From llvm-testresults at cs.uiuc.edu Thu Nov 1 00:54:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 02:54:13 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121101075413.2D38F2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/5478?compare_to=5476&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5478, Order: 167216, Start Time: 2012-11-01 06:27:31, End Time: 2012-11-01 07:54:16 To: 5476, Order: 167210, Start Time: 2012-11-01 04:44:27, End Time: 2012-11-01 06:10:32 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 12 (94 on baseline) Performance Improvements: 0 (6 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 979 (874 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.68% (0.1850 => 0.1992, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.58% (0.4808 => 0.5028, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.18% (0.4862 => 0.4968, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.06% (0.6029 => 0.6153, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.76% (1.1383 => 1.1583, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.72% (4.2382 => 4.3112, std.dev.: 0.0146) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.70% (1.2640 => 1.2855, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.62% (0.9704 => 0.9861, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.46% (0.9261 => 0.9396, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.11% (11.2399 => 11.5900, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/hash: 2.22% (0.6267 => 0.6406, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/ReedSolomon: 1.03% (8.6801 => 8.7692, std.dev.: 0.0230) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.25% (16.7146 => 16.7558, std.dev.: 0.1864) MultiSource/Applications/obsequi/Obsequi: 3.07% (1.0386 => 1.0705, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.53% (21.8456 => 21.7300, std.dev.: 0.2946) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.94% (0.3625 => 0.3659, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -0.08% (0.6038 => 0.6033, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.3325 => 0.3325, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/strcat: -0.84% (0.2023 => 0.2006, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 3.77% (0.0212 => 0.0220, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 23.68% (0.0342 => 0.0423, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0328 => 0.0328, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0311 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.53% (0.0380 => 0.0420, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0203 => 0.0202, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 43.71% (0.0151 => 0.0217, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.28% (0.1434 => 0.1438, std.dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.23% (1.1109 => 1.1134, std.dev.: 0.0161) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 2.08% (0.1441 => 0.1471, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.02% (0.4054 => 0.4055, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.49% (0.1347 => 0.1300, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.16% (0.0611 => 0.0612, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.96% (0.0203 => 0.0197, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.87% (0.0588 => 0.0599, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.14% (1.1417 => 1.1433, std.dev.: 0.0482) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.33% (0.0030 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -88.89% (0.0009 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.73% (0.0579 => 0.0569, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.94% (0.0242 => 0.0201, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.06% (0.8010 => 0.8015, std.dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 26.09% (0.0069 => 0.0087, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2318.56% (0.6332 => 15.3143, std.dev.: 0.1864) MultiSource/Benchmarks/McCat/08-main/main: 43.20% (0.1831 => 0.2622, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -13.86% (0.1559 => 0.1343, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1496.26% (0.3344 => 5.3379, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: 34.26% (0.2364 => 0.3174, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0429 => 0.0439, std.dev.: 0.0022) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.34% (0.0224 => 0.0221, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3587, std.dev.: 0.0363) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0695, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4957, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3414, std.dev.: 0.0149) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0287, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4058, std.dev.: 0.0020) SingleSource/Regression/C/uint64_to_float: -23.96% (2.1832 => 1.6602, std.dev.: 0.0017) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.19% (0.0810 => 0.0933, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: 11.33% (0.1112 => 0.1238, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.85% (0.2180 => 0.2373, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.86% (0.8321 => 0.8892, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.2279 => 0.2435, std.dev.: 0.0024) MultiSource/Applications/spiff/spiff: 5.86% (0.7950 => 0.8416, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.68% (0.1885 => 0.1992, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.10% (0.2998 => 0.3151, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.04% (0.7473 => 0.7850, std.dev.: 0.0054) MultiSource/Benchmarks/nbench/nbench: 4.78% (1.1271 => 1.1810, std.dev.: 0.0099) MultiSource/Applications/Burg/burg: 4.72% (1.2222 => 1.2799, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.52% (0.9435 => 0.9861, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 4.37% (0.2999 => 0.3130, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 4.29% (14.7684 => 15.4013, std.dev.: 0.0688) MultiSource/Applications/SIBsim4/SIBsim4: 4.27% (1.2568 => 1.3105, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.20% (1.1606 => 1.2093, std.dev.: 0.0112) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.87% (0.4783 => 0.4968, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.84% (0.4559 => 0.4734, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.82% (0.6227 => 0.6465, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.75% (0.9056 => 0.9396, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.73% (0.4847 => 0.5028, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.70% (1.1170 => 1.1583, std.dev.: 0.0028) MultiSource/Applications/d/make_dparser: 3.68% (3.2366 => 3.3557, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.59% (0.6287 => 0.6513, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.52% (1.6386 => 1.6963, std.dev.: 0.0069) MultiSource/Applications/treecc/treecc: 3.36% (1.9948 => 2.0619, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.36% (0.6586 => 0.6807, std.dev.: 0.0053) MultiSource/Applications/hbd/hbd: 3.26% (1.4269 => 1.4734, std.dev.: 0.0070) MultiSource/Applications/SPASS/SPASS: 3.25% (14.2605 => 14.7240, std.dev.: 0.0790) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.25% (0.4127 => 0.4261, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.23% (4.1763 => 4.3112, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.22% (0.5961 => 0.6153, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.09% (6.6074 => 6.8116, std.dev.: 0.0261) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.06% (0.8148 => 0.8397, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.05% (0.8697 => 0.8962, std.dev.: 0.0071) MultiSource/Applications/minisat/minisat: 3.01% (0.6834 => 0.7040, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.01% (0.8286 => 0.8535, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.97% (0.8317 => 0.8564, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.90% (0.9688 => 0.9969, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.88% (0.8050 => 0.8282, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.84% (0.8597 => 0.8841, std.dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: 2.77% (8.4179 => 8.6510, std.dev.: 0.0594) MultiSource/Benchmarks/Prolangs-C/football/football: 2.74% (0.8768 => 0.9008, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.74% (0.8007 => 0.8226, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.71% (1.3279 => 1.3639, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.67% (0.7932 => 0.8144, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.67% (0.8359 => 0.8582, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.66% (0.9069 => 0.9310, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.63% (1.2526 => 1.2855, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.52% (0.8805 => 0.9027, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.51% (0.8716 => 0.8935, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.51% (0.5817 => 0.5963, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.50% (0.8331 => 0.8539, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.49% (8.6476 => 8.8628, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.48% (0.9074 => 0.9299, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.46% (13.1811 => 13.5060, std.dev.: 0.0541) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.45% (0.8338 => 0.8542, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.45% (0.8261 => 0.8463, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.41% (4.4873 => 4.5954, std.dev.: 0.0227) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.39% (0.8086 => 0.8279, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.37% (0.8885 => 0.9096, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.35% (0.9039 => 0.9251, std.dev.: 0.0081) MultiSource/Benchmarks/mafft/pairlocalalign: 2.34% (8.6247 => 8.8262, std.dev.: 0.0510) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.33% (0.9908 => 1.0139, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.30% (0.8340 => 0.8532, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.30% (0.8177 => 0.8365, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.30% (0.8656 => 0.8855, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.22% (0.7966 => 0.8143, std.dev.: 0.0063) MultiSource/Applications/siod/siod: 2.20% (2.2184 => 2.2673, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.20% (0.8712 => 0.8904, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.20% (0.8855 => 0.9050, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.11% (2.1401 => 2.1853, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.11% (0.8204 => 0.8377, std.dev.: 0.0060) MultiSource/Applications/lua/lua: 2.00% (3.8189 => 3.8951, std.dev.: 0.0286) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.91% (1.5315 => 1.5608, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.90% (1.2602 => 1.2842, std.dev.: 0.0064) MultiSource/Benchmarks/Bullet/bullet: 1.90% (31.8598 => 32.4640, std.dev.: 0.2176) MultiSource/Benchmarks/MallocBench/gs/gs: 1.84% (4.1305 => 4.2063, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.81% (0.8048 => 0.8194, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (3.1832 => 3.2407, std.dev.: 0.0143) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.76% (0.8995 => 0.9153, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.66% (4.5702 => 4.6459, std.dev.: 0.0114) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.23% (4.4880 => 4.5433, std.dev.: 0.0141) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.47% (1.5795 => 2.5031, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.52% (2.7978 => 3.7356, std.dev.: 0.0061) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.40% (2.4333 => 2.6863, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.46% (1.1857 => 1.2742, std.dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: 5.91% (63.1822 => 66.9183, std.dev.: 0.0562) SingleSource/Benchmarks/Shootout-C++/hash: 3.24% (0.6205 => 0.6406, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/ReedSolomon: 2.78% (8.5322 => 8.7692, std.dev.: 0.0230) MultiSource/Applications/siod/siod: 2.78% (3.6643 => 3.7660, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.67% (2.4490 => 2.5145, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/bh/bh: 1.64% (2.3560 => 2.3947, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.33% (59.2638 => 60.0497, std.dev.: 0.1630) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -35.21% (0.0338 => 0.0219, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.29% (0.3269 => 0.2998, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/heapsort: -7.40% (3.2926 => 3.0490, std.dev.: 0.0762) MultiSource/Applications/lua/lua: -4.96% (29.8330 => 28.3543, std.dev.: 0.1722) SingleSource/Benchmarks/Shootout-C++/hash2: -1.40% (3.4237 => 3.3758, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.24% (3.3479 => 3.3064, std.dev.: 0.0011) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.88% (16.4461 => 16.7558, std.dev.: 0.1864) MultiSource/Applications/obsequi/Obsequi: 4.32% (1.0262 => 1.0705, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6858.05% (0.3123 => 21.7300, std.dev.: 0.2946) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.56% (0.2463 => 0.3659, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 0.38% (0.6010 => 0.6033, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.81% (0.3266 => 0.3325, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/strcat: 1.88% (0.1969 => 0.2006, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.68% (0.0408 => 0.0423, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.13% (0.0254 => 0.0328, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.38% (0.0384 => 0.0420, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: - (0.1438 => 0.1438, std.dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -1.72% (1.1329 => 1.1134, std.dev.: 0.0161) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.62% (0.1462 => 0.1471, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.62% (0.4164 => 0.4055, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.04% (0.1369 => 0.1300, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.52% (0.0641 => 0.0612, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.03% (0.0195 => 0.0197, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.63% (0.0578 => 0.0599, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.03% (1.1437 => 1.1433, std.dev.: 0.0482) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.25% (0.0627 => 0.0569, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 11.67% (0.0180 => 0.0201, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.02% (0.8017 => 0.8015, std.dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 40.32% (0.0062 => 0.0087, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 01:12:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 03:12:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121101081257.CA9AF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5479?compare_to=5475&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5479, Order: 167216, Start Time: 2012-11-01 06:38:02, End Time: 2012-11-01 08:12:59 To: 5475, Order: 167210, Start Time: 2012-11-01 04:35:18, End Time: 2012-11-01 06:08:22 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 0 (171 on baseline) Performance Improvements: 1 (52 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 2 (2 on baseline) Unchanged Tests: 1039 (666 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.01% (29.7972 => 29.4951, std.dev.: 0.1000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: - (0.1403 => 0.1403, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.63% (0.0673 => 0.0662, std.dev.: 0.0025) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 190.97% (0.5229 => 1.5215, std.dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 13.24% (14.9895 => 16.9745, std.dev.: 0.0159) MultiSource/Applications/kimwitu++/kc: 36.26% (14.1553 => 19.2882, std.dev.: 0.0210) MultiSource/Benchmarks/MallocBench/gs/gs: 12.41% (4.1105 => 4.6205, std.dev.: 0.0200) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 29.28% (1.1048 => 1.4283, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 307.14% (7.1582 => 29.1436, std.dev.: 0.1626) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.90% (3.4629 => 5.8488, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 63.32% (0.6222 => 1.0162, std.dev.: 0.0021) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10599.72% (0.0720 => 7.7038, std.dev.: 0.0071) MultiSource/Applications/SIBsim4/SIBsim4: 3837000.00% (0.0001 => 3.8371, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 11174200.00% (0.0001 => 11.1743, std.dev.: 0.0241) MultiSource/Applications/kimwitu++/kc: 51000.00% (0.0001 => 0.0511, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63800.00% (0.0001 => 0.0639, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 781200.00% (0.0001 => 0.7813, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050400.00% (0.0001 => 10.0505, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488400.00% (0.0001 => 5.4885, std.dev.: 0.0410) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 37.97% (0.1056 => 0.1457, std.dev.: 0.0013) SingleSource/UnitTests/vla: 29.58% (0.0355 => 0.0460, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 28.21% (0.1432 => 0.1836, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.31% (0.1566 => 0.1884, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 19.32% (0.0730 => 0.0871) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 18.13% (0.3177 => 0.3753, std.dev.: 0.0090) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.28% (0.0793 => 0.0930, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 17.02% (0.1175 => 0.1375, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.87% (0.4879 => 0.5702, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.78% (0.8172 => 0.9543, std.dev.: 0.0256) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.76% (0.0871 => 0.1017, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 16.76% (0.0746 => 0.0871, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 16.48% (0.2554 => 0.2975, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.42% (0.0798 => 0.0929, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.35% (0.0834 => 0.0962, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.34% (0.1584 => 0.1827, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.96% (0.0842 => 0.0968, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.79% (0.0730 => 0.0838, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/em3d/em3d: 14.63% (0.1695 => 0.1943, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.45% (0.0886 => 0.1014, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 14.45% (0.1163 => 0.1331, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 14.26% (0.1655 => 0.1891, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 14.15% (0.1555 => 0.1775, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.07% (0.2700 => 0.3080, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 14.05% (0.5105 => 0.5822, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.04% (0.2065 => 0.2355, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.97% (0.1117 => 0.1273, std.dev.: 0.0022) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.74% (0.1143 => 0.1300, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.72% (0.1625 => 0.1848, std.dev.: 0.0065) MultiSource/Applications/spiff/spiff: 13.59% (0.7835 => 0.8900, std.dev.: 0.0051) MultiSource/Applications/minisat/minisat: 13.55% (0.7115 => 0.8079, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.51% (0.1940 => 0.2202, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.45% (0.2758 => 0.3129, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.44% (0.6675 => 0.7572, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.39% (0.5981 => 0.6782, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.39% (0.1337 => 0.1516, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 13.38% (0.1151 => 0.1305, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.38% (0.0770 => 0.0873, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: 13.37% (1.1642 => 1.3198, std.dev.: 0.0090) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.33% (0.1125 => 0.1275, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.30% (0.4615 => 0.5229, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.30% (0.9765 => 1.1064, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.25% (0.0770 => 0.0872, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.24% (2.2022 => 2.4937, std.dev.: 0.0036) MultiSource/Applications/sgefa/sgefa: 13.22% (0.3109 => 0.3520, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.15% (0.2107 => 0.2384, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 13.12% (0.7433 => 0.8408, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.05% (0.5860 => 0.6625, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.05% (0.1510 => 0.1707, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.99% (0.2271 => 0.2566, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.91% (0.3121 => 0.3524, std.dev.: 0.0055) MultiSource/Applications/d/make_dparser: 12.89% (3.3354 => 3.7654, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.83% (1.5415 => 1.7392, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.63% (0.1029 => 0.1159, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/exptree: 12.53% (0.0814 => 0.0916, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.52% (0.1062 => 0.1195, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.44% (0.5569 => 0.6262, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.31% (0.1032 => 0.1159, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.23% (0.3441 => 0.3862, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.14% (0.1236 => 0.1386, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.03% (1.3050 => 1.4620, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.97% (0.5020 => 0.5621, std.dev.: 0.0032) MultiSource/Applications/lua/lua: 11.93% (3.8723 => 4.3344, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/health/health: 11.91% (0.1268 => 0.1419, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.76% (0.3307 => 0.3696, std.dev.: 0.0037) MultiSource/Applications/treecc/treecc: 11.73% (2.0273 => 2.2652, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/18-imp/imp: 11.45% (0.3423 => 0.3815, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.37% (0.2603 => 0.2899, std.dev.: 0.0042) SingleSource/UnitTests/SignlessTypes/rem: 11.28% (0.1144 => 0.1273) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.19% (4.2646 => 4.7417, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.18% (0.6450 => 0.7171, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 11.08% (1.0722 => 1.1910, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 11.07% (0.1463 => 0.1625, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.00% (1.5859 => 1.7604, std.dev.: 0.0158) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.91% (0.1695 => 0.1880, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.87% (0.0929 => 0.1030, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 10.83% (0.0933 => 0.1034, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 10.79% (9.4845 => 10.5078, std.dev.: 0.0136) SingleSource/UnitTests/ObjC/parameter-passing: 10.75% (0.3927 => 0.4349, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.71% (2.2024 => 2.4383, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 10.61% (0.4299 => 0.4755, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/trivial-interface: 10.57% (0.3473 => 0.3840, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.52% (8.1363 => 8.9921, std.dev.: 0.0129) SingleSource/UnitTests/ObjC/exceptions: 10.50% (0.3828 => 0.4230, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.44% (0.3543 => 0.3913, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 10.44% (0.3180 => 0.3512, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 10.43% (2.2969 => 2.5364, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/for-in: 10.42% (0.3694 => 0.4079, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.41% (0.3543 => 0.3912, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 10.40% (0.8921 => 0.9849, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/synchronized: 10.36% (0.3561 => 0.3930, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.35% (0.3497 => 0.3859, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.30% (0.3516 => 0.3878, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 10.25% (0.6456 => 0.7118, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 10.19% (1.1840 => 1.3047, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/property: 10.14% (0.3886 => 0.4280, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 10.04% (0.3387 => 0.3727, std.dev.: 0.0092) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.01% (0.8101 => 0.8912, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: 9.85% (1.5603 => 1.7140, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.72% (1.1861 => 1.3014, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.51% (1.4186 => 1.5535, std.dev.: 0.0114) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.46% (0.1892 => 0.2071, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.46% (0.4103 => 0.4491, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/hash: 9.42% (0.4289 => 0.4693, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 9.35% (0.4620 => 0.5052, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.35% (0.4203 => 0.4596, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.06% (0.3865 => 0.4215, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.80% (5.0018 => 5.4418, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.77% (4.9449 => 5.3786, std.dev.: 0.0122) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.72% (0.1330 => 0.1446, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists: 8.71% (0.3422 => 0.3720, std.dev.: 0.0019) SingleSource/Benchmarks/Stanford/Puzzle: 8.60% (0.1268 => 0.1377, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 8.58% (0.3603 => 0.3912, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.52% (0.4636 => 0.5031, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.31% (0.2430 => 0.2632, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 8.25% (0.3684 => 0.3988, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 8.20% (5.7591 => 6.2311, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.19% (0.3650 => 0.3949, std.dev.: 0.0079) SingleSource/UnitTests/ObjC++/property-reference-object: 8.04% (0.6030 => 0.6515, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.00% (0.5925 => 0.6399, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.92% (0.3826 => 0.4129, std.dev.: 0.0105) SingleSource/UnitTests/ObjC++/property-reference: 7.84% (0.7326 => 0.7900, std.dev.: 0.0025) SingleSource/Regression/C++/ofstream_ctor: 7.44% (0.2905 => 0.3121, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.17% (0.2831 => 0.3034, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.16% (0.2891 => 0.3098, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.15% (0.3162 => 0.3388, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.12% (0.2793 => 0.2992, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.07% (0.2872 => 0.3075, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.06% (14.3668 => 15.3815, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.06% (0.4064 => 0.4351, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 7.01% (0.3283 => 0.3513, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.96% (0.3232 => 0.3457, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.91% (0.3098 => 0.3312, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.80% (0.3427 => 0.3660, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.76% (0.2871 => 0.3065, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.76% (0.8067 => 0.8612, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.75% (0.2756 => 0.2942, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 6.74% (0.2877 => 0.3071, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.61% (0.2725 => 0.2905, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 6.60% (0.2714 => 0.2893, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 6.59% (0.3052 => 0.3253, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 6.52% (0.3282 => 0.3496, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 6.52% (17.1811 => 18.3012, std.dev.: 0.0060) MultiSource/Applications/hexxagon/hexxagon: 6.44% (1.2842 => 1.3669, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/random: 6.32% (0.2802 => 0.2979, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.27% (0.2266 => 0.2408, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.24% (3.8922 => 4.1349, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/bh/bh: 5.89% (0.3092 => 0.3274, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: 5.74% (0.3379 => 0.3573, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/objinst: 4.73% (0.3131 => 0.3279, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.95% (0.3935 => 0.4051, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.86% (0.3817 => 0.3926, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.40% (7.0540 => 7.2233, std.dev.: 0.0158) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 19.81% (2.8904 => 3.4629, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.55% (1.1145 => 1.2990, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.93% (1.1396 => 1.2528, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3686, std.dev.: 0.0021) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.80% (4.2280 => 4.3463, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7650, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.18% (3.6395 => 3.7190, std.dev.: 0.0056) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2076, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.32% (11.6436 => 11.7977, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5783, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.93% (6.6874 => 0.1387, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -76.21% (0.8651 => 0.2058, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -54.99% (5.3855 => 2.4238, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.61% (5.3526 => 2.4294, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/richards_benchmark: -45.68% (0.1622 => 0.0881, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.88% (5.2763 => 3.1192, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -38.00% (1.1194 => 0.6940, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -24.06% (1.7609 => 1.3373, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.51% (2.9384 => 2.5414, std.dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: -10.32% (10.4361 => 9.3588, std.dev.: 0.0229) SingleSource/UnitTests/Vector/constpool: -9.08% (54.1659 => 49.2459, std.dev.: 0.0173) MultiSource/Benchmarks/Bullet/bullet: -7.48% (63.2438 => 58.5120, std.dev.: 0.0166) MultiSource/Benchmarks/PAQ8p/paq8p: -6.04% (10.3673 => 9.7411, std.dev.: 0.1184) MultiSource/Applications/ClamAV/clamscan: -3.35% (22.1758 => 21.4322, std.dev.: 0.0447) MultiSource/Applications/JM/lencod/lencod: -2.07% (21.9371 => 21.4826, std.dev.: 0.0306) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -35.14% (0.3987 => 0.2586, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.40% (1.1492 => 0.7654, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -28.82% (10.7105 => 7.6236, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4246, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -11.03% (1.5373 => 1.3678, std.dev.: 0.0040) MultiSource/Benchmarks/NPB-serial/is/is: -11.00% (9.5636 => 8.5120, std.dev.: 0.0379) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2977, std.dev.: 0.0093) MultiSource/Benchmarks/FreeBench/mason/mason: -7.96% (0.2161 => 0.1989, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.21% (1.8329 => 1.7007, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.76% (1.2373 => 1.1536, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0145) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.11% (1.6805 => 1.5946, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: -4.99% (6.6465 => 6.3148, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.60% (1.5660 => 1.4939, std.dev.: 0.0251) SingleSource/Benchmarks/Misc/flops-5: -4.48% (1.5835 => 1.5126, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.04% (0.2497 => 0.2396, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.03% (0.9957 => 0.9556, std.dev.: 0.0097) MultiSource/Applications/siod/siod: -3.77% (3.2827 => 3.1588, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -3.76% (4.5009 => 4.3316, std.dev.: 0.0076) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.51% (32.5116 => 31.3714, std.dev.: 0.0106) MultiSource/Benchmarks/sim/sim: -3.24% (5.0483 => 4.8849, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -2.78% (4.6441 => 4.5148, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.62% (0.4808 => 0.4682, std.dev.: 0.0015) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/Olden/power/power: -2.14% (1.1277 => 1.1036, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.97% (10.2830 => 10.0800, std.dev.: 0.0277) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.84% (8.1563 => 8.0063, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6824, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.51% (2.5528 => 2.5143, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2303, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8584, std.dev.: 0.0176) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -5.52% (0.1485 => 0.1403, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.71% (0.2116 => 0.0662, std.dev.: 0.0025) Report Time: 2.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 01:21:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 03:21:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121101082133.07CD72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5480?compare_to=5472&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5480, Order: 167210, Start Time: 2012-11-01 05:03:13, End Time: 2012-11-01 08:21:35 To: 5472, Order: 167184, Start Time: 2012-11-01 00:59:10, End Time: 2012-11-01 04:14:49 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (169 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1039 (721 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.41% (0.8323 => 0.8440, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 8.81% (109.0162 => 118.6191, std.dev.: 0.0828) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.19% (54.2332 => 54.8789, std.dev.: 0.0996) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.52% (0.0625 => 0.0872, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.23% (0.1063 => 0.1395, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.56% (0.2969 => 0.3728, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.32% (0.4253 => 0.5330, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.23% (0.1106 => 0.1385, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.86% (0.4139 => 0.5168, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.31% (0.4994 => 0.6208, std.dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 23.37% (1.5932 => 1.9656, std.dev.: 0.0155) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.34% (0.5900 => 0.7277, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.25% (0.0714 => 0.0880, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.96% (0.1620 => 0.1992, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.58% (0.5000 => 0.6129, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.43% (0.0584 => 0.0715, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.55% (0.1021 => 0.1241, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.33% (0.0633 => 0.0768, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.23% (0.1107 => 0.1342, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.07% (0.0897 => 0.1086, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 20.57% (0.0948 => 0.1143, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.52% (0.0541 => 0.0652, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.38% (0.0584 => 0.0703, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.25% (0.0642 => 0.0772, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.13% (0.1103 => 0.1325, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.01% (0.3903 => 0.4684, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.95% (0.1604 => 0.1924, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.94% (0.1003 => 0.1203, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.88% (0.1549 => 0.1857, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 19.85% (0.0821 => 0.0984, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.83% (0.0822 => 0.0985, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 19.77% (0.1619 => 0.1939, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 19.55% (0.5826 => 0.6965, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 18.90% (0.5889 => 0.7002, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 18.59% (0.0947 => 0.1123, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.33% (0.1462 => 0.1730, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.20% (0.3890 => 0.4598, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 18.19% (0.0808 => 0.0955, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.02% (0.2014 => 0.2377, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 17.98% (0.1218 => 0.1437, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.90% (0.2866 => 0.3379, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 17.81% (0.1505 => 0.1773, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 17.70% (0.7171 => 0.8440, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.68% (1.3152 => 1.5477, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/mst/mst: 17.62% (0.0698 => 0.0821, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 17.55% (0.4029 => 0.4736, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.53% (0.2875 => 0.3379, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.46% (0.1088 => 0.1278, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.43% (0.2736 => 0.3213, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.24% (0.2738 => 0.3210, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/fibo: 16.99% (0.2725 => 0.3188, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 16.97% (0.9697 => 1.1343, std.dev.: 0.0037) MultiSource/Applications/Burg/burg: 16.80% (0.5546 => 0.6478, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hello: 16.76% (0.2714 => 0.3169, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 16.76% (1.8794 => 2.1943, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.69% (3.5627 => 4.1572, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.60% (0.2729 => 0.3182, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.57% (0.4658 => 0.5430, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.55% (0.1160 => 0.1352, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 16.54% (0.2823 => 0.3290, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.49% (1.6211 => 1.8884, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 16.47% (0.2780 => 0.3238, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.46% (0.1968 => 0.2292, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 16.42% (0.2813 => 0.3275, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.41% (0.5026 => 0.5851, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 16.41% (0.3004 => 0.3497, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 16.41% (0.2803 => 0.3263, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 16.40% (0.2811 => 0.3272, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 16.36% (0.2750 => 0.3200, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.34% (0.3195 => 0.3717, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.31% (2.0673 => 2.4044, std.dev.: 0.0447) MultiSource/Benchmarks/Bullet/bullet: 16.27% (23.5202 => 27.3461, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/wc: 16.25% (0.3096 => 0.3599, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.23% (0.3271 => 0.3802, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.22% (0.2792 => 0.3245, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.21% (0.2911 => 0.3383, std.dev.: 0.0108) MultiSource/Applications/hexxagon/hexxagon: 16.14% (0.9909 => 1.1508, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/18-imp/imp: 15.90% (0.1421 => 0.1647, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 15.76% (0.3267 => 0.3782, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.74% (2.7292 => 3.1588, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.71% (0.4361 => 0.5046, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 15.68% (1.0781 => 1.2471, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.67% (0.3930 => 0.4546, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary: 15.65% (0.3258 => 0.3768, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.62% (0.3060 => 0.3538, std.dev.: 0.0108) MultiSource/Benchmarks/Olden/bh/bh: 15.58% (0.1284 => 0.1484, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 15.47% (0.3317 => 0.3830, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.42% (4.4195 => 5.1012, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.38% (0.3362 => 0.3879, std.dev.: 0.0143) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.21% (0.3845 => 0.4430, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.20% (0.3124 => 0.3599, std.dev.: 0.0078) MultiSource/Applications/ClamAV/clamscan: 15.18% (4.2109 => 4.8503, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.10% (1.9694 => 2.2667, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.07% (1.9966 => 2.2975, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists: 14.93% (0.3348 => 0.3848, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 14.87% (0.3678 => 0.4225, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 14.87% (0.3477 => 0.3994, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.81% (0.3282 => 0.3768, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/hash: 14.79% (0.4146 => 0.4759, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 14.68% (0.3726 => 0.4273, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 14.58% (0.2566 => 0.2940, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.54% (0.3625 => 0.4152, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 14.37% (0.4251 => 0.4862, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.31% (0.1090 => 0.1246, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.27% (0.3981 => 0.4549, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.25% (0.3690 => 0.4216, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/synchronized: 13.92% (0.3469 => 0.3952, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 13.90% (0.3496 => 0.3982, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 13.90% (0.3446 => 0.3925, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 13.88% (0.3465 => 0.3946, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 13.84% (0.3460 => 0.3939, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.79% (0.3488 => 0.3969, std.dev.: 0.0015) MultiSource/Applications/lua/lua: 13.77% (1.4269 => 1.6234, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/trivial-interface: 13.65% (0.3442 => 0.3912, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 13.54% (0.2075 => 0.2356, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 13.49% (0.5012 => 0.5688, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 13.40% (0.7875 => 0.8930, std.dev.: 0.0074) SingleSource/UnitTests/ObjC/exceptions: 13.40% (0.3643 => 0.4131, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/parameter-passing: 13.32% (0.3724 => 0.4220, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 13.29% (0.3650 => 0.4135, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 13.23% (2.1653 => 2.4518, std.dev.: 0.0052) MultiSource/Applications/JM/lencod/lencod: 12.85% (4.6177 => 5.2112, std.dev.: 0.0141) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.82% (0.6435 => 0.7260, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 12.58% (2.1013 => 2.3657, std.dev.: 0.0089) MultiSource/Benchmarks/PAQ8p/paq8p: 12.07% (0.4847 => 0.5432, std.dev.: 0.0167) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.06% (0.2040 => 0.2286, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 11.74% (0.2691 => 0.3007, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 11.61% (5.5417 => 6.1853, std.dev.: 0.0077) MultiSource/Applications/lambda-0_1_3/lambda: 11.61% (0.3498 => 0.3904, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.33% (0.2737 => 0.3047, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.19% (0.1028 => 0.1143, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.17% (0.2068 => 0.2299, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.02% (0.3084 => 0.3424, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 10.94% (0.6634 => 0.7360, std.dev.: 0.0059) MultiSource/Applications/minisat/minisat: 10.40% (0.3336 => 0.3683, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.27% (0.1383 => 0.1525, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.80% (0.2103 => 0.2309, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.40% (4.6926 => 5.1337, std.dev.: 0.0067) MultiSource/Applications/sqlite3/sqlite3: 9.18% (2.0346 => 2.2213, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: 9.08% (0.2391 => 0.2608, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.96% (11.6398 => 12.6824, std.dev.: 0.0313) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.24% (0.5361 => 0.5803, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.06% (0.5584 => 0.6034, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.69% (0.7426 => 0.7997, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 7.11% (11.9555 => 12.8054, std.dev.: 0.0176) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.43% (0.3792 => 0.3960, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.32% (0.2162 => 0.3531, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6537, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 9.24% (0.2802 => 0.3061, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6107, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 4.98% (12.0509 => 12.6510, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary: 4.90% (0.2122 => 0.2226, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 4.74% (15.4430 => 16.1756, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-2: 3.87% (1.8057 => 1.8756, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/dry: 2.75% (14.0481 => 14.4339, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2042, std.dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2240, std.dev.: 0.0016) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3054, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2878, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.23% (1.0142 => 1.0267, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5406, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6026, std.dev.: 0.0192) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.55% (25.4195 => 16.3836, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/ary2: -7.95% (0.2402 => 0.2211, std.dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9772, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7752, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/tsp/tsp: -7.16% (2.1113 => 1.9601, std.dev.: 0.0203) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.94% (0.6293 => 0.6108, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -2.90% (11.2080 => 10.8825, std.dev.: 0.0185) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5219, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -2.64% (17.2379 => 16.7830, std.dev.: 0.0302) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.19% (41.7953 => 40.8796, std.dev.: 0.0208) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5788, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4966, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.32% (5.7935 => 5.7168, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.1973, std.dev.: 0.0564) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0425, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.06% (3.3991 => 3.3629, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 01:50:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 03:50:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121101085017.CB82F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5481?compare_to=5477&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5481, Order: 167217, Start Time: 2012-11-01 07:24:39, End Time: 2012-11-01 08:50:19 To: 5477, Order: 167211, Start Time: 2012-11-01 05:31:28, End Time: 2012-11-01 06:56:37 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (179 on baseline) Unchanged Tests: 1042 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.15% (3.1919 => 3.4200, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.68% (2.0478 => 2.1027, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: 2.36% (7.4937 => 7.6709, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/hash2: 2.19% (3.1932 => 3.2630, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.65% (0.1584 => 0.1447, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.53% (0.1431 => 0.1309, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.09% (0.3821 => 0.3550, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -7.03% (2.4924 => 2.3173, std.dev.: 0.0143) SingleSource/UnitTests/ObjC/trivial-interface: -6.74% (0.3812 => 0.3555, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.68% (0.3831 => 0.3575, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.68% (0.3891 => 0.3631, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.68% (0.3848 => 0.3591, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -6.59% (0.4176 => 0.3901, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.57% (0.3880 => 0.3625, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -6.57% (0.4033 => 0.3768, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.57% (0.3884 => 0.3629, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: -6.49% (0.3896 => 0.3643, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -6.38% (0.4199 => 0.3931, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.30% (0.3142 => 0.2944, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -6.24% (0.4280 => 0.4013, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.93% (0.4151 => 0.3905, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: -5.89% (0.2989 => 0.2813, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.88% (0.9542 => 0.8981, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.88% (0.3658 => 0.3443, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.85% (0.2428 => 0.2286, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.85% (22.4056 => 21.0955, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.82% (4.5069 => 4.2444, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.82% (0.3057 => 0.2879, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.82% (0.2871 => 0.2704, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -5.78% (16.1920 => 15.2562, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.76% (0.3837 => 0.3616, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.75% (0.2903 => 0.2736, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.74% (2.1713 => 2.0466, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.72% (0.7198 => 0.6786, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.72% (0.6484 => 0.6113, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: -5.72% (0.3059 => 0.2884, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -5.69% (0.3446 => 0.3250, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.69% (0.3323 => 0.3134, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: -5.67% (1.3148 => 1.2403, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: -5.66% (0.3394 => 0.3202, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.64% (3.5339 => 3.3346, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: -5.61% (7.0961 => 6.6982, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/random: -5.58% (0.2939 => 0.2775, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.57% (0.3194 => 0.3016, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.57% (0.3016 => 0.2848, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.55% (0.3025 => 0.2857, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -5.52% (0.3205 => 0.3028, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -5.52% (0.3481 => 0.3289, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -5.50% (0.3621 => 0.3422, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.49% (4.8161 => 4.5517, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.49% (0.4083 => 0.3859, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.47% (0.3931 => 0.3716, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: -5.47% (1.2515 => 1.1831, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/oourafft: -5.46% (0.2160 => 0.2042, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.42% (0.4321 => 0.4087, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.41% (0.3252 => 0.3076, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.41% (0.3255 => 0.3079, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -5.40% (0.3867 => 0.3658, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -5.39% (0.3357 => 0.3176, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: -5.39% (0.3026 => 0.2863, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: -5.38% (4.3330 => 4.0997, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.38% (4.8802 => 4.6178, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hello: -5.37% (0.2849 => 0.2696, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -5.37% (34.0927 => 32.2631, std.dev.: 0.0294) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.35% (0.2355 => 0.2229, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: -5.34% (0.4248 => 0.4021, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.34% (1.0544 => 0.9981, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.33% (0.3849 => 0.3644, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.30% (0.2659 => 0.2518, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -5.29% (0.4861 => 0.4604, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.26% (5.4682 => 5.1805, std.dev.: 0.0151) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.24% (0.4813 => 0.4561, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.23% (4.0323 => 3.8216, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.22% (0.2548 => 0.2415, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.15% (0.4427 => 0.4199, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -5.15% (0.3788 => 0.3593, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.14% (14.2083 => 13.4778, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: -5.14% (0.6750 => 0.6403, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.14% (0.9852 => 0.9346, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.11% (0.7919 => 0.7514, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.09% (0.6293 => 0.5973, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.08% (0.5999 => 0.5694, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.08% (1.6364 => 1.5533, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: -5.03% (0.7779 => 0.7388, std.dev.: 0.0051) MultiSource/Applications/siod/siod: -5.01% (2.4021 => 2.2817, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.00% (1.2784 => 1.2145, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.00% (1.6474 => 1.5651, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.95% (1.2300 => 1.1691, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.93% (0.8521 => 0.8101, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: -4.91% (17.1032 => 16.2627, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/football/football: -4.91% (0.9179 => 0.8728, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.89% (1.3722 => 1.3051, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -4.88% (1.1450 => 1.0891, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -4.88% (18.2933 => 17.4008, std.dev.: 0.0218) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.84% (0.2933 => 0.2791, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -4.82% (0.2985 => 0.2841, std.dev.: 0.0011) MultiSource/Applications/lua/lua: -4.82% (4.0594 => 3.8639, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.79% (0.5591 => 0.5323, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.77% (1.2221 => 1.1638, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.76% (0.5478 => 0.5217, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.75% (1.4642 => 1.3946, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -4.75% (0.6441 => 0.6135, std.dev.: 0.0090) MultiSource/Benchmarks/mafft/pairlocalalign: -4.75% (9.2283 => 8.7904, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.74% (0.5925 => 0.5644, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.71% (0.3483 => 0.3319, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.70% (0.2278 => 0.2171, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: -4.70% (0.6347 => 0.6049, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.69% (6.7716 => 6.4541, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.69% (0.6230 => 0.5938, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: -4.69% (0.4524 => 0.4312, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.67% (0.3491 => 0.3328, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.66% (0.5857 => 0.5584, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.65% (0.5802 => 0.5532, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: -4.61% (0.7447 => 0.7104, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.61% (0.5863 => 0.5593, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.59% (1.2210 => 1.1649, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: -4.58% (0.3581 => 0.3417, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.57% (2.2587 => 2.1554, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: -4.57% (0.7982 => 0.7617, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.55% (0.6194 => 0.5912, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.53% (0.2999 => 0.2863, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.51% (0.6052 => 0.5779, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: -4.50% (0.4515 => 0.4312, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.49% (0.5569 => 0.5319, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.49% (0.5705 => 0.5449, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.48% (0.5575 => 0.5325, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.48% (0.6297 => 0.6015, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.48% (0.6681 => 0.6382, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.48% (0.4916 => 0.4696, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.47% (0.7339 => 0.7011, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.47% (0.9557 => 0.9130, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.46% (0.5581 => 0.5332, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.44% (0.6667 => 0.6371, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.40% (0.5570 => 0.5325, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.39% (0.6260 => 0.5985, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.38% (0.5805 => 0.5551, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.34% (0.6660 => 0.6371, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.34% (0.5859 => 0.5605, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.33% (0.6189 => 0.5921, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.33% (0.6446 => 0.6167, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.32% (0.2385 => 0.2282, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -4.32% (0.3406 => 0.3259, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.31% (0.6304 => 0.6032, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -4.29% (15.5079 => 14.8433, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.28% (0.6676 => 0.6390, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.25% (0.6440 => 0.6166, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.24% (0.5849 => 0.5601, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.22% (0.5567 => 0.5332, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.22% (0.3319 => 0.3179, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.22% (0.5456 => 0.5226, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.21% (0.6033 => 0.5779, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -4.18% (1.3864 => 1.3285, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.18% (0.6395 => 0.6128, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.17% (8.0126 => 7.6781, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.16% (0.7524 => 0.7211, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.16% (0.2695 => 0.2583, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.11% (0.6395 => 0.6132, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.11% (0.6736 => 0.6459, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.11% (0.5941 => 0.5697, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -4.08% (2.1401 => 2.0527, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.06% (0.5688 => 0.5457, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -4.00% (0.3271 => 0.3140, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -3.90% (0.8418 => 0.8090, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: -3.89% (3.5154 => 3.3788, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.80% (0.7021 => 0.6754, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -3.80% (1.5610 => 1.5017, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.78% (0.9077 => 0.8734, std.dev.: 0.0035) MultiSource/Applications/ClamAV/clamscan: -3.72% (15.2527 => 14.6855, std.dev.: 0.0396) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.64% (0.5168 => 0.4980, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: -3.45% (5.0226 => 4.8493, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: -3.24% (1.1530 => 1.1156, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.19% (0.5329 => 0.5159, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -2.41% (20.7746 => 20.2733, std.dev.: 0.0199) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7538, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: -8.62% (1.2842 => 1.1735, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.75% (2.2633 => 2.1784, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.61% (6.5735 => 6.4676, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.08% (1.6086 => 1.5912, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0009) Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 02:38:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 04:38:59 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121101093859.657342A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5482?compare_to=5478&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5482, Order: 167219, Start Time: 2012-11-01 08:11:17, End Time: 2012-11-01 09:39:02 To: 5478, Order: 167216, Start Time: 2012-11-01 06:27:31, End Time: 2012-11-01 07:54:16 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 15 (82 on baseline) Performance Improvements: 3 (3 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 973 (889 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.80% (0.1343 => 0.1488, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.52% (0.2209 => 0.2353, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.89% (0.3342 => 0.3472, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.65% (0.6273 => 0.6502, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.07% (0.6513 => 0.6648, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.68% (0.9119 => 0.9272, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.38% (0.8841 => 0.8963, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.24% (0.8539 => 0.8645, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.38% (14.0958 => 16.2631, std.dev.: 0.1973) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.26% (0.0915 => 0.1018, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.00% (2.2322 => 2.3438, std.dev.: 0.0425) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.64% (0.3134 => 0.3248, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.84% (0.4053 => 0.4168, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/ffbench: 1.59% (1.4185 => 1.4411, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.22% (6.4102 => 6.4881, std.dev.: 0.0185) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.82% (8.6510 => 8.4073, std.dev.: 0.0922) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.60% (0.9396 => 0.9246, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash: -1.65% (0.6406 => 0.6300, std.dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.71% (16.7558 => 16.6363, std.dev.: 0.3572) MultiSource/Applications/obsequi/Obsequi: 0.06% (1.0705 => 1.0711, std.dev.: 0.0110) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.48% (21.7300 => 21.6262, std.dev.: 0.1588) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.44% (0.3659 => 0.3643, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/bigfib: 0.02% (0.6033 => 0.6034, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.21% (0.3325 => 0.3318, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: -0.90% (0.2006 => 0.1988, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -15.91% (0.0220 => 0.0185, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.24% (0.0423 => 0.0422, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.61% (0.0328 => 0.0330, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0312 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.24% (0.0420 => 0.0421, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0202 => 0.0202, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -35.94% (0.0217 => 0.0139, std.dev.: 0.0038) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.02% (0.1438 => 0.1467, std.dev.: 0.0094) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.07% (1.1134 => 1.1253, std.dev.: 0.0415) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.20% (0.1471 => 0.1518, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.66% (0.4055 => 0.4163, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.38% (0.1300 => 0.1383, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.65% (0.0612 => 0.0616, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.54% (0.0197 => 0.0202, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.67% (0.0599 => 0.0589, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.21% (1.1433 => 1.1457, std.dev.: 0.0486) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 15.64% (0.0569 => 0.0658, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.92% (0.0201 => 0.0233, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.8015 => 0.8015, std.dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -40.23% (0.0087 => 0.0052, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2302.83% (0.6332 => 15.2147, std.dev.: 0.3409) MultiSource/Benchmarks/McCat/08-main/main: 49.32% (0.1831 => 0.2734, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.55% (0.1559 => 0.1488, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1480.92% (0.3344 => 5.2866, std.dev.: 0.1518) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.29% (0.2364 => 0.3222, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel: -0.93% (0.0429 => 0.0425, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.57% (0.0224 => 0.0232, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3459, std.dev.: 0.0579) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0678, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4936, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3432, std.dev.: 0.0424) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0331, std.dev.: 0.0336) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4035, std.dev.: 0.0240) SingleSource/Regression/C/uint64_to_float: -23.88% (2.1832 => 1.6618, std.dev.: 0.0021) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.42% (0.0810 => 0.0943, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.13% (0.0830 => 0.0939, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.38% (0.0848 => 0.0953, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.23% (0.8321 => 0.9089, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.19% (0.6010 => 0.6502, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.98% (0.2180 => 0.2354, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.75% (0.3137 => 0.3380, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.61% (0.1905 => 0.2050, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.76% (0.1983 => 0.2117, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.84% (0.8148 => 0.8624, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.74% (0.6287 => 0.6648, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.68% (0.1885 => 0.1992, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.61% (0.7473 => 0.7892, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.37% (0.3295 => 0.3472, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 5.20% (1.2222 => 1.2857, std.dev.: 0.0162) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.08% (0.2519 => 0.2647, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.04% (0.2240 => 0.2353, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.85% (0.6227 => 0.6529, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.60% (0.9435 => 0.9869, std.dev.: 0.0145) MultiSource/Applications/treecc/treecc: 4.59% (1.9948 => 2.0863, std.dev.: 0.0155) MultiSource/Applications/hbd/hbd: 4.48% (1.4269 => 1.4908, std.dev.: 0.0217) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 4.26% (0.8597 => 0.8963, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.10% (1.1271 => 1.1733, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.06% (0.8697 => 0.9050, std.dev.: 0.0101) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.98% (0.2741 => 0.2850, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.94% (0.5817 => 0.6046, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.89% (1.3279 => 1.3796, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 3.86% (0.8927 => 0.9272, std.dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: 3.82% (14.7684 => 15.3325, std.dev.: 0.1275) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.81% (0.5961 => 0.6188, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.77% (0.4559 => 0.4731, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.77% (0.8331 => 0.8645, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.67% (0.9069 => 0.9402, std.dev.: 0.0060) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.66% (6.6074 => 6.8493, std.dev.: 0.0877) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.62% (0.5191 => 0.5379, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/18-imp/imp: 3.57% (0.3503 => 0.3628, std.dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 3.55% (1.2568 => 1.3014, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.43% (8.6476 => 8.9445, std.dev.: 0.0733) MultiSource/Applications/d/make_dparser: 3.40% (3.2366 => 3.3467, std.dev.: 0.0353) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.40% (0.3003 => 0.3105, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/05-eks/eks: 3.37% (0.4397 => 0.4545, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.30% (0.4783 => 0.4941, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.23% (0.8007 => 0.8266, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.23% (0.3717 => 0.3837, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.17% (0.8086 => 0.8342, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.08% (0.8338 => 0.8595, std.dev.: 0.0075) MultiSource/Applications/SPASS/SPASS: 3.01% (14.2605 => 14.6894, std.dev.: 0.1536) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.98% (0.8518 => 0.8772, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 2.93% (0.4125 => 0.4246, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.92% (0.8805 => 0.9062, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.92% (0.8261 => 0.8502, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.79% (0.6586 => 0.6770, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.79% (0.8316 => 0.8548, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.79% (0.8611 => 0.8851, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/football/football: 2.76% (0.8768 => 0.9010, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.75% (0.8712 => 0.8952, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.74% (0.8716 => 0.8955, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.73% (0.8885 => 0.9128, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.65% (0.8457 => 0.8681, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.60% (1.2602 => 1.2930, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.57% (0.9039 => 0.9271, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.55% (0.8048 => 0.8253, std.dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: 2.45% (8.6247 => 8.8358, std.dev.: 0.0283) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.43% (0.9688 => 0.9923, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.10% (0.9056 => 0.9246, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.97% (0.8066 => 0.8225, std.dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: 1.72% (31.8598 => 32.4089, std.dev.: 0.2087) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.28% (1.5795 => 2.5001, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.31% (2.7978 => 3.7297, std.dev.: 0.0172) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.10% (2.4333 => 2.7035, std.dev.: 0.0218) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.05% (14.6451 => 16.2631, std.dev.: 0.1973) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.84% (1.1857 => 1.2787, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 5.95% (63.1822 => 66.9437, std.dev.: 0.0172) MultiSource/Benchmarks/FreeBench/distray/distray: 4.31% (0.2390 => 0.2493, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.44% (0.3140 => 0.3248, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.40% (0.4031 => 0.4168, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.23% (2.4490 => 2.5282, std.dev.: 0.0167) SingleSource/Benchmarks/Misc/ReedSolomon: 3.01% (8.5322 => 8.7890, std.dev.: 0.0291) MultiSource/Applications/siod/siod: 2.82% (3.6643 => 3.7676, std.dev.: 0.0161) MultiSource/Benchmarks/Olden/bh/bh: 2.63% (2.3560 => 2.4180, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.74% (6.3772 => 6.4881, std.dev.: 0.0185) MultiSource/Applications/viterbi/viterbi: 1.02% (3.6155 => 3.6523, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.46% (0.3269 => 0.3025, std.dev.: 0.0027) MultiSource/Applications/lua/lua: -5.19% (29.8330 => 28.2845, std.dev.: 0.3178) SingleSource/Benchmarks/Shootout-C++/hash2: -1.61% (3.4237 => 3.3686, std.dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.16% (16.4461 => 16.6363, std.dev.: 0.3572) MultiSource/Applications/obsequi/Obsequi: 4.38% (1.0262 => 1.0711, std.dev.: 0.0110) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6824.82% (0.3123 => 21.6262, std.dev.: 0.1588) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.91% (0.2463 => 0.3643, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/bigfib: 0.40% (0.6010 => 0.6034, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.59% (0.3266 => 0.3318, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 0.96% (0.1969 => 0.1988, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 50.41% (0.0123 => 0.0185, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.43% (0.0408 => 0.0422, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.64% (0.0384 => 0.0421, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -22.78% (0.0180 => 0.0139, std.dev.: 0.0038) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.02% (0.1438 => 0.1467, std.dev.: 0.0094) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.67% (1.1329 => 1.1253, std.dev.: 0.0415) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.83% (0.1462 => 0.1518, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.02% (0.4164 => 0.4163, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.02% (0.1369 => 0.1383, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.90% (0.0641 => 0.0616, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.59% (0.0195 => 0.0202, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.90% (0.0578 => 0.0589, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.17% (1.1437 => 1.1457, std.dev.: 0.0486) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.94% (0.0627 => 0.0658, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 29.44% (0.0180 => 0.0233, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.02% (0.8017 => 0.8015, std.dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -16.13% (0.0062 => 0.0052, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 03:17:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 05:17:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121101101757.6C6522A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5483?compare_to=5479&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5483, Order: 167221, Start Time: 2012-11-01 08:44:36, End Time: 2012-11-01 10:17:58 To: 5479, Order: 167216, Start Time: 2012-11-01 06:38:02, End Time: 2012-11-01 08:12:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Passes: 1 (18 on baseline) Performance Regressions: 10 (171 on baseline) Performance Improvements: 8 (54 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 1 (1 on baseline) Unchanged Tests: 1022 (664 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/oggenc/oggenc: -5.56% (0.1403 => 0.1325, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 44.71% (0.6940 => 1.0043, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 26.54% (21.4322 => 27.1193, std.dev.: 0.0412) SingleSource/Benchmarks/CoyoteBench/almabench: 18.94% (0.0871 => 0.1036, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 14.58% (8.9921 => 10.3035, std.dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: 5.42% (58.5120 => 61.6813, std.dev.: 0.0883) SingleSource/Benchmarks/Misc/oourafft: 3.60% (0.3496 => 0.3622, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 1.80% (9.7411 => 9.9166, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.11% (2.4937 => 2.5214, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.05% (2.4238 => 2.4493, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.04% (8.6623 => 8.9254, std.dev.: 0.0102) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/flops: -19.83% (0.1836 => 0.1472, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.73% (7.2233 => 7.0260, std.dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.20% (2.6987 => 2.1267, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -7.32% (0.1693 => 0.1569, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.26% (0.7813 => 0.7480, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -2.62% (6.3148 => 6.1496, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/almabench: -2.39% (11.3592 => 11.0875, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -2.06% (7.6236 => 7.4665, std.dev.: 0.0092) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.27% (0.0662 => 0.0647, std.dev.: 0.0030) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 190.80% (0.5229 => 1.5206, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 13.27% (14.9895 => 16.9779, std.dev.: 0.0122) MultiSource/Applications/kimwitu++/kc: 36.62% (14.1553 => 19.3389, std.dev.: 0.0108) MultiSource/Benchmarks/MallocBench/gs/gs: 12.32% (4.1105 => 4.6169, std.dev.: 0.0134) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 29.73% (1.1048 => 1.4333, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 306.74% (7.1582 => 29.1152, std.dev.: 0.0140) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.01% (3.4629 => 5.8528, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 63.39% (0.6222 => 1.0166, std.dev.: 0.0014) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10581.53% (0.0720 => 7.6907, std.dev.: 0.0098) MultiSource/Applications/SIBsim4/SIBsim4: 3836800.00% (0.0001 => 3.8369, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 11182100.00% (0.0001 => 11.1822, std.dev.: 0.0128) MultiSource/Applications/kimwitu++/kc: 50600.00% (0.0001 => 0.0507, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: -10.77% (0.1485 => 0.1325, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 747900.00% (0.0001 => 0.7480, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049800.00% (0.0001 => 10.0499, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5492100.00% (0.0001 => 5.4922, std.dev.: 0.0010) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/CoyoteBench/almabench: 41.92% (0.0730 => 0.1036, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 38.45% (0.1056 => 0.1462, std.dev.: 0.0001) SingleSource/UnitTests/vla: 29.30% (0.0355 => 0.0459, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 26.64% (8.1363 => 10.3035, std.dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: 22.29% (22.1758 => 27.1193, std.dev.: 0.0412) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.18% (0.1566 => 0.1882, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 17.79% (0.1175 => 0.1384, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.78% (0.0793 => 0.0934, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: 16.89% (0.0746 => 0.0872, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.88% (0.0871 => 0.1018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 16.78% (0.3177 => 0.3710, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.50% (0.4879 => 0.5684, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: 16.25% (0.2554 => 0.2969, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 15.91% (0.0798 => 0.0925, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.80% (0.0842 => 0.0975, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.55% (0.8172 => 0.9443, std.dev.: 0.0060) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.34% (0.1584 => 0.1827, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.23% (0.0834 => 0.0961, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.90% (0.0886 => 0.1018, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 14.88% (0.1163 => 0.1336, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 14.87% (0.1695 => 0.1947, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 14.53% (0.5105 => 0.5847, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 14.50% (0.1655 => 0.1895, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.49% (2.2022 => 2.5214, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.30% (0.2700 => 0.3086, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.19% (0.2065 => 0.2358, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.97% (0.1940 => 0.2211, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 13.91% (0.7115 => 0.8105, std.dev.: 0.0016) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.91% (0.1143 => 0.1302, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.67% (0.2758 => 0.3135, std.dev.: 0.0028) MultiSource/Applications/aha/aha: 13.64% (0.1151 => 0.1308, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.64% (0.0770 => 0.0875, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.64% (0.0770 => 0.0875, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 13.57% (0.7433 => 0.8442, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.56% (0.5981 => 0.6792, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 13.44% (0.1555 => 0.1764, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.43% (0.1117 => 0.1267, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.38% (0.6675 => 0.7568, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 13.37% (1.1642 => 1.3199, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.31% (0.1337 => 0.1515, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.19% (0.2107 => 0.2385, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.18% (0.1510 => 0.1709, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.16% (0.1125 => 0.1273, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 13.12% (0.3109 => 0.3517, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.06% (0.9765 => 1.1040, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 13.03% (0.7835 => 0.8856, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.99% (0.2271 => 0.2566, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.98% (0.3121 => 0.3526, std.dev.: 0.0033) MultiSource/Applications/d/make_dparser: 12.93% (3.3354 => 3.7668, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.82% (1.5415 => 1.7391, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/exptree: 12.78% (0.0814 => 0.0918, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.73% (0.5860 => 0.6606, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.71% (0.1062 => 0.1197, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.66% (0.5569 => 0.6274, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.63% (0.1029 => 0.1159, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.55% (0.4615 => 0.5194, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.50% (0.1032 => 0.1161, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.26% (0.3441 => 0.3863, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.21% (0.5020 => 0.5633, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 12.07% (3.8723 => 4.3397, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.06% (0.1236 => 0.1385, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.02% (1.3050 => 1.4618, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 11.98% (2.0273 => 2.2701, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/health/health: 11.91% (0.1268 => 0.1419, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.88% (0.1625 => 0.1818, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 11.63% (0.3423 => 0.3821, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.61% (0.3307 => 0.3691, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 11.46% (1.0722 => 1.1951, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.45% (0.1695 => 0.1889, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.41% (0.2603 => 0.2900, std.dev.: 0.0005) SingleSource/UnitTests/SignlessTypes/rem: 11.28% (0.1144 => 0.1273, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.27% (0.6450 => 0.7177, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.22% (1.5859 => 1.7638, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.11% (0.1044 => 0.1160, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.10% (4.2646 => 4.7379, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/neural/neural: 11.00% (0.1463 => 0.1624, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.99% (2.2024 => 2.4444, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.98% (0.0929 => 0.1031, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.91% (2.2969 => 2.5474, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C++/life/life: 10.83% (0.0933 => 0.1034, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.80% (0.3927 => 0.4351, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 10.73% (1.1840 => 1.3110, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/09-vor/vor: 10.63% (0.3180 => 0.3518, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 10.56% (0.3543 => 0.3917, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 10.54% (0.3473 => 0.3839, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: 10.54% (0.8921 => 0.9861, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 10.48% (0.3828 => 0.4229, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 10.47% (0.4299 => 0.4749, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.44% (0.8101 => 0.8947, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 10.42% (0.6456 => 0.7129, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.41% (0.3543 => 0.3912, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.38% (0.3497 => 0.3860, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 10.36% (0.3282 => 0.3622, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.34% (0.1906 => 0.2103, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.31% (0.3561 => 0.3928, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 10.28% (9.4845 => 10.4596, std.dev.: 0.0126) SingleSource/UnitTests/ObjC/exceptions-3: 10.27% (0.3516 => 0.3877, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.18% (0.3694 => 0.4070, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.11% (0.3886 => 0.4279, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 10.01% (0.3387 => 0.3726, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.81% (1.1861 => 1.3024, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.69% (1.4186 => 1.5561, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.46% (0.1892 => 0.2071, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 9.23% (0.4289 => 0.4685, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.07% (0.4103 => 0.4475, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 9.05% (0.4620 => 0.5038, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.99% (0.4203 => 0.4581, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.82% (0.3865 => 0.4206, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 8.72% (1.5603 => 1.6963, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/lists: 8.56% (0.3422 => 0.3715, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.52% (0.2430 => 0.2637, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.50% (0.1330 => 0.1443, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.37% (4.9449 => 5.3587, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 8.36% (0.6030 => 0.6534, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists1: 8.33% (0.3684 => 0.3991, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.32% (5.0018 => 5.4178, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.30% (0.2266 => 0.2454, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 8.27% (0.3603 => 0.3901, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.25% (0.5925 => 0.6414, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 8.10% (0.4048 => 0.4376, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.05% (0.4636 => 0.5009, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 7.55% (5.7591 => 6.1938, std.dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference: 7.53% (0.7326 => 0.7878, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.32% (0.3650 => 0.3917, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.06% (0.3826 => 0.4096, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.04% (14.3668 => 15.3788, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.03% (0.3427 => 0.3668, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.94% (0.3098 => 0.3313, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.89% (0.3162 => 0.3380, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.89% (0.4064 => 0.4344, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.88% (0.3283 => 0.3509, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.87% (0.3232 => 0.3454, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 6.78% (17.1811 => 18.3456, std.dev.: 0.0020) SingleSource/Regression/C++/ofstream_ctor: 6.75% (0.2905 => 0.3101, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.62% (0.2793 => 0.2978, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.58% (0.2872 => 0.3061, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.54% (0.2891 => 0.3080) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.47% (2.0665 => 2.2003, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.45% (3.8922 => 4.1431, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/wc: 6.29% (0.3052 => 0.3244, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.28% (0.8067 => 0.8574, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.20% (0.2756 => 0.2927, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 6.18% (0.3092 => 0.3283, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 6.15% (0.2877 => 0.3054, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 6.09% (1.2842 => 1.3624, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/random: 6.07% (0.2802 => 0.2972, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.06% (0.2725 => 0.2890, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.90% (0.2714 => 0.2874, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.47% (0.3379 => 0.3564, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.23% (0.3136 => 0.3300, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.3131 => 0.3262, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.88% (0.3817 => 0.3927, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.87% (0.3935 => 0.4048, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 19.80% (2.8904 => 3.4628, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.60% (1.1145 => 1.2995, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.84% (1.1396 => 1.2517, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3678, std.dev.: 0.0064) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.82% (8.6802 => 8.9254, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.73% (4.2280 => 4.3434, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7657, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.91% (3.6395 => 3.7089, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bisort/bisort: 1.81% (0.8333 => 0.8484, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 1.51% (3.1595 => 3.2072, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.92% (6.6874 => 0.1389, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -75.89% (0.8651 => 0.2086, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -54.52% (5.3855 => 2.4493, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.22% (5.3526 => 2.4505, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/richards_benchmark: -45.75% (0.1622 => 0.0880, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.63% (5.2763 => 3.1323, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -24.04% (1.7609 => 1.3376, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.82% (2.9384 => 2.5616, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -10.28% (1.1194 => 1.0043, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: -10.04% (10.4361 => 9.3884, std.dev.: 0.0046) SingleSource/UnitTests/Vector/constpool: -9.01% (54.1659 => 49.2867, std.dev.: 0.0217) MultiSource/Benchmarks/PAQ8p/paq8p: -4.35% (10.3673 => 9.9166, std.dev.: 0.0082) MultiSource/Applications/JM/lencod/lencod: -2.66% (21.9371 => 21.3526, std.dev.: 0.0327) MultiSource/Benchmarks/Bullet/bullet: -2.47% (63.2438 => 61.6813, std.dev.: 0.0883) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.92% (0.3987 => 0.2515, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.76% (0.0506 => 0.0320, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -30.29% (10.7105 => 7.4665, std.dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -20.58% (2.6778 => 2.1267, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -16.31% (1.6925 => 1.4164, std.dev.: 0.0033) MultiSource/Benchmarks/NPB-serial/is/is: -10.98% (9.5636 => 8.5132, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -10.71% (1.5373 => 1.3727, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.20% (19.9488 => 18.3131, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: -7.48% (6.6465 => 6.1496, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: -7.11% (1.2373 => 1.1493, std.dev.: 0.0047) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.11% (1.8329 => 1.7026, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.06% (1.6805 => 1.5955, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5061, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.60% (1.5660 => 1.4939, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.00% (0.2497 => 0.2397, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -3.75% (4.5009 => 4.3320, std.dev.: 0.0010) MultiSource/Applications/siod/siod: -3.74% (3.2827 => 3.1600, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.54% (32.5116 => 31.3615, std.dev.: 0.0111) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.50% (0.9957 => 0.9609, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.24% (0.4808 => 0.4652, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: -3.21% (5.0483 => 4.8865, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -2.83% (4.6441 => 4.5127, std.dev.: 0.0016) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/Olden/power/power: -2.14% (1.1277 => 1.1036, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.01% (8.1563 => 7.9925, std.dev.: 0.0149) SingleSource/Benchmarks/CoyoteBench/almabench: -1.97% (11.3103 => 11.0875, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0862, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6797, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.51% (2.5528 => 2.5142, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (85.0658 => 83.9988, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.01% (6.2999 => 6.2362, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.42% (0.2116 => 0.0647, std.dev.: 0.0030) Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 03:38:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 05:38:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121101103831.635A42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5484?compare_to=5481&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5484, Order: 167221, Start Time: 2012-11-01 09:13:30, End Time: 2012-11-01 10:38:32 To: 5481, Order: 167217, Start Time: 2012-11-01 07:24:39, End Time: 2012-11-01 08:50:19 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (175 on baseline) Unchanged Tests: 1041 (861 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.22% (54.2182 => 56.5069, std.dev.: 0.0620) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.14% (3.1919 => 3.4199, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.54% (54.5751 => 56.5069, std.dev.: 0.0620) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1016, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.4937 => 7.6824, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/hash2: 2.35% (3.1932 => 3.2683, std.dev.: 0.0087) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.78% (0.1584 => 0.1445, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.54% (0.3821 => 0.3533, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -7.11% (2.4924 => 2.3151, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.40% (0.3142 => 0.2941, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/trivial-interface: -6.35% (0.3812 => 0.3570, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: -6.32% (0.3831 => 0.3589, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.30% (0.2428 => 0.2275, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.24% (0.3880 => 0.3638, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.21% (0.3896 => 0.3654, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.19% (0.3891 => 0.3650, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.19% (0.3848 => 0.3610, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -6.17% (0.4033 => 0.3784, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -6.13% (0.4176 => 0.3920, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.04% (0.3658 => 0.3437, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.03% (0.9542 => 0.8967, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -6.00% (0.4199 => 0.3947, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.95% (0.4151 => 0.3904, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.94% (22.4056 => 21.0752, std.dev.: 0.0187) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.92% (0.3884 => 0.3654, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.86% (4.5069 => 4.2428, std.dev.: 0.0141) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.86% (0.2355 => 0.2217, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: -5.85% (0.3026 => 0.2849, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -5.84% (0.4280 => 0.4030, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -5.82% (0.2989 => 0.2815, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.80% (0.3016 => 0.2841, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.78% (3.5339 => 3.3297, std.dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: -5.78% (16.1920 => 15.2565, std.dev.: 0.0115) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.73% (0.4813 => 0.4537, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.73% (0.3837 => 0.3617, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: -5.73% (7.0961 => 6.6897, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.72% (2.1713 => 2.0471, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: -5.70% (1.3148 => 1.2399, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: -5.69% (0.3357 => 0.3166, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.67% (0.3194 => 0.3013, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -5.66% (0.3446 => 0.3251, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -5.66% (0.3394 => 0.3202, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.65% (0.2903 => 0.2739, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/random: -5.65% (0.2939 => 0.2773, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.63% (0.6484 => 0.6119, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: -5.62% (0.3255 => 0.3072, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.61% (0.2871 => 0.2710, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -5.57% (4.3330 => 4.0915, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.57% (0.9852 => 0.9303, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -5.55% (0.3025 => 0.2857, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -5.52% (0.3059 => 0.2890, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.52% (4.0323 => 3.8096, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.52% (0.7198 => 0.6801, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: -5.51% (0.2160 => 0.2041, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -5.49% (0.2659 => 0.2513, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -5.48% (1.2515 => 1.1829, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hello: -5.44% (0.2849 => 0.2694, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists: -5.44% (0.3621 => 0.3424, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: -5.43% (0.3481 => 0.3292, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -5.43% (0.3205 => 0.3031, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.41% (0.4083 => 0.3862, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: -5.41% (0.4861 => 0.4598, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.41% (1.0544 => 0.9974, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.38% (4.8161 => 4.5571, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sieve: -5.36% (0.3788 => 0.3585, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.35% (0.7919 => 0.7495, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: -5.35% (0.3867 => 0.3660, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.35% (0.3849 => 0.3643, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.35% (0.3252 => 0.3078, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.33% (1.6474 => 1.5596, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.31% (4.8802 => 4.6213, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.28% (1.2784 => 1.2109, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.27% (0.3931 => 0.3724, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.26% (5.4682 => 5.1808, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: -5.24% (0.6750 => 0.6396, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -5.23% (34.0927 => 32.3080, std.dev.: 0.0260) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.22% (0.4427 => 0.4196, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.18% (0.2548 => 0.2416, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.14% (14.2083 => 13.4780, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.13% (0.5999 => 0.5691, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.13% (0.6293 => 0.5970, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -5.13% (0.4248 => 0.4030, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -5.10% (2.4021 => 2.2795, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -5.09% (9.2283 => 8.7582, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.09% (0.4321 => 0.4101, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.06% (0.3323 => 0.3155, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -5.05% (0.7779 => 0.7386, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.02% (1.2300 => 1.1683, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.96% (0.8521 => 0.8098, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: -4.96% (0.9179 => 0.8724, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.95% (1.6364 => 1.5554, std.dev.: 0.0023) MultiSource/Applications/lua/lua: -4.92% (4.0594 => 3.8596, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.91% (0.2933 => 0.2789, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.90% (1.4642 => 1.3925, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.88% (1.3722 => 1.3053, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.84% (1.2221 => 1.1630, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.83% (0.2278 => 0.2168, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -4.82% (0.2985 => 0.2841, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.80% (0.2999 => 0.2855, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.80% (0.5478 => 0.5215, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -4.78% (1.1450 => 1.0903, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.77% (0.3483 => 0.3317, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.73% (6.7716 => 6.4510, std.dev.: 0.0070) MultiSource/Applications/kimwitu++/kc: -4.71% (18.2933 => 17.4308, std.dev.: 0.0190) SingleSource/UnitTests/ObjC++/Hello: -4.71% (0.6347 => 0.6048, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.69% (2.2587 => 2.1528, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: -4.69% (0.7447 => 0.7098, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: -4.68% (17.1032 => 16.3025, std.dev.: 0.0232) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.67% (0.3491 => 0.3328, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.65% (1.2210 => 1.1642, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -4.65% (0.7982 => 0.7611, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.64% (0.6681 => 0.6371, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.63% (0.5575 => 0.5317, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.62% (0.5925 => 0.5651, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.61% (0.9557 => 0.9116, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.59% (0.5857 => 0.5588, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: -4.58% (0.6441 => 0.6146, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: -4.58% (0.4524 => 0.4317, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.52% (0.6194 => 0.5914, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.52% (0.5863 => 0.5598, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.51% (0.5849 => 0.5585, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.51% (0.5591 => 0.5339, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.49% (0.6660 => 0.6361, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.48% (0.7339 => 0.7010, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.48% (0.4916 => 0.4696, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.46% (0.5802 => 0.5543, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.46% (0.5805 => 0.5546, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.45% (0.5859 => 0.5598, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.44% (0.6667 => 0.6371, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.43% (0.5570 => 0.5323, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.43% (0.6052 => 0.5784, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.41% (0.6260 => 0.5984, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.41% (0.6446 => 0.6162, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.40% (0.5705 => 0.5454, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.40% (0.5688 => 0.5438, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.38% (0.6297 => 0.6021, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.38% (0.6304 => 0.6028, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -4.36% (0.4515 => 0.4318, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: -4.36% (0.3581 => 0.3425, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.35% (0.6189 => 0.5920, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -4.35% (0.3406 => 0.3258, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.32% (0.2385 => 0.2282, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.29% (0.5567 => 0.5328, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.29% (0.7524 => 0.7201, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.26% (0.5581 => 0.5343, std.dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.25% (0.3319 => 0.3178, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.24% (0.6440 => 0.6167, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.24% (0.5569 => 0.5333, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: -4.23% (15.5079 => 14.8516, std.dev.: 0.0123) MultiSource/Applications/spiff/spiff: -4.22% (0.8418 => 0.8063, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.19% (0.6676 => 0.6396, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.19% (0.5941 => 0.5692, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.18% (8.0126 => 7.6773, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.18% (0.6033 => 0.5781, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.18% (0.6395 => 0.6128, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.16% (0.5456 => 0.5229, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -4.14% (2.1401 => 2.0514, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.14% (0.6736 => 0.6457, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: -4.13% (0.3271 => 0.3136, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: -4.01% (1.3864 => 1.3308, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.97% (0.2695 => 0.2588, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.90% (0.7021 => 0.6747, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.83% (0.5168 => 0.4970, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.81% (0.9077 => 0.8731, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: -3.69% (1.1530 => 1.1105, std.dev.: 0.0040) MultiSource/Applications/d/make_dparser: -3.68% (3.5154 => 3.3859, std.dev.: 0.0109) MultiSource/Applications/ClamAV/clamscan: -3.65% (15.2527 => 14.6966, std.dev.: 0.0212) MultiSource/Applications/oggenc/oggenc: -3.50% (5.0226 => 4.8466, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.27% (0.5329 => 0.5155, std.dev.: 0.0045) MultiSource/Applications/hbd/hbd: -3.25% (1.5610 => 1.5103, std.dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -2.35% (20.7746 => 20.2856, std.dev.: 0.0393) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7532, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/richards_benchmark: -8.61% (1.2842 => 1.1736) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.81% (1.7753 => 1.7076, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.55% (2.2633 => 2.1830, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.73% (1.3096 => 1.2870, std.dev.: 0.0084) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4686, std.dev.: 0.0018) Report Time: 2.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 04:27:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 06:27:22 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121101112722.DA1BC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5485?compare_to=5482&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5485, Order: 167222, Start Time: 2012-11-01 10:00:03, End Time: 2012-11-01 11:27:26 To: 5482, Order: 167219, Start Time: 2012-11-01 08:11:17, End Time: 2012-11-01 09:39:02 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 4 (90 on baseline) Performance Improvements: 9 (4 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 978 (880 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 5.33% (0.1990 => 0.2096, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 1.54% (0.7610 => 0.7727, std.dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: 1.05% (32.4089 => 32.7487, std.dev.: 0.1103) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.01% (1.1339 => 1.1454, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.55% (0.8645 => 0.8511, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.37% (0.9402 => 0.9273, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.28% (0.9050 => 0.8934, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.07% (0.9409 => 0.9308, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: -5.28% (1.3325 => 1.2621, std.dev.: 0.0255) SingleSource/Benchmarks/Misc/ffbench: -3.73% (1.4411 => 1.3873, std.dev.: 0.0202) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.33% (0.3248 => 0.3140, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.40% (2.6457 => 2.5823, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.99% (5.1252 => 5.0230, std.dev.: 0.0013) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.15% (16.6363 => 16.6110, std.dev.: 0.2442) MultiSource/Applications/obsequi/Obsequi: -1.63% (1.0711 => 1.0536, std.dev.: 0.0250) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.10% (21.6262 => 21.6476, std.dev.: 0.4128) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.19% (0.3643 => 0.3650, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 0.22% (0.6034 => 0.6047, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.03% (0.3318 => 0.3317, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: -0.10% (0.1988 => 0.1986, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.86% (0.0185 => 0.0176, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.90% (0.0422 => 0.0414, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.30% (0.0330 => 0.0329, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.64% (0.0312 => 0.0314, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.71% (0.0421 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 1.49% (0.0202 => 0.0205, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 39.57% (0.0139 => 0.0194, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 75.00% (0.0008 => 0.0014) MultiSource/Applications/ClamAV/clamscan: -1.23% (0.1467 => 0.1449, std.dev.: 0.0085) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.89% (1.1253 => 1.1153, std.dev.: 0.0624) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.13% (0.1518 => 0.1516, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.18% (0.4163 => 0.3989, std.dev.: 0.0226) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.57% (0.1383 => 0.1306, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.90% (0.0616 => 0.0640, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 33.17% (0.0202 => 0.0269, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.17% (0.0589 => 0.0535, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.23% (1.1457 => 1.1431, std.dev.: 0.0158) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -51.61% (0.0031 => 0.0015, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -74.07% (0.0027 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.37% (0.0658 => 0.0649, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 12.02% (0.0233 => 0.0261, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.34% (0.8015 => 0.7988, std.dev.: 0.0312) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 63.46% (0.0052 => 0.0085, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2358.99% (0.6332 => 15.5703, std.dev.: 0.1409) MultiSource/Benchmarks/McCat/08-main/main: 46.97% (0.1831 => 0.2691, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.53% (0.1559 => 0.1426, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1486.06% (0.3344 => 5.3038, std.dev.: 0.0194) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.25% (0.2364 => 0.3221, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel: 1.86% (0.0429 => 0.0437, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.79% (0.0224 => 0.0228, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0037) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3497, std.dev.: 0.0175) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0711, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4893, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3407, std.dev.: 0.0352) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0418, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4051, std.dev.: 0.0061) SingleSource/Regression/C/uint64_to_float: -23.83% (2.1832 => 1.6630, std.dev.: 0.0134) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.17% (0.0810 => 0.0941, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 12.41% (0.1112 => 0.1250, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.21% (0.2180 => 0.2359, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 8.17% (0.1347 => 0.1457, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.72% (0.8321 => 0.8963, std.dev.: 0.0205) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.88% (0.1905 => 0.2017, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.57% (0.2279 => 0.2406, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 5.53% (0.7950 => 0.8390, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.46% (0.7473 => 0.7881, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.43% (1.1685 => 1.2319, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.40% (0.2519 => 0.2655, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.32% (0.4847 => 0.5105, std.dev.: 0.0089) MultiSource/Applications/Burg/burg: 5.12% (1.2222 => 1.2848, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.71% (0.6227 => 0.6520, std.dev.: 0.0112) MultiSource/Applications/ClamAV/clamscan: 4.50% (14.7684 => 15.4333, std.dev.: 0.0873) MultiSource/Applications/treecc/treecc: 4.47% (1.9948 => 2.0840, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.45% (0.4559 => 0.4762, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 4.41% (14.2605 => 14.8897, std.dev.: 0.0793) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.33% (0.8148 => 0.8501, std.dev.: 0.0056) MultiSource/Applications/hbd/hbd: 4.30% (1.4269 => 1.4882, std.dev.: 0.0044) MultiSource/Applications/SIBsim4/SIBsim4: 4.22% (1.2568 => 1.3098, std.dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 4.10% (1.1271 => 1.1733, std.dev.: 0.0130) MultiSource/Applications/d/make_dparser: 3.94% (3.2366 => 3.3642, std.dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: 3.83% (8.6247 => 8.9549, std.dev.: 0.0620) MultiSource/Applications/minisat/minisat: 3.53% (0.6834 => 0.7075, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.46% (0.3295 => 0.3409, std.dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.39% (6.6074 => 6.8311, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.23% (1.3279 => 1.3708, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 3.11% (0.8927 => 0.9205, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.01% (0.4783 => 0.4927, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: 2.97% (1.0945 => 1.1270, std.dev.: 0.0111) MultiSource/Applications/oggenc/oggenc: 2.93% (4.9628 => 5.1080, std.dev.: 0.0435) MultiSource/Applications/JM/ldecod/ldecod: 2.86% (6.7320 => 6.9248, std.dev.: 0.0212) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.81% (0.5191 => 0.5337, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 2.80% (15.3280 => 15.7566, std.dev.: 0.0804) MultiSource/Benchmarks/Bullet/bullet: 2.79% (31.8598 => 32.7487, std.dev.: 0.1103) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.79% (8.6476 => 8.8886, std.dev.: 0.0666) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.78% (0.6586 => 0.6769, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.73% (0.8697 => 0.8934, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.58% (0.9074 => 0.9308, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.50% (0.8855 => 0.9076, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.49% (4.4873 => 4.5990, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.47% (0.8457 => 0.8666, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.43% (1.1170 => 1.1441, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.42% (0.8317 => 0.8518, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.41% (0.8261 => 0.8460, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.38% (0.8286 => 0.8483, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.37% (0.8611 => 0.8815, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.35% (0.9908 => 1.0141, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.35% (0.8177 => 0.8369, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.33% (0.9688 => 0.9914, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.32% (0.7932 => 0.8116, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.31% (0.8518 => 0.8715, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.31% (0.8805 => 0.9008, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.27% (0.8050 => 0.8233, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 2.27% (0.8768 => 0.8967, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.26% (0.9039 => 0.9243, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 2.25% (0.7557 => 0.7727, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.25% (0.9069 => 0.9273, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.24% (0.8007 => 0.8186, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.23% (0.8340 => 0.8526, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.21% (0.8359 => 0.8544, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.21% (0.7966 => 0.8142, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.20% (0.8712 => 0.8904, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.16% (0.8331 => 0.8511, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.11% (0.8656 => 0.8839, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.10% (1.4479 => 1.4783, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.09% (0.8069 => 0.8238, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.05% (0.8048 => 0.8213, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 2.02% (4.1305 => 4.2139, std.dev.: 0.0291) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.00% (0.8420 => 0.8588, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.99% (0.8204 => 0.8367, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.97% (0.8086 => 0.8245, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.96% (4.1763 => 4.2580, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.82% (0.8716 => 0.8875, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.74% (0.8066 => 0.8206, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.64% (13.1811 => 13.3972, std.dev.: 0.0456) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.64% (0.8316 => 0.8452, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.40% (1.2526 => 1.2701, std.dev.: 0.0051) MultiSource/Benchmarks/PAQ8p/paq8p: 1.08% (2.3764 => 2.4021, std.dev.: 0.0083) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.96% (1.5795 => 2.5108, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.14% (2.7978 => 3.7249, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.54% (0.3186 => 0.3490, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.51% (2.4333 => 2.6648, std.dev.: 0.0216) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.24% (1.1857 => 1.2716, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 6.04% (63.1822 => 66.9961, std.dev.: 0.0619) MultiSource/Applications/siod/siod: 3.25% (3.6643 => 3.7835, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/ReedSolomon: 3.25% (8.5322 => 8.8094, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/bh/bh: 1.87% (2.3560 => 2.4000, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.48% (4.8362 => 4.9077, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.10% (0.3269 => 0.3037, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -5.23% (29.8330 => 28.2739, std.dev.: 0.2796) SingleSource/Benchmarks/Shootout-C++/hash2: -1.57% (3.4237 => 3.3698, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.27% (3.3479 => 3.3055, std.dev.: 0.0113) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.00% (16.4461 => 16.6110, std.dev.: 0.2442) MultiSource/Applications/obsequi/Obsequi: 2.67% (1.0262 => 1.0536, std.dev.: 0.0250) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6831.67% (0.3123 => 21.6476, std.dev.: 0.4128) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.19% (0.2463 => 0.3650, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 0.62% (0.6010 => 0.6047, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.56% (0.3266 => 0.3317, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: 0.86% (0.1969 => 0.1986, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 43.09% (0.0123 => 0.0176, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.47% (0.0408 => 0.0414, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.53% (0.0254 => 0.0329, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 7.78% (0.0180 => 0.0194, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 100.00% (0.0007 => 0.0014) MultiSource/Applications/ClamAV/clamscan: 0.76% (0.1438 => 0.1449, std.dev.: 0.0085) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.55% (1.1329 => 1.1153, std.dev.: 0.0624) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.69% (0.1462 => 0.1516, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.20% (0.4164 => 0.3989, std.dev.: 0.0226) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.60% (0.1369 => 0.1306, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.16% (0.0641 => 0.0640, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 37.95% (0.0195 => 0.0269, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.44% (0.0578 => 0.0535, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.05% (1.1437 => 1.1431, std.dev.: 0.0158) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1400.00% (0.0001 => 0.0015, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0014 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.51% (0.0627 => 0.0649, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 45.00% (0.0180 => 0.0261, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.36% (0.8017 => 0.7988, std.dev.: 0.0312) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 37.10% (0.0062 => 0.0085, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 05:20:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 07:20:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121101122049.D14342A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5486?compare_to=5483&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5486, Order: 167223, Start Time: 2012-11-01 10:47:36, End Time: 2012-11-01 12:20:52 To: 5483, Order: 167221, Start Time: 2012-11-01 08:44:36, End Time: 2012-11-01 10:17:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 5 (174 on baseline) Performance Improvements: 0 (54 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 1 (1 on baseline) Unchanged Tests: 1036 (661 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.00% (9.9166 => 10.2140, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.02% (7.0260 => 7.0980, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.02% (1.0043 => 1.0145, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.04% (78.9854 => 80.5970, std.dev.: 0.4053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.07% (1.4994 => 1.5155, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.09% (0.0647 => 0.0667, std.dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 191.18% (0.5229 => 1.5226, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 13.46% (14.9895 => 17.0072, std.dev.: 0.0064) MultiSource/Applications/kimwitu++/kc: 36.55% (14.1553 => 19.3294, std.dev.: 0.0109) MultiSource/Benchmarks/MallocBench/gs/gs: 12.22% (4.1105 => 4.6127, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 29.74% (1.1048 => 1.4334, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 307.75% (7.1582 => 29.1878, std.dev.: 0.0150) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.84% (3.4629 => 5.8466, std.dev.: 0.0241) SingleSource/Benchmarks/Misc-C++/stepanov_container: 63.52% (0.6222 => 1.0174, std.dev.: 0.0060) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10588.33% (0.0720 => 7.6956, std.dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: 3836700.00% (0.0001 => 3.8368, std.dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 11165500.00% (0.0001 => 11.1656, std.dev.: 0.0245) MultiSource/Applications/kimwitu++/kc: 50600.00% (0.0001 => 0.0507, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -10.77% (0.1485 => 0.1325, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 748200.00% (0.0001 => 0.7483, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049900.00% (0.0001 => 10.0500, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488400.00% (0.0001 => 5.4885, std.dev.: 0.0028) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/CoyoteBench/almabench: 41.92% (0.0730 => 0.1036, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 39.11% (0.1056 => 0.1469, std.dev.: 0.0001) SingleSource/UnitTests/vla: 29.30% (0.0355 => 0.0459, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 26.71% (8.1363 => 10.3091, std.dev.: 0.0051) MultiSource/Applications/ClamAV/clamscan: 22.50% (22.1758 => 27.1661, std.dev.: 0.0131) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.24% (0.1566 => 0.1883, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 17.87% (0.1175 => 0.1385, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.28% (0.0793 => 0.0930, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.20% (0.4879 => 0.5718, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.03% (0.3177 => 0.3718, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 17.02% (0.0746 => 0.0873, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.65% (0.0871 => 0.1016, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 16.21% (0.2554 => 0.2968, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.17% (0.0798 => 0.0927, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.34% (0.1584 => 0.1827, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.33% (0.8172 => 0.9425, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.32% (2.2022 => 2.5396, std.dev.: 0.0132) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.99% (0.0834 => 0.0959) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.85% (0.0842 => 0.0967, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.84% (0.1125 => 0.1292, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 14.62% (0.1163 => 0.1333) MultiSource/Benchmarks/Olden/em3d/em3d: 14.57% (0.1695 => 0.1942, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.52% (0.2700 => 0.3092, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 14.50% (0.1655 => 0.1895, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 14.34% (0.5105 => 0.5837, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.11% (0.0886 => 0.1011, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.95% (0.2065 => 0.2353, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 13.82% (0.7115 => 0.8098, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.76% (0.1940 => 0.2207, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.74% (0.2758 => 0.3137, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.69% (0.6675 => 0.7589, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.51% (0.0770 => 0.0874, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.51% (0.0770 => 0.0874, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 13.50% (0.1555 => 0.1765, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.47% (0.1143 => 0.1297, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 13.47% (0.1151 => 0.1306, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 13.45% (0.7433 => 0.8433, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.38% (0.1510 => 0.1712, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 13.37% (3.3354 => 3.7815, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.36% (0.5981 => 0.6780, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 13.19% (0.3109 => 0.3519, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.16% (0.1117 => 0.1264, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 13.13% (1.1642 => 1.3171, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.11% (1.5415 => 1.7436, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.10% (0.2107 => 0.2383, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.09% (0.1337 => 0.1512, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 13.01% (0.7835 => 0.8854, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.95% (0.2271 => 0.2565, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.87% (0.9765 => 1.1022, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.82% (0.3121 => 0.3521, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/exptree: 12.78% (0.0814 => 0.0918, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.73% (0.1029 => 0.1160, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.53% (0.5860 => 0.6594, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.52% (0.4615 => 0.5193, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.34% (0.1062 => 0.1193, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.32% (0.5569 => 0.6255, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.31% (0.1032 => 0.1159, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.22% (0.1236 => 0.1387, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.18% (0.3441 => 0.3860, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.97% (1.3050 => 1.4612, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.91% (0.5020 => 0.5618, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/health/health: 11.91% (0.1268 => 0.1419, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 11.90% (2.0273 => 2.2686, std.dev.: 0.0077) MultiSource/Applications/lua/lua: 11.83% (3.8723 => 4.3303, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.75% (0.1625 => 0.1816, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.55% (0.3307 => 0.3689, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 11.43% (1.0722 => 1.1947, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 11.39% (0.3423 => 0.3813, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.30% (0.1044 => 0.1162, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.29% (0.2603 => 0.2897, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.22% (0.6450 => 0.7174, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.19% (1.5859 => 1.7634, std.dev.: 0.0057) SingleSource/UnitTests/SignlessTypes/rem: 11.19% (0.1144 => 0.1272, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.17% (4.2646 => 4.7410, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.09% (0.1695 => 0.1883, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 11.07% (0.1463 => 0.1625, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.87% (0.0929 => 0.1030, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 10.83% (0.0933 => 0.1034, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.79% (2.2024 => 2.4400, std.dev.: 0.0083) MultiSource/Benchmarks/mafft/pairlocalalign: 10.76% (9.4845 => 10.5053, std.dev.: 0.0054) MultiSource/Benchmarks/nbench/nbench: 10.76% (1.1840 => 1.3114, std.dev.: 0.0059) MultiSource/Applications/siod/siod: 10.68% (2.2969 => 2.5422, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 10.57% (0.3282 => 0.3629, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.52% (0.3927 => 0.4340, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 10.47% (0.4299 => 0.4749, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.43% (0.8101 => 0.8946, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/09-vor/vor: 10.41% (0.3180 => 0.3511, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions: 10.40% (0.3828 => 0.4226, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.34% (0.1906 => 0.2103, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 10.33% (0.3387 => 0.3737, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 10.29% (0.8921 => 0.9839, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 10.19% (0.3473 => 0.3827, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.13% (0.3543 => 0.3902, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.09% (0.3497 => 0.3850, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 10.08% (0.6456 => 0.7107, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.05% (0.3561 => 0.3919, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.04% (0.3516 => 0.3869, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.04% (0.3886 => 0.4276, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-4: 10.02% (0.3543 => 0.3898, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.91% (0.3694 => 0.4060, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.82% (1.1861 => 1.3026, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 9.70% (0.4289 => 0.4705, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.64% (1.4186 => 1.5554, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 9.55% (0.4620 => 0.5061, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.29% (0.4103 => 0.4484, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.16% (0.3865 => 0.4219, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.14% (0.1892 => 0.2065, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.83% (0.2266 => 0.2466, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 8.77% (1.5603 => 1.6971, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.68% (0.4203 => 0.4568, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 8.53% (0.3422 => 0.3714, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.42% (0.1330 => 0.1442, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.39% (5.0018 => 5.4216, std.dev.: 0.0029) SingleSource/Benchmarks/Stanford/Puzzle: 8.36% (0.1268 => 0.1374) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.31% (4.9449 => 5.3556, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference-object: 8.19% (0.6030 => 0.6524, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.15% (0.2430 => 0.2628, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 8.10% (0.4048 => 0.4376, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.10% (0.5925 => 0.6405, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 8.03% (0.3684 => 0.3980, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.00% (0.4636 => 0.5007, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: 7.83% (0.3603 => 0.3885, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 7.53% (5.7591 => 6.1928, std.dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference: 7.52% (0.7326 => 0.7877, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.32% (0.3826 => 0.4106, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.30% (14.3668 => 15.4153, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.29% (0.3650 => 0.3916, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.05% (0.2793 => 0.2990, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.00% (0.3427 => 0.3667, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.99% (0.2831 => 0.3029, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.95% (0.2891 => 0.3092, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.92% (0.2905 => 0.3106, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary3: 6.88% (0.3283 => 0.3509, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.83% (0.3162 => 0.3378, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.82% (0.4064 => 0.4341, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.75% (0.3098 => 0.3307, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 6.74% (17.1811 => 18.3392, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.66% (2.0665 => 2.2041, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.57% (0.2756 => 0.2937, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.55% (0.3052 => 0.3252, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.50% (3.8922 => 4.1453, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 6.50% (0.3232 => 0.3442, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 6.50% (0.2725 => 0.2902, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 6.48% (0.2871 => 0.3057, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.48% (0.2872 => 0.3058, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 6.26% (0.2714 => 0.2884, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.25% (0.2802 => 0.2977, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.19% (0.2877 => 0.3055, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.8067 => 0.8561, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 6.03% (1.2842 => 1.3616, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 6.02% (0.3092 => 0.3278, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.39% (0.3136 => 0.3305, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 5.36% (0.3379 => 0.3560, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.3131 => 0.3265, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.80% (0.3817 => 0.3924) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.77% (0.3935 => 0.4044, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 19.80% (2.8904 => 3.4628, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.56% (1.1145 => 1.2991, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 9.99% (1.1396 => 1.2534, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3675, std.dev.: 0.0008) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.85% (4.2280 => 4.3484, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.66% (8.6802 => 8.9111, std.dev.: 0.0227) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7651, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.83% (3.6395 => 3.7061, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/bisort/bisort: 1.78% (0.8333 => 0.8481, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.92% (6.6874 => 0.1388, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -75.85% (0.8651 => 0.2089) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -54.30% (5.3855 => 2.4613, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -53.96% (5.3526 => 2.4642, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/richards_benchmark: -45.62% (0.1622 => 0.0882, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.27% (5.2763 => 3.1516, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -23.73% (1.7609 => 1.3430, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.55% (2.9384 => 2.5695, std.dev.: 0.0135) MultiSource/Applications/JM/ldecod/ldecod: -10.07% (10.4361 => 9.3856, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.37% (1.1194 => 1.0145, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -9.05% (54.1659 => 49.2665, std.dev.: 0.0204) MultiSource/Benchmarks/Bullet/bullet: -2.36% (63.2438 => 61.7513, std.dev.: 0.0325) MultiSource/Applications/JM/lencod/lencod: -1.99% (21.9371 => 21.5014, std.dev.: 0.0082) MultiSource/Benchmarks/PAQ8p/paq8p: -1.48% (10.3673 => 10.2140, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.97% (0.3987 => 0.2513, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.76% (0.0506 => 0.0320, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.45% (1.1492 => 0.7648, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -30.27% (10.7105 => 7.4688, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -20.56% (2.6778 => 2.1273, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4220, std.dev.: 0.0028) MultiSource/Benchmarks/NPB-serial/is/is: -10.99% (9.5636 => 8.5121, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: -10.54% (1.5373 => 1.3752, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.42% (19.9488 => 18.2695, std.dev.: 0.0158) MultiSource/Benchmarks/FreeBench/mason/mason: -7.82% (0.2161 => 0.1992, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -7.48% (6.6465 => 6.1492, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.13% (1.8329 => 1.7022, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.51% (1.2373 => 1.1568, std.dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0143) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.08% (1.6805 => 1.5952, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5054, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.61% (1.5660 => 1.4938, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.04% (0.2497 => 0.2396, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -3.72% (4.5009 => 4.3333, std.dev.: 0.0016) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1626, std.dev.: 0.0073) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.53% (32.5116 => 31.3653, std.dev.: 0.0104) MultiSource/Benchmarks/sim/sim: -3.24% (5.0483 => 4.8849, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.10% (0.9957 => 0.9648, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: -2.78% (4.6441 => 4.5148, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.60% (0.4808 => 0.4683, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/Olden/power/power: -2.14% (1.1277 => 1.1036, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: -1.97% (11.3103 => 11.0873, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.83% (10.2830 => 10.0952, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.74% (8.1563 => 8.0140, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6797, std.dev.: 0.0017) SingleSource/UnitTests/Vector/multiplies: -1.57% (2.5528 => 2.5127, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (85.0658 => 83.9913, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/lists: -1.13% (6.2999 => 6.2286, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.48% (0.2116 => 0.0667, std.dev.: 0.0001) Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 05:25:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 07:25:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121101122537.E62332A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5487?compare_to=5480&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5487, Order: 167221, Start Time: 2012-11-01 09:09:51, End Time: 2012-11-01 12:25:39 To: 5480, Order: 167210, Start Time: 2012-11-01 05:03:13, End Time: 2012-11-01 08:21:35 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (167 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (723 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.73% (122.0352 => 129.0238, std.dev.: 1.6814) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.04% (0.0625 => 0.0869, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.48% (0.1063 => 0.1387, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.90% (0.2969 => 0.3738, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.18% (0.4253 => 0.5324, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.95% (0.1106 => 0.1382, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.31% (0.4139 => 0.5145, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 23.16% (1.5932 => 1.9622, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.69% (0.0714 => 0.0876, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.63% (0.5900 => 0.7235, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.53% (0.0475 => 0.0582, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.49% (0.0547 => 0.0670, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.47% (0.4994 => 0.6116, std.dev.: 0.0034) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.26% (0.0584 => 0.0714, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.08% (0.5000 => 0.6104, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.85% (0.0897 => 0.1093, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.48% (0.1620 => 0.1968, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.16% (0.1021 => 0.1237, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 21.04% (0.0599 => 0.0725, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.87% (0.1107 => 0.1338, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.06% (0.0633 => 0.0760, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 20.04% (0.0948 => 0.1138, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.03% (0.0584 => 0.0701, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 19.70% (0.0604 => 0.0723, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.69% (0.1549 => 0.1854, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.59% (0.0541 => 0.0647, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.52% (0.3903 => 0.4665, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.49% (0.1103 => 0.1318, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.47% (0.0642 => 0.0767, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 19.39% (0.1619 => 0.1933, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 19.37% (0.0821 => 0.0980, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.24% (0.1003 => 0.1196, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.14% (0.1604 => 0.1911, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.98% (0.0822 => 0.0978, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 18.86% (0.5826 => 0.6925, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 18.68% (0.5889 => 0.6989, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.06% (0.1462 => 0.1726, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 18.06% (0.0947 => 0.1118, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.95% (0.2736 => 0.3227, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.79% (0.3890 => 0.4582, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 17.70% (0.0808 => 0.0951, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 17.49% (0.1218 => 0.1431, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/mst/mst: 17.34% (0.0698 => 0.0819, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.28% (0.2014 => 0.2362, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 17.28% (0.1505 => 0.1765, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.22% (0.2875 => 0.3370, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.04% (1.3152 => 1.5393, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.00% (0.1088 => 0.1273, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 17.00% (0.4029 => 0.4714, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: 16.88% (0.2725 => 0.3185, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 16.73% (0.2714 => 0.3168, std.dev.: 0.0039) MultiSource/Applications/hbd/hbd: 16.61% (0.9697 => 1.1308, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.61% (0.2866 => 0.3342, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.51% (0.2738 => 0.3190, std.dev.: 0.0051) SingleSource/UnitTests/ObjC++/property-reference: 16.47% (0.7171 => 0.8352, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: 16.44% (0.5546 => 0.6458, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 16.41% (0.3004 => 0.3497, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 16.40% (0.2780 => 0.3236, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 16.32% (1.8794 => 2.1862, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.31% (0.2729 => 0.3174, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 16.29% (0.2750 => 0.3198, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.27% (0.4658 => 0.5416, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.23% (3.5627 => 4.1410, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 16.23% (23.5202 => 27.3377, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/random: 16.20% (0.2803 => 0.3257, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.19% (0.2792 => 0.3244, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/objinst: 16.19% (0.2823 => 0.3280, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.18% (0.3195 => 0.3712, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.18% (0.2911 => 0.3382, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wc: 16.12% (0.3096 => 0.3595, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 16.12% (0.2811 => 0.3264, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.10% (0.5026 => 0.5835, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.07% (2.0673 => 2.3996, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: 16.07% (0.2813 => 0.3265, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.03% (0.1160 => 0.1346, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.96% (0.1968 => 0.2282, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 15.95% (0.9909 => 1.1489, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.90% (0.3271 => 0.3791, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.77% (1.6211 => 1.8768, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 15.76% (0.3267 => 0.3782, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary: 15.62% (0.3258 => 0.3767, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.44% (0.3362 => 0.3881, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/ary2: 15.38% (0.3317 => 0.3827, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 15.34% (0.1421 => 0.1639, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.33% (0.3060 => 0.3529, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.18% (0.4361 => 0.5023, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: 15.13% (1.0781 => 1.2412, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 15.04% (0.3678 => 0.4231, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 15.03% (0.1284 => 0.1477, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.01% (2.7292 => 3.1388, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.96% (0.3282 => 0.3773, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.91% (0.3930 => 0.4516, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 14.88% (0.4146 => 0.4763, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 14.87% (4.2109 => 4.8371, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.85% (0.3124 => 0.3588, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 14.81% (0.3348 => 0.3844, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.76% (4.4195 => 5.0720, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/lists1: 14.75% (0.3477 => 0.3990, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/sieve: 14.71% (0.3726 => 0.4274, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.63% (1.9694 => 2.2575, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 14.44% (0.4251 => 0.4865, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.43% (0.3625 => 0.4148, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.34% (1.9966 => 2.2830, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.31% (0.3690 => 0.4218, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.24% (0.3981 => 0.4548, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.22% (0.1090 => 0.1245, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.84% (0.3845 => 0.4377, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/for-in: 13.76% (0.3496 => 0.3977, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 13.76% (0.3446 => 0.3920, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.73% (0.3488 => 0.3967, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-3: 13.73% (0.3460 => 0.3935, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 13.71% (0.3465 => 0.3940, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 13.70% (1.4269 => 1.6224, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 13.65% (0.3442 => 0.3912, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 13.63% (0.5012 => 0.5695, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/synchronized: 13.61% (0.3469 => 0.3941, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 13.52% (0.2566 => 0.2913, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 13.49% (0.2075 => 0.2355, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 13.34% (0.3650 => 0.4137, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions: 13.31% (0.3643 => 0.4128, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.13% (0.3724 => 0.4213, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 12.90% (0.7875 => 0.8891, std.dev.: 0.0075) MultiSource/Applications/JM/ldecod/ldecod: 12.82% (2.1653 => 2.4429, std.dev.: 0.0063) MultiSource/Applications/JM/lencod/lencod: 12.49% (4.6177 => 5.1944, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.14% (0.6435 => 0.7216, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 12.01% (2.1013 => 2.3536, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 11.58% (5.5417 => 6.1836, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.58% (0.1028 => 0.1147, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 11.45% (0.2691 => 0.2999, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.32% (0.2040 => 0.2271, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 11.29% (0.3498 => 0.3893, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.18% (0.2737 => 0.3043, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.07% (0.2068 => 0.2297, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.83% (0.3084 => 0.3418, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 10.55% (0.3336 => 0.3688, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 10.54% (0.4847 => 0.5358, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 10.45% (0.6634 => 0.7327, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.03% (0.2103 => 0.2314, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.91% (0.1383 => 0.1520, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.50% (4.6926 => 5.1383, std.dev.: 0.0113) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.15% (11.6398 => 12.7050, std.dev.: 0.0171) MultiSource/Applications/sqlite3/sqlite3: 8.98% (2.0346 => 2.2174, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.62% (0.5361 => 0.5823, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.03% (0.7426 => 0.8022, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.74% (0.5584 => 0.6016, std.dev.: 0.0089) MultiSource/Applications/kimwitu++/kc: 7.09% (11.9555 => 12.8036, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.46% (0.3792 => 0.3961, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6533, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0300, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.14% (0.2802 => 0.3058, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6117, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.06% (12.0509 => 12.6606, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1715, std.dev.: 0.0185) SingleSource/Benchmarks/Misc/flops-2: 4.21% (1.8057 => 1.8817, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: 2.75% (14.0481 => 14.4343, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1955, std.dev.: 0.0116) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.64% (3.1722 => 3.2242, std.dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3056, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2882, std.dev.: 0.0025) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5144, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5403, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6036, std.dev.: 0.0243) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.36% (2.4764 => 2.4427, std.dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.53% (25.4195 => 16.3883, std.dev.: 0.0153) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9759, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7761, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: -7.21% (2.1113 => 1.9591, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -6.33% (0.2402 => 0.2250, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.39% (11.2080 => 10.8275, std.dev.: 0.0451) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7744, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: -2.87% (3.6262 => 3.5223, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (17.2379 => 16.7850, std.dev.: 0.0382) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.20% (41.7953 => 40.8747, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5741, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4954, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.29% (5.7935 => 5.7185, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1489, std.dev.: 0.0306) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0420, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.05% (3.3991 => 3.3633, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 05:26:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 07:26:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121101122640.2ECB42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5488?compare_to=5484&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5488, Order: 167224, Start Time: 2012-11-01 11:01:30, End Time: 2012-11-01 12:26:37 To: 5484, Order: 167221, Start Time: 2012-11-01 09:13:30, End Time: 2012-11-01 10:38:32 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 3 (5 on baseline) Performance Improvements: 0 (178 on baseline) Unchanged Tests: 1039 (859 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.71% (78.2355 => 80.3533, std.dev.: 0.3656) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.14% (0.9521 => 0.9630, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: 1.08% (1.1487 => 1.1611, std.dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.15% (3.1919 => 3.4201, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1009, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4937 => 7.6769, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/hash2: 2.04% (3.1932 => 3.2584, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.84% (0.1584 => 0.1444, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.53% (0.1431 => 0.1309, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.67% (0.3821 => 0.3528, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: -7.50% (2.4924 => 2.3054, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: -7.27% (0.3812 => 0.3535, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -7.23% (0.3831 => 0.3554, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.12% (0.3891 => 0.3614, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -7.09% (0.3880 => 0.3605, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.03% (0.3884 => 0.3611, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/for-in: -7.02% (0.4033 => 0.3750, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -7.01% (0.3896 => 0.3623, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.99% (0.3848 => 0.3579, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -6.94% (0.4176 => 0.3886, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -6.83% (0.4199 => 0.3912, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -6.68% (0.4280 => 0.3994, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.53% (0.9542 => 0.8919, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.47% (0.2428 => 0.2271, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -6.44% (0.1879 => 0.1758, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.43% (0.3142 => 0.2940, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.35% (0.3025 => 0.2833, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.23% (0.3658 => 0.3430, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.23% (4.5069 => 4.2261, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/random: -6.23% (0.2939 => 0.2756, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.22% (0.4151 => 0.3893, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -6.21% (0.3026 => 0.2838, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.20% (0.2903 => 0.2723, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -6.20% (0.2871 => 0.2693, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.20% (0.2355 => 0.2209, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.18% (0.3057 => 0.2868, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.18% (2.1713 => 2.0371, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.18% (0.3837 => 0.3600, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -6.18% (16.1920 => 15.1920, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/strcat: -6.16% (0.2989 => 0.2805, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -6.15% (7.0961 => 6.6595, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.11% (0.3323 => 0.3120, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: -6.11% (0.2849 => 0.2675, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -6.11% (0.3194 => 0.2999, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.10% (22.4056 => 21.0382, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/wc: -6.08% (0.3205 => 0.3010, std.dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: -6.05% (0.3357 => 0.3154, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: -6.04% (0.3394 => 0.3189, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -6.04% (0.3446 => 0.3238, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.00% (0.3016 => 0.2835, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.00% (0.6484 => 0.6095, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: -5.99% (1.3148 => 1.2361, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.98% (0.3931 => 0.3696, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -5.98% (0.3481 => 0.3273) SingleSource/Benchmarks/Misc/oourafft: -5.97% (0.2160 => 0.2031, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: -5.96% (0.3255 => 0.3061, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.93% (3.5339 => 3.3245, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.86% (4.8161 => 4.5338, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.85% (4.0323 => 3.7964, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.84% (0.3252 => 0.3062, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -5.83% (0.2659 => 0.2504, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.82% (0.3849 => 0.3625, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.78% (0.4083 => 0.3847, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.78% (0.4813 => 0.4535, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -5.74% (0.4861 => 0.4582, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -5.72% (0.3059 => 0.2884, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -5.72% (4.3330 => 4.0852, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: -5.72% (0.3621 => 0.3414, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.71% (0.4427 => 0.4174, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -5.71% (1.2515 => 1.1800, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.71% (4.8802 => 4.6016, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.69% (0.9852 => 0.9291, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.68% (1.0544 => 0.9945, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.65% (0.2548 => 0.2404, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/moments: -5.65% (0.4248 => 0.4008, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: -5.64% (0.3867 => 0.3649, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: -5.62% (0.3788 => 0.3575, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.56% (0.7919 => 0.7479, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.54% (1.2784 => 1.2076, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.52% (0.5999 => 0.5668, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: -5.50% (34.0927 => 32.2166, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.48% (5.4682 => 5.1686, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.46% (0.4321 => 0.4085, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.46% (14.2083 => 13.4326, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/bigfib: -5.42% (0.6750 => 0.6384, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.42% (0.2933 => 0.2774, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.41% (1.2300 => 1.1634, std.dev.: 0.0229) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.39% (0.6293 => 0.5954, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.38% (1.6474 => 1.5587, std.dev.: 0.0174) MultiSource/Applications/siod/siod: -5.38% (2.4021 => 2.2729, std.dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C/football/football: -5.37% (0.9179 => 0.8686, std.dev.: 0.0009) MultiSource/Applications/lua/lua: -5.36% (4.0594 => 3.8420, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: -5.34% (9.2283 => 8.7359, std.dev.: 0.0107) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.33% (0.8521 => 0.8067, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: -5.31% (0.7779 => 0.7366, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.30% (1.3722 => 1.2995, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -5.28% (0.4524 => 0.4285, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.27% (0.2278 => 0.2158, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.24% (1.6364 => 1.5506, std.dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.24% (6.7716 => 6.4170, std.dev.: 0.0105) MultiSource/Applications/lemon/lemon: -5.23% (1.1450 => 1.0851, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.20% (0.2999 => 0.2843, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.15% (0.7198 => 0.6827, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: -5.15% (0.6347 => 0.6020, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: -5.14% (17.1032 => 16.2240, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.13% (0.5478 => 0.5197, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.11% (0.5857 => 0.5558, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.08% (0.5591 => 0.5307, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.07% (1.4642 => 1.3899, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.02% (0.3483 => 0.3308, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -4.99% (0.2985 => 0.2836, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.98% (0.4916 => 0.4671, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.98% (0.6230 => 0.5920, std.dev.: 0.0048) SingleSource/UnitTests/ObjC++/property-reference-object: -4.97% (0.6441 => 0.6121, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -4.96% (0.4515 => 0.4291, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.96% (0.6194 => 0.5887, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.95% (0.5575 => 0.5299, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -4.94% (18.2933 => 17.3890, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.94% (0.6052 => 0.5753, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.94% (0.5570 => 0.5295, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.93% (0.5925 => 0.5633, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -4.91% (0.3581 => 0.3405, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.90% (0.3491 => 0.3320, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.89% (0.7339 => 0.6980, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.89% (1.2221 => 1.1624, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.87% (0.6260 => 0.5955, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.85% (0.6681 => 0.6357, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: -4.85% (0.7982 => 0.7595, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.85% (0.5859 => 0.5575, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.84% (0.5802 => 0.5521, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.84% (0.5805 => 0.5524, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.81% (0.6667 => 0.6346, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.79% (0.7447 => 0.7090, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.78% (0.9557 => 0.9100, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.78% (0.6676 => 0.6357, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.78% (0.6446 => 0.6138, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.77% (1.2210 => 1.1627, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.77% (0.6304 => 0.6003, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.77% (0.5581 => 0.5315, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.76% (0.6297 => 0.5997, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.75% (0.5705 => 0.5434, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.74% (0.5567 => 0.5303, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.74% (0.5863 => 0.5585, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.74% (0.2385 => 0.2272, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.74% (0.5849 => 0.5572, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.73% (0.7524 => 0.7168, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.73% (2.2587 => 2.1519, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.73% (0.3406 => 0.3245, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.72% (0.5569 => 0.5306, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.71% (0.6660 => 0.6346, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.71% (8.0126 => 7.6354, std.dev.: 0.0070) MultiSource/Applications/SPASS/SPASS: -4.67% (15.5079 => 14.7830, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.66% (0.5941 => 0.5664, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.61% (0.6440 => 0.6143, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.59% (0.6033 => 0.5756, std.dev.: 0.0058) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.58% (0.3319 => 0.3167, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/09-vor/vor: -4.56% (0.3271 => 0.3122, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.55% (0.5688 => 0.5429, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.55% (0.6395 => 0.6104, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.54% (0.6189 => 0.5908, std.dev.: 0.0086) MultiSource/Applications/spiff/spiff: -4.54% (0.8418 => 0.8036, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: -4.53% (1.3864 => 1.3236, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.53% (0.6736 => 0.6431, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.53% (0.5456 => 0.5209, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.45% (0.2695 => 0.2575, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.43% (0.6395 => 0.6112, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: -4.37% (2.1401 => 2.0465, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: -4.23% (3.5154 => 3.3667, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.10% (0.7021 => 0.6733, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.10% (0.9077 => 0.8705, std.dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: -4.08% (15.2527 => 14.6308, std.dev.: 0.0109) MultiSource/Applications/hbd/hbd: -4.05% (1.5610 => 1.4978, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.01% (0.5168 => 0.4961, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.80% (5.0226 => 4.8316, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.55% (0.5329 => 0.5140, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: -3.48% (1.1530 => 1.1129, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.40% (20.7746 => 20.2752, std.dev.: 0.0462) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.49% (7.5137 => 5.7487, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1729, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7061, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.79% (2.2633 => 2.1776, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.81% (1.3096 => 1.2728, std.dev.: 0.0098) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4733, std.dev.: 0.0019) Report Time: 4.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 06:11:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 08:11:36 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121101131136.858DD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5489?compare_to=5485&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5489, Order: 167227, Start Time: 2012-11-01 11:45:05, End Time: 2012-11-01 13:11:35 To: 5485, Order: 167222, Start Time: 2012-11-01 10:00:03, End Time: 2012-11-01 11:27:26 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 4 (61 on baseline) Performance Improvements: 9 (6 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 978 (907 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 5.81% (21.9970 => 23.2743, std.dev.: 0.2477) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.45% (2.4241 => 2.5077, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.58% (41.0811 => 41.7292, std.dev.: 0.2468) SingleSource/Benchmarks/Shootout/methcall: 1.12% (8.1693 => 8.2607, std.dev.: 0.0119) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/treecc/treecc: -2.68% (2.0840 => 2.0281, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.33% (1.2319 => 1.2032, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.02% (0.6520 => 0.6388, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: -1.94% (8.9549 => 8.7810, std.dev.: 0.0622) MultiSource/Benchmarks/Bullet/bullet: -1.56% (32.7487 => 32.2380, std.dev.: 0.1788) MultiSource/Applications/sqlite3/sqlite3: -1.32% (15.5703 => 15.3651, std.dev.: 0.0640) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: -7.02% (0.8143 => 0.7571, std.dev.: 0.0182) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -1.17% (4.0142 => 3.9673, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/ReedSolomon: -1.03% (8.8094 => 8.7185, std.dev.: 0.0326) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.01% (16.6110 => 16.6127, std.dev.: 0.0558) MultiSource/Applications/obsequi/Obsequi: -0.57% (1.0536 => 1.0476, std.dev.: 0.0256) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.47% (21.6476 => 21.7501, std.dev.: 0.1267) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.14% (0.3650 => 0.3645, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 0.05% (0.6047 => 0.6050, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.06% (0.3317 => 0.3352, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 0.70% (0.1986 => 0.2000, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 23.86% (0.0176 => 0.0218, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.90% (0.0414 => 0.0373, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -23.71% (0.0329 => 0.0251, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.64% (0.0314 => 0.0312, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.18% (0.0424 => 0.0419, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -0.98% (0.0205 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 2.58% (0.0194 => 0.0199, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.86% (0.0014 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.76% (0.1449 => 0.1438, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.81% (1.1153 => 1.1243, std.dev.: 0.0308) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.36% (0.1516 => 0.1465, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.91% (0.3989 => 0.4145, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.84% (0.1306 => 0.1330, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.00% (0.0640 => 0.0576, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -31.23% (0.0269 => 0.0185, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.92% (0.0535 => 0.0572, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.24% (1.1431 => 1.1404, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 106.67% (0.0015 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 42.86% (0.0007 => 0.0010, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.31% (0.0649 => 0.0621, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.12% (0.0261 => 0.0185, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.08% (0.7988 => 0.7994, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -55.29% (0.0085 => 0.0038, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2326.58% (0.6332 => 15.3651, std.dev.: 0.0640) MultiSource/Benchmarks/McCat/08-main/main: 44.84% (0.1831 => 0.2652, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.47% (0.1559 => 0.1427, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1484.99% (0.3344 => 5.3002, std.dev.: 0.0318) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.06% (0.2364 => 0.3240, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -0.93% (0.0429 => 0.0425, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.79% (0.0224 => 0.0220, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: -31.74% (0.0230 => 0.0157, std.dev.: 0.0007) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3553, std.dev.: 0.0192) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0725, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4948, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3385, std.dev.: 0.0309) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0257, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4029, std.dev.: 0.0062) SingleSource/Regression/C/uint64_to_float: -23.84% (2.1832 => 1.6628, std.dev.: 0.0059) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.93% (0.0810 => 0.0939, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 11.51% (0.1112 => 0.1240, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.20% (0.2180 => 0.2337, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.93% (0.1905 => 0.2018, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.51% (0.6010 => 0.6341, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.12% (0.4847 => 0.5095, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.70% (0.7473 => 0.7824, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.51% (0.2240 => 0.2341, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.77% (0.4559 => 0.4731, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.62% (0.8457 => 0.8763, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.49% (0.4127 => 0.4271, std.dev.: 0.0053) MultiSource/Applications/ClamAV/clamscan: 3.41% (14.7684 => 15.2724, std.dev.: 0.1180) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.12% (0.5191 => 0.5353, std.dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 3.06% (1.1271 => 1.1616, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.97% (1.1685 => 1.2032, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.84% (0.8331 => 0.8568, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/hash: 2.74% (0.3800 => 0.3904, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.69% (1.1170 => 1.1471, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.59% (0.6227 => 0.6388, std.dev.: 0.0047) MultiSource/Applications/SPASS/SPASS: 2.57% (14.2605 => 14.6271, std.dev.: 0.1386) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.54% (0.7966 => 0.8168, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.50% (0.8069 => 0.8271, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.45% (0.8611 => 0.8822, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.45% (0.9069 => 0.9291, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.44% (0.8317 => 0.8520, std.dev.: 0.0072) MultiSource/Applications/oggenc/oggenc: 2.38% (4.9628 => 5.0807, std.dev.: 0.0317) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.37% (0.8597 => 0.8801, std.dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: 2.37% (6.7320 => 6.8917, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.28% (0.8712 => 0.8911, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.28% (0.9688 => 0.9909, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.23% (0.8340 => 0.8526, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 2.19% (0.8768 => 0.8960, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.19% (0.8048 => 0.8224, std.dev.: 0.0056) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.17% (6.6074 => 6.7508, std.dev.: 0.0504) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.12% (0.8855 => 0.9043, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.1401 => 2.1855, std.dev.: 0.0060) MultiSource/Applications/lemon/lemon: 2.07% (1.0945 => 1.1172, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.00% (0.9056 => 0.9237, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.00% (0.8316 => 0.8482, std.dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 1.88% (15.3280 => 15.6164, std.dev.: 0.0969) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.81% (1.2423 => 1.2648, std.dev.: 0.0067) MultiSource/Applications/siod/siod: 1.80% (2.2184 => 2.2583, std.dev.: 0.0091) MultiSource/Applications/hexxagon/hexxagon: 1.78% (0.9810 => 0.9985, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.69% (0.8995 => 0.9147, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.65% (13.1811 => 13.3989, std.dev.: 0.0536) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.60% (1.6386 => 1.6648, std.dev.: 0.0097) MultiSource/Benchmarks/PAQ8p/paq8p: 1.01% (2.3764 => 2.4003, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 59.32% (1.5795 => 2.5164, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.17% (2.7978 => 3.7259, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.55% (0.3186 => 0.3522, std.dev.: 0.0034) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.93% (2.4333 => 2.6749, std.dev.: 0.0361) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.74% (1.1857 => 1.2775, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 5.96% (21.9654 => 23.2743, std.dev.: 0.2477) MultiSource/Benchmarks/mafft/pairlocalalign: 5.94% (63.1822 => 66.9324, std.dev.: 0.0648) MultiSource/Applications/siod/siod: 2.53% (3.6643 => 3.7569, std.dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.40% (2.4490 => 2.5077, std.dev.: 0.0146) SingleSource/Benchmarks/Misc/ReedSolomon: 2.18% (8.5322 => 8.7185, std.dev.: 0.0326) MultiSource/Applications/minisat/minisat: 2.17% (6.1525 => 6.2861, std.dev.: 0.0515) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.97% (4.3552 => 4.4409, std.dev.: 0.0251) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.92% (4.8362 => 4.9291, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/bh/bh: 1.70% (2.3560 => 2.3960, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -8.46% (3.2926 => 3.0142, std.dev.: 0.0906) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.70% (0.3269 => 0.3050, std.dev.: 0.0016) MultiSource/Applications/lua/lua: -5.26% (29.8330 => 28.2625, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout-C++/hash2: -1.47% (3.4237 => 3.3734, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.44% (1.2822 => 1.2637, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.35% (3.3479 => 3.3026, std.dev.: 0.0057) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.01% (16.4461 => 16.6127, std.dev.: 0.0558) MultiSource/Applications/obsequi/Obsequi: 2.09% (1.0262 => 1.0476, std.dev.: 0.0256) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6864.49% (0.3123 => 21.7501, std.dev.: 0.1267) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.99% (0.2463 => 0.3645, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 0.67% (0.6010 => 0.6050, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.63% (0.3266 => 0.3352, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 1.57% (0.1969 => 0.2000, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -8.58% (0.0408 => 0.0373, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.18% (0.0254 => 0.0251, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.11% (0.0384 => 0.0419, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 10.56% (0.0180 => 0.0199, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: - (0.1438 => 0.1438, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.76% (1.1329 => 1.1243, std.dev.: 0.0308) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.21% (0.1462 => 0.1465, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.46% (0.4164 => 0.4145, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.85% (0.1369 => 0.1330, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.14% (0.0641 => 0.0576, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.13% (0.0195 => 0.0185, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.04% (0.0578 => 0.0572, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.29% (1.1437 => 1.1404, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -28.57% (0.0014 => 0.0010, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.96% (0.0627 => 0.0621, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.78% (0.0180 => 0.0185, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.29% (0.8017 => 0.7994, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -38.71% (0.0062 => 0.0038, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 07:14:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 09:14:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121101141446.2599D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5490?compare_to=5488&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5490, Order: 167229, Start Time: 2012-11-01 12:49:47, End Time: 2012-11-01 14:14:47 To: 5488, Order: 167224, Start Time: 2012-11-01 11:01:30, End Time: 2012-11-01 12:26:37 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (6 on baseline) Performance Improvements: 1 (177 on baseline) Unchanged Tests: 1041 (859 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.16% (0.9630 => 0.9518, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.15% (3.1919 => 3.4201, std.dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 2.80% (3.7435 => 3.8483, std.dev.: 0.0384) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1014, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4937 => 7.6763, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/hash2: 2.16% (3.1932 => 3.2621, std.dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.78% (0.1584 => 0.1445, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.39% (0.1431 => 0.1311, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -7.43% (2.4924 => 2.3071, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.43% (0.3821 => 0.3537, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -7.32% (0.3812 => 0.3533, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -7.28% (0.3831 => 0.3552, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.22% (0.3891 => 0.3610, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -7.22% (0.3880 => 0.3600, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -7.19% (0.3896 => 0.3616, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.13% (0.3884 => 0.3607, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -7.12% (0.4033 => 0.3746, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -7.04% (0.3848 => 0.3577, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -7.04% (0.4176 => 0.3882, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/property: -6.83% (0.4199 => 0.3912, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -6.75% (0.4280 => 0.3991, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.48% (0.3025 => 0.2829, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: -6.48% (0.3026 => 0.2830, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.47% (0.9542 => 0.8925, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.43% (2.1713 => 2.0317, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -6.42% (0.2989 => 0.2797, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.41% (0.3057 => 0.2861, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.37% (0.2903 => 0.2718, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.36% (0.4151 => 0.3887, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -6.33% (0.2939 => 0.2753, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -6.30% (0.2871 => 0.2690, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -6.28% (0.2849 => 0.2670, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.25% (0.3837 => 0.3597, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -6.23% (0.1879 => 0.1762, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.21% (0.3252 => 0.3050, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -6.21% (0.3059 => 0.2869, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.21% (0.3849 => 0.3610, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.21% (0.3142 => 0.2947, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.20% (0.3016 => 0.2829, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.19% (4.5069 => 4.2280, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.17% (0.3323 => 0.3118, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: -6.15% (0.3446 => 0.3234, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -6.15% (0.3205 => 0.3008, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -6.14% (0.3194 => 0.2998, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.11% (0.2355 => 0.2211, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.11% (0.4813 => 0.4519, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -6.10% (1.3148 => 1.2346, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.10% (0.2428 => 0.2280, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -6.09% (0.3481 => 0.3269, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -6.05% (16.1920 => 15.2129, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.00% (0.3931 => 0.3695, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary: -5.98% (0.3394 => 0.3191, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.97% (22.4056 => 21.0674, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/matrix: -5.96% (0.3255 => 0.3061, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -5.93% (7.0961 => 6.6756, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.91% (3.5339 => 3.3250, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -5.88% (0.2160 => 0.2033, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.85% (0.3658 => 0.3444, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.83% (0.4321 => 0.4069, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: -5.82% (0.4861 => 0.4578, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -5.81% (0.3357 => 0.3162, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: -5.81% (0.3788 => 0.3568, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -5.80% (0.7779 => 0.7328, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: -5.79% (0.3867 => 0.3643, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.79% (0.2659 => 0.2505, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: -5.79% (0.4248 => 0.4002, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.75% (4.8161 => 4.5391, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.74% (0.4427 => 0.4173, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.71% (0.4083 => 0.3850, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: -5.67% (1.2515 => 1.1806, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.66% (0.6484 => 0.6117, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.61% (4.0323 => 3.8059, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.61% (0.9852 => 0.9299, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.61% (4.8802 => 4.6063, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/lists: -5.61% (0.3621 => 0.3418, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.59% (0.2933 => 0.2769, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.58% (1.0544 => 0.9956, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: -5.56% (0.6347 => 0.5994, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -5.54% (4.3330 => 4.0928, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.53% (0.7919 => 0.7481, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -5.50% (34.0927 => 32.2186, std.dev.: 0.0160) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.46% (5.4682 => 5.1694, std.dev.: 0.0141) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.46% (0.2548 => 0.2409, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.43% (1.2784 => 1.2090, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.40% (1.6474 => 1.5585, std.dev.: 0.0187) MultiSource/Applications/siod/siod: -5.37% (2.4021 => 2.2731, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.36% (14.2083 => 13.4461, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.36% (0.7198 => 0.6812, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -5.33% (0.6750 => 0.6390, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.27% (0.5999 => 0.5683, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.25% (1.3722 => 1.3001, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -5.23% (0.9179 => 0.8699, std.dev.: 0.0034) MultiSource/Applications/lua/lua: -5.19% (4.0594 => 3.8487, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference-object: -5.19% (0.6441 => 0.6107, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.18% (1.2300 => 1.1663, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.17% (1.6364 => 1.5518, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -5.15% (1.1450 => 1.0860, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: -5.13% (18.2933 => 17.3542, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/hash: -5.08% (0.4524 => 0.4294, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.07% (6.7716 => 6.4280, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.07% (0.3491 => 0.3314, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.06% (17.1032 => 16.2377, std.dev.: 0.0105) MultiSource/Benchmarks/mafft/pairlocalalign: -5.05% (9.2283 => 8.7625, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: -5.01% (0.4515 => 0.4289, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.00% (0.2278 => 0.2164, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.00% (1.4642 => 1.3910, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.98% (0.5478 => 0.5205, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.97% (0.3483 => 0.3310, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.93% (0.2999 => 0.2851, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.93% (0.6293 => 0.5983, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.93% (1.2221 => 1.1619, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.88% (0.5925 => 0.5636, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.88% (0.5802 => 0.5519, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -4.86% (0.7982 => 0.7594, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.85% (0.8521 => 0.8108, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.84% (0.5863 => 0.5579, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -4.83% (0.7447 => 0.7087, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.83% (0.5591 => 0.5321, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.83% (0.6194 => 0.5895, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.83% (2.2587 => 2.1497, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.80% (1.2210 => 1.1624, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.80% (0.5857 => 0.5576, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -4.79% (0.2985 => 0.2842, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.79% (0.6681 => 0.6361, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.78% (0.6230 => 0.5932, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: -4.75% (0.3581 => 0.3411, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.74% (0.5575 => 0.5311, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.71% (0.9557 => 0.9107, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.70% (0.4916 => 0.4685, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.69% (0.7339 => 0.6995, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.67% (0.6297 => 0.6003, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.66% (0.6052 => 0.5770, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.64% (0.5581 => 0.5322, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.63% (0.5570 => 0.5312, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.61% (0.5705 => 0.5442, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.61% (0.6660 => 0.6353, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: -4.60% (15.5079 => 14.7951, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.58% (0.6260 => 0.5973, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.58% (0.5849 => 0.5581, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.58% (8.0126 => 7.6458, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.57% (0.6440 => 0.6146, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.55% (0.6676 => 0.6372, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.55% (0.6395 => 0.6104, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.55% (0.5805 => 0.5541, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.55% (0.6446 => 0.6153, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.54% (0.6189 => 0.5908, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.53% (0.5569 => 0.5317, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.51% (0.6667 => 0.6366, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.51% (0.6304 => 0.6020, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.49% (0.7524 => 0.7186, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.49% (0.5859 => 0.5596, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.47% (0.5456 => 0.5212, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.46% (0.3406 => 0.3254, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.46% (0.5941 => 0.5676, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.46% (0.3319 => 0.3171, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.44% (0.6033 => 0.5765, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -4.44% (1.3864 => 1.3249, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.42% (0.6736 => 0.6438, std.dev.: 0.0029) MultiSource/Applications/treecc/treecc: -4.41% (2.1401 => 2.0458, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/09-vor/vor: -4.40% (0.3271 => 0.3127, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.38% (0.2695 => 0.2577, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.35% (0.5567 => 0.5325, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.32% (0.8418 => 0.8054, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.27% (0.6395 => 0.6122, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.19% (0.7021 => 0.6727, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -4.16% (3.5154 => 3.3691, std.dev.: 0.0041) MultiSource/Applications/hbd/hbd: -4.04% (1.5610 => 1.4979, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.02% (0.5168 => 0.4960, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -4.01% (15.2527 => 14.6405, std.dev.: 0.0163) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.91% (0.9077 => 0.8722, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: -3.90% (1.1530 => 1.1080, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.59% (5.0226 => 4.8424, std.dev.: 0.0186) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.55% (0.5329 => 0.5140, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -2.34% (20.7746 => 20.2893, std.dev.: 0.0224) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7559, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/richards_benchmark: -8.61% (1.2842 => 1.1736) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.78% (2.2633 => 2.1777, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.06% (1.3096 => 1.2826, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4729, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 07:23:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 09:23:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121101142342.603282A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5491?compare_to=5486&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5491, Order: 167229, Start Time: 2012-11-01 12:50:25, End Time: 2012-11-01 14:23:45 To: 5486, Order: 167223, Start Time: 2012-11-01 10:47:36, End Time: 2012-11-01 12:20:52 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 0 (173 on baseline) Performance Improvements: 2 (53 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 1 (1 on baseline) Unchanged Tests: 1039 (663 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.23% (10.2140 => 10.0886, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.04% (1.0145 => 1.0039, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.85% (0.0667 => 0.0648, std.dev.: 0.0023) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 191.57% (0.5229 => 1.5246, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 13.32% (14.9895 => 16.9861, std.dev.: 0.0135) MultiSource/Applications/kimwitu++/kc: 36.32% (14.1553 => 19.2968, std.dev.: 0.0102) MultiSource/Benchmarks/MallocBench/gs/gs: 12.52% (4.1105 => 4.6252, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 29.81% (1.1048 => 1.4341, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 306.78% (7.1582 => 29.1182, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.38% (3.4629 => 5.8309, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 63.07% (0.6222 => 1.0146, std.dev.: 0.0058) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10587.50% (0.0720 => 7.6950, std.dev.: 0.0040) MultiSource/Applications/SIBsim4/SIBsim4: 3836600.00% (0.0001 => 3.8367, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 11185100.00% (0.0001 => 11.1852, std.dev.: 0.0141) MultiSource/Applications/kimwitu++/kc: 50800.00% (0.0001 => 0.0509, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -10.71% (0.1485 => 0.1326, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 747700.00% (0.0001 => 0.7478, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050100.00% (0.0001 => 10.0502, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5490900.00% (0.0001 => 5.4910, std.dev.: 0.0013) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/CoyoteBench/almabench: 41.64% (0.0730 => 0.1034, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/distray/distray: 38.83% (0.1056 => 0.1466, std.dev.: 0.0005) SingleSource/UnitTests/vla: 29.30% (0.0355 => 0.0459, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 26.84% (8.1363 => 10.3201, std.dev.: 0.0034) MultiSource/Applications/ClamAV/clamscan: 22.33% (22.1758 => 27.1272, std.dev.: 0.0202) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.31% (0.1566 => 0.1884, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 17.87% (0.1175 => 0.1385, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.28% (0.0793 => 0.0930, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.25% (0.3177 => 0.3725, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 16.89% (0.0746 => 0.0872, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.88% (0.0871 => 0.1018, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.79% (0.4879 => 0.5698, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 16.17% (0.2554 => 0.2967, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.04% (0.0798 => 0.0926, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.60% (0.8172 => 0.9447, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.59% (0.1584 => 0.1831, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.44% (0.0842 => 0.0972, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/mst/mst: 15.05% (0.1163 => 0.1338, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.99% (0.0834 => 0.0959, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.89% (2.2022 => 2.5302, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.89% (0.2700 => 0.3102, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 14.86% (0.1655 => 0.1901, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 14.75% (0.1695 => 0.1945, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.56% (0.0886 => 0.1015, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.24% (0.2065 => 0.2359, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.14% (0.1337 => 0.1526, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 14.01% (0.5105 => 0.5820, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.97% (0.1940 => 0.2211, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 13.91% (0.7115 => 0.8105, std.dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 13.76% (0.1555 => 0.1769, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.67% (0.2758 => 0.3135, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.64% (0.5981 => 0.6797, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.64% (0.0770 => 0.0875, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.61% (0.1117 => 0.1269, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 13.55% (0.1151 => 0.1307, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.51% (0.0770 => 0.0874, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 13.41% (0.7433 => 0.8430, std.dev.: 0.0019) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.39% (0.1143 => 0.1296, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 13.38% (0.3109 => 0.3525, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: 13.30% (1.1642 => 1.3190, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.29% (0.6675 => 0.7562, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.25% (0.1510 => 0.1710, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.21% (0.2271 => 0.2571, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.19% (0.2107 => 0.2385, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.16% (0.1125 => 0.1273, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 13.12% (0.7835 => 0.8863, std.dev.: 0.0042) MultiSource/Applications/d/make_dparser: 13.09% (3.3354 => 3.7721, std.dev.: 0.0055) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.07% (0.3121 => 0.3529, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.03% (0.9765 => 1.1037, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.93% (0.1029 => 0.1162, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.92% (1.5415 => 1.7406, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.78% (0.4615 => 0.5205, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/exptree: 12.78% (0.0814 => 0.0918, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.76% (0.5860 => 0.6608, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.69% (0.1032 => 0.1163, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.62% (0.1062 => 0.1196, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.48% (0.5569 => 0.6264, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/health/health: 12.15% (0.1268 => 0.1422, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.13% (1.3050 => 1.4633, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.12% (0.3441 => 0.3858, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 12.02% (2.0273 => 2.2709, std.dev.: 0.0055) MultiSource/Applications/lua/lua: 12.01% (3.8723 => 4.3375, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.97% (0.1236 => 0.1384, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 11.80% (0.3423 => 0.3827, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.79% (0.5020 => 0.5612, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.60% (0.6450 => 0.7198, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.57% (0.1625 => 0.1813, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.56% (0.2603 => 0.2904, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.40% (0.3307 => 0.3684, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/rem: 11.36% (0.1144 => 0.1274) MultiSource/Applications/lemon/lemon: 11.35% (1.0722 => 1.1939, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.28% (4.2646 => 4.7455, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.20% (1.5859 => 1.7636, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/parameter-passing: 11.15% (0.3927 => 0.4365, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: 11.07% (0.1463 => 0.1625, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 11.00% (0.3473 => 0.3855, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.98% (0.0929 => 0.1031, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.87% (0.3828 => 0.4244, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.86% (0.1695 => 0.1879, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 10.83% (0.0933 => 0.1034, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 10.81% (0.3561 => 0.3946, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.81% (0.3543 => 0.3926, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.81% (0.3497 => 0.3875, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.78% (0.3543 => 0.3925, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.78% (0.3516 => 0.3895, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.73% (0.1044 => 0.1156, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 10.71% (1.1840 => 1.3108, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.70% (0.1906 => 0.2110, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 10.69% (0.3180 => 0.3520, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.67% (2.2024 => 2.4375, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/oourafft: 10.66% (0.3282 => 0.3632, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.64% (0.3694 => 0.4087, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 10.63% (0.4299 => 0.4756, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 10.58% (2.2969 => 2.5398, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 10.54% (9.4845 => 10.4841, std.dev.: 0.0089) SingleSource/UnitTests/ObjC/property: 10.47% (0.3886 => 0.4293, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 10.46% (0.8921 => 0.9854, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.31% (0.8101 => 0.8936, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: 10.27% (0.3387 => 0.3735, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.88% (1.1861 => 1.3033, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 9.85% (0.6456 => 0.7092, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.76% (1.4186 => 1.5570, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.41% (0.1892 => 0.2070, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.14% (0.4103 => 0.4478, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.82% (0.3865 => 0.4206, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.82% (0.6030 => 0.6562, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 8.81% (0.4289 => 0.4667, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.67% (5.0018 => 5.4355, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.65% (0.2266 => 0.2462, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 8.64% (0.4620 => 0.5019, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.62% (0.5925 => 0.6436, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.54% (0.4203 => 0.4562, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 8.52% (1.5603 => 1.6932, std.dev.: 0.0060) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.50% (0.1330 => 0.1443, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.44% (4.9449 => 5.3622, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.44% (0.2430 => 0.2635, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 8.42% (0.3422 => 0.3710, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.26% (0.4636 => 0.5019, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.93% (0.7326 => 0.7907, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists1: 7.84% (0.3684 => 0.3973, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 7.66% (0.3603 => 0.3879, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.64% (5.7591 => 6.1992, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/moments: 7.56% (0.4048 => 0.4354, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.28% (14.3668 => 15.4126, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.24% (0.3162 => 0.3391, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.06% (0.3427 => 0.3669, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.96% (0.3650 => 0.3904, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 6.73% (17.1811 => 18.3380, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/strcat: 6.68% (0.2831 => 0.3020, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.64% (0.3826 => 0.4080, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/matrix: 6.62% (0.3098 => 0.3303, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.58% (0.3283 => 0.3499, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.52% (0.8067 => 0.8593, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.52% (0.2793 => 0.2975, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.51% (3.8922 => 4.1456, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.47% (0.4064 => 0.4327, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.36% (0.2891 => 0.3075, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 6.34% (0.3232 => 0.3437, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.34% (0.2871 => 0.3053, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 6.31% (0.3092 => 0.3287, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 6.24% (0.2725 => 0.2895, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.20% (0.2872 => 0.3050, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.20% (0.2905 => 0.3085, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.19% (2.0665 => 2.1945, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.02% (0.2756 => 0.2922, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 5.95% (1.2842 => 1.3606, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wc: 5.83% (0.3052 => 0.3230, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.80% (0.2877 => 0.3044, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2714 => 0.2870, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 5.60% (0.2802 => 0.2959, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.27% (0.3379 => 0.3557, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.94% (0.3136 => 0.3291, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.96% (0.3131 => 0.3255, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.30% (0.3817 => 0.3943, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.06% (7.9617 => 8.0461, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 19.80% (2.8904 => 3.4627, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.56% (1.1145 => 1.2991, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 10.04% (1.1396 => 1.2540, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.11% (0.9540 => 1.0218) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3689, std.dev.: 0.0052) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.73% (4.2280 => 4.3435, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.39% (8.6802 => 8.8880, std.dev.: 0.0164) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.97% (3.6395 => 3.7113, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/bisort/bisort: 1.96% (0.8333 => 0.8496, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2080, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.92% (6.6874 => 0.1388, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -75.82% (0.8651 => 0.2092, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -54.41% (5.3855 => 2.4551, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.12% (5.3526 => 2.4558, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: -45.75% (0.1622 => 0.0880, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.52% (5.2763 => 3.1385, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -23.96% (1.7609 => 1.3390, std.dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.83% (2.9384 => 2.5614, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -10.32% (1.1194 => 1.0039, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: -10.25% (10.4361 => 9.3667, std.dev.: 0.0089) SingleSource/UnitTests/Vector/constpool: -9.03% (54.1659 => 49.2744, std.dev.: 0.0342) MultiSource/Benchmarks/PAQ8p/paq8p: -2.69% (10.3673 => 10.0886, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -2.47% (63.2438 => 61.6790, std.dev.: 0.0129) MultiSource/Applications/JM/lencod/lencod: -2.12% (21.9371 => 21.4728, std.dev.: 0.0173) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.89% (0.3987 => 0.2516, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -30.27% (10.7105 => 7.4683, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -20.57% (2.6778 => 2.1271, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -16.34% (1.6925 => 1.4159, std.dev.: 0.0092) MultiSource/Benchmarks/NPB-serial/is/is: -11.00% (9.5636 => 8.5113, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -10.93% (1.5373 => 1.3693, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.40% (19.9488 => 18.2739, std.dev.: 0.0150) MultiSource/Benchmarks/FreeBench/mason/mason: -7.91% (0.2161 => 0.1990, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -7.47% (6.6465 => 6.1503, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.12% (1.8329 => 1.7024, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.22% (1.2373 => 1.1604, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.12% (1.6805 => 1.5944, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5082, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.62% (1.5660 => 1.4937, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.00% (0.2497 => 0.2397) MultiSource/Applications/siod/siod: -3.77% (3.2827 => 3.1591, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -3.71% (4.5009 => 4.3339, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.50% (32.5116 => 31.3731, std.dev.: 0.0150) MultiSource/Benchmarks/sim/sim: -3.24% (5.0483 => 4.8849, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.18% (0.9957 => 0.9640, std.dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: -2.84% (4.6441 => 4.5124, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.70% (0.4808 => 0.4678, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.17% (8.1563 => 7.9795, std.dev.: 0.0183) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/Olden/power/power: -2.14% (1.1277 => 1.1036, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: -1.97% (11.3103 => 11.0872, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -1.86% (10.2830 => 10.0920, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6778, std.dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5093, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: -1.28% (6.2999 => 6.2191, std.dev.: 0.0100) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (85.0658 => 83.9854, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0023) Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 07:56:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 09:56:12 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121101145612.4459A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5492?compare_to=5489&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5492, Order: 167229, Start Time: 2012-11-01 13:28:28, End Time: 2012-11-01 14:56:16 To: 5489, Order: 167227, Start Time: 2012-11-01 11:45:05, End Time: 2012-11-01 13:11:35 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 22 (92 on baseline) Performance Improvements: 1 (5 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 968 (877 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 11.38% (0.1415 => 0.1576, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.79% (0.8190 => 0.8992, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.80% (0.3292 => 0.3450, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.99% (0.8318 => 0.8650, std.dev.: 0.0059) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.82% (0.3247 => 0.3371, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.79% (0.9479 => 0.9838, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.66% (0.6443 => 0.6679, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.22% (0.5994 => 0.6187, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.02% (1.2562 => 1.2941, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.99% (1.3378 => 1.3778, std.dev.: 0.0105) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.84% (0.4821 => 0.4958, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/gs/gs: 2.76% (4.1573 => 4.2721, std.dev.: 0.0258) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.60% (1.2032 => 1.2345, std.dev.: 0.0116) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.53% (4.5532 => 4.6682, std.dev.: 0.0281) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.49% (8.7440 => 8.9618, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.26% (4.2213 => 4.3166, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.26% (0.8910 => 0.9111, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.85% (0.8332 => 0.8486, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.56% (0.8911 => 0.9050, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.27% (0.9116 => 0.9232, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 8.76% (0.1187 => 0.1291, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.67% (14.7791 => 15.6174, std.dev.: 0.2382) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.42% (0.3522 => 0.3331, std.dev.: 0.0049) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.04% (16.6127 => 16.6201, std.dev.: 0.2526) MultiSource/Applications/obsequi/Obsequi: 0.24% (1.0476 => 1.0501, std.dev.: 0.0219) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.65% (21.7501 => 21.6080, std.dev.: 0.4273) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.14% (0.3645 => 0.3650, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: -0.26% (0.6050 => 0.6034, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.06% (0.3352 => 0.3350, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/strcat: -0.20% (0.2000 => 0.1996, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.46% (0.0218 => 0.0219, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 14.21% (0.0373 => 0.0426, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 32.27% (0.0251 => 0.0332, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0312 => 0.0313, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.43% (0.0419 => 0.0425, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/casts: 1.48% (0.0203 => 0.0206, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 11.06% (0.0199 => 0.0221, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 700.00% (0.0001 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.53% (0.1438 => 0.1460, std.dev.: 0.0051) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.03% (1.1243 => 1.1471, std.dev.: 0.0333) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.50% (0.1465 => 0.1487, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.68% (0.4145 => 0.4034, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.93% (0.1330 => 0.1369, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.81% (0.0576 => 0.0644, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 49.73% (0.0185 => 0.0277, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.59% (0.0572 => 0.0540, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.25% (1.1404 => 1.1432, std.dev.: 0.0204) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.23% (0.0031 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -90.00% (0.0010 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.09% (0.0621 => 0.0665, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 10.27% (0.0185 => 0.0204, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.31% (0.7994 => 0.7969, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 23.68% (0.0038 => 0.0047, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2304.49% (0.6332 => 15.2252, std.dev.: 0.2995) MultiSource/Benchmarks/McCat/08-main/main: 48.77% (0.1831 => 0.2724, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.86% (0.1559 => 0.1452, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1488.61% (0.3344 => 5.3123, std.dev.: 0.0249) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.70% (0.2364 => 0.3208, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel: - (0.0429 => 0.0429, std.dev.: 0.0037) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.80% (0.0224 => 0.0237, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -28.26% (0.0230 => 0.0165, std.dev.: 0.0010) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3499, std.dev.: 0.0309) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0710, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4939, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3428, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0371, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4015, std.dev.: 0.0040) SingleSource/Regression/C/uint64_to_float: -23.53% (2.1832 => 1.6694, std.dev.: 0.0094) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.42% (0.0810 => 0.0943, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.77% (0.0830 => 0.0936, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.60% (0.1425 => 0.1576, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.13% (0.2180 => 0.2379, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/04-bisect/bisect: 8.97% (0.1137 => 0.1239, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.06% (0.8321 => 0.8992, std.dev.: 0.0111) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.46% (0.3137 => 0.3371, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.30% (0.1466 => 0.1573, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.91% (0.2519 => 0.2693, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.81% (0.1983 => 0.2118, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.38% (0.7473 => 0.7950, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.36% (0.2279 => 0.2424, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.24% (0.6287 => 0.6679, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.16% (0.8148 => 0.8650, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.65% (1.1685 => 1.2345, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.47% (0.2998 => 0.3162, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.80% (1.1606 => 1.2163, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.76% (0.8697 => 0.9111, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.70% (0.3295 => 0.3450, std.dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 4.53% (1.1271 => 1.1782, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.27% (0.9435 => 0.9838, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.16% (0.3003 => 0.3128, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.00% (0.6227 => 0.6476, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.88% (0.8712 => 0.9050, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.84% (6.6074 => 6.8608, std.dev.: 0.0522) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.79% (0.5961 => 0.6187, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.76% (1.3279 => 1.3778, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.73% (0.9908 => 1.0278, std.dev.: 0.0095) MultiSource/Applications/SIBsim4/SIBsim4: 3.72% (1.2568 => 1.3036, std.dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.71% (1.1170 => 1.1584, std.dev.: 0.0109) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.66% (0.4783 => 0.4958, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.63% (8.6476 => 8.9618, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.63% (0.7966 => 0.8255, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.60% (0.4559 => 0.4723, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.44% (0.4127 => 0.4269, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.44% (0.8204 => 0.8486, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 3.43% (4.1305 => 4.2721, std.dev.: 0.0258) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 3.42% (0.8927 => 0.9232, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.36% (4.1763 => 4.3166, std.dev.: 0.0093) MultiSource/Applications/ClamAV/clamscan: 3.36% (14.7684 => 15.2642, std.dev.: 0.0773) MultiSource/Applications/treecc/treecc: 3.35% (1.9948 => 2.0616, std.dev.: 0.0233) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.31% (1.2526 => 1.2941, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/moments: 3.29% (0.3645 => 0.3765, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 3.29% (3.2366 => 3.3430, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.28% (0.8317 => 0.8590, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.23% (0.8286 => 0.8554, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.23% (1.6386 => 1.6915, std.dev.: 0.0125) MultiSource/Applications/SPASS/SPASS: 3.17% (14.2605 => 14.7131, std.dev.: 0.0256) MultiSource/Benchmarks/Prolangs-C/football/football: 3.10% (0.8768 => 0.9040, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.97% (0.8597 => 0.8852, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/05-eks/eks: 2.82% (0.4397 => 0.4521, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.81% (0.9069 => 0.9324, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.80% (1.4479 => 1.4884, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.79% (0.8007 => 0.8230, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 2.70% (2.2184 => 2.2784, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.67% (0.6586 => 0.6762, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 2.66% (1.0945 => 1.1236, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.63% (0.8359 => 0.8579, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.62% (0.5191 => 0.5327, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.55% (0.8050 => 0.8255, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.52% (0.8069 => 0.8272, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.48% (0.8805 => 0.9023, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.44% (0.8885 => 0.9102, std.dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 2.43% (8.6247 => 8.8339, std.dev.: 0.0423) MultiSource/Applications/oggenc/oggenc: 2.41% (4.9628 => 5.0823, std.dev.: 0.0412) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.30% (0.8340 => 0.8532, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.24% (13.1811 => 13.4758, std.dev.: 0.0821) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.21% (0.8716 => 0.8909, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.20% (0.9039 => 0.9238, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.14% (4.5702 => 4.6682, std.dev.: 0.0281) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.09% (0.9688 => 0.9890, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.08% (0.8066 => 0.8234, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.06% (4.4880 => 4.5805, std.dev.: 0.0123) MultiSource/Benchmarks/Bullet/bullet: 2.05% (31.8598 => 32.5114, std.dev.: 0.1445) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.00% (0.8338 => 0.8505, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.91% (0.8048 => 0.8202, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 1.84% (15.3280 => 15.6103, std.dev.: 0.0683) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.82% (0.7932 => 0.8076, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.64% (0.8316 => 0.8452, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.12% (1.5315 => 1.5487, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 57.35% (1.5795 => 2.4854, std.dev.: 0.0133) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.45% (2.7978 => 3.7336, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.51% (2.4333 => 2.6648, std.dev.: 0.0402) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.98% (1.1857 => 1.2803, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.64% (14.6451 => 15.6174, std.dev.: 0.2382) MultiSource/Benchmarks/mafft/pairlocalalign: 5.96% (63.1822 => 66.9460, std.dev.: 0.0392) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.55% (0.3186 => 0.3331, std.dev.: 0.0049) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.71% (0.2887 => 0.2994, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.78% (44.5605 => 45.8001, std.dev.: 0.3855) MultiSource/Applications/siod/siod: 2.74% (3.6643 => 3.7647, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/bh/bh: 1.66% (2.3560 => 2.3950, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.18% (4.8362 => 4.8934, std.dev.: 0.0079) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -30.77% (0.0338 => 0.0234, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.01% (0.3269 => 0.3040, std.dev.: 0.0042) MultiSource/Applications/lua/lua: -5.19% (29.8330 => 28.2842, std.dev.: 0.2019) SingleSource/Benchmarks/Shootout-C++/hash2: -1.43% (3.4237 => 3.3749, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.31% (3.3479 => 3.3041, std.dev.: 0.0007) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.06% (16.4461 => 16.6201, std.dev.: 0.2526) MultiSource/Applications/obsequi/Obsequi: 2.33% (1.0262 => 1.0501, std.dev.: 0.0219) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6818.99% (0.3123 => 21.6080, std.dev.: 0.4273) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.19% (0.2463 => 0.3650, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 0.40% (0.6010 => 0.6034, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.57% (0.3266 => 0.3350, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/strcat: 1.37% (0.1969 => 0.1996, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/casts: 8.42% (0.0190 => 0.0206, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 22.78% (0.0180 => 0.0221, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.53% (0.1438 => 0.1460, std.dev.: 0.0051) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.25% (1.1329 => 1.1471, std.dev.: 0.0333) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.71% (0.1462 => 0.1487, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.12% (0.4164 => 0.4034, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: - (0.1369 => 0.1369, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.47% (0.0641 => 0.0644, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.57% (0.0578 => 0.0540, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.04% (1.1437 => 1.1432, std.dev.: 0.0204) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.06% (0.0627 => 0.0665, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 13.33% (0.0180 => 0.0204, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.60% (0.8017 => 0.7969, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -24.19% (0.0062 => 0.0047, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 09:02:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 11:02:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121101160245.5C0B82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5493?compare_to=5490&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5493, Order: 167230, Start Time: 2012-11-01 14:37:44, End Time: 2012-11-01 16:02:47 To: 5490, Order: 167229, Start Time: 2012-11-01 12:49:47, End Time: 2012-11-01 14:14:47 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (176 on baseline) Unchanged Tests: 1041 (861 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.24% (78.4826 => 80.2381, std.dev.: 0.2085) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.32% (1.2783 => 1.3719, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.15% (3.1919 => 3.4200, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.06% (2.0478 => 2.1104, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/salsa20: 2.54% (7.4937 => 7.6838, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/hash2: 2.33% (3.1932 => 3.2677, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.90% (0.1584 => 0.1443, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.25% (0.1431 => 0.1313, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -7.37% (2.4924 => 2.3086, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.30% (0.3821 => 0.3542, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -7.27% (0.3812 => 0.3535, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: -7.23% (0.3831 => 0.3554, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: -7.22% (0.3848 => 0.3570, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -7.22% (0.3880 => 0.3600, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.17% (0.3891 => 0.3612, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.13% (0.3884 => 0.3607, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions: -7.06% (0.4176 => 0.3881, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: -7.03% (0.3896 => 0.3622, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.99% (0.4033 => 0.3751, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -6.71% (0.4280 => 0.3993, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/property: -6.60% (0.4199 => 0.3922, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.49% (0.9542 => 0.8923, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.45% (0.3025 => 0.2830, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.35% (0.3057 => 0.2863, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -6.32% (0.2989 => 0.2800, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -6.31% (0.3026 => 0.2835, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.30% (0.2903 => 0.2720, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.30% (0.3016 => 0.2826, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -6.29% (0.3194 => 0.2993, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -6.27% (0.2871 => 0.2691) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.26% (0.4151 => 0.3891, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -6.26% (0.2939 => 0.2755, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -6.23% (0.1879 => 0.1762, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -6.21% (0.2849 => 0.2672, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.19% (2.1713 => 2.0368, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.18% (0.3849 => 0.3611, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.15% (4.5069 => 4.2299, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.14% (0.3142 => 0.2949, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -6.13% (0.3394 => 0.3186, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.12% (0.3837 => 0.3602, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -6.12% (0.3446 => 0.3235, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -6.11% (0.3255 => 0.3056, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: -6.11% (0.3059 => 0.2872, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.10% (0.3658 => 0.3435, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.10% (0.2428 => 0.2280, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.09% (0.3252 => 0.3054, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: -6.08% (0.3205 => 0.3010, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -6.03% (0.3481 => 0.3271, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.03% (0.2355 => 0.2213, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.03% (0.3931 => 0.3694, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.03% (0.4813 => 0.4523, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -6.02% (16.1920 => 15.2178, std.dev.: 0.0121) MultiSource/Applications/hexxagon/hexxagon: -5.99% (1.3148 => 1.2360, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: -5.99% (7.0961 => 6.6709, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.99% (0.3323 => 0.3124, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.98% (22.4056 => 21.0659, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.93% (3.5339 => 3.3244, std.dev.: 0.0054) MultiSource/Applications/sgefa/sgefa: -5.90% (0.3357 => 0.3159, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: -5.88% (0.2160 => 0.2033, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.88% (0.4083 => 0.3843, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -5.85% (0.3621 => 0.3409, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: -5.79% (0.4248 => 0.4002, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: -5.78% (0.7779 => 0.7329, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: -5.72% (0.3867 => 0.3646, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.71% (0.4427 => 0.4174, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/sieve: -5.70% (0.3788 => 0.3572, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -5.70% (0.4861 => 0.4584, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.68% (0.2659 => 0.2508, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.65% (4.8161 => 4.5438, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.62% (0.4321 => 0.4078, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: -5.61% (0.4524 => 0.4270, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.61% (0.6484 => 0.6120, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.59% (1.0544 => 0.9955, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.58% (0.9852 => 0.9302, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -5.58% (0.6347 => 0.5993, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.56% (4.8802 => 4.6088, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: -5.55% (1.2515 => 1.1821, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.54% (1.2784 => 1.2076, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.52% (4.0323 => 3.8098, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.49% (0.2548 => 0.2408, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -5.46% (4.3330 => 4.0963, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.44% (5.4682 => 5.1705, std.dev.: 0.0177) SingleSource/Benchmarks/Misc-C++/bigfib: -5.44% (0.6750 => 0.6383, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.42% (0.2933 => 0.2774, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -5.40% (34.0927 => 32.2529, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.35% (0.5999 => 0.5678, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.34% (1.6474 => 1.5595, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -5.29% (0.9179 => 0.8693, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.29% (14.2083 => 13.4565, std.dev.: 0.0103) MultiSource/Applications/siod/siod: -5.25% (2.4021 => 2.2759, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.24% (1.2300 => 1.1655, std.dev.: 0.0019) MultiSource/Applications/lua/lua: -5.24% (4.0594 => 3.8468, std.dev.: 0.0083) SingleSource/UnitTests/ObjC++/property-reference-object: -5.22% (0.6441 => 0.6105, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.21% (1.3722 => 1.3007, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.18% (1.6364 => 1.5516, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.18% (0.7198 => 0.6825, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: -5.13% (18.2933 => 17.3546, std.dev.: 0.0216) MultiSource/Benchmarks/mafft/pairlocalalign: -5.11% (9.2283 => 8.7568, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.06% (6.7716 => 6.4287, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: -5.06% (17.1032 => 16.2377, std.dev.: 0.0197) MultiSource/Applications/lemon/lemon: -5.06% (1.1450 => 1.0871, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.05% (0.7919 => 0.7519, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.05% (0.8521 => 0.8091, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.03% (1.4642 => 1.3906, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: -4.96% (0.4515 => 0.4291, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.96% (0.3491 => 0.3318, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.93% (0.6293 => 0.5983, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.91% (0.5925 => 0.5634, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.90% (0.5857 => 0.5570, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.89% (0.5478 => 0.5210, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -4.89% (0.7982 => 0.7592, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -4.85% (0.7447 => 0.7086, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.85% (0.5591 => 0.5320, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.84% (0.9557 => 0.9094, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.84% (2.2587 => 2.1494, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (0.6681 => 0.6358, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.83% (0.5863 => 0.5580, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.81% (0.5802 => 0.5523, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.80% (1.2221 => 1.1634, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.78% (1.2210 => 1.1626, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.78% (0.4916 => 0.4681, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.78% (0.6052 => 0.5763, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: -4.78% (0.3581 => 0.3410, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.77% (0.7339 => 0.6989, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.75% (0.6230 => 0.5934, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.74% (0.5575 => 0.5311, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.68% (0.6194 => 0.5904, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: -4.66% (15.5079 => 14.7849, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.65% (0.6446 => 0.6146, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.65% (0.3483 => 0.3321, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.65% (0.5705 => 0.5440, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.63% (0.5569 => 0.5311, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.63% (0.5570 => 0.5312, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.62% (0.5581 => 0.5323, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.61% (0.6395 => 0.6100, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.60% (0.6304 => 0.6014, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.59% (0.5859 => 0.5590, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.59% (0.6297 => 0.6008, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.58% (0.5849 => 0.5581, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.57% (0.2385 => 0.2276, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.56% (0.6660 => 0.6356, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.53% (0.7524 => 0.7183, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.52% (0.6260 => 0.5977, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.51% (0.5805 => 0.5543, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.51% (8.0126 => 7.6516, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.49% (0.6189 => 0.5911, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.48% (0.6667 => 0.6368, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.46% (0.6676 => 0.6378, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -4.46% (0.3406 => 0.3254, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.45% (0.5567 => 0.5319, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.44% (0.6736 => 0.6437, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: -4.43% (0.3271 => 0.3126, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: -4.39% (1.3864 => 1.3255, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.38% (0.6440 => 0.6158, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.38% (0.6395 => 0.6115, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -4.37% (2.1401 => 2.0466, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.36% (0.5688 => 0.5440, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.34% (0.2695 => 0.2578, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.33% (0.2999 => 0.2869, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -4.32% (0.2985 => 0.2856, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.31% (0.5456 => 0.5221, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.29% (0.6033 => 0.5774, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.24% (0.5941 => 0.5689, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.19% (0.7021 => 0.6727, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -4.12% (0.8418 => 0.8071, std.dev.: 0.0039) MultiSource/Applications/d/make_dparser: -4.05% (3.5154 => 3.3730, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.02% (0.5168 => 0.4960, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -3.96% (15.2527 => 14.6481, std.dev.: 0.0139) MultiSource/Applications/hbd/hbd: -3.96% (1.5610 => 1.4992, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: -3.89% (1.1530 => 1.1082, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.71% (0.3319 => 0.3196, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.57% (0.5329 => 0.5139, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.51% (5.0226 => 4.8462, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.04% (0.9077 => 0.8801, std.dev.: 0.0034) SingleSource/UnitTests/Vector/constpool: -2.26% (20.7746 => 20.3052, std.dev.: 0.0194) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7566, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.84% (2.2633 => 2.1765, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4711, std.dev.: 0.0044) Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 09:26:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 11:26:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121101162631.133462A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5494?compare_to=5491&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5494, Order: 167230, Start Time: 2012-11-01 14:53:22, End Time: 2012-11-01 16:26:33 To: 5491, Order: 167229, Start Time: 2012-11-01 12:50:25, End Time: 2012-11-01 14:23:45 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 1 (175 on baseline) Performance Improvements: 0 (54 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 1 (1 on baseline) Unchanged Tests: 1040 (660 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.85% (55.3727 => 56.3988, std.dev.: 0.0948) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0648 => 0.0647, std.dev.: 0.0033) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 191.22% (0.5229 => 1.5228, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 13.38% (14.9895 => 16.9958, std.dev.: 0.0067) MultiSource/Applications/kimwitu++/kc: 36.16% (14.1553 => 19.2742, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/gs/gs: 12.60% (4.1105 => 4.6283, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 29.77% (1.1048 => 1.4337, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 306.49% (7.1582 => 29.0975, std.dev.: 0.0147) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.66% (3.4629 => 5.8405, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_container: 62.99% (0.6222 => 1.0141, std.dev.: 0.0007) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10589.44% (0.0720 => 7.6964, std.dev.: 0.0100) MultiSource/Applications/SIBsim4/SIBsim4: 3836600.00% (0.0001 => 3.8367, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 11188500.00% (0.0001 => 11.1886, std.dev.: 0.0100) MultiSource/Applications/kimwitu++/kc: 50500.00% (0.0001 => 0.0506, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -10.77% (0.1485 => 0.1325, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 747500.00% (0.0001 => 0.7476, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050300.00% (0.0001 => 10.0504, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488400.00% (0.0001 => 5.4885, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/CoyoteBench/almabench: 41.92% (0.0730 => 0.1036, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/distray/distray: 38.92% (0.1056 => 0.1467, std.dev.: 0.0003) SingleSource/UnitTests/vla: 29.30% (0.0355 => 0.0459) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 26.92% (8.1363 => 10.3262, std.dev.: 0.0064) MultiSource/Applications/ClamAV/clamscan: 22.22% (22.1758 => 27.1035, std.dev.: 0.0046) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.24% (0.1566 => 0.1883, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 17.96% (0.1175 => 0.1386, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.53% (0.0793 => 0.0932, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.19% (0.3177 => 0.3723, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.11% (0.0871 => 0.1020, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/n-body: 16.89% (0.0746 => 0.0872) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.79% (0.4879 => 0.5698, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.17% (0.0798 => 0.0927, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.07% (0.0834 => 0.0968, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 16.05% (0.2554 => 0.2964, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.93% (0.8172 => 0.9474, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.53% (0.1584 => 0.1830, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.08% (0.0842 => 0.0969, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 14.79% (0.1163 => 0.1335, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.76% (2.2022 => 2.5273, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 14.63% (0.1695 => 0.1943, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 14.62% (0.1655 => 0.1897, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.48% (0.2700 => 0.3091, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.33% (0.0886 => 0.1013, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.24% (0.2065 => 0.2359) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.93% (0.5105 => 0.5816, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.92% (0.2758 => 0.3142, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: 13.77% (0.7115 => 0.8095, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.77% (0.0770 => 0.0876, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.71% (0.1940 => 0.2206, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.69% (0.1337 => 0.1520, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 13.63% (0.1555 => 0.1767) MultiSource/Applications/aha/aha: 13.55% (0.1151 => 0.1307, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.48% (0.5981 => 0.6787, std.dev.: 0.0017) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.39% (0.1143 => 0.1296, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.38% (0.0770 => 0.0873, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.34% (0.1117 => 0.1266, std.dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 13.28% (0.3109 => 0.3522, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 13.25% (0.7433 => 0.8418, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 13.21% (0.7835 => 0.8870, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.19% (0.2107 => 0.2385, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.18% (0.1510 => 0.1709, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.16% (0.1125 => 0.1273, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 13.08% (1.1642 => 1.3165, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.08% (0.2271 => 0.2568, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.04% (0.4615 => 0.5217, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.03% (0.6675 => 0.7545, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.00% (0.5569 => 0.6293, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 12.97% (3.3354 => 3.7679, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.96% (0.9765 => 1.1031, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.93% (0.1029 => 0.1162, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.92% (1.5415 => 1.7406, std.dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.91% (0.3121 => 0.3524, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.73% (0.5860 => 0.6606, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/exptree: 12.65% (0.0814 => 0.0917, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.52% (0.1062 => 0.1195, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.40% (0.1032 => 0.1160, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.15% (0.3441 => 0.3859, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.10% (1.3050 => 1.4629, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.06% (0.1236 => 0.1385, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 11.91% (0.1268 => 0.1419, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 11.86% (0.3423 => 0.3829, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.83% (0.5020 => 0.5614, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 11.76% (3.8723 => 4.3278, std.dev.: 0.0107) MultiSource/Applications/treecc/treecc: 11.75% (2.0273 => 2.2656, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.45% (0.1625 => 0.1811, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.34% (0.3307 => 0.3682, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.32% (0.6450 => 0.7180, std.dev.: 0.0022) SingleSource/UnitTests/SignlessTypes/rem: 11.28% (0.1144 => 0.1273, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 11.26% (1.0722 => 1.1929, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.26% (0.2603 => 0.2896, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 11.20% (0.3927 => 0.4367, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.10% (4.2646 => 4.7379, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.09% (1.5859 => 1.7617, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 11.00% (0.1463 => 0.1624, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 11.00% (0.3473 => 0.3855, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.98% (0.0929 => 0.1031, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 10.93% (0.0933 => 0.1035, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.89% (0.3828 => 0.4245, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.87% (0.3561 => 0.3948, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.87% (0.3543 => 0.3928, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.87% (0.3497 => 0.3877, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.81% (0.3543 => 0.3926, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.80% (0.1695 => 0.1878, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 10.78% (0.3516 => 0.3895, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 10.75% (0.4299 => 0.4761, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 10.69% (9.4845 => 10.4982, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/for-in: 10.67% (0.3694 => 0.4088, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.62% (2.2024 => 2.4363, std.dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 10.55% (1.1840 => 1.3089, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.54% (0.1044 => 0.1154, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.52% (0.3886 => 0.4295, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 10.47% (0.3180 => 0.3513, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 10.45% (0.3282 => 0.3625, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 10.44% (0.8921 => 0.9852, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 10.43% (2.2969 => 2.5364, std.dev.: 0.0062) MultiSource/Benchmarks/sim/sim: 10.39% (0.3387 => 0.3739, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.39% (0.1906 => 0.2104, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.32% (0.8101 => 0.8937, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 10.02% (0.6456 => 0.7103, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.97% (1.1861 => 1.3044, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.83% (0.1892 => 0.2078, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.65% (1.4186 => 1.5555, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 9.30% (0.4289 => 0.4688, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.29% (0.4103 => 0.4484, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.00% (0.3865 => 0.4213, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.96% (0.6030 => 0.6570, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.85% (0.4620 => 0.5029, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.81% (0.5925 => 0.6447, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.78% (0.4203 => 0.4572, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.69% (0.2266 => 0.2463, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 8.58% (1.5603 => 1.6941, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.56% (0.4636 => 0.5033, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.56% (5.0018 => 5.4298, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: 8.36% (0.3422 => 0.3708, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.35% (0.2430 => 0.2633, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.30% (4.9449 => 5.3553, std.dev.: 0.0095) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.20% (0.1330 => 0.1439, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 8.12% (0.1268 => 0.1371, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.07% (0.7326 => 0.7917, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 8.05% (0.3603 => 0.3893, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 7.93% (0.4048 => 0.4369, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 7.93% (0.3684 => 0.3976, std.dev.: 0.0085) MultiSource/Applications/oggenc/oggenc: 7.69% (5.7591 => 6.2021, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.29% (0.3650 => 0.3916, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.17% (14.3668 => 15.3963, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/strcat: 7.14% (0.2831 => 0.3033, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.12% (0.3427 => 0.3671, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.99% (0.3162 => 0.3383, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.99% (0.4064 => 0.4348, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.95% (0.2793 => 0.2987, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 6.94% (0.3098 => 0.3313, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.93% (0.3826 => 0.4091, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.87% (0.3232 => 0.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 6.82% (0.3283 => 0.3507, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 6.82% (17.1811 => 18.3531, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.81% (0.2891 => 0.3088, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.79% (0.2871 => 0.3066, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.68% (0.2756 => 0.2940, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 6.64% (0.2905 => 0.3098, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.52% (2.0665 => 2.2012, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.51% (0.2872 => 0.3059, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.50% (0.2725 => 0.2902, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 6.45% (0.2714 => 0.2889, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.42% (3.8922 => 4.1421, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/methcall: 6.40% (0.2877 => 0.3061, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.26% (0.3052 => 0.3243, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 6.14% (0.2802 => 0.2974, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 6.11% (0.3092 => 0.3281, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 6.10% (1.2842 => 1.3625, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.93% (0.8067 => 0.8545, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 5.68% (0.3379 => 0.3571, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.45% (0.3136 => 0.3307, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.3131 => 0.3265, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.33% (0.3817 => 0.3944, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.85% (0.3935 => 0.4047, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.04% (7.9617 => 8.0446, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 19.81% (2.8904 => 3.4629, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.50% (1.1145 => 1.2984, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.79% (1.1396 => 1.2512, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3688, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.67% (8.6802 => 8.9118, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.45% (4.2280 => 4.3316, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.08% (1.0313 => 1.0527, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.88% (3.6395 => 3.7079, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/bisort/bisort: 1.84% (0.8333 => 0.8486, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.93% (6.6874 => 0.1386, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -75.86% (0.8651 => 0.2088, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -54.22% (5.3855 => 2.4656, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -53.86% (5.3526 => 2.4698, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: -45.68% (0.1622 => 0.0881, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.54% (5.2763 => 3.1371, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -23.89% (1.7609 => 1.3403, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.76% (2.9384 => 2.5634, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -10.33% (1.1194 => 1.0038, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -10.20% (10.4361 => 9.3721, std.dev.: 0.0068) SingleSource/UnitTests/Vector/constpool: -9.12% (54.1659 => 49.2285, std.dev.: 0.0667) MultiSource/Benchmarks/PAQ8p/paq8p: -3.38% (10.3673 => 10.0170, std.dev.: 0.0066) MultiSource/Benchmarks/Bullet/bullet: -2.44% (63.2438 => 61.7029, std.dev.: 0.0099) MultiSource/Applications/JM/lencod/lencod: -2.16% (21.9371 => 21.4634, std.dev.: 0.0116) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.97% (0.3987 => 0.2513, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.49% (1.1492 => 0.7643, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -30.26% (10.7105 => 7.4693, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -20.58% (2.6778 => 2.1268, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4220, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -11.01% (1.5373 => 1.3681, std.dev.: 0.0044) MultiSource/Benchmarks/NPB-serial/is/is: -10.99% (9.5636 => 8.5127, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (19.9488 => 18.2706, std.dev.: 0.0475) MultiSource/Benchmarks/FreeBench/mason/mason: -7.91% (0.2161 => 0.1990, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -7.48% (6.6465 => 6.1492, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.04% (1.8329 => 1.7039, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4780, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.11% (1.2373 => 1.1617, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.14% (1.6805 => 1.5941, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.64% (1.5835 => 1.5100, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.60% (1.5660 => 1.4939, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.06% (0.9957 => 0.9553, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.04% (0.2497 => 0.2396, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -3.76% (4.5009 => 4.3318, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -3.74% (3.2827 => 3.1599, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.52% (32.5116 => 31.3656, std.dev.: 0.0078) MultiSource/Benchmarks/sim/sim: -3.23% (5.0483 => 4.8850, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -2.73% (4.6441 => 4.5171, std.dev.: 0.0031) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.56% (0.4808 => 0.4685, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: -2.14% (1.1277 => 1.1036, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.10% (8.1563 => 7.9850, std.dev.: 0.0281) SingleSource/Benchmarks/Misc/salsa20: -2.02% (10.2830 => 10.0749, std.dev.: 0.0239) SingleSource/Benchmarks/CoyoteBench/almabench: -1.97% (11.3103 => 11.0876, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6809, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5136, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (85.0658 => 83.9861, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/lists: -1.18% (6.2999 => 6.2253, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8594, std.dev.: 0.0044) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.42% (0.2116 => 0.0647, std.dev.: 0.0033) Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 09:29:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 11:29:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121101162928.E89E32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5495?compare_to=5487&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5495, Order: 167229, Start Time: 2012-11-01 13:13:53, End Time: 2012-11-01 16:29:31 To: 5487, Order: 167221, Start Time: 2012-11-01 09:09:51, End Time: 2012-11-01 12:25:39 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (170 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1039 (719 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.56% (0.2090 => 0.2227, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.11% (54.3814 => 54.9842, std.dev.: 0.0295) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Bullet/bullet: -1.37% (27.3377 => 26.9636, std.dev.: 0.0081) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.36% (0.0625 => 0.0871, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.95% (0.1063 => 0.1392, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.33% (0.2969 => 0.3721, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.69% (0.4253 => 0.5303, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.59% (0.1106 => 0.1378, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 23.80% (0.4139 => 0.5124, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.27% (0.5900 => 0.7273, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 23.23% (0.0452 => 0.0557, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 23.09% (1.5932 => 1.9610, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.69% (0.0714 => 0.0876, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.67% (0.0547 => 0.0671, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.41% (0.4994 => 0.6113, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.09% (0.0584 => 0.0713, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 21.84% (0.5000 => 0.6092, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.29% (0.0897 => 0.1088, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.05% (0.1620 => 0.1961, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 20.76% (0.1021 => 0.1233, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 20.70% (0.0599 => 0.0723, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.42% (0.1107 => 0.1333, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 19.91% (0.0698 => 0.0837, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 19.70% (0.0604 => 0.0723, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 19.62% (0.0948 => 0.1134, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.59% (0.0633 => 0.0757, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.50% (0.3903 => 0.4664, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/05-eks/eks: 19.46% (0.1619 => 0.1934, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.37% (0.1549 => 0.1849, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.35% (0.0584 => 0.0697, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.31% (0.1103 => 0.1316, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.24% (0.1003 => 0.1196, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.22% (0.0541 => 0.0645, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.16% (0.0642 => 0.0765, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.14% (0.1604 => 0.1911, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 19.12% (0.0821 => 0.0978, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.86% (0.0822 => 0.0977, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 17.90% (0.5826 => 0.6869, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.78% (0.1462 => 0.1722, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 17.74% (0.0947 => 0.1115, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 17.71% (0.5889 => 0.6932, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 17.57% (0.0808 => 0.0950, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.51% (0.3890 => 0.4571, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 17.28% (0.1505 => 0.1765, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 17.27% (0.4029 => 0.4725, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.23% (0.2014 => 0.2361, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.14% (0.2736 => 0.3205, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 17.08% (0.1218 => 0.1426, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.84% (1.3152 => 1.5367, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.68% (0.2866 => 0.3344, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: 16.64% (0.1088 => 0.1269, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 16.48% (0.2725 => 0.3174, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.47% (0.1160 => 0.1351, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.31% (0.2875 => 0.3344, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 16.30% (0.5546 => 0.6450, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 16.13% (1.8794 => 2.1826, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.12% (3.5627 => 4.1369, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 15.91% (0.4658 => 0.5399, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 15.90% (0.9697 => 1.1239, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 15.90% (0.7171 => 0.8311, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.90% (0.5026 => 0.5825, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.84% (0.3271 => 0.3789, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.77% (1.6211 => 1.8768, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: 15.62% (0.2714 => 0.3138, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.60% (0.1968 => 0.2275, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.59% (0.4361 => 0.5041, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.54% (0.2729 => 0.3153, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.52% (0.2738 => 0.3163, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.47% (0.2792 => 0.3224, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 15.45% (0.3004 => 0.3468, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 15.42% (0.2750 => 0.3174, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 15.40% (0.2780 => 0.3208, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.37% (0.3195 => 0.3686, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: 15.34% (0.1284 => 0.1481, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/18-imp/imp: 15.34% (0.1421 => 0.1639, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 15.34% (0.3267 => 0.3768, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 15.27% (0.2803 => 0.3231, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 15.26% (0.2811 => 0.3240, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 15.17% (0.9909 => 1.1412, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 15.15% (0.3096 => 0.3565, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 15.09% (0.2823 => 0.3249, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.04% (2.0673 => 2.3783, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 15.04% (0.2813 => 0.3236, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.00% (2.7292 => 3.1385, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.94% (0.2911 => 0.3346, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 14.79% (1.0781 => 1.2375, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.71% (0.3930 => 0.4508, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 14.64% (23.5202 => 26.9636, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.59% (4.4195 => 5.0645, std.dev.: 0.0151) MultiSource/Applications/ClamAV/clamscan: 14.47% (4.2109 => 4.8204, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/ary: 14.46% (0.3258 => 0.3729, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.40% (0.3362 => 0.3846, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 14.32% (0.3317 => 0.3792, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.27% (1.9694 => 2.2504, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.25% (0.3060 => 0.3496, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.18% (1.9966 => 2.2797, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.04% (0.1090 => 0.1243, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.99% (0.3124 => 0.3561, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 13.89% (0.4146 => 0.4722, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 13.88% (0.2075 => 0.2363, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 13.80% (0.3348 => 0.3810, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.77% (0.3282 => 0.3734, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 13.77% (0.3726 => 0.4239, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/moments: 13.70% (0.3678 => 0.4182, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 13.66% (0.3477 => 0.3952, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.43% (0.3625 => 0.4112, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 13.41% (0.4251 => 0.4821, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.39% (0.3981 => 0.4514, std.dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 13.29% (0.2566 => 0.2907, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.25% (0.3690 => 0.4179, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.03% (0.3845 => 0.4346, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 13.02% (1.4269 => 1.6127, std.dev.: 0.0032) MultiSource/Applications/treecc/treecc: 12.80% (0.7875 => 0.8883, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 12.69% (0.3460 => 0.3899, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 12.63% (2.1653 => 2.4387, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/for-in: 12.61% (0.3496 => 0.3937, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/synchronized: 12.60% (0.3469 => 0.3906, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.59% (0.3446 => 0.3880, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.58% (0.3465 => 0.3901, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.53% (0.3488 => 0.3925, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 12.47% (0.5012 => 0.5637, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.46% (0.3442 => 0.3871, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 12.40% (4.6177 => 5.1902, std.dev.: 0.0106) SingleSource/UnitTests/ObjC/property: 12.25% (0.3650 => 0.4097) SingleSource/UnitTests/ObjC/exceptions: 12.22% (0.3643 => 0.4088, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 12.03% (2.1013 => 2.3541, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 11.98% (0.3724 => 0.4170, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.42% (0.2040 => 0.2273, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.22% (0.6435 => 0.7157, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 11.15% (0.2691 => 0.2991, std.dev.: 0.0066) MultiSource/Applications/SPASS/SPASS: 10.93% (5.5417 => 6.1475, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: 10.49% (0.3498 => 0.3865, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.49% (0.2737 => 0.3024, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 10.46% (0.3336 => 0.3685, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.41% (0.1028 => 0.1135, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.30% (0.2068 => 0.2281, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.27% (0.6634 => 0.7315, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.12% (0.1383 => 0.1523, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.08% (0.3084 => 0.3395, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 10.05% (0.4847 => 0.5334, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.03% (0.2103 => 0.2293, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.66% (4.6926 => 5.0991, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 8.56% (2.0346 => 2.2088, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 8.41% (0.2391 => 0.2592, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.16% (11.6398 => 12.5898, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.76% (0.5361 => 0.5777, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.19% (0.7426 => 0.7960, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.06% (0.5584 => 0.5978, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 6.38% (11.9555 => 12.7178, std.dev.: 0.0118) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.32% (0.3792 => 0.3918, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.37% (0.2162 => 0.3532, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6536, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 8.53% (0.2802 => 0.3041, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6094, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.03% (12.0509 => 12.6571, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: 4.95% (0.2122 => 0.2227, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1718, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-2: 3.87% (1.8057 => 1.8756, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/dry: 2.74% (14.0481 => 14.4331, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary3: 1.99% (15.8721 => 16.1873, std.dev.: 0.0096) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.66% (3.1722 => 3.2248, std.dev.: 0.0038) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3057, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2879, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5405, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5974, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.07% (1.2451 => 1.2584, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.71% (25.4195 => 16.3422, std.dev.: 0.0368) SingleSource/Benchmarks/Shootout-C++/ary2: -8.78% (0.2402 => 0.2191, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9777, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -7.67% (35.5013 => 32.7795, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: -7.20% (2.1113 => 1.9593, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.17% (11.2080 => 10.8531, std.dev.: 0.0452) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0059) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7752, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5218, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -2.73% (17.2379 => 16.7677, std.dev.: 0.0572) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.18% (41.7953 => 40.8842, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5694, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4951, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.36% (21.9346 => 21.6358, std.dev.: 0.0941) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.20% (105.3826 => 104.1162, std.dev.: 0.1178) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0421, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.04% (3.3991 => 3.3636, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 09:39:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 11:39:37 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121101163937.78FD72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5496?compare_to=5492&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5496, Order: 167232, Start Time: 2012-11-01 15:13:19, End Time: 2012-11-01 16:39:41 To: 5492, Order: 167229, Start Time: 2012-11-01 13:28:28, End Time: 2012-11-01 14:56:16 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 6 (84 on baseline) Performance Improvements: 2 (5 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 983 (885 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/Burg/burg: 1.01% (1.2593 => 1.2720, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/recursive: 2.20% (2.4777 => 2.5323, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C++/life/life: 2.03% (2.5789 => 2.6312, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.12% (5.2644 => 5.3232, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/methcall: 1.03% (8.9599 => 9.0523, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.00% (4.4380 => 4.4826, std.dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.97% (0.2092 => 0.1988, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/lpbench: -2.32% (3.9851 => 3.8925, std.dev.: 0.0198) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.38% (16.6201 => 16.6831, std.dev.: 0.0874) MultiSource/Applications/obsequi/Obsequi: 1.79% (1.0501 => 1.0689, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.27% (21.6080 => 21.6657, std.dev.: 0.1277) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.3650 => 0.3650, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 0.40% (0.6034 => 0.6058, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.45% (0.3350 => 0.3335, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/strcat: 0.25% (0.1996 => 0.2001, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -30.14% (0.0219 => 0.0153, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -19.95% (0.0426 => 0.0341, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -25.30% (0.0332 => 0.0248, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0313 => 0.0314, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.41% (0.0425 => 0.0419, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -1.94% (0.0206 => 0.0202, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -14.03% (0.0221 => 0.0190, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -87.50% (0.0008 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -1.78% (0.1460 => 0.1434, std.dev.: 0.0034) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: -1.28% (1.1471 => 1.1324, std.dev.: 0.0099) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.56% (0.1487 => 0.1434, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.02% (0.4034 => 0.4075, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.41% (0.1369 => 0.1295, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.57% (0.0644 => 0.0621, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.36% (0.0277 => 0.0240, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.81% (0.0540 => 0.0566, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.02% (1.1432 => 1.1434, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.67% (0.0030 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -16.39% (0.0665 => 0.0556, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.41% (0.0204 => 0.0195, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.67% (0.7969 => 0.8022, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -12.77% (0.0047 => 0.0041, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2314.36% (0.6332 => 15.2877, std.dev.: 0.0968) MultiSource/Benchmarks/McCat/08-main/main: 48.39% (0.1831 => 0.2717, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.84% (0.1559 => 0.1468, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1486.24% (0.3344 => 5.3044, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.89% (0.2364 => 0.3236, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: 0.70% (0.0429 => 0.0432, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -17.41% (0.0224 => 0.0185, std.dev.: 0.0023) SingleSource/UnitTests/byval-alignment: -30.87% (0.0230 => 0.0159, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3619, std.dev.: 0.0117) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0727, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4886, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3439, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0315, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4016, std.dev.: 0.0045) SingleSource/Regression/C/uint64_to_float: -23.57% (2.1832 => 1.6687, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.54% (0.0810 => 0.0944, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.50% (0.0848 => 0.0954, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 11.33% (0.1112 => 0.1238, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.90% (0.2180 => 0.2374, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.01% (0.8321 => 0.8904, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.67% (0.2279 => 0.2431, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.42% (0.6010 => 0.6396, std.dev.: 0.0123) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.05% (0.1885 => 0.1999, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.04% (0.1905 => 0.2020, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.11% (0.8148 => 0.8564, std.dev.: 0.0130) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.53% (0.2519 => 0.2633, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 4.40% (1.2568 => 1.3121, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.39% (0.6287 => 0.6563, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2998 => 0.3128, std.dev.: 0.0038) MultiSource/Applications/Burg/burg: 4.07% (1.2222 => 1.2720, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 4.06% (14.7684 => 15.3673, std.dev.: 0.0224) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.94% (0.2741 => 0.2849, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.83% (1.1271 => 1.1703, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.71% (1.1606 => 1.2037, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.63% (0.4127 => 0.4277, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.45% (0.6227 => 0.6442, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.45% (0.5191 => 0.5370, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 3.25% (3.2366 => 3.3417, std.dev.: 0.0287) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.22% (0.4559 => 0.4706, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.16% (0.8286 => 0.8548, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.13% (0.9074 => 0.9358, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.04% (0.8317 => 0.8570, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.98% (0.9908 => 1.0203, std.dev.: 0.0065) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.93% (6.6074 => 6.8013, std.dev.: 0.0304) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.91% (0.8611 => 0.8862, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 2.91% (0.6834 => 0.7033, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.91% (0.8007 => 0.8240, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.82% (0.6586 => 0.6772, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.82% (0.8331 => 0.8566, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.82% (0.8261 => 0.8494, std.dev.: 0.0056) MultiSource/Applications/SPASS/SPASS: 2.80% (14.2605 => 14.6603, std.dev.: 0.0630) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.80% (0.8597 => 0.8838, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.73% (0.9069 => 0.9317, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.65% (0.7966 => 0.8177, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.64% (0.8359 => 0.8580, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.60% (0.7932 => 0.8138, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.57% (0.8204 => 0.8415, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.57% (0.8050 => 0.8257, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.56% (0.9688 => 0.9936, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.55% (0.8855 => 0.9081, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.54% (0.9039 => 0.9269, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.52% (0.8340 => 0.8550, std.dev.: 0.0060) MultiSource/Applications/hbd/hbd: 2.51% (1.4269 => 1.4627, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.51% (0.8420 => 0.8631, std.dev.: 0.0052) MultiSource/Applications/lua/lua: 2.44% (3.8189 => 3.9121, std.dev.: 0.0257) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.43% (0.8069 => 0.8265, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.39% (4.1763 => 4.2762, std.dev.: 0.0145) MultiSource/Applications/lemon/lemon: 2.32% (1.0945 => 1.1199, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 2.29% (8.6247 => 8.8221, std.dev.: 0.0314) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.27% (0.8885 => 0.9087, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.19% (0.8066 => 0.8243, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.08% (0.8316 => 0.8489, std.dev.: 0.0029) MultiSource/Applications/siod/siod: 2.06% (2.2184 => 2.2642, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.05% (0.8518 => 0.8693, std.dev.: 0.0030) MultiSource/Applications/oggenc/oggenc: 2.00% (4.9628 => 5.0623, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.91% (1.5315 => 1.5607, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.84% (1.2423 => 1.2652, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.79% (0.8927 => 0.9087, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.78% (4.4880 => 4.5679, std.dev.: 0.0183) MultiSource/Applications/JM/lencod/lencod: 1.72% (15.3280 => 15.5917, std.dev.: 0.0740) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.65% (1.2602 => 1.2810, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.57% (13.1811 => 13.3880, std.dev.: 0.0726) MultiSource/Benchmarks/Bullet/bullet: 1.52% (31.8598 => 32.3435, std.dev.: 0.0869) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.64% (1.5795 => 2.5057, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.40% (2.7978 => 3.7324, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.67% (14.6451 => 16.6471, std.dev.: 0.5443) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.43% (2.4333 => 2.6627, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.05% (1.1857 => 1.2812, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.78% (0.3186 => 0.3402, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 5.96% (63.1822 => 66.9496, std.dev.: 0.0380) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.40% (2.4490 => 2.5323, std.dev.: 0.0169) SingleSource/Benchmarks/Misc/ReedSolomon: 2.94% (8.5322 => 8.7827, std.dev.: 0.0077) MultiSource/Applications/siod/siod: 2.72% (3.6643 => 3.7639, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/bh/bh: 1.63% (2.3560 => 2.3943, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.47% (1.5941 => 1.6175, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.41% (4.8362 => 4.9045, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.11% (1.1365 => 1.1491, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.10% (4.4340 => 4.4826, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.01% (1.3882 => 1.4022, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.87% (0.3269 => 0.2979, std.dev.: 0.0032) MultiSource/Applications/lua/lua: -5.29% (29.8330 => 28.2551, std.dev.: 0.0915) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.47% (1.0388 => 1.0235, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash2: -1.47% (3.4237 => 3.3733, std.dev.: 0.0173) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.29% (3.3479 => 3.3046, std.dev.: 0.0005) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.44% (16.4461 => 16.6831, std.dev.: 0.0874) MultiSource/Applications/obsequi/Obsequi: 4.16% (1.0262 => 1.0689, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6837.46% (0.3123 => 21.6657, std.dev.: 0.1277) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.19% (0.2463 => 0.3650, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 0.80% (0.6010 => 0.6058, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.11% (0.3266 => 0.3335, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/strcat: 1.63% (0.1969 => 0.2001, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 24.39% (0.0123 => 0.0153, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -16.42% (0.0408 => 0.0341, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.36% (0.0254 => 0.0248, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.11% (0.0384 => 0.0419, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 5.56% (0.0180 => 0.0190, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.28% (0.1438 => 0.1434, std.dev.: 0.0034) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: -0.04% (1.1329 => 1.1324, std.dev.: 0.0099) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.92% (0.1462 => 0.1434, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.14% (0.4164 => 0.4075, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.41% (0.1369 => 0.1295, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.12% (0.0641 => 0.0621, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 23.08% (0.0195 => 0.0240, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.08% (0.0578 => 0.0566, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.03% (1.1437 => 1.1434, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.32% (0.0627 => 0.0556, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.33% (0.0180 => 0.0195, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.06% (0.8017 => 0.8022, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -33.87% (0.0062 => 0.0041, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 10:50:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 12:50:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121101175058.07A022A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5497?compare_to=5493&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5497, Order: 167232, Start Time: 2012-11-01 16:25:53, End Time: 2012-11-01 17:50:59 To: 5493, Order: 167230, Start Time: 2012-11-01 14:37:44, End Time: 2012-11-01 16:02:47 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 1 (177 on baseline) Unchanged Tests: 1040 (860 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.01% (1.2641 => 1.2895, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.25% (80.2381 => 79.2319, std.dev.: 0.3382) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.14% (3.1919 => 3.4199, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1015, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/salsa20: 2.42% (7.4937 => 7.6747, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash2: 2.13% (3.1932 => 3.2611, std.dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.84% (0.1584 => 0.1444, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.39% (0.1431 => 0.1311, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -7.40% (0.3812 => 0.3530, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -7.37% (2.4924 => 2.3087, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.35% (0.3821 => 0.3540, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -7.33% (0.3831 => 0.3550, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -7.22% (0.3848 => 0.3570, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.22% (0.3891 => 0.3610, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: -7.21% (0.3896 => 0.3615, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -7.19% (0.3880 => 0.3601, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.18% (0.3884 => 0.3605, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: -7.14% (0.4033 => 0.3745, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -7.02% (0.4176 => 0.3883, std.dev.: 0.0091) SingleSource/UnitTests/ObjC/property: -6.86% (0.4199 => 0.3911, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -6.75% (0.4280 => 0.3991, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.50% (0.9542 => 0.8922, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.45% (0.3025 => 0.2830, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -6.35% (0.3026 => 0.2834, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.31% (2.1713 => 2.0342, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.31% (0.3057 => 0.2864, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -6.29% (0.2989 => 0.2801, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -6.28% (0.1879 => 0.1761, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.27% (0.3142 => 0.2945, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.26% (0.4151 => 0.3891, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -6.25% (0.2849 => 0.2671, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -6.23% (0.2871 => 0.2692, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -6.23% (0.2939 => 0.2756, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -6.20% (0.3194 => 0.2996, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.17% (0.2903 => 0.2724, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -6.14% (0.3255 => 0.3055, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.12% (4.5069 => 4.2309, std.dev.: 0.0074) SingleSource/Regression/C++/ofstream_ctor: -6.08% (0.3059 => 0.2873, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.08% (0.3849 => 0.3615, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.07% (0.3658 => 0.3436, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.05% (0.2428 => 0.2281, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: -6.04% (16.1920 => 15.2138, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/ary3: -6.04% (0.3446 => 0.3238, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -6.02% (0.3205 => 0.3012, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -6.02% (1.3148 => 1.2357, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.99% (0.3837 => 0.3607, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.98% (0.4813 => 0.4525, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -5.98% (0.3394 => 0.3191, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -5.97% (7.0961 => 6.6728, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.94% (3.5339 => 3.3239, std.dev.: 0.0055) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.93% (22.4056 => 21.0767, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.90% (0.3252 => 0.3060, std.dev.: 0.0043) MultiSource/Applications/sgefa/sgefa: -5.87% (0.3357 => 0.3160, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: -5.83% (0.2160 => 0.2034, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -5.80% (0.3481 => 0.3279, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -5.78% (0.4861 => 0.4580, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -5.77% (0.3621 => 0.3412, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.76% (0.4083 => 0.3848, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: -5.73% (0.7779 => 0.7333, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.72% (0.6484 => 0.6113, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.69% (0.2355 => 0.2221, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -5.68% (0.2659 => 0.2508, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -5.64% (0.3867 => 0.3649, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.61% (4.8161 => 4.5458, std.dev.: 0.0058) MultiSource/Applications/Burg/burg: -5.61% (1.2515 => 1.1813, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/moments: -5.60% (0.4248 => 0.4010, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -5.60% (0.3788 => 0.3576, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.60% (1.0544 => 0.9954, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.58% (4.8802 => 4.6079, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.57% (0.9852 => 0.9303, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.57% (4.0323 => 3.8078, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.53% (0.4427 => 0.4182, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.52% (0.2933 => 0.2771, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -5.49% (4.3330 => 4.0951, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.48% (0.4321 => 0.4084, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.48% (1.2784 => 1.2084, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.46% (0.2548 => 0.2409, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.44% (0.3931 => 0.3717, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.42% (0.3323 => 0.3143, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -5.41% (34.0927 => 32.2477, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.40% (0.7919 => 0.7491, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -5.39% (0.4524 => 0.4280, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.39% (5.4682 => 5.1733, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.38% (1.6474 => 1.5587, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -5.37% (0.6347 => 0.6006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.35% (14.2083 => 13.4477, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.33% (1.6364 => 1.5492, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -5.32% (0.6750 => 0.6391, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -5.31% (2.4021 => 2.2746, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.28% (0.7198 => 0.6818, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.24% (1.2300 => 1.1656, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.23% (0.5999 => 0.5685, std.dev.: 0.0011) MultiSource/Applications/lua/lua: -5.22% (4.0594 => 3.8474, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.21% (1.3722 => 1.3007, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: -5.20% (0.9179 => 0.8702, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.16% (6.7716 => 6.4225, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.15% (0.8521 => 0.8082, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: -5.14% (18.2933 => 17.3525, std.dev.: 0.0097) SingleSource/UnitTests/ObjC++/property-reference-object: -5.11% (0.6441 => 0.6112, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.09% (0.2278 => 0.2162, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.07% (1.4642 => 1.3900, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -5.06% (1.1450 => 1.0871, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: -5.05% (17.1032 => 16.2391, std.dev.: 0.0141) MultiSource/Benchmarks/mafft/pairlocalalign: -5.05% (9.2283 => 8.7627, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.01% (0.3491 => 0.3316, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.95% (2.2587 => 2.1468, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.94% (0.3483 => 0.3311, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -4.94% (0.7982 => 0.7588, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.93% (0.5478 => 0.5208, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -4.92% (0.4515 => 0.4293, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.89% (0.6293 => 0.5985, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -4.89% (0.2985 => 0.2839, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.89% (1.2221 => 1.1624, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.88% (0.5591 => 0.5318, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.85% (0.5857 => 0.5573, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.85% (0.6230 => 0.5928, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.83% (0.2999 => 0.2854, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.83% (0.5925 => 0.5639, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.81% (0.6194 => 0.5896, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.79% (0.5802 => 0.5524, std.dev.: 0.0107) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.78% (0.4916 => 0.4681, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.76% (0.5570 => 0.5305, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.75% (0.9557 => 0.9103, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.74% (0.6052 => 0.5765, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: -4.74% (0.7447 => 0.7094, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.73% (1.2210 => 1.1633, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.72% (0.5575 => 0.5312, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.71% (0.6681 => 0.6366, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.71% (0.7339 => 0.6993, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.69% (0.6667 => 0.6354, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: -4.69% (0.3581 => 0.3413, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.69% (0.5863 => 0.5588, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.66% (0.5705 => 0.5439, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.65% (0.2385 => 0.2274, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.65% (0.5569 => 0.5310, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.65% (0.6260 => 0.5969, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.65% (0.6304 => 0.6011, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: -4.64% (15.5079 => 14.7889, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.60% (0.5581 => 0.5324, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.60% (0.5805 => 0.5538, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.60% (0.6395 => 0.6101, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.58% (0.5849 => 0.5581, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.57% (0.5859 => 0.5591, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.57% (0.6297 => 0.6009, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.56% (0.6446 => 0.6152, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.55% (0.7524 => 0.7182, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.52% (0.6660 => 0.6359, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.50% (0.6736 => 0.6433, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.49% (0.6033 => 0.5762, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.48% (0.6676 => 0.6377, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.47% (8.0126 => 7.6542, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.47% (0.5567 => 0.5318, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.46% (0.3319 => 0.3171, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.45% (0.5688 => 0.5435, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -4.43% (0.3406 => 0.3255, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.42% (0.2695 => 0.2576, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -4.41% (1.3864 => 1.3252, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: -4.41% (2.1401 => 2.0457, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.41% (0.6440 => 0.6156, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -4.41% (0.8418 => 0.8047, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: -4.37% (0.3271 => 0.3128, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.36% (0.5456 => 0.5218, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.31% (0.5941 => 0.5685, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.21% (0.6395 => 0.6126, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.19% (0.7021 => 0.6727, std.dev.: 0.0086) MultiSource/Applications/d/make_dparser: -4.13% (3.5154 => 3.3702, std.dev.: 0.0072) MultiSource/Applications/hbd/hbd: -4.11% (1.5610 => 1.4968, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -4.04% (15.2527 => 14.6367, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.99% (0.5168 => 0.4962, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.98% (0.9077 => 0.8716, std.dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: -3.89% (1.1530 => 1.1081, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.57% (0.5329 => 0.5139, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.46% (5.0226 => 4.8487, std.dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -2.26% (20.7746 => 20.3061, std.dev.: 0.0147) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7527, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: -8.74% (1.2842 => 1.1719, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -4.06% (2.2633 => 2.1713, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.91% (1.7753 => 1.7059, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.16% (1.0557 => 1.0223, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.53% (1.3096 => 1.2895, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4728, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.05% (1.6086 => 1.5917, std.dev.: 0.0022) Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 11:29:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 13:29:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121101182931.8FF462A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5498?compare_to=5494&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5498, Order: 167232, Start Time: 2012-11-01 16:56:13, End Time: 2012-11-01 18:29:34 To: 5494, Order: 167230, Start Time: 2012-11-01 14:53:22, End Time: 2012-11-01 16:26:33 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 0 (176 on baseline) Performance Improvements: 0 (54 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 1 (1 on baseline) Unchanged Tests: 1041 (659 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.86% (0.0647 => 0.0672, std.dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 191.22% (0.5229 => 1.5228, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 13.39% (14.9895 => 16.9962, std.dev.: 0.0090) MultiSource/Applications/kimwitu++/kc: 36.14% (14.1553 => 19.2711, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/gs/gs: 12.53% (4.1105 => 4.6256, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 29.70% (1.1048 => 1.4329, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 306.47% (7.1582 => 29.0962, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.54% (3.4629 => 5.8365, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 62.87% (0.6222 => 1.0134, std.dev.: 0.0013) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10595.83% (0.0720 => 7.7010, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 3836400.00% (0.0001 => 3.8365, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 11185400.00% (0.0001 => 11.1855, std.dev.: 0.0443) MultiSource/Applications/kimwitu++/kc: 50700.00% (0.0001 => 0.0508, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -10.77% (0.1485 => 0.1325, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 747600.00% (0.0001 => 0.7477, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050500.00% (0.0001 => 10.0506, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5497800.00% (0.0001 => 5.4979, std.dev.: 0.0137) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/CoyoteBench/almabench: 41.92% (0.0730 => 0.1036, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/distray/distray: 38.92% (0.1056 => 0.1467, std.dev.: 0.0003) SingleSource/UnitTests/vla: 29.30% (0.0355 => 0.0459, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 26.82% (8.1363 => 10.3184, std.dev.: 0.0079) MultiSource/Applications/ClamAV/clamscan: 22.21% (22.1758 => 27.1005, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.43% (0.1566 => 0.1886, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 17.62% (0.1175 => 0.1382, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.53% (0.0793 => 0.0932, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.25% (0.3177 => 0.3725, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 16.89% (0.0746 => 0.0872) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.85% (0.4879 => 0.5701, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.76% (0.0871 => 0.1017, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.42% (0.0798 => 0.0929, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 15.94% (0.2554 => 0.2961, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.59% (0.0834 => 0.0964, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.47% (0.8172 => 0.9436, std.dev.: 0.0065) SingleSource/Benchmarks/McGill/chomp: 15.41% (0.1655 => 0.1910, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.40% (0.1584 => 0.1828, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.20% (0.0842 => 0.0970, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 14.79% (0.1163 => 0.1335, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.77% (2.2022 => 2.5275, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 14.57% (0.1695 => 0.1942, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.50% (0.2758 => 0.3158, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.33% (0.2700 => 0.3087, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.22% (0.0886 => 0.1012, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.04% (0.2065 => 0.2355, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 14.03% (0.5105 => 0.5821, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.88% (0.1117 => 0.1272, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 13.72% (0.7115 => 0.8091, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.64% (0.0770 => 0.0875, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.64% (0.0770 => 0.0875, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.59% (0.5981 => 0.6794, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 13.57% (0.1555 => 0.1766, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.56% (0.1940 => 0.2203, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.54% (0.1337 => 0.1518, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 13.47% (0.1151 => 0.1306, std.dev.: 0.0013) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.39% (0.1143 => 0.1296, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 13.28% (0.3109 => 0.3522, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.24% (0.1125 => 0.1274, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.19% (0.2107 => 0.2385, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 13.17% (0.7433 => 0.8412, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 13.12% (1.1642 => 1.3169, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.11% (0.6675 => 0.7550, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.05% (0.1510 => 0.1707, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.04% (0.5860 => 0.6624, std.dev.: 0.0025) MultiSource/Applications/d/make_dparser: 12.98% (3.3354 => 3.7682, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.90% (0.9765 => 1.1025, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.90% (0.2271 => 0.2564, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 12.88% (0.7835 => 0.8844, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.84% (1.5415 => 1.7394, std.dev.: 0.0095) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.75% (0.3121 => 0.3519, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.73% (0.1029 => 0.1160, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.65% (0.4615 => 0.5199, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.53% (0.5569 => 0.6267, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/exptree: 12.53% (0.0814 => 0.0916, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.52% (0.1062 => 0.1195, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.40% (0.1032 => 0.1160, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.11% (1.3050 => 1.4630, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.06% (0.3441 => 0.3856, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 11.99% (0.1268 => 0.1420, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.81% (0.1236 => 0.1382, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 11.78% (2.0273 => 2.2662, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.71% (0.5020 => 0.5608, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 11.69% (3.8723 => 4.3249, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.45% (0.1625 => 0.1811, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 11.39% (0.3423 => 0.3813, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.34% (0.3307 => 0.3682, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/rem: 11.28% (0.1144 => 0.1273, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.26% (0.3927 => 0.4369, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 11.22% (1.0722 => 1.1925, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.22% (0.2603 => 0.2895, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.18% (0.6450 => 0.7171, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.04% (4.2646 => 4.7352, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/trivial-interface: 11.00% (0.3473 => 0.3855, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.95% (0.3497 => 0.3880, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 10.94% (0.1463 => 0.1623, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.90% (1.5859 => 1.7588, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 10.89% (0.3828 => 0.4245, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.87% (0.0929 => 0.1030, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.87% (0.3543 => 0.3928, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.87% (0.3543 => 0.3928, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.81% (0.3561 => 0.3946, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 10.78% (0.3516 => 0.3895, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.74% (0.1695 => 0.1877, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 10.72% (0.0933 => 0.1033, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 10.69% (0.3694 => 0.4089, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.64% (2.2024 => 2.4367, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 10.63% (0.4299 => 0.4756, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 10.62% (9.4845 => 10.4913, std.dev.: 0.0124) SingleSource/UnitTests/ObjC/property: 10.55% (0.3886 => 0.4296, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 10.55% (1.1840 => 1.3089, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.44% (0.1044 => 0.1153, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.39% (0.1906 => 0.2104, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/09-vor/vor: 10.38% (0.3180 => 0.3510, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 10.37% (2.2969 => 2.5351, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/oourafft: 10.36% (0.3282 => 0.3622, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 10.36% (0.8921 => 0.9845, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: 10.30% (0.3387 => 0.3736, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.25% (0.8101 => 0.8931, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 10.05% (0.6456 => 0.7105, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.79% (1.1861 => 1.3022, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.78% (0.1892 => 0.2077, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.66% (1.4186 => 1.5556, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.46% (0.4103 => 0.4491, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/hash: 9.28% (0.4289 => 0.4687, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.18% (0.2430 => 0.2653, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.93% (0.3865 => 0.4210, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.89% (0.6030 => 0.6566, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.83% (0.4203 => 0.4574, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.79% (0.4620 => 0.5026, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 8.78% (0.5925 => 0.6445, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.65% (0.2266 => 0.2462, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 8.55% (1.5603 => 1.6937, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.48% (4.9449 => 5.3641, std.dev.: 0.0089) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.39% (0.4636 => 0.5025, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.37% (5.0018 => 5.4205, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/lists: 8.36% (0.3422 => 0.3708, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.27% (0.1330 => 0.1440, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 8.12% (0.1268 => 0.1371, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 8.10% (0.4048 => 0.4376, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.07% (0.7326 => 0.7917, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 7.97% (0.3603 => 0.3890, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 7.95% (0.3684 => 0.3977, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 7.65% (5.7591 => 6.1999, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.29% (0.3650 => 0.3916, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.20% (0.2793 => 0.2994, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.17% (14.3668 => 15.3962, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.15% (0.3427 => 0.3672, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.06% (0.2831 => 0.3031, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 7.02% (0.3232 => 0.3459, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.96% (0.3162 => 0.3382, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.94% (0.3098 => 0.3313, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.87% (0.3826 => 0.4089, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.3283 => 0.3508, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.82% (0.2756 => 0.2944, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.79% (0.2871 => 0.3066, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.75% (0.2891 => 0.3086, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.69% (0.4064 => 0.4336, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 6.63% (17.1811 => 18.3196, std.dev.: 0.0232) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.54% (2.0665 => 2.2016, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.51% (0.2872 => 0.3059, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.51% (0.2905 => 0.3094, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.49% (0.3052 => 0.3250, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 6.43% (0.2877 => 0.3062, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.42% (0.2725 => 0.2900, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.38% (3.8922 => 4.1406, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hello: 6.34% (0.2714 => 0.2886, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 6.18% (1.2842 => 1.3635, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 6.07% (0.2802 => 0.2972, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.04% (0.8067 => 0.8554, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/bh/bh: 5.98% (0.3092 => 0.3277, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 5.39% (0.3379 => 0.3561, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.29% (0.3136 => 0.3302, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.25% (0.3131 => 0.3264, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.35% (0.3817 => 0.3945, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (0.3935 => 0.4043, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 19.80% (2.8904 => 3.4627, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.57% (1.1145 => 1.2992, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 9.91% (1.1396 => 1.2525, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.11% (0.9540 => 1.0218) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3676, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.80% (4.2280 => 4.3463, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.48% (8.6802 => 8.8958, std.dev.: 0.0149) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7658, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.95% (3.6395 => 3.7105, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bisort/bisort: 1.79% (0.8333 => 0.8482, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2082, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.06% (9.1159 => 9.2129, std.dev.: 0.0328) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5766, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.93% (6.6874 => 0.1387, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -75.90% (0.8651 => 0.2085, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -54.28% (5.3855 => 2.4624, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -53.86% (5.3526 => 2.4696, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -45.62% (0.1622 => 0.0882, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.51% (5.2763 => 3.1388, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -23.90% (1.7609 => 1.3400, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.83% (2.9384 => 2.5613, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -10.40% (1.1194 => 1.0030, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: -10.19% (10.4361 => 9.3726, std.dev.: 0.0052) SingleSource/UnitTests/Vector/constpool: -9.03% (54.1659 => 49.2749, std.dev.: 0.0686) MultiSource/Benchmarks/PAQ8p/paq8p: -3.35% (10.3673 => 10.0204, std.dev.: 0.0048) MultiSource/Benchmarks/Bullet/bullet: -2.48% (63.2438 => 61.6774, std.dev.: 0.0181) MultiSource/Applications/JM/lencod/lencod: -2.17% (21.9371 => 21.4608, std.dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.97% (0.3987 => 0.2513, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -30.38% (10.7105 => 7.4570, std.dev.: 0.0147) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -20.57% (2.6778 => 2.1270) SingleSource/Benchmarks/Misc/flops-6: -15.78% (1.6925 => 1.4255, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -10.98% (9.5636 => 8.5131, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -10.82% (1.5373 => 1.3710, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2854, std.dev.: 0.0144) MultiSource/Benchmarks/FreeBench/mason/mason: -7.87% (0.2161 => 0.1991, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -7.48% (6.6465 => 6.1493, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.11% (1.8329 => 1.7026, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.17% (1.2373 => 1.1610, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.11% (1.6805 => 1.5947, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5079, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.62% (1.5660 => 1.4937, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.44% (0.9957 => 0.9515, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.04% (0.2497 => 0.2396, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -3.83% (4.5009 => 4.3283, std.dev.: 0.0025) MultiSource/Applications/siod/siod: -3.70% (3.2827 => 3.1611, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.52% (32.5116 => 31.3683, std.dev.: 0.0039) MultiSource/Benchmarks/sim/sim: -3.24% (5.0483 => 4.8848, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -2.79% (4.6441 => 4.5146, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.52% (0.4808 => 0.4687, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/Olden/power/power: -2.14% (1.1277 => 1.1036, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.01% (8.1563 => 7.9921, std.dev.: 0.0270) SingleSource/Benchmarks/Misc/salsa20: -1.99% (10.2830 => 10.0788, std.dev.: 0.0178) SingleSource/Benchmarks/CoyoteBench/almabench: -1.97% (11.3103 => 11.0875, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6797, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5104, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (85.0658 => 83.9875, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/lists: -1.08% (6.2999 => 6.2320, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8596, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.24% (0.2116 => 0.0672, std.dev.: 0.0002) Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 12:24:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 14:24:51 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121101192451.71EC12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5499?compare_to=5496&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5499, Order: 167237, Start Time: 2012-11-01 17:58:20, End Time: 2012-11-01 19:24:55 To: 5496, Order: 167232, Start Time: 2012-11-01 15:13:19, End Time: 2012-11-01 16:39:41 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 15 (80 on baseline) Performance Improvements: 1 (6 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 975 (888 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.52% (0.1409 => 0.1529, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.15% (0.2991 => 0.3115, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.65% (0.9623 => 0.9782, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.12% (6.8013 => 6.8772, std.dev.: 0.0281) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.01% (1.3568 => 1.3705, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 10.36% (3.6730 => 4.0535, std.dev.: 0.0394) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.50% (3.0351 => 3.2323, std.dev.: 0.0580) SingleSource/Benchmarks/Shootout/heapsort: 5.09% (3.0382 => 3.1927, std.dev.: 0.0211) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.53% (4.3036 => 4.4557, std.dev.: 0.0194) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.38% (58.3950 => 60.3707, std.dev.: 0.4736) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.41% (21.6607 => 22.1838, std.dev.: 0.1984) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.21% (0.5838 => 0.5967, std.dev.: 0.0030) MultiSource/Benchmarks/llubenchmark/llu: 1.64% (1.9882 => 2.0209, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.12% (2.5698 => 2.5986, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.04% (1.5805 => 1.5970, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: -1.37% (0.7867 => 0.7759, std.dev.: 0.0037) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.39% (16.6831 => 16.6175, std.dev.: 0.1562) MultiSource/Applications/obsequi/Obsequi: -0.82% (1.0689 => 1.0601, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.01% (21.6657 => 21.6645, std.dev.: 0.3339) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.14% (0.3650 => 0.3655, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: -0.58% (0.6058 => 0.6023, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.15% (0.3335 => 0.3340, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/strcat: 0.80% (0.2001 => 0.2017, std.dev.: 0.0072) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 43.79% (0.0153 => 0.0220, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 24.93% (0.0341 => 0.0426, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 34.27% (0.0248 => 0.0333, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0314 => 0.0315, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.40% (0.0419 => 0.0388, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/casts: 0.50% (0.0202 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 5.79% (0.0190 => 0.0201, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.98% (0.1434 => 0.1448, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.02% (1.1324 => 1.1553, std.dev.: 0.0317) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.56% (0.1434 => 0.1485, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.28% (0.4075 => 0.3982, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.71% (0.1295 => 0.1369, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.06% (0.0621 => 0.0602, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -23.75% (0.0240 => 0.0183, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.59% (0.0566 => 0.0540, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.20% (1.1434 => 1.1457, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.14% (0.0556 => 0.0579, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.64% (0.0195 => 0.0245, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.96% (0.8022 => 0.7945, std.dev.: 0.0124) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 12.20% (0.0041 => 0.0046, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2314.94% (0.6332 => 15.2914, std.dev.: 0.3418) MultiSource/Benchmarks/McCat/08-main/main: 48.33% (0.1831 => 0.2716, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.77% (0.1559 => 0.1469, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1482.12% (0.3344 => 5.2906, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.28% (0.2364 => 0.3198, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: 2.56% (0.0429 => 0.0440, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.57% (0.0224 => 0.0232, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3732, std.dev.: 0.0391) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0690, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4935, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3386, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0271, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4017, std.dev.: 0.0032) SingleSource/Regression/C/uint64_to_float: -23.70% (2.1832 => 1.6657, std.dev.: 0.0010) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.44% (0.0810 => 0.0927, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.61% (0.0830 => 0.0943, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 10.34% (0.1112 => 0.1227, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.67% (0.2180 => 0.2369, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.30% (0.1425 => 0.1529, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.50% (0.3137 => 0.3341, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.49% (0.7473 => 0.7958, std.dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.04% (0.6010 => 0.6373, std.dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.84% (0.1885 => 0.1995, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.27% (0.2279 => 0.2399, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.24% (0.4847 => 0.5101, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.80% (0.8321 => 0.8720, std.dev.: 0.0155) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.17% (0.8148 => 0.8488, std.dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 4.09% (1.1271 => 1.1732, std.dev.: 0.0078) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.08% (6.6074 => 6.8772, std.dev.: 0.0281) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.97% (1.1606 => 1.2067, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.73% (0.3003 => 0.3115, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.69% (0.6287 => 0.6519, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.68% (0.9435 => 0.9782, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.66% (0.8712 => 0.9031, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.64% (0.4559 => 0.4725, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.54% (0.4127 => 0.4273, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.39% (0.8286 => 0.8567, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.21% (1.3279 => 1.3705, std.dev.: 0.0030) MultiSource/Applications/d/make_dparser: 3.19% (3.2366 => 3.3400, std.dev.: 0.0129) MultiSource/Applications/SIBsim4/SIBsim4: 3.17% (1.2568 => 1.2966, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.15% (0.8338 => 0.8601, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.13% (14.2605 => 14.7068, std.dev.: 0.0281) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.96% (0.8611 => 0.8866, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.95% (0.6586 => 0.6780, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 2.93% (0.4125 => 0.4246, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.83% (4.1763 => 4.2944, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.80% (0.9039 => 0.9292, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.80% (0.9908 => 1.0185, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.73% (0.8069 => 0.8289, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.71% (0.8597 => 0.8830, std.dev.: 0.0052) MultiSource/Applications/minisat/minisat: 2.71% (0.6834 => 0.7019, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.64% (0.8457 => 0.8680, std.dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 2.59% (15.3280 => 15.7250, std.dev.: 0.0609) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.50% (1.6386 => 1.6796, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.50% (0.8317 => 0.8525, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.41% (0.8716 => 0.8926, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.37% (0.7966 => 0.8155, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.36% (0.8855 => 0.9064, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.31% (0.8805 => 0.9008, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.27% (4.4873 => 4.5890, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.25% (0.8340 => 0.8528, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.24% (0.7932 => 0.8110, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.24% (0.9056 => 0.9259, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.21% (0.8885 => 0.9081, std.dev.: 0.0062) MultiSource/Applications/JM/ldecod/ldecod: 2.21% (6.7320 => 6.8805, std.dev.: 0.0289) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.20% (0.9688 => 0.9901, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.20% (1.2526 => 1.2801, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.14% (2.1401 => 2.1860, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.14% (0.8048 => 0.8220, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.12% (0.8204 => 0.8378, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.05% (13.1811 => 13.4516, std.dev.: 0.0348) MultiSource/Applications/oggenc/oggenc: 2.02% (4.9628 => 5.0631, std.dev.: 0.0286) MultiSource/Applications/siod/siod: 2.01% (2.2184 => 2.2629, std.dev.: 0.0164) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.92% (3.1832 => 3.2443, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.74% (1.2423 => 1.2639, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.62% (0.8995 => 0.9141, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: 1.54% (0.8768 => 0.8903, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 1.50% (4.1305 => 4.1926, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.15% (1.2602 => 1.2747, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.48% (1.5795 => 2.5032, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.39% (2.7978 => 3.7319, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.37% (14.6451 => 16.1637, std.dev.: 0.3852) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.89% (2.4333 => 2.6740, std.dev.: 0.0505) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.82% (0.3186 => 0.3499, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.06% (1.1857 => 1.2813, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.92% (3.0515 => 3.2323, std.dev.: 0.0580) MultiSource/Benchmarks/mafft/pairlocalalign: 5.89% (63.1822 => 66.9052, std.dev.: 0.3269) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.44% (3.9188 => 4.0535, std.dev.: 0.0394) MultiSource/Applications/siod/siod: 2.66% (3.6643 => 3.7618, std.dev.: 0.0100) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.56% (0.4031 => 0.4134, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.31% (4.3552 => 4.4557, std.dev.: 0.0194) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.13% (0.7597 => 0.7759, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: 1.57% (2.3560 => 2.3931, std.dev.: 0.0101) MultiSource/Benchmarks/llubenchmark/llu: 1.21% (1.9967 => 2.0209, std.dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.15% (0.3269 => 0.2970, std.dev.: 0.0039) MultiSource/Applications/lua/lua: -5.20% (29.8330 => 28.2823, std.dev.: 0.1886) SingleSource/Benchmarks/Shootout/heapsort: -3.03% (3.2926 => 3.1927, std.dev.: 0.0211) SingleSource/Benchmarks/Shootout-C++/hash2: -1.69% (3.4237 => 3.3657, std.dev.: 0.0194) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.18% (1.2337 => 1.2192, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.15% (3.3479 => 3.3094, std.dev.: 0.0055) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.04% (16.4461 => 16.6175, std.dev.: 0.1562) MultiSource/Applications/obsequi/Obsequi: 3.30% (1.0262 => 1.0601, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6837.08% (0.3123 => 21.6645, std.dev.: 0.3339) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.40% (0.2463 => 0.3655, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 0.22% (0.6010 => 0.6023, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.27% (0.3266 => 0.3340, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/strcat: 2.44% (0.1969 => 0.2017, std.dev.: 0.0072) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.04% (0.0384 => 0.0388, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 11.67% (0.0180 => 0.0201, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.70% (0.1438 => 0.1448, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.98% (1.1329 => 1.1553, std.dev.: 0.0317) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.57% (0.1462 => 0.1485, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.37% (0.4164 => 0.3982, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: - (0.1369 => 0.1369, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.08% (0.0641 => 0.0602, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.15% (0.0195 => 0.0183, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.57% (0.0578 => 0.0540, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.17% (1.1437 => 1.1457, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.66% (0.0627 => 0.0579, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 36.11% (0.0180 => 0.0245, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.90% (0.8017 => 0.7945, std.dev.: 0.0124) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.81% (0.0062 => 0.0046, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 12:39:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 14:39:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121101193900.4DD392A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5500?compare_to=5497&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5500, Order: 167237, Start Time: 2012-11-01 18:14:00, End Time: 2012-11-01 19:39:01 To: 5497, Order: 167232, Start Time: 2012-11-01 16:25:53, End Time: 2012-11-01 17:50:59 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (176 on baseline) Unchanged Tests: 1042 (861 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.15% (3.1919 => 3.4200, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.95% (2.0478 => 2.1083, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/salsa20: 2.54% (7.4937 => 7.6838, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/hash2: 2.23% (3.1932 => 3.2645, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.59% (0.1584 => 0.1448, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.18% (0.1431 => 0.1314, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.43% (2.4924 => 2.3073, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.22% (0.3821 => 0.3545, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: -7.14% (0.3812 => 0.3540, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.09% (0.3891 => 0.3615, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -7.02% (0.3831 => 0.3562, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -7.01% (0.3880 => 0.3608, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.00% (0.3884 => 0.3612, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -6.99% (0.4033 => 0.3751, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -6.96% (0.3848 => 0.3580, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.93% (0.3896 => 0.3626, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.87% (0.4176 => 0.3889, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -6.69% (0.4199 => 0.3918, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -6.54% (0.4280 => 0.4000, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.38% (0.2428 => 0.2273, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -6.36% (0.2989 => 0.2799, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.35% (0.3025 => 0.2833, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.34% (0.9542 => 0.8937) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.33% (0.3142 => 0.2943, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -6.33% (0.1879 => 0.1760, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.29% (0.3658 => 0.3428, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.28% (0.3057 => 0.2865, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.24% (2.1713 => 2.0358, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/fibo: -6.23% (0.2871 => 0.2692, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -6.23% (0.3194 => 0.2995, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.22% (0.4151 => 0.3893, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -6.21% (0.3026 => 0.2838, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -6.21% (0.2849 => 0.2672, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -6.19% (0.3394 => 0.3184, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -6.16% (0.2939 => 0.2758, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -6.15% (0.3446 => 0.3234, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.13% (0.3016 => 0.2831, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.13% (0.2903 => 0.2725, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -6.12% (0.3205 => 0.3009, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: -6.08% (16.1920 => 15.2080, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.07% (0.2355 => 0.2212, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.06% (22.4056 => 21.0471, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/ary2: -6.06% (0.3481 => 0.3270, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -6.05% (0.3357 => 0.3154, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.04% (3.5339 => 3.3204, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.04% (4.5069 => 4.2347, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.03% (0.4813 => 0.4523, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -6.02% (7.0961 => 6.6686, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/matrix: -6.02% (0.3255 => 0.3059, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -6.02% (0.2160 => 0.2030, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.99% (0.3323 => 0.3124, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: -5.98% (0.3059 => 0.2876, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.97% (0.3837 => 0.3608, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: -5.96% (1.3148 => 1.2365, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.91% (0.6484 => 0.6101, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.83% (4.8161 => 4.5352, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.83% (0.4083 => 0.3845, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.82% (0.3849 => 0.3625, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -5.80% (0.4861 => 0.4579, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.80% (4.8802 => 4.5973, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/moments: -5.79% (0.4248 => 0.4002, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -5.77% (0.3867 => 0.3644, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.75% (0.9852 => 0.9286, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -5.74% (0.3621 => 0.3413, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.74% (1.0544 => 0.9939, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.73% (4.0323 => 3.8012, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: -5.73% (0.3788 => 0.3571, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -5.72% (4.3330 => 4.0851, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.69% (0.3252 => 0.3067, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -5.67% (1.2515 => 1.1805, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: -5.64% (0.2659 => 0.2509, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.57% (0.7919 => 0.7478, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.56% (0.4427 => 0.4181, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -5.55% (34.0927 => 32.1997, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.53% (0.2548 => 0.2407, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: -5.50% (0.4524 => 0.4275, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.50% (1.2784 => 1.2081, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.49% (0.2933 => 0.2772, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -5.45% (0.7779 => 0.7355, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -5.44% (0.6750 => 0.6383, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -5.40% (9.2283 => 8.7296, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.40% (5.4682 => 5.1731, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.38% (0.5999 => 0.5676, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.38% (1.2300 => 1.1638, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.34% (1.6474 => 1.5594, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -5.34% (0.4515 => 0.4274, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.33% (1.6364 => 1.5491, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.32% (14.2083 => 13.4519, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/football/football: -5.32% (0.9179 => 0.8691, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.31% (6.7716 => 6.4121, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.31% (1.3722 => 1.2994, std.dev.: 0.0038) MultiSource/Applications/siod/siod: -5.26% (2.4021 => 2.2758, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.24% (0.3931 => 0.3725, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.22% (0.2278 => 0.2159, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.22% (0.7198 => 0.6822, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.20% (0.8521 => 0.8078, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: -5.17% (0.6347 => 0.6019, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.14% (0.4321 => 0.4099, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.13% (0.6293 => 0.5970, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -5.13% (4.0594 => 3.8513, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/bh/bh: -5.09% (0.2985 => 0.2833, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.07% (0.5478 => 0.5200, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.05% (1.4642 => 1.3903, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: -5.03% (0.6441 => 0.6117, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -5.01% (1.1450 => 1.0876, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.01% (0.3491 => 0.3316, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.98% (1.2221 => 1.1612, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.98% (0.5925 => 0.5630, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.97% (0.5575 => 0.5298, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.96% (0.4916 => 0.4672, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.95% (0.6260 => 0.5950, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -4.95% (17.1032 => 16.2565, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.94% (0.5591 => 0.5315, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (0.6681 => 0.6352, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.92% (0.5859 => 0.5571, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: -4.91% (18.2933 => 17.3942, std.dev.: 0.0205) MultiSource/Benchmarks/McCat/18-imp/imp: -4.91% (0.3581 => 0.3405, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.91% (0.6230 => 0.5924, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.89% (1.2210 => 1.1613, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.88% (0.5857 => 0.5571, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.86% (0.6194 => 0.5893, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.86% (0.5581 => 0.5310, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.85% (0.3483 => 0.3314, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.85% (0.6660 => 0.6337, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -4.85% (0.7982 => 0.7595, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.85% (0.6189 => 0.5889, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.83% (2.2587 => 2.1497, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.80% (0.5849 => 0.5568, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.80% (0.7339 => 0.6987, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.78% (0.7524 => 0.7164, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.78% (0.5567 => 0.5301, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.78% (0.5570 => 0.5304, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.77% (0.6304 => 0.6003, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.77% (0.9557 => 0.9101, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.76% (0.6052 => 0.5764, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.75% (0.6676 => 0.6359, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -4.74% (0.7447 => 0.7094, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.74% (0.6440 => 0.6135, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.72% (0.5863 => 0.5586, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.72% (0.5569 => 0.5306, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.72% (0.5705 => 0.5436, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.71% (0.6667 => 0.6353, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.71% (0.6033 => 0.5749, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.67% (0.5456 => 0.5201, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.67% (0.6297 => 0.6003, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.65% (0.2385 => 0.2274, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.65% (8.0126 => 7.6400, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.64% (0.5688 => 0.5424, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.64% (0.6446 => 0.6147, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -4.62% (15.5079 => 14.7916, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.58% (0.5941 => 0.5669, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.55% (0.3406 => 0.3251, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -4.54% (0.8418 => 0.8036, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.52% (0.6395 => 0.6106, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.49% (0.2695 => 0.2574, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.43% (0.6395 => 0.6112, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: -4.43% (2.1401 => 2.0454, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: -4.41% (1.3864 => 1.3253, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: -4.40% (0.3271 => 0.3127, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.34% (0.3319 => 0.3175, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.33% (0.6736 => 0.6444, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.30% (0.7021 => 0.6719, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.27% (0.9077 => 0.8689, std.dev.: 0.0028) MultiSource/Applications/d/make_dparser: -4.10% (3.5154 => 3.3712, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.01% (0.5168 => 0.4961, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -4.00% (15.2527 => 14.6419, std.dev.: 0.0113) MultiSource/Applications/hbd/hbd: -3.98% (1.5610 => 1.4988, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: -3.82% (1.1530 => 1.1090, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.73% (0.5329 => 0.5130, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.66% (5.0226 => 4.8390, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -2.52% (20.7746 => 20.2515, std.dev.: 0.0316) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7505, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/richards_benchmark: -8.74% (1.2842 => 1.1720, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: -4.02% (2.2633 => 2.1723, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.84% (1.7753 => 1.7072, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.92% (1.3096 => 1.2713, std.dev.: 0.0089) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4695, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/ary3: -1.06% (3.7241 => 3.6847, std.dev.: 0.0139) Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 13:32:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 15:32:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121101203250.865B22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5501?compare_to=5498&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5501, Order: 167239, Start Time: 2012-11-01 18:59:08, End Time: 2012-11-01 20:32:38 To: 5498, Order: 167232, Start Time: 2012-11-01 16:56:13, End Time: 2012-11-01 18:29:34 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 2 (174 on baseline) Performance Improvements: 1 (55 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 1 (1 on baseline) Unchanged Tests: 1038 (660 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.39% (78.6538 => 81.3230, std.dev.: 0.2887) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.86% (54.9874 => 56.5625, std.dev.: 0.0365) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.70% (10.0204 => 9.8499, std.dev.: 0.0033) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.57% (0.0672 => 0.0648, std.dev.: 0.0039) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 191.38% (0.5229 => 1.5236, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 13.54% (14.9895 => 17.0188, std.dev.: 0.0133) MultiSource/Applications/kimwitu++/kc: 36.39% (14.1553 => 19.3067, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/gs/gs: 12.90% (4.1105 => 4.6406, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 30.08% (1.1048 => 1.4371, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 306.89% (7.1582 => 29.1262, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.44% (3.4629 => 5.8329, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 63.23% (0.6222 => 1.0156, std.dev.: 0.0009) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10587.08% (0.0720 => 7.6947, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 3836500.00% (0.0001 => 3.8366, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11197300.00% (0.0001 => 11.1974, std.dev.: 0.0365) MultiSource/Applications/kimwitu++/kc: 50700.00% (0.0001 => 0.0508, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -10.71% (0.1485 => 0.1326) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 747400.00% (0.0001 => 0.7475, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049200.00% (0.0001 => 10.0493, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5493000.00% (0.0001 => 5.4931, std.dev.: 0.0118) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/CoyoteBench/almabench: 44.66% (0.0730 => 0.1056, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/distray/distray: 39.11% (0.1056 => 0.1469, std.dev.: 0.0001) SingleSource/UnitTests/vla: 29.58% (0.0355 => 0.0460, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 26.90% (8.1363 => 10.3251, std.dev.: 0.0052) MultiSource/Applications/ClamAV/clamscan: 22.18% (22.1758 => 27.0940, std.dev.: 0.0267) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.63% (0.1566 => 0.1889, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 18.13% (0.1175 => 0.1388, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.65% (0.0793 => 0.0933, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.50% (0.3177 => 0.3733, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 17.29% (0.0746 => 0.0875, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.20% (0.4879 => 0.5718, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.99% (0.0871 => 0.1019, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 16.64% (0.2554 => 0.2979, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.42% (0.0798 => 0.0929, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 15.89% (0.1655 => 0.1918) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 15.82% (0.1125 => 0.1303, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.68% (0.8172 => 0.9453, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.53% (0.1584 => 0.1830, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.44% (0.0842 => 0.0972, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.35% (0.0834 => 0.0962, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 15.22% (0.1163 => 0.1340, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 14.93% (0.1695 => 0.1948, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.89% (0.2700 => 0.3102, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.67% (0.0886 => 0.1016, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.57% (2.2022 => 2.5230, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.24% (0.2065 => 0.2359, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 14.10% (0.5105 => 0.5825, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.07% (0.2758 => 0.3146, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.03% (0.0770 => 0.0878, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.02% (0.1940 => 0.2212, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 13.95% (0.1555 => 0.1772, std.dev.: 0.0014) MultiSource/Applications/aha/aha: 13.90% (0.1151 => 0.1311, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 13.89% (0.7115 => 0.8103, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.88% (0.1117 => 0.1272, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.84% (0.1337 => 0.1522, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.69% (0.5981 => 0.6800, std.dev.: 0.0024) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.65% (0.1143 => 0.1299, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.51% (0.0770 => 0.0874, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.46% (0.3121 => 0.3541, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 13.45% (0.7433 => 0.8433, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 13.44% (0.3109 => 0.3527, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.34% (0.2107 => 0.2388, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 13.29% (1.1642 => 1.3189, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.25% (0.1510 => 0.1710, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.20% (0.6675 => 0.7556, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 13.18% (0.7835 => 0.8868, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.17% (0.2271 => 0.2570, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 13.03% (3.3354 => 3.7699, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.02% (0.1029 => 0.1163, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.01% (0.9765 => 1.1035, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.91% (0.4615 => 0.5211, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.90% (0.1062 => 0.1199, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 12.90% (0.0814 => 0.0919, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.89% (1.5415 => 1.7402, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.87% (0.5860 => 0.6614, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.69% (0.1032 => 0.1163, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.61% (0.5569 => 0.6271, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.30% (0.1236 => 0.1388, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.28% (1.3050 => 1.4652, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/health/health: 12.22% (0.1268 => 0.1423, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 12.19% (3.8723 => 4.3444, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.18% (0.3441 => 0.3860, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 11.98% (2.0273 => 2.2702, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.95% (0.5020 => 0.5620, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.85% (0.3307 => 0.3699, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.82% (0.3927 => 0.4391, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.72% (0.3473 => 0.3880, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.72% (0.2603 => 0.2908, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 11.71% (0.3423 => 0.3824, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.63% (0.1625 => 0.1814, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.55% (0.3497 => 0.3901, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.55% (0.3828 => 0.4270, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.54% (0.3543 => 0.3952, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 11.52% (0.3543 => 0.3951, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.46% (0.3516 => 0.3919, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.43% (0.3561 => 0.3968, std.dev.: 0.0066) SingleSource/UnitTests/SignlessTypes/rem: 11.36% (0.1144 => 0.1274, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.35% (0.6450 => 0.7182, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.34% (4.2646 => 4.7483, std.dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.30% (0.0929 => 0.1034, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 11.29% (0.3694 => 0.4111, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 11.28% (1.0722 => 1.1931, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 11.17% (0.4299 => 0.4779, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 11.15% (0.0933 => 0.1037, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 11.14% (0.3886 => 0.4319, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 11.14% (0.1463 => 0.1626, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.09% (1.5859 => 1.7618, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.09% (0.1695 => 0.1883, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.76% (2.2024 => 2.4393, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.76% (0.1906 => 0.2111, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 10.73% (9.4845 => 10.5024, std.dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 10.71% (1.1840 => 1.3108, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 10.69% (0.3180 => 0.3520, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 10.67% (2.2969 => 2.5420, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.63% (0.1044 => 0.1155, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 10.46% (0.8921 => 0.9854, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.44% (0.8101 => 0.8947, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 10.33% (0.3282 => 0.3621, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 10.19% (0.3387 => 0.3732, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 10.16% (0.6456 => 0.7112, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.92% (1.1861 => 1.3038, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.78% (1.4186 => 1.5574, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.57% (0.1892 => 0.2073, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 9.44% (0.4289 => 0.4694, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 9.25% (0.6030 => 0.6588, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.18% (0.5925 => 0.6469, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.16% (0.3865 => 0.4219, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.06% (0.4203 => 0.4584, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 8.98% (0.4620 => 0.5035, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.82% (0.4103 => 0.4465, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.71% (0.4636 => 0.5040, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 8.71% (1.5603 => 1.6962, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists: 8.65% (0.3422 => 0.3718, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.65% (0.2266 => 0.2462, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.59% (5.0018 => 5.4317, std.dev.: 0.0141) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.57% (0.1330 => 0.1444, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 8.52% (0.1268 => 0.1376, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.50% (4.9449 => 5.3650, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/sieve: 8.49% (0.3603 => 0.3909, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.44% (0.2430 => 0.2635, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 8.41% (0.7326 => 0.7942, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists1: 8.09% (0.3684 => 0.3982, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 8.03% (0.4048 => 0.4373, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.73% (0.2793 => 0.3009, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.73% (5.7591 => 6.2041, std.dev.: 0.0068) SingleSource/Regression/C++/ofstream_ctor: 7.47% (0.2905 => 0.3122, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.45% (0.3650 => 0.3922, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.33% (0.2756 => 0.2958, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.29% (14.3668 => 15.4144, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/strcat: 7.28% (0.2831 => 0.3037, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.19% (0.2891 => 0.3099, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 7.19% (0.2725 => 0.2921, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.18% (0.3427 => 0.3673, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.14% (0.3826 => 0.4099, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.12% (0.3162 => 0.3387, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.07% (0.3098 => 0.3317, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 7.04% (0.2714 => 0.2905, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.98% (0.3283 => 0.3512, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.97% (0.2871 => 0.3071, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.96% (0.3232 => 0.3457, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.94% (0.4064 => 0.4346, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.75% (2.0665 => 2.2060, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.72% (0.2872 => 0.3065, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 6.71% (17.1811 => 18.3335, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.68% (3.8922 => 4.1521, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/methcall: 6.36% (0.2877 => 0.3060, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 6.34% (0.3092 => 0.3288, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 6.32% (0.3052 => 0.3245, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 6.30% (1.2842 => 1.3651, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.30% (0.8067 => 0.8575, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/random: 6.25% (0.2802 => 0.2977, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.21% (0.3379 => 0.3589, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.34% (0.3131 => 0.3267, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.96% (0.3817 => 0.3968, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.92% (0.3935 => 0.4050, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.23% (7.9617 => 8.0600, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 19.81% (2.8904 => 3.4629, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.52% (1.1145 => 1.2986, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.83% (1.1396 => 1.2516, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (3.1578 => 3.3671, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.59% (8.6802 => 8.9053, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.49% (4.2280 => 4.3331, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7658, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.15% (1.0313 => 1.0535, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.99% (3.6395 => 3.7119, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/bisort/bisort: 1.96% (0.8333 => 0.8496, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2080, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.92% (6.6874 => 0.1390, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -75.91% (0.8651 => 0.2084, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -54.50% (5.3855 => 2.4505, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.11% (5.3526 => 2.4565, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -45.62% (0.1622 => 0.0882, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.48% (5.2763 => 3.1402, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -23.76% (1.7609 => 1.3425, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.01% (2.9384 => 2.5560, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -10.47% (1.1194 => 1.0022, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: -10.08% (10.4361 => 9.3839, std.dev.: 0.0084) SingleSource/UnitTests/Vector/constpool: -9.05% (54.1659 => 49.2615, std.dev.: 0.0315) MultiSource/Benchmarks/PAQ8p/paq8p: -4.99% (10.3673 => 9.8499, std.dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: -2.52% (63.2438 => 61.6473, std.dev.: 0.0191) MultiSource/Applications/JM/lencod/lencod: -2.09% (21.9371 => 21.4783, std.dev.: 0.0103) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.96% (0.0506 => 0.0319, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.89% (0.3987 => 0.2516, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -30.26% (10.7105 => 7.4696, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -20.57% (2.6778 => 2.1271, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4243, std.dev.: 0.0027) MultiSource/Benchmarks/NPB-serial/is/is: -10.98% (9.5636 => 8.5139, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: -10.87% (1.5373 => 1.3702, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.45% (19.9488 => 18.2641, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -7.48% (6.6465 => 6.1491, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7042, std.dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4780, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -6.05% (1.2373 => 1.1625, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.12% (1.6805 => 1.5945, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.87% (1.5835 => 1.5064, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.60% (1.5660 => 1.4939, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.04% (0.2497 => 0.2396, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.93% (0.9957 => 0.9566, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -3.83% (4.5009 => 4.3284, std.dev.: 0.0030) MultiSource/Applications/siod/siod: -3.82% (3.2827 => 3.1572, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.52% (32.5116 => 31.3677, std.dev.: 0.0091) MultiSource/Benchmarks/sim/sim: -3.23% (5.0483 => 4.8851) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.81% (0.4808 => 0.4673, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -2.80% (4.6441 => 4.5141, std.dev.: 0.0013) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/Olden/power/power: -2.14% (1.1277 => 1.1036, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: -1.97% (11.3103 => 11.0879, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.91% (8.1563 => 8.0008, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/salsa20: -1.80% (10.2830 => 10.0984, std.dev.: 0.0163) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6790, std.dev.: 0.0025) SingleSource/UnitTests/Vector/multiplies: -1.51% (2.5528 => 2.5143, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (85.0658 => 83.9856, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2327, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8568, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0039) Report Time: 4.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 13:33:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 15:33:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121101203323.B899C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5502?compare_to=5495&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5502, Order: 167232, Start Time: 2012-11-01 17:17:46, End Time: 2012-11-01 20:33:12 To: 5495, Order: 167229, Start Time: 2012-11-01 13:13:53, End Time: 2012-11-01 16:29:31 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (169 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (720 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.18% (2.4523 => 2.4812, std.dev.: 0.0104) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 38.88% (0.0625 => 0.0868, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.76% (0.1063 => 0.1390, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.60% (0.2969 => 0.3729, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.86% (0.1106 => 0.1381, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.27% (0.4253 => 0.5285, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.21% (0.4139 => 0.5141, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.37% (0.5900 => 0.7279, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 22.69% (1.5932 => 1.9547, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.69% (0.0714 => 0.0876, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.60% (0.0584 => 0.0716, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.53% (0.0475 => 0.0582, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.41% (0.4994 => 0.6113, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.28% (0.5000 => 0.6114, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.48% (0.1620 => 0.1968, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.07% (0.0897 => 0.1086, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.06% (0.1021 => 0.1236, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 20.87% (0.0599 => 0.0724, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.87% (0.1107 => 0.1338, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 20.25% (0.0948 => 0.1140, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.14% (0.3903 => 0.4689, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.91% (0.0633 => 0.0759, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.86% (0.0584 => 0.0700) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.78% (0.0541 => 0.0648, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.69% (0.1549 => 0.1854, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.63% (0.0642 => 0.0768, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 19.61% (0.0821 => 0.0982, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.58% (0.1103 => 0.1319, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.44% (0.1003 => 0.1198, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 19.27% (0.1619 => 0.1931, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.22% (0.0822 => 0.0980, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 19.21% (0.0604 => 0.0720, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 18.95% (0.1604 => 0.1908, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.47% (0.1462 => 0.1732, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 18.37% (0.0947 => 0.1121, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.19% (0.1160 => 0.1371, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.12% (0.3890 => 0.4595, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 17.95% (0.0808 => 0.0953, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 17.87% (0.5826 => 0.6867, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 17.59% (0.5889 => 0.6925, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 17.57% (0.1218 => 0.1432) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.51% (0.2736 => 0.3215, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.43% (0.2014 => 0.2365, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 17.28% (0.1505 => 0.1765, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/mst/mst: 17.19% (0.0698 => 0.0818, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 17.10% (0.4029 => 0.4718, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.00% (0.1088 => 0.1273, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.99% (0.2866 => 0.3353, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.93% (1.3152 => 1.5379, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/gs/gs: 16.78% (1.8794 => 2.1947, std.dev.: 0.0089) MultiSource/Applications/Burg/burg: 16.73% (0.5546 => 0.6474, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.60% (0.4658 => 0.5431, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.31% (1.6211 => 1.8855, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.30% (3.5627 => 4.1433, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.28% (0.2875 => 0.3343, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 16.26% (0.1421 => 0.1652, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 16.13% (0.9697 => 1.1261, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.06% (0.1968 => 0.2284, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.87% (0.3271 => 0.3790, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.86% (0.5026 => 0.5823, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hello: 15.70% (0.2714 => 0.3140, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 15.67% (0.2725 => 0.3152, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.67% (0.2738 => 0.3167, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 15.56% (1.0781 => 1.2458, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 15.50% (0.2780 => 0.3211, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.50% (0.2729 => 0.3152, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 15.48% (0.7171 => 0.8281, std.dev.: 0.0039) SingleSource/Regression/C++/ofstream_ctor: 15.45% (0.3004 => 0.3468, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.44% (0.2792 => 0.3223, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/strcat: 15.42% (0.2750 => 0.3174, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.40% (0.3195 => 0.3687, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.32% (0.4361 => 0.5029, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.27% (4.4195 => 5.0942, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/except: 15.26% (0.2811 => 0.3240, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: 15.23% (0.2803 => 0.3230, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 15.22% (0.9909 => 1.1417, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/bh/bh: 15.19% (0.1284 => 0.1479, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wc: 15.18% (0.3096 => 0.3566, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 15.16% (0.2823 => 0.3251, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 15.14% (0.2813 => 0.3239, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.14% (2.0673 => 2.3802, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.08% (0.2911 => 0.3350, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.01% (0.3930 => 0.4520, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.94% (2.7292 => 3.1370, std.dev.: 0.0154) MultiSource/Applications/ClamAV/clamscan: 14.89% (4.2109 => 4.8380, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.66% (1.9694 => 2.2581, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary3: 14.63% (0.3267 => 0.3745, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.59% (1.9966 => 2.2880, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary: 14.55% (0.3258 => 0.3732, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 14.52% (23.5202 => 26.9345, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.52% (0.3362 => 0.3850, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary2: 14.38% (0.3317 => 0.3794, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.38% (0.3060 => 0.3500, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.29% (0.3282 => 0.3751, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.22% (0.1090 => 0.1245, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 14.17% (0.2075 => 0.2369, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 14.04% (0.3348 => 0.3818, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.96% (0.3124 => 0.3560, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 13.92% (0.4146 => 0.4723, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 13.90% (0.3726 => 0.4244, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 13.81% (0.3678 => 0.4186, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 13.69% (0.3477 => 0.3953, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.63% (0.3625 => 0.4119, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 13.53% (0.4251 => 0.4826, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 13.52% (1.4269 => 1.6198, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 13.48% (0.2566 => 0.2912, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.44% (0.3690 => 0.4186, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.44% (0.3981 => 0.4516, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.27% (0.3460 => 0.3919, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 13.24% (0.3496 => 0.3959, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 13.19% (0.3465 => 0.3922, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.17% (0.3446 => 0.3900, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.13% (0.3488 => 0.3946, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.08% (0.3845 => 0.4348, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/synchronized: 13.06% (0.3469 => 0.3922, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 12.95% (0.7875 => 0.8895, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/trivial-interface: 12.93% (0.3442 => 0.3887, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.79% (0.3650 => 0.4117, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 12.79% (0.3643 => 0.4109, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 12.76% (2.1653 => 2.4415, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/bigfib: 12.65% (0.5012 => 0.5646, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 12.57% (0.3724 => 0.4192, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 12.51% (4.6177 => 5.1953, std.dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 12.13% (2.1013 => 2.3562, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.86% (0.1383 => 0.1547, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 11.52% (0.2691 => 0.3001, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.47% (0.2040 => 0.2274, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.31% (0.6435 => 0.7163, std.dev.: 0.0067) MultiSource/Applications/SPASS/SPASS: 11.01% (5.5417 => 6.1517, std.dev.: 0.0061) MultiSource/Applications/lambda-0_1_3/lambda: 10.95% (0.3498 => 0.3881, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.89% (0.1028 => 0.1140) MultiSource/Applications/siod/siod: 10.54% (0.6634 => 0.7333, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.49% (0.2737 => 0.3024, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.44% (0.3084 => 0.3406, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.40% (0.2068 => 0.2283, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 10.23% (0.4847 => 0.5343, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 9.74% (0.3336 => 0.3661, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.37% (0.2103 => 0.2300, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 8.95% (0.2391 => 0.2605, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 8.86% (2.0346 => 2.2149, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.75% (4.6926 => 5.1032, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.38% (11.6398 => 12.6150, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.95% (0.5361 => 0.5787, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.47% (0.5584 => 0.6001, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.38% (0.7426 => 0.7974, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 6.38% (11.9555 => 12.7182, std.dev.: 0.0154) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.88% (0.3792 => 0.3939, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.23% (0.2162 => 0.3529, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6532, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 9.21% (0.2802 => 0.3060, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6100, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.02% (12.0509 => 12.6554, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1677, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.25% (0.3693 => 0.3850, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-2: 4.17% (1.8057 => 1.8810, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: 2.74% (14.0481 => 14.4328, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2043, std.dev.: 0.0473) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.80% (3.1722 => 3.2294, std.dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3037, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2888, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5916, std.dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.46% (25.4195 => 16.4060, std.dev.: 0.0101) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9807, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.66% (35.5013 => 32.7805, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -7.24% (0.2402 => 0.2228, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.29% (11.2080 => 10.8398, std.dev.: 0.0468) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std.dev.: 0.0055) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7742, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5216, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -2.43% (17.2379 => 16.8190, std.dev.: 0.0425) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.17% (41.7953 => 40.8881, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5793, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: -1.55% (5.5810 => 5.4945, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.09% (105.3826 => 104.2336, std.dev.: 0.0635) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0422, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.06% (3.3991 => 3.3630, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.02% (21.9346 => 21.7103, std.dev.: 0.0240) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 14:09:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 16:09:58 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121101210958.95E042A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5503?compare_to=5499&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5503, Order: 167243, Start Time: 2012-11-01 19:42:50, End Time: 2012-11-01 21:10:01 To: 5499, Order: 167237, Start Time: 2012-11-01 17:58:20, End Time: 2012-11-01 19:24:55 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 19 (111 on baseline) Performance Improvements: 0 (4 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 972 (859 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.27% (0.1133 => 0.1238, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 4.01% (0.3016 => 0.3137, std.dev.: 0.0046) MultiSource/Applications/hbd/hbd: 3.17% (1.4495 => 1.4955, std.dev.: 0.0108) MultiSource/Applications/spiff/spiff: 2.99% (0.8161 => 0.8405, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.62% (0.6035 => 0.6193, std.dev.: 0.0037) MultiSource/Applications/Burg/burg: 2.53% (1.2535 => 1.2852, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.50% (0.6393 => 0.6553, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.37% (0.9782 => 1.0014, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/05-eks/eks: 2.34% (0.4479 => 0.4584, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.90% (1.2053 => 1.2282, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.70% (8.7729 => 8.9224, std.dev.: 0.0340) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.68% (0.6373 => 0.6480, std.dev.: 0.0022) MultiSource/Applications/treecc/treecc: 1.67% (2.0329 => 2.0669, std.dev.: 0.0113) MultiSource/Benchmarks/MallocBench/gs/gs: 1.47% (4.1926 => 4.2544, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.35% (0.8220 => 0.8331, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.13% (4.5305 => 4.5819, std.dev.: 0.0166) MultiSource/Applications/hexxagon/hexxagon: 1.01% (0.9938 => 1.0038, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/ffbench: 4.14% (1.3820 => 1.4392, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C++/life/life: 2.83% (2.5554 => 2.6278, std.dev.: 0.0133) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.12% (16.6175 => 16.5979, std.dev.: 0.1507) MultiSource/Applications/obsequi/Obsequi: 1.09% (1.0601 => 1.0717, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.16% (21.6645 => 21.6303, std.dev.: 0.4079) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.71% (0.3655 => 0.3681, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 0.60% (0.6023 => 0.6059, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.02% (0.3340 => 0.3374, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 1.24% (0.2017 => 0.2042, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.45% (0.0220 => 0.0219, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.70% (0.0426 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.60% (0.0333 => 0.0331, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.95% (0.0315 => 0.0312, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.51% (0.0388 => 0.0421, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0203 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 7.46% (0.0201 => 0.0216, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.55% (0.1448 => 0.1440, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.96% (1.1553 => 1.1326, std.dev.: 0.0369) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.27% (0.1485 => 0.1489, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.38% (0.3982 => 0.3997, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.02% (0.1369 => 0.1355, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.50% (0.0602 => 0.0593, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 37.70% (0.0183 => 0.0252, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.26% (0.0540 => 0.0563, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.30% (1.1457 => 1.1423, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.39% (0.0579 => 0.0616, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.76% (0.0245 => 0.0177, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.08% (0.7945 => 0.8031, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -13.04% (0.0046 => 0.0040, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2306.36% (0.6332 => 15.2371, std.dev.: 0.3031) MultiSource/Benchmarks/McCat/08-main/main: 49.21% (0.1831 => 0.2732, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.35% (0.1559 => 0.1460, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1484.06% (0.3344 => 5.2971, std.dev.: 0.0270) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.27% (0.2364 => 0.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: 3.03% (0.0429 => 0.0442, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0224 => 0.0224, std.dev.: 0.0008) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3449, std.dev.: 0.0131) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0702, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4943, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3428, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0485, std.dev.: 0.0554) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4034, std.dev.: 0.0030) SingleSource/Regression/C/uint64_to_float: -23.99% (2.1832 => 1.6594, std.dev.: 0.0073) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.19% (0.0810 => 0.0933, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: 14.03% (0.1112 => 0.1268, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.26% (0.0848 => 0.0952, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.17% (0.2180 => 0.2380, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/04-bisect/bisect: 8.88% (0.1137 => 0.1238, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.19% (0.3137 => 0.3394, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.82% (0.6010 => 0.6480, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.64% (0.1466 => 0.1578, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.60% (0.8321 => 0.8953, std.dev.: 0.0114) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.45% (0.1905 => 0.2047, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.29% (0.7473 => 0.8018, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.16% (0.1425 => 0.1527, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/em3d/em3d: 6.57% (0.1721 => 0.1834, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.20% (0.2998 => 0.3184, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.14% (0.9435 => 1.0014, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.80% (0.2519 => 0.2665, std.dev.: 0.0031) MultiSource/Applications/spiff/spiff: 5.72% (0.7950 => 0.8405, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.70% (0.2279 => 0.2409, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.68% (0.1885 => 0.1992, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.39% (0.8148 => 0.8587, std.dev.: 0.0116) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.35% (0.1983 => 0.2089, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.24% (0.6227 => 0.6553, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 5.15% (1.2222 => 1.2852, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.11% (1.1685 => 1.2282, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.85% (0.4847 => 0.5082, std.dev.: 0.0075) MultiSource/Applications/hbd/hbd: 4.81% (1.4269 => 1.4955, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.79% (0.6287 => 0.6588, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.78% (0.2133 => 0.2235, std.dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 4.60% (0.2999 => 0.3137, std.dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: 4.56% (1.2568 => 1.3141, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.56% (1.1606 => 1.2135, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.46% (0.2240 => 0.2340, std.dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 4.37% (1.1271 => 1.1764, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/05-eks/eks: 4.25% (0.4397 => 0.4584, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.04% (0.4559 => 0.4743, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.01% (0.3295 => 0.3427, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.89% (0.5961 => 0.6193, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.77% (6.6074 => 6.8567, std.dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.63% (0.5817 => 0.6028, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: 3.62% (1.0945 => 1.1341, std.dev.: 0.0121) MultiSource/Applications/treecc/treecc: 3.61% (1.9948 => 2.0669, std.dev.: 0.0113) MultiSource/Applications/ClamAV/clamscan: 3.60% (14.7684 => 15.2997, std.dev.: 0.1055) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.58% (0.9074 => 0.9399, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash: 3.58% (0.3800 => 0.3936, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.49% (0.8050 => 0.8331, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.41% (0.5191 => 0.5368, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.36% (0.8697 => 0.8989, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.27% (0.8611 => 0.8893, std.dev.: 0.0052) MultiSource/Applications/lua/lua: 3.22% (3.8189 => 3.9417, std.dev.: 0.0144) MultiSource/Applications/d/make_dparser: 3.21% (3.2366 => 3.3406, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/hash2: 3.20% (0.4125 => 0.4257, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.19% (1.3279 => 1.3702, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.18% (8.6476 => 8.9224, std.dev.: 0.0340) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.16% (0.9908 => 1.0221, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.16% (1.6386 => 1.6903, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.15% (4.4873 => 4.6286, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.11% (4.1763 => 4.3061, std.dev.: 0.0127) MultiSource/Applications/SPASS/SPASS: 3.02% (14.2605 => 14.6916, std.dev.: 0.0866) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.00% (0.8457 => 0.8711, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 3.00% (4.1305 => 4.2544, std.dev.: 0.0202) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.99% (1.2526 => 1.2901, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.98% (0.7966 => 0.8203, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.92% (0.8007 => 0.8241, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.92% (0.6586 => 0.6778, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.91% (0.8286 => 0.8527, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.88% (0.8331 => 0.8571, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.86% (0.8069 => 0.8300, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.86% (0.8317 => 0.8555, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.85% (0.8340 => 0.8578, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.85% (0.9688 => 0.9964, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.81% (0.9069 => 0.9324, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.81% (0.8656 => 0.8899, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.80% (1.4479 => 1.4885, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.63% (0.8066 => 0.8278, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/football/football: 2.62% (0.8768 => 0.8998, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.60% (0.8855 => 0.9085, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.57% (0.4127 => 0.4233, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.56% (0.8086 => 0.8293, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.54% (0.8716 => 0.8937, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.53% (0.8420 => 0.8633, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.52% (0.8805 => 0.9027, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.50% (0.8712 => 0.8930, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.47% (0.8204 => 0.8407, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.46% (0.9039 => 0.9261, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.45% (0.9056 => 0.9278, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.45% (0.8261 => 0.8463, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.34% (0.7932 => 0.8118, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.34% (0.8518 => 0.8717, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 2.32% (0.9810 => 1.0038, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.31% (0.8338 => 0.8531, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.24% (0.8885 => 0.9084, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.21% (0.8316 => 0.8500, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.15% (13.1811 => 13.4649, std.dev.: 0.0641) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.14% (4.5702 => 4.6679, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.09% (0.8927 => 0.9114, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.09% (4.4880 => 4.5819, std.dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.03% (1.2602 => 1.2858, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 1.79% (2.2184 => 2.2582, std.dev.: 0.0063) MultiSource/Applications/lambda-0_1_3/lambda: 1.54% (0.7557 => 0.7673, std.dev.: 0.0029) SingleSource/UnitTests/Vector/constpool: 1.51% (8.4179 => 8.5447, std.dev.: 0.0428) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 56.92% (1.5795 => 2.4786, std.dev.: 0.0162) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.41% (2.7978 => 3.7325, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.40% (1.1857 => 1.2734, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/strcat: 6.70% (0.1538 => 0.1641, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.90% (63.1822 => 66.9121, std.dev.: 0.0810) MultiSource/Benchmarks/BitBench/drop3/drop3: 5.06% (0.2887 => 0.3033, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.81% (2.4490 => 2.5178, std.dev.: 0.0218) MultiSource/Applications/siod/siod: 2.73% (3.6643 => 3.7642, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.13% (59.2638 => 60.5279, std.dev.: 0.3827) SingleSource/Benchmarks/Misc/ReedSolomon: 1.72% (8.5322 => 8.6792, std.dev.: 0.0494) MultiSource/Benchmarks/Olden/bh/bh: 1.69% (2.3560 => 2.3958, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.04% (0.3269 => 0.3039, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -5.36% (29.8330 => 28.2334, std.dev.: 0.1799) SingleSource/Benchmarks/Shootout-C++/hash2: -1.45% (3.4237 => 3.3740, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.27% (3.3479 => 3.3054, std.dev.: 0.0013) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.92% (16.4461 => 16.5979, std.dev.: 0.1507) MultiSource/Applications/obsequi/Obsequi: 4.43% (1.0262 => 1.0717, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6826.13% (0.3123 => 21.6303, std.dev.: 0.4079) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.45% (0.2463 => 0.3681, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 0.82% (0.6010 => 0.6059, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.31% (0.3266 => 0.3374, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 3.71% (0.1969 => 0.2042, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.68% (0.0408 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.64% (0.0384 => 0.0421, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1438 => 0.1440, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.03% (1.1329 => 1.1326, std.dev.: 0.0369) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 1.85% (0.1462 => 0.1489, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.01% (0.4164 => 0.3997, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.02% (0.1369 => 0.1355, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.49% (0.0641 => 0.0593, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 29.23% (0.0195 => 0.0252, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.60% (0.0578 => 0.0563, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.12% (1.1437 => 1.1423, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.75% (0.0627 => 0.0616, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.67% (0.0180 => 0.0177, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.17% (0.8017 => 0.8031, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -35.48% (0.0062 => 0.0040, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 14:27:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 16:27:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121101212721.E1F8E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5504?compare_to=5500&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5504, Order: 167243, Start Time: 2012-11-01 20:02:16, End Time: 2012-11-01 21:27:23 To: 5500, Order: 167237, Start Time: 2012-11-01 18:14:00, End Time: 2012-11-01 19:39:01 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 5 (6 on baseline) Performance Improvements: 0 (175 on baseline) Unchanged Tests: 1037 (861 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/Hello: 1.86% (0.6019 => 0.6131, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 1.72% (0.6117 => 0.6222, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 1.69% (0.7355 => 0.7479, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.46% (2.0358 => 2.0656, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 1.08% (1.2365 => 1.2499, std.dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 3.05% (0.3834 => 0.3951, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.15% (3.1919 => 3.4202, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.99% (2.0478 => 2.1090, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: 2.36% (7.4937 => 7.6704, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hash2: 2.03% (3.1932 => 3.2579, std.dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.71% (0.1584 => 0.1446, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.18% (0.1431 => 0.1314, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.20% (0.3821 => 0.3546, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -6.98% (2.4924 => 2.3184, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.47% (0.2428 => 0.2271, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.33% (0.3142 => 0.2943, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.15% (0.3658 => 0.3433, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.14% (0.9542 => 0.8956, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -6.07% (0.1879 => 0.1765, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.94% (22.4056 => 21.0742, std.dev.: 0.0185) MultiSource/Applications/JM/ldecod/ldecod: -5.85% (7.0961 => 6.6812, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.82% (4.5069 => 4.2447, std.dev.: 0.0113) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.80% (0.9852 => 0.9281, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.80% (3.5339 => 3.3291, std.dev.: 0.0023) MultiSource/Applications/sgefa/sgefa: -5.78% (0.3357 => 0.3163, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.77% (0.6484 => 0.6110, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: -5.76% (16.1920 => 15.2587, std.dev.: 0.0078) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.69% (0.2355 => 0.2221, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -5.65% (0.2160 => 0.2038, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -5.64% (0.2659 => 0.2509, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -5.57% (4.3330 => 4.0915, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.52% (0.7198 => 0.6801, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.48% (0.7919 => 0.7485, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.43% (1.0544 => 0.9971, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.43% (4.0323 => 3.8134, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: -5.42% (1.2515 => 1.1837, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.42% (0.2548 => 0.2410, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.42% (4.8802 => 4.6159, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.40% (4.8161 => 4.5559, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.40% (1.6474 => 1.5585, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -5.29% (2.4021 => 2.2751, std.dev.: 0.0153) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.25% (0.4151 => 0.3933, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -5.25% (34.0927 => 32.3027, std.dev.: 0.0203) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.25% (1.2784 => 1.2113, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.21% (14.2083 => 13.4678, std.dev.: 0.0146) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.18% (5.4682 => 5.1852, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: -5.17% (0.9179 => 0.8704, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: -5.13% (9.2283 => 8.7547, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/methcall: -5.12% (0.3025 => 0.2870, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.12% (1.2300 => 1.1670, std.dev.: 0.0051) MultiSource/Applications/lua/lua: -5.10% (4.0594 => 3.8525, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/trivial-interface: -5.09% (0.3812 => 0.3618, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.08% (1.6364 => 1.5533, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/objinst: -5.07% (0.3194 => 0.3032, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.05% (0.4813 => 0.4570, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: -5.04% (0.3831 => 0.3638, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.00% (0.3837 => 0.3645, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.00% (0.3880 => 0.3686, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.99% (0.3891 => 0.3697, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.98% (1.3722 => 1.3038, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.98% (0.8521 => 0.8097, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: -4.97% (1.1450 => 1.0881, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.97% (0.3483 => 0.3310, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.95% (0.3896 => 0.3703, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.95% (0.4321 => 0.4107, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: -4.94% (1.3148 => 1.2499, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: -4.93% (0.4033 => 0.3834, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -4.93% (0.4176 => 0.3970, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -4.92% (0.2985 => 0.2838, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.91% (0.3057 => 0.2907, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -4.90% (0.7982 => 0.7591, std.dev.: 0.0090) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.89% (0.3884 => 0.3694, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.89% (0.2903 => 0.2761, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -4.89% (0.3026 => 0.2878, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.88% (0.5999 => 0.5706, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -4.88% (17.1032 => 16.2689, std.dev.: 0.0165) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.87% (6.7716 => 6.4416, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.87% (2.1713 => 2.0656, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: -4.85% (0.3481 => 0.3312, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -4.83% (0.3394 => 0.3230, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -4.82% (0.2989 => 0.2845, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -4.81% (0.2849 => 0.2712, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.80% (0.2999 => 0.2855, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.79% (1.4642 => 1.3941, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -4.79% (0.6750 => 0.6427, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-3: -4.78% (0.3848 => 0.3664, std.dev.: 0.0026) SingleSource/Regression/C++/ofstream_ctor: -4.77% (0.3059 => 0.2913, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -4.77% (0.2871 => 0.2734, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -4.76% (0.2939 => 0.2799, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.76% (0.4199 => 0.3999, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: -4.76% (0.3446 => 0.3282, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -4.75% (18.2933 => 17.4247, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.75% (1.2221 => 1.1641, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.74% (2.2587 => 2.1517, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/moments: -4.73% (0.4248 => 0.4047, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.73% (0.3849 => 0.3667, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.72% (0.4280 => 0.4078, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.72% (0.6293 => 0.5996, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.71% (0.3016 => 0.2874, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.70% (0.3252 => 0.3099, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -4.70% (0.3255 => 0.3102, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.68% (0.3205 => 0.3055, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -4.65% (0.7447 => 0.7101, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.63% (0.4427 => 0.4222, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.62% (0.5478 => 0.5225, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -4.61% (0.3581 => 0.3416, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.59% (1.2210 => 1.1649, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.59% (0.5857 => 0.5588, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: -4.57% (0.3788 => 0.3615, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.57% (0.6681 => 0.6376, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -4.56% (0.3621 => 0.3456, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash: -4.55% (0.4524 => 0.4318, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.54% (0.5591 => 0.5337, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.54% (0.5575 => 0.5322, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.52% (0.6260 => 0.5977, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.52% (0.4916 => 0.4694, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: -4.50% (0.3867 => 0.3693, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.49% (0.6230 => 0.5950, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.49% (0.5859 => 0.5596, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -4.47% (0.4515 => 0.4313, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: -4.46% (0.3406 => 0.3254, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.46% (0.4083 => 0.3901, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.46% (0.6194 => 0.5918, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.46% (0.7339 => 0.7012, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.45% (0.6676 => 0.6379, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.44% (0.7524 => 0.7190, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -4.43% (15.5079 => 14.8204, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.41% (0.5805 => 0.5549, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.41% (0.5581 => 0.5335, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.40% (0.6052 => 0.5786, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.39% (0.5849 => 0.5592, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.38% (0.5567 => 0.5323, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.38% (0.5570 => 0.5326, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.37% (0.5925 => 0.5666, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.35% (0.6660 => 0.6370, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.35% (0.6189 => 0.5920, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/09-vor/vor: -4.34% (0.3271 => 0.3129, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.33% (0.6667 => 0.6378, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.33% (0.6304 => 0.6031, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.33% (0.5456 => 0.5220, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.32% (0.6440 => 0.6162, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.32% (0.5863 => 0.5610, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.28% (0.6446 => 0.6170, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.28% (0.5705 => 0.5461, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.26% (0.6033 => 0.5776, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.24% (8.0126 => 7.6728, std.dev.: 0.0085) MultiSource/Applications/treecc/treecc: -4.24% (2.1401 => 2.0494, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.23% (0.2695 => 0.2581, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.22% (0.3319 => 0.3179, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: -4.21% (1.3864 => 1.3280, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.21% (0.3491 => 0.3344, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.21% (0.6297 => 0.6032, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.21% (0.5941 => 0.5691, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.19% (0.6395 => 0.6127, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.17% (0.9557 => 0.9158, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.12% (0.3323 => 0.3186, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.11% (0.5688 => 0.5454, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.09% (0.2933 => 0.2813, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -4.09% (0.8418 => 0.8074, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.07% (0.3931 => 0.3771, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.06% (0.5569 => 0.5343, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.04% (0.6736 => 0.6464, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.03% (0.6395 => 0.6137, std.dev.: 0.0052) MultiSource/Applications/d/make_dparser: -3.93% (3.5154 => 3.3773, std.dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: -3.89% (5.0226 => 4.8273, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.86% (0.7021 => 0.6750, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -3.86% (0.7779 => 0.7479, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.80% (0.9077 => 0.8732, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.75% (0.5168 => 0.4974, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -3.73% (15.2527 => 14.6836, std.dev.: 0.0126) MultiSource/Benchmarks/nbench/nbench: -3.73% (1.1530 => 1.1100, std.dev.: 0.0041) SingleSource/UnitTests/ObjC++/Hello: -3.40% (0.6347 => 0.6131, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.40% (0.6441 => 0.6222, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.39% (1.5610 => 1.5081, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.28% (0.5329 => 0.5154, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.37% (20.7746 => 20.2814, std.dev.: 0.0253) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7546, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: -8.65% (1.2842 => 1.1731, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -4.06% (2.2633 => 2.1715, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.84% (1.7753 => 1.7072, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.61% (1.3096 => 1.2754, std.dev.: 0.0103) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4704, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0010) Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 15:35:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 17:35:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121101223541.310B12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5505?compare_to=5501&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5505, Order: 167249, Start Time: 2012-11-01 21:02:33, End Time: 2012-11-01 22:35:42 To: 5501, Order: 167239, Start Time: 2012-11-01 18:59:08, End Time: 2012-11-01 20:32:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 0 (174 on baseline) Performance Improvements: 1 (54 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 1 (1 on baseline) Unchanged Tests: 1040 (661 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.09% (81.3230 => 78.8087, std.dev.: 0.9282) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0648 => 0.0648, std.dev.: 0.0013) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 191.59% (0.5229 => 1.5247, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 13.08% (14.9895 => 16.9502, std.dev.: 0.0137) MultiSource/Applications/kimwitu++/kc: 36.87% (14.1553 => 19.3745, std.dev.: 0.0129) MultiSource/Benchmarks/MallocBench/gs/gs: 12.46% (4.1105 => 4.6225, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 29.70% (1.1048 => 1.4329, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 307.96% (7.1582 => 29.2026, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.90% (3.4629 => 5.8489, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_container: 63.84% (0.6222 => 1.0194, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10588.89% (0.0720 => 7.6960, std.dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: 3836400.00% (0.0001 => 3.8365, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11162900.00% (0.0001 => 11.1630, std.dev.: 0.0234) MultiSource/Applications/kimwitu++/kc: 51000.00% (0.0001 => 0.0511, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -10.71% (0.1485 => 0.1326, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63700.00% (0.0001 => 0.0638, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 748700.00% (0.0001 => 0.7488, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10051600.00% (0.0001 => 10.0517, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5491700.00% (0.0001 => 5.4918, std.dev.: 0.0078) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/CoyoteBench/almabench: 41.37% (0.0730 => 0.1032, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/distray/distray: 38.83% (0.1056 => 0.1466, std.dev.: 0.0001) SingleSource/UnitTests/vla: 29.86% (0.0355 => 0.0461, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 26.55% (8.1363 => 10.2968, std.dev.: 0.0086) MultiSource/Applications/ClamAV/clamscan: 21.97% (22.1758 => 27.0486, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.56% (0.1566 => 0.1888) MultiSource/Benchmarks/Olden/tsp/tsp: 17.79% (0.1175 => 0.1384, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.78% (0.0793 => 0.0934, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 17.43% (0.0746 => 0.0876, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 16.97% (0.3177 => 0.3716, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.76% (0.0871 => 0.1017, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.72% (0.4879 => 0.5695, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 16.33% (0.2554 => 0.2971, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.17% (0.0798 => 0.0927, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.66% (0.1143 => 0.1322, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.66% (0.1584 => 0.1832, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.57% (0.8172 => 0.9444, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.32% (0.0842 => 0.0971, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 15.05% (0.1163 => 0.1338, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 15.02% (0.1125 => 0.1294, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 14.93% (0.1695 => 0.1948, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.89% (0.2700 => 0.3102, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 14.80% (0.1655 => 0.1900, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.38% (2.2022 => 2.5189, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.36% (0.2758 => 0.3154, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.33% (0.0886 => 0.1013, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 14.30% (0.5105 => 0.5835, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.27% (0.0834 => 0.0953, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.19% (0.2065 => 0.2358, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 14.08% (0.7115 => 0.8117, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.07% (0.1940 => 0.2213, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 13.95% (0.1555 => 0.1772, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 13.90% (0.1151 => 0.1311, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 13.74% (0.7433 => 0.8454, std.dev.: 0.0040) MultiSource/Applications/sgefa/sgefa: 13.57% (0.3109 => 0.3531, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.51% (0.0770 => 0.0874, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.48% (0.6675 => 0.7575, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 13.46% (1.1642 => 1.3209, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.46% (0.5981 => 0.6786, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.39% (0.1337 => 0.1516, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.38% (0.0770 => 0.0873, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.34% (0.1117 => 0.1266, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.34% (0.2107 => 0.2388, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.25% (0.1510 => 0.1710, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 13.02% (0.0814 => 0.0920, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 13.00% (3.3354 => 3.7690, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.99% (0.2271 => 0.2566, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.98% (0.3121 => 0.3526, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.96% (0.9765 => 1.1031, std.dev.: 0.0020) MultiSource/Applications/spiff/spiff: 12.95% (0.7835 => 0.8850, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.82% (0.5569 => 0.6283, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.78% (0.4615 => 0.5205, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.78% (0.5860 => 0.6609, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.73% (0.1029 => 0.1160, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.73% (1.5415 => 1.7377, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.69% (0.1032 => 0.1163, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.62% (0.1236 => 0.1392, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.52% (0.1062 => 0.1195, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.26% (0.3441 => 0.3863, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.21% (0.5020 => 0.5633, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.19% (1.3050 => 1.4641, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/health/health: 12.15% (0.1268 => 0.1422, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 12.02% (3.8723 => 4.3378, std.dev.: 0.0096) MultiSource/Applications/treecc/treecc: 11.95% (2.0273 => 2.2696, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.94% (0.1625 => 0.1819, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.70% (0.3307 => 0.3694, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 11.54% (0.3423 => 0.3818, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 11.46% (1.0722 => 1.1951, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.35% (1.5859 => 1.7659, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.30% (0.0929 => 0.1034, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.29% (0.2603 => 0.2897, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 11.25% (0.0933 => 0.1038, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.24% (0.6450 => 0.7175, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.20% (4.2646 => 4.7423, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.11% (0.1044 => 0.1160, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/rem: 11.10% (0.1144 => 0.1271, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.09% (0.1695 => 0.1883, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 11.00% (0.1463 => 0.1624, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 10.91% (0.4299 => 0.4768, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.87% (2.2024 => 2.4419, std.dev.: 0.0081) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.76% (0.1906 => 0.2111, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 10.71% (2.2969 => 2.5429, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/09-vor/vor: 10.69% (0.3180 => 0.3520, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 10.68% (9.4845 => 10.4979, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/bigfib: 10.64% (0.6456 => 0.7143, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 10.63% (0.3387 => 0.3747, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 10.59% (1.1840 => 1.3094, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/parameter-passing: 10.57% (0.3927 => 0.4342, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 10.39% (0.8921 => 0.9848, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 10.39% (0.3282 => 0.3623, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 10.25% (0.3473 => 0.3829, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.24% (0.3828 => 0.4220, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.15% (0.8101 => 0.8923, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.10% (0.3543 => 0.3901, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.08% (0.3561 => 0.3920, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 10.08% (0.3543 => 0.3900, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.07% (0.3497 => 0.3849, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.04% (0.3516 => 0.3869, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 9.98% (0.4289 => 0.4717, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 9.96% (0.3694 => 0.4062, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.96% (0.3886 => 0.4273, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.93% (1.1861 => 1.3039, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.72% (1.4186 => 1.5565, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 9.65% (0.4620 => 0.5066, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.57% (0.3865 => 0.4235, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.40% (0.4203 => 0.4598, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.34% (0.4636 => 0.5069, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.31% (0.4103 => 0.4485, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.20% (1.5603 => 1.7039, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.09% (0.1892 => 0.2064, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 9.09% (0.3422 => 0.3733, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.99% (0.6030 => 0.6572, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.93% (0.5925 => 0.6454, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.89% (0.7326 => 0.7977, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: 8.82% (0.4048 => 0.4405, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 8.74% (0.3684 => 0.4006, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 8.69% (0.3603 => 0.3916, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.69% (5.0018 => 5.4363, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.60% (0.2430 => 0.2639, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.59% (4.9449 => 5.3698, std.dev.: 0.0067) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.57% (0.1330 => 0.1444, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.52% (0.2266 => 0.2459, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.11% (0.3650 => 0.3946, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.89% (0.3826 => 0.4128, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 7.70% (0.2831 => 0.3049, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.70% (0.2793 => 0.3008, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 7.68% (0.2905 => 0.3128, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.60% (0.4064 => 0.4373, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.54% (0.2891 => 0.3109, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.53% (0.3162 => 0.3400, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.43% (0.3283 => 0.3527, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.39% (0.3232 => 0.3471, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 7.39% (0.3098 => 0.3327, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.35% (0.2871 => 0.3082, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 7.30% (5.7591 => 6.1795, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.30% (2.0665 => 2.2173, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.24% (14.3668 => 15.4066, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/fibo: 7.12% (0.2725 => 0.2919, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.11% (0.2756 => 0.2952, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.10% (0.2872 => 0.3076, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/methcall: 7.09% (0.2877 => 0.3081, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.95% (0.3052 => 0.3264, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.92% (0.3427 => 0.3664, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.89% (0.2714 => 0.2901, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 6.80% (1.2842 => 1.3715, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 6.78% (0.2802 => 0.2992, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 6.59% (17.1811 => 18.3127, std.dev.: 0.0238) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.57% (0.3136 => 0.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.51% (3.8922 => 4.1457, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 6.40% (0.3092 => 0.3290, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.38% (0.8067 => 0.8582, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: 6.10% (0.3379 => 0.3585, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 4.98% (0.3131 => 0.3287, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.46% (0.3935 => 0.4071, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.65% (0.3817 => 0.3918, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 19.80% (2.8904 => 3.4628, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.55% (1.1145 => 1.2989, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.99% (1.1396 => 1.2534, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3690, std.dev.: 0.0017) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.59% (8.6802 => 8.9050, std.dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.52% (4.2280 => 4.3345, std.dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.16% (3.6395 => 3.7181, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bisort/bisort: 1.75% (0.8333 => 0.8479, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 1.51% (3.1595 => 3.2071, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5758, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.92% (6.6874 => 0.1388, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -76.20% (0.8651 => 0.2059, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -54.53% (5.3855 => 2.4487, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.28% (5.3526 => 2.4474, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -45.56% (0.1622 => 0.0883, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.72% (5.2763 => 3.1278, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -23.82% (1.7609 => 1.3414, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.10% (2.9384 => 2.5534, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -10.77% (1.1194 => 0.9988, std.dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: -9.94% (10.4361 => 9.3983, std.dev.: 0.0067) SingleSource/UnitTests/Vector/constpool: -9.01% (54.1659 => 49.2837, std.dev.: 0.0152) MultiSource/Benchmarks/PAQ8p/paq8p: -5.64% (10.3673 => 9.7822, std.dev.: 0.0117) MultiSource/Benchmarks/Bullet/bullet: -2.54% (63.2438 => 61.6361, std.dev.: 0.0088) MultiSource/Applications/JM/lencod/lencod: -2.04% (21.9371 => 21.4896, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.96% (0.0506 => 0.0319, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.92% (0.3987 => 0.2515, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7636, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -30.26% (10.7105 => 7.4695, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -20.58% (2.6778 => 2.1268, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4240, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -10.99% (9.5636 => 8.5127, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -10.78% (1.5373 => 1.3716, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.40% (19.9488 => 18.2739, std.dev.: 0.0219) MultiSource/Benchmarks/FreeBench/mason/mason: -7.82% (0.2161 => 0.1992, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -7.48% (6.6465 => 6.1495, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.07% (1.8329 => 1.7033, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.65% (1.2373 => 1.1550, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.05% (1.6805 => 1.5957, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5073, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.61% (1.5660 => 1.4938, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.41% (0.9957 => 0.9518, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.00% (0.2497 => 0.2397, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.84% (3.2827 => 3.1567, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -3.79% (4.5009 => 4.3305, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.52% (32.5116 => 31.3667, std.dev.: 0.0038) MultiSource/Benchmarks/sim/sim: -3.24% (5.0483 => 4.8848, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.81% (0.4808 => 0.4673, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -2.77% (4.6441 => 4.5154, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/Olden/power/power: -2.14% (1.1277 => 1.1036, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.98% (8.1563 => 7.9952, std.dev.: 0.0156) SingleSource/Benchmarks/CoyoteBench/almabench: -1.97% (11.3103 => 11.0876, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0833, std.dev.: 0.0256) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6808, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.67% (2.5528 => 2.5101, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (85.0658 => 83.9818, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/lists: -1.18% (6.2999 => 6.2254, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0013) Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 15:53:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 17:53:51 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121101225351.07EC92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5506?compare_to=5503&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5506, Order: 167249, Start Time: 2012-11-01 21:26:49, End Time: 2012-11-01 22:53:54 To: 5503, Order: 167243, Start Time: 2012-11-01 19:42:50, End Time: 2012-11-01 21:10:01 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 6 (69 on baseline) Performance Improvements: 7 (7 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 978 (898 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.60% (0.3197 => 0.3472, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.56% (44.8928 => 46.0427, std.dev.: 0.2385) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.28% (4.3413 => 4.4401, std.dev.: 0.0339) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.31% (2.6679 => 2.7029, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.18% (4.5307 => 4.5842, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/pi: 1.14% (2.4786 => 2.5069, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.22% (1.0014 => 0.9391, std.dev.: 0.0203) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.58% (4.6286 => 4.5093, std.dev.: 0.0421) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -12.40% (3.4794 => 3.0481, std.dev.: 0.1226) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -3.08% (22.5274 => 21.8329, std.dev.: 0.1484) SingleSource/Benchmarks/Misc/ffbench: -2.72% (1.4392 => 1.4001, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.31% (2.6278 => 2.5672, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.89% (60.5279 => 59.3868, std.dev.: 0.3846) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.65% (16.5979 => 16.7065, std.dev.: 0.2682) MultiSource/Applications/obsequi/Obsequi: 0.15% (1.0717 => 1.0733, std.dev.: 0.0120) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.34% (21.6303 => 21.7039, std.dev.: 0.2315) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.57% (0.3681 => 0.3660, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/bigfib: -0.07% (0.6059 => 0.6055, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.83% (0.3374 => 0.3346, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: -1.08% (0.2042 => 0.2020, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -17.81% (0.0219 => 0.0180, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0423 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0331 => 0.0332, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0312 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.24% (0.0421 => 0.0422, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 0.99% (0.0202 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -14.35% (0.0216 => 0.0185, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1440 => 0.1437, std.dev.: 0.0036) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.49% (1.1326 => 1.1495, std.dev.: 0.0048) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 1.81% (0.1489 => 0.1516, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.33% (0.3997 => 0.4050, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.70% (0.1355 => 0.1332, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.55% (0.0593 => 0.0620, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 7.94% (0.0252 => 0.0272, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.62% (0.0563 => 0.0589, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.06% (1.1423 => 1.1430, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.45% (0.0031 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.97% (0.0616 => 0.0622, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.21% (0.0177 => 0.0211, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.19% (0.8031 => 0.8016, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 42.50% (0.0040 => 0.0057, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2315.19% (0.6332 => 15.2930, std.dev.: 0.2963) MultiSource/Benchmarks/McCat/08-main/main: 46.70% (0.1831 => 0.2686, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.50% (0.1559 => 0.1442, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1486.81% (0.3344 => 5.3063, std.dev.: 0.0260) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.21% (0.2364 => 0.3220, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0010) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.34% (0.0224 => 0.0221, std.dev.: 0.0012) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3461, std.dev.: 0.0225) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0707, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4951, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3555, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0451, std.dev.: 0.0256) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4031, std.dev.: 0.0065) SingleSource/Regression/C/uint64_to_float: -24.40% (2.1832 => 1.6506, std.dev.: 0.0081) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.04% (0.0810 => 0.0948, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: 11.87% (0.1112 => 0.1244, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.24% (0.1588 => 0.1703, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.16% (0.1425 => 0.1527, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.90% (0.1885 => 0.2015, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.51% (0.2180 => 0.2322, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.73% (0.7473 => 0.7901, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.57% (0.4559 => 0.4813, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.46% (0.1905 => 0.2009, std.dev.: 0.0034) MultiSource/Applications/sgefa/sgefa: 5.30% (0.2999 => 0.3158, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.23% (0.8148 => 0.8574, std.dev.: 0.0123) MultiSource/Applications/spiff/spiff: 5.12% (0.7950 => 0.8357, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.96% (0.2519 => 0.2644, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 4.95% (0.8007 => 0.8403, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.89% (0.8611 => 0.8946, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.84% (0.9039 => 0.9386, std.dev.: 0.0106) MultiSource/Benchmarks/nbench/nbench: 3.83% (1.1271 => 1.1703, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.76% (0.9688 => 1.0052, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.69% (0.6227 => 0.6457, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.65% (0.2741 => 0.2841, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.51% (0.5191 => 0.5373, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: 3.48% (1.9948 => 2.0643, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.48% (0.8457 => 0.8751, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/hash: 3.47% (0.3800 => 0.3932, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 3.44% (14.2605 => 14.7517, std.dev.: 0.0994) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.37% (0.8317 => 0.8597, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.28% (0.8697 => 0.8982, std.dev.: 0.0070) MultiSource/Applications/ClamAV/clamscan: 3.23% (14.7684 => 15.2459, std.dev.: 0.1472) MultiSource/Benchmarks/McCat/05-eks/eks: 3.16% (0.4397 => 0.4536, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.09% (0.8805 => 0.9077, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.01% (0.6586 => 0.6784, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.96% (0.8338 => 0.8585, std.dev.: 0.0042) MultiSource/Applications/d/make_dparser: 2.93% (3.2366 => 3.3315, std.dev.: 0.0246) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.93% (1.4479 => 1.4903, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.92% (0.8316 => 0.8559, std.dev.: 0.0077) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.92% (6.6074 => 6.8002, std.dev.: 0.0430) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.87% (0.8261 => 0.8498, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.85% (0.8597 => 0.8842, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.77% (0.8716 => 0.8957, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.73% (0.8420 => 0.8650, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.72% (0.8331 => 0.8558, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.65% (0.8518 => 0.8744, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.65% (1.3279 => 1.3631, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.62% (0.8855 => 0.9087, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.61% (0.7932 => 0.8139, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.58% (0.8286 => 0.8500, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.52% (0.9908 => 1.0158, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/hash2: 2.52% (0.4125 => 0.4229, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.50% (0.8656 => 0.8872, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.34% (8.6476 => 8.8501, std.dev.: 0.0564) MultiSource/Benchmarks/mafft/pairlocalalign: 2.21% (8.6247 => 8.8152, std.dev.: 0.0228) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.99% (1.2423 => 1.2670, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.90% (1.2526 => 1.2764, std.dev.: 0.0072) MultiSource/Benchmarks/Bullet/bullet: 1.52% (31.8598 => 32.3434, std.dev.: 0.0880) MultiSource/Benchmarks/PAQ8p/paq8p: 1.36% (2.3764 => 2.4088, std.dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.71% (1.5795 => 2.5069, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.48% (2.7978 => 3.7346, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 20.45% (0.0528 => 0.0636, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.08% (2.4333 => 2.7029, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.98% (0.3186 => 0.3472, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.62% (1.1857 => 1.2760, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 5.93% (63.1822 => 66.9299, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.33% (44.5605 => 46.0427, std.dev.: 0.2385) MultiSource/Applications/siod/siod: 2.82% (3.6643 => 3.7676, std.dev.: 0.0317) SingleSource/Benchmarks/Shootout-C++/hash: 2.30% (0.6205 => 0.6348, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/bh/bh: 2.11% (2.3560 => 2.4056, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/ReedSolomon: 1.94% (8.5322 => 8.6981, std.dev.: 0.0473) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.14% (4.8362 => 4.8912, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/richards_benchmark: 1.00% (1.3037 => 1.3168, std.dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.37% (0.3269 => 0.3028, std.dev.: 0.0007) MultiSource/Applications/lua/lua: -5.21% (29.8330 => 28.2777, std.dev.: 0.2914) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.06% (7.2130 => 6.9205, std.dev.: 0.0380) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.60% (2.6356 => 2.5672, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.09% (22.2997 => 21.8329, std.dev.: 0.1484) SingleSource/Benchmarks/Shootout-C++/hash2: -1.46% (3.4237 => 3.3736, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.23% (3.3479 => 3.3066, std.dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.58% (16.4461 => 16.7065, std.dev.: 0.2682) MultiSource/Applications/obsequi/Obsequi: 4.59% (1.0262 => 1.0733, std.dev.: 0.0120) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6849.70% (0.3123 => 21.7039, std.dev.: 0.2315) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.60% (0.2463 => 0.3660, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/bigfib: 0.75% (0.6010 => 0.6055, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.45% (0.3266 => 0.3346, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 2.59% (0.1969 => 0.2020, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 46.34% (0.0123 => 0.0180, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.68% (0.0408 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 2.78% (0.0180 => 0.0185, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1438 => 0.1437, std.dev.: 0.0036) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.47% (1.1329 => 1.1495, std.dev.: 0.0048) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.69% (0.1462 => 0.1516, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.74% (0.4164 => 0.4050, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.70% (0.1369 => 0.1332, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.28% (0.0641 => 0.0620, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 39.49% (0.0195 => 0.0272, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.90% (0.0578 => 0.0589, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.06% (1.1437 => 1.1430, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2800.00% (0.0001 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.80% (0.0627 => 0.0622, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 17.22% (0.0180 => 0.0211, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.01% (0.8017 => 0.8016, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -8.06% (0.0062 => 0.0057, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 16:15:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 18:15:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121101231538.80A592A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5507?compare_to=5504&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5507, Order: 167249, Start Time: 2012-11-01 21:50:29, End Time: 2012-11-01 23:15:41 To: 5504, Order: 167243, Start Time: 2012-11-01 20:02:16, End Time: 2012-11-01 21:27:23 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (176 on baseline) Unchanged Tests: 1041 (860 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.47% (54.5866 => 56.4817, std.dev.: 0.1456) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.15% (3.1919 => 3.4202, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.49% (54.5751 => 56.4817, std.dev.: 0.1456) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.65% (2.0478 => 2.1020, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/salsa20: 2.55% (7.4937 => 7.6845, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/hash2: 2.28% (3.1932 => 3.2659, std.dev.: 0.0089) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.25% (0.1431 => 0.1313, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.21% (0.1584 => 0.1454, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.51% (0.3821 => 0.3534, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -7.03% (2.4924 => 2.3172, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.47% (0.2428 => 0.2271, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.33% (0.3142 => 0.2943, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.10% (0.3658 => 0.3435, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.09% (0.9542 => 0.8961, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.90% (4.5069 => 4.2408, std.dev.: 0.0132) MultiSource/Applications/JM/ldecod/ldecod: -5.87% (7.0961 => 6.6793, std.dev.: 0.0102) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.84% (22.4056 => 21.0967, std.dev.: 0.0111) MultiSource/Applications/JM/lencod/lencod: -5.82% (16.1920 => 15.2492, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: -5.79% (0.2160 => 0.2035, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.79% (3.5339 => 3.3294, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.77% (0.2355 => 0.2219, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.74% (0.6484 => 0.6112, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -5.72% (0.3357 => 0.3165, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.68% (0.9852 => 0.9292, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/08-main/main: -5.60% (0.2659 => 0.2510, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -5.57% (4.3330 => 4.0917, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.54% (4.0323 => 3.8089, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.52% (0.7198 => 0.6801, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.50% (1.0544 => 0.9964, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: -5.47% (1.2515 => 1.1831, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.46% (4.8161 => 4.5530, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.42% (0.2548 => 0.2410, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.38% (4.8802 => 4.6175, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.34% (0.7919 => 0.7496, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.33% (1.6474 => 1.5596, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.31% (1.2784 => 1.2105, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.27% (0.5999 => 0.5683, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -5.27% (34.0927 => 32.2973, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.25% (0.4151 => 0.3933, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -5.23% (2.4021 => 2.2764, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: -5.22% (1.3148 => 1.2462, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.21% (14.2083 => 13.4679, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/methcall: -5.19% (0.3025 => 0.2868, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.18% (5.4682 => 5.1850, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: -5.17% (0.3812 => 0.3615, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -5.15% (0.9179 => 0.8706, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -5.12% (0.3831 => 0.3635, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.11% (1.2300 => 1.1672, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: -5.10% (0.3880 => 0.3682, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -5.09% (9.2283 => 8.7584, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.09% (0.3891 => 0.3693, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.09% (0.3323 => 0.3154, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.08% (0.3837 => 0.3642, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -5.08% (0.4176 => 0.3964, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -5.06% (0.4033 => 0.3829, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -5.06% (0.3026 => 0.2873, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -5.05% (0.2989 => 0.2838, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.03% (1.6364 => 1.5541, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.02% (0.4321 => 0.4104, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -5.02% (4.0594 => 3.8556, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.01% (1.3722 => 1.3034, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.01% (1.4642 => 1.3908, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/synchronized: -5.01% (0.3896 => 0.3701, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -5.00% (1.1450 => 1.0877, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: -4.99% (0.3446 => 0.3274, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.99% (0.3848 => 0.3656, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.99% (0.8521 => 0.8096, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.96% (0.2903 => 0.2759, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -4.96% (0.2985 => 0.2837, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: -4.95% (0.3194 => 0.3036, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.94% (0.3884 => 0.3692, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.94% (0.3057 => 0.2906, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.94% (0.3483 => 0.3311, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -4.93% (0.2939 => 0.2794, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.93% (0.4199 => 0.3992, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.92% (2.1713 => 2.0645, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: -4.90% (0.3059 => 0.2909, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -4.90% (17.1032 => 16.2650, std.dev.: 0.0214) SingleSource/Benchmarks/Shootout-C++/wc: -4.90% (0.3205 => 0.3048, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.89% (0.6293 => 0.5985, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -4.88% (0.3481 => 0.3311, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.87% (0.2278 => 0.2167, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.85% (6.7716 => 6.4433, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.83% (0.3849 => 0.3663, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.83% (0.3252 => 0.3095, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.83% (2.2587 => 2.1497, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: -4.81% (0.2849 => 0.2712, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.79% (1.2210 => 1.1625, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: -4.79% (0.4280 => 0.4075, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/bigfib: -4.79% (0.6750 => 0.6427, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/hash2: -4.77% (0.4861 => 0.4629, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -4.76% (0.4248 => 0.4046, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -4.75% (0.7982 => 0.7603, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -4.74% (0.3394 => 0.3233, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: -4.74% (18.2933 => 17.4265, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.71% (0.3016 => 0.2874, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -4.70% (0.2871 => 0.2736, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.70% (0.2999 => 0.2858, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.69% (1.2221 => 1.1648, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.68% (0.4427 => 0.4220, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.62% (0.5581 => 0.5323, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.61% (0.5591 => 0.5333, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -4.61% (0.3255 => 0.3105, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: -4.61% (0.7447 => 0.7104, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: -4.60% (0.3867 => 0.3689, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.60% (0.4916 => 0.4690, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.58% (0.6260 => 0.5973, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.58% (0.4083 => 0.3896, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -4.57% (0.3788 => 0.3615, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.56% (0.6230 => 0.5946, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.55% (0.6681 => 0.6377, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.55% (0.4813 => 0.4594, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.54% (0.5575 => 0.5322, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -4.50% (0.3621 => 0.3458, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.49% (0.5859 => 0.5596, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.47% (0.5925 => 0.5660, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -4.47% (0.4524 => 0.4322, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.46% (0.5857 => 0.5596, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.45% (0.7524 => 0.7189, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: -4.45% (0.4515 => 0.4314, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.45% (0.3931 => 0.3756, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.44% (0.6660 => 0.6364, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.43% (0.3406 => 0.3255, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.43% (0.3319 => 0.3172, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.43% (0.6304 => 0.6025, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.42% (0.6676 => 0.6381, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.41% (0.6194 => 0.5921, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.39% (0.6189 => 0.5917, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.39% (0.5849 => 0.5592, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.39% (0.5805 => 0.5550, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.39% (0.7339 => 0.7017, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.38% (0.6440 => 0.6158, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: -4.37% (0.3271 => 0.3128, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.35% (0.6667 => 0.6377, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.35% (0.5567 => 0.5325, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.34% (0.2695 => 0.2578, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.33% (0.2933 => 0.2806, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -4.33% (0.3581 => 0.3426, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: -4.32% (15.5079 => 14.8376, std.dev.: 0.0042) MultiSource/Applications/treecc/treecc: -4.32% (2.1401 => 2.0477, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.31% (0.5802 => 0.5552, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.31% (0.5456 => 0.5221, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.31% (0.6736 => 0.6446, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.30% (0.5863 => 0.5611, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.28% (0.6033 => 0.5775, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.27% (0.5570 => 0.5332, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.27% (0.6446 => 0.6171, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.26% (0.6052 => 0.5794, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.26% (8.0126 => 7.6714, std.dev.: 0.0080) MultiSource/Applications/SIBsim4/SIBsim4: -4.26% (1.3864 => 1.3274, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.25% (0.9557 => 0.9151, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.22% (0.5941 => 0.5690, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.21% (0.3491 => 0.3344, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.21% (0.6395 => 0.6126, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.17% (0.5705 => 0.5467, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.16% (0.6297 => 0.6035, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.15% (0.5688 => 0.5452, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.15% (0.5569 => 0.5338, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.05% (0.6395 => 0.6136, std.dev.: 0.0056) MultiSource/Applications/spiff/spiff: -4.03% (0.8418 => 0.8079, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.97% (0.7021 => 0.6742, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -3.93% (3.5154 => 3.3772, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.86% (5.0226 => 4.8285, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -3.80% (15.2527 => 14.6734, std.dev.: 0.0096) MultiSource/Benchmarks/nbench/nbench: -3.65% (1.1530 => 1.1109, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference: -3.63% (0.7779 => 0.7497, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.62% (0.5168 => 0.4981, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: -3.59% (1.5610 => 1.5050, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/Hello: -3.50% (0.6347 => 0.6125, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -3.48% (0.6441 => 0.6217, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.42% (0.5329 => 0.5147, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.05% (0.9077 => 0.8800, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -2.39% (20.7746 => 20.2784, std.dev.: 0.0325) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7510, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -8.61% (1.2842 => 1.1736) SingleSource/Benchmarks/Misc/fbench: -3.94% (2.2633 => 2.1741, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.06% (1.0557 => 1.0234, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.84% (1.3096 => 1.2724, std.dev.: 0.0103) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4682, std.dev.: 0.0025) Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 17:37:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 19:37:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121102003744.BE6B52A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5508?compare_to=5502&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5508, Order: 167249, Start Time: 2012-11-01 21:21:50, End Time: 2012-11-02 00:37:47 To: 5502, Order: 167232, Start Time: 2012-11-01 17:17:46, End Time: 2012-11-01 20:33:12 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (169 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1042 (721 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.36% (0.0625 => 0.0871, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.95% (0.1063 => 0.1392) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.50% (0.2969 => 0.3726, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.18% (0.4253 => 0.5324, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.05% (0.1106 => 0.1383, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 23.94% (0.4139 => 0.5130, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.40% (0.0547 => 0.0675, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.39% (0.0714 => 0.0881, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.10% (0.5900 => 0.7263, std.dev.: 0.0051) MultiSource/Applications/oggenc/oggenc: 23.00% (1.5932 => 1.9596, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.95% (0.4994 => 0.6140, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.74% (0.0475 => 0.0583, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.09% (0.0584 => 0.0713, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.06% (0.5000 => 0.6103, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.63% (0.0897 => 0.1091, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.54% (0.1620 => 0.1969, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/tsp/tsp: 21.20% (0.0599 => 0.0726, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.16% (0.1021 => 0.1237, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.87% (0.1107 => 0.1338, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 20.20% (0.1619 => 0.1946, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.96% (0.0541 => 0.0649, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 19.94% (0.0948 => 0.1137, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.91% (0.0633 => 0.0759, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.86% (0.0584 => 0.0700, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.78% (0.0642 => 0.0769, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.78% (0.3903 => 0.4675, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.67% (0.1103 => 0.1320, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 19.61% (0.0821 => 0.0982) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.24% (0.1003 => 0.1196, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.17% (0.1549 => 0.1846, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.10% (0.0822 => 0.0979, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 18.95% (0.1604 => 0.1908, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 18.06% (0.0947 => 0.1118, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.99% (0.1462 => 0.1725, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.89% (0.3890 => 0.4586, std.dev.: 0.0054) SingleSource/UnitTests/ObjC++/Hello: 17.71% (0.5826 => 0.6858, std.dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 17.57% (0.0808 => 0.0950, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 17.49% (0.1218 => 0.1431, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.43% (0.2014 => 0.2365, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 17.34% (0.5889 => 0.6910, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.32% (1.3152 => 1.5430, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.29% (0.2736 => 0.3209, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 17.05% (0.0698 => 0.0817, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 17.03% (0.4029 => 0.4715, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.00% (0.1088 => 0.1273, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 16.94% (0.1505 => 0.1760, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.90% (0.2875 => 0.3361, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.58% (0.2738 => 0.3192, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 16.55% (0.5546 => 0.6464, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.54% (0.2866 => 0.3340, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 16.44% (0.2823 => 0.3287, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.40% (3.5627 => 4.1470, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 16.34% (1.8794 => 2.1865, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.12% (0.1160 => 0.1347, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 15.99% (0.2714 => 0.3148, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.96% (0.1968 => 0.2282, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 15.93% (0.2725 => 0.3159, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 15.81% (0.3004 => 0.3479, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/matrix: 15.79% (0.2780 => 0.3219, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.78% (0.5026 => 0.5819, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 15.76% (0.1421 => 0.1645, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.75% (1.6211 => 1.8765, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.74% (0.3271 => 0.3786, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 15.71% (0.4658 => 0.5390, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 15.71% (0.2813 => 0.3255, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.71% (0.3195 => 0.3697, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 15.71% (0.2750 => 0.3182, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 15.71% (0.9697 => 1.1220, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.68% (0.2729 => 0.3157, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.58% (0.2792 => 0.3227, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/random: 15.55% (0.2803 => 0.3239, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 15.55% (0.2811 => 0.3248, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 15.54% (0.3096 => 0.3577, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 15.53% (0.7171 => 0.8285, std.dev.: 0.0033) MultiSource/Applications/d/make_dparser: 15.43% (1.0781 => 1.2445, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.42% (0.2911 => 0.3360, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 15.38% (0.9909 => 1.1433, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.36% (2.0673 => 2.3849, std.dev.: 0.0066) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.31% (2.7292 => 3.1471, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.27% (0.4361 => 0.5027, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.19% (4.4195 => 5.0909, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: 15.19% (0.1284 => 0.1479, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 15.00% (0.3267 => 0.3757, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 14.90% (0.3477 => 0.3995, std.dev.: 0.0066) MultiSource/Benchmarks/Bullet/bullet: 14.89% (23.5202 => 27.0219, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ary: 14.89% (0.3258 => 0.3743, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.86% (0.3930 => 0.4514, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 14.80% (0.3317 => 0.3808, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.78% (0.3282 => 0.3767, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.75% (1.9694 => 2.2599, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 14.71% (4.2109 => 4.8302, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.71% (0.3060 => 0.3510, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.63% (0.3362 => 0.3854, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.56% (1.9966 => 2.2874, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.37% (0.3124 => 0.3573, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.37% (0.3625 => 0.4146, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.22% (0.1090 => 0.1245, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 14.22% (0.3348 => 0.3824, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 14.11% (0.3678 => 0.4197, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 13.96% (0.3726 => 0.4246, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 13.74% (0.3465 => 0.3941, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 13.73% (0.2075 => 0.2360, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 13.73% (0.3496 => 0.3976, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.73% (0.3446 => 0.3919, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 13.71% (0.4251 => 0.4834, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/synchronized: 13.66% (0.3469 => 0.3943, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.65% (0.3488 => 0.3964, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash: 13.60% (0.4146 => 0.4710, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 13.58% (0.3460 => 0.3930, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.56% (0.3981 => 0.4521, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.54% (0.3442 => 0.3908, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.50% (0.3690 => 0.4188, std.dev.: 0.0115) MultiSource/Benchmarks/nbench/nbench: 13.48% (0.2566 => 0.2912, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.34% (0.3845 => 0.4358, std.dev.: 0.0090) MultiSource/Applications/lua/lua: 13.32% (1.4269 => 1.6170, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/property: 13.32% (0.3650 => 0.4136, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 13.20% (0.3643 => 0.4124, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.00% (0.3724 => 0.4208, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 12.77% (0.7875 => 0.8881, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 12.77% (2.1653 => 2.4419, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: 12.77% (0.5012 => 0.5652, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 12.34% (4.6177 => 5.1876, std.dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 12.20% (2.1013 => 2.3577, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.84% (0.6435 => 0.7197, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.56% (0.2068 => 0.2307, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 11.26% (0.2691 => 0.2994, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.23% (0.2040 => 0.2269, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11.18% (5.5417 => 6.1613, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.56% (0.2737 => 0.3026, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 10.49% (0.3498 => 0.3865, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.41% (0.1028 => 0.1135, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.25% (0.3084 => 0.3400, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 10.17% (0.6634 => 0.7309, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 9.99% (0.4847 => 0.5331, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.98% (0.1383 => 0.1521, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 9.86% (0.3336 => 0.3665, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.08% (0.2103 => 0.2294, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 8.97% (2.0346 => 2.2172, std.dev.: 0.0189) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.57% (4.6926 => 5.0946, std.dev.: 0.0216) MultiSource/Applications/lemon/lemon: 8.49% (0.2391 => 0.2594, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.38% (11.6398 => 12.6156, std.dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.70% (0.5361 => 0.5774, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.24% (0.7426 => 0.7964, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.04% (0.5584 => 0.5977, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: 6.56% (11.9555 => 12.7399, std.dev.: 0.0109) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.38% (0.3792 => 0.3958, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.41% (0.2162 => 0.3533, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6537, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 8.35% (0.2802 => 0.3036, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6102, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/objinst: 5.10% (12.0509 => 12.6658, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1707, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-2: 4.27% (1.8057 => 1.8828, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.01% (0.3693 => 0.3841, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/dry: 2.63% (14.0481 => 14.4179, std.dev.: 0.0475) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2009, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.79% (3.1722 => 3.2289, std.dev.: 0.0026) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3056, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2868, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.23% (1.0142 => 1.0267, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 1.09% (50.0626 => 50.6073, std.dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.64% (25.4195 => 16.3606, std.dev.: 0.0511) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9766, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: -7.67% (35.5013 => 32.7766, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary2: -7.41% (0.2402 => 0.2224, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: -7.20% (2.1113 => 1.9592, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.51% (11.2080 => 10.8145, std.dev.: 0.0290) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.02% (0.6293 => 0.6103, std.dev.: 0.0052) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: -2.90% (3.6262 => 3.5209, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: -2.36% (17.2379 => 16.8312, std.dev.: 0.0129) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8698, std.dev.: 0.0142) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5763, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: -1.55% (5.5810 => 5.4945, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.32% (5.7935 => 5.7169, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1468, std.dev.: 0.0403) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.07% (3.3991 => 3.3626, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0455, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 17:38:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 19:38:12 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121102003812.D80B32A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5509?compare_to=5506&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5509, Order: 167261, Start Time: 2012-11-01 23:11:04, End Time: 2012-11-02 00:38:16 To: 5506, Order: 167249, Start Time: 2012-11-01 21:26:49, End Time: 2012-11-01 22:53:54 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 23 (102 on baseline) Performance Improvements: 2 (4 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 966 (868 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.68% (0.5961 => 0.6419, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.69% (0.2988 => 0.3188, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.55% (0.3192 => 0.3401, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.46% (0.3281 => 0.3460, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.42% (0.9391 => 0.9900, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.15% (0.2272 => 0.2389, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.62% (0.5762 => 0.6028, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.26% (0.6314 => 0.6583, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.18% (0.8588 => 0.8947, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.96% (1.1876 => 1.2228, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.70% (1.1349 => 1.1655, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.31% (4.5093 => 4.6136, std.dev.: 0.0197) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.87% (1.1994 => 1.2218, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.62% (4.2234 => 4.2919, std.dev.: 0.0242) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.57% (4.5327 => 4.6038, std.dev.: 0.0188) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.45% (8.8501 => 8.9784, std.dev.: 0.0295) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.42% (4.6177 => 4.6834, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.12% (1.3631 => 1.3784, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.01% (13.8004 => 15.8721, std.dev.: 0.4849) MultiSource/Benchmarks/nbench/nbench: 6.76% (20.8833 => 22.2943, std.dev.: 0.3760) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.81% (0.7570 => 0.7934, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/richards_benchmark: 1.64% (1.3168 => 1.3384, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.12% (3.1971 => 3.2329, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.32% (2.2193 => 2.1901, std.dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/methcall: -1.07% (8.2765 => 8.1876, std.dev.: 0.0301) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.40% (16.7065 => 16.7741, std.dev.: 0.1116) MultiSource/Applications/obsequi/Obsequi: -1.11% (1.0733 => 1.0614, std.dev.: 0.0141) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.17% (21.7039 => 21.7415, std.dev.: 0.5532) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.25% (0.3660 => 0.3669, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/bigfib: 0.20% (0.6055 => 0.6067, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.30% (0.3346 => 0.3336, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/strcat: -0.69% (0.2020 => 0.2006, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.78% (0.0180 => 0.0185, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.18% (0.0423 => 0.0428, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.90% (0.0332 => 0.0329, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -16.99% (0.0312 => 0.0259, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.71% (0.0422 => 0.0425, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0204 => 0.0204, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: 5.41% (0.0185 => 0.0195, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.23% (0.1437 => 0.1469, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: 1.93% (1.1495 => 1.1717, std.dev.: 0.0031) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -6.00% (0.1516 => 0.1425, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.64% (0.4050 => 0.4319, std.dev.: 0.0332) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.65% (0.1332 => 0.1354, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.55% (0.0620 => 0.0567, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.25% (0.0272 => 0.0255, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.68% (0.0589 => 0.0585, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.17% (1.1430 => 1.1450, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.55% (0.0029 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 600.00% (0.0001 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.34% (0.0622 => 0.0649, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.01% (0.0211 => 0.0173, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.14% (0.8016 => 0.8005, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -10.53% (0.0057 => 0.0051, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2320.94% (0.6332 => 15.3294, std.dev.: 0.0560) MultiSource/Benchmarks/McCat/08-main/main: 47.13% (0.1831 => 0.2694, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.45% (0.1559 => 0.1474, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1487.68% (0.3344 => 5.3092, std.dev.: 0.0424) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.14% (0.2364 => 0.3242, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0429 => 0.0439, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0224 => 0.0224, std.dev.: 0.0029) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3589, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0698, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4939, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3521, std.dev.: 0.0154) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0237, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4095, std.dev.: 0.0054) SingleSource/Regression/C/uint64_to_float: -24.11% (2.1832 => 1.6569, std.dev.: 0.0089) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.94% (0.0810 => 0.0931, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 12.95% (0.1112 => 0.1256, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.82% (0.1157 => 0.1259, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.42% (0.3137 => 0.3401, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.03% (0.1905 => 0.2058, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.94% (0.2180 => 0.2353, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.72% (0.1983 => 0.2136, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.52% (0.8321 => 0.8947, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.37% (0.2279 => 0.2447, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.04% (0.8148 => 0.8722, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.02% (0.1425 => 0.1525, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.81% (0.6010 => 0.6419, std.dev.: 0.0101) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.68% (0.1885 => 0.2011, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.65% (0.2240 => 0.2389, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.46% (0.7473 => 0.7956, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.16% (0.3003 => 0.3188, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.90% (0.2998 => 0.3175, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.37% (0.4783 => 0.5040, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.27% (1.1606 => 1.2218, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.01% (0.3295 => 0.3460, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.93% (0.9435 => 0.9900, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.71% (0.6287 => 0.6583, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.65% (1.1685 => 1.2228, std.dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 4.49% (1.1271 => 1.1777, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.43% (0.7966 => 0.8319, std.dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.34% (1.1170 => 1.1655, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.16% (0.2741 => 0.2855, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.14% (0.6227 => 0.6485, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.95% (0.4559 => 0.4739, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.83% (8.6476 => 8.9784, std.dev.: 0.0295) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.82% (6.6074 => 6.8595, std.dev.: 0.0424) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.80% (1.3279 => 1.3784, std.dev.: 0.0027) MultiSource/Applications/treecc/treecc: 3.79% (1.9948 => 2.0704, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.78% (0.4127 => 0.4283, std.dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 3.67% (1.2568 => 1.3029, std.dev.: 0.0131) MultiSource/Applications/sgefa/sgefa: 3.67% (0.2999 => 0.3109, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.63% (0.5817 => 0.6028, std.dev.: 0.0053) MultiSource/Applications/ClamAV/clamscan: 3.61% (14.7684 => 15.3020, std.dev.: 0.1993) MultiSource/Applications/d/make_dparser: 3.57% (3.2366 => 3.3522, std.dev.: 0.0447) MultiSource/Applications/Burg/burg: 3.56% (1.2222 => 1.2657, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.47% (0.5961 => 0.6168, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/18-imp/imp: 3.43% (0.3503 => 0.3623, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 3.37% (0.8927 => 0.9228, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.35% (0.8805 => 0.9100, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.32% (0.8656 => 0.8943, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.31% (0.9074 => 0.9374, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.30% (0.8007 => 0.8271, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.26% (0.8331 => 0.8603, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/05-eks/eks: 3.25% (0.4397 => 0.4540, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.19% (0.8716 => 0.8994, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.11% (0.8204 => 0.8459, std.dev.: 0.0065) MultiSource/Applications/SPASS/SPASS: 3.06% (14.2605 => 14.6973, std.dev.: 0.1155) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.03% (0.8611 => 0.8872, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.02% (0.6586 => 0.6785, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 2.98% (3.8189 => 3.9326, std.dev.: 0.0366) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.97% (0.5191 => 0.5345, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.93% (0.8317 => 0.8561, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.83% (0.8855 => 0.9106, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.81% (4.4873 => 4.6136, std.dev.: 0.0197) MultiSource/Applications/minisat/minisat: 2.81% (0.6834 => 0.7026, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.77% (4.1763 => 4.2919, std.dev.: 0.0242) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.76% (0.8286 => 0.8515, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.71% (0.8086 => 0.8305, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.70% (0.8597 => 0.8829, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.70% (0.8457 => 0.8685, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.69% (0.9688 => 0.9949, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.69% (0.8316 => 0.8540, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.64% (0.8518 => 0.8743, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/football/football: 2.62% (0.8768 => 0.8998, std.dev.: 0.0056) MultiSource/Applications/lemon/lemon: 2.61% (1.0945 => 1.1231, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.58% (4.4880 => 4.6038, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.57% (0.7932 => 0.8136, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.57% (0.8340 => 0.8554, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 2.52% (4.1305 => 4.2346, std.dev.: 0.0312) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.48% (4.5702 => 4.6834, std.dev.: 0.0101) MultiSource/Applications/oggenc/oggenc: 2.45% (4.9628 => 5.0842, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.38% (1.4479 => 1.4823, std.dev.: 0.0114) MultiSource/Applications/siod/siod: 2.36% (2.2184 => 2.2707, std.dev.: 0.0071) MultiSource/Applications/JM/lencod/lencod: 2.34% (15.3280 => 15.6865, std.dev.: 0.0545) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.34% (2.1401 => 2.1901, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.29% (0.8066 => 0.8251, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.11% (13.1811 => 13.4590, std.dev.: 0.0969) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.02% (3.1832 => 3.2475, std.dev.: 0.0192) MultiSource/Applications/lambda-0_1_3/lambda: 2.01% (0.7557 => 0.7709, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.95% (1.2526 => 1.2770, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.65% (1.2602 => 1.2810, std.dev.: 0.0055) MultiSource/Benchmarks/PAQ8p/paq8p: 1.33% (2.3764 => 2.4080, std.dev.: 0.0118) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 57.49% (1.5795 => 2.4875, std.dev.: 0.0153) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.22% (2.7978 => 3.7272, std.dev.: 0.0101) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.03% (2.4333 => 2.6774, std.dev.: 0.0349) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.76% (0.3186 => 0.3497, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.09% (1.1857 => 1.2816, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 6.00% (63.1822 => 66.9760, std.dev.: 0.2355) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.44% (0.7597 => 0.7934, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.79% (44.5605 => 45.8016, std.dev.: 0.1719) SingleSource/Benchmarks/Misc/richards_benchmark: 2.66% (1.3037 => 1.3384, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 2.58% (3.6643 => 3.7587, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hash: 2.39% (0.6205 => 0.6353, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.06% (2.4490 => 2.4995, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/ReedSolomon: 1.93% (8.5322 => 8.6967, std.dev.: 0.0521) MultiSource/Benchmarks/Olden/bh/bh: 1.87% (2.3560 => 2.4001, std.dev.: 0.0069) MultiSource/Applications/minisat/minisat: 1.58% (6.1525 => 6.2496, std.dev.: 0.0324) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.11% (0.3269 => 0.3004, std.dev.: 0.0016) MultiSource/Applications/lua/lua: -5.00% (29.8330 => 28.3407, std.dev.: 0.1819) SingleSource/Benchmarks/Shootout-C++/hash2: -1.51% (3.4237 => 3.3721, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.28% (3.3479 => 3.3051, std.dev.: 0.0020) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.99% (16.4461 => 16.7741, std.dev.: 0.1116) MultiSource/Applications/obsequi/Obsequi: 3.43% (1.0262 => 1.0614, std.dev.: 0.0141) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6861.74% (0.3123 => 21.7415, std.dev.: 0.5532) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.96% (0.2463 => 0.3669, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/bigfib: 0.95% (0.6010 => 0.6067, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.14% (0.3266 => 0.3336, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/strcat: 1.88% (0.1969 => 0.2006, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 50.41% (0.0123 => 0.0185, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.53% (0.0254 => 0.0329, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -14.24% (0.0302 => 0.0259, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: 8.33% (0.0180 => 0.0195, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.16% (0.1438 => 0.1469, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: 3.42% (1.1329 => 1.1717, std.dev.: 0.0031) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -2.53% (0.1462 => 0.1425, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.72% (0.4164 => 0.4319, std.dev.: 0.0332) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.10% (0.1369 => 0.1354, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.54% (0.0641 => 0.0567, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 30.77% (0.0195 => 0.0255, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.21% (0.0578 => 0.0585, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.11% (1.1437 => 1.1450, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0014 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.51% (0.0627 => 0.0649, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.89% (0.0180 => 0.0173, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.15% (0.8017 => 0.8005, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -17.74% (0.0062 => 0.0051, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 18:03:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 20:03:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121102010358.B117A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5510?compare_to=5507&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5510, Order: 167261, Start Time: 2012-11-01 23:38:58, End Time: 2012-11-02 01:04:00 To: 5507, Order: 167249, Start Time: 2012-11-01 21:50:29, End Time: 2012-11-01 23:15:41 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (6 on baseline) Performance Improvements: 0 (174 on baseline) Unchanged Tests: 1040 (862 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.05% (1.5050 => 1.5208, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.03% (2.0645 => 2.0857, std.dev.: 0.0080) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.29% (1.2783 => 1.3715, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.15% (3.1919 => 3.4200, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.58% (54.5751 => 56.5291, std.dev.: 0.0572) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1013, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/salsa20: 2.60% (7.4937 => 7.6884, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/hash2: 2.33% (3.1932 => 3.2677, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.52% (0.1584 => 0.1449, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.11% (0.1431 => 0.1315, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.51% (0.3821 => 0.3534, std.dev.: 0.0038) MultiSource/Benchmarks/PAQ8p/paq8p: -6.78% (2.4924 => 2.3234, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.18% (0.2428 => 0.2278, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.17% (0.3142 => 0.2948, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.02% (0.9542 => 0.8968, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -5.96% (0.1879 => 0.1767, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.90% (0.3658 => 0.3442, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.79% (4.5069 => 4.2461, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.75% (3.5339 => 3.3307, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/oourafft: -5.74% (0.2160 => 0.2036, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.74% (22.4056 => 21.1200, std.dev.: 0.0128) MultiSource/Applications/JM/ldecod/ldecod: -5.72% (7.0961 => 6.6904, std.dev.: 0.0112) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.69% (0.2355 => 0.2221, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -5.69% (0.3357 => 0.3166, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: -5.67% (16.1920 => 15.2739, std.dev.: 0.0129) MultiSource/Benchmarks/MallocBench/gs/gs: -5.67% (4.3330 => 4.0875, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions-2: -5.53% (0.3831 => 0.3619, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -5.53% (0.2659 => 0.2512, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: -5.52% (0.3880 => 0.3666, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.51% (0.9852 => 0.9309, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/trivial-interface: -5.51% (0.3812 => 0.3602, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.50% (0.4033 => 0.3811, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.48% (0.6484 => 0.6129, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.47% (0.3891 => 0.3678, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.46% (0.3848 => 0.3638, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -5.44% (0.3896 => 0.3684, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.44% (4.0323 => 3.8130, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/exceptions: -5.41% (0.4176 => 0.3950, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.41% (0.3884 => 0.3674, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: -5.38% (1.2515 => 1.1842, std.dev.: 0.0031) MultiSource/Applications/siod/siod: -5.35% (2.4021 => 2.2736, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.34% (4.8161 => 4.5590, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.34% (0.2548 => 0.2412, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.31% (1.2784 => 1.2105, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: -5.29% (0.4199 => 0.3977, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.26% (1.0544 => 0.9989, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.24% (0.7919 => 0.7504, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.21% (4.8802 => 4.6259, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.15% (0.5999 => 0.5690, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.11% (1.6474 => 1.5633, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: -5.07% (0.4280 => 0.4063, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.02% (14.2083 => 13.4956, std.dev.: 0.0090) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.01% (0.8521 => 0.8094, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: -5.00% (0.9179 => 0.8720, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -4.98% (9.2283 => 8.7691, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.97% (5.4682 => 5.1964, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.96% (1.2300 => 1.1690, std.dev.: 0.0021) MultiSource/Applications/lua/lua: -4.94% (4.0594 => 3.8590, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.92% (1.3722 => 1.3047, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -4.92% (34.0927 => 32.4166, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: -4.86% (17.1032 => 16.2718, std.dev.: 0.0177) MultiSource/Applications/lemon/lemon: -4.86% (1.1450 => 1.0894, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.85% (0.3483 => 0.3314, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.84% (1.6364 => 1.5572, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.81% (0.7198 => 0.6852, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.79% (1.4642 => 1.3940, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: -4.79% (0.2985 => 0.2842, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.74% (6.7716 => 6.4504, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.74% (1.2221 => 1.1642, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.74% (0.6293 => 0.5995, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.70% (0.2999 => 0.2858, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.64% (1.2210 => 1.1644, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -4.62% (0.7982 => 0.7613, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: -4.59% (18.2933 => 17.4545, std.dev.: 0.0101) MultiSource/Benchmarks/McCat/05-eks/eks: -4.58% (0.4515 => 0.4308, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: -4.52% (0.3581 => 0.3419, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.51% (2.2587 => 2.1568, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.49% (0.6230 => 0.5950, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -4.49% (0.7447 => 0.7113, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.47% (0.5478 => 0.5233, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.47% (0.7339 => 0.7011, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.46% (0.3406 => 0.3254, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.46% (0.5581 => 0.5332, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -4.45% (1.3148 => 1.2563, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.41% (0.6194 => 0.5921, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.39% (0.4916 => 0.4700, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.38% (0.2695 => 0.2577, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.37% (0.6681 => 0.6389, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.36% (0.6676 => 0.6385, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.35% (0.5925 => 0.5667, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.35% (0.5591 => 0.5348, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -4.34% (0.6750 => 0.6457, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.33% (0.5863 => 0.5609, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.33% (0.5456 => 0.5220, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.31% (0.6304 => 0.6032, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.31% (0.6736 => 0.6446, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.30% (0.5575 => 0.5335, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.30% (0.6667 => 0.6380, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.30% (0.4321 => 0.4135, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.30% (0.3837 => 0.3672, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.30% (0.6052 => 0.5792, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.29% (0.5849 => 0.5598, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/objinst: -4.29% (0.3194 => 0.3057, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.28% (0.6260 => 0.5992, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.28% (0.6660 => 0.6375, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -4.28% (0.4861 => 0.4653, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -4.26% (0.3025 => 0.2896, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.24% (0.5941 => 0.5689, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.22% (0.5705 => 0.5464, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.22% (0.6440 => 0.6168, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.22% (0.6395 => 0.6125, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.21% (0.3849 => 0.3687, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -4.21% (15.5079 => 14.8557, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.20% (0.5567 => 0.5333, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.20% (0.7524 => 0.7208, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.20% (0.5859 => 0.5613, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -4.20% (2.1401 => 2.0503, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.18% (0.6189 => 0.5930, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.17% (0.5857 => 0.5613, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: -4.16% (1.3864 => 1.3287, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.16% (0.3319 => 0.3181, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: -4.15% (0.2989 => 0.2865, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -4.12% (0.3394 => 0.3254, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -4.12% (0.3446 => 0.3304, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.10% (8.0126 => 7.6841, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.08% (0.5805 => 0.5568, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.08% (0.5570 => 0.5343, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.06% (0.8418 => 0.8076, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.04% (0.3931 => 0.3772, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.04% (0.6033 => 0.5789, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.04% (0.3271 => 0.3139, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.02% (0.3057 => 0.2934, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.02% (0.6446 => 0.6187, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.02% (0.6297 => 0.6044, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.01% (0.3491 => 0.3351, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.00% (0.2903 => 0.2787, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.97% (0.4083 => 0.3921, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.96% (0.6395 => 0.6142, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -3.96% (0.5688 => 0.5463, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -3.96% (0.3059 => 0.2938, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -3.95% (0.4248 => 0.4080, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.94% (0.9557 => 0.9180, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.94% (2.1713 => 2.0857, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.91% (0.3252 => 0.3125, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: -3.90% (0.2871 => 0.2759, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.90% (5.0226 => 4.8269, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: -3.89% (0.4524 => 0.4348, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: -3.88% (0.2939 => 0.2825, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -3.87% (0.3255 => 0.3129, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -3.87% (0.3026 => 0.2909, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.86% (0.4813 => 0.4627, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -3.86% (0.5569 => 0.5354, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -3.81% (3.5154 => 3.3816, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.78% (0.3016 => 0.2902, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -3.76% (0.3481 => 0.3350, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.75% (0.4427 => 0.4261, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -3.72% (0.2849 => 0.2743, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -3.71% (0.3205 => 0.3086, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -3.70% (0.3621 => 0.3487, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.69% (0.7021 => 0.6762, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.66% (0.9077 => 0.8745, std.dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: -3.60% (15.2527 => 14.7041, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists1: -3.59% (0.3867 => 0.3728, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.59% (0.6347 => 0.6119, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: -3.59% (0.3788 => 0.3652, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -3.57% (1.1530 => 1.1118, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.54% (0.5168 => 0.4985, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -3.48% (0.6441 => 0.6217, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.46% (0.3323 => 0.3208, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -3.38% (0.7779 => 0.7516, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.25% (0.5329 => 0.5156, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: -2.58% (1.5610 => 1.5208, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -2.42% (20.7746 => 20.2722, std.dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7529, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/richards_benchmark: -8.63% (1.2842 => 1.1734, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.67% (2.2633 => 2.1802, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.82% (1.3096 => 1.2727, std.dev.: 0.0138) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.78% (6.5735 => 6.4563, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0003) Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 19:22:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 21:22:44 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121102022244.ABE522A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5511?compare_to=5509&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5511, Order: 167266, Start Time: 2012-11-02 00:55:21, End Time: 2012-11-02 02:22:48 To: 5509, Order: 167261, Start Time: 2012-11-01 23:11:04, End Time: 2012-11-02 00:38:16 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 10 (80 on baseline) Performance Improvements: 2 (3 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 979 (891 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.66% (0.5029 => 0.5213, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.31% (0.9083 => 0.9202, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.63% (11.2817 => 11.5785, std.dev.: 0.0090) SingleSource/Benchmarks/CoyoteBench/lpbench: 2.50% (3.9085 => 4.0062, std.dev.: 0.0301) SingleSource/Benchmarks/Shootout/ary3: 1.90% (2.0934 => 2.1332, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.84% (21.8070 => 22.2072, std.dev.: 0.1053) SingleSource/Benchmarks/Shootout-C++/ary3: 1.57% (1.9964 => 2.0278, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.26% (1.4158 => 1.4336, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 1.18% (2.3176 => 2.3450, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.09% (11.4279 => 11.5524, std.dev.: 0.0296) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Ptrdist/bc/bc: -1.76% (1.1655 => 1.1450, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -2.21% (1.3384 => 1.3088, std.dev.: 0.0051) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.44% (16.7741 => 16.6997, std.dev.: 0.0877) MultiSource/Applications/obsequi/Obsequi: 1.00% (1.0614 => 1.0720, std.dev.: 0.0068) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.35% (21.7415 => 21.6644, std.dev.: 0.3895) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.03% (0.3669 => 0.3670, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -0.59% (0.6067 => 0.6031, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.60% (0.3336 => 0.3356, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/strcat: 0.20% (0.2006 => 0.2010, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 19.46% (0.0185 => 0.0221, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0428 => 0.0428, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.52% (0.0329 => 0.0334, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 22.01% (0.0259 => 0.0316, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.24% (0.0425 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0204 => 0.0203, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/test1: 11.79% (0.0195 => 0.0218, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -2.79% (0.1469 => 0.1428, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/lemon/lemon: -5.40% (1.1717 => 1.1084, std.dev.: 0.0576) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 6.53% (0.1425 => 0.1518, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.86% (0.4319 => 0.4109, std.dev.: 0.0303) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.15% (0.1354 => 0.1352, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.41% (0.0567 => 0.0609, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.63% (0.0255 => 0.0277, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.51% (0.0585 => 0.0582, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.69% (1.1450 => 1.1371, std.dev.: 0.0475) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1900.00% (0.0001 => 0.0020, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 271.43% (0.0007 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.31% (0.0649 => 0.0651, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 53.76% (0.0173 => 0.0266, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.84% (0.8005 => 0.7938, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: -85.71% (0.0007 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 37.25% (0.0051 => 0.0070, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2310.75% (0.6332 => 15.2649, std.dev.: 0.2975) MultiSource/Benchmarks/McCat/08-main/main: 48.61% (0.1831 => 0.2721, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.39% (0.1559 => 0.1475, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1483.40% (0.3344 => 5.2949, std.dev.: 0.0248) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.80% (0.2364 => 0.3234, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0429 => 0.0439, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.89% (0.0224 => 0.0222, std.dev.: 0.0008) SingleSource/UnitTests/byval-alignment: -30.87% (0.0230 => 0.0159, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3460, std.dev.: 0.0127) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0728, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4892, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3394, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0293, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4042, std.dev.: 0.0023) SingleSource/Regression/C/uint64_to_float: -24.01% (2.1832 => 1.6591, std.dev.: 0.0056) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.12% (0.0810 => 0.0973, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.85% (0.1157 => 0.1271, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.99% (0.2180 => 0.2376, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.56% (0.2279 => 0.2474, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.47% (0.8321 => 0.9026, std.dev.: 0.0049) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.35% (0.3137 => 0.3399, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.34% (0.6010 => 0.6511, std.dev.: 0.0069) MultiSource/Applications/viterbi/viterbi: 8.12% (0.1577 => 0.1705, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.00% (0.1425 => 0.1539, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.63% (0.7473 => 0.8043, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.55% (0.4847 => 0.5213, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.32% (0.1885 => 0.2023, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.07% (0.2240 => 0.2376, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.88% (1.1606 => 1.2288, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.63% (1.1685 => 1.2343, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.33% (0.6287 => 0.6622, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.31% (0.5817 => 0.6126, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.31% (0.4783 => 0.5037, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.17% (0.9435 => 0.9923, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.17% (0.2998 => 0.3153, std.dev.: 0.0032) MultiSource/Applications/spiff/spiff: 5.16% (0.7950 => 0.8360, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.01% (0.3295 => 0.3460, std.dev.: 0.0022) MultiSource/Applications/Burg/burg: 4.66% (1.2222 => 1.2791, std.dev.: 0.0075) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.1271 => 1.1779, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.33% (0.2519 => 0.2628, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 4.30% (0.2999 => 0.3128, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.26% (8.6476 => 9.0160, std.dev.: 0.0220) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.22% (1.3279 => 1.3839, std.dev.: 0.0077) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.08% (6.6074 => 6.8768, std.dev.: 0.0526) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.05% (0.2741 => 0.2852, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 3.93% (14.7684 => 15.3485, std.dev.: 0.0832) MultiSource/Applications/hbd/hbd: 3.91% (1.4269 => 1.4827, std.dev.: 0.0204) MultiSource/Applications/SIBsim4/SIBsim4: 3.90% (1.2568 => 1.3058, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.86% (0.4559 => 0.4735, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.79% (0.6227 => 0.6463, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: 3.71% (0.4397 => 0.4560, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.66% (0.4127 => 0.4278, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.51% (4.1763 => 4.3230, std.dev.: 0.0503) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.45% (1.6386 => 1.6952, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.35% (0.5191 => 0.5365, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 3.35% (4.1305 => 4.2689, std.dev.: 0.0263) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.04% (1.2602 => 1.2985, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.90% (1.2526 => 1.2889, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.88% (0.8597 => 0.8845, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.84% (4.5702 => 4.7001, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/football/football: 2.79% (0.8768 => 0.9013, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 2.74% (0.4125 => 0.4238, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.73% (4.4873 => 4.6097, std.dev.: 0.0384) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.64% (4.4880 => 4.6067, std.dev.: 0.0150) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.51% (1.1170 => 1.1450, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.45% (0.8340 => 0.8544, std.dev.: 0.0037) MultiSource/Applications/lua/lua: 2.42% (3.8189 => 3.9115, std.dev.: 0.0294) MultiSource/Benchmarks/mafft/pairlocalalign: 2.39% (8.6247 => 8.8307, std.dev.: 0.0506) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.30% (0.8995 => 0.9202, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.25% (0.8518 => 0.8710, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.22% (1.4479 => 1.4800, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.15% (2.1401 => 2.1861, std.dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 2.11% (0.9810 => 1.0017, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.09% (0.8316 => 0.8490, std.dev.: 0.0039) MultiSource/Benchmarks/Bullet/bullet: 2.08% (31.8598 => 32.5238, std.dev.: 0.1976) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.05% (0.8177 => 0.8345, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.03% (0.6586 => 0.6720, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.01% (0.8204 => 0.8369, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.46% (1.5315 => 1.5538, std.dev.: 0.0052) MultiSource/Benchmarks/PAQ8p/paq8p: 1.45% (2.3764 => 2.4109, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.45% (3.1832 => 3.2292, std.dev.: 0.0159) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 57.18% (1.5795 => 2.4827, std.dev.: 0.0150) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.42% (2.7978 => 3.7329, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.72% (2.4333 => 2.6699, std.dev.: 0.0539) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.09% (1.1857 => 1.2816, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.93% (63.1822 => 66.9314, std.dev.: 0.0817) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.29% (2.2485 => 2.3450, std.dev.: 0.0102) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.98% (0.2887 => 0.3002, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 2.72% (3.6643 => 3.7638, std.dev.: 0.0204) SingleSource/Benchmarks/CoyoteBench/lpbench: 2.71% (3.9006 => 4.0062, std.dev.: 0.0301) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.58% (0.4031 => 0.4135, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.01% (2.4490 => 2.4982, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/ary3: 1.83% (2.0949 => 2.1332, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/ReedSolomon: 1.70% (8.5322 => 8.6773, std.dev.: 0.0456) MultiSource/Benchmarks/Olden/bh/bh: 1.60% (2.3560 => 2.3936, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.97% (0.3269 => 0.3041, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -4.99% (29.8330 => 28.3449, std.dev.: 0.0952) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.50% (3.3479 => 3.2976, std.dev.: 0.0047) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.54% (16.4461 => 16.6997, std.dev.: 0.0877) MultiSource/Applications/obsequi/Obsequi: 4.46% (1.0262 => 1.0720, std.dev.: 0.0068) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6837.05% (0.3123 => 21.6644, std.dev.: 0.3895) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.01% (0.2463 => 0.3670, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 0.35% (0.6010 => 0.6031, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.76% (0.3266 => 0.3356, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/strcat: 2.08% (0.1969 => 0.2010, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 79.67% (0.0123 => 0.0221, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.50% (0.0254 => 0.0334, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.70% (0.1438 => 0.1428, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: -2.16% (1.1329 => 1.1084, std.dev.: 0.0576) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 3.83% (0.1462 => 0.1518, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.32% (0.4164 => 0.4109, std.dev.: 0.0303) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.24% (0.1369 => 0.1352, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.99% (0.0641 => 0.0609, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.69% (0.0578 => 0.0582, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.58% (1.1437 => 1.1371, std.dev.: 0.0475) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1900.00% (0.0001 => 0.0020, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.83% (0.0627 => 0.0651, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.99% (0.8017 => 0.7938, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 12.90% (0.0062 => 0.0070, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 19:52:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 21:52:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121102025221.B13422A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5512?compare_to=5510&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5512, Order: 167266, Start Time: 2012-11-02 01:27:05, End Time: 2012-11-02 02:52:23 To: 5510, Order: 167261, Start Time: 2012-11-01 23:38:58, End Time: 2012-11-02 01:04:00 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 1 (176 on baseline) Unchanged Tests: 1041 (861 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.42% (0.7516 => 0.7409, std.dev.: 0.0017) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.15% (3.1919 => 3.4200, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1009, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/salsa20: 2.42% (7.4937 => 7.6754, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hash2: 2.31% (3.1932 => 3.2670, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.46% (0.1584 => 0.1450, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.83% (0.1431 => 0.1319, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.94% (0.3821 => 0.3556, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -6.75% (2.4924 => 2.3241, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -5.92% (0.3142 => 0.2956, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.85% (0.2428 => 0.2286, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -5.75% (0.1879 => 0.1771, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.71% (0.3658 => 0.3449, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.67% (0.9542 => 0.9001, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -5.67% (0.3812 => 0.3596, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.61% (0.7198 => 0.6794, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.60% (0.3891 => 0.3673, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.60% (3.5339 => 3.3360, std.dev.: 0.0233) MultiSource/Applications/JM/ldecod/ldecod: -5.58% (7.0961 => 6.6998, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/exceptions-3: -5.56% (0.3848 => 0.3634, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.53% (22.4056 => 21.1675, std.dev.: 0.0154) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.51% (4.5069 => 4.2584, std.dev.: 0.0111) SingleSource/UnitTests/ObjC/exceptions-2: -5.51% (0.3831 => 0.3620, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: -5.49% (16.1920 => 15.3029, std.dev.: 0.0104) SingleSource/UnitTests/ObjC/exceptions: -5.48% (0.4176 => 0.3947, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: -5.48% (0.4033 => 0.3812, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.46% (0.3880 => 0.3668, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.46% (0.3884 => 0.3672) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.41% (0.6484 => 0.6133, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.39% (0.3896 => 0.3686, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -5.33% (0.4199 => 0.3975, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: -5.33% (4.3330 => 4.1019, std.dev.: 0.0042) MultiSource/Applications/sgefa/sgefa: -5.33% (0.3357 => 0.3178, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.31% (0.2355 => 0.2230, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.28% (0.9852 => 0.9332, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -5.28% (0.2160 => 0.2046, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -5.26% (0.4280 => 0.4055, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -5.22% (1.2515 => 1.1862, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.17% (1.0544 => 0.9999, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.12% (1.6474 => 1.5630, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.10% (0.2548 => 0.2418, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.07% (4.0323 => 3.8280, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/08-main/main: -5.04% (0.2659 => 0.2525, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.04% (1.2784 => 1.2140, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.03% (0.7919 => 0.7521, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -4.98% (4.8161 => 4.5761, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -4.95% (4.8802 => 4.6385, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: -4.91% (0.9179 => 0.8728, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.84% (0.4151 => 0.3950, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.83% (0.5999 => 0.5709, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.77% (5.4682 => 5.2072, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.77% (14.2083 => 13.5304, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.77% (0.3837 => 0.3654, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.77% (1.3722 => 1.3068, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference: -4.76% (0.7779 => 0.7409, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: -4.75% (1.3148 => 1.2523, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.74% (0.8521 => 0.8117, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: -4.71% (0.6347 => 0.6048, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -4.71% (4.0594 => 3.8682, std.dev.: 0.0073) MultiSource/Applications/sqlite3/sqlite3: -4.69% (17.1032 => 16.3006, std.dev.: 0.0210) MultiSource/Applications/lemon/lemon: -4.69% (1.1450 => 1.0913, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -4.64% (34.0927 => 32.5123, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.61% (1.6364 => 1.5610, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.60% (1.2300 => 1.1734, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.57% (1.4642 => 1.3973, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -4.55% (2.4021 => 2.2928, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.55% (0.3849 => 0.3674, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -4.53% (9.2283 => 8.8104, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary3: -4.53% (0.3446 => 0.3290, std.dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.52% (6.7716 => 6.4652, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: -4.52% (0.2989 => 0.2854, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.51% (0.6293 => 0.6009, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.51% (0.3483 => 0.3326, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -4.50% (0.6441 => 0.6151, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -4.50% (0.3025 => 0.2889, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.48% (0.3057 => 0.2920, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.48% (0.6230 => 0.5951, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -4.48% (0.3194 => 0.3051, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.46% (2.1713 => 2.0744, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.46% (0.7339 => 0.7012, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -4.45% (0.3394 => 0.3243, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -4.45% (0.3059 => 0.2923, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.44% (0.2903 => 0.2774, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.44% (0.6194 => 0.5919, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.43% (2.2587 => 2.1587, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.41% (1.2221 => 1.1682, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -4.40% (18.2933 => 17.4889, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/ary2: -4.40% (0.3481 => 0.3328, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -4.39% (0.2939 => 0.2810, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -4.39% (0.2985 => 0.2854, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.37% (0.6681 => 0.6389, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.37% (0.6660 => 0.6369, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.37% (0.2999 => 0.2868, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.37% (0.5863 => 0.5607, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.36% (0.5591 => 0.5347, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: -4.35% (0.2871 => 0.2746, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.34% (0.5478 => 0.5240, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -4.34% (0.6750 => 0.6457, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.34% (0.5925 => 0.5668, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.34% (0.5581 => 0.5339, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: -4.32% (0.4861 => 0.4651, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -4.32% (0.2849 => 0.2726, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -4.31% (0.3621 => 0.3465, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.31% (1.2210 => 1.1684, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.31% (0.5805 => 0.5555, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.30% (0.6667 => 0.6380, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.29% (0.3406 => 0.3260, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.29% (0.5857 => 0.5606, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.28% (0.5705 => 0.5461, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.27% (0.4916 => 0.4706, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.26% (0.4083 => 0.3909, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.25% (0.5456 => 0.5224, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.24% (0.5802 => 0.5556, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -4.24% (0.4248 => 0.4068, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.22% (0.6304 => 0.6038, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.22% (0.5570 => 0.5335, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -4.20% (0.7982 => 0.7647, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.19% (0.6676 => 0.6396, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -4.19% (0.3867 => 0.3705, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.19% (0.5849 => 0.5604, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -4.18% (0.3205 => 0.3071, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.18% (0.6052 => 0.5799, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.18% (0.5575 => 0.5342, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.17% (0.6260 => 0.5999, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: -4.16% (0.3026 => 0.2900, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.16% (0.6297 => 0.6035, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.16% (0.6446 => 0.6178, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.15% (0.5859 => 0.5616, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.14% (0.3016 => 0.2891, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: -4.12% (0.7447 => 0.7140, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: -4.12% (0.3255 => 0.3121, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: -4.11% (0.4524 => 0.4338, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.10% (0.5567 => 0.5339, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.09% (0.4813 => 0.4616, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.08% (0.7524 => 0.7217, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.07% (0.6395 => 0.6135, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -4.05% (0.4515 => 0.4332, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.05% (0.6440 => 0.6179, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.05% (0.4321 => 0.4146, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.04% (0.5569 => 0.5344, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.04% (0.5941 => 0.5701, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.03% (0.3252 => 0.3121, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: -4.02% (0.3581 => 0.3437, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: -4.01% (15.5079 => 14.8864, std.dev.: 0.0118) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.01% (0.2695 => 0.2587, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -3.99% (0.6189 => 0.5942, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -3.95% (8.0126 => 7.6959, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.91% (0.6395 => 0.6145, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.91% (0.4427 => 0.4254, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.88% (0.6033 => 0.5799, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.87% (0.6736 => 0.6475, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -3.85% (0.5688 => 0.5469, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.84% (0.3931 => 0.3780, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: -3.84% (2.1401 => 2.0579, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.84% (0.3491 => 0.3357, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -3.84% (0.8418 => 0.8095, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: -3.82% (1.3864 => 1.3335, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.80% (0.9557 => 0.9194, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.72% (5.0226 => 4.8356, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sieve: -3.72% (0.3788 => 0.3647, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.70% (0.3323 => 0.3200, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: -3.70% (0.3271 => 0.3150, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: -3.66% (3.5154 => 3.3867, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.61% (0.2933 => 0.2827, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.46% (0.7021 => 0.6778, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.40% (0.9077 => 0.8768, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -3.37% (15.2527 => 14.7387, std.dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.25% (0.5168 => 0.5000, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (0.3319 => 0.3213, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.96% (0.5329 => 0.5171, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -2.94% (1.5610 => 1.5151, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: -2.94% (1.1530 => 1.1191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -2.33% (20.7746 => 20.2898, std.dev.: 0.0232) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7553, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -8.72% (1.2842 => 1.1722, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7067, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.80% (2.2633 => 2.1774, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.17% (1.3096 => 1.2812, std.dev.: 0.0092) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4668, std.dev.: 0.0041) Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 21:05:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 23:05:49 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121102040549.BCA8D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5513?compare_to=5511&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5513, Order: 167279, Start Time: 2012-11-02 02:39:31, End Time: 2012-11-02 04:05:53 To: 5511, Order: 167266, Start Time: 2012-11-02 00:55:21, End Time: 2012-11-02 02:22:48 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 5 (86 on baseline) Performance Improvements: 7 (5 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 979 (883 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 2.11% (8.4725 => 8.6511, std.dev.: 0.0434) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.23% (0.8893 => 0.9002, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.48% (2.0001 => 2.0297, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/ReedSolomon: 1.24% (8.6773 => 8.7846, std.dev.: 0.0191) SingleSource/Benchmarks/Misc/pi: 1.10% (2.4827 => 2.5099, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.69% (0.2474 => 0.2358, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/09-vor/vor: -3.05% (0.3308 => 0.3207, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.03% (0.8043 => 0.7799, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.23% (1.2288 => 1.2014, std.dev.: 0.0098) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.30% (4.6067 => 4.5467, std.dev.: 0.0208) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.19% (4.7001 => 4.6442, std.dev.: 0.0155) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -12.75% (3.4713 => 3.0288, std.dev.: 0.0836) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.37% (16.6997 => 16.6382, std.dev.: 0.1023) MultiSource/Applications/obsequi/Obsequi: -3.11% (1.0720 => 1.0387, std.dev.: 0.0306) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.38% (21.6644 => 21.7476, std.dev.: 0.2860) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.09% (0.3670 => 0.3630, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: -0.07% (0.6031 => 0.6027, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.77% (0.3356 => 0.3330, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -0.55% (0.2010 => 0.1999, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.45% (0.0221 => 0.0220, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0428 => 0.0428, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -11.38% (0.0334 => 0.0296, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0316 => 0.0316, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -8.49% (0.0424 => 0.0388, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/casts: -13.79% (0.0203 => 0.0175, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/test1: -28.44% (0.0218 => 0.0156, std.dev.: 0.0031) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.63% (0.1428 => 0.1437, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.41% (1.1084 => 1.1240, std.dev.: 0.0163) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000) MultiSource/Applications/oggenc/oggenc: -3.43% (0.1518 => 0.1466, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.02% (0.4109 => 0.3985, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.73% (0.1352 => 0.1416, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.66% (0.0609 => 0.0605, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -23.47% (0.0277 => 0.0212, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.75% (0.0582 => 0.0566, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.53% (1.1371 => 1.1431, std.dev.: 0.0591) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -95.00% (0.0020 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.22% (0.0651 => 0.0604, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.47% (0.0266 => 0.0169, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.97% (0.7938 => 0.8015, std.dev.: 0.0147) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -38.57% (0.0070 => 0.0043, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2311.69% (0.6332 => 15.2708, std.dev.: 0.0982) MultiSource/Benchmarks/McCat/08-main/main: 46.42% (0.1831 => 0.2681, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.67% (0.1559 => 0.1455, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1487.32% (0.3344 => 5.3080, std.dev.: 0.0218) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.08% (0.2364 => 0.3217, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0429 => 0.0439, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.34% (0.0224 => 0.0221, std.dev.: 0.0011) SingleSource/UnitTests/byval-alignment: -32.17% (0.0230 => 0.0156, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3544, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0706, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4946, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3382, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0309, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4042, std.dev.: 0.0021) SingleSource/Regression/C/uint64_to_float: -24.19% (2.1832 => 1.6551, std.dev.: 0.0097) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 11.24% (0.1112 => 0.1237, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.51% (0.8321 => 0.9029, std.dev.: 0.0181) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.07% (0.2180 => 0.2356, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.93% (0.1425 => 0.1538, std.dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.68% (0.3137 => 0.3378, std.dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.48% (0.1885 => 0.2026, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.61% (0.1905 => 0.2031, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.04% (0.2998 => 0.3149, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.76% (0.5817 => 0.6094, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.45% (0.2519 => 0.2631, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.36% (0.7473 => 0.7799, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.30% (1.1685 => 1.2188, std.dev.: 0.0153) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.24% (0.4783 => 0.4986, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.13% (0.3295 => 0.3431, std.dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 4.04% (1.1271 => 1.1726, std.dev.: 0.0037) MultiSource/Applications/d/make_dparser: 3.80% (3.2366 => 3.3596, std.dev.: 0.0230) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.77% (6.6074 => 6.8565, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.52% (1.1606 => 1.2014, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.44% (0.8611 => 0.8907, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.43% (0.5191 => 0.5369, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.33% (0.8712 => 0.9002, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.30% (0.8597 => 0.8881, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.30% (0.4127 => 0.4263, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.03% (8.6476 => 8.9094, std.dev.: 0.0876) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.97% (1.3279 => 1.3674, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.94% (0.8697 => 0.8953, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.94% (0.5961 => 0.6136, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.91% (0.6227 => 0.6408, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/football/football: 2.85% (0.8768 => 0.9018, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.80% (0.8457 => 0.8694, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.80% (0.8007 => 0.8231, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: 2.77% (8.4179 => 8.6511, std.dev.: 0.0434) MultiSource/Applications/SPASS/SPASS: 2.73% (14.2605 => 14.6491, std.dev.: 0.1176) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.69% (0.9908 => 1.0175, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.63% (0.8331 => 0.8550, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.61% (0.8338 => 0.8556, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.59% (0.9074 => 0.9309, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.58% (0.8086 => 0.8295, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.57% (0.9039 => 0.9271, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.53% (0.9688 => 0.9933, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.50% (4.1763 => 4.2808, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.50% (0.8716 => 0.8934, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.49% (0.8805 => 0.9024, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.48% (0.8050 => 0.8250, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.48% (0.4559 => 0.4672, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.44% (0.8316 => 0.8519, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.44% (0.8855 => 0.9071, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.42% (0.8340 => 0.8542, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.39% (0.8420 => 0.8621, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.39% (0.8885 => 0.9097, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.35% (0.8518 => 0.8718, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.28% (0.8069 => 0.8253, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.25% (0.9069 => 0.9273, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 2.25% (1.0945 => 1.1191, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.25% (0.7966 => 0.8145, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.24% (0.8261 => 0.8446, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.22% (0.8066 => 0.8245, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 2.22% (4.1305 => 4.2221, std.dev.: 0.0331) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.06% (0.8995 => 0.9180, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 2.03% (8.6247 => 8.8002, std.dev.: 0.0580) MultiSource/Applications/minisat/minisat: 2.00% (0.6834 => 0.6971, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.98% (0.8177 => 0.8339, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.96% (0.8927 => 0.9102, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.91% (2.1401 => 2.1810, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (3.1832 => 3.2438, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.86% (0.8048 => 0.8198, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 1.84% (2.2184 => 2.2593, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.82% (4.4873 => 4.5691, std.dev.: 0.0194) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.78% (1.5315 => 1.5587, std.dev.: 0.0105) MultiSource/Benchmarks/PAQ8p/paq8p: 1.69% (2.3764 => 2.4165, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.65% (1.2423 => 1.2628, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.62% (4.5702 => 4.6442, std.dev.: 0.0155) MultiSource/Benchmarks/Bullet/bullet: 1.43% (31.8598 => 32.3143, std.dev.: 0.1188) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.31% (4.4880 => 4.5467, std.dev.: 0.0208) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.90% (1.5795 => 2.5099, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.42% (2.7978 => 3.7327, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.69% (2.4333 => 2.6691, std.dev.: 0.0477) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.42% (1.1857 => 1.2737, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 5.95% (63.1822 => 66.9447, std.dev.: 0.0809) SingleSource/Benchmarks/Misc/ReedSolomon: 2.96% (8.5322 => 8.7846, std.dev.: 0.0191) MultiSource/Applications/siod/siod: 2.52% (3.6643 => 3.7568, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash: 2.14% (0.6205 => 0.6338, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.83% (3.9006 => 3.9721, std.dev.: 0.0160) MultiSource/Benchmarks/llubenchmark/llu: 1.65% (1.9967 => 2.0297, std.dev.: 0.0046) MultiSource/Applications/minisat/minisat: 1.37% (6.1525 => 6.2370, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.26% (4.8362 => 4.8970, std.dev.: 0.0131) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.04% (0.3269 => 0.3039, std.dev.: 0.0019) MultiSource/Applications/lua/lua: -5.27% (29.8330 => 28.2605, std.dev.: 0.0991) SingleSource/Benchmarks/Shootout-C++/hash2: -1.69% (3.4237 => 3.3660, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.39% (3.3479 => 3.3013, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.13% (1.0388 => 1.0271, std.dev.: 0.0005) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.17% (16.4461 => 16.6382, std.dev.: 0.1023) MultiSource/Applications/obsequi/Obsequi: 1.22% (1.0262 => 1.0387, std.dev.: 0.0306) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6863.69% (0.3123 => 21.7476, std.dev.: 0.2860) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.38% (0.2463 => 0.3630, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 0.28% (0.6010 => 0.6027, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.96% (0.3266 => 0.3330, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 1.52% (0.1969 => 0.1999, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 16.54% (0.0254 => 0.0296, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.04% (0.0384 => 0.0388, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/casts: -7.89% (0.0190 => 0.0175, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/test1: -13.33% (0.0180 => 0.0156, std.dev.: 0.0031) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1438 => 0.1437, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.79% (1.1329 => 1.1240, std.dev.: 0.0163) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.27% (0.1462 => 0.1466, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.30% (0.4164 => 0.3985, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.43% (0.1369 => 0.1416, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.62% (0.0641 => 0.0605, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.72% (0.0195 => 0.0212, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.08% (0.0578 => 0.0566, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.05% (1.1437 => 1.1431, std.dev.: 0.0591) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.67% (0.0627 => 0.0604, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.11% (0.0180 => 0.0169, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.02% (0.8017 => 0.8015, std.dev.: 0.0147) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -30.65% (0.0062 => 0.0043, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 21:40:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 23:40:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121102044039.CA8BD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5514?compare_to=5512&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5514, Order: 167280, Start Time: 2012-11-02 03:15:39, End Time: 2012-11-02 04:40:41 To: 5512, Order: 167266, Start Time: 2012-11-02 01:27:05, End Time: 2012-11-02 02:52:23 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (173 on baseline) Unchanged Tests: 1041 (864 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.62% (0.6794 => 0.6904, std.dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.15% (3.1919 => 3.4202, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1017, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/salsa20: 2.42% (7.4937 => 7.6752, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/hash2: 2.04% (3.1932 => 3.2583, std.dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.46% (0.1584 => 0.1450, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.83% (0.1431 => 0.1319, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -6.58% (2.4924 => 2.3285, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.36% (0.3821 => 0.3578, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: -6.29% (0.3880 => 0.3636, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.24% (0.3831 => 0.3592, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -6.21% (0.3896 => 0.3654, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.19% (0.3812 => 0.3576, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -6.19% (0.3848 => 0.3610, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.18% (0.4176 => 0.3918, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -6.17% (0.4033 => 0.3784, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.15% (0.3884 => 0.3645, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.07% (0.3891 => 0.3655, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -5.92% (0.3142 => 0.2956, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.89% (0.2428 => 0.2285, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.88% (0.9542 => 0.8981, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.79% (0.4199 => 0.3956, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/parameter-passing: -5.77% (0.4280 => 0.4033, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.69% (0.3658 => 0.3450, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.66% (22.4056 => 21.1382, std.dev.: 0.0160) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.65% (4.5069 => 4.2521, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: -5.64% (0.1879 => 0.1773, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.54% (3.5339 => 3.3380, std.dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: -5.54% (7.0961 => 6.7030, std.dev.: 0.0047) SingleSource/UnitTests/ObjC++/property-reference: -5.50% (0.7779 => 0.7351, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.49% (0.4151 => 0.3923, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -5.48% (16.1920 => 15.3040, std.dev.: 0.0057) MultiSource/Applications/sgefa/sgefa: -5.48% (0.3357 => 0.3173, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/strcat: -5.45% (0.2989 => 0.2826, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.43% (0.6484 => 0.6132, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: -5.38% (1.3148 => 1.2440, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.35% (0.2355 => 0.2229, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.34% (0.3837 => 0.3632, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: -5.34% (0.2939 => 0.2782, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -5.33% (0.3394 => 0.3213, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.33% (0.2871 => 0.2718, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -5.31% (0.3481 => 0.3296, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -5.31% (0.3446 => 0.3263, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -5.30% (4.3330 => 4.1034, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: -5.29% (0.3194 => 0.3025, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.27% (0.2903 => 0.2750, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -5.26% (0.3059 => 0.2898, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -5.23% (0.2160 => 0.2047, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -5.22% (0.3025 => 0.2867, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.22% (2.1713 => 2.0580, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.21% (4.8161 => 4.5653, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.20% (0.3057 => 0.2898, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hello: -5.19% (0.2849 => 0.2701, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -5.18% (0.6347 => 0.6018, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -5.18% (0.3205 => 0.3039, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.17% (0.3849 => 0.3650, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.14% (0.2548 => 0.2417, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.14% (1.0544 => 1.0002, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.12% (4.8802 => 4.6302, std.dev.: 0.0122) MultiSource/Benchmarks/McCat/08-main/main: -5.11% (0.2659 => 0.2523, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.11% (4.0323 => 3.8261, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: -5.11% (1.2515 => 1.1876, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.03% (0.9852 => 0.9356, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.03% (1.6474 => 1.5646, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: -5.02% (0.3867 => 0.3673, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.00% (0.4083 => 0.3879, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.99% (5.4682 => 5.1953, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists: -4.97% (0.3621 => 0.3441, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -4.94% (34.0927 => 32.4086, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.91% (0.3016 => 0.2868, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -4.90% (0.4248 => 0.4040, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.89% (0.6441 => 0.6126, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -4.88% (0.3255 => 0.3096, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.88% (0.5999 => 0.5706, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.86% (0.4813 => 0.4579, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -4.85% (4.0594 => 3.8627, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/bigfib: -4.84% (0.6750 => 0.6423, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.83% (0.3252 => 0.3095, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.82% (1.6364 => 1.5575, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -4.82% (1.2784 => 1.2168, std.dev.: 0.0010) MultiSource/Applications/siod/siod: -4.82% (2.4021 => 2.2864, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.80% (0.7919 => 0.7539, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: -4.77% (0.4861 => 0.4629, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.74% (0.8521 => 0.8117, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: -4.73% (0.9179 => 0.8745, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.70% (1.3722 => 1.3077, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/except: -4.69% (0.3026 => 0.2884, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.67% (1.2300 => 1.1726, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: -4.67% (17.1032 => 16.3053, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.66% (14.2083 => 13.5462, std.dev.: 0.0220) MultiSource/Applications/lemon/lemon: -4.64% (1.1450 => 1.0919, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: -4.59% (0.3788 => 0.3614, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.57% (0.6230 => 0.5945, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.57% (0.2933 => 0.2799, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.57% (0.2999 => 0.2862, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: -4.56% (9.2283 => 8.8078, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.56% (1.4642 => 1.3975, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.54% (0.6293 => 0.6007, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.54% (0.4427 => 0.4226, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.54% (0.3483 => 0.3325, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: -4.53% (18.2933 => 17.4641, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.52% (0.5925 => 0.5657, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.51% (1.2221 => 1.1670, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: -4.50% (0.4515 => 0.4312, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.48% (0.9557 => 0.9129, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.48% (0.2278 => 0.2176, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.46% (0.6660 => 0.6363, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.46% (1.2210 => 1.1666, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.43% (0.7339 => 0.7014, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.43% (0.6304 => 0.6025, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.42% (0.5857 => 0.5598, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.41% (0.6052 => 0.5785, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.40% (2.2587 => 2.1593, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.40% (0.5478 => 0.5237, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.39% (0.3323 => 0.3177, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.38% (0.3491 => 0.3338, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.38% (0.5705 => 0.5455, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.38% (0.5456 => 0.5217, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.37% (6.7716 => 6.4754, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.37% (0.5863 => 0.5607, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.36% (0.7447 => 0.7122, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.36% (0.5849 => 0.5594, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.35% (0.5581 => 0.5338, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.35% (0.3931 => 0.3760, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.34% (0.5570 => 0.5328, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.34% (0.6194 => 0.5925, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.33% (0.4321 => 0.4134, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -4.28% (0.7982 => 0.7640, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.28% (0.6446 => 0.6170, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.27% (0.4916 => 0.4706, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.26% (0.5802 => 0.5555, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.25% (0.5805 => 0.5558, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.25% (0.5859 => 0.5610, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.23% (0.5575 => 0.5339, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.21% (0.6667 => 0.6386, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.21% (0.6297 => 0.6032, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -4.20% (0.4524 => 0.4334, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.19% (0.3319 => 0.3180, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.19% (0.7524 => 0.7209, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.19% (0.6260 => 0.5998, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.17% (0.3406 => 0.3264, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.15% (0.5567 => 0.5336, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -4.12% (0.2985 => 0.2862, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.10% (0.6395 => 0.6133, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.10% (0.6395 => 0.6133, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.09% (0.5941 => 0.5698, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.08% (0.7198 => 0.6904, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.04% (0.6676 => 0.6406, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.04% (8.0126 => 7.6888, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.04% (0.5569 => 0.5344, std.dev.: 0.0059) MultiSource/Applications/SPASS/SPASS: -4.03% (15.5079 => 14.8833, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -3.96% (0.5688 => 0.5463, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.90% (0.6033 => 0.5798, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -3.89% (0.6189 => 0.5948, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.89% (0.6681 => 0.6421, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/09-vor/vor: -3.88% (0.3271 => 0.3144, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.88% (0.6440 => 0.6190, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -3.86% (2.1401 => 2.0575, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.82% (0.2695 => 0.2592, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: -3.80% (0.3581 => 0.3445, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: -3.79% (1.3864 => 1.3338, std.dev.: 0.0040) MultiSource/Applications/oggenc/oggenc: -3.76% (5.0226 => 4.8336, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.66% (0.5168 => 0.4979, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -3.61% (0.8418 => 0.8114, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: -3.61% (3.5154 => 3.3886, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -3.37% (15.2527 => 14.7386, std.dev.: 0.0181) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.36% (0.9077 => 0.8772, std.dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: -3.34% (1.1530 => 1.1145, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: -3.27% (1.5610 => 1.5099, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.10% (0.5329 => 0.5164, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -2.22% (20.7746 => 20.3127, std.dev.: 0.0221) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7515, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/richards_benchmark: -8.63% (1.2842 => 1.1734, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.94% (2.2633 => 2.1741, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7067, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4695, std.dev.: 0.0028) Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 21:41:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 23:41:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121102044120.9D3DA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5515?compare_to=5508&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5515, Order: 167266, Start Time: 2012-11-02 01:26:02, End Time: 2012-11-02 04:41:24 To: 5508, Order: 167249, Start Time: 2012-11-01 21:21:50, End Time: 2012-11-02 00:37:47 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (169 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1042 (721 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.16% (0.0625 => 0.0876, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.33% (0.1063 => 0.1396, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.53% (0.2969 => 0.3727, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.23% (0.1106 => 0.1385, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.37% (0.0714 => 0.0888, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.06% (0.4139 => 0.5135, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.03% (0.4253 => 0.5275, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 23.88% (1.5932 => 1.9736, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.52% (0.0642 => 0.0793, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.41% (0.5900 => 0.7281, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.40% (0.0547 => 0.0675, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.01% (0.4994 => 0.6143, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.86% (0.5000 => 0.6143, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.26% (0.0584 => 0.0714, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.96% (0.0897 => 0.1094, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.67% (0.1620 => 0.1971, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 21.54% (0.0599 => 0.0728) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.35% (0.1021 => 0.1239, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.23% (0.1107 => 0.1342, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 20.68% (0.0948 => 0.1144, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.38% (0.0633 => 0.0762) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.04% (0.1103 => 0.1324, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.03% (0.0584 => 0.0701, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 19.85% (0.0821 => 0.0984, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.81% (0.3903 => 0.4676, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.78% (0.0541 => 0.0648, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 19.77% (0.1619 => 0.1939, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.69% (0.1549 => 0.1854, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.59% (0.0822 => 0.0983, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.39% (0.1604 => 0.1915, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.34% (0.1003 => 0.1197, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.84% (0.0605 => 0.0719, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.48% (0.0947 => 0.1122, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.13% (0.1462 => 0.1727, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 17.95% (0.0808 => 0.0953) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.87% (0.3890 => 0.4585, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.83% (0.2014 => 0.2373, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 17.73% (0.1218 => 0.1434, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 17.61% (0.1505 => 0.1770, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 17.56% (0.5826 => 0.6849, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 17.44% (0.5889 => 0.6916, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 17.37% (0.4029 => 0.4729, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.37% (0.1088 => 0.1277, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.25% (0.2736 => 0.3208, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.15% (1.3152 => 1.5407, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.92% (0.2866 => 0.3351, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 16.78% (1.8794 => 2.1947, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.70% (3.5627 => 4.1576, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 16.62% (0.5546 => 0.6468, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.57% (0.5026 => 0.5859, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.47% (0.1160 => 0.1351, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.21% (0.1968 => 0.2287, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.21% (0.4658 => 0.5413, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 16.12% (0.1421 => 0.1650, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.11% (0.3271 => 0.3798, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.07% (0.2875 => 0.3337, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 16.01% (0.3004 => 0.3485, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.01% (1.6211 => 1.8806, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: 15.91% (0.9697 => 1.1240, std.dev.: 0.0114) MultiSource/Applications/hexxagon/hexxagon: 15.66% (0.9909 => 1.1461, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.60% (0.2738 => 0.3165, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 15.58% (1.0781 => 1.2461, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.55% (0.4361 => 0.5039, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 15.52% (0.7171 => 0.8284, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hello: 15.51% (0.2714 => 0.3135, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 15.42% (23.5202 => 27.1472, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/fibo: 15.41% (0.2725 => 0.3145, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 15.31% (0.2750 => 0.3171, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.28% (0.2729 => 0.3146, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.27% (0.3930 => 0.4530, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 15.26% (0.1284 => 0.1480, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 15.22% (0.2780 => 0.3203, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.13% (4.4195 => 5.0881, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.13% (2.7292 => 3.1420, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.12% (0.2911 => 0.3351, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/random: 15.09% (0.2803 => 0.3226, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 15.06% (4.2109 => 4.8452, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/objinst: 15.05% (0.2823 => 0.3248, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 15.04% (0.2813 => 0.3236, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.03% (0.3060 => 0.3520, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 15.01% (0.2811 => 0.3233, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.01% (0.2792 => 0.3211, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.99% (0.3195 => 0.3674, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/wc: 14.95% (0.3096 => 0.3559, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 14.77% (0.3317 => 0.3807, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.76% (2.0673 => 2.3725, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.74% (1.9694 => 2.2597, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.64% (1.9966 => 2.2889, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.49% (0.3362 => 0.3849, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 14.45% (0.3267 => 0.3739, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 14.40% (0.3258 => 0.3727, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.31% (0.1090 => 0.1246, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 13.95% (0.3348 => 0.3815, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.83% (0.3124 => 0.3556, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 13.78% (0.3678 => 0.4185, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 13.78% (0.2075 => 0.2361, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 13.77% (0.3465 => 0.3942, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 13.74% (1.4269 => 1.6230, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 13.68% (0.2566 => 0.2917, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 13.68% (0.4146 => 0.4713, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.65% (0.3282 => 0.3730, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.63% (0.3845 => 0.4369, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 13.45% (0.3726 => 0.4227, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists1: 13.40% (0.3477 => 0.3943, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.38% (0.3625 => 0.4110, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/for-in: 13.33% (0.3496 => 0.3962, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.29% (0.3460 => 0.3920, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 13.29% (0.3446 => 0.3904, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.27% (0.3488 => 0.3951, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 13.26% (0.3469 => 0.3929, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 13.24% (0.4251 => 0.4814, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.17% (0.3690 => 0.4176, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 13.13% (0.3442 => 0.3894, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 13.05% (0.7875 => 0.8903, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.04% (0.3981 => 0.4500, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/property: 12.93% (0.3650 => 0.4122, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 12.87% (2.1653 => 2.4439, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 12.87% (4.6177 => 5.2118, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions: 12.85% (0.3643 => 0.4111, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 12.73% (0.3724 => 0.4198, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 12.55% (0.5012 => 0.5641, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 12.37% (2.1013 => 2.3612, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 11.63% (0.2691 => 0.3004, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.52% (0.2040 => 0.2275, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11.43% (5.5417 => 6.1750, std.dev.: 0.0157) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.28% (0.6435 => 0.7161, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: 11.21% (0.3498 => 0.3890, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.99% (0.1028 => 0.1141, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.49% (0.2068 => 0.2285, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.34% (0.1383 => 0.1526, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.34% (0.2737 => 0.3020, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.33% (0.6634 => 0.7319, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 10.32% (0.4847 => 0.5347, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.15% (0.3084 => 0.3397, std.dev.: 0.0038) MultiSource/Applications/minisat/minisat: 10.04% (0.3336 => 0.3671, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.42% (0.2103 => 0.2301, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 8.93% (2.0346 => 2.2162, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 8.62% (0.2391 => 0.2597, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.59% (4.6926 => 5.0959, std.dev.: 0.0186) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.49% (11.6398 => 12.6286, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.41% (0.5361 => 0.5812, std.dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.57% (0.7426 => 0.7988, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.43% (0.5584 => 0.5999, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 6.43% (11.9555 => 12.7240, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.38% (0.3792 => 0.3958, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6533, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 8.60% (0.2802 => 0.3043, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6106, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.02% (12.0509 => 12.6558, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: 4.75% (15.4430 => 16.1766, std.dev.: 0.0450) SingleSource/Benchmarks/Misc/flops-2: 4.44% (1.8057 => 1.8859, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/dry: 3.44% (14.0481 => 14.5308, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/ary3: 1.99% (15.8721 => 16.1873, std.dev.: 0.0058) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.73% (3.1722 => 3.2272, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3037, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2847, std.dev.: 0.0035) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.23% (1.0142 => 1.0267, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5143, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5871, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.19% (25.4195 => 16.4744, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/ary2: -9.28% (0.2402 => 0.2179, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9774, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.67% (35.5013 => 32.7767, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/tsp/tsp: -7.18% (2.1113 => 1.9598, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.28% (11.2080 => 10.8401, std.dev.: 0.0337) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7752, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -2.90% (3.6262 => 3.5210, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.60% (17.2379 => 16.7890, std.dev.: 0.0193) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.20% (41.7953 => 40.8777, std.dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5703, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.73% (0.6293 => 0.6184, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4973, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.28% (105.3826 => 104.0376, std.dev.: 0.1564) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0421, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.06% (3.3991 => 3.3629, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 22:49:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 2 Nov 2012 00:49:24 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121102054924.79A1A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5516?compare_to=5513&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5516, Order: 167281, Start Time: 2012-11-02 04:22:45, End Time: 2012-11-02 05:49:28 To: 5513, Order: 167279, Start Time: 2012-11-02 02:39:31, End Time: 2012-11-02 04:05:53 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 8 (84 on baseline) Performance Improvements: 2 (4 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 981 (886 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 5.37% (0.1955 => 0.2060, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 1.73% (1.4343 => 1.4591, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.71% (0.6685 => 0.6799, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 1.58% (0.7519 => 0.7638, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.25% (0.3200 => 0.3528, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.03% (3.0288 => 3.2720, std.dev.: 0.0787) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.91% (58.9507 => 60.6677, std.dev.: 0.3503) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.66% (4.3461 => 4.4617, std.dev.: 0.0242) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -1.09% (6.4480 => 6.3774, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.09% (1.4284 => 1.4129, std.dev.: 0.0022) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.77% (16.6382 => 16.7658, std.dev.: 0.2054) MultiSource/Applications/obsequi/Obsequi: 1.59% (1.0387 => 1.0552, std.dev.: 0.0058) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.03% (21.7476 => 21.7409, std.dev.: 0.1395) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.80% (0.3630 => 0.3659, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 0.50% (0.6027 => 0.6057, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.42% (0.3330 => 0.3344, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 0.05% (0.1999 => 0.2000, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -19.09% (0.0220 => 0.0178, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -16.59% (0.0428 => 0.0357, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -7.77% (0.0296 => 0.0273, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -24.68% (0.0316 => 0.0238, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.67% (0.0388 => 0.0366, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/casts: 16.57% (0.0175 => 0.0204, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 28.21% (0.0156 => 0.0200, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.70% (0.1437 => 0.1427, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.62% (1.1240 => 1.1310, std.dev.: 0.0153) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: - (0.1466 => 0.1466, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.56% (0.3985 => 0.4047, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.50% (0.1416 => 0.1324, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.13% (0.0605 => 0.0630, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 19.34% (0.0212 => 0.0253, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.88% (0.0566 => 0.0571, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.58% (1.1431 => 1.1365, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 700.00% (0.0001 => 0.0008, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.16% (0.0604 => 0.0597, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.28% (0.0169 => 0.0183, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.74% (0.8015 => 0.7956, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 37.21% (0.0043 => 0.0059, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2305.65% (0.6332 => 15.2326, std.dev.: 0.2248) MultiSource/Benchmarks/McCat/08-main/main: 46.97% (0.1831 => 0.2691, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.58% (0.1559 => 0.1472, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1489.17% (0.3344 => 5.3142, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.69% (0.2364 => 0.3255, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: 3.03% (0.0429 => 0.0442, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.12% (0.0224 => 0.0231, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -31.30% (0.0230 => 0.0158, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3453, std.dev.: 0.0236) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0717, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4926, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3361, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0334, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4018, std.dev.: 0.0032) SingleSource/Regression/C/uint64_to_float: -23.77% (2.1832 => 1.6643, std.dev.: 0.0025) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0008) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.41% (0.0810 => 0.0951, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 14.30% (0.1112 => 0.1271, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.74% (0.0848 => 0.0956, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.42% (0.1157 => 0.1266, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.26% (0.2180 => 0.2360, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.2279 => 0.2451, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.67% (0.8321 => 0.8876, std.dev.: 0.0134) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.65% (0.1983 => 0.2095, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.55% (0.6287 => 0.6636, std.dev.: 0.0089) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.47% (0.8148 => 0.8512, std.dev.: 0.0050) MultiSource/Benchmarks/nbench/nbench: 4.34% (1.1271 => 1.1760, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.32% (0.4559 => 0.4756, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.12% (0.4127 => 0.4297, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.07% (0.5817 => 0.6054, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.98% (1.3279 => 1.3808, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.95% (0.9435 => 0.9808, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.79% (0.2741 => 0.2845, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.78% (0.5191 => 0.5387, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.75% (6.6074 => 6.8550, std.dev.: 0.0564) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.55% (0.3717 => 0.3849, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: 3.55% (1.2222 => 1.2656, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.41% (8.6476 => 8.9427, std.dev.: 0.0412) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.41% (0.8340 => 0.8624, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.37% (0.8611 => 0.8901, std.dev.: 0.0046) MultiSource/Applications/minisat/minisat: 3.29% (0.6834 => 0.7059, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.27% (0.5961 => 0.6156, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.23% (0.6586 => 0.6799, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 3.15% (3.2366 => 3.3387, std.dev.: 0.0206) MultiSource/Applications/ClamAV/clamscan: 3.09% (14.7684 => 15.2242, std.dev.: 0.1129) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.92% (0.8697 => 0.8951, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/gs/gs: 2.89% (4.1305 => 4.2500, std.dev.: 0.0370) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.75% (0.8317 => 0.8546, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/hash2: 2.69% (0.4125 => 0.4236, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash: 2.66% (0.3800 => 0.3901, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.62% (0.8331 => 0.8549, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (4.1763 => 4.2854, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.57% (0.8457 => 0.8674, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.56% (0.9074 => 0.9306, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.54% (0.8597 => 0.8815, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.53% (0.8177 => 0.8384, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.52% (0.7932 => 0.8132, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.48% (0.8656 => 0.8871, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.46% (1.1170 => 1.1445, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.38% (0.9908 => 1.0144, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.36% (0.6227 => 0.6374, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.35% (0.8204 => 0.8397, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.33% (0.8995 => 0.9205, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.33% (4.4880 => 4.5924, std.dev.: 0.0354) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.31% (0.9039 => 0.9248, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.27% (1.5315 => 1.5663, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.1401 => 2.1885, std.dev.: 0.0164) MultiSource/Applications/hbd/hbd: 2.26% (1.4269 => 1.4591, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.25% (0.7966 => 0.8145, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.20% (0.9056 => 0.9255, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.19% (0.8716 => 0.8907, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.17% (1.2602 => 1.2876, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.15% (0.8086 => 0.8260, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.09% (0.8805 => 0.8989, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.98% (0.8316 => 0.8481, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.96% (0.8855 => 0.9029, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.95% (0.8048 => 0.8205, std.dev.: 0.0057) SingleSource/UnitTests/Vector/constpool: 1.90% (8.4179 => 8.5782, std.dev.: 0.0385) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.85% (0.8338 => 0.8492, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (3.1832 => 3.2412, std.dev.: 0.0190) MultiSource/Benchmarks/mafft/pairlocalalign: 1.78% (8.6247 => 8.7779, std.dev.: 0.0436) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.72% (1.2423 => 1.2637, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.68% (0.8261 => 0.8400, std.dev.: 0.0052) MultiSource/Benchmarks/PAQ8p/paq8p: 1.42% (2.3764 => 2.4101, std.dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 1.35% (0.9810 => 0.9942, std.dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 57.07% (1.5795 => 2.4809, std.dev.: 0.0155) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.21% (2.7978 => 3.7269, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.73% (0.3186 => 0.3528, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.31% (2.4333 => 2.6841, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.63% (1.1857 => 1.2762, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.23% (3.0515 => 3.2720, std.dev.: 0.0787) MultiSource/Benchmarks/mafft/pairlocalalign: 5.95% (63.1822 => 66.9418, std.dev.: 0.0884) MultiSource/Applications/siod/siod: 2.75% (3.6643 => 3.7651, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.68% (2.4490 => 2.5147, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.45% (4.3552 => 4.4617, std.dev.: 0.0242) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.37% (59.2638 => 60.6677, std.dev.: 0.3503) MultiSource/Applications/minisat/minisat: 2.33% (6.1525 => 6.2960, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/ReedSolomon: 1.95% (8.5322 => 8.6983, std.dev.: 0.0416) MultiSource/Benchmarks/Olden/bh/bh: 1.88% (2.3560 => 2.4004, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.47% (1.2474 => 1.2657, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -35.80% (0.0338 => 0.0217, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.01% (0.3269 => 0.3007, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -7.34% (0.1430 => 0.1325, std.dev.: 0.0028) MultiSource/Applications/lua/lua: -4.97% (29.8330 => 28.3506, std.dev.: 0.1362) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.94% (16.4461 => 16.7658, std.dev.: 0.2054) MultiSource/Applications/obsequi/Obsequi: 2.83% (1.0262 => 1.0552, std.dev.: 0.0058) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6861.54% (0.3123 => 21.7409, std.dev.: 0.1395) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.56% (0.2463 => 0.3659, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 0.78% (0.6010 => 0.6057, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.39% (0.3266 => 0.3344, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 1.57% (0.1969 => 0.2000, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 44.72% (0.0123 => 0.0178, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -12.50% (0.0408 => 0.0357, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 7.48% (0.0254 => 0.0273, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -21.19% (0.0302 => 0.0238, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.69% (0.0384 => 0.0366, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 11.11% (0.0180 => 0.0200, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.76% (0.1438 => 0.1427, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.17% (1.1329 => 1.1310, std.dev.: 0.0153) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.27% (0.1462 => 0.1466, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.81% (0.4164 => 0.4047, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.29% (0.1369 => 0.1324, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.72% (0.0641 => 0.0630, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 29.74% (0.0195 => 0.0253, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.21% (0.0578 => 0.0571, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.63% (1.1437 => 1.1365, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 700.00% (0.0001 => 0.0008, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.78% (0.0627 => 0.0597, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.67% (0.0180 => 0.0183, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.76% (0.8017 => 0.7956, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -4.84% (0.0062 => 0.0059, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 1 23:29:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 2 Nov 2012 01:29:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121102062902.99F7F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5517?compare_to=5514&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5517, Order: 167281, Start Time: 2012-11-02 05:03:46, End Time: 2012-11-02 06:29:05 To: 5514, Order: 167280, Start Time: 2012-11-02 03:15:39, End Time: 2012-11-02 04:40:41 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (175 on baseline) Unchanged Tests: 1042 (862 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.15% (3.1919 => 3.4201, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.77% (2.0478 => 2.1045, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/salsa20: 2.72% (7.4937 => 7.6972, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash2: 2.41% (3.1932 => 3.2700, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.46% (0.1584 => 0.1450, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.90% (0.1431 => 0.1318, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.94% (0.3821 => 0.3556, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -6.59% (2.4924 => 2.3282, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: -6.30% (0.3812 => 0.3572, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -6.29% (0.3831 => 0.3590, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -6.26% (0.3880 => 0.3637, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.22% (0.3891 => 0.3649, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -6.21% (0.3848 => 0.3609, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: -6.19% (0.3896 => 0.3655, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: -6.17% (0.4033 => 0.3784, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: -6.08% (0.4176 => 0.3922, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.98% (0.4199 => 0.3948, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.89% (0.2428 => 0.2285, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -5.86% (0.3142 => 0.2958, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.76% (0.9542 => 0.8992, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -5.75% (0.1879 => 0.1771, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: -5.75% (0.4280 => 0.4034, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.69% (0.3658 => 0.3450, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.62% (4.5069 => 4.2534, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.59% (22.4056 => 21.1542, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.54% (3.5339 => 3.3380, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.54% (0.4151 => 0.3921, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.54% (0.3884 => 0.3669, std.dev.: 0.0059) MultiSource/Applications/JM/ldecod/ldecod: -5.49% (7.0961 => 6.7063, std.dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: -5.49% (16.1920 => 15.3028, std.dev.: 0.0028) MultiSource/Applications/sgefa/sgefa: -5.48% (0.3357 => 0.3173, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.46% (0.3057 => 0.2890, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -5.45% (0.2989 => 0.2826, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.39% (0.3837 => 0.3630, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.39% (0.2355 => 0.2228, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/methcall: -5.39% (0.3025 => 0.2862, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.39% (0.3194 => 0.3022, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -5.37% (0.3446 => 0.3261, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -5.34% (4.3330 => 4.1015, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.34% (0.6484 => 0.6138, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.32% (1.3148 => 1.2449, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: -5.30% (0.2849 => 0.2698, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.29% (2.1713 => 2.0565, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -5.28% (1.2515 => 1.1854, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary: -5.27% (0.3394 => 0.3215, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.27% (0.2939 => 0.2784, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -5.26% (0.2871 => 0.2720, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -5.26% (0.3481 => 0.3298, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: -5.23% (0.3059 => 0.2899, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.20% (0.3849 => 0.3649, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.17% (1.0544 => 0.9999, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: -5.15% (0.3205 => 0.3040, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: -5.14% (0.2160 => 0.2049, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.13% (0.2903 => 0.2754, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: -5.10% (0.7779 => 0.7382, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: -5.09% (0.3026 => 0.2872, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: -5.09% (0.6347 => 0.6024, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.07% (4.0323 => 3.8278, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.07% (1.6474 => 1.5639, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.06% (0.9852 => 0.9353, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.05% (1.2784 => 1.2139, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.03% (4.8161 => 4.5738, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists: -5.03% (0.3621 => 0.3439, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.01% (5.4682 => 5.1944, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: -5.00% (0.2659 => 0.2526, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.98% (0.2548 => 0.2421, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.97% (0.4083 => 0.3880, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -4.97% (4.8802 => 4.6377, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.94% (0.3016 => 0.2867, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.94% (0.7919 => 0.7528, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: -4.91% (0.3867 => 0.3677, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: -4.90% (0.4861 => 0.4623, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -4.88% (0.6441 => 0.6127, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -4.87% (0.4248 => 0.4041, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -4.87% (34.0927 => 32.4318, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/matrix: -4.82% (0.3255 => 0.3098, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.80% (0.3252 => 0.3096, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.78% (1.6364 => 1.5581, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: -4.77% (0.6750 => 0.6428, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.73% (0.5999 => 0.5715, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: -4.70% (0.9179 => 0.8748, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -4.69% (17.1032 => 16.3019, std.dev.: 0.0246) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.68% (1.3722 => 1.3080, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.67% (0.4321 => 0.4119, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.67% (1.2300 => 1.1725, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.66% (14.2083 => 13.5456, std.dev.: 0.0117) MultiSource/Applications/siod/siod: -4.65% (2.4021 => 2.2903, std.dev.: 0.0127) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.61% (0.8521 => 0.8128, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.59% (0.4427 => 0.4224, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.57% (0.4813 => 0.4593, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.57% (0.2933 => 0.2799, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -4.56% (4.0594 => 3.8741, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.56% (1.4642 => 1.3974, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sieve: -4.54% (0.3788 => 0.3616, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: -4.54% (0.4515 => 0.4310, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.54% (0.3483 => 0.3325, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -4.53% (18.2933 => 17.4653, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.52% (0.6194 => 0.5914, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.49% (0.7198 => 0.6875, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.48% (1.2221 => 1.1673, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.48% (0.6293 => 0.6011, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -4.48% (1.1450 => 1.0937, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.48% (0.6230 => 0.5951, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.48% (0.2278 => 0.2176, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: -4.48% (9.2283 => 8.8151, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.47% (1.2210 => 1.1664, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.45% (0.3323 => 0.3175, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.45% (0.5591 => 0.5342, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.45% (0.5863 => 0.5602, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.43% (0.2999 => 0.2866, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.42% (0.5478 => 0.5236, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -4.41% (0.7982 => 0.7630, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.41% (0.5925 => 0.5664, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.40% (0.7339 => 0.7016, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.39% (0.5581 => 0.5336, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.38% (0.3491 => 0.3338, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.37% (0.6681 => 0.6389, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.37% (6.7716 => 6.4757, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.35% (0.5705 => 0.5457, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.34% (2.2587 => 2.1606, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.34% (0.9557 => 0.9142, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.32% (0.6667 => 0.6379, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -4.31% (0.4524 => 0.4329, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.30% (0.3931 => 0.3762, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.29% (0.5456 => 0.5222, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.28% (0.6304 => 0.6034, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.25% (0.5857 => 0.5608, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.25% (0.6260 => 0.5994, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.21% (0.6676 => 0.6395, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.20% (0.6660 => 0.6380, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.19% (0.6395 => 0.6127, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.17% (0.6446 => 0.6177, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.17% (0.4916 => 0.4711, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: -4.17% (0.3406 => 0.3264, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.17% (0.5805 => 0.5563, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.17% (0.5569 => 0.5337, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.16% (0.2695 => 0.2583, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.15% (0.5802 => 0.5561, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.14% (0.6297 => 0.6036, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.14% (0.5575 => 0.5344, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.13% (0.5570 => 0.5340, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.13% (0.3319 => 0.3182, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.11% (0.5941 => 0.5697, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.10% (0.5849 => 0.5609, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.09% (0.6189 => 0.5936, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.08% (0.6440 => 0.6177, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -4.08% (0.7447 => 0.7143, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.05% (0.5859 => 0.5622, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -4.03% (15.5079 => 14.8825, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.01% (0.7524 => 0.7222, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.01% (0.6033 => 0.5791, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -3.97% (8.0126 => 7.6948, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.93% (0.5567 => 0.5348, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.87% (0.6736 => 0.6475, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.86% (0.6395 => 0.6148, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -3.85% (0.3271 => 0.3145, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: -3.85% (2.1401 => 2.0577, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -3.85% (0.5688 => 0.5469, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -3.83% (0.8418 => 0.8096, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: -3.71% (1.3864 => 1.3349, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.70% (0.7021 => 0.6761, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.69% (0.2985 => 0.2875, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: -3.67% (5.0226 => 4.8381, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: -3.63% (0.3581 => 0.3451, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -3.51% (3.5154 => 3.3921, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.35% (0.9077 => 0.8773, std.dev.: 0.0024) MultiSource/Applications/ClamAV/clamscan: -3.32% (15.2527 => 14.7466, std.dev.: 0.0032) MultiSource/Applications/hbd/hbd: -3.27% (1.5610 => 1.5099, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.06% (0.5329 => 0.5166, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -2.95% (1.1530 => 1.1190, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.15% (20.7746 => 20.3289, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7546, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/richards_benchmark: -8.66% (1.2842 => 1.1730, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7061, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.79% (2.2633 => 2.1776, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4742, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0001) Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 2 00:33:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 2 Nov 2012 02:33:41 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121102073341.749132A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5518?compare_to=5516&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5518, Order: 167282, Start Time: 2012-11-02 06:06:35, End Time: 2012-11-02 07:33:46 To: 5516, Order: 167281, Start Time: 2012-11-02 04:22:45, End Time: 2012-11-02 05:49:28 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 18 (91 on baseline) Performance Improvements: 0 (4 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 973 (879 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: 8.90% (0.1675 => 0.1824, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.85% (0.4987 => 0.5229, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 3.38% (0.4414 => 0.4563, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.30% (0.4852 => 0.5012, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.08% (0.3377 => 0.3481, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 2.43% (0.8185 => 0.8384, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.38% (0.8876 => 0.9087, std.dev.: 0.0039) MultiSource/Applications/treecc/treecc: 2.34% (2.0427 => 2.0906, std.dev.: 0.0170) MultiSource/Applications/hbd/hbd: 2.17% (1.4591 => 1.4907, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.04% (1.1914 => 1.2157, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.28% (1.4636 => 1.4824, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 1.16% (0.9942 => 1.0057, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 1.15% (15.2326 => 15.4071, std.dev.: 0.0381) MultiSource/Applications/ClamAV/clamscan: 1.02% (15.2242 => 15.3789, std.dev.: 0.0581) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 14.91% (24.8509 => 28.5566, std.dev.: 0.0672) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 4.98% (44.4035 => 46.6166, std.dev.: 0.4846) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.23% (4.4182 => 4.4727, std.dev.: 0.0163) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.05% (22.1948 => 22.4289, std.dev.: 0.0306) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.58% (16.7658 => 16.6688, std.dev.: 0.1914) MultiSource/Applications/obsequi/Obsequi: 1.80% (1.0552 => 1.0742, std.dev.: 0.0068) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.21% (21.7409 => 21.6949, std.dev.: 0.1018) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.22% (0.3659 => 0.3651, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 0.66% (0.6057 => 0.6097, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.54% (0.3344 => 0.3326, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: -0.40% (0.2000 => 0.1992, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 22.47% (0.0178 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 19.33% (0.0357 => 0.0426, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.30% (0.0273 => 0.0264, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 31.93% (0.0238 => 0.0314, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 15.85% (0.0366 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -17.65% (0.0204 => 0.0168, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/test1: -5.50% (0.0200 => 0.0189, std.dev.: 0.0032) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 3.36% (0.1427 => 0.1475, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.22% (1.1310 => 1.1285, std.dev.: 0.0110) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.14% (0.1466 => 0.1512, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.32% (0.4047 => 0.4060, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.79% (0.1324 => 0.1361, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.98% (0.0630 => 0.0586, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -14.62% (0.0253 => 0.0216, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.58% (0.0571 => 0.0580, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.70% (1.1365 => 1.1444, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -87.50% (0.0008 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.70% (0.0597 => 0.0557, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.55% (0.0183 => 0.0184, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.63% (0.7956 => 0.8006, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -13.56% (0.0059 => 0.0051, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2333.21% (0.6332 => 15.4071, std.dev.: 0.0381) MultiSource/Benchmarks/McCat/08-main/main: 48.39% (0.1831 => 0.2717, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.84% (0.1559 => 0.1468, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1485.35% (0.3344 => 5.3014, std.dev.: 0.0741) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.59% (0.2364 => 0.3229, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel: 1.86% (0.0429 => 0.0437, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.45% (0.0224 => 0.0223, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3441, std.dev.: 0.0136) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0745, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4929, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3429, std.dev.: 0.0158) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0180, std.dev.: 0.0240) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4003, std.dev.: 0.0059) SingleSource/Regression/C/uint64_to_float: -23.79% (2.1832 => 1.6639, std.dev.: 0.0262) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 13.40% (0.1112 => 0.1261, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.45% (0.2180 => 0.2386, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.21% (0.8321 => 0.9087, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.88% (0.1983 => 0.2159, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.88% (0.4847 => 0.5229, std.dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.85% (0.3137 => 0.3352, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.40% (0.1905 => 0.2027, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 5.98% (0.1721 => 0.1824, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.93% (0.7473 => 0.7916, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.64% (0.3295 => 0.3481, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 5.46% (0.7950 => 0.8384, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.45% (0.8148 => 0.8592, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.29% (0.6010 => 0.6328, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.12% (0.2519 => 0.2648, std.dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 4.81% (1.1271 => 1.1813, std.dev.: 0.0069) MultiSource/Applications/treecc/treecc: 4.80% (1.9948 => 2.0906, std.dev.: 0.0170) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.79% (0.4783 => 0.5012, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.75% (1.1606 => 1.2157, std.dev.: 0.0053) MultiSource/Applications/Burg/burg: 4.74% (1.2222 => 1.2801, std.dev.: 0.0204) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.60% (0.2240 => 0.2343, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.48% (0.9435 => 0.9858, std.dev.: 0.0085) MultiSource/Applications/hbd/hbd: 4.47% (1.4269 => 1.4907, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.43% (0.4559 => 0.4761, std.dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 4.36% (1.2568 => 1.3116, std.dev.: 0.0175) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.35% (6.6074 => 6.8946, std.dev.: 0.0596) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.22% (1.1685 => 1.2178, std.dev.: 0.0050) MultiSource/Applications/ClamAV/clamscan: 4.13% (14.7684 => 15.3789, std.dev.: 0.0581) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.84% (0.2998 => 0.3113, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.80% (0.3003 => 0.3117, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: 3.79% (3.2366 => 3.3593, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.79% (2.1401 => 2.2212, std.dev.: 0.0143) MultiSource/Benchmarks/McCat/05-eks/eks: 3.78% (0.4397 => 0.4563, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.76% (0.5961 => 0.6185, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.65% (0.2741 => 0.2841, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.53% (0.5191 => 0.5374, std.dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: 3.50% (14.2605 => 14.7594, std.dev.: 0.1219) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.20% (0.3717 => 0.3836, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 3.11% (3.8189 => 3.9378, std.dev.: 0.0311) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.11% (0.6586 => 0.6791, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.06% (8.6476 => 8.9119, std.dev.: 0.0379) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.94% (4.1763 => 4.2990, std.dev.: 0.0420) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.76% (0.9069 => 0.9319, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.76% (1.3279 => 1.3645, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.68% (0.8069 => 0.8285, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.66% (0.8716 => 0.8948, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.65% (0.8050 => 0.8263, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.63% (0.8597 => 0.8823, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.61% (0.8611 => 0.8836, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.56% (4.4873 => 4.6023, std.dev.: 0.0417) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.54% (0.8331 => 0.8543, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.52% (0.8204 => 0.8411, std.dev.: 0.0074) MultiSource/Applications/hexxagon/hexxagon: 2.52% (0.9810 => 1.0057, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.47% (0.7966 => 0.8163, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.47% (0.8420 => 0.8628, std.dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 2.45% (15.3280 => 15.7041, std.dev.: 0.1175) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.43% (0.8286 => 0.8487, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.41% (0.9074 => 0.9293, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.39% (0.8518 => 0.8722, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.38% (1.4479 => 1.4824, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.38% (0.7932 => 0.8121, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.36% (0.8805 => 0.9013, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.36% (1.2602 => 1.2899, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.36% (0.8317 => 0.8513, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.35% (0.9056 => 0.9269, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.34% (0.8712 => 0.8916, std.dev.: 0.0033) MultiSource/Applications/lemon/lemon: 2.32% (1.0945 => 1.1199, std.dev.: 0.0032) MultiSource/Applications/siod/siod: 2.31% (2.2184 => 2.2696, std.dev.: 0.0131) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.30% (0.8340 => 0.8532, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.26% (0.8086 => 0.8269, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.23% (0.8177 => 0.8359, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.21% (0.8927 => 0.9124, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.17% (0.8855 => 0.9047, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.17% (0.8261 => 0.8440, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 2.15% (8.6247 => 8.8103, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.12% (13.1811 => 13.4609, std.dev.: 0.0870) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.03% (0.8656 => 0.8832, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.98% (0.8048 => 0.8207, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.91% (3.1832 => 3.2439, std.dev.: 0.0232) MultiSource/Benchmarks/Bullet/bullet: 1.76% (31.8598 => 32.4221, std.dev.: 0.0417) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.67% (0.8316 => 0.8455, std.dev.: 0.0041) MultiSource/Benchmarks/PAQ8p/paq8p: 1.37% (2.3764 => 2.4090, std.dev.: 0.0083) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 57.11% (1.5795 => 2.4816, std.dev.: 0.0145) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.28% (2.7978 => 3.7289, std.dev.: 0.0115) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.96% (2.4333 => 2.6757, std.dev.: 0.0572) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.10% (1.1857 => 1.2817, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 5.93% (63.1822 => 66.9280, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/distray/distray: 4.85% (0.2390 => 0.2506, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 4.61% (44.5605 => 46.6166, std.dev.: 0.4846) MultiSource/Applications/siod/siod: 2.69% (3.6643 => 3.7627, std.dev.: 0.0148) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.47% (2.4490 => 2.5094, std.dev.: 0.0207) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.32% (0.7597 => 0.7773, std.dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -30.77% (0.0338 => 0.0234, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.92% (0.3269 => 0.3010, std.dev.: 0.0016) MultiSource/Applications/lua/lua: -5.23% (29.8330 => 28.2738, std.dev.: 0.2410) SingleSource/Benchmarks/Shootout-C++/hash2: -1.50% (3.4237 => 3.3723, std.dev.: 0.0125) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.35% (16.4461 => 16.6688, std.dev.: 0.1914) MultiSource/Applications/obsequi/Obsequi: 4.68% (1.0262 => 1.0742, std.dev.: 0.0068) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6846.81% (0.3123 => 21.6949, std.dev.: 0.1018) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.23% (0.2463 => 0.3651, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 1.45% (0.6010 => 0.6097, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.84% (0.3266 => 0.3326, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: 1.17% (0.1969 => 0.1992, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.94% (0.0254 => 0.0264, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -11.58% (0.0190 => 0.0168, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/test1: 5.00% (0.0180 => 0.0189, std.dev.: 0.0032) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.57% (0.1438 => 0.1475, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.39% (1.1329 => 1.1285, std.dev.: 0.0110) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.42% (0.1462 => 0.1512, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.50% (0.4164 => 0.4060, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.58% (0.1369 => 0.1361, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.58% (0.0641 => 0.0586, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 10.77% (0.0195 => 0.0216, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.35% (0.0578 => 0.0580, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.06% (1.1437 => 1.1444, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.16% (0.0627 => 0.0557, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.22% (0.0180 => 0.0184, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.14% (0.8017 => 0.8006, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -17.74% (0.0062 => 0.0051, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 2 01:21:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 2 Nov 2012 03:21:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121102082128.D74C52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5519?compare_to=5517&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5519, Order: 167282, Start Time: 2012-11-02 06:52:31, End Time: 2012-11-02 08:21:30 To: 5517, Order: 167281, Start Time: 2012-11-02 05:03:46, End Time: 2012-11-02 06:29:05 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (167 on baseline) Unchanged Tests: 1042 (870 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.31% (1.2783 => 1.3718, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.15% (3.1919 => 3.4200, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.02% (2.0478 => 2.1096, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.4937 => 7.6784, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/hash2: 2.07% (3.1932 => 3.2592, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.40% (0.1584 => 0.1451, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.90% (0.1431 => 0.1318, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.65% (0.3821 => 0.3567, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -6.56% (2.4924 => 2.3289, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -6.35% (0.3812 => 0.3570, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.34% (0.3831 => 0.3588, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.30% (0.3891 => 0.3646, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-3: -6.29% (0.3848 => 0.3606, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.26% (0.3884 => 0.3641, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: -6.24% (0.3896 => 0.3653, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.24% (0.3880 => 0.3638, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions: -6.18% (0.4176 => 0.3918, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.17% (0.4033 => 0.3784, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.98% (0.4199 => 0.3948, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.89% (0.2428 => 0.2285, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -5.89% (0.4280 => 0.4028, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -5.67% (0.3142 => 0.2964, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.66% (0.3658 => 0.3451, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.63% (22.4056 => 21.1452, std.dev.: 0.0221) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.61% (4.5069 => 4.2539, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.61% (0.4151 => 0.3918, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.53% (3.5339 => 3.3383, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/ReedSolomon: -5.53% (0.1879 => 0.1775, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.53% (0.3057 => 0.2888, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -5.52% (0.3025 => 0.2858, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -5.49% (0.2989 => 0.2825, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.48% (0.9542 => 0.9019, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.47% (0.3837 => 0.3627, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/random: -5.44% (0.2939 => 0.2779, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.44% (0.2903 => 0.2745, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.43% (0.2871 => 0.2715, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -5.43% (7.0961 => 6.7106, std.dev.: 0.1353) SingleSource/Benchmarks/Shootout-C++/ary: -5.42% (0.3394 => 0.3210, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -5.42% (16.1920 => 15.3144, std.dev.: 0.2566) SingleSource/Benchmarks/Shootout-C++/objinst: -5.42% (0.3194 => 0.3021, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.42% (2.1713 => 2.0537, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: -5.41% (0.2849 => 0.2695, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -5.40% (0.3481 => 0.3293, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -5.40% (0.3446 => 0.3260, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.36% (0.3323 => 0.3145, std.dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: -5.33% (0.3059 => 0.2896, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.32% (0.6484 => 0.6139, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -5.31% (0.6347 => 0.6010, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.27% (0.2355 => 0.2231, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -5.19% (1.3148 => 1.2466, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.17% (0.3849 => 0.3650, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -5.16% (0.3621 => 0.3434, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: -5.16% (4.3330 => 4.1096, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/except: -5.16% (0.3026 => 0.2870, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -5.15% (0.2659 => 0.2522, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -5.15% (0.3205 => 0.3040, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.13% (1.0544 => 1.0003, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.11% (4.8802 => 4.6309, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.10% (0.2548 => 0.2418, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.10% (1.2784 => 1.2132, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/oourafft: -5.09% (0.2160 => 0.2050, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.09% (4.8161 => 4.5709, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists1: -5.02% (0.3867 => 0.3673, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.01% (0.3255 => 0.3092, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.01% (4.0323 => 3.8304, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.01% (0.3016 => 0.2865, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.00% (1.6474 => 1.5650, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: -5.00% (0.7779 => 0.7390, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: -4.99% (0.4248 => 0.4036, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.98% (5.4682 => 5.1958, std.dev.: 0.0213) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.95% (0.9852 => 0.9364, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: -4.94% (0.4861 => 0.4621, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -4.94% (34.0927 => 32.4095, std.dev.: 0.0257) SingleSource/UnitTests/ObjC++/property-reference-object: -4.94% (0.6441 => 0.6123, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -4.91% (0.4524 => 0.4302, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.91% (0.8521 => 0.8103, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.89% (0.3252 => 0.3093, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.78% (0.4083 => 0.3888, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.77% (0.6293 => 0.5993, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: -4.76% (0.6750 => 0.6429, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.72% (1.2300 => 1.1720, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.71% (0.2933 => 0.2795, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -4.70% (4.0594 => 3.8687, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.69% (1.3722 => 1.3079, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/sieve: -4.65% (0.3788 => 0.3612, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.65% (14.2083 => 13.5483, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: -4.64% (0.9179 => 0.8753, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.63% (0.4813 => 0.4590, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.61% (0.4427 => 0.4223, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -4.60% (17.1032 => 16.3159, std.dev.: 0.0251) MultiSource/Applications/lemon/lemon: -4.60% (1.1450 => 1.0923, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.58% (0.7919 => 0.7556, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.57% (0.6230 => 0.5945, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.57% (0.5999 => 0.5725, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: -4.53% (18.2933 => 17.4646, std.dev.: 0.0255) MultiSource/Benchmarks/mafft/pairlocalalign: -4.48% (9.2283 => 8.8146, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.47% (0.6194 => 0.5917, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.47% (0.7339 => 0.7011, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.47% (0.5863 => 0.5601, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.47% (1.2221 => 1.1675, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.46% (0.5925 => 0.5661, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.45% (1.6364 => 1.5636, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.44% (1.4642 => 1.3992, std.dev.: 0.0096) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.43% (6.7716 => 6.4719, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.39% (0.6304 => 0.6027, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.38% (0.3491 => 0.3338, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.38% (0.5591 => 0.5346, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.38% (0.3931 => 0.3759, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.37% (0.5581 => 0.5337, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.37% (0.5857 => 0.5601, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.37% (1.2210 => 1.1677, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.36% (0.6667 => 0.6376, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.36% (0.3483 => 0.3331, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.36% (0.5478 => 0.5239, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -4.34% (0.4515 => 0.4319, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.33% (0.9557 => 0.9143, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -4.32% (0.7447 => 0.7125, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: -4.32% (0.2985 => 0.2856, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.32% (0.5859 => 0.5606, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.31% (0.4916 => 0.4704, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.31% (0.7198 => 0.6888, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.30% (0.4321 => 0.4135, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.27% (0.5456 => 0.5223, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.26% (0.6660 => 0.6376, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.25% (0.5805 => 0.5558, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.25% (0.5575 => 0.5338, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.22% (0.5849 => 0.5602, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: -4.22% (0.3581 => 0.3430, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -4.21% (0.7982 => 0.7646, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.20% (0.6446 => 0.6175, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.20% (2.2587 => 2.1638, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.19% (0.6297 => 0.6033, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.19% (0.6260 => 0.5998, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.16% (0.6052 => 0.5800, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.15% (0.5570 => 0.5339, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.12% (0.6676 => 0.6401, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.11% (0.6395 => 0.6132, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.09% (0.6189 => 0.5936, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.08% (0.5705 => 0.5472, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.08% (0.6440 => 0.6177, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.08% (0.3406 => 0.3267, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.05% (0.5802 => 0.5567, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.04% (0.2695 => 0.2586, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.04% (0.5569 => 0.5344, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.01% (0.7524 => 0.7222, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -3.95% (8.0126 => 7.6958, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: -3.94% (0.3271 => 0.3142, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.91% (0.6395 => 0.6145, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.91% (0.5941 => 0.5709, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.90% (0.6033 => 0.5798, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.89% (0.6736 => 0.6474, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.88% (0.5567 => 0.5351, std.dev.: 0.0055) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.86% (0.3319 => 0.3191, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -3.80% (0.5688 => 0.5472, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.73% (0.7021 => 0.6759, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -3.73% (1.3864 => 1.3347, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/loader/loader: -3.70% (0.2999 => 0.2888, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.60% (0.5168 => 0.4982, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -3.33% (15.2527 => 14.7444, std.dev.: 0.0176) MultiSource/Applications/hbd/hbd: -3.16% (1.5610 => 1.5117, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.06% (0.5329 => 0.5166, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.96% (0.9077 => 0.8808, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: -2.94% (1.1530 => 1.1191, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -2.22% (20.7746 => 20.3132, std.dev.: 0.0654) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7564, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/richards_benchmark: -8.74% (1.2842 => 1.1720, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.94% (1.7753 => 1.7054, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.84% (2.2633 => 2.1763, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.61% (1.3096 => 1.2754, std.dev.: 0.0077) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4698, std.dev.: 0.0030) Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 2 01:47:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 2 Nov 2012 03:47:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121102084747.C917F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5520?compare_to=5515&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5520, Order: 167281, Start Time: 2012-11-02 05:29:41, End Time: 2012-11-02 08:47:51 To: 5515, Order: 167266, Start Time: 2012-11-02 01:26:02, End Time: 2012-11-02 04:41:24 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (171 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (719 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.48% (0.2086 => 0.2242, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.30% (120.3144 => 127.8909, std.dev.: 1.8350) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.76% (0.0625 => 0.0886, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.36% (0.1063 => 0.1407, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.36% (0.2969 => 0.3722, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.86% (0.1106 => 0.1381, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 24.71% (1.5932 => 1.9869, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.64% (0.4253 => 0.5301, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.45% (0.4139 => 0.5151, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.09% (0.0714 => 0.0886, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.41% (0.5900 => 0.7281, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.29% (0.4994 => 0.6157, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.67% (0.0547 => 0.0671, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.53% (0.0475 => 0.0582, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.42% (0.5000 => 0.6121, std.dev.: 0.0056) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.26% (0.0584 => 0.0714, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.96% (0.0897 => 0.1094, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.48% (0.1620 => 0.1968, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 21.20% (0.0599 => 0.0726, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.12% (0.1103 => 0.1336, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 20.86% (0.1021 => 0.1234, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.60% (0.1107 => 0.1335, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 20.36% (0.0604 => 0.0727, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.06% (0.0633 => 0.0760, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 20.04% (0.0948 => 0.1138, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.94% (0.0642 => 0.0770, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.69% (0.0584 => 0.0699, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.59% (0.0541 => 0.0647, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.57% (0.3903 => 0.4667, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.51% (0.1604 => 0.1917, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.43% (0.1549 => 0.1850, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 19.37% (0.0821 => 0.0980, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.34% (0.1003 => 0.1197, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.22% (0.0822 => 0.0980, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 19.21% (0.1619 => 0.1930, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 18.30% (0.5826 => 0.6892, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.19% (0.1462 => 0.1728, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 18.17% (0.5889 => 0.6959, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.97% (0.3890 => 0.4589, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 17.95% (0.0808 => 0.0953, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.93% (0.1160 => 0.1368, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 17.85% (0.0947 => 0.1116, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.58% (0.2014 => 0.2368, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 17.49% (0.1218 => 0.1431, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.36% (1.3152 => 1.5435, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.25% (0.2736 => 0.3208, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.20% (0.2866 => 0.3359, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 17.19% (0.0698 => 0.0818, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.19% (0.1088 => 0.1275, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 17.15% (0.4029 => 0.4720, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 16.94% (0.1505 => 0.1760, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 16.92% (1.8794 => 2.1974, std.dev.: 0.0049) MultiSource/Applications/hbd/hbd: 16.73% (0.9697 => 1.1319, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 16.71% (0.5546 => 0.6473, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.41% (3.5627 => 4.1472, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.36% (0.2738 => 0.3186, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.29% (0.4658 => 0.5417, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.21% (0.2875 => 0.3341, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.14% (0.3271 => 0.3799, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.14% (0.5026 => 0.5837, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.03% (0.3930 => 0.4560, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference: 16.02% (0.7171 => 0.8320, std.dev.: 0.0027) MultiSource/Applications/d/make_dparser: 16.01% (1.0781 => 1.2507, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.94% (1.6211 => 1.8795, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 15.85% (0.2750 => 0.3186, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 15.74% (0.2725 => 0.3154, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 15.73% (0.1284 => 0.1486, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.70% (0.1968 => 0.2277, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.53% (0.2911 => 0.3363, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 15.51% (0.3004 => 0.3470, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hello: 15.51% (0.2714 => 0.3135, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.39% (0.2729 => 0.3149, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 15.36% (0.2780 => 0.3207, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 15.34% (4.2109 => 4.8568, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 15.29% (0.9909 => 1.1424, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.27% (0.3195 => 0.3683, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 15.27% (0.1421 => 0.1638, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 15.23% (0.2811 => 0.3239, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.19% (0.2792 => 0.3216, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 15.18% (0.2813 => 0.3240, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.16% (0.3060 => 0.3524, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/random: 15.16% (0.2803 => 0.3228, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.13% (0.4361 => 0.5021, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.12% (2.0673 => 2.3798, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wc: 15.12% (0.3096 => 0.3564, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.06% (4.4195 => 5.0852, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/ary3: 15.06% (0.3267 => 0.3759, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 15.05% (0.2823 => 0.3248, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.05% (0.1090 => 0.1254) MultiSource/Benchmarks/Bullet/bullet: 15.04% (23.5202 => 27.0571, std.dev.: 0.0276) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.02% (0.3282 => 0.3775, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary: 14.92% (0.3258 => 0.3744, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 14.74% (0.3317 => 0.3806, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.69% (0.3362 => 0.3856, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.64% (2.7292 => 3.1288, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.61% (1.9694 => 2.2571, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.39% (1.9966 => 2.2840, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.21% (0.3124 => 0.3568, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 14.13% (0.3348 => 0.3821, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 14.07% (0.2566 => 0.2927, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 13.92% (0.3678 => 0.4190, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 13.72% (0.3477 => 0.3954, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 13.66% (0.3726 => 0.4235, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.66% (0.3625 => 0.4120, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 13.45% (1.4269 => 1.6188, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 13.41% (0.4146 => 0.4702, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 13.39% (0.4251 => 0.4820, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.28% (0.3690 => 0.4180, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 13.25% (0.2075 => 0.2350, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.16% (0.3981 => 0.4505, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.11% (0.3845 => 0.4349, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 13.03% (0.7875 => 0.8901, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-2: 12.97% (0.3446 => 0.3893, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 12.83% (0.5012 => 0.5655, std.dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 12.76% (2.1653 => 2.4417, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/property: 12.63% (0.3650 => 0.4111, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.59% (0.3488 => 0.3927, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 12.53% (0.3465 => 0.3899, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.50% (0.3496 => 0.3933, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 12.49% (0.3460 => 0.3892, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 12.41% (0.2691 => 0.3025, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: 12.41% (0.3442 => 0.3869, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 12.40% (4.6177 => 5.1901, std.dev.: 0.0188) SingleSource/UnitTests/ObjC/synchronized: 12.37% (0.3469 => 0.3898, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 12.19% (2.1013 => 2.3575, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions: 12.08% (0.3643 => 0.4083, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 12.06% (0.3724 => 0.4173, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.78% (0.6435 => 0.7193, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 11.56% (5.5417 => 6.1821, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.27% (0.2040 => 0.2270, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.19% (0.1028 => 0.1143, std.dev.: 0.0044) MultiSource/Applications/lambda-0_1_3/lambda: 11.03% (0.3498 => 0.3884, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 10.85% (0.6634 => 0.7354, std.dev.: 0.0049) MultiSource/Applications/minisat/minisat: 10.67% (0.3336 => 0.3692, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.54% (0.2068 => 0.2286, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 10.46% (0.4847 => 0.5354, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.45% (0.2737 => 0.3023, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.34% (0.1383 => 0.1526, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.28% (0.3084 => 0.3401, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.46% (0.2103 => 0.2302, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 9.30% (2.0346 => 2.2238, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.84% (4.6926 => 5.1076, std.dev.: 0.0040) MultiSource/Applications/lemon/lemon: 8.70% (0.2391 => 0.2599, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.44% (11.6398 => 12.6222, std.dev.: 0.0239) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.43% (0.5361 => 0.5813, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.56% (0.5584 => 0.6006, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.53% (0.7426 => 0.7985, std.dev.: 0.0052) MultiSource/Applications/kimwitu++/kc: 6.66% (11.9555 => 12.7517, std.dev.: 0.0166) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.67% (0.3792 => 0.3931, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6534, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.12% (0.0734 => 0.0845, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 8.46% (0.2802 => 0.3039, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.63% (3.3903 => 3.6152, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 5.66% (0.2122 => 0.2242, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 5.09% (12.0509 => 12.6642, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1695, std.dev.: 0.0439) SingleSource/Benchmarks/Misc/flops-2: 4.52% (1.8057 => 1.8873, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.95% (0.3693 => 0.3839, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/dry: 3.37% (14.0481 => 14.5218, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1919, std.dev.: 0.0676) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.78% (3.1722 => 3.2287, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.56% (2.0820 => 2.1144, std.dev.: 0.0090) MultiSource/Applications/viterbi/viterbi: 1.48% (46.6247 => 47.3125, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2856, std.dev.: 0.0052) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.26% (1.0142 => 1.0270, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5147, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5841, std.dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.25% (25.4195 => 16.4596, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/ary2: -10.49% (0.2402 => 0.2150, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9813, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.66% (35.5013 => 32.7835, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: -7.32% (2.1113 => 1.9568, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -3.16% (17.2379 => 16.6936, std.dev.: 0.0491) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7733, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -2.93% (3.6262 => 3.5201, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.64% (11.2080 => 10.9119, std.dev.: 0.0193) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.20% (41.7953 => 40.8754, std.dev.: 0.0113) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.83% (0.6293 => 0.6178, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.69% (10.7630 => 10.5806, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4950, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7165, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.20% (105.3826 => 104.1230, std.dev.: 0.1878) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0450, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.04% (3.3991 => 3.3638, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 2 02:39:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 2 Nov 2012 04:39:35 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121102093935.ADCB52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5521?compare_to=5518&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5521, Order: 167285, Start Time: 2012-11-02 08:11:51, End Time: 2012-11-02 09:39:40 To: 5518, Order: 167282, Start Time: 2012-11-02 06:06:35, End Time: 2012-11-02 07:33:46 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 8 (106 on baseline) Performance Improvements: 2 (4 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 981 (864 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.72% (0.6431 => 0.6606, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/football/football: 1.87% (0.8897 => 0.9063, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.06% (1.0159 => 1.0267, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.04% (1.2178 => 1.2305, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 20.64% (0.0528 => 0.0637, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.70% (1.4107 => 1.4347, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/pi: 1.33% (2.4816 => 2.5147, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/whetstone: 1.25% (2.1182 => 2.1446, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.36% (22.4289 => 21.4503, std.dev.: 0.3555) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.13% (11.5866 => 11.4558, std.dev.: 0.0072) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.98% (16.6688 => 16.8326, std.dev.: 0.2141) MultiSource/Applications/obsequi/Obsequi: 1.07% (1.0742 => 1.0857, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.18% (21.6949 => 21.7342, std.dev.: 0.3087) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.11% (0.3651 => 0.3655, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/bigfib: -1.10% (0.6097 => 0.6030, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.24% (0.3326 => 0.3318, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 0.85% (0.1992 => 0.2009, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.92% (0.0218 => 0.0220, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.99% (0.0426 => 0.0409, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 26.52% (0.0264 => 0.0334, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -14.01% (0.0314 => 0.0270, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.24% (0.0424 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 21.43% (0.0168 => 0.0204, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -8.99% (0.0189 => 0.0172, std.dev.: 0.0025) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -4.27% (0.1475 => 0.1412, std.dev.: 0.0035) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 4.56% (1.1285 => 1.1800, std.dev.: 0.0091) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1512 => 0.1511, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.44% (0.4060 => 0.4159, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.91% (0.1361 => 0.1335, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.90% (0.0586 => 0.0644, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 25.93% (0.0216 => 0.0272, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.59% (0.0580 => 0.0536, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.35% (1.1444 => 1.1484, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 17.06% (0.0557 => 0.0652, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.61% (0.0184 => 0.0198, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.34% (0.8006 => 0.7979, std.dev.: 0.0128) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -23.53% (0.0051 => 0.0039, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2341.55% (0.6332 => 15.4599, std.dev.: 0.1193) MultiSource/Benchmarks/McCat/08-main/main: 49.43% (0.1831 => 0.2736, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.70% (0.1559 => 0.1439, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1494.02% (0.3344 => 5.3304, std.dev.: 0.0832) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.84% (0.2364 => 0.3235, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0429 => 0.0439, std.dev.: 0.0015) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.25% (0.0224 => 0.0238, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3557, std.dev.: 0.1298) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0686, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4941, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3531, std.dev.: 0.0274) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0612, std.dev.: 0.0328) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4091, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: -24.09% (2.1832 => 1.6573, std.dev.: 0.0189) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.99% (0.0810 => 0.0980, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: 14.93% (0.1112 => 0.1278, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.85% (0.0848 => 0.0957, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.36% (0.2180 => 0.2384, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.31% (0.3137 => 0.3429, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.00% (0.6010 => 0.6491, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.96% (0.4847 => 0.5233, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.29% (0.8321 => 0.8928, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.92% (0.7473 => 0.7990, std.dev.: 0.0198) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.91% (1.1606 => 1.2408, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.2279 => 0.2435, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.70% (0.2240 => 0.2390, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.55% (0.2519 => 0.2684, std.dev.: 0.0043) MultiSource/Applications/viterbi/viterbi: 6.47% (0.1577 => 0.1679, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.45% (0.1983 => 0.2111, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.58% (0.3295 => 0.3479, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.31% (1.1685 => 1.2305, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.07% (0.6287 => 0.6606, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.00% (0.2998 => 0.3148, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: 4.88% (1.2222 => 1.2819, std.dev.: 0.0045) MultiSource/Applications/spiff/spiff: 4.59% (0.7950 => 0.8315, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 4.57% (0.3503 => 0.3663, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.26% (0.4559 => 0.4753, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.25% (0.6586 => 0.6866, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.24% (0.9435 => 0.9835, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.18% (2.1401 => 2.2295, std.dev.: 0.0225) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.10% (0.3003 => 0.3126, std.dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 4.04% (1.1271 => 1.1726, std.dev.: 0.0109) MultiSource/Applications/sgefa/sgefa: 4.00% (0.2999 => 0.3119, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.97% (8.6476 => 8.9907, std.dev.: 0.0454) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.95% (1.2602 => 1.3100, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.5191 => 0.5396, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.90% (0.2741 => 0.2848, std.dev.: 0.0024) MultiSource/Applications/ClamAV/clamscan: 3.84% (14.7684 => 15.3354, std.dev.: 0.1646) MultiSource/Applications/SIBsim4/SIBsim4: 3.81% (1.2568 => 1.3047, std.dev.: 0.0171) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.71% (0.3717 => 0.3855, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 3.69% (3.8189 => 3.9600, std.dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.66% (6.6074 => 6.8492, std.dev.: 0.0286) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.62% (0.9908 => 1.0267, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 3.60% (3.2366 => 3.3532, std.dev.: 0.0205) MultiSource/Benchmarks/MallocBench/gs/gs: 3.58% (4.1305 => 4.2785, std.dev.: 0.0312) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.43% (0.8697 => 0.8995, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.38% (3.1832 => 3.2907, std.dev.: 0.0376) MultiSource/Benchmarks/Prolangs-C/football/football: 3.36% (0.8768 => 0.9063, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.30% (4.4873 => 4.6354, std.dev.: 0.0103) MultiSource/Applications/hbd/hbd: 3.27% (1.4269 => 1.4736, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/hash: 3.18% (0.3800 => 0.3921, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.16% (0.5817 => 0.6001, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.14% (1.1170 => 1.1521, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.13% (0.8855 => 0.9132, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.01% (4.5702 => 4.7079, std.dev.: 0.0223) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.01% (0.9069 => 0.9342, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 2.98% (14.2605 => 14.6858, std.dev.: 0.0695) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.91% (4.1763 => 4.2980, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.89% (0.7966 => 0.8196, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.81% (0.8611 => 0.8853, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 2.76% (0.4125 => 0.4239, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.76% (0.4127 => 0.4241, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.72% (0.8086 => 0.8306, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.71% (0.8204 => 0.8426, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 2.70% (1.0945 => 1.1240, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.67% (0.8317 => 0.8539, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.66% (4.4880 => 4.6076, std.dev.: 0.0302) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.58% (0.8457 => 0.8675, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.55% (0.8712 => 0.8934, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.48% (0.8069 => 0.8269, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.47% (0.9074 => 0.9298, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.44% (13.1811 => 13.5022, std.dev.: 0.0343) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.44% (0.8007 => 0.8202, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.40% (0.8286 => 0.8485, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.39% (0.9056 => 0.9272, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 2.37% (8.6247 => 8.8293, std.dev.: 0.0715) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.31% (0.9688 => 0.9912, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.31% (0.8177 => 0.8366, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.30% (0.8359 => 0.8551, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.29% (0.8261 => 0.8450, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.28% (0.8656 => 0.8853, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.23% (0.8066 => 0.8246, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.23% (1.5315 => 1.5656, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.22% (0.7932 => 0.8108, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.19% (0.8885 => 0.9080, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.15% (0.9039 => 0.9233, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.15% (0.8716 => 0.8903, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.06% (0.8048 => 0.8214, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.02% (0.8420 => 0.8590, std.dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: 2.01% (31.8598 => 32.5003, std.dev.: 0.1568) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.98% (0.8316 => 0.8481, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.93% (0.8338 => 0.8499, std.dev.: 0.0039) MultiSource/Applications/JM/lencod/lencod: 1.74% (15.3280 => 15.5951, std.dev.: 0.0758) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.73% (1.2423 => 1.2638, std.dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: 1.52% (0.9810 => 0.9959, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.3764 => 2.4095, std.dev.: 0.0115) MultiSource/Applications/lambda-0_1_3/lambda: 1.39% (0.7557 => 0.7662, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 59.21% (1.5795 => 2.5147, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.48% (2.7978 => 3.7344, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 20.64% (0.0528 => 0.0637, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.06% (2.4333 => 2.6781, std.dev.: 0.0258) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 6.73% (1.1857 => 1.2655, std.dev.: 0.0067) MultiSource/Benchmarks/mafft/pairlocalalign: 5.92% (63.1822 => 66.9228, std.dev.: 0.0449) MultiSource/Benchmarks/FreeBench/distray/distray: 4.23% (0.2390 => 0.2491, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.06% (0.6205 => 0.6395, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/ReedSolomon: 2.87% (8.5322 => 8.7773, std.dev.: 0.0064) MultiSource/Applications/siod/siod: 2.57% (3.6643 => 3.7584, std.dev.: 0.0217) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.48% (0.4031 => 0.4131, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: 2.00% (2.3560 => 2.4031, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/whetstone: 1.05% (2.1224 => 2.1446, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.13% (0.3269 => 0.3036, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -4.88% (29.8330 => 28.3784, std.dev.: 0.1201) SingleSource/Benchmarks/Shootout-C++/hash2: -1.42% (3.4237 => 3.3750, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.25% (3.3479 => 3.3059, std.dev.: 0.0135) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.35% (16.4461 => 16.8326, std.dev.: 0.2141) MultiSource/Applications/obsequi/Obsequi: 5.80% (1.0262 => 1.0857, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6859.40% (0.3123 => 21.7342, std.dev.: 0.3087) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.40% (0.2463 => 0.3655, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/bigfib: 0.33% (0.6010 => 0.6030, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.59% (0.3266 => 0.3318, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 2.03% (0.1969 => 0.2009, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.25% (0.0408 => 0.0409, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.50% (0.0254 => 0.0334, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -10.60% (0.0302 => 0.0270, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -4.44% (0.0180 => 0.0172, std.dev.: 0.0025) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -1.81% (0.1438 => 0.1412, std.dev.: 0.0035) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 4.16% (1.1329 => 1.1800, std.dev.: 0.0091) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.35% (0.1462 => 0.1511, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.12% (0.4164 => 0.4159, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.48% (0.1369 => 0.1335, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.47% (0.0641 => 0.0644, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 39.49% (0.0195 => 0.0272, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.27% (0.0578 => 0.0536, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.41% (1.1437 => 1.1484, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.99% (0.0627 => 0.0652, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 10.00% (0.0180 => 0.0198, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.47% (0.8017 => 0.7979, std.dev.: 0.0128) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -37.10% (0.0062 => 0.0039, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 2 03:11:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 2 Nov 2012 05:11:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121102101103.F2C792A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5522?compare_to=5519&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5522, Order: 167285, Start Time: 2012-11-02 08:45:00, End Time: 2012-11-02 10:10:25 To: 5519, Order: 167282, Start Time: 2012-11-02 06:52:31, End Time: 2012-11-02 08:21:30 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 1 (174 on baseline) Unchanged Tests: 1041 (863 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.08% (1.4307 => 1.4152, std.dev.: 0.0054) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.15% (3.1919 => 3.4200, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.76% (2.0478 => 2.1043, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/salsa20: 2.29% (7.4937 => 7.6654, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/hash2: 2.15% (3.1932 => 3.2620, std.dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.40% (0.1584 => 0.1451, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.90% (0.1431 => 0.1318, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.88% (0.3821 => 0.3558, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.60% (2.4924 => 2.3280, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: -6.32% (0.3831 => 0.3589, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/trivial-interface: -6.30% (0.3812 => 0.3572, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -6.21% (0.3880 => 0.3639, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.19% (0.3896 => 0.3655, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.17% (0.3891 => 0.3651, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.13% (0.3848 => 0.3612, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -6.12% (0.4033 => 0.3786, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -6.06% (0.4176 => 0.3923, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.02% (0.3884 => 0.3650, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/property: -5.91% (0.4199 => 0.3951, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.89% (0.2428 => 0.2285, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.87% (0.9542 => 0.8982, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -5.82% (0.3142 => 0.2959, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -5.79% (0.4280 => 0.4032, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -5.69% (0.1879 => 0.1772, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.64% (22.4056 => 21.1429, std.dev.: 0.0192) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.60% (0.3658 => 0.3453, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.56% (0.4151 => 0.3920, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.55% (4.5069 => 4.2569, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.52% (3.5339 => 3.3390, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: -5.51% (7.0961 => 6.7053, std.dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: -5.48% (0.3357 => 0.3173, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: -5.46% (16.1920 => 15.3077, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/strcat: -5.45% (0.2989 => 0.2826, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -5.42% (0.3025 => 0.2861, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.42% (0.3837 => 0.3629, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -5.40% (0.3446 => 0.3260, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.40% (0.3057 => 0.2892, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.36% (0.2871 => 0.2717, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -5.34% (0.3481 => 0.3295, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.34% (0.2903 => 0.2748, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.30% (2.1713 => 2.0562, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/random: -5.27% (0.2939 => 0.2784, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -5.26% (1.3148 => 1.2456, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary: -5.24% (0.3394 => 0.3216, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -5.23% (0.2160 => 0.2047, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: -5.23% (0.3059 => 0.2899, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -5.23% (0.2849 => 0.2700, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.23% (0.3194 => 0.3027, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.22% (0.2355 => 0.2232, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -5.18% (0.6347 => 0.6018, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.18% (4.0323 => 3.8234, std.dev.: 0.0139) MultiSource/Benchmarks/MallocBench/gs/gs: -5.18% (4.3330 => 4.1086, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: -5.17% (0.7779 => 0.7377, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wc: -5.15% (0.3205 => 0.3040, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.14% (0.3849 => 0.3651, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.10% (1.2784 => 1.2132, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/except: -5.09% (0.3026 => 0.2872, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.06% (0.2548 => 0.2419, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.05% (0.9852 => 0.9354, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -5.05% (0.3621 => 0.3438, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.04% (4.8802 => 4.6344, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: -5.01% (0.4248 => 0.4035, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.01% (4.8161 => 4.5748, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: -5.00% (0.2659 => 0.2526, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.00% (1.0544 => 1.0017, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.97% (1.6474 => 1.5656, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.97% (0.3323 => 0.3158, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -4.92% (0.6441 => 0.6124, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.90% (0.6484 => 0.6166, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.90% (5.4682 => 5.2001, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.88% (0.5999 => 0.5706, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: -4.88% (34.0927 => 32.4281, std.dev.: 0.0128) MultiSource/Applications/Burg/burg: -4.88% (1.2515 => 1.1904, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.88% (0.8521 => 0.8105, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists1: -4.86% (0.3867 => 0.3679, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.86% (0.3931 => 0.3740, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: -4.85% (0.4861 => 0.4625, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -4.85% (0.3255 => 0.3097, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.84% (0.3016 => 0.2870, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -4.82% (0.4524 => 0.4306, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.78% (0.4083 => 0.3888, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.77% (0.3252 => 0.3097, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -4.76% (2.4021 => 2.2877, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/bigfib: -4.73% (0.6750 => 0.6431, std.dev.: 0.0007) MultiSource/Applications/lua/lua: -4.72% (4.0594 => 3.8676, std.dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.67% (0.4813 => 0.4588, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.67% (0.7919 => 0.7549, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -4.65% (17.1032 => 16.3072, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.65% (1.3722 => 1.3084, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.63% (0.4427 => 0.4222, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.63% (14.2083 => 13.5507, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.63% (0.7198 => 0.6865, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.60% (0.2933 => 0.2798, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.60% (1.6364 => 1.5611, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: -4.56% (9.2283 => 8.8074, std.dev.: 0.0061) MultiSource/Applications/lemon/lemon: -4.56% (1.1450 => 1.0928, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.56% (1.4642 => 1.3975, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.54% (0.6230 => 0.5947, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: -4.54% (0.3788 => 0.3616, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -4.52% (18.2933 => 17.4659, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.52% (0.6194 => 0.5914, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.51% (1.2300 => 1.1745, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.49% (0.5925 => 0.5659, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.48% (0.7339 => 0.7010, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.48% (0.6293 => 0.6011, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.45% (0.5591 => 0.5342, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -4.45% (0.4515 => 0.4314, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.45% (0.5863 => 0.5602, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.45% (0.6681 => 0.6384, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.42% (0.3483 => 0.3329, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.41% (0.6304 => 0.6026, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.40% (0.2999 => 0.2867, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.40% (0.4321 => 0.4131, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.40% (0.6052 => 0.5786, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.39% (6.7716 => 6.4741, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.37% (2.2587 => 2.1599, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.37% (0.6660 => 0.6369, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.35% (0.3491 => 0.3339, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.33% (0.4916 => 0.4703, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.33% (0.5705 => 0.5458, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.31% (0.9557 => 0.9145, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.31% (0.5849 => 0.5597, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.30% (0.6667 => 0.6380, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -4.30% (0.3581 => 0.3427, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.29% (0.5478 => 0.5243) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.29% (0.5456 => 0.5222, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.29% (0.6297 => 0.6027, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.29% (0.5575 => 0.5336, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.29% (0.5857 => 0.5606, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -4.28% (0.7447 => 0.7128, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.27% (0.5802 => 0.5554, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.27% (0.5805 => 0.5557, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.26% (1.2210 => 1.1690, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.25% (0.5570 => 0.5333, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.25% (0.5581 => 0.5344, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -4.22% (0.7982 => 0.7645, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.22% (0.6446 => 0.6174, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.20% (0.6260 => 0.5997, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.18% (0.5859 => 0.5614, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.17% (1.2221 => 1.1711, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.16% (0.5941 => 0.5694, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -4.14% (0.3406 => 0.3265, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.13% (0.5569 => 0.5339, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.10% (0.5567 => 0.5339, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/football/football: -4.09% (0.9179 => 0.8804, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.08% (0.6395 => 0.6134, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.07% (0.7524 => 0.7218, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.05% (0.6395 => 0.6136, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.03% (0.6033 => 0.5790, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.02% (0.6189 => 0.5940, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.01% (0.2695 => 0.2587, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -3.99% (0.5688 => 0.5461, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.98% (0.3319 => 0.3187, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: -3.96% (15.5079 => 14.8934, std.dev.: 0.0075) MultiSource/Applications/SIBsim4/SIBsim4: -3.95% (1.3864 => 1.3316, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -3.92% (8.0126 => 7.6983, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: -3.85% (0.2985 => 0.2870, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -3.85% (0.3271 => 0.3145, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: -3.79% (2.1401 => 2.0590, std.dev.: 0.0127) MultiSource/Applications/spiff/spiff: -3.79% (0.8418 => 0.8099, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.72% (0.7021 => 0.6760, std.dev.: 0.0051) MultiSource/Applications/oggenc/oggenc: -3.68% (5.0226 => 4.8376, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.66% (0.5168 => 0.4979, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.62% (0.6736 => 0.6492, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: -3.51% (3.5154 => 3.3919, std.dev.: 0.0057) MultiSource/Applications/ClamAV/clamscan: -3.36% (15.2527 => 14.7407, std.dev.: 0.0238) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.35% (0.9077 => 0.8773, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: -3.34% (1.1530 => 1.1145, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: -3.34% (1.5610 => 1.5089, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.96% (0.5329 => 0.5171, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.15% (20.7746 => 20.3279, std.dev.: 0.0518) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7581, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/richards_benchmark: -8.70% (1.2842 => 1.1725, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.91% (1.7753 => 1.7059, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.65% (2.2633 => 2.1808, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.97% (1.3096 => 1.2838, std.dev.: 0.0089) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4699, std.dev.: 0.0022) Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 2 04:27:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 2 Nov 2012 06:27:31 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121102112731.2DC082A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5523?compare_to=5521&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5523, Order: 167289, Start Time: 2012-11-02 10:01:25, End Time: 2012-11-02 11:27:35 To: 5521, Order: 167285, Start Time: 2012-11-02 08:11:51, End Time: 2012-11-02 09:39:40 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 4 (34 on baseline) Performance Improvements: 58 (4 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 929 (936 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.58% (0.3036 => 0.3175, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.26% (21.4503 => 22.3642, std.dev.: 0.1740) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.59% (7.0495 => 7.2322, std.dev.: 0.0360) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.2655 => 1.2811, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: -6.06% (0.2031 => 0.1908, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.95% (0.2285 => 0.2149, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.23% (0.2390 => 0.2265, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.86% (0.3479 => 0.3310, std.dev.: 0.0038) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.67% (0.3429 => 0.3269, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.51% (1.2408 => 1.1849, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.16% (1.3100 => 1.2555, std.dev.: 0.0156) MultiSource/Benchmarks/McCat/18-imp/imp: -3.93% (0.3663 => 0.3519, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.50% (1.2305 => 1.1874, std.dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.28% (0.4753 => 0.4597, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.01% (2.2295 => 2.1624, std.dev.: 0.0091) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.98% (0.8745 => 0.8484, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -2.97% (1.2913 => 1.2529, std.dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: -2.94% (1.1726 => 1.1381, std.dev.: 0.0042) MultiSource/Applications/lua/lua: -2.88% (3.9600 => 3.8459, std.dev.: 0.0285) MultiSource/Benchmarks/MallocBench/gs/gs: -2.87% (4.2785 => 4.1556, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -2.85% (8.9907 => 8.7343, std.dev.: 0.0640) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.80% (0.6866 => 0.6674, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.78% (0.6483 => 0.6303, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.68% (3.2907 => 3.2024, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -2.56% (1.6947 => 1.6513, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -2.53% (4.7079 => 4.5886, std.dev.: 0.0152) MultiSource/Applications/d/make_dparser: -2.42% (3.3532 => 3.2722, std.dev.: 0.0276) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -2.35% (1.0267 => 1.0026, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.32% (0.5396 => 0.5271, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.26% (4.6354 => 4.5306, std.dev.: 0.0196) MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.21% (0.8928 => 0.8731, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.15% (4.6076 => 4.5086, std.dev.: 0.0310) MultiSource/Applications/SIBsim4/SIBsim4: -2.10% (1.3047 => 1.2773, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.95% (0.9132 => 0.8954, std.dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: -1.88% (15.3354 => 15.0474, std.dev.: 0.0931) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.81% (1.1521 => 1.1312, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.76% (0.8853 => 0.8697, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.73% (0.8246 => 0.8103, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: -1.65% (0.7049 => 0.6933, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.60% (0.8426 => 0.8291, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: -1.56% (8.8293 => 8.6919, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.53% (0.8214 => 0.8088, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.50% (0.8539 => 0.8411, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.49% (0.8196 => 0.8074, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.47% (0.8992 => 0.8860, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.36% (0.8485 => 0.8370, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.35% (0.8836 => 0.8717, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.33% (0.8934 => 0.8815, std.dev.: 0.0018) MultiSource/Applications/siod/siod: -1.32% (2.2631 => 2.2333, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.29% (0.9080 => 0.8963, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.28% (0.9272 => 0.9153, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.25% (0.8551 => 0.8444, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.13% (0.9912 => 0.9800, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/fannkuch: -24.94% (3.7344 => 2.8032, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -20.41% (0.0637 => 0.0507, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -8.69% (2.6781 => 2.4454, std.dev.: 0.0241) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.28% (3.2291 => 3.0908, std.dev.: 0.0517) MultiSource/Benchmarks/Prolangs-C++/primes/primes: -3.52% (0.7889 => 0.7611, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/lpbench: -2.26% (4.0130 => 3.9225, std.dev.: 0.0219) SingleSource/Benchmarks/Shootout-C++/hash: -2.06% (0.6395 => 0.6263, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.57% (2.9500 => 2.9037, std.dev.: 0.0137) SingleSource/Benchmarks/McGill/chomp: -1.40% (1.1230 => 1.1073, std.dev.: 0.0057) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.99% (16.8326 => 16.6654, std.dev.: 0.0675) MultiSource/Applications/obsequi/Obsequi: -2.66% (1.0857 => 1.0568, std.dev.: 0.0127) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.07% (21.7342 => 21.7179, std.dev.: 0.1499) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.88% (0.3655 => 0.3623, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: -0.38% (0.6030 => 0.6007, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.60% (0.3318 => 0.3298, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: -1.14% (0.2009 => 0.1986, std.dev.: 0.0079) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -37.73% (0.0220 => 0.0137, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -13.45% (0.0409 => 0.0354, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -21.26% (0.0334 => 0.0263, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 7.78% (0.0270 => 0.0291, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -16.31% (0.0423 => 0.0354, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/casts: -3.43% (0.0204 => 0.0197, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 20.35% (0.0172 => 0.0207, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.55% (0.1412 => 0.1448, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -4.75% (1.1800 => 1.1240, std.dev.: 0.0111) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -5.36% (0.1511 => 0.1430, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.03% (0.4159 => 0.4033, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.50% (0.1335 => 0.1315, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.81% (0.0644 => 0.0613, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.40% (0.0272 => 0.0241, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.60% (0.0536 => 0.0566, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.44% (1.1484 => 1.1433, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.49% (0.0652 => 0.0551, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.18% (0.0198 => 0.0234, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.40% (0.7979 => 0.8011, std.dev.: 0.0153) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 82.05% (0.0039 => 0.0071, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2293.83% (0.6332 => 15.1577, std.dev.: 0.1657) MultiSource/Benchmarks/McCat/08-main/main: 45.22% (0.1831 => 0.2659, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.95% (0.1559 => 0.1435, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1479.52% (0.3344 => 5.2819, std.dev.: 0.0391) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.00% (0.2364 => 0.3215, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -1.17% (0.0429 => 0.0424, std.dev.: 0.0013) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.57% (0.0224 => 0.0232, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -32.17% (0.0230 => 0.0156, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3524, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0713, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4960, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3396, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0319, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4070, std.dev.: 0.0017) SingleSource/Regression/C/uint64_to_float: -23.99% (2.1832 => 1.6595, std.dev.: 0.0030) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.31% (0.0810 => 0.0934, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 12.05% (0.1112 => 0.1246, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.95% (0.2180 => 0.2288, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.93% (0.8321 => 0.8731, std.dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.21% (0.3137 => 0.3269, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.12% (0.8148 => 0.8484, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.05% (0.4127 => 0.4253, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.51% (0.4783 => 0.4903, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.26% (1.3279 => 1.3579, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.95% (0.8007 => 0.8163, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 1.89% (14.7684 => 15.0474, std.dev.: 0.0931) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.70% (0.8457 => 0.8601, std.dev.: 0.0021) MultiSource/Applications/SIBsim4/SIBsim4: 1.63% (1.2568 => 1.2773, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.51% (0.9074 => 0.9211, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.40% (0.8597 => 0.8717, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.39% (0.8086 => 0.8198, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.38% (0.8261 => 0.8375, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.36% (0.7966 => 0.8074, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.32% (0.7932 => 0.8037, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 1.31% (4.9628 => 5.0280, std.dev.: 0.0215) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.27% (1.1170 => 1.1312, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: 1.24% (31.8598 => 32.2537, std.dev.: 0.1360) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.18% (0.8712 => 0.8815, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.17% (0.8716 => 0.8818, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.16% (0.9688 => 0.9800, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.22% (1.5795 => 2.4991, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.60% (0.3186 => 0.3460, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.05% (1.1857 => 1.2811, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 5.92% (63.1822 => 66.9200, std.dev.: 0.0168) MultiSource/Applications/siod/siod: 2.76% (3.6643 => 3.7653, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/ReedSolomon: 2.14% (8.5322 => 8.7146, std.dev.: 0.0640) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.91% (59.2638 => 60.3976, std.dev.: 0.4295) MultiSource/Benchmarks/Olden/bh/bh: 1.68% (2.3560 => 2.3956, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.35% (4.8362 => 4.9016, std.dev.: 0.0234) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -5.07% (29.8330 => 28.3204, std.dev.: 0.1962) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.76% (1.0388 => 1.0205, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash2: -1.51% (3.4237 => 3.3719, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.35% (3.3479 => 3.3027, std.dev.: 0.0020) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.33% (16.4461 => 16.6654, std.dev.: 0.0675) MultiSource/Applications/obsequi/Obsequi: 2.98% (1.0262 => 1.0568, std.dev.: 0.0127) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6854.18% (0.3123 => 21.7179, std.dev.: 0.1499) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.10% (0.2463 => 0.3623, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: -0.05% (0.6010 => 0.6007, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.98% (0.3266 => 0.3298, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: 0.86% (0.1969 => 0.1986, std.dev.: 0.0079) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 11.38% (0.0123 => 0.0137, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -13.24% (0.0408 => 0.0354, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.54% (0.0254 => 0.0263, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.64% (0.0302 => 0.0291, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.81% (0.0384 => 0.0354, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/casts: 3.68% (0.0190 => 0.0197, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 15.00% (0.0180 => 0.0207, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.70% (0.1438 => 0.1448, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.79% (1.1329 => 1.1240, std.dev.: 0.0111) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -2.19% (0.1462 => 0.1430, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.15% (0.4164 => 0.4033, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.94% (0.1369 => 0.1315, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.37% (0.0641 => 0.0613, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 23.59% (0.0195 => 0.0241, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.08% (0.0578 => 0.0566, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.03% (1.1437 => 1.1433, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.12% (0.0627 => 0.0551, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 30.00% (0.0180 => 0.0234, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.07% (0.8017 => 0.8011, std.dev.: 0.0153) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 14.52% (0.0062 => 0.0071, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 2 04:59:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 2 Nov 2012 06:59:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121102115950.7A7A12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5524?compare_to=5522&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5524, Order: 167293, Start Time: 2012-11-02 10:34:36, End Time: 2012-11-02 11:59:53 To: 5522, Order: 167285, Start Time: 2012-11-02 08:45:00, End Time: 2012-11-02 10:10:25 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 15 (178 on baseline) Unchanged Tests: 1026 (859 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.24% (55.0200 => 56.2498, std.dev.: 0.2128) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/nbench/nbench: -2.14% (1.1145 => 1.0907, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -1.93% (0.5171 => 0.5071, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -1.87% (0.8804 => 0.8639, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.59% (0.6492 => 0.6389, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: -1.49% (3.3919 => 3.3415, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -1.46% (14.8934 => 14.6763, std.dev.: 0.0119) MultiSource/Applications/ClamAV/clamscan: -1.42% (14.7407 => 14.5320, std.dev.: 0.0154) MultiSource/Applications/SIBsim4/SIBsim4: -1.26% (1.3316 => 1.3148, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: -1.22% (8.8074 => 8.6999, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.12% (1.3084 => 1.2937, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -1.11% (1.1904 => 1.1772, std.dev.: 0.0025) MultiSource/Applications/treecc/treecc: -1.10% (2.0590 => 2.0364, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.02% (1.0017 => 0.9915, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.01% (1.1745 => 1.1626, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.66% (3.4200 => 3.1921, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.07% (54.5751 => 56.2498, std.dev.: 0.2128) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.00% (2.0478 => 2.1092, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/hash2: 2.33% (3.1932 => 3.2675, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4937 => 7.6678, std.dev.: 0.0076) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.90% (0.1431 => 0.1318, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.33% (0.3821 => 0.3541, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: -6.88% (2.4924 => 2.3210, std.dev.: 0.0065) MultiSource/Applications/sgefa/sgefa: -6.37% (0.3357 => 0.3143, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.33% (3.5339 => 3.3101, std.dev.: 0.0186) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.17% (22.4056 => 21.0230, std.dev.: 0.0216) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.17% (0.6484 => 0.6084, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.14% (0.3142 => 0.2949, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.04% (0.3658 => 0.3437, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.97% (1.0544 => 0.9915, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: -5.94% (1.2515 => 1.1772, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: -5.90% (4.3330 => 4.0773, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/football/football: -5.88% (0.9179 => 0.8639, std.dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: -5.83% (16.1920 => 15.2478, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.82% (0.9542 => 0.8987, std.dev.: 0.0108) MultiSource/Applications/JM/ldecod/ldecod: -5.81% (7.0961 => 6.6837, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -5.80% (0.1879 => 0.1770, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -5.79% (0.2160 => 0.2035, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.77% (1.2784 => 1.2047, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: -5.73% (9.2283 => 8.6999, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.72% (1.3722 => 1.2937, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.70% (0.7919 => 0.7468, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.67% (0.5857 => 0.5525, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.66% (0.9852 => 0.9294, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: -5.65% (1.1450 => 1.0803, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.62% (0.1796 => 0.1695, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.62% (1.4642 => 1.3819, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.60% (0.2428 => 0.2292, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.60% (1.6474 => 1.5552, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/bh/bh: -5.59% (0.2985 => 0.2818, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.55% (0.6681 => 0.6310, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.54% (1.6364 => 1.5458, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.53% (0.7339 => 0.6933, std.dev.: 0.0009) MultiSource/Applications/siod/siod: -5.53% (2.4021 => 2.2693, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.53% (0.5591 => 0.5282, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.49% (0.2548 => 0.2408, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.49% (0.4151 => 0.3923, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.49% (0.6230 => 0.5888, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.49% (4.5069 => 4.2596, std.dev.: 0.0113) MultiSource/Applications/hexxagon/hexxagon: -5.48% (1.3148 => 1.2427, std.dev.: 0.0220) SingleSource/UnitTests/ObjC/trivial-interface: -5.48% (0.3812 => 0.3603, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.48% (1.2300 => 1.1626, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.48% (0.6297 => 0.5952, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.48% (0.2355 => 0.2226, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.47% (0.6194 => 0.5855, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.47% (0.6052 => 0.5721, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: -5.46% (0.3880 => 0.3668, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.46% (0.8521 => 0.8056, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.44% (0.5478 => 0.5180, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.43% (0.5999 => 0.5673, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-3: -5.43% (0.3848 => 0.3639, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -5.43% (0.3831 => 0.3623, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -5.42% (4.0594 => 3.8394, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.42% (0.2695 => 0.2549, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: -5.42% (0.2659 => 0.2515, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.41% (5.4682 => 5.1722, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions: -5.41% (0.4176 => 0.3950, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.41% (4.8161 => 4.5557, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/for-in: -5.41% (0.4033 => 0.3815, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -5.40% (1.1530 => 1.0907, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.39% (14.2083 => 13.4420, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/synchronized: -5.39% (0.3896 => 0.3686, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.38% (0.6667 => 0.6308, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.38% (0.5925 => 0.5606, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.38% (0.6304 => 0.5965, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.37% (0.3891 => 0.3682, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.37% (4.8802 => 4.6183, std.dev.: 0.0062) MultiSource/Applications/SPASS/SPASS: -5.36% (15.5079 => 14.6763, std.dev.: 0.0119) MultiSource/Benchmarks/McCat/18-imp/imp: -5.36% (0.3581 => 0.3389, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.36% (0.6293 => 0.5956, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -5.35% (17.1032 => 16.1874, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.35% (0.3849 => 0.3643, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.34% (0.2999 => 0.2839, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: -5.33% (0.4199 => 0.3975, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -5.33% (0.4861 => 0.4602, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.33% (0.5859 => 0.5547, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.32% (0.6260 => 0.5927, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.31% (0.5802 => 0.5494, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.30% (0.3323 => 0.3147, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: -5.29% (0.7447 => 0.7053, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.29% (0.3837 => 0.3634, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.29% (0.5863 => 0.5553, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.28% (0.3406 => 0.3226, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.27% (0.5575 => 0.5281, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.27% (0.2903 => 0.2750, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.27% (0.5941 => 0.5628, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.27% (0.3057 => 0.2896, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.26% (0.2871 => 0.2720, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.26% (0.6446 => 0.6107, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -5.25% (0.2989 => 0.2832, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -5.24% (0.3394 => 0.3216, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.23% (0.4321 => 0.4095, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.23% (0.5569 => 0.5278, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: -5.22% (0.3446 => 0.3266, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.22% (0.7524 => 0.7131, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.22% (2.1713 => 2.0579, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.22% (0.4083 => 0.3870, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.21% (0.5849 => 0.5544, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.21% (0.9557 => 0.9059, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: -5.21% (0.2939 => 0.2786, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.20% (0.3884 => 0.3682, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -5.20% (0.3867 => 0.3666, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.20% (0.6676 => 0.6329, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.20% (0.3194 => 0.3028, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.20% (4.0323 => 3.8228, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hello: -5.19% (0.2849 => 0.2701, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.19% (6.7716 => 6.4202, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.19% (0.6033 => 0.5720, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.18% (0.6395 => 0.6064, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.17% (0.6189 => 0.5869, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -5.16% (1.3864 => 1.3148, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.16% (0.6440 => 0.6108, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.15% (0.6736 => 0.6389, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.15% (0.5456 => 0.5175, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.15% (0.6660 => 0.6317, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.15% (0.2933 => 0.2782, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.14% (0.5581 => 0.5294, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary2: -5.14% (0.3481 => 0.3302, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -5.14% (0.3621 => 0.3435, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.14% (0.5705 => 0.5412, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.12% (0.3319 => 0.3149, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wc: -5.12% (0.3205 => 0.3041, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -5.12% (0.4280 => 0.4061, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.12% (0.5805 => 0.5508, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.11% (0.3483 => 0.3305, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.10% (0.5570 => 0.5286, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.10% (2.2587 => 2.1436, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/except: -5.09% (0.3026 => 0.2872, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -5.08% (0.4248 => 0.4032, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.08% (0.6395 => 0.6070, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: -5.07% (0.3059 => 0.2904, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.07% (0.4916 => 0.4667, std.dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: -5.05% (18.2933 => 17.3688, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/bigfib: -5.05% (0.6750 => 0.6409, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/05-eks/eks: -5.05% (0.4515 => 0.4287, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.04% (0.3016 => 0.2864, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.04% (0.3255 => 0.3091, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.03% (0.5168 => 0.4908, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.00% (0.2278 => 0.2164, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.98% (0.3491 => 0.3317, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.98% (0.5567 => 0.5290, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -4.97% (0.7982 => 0.7585, std.dev.: 0.0113) MultiSource/Applications/d/make_dparser: -4.95% (3.5154 => 3.3415, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.92% (0.4427 => 0.4209, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -4.92% (34.0927 => 32.4161, std.dev.: 0.0070) SingleSource/UnitTests/ObjC++/property-reference: -4.90% (0.7779 => 0.7398, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.87% (0.5688 => 0.5411, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.86% (0.2385 => 0.2269, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.86% (8.0126 => 7.6231, std.dev.: 0.0044) MultiSource/Applications/treecc/treecc: -4.85% (2.1401 => 2.0364, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.84% (0.2106 => 0.2004, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.84% (0.5329 => 0.5071, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.81% (0.7021 => 0.6683, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.81% (0.3931 => 0.3742, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -4.73% (15.2527 => 14.5320, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/sieve: -4.67% (0.3788 => 0.3611, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.65% (0.6347 => 0.6052, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.64% (0.3252 => 0.3101, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.60% (1.2221 => 1.1659, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -4.60% (0.4524 => 0.4316, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.59% (1.2210 => 1.1649, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.53% (0.4813 => 0.4595, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.53% (0.7198 => 0.6872, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.49% (0.6441 => 0.6152, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -4.46% (0.3271 => 0.3125, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: -4.34% (0.8418 => 0.8053, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: -4.30% (5.0226 => 4.8064, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.05% (0.9077 => 0.8709, std.dev.: 0.0017) MultiSource/Applications/hbd/hbd: -3.46% (1.5610 => 1.5070, std.dev.: 0.0176) SingleSource/UnitTests/Vector/constpool: -2.61% (20.7746 => 20.2324, std.dev.: 0.0505) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7544, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: -8.66% (1.2842 => 1.1730, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7061, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.78% (2.2633 => 2.1777, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4690, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0005) Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 2 05:52:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 2 Nov 2012 07:52:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121102125221.55FC32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5525?compare_to=5520&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5525, Order: 167286, Start Time: 2012-11-02 09:36:15, End Time: 2012-11-02 12:52:25 To: 5520, Order: 167281, Start Time: 2012-11-02 05:29:41, End Time: 2012-11-02 08:47:51 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (170 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (719 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.72% (127.8909 => 131.3686, std.dev.: 0.3531) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.12% (0.0625 => 0.0882) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.98% (0.1063 => 0.1403, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.70% (0.2969 => 0.3732, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.68% (0.1106 => 0.1390, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.62% (0.4253 => 0.5300, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 24.61% (1.5932 => 1.9853, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.37% (0.0714 => 0.0888, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.26% (0.4139 => 0.5143, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.15% (0.4994 => 0.6150, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.95% (0.5900 => 0.7254, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.68% (0.5000 => 0.6134, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.60% (0.0584 => 0.0716, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.67% (0.1620 => 0.1971, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.63% (0.0897 => 0.1091, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 21.54% (0.0599 => 0.0728, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.45% (0.1021 => 0.1240, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 21.20% (0.0948 => 0.1149, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.14% (0.1107 => 0.1341, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.38% (0.0633 => 0.0762, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 20.36% (0.0604 => 0.0727, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.16% (0.3903 => 0.4690, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.04% (0.1103 => 0.1324, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.01% (0.1549 => 0.1859, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.96% (0.0541 => 0.0649, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.94% (0.0642 => 0.0770, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.86% (0.0584 => 0.0700, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 19.85% (0.0821 => 0.0984, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 19.77% (0.1619 => 0.1939, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.70% (0.1604 => 0.1920, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.54% (0.1003 => 0.1199) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.34% (0.0822 => 0.0981, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 18.66% (0.5826 => 0.6913, std.dev.: 0.0040) MultiSource/Applications/viterbi/viterbi: 18.48% (0.0947 => 0.1122, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.33% (0.1462 => 0.1730, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 18.24% (0.5889 => 0.6963, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 17.98% (0.1218 => 0.1437, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.97% (0.2014 => 0.2376, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 17.95% (0.0808 => 0.0953, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.92% (0.3890 => 0.4587, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 17.55% (0.4029 => 0.4736, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 17.48% (0.1505 => 0.1768, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.47% (0.2736 => 0.3214, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.46% (1.3152 => 1.5448, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.37% (0.1088 => 0.1277, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 17.34% (0.0698 => 0.0819, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.88% (3.5627 => 4.1640, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.78% (0.2866 => 0.3347, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 16.77% (1.8794 => 2.1945, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: 16.73% (0.5546 => 0.6474, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 16.69% (0.0605 => 0.0706, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.64% (0.1160 => 0.1353, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.49% (0.2875 => 0.3349, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.36% (0.2738 => 0.3186, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.36% (0.4658 => 0.5420, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.31% (0.1968 => 0.2289, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: 16.29% (0.7171 => 0.8339, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.28% (1.6211 => 1.8850, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.20% (0.5026 => 0.5840, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.14% (0.3271 => 0.3799, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 16.05% (0.1421 => 0.1649, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 16.03% (0.9697 => 1.1251, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/fibo: 15.93% (0.2725 => 0.3159, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 15.83% (1.0781 => 1.2488, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.80% (0.4361 => 0.5050, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 15.71% (0.3004 => 0.3476, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 15.70% (0.2714 => 0.3140, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.65% (0.3195 => 0.3695, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 15.58% (0.1284 => 0.1484, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.57% (0.2729 => 0.3154, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.48% (4.4195 => 5.1035, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/matrix: 15.47% (0.2780 => 0.3210, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 15.38% (0.2750 => 0.3173, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 15.38% (0.2803 => 0.3234, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.37% (0.2792 => 0.3221, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.30% (2.7292 => 3.1468, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.29% (0.3930 => 0.4531, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 15.26% (0.2811 => 0.3240, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 15.22% (0.2813 => 0.3241, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: 15.21% (0.3096 => 0.3567, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 15.13% (0.2823 => 0.3250, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 15.12% (4.2109 => 4.8474, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.10% (2.0673 => 2.3795, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 15.07% (0.9909 => 1.1402, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.05% (0.1090 => 0.1254, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.02% (1.9694 => 2.2653, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.94% (0.2911 => 0.3346, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.82% (1.9966 => 2.2924, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions-2: 14.74% (0.3446 => 0.3954, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 14.73% (23.5202 => 26.9853, std.dev.: 0.0217) SingleSource/Benchmarks/Shootout-C++/ary3: 14.72% (0.3267 => 0.3748, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 14.53% (0.3317 => 0.3799, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 14.52% (0.3258 => 0.3731, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.46% (0.3362 => 0.3848, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 14.29% (0.3465 => 0.3960, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 14.27% (0.2075 => 0.2371, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.22% (0.3488 => 0.3984, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/property: 14.19% (0.3650 => 0.4168, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-3: 14.19% (0.3460 => 0.3951, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 14.19% (0.3496 => 0.3992, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.18% (0.3060 => 0.3494, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 14.15% (0.3469 => 0.3960, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.15% (0.3442 => 0.3929, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.15% (0.3124 => 0.3566, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 14.01% (0.3348 => 0.3817, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 13.95% (0.2566 => 0.2924, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 13.92% (0.3643 => 0.4150, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 13.81% (0.3678 => 0.4186, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 13.71% (0.3726 => 0.4237, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.71% (0.3282 => 0.3732, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 13.64% (1.4269 => 1.6216, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: 13.60% (0.4146 => 0.4710, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.60% (0.3625 => 0.4118, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 13.52% (0.3477 => 0.3947, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 13.51% (0.3724 => 0.4227, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 13.50% (0.4251 => 0.4825, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.41% (0.3690 => 0.4185, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.36% (0.3981 => 0.4513, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: 13.10% (0.7875 => 0.8907, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.03% (0.3845 => 0.4346, std.dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: 12.89% (2.1653 => 2.4443, std.dev.: 0.0095) MultiSource/Applications/JM/lencod/lencod: 12.88% (4.6177 => 5.2124, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/bigfib: 12.81% (0.5012 => 0.5654, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 12.28% (2.1013 => 2.3594, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.11% (0.2040 => 0.2287, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 11.74% (0.2691 => 0.3007, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 11.64% (5.5417 => 6.1868, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.22% (0.6435 => 0.7157, std.dev.: 0.0023) MultiSource/Benchmarks/PAQ8p/paq8p: 11.00% (0.4847 => 0.5380, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.89% (0.1028 => 0.1140, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 10.63% (0.3498 => 0.3870, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.63% (0.2737 => 0.3028, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.41% (0.1383 => 0.1527, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.35% (0.2068 => 0.2282, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.12% (0.3084 => 0.3396, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 10.11% (0.6634 => 0.7305, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 10.04% (0.3336 => 0.3671, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.46% (0.2103 => 0.2302, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 9.20% (2.0346 => 2.2217, std.dev.: 0.0075) MultiSource/Applications/lemon/lemon: 8.87% (0.2391 => 0.2603, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.81% (4.6926 => 5.1061, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.62% (11.6398 => 12.6437, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.15% (0.5361 => 0.5798, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.70% (0.7426 => 0.7998, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.52% (0.5584 => 0.6004, std.dev.: 0.0120) MultiSource/Applications/kimwitu++/kc: 6.79% (11.9555 => 12.7673, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.85% (0.3792 => 0.3976, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6536, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 8.57% (0.2802 => 0.3042, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6095, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 5.18% (0.2122 => 0.2232, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/objinst: 5.03% (12.0509 => 12.6569, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1696, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-2: 4.54% (1.8057 => 1.8877, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: 3.36% (14.0481 => 14.5199, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ary3: 2.00% (15.8721 => 16.1899, std.dev.: 0.0717) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2220, std.dev.: 0.0026) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3083, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2875, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.24% (1.0142 => 1.0268, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5940, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.23% (25.4195 => 16.4635, std.dev.: 0.0132) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9763, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7750, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: -6.66% (0.2402 => 0.2242, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.18% (0.6293 => 0.6093, std.dev.: 0.0056) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7753, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel-2: -2.91% (3.6262 => 3.5207, std.dev.: 0.0026) SingleSource/UnitTests/Vector/build2: -2.57% (11.2080 => 10.9194, std.dev.: 0.0174) SingleSource/Benchmarks/Dhrystone/fldry: -2.47% (17.2379 => 16.8122, std.dev.: 0.0136) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8689, std.dev.: 0.0159) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.83% (10.7630 => 10.5665, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4955, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.35% (21.9346 => 21.6386, std.dev.: 0.0806) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.2019, std.dev.: 0.0585) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.08% (3.3991 => 3.3625, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0430, std.dev.: 0.0038) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 2 06:12:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 2 Nov 2012 08:12:35 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121102131235.B239D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5526?compare_to=5523&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5526, Order: 167293, Start Time: 2012-11-02 11:44:26, End Time: 2012-11-02 13:12:40 To: 5523, Order: 167289, Start Time: 2012-11-02 10:01:25, End Time: 2012-11-02 11:27:35 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 23 (58 on baseline) Performance Improvements: 2 (3 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 966 (913 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.28% (0.2930 => 0.3114, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.13% (0.1908 => 0.2025, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 5.33% (1.2344 => 1.3002, std.dev.: 0.0045) MultiSource/Applications/spiff/spiff: 4.96% (0.7957 => 0.8352, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.62% (0.6135 => 0.6357, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.56% (0.7633 => 0.7905, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.31% (0.6380 => 0.6591, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.25% (0.9534 => 0.9844, std.dev.: 0.0076) SingleSource/UnitTests/Vector/constpool: 3.17% (8.4393 => 8.7072, std.dev.: 0.0708) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.74% (1.1849 => 1.2174, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.69% (0.5867 => 0.6025, std.dev.: 0.0050) MultiSource/Applications/treecc/treecc: 2.63% (2.0076 => 2.0603, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.53% (1.1874 => 1.2174, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.77% (8.7343 => 8.8885, std.dev.: 0.0193) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.69% (4.5886 => 4.6661, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.56% (0.9153 => 0.9296, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 1.48% (3.2722 => 3.3205, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.40% (0.8484 => 0.8603, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.21% (1.3579 => 1.3743, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.15% (1.6513 => 1.6703, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.15% (0.8818 => 0.8919, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 1.10% (14.4189 => 14.5780, std.dev.: 0.0423) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/recursive: 1.67% (2.4667 => 2.5078, std.dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.77% (7.2322 => 6.9597, std.dev.: 0.1035) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.15% (1.2523 => 1.2254, std.dev.: 0.0006) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.51% (16.6654 => 16.5809, std.dev.: 0.0751) MultiSource/Applications/obsequi/Obsequi: 1.13% (1.0568 => 1.0687, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.71% (21.7179 => 21.5642, std.dev.: 0.2300) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.17% (0.3623 => 0.3617, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/bigfib: -0.28% (0.6007 => 0.5990, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.09% (0.3298 => 0.3301, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/strcat: 0.55% (0.1986 => 0.1997, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 59.85% (0.0137 => 0.0219, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 21.19% (0.0354 => 0.0429, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 26.62% (0.0263 => 0.0333, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 8.25% (0.0291 => 0.0315, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 20.34% (0.0354 => 0.0426, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 4.06% (0.0197 => 0.0205, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/test1: 5.31% (0.0207 => 0.0218, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.69% (0.1448 => 0.1458, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.22% (1.1240 => 1.1215, std.dev.: 0.0647) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 6.43% (0.1430 => 0.1522, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.71% (0.4033 => 0.4223, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.80% (0.1315 => 0.1265, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.96% (0.0613 => 0.0625, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.62% (0.0241 => 0.0269, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.59% (0.0566 => 0.0557, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.18% (1.1433 => 1.1454, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 1700.00% (0.0001 => 0.0018, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.62% (0.0551 => 0.0593, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.41% (0.0234 => 0.0249, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.10% (0.8011 => 0.8019, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -26.76% (0.0071 => 0.0052, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2286.29% (0.6332 => 15.1100, std.dev.: 0.2378) MultiSource/Benchmarks/McCat/08-main/main: 48.88% (0.1831 => 0.2726, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.58% (0.1559 => 0.1472, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1507.63% (0.3344 => 5.3759, std.dev.: 0.0396) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.66% (0.2364 => 0.3207, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: 3.03% (0.0429 => 0.0442, std.dev.: 0.0018) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.80% (0.0224 => 0.0237, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3515, std.dev.: 0.0572) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0700, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4952, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3484, std.dev.: 0.0298) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0241, std.dev.: 0.0281) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4030, std.dev.: 0.0087) SingleSource/Regression/C/uint64_to_float: -23.82% (2.1832 => 1.6631, std.dev.: 0.0025) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.05% (0.0810 => 0.0940, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.30% (0.2180 => 0.2361, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.21% (0.2279 => 0.2466, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.81% (0.4847 => 0.5177, std.dev.: 0.0084) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.67% (0.8321 => 0.8876, std.dev.: 0.0137) MultiSource/Applications/Burg/burg: 6.38% (1.2222 => 1.3002, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.35% (0.1983 => 0.2109, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.30% (0.1905 => 0.2025, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.84% (0.1885 => 0.1995, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.78% (0.7473 => 0.7905, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.77% (0.6010 => 0.6357, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.58% (0.8148 => 0.8603, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.32% (0.3137 => 0.3304, std.dev.: 0.0048) MultiSource/Applications/spiff/spiff: 5.06% (0.7950 => 0.8352, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.89% (1.1606 => 1.2174, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.84% (0.6287 => 0.6591, std.dev.: 0.0053) MultiSource/Applications/sgefa/sgefa: 4.77% (0.2999 => 0.3142, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.68% (0.2519 => 0.2637, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.60% (0.3003 => 0.3141, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.33% (0.9435 => 0.9844, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.18% (1.1685 => 1.2174, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.87% (0.2998 => 0.3114, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.58% (0.5817 => 0.6025, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.49% (1.3279 => 1.3743, std.dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: 3.44% (8.4179 => 8.7072, std.dev.: 0.0708) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.32% (0.4127 => 0.4264, std.dev.: 0.0041) MultiSource/Applications/treecc/treecc: 3.28% (1.9948 => 2.0603, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.01% (0.3717 => 0.3829, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.79% (8.6476 => 8.8885, std.dev.: 0.0193) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.71% (6.6074 => 6.7864, std.dev.: 0.0622) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.65% (0.9056 => 0.9296, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.60% (0.5961 => 0.6116, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.60% (1.1170 => 1.1460, std.dev.: 0.0062) MultiSource/Applications/d/make_dparser: 2.59% (3.2366 => 3.3205, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.8768 => 0.8990, std.dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: 2.51% (14.7684 => 15.1396, std.dev.: 0.0753) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.42% (0.8340 => 0.8542, std.dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 2.41% (1.1271 => 1.1543, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.33% (0.8716 => 0.8919, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 2.23% (14.2605 => 14.5780, std.dev.: 0.0423) MultiSource/Benchmarks/MallocBench/gs/gs: 2.17% (4.1305 => 4.2201, std.dev.: 0.0279) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.10% (4.5702 => 4.6661, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.93% (1.6386 => 1.6703, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.90% (4.4880 => 4.5734, std.dev.: 0.0272) MultiSource/Applications/siod/siod: 1.87% (2.2184 => 2.2599, std.dev.: 0.0146) MultiSource/Applications/lua/lua: 1.85% (3.8189 => 3.8896, std.dev.: 0.0263) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.85% (0.8611 => 0.8770, std.dev.: 0.0056) MultiSource/Applications/JM/lencod/lencod: 1.65% (15.3280 => 15.5808, std.dev.: 0.0791) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 57.06% (1.5795 => 2.4807, std.dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.14% (1.1857 => 1.2822, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.34% (0.3186 => 0.3388, std.dev.: 0.0071) MultiSource/Benchmarks/mafft/pairlocalalign: 5.91% (63.1822 => 66.9150, std.dev.: 0.0774) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.40% (2.4490 => 2.5078, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/ReedSolomon: 2.31% (8.5322 => 8.7290, std.dev.: 0.0559) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.87% (4.8362 => 4.9265, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: 1.63% (0.6205 => 0.6306, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: 1.61% (2.3560 => 2.3940, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.04% (1.5941 => 1.6107, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -5.17% (29.8330 => 28.2893, std.dev.: 0.1023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.46% (0.3269 => 0.3156, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.28% (3.3479 => 3.3052, std.dev.: 0.0025) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.82% (16.4461 => 16.5809, std.dev.: 0.0751) MultiSource/Applications/obsequi/Obsequi: 4.14% (1.0262 => 1.0687, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6804.96% (0.3123 => 21.5642, std.dev.: 0.2300) SingleSource/Benchmarks/CoyoteBench/fftbench: 46.85% (0.2463 => 0.3617, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/bigfib: -0.33% (0.6010 => 0.5990, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.07% (0.3266 => 0.3301, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/strcat: 1.42% (0.1969 => 0.1997, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.15% (0.0408 => 0.0429, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.94% (0.0384 => 0.0426, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.39% (0.1438 => 0.1458, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.01% (1.1329 => 1.1215, std.dev.: 0.0647) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 4.10% (0.1462 => 0.1522, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.42% (0.4164 => 0.4223, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -7.60% (0.1369 => 0.1265, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.50% (0.0641 => 0.0625, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 37.95% (0.0195 => 0.0269, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.63% (0.0578 => 0.0557, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.15% (1.1437 => 1.1454, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 28.57% (0.0014 => 0.0018, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.42% (0.0627 => 0.0593, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 38.33% (0.0180 => 0.0249, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.02% (0.8017 => 0.8019, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -16.13% (0.0062 => 0.0052, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 2 07:19:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 2 Nov 2012 09:19:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121102141907.2DEC12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5527?compare_to=5524&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5527, Order: 167295, Start Time: 2012-11-02 12:54:01, End Time: 2012-11-02 14:19:10 To: 5524, Order: 167293, Start Time: 2012-11-02 10:34:36, End Time: 2012-11-02 11:59:53 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (179 on baseline) Unchanged Tests: 1042 (859 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.19% (2.0478 => 2.1132, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/salsa20: 2.43% (7.4937 => 7.6760, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/hash2: 2.12% (3.1932 => 3.2609, std.dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.97% (0.1431 => 0.1317, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.28% (0.3821 => 0.3543, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -6.83% (2.4924 => 2.3222, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.38% (0.2428 => 0.2273, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -6.34% (0.3357 => 0.3144, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.34% (3.5339 => 3.3097, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.26% (0.3658 => 0.3429, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.21% (0.3142 => 0.2947, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.14% (22.4056 => 21.0289, std.dev.: 0.0201) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.00% (0.6484 => 0.6095, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.89% (1.0544 => 0.9923, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.89% (0.1716 => 0.1615, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: -5.88% (16.1920 => 15.2394, std.dev.: 0.0142) MultiSource/Applications/Burg/burg: -5.88% (1.2515 => 1.1779, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.83% (0.9542 => 0.8986, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -5.80% (0.1879 => 0.1770, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.80% (1.2784 => 1.2043, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: -5.78% (0.9179 => 0.8648, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.78% (1.6474 => 1.5521, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: -5.77% (7.0961 => 6.6868, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: -5.75% (4.3330 => 4.0840, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.73% (0.9852 => 0.9287, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.73% (1.3722 => 1.2936, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.72% (1.4642 => 1.3804, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: -5.69% (0.2160 => 0.2037) MultiSource/Benchmarks/mafft/pairlocalalign: -5.69% (9.2283 => 8.7034, std.dev.: 0.0048) MultiSource/Applications/lemon/lemon: -5.68% (1.1450 => 1.0800, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: -5.65% (1.1530 => 1.0879, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.64% (0.4151 => 0.3917, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.63% (0.5857 => 0.5527, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -5.63% (0.2985 => 0.2817, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.57% (1.2300 => 1.1615, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.57% (0.1796 => 0.1696, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -5.57% (0.2659 => 0.2511, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.55% (4.5069 => 4.2568, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.54% (4.8161 => 4.5494, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.53% (0.2695 => 0.2546, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.53% (0.5591 => 0.5282, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.49% (0.2548 => 0.2408, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -5.48% (0.3831 => 0.3621, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.48% (0.2355 => 0.2226, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.48% (0.7339 => 0.6937, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.47% (0.6194 => 0.5855, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.47% (0.5849 => 0.5529, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.47% (0.5925 => 0.5601, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: -5.46% (0.3880 => 0.3668, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.46% (0.6681 => 0.6316, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.46% (0.5478 => 0.5179, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: -5.46% (0.3812 => 0.3604, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -5.45% (0.4861 => 0.4596, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.44% (0.6230 => 0.5891, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.44% (0.6304 => 0.5961, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.44% (0.6052 => 0.5723, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.42% (0.3891 => 0.3680, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -5.41% (4.0594 => 3.8397, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.41% (0.5802 => 0.5488, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: -5.41% (0.4176 => 0.3950, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.41% (0.8521 => 0.8060, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.40% (0.3849 => 0.3641, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.40% (14.2083 => 13.4409, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.40% (0.6297 => 0.5957, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.40% (0.6446 => 0.6098, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.38% (4.8802 => 4.6176, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/synchronized: -5.36% (0.3896 => 0.3687, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.36% (0.3323 => 0.3145, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -5.36% (0.4033 => 0.3817, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.35% (0.5705 => 0.5400, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.35% (5.4682 => 5.1759, std.dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: -5.34% (1.3148 => 1.2446, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.33% (0.4199 => 0.3975, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: -5.33% (0.3581 => 0.3390, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.33% (0.3057 => 0.2894, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.33% (0.3884 => 0.3677, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.33% (0.7919 => 0.7497, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.33% (0.5575 => 0.5278, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -5.32% (17.1032 => 16.1927, std.dev.: 0.0053) MultiSource/Applications/siod/siod: -5.32% (2.4021 => 2.2744, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.31% (0.6736 => 0.6378, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.31% (0.6293 => 0.5959, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.30% (0.5863 => 0.5552, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -5.30% (0.7447 => 0.7052, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.30% (0.7524 => 0.7125, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: -5.30% (0.3848 => 0.3644, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -5.29% (15.5079 => 14.6868, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/fibo: -5.29% (0.2871 => 0.2719, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -5.29% (0.3025 => 0.2865, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.29% (0.6260 => 0.5929, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.29% (0.6395 => 0.6057, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -5.28% (0.3406 => 0.3226, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.28% (0.6667 => 0.6315, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.27% (0.5859 => 0.5550, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.26% (4.0323 => 3.8203, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary3: -5.25% (0.3446 => 0.3265, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.24% (0.5168 => 0.4897, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.24% (2.2587 => 2.1403, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.24% (0.5456 => 0.5170, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: -5.23% (0.3194 => 0.3027, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.22% (6.7716 => 6.4179, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.20% (2.1713 => 2.0583, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.20% (0.5999 => 0.5687, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: -5.20% (0.3867 => 0.3666, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -5.19% (0.2849 => 0.2701, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.19% (1.6364 => 1.5515, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -5.19% (0.4280 => 0.4058, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: -5.19% (0.3394 => 0.3218, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.18% (0.5941 => 0.5633, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.17% (0.5570 => 0.5282, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.15% (0.6033 => 0.5722, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -5.15% (0.2989 => 0.2835, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.15% (0.2933 => 0.2782, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -5.15% (18.2933 => 17.3518, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/random: -5.14% (0.2939 => 0.2788, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -5.13% (0.3255 => 0.3088) SingleSource/Benchmarks/Shootout-C++/hash: -5.13% (0.4524 => 0.4292, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.12% (0.6676 => 0.6334, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.12% (0.5569 => 0.5284, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.12% (0.5805 => 0.5508, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary2: -5.11% (0.3481 => 0.3303, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.11% (0.6395 => 0.6068, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.11% (0.3483 => 0.3305, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -5.11% (0.3621 => 0.3436, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.11% (0.5581 => 0.5296, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.11% (0.3016 => 0.2862, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.11% (0.4916 => 0.4665, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.10% (0.2999 => 0.2846, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.10% (0.2903 => 0.2755, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -5.09% (0.4515 => 0.4285, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.09% (0.6440 => 0.6112, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.09% (0.9557 => 0.9071, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -5.08% (0.4248 => 0.4032, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.08% (0.5567 => 0.5284, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.06% (0.6189 => 0.5876, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: -5.05% (3.5154 => 3.3380, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/except: -5.02% (0.3026 => 0.2874, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -5.02% (0.6750 => 0.6411, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.02% (0.4321 => 0.4104, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -5.00% (0.3059 => 0.2906, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.00% (0.6660 => 0.6327, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.99% (0.2385 => 0.2266, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.98% (0.3491 => 0.3317, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: -4.97% (1.3864 => 1.3175, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.97% (0.4813 => 0.4574, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: -4.96% (0.3205 => 0.3046, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.95% (0.4083 => 0.3881, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.94% (0.3319 => 0.3155, std.dev.: 0.0020) MultiSource/Applications/treecc/treecc: -4.94% (2.1401 => 2.0344, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.92% (0.4427 => 0.4209, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -4.91% (34.0927 => 32.4176, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.85% (0.5688 => 0.5412, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.83% (8.0126 => 7.6256, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.83% (0.7021 => 0.6682, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.82% (0.5329 => 0.5072, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.79% (1.2210 => 1.1625, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: -4.79% (0.7982 => 0.7600, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.74% (0.3252 => 0.3098, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: -4.73% (0.3788 => 0.3609, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.71% (0.3931 => 0.3746, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.70% (0.2278 => 0.2171, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.66% (1.2221 => 1.1651, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/09-vor/vor: -4.65% (0.3271 => 0.3119, std.dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: -4.64% (15.2527 => 14.5444, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.64% (0.3837 => 0.3659, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -4.63% (0.8418 => 0.8028, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: -4.56% (0.7779 => 0.7424, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: -4.55% (0.6347 => 0.6058, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.53% (0.7198 => 0.6872, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: -4.46% (0.6441 => 0.6154, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: -4.32% (5.0226 => 4.8054, std.dev.: 0.0154) MultiSource/Applications/hbd/hbd: -3.56% (1.5610 => 1.5055, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.53% (0.9077 => 0.8757, std.dev.: 0.0029) SingleSource/UnitTests/Vector/constpool: -2.67% (20.7746 => 20.2208, std.dev.: 0.0209) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.29% (7.5137 => 5.7641, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1733, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.97% (2.2633 => 2.1734, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.92% (1.7753 => 1.7057, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.04% (1.0557 => 1.0236, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.07% (1.3096 => 1.2825, std.dev.: 0.0089) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4693, std.dev.: 0.0045) Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 2 07:55:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 2 Nov 2012 09:55:16 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121102145516.6B7FC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5528?compare_to=5526&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5528, Order: 167295, Start Time: 2012-11-02 13:29:22, End Time: 2012-11-02 14:55:22 To: 5526, Order: 167293, Start Time: 2012-11-02 11:44:26, End Time: 2012-11-02 13:12:40 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 5 (36 on baseline) Performance Improvements: 14 (7 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 972 (931 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 13.83% (25.1108 => 28.5831, std.dev.: 0.0549) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.64% (21.4103 => 22.1895, std.dev.: 0.0752) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.93% (4.2986 => 4.4247, std.dev.: 0.0160) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.39% (2.7317 => 2.7698, std.dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.04% (2.4331 => 2.4583, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.75% (0.3141 => 0.2929, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.15% (0.2466 => 0.2339, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -4.43% (0.6591 => 0.6299, std.dev.: 0.0069) SingleSource/UnitTests/Vector/constpool: -3.11% (8.7072 => 8.4364, std.dev.: 0.0504) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -2.98% (1.3743 => 1.3333, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.33% (0.9844 => 0.9615, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/football/football: -2.30% (0.8990 => 0.8783, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -2.00% (1.2763 => 1.2508, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -1.81% (0.6025 => 0.5916, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.80% (5.3759 => 5.2794, std.dev.: 0.0236) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.72% (8.8885 => 8.7353, std.dev.: 0.0305) MultiSource/Applications/d/make_dparser: -1.28% (3.3205 => 3.2779, std.dev.: 0.0106) MultiSource/Applications/siod/siod: -1.09% (2.2599 => 2.2353, std.dev.: 0.0052) MultiSource/Applications/SPASS/SPASS: -1.09% (14.5780 => 14.4198, std.dev.: 0.0440) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.11% (16.5809 => 16.5630, std.dev.: 0.0632) MultiSource/Applications/obsequi/Obsequi: -2.22% (1.0687 => 1.0450, std.dev.: 0.0097) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.37% (21.5642 => 21.6432, std.dev.: 0.1575) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.06% (0.3617 => 0.3619, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 0.33% (0.5990 => 0.6010, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.24% (0.3301 => 0.3309, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: -0.90% (0.1997 => 0.1979, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -24.66% (0.0219 => 0.0165, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.47% (0.0429 => 0.0427, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0333 => 0.0333, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -24.76% (0.0315 => 0.0237, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.47% (0.0426 => 0.0424, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/casts: -1.46% (0.0205 => 0.0202, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0218 => 0.0218, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.55% (0.1458 => 0.1450, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -3.01% (1.1215 => 1.0877, std.dev.: 0.0316) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -5.39% (0.1522 => 0.1440, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.38% (0.4223 => 0.4207, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.77% (0.1265 => 0.1300, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.40% (0.0625 => 0.0585, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -16.73% (0.0269 => 0.0224, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: - (0.0557 => 0.0557, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.78% (1.1454 => 1.1365, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 500.00% (0.0001 => 0.0006, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -94.44% (0.0018 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.55% (0.0593 => 0.0566, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.63% (0.0249 => 0.0230, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.06% (0.8019 => 0.8014, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 48.08% (0.0052 => 0.0077, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2285.93% (0.6332 => 15.1077, std.dev.: 0.0947) MultiSource/Benchmarks/McCat/08-main/main: 44.40% (0.1831 => 0.2644, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.11% (0.1559 => 0.1417, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1478.77% (0.3344 => 5.2794, std.dev.: 0.0236) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.29% (0.2364 => 0.3222, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -0.23% (0.0429 => 0.0428, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.36% (0.0224 => 0.0236, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3447, std.dev.: 0.0086) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0686, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4948, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3407, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0429, std.dev.: 0.0281) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4025, std.dev.: 0.0032) SingleSource/Regression/C/uint64_to_float: -23.89% (2.1832 => 1.6617, std.dev.: 0.0042) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.28% (0.2180 => 0.2317, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.38% (0.7473 => 0.7800, std.dev.: 0.0063) MultiSource/Applications/spiff/spiff: 3.19% (0.7950 => 0.8204, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.01% (0.8007 => 0.8248, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.68% (0.4783 => 0.4911, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.65% (6.6074 => 6.7825, std.dev.: 0.0487) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.43% (0.8805 => 0.9019, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.16% (0.8697 => 0.8885, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.09% (0.7932 => 0.8098, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.98% (4.1763 => 4.2589, std.dev.: 0.0203) MultiSource/Benchmarks/nbench/nbench: 1.84% (1.1271 => 1.1478, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: 1.83% (31.8598 => 32.4435, std.dev.: 0.0495) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.80% (4.4873 => 4.5681, std.dev.: 0.0175) MultiSource/Applications/SIBsim4/SIBsim4: 1.79% (1.2568 => 1.2793, std.dev.: 0.0069) MultiSource/Applications/ClamAV/clamscan: 1.68% (14.7684 => 15.0164, std.dev.: 0.0565) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.62% (0.9074 => 0.9221, std.dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: 1.50% (8.6247 => 8.7545, std.dev.: 0.0321) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.39% (0.8204 => 0.8318, std.dev.: 0.0027) MultiSource/Applications/d/make_dparser: 1.28% (3.2366 => 3.2779, std.dev.: 0.0106) MultiSource/Applications/oggenc/oggenc: 1.22% (4.9628 => 5.0233, std.dev.: 0.0036) MultiSource/Applications/JM/ldecod/ldecod: 1.15% (6.7320 => 6.8094, std.dev.: 0.0199) MultiSource/Applications/SPASS/SPASS: 1.12% (14.2605 => 14.4198, std.dev.: 0.0440) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.11% (4.4880 => 4.5378, std.dev.: 0.0101) MultiSource/Applications/lua/lua: 1.07% (3.8189 => 3.8597, std.dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: 1.04% (15.3280 => 15.4872, std.dev.: 0.0447) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.01% (8.6476 => 8.7353, std.dev.: 0.0305) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 57.33% (1.5795 => 2.4850, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.03% (1.1857 => 1.2809, std.dev.: 0.0082) MultiSource/Benchmarks/mafft/pairlocalalign: 5.92% (63.1822 => 66.9252, std.dev.: 0.0958) SingleSource/Benchmarks/Misc/ReedSolomon: 2.83% (8.5322 => 8.7740, std.dev.: 0.0288) MultiSource/Applications/siod/siod: 2.60% (3.6643 => 3.7597, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.39% (44.5605 => 45.6265, std.dev.: 0.0600) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.60% (4.3552 => 4.4247, std.dev.: 0.0160) MultiSource/Applications/minisat/minisat: 1.20% (6.1525 => 6.2263, std.dev.: 0.0183) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.03% (2.4333 => 2.4583, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.02% (4.8362 => 4.8855, std.dev.: 0.0141) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -7.13% (0.1430 => 0.1328, std.dev.: 0.0029) MultiSource/Applications/lua/lua: -5.29% (29.8330 => 28.2558, std.dev.: 0.1460) SingleSource/Benchmarks/Shootout/heapsort: -4.59% (3.2926 => 3.1414, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.24% (7.2130 => 6.9074, std.dev.: 0.1026) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.78% (1.2822 => 1.2594, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/hash2: -1.42% (3.4237 => 3.3752, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.20% (3.3479 => 3.3077, std.dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.71% (16.4461 => 16.5630, std.dev.: 0.0632) MultiSource/Applications/obsequi/Obsequi: 1.83% (1.0262 => 1.0450, std.dev.: 0.0097) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6830.26% (0.3123 => 21.6432, std.dev.: 0.1575) SingleSource/Benchmarks/CoyoteBench/fftbench: 46.93% (0.2463 => 0.3619, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.6010 => 0.6010, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.32% (0.3266 => 0.3309, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 0.51% (0.1969 => 0.1979, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 34.15% (0.0123 => 0.0165, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -21.52% (0.0302 => 0.0237, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.83% (0.1438 => 0.1450, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -3.99% (1.1329 => 1.0877, std.dev.: 0.0316) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.50% (0.1462 => 0.1440, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.03% (0.4164 => 0.4207, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.04% (0.1369 => 0.1300, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.74% (0.0641 => 0.0585, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 14.87% (0.0195 => 0.0224, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.63% (0.0578 => 0.0557, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.63% (1.1437 => 1.1365, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 500.00% (0.0001 => 0.0006, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.73% (0.0627 => 0.0566, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 27.78% (0.0180 => 0.0230, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.04% (0.8017 => 0.8014, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 24.19% (0.0062 => 0.0077, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 2 08:36:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 2 Nov 2012 10:36:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121102153638.70A8C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5529?compare_to=5505&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5529, Order: 167260, Start Time: 2012-11-01 23:05:18, End Time: 2012-11-02 15:36:41 To: 5505, Order: 167249, Start Time: 2012-11-01 21:02:33, End Time: 2012-11-01 22:35:42 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 40 (34 on baseline) New Passes: 0 (12 on baseline) Performance Regressions: 27 (173 on baseline) Performance Improvements: 17 (37 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 1 (7 on baseline) Unchanged Tests: 957 (645 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/ClamAV/clamscan: 4.92% (27.0486 => 28.3800, std.dev.: 0.0465) MultiSource/Applications/JM/ldecod/ldecod: -32.61% (9.3983 => 6.3332, std.dev.: 0.0245) MultiSource/Applications/JM/lencod/lencod: -12.72% (21.4896 => 18.7561, std.dev.: 0.0318) MultiSource/Applications/oggenc/oggenc: -99.97% (6.1795 => 0.0020) MultiSource/Applications/sqlite3/sqlite3: -97.11% (18.3127 => 0.5285, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.83% (5.3698 => 5.0568, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -18.22% (1.7377 => 1.4211, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -46.51% (0.5695 => 0.3046, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -79.61% (0.1388 => 0.0283, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -46.45% (2.4474 => 1.3107, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/voronoi/voronoi: -36.52% (0.3102 => 0.1969, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -99.92% (2.5534 => 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -99.80% (0.9988 => 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -25.08% (0.3716 => 0.2784, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -46.38% (2.4487 => 1.3130, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -4.11% (5.4363 => 5.2126, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -3.17% (1.4329 => 1.3875, std.dev.: 0.0052) MultiSource/Benchmarks/nbench/nbench: -15.57% (1.3094 => 1.1055, std.dev.: 0.0058) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -99.99% (29.2026 => 0.0020) New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/ClamAV/clamscan: -99.94% (0.1571 => 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -99.92% (0.1212 => 0.0001) MultiSource/Applications/JM/lencod/lencod: -100.00% (7.6960 => 0.0001) MultiSource/Applications/oggenc/oggenc: -99.92% (0.1326 => 0.0001) MultiSource/Applications/sqlite3/sqlite3: -100.00% (4.5154 => 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.06% (4.4231 => 0.0416, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -97.62% (0.0042 => 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -50.00% (0.0002 => 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -75.00% (0.0004 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.51% (0.0203 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -99.96% (0.2515 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 45194.72% (1.1036 => 499.8725, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: -99.97% (0.3101 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -100.00% (2.6588 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -100.00% (2.1268 => 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -100.00% (4.3305 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -99.69% (0.0319 => 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -97.14% (0.0035 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -99.31% (0.0144 => 0.0001) MultiSource/Benchmarks/nbench/nbench: -100.00% (11.7510 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -99.99% (0.7488 => 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: 167.35% (0.0882 => 0.2358, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 57.41% (61.6361 => 97.0205, std.dev.: 0.0616) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.24% (7.0380 => 10.9960, std.dev.: 0.0210) SingleSource/Benchmarks/Misc/flops: 49.29% (0.1475 => 0.2202, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.51% (2.5189 => 3.2370, std.dev.: 0.0046) MultiSource/Benchmarks/PAQ8p/paq8p: 14.64% (9.7822 => 11.2139, std.dev.: 0.0139) SingleSource/Benchmarks/CoyoteBench/almabench: 14.15% (0.1032 => 0.1178, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 12.45% (0.3623 => 0.4074, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/distray/distray: 7.71% (0.1466 => 0.1579, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.90% (15.4066 => 16.3158, std.dev.: 0.0163) MultiSource/Benchmarks/McCat/08-main/main: 5.65% (0.2971 => 0.3139, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.78% (0.8582 => 0.8906, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.30% (4.1457 => 4.2825, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/flops-6: 39.42% (1.4240 => 1.9854, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: 32.94% (1.5073 => 2.0038, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 26.83% (6.1495 => 7.7994, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.41% (5.5320 => 6.7716, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 15.31% (1.7613 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 11.66% (2.0751 => 2.3171) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.43% (1.7655 => 1.8791, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 5.82% (8.6808 => 9.1859, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.83% (8.5499 => 8.7916, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.57% (1.3590 => 1.3939, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 2.45% (0.9573 => 0.9808, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.09% (5.3965 => 5.5093, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.67% (78.8087 => 80.1213, std.dev.: 0.3507) MultiSource/Benchmarks/Bullet/bullet: 1.67% (7.4695 => 7.5939, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -61.50% (3.1278 => 1.2043, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -19.18% (0.1444 => 0.1167, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -10.12% (0.1819 => 0.1635, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: -9.19% (0.2459 => 0.2233, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.33% (1.3414 => 1.2699, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.72% (8.0316 => 7.8937, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.46% (10.2968 => 10.1468, std.dev.: 0.0113) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -44.00% (0.0650 => 0.0364, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: -12.95% (0.1992 => 0.1734, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -7.74% (31.3667 => 28.9398, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.49% (5.4287 => 5.1852, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.06% (1.4938 => 1.4332, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.53% (6.9156 => 6.6713, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.25% (5.4609 => 5.3382, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.23% (1.5957 => 1.5760, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.22% (5.6055 => 5.5370, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/himenobmtxpa: -1.10% (3.7181 => 3.6771, std.dev.: 0.0043) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.88% (0.0648 => 0.0712, std.dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/nbench/nbench MultiSource/Applications/ClamAV/clamscan: 27.98% (22.1758 => 28.3800, std.dev.: 0.0465) MultiSource/Applications/JM/ldecod/ldecod: -39.31% (10.4361 => 6.3332, std.dev.: 0.0245) MultiSource/Applications/JM/lencod/lencod: -14.50% (21.9371 => 18.7561, std.dev.: 0.0318) MultiSource/Applications/oggenc/oggenc: -99.97% (5.7591 => 0.0020) MultiSource/Applications/sqlite3/sqlite3: -96.92% (17.1811 => 0.5285, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.26% (4.9449 => 5.0568, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -7.81% (1.5415 => 1.4211, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -37.57% (0.4879 => 0.3046, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.58% (6.6874 => 0.0283, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -75.51% (5.3526 => 1.3107, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/voronoi/voronoi: -27.07% (0.2700 => 0.1969, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -99.93% (2.9384 => 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -99.82% (1.1194 => 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -12.37% (0.3177 => 0.2784, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -75.62% (5.3855 => 1.3130, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.21% (5.0018 => 5.2126, std.dev.: 0.0133) MultiSource/Benchmarks/nbench/nbench: -6.63% (1.1840 => 1.1055, std.dev.: 0.0058) New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/nbench/nbench MultiSource/Applications/ClamAV/clamscan: -99.94% (0.1629 => 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -99.92% (0.1298 => 0.0001) MultiSource/Applications/sqlite3/sqlite3: -100.00% (4.6441 => 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -98.00% (0.0050 => 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -50.00% (0.0002 => 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -75.00% (0.0004 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -99.97% (0.3987 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 44226.73% (1.1277 => 499.8725, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: -99.97% (0.3070 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -100.00% (2.6546 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -100.00% (2.6778 => 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -100.00% (4.5009 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -99.80% (0.0506 => 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -97.30% (0.0037 => 0.0001) MultiSource/Benchmarks/nbench/nbench: -100.00% (11.6436 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 193.13% (0.5229 => 1.5328, std.dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: 13.07% (14.9895 => 16.9484, std.dev.: 0.0346) MultiSource/Applications/kimwitu++/kc: 36.66% (14.1553 => 19.3450, std.dev.: 0.0079) MultiSource/Benchmarks/MallocBench/gs/gs: 13.09% (4.1105 => 4.6487, std.dev.: 0.0217) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.76% (3.4629 => 5.8440, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_container: 63.66% (0.6222 => 1.0183, std.dev.: 0.0008) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3839200.00% (0.0001 => 3.8393, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11167700.00% (0.0001 => 11.1678, std.dev.: 0.0191) MultiSource/Applications/kimwitu++/kc: 50800.00% (0.0001 => 0.0509, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 64300.00% (0.0001 => 0.0644, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050000.00% (0.0001 => 10.0501, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5495500.00% (0.0001 => 5.4956, std.dev.: 0.0065) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/CoyoteBench/almabench: 61.37% (0.0730 => 0.1178, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.88% (7.0540 => 10.9960, std.dev.: 0.0210) SingleSource/Benchmarks/Misc/flops: 53.77% (0.1432 => 0.2202, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 53.41% (63.2438 => 97.0205, std.dev.: 0.0616) MultiSource/Benchmarks/FreeBench/distray/distray: 49.53% (0.1056 => 0.1579, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 46.99% (2.2022 => 3.2370, std.dev.: 0.0046) SingleSource/UnitTests/vla: 29.86% (0.0355 => 0.0461, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 24.71% (8.1363 => 10.1468, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/oourafft: 24.13% (0.3282 => 0.4074, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 22.91% (0.2554 => 0.3139, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 21.15% (0.1584 => 0.1919, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.31% (0.1566 => 0.1884, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.29% (0.1125 => 0.1342, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 19.03% (0.0746 => 0.0888, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: 17.96% (0.1175 => 0.1386, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.91% (0.0793 => 0.0935, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.34% (0.0871 => 0.1022, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.28% (0.1117 => 0.1310, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.65% (0.8172 => 0.9533, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.42% (0.0798 => 0.0929, std.dev.: 0.0036) MultiSource/Applications/aha/aha: 15.99% (0.1151 => 0.1335, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 15.65% (0.1655 => 0.1914, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 15.56% (0.1163 => 0.1344, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.32% (0.0842 => 0.0971, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/matrix: 15.16% (0.0818 => 0.0942, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 14.87% (0.1695 => 0.1947, std.dev.: 0.0019) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.61% (0.1143 => 0.1310, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.56% (0.0886 => 0.1015, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 14.38% (0.0953 => 0.1090, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.33% (0.2065 => 0.2361, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.27% (0.0834 => 0.0953, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 14.20% (0.5105 => 0.5830, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 14.19% (0.0719 => 0.0821, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 13.88% (0.1268 => 0.1444, std.dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 13.83% (0.1555 => 0.1770, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.81% (0.1940 => 0.2208, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.78% (0.4615 => 0.5251, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 13.72% (0.7115 => 0.8091, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.64% (0.0770 => 0.0875, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.64% (0.0770 => 0.0875, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.57% (14.3668 => 16.3158, std.dev.: 0.0163) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.52% (0.3121 => 0.3543, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.45% (0.2758 => 0.3129, std.dev.: 0.0059) MultiSource/Applications/sgefa/sgefa: 13.41% (0.3109 => 0.3526, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.39% (0.1337 => 0.1516, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.38% (0.5981 => 0.6781, std.dev.: 0.0039) MultiSource/Applications/spiff/spiff: 13.29% (0.7835 => 0.8876, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.27% (0.6675 => 0.7561, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 13.24% (0.7433 => 0.8417, std.dev.: 0.0045) MultiSource/Applications/Burg/burg: 13.16% (1.1642 => 1.3174, std.dev.: 0.0104) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.15% (0.2107 => 0.2384, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.11% (0.1510 => 0.1708, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.11% (0.1236 => 0.1398) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.08% (0.1032 => 0.1167, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.90% (0.2271 => 0.2564, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.83% (0.1029 => 0.1161, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.82% (0.5569 => 0.6283, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.81% (0.1062 => 0.1198, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.80% (0.1906 => 0.2150, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/exptree: 12.78% (0.0814 => 0.0918, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.73% (0.9765 => 1.1008, std.dev.: 0.0032) MultiSource/Applications/d/make_dparser: 12.61% (3.3354 => 3.7560, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.58% (0.5860 => 0.6597, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.54% (1.3050 => 1.4686, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.53% (0.5020 => 0.5649, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 12.33% (0.3423 => 0.3845, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.06% (0.3441 => 0.3856, std.dev.: 0.0025) MultiSource/Applications/lua/lua: 11.83% (3.8723 => 4.3305, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.70% (0.3307 => 0.3694, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 11.70% (2.0273 => 2.2645, std.dev.: 0.0071) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.64% (0.2603 => 0.2906, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.63% (0.6450 => 0.7200, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.25% (4.2646 => 4.7444, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.21% (0.1695 => 0.1885, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 11.15% (0.0933 => 0.1037, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.09% (0.0929 => 0.1032, std.dev.: 0.0015) SingleSource/UnitTests/SignlessTypes/rem: 11.01% (0.1144 => 0.1270, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 10.98% (0.4299 => 0.4771, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 10.93% (1.0722 => 1.1894, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.88% (1.5859 => 1.7584, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 10.87% (0.1463 => 0.1622, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.82% (0.1044 => 0.1157, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 10.74% (1.1861 => 1.3135, std.dev.: 0.0099) MultiSource/Benchmarks/mafft/pairlocalalign: 10.74% (9.4845 => 10.5028, std.dev.: 0.0160) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.73% (0.1892 => 0.2095, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.54% (2.2024 => 2.4345, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.49% (0.3927 => 0.4339, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.43% (2.2969 => 2.5364, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.40% (0.8067 => 0.8906, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/bigfib: 10.33% (0.6456 => 0.7123, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 10.27% (0.3543 => 0.3907, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.26% (0.8101 => 0.8932, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 10.16% (0.3180 => 0.3503, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 10.13% (0.8921 => 0.9825, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/trivial-interface: 10.11% (0.3473 => 0.3824, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.03% (3.8922 => 4.2825, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.96% (0.3543 => 0.3896, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 9.93% (0.3828 => 0.4208, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.89% (0.3497 => 0.3843, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 9.79% (0.4289 => 0.4709, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-3: 9.78% (0.3516 => 0.3860, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/synchronized: 9.77% (0.3561 => 0.3909) MultiSource/Benchmarks/sim/sim: 9.71% (0.3387 => 0.3716, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/property: 9.70% (0.3886 => 0.4263, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 9.64% (0.3694 => 0.4050, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.54% (1.4186 => 1.5539, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.47% (0.3865 => 0.4231, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 9.46% (1.5603 => 1.7079, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/hash2: 9.24% (0.4620 => 0.5047, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.21% (0.4636 => 0.5063, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 9.19% (0.6030 => 0.6584, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.11% (0.5925 => 0.6465, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.93% (0.2430 => 0.2647, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.92% (0.4203 => 0.4578, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.92% (0.4103 => 0.4469, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists: 8.65% (0.3422 => 0.3718, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.52% (0.7326 => 0.7950, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/moments: 8.47% (0.4048 => 0.4391, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 8.41% (0.3684 => 0.3994, std.dev.: 0.0080) SingleSource/Benchmarks/Stanford/Puzzle: 8.20% (0.1268 => 0.1372, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 8.17% (10.3673 => 11.2139, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/sieve: 8.16% (0.3603 => 0.3897, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.91% (0.2793 => 0.3014, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.42% (0.3650 => 0.3921, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.42% (0.3826 => 0.4110, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.29% (0.2756 => 0.2957, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 7.21% (0.3092 => 0.3315, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 7.17% (0.2831 => 0.3034, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.16% (0.4064 => 0.4355, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 7.08% (0.2725 => 0.2918, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.05% (2.0665 => 2.2122, std.dev.: 0.0218) SingleSource/Regression/C++/ofstream_ctor: 7.02% (0.2905 => 0.3109, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.02% (0.2891 => 0.3094, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 7.00% (0.2714 => 0.2904, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.96% (0.3162 => 0.3382, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.84% (0.3232 => 0.3453, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.82% (0.3283 => 0.3507, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/matrix: 6.78% (0.3098 => 0.3308, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.62% (0.3427 => 0.3654, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.62% (0.2871 => 0.3061, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.52% (0.3052 => 0.3251, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.51% (0.2872 => 0.3059, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.46% (0.2802 => 0.2983, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.29% (1.2842 => 1.3650, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary2: 6.19% (0.3379 => 0.3588) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.52% (0.3136 => 0.3309) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.57% (0.3935 => 0.4115, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.50% (0.3131 => 0.3272, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 26.54% (1.5835 => 2.0038, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 19.81% (2.8904 => 3.4630, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 17.35% (6.6465 => 7.7994, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 17.31% (1.6925 => 1.9854, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.06% (1.1145 => 1.3046, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 9.92% (1.1396 => 1.2527, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 9.63% (1.8525 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.91% (1.7254 => 1.8791, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3682, std.dev.: 0.0005) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 3.99% (8.8334 => 9.1859, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 3.19% (0.9505 => 0.9808, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.62% (8.6802 => 8.9078, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.48% (4.2280 => 4.3329, std.dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bisort/bisort: 1.93% (0.8333 => 0.8494, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 1.92% (1.3677 => 1.3939, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 1.82% (3.1595 => 3.2170, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.03% (3.6395 => 3.6771, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.18% (5.2763 => 1.2043, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -75.27% (0.8651 => 0.2139) SingleSource/Benchmarks/Misc/richards_benchmark: -45.50% (0.1622 => 0.0884, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -27.88% (1.7609 => 1.2699, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -12.26% (0.1330 => 0.1167, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -9.20% (54.1659 => 49.1828, std.dev.: 0.0270) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.04% (0.0628 => 0.0364, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: -33.39% (1.1492 => 0.7655, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -29.10% (10.7105 => 7.5939, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/mason/mason: -19.76% (0.2161 => 0.1734, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -10.99% (9.5636 => 8.5128, std.dev.: 0.0065) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.99% (32.5116 => 28.9398, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/mandel-2: -10.82% (1.5373 => 1.3710, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.48% (1.5660 => 1.4332, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.36% (19.9488 => 18.2810, std.dev.: 0.0222) MultiSource/Benchmarks/FreeBench/distray/distray: -8.04% (0.1592 => 0.1464, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.08% (1.8329 => 1.7031, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4780, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.22% (1.6805 => 1.5760, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -6.17% (1.2373 => 1.1610, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.05% (0.2497 => 0.2371, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.35% (0.4808 => 0.4599, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1553, std.dev.: 0.0081) MultiSource/Benchmarks/sim/sim: -3.24% (5.0483 => 4.8849, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.17% (0.9957 => 0.9641, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/almabench: -2.29% (11.3103 => 11.0511, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.19% (8.1563 => 7.9777, std.dev.: 0.0302) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/PAQ8p/paq8p: -1.76% (85.0658 => 83.5675, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/salsa20: -1.65% (10.2830 => 10.1129, std.dev.: 0.0113) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5109, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: -1.39% (1.9405 => 1.9136, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2334, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 25.59% (1.1048 => 1.3875, std.dev.: 0.0052) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -99.97% (7.1582 => 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: -99.86% (0.0720 => 0.0001) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -66.35% (0.2116 => 0.0712, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 2 09:56:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 2 Nov 2012 11:56:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121102165608.AECE72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5530?compare_to=5525&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5530, Order: 167295, Start Time: 2012-11-02 13:40:40, End Time: 2012-11-02 16:56:12 To: 5525, Order: 167286, Start Time: 2012-11-02 09:36:15, End Time: 2012-11-02 12:52:25 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (170 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1042 (719 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.80% (0.0625 => 0.0880, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.89% (0.1063 => 0.1402, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.60% (0.2969 => 0.3729, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.23% (0.1106 => 0.1385, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.29% (0.4253 => 0.5286, std.dev.: 0.0037) MultiSource/Applications/oggenc/oggenc: 24.28% (1.5932 => 1.9800, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.23% (0.0714 => 0.0887, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.16% (0.4139 => 0.5139, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.23% (0.4994 => 0.6154, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.61% (0.5900 => 0.7234, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.52% (0.5000 => 0.6126, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.26% (0.0584 => 0.0714, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 21.69% (0.0604 => 0.0735, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.60% (0.1620 => 0.1970, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.52% (0.0897 => 0.1090, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.25% (0.1021 => 0.1238, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 21.04% (0.0599 => 0.0725, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.96% (0.1107 => 0.1339, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.21% (0.0584 => 0.0702) MultiSource/Benchmarks/Olden/em3d/em3d: 20.15% (0.0948 => 0.1139, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.06% (0.0633 => 0.0760, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.96% (0.0541 => 0.0649, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.94% (0.0642 => 0.0770, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.78% (0.3903 => 0.4675, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 19.73% (0.0821 => 0.0983, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.63% (0.1549 => 0.1853, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.58% (0.1103 => 0.1319, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 19.52% (0.1619 => 0.1935, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.45% (0.1604 => 0.1916, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.34% (0.0822 => 0.0981, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.24% (0.1003 => 0.1196, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 18.64% (0.5826 => 0.6912, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.62% (0.2014 => 0.2389, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 18.27% (0.5889 => 0.6965, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 18.16% (0.0947 => 0.1119, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.94% (0.3890 => 0.4588, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 17.82% (0.0808 => 0.0952, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.78% (0.1462 => 0.1722, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 17.49% (0.1218 => 0.1431, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 17.28% (0.1505 => 0.1765, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.25% (0.2736 => 0.3208, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 17.20% (0.4029 => 0.4722, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.19% (0.1088 => 0.1275, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.16% (1.3152 => 1.5409, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/mst/mst: 16.91% (0.0698 => 0.0816, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.78% (0.2866 => 0.3347, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.67% (3.5627 => 4.1567, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference: 16.64% (0.7171 => 0.8364, std.dev.: 0.0030) SingleSource/Regression/C++/ofstream_ctor: 16.58% (0.3004 => 0.3502, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.45% (0.2875 => 0.3348, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 16.41% (0.5546 => 0.6456, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.25% (1.6211 => 1.8846, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 16.20% (1.8794 => 2.1839, std.dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.16% (0.1968 => 0.2286, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.04% (0.4658 => 0.5405, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.03% (0.1160 => 0.1346, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.92% (0.5026 => 0.5826, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/fibo: 15.89% (0.2725 => 0.3158, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 15.87% (0.9697 => 1.1236, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/18-imp/imp: 15.83% (0.1421 => 0.1646, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.81% (0.3271 => 0.3788, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.67% (0.2738 => 0.3167, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 15.66% (0.2714 => 0.3139, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 15.60% (1.0781 => 1.2463, std.dev.: 0.0060) MultiSource/Applications/hexxagon/hexxagon: 15.59% (0.9909 => 1.1454, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/matrix: 15.54% (0.2780 => 0.3212, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.51% (0.2792 => 0.3225, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.49% (0.3195 => 0.3690, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 15.45% (0.2750 => 0.3175, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 15.44% (0.2811 => 0.3245, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.43% (0.2729 => 0.3150, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.39% (0.4361 => 0.5032, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.34% (2.0673 => 2.3844, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 15.34% (0.2823 => 0.3256, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 15.32% (0.2813 => 0.3244, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 15.27% (0.2803 => 0.3231, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.24% (0.3930 => 0.4529, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.22% (4.4195 => 5.0923, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/wc: 15.21% (0.3096 => 0.3567, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 15.11% (0.1284 => 0.1478, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.09% (2.7292 => 3.1409, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.05% (0.2911 => 0.3349, std.dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 15.00% (4.2109 => 4.8424, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.86% (1.9694 => 2.2621, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.77% (0.1090 => 0.1251, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.71% (1.9966 => 2.2903, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ary3: 14.57% (0.3267 => 0.3743, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 14.57% (23.5202 => 26.9462, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ary: 14.55% (0.3258 => 0.3732, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 14.55% (0.3348 => 0.3835, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.54% (0.3362 => 0.3851, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 14.47% (0.3317 => 0.3797, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 14.34% (0.3446 => 0.3940, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 14.31% (0.3465 => 0.3961, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.31% (0.3488 => 0.3987, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 14.27% (0.3496 => 0.3995, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 14.21% (0.3469 => 0.3962, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/exceptions-3: 14.19% (0.3460 => 0.3951, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.15% (0.3060 => 0.3493, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 14.12% (0.3442 => 0.3928, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.99% (0.3124 => 0.3561, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 13.81% (0.3678 => 0.4186, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.81% (0.3643 => 0.4146, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 13.75% (0.3650 => 0.4152, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 13.69% (0.3726 => 0.4236, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 13.66% (0.3477 => 0.3952, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.65% (0.3282 => 0.3730, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 13.64% (0.3724 => 0.4232, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: 13.64% (0.2075 => 0.2358, std.dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 13.60% (0.2566 => 0.2915, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 13.60% (0.4251 => 0.4829, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 13.57% (1.4269 => 1.6205, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 13.51% (0.4146 => 0.4706, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.49% (0.3625 => 0.4114, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.36% (0.3981 => 0.4513, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.33% (0.3690 => 0.4182, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.90% (0.3845 => 0.4341, std.dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 12.85% (2.1653 => 2.4436, std.dev.: 0.0026) MultiSource/Applications/treecc/treecc: 12.80% (0.7875 => 0.8883, std.dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 12.76% (4.6177 => 5.2068, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 12.61% (0.5012 => 0.5644, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 12.16% (2.1013 => 2.3569, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.57% (0.2040 => 0.2276, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 11.41% (0.2691 => 0.2998, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 11.40% (5.5417 => 6.1734, std.dev.: 0.0152) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.14% (0.6435 => 0.7152, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.70% (0.1028 => 0.1138, std.dev.: 0.0034) MultiSource/Applications/lambda-0_1_3/lambda: 10.43% (0.3498 => 0.3863, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.34% (0.2737 => 0.3020, std.dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: 10.15% (0.4847 => 0.5339, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.12% (0.1383 => 0.1523, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.06% (0.2068 => 0.2276, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.79% (0.3084 => 0.3386, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 9.75% (0.6634 => 0.7281, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 9.71% (0.3336 => 0.3660, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.18% (0.2103 => 0.2296, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 8.76% (2.0346 => 2.2129, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 8.70% (0.2391 => 0.2599, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.37% (4.6926 => 5.0855, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.12% (11.6398 => 12.5853, std.dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.70% (0.5361 => 0.5774, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.11% (0.5584 => 0.5981, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.10% (0.7426 => 0.7953, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 6.42% (11.9555 => 12.7230, std.dev.: 0.0191) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.91% (0.3792 => 0.3978, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6534, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.22% (0.5917 => 0.6699, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 8.89% (0.2802 => 0.3051, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6116, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary: 5.51% (0.2122 => 0.2239, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (12.0509 => 12.6635, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 4.73% (15.4430 => 16.1731, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-2: 4.58% (1.8057 => 1.8884, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: 3.37% (14.0481 => 14.5213, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1922, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.68% (3.1722 => 3.2255, std.dev.: 0.0038) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3023, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2852, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5401, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (28.0362 => 28.3435, std.dev.: 0.0363) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5974, std.dev.: 0.0141) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.71% (2.4764 => 2.4341, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.22% (25.4195 => 16.4679, std.dev.: 0.0186) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9791, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -7.66% (35.5013 => 32.7822, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: -7.58% (0.2402 => 0.2220, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/tsp/tsp: -7.19% (2.1113 => 1.9595, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.34% (11.2080 => 10.8341, std.dev.: 0.0179) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0056) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.93% (17.2379 => 16.7333, std.dev.: 0.0298) SingleSource/Benchmarks/Misc/mandel-2: -2.91% (3.6262 => 3.5207, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.19% (41.7953 => 40.8784, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5730, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4952, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7160, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.10% (105.3826 => 104.2283, std.dev.: 0.0671) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.09% (3.3991 => 3.3621, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0431, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 2 12:36:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 2 Nov 2012 14:36:31 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121102193631.CE10E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5531?compare_to=5528&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5531, Order: 167300, Start Time: 2012-11-02 18:09:34, End Time: 2012-11-02 19:36:36 To: 5528, Order: 167295, Start Time: 2012-11-02 13:29:22, End Time: 2012-11-02 14:55:22 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 13 (48 on baseline) Performance Improvements: 0 (5 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 978 (921 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.87% (0.1040 => 0.1153, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.45% (0.2929 => 0.3118, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.68% (0.8467 => 0.8948, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.86% (0.6299 => 0.6542, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.04% (0.8392 => 0.8647, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.85% (1.2385 => 1.2738, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.11% (1.1896 => 1.2147, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.85% (0.8753 => 0.8915, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.75% (0.8410 => 0.8557, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.55% (1.0064 => 1.0220, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.13% (1.1201 => 1.1328, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.19% (59.6363 => 60.9425, std.dev.: 0.2082) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.59% (4.4206 => 4.4908, std.dev.: 0.0096) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.20% (16.5630 => 16.5964, std.dev.: 0.1038) MultiSource/Applications/obsequi/Obsequi: 0.92% (1.0450 => 1.0546, std.dev.: 0.0193) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.39% (21.6432 => 21.9451, std.dev.: 0.0907) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.99% (0.3619 => 0.3655, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/bigfib: 0.05% (0.6010 => 0.6013, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.97% (0.3309 => 0.3341, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 0.76% (0.1979 => 0.1994, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 32.12% (0.0165 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0427 => 0.0426) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -11.11% (0.0333 => 0.0296, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 32.49% (0.0237 => 0.0314, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0424 => 0.0424, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/casts: 0.50% (0.0202 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 0.46% (0.0218 => 0.0219, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: - (0.1450 => 0.1450, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: 2.31% (1.0877 => 1.1128, std.dev.: 0.0356) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.54% (0.1440 => 0.1491, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.04% (0.4207 => 0.4037, std.dev.: 0.0219) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.23% (0.1300 => 0.1316, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.59% (0.0585 => 0.0564, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 15.18% (0.0224 => 0.0258, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.08% (0.0557 => 0.0551, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.48% (1.1365 => 1.1420, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -83.33% (0.0006 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.30% (0.0566 => 0.0579, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.78% (0.0230 => 0.0264, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.05% (0.8014 => 0.8018, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 3.90% (0.0077 => 0.0080, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2290.68% (0.6332 => 15.1378, std.dev.: 0.4074) MultiSource/Benchmarks/McCat/08-main/main: 48.66% (0.1831 => 0.2722, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.03% (0.1559 => 0.1465, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1505.02% (0.3344 => 5.3672, std.dev.: 0.0533) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.49% (0.2364 => 0.3203, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: -0.70% (0.0429 => 0.0426, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.12% (0.0224 => 0.0231, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3470, std.dev.: 0.0320) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0718, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4942, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3438, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0229, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3998, std.dev.: 0.0054) SingleSource/Regression/C/uint64_to_float: -23.91% (2.1832 => 1.6612, std.dev.: 0.0033) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.79% (0.0810 => 0.0946, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: 9.62% (0.1112 => 0.1219, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.86% (0.1425 => 0.1537, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.84% (0.2180 => 0.2351, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.54% (0.8321 => 0.8948, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.76% (0.2279 => 0.2433, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.63% (0.1885 => 0.2010, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.12% (0.8148 => 0.8647, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.19% (0.1983 => 0.2086, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.00% (0.2998 => 0.3148, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.66% (1.1606 => 1.2147, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.29% (0.2519 => 0.2627, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.06% (0.6287 => 0.6542, std.dev.: 0.0059) MultiSource/Applications/spiff/spiff: 3.85% (0.7950 => 0.8256, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.62% (0.5961 => 0.6177, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.53% (0.8611 => 0.8915, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.15% (0.9908 => 1.0220, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: 3.13% (1.2222 => 1.2605, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.90% (0.8316 => 0.8557, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.60% (1.4479 => 1.4856, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.56% (0.5817 => 0.5966, std.dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.29% (6.6074 => 6.7590, std.dev.: 0.0333) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.06% (0.8286 => 0.8457, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.06% (0.8457 => 0.8631, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.03% (8.6476 => 8.8235, std.dev.: 0.0533) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.03% (4.1763 => 4.2612, std.dev.: 0.0268) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.98% (0.8317 => 0.8482, std.dev.: 0.0053) MultiSource/Applications/treecc/treecc: 1.87% (1.9948 => 2.0322, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.86% (0.8338 => 0.8493, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 1.83% (0.6834 => 0.6959, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.61% (0.6586 => 0.6692, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.61% (1.6386 => 1.6649, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.56% (4.4873 => 4.5575, std.dev.: 0.0140) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.47% (4.4880 => 4.5538, std.dev.: 0.0117) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.41% (1.1170 => 1.1328, std.dev.: 0.0045) MultiSource/Benchmarks/Bullet/bullet: 1.32% (31.8598 => 32.2805, std.dev.: 0.1452) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.08% (1.2602 => 1.2738, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 57.44% (1.5795 => 2.4868, std.dev.: 0.0122) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.10% (14.6451 => 16.1238, std.dev.: 0.3313) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.78% (1.1857 => 1.2780, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 5.96% (63.1822 => 66.9473, std.dev.: 0.0178) MultiSource/Benchmarks/FreeBench/distray/distray: 4.23% (0.2390 => 0.2491, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.83% (59.2638 => 60.9425, std.dev.: 0.2082) MultiSource/Applications/siod/siod: 2.83% (3.6643 => 3.7680, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/ReedSolomon: 2.19% (8.5322 => 8.7193, std.dev.: 0.0251) MultiSource/Benchmarks/Olden/bh/bh: 1.66% (2.3560 => 2.3950, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.63% (4.3552 => 4.4263, std.dev.: 0.0242) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.28% (4.4340 => 4.4908, std.dev.: 0.0096) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -7.10% (3.9188 => 3.6407, std.dev.: 0.0818) MultiSource/Applications/lua/lua: -5.26% (29.8330 => 28.2640, std.dev.: 0.1434) SingleSource/Benchmarks/Shootout-C++/hash2: -1.42% (3.4237 => 3.3750, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.27% (3.3479 => 3.3055, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -1.01% (1.1216 => 1.1103, std.dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.91% (16.4461 => 16.5964, std.dev.: 0.1038) MultiSource/Applications/obsequi/Obsequi: 2.77% (1.0262 => 1.0546, std.dev.: 0.0193) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6926.93% (0.3123 => 21.9451, std.dev.: 0.0907) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.40% (0.2463 => 0.3655, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/bigfib: 0.05% (0.6010 => 0.6013, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.30% (0.3266 => 0.3341, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 1.27% (0.1969 => 0.1994, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 16.54% (0.0254 => 0.0296, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.83% (0.1438 => 0.1450, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: -1.77% (1.1329 => 1.1128, std.dev.: 0.0356) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 1.98% (0.1462 => 0.1491, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.05% (0.4164 => 0.4037, std.dev.: 0.0219) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.87% (0.1369 => 0.1316, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -12.01% (0.0641 => 0.0564, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 32.31% (0.0195 => 0.0258, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.67% (0.0578 => 0.0551, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.15% (1.1437 => 1.1420, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.66% (0.0627 => 0.0579, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 46.67% (0.0180 => 0.0264, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.01% (0.8017 => 0.8018, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 29.03% (0.0062 => 0.0080, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 2 12:40:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 2 Nov 2012 14:40:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121102194049.094E82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5532?compare_to=5527&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5532, Order: 167300, Start Time: 2012-11-02 18:15:53, End Time: 2012-11-02 19:40:52 To: 5527, Order: 167295, Start Time: 2012-11-02 12:54:01, End Time: 2012-11-02 14:19:10 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (180 on baseline) Unchanged Tests: 1042 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.01% (2.0478 => 2.1095, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: 2.55% (7.4937 => 7.6850, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hash2: 2.17% (3.1932 => 3.2625, std.dev.: 0.0083) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.90% (0.1431 => 0.1318, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.09% (0.3821 => 0.3550, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -6.81% (2.4924 => 2.3226, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.51% (0.2428 => 0.2270, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.37% (0.3357 => 0.3143, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.25% (3.5339 => 3.3130, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.24% (0.3142 => 0.2946, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.21% (0.3658 => 0.3431, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.13% (22.4056 => 21.0330, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.08% (0.9542 => 0.8962, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.02% (1.0544 => 0.9909, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.01% (0.6484 => 0.6094, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: -5.92% (4.3330 => 4.0766, std.dev.: 0.0069) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.89% (0.1716 => 0.1615, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: -5.88% (1.2515 => 1.1779, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: -5.83% (0.2160 => 0.2034, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: -5.82% (7.0961 => 6.6834, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.78% (1.2784 => 1.2045, std.dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: -5.77% (16.1920 => 15.2574, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/football/football: -5.76% (0.9179 => 0.8650, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.76% (1.6474 => 1.5525, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.76% (0.7919 => 0.7463, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/ReedSolomon: -5.75% (0.1879 => 0.1771, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -5.72% (9.2283 => 8.7009, std.dev.: 0.0105) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.71% (0.9852 => 0.9289, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.69% (0.2548 => 0.2403, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.69% (1.4642 => 1.3809, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.68% (0.1796 => 0.1694, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.67% (1.3722 => 1.2944, std.dev.: 0.0085) MultiSource/Applications/lemon/lemon: -5.60% (1.1450 => 1.0809, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.59% (1.2300 => 1.1612, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.59% (1.6364 => 1.5449, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.58% (0.5857 => 0.5530, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.57% (4.5069 => 4.2557, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/08-main/main: -5.57% (0.2659 => 0.2511, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -5.54% (1.3148 => 1.2419, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: -5.54% (0.3880 => 0.3665, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -5.54% (0.3812 => 0.3601, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.53% (4.8161 => 4.5498, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.53% (0.2695 => 0.2546, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -5.53% (2.4021 => 2.2693, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.52% (0.4151 => 0.3922, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.51% (0.6293 => 0.5946, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.51% (0.6736 => 0.6365, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions: -5.51% (0.4176 => 0.3946, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -5.50% (4.0594 => 3.8363, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.49% (0.5591 => 0.5284, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -5.48% (0.3831 => 0.3621, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.48% (0.2355 => 0.2226, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.47% (0.3891 => 0.3678, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.47% (0.6304 => 0.5959, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.46% (0.7339 => 0.6938, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.46% (0.3884 => 0.3672, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.45% (0.6052 => 0.5722, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.45% (14.2083 => 13.4346, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: -5.43% (0.4861 => 0.4597, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -5.43% (0.4033 => 0.3814, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.42% (5.4682 => 5.1717, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.42% (4.8802 => 4.6156, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/synchronized: -5.42% (0.3896 => 0.3685, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.42% (0.6297 => 0.5956, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.41% (0.5802 => 0.5488, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -5.41% (0.3848 => 0.3640, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.40% (0.6681 => 0.6320, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -5.39% (0.3025 => 0.2862, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.39% (0.3323 => 0.3144, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -5.39% (0.2989 => 0.2828, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.38% (0.6446 => 0.6099, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.38% (0.3849 => 0.3642, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.38% (0.6194 => 0.5861, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.37% (0.8521 => 0.8063, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.37% (4.0323 => 3.8157, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.37% (0.6667 => 0.6309, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: -5.37% (15.5079 => 14.6755, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.37% (0.5999 => 0.5677, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.35% (0.6230 => 0.5897, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary3: -5.34% (0.3446 => 0.3262, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.33% (0.4199 => 0.3975, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.32% (0.6260 => 0.5927, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -5.31% (17.1032 => 16.1943, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.31% (0.5478 => 0.5187, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.31% (0.5705 => 0.5402, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: -5.31% (0.3581 => 0.3391, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.29% (0.5575 => 0.5280, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -5.29% (0.7447 => 0.7053, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.29% (0.5863 => 0.5553, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.28% (0.3406 => 0.3226, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.28% (0.5849 => 0.5540, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.28% (0.5925 => 0.5612, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.28% (0.5168 => 0.4895, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -5.27% (0.2939 => 0.2784, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.27% (0.6395 => 0.6058, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.27% (0.2999 => 0.2841, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.27% (0.4083 => 0.3868, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.26% (6.7716 => 6.4154, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/fibo: -5.26% (0.2871 => 0.2720) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.23% (0.5941 => 0.5630, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -5.23% (0.3194 => 0.3027, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.22% (0.5570 => 0.5279, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.22% (0.7524 => 0.7131, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.22% (0.5859 => 0.5553, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -5.22% (0.3394 => 0.3217, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: -5.21% (1.1530 => 1.0929, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.20% (0.2903 => 0.2752, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.20% (0.6676 => 0.6329, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: -5.19% (0.4280 => 0.4058, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.18% (2.1713 => 2.0588, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/moments: -5.18% (0.4248 => 0.4028, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.18% (2.2587 => 2.1418, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.17% (0.3057 => 0.2899, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -5.16% (0.2849 => 0.2702, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -5.16% (0.2985 => 0.2831, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.15% (0.2933 => 0.2782, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -5.15% (0.3205 => 0.3040, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -5.15% (0.3867 => 0.3668, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -5.14% (0.3481 => 0.3302, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.14% (0.3016 => 0.2861, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.14% (0.6033 => 0.5723, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: -5.14% (0.3621 => 0.3435, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: -5.14% (1.3864 => 1.3152, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.14% (0.6660 => 0.6318, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.13% (0.5456 => 0.5176, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: -5.13% (0.3255 => 0.3088, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.13% (0.9557 => 0.9067, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.12% (0.6189 => 0.5872, std.dev.: 0.0078) MultiSource/Applications/kimwitu++/kc: -5.12% (18.2933 => 17.3572, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.11% (0.5581 => 0.5296, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.11% (0.4916 => 0.4665, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.10% (0.5567 => 0.5283, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.10% (0.5569 => 0.5285, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -5.09% (0.4515 => 0.4285, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.09% (0.6440 => 0.6112, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.09% (0.2278 => 0.2162, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.08% (0.3483 => 0.3306, std.dev.: 0.0041) SingleSource/Regression/C++/ofstream_ctor: -5.07% (0.3059 => 0.2904, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -5.07% (0.6750 => 0.6408, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: -5.06% (0.3026 => 0.2873, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.03% (0.5805 => 0.5513, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -5.02% (3.5154 => 3.3389, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.99% (0.6395 => 0.6076, std.dev.: 0.0067) MultiSource/Benchmarks/Bullet/bullet: -4.98% (34.0927 => 32.3955, std.dev.: 0.0206) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.96% (0.3491 => 0.3318, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.95% (0.4321 => 0.4107, std.dev.: 0.0053) MultiSource/Applications/treecc/treecc: -4.95% (2.1401 => 2.0342, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.94% (0.4813 => 0.4575, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.94% (0.3931 => 0.3737, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.92% (0.4427 => 0.4209, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.90% (0.7021 => 0.6677, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.89% (0.2106 => 0.2003, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -4.87% (0.7982 => 0.7593, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.86% (1.2210 => 1.1616, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: -4.83% (0.3788 => 0.3605, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.83% (8.0126 => 7.6258, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.82% (0.5688 => 0.5414, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.80% (0.5329 => 0.5073, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.74% (0.3837 => 0.3655, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.74% (0.3252 => 0.3098, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -4.71% (0.3271 => 0.3117, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -4.70% (15.2527 => 14.5363, std.dev.: 0.0178) SingleSource/UnitTests/ObjC++/Hello: -4.65% (0.6347 => 0.6052, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -4.64% (0.8418 => 0.8027, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.57% (1.2221 => 1.1663, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.56% (0.7198 => 0.6870, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -4.55% (0.4524 => 0.4318, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.44% (0.6441 => 0.6155, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -4.41% (0.7779 => 0.7436, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.30% (5.0226 => 4.8065, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.16% (0.9077 => 0.8699, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.16% (0.3319 => 0.3181, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: -3.65% (1.5610 => 1.5040, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.54% (20.7746 => 20.2477, std.dev.: 0.0347) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7554, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1728, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.96% (2.2633 => 2.1737, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.17% (1.0557 => 1.0222, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4693, std.dev.: 0.0035) Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 2 14:20:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 2 Nov 2012 16:20:11 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121102212011.71A602A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5533?compare_to=5531&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5533, Order: 167302, Start Time: 2012-11-02 19:53:29, End Time: 2012-11-02 21:20:14 To: 5531, Order: 167300, Start Time: 2012-11-02 18:09:34, End Time: 2012-11-02 19:36:36 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 9 (54 on baseline) Performance Improvements: 2 (3 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 980 (917 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 5.98% (0.3125 => 0.3312, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.59% (4.5806 => 4.6992, std.dev.: 0.0273) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.90% (4.5575 => 4.6440, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.51% (0.8726 => 0.8858, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.23% (0.8482 => 0.8586, std.dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.04% (6.7590 => 6.8292, std.dev.: 0.0220) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.75% (0.3289 => 0.3478, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.60% (0.7549 => 0.7896, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.56% (22.0247 => 22.3685, std.dev.: 0.1029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.63% (0.8299 => 0.8164, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.15% (60.9425 => 59.6294, std.dev.: 0.2579) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.31% (16.5964 => 16.6482, std.dev.: 0.3042) MultiSource/Applications/obsequi/Obsequi: 1.09% (1.0546 => 1.0661, std.dev.: 0.0149) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.46% (21.9451 => 21.6237, std.dev.: 0.3528) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.33% (0.3655 => 0.3643, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/bigfib: 0.12% (0.6013 => 0.6020, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.66% (0.3341 => 0.3319, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/strcat: -0.25% (0.1994 => 0.1989, std.dev.: 0.0073) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -11.01% (0.0218 => 0.0194, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0426 => 0.0427, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 4.05% (0.0296 => 0.0308, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0314 => 0.0313, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.18% (0.0424 => 0.0419, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -41.38% (0.0203 => 0.0119, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/test1: -37.44% (0.0219 => 0.0137, std.dev.: 0.0038) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0008 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1450 => 0.1451, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.16% (1.1128 => 1.1368, std.dev.: 0.0427) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -3.35% (0.1491 => 0.1441, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.94% (0.4037 => 0.4196, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.42% (0.1316 => 0.1361, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.59% (0.0564 => 0.0635, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -19.77% (0.0258 => 0.0207, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.91% (0.0551 => 0.0556, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.26% (1.1420 => 1.1450, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2000.00% (0.0001 => 0.0021, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.07% (0.0579 => 0.0591, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.98% (0.0264 => 0.0235, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.07% (0.8018 => 0.8012, std.dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -37.50% (0.0080 => 0.0050, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2298.85% (0.6332 => 15.1895, std.dev.: 0.0716) MultiSource/Benchmarks/McCat/08-main/main: 40.74% (0.1831 => 0.2577, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.93% (0.1559 => 0.1451, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1480.68% (0.3344 => 5.2858, std.dev.: 0.1065) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.91% (0.2364 => 0.3213, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0429 => 0.0439, std.dev.: 0.0011) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.91% (0.0224 => 0.0235, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3534, std.dev.: 0.0240) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0693, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4950, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3423, std.dev.: 0.0214) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0250, std.dev.: 0.0288) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4033, std.dev.: 0.0048) SingleSource/Regression/C/uint64_to_float: -24.38% (2.1832 => 1.6510, std.dev.: 0.0118) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.68% (0.0810 => 0.0937, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.10% (0.0773 => 0.0882, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.11% (0.1425 => 0.1569, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.59% (0.2180 => 0.2389, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.17% (0.2279 => 0.2488, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.98% (0.1905 => 0.2076, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.89% (0.8321 => 0.8894, std.dev.: 0.0138) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.61% (0.2240 => 0.2388, std.dev.: 0.0049) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.58% (0.3137 => 0.3312, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.47% (0.2998 => 0.3162, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.40% (0.8148 => 0.8588, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.35% (0.7473 => 0.7873, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.61% (0.6010 => 0.6287, std.dev.: 0.0082) MultiSource/Applications/spiff/spiff: 4.08% (0.7950 => 0.8274, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.92% (0.3295 => 0.3424, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.49% (4.4873 => 4.6440, std.dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.41% (0.4783 => 0.4946, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.41% (0.5961 => 0.6164, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.39% (0.3717 => 0.3843, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.36% (6.6074 => 6.8292, std.dev.: 0.0220) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.26% (0.4847 => 0.5005, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.23% (0.8317 => 0.8586, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.12% (1.1685 => 1.2049, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.04% (0.8597 => 0.8858, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.98% (4.1763 => 4.3006, std.dev.: 0.0245) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.96% (1.1170 => 1.1501, std.dev.: 0.0071) MultiSource/Applications/Burg/burg: 2.91% (1.2222 => 1.2578, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.86% (0.6227 => 0.6405, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.82% (4.5702 => 4.6992, std.dev.: 0.0273) MultiSource/Applications/ClamAV/clamscan: 2.68% (14.7684 => 15.1638, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.67% (0.8007 => 0.8221, std.dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: 2.56% (1.2568 => 1.2890, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.53% (8.6476 => 8.8665, std.dev.: 0.0463) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.50% (0.8316 => 0.8524, std.dev.: 0.0038) MultiSource/Applications/hbd/hbd: 2.41% (1.4269 => 1.4613, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.31% (0.8611 => 0.8810, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.24% (0.8697 => 0.8892, std.dev.: 0.0064) MultiSource/Benchmarks/nbench/nbench: 2.05% (1.1271 => 1.1502, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.90% (0.7966 => 0.8117, std.dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 1.87% (14.2605 => 14.5271, std.dev.: 0.0344) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.79% (0.6943 => 0.7067, std.dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 1.76% (6.7320 => 6.8503, std.dev.: 0.0144) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.64% (0.8340 => 0.8477, std.dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: 1.64% (15.3280 => 15.5787, std.dev.: 0.0443) MultiSource/Applications/oggenc/oggenc: 1.45% (4.9628 => 5.0349, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.41% (1.5795 => 2.5021, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.17% (0.3186 => 0.3478, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.84% (1.1857 => 1.2786, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 6.02% (63.1822 => 66.9886, std.dev.: 0.1368) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.94% (0.7597 => 0.7896, std.dev.: 0.0097) MultiSource/Applications/siod/siod: 2.80% (3.6643 => 3.7668, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: 2.14% (8.5322 => 8.7152, std.dev.: 0.0543) SingleSource/Benchmarks/Shootout-C++/hash: 1.84% (0.6205 => 0.6319, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.19% (4.8362 => 4.8938, std.dev.: 0.0193) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -5.33% (29.8330 => 28.2442, std.dev.: 0.2086) SingleSource/Benchmarks/Shootout-C++/hash2: -1.49% (3.4237 => 3.3728, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.30% (3.3479 => 3.3044, std.dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.23% (16.4461 => 16.6482, std.dev.: 0.3042) MultiSource/Applications/obsequi/Obsequi: 3.89% (1.0262 => 1.0661, std.dev.: 0.0149) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6824.02% (0.3123 => 21.6237, std.dev.: 0.3528) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.91% (0.2463 => 0.3643, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/bigfib: 0.17% (0.6010 => 0.6020, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.62% (0.3266 => 0.3319, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/strcat: 1.02% (0.1969 => 0.1989, std.dev.: 0.0073) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 57.72% (0.0123 => 0.0194, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 21.26% (0.0254 => 0.0308, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.11% (0.0384 => 0.0419, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -37.37% (0.0190 => 0.0119, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/test1: -23.89% (0.0180 => 0.0137, std.dev.: 0.0038) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.90% (0.1438 => 0.1451, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.34% (1.1329 => 1.1368, std.dev.: 0.0427) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -1.44% (0.1462 => 0.1441, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.77% (0.4164 => 0.4196, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.58% (0.1369 => 0.1361, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.94% (0.0641 => 0.0635, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.15% (0.0195 => 0.0207, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.81% (0.0578 => 0.0556, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.11% (1.1437 => 1.1450, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2000.00% (0.0001 => 0.0021, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.74% (0.0627 => 0.0591, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 30.56% (0.0180 => 0.0235, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.06% (0.8017 => 0.8012, std.dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -19.35% (0.0062 => 0.0050, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 3.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 2 14:28:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 2 Nov 2012 16:28:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121102212850.5590E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5534?compare_to=5532&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5534, Order: 167302, Start Time: 2012-11-02 20:03:54, End Time: 2012-11-02 21:28:53 To: 5532, Order: 167300, Start Time: 2012-11-02 18:15:53, End Time: 2012-11-02 19:40:52 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (4 on baseline) Performance Improvements: 0 (179 on baseline) Unchanged Tests: 1040 (859 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.87% (1.2735 => 1.2973, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.47% (79.2117 => 80.3798, std.dev.: 0.1643) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1008, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/salsa20: 2.58% (7.4937 => 7.6870, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: 2.21% (3.1932 => 3.2637, std.dev.: 0.0102) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.97% (0.1431 => 0.1317, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.33% (0.3821 => 0.3541, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -6.82% (2.4924 => 2.3225, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.38% (0.2428 => 0.2273, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.32% (0.3357 => 0.3145, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.31% (3.5339 => 3.3109, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.27% (0.3142 => 0.2945, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.12% (22.4056 => 21.0333, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.07% (0.3658 => 0.3436, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -6.05% (4.3330 => 4.0708, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.05% (0.9542 => 0.8965, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.03% (0.6484 => 0.6093, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.02% (1.0544 => 0.9909, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -5.95% (1.2515 => 1.1770, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: -5.90% (16.1920 => 15.2374, std.dev.: 0.0090) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.89% (0.1716 => 0.1615, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -5.88% (0.2160 => 0.2033, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: -5.87% (7.0961 => 6.6794, std.dev.: 0.0173) SingleSource/Benchmarks/Misc/ReedSolomon: -5.80% (0.1879 => 0.1770, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: -5.80% (0.9179 => 0.8647, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.77% (0.7919 => 0.7462, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.73% (1.3722 => 1.2936, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.72% (0.9852 => 0.9288, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.72% (1.2784 => 1.2053, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.71% (1.6474 => 1.5533, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.71% (0.4151 => 0.3914, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -5.70% (9.2283 => 8.7026, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.68% (0.1796 => 0.1694, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -5.68% (0.1761 => 0.1661, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -5.68% (1.1450 => 1.0800, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -5.66% (0.2985 => 0.2816, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: -5.64% (0.2659 => 0.2509, std.dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: -5.64% (1.1530 => 1.0880, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.63% (1.6364 => 1.5443, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.63% (0.6293 => 0.5939, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.62% (1.4642 => 1.3819, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.61% (0.2548 => 0.2405, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: -5.59% (1.3148 => 1.2413, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.57% (0.5857 => 0.5531, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.57% (0.2695 => 0.2545, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.56% (1.2300 => 1.1616, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.56% (4.5069 => 4.2565, std.dev.: 0.0044) MultiSource/Applications/siod/siod: -5.55% (2.4021 => 2.2687, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.55% (0.7339 => 0.6932, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.54% (4.8161 => 4.5492, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.51% (0.5591 => 0.5283, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.50% (0.8521 => 0.8052, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.49% (0.6681 => 0.6314, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: -5.49% (0.3880 => 0.3667, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/trivial-interface: -5.48% (0.3812 => 0.3603, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -5.48% (0.3831 => 0.3621, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.48% (0.6736 => 0.6367, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.48% (0.5478 => 0.5178, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.47% (4.8802 => 4.6133, std.dev.: 0.0101) SingleSource/UnitTests/ObjC/synchronized: -5.47% (0.3896 => 0.3683, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -5.45% (4.0594 => 3.8381, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.45% (0.5999 => 0.5672, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.45% (0.3891 => 0.3679, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.44% (0.6052 => 0.5723, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.44% (0.4176 => 0.3949, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.43% (0.4033 => 0.3814, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.43% (0.3849 => 0.3640, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.43% (0.6446 => 0.6096, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -5.42% (0.3025 => 0.2861, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.42% (14.2083 => 13.4385, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/hash2: -5.41% (0.4861 => 0.4598, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.41% (5.4682 => 5.1724, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.41% (4.0323 => 3.8143, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.39% (0.6194 => 0.5860, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: -5.39% (0.3581 => 0.3388, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.39% (0.3323 => 0.3144, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.38% (0.6667 => 0.6308, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.38% (0.5925 => 0.5606, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.38% (0.5575 => 0.5275, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.38% (0.3884 => 0.3675, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -5.38% (0.3848 => 0.3641, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -5.37% (0.7447 => 0.7047, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.37% (0.6297 => 0.5959, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.36% (0.5802 => 0.5491, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.35% (0.6304 => 0.5967, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.33% (2.1713 => 2.0556, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -5.32% (17.1032 => 16.1926, std.dev.: 0.0169) MultiSource/Applications/SPASS/SPASS: -5.31% (15.5079 => 14.6843, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.30% (0.6260 => 0.5928, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.30% (0.5849 => 0.5539, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: -5.29% (0.2871 => 0.2719, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.29% (0.6395 => 0.6057, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: -5.28% (0.3446 => 0.3264, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -5.28% (0.4280 => 0.4054, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.28% (2.2587 => 2.1395, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.28% (6.7716 => 6.4143, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/random: -5.27% (0.2939 => 0.2784, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.27% (0.3057 => 0.2896, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.26% (0.5168 => 0.4896, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.24% (0.5705 => 0.5406, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -5.24% (0.4199 => 0.3979, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.24% (0.7524 => 0.7130, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.24% (0.2903 => 0.2751, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -5.23% (0.2849 => 0.2700, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -5.23% (0.3481 => 0.3299, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.23% (0.3483 => 0.3301, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.22% (0.5859 => 0.5553, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.22% (0.2933 => 0.2780, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.20% (0.2999 => 0.2843, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.20% (0.5941 => 0.5632, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: -5.20% (0.3867 => 0.3666, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -5.20% (0.3194 => 0.3028, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -5.20% (18.2933 => 17.3427, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/lists: -5.19% (0.3621 => 0.3433, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.18% (0.6676 => 0.6330, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.17% (0.5456 => 0.5174, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.17% (0.5863 => 0.5560, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.16% (0.5581 => 0.5293, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.16% (0.9557 => 0.9064, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -5.16% (0.4248 => 0.4029, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -5.16% (0.3026 => 0.2870, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.15% (0.6033 => 0.5722, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.13% (0.5570 => 0.5284, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.13% (0.3255 => 0.3088, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.13% (0.3491 => 0.3312, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.13% (0.4916 => 0.4664, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.11% (0.6440 => 0.6111, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -5.11% (1.3864 => 1.3156, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.11% (0.6189 => 0.5873, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: -5.10% (0.3059 => 0.2903, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.10% (0.5569 => 0.5285, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.10% (0.5805 => 0.5509, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.09% (0.4515 => 0.4285, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.09% (0.2278 => 0.2162, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -5.09% (0.2989 => 0.2837, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -5.07% (2.1401 => 2.0317, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wc: -5.05% (0.3205 => 0.3043, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.05% (0.6395 => 0.6072, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.05% (0.5567 => 0.5286, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -5.04% (0.3394 => 0.3223, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -5.04% (3.5154 => 3.3383, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.03% (0.6660 => 0.6325, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: -5.02% (0.7982 => 0.7581, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.02% (0.4083 => 0.3878, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/bigfib: -5.01% (0.6750 => 0.6412, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.00% (0.4321 => 0.4105, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.99% (0.4427 => 0.4206, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -4.99% (34.0927 => 32.3915, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.94% (0.3016 => 0.2867, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.91% (0.3319 => 0.3156, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.88% (0.3931 => 0.3739, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.87% (0.7021 => 0.6679, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.85% (0.5688 => 0.5412, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.84% (8.0126 => 7.6245, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.84% (0.2106 => 0.2004, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.84% (0.4813 => 0.4580, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.82% (0.5329 => 0.5072, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: -4.80% (0.3788 => 0.3606, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.80% (1.2221 => 1.1635, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.79% (1.2210 => 1.1625, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -4.74% (15.2527 => 14.5300, std.dev.: 0.0214) SingleSource/UnitTests/ObjC++/property-reference: -4.69% (0.7779 => 0.7414, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: -4.68% (0.8418 => 0.8024, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: -4.68% (0.3271 => 0.3118, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.67% (0.3252 => 0.3100, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.67% (0.3837 => 0.3658, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -4.66% (0.6347 => 0.6051, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -4.62% (0.4524 => 0.4315, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.54% (0.2355 => 0.2248, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.50% (0.7198 => 0.6874, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: -4.42% (0.6441 => 0.6156, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -4.28% (5.0226 => 4.8075, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.11% (0.9077 => 0.8704, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: -3.72% (1.5610 => 1.5029, std.dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -2.69% (20.7746 => 20.2156, std.dev.: 0.0216) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7525, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: -8.72% (1.2842 => 1.1722, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.87% (2.2633 => 2.1758, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.66% (6.5735 => 6.4644, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 2 14:56:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 2 Nov 2012 16:56:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121102215636.7E0442A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5535?compare_to=5530&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5535, Order: 167300, Start Time: 2012-11-02 18:41:00, End Time: 2012-11-02 21:56:41 To: 5530, Order: 167295, Start Time: 2012-11-02 13:40:40, End Time: 2012-11-02 16:56:12 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (170 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (720 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 1.80% (0.6098 => 0.6208, std.dev.: 0.0017) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.96% (0.0625 => 0.0881, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.89% (0.1063 => 0.1402, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.46% (0.2969 => 0.3725, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.95% (0.1106 => 0.1382, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 24.38% (1.5932 => 1.9817, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.37% (0.0714 => 0.0888, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.31% (0.4253 => 0.5287, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.21% (0.4139 => 0.5141, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.25% (0.5900 => 0.7272, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.96% (0.5000 => 0.6148, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.91% (0.4994 => 0.6138, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.67% (0.0547 => 0.0671, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.43% (0.0584 => 0.0715, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.79% (0.1620 => 0.1973, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.55% (0.1021 => 0.1241, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 21.20% (0.0599 => 0.0726, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.05% (0.1107 => 0.1340, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 20.85% (0.0897 => 0.1084, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.38% (0.0633 => 0.0762, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 20.36% (0.0948 => 0.1141, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.03% (0.0584 => 0.0701, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.96% (0.0541 => 0.0649, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.94% (0.0642 => 0.0770, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.88% (0.3903 => 0.4679, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.85% (0.1103 => 0.1322, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: 19.73% (0.0821 => 0.0983, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 19.64% (0.1619 => 0.1937, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.56% (0.1549 => 0.1852, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.46% (0.0822 => 0.0982, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.44% (0.1003 => 0.1198, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.33% (0.1604 => 0.1914, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 18.61% (0.5826 => 0.6910, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 18.49% (0.5889 => 0.6978, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 18.37% (0.0947 => 0.1121, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.19% (0.1462 => 0.1728, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 18.07% (0.0808 => 0.0954, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.02% (0.3890 => 0.4591, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 17.98% (0.1218 => 0.1437, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 17.97% (0.4029 => 0.4753, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.87% (0.2014 => 0.2374, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/09-vor/vor: 17.41% (0.1505 => 0.1767, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.40% (1.3152 => 1.5440, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.37% (0.1088 => 0.1277, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.32% (0.2736 => 0.3210, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/mst/mst: 17.05% (0.0698 => 0.0817, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.92% (0.2866 => 0.3351, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 16.73% (0.7171 => 0.8371, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.71% (3.5627 => 4.1581, std.dev.: 0.0040) MultiSource/Applications/Burg/burg: 16.62% (0.5546 => 0.6468, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 16.52% (1.8794 => 2.1899, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.48% (0.3271 => 0.3810, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.40% (1.6211 => 1.8869, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.38% (0.2875 => 0.3346, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.32% (0.5026 => 0.5846, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.29% (0.4658 => 0.5417, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.21% (0.1968 => 0.2287, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.21% (0.1160 => 0.1348, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 15.93% (0.2725 => 0.3159, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 15.90% (0.1421 => 0.1647, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 15.87% (0.9697 => 1.1236, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 15.78% (0.3004 => 0.3478, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: 15.76% (1.0781 => 1.2480, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 15.66% (0.2714 => 0.3139, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.56% (0.2738 => 0.3164, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.54% (0.2792 => 0.3226, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.46% (0.2729 => 0.3151, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 15.43% (0.2780 => 0.3209, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.43% (0.3195 => 0.3688, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 15.35% (0.2750 => 0.3172, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.34% (0.4361 => 0.5030, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 15.29% (0.2813 => 0.3243, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 15.27% (0.2803 => 0.3231, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 15.27% (0.2823 => 0.3254, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 15.26% (0.1284 => 0.1480, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.26% (4.4195 => 5.0938, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/except: 15.23% (0.2811 => 0.3239, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 15.22% (0.9909 => 1.1417, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/wc: 15.21% (0.3096 => 0.3567, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 15.18% (4.2109 => 4.8500, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.14% (0.3930 => 0.4525, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.06% (2.0673 => 2.3787, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.04% (2.7292 => 3.1396, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.98% (0.2911 => 0.3347, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.79% (1.9694 => 2.2607, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.77% (0.1090 => 0.1251, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 14.62% (23.5202 => 26.9600, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.62% (1.9966 => 2.2886, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.59% (0.3488 => 0.3997, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: 14.57% (0.3267 => 0.3743, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 14.52% (0.3258 => 0.3731, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 14.51% (0.3446 => 0.3946, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.43% (0.3362 => 0.3847, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 14.40% (0.3465 => 0.3964, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 14.33% (0.3496 => 0.3997, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 14.32% (0.3317 => 0.3792, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.27% (0.3469 => 0.3964, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 14.22% (0.3460 => 0.3952, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.18% (0.3060 => 0.3494, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.15% (0.3124 => 0.3566, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/trivial-interface: 14.12% (0.3442 => 0.3928, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 14.07% (0.2566 => 0.2927, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 13.98% (0.3348 => 0.3816, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 13.94% (0.3643 => 0.4151, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash: 13.94% (0.4146 => 0.4724, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.92% (0.3650 => 0.4158, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 13.88% (0.2075 => 0.2363, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 13.84% (0.3678 => 0.4187, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 13.82% (0.3726 => 0.4241, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.76% (0.3845 => 0.4374, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 13.67% (0.3724 => 0.4233, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 13.67% (0.4251 => 0.4832, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 13.67% (1.4269 => 1.6219, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.59% (0.3282 => 0.3728, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 13.57% (0.3477 => 0.3949, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.46% (0.3625 => 0.4113, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.39% (0.3981 => 0.4514, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.36% (0.3690 => 0.4183, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 13.18% (0.7875 => 0.8913, std.dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 12.97% (2.1653 => 2.4462, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 12.70% (4.6177 => 5.2043, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/bigfib: 12.63% (0.5012 => 0.5645, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 12.45% (2.1013 => 2.3629, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.67% (0.2040 => 0.2278, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 11.52% (0.2691 => 0.3001, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 11.47% (5.5417 => 6.1772, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.33% (0.6435 => 0.7164, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.70% (0.1028 => 0.1138, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 10.69% (0.3498 => 0.3872, std.dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: 10.48% (0.4847 => 0.5355, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.45% (0.2737 => 0.3023, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.25% (0.2068 => 0.2280, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.20% (0.1383 => 0.1524, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.86% (0.3084 => 0.3388, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 9.83% (0.3336 => 0.3664, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 9.77% (0.6634 => 0.7282, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.22% (0.2103 => 0.2297, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 8.92% (2.0346 => 2.2160, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 8.78% (0.2391 => 0.2601, std.dev.: 0.0058) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.43% (11.6398 => 12.6209, std.dev.: 0.0266) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.28% (4.6926 => 5.0810, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.82% (0.5361 => 0.5780, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.22% (0.7426 => 0.7962, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.20% (0.5584 => 0.5986, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 6.44% (11.9555 => 12.7255, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.88% (0.3792 => 0.3977, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.37% (0.2162 => 0.3532, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6532, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.14% (0.2802 => 0.3058, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 6.64% (0.2122 => 0.2263, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6100, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.01% (12.0509 => 12.6549, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1645, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-2: 4.04% (1.8057 => 1.8786, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.82% (0.3693 => 0.3834, std.dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: 2.55% (14.0481 => 14.4067, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1920, std.dev.: 0.0078) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.76% (3.1722 => 3.2281, std.dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3041, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2862, std.dev.: 0.0019) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5849, std.dev.: 0.0121) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.63% (25.4195 => 16.3634, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/ary2: -10.87% (0.2402 => 0.2141, std.dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9760, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7765, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.24% (11.2080 => 10.8446, std.dev.: 0.0561) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7724, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -2.87% (3.6262 => 3.5223, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.35% (17.2379 => 16.8323, std.dev.: 0.0169) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8698, std.dev.: 0.0149) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.81% (10.7630 => 10.5687, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4952, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.50% (21.9346 => 21.6063, std.dev.: 0.0760) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7160, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.22% (105.3826 => 104.0955, std.dev.: 0.1216) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0407, std.dev.: 0.0067) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.07% (3.3991 => 3.3627, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 2 16:07:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 2 Nov 2012 18:07:59 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121102230759.422F32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5536?compare_to=5533&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5536, Order: 167313, Start Time: 2012-11-02 21:39:44, End Time: 2012-11-02 23:08:04 To: 5533, Order: 167302, Start Time: 2012-11-02 19:53:29, End Time: 2012-11-02 21:20:14 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 10 (53 on baseline) Performance Improvements: 3 (4 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 978 (917 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 6.30% (0.1858 => 0.1975, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.91% (1.1847 => 1.2192, std.dev.: 0.0064) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.07% (6.8292 => 6.9020, std.dev.: 0.0156) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: 5.30% (5.1912 => 5.4662, std.dev.: 0.0676) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.51% (1.2295 => 1.2604, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.26% (59.6294 => 60.9770, std.dev.: 0.2608) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.87% (1.5993 => 1.6292, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.45% (2.5852 => 2.6226, std.dev.: 0.0139) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.38% (1.0440 => 1.0584, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/fibo: 1.00% (4.3093 => 4.3526, std.dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: -5.78% (0.2076 => 0.1956, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.50% (0.8858 => 0.8725, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/matrix: -1.06% (1.5819 => 1.5652, std.dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.30% (16.6482 => 16.8643, std.dev.: 0.2907) MultiSource/Applications/obsequi/Obsequi: -1.03% (1.0661 => 1.0551, std.dev.: 0.0310) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.41% (21.6237 => 21.5352, std.dev.: 0.4263) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.74% (0.3643 => 0.3670, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/bigfib: 0.25% (0.6020 => 0.6035, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.18% (0.3319 => 0.3358, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/strcat: 1.81% (0.1989 => 0.2025, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 12.89% (0.0194 => 0.0219, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.94% (0.0427 => 0.0431, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 8.12% (0.0308 => 0.0333, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.60% (0.0313 => 0.0318, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.95% (0.0419 => 0.0423, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: 72.27% (0.0119 => 0.0205, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 59.85% (0.0137 => 0.0219, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 75.00% (0.0008 => 0.0014) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1451 => 0.1453, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 2.23% (1.1368 => 1.1621, std.dev.: 0.0729) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -0.28% (0.1441 => 0.1437, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.48% (0.4196 => 0.4176, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.88% (0.1361 => 0.1373, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.47% (0.0635 => 0.0638, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 33.82% (0.0207 => 0.0277, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.42% (0.0556 => 0.0537, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.52% (1.1450 => 1.1510, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -14.29% (0.0021 => 0.0018, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.94% (0.0591 => 0.0632, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 11.06% (0.0235 => 0.0261, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.19% (0.8012 => 0.8027, std.dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -10.00% (0.0050 => 0.0045, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2326.53% (0.6332 => 15.3648, std.dev.: 0.1812) MultiSource/Benchmarks/McCat/08-main/main: 48.66% (0.1831 => 0.2722, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.03% (0.1559 => 0.1465, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1486.48% (0.3344 => 5.3052, std.dev.: 0.1356) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.17% (0.2364 => 0.3219, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/mandel: 3.96% (0.0429 => 0.0446, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.57% (0.0224 => 0.0232, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0009) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3658, std.dev.: 0.0271) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0702, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4966, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3349, std.dev.: 0.0524) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0332, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4099, std.dev.: 0.0028) SingleSource/Regression/C/uint64_to_float: -23.84% (2.1832 => 1.6627, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.19% (0.0810 => 0.0933, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 11.60% (0.1112 => 0.1241, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.57% (0.3137 => 0.3500, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.39% (0.2279 => 0.2493, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.53% (0.2180 => 0.2366, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.02% (0.8321 => 0.8988, std.dev.: 0.0115) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.26% (0.1983 => 0.2127, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.19% (0.2378 => 0.2549, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.36% (0.8148 => 0.8666, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.04% (0.2998 => 0.3179, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.65% (0.7473 => 0.7895, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.05% (1.1606 => 1.2192, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.88% (4.4873 => 4.7061, std.dev.: 0.0295) MultiSource/Applications/hbd/hbd: 4.52% (1.4269 => 1.4914, std.dev.: 0.0166) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.46% (6.6074 => 6.9020, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.42% (4.1763 => 4.3607, std.dev.: 0.0258) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.03% (1.1685 => 1.2156, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.72% (0.3657 => 0.3793, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.71% (0.6227 => 0.6458, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.69% (0.5961 => 0.6181, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash: 3.58% (0.3800 => 0.3936, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.35% (1.6386 => 1.6935, std.dev.: 0.0137) MultiSource/Benchmarks/MallocBench/gs/gs: 3.09% (4.1305 => 4.2582, std.dev.: 0.0458) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.91% (4.4880 => 4.6184, std.dev.: 0.0492) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.77% (0.3717 => 0.3820, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.75% (1.4479 => 1.4877, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.73% (13.1811 => 13.5413, std.dev.: 0.0862) MultiSource/Applications/SIBsim4/SIBsim4: 2.71% (1.2568 => 1.2909, std.dev.: 0.0100) MultiSource/Applications/lambda-0_1_3/lambda: 2.59% (0.7557 => 0.7753, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 2.35% (4.9628 => 5.0796, std.dev.: 0.0320) MultiSource/Applications/treecc/treecc: 2.31% (1.9948 => 2.0408, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.22% (0.8317 => 0.8502, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.13% (0.7966 => 0.8136, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.09% (0.9074 => 0.9264, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.91% (1.2423 => 1.2660, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.87% (0.8177 => 0.8330, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.78% (0.8855 => 0.9013, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.76% (0.6943 => 0.7065, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.73% (0.8420 => 0.8566, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.49% (0.8597 => 0.8725, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.05% (1.1857 => 1.2811, std.dev.: 0.0141) MultiSource/Benchmarks/mafft/pairlocalalign: 5.97% (63.1822 => 66.9524, std.dev.: 0.0627) SingleSource/Benchmarks/Misc/ReedSolomon: 3.10% (8.5322 => 8.7963, std.dev.: 0.0266) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.89% (59.2638 => 60.9770, std.dev.: 0.2608) MultiSource/Applications/siod/siod: 2.77% (3.6643 => 3.7658, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.20% (1.5941 => 1.6292, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: 2.18% (2.3560 => 2.4074, std.dev.: 0.0188) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.16% (1.2337 => 1.2604, std.dev.: 0.0090) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (2.5763 => 2.6226, std.dev.: 0.0139) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.61% (4.8362 => 4.9141, std.dev.: 0.0058) MultiSource/Benchmarks/llubenchmark/llu: 1.21% (1.9967 => 2.0208, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/whetstone: 1.11% (2.1224 => 2.1460, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/fibo: 1.11% (4.3049 => 4.3526, std.dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -4.41% (29.8330 => 28.5175, std.dev.: 0.1986) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.76% (1.0388 => 1.0205, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash2: -1.37% (3.4237 => 3.3769, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.16% (3.3479 => 3.3090, std.dev.: 0.0143) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.54% (16.4461 => 16.8643, std.dev.: 0.2907) MultiSource/Applications/obsequi/Obsequi: 2.82% (1.0262 => 1.0551, std.dev.: 0.0310) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6795.68% (0.3123 => 21.5352, std.dev.: 0.4263) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.01% (0.2463 => 0.3670, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/bigfib: 0.42% (0.6010 => 0.6035, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.82% (0.3266 => 0.3358, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/strcat: 2.84% (0.1969 => 0.2025, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.64% (0.0408 => 0.0431, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.30% (0.0302 => 0.0318, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 100.00% (0.0007 => 0.0014) MultiSource/Applications/ClamAV/clamscan: 1.04% (0.1438 => 0.1453, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 2.58% (1.1329 => 1.1621, std.dev.: 0.0729) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -1.71% (0.1462 => 0.1437, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.29% (0.4164 => 0.4176, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.29% (0.1369 => 0.1373, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.47% (0.0641 => 0.0638, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.09% (0.0578 => 0.0537, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.64% (1.1437 => 1.1510, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1700.00% (0.0001 => 0.0018, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.80% (0.0627 => 0.0632, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 45.00% (0.0180 => 0.0261, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.12% (0.8017 => 0.8027, std.dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -27.42% (0.0062 => 0.0045, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 2 16:16:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 2 Nov 2012 18:16:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121102231656.DC7012A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5537?compare_to=5534&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5537, Order: 167313, Start Time: 2012-11-02 21:52:00, End Time: 2012-11-02 23:16:59 To: 5534, Order: 167302, Start Time: 2012-11-02 20:03:54, End Time: 2012-11-02 21:28:53 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 1 (181 on baseline) Unchanged Tests: 1041 (857 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.56% (80.3798 => 78.3195, std.dev.: 0.6545) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.69% (2.0478 => 2.1028, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/salsa20: 2.61% (7.4937 => 7.6896, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/hash2: 1.81% (3.1932 => 3.2510, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.18% (0.1431 => 0.1314, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.41% (0.3821 => 0.3538, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -7.12% (2.4924 => 2.3149, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -6.67% (0.3357 => 0.3133, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.63% (0.2428 => 0.2267, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.49% (3.5339 => 3.3044, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.40% (0.3142 => 0.2941, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.34% (0.6484 => 0.6073, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.31% (0.3658 => 0.3427, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: -6.29% (4.3330 => 4.0605, std.dev.: 0.0082) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.28% (22.4056 => 20.9989, std.dev.: 0.0165) MultiSource/Applications/Burg/burg: -6.24% (1.2515 => 1.1734, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.18% (1.0544 => 0.9892, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.12% (0.9542 => 0.8958, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.12% (0.1716 => 0.1611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -6.07% (0.1879 => 0.1765, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.02% (0.1761 => 0.1655, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -6.01% (16.1920 => 15.2181, std.dev.: 0.0070) MultiSource/Applications/JM/ldecod/ldecod: -6.01% (7.0961 => 6.6695, std.dev.: 0.0142) SingleSource/UnitTests/ObjC/exceptions-4: -5.98% (0.3880 => 0.3648, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -5.96% (0.9179 => 0.8632, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.96% (0.9852 => 0.9265, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -5.95% (0.3831 => 0.3603, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -5.93% (9.2283 => 8.6808, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: -5.93% (0.2985 => 0.2808, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: -5.93% (0.4033 => 0.3794, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.93% (0.3848 => 0.3620, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.92% (1.3722 => 1.2910, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -5.91% (0.4176 => 0.3929, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -5.90% (0.2659 => 0.2502, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.90% (0.3896 => 0.3666, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.90% (0.3812 => 0.3587, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.90% (0.1796 => 0.1690, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.89% (0.3891 => 0.3662, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.88% (1.6474 => 1.5505, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.87% (0.3884 => 0.3656, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.87% (1.4642 => 1.3783, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.86% (0.6293 => 0.5924, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.86% (4.5069 => 4.2427, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.85% (1.2784 => 1.2036, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.82% (0.2355 => 0.2218, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -5.81% (2.4021 => 2.2625, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: -5.81% (0.4199 => 0.3955, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.79% (1.2300 => 1.1588, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.79% (1.6364 => 1.5417, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: -5.78% (1.1450 => 1.0788, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.78% (0.6681 => 0.6295, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.77% (0.6736 => 0.6347, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.77% (0.2548 => 0.2401, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.74% (0.5857 => 0.5521, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.71% (4.8161 => 4.5409, std.dev.: 0.0122) MultiSource/Applications/lua/lua: -5.69% (4.0594 => 3.8283, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.69% (5.4682 => 5.1570, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.68% (0.6052 => 0.5708, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.67% (4.0323 => 3.8038, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.66% (0.6304 => 0.5947, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.66% (6.7716 => 6.3883, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.65% (0.6297 => 0.5941, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.65% (0.6230 => 0.5878, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.62% (0.6446 => 0.6084, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -5.61% (0.4280 => 0.4040, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.60% (0.5478 => 0.5171, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.60% (0.2695 => 0.2544, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.60% (0.5802 => 0.5477, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.60% (0.5591 => 0.5278, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.60% (0.8521 => 0.8044, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.59% (4.8802 => 4.6072, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.59% (0.5849 => 0.5522, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.59% (0.4151 => 0.3919, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.59% (0.7339 => 0.6929, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -5.58% (15.5079 => 14.6422, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.58% (0.7919 => 0.7477, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.57% (0.6194 => 0.5849, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.57% (0.5925 => 0.5595, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.56% (0.6667 => 0.6296, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -5.55% (0.3406 => 0.3217, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.54% (14.2083 => 13.4205, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.54% (0.3483 => 0.3290, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.54% (0.2999 => 0.2833, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.53% (0.4916 => 0.4644, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -5.53% (0.3581 => 0.3383, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.52% (0.5705 => 0.5390, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.49% (0.6395 => 0.6044, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.47% (0.5575 => 0.5270, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.46% (0.5863 => 0.5543, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.45% (0.6260 => 0.5919, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.43% (0.5859 => 0.5541, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -5.43% (17.1032 => 16.1752, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.39% (0.5581 => 0.5280, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.39% (0.6676 => 0.6316, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.37% (2.2587 => 2.1374, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.37% (0.5569 => 0.5270, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.36% (0.6440 => 0.6095, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.36% (0.7524 => 0.7121, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.35% (0.6660 => 0.6304, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -5.34% (0.7447 => 0.7049, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -5.34% (1.3148 => 1.2446, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: -5.34% (1.3864 => 1.3124, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.34% (0.5941 => 0.5624, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.33% (0.6189 => 0.5859, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -5.33% (34.0927 => 32.2756, std.dev.: 0.0120) MultiSource/Benchmarks/nbench/nbench: -5.33% (1.1530 => 1.0916, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.32% (0.5805 => 0.5496, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.32% (0.5567 => 0.5271, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.30% (0.5456 => 0.5167, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.27% (0.4515 => 0.4277, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.27% (0.2278 => 0.2158, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.27% (0.5999 => 0.5683, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.24% (0.6395 => 0.6060, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.21% (0.3319 => 0.3146, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.20% (0.6033 => 0.5719, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.20% (0.3849 => 0.3649, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -5.19% (0.7982 => 0.7568, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.19% (0.5168 => 0.4900, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/hash2: -5.18% (0.4861 => 0.4609, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.18% (0.2106 => 0.1997, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -5.17% (3.5154 => 3.3337, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.16% (0.3837 => 0.3639, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.14% (0.4321 => 0.4099, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.13% (0.9557 => 0.9067, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.12% (0.4083 => 0.3874, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.12% (0.5570 => 0.5285, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.12% (0.2385 => 0.2263, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: -5.11% (18.2933 => 17.3582, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.09% (0.3323 => 0.3154, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -5.08% (0.3446 => 0.3271, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.06% (8.0126 => 7.6074, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.04% (0.3491 => 0.3315, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: -5.04% (2.1401 => 2.0323, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.03% (0.5329 => 0.5061, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.03% (0.5688 => 0.5402, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.02% (0.3025 => 0.2873, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -5.02% (0.2989 => 0.2839, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: -5.02% (0.3867 => 0.3673, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.01% (1.2210 => 1.1598, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary: -5.01% (0.3394 => 0.3224, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -5.01% (0.6750 => 0.6412, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.00% (0.3057 => 0.2904, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.00% (2.1713 => 2.0628, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.96% (0.3931 => 0.3736, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -4.95% (15.2527 => 14.4981, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/objinst: -4.95% (0.3194 => 0.3036, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.95% (0.2871 => 0.2729, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.94% (0.7021 => 0.6674, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -4.94% (0.3481 => 0.3309, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.93% (0.2903 => 0.2760, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -4.89% (0.3271 => 0.3111, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -4.88% (0.2849 => 0.2710, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.88% (0.2933 => 0.2790, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -4.87% (0.2939 => 0.2796, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.86% (0.4813 => 0.4579, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: -4.85% (0.8418 => 0.8010, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.84% (1.2221 => 1.1630, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/wc: -4.80% (0.3205 => 0.3051, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -4.77% (0.7779 => 0.7408, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: -4.75% (0.3621 => 0.3449, std.dev.: 0.0031) SingleSource/Regression/C++/ofstream_ctor: -4.74% (0.3059 => 0.2914, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -4.73% (0.3255 => 0.3101, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -4.66% (0.3026 => 0.2885, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.65% (0.4427 => 0.4221, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.61% (0.3252 => 0.3102, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.61% (0.3016 => 0.2877, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -4.52% (5.0226 => 4.7954, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/Hello: -4.52% (0.6347 => 0.6060, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.48% (0.9077 => 0.8670, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.46% (0.7198 => 0.6877, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: -4.44% (0.3788 => 0.3620, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -4.24% (0.6441 => 0.6168, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -4.22% (0.4524 => 0.4333, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: -3.77% (1.5610 => 1.5022, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -2.78% (20.7746 => 20.1974, std.dev.: 0.0352) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7551, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: -8.74% (1.2842 => 1.1719, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.84% (1.7753 => 1.7072, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.83% (2.2633 => 2.1766, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.95% (1.3096 => 1.2710, std.dev.: 0.0113) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4702, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 2 17:52:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 2 Nov 2012 19:52:46 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121103005246.BE6D92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5538?compare_to=5536&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5538, Order: 167331, Start Time: 2012-11-02 23:24:54, End Time: 2012-11-03 00:52:51 To: 5536, Order: 167313, Start Time: 2012-11-02 21:39:44, End Time: 2012-11-02 23:08:04 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 16 (57 on baseline) Performance Improvements: 3 (5 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 972 (912 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.85% (0.6184 => 0.6546, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/09-vor/vor: 3.83% (0.3161 => 0.3282, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.88% (0.7895 => 0.8122, std.dev.: 0.0078) MultiSource/Applications/spiff/spiff: 2.55% (0.8145 => 0.8353, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.01% (0.9001 => 0.9182, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.94% (0.8837 => 0.9008, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 28.95% (1.9228 => 2.4794, std.dev.: 0.0150) MultiSource/Applications/SPASS/SPASS: 4.98% (8.1161 => 8.5199, std.dev.: 0.0287) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.01% (2.2414 => 2.3313, std.dev.: 0.0282) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.71% (1.1201 => 1.1505, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.85% (4.3598 => 4.4404, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.34% (4.4215 => 4.4807, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: 1.24% (7.1593 => 7.2478, std.dev.: 0.0137) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (5.5520 => 5.6158, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.07% (1.2357 => 1.2489, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.01% (1.5827 => 1.5987, std.dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.35% (0.2549 => 0.2438, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.76% (4.7061 => 4.6232, std.dev.: 0.0251) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.12% (1.6292 => 1.6109, std.dev.: 0.0065) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -1.09% (16.8643 => 16.6805, std.dev.: 0.2705) MultiSource/Applications/obsequi/Obsequi: -0.34% (1.0551 => 1.0515, std.dev.: 0.0198) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.72% (21.5352 => 21.6912, std.dev.: 0.3808) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.58% (0.3670 => 0.3612, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/bigfib: 0.27% (0.6035 => 0.6051, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/reversefile: -1.37% (0.3358 => 0.3312, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/strcat: -1.23% (0.2025 => 0.2000, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.37% (0.0219 => 0.0216, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.78% (0.0431 => 0.0419, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.40% (0.0333 => 0.0325, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.52% (0.0318 => 0.0310, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.18% (0.0423 => 0.0418, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/casts: -1.95% (0.0205 => 0.0201, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -1.83% (0.0219 => 0.0215, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1453 => 0.1452, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.62% (1.1621 => 1.1549, std.dev.: 0.0539) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 6.05% (0.1437 => 0.1524, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.63% (0.4176 => 0.4066, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.42% (0.1373 => 0.1326, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.92% (0.0638 => 0.0663, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.53% (0.0277 => 0.0270, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.05% (0.0537 => 0.0548, std.dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.68% (1.1510 => 1.1432, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0018 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.47% (0.0632 => 0.0629, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.36% (0.0261 => 0.0247, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.11% (0.8027 => 0.8018, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 44.44% (0.0045 => 0.0065, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2291.95% (0.6332 => 15.1458, std.dev.: 0.2995) MultiSource/Benchmarks/McCat/08-main/main: 48.61% (0.1831 => 0.2721, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.26% (0.1559 => 0.1477, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1482.24% (0.3344 => 5.2910, std.dev.: 0.0643) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.01% (0.2364 => 0.3239, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/mandel: 2.80% (0.0429 => 0.0441, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.46% (0.0224 => 0.0234, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -28.70% (0.0230 => 0.0164, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3748, std.dev.: 0.0441) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0717, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4912, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3440, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0236, std.dev.: 0.0206) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4035, std.dev.: 0.0040) SingleSource/Regression/C/uint64_to_float: -23.97% (2.1832 => 1.6598, std.dev.: 0.0034) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.67% (0.0810 => 0.0945, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.27% (0.0773 => 0.0891, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 12.86% (0.1112 => 0.1255, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.26% (0.0848 => 0.0952, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.92% (0.6010 => 0.6546, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.81% (0.4847 => 0.5274, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.68% (0.7473 => 0.8122, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.67% (0.2180 => 0.2369, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.29% (0.2279 => 0.2468, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.26% (0.3137 => 0.3396, std.dev.: 0.0095) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.37% (0.1588 => 0.1705, std.dev.: 0.0019) MultiSource/Applications/viterbi/viterbi: 6.79% (0.1577 => 0.1684, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.57% (0.8148 => 0.8602, std.dev.: 0.0142) MultiSource/Applications/Burg/burg: 5.20% (1.2222 => 1.2857, std.dev.: 0.0206) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.16% (0.9435 => 0.9922, std.dev.: 0.0097) MultiSource/Applications/spiff/spiff: 5.07% (0.7950 => 0.8353, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.91% (0.2240 => 0.2350, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 4.48% (1.4269 => 1.4908, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.42% (1.1685 => 1.2201, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.29% (1.1606 => 1.2104, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.59% (0.3124 => 0.3236, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.41% (0.8204 => 0.8484, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.40% (0.8712 => 0.9008, std.dev.: 0.0031) MultiSource/Applications/treecc/treecc: 3.18% (1.9948 => 2.0582, std.dev.: 0.0178) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.04% (4.1763 => 4.3034, std.dev.: 0.0351) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.03% (4.4873 => 4.6232, std.dev.: 0.0251) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.98% (0.9908 => 1.0203, std.dev.: 0.0076) MultiSource/Applications/ClamAV/clamscan: 2.93% (14.7684 => 15.2012, std.dev.: 0.0659) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.87% (0.8086 => 0.8318, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.86% (0.8927 => 0.9182, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.60% (0.8331 => 0.8548, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.59% (0.8518 => 0.8739, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.57% (0.7966 => 0.8171, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.40% (0.9069 => 0.9287, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.33% (0.8317 => 0.8511, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.33% (0.4559 => 0.4665, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/05-eks/eks: 2.32% (0.4397 => 0.4499, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.25% (0.9074 => 0.9278, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.18% (0.8069 => 0.8245, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.86% (0.8340 => 0.8495, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.36% (3.1832 => 3.2265, std.dev.: 0.0111) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 56.97% (1.5795 => 2.4794, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.30% (0.3186 => 0.3546, std.dev.: 0.0134) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.74% (1.1857 => 1.2775, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 5.98% (63.1822 => 66.9624, std.dev.: 0.2056) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.68% (2.2485 => 2.3313, std.dev.: 0.0282) SingleSource/Benchmarks/Misc/ReedSolomon: 3.40% (8.5322 => 8.8227, std.dev.: 0.0173) MultiSource/Applications/siod/siod: 3.11% (3.6643 => 3.7782, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.96% (4.3552 => 4.4404, std.dev.: 0.0117) MultiSource/Benchmarks/Bullet/bullet: 1.82% (7.1181 => 7.2478, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.38% (41.4238 => 41.9966, std.dev.: 0.0641) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.24% (4.8362 => 4.8964, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.23% (1.1365 => 1.1505, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.21% (3.1873 => 3.2258, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.05% (1.5941 => 1.6109, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.05% (4.4340 => 4.4807, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 1.04% (8.4326 => 8.5199, std.dev.: 0.0287) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -4.90% (29.8330 => 28.3723, std.dev.: 0.1598) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.81% (7.2130 => 7.0105, std.dev.: 0.0479) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.45% (1.0388 => 1.0134, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/hash2: -1.43% (3.4237 => 3.3747, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.24% (3.3479 => 3.3064, std.dev.: 0.0056) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.43% (16.4461 => 16.6805, std.dev.: 0.2705) MultiSource/Applications/obsequi/Obsequi: 2.47% (1.0262 => 1.0515, std.dev.: 0.0198) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6845.63% (0.3123 => 21.6912, std.dev.: 0.3808) SingleSource/Benchmarks/CoyoteBench/fftbench: 46.65% (0.2463 => 0.3612, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/bigfib: 0.68% (0.6010 => 0.6051, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.41% (0.3266 => 0.3312, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/strcat: 1.57% (0.1969 => 0.2000, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 75.61% (0.0123 => 0.0216, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.70% (0.0408 => 0.0419, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 27.95% (0.0254 => 0.0325, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.65% (0.0302 => 0.0310, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.85% (0.0384 => 0.0418, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/casts: 5.79% (0.0190 => 0.0201, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 19.44% (0.0180 => 0.0215, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.97% (0.1438 => 0.1452, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.94% (1.1329 => 1.1549, std.dev.: 0.0539) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 4.24% (0.1462 => 0.1524, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.35% (0.4164 => 0.4066, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.14% (0.1369 => 0.1326, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.43% (0.0641 => 0.0663, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 38.46% (0.0195 => 0.0270, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.19% (0.0578 => 0.0548, std.dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.04% (1.1437 => 1.1432, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1700.00% (0.0001 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.32% (0.0627 => 0.0629, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 37.22% (0.0180 => 0.0247, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.01% (0.8017 => 0.8018, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 4.84% (0.0062 => 0.0065, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 2 18:05:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 2 Nov 2012 20:05:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121103010532.341B52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5539?compare_to=5537&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5539, Order: 167332, Start Time: 2012-11-02 23:40:16, End Time: 2012-11-03 01:05:31 To: 5537, Order: 167313, Start Time: 2012-11-02 21:52:00, End Time: 2012-11-02 23:16:59 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 5 (6 on baseline) Performance Improvements: 0 (180 on baseline) Unchanged Tests: 1037 (856 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.48% (0.7408 => 0.7518, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.58% (78.3195 => 80.3424, std.dev.: 0.5113) MultiSource/Benchmarks/sim/sim: 2.02% (4.8812 => 4.9798, std.dev.: 0.0305) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.67% (55.4945 => 56.4194, std.dev.: 0.1219) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.20% (1.2710 => 1.2863, std.dev.: 0.0046) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.29% (1.2783 => 1.3715, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.38% (54.5751 => 56.4194, std.dev.: 0.1219) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.67% (2.0478 => 2.1025, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/salsa20: 2.47% (7.4937 => 7.6791, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/hash2: 2.27% (3.1932 => 3.2657, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 2.02% (4.8812 => 4.9798, std.dev.: 0.0305) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.53% (0.1431 => 0.1309, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: -8.21% (0.1230 => 0.1129, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.25% (0.3821 => 0.3544, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -6.96% (2.4924 => 2.3190, std.dev.: 0.0066) MultiSource/Applications/sgefa/sgefa: -6.85% (0.3357 => 0.3127, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.85% (3.5339 => 3.2919, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.80% (0.2428 => 0.2263, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.71% (22.4056 => 20.9019, std.dev.: 0.0218) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.62% (0.9542 => 0.8910, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.49% (0.3142 => 0.2938, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.44% (0.1584 => 0.1482, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: -6.42% (4.3330 => 4.0548, std.dev.: 0.0031) MultiSource/Applications/Burg/burg: -6.41% (1.2515 => 1.1713, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.39% (1.6474 => 1.5421, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.29% (0.1716 => 0.1608, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.29% (0.3658 => 0.3428, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.27% (0.9852 => 0.9234, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -6.25% (0.2160 => 0.2025, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.24% (1.0544 => 0.9886, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: -6.20% (0.9179 => 0.8610, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -6.19% (2.4021 => 2.2534, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -6.19% (0.1761 => 0.1652, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: -6.13% (16.1920 => 15.1988, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -6.11% (9.2283 => 8.6646, std.dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.11% (0.6484 => 0.6088, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: -6.07% (7.0961 => 6.6651, std.dev.: 0.0214) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.04% (1.4642 => 1.3757, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: -6.03% (1.1450 => 1.0760, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: -5.98% (0.2659 => 0.2500, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.97% (0.2548 => 0.2396, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.96% (1.2784 => 1.2022, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: -5.96% (1.1530 => 1.0843, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.95% (0.6304 => 0.5929, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.95% (0.7919 => 0.7448, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.94% (1.3722 => 1.2907, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.93% (0.6681 => 0.6285, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.92% (0.5591 => 0.5260, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.91% (1.2300 => 1.1573, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.91% (0.5857 => 0.5511, std.dev.: 0.0114) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.90% (0.2695 => 0.2536, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.90% (0.6052 => 0.5695, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -5.90% (0.2985 => 0.2809, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.86% (0.7339 => 0.6909, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.84% (0.6194 => 0.5832, std.dev.: 0.0012) MultiSource/Applications/lua/lua: -5.83% (4.0594 => 3.8226, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.83% (0.4151 => 0.3909, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.83% (2.2587 => 2.1271, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.81% (0.6260 => 0.5896, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.81% (0.5478 => 0.5160, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.80% (0.5849 => 0.5510, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.79% (0.5575 => 0.5252, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.78% (0.6230 => 0.5870, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.76% (4.5069 => 4.2474, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.76% (5.4682 => 5.1534, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.75% (0.7524 => 0.7091, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.74% (0.6667 => 0.6284, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.74% (0.3483 => 0.3283, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.74% (0.6446 => 0.6076, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.74% (0.5802 => 0.5469, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -5.72% (0.7447 => 0.7021, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.70% (0.6293 => 0.5934, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.70% (0.5863 => 0.5529, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: -5.70% (0.3581 => 0.3377, std.dev.: 0.0076) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.69% (0.2355 => 0.2221, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.69% (0.5941 => 0.5603, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.68% (0.5456 => 0.5146, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.68% (0.6676 => 0.6297, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.67% (0.6736 => 0.6354, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.65% (0.5925 => 0.5590, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.64% (4.0323 => 3.8048, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.63% (0.5581 => 0.5267, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.62% (0.6297 => 0.5943, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.62% (0.5805 => 0.5479, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -5.61% (0.3406 => 0.3215, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.61% (0.6440 => 0.6079, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.60% (1.6364 => 1.5448, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.59% (14.2083 => 13.4134, std.dev.: 0.0129) MultiSource/Applications/SPASS/SPASS: -5.58% (15.5079 => 14.6425, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.57% (6.7716 => 6.3942, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.57% (0.5168 => 0.4880, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.57% (4.8802 => 4.6083, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.57% (0.5569 => 0.5259, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.56% (4.8161 => 4.5481, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.56% (0.6660 => 0.6290, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.55% (0.6033 => 0.5698, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.55% (0.5570 => 0.5261, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.54% (0.6189 => 0.5846, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -5.54% (1.3148 => 1.2420, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hash2: -5.53% (0.4861 => 0.4592, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.50% (0.6395 => 0.6043, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -5.50% (34.0927 => 32.2182, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.50% (0.5859 => 0.5537, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -5.49% (0.7982 => 0.7544, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.47% (0.5705 => 0.5393, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -5.44% (18.2933 => 17.2975, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.42% (0.5567 => 0.5265, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -5.40% (17.1032 => 16.1791, std.dev.: 0.0130) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.40% (0.9557 => 0.9041, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -5.39% (0.3025 => 0.2862, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.39% (0.8521 => 0.8062, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.38% (0.3849 => 0.3642, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.36% (0.3491 => 0.3304, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.34% (0.4515 => 0.4274, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.33% (0.3323 => 0.3146, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: -5.32% (1.3864 => 1.3126, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.31% (0.4083 => 0.3866, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -5.31% (0.4524 => 0.4284, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.30% (0.2999 => 0.2840, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -5.29% (0.3194 => 0.3025, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.28% (0.5999 => 0.5682, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: -5.28% (0.3255 => 0.3083, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.28% (2.1713 => 2.0566, std.dev.: 0.0033) MultiSource/Applications/d/make_dparser: -5.28% (3.5154 => 3.3299, std.dev.: 0.0102) MultiSource/Applications/treecc/treecc: -5.27% (2.1401 => 2.0274, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/except: -5.25% (0.3026 => 0.2867, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.24% (0.7198 => 0.6821, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.22% (0.2278 => 0.2159, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: -5.22% (0.3446 => 0.3266, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -5.22% (0.2989 => 0.2833, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.22% (0.5329 => 0.5051, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.21% (0.3319 => 0.3146, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.21% (0.4321 => 0.4096, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.19% (0.3931 => 0.3727, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.18% (0.2106 => 0.1997, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -5.17% (0.6750 => 0.6401, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.17% (0.5688 => 0.5394, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.17% (0.4916 => 0.4662, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: -5.16% (0.4248 => 0.4029, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -5.15% (0.3867 => 0.3668, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -5.14% (0.3481 => 0.3302, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.14% (0.3057 => 0.2900, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.12% (0.2871 => 0.2724, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -5.11% (0.3621 => 0.3436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.10% (0.2903 => 0.2755, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -5.10% (0.3394 => 0.3221, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.06% (1.2210 => 1.1592, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.05% (0.4813 => 0.4570, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.04% (0.3252 => 0.3088, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.04% (0.3016 => 0.2864, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.04% (0.4427 => 0.4204, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.04% (0.2939 => 0.2791, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -5.02% (0.2849 => 0.2706, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -4.99% (0.3788 => 0.3599, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -4.98% (0.3271 => 0.3108, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.98% (0.2933 => 0.2787, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -4.98% (5.0226 => 4.7727, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: -4.96% (0.3205 => 0.3046, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.93% (1.2221 => 1.1619, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.92% (8.0126 => 7.6184, std.dev.: 0.0097) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: -4.90% (0.3059 => 0.2909, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -4.86% (15.2527 => 14.5121, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.74% (0.3837 => 0.3655, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -4.68% (0.8418 => 0.8024, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -4.62% (0.4199 => 0.4005, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.56% (0.3880 => 0.3703, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -4.53% (0.4176 => 0.3987, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/exceptions-2: -4.52% (0.3831 => 0.3658, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.51% (0.4033 => 0.3851, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.47% (0.3896 => 0.3722, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.46% (0.3812 => 0.3642, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.42% (0.3891 => 0.3719, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -4.42% (0.3848 => 0.3678, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -4.25% (0.4280 => 0.4098, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.22% (0.3884 => 0.3720, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.78% (0.9077 => 0.8734, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: -3.72% (1.5610 => 1.5030, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: -3.43% (0.6441 => 0.6220, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.40% (0.6347 => 0.6131, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -3.36% (0.7779 => 0.7518, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.96% (20.7746 => 20.1595, std.dev.: 0.0357) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7527, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -8.77% (1.2842 => 1.1716, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: -4.01% (2.2633 => 2.1725, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.78% (1.3096 => 1.2863, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4733, std.dev.: 0.0043) Report Time: 4.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 2 19:00:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 2 Nov 2012 21:00:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121103020048.30C502A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5540?compare_to=5535&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5540, Order: 167324, Start Time: 2012-11-02 22:45:00, End Time: 2012-11-03 02:00:49 To: 5535, Order: 167300, Start Time: 2012-11-02 18:41:00, End Time: 2012-11-02 21:56:41 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (171 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (717 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.16% (2.4096 => 2.4375, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.01% (122.1135 => 128.2333, std.dev.: 1.7162) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.64% (0.0625 => 0.0879, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.51% (0.1063 => 0.1398, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.16% (0.2969 => 0.3716, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.86% (0.1106 => 0.1381, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.76% (0.4253 => 0.5306, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.23% (0.0714 => 0.0887, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 24.08% (1.5932 => 1.9768, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 23.87% (0.4139 => 0.5127, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.65% (0.4994 => 0.6125, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.54% (0.5900 => 0.7230, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.53% (0.0475 => 0.0582, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.30% (0.0547 => 0.0669, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.26% (0.0584 => 0.0714, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 21.90% (0.5000 => 0.6095, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.74% (0.0897 => 0.1092, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 21.21% (0.0481 => 0.0583, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 20.99% (0.1620 => 0.1960, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 20.87% (0.0599 => 0.0724, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 20.86% (0.1021 => 0.1234, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.51% (0.1107 => 0.1334, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 20.03% (0.0604 => 0.0725, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.78% (0.0541 => 0.0648, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.69% (0.0584 => 0.0699, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.63% (0.1549 => 0.1853, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.52% (0.3903 => 0.4665, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 19.51% (0.0948 => 0.1133, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.51% (0.1604 => 0.1917, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.49% (0.1103 => 0.1318, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.43% (0.0633 => 0.0756, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.31% (0.0642 => 0.0766, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 19.24% (0.0821 => 0.0979, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.04% (0.1003 => 0.1194, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 18.84% (0.1619 => 0.1924, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.47% (0.1462 => 0.1732, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.37% (0.0822 => 0.0973, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 18.16% (0.5826 => 0.6884, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 17.85% (0.0947 => 0.1116, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 17.81% (0.5889 => 0.6938, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 17.70% (0.0808 => 0.0951, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.61% (0.3890 => 0.4575, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.40% (0.2736 => 0.3212, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 17.24% (0.1218 => 0.1428, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 17.18% (0.4029 => 0.4721, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.13% (0.2014 => 0.2359, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/09-vor/vor: 17.01% (0.1505 => 0.1761, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 16.91% (0.1088 => 0.1272) MultiSource/Benchmarks/Olden/mst/mst: 16.91% (0.0698 => 0.0816, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.88% (1.3152 => 1.5372, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.50% (0.2866 => 0.3339, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 16.41% (1.8794 => 2.1878, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 16.25% (0.5546 => 0.6447, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 16.21% (1.0781 => 1.2529, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.21% (0.2875 => 0.3341, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 15.99% (0.4658 => 0.5403, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.95% (0.1160 => 0.1345, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 15.93% (0.7171 => 0.8313, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 15.90% (3.5627 => 4.1291, std.dev.: 0.0050) MultiSource/Applications/hbd/hbd: 15.81% (0.9697 => 1.1230, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.75% (0.1968 => 0.2278, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 15.71% (0.2725 => 0.3153, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.68% (0.3271 => 0.3784, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.66% (0.5026 => 0.5813, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 15.62% (0.1421 => 0.1643, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.53% (1.6211 => 1.8728, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hello: 15.51% (0.2714 => 0.3135, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.49% (0.2738 => 0.3162) SingleSource/Benchmarks/Shootout-C++/strcat: 15.45% (0.2750 => 0.3175, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 15.38% (0.3004 => 0.3466, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.30% (4.4195 => 5.0959, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.28% (0.2729 => 0.3146, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.21% (0.3195 => 0.3681, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (0.2780 => 0.3202, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.15% (0.2792 => 0.3215, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 15.09% (0.2803 => 0.3226, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/wc: 15.08% (0.3096 => 0.3563, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.04% (0.4361 => 0.5017, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 15.03% (0.1284 => 0.1477, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/except: 15.01% (0.2811 => 0.3233, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 14.93% (0.2813 => 0.3233, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 14.88% (4.2109 => 4.8373, std.dev.: 0.0289) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.87% (0.2911 => 0.3344, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.87% (2.0673 => 2.3747, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 14.86% (0.9909 => 1.1381, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 14.84% (0.2823 => 0.3242, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.73% (0.3930 => 0.4509, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 14.69% (0.3267 => 0.3747, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.59% (1.9694 => 2.2568, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/ary: 14.52% (0.3258 => 0.3731, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.51% (2.7292 => 3.1252, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.50% (0.1090 => 0.1248, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 14.37% (23.5202 => 26.8997, std.dev.: 0.0179) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.33% (1.9966 => 2.2827, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.31% (0.3060 => 0.3498, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 14.23% (0.3317 => 0.3789, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.19% (0.3362 => 0.3839, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 14.03% (0.2566 => 0.2926, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.96% (0.3124 => 0.3560, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 13.88% (0.2075 => 0.2363, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.86% (0.3845 => 0.4378, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 13.78% (0.3678 => 0.4185, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 13.77% (0.4146 => 0.4717, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 13.74% (0.3348 => 0.3808, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.62% (0.3282 => 0.3729, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 13.61% (0.3460 => 0.3931, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 13.55% (0.3726 => 0.4231, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.54% (0.3465 => 0.3934, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.53% (0.3488 => 0.3960, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 13.52% (0.3446 => 0.3912, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 13.52% (0.3477 => 0.3947, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 13.50% (0.3496 => 0.3968, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 13.49% (0.3469 => 0.3937, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 13.49% (1.4269 => 1.6194, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/trivial-interface: 13.39% (0.3442 => 0.3903, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.38% (0.3625 => 0.4110, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.26% (0.3981 => 0.4509, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.20% (0.3690 => 0.4177, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 13.17% (0.4251 => 0.4811, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.15% (0.3650 => 0.4130, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 13.15% (0.3643 => 0.4122, std.dev.: 0.0032) MultiSource/Applications/treecc/treecc: 12.90% (0.7875 => 0.8891, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/parameter-passing: 12.89% (0.3724 => 0.4204, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 12.53% (0.5012 => 0.5640, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 12.41% (2.1653 => 2.4340, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 12.26% (4.6177 => 5.1838, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.95% (0.6435 => 0.7204, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 11.66% (2.1013 => 2.3464, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.64% (0.1383 => 0.1544, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.52% (0.2040 => 0.2275, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 11.37% (0.2691 => 0.2997, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11.10% (5.5417 => 6.1567, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.70% (0.1028 => 0.1138, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 10.66% (0.3498 => 0.3871, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.45% (0.2737 => 0.3023, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 10.27% (0.4847 => 0.5345, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 10.19% (0.6634 => 0.7310, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.06% (0.2068 => 0.2276, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.86% (0.3084 => 0.3388, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 9.74% (0.3336 => 0.3661, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.22% (0.2103 => 0.2297, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 8.97% (2.0346 => 2.2171, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.93% (4.6926 => 5.1117, std.dev.: 0.0038) MultiSource/Applications/lemon/lemon: 8.74% (0.2391 => 0.2600, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.64% (11.6398 => 12.6458, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.19% (0.5361 => 0.5800, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.66% (0.5584 => 0.6012, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.47% (0.7426 => 0.7981, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 6.50% (11.9555 => 12.7329, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.22% (0.3792 => 0.3952, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.29% (0.2162 => 0.3552, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6531, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 8.92% (0.2802 => 0.3052, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary: 7.78% (0.2122 => 0.2287, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6096, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.66% (0.3693 => 0.3902, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.04% (12.0509 => 12.6580, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1677, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-2: 3.93% (1.8057 => 1.8767, std.dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/dry: 2.57% (14.0481 => 14.4098, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1928, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.73% (3.1722 => 3.2272, std.dev.: 0.0033) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3080, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2871, std.dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.21% (1.0142 => 1.0265, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5402, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5879, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.57% (2.4764 => 2.4375, std.dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.65% (25.4195 => 16.3563, std.dev.: 0.0212) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9751, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7737, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: -7.24% (0.2402 => 0.2228, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.33% (11.2080 => 10.8343, std.dev.: 0.0048) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7747, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -2.87% (3.6262 => 3.5220, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.59% (0.6293 => 0.6130, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -2.16% (17.2379 => 16.8656, std.dev.: 0.0158) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.15% (41.7953 => 40.8986, std.dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5713, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4957, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7164, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1808, std.dev.: 0.0338) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.09% (3.3991 => 3.3620, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.09% (21.9346 => 21.6955, std.dev.: 0.0701) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0435, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 2 19:36:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 2 Nov 2012 21:36:59 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121103023659.A290F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5541?compare_to=5538&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5541, Order: 167347, Start Time: 2012-11-03 01:10:36, End Time: 2012-11-03 02:37:04 To: 5538, Order: 167331, Start Time: 2012-11-02 23:24:54, End Time: 2012-11-03 00:52:51 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 11 (74 on baseline) Performance Improvements: 27 (8 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 953 (892 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.66% (14.5231 => 16.3617, std.dev.: 0.6457) MultiSource/Applications/SIBsim4/SIBsim4: 6.81% (3.2258 => 3.4454, std.dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: 4.89% (14.0010 => 14.6857, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.04% (7.0105 => 7.2238, std.dev.: 0.0792) MultiSource/Benchmarks/sim/sim: 2.91% (3.8146 => 3.9256, std.dev.: 0.0145) MultiSource/Applications/lambda-0_1_3/lambda: 2.65% (7.4354 => 7.6322, std.dev.: 0.0050) MultiSource/Applications/lua/lua: 2.55% (28.3723 => 29.0963, std.dev.: 0.1586) MultiSource/Benchmarks/FreeBench/neural/neural: 1.72% (1.0793 => 1.0979, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.68% (28.6002 => 29.0816, std.dev.: 0.0137) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.66% (2.4603 => 2.5011, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/pi: 1.04% (2.4794 => 2.5051, std.dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -4.09% (0.3396 => 0.3257, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.81% (0.2680 => 0.2578, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.99% (0.8484 => 0.8315, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.91% (0.8318 => 0.8159, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.87% (0.8985 => 0.8817, std.dev.: 0.0060) SingleSource/UnitTests/Vector/constpool: -1.84% (8.4992 => 8.3428, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -1.80% (0.8245 => 0.8097, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.78% (0.9008 => 0.8848, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.59% (0.9182 => 0.9036, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.54% (0.8171 => 0.8045, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.44% (0.8739 => 0.8613, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.28% (0.8274 => 0.8168, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.26% (4.6232 => 4.5650, std.dev.: 0.0121) MultiSource/Benchmarks/Bullet/bullet: -1.03% (32.6539 => 32.3182, std.dev.: 0.0663) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: -7.75% (0.1497 => 0.1381, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.69% (0.3232 => 0.3048, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -4.36% (66.9624 => 64.0443, std.dev.: 0.3863) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.20% (2.8823 => 2.7612, std.dev.: 0.0352) MultiSource/Benchmarks/Ptrdist/ft/ft: -3.68% (0.8968 => 0.8638, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.46% (1.1505 => 1.1107, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout/lists: -3.42% (7.2951 => 7.0453, std.dev.: 0.0200) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -3.38% (22.5046 => 21.7432, std.dev.: 0.2258) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.90% (0.3546 => 0.3443, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: -2.52% (6.3291 => 6.1694, std.dev.: 0.0571) MultiSource/Benchmarks/Bullet/bullet: -2.06% (7.2478 => 7.0988, std.dev.: 0.0321) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.81% (2.4494 => 2.4050, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: -1.23% (4.3748 => 4.3212, std.dev.: 0.0118) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.27% (16.6805 => 16.7255, std.dev.: 0.0478) MultiSource/Applications/obsequi/Obsequi: -0.30% (1.0515 => 1.0483, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.03% (21.6912 => 21.6848, std.dev.: 0.1401) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.94% (0.3612 => 0.3646, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -0.40% (0.6051 => 0.6027, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.69% (0.3312 => 0.3335, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/strcat: 0.20% (0.2000 => 0.2004, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.93% (0.0216 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -10.26% (0.0419 => 0.0376, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 2.15% (0.0325 => 0.0332, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.65% (0.0310 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.72% (0.0418 => 0.0421, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 0.50% (0.0201 => 0.0202, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 0.47% (0.0215 => 0.0216, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.52% (0.1452 => 0.1474, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -2.44% (1.1549 => 1.1267, std.dev.: 0.0154) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.62% (0.1524 => 0.1484, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.32% (0.4066 => 0.4053, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.83% (0.1326 => 0.1315, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.17% (0.0663 => 0.0642, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.56% (0.0270 => 0.0228, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.36% (0.0548 => 0.0546, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.11% (1.1432 => 1.1419, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 72.22% (0.0018 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.91% (0.0629 => 0.0641, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.10% (0.0247 => 0.0267) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.34% (0.8018 => 0.8045, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -35.38% (0.0065 => 0.0042, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2301.55% (0.6332 => 15.2066, std.dev.: 0.0896) MultiSource/Benchmarks/McCat/08-main/main: 47.62% (0.1831 => 0.2703, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.86% (0.1559 => 0.1452, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1484.48% (0.3344 => 5.2985, std.dev.: 0.0355) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.96% (0.2364 => 0.3214, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/mandel: -12.82% (0.0429 => 0.0374, std.dev.: 0.0057) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.91% (0.0224 => 0.0235, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -32.17% (0.0230 => 0.0156, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3212, std.dev.: 0.0118) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0706, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4952, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3466, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0234, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4052, std.dev.: 0.0023) SingleSource/Regression/C/uint64_to_float: -24.04% (2.1832 => 1.6584, std.dev.: 0.0073) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.83% (0.0810 => 0.0922, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/tsp/tsp: 11.69% (0.1112 => 0.1242, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.51% (0.1425 => 0.1532, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.96% (0.8321 => 0.8817, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.92% (0.2180 => 0.2309, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: 5.46% (0.7950 => 0.8384, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.11% (0.7473 => 0.7855, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.93% (0.6010 => 0.6306, std.dev.: 0.0097) MultiSource/Applications/Burg/burg: 3.94% (1.2222 => 1.2703, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.71% (1.1685 => 1.2119, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.37% (0.9435 => 0.9753, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.16% (0.3295 => 0.3399, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.93% (0.3717 => 0.3826, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.57% (0.4127 => 0.4233, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.53% (0.8697 => 0.8917, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 2.51% (1.4269 => 1.4627, std.dev.: 0.0113) MultiSource/Applications/treecc/treecc: 2.50% (1.9948 => 2.0446, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.49% (1.3279 => 1.3609, std.dev.: 0.0049) MultiSource/Applications/SIBsim4/SIBsim4: 2.47% (1.2568 => 1.2879, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 2.47% (14.7684 => 15.1333, std.dev.: 0.0474) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.34% (0.5817 => 0.5953, std.dev.: 0.0042) MultiSource/Applications/JM/lencod/lencod: 2.05% (15.3280 => 15.6426, std.dev.: 0.0235) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.00% (0.8420 => 0.8588, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.96% (0.8611 => 0.8780, std.dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.96% (6.6074 => 6.7366, std.dev.: 0.0360) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (0.9908 => 1.0101, std.dev.: 0.0071) MultiSource/Applications/d/make_dparser: 1.93% (3.2366 => 3.2992, std.dev.: 0.0159) MultiSource/Applications/JM/ldecod/ldecod: 1.90% (6.7320 => 6.8602, std.dev.: 0.0329) MultiSource/Applications/siod/siod: 1.90% (2.2184 => 2.2605, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.89% (1.4479 => 1.4753, std.dev.: 0.0082) MultiSource/Applications/lua/lua: 1.87% (3.8189 => 3.8904, std.dev.: 0.0179) MultiSource/Applications/SPASS/SPASS: 1.86% (14.2605 => 14.5262, std.dev.: 0.0385) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.86% (0.8716 => 0.8878, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.81% (0.9688 => 0.9863, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.79% (4.1763 => 4.2509, std.dev.: 0.0247) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.78% (1.1170 => 1.1369, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.77% (0.8457 => 0.8607, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.76% (0.9074 => 0.9234, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.73% (4.4873 => 4.5650, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.72% (0.8007 => 0.8145, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 1.69% (1.1271 => 1.1462, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.66% (0.9039 => 0.9189, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.56% (0.7932 => 0.8056, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.56% (0.8712 => 0.8848, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.56% (13.1811 => 13.3861, std.dev.: 0.0408) MultiSource/Benchmarks/mafft/pairlocalalign: 1.52% (8.6247 => 8.7558, std.dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.52% (0.6586 => 0.6686, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.52% (0.8177 => 0.8301, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.47% (0.8050 => 0.8168, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.46% (0.8261 => 0.8382, std.dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: 1.44% (31.8598 => 32.3182, std.dev.: 0.0663) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.43% (0.8317 => 0.8436, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.37% (0.9056 => 0.9180, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.35% (0.8204 => 0.8315, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.34% (0.8656 => 0.8772, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 1.32% (1.0945 => 1.1090, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.22% (0.8927 => 0.9036, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 59.30% (0.0199 => 0.0317, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/pi: 58.60% (1.5795 => 2.5051, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.72% (14.6451 => 16.3617, std.dev.: 0.6457) MultiSource/Applications/SIBsim4/SIBsim4: 8.10% (3.1873 => 3.4454, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.07% (0.3186 => 0.3443, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.78% (1.1857 => 1.2780, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 4.85% (14.0064 => 14.6857, std.dev.: 0.0108) MultiSource/Benchmarks/sim/sim: 2.75% (3.8206 => 3.9256, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/ReedSolomon: 2.73% (8.5322 => 8.7648, std.dev.: 0.0656) MultiSource/Applications/siod/siod: 2.36% (3.6643 => 3.7508, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.13% (2.4490 => 2.5011, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.02% (4.3552 => 4.4431, std.dev.: 0.0262) MultiSource/Applications/lambda-0_1_3/lambda: 1.85% (7.4933 => 7.6322, std.dev.: 0.0050) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.75% (28.5821 => 29.0816, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.29% (4.8362 => 4.8986, std.dev.: 0.0176) MultiSource/Benchmarks/FreeBench/neural/neural: 1.27% (1.0841 => 1.0979, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.02% (2.4647 => 2.4898, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.76% (0.3269 => 0.3048, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.04% (2.8773 => 2.7612, std.dev.: 0.0352) SingleSource/Benchmarks/Shootout/lists: -3.98% (7.3375 => 7.0453, std.dev.: 0.0200) MultiSource/Applications/lua/lua: -2.47% (29.8330 => 29.0963, std.dev.: 0.1586) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.41% (1.2822 => 1.2513, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/hash2: -1.55% (3.4237 => 3.3708, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.16% (2.4333 => 2.4050, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.06% (3.3479 => 3.3125, std.dev.: 0.0124) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.70% (16.4461 => 16.7255, std.dev.: 0.0478) MultiSource/Applications/obsequi/Obsequi: 2.15% (1.0262 => 1.0483, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6843.58% (0.3123 => 21.6848, std.dev.: 0.1401) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.03% (0.2463 => 0.3646, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 0.28% (0.6010 => 0.6027, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.11% (0.3266 => 0.3335, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/strcat: 1.78% (0.1969 => 0.2004, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -7.84% (0.0408 => 0.0376, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.64% (0.0384 => 0.0421, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.50% (0.1438 => 0.1474, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.55% (1.1329 => 1.1267, std.dev.: 0.0154) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.50% (0.1462 => 0.1484, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.67% (0.4164 => 0.4053, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.94% (0.1369 => 0.1315, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.16% (0.0641 => 0.0642, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 16.92% (0.0195 => 0.0228, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.54% (0.0578 => 0.0546, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.16% (1.1437 => 1.1419, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.23% (0.0627 => 0.0641, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.35% (0.8017 => 0.8045, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -32.26% (0.0062 => 0.0042, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 2 19:53:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 2 Nov 2012 21:53:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121103025353.4E1B22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5542?compare_to=5539&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5542, Order: 167348, Start Time: 2012-11-03 01:28:55, End Time: 2012-11-03 02:53:55 To: 5539, Order: 167332, Start Time: 2012-11-02 23:40:16, End Time: 2012-11-03 01:05:31 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (4 on baseline) Performance Improvements: 1 (180 on baseline) Unchanged Tests: 1039 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.16% (20.1595 => 20.3928, std.dev.: 0.0172) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.13% (1.1480 => 1.1610, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.52% (0.7518 => 0.7404, std.dev.: 0.0022) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.56% (2.0478 => 2.1003, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.4937 => 7.6783, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/hash2: 2.04% (3.1932 => 3.2583, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.77% (0.3821 => 0.3524, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -7.23% (2.4924 => 2.3123, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.70% (22.4056 => 20.9036, std.dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.70% (3.5339 => 3.2973, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.68% (0.3142 => 0.2932, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.64% (0.3357 => 0.3134, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.57% (0.9542 => 0.8915, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.53% (0.3658 => 0.3419, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: -6.53% (4.3330 => 4.0500, std.dev.: 0.0046) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.44% (0.1584 => 0.1482, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: -6.41% (16.1920 => 15.1545, std.dev.: 0.0193) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.34% (1.0544 => 0.9875, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.34% (0.2428 => 0.2274, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: -6.29% (7.0961 => 6.6497, std.dev.: 0.0224) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.22% (0.9852 => 0.9239, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -6.22% (1.2515 => 1.1737, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.20% (1.6474 => 1.5452, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -6.17% (9.2283 => 8.6587, std.dev.: 0.0084) MultiSource/Applications/lemon/lemon: -6.14% (1.1450 => 1.0747, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.12% (0.7919 => 0.7434, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.12% (0.1716 => 0.1611, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: -6.09% (0.9179 => 0.8620, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.09% (1.2784 => 1.2006, std.dev.: 0.0031) MultiSource/Applications/siod/siod: -6.08% (2.4021 => 2.2560, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.08% (1.3722 => 1.2888, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: -6.08% (0.1761 => 0.1654, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: -6.05% (0.2659 => 0.2498, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.05% (0.6484 => 0.6092, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.04% (0.2548 => 0.2394, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.02% (5.4682 => 5.1390, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: -6.02% (0.2160 => 0.2030, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.01% (0.1796 => 0.1688, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.98% (4.5069 => 4.2373, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.98% (1.4642 => 1.3767, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.95% (1.2300 => 1.1568, std.dev.: 0.0105) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.94% (0.2355 => 0.2215, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.93% (4.0323 => 3.7931, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.92% (1.6364 => 1.5395, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.89% (0.6736 => 0.6339, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-4: -5.88% (0.3880 => 0.3652, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.86% (0.3891 => 0.3663, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.85% (4.8161 => 4.5342, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/trivial-interface: -5.85% (0.3812 => 0.3589, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.83% (0.2695 => 0.2538, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -5.82% (0.3831 => 0.3608, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -5.82% (0.4176 => 0.3933, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.81% (0.5857 => 0.5517, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -5.80% (0.4033 => 0.3799, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.80% (0.3483 => 0.3281, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.79% (4.8802 => 4.5976, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/synchronized: -5.78% (0.3896 => 0.3671, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.77% (0.3884 => 0.3660, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -5.76% (17.1032 => 16.1181, std.dev.: 0.0144) MultiSource/Applications/lua/lua: -5.76% (4.0594 => 3.8257, std.dev.: 0.0109) MultiSource/Applications/hexxagon/hexxagon: -5.75% (1.3148 => 1.2392, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: -5.75% (15.5079 => 14.6167, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/exceptions-3: -5.74% (0.3848 => 0.3627, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.73% (0.3406 => 0.3211, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.72% (0.4321 => 0.4074, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.72% (0.3849 => 0.3629, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.70% (0.6681 => 0.6300, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.69% (0.6304 => 0.5945, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.69% (14.2083 => 13.3994, std.dev.: 0.0100) MultiSource/Applications/kimwitu++/kc: -5.69% (18.2933 => 17.2525, std.dev.: 0.0098) MultiSource/Benchmarks/nbench/nbench: -5.69% (1.1530 => 1.0874, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.69% (0.7524 => 0.7096, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: -5.69% (0.3025 => 0.2853, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.68% (0.5999 => 0.5658, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.68% (6.7716 => 6.3867, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/property: -5.67% (0.4199 => 0.3961, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.65% (2.2587 => 2.1310, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.63% (0.8521 => 0.8041, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/parameter-passing: -5.63% (0.4280 => 0.4039, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.63% (0.7339 => 0.6926, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.62% (0.5478 => 0.5170, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -5.62% (34.0927 => 32.1769, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.62% (0.6194 => 0.5846, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.62% (0.6052 => 0.5712, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.62% (0.5591 => 0.5277, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.61% (0.5575 => 0.5262, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: -5.61% (0.7447 => 0.7029, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: -5.60% (0.3194 => 0.3015, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.59% (0.5849 => 0.5522, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.59% (0.6297 => 0.5945, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.59% (0.5925 => 0.5594, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.57% (0.4916 => 0.4642, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.56% (0.6667 => 0.6296, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -5.56% (0.3581 => 0.3382, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.55% (0.6446 => 0.6088, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -5.55% (0.3026 => 0.2858, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.55% (0.5802 => 0.5480, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.54% (0.6230 => 0.5885, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.54% (0.3323 => 0.3139, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.53% (2.1713 => 2.0512, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.53% (0.3255 => 0.3075, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.51% (0.6660 => 0.6293, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.50% (0.6293 => 0.5947, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: -5.48% (0.3446 => 0.3257, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.47% (0.6395 => 0.6045, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.47% (0.2999 => 0.2835, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: -5.47% (0.3621 => 0.3423, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.46% (0.3057 => 0.2890, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -5.46% (0.4248 => 0.4016, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.46% (0.5863 => 0.5543, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.46% (0.5168 => 0.4886, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -5.45% (0.4861 => 0.4596, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -5.45% (0.3394 => 0.3209, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.44% (0.5859 => 0.5540, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.43% (0.5705 => 0.5395, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.43% (0.6260 => 0.5920, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.43% (0.9557 => 0.9038, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.41% (0.2939 => 0.2780, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.40% (0.7198 => 0.6809, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: -5.40% (0.3481 => 0.3293, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.39% (0.5581 => 0.5280, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.39% (0.5805 => 0.5492, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.38% (0.3252 => 0.3077, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -5.38% (3.5154 => 3.3263, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: -5.38% (0.6750 => 0.6387, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.37% (0.2903 => 0.2747, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -5.37% (0.4524 => 0.4281, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/fibo: -5.36% (0.2871 => 0.2717, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -5.36% (2.1401 => 2.0254, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/lists1: -5.35% (0.3867 => 0.3660, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.35% (0.5941 => 0.5623, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.35% (0.6189 => 0.5858, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.35% (0.6676 => 0.6319, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: -5.34% (0.2849 => 0.2697, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.33% (0.4427 => 0.4191, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: -5.33% (1.3864 => 1.3125, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.33% (0.3491 => 0.3305, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.31% (0.5570 => 0.5274, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.31% (0.2278 => 0.2157, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.29% (0.3931 => 0.3723, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.28% (0.5569 => 0.5275, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.27% (0.4083 => 0.3868, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.25% (0.6395 => 0.6059, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.24% (0.6033 => 0.5717, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -5.23% (0.3059 => 0.2899, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -5.22% (0.2989 => 0.2833, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.22% (0.2933 => 0.2780, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: -5.20% (0.3788 => 0.3591, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.19% (0.5567 => 0.5278, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.19% (0.5688 => 0.5393, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.19% (0.6440 => 0.6106, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.17% (0.3016 => 0.2860, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.14% (0.7021 => 0.6660, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -5.09% (0.4515 => 0.4285, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.08% (8.0126 => 7.6058, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.07% (0.2385 => 0.2264, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.07% (0.5329 => 0.5059, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.05% (0.4813 => 0.4570, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.03% (0.2106 => 0.2000, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.03% (0.3319 => 0.3152, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.02% (1.2210 => 1.1597, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -5.01% (15.2527 => 14.4880, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.98% (1.2221 => 1.1612, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/09-vor/vor: -4.98% (0.3271 => 0.3108, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -4.97% (0.7982 => 0.7585, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wc: -4.96% (0.3205 => 0.3046, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.90% (0.3837 => 0.3649, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -4.82% (0.7779 => 0.7404, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: -4.80% (0.8418 => 0.8014, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: -4.79% (5.0226 => 4.7819, std.dev.: 0.0065) SingleSource/UnitTests/ObjC++/Hello: -4.57% (0.6347 => 0.6057, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -4.36% (0.6441 => 0.6160, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -4.13% (1.5610 => 1.4966, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.99% (0.9077 => 0.8715, std.dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -1.84% (20.7746 => 20.3928, std.dev.: 0.0172) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7581, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: -8.74% (1.2842 => 1.1719, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: -4.17% (2.2633 => 2.1690, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7068, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.49% (1.3096 => 1.2639, std.dev.: 0.0105) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.71% (6.5735 => 6.4609, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0004) Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 2 21:20:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 2 Nov 2012 23:20:10 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121103042010.A5E882A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5543?compare_to=5541&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5543, Order: 167348, Start Time: 2012-11-03 02:53:46, End Time: 2012-11-03 04:20:16 To: 5541, Order: 167347, Start Time: 2012-11-03 01:10:36, End Time: 2012-11-03 02:37:04 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 8 (72 on baseline) Performance Improvements: 0 (8 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 983 (894 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.04% (0.5007 => 0.5159, std.dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: 2.66% (8.3428 => 8.5646, std.dev.: 0.0246) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.46% (0.8817 => 0.8946, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.00% (1.1971 => 1.2091, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.75% (1.1107 => 1.1412, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.36% (21.7432 => 22.2554, std.dev.: 0.0585) SingleSource/Benchmarks/Shootout-C++/except: 2.21% (0.4932 => 0.5041, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.93% (40.9482 => 41.7389, std.dev.: 0.2993) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.32% (16.7255 => 16.6713, std.dev.: 0.0440) MultiSource/Applications/obsequi/Obsequi: 1.59% (1.0483 => 1.0650, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.13% (21.6848 => 21.6572, std.dev.: 0.7947) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.49% (0.3646 => 0.3664, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 0.12% (0.6027 => 0.6034, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.36% (0.3335 => 0.3323, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/strcat: -0.25% (0.2004 => 0.1999, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.46% (0.0218 => 0.0217, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.46% (0.0376 => 0.0363, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -23.19% (0.0332 => 0.0255, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -12.50% (0.0312 => 0.0273, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -11.40% (0.0421 => 0.0373, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0202 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -12.96% (0.0216 => 0.0188, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -69.23% (0.0013 => 0.0004, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -0.47% (0.1474 => 0.1467, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.94% (1.1267 => 1.1373, std.dev.: 0.0170) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1484 => 0.1485, std.dev.: 0.0083) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.22% (0.4053 => 0.4044, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.38% (0.1315 => 0.1320, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.50% (0.0642 => 0.0581, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.95% (0.0228 => 0.0237, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.95% (0.0546 => 0.0573, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.11% (1.1419 => 1.1431, std.dev.: 0.0205) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -57.69% (0.0026 => 0.0011, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.50% (0.0641 => 0.0625, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.34% (0.0267 => 0.0194, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.89% (0.8045 => 0.7973, std.dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 40.48% (0.0042 => 0.0059, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2297.13% (0.6332 => 15.1786, std.dev.: 0.0142) MultiSource/Benchmarks/McCat/08-main/main: 47.35% (0.1831 => 0.2698, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.47% (0.1559 => 0.1427, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1484.90% (0.3344 => 5.2999, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.38% (0.2364 => 0.3224, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: 2.10% (0.0429 => 0.0438, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.57% (0.0224 => 0.0232, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3219, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0707, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4919, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3415, std.dev.: 0.0213) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0331, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4059, std.dev.: 0.0077) SingleSource/Regression/C/uint64_to_float: -24.02% (2.1832 => 1.6587, std.dev.: 0.0094) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.79% (0.0810 => 0.0946, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 10.79% (0.1112 => 0.1232, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.51% (0.8321 => 0.8946, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.44% (0.4847 => 0.5159, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.60% (0.2180 => 0.2302, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.42% (0.7473 => 0.7878, std.dev.: 0.0107) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.14% (0.1983 => 0.2085, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.06% (0.6010 => 0.6314, std.dev.: 0.0049) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.75% (0.3137 => 0.3286, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.72% (0.2519 => 0.2638, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.18% (1.1606 => 1.2091, std.dev.: 0.0033) MultiSource/Applications/spiff/spiff: 3.97% (0.7950 => 0.8266, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.89% (0.9435 => 0.9708, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.75% (0.6287 => 0.6460, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.42% (1.4479 => 1.4830, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.41% (1.1685 => 1.1967, std.dev.: 0.0074) MultiSource/Applications/ClamAV/clamscan: 2.21% (14.7684 => 15.0941, std.dev.: 0.0165) MultiSource/Applications/treecc/treecc: 2.19% (1.9948 => 2.0384, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.14% (0.8007 => 0.8178, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.07% (0.8597 => 0.8775, std.dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 1.99% (6.7320 => 6.8662, std.dev.: 0.0517) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.98% (0.9688 => 0.9880, std.dev.: 0.0064) MultiSource/Applications/SIBsim4/SIBsim4: 1.98% (1.2568 => 1.2817, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.98% (0.6227 => 0.6350, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.97% (0.8697 => 0.8868, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.95% (0.8261 => 0.8422, std.dev.: 0.0052) MultiSource/Applications/SPASS/SPASS: 1.91% (14.2605 => 14.5328, std.dev.: 0.0414) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.88% (4.4873 => 4.5716, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.87% (4.1763 => 4.2543, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.86% (4.4880 => 4.5717, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.79% (1.1170 => 1.1370, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.79% (0.8331 => 0.8480, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: 1.74% (8.4179 => 8.5646, std.dev.: 0.0246) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.71% (0.8805 => 0.8956, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.71% (8.6476 => 8.7958, std.dev.: 0.0250) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.68% (0.9056 => 0.9208, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.62% (0.8338 => 0.8473, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.61% (0.8050 => 0.8180, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.56% (0.8286 => 0.8415, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 1.55% (4.1305 => 4.1946, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.53% (0.8086 => 0.8210, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.52% (0.6586 => 0.6686, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.52% (0.8712 => 0.8844, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.45% (0.8204 => 0.8323, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.43% (0.8518 => 0.8640, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.42% (1.6386 => 1.6619, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 1.42% (1.0945 => 1.1100, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.41% (0.8069 => 0.8183, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.40% (0.8855 => 0.8979, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.38% (0.7966 => 0.8076, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.37% (0.9908 => 1.0044, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.36% (0.9039 => 0.9162, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.33% (0.8927 => 0.9046, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.29% (0.8656 => 0.8768, std.dev.: 0.0038) MultiSource/Applications/oggenc/oggenc: 1.27% (4.9628 => 5.0259, std.dev.: 0.0204) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.19% (13.1811 => 13.3378, std.dev.: 0.0161) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 72.36% (0.0199 => 0.0343, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/pi: 58.96% (1.5795 => 2.5108, std.dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 8.33% (3.1873 => 3.4529, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.00% (1.1857 => 1.2806, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.94% (0.3186 => 0.3439, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 4.71% (14.0064 => 14.6663, std.dev.: 0.0048) MultiSource/Benchmarks/sim/sim: 3.20% (3.8206 => 3.9429, std.dev.: 0.0232) SingleSource/Benchmarks/Misc/ReedSolomon: 2.93% (8.5322 => 8.7822, std.dev.: 0.0310) MultiSource/Applications/siod/siod: 2.82% (3.6643 => 3.7678, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/except: 2.44% (0.4921 => 0.5041, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 2.22% (63.1822 => 64.5836, std.dev.: 0.1498) MultiSource/Applications/lambda-0_1_3/lambda: 1.96% (7.4933 => 7.6402, std.dev.: 0.0140) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.80% (28.5821 => 29.0978, std.dev.: 0.0425) MultiSource/Benchmarks/Olden/bh/bh: 1.40% (2.3560 => 2.3890, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.32% (4.8362 => 4.8998, std.dev.: 0.0184) MultiSource/Benchmarks/FreeBench/neural/neural: 1.01% (1.0841 => 1.0951, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -31.36% (0.0338 => 0.0232, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.27% (0.3269 => 0.2966, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: -3.63% (7.3375 => 7.0712, std.dev.: 0.0124) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.22% (2.8773 => 2.7846, std.dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.59% (1.0388 => 1.0119, std.dev.: 0.0104) MultiSource/Applications/lua/lua: -2.35% (29.8330 => 29.1312, std.dev.: 0.0773) SingleSource/Benchmarks/Shootout-C++/hash2: -1.44% (3.4237 => 3.3744, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.21% (3.3479 => 3.3075, std.dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.37% (16.4461 => 16.6713, std.dev.: 0.0440) MultiSource/Applications/obsequi/Obsequi: 3.78% (1.0262 => 1.0650, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6834.74% (0.3123 => 21.6572, std.dev.: 0.7947) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.76% (0.2463 => 0.3664, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 0.40% (0.6010 => 0.6034, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.75% (0.3266 => 0.3323, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/strcat: 1.52% (0.1969 => 0.1999, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -11.03% (0.0408 => 0.0363, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.39% (0.0254 => 0.0255, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -9.60% (0.0302 => 0.0273, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.86% (0.0384 => 0.0373, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 4.44% (0.0180 => 0.0188, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -42.86% (0.0007 => 0.0004, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 2.02% (0.1438 => 0.1467, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.39% (1.1329 => 1.1373, std.dev.: 0.0170) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 1.57% (0.1462 => 0.1485, std.dev.: 0.0083) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.88% (0.4164 => 0.4044, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.58% (0.1369 => 0.1320, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.36% (0.0641 => 0.0581, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 21.54% (0.0195 => 0.0237, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.87% (0.0578 => 0.0573, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.05% (1.1437 => 1.1431, std.dev.: 0.0205) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -21.43% (0.0014 => 0.0011, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.32% (0.0627 => 0.0625, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.78% (0.0180 => 0.0194, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.55% (0.8017 => 0.7973, std.dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -4.84% (0.0062 => 0.0059, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 2 21:46:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 2 Nov 2012 23:46:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121103044654.28D552A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5544?compare_to=5542&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5544, Order: 167352, Start Time: 2012-11-03 03:21:54, End Time: 2012-11-03 04:46:57 To: 5542, Order: 167348, Start Time: 2012-11-03 01:28:55, End Time: 2012-11-03 02:53:55 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (6 on baseline) Performance Improvements: 0 (180 on baseline) Unchanged Tests: 1040 (856 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 8.52% (0.3744 => 0.4063, std.dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.30% (78.2669 => 80.0704, std.dev.: 0.6132) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 5.97% (0.3834 => 0.4063, std.dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.71% (2.0478 => 2.1033, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/salsa20: 2.25% (7.4937 => 7.6624, std.dev.: 0.0176) SingleSource/Benchmarks/Shootout-C++/hash2: 2.19% (3.1932 => 3.2631, std.dev.: 0.0011) MultiSource/Benchmarks/llubenchmark/llu: 1.09% (3.7435 => 3.7843, std.dev.: 0.0154) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.74% (0.1431 => 0.1306, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.56% (0.3821 => 0.3532, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -7.21% (2.4924 => 2.3126, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.84% (0.2428 => 0.2262, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.79% (3.5339 => 3.2941, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.69% (0.9542 => 0.8904, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.68% (0.3142 => 0.2932, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.63% (22.4056 => 20.9194, std.dev.: 0.0170) MultiSource/Benchmarks/MallocBench/gs/gs: -6.62% (4.3330 => 4.0461, std.dev.: 0.0081) MultiSource/Applications/sgefa/sgefa: -6.61% (0.3357 => 0.3135, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.56% (0.3658 => 0.3418, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -6.41% (16.1920 => 15.1536, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.39% (1.0544 => 0.9870, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -6.34% (1.2515 => 1.1722, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: -6.30% (0.2160 => 0.2024, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.26% (0.9852 => 0.9235, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -6.24% (7.0961 => 6.6532, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/football/football: -6.23% (0.9179 => 0.8607, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.22% (1.6474 => 1.5449, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -6.22% (1.1450 => 1.0738, std.dev.: 0.0143) MultiSource/Benchmarks/mafft/pairlocalalign: -6.20% (9.2283 => 8.6565, std.dev.: 0.0169) SingleSource/Benchmarks/McGill/chomp: -6.19% (0.1761 => 0.1652, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -6.18% (2.4021 => 2.2537, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.15% (0.6484 => 0.6085, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.14% (1.4642 => 1.3743, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.12% (0.2548 => 0.2392, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.07% (0.1796 => 0.1687, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.06% (4.5069 => 4.2338, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.05% (1.2784 => 1.2010, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.03% (1.3722 => 1.2895, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.02% (1.2300 => 1.1559, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: -6.02% (0.2659 => 0.2499, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.01% (1.6364 => 1.5380, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.99% (4.0323 => 3.7908, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.97% (5.4682 => 5.1419, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.94% (4.8161 => 4.5302, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.91% (0.6293 => 0.5921, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.90% (0.2355 => 0.2216, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.90% (0.2695 => 0.2536, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.88% (0.6736 => 0.6340, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.86% (0.3483 => 0.3279, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.85% (0.7919 => 0.7456, std.dev.: 0.0009) MultiSource/Applications/lua/lua: -5.84% (4.0594 => 3.8222, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.83% (14.2083 => 13.3796, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.82% (4.8802 => 4.5962, std.dev.: 0.0097) MultiSource/Applications/minisat/minisat: -5.79% (0.7447 => 0.7016, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: -5.78% (15.5079 => 14.6114, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.77% (0.5857 => 0.5519, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.76% (0.2985 => 0.2813, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -5.75% (17.1032 => 16.1196, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.75% (2.2587 => 2.1289, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.73% (0.6304 => 0.5943, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.73% (0.3406 => 0.3211, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.72% (0.3880 => 0.3658, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.72% (0.6052 => 0.5706, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.71% (0.4151 => 0.3914, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -5.70% (0.4033 => 0.3803, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.70% (0.5999 => 0.5657, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -5.70% (0.3581 => 0.3377, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: -5.69% (0.3831 => 0.3613, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.69% (6.7716 => 6.3863, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.69% (0.5925 => 0.5588, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.69% (0.5802 => 0.5472, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.68% (0.7524 => 0.7097, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -5.67% (0.3896 => 0.3675, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.67% (0.6297 => 0.5940, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -5.67% (0.3812 => 0.3596, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -5.66% (0.7982 => 0.7530, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.66% (0.6681 => 0.6303, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -5.65% (0.4176 => 0.3940, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -5.65% (1.1530 => 1.0879, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/property: -5.64% (0.4199 => 0.3962, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.64% (0.5478 => 0.5169, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -5.64% (0.3848 => 0.3631, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -5.61% (1.3148 => 1.2411, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.60% (0.3891 => 0.3673, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.60% (0.7339 => 0.6928, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.60% (0.5591 => 0.5278, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.60% (0.5575 => 0.5263, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.58% (0.6446 => 0.6086, std.dev.: 0.0057) MultiSource/Applications/kimwitu++/kc: -5.58% (18.2933 => 17.2733, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.57% (0.5705 => 0.5387, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.57% (0.2999 => 0.2832, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.56% (0.5849 => 0.5524, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.55% (0.6667 => 0.6297, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.54% (0.6194 => 0.5851, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.53% (0.6660 => 0.6292, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.52% (0.6230 => 0.5886, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.52% (0.6395 => 0.6042, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.51% (0.5859 => 0.5536, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -5.50% (1.3864 => 1.3102, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.49% (0.5863 => 0.5541, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.49% (0.5941 => 0.5615, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.49% (0.2278 => 0.2153, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.48% (0.3884 => 0.3671, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.48% (0.5168 => 0.4885, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.47% (0.4916 => 0.4647, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.47% (0.6033 => 0.5703, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.47% (0.8521 => 0.8055, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.46% (0.5456 => 0.5158, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: -5.45% (3.5154 => 3.3237, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.44% (0.5805 => 0.5489, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.42% (0.5570 => 0.5268, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -5.41% (34.0927 => 32.2482, std.dev.: 0.0153) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.40% (0.3849 => 0.3641, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.40% (0.6260 => 0.5922, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.39% (0.5581 => 0.5280, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -5.39% (0.4861 => 0.4599, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -5.39% (0.3025 => 0.2862, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.37% (0.5569 => 0.5270, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.35% (0.5567 => 0.5269, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -5.35% (0.4280 => 0.4051, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.35% (0.6676 => 0.6319, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -5.34% (2.1401 => 2.0258, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.33% (0.3323 => 0.3146, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.33% (0.6440 => 0.6097, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -5.32% (0.4515 => 0.4275, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.31% (0.9557 => 0.9050, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.29% (0.4083 => 0.3867, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: -5.29% (0.3026 => 0.2866, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -5.28% (0.3446 => 0.3264, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.28% (8.0126 => 7.5896, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.28% (0.4321 => 0.4093, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.25% (0.6395 => 0.6059, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -5.25% (0.2989 => 0.2832, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.24% (0.3491 => 0.3308, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.24% (0.5688 => 0.5390, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.24% (0.6189 => 0.5865, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.23% (0.7021 => 0.6654, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -5.22% (0.3394 => 0.3217, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.19% (0.3255 => 0.3086, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.18% (2.1713 => 2.0589, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.17% (0.3016 => 0.2860, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.17% (0.3194 => 0.3029, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.16% (0.2385 => 0.2262, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -5.16% (0.6750 => 0.6402, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: -5.16% (0.4248 => 0.4029, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.16% (1.2221 => 1.1591, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: -5.15% (0.2871 => 0.2723, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.15% (1.2210 => 1.1581, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -5.14% (0.3481 => 0.3302, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.13% (0.4427 => 0.4200, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.11% (0.7198 => 0.6830, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: -5.11% (0.3271 => 0.3104, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -5.11% (15.2527 => 14.4740, std.dev.: 0.0207) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.10% (0.3252 => 0.3086, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.10% (0.3057 => 0.2901, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.09% (0.5329 => 0.5058, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.08% (0.2933 => 0.2784, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.06% (0.3931 => 0.3732, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -5.05% (0.3205 => 0.3043, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -5.05% (0.2849 => 0.2705, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.03% (0.2106 => 0.2000, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.00% (0.3319 => 0.3153, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: -4.96% (0.3788 => 0.3600, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -4.92% (0.8418 => 0.8004, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.90% (0.4813 => 0.4577, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.89% (0.2903 => 0.2761, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.89% (0.3867 => 0.3678, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -4.84% (0.3059 => 0.2911, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -4.81% (0.3621 => 0.3447, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.74% (0.3837 => 0.3655, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -4.73% (5.0226 => 4.7851, std.dev.: 0.0044) SingleSource/UnitTests/ObjC++/property-reference: -4.47% (0.7779 => 0.7431, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: -4.47% (0.4524 => 0.4322, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.24% (0.9077 => 0.8692, std.dev.: 0.0058) SingleSource/UnitTests/ObjC++/Hello: -4.22% (0.6347 => 0.6079, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -4.21% (0.6441 => 0.6170, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -4.13% (1.5610 => 1.4965, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -1.94% (20.7746 => 20.3715, std.dev.: 0.0303) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7503, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/richards_benchmark: -8.68% (1.2842 => 1.1727, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.90% (2.2633 => 2.1750, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.76% (1.3096 => 1.2603, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0245, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.47% (6.5735 => 6.4771, std.dev.: 0.0027) Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 2 23:03:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 3 Nov 2012 01:03:41 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121103060341.579122A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5545?compare_to=5543&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5545, Order: 167353, Start Time: 2012-11-03 04:37:27, End Time: 2012-11-03 06:03:46 To: 5543, Order: 167348, Start Time: 2012-11-03 02:53:46, End Time: 2012-11-03 04:20:16 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 9 (49 on baseline) Performance Improvements: 3 (6 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 979 (919 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.59% (0.8193 => 0.8651, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.33% (0.2119 => 0.2232, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.84% (0.2976 => 0.3120, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.01% (4.5604 => 4.6521, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.75% (0.5895 => 0.5998, std.dev.: 0.0030) MultiSource/Applications/lua/lua: 1.07% (3.8687 => 3.9100, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 12.41% (0.7722 => 0.8680, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.63% (1.2434 => 1.2637, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/richards_benchmark: 1.35% (1.2998 => 1.3174, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Ptrdist/bc/bc: -1.00% (1.1370 => 1.1256, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -5.25% (4.0667 => 3.8533, std.dev.: 0.0743) SingleSource/Benchmarks/Shootout-C++/except: -3.19% (0.5041 => 0.4880, std.dev.: 0.0051) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.76% (16.6713 => 16.5443, std.dev.: 0.0491) MultiSource/Applications/obsequi/Obsequi: -0.24% (1.0650 => 1.0624, std.dev.: 0.0072) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.99% (21.6572 => 21.4431, std.dev.: 0.5663) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.72% (0.3664 => 0.3601, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/bigfib: -0.76% (0.6034 => 0.5988, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.33% (0.3323 => 0.3334, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/strcat: 0.35% (0.1999 => 0.2006, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -28.11% (0.0217 => 0.0156, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 17.36% (0.0363 => 0.0426, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 16.86% (0.0255 => 0.0298, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 17.22% (0.0273 => 0.0320, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 14.21% (0.0373 => 0.0426, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 0.99% (0.0202 => 0.0204, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 7.98% (0.0188 => 0.0203, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -75.00% (0.0004 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.36% (0.1467 => 0.1487, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.73% (1.1373 => 1.1176, std.dev.: 0.0274) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.98% (0.1485 => 0.1411, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.89% (0.4044 => 0.4008, std.dev.: 0.0174) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.26% (0.1320 => 0.1363, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.61% (0.0581 => 0.0560, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 10.97% (0.0237 => 0.0263, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.62% (0.0573 => 0.0558, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.23% (1.1431 => 1.1457, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 63.64% (0.0011 => 0.0018, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.84% (0.0625 => 0.0551, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.55% (0.0194 => 0.0191, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.04% (0.7973 => 0.7970, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -8.47% (0.0059 => 0.0054, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2284.79% (0.6332 => 15.1005, std.dev.: 0.3118) MultiSource/Benchmarks/McCat/08-main/main: 46.81% (0.1831 => 0.2688, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.90% (0.1559 => 0.1467, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1472.40% (0.3344 => 5.2581, std.dev.: 0.0324) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.59% (0.2364 => 0.3229, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.36% (0.0224 => 0.0236, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -26.09% (0.0230 => 0.0170, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3207, std.dev.: 0.0214) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0680, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4953, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3417, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0239, std.dev.: 0.0461) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4021, std.dev.: 0.0027) SingleSource/Regression/C/uint64_to_float: -24.04% (2.1832 => 1.6584, std.dev.: 0.0068) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.80% (0.0810 => 0.0938, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 11.87% (0.1112 => 0.1244, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.12% (0.2279 => 0.2464, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.49% (0.3137 => 0.3372, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.39% (0.4847 => 0.5205, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.34% (0.2180 => 0.2340, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.44% (0.6010 => 0.6397, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.17% (0.8148 => 0.8651, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.46% (0.1905 => 0.2009, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.07% (0.2998 => 0.3120, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.07% (1.1606 => 1.2078, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.07% (0.3295 => 0.3429, std.dev.: 0.0032) MultiSource/Applications/Burg/burg: 3.62% (1.2222 => 1.2664, std.dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.58% (0.4783 => 0.4954, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.53% (0.6287 => 0.6509, std.dev.: 0.0048) MultiSource/Applications/spiff/spiff: 3.47% (0.7950 => 0.8226, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.23% (1.1685 => 1.2063, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.11% (0.5817 => 0.5998, std.dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.57% (6.6074 => 6.7770, std.dev.: 0.0227) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.42% (4.1763 => 4.2775, std.dev.: 0.0194) MultiSource/Applications/lua/lua: 2.39% (3.8189 => 3.9100, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.30% (4.4873 => 4.5905, std.dev.: 0.0232) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.27% (1.4479 => 1.4808, std.dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: 2.24% (14.7684 => 15.0991, std.dev.: 0.0555) MultiSource/Applications/SIBsim4/SIBsim4: 2.05% (1.2568 => 1.2826, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/gs/gs: 1.98% (4.1305 => 4.2122, std.dev.: 0.0168) MultiSource/Applications/treecc/treecc: 1.93% (1.9948 => 2.0332, std.dev.: 0.0125) MultiSource/Benchmarks/nbench/nbench: 1.87% (1.1271 => 1.1482, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.79% (4.5702 => 4.6521, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.78% (1.3279 => 1.3516, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 1.63% (0.9810 => 0.9970, std.dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 1.61% (6.7320 => 6.8406, std.dev.: 0.0300) MultiSource/Applications/SPASS/SPASS: 1.57% (14.2605 => 14.4845, std.dev.: 0.0778) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.43% (1.6386 => 1.6620, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.12% (4.4880 => 4.5383, std.dev.: 0.0162) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 57.79% (0.0199 => 0.0314, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/pi: 57.28% (1.5795 => 2.4842, std.dev.: 0.0112) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.02% (14.6451 => 16.2585, std.dev.: 0.1714) MultiSource/Applications/SIBsim4/SIBsim4: 8.13% (3.1873 => 3.4463, std.dev.: 0.0187) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.02% (1.1857 => 1.2808, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 4.78% (14.0064 => 14.6763, std.dev.: 0.1067) MultiSource/Benchmarks/sim/sim: 2.94% (3.8206 => 3.9331, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/ReedSolomon: 2.86% (8.5322 => 8.7761, std.dev.: 0.0255) MultiSource/Applications/siod/siod: 2.61% (3.6643 => 3.7599, std.dev.: 0.0146) MultiSource/Applications/lambda-0_1_3/lambda: 2.01% (7.4933 => 7.6440, std.dev.: 0.0349) MultiSource/Benchmarks/mafft/pairlocalalign: 1.98% (63.1822 => 64.4323, std.dev.: 0.2099) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.73% (28.5821 => 29.0753, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.18% (6.3772 => 6.4524, std.dev.: 0.0231) SingleSource/Benchmarks/Misc/richards_benchmark: 1.05% (1.3037 => 1.3174, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.55% (0.3269 => 0.3055, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -3.96% (7.3375 => 7.0469, std.dev.: 0.0294) MultiSource/Applications/lua/lua: -2.60% (29.8330 => 29.0570, std.dev.: 0.1227) MultiSource/Benchmarks/Olden/bisort/bisort: -2.40% (0.6636 => 0.6477, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: -1.45% (3.4237 => 3.3741, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.32% (3.3479 => 3.3038, std.dev.: 0.0021) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.60% (16.4461 => 16.5443, std.dev.: 0.0491) MultiSource/Applications/obsequi/Obsequi: 3.53% (1.0262 => 1.0624, std.dev.: 0.0072) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6766.19% (0.3123 => 21.4431, std.dev.: 0.5663) SingleSource/Benchmarks/CoyoteBench/fftbench: 46.20% (0.2463 => 0.3601, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/bigfib: -0.37% (0.6010 => 0.5988, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.08% (0.3266 => 0.3334, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/strcat: 1.88% (0.1969 => 0.2006, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 26.83% (0.0123 => 0.0156, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 17.32% (0.0254 => 0.0298, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.96% (0.0302 => 0.0320, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.94% (0.0384 => 0.0426, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 12.78% (0.0180 => 0.0203, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 3.41% (0.1438 => 0.1487, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.35% (1.1329 => 1.1176, std.dev.: 0.0274) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.49% (0.1462 => 0.1411, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.75% (0.4164 => 0.4008, std.dev.: 0.0174) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.44% (0.1369 => 0.1363, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -12.64% (0.0641 => 0.0560, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 34.87% (0.0195 => 0.0263, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.46% (0.0578 => 0.0558, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.17% (1.1437 => 1.1457, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 28.57% (0.0014 => 0.0018, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.12% (0.0627 => 0.0551, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.11% (0.0180 => 0.0191, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.59% (0.8017 => 0.7970, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -12.90% (0.0062 => 0.0054, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 2 23:04:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 3 Nov 2012 01:04:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121103060434.69EB82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5546?compare_to=5540&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5546, Order: 167348, Start Time: 2012-11-03 02:49:13, End Time: 2012-11-03 06:04:39 To: 5540, Order: 167324, Start Time: 2012-11-02 22:45:00, End Time: 2012-11-03 02:00:49 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (171 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (718 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.12% (54.3033 => 54.9089, std.dev.: 0.0821) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: -9.09% (0.2287 => 0.2079, std.dev.: 0.0063) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.36% (0.0625 => 0.0871, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.76% (0.1063 => 0.1390, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.13% (0.2969 => 0.3715, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.97% (0.4253 => 0.5315, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.86% (0.1106 => 0.1381, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.63% (0.0475 => 0.0592, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 23.70% (0.4139 => 0.5120, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.67% (0.0714 => 0.0883, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 23.37% (1.5932 => 1.9656, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.93% (0.4994 => 0.6139, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.61% (0.5900 => 0.7234, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.36% (0.5000 => 0.6118, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.26% (0.0584 => 0.0714, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.10% (0.1620 => 0.1978, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.96% (0.0897 => 0.1094) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 21.76% (0.0547 => 0.0666, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 20.76% (0.1021 => 0.1233, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 20.70% (0.0599 => 0.0723, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 20.36% (0.0604 => 0.0727, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.14% (0.1107 => 0.1330, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 19.73% (0.0948 => 0.1135, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 19.67% (0.0605 => 0.0724, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.59% (0.0541 => 0.0647, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.43% (0.0633 => 0.0756, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.42% (0.3903 => 0.4661, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.33% (0.1604 => 0.1914, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.31% (0.0642 => 0.0766, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.31% (0.1103 => 0.1316, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.18% (0.0584 => 0.0696, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.11% (0.1549 => 0.1845, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 18.96% (0.1619 => 0.1926, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.94% (0.1003 => 0.1193, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 18.88% (0.0821 => 0.0976, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.61% (0.0822 => 0.0975, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 18.36% (0.0561 => 0.0664, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 18.33% (0.5826 => 0.6894, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 18.20% (0.5889 => 0.6961, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.99% (0.1462 => 0.1725, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 17.95% (0.0947 => 0.1117, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 17.82% (0.0808 => 0.0952, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.71% (0.3890 => 0.4579, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.31% (1.3152 => 1.5429, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 17.24% (0.1218 => 0.1428, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.23% (0.2014 => 0.2361, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 17.14% (0.1505 => 0.1763, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.13% (0.2866 => 0.3357, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 16.95% (0.4029 => 0.4712, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 16.82% (0.1088 => 0.1271, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 16.62% (0.0698 => 0.0814, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 16.59% (0.2736 => 0.3190, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 16.47% (1.8794 => 2.1890, std.dev.: 0.0033) SingleSource/Regression/C++/ofstream_ctor: 16.44% (0.3004 => 0.3498, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 16.41% (0.5546 => 0.6456, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.40% (0.4658 => 0.5422, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.21% (0.2875 => 0.3341, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.21% (3.5627 => 4.1401, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.16% (0.1968 => 0.2286, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.04% (0.5026 => 0.5832, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.86% (0.1160 => 0.1344, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 15.80% (0.7171 => 0.8304, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.78% (0.2738 => 0.3170, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.74% (0.3271 => 0.3786, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 15.73% (1.0781 => 1.2477, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.73% (1.6211 => 1.8761, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 15.59% (0.9697 => 1.1209, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/except: 15.51% (0.2811 => 0.3247, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 15.49% (0.2725 => 0.3147, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 15.48% (0.2803 => 0.3237, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/18-imp/imp: 15.48% (0.1421 => 0.1641, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.47% (4.4195 => 5.1031, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/strcat: 15.38% (0.2750 => 0.3173, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.34% (0.3195 => 0.3685, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 15.29% (0.2714 => 0.3129, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.28% (0.2729 => 0.3146, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.27% (0.4361 => 0.5027, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 15.22% (0.2780 => 0.3203, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 15.20% (0.2823 => 0.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 15.18% (0.2813 => 0.3240, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.04% (0.2792 => 0.3212, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 15.04% (0.9909 => 1.1399, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wc: 14.95% (0.3096 => 0.3559, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 14.94% (0.2075 => 0.2385, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.88% (2.0673 => 2.3750, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.87% (0.2911 => 0.3344, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 14.81% (23.5202 => 27.0042, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: 14.80% (0.1284 => 0.1474, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 14.80% (4.2109 => 4.8340, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.78% (0.3930 => 0.4511, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.70% (1.9966 => 2.2902, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.69% (1.9694 => 2.2588, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 14.69% (0.2566 => 0.2943, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 14.65% (0.3317 => 0.3803, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary3: 14.57% (0.3267 => 0.3743, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.42% (2.7292 => 3.1227, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.40% (0.1090 => 0.1247, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary: 14.36% (0.3258 => 0.3726, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.16% (0.3362 => 0.3838, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.15% (0.3060 => 0.3493, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.15% (0.3845 => 0.4389, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.96% (0.3124 => 0.3560, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.88% (0.3625 => 0.4128, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/moments: 13.84% (0.3678 => 0.4187, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 13.82% (0.4146 => 0.4719, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.66% (0.3690 => 0.4194, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 13.65% (0.3348 => 0.3805, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.50% (0.3282 => 0.3725, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 13.42% (0.3726 => 0.4226, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 13.41% (1.4269 => 1.6183, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: 13.40% (0.3477 => 0.3943, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 13.27% (0.4251 => 0.4815, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.21% (0.3981 => 0.4507, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 12.95% (2.1653 => 2.4458, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 12.85% (0.7875 => 0.8887, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/for-in: 12.53% (0.3496 => 0.3934, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 12.51% (0.5012 => 0.5639, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 12.49% (4.6177 => 5.1945, std.dev.: 0.0108) SingleSource/UnitTests/ObjC/exceptions-2: 12.45% (0.3446 => 0.3875, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.44% (0.3488 => 0.3922, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.38% (0.3465 => 0.3894, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.38% (0.3442 => 0.3868, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-3: 12.34% (0.3460 => 0.3887, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.34% (0.3469 => 0.3897, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.22% (0.1383 => 0.1552, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.21% (0.2040 => 0.2289, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 12.05% (0.3650 => 0.4090, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 12.02% (0.3643 => 0.4081, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.98% (0.3724 => 0.4170, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 11.85% (2.1013 => 2.3502, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.64% (0.6435 => 0.7184, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 11.63% (0.2691 => 0.3004, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 11.02% (5.5417 => 6.1523, std.dev.: 0.0055) MultiSource/Applications/lambda-0_1_3/lambda: 10.83% (0.3498 => 0.3877, std.dev.: 0.0037) MultiSource/Benchmarks/PAQ8p/paq8p: 10.71% (0.4847 => 0.5366, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.41% (0.1028 => 0.1135, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.30% (0.2737 => 0.3019, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.15% (0.2068 => 0.2278, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 10.14% (0.6634 => 0.7307, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 9.83% (0.3336 => 0.3664, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.79% (0.3084 => 0.3386, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 9.28% (2.0346 => 2.2235, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.18% (0.2103 => 0.2296, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 9.12% (0.2391 => 0.2609, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.68% (4.6926 => 5.0998, std.dev.: 0.0098) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.59% (11.6398 => 12.6394, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.87% (0.5361 => 0.5783, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.72% (0.5584 => 0.6015, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.16% (0.7426 => 0.7958, std.dev.: 0.0044) MultiSource/Applications/kimwitu++/kc: 6.44% (11.9555 => 12.7254, std.dev.: 0.0154) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.22% (0.3792 => 0.3914, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6532, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 9.28% (0.2802 => 0.3062, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6092, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6687, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1640, std.dev.: 0.0163) SingleSource/Benchmarks/Misc/flops-2: 4.23% (1.8057 => 1.8820, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.12% (0.3693 => 0.3845, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/dry: 2.60% (14.0481 => 14.4132, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1964, std.dev.: 0.0090) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2229, std.dev.: 0.0028) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3060, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2885, std.dev.: 0.0036) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.24% (1.0142 => 1.0268, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5150, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5819, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.66% (25.4195 => 16.3555, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/ary2: -9.37% (0.2402 => 0.2177, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9773, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.69% (35.5013 => 32.7718, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/tsp/tsp: -7.21% (2.1113 => 1.9590, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2421, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.29% (11.2080 => 10.8392, std.dev.: 0.0157) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0050) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7742, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5217, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -2.53% (17.2379 => 16.8017, std.dev.: 0.0642) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.18% (41.7953 => 40.8847, std.dev.: 0.0240) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5730, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: -1.55% (5.5810 => 5.4944, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.25% (21.9346 => 21.6595, std.dev.: 0.0664) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0406, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.08% (3.3991 => 3.3625, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.04% (105.3826 => 104.2911, std.dev.: 0.0430) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 2 23:35:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 3 Nov 2012 01:35:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121103063512.445E12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5547?compare_to=5544&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5547, Order: 167353, Start Time: 2012-11-03 05:10:16, End Time: 2012-11-03 06:35:16 To: 5544, Order: 167352, Start Time: 2012-11-03 03:21:54, End Time: 2012-11-03 04:46:57 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (180 on baseline) Unchanged Tests: 1042 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 2.64% (7.4937 => 7.6913, std.dev.: 0.0172) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1008, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.02% (3.1932 => 3.2578, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.46% (0.1431 => 0.1310) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.75% (0.3821 => 0.3525, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -7.15% (2.4924 => 2.3142, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.78% (22.4056 => 20.8871, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.71% (3.5339 => 3.2966, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.71% (0.2428 => 0.2265, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.59% (0.3142 => 0.2935, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -6.58% (0.3357 => 0.3136, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.53% (0.3658 => 0.3419, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.50% (0.1584 => 0.1481, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.45% (0.9542 => 0.8927, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -6.35% (4.3330 => 4.0577, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: -6.28% (16.1920 => 15.1757, std.dev.: 0.0043) MultiSource/Applications/JM/ldecod/ldecod: -6.21% (7.0961 => 6.6552, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.17% (1.6474 => 1.5457, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -6.14% (1.2515 => 1.1747, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.13% (1.0544 => 0.9898, std.dev.: 0.0056) MultiSource/Applications/lemon/lemon: -6.10% (1.1450 => 1.0751, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -6.09% (2.4021 => 2.2559, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.08% (0.6484 => 0.6090, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.07% (0.9852 => 0.9254, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -6.07% (0.9179 => 0.8622, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.06% (0.1716 => 0.1612, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: -6.06% (9.2283 => 8.6692, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.05% (1.2784 => 1.2011, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/trivial-interface: -6.03% (0.3812 => 0.3582, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.01% (5.4682 => 5.1396, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.00% (0.2548 => 0.2395, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -5.98% (0.3831 => 0.3602, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.98% (1.4642 => 1.3767, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -5.96% (0.1761 => 0.1656, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -5.96% (0.1879 => 0.1767, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.96% (0.1796 => 0.1689, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -5.95% (0.3880 => 0.3649, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.94% (0.7919 => 0.7449, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.91% (0.3891 => 0.3661, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.91% (1.3722 => 1.2911, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: -5.90% (0.2659 => 0.2502, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.90% (0.3896 => 0.3666, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.89% (1.6364 => 1.5400, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-3: -5.87% (0.3848 => 0.3622, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.87% (0.3884 => 0.3656, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.86% (0.2695 => 0.2537, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.86% (1.2300 => 1.1579, std.dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: -5.85% (1.1530 => 1.0855, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: -5.85% (0.4033 => 0.3797, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.85% (4.0323 => 3.7965, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions: -5.84% (0.4176 => 0.3932, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.84% (4.5069 => 4.2439, std.dev.: 0.0126) SingleSource/UnitTests/ObjC/property: -5.83% (0.4199 => 0.3954, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.83% (0.4151 => 0.3909, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.81% (0.5857 => 0.5517, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.79% (4.8161 => 4.5372, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/oourafft: -5.79% (0.2160 => 0.2035, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -5.79% (15.5079 => 14.6105, std.dev.: 0.0192) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.77% (0.2355 => 0.2219, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.77% (0.6293 => 0.5930, std.dev.: 0.0015) MultiSource/Applications/lua/lua: -5.77% (4.0594 => 3.8253, std.dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.76% (0.6736 => 0.6348, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.74% (0.6304 => 0.5942, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.74% (0.5591 => 0.5270, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.72% (4.8802 => 4.6011, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.71% (0.7339 => 0.6920, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.70% (0.6681 => 0.6300, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -5.70% (0.4280 => 0.4036, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.70% (0.5478 => 0.5166, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.68% (0.6667 => 0.6288, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -5.67% (0.3406 => 0.3213, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.67% (0.6230 => 0.5877, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.66% (0.7524 => 0.7098, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.65% (0.6052 => 0.5710, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.64% (14.2083 => 13.4076, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.63% (0.6194 => 0.5845, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -5.62% (17.1032 => 16.1412, std.dev.: 0.0085) MultiSource/Applications/kimwitu++/kc: -5.58% (18.2933 => 17.2732, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.57% (2.2587 => 2.1328, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.55% (0.5941 => 0.5611, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.55% (0.6446 => 0.6088, std.dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: -5.55% (1.3148 => 1.2418, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.55% (0.5859 => 0.5534, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.55% (6.7716 => 6.3960, std.dev.: 0.0095) MultiSource/Applications/minisat/minisat: -5.55% (0.7447 => 0.7034, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.54% (0.6676 => 0.6306, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.54% (0.3483 => 0.3290, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.53% (0.6260 => 0.5914, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.51% (0.6297 => 0.5950, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.51% (0.5849 => 0.5527, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.50% (0.5456 => 0.5156, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.50% (0.6440 => 0.6086, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.49% (0.5575 => 0.5269, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -5.49% (0.3025 => 0.2859, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.49% (0.4083 => 0.3859, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.45% (0.6033 => 0.5704, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.45% (0.5581 => 0.5277, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -5.45% (0.3581 => 0.3386, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -5.44% (0.7982 => 0.7548, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.43% (0.5802 => 0.5487, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -5.43% (0.2985 => 0.2823, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.42% (0.5570 => 0.5268, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.41% (0.4916 => 0.4650, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -5.41% (0.4861 => 0.4598, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -5.41% (3.5154 => 3.3253, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.41% (0.5863 => 0.5546, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.40% (0.3849 => 0.3641, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.40% (0.5999 => 0.5675, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.40% (0.5925 => 0.5605, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.40% (0.5168 => 0.4889, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.38% (0.6395 => 0.6051, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.36% (0.5705 => 0.5399, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -5.36% (0.6750 => 0.6388, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.36% (0.9557 => 0.9045, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -5.35% (0.3026 => 0.2864, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -5.35% (0.2989 => 0.2829, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -5.33% (0.3394 => 0.3213, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.33% (0.8521 => 0.8067, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.33% (0.3323 => 0.3146, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.32% (0.4321 => 0.4091, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -5.32% (0.4248 => 0.4022, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.31% (0.3255 => 0.3082, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: -5.31% (0.3446 => 0.3263, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.30% (0.2999 => 0.2840, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.29% (0.2871 => 0.2719, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -5.29% (0.3194 => 0.3025, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.29% (0.6395 => 0.6057, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.29% (0.6660 => 0.6308, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.27% (0.5805 => 0.5499, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.27% (0.3057 => 0.2896, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.26% (0.5567 => 0.5274, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.25% (2.1713 => 2.0572, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -5.25% (34.0927 => 32.3043, std.dev.: 0.0105) MultiSource/Applications/treecc/treecc: -5.24% (2.1401 => 2.0279, std.dev.: 0.0040) MultiSource/Applications/SIBsim4/SIBsim4: -5.24% (1.3864 => 1.3138, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.23% (0.5569 => 0.5278, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.22% (0.2278 => 0.2159, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/random: -5.21% (0.2939 => 0.2786, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -5.20% (0.3481 => 0.3300, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.18% (0.3491 => 0.3310, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.17% (0.4427 => 0.4198, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -5.16% (0.3621 => 0.3434, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: -5.15% (0.3867 => 0.3668, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.13% (0.2903 => 0.2754, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -5.12% (0.2849 => 0.2703, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: -5.09% (0.4515 => 0.4285, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.09% (0.5329 => 0.5058, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.08% (0.7198 => 0.6832, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.08% (0.7021 => 0.6664, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.08% (1.2221 => 1.1600, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.08% (0.2933 => 0.2784, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.07% (8.0126 => 7.6063, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/sieve: -5.04% (0.3788 => 0.3597, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.04% (0.3016 => 0.2864, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.04% (1.2210 => 1.1595, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/wc: -5.02% (0.3205 => 0.3044, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.99% (0.5688 => 0.5404, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.99% (0.2385 => 0.2266, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: -4.97% (0.3059 => 0.2907, std.dev.: 0.0045) MultiSource/Applications/ClamAV/clamscan: -4.96% (15.2527 => 14.4955, std.dev.: 0.0203) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.94% (0.3931 => 0.3737, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.92% (0.4813 => 0.4576, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.92% (0.3252 => 0.3092, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.85% (0.3837 => 0.3651, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: -4.83% (0.3271 => 0.3113, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -4.81% (5.0226 => 4.7810, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: -4.80% (0.4524 => 0.4307, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.80% (0.2106 => 0.2005, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: -4.74% (0.8418 => 0.8019, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.73% (0.3319 => 0.3162, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: -4.52% (0.6347 => 0.6060, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.33% (0.6441 => 0.6162, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -4.26% (0.7779 => 0.7448, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.19% (0.9077 => 0.8697, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: -3.96% (1.5610 => 1.4992, std.dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -2.21% (20.7746 => 20.3164, std.dev.: 0.0342) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7539, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -8.70% (1.2842 => 1.1725, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7069, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.68% (2.2633 => 2.1799, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4714, std.dev.: 0.0030) Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 3 01:38:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 3 Nov 2012 03:38:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121103083840.B82772A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5548?compare_to=5529&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5548, Order: 167295, Start Time: 2012-11-02 16:06:55, End Time: 2012-11-03 08:38:42 To: 5529, Order: 167260, Start Time: 2012-11-01 23:05:18, End Time: 2012-11-02 15:36:41 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (34 on baseline) New Passes: 0 (12 on baseline) Performance Regressions: 3 (173 on baseline) Performance Improvements: 23 (38 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 41 (7 on baseline) Unchanged Tests: 975 (644 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.61% (54.6231 => 56.5973, std.dev.: 0.0943) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.84% (1.2880 => 1.3117, std.dev.: 0.0039) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.12% (1.5760 => 1.5936, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.20% (0.5830 => 0.5702, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -1.72% (11.2139 => 11.0208, std.dev.: 0.0126) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.69% (0.7200 => 0.7078, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.67% (0.6118 => 0.6016, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.61% (0.7561 => 0.7439, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.58% (0.6395 => 0.6294, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.52% (0.6559 => 0.6459, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.52% (0.6840 => 0.6736, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -1.51% (3.7560 => 3.6994, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.49% (0.7106 => 0.7000, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.41% (0.8021 => 0.7908, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -1.36% (4.6487 => 4.5854, std.dev.: 0.0217) MultiSource/Applications/treecc/treecc: -1.36% (2.2645 => 2.2337, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (0.7810 => 0.7704, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -1.35% (16.9484 => 16.7202, std.dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.31% (2.4345 => 2.4025, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -1.31% (1.1894 => 1.1738, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -1.27% (1.5328 => 1.5133, std.dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: -1.10% (19.3450 => 19.1319, std.dev.: 0.0053) MultiSource/Applications/siod/siod: -1.06% (2.5364 => 2.5094, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.05% (1.4686 => 1.4532, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.01% (10.5028 => 10.3972, std.dev.: 0.0155) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/fannkuch: -7.08% (3.4630 => 3.2177, std.dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/ClamAV/clamscan: -0.55% (28.3800 => 28.2231, std.dev.: 0.0506) MultiSource/Applications/JM/ldecod/ldecod: -0.54% (6.3332 => 6.2988, std.dev.: 0.0177) MultiSource/Applications/JM/lencod/lencod: -0.49% (18.7561 => 18.6648, std.dev.: 0.0284) MultiSource/Applications/oggenc/oggenc: - (0.0020 => 0.0020) MultiSource/Applications/sqlite3/sqlite3: -1.12% (0.5285 => 0.5226, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -0.67% (5.0568 => 5.0230, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -0.27% (1.4211 => 1.4173, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -0.26% (0.3046 => 0.3038, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.36% (0.0283 => 0.0301, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 0.79% (1.3107 => 1.3211, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/voronoi/voronoi: -2.29% (0.1969 => 0.1924, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.00% (0.0020 => 0.0019, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.00% (0.0020 => 0.0019, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -0.25% (0.2784 => 0.2777, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.60% (1.3130 => 1.3051, std.dev.: 0.0103) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -0.37% (5.2126 => 5.1934, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.70% (1.3875 => 1.3778, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: -1.64% (1.1055 => 1.0874, std.dev.: 0.0047) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0020 => 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/ClamAV/clamscan: - (0.0001 => 0.0001) MultiSource/Applications/JM/ldecod/ldecod: - (0.0001 => 0.0001) MultiSource/Applications/JM/lencod/lencod: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.48% (0.0416 => 0.0418) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.97% (0.0712 => 0.0726, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: - (0.0001 => 0.0001) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8725 => 499.8643, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/voronoi/voronoi: - (0.0001 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: - (0.0001 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: - (0.0001 => 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/nbench/nbench: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/nbench/nbench MultiSource/Applications/ClamAV/clamscan: 27.27% (22.1758 => 28.2231, std.dev.: 0.0506) MultiSource/Applications/JM/ldecod/ldecod: -39.64% (10.4361 => 6.2988, std.dev.: 0.0177) MultiSource/Applications/JM/lencod/lencod: -14.92% (21.9371 => 18.6648, std.dev.: 0.0284) MultiSource/Applications/oggenc/oggenc: -99.97% (5.7591 => 0.0020) MultiSource/Applications/sqlite3/sqlite3: -96.96% (17.1811 => 0.5226, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.58% (4.9449 => 5.0230, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -8.06% (1.5415 => 1.4173, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -37.73% (0.4879 => 0.3038, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.55% (6.6874 => 0.0301, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -75.32% (5.3526 => 1.3211, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/voronoi/voronoi: -28.74% (0.2700 => 0.1924, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -99.94% (2.9384 => 0.0019, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -99.83% (1.1194 => 0.0019, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -12.59% (0.3177 => 0.2777, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -75.77% (5.3855 => 1.3051, std.dev.: 0.0103) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.83% (5.0018 => 5.1934, std.dev.: 0.0094) MultiSource/Benchmarks/nbench/nbench: -8.16% (1.1840 => 1.0874, std.dev.: 0.0047) New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/nbench/nbench MultiSource/Applications/ClamAV/clamscan: -99.94% (0.1629 => 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -99.92% (0.1298 => 0.0001) MultiSource/Applications/sqlite3/sqlite3: -100.00% (4.6441 => 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -98.00% (0.0050 => 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -50.00% (0.0002 => 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -75.00% (0.0004 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -99.97% (0.3987 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 44226.00% (1.1277 => 499.8643, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/voronoi/voronoi: -99.97% (0.3070 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -100.00% (2.6546 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -100.00% (2.6778 => 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -100.00% (4.5009 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -99.80% (0.0506 => 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -97.30% (0.0037 => 0.0001) MultiSource/Benchmarks/nbench/nbench: -100.00% (11.6436 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 189.41% (0.5229 => 1.5133, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 11.55% (14.9895 => 16.7202, std.dev.: 0.0155) MultiSource/Applications/kimwitu++/kc: 35.16% (14.1553 => 19.1319, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/gs/gs: 11.55% (4.1105 => 4.5854, std.dev.: 0.0217) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.12% (3.4629 => 5.7873, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/stepanov_container: 62.12% (0.6222 => 1.0087, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3841100.00% (0.0001 => 3.8412, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11158100.00% (0.0001 => 11.1582, std.dev.: 0.0571) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 67300.00% (0.0001 => 0.0674, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049300.00% (0.0001 => 10.0494, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5492400.00% (0.0001 => 5.4925, std.dev.: 0.0089) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/CoyoteBench/almabench: 61.10% (0.0730 => 0.1176, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.50% (7.0540 => 11.0395, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops: 53.56% (0.1432 => 0.2199, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 52.58% (63.2438 => 96.4987, std.dev.: 0.0737) MultiSource/Benchmarks/FreeBench/distray/distray: 50.76% (0.1056 => 0.1592, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 47.08% (2.2022 => 3.2389, std.dev.: 0.0032) SingleSource/UnitTests/vla: 28.45% (0.0355 => 0.0456, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 24.46% (8.1363 => 10.1265, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/oourafft: 23.22% (0.3282 => 0.4044, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 22.31% (0.0798 => 0.0976, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 21.65% (0.2554 => 0.3107, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.54% (0.1566 => 0.1872, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.67% (0.1125 => 0.1335, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 18.66% (0.0793 => 0.0941, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 17.96% (0.0746 => 0.0880, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 17.68% (0.1555 => 0.1830, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 17.53% (0.1175 => 0.1381, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.44% (0.0648 => 0.0761, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.86% (0.0842 => 0.0984, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 16.73% (0.1584 => 0.1849, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 16.29% (0.0614 => 0.0714, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.00% (0.0675 => 0.0783, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.97% (0.8172 => 0.9477, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.84% (0.0770 => 0.0892, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.69% (0.0886 => 0.1025, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 15.38% (0.0871 => 0.1005, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 14.93% (0.1695 => 0.1948, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.92% (0.2065 => 0.2373, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.67% (0.2107 => 0.2416, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.32% (0.3121 => 0.3568, std.dev.: 0.0030) MultiSource/Applications/aha/aha: 14.25% (0.1151 => 0.1315, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.19% (0.1029 => 0.1175, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 14.17% (0.0953 => 0.1088, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.13% (0.2271 => 0.2592, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.11% (0.5981 => 0.6825, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.06% (0.1337 => 0.1525, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/matrix: 14.06% (0.0818 => 0.0933, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 13.93% (0.1163 => 0.1325, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.91% (0.0834 => 0.0950, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.38% (0.2758 => 0.3127, std.dev.: 0.0026) MultiSource/Applications/Burg/burg: 13.34% (1.1642 => 1.3195, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.25% (0.1117 => 0.1265, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.22% (0.1906 => 0.2158, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 13.17% (0.1268 => 0.1435, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.93% (0.5569 => 0.6289, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.88% (14.3668 => 16.2167, std.dev.: 0.0074) MultiSource/Applications/minisat/minisat: 12.87% (0.7115 => 0.8031, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: 12.81% (0.1655 => 0.1867, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 12.75% (0.7433 => 0.8381, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.73% (0.5860 => 0.6606, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.42% (0.1940 => 0.2181, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.36% (0.9765 => 1.0972, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.26% (0.4615 => 0.5181, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 12.13% (0.7835 => 0.8785, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.05% (0.0838 => 0.0939, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 12.03% (0.3109 => 0.3483, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 11.96% (0.1062 => 0.1189, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.77% (0.3441 => 0.3846, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 11.71% (0.3423 => 0.3824, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.69% (0.5105 => 0.5702, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.45% (0.6675 => 0.7439, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.43% (0.1032 => 0.1150, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.36% (1.3050 => 1.4532, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.26% (0.1510 => 0.1680, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.25% (0.1236 => 0.1375, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 11.06% (3.8723 => 4.3006, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.04% (4.2646 => 4.7352, std.dev.: 0.0036) MultiSource/Applications/d/make_dparser: 10.91% (3.3354 => 3.6994, std.dev.: 0.0176) SingleSource/UnitTests/ObjC/parameter-passing: 10.72% (0.3927 => 0.4348, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.61% (0.3307 => 0.3658, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 10.48% (0.3473 => 0.3837, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.41% (0.3516 => 0.3882, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.41% (0.3497 => 0.3861, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.39% (0.3543 => 0.3911, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 10.34% (0.3828 => 0.4224, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.32% (0.5020 => 0.5538, std.dev.: 0.0109) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.30% (0.3543 => 0.3908, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 10.28% (0.3561 => 0.3927, std.dev.: 0.0051) MultiSource/Applications/treecc/treecc: 10.18% (2.0273 => 2.2337, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/for-in: 10.15% (0.3694 => 0.4069, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.06% (0.3886 => 0.4277, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.06% (0.1143 => 0.1258, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 9.88% (0.6456 => 0.7094, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 9.86% (0.4299 => 0.4723, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.82% (1.5859 => 1.7416, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.74% (0.6450 => 0.7078, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.68% (0.1695 => 0.1859, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.64% (0.8101 => 0.8882, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 9.62% (9.4845 => 10.3972, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.56% (0.8067 => 0.8838, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.51% (0.1892 => 0.2072, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.49% (0.4636 => 0.5076, std.dev.: 0.0080) MultiSource/Applications/lemon/lemon: 9.48% (1.0722 => 1.1738, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 9.46% (0.7326 => 0.8019, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.37% (1.1861 => 1.2972, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/lists: 9.32% (0.3422 => 0.3741, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.31% (0.3865 => 0.4225, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 9.28% (0.3180 => 0.3475, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 9.27% (1.5603 => 1.7050, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/football/football: 9.27% (0.8921 => 0.9748, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 9.26% (0.4289 => 0.4686, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 9.25% (2.2969 => 2.5094, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference-object: 9.20% (0.6030 => 0.6585, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.18% (0.2430 => 0.2653, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 9.15% (0.5925 => 0.6467, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.14% (0.2603 => 0.2841, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.09% (2.2024 => 2.4025, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.08% (3.8922 => 4.2456, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.02% (0.4103 => 0.4473, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/hash2: 8.96% (0.4620 => 0.5034, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.92% (0.4203 => 0.4578, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.89% (1.4186 => 1.5447, std.dev.: 0.0053) MultiSource/Benchmarks/sim/sim: 8.80% (0.3387 => 0.3685, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 8.60% (0.3603 => 0.3913, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: 8.54% (0.1463 => 0.1588, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/Puzzle: 8.52% (0.1268 => 0.1376, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 8.50% (0.4048 => 0.4392, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 8.31% (0.3684 => 0.3990, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.13% (0.2756 => 0.2980, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 8.11% (0.2725 => 0.2946, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.05% (0.3826 => 0.4134, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.98% (0.2831 => 0.3057, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.95% (0.3650 => 0.3940, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hello: 7.92% (0.2714 => 0.2929, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.91% (0.2793 => 0.3014, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.85% (0.2891 => 0.3118, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 7.64% (0.2905 => 0.3127, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.56% (2.0665 => 2.2227, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/ary3: 7.46% (0.3283 => 0.3528, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 7.43% (0.3232 => 0.3472, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.42% (0.2872 => 0.3085, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 7.40% (0.3052 => 0.3278, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.40% (0.3162 => 0.3396, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.38% (0.2871 => 0.3083, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.30% (0.3098 => 0.3324, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 7.16% (0.2877 => 0.3083, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 7.14% (0.2802 => 0.3002, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 7.10% (1.2842 => 1.3754, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/ReedSolomon: 7.08% (0.2049 => 0.2194, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.06% (0.4064 => 0.4351, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 6.87% (0.3379 => 0.3611, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 6.47% (0.3092 => 0.3292, std.dev.: 0.0054) MultiSource/Benchmarks/PAQ8p/paq8p: 6.30% (10.3673 => 11.0208, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.19% (0.3136 => 0.3330, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.49% (0.3427 => 0.3615, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.05% (0.3131 => 0.3289, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.85% (0.3935 => 0.4126, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.96% (0.3817 => 0.3930, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: 26.58% (1.5835 => 2.0044, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 17.34% (6.6465 => 7.7990, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 17.19% (1.6925 => 1.9835, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.78% (1.1145 => 1.3015, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.55% (0.2944 => 0.3284, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.86% (1.1396 => 1.2520, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 9.63% (1.8525 => 2.0309, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.89% (1.7254 => 1.8788, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (3.1578 => 3.3673, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.40% (0.3463 => 0.3650, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) SingleSource/Benchmarks/Misc/flops: 4.01% (8.8334 => 9.1880, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 3.20% (0.9505 => 0.9809, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.78% (4.2280 => 4.3456, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.72% (8.6802 => 8.9166, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 1.93% (1.3677 => 1.3941) MultiSource/Benchmarks/Olden/bisort/bisort: 1.85% (0.8333 => 0.8487, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 1.83% (3.1595 => 3.2173, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.21% (5.2763 => 1.2026, std.dev.: 0.0173) SingleSource/Benchmarks/Misc/salsa20: -75.32% (0.8651 => 0.2135, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -46.24% (0.1622 => 0.0872, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -28.16% (1.7609 => 1.2651, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -11.95% (0.1330 => 0.1171, std.dev.: 0.0046) SingleSource/UnitTests/Vector/constpool: -9.05% (54.1659 => 49.2663, std.dev.: 0.0188) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.45% (7.9617 => 7.8461, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.85% (0.0628 => 0.0384, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: -33.35% (1.1492 => 0.7659, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -29.40% (10.7105 => 7.5617, std.dev.: 0.0118) MultiSource/Benchmarks/FreeBench/mason/mason: -18.51% (0.2161 => 0.1761, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -11.01% (1.5373 => 1.3680, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.98% (32.5116 => 28.9413, std.dev.: 0.0075) MultiSource/Benchmarks/NPB-serial/is/is: -10.95% (9.5636 => 8.5163, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.48% (1.5660 => 1.4332, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2915, std.dev.: 0.0137) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.05% (1.8329 => 1.7037, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -6.41% (0.1592 => 0.1490, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.31% (1.2373 => 1.1592, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5758, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.17% (1.6805 => 1.5936, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.33% (0.4808 => 0.4600, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1553, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.34% (0.9957 => 0.9624, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: -3.24% (5.0483 => 4.8849, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: -2.29% (11.3103 => 11.0518, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.08% (8.1563 => 7.9866, std.dev.: 0.0157) SingleSource/Benchmarks/Misc/salsa20: -1.95% (10.2830 => 10.0825, std.dev.: 0.0127) MultiSource/Benchmarks/PAQ8p/paq8p: -1.70% (85.0658 => 83.6237, std.dev.: 0.0023) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -1.40% (1.9405 => 1.9133, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/whetstone: -1.08% (1.0554 => 1.0440, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2335, std.dev.: 0.0053) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 24.71% (1.1048 => 1.3778, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -99.97% (7.1582 => 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: -99.86% (0.0720 => 0.0001) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -65.69% (0.2116 => 0.0726, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 2.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 3 03:11:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 3 Nov 2012 05:11:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121103101146.C8C032A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5549?compare_to=5546&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5549, Order: 167353, Start Time: 2012-11-03 06:52:54, End Time: 2012-11-03 10:11:51 To: 5546, Order: 167348, Start Time: 2012-11-03 02:49:13, End Time: 2012-11-03 06:04:39 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (166 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1037 (725 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 33.44% (0.4007 => 0.5347, std.dev.: 0.0214) SingleSource/UnitTests/Vector/constpool: 1.51% (2.4111 => 2.4476, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 1.74% (0.6098 => 0.6204, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.02% (21.6595 => 21.8811, std.dev.: 0.0523) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -1.46% (54.9089 => 54.1066, std.dev.: 0.0877) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.48% (0.0625 => 0.0878, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.70% (0.1063 => 0.1400, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.56% (0.2969 => 0.3728, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.77% (0.1106 => 0.1380, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.57% (0.4139 => 0.5156, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 24.03% (1.5932 => 1.9760, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 23.89% (0.0452 => 0.0560, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.83% (0.5900 => 0.7306, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.65% (0.4253 => 0.5259, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.53% (0.4994 => 0.6169, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.12% (0.5000 => 0.6156, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.97% (0.0714 => 0.0878, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.26% (0.0584 => 0.0714, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.73% (0.1620 => 0.1972, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 21.37% (0.0599 => 0.0727) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.35% (0.1021 => 0.1239, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.07% (0.0897 => 0.1086, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.96% (0.1107 => 0.1339, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 20.70% (0.0604 => 0.0729, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 20.46% (0.0948 => 0.1142, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.38% (0.0633 => 0.0762, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.31% (0.1103 => 0.1327, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.03% (0.0584 => 0.0701, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.96% (0.0541 => 0.0649, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.95% (0.1549 => 0.1858, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.94% (0.0642 => 0.0770, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.89% (0.1604 => 0.1923, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 19.85% (0.0821 => 0.0984, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.83% (0.0822 => 0.0985, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 19.70% (0.1619 => 0.1938, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.64% (0.1003 => 0.1200, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.57% (0.3903 => 0.4667, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 18.48% (0.0947 => 0.1122, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.40% (0.1462 => 0.1731, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.20% (0.2736 => 0.3234, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 18.02% (0.5826 => 0.6876, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.92% (0.2014 => 0.2375, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 17.92% (0.4029 => 0.4751, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.89% (0.3890 => 0.4586, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.83% (1.3152 => 1.5497, std.dev.: 0.0065) MultiSource/Applications/sgefa/sgefa: 17.82% (0.0808 => 0.0952, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: 17.82% (0.1218 => 0.1435, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 17.73% (0.5889 => 0.6933, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 17.67% (0.1505 => 0.1771, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.46% (0.1088 => 0.1278, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 17.34% (0.0698 => 0.0819, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.23% (0.1968 => 0.2307, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.10% (0.2866 => 0.3356, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.76% (3.5627 => 4.1599, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/gs/gs: 16.73% (1.8794 => 2.1938, std.dev.: 0.0085) MultiSource/Applications/Burg/burg: 16.62% (0.5546 => 0.6468, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.47% (0.1160 => 0.1351, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 16.43% (0.9697 => 1.1290, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.38% (0.4658 => 0.5421, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.35% (1.6211 => 1.8862, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.21% (0.3930 => 0.4567, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.18% (0.5026 => 0.5839, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 16.15% (0.7171 => 0.8329, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 16.05% (0.1421 => 0.1649, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.02% (0.3271 => 0.3795, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.93% (0.2875 => 0.3333, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/bh/bh: 15.89% (0.1284 => 0.1488, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 15.85% (1.0781 => 1.2490, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.68% (0.4361 => 0.5045, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 15.60% (4.2109 => 4.8679, std.dev.: 0.0075) SingleSource/Regression/C++/ofstream_ctor: 15.45% (0.3004 => 0.3468, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.33% (4.4195 => 5.0971, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.29% (2.7292 => 3.1464, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/fibo: 15.27% (0.2725 => 0.3141, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.23% (0.2738 => 0.3155, std.dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 15.22% (0.9909 => 1.1417, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hello: 15.14% (0.2714 => 0.3125, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/strcat: 15.05% (0.2750 => 0.3164, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.01% (1.9694 => 2.2650, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 14.99% (0.2729 => 0.3138, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/matrix: 14.96% (0.2780 => 0.3196, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/random: 14.88% (0.2803 => 0.3220, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.87% (1.9966 => 2.2934, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.84% (0.2911 => 0.3343, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.84% (2.0673 => 2.3740, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.83% (0.2792 => 0.3206, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/wc: 14.83% (0.3096 => 0.3555, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.74% (0.3195 => 0.3666, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/methcall: 14.72% (0.2813 => 0.3227, std.dev.: 0.0127) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.71% (0.3488 => 0.4001, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 14.69% (0.2811 => 0.3224, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.68% (0.1090 => 0.1250, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 14.36% (23.5202 => 26.8970, std.dev.: 0.0294) SingleSource/Benchmarks/Shootout-C++/ary3: 14.33% (0.3267 => 0.3735, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.25% (0.3362 => 0.3841, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 14.06% (0.3258 => 0.3716, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 14.03% (0.2566 => 0.2926, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.02% (0.3060 => 0.3489, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-4: 14.00% (0.3465 => 0.3950, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 13.99% (0.4146 => 0.4726, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-2: 13.99% (0.3446 => 0.3928, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 13.96% (0.3496 => 0.3984, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 13.90% (0.3317 => 0.3778, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 13.89% (0.3442 => 0.3920, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 13.87% (0.3460 => 0.3940, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 13.87% (0.3469 => 0.3950, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 13.84% (1.4269 => 1.6244, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/moments: 13.81% (0.3678 => 0.4186, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/football/football: 13.59% (0.2075 => 0.2357, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.57% (0.3124 => 0.3548, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.53% (0.3282 => 0.3726, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/property: 13.51% (0.3650 => 0.4143, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/exceptions: 13.48% (0.3643 => 0.4134, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 13.41% (2.1653 => 2.4557, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: 13.41% (0.3348 => 0.3797, std.dev.: 0.0125) SingleSource/UnitTests/ObjC/parameter-passing: 13.37% (0.3724 => 0.4222, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 13.24% (4.6177 => 5.2289, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 13.20% (0.3726 => 0.4218, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/hash2: 13.20% (0.4251 => 0.4812, std.dev.: 0.0038) MultiSource/Applications/treecc/treecc: 13.18% (0.7875 => 0.8913, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.95% (0.3690 => 0.4168, std.dev.: 0.0112) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.72% (0.3845 => 0.4334, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 12.43% (0.5012 => 0.5635, std.dev.: 0.0207) MultiSource/Benchmarks/mafft/pairlocalalign: 12.31% (2.1013 => 2.3600, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.91% (0.2040 => 0.2283, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 11.56% (0.2691 => 0.3002, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 11.53% (5.5417 => 6.1809, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.03% (0.6435 => 0.7145, std.dev.: 0.0138) MultiSource/Applications/lambda-0_1_3/lambda: 10.66% (0.3498 => 0.3871, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 10.52% (0.6634 => 0.7332, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.51% (0.1028 => 0.1136, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.27% (0.1383 => 0.1525, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.16% (0.2737 => 0.3015, std.dev.: 0.0077) MultiSource/Benchmarks/PAQ8p/paq8p: 10.15% (0.4847 => 0.5339, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.91% (0.2068 => 0.2273, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.79% (0.3084 => 0.3386, std.dev.: 0.0061) MultiSource/Applications/minisat/minisat: 9.50% (0.3336 => 0.3653, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 9.03% (0.2391 => 0.2607, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 9.01% (2.0346 => 2.2179, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.94% (0.2103 => 0.2291, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.48% (4.6926 => 5.0907, std.dev.: 0.0334) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.19% (11.6398 => 12.5934, std.dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.80% (0.5361 => 0.5779, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.20% (0.5584 => 0.5986, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.00% (0.7426 => 0.7946, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 6.16% (11.9555 => 12.6918, std.dev.: 0.0229) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.69% (0.3792 => 0.3970, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6533, std.dev.: 0.0181) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 9.24% (0.2802 => 0.3061, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6115, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.61% (0.3693 => 0.3900, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.00% (12.0509 => 12.6530, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops: 4.76% (15.4430 => 16.1787, std.dev.: 0.0654) SingleSource/Benchmarks/Misc/flops-2: 3.89% (1.8057 => 1.8760, std.dev.: 0.0071) SingleSource/Benchmarks/Dhrystone/dry: 2.57% (14.0481 => 14.4089, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2003, std.dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.66% (3.1722 => 3.2249, std.dev.: 0.0028) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3047, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.36% (7.1849 => 7.2823, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1063, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5143, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5766, std.dev.: 0.0172) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.16% (2.4764 => 2.4476, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -36.09% (25.4195 => 16.2467, std.dev.: 0.0817) SingleSource/Benchmarks/Shootout-C++/ary2: -9.03% (0.2402 => 0.2185, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9799, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.67% (35.5013 => 32.7792, std.dev.: 0.1052) MultiSource/Benchmarks/Olden/tsp/tsp: -7.21% (2.1113 => 1.9590, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -3.44% (11.2080 => 10.8220, std.dev.: 0.0366) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: -2.87% (3.6262 => 3.5223, std.dev.: 0.0121) SingleSource/Benchmarks/Dhrystone/fldry: -2.36% (17.2379 => 16.8317, std.dev.: 0.0094) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.19% (41.7953 => 40.8790, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5742, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4954, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.11% (105.3826 => 104.2085, std.dev.: 0.0389) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.07% (3.3991 => 3.3626, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 3 06:34:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 3 Nov 2012 08:34:00 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121103133400.8BE072A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5550?compare_to=5545&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5550, Order: 167354, Start Time: 2012-11-03 12:08:03, End Time: 2012-11-03 13:34:05 To: 5545, Order: 167353, Start Time: 2012-11-03 04:37:27, End Time: 2012-11-03 06:03:46 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 7 (53 on baseline) Performance Improvements: 5 (10 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 979 (911 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.43% (0.4150 => 0.4251, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.1256 => 1.1372, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.42% (40.0879 => 42.2596, std.dev.: 0.2512) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.91% (2.5716 => 2.6206, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/hash: 1.88% (0.6271 => 0.6389, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 1.77% (2.8577 => 2.9082, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.33% (1.8695 => 1.8943, std.dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.59% (0.8651 => 0.8167, std.dev.: 0.0187) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.35% (4.5905 => 4.5285, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.03% (4.6521 => 4.6040, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.01% (4.2775 => 4.2344, std.dev.: 0.0113) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: -1.07% (1.2655 => 1.2519, std.dev.: 0.0022) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.87% (16.5443 => 16.6890, std.dev.: 0.0364) MultiSource/Applications/obsequi/Obsequi: -2.89% (1.0624 => 1.0317, std.dev.: 0.0115) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.64% (21.4431 => 21.5811, std.dev.: 0.1085) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.50% (0.3601 => 0.3655, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/bigfib: 0.23% (0.5988 => 0.6002, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.24% (0.3334 => 0.3326, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: 1.69% (0.2006 => 0.2040, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 23.08% (0.0156 => 0.0192, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0426 => 0.0426, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.34% (0.0298 => 0.0297, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.56% (0.0320 => 0.0315, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -11.50% (0.0426 => 0.0377, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/casts: -31.37% (0.0204 => 0.0140, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/test1: -5.91% (0.0203 => 0.0191, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -1.14% (0.1487 => 0.1470, std.dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 3.36% (1.1176 => 1.1552, std.dev.: 0.0052) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.21% (0.1411 => 0.1414, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.30% (0.4008 => 0.4100, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.83% (0.1363 => 0.1338, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.50% (0.0560 => 0.0574, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -25.86% (0.0263 => 0.0195, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.43% (0.0558 => 0.0550, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.19% (1.1457 => 1.1435, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -94.44% (0.0018 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.34% (0.0551 => 0.0608, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.05% (0.0191 => 0.0189, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.49% (0.7970 => 0.8009, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -16.67% (0.0054 => 0.0045, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2293.21% (0.6332 => 15.1538, std.dev.: 0.1374) MultiSource/Benchmarks/McCat/08-main/main: 45.39% (0.1831 => 0.2662, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.02% (0.1559 => 0.1434, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1478.95% (0.3344 => 5.2800, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.29% (0.2364 => 0.3222, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: 2.56% (0.0429 => 0.0440, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.34% (0.0224 => 0.0221, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -31.74% (0.0230 => 0.0157, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3313, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0729, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4924, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3443, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0282, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4084, std.dev.: 0.0026) SingleSource/Regression/C/uint64_to_float: -23.45% (2.1832 => 1.6712, std.dev.: 0.0031) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.93% (0.0810 => 0.0939, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 10.16% (0.1112 => 0.1225, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/health/health: 8.83% (0.1347 => 0.1466, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.38% (0.2180 => 0.2319, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.51% (0.1905 => 0.2010, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.17% (0.8321 => 0.8751, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.00% (0.4127 => 0.4251, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.89% (0.9435 => 0.9708, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.74% (0.3717 => 0.3819, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.68% (0.4783 => 0.4911, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.38% (0.5961 => 0.6103, std.dev.: 0.0044) MultiSource/Applications/treecc/treecc: 2.29% (1.9948 => 2.0405, std.dev.: 0.0102) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.14% (6.6074 => 6.7489, std.dev.: 0.0122) MultiSource/Applications/hbd/hbd: 2.06% (1.4269 => 1.4563, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.81% (1.1170 => 1.1372, std.dev.: 0.0043) MultiSource/Applications/SIBsim4/SIBsim4: 1.71% (1.2568 => 1.2783, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 1.66% (4.1305 => 4.1989, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.57% (0.7966 => 0.8091, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.54% (4.4880 => 4.5572, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.53% (1.2526 => 1.2718, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.51% (0.8340 => 0.8466, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.48% (0.6834 => 0.6935, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.41% (1.1271 => 1.1430, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.40% (0.9074 => 0.9201, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.39% (4.1763 => 4.2344, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.39% (0.8204 => 0.8318, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.39% (0.8069 => 0.8181, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 1.37% (14.2605 => 14.4556, std.dev.: 0.0743) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.33% (0.8331 => 0.8442, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.29% (0.9688 => 0.9813, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.29% (13.1811 => 13.3509, std.dev.: 0.0480) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.27% (0.8317 => 0.8423, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.27% (0.9056 => 0.9171, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.11% (0.9908 => 1.0018, std.dev.: 0.0025) MultiSource/Applications/lemon/lemon: 1.08% (1.0945 => 1.1063, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.06% (2.1401 => 2.1627, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 74.37% (0.0199 => 0.0347, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/pi: 57.80% (1.5795 => 2.4925, std.dev.: 0.0119) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.89% (14.6451 => 16.6788, std.dev.: 0.3805) MultiSource/Applications/SIBsim4/SIBsim4: 8.04% (3.1873 => 3.4436, std.dev.: 0.0113) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.00% (1.1857 => 1.2806, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.44% (0.3186 => 0.3423, std.dev.: 0.0066) MultiSource/Applications/hexxagon/hexxagon: 4.56% (14.0064 => 14.6451, std.dev.: 0.0365) SingleSource/Benchmarks/Shootout-C++/hash: 2.97% (0.6205 => 0.6389, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 2.82% (3.8206 => 3.9283, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/ReedSolomon: 2.71% (8.5322 => 8.7631, std.dev.: 0.0274) MultiSource/Applications/siod/siod: 2.69% (3.6643 => 3.7628, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 2.67% (63.1822 => 64.8723, std.dev.: 0.0284) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.02% (41.4238 => 42.2596, std.dev.: 0.2512) MultiSource/Applications/lambda-0_1_3/lambda: 1.94% (7.4933 => 7.6383, std.dev.: 0.0143) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.77% (28.5821 => 29.0877, std.dev.: 0.0151) MultiSource/Benchmarks/Olden/bh/bh: 1.63% (2.3560 => 2.3944, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: 1.13% (1.0841 => 1.0964, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -31.36% (0.0338 => 0.0232, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.24% (0.3269 => 0.2967, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.54% (3.9188 => 3.7018, std.dev.: 0.0733) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.20% (2.8773 => 2.7564, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: -3.80% (7.3375 => 7.0586, std.dev.: 0.0147) MultiSource/Applications/lua/lua: -2.49% (29.8330 => 29.0892, std.dev.: 0.0650) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.36% (1.2822 => 1.2519, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: -1.41% (3.4237 => 3.3754, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.24% (3.3479 => 3.3064, std.dev.: 0.0074) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.20% (2.4333 => 2.4042, std.dev.: 0.0088) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.48% (16.4461 => 16.6890, std.dev.: 0.0364) MultiSource/Applications/obsequi/Obsequi: 0.54% (1.0262 => 1.0317, std.dev.: 0.0115) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6810.37% (0.3123 => 21.5811, std.dev.: 0.1085) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.40% (0.2463 => 0.3655, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/bigfib: -0.13% (0.6010 => 0.6002, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.84% (0.3266 => 0.3326, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: 3.61% (0.1969 => 0.2040, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 56.10% (0.0123 => 0.0192, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 16.93% (0.0254 => 0.0297, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.82% (0.0384 => 0.0377, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/casts: -26.32% (0.0190 => 0.0140, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/test1: 6.11% (0.0180 => 0.0191, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 2.23% (0.1438 => 0.1470, std.dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.97% (1.1329 => 1.1552, std.dev.: 0.0052) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -3.28% (0.1462 => 0.1414, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.54% (0.4164 => 0.4100, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.26% (0.1369 => 0.1338, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -37.50% (0.0008 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.45% (0.0641 => 0.0574, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0195 => 0.0195, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.84% (0.0578 => 0.0550, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.02% (1.1437 => 1.1435, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.03% (0.0627 => 0.0608, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.00% (0.0180 => 0.0189, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.10% (0.8017 => 0.8009, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -27.42% (0.0062 => 0.0045, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 3 06:39:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 3 Nov 2012 08:39:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121103133921.630A02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5551?compare_to=5547&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5551, Order: 167354, Start Time: 2012-11-03 12:14:18, End Time: 2012-11-03 13:39:25 To: 5547, Order: 167353, Start Time: 2012-11-03 05:10:16, End Time: 2012-11-03 06:35:16 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 3 (5 on baseline) Performance Improvements: 0 (180 on baseline) Unchanged Tests: 1039 (857 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 23.23% (7.3482 => 9.0549, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.75% (54.5226 => 56.5655, std.dev.: 0.1377) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.75% (78.6017 => 79.9791, std.dev.: 0.4756) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.33% (1.2783 => 1.3720, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.65% (54.5751 => 56.5655, std.dev.: 0.1377) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.57% (2.0478 => 2.1005, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: 2.54% (7.4937 => 7.6843, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash2: 1.95% (3.1932 => 3.2554, std.dev.: 0.0082) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.53% (0.1431 => 0.1309, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.72% (0.3821 => 0.3526, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -7.19% (2.4924 => 2.3132, std.dev.: 0.0145) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.80% (22.4056 => 20.8823, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.75% (0.2428 => 0.2264, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.75% (3.5339 => 3.2953, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -6.67% (0.3357 => 0.3133, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.57% (0.1584 => 0.1480, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.56% (0.3142 => 0.2936, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -6.54% (4.3330 => 4.0497, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.42% (0.9542 => 0.8929, std.dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: -6.34% (16.1920 => 15.1661, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.31% (0.3658 => 0.3427, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/chomp: -6.30% (0.1761 => 0.1650, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: -6.28% (7.0961 => 6.6502, std.dev.: 0.0054) MultiSource/Applications/siod/siod: -6.22% (2.4021 => 2.2527, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.21% (1.0544 => 0.9889, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.17% (1.6474 => 1.5457, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -6.16% (1.2515 => 1.1744, std.dev.: 0.0034) MultiSource/Applications/lemon/lemon: -6.14% (1.1450 => 1.0747, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -6.13% (9.2283 => 8.6624, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.12% (0.1716 => 0.1611, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -6.10% (0.9179 => 0.8619, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.10% (0.9852 => 0.9251) SingleSource/UnitTests/ObjC/trivial-interface: -6.09% (0.3812 => 0.3580, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.08% (0.2548 => 0.2393, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -6.05% (0.2659 => 0.2498, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.05% (1.4642 => 1.3756, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: -6.03% (0.3831 => 0.3600, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.99% (1.3722 => 1.2900, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.99% (0.3891 => 0.3658, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.98% (1.2784 => 1.2019, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.96% (0.1796 => 0.1689, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.96% (5.4682 => 5.1425, std.dev.: 0.0165) SingleSource/UnitTests/ObjC/exceptions-4: -5.95% (0.3880 => 0.3649, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -5.95% (0.4033 => 0.3793, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -5.94% (0.4176 => 0.3928, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.94% (0.6484 => 0.6099, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.94% (4.5069 => 4.2393, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.93% (1.6364 => 1.5394, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.92% (1.2300 => 1.1572, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/synchronized: -5.90% (0.3896 => 0.3666, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.90% (0.2695 => 0.2536, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: -5.90% (1.1530 => 1.0850, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.89% (0.5857 => 0.5512, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.88% (0.7919 => 0.7453, std.dev.: 0.0031) MultiSource/Applications/lua/lua: -5.88% (4.0594 => 3.8206, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.88% (0.6293 => 0.5923, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-3: -5.87% (0.3848 => 0.3622, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -5.86% (0.4199 => 0.3953, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.85% (0.4151 => 0.3908, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.85% (0.6736 => 0.6342, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: -5.84% (15.5079 => 14.6018, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.80% (4.8161 => 4.5366, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.80% (4.8802 => 4.5971, std.dev.: 0.0034) MultiSource/Benchmarks/sim/sim: -5.78% (0.3406 => 0.3209, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.77% (0.2355 => 0.2219, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.77% (0.6304 => 0.5940, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -5.77% (0.4280 => 0.4033, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.76% (0.4321 => 0.4072, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.74% (0.6446 => 0.6076, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.73% (0.6052 => 0.5705, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.73% (0.7524 => 0.7093, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.72% (4.0323 => 3.8017, std.dev.: 0.0096) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.72% (0.3884 => 0.3662, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.71% (0.5478 => 0.5165, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -5.71% (1.3148 => 1.2397, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.70% (0.5925 => 0.5587, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.70% (2.2587 => 2.1300, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.69% (0.6297 => 0.5939, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.68% (0.7339 => 0.6922, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.67% (0.5802 => 0.5473, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.67% (0.5575 => 0.5259, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -5.66% (0.2985 => 0.2816, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.66% (0.5849 => 0.5518, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.66% (17.1032 => 16.1354, std.dev.: 0.0187) MultiSource/Applications/kimwitu++/kc: -5.65% (18.2933 => 17.2604, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.64% (14.2083 => 13.4066, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.60% (0.3931 => 0.3711, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.59% (6.7716 => 6.3933, std.dev.: 0.0049) MultiSource/Applications/minisat/minisat: -5.59% (0.7447 => 0.7031, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.59% (0.6230 => 0.5882, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.58% (0.5591 => 0.5279, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.57% (0.5941 => 0.5610, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.57% (0.6681 => 0.6309, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.57% (0.5999 => 0.5665, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: -5.56% (0.7982 => 0.7538, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: -5.56% (0.3581 => 0.3382, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.55% (0.3837 => 0.3624, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.55% (0.4813 => 0.4546, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.54% (0.5863 => 0.5538, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.54% (0.6260 => 0.5913, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.54% (0.6395 => 0.6041, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -5.52% (0.3025 => 0.2858, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.51% (0.5859 => 0.5536, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.51% (0.6440 => 0.6085, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.50% (0.6667 => 0.6300, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.49% (0.6033 => 0.5702, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.49% (0.5705 => 0.5392, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.48% (0.9557 => 0.9033, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.47% (0.6194 => 0.5855, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -5.47% (0.4861 => 0.4595, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.46% (0.5456 => 0.5158, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.46% (0.5570 => 0.5266, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.46% (0.3849 => 0.3639, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.45% (0.3323 => 0.3142, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.44% (0.5805 => 0.5489, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -5.44% (1.3864 => 1.3110, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.44% (0.5168 => 0.4887, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.44% (0.2999 => 0.2836, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.42% (0.8521 => 0.8059, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: -5.42% (0.3194 => 0.3021, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.41% (0.4916 => 0.4650, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.40% (0.3057 => 0.2892, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.39% (0.6395 => 0.6050, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -5.39% (34.0927 => 32.2556, std.dev.: 0.0437) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.39% (0.4083 => 0.3863, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.38% (0.3255 => 0.3080, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -5.37% (0.4524 => 0.4281, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.37% (0.5569 => 0.5270, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.37% (0.3483 => 0.3296, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.36% (0.6676 => 0.6318, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.36% (0.6660 => 0.6303, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.35% (0.5567 => 0.5269, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.35% (0.3252 => 0.3078, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -5.35% (2.1401 => 2.0256, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.34% (2.1713 => 2.0553, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/except: -5.32% (0.3026 => 0.2865, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: -5.32% (0.4248 => 0.4022, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -5.32% (0.2989 => 0.2830, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.32% (0.6189 => 0.5860, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary3: -5.31% (0.3446 => 0.3263, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: -5.31% (3.5154 => 3.3289, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/ary: -5.30% (0.3394 => 0.3214, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: -5.29% (0.2871 => 0.2719, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -5.26% (0.6750 => 0.6395, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.24% (0.3491 => 0.3308, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.24% (0.5688 => 0.5390, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hello: -5.23% (0.2849 => 0.2700, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -5.23% (0.3481 => 0.3299, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.21% (0.5581 => 0.5290, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/random: -5.21% (0.2939 => 0.2786, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.20% (0.2903 => 0.2752, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -5.20% (0.3867 => 0.3666, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.20% (0.4427 => 0.4197, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.18% (0.2278 => 0.2160, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: -5.16% (0.3621 => 0.3434, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.15% (1.2221 => 1.1592, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.14% (0.7021 => 0.6660, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.14% (0.5329 => 0.5055, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.13% (0.7198 => 0.6829, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.11% (0.2933 => 0.2783, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.10% (8.0126 => 7.6036, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/05-eks/eks: -5.07% (0.4515 => 0.4286, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.06% (1.2210 => 1.1592, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wc: -5.05% (0.3205 => 0.3043, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.03% (0.2106 => 0.2000, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -5.02% (15.2527 => 14.4865, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/sieve: -5.02% (0.3788 => 0.3598, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.99% (0.2385 => 0.2266, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: -4.95% (0.3271 => 0.3109, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.94% (0.3319 => 0.3155, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.84% (5.0226 => 4.7795, std.dev.: 0.0182) MultiSource/Applications/spiff/spiff: -4.82% (0.8418 => 0.8012, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: -4.79% (0.7779 => 0.7406, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference-object: -4.46% (0.6441 => 0.6154, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -4.43% (0.6347 => 0.6066, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.22% (0.9077 => 0.8694, std.dev.: 0.0034) MultiSource/Applications/hbd/hbd: -4.10% (1.5610 => 1.4970, std.dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -2.21% (20.7746 => 20.3147, std.dev.: 0.0143) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7563, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1732, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.86% (2.2633 => 2.1759, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7068, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.24% (1.3096 => 1.2802, std.dev.: 0.0084) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4672, std.dev.: 0.0041) Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 3 08:54:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 3 Nov 2012 10:54:52 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121103155452.40B4B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5552?compare_to=5550&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5552, Order: 167356, Start Time: 2012-11-03 14:27:58, End Time: 2012-11-03 15:54:58 To: 5550, Order: 167354, Start Time: 2012-11-03 12:08:03, End Time: 2012-11-03 13:34:05 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 18 (49 on baseline) Performance Improvements: 0 (5 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 973 (920 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.11% (0.0627 => 0.0728, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.74% (0.4792 => 0.5211, std.dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.29% (0.3128 => 0.3356, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.40% (0.8167 => 0.8690, std.dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.20% (0.1919 => 0.2038, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.86% (0.6199 => 0.6500, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.02% (0.3011 => 0.3132, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.82% (0.7696 => 0.7990, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.80% (0.6183 => 0.6356, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/05-eks/eks: 2.53% (0.4391 => 0.4502, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.77% (0.5877 => 0.5981, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.56% (1.0121 => 1.0380, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.17% (22.2496 => 22.7320, std.dev.: 0.0192) SingleSource/Benchmarks/Misc/whetstone: 1.67% (2.1029 => 2.1380, std.dev.: 0.0067) MultiSource/Benchmarks/BitBench/five11/five11: 1.42% (5.5822 => 5.6615, std.dev.: 0.0235) MultiSource/Benchmarks/llubenchmark/llu: 1.27% (1.9913 => 2.0165, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.09% (1.5947 => 1.6121, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.08% (2.4795 => 2.5062, std.dev.: 0.0046) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.32% (16.6890 => 16.7422, std.dev.: 0.0593) MultiSource/Applications/obsequi/Obsequi: 1.86% (1.0317 => 1.0509, std.dev.: 0.0131) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.02% (21.5811 => 21.5768, std.dev.: 0.1326) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.19% (0.3655 => 0.3648, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/bigfib: 0.07% (0.6002 => 0.6006, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.12% (0.3326 => 0.3322, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/strcat: -2.94% (0.2040 => 0.1980, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -28.65% (0.0192 => 0.0137, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -15.26% (0.0426 => 0.0361, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 12.12% (0.0297 => 0.0333, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.54% (0.0315 => 0.0307, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 12.73% (0.0377 => 0.0425, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 46.43% (0.0140 => 0.0205, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -31.41% (0.0191 => 0.0131, std.dev.: 0.0039) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.41% (0.1470 => 0.1464, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.57% (1.1552 => 1.1371, std.dev.: 0.0278) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 5.45% (0.1414 => 0.1491, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.56% (0.4100 => 0.4077, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.49% (0.1338 => 0.1318, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 60.00% (0.0005 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 13.41% (0.0574 => 0.0651, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.54% (0.0195 => 0.0276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.55% (0.0550 => 0.0536, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.24% (1.1435 => 1.1408, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.25% (0.0608 => 0.0646, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.28% (0.0189 => 0.0233, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.17% (0.8009 => 0.8023, std.dev.: 0.0197) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 66.67% (0.0045 => 0.0075, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2301.91% (0.6332 => 15.2089, std.dev.: 0.1234) MultiSource/Benchmarks/McCat/08-main/main: 49.65% (0.1831 => 0.2740, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.48% (0.1559 => 0.1458, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1488.67% (0.3344 => 5.3125, std.dev.: 0.0384) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.18% (0.2364 => 0.3243, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: 1.40% (0.0429 => 0.0435, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.34% (0.0224 => 0.0227, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3340, std.dev.: 0.0505) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0711, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4948, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3541, std.dev.: 0.0416) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0317, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4001, std.dev.: 0.0056) SingleSource/Regression/C/uint64_to_float: -23.55% (2.1832 => 1.6690, std.dev.: 0.0045) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.78% (0.0810 => 0.0954, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.01% (0.0830 => 0.0938, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 12.86% (0.1112 => 0.1255, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.15% (0.6010 => 0.6500, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.12% (0.1885 => 0.2038, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.89% (0.2180 => 0.2352, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.51% (0.4847 => 0.5211, std.dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.98% (0.3137 => 0.3356, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.92% (0.7473 => 0.7990, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.65% (0.8148 => 0.8690, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.75% (0.2279 => 0.2410, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.52% (0.2519 => 0.2658, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.88% (1.1606 => 1.2172, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.78% (0.9435 => 0.9886, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.73% (0.2240 => 0.2346, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.30% (0.3003 => 0.3132, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.50% (1.1685 => 1.2094, std.dev.: 0.0118) MultiSource/Benchmarks/MallocBench/gs/gs: 3.39% (4.1305 => 4.2704, std.dev.: 0.0405) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.32% (0.4127 => 0.4264, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 3.26% (0.7950 => 0.8209, std.dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.01% (0.4783 => 0.4927, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.82% (0.5817 => 0.5981, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.77% (8.6476 => 8.8874, std.dev.: 0.0599) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.59% (4.1763 => 4.2846, std.dev.: 0.0205) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.39% (6.6074 => 6.7652, std.dev.: 0.0495) MultiSource/Benchmarks/McCat/05-eks/eks: 2.39% (0.4397 => 0.4502, std.dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 2.12% (1.1271 => 1.1510, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.63% (0.8697 => 0.8839, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.60% (13.1811 => 13.3919, std.dev.: 0.0788) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.37% (0.8995 => 0.9118, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 68.84% (0.0199 => 0.0336, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/pi: 58.54% (1.5795 => 2.5042, std.dev.: 0.0069) MultiSource/Applications/SIBsim4/SIBsim4: 8.18% (3.1873 => 3.4479, std.dev.: 0.0447) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.05% (1.1857 => 1.2811, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/distray/distray: 4.98% (0.2390 => 0.2509, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.83% (14.0064 => 14.6826, std.dev.: 0.0136) MultiSource/Benchmarks/sim/sim: 2.80% (3.8206 => 3.9277, std.dev.: 0.0140) MultiSource/Applications/siod/siod: 2.67% (3.6643 => 3.7621, std.dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.34% (2.4490 => 2.5062, std.dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 2.31% (63.1822 => 64.6400, std.dev.: 0.1278) SingleSource/Benchmarks/Misc/ReedSolomon: 2.15% (8.5322 => 8.7160, std.dev.: 0.0531) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.94% (22.2997 => 22.7320, std.dev.: 0.0192) MultiSource/Applications/lambda-0_1_3/lambda: 1.92% (7.4933 => 7.6374, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.73% (6.3772 => 6.4875, std.dev.: 0.0348) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.72% (28.5821 => 29.0724, std.dev.: 0.0477) MultiSource/Benchmarks/Olden/bh/bh: 1.50% (2.3560 => 2.3913, std.dev.: 0.0128) MultiSource/Benchmarks/FreeBench/neural/neural: 1.30% (1.0841 => 1.0982, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.13% (1.5941 => 1.6121, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.4647 => 2.4901, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.52% (0.3269 => 0.3056, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.02% (2.8773 => 2.7615, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout/lists: -3.36% (7.3375 => 7.0907, std.dev.: 0.0095) MultiSource/Applications/lua/lua: -2.53% (29.8330 => 29.0797, std.dev.: 0.0693) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.19% (3.3479 => 3.3079, std.dev.: 0.0066) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.80% (16.4461 => 16.7422, std.dev.: 0.0593) MultiSource/Applications/obsequi/Obsequi: 2.41% (1.0262 => 1.0509, std.dev.: 0.0131) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6809.00% (0.3123 => 21.5768, std.dev.: 0.1326) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.11% (0.2463 => 0.3648, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/bigfib: -0.07% (0.6010 => 0.6006, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.71% (0.3266 => 0.3322, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/strcat: 0.56% (0.1969 => 0.1980, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 11.38% (0.0123 => 0.0137, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -11.52% (0.0408 => 0.0361, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.66% (0.0302 => 0.0307, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -27.22% (0.0180 => 0.0131, std.dev.: 0.0039) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.81% (0.1438 => 0.1464, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.37% (1.1329 => 1.1371, std.dev.: 0.0278) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 1.98% (0.1462 => 0.1491, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.09% (0.4164 => 0.4077, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.73% (0.1369 => 0.1318, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.56% (0.0641 => 0.0651, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.54% (0.0195 => 0.0276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.27% (0.0578 => 0.0536, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.25% (1.1437 => 1.1408, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.03% (0.0627 => 0.0646, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 29.44% (0.0180 => 0.0233, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.07% (0.8017 => 0.8023, std.dev.: 0.0197) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 20.97% (0.0062 => 0.0075, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 3 08:54:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 3 Nov 2012 10:54:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121103155459.EB6252A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5553?compare_to=5549&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5553, Order: 167354, Start Time: 2012-11-03 12:39:07, End Time: 2012-11-03 15:55:04 To: 5549, Order: 167353, Start Time: 2012-11-03 06:52:54, End Time: 2012-11-03 10:11:51 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (171 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1039 (719 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.63% (0.2126 => 0.2267, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.44% (54.1066 => 54.8856, std.dev.: 0.1255) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.05% (1.3645 => 1.3502, std.dev.: 0.0048) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.48% (0.0625 => 0.0878, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.98% (0.1063 => 0.1403, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.67% (0.2969 => 0.3731, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.95% (0.1106 => 0.1382, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.76% (0.4139 => 0.5164, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 24.41% (1.5932 => 1.9821, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.90% (0.5900 => 0.7310, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.85% (0.4994 => 0.6185, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.58% (0.0547 => 0.0676) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.58% (0.0475 => 0.0587, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.39% (0.0714 => 0.0881, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.32% (0.4253 => 0.5245, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.12% (0.5000 => 0.6156, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.77% (0.0584 => 0.0717, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.30% (0.0897 => 0.1097, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.10% (0.1620 => 0.1978, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.84% (0.1021 => 0.1244, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 21.70% (0.0599 => 0.0729, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.14% (0.1107 => 0.1341, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 20.86% (0.0604 => 0.0730, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 20.57% (0.0948 => 0.1143, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.40% (0.0642 => 0.0773, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.40% (0.1103 => 0.1328, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.38% (0.0584 => 0.0703, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.27% (0.1549 => 0.1863, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/health/health: 20.22% (0.0821 => 0.0987, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 20.01% (0.1619 => 0.1943, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.95% (0.0822 => 0.0986, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.91% (0.3903 => 0.4680, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.89% (0.1604 => 0.1923, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.74% (0.1003 => 0.1201, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.90% (0.0947 => 0.1126, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.47% (0.2014 => 0.2386, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.47% (0.1462 => 0.1732, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.46% (0.2736 => 0.3241, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.28% (0.3890 => 0.4601, std.dev.: 0.0032) MultiSource/Applications/sgefa/sgefa: 18.19% (0.0808 => 0.0955, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 18.06% (0.5826 => 0.6878, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 18.02% (0.5889 => 0.6950, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 17.98% (0.1218 => 0.1437, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.82% (1.3152 => 1.5496, std.dev.: 0.0075) MultiSource/Applications/spiff/spiff: 17.80% (0.4029 => 0.4746, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.73% (0.0581 => 0.0684, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.65% (0.1088 => 0.1280, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 17.61% (0.1505 => 0.1770, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.10% (3.5627 => 4.1720, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.10% (0.2866 => 0.3356, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.07% (0.1160 => 0.1358, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 16.97% (0.5546 => 0.6487, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 16.91% (1.8794 => 2.1972, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference: 16.90% (0.7171 => 0.8383, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.79% (0.5026 => 0.5870, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.57% (1.6211 => 1.8897, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.46% (0.1968 => 0.2292, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.40% (0.4658 => 0.5422, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 16.33% (0.1421 => 0.1653, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 16.29% (0.9697 => 1.1277, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.03% (0.2738 => 0.3177, std.dev.: 0.0028) MultiSource/Applications/d/make_dparser: 15.96% (1.0781 => 1.2502, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.96% (0.3271 => 0.3793, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.93% (0.2875 => 0.3333, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.91% (0.4361 => 0.5055, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.63% (2.7292 => 3.1557, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: 15.50% (0.1284 => 0.1483, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.49% (4.4195 => 5.1041, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/fibo: 15.41% (0.2725 => 0.3145, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.38% (1.9694 => 2.2722, std.dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: 15.37% (4.2109 => 4.8583, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.34% (0.3930 => 0.4533, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hello: 15.29% (0.2714 => 0.3129, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.21% (0.2729 => 0.3144, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.18% (1.9966 => 2.2997, std.dev.: 0.0022) SingleSource/Regression/C++/ofstream_ctor: 15.15% (0.3004 => 0.3459, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: 15.13% (0.2750 => 0.3166, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 15.07% (0.2813 => 0.3237, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 15.07% (0.2780 => 0.3199, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 14.98% (0.2803 => 0.3223, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 14.95% (0.2823 => 0.3245, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 14.94% (0.9909 => 1.1389, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 14.89% (0.3096 => 0.3557, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 14.80% (0.2811 => 0.3227, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.79% (0.2792 => 0.3205, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.77% (0.3195 => 0.3667, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.77% (0.1090 => 0.1251, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.74% (0.2911 => 0.3340, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.72% (2.0673 => 2.3717, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 14.42% (23.5202 => 26.9110, std.dev.: 0.0271) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.39% (0.3488 => 0.3990, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 14.37% (0.3465 => 0.3963, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 14.36% (0.3267 => 0.3736, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 14.34% (0.3446 => 0.3940, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.25% (0.3460 => 0.3953, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 14.24% (0.3442 => 0.3932, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 14.23% (0.3317 => 0.3789, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 14.22% (0.3496 => 0.3993, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.21% (0.3469 => 0.3962, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.13% (0.3362 => 0.3837, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/ary: 14.12% (0.3258 => 0.3718, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 14.02% (0.7875 => 0.8979, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 13.99% (1.4269 => 1.6265, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.99% (0.3060 => 0.3488, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 13.91% (0.2566 => 0.2923, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/property: 13.89% (0.3650 => 0.4157, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 13.83% (0.2075 => 0.2362, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions: 13.78% (0.3643 => 0.4145, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 13.72% (0.3724 => 0.4235, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.70% (0.3124 => 0.3552, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.56% (0.3282 => 0.3727, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists: 13.53% (0.3348 => 0.3801, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/moments: 13.35% (0.3678 => 0.4169, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 13.34% (0.3726 => 0.4223, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 13.25% (2.1653 => 2.4523, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash2: 13.24% (0.4251 => 0.4814, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 13.20% (0.3477 => 0.3936, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.19% (0.3625 => 0.4103, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.17% (0.3690 => 0.4176, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 13.14% (4.6177 => 5.2244, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/hash: 13.12% (0.4146 => 0.4690, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.96% (0.3981 => 0.4497, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.82% (0.3845 => 0.4338, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 12.68% (2.1013 => 2.3677, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 12.39% (0.5012 => 0.5633, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.16% (0.2040 => 0.2288, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 11.85% (0.2691 => 0.3010, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 11.55% (5.5417 => 6.1816, std.dev.: 0.0192) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.14% (0.6435 => 0.7152, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.85% (0.1383 => 0.1533, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.70% (0.1028 => 0.1138, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 10.61% (0.3498 => 0.3869, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.40% (0.2068 => 0.2283, std.dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: 10.32% (0.4847 => 0.5347, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.31% (0.3336 => 0.3680, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 10.28% (0.6634 => 0.7316, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.27% (0.2737 => 0.3018, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.79% (0.3084 => 0.3386, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 9.47% (2.0346 => 2.2272, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.18% (0.2103 => 0.2296, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 9.03% (0.2391 => 0.2607, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.67% (4.6926 => 5.0994, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.28% (11.6398 => 12.6034, std.dev.: 0.0202) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.87% (0.5361 => 0.5783, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.31% (0.5584 => 0.5992, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.20% (0.7426 => 0.7961, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 6.39% (11.9555 => 12.7189, std.dev.: 0.0104) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.93% (0.3792 => 0.3979, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6531, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.59% (2.5769 => 3.0301, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 8.71% (0.2802 => 0.3046, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary: 6.83% (0.2122 => 0.2267, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6107, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.26% (0.3693 => 0.3924, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.02% (12.0509 => 12.6554, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1708, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-2: 3.95% (1.8057 => 1.8770, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/dry: 2.51% (14.0481 => 14.4013, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/ary3: 1.99% (15.8721 => 16.1878, std.dev.: 0.0080) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.70% (3.1722 => 3.2260, std.dev.: 0.0051) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3080, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2892, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.25% (1.0142 => 1.0269, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5141, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.08% (1.2451 => 1.2585, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5877, std.dev.: 0.0114) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.96% (2.4764 => 2.4278, std.dev.: 0.0176) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.67% (25.4195 => 16.3521, std.dev.: 0.0233) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9757, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -7.69% (35.5013 => 32.7727, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9574, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -5.58% (0.2402 => 0.2268, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -3.03% (11.2080 => 10.8682, std.dev.: 0.0450) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.87% (3.6262 => 3.5222, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.41% (17.2379 => 16.8230, std.dev.: 0.0310) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.14% (41.7953 => 40.9005, std.dev.: 0.0106) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5698, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/bh/bh: -1.55% (5.5810 => 5.4946, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7166, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.07% (3.3991 => 3.3627, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0450, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.04% (105.3826 => 104.2870, std.dev.: 0.0473) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 3 08:58:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 3 Nov 2012 10:58:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121103155813.4A07F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5554?compare_to=5551&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5554, Order: 167356, Start Time: 2012-11-03 14:33:33, End Time: 2012-11-03 15:58:16 To: 5551, Order: 167354, Start Time: 2012-11-03 12:14:18, End Time: 2012-11-03 13:39:25 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 1 (183 on baseline) Unchanged Tests: 1041 (855 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.43% (3.8591 => 3.7655, std.dev.: 0.0187) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.42% (2.0478 => 2.1179, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 2.45% (7.4937 => 7.6775, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/hash2: 2.30% (3.1932 => 3.2666, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.46% (0.1431 => 0.1310, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.72% (0.3821 => 0.3526, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -7.21% (2.4924 => 2.3126, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.75% (3.5339 => 3.2952, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.75% (0.2428 => 0.2264, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.73% (22.4056 => 20.8987, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.65% (0.3142 => 0.2933, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.64% (0.3658 => 0.3415, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.55% (0.3357 => 0.3137, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -6.46% (4.3330 => 4.0533, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.44% (0.1584 => 0.1482, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.42% (0.9542 => 0.8929, std.dev.: 0.0047) MultiSource/Applications/JM/lencod/lencod: -6.34% (16.1920 => 15.1659, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.26% (1.6474 => 1.5443, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: -6.24% (7.0961 => 6.6534, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.24% (0.1716 => 0.1609, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.19% (1.0544 => 0.9891, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -6.19% (2.4021 => 2.2534, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.17% (0.9852 => 0.9244, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.17% (0.6484 => 0.6084, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -6.16% (1.2515 => 1.1744, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -6.14% (9.2283 => 8.6621, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -6.09% (1.1450 => 1.0753, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: -6.08% (0.9179 => 0.8621, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.08% (0.1761 => 0.1654, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.07% (0.7919 => 0.7438, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -6.07% (0.1879 => 0.1765, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.03% (0.3812 => 0.3582, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/BoolLiteralTest: -6.03% (0.3834 => 0.3603, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.02% (5.4682 => 5.1388, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.02% (1.4642 => 1.3761, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -6.01% (0.3880 => 0.3647, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.00% (1.3722 => 1.2899, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.96% (0.1796 => 0.1689, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -5.95% (0.3831 => 0.3603, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.94% (1.2784 => 1.2024, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/synchronized: -5.93% (0.3896 => 0.3665, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.93% (1.2300 => 1.1571, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.93% (0.2548 => 0.2397, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.93% (0.4033 => 0.3794, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.92% (4.5069 => 4.2400, std.dev.: 0.0081) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.92% (0.3884 => 0.3654, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.92% (1.6364 => 1.5395, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions: -5.91% (0.4176 => 0.3929, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.91% (0.3891 => 0.3661, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.90% (0.2695 => 0.2536, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.88% (0.4151 => 0.3907, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.87% (0.2659 => 0.2503, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -5.86% (4.0594 => 3.8217, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.86% (4.0323 => 3.7962, std.dev.: 0.0100) SingleSource/UnitTests/ObjC/exceptions-3: -5.85% (0.3848 => 0.3623, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.82% (0.5857 => 0.5516, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -5.81% (1.1530 => 1.0860, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.81% (0.6681 => 0.6293, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.80% (4.8161 => 4.5366, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.78% (0.5591 => 0.5268, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.76% (0.7339 => 0.6916, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -5.75% (0.4280 => 0.4034, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -5.74% (15.5079 => 14.6172, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.74% (0.3483 => 0.3283, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -5.74% (0.4199 => 0.3958, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.72% (2.2587 => 2.1294, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.71% (0.6230 => 0.5874, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.70% (0.6052 => 0.5707, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.70% (0.6667 => 0.6287, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.70% (0.3406 => 0.3212, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.70% (0.2985 => 0.2815, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.69% (0.4321 => 0.4075, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.69% (0.4813 => 0.4539, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.69% (0.2355 => 0.2221, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.69% (0.6293 => 0.5935, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.69% (0.6736 => 0.6353, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.68% (4.8802 => 4.6031, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: -5.68% (17.1032 => 16.1322, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.67% (0.3931 => 0.3708, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.65% (0.6260 => 0.5906, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.63% (0.6194 => 0.5845, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.61% (14.2083 => 13.4106, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.60% (0.5999 => 0.5663, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.59% (6.7716 => 6.3932, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.58% (0.3837 => 0.3623, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -5.58% (0.7982 => 0.7537, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -5.57% (1.3148 => 1.2415, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.57% (0.5849 => 0.5523, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -5.57% (0.7447 => 0.7032, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.57% (0.5925 => 0.5595, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.57% (0.6304 => 0.5953, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -5.55% (0.3025 => 0.2857, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.53% (0.6297 => 0.5949, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.52% (0.7524 => 0.7109) MultiSource/Applications/kimwitu++/kc: -5.50% (18.2933 => 17.2864, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.50% (0.5941 => 0.5614, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.50% (0.8521 => 0.8052, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.50% (0.6033 => 0.5701, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: -5.50% (0.3581 => 0.3384, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.50% (0.5456 => 0.5156, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.49% (0.5575 => 0.5269, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.48% (0.6676 => 0.6310) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.48% (0.3849 => 0.3638, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.48% (0.6440 => 0.6087, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.48% (0.5805 => 0.5487, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.48% (0.5478 => 0.5178, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.48% (0.6446 => 0.6093, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -5.47% (1.3864 => 1.3105, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash2: -5.47% (0.4861 => 0.4595, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.46% (0.6189 => 0.5851, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.45% (0.5802 => 0.5486, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.44% (0.5168 => 0.4887, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.43% (0.5581 => 0.5278, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -5.43% (3.5154 => 3.3246, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: -5.43% (0.3446 => 0.3259, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -5.42% (0.2989 => 0.2827, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -5.42% (0.3194 => 0.3021, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.41% (0.4916 => 0.4650, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.41% (0.6395 => 0.6049, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.41% (0.6660 => 0.6300, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -5.39% (0.3394 => 0.3211, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.39% (0.9557 => 0.9042, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.39% (0.4083 => 0.3863, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.38% (0.5705 => 0.5398, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.38% (0.6395 => 0.6051, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.37% (0.2999 => 0.2838, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -5.36% (0.6750 => 0.6388, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.36% (0.5863 => 0.5549, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -5.35% (34.0927 => 32.2682, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/matrix: -5.35% (0.3255 => 0.3081, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.33% (2.1713 => 2.0555, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -5.33% (0.4524 => 0.4283, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.33% (0.5859 => 0.5547, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.32% (0.3252 => 0.3079, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.29% (0.2871 => 0.2719, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.28% (0.5570 => 0.5276, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.27% (0.3057 => 0.2896, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -5.25% (0.3026 => 0.2867, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -5.25% (2.1401 => 2.0277, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/lists: -5.25% (0.3621 => 0.3431, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -5.23% (0.3481 => 0.3299, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/moments: -5.23% (0.4248 => 0.4026, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -5.21% (0.2939 => 0.2786, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.20% (0.2903 => 0.2752, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.19% (0.5567 => 0.5278, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.17% (0.3016 => 0.2860, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: -5.17% (0.3867 => 0.3667, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -5.16% (0.2849 => 0.2702, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.15% (0.5569 => 0.5282, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.15% (0.4427 => 0.4199, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.15% (0.3323 => 0.3152, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.12% (0.5329 => 0.5056, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.12% (1.2210 => 1.1585, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.11% (0.2933 => 0.2783, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -5.10% (0.3059 => 0.2903, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.10% (0.3491 => 0.3313, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -5.09% (0.4515 => 0.4285, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.09% (0.2278 => 0.2162, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.09% (8.0126 => 7.6046, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.08% (0.5688 => 0.5399, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.07% (0.2385 => 0.2264, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.07% (0.7198 => 0.6833, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -5.06% (15.2527 => 14.4809, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.06% (0.7021 => 0.6666, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -5.05% (0.3205 => 0.3043, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -5.04% (0.3788 => 0.3597, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.99% (1.2221 => 1.1611, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.94% (0.3319 => 0.3155, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.86% (0.3271 => 0.3112, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.80% (5.0226 => 4.7813, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.80% (0.2106 => 0.2005, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: -4.79% (0.7779 => 0.7406, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.78% (0.8418 => 0.8016, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -4.44% (0.6347 => 0.6065, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -4.38% (0.6441 => 0.6159, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.14% (0.9077 => 0.8701, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -4.05% (1.5610 => 1.4978, std.dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: -2.18% (20.7746 => 20.3212, std.dev.: 0.0240) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7528, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/richards_benchmark: -8.63% (1.2842 => 1.1734, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7061, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.65% (2.2633 => 2.1808, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4735, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0010) Report Time: 2.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 3 10:38:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 3 Nov 2012 12:38:12 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121103173812.348742A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5555?compare_to=5552&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5555, Order: 167357, Start Time: 2012-11-03 16:11:48, End Time: 2012-11-03 17:38:17 To: 5552, Order: 167356, Start Time: 2012-11-03 14:27:58, End Time: 2012-11-03 15:54:58 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 2 (54 on baseline) Performance Improvements: 2 (8 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 987 (912 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.48% (0.7480 => 0.7740, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/ReedSolomon: 1.31% (8.7160 => 8.8300, std.dev.: 0.0164) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/gs/gs: -1.44% (4.2704 => 4.2090, std.dev.: 0.0127) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.15% (2.0165 => 1.9934, std.dev.: 0.0037) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.74% (16.7422 => 16.6181, std.dev.: 0.0233) MultiSource/Applications/obsequi/Obsequi: 0.96% (1.0509 => 1.0610, std.dev.: 0.0079) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.49% (21.5768 => 21.4710, std.dev.: 0.2368) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.58% (0.3648 => 0.3627, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: -0.28% (0.6006 => 0.5989, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.3322 => 0.3322, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 0.96% (0.1980 => 0.1999, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 60.58% (0.0137 => 0.0220, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 18.56% (0.0361 => 0.0428, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.11% (0.0333 => 0.0286, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.61% (0.0307 => 0.0315, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.06% (0.0425 => 0.0412, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0205 => 0.0204, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 67.18% (0.0131 => 0.0219, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -2.60% (0.1464 => 0.1426, std.dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: -0.79% (1.1371 => 1.1281, std.dev.: 0.0176) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.15% (0.1491 => 0.1459, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.41% (0.4077 => 0.3938, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.88% (0.1318 => 0.1280, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.98% (0.0651 => 0.0573, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -25.72% (0.0276 => 0.0205, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.24% (0.0536 => 0.0548, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.18% (1.1408 => 1.1428, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.23% (0.0031 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.15% (0.0646 => 0.0645, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.58% (0.0233 => 0.0253, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.54% (0.8023 => 0.7980, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -26.67% (0.0075 => 0.0055, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2292.86% (0.6332 => 15.1516, std.dev.: 0.2488) MultiSource/Benchmarks/McCat/08-main/main: 49.54% (0.1831 => 0.2738, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.81% (0.1559 => 0.1406, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1476.97% (0.3344 => 5.2734, std.dev.: 0.0583) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.70% (0.2364 => 0.3208, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel: -0.47% (0.0429 => 0.0427, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.36% (0.0224 => 0.0236, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3252, std.dev.: 0.0123) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0734, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4943, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3387, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0256, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4064, std.dev.: 0.0077) SingleSource/Regression/C/uint64_to_float: -24.05% (2.1832 => 1.6582, std.dev.: 0.0031) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.32% (0.0810 => 0.0926, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.54% (0.6010 => 0.6403, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.25% (0.7473 => 0.7940, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.14% (0.2279 => 0.2419, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.69% (0.4847 => 0.5123, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.35% (0.1905 => 0.2007, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.56% (0.9435 => 0.9865, std.dev.: 0.0063) MultiSource/Applications/spiff/spiff: 4.55% (0.7950 => 0.8312, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.28% (0.5961 => 0.6216, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.99% (0.6287 => 0.6538, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: 3.24% (1.2222 => 1.2618, std.dev.: 0.0119) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.85% (0.3717 => 0.3823, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 2.75% (1.4269 => 1.4662, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.69% (0.4127 => 0.4238, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.52% (1.3279 => 1.3614, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 2.40% (1.1271 => 1.1542, std.dev.: 0.0043) MultiSource/Applications/ClamAV/clamscan: 2.24% (14.7684 => 15.0999, std.dev.: 0.0447) MultiSource/Applications/treecc/treecc: 2.22% (1.9948 => 2.0390, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.18% (0.8340 => 0.8522, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.04% (8.6476 => 8.8241, std.dev.: 0.0501) MultiSource/Applications/lua/lua: 2.02% (3.8189 => 3.8961, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.91% (4.1763 => 4.2561, std.dev.: 0.0155) MultiSource/Benchmarks/MallocBench/gs/gs: 1.90% (4.1305 => 4.2090, std.dev.: 0.0127) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.88% (6.6074 => 6.7315, std.dev.: 0.0266) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.83% (0.8286 => 0.8438, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.69% (1.6386 => 1.6663, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.68% (0.8597 => 0.8741, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 1.67% (14.2605 => 14.4991, std.dev.: 0.0798) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.63% (0.6943 => 0.7056, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.58% (0.6834 => 0.6942, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.54% (0.8317 => 0.8445, std.dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: 1.48% (0.9810 => 0.9955, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.46% (0.8007 => 0.8124, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.37% (0.8420 => 0.8535, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.33% (0.8204 => 0.8313, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: 1.24% (31.8598 => 32.2550, std.dev.: 0.1150) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.21% (13.1811 => 13.3402, std.dev.: 0.0410) MultiSource/Benchmarks/mafft/pairlocalalign: 1.03% (8.6247 => 8.7139, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 66.83% (0.0199 => 0.0332, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/pi: 57.02% (1.5795 => 2.4802, std.dev.: 0.0134) MultiSource/Applications/SIBsim4/SIBsim4: 8.08% (3.1873 => 3.4447, std.dev.: 0.0232) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.00% (1.1857 => 1.2806, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 4.71% (14.0064 => 14.6655, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/ReedSolomon: 3.49% (8.5322 => 8.8300, std.dev.: 0.0164) MultiSource/Benchmarks/sim/sim: 2.90% (3.8206 => 3.9313, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 2.65% (3.6643 => 3.7614, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 2.14% (63.1822 => 64.5317, std.dev.: 0.1999) MultiSource/Applications/lambda-0_1_3/lambda: 2.05% (7.4933 => 7.6466, std.dev.: 0.0142) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.74% (28.5821 => 29.0780, std.dev.: 0.0880) MultiSource/Benchmarks/FreeBench/neural/neural: 1.34% (1.0841 => 1.0986) MultiSource/Benchmarks/Olden/bh/bh: 1.20% (2.3560 => 2.3843, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.07% (3.9006 => 3.9424, std.dev.: 0.0162) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.07% (4.8362 => 4.8880, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.01% (2.9096 => 2.9390, std.dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -8.70% (3.2926 => 3.0060, std.dev.: 0.0430) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.59% (0.3269 => 0.3021, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.57% (2.8773 => 2.7459, std.dev.: 0.0237) SingleSource/Benchmarks/Shootout/lists: -3.37% (7.3375 => 7.0900, std.dev.: 0.0058) MultiSource/Applications/lua/lua: -2.68% (29.8330 => 29.0345, std.dev.: 0.0881) MultiSource/Benchmarks/Olden/bisort/bisort: -2.49% (0.6636 => 0.6471, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hash2: -1.72% (3.4237 => 3.3649, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.34% (3.3479 => 3.3031, std.dev.: 0.0014) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.05% (16.4461 => 16.6181, std.dev.: 0.0233) MultiSource/Applications/obsequi/Obsequi: 3.39% (1.0262 => 1.0610, std.dev.: 0.0079) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6775.12% (0.3123 => 21.4710, std.dev.: 0.2368) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.26% (0.2463 => 0.3627, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: -0.35% (0.6010 => 0.5989, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.71% (0.3266 => 0.3322, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 1.52% (0.1969 => 0.1999, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 12.60% (0.0254 => 0.0286, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 7.29% (0.0384 => 0.0412, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.83% (0.1438 => 0.1426, std.dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: -0.42% (1.1329 => 1.1281, std.dev.: 0.0176) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.21% (0.1462 => 0.1459, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.43% (0.4164 => 0.3938, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.50% (0.1369 => 0.1280, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.61% (0.0641 => 0.0573, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.13% (0.0195 => 0.0205, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.19% (0.0578 => 0.0548, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.08% (1.1437 => 1.1428, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.87% (0.0627 => 0.0645, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 40.56% (0.0180 => 0.0253, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.46% (0.8017 => 0.7980, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -11.29% (0.0062 => 0.0055, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 3 10:45:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 3 Nov 2012 12:45:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121103174559.ACC0D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5556?compare_to=5554&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5556, Order: 167357, Start Time: 2012-11-03 16:21:15, End Time: 2012-11-03 17:46:04 To: 5554, Order: 167356, Start Time: 2012-11-03 14:33:33, End Time: 2012-11-03 15:58:16 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (183 on baseline) Unchanged Tests: 1041 (854 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.55% (54.5537 => 56.4905, std.dev.: 0.0480) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.51% (54.5751 => 56.4905, std.dev.: 0.0480) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.64% (2.0478 => 2.1019, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/salsa20: 2.54% (7.4937 => 7.6837, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 1.87% (3.1932 => 3.2528, std.dev.: 0.0106) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.46% (0.1431 => 0.1310) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.59% (0.3821 => 0.3531, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -7.19% (2.4924 => 2.3133, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.77% (3.5339 => 3.2948, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.74% (22.4056 => 20.8961, std.dev.: 0.0153) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.71% (0.2428 => 0.2265, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.70% (0.3357 => 0.3132, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.53% (0.3658 => 0.3419, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -6.53% (4.3330 => 4.0502, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.46% (0.9542 => 0.8926, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -6.32% (16.1920 => 15.1693, std.dev.: 0.0216) MultiSource/Applications/JM/ldecod/ldecod: -6.25% (7.0961 => 6.6528, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.23% (1.6474 => 1.5448, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: -6.22% (1.2515 => 1.1737, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.20% (1.0544 => 0.9890, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.19% (0.1761 => 0.1652, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.12% (9.2283 => 8.6634, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: -6.10% (0.9179 => 0.8619, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: -6.10% (1.1450 => 1.0752, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.09% (0.9852 => 0.9252, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.09% (0.7919 => 0.7437, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.08% (0.2548 => 0.2393, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.07% (5.4682 => 5.1363, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/trivial-interface: -6.06% (0.3812 => 0.3581, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.03% (0.6484 => 0.6093, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -6.03% (2.4021 => 2.2573, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.02% (1.4642 => 1.3760, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.02% (1.3722 => 1.2896, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/08-main/main: -6.02% (0.2659 => 0.2499, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: -5.99% (0.4176 => 0.3926, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.98% (0.3880 => 0.3648, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.98% (0.3831 => 0.3602, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.98% (1.2784 => 1.2020, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.96% (0.3891 => 0.3659, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.96% (4.5069 => 4.2384, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.95% (1.2300 => 1.1568, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -5.95% (0.4033 => 0.3793, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.93% (4.0323 => 3.7931, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions-3: -5.93% (0.3848 => 0.3620, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.91% (1.6364 => 1.5397, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.90% (0.1796 => 0.1690) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.90% (0.2695 => 0.2536, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.90% (0.3884 => 0.3655, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.89% (0.1716 => 0.1615, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -5.88% (0.4199 => 0.3952, std.dev.: 0.0068) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.86% (0.2355 => 0.2217, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/BoolLiteralTest: -5.84% (0.3834 => 0.3610, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.83% (0.6293 => 0.5926, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.83% (0.4151 => 0.3909, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -5.83% (0.2985 => 0.2811, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.82% (0.6681 => 0.6292, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -5.82% (4.0594 => 3.8231, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: -5.81% (1.1530 => 1.0860, std.dev.: 0.0047) MultiSource/Applications/SPASS/SPASS: -5.81% (15.5079 => 14.6073, std.dev.: 0.0118) SingleSource/UnitTests/ObjC/synchronized: -5.80% (0.3896 => 0.3670, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.80% (0.3483 => 0.3281, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -5.79% (0.4280 => 0.4032, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.79% (0.6736 => 0.6346, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.78% (4.8161 => 4.5378, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.77% (4.8802 => 4.5985, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.75% (0.7339 => 0.6917, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -5.75% (0.7447 => 0.7019, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.74% (0.5591 => 0.5270, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.72% (0.3931 => 0.3706, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.72% (0.5857 => 0.5522, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.71% (2.2587 => 2.1298, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.70% (0.6052 => 0.5707, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.70% (0.6667 => 0.6287, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.70% (0.6230 => 0.5875, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.70% (0.3406 => 0.3212, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.69% (0.6304 => 0.5945, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.69% (0.4813 => 0.4539, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.67% (0.4321 => 0.4076, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -5.67% (17.1032 => 16.1335, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.66% (0.5478 => 0.5168, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.66% (14.2083 => 13.4046, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/methcall: -5.62% (0.3025 => 0.2855, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.61% (6.7716 => 6.3914, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -5.61% (1.3148 => 1.2410, std.dev.: 0.0136) MultiSource/Applications/lambda-0_1_3/lambda: -5.61% (0.7982 => 0.7534, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.61% (0.6260 => 0.5909, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.58% (0.5999 => 0.5664, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.58% (0.3837 => 0.3623, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.57% (0.6194 => 0.5849, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.56% (0.5575 => 0.5265, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: -5.56% (0.3581 => 0.3382, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.56% (0.5849 => 0.5524, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.55% (0.8521 => 0.8048, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.54% (0.6297 => 0.5948, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.54% (0.5941 => 0.5612, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.53% (0.3849 => 0.3636, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -5.53% (0.4861 => 0.4592, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: -5.53% (18.2933 => 17.2813, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.51% (0.6676 => 0.6308, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.50% (0.5581 => 0.5274, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.49% (0.6033 => 0.5702, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.48% (0.9557 => 0.9033, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -5.48% (0.3194 => 0.3019, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.48% (0.5859 => 0.5538, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.48% (0.7524 => 0.7112, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.47% (0.4916 => 0.4647, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.46% (0.5802 => 0.5485, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.45% (0.6440 => 0.6089, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.45% (0.3323 => 0.3142, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -5.44% (0.4524 => 0.4278, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.44% (0.4083 => 0.3861, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.44% (0.2999 => 0.2836, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.43% (0.6189 => 0.5853, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -5.43% (0.3446 => 0.3259, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.43% (0.5456 => 0.5160, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -5.42% (3.5154 => 3.3248, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary: -5.42% (0.3394 => 0.3210, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -5.42% (0.2989 => 0.2827, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.41% (0.6446 => 0.6097, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -5.41% (34.0927 => 32.2474, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/matrix: -5.41% (0.3255 => 0.3079, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: -5.40% (1.3864 => 1.3115, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.40% (0.5925 => 0.5605, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.40% (0.5168 => 0.4889, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.39% (0.5863 => 0.5547, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.38% (0.3252 => 0.3077, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.38% (0.6660 => 0.6302, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.37% (0.5567 => 0.5268, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.36% (0.6395 => 0.6052, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -5.35% (0.3026 => 0.2864, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.35% (2.1713 => 2.0552, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -5.34% (2.1401 => 2.0258, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.33% (0.2871 => 0.2718, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.30% (0.2903 => 0.2749, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -5.30% (0.3867 => 0.3662, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.30% (0.3491 => 0.3306, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -5.30% (0.4248 => 0.4023, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.29% (0.6395 => 0.6057, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: -5.27% (0.2939 => 0.2784, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.27% (0.3016 => 0.2857, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.27% (0.5805 => 0.5499, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -5.26% (0.3481 => 0.3298, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -5.25% (0.3621 => 0.3431, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.24% (0.5569 => 0.5277, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.24% (0.5705 => 0.5406, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.23% (0.3057 => 0.2897, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -5.23% (0.2849 => 0.2700, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: -5.23% (0.6750 => 0.6397, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.20% (0.2385 => 0.2261, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.19% (0.5570 => 0.5281, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.18% (0.2933 => 0.2781, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.18% (0.2278 => 0.2160, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.17% (0.4427 => 0.4198, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.17% (0.7021 => 0.6658, std.dev.: 0.0050) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.12% (0.3319 => 0.3149, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.11% (8.0126 => 7.6028, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.10% (0.5329 => 0.5057, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.10% (0.5688 => 0.5398, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.09% (1.2210 => 1.1589, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.08% (0.7198 => 0.6832, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.08% (1.2221 => 1.1600, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: -5.05% (0.3205 => 0.3043, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/sieve: -5.04% (0.3788 => 0.3597, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -5.04% (15.2527 => 14.4845, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/05-eks/eks: -5.03% (0.4515 => 0.4288, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.99% (0.2106 => 0.2001, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -4.95% (0.3271 => 0.3109, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: -4.84% (0.3059 => 0.2911, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: -4.82% (0.7779 => 0.7404, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: -4.78% (5.0226 => 4.7826, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: -4.78% (0.8418 => 0.8016, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -4.54% (0.6347 => 0.6059, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.36% (0.6441 => 0.6160, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.13% (0.9077 => 0.8702, std.dev.: 0.0017) MultiSource/Applications/hbd/hbd: -4.03% (1.5610 => 1.4981, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -2.17% (20.7746 => 20.3238, std.dev.: 0.0227) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7553, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.98% (2.2633 => 2.1732, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.83% (1.7753 => 1.7073, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.14% (1.3096 => 1.2685, std.dev.: 0.0154) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4721, std.dev.: 0.0027) Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 3 12:21:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 3 Nov 2012 14:21:25 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121103192125.3B1CD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5557?compare_to=5555&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5557, Order: 167358, Start Time: 2012-11-03 17:55:09, End Time: 2012-11-03 19:21:31 To: 5555, Order: 167357, Start Time: 2012-11-03 16:11:48, End Time: 2012-11-03 17:38:17 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 2 (49 on baseline) Performance Improvements: 4 (7 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 985 (918 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 18.15% (19.4408 => 22.9694, std.dev.: 0.2735) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.85% (16.1690 => 16.9526, std.dev.: 0.1747) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.41% (0.9865 => 0.9627, std.dev.: 0.0053) MultiSource/Benchmarks/nbench/nbench: -1.68% (1.1542 => 1.1348, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.03% (1.2692 => 1.2561, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.25% (4.6506 => 4.5926, std.dev.: 0.0122) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.37% (16.6181 => 16.6799, std.dev.: 0.0853) MultiSource/Applications/obsequi/Obsequi: -1.06% (1.0610 => 1.0498, std.dev.: 0.0096) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.23% (21.4710 => 21.7344, std.dev.: 0.1285) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.05% (0.3627 => 0.3665, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 0.32% (0.5989 => 0.6008, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.69% (0.3322 => 0.3299, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: -0.75% (0.1999 => 0.1984, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -22.73% (0.0220 => 0.0170, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.47% (0.0428 => 0.0426, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.50% (0.0286 => 0.0296, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.90% (0.0315 => 0.0309, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -13.83% (0.0412 => 0.0355, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0204 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -16.44% (0.0219 => 0.0183, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 3.23% (0.1426 => 0.1472, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.12% (1.1281 => 1.1295, std.dev.: 0.0203) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 1.78% (0.1459 => 0.1485, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.30% (0.3938 => 0.4186, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.44% (0.1280 => 0.1324, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.27% (0.0573 => 0.0560, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.49% (0.0205 => 0.0206, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.37% (0.0548 => 0.0535, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.30% (1.1428 => 1.1394, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -56.67% (0.0030 => 0.0013, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.92% (0.0645 => 0.0581, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.70% (0.0253 => 0.0231, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.51% (0.7980 => 0.8021, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -14.55% (0.0055 => 0.0047, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2313.00% (0.6332 => 15.2791, std.dev.: 0.0926) MultiSource/Benchmarks/McCat/08-main/main: 45.66% (0.1831 => 0.2667, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.25% (0.1559 => 0.1446, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1491.00% (0.3344 => 5.3203, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.80% (0.2364 => 0.3234, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel: 3.50% (0.0429 => 0.0444, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.91% (0.0224 => 0.0235, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3300, std.dev.: 0.0241) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0701, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4946, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3390, std.dev.: 0.1107) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0465, std.dev.: 0.0351) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4030, std.dev.: 0.0038) SingleSource/Regression/C/uint64_to_float: -24.18% (2.1832 => 1.6552, std.dev.: 0.0033) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0008) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.95% (0.0810 => 0.0923, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/tsp/tsp: 11.96% (0.1112 => 0.1245, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.17% (0.2180 => 0.2358, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.97% (0.2279 => 0.2415, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.02% (0.6010 => 0.6312, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.34% (0.8321 => 0.8682, std.dev.: 0.0138) MultiSource/Applications/Burg/burg: 3.78% (1.2222 => 1.2684, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.17% (0.3717 => 0.3835, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.82% (0.5961 => 0.6129, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.71% (0.4127 => 0.4239, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: 2.59% (1.4269 => 1.4639, std.dev.: 0.0142) MultiSource/Applications/SIBsim4/SIBsim4: 2.22% (1.2568 => 1.2847, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.09% (1.4479 => 1.4782, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.03% (0.9435 => 0.9627, std.dev.: 0.0053) MultiSource/Applications/ClamAV/clamscan: 1.86% (14.7684 => 15.0438, std.dev.: 0.0777) MultiSource/Applications/d/make_dparser: 1.85% (3.2366 => 3.2964, std.dev.: 0.0062) MultiSource/Applications/SPASS/SPASS: 1.83% (14.2605 => 14.5218, std.dev.: 0.0426) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.76% (0.6586 => 0.6702, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.76% (0.6943 => 0.7065, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: 1.72% (31.8598 => 32.4071, std.dev.: 0.1396) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.63% (0.8697 => 0.8839, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.56% (0.9074 => 0.9216, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.56% (0.8007 => 0.8132, std.dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: 1.48% (15.3280 => 15.5551, std.dev.: 0.0464) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.42% (6.6074 => 6.7012, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.40% (0.8331 => 0.8448, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.37% (0.8805 => 0.8926, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.23% (0.9908 => 1.0030, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.17% (0.9039 => 0.9145, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 61.81% (0.0199 => 0.0322, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/pi: 55.68% (1.5795 => 2.4589, std.dev.: 0.0235) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.76% (14.6451 => 16.9526, std.dev.: 0.1747) MultiSource/Applications/SIBsim4/SIBsim4: 8.26% (3.1873 => 3.4507, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.19% (1.1857 => 1.2710, std.dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: 4.85% (14.0064 => 14.6854, std.dev.: 0.0819) MultiSource/Benchmarks/nbench/nbench: 4.57% (21.9654 => 22.9694, std.dev.: 0.2735) SingleSource/Benchmarks/Misc/ReedSolomon: 3.39% (8.5322 => 8.8216, std.dev.: 0.0031) MultiSource/Benchmarks/sim/sim: 2.94% (3.8206 => 3.9330, std.dev.: 0.0101) MultiSource/Applications/siod/siod: 2.69% (3.6643 => 3.7630, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 2.29% (63.1822 => 64.6293, std.dev.: 0.1038) MultiSource/Applications/lambda-0_1_3/lambda: 2.12% (7.4933 => 7.6521, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/bh/bh: 1.75% (2.3560 => 2.3973, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.75% (28.5821 => 29.0812, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.49% (4.8362 => 4.9085, std.dev.: 0.0188) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.37% (1.5941 => 1.6160, std.dev.: 0.0053) MultiSource/Benchmarks/PAQ8p/paq8p: 1.34% (91.7701 => 93.0034, std.dev.: 0.3296) MultiSource/Benchmarks/FreeBench/neural/neural: 1.34% (1.0841 => 1.0986) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.30% (3.9006 => 3.9512, std.dev.: 0.0119) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.20% (2.4647 => 2.4943, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.35% (0.3269 => 0.2996, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/heapsort: -5.87% (3.2926 => 3.0993, std.dev.: 0.0458) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.84% (2.8773 => 2.7667, std.dev.: 0.0344) SingleSource/Benchmarks/Shootout/lists: -3.42% (7.3375 => 7.0863, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/bisort/bisort: -2.71% (0.6636 => 0.6456, std.dev.: 0.0064) MultiSource/Applications/lua/lua: -2.51% (29.8330 => 29.0843, std.dev.: 0.1207) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.24% (3.3479 => 3.3064, std.dev.: 0.0010) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.42% (16.4461 => 16.6799, std.dev.: 0.0853) MultiSource/Applications/obsequi/Obsequi: 2.30% (1.0262 => 1.0498, std.dev.: 0.0096) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6859.46% (0.3123 => 21.7344, std.dev.: 0.1285) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.80% (0.2463 => 0.3665, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: -0.03% (0.6010 => 0.6008, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.01% (0.3266 => 0.3299, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: 0.76% (0.1969 => 0.1984, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 38.21% (0.0123 => 0.0170, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 16.54% (0.0254 => 0.0296, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.32% (0.0302 => 0.0309, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.55% (0.0384 => 0.0355, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 1.67% (0.0180 => 0.0183, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 2.36% (0.1438 => 0.1472, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.30% (1.1329 => 1.1295, std.dev.: 0.0203) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 1.57% (0.1462 => 0.1485, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.53% (0.4164 => 0.4186, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.29% (0.1369 => 0.1324, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -12.64% (0.0641 => 0.0560, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.64% (0.0195 => 0.0206, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.44% (0.0578 => 0.0535, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.38% (1.1437 => 1.1394, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.34% (0.0627 => 0.0581, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 28.33% (0.0180 => 0.0231, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.05% (0.8017 => 0.8021, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -24.19% (0.0062 => 0.0047, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 3 12:33:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 3 Nov 2012 14:33:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121103193355.EF2942A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5558?compare_to=5556&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5558, Order: 167358, Start Time: 2012-11-03 18:08:59, End Time: 2012-11-03 19:33:59 To: 5556, Order: 167357, Start Time: 2012-11-03 16:21:15, End Time: 2012-11-03 17:46:04 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (182 on baseline) Unchanged Tests: 1041 (856 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.87% (78.9363 => 80.4157, std.dev.: 0.3594) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.82% (2.0478 => 2.1055, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/salsa20: 2.34% (7.4937 => 7.6687, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/hash2: 2.15% (3.1932 => 3.2618, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.60% (0.1431 => 0.1308, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.72% (0.3821 => 0.3526, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.22% (2.4924 => 2.3125, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.74% (3.5339 => 3.2957, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.67% (0.2428 => 0.2266, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.65% (0.3142 => 0.2933, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.65% (22.4056 => 20.9158, std.dev.: 0.0118) MultiSource/Applications/sgefa/sgefa: -6.58% (0.3357 => 0.3136, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.51% (0.3658 => 0.3420, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.45% (0.9542 => 0.8927, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -6.41% (4.3330 => 4.0554, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -6.25% (16.1920 => 15.1794, std.dev.: 0.0185) MultiSource/Applications/JM/ldecod/ldecod: -6.24% (7.0961 => 6.6530, std.dev.: 0.0049) MultiSource/Applications/siod/siod: -6.19% (2.4021 => 2.2533, std.dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.16% (1.6474 => 1.5460, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -6.12% (1.1450 => 1.0749, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.11% (1.0544 => 0.9900, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: -6.10% (9.2283 => 8.6655, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.09% (0.9852 => 0.9252, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -6.08% (0.9179 => 0.8621, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.08% (0.1761 => 0.1654, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.02% (1.4642 => 1.3760, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.02% (0.7919 => 0.7442, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -6.01% (0.1879 => 0.1766, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.00% (1.3722 => 1.2898, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.00% (0.1716 => 0.1613, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -6.00% (1.2515 => 1.1764, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.00% (0.6484 => 0.6095, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.92% (5.4682 => 5.1443, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.91% (1.2784 => 1.2029, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.89% (0.2548 => 0.2398, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.87% (0.5857 => 0.5513, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -5.87% (0.2659 => 0.2503, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.85% (0.1796 => 0.1691, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.84% (1.6364 => 1.5408, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.83% (4.5069 => 4.2441, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.83% (0.4151 => 0.3909, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.81% (4.0323 => 3.7982, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.80% (1.2300 => 1.1586, std.dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: -5.80% (1.1530 => 1.0861, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.79% (0.2695 => 0.2539, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -5.76% (4.0594 => 3.8254, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/BoolLiteralTest: -5.76% (0.3834 => 0.3613, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.76% (0.7339 => 0.6916, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.76% (0.6681 => 0.6296, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -5.76% (15.5079 => 14.6148, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.74% (0.3483 => 0.3283, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.73% (0.2355 => 0.2220, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.72% (0.5591 => 0.5271, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.72% (4.8161 => 4.5406, std.dev.: 0.0091) MultiSource/Applications/sqlite3/sqlite3: -5.72% (17.1032 => 16.1254, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.70% (0.6667 => 0.6287, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.70% (0.3931 => 0.3707, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -5.70% (0.2985 => 0.2815, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.69% (0.6293 => 0.5935, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.69% (0.6736 => 0.6353, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.68% (0.6052 => 0.5708, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.68% (0.3891 => 0.3670, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.67% (0.3880 => 0.3660, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.67% (4.8802 => 4.6035, std.dev.: 0.0091) MultiSource/Applications/minisat/minisat: -5.67% (0.7447 => 0.7025, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -5.66% (0.3831 => 0.3614, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.66% (0.5478 => 0.5168, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -5.65% (0.4176 => 0.3940, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.65% (0.6194 => 0.5844, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.65% (0.6230 => 0.5878, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -5.64% (0.3812 => 0.3597, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.64% (0.5925 => 0.5591, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.63% (14.2083 => 13.4087, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.61% (0.5575 => 0.5262, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -5.61% (1.3148 => 1.2410, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: -5.61% (0.7982 => 0.7534, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.61% (0.7524 => 0.7102, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.61% (0.5849 => 0.5521, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.61% (0.6297 => 0.5944, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -5.60% (0.4199 => 0.3964, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.60% (2.2587 => 2.1323, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -5.59% (34.0927 => 32.1871, std.dev.: 0.0125) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.59% (0.3884 => 0.3667, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -5.58% (0.3406 => 0.3216, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.58% (0.4321 => 0.4080, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.57% (0.6676 => 0.6304, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -5.56% (18.2933 => 17.2753, std.dev.: 0.0151) SingleSource/UnitTests/ObjC/parameter-passing: -5.56% (0.4280 => 0.4042, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.56% (0.6260 => 0.5912, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.56% (0.6660 => 0.6290, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -5.55% (0.4033 => 0.3809, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.54% (6.7716 => 6.3963, std.dev.: 0.0107) SingleSource/UnitTests/ObjC/exceptions-3: -5.54% (0.3848 => 0.3635, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.53% (0.4813 => 0.4547, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.53% (0.5863 => 0.5539, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.52% (0.6304 => 0.5956, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: -5.50% (0.3581 => 0.3384, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.50% (0.3837 => 0.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.48% (0.3849 => 0.3638, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.48% (0.6440 => 0.6087, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: -5.47% (0.3896 => 0.3683, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.46% (0.6446 => 0.6094, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.44% (0.5456 => 0.5159, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.44% (0.5941 => 0.5618, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.43% (0.5802 => 0.5487, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.43% (0.6189 => 0.5853, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.42% (0.5999 => 0.5674, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.41% (0.5805 => 0.5491, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.40% (0.6033 => 0.5707, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.40% (0.5168 => 0.4889, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.40% (0.8521 => 0.8061, std.dev.: 0.0037) MultiSource/Applications/SIBsim4/SIBsim4: -5.40% (1.3864 => 1.3116, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.39% (0.5581 => 0.5280, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.39% (0.3025 => 0.2862, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.39% (0.3323 => 0.3144, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.38% (0.6395 => 0.6051, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.37% (0.2999 => 0.2838, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.36% (0.6395 => 0.6052, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.36% (0.5859 => 0.5545, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.35% (0.3194 => 0.3023, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.35% (0.5570 => 0.5272, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.35% (0.9557 => 0.9046, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.33% (0.4916 => 0.4654, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -5.32% (0.4248 => 0.4022, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -5.31% (0.3255 => 0.3082, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -5.31% (3.5154 => 3.3286, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -5.31% (0.4524 => 0.4284, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -5.30% (0.3394 => 0.3214, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.30% (0.3057 => 0.2895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -5.29% (0.2989 => 0.2831, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.28% (2.1713 => 2.0567, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.28% (0.5705 => 0.5404, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: -5.28% (2.1401 => 2.0272, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.27% (0.7198 => 0.6819, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.26% (0.2871 => 0.2720, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -5.26% (0.6750 => 0.6395, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -5.25% (0.3867 => 0.3664, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -5.25% (0.4861 => 0.4606, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.24% (0.5569 => 0.5277, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary2: -5.23% (0.3481 => 0.3299, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.23% (0.3252 => 0.3082, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/except: -5.22% (0.3026 => 0.2868, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.19% (0.5567 => 0.5278, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.18% (0.3491 => 0.3310, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -5.17% (0.2939 => 0.2787, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.17% (0.2903 => 0.2753, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -5.17% (0.3446 => 0.3268, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -5.16% (0.3621 => 0.3434, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.15% (0.5688 => 0.5395, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.13% (0.4427 => 0.4200, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.10% (0.5329 => 0.5057, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.09% (0.2278 => 0.2162, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.07% (0.3016 => 0.2863, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -5.07% (0.3059 => 0.2904, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -5.05% (0.2849 => 0.2705, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.05% (0.2933 => 0.2785, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.04% (1.2221 => 1.1605, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.03% (0.7021 => 0.6668, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -5.02% (15.2527 => 14.4873, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.01% (1.2210 => 1.1598, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -4.99% (0.3788 => 0.3599, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.97% (8.0126 => 7.6141, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/wc: -4.96% (0.3205 => 0.3046, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -4.92% (0.4515 => 0.4293, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.89% (5.0226 => 4.7770, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.85% (0.3319 => 0.3158, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: -4.85% (0.7779 => 0.7402, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -4.80% (0.3271 => 0.3114, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.75% (0.2106 => 0.2006, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -4.57% (0.6347 => 0.6057, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -4.54% (0.8418 => 0.8036, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: -4.39% (0.6441 => 0.6158, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.99% (1.5610 => 1.4987, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.94% (0.9077 => 0.8719, std.dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -2.02% (20.7746 => 20.3557, std.dev.: 0.0210) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7536, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/richards_benchmark: -8.73% (1.2842 => 1.1721, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.69% (2.2633 => 2.1798, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.25% (1.3096 => 1.2670, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.63% (6.5735 => 6.4661, std.dev.: 0.0045) Report Time: 2.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 3 12:59:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 3 Nov 2012 14:59:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121103195929.0EFE52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5559?compare_to=5553&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5559, Order: 167357, Start Time: 2012-11-03 16:43:21, End Time: 2012-11-03 19:59:32 To: 5553, Order: 167354, Start Time: 2012-11-03 12:39:07, End Time: 2012-11-03 15:55:04 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (171 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1042 (718 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.16% (0.0625 => 0.0876, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.51% (0.1063 => 0.1398, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.14% (0.2969 => 0.3745, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.50% (0.1106 => 0.1388, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.57% (0.4139 => 0.5156, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 24.27% (1.5932 => 1.9798, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.91% (0.4994 => 0.6188, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.77% (0.0547 => 0.0677, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.58% (0.5900 => 0.7291, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.16% (0.5000 => 0.6158, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.11% (0.0714 => 0.0879, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.00% (0.4253 => 0.5231, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.60% (0.0584 => 0.0716, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.07% (0.0897 => 0.1095, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.98% (0.1620 => 0.1976, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.74% (0.1021 => 0.1243, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 21.54% (0.0599 => 0.0728) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.32% (0.1107 => 0.1343, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 20.57% (0.0948 => 0.1143, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0584 => 0.0704, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 20.53% (0.0604 => 0.0728, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.22% (0.1103 => 0.1326, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 20.10% (0.0821 => 0.0986, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.09% (0.0642 => 0.0771, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 19.95% (0.1619 => 0.1942, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.84% (0.1003 => 0.1202, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.83% (0.3903 => 0.4677, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.83% (0.0822 => 0.0985, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.76% (0.1604 => 0.1921, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.69% (0.1549 => 0.1854, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 19.07% (0.1505 => 0.1792, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 18.59% (0.0947 => 0.1123, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.47% (0.1462 => 0.1732, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.46% (0.3890 => 0.4608, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.42% (0.2736 => 0.3240, std.dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: 18.19% (0.0808 => 0.0955, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 17.99% (0.5826 => 0.6874, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 17.98% (0.1218 => 0.1437, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.92% (0.2014 => 0.2375, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.92% (1.3152 => 1.5509, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference-object: 17.88% (0.5889 => 0.6942, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.83% (0.1088 => 0.1282, std.dev.: 0.0032) MultiSource/Applications/spiff/spiff: 17.72% (0.4029 => 0.4743, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.68% (0.1968 => 0.2316, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.38% (0.0581 => 0.0682, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.06% (0.2866 => 0.3355, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 16.97% (0.5546 => 0.6487, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.95% (3.5627 => 4.1666, std.dev.: 0.0081) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.81% (0.1160 => 0.1355, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 16.79% (1.8794 => 2.1950, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.75% (1.6211 => 1.8926, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.65% (0.5026 => 0.5863, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 16.40% (0.7171 => 0.8347, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 16.26% (0.1421 => 0.1652, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 16.24% (0.9697 => 1.1272, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.21% (0.4658 => 0.5413, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.95% (0.3930 => 0.4557, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.89% (0.4361 => 0.5054, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 15.86% (1.0781 => 1.2491, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.81% (0.3271 => 0.3788, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.79% (0.2875 => 0.3329, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.60% (2.7292 => 3.1550, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/bh/bh: 15.50% (0.1284 => 0.1483, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.47% (4.4195 => 5.1033, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.40% (1.9694 => 2.2726, std.dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 15.35% (4.2109 => 4.8573, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/fibo: 15.27% (0.2725 => 0.3141, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.26% (1.9966 => 2.3013, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.16% (0.2738 => 0.3153, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hello: 15.11% (0.2714 => 0.3124, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 15.01% (0.3004 => 0.3455, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 14.99% (0.2729 => 0.3138, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 14.98% (0.2750 => 0.3162, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 14.83% (0.9909 => 1.1379, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: 14.82% (0.2780 => 0.3192, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 14.81% (0.2823 => 0.3241, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 14.79% (0.3096 => 0.3554, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.79% (0.2792 => 0.3205, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.75% (2.0673 => 2.3723, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/methcall: 14.75% (0.2813 => 0.3228, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 14.73% (0.2566 => 0.2944, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 14.70% (0.2803 => 0.3215, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.68% (0.1090 => 0.1250, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 14.62% (0.2811 => 0.3222, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.55% (0.3195 => 0.3660, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.50% (0.2911 => 0.3333, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 14.31% (23.5202 => 26.8851, std.dev.: 0.0136) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.28% (0.3488 => 0.3986, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-4: 14.26% (0.3465 => 0.3959, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-2: 14.25% (0.3446 => 0.3937, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 14.23% (0.3267 => 0.3732, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 14.22% (0.3496 => 0.3993, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.18% (0.3442 => 0.3930, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 14.16% (0.3460 => 0.3950, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 14.10% (0.3469 => 0.3958, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 14.04% (1.4269 => 1.6272, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 13.97% (0.3258 => 0.3713, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.89% (0.3362 => 0.3829, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 13.87% (0.3317 => 0.3777, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.86% (0.3060 => 0.3484, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 13.78% (0.3650 => 0.4153, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 13.69% (0.2075 => 0.2359, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 13.67% (0.3643 => 0.4141, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.64% (0.3724 => 0.4232, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.62% (0.3282 => 0.3729, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 13.46% (0.4146 => 0.4704, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 13.44% (0.3348 => 0.3798, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.41% (0.3124 => 0.3543, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.39% (0.3845 => 0.4360, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 13.31% (2.1653 => 2.4536, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/moments: 13.30% (0.3678 => 0.4167, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 13.26% (0.3726 => 0.4220, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 13.19% (4.6177 => 5.2268, std.dev.: 0.0034) MultiSource/Applications/treecc/treecc: 13.13% (0.7875 => 0.8909, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 13.13% (0.4251 => 0.4809, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 13.11% (0.3477 => 0.3933, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.08% (0.3625 => 0.4099, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 12.89% (0.2691 => 0.3038, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.89% (0.3981 => 0.4494, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.87% (0.3690 => 0.4165, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 12.64% (2.1013 => 2.3668, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.29% (0.1383 => 0.1553, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 12.29% (0.5012 => 0.5628, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.21% (0.2040 => 0.2289, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 11.55% (5.5417 => 6.1818, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.11% (0.6435 => 0.7150, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 10.61% (0.3498 => 0.3869, std.dev.: 0.0080) MultiSource/Applications/siod/siod: 10.48% (0.6634 => 0.7329, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.31% (0.1028 => 0.1134, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.27% (0.2737 => 0.3018, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 10.17% (0.4847 => 0.5340, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.06% (0.2068 => 0.2276, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.66% (0.3084 => 0.3382, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 9.56% (0.3336 => 0.3655, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.03% (0.2103 => 0.2293, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 9.03% (0.2391 => 0.2607, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 9.00% (2.0346 => 2.2177, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.38% (4.6926 => 5.0857, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.25% (11.6398 => 12.6004, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.83% (0.5361 => 0.5781, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.22% (0.5584 => 0.5987, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.08% (0.7426 => 0.7952, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 6.16% (11.9555 => 12.6917, std.dev.: 0.0151) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.85% (0.3792 => 0.3976, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.46% (0.2162 => 0.3534, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6532, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 8.99% (0.2802 => 0.3054, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 8.58% (0.2122 => 0.2304, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6113, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.01% (12.0509 => 12.6552, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1692, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.63% (0.3693 => 0.3864, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-2: 4.03% (1.8057 => 1.8785, std.dev.: 0.0077) SingleSource/Benchmarks/Dhrystone/dry: 2.54% (14.0481 => 14.4056, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1947, std.dev.: 0.0053) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2253, std.dev.: 0.0037) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3100, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2884, std.dev.: 0.0027) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.24% (1.0142 => 1.0268, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5145, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5404, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5950, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.31% (2.4764 => 2.4440, std.dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.59% (25.4195 => 16.3717, std.dev.: 0.0256) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9753, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -7.67% (35.5013 => 32.7772, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -7.49% (0.2402 => 0.2222, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/tsp/tsp: -7.31% (2.1113 => 1.9569, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -3.48% (11.2080 => 10.8181, std.dev.: 0.0514) MultiSource/Applications/siod/siod: -2.97% (6.9842 => 6.7765, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.91% (0.6293 => 0.6110, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: -2.87% (3.6262 => 3.5222, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.54% (17.2379 => 16.7992, std.dev.: 0.0455) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.19% (41.7953 => 40.8780, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5747, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4959, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7165, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (105.3826 => 104.1903, std.dev.: 0.0662) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.09% (3.3991 => 3.3621, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0417, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 3.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 3 15:46:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 3 Nov 2012 17:46:57 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121103224657.659052A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5560?compare_to=5557&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5560, Order: 167359, Start Time: 2012-11-03 21:19:47, End Time: 2012-11-03 22:46:59 To: 5557, Order: 167358, Start Time: 2012-11-03 17:55:09, End Time: 2012-11-03 19:21:31 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 35 (86 on baseline) Performance Improvements: 3 (9 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 953 (879 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/objects/objects: 13.15% (0.0791 => 0.0895, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.91% (0.3076 => 0.3350, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.38% (0.1873 => 0.2030, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 4.42% (0.3012 => 0.3145, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.04% (0.6144 => 0.6392, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.58% (0.8682 => 0.8993, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.41% (0.4985 => 0.5155, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 3.23% (0.3188 => 0.3291, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.03% (0.7721 => 0.7955, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.68% (0.9627 => 0.9885, std.dev.: 0.0034) MultiSource/Applications/spiff/spiff: 2.68% (0.8135 => 0.8353, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (1.1910 => 1.2221, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.42% (1.3374 => 1.3697, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: 2.36% (8.4273 => 8.6261, std.dev.: 0.0514) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.30% (1.6425 => 1.6803, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.00% (0.6312 => 0.6438, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.94% (8.6565 => 8.8244, std.dev.: 0.0324) MultiSource/Applications/treecc/treecc: 1.85% (2.0312 => 2.0687, std.dev.: 0.0068) MultiSource/Applications/lua/lua: 1.72% (3.8523 => 3.9186, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.57% (0.9117 => 0.9260, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.49% (4.2277 => 4.2907, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.46% (0.8489 => 0.8613, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.39% (4.5128 => 4.5755, std.dev.: 0.0243) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.39% (4.5720 => 4.6355, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.31% (0.8325 => 0.8434, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.31% (1.2561 => 1.2725, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.30% (0.8508 => 0.8619, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 1.30% (1.1348 => 1.1495, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 14.29% (3.0993 => 3.5421, std.dev.: 0.1465) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.23% (0.3160 => 0.3357, std.dev.: 0.0055) MultiSource/Benchmarks/BitBench/drop3/drop3: 4.09% (0.2908 => 0.3027, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.07% (5.1607 => 5.3189, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.31% (2.6863 => 2.7484, std.dev.: 0.0217) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.31% (1.4565 => 1.4756, std.dev.: 0.0037) MultiSource/Benchmarks/llubenchmark/llu: 1.21% (1.9953 => 2.0195, std.dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: -1.86% (1.2664 => 1.2429, std.dev.: 0.0059) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.35% (1.2440 => 1.2272, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: -1.01% (1.4904 => 1.4753, std.dev.: 0.0057) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.19% (16.6799 => 16.6482, std.dev.: 0.0847) MultiSource/Applications/obsequi/Obsequi: 1.36% (1.0498 => 1.0641, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.63% (21.7344 => 21.5984, std.dev.: 0.5638) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.90% (0.3665 => 0.3632, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: 0.15% (0.6008 => 0.6017, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.73% (0.3299 => 0.3323, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/strcat: 0.81% (0.1984 => 0.2000, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.18% (0.0170 => 0.0168, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0426 => 0.0428, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 9.12% (0.0296 => 0.0323, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.88% (0.0309 => 0.0297, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 19.44% (0.0355 => 0.0424, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -36.45% (0.0203 => 0.0129, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/test1: 19.13% (0.0183 => 0.0218, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.02% (0.1472 => 0.1487, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -2.28% (1.1295 => 1.1037, std.dev.: 0.0224) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.28% (0.1485 => 0.1466, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.06% (0.4186 => 0.3974, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.19% (0.1324 => 0.1295, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.11% (0.0560 => 0.0583, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 34.47% (0.0206 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.68% (0.0535 => 0.0544, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.02% (1.1394 => 1.1396, std.dev.: 0.0287) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -92.31% (0.0013 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.44% (0.0581 => 0.0561, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.72% (0.0231 => 0.0197, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.25% (0.8021 => 0.8121, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -6.38% (0.0047 => 0.0044, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2290.59% (0.6332 => 15.1372, std.dev.: 0.1327) MultiSource/Benchmarks/McCat/08-main/main: 47.68% (0.1831 => 0.2704, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.06% (0.1559 => 0.1449, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1485.97% (0.3344 => 5.3035, std.dev.: 0.0762) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.34% (0.2364 => 0.3223, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel: -5.83% (0.0429 => 0.0404, std.dev.: 0.0018) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.36% (0.0224 => 0.0236, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -35.65% (0.0230 => 0.0148, std.dev.: 0.0011) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3151, std.dev.: 0.0267) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0695, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4954, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3434, std.dev.: 0.0237) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0125, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4074, std.dev.: 0.0009) SingleSource/Regression/C/uint64_to_float: -23.85% (2.1832 => 1.6626, std.dev.: 0.0251) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.27% (0.0810 => 0.0958, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.22% (0.0830 => 0.0948, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/tsp/tsp: 10.07% (0.1112 => 0.1224, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.08% (0.8321 => 0.8993, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.43% (0.2180 => 0.2342, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.23% (0.1425 => 0.1528, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.12% (0.6010 => 0.6438, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.79% (0.3137 => 0.3350, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.56% (0.1905 => 0.2030, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.56% (0.1983 => 0.2113, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.45% (0.7473 => 0.7955, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.35% (0.4847 => 0.5155, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.97% (0.2998 => 0.3177, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.71% (0.8148 => 0.8613, std.dev.: 0.0046) MultiSource/Applications/Burg/burg: 5.47% (1.2222 => 1.2891, std.dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.46% (0.1885 => 0.1988, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 5.07% (0.7950 => 0.8353, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.04% (0.2519 => 0.2646, std.dev.: 0.0032) MultiSource/Applications/sgefa/sgefa: 4.87% (0.2999 => 0.3145, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.77% (0.9435 => 0.9885, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.59% (1.1685 => 1.2221, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.07% (0.3295 => 0.3429, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 3.70% (1.9948 => 2.0687, std.dev.: 0.0068) MultiSource/Applications/hbd/hbd: 3.61% (1.4269 => 1.4784, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.36% (0.6287 => 0.6498, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.29% (0.5961 => 0.6157, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.20% (1.1606 => 1.1977, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.15% (1.3279 => 1.3697, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.82% (0.5817 => 0.5981, std.dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.78% (0.4783 => 0.4916, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.77% (0.3717 => 0.3820, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.76% (0.4127 => 0.4241, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.74% (4.1763 => 4.2907, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.65% (0.6227 => 0.6392, std.dev.: 0.0024) MultiSource/Applications/ClamAV/clamscan: 2.63% (14.7684 => 15.1570, std.dev.: 0.0185) MultiSource/Applications/lua/lua: 2.61% (3.8189 => 3.9186, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.54% (1.6386 => 1.6803, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: 2.47% (8.4179 => 8.6261, std.dev.: 0.0514) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.36% (0.8420 => 0.8619, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.25% (6.6074 => 6.7563, std.dev.: 0.0306) MultiSource/Applications/SIBsim4/SIBsim4: 2.25% (1.2568 => 1.2851, std.dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 2.20% (15.3280 => 15.6654, std.dev.: 0.0597) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.20% (4.4880 => 4.5867, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.11% (0.9069 => 0.9260, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.04% (8.6476 => 8.8244, std.dev.: 0.0324) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.01% (1.4479 => 1.4770, std.dev.: 0.0080) MultiSource/Benchmarks/nbench/nbench: 1.99% (1.1271 => 1.1495, std.dev.: 0.0042) MultiSource/Applications/siod/siod: 1.97% (2.2184 => 2.2621, std.dev.: 0.0168) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.97% (4.4873 => 4.5755, std.dev.: 0.0243) MultiSource/Applications/hexxagon/hexxagon: 1.96% (0.9810 => 1.0002, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.93% (0.6834 => 0.6966, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.77% (0.8716 => 0.8870, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.70% (0.8007 => 0.8143, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.69% (0.8086 => 0.8223, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.68% (0.8457 => 0.8599, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.68% (0.8697 => 0.8843, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.66% (0.8050 => 0.8184, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.62% (0.8597 => 0.8736, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.59% (1.2526 => 1.2725, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.57% (0.8331 => 0.8462, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/football/football: 1.55% (0.8768 => 0.8904, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.55% (0.8340 => 0.8469, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.43% (0.9908 => 1.0050, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.43% (4.5702 => 4.6355, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.42% (0.8316 => 0.8434, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.37% (0.9074 => 0.9198, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.25% (0.8805 => 0.8915, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.25% (0.8177 => 0.8279, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.23% (0.8286 => 0.8388, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.17% (0.8656 => 0.8757, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 56.57% (1.5795 => 2.4731, std.dev.: 0.0144) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.61% (14.6451 => 16.4924, std.dev.: 0.4352) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.12% (1.1857 => 1.2820, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 8.05% (3.1873 => 3.4438, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.37% (0.3186 => 0.3357, std.dev.: 0.0055) MultiSource/Benchmarks/BitBench/drop3/drop3: 4.85% (0.2887 => 0.3027, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 4.63% (14.0064 => 14.6547, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/ReedSolomon: 3.46% (8.5322 => 8.8272, std.dev.: 0.0032) MultiSource/Benchmarks/sim/sim: 2.83% (3.8206 => 3.9288, std.dev.: 0.0099) MultiSource/Applications/siod/siod: 2.54% (3.6643 => 3.7574, std.dev.: 0.0168) MultiSource/Benchmarks/mafft/pairlocalalign: 2.19% (63.1822 => 64.5638, std.dev.: 0.1701) MultiSource/Applications/lambda-0_1_3/lambda: 1.96% (7.4933 => 7.6402, std.dev.: 0.0046) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.74% (28.5821 => 29.0786, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.51% (1.4536 => 1.4756, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: 1.32% (1.0841 => 1.0984, std.dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 1.14% (1.9967 => 2.0195, std.dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -31.66% (0.0338 => 0.0231, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.50% (0.3269 => 0.2991, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/lists: -3.42% (7.3375 => 7.0862, std.dev.: 0.0104) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.07% (1.2822 => 1.2429, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/bisort/bisort: -2.97% (0.6636 => 0.6439, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: -2.60% (8.4326 => 8.2130, std.dev.: 0.0816) MultiSource/Applications/lua/lua: -2.58% (29.8330 => 29.0637, std.dev.: 0.0975) SingleSource/Benchmarks/Shootout-C++/hash2: -1.48% (3.4237 => 3.3731, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.36% (3.3479 => 3.3025, std.dev.: 0.0018) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.23% (16.4461 => 16.6482, std.dev.: 0.0847) MultiSource/Applications/obsequi/Obsequi: 3.69% (1.0262 => 1.0641, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6815.91% (0.3123 => 21.5984, std.dev.: 0.5638) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.46% (0.2463 => 0.3632, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: 0.12% (0.6010 => 0.6017, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.75% (0.3266 => 0.3323, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/strcat: 1.57% (0.1969 => 0.2000, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 36.59% (0.0123 => 0.0168, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 27.17% (0.0254 => 0.0323, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.66% (0.0302 => 0.0297, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -32.11% (0.0190 => 0.0129, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 3.41% (0.1438 => 0.1487, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -2.58% (1.1329 => 1.1037, std.dev.: 0.0224) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.27% (0.1462 => 0.1466, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.56% (0.4164 => 0.3974, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.41% (0.1369 => 0.1295, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.05% (0.0641 => 0.0583, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.88% (0.0578 => 0.0544, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.36% (1.1437 => 1.1396, std.dev.: 0.0287) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.53% (0.0627 => 0.0561, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.44% (0.0180 => 0.0197, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.30% (0.8017 => 0.8121, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -29.03% (0.0062 => 0.0044, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 4.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 3 15:50:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 3 Nov 2012 17:50:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121103225019.44B202A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5561?compare_to=5558&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5561, Order: 167359, Start Time: 2012-11-03 21:25:36, End Time: 2012-11-03 22:50:23 To: 5558, Order: 167358, Start Time: 2012-11-03 18:08:59, End Time: 2012-11-03 19:33:59 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (6 on baseline) Performance Improvements: 0 (183 on baseline) Unchanged Tests: 1040 (853 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.83% (54.5236 => 56.6132, std.dev.: 0.0175) MultiSource/Benchmarks/llubenchmark/llu: 2.30% (3.7589 => 3.8455, std.dev.: 0.0262) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.73% (54.5751 => 56.6132, std.dev.: 0.0175) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.74% (2.0478 => 2.1040, std.dev.: 0.0109) MultiSource/Benchmarks/llubenchmark/llu: 2.72% (3.7435 => 3.8455, std.dev.: 0.0262) SingleSource/Benchmarks/Misc/salsa20: 2.51% (7.4937 => 7.6818, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 2.28% (3.1932 => 3.2660, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.60% (0.1431 => 0.1308, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.75% (0.3821 => 0.3525, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -7.16% (2.4924 => 2.3139, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.72% (3.5339 => 3.2964, std.dev.: 0.0146) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.66% (22.4056 => 20.9143, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.63% (0.2428 => 0.2267, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.52% (0.3142 => 0.2937, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.49% (0.3357 => 0.3139, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.48% (0.3658 => 0.3421, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -6.40% (4.3330 => 4.0558, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.36% (0.9542 => 0.8935, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.31% (0.1584 => 0.1484, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -6.26% (16.1920 => 15.1780, std.dev.: 0.0105) MultiSource/Applications/JM/ldecod/ldecod: -6.21% (7.0961 => 6.6554, std.dev.: 0.0086) MultiSource/Applications/Burg/burg: -6.16% (1.2515 => 1.1744, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -6.13% (1.1450 => 1.0748, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.12% (1.6474 => 1.5465, std.dev.: 0.0063) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.12% (0.1716 => 0.1611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.11% (1.0544 => 0.9900, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.07% (0.9852 => 0.9254, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -6.07% (0.1879 => 0.1765, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -6.02% (0.9179 => 0.8626, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.02% (0.1761 => 0.1655, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.01% (0.6484 => 0.6094, std.dev.: 0.0024) MultiSource/Applications/siod/siod: -6.01% (2.4021 => 2.2578, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: -6.01% (9.2283 => 8.6740, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.96% (1.4642 => 1.3770, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.93% (0.4151 => 0.3905, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.93% (5.4682 => 5.1442, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.91% (1.2784 => 1.2029, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.90% (0.1796 => 0.1690) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.90% (0.7919 => 0.7452, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.88% (1.3722 => 1.2915, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -5.86% (1.1530 => 1.0854, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.86% (0.2695 => 0.2537, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.85% (0.2548 => 0.2399, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.83% (4.5069 => 4.2441, std.dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.80% (1.2300 => 1.1587, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: -5.79% (0.2659 => 0.2505, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.79% (0.5857 => 0.5518, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.78% (4.0323 => 3.7993, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.77% (1.6364 => 1.5419, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -5.75% (17.1032 => 16.1202, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.75% (4.8161 => 4.5393, std.dev.: 0.0007) MultiSource/Applications/lua/lua: -5.74% (4.0594 => 3.8264, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.73% (0.2355 => 0.2220, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.71% (0.6304 => 0.5944, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.71% (0.7339 => 0.6920, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.70% (0.6681 => 0.6300, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.70% (0.6736 => 0.6352, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -5.69% (0.7447 => 0.7023, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.67% (0.6052 => 0.5709, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.66% (0.5849 => 0.5518, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: -5.66% (15.5079 => 14.6307, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.65% (0.5802 => 0.5474, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.65% (0.5591 => 0.5275, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/exceptions: -5.65% (0.4176 => 0.3940, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.65% (0.4321 => 0.4077, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -5.64% (0.3880 => 0.3661, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.63% (0.4813 => 0.4542, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.63% (0.3891 => 0.3672, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -5.63% (0.2985 => 0.2817, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.63% (0.3483 => 0.3287, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.62% (0.7524 => 0.7101, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.62% (0.6297 => 0.5943, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.62% (0.6230 => 0.5880, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -5.61% (0.3812 => 0.3598, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -5.61% (0.3406 => 0.3215, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.60% (0.4033 => 0.3807, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.60% (0.6194 => 0.5847, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.60% (4.8802 => 4.6071, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.59% (0.3884 => 0.3667, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.59% (0.3831 => 0.3617, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -5.57% (1.3148 => 1.2415, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.57% (0.5925 => 0.5595, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.57% (0.6446 => 0.6087, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: -5.57% (18.2933 => 17.2752, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.56% (0.5859 => 0.5533, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -5.56% (0.3848 => 0.3634, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.56% (0.5575 => 0.5265, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.56% (0.6660 => 0.6290, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -5.55% (34.0927 => 32.1999, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.55% (0.6667 => 0.6297, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.54% (0.6260 => 0.5913, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.53% (14.2083 => 13.4224, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.50% (0.5705 => 0.5391, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -5.50% (0.4199 => 0.3968, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -5.50% (0.7982 => 0.7543, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.50% (0.6440 => 0.6086, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.49% (2.2587 => 2.1346, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.49% (0.8521 => 0.8053, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -5.49% (0.4280 => 0.4045, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.47% (0.6676 => 0.6311, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: -5.47% (0.3896 => 0.3683, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: -5.46% (1.3864 => 1.3107, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.46% (0.6395 => 0.6046, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.45% (0.6033 => 0.5704, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: -5.45% (0.3581 => 0.3386, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.44% (0.5567 => 0.5264, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: -5.43% (0.3446 => 0.3259, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.42% (0.5863 => 0.5545, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -5.42% (0.3025 => 0.2861, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.42% (0.5999 => 0.5674, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.41% (6.7716 => 6.4052, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.40% (0.3849 => 0.3641, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.40% (0.6189 => 0.5855, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.39% (0.3931 => 0.3719, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.39% (0.4083 => 0.3863, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.39% (0.3323 => 0.3144, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.39% (0.5570 => 0.5270, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.37% (0.5805 => 0.5493, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -5.37% (0.4861 => 0.4600, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -5.35% (0.2989 => 0.2829, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.35% (0.5456 => 0.5164, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -5.35% (0.4524 => 0.4282, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.34% (0.3837 => 0.3632, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.34% (0.6293 => 0.5957, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.32% (0.3194 => 0.3024, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -5.30% (0.6750 => 0.6392, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -5.30% (0.3394 => 0.3214, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.30% (0.5168 => 0.4894, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -5.29% (3.5154 => 3.3294, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.29% (0.4916 => 0.4656, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.27% (2.1713 => 2.0569, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.27% (0.2999 => 0.2841, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.26% (0.9557 => 0.9054, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -5.25% (0.3026 => 0.2867, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.25% (0.3255 => 0.3084, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.23% (0.3057 => 0.2897, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.23% (0.3252 => 0.3082, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.23% (0.5569 => 0.5278, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.22% (0.5941 => 0.5631, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.21% (0.3491 => 0.3309, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -5.20% (0.3481 => 0.3300, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -5.19% (0.2871 => 0.2722, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -5.19% (2.1401 => 2.0291, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.19% (0.5688 => 0.5393, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -5.16% (0.3621 => 0.3434, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -5.16% (0.4248 => 0.4029, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -5.15% (0.3867 => 0.3668, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.14% (0.6395 => 0.6066, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.14% (0.7021 => 0.6660, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.14% (0.2278 => 0.2161, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.13% (0.4427 => 0.4200, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -5.12% (0.3205 => 0.3041, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -5.09% (0.2849 => 0.2704, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.09% (0.5329 => 0.5058, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.07% (0.3016 => 0.2863, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.07% (0.2939 => 0.2790, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.05% (0.5581 => 0.5299, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.03% (0.2903 => 0.2757, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.01% (0.2933 => 0.2786, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/BoolLiteralTest: -5.01% (0.3834 => 0.3642, std.dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: -4.99% (15.2527 => 14.4916, std.dev.: 0.0189) SingleSource/Benchmarks/Shootout-C++/sieve: -4.99% (0.3788 => 0.3599, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -4.96% (0.4515 => 0.4291, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.94% (1.2221 => 1.1617, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.89% (8.0126 => 7.6204, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.88% (0.3319 => 0.3157, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.88% (0.7198 => 0.6847, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.87% (0.3059 => 0.2910, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -4.85% (0.7779 => 0.7402, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.84% (0.2106 => 0.2004, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.80% (5.0226 => 4.7813, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.71% (1.2210 => 1.1635, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: -4.71% (0.3271 => 0.3117, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: -4.61% (0.8418 => 0.8030, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: -4.54% (0.6347 => 0.6059, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.38% (0.6441 => 0.6159, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.01% (0.9077 => 0.8713, std.dev.: 0.0017) MultiSource/Applications/hbd/hbd: -3.93% (1.5610 => 1.4997, std.dev.: 0.0029) SingleSource/UnitTests/Vector/constpool: -1.96% (20.7746 => 20.3678, std.dev.: 0.0187) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7569, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: -8.68% (1.2842 => 1.1727, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.84% (2.2633 => 2.1765, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.44% (1.3096 => 1.2776, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.46% (6.5735 => 6.4772, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0001) Report Time: 2.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 3 17:03:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 3 Nov 2012 19:03:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121104000359.CC2DE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5562?compare_to=5559&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5562, Order: 167358, Start Time: 2012-11-03 20:47:56, End Time: 2012-11-04 00:04:05 To: 5559, Order: 167357, Start Time: 2012-11-03 16:43:21, End Time: 2012-11-03 19:59:32 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (169 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (721 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.55% (125.7869 => 130.2525, std.dev.: 0.8828) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.52% (0.0625 => 0.0872, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.95% (0.1063 => 0.1392, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.67% (0.2969 => 0.3731, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.23% (0.1106 => 0.1385, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.26% (0.4139 => 0.5143, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.95% (0.5900 => 0.7313, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 23.93% (1.5932 => 1.9744, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.56% (0.4253 => 0.5255, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.51% (0.4994 => 0.6168, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.39% (0.0714 => 0.0881, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.88% (0.5000 => 0.6144, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.85% (0.0547 => 0.0672, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.26% (0.0584 => 0.0714, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.85% (0.0897 => 0.1093, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.54% (0.1620 => 0.1969, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.45% (0.1021 => 0.1240, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.96% (0.1107 => 0.1339, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 20.78% (0.0948 => 0.1145, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.09% (0.0642 => 0.0771, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.06% (0.0633 => 0.0760, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.04% (0.1103 => 0.1324, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/health/health: 19.85% (0.0821 => 0.0984, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.81% (0.3903 => 0.4676, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 19.70% (0.1619 => 0.1938, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.69% (0.0584 => 0.0699, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 19.54% (0.0604 => 0.0722, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.44% (0.1003 => 0.1198, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.43% (0.1549 => 0.1850, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.34% (0.0822 => 0.0981, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.33% (0.1604 => 0.1914, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.62% (0.1160 => 0.1376, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 18.54% (0.5826 => 0.6906, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.54% (0.1462 => 0.1733, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 18.48% (0.0947 => 0.1122, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: 18.37% (0.5889 => 0.6971, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 18.27% (0.1505 => 0.1780, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.20% (0.2736 => 0.3234, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 18.07% (0.0808 => 0.0954, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 17.90% (0.1218 => 0.1436) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.89% (0.3890 => 0.4586, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.69% (1.3152 => 1.5479, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.58% (0.2014 => 0.2368, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 17.42% (0.4029 => 0.4731, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.37% (0.1088 => 0.1277, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 17.05% (0.0698 => 0.0817, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 17.02% (0.5546 => 0.6490, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.89% (0.2866 => 0.3350, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 16.89% (0.7171 => 0.8382, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 16.87% (1.8794 => 2.1965, std.dev.: 0.0231) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.76% (3.5627 => 4.1599, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.21% (0.1968 => 0.2287, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.20% (1.6211 => 1.8837, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.17% (0.4658 => 0.5411, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 16.12% (0.1421 => 0.1650) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.00% (0.2875 => 0.3335, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.93% (0.3271 => 0.3792, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 15.89% (0.9697 => 1.1238, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.76% (0.5026 => 0.5818, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.60% (0.2738 => 0.3165, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 15.56% (1.0781 => 1.2459, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.43% (4.4195 => 5.1014, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: 15.42% (0.1284 => 0.1482, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 15.41% (0.2725 => 0.3145, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.41% (0.4361 => 0.5033, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.39% (2.7292 => 3.1492, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: 15.36% (0.2714 => 0.3131, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.24% (0.2729 => 0.3145, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 15.24% (4.2109 => 4.8527, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/strcat: 15.20% (0.2750 => 0.3168, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 15.14% (0.2780 => 0.3201, std.dev.: 0.0023) SingleSource/Regression/C++/ofstream_ctor: 15.11% (0.3004 => 0.3458, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 15.09% (0.2803 => 0.3226, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.06% (0.3930 => 0.4522, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/except: 15.01% (0.2811 => 0.3233, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 15.00% (0.2813 => 0.3235, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.98% (1.9694 => 2.2645, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/objinst: 14.98% (0.2823 => 0.3246, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 14.95% (0.3096 => 0.3559, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.94% (0.2792 => 0.3209, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.91% (0.2911 => 0.3345, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.90% (0.3195 => 0.3671, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 14.90% (0.9909 => 1.1385, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.84% (2.0673 => 2.3740, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.76% (1.9966 => 2.2913, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary3: 14.45% (0.3267 => 0.3739, std.dev.: 0.0051) MultiSource/Benchmarks/Bullet/bullet: 14.37% (23.5202 => 26.9009, std.dev.: 0.0317) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.31% (0.1090 => 0.1246, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.25% (0.3362 => 0.3841, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: 14.24% (0.3496 => 0.3994, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.22% (0.3060 => 0.3495, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 14.20% (0.3465 => 0.3957, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 14.18% (0.3258 => 0.3720, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 14.13% (0.3446 => 0.3933, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.12% (0.3442 => 0.3928, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 14.11% (0.3317 => 0.3785, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.11% (0.3488 => 0.3980, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.10% (0.3845 => 0.4387, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 14.07% (0.2566 => 0.2927, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 14.05% (0.3460 => 0.3946, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 14.01% (0.3469 => 0.3955, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.86% (0.3124 => 0.3557, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 13.84% (0.4146 => 0.4720, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.77% (0.3282 => 0.3734, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 13.69% (0.2075 => 0.2359, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.67% (0.3650 => 0.4149, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 13.67% (0.3643 => 0.4141, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 13.66% (1.4269 => 1.6218, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/parameter-passing: 13.59% (0.3724 => 0.4230, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/lists: 13.56% (0.3348 => 0.3802, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 13.43% (0.3678 => 0.4172, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 13.36% (0.7875 => 0.8927, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 13.34% (0.3477 => 0.3941, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 13.34% (0.3726 => 0.4223, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.30% (0.3625 => 0.4107, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 13.28% (2.1653 => 2.4529, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 13.27% (0.4251 => 0.4815, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.16% (0.3981 => 0.4505, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.06% (0.3690 => 0.4172, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 13.01% (4.6177 => 5.2186, std.dev.: 0.0140) SingleSource/Benchmarks/Misc-C++/bigfib: 12.47% (0.5012 => 0.5637, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 12.42% (2.1013 => 2.3623, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.16% (0.2040 => 0.2288, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 11.71% (0.2691 => 0.3006, std.dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 11.38% (5.5417 => 6.1721, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.11% (0.6435 => 0.7150, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.70% (0.1383 => 0.1531, std.dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 10.52% (0.3498 => 0.3866, std.dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: 10.30% (0.4847 => 0.5346, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.23% (0.2737 => 0.3017, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 10.22% (0.6634 => 0.7312, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.20% (0.2068 => 0.2279, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.89% (0.3084 => 0.3389, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 9.65% (0.3336 => 0.3658, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.08% (0.2103 => 0.2294, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 9.06% (2.0346 => 2.2190, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: 8.99% (0.2391 => 0.2606, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.49% (4.6926 => 5.0912, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.31% (11.6398 => 12.6069, std.dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.98% (0.5361 => 0.5789, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.27% (0.5584 => 0.5990, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.23% (0.7426 => 0.7963, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 6.25% (11.9555 => 12.7027, std.dev.: 0.0188) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.83% (0.3792 => 0.3975, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.37% (0.2162 => 0.3532, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.26% (0.0734 => 0.0868, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 9.17% (0.2802 => 0.3059, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6114, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 5.98% (0.2122 => 0.2249, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 5.02% (12.0509 => 12.6564, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1670, std.dev.: 0.0204) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.98% (0.3693 => 0.3840, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-2: 3.84% (1.8057 => 1.8751, std.dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: 2.56% (14.0481 => 14.4081, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: 2.00% (15.8721 => 16.1889, std.dev.: 0.0082) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.61% (3.1722 => 3.2233, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.47% (7.1849 => 7.2902, std.dev.: 0.0017) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3022, std.dev.: 0.0055) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.21% (1.0142 => 1.0265, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5140, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5818, std.dev.: 0.0130) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.02% (1.2451 => 1.2578, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.47% (25.4195 => 16.4026, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary2: -8.95% (0.2402 => 0.2187, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9771, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.66% (35.5013 => 32.7804, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: -7.21% (2.1113 => 1.9591, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -3.72% (3.3665 => 3.2414, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.00% (0.6293 => 0.6104, std.dev.: 0.0068) MultiSource/Applications/siod/siod: -2.97% (6.9842 => 6.7766, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.92% (11.2080 => 10.8804, std.dev.: 0.0354) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5219, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: -2.35% (17.2379 => 16.8322, std.dev.: 0.0196) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.13% (41.7953 => 40.9056, std.dev.: 0.0150) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5710, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/bh/bh: -1.55% (5.5810 => 5.4947, std.dev.: 0.0085) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7166, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1758, std.dev.: 0.0534) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.09% (3.3991 => 3.3622, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0408, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 3 17:30:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 3 Nov 2012 19:30:13 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121104003013.A9BD72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5563?compare_to=5560&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5563, Order: 167363, Start Time: 2012-11-03 23:03:51, End Time: 2012-11-04 00:30:19 To: 5560, Order: 167359, Start Time: 2012-11-03 21:19:47, End Time: 2012-11-03 22:46:59 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 6 (66 on baseline) Performance Improvements: 7 (12 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 978 (896 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 13.88% (0.7661 => 0.8724, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.73% (3.0272 => 3.2612, std.dev.: 0.0391) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.70% (2.4266 => 2.5165, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.46% (0.3357 => 0.3473, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 2.61% (0.6272 => 0.6436, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones/fhourstones: 1.57% (1.2429 => 1.2624, std.dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.13% (8.6261 => 8.3563, std.dev.: 0.0972) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.03% (0.6438 => 0.6243, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.07% (1.3697 => 1.3551, std.dev.: 0.0047) MultiSource/Benchmarks/PAQ8p/paq8p: -1.06% (2.4160 => 2.3903, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.00% (4.2907 => 4.2477, std.dev.: 0.0136) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -13.84% (3.5421 => 3.0517, std.dev.: 0.1182) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.71% (42.6101 => 41.4564, std.dev.: 0.3636) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.11% (16.6482 => 16.6666, std.dev.: 0.0613) MultiSource/Applications/obsequi/Obsequi: -0.39% (1.0641 => 1.0600, std.dev.: 0.0158) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.34% (21.5984 => 21.5259, std.dev.: 0.2054) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.14% (0.3632 => 0.3627, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 1.03% (0.6017 => 0.6079, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.36% (0.3323 => 0.3335, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/strcat: 0.90% (0.2000 => 0.2018, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -18.45% (0.0168 => 0.0137, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.17% (0.0428 => 0.0423, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -4.64% (0.0323 => 0.0308, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.05% (0.0297 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.94% (0.0424 => 0.0420, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 50.39% (0.0129 => 0.0194, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -39.45% (0.0218 => 0.0132, std.dev.: 0.0042) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -1.14% (0.1487 => 0.1470, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.87% (1.1037 => 1.1133, std.dev.: 0.0195) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000) MultiSource/Applications/oggenc/oggenc: -4.09% (0.1466 => 0.1406, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.59% (0.3974 => 0.4236, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.32% (0.1295 => 0.1338, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.43% (0.0583 => 0.0638, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -33.21% (0.0277 => 0.0185, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.37% (0.0544 => 0.0542, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.23% (1.1396 => 1.1422, std.dev.: 0.0622) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.06% (0.0561 => 0.0595, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.81% (0.0197 => 0.0156, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.40% (0.8121 => 0.8007, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 6.82% (0.0044 => 0.0047, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2301.83% (0.6332 => 15.2084, std.dev.: 0.0670) MultiSource/Benchmarks/McCat/08-main/main: 47.79% (0.1831 => 0.2706, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.70% (0.1559 => 0.1439, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1483.31% (0.3344 => 5.2946, std.dev.: 0.0175) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.55% (0.2364 => 0.3228, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: 1.63% (0.0429 => 0.0436, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.02% (0.0224 => 0.0233, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3334, std.dev.: 0.0380) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0700, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4944, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3431, std.dev.: 0.0276) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0441, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4031, std.dev.: 0.0077) SingleSource/Regression/C/uint64_to_float: -24.01% (2.1832 => 1.6590, std.dev.: 0.0037) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.33% (0.0810 => 0.0918, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/tsp/tsp: 12.77% (0.1112 => 0.1254, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.05% (0.8321 => 0.9074, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.90% (0.2279 => 0.2459, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.79% (0.2180 => 0.2328, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.85% (0.1983 => 0.2099, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 5.54% (1.2222 => 1.2899, std.dev.: 0.0087) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.48% (0.3137 => 0.3309, std.dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 4.33% (0.2999 => 0.3129, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.88% (0.6010 => 0.6243, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.56% (0.6287 => 0.6511, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.55% (0.4783 => 0.4953, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.53% (0.3003 => 0.3109, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.43% (0.3295 => 0.3408, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 3.26% (0.7950 => 0.8209, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.93% (0.4127 => 0.4248, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.90% (1.1685 => 1.2024, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.85% (0.4559 => 0.4689, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.49% (1.1606 => 1.1895, std.dev.: 0.0089) MultiSource/Applications/treecc/treecc: 2.40% (1.9948 => 2.0426, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.39% (0.8340 => 0.8539, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.33% (1.4479 => 1.4816, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.25% (0.6227 => 0.6367, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.22% (6.6074 => 6.7539, std.dev.: 0.0163) MultiSource/Applications/d/make_dparser: 2.10% (3.2366 => 3.3046, std.dev.: 0.0100) MultiSource/Applications/JM/ldecod/ldecod: 2.06% (6.7320 => 6.8710, std.dev.: 0.0374) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.05% (1.3279 => 1.3551, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.88% (0.6586 => 0.6710, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.82% (1.6386 => 1.6684, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.71% (4.1763 => 4.2477, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.70% (4.4873 => 4.5634, std.dev.: 0.0115) MultiSource/Applications/minisat/minisat: 1.68% (0.6834 => 0.6949, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.66% (0.8597 => 0.8740, std.dev.: 0.0053) MultiSource/Applications/lua/lua: 1.65% (3.8189 => 3.8818, std.dev.: 0.0178) MultiSource/Applications/SPASS/SPASS: 1.63% (14.2605 => 14.4928, std.dev.: 0.0559) MultiSource/Applications/oggenc/oggenc: 1.59% (4.9628 => 5.0417, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.58% (8.6476 => 8.7845, std.dev.: 0.0400) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.41% (1.2526 => 1.2703, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.38% (2.1401 => 2.1697, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.32% (0.8286 => 0.8395, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/football/football: 1.30% (0.8768 => 0.8882, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: 1.30% (4.1305 => 4.1842, std.dev.: 0.0149) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.30% (4.5702 => 4.6294, std.dev.: 0.0064) MultiSource/Benchmarks/nbench/nbench: 1.17% (1.1271 => 1.1403, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 1.03% (1.0945 => 1.1058, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 68.84% (0.0199 => 0.0336, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/pi: 56.55% (1.5795 => 2.4727, std.dev.: 0.0160) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.37% (14.6451 => 16.3103, std.dev.: 0.6041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.01% (0.3186 => 0.3473, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.11% (1.1857 => 1.2819, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 8.08% (3.1873 => 3.4449, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.87% (3.0515 => 3.2612, std.dev.: 0.0391) MultiSource/Applications/hexxagon/hexxagon: 4.76% (14.0064 => 14.6726, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash: 3.72% (0.6205 => 0.6436, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/ReedSolomon: 3.68% (8.5322 => 8.8461, std.dev.: 0.0133) MultiSource/Benchmarks/sim/sim: 3.15% (3.8206 => 3.9409, std.dev.: 0.0116) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.76% (2.4490 => 2.5165, std.dev.: 0.0142) MultiSource/Applications/siod/siod: 2.57% (3.6643 => 3.7583, std.dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: 2.35% (63.1822 => 64.6669, std.dev.: 0.1258) MultiSource/Applications/lambda-0_1_3/lambda: 2.05% (7.4933 => 7.6471, std.dev.: 0.0139) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.74% (28.5821 => 29.0807, std.dev.: 0.0097) MultiSource/Benchmarks/llubenchmark/llu: 1.59% (1.9967 => 2.0285, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: 1.37% (2.3560 => 2.3883, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: 1.29% (1.0841 => 1.0981, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.29% (1.5941 => 1.6146, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.16% (4.8362 => 4.8923, std.dev.: 0.0112) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -32.54% (0.0338 => 0.0228, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.70% (0.3269 => 0.3050, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.53% (7.2130 => 6.8864, std.dev.: 0.1237) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.33% (2.8773 => 2.7527, std.dev.: 0.0416) SingleSource/Benchmarks/Shootout/lists: -3.89% (7.3375 => 7.0522, std.dev.: 0.0178) MultiSource/Applications/SPASS/SPASS: -2.96% (8.4326 => 8.1834, std.dev.: 0.0928) MultiSource/Applications/lua/lua: -2.25% (29.8330 => 29.1614, std.dev.: 0.0556) MultiSource/Benchmarks/Olden/bisort/bisort: -1.70% (0.6636 => 0.6523, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.57% (1.0388 => 1.0225, std.dev.: 0.0059) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.54% (1.2822 => 1.2624, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash2: -1.40% (3.4237 => 3.3758, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.06% (3.3479 => 3.3125, std.dev.: 0.0118) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.34% (16.4461 => 16.6666, std.dev.: 0.0613) MultiSource/Applications/obsequi/Obsequi: 3.29% (1.0262 => 1.0600, std.dev.: 0.0158) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6792.70% (0.3123 => 21.5259, std.dev.: 0.2054) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.26% (0.2463 => 0.3627, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 1.15% (0.6010 => 0.6079, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.11% (0.3266 => 0.3335, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/strcat: 2.49% (0.1969 => 0.2018, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 11.38% (0.0123 => 0.0137, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.68% (0.0408 => 0.0423, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 21.26% (0.0254 => 0.0308, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.38% (0.0384 => 0.0420, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 2.11% (0.0190 => 0.0194, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -26.67% (0.0180 => 0.0132, std.dev.: 0.0042) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 2.23% (0.1438 => 0.1470, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.73% (1.1329 => 1.1133, std.dev.: 0.0195) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -3.83% (0.1462 => 0.1406, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.73% (0.4164 => 0.4236, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.26% (0.1369 => 0.1338, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.47% (0.0641 => 0.0638, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.13% (0.0195 => 0.0185, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.23% (0.0578 => 0.0542, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.13% (1.1437 => 1.1422, std.dev.: 0.0622) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.10% (0.0627 => 0.0595, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.33% (0.0180 => 0.0156, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.12% (0.8017 => 0.8007, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: -24.19% (0.0062 => 0.0047, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 3 17:38:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 3 Nov 2012 19:38:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121104003801.056A92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5564?compare_to=5561&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5564, Order: 167363, Start Time: 2012-11-03 23:13:17, End Time: 2012-11-04 00:38:06 To: 5561, Order: 167359, Start Time: 2012-11-03 21:25:36, End Time: 2012-11-03 22:50:23 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (182 on baseline) Unchanged Tests: 1041 (856 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.76% (1.2776 => 1.3001, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.57% (2.0478 => 2.1005, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4937 => 7.6767, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/hash2: 2.27% (3.1932 => 3.2656, std.dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.60% (0.1431 => 0.1308, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.80% (0.3821 => 0.3523, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.25% (2.4924 => 2.3118, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.84% (3.5339 => 3.2922, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.84% (0.2428 => 0.2262, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.77% (22.4056 => 20.8885, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.72% (0.3142 => 0.2931, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.62% (0.3658 => 0.3416, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.61% (0.3357 => 0.3135, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.57% (0.1584 => 0.1480, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -6.54% (4.3330 => 4.0497, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.46% (0.9542 => 0.8926, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -6.37% (16.1920 => 15.1604, std.dev.: 0.0194) MultiSource/Applications/JM/ldecod/ldecod: -6.31% (7.0961 => 6.6480, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.30% (1.0544 => 0.9880, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.29% (1.6474 => 1.5438, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -6.27% (2.4021 => 2.2514, std.dev.: 0.0157) MultiSource/Applications/Burg/burg: -6.26% (1.2515 => 1.1731, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: -6.25% (0.2160 => 0.2025, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.24% (0.1716 => 0.1609, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -6.21% (1.1450 => 1.0739, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.20% (0.6484 => 0.6082, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.18% (0.9852 => 0.9243, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -6.17% (0.9179 => 0.8613, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.16% (0.7919 => 0.7431, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.15% (1.4642 => 1.3741, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -6.14% (0.3812 => 0.3578, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.13% (0.3880 => 0.3642, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.13% (0.1761 => 0.1653, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/BoolLiteralTest: -6.13% (0.3834 => 0.3599, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.12% (0.2548 => 0.2392, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -6.09% (0.2659 => 0.2497, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.09% (0.3891 => 0.3654, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.09% (5.4682 => 5.1353, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.07% (0.1796 => 0.1687, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -6.06% (0.4176 => 0.3923, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.06% (0.3848 => 0.3615, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.05% (1.2784 => 1.2011, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: -6.04% (9.2283 => 8.6708, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions-2: -6.03% (0.3831 => 0.3600, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.02% (0.3884 => 0.3650, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.02% (1.2300 => 1.1559, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: -5.98% (0.3896 => 0.3663, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.97% (1.3722 => 1.2903, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.96% (0.5857 => 0.5508, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -5.93% (0.4033 => 0.3794, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.92% (4.5069 => 4.2399, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.91% (4.0323 => 3.7939, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.90% (0.4151 => 0.3906, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.90% (0.2695 => 0.2536, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -5.89% (4.0594 => 3.8201, std.dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: -5.88% (1.1530 => 1.0852, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.87% (1.6364 => 1.5403, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.86% (0.2355 => 0.2217, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: -5.84% (15.5079 => 14.6023, std.dev.: 0.0147) MultiSource/Benchmarks/Olden/bh/bh: -5.83% (0.2985 => 0.2811, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.83% (4.8161 => 4.5355, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.82% (0.6681 => 0.6292, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -5.82% (0.4280 => 0.4031, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.81% (4.8802 => 4.5965, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/property: -5.81% (0.4199 => 0.3955, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.81% (0.4321 => 0.4070, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.80% (0.3483 => 0.3281, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.79% (0.6304 => 0.5939, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.79% (0.6667 => 0.6281, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.77% (0.3931 => 0.3704, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.77% (6.7716 => 6.3812, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.76% (0.7339 => 0.6916, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.76% (0.6736 => 0.6348, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -5.75% (0.3406 => 0.3210) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.74% (0.5591 => 0.5270, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.73% (0.4813 => 0.4537, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -5.73% (1.3148 => 1.2395, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.70% (0.6230 => 0.5875, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.68% (0.5849 => 0.5517, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -5.67% (17.1032 => 16.1328, std.dev.: 0.0149) MultiSource/Benchmarks/McCat/18-imp/imp: -5.67% (0.3581 => 0.3378, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.67% (0.6194 => 0.5843, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.66% (14.2083 => 13.4035, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.66% (0.6446 => 0.6081, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.66% (0.7524 => 0.7098, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -5.66% (18.2933 => 17.2577, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.65% (0.6052 => 0.5710, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.64% (0.6297 => 0.5942, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.64% (2.2587 => 2.1314, std.dev.: 0.0185) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.63% (0.8521 => 0.8041, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -5.62% (0.3025 => 0.2855, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -5.61% (0.7447 => 0.7029, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.61% (0.6260 => 0.5909, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.60% (0.6676 => 0.6302, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.60% (0.5802 => 0.5477, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.60% (0.5575 => 0.5263, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.59% (0.5941 => 0.5609, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -5.59% (0.7982 => 0.7536, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.59% (0.5478 => 0.5172, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.59% (0.3849 => 0.3634, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.58% (0.5999 => 0.5664, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.57% (0.5581 => 0.5270, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.57% (0.5456 => 0.5152, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.57% (0.5925 => 0.5595, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.56% (0.6440 => 0.6082, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.55% (0.6033 => 0.5698, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.53% (0.6660 => 0.6292, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.53% (0.3837 => 0.3625, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.53% (1.3864 => 1.3098, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.52% (0.5705 => 0.5390, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: -5.51% (0.3446 => 0.3256, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.50% (0.6395 => 0.6043, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.50% (0.5168 => 0.4884, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.49% (0.6189 => 0.5849, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.48% (0.9557 => 0.9033, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: -5.48% (0.3394 => 0.3208, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.48% (0.3194 => 0.3019, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.47% (0.2999 => 0.2835, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -5.45% (0.2989 => 0.2826, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.45% (0.4916 => 0.4648, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: -5.45% (0.4861 => 0.4596, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: -5.45% (2.1401 => 2.0235, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.44% (0.5859 => 0.5540, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.44% (0.5570 => 0.5267, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.44% (0.4083 => 0.3861, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.43% (0.6293 => 0.5951, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -5.42% (3.5154 => 3.3248, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.42% (0.3323 => 0.3143, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.38% (0.3252 => 0.3077, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: -5.38% (0.3255 => 0.3080, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.36% (0.3057 => 0.2893, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.36% (0.6395 => 0.6052, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.36% (0.2278 => 0.2156, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -5.35% (34.0927 => 32.2673, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/bigfib: -5.35% (0.6750 => 0.6389, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.34% (0.5863 => 0.5550, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.33% (0.5569 => 0.5272, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -5.33% (0.2871 => 0.2718, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -5.32% (0.3026 => 0.2865, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -5.32% (0.4248 => 0.4022, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.32% (2.1713 => 2.0558, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: -5.31% (0.2939 => 0.2783, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: -5.31% (0.4524 => 0.4284, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.30% (0.5567 => 0.5272, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.29% (0.5805 => 0.5498, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -5.29% (0.3481 => 0.3297) SingleSource/Benchmarks/Shootout-C++/lists: -5.27% (0.3621 => 0.3430, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.27% (0.3491 => 0.3307, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.27% (0.2903 => 0.2750, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: -5.25% (0.3867 => 0.3664, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.22% (0.4427 => 0.4196, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.19% (0.5688 => 0.5393, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.18% (0.7021 => 0.6657, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.18% (0.2933 => 0.2781, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.17% (0.3016 => 0.2860, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.16% (0.5329 => 0.5054, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.16% (1.2210 => 1.1580, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.16% (0.2385 => 0.2262, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -5.14% (0.4515 => 0.4283, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.13% (0.2106 => 0.1998, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -5.12% (0.2849 => 0.2703, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.11% (1.2221 => 1.1596, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.10% (8.0126 => 7.6042, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/wc: -5.09% (0.3205 => 0.3042, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -5.08% (15.2527 => 14.4779, std.dev.: 0.0121) MultiSource/Benchmarks/McCat/09-vor/vor: -5.04% (0.3271 => 0.3106, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -5.04% (0.3788 => 0.3597, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.03% (0.3319 => 0.3152, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.99% (0.7198 => 0.6839, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: -4.97% (0.8418 => 0.8000, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -4.83% (5.0226 => 4.7798, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: -4.61% (0.7779 => 0.7420, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.45% (0.9077 => 0.8673, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: -4.33% (0.6347 => 0.6072, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -4.21% (0.6441 => 0.6170, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -4.14% (1.5610 => 1.4963, std.dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: -2.07% (20.7746 => 20.3444, std.dev.: 0.0148) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7539, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.82% (2.2633 => 2.1769, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.73% (6.5735 => 6.4597, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.02% (3.2107 => 3.1781, std.dev.: 0.0002) Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 3 19:19:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 3 Nov 2012 21:19:22 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121104021922.D82A82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5565?compare_to=5563&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5565, Order: 167364, Start Time: 2012-11-04 00:47:16, End Time: 2012-11-04 02:19:29 To: 5563, Order: 167363, Start Time: 2012-11-03 23:03:51, End Time: 2012-11-04 00:30:19 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 9 (72 on baseline) Performance Improvements: 3 (7 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 979 (895 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.20% (0.8331 => 0.8431, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.03% (1.2585 => 1.2714, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 1.01% (32.2288 => 32.5531, std.dev.: 0.0439) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 10.46% (3.0517 => 3.3710, std.dev.: 0.0739) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.51% (6.8864 => 7.2660, std.dev.: 0.0311) SingleSource/Benchmarks/CoyoteBench/lpbench: 2.02% (3.8992 => 3.9780, std.dev.: 0.0224) SingleSource/Benchmarks/Shootout/methcall: 1.59% (8.1466 => 8.2759, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 1.27% (3.4449 => 3.4885, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/pi: 1.01% (2.4727 => 2.4977, std.dev.: 0.0093) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.54% (0.9074 => 0.8753, std.dev.: 0.0116) MultiSource/Applications/Burg/burg: -1.89% (1.2899 => 1.2655, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -1.32% (3.9152 => 3.8637, std.dev.: 0.0149) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.37% (16.6666 => 16.6042, std.dev.: 0.1602) MultiSource/Applications/obsequi/Obsequi: -0.54% (1.0600 => 1.0543, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.45% (21.5259 => 21.8383, std.dev.: 0.1593) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.63% (0.3627 => 0.3650, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: -0.82% (0.6079 => 0.6029, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.54% (0.3335 => 0.3317, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: -1.34% (0.2018 => 0.1991, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 57.66% (0.0137 => 0.0216, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -8.98% (0.0423 => 0.0385, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.62% (0.0308 => 0.0313, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -27.24% (0.0312 => 0.0227, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.62% (0.0420 => 0.0388, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/casts: 4.12% (0.0194 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 3.03% (0.0132 => 0.0136, std.dev.: 0.0038) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1470 => 0.1468, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.78% (1.1133 => 1.1331, std.dev.: 0.0160) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.21% (0.1406 => 0.1409, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.94% (0.4236 => 0.4069, std.dev.: 0.0376) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.97% (0.1338 => 0.1351, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.03% (0.0638 => 0.0574, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.08% (0.0185 => 0.0187, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.20% (0.0542 => 0.0581, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.11% (1.1422 => 1.1409, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.03% (0.0595 => 0.0577, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 57.69% (0.0156 => 0.0246, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.27% (0.8007 => 0.7985, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -4.26% (0.0047 => 0.0045, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2316.06% (0.6332 => 15.2985, std.dev.: 0.1172) MultiSource/Benchmarks/McCat/08-main/main: 48.55% (0.1831 => 0.2720, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.97% (0.1559 => 0.1466, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1497.13% (0.3344 => 5.3408, std.dev.: 0.0295) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.44% (0.2364 => 0.3249, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0429 => 0.0439, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.46% (0.0224 => 0.0234, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3207, std.dev.: 0.0107) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0689, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4949, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3453, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0462, std.dev.: 0.0266) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4103, std.dev.: 0.0014) SingleSource/Regression/C/uint64_to_float: -24.22% (2.1832 => 1.6545, std.dev.: 0.0139) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.56% (0.0810 => 0.0936, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: 13.13% (0.1112 => 0.1258, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.43% (0.2180 => 0.2342, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.19% (0.8321 => 0.8753, std.dev.: 0.0116) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.94% (1.1606 => 1.2179, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.89% (0.6010 => 0.6244, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.75% (0.7473 => 0.7753, std.dev.: 0.0079) MultiSource/Applications/Burg/burg: 3.54% (1.2222 => 1.2655, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.05% (0.6287 => 0.6479, std.dev.: 0.0027) MultiSource/Applications/spiff/spiff: 2.96% (0.7950 => 0.8185, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.63% (0.8204 => 0.8420, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.58% (1.4479 => 1.4852, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.54% (0.9056 => 0.9286, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.48% (0.8340 => 0.8547, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.47% (0.9074 => 0.9298, std.dev.: 0.0067) MultiSource/Applications/SIBsim4/SIBsim4: 2.43% (1.2568 => 1.2874, std.dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: 2.37% (14.7684 => 15.1186, std.dev.: 0.0627) MultiSource/Applications/hbd/hbd: 2.32% (1.4269 => 1.4600, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.31% (0.8069 => 0.8255, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.28% (0.8359 => 0.8550, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 2.26% (3.2366 => 3.3099, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.25% (0.8086 => 0.8268, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.24% (0.8697 => 0.8892, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.24% (0.8716 => 0.8911, std.dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: 2.18% (31.8598 => 32.5531, std.dev.: 0.0439) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.06% (0.8261 => 0.8431, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.00% (0.8597 => 0.8769, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.99% (0.9039 => 0.9219, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.99% (0.8457 => 0.8625, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 1.94% (4.1305 => 4.2107, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.89% (0.8611 => 0.8774, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.88% (0.7932 => 0.8081, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (0.6586 => 0.6709, std.dev.: 0.0035) MultiSource/Applications/lua/lua: 1.86% (3.8189 => 3.8900, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.85% (0.9908 => 1.0091, std.dev.: 0.0064) MultiSource/Applications/JM/lencod/lencod: 1.83% (15.3280 => 15.6090, std.dev.: 0.0730) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.77% (4.4880 => 4.5676, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 1.77% (14.2605 => 14.5134, std.dev.: 0.0235) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.77% (0.8712 => 0.8866, std.dev.: 0.0053) MultiSource/Applications/siod/siod: 1.77% (2.2184 => 2.2576, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.76% (0.7966 => 0.8106, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.74% (1.1170 => 1.1364, std.dev.: 0.0065) MultiSource/Applications/oggenc/oggenc: 1.73% (4.9628 => 5.0485, std.dev.: 0.0222) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.71% (0.8316 => 0.8458, std.dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: 1.63% (8.6247 => 8.7651, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.60% (0.8317 => 0.8450, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.56% (0.9688 => 0.9839, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.51% (0.8420 => 0.8547, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.42% (0.8855 => 0.8981, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.28% (0.8066 => 0.8169, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.25% (3.1832 => 3.2229, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.17% (1.5315 => 1.5494, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.13% (1.5795 => 2.4977, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C++/city/city: 55.78% (0.0199 => 0.0310, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.85% (14.6451 => 16.5275, std.dev.: 0.6761) MultiSource/Applications/SIBsim4/SIBsim4: 9.45% (3.1873 => 3.4885, std.dev.: 0.0126) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.14% (1.1857 => 1.2822, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 4.62% (14.0064 => 14.6540, std.dev.: 0.0431) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.36% (6.3772 => 6.5913, std.dev.: 0.0785) MultiSource/Benchmarks/sim/sim: 3.09% (3.8206 => 3.9386, std.dev.: 0.0435) SingleSource/Benchmarks/Misc/ReedSolomon: 3.07% (8.5322 => 8.7943, std.dev.: 0.0344) MultiSource/Benchmarks/mafft/pairlocalalign: 2.71% (63.1822 => 64.8927, std.dev.: 0.6149) MultiSource/Applications/siod/siod: 2.66% (3.6643 => 3.7616, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 2.51% (0.6205 => 0.6361, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 2.08% (7.4933 => 7.6494, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.98% (3.9006 => 3.9780, std.dev.: 0.0224) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.85% (59.2638 => 60.3590, std.dev.: 0.2430) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.84% (28.5821 => 29.1089, std.dev.: 0.0304) MultiSource/Benchmarks/Olden/bh/bh: 1.42% (2.3560 => 2.3894, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/neural/neural: 1.29% (1.0841 => 1.0981, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.28% (2.4647 => 2.4963, std.dev.: 0.0048) SingleSource/Benchmarks/Stanford/FloatMM: 1.27% (0.8807 => 0.8919, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -32.25% (0.0338 => 0.0229, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -7.13% (0.1430 => 0.1328, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.67% (0.3269 => 0.3051, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.70% (2.8773 => 2.7420, std.dev.: 0.0365) SingleSource/Benchmarks/Shootout/lists: -3.57% (7.3375 => 7.0754, std.dev.: 0.0148) MultiSource/Applications/lua/lua: -2.43% (29.8330 => 29.1075, std.dev.: 0.1318) SingleSource/Benchmarks/Shootout-C++/ackermann: -1.41% (3.9188 => 3.8637, std.dev.: 0.0149) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.96% (16.4461 => 16.6042, std.dev.: 0.1602) MultiSource/Applications/obsequi/Obsequi: 2.74% (1.0262 => 1.0543, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6892.73% (0.3123 => 21.8383, std.dev.: 0.1593) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.19% (0.2463 => 0.3650, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: 0.32% (0.6010 => 0.6029, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.56% (0.3266 => 0.3317, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 1.12% (0.1969 => 0.1991, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 75.61% (0.0123 => 0.0216, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.64% (0.0408 => 0.0385, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 23.23% (0.0254 => 0.0313, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -24.83% (0.0302 => 0.0227, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.04% (0.0384 => 0.0388, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -24.44% (0.0180 => 0.0136, std.dev.: 0.0038) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 2.09% (0.1438 => 0.1468, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.02% (1.1329 => 1.1331, std.dev.: 0.0160) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.63% (0.1462 => 0.1409, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.28% (0.4164 => 0.4069, std.dev.: 0.0376) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.31% (0.1369 => 0.1351, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.45% (0.0641 => 0.0574, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.10% (0.0195 => 0.0187, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.52% (0.0578 => 0.0581, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.24% (1.1437 => 1.1409, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.97% (0.0627 => 0.0577, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 36.67% (0.0180 => 0.0246, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.40% (0.8017 => 0.7985, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -27.42% (0.0062 => 0.0045, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 3 19:25:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 3 Nov 2012 21:25:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121104022556.68A4C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5566?compare_to=5564&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5566, Order: 167364, Start Time: 2012-11-04 01:00:59, End Time: 2012-11-04 02:25:55 To: 5564, Order: 167363, Start Time: 2012-11-03 23:13:17, End Time: 2012-11-04 00:38:06 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (7 on baseline) Performance Improvements: 0 (179 on baseline) Unchanged Tests: 1040 (856 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.42% (54.7297 => 56.6000, std.dev.: 0.0284) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.99% (78.5345 => 80.8821, std.dev.: 0.4482) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.25% (1.2783 => 1.3710, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.71% (54.5751 => 56.6000, std.dev.: 0.0284) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1011, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/salsa20: 2.47% (7.4937 => 7.6787, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash2: 2.29% (3.1932 => 3.2664, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.53% (0.9531 => 0.9677, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.46% (79.7170 => 80.8821, std.dev.: 0.4482) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.46% (0.1431 => 0.1310, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.77% (0.3821 => 0.3524, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.36% (2.4924 => 2.3090, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.59% (0.2428 => 0.2268, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.55% (3.5339 => 3.3023, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.52% (0.3142 => 0.2937, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.50% (22.4056 => 20.9490, std.dev.: 0.0080) MultiSource/Applications/sgefa/sgefa: -6.49% (0.3357 => 0.3139, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.39% (0.9542 => 0.8932, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -6.24% (16.1920 => 15.1811, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.18% (0.3658 => 0.3432, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -6.17% (0.1879 => 0.1763, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -6.12% (7.0961 => 6.6616, std.dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: -6.12% (9.2283 => 8.6633, std.dev.: 0.0092) MultiSource/Benchmarks/MallocBench/gs/gs: -6.05% (4.3330 => 4.0710, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/oourafft: -6.02% (0.2160 => 0.2030, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.98% (1.2784 => 1.2019, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -5.97% (1.1450 => 1.0766, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/football/football: -5.97% (0.9179 => 0.8631, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.97% (0.6484 => 0.6097, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.97% (1.0544 => 0.9915, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.94% (1.3722 => 1.2907, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.92% (0.9852 => 0.9269, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.90% (0.1796 => 0.1690, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.87% (1.6364 => 1.5403, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.86% (1.6474 => 1.5508, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.86% (1.4642 => 1.3784, std.dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: -5.85% (1.1530 => 1.0855, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.83% (0.2695 => 0.2538, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.78% (0.6681 => 0.6295, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: -5.77% (1.2515 => 1.1793, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.76% (0.4151 => 0.3912, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.74% (0.6304 => 0.5942, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.74% (0.5925 => 0.5585, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -5.73% (17.1032 => 16.1234, std.dev.: 0.0159) MultiSource/Benchmarks/sim/sim: -5.73% (0.3406 => 0.3211, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.72% (0.5591 => 0.5271, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.71% (0.6230 => 0.5874, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.70% (1.2300 => 1.1599, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.67% (0.6667 => 0.6289, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.67% (4.5069 => 4.2514, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.65% (0.5802 => 0.5474, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.64% (0.7919 => 0.7472, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.64% (0.5478 => 0.5169, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -5.64% (4.0594 => 3.8305, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.63% (0.6052 => 0.5711, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.62% (0.5941 => 0.5607, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.62% (0.5857 => 0.5528, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.61% (14.2083 => 13.4111, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.61% (0.6297 => 0.5944, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.60% (0.7339 => 0.6928, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.59% (5.4682 => 5.1623, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.59% (0.6194 => 0.5848, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.58% (0.5575 => 0.5264, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.57% (0.5849 => 0.5523, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.57% (0.2548 => 0.2406, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.57% (4.8802 => 4.6084, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/08-main/main: -5.57% (0.2659 => 0.2511, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.56% (0.2355 => 0.2224, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -5.55% (15.5079 => 14.6466, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.55% (6.7716 => 6.3958, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.55% (4.8161 => 4.5490, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.54% (0.7524 => 0.7107, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.54% (4.0323 => 3.8089, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.54% (0.6736 => 0.6363, std.dev.: 0.0075) MultiSource/Applications/SIBsim4/SIBsim4: -5.53% (1.3864 => 1.3097, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.53% (0.5863 => 0.5539, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.50% (0.5705 => 0.5391, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.50% (0.6033 => 0.5701, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -5.50% (1.3148 => 1.2425, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.50% (0.6660 => 0.6294, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: -5.49% (0.4861 => 0.4594, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -5.49% (0.7447 => 0.7038, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.48% (0.6676 => 0.6310, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.48% (0.5859 => 0.5538, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.48% (0.5805 => 0.5487, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.47% (0.3931 => 0.3716, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.46% (0.5570 => 0.5266, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -5.46% (2.4021 => 2.2710, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.46% (0.3483 => 0.3293, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.44% (0.6395 => 0.6047, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.43% (0.5581 => 0.5278, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.43% (0.6189 => 0.5853, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.42% (0.5569 => 0.5267, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.42% (0.6440 => 0.6091, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -5.41% (0.3880 => 0.3670, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.40% (0.3849 => 0.3641, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: -5.40% (0.3812 => 0.3606, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.40% (0.5999 => 0.5675, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.39% (0.8521 => 0.8062, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.38% (0.6260 => 0.5923, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -5.38% (0.3831 => 0.3625, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.37% (0.3891 => 0.3682, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.37% (0.5567 => 0.5268, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.37% (0.3837 => 0.3631, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -5.35% (0.3848 => 0.3642, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: -5.33% (0.3581 => 0.3390, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -5.32% (0.3025 => 0.2864, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.32% (2.2587 => 2.1386, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.32% (0.5456 => 0.5166, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.30% (0.5168 => 0.4894, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: -5.29% (0.4176 => 0.3955) SingleSource/Benchmarks/Shootout-C++/except: -5.29% (0.3026 => 0.2866, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -5.28% (0.3255 => 0.3083, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.28% (0.4033 => 0.3820, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.27% (0.3323 => 0.3148, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.26% (0.6293 => 0.5962, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.24% (0.5688 => 0.5390, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: -5.23% (0.3194 => 0.3027, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.21% (0.3896 => 0.3693, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.21% (0.4321 => 0.4096, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: -5.20% (3.5154 => 3.3327, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.20% (2.1713 => 2.0585, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: -5.19% (0.4524 => 0.4289, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.19% (0.4916 => 0.4661, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -5.17% (2.1401 => 2.0294, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/bh/bh: -5.16% (0.2985 => 0.2831, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -5.16% (0.4248 => 0.4029, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.15% (0.9557 => 0.9065, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.14% (0.6395 => 0.6066, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: -5.14% (0.2939 => 0.2788, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -5.14% (0.3446 => 0.3269, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.14% (0.3057 => 0.2900, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.13% (0.4813 => 0.4566, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -5.12% (0.7982 => 0.7573, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.12% (0.3884 => 0.3685, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -5.12% (0.4199 => 0.3984, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.12% (0.2871 => 0.2724, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.10% (0.2999 => 0.2846, std.dev.: 0.0021) SingleSource/Regression/C++/ofstream_ctor: -5.10% (0.3059 => 0.2903, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.09% (0.2278 => 0.2162, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.08% (0.7021 => 0.6664, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -5.08% (34.0927 => 32.3621, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.07% (0.3252 => 0.3087, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.07% (0.3016 => 0.2863, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -5.07% (0.4280 => 0.4063, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -5.07% (0.3867 => 0.3671, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -5.07% (0.3394 => 0.3222, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -5.07% (0.6750 => 0.6408, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.06% (0.4427 => 0.4203, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.05% (0.4083 => 0.3877, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary2: -5.03% (0.3481 => 0.3306, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -5.03% (0.3621 => 0.3439, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -5.02% (15.2527 => 14.4871, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.01% (0.2933 => 0.2786, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.99% (0.2903 => 0.2758, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.99% (0.3205 => 0.3045, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.98% (0.3491 => 0.3317, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: -4.98% (0.2849 => 0.2707, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.95% (1.2210 => 1.1606, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: -4.94% (0.4515 => 0.4292, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.94% (0.5329 => 0.5066, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -4.91% (18.2933 => 17.3943, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/sieve: -4.91% (0.3788 => 0.3602, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.88% (8.0126 => 7.6213, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: -4.85% (0.2989 => 0.2844, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.82% (0.2385 => 0.2270, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.82% (0.7198 => 0.6851, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.75% (1.2221 => 1.1641, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.70% (0.3319 => 0.3163, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -4.55% (0.8418 => 0.8035, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: -4.46% (0.3271 => 0.3125, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.43% (5.0226 => 4.8001, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: -4.24% (0.7779 => 0.7449, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.88% (0.9077 => 0.8725, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/Hello: -3.72% (0.6347 => 0.6111, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -3.62% (1.5610 => 1.5045, std.dev.: 0.0043) SingleSource/UnitTests/ObjC++/property-reference-object: -3.49% (0.6441 => 0.6216, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.13% (20.7746 => 20.3328, std.dev.: 0.0271) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7524, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: -8.72% (1.2842 => 1.1722, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.66% (2.2633 => 2.1805, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.64% (6.5735 => 6.4655, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Report Time: 6.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 3 21:08:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 3 Nov 2012 23:08:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121104040833.8C21D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5567?compare_to=5562&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5567, Order: 167364, Start Time: 2012-11-04 00:52:38, End Time: 2012-11-04 04:08:39 To: 5562, Order: 167358, Start Time: 2012-11-03 20:47:56, End Time: 2012-11-04 00:04:05 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (169 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1042 (721 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.64% (0.0625 => 0.0879, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.17% (0.1063 => 0.1405, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.80% (0.2969 => 0.3735, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.59% (0.1106 => 0.1389, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.84% (0.0475 => 0.0593, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.41% (0.4253 => 0.5291, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.35% (0.4139 => 0.5147, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 24.25% (1.5932 => 1.9796, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.02% (0.5900 => 0.7317, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.79% (0.4994 => 0.6182, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.67% (0.0714 => 0.0883, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.02% (0.5000 => 0.6151, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.77% (0.0584 => 0.0717, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.16% (0.1620 => 0.1979, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.07% (0.0897 => 0.1095, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.94% (0.1021 => 0.1245, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.59% (0.1107 => 0.1346, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 21.54% (0.0599 => 0.0728, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 20.53% (0.0604 => 0.0728, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 20.46% (0.0948 => 0.1142, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.40% (0.0642 => 0.0773, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.40% (0.1549 => 0.1865, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.40% (0.1103 => 0.1328, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.38% (0.0584 => 0.0703, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.26% (0.1604 => 0.1929, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 20.10% (0.0821 => 0.0986, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.09% (0.3903 => 0.4687, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 20.07% (0.1619 => 0.1944, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.95% (0.0822 => 0.0986, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.84% (0.1003 => 0.1202, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.22% (0.2014 => 0.2401, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 18.80% (0.0947 => 0.1125, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 18.42% (0.5826 => 0.6899, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.33% (0.1462 => 0.1730, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 18.32% (0.0808 => 0.0956, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.17% (0.3890 => 0.4597, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 18.14% (0.1218 => 0.1439, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 18.14% (0.4029 => 0.4760, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 18.14% (0.5889 => 0.6957, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.83% (1.3152 => 1.5497, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/09-vor/vor: 17.81% (0.1505 => 0.1773, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.76% (0.2736 => 0.3222, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.65% (0.1088 => 0.1280, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.56% (0.0581 => 0.0683, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.32% (3.5627 => 4.1799, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.31% (0.2866 => 0.3362, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 16.91% (0.5546 => 0.6484, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 16.90% (1.8794 => 2.1971, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.77% (0.2875 => 0.3357, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.76% (0.2738 => 0.3197, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.72% (0.1160 => 0.1354, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.66% (0.3271 => 0.3816, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.58% (1.6211 => 1.8899, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.57% (0.5026 => 0.5859, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/18-imp/imp: 16.54% (0.1421 => 0.1656, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.51% (0.1968 => 0.2293, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.32% (0.4658 => 0.5418, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.26% (0.4361 => 0.5070, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 16.26% (0.2725 => 0.3168, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 16.16% (0.7171 => 0.8330, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/hello: 16.14% (0.2714 => 0.3152, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 15.97% (1.0781 => 1.2503, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.94% (0.2729 => 0.3164, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 15.93% (0.2813 => 0.3261, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 15.91% (0.3004 => 0.3482, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 15.91% (0.2823 => 0.3272, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 15.89% (0.2750 => 0.3187, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 15.88% (0.9697 => 1.1237, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.87% (0.3195 => 0.3702, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 15.80% (0.2811 => 0.3255, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 15.79% (0.2780 => 0.3219, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.79% (2.7292 => 3.1601, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.74% (1.9694 => 2.2794, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.74% (4.4195 => 5.1151, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/random: 15.73% (0.2803 => 0.3244, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.72% (0.2792 => 0.3231, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 15.65% (0.1284 => 0.1485, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.64% (2.0673 => 2.3907, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wc: 15.60% (0.3096 => 0.3579, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.60% (0.3930 => 0.4543, std.dev.: 0.0071) MultiSource/Applications/hexxagon/hexxagon: 15.59% (0.9909 => 1.1454, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 15.53% (4.2109 => 4.8647, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.42% (0.2911 => 0.3360, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.33% (1.9966 => 2.3027, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: 15.15% (0.3267 => 0.3762, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary2: 14.95% (0.3317 => 0.3813, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 14.95% (0.3258 => 0.3745, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 14.94% (23.5202 => 27.0330, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.84% (0.3060 => 0.3514, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.77% (0.1090 => 0.1251, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.72% (0.3362 => 0.3857, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.53% (0.3124 => 0.3578, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.37% (0.3625 => 0.4146, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 14.34% (0.3348 => 0.3828, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/moments: 14.33% (0.3678 => 0.4205, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 14.31% (0.3446 => 0.3939, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 14.24% (0.3496 => 0.3994, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/exceptions-4: 14.23% (0.3465 => 0.3958, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.16% (0.3488 => 0.3982, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-3: 14.16% (0.3460 => 0.3950, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 14.14% (0.3726 => 0.4253, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/synchronized: 14.13% (0.3469 => 0.3959, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 14.12% (0.7875 => 0.8987, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.11% (0.3282 => 0.3745, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 14.06% (0.3477 => 0.3966, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 14.06% (0.3442 => 0.3926, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 14.02% (1.4269 => 1.6270, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.99% (0.3845 => 0.4383, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 13.93% (0.2075 => 0.2364, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 13.82% (0.4146 => 0.4719, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: 13.81% (0.4251 => 0.4838, std.dev.: 0.0057) MultiSource/Benchmarks/nbench/nbench: 13.80% (0.2566 => 0.2920, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: 13.78% (0.3643 => 0.4145, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.77% (0.3690 => 0.4198, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 13.73% (0.3650 => 0.4151, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.72% (0.3981 => 0.4527, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 13.56% (0.3724 => 0.4229, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 13.22% (2.1653 => 2.4515, std.dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 13.06% (4.6177 => 5.2210, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/bigfib: 13.03% (0.5012 => 0.5665, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 12.73% (2.1013 => 2.3689, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.21% (0.2040 => 0.2289, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 12.04% (0.2691 => 0.3015, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.90% (0.6435 => 0.7201, std.dev.: 0.0046) MultiSource/Applications/SPASS/SPASS: 11.74% (5.5417 => 6.1925, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.99% (0.1383 => 0.1535, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 10.99% (0.6634 => 0.7363, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 10.95% (0.3498 => 0.3881, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.89% (0.2737 => 0.3035, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.70% (0.1028 => 0.1138, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.54% (0.2068 => 0.2286, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 10.36% (0.4847 => 0.5349, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.18% (0.3084 => 0.3398, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 10.07% (0.3336 => 0.3672, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.51% (0.2103 => 0.2303, std.dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 9.31% (2.0346 => 2.2241, std.dev.: 0.0044) MultiSource/Applications/lemon/lemon: 9.20% (0.2391 => 0.2611, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.75% (4.6926 => 5.1033, std.dev.: 0.0100) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.63% (11.6398 => 12.6440, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.08% (0.5361 => 0.5794, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.37% (0.7426 => 0.7973, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.22% (0.5584 => 0.5987, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 6.77% (11.9555 => 12.7644, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.83% (0.3792 => 0.3975, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6531, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 9.46% (0.2802 => 0.3067, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6108, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.99% (12.0509 => 12.6517, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1680, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-2: 3.65% (1.8057 => 1.8716, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: 2.53% (14.0481 => 14.4041, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1938, std.dev.: 0.0063) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2230, std.dev.: 0.0037) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3055, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2839, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5386, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5842, std.dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.54% (25.4195 => 16.3864, std.dev.: 0.0171) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9766, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7754, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9572, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: -5.29% (0.2402 => 0.2275, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7745, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -2.87% (3.6262 => 3.5222, std.dev.: 0.0022) SingleSource/UnitTests/Vector/build2: -2.84% (11.2080 => 10.8899, std.dev.: 0.0221) SingleSource/Benchmarks/Dhrystone/fldry: -2.42% (17.2379 => 16.8203, std.dev.: 0.0389) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8720, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5765, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: -1.55% (5.5810 => 5.4945, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.46% (21.9346 => 21.6145, std.dev.: 0.1041) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7160, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1784, std.dev.: 0.0753) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.08% (3.3991 => 3.3625, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 3 23:34:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 4 Nov 2012 01:34:21 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121104063421.A81A32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5568?compare_to=5565&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5568, Order: 167366, Start Time: 2012-11-04 05:08:15, End Time: 2012-11-04 06:34:28 To: 5565, Order: 167364, Start Time: 2012-11-04 00:47:16, End Time: 2012-11-04 02:19:29 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 8 (55 on baseline) Performance Improvements: 6 (10 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 977 (909 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.17% (0.2822 => 0.2968, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.69% (0.3333 => 0.3456, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 2.43% (0.8799 => 0.9013, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.37% (0.5982 => 0.6124, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 1.86% (0.6830 => 0.6957, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 1.40% (2.0216 => 2.0499, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/BitBench/five11/five11: 1.57% (5.6208 => 5.7091, std.dev.: 0.0229) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.42% (2.6023 => 2.6392, std.dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.53% (0.9286 => 0.9144, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.24% (0.8547 => 0.8441, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.14% (0.9298 => 0.9192, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -10.99% (3.3710 => 3.0006, std.dev.: 0.1093) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.21% (1.0594 => 1.0254, std.dev.: 0.0099) MultiSource/Applications/SIBsim4/SIBsim4: -1.26% (3.4885 => 3.4445, std.dev.: 0.0092) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.33% (16.6042 => 16.6590, std.dev.: 0.1306) MultiSource/Applications/obsequi/Obsequi: 0.83% (1.0543 => 1.0631, std.dev.: 0.0075) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.46% (21.8383 => 21.5196, std.dev.: 0.2741) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.22% (0.3650 => 0.3642, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/bigfib: 0.17% (0.6029 => 0.6039, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.33% (0.3317 => 0.3306, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 0.05% (0.1991 => 0.1992, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -16.20% (0.0216 => 0.0181, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 9.87% (0.0385 => 0.0423, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 5.43% (0.0313 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 37.44% (0.0227 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.51% (0.0388 => 0.0421, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 0.50% (0.0202 => 0.0203, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 25.74% (0.0136 => 0.0171, std.dev.: 0.0030) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.48% (0.1468 => 0.1475, std.dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.73% (1.1331 => 1.1414, std.dev.: 0.0099) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.91% (0.1409 => 0.1450, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.49% (0.4069 => 0.4049, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.15% (0.1351 => 0.1349, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.61% (0.0574 => 0.0559, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 10.16% (0.0187 => 0.0206, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.23% (0.0581 => 0.0539, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.75% (1.1409 => 1.1495, std.dev.: 0.0399) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.52% (0.0577 => 0.0580, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.73% (0.0246 => 0.0195, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.31% (0.7985 => 0.8010, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -8.89% (0.0045 => 0.0041, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2307.74% (0.6332 => 15.2458, std.dev.: 0.0803) MultiSource/Benchmarks/McCat/08-main/main: 47.46% (0.1831 => 0.2700, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.98% (0.1559 => 0.1419, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1485.23% (0.3344 => 5.3010, std.dev.: 0.0585) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.83% (0.2364 => 0.3211, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: 1.86% (0.0429 => 0.0437, std.dev.: 0.0015) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.02% (0.0224 => 0.0233, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -31.30% (0.0230 => 0.0158, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3291, std.dev.: 0.0185) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0709, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4940, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3452, std.dev.: 0.0995) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0363, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4088, std.dev.: 0.0020) SingleSource/Regression/C/uint64_to_float: -23.67% (2.1832 => 1.6664, std.dev.: 0.0013) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 14.84% (0.1112 => 0.1277, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.99% (0.2774 => 0.2968, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.88% (0.2180 => 0.2330, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.72% (0.1905 => 0.2033, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.89% (0.3295 => 0.3456, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.28% (0.8321 => 0.8677, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.02% (1.1606 => 1.1956, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.84% (1.4479 => 1.4890, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/football/football: 2.79% (0.8768 => 0.9013, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 2.77% (3.8189 => 3.9246, std.dev.: 0.0209) MultiSource/Applications/treecc/treecc: 2.76% (1.9948 => 2.0499, std.dev.: 0.0063) MultiSource/Applications/Burg/burg: 2.74% (1.2222 => 1.2557, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.73% (0.5961 => 0.6124, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.64% (0.4127 => 0.4236, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.54% (0.4559 => 0.4675, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 2.14% (1.2568 => 1.2837, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.01% (0.6227 => 0.6352, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: 1.95% (14.7684 => 15.0562, std.dev.: 0.0739) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.94% (1.3279 => 1.3536, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.90% (0.8611 => 0.8775, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 1.84% (2.2184 => 2.2592, std.dev.: 0.0096) MultiSource/Benchmarks/Bullet/bullet: 1.82% (31.8598 => 32.4394, std.dev.: 0.1727) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.81% (0.8457 => 0.8610, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 1.80% (0.6834 => 0.6957, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 1.78% (3.2366 => 3.2941, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.68% (0.8331 => 0.8471, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.54% (0.8177 => 0.8303, std.dev.: 0.0039) MultiSource/Applications/JM/lencod/lencod: 1.50% (15.3280 => 15.5577, std.dev.: 0.0696) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.42% (0.9069 => 0.9198, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 1.41% (4.9628 => 5.0326, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.38% (0.8716 => 0.8836, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.30% (0.8359 => 0.8468, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.30% (0.9074 => 0.9192, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.29% (0.7966 => 0.8069, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.25% (0.8317 => 0.8421, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.21% (0.8340 => 0.8441, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.19% (0.8518 => 0.8619, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.10% (1.5315 => 1.5483, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.02% (2.1401 => 2.1620, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.99% (1.5795 => 2.5112, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.04% (14.6451 => 16.5551, std.dev.: 0.2565) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.19% (1.1857 => 1.2828, std.dev.: 0.0021) MultiSource/Applications/SIBsim4/SIBsim4: 8.07% (3.1873 => 3.4445, std.dev.: 0.0092) MultiSource/Applications/hexxagon/hexxagon: 4.88% (14.0064 => 14.6904, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 3.47% (3.8206 => 3.9532, std.dev.: 0.0181) SingleSource/Benchmarks/Misc/ReedSolomon: 2.89% (8.5322 => 8.7792, std.dev.: 0.0242) MultiSource/Applications/siod/siod: 2.87% (3.6643 => 3.7694, std.dev.: 0.0102) MultiSource/Benchmarks/mafft/pairlocalalign: 2.42% (63.1822 => 64.7117, std.dev.: 0.0845) MultiSource/Applications/lambda-0_1_3/lambda: 1.97% (7.4933 => 7.6412, std.dev.: 0.0087) MultiSource/Benchmarks/BitBench/five11/five11: 1.89% (5.6030 => 5.7091, std.dev.: 0.0229) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.70% (28.5821 => 29.0683, std.dev.: 0.0379) MultiSource/Benchmarks/FreeBench/neural/neural: 1.30% (1.0841 => 1.0982, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.18% (4.8362 => 4.8933, std.dev.: 0.0138) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.14% (2.4647 => 2.4929, std.dev.: 0.0008) MultiSource/Benchmarks/llubenchmark/llu: 1.06% (1.9967 => 2.0178, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -35.50% (0.0338 => 0.0218, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.15% (0.3269 => 0.2970, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/heapsort: -8.87% (3.2926 => 3.0006, std.dev.: 0.1093) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.59% (2.8773 => 2.7452, std.dev.: 0.0220) SingleSource/Benchmarks/Shootout/lists: -3.39% (7.3375 => 7.0889, std.dev.: 0.0253) MultiSource/Applications/SPASS/SPASS: -3.01% (8.4326 => 8.1785, std.dev.: 0.0699) MultiSource/Applications/lua/lua: -2.30% (29.8330 => 29.1455, std.dev.: 0.1376) SingleSource/Benchmarks/Misc/ffbench: -1.76% (1.4296 => 1.4045, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: -1.40% (3.4237 => 3.3758, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.39% (3.3479 => 3.3012, std.dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.29% (16.4461 => 16.6590, std.dev.: 0.1306) MultiSource/Applications/obsequi/Obsequi: 3.60% (1.0262 => 1.0631, std.dev.: 0.0075) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6790.68% (0.3123 => 21.5196, std.dev.: 0.2741) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.87% (0.2463 => 0.3642, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/bigfib: 0.48% (0.6010 => 0.6039, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.22% (0.3266 => 0.3306, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 1.17% (0.1969 => 0.1992, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 47.15% (0.0123 => 0.0181, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.68% (0.0408 => 0.0423, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.64% (0.0384 => 0.0421, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -5.00% (0.0180 => 0.0171, std.dev.: 0.0030) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.57% (0.1438 => 0.1475, std.dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.75% (1.1329 => 1.1414, std.dev.: 0.0099) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.82% (0.1462 => 0.1450, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.76% (0.4164 => 0.4049, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.46% (0.1369 => 0.1349, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -12.79% (0.0641 => 0.0559, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.64% (0.0195 => 0.0206, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.75% (0.0578 => 0.0539, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.51% (1.1437 => 1.1495, std.dev.: 0.0399) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.50% (0.0627 => 0.0580, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.33% (0.0180 => 0.0195, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.09% (0.8017 => 0.8010, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -33.87% (0.0062 => 0.0041, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 3 23:38:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 4 Nov 2012 01:38:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121104063815.4715F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5569?compare_to=5566&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5569, Order: 167366, Start Time: 2012-11-04 05:13:35, End Time: 2012-11-04 06:38:19 To: 5566, Order: 167364, Start Time: 2012-11-04 01:00:59, End Time: 2012-11-04 02:25:55 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 1 (179 on baseline) Unchanged Tests: 1041 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.47% (1.3035 => 1.2843, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.39% (54.5751 => 56.4238, std.dev.: 0.2057) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1017, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/salsa20: 2.45% (7.4937 => 7.6772, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash2: 2.30% (3.1932 => 3.2665, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.46% (0.1431 => 0.1310, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.75% (0.3821 => 0.3525, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -7.30% (2.4924 => 2.3104, std.dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.57% (3.5339 => 3.3017, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.56% (0.3142 => 0.2936, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.55% (0.2428 => 0.2269, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -6.49% (0.3357 => 0.3139, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.43% (22.4056 => 20.9657, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.41% (0.9542 => 0.8930, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.29% (0.3658 => 0.3428, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -6.26% (16.1920 => 15.1782, std.dev.: 0.0094) MultiSource/Applications/JM/ldecod/ldecod: -6.18% (7.0961 => 6.6578, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: -6.12% (9.2283 => 8.6632, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.02% (1.0544 => 0.9909, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -6.02% (0.2160 => 0.2030, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.97% (0.6484 => 0.6097, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -5.96% (0.9179 => 0.8632, std.dev.: 0.0117) MultiSource/Applications/lemon/lemon: -5.94% (1.1450 => 1.0770, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.93% (0.9852 => 0.9268, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.89% (1.2784 => 1.2031, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.86% (0.5857 => 0.5514, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.85% (1.6364 => 1.5407, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.84% (1.3722 => 1.2920, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -5.83% (4.3330 => 4.0802, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.83% (1.6474 => 1.5514, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: -5.82% (1.1530 => 1.0859, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: -5.81% (1.2515 => 1.1788, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.79% (0.1796 => 0.1692, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.79% (0.2695 => 0.2539, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -5.76% (17.1032 => 16.1186, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.75% (0.6681 => 0.6297, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.74% (0.5591 => 0.5270, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.74% (0.6293 => 0.5932, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.72% (1.4642 => 1.3805, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.70% (0.6052 => 0.5707, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.70% (0.6194 => 0.5841, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.70% (0.6230 => 0.5875, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.69% (0.2355 => 0.2221, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.69% (4.0323 => 3.8030, std.dev.: 0.0113) MultiSource/Benchmarks/sim/sim: -5.67% (0.3406 => 0.3213, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.66% (0.6304 => 0.5947, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.64% (0.5478 => 0.5169, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.64% (0.4151 => 0.3917, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.64% (4.8161 => 4.5447, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.63% (4.5069 => 4.2530, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.62% (14.2083 => 13.4096, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.61% (5.4682 => 5.1612, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.61% (1.2300 => 1.1610, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.61% (0.6667 => 0.6293, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.61% (0.7524 => 0.7102, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.60% (0.5925 => 0.5593, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.59% (0.7919 => 0.7476, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.59% (0.6260 => 0.5910, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.59% (0.7339 => 0.6929, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -5.58% (4.0594 => 3.8329, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.58% (0.5575 => 0.5264, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.57% (0.6446 => 0.6087, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.55% (0.6736 => 0.6362, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -5.54% (2.4021 => 2.2690, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.52% (0.5941 => 0.5613, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -5.52% (0.7447 => 0.7036, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.51% (4.8802 => 4.6111, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.51% (0.3483 => 0.3291, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.50% (0.5802 => 0.5483, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.49% (6.7716 => 6.3998, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.47% (0.6033 => 0.5703, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -5.47% (15.5079 => 14.6602, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.47% (0.6440 => 0.6088, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.46% (0.5456 => 0.5158, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: -5.45% (0.2659 => 0.2514, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.45% (0.6297 => 0.5954, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -5.43% (0.2985 => 0.2823, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: -5.42% (1.3864 => 1.3113, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.42% (0.5705 => 0.5396, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.42% (0.2548 => 0.2410, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.41% (0.5581 => 0.5279, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -5.41% (0.4861 => 0.4598, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: -5.41% (1.3148 => 1.2437, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.41% (0.6676 => 0.6315, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.39% (0.6395 => 0.6050, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.39% (0.3931 => 0.3719, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.39% (0.5849 => 0.5534, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.38% (0.6189 => 0.5856, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.38% (0.3849 => 0.3642, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.38% (0.5859 => 0.5544, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.36% (0.4176 => 0.3952, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.36% (0.5805 => 0.5494, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.35% (0.5570 => 0.5272, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.33% (0.6395 => 0.6054, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.33% (0.4033 => 0.3818, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.33% (0.3848 => 0.3643, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.32% (0.3837 => 0.3633, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: -5.31% (0.3896 => 0.3689, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: -5.31% (0.3581 => 0.3391, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.30% (0.5168 => 0.4894, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.30% (0.5567 => 0.5272, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -5.30% (0.3812 => 0.3610, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.29% (2.2587 => 2.1393, std.dev.: 0.0059) MultiSource/Applications/d/make_dparser: -5.27% (3.5154 => 3.3300, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.27% (0.5863 => 0.5554, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.27% (0.6660 => 0.6309, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.26% (0.5569 => 0.5276, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: -5.26% (0.3880 => 0.3676, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.26% (0.3025 => 0.2866, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.25% (0.3884 => 0.3680, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.25% (0.3831 => 0.3630, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.25% (0.8521 => 0.8074, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.24% (0.3891 => 0.3687, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.20% (0.5999 => 0.5687, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.19% (0.5688 => 0.5393, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.18% (0.3323 => 0.3151, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.17% (0.9557 => 0.9063, std.dev.: 0.0053) SingleSource/Regression/C++/ofstream_ctor: -5.17% (0.3059 => 0.2901, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -5.14% (0.4199 => 0.3983, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.14% (0.2278 => 0.2161, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.13% (0.4813 => 0.4566, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.13% (0.4916 => 0.4664, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.12% (0.2871 => 0.2724, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -5.09% (0.3026 => 0.2872, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.07% (0.3252 => 0.3087, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.07% (0.2385 => 0.2264, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.07% (0.3016 => 0.2863, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -5.07% (0.2939 => 0.2790, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.07% (0.4321 => 0.4102, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -5.07% (0.6750 => 0.6408, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -5.07% (2.1401 => 2.0317, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/moments: -5.06% (0.4248 => 0.4033, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -5.05% (0.4280 => 0.4064, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.05% (0.4083 => 0.3877, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.04% (0.3491 => 0.3315, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.04% (0.3194 => 0.3033, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -5.04% (0.3255 => 0.3091, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.04% (0.3057 => 0.2903, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.02% (2.1713 => 2.0622, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/ary3: -5.02% (0.3446 => 0.3273, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -5.02% (0.2849 => 0.2706, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -5.01% (34.0927 => 32.3837, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.99% (0.2903 => 0.2758, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -4.99% (15.2527 => 14.4912, std.dev.: 0.0088) MultiSource/Applications/lambda-0_1_3/lambda: -4.99% (0.7982 => 0.7584, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: -4.98% (18.2933 => 17.3829, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/hash: -4.97% (0.4524 => 0.4299, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.97% (8.0126 => 7.6142, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.97% (0.7021 => 0.6672, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -4.97% (0.3481 => 0.3308, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.97% (0.2999 => 0.2850, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: -4.97% (0.3867 => 0.3675, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.95% (0.4427 => 0.4208, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.93% (1.2221 => 1.1619, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.92% (0.5329 => 0.5067, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.90% (1.2210 => 1.1612, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -4.89% (0.3621 => 0.3444, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.88% (0.2989 => 0.2843, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -4.88% (0.3788 => 0.3603, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.88% (0.2933 => 0.2790, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: -4.87% (0.4515 => 0.4295, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -4.87% (0.3205 => 0.3049, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.75% (0.7198 => 0.6856, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.58% (0.3319 => 0.3167, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: -4.49% (0.3271 => 0.3124, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: -4.42% (0.8418 => 0.8046, std.dev.: 0.0046) MultiSource/Applications/oggenc/oggenc: -4.34% (5.0226 => 4.8045, std.dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference: -4.13% (0.7779 => 0.7458, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.99% (0.9077 => 0.8715, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: -3.75% (0.6347 => 0.6109, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -3.56% (1.5610 => 1.5055, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: -3.48% (0.6441 => 0.6217, std.dev.: 0.0059) SingleSource/UnitTests/Vector/constpool: -2.11% (20.7746 => 20.3368, std.dev.: 0.0235) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7550, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/richards_benchmark: -8.76% (1.2842 => 1.1717, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7061, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.65% (2.2633 => 2.1807, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.14% (1.0557 => 1.0225, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.93% (1.3096 => 1.2843, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4719, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 4 01:17:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 4 Nov 2012 02:17:49 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121104081749.0EE5B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5570?compare_to=5568&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5570, Order: 167369, Start Time: 2012-11-04 06:51:22, End Time: 2012-11-04 08:17:55 To: 5568, Order: 167366, Start Time: 2012-11-04 05:08:15, End Time: 2012-11-04 06:34:28 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 13 (58 on baseline) Performance Improvements: 1 (8 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 977 (908 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.46% (0.2985 => 0.3148, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: 2.90% (8.1984 => 8.4365, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.54% (1.6308 => 1.6723, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.20% (0.8011 => 0.8187, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.90% (0.8946 => 0.9116, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.71% (0.9137 => 0.9293, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.63% (0.8300 => 0.8435, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.47% (1.3536 => 1.3735, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/gs/gs: 1.16% (4.1870 => 4.2357, std.dev.: 0.0168) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.28% (1.4960 => 1.8892, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 14.11% (19.5390 => 22.2962, std.dev.: 0.9311) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.85% (2.3561 => 2.6354, std.dev.: 0.0665) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.87% (0.3158 => 0.3438, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.28% (0.2968 => 0.2841, std.dev.: 0.0018) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.21% (16.6590 => 16.6941, std.dev.: 0.1768) MultiSource/Applications/obsequi/Obsequi: -0.39% (1.0631 => 1.0590, std.dev.: 0.0114) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.57% (21.5196 => 21.6413, std.dev.: 0.3065) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.38% (0.3642 => 0.3628, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 0.28% (0.6039 => 0.6056, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.48% (0.3306 => 0.3322, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 0.70% (0.1992 => 0.2006, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 19.34% (0.0181 => 0.0216, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0423 => 0.0425, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -17.88% (0.0330 => 0.0271, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0312 => 0.0312, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.33% (0.0421 => 0.0407, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0203 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 14.62% (0.0171 => 0.0196, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1475 => 0.1474, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.62% (1.1414 => 1.1599, std.dev.: 0.0015) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.21% (0.1450 => 0.1418, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.15% (0.4049 => 0.4055, std.dev.: 0.0269) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.41% (0.1349 => 0.1368, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.61% (0.0559 => 0.0550, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.17% (0.0206 => 0.0229, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.35% (0.0539 => 0.0584, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.21% (1.1495 => 1.1471, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.24% (0.0580 => 0.0567, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.51% (0.0195 => 0.0194, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.07% (0.8010 => 0.8016, std.dev.: 0.0185) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 53.66% (0.0041 => 0.0063, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2294.60% (0.6332 => 15.1626, std.dev.: 0.1938) MultiSource/Benchmarks/McCat/08-main/main: 46.26% (0.1831 => 0.2678, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.72% (0.1559 => 0.1423, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1490.49% (0.3344 => 5.3186, std.dev.: 0.0451) SingleSource/Benchmarks/Misc-C++/Large/ray: 34.22% (0.2364 => 0.3173, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel: 1.86% (0.0429 => 0.0437, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.91% (0.0224 => 0.0235, std.dev.: 0.0051) SingleSource/UnitTests/byval-alignment: -32.17% (0.0230 => 0.0156, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3286, std.dev.: 0.0466) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0689, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4890, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3411, std.dev.: 0.0388) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0324, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4024, std.dev.: 0.0036) SingleSource/Regression/C/uint64_to_float: -24.15% (2.1832 => 1.6560, std.dev.: 0.0039) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.54% (0.0810 => 0.0944, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.07% (0.0773 => 0.0874, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.48% (0.2180 => 0.2343, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.30% (0.1905 => 0.2025, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.54% (0.8321 => 0.8782, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.83% (0.3003 => 0.3148, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.24% (0.3137 => 0.3270, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.04% (0.3295 => 0.3428, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.86% (0.9688 => 1.0062, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.46% (1.1606 => 1.2008, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.44% (0.4127 => 0.4269, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.43% (1.3279 => 1.3735, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.21% (0.7932 => 0.8187, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.05% (0.6287 => 0.6479, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.82% (0.8204 => 0.8435, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.81% (0.9039 => 0.9293, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.71% (0.6227 => 0.6396, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.60% (0.8885 => 0.9116, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.55% (0.4783 => 0.4905, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/gs/gs: 2.55% (4.1305 => 4.2357, std.dev.: 0.0168) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.35% (6.6074 => 6.7630, std.dev.: 0.0204) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.27% (0.8457 => 0.8649, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.17% (0.8697 => 0.8886, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.09% (0.9056 => 0.9245, std.dev.: 0.0058) MultiSource/Applications/lua/lua: 2.06% (3.8189 => 3.8976, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.06% (1.6386 => 1.6723, std.dev.: 0.0079) MultiSource/Applications/minisat/minisat: 2.02% (0.6834 => 0.6972, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.98% (8.6476 => 8.8188, std.dev.: 0.0204) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.88% (0.8340 => 0.8497, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.78% (4.1763 => 4.2508, std.dev.: 0.0182) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.70% (0.6586 => 0.6698, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 1.68% (1.1271 => 1.1460, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.65% (2.1401 => 2.1755, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.61% (0.8177 => 0.8309, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.58% (0.8050 => 0.8177, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.57% (13.1811 => 13.3876, std.dev.: 0.0771) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.52% (0.8286 => 0.8412, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.48% (0.8261 => 0.8383, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.47% (0.7966 => 0.8083, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.35% (4.4880 => 4.5485, std.dev.: 0.0133) MultiSource/Benchmarks/Bullet/bullet: 1.34% (31.8598 => 32.2873, std.dev.: 0.1620) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.28% (0.8359 => 0.8466, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 57.40% (1.5795 => 2.4862, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C++/city/city: 55.28% (0.0199 => 0.0309, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.77% (14.6451 => 16.6610, std.dev.: 0.4215) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.01% (1.1857 => 1.2807, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 7.99% (3.1873 => 3.4419, std.dev.: 0.0496) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.91% (0.3186 => 0.3438, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 4.78% (14.0064 => 14.6760, std.dev.: 0.0112) MultiSource/Benchmarks/FreeBench/distray/distray: 4.64% (0.2390 => 0.2501, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 3.45% (8.5322 => 8.8263, std.dev.: 0.0114) MultiSource/Benchmarks/sim/sim: 3.19% (3.8206 => 3.9425, std.dev.: 0.0219) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.78% (44.5605 => 45.8010, std.dev.: 0.4449) MultiSource/Applications/siod/siod: 2.45% (3.6643 => 3.7542, std.dev.: 0.0292) MultiSource/Applications/lambda-0_1_3/lambda: 1.85% (7.4933 => 7.6323, std.dev.: 0.0157) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.83% (28.5821 => 29.1041, std.dev.: 0.0622) MultiSource/Benchmarks/mafft/pairlocalalign: 1.77% (63.1822 => 64.2974, std.dev.: 0.2675) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.29% (1.5941 => 1.6147, std.dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -8.74% (3.2926 => 3.0048, std.dev.: 0.0994) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.61% (0.3269 => 0.3053, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.37% (2.8773 => 2.7515, std.dev.: 0.0262) SingleSource/Benchmarks/Shootout/lists: -3.71% (7.3375 => 7.0656, std.dev.: 0.0114) MultiSource/Applications/lua/lua: -2.44% (29.8330 => 29.1051, std.dev.: 0.1518) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.82% (1.2822 => 1.2588, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/hash2: -1.52% (3.4237 => 3.3716, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.21% (3.3479 => 3.3075, std.dev.: 0.0012) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.51% (16.4461 => 16.6941, std.dev.: 0.1768) MultiSource/Applications/obsequi/Obsequi: 3.20% (1.0262 => 1.0590, std.dev.: 0.0114) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6829.65% (0.3123 => 21.6413, std.dev.: 0.3065) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.30% (0.2463 => 0.3628, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 0.77% (0.6010 => 0.6056, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.71% (0.3266 => 0.3322, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 1.88% (0.1969 => 0.2006, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 75.61% (0.0123 => 0.0216, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 6.69% (0.0254 => 0.0271, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 5.99% (0.0384 => 0.0407, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 8.89% (0.0180 => 0.0196, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.50% (0.1438 => 0.1474, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.38% (1.1329 => 1.1599, std.dev.: 0.0015) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.01% (0.1462 => 0.1418, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.62% (0.4164 => 0.4055, std.dev.: 0.0269) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.07% (0.1369 => 0.1368, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -14.20% (0.0641 => 0.0550, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 17.44% (0.0195 => 0.0229, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.04% (0.0578 => 0.0584, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.30% (1.1437 => 1.1471, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.57% (0.0627 => 0.0567, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.78% (0.0180 => 0.0194, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.01% (0.8017 => 0.8016, std.dev.: 0.0185) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 1.61% (0.0062 => 0.0063, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 4 01:30:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 4 Nov 2012 02:30:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121104083020.A57562A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5571?compare_to=5569&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5571, Order: 167369, Start Time: 2012-11-04 07:02:36, End Time: 2012-11-04 08:30:23 To: 5569, Order: 167366, Start Time: 2012-11-04 05:13:35, End Time: 2012-11-04 06:38:19 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (149 on baseline) Unchanged Tests: 1041 (889 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 21.42% (0.3660 => 0.4444, std.dev.: 0.0293) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.31% (1.2783 => 1.3717, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.58% (54.5751 => 56.5306, std.dev.: 0.0653) SingleSource/Benchmarks/Misc/salsa20: 2.72% (7.4937 => 7.6979, std.dev.: 0.0124) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1011, std.dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.46% (0.1431 => 0.1310, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.83% (0.3821 => 0.3522, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -7.36% (2.4924 => 2.3090, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.53% (3.5339 => 3.3032, std.dev.: 0.0068) MultiSource/Applications/sgefa/sgefa: -6.49% (0.3357 => 0.3139, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.46% (0.3142 => 0.2939, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.40% (0.9542 => 0.8931, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.39% (22.4056 => 20.9743, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.26% (0.3658 => 0.3429, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -6.20% (16.1920 => 15.1879, std.dev.: 0.0200) MultiSource/Applications/JM/ldecod/ldecod: -6.19% (7.0961 => 6.6571, std.dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: -6.15% (9.2283 => 8.6605, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/oourafft: -6.06% (0.2160 => 0.2029, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.00% (1.0544 => 0.9911, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.00% (0.6484 => 0.6095, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.96% (0.9852 => 0.9265, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.91% (1.6474 => 1.5501, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.87% (1.3722 => 1.2916, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -5.84% (1.1450 => 1.0781, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.82% (1.6364 => 1.5411, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.82% (0.6304 => 0.5937, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: -5.81% (1.2515 => 1.1788, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.80% (1.2784 => 1.2043, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.79% (0.2695 => 0.2539, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.75% (0.5478 => 0.5163, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.74% (17.1032 => 16.1211, std.dev.: 0.0242) MultiSource/Benchmarks/Prolangs-C/football/football: -5.74% (0.9179 => 0.8652, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: -5.74% (4.3330 => 4.0845, std.dev.: 0.0161) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.71% (1.2300 => 1.1598, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.70% (0.5857 => 0.5523, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -5.67% (0.7447 => 0.7025, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: -5.67% (0.3406 => 0.3213, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.65% (0.2355 => 0.2222, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.64% (0.2428 => 0.2291, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: -5.63% (1.1530 => 1.0881, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.62% (0.5849 => 0.5520, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.62% (0.5802 => 0.5476, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.62% (0.5591 => 0.5277, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.61% (0.5575 => 0.5262, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.61% (0.7524 => 0.7102, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.60% (0.6052 => 0.5713, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.60% (0.7339 => 0.6928, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.59% (14.2083 => 13.4137, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.59% (0.6297 => 0.5945, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.59% (4.8161 => 4.5470, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.59% (0.5925 => 0.5594, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.58% (0.5859 => 0.5532, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.58% (0.6260 => 0.5911, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.57% (4.0323 => 3.8077, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.56% (0.6667 => 0.6296, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.56% (1.4642 => 1.3828, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.56% (0.5705 => 0.5388, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.56% (0.6660 => 0.6290, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.55% (0.6395 => 0.6040, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.53% (5.4682 => 5.1657, std.dev.: 0.0294) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.51% (0.3483 => 0.3291, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.51% (0.6230 => 0.5887, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.50% (4.5069 => 4.2588, std.dev.: 0.0096) MultiSource/Applications/SPASS/SPASS: -5.49% (15.5079 => 14.6565, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.49% (0.6194 => 0.5854, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -5.48% (2.4021 => 2.2705, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.47% (0.6033 => 0.5703, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.47% (0.6676 => 0.6311, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.46% (0.5805 => 0.5488, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.46% (6.7716 => 6.4019, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.46% (0.2548 => 0.2409, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.46% (0.7919 => 0.7487, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: -5.45% (0.4861 => 0.4596, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.45% (0.6189 => 0.5852, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.44% (0.3931 => 0.3717, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.44% (0.5863 => 0.5544, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.44% (0.5570 => 0.5267, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -5.44% (1.3148 => 1.2433, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.43% (0.6440 => 0.6090, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.42% (4.8802 => 4.6157, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.41% (0.5456 => 0.5161, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.40% (0.6446 => 0.6098, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.39% (0.5581 => 0.5280, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.38% (0.2659 => 0.2516, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.37% (0.6681 => 0.6322, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.37% (0.5567 => 0.5268, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.36% (0.2985 => 0.2825, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.36% (0.6293 => 0.5956, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.35% (0.5941 => 0.5623, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.33% (0.5569 => 0.5272, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -5.33% (0.3812 => 0.3609, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.32% (0.8521 => 0.8068, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-4: -5.31% (0.3880 => 0.3674, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/18-imp/imp: -5.31% (0.3581 => 0.3391, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -5.30% (0.3848 => 0.3644, std.dev.: 0.0068) MultiSource/Applications/lua/lua: -5.30% (4.0594 => 3.8442, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions: -5.29% (0.4176 => 0.3955, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.29% (0.5688 => 0.5387, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: -5.28% (0.4033 => 0.3820, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.28% (2.2587 => 2.1395, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-2: -5.25% (0.3831 => 0.3630, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.24% (0.3837 => 0.3636, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.24% (1.3864 => 1.3138, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/synchronized: -5.24% (0.3896 => 0.3692, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.22% (0.5168 => 0.4898, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.21% (0.6736 => 0.6385, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.21% (0.4321 => 0.4096, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.18% (0.7198 => 0.6825, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.18% (0.3323 => 0.3151, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.17% (0.3057 => 0.2899, std.dev.: 0.0056) MultiSource/Applications/d/make_dparser: -5.15% (3.5154 => 3.3342, std.dev.: 0.0146) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.15% (0.4916 => 0.4663, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.14% (0.7021 => 0.6660, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.13% (2.1713 => 2.0599, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.13% (0.6395 => 0.6067, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.13% (0.3491 => 0.3312, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.11% (0.9557 => 0.9069, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/bigfib: -5.05% (0.6750 => 0.6409, std.dev.: 0.0088) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.05% (0.3884 => 0.3688, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.04% (0.3252 => 0.3088, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.01% (0.5329 => 0.5062, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -5.00% (0.4199 => 0.3989, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.99% (0.2385 => 0.2266, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/fibo: -4.98% (0.2871 => 0.2728, std.dev.: 0.0048) MultiSource/Benchmarks/Bullet/bullet: -4.97% (34.0927 => 32.3984, std.dev.: 0.0171) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.96% (0.2278 => 0.2165, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.95% (8.0126 => 7.6162, std.dev.: 0.0050) MultiSource/Applications/treecc/treecc: -4.92% (2.1401 => 2.0349, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -4.91% (0.7982 => 0.7590, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -4.90% (15.2527 => 14.5056, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.88% (0.5999 => 0.5706, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -4.86% (0.4280 => 0.4072, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.83% (0.2999 => 0.2854, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -4.83% (0.4515 => 0.4297, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: -4.82% (18.2933 => 17.4120, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.73% (1.2210 => 1.1633, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.71% (1.2221 => 1.1646, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.64% (0.2933 => 0.2797, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.58% (0.4083 => 0.3896, std.dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.58% (0.3319 => 0.3167, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: -4.51% (0.4524 => 0.4320, std.dev.: 0.0079) MultiSource/Applications/oggenc/oggenc: -4.34% (5.0226 => 4.8044, std.dev.: 0.0036) MultiSource/Applications/spiff/spiff: -4.05% (0.8418 => 0.8077, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.84% (0.9077 => 0.8728, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/09-vor/vor: -3.76% (0.3271 => 0.3148, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.36% (1.5610 => 1.5085, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7511, std.dev.: 0.0314) SingleSource/Benchmarks/Misc/richards_benchmark: -8.61% (1.2842 => 1.1736, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.83% (1.7753 => 1.7073, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fbench: -3.74% (2.2633 => 2.1787, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4708, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 4 01:57:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 4 Nov 2012 02:57:39 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121104085739.3949D2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5572?compare_to=5567&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5572, Order: 167366, Start Time: 2012-11-04 05:39:04, End Time: 2012-11-04 08:57:43 To: 5567, Order: 167364, Start Time: 2012-11-04 00:52:38, End Time: 2012-11-04 04:08:39 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (167 on baseline) Performance Improvements: 2 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (723 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.44% (2.4521 => 2.4167, std.dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: -4.75% (0.2275 => 0.2167, std.dev.: 0.0042) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.48% (0.0625 => 0.0878, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.08% (0.1063 => 0.1404, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.47% (0.0714 => 0.0903, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.56% (0.2969 => 0.3728, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.86% (0.1106 => 0.1381, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 24.78% (0.0452 => 0.0564, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.45% (0.4139 => 0.5151, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.45% (0.4994 => 0.6215, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.36% (0.4253 => 0.5289, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 24.16% (1.5932 => 1.9781, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.83% (0.5900 => 0.7306, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.77% (0.0547 => 0.0677, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.92% (0.5000 => 0.6146, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.74% (0.0897 => 0.1101, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.43% (0.0584 => 0.0715, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.22% (0.1620 => 0.1980, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.86% (0.1107 => 0.1349, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.74% (0.1021 => 0.1243, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.58% (0.1103 => 0.1341, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.58% (0.0584 => 0.0710, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 21.54% (0.0599 => 0.0728, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.18% (0.0642 => 0.0778, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.17% (0.0633 => 0.0767, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 20.68% (0.0948 => 0.1144, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.52% (0.0541 => 0.0652) MultiSource/Benchmarks/McCat/05-eks/eks: 20.38% (0.1619 => 0.1949, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 20.34% (0.0821 => 0.0988) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.16% (0.3903 => 0.4690, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.01% (0.1549 => 0.1859, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.01% (0.1604 => 0.1925, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.95% (0.0822 => 0.0986, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.84% (0.1003 => 0.1202, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 19.11% (0.0947 => 0.1128, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.74% (0.1462 => 0.1736, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.73% (0.0582 => 0.0691, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.64% (0.3890 => 0.4615, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 18.47% (0.5826 => 0.6902, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 18.36% (0.5889 => 0.6970, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 18.32% (0.0808 => 0.0956, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.27% (0.2014 => 0.2382, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 18.14% (0.1218 => 0.1439, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.13% (1.3152 => 1.5536, std.dev.: 0.0043) MultiSource/Applications/spiff/spiff: 18.07% (0.4029 => 0.4757, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/mst/mst: 18.05% (0.0698 => 0.0824, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.95% (0.2736 => 0.3227, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/09-vor/vor: 17.94% (0.1505 => 0.1775, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.90% (0.0581 => 0.0685, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.66% (0.2866 => 0.3372, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.56% (0.1088 => 0.1279, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 17.38% (0.5546 => 0.6510, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.32% (3.5627 => 4.1796, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/gs/gs: 17.22% (1.8794 => 2.2031, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.19% (0.5026 => 0.5890, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.00% (1.6211 => 1.8967, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.77% (0.2875 => 0.3357, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 16.65% (0.7171 => 0.8365, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.57% (0.1968 => 0.2294, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.48% (0.3271 => 0.3810, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 16.47% (0.1421 => 0.1655, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 16.43% (1.0781 => 1.2552, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.38% (0.1160 => 0.1350, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.35% (0.4361 => 0.5074, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 16.28% (0.1284 => 0.1493, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.27% (0.4658 => 0.5416, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: 16.27% (0.9697 => 1.1275, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.21% (0.3195 => 0.3713, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.14% (0.2738 => 0.3180, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: 16.14% (0.2714 => 0.3152, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.11% (0.3930 => 0.4563, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/fibo: 16.00% (0.2725 => 0.3161, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 15.93% (0.2813 => 0.3261, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.92% (4.4195 => 5.1233, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/objinst: 15.91% (0.2823 => 0.3272, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.87% (0.2729 => 0.3162, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 15.86% (0.2780 => 0.3221, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 15.85% (0.2750 => 0.3186, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.83% (2.7292 => 3.1613, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 15.82% (0.9909 => 1.1477, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/random: 15.80% (0.2803 => 0.3246, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 15.78% (0.3004 => 0.3478, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 15.76% (0.3096 => 0.3584, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 15.72% (0.2811 => 0.3253, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.65% (0.2792 => 0.3229, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 15.64% (4.2109 => 4.8696, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.58% (2.0673 => 2.3893, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.56% (0.2911 => 0.3364, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.52% (1.9694 => 2.2751, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.45% (1.9966 => 2.3051, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 15.15% (0.3267 => 0.3762, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 15.02% (23.5202 => 27.0528, std.dev.: 0.0482) SingleSource/Benchmarks/Shootout-C++/ary2: 15.01% (0.3317 => 0.3815, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 15.01% (0.3258 => 0.3747, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.87% (0.3060 => 0.3515, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.86% (0.1090 => 0.1252, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 14.84% (0.3348 => 0.3845, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.81% (0.3362 => 0.3860, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.72% (0.3845 => 0.4411, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 14.68% (0.3446 => 0.3952, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.63% (0.3124 => 0.3581, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 14.38% (0.4146 => 0.4742, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.34% (0.3625 => 0.4145, std.dev.: 0.0065) SingleSource/UnitTests/ObjC/exceptions-4: 14.29% (0.3465 => 0.3960, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.28% (0.3488 => 0.3986, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 14.22% (0.3678 => 0.4201, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 14.22% (0.3496 => 0.3993, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 14.19% (0.2566 => 0.2930, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/trivial-interface: 14.18% (0.3442 => 0.3930, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.17% (0.3282 => 0.3747, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 14.16% (0.3460 => 0.3950, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 14.11% (0.3650 => 0.4165, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 14.06% (1.4269 => 1.6275, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/synchronized: 14.04% (0.3469 => 0.3956, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 14.04% (0.3477 => 0.3965, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 14.01% (0.3726 => 0.4248, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 13.98% (0.2075 => 0.2365, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 13.83% (0.4251 => 0.4839, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.82% (0.3981 => 0.4531, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 13.72% (0.3643 => 0.4143, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.66% (0.3690 => 0.4194, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/parameter-passing: 13.59% (0.3724 => 0.4230, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 13.52% (2.1653 => 2.4581, std.dev.: 0.0020) MultiSource/Applications/treecc/treecc: 13.38% (0.7875 => 0.8929, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 13.30% (4.6177 => 5.2318, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/bigfib: 13.03% (0.5012 => 0.5665, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 12.93% (0.2691 => 0.3039, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 12.80% (2.1013 => 2.3702, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.58% (0.1383 => 0.1557, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 12.00% (5.5417 => 6.2069, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.89% (0.6435 => 0.7200, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.81% (0.2040 => 0.2281, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 11.38% (0.3498 => 0.3896, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 10.97% (0.6634 => 0.7362, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.89% (0.2737 => 0.3035, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.80% (0.1028 => 0.1139, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 10.42% (0.4847 => 0.5352, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 10.16% (0.3336 => 0.3675, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: 9.41% (0.2391 => 0.2616, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 9.33% (2.0346 => 2.2244, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.83% (4.6926 => 5.1068, std.dev.: 0.1541) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.64% (11.6398 => 12.6459, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.49% (0.5584 => 0.6002, std.dev.: 0.0147) MultiSource/Applications/kimwitu++/kc: 6.59% (11.9555 => 12.7434, std.dev.: 0.0146) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.85% (0.3792 => 0.3976, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6537, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 8.32% (0.2802 => 0.3035, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6109, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/objinst: 5.02% (12.0509 => 12.6556, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1694, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.60% (0.3693 => 0.3863, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-2: 3.85% (1.8057 => 1.8752, std.dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/dry: 2.59% (14.0481 => 14.4121, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary3: 2.00% (15.8721 => 16.1899, std.dev.: 0.0079) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.66% (3.1722 => 3.2248, std.dev.: 0.0035) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3009, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2866, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.26% (1.0927 => 1.1065, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.23% (1.0142 => 1.0267, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.14% (8.4155 => 8.5116, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5878, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.41% (2.4764 => 2.4167, std.dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.56% (25.4195 => 16.3800, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/ary2: -9.78% (0.2402 => 0.2167, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9768, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7747, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -2.87% (3.6262 => 3.5221, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.56% (11.2080 => 10.9209, std.dev.: 0.0146) SingleSource/Benchmarks/Dhrystone/fldry: -2.31% (17.2379 => 16.8390, std.dev.: 0.0258) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.18% (41.7953 => 40.8828, std.dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5741, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.60% (0.6293 => 0.6192, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4960, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0409, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.07% (3.3991 => 3.3626, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 4 01:07:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 4 Nov 2012 03:07:43 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121104090743.E12ED2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5573?compare_to=5548&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5573, Order: 167353, Start Time: 2012-11-03 09:08:53, End Time: 2012-11-04 09:07:49 To: 5548, Order: 167295, Start Time: 2012-11-02 16:06:55, End Time: 2012-11-03 08:38:42 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 2 (36 on baseline) New Passes: 0 (12 on baseline) Performance Regressions: 8 (169 on baseline) Performance Improvements: 16 (40 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 41 (7 on baseline) Unchanged Tests: 975 (644 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -51.30% (96.4987 => 46.9978, std.dev.: 0.0543) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.5617 => 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/BenchmarkGame/n-body: 18.64% (0.0880 => 0.1044, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/ffbench: 4.77% (0.9809 => 1.0277, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 4.70% (5.1853 => 5.4288, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.58% (11.0518 => 11.2268, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: 1.42% (5.9648 => 6.0495, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.42% (4.3456 => 4.4071, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.22% (5.5353 => 5.6031, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: 1.06% (1.9133 => 1.9335, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -59.73% (0.2364 => 0.0952, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -25.00% (3.2389 => 2.4293, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: -15.22% (0.1176 => 0.0997, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: -14.32% (0.4044 => 0.3465, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: -11.19% (0.2199 => 0.1953, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.91% (10.1265 => 9.6295, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.67% (11.0395 => 10.6343, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/flops-6: -28.41% (1.9835 => 1.4199, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-5: -24.68% (2.0044 => 1.5098, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -17.12% (2.3171 => 1.9205, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-8: -13.86% (2.0309 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -5.57% (9.1880 => 8.6764, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.57% (1.3941 => 1.3165, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -2.94% (7.7990 => 7.5697, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.06% (5.5095 => 5.3960, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.51% (3.2716 => 3.2223, std.dev.: 0.0018) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/ClamAV/clamscan: -0.16% (28.2231 => 28.1772, std.dev.: 0.0492) MultiSource/Applications/JM/ldecod/ldecod: 0.02% (6.2988 => 6.3000, std.dev.: 0.0189) MultiSource/Applications/JM/lencod/lencod: 0.09% (18.6648 => 18.6810, std.dev.: 0.0206) MultiSource/Applications/oggenc/oggenc: - (0.0020 => 0.0020) MultiSource/Applications/sqlite3/sqlite3: -0.04% (0.5226 => 0.5224, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 0.33% (5.0230 => 5.0395, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -0.06% (1.4173 => 1.4165, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -0.23% (0.3038 => 0.3031, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0301 => 0.0301, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 0.18% (1.3211 => 1.3235, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/voronoi/voronoi: 1.35% (0.1924 => 0.1950, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.26% (0.0019 => 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: - (0.0019 => 0.0019, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 0.72% (0.2777 => 0.2797, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.61% (1.3051 => 1.3130, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 0.09% (5.1934 => 5.1983, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.04% (1.3778 => 1.3773, std.dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 0.06% (1.0874 => 1.0881, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0020 => 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/ClamAV/clamscan: - (0.0001 => 0.0001) MultiSource/Applications/JM/ldecod/ldecod: - (0.0001 => 0.0001) MultiSource/Applications/JM/lencod/lencod: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0726 => 0.0726, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: - (0.0001 => 0.0001) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8643 => 499.8528, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/voronoi/voronoi: - (0.0001 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: - (0.0001 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: - (0.0001 => 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/nbench/nbench: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/nbench/nbench MultiSource/Applications/ClamAV/clamscan: 27.06% (22.1758 => 28.1772, std.dev.: 0.0492) MultiSource/Applications/JM/ldecod/ldecod: -39.63% (10.4361 => 6.3000, std.dev.: 0.0189) MultiSource/Applications/JM/lencod/lencod: -14.84% (21.9371 => 18.6810, std.dev.: 0.0206) MultiSource/Applications/oggenc/oggenc: -99.97% (5.7591 => 0.0020) MultiSource/Applications/sqlite3/sqlite3: -96.96% (17.1811 => 0.5224, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -25.69% (63.2438 => 46.9978, std.dev.: 0.0543) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.91% (4.9449 => 5.0395, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -8.11% (1.5415 => 1.4165, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -37.88% (0.4879 => 0.3031, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.55% (6.6874 => 0.0301, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -75.27% (5.3526 => 1.3235, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/voronoi/voronoi: -27.78% (0.2700 => 0.1950, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -99.93% (2.9384 => 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -99.83% (1.1194 => 0.0019, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -11.96% (0.3177 => 0.2797, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -75.62% (5.3855 => 1.3130, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (5.0018 => 5.1983, std.dev.: 0.0084) MultiSource/Benchmarks/nbench/nbench: -8.10% (1.1840 => 1.0881, std.dev.: 0.0009) New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/nbench/nbench MultiSource/Applications/ClamAV/clamscan: -99.94% (0.1629 => 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -99.92% (0.1298 => 0.0001) MultiSource/Applications/sqlite3/sqlite3: -100.00% (4.6441 => 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -98.00% (0.0050 => 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -50.00% (0.0002 => 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -75.00% (0.0004 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -99.97% (0.3987 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 44224.98% (1.1277 => 499.8528, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/voronoi/voronoi: -99.97% (0.3070 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -100.00% (2.6546 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -100.00% (2.6778 => 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -100.00% (4.5009 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -99.80% (0.0506 => 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -97.30% (0.0037 => 0.0001) MultiSource/Benchmarks/nbench/nbench: -100.00% (11.6436 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 188.87% (0.5229 => 1.5105, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 11.58% (14.9895 => 16.7252, std.dev.: 0.0173) MultiSource/Applications/kimwitu++/kc: 35.18% (14.1553 => 19.1354, std.dev.: 0.0175) MultiSource/Benchmarks/MallocBench/gs/gs: 12.00% (4.1105 => 4.6036, std.dev.: 0.0189) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.33% (3.4629 => 5.7943, std.dev.: 0.0188) SingleSource/Benchmarks/Misc-C++/stepanov_container: 61.65% (0.6222 => 1.0058, std.dev.: 0.0011) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3840900.00% (0.0001 => 3.8410, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 11198700.00% (0.0001 => 11.1988, std.dev.: 0.0480) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 66300.00% (0.0001 => 0.0664, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050200.00% (0.0001 => 10.0503, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5491900.00% (0.0001 => 5.4920, std.dev.: 0.0094) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 50.76% (7.0540 => 10.6343, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/distray/distray: 50.66% (0.1056 => 0.1591, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 39.95% (0.0746 => 0.1044, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 36.58% (0.0730 => 0.0997, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 36.38% (0.1432 => 0.1953, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Oscar: 23.27% (0.0636 => 0.0784, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 19.69% (0.2554 => 0.3057, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 19.17% (0.0798 => 0.0951, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.16% (0.1566 => 0.1866, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 19.15% (0.1175 => 0.1400, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 18.92% (0.0793 => 0.0943, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.35% (8.1363 => 9.6295, std.dev.: 0.0067) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 17.60% (0.1125 => 0.1323, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 17.30% (0.1555 => 0.1824, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.98% (0.0648 => 0.0758, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 16.86% (0.1584 => 0.1851, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.75% (0.0842 => 0.0983, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.00% (0.0675 => 0.0783, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.84% (0.0953 => 0.1104, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.82% (0.8172 => 0.9465, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.50% (0.2065 => 0.2385, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: 15.38% (0.0871 => 0.1005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.35% (0.0886 => 0.1022, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.32% (0.0770 => 0.0888, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 14.69% (0.1695 => 0.1944, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/matrix: 14.55% (0.0818 => 0.0937, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.48% (0.2107 => 0.2412, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.18% (0.2271 => 0.2593, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.11% (0.0730 => 0.0833, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.00% (0.2758 => 0.3144, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.99% (0.1029 => 0.1173, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.97% (0.3121 => 0.3557, std.dev.: 0.0029) MultiSource/Applications/aha/aha: 13.90% (0.1151 => 0.1311, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.86% (0.5981 => 0.6810, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 13.67% (0.1163 => 0.1322, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.56% (0.1062 => 0.1206, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.09% (0.1337 => 0.1512, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 13.01% (0.1268 => 0.1433, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 13.00% (1.1642 => 1.3156, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.98% (0.5569 => 0.6292, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 12.98% (0.1117 => 0.1262, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.95% (0.0834 => 0.0942, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 12.92% (0.7433 => 0.8393, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.82% (14.3668 => 16.2088, std.dev.: 0.0138) SingleSource/Benchmarks/McGill/chomp: 12.75% (0.1655 => 0.1866, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 12.73% (0.7115 => 0.8021, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.70% (0.1906 => 0.2148, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.36% (0.9765 => 1.0972, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.32% (0.3441 => 0.3865, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.32% (0.1940 => 0.2179, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.20% (0.5860 => 0.6575, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.17% (0.0838 => 0.0940, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 12.06% (0.7835 => 0.8780, std.dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.98% (0.4615 => 0.5168, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 11.58% (0.3109 => 0.3469, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.52% (0.5105 => 0.5693, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.42% (0.6675 => 0.7437, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/18-imp/imp: 11.36% (0.3423 => 0.3812, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.35% (1.3050 => 1.4531, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.32% (0.1510 => 0.1681, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1143 => 0.1270, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.08% (0.1236 => 0.1373, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.05% (0.1032 => 0.1146, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 10.95% (3.8723 => 4.2963, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.87% (4.2646 => 4.7280, std.dev.: 0.0035) MultiSource/Applications/d/make_dparser: 10.70% (3.3354 => 3.6922, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.43% (0.3307 => 0.3652, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.31% (2.2022 => 2.4293, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.24% (0.5020 => 0.5534, std.dev.: 0.0077) MultiSource/Applications/treecc/treecc: 10.22% (2.0273 => 2.2345, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.20% (0.8067 => 0.8890, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/parameter-passing: 10.08% (0.3927 => 0.4323, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.01% (0.3886 => 0.4275, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.90% (0.3473 => 0.3817, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.87% (0.1044 => 0.1147, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.82% (0.3543 => 0.3891, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 9.80% (0.3828 => 0.4203, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 9.76% (0.6456 => 0.7086, std.dev.: 0.0125) SingleSource/UnitTests/ObjC/exceptions-2: 9.75% (0.3497 => 0.3838, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.74% (0.3561 => 0.3908, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.74% (0.3543 => 0.3888, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 9.70% (0.3516 => 0.3857, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 9.69% (9.4845 => 10.4040, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.65% (0.8101 => 0.8883, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 9.61% (0.3694 => 0.4049, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.58% (1.5859 => 1.7379, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 9.48% (1.0722 => 1.1738, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.43% (0.4103 => 0.4490, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.38% (0.2430 => 0.2658, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.38% (0.6450 => 0.7055, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 9.34% (2.2969 => 2.5114, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/05-eks/eks: 9.30% (0.4299 => 0.4699, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.26% (0.2603 => 0.2844, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.20% (0.1695 => 0.1851, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.19% (2.2024 => 2.4048, std.dev.: 0.0201) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.04% (3.8922 => 4.2441, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/09-vor/vor: 9.03% (0.3180 => 0.3467, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 9.01% (0.8921 => 0.9725, std.dev.: 0.0014) SingleSource/Benchmarks/Stanford/Puzzle: 8.99% (0.1268 => 0.1382, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 8.91% (0.4289 => 0.4671, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.89% (0.4636 => 0.5048, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.88% (1.1861 => 1.2914, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.87% (0.3865 => 0.4208, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 8.84% (1.5603 => 1.6982, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.83% (0.1892 => 0.2059, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.80% (1.4186 => 1.5434, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists: 8.74% (0.3422 => 0.3721, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.66% (0.4620 => 0.5020, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.61% (0.4203 => 0.4565, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 8.50% (0.3387 => 0.3675, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 8.26% (0.6030 => 0.6528, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.20% (0.7326 => 0.7927, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: 8.20% (0.1463 => 0.1583, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 8.12% (0.5925 => 0.6406, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 8.08% (0.4048 => 0.4375, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.08% (0.3826 => 0.4135, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 8.01% (0.3684 => 0.3979, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.00% (0.3650 => 0.3942, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 7.99% (0.3603 => 0.3891, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 7.95% (0.2905 => 0.3136, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 7.91% (0.2831 => 0.3055, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/fibo: 7.56% (0.2725 => 0.2931, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.55% (0.2756 => 0.2964, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 7.43% (0.3283 => 0.3527, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 7.43% (0.3232 => 0.3472, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.30% (0.2714 => 0.2912, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.27% (1.2842 => 1.3776, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.27% (0.2793 => 0.2996, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.23% (0.2891 => 0.3100, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.18% (2.0665 => 2.2149, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.08% (0.3162 => 0.3386, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.04% (0.2871 => 0.3073, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/ReedSolomon: 6.93% (0.2049 => 0.2191, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.92% (0.2877 => 0.3076, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 6.91% (10.3673 => 11.0839, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/matrix: 6.91% (0.3098 => 0.3312, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.89% (0.4064 => 0.4344, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.79% (0.2872 => 0.3067, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.68% (0.3052 => 0.3256, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.46% (0.2802 => 0.2983, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.45% (0.3379 => 0.3597, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.87% (0.3136 => 0.3320, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 5.76% (0.3092 => 0.3270, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 5.58% (0.3282 => 0.3465, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.52% (0.3427 => 0.3616, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 4.66% (0.3131 => 0.3277, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.20% (0.3935 => 0.4061, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.63% (1.1145 => 1.2998, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/oourafft: 13.89% (6.6465 => 7.5697, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.85% (1.1396 => 1.2519, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.94% (1.7254 => 1.8796, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 8.12% (0.9505 => 1.0277, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.11% (0.9540 => 1.0218) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3690, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.43% (0.3463 => 0.3651, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.24% (4.2280 => 4.4071, std.dev.: 0.0102) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.77% (0.4162 => 0.4319, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.64% (8.6802 => 8.9090, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 2.00% (0.8333 => 0.8500, std.dev.: 0.0054) MultiSource/Applications/aha/aha: 1.82% (3.1595 => 3.2171, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.26% (3.6395 => 3.6855, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0495, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.07% (5.2763 => 1.2099, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: -75.68% (0.8651 => 0.2104, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -45.81% (0.1622 => 0.0879, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -27.96% (1.7609 => 1.2685, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -12.18% (0.1330 => 0.1168, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -9.05% (54.1659 => 49.2633, std.dev.: 0.0231) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.57% (7.9617 => 7.8366, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.69% (0.0628 => 0.0385) SingleSource/Benchmarks/Misc/mandel: -33.37% (1.1492 => 0.7657, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -18.74% (0.2161 => 0.1756, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -16.11% (1.6925 => 1.4199, std.dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: -10.99% (9.5636 => 8.5129, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.98% (32.5116 => 28.9424, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/mandel-2: -10.82% (1.5373 => 1.3709, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.13% (1.5660 => 1.4231, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.27% (19.9488 => 18.2982, std.dev.: 0.0104) MultiSource/Benchmarks/FreeBench/distray/distray: -7.16% (0.1592 => 0.1478, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.05% (1.8329 => 1.7037, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.04% (1.2373 => 1.1626, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -5.93% (0.4808 => 0.4523, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.18% (1.6805 => 1.5935, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -4.65% (1.5835 => 1.5098, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.45% (0.9957 => 0.9514, std.dev.: 0.0095) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1542, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.74% (1.3677 => 1.3165, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -3.24% (5.0483 => 4.8848, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -2.16% (10.2830 => 10.0610, std.dev.: 0.0462) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.93% (8.1563 => 7.9992, std.dev.: 0.0218) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -1.69% (85.0658 => 83.6251, std.dev.: 0.0063) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5136, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2332, std.dev.: 0.0070) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 24.67% (1.1048 => 1.3773, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -99.97% (7.1582 => 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: -99.86% (0.0720 => 0.0001) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -65.69% (0.2116 => 0.0726, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 4 02:54:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 4 Nov 2012 04:54:07 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121104105407.BE3292A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5574?compare_to=5570&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5574, Order: 167370, Start Time: 2012-11-04 09:28:15, End Time: 2012-11-04 10:54:14 To: 5570, Order: 167369, Start Time: 2012-11-04 06:51:22, End Time: 2012-11-04 08:17:55 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 7 (58 on baseline) Performance Improvements: 6 (8 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 978 (908 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/power/power: 8.67% (0.1199 => 0.1303, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 2.64% (0.4314 => 0.4428, std.dev.: 0.0039) MultiSource/Applications/Burg/burg: 2.61% (1.2339 => 1.2661, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.91% (0.8114 => 0.8269, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.61% (0.8504 => 0.8641, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.59% (59.2258 => 60.1678, std.dev.: 0.3627) MultiSource/Benchmarks/Olden/bh/bh: 1.08% (2.3638 => 2.3893, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.07% (0.3148 => 0.2957, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.43% (0.8435 => 0.8314, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.43% (0.9293 => 0.9160, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.24% (0.9116 => 0.9003, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -7.51% (22.2962 => 20.6228, std.dev.: 0.5878) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.32% (11.5850 => 11.4321, std.dev.: 0.0561) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.29% (16.6941 => 16.6455, std.dev.: 0.0607) MultiSource/Applications/obsequi/Obsequi: -1.60% (1.0590 => 1.0421, std.dev.: 0.0106) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.51% (21.6413 => 21.5311, std.dev.: 0.3039) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.74% (0.3628 => 0.3655, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: -0.74% (0.6056 => 0.6011, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.02% (0.3322 => 0.3356, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: -0.10% (0.2006 => 0.2004, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -20.37% (0.0216 => 0.0172, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.65% (0.0425 => 0.0418, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 2.95% (0.0271 => 0.0279, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -27.24% (0.0312 => 0.0227, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.13% (0.0407 => 0.0378, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0203 => 0.0202, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -3.57% (0.0196 => 0.0189, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.47% (0.1474 => 0.1467, std.dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -2.44% (1.1599 => 1.1316, std.dev.: 0.0214) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.78% (0.1418 => 0.1429, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.31% (0.4055 => 0.4002, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.66% (0.1368 => 0.1359, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.55% (0.0550 => 0.0619, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.42% (0.0229 => 0.0212, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.39% (0.0584 => 0.0535, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.37% (1.1471 => 1.1514, std.dev.: 0.0332) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2700.00% (0.0001 => 0.0028, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.71% (0.0567 => 0.0563, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 20.62% (0.0194 => 0.0234, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.17% (0.8016 => 0.8030) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 63.49% (0.0063 => 0.0103, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2299.67% (0.6332 => 15.1947, std.dev.: 0.0492) MultiSource/Benchmarks/McCat/08-main/main: 46.10% (0.1831 => 0.2675, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.69% (0.1559 => 0.1408, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1481.04% (0.3344 => 5.2870, std.dev.: 0.0288) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.93% (0.2364 => 0.3237, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: 1.86% (0.0429 => 0.0437, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.68% (0.0224 => 0.0230, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -45.65% (0.0230 => 0.0125, std.dev.: 0.0020) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3241, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0673, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4861, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3354, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0151, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4088, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: -24.19% (2.1832 => 1.6550, std.dev.: 0.0066) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.69% (0.0810 => 0.0929, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 9.26% (0.1112 => 0.1215, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.84% (0.8321 => 0.8807, std.dev.: 0.0144) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.55% (0.1983 => 0.2093, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.58% (0.7473 => 0.7815, std.dev.: 0.0101) MultiSource/Applications/Burg/burg: 3.59% (1.2222 => 1.2661, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 3.09% (0.7950 => 0.8196, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.94% (1.4479 => 1.4905, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.62% (0.8420 => 0.8641, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.48% (0.8069 => 0.8269, std.dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 2.14% (1.2568 => 1.2837, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.10% (0.9074 => 0.9265, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: 1.97% (31.8598 => 32.4870, std.dev.: 0.0976) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.97% (0.8286 => 0.8449, std.dev.: 0.0047) MultiSource/Applications/lua/lua: 1.92% (3.8189 => 3.8923, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.90% (0.8855 => 0.9023, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.87% (0.8007 => 0.8157, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.87% (0.8066 => 0.8217, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.85% (0.8611 => 0.8770, std.dev.: 0.0060) MultiSource/Applications/ClamAV/clamscan: 1.83% (14.7684 => 15.0386, std.dev.: 0.1046) MultiSource/Applications/d/make_dparser: 1.81% (3.2366 => 3.2951, std.dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.68% (1.1170 => 1.1358, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.61% (6.6074 => 6.7140, std.dev.: 0.0302) MultiSource/Applications/SPASS/SPASS: 1.55% (14.2605 => 14.4820, std.dev.: 0.0684) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.52% (0.8697 => 0.8829, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.50% (0.8457 => 0.8584, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.44% (0.8261 => 0.8380, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.43% (0.8317 => 0.8436, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.37% (0.8518 => 0.8635, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.34% (0.8204 => 0.8314, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.34% (0.9039 => 0.9160, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.33% (0.8885 => 0.9003, std.dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 1.32% (15.3280 => 15.5308, std.dev.: 0.0596) MultiSource/Benchmarks/nbench/nbench: 1.31% (1.1271 => 1.1419, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.30% (0.8086 => 0.8191, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.27% (0.8597 => 0.8706, std.dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: 1.23% (4.9628 => 5.0240, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.21% (2.1401 => 2.1659, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 1.17% (6.7320 => 6.8109, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.16% (0.8716 => 0.8817, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.14% (0.9069 => 0.9172, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 1.08% (1.0945 => 1.1063, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 73.87% (0.0199 => 0.0346, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/pi: 57.30% (1.5795 => 2.4846, std.dev.: 0.0142) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.00% (14.6451 => 16.5496, std.dev.: 0.3324) MultiSource/Applications/SIBsim4/SIBsim4: 8.57% (3.1873 => 3.4603, std.dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.25% (1.1857 => 1.2835, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.62% (0.3186 => 0.3397, std.dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: 4.77% (14.0064 => 14.6752, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: 3.48% (8.5322 => 8.8289, std.dev.: 0.0051) MultiSource/Benchmarks/sim/sim: 2.81% (3.8206 => 3.9281, std.dev.: 0.0317) MultiSource/Applications/siod/siod: 2.72% (3.6643 => 3.7641, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 2.21% (63.1822 => 64.5755, std.dev.: 0.1067) MultiSource/Applications/lambda-0_1_3/lambda: 2.06% (7.4933 => 7.6475, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.77% (28.5821 => 29.0887, std.dev.: 0.0998) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.53% (41.4238 => 42.0584, std.dev.: 0.1201) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.50% (4.8362 => 4.9088, std.dev.: 0.0155) MultiSource/Benchmarks/Olden/bh/bh: 1.41% (2.3560 => 2.3893, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -35.80% (0.0338 => 0.0217, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.61% (0.3269 => 0.3053, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.67% (2.8773 => 2.7717, std.dev.: 0.0344) SingleSource/Benchmarks/Shootout/lists: -3.59% (7.3375 => 7.0738, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bisort/bisort: -2.44% (0.6636 => 0.6474, std.dev.: 0.0056) MultiSource/Applications/lua/lua: -2.42% (29.8330 => 29.1111, std.dev.: 0.0980) SingleSource/Benchmarks/Shootout-C++/hash2: -1.39% (3.4237 => 3.3762, std.dev.: 0.0183) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.38% (3.3479 => 3.3018, std.dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.21% (16.4461 => 16.6455, std.dev.: 0.0607) MultiSource/Applications/obsequi/Obsequi: 1.55% (1.0262 => 1.0421, std.dev.: 0.0106) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6794.36% (0.3123 => 21.5311, std.dev.: 0.3039) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.40% (0.2463 => 0.3655, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 0.02% (0.6010 => 0.6011, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.76% (0.3266 => 0.3356, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 1.78% (0.1969 => 0.2004, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 39.84% (0.0123 => 0.0172, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.45% (0.0408 => 0.0418, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 9.84% (0.0254 => 0.0279, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -24.83% (0.0302 => 0.0227, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.56% (0.0384 => 0.0378, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 5.00% (0.0180 => 0.0189, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.02% (0.1438 => 0.1467, std.dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.11% (1.1329 => 1.1316, std.dev.: 0.0214) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -2.26% (0.1462 => 0.1429, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.89% (0.4164 => 0.4002, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.73% (0.1369 => 0.1359, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.43% (0.0641 => 0.0619, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.72% (0.0195 => 0.0212, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.44% (0.0578 => 0.0535, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.67% (1.1437 => 1.1514, std.dev.: 0.0332) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2700.00% (0.0001 => 0.0028, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.21% (0.0627 => 0.0563, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 30.00% (0.0180 => 0.0234, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.16% (0.8017 => 0.8030) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 66.13% (0.0062 => 0.0103, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 4 03:00:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 4 Nov 2012 05:00:01 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121104110001.9A5C62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5575?compare_to=5571&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5575, Order: 167370, Start Time: 2012-11-04 09:34:01, End Time: 2012-11-04 10:59:12 To: 5571, Order: 167369, Start Time: 2012-11-04 07:02:36, End Time: 2012-11-04 08:30:23 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 1 (174 on baseline) Unchanged Tests: 1040 (864 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/lists: 1.88% (6.1224 => 6.2378, std.dev.: 0.0114) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.48% (56.5306 => 54.5615, std.dev.: 0.6466) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.57% (2.0478 => 2.1004, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.4937 => 7.6826, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash2: 2.15% (3.1932 => 3.2618, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.09% (0.3821 => 0.3512, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: -7.11% (2.4924 => 2.3153, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.68% (0.3142 => 0.2932, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.63% (22.4056 => 20.9193, std.dev.: 0.0221) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.63% (0.2428 => 0.2267, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: -6.46% (0.3357 => 0.3140, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.44% (3.5339 => 3.3064, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.29% (0.3658 => 0.3428, std.dev.: 0.0082) MultiSource/Applications/JM/lencod/lencod: -6.21% (16.1920 => 15.1869, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.19% (0.9542 => 0.8951, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -6.15% (9.2283 => 8.6610, std.dev.: 0.0166) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: -6.09% (7.0961 => 6.6639, std.dev.: 0.0118) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.04% (0.9852 => 0.9257, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.03% (1.0544 => 0.9908, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.01% (0.6484 => 0.6094, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -5.97% (1.1450 => 1.0767, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: -5.95% (0.9179 => 0.8633, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.89% (0.5857 => 0.5512, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -5.86% (1.2515 => 1.1781, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: -5.85% (0.1761 => 0.1658, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: -5.82% (1.1530 => 1.0859, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: -5.80% (4.3330 => 4.0817, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: -5.80% (17.1032 => 16.1116, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.78% (0.7339 => 0.6915, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.77% (1.6474 => 1.5523, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.76% (0.6304 => 0.5941, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.75% (1.3722 => 1.2933, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.73% (0.2355 => 0.2220, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.73% (1.2784 => 1.2052, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.71% (1.2300 => 1.1598, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.70% (0.5478 => 0.5166, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.69% (0.5591 => 0.5273, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.68% (0.6052 => 0.5708, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.68% (0.2695 => 0.2542, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.67% (0.5925 => 0.5589, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.66% (4.8161 => 4.5434, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.66% (4.0323 => 3.8042, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.65% (0.6230 => 0.5878, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.65% (1.4642 => 1.3815, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.63% (0.6681 => 0.6305, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.63% (0.3483 => 0.3287, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -5.62% (2.4021 => 2.2670, std.dev.: 0.0167) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.62% (14.2083 => 13.4094, std.dev.: 0.0194) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.62% (5.4682 => 5.1609, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.62% (0.5802 => 0.5476, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.62% (0.6446 => 0.6084, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.62% (4.5069 => 4.2538, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.61% (0.5575 => 0.5262, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -5.61% (0.3406 => 0.3215, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.61% (0.6297 => 0.5944, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.61% (0.5941 => 0.5608, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.59% (4.8802 => 4.6074, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.59% (0.6194 => 0.5848, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.58% (0.7524 => 0.7104, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.57% (1.6364 => 1.5452, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/08-main/main: -5.57% (0.2659 => 0.2511, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.54% (0.7919 => 0.7480, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.54% (0.5849 => 0.5525, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.53% (0.6667 => 0.6298, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -5.53% (0.7447 => 0.7035, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.51% (0.6260 => 0.5915, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.50% (0.5705 => 0.5391, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.50% (6.7716 => 6.3992, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.50% (0.5859 => 0.5537, std.dev.: 0.0009) MultiSource/Applications/lua/lua: -5.48% (4.0594 => 3.8370, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.47% (0.6395 => 0.6045, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.47% (0.6676 => 0.6311, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.47% (0.6440 => 0.6088, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.46% (0.5581 => 0.5276, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -5.46% (0.2985 => 0.2822, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.46% (0.2548 => 0.2409, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.45% (0.6189 => 0.5852, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.44% (0.6033 => 0.5705, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.42% (0.5570 => 0.5268, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.42% (0.6660 => 0.6299, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.41% (0.5456 => 0.5161, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -5.40% (0.3812 => 0.3606, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -5.40% (0.3831 => 0.3624, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.40% (0.4151 => 0.3927, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.39% (0.5805 => 0.5492, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -5.39% (0.4176 => 0.3951, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -5.39% (15.5079 => 14.6725, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.38% (0.6395 => 0.6051, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.37% (0.7021 => 0.6644, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.36% (0.3880 => 0.3672, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/for-in: -5.36% (0.4033 => 0.3817, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.36% (0.3884 => 0.3676, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.35% (0.5567 => 0.5269, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -5.35% (0.4861 => 0.4601, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.35% (0.3891 => 0.3683, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.33% (0.5569 => 0.5272, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -5.30% (3.5154 => 3.3290, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/exceptions-3: -5.30% (0.3848 => 0.3644, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.29% (0.3896 => 0.3690, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.27% (0.6736 => 0.6381, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.26% (0.6293 => 0.5962, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.25% (0.5329 => 0.5049, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.23% (0.4916 => 0.4659, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.22% (0.5168 => 0.4898, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.22% (2.2587 => 2.1408, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.19% (0.5688 => 0.5393, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -5.16% (1.3148 => 1.2469, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.14% (0.3849 => 0.3651, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: -5.14% (2.1401 => 2.0301, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.14% (0.2278 => 0.2161, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: -5.11% (1.3864 => 1.3155, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: -5.07% (0.4199 => 0.3986, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.07% (0.2999 => 0.2847, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.06% (0.8521 => 0.8090, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/parameter-passing: -5.05% (0.4280 => 0.4064, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.03% (0.3837 => 0.3644, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -5.02% (0.3025 => 0.2873, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.02% (0.9557 => 0.9077, std.dev.: 0.0144) MultiSource/Applications/ClamAV/clamscan: -5.00% (15.2527 => 14.4899, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.99% (0.3931 => 0.3735, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.98% (0.5999 => 0.5700, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -4.98% (0.4515 => 0.4290, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: -4.98% (0.3255 => 0.3093, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.97% (8.0126 => 7.6142, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/bigfib: -4.95% (0.6750 => 0.6416, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -4.95% (0.3194 => 0.3036, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.93% (1.2210 => 1.1608, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.93% (0.4321 => 0.4108, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -4.92% (0.7982 => 0.7589, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.91% (0.3323 => 0.3160, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.90% (0.4083 => 0.3883, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: -4.89% (18.2933 => 17.3987, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/lists1: -4.89% (0.3867 => 0.3678, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.86% (0.2385 => 0.2269, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.85% (0.3319 => 0.3158, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -4.85% (0.4248 => 0.4042, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -4.81% (0.2871 => 0.2733, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.80% (1.2221 => 1.1635, std.dev.: 0.0075) MultiSource/Benchmarks/Bullet/bullet: -4.79% (34.0927 => 32.4598, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/ary3: -4.79% (0.3446 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.78% (0.3057 => 0.2911, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.74% (0.3016 => 0.2873, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.70% (0.4427 => 0.4219, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.70% (0.3491 => 0.3327, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.70% (2.1713 => 2.0693, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary2: -4.68% (0.3481 => 0.3318, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: -4.67% (0.3059 => 0.2916, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -4.66% (0.2939 => 0.2802, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -4.63% (0.3394 => 0.3237, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.62% (0.3205 => 0.3057, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -4.57% (0.3788 => 0.3615, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.56% (0.2849 => 0.2719, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: -4.56% (0.3621 => 0.3456, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -4.55% (0.2989 => 0.2853, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.50% (0.2933 => 0.2801, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -4.49% (0.8418 => 0.8040, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.47% (0.7198 => 0.6876, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: -4.46% (0.3271 => 0.3125, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: -4.24% (0.4524 => 0.4332, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -4.23% (5.0226 => 4.8103, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.03% (0.2903 => 0.2786, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -3.99% (0.7779 => 0.7469, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: -3.64% (0.6347 => 0.6116, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.60% (0.9077 => 0.8750, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: -3.40% (0.6441 => 0.6222, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -3.38% (1.5610 => 1.5083, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -2.57% (20.7746 => 20.2412, std.dev.: 0.0303) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7510, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1732, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.91% (1.7753 => 1.7058, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.79% (2.2633 => 2.1776, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.07% (1.0557 => 1.0233, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.73% (1.3096 => 1.2739, std.dev.: 0.0121) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4669, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Report Time: 2.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 4 05:01:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 4 Nov 2012 07:01:53 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121104130153.09FD82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5576?compare_to=5572&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5576, Order: 167369, Start Time: 2012-11-04 09:46:11, End Time: 2012-11-04 13:01:59 To: 5572, Order: 167366, Start Time: 2012-11-04 05:39:04, End Time: 2012-11-04 08:57:43 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (169 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (721 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 5.35% (0.2167 => 0.2283, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.60% (128.6375 => 131.9772, std.dev.: 0.1802) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.16% (0.0625 => 0.0876, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.70% (0.1063 => 0.1400, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.97% (0.2969 => 0.3740, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.41% (0.1106 => 0.1387, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.79% (0.4139 => 0.5165, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.22% (0.4253 => 0.5283, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 24.18% (1.5932 => 1.9784, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.81% (0.0714 => 0.0884, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.77% (0.0547 => 0.0677, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.61% (0.5900 => 0.7293, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.47% (0.4994 => 0.6166, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.37% (0.0475 => 0.0586, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.20% (0.5000 => 0.6160, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.43% (0.0584 => 0.0715, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.35% (0.1620 => 0.1982, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.19% (0.0897 => 0.1096, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.84% (0.1021 => 0.1244, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.59% (0.1107 => 0.1346, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 20.70% (0.0604 => 0.0729, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.70% (0.0633 => 0.0764, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 20.68% (0.0948 => 0.1144, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.49% (0.1103 => 0.1329, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.44% (0.0822 => 0.0990, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.40% (0.0642 => 0.0773, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.38% (0.0584 => 0.0703, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 20.26% (0.1619 => 0.1947, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 20.22% (0.0821 => 0.0987, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.21% (0.1549 => 0.1862, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.19% (0.3903 => 0.4691, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.96% (0.0541 => 0.0649, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.94% (0.1003 => 0.1203, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.64% (0.1604 => 0.1919, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.02% (0.2014 => 0.2397, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 18.80% (0.0947 => 0.1125, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.54% (0.1462 => 0.1733, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 18.40% (0.5826 => 0.6898, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.23% (0.3890 => 0.4599, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 18.19% (0.0808 => 0.0955, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 18.12% (0.4029 => 0.4759, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 18.07% (0.5889 => 0.6953, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 17.98% (0.1218 => 0.1437, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 17.81% (0.1505 => 0.1773, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.80% (0.2736 => 0.3223, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.77% (1.3152 => 1.5489, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.65% (0.1088 => 0.1280) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.36% (3.5627 => 4.1812, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.24% (0.2866 => 0.3360, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 17.00% (0.5546 => 0.6489, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.95% (0.2738 => 0.3202, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 16.94% (1.8794 => 2.1978, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.90% (0.1160 => 0.1356, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.84% (1.6211 => 1.8941, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.77% (0.2875 => 0.3357, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.57% (0.1968 => 0.2294, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 16.54% (0.1421 => 0.1656, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.51% (0.4658 => 0.5427, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.36% (0.3271 => 0.3806, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 16.36% (0.9697 => 1.1283, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 16.22% (0.7171 => 0.8334, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hello: 16.14% (0.2714 => 0.3152, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 16.07% (0.2725 => 0.3163, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 16.00% (0.2813 => 0.3263, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 15.97% (0.2780 => 0.3224, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 15.95% (0.3004 => 0.3483, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.94% (0.2729 => 0.3164, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.94% (2.7292 => 3.1641, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 15.90% (1.0781 => 1.2495, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.88% (0.5026 => 0.5824, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/objinst: 15.87% (0.2823 => 0.3271, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.87% (0.4361 => 0.5053, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/strcat: 15.85% (0.2750 => 0.3186, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.83% (1.9694 => 2.2811, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.81% (4.4195 => 5.1184, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.77% (0.3195 => 0.3699, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 15.73% (0.3096 => 0.3583, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/random: 15.70% (0.2803 => 0.3243, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 15.69% (0.2811 => 0.3252, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 15.65% (0.1284 => 0.1485, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.65% (0.2792 => 0.3229, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.65% (0.3930 => 0.4545, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.63% (2.0673 => 2.3904, std.dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 15.56% (4.2109 => 4.8660, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.49% (0.2911 => 0.3362, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 15.45% (0.9909 => 1.1440, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.33% (1.9966 => 2.3026, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: 15.21% (0.3267 => 0.3764, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 14.98% (0.3317 => 0.3814, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 14.98% (23.5202 => 27.0430, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/ary: 14.92% (0.3258 => 0.3744, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.90% (0.3060 => 0.3516, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.77% (0.1090 => 0.1251, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.72% (0.3362 => 0.3857, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.63% (0.3124 => 0.3581, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 14.55% (0.3726 => 0.4268, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 14.36% (0.3496 => 0.3998, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.34% (0.3625 => 0.4145, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 14.34% (0.3348 => 0.3828, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 14.33% (0.3678 => 0.4205, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.29% (0.3282 => 0.3751, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.28% (0.3488 => 0.3986, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions-2: 14.28% (0.3446 => 0.3938, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.24% (0.3469 => 0.3963, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.23% (0.3845 => 0.4392, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/exceptions-4: 14.20% (0.3465 => 0.3957, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 14.18% (0.3442 => 0.3930, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 14.12% (0.2075 => 0.2368, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.10% (0.3460 => 0.3948, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 13.99% (0.2566 => 0.2925, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 13.95% (0.3477 => 0.3962, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 13.88% (0.4251 => 0.4841, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 13.87% (1.4269 => 1.6248, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.87% (0.3981 => 0.4533, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 13.81% (0.3650 => 0.4154, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 13.75% (0.3643 => 0.4144, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 13.75% (0.3724 => 0.4236, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 13.75% (0.4146 => 0.4716, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.74% (0.3690 => 0.4197, std.dev.: 0.0093) MultiSource/Applications/JM/ldecod/ldecod: 13.42% (2.1653 => 2.4559, std.dev.: 0.0043) MultiSource/Applications/treecc/treecc: 13.40% (0.7875 => 0.8930, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 13.11% (4.6177 => 5.2233, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/bigfib: 13.05% (0.5012 => 0.5666, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 12.91% (2.1013 => 2.3726, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.58% (0.1383 => 0.1557, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.21% (0.2040 => 0.2289, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 12.11% (0.2691 => 0.3017, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.84% (0.6435 => 0.7197, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 11.79% (5.5417 => 6.1950, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.96% (0.2737 => 0.3037, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 10.92% (0.3498 => 0.3880, std.dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: 10.83% (0.4847 => 0.5372, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.80% (0.1028 => 0.1139, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.64% (0.2068 => 0.2288, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 10.25% (0.6634 => 0.7314, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.21% (0.3084 => 0.3399, std.dev.: 0.0055) MultiSource/Applications/minisat/minisat: 10.16% (0.3336 => 0.3675, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.51% (0.2103 => 0.2303, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 9.35% (2.0346 => 2.2249, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 9.24% (0.2391 => 0.2612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.91% (4.6926 => 5.1106, std.dev.: 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.73% (11.6398 => 12.6556, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.24% (0.5361 => 0.5803, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.42% (0.7426 => 0.7977, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.31% (0.5584 => 0.5992, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 6.76% (11.9555 => 12.7642, std.dev.: 0.0139) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.85% (0.3792 => 0.3976, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6530, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.22% (0.5917 => 0.6699, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 9.28% (0.2802 => 0.3062, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6090, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.55% (0.3693 => 0.3898, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/objinst: 5.00% (12.0509 => 12.6534, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1702, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-2: 3.86% (1.8057 => 1.8754, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: 2.47% (14.0481 => 14.3954, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1959, std.dev.: 0.0053) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.66% (3.1722 => 3.2249, std.dev.: 0.0029) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3016, std.dev.: 0.0089) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2852, std.dev.: 0.0064) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.25% (1.0142 => 1.0269, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1063, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5406, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5770, std.dev.: 0.0313) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.05% (2.4764 => 2.4256, std.dev.: 0.0131) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.52% (25.4195 => 16.3896, std.dev.: 0.0164) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9795, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7753, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -4.95% (0.2402 => 0.2283, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0009) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7743, std.dev.: 0.0041) SingleSource/UnitTests/Vector/build2: -2.95% (11.2080 => 10.8770, std.dev.: 0.0313) SingleSource/Benchmarks/Misc/mandel-2: -2.87% (3.6262 => 3.5220, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.33% (17.2379 => 16.8361, std.dev.: 0.0247) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8649, std.dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5789, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4955, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7165, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1599, std.dev.: 0.0420) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0419, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.07% (3.3991 => 3.3627, std.dev.: 0.0038) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 4 09:05:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 4 Nov 2012 11:05:43 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121104170543.D5F182A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5577?compare_to=5576&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5577, Order: 167370, Start Time: 2012-11-04 13:50:14, End Time: 2012-11-04 17:05:50 To: 5576, Order: 167369, Start Time: 2012-11-04 09:46:11, End Time: 2012-11-04 13:01:59 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (171 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (719 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.32% (2.0530 => 2.1212, std.dev.: 0.0088) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.16% (0.0625 => 0.0876, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.70% (0.1063 => 0.1400, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.90% (0.2969 => 0.3738, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.50% (0.1106 => 0.1388, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.45% (0.4139 => 0.5151, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 24.37% (1.5932 => 1.9815, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.24% (0.4253 => 0.5284, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.81% (0.0714 => 0.0884, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.13% (0.4994 => 0.6149, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.10% (0.5900 => 0.7263, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.86% (0.5000 => 0.6143, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.85% (0.0547 => 0.0672, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.77% (0.0584 => 0.0717, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.19% (0.0897 => 0.1096, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.16% (0.1620 => 0.1979) MultiSource/Benchmarks/Olden/tsp/tsp: 21.70% (0.0599 => 0.0729) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.65% (0.1021 => 0.1242, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.59% (0.1107 => 0.1346, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 21.19% (0.0604 => 0.0732, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.01% (0.0633 => 0.0766, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 20.57% (0.0948 => 0.1143, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.49% (0.1103 => 0.1329) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.38% (0.0584 => 0.0703, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.27% (0.1549 => 0.1863, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.25% (0.0642 => 0.0772, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 20.14% (0.1619 => 0.1945, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: 20.10% (0.0821 => 0.0986, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.07% (0.1604 => 0.1926, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.04% (0.3903 => 0.4685, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.94% (0.1003 => 0.1203, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.83% (0.0822 => 0.0985, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 19.01% (0.0947 => 0.1127, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/Hello: 18.55% (0.5826 => 0.6907, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.54% (0.1462 => 0.1733, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 18.46% (0.5889 => 0.6976, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 18.27% (0.1505 => 0.1780, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.23% (0.3890 => 0.4599, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 18.19% (0.0808 => 0.0955, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.17% (0.2014 => 0.2380, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 18.14% (0.1218 => 0.1439, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.94% (1.3152 => 1.5511, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.92% (0.1088 => 0.1283, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.87% (0.2736 => 0.3225, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 17.85% (0.4029 => 0.4748, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.52% (0.2866 => 0.3368, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.19% (3.5627 => 4.1753, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/gs/gs: 17.03% (1.8794 => 2.1994, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.90% (0.1160 => 0.1356, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 16.88% (0.5546 => 0.6482, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.73% (0.2875 => 0.3356, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.62% (0.4658 => 0.5432, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.58% (1.6211 => 1.8899, std.dev.: 0.0066) SingleSource/UnitTests/ObjC++/property-reference: 16.57% (0.7171 => 0.8359, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.51% (0.1968 => 0.2293, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 16.48% (0.2725 => 0.3174, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.42% (0.3271 => 0.3808, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hello: 16.40% (0.2714 => 0.3159, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.21% (0.4361 => 0.5068, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 16.15% (0.9697 => 1.1263, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 16.12% (0.1421 => 0.1650, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 16.09% (1.0781 => 1.2516, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.09% (0.2729 => 0.3168, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.07% (0.2738 => 0.3178, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 16.07% (0.2813 => 0.3265, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 16.05% (0.2823 => 0.3276, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 16.04% (0.1284 => 0.1490, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 16.04% (0.2750 => 0.3191, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 16.01% (0.3004 => 0.3485, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: 16.01% (0.2780 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.93% (0.3195 => 0.3704, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.92% (2.0673 => 2.3964, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.83% (0.2792 => 0.3234, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/random: 15.80% (0.2803 => 0.3246, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 15.80% (0.2811 => 0.3255, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 15.79% (0.3096 => 0.3585, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.77% (4.4195 => 5.1165, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.76% (0.5026 => 0.5818, std.dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.70% (2.7292 => 3.1577, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.70% (0.2911 => 0.3368, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.57% (0.3930 => 0.4542, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 15.53% (0.9909 => 1.1448, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.46% (1.9694 => 2.2738, std.dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 15.40% (4.2109 => 4.8595, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.30% (1.9966 => 2.3020, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ary3: 15.24% (0.3267 => 0.3765, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 15.12% (23.5202 => 27.0765, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/ary2: 15.10% (0.3317 => 0.3818, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 15.07% (0.3258 => 0.3749, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.87% (0.3362 => 0.3862, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.86% (0.1090 => 0.1252, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.85% (0.3124 => 0.3588, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.74% (0.3060 => 0.3511, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 14.63% (0.3678 => 0.4216, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 14.46% (0.3348 => 0.3832, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 14.39% (0.3726 => 0.4262, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.32% (0.3625 => 0.4144, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.26% (0.3282 => 0.3750, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/exceptions-4: 14.23% (0.3465 => 0.3958, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-2: 14.22% (0.3446 => 0.3936, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 14.22% (0.3496 => 0.3993, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 14.21% (0.3477 => 0.3971, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.19% (0.3488 => 0.3983, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 14.15% (0.2566 => 0.2929, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.12% (0.3845 => 0.4388, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 14.12% (1.4269 => 1.6284, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 14.12% (0.2075 => 0.2368, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 14.09% (0.3442 => 0.3927, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 14.07% (0.3469 => 0.3957, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 14.05% (0.3460 => 0.3946, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.02% (0.3981 => 0.4539, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 14.00% (0.4251 => 0.4846, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 13.92% (0.4146 => 0.4723, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.90% (0.3690 => 0.4203, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/exceptions: 13.75% (0.3643 => 0.4144, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 13.64% (0.3650 => 0.4148, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 13.61% (0.3724 => 0.4231, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 13.49% (0.7875 => 0.8937, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/bigfib: 13.29% (0.5012 => 0.5678, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 13.21% (2.1653 => 2.4513, std.dev.: 0.0047) MultiSource/Applications/JM/lencod/lencod: 12.99% (4.6177 => 5.2177, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 12.66% (2.1013 => 2.3674, std.dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 12.19% (0.2691 => 0.3019, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.11% (0.2040 => 0.2287, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.06% (0.6435 => 0.7211, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 11.86% (5.5417 => 6.1992, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.19% (0.1028 => 0.1143, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.14% (0.2737 => 0.3042, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 11.09% (0.3498 => 0.3886, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.96% (0.3084 => 0.3422, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 10.81% (0.6634 => 0.7351, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.74% (0.2068 => 0.2290, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.70% (0.1383 => 0.1531, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 10.63% (0.4847 => 0.5362, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 10.37% (0.3336 => 0.3682, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.61% (0.2103 => 0.2305, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 9.42% (2.0346 => 2.2262, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 9.37% (0.2391 => 0.2615, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.10% (4.6926 => 5.1196, std.dev.: 0.0251) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.94% (11.6398 => 12.6803, std.dev.: 0.0167) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.60% (0.5361 => 0.5822, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.66% (0.7426 => 0.7995, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.49% (0.5584 => 0.6002, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 6.92% (11.9555 => 12.7828, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.75% (0.3792 => 0.3972, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.32% (0.2162 => 0.3531, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.27% (0.5917 => 0.6702, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6095, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 5.98% (0.2122 => 0.2249, std.dev.: 0.0037) MultiSource/Applications/ClamAV/clamscan: 5.60% (0.2802 => 0.2959, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/objinst: 5.06% (12.0509 => 12.6609, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1686, std.dev.: 0.0493) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.17% (0.3693 => 0.3847, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-2: 3.85% (1.8057 => 1.8752, std.dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/dry: 2.53% (14.0481 => 14.4030, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1922, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.88% (2.0820 => 2.1212, std.dev.: 0.0088) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.74% (3.1722 => 3.2273, std.dev.: 0.0038) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3014, std.dev.: 0.0155) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2886, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.24% (1.0142 => 1.0268, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5142, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.07% (1.2451 => 1.2584, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5828, std.dev.: 0.0105) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.65% (25.4195 => 16.3579, std.dev.: 0.0223) SingleSource/Benchmarks/Shootout-C++/ary2: -10.37% (0.2402 => 0.2153, std.dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9764, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7746, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9576, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.43% (11.2080 => 10.8236, std.dev.: 0.0451) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0028) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7728, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5219, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.33% (17.2379 => 16.8357, std.dev.: 0.0387) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8650, std.dev.: 0.0419) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5732, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: -1.56% (5.5810 => 5.4942, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.09% (105.3826 => 104.2314, std.dev.: 0.0669) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0408, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.08% (3.3991 => 3.3624, std.dev.: 0.0008) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 4 12:12:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 4 Nov 2012 14:12:59 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121104201259.066662A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5578?compare_to=5574&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5578, Order: 167374, Start Time: 2012-11-04 18:45:38, End Time: 2012-11-04 20:13:06 To: 5574, Order: 167370, Start Time: 2012-11-04 09:28:15, End Time: 2012-11-04 10:54:14 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 14 (63 on baseline) Performance Improvements: 1 (4 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 976 (907 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.00% (0.8210 => 0.8703, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.78% (0.2957 => 0.3128, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.70% (0.6124 => 0.6473, std.dev.: 0.0098) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.97% (0.3258 => 0.3420, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.97% (0.6295 => 0.6608, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.73% (0.5968 => 0.6250, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.50% (1.1785 => 1.2198, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.47% (2.1659 => 2.2195, std.dev.: 0.0140) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.29% (0.9039 => 0.9156, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 12.12% (20.6228 => 23.1215, std.dev.: 0.4307) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.19% (2.3570 => 2.5737, std.dev.: 0.0243) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 4.22% (43.6317 => 45.4718, std.dev.: 0.5085) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.17% (6.3975 => 6.5364, std.dev.: 0.0302) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.13% (1.5831 => 1.6010, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -1.31% (0.8269 => 0.8161, std.dev.: 0.0012) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.05% (16.6455 => 16.6364, std.dev.: 0.1718) MultiSource/Applications/obsequi/Obsequi: 3.51% (1.0421 => 1.0787, std.dev.: 0.0146) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.23% (21.5311 => 21.4821, std.dev.: 0.0858) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.05% (0.3655 => 0.3653, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 1.05% (0.6011 => 0.6074, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: -1.97% (0.3356 => 0.3290, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: -0.20% (0.2004 => 0.2000, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 26.74% (0.0172 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -13.16% (0.0418 => 0.0363, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 17.20% (0.0279 => 0.0327, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 37.00% (0.0227 => 0.0311, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.64% (0.0378 => 0.0422, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -0.50% (0.0202 => 0.0201, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/test1: 14.81% (0.0189 => 0.0217, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.36% (0.1467 => 0.1487, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.57% (1.1316 => 1.1138, std.dev.: 0.0414) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.61% (0.1429 => 0.1406, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.70% (0.4002 => 0.4030, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.22% (0.1359 => 0.1288, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.32% (0.0619 => 0.0621, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 30.19% (0.0212 => 0.0276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.56% (0.0535 => 0.0532, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.70% (1.1514 => 1.1433, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 10.71% (0.0028 => 0.0031, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 14.74% (0.0563 => 0.0646, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 12.39% (0.0234 => 0.0263, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.25% (0.8030 => 0.8050, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -65.05% (0.0103 => 0.0036, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2292.40% (0.6332 => 15.1487, std.dev.: 0.2550) MultiSource/Benchmarks/McCat/08-main/main: 49.26% (0.1831 => 0.2733, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.35% (0.1559 => 0.1460, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1478.92% (0.3344 => 5.2799, std.dev.: 0.0777) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.80% (0.2364 => 0.3234, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel: 2.80% (0.0429 => 0.0441, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.91% (0.0224 => 0.0235, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3269, std.dev.: 0.0236) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0679, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4948, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3596, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0369, std.dev.: 0.0136) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3994, std.dev.: 0.0091) SingleSource/Regression/C/uint64_to_float: -23.94% (2.1832 => 1.6606, std.dev.: 0.0036) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 16.56% (0.0773 => 0.0901, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.06% (0.0810 => 0.0932, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.17% (0.0830 => 0.0931, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 11.15% (0.1112 => 0.1236, std.dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.02% (0.3137 => 0.3420, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.00% (0.1425 => 0.1539, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.96% (0.8321 => 0.8983, std.dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.72% (0.4847 => 0.5221, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.70% (0.6010 => 0.6473, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.16% (0.1983 => 0.2125, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.81% (0.8148 => 0.8703, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.2279 => 0.2428, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.62% (0.1885 => 0.1991, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.52% (0.2519 => 0.2658, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.41% (0.1905 => 0.2008, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.11% (0.6287 => 0.6608, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.04% (0.2240 => 0.2353, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.85% (0.5961 => 0.6250, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.76% (0.9435 => 0.9884, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.39% (1.1685 => 1.2198, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.71% (2.1401 => 2.2195, std.dev.: 0.0140) MultiSource/Applications/spiff/spiff: 3.52% (0.7950 => 0.8230, std.dev.: 0.0071) MultiSource/Applications/sgefa/sgefa: 3.43% (0.2999 => 0.3102, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.20% (0.3717 => 0.3836, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.18% (0.6227 => 0.6425, std.dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.95% (0.4783 => 0.4924, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.88% (0.4127 => 0.4246, std.dev.: 0.0036) MultiSource/Applications/hbd/hbd: 2.87% (1.4269 => 1.4679, std.dev.: 0.0133) MultiSource/Applications/SIBsim4/SIBsim4: 2.86% (1.2568 => 1.2927, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.01% (1.4479 => 1.4770, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.97% (1.6386 => 1.6709, std.dev.: 0.0094) MultiSource/Applications/ClamAV/clamscan: 1.93% (14.7684 => 15.0536, std.dev.: 0.0793) MultiSource/Benchmarks/nbench/nbench: 1.93% (1.1271 => 1.1488, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.88% (0.9688 => 0.9870, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.81% (1.1170 => 1.1372, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.79% (0.8995 => 0.9156, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.75% (0.8697 => 0.8849, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.65% (0.9074 => 0.9224, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.56% (0.8597 => 0.8731, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.46% (13.1811 => 13.3734, std.dev.: 0.0700) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.40% (0.8805 => 0.8928, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.38% (0.8286 => 0.8400, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.28% (0.8050 => 0.8153, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.26% (0.8338 => 0.8443, std.dev.: 0.0039) MultiSource/Benchmarks/Bullet/bullet: 1.18% (31.8598 => 32.2347, std.dev.: 0.0826) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 57.33% (1.5795 => 2.4851, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/city/city: 55.28% (0.0199 => 0.0309, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.85% (14.6451 => 16.8198, std.dev.: 0.1407) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.13% (0.3186 => 0.3477, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.30% (1.1857 => 1.2841, std.dev.: 0.0065) MultiSource/Applications/SIBsim4/SIBsim4: 7.99% (3.1873 => 3.4421, std.dev.: 0.0315) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.81% (2.2485 => 2.4016, std.dev.: 0.0480) MultiSource/Benchmarks/nbench/nbench: 5.26% (21.9654 => 23.1215, std.dev.: 0.4307) MultiSource/Applications/hexxagon/hexxagon: 4.82% (14.0064 => 14.6820, std.dev.: 0.0529) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.53% (0.7597 => 0.7865, std.dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.36% (2.4490 => 2.5314, std.dev.: 0.0249) MultiSource/Applications/siod/siod: 3.26% (3.6643 => 3.7839, std.dev.: 0.0057) MultiSource/Benchmarks/sim/sim: 2.95% (3.8206 => 3.9334, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.50% (6.3772 => 6.5364, std.dev.: 0.0302) MultiSource/Benchmarks/mafft/pairlocalalign: 1.93% (63.1822 => 64.3997, std.dev.: 0.1784) MultiSource/Applications/lambda-0_1_3/lambda: 1.86% (7.4933 => 7.6326, std.dev.: 0.0103) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.74% (28.5821 => 29.0804, std.dev.: 0.1775) MultiSource/Benchmarks/FreeBench/neural/neural: 1.27% (1.0841 => 1.0979, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.33% (0.3269 => 0.3062, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -3.66% (7.3375 => 7.0690, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/bisort/bisort: -3.03% (0.6636 => 0.6435, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.23% (3.3479 => 3.3067, std.dev.: 0.0075) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.16% (16.4461 => 16.6364, std.dev.: 0.1718) MultiSource/Applications/obsequi/Obsequi: 5.12% (1.0262 => 1.0787, std.dev.: 0.0146) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6778.67% (0.3123 => 21.4821, std.dev.: 0.0858) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.32% (0.2463 => 0.3653, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 1.06% (0.6010 => 0.6074, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.73% (0.3266 => 0.3290, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 1.57% (0.1969 => 0.2000, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -11.03% (0.0408 => 0.0363, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 28.74% (0.0254 => 0.0327, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.98% (0.0302 => 0.0311, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 5.79% (0.0190 => 0.0201, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 3.41% (0.1438 => 0.1487, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.69% (1.1329 => 1.1138, std.dev.: 0.0414) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.83% (0.1462 => 0.1406, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.22% (0.4164 => 0.4030, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.92% (0.1369 => 0.1288, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.12% (0.0641 => 0.0621, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.54% (0.0195 => 0.0276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.96% (0.0578 => 0.0532, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.03% (1.1437 => 1.1433, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.03% (0.0627 => 0.0646, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 46.11% (0.0180 => 0.0263, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.41% (0.8017 => 0.8050, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -41.94% (0.0062 => 0.0036, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 4 12:17:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 4 Nov 2012 14:17:08 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121104201708.B0D902A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5579?compare_to=5575&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5579, Order: 167374, Start Time: 2012-11-04 18:52:00, End Time: 2012-11-04 20:17:14 To: 5575, Order: 167370, Start Time: 2012-11-04 09:34:01, End Time: 2012-11-04 10:59:12 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (175 on baseline) Unchanged Tests: 1041 (862 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.78% (54.5615 => 56.6220, std.dev.: 0.1429) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.75% (54.5751 => 56.6220, std.dev.: 0.1429) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.81% (2.0478 => 2.1053, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/salsa20: 2.37% (7.4937 => 7.6715, std.dev.: 0.0219) SingleSource/Benchmarks/Shootout-C++/hash2: 2.17% (3.1932 => 3.2624, std.dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.60% (0.1431 => 0.1308, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.41% (0.3821 => 0.3538, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -7.06% (2.4924 => 2.3164, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.57% (22.4056 => 20.9329, std.dev.: 0.0144) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.51% (0.2428 => 0.2270, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.40% (3.5339 => 3.3077, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: -6.34% (0.3357 => 0.3144, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.24% (0.9542 => 0.8947, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: -6.17% (16.1920 => 15.1935, std.dev.: 0.0196) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.08% (0.6484 => 0.6090, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.07% (0.3658 => 0.3436, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -6.07% (9.2283 => 8.6683, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/oourafft: -6.06% (0.2160 => 0.2029, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -6.03% (7.0961 => 6.6679, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.97% (1.0544 => 0.9914, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/football/football: -5.96% (0.9179 => 0.8632, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.90% (0.9852 => 0.9271, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -5.89% (1.1450 => 1.0776, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.87% (1.3722 => 1.2917, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: -5.86% (4.3330 => 4.0791, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.86% (1.2784 => 1.2035, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -5.83% (1.2515 => 1.1786, std.dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: -5.79% (17.1032 => 16.1123, std.dev.: 0.0069) MultiSource/Benchmarks/nbench/nbench: -5.77% (1.1530 => 1.0865, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.75% (4.0323 => 3.8006, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.71% (1.6474 => 1.5533, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.68% (0.2695 => 0.2542, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.67% (1.2300 => 1.1602, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.67% (0.5857 => 0.5525, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.65% (0.2355 => 0.2222, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.64% (0.6681 => 0.6304, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.64% (4.8161 => 4.5447, std.dev.: 0.0050) MultiSource/Applications/siod/siod: -5.63% (2.4021 => 2.2668, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.62% (0.5478 => 0.5170, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -5.61% (0.3406 => 0.3215, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.60% (0.5591 => 0.5278, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.59% (0.6230 => 0.5882, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.58% (4.5069 => 4.2553, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.58% (0.6293 => 0.5942, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.58% (14.2083 => 13.4160, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.57% (0.7339 => 0.6930, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.57% (0.3483 => 0.3289, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.57% (0.6052 => 0.5715, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.55% (5.4682 => 5.1647, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.55% (0.5802 => 0.5480, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.54% (0.5575 => 0.5266, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: -5.53% (0.2659 => 0.2512, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: -5.52% (0.7447 => 0.7036, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.51% (0.6297 => 0.5950, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.50% (0.7524 => 0.7110, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.50% (1.6364 => 1.5464, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.50% (0.5859 => 0.5537, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.49% (0.2548 => 0.2408, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.49% (0.6446 => 0.6092, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.49% (0.5849 => 0.5528, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.49% (0.5925 => 0.5600, std.dev.: 0.0061) MultiSource/Applications/lua/lua: -5.46% (4.0594 => 3.8376, std.dev.: 0.0110) MultiSource/Benchmarks/Olden/bh/bh: -5.46% (0.2985 => 0.2822, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.45% (4.8802 => 4.6141, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.43% (6.7716 => 6.4038, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.42% (0.6194 => 0.5858, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.42% (1.4642 => 1.3849, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.41% (0.6667 => 0.6306, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.41% (0.6395 => 0.6049, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.41% (0.5863 => 0.5546, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.40% (0.5570 => 0.5269, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.40% (0.6260 => 0.5922) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.40% (0.5705 => 0.5397, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.38% (0.7919 => 0.7493, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.37% (0.5805 => 0.5493, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.36% (0.6304 => 0.5966, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.36% (0.6660 => 0.6303, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.32% (0.6033 => 0.5712, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -5.31% (15.5079 => 14.6843, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.30% (0.6676 => 0.6322, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.30% (0.6736 => 0.6379, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.30% (0.5569 => 0.5274, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.28% (0.7021 => 0.6650, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.28% (0.6189 => 0.5862, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.27% (2.2587 => 2.1397, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.27% (0.5941 => 0.5628, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.27% (0.5581 => 0.5287, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.25% (0.5567 => 0.5275, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.23% (0.6440 => 0.6103, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.22% (0.8521 => 0.8076, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: -5.22% (0.3831 => 0.3631, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -5.22% (0.3812 => 0.3613, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.21% (0.3880 => 0.3678, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -5.20% (0.4176 => 0.3959, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.19% (0.5456 => 0.5173, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.19% (0.5688 => 0.5393, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: -5.17% (3.5154 => 3.3337, std.dev.: 0.0085) MultiSource/Benchmarks/McCat/18-imp/imp: -5.17% (0.3581 => 0.3396, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.17% (0.3891 => 0.3690, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: -5.16% (0.4861 => 0.4610, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -5.15% (0.3848 => 0.3650, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: -5.14% (1.3864 => 1.3152, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: -5.11% (0.4033 => 0.3827, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.10% (0.3884 => 0.3686, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.09% (0.4916 => 0.4666, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.09% (0.5329 => 0.5058, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.08% (0.6395 => 0.6070, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.04% (0.2999 => 0.2848, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.01% (0.3931 => 0.3734, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: -5.01% (0.3896 => 0.3701, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.00% (0.2278 => 0.2164, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -5.00% (34.0927 => 32.3872, std.dev.: 0.0203) MultiSource/Applications/lambda-0_1_3/lambda: -5.00% (0.7982 => 0.7583, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -4.98% (1.3148 => 1.2493, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.95% (0.3837 => 0.3647, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.95% (0.2385 => 0.2267, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: -4.94% (2.1401 => 2.0344, std.dev.: 0.0115) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.94% (0.3849 => 0.3659, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -4.92% (0.4515 => 0.4293, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.91% (0.9557 => 0.9088, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: -4.90% (0.6750 => 0.6419, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.89% (8.0126 => 7.6209, std.dev.: 0.0068) MultiSource/Applications/ClamAV/clamscan: -4.87% (15.2527 => 14.5097, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/property: -4.86% (0.4199 => 0.3995, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -4.84% (0.4280 => 0.4073, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: -4.82% (18.2933 => 17.4108, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.82% (0.4151 => 0.3951, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.82% (0.5999 => 0.5710, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.81% (0.7198 => 0.6852, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.75% (0.4083 => 0.3889, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.73% (0.3491 => 0.3326, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -4.70% (0.3255 => 0.3102, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -4.69% (0.3025 => 0.2883, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.69% (1.2221 => 1.1648, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: -4.68% (0.4248 => 0.4049) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.67% (2.1713 => 2.0698, std.dev.: 0.0061) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.67% (0.3319 => 0.3164, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: -4.66% (0.3194 => 0.3045, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -4.66% (0.3026 => 0.2885, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.65% (0.3057 => 0.2915, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.64% (1.2210 => 1.1643, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.63% (0.3323 => 0.3169, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: -4.63% (0.3867 => 0.3688, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.61% (0.3016 => 0.2877, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.59% (0.4427 => 0.4224, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -4.59% (0.3446 => 0.3288, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.58% (0.3252 => 0.3103, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: -4.57% (0.3394 => 0.3239, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -4.55% (0.2989 => 0.2853, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.53% (0.4813 => 0.4595, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/fibo: -4.53% (0.2871 => 0.2741, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -4.51% (0.3481 => 0.3324, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: -4.49% (0.2939 => 0.2807, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -4.47% (0.3621 => 0.3459, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -4.46% (0.2849 => 0.2722, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -4.45% (0.3059 => 0.2923, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -4.44% (0.3788 => 0.3620, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.43% (0.2933 => 0.2803, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.37% (0.3205 => 0.3065, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -4.29% (0.8418 => 0.8057, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -4.20% (0.4524 => 0.4334, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: -4.19% (5.0226 => 4.8121, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.89% (0.2903 => 0.2790, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.80% (0.9077 => 0.8732, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: -3.70% (0.3271 => 0.3150, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -3.61% (0.6347 => 0.6118, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -3.39% (0.7779 => 0.7515, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: -3.37% (0.6441 => 0.6224, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -3.26% (1.5610 => 1.5101, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -2.48% (20.7746 => 20.2603, std.dev.: 0.0253) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7509, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: -8.76% (1.2842 => 1.1717, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: -4.03% (2.2633 => 2.1721, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.47% (1.3096 => 1.2773, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4718, std.dev.: 0.0026) Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 4 14:11:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 4 Nov 2012 16:11:23 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121104221123.11D632A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5580?compare_to=5578&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5580, Order: 167376, Start Time: 2012-11-04 20:45:28, End Time: 2012-11-04 22:11:29 To: 5578, Order: 167374, Start Time: 2012-11-04 18:45:38, End Time: 2012-11-04 20:13:06 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 3 (52 on baseline) Performance Improvements: 24 (9 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 964 (913 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 6.34% (3.0346 => 3.2269, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.55% (21.5700 => 22.3367, std.dev.: 0.1807) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.32% (1.2426 => 1.2590, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -7.06% (0.6250 => 0.5809, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.77% (0.6473 => 0.6035, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -5.34% (0.5221 => 0.4942, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/08-main/main: -3.99% (0.2733 => 0.2624, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.39% (0.3420 => 0.3304, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -3.32% (0.6028 => 0.5828, std.dev.: 0.0055) MultiSource/Applications/hbd/hbd: -3.16% (1.4679 => 1.4215, std.dev.: 0.0150) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -3.15% (0.8703 => 0.8429, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -2.94% (0.6608 => 0.6414, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.87% (0.9884 => 0.9600, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.81% (2.2195 => 2.1571, std.dev.: 0.0121) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.47% (1.2191 => 1.1890, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -2.30% (4.6743 => 4.5668, std.dev.: 0.0407) MultiSource/Benchmarks/McCat/05-eks/eks: -2.23% (0.4537 => 0.4436, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.96% (1.2775 => 1.2525, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.60% (4.5828 => 4.5094, std.dev.: 0.0211) MultiSource/Applications/spiff/spiff: -1.48% (0.8230 => 0.8108, std.dev.: 0.0026) MultiSource/Applications/lua/lua: -1.42% (3.9088 => 3.8532, std.dev.: 0.0168) MultiSource/Benchmarks/MallocBench/gs/gs: -1.32% (4.2550 => 4.1990, std.dev.: 0.0103) MultiSource/Applications/SIBsim4/SIBsim4: -1.30% (1.2927 => 1.2759, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.28% (1.3597 => 1.3423, std.dev.: 0.0032) MultiSource/Applications/Burg/burg: -1.07% (1.2607 => 1.2472, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -7.52% (4.0523 => 3.7476, std.dev.: 0.0721) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.14% (60.2447 => 59.5582, std.dev.: 0.2531) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.13% (16.6364 => 16.6583, std.dev.: 0.0779) MultiSource/Applications/obsequi/Obsequi: -2.50% (1.0787 => 1.0517, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.04% (21.4821 => 21.7052, std.dev.: 0.1186) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.71% (0.3653 => 0.3627, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: -1.28% (0.6074 => 0.5996, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.55% (0.3290 => 0.3308, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/strcat: -0.10% (0.2000 => 0.1998, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -11.01% (0.0218 => 0.0194, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 16.25% (0.0363 => 0.0422, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.67% (0.0327 => 0.0315, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0311 => 0.0312, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.24% (0.0422 => 0.0421, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -41.79% (0.0201 => 0.0117, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/test1: -25.35% (0.0217 => 0.0162, std.dev.: 0.0026) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 200.00% (0.0001 => 0.0003, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -1.48% (0.1487 => 0.1465, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.04% (1.1138 => 1.1143, std.dev.: 0.0098) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.34% (0.1406 => 0.1453, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.45% (0.4030 => 0.4048, std.dev.: 0.0467) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.12% (0.1288 => 0.1354, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.42% (0.0621 => 0.0606, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -27.90% (0.0276 => 0.0199, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.76% (0.0532 => 0.0552, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.10% (1.1433 => 1.1445, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.85% (0.0646 => 0.0563, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -25.86% (0.0263 => 0.0195, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.34% (0.8050 => 0.8023, std.dev.: 0.0115) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 63.89% (0.0036 => 0.0059, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2291.74% (0.6332 => 15.1445, std.dev.: 0.0267) MultiSource/Benchmarks/McCat/08-main/main: 43.31% (0.1831 => 0.2624, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.27% (0.1559 => 0.1430, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1477.84% (0.3344 => 5.2763, std.dev.: 0.1715) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.19% (0.2364 => 0.3196, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: 2.56% (0.0429 => 0.0440, std.dev.: 0.0010) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.02% (0.0224 => 0.0233, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3305, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0678, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4954, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3424, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0260, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4101, std.dev.: 0.0014) SingleSource/Regression/C/uint64_to_float: -23.85% (2.1832 => 1.6625, std.dev.: 0.0071) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.46% (0.0810 => 0.0919, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 9.98% (0.1112 => 0.1223, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.16% (0.2180 => 0.2336, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.26% (0.1885 => 0.2003, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.32% (0.3137 => 0.3304, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.96% (0.2279 => 0.2392, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.67% (0.2249 => 0.2354, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.80% (0.2998 => 0.3112, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.45% (0.8148 => 0.8429, std.dev.: 0.0069) MultiSource/Applications/treecc/treecc: 2.68% (1.9948 => 2.0482, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.67% (0.4127 => 0.4237, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.56% (1.4479 => 1.4849, std.dev.: 0.0067) MultiSource/Benchmarks/nbench/nbench: 2.45% (1.1271 => 1.1547, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.45% (1.1606 => 1.1890, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.39% (0.8457 => 0.8659, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.26% (0.8611 => 0.8806, std.dev.: 0.0043) MultiSource/Applications/Burg/burg: 2.05% (1.2222 => 1.2472, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.99% (0.8697 => 0.8870, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 1.99% (0.7950 => 0.8108, std.dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.95% (6.6074 => 6.7363, std.dev.: 0.0250) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.91% (4.1763 => 4.2559, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.91% (0.8712 => 0.8878, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.88% (0.9908 => 1.0094, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.79% (0.8597 => 0.8751, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.74% (0.8331 => 0.8476, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.72% (0.6227 => 0.6334, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 1.66% (4.1305 => 4.1990, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.63% (0.8261 => 0.8396, std.dev.: 0.0041) MultiSource/Applications/SIBsim4/SIBsim4: 1.52% (1.2568 => 1.2759, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 1.47% (2.2184 => 2.2511, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.37% (0.9039 => 0.9163, std.dev.: 0.0033) MultiSource/Applications/d/make_dparser: 1.37% (3.2366 => 3.2809, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.29% (0.8286 => 0.8393, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.28% (8.6476 => 8.7585, std.dev.: 0.0345) MultiSource/Applications/ClamAV/clamscan: 1.28% (14.7684 => 14.9570, std.dev.: 0.0582) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.26% (0.8805 => 0.8916, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 1.14% (14.2605 => 14.4225, std.dev.: 0.0562) MultiSource/Applications/JM/lencod/lencod: 1.09% (15.3280 => 15.4958, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.08% (1.3279 => 1.3423, std.dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 1.05% (6.7320 => 6.8025, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 67.34% (0.0199 => 0.0333, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/pi: 58.70% (1.5795 => 2.5066, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 8.16% (3.1873 => 3.4475, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.46% (1.1857 => 1.2742, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.19% (0.3186 => 0.3415, std.dev.: 0.0045) MultiSource/Benchmarks/sim/sim: 2.81% (3.8206 => 3.9281, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.75% (2.4490 => 2.5164, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/ReedSolomon: 2.74% (8.5322 => 8.7661, std.dev.: 0.0761) MultiSource/Applications/siod/siod: 2.59% (3.6643 => 3.7593, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 2.25% (63.1822 => 64.6030, std.dev.: 0.0850) MultiSource/Applications/lambda-0_1_3/lambda: 2.01% (7.4933 => 7.6442, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.74% (28.5821 => 29.0801, std.dev.: 0.1308) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -33.73% (0.0338 => 0.0224, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.37% (0.3269 => 0.3028, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.33% (2.8773 => 2.7528, std.dev.: 0.0230) SingleSource/Benchmarks/Shootout/lists: -3.68% (7.3375 => 7.0672, std.dev.: 0.0058) MultiSource/Applications/SPASS/SPASS: -2.96% (8.4326 => 8.1833, std.dev.: 0.0231) MultiSource/Applications/lua/lua: -2.54% (29.8330 => 29.0755, std.dev.: 0.2110) SingleSource/Benchmarks/Shootout/heapsort: -2.00% (3.2926 => 3.2269, std.dev.: 0.0159) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.45% (3.3479 => 3.2994, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/hash2: -1.16% (3.4237 => 3.3840, std.dev.: 0.0055) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.29% (16.4461 => 16.6583, std.dev.: 0.0779) MultiSource/Applications/obsequi/Obsequi: 2.48% (1.0262 => 1.0517, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6850.11% (0.3123 => 21.7052, std.dev.: 0.1186) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.26% (0.2463 => 0.3627, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: -0.23% (0.6010 => 0.5996, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.29% (0.3266 => 0.3308, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/strcat: 1.47% (0.1969 => 0.1998, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 57.72% (0.0123 => 0.0194, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.43% (0.0408 => 0.0422, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 24.02% (0.0254 => 0.0315, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.64% (0.0384 => 0.0421, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -38.42% (0.0190 => 0.0117, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/test1: -10.00% (0.0180 => 0.0162, std.dev.: 0.0026) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -57.14% (0.0007 => 0.0003, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 1.88% (0.1438 => 0.1465, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.64% (1.1329 => 1.1143, std.dev.: 0.0098) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.62% (0.1462 => 0.1453, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.79% (0.4164 => 0.4048, std.dev.: 0.0467) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.10% (0.1369 => 0.1354, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.46% (0.0641 => 0.0606, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.05% (0.0195 => 0.0199, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.50% (0.0578 => 0.0552, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.07% (1.1437 => 1.1445, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.21% (0.0627 => 0.0563, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.33% (0.0180 => 0.0195, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.07% (0.8017 => 0.8023, std.dev.: 0.0115) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -4.84% (0.0062 => 0.0059, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 4 14:16:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 4 Nov 2012 16:16:40 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121104221640.5FC112A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5581?compare_to=5579&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5581, Order: 167376, Start Time: 2012-11-04 20:51:46, End Time: 2012-11-04 22:16:46 To: 5579, Order: 167374, Start Time: 2012-11-04 18:52:00, End Time: 2012-11-04 20:17:14 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (175 on baseline) Unchanged Tests: 1041 (863 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.15% (0.8732 => 0.8832, std.dev.: 0.0007) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.65% (2.0478 => 2.1020, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.4937 => 7.6826, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/hash2: 1.95% (3.1932 => 3.2554, std.dev.: 0.0067) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.60% (0.1431 => 0.1308, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.46% (0.3821 => 0.3536, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.07% (2.4924 => 2.3161, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.58% (22.4056 => 20.9305, std.dev.: 0.0112) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.47% (0.2428 => 0.2271, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.43% (0.3357 => 0.3141, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.43% (3.5339 => 3.3068, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.39% (0.9542 => 0.8932, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.21% (0.3658 => 0.3431, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -6.10% (16.1920 => 15.2043, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/football/football: -6.08% (0.9179 => 0.8621, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: -6.06% (0.2160 => 0.2029, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -6.06% (7.0961 => 6.6659, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.05% (0.6484 => 0.6092, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.00% (9.2283 => 8.6742, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.99% (1.0544 => 0.9912, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -5.99% (1.1450 => 1.0764, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.93% (0.9852 => 0.9268, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.87% (1.2784 => 1.2033, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: -5.83% (1.2515 => 1.1785, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -5.81% (17.1032 => 16.1092, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.81% (0.5857 => 0.5517, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.76% (1.3722 => 1.2931, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.72% (1.6474 => 1.5532, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: -5.72% (1.1530 => 1.0871, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.72% (1.2300 => 1.1597, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.69% (1.6364 => 1.5433, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: -5.66% (4.3330 => 4.0876, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.66% (4.0323 => 3.8041, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.65% (0.2355 => 0.2222, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.64% (1.4642 => 1.3816, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.64% (0.6293 => 0.5938, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.62% (0.6304 => 0.5950, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.61% (0.2548 => 0.2405, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.60% (0.5478 => 0.5171, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.60% (0.5925 => 0.5593, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.59% (4.8161 => 4.5470, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.59% (5.4682 => 5.1628, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.58% (14.2083 => 13.4149, std.dev.: 0.0115) MultiSource/Benchmarks/sim/sim: -5.58% (0.3406 => 0.3216, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -5.57% (2.4021 => 2.2683, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.57% (0.6446 => 0.6087, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.56% (0.6297 => 0.5947, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.56% (0.5849 => 0.5524, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.55% (0.5802 => 0.5480, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.53% (4.5069 => 4.2575, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.53% (0.7524 => 0.7108, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: -5.53% (0.2659 => 0.2512, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.52% (0.5705 => 0.5390, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.52% (0.7339 => 0.6934, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.51% (0.3483 => 0.3291, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.51% (0.5863 => 0.5540, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -5.50% (4.0594 => 3.8360, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.49% (0.5575 => 0.5269, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.48% (4.8802 => 4.6129, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.46% (0.5859 => 0.5539, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.46% (0.6230 => 0.5890, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.44% (0.7021 => 0.6639, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.44% (0.6052 => 0.5723, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.42% (6.7716 => 6.4043, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.42% (0.5570 => 0.5268, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.42% (0.5591 => 0.5288, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.41% (0.5581 => 0.5279, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: -5.39% (15.5079 => 14.6716, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.39% (0.6194 => 0.5860, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.39% (0.6660 => 0.6301, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.37% (0.5805 => 0.5493, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -5.37% (1.3864 => 1.3119, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.35% (0.7919 => 0.7495, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.35% (0.5456 => 0.5164, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -5.33% (0.2985 => 0.2826, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.32% (0.6667 => 0.6312, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.32% (0.6260 => 0.5927, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: -5.32% (0.7447 => 0.7051, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.31% (0.2695 => 0.2552, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.30% (0.6440 => 0.6099, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.26% (0.5567 => 0.5274, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.26% (0.5569 => 0.5276, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.24% (0.6676 => 0.6326, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.24% (0.5329 => 0.5050, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.23% (0.5941 => 0.5630, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.22% (0.6681 => 0.6332, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.22% (0.6033 => 0.5718, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -5.21% (0.3880 => 0.3678, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.20% (0.4151 => 0.3935, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.19% (0.6189 => 0.5868, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.18% (0.4033 => 0.3824, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: -5.17% (0.3581 => 0.3396, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.16% (2.2587 => 2.1421, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/hash2: -5.14% (0.4861 => 0.4611, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -5.14% (0.3831 => 0.3634, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.13% (0.5688 => 0.5396, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.13% (0.4916 => 0.4664, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -5.12% (0.3848 => 0.3651, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.11% (0.6395 => 0.6068, std.dev.: 0.0101) SingleSource/UnitTests/ObjC/synchronized: -5.11% (0.3896 => 0.3697, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -5.10% (3.5154 => 3.3360, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.10% (0.7198 => 0.6831, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.09% (0.8521 => 0.8087, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -5.09% (0.3812 => 0.3618, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.09% (0.9557 => 0.9071, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: -5.08% (2.1401 => 2.0314, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.07% (0.5168 => 0.4906, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.04% (0.3891 => 0.3695, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.03% (0.4176 => 0.3966, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -5.02% (0.7982 => 0.7581, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.02% (0.6736 => 0.6398, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -5.00% (1.3148 => 1.2490, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.99% (0.3849 => 0.3657, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.98% (0.4199 => 0.3990, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.97% (0.5999 => 0.5701, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.96% (0.2278 => 0.2165, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: -4.95% (34.0927 => 32.4041, std.dev.: 0.0126) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.94% (0.3884 => 0.3692, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.91% (15.2527 => 14.5042, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/bigfib: -4.90% (0.6750 => 0.6419, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.90% (0.3837 => 0.3649, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: -4.89% (18.2933 => 17.3986, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.87% (0.2999 => 0.2853, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.86% (8.0126 => 7.6231, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.81% (1.2221 => 1.1633, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/moments: -4.80% (0.4248 => 0.4044, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.79% (1.2210 => 1.1625, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.78% (0.4083 => 0.3888, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -4.77% (0.4280 => 0.4076, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: -4.76% (0.3025 => 0.2881, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.74% (0.2385 => 0.2272, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: -4.73% (0.3255 => 0.3101, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.68% (0.3057 => 0.2914, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: -4.67% (0.4515 => 0.4304, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.67% (0.3491 => 0.3328, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: -4.66% (0.3194 => 0.3045, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -4.66% (0.3026 => 0.2885, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.64% (0.3016 => 0.2876, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -4.61% (0.3446 => 0.3287, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.60% (0.3867 => 0.3689, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.59% (0.4427 => 0.4224, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/fibo: -4.56% (0.2871 => 0.2740, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.55% (2.1713 => 2.0725, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: -4.51% (0.8418 => 0.8038, std.dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: -4.51% (0.3059 => 0.2921, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -4.51% (0.3394 => 0.3241, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -4.49% (0.2849 => 0.2721, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -4.49% (0.2939 => 0.2807, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.46% (0.3271 => 0.3125, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -4.45% (0.3481 => 0.3326, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.45% (0.2989 => 0.2856, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.40% (0.3931 => 0.3758, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.38% (0.4813 => 0.4602, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: -4.36% (0.3788 => 0.3623, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.35% (0.4321 => 0.4133, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wc: -4.34% (0.3205 => 0.3066, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.31% (0.3252 => 0.3112, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.30% (0.2933 => 0.2807, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -4.28% (0.3621 => 0.3466, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: -4.20% (5.0226 => 4.8119, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: -4.16% (0.4524 => 0.4336, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.88% (0.3323 => 0.3194, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.62% (0.3319 => 0.3199, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.53% (0.6347 => 0.6123, std.dev.: 0.0079) SingleSource/UnitTests/ObjC++/property-reference: -3.47% (0.7779 => 0.7509, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: -3.43% (0.6441 => 0.6220, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -3.40% (1.5610 => 1.5080, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.70% (0.9077 => 0.8832, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -2.49% (20.7746 => 20.2578, std.dev.: 0.0231) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7523, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7067, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.61% (2.2633 => 2.1817, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.68% (1.3096 => 1.2745, std.dev.: 0.0113) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4698, std.dev.: 0.0023) Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 4 14:33:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 4 Nov 2012 16:33:15 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121104223315.8AE872A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5582?compare_to=5577&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5582, Order: 167374, Start Time: 2012-11-04 19:16:59, End Time: 2012-11-04 22:33:22 To: 5577, Order: 167370, Start Time: 2012-11-04 13:50:14, End Time: 2012-11-04 17:05:50 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (169 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (720 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 3.82% (0.2959 => 0.3072, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.39% (2.1212 => 2.0706, std.dev.: 0.0086) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.16% (0.0625 => 0.0876, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.42% (0.1063 => 0.1397, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.86% (0.1106 => 0.1392, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.36% (0.2969 => 0.3722, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.65% (0.0714 => 0.0890, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.55% (0.4139 => 0.5155, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.79% (0.4253 => 0.5265, std.dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: 23.54% (1.5932 => 1.9682, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.10% (0.5900 => 0.7263, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.97% (0.4994 => 0.6141, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.49% (0.0547 => 0.0670, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.26% (0.0584 => 0.0714, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.26% (0.5000 => 0.6113, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.07% (0.0897 => 0.1095, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.98% (0.1620 => 0.1976, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.74% (0.1021 => 0.1243, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 21.37% (0.0599 => 0.0727, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.32% (0.1107 => 0.1343, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 20.70% (0.0604 => 0.0729, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.40% (0.0642 => 0.0773, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.38% (0.0584 => 0.0703, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 20.36% (0.0948 => 0.1141, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 20.10% (0.0821 => 0.0986, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.01% (0.1549 => 0.1859, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 20.01% (0.1619 => 0.1943, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.95% (0.1103 => 0.1323, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.83% (0.0822 => 0.0985, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.83% (0.1604 => 0.1922, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.81% (0.3903 => 0.4676, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.44% (0.1003 => 0.1198, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.59% (0.0947 => 0.1123, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 18.37% (0.5826 => 0.6896, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 18.17% (0.5889 => 0.6959, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 18.17% (0.4029 => 0.4761, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.13% (0.1462 => 0.1727, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 17.98% (0.1218 => 0.1437, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.97% (0.2014 => 0.2376, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.97% (0.3890 => 0.4589, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 17.82% (0.0808 => 0.0952, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 17.74% (0.1505 => 0.1772, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.46% (0.1088 => 0.1278, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.43% (0.2736 => 0.3213, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.37% (1.3152 => 1.5437, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/mst/mst: 17.34% (0.0698 => 0.0819, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.17% (0.2866 => 0.3358, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.03% (3.5627 => 4.1693, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 16.75% (0.5546 => 0.6475, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.64% (0.1160 => 0.1353, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 16.54% (1.8794 => 2.1903, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.49% (0.2875 => 0.3349, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.44% (1.6211 => 1.8876, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference: 16.40% (0.7171 => 0.8347, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hello: 16.40% (0.2714 => 0.3159, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.34% (0.4658 => 0.5419, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.29% (0.3271 => 0.3804, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.26% (0.1968 => 0.2288, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: 16.11% (0.2725 => 0.3164, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 16.05% (0.1421 => 0.1649, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.98% (0.5026 => 0.5829, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.85% (0.2738 => 0.3172, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 15.82% (0.2750 => 0.3185, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: 15.75% (0.2813 => 0.3256, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.68% (0.4361 => 0.5045, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 15.67% (0.9697 => 1.1217, std.dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 15.65% (0.3004 => 0.3474, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 15.62% (0.2823 => 0.3264, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.61% (0.2729 => 0.3155, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 15.54% (0.2780 => 0.3212, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.52% (0.3195 => 0.3691, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 15.50% (0.1284 => 0.1483, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.45% (2.0673 => 2.3867, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 15.45% (0.2803 => 0.3236, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.42% (4.4195 => 5.1009, std.dev.: 0.0068) MultiSource/Applications/d/make_dparser: 15.42% (1.0781 => 1.2443, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.40% (0.2792 => 0.3222, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 15.37% (0.3096 => 0.3572, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.34% (2.7292 => 3.1478, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/except: 15.33% (0.2811 => 0.3242, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.22% (0.3930 => 0.4528, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.15% (0.2911 => 0.3352, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 15.09% (0.9909 => 1.1404, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.08% (1.9694 => 2.2663, std.dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 15.06% (4.2109 => 4.8452, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.83% (1.9966 => 2.2927, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 14.75% (0.3267 => 0.3749, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 14.64% (0.3258 => 0.3735, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.50% (0.1090 => 0.1248, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.46% (0.3362 => 0.3848, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 14.45% (23.5202 => 26.9180, std.dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.43% (0.3845 => 0.4400, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 14.41% (0.3317 => 0.3795, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.37% (0.3124 => 0.3573, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.35% (0.3060 => 0.3499, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 14.19% (0.3678 => 0.4200, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 14.08% (0.3465 => 0.3953, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-2: 14.05% (0.3446 => 0.3930, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 14.04% (0.3496 => 0.3987, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 14.04% (0.3348 => 0.3818, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.02% (0.3488 => 0.3977, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.92% (0.3442 => 0.3921, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 13.87% (0.3460 => 0.3940, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.86% (0.3282 => 0.3737, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 13.84% (0.3469 => 0.3949, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 13.82% (0.3726 => 0.4241, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.79% (0.3625 => 0.4125, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 13.75% (0.3477 => 0.3955, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 13.69% (0.2075 => 0.2359, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 13.64% (0.2566 => 0.2916, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 13.53% (0.3643 => 0.4136, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 13.53% (0.4251 => 0.4826, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 13.51% (0.3650 => 0.4143, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 13.45% (1.4269 => 1.6188, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 13.43% (0.4146 => 0.4703, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.41% (0.3981 => 0.4515, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 13.40% (0.3724 => 0.4223, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.33% (0.3690 => 0.4182, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 13.28% (0.7875 => 0.8921, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 12.87% (2.1653 => 2.4439, std.dev.: 0.0109) MultiSource/Applications/JM/lencod/lencod: 12.75% (4.6177 => 5.2063, std.dev.: 0.0089) MultiSource/Benchmarks/mafft/pairlocalalign: 12.58% (2.1013 => 2.3657, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/bigfib: 12.57% (0.5012 => 0.5642, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 11.93% (0.2691 => 0.3012, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.86% (0.2040 => 0.2282, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 11.32% (5.5417 => 6.1690, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.30% (0.6435 => 0.7162, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 10.49% (0.3498 => 0.3865, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.49% (0.2737 => 0.3024, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.41% (0.1383 => 0.1527, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.41% (0.1028 => 0.1135, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.35% (0.2068 => 0.2282, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.11% (0.6634 => 0.7305, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 10.09% (0.4847 => 0.5336, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.82% (0.3084 => 0.3387, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 9.65% (0.3336 => 0.3658, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.18% (0.2103 => 0.2296, std.dev.: 0.0056) MultiSource/Applications/lemon/lemon: 9.08% (0.2391 => 0.2608, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 8.90% (2.0346 => 2.2157, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.32% (4.6926 => 5.0828, std.dev.: 0.0135) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.24% (11.6398 => 12.5993, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.72% (0.5361 => 0.5775, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.98% (0.7426 => 0.7944, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.91% (0.5584 => 0.5970, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 6.23% (11.9555 => 12.7000, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.67% (0.3792 => 0.3969, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6531, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 9.64% (0.2802 => 0.3072, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6106, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.51% (0.2122 => 0.2239, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 5.04% (12.0509 => 12.6580, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1666, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-2: 4.00% (1.8057 => 1.8779, std.dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/dry: 2.53% (14.0481 => 14.4040, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1964, std.dev.: 0.0034) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.74% (3.1722 => 3.2274, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3052, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2882, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5143, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5405, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5996, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.09% (2.4764 => 2.4247, std.dev.: 0.0190) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.62% (25.4195 => 16.3645, std.dev.: 0.0217) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9758, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.67% (35.5013 => 32.7801, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: -7.20% (0.2402 => 0.2229, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.03% (11.2080 => 10.8689, std.dev.: 0.0389) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: -2.87% (3.6262 => 3.5220, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.83% (0.6293 => 0.6115, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/fldry: -2.69% (17.2379 => 16.7749, std.dev.: 0.0372) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8664, std.dev.: 0.0280) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5705, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/bh/bh: -1.56% (5.5810 => 5.4942, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7164, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.1988, std.dev.: 0.0440) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.09% (16.2163 => 16.0402, std.dev.: 0.0034) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.09% (3.3991 => 3.3622, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 4 18:05:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 4 Nov 2012 20:05:47 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121105020547.2CB4E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5583?compare_to=5580&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5583, Order: 167377, Start Time: 2012-11-05 00:38:25, End Time: 2012-11-05 02:05:54 To: 5580, Order: 167376, Start Time: 2012-11-04 20:45:28, End Time: 2012-11-04 22:11:29 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 18 (67 on baseline) Performance Improvements: 1 (6 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 972 (901 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.43% (0.8489 => 0.9205, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.06% (0.5809 => 0.6277, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.18% (0.6035 => 0.6408, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.91% (0.2522 => 0.2671, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/08-main/main: 4.42% (0.2624 => 0.2740, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 4.26% (0.8108 => 0.8453, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.19% (0.4942 => 0.5149, std.dev.: 0.0074) MultiSource/Applications/hbd/hbd: 4.03% (1.4215 => 1.4788, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.05% (0.5828 => 0.6006, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.78% (0.6414 => 0.6592, std.dev.: 0.0058) MultiSource/Applications/Burg/burg: 2.43% (1.2472 => 1.2775, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.36% (0.9600 => 0.9827, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.15% (0.8429 => 0.8610, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.11% (5.2763 => 5.3875, std.dev.: 0.0284) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.91% (4.5668 => 4.6541, std.dev.: 0.0286) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.06% (4.5094 => 4.5571, std.dev.: 0.0148) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/life/life: 1.70% (2.6031 => 2.6474, std.dev.: 0.0109) MultiSource/Benchmarks/BitBench/five11/five11: 1.06% (5.5804 => 5.6395, std.dev.: 0.0200) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.22% (4.8917 => 4.8321, std.dev.: 0.0171) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.08% (16.6583 => 16.6448, std.dev.: 0.2264) MultiSource/Applications/obsequi/Obsequi: 1.74% (1.0517 => 1.0700, std.dev.: 0.0059) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.10% (21.7052 => 21.4657, std.dev.: 0.0112) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.19% (0.3627 => 0.3634, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/bigfib: 0.40% (0.5996 => 0.6020, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.15% (0.3308 => 0.3313, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: -0.30% (0.1998 => 0.1992, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 3.09% (0.0194 => 0.0200, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -17.06% (0.0422 => 0.0350, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.49% (0.0315 => 0.0304, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0312 => 0.0312, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.24% (0.0421 => 0.0420, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 72.65% (0.0117 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 33.95% (0.0162 => 0.0217, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 333.33% (0.0003 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.96% (0.1465 => 0.1479, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.85% (1.1143 => 1.1238, std.dev.: 0.0052) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1453 => 0.1454, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.01% (0.4048 => 0.4007, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.54% (0.1354 => 0.1279, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.17% (0.0606 => 0.0605, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 39.20% (0.0199 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.09% (0.0552 => 0.0546, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.29% (1.1445 => 1.1478, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.37% (0.0563 => 0.0582, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.59% (0.0195 => 0.0188, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.02% (0.8023 => 0.7941, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 30.51% (0.0059 => 0.0077, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2287.49% (0.6332 => 15.1176, std.dev.: 0.1472) MultiSource/Benchmarks/McCat/08-main/main: 49.65% (0.1831 => 0.2740, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.03% (0.1559 => 0.1465, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1511.09% (0.3344 => 5.3875, std.dev.: 0.0284) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.76% (0.2364 => 0.3233, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0429 => 0.0439, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.46% (0.0224 => 0.0234, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -32.17% (0.0230 => 0.0156, std.dev.: 0.0007) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3146, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0734, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4928, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3448, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0381, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4061, std.dev.: 0.0053) SingleSource/Regression/C/uint64_to_float: -23.88% (2.1832 => 1.6619, std.dev.: 0.0064) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.31% (0.0810 => 0.0934, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.75% (0.0773 => 0.0887, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 14.12% (0.1112 => 0.1269, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.01% (0.0830 => 0.0938, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.62% (0.8321 => 0.9205, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.35% (0.1425 => 0.1544, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.66% (0.2180 => 0.2347, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 6.72% (0.1577 => 0.1683, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.62% (0.6010 => 0.6408, std.dev.: 0.0104) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.52% (0.2240 => 0.2386, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.41% (0.2279 => 0.2425, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.38% (0.7473 => 0.7950, std.dev.: 0.0084) MultiSource/Applications/spiff/spiff: 6.33% (0.7950 => 0.8453, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.23% (0.4847 => 0.5149, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.03% (0.2519 => 0.2671, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.85% (0.1983 => 0.2099, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.67% (0.8148 => 0.8610, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.30% (0.5961 => 0.6277, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.22% (0.3295 => 0.3467, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.85% (0.6287 => 0.6592, std.dev.: 0.0058) MultiSource/Applications/Burg/burg: 4.52% (1.2222 => 1.2775, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.44% (0.2998 => 0.3131, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.15% (0.9435 => 0.9827, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.87% (1.1606 => 1.2055, std.dev.: 0.0081) MultiSource/Applications/sgefa/sgefa: 3.67% (0.2999 => 0.3109, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.66% (1.1685 => 1.2113, std.dev.: 0.0093) MultiSource/Applications/hbd/hbd: 3.64% (1.4269 => 1.4788, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.25% (0.5817 => 0.6006, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/gs/gs: 3.11% (4.1305 => 4.2588, std.dev.: 0.0252) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.00% (0.4127 => 0.4251, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.00% (1.3279 => 1.3677, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.90% (8.6476 => 8.8980, std.dev.: 0.0603) MultiSource/Benchmarks/McCat/05-eks/eks: 2.77% (0.4397 => 0.4519, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash2: 2.45% (0.4125 => 0.4226, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.34% (0.8457 => 0.8655, std.dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: 2.29% (14.7684 => 15.1059, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.26% (4.1763 => 4.2708, std.dev.: 0.0195) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.04% (1.4479 => 1.4774, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.00% (6.6074 => 6.7398, std.dev.: 0.0371) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.92% (0.8611 => 0.8776, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.84% (4.5702 => 4.6541, std.dev.: 0.0286) MultiSource/Applications/d/make_dparser: 1.82% (3.2366 => 3.2955, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.75% (0.8697 => 0.8849, std.dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 1.67% (14.2605 => 14.4980, std.dev.: 0.0620) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.65% (0.8007 => 0.8139, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 1.65% (1.2568 => 1.2775, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.60% (4.4873 => 4.5593, std.dev.: 0.0120) MultiSource/Applications/JM/lencod/lencod: 1.58% (15.3280 => 15.5709, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.54% (4.4880 => 4.5571, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.50% (0.8805 => 0.8937, std.dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: 1.48% (6.7320 => 6.8317, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.48% (1.2602 => 1.2788, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.26% (0.8317 => 0.8422, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 1.15% (31.8598 => 32.2257, std.dev.: 0.0529) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 59.80% (0.0199 => 0.0318, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/pi: 56.36% (1.5795 => 2.4697, std.dev.: 0.0211) MultiSource/Applications/SIBsim4/SIBsim4: 8.14% (3.1873 => 3.4469, std.dev.: 0.0284) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.10% (1.1857 => 1.2817, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 4.75% (14.0064 => 14.6713, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/ReedSolomon: 3.51% (8.5322 => 8.8319, std.dev.: 0.0325) MultiSource/Benchmarks/sim/sim: 2.91% (3.8206 => 3.9317, std.dev.: 0.0183) MultiSource/Applications/siod/siod: 2.91% (3.6643 => 3.7708, std.dev.: 0.0093) MultiSource/Benchmarks/mafft/pairlocalalign: 2.57% (63.1822 => 64.8052, std.dev.: 0.1102) MultiSource/Applications/lambda-0_1_3/lambda: 1.96% (7.4933 => 7.6400, std.dev.: 0.0186) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.70% (28.5821 => 29.0666, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/neural/neural: 1.24% (1.0841 => 1.0975, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 1.10% (2.3560 => 2.3819, std.dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.58% (0.3269 => 0.3054, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.41% (2.8773 => 2.7504, std.dev.: 0.0301) SingleSource/Benchmarks/Shootout/lists: -4.09% (7.3375 => 7.0375, std.dev.: 0.0329) MultiSource/Applications/lua/lua: -2.55% (29.8330 => 29.0731, std.dev.: 0.2030) SingleSource/Benchmarks/Shootout-C++/hash2: -1.49% (3.4237 => 3.3727, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.44% (3.3479 => 3.2997, std.dev.: 0.0071) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.21% (16.4461 => 16.6448, std.dev.: 0.2264) MultiSource/Applications/obsequi/Obsequi: 4.27% (1.0262 => 1.0700, std.dev.: 0.0059) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6773.42% (0.3123 => 21.4657, std.dev.: 0.0112) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.54% (0.2463 => 0.3634, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/bigfib: 0.17% (0.6010 => 0.6020, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.44% (0.3266 => 0.3313, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 1.17% (0.1969 => 0.1992, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 62.60% (0.0123 => 0.0200, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -14.22% (0.0408 => 0.0350, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 19.69% (0.0254 => 0.0304, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.38% (0.0384 => 0.0420, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.85% (0.1438 => 0.1479, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.80% (1.1329 => 1.1238, std.dev.: 0.0052) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.55% (0.1462 => 0.1454, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.77% (0.4164 => 0.4007, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.57% (0.1369 => 0.1279, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.62% (0.0641 => 0.0605, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.54% (0.0578 => 0.0546, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.36% (1.1437 => 1.1478, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.18% (0.0627 => 0.0582, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.44% (0.0180 => 0.0188, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.95% (0.8017 => 0.7941, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 24.19% (0.0062 => 0.0077, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 4 18:08:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 4 Nov 2012 20:08:38 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121105020838.C92852A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5584?compare_to=5581&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5584, Order: 167377, Start Time: 2012-11-05 00:43:34, End Time: 2012-11-05 02:08:44 To: 5581, Order: 167376, Start Time: 2012-11-04 20:51:46, End Time: 2012-11-04 22:16:46 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (6 on baseline) Performance Improvements: 0 (180 on baseline) Unchanged Tests: 1040 (856 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.40% (78.5707 => 81.2398, std.dev.: 0.0310) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.97% (54.9235 => 56.5536, std.dev.: 0.0676) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.38% (1.2783 => 1.3726, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.63% (54.5751 => 56.5536, std.dev.: 0.0676) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.70% (2.0478 => 2.1031, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.4937 => 7.6743, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/hash2: 2.22% (3.1932 => 3.2642, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.91% (79.7170 => 81.2398, std.dev.: 0.0310) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.53% (0.1431 => 0.1309, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.03% (0.3821 => 0.3514, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -7.07% (2.4924 => 2.3161, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.56% (0.3142 => 0.2936, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.55% (0.2428 => 0.2269, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.53% (22.4056 => 20.9415, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.46% (3.5339 => 3.3055, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.38% (0.9542 => 0.8933, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.29% (0.3357 => 0.3146, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.26% (0.3658 => 0.3429, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: -6.16% (0.2160 => 0.2027, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -6.15% (16.1920 => 15.1969, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: -6.12% (7.0961 => 6.6619, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: -6.04% (9.2283 => 8.6712, std.dev.: 0.0116) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.02% (0.9852 => 0.9259, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.99% (1.0544 => 0.9912, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -5.97% (1.1450 => 1.0767, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -5.96% (0.1761 => 0.1656, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.95% (0.6484 => 0.6098, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -5.95% (4.3330 => 4.0754, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.85% (0.1796 => 0.1691, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: -5.83% (1.2515 => 1.1785, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.82% (0.5857 => 0.5516, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.80% (1.3722 => 1.2926, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.78% (0.6681 => 0.6295, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.74% (1.6474 => 1.5529, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.73% (1.4642 => 1.3803, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.72% (4.0323 => 3.8016, std.dev.: 0.0048) MultiSource/Applications/siod/siod: -5.71% (2.4021 => 2.2649, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/football/football: -5.71% (0.9179 => 0.8655, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.69% (1.2300 => 1.1600, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: -5.68% (17.1032 => 16.1321, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.66% (0.6304 => 0.5947, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.66% (5.4682 => 5.1588, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.65% (1.6364 => 1.5439, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.65% (1.2784 => 1.2062, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.65% (0.2355 => 0.2222, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.64% (0.2695 => 0.2543, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.63% (0.5591 => 0.5276, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.63% (0.6230 => 0.5879, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.62% (0.5478 => 0.5170, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: -5.60% (0.2659 => 0.2510, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.60% (0.6052 => 0.5713, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.60% (14.2083 => 13.4131, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.59% (4.8161 => 4.5467, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.59% (0.6194 => 0.5848, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.58% (0.6446 => 0.6086, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.58% (4.5069 => 4.2553, std.dev.: 0.0037) MultiSource/Benchmarks/sim/sim: -5.58% (0.3406 => 0.3216, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.57% (0.5849 => 0.5523, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.56% (0.6667 => 0.6296, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.55% (0.5802 => 0.5480, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.51% (0.6293 => 0.5946, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.51% (0.5575 => 0.5268, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.50% (4.8802 => 4.6118, std.dev.: 0.0038) MultiSource/Applications/lua/lua: -5.50% (4.0594 => 3.8362, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.50% (0.5859 => 0.5537, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.49% (0.2548 => 0.2408, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -5.49% (0.2985 => 0.2821, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.49% (0.7339 => 0.6936, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.49% (0.7524 => 0.7111, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.49% (0.5925 => 0.5600, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.48% (0.3483 => 0.3292, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -5.48% (0.7447 => 0.7039, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.46% (0.6260 => 0.5918, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.46% (6.7716 => 6.4018, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.45% (0.6297 => 0.5954, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.44% (0.5941 => 0.5618, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.44% (0.6660 => 0.6298, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.43% (0.6736 => 0.6370, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: -5.42% (15.5079 => 14.6667, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.40% (0.6440 => 0.6092, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.40% (0.7021 => 0.6642, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -5.40% (1.3864 => 1.3116, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.39% (0.5805 => 0.5492, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.39% (0.5863 => 0.5547, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.38% (0.6189 => 0.5856, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.38% (0.6676 => 0.6317, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.37% (0.5456 => 0.5163, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: -5.37% (1.1530 => 1.0911, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.37% (0.5570 => 0.5271, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.36% (0.6395 => 0.6052, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.34% (2.2587 => 2.1380, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.34% (0.7919 => 0.7496, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.34% (0.6033 => 0.5711, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.33% (0.5569 => 0.5272, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.32% (0.5581 => 0.5284, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.30% (0.5567 => 0.5272, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: -5.28% (3.5154 => 3.3297, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.26% (0.5705 => 0.5405, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.25% (0.4151 => 0.3933, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: -5.22% (0.4176 => 0.3958, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -5.19% (0.3812 => 0.3614, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.19% (0.6395 => 0.6063, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.18% (0.5999 => 0.5688, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.15% (0.8521 => 0.8082, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-2: -5.14% (0.3831 => 0.3634, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/18-imp/imp: -5.14% (0.3581 => 0.3397, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: -5.13% (0.4033 => 0.3826, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.13% (0.3880 => 0.3681, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.11% (0.3891 => 0.3692, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.10% (0.5329 => 0.5057, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.08% (0.3896 => 0.3698, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.08% (0.5688 => 0.5399, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.07% (0.4916 => 0.4667, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -5.05% (0.7982 => 0.7579, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -5.04% (0.4861 => 0.4616, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -5.03% (2.1401 => 2.0324, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -5.02% (0.3848 => 0.3655, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.01% (0.5168 => 0.4909, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.00% (0.2999 => 0.2849, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.99% (0.3849 => 0.3657, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -4.96% (34.0927 => 32.4007, std.dev.: 0.0112) MultiSource/Applications/hexxagon/hexxagon: -4.96% (1.3148 => 1.2496, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.94% (0.9557 => 0.9085, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.93% (0.3837 => 0.3648, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.92% (0.3884 => 0.3693, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.91% (0.4199 => 0.3993, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -4.90% (15.2527 => 14.5059, std.dev.: 0.0079) SingleSource/UnitTests/ObjC/parameter-passing: -4.88% (0.4280 => 0.4071, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -4.88% (18.2933 => 17.4005, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.88% (8.0126 => 7.6217, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: -4.87% (0.6750 => 0.6421, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.87% (1.2221 => 1.1626, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.82% (0.2385 => 0.2270, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.80% (0.4083 => 0.3887, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.80% (1.2210 => 1.1624, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: -4.79% (0.3194 => 0.3041, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.78% (0.2278 => 0.2169, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: -4.78% (0.4515 => 0.4299, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: -4.76% (0.3255 => 0.3100, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -4.76% (0.3025 => 0.2881, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.75% (0.7198 => 0.6856, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.73% (0.3319 => 0.3162, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.67% (0.3491 => 0.3328, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.63% (0.3867 => 0.3688, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.63% (2.1713 => 2.0708, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: -4.61% (0.4248 => 0.4052, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -4.59% (0.3026 => 0.2887, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -4.59% (0.3446 => 0.3288, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.58% (0.4321 => 0.4123, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.58% (0.3057 => 0.2917, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.56% (0.4427 => 0.4225, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: -4.56% (0.3271 => 0.3122, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -4.53% (0.2939 => 0.2806, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -4.52% (0.2989 => 0.2854, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.51% (0.3016 => 0.2880, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -4.49% (0.2871 => 0.2742, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -4.48% (0.3059 => 0.2922, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary: -4.48% (0.3394 => 0.3242, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: -4.47% (0.3621 => 0.3459, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary2: -4.45% (0.3481 => 0.3326, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.44% (0.2903 => 0.2774, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: -4.44% (0.3788 => 0.3620, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -4.43% (0.3205 => 0.3063, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.43% (0.3252 => 0.3108, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.39% (0.2849 => 0.2724, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.38% (0.3931 => 0.3759, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.34% (0.4813 => 0.4604, std.dev.: 0.0032) MultiSource/Applications/spiff/spiff: -4.31% (0.8418 => 0.8055, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.30% (0.2933 => 0.2807, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -4.29% (0.4524 => 0.4330, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -4.23% (5.0226 => 4.8099, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.88% (0.3323 => 0.3194, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.66% (0.9077 => 0.8745, std.dev.: 0.0085) SingleSource/UnitTests/ObjC++/Hello: -3.59% (0.6347 => 0.6119, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference-object: -3.45% (0.6441 => 0.6219, std.dev.: 0.0039) MultiSource/Applications/hbd/hbd: -3.38% (1.5610 => 1.5083, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: -3.28% (0.7779 => 0.7524, std.dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -2.49% (20.7746 => 20.2570, std.dev.: 0.0290) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7578, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1728, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.74% (2.2633 => 2.1786, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.57% (1.3096 => 1.2760, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.63% (6.5735 => 6.4666, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 4 18:37:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 4 Nov 2012 20:37:16 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121105023716.48D4E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5585?compare_to=5582&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5585, Order: 167376, Start Time: 2012-11-04 23:21:44, End Time: 2012-11-05 02:37:21 To: 5582, Order: 167374, Start Time: 2012-11-04 19:16:59, End Time: 2012-11-04 22:33:22 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (171 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (717 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 8.90% (120.1074 => 130.8028, std.dev.: 0.6090) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.12% (0.3777 => 0.3895, std.dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.32% (0.0625 => 0.0877, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.27% (0.1063 => 0.1406, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.77% (0.1106 => 0.1391, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.77% (0.2969 => 0.3734, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.23% (0.0714 => 0.0887, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.18% (0.4139 => 0.5140, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.83% (0.5900 => 0.7306, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 23.74% (1.5932 => 1.9715, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.58% (0.0547 => 0.0676, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.47% (0.4253 => 0.5251, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.74% (0.0475 => 0.0583, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.73% (0.4994 => 0.6129, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.44% (0.5000 => 0.6122, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.26% (0.0584 => 0.0714, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.85% (0.0897 => 0.1093, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.54% (0.1620 => 0.1969, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.25% (0.1021 => 0.1238, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 21.20% (0.0599 => 0.0726, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.14% (0.1107 => 0.1341, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.38% (0.0633 => 0.0762, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 20.25% (0.0948 => 0.1140, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.09% (0.0642 => 0.0771, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.09% (0.3903 => 0.4687, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.08% (0.1549 => 0.1860, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.03% (0.0584 => 0.0701, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 20.03% (0.0604 => 0.0725, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.95% (0.1103 => 0.1323, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 19.85% (0.0821 => 0.0984, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 19.77% (0.1619 => 0.1939, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.71% (0.0822 => 0.0984, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.70% (0.1604 => 0.1920, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.44% (0.1003 => 0.1198, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.51% (0.0605 => 0.0717, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 18.48% (0.0947 => 0.1122, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 18.11% (0.5826 => 0.6881, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.99% (0.1462 => 0.1725, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.92% (0.3890 => 0.4587, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.87% (0.2014 => 0.2374, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 17.82% (0.0808 => 0.0952, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 17.82% (0.1218 => 0.1435, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 17.78% (0.5889 => 0.6936, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 17.48% (0.1505 => 0.1768, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.47% (1.3152 => 1.5449, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/mst/mst: 17.34% (0.0698 => 0.0819, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.32% (0.2736 => 0.3210, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 17.30% (0.4029 => 0.4726, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.28% (0.1088 => 0.1276, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.13% (0.2866 => 0.3357, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.70% (3.5627 => 4.1578, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: 16.55% (0.5546 => 0.6464, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.47% (0.1160 => 0.1351, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 16.44% (1.8794 => 2.1884, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.23% (1.6211 => 1.8842, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.11% (0.1968 => 0.2285, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.08% (0.5026 => 0.5834, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 15.99% (0.4658 => 0.5403, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.83% (0.2875 => 0.3330, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 15.80% (0.7171 => 0.8304, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.77% (0.3271 => 0.3787, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 15.76% (0.1421 => 0.1645, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 15.65% (0.1284 => 0.1485, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 15.63% (0.9697 => 1.1213, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.59% (0.4361 => 0.5041, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 15.38% (0.2725 => 0.3144, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.37% (4.4195 => 5.0989, std.dev.: 0.0088) MultiSource/Applications/d/make_dparser: 15.37% (1.0781 => 1.2438, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.27% (2.7292 => 3.1459, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hello: 15.25% (0.2714 => 0.3128, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.19% (1.9694 => 2.2685, std.dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 15.18% (0.3004 => 0.3460, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.17% (0.3930 => 0.4526, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.09% (1.9966 => 2.2978, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.08% (0.2738 => 0.3151, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 15.05% (0.2823 => 0.3248, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 15.04% (0.2813 => 0.3236, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.02% (0.2729 => 0.3139, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 15.02% (0.2750 => 0.3163, std.dev.: 0.0035) MultiSource/Applications/ClamAV/clamscan: 14.98% (4.2109 => 4.8419, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 14.93% (0.2780 => 0.3195, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.90% (0.3195 => 0.3671, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 14.83% (0.9909 => 1.1379, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 14.81% (0.2803 => 0.3218, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.79% (0.2792 => 0.3205, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 14.73% (0.2811 => 0.3225, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.71% (2.0673 => 2.3714, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.70% (0.2911 => 0.3339, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 14.60% (23.5202 => 26.9542, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/wc: 14.60% (0.3096 => 0.3548, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.40% (0.1090 => 0.1247, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.33% (0.3488 => 0.3988, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 14.26% (0.3267 => 0.3733, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 14.26% (0.3465 => 0.3959, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-2: 14.25% (0.3446 => 0.3937, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 14.22% (0.3496 => 0.3993, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 14.21% (0.3442 => 0.3931, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 14.13% (0.3460 => 0.3949, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.13% (0.3469 => 0.3959, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 14.08% (0.3317 => 0.3784, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 14.06% (0.3258 => 0.3716, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.02% (0.3060 => 0.3489, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.96% (0.3124 => 0.3560, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.95% (0.3362 => 0.3831, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.78% (0.3650 => 0.4153, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 13.77% (1.4269 => 1.6234, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: 13.72% (0.3643 => 0.4143, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 13.70% (0.3678 => 0.4182, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 13.67% (0.3724 => 0.4233, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 13.58% (0.4146 => 0.4709, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 13.54% (0.2075 => 0.2356, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.52% (0.3845 => 0.4365, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 13.48% (0.2566 => 0.2912, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 13.47% (0.3348 => 0.3799, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 13.38% (0.7875 => 0.8929, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.38% (0.3282 => 0.3721, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.35% (0.3625 => 0.4109, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sieve: 13.29% (0.3726 => 0.4221, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 13.26% (0.3477 => 0.3938, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 13.06% (0.4251 => 0.4806, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.04% (0.3981 => 0.4500, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.93% (0.3690 => 0.4167, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 12.78% (2.1653 => 2.4420, std.dev.: 0.0101) MultiSource/Applications/JM/lencod/lencod: 12.73% (4.6177 => 5.2056, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 12.40% (2.1013 => 2.3619, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/bigfib: 12.31% (0.5012 => 0.5629, std.dev.: 0.0151) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.96% (0.2040 => 0.2284, std.dev.: 0.0021) MultiSource/Applications/SIBsim4/SIBsim4: 11.45% (0.2691 => 0.2999, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11.14% (5.5417 => 6.1589, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.89% (0.6435 => 0.7136, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.41% (0.1383 => 0.1527, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.41% (0.1028 => 0.1135, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 10.35% (0.3498 => 0.3860, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.23% (0.2737 => 0.3017, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.11% (0.2068 => 0.2277, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 10.07% (0.4847 => 0.5335, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 9.84% (0.6634 => 0.7287, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.79% (0.3084 => 0.3386, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 9.62% (0.3336 => 0.3657, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.08% (0.2103 => 0.2294, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 8.82% (0.2391 => 0.2602, std.dev.: 0.0069) MultiSource/Applications/sqlite3/sqlite3: 8.74% (2.0346 => 2.2125, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.35% (4.6926 => 5.0843, std.dev.: 0.0136) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.21% (11.6398 => 12.5954, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.70% (0.5361 => 0.5774, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.09% (0.5584 => 0.5980, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.92% (0.7426 => 0.7940, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 6.13% (11.9555 => 12.6887, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.93% (0.3792 => 0.3979, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6531, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.27% (0.5917 => 0.6702, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 8.07% (0.2802 => 0.3028, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary: 7.26% (0.2122 => 0.2276, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6099, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.47% (0.3693 => 0.3895, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.03% (12.0509 => 12.6566, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1724, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-2: 3.90% (1.8057 => 1.8761, std.dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/dry: 2.59% (14.0481 => 14.4126, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2035, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.79% (3.1722 => 3.2289, std.dev.: 0.0035) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3073, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2866, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.23% (1.0142 => 1.0267, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5142, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.02% (50.0626 => 50.5742, std.dev.: 0.0154) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.87% (2.4764 => 2.4300, std.dev.: 0.0108) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.59% (25.4195 => 16.3727, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/ary2: -9.95% (0.2402 => 0.2163, std.dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9750, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -7.66% (35.5013 => 32.7817, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.16% (0.6293 => 0.6094, std.dev.: 0.0067) SingleSource/UnitTests/Vector/build2: -3.15% (11.2080 => 10.8553, std.dev.: 0.0104) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7744, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5218, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: -2.35% (17.2379 => 16.8336, std.dev.: 0.0050) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.20% (41.7953 => 40.8743, std.dev.: 0.0313) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5787, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4951, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7160, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.21% (21.9346 => 21.6690, std.dev.: 0.0660) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.2048, std.dev.: 0.0932) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0412, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.07% (3.3991 => 3.3627, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 4 20:48:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 4 Nov 2012 22:48:21 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121105044821.613AF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5586?compare_to=5583&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5586, Order: 167378, Start Time: 2012-11-05 03:21:51, End Time: 2012-11-05 04:48:28 To: 5583, Order: 167377, Start Time: 2012-11-05 00:38:25, End Time: 2012-11-05 02:05:54 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 9 (45 on baseline) Performance Improvements: 10 (7 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 972 (922 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 20.96% (1.5627 => 1.8903, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.86% (0.3159 => 0.3502, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.40% (3.0725 => 3.2078, std.dev.: 0.0456) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.17% (21.5453 => 22.2277, std.dev.: 0.2214) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.51% (59.7589 => 60.6609, std.dev.: 0.3032) MultiSource/Applications/spiff/spiff: 1.49% (2.8519 => 2.8943, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (1.1206 => 1.1365, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: 1.39% (1.3055 => 1.3237, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/pi: 1.33% (2.4697 => 2.5026, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.14% (0.9205 => 0.8824, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -3.98% (0.6277 => 0.6027, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.89% (0.6408 => 0.6223, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.34% (0.9827 => 0.9597, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.08% (5.3875 => 5.2755, std.dev.: 0.0223) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -1.76% (0.6006 => 0.5900, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.59% (1.3677 => 1.3460, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.34% (0.8655 => 0.8539, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.16% (0.8776 => 0.8674, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -6.84% (22.5566 => 21.0139, std.dev.: 0.5423) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.12% (16.6448 => 16.6243, std.dev.: 0.0429) MultiSource/Applications/obsequi/Obsequi: -2.36% (1.0700 => 1.0448, std.dev.: 0.0125) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.08% (21.4657 => 21.4831, std.dev.: 0.2336) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.19% (0.3634 => 0.3641, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -0.22% (0.6020 => 0.6007, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.72% (0.3313 => 0.3370, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 1.00% (0.1992 => 0.2012, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 9.50% (0.0200 => 0.0219, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 17.71% (0.0350 => 0.0412, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -5.92% (0.0304 => 0.0286, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -12.50% (0.0312 => 0.0273, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.48% (0.0420 => 0.0418, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: -8.42% (0.0202 => 0.0185, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: -5.53% (0.0217 => 0.0205, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.74% (0.1479 => 0.1468, std.dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 1.46% (1.1238 => 1.1402, std.dev.: 0.0119) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000) MultiSource/Applications/oggenc/oggenc: 1.79% (0.1454 => 0.1480, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.22% (0.4007 => 0.4056, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.97% (0.1279 => 0.1381, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.81% (0.0605 => 0.0622, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -33.57% (0.0277 => 0.0184, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.83% (0.0546 => 0.0556, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.06% (1.1478 => 1.1471, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.45% (0.0582 => 0.0637, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 30.85% (0.0188 => 0.0246, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.88% (0.7941 => 0.8011, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -66.67% (0.0003 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -29.87% (0.0077 => 0.0054, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2308.92% (0.6332 => 15.2533, std.dev.: 0.1064) MultiSource/Benchmarks/McCat/08-main/main: 46.59% (0.1831 => 0.2684, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.38% (0.1559 => 0.1444, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1477.60% (0.3344 => 5.2755, std.dev.: 0.0223) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.17% (0.2364 => 0.3219, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: 2.80% (0.0429 => 0.0441, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.91% (0.0224 => 0.0235, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0009) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3252, std.dev.: 0.0090) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0700, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4952, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3405, std.dev.: 0.0141) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0395, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4085, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: -24.34% (2.1832 => 1.6518, std.dev.: 0.0237) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.20% (0.0810 => 0.0925, std.dev.: 0.0026) MultiSource/Applications/viterbi/viterbi: 6.47% (0.1577 => 0.1679, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.04% (0.8321 => 0.8824, std.dev.: 0.0078) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.19% (0.1983 => 0.2086, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.18% (0.2279 => 0.2397, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.54% (0.6010 => 0.6223, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.47% (1.4479 => 1.4837, std.dev.: 0.0057) MultiSource/Applications/siod/siod: 2.29% (2.2184 => 2.2691, std.dev.: 0.0102) MultiSource/Applications/JM/ldecod/ldecod: 1.83% (6.7320 => 6.8549, std.dev.: 0.0274) MultiSource/Applications/JM/lencod/lencod: 1.76% (15.3280 => 15.5971, std.dev.: 0.0881) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.74% (6.6074 => 6.7221, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.70% (0.8007 => 0.8143, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 1.64% (14.2605 => 14.4948, std.dev.: 0.0839) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.61% (0.8697 => 0.8837, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.53% (0.8286 => 0.8413, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.51% (0.8204 => 0.8328, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 1.44% (1.1271 => 1.1433, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.42% (4.1763 => 4.2354, std.dev.: 0.0181) MultiSource/Applications/oggenc/oggenc: 1.37% (4.9628 => 5.0310, std.dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.36% (1.3279 => 1.3460, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.30% (0.8716 => 0.8829, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.28% (0.9074 => 0.9190, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: 1.26% (1.0945 => 1.1083, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.26% (0.8359 => 0.8464, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.16% (0.9039 => 0.9144, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.07% (2.1401 => 2.1631, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 64.82% (0.0199 => 0.0328, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/pi: 58.44% (1.5795 => 2.5026, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.50% (14.6451 => 16.6224, std.dev.: 0.5992) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.92% (0.3186 => 0.3502, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 8.51% (3.1873 => 3.4584, std.dev.: 0.0209) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.09% (1.1857 => 1.2816, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.12% (3.0515 => 3.2078, std.dev.: 0.0456) MultiSource/Applications/hexxagon/hexxagon: 4.89% (14.0064 => 14.6915, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/ReedSolomon: 2.88% (8.5322 => 8.7781, std.dev.: 0.0314) MultiSource/Benchmarks/sim/sim: 2.79% (3.8206 => 3.9272, std.dev.: 0.0114) MultiSource/Applications/siod/siod: 2.61% (3.6643 => 3.7598, std.dev.: 0.0323) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.36% (59.2638 => 60.6609, std.dev.: 0.3032) MultiSource/Benchmarks/mafft/pairlocalalign: 2.20% (63.1822 => 64.5722, std.dev.: 0.1284) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.73% (28.5821 => 29.0777, std.dev.: 0.0152) MultiSource/Benchmarks/Olden/bh/bh: 1.54% (2.3560 => 2.3924, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/richards_benchmark: 1.53% (1.3037 => 1.3237, std.dev.: 0.0039) MultiSource/Applications/spiff/spiff: 1.34% (2.8561 => 2.8943, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.18% (2.4647 => 2.4937, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/neural/neural: 1.03% (1.0841 => 1.0953, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.90% (0.3269 => 0.2978, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.32% (2.8773 => 2.7530, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout/lists: -3.70% (7.3375 => 7.0657, std.dev.: 0.0212) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.96% (1.2822 => 1.2443, std.dev.: 0.0128) MultiSource/Applications/lua/lua: -2.41% (29.8330 => 29.1128, std.dev.: 0.0870) SingleSource/Benchmarks/Shootout-C++/hash2: -1.48% (3.4237 => 3.3731, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.26% (3.3479 => 3.3057, std.dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.08% (16.4461 => 16.6243, std.dev.: 0.0429) MultiSource/Applications/obsequi/Obsequi: 1.81% (1.0262 => 1.0448, std.dev.: 0.0125) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6778.99% (0.3123 => 21.4831, std.dev.: 0.2336) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.83% (0.2463 => 0.3641, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -0.05% (0.6010 => 0.6007, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.18% (0.3266 => 0.3370, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 2.18% (0.1969 => 0.2012, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.98% (0.0408 => 0.0412, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 12.60% (0.0254 => 0.0286, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -9.60% (0.0302 => 0.0273, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.85% (0.0384 => 0.0418, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: -2.63% (0.0190 => 0.0185, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: 13.89% (0.0180 => 0.0205, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.09% (0.1438 => 0.1468, std.dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.64% (1.1329 => 1.1402, std.dev.: 0.0119) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 1.23% (0.1462 => 0.1480, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.59% (0.4164 => 0.4056, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.88% (0.1369 => 0.1381, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.96% (0.0641 => 0.0622, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.64% (0.0195 => 0.0184, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.81% (0.0578 => 0.0556, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.30% (1.1437 => 1.1471, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.59% (0.0627 => 0.0637, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 36.67% (0.0180 => 0.0246, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.07% (0.8017 => 0.8011, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -12.90% (0.0062 => 0.0054, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 4 20:52:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 4 Nov 2012 22:52:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121105045241.466E52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5587?compare_to=5584&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5587, Order: 167378, Start Time: 2012-11-05 03:27:40, End Time: 2012-11-05 04:52:47 To: 5584, Order: 167377, Start Time: 2012-11-05 00:43:34, End Time: 2012-11-05 02:08:44 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (177 on baseline) Unchanged Tests: 1041 (860 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.88% (29.2047 => 29.7539, std.dev.: 0.0645) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.25% (1.2783 => 1.3710, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.42% (54.5751 => 56.4414, std.dev.: 0.1342) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1006, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.4937 => 7.6826, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/hash2: 2.28% (3.1932 => 3.2661, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.01% (0.3821 => 0.3515, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: -7.14% (2.4924 => 2.3145, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.58% (22.4056 => 20.9324, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.43% (0.2428 => 0.2272, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -6.40% (0.3357 => 0.3142, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.40% (3.5339 => 3.3077, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.29% (0.3658 => 0.3428, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.17% (0.9542 => 0.8953, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -6.11% (16.1920 => 15.2022, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -6.09% (7.0961 => 6.6641, std.dev.: 0.0085) MultiSource/Benchmarks/mafft/pairlocalalign: -6.08% (9.2283 => 8.6672, std.dev.: 0.0126) MultiSource/Applications/lemon/lemon: -5.97% (1.1450 => 1.0766, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: -5.96% (0.9179 => 0.8632, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.95% (0.6484 => 0.6098, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.95% (0.9852 => 0.9266, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/gs/gs: -5.95% (4.3330 => 4.0753, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.94% (1.0544 => 0.9918, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -5.91% (0.1761 => 0.1657, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.89% (0.1716 => 0.1615, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.84% (0.5857 => 0.5515, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.83% (1.2784 => 1.2039, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.81% (0.7919 => 0.7459, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.80% (1.4642 => 1.3793, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.77% (1.3722 => 1.2930, std.dev.: 0.0088) MultiSource/Applications/Burg/burg: -5.76% (1.2515 => 1.1794, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.74% (1.6474 => 1.5528, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.71% (0.2695 => 0.2541, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -5.70% (17.1032 => 16.1287, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.65% (0.2548 => 0.2404, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.65% (0.6304 => 0.5948, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.64% (0.6293 => 0.5938, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.64% (0.7339 => 0.6925, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.64% (4.0323 => 3.8049, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.62% (0.5802 => 0.5476, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.62% (0.6230 => 0.5880, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.61% (0.2355 => 0.2223, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.60% (0.5925 => 0.5593, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.60% (4.5069 => 4.2545, std.dev.: 0.0028) MultiSource/Applications/siod/siod: -5.59% (2.4021 => 2.2678, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.58% (0.6681 => 0.6308, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.58% (0.6667 => 0.6295, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.58% (0.3406 => 0.3216, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -5.58% (1.1530 => 1.0887, std.dev.: 0.0123) MultiSource/Benchmarks/McCat/08-main/main: -5.57% (0.2659 => 0.2511, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.56% (1.2300 => 1.1616, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.56% (14.2083 => 13.4182, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.56% (0.5575 => 0.5265, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.55% (0.6446 => 0.6088, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.55% (0.6052 => 0.5716, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.55% (5.4682 => 5.1647, std.dev.: 0.0235) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.54% (0.6260 => 0.5913, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.54% (0.6297 => 0.5948, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.54% (0.3483 => 0.3290, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.53% (0.7524 => 0.7108, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.53% (0.5591 => 0.5282, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.52% (4.8161 => 4.5501, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.51% (0.5478 => 0.5176, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.50% (0.5941 => 0.5614, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.50% (4.8802 => 4.6116, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.46% (0.6736 => 0.6368, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.46% (0.5859 => 0.5539, std.dev.: 0.0007) MultiSource/Applications/lua/lua: -5.46% (4.0594 => 3.8379, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.45% (0.5705 => 0.5394, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.45% (1.6364 => 1.5472, std.dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: -5.45% (15.5079 => 14.6634, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.44% (0.6395 => 0.6047, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.44% (0.5863 => 0.5544, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.44% (0.5849 => 0.5531, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -5.43% (0.2985 => 0.2823, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.41% (0.7021 => 0.6641, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.41% (0.5581 => 0.5279, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: -5.40% (0.7447 => 0.7045, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.40% (0.6189 => 0.5855, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.39% (0.5456 => 0.5162, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.39% (6.7716 => 6.4069, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.37% (0.6033 => 0.5709, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.37% (0.5570 => 0.5271, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.37% (2.2587 => 2.1375, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.36% (0.6194 => 0.5862, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -5.36% (1.3864 => 1.3121, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.36% (0.6440 => 0.6095, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.35% (0.6660 => 0.6304, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.32% (0.6395 => 0.6055, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.29% (0.5805 => 0.5498, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.28% (0.4151 => 0.3932, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/18-imp/imp: -5.25% (0.3581 => 0.3393, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.25% (0.5567 => 0.5275, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.24% (0.6676 => 0.6326, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.22% (0.5999 => 0.5686, std.dev.: 0.0022) MultiSource/Applications/d/make_dparser: -5.21% (3.5154 => 3.3321, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.19% (0.5569 => 0.5280, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/exceptions-4: -5.18% (0.3880 => 0.3679, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.18% (0.5329 => 0.5053, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -5.17% (0.4176 => 0.3960, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -5.17% (0.3812 => 0.3615, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.17% (0.3891 => 0.3690, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -5.16% (0.4033 => 0.3825, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.15% (0.3848 => 0.3650, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -5.14% (0.4861 => 0.4611, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.13% (0.8521 => 0.8084, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/synchronized: -5.08% (0.3896 => 0.3698, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -5.06% (2.1401 => 2.0319, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.05% (0.3884 => 0.3688, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.05% (0.5688 => 0.5401, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.02% (0.4916 => 0.4669, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -5.00% (34.0927 => 32.3878, std.dev.: 0.0140) MultiSource/Applications/lambda-0_1_3/lambda: -4.99% (0.7982 => 0.7584, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -4.99% (0.3831 => 0.3640, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/05-eks/eks: -4.98% (0.4515 => 0.4290, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.97% (0.9557 => 0.9082, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.97% (0.2999 => 0.2850, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.96% (0.3849 => 0.3658, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.95% (0.3837 => 0.3647, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -4.93% (0.4199 => 0.3992, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -4.92% (15.2527 => 14.5021, std.dev.: 0.0107) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.92% (0.2278 => 0.2166, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.91% (0.5168 => 0.4914, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.91% (8.0126 => 7.6191, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.91% (0.3931 => 0.3738, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: -4.88% (1.3148 => 1.2506, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: -4.88% (18.2933 => 17.4010, std.dev.: 0.0113) SingleSource/UnitTests/ObjC/parameter-passing: -4.86% (0.4280 => 0.4072, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.83% (1.2210 => 1.1620, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.82% (0.7198 => 0.6851, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.81% (1.2221 => 1.1633, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -4.77% (0.6750 => 0.6428, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -4.76% (0.3025 => 0.2881, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -4.70% (0.3255 => 0.3102, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.70% (0.3491 => 0.3327, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -4.70% (0.3194 => 0.3044, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -4.68% (0.4248 => 0.4049, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.67% (2.1713 => 2.0699, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.66% (0.3323 => 0.3168, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.61% (0.3057 => 0.2916, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.61% (0.3016 => 0.2877, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.61% (0.4427 => 0.4223, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.60% (0.4083 => 0.3895, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -4.60% (0.3867 => 0.3689, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -4.59% (0.3026 => 0.2887, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.58% (0.3319 => 0.3167, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.57% (0.4813 => 0.4593, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary3: -4.56% (0.3446 => 0.3289, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: -4.56% (0.3271 => 0.3122, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: -4.53% (0.2939 => 0.2806, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -4.52% (0.2989 => 0.2854, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.49% (0.2871 => 0.2742, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.48% (0.3059 => 0.2922, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.47% (0.2933 => 0.2802, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -4.45% (0.3481 => 0.3326, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.44% (0.2385 => 0.2279, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.43% (0.3252 => 0.3108, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -4.42% (0.2849 => 0.2723, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/lists: -4.39% (0.3621 => 0.3462, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: -4.38% (0.3788 => 0.3622, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.37% (0.2903 => 0.2776, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: -4.37% (0.3205 => 0.3065, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -4.27% (5.0226 => 4.8082, std.dev.: 0.0043) MultiSource/Applications/spiff/spiff: -4.24% (0.8418 => 0.8061, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: -4.20% (0.4524 => 0.4334, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.14% (0.4321 => 0.4142, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.65% (0.9077 => 0.8746, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -3.62% (0.6347 => 0.6117, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -3.46% (0.7779 => 0.7510, std.dev.: 0.0068) SingleSource/UnitTests/ObjC++/property-reference-object: -3.43% (0.6441 => 0.6220, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.43% (1.5610 => 1.5075, std.dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -2.59% (20.7746 => 20.2364, std.dev.: 0.0343) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7534, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1732, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.89% (2.2633 => 2.1752, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4690, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0003) Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 4 22:41:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 5 Nov 2012 00:41:10 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121105064110.ECBFA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5588?compare_to=5585&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5588, Order: 167377, Start Time: 2012-11-05 03:25:33, End Time: 2012-11-05 06:41:17 To: 5585, Order: 167376, Start Time: 2012-11-04 23:21:44, End Time: 2012-11-05 02:37:21 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (171 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (718 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/UnitTests/ObjC/synchronized: 17.85% (0.1053 => 0.1241, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 5.55% (0.2163 => 0.2283, std.dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.16% (0.0625 => 0.0876, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.42% (0.1063 => 0.1397, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.56% (0.2969 => 0.3728, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.23% (0.1106 => 0.1385, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.23% (0.0714 => 0.0887, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.11% (0.4139 => 0.5137, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.61% (0.4253 => 0.5257, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 23.55% (1.5932 => 1.9684, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.53% (0.5900 => 0.7288, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.93% (0.4994 => 0.6139, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.85% (0.0547 => 0.0672, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.50% (0.5000 => 0.6125, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.26% (0.0584 => 0.0714, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 21.54% (0.0599 => 0.0728, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.48% (0.1620 => 0.1968, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.45% (0.1021 => 0.1240, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.23% (0.1107 => 0.1342, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 20.96% (0.0897 => 0.1085, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 20.86% (0.0604 => 0.0730, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.38% (0.0633 => 0.0762, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.07% (0.1604 => 0.1926, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 20.04% (0.0948 => 0.1138, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.03% (0.0584 => 0.0701, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.94% (0.0642 => 0.0770, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.85% (0.1103 => 0.1322, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 19.83% (0.1619 => 0.1940, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.68% (0.3903 => 0.4671, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 19.61% (0.0821 => 0.0982, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.59% (0.0822 => 0.0983, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.44% (0.1003 => 0.1198, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.43% (0.1549 => 0.1850, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 18.59% (0.0947 => 0.1123, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.40% (0.1462 => 0.1731, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 18.21% (0.5826 => 0.6887, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 18.07% (0.0808 => 0.0954, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 17.91% (0.5889 => 0.6944, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.84% (0.3890 => 0.4584, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 17.73% (0.1218 => 0.1434, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.73% (0.2014 => 0.2371, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 17.67% (0.4029 => 0.4741, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 17.54% (0.1505 => 0.1769, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.34% (1.3152 => 1.5433, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.32% (0.2736 => 0.3210, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.19% (0.1088 => 0.1275, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.17% (0.2866 => 0.3358, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/mst/mst: 17.05% (0.0698 => 0.0817, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.75% (3.5627 => 4.1595, std.dev.: 0.0048) MultiSource/Applications/Burg/burg: 16.61% (0.5546 => 0.6467, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 16.48% (1.8794 => 2.1892, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.47% (0.5026 => 0.5854, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.47% (0.1160 => 0.1351, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.25% (1.6211 => 1.8846, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.17% (0.4658 => 0.5411, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.96% (0.1968 => 0.2282, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.93% (0.3271 => 0.3792, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.84% (0.4361 => 0.5052, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 15.84% (0.7171 => 0.8307, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/18-imp/imp: 15.83% (0.1421 => 0.1646, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.83% (0.2875 => 0.3330, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 15.55% (0.9697 => 1.1205, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: 15.48% (1.0781 => 1.2450, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/fibo: 15.41% (0.2725 => 0.3145, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.36% (0.2911 => 0.3358, std.dev.: 0.0073) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.29% (2.7292 => 3.1465, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/bh/bh: 15.26% (0.1284 => 0.1480, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.23% (0.2738 => 0.3155, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.23% (4.4195 => 5.0925, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hello: 15.22% (0.2714 => 0.3127, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 15.09% (0.2750 => 0.3165, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.09% (0.3930 => 0.4523, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 15.04% (0.2813 => 0.3236, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 15.02% (0.2823 => 0.3247, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 15.01% (0.3004 => 0.3455, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 14.99% (0.2729 => 0.3138, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.94% (1.9694 => 2.2637, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.93% (1.9966 => 2.2947, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.93% (0.3195 => 0.3672, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 14.93% (0.2780 => 0.3195, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 14.93% (4.2109 => 4.8394, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.86% (2.0673 => 2.3745, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/random: 14.81% (0.2803 => 0.3218, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 14.76% (0.2811 => 0.3226, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.76% (0.2792 => 0.3204, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 14.74% (23.5202 => 26.9871, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/wc: 14.70% (0.3096 => 0.3551, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 14.67% (0.9909 => 1.1363, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.40% (0.1090 => 0.1247, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.31% (0.3488 => 0.3987, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-4: 14.29% (0.3465 => 0.3960, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 14.28% (0.3446 => 0.3938, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 14.26% (0.3267 => 0.3733, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 14.24% (0.3496 => 0.3994, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/synchronized: 14.18% (0.3469 => 0.3961, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 14.18% (0.3442 => 0.3930, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 14.17% (0.3317 => 0.3787, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 14.10% (0.3460 => 0.3948, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.10% (0.3845 => 0.4387, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 14.06% (0.3258 => 0.3716, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.89% (0.3362 => 0.3829, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.89% (0.3060 => 0.3485, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 13.88% (0.2075 => 0.2363, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 13.81% (0.3650 => 0.4154, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 13.78% (0.3643 => 0.4145, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/moments: 13.70% (0.3678 => 0.4182, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.70% (0.3124 => 0.3552, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.69% (0.3724 => 0.4234, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 13.65% (1.4269 => 1.6217, std.dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 13.64% (0.2566 => 0.2916, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 13.63% (0.4146 => 0.4711, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.50% (0.3282 => 0.3725, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 13.41% (0.3348 => 0.3797, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.38% (0.3625 => 0.4110, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/sieve: 13.31% (0.3726 => 0.4222, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 13.17% (0.3477 => 0.3935, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 13.16% (0.7875 => 0.8911, std.dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 13.11% (2.1653 => 2.4492, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 13.03% (0.4251 => 0.4805, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.96% (0.3981 => 0.4497, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.93% (0.3690 => 0.4167, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 12.63% (4.6177 => 5.2010, std.dev.: 0.0135) MultiSource/Benchmarks/mafft/pairlocalalign: 12.47% (2.1013 => 2.3633, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 12.25% (0.5012 => 0.5626, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 12.04% (0.2691 => 0.3015, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.00% (0.1383 => 0.1549, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.91% (0.2040 => 0.2283, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11.21% (5.5417 => 6.1630, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.05% (0.6435 => 0.7146, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 10.57% (0.6634 => 0.7335, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.51% (0.1028 => 0.1136, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 10.29% (0.3498 => 0.3858, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.25% (0.2068 => 0.2280, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.23% (0.2737 => 0.3017, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 10.13% (0.4847 => 0.5338, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.76% (0.3084 => 0.3385, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 9.68% (0.3336 => 0.3659, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.13% (0.2103 => 0.2295, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 8.95% (2.0346 => 2.2167, std.dev.: 0.0024) MultiSource/Applications/lemon/lemon: 8.91% (0.2391 => 0.2604, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.45% (4.6926 => 5.0893, std.dev.: 0.0109) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.23% (11.6398 => 12.5979, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.91% (0.5361 => 0.5785, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.06% (0.7426 => 0.7950, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.04% (0.5584 => 0.5977, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 6.22% (11.9555 => 12.6988, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.88% (0.3792 => 0.3977, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6530, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 17.74% (0.1054 => 0.1241, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.22% (0.5917 => 0.6699, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 8.32% (0.2802 => 0.3035, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6108, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 5.47% (0.2122 => 0.2238, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/objinst: 4.99% (12.0509 => 12.6519, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1673, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-2: 3.95% (1.8057 => 1.8770, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.30% (0.3693 => 0.3815, std.dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: 2.55% (14.0481 => 14.4069, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: 2.00% (15.8721 => 16.1895, std.dev.: 0.0085) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.88% (3.1722 => 3.2319, std.dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3086, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2878, std.dev.: 0.0034) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.07% (1.2451 => 1.2584, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5829, std.dev.: 0.0121) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.61% (25.4195 => 16.3681, std.dev.: 0.0142) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9750, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7838, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: -4.95% (0.2402 => 0.2283, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.43% (11.2080 => 10.8238, std.dev.: 0.0656) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7730, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5218, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.56% (17.2379 => 16.7969, std.dev.: 0.0400) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.22% (0.6293 => 0.6153, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.20% (41.7953 => 40.8774, std.dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5759, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4970, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.37% (21.9346 => 21.6331, std.dev.: 0.0827) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.2065, std.dev.: 0.0241) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.09% (3.3991 => 3.3619, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0421, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 4 23:22:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 5 Nov 2012 01:22:19 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121105072219.6CE172A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5589?compare_to=5586&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5589, Order: 167379, Start Time: 2012-11-05 05:55:47, End Time: 2012-11-05 07:22:26 To: 5586, Order: 167378, Start Time: 2012-11-05 03:21:51, End Time: 2012-11-05 04:48:28 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 17 (75 on baseline) Performance Improvements: 2 (7 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 972 (892 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.37% (0.1255 => 0.1360, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 6.47% (0.3076 => 0.3275, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.29% (0.6223 => 0.6552, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.77% (0.4882 => 0.5115, std.dev.: 0.0079) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.49% (0.4781 => 0.4948, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.15% (0.8372 => 0.8636, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.70% (1.1875 => 1.2196, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.47% (0.6027 => 0.6176, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.99% (0.8025 => 0.8185, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.89% (0.9597 => 0.9778, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.86% (4.5142 => 4.5980, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/football/football: 1.74% (0.8775 => 0.8928, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.20% (4.5990 => 4.6540, std.dev.: 0.0168) MultiSource/Applications/treecc/treecc: 1.16% (2.0052 => 2.0285, std.dev.: 0.0048) MultiSource/Applications/Burg/burg: 1.01% (1.2500 => 1.2626, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 11.82% (0.1988 => 0.2223, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.37% (2.4085 => 2.4415, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/spiff/spiff: -1.50% (2.8943 => 2.8509, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.26% (60.6609 => 59.8937, std.dev.: 0.1010) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.05% (16.6243 => 16.6334, std.dev.: 0.2109) MultiSource/Applications/obsequi/Obsequi: 1.67% (1.0448 => 1.0623, std.dev.: 0.0069) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.19% (21.4831 => 21.5239, std.dev.: 0.1689) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.30% (0.3641 => 0.3652, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 0.97% (0.6007 => 0.6065, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: -1.01% (0.3370 => 0.3336, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/strcat: 0.30% (0.2012 => 0.2018, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.91% (0.0219 => 0.0217, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.67% (0.0412 => 0.0423, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 15.38% (0.0286 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 14.29% (0.0273 => 0.0312, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.72% (0.0418 => 0.0421, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 9.19% (0.0185 => 0.0202, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 5.37% (0.0205 => 0.0216, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.61% (0.1468 => 0.1477, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -2.89% (1.1402 => 1.1073, std.dev.: 0.0232) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.26% (0.1480 => 0.1417, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.10% (0.4056 => 0.4052, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.77% (0.1381 => 0.1329, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.91% (0.0622 => 0.0579, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.52% (0.0184 => 0.0196, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.22% (0.0556 => 0.0585, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.03% (1.1471 => 1.1474, std.dev.: 0.0492) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -25.93% (0.0027 => 0.0020, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.79% (0.0637 => 0.0581, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -23.98% (0.0246 => 0.0187, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.12% (0.8011 => 0.8021, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -9.26% (0.0054 => 0.0049, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2289.89% (0.6332 => 15.1328, std.dev.: 0.1744) MultiSource/Benchmarks/McCat/08-main/main: 49.70% (0.1831 => 0.2741, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.74% (0.1559 => 0.1454, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1486.93% (0.3344 => 5.3067, std.dev.: 0.0776) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.65% (0.2364 => 0.3254, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: 2.10% (0.0429 => 0.0438, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.46% (0.0224 => 0.0234, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3229, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0735, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4923, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3438, std.dev.: 0.0178) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0287, std.dev.: 0.0187) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4081, std.dev.: 0.0188) SingleSource/Regression/C/uint64_to_float: -23.88% (2.1832 => 1.6619, std.dev.: 0.0022) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.80% (0.0810 => 0.0938, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 13.49% (0.1112 => 0.1262, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.89% (0.0830 => 0.0937, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.91% (0.0848 => 0.0949, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.02% (0.6010 => 0.6552, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.51% (0.2279 => 0.2473, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.28% (0.8321 => 0.9010, std.dev.: 0.0093) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.43% (0.2180 => 0.2342, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.95% (0.1885 => 0.2016, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.80% (0.7473 => 0.7981, std.dev.: 0.0112) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.45% (0.1983 => 0.2111, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.99% (0.8148 => 0.8636, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.80% (0.3137 => 0.3319, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.53% (0.4847 => 0.5115, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.08% (1.1606 => 1.2196, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.17% (0.2519 => 0.2624, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 3.77% (0.7950 => 0.8250, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.64% (0.9435 => 0.9778, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.61% (0.5961 => 0.6176, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.45% (0.4783 => 0.4948, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.44% (1.3279 => 1.3736, std.dev.: 0.0176) MultiSource/Applications/Burg/burg: 3.31% (1.2222 => 1.2626, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.21% (1.1685 => 1.2060, std.dev.: 0.0141) MultiSource/Benchmarks/MallocBench/gs/gs: 3.00% (4.1305 => 4.2545, std.dev.: 0.0373) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.99% (0.5817 => 0.5991, std.dev.: 0.0037) MultiSource/Applications/hbd/hbd: 2.97% (1.4269 => 1.4693, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.88% (0.4127 => 0.4246, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.59% (6.6074 => 6.7786, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.56% (1.4479 => 1.4849, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.47% (4.4873 => 4.5980, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.35% (4.1763 => 4.2745, std.dev.: 0.0122) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.18% (0.6227 => 0.6363, std.dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: 2.03% (1.2568 => 1.2823, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.98% (8.6476 => 8.8186, std.dev.: 0.0469) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.91% (0.8286 => 0.8444, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 1.88% (2.2184 => 2.2602, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.83% (4.5702 => 4.6540, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/football/football: 1.82% (0.8768 => 0.8928, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 1.79% (14.7684 => 15.0328, std.dev.: 0.0292) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.78% (0.8697 => 0.8852, std.dev.: 0.0051) MultiSource/Applications/lua/lua: 1.73% (3.8189 => 3.8849, std.dev.: 0.0214) MultiSource/Applications/JM/ldecod/ldecod: 1.72% (6.7320 => 6.8476, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.70% (1.6386 => 1.6665, std.dev.: 0.0081) MultiSource/Applications/treecc/treecc: 1.69% (1.9948 => 2.0285, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.68% (0.8050 => 0.8185, std.dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 1.57% (14.2605 => 14.4851, std.dev.: 0.0143) MultiSource/Applications/JM/lencod/lencod: 1.53% (15.3280 => 15.5621, std.dev.: 0.0157) MultiSource/Applications/lambda-0_1_3/lambda: 1.46% (0.7557 => 0.7667, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.42% (13.1811 => 13.3681, std.dev.: 0.0031) MultiSource/Applications/d/make_dparser: 1.41% (3.2366 => 3.2823, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.35% (0.8597 => 0.8713, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.30% (0.8069 => 0.8174, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.28% (0.8656 => 0.8767, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.26% (0.9074 => 0.9188, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.26% (0.8204 => 0.8307, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 1.25% (31.8598 => 32.2572, std.dev.: 0.0536) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.20% (0.8317 => 0.8417, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 1.15% (0.9810 => 0.9923, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 63.82% (0.0199 => 0.0326, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/pi: 58.39% (1.5795 => 2.5017, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: 10.96% (0.0949 => 0.1053, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/nestedloop: 9.89% (0.2023 => 0.2223, std.dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: 8.23% (3.1873 => 3.4496, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.10% (1.1857 => 1.2817, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 4.79% (14.0064 => 14.6774, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/ReedSolomon: 3.70% (8.5322 => 8.8483, std.dev.: 0.0044) MultiSource/Benchmarks/sim/sim: 2.76% (3.8206 => 3.9260, std.dev.: 0.0062) MultiSource/Applications/siod/siod: 2.63% (3.6643 => 3.7607, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.32% (2.4490 => 2.5058, std.dev.: 0.0207) MultiSource/Benchmarks/mafft/pairlocalalign: 2.25% (63.1822 => 64.6066, std.dev.: 0.1769) MultiSource/Applications/lambda-0_1_3/lambda: 1.92% (7.4933 => 7.6374, std.dev.: 0.0475) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.70% (28.5821 => 29.0674, std.dev.: 0.0555) MultiSource/Benchmarks/Olden/bh/bh: 1.30% (2.3560 => 2.3867, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.10% (4.8362 => 4.8894, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.06% (59.2638 => 59.8937, std.dev.: 0.1010) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -33.73% (0.0338 => 0.0224, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.62% (0.3269 => 0.3020, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.76% (2.8773 => 2.7403, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout/lists: -3.47% (7.3375 => 7.0831, std.dev.: 0.0071) MultiSource/Applications/lua/lua: -2.51% (29.8330 => 29.0837, std.dev.: 0.1362) SingleSource/Benchmarks/Shootout-C++/hash2: -1.53% (3.4237 => 3.3714, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.25% (3.3479 => 3.3059, std.dev.: 0.0146) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.14% (16.4461 => 16.6334, std.dev.: 0.2109) MultiSource/Applications/obsequi/Obsequi: 3.52% (1.0262 => 1.0623, std.dev.: 0.0069) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6792.06% (0.3123 => 21.5239, std.dev.: 0.1689) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.27% (0.2463 => 0.3652, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 0.92% (0.6010 => 0.6065, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.14% (0.3266 => 0.3336, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/strcat: 2.49% (0.1969 => 0.2018, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.68% (0.0408 => 0.0423, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.64% (0.0384 => 0.0421, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.71% (0.1438 => 0.1477, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -2.26% (1.1329 => 1.1073, std.dev.: 0.0232) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.08% (0.1462 => 0.1417, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.69% (0.4164 => 0.4052, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.92% (0.1369 => 0.1329, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.67% (0.0641 => 0.0579, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.51% (0.0195 => 0.0196, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.21% (0.0578 => 0.0585, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.32% (1.1437 => 1.1474, std.dev.: 0.0492) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 42.86% (0.0014 => 0.0020, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.34% (0.0627 => 0.0581, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.89% (0.0180 => 0.0187, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.05% (0.8017 => 0.8021, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -20.97% (0.0062 => 0.0049, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 4 23:26:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 5 Nov 2012 01:26:59 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121105072659.D9BEA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5590?compare_to=5587&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5590, Order: 167379, Start Time: 2012-11-05 06:02:05, End Time: 2012-11-05 07:27:05 To: 5587, Order: 167378, Start Time: 2012-11-05 03:27:40, End Time: 2012-11-05 04:52:47 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (6 on baseline) Performance Improvements: 0 (176 on baseline) Unchanged Tests: 1040 (860 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 3.08% (0.3829 => 0.3947, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.41% (79.0292 => 80.1443, std.dev.: 0.3828) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 2.95% (0.3834 => 0.3947, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.64% (54.5751 => 56.5595, std.dev.: 0.0314) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1015, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4937 => 7.6676, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/hash2: 2.20% (3.1932 => 3.2636, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.60% (0.1431 => 0.1308, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.38% (0.3821 => 0.3539, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.10% (2.4924 => 2.3155, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.65% (0.3142 => 0.2933, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.55% (22.4056 => 20.9379, std.dev.: 0.0245) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.45% (3.5339 => 3.3060, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.43% (0.2428 => 0.2272, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.23% (0.3658 => 0.3430, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -6.23% (0.3357 => 0.3148, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.11% (0.9542 => 0.8959, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -6.09% (7.0961 => 6.6643, std.dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: -6.08% (9.2283 => 8.6675, std.dev.: 0.0189) MultiSource/Applications/JM/lencod/lencod: -6.08% (16.1920 => 15.2081, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/football/football: -6.02% (0.9179 => 0.8626, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: -5.97% (0.2160 => 0.2031, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.97% (0.6484 => 0.6097, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.96% (1.0544 => 0.9916, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -5.95% (1.1450 => 1.0769, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.93% (0.9852 => 0.9268, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -5.87% (1.2515 => 1.1780, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.84% (1.2784 => 1.2038, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: -5.81% (17.1032 => 16.1093, std.dev.: 0.0208) MultiSource/Benchmarks/MallocBench/gs/gs: -5.80% (4.3330 => 4.0815, std.dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: -5.80% (1.1530 => 1.0861, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.79% (0.5857 => 0.5518, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.77% (1.3722 => 1.2930, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.73% (1.4642 => 1.3803, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.71% (1.2300 => 1.1598, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.69% (0.6304 => 0.5945, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.69% (1.6474 => 1.5537, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.68% (0.6052 => 0.5708, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.68% (0.2695 => 0.2542, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.65% (0.2355 => 0.2222, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.61% (0.7339 => 0.6927, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.60% (0.7524 => 0.7103, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.59% (0.7919 => 0.7476, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.59% (4.8161 => 4.5468, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.59% (0.5478 => 0.5172, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: -5.58% (0.3406 => 0.3216, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.58% (14.2083 => 13.4160, std.dev.: 0.1114) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.57% (0.2548 => 0.2406) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.57% (0.6681 => 0.6309, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.56% (0.5705 => 0.5388, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.56% (0.5849 => 0.5524, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.55% (0.6230 => 0.5884, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.55% (4.0323 => 3.8086, std.dev.: 0.0076) MultiSource/Applications/lua/lua: -5.54% (4.0594 => 3.8347, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.53% (0.6667 => 0.6298, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.52% (0.5575 => 0.5267, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.51% (0.6293 => 0.5946, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.51% (0.3483 => 0.3291, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.51% (0.5591 => 0.5283, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.50% (4.5069 => 4.2592, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.50% (0.5859 => 0.5537, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.48% (0.5802 => 0.5484, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.48% (0.6260 => 0.5917, std.dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.46% (0.6736 => 0.6368, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.46% (0.6297 => 0.5953, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.46% (1.6364 => 1.5471, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.46% (5.4682 => 5.1698, std.dev.: 0.0138) MultiSource/Benchmarks/McCat/08-main/main: -5.45% (0.2659 => 0.2514, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.45% (0.5925 => 0.5602, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.45% (0.6446 => 0.6095, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.43% (0.2985 => 0.2823, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -5.42% (2.4021 => 2.2718, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.42% (4.8802 => 4.6156, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.42% (0.5570 => 0.5268, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.41% (0.6395 => 0.6049, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.39% (0.6440 => 0.6093, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.39% (0.5941 => 0.5621, std.dev.: 0.0065) MultiSource/Applications/SPASS/SPASS: -5.38% (15.5079 => 14.6729, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.38% (0.6194 => 0.5861, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.35% (0.6033 => 0.5710, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.35% (0.5456 => 0.5164, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.34% (0.7021 => 0.6646, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.34% (0.5863 => 0.5550, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.32% (6.7716 => 6.4113, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.30% (0.5581 => 0.5285, std.dev.: 0.0114) MultiSource/Applications/SIBsim4/SIBsim4: -5.28% (1.3864 => 1.3132, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.28% (0.4151 => 0.3932, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.27% (0.6676 => 0.6324, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.26% (0.5569 => 0.5276, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.25% (2.2587 => 2.1401, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: -5.25% (0.7447 => 0.7056, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.25% (0.5567 => 0.5275, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.24% (0.5805 => 0.5501, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -5.22% (0.3581 => 0.3394, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.21% (0.6660 => 0.6313, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.18% (0.4033 => 0.3824, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.17% (0.3831 => 0.3633, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -5.17% (0.3812 => 0.3615, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.17% (0.5168 => 0.4901, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.16% (0.8521 => 0.8081, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -5.15% (3.5154 => 3.3344, std.dev.: 0.0125) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.15% (0.4916 => 0.4663, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -5.14% (0.4861 => 0.4611, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.13% (0.5999 => 0.5691, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/synchronized: -5.13% (0.3896 => 0.3696, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -5.13% (0.3880 => 0.3681, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -5.12% (0.4176 => 0.3962, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.12% (0.5329 => 0.5056, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -5.12% (0.3848 => 0.3651, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.11% (0.6395 => 0.6068, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.11% (0.6189 => 0.5873, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.10% (0.3884 => 0.3686, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -5.06% (0.7982 => 0.7578, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: -5.05% (1.3148 => 1.2484, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.03% (0.5688 => 0.5402, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.00% (0.2278 => 0.2164, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.99% (0.3891 => 0.3697) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.97% (0.9557 => 0.9082, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -4.95% (34.0927 => 32.4055, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.94% (0.3849 => 0.3659, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/property: -4.93% (0.4199 => 0.3992, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -4.93% (2.1401 => 2.0346, std.dev.: 0.0047) MultiSource/Applications/ClamAV/clamscan: -4.91% (15.2527 => 14.5045, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.90% (0.2999 => 0.2852, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.88% (8.0126 => 7.6215, std.dev.: 0.0031) MultiSource/Applications/kimwitu++/kc: -4.85% (18.2933 => 17.4060, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.85% (0.3837 => 0.3651, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.83% (0.3931 => 0.3741, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: -4.83% (0.4515 => 0.4297, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.82% (0.2385 => 0.2270, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.79% (0.4321 => 0.4114, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.78% (1.2221 => 1.1637, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.77% (1.2210 => 1.1628, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.77% (0.7198 => 0.6855, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -4.76% (0.3255 => 0.3100, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -4.76% (0.3025 => 0.2881) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.75% (0.4083 => 0.3889, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.74% (0.4280 => 0.4077, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.73% (0.3491 => 0.3326, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/bigfib: -4.73% (0.6750 => 0.6431, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -4.70% (0.3194 => 0.3044, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.66% (0.3323 => 0.3168, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.64% (0.3252 => 0.3101, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: -4.64% (0.4248 => 0.4051, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -4.63% (0.3026 => 0.2886, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.61% (0.3319 => 0.3166, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -4.59% (0.3446 => 0.3288, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.58% (0.3057 => 0.2917, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -4.57% (0.3481 => 0.3322, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.56% (2.1713 => 2.0723, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: -4.55% (0.3867 => 0.3691, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -4.53% (0.2871 => 0.2741, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -4.53% (0.2939 => 0.2806, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -4.51% (0.3394 => 0.3241, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hello: -4.49% (0.2849 => 0.2721, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -4.49% (0.8418 => 0.8040, std.dev.: 0.0026) SingleSource/Regression/C++/ofstream_ctor: -4.48% (0.3059 => 0.2922, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.47% (0.4427 => 0.4229, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -4.46% (0.3271 => 0.3125, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -4.45% (0.3621 => 0.3460, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: -4.40% (0.3205 => 0.3064, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.40% (0.2933 => 0.2804, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/strcat: -4.38% (0.2989 => 0.2858, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.34% (0.2903 => 0.2777, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: -4.33% (0.3788 => 0.3624, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -4.31% (0.4524 => 0.4329, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.22% (0.4813 => 0.4610, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: -4.19% (5.0226 => 4.8122, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/Hello: -3.58% (0.6347 => 0.6120, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference-object: -3.49% (0.6441 => 0.6216, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -3.42% (0.7779 => 0.7513, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.34% (1.5610 => 1.5089, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.19% (0.9077 => 0.8787, std.dev.: 0.0026) SingleSource/UnitTests/Vector/constpool: -2.49% (20.7746 => 20.2578, std.dev.: 0.0350) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7502, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.73% (2.2633 => 2.1789, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.95% (1.3096 => 1.2841, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4700, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.13% (1.6086 => 1.5904, std.dev.: 0.0065) Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 5 01:36:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 5 Nov 2012 03:36:40 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121105093640.69BFB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5591?compare_to=5573&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5591, Order: 167369, Start Time: 2012-11-04 09:37:59, End Time: 2012-11-05 09:36:46 To: 5573, Order: 167353, Start Time: 2012-11-03 09:08:53, End Time: 2012-11-04 09:07:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (36 on baseline) New Passes: 0 (12 on baseline) Performance Regressions: 1 (172 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 43 (7 on baseline) Unchanged Tests: 998 (642 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.36% (0.9514 => 0.9643, std.dev.: 0.0018) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/ClamAV/clamscan: 0.40% (28.1772 => 28.2907, std.dev.: 0.0101) MultiSource/Applications/JM/ldecod/ldecod: 0.27% (6.3000 => 6.3167, std.dev.: 0.0157) MultiSource/Applications/JM/lencod/lencod: 0.25% (18.6810 => 18.7270, std.dev.: 0.0311) MultiSource/Applications/oggenc/oggenc: - (0.0020 => 0.0020) MultiSource/Applications/sqlite3/sqlite3: 0.25% (0.5224 => 0.5237, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 0.36% (46.9978 => 47.1681, std.dev.: 0.0582) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 0.44% (5.0395 => 5.0615, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -0.30% (1.4165 => 1.4122, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 0.26% (0.3031 => 0.3039, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.66% (0.0301 => 0.0299, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -0.02% (1.3235 => 1.3232, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/voronoi/voronoi: -0.46% (0.1950 => 0.1941, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: - (0.0020 => 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: - (0.0019 => 0.0019, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 2.40% (0.2797 => 0.2864, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.23% (1.3130 => 1.3160, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 0.28% (5.1983 => 5.2128, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.28% (1.3773 => 1.3812, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 0.08% (1.0881 => 1.0890, std.dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0020 => 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/ClamAV/clamscan: - (0.0001 => 0.0001) MultiSource/Applications/JM/ldecod/ldecod: - (0.0001 => 0.0001) MultiSource/Applications/JM/lencod/lencod: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.69% (0.0726 => 0.0721, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: - (0.0001 => 0.0001) MultiSource/Benchmarks/Olden/power/power: -0.01% (499.8528 => 499.8220, std.dev.: 0.0205) MultiSource/Benchmarks/Olden/voronoi/voronoi: - (0.0001 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: - (0.0001 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: - (0.0001 => 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/nbench/nbench: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/nbench/nbench MultiSource/Applications/ClamAV/clamscan: 27.57% (22.1758 => 28.2907, std.dev.: 0.0101) MultiSource/Applications/JM/ldecod/ldecod: -39.47% (10.4361 => 6.3167, std.dev.: 0.0157) MultiSource/Applications/JM/lencod/lencod: -14.63% (21.9371 => 18.7270, std.dev.: 0.0311) MultiSource/Applications/oggenc/oggenc: -99.97% (5.7591 => 0.0020) MultiSource/Applications/sqlite3/sqlite3: -96.95% (17.1811 => 0.5237, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -25.42% (63.2438 => 47.1681, std.dev.: 0.0582) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.36% (4.9449 => 5.0615, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -8.39% (1.5415 => 1.4122, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -37.71% (0.4879 => 0.3039, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.55% (6.6874 => 0.0299, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -75.28% (5.3526 => 1.3232, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/voronoi/voronoi: -28.11% (0.2700 => 0.1941, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -99.93% (2.9384 => 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -99.83% (1.1194 => 0.0019, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -9.85% (0.3177 => 0.2864, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -75.56% (5.3855 => 1.3160, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.22% (5.0018 => 5.2128, std.dev.: 0.0077) MultiSource/Benchmarks/nbench/nbench: -8.02% (1.1840 => 1.0890, std.dev.: 0.0053) New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/nbench/nbench MultiSource/Applications/ClamAV/clamscan: -99.94% (0.1629 => 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -99.92% (0.1298 => 0.0001) MultiSource/Applications/sqlite3/sqlite3: -100.00% (4.6441 => 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -98.00% (0.0050 => 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -50.00% (0.0002 => 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -75.00% (0.0004 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -99.97% (0.3987 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 44222.25% (1.1277 => 499.8220, std.dev.: 0.0205) MultiSource/Benchmarks/Olden/voronoi/voronoi: -99.97% (0.3070 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -100.00% (2.6546 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -100.00% (2.6778 => 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -100.00% (4.5009 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -99.80% (0.0506 => 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -97.30% (0.0037 => 0.0001) MultiSource/Benchmarks/nbench/nbench: -100.00% (11.6436 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 189.50% (0.5229 => 1.5138, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 11.83% (14.9895 => 16.7622, std.dev.: 0.0271) MultiSource/Applications/kimwitu++/kc: 35.61% (14.1553 => 19.1963, std.dev.: 0.0128) MultiSource/Benchmarks/MallocBench/gs/gs: 12.28% (4.1105 => 4.6154, std.dev.: 0.0190) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.66% (3.4629 => 5.8060, std.dev.: 0.0164) SingleSource/Benchmarks/Misc-C++/stepanov_container: 62.04% (0.6222 => 1.0082, std.dev.: 0.0014) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3839700.00% (0.0001 => 3.8398, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 11168300.00% (0.0001 => 11.1684, std.dev.: 0.0423) MultiSource/Applications/kimwitu++/kc: 51100.00% (0.0001 => 0.0512, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 66400.00% (0.0001 => 0.0665, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050000.00% (0.0001 => 10.0501, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5491500.00% (0.0001 => 5.4916, std.dev.: 0.0038) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 50.95% (0.1056 => 0.1594, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 50.57% (7.0540 => 10.6209, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/n-body: 40.21% (0.0746 => 0.1046, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 37.12% (0.0730 => 0.1001, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 36.73% (0.1432 => 0.1958, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Oscar: 23.58% (0.0636 => 0.0786, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 21.30% (0.0798 => 0.0968, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 20.32% (0.2554 => 0.3073, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.60% (0.1566 => 0.1873, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.42% (0.0793 => 0.0947, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 19.32% (0.1175 => 0.1402, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.99% (8.1363 => 9.6811, std.dev.: 0.0067) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.04% (0.1125 => 0.1328, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 17.75% (0.1555 => 0.1831, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.44% (0.0648 => 0.0761, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.22% (0.0842 => 0.0987, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 16.92% (0.1584 => 0.1852, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 16.61% (0.0614 => 0.0716, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.59% (0.0675 => 0.0787, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.32% (0.2065 => 0.2402, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.26% (0.0953 => 0.1108, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.88% (0.8172 => 0.9470, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.84% (0.0770 => 0.0892, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 15.61% (0.0871 => 0.1007, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.23% (0.0834 => 0.0961, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/em3d/em3d: 15.22% (0.1695 => 0.1953, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/matrix: 14.67% (0.0818 => 0.0938, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 14.60% (0.1151 => 0.1319, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.57% (0.2107 => 0.2414, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.51% (0.3121 => 0.3574, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.49% (0.2271 => 0.2600, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.38% (0.0730 => 0.0835, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.31% (0.1062 => 0.1214) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.29% (0.1029 => 0.1176, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.23% (0.5981 => 0.6832, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.22% (0.0886 => 0.1012, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.89% (0.2758 => 0.3141, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/mst/mst: 13.84% (0.1163 => 0.1324, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.76% (0.1337 => 0.1521, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.70% (0.1117 => 0.1270, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.59% (0.1906 => 0.2165, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 13.57% (1.1642 => 1.3222, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/health/health: 13.49% (0.1268 => 0.1439, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.14% (0.5569 => 0.6301, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.04% (14.3668 => 16.2409, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 12.89% (0.7115 => 0.8032, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 12.87% (0.1655 => 0.1868, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 12.86% (0.7433 => 0.8389, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.85% (0.5860 => 0.6613, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.77% (0.9765 => 1.1012, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.68% (0.1940 => 0.2186, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.52% (0.4615 => 0.5193, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.41% (0.0838 => 0.0942, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 12.34% (0.7835 => 0.8802, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/18-imp/imp: 12.24% (0.3423 => 0.3842, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 11.87% (0.3109 => 0.3478, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.86% (0.3441 => 0.3849, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.81% (0.5105 => 0.5708, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.52% (0.1510 => 0.1684, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.52% (0.6675 => 0.7444, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.43% (1.3050 => 1.4541, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 11.38% (3.8723 => 4.3129, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.34% (0.1032 => 0.1149, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.33% (0.1236 => 0.1376, std.dev.: 0.0008) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.29% (0.1143 => 0.1272, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.28% (4.2646 => 4.7456, std.dev.: 0.0053) MultiSource/Applications/d/make_dparser: 11.06% (3.3354 => 3.7044, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.92% (0.1044 => 0.1158, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.84% (0.3543 => 0.3927, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.77% (0.3307 => 0.3663, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 10.75% (0.3927 => 0.4349, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.68% (0.3473 => 0.3844, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/property: 10.52% (0.3886 => 0.4295, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 10.49% (2.0273 => 2.2400, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.47% (0.3543 => 0.3914, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 10.44% (0.3497 => 0.3862, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.42% (0.5020 => 0.5543, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/synchronized: 10.33% (0.3561 => 0.3929, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.32% (0.3828 => 0.4223, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.27% (0.3516 => 0.3877, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.21% (0.3694 => 0.4071, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.15% (2.2022 => 2.4258, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash: 10.05% (0.4289 => 0.4720, std.dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: 9.96% (9.4845 => 10.4292, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/bigfib: 9.94% (0.6456 => 0.7098, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.88% (0.8101 => 0.8901, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.84% (0.8067 => 0.8861, std.dev.: 0.0102) MultiSource/Benchmarks/McCat/05-eks/eks: 9.82% (0.4299 => 0.4721, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.75% (0.6450 => 0.7079, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.72% (1.5859 => 1.7400, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.67% (0.1892 => 0.2075, std.dev.: 0.0036) MultiSource/Applications/lemon/lemon: 9.63% (1.0722 => 1.1755, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 9.61% (2.2969 => 2.5176, std.dev.: 0.0060) SingleSource/Benchmarks/Stanford/Puzzle: 9.54% (0.1268 => 0.1389, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 9.53% (0.3180 => 0.3483, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.38% (0.2430 => 0.2658, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.32% (0.1695 => 0.1853, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.31% (1.1861 => 1.2965, std.dev.: 0.0131) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.28% (0.4636 => 0.5066, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/football/football: 9.23% (0.8921 => 0.9744, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.19% (0.4103 => 0.4480, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.14% (0.2603 => 0.2841, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.14% (3.8922 => 4.2478, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.13% (0.3865 => 0.4218, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.11% (2.2024 => 2.4030, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.04% (0.4203 => 0.4583, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 9.03% (1.5603 => 1.7012, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/hash2: 9.03% (0.4620 => 0.5037, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.99% (1.4186 => 1.5462, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference-object: 8.94% (0.6030 => 0.6569, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.91% (0.5925 => 0.6453, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.90% (0.7326 => 0.7978, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists: 8.85% (0.3422 => 0.3725, std.dev.: 0.0005) SingleSource/UnitTests/SignlessTypes/rem: 8.83% (0.1144 => 0.1245, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 8.68% (0.3387 => 0.3681, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 8.48% (0.1463 => 0.1587, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 8.42% (0.4048 => 0.4389, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.42% (0.3826 => 0.4148, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 8.36% (0.3684 => 0.3992, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 8.35% (0.3603 => 0.3904, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.33% (0.2905 => 0.3147, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.11% (0.3650 => 0.3946, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 8.02% (0.2831 => 0.3058, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.84% (0.2756 => 0.2972, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.82% (0.2725 => 0.2938, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 7.71% (0.3283 => 0.3536, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.66% (0.2714 => 0.2922, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.61% (0.2891 => 0.3111, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.61% (2.0665 => 2.2237, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.56% (0.3162 => 0.3401, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.55% (0.2793 => 0.3004, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.52% (0.3232 => 0.3475, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.36% (0.4064 => 0.4363, std.dev.: 0.0054) MultiSource/Benchmarks/PAQ8p/paq8p: 7.36% (10.3673 => 11.1300, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/except: 7.35% (0.2871 => 0.3082, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 7.30% (0.2877 => 0.3087, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 7.22% (0.2049 => 0.2197, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.17% (0.3098 => 0.3320, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 7.04% (0.3052 => 0.3267, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 7.02% (1.2842 => 1.3743, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.96% (0.2872 => 0.3072, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 6.85% (0.2802 => 0.2994, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.69% (0.3379 => 0.3605, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.47% (0.3136 => 0.3339, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 6.37% (0.3092 => 0.3289, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 5.91% (0.3282 => 0.3476, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.84% (0.3427 => 0.3627, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.95% (0.3131 => 0.3286, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.51% (0.3935 => 0.4073, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.88% (0.3817 => 0.3927, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8964, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.64% (1.1145 => 1.2999, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: 13.90% (6.6465 => 7.5706, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2180) SingleSource/Benchmarks/Misc/richards_benchmark: 9.80% (1.1396 => 1.2513, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.93% (1.7254 => 1.8794, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 8.11% (0.9505 => 1.0276, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.11% (0.9540 => 1.0218) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3676, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.46% (0.3463 => 0.3652) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.45% (4.2280 => 4.4163, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.45% (8.6802 => 8.8927, std.dev.: 0.0174) MultiSource/Applications/aha/aha: 1.83% (3.1595 => 3.2172, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.76% (0.8333 => 0.8480, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0497, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.01% (3.6395 => 3.6762, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.99% (5.2763 => 1.2141, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -75.56% (0.8651 => 0.2114, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -45.99% (0.1622 => 0.0876, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -27.84% (1.7609 => 1.2706, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -12.11% (0.1330 => 0.1169, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -9.08% (54.1659 => 49.2457, std.dev.: 0.0186) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.19% (7.9617 => 7.8672, std.dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.85% (0.0628 => 0.0384, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -18.32% (0.2161 => 0.1765, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.84% (1.6925 => 1.4244, std.dev.: 0.0037) MultiSource/Benchmarks/NPB-serial/is/is: -10.99% (9.5636 => 8.5127, std.dev.: 0.0235) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.98% (32.5116 => 28.9433, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: -10.94% (1.5373 => 1.3691, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.13% (1.5660 => 1.4230, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2965, std.dev.: 0.0224) MultiSource/Benchmarks/FreeBench/distray/distray: -7.16% (0.1592 => 0.1478, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7049, std.dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783) SingleSource/Benchmarks/McGill/chomp: -6.28% (1.2373 => 1.1596, std.dev.: 0.0055) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -6.05% (0.4808 => 0.4517, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.19% (1.6805 => 1.5932, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -4.88% (1.5835 => 1.5062, std.dev.: 0.0019) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1550, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.76% (1.3677 => 1.3163, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -3.23% (5.0483 => 4.8850, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.15% (0.9957 => 0.9643, std.dev.: 0.0018) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.84% (10.2830 => 10.0935, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.71% (2.5528 => 2.5092, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: -1.70% (85.0658 => 83.6186, std.dev.: 0.0095) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.66% (8.1563 => 8.0210, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 25.02% (1.1048 => 1.3812, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -99.97% (7.1582 => 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: -99.86% (0.0720 => 0.0001) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -65.93% (0.2116 => 0.0721, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 5 02:48:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 5 Nov 2012 04:48:40 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121105104840.2ED6A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5592?compare_to=5588&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5592, Order: 167379, Start Time: 2012-11-05 07:29:33, End Time: 2012-11-05 10:48:46 To: 5588, Order: 167377, Start Time: 2012-11-05 03:25:33, End Time: 2012-11-05 06:41:17 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (168 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1042 (721 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.48% (0.0625 => 0.0878, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.70% (0.1063 => 0.1400, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.43% (0.2969 => 0.3724, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.05% (0.1106 => 0.1383, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.51% (0.0714 => 0.0889, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.28% (0.4139 => 0.5144, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.03% (0.4994 => 0.6194, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.70% (0.4253 => 0.5261, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 23.68% (1.5932 => 1.9705, std.dev.: 0.0321) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.63% (0.0584 => 0.0722, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.58% (0.5900 => 0.7291, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.06% (0.5000 => 0.6153, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.49% (0.0547 => 0.0670, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.43% (0.0584 => 0.0715, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.41% (0.1620 => 0.1983, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 21.65% (0.0947 => 0.1152, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.55% (0.1021 => 0.1241, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.52% (0.0897 => 0.1090, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.23% (0.1107 => 0.1342, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: 21.20% (0.0599 => 0.0726, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 20.86% (0.0604 => 0.0730, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.56% (0.0642 => 0.0774, std.dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: 20.54% (0.0808 => 0.0974, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.38% (0.0633 => 0.0762, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 20.36% (0.0948 => 0.1141, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 20.06% (0.0698 => 0.0838, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.01% (0.1604 => 0.1925, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 20.01% (0.1619 => 0.1943, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.85% (0.1103 => 0.1322, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 19.85% (0.0821 => 0.0984, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.83% (0.0822 => 0.0985, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.82% (0.1549 => 0.1856, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.74% (0.1003 => 0.1201, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.65% (0.3903 => 0.4670, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.06% (0.0572 => 0.0681, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.36% (0.1160 => 0.1373, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 18.28% (0.5826 => 0.6891, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.26% (0.1462 => 0.1729, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 18.02% (0.4029 => 0.4755, std.dev.: 0.0140) MultiSource/Benchmarks/McCat/09-vor/vor: 18.01% (0.1505 => 0.1776, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.99% (0.3890 => 0.4590, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.90% (0.0581 => 0.0685, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.87% (1.3152 => 1.5502, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.83% (0.2014 => 0.2373, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 17.82% (0.1218 => 0.1435, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 17.76% (0.5889 => 0.6935, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.58% (0.2736 => 0.3217, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.37% (0.1088 => 0.1277, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.20% (0.2866 => 0.3359, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.13% (3.5627 => 4.1729, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 16.79% (1.8794 => 2.1949, std.dev.: 0.0039) MultiSource/Applications/Burg/burg: 16.77% (0.5546 => 0.6476, std.dev.: 0.0243) MultiSource/Benchmarks/Olden/bh/bh: 16.67% (0.1284 => 0.1498, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 16.39% (0.7171 => 0.8346, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.36% (1.6211 => 1.8863, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.32% (0.5026 => 0.5846, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.27% (0.4658 => 0.5416, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.26% (0.1968 => 0.2288, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/18-imp/imp: 16.19% (0.1421 => 0.1651, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.96% (0.3271 => 0.3793, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.86% (0.2875 => 0.3331, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.84% (0.4361 => 0.5052, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 15.74% (0.9697 => 1.1223, std.dev.: 0.0315) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.57% (2.7292 => 3.1541, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.52% (0.3195 => 0.3691, std.dev.: 0.0036) MultiSource/Applications/d/make_dparser: 15.50% (1.0781 => 1.2452, std.dev.: 0.0343) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.35% (1.9694 => 2.2717, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.33% (4.4195 => 5.0972, std.dev.: 0.0045) MultiSource/Applications/ClamAV/clamscan: 15.31% (4.2109 => 4.8555, std.dev.: 0.1568) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.24% (0.3930 => 0.4529, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/fibo: 15.16% (0.2725 => 0.3138, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 15.14% (0.2714 => 0.3125, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.05% (0.2738 => 0.3150, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 15.05% (0.3004 => 0.3456, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 15.02% (0.2823 => 0.3247, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 14.99% (0.2729 => 0.3138, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 14.98% (0.9909 => 1.1393, std.dev.: 0.0381) SingleSource/Benchmarks/Shootout-C++/methcall: 14.97% (0.2813 => 0.3234, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 14.96% (0.2780 => 0.3196, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.95% (0.1090 => 0.1253, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/strcat: 14.95% (0.2750 => 0.3161, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.93% (1.9966 => 2.2947, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 14.84% (0.2803 => 0.3219, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.83% (0.2792 => 0.3206, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.82% (2.0673 => 2.3737, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/except: 14.80% (0.2811 => 0.3227, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wc: 14.76% (0.3096 => 0.3553, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 14.73% (0.2566 => 0.2944, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.70% (0.2911 => 0.3339, std.dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: 14.67% (23.5202 => 26.9704, std.dev.: 0.0123) SingleSource/UnitTests/ObjC/for-in: 14.53% (0.3496 => 0.4004, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.36% (0.3488 => 0.3989, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 14.34% (0.3446 => 0.3940, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 14.24% (0.3469 => 0.3963, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/trivial-interface: 14.24% (0.3442 => 0.3932, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 14.20% (0.3465 => 0.3957, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.16% (0.3460 => 0.3950, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 14.11% (0.3267 => 0.3728, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 14.09% (0.3258 => 0.3717, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.04% (0.3362 => 0.3834, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 13.96% (0.3724 => 0.4244, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.92% (0.3060 => 0.3486, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.86% (0.3845 => 0.4378, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary2: 13.84% (0.3317 => 0.3776, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 13.81% (0.3650 => 0.4154, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 13.80% (1.4269 => 1.6238, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/moments: 13.76% (0.3678 => 0.4184, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 13.73% (0.2075 => 0.2360, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 13.70% (0.3643 => 0.4142, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.67% (0.3124 => 0.3551, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 13.51% (0.4146 => 0.4706, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 13.44% (0.3348 => 0.3798, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.27% (0.3625 => 0.4106, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.25% (0.3282 => 0.3717, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 13.20% (0.3726 => 0.4218, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/lists1: 13.14% (0.3477 => 0.3934, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 13.13% (0.7875 => 0.8909, std.dev.: 0.0243) MultiSource/Applications/JM/ldecod/ldecod: 13.11% (2.1653 => 2.4492, std.dev.: 0.0800) SingleSource/Benchmarks/Shootout-C++/hash2: 13.01% (0.4251 => 0.4804, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.94% (0.3981 => 0.4496, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.93% (0.3690 => 0.4167, std.dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 12.85% (4.6177 => 5.2111, std.dev.: 0.1374) MultiSource/Benchmarks/mafft/pairlocalalign: 12.58% (2.1013 => 2.3656, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 12.25% (0.5012 => 0.5626, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.91% (0.2040 => 0.2283, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 11.39% (5.5417 => 6.1728, std.dev.: 0.1424) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.89% (0.6435 => 0.7136, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.41% (0.1028 => 0.1135, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.34% (0.1383 => 0.1526, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.27% (0.2737 => 0.3018, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 10.07% (0.4847 => 0.5335, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.06% (0.2068 => 0.2276, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.79% (0.3084 => 0.3386, std.dev.: 0.0050) MultiSource/Applications/minisat/minisat: 9.65% (0.3336 => 0.3658, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.13% (0.2103 => 0.2295, std.dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: 9.00% (2.0346 => 2.2177, std.dev.: 0.0440) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.30% (4.6926 => 5.0823, std.dev.: 0.0122) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.16% (11.6398 => 12.5896, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.70% (0.5361 => 0.5774, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.93% (0.5584 => 0.5971, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.88% (0.7426 => 0.7937, std.dev.: 0.0081) MultiSource/Applications/kimwitu++/kc: 6.22% (11.9555 => 12.6997, std.dev.: 0.0089) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.88% (0.3792 => 0.3977, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.23% (0.2162 => 0.3529, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.59% (2.5769 => 3.0301, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 7.64% (0.2802 => 0.3016, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6117, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.04% (12.0509 => 12.6579, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary: 4.90% (0.2122 => 0.2226, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1679, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.22% (0.3693 => 0.3849, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-2: 3.79% (1.8057 => 1.8741, std.dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/dry: 2.52% (14.0481 => 14.4022, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary3: 1.99% (15.8721 => 16.1882, std.dev.: 0.0691) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2228, std.dev.: 0.0027) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3005, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2873, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.26% (1.0142 => 1.0270, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5904, std.dev.: 0.0259) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.18% (2.4764 => 2.4224, std.dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.47% (25.4195 => 16.4036, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9788, std.dev.: 0.0309) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7763, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9587, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -7.08% (0.2402 => 0.2232, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: -3.72% (3.3665 => 3.2412, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0056) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std.dev.: 0.0187) SingleSource/Benchmarks/Misc/mandel-2: -2.87% (3.6262 => 3.5220, std.dev.: 0.0019) SingleSource/UnitTests/Vector/build2: -2.75% (11.2080 => 10.8997, std.dev.: 0.0167) SingleSource/Benchmarks/Dhrystone/fldry: -2.55% (17.2379 => 16.7981, std.dev.: 0.0220) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.19% (41.7953 => 40.8785, std.dev.: 0.0179) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5752, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4952, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.1972, std.dev.: 0.0372) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.10% (3.3991 => 3.3617, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0417, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 5 04:10:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 5 Nov 2012 06:10:01 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121105121001.67D802A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5593?compare_to=5589&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5593, Order: 167380, Start Time: 2012-11-05 10:41:47, End Time: 2012-11-05 12:10:09 To: 5589, Order: 167379, Start Time: 2012-11-05 05:55:47, End Time: 2012-11-05 07:22:26 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 6 (65 on baseline) Performance Improvements: 1 (5 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 984 (904 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.35% (0.1071 => 0.1214, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.73% (0.3002 => 0.3174, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.33% (0.3093 => 0.3196, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.03% (0.5115 => 0.5270, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.24% (0.4948 => 0.5059, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 4.49% (8.6396 => 9.0276, std.dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: -6.88% (0.2223 => 0.2070, std.dev.: 0.0055) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.16% (16.6334 => 16.6075, std.dev.: 0.3180) MultiSource/Applications/obsequi/Obsequi: -0.56% (1.0623 => 1.0563, std.dev.: 0.0388) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.01% (21.5239 => 21.5252, std.dev.: 0.1671) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.25% (0.3652 => 0.3643, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: -0.68% (0.6065 => 0.6024, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.54% (0.3336 => 0.3318, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/strcat: -1.09% (0.2018 => 0.1996, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0217 => 0.0217, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0423 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0330 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0312 => 0.0313, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.48% (0.0421 => 0.0419, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0202 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0216 => 0.0216, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.27% (0.1477 => 0.1473, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 3.92% (1.1073 => 1.1507, std.dev.: 0.0216) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 4.73% (0.1417 => 0.1484, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.20% (0.4052 => 0.4044, std.dev.: 0.0264) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.96% (0.1329 => 0.1303, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.08% (0.0579 => 0.0620, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 15.31% (0.0196 => 0.0226, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.64% (0.0585 => 0.0552, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.22% (1.1474 => 1.1449, std.dev.: 0.0110) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -65.00% (0.0020 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.69% (0.0581 => 0.0577, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.04% (0.0187 => 0.0260, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.8021 => 0.8021, std.dev.: 0.0133) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 20.41% (0.0049 => 0.0059, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2309.13% (0.6332 => 15.2546, std.dev.: 0.2372) MultiSource/Benchmarks/McCat/08-main/main: 47.52% (0.1831 => 0.2701, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.26% (0.1559 => 0.1477, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1485.68% (0.3344 => 5.3025, std.dev.: 0.0538) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.38% (0.2364 => 0.3224, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: -1.86% (0.0429 => 0.0421, std.dev.: 0.0011) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.25% (0.0224 => 0.0238, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -50.87% (0.0230 => 0.0113, std.dev.: 0.0021) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3137, std.dev.: 0.0593) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0709, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4929, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3409, std.dev.: 0.0177) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0286, std.dev.: 0.0209) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4051, std.dev.: 0.0041) SingleSource/Regression/C/uint64_to_float: -24.08% (2.1832 => 1.6574, std.dev.: 0.0034) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.20% (0.0773 => 0.0875, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.03% (0.0848 => 0.0950, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 11.42% (0.1112 => 0.1239, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.73% (0.4847 => 0.5270, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.08% (0.1905 => 0.2059, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.00% (0.1425 => 0.1539, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.97% (0.6010 => 0.6489, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.31% (0.7473 => 0.8019, std.dev.: 0.0135) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.02% (0.2180 => 0.2333, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.60% (0.2998 => 0.3196, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.57% (0.3137 => 0.3343, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.31% (0.2519 => 0.2678, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.77% (0.4783 => 0.5059, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.69% (0.3003 => 0.3174, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.49% (1.1606 => 1.2243, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 5.27% (0.7950 => 0.8369, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.11% (0.9435 => 0.9917, std.dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.86% (0.3295 => 0.3455, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.82% (0.2240 => 0.2348, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 4.33% (0.2999 => 0.3129, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 4.23% (1.2222 => 1.2739, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.20% (0.6287 => 0.6551, std.dev.: 0.0061) MultiSource/Applications/hbd/hbd: 3.47% (1.4269 => 1.4764, std.dev.: 0.0146) MultiSource/Benchmarks/Olden/bh/bh: 3.45% (0.2985 => 0.3088, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 3.24% (4.1305 => 4.2643, std.dev.: 0.0492) MultiSource/Applications/treecc/treecc: 3.13% (1.9948 => 2.0573, std.dev.: 0.0139) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.79% (0.6227 => 0.6401, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.76% (0.9056 => 0.9306, std.dev.: 0.0067) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.64% (6.6074 => 6.7816, std.dev.: 0.0507) MultiSource/Applications/SIBsim4/SIBsim4: 2.63% (1.2568 => 1.2899, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.63% (1.4479 => 1.4860, std.dev.: 0.0060) MultiSource/Applications/d/make_dparser: 2.57% (3.2366 => 3.3199, std.dev.: 0.0196) MultiSource/Applications/lemon/lemon: 2.55% (1.0945 => 1.1224, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.36% (4.1763 => 4.2747, std.dev.: 0.0303) MultiSource/Applications/lua/lua: 2.33% (3.8189 => 3.9078, std.dev.: 0.0300) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.33% (1.6386 => 1.6767, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.28% (0.8340 => 0.8530, std.dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: 2.19% (14.7684 => 15.0918, std.dev.: 0.0655) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.16% (1.2526 => 1.2797, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.15% (4.5702 => 4.6686, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 1.86% (0.9810 => 0.9992, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 1.82% (1.1271 => 1.1476, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.79% (0.8316 => 0.8465, std.dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: 1.64% (6.7320 => 6.8426, std.dev.: 0.0224) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.60% (0.8697 => 0.8836, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.56% (0.9908 => 1.0063, std.dev.: 0.0054) MultiSource/Benchmarks/Bullet/bullet: 1.51% (31.8598 => 32.3406, std.dev.: 0.0972) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.47% (0.9069 => 0.9202, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.33% (0.7966 => 0.8072, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.30% (2.1401 => 2.1679, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.19% (1.5315 => 1.5497, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 1.01% (8.6247 => 8.7119, std.dev.: 0.0193) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 69.35% (0.0199 => 0.0337, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/pi: 57.19% (1.5795 => 2.4828, std.dev.: 0.0091) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.44% (14.6451 => 17.0527, std.dev.: 0.3809) MultiSource/Applications/SIBsim4/SIBsim4: 8.17% (3.1873 => 3.4476, std.dev.: 0.0401) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.16% (1.1857 => 1.2825, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 4.74% (14.0064 => 14.6702, std.dev.: 0.0418) SingleSource/Benchmarks/Misc/ReedSolomon: 3.45% (8.5322 => 8.8262, std.dev.: 0.0082) MultiSource/Benchmarks/sim/sim: 3.06% (3.8206 => 3.9374, std.dev.: 0.0140) MultiSource/Applications/siod/siod: 2.94% (3.6643 => 3.7721, std.dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: 2.43% (63.1822 => 64.7169, std.dev.: 0.0868) SingleSource/Benchmarks/Shootout-C++/hash: 2.03% (0.6205 => 0.6331, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.78% (28.5821 => 29.0901, std.dev.: 0.0521) MultiSource/Benchmarks/FreeBench/neural/neural: 1.33% (1.0841 => 1.0985, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.12% (0.3269 => 0.2971, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.64% (7.2130 => 6.8782, std.dev.: 0.0900) SingleSource/Benchmarks/Shootout/lists: -3.37% (7.3375 => 7.0902, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/hash2: -1.56% (3.4237 => 3.3704, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.21% (3.3479 => 3.3074, std.dev.: 0.0100) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.98% (16.4461 => 16.6075, std.dev.: 0.3180) MultiSource/Applications/obsequi/Obsequi: 2.93% (1.0262 => 1.0563, std.dev.: 0.0388) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6792.48% (0.3123 => 21.5252, std.dev.: 0.1671) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.91% (0.2463 => 0.3643, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: 0.23% (0.6010 => 0.6024, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.59% (0.3266 => 0.3318, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/strcat: 1.37% (0.1969 => 0.1996, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.68% (0.0408 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.11% (0.0384 => 0.0419, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.43% (0.1438 => 0.1473, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.57% (1.1329 => 1.1507, std.dev.: 0.0216) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 1.50% (0.1462 => 0.1484, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.88% (0.4164 => 0.4044, std.dev.: 0.0264) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.82% (0.1369 => 0.1303, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.28% (0.0641 => 0.0620, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 15.90% (0.0195 => 0.0226, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.50% (0.0578 => 0.0552, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.10% (1.1437 => 1.1449, std.dev.: 0.0110) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0014 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.97% (0.0627 => 0.0577, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 44.44% (0.0180 => 0.0260, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.05% (0.8017 => 0.8021, std.dev.: 0.0133) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: -4.84% (0.0062 => 0.0059, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 5 04:12:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 5 Nov 2012 06:12:53 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121105121253.DC44B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5594?compare_to=5590&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5594, Order: 167380, Start Time: 2012-11-05 10:48:02, End Time: 2012-11-05 12:13:00 To: 5590, Order: 167379, Start Time: 2012-11-05 06:02:05, End Time: 2012-11-05 07:27:05 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (180 on baseline) Unchanged Tests: 1042 (857 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1008, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.53% (54.5751 => 55.9548, std.dev.: 0.3479) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.4937 => 7.6742, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout-C++/hash2: 2.12% (3.1932 => 3.2609, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.60% (0.1431 => 0.1308, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.77% (0.3821 => 0.3524, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.16% (2.4924 => 2.3140, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.66% (22.4056 => 20.9131, std.dev.: 0.0236) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.65% (0.3142 => 0.2933, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.55% (0.2428 => 0.2269, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.46% (3.5339 => 3.3056, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.41% (0.9542 => 0.8930, std.dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: -6.34% (0.3357 => 0.3144, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.29% (0.3658 => 0.3428, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: -6.17% (0.1879 => 0.1763, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: -6.16% (0.2160 => 0.2027, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: -6.13% (7.0961 => 6.6609, std.dev.: 0.0071) MultiSource/Benchmarks/mafft/pairlocalalign: -6.12% (9.2283 => 8.6637, std.dev.: 0.0133) MultiSource/Applications/JM/lencod/lencod: -6.11% (16.1920 => 15.2032, std.dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.04% (1.0544 => 0.9907, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.00% (0.6484 => 0.6095, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -5.99% (1.1450 => 1.0764, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -5.96% (4.3330 => 4.0748, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.95% (0.9852 => 0.9266, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.89% (1.6474 => 1.5503, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.85% (1.2784 => 1.2036, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: -5.85% (0.1761 => 0.1658, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.84% (1.3722 => 1.2920, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.84% (1.6364 => 1.5409, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.82% (1.4642 => 1.3790, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: -5.82% (0.9179 => 0.8645, std.dev.: 0.0026) MultiSource/Applications/Burg/burg: -5.81% (1.2515 => 1.1788, std.dev.: 0.0056) MultiSource/Benchmarks/nbench/nbench: -5.78% (1.1530 => 1.0863, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -5.77% (17.1032 => 16.1164, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.75% (0.6681 => 0.6297, std.dev.: 0.0019) MultiSource/Applications/siod/siod: -5.74% (2.4021 => 2.2643, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.73% (0.1796 => 0.1693, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.71% (0.7919 => 0.7467, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.69% (1.2300 => 1.1600, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.68% (0.6304 => 0.5946, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: -5.68% (0.2659 => 0.2508, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.67% (0.6230 => 0.5877, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -5.65% (4.0594 => 3.8299, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.65% (0.5591 => 0.5275, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.65% (0.5857 => 0.5526, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.65% (0.2355 => 0.2222, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.63% (0.6052 => 0.5711, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.63% (0.6194 => 0.5845, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.63% (4.5069 => 4.2530, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.63% (14.2083 => 13.4090, std.dev.: 0.0210) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.62% (4.8161 => 4.5454, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.61% (0.7339 => 0.6927, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.61% (0.3406 => 0.3215, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.60% (0.2695 => 0.2544, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.60% (0.5802 => 0.5477, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.59% (0.6293 => 0.5941, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.58% (0.6667 => 0.6295, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.57% (0.5849 => 0.5523, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.57% (0.5478 => 0.5173, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -5.56% (0.7447 => 0.7033, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.55% (0.6446 => 0.6088, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.54% (0.3483 => 0.3290, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.54% (4.8802 => 4.6098, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.54% (0.5925 => 0.5597, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.53% (0.2548 => 0.2407, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.53% (5.4682 => 5.1659, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.53% (0.6297 => 0.5949, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.52% (4.0323 => 3.8098, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.50% (0.5705 => 0.5391, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -5.49% (0.2985 => 0.2821, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -5.47% (15.5079 => 14.6602, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.47% (0.6660 => 0.6296, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.46% (0.6260 => 0.5918, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.46% (0.6395 => 0.6046, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.45% (6.7716 => 6.4027, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.44% (0.5859 => 0.5540, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.44% (0.6676 => 0.6313, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.43% (0.5575 => 0.5272, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.43% (0.5456 => 0.5160, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.40% (0.5570 => 0.5269, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.40% (0.5941 => 0.5620, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.39% (0.5581 => 0.5280, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.39% (0.6736 => 0.6373, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.39% (0.6440 => 0.6093, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.37% (0.7524 => 0.7120, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: -5.37% (1.3864 => 1.3120, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: -5.36% (0.3581 => 0.3389, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.36% (0.5863 => 0.5549, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.35% (0.8521 => 0.8065, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.34% (0.5805 => 0.5495, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.32% (0.6189 => 0.5860, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.31% (2.2587 => 2.1387, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.30% (0.4151 => 0.3931, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.29% (0.6395 => 0.6057, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.28% (0.5999 => 0.5682, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.28% (0.7021 => 0.6650, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.28% (0.5567 => 0.5273, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: -5.27% (0.3812 => 0.3611, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.27% (0.6033 => 0.5715, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.27% (0.3891 => 0.3686, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.22% (0.3831 => 0.3631, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -5.22% (0.4176 => 0.3958, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.22% (0.5329 => 0.5051, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: -5.21% (0.3880 => 0.3678, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.19% (0.5569 => 0.5280, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.17% (0.5168 => 0.4901, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: -5.16% (0.4861 => 0.4610, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.14% (0.2999 => 0.2845, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.13% (0.7198 => 0.6829, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.13% (0.4916 => 0.4664, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.11% (0.4033 => 0.3827, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.11% (0.3896 => 0.3697, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.09% (0.3848 => 0.3652, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -5.09% (0.7982 => 0.7576, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: -5.08% (1.3148 => 1.2480, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.07% (0.3884 => 0.3687, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.07% (0.4813 => 0.4569, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: -5.06% (3.5154 => 3.3376, std.dev.: 0.0086) MultiSource/Applications/treecc/treecc: -5.05% (2.1401 => 2.0320, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.05% (0.2278 => 0.2163, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.04% (0.3931 => 0.3733, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.03% (0.9557 => 0.9076, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -5.03% (34.0927 => 32.3780, std.dev.: 0.0218) MultiSource/Benchmarks/McCat/05-eks/eks: -5.03% (0.4515 => 0.4288, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.01% (0.3849 => 0.3656, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.01% (0.5688 => 0.5403, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.98% (0.4199 => 0.3990, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -4.95% (0.4280 => 0.4068, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.95% (0.2385 => 0.2267, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -4.91% (15.2527 => 14.5037, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.90% (1.2221 => 1.1622, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.90% (0.3837 => 0.3649, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.89% (8.0126 => 7.6211, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.88% (1.2210 => 1.1614, std.dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.85% (0.3319 => 0.3158, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: -4.83% (18.2933 => 17.4093, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/methcall: -4.83% (0.3025 => 0.2879, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: -4.82% (0.4524 => 0.4306, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -4.77% (0.6750 => 0.6428, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.77% (2.1713 => 2.0678, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: -4.71% (0.4248 => 0.4048, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -4.70% (0.3255 => 0.3102, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -4.70% (0.3194 => 0.3044, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.68% (0.4083 => 0.3892, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.64% (0.3016 => 0.2876, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -4.63% (0.3867 => 0.3688, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.63% (0.4321 => 0.4121, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: -4.63% (0.3026 => 0.2886, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -4.61% (0.3446 => 0.3287, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.61% (0.3057 => 0.2916, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.61% (0.4427 => 0.4223, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -4.59% (0.3271 => 0.3121, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.58% (0.3252 => 0.3103, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -4.58% (0.3059 => 0.2919, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -4.57% (0.3394 => 0.3239, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -4.54% (0.3481 => 0.3323, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hello: -4.53% (0.2849 => 0.2720, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -4.53% (0.8418 => 0.8037, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/random: -4.53% (0.2939 => 0.2806, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -4.49% (0.2871 => 0.2742, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.48% (0.2989 => 0.2855, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.45% (0.3323 => 0.3175, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.44% (0.2903 => 0.2774, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -4.44% (0.3788 => 0.3620, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: -4.43% (0.3205 => 0.3063, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: -4.42% (0.3621 => 0.3461, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.36% (0.2933 => 0.2805, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.24% (5.0226 => 4.8096, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.01% (0.9077 => 0.8713, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: -3.91% (0.7779 => 0.7475, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/Hello: -3.61% (0.6347 => 0.6118, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -3.43% (0.6441 => 0.6220, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.39% (1.5610 => 1.5081, std.dev.: 0.0029) SingleSource/UnitTests/Vector/constpool: -2.59% (20.7746 => 20.2358, std.dev.: 0.0327) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7555, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: -8.76% (1.2842 => 1.1717, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.91% (1.7753 => 1.7058, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.67% (2.2633 => 2.1802, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.96% (1.3096 => 1.2708, std.dev.: 0.0079) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.50% (6.5735 => 6.4746, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.02% (3.2107 => 3.1781, std.dev.: 0.0003) Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 5 05:53:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 5 Nov 2012 07:53:23 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121105135323.54C4D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5595?compare_to=5593&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5595, Order: 167381, Start Time: 2012-11-05 12:27:18, End Time: 2012-11-05 13:53:29 To: 5593, Order: 167380, Start Time: 2012-11-05 10:41:47, End Time: 2012-11-05 12:10:09 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 2 (42 on baseline) Performance Improvements: 15 (12 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 974 (920 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash: 4.01% (0.6331 => 0.6585, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/whetstone: 1.77% (2.1044 => 2.1417, std.dev.: 0.0141) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.45% (0.2498 => 0.2337, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -5.81% (0.5270 => 0.4964, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.88% (0.3196 => 0.3040, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.52% (0.8019 => 0.7737, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.30% (0.6401 => 0.6190, std.dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.87% (0.5059 => 0.4914, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.17% (0.9306 => 0.9104, std.dev.: 0.0076) SingleSource/UnitTests/Vector/constpool: -2.08% (8.4099 => 8.2352, std.dev.: 0.0654) MultiSource/Applications/lemon/lemon: -1.83% (1.1224 => 1.1019, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.49% (1.4860 => 1.4638, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.25% (0.8423 => 0.8318, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -8.99% (2.5358 => 2.3079, std.dev.: 0.0467) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.07% (1.2899 => 1.2374, std.dev.: 0.0119) MultiSource/Benchmarks/FreeBench/mason/mason: -2.99% (0.5624 => 0.5456, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.78% (22.7266 => 22.0958, std.dev.: 0.1648) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.28% (16.6075 => 16.5610, std.dev.: 0.0387) MultiSource/Applications/obsequi/Obsequi: 0.09% (1.0563 => 1.0572, std.dev.: 0.0117) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.24% (21.5252 => 21.4734, std.dev.: 0.1448) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.33% (0.3643 => 0.3631, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -0.35% (0.6024 => 0.6003, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.30% (0.3318 => 0.3361, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/strcat: -0.10% (0.1996 => 0.1994, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -23.50% (0.0217 => 0.0166, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0423 => 0.0423, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -20.00% (0.0330 => 0.0264, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0313 => 0.0313, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.72% (0.0419 => 0.0422, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0202 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -7.41% (0.0216 => 0.0200, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.20% (0.1473 => 0.1470, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.08% (1.1507 => 1.1383, std.dev.: 0.0424) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -5.46% (0.1484 => 0.1403, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.79% (0.4044 => 0.4157, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.30% (0.1303 => 0.1273, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.74% (0.0620 => 0.0637, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 16.37% (0.0226 => 0.0263, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.81% (0.0552 => 0.0542, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.82% (1.1449 => 1.1355, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1700.00% (0.0001 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 285.71% (0.0007 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.04% (0.0577 => 0.0571, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -23.85% (0.0260 => 0.0198, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.11% (0.8021 => 0.8012, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -33.90% (0.0059 => 0.0039, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2294.60% (0.6332 => 15.1626, std.dev.: 0.0654) MultiSource/Benchmarks/McCat/08-main/main: 46.26% (0.1831 => 0.2678, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.63% (0.1559 => 0.1440, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1475.63% (0.3344 => 5.2689, std.dev.: 0.0527) SingleSource/Benchmarks/Misc-C++/Large/ray: 34.48% (0.2364 => 0.3179, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: 1.86% (0.0429 => 0.0437, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.34% (0.0224 => 0.0221, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3209, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0694, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4887, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3440, std.dev.: 0.0176) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0263, std.dev.: 0.0349) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4047, std.dev.: 0.0040) SingleSource/Regression/C/uint64_to_float: -23.95% (2.1832 => 1.6604, std.dev.: 0.0078) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 10.88% (0.1112 => 0.1233, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.33% (0.2180 => 0.2318, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 3.66% (1.2222 => 1.2669, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.53% (0.7473 => 0.7737, std.dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.74% (0.4783 => 0.4914, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.59% (0.4127 => 0.4234, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.57% (1.9948 => 2.0461, std.dev.: 0.0165) MultiSource/Applications/hbd/hbd: 2.51% (1.4269 => 1.4627, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.08% (0.8712 => 0.8893, std.dev.: 0.0035) MultiSource/Applications/SIBsim4/SIBsim4: 1.96% (1.2568 => 1.2814, std.dev.: 0.0058) MultiSource/Applications/ClamAV/clamscan: 1.89% (14.7684 => 15.0475, std.dev.: 0.0291) MultiSource/Applications/lua/lua: 1.82% (3.8189 => 3.8885, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.81% (0.8697 => 0.8854, std.dev.: 0.0052) MultiSource/Applications/JM/lencod/lencod: 1.68% (15.3280 => 15.5861, std.dev.: 0.0450) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.65% (0.8007 => 0.8139, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 1.58% (0.6834 => 0.6942, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 1.50% (2.2184 => 2.2517, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.44% (0.8457 => 0.8579, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (0.9074 => 0.9204, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 1.39% (14.2605 => 14.4588, std.dev.: 0.0457) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.38% (0.8340 => 0.8455, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.38% (0.8050 => 0.8161, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.34% (0.8086 => 0.8194, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 1.18% (0.9810 => 0.9926, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.10% (1.4479 => 1.4638, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.07% (0.9908 => 1.0014, std.dev.: 0.0038) MultiSource/Benchmarks/PAQ8p/paq8p: 1.06% (2.3764 => 2.4015, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 57.16% (1.5795 => 2.4823, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C++/city/city: 56.78% (0.0199 => 0.0312, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 8.97% (3.1873 => 3.4731, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.90% (1.1857 => 1.2794, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 6.12% (0.6205 => 0.6585, std.dev.: 0.0080) MultiSource/Applications/hexxagon/hexxagon: 4.77% (14.0064 => 14.6747, std.dev.: 0.0090) MultiSource/Applications/siod/siod: 3.97% (3.6643 => 3.8096, std.dev.: 0.0183) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.56% (4.3552 => 4.4668, std.dev.: 0.0147) MultiSource/Benchmarks/mafft/pairlocalalign: 2.44% (63.1822 => 64.7214, std.dev.: 0.0475) SingleSource/Benchmarks/Misc/ReedSolomon: 2.13% (8.5322 => 8.7136, std.dev.: 0.0695) MultiSource/Applications/lambda-0_1_3/lambda: 2.02% (7.4933 => 7.6449, std.dev.: 0.0227) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.74% (28.5821 => 29.0798, std.dev.: 0.0628) MultiSource/Benchmarks/FreeBench/neural/neural: 1.30% (1.0841 => 1.0982, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.24% (1.5941 => 1.6138, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: 1.22% (2.3560 => 2.3847, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.17% (8.4179 => 8.2352, std.dev.: 0.0654) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -9.22% (3.2926 => 2.9889, std.dev.: 0.1110) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.78% (0.3269 => 0.2982, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.27% (2.8773 => 2.7543, std.dev.: 0.0360) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.95% (0.2605 => 0.2502, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/lists: -3.83% (7.3375 => 7.0562, std.dev.: 0.0199) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.2822 => 1.2374, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.36% (7.2130 => 6.9705, std.dev.: 0.0933) MultiSource/Applications/SPASS/SPASS: -2.98% (8.4326 => 8.1816, std.dev.: 0.0585) MultiSource/Applications/lua/lua: -2.29% (29.8330 => 29.1497, std.dev.: 0.0874) SingleSource/Benchmarks/Shootout-C++/hash2: -1.60% (3.4237 => 3.3688, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.31% (3.3479 => 3.3041, std.dev.: 0.0071) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.70% (16.4461 => 16.5610, std.dev.: 0.0387) MultiSource/Applications/obsequi/Obsequi: 3.02% (1.0262 => 1.0572, std.dev.: 0.0117) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6775.89% (0.3123 => 21.4734, std.dev.: 0.1448) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.42% (0.2463 => 0.3631, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -0.12% (0.6010 => 0.6003, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.91% (0.3266 => 0.3361, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/strcat: 1.27% (0.1969 => 0.1994, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 34.96% (0.0123 => 0.0166, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.68% (0.0408 => 0.0423, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.94% (0.0254 => 0.0264, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 11.11% (0.0180 => 0.0200, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.23% (0.1438 => 0.1470, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.48% (1.1329 => 1.1383, std.dev.: 0.0424) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.04% (0.1462 => 0.1403, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.17% (0.4164 => 0.4157, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -7.01% (0.1369 => 0.1273, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.62% (0.0641 => 0.0637, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 34.87% (0.0195 => 0.0263, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.23% (0.0578 => 0.0542, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.72% (1.1437 => 1.1355, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1700.00% (0.0001 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.93% (0.0627 => 0.0571, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 10.00% (0.0180 => 0.0198, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.06% (0.8017 => 0.8012, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -37.10% (0.0062 => 0.0039, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 3.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 5 06:00:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 5 Nov 2012 08:00:43 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121105140043.048F62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5596?compare_to=5594&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5596, Order: 167381, Start Time: 2012-11-05 12:35:57, End Time: 2012-11-05 14:00:48 To: 5594, Order: 167380, Start Time: 2012-11-05 10:48:02, End Time: 2012-11-05 12:13:00 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (180 on baseline) Unchanged Tests: 1041 (857 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.09% (79.2305 => 80.8848, std.dev.: 0.2525) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.05% (2.0478 => 2.1103, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4937 => 7.6765, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/hash2: 1.87% (3.1932 => 3.2530, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.46% (79.7170 => 80.8848, std.dev.: 0.2525) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.46% (0.1431 => 0.1310, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.80% (0.3821 => 0.3523, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -7.11% (2.4924 => 2.3153, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -6.58% (0.3357 => 0.3136, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.48% (0.9542 => 0.8924, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.47% (3.5339 => 3.3052, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.47% (0.2428 => 0.2271, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.46% (0.3142 => 0.2939, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.44% (22.4056 => 20.9637, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.29% (0.3658 => 0.3428, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -6.16% (0.2160 => 0.2027, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -6.06% (9.2283 => 8.6694, std.dev.: 0.0120) MultiSource/Applications/JM/lencod/lencod: -6.06% (16.1920 => 15.2115, std.dev.: 0.0058) MultiSource/Applications/JM/ldecod/ldecod: -6.00% (7.0961 => 6.6706, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/football/football: -5.99% (0.9179 => 0.8629, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.99% (0.9852 => 0.9262, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.98% (0.6484 => 0.6096, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -5.96% (1.1450 => 1.0768, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.90% (0.1796 => 0.1690, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.89% (1.0544 => 0.9923, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/gs/gs: -5.86% (4.3330 => 4.0790, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.86% (0.5857 => 0.5514, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -5.85% (0.1761 => 0.1658, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.83% (0.1716 => 0.1616, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.82% (1.6364 => 1.5412, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.79% (0.6681 => 0.6294, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: -5.78% (1.1530 => 1.0863, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.77% (0.5478 => 0.5162, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -5.75% (1.2515 => 1.1796, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.74% (1.4642 => 1.3801, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.74% (0.6304 => 0.5942, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.74% (1.2784 => 1.2050, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.71% (1.3722 => 1.2938, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: -5.70% (17.1032 => 16.1275, std.dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.70% (1.6474 => 1.5535, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.69% (1.2300 => 1.1600, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.68% (0.6052 => 0.5708, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.68% (0.7339 => 0.6922, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.67% (0.6230 => 0.5877, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.66% (4.0323 => 3.8041, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.65% (0.6667 => 0.6290, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.65% (0.5925 => 0.5590, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.65% (0.6446 => 0.6082, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.64% (0.5849 => 0.5519, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.64% (0.2695 => 0.2543, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.63% (0.5591 => 0.5276, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.63% (0.3483 => 0.3287, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.60% (0.7524 => 0.7103, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.59% (0.6194 => 0.5848, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.57% (4.5069 => 4.2560, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -5.57% (2.4021 => 2.2684, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.56% (0.6260 => 0.5912, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.55% (0.3406 => 0.3217, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.54% (0.6736 => 0.6363, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.52% (14.2083 => 13.4235, std.dev.: 0.0156) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.52% (5.4682 => 5.1663, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.52% (0.7919 => 0.7482, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.51% (0.5863 => 0.5540, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.50% (0.5581 => 0.5274, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.50% (0.5456 => 0.5156, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.50% (4.8161 => 4.5514, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.49% (0.5575 => 0.5269, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.49% (0.5705 => 0.5392, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.48% (0.6676 => 0.6310, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.48% (0.6297 => 0.5952, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.48% (0.2355 => 0.2226, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -5.46% (4.0594 => 3.8377, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.46% (0.5805 => 0.5488, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.46% (0.2548 => 0.2409, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.45% (0.5941 => 0.5617, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.45% (0.6189 => 0.5852, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.43% (0.5802 => 0.5487, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.43% (0.6395 => 0.6048, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.42% (0.5569 => 0.5267, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: -5.42% (0.2659 => 0.2515, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -5.41% (0.7447 => 0.7044, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.40% (0.6440 => 0.6092, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -5.40% (15.5079 => 14.6702, std.dev.: 0.0243) MultiSource/Benchmarks/Olden/bh/bh: -5.39% (0.2985 => 0.2824, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.39% (0.5859 => 0.5543, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.39% (4.8802 => 4.6170, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.38% (0.6395 => 0.6051, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.37% (0.5570 => 0.5271, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -5.34% (1.3864 => 1.3123, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.33% (0.6660 => 0.6305, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.32% (2.2587 => 2.1385, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.32% (0.6033 => 0.5712, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.30% (0.7021 => 0.6649, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.28% (0.8521 => 0.8071, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.28% (0.4151 => 0.3932, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.25% (0.5567 => 0.5275, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.24% (0.5688 => 0.5390, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.22% (6.7716 => 6.4182, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.21% (0.6293 => 0.5965, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: -5.16% (3.5154 => 3.3341, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.15% (0.5999 => 0.5690, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.15% (0.5168 => 0.4902, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.14% (0.5329 => 0.5055, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -5.12% (0.4515 => 0.4284, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -5.08% (0.4861 => 0.4614, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -5.05% (0.3581 => 0.3400, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -5.05% (1.3148 => 1.2484, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.04% (0.4916 => 0.4668, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.03% (0.9557 => 0.9076, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.01% (0.3931 => 0.3734, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.00% (0.2278 => 0.2164, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.97% (0.2999 => 0.2850, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.93% (0.7198 => 0.6843, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.93% (0.3837 => 0.3648, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -4.91% (18.2933 => 17.3947, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.91% (0.3849 => 0.3660, std.dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: -4.90% (0.7982 => 0.7591, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: -4.87% (34.0927 => 32.4313, std.dev.: 0.0142) MultiSource/Applications/treecc/treecc: -4.87% (2.1401 => 2.0359, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/exceptions: -4.84% (0.4176 => 0.3974, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.81% (1.2221 => 1.1633, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -4.81% (15.2527 => 14.5197, std.dev.: 0.0111) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.80% (0.4813 => 0.4582, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -4.79% (0.3025 => 0.2880, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.79% (1.2210 => 1.1625, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.79% (0.4321 => 0.4114, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.78% (0.4083 => 0.3888, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.75% (0.3891 => 0.3706, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.75% (0.3831 => 0.3649, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.74% (0.3880 => 0.3696, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -4.74% (0.6750 => 0.6430, std.dev.: 0.0111) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.74% (0.2385 => 0.2272, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -4.73% (0.3255 => 0.3101, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.73% (0.3491 => 0.3326, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -4.72% (0.3812 => 0.3632, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.71% (0.4033 => 0.3843, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -4.70% (0.3194 => 0.3044, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -4.68% (0.4248 => 0.4049, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.68% (2.1713 => 2.0697, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.68% (0.3848 => 0.3668, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.67% (0.3896 => 0.3714, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.66% (8.0126 => 7.6389, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ary2: -4.65% (0.3481 => 0.3319, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -4.64% (0.3446 => 0.3286, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.63% (0.3884 => 0.3704, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.61% (0.3252 => 0.3102, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -4.61% (0.3621 => 0.3454, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -4.57% (0.3394 => 0.3239, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.56% (0.2871 => 0.2740, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -4.56% (0.3026 => 0.2888, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -4.55% (0.4524 => 0.4318, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists1: -4.55% (0.3867 => 0.3691, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.55% (0.3057 => 0.2918, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.54% (0.3323 => 0.3172, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.52% (0.4427 => 0.4227, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.52% (0.2989 => 0.2854, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -4.49% (0.2939 => 0.2807, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.49% (0.3319 => 0.3170, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.48% (0.3016 => 0.2881, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.47% (0.8418 => 0.8042, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/parameter-passing: -4.44% (0.4280 => 0.4090, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.42% (0.2849 => 0.2723, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -4.40% (0.3205 => 0.3064, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -4.38% (0.3788 => 0.3622, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.36% (0.2933 => 0.2805, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.34% (0.2903 => 0.2777, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -4.32% (0.3059 => 0.2927, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: -4.30% (5.0226 => 4.8065, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/09-vor/vor: -4.28% (0.3271 => 0.3131, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: -3.83% (0.7779 => 0.7481, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.82% (0.9077 => 0.8730, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: -3.45% (0.6347 => 0.6128, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.33% (1.5610 => 1.5090, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -3.17% (0.6441 => 0.6237, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.55% (20.7746 => 20.2455, std.dev.: 0.0197) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7507, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1729, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.87% (2.2633 => 2.1758, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.80% (1.3096 => 1.2729, std.dev.: 0.0104) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4724, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.16% (1.6086 => 1.5900, std.dev.: 0.0054) Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 5 06:52:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 5 Nov 2012 08:52:51 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121105145251.66B342A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5597?compare_to=5592&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5597, Order: 167380, Start Time: 2012-11-05 11:37:08, End Time: 2012-11-05 14:52:58 To: 5592, Order: 167379, Start Time: 2012-11-05 07:29:33, End Time: 2012-11-05 10:48:46 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (169 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (720 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 17.53% (100.9714 => 118.6709, std.dev.: 0.0346) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.48% (0.0625 => 0.0878, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.61% (0.1063 => 0.1399, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.59% (0.1106 => 0.1389, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.43% (0.2969 => 0.3724, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.37% (0.0714 => 0.0888, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.35% (0.4139 => 0.5147, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 23.64% (1.5932 => 1.9699, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.63% (0.4253 => 0.5258, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.51% (0.5900 => 0.7287, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.97% (0.4994 => 0.6141, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.49% (0.0547 => 0.0670, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.43% (0.0584 => 0.0715, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.41% (0.0897 => 0.1098, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.32% (0.5000 => 0.6116, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.85% (0.1620 => 0.1974, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 21.37% (0.0599 => 0.0727, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.35% (0.1021 => 0.1239, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.23% (0.1107 => 0.1342, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 20.86% (0.0604 => 0.0730, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 20.57% (0.0948 => 0.1143, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.25% (0.0642 => 0.0772, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.22% (0.0633 => 0.0761, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.03% (0.0584 => 0.0701, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 19.89% (0.1619 => 0.1941, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.85% (0.1103 => 0.1322, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 19.85% (0.0821 => 0.0984, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.83% (0.0822 => 0.0985, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.82% (0.1549 => 0.1856, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.73% (0.3903 => 0.4673, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.51% (0.1604 => 0.1917, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.44% (0.1003 => 0.1198, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.48% (0.0947 => 0.1122, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.26% (0.1462 => 0.1729, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 18.21% (0.5826 => 0.6887, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.02% (0.2014 => 0.2377, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 17.95% (0.0808 => 0.0953, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.92% (0.3890 => 0.4587, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 17.90% (0.1218 => 0.1436, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 17.85% (0.5889 => 0.6940, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 17.85% (0.4029 => 0.4748, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 17.41% (0.1505 => 0.1767, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 17.34% (0.0698 => 0.0819) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.32% (0.2736 => 0.3210, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.28% (0.1088 => 0.1276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.13% (1.3152 => 1.5405, std.dev.: 0.0044) MultiSource/Applications/Burg/burg: 17.02% (0.5546 => 0.6490, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.97% (3.5627 => 4.1674, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.96% (0.2866 => 0.3352, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 16.87% (1.8794 => 2.1964, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.55% (0.1160 => 0.1352, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.43% (1.6211 => 1.8874, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.38% (0.4658 => 0.5421, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.32% (0.5026 => 0.5846, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.31% (0.1968 => 0.2289, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.11% (0.3271 => 0.3798, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 15.99% (0.7171 => 0.8318, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.93% (0.2875 => 0.3333, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 15.83% (0.1421 => 0.1646, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.73% (0.4361 => 0.5047, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 15.66% (0.9697 => 1.1216, std.dev.: 0.0041) MultiSource/Applications/d/make_dparser: 15.59% (1.0781 => 1.2462, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.39% (4.4195 => 5.0996, std.dev.: 0.0086) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.30% (2.7292 => 3.1468, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hello: 15.29% (0.2714 => 0.3129) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.22% (0.3930 => 0.4528, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: 15.19% (0.2725 => 0.3139, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 15.19% (0.1284 => 0.1479, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 15.17% (4.2109 => 4.8499, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.16% (0.2738 => 0.3153, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.15% (1.9694 => 2.2678, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 15.13% (0.2823 => 0.3250, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 15.11% (0.2780 => 0.3200, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 15.07% (0.2813 => 0.3237, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.06% (0.2729 => 0.3140, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/strcat: 15.02% (0.2750 => 0.3163, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.97% (0.2792 => 0.3210, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.96% (0.3195 => 0.3673, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 14.91% (0.3004 => 0.3452, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.91% (1.9966 => 2.2943, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 14.90% (0.9909 => 1.1385, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 14.89% (0.3096 => 0.3557, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 14.84% (0.2803 => 0.3219, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 14.76% (0.2811 => 0.3226, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.74% (0.2911 => 0.3340) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.72% (2.0673 => 2.3716, std.dev.: 0.0048) MultiSource/Benchmarks/Bullet/bullet: 14.71% (23.5202 => 26.9796, std.dev.: 0.0357) SingleSource/UnitTests/ObjC/synchronized: 14.50% (0.3469 => 0.3972, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.50% (0.1090 => 0.1248, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 14.45% (0.3446 => 0.3944, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 14.31% (0.3465 => 0.3961, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.31% (0.3060 => 0.3498, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.30% (0.3496 => 0.3996, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.28% (0.3488 => 0.3986, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 14.21% (0.3442 => 0.3931, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 14.18% (0.3258 => 0.3720, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 14.17% (0.3267 => 0.3730, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 14.16% (0.3460 => 0.3950, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 14.05% (0.3317 => 0.3783, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.95% (0.3362 => 0.3831, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.92% (0.3124 => 0.3559, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 13.86% (0.3650 => 0.4156, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 13.75% (0.3643 => 0.4144, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 13.70% (0.3678 => 0.4182, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.69% (0.3724 => 0.4234, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 13.68% (0.2566 => 0.2917, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.60% (0.3845 => 0.4368, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/lists: 13.59% (0.3348 => 0.3803, std.dev.: 0.0014) MultiSource/Applications/lua/lua: 13.57% (1.4269 => 1.6205, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 13.45% (0.2075 => 0.2354, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.38% (0.3282 => 0.3721, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.35% (0.3625 => 0.4109, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 13.34% (0.3726 => 0.4223, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 13.27% (0.7875 => 0.8920, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists1: 13.14% (0.3477 => 0.3934, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 13.05% (0.4146 => 0.4687, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.04% (0.3690 => 0.4171, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/hash2: 13.03% (0.4251 => 0.4805, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.94% (0.3981 => 0.4496, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 12.93% (2.1653 => 2.4452, std.dev.: 0.0074) MultiSource/Applications/JM/lencod/lencod: 12.71% (4.6177 => 5.2045, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/bigfib: 12.33% (0.5012 => 0.5630, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 12.23% (2.1013 => 2.3583, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.86% (0.2040 => 0.2282, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 11.52% (0.2691 => 0.3001, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.42% (0.1383 => 0.1541, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11.25% (5.5417 => 6.1653, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.03% (0.6435 => 0.7145, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 10.50% (0.4847 => 0.5356, std.dev.: 0.0055) MultiSource/Applications/siod/siod: 10.36% (0.6634 => 0.7321, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.31% (0.1028 => 0.1134, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 10.29% (0.3498 => 0.3858, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.25% (0.3084 => 0.3400, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.20% (0.2068 => 0.2279, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.19% (0.2737 => 0.3016, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 9.71% (0.3336 => 0.3660, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.08% (0.2103 => 0.2294, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 8.81% (2.0346 => 2.2139, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: 8.78% (0.2391 => 0.2601, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.37% (4.6926 => 5.0853, std.dev.: 0.0127) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.19% (11.6398 => 12.5935, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.63% (0.5361 => 0.5770, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.16% (0.5584 => 0.5984, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.94% (0.7426 => 0.7941, std.dev.: 0.0034) MultiSource/Applications/kimwitu++/kc: 6.18% (11.9555 => 12.6946, std.dev.: 0.0137) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.91% (0.3792 => 0.3978, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6532, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 8.21% (0.2802 => 0.3032, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6094, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.01% (12.0509 => 12.6546, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1680, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.95% (0.3693 => 0.3839, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-2: 3.74% (1.8057 => 1.8733, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/dry: 2.54% (14.0481 => 14.4048, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2033, std.dev.: 0.0063) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.75% (3.1722 => 3.2276, std.dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3057, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2893, std.dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.25% (1.0142 => 1.0269, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5147, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.07% (1.2451 => 1.2584, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5882, std.dev.: 0.0094) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.91% (2.4764 => 2.4291, std.dev.: 0.0132) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.60% (25.4195 => 16.3711, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/ary2: -8.70% (0.2402 => 0.2193, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9771, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7752, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2421, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -3.39% (11.2080 => 10.8279, std.dev.: 0.0448) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.05% (0.6293 => 0.6101, std.dev.: 0.0064) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel-2: -2.87% (3.6262 => 3.5222, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -2.41% (17.2379 => 16.8223, std.dev.: 0.0290) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8732, std.dev.: 0.0147) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5771, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/bh/bh: -1.57% (5.5810 => 5.4933, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7161, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1761, std.dev.: 0.0544) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0419, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.07% (3.3991 => 3.3626, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 5 08:48:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 5 Nov 2012 10:48:16 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121105164816.1E5262A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5598?compare_to=5595&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5598, Order: 167383, Start Time: 2012-11-05 15:22:05, End Time: 2012-11-05 16:48:23 To: 5595, Order: 167381, Start Time: 2012-11-05 12:27:18, End Time: 2012-11-05 13:53:29 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 10 (46 on baseline) Performance Improvements: 3 (10 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 978 (918 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.86% (1.1489 => 1.1933, std.dev.: 0.0139) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.49% (0.6190 => 0.6406, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/gs/gs: 3.34% (4.0825 => 4.2190, std.dev.: 0.0482) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.64% (1.2368 => 1.2694, std.dev.: 0.0074) MultiSource/Benchmarks/nbench/nbench: 1.91% (1.1267 => 1.1482, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.40% (4.2030 => 4.2620, std.dev.: 0.0158) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.35% (0.3167 => 0.3463, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.54% (3.0746 => 3.1833, std.dev.: 0.0315) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.10% (0.8626 => 0.8807, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.05% (3.9091 => 3.9500, std.dev.: 0.0108) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/treecc/treecc: -1.94% (2.0461 => 2.0065, std.dev.: 0.0152) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash: -4.77% (0.6585 => 0.6271, std.dev.: 0.0035) MultiSource/Applications/siod/siod: -1.47% (3.8096 => 3.7536, std.dev.: 0.0050) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.81% (16.5610 => 16.6947, std.dev.: 0.1119) MultiSource/Applications/obsequi/Obsequi: 0.91% (1.0572 => 1.0668, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.11% (21.4734 => 21.4979, std.dev.: 0.2780) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.17% (0.3631 => 0.3625, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: -0.13% (0.6003 => 0.5995, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: -1.52% (0.3361 => 0.3310, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -0.40% (0.1994 => 0.1986, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -12.65% (0.0166 => 0.0145, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -11.11% (0.0423 => 0.0376, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 25.00% (0.0264 => 0.0330, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -7.99% (0.0313 => 0.0288, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.42% (0.0422 => 0.0416, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -7.92% (0.0202 => 0.0186, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: -8.00% (0.0200 => 0.0184, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.20% (0.1470 => 0.1467, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -2.41% (1.1383 => 1.1109, std.dev.: 0.0284) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 1.35% (0.1403 => 0.1422, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.95% (0.4157 => 0.4076, std.dev.: 0.0331) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.73% (0.1273 => 0.1346, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.28% (0.0637 => 0.0597, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.27% (0.0263 => 0.0236, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.24% (0.0542 => 0.0565, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.75% (1.1355 => 1.1440, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -94.44% (0.0018 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.85% (0.0571 => 0.0549, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.53% (0.0198 => 0.0203, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.01% (0.8012 => 0.8011, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 82.05% (0.0039 => 0.0071, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2296.76% (0.6332 => 15.1763, std.dev.: 0.0674) MultiSource/Benchmarks/McCat/08-main/main: 46.37% (0.1831 => 0.2680, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.12% (0.1559 => 0.1448, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1476.47% (0.3344 => 5.2717, std.dev.: 0.0516) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.18% (0.2364 => 0.3243, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: -1.17% (0.0429 => 0.0424, std.dev.: 0.0008) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.45% (0.0224 => 0.0225, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0011) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3348, std.dev.: 0.0266) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0701, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4901, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3404, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0392, std.dev.: 0.0167) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4009, std.dev.: 0.0087) SingleSource/Regression/C/uint64_to_float: -23.90% (2.1832 => 1.6614, std.dev.: 0.0111) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.81% (0.0810 => 0.0930, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.30% (0.1425 => 0.1529, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.11% (0.2180 => 0.2335, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.64% (0.3137 => 0.3314, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.47% (0.2998 => 0.3102, std.dev.: 0.0032) MultiSource/Applications/Burg/burg: 3.25% (1.2222 => 1.2619, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.87% (0.6227 => 0.6406, std.dev.: 0.0044) MultiSource/Applications/ClamAV/clamscan: 2.76% (14.7684 => 15.1762, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.57% (0.5961 => 0.6114, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.56% (1.1606 => 1.1903, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.45% (0.4127 => 0.4228, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.07% (6.6074 => 6.7443, std.dev.: 0.0306) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.05% (4.1763 => 4.2620, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.97% (0.8697 => 0.8868, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 1.94% (3.8189 => 3.8931, std.dev.: 0.0244) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.93% (1.4479 => 1.4758, std.dev.: 0.0048) MultiSource/Benchmarks/nbench/nbench: 1.87% (1.1271 => 1.1482, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.76% (0.8007 => 0.8148, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.57% (0.8340 => 0.8471, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.50% (0.8855 => 0.8988, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 1.41% (6.7320 => 6.8266, std.dev.: 0.0191) MultiSource/Applications/hexxagon/hexxagon: 1.36% (0.9810 => 0.9943, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.29% (0.9074 => 0.9191, std.dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 1.25% (15.3280 => 15.5202, std.dev.: 0.0336) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.25% (0.8317 => 0.8421, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.25% (0.8331 => 0.8435, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 1.18% (14.2605 => 14.4283, std.dev.: 0.0509) MultiSource/Applications/lemon/lemon: 1.09% (1.0945 => 1.1064, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 62.81% (0.0199 => 0.0324, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/pi: 57.90% (1.5795 => 2.4940, std.dev.: 0.0113) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.18% (14.6451 => 17.0144, std.dev.: 0.4096) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.69% (0.3186 => 0.3463, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 8.40% (3.1873 => 3.4551, std.dev.: 0.0199) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.09% (1.1857 => 1.2816, std.dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 4.83% (14.0064 => 14.6823, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.32% (3.0515 => 3.1833, std.dev.: 0.0315) MultiSource/Benchmarks/sim/sim: 3.20% (3.8206 => 3.9429, std.dev.: 0.0267) SingleSource/Benchmarks/Misc/ReedSolomon: 3.01% (8.5322 => 8.7892, std.dev.: 0.0184) MultiSource/Applications/siod/siod: 2.44% (3.6643 => 3.7536, std.dev.: 0.0050) MultiSource/Applications/lambda-0_1_3/lambda: 2.05% (7.4933 => 7.6472, std.dev.: 0.0227) MultiSource/Benchmarks/mafft/pairlocalalign: 2.01% (63.1822 => 64.4523, std.dev.: 0.2135) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.77% (28.5821 => 29.0878, std.dev.: 0.0482) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.54% (4.8362 => 4.9106, std.dev.: 0.0161) MultiSource/Benchmarks/Olden/bh/bh: 1.40% (2.3560 => 2.3889, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 1.31% (1.0841 => 1.0983, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.27% (3.9006 => 3.9500, std.dev.: 0.0108) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -34.32% (0.0338 => 0.0222, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.32% (0.3269 => 0.2997, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/heapsort: -6.24% (3.2926 => 3.0871, std.dev.: 0.0653) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.38% (2.8773 => 2.7512, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout/lists: -3.62% (7.3375 => 7.0721, std.dev.: 0.0611) MultiSource/Benchmarks/Olden/bisort/bisort: -3.09% (0.6636 => 0.6431, std.dev.: 0.0059) MultiSource/Applications/SPASS/SPASS: -3.06% (8.4326 => 8.1745, std.dev.: 0.0695) MultiSource/Applications/lua/lua: -2.64% (29.8330 => 29.0465, std.dev.: 0.1336) SingleSource/Benchmarks/Shootout-C++/hash2: -1.50% (3.4237 => 3.3722, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.46% (3.3479 => 3.2990, std.dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.51% (16.4461 => 16.6947, std.dev.: 0.1119) MultiSource/Applications/obsequi/Obsequi: 3.96% (1.0262 => 1.0668, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6783.73% (0.3123 => 21.4979, std.dev.: 0.2780) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.18% (0.2463 => 0.3625, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: -0.25% (0.6010 => 0.5995, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.35% (0.3266 => 0.3310, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 0.86% (0.1969 => 0.1986, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 17.89% (0.0123 => 0.0145, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -7.84% (0.0408 => 0.0376, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -4.64% (0.0302 => 0.0288, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.33% (0.0384 => 0.0416, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -2.11% (0.0190 => 0.0186, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: 2.22% (0.0180 => 0.0184, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.02% (0.1438 => 0.1467, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.94% (1.1329 => 1.1109, std.dev.: 0.0284) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -2.74% (0.1462 => 0.1422, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.11% (0.4164 => 0.4076, std.dev.: 0.0331) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.68% (0.1369 => 0.1346, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.86% (0.0641 => 0.0597, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 21.03% (0.0195 => 0.0236, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.25% (0.0578 => 0.0565, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.03% (1.1437 => 1.1440, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.44% (0.0627 => 0.0549, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 12.78% (0.0180 => 0.0203, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.07% (0.8017 => 0.8011, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 14.52% (0.0062 => 0.0071, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 5 08:52:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 5 Nov 2012 10:52:18 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121105165218.F05A42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5599?compare_to=5596&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5599, Order: 167383, Start Time: 2012-11-05 15:27:32, End Time: 2012-11-05 16:52:25 To: 5596, Order: 167381, Start Time: 2012-11-05 12:35:57, End Time: 2012-11-05 14:00:48 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 1 (178 on baseline) Unchanged Tests: 1040 (859 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.66% (54.4808 => 56.4754, std.dev.: 0.0792) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.38% (80.8848 => 78.9617, std.dev.: 0.5908) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.48% (54.5751 => 56.4754, std.dev.: 0.0792) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.69% (2.0478 => 2.1029, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/salsa20: 2.58% (7.4937 => 7.6874, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/hash2: 1.96% (3.1932 => 3.2557, std.dev.: 0.0101) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.60% (0.1431 => 0.1308, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.75% (0.3821 => 0.3525, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.17% (2.4924 => 2.3136, std.dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.50% (3.5339 => 3.3041, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.49% (0.3142 => 0.2938, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.42% (0.9542 => 0.8929, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.39% (22.4056 => 20.9728, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.38% (0.2428 => 0.2273, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.37% (0.3357 => 0.3143, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.15% (0.3658 => 0.3433, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -6.09% (9.2283 => 8.6659, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/football/football: -6.08% (0.9179 => 0.8621, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -6.07% (7.0961 => 6.6651, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: -6.05% (16.1920 => 15.2116, std.dev.: 0.0141) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.02% (0.9852 => 0.9259, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -6.02% (0.2160 => 0.2030, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.99% (1.0544 => 0.9912, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: -5.94% (1.1450 => 1.0770, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.89% (0.6484 => 0.6102, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.89% (0.1716 => 0.1615, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.85% (0.1796 => 0.1691, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.84% (1.6474 => 1.5512, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.84% (0.5857 => 0.5515, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: -5.83% (1.2515 => 1.1785, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: -5.83% (4.3330 => 4.0803, std.dev.: 0.0048) MultiSource/Benchmarks/nbench/nbench: -5.79% (1.1530 => 1.0862, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.77% (1.2784 => 1.2047, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.76% (1.6364 => 1.5421, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.76% (0.6304 => 0.5941, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.76% (1.3722 => 1.2932, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.75% (0.5478 => 0.5163, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.74% (1.4642 => 1.3801, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -5.74% (0.1761 => 0.1660, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.72% (0.7339 => 0.6919, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -5.71% (17.1032 => 16.1269, std.dev.: 0.0200) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.71% (1.2300 => 1.1598, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.70% (0.6230 => 0.5875, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -5.69% (2.4021 => 2.2654, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.69% (4.0323 => 3.8029, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.69% (0.6297 => 0.5939, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.66% (0.5849 => 0.5518, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.65% (0.5591 => 0.5275, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.64% (0.2695 => 0.2543, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.63% (0.6052 => 0.5711, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.63% (0.5575 => 0.5261, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.61% (0.6681 => 0.6306, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.61% (0.6667 => 0.6293, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.60% (0.5925 => 0.5593, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.60% (0.6194 => 0.5847, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.60% (0.6446 => 0.6085, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.60% (14.2083 => 13.4132, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.59% (4.5069 => 4.2550, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.58% (0.5802 => 0.5478, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.58% (0.7524 => 0.7104, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.57% (0.5705 => 0.5387, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.56% (0.5859 => 0.5533, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.54% (0.5863 => 0.5538, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.54% (0.6676 => 0.6306, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.54% (0.6736 => 0.6363, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.53% (0.6260 => 0.5914, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.52% (0.6395 => 0.6042, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.51% (0.3483 => 0.3291, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.50% (0.5941 => 0.5614, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.50% (4.8161 => 4.5513, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.50% (0.6440 => 0.6086, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.49% (0.2548 => 0.2408, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.49% (0.6033 => 0.5702, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.48% (0.5570 => 0.5265, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.46% (0.5581 => 0.5276, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.46% (0.6189 => 0.5851, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.46% (0.7919 => 0.7487, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: -5.45% (15.5079 => 14.6628, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.44% (0.5569 => 0.5266, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.44% (5.4682 => 5.1708, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.44% (4.8802 => 4.6148, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.44% (0.2355 => 0.2227, std.dev.: 0.0039) MultiSource/Applications/minisat/minisat: -5.43% (0.7447 => 0.7043, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.42% (0.6660 => 0.6299, std.dev.: 0.0109) MultiSource/Applications/lua/lua: -5.42% (4.0594 => 3.8395, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.41% (0.7021 => 0.6641, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: -5.38% (0.2659 => 0.2516, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.37% (0.5805 => 0.5493, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.33% (2.2587 => 2.1382, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.33% (0.5456 => 0.5165, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.33% (6.7716 => 6.4105, std.dev.: 0.0090) MultiSource/Applications/SIBsim4/SIBsim4: -5.33% (1.3864 => 1.3125, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.32% (0.5567 => 0.5271, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.30% (0.4151 => 0.3931, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -5.29% (0.2985 => 0.2827, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.28% (0.8521 => 0.8071, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.24% (0.5329 => 0.5050, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.23% (0.6293 => 0.5964, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.17% (0.5688 => 0.5394, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -5.16% (0.4861 => 0.4610, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.16% (0.4515 => 0.4282, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -5.14% (0.3581 => 0.3397, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -5.14% (3.5154 => 3.3348, std.dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: -5.13% (1.3148 => 1.2473, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.12% (0.5999 => 0.5692, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.09% (0.2278 => 0.2162, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.09% (0.3931 => 0.3731, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.07% (0.5168 => 0.4906, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.07% (0.2999 => 0.2847, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.03% (0.9557 => 0.9076, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.02% (0.4916 => 0.4669, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -5.00% (0.7982 => 0.7583, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.99% (0.7198 => 0.6839, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -4.99% (2.1401 => 2.0334, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/bigfib: -4.98% (0.6750 => 0.6414, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.94% (0.3849 => 0.3659, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -4.93% (18.2933 => 17.3923, std.dev.: 0.0210) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.91% (0.4321 => 0.4109, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.90% (0.3837 => 0.3649, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.89% (1.2221 => 1.1623, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: -4.86% (0.3025 => 0.2878, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -4.86% (15.2527 => 14.5115, std.dev.: 0.0129) MultiSource/Benchmarks/Bullet/bullet: -4.84% (34.0927 => 32.4422, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.84% (1.2210 => 1.1619, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.82% (0.2385 => 0.2270, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.79% (8.0126 => 7.6284, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions: -4.79% (0.4176 => 0.3976, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.78% (0.3323 => 0.3164, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.78% (0.4813 => 0.4583, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -4.78% (0.4248 => 0.4045, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.76% (2.1713 => 2.0679, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.76% (0.3491 => 0.3325, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.73% (0.3319 => 0.3162, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.71% (0.4033 => 0.3843, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.70% (0.3848 => 0.3667, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -4.70% (0.3255 => 0.3102, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -4.69% (0.4524 => 0.4312, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -4.68% (0.3481 => 0.3318, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.68% (0.4083 => 0.3892, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.67% (0.3252 => 0.3100, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.67% (0.3896 => 0.3714, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.66% (0.3880 => 0.3699, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.66% (0.3884 => 0.3703, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -4.64% (0.3446 => 0.3286, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -4.63% (0.3194 => 0.3046, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -4.63% (0.2871 => 0.2738, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.63% (0.3891 => 0.3711, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -4.63% (0.3394 => 0.3237, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.62% (0.3831 => 0.3654, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -4.62% (0.2989 => 0.2851, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.60% (0.3867 => 0.3689, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -4.59% (0.3026 => 0.2887, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -4.58% (0.3621 => 0.3455, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.58% (0.3057 => 0.2917, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -4.56% (0.3812 => 0.3638, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.52% (0.4427 => 0.4227, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.50% (0.2933 => 0.2801, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: -4.49% (0.3205 => 0.3061, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -4.49% (0.2939 => 0.2807, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.46% (0.2849 => 0.2722, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.44% (0.2903 => 0.2774, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.41% (0.3016 => 0.2883, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.39% (0.4280 => 0.4092, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -4.38% (0.8418 => 0.8049, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: -4.38% (0.3788 => 0.3622, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.37% (0.3271 => 0.3128, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: -4.32% (5.0226 => 4.8057, std.dev.: 0.0031) SingleSource/Regression/C++/ofstream_ctor: -4.09% (0.3059 => 0.2934, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -3.84% (0.7779 => 0.7480, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.83% (0.9077 => 0.8729) SingleSource/UnitTests/ObjC++/Hello: -3.53% (0.6347 => 0.6123, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.47% (1.5610 => 1.5069, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: -3.26% (0.6441 => 0.6231, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/BoolLiteralTest: -2.84% (0.3834 => 0.3725, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -2.61% (20.7746 => 20.2316, std.dev.: 0.0216) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.53% (7.5137 => 5.7454, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/richards_benchmark: -8.74% (1.2842 => 1.1720, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/fbench: -3.87% (2.2633 => 2.1756, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.37% (1.3096 => 1.2655, std.dev.: 0.0131) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4735, std.dev.: 0.0014) Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 5 10:46:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 5 Nov 2012 12:46:35 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121105184635.C293A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5600?compare_to=5598&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5600, Order: 167385, Start Time: 2012-11-05 17:19:47, End Time: 2012-11-05 18:46:43 To: 5598, Order: 167383, Start Time: 2012-11-05 15:22:05, End Time: 2012-11-05 16:48:23 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 15 (67 on baseline) Performance Improvements: 0 (9 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 976 (898 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 33.33% (0.0342 => 0.0456, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/treeadd/treeadd: 29.59% (0.0365 => 0.0473, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.96% (0.1139 => 0.1241, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.11% (0.8646 => 0.9001, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.17% (0.3345 => 0.3451, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.95% (0.7748 => 0.7899, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.60% (1.3324 => 1.3537, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.59% (1.1224 => 1.1403, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.54% (1.2624 => 1.2819, std.dev.: 0.0067) MultiSource/Applications/hbd/hbd: 1.26% (1.4606 => 1.4790, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 10.17% (20.0867 => 22.1301, std.dev.: 0.6011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.80% (59.6705 => 61.3403, std.dev.: 0.1730) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.34% (4.3428 => 4.4443, std.dev.: 0.0247) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.13% (3.5696 => 3.6098, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.08% (1.5953 => 1.6125, std.dev.: 0.0063) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.15% (16.6947 => 16.6689, std.dev.: 0.1835) MultiSource/Applications/obsequi/Obsequi: -0.05% (1.0668 => 1.0663, std.dev.: 0.0159) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.01% (21.4979 => 21.4950, std.dev.: 0.3298) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.14% (0.3625 => 0.3630, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/bigfib: 0.87% (0.5995 => 0.6047, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.30% (0.3310 => 0.3320, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 1.21% (0.1986 => 0.2010, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 48.97% (0.0145 => 0.0216, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -8.24% (0.0376 => 0.0345, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.30% (0.0330 => 0.0329, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 8.68% (0.0288 => 0.0313, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.64% (0.0416 => 0.0427, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 8.60% (0.0186 => 0.0202, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 19.02% (0.0184 => 0.0219, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.89% (0.1467 => 0.1480, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: 1.64% (1.1109 => 1.1291, std.dev.: 0.0715) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.27% (0.1422 => 0.1404, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.82% (0.4076 => 0.4002, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.34% (0.1346 => 0.1328, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.56% (0.0597 => 0.0672, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 17.37% (0.0236 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.71% (0.0565 => 0.0561, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.03% (1.1440 => 1.1444, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1400.00% (0.0001 => 0.0015, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 900.00% (0.0001 => 0.0010, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 17.85% (0.0549 => 0.0647, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.53% (0.0203 => 0.0267, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.21% (0.8011 => 0.7994, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -42.25% (0.0071 => 0.0041, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2285.17% (0.6332 => 15.1029, std.dev.: 0.2067) MultiSource/Benchmarks/McCat/08-main/main: 47.79% (0.1831 => 0.2706, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.75% (0.1559 => 0.1485, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1475.12% (0.3344 => 5.2672, std.dev.: 0.0763) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.97% (0.2364 => 0.3238, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/mandel: 2.10% (0.0429 => 0.0438, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.46% (0.0224 => 0.0234, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3211, std.dev.: 0.0218) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0723, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4937, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3399, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0320, std.dev.: 0.0328) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4006, std.dev.: 0.0040) SingleSource/Regression/C/uint64_to_float: -23.85% (2.1832 => 1.6624, std.dev.: 0.0115) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.04% (0.0810 => 0.0948, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.77% (0.0830 => 0.0936, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 10.97% (0.1112 => 0.1234, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.45% (0.3137 => 0.3402, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.35% (0.2180 => 0.2362, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.17% (0.8321 => 0.9001, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.72% (0.1425 => 0.1535, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.57% (0.6010 => 0.6405, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/em3d/em3d: 6.28% (0.1721 => 0.1829, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.23% (0.2279 => 0.2421, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.72% (0.8148 => 0.8614, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.70% (0.7473 => 0.7899, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.28% (0.4847 => 0.5103, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.73% (0.3295 => 0.3451, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.39% (0.6287 => 0.6563, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.29% (0.2519 => 0.2627, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.73% (0.9435 => 0.9787, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.71% (1.1685 => 1.2118, std.dev.: 0.0076) MultiSource/Applications/hbd/hbd: 3.65% (1.4269 => 1.4790, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.22% (0.4783 => 0.4937, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.20% (0.5961 => 0.6152, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 2.95% (1.2222 => 1.2583, std.dev.: 0.0100) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.87% (6.6074 => 6.7973, std.dev.: 0.0252) MultiSource/Benchmarks/MallocBench/gs/gs: 2.87% (4.1305 => 4.2489, std.dev.: 0.0201) MultiSource/Benchmarks/McCat/05-eks/eks: 2.75% (0.4397 => 0.4518, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.74% (0.8007 => 0.8226, std.dev.: 0.0039) MultiSource/Applications/lua/lua: 2.56% (3.8189 => 3.9166, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.47% (0.4127 => 0.4229, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.47% (0.8066 => 0.8265, std.dev.: 0.0067) MultiSource/Benchmarks/nbench/nbench: 2.43% (1.1271 => 1.1545, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.34% (1.2526 => 1.2819, std.dev.: 0.0067) MultiSource/Applications/ClamAV/clamscan: 2.32% (14.7684 => 15.1116, std.dev.: 0.1237) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.21% (4.1763 => 4.2688, std.dev.: 0.0297) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.09% (1.1170 => 1.1403, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.06% (0.6227 => 0.6355, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.94% (1.3279 => 1.3537, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.88% (8.6476 => 8.8103, std.dev.: 0.0463) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.81% (0.8697 => 0.8854, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.80% (0.7932 => 0.8075, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.77% (4.4880 => 4.5673, std.dev.: 0.0190) MultiSource/Applications/d/make_dparser: 1.63% (3.2366 => 3.2893, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.62% (0.8457 => 0.8594, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 1.59% (14.2605 => 14.4870, std.dev.: 0.0848) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.58% (0.8712 => 0.8850, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 1.55% (0.6834 => 0.6940, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 1.41% (0.9810 => 0.9948, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: 1.40% (0.8768 => 0.8891, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 57.48% (1.5795 => 2.4874, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C++/city/city: 55.28% (0.0199 => 0.0309, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.40% (14.6451 => 16.6071, std.dev.: 0.3922) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.01% (0.3186 => 0.3473, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 8.35% (3.1873 => 3.4533, std.dev.: 0.0305) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.16% (1.1857 => 1.2824, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 4.76% (14.0064 => 14.6731, std.dev.: 0.0100) MultiSource/Benchmarks/FreeBench/distray/distray: 4.64% (0.2390 => 0.2501, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.50% (59.2638 => 61.3403, std.dev.: 0.1730) SingleSource/Benchmarks/Misc/ReedSolomon: 3.44% (8.5322 => 8.8256, std.dev.: 0.0870) MultiSource/Applications/siod/siod: 2.85% (3.6643 => 3.7687, std.dev.: 0.0077) MultiSource/Benchmarks/sim/sim: 2.73% (3.8206 => 3.9249, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.34% (44.5605 => 45.6024, std.dev.: 0.3038) MultiSource/Benchmarks/mafft/pairlocalalign: 2.13% (63.1822 => 64.5260, std.dev.: 0.1493) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.05% (4.3552 => 4.4443, std.dev.: 0.0247) MultiSource/Applications/lambda-0_1_3/lambda: 1.86% (7.4933 => 7.6324, std.dev.: 0.0084) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.73% (28.5821 => 29.0779, std.dev.: 0.0245) MultiSource/Benchmarks/FreeBench/neural/neural: 1.32% (1.0841 => 1.0984, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 1.20% (2.3560 => 2.3843, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.15% (1.5941 => 1.6125, std.dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -8.56% (3.2926 => 3.0107, std.dev.: 0.0859) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.30% (0.3269 => 0.3063, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.63% (2.8773 => 2.7442, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout/lists: -3.23% (7.3375 => 7.1004, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/bisort/bisort: -2.88% (0.6636 => 0.6445, std.dev.: 0.0061) MultiSource/Applications/lua/lua: -2.65% (29.8330 => 29.0422, std.dev.: 0.2440) SingleSource/Benchmarks/Misc/ffbench: -2.29% (1.4296 => 1.3968, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/hash2: -1.73% (3.4237 => 3.3646, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.25% (3.3479 => 3.3060, std.dev.: 0.0049) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.35% (16.4461 => 16.6689, std.dev.: 0.1835) MultiSource/Applications/obsequi/Obsequi: 3.91% (1.0262 => 1.0663, std.dev.: 0.0159) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6782.80% (0.3123 => 21.4950, std.dev.: 0.3298) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.38% (0.2463 => 0.3630, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/bigfib: 0.62% (0.6010 => 0.6047, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.65% (0.3266 => 0.3320, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 2.08% (0.1969 => 0.2010, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 75.61% (0.0123 => 0.0216, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -15.44% (0.0408 => 0.0345, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.53% (0.0254 => 0.0329, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.20% (0.0384 => 0.0427, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.92% (0.1438 => 0.1480, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: -0.34% (1.1329 => 1.1291, std.dev.: 0.0715) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.97% (0.1462 => 0.1404, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.89% (0.4164 => 0.4002, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.99% (0.1369 => 0.1328, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.84% (0.0641 => 0.0672, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.94% (0.0578 => 0.0561, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.06% (1.1437 => 1.1444, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1400.00% (0.0001 => 0.0015, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -28.57% (0.0014 => 0.0010, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.19% (0.0627 => 0.0647, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.29% (0.8017 => 0.7994, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -33.87% (0.0062 => 0.0041, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 5 10:50:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 5 Nov 2012 12:50:36 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121105185036.D026C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5601?compare_to=5599&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5601, Order: 167385, Start Time: 2012-11-05 17:25:51, End Time: 2012-11-05 18:50:42 To: 5599, Order: 167383, Start Time: 2012-11-05 15:27:32, End Time: 2012-11-05 16:52:25 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (178 on baseline) Unchanged Tests: 1042 (860 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.69% (2.0478 => 2.1029, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: 2.45% (7.4937 => 7.6775, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/hash2: 2.08% (3.1932 => 3.2595, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.46% (0.1431 => 0.1310) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.72% (0.3821 => 0.3526, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -7.07% (2.4924 => 2.3162, std.dev.: 0.0109) MultiSource/Applications/sgefa/sgefa: -6.61% (0.3357 => 0.3135, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.52% (0.3142 => 0.2937, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.51% (0.2428 => 0.2270, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.43% (3.5339 => 3.3065, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.42% (0.9542 => 0.8929, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.33% (22.4056 => 20.9864, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.15% (0.3658 => 0.3433, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -6.13% (16.1920 => 15.2001, std.dev.: 0.0097) MultiSource/Benchmarks/mafft/pairlocalalign: -6.12% (9.2283 => 8.6635, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/ReedSolomon: -6.07% (0.1879 => 0.1765, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.06% (1.0544 => 0.9905, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: -6.00% (0.9179 => 0.8628, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: -6.00% (7.0961 => 6.6703, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.99% (0.9852 => 0.9262, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -5.97% (0.2160 => 0.2031, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: -5.96% (0.1761 => 0.1656, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -5.90% (1.1450 => 1.0774, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.89% (0.5857 => 0.5512, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.89% (1.3722 => 1.2914, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/gs/gs: -5.88% (4.3330 => 4.0781, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.86% (0.6484 => 0.6104, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.85% (0.1796 => 0.1691, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.80% (1.2784 => 1.2043, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: -5.78% (1.1530 => 1.0863, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.78% (1.6474 => 1.5521, std.dev.: 0.0121) MultiSource/Applications/Burg/burg: -5.75% (1.2515 => 1.1796, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.74% (0.6304 => 0.5942, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.73% (1.6364 => 1.5427, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.72% (1.4642 => 1.3804, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: -5.71% (17.1032 => 16.1270, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.69% (0.5849 => 0.5516, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.69% (4.0323 => 3.8030, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.67% (1.2300 => 1.1602, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.67% (0.7339 => 0.6923, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.65% (0.5591 => 0.5275, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.65% (0.5575 => 0.5260, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.65% (0.6446 => 0.6082, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.64% (0.6667 => 0.6291, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.63% (0.3483 => 0.3287, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.62% (0.5478 => 0.5170, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.62% (0.6297 => 0.5943, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.62% (0.5802 => 0.5476, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.61% (0.7524 => 0.7102, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.60% (0.2695 => 0.2544, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.60% (0.6194 => 0.5847, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.60% (0.6660 => 0.6287, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -5.59% (2.4021 => 2.2678, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.59% (4.5069 => 4.2551, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.58% (0.6681 => 0.6308, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.58% (0.3406 => 0.3216, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.57% (0.6230 => 0.5883, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.57% (0.7919 => 0.7478, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.55% (0.6736 => 0.6362, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.55% (0.5859 => 0.5534, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.54% (0.5863 => 0.5538, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.54% (0.6260 => 0.5913, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.54% (0.5705 => 0.5389, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.54% (0.5925 => 0.5597, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.54% (0.6052 => 0.5717, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.52% (0.2355 => 0.2225, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.51% (0.6676 => 0.6308, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.51% (4.8161 => 4.5507, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.51% (14.2083 => 13.4259, std.dev.: 0.0126) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.49% (0.2548 => 0.2408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.49% (0.5941 => 0.5615, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.48% (0.5456 => 0.5157, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.47% (0.6395 => 0.6045, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.46% (0.5581 => 0.5276, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.46% (0.5569 => 0.5265, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.46% (0.5570 => 0.5266, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -5.45% (0.2659 => 0.2514, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.45% (4.8802 => 4.6141, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.45% (5.4682 => 5.1701, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.43% (0.6440 => 0.6090, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -5.43% (4.0594 => 3.8389, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -5.41% (0.7447 => 0.7044, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.40% (0.6033 => 0.5707, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.40% (0.6189 => 0.5855, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.39% (0.5567 => 0.5267, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -5.38% (15.5079 => 14.6737, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.37% (0.5805 => 0.5493, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.36% (0.7021 => 0.6645, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -5.35% (1.3864 => 1.3122, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.30% (0.4151 => 0.3931, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.28% (0.8521 => 0.8071, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.27% (0.6395 => 0.6058, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.23% (2.2587 => 2.1406, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.22% (0.5688 => 0.5391, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.22% (6.7716 => 6.4181, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/18-imp/imp: -5.19% (0.3581 => 0.3395, std.dev.: 0.0031) MultiSource/Applications/d/make_dparser: -5.19% (3.5154 => 3.3330, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.18% (0.6293 => 0.5967, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.17% (0.5999 => 0.5689, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.16% (1.3148 => 1.2469, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.16% (0.5329 => 0.5054, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bh/bh: -5.16% (0.2985 => 0.2831, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.14% (0.2999 => 0.2845, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.05% (0.4515 => 0.4287, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.02% (0.4916 => 0.4669, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.00% (0.2278 => 0.2164, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -5.00% (2.1401 => 2.0331, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -5.00% (0.4861 => 0.4618, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: -5.00% (0.7982 => 0.7583, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.99% (0.3849 => 0.3657, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.99% (0.3931 => 0.3735, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.97% (0.5168 => 0.4911, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.94% (0.4813 => 0.4575, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.94% (0.9557 => 0.9085, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.90% (0.7198 => 0.6845, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: -4.90% (0.6750 => 0.6419, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.90% (0.3837 => 0.3649, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -4.90% (18.2933 => 17.3970, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.88% (0.4321 => 0.4110, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -4.88% (15.2527 => 14.5080, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.88% (0.3323 => 0.3161, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -4.86% (0.3025 => 0.2878, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.85% (0.3880 => 0.3692, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -4.83% (34.0927 => 32.4448, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.82% (8.0126 => 7.6267, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/exceptions-2: -4.80% (0.3831 => 0.3647, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.80% (0.3812 => 0.3629, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.78% (0.2385 => 0.2271, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -4.77% (0.4176 => 0.3977, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.76% (1.2221 => 1.1639, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: -4.76% (0.3255 => 0.3100, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -4.76% (0.4033 => 0.3841, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -4.76% (0.3194 => 0.3042, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.76% (0.3848 => 0.3665, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -4.76% (0.4248 => 0.4046, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.75% (0.3891 => 0.3706, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.73% (0.4083 => 0.3890, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.73% (0.3491 => 0.3326, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.71% (0.3884 => 0.3701, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -4.71% (0.4524 => 0.4311, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.71% (2.1713 => 2.0691, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists1: -4.71% (0.3867 => 0.3685, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.70% (0.3252 => 0.3099, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.70% (0.3896 => 0.3713, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -4.69% (0.3621 => 0.3451, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.67% (0.3319 => 0.3164, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -4.65% (0.3481 => 0.3319, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.65% (0.2989 => 0.2850, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.65% (0.3057 => 0.2915, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.64% (1.2210 => 1.1643, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: -4.63% (0.3026 => 0.2886, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -4.61% (0.3446 => 0.3287, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -4.60% (0.2871 => 0.2739, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -4.60% (0.4199 => 0.4006, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -4.58% (0.4280 => 0.4084, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -4.57% (0.3394 => 0.3239, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -4.56% (0.2939 => 0.2805, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.55% (0.2903 => 0.2771, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.54% (0.4427 => 0.4226, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.54% (0.8418 => 0.8036, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.51% (0.3016 => 0.2880, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.50% (0.2933 => 0.2801, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.42% (0.2849 => 0.2723, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: -4.37% (0.3271 => 0.3128, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -4.36% (0.3788 => 0.3623, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -4.35% (0.3059 => 0.2926, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -4.26% (5.0226 => 4.8086, std.dev.: 0.0180) SingleSource/UnitTests/ObjC++/property-reference: -3.90% (0.7779 => 0.7476, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.70% (0.9077 => 0.8741, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: -3.52% (1.5610 => 1.5061, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/Hello: -3.50% (0.6347 => 0.6125, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -3.28% (0.6441 => 0.6230, std.dev.: 0.0060) SingleSource/UnitTests/Vector/constpool: -2.67% (20.7746 => 20.2197, std.dev.: 0.0513) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7532, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/richards_benchmark: -8.73% (1.2842 => 1.1721, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.91% (2.2633 => 2.1748, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3339, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.05% (1.0557 => 1.0235, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4693, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.02% (3.2107 => 3.1781, std.dev.: 0.0003) Report Time: 2.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 5 10:57:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 5 Nov 2012 12:57:40 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121105185740.4ACF42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5602?compare_to=5597&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5602, Order: 167381, Start Time: 2012-11-05 15:41:17, End Time: 2012-11-05 18:57:46 To: 5597, Order: 167380, Start Time: 2012-11-05 11:37:08, End Time: 2012-11-05 14:52:58 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (172 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1039 (716 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/UnitTests/ObjC/synchronized: 16.71% (0.1053 => 0.1229, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.28% (123.6246 => 125.2089, std.dev.: 0.4578) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.24% (54.2846 => 54.9564, std.dev.: 0.0353) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.32% (0.0625 => 0.0877, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.51% (0.1063 => 0.1398, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.77% (0.1106 => 0.1391, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.46% (0.2969 => 0.3725, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.86% (0.0547 => 0.0683, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.37% (0.0714 => 0.0888, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.21% (0.4139 => 0.5141, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.71% (0.5900 => 0.7299, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.70% (0.4253 => 0.5261, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 23.56% (1.5932 => 1.9685, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.21% (0.4994 => 0.6153, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.48% (0.5000 => 0.6124, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.43% (0.0584 => 0.0715, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.79% (0.1620 => 0.1973, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.65% (0.1021 => 0.1242, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.52% (0.0897 => 0.1090, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/tsp/tsp: 21.37% (0.0599 => 0.0727, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.23% (0.1107 => 0.1342, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.13% (0.1604 => 0.1943, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 20.53% (0.0604 => 0.0728, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 20.46% (0.0948 => 0.1142, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.38% (0.0633 => 0.0762, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.25% (0.0642 => 0.0772, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.03% (0.0584 => 0.0701, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.85% (0.1103 => 0.1322, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.83% (0.3903 => 0.4677, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.82% (0.1549 => 0.1856, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 19.77% (0.1619 => 0.1939, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/health/health: 19.73% (0.0821 => 0.0983, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.71% (0.0822 => 0.0984, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.54% (0.1003 => 0.1199, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 19.28% (0.0581 => 0.0693, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.51% (0.0605 => 0.0717, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 18.48% (0.0947 => 0.1122, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.26% (0.1462 => 0.1729, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.24% (0.2736 => 0.3235, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 18.18% (0.5826 => 0.6885, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.97% (0.2014 => 0.2376, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 17.97% (0.5889 => 0.6947, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 17.95% (0.0808 => 0.0953, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.92% (0.3890 => 0.4587, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 17.82% (0.1218 => 0.1435, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.50% (1.3152 => 1.5453, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: 17.42% (0.4029 => 0.4731, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.37% (0.1088 => 0.1277, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 17.21% (0.1505 => 0.1764, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 17.19% (0.0698 => 0.0818, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.77% (3.5627 => 4.1602, std.dev.: 0.0031) MultiSource/Applications/Burg/burg: 16.77% (0.5546 => 0.6476, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.71% (0.2866 => 0.3345, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.64% (0.1160 => 0.1353, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 16.61% (1.8794 => 2.1915, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.35% (1.6211 => 1.8862, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.32% (0.5026 => 0.5846, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.29% (0.4658 => 0.5417, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 16.29% (0.9697 => 1.1277, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 16.19% (0.7171 => 0.8332, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.11% (0.1968 => 0.2285, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.02% (0.3271 => 0.3795, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.79% (0.2875 => 0.3329, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.78% (0.4361 => 0.5049, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 15.69% (0.1421 => 0.1644, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 15.48% (1.0781 => 1.2450, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 15.42% (0.1284 => 0.1482, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 15.34% (0.2725 => 0.3143, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.34% (2.7292 => 3.1478, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.29% (0.3930 => 0.4531, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.28% (4.4195 => 5.0947, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.24% (1.9694 => 2.2695, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.23% (0.2738 => 0.3155, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 15.18% (0.2714 => 0.3126, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 15.14% (4.2109 => 4.8486, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/objinst: 15.13% (0.2823 => 0.3250, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.06% (0.2729 => 0.3140, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.05% (1.9966 => 2.2970, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/methcall: 15.04% (0.2813 => 0.3236, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 15.02% (0.2750 => 0.3163, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 14.96% (0.2780 => 0.3196, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 14.88% (0.3004 => 0.3451, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 14.88% (0.2803 => 0.3220, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.80% (0.3195 => 0.3668, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.79% (0.2792 => 0.3205, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.78% (2.0673 => 2.3729, std.dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: 14.77% (0.9909 => 1.1373, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 14.76% (0.2811 => 0.3226, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 14.73% (0.3096 => 0.3552, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.63% (0.2911 => 0.3337, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 14.60% (23.5202 => 26.9549, std.dev.: 0.0105) SingleSource/UnitTests/ObjC/for-in: 14.42% (0.3496 => 0.4000, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 14.37% (0.3465 => 0.3963, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.36% (0.3488 => 0.3989, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-2: 14.34% (0.3446 => 0.3940, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.31% (0.1090 => 0.1246, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 14.24% (0.3442 => 0.3932, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 14.22% (0.3460 => 0.3952, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 14.21% (0.3469 => 0.3962, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 14.17% (0.3267 => 0.3730, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 14.05% (0.3317 => 0.3783, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 14.03% (0.3258 => 0.3715, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.92% (0.3282 => 0.3739, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.92% (0.3362 => 0.3830, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 13.92% (0.3643 => 0.4150, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.91% (0.3845 => 0.4380, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.89% (0.3650 => 0.4157, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.83% (0.3124 => 0.3556, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.82% (0.3060 => 0.3483, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 13.72% (0.3724 => 0.4235, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 13.68% (0.3678 => 0.4181, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 13.60% (0.2566 => 0.2915, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 13.54% (1.4269 => 1.6201, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hash: 13.48% (0.4146 => 0.4705, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 13.45% (0.2075 => 0.2354, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 13.38% (0.3348 => 0.3796, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.38% (0.3625 => 0.4110, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 13.29% (0.3726 => 0.4221, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 13.26% (2.1653 => 2.4525, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists1: 13.06% (0.3477 => 0.3931, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 12.96% (0.4251 => 0.4802, std.dev.: 0.0089) MultiSource/Applications/treecc/treecc: 12.91% (0.7875 => 0.8892, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.91% (0.3981 => 0.4495, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.82% (0.3690 => 0.4163, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 12.74% (4.6177 => 5.2059, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 12.64% (2.1013 => 2.3670, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 12.61% (0.5012 => 0.5644, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.76% (0.2040 => 0.2280, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 11.63% (0.2691 => 0.3004, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 11.23% (5.5417 => 6.1643, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.17% (0.6435 => 0.7154, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.27% (0.1383 => 0.1525, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 10.23% (0.3498 => 0.3856, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.21% (0.1028 => 0.1133, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.16% (0.2737 => 0.3015, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.06% (0.2068 => 0.2276, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.02% (0.6634 => 0.7299, std.dev.: 0.0044) MultiSource/Benchmarks/PAQ8p/paq8p: 9.94% (0.4847 => 0.5329, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.76% (0.3084 => 0.3385, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 9.59% (0.3336 => 0.3656, std.dev.: 0.0060) MultiSource/Applications/lemon/lemon: 8.91% (0.2391 => 0.2604, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.89% (0.2103 => 0.2290, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 8.82% (2.0346 => 2.2140, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.21% (4.6926 => 5.0779, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.04% (11.6398 => 12.5762, std.dev.: 0.0196) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.39% (0.5361 => 0.5757, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.86% (0.5584 => 0.5967, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.77% (0.7426 => 0.7929, std.dev.: 0.0036) MultiSource/Applications/kimwitu++/kc: 6.07% (11.9555 => 12.6812, std.dev.: 0.0230) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.98% (0.3792 => 0.3981, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6533, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 16.60% (0.1054 => 0.1229, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 8.89% (0.2802 => 0.3051, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6101, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.00% (12.0509 => 12.6539, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1706, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-2: 3.92% (1.8057 => 1.8765, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.71% (0.3693 => 0.3830, std.dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/dry: 2.52% (14.0481 => 14.4022, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1919, std.dev.: 0.0039) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2237, std.dev.: 0.0046) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3027, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2887, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5390, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5878, std.dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.40% (2.4764 => 2.4169, std.dev.: 0.0105) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.65% (25.4195 => 16.3574, std.dev.: 0.0236) SingleSource/Benchmarks/Shootout-C++/ary2: -10.07% (0.2402 => 0.2160, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9751, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7753, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/tsp/tsp: -7.20% (2.1113 => 1.9593, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.13% (0.6293 => 0.6096, std.dev.: 0.0054) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7747, std.dev.: 0.0021) SingleSource/UnitTests/Vector/build2: -2.98% (11.2080 => 10.8740, std.dev.: 0.0253) SingleSource/Benchmarks/Misc/mandel-2: -2.87% (3.6262 => 3.5222, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -2.34% (17.2379 => 16.8337, std.dev.: 0.0277) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.17% (41.7953 => 40.8878, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5766, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -1.57% (5.5810 => 5.4934, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1470, std.dev.: 0.0916) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.10% (21.9346 => 21.6944, std.dev.: 0.0432) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.09% (3.3991 => 3.3620, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0415, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 5 12:30:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 5 Nov 2012 14:30:56 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121105203056.A8ED82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5603?compare_to=5600&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5603, Order: 167388, Start Time: 2012-11-05 19:03:36, End Time: 2012-11-05 20:31:05 To: 5600, Order: 167385, Start Time: 2012-11-05 17:19:47, End Time: 2012-11-05 18:46:43 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 3 (44 on baseline) Performance Improvements: 5 (6 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 983 (924 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.27% (1.4975 => 1.8759, std.dev.: 0.0155) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.94% (2.3601 => 2.6418, std.dev.: 0.0512) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.83% (1.0230 => 1.0417, std.dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (0.3402 => 0.3294, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.72% (0.8265 => 0.8123, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.09% (1.2819 => 1.2679, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: -5.22% (0.2106 => 0.1996, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.13% (61.3403 => 60.0365, std.dev.: 0.4537) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.00% (16.6689 => 16.6693, std.dev.: 0.1768) MultiSource/Applications/obsequi/Obsequi: -2.17% (1.0663 => 1.0432, std.dev.: 0.0195) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.83% (21.4950 => 21.6725, std.dev.: 0.0858) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.91% (0.3630 => 0.3663, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: -0.76% (0.6047 => 0.6001, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.30% (0.3320 => 0.3363, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: -1.00% (0.2010 => 0.1990, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.46% (0.0216 => 0.0217, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 23.19% (0.0345 => 0.0425, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.22% (0.0329 => 0.0333, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.96% (0.0313 => 0.0316, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.17% (0.0427 => 0.0422, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0202 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 2.28% (0.0219 => 0.0224, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.54% (0.1480 => 0.1472, std.dev.: 0.0046) MultiSource/Applications/kimwitu++/kc: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 4.50% (1.1291 => 1.1799, std.dev.: 0.0449) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 6.41% (0.1404 => 0.1494, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.25% (0.4002 => 0.4132, std.dev.: 0.0201) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.43% (0.1328 => 0.1309, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.10% (0.0672 => 0.0631, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0277 => 0.0277, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.89% (0.0561 => 0.0566, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.83% (1.1444 => 1.1539, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 106.67% (0.0015 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 20.00% (0.0010 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0647 => 0.0647, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0267 => 0.0267, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.34% (0.7994 => 0.8021, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 148.78% (0.0041 => 0.0102, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2312.30% (0.6332 => 15.2747, std.dev.: 0.1811) MultiSource/Benchmarks/McCat/08-main/main: 45.28% (0.1831 => 0.2660, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.03% (0.1559 => 0.1465, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1489.86% (0.3344 => 5.3165, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.91% (0.2364 => 0.3213, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel: 2.10% (0.0429 => 0.0438, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.36% (0.0224 => 0.0236, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0008) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3219, std.dev.: 0.0134) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0692, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4952, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3502, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0236, std.dev.: 0.0258) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4072, std.dev.: 0.0115) SingleSource/Regression/C/uint64_to_float: -24.21% (2.1832 => 1.6547, std.dev.: 0.0065) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.05% (0.0810 => 0.0940, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: 11.42% (0.1112 => 0.1239, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.52% (0.2180 => 0.2344, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.19% (0.1905 => 0.2042, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.02% (0.8321 => 0.8905, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.15% (0.4847 => 0.5145, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.39% (0.8148 => 0.8587, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.35% (0.7473 => 0.7873, std.dev.: 0.0101) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.00% (0.3137 => 0.3294, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.55% (1.1685 => 1.2217, std.dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: 3.57% (0.2999 => 0.3106, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.48% (6.6074 => 6.8373, std.dev.: 0.0117) MultiSource/Applications/spiff/spiff: 3.47% (0.7950 => 0.8226, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.14% (0.4783 => 0.4933, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.64% (0.4127 => 0.4236, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.42% (0.9435 => 0.9663, std.dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: 2.40% (14.7684 => 15.1226, std.dev.: 0.0552) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.35% (4.4873 => 4.5926, std.dev.: 0.0241) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.32% (4.1763 => 4.2733, std.dev.: 0.0279) MultiSource/Benchmarks/MallocBench/gs/gs: 2.17% (4.1305 => 4.2201, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.93% (1.4479 => 1.4759, std.dev.: 0.0103) MultiSource/Applications/SIBsim4/SIBsim4: 1.90% (1.2568 => 1.2807, std.dev.: 0.0079) MultiSource/Applications/lua/lua: 1.81% (3.8189 => 3.8879, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.72% (1.6386 => 1.6668, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.58% (13.1811 => 13.3892, std.dev.: 0.0783) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.55% (0.8007 => 0.8131, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.32% (0.8340 => 0.8450, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.23% (2.1401 => 2.1665, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.22% (1.2526 => 1.2679, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 67.34% (0.0199 => 0.0333, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/pi: 59.02% (1.5795 => 2.5117, std.dev.: 0.0036) MultiSource/Applications/SIBsim4/SIBsim4: 8.33% (3.1873 => 3.4528, std.dev.: 0.0484) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.95% (1.1857 => 1.2800, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.88% (0.3186 => 0.3437, std.dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: 4.96% (14.0064 => 14.7018, std.dev.: 0.0986) MultiSource/Benchmarks/FreeBench/distray/distray: 4.94% (0.2390 => 0.2508, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 2.91% (3.8206 => 3.9319, std.dev.: 0.0085) MultiSource/Applications/siod/siod: 2.90% (3.6643 => 3.7705, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/ReedSolomon: 2.03% (8.5322 => 8.7058, std.dev.: 0.0585) MultiSource/Benchmarks/SciMark2-C/scimark2: 1.80% (28.5821 => 29.0961, std.dev.: 0.0332) MultiSource/Benchmarks/mafft/pairlocalalign: 1.79% (63.1822 => 64.3132, std.dev.: 0.2302) MultiSource/Benchmarks/FreeBench/neural/neural: 1.35% (1.0841 => 1.0987, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 1.33% (2.3560 => 2.3874, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.13% (4.8362 => 4.8909, std.dev.: 0.0194) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -8.99% (3.2926 => 2.9966, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.55% (0.3269 => 0.3055, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.08% (3.9188 => 3.6806, std.dev.: 0.0656) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.26% (2.8773 => 2.7546, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout/lists: -3.80% (7.3375 => 7.0590, std.dev.: 0.0086) SingleSource/Benchmarks/McGill/chomp: -1.34% (1.1216 => 1.1066, std.dev.: 0.0044) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.36% (16.4461 => 16.6693, std.dev.: 0.1768) MultiSource/Applications/obsequi/Obsequi: 1.66% (1.0262 => 1.0432, std.dev.: 0.0195) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6839.64% (0.3123 => 21.6725, std.dev.: 0.0858) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.72% (0.2463 => 0.3663, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: -0.15% (0.6010 => 0.6001, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.97% (0.3266 => 0.3363, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 1.07% (0.1969 => 0.1990, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 24.44% (0.0180 => 0.0224, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.36% (0.1438 => 0.1472, std.dev.: 0.0046) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 4.15% (1.1329 => 1.1799, std.dev.: 0.0449) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.19% (0.1462 => 0.1494, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.77% (0.4164 => 0.4132, std.dev.: 0.0201) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.38% (0.1369 => 0.1309, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.56% (0.0641 => 0.0631, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.08% (0.0578 => 0.0566, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.89% (1.1437 => 1.1539, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -14.29% (0.0014 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.19% (0.0627 => 0.0647, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.05% (0.8017 => 0.8021, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 64.52% (0.0062 => 0.0102, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 5 12:38:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 5 Nov 2012 14:38:21 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121105203821.EB8E22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5604?compare_to=5601&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5604, Order: 167388, Start Time: 2012-11-05 19:13:44, End Time: 2012-11-05 20:38:28 To: 5601, Order: 167385, Start Time: 2012-11-05 17:25:51, End Time: 2012-11-05 18:50:42 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (178 on baseline) Unchanged Tests: 1041 (860 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.19% (1.2762 => 1.3042, std.dev.: 0.0063) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1007, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4937 => 7.6672, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/hash2: 2.08% (3.1932 => 3.2595, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.60% (0.1431 => 0.1308) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.88% (0.3821 => 0.3520, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -7.11% (2.4924 => 2.3153, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.78% (0.3142 => 0.2929, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.58% (0.3357 => 0.3136, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.47% (0.2428 => 0.2271, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.45% (0.9542 => 0.8927, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.44% (3.5339 => 3.3062, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.44% (22.4056 => 20.9630, std.dev.: 0.0095) MultiSource/Benchmarks/mafft/pairlocalalign: -6.23% (9.2283 => 8.6536, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.21% (0.3658 => 0.3431, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -6.17% (16.1920 => 15.1922, std.dev.: 0.0090) MultiSource/Applications/JM/ldecod/ldecod: -6.17% (7.0961 => 6.6581, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/football/football: -6.09% (0.9179 => 0.8620, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -6.07% (0.1879 => 0.1765, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.06% (0.6484 => 0.6091, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.05% (0.9852 => 0.9256, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -6.02% (0.2160 => 0.2030, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.01% (0.1796 => 0.1688, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.00% (1.0544 => 0.9911, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.00% (0.1716 => 0.1613, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.92% (0.5857 => 0.5510, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: -5.92% (4.3330 => 4.0765, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.91% (1.2784 => 1.2028, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -5.91% (1.2515 => 1.1775, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -5.91% (0.1761 => 0.1657, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -5.90% (1.1450 => 1.0774, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: -5.88% (1.1530 => 1.0852, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.87% (1.6364 => 1.5404, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.87% (1.3722 => 1.2917, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.84% (0.5478 => 0.5158, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.84% (1.2300 => 1.1582, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.82% (4.0323 => 3.7976, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.77% (0.6052 => 0.5703, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -5.76% (17.1032 => 16.1177, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.75% (0.7339 => 0.6917, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.73% (1.4642 => 1.3803, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.72% (0.7919 => 0.7466, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.71% (0.3483 => 0.3284, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -5.71% (2.4021 => 2.2649, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.71% (0.6304 => 0.5944, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.71% (0.5591 => 0.5272, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.70% (0.5802 => 0.5471, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.66% (4.8161 => 4.5437, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.65% (0.2355 => 0.2222, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.65% (0.6446 => 0.6082, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.65% (1.6474 => 1.5544, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.64% (0.6681 => 0.6304, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.64% (14.2083 => 13.4074, std.dev.: 0.0120) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.63% (4.5069 => 4.2533, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.63% (0.5705 => 0.5384, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.62% (0.5849 => 0.5520, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.61% (0.5575 => 0.5262, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.61% (0.2548 => 0.2405, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.61% (4.8802 => 4.6066, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.61% (0.5941 => 0.5608, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.60% (0.5925 => 0.5593, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.60% (0.2695 => 0.2544, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.60% (0.6230 => 0.5881, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.60% (0.7524 => 0.7103, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.59% (0.6297 => 0.5945, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.58% (0.6736 => 0.6360, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.57% (5.4682 => 5.1634, std.dev.: 0.0032) MultiSource/Applications/lua/lua: -5.57% (4.0594 => 3.8332, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.57% (0.5456 => 0.5152, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: -5.57% (0.3880 => 0.3664, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.56% (0.5859 => 0.5533, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.55% (0.6194 => 0.5850, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.54% (0.6260 => 0.5913, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -5.54% (0.3812 => 0.3601, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.53% (0.3831 => 0.3619, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.53% (0.4033 => 0.3810, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.51% (0.5570 => 0.5263, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.50% (0.6395 => 0.6043, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.50% (0.6033 => 0.5701, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.50% (0.6440 => 0.6086, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -5.49% (0.2985 => 0.2821, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.49% (0.5863 => 0.5541, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.48% (0.3848 => 0.3637, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.47% (0.6660 => 0.6296, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.46% (0.5569 => 0.5265, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.45% (0.3891 => 0.3679, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.44% (0.6667 => 0.6304, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/synchronized: -5.44% (0.3896 => 0.3684, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.43% (0.5805 => 0.5490, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -5.43% (0.7447 => 0.7043, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.42% (0.8521 => 0.8059, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: -5.41% (15.5079 => 14.6685, std.dev.: 0.0126) MultiSource/Applications/SIBsim4/SIBsim4: -5.41% (1.3864 => 1.3114, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.39% (0.5581 => 0.5280, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.39% (0.4176 => 0.3951, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.37% (0.3406 => 0.3223, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.36% (0.3884 => 0.3676, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -5.32% (3.5154 => 3.3283, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.32% (6.7716 => 6.4114, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.30% (0.5567 => 0.5272, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.28% (0.5999 => 0.5682, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.28% (0.7021 => 0.6650, std.dev.: 0.0124) SingleSource/UnitTests/ObjC/property: -5.26% (0.4199 => 0.3978, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.26% (0.6293 => 0.5962, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.24% (0.6189 => 0.5865, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.24% (0.2999 => 0.2842, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.23% (0.4151 => 0.3934, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: -5.19% (0.3581 => 0.3395, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.19% (0.6395 => 0.6063, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.19% (0.4916 => 0.4661, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.16% (0.5329 => 0.5054, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: -5.14% (0.4861 => 0.4611, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -5.14% (0.4280 => 0.4060, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.14% (0.4515 => 0.4283, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -5.12% (2.1401 => 2.0305, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.12% (0.5688 => 0.5397, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.09% (0.2278 => 0.2162, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.09% (2.2587 => 2.1438, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.07% (0.7198 => 0.6833, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -5.05% (1.3148 => 1.2484, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.04% (0.3931 => 0.3733, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -5.02% (0.7982 => 0.7581, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.02% (1.2221 => 1.1608, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.99% (0.5168 => 0.4910, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.99% (0.2385 => 0.2266, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.99% (0.4813 => 0.4573, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.96% (0.9557 => 0.9083, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.95% (0.3837 => 0.3647, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -4.94% (18.2933 => 17.3895, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.94% (0.3849 => 0.3659, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -4.93% (15.2527 => 14.5005, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.92% (8.0126 => 7.6185, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.91% (1.2210 => 1.1610, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: -4.86% (0.6750 => 0.6422, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -4.86% (34.0927 => 32.4365, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.84% (0.3491 => 0.3322, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.82% (0.4083 => 0.3886, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -4.77% (0.4524 => 0.4308, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.77% (0.4321 => 0.4115, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -4.76% (0.4248 => 0.4046, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.75% (0.3323 => 0.3165, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: -4.73% (0.3025 => 0.2882, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -4.73% (0.3026 => 0.2883, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -4.70% (0.3255 => 0.3102, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -4.68% (0.3481 => 0.3318, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -4.67% (0.3446 => 0.3285, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -4.66% (0.3194 => 0.3045, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.65% (0.3057 => 0.2915, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.64% (0.3252 => 0.3101, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -4.63% (0.2871 => 0.2738, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.61% (0.3319 => 0.3166, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.58% (2.1713 => 2.0719, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary: -4.57% (0.3394 => 0.3239, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -4.56% (0.2939 => 0.2805, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -4.56% (0.3621 => 0.3456, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.55% (0.3867 => 0.3691, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -4.55% (0.2989 => 0.2853, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: -4.54% (5.0226 => 4.7947, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/wc: -4.52% (0.3205 => 0.3060, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.52% (0.4427 => 0.4227, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -4.51% (0.3059 => 0.2921, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.51% (0.3016 => 0.2880, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -4.47% (0.8418 => 0.8042, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.47% (0.2933 => 0.2802, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.44% (0.2903 => 0.2774, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.42% (0.2849 => 0.2723, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -4.40% (0.3271 => 0.3127, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sieve: -4.38% (0.3788 => 0.3622, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -4.02% (0.7779 => 0.7466, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.94% (0.9077 => 0.8719, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: -3.67% (0.6347 => 0.6114, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -3.54% (0.6441 => 0.6213, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -3.28% (1.5610 => 1.5098, std.dev.: 0.0086) SingleSource/UnitTests/Vector/constpool: -2.59% (20.7746 => 20.2360, std.dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7514, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/richards_benchmark: -8.66% (1.2842 => 1.1730, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: -4.02% (2.2633 => 2.1724, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4691, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0000) Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 5 14:14:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 5 Nov 2012 16:14:43 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121105221443.26AE52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5605?compare_to=5603&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5605, Order: 167398, Start Time: 2012-11-05 20:48:01, End Time: 2012-11-05 22:14:51 To: 5603, Order: 167388, Start Time: 2012-11-05 19:03:36, End Time: 2012-11-05 20:31:05 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 49 (104 on baseline) Performance Improvements: 26 (25 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 916 (845 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.44% (0.9107 => 0.9420, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.36% (0.8918 => 0.9218, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.29% (0.7974 => 0.8236, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.94% (0.8123 => 0.8362, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.80% (0.8274 => 0.8506, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.78% (0.8390 => 0.8623, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.73% (0.9770 => 1.0037, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.66% (0.8762 => 0.8995, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.60% (0.8024 => 0.8233, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.39% (0.8409 => 0.8610, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.34% (0.8583 => 0.8784, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.24% (0.8471 => 0.8661, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.14% (0.8370 => 0.8549, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.07% (0.8827 => 0.9010, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.05% (0.8406 => 0.8578, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.98% (0.8729 => 0.8902, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.91% (1.1863 => 1.2089, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.81% (0.9167 => 0.9333, std.dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: 1.77% (1.1403 => 1.1605, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 1.69% (1.4568 => 1.4814, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.64% (0.8967 => 0.9114, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.52% (0.8149 => 0.8273, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.33% (0.8580 => 0.8694, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.03% (1.6668 => 1.6839, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 33.33% (0.0333 => 0.0444, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.77% (0.7551 => 0.8817, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.56% (2.9679 => 3.4593, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 15.07% (2.7941 => 3.2153, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.78% (5.0198 => 5.6109, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/queens: 8.03% (1.6979 => 1.8342, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/lists: 6.58% (7.0590 => 7.5238, std.dev.: 0.0229) SingleSource/Benchmarks/Misc/richards_benchmark: 6.16% (1.3093 => 1.3899, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.83% (4.9731 => 5.2632, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.76% (4.5378 => 4.7993, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.53% (3.3799 => 3.5329, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.33% (4.9421 => 5.1561, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.30% (6.2434 => 6.5118, std.dev.: 0.0252) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.29% (1.2301 => 1.2829, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.00% (4.9486 => 5.1465, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.92% (4.8438 => 4.9851, std.dev.: 0.0367) SingleSource/Benchmarks/Dhrystone/dry: 2.76% (0.5076 => 0.5216, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.57% (11.5726 => 11.8695, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.40% (8.2687 => 8.4668, std.dev.: 0.0199) MultiSource/Applications/sqlite3/sqlite3: 2.31% (4.3219 => 4.4218, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.28% (5.0236 => 5.1381, std.dev.: 0.0225) MultiSource/Applications/SPASS/SPASS: 2.26% (8.3331 => 8.5213, std.dev.: 0.0470) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.36% (4.8909 => 4.9574, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.14% (4.4562 => 4.5070, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.09% (3.5684 => 3.6074, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.08% (5.4698 => 4.3170, std.dev.: 0.0253) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.51% (7.1195 => 6.2287, std.dev.: 0.0673) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.97% (1.0510 => 0.9357, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -9.97% (64.3132 => 57.9027, std.dev.: 0.0808) MultiSource/Benchmarks/nbench/nbench: -7.01% (22.3794 => 20.8099, std.dev.: 0.5389) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.72% (4.7452 => 4.4262, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.82% (5.4920 => 5.1723, std.dev.: 0.0206) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.77% (3.7137 => 3.4994, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.99% (5.1545 => 4.8973, std.dev.: 0.0197) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.80% (29.0961 => 27.6981, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.27% (4.7454 => 4.5428, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/mason/mason: -4.01% (0.5505 => 0.5284, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.46% (6.0143 => 5.8062, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.79% (0.5778 => 0.5617, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -2.59% (3.9319 => 3.8300, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.40% (2.4588 => 2.3997, std.dev.: 0.0075) MultiSource/Applications/aha/aha: -2.37% (3.3483 => 3.2690, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.91% (2.3569 => 2.3120, std.dev.: 0.0063) MultiSource/Applications/SIBsim4/SIBsim4: -1.80% (3.4528 => 3.3908, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.77% (9.9317 => 9.7555, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.62% (11.4913 => 11.3054, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.54% (5.0000 => 4.9228, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/tsp/tsp: -1.43% (1.4941 => 1.4727, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.16% (1.0417 => 1.0296, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.10% (5.6332 => 5.5714, std.dev.: 0.0162) MultiSource/Applications/hexxagon/hexxagon: -1.02% (14.7018 => 14.5522, std.dev.: 0.0060) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.31% (16.6693 => 16.6170, std.dev.: 0.0978) MultiSource/Applications/obsequi/Obsequi: 0.58% (1.0432 => 1.0492, std.dev.: 0.0099) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.25% (21.6725 => 21.6180, std.dev.: 0.4656) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.93% (0.3663 => 0.3629, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 0.30% (0.6001 => 0.6019, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.30% (0.3363 => 0.3353, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 0.65% (0.1990 => 0.2003, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.92% (0.0217 => 0.0219, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0425 => 0.0427, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.60% (0.0333 => 0.0331) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.95% (0.0316 => 0.0313, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.24% (0.0422 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -37.62% (0.0202 => 0.0126, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/test1: -2.68% (0.0224 => 0.0218, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014) MultiSource/Applications/ClamAV/clamscan: -3.33% (0.1472 => 0.1423, std.dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: 0.43% (1.1799 => 1.1850, std.dev.: 0.0329) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.54% (0.1494 => 0.1517, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.16% (0.4132 => 0.4180, std.dev.: 0.0354) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.58% (0.1309 => 0.1382, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.54% (0.0631 => 0.0647, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0277 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.53% (0.0566 => 0.0546, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.49% (1.1539 => 1.1942, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 116.67% (0.0012 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.39% (0.0647 => 0.0638, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.12% (0.0267 => 0.0248, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.34% (0.8021 => 0.7753, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -56.86% (0.0102 => 0.0044, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2303.35% (0.6332 => 15.2180, std.dev.: 0.0685) MultiSource/Benchmarks/McCat/08-main/main: 49.04% (0.1831 => 0.2729, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.77% (0.1559 => 0.1469, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1489.86% (0.3344 => 5.3165, std.dev.: 0.0809) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.38% (0.2364 => 0.3224, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0429 => 0.0439, std.dev.: 0.0044) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0224 => 0.0224, std.dev.: 0.0011) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0000) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4218, std.dev.: 0.0089) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0688, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4957, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3439, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1381, std.dev.: 0.0225) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4091, std.dev.: 0.0071) SingleSource/Regression/C/uint64_to_float: -23.91% (2.1832 => 1.6613, std.dev.: 0.0013) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.80% (0.0810 => 0.0938, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.77% (0.1425 => 0.1550, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.19% (0.8321 => 0.8836, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.02% (0.6010 => 0.6372, std.dev.: 0.0092) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.95% (0.1983 => 0.2101, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.87% (0.2180 => 0.2308, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.57% (0.2279 => 0.2406, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.57% (0.1885 => 0.1990, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.31% (0.7473 => 0.7870, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.79% (0.4847 => 0.5079, std.dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.58% (0.4783 => 0.5002, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 4.22% (0.9039 => 0.9420, std.dev.: 0.0114) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.16% (1.1606 => 1.2089, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 4.10% (0.8855 => 0.9218, std.dev.: 0.0036) MultiSource/Applications/sgefa/sgefa: 4.07% (0.2999 => 0.3121, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.07% (0.8286 => 0.8623, std.dev.: 0.0046) MultiSource/Applications/Burg/burg: 4.04% (1.2222 => 1.2716, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.97% (0.3124 => 0.3248, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.83% (0.7932 => 0.8236, std.dev.: 0.0057) MultiSource/Applications/hbd/hbd: 3.82% (1.4269 => 1.4814, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.68% (0.8204 => 0.8506, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.67% (0.8066 => 0.8362, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.60% (0.9688 => 1.0037, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.60% (0.8697 => 0.9010, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.40% (1.1685 => 1.2082, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.35% (0.7966 => 0.8233, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.35% (0.8331 => 0.8610, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.25% (0.8712 => 0.8995, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.14% (0.8317 => 0.8578, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.12% (0.8518 => 0.8784, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.11% (0.9074 => 0.9356, std.dev.: 0.0101) MultiSource/Benchmarks/nbench/nbench: 2.96% (1.1271 => 1.1605, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.91% (0.9069 => 0.9333, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.88% (0.4127 => 0.4246, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 2.88% (1.9948 => 2.0522, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.86% (0.8420 => 0.8661, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.86% (0.8007 => 0.8236, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.85% (0.9908 => 1.0190, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.84% (0.8656 => 0.8902, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.80% (0.8457 => 0.8694, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.80% (0.8316 => 0.8549, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.77% (0.8050 => 0.8273, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.76% (1.6386 => 1.6839, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.73% (0.8069 => 0.8289, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.71% (0.8177 => 0.8399, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.68% (0.8805 => 0.9041, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.64% (0.9435 => 0.9684, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.62% (0.8611 => 0.8837, std.dev.: 0.0085) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.62% (6.6074 => 6.7804, std.dev.: 0.0362) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.58% (0.8885 => 0.9114, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.51% (1.4479 => 1.4843, std.dev.: 0.0133) MultiSource/Applications/ClamAV/clamscan: 2.48% (14.7684 => 15.1350, std.dev.: 0.0556) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.46% (0.8261 => 0.8464, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.42% (0.8086 => 0.8282, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.41% (4.1763 => 4.2771, std.dev.: 0.0241) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.35% (4.4873 => 4.5929, std.dev.: 0.0323) MultiSource/Applications/SIBsim4/SIBsim4: 2.34% (1.2568 => 1.2862, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 2.28% (14.2605 => 14.5858, std.dev.: 0.1206) MultiSource/Applications/lua/lua: 2.28% (3.8189 => 3.9060, std.dev.: 0.0303) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.26% (0.8927 => 0.9129, std.dev.: 0.0073) MultiSource/Applications/d/make_dparser: 2.21% (3.2366 => 3.3082, std.dev.: 0.0206) MultiSource/Applications/minisat/minisat: 2.03% (0.6834 => 0.6973, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.01% (0.8338 => 0.8506, std.dev.: 0.0052) MultiSource/Applications/JM/lencod/lencod: 1.97% (15.3280 => 15.6301, std.dev.: 0.0119) MultiSource/Applications/JM/ldecod/ldecod: 1.75% (6.7320 => 6.8499, std.dev.: 0.0128) MultiSource/Applications/oggenc/oggenc: 1.71% (4.9628 => 5.0478, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.30% (1.2423 => 1.2584, std.dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 1.17% (0.9810 => 0.9925, std.dev.: 0.0033) MultiSource/Applications/lemon/lemon: 1.07% (1.0945 => 1.1062, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 123.12% (0.0199 => 0.0444, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/pi: 57.99% (1.5795 => 2.4955, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.27% (2.9753 => 3.4593, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.06% (0.7597 => 0.8817, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.85% (2.7995 => 3.2153, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.64% (5.0261 => 5.6109, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.51% (0.3186 => 0.3489, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/queens: 7.54% (1.7056 => 1.8342, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.51% (1.1857 => 1.2747, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/richards_benchmark: 6.61% (1.3037 => 1.3899, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 6.38% (3.1873 => 3.3908, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.93% (4.9686 => 5.2632, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.88% (4.5327 => 4.7993, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.66% (2.2485 => 2.3532, std.dev.: 0.0269) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.64% (3.3761 => 3.5329, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.57% (6.2275 => 6.5118, std.dev.: 0.0252) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.26% (4.9453 => 5.1561, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.03% (4.9469 => 5.1465, std.dev.: 0.0080) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.99% (1.2337 => 1.2829, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 3.90% (14.0064 => 14.5522, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.63% (44.5605 => 46.1797, std.dev.: 0.5071) MultiSource/Applications/siod/siod: 2.84% (3.6643 => 3.7682, std.dev.: 0.0095) SingleSource/Benchmarks/Dhrystone/dry: 2.66% (0.5081 => 0.5216, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.60% (11.5690 => 11.8695, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout/lists: 2.54% (7.3375 => 7.5238, std.dev.: 0.0229) MultiSource/Applications/lambda-0_1_3/lambda: 2.53% (7.4933 => 7.6831, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.51% (4.8362 => 4.9574, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.45% (4.8660 => 4.9851, std.dev.: 0.0367) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.28% (8.2783 => 8.4668, std.dev.: 0.0199) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.65% (4.4340 => 4.5070, std.dev.: 0.0069) SingleSource/Benchmarks/Stanford/FloatMM: 1.53% (0.8807 => 0.8942, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.25% (2.4647 => 2.4955, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: 1.24% (1.0841 => 1.0975, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 1.19% (8.5322 => 8.6338, std.dev.: 0.0360) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.11% (3.5679 => 3.6074, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.99% (5.4641 => 4.3170, std.dev.: 0.0253) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.65% (7.2130 => 6.2287, std.dev.: 0.0673) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.99% (1.0512 => 0.9357, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -8.36% (63.1822 => 57.9027, std.dev.: 0.0808) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.78% (4.7482 => 4.4262, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.30% (0.3269 => 0.3063, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.91% (5.4972 => 5.1723, std.dev.: 0.0206) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.80% (3.7148 => 3.4994, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.01% (5.1557 => 4.8973, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.26% (4.7449 => 4.5428, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.14% (2.8773 => 2.7581, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.59% (6.0224 => 5.8062, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.27% (0.5807 => 0.5617, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (28.5821 => 27.6981, std.dev.: 0.0219) MultiSource/Applications/lua/lua: -3.00% (29.8330 => 28.9372, std.dev.: 0.2675) MultiSource/Benchmarks/FreeBench/mason/mason: -2.42% (0.5415 => 0.5284, std.dev.: 0.0040) MultiSource/Applications/aha/aha: -2.12% (3.3398 => 3.2690, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.03% (2.6356 => 2.5822, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.01% (2.4490 => 2.3997, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.96% (11.5316 => 11.3054, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.56% (2.3487 => 2.3120, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.53% (4.9994 => 4.9228, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.52% (9.9065 => 9.7555, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/hash2: -1.48% (3.4237 => 3.3730, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.12% (5.6343 => 5.5714, std.dev.: 0.0162) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.04% (16.4461 => 16.6170, std.dev.: 0.0978) MultiSource/Applications/obsequi/Obsequi: 2.24% (1.0262 => 1.0492, std.dev.: 0.0099) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6822.19% (0.3123 => 21.6180, std.dev.: 0.4656) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.34% (0.2463 => 0.3629, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 0.15% (0.6010 => 0.6019, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.66% (0.3266 => 0.3353, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 1.73% (0.1969 => 0.2003, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -33.68% (0.0190 => 0.0126, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 100.00% (0.0007 => 0.0014) MultiSource/Applications/ClamAV/clamscan: -1.04% (0.1438 => 0.1423, std.dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: 4.60% (1.1329 => 1.1850, std.dev.: 0.0329) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.76% (0.1462 => 0.1517, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.38% (0.4164 => 0.4180, std.dev.: 0.0354) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.95% (0.1369 => 0.1382, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.94% (0.0641 => 0.0647, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.54% (0.0578 => 0.0546, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.42% (1.1437 => 1.1942, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.75% (0.0627 => 0.0638, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 37.78% (0.0180 => 0.0248, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.29% (0.8017 => 0.7753, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -29.03% (0.0062 => 0.0044, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 5 14:26:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 5 Nov 2012 16:26:09 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121105222609.C342E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5606?compare_to=5604&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5606, Order: 167398, Start Time: 2012-11-05 21:01:29, End Time: 2012-11-05 22:26:16 To: 5604, Order: 167388, Start Time: 2012-11-05 19:13:44, End Time: 2012-11-05 20:38:28 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 1 (181 on baseline) Unchanged Tests: 1041 (857 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.60% (1.3042 => 1.2703, std.dev.: 0.0109) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.69% (2.0478 => 2.1029, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.4937 => 7.6740, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/hash2: 2.06% (3.1932 => 3.2589, std.dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.98% (0.3821 => 0.3516, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -7.52% (2.4924 => 2.3050, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.92% (0.9542 => 0.8882, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.88% (0.3357 => 0.3126, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.87% (0.3142 => 0.2926, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -6.67% (0.2160 => 0.2016, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.64% (0.3658 => 0.3415, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.57% (22.4056 => 20.9329, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.55% (0.2428 => 0.2269, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.49% (3.5339 => 3.3047, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -6.41% (4.3330 => 4.0552, std.dev.: 0.0062) MultiSource/Applications/Burg/burg: -6.38% (1.2515 => 1.1716, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.37% (9.2283 => 8.6404, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.34% (0.9852 => 0.9227, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.34% (1.0544 => 0.9876, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: -6.33% (16.1920 => 15.1663, std.dev.: 0.0145) MultiSource/Applications/JM/ldecod/ldecod: -6.31% (7.0961 => 6.6481, std.dev.: 0.0043) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.31% (0.1584 => 0.1484) MultiSource/Benchmarks/Prolangs-C/football/football: -6.21% (0.9179 => 0.8609, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.15% (1.4642 => 1.3741, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.15% (1.6474 => 1.5461, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.15% (1.2784 => 1.1998, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.14% (1.3722 => 1.2879, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -6.14% (1.1450 => 1.0747, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.14% (0.6484 => 0.6086, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.11% (0.2355 => 0.2211, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.09% (0.7919 => 0.7437, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: -6.08% (0.1761 => 0.1654, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.07% (0.1796 => 0.1687, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.05% (4.0323 => 3.7885, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/bh/bh: -6.03% (0.2985 => 0.2805, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/08-main/main: -6.02% (0.2659 => 0.2499, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.02% (1.2300 => 1.1560, std.dev.: 0.0111) MultiSource/Benchmarks/nbench/nbench: -6.01% (1.1530 => 1.0837, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.00% (0.2548 => 0.2395, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -5.99% (2.4021 => 2.2583, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.93% (4.8161 => 4.5303, std.dev.: 0.0023) MultiSource/Benchmarks/sim/sim: -5.90% (0.3406 => 0.3205, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -5.88% (15.5079 => 14.5957, std.dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.88% (0.6736 => 0.6340, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -5.84% (0.4861 => 0.4577, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.84% (1.6364 => 1.5408, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.84% (0.3837 => 0.3613, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.83% (0.4151 => 0.3909, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.83% (4.5069 => 4.2443, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.81% (4.8802 => 4.5969, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.80% (0.3931 => 0.3703, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.79% (0.3849 => 0.3626, std.dev.: 0.0068) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.79% (6.7716 => 6.3794, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/methcall: -5.79% (0.3025 => 0.2850, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.75% (14.2083 => 13.3907, std.dev.: 0.0050) MultiSource/Applications/lua/lua: -5.75% (4.0594 => 3.8261, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -5.72% (0.7447 => 0.7021, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.72% (5.4682 => 5.1555, std.dev.: 0.0246) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.70% (0.7524 => 0.7095, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.70% (0.6052 => 0.5707, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: -5.70% (0.3194 => 0.3012, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.68% (1.3148 => 1.2401, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -5.68% (18.2933 => 17.2542, std.dev.: 0.0254) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.67% (2.1713 => 2.0482, std.dev.: 0.0114) MultiSource/Applications/SIBsim4/SIBsim4: -5.67% (1.3864 => 1.3078, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.66% (0.3057 => 0.2884, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.66% (0.3323 => 0.3135, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.66% (0.3483 => 0.3286, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -5.64% (17.1032 => 16.1382, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.64% (0.2695 => 0.2543, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.63% (0.8521 => 0.8041, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.62% (0.4321 => 0.4078, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.62% (0.6304 => 0.5950, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.60% (0.5857 => 0.5529, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.59% (0.5478 => 0.5172, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.59% (0.6660 => 0.6288, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -5.59% (0.3581 => 0.3381, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: -5.58% (0.3026 => 0.2857, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.58% (0.7021 => 0.6629, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.58% (2.2587 => 2.1326, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: -5.58% (0.4515 => 0.4263, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -5.58% (0.2939 => 0.2775, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -5.58% (0.4033 => 0.3808, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.58% (0.3891 => 0.3674, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.58% (0.2278 => 0.2151, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.57% (0.5168 => 0.4880, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -5.57% (3.5154 => 3.3196, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.57% (0.5999 => 0.5665, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.57% (0.9557 => 0.9025, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.55% (0.2903 => 0.2742, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.55% (0.6293 => 0.5944, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -5.54% (2.1401 => 2.0215, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/exceptions-4: -5.54% (0.3880 => 0.3665, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: -5.54% (0.2871 => 0.2712, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -5.53% (0.3831 => 0.3619, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -5.53% (0.4248 => 0.4013, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.53% (0.5805 => 0.5484, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.53% (0.4813 => 0.4547, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -5.52% (34.0927 => 32.2116, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/ary: -5.51% (0.3394 => 0.3207, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -5.50% (0.3255 => 0.3076, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -5.50% (0.6750 => 0.6379, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.49% (0.2933 => 0.2772, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -5.49% (0.2989 => 0.2825, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.49% (0.5925 => 0.5600, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: -5.48% (0.3848 => 0.3637, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.47% (0.2999 => 0.2835) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.46% (0.5329 => 0.5038, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -5.46% (0.4176 => 0.3948, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: -5.46% (0.4524 => 0.4277, std.dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: -5.46% (0.3059 => 0.2892, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -5.46% (0.3481 => 0.3291, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.45% (0.5849 => 0.5530, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.45% (0.6446 => 0.6095, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.44% (0.6667 => 0.6304, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.44% (0.3252 => 0.3075, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.43% (0.4916 => 0.4649, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.43% (0.5581 => 0.5278, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.43% (0.5859 => 0.5541, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.43% (0.6395 => 0.6048, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.41% (0.7339 => 0.6942, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.41% (0.3884 => 0.3674, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: -5.41% (0.2849 => 0.2695, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.40% (0.3016 => 0.2853, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.40% (0.5591 => 0.5289, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.40% (0.6260 => 0.5922, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.40% (0.6189 => 0.5855, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.39% (0.3896 => 0.3686, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.39% (0.5456 => 0.5162, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.39% (0.6681 => 0.6321, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.38% (0.6297 => 0.5958, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: -5.38% (0.4199 => 0.3973, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -5.38% (0.3867 => 0.3659, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.38% (0.3812 => 0.3607, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -5.36% (0.3621 => 0.3427, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.36% (0.5863 => 0.5549, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.35% (0.5705 => 0.5400, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.35% (0.5575 => 0.5277, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.34% (0.4083 => 0.3865, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: -5.34% (0.3205 => 0.3034, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.33% (0.6676 => 0.6320, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.33% (0.3491 => 0.3305, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.32% (1.2210 => 1.1561, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.31% (0.5802 => 0.5494, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.30% (0.3319 => 0.3143, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.30% (0.6395 => 0.6056, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.30% (0.5567 => 0.5272, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.30% (0.6194 => 0.5866, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.29% (0.4427 => 0.4193, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.28% (0.6440 => 0.6100, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.28% (0.5569 => 0.5275, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.27% (0.2106 => 0.1995, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -5.26% (0.4280 => 0.4055, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.25% (0.6033 => 0.5716, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.25% (0.7198 => 0.6820, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.23% (0.5941 => 0.5630, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.22% (1.2221 => 1.1583, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.21% (0.5570 => 0.5280, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.20% (0.2385 => 0.2261, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.17% (0.5688 => 0.5394, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -5.15% (0.3788 => 0.3593, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.13% (8.0126 => 7.6015, std.dev.: 0.0082) MultiSource/Applications/lambda-0_1_3/lambda: -5.12% (0.7982 => 0.7573, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -5.06% (15.2527 => 14.4807, std.dev.: 0.0106) MultiSource/Applications/oggenc/oggenc: -4.96% (5.0226 => 4.7734, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/09-vor/vor: -4.89% (0.3271 => 0.3111, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -4.75% (0.8418 => 0.8018, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference: -4.70% (0.7779 => 0.7413, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.33% (0.9077 => 0.8684, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -4.13% (0.6347 => 0.6085, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: -4.08% (0.6441 => 0.6178, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: -3.59% (1.5610 => 1.5049, std.dev.: 0.0050) SingleSource/UnitTests/Vector/constpool: -2.39% (20.7746 => 20.2777, std.dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7511, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: -8.78% (1.2842 => 1.1714, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: -3.99% (2.2633 => 2.1730, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.84% (1.7753 => 1.7072, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.73% (6.5803 => 6.3346, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.00% (1.3096 => 1.2703, std.dev.: 0.0109) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.65% (6.5735 => 6.4649, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.02% (3.2107 => 3.1781, std.dev.: 0.0004) Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 5 15:01:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 5 Nov 2012 17:01:50 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121105230150.1A99F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5607?compare_to=5602&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5607, Order: 167388, Start Time: 2012-11-05 19:46:05, End Time: 2012-11-05 23:01:54 To: 5602, Order: 167381, Start Time: 2012-11-05 15:41:17, End Time: 2012-11-05 18:57:46 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (170 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (720 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 244.02% (2.9104 => 10.0124, std.dev.: 0.0226) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.68% (125.2089 => 129.8114, std.dev.: 1.0884) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.00% (0.0625 => 0.0875, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.61% (0.1063 => 0.1399, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.67% (0.2969 => 0.3731, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.23% (0.1106 => 0.1385, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.05% (0.4253 => 0.5276, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.95% (0.0714 => 0.0885, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 23.87% (0.4139 => 0.5127, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 23.69% (1.5932 => 1.9706, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.53% (0.5900 => 0.7288, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.97% (0.4994 => 0.6141, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.80% (0.5000 => 0.6140, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.30% (0.0547 => 0.0669, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.26% (0.0584 => 0.0714, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.85% (0.1620 => 0.1974, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.65% (0.1021 => 0.1242, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 21.37% (0.0599 => 0.0727, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.29% (0.0897 => 0.1088, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.23% (0.1107 => 0.1342, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763) MultiSource/Benchmarks/Olden/em3d/em3d: 20.36% (0.0948 => 0.1141, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.09% (0.0642 => 0.0771, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.96% (0.0541 => 0.0649, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.86% (0.0584 => 0.0700, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.85% (0.1103 => 0.1322, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 19.85% (0.0821 => 0.0984, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.84% (0.1003 => 0.1202, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 19.64% (0.1619 => 0.1937, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.63% (0.3903 => 0.4669, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.63% (0.1549 => 0.1853, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.59% (0.0822 => 0.0983, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.51% (0.1604 => 0.1917, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 19.50% (0.0605 => 0.0723, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 18.48% (0.0947 => 0.1122, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 18.31% (0.5826 => 0.6893, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.10% (0.3890 => 0.4594, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 18.07% (0.5889 => 0.6953, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.99% (0.1462 => 0.1725, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: 17.98% (0.1218 => 0.1437, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.87% (0.2014 => 0.2374, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 17.82% (0.0808 => 0.0952, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.53% (1.3152 => 1.5458, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.37% (0.1088 => 0.1277, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 17.32% (0.4029 => 0.4727, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 17.28% (0.1505 => 0.1765, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.25% (0.2736 => 0.3208, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.84% (3.5627 => 4.1628, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 16.62% (1.8794 => 2.1918, std.dev.: 0.0041) MultiSource/Applications/Burg/burg: 16.55% (0.5546 => 0.6464, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.50% (0.2866 => 0.3339, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.47% (0.1160 => 0.1351, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.37% (0.5026 => 0.5849, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.36% (0.1968 => 0.2290, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.17% (1.6211 => 1.8832, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.10% (0.4658 => 0.5408, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 16.06% (0.7171 => 0.8323, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.02% (0.3271 => 0.3795, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.00% (0.2875 => 0.3335, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 15.76% (0.1421 => 0.1645, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 15.70% (1.0781 => 1.2474, std.dev.: 0.0032) MultiSource/Applications/hbd/hbd: 15.56% (0.9697 => 1.1206, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: 15.56% (0.2725 => 0.3149, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.50% (0.4361 => 0.5037, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.45% (2.7292 => 3.1508, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.38% (0.2738 => 0.3159, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 15.36% (0.2714 => 0.3131, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 15.26% (0.1284 => 0.1480, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.26% (1.9694 => 2.2699, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.24% (4.4195 => 5.0932, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/matrix: 15.14% (0.2780 => 0.3201, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.13% (0.2729 => 0.3142, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 15.13% (0.2750 => 0.3166, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.11% (0.3930 => 0.4524, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 15.11% (0.2813 => 0.3238, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 15.09% (0.2823 => 0.3249, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 15.08% (0.3096 => 0.3563, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 15.08% (0.3004 => 0.3457, std.dev.: 0.0045) MultiSource/Applications/ClamAV/clamscan: 15.08% (4.2109 => 4.8458, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.02% (0.3195 => 0.3675, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.01% (0.2792 => 0.3211, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 14.91% (0.2803 => 0.3221, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.85% (2.0673 => 2.3742, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.81% (0.2911 => 0.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 14.76% (0.2811 => 0.3226, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.74% (1.9966 => 2.2908, std.dev.: 0.0104) MultiSource/Benchmarks/Bullet/bullet: 14.73% (23.5202 => 26.9844, std.dev.: 0.0254) MultiSource/Applications/hexxagon/hexxagon: 14.60% (0.9909 => 1.1356, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.28% (0.3488 => 0.3986, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 14.27% (0.3258 => 0.3723, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/ary3: 14.26% (0.3267 => 0.3733, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 14.26% (0.3465 => 0.3959, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 14.25% (0.3446 => 0.3937, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 14.24% (0.3496 => 0.3994, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.22% (0.1090 => 0.1245, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 14.13% (0.3460 => 0.3949, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 14.13% (0.3469 => 0.3959, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/trivial-interface: 14.06% (0.3442 => 0.3926, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 13.99% (0.3317 => 0.3781, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.99% (0.3060 => 0.3488, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.92% (0.3362 => 0.3830, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.89% (0.3124 => 0.3558, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 13.78% (0.3678 => 0.4185, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 13.78% (0.3650 => 0.4153, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 13.78% (0.3643 => 0.4145, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 13.73% (0.2075 => 0.2360, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 13.65% (0.4146 => 0.4712, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 13.64% (0.2566 => 0.2916, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 13.59% (0.3724 => 0.4230, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 13.53% (1.4269 => 1.6199, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/lists: 13.50% (0.3348 => 0.3800, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.50% (0.3282 => 0.3725, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.41% (0.3625 => 0.4111, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.37% (0.3845 => 0.4359, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sieve: 13.26% (0.3726 => 0.4220, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 13.23% (0.3477 => 0.3937, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 13.10% (0.7875 => 0.8907, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 13.01% (0.4251 => 0.4804, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.99% (0.3981 => 0.4498, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.98% (0.3690 => 0.4169, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 12.80% (2.1653 => 2.4425, std.dev.: 0.0119) MultiSource/Applications/JM/lencod/lencod: 12.61% (4.6177 => 5.2001, std.dev.: 0.0086) MultiSource/Benchmarks/mafft/pairlocalalign: 12.48% (2.1013 => 2.3635, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/bigfib: 12.31% (0.5012 => 0.5629, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.72% (0.2040 => 0.2279, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 11.63% (0.2691 => 0.3004, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 10.99% (5.5417 => 6.1506, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.96% (0.6435 => 0.7140, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.41% (0.1383 => 0.1527) MultiSource/Applications/lambda-0_1_3/lambda: 10.35% (0.3498 => 0.3860, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 10.32% (0.4847 => 0.5347, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.12% (0.2737 => 0.3014, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.12% (0.1028 => 0.1132, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.91% (0.2068 => 0.2273, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 9.83% (0.6634 => 0.7286, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.70% (0.3084 => 0.3383, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 9.65% (0.3336 => 0.3658, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.84% (0.2103 => 0.2289, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 8.84% (2.0346 => 2.2145, std.dev.: 0.0032) MultiSource/Applications/lemon/lemon: 8.66% (0.2391 => 0.2598, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.26% (4.6926 => 5.0804, std.dev.: 0.0167) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.05% (11.6398 => 12.5768, std.dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.46% (0.5361 => 0.5761, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.85% (0.7426 => 0.7935, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.75% (0.5584 => 0.5961, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: 6.09% (11.9555 => 12.6836, std.dev.: 0.0216) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.85% (0.3792 => 0.3976, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.27% (0.2162 => 0.3530, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6533, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0300) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 8.64% (0.2802 => 0.3044, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6098, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.01% (12.0509 => 12.6546, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1699, std.dev.: 0.0202) SingleSource/Benchmarks/Misc/flops-2: 4.18% (1.8057 => 1.8812, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.12% (0.3693 => 0.3845, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/dry: 2.56% (14.0481 => 14.4080, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2005, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.71% (3.1722 => 3.2263, std.dev.: 0.0032) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3041, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.34% (7.1849 => 7.2809, std.dev.: 0.0069) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5143, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5832, std.dev.: 0.0090) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.18% (2.4764 => 2.4223, std.dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.56% (25.4195 => 16.3799, std.dev.: 0.0189) SingleSource/Benchmarks/Shootout-C++/ary2: -8.49% (0.2402 => 0.2198, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9772, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: -7.69% (35.5013 => 32.7728, std.dev.: 0.0142) MultiSource/Benchmarks/Olden/tsp/tsp: -7.31% (2.1113 => 1.9569, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -3.10% (11.2080 => 10.8608, std.dev.: 0.0155) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5191, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (17.2379 => 16.7837, std.dev.: 0.0324) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8727, std.dev.: 0.0172) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.15% (0.6293 => 0.6158, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5727, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4965, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.08% (3.3991 => 3.3625, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0449, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 5 15:59:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 5 Nov 2012 17:59:30 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121105235930.ECF742A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5608?compare_to=5605&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5608, Order: 167411, Start Time: 2012-11-05 22:33:09, End Time: 2012-11-05 23:59:39 To: 5605, Order: 167398, Start Time: 2012-11-05 20:48:01, End Time: 2012-11-05 22:14:51 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 12 (97 on baseline) Performance Improvements: 10 (25 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 969 (852 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.53% (0.2406 => 0.2515, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.81% (0.8409 => 0.8729, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.39% (0.6050 => 0.6255, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.56% (0.8836 => 0.9062, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 2.35% (0.9925 => 1.0158, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.26% (0.7870 => 0.8048, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/gs/gs: 2.19% (4.1755 => 4.2671, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.55% (1.2565 => 1.2760, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.30% (8.7794 => 8.8936, std.dev.: 0.0436) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.71% (6.7365 => 7.2559, std.dev.: 0.0953) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.02% (1.3717 => 1.4268, std.dev.: 0.0130) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.84% (0.3071 => 0.3189, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.21% (0.9420 => 0.9212, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.97% (0.9218 => 0.9036, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.89% (0.8362 => 0.8204, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.81% (1.0037 => 0.9855, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.57% (0.8995 => 0.8854, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.21% (0.9010 => 0.8901, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.13% (0.9114 => 0.9011, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.05% (1.0190 => 1.0083, std.dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: -1.47% (4.3637 => 4.2996, std.dev.: 0.0207) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.02% (4.1092 => 4.0673, std.dev.: 0.0125) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.02% (16.6170 => 16.6208, std.dev.: 0.3771) MultiSource/Applications/obsequi/Obsequi: 1.71% (1.0492 => 1.0671, std.dev.: 0.0135) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.05% (21.6180 => 21.6071, std.dev.: 0.3084) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.47% (0.3629 => 0.3646, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: -0.40% (0.6019 => 0.5995, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.81% (0.3353 => 0.3326, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: -0.35% (0.2003 => 0.1996, std.dev.: 0.0065) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.46% (0.0219 => 0.0218, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.47% (0.0427 => 0.0425, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.30% (0.0331 => 0.0330, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0313 => 0.0314, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.24% (0.0423 => 0.0424, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 61.90% (0.0126 => 0.0204) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0218 => 0.0218, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.74% (0.1423 => 0.1462, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -4.95% (1.1850 => 1.1263, std.dev.: 0.0104) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1517 => 0.1518, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.17% (0.4180 => 0.4229, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.29% (0.1382 => 0.1386, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.46% (0.0647 => 0.0650, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.72% (0.0277 => 0.0275, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.03% (0.0546 => 0.0568, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.42% (1.1942 => 1.1992, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.78% (0.0638 => 0.0643, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.44% (0.0248 => 0.0237, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.70% (0.7753 => 0.7807, std.dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -50.00% (0.0002 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 97.73% (0.0044 => 0.0087, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2298.23% (0.6332 => 15.1856, std.dev.: 0.1502) MultiSource/Benchmarks/McCat/08-main/main: 46.75% (0.1831 => 0.2687, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.74% (0.1559 => 0.1454, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1482.86% (0.3344 => 5.2931, std.dev.: 0.1564) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.90% (0.2364 => 0.3260, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0429 => 0.0439, std.dev.: 0.0034) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.46% (0.0224 => 0.0234, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4249, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0683, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4939, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3437, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1369, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4030, std.dev.: 0.0058) SingleSource/Regression/C/uint64_to_float: -24.14% (2.1832 => 1.6562, std.dev.: 0.0053) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.90% (0.0810 => 0.0955, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.84% (0.0773 => 0.0880, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.29% (0.0830 => 0.0932, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 11.42% (0.1112 => 0.1239, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.36% (0.2279 => 0.2515, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.99% (0.2180 => 0.2376, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.91% (0.8321 => 0.9062, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.69% (0.7473 => 0.8048, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.19% (0.2240 => 0.2401, std.dev.: 0.0052) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.17% (0.3137 => 0.3362, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.13% (0.8148 => 0.8729, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.87% (0.4847 => 0.5180, std.dev.: 0.0092) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.15% (0.1983 => 0.2105, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.84% (0.1885 => 0.1995, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.38% (0.2378 => 0.2506, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.37% (0.2998 => 0.3159, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.93% (0.5961 => 0.6255, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.55% (0.3295 => 0.3445, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.54% (1.1685 => 1.2216, std.dev.: 0.0094) MultiSource/Applications/hbd/hbd: 4.45% (1.4269 => 1.4904, std.dev.: 0.0180) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.43% (1.1606 => 1.2120, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.96% (0.9435 => 0.9809, std.dev.: 0.0095) MultiSource/Applications/Burg/burg: 3.94% (1.2222 => 1.2704, std.dev.: 0.0140) MultiSource/Applications/hexxagon/hexxagon: 3.55% (0.9810 => 1.0158, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.36% (0.6287 => 0.6498, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.34% (0.8286 => 0.8563, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.32% (0.5817 => 0.6010, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/gs/gs: 3.31% (4.1305 => 4.2671, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.30% (6.6074 => 6.8252, std.dev.: 0.0227) MultiSource/Applications/lua/lua: 3.28% (3.8189 => 3.9442, std.dev.: 0.0144) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.20% (0.3717 => 0.3836, std.dev.: 0.0017) MultiSource/Applications/treecc/treecc: 3.15% (1.9948 => 2.0576, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.08% (1.4479 => 1.4925, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.07% (1.6386 => 1.6889, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.97% (4.4873 => 4.6205, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.85% (4.1763 => 4.2954, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.84% (8.6476 => 8.8936, std.dev.: 0.0436) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.74% (0.8611 => 0.8847, std.dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 2.73% (1.1271 => 1.1579, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.54% (0.8420 => 0.8634, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.35% (0.8697 => 0.8901, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.12% (0.8007 => 0.8177, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.11% (13.1811 => 13.4595, std.dev.: 0.1005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.10% (0.8656 => 0.8838, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.04% (0.8855 => 0.9036, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.97% (0.8597 => 0.8766, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.95% (0.8086 => 0.8244, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.91% (0.9039 => 0.9212, std.dev.: 0.0058) MultiSource/Applications/JM/ldecod/ldecod: 1.78% (6.7320 => 6.8516, std.dev.: 0.0284) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.77% (0.9908 => 1.0083, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.76% (0.8457 => 0.8606, std.dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: 1.75% (31.8598 => 32.4160, std.dev.: 0.1195) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.72% (0.9688 => 0.9855, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.71% (0.8066 => 0.8204, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.71% (0.8359 => 0.8502, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.63% (0.8712 => 0.8854, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.62% (0.8805 => 0.8948, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.62% (0.8261 => 0.8395, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.53% (0.8177 => 0.8302, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.46% (0.8716 => 0.8843, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.42% (0.8885 => 0.9011, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 1.36% (8.6247 => 8.7424, std.dev.: 0.0200) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.25% (1.2602 => 1.2760, std.dev.: 0.0053) MultiSource/Applications/oggenc/oggenc: 1.03% (4.9628 => 5.0140, std.dev.: 0.0127) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 91.46% (0.0199 => 0.0381, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/pi: 57.39% (1.5795 => 2.4860, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.34% (2.9753 => 3.4615, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.11% (0.7597 => 0.8821, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.41% (2.7995 => 3.2029, std.dev.: 0.0671) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 13.78% (6.3772 => 7.2559, std.dev.: 0.0953) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.62% (5.0261 => 5.6101, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.69% (1.1857 => 1.2769, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 7.53% (1.7056 => 1.8341, std.dev.: 0.0432) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.80% (4.7794 => 5.1046, std.dev.: 0.0480) SingleSource/Benchmarks/Misc/richards_benchmark: 6.31% (1.3037 => 1.3860, std.dev.: 0.0068) MultiSource/Applications/SIBsim4/SIBsim4: 6.19% (3.1873 => 3.3846, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.95% (4.9686 => 5.2642, std.dev.: 0.0706) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.71% (4.5327 => 4.7913, std.dev.: 0.0170) MultiSource/Benchmarks/Olden/treeadd/treeadd: 5.38% (0.3587 => 0.3780, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.79% (6.2275 => 6.5256, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.72% (3.3761 => 3.5353, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.37% (4.9453 => 5.1616, std.dev.: 0.0081) MultiSource/Benchmarks/BitBench/drop3/drop3: 4.23% (0.2887 => 0.3009, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.12% (4.9469 => 5.1505, std.dev.: 0.0066) MultiSource/Applications/hexxagon/hexxagon: 4.01% (14.0064 => 14.5685, std.dev.: 0.0595) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.94% (11.5690 => 11.9089, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.78% (1.3882 => 1.4268, std.dev.: 0.0130) MultiSource/Applications/lambda-0_1_3/lambda: 2.70% (7.4933 => 7.6954, std.dev.: 0.0364) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.69% (8.2783 => 8.5008, std.dev.: 0.0146) MultiSource/Applications/siod/siod: 2.18% (3.6643 => 3.7443, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout/lists: 2.17% (7.3375 => 7.4970, std.dev.: 0.0185) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.56% (2.4647 => 2.5031, std.dev.: 0.0085) MultiSource/Benchmarks/FreeBench/neural/neural: 1.32% (1.0841 => 1.0984, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 1.28% (8.5322 => 8.6410, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.15% (1.4536 => 1.4703, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.12% (1.5941 => 1.6119, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.00% (3.5679 => 3.6036, std.dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.27% (5.4641 => 4.3020, std.dev.: 0.0165) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.68% (1.0512 => 0.9284, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: -11.05% (1.1216 => 0.9977, std.dev.: 0.0168) MultiSource/Benchmarks/mafft/pairlocalalign: -8.54% (63.1822 => 57.7865, std.dev.: 0.0506) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.85% (4.7482 => 4.4230, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.39% (0.3269 => 0.3060, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.97% (3.7148 => 3.4930, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.79% (5.4972 => 5.1791, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.06% (5.1557 => 4.8947, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.35% (4.7449 => 4.5385, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.61% (6.0224 => 5.8050, std.dev.: 0.0185) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.55% (2.4490 => 2.3620, std.dev.: 0.0177) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.27% (2.8773 => 2.7832, std.dev.: 0.0271) MultiSource/Applications/lua/lua: -2.99% (29.8330 => 28.9417, std.dev.: 0.0997) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.98% (28.5821 => 27.7293, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.96% (0.5807 => 0.5635, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.95% (2.6356 => 2.5578, std.dev.: 0.0056) MultiSource/Applications/aha/aha: -2.60% (3.3398 => 3.2529, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.50% (9.9065 => 9.6589, std.dev.: 0.0554) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.00% (11.5316 => 11.3005, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.64% (4.9994 => 4.9176, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/hash2: -1.50% (3.4237 => 3.3722, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.38% (2.3487 => 2.3162, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: -1.28% (4.3552 => 4.2996, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.22% (5.6343 => 5.5658, std.dev.: 0.0247) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.06% (16.4461 => 16.6208, std.dev.: 0.3771) MultiSource/Applications/obsequi/Obsequi: 3.99% (1.0262 => 1.0671, std.dev.: 0.0135) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6818.70% (0.3123 => 21.6071, std.dev.: 0.3084) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.03% (0.2463 => 0.3646, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: -0.25% (0.6010 => 0.5995, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.84% (0.3266 => 0.3326, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 1.37% (0.1969 => 0.1996, std.dev.: 0.0065) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.67% (0.1438 => 0.1462, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.58% (1.1329 => 1.1263, std.dev.: 0.0104) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.83% (0.1462 => 0.1518, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.56% (0.4164 => 0.4229, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.24% (0.1369 => 0.1386, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.40% (0.0641 => 0.0650, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.03% (0.0195 => 0.0275, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.73% (0.0578 => 0.0568, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.85% (1.1437 => 1.1992, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.55% (0.0627 => 0.0643, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.67% (0.0180 => 0.0237, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.62% (0.8017 => 0.7807, std.dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 40.32% (0.0062 => 0.0087, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 5 16:14:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 5 Nov 2012 18:14:32 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121106001432.92CF22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5609?compare_to=5606&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5609, Order: 167411, Start Time: 2012-11-05 22:49:24, End Time: 2012-11-06 00:14:38 To: 5606, Order: 167398, Start Time: 2012-11-05 21:01:29, End Time: 2012-11-05 22:26:16 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (180 on baseline) Unchanged Tests: 1041 (857 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.47% (54.6303 => 56.5260, std.dev.: 0.1143) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.57% (54.5751 => 56.5260, std.dev.: 0.1143) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.80% (2.0478 => 2.1051, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.4937 => 7.6823, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout-C++/hash2: 2.07% (3.1932 => 3.2592, std.dev.: 0.0085) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.09% (0.3821 => 0.3512, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -7.59% (2.4924 => 2.3033, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: -6.98% (0.3812 => 0.3546, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.94% (0.3142 => 0.2924, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.89% (0.3831 => 0.3567, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: -6.87% (0.4033 => 0.3756, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -6.86% (0.3880 => 0.3614, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.84% (0.2428 => 0.2262, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.81% (0.3891 => 0.3626, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/synchronized: -6.75% (0.3896 => 0.3633, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.75% (0.3884 => 0.3622, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.73% (22.4056 => 20.8982, std.dev.: 0.0184) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.67% (3.5339 => 3.2981, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.67% (0.3658 => 0.3414, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.61% (0.3357 => 0.3135, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -6.61% (0.4176 => 0.3900, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -6.60% (0.3848 => 0.3594, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/parameter-passing: -6.47% (0.4280 => 0.4003, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.45% (0.9542 => 0.8927, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -6.43% (0.4199 => 0.3929, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -6.41% (16.1920 => 15.1534, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.35% (0.6484 => 0.6072, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -6.34% (4.3330 => 4.0584, std.dev.: 0.0123) MultiSource/Applications/JM/ldecod/ldecod: -6.32% (7.0961 => 6.6477, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/oourafft: -6.30% (0.2160 => 0.2024, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -6.29% (1.2515 => 1.1728, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.25% (1.0544 => 0.9885, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.24% (0.1716 => 0.1609, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/football/football: -6.19% (0.9179 => 0.8611, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -6.18% (1.1450 => 1.0742, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.13% (1.2784 => 1.2000, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.12% (0.1796 => 0.1686, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.12% (9.2283 => 8.6632, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.11% (1.2300 => 1.1548, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.10% (0.9852 => 0.9251, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.09% (0.2695 => 0.2531, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.07% (0.4151 => 0.3899, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -6.07% (0.1879 => 0.1765, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.06% (1.3722 => 1.2890, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.05% (0.7919 => 0.7440, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.05% (1.6474 => 1.5478, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.03% (1.4642 => 1.3759, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/bh/bh: -6.03% (0.2985 => 0.2805, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.03% (0.2355 => 0.2213, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.03% (1.6364 => 1.5378, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.00% (5.4682 => 5.1400, std.dev.: 0.0100) MultiSource/Benchmarks/nbench/nbench: -6.00% (1.1530 => 1.0838, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.00% (4.8161 => 4.5271, std.dev.: 0.0020) MultiSource/Applications/siod/siod: -6.00% (2.4021 => 2.2580, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.00% (4.5069 => 4.2367, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.98% (4.8802 => 4.5882, std.dev.: 0.0052) SingleSource/Benchmarks/McGill/chomp: -5.96% (0.1761 => 0.1656, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.96% (0.3406 => 0.3203, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.90% (4.0323 => 3.7943, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: -5.88% (0.4861 => 0.4575, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -5.87% (1.3148 => 1.2376, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: -5.87% (0.2659 => 0.2503, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.85% (14.2083 => 13.3770, std.dev.: 0.0150) MultiSource/Applications/minisat/minisat: -5.84% (0.7447 => 0.7012, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -5.84% (17.1032 => 16.1043, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.83% (0.3483 => 0.3280, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -5.81% (4.0594 => 3.8234, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.81% (0.2548 => 0.2400, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.80% (0.6736 => 0.6345, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.78% (0.5999 => 0.5652, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.77% (0.3849 => 0.3627, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -5.75% (15.5079 => 14.6164, std.dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.71% (6.7716 => 6.3848, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.70% (0.8521 => 0.8035, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.70% (0.3931 => 0.3707, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -5.70% (0.3581 => 0.3377, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.69% (0.3025 => 0.2853, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.68% (0.3837 => 0.3619, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.66% (2.2587 => 2.1308, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/strcat: -5.65% (0.2989 => 0.2820, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.63% (0.6230 => 0.5879, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.62% (0.2278 => 0.2150, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.62% (0.6052 => 0.5712, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -5.62% (0.3026 => 0.2856, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -5.61% (1.3864 => 1.3086, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: -5.61% (3.5154 => 3.3182, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.61% (2.1713 => 2.0495, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.61% (0.6293 => 0.5940, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -5.60% (0.3194 => 0.3015, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -5.60% (2.1401 => 2.0203, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.60% (0.3323 => 0.3137, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.59% (0.3057 => 0.2886, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -5.59% (34.0927 => 32.1866, std.dev.: 0.0253) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.59% (0.5478 => 0.5172, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: -5.57% (0.3446 => 0.3254) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.57% (0.2999 => 0.2832, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.57% (0.5857 => 0.5531, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/matrix: -5.56% (0.3255 => 0.3074, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.55% (0.7021 => 0.6631, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -5.55% (0.3621 => 0.3420, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.55% (0.6667 => 0.6297, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.54% (0.5329 => 0.5034, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -5.52% (0.3481 => 0.3289, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -5.51% (0.4248 => 0.4014, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.50% (0.5925 => 0.5599, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.48% (0.4321 => 0.4084, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: -5.48% (0.3394 => 0.3208, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.47% (0.4916 => 0.4647, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: -5.47% (0.2871 => 0.2714, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -5.47% (0.6750 => 0.6381, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.46% (0.6681 => 0.6316, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.46% (0.6395 => 0.6046, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -5.46% (0.3867 => 0.3656, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.46% (0.5591 => 0.5286, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: -5.45% (0.4515 => 0.4269, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.44% (0.3252 => 0.3075, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.44% (0.2903 => 0.2745, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.44% (0.6194 => 0.5857, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.44% (0.5168 => 0.4887, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.43% (0.9557 => 0.9038, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.41% (0.3491 => 0.3302, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.41% (0.4083 => 0.3862, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: -5.41% (0.2939 => 0.2780, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.41% (0.7339 => 0.6942, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.41% (0.6304 => 0.5963, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: -5.41% (18.2933 => 17.3040, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.40% (0.3016 => 0.2853, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.40% (0.6297 => 0.5957, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.40% (0.4427 => 0.4188, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.39% (0.3319 => 0.3140, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.39% (0.6660 => 0.6301, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: -5.37% (0.2849 => 0.2696, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.36% (0.5863 => 0.5549, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.35% (0.2933 => 0.2776, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -5.35% (0.7982 => 0.7555, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.35% (1.2210 => 1.1557, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.35% (0.5705 => 0.5400, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.34% (0.5802 => 0.5492, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.34% (0.5805 => 0.5495, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: -5.34% (0.3205 => 0.3034, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -5.33% (0.3059 => 0.2896, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.32% (0.2385 => 0.2258, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.32% (0.5849 => 0.5538, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.31% (8.0126 => 7.5869, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: -5.31% (0.3788 => 0.3587, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.31% (0.6446 => 0.6104, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.27% (0.2106 => 0.1995, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.26% (1.2221 => 1.1578, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.26% (0.6260 => 0.5931, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.25% (0.6189 => 0.5864, std.dev.: 0.0050) MultiSource/Applications/ClamAV/clamscan: -5.25% (15.2527 => 14.4524, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.24% (0.5569 => 0.5277, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.24% (0.4813 => 0.4561, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.22% (0.7524 => 0.7131, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.21% (0.5859 => 0.5554, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.20% (0.5941 => 0.5632, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.18% (0.5575 => 0.5286, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.17% (0.5456 => 0.5174, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.17% (0.6676 => 0.6331, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.16% (0.5567 => 0.5280, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.16% (0.6440 => 0.6108, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.15% (0.7198 => 0.6827, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.14% (0.6395 => 0.6066, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -5.14% (0.3271 => 0.3103, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.10% (0.5570 => 0.5286, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.06% (0.5688 => 0.5400, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: -5.06% (0.4524 => 0.4295, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -5.00% (0.8418 => 0.7997, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: -4.96% (5.0226 => 4.7736, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.96% (0.6033 => 0.5734, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.53% (0.9077 => 0.8666, std.dev.: 0.0042) MultiSource/Applications/hbd/hbd: -4.27% (1.5610 => 1.4943, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: -4.24% (0.6347 => 0.6078, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: -4.18% (0.6441 => 0.6172, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -4.08% (0.7779 => 0.7462, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7542, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1732, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: -3.83% (2.2633 => 2.1766, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0245, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.54% (1.3096 => 1.2763, std.dev.: 0.0101) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4683, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 5 17:42:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 5 Nov 2012 19:42:44 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121106014244.883832A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5610?compare_to=5608&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5610, Order: 167421, Start Time: 2012-11-06 00:17:09, End Time: 2012-11-06 01:42:53 To: 5608, Order: 167411, Start Time: 2012-11-05 22:33:09, End Time: 2012-11-05 23:59:39 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 6 (103 on baseline) Performance Improvements: 4 (28 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 981 (843 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/Burg/burg: 2.42% (1.2704 => 1.3012, std.dev.: 0.0029) MultiSource/Applications/d/make_dparser: 1.34% (3.2971 => 3.3413, std.dev.: 0.0138) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.07% (0.3159 => 0.3477, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.41% (40.6186 => 42.0044, std.dev.: 0.2028) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.18% (1.1289 => 1.1535, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.94% (21.8446 => 22.2685, std.dev.: 0.1393) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.26% (0.8337 => 0.8232, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.89% (7.2559 => 6.7563, std.dev.: 0.1045) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.90% (6.5228 => 6.2031, std.dev.: 0.0686) SingleSource/Benchmarks/Shootout-C++/matrix: -3.67% (2.9859 => 2.8764, std.dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.37% (16.6208 => 16.8493, std.dev.: 0.0629) MultiSource/Applications/obsequi/Obsequi: 0.37% (1.0671 => 1.0711, std.dev.: 0.0191) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.11% (21.6071 => 21.6301, std.dev.: 0.2085) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.33% (0.3646 => 0.3634, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 1.18% (0.5995 => 0.6066, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.18% (0.3326 => 0.3332, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/strcat: -0.30% (0.1996 => 0.1990, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -33.03% (0.0218 => 0.0146, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.65% (0.0425 => 0.0418, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.42% (0.0330 => 0.0322, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0314 => 0.0315, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.24% (0.0424 => 0.0425, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0204 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -14.22% (0.0218 => 0.0187, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -1.85% (0.1462 => 0.1435, std.dev.: 0.0042) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -5.49% (1.1263 => 1.0645, std.dev.: 0.0585) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -5.53% (0.1518 => 0.1434, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.64% (0.4229 => 0.4202, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.18% (0.1386 => 0.1444, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.23% (0.0650 => 0.0577, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -30.55% (0.0275 => 0.0191, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.88% (0.0568 => 0.0563, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.59% (1.1992 => 1.1921, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.62% (0.0643 => 0.0647, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0237 => 0.0237, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.33% (0.7807 => 0.7781, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -47.13% (0.0087 => 0.0046, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2304.37% (0.6332 => 15.2245, std.dev.: 0.1041) MultiSource/Benchmarks/McCat/08-main/main: 47.90% (0.1831 => 0.2708, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -10.07% (0.1559 => 0.1402, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1488.25% (0.3344 => 5.3111, std.dev.: 0.0149) SingleSource/Benchmarks/Misc-C++/Large/ray: 34.14% (0.2364 => 0.3171, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel: - (0.0429 => 0.0429, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.36% (0.0224 => 0.0236, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4238, std.dev.: 0.0629) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0726, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4954) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3450, std.dev.: 0.0657) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1259, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3999, std.dev.: 0.0021) SingleSource/Regression/C/uint64_to_float: -23.98% (2.1832 => 1.6596, std.dev.: 0.0045) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.67% (0.0810 => 0.0945, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.37% (0.0830 => 0.0941, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: 9.80% (0.1112 => 0.1221, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.08% (0.1905 => 0.2059, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.51% (0.1425 => 0.1532, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.34% (0.2180 => 0.2340, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.28% (0.2279 => 0.2445, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.69% (0.7473 => 0.7973, std.dev.: 0.0145) MultiSource/Applications/Burg/burg: 6.46% (1.2222 => 1.3012, std.dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 5.77% (0.2999 => 0.3172, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.53% (0.4847 => 0.5115, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.07% (0.6287 => 0.6606, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.05% (1.1606 => 1.2192, std.dev.: 0.0102) MultiSource/Applications/hbd/hbd: 4.97% (1.4269 => 1.4978, std.dev.: 0.0081) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.64% (0.2519 => 0.2636, std.dev.: 0.0020) MultiSource/Applications/spiff/spiff: 4.31% (0.7950 => 0.8293, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.76% (0.4127 => 0.4282, std.dev.: 0.0045) MultiSource/Applications/ClamAV/clamscan: 3.51% (14.7684 => 15.2861, std.dev.: 0.0841) MultiSource/Applications/SPASS/SPASS: 3.37% (14.2605 => 14.7406, std.dev.: 0.1168) MultiSource/Applications/d/make_dparser: 3.23% (3.2366 => 3.3413, std.dev.: 0.0138) MultiSource/Benchmarks/McCat/05-eks/eks: 3.18% (0.4397 => 0.4537, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.89% (0.4783 => 0.4921, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.82% (6.6074 => 6.7934, std.dev.: 0.0611) MultiSource/Applications/JM/ldecod/ldecod: 2.76% (6.7320 => 6.9181, std.dev.: 0.0309) MultiSource/Applications/hexxagon/hexxagon: 2.74% (0.9810 => 1.0079, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.72% (0.3717 => 0.3818, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.68% (4.1763 => 4.2881, std.dev.: 0.0180) MultiSource/Applications/minisat/minisat: 2.58% (0.6834 => 0.7010, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 2.57% (15.3280 => 15.7225, std.dev.: 0.0760) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.53% (0.8697 => 0.8917, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.29% (0.8611 => 0.8808, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.26% (0.8050 => 0.8232, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.18% (0.8286 => 0.8467, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.17% (0.8420 => 0.8603, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.16% (0.8317 => 0.8497, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 2.16% (2.2184 => 2.2664, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.16% (4.4873 => 4.5842, std.dev.: 0.0294) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.14% (0.8331 => 0.8509, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.13% (1.6386 => 1.6735, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.13% (0.8177 => 0.8351, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.10% (0.7966 => 0.8133, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.07% (0.8597 => 0.8775, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.04% (0.9056 => 0.9241, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.02% (0.8805 => 0.8983, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.01% (0.8340 => 0.8508, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.01% (0.9074 => 0.9256, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.96% (0.8204 => 0.8365, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.96% (0.8069 => 0.8227, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.95% (0.8086 => 0.8244, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.95% (0.9039 => 0.9215, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.93% (0.8712 => 0.8880, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.93% (0.8457 => 0.8620, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.93% (1.4479 => 1.4758, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.92% (0.8261 => 0.8420, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.87% (13.1811 => 13.4272, std.dev.: 0.0419) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.85% (0.6227 => 0.6342, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.84% (0.8316 => 0.8469, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.82% (0.8066 => 0.8213, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.81% (0.8338 => 0.8489, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.80% (0.8656 => 0.8812, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.79% (0.8885 => 0.9044, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.78% (0.9688 => 0.9860, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.77% (0.8359 => 0.8507, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 1.71% (4.9628 => 5.0475, std.dev.: 0.0185) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.44% (1.5315 => 1.5536, std.dev.: 0.0055) MultiSource/Applications/lambda-0_1_3/lambda: 1.43% (0.7557 => 0.7665, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 91.46% (0.0199 => 0.0381, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/pi: 58.96% (1.5795 => 2.5108, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 18.53% (0.7597 => 0.9005, std.dev.: 0.0504) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.45% (2.9753 => 3.4648, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.73% (2.7995 => 3.2119, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.50% (5.0261 => 5.6043, std.dev.: 0.0213) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.13% (0.3186 => 0.3477, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/queens: 7.35% (1.7056 => 1.8309, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 6.70% (1.1857 => 1.2651, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.61% (4.7794 => 5.0954, std.dev.: 0.0115) MultiSource/Applications/SIBsim4/SIBsim4: 6.60% (3.1873 => 3.3978, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.94% (6.3772 => 6.7563, std.dev.: 0.1045) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.88% (4.5327 => 4.7993, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.86% (4.9686 => 5.2599, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/richards_benchmark: 5.04% (1.3037 => 1.3694, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.54% (6.2275 => 6.5102, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.42% (3.3761 => 3.5253, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.09% (4.9453 => 5.1477, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.06% (4.9469 => 5.1478, std.dev.: 0.0162) MultiSource/Applications/hexxagon/hexxagon: 4.06% (14.0064 => 14.5747, std.dev.: 0.0445) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.29% (0.3587 => 0.3705, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.95% (8.2783 => 8.5229, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.83% (11.5690 => 11.8968, std.dev.: 0.0070) MultiSource/Applications/lambda-0_1_3/lambda: 2.73% (7.4933 => 7.6981, std.dev.: 0.0685) SingleSource/Benchmarks/Dhrystone/dry: 2.72% (0.5081 => 0.5219, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.64% (4.8362 => 4.9637, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.57% (4.8660 => 4.9909, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 2.39% (3.6643 => 3.7518, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout/lists: 2.22% (7.3375 => 7.5001, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.44% (3.5679 => 3.6193, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/power/power: 1.43% (1.2061 => 1.2233, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.40% (4.4340 => 4.4962, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.40% (41.4238 => 42.0044, std.dev.: 0.2028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.31% (2.4647 => 2.4970, std.dev.: 0.0123) MultiSource/Benchmarks/FreeBench/neural/neural: 1.25% (1.0841 => 1.0976, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 1.13% (2.3560 => 2.3826, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 1.11% (8.5322 => 8.6270, std.dev.: 0.0267) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.09% (5.4641 => 4.3116, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.00% (7.2130 => 6.2031, std.dev.: 0.0686) SingleSource/Benchmarks/McGill/chomp: -11.21% (1.1216 => 0.9959, std.dev.: 0.0240) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.86% (1.0512 => 0.9370, std.dev.: 0.0084) MultiSource/Benchmarks/mafft/pairlocalalign: -8.55% (63.1822 => 57.7777, std.dev.: 0.0779) SingleSource/Benchmarks/Shootout-C++/ackermann: -7.47% (3.9188 => 3.6259, std.dev.: 0.0676) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.85% (4.7482 => 4.4229, std.dev.: 0.0572) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.39% (0.3269 => 0.3060, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.94% (3.7148 => 3.4940, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.80% (5.4972 => 5.1784, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.10% (5.1557 => 4.8926, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.36% (4.7449 => 4.5378, std.dev.: 0.0372) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.99% (2.8773 => 2.7624, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.72% (6.0224 => 5.7982, std.dev.: 0.0160) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.06% (28.5821 => 27.7064, std.dev.: 0.1142) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.99% (1.2822 => 1.2438, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.98% (0.5807 => 0.5634, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.88% (2.6356 => 2.5598, std.dev.: 0.0205) MultiSource/Applications/lua/lua: -2.67% (29.8330 => 29.0366, std.dev.: 0.0471) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.66% (2.4490 => 2.3838, std.dev.: 0.0243) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.45% (9.9065 => 9.6636, std.dev.: 0.0299) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.36% (3.2169 => 3.1411, std.dev.: 0.0231) MultiSource/Applications/aha/aha: -2.28% (3.3398 => 3.2637, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.16% (11.5316 => 11.2822, std.dev.: 0.0088) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.78% (2.3487 => 2.3068, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.54% (4.9994 => 4.9222, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash2: -1.51% (3.4237 => 3.3720, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.24% (5.6343 => 5.5647, std.dev.: 0.0096) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.45% (16.4461 => 16.8493, std.dev.: 0.0629) MultiSource/Applications/obsequi/Obsequi: 4.38% (1.0262 => 1.0711, std.dev.: 0.0191) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6826.06% (0.3123 => 21.6301, std.dev.: 0.2085) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.54% (0.2463 => 0.3634, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 0.93% (0.6010 => 0.6066, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.02% (0.3266 => 0.3332, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/strcat: 1.07% (0.1969 => 0.1990, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 18.70% (0.0123 => 0.0146, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.45% (0.0408 => 0.0418, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 26.77% (0.0254 => 0.0322, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 3.89% (0.0180 => 0.0187, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1438 => 0.1435, std.dev.: 0.0042) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -6.04% (1.1329 => 1.0645, std.dev.: 0.0585) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -1.92% (0.1462 => 0.1434, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.91% (0.4164 => 0.4202, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.48% (0.1369 => 0.1444, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.98% (0.0641 => 0.0577, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.05% (0.0195 => 0.0191, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.60% (0.0578 => 0.0563, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.23% (1.1437 => 1.1921, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.19% (0.0627 => 0.0647, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.67% (0.0180 => 0.0237, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.94% (0.8017 => 0.7781, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.81% (0.0062 => 0.0046, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 5 18:02:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 5 Nov 2012 20:02:12 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121106020212.C97C92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5611?compare_to=5609&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5611, Order: 167423, Start Time: 2012-11-06 00:37:36, End Time: 2012-11-06 02:02:19 To: 5609, Order: 167411, Start Time: 2012-11-05 22:49:24, End Time: 2012-11-06 00:14:38 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (182 on baseline) Unchanged Tests: 1042 (855 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.44% (54.5751 => 56.4527, std.dev.: 0.1277) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.66% (2.0478 => 2.1022, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/salsa20: 2.43% (7.4937 => 7.6758, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/hash2: 2.30% (3.1932 => 3.2665, std.dev.: 0.0108) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.19% (0.3821 => 0.3508, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -7.60% (2.4924 => 2.3031, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.26% (0.3142 => 0.2914, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.00% (0.2428 => 0.2258, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.85% (0.3357 => 0.3127, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.77% (3.5339 => 3.2945, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -6.68% (4.3330 => 4.0434, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.68% (0.9542 => 0.8905, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.67% (0.3658 => 0.3414, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.65% (0.3880 => 0.3622, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -6.63% (1.2515 => 1.1685, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.63% (0.3891 => 0.3633, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.63% (0.3831 => 0.3577, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.62% (0.4033 => 0.3766, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -6.61% (0.3812 => 0.3560, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.61% (22.4056 => 20.9255, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.59% (1.0544 => 0.9849, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -6.57% (0.3848 => 0.3595, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -6.57% (0.2160 => 0.2018, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -6.57% (0.3896 => 0.3640, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -6.55% (9.2283 => 8.6239, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: -6.54% (0.4176 => 0.3903, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: -6.52% (7.0961 => 6.6335, std.dev.: 0.0041) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.50% (0.1584 => 0.1481, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.49% (0.3884 => 0.3632, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.48% (0.9852 => 0.9214, std.dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: -6.47% (16.1920 => 15.1448, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.46% (0.6484 => 0.6065, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -6.46% (0.9179 => 0.8586, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: -6.43% (0.4199 => 0.3929, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.41% (0.7919 => 0.7411, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.40% (0.2548 => 0.2385, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -6.39% (0.2659 => 0.2489, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -6.38% (0.4280 => 0.4007, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -6.36% (0.1761 => 0.1649, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -6.34% (1.1450 => 1.0724, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.33% (0.2355 => 0.2206, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.32% (1.4642 => 1.3716, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.32% (4.0323 => 3.7775, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: -6.30% (0.2985 => 0.2797, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.30% (1.2784 => 1.1979, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.29% (0.1716 => 0.1608, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.28% (1.3722 => 1.2860, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.28% (1.2300 => 1.1528, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.27% (1.6364 => 1.5338, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.26% (1.6474 => 1.5442, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.24% (0.1796 => 0.1684, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.23% (4.5069 => 4.2259, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.23% (0.1621 => 0.1520, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -6.23% (0.1879 => 0.1762, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: -6.22% (1.1530 => 1.0813, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.14% (0.3483 => 0.3269, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.14% (14.2083 => 13.3355, std.dev.: 0.0033) MultiSource/Applications/lua/lua: -6.12% (4.0594 => 3.8108, std.dev.: 0.0037) MultiSource/Benchmarks/sim/sim: -6.11% (0.3406 => 0.3198, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.06% (0.8521 => 0.8005, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.05% (4.8802 => 4.5851, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.05% (4.8161 => 4.5249, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.02% (0.5999 => 0.5638, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.98% (0.6736 => 0.6333, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.92% (6.7716 => 6.3704, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.90% (0.2695 => 0.2536, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -5.89% (0.3581 => 0.3370, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.87% (0.2999 => 0.2823, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -5.86% (2.1401 => 2.0147, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: -5.85% (0.7447 => 0.7011, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.83% (5.4682 => 5.1492, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/05-eks/eks: -5.83% (0.4515 => 0.4252, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.82% (0.6667 => 0.6279, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: -5.81% (15.5079 => 14.6070, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.80% (0.7339 => 0.6913, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.79% (0.5857 => 0.5518, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.78% (2.2587 => 2.1281, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.77% (0.6293 => 0.5930, std.dev.: 0.0025) MultiSource/Applications/siod/siod: -5.76% (2.4021 => 2.2637, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.76% (0.6304 => 0.5941, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.75% (0.2278 => 0.2147, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.75% (0.6230 => 0.5872, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.74% (0.5591 => 0.5270, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -5.73% (17.1032 => 16.1224, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.72% (0.5575 => 0.5256, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -5.72% (1.3148 => 1.2396, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -5.72% (3.5154 => 3.3144, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.71% (0.6446 => 0.6078, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.70% (0.6052 => 0.5707, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.70% (0.4916 => 0.4636, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.69% (0.4151 => 0.3915, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.68% (0.7021 => 0.6622, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.67% (0.3931 => 0.3708, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.66% (0.7524 => 0.7098, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.65% (0.5859 => 0.5528, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.63% (0.5168 => 0.4877, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.63% (0.6395 => 0.6035, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.59% (0.5863 => 0.5535, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.57% (0.6297 => 0.5946, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.57% (0.5802 => 0.5479, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.56% (0.2106 => 0.1989, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.55% (0.4321 => 0.4081, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -5.55% (0.7982 => 0.7539, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.54% (0.5329 => 0.5034, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.54% (0.5456 => 0.5154, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.53% (0.2385 => 0.2253, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.53% (1.3864 => 1.3097, std.dev.: 0.0053) MultiSource/Applications/kimwitu++/kc: -5.53% (18.2933 => 17.2815, std.dev.: 0.0147) MultiSource/Benchmarks/Bullet/bullet: -5.53% (34.0927 => 32.2073, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.53% (0.5570 => 0.5262, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.52% (8.0126 => 7.5704, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.52% (0.7198 => 0.6801, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: -5.51% (0.4861 => 0.4593, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.51% (0.6189 => 0.5848, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.50% (0.5925 => 0.5599, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.49% (0.6681 => 0.6314, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.48% (0.5569 => 0.5264, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.48% (0.5478 => 0.5178, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -5.46% (0.4524 => 0.4277, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.46% (0.6395 => 0.6046, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.46% (0.3849 => 0.3639, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.45% (0.6660 => 0.6297, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.45% (0.6440 => 0.6089, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.45% (0.6260 => 0.5919, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.44% (0.5805 => 0.5489, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.44% (0.6194 => 0.5857, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.42% (0.5941 => 0.5619, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.41% (2.1713 => 2.0539, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.39% (0.3837 => 0.3630, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.39% (0.6676 => 0.6316, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -5.39% (0.3025 => 0.2862, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.39% (0.4083 => 0.3863, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.39% (0.6033 => 0.5708, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: -5.37% (0.3446 => 0.3261, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.36% (0.5705 => 0.5399, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.36% (0.3319 => 0.3141, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -5.35% (0.3026 => 0.2864, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -5.35% (0.2989 => 0.2829, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -5.35% (0.3271 => 0.3096, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -5.34% (15.2527 => 14.4380, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.34% (1.2221 => 1.1569, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.33% (0.3491 => 0.3305, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.31% (0.3255 => 0.3082, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -5.30% (0.6750 => 0.6392, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.30% (1.2210 => 1.1563, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: -5.30% (0.4248 => 0.4023, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.28% (0.9557 => 0.9052, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.28% (0.5567 => 0.5273, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: -5.27% (0.8418 => 0.7974, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: -5.27% (0.3394 => 0.3215, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.27% (0.3016 => 0.2857, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.26% (0.3194 => 0.3026, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.26% (0.2871 => 0.2720, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.26% (0.3252 => 0.3081, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.23% (0.3057 => 0.2897, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.21% (0.5581 => 0.5290, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -5.20% (0.3481 => 0.3300, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.20% (0.4427 => 0.4197, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -5.17% (0.3867 => 0.3667, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -5.17% (0.2939 => 0.2787, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.17% (0.2903 => 0.2753, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -5.16% (0.3621 => 0.3434, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -5.12% (0.2849 => 0.2703, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.08% (0.2933 => 0.2784, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.07% (0.4813 => 0.4569, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wc: -5.05% (0.3205 => 0.3043, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -5.00% (0.3059 => 0.2906, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -4.96% (0.3788 => 0.3600, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.96% (0.5688 => 0.5406, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.91% (0.9077 => 0.8631, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: -4.80% (5.0226 => 4.7815, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: -4.66% (0.6347 => 0.6051, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -4.56% (0.6441 => 0.6147, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.32% (0.7779 => 0.7443, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -4.09% (1.5610 => 1.4972, std.dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -2.45% (20.7746 => 20.2650, std.dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.48% (7.5137 => 5.7497, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: -8.74% (1.2842 => 1.1719, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.94% (2.2633 => 2.1741, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7068, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.37% (1.3096 => 1.2786, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4713, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 5 19:05:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 5 Nov 2012 21:05:10 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121106030510.D38B32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5612?compare_to=5607&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5612, Order: 167419, Start Time: 2012-11-05 23:49:59, End Time: 2012-11-06 03:05:18 To: 5607, Order: 167388, Start Time: 2012-11-05 19:46:05, End Time: 2012-11-05 23:01:54 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (171 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1039 (719 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/dry: 1.61% (14.4080 => 14.6403, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/methcall: 1.03% (16.3799 => 16.5489, std.dev.: 0.0231) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.41% (0.8323 => 0.8206, std.dev.: 0.0032) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 38.88% (0.0625 => 0.0868, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.39% (0.1063 => 0.1386, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.90% (0.2969 => 0.3738, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.95% (0.1106 => 0.1382, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.03% (0.4253 => 0.5275, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.02% (0.4139 => 0.5133, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.95% (0.0714 => 0.0885, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.54% (0.5900 => 0.7289, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.85% (0.0547 => 0.0672, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.77% (0.0584 => 0.0717, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 22.71% (1.5932 => 1.9550, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.37% (0.4994 => 0.6111, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.06% (0.5000 => 0.6103, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.55% (0.1021 => 0.1241, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.54% (0.1620 => 0.1969, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 21.37% (0.0599 => 0.0727, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.29% (0.0897 => 0.1088, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.96% (0.1107 => 0.1339, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 20.36% (0.0948 => 0.1141, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.06% (0.0633 => 0.0760, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.03% (0.0584 => 0.0701, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.96% (0.0541 => 0.0649, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.94% (0.0642 => 0.0770, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.86% (0.3903 => 0.4678, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.85% (0.1103 => 0.1322, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: 19.73% (0.0821 => 0.0983, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.70% (0.1604 => 0.1920, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.59% (0.0822 => 0.0983) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.50% (0.1549 => 0.1851, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/power/power: 19.37% (0.0604 => 0.0721) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.24% (0.1003 => 0.1196, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 19.21% (0.1619 => 0.1930, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 19.17% (0.0605 => 0.0721, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.27% (0.0947 => 0.1120, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 18.19% (0.0808 => 0.0955, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.13% (0.1462 => 0.1727, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 18.00% (0.0561 => 0.0662, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 17.90% (0.1218 => 0.1436, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.63% (0.3890 => 0.4576, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.53% (0.2014 => 0.2367, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 17.10% (0.4029 => 0.4718, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.10% (0.1088 => 0.1274, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 17.08% (0.1505 => 0.1762, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.07% (0.2736 => 0.3203, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.93% (1.3152 => 1.5379, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 16.79% (0.5826 => 0.6804, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.68% (0.2866 => 0.3344, std.dev.: 0.0048) SingleSource/UnitTests/ObjC++/property-reference-object: 16.39% (0.5889 => 0.6854, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 16.34% (0.5546 => 0.6452, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.29% (0.3271 => 0.3804, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.18% (3.5627 => 4.1390, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 16.17% (1.8794 => 2.1833, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.06% (0.1968 => 0.2284, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 15.93% (0.4658 => 0.5400, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.81% (1.6211 => 1.8774, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.69% (0.1160 => 0.1342, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 15.41% (0.1421 => 0.1640, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 15.33% (0.9697 => 1.1184, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.16% (0.4361 => 0.5022, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 15.03% (0.1284 => 0.1477, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.03% (4.4195 => 5.0838, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/sumcol: 14.96% (0.2875 => 0.3305, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.90% (0.5026 => 0.5775, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.75% (2.7292 => 3.1317, std.dev.: 0.0022) MultiSource/Applications/d/make_dparser: 14.74% (1.0781 => 1.2370, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.73% (0.3930 => 0.4509, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 14.67% (4.2109 => 4.8285, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference: 14.43% (0.7171 => 0.8206, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ackermann: 14.35% (0.2738 => 0.3131, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/fibo: 14.28% (0.2725 => 0.3114, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 14.26% (0.2714 => 0.3101, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 14.25% (0.2729 => 0.3118, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.25% (1.9694 => 2.2501, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 14.21% (0.3004 => 0.3431, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.17% (1.9966 => 2.2795, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 14.14% (0.2780 => 0.3173, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 14.11% (23.5202 => 26.8385, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 14.07% (0.2750 => 0.3137, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.02% (0.2911 => 0.3319, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 14.01% (0.2813 => 0.3207, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 13.99% (0.2803 => 0.3195, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 13.95% (0.2811 => 0.3203, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.93% (0.3195 => 0.3640, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 13.92% (0.2823 => 0.3216, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 13.90% (0.9909 => 1.1286, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 13.83% (2.0673 => 2.3533, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 13.83% (0.2792 => 0.3178, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 13.73% (0.3096 => 0.3521, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.67% (0.1090 => 0.1239, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.53% (0.3362 => 0.3817, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.43% (0.3060 => 0.3471, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 13.40% (0.2075 => 0.2353, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 13.37% (0.2566 => 0.2909, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary3: 13.35% (0.3267 => 0.3703, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 13.23% (0.3258 => 0.3689, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 13.10% (1.4269 => 1.6138, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 13.02% (0.3317 => 0.3749, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.90% (0.3124 => 0.3527, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 12.74% (0.3446 => 0.3885, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.67% (0.3496 => 0.3939, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.64% (0.3488 => 0.3929, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 12.64% (0.3678 => 0.4143, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 12.64% (0.3465 => 0.3903, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.57% (0.3469 => 0.3905, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 12.54% (0.3348 => 0.3768, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 12.52% (0.3282 => 0.3693, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/trivial-interface: 12.52% (0.3442 => 0.3873, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 12.52% (0.7875 => 0.8861, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-3: 12.51% (0.3460 => 0.3893, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.46% (0.3845 => 0.4324, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 12.37% (0.3726 => 0.4187, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 12.34% (0.3477 => 0.3906, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 12.33% (0.4251 => 0.4775, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 12.30% (0.3625 => 0.4071, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 12.28% (2.1653 => 2.4312, std.dev.: 0.0092) SingleSource/UnitTests/ObjC/exceptions: 12.27% (0.3643 => 0.4090, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 12.25% (0.4146 => 0.4654, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 12.22% (0.3650 => 0.4096, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.09% (0.3690 => 0.4136, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 12.07% (4.6177 => 5.1752, std.dev.: 0.0117) SingleSource/UnitTests/ObjC/parameter-passing: 12.03% (0.3724 => 0.4172, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.01% (0.3981 => 0.4459, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 11.94% (2.1013 => 2.3522, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/bigfib: 11.73% (0.5012 => 0.5600, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 11.37% (0.2691 => 0.2997, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.27% (0.2040 => 0.2270, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 10.81% (5.5417 => 6.1410, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.30% (0.6435 => 0.7098, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.98% (0.1383 => 0.1521, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.92% (0.1028 => 0.1130, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 9.89% (0.3498 => 0.3844, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 9.57% (0.4847 => 0.5311, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.57% (0.2737 => 0.2999, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.48% (0.2068 => 0.2264, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.34% (0.3084 => 0.3372, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 9.27% (0.6634 => 0.7249, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 9.08% (0.3336 => 0.3639, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.03% (0.2103 => 0.2293, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 8.44% (2.0346 => 2.2063, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 8.41% (0.2391 => 0.2592, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.70% (4.6926 => 5.0540, std.dev.: 0.0118) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.47% (11.6398 => 12.5088, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.46% (0.5361 => 0.5761, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.97% (0.5584 => 0.5973, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.73% (0.7426 => 0.7926, std.dev.: 0.0051) MultiSource/Applications/kimwitu++/kc: 5.52% (11.9555 => 12.6154, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.45% (0.3792 => 0.3923, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 8.99% (0.2802 => 0.3054, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6113, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.28% (0.3693 => 0.3888, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.23% (12.0509 => 12.6806, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1690, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-2: 4.70% (1.8057 => 1.8905, std.dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6403, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1955, std.dev.: 0.0077) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.77% (3.1722 => 3.2282, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3023, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2881, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5966, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.29% (2.4764 => 2.4444, std.dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.90% (25.4195 => 16.5489, std.dev.: 0.0231) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9747, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary2: -7.70% (0.2402 => 0.2217, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7916, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9572, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8068, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0053) MultiSource/Applications/siod/siod: -2.98% (6.9842 => 6.7761, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -2.78% (17.2379 => 16.7593, std.dev.: 0.0497) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8600, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5772, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4953, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7165, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1600, std.dev.: 0.0873) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0438, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 5 19:25:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 5 Nov 2012 21:25:42 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121106032542.2FDD02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5613?compare_to=5610&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5613, Order: 167429, Start Time: 2012-11-06 01:59:49, End Time: 2012-11-06 03:25:51 To: 5610, Order: 167421, Start Time: 2012-11-06 00:17:09, End Time: 2012-11-06 01:42:53 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 12 (99 on baseline) Performance Improvements: 1 (28 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 978 (847 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/power/power: 9.10% (0.1220 => 0.1331, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.31% (0.3417 => 0.3530, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: 3.07% (8.3951 => 8.6529, std.dev.: 0.0864) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.83% (8.7830 => 8.9438, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.66% (1.2687 => 1.2898, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/gs/gs: 1.57% (4.2096 => 4.2757, std.dev.: 0.0213) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.48% (0.8507 => 0.8633, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.27% (0.8608 => 0.8717, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 4.32% (1.2438 => 1.2975, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.84% (1.3541 => 1.4061, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.33% (1.2651 => 1.2819, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.27% (6.2031 => 6.2819, std.dev.: 0.0184) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/recursive: -2.03% (2.3838 => 2.3354, std.dev.: 0.0122) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.71% (16.8493 => 16.7290, std.dev.: 0.1052) MultiSource/Applications/obsequi/Obsequi: -0.97% (1.0711 => 1.0607, std.dev.: 0.0064) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.75% (21.6301 => 21.7916, std.dev.: 0.4661) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.41% (0.3634 => 0.3649, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -0.12% (0.6066 => 0.6059, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.09% (0.3332 => 0.3335, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 0.65% (0.1990 => 0.2003, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 49.32% (0.0146 => 0.0218, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.15% (0.0418 => 0.0427, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.31% (0.0322 => 0.0321, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0315 => 0.0314, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0425 => 0.0425, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0203 => 0.0203, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -10.70% (0.0187 => 0.0167, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 500.00% (0.0001 => 0.0006, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.98% (0.1435 => 0.1449, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.25% (1.0645 => 1.0885, std.dev.: 0.0737) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.74% (0.1434 => 0.1459, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.98% (0.4202 => 0.4161, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.32% (0.1444 => 0.1396, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.79% (0.0577 => 0.0645, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 38.22% (0.0191 => 0.0264, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.53% (0.0563 => 0.0566, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.02% (1.1921 => 1.1923, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.66% (0.0647 => 0.0591, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.64% (0.0237 => 0.0226, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.41% (0.7781 => 0.7749, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 500.00% (0.0001 => 0.0006, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -4.35% (0.0046 => 0.0044, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2306.40% (0.6332 => 15.2373, std.dev.: 0.1633) MultiSource/Benchmarks/McCat/08-main/main: 45.39% (0.1831 => 0.2662, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.92% (0.1559 => 0.1420, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1491.45% (0.3344 => 5.3218, std.dev.: 0.0261) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.31% (0.2364 => 0.3246, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: 0.47% (0.0429 => 0.0431, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.25% (0.0224 => 0.0238, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -32.17% (0.0230 => 0.0156, std.dev.: 0.0015) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4214, std.dev.: 0.0188) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0683, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4966, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3441, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1281, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4064, std.dev.: 0.0036) SingleSource/Regression/C/uint64_to_float: -23.96% (2.1832 => 1.6602, std.dev.: 0.0026) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0008) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.94% (0.0810 => 0.0931, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.26% (0.0848 => 0.0952, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.19% (0.7473 => 0.8085, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.93% (0.1425 => 0.1538, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.16% (0.3003 => 0.3218, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.13% (0.3295 => 0.3530, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.83% (0.2180 => 0.2329, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.88% (0.1905 => 0.2017, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.45% (1.1606 => 1.2238, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.12% (0.9435 => 0.9918, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.90% (0.2998 => 0.3145, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.76% (0.8321 => 0.8717, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.68% (0.2519 => 0.2637, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.41% (0.6287 => 0.6564, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.34% (0.8148 => 0.8502, std.dev.: 0.0057) MultiSource/Applications/sgefa/sgefa: 3.77% (0.2999 => 0.3112, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.60% (6.6074 => 6.8455, std.dev.: 0.0395) MultiSource/Benchmarks/MallocBench/gs/gs: 3.52% (4.1305 => 4.2757, std.dev.: 0.0213) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.43% (8.6476 => 8.9438, std.dev.: 0.0115) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.42% (0.3717 => 0.3844, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.28% (0.8359 => 0.8633, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.11% (0.7932 => 0.8179, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.10% (1.1685 => 1.2047, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.02% (4.4873 => 4.6226, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.93% (0.8007 => 0.8242, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.91% (0.8048 => 0.8282, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.89% (0.8697 => 0.8948, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.81% (0.8597 => 0.8839, std.dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: 2.79% (8.4179 => 8.6529, std.dev.: 0.0864) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.75% (0.9056 => 0.9305, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.70% (4.5702 => 4.6936, std.dev.: 0.0239) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.67% (0.9688 => 0.9947, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.66% (0.8611 => 0.8840, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.65% (0.7966 => 0.8177, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.59% (1.2526 => 1.2851, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.54% (0.8885 => 0.9111, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 2.52% (14.2605 => 14.6200, std.dev.: 0.0934) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.50% (0.9074 => 0.9301, std.dev.: 0.0054) MultiSource/Benchmarks/PAQ8p/paq8p: 2.49% (2.3764 => 2.4356, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.42% (0.8331 => 0.8533, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.40% (0.8338 => 0.8538, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 2.38% (1.1271 => 1.1539, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.35% (1.2602 => 1.2898, std.dev.: 0.0060) MultiSource/Applications/minisat/minisat: 2.30% (0.6834 => 0.6991, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.30% (0.8317 => 0.8508, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.22% (0.8712 => 0.8905, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.11% (4.4880 => 4.5827, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.09% (1.2423 => 1.2683, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.07% (0.8805 => 0.8987, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.04% (0.8340 => 0.8510, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.95% (0.8066 => 0.8223, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 1.93% (15.3280 => 15.6233, std.dev.: 0.0979) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.90% (0.8927 => 0.9097, std.dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 1.90% (6.7320 => 6.8599, std.dev.: 0.0339) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.87% (2.1401 => 2.1801, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.81% (0.8177 => 0.8325, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.79% (0.8656 => 0.8811, std.dev.: 0.0022) MultiSource/Applications/d/make_dparser: 1.79% (3.2366 => 3.2944, std.dev.: 0.0196) MultiSource/Applications/oggenc/oggenc: 1.63% (4.9628 => 5.0435, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.57% (0.8086 => 0.8213, std.dev.: 0.0034) MultiSource/Applications/siod/siod: 1.53% (2.2184 => 2.2523, std.dev.: 0.0130) MultiSource/Benchmarks/mafft/pairlocalalign: 1.52% (8.6247 => 8.7562, std.dev.: 0.0360) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.50% (1.5315 => 1.5544, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 91.46% (0.0199 => 0.0381, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/pi: 58.99% (1.5795 => 2.5113, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.66% (0.7597 => 0.8939, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.44% (2.9753 => 3.4645, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.75% (2.7995 => 3.2125, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.64% (5.0261 => 5.6113, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.19% (0.3186 => 0.3447, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.11% (1.1857 => 1.2819, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.10% (6.3772 => 6.8297, std.dev.: 0.1554) SingleSource/Benchmarks/McGill/queens: 6.92% (1.7056 => 1.8237, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.64% (4.7794 => 5.0967, std.dev.: 0.0076) MultiSource/Applications/SIBsim4/SIBsim4: 6.38% (3.1873 => 3.3905, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/richards_benchmark: 5.99% (1.3037 => 1.3818, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.91% (4.9686 => 5.2622, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.71% (4.5327 => 4.7914, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.73% (3.3761 => 3.5358, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.29% (4.9453 => 5.1575, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.05% (4.9469 => 5.1472, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.01% (6.2275 => 6.4772, std.dev.: 0.0258) MultiSource/Applications/hexxagon/hexxagon: 3.86% (14.0064 => 14.5464, std.dev.: 0.0132) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.55% (1.2337 => 1.2775, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.04% (0.3587 => 0.3696, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.85% (11.5690 => 11.8983, std.dev.: 0.0109) MultiSource/Applications/lambda-0_1_3/lambda: 2.71% (7.4933 => 7.6966, std.dev.: 0.0039) MultiSource/Applications/siod/siod: 2.60% (3.6643 => 3.7596, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.49% (4.8660 => 4.9873, std.dev.: 0.0390) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.40% (8.2783 => 8.4773, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout/lists: 2.21% (7.3375 => 7.4996, std.dev.: 0.0129) MultiSource/Benchmarks/Olden/power/power: 1.48% (1.2061 => 1.2240, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.29% (1.5941 => 1.6146, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.27% (2.4647 => 2.4961, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.23% (3.5679 => 3.6117, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 1.22% (8.5322 => 8.6361, std.dev.: 0.0082) MultiSource/Benchmarks/Fhourstones/fhourstones: 1.19% (1.2822 => 1.2975, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.18% (4.4340 => 4.4862, std.dev.: 0.0135) MultiSource/Applications/spiff/spiff: 1.16% (2.8561 => 2.8893, std.dev.: 0.0097) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.83% (5.4641 => 4.3258, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.91% (7.2130 => 6.2819, std.dev.: 0.0184) SingleSource/Benchmarks/McGill/chomp: -11.13% (1.1216 => 0.9968, std.dev.: 0.0124) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.04% (1.0512 => 0.9351, std.dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: -8.56% (63.1822 => 57.7738, std.dev.: 0.0477) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.01% (0.3269 => 0.3007, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.77% (4.7482 => 4.4267, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.97% (3.7148 => 3.4932, std.dev.: 0.0064) SingleSource/Benchmarks/Stanford/Puzzle: -5.95% (0.1698 => 0.1597, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.86% (5.4972 => 5.1749, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.18% (5.1557 => 4.8886, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.64% (2.4490 => 2.3354, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.36% (4.7449 => 4.5380, std.dev.: 0.0261) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.75% (6.0224 => 5.7966, std.dev.: 0.0130) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.00% (28.5821 => 27.7243, std.dev.: 0.0416) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.94% (0.5807 => 0.5636, std.dev.: 0.0007) MultiSource/Applications/lua/lua: -2.75% (29.8330 => 29.0136, std.dev.: 0.1194) MultiSource/Benchmarks/Olden/bisort/bisort: -2.68% (0.6636 => 0.6458, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.52% (3.2169 => 3.1359, std.dev.: 0.0309) MultiSource/Applications/aha/aha: -2.36% (3.3398 => 3.2609, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.31% (11.5316 => 11.2653, std.dev.: 0.0401) MultiSource/Benchmarks/FreeBench/mason/mason: -2.07% (0.5415 => 0.5303, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.84% (2.6356 => 2.5870, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.77% (9.9065 => 9.7309, std.dev.: 0.0300) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.57% (4.9994 => 4.9209, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: -1.43% (3.4237 => 3.3747, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.35% (2.3487 => 2.3169, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.23% (5.6343 => 5.5651, std.dev.: 0.0121) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.72% (16.4461 => 16.7290, std.dev.: 0.1052) MultiSource/Applications/obsequi/Obsequi: 3.36% (1.0262 => 1.0607, std.dev.: 0.0064) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6877.78% (0.3123 => 21.7916, std.dev.: 0.4661) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.15% (0.2463 => 0.3649, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 0.82% (0.6010 => 0.6059, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.11% (0.3266 => 0.3335, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 1.73% (0.1969 => 0.2003, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 26.38% (0.0254 => 0.0321, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -7.22% (0.0180 => 0.0167, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -14.29% (0.0007 => 0.0006, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.76% (0.1438 => 0.1449, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -3.92% (1.1329 => 1.0885, std.dev.: 0.0737) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.21% (0.1462 => 0.1459, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.07% (0.4164 => 0.4161, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.97% (0.1369 => 0.1396, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.62% (0.0641 => 0.0645, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 35.38% (0.0195 => 0.0264, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.08% (0.0578 => 0.0566, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.25% (1.1437 => 1.1923, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.74% (0.0627 => 0.0591, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.56% (0.0180 => 0.0226, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.34% (0.8017 => 0.7749, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 500.00% (0.0001 => 0.0006, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -29.03% (0.0062 => 0.0044, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 5 19:49:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 5 Nov 2012 21:49:47 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121106034947.838692A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5614?compare_to=5611&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5614, Order: 167431, Start Time: 2012-11-06 02:25:13, End Time: 2012-11-06 03:49:54 To: 5611, Order: 167423, Start Time: 2012-11-06 00:37:36, End Time: 2012-11-06 02:02:19 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (182 on baseline) Unchanged Tests: 1041 (855 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.47% (78.0726 => 79.9996, std.dev.: 0.5648) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1011, std.dev.: 0.0076) MultiSource/Benchmarks/llubenchmark/llu: 2.59% (3.7435 => 3.8403, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/salsa20: 2.50% (7.4937 => 7.6812, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/hash2: 1.83% (3.1932 => 3.2515, std.dev.: 0.0085) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.24% (0.3821 => 0.3506, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -7.55% (2.4924 => 2.3041, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.10% (0.3142 => 0.2919, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.75% (0.9542 => 0.8898, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.73% (0.3357 => 0.3131, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.71% (0.2428 => 0.2265, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.71% (22.4056 => 20.9023, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.64% (3.5339 => 3.2993, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.62% (0.3658 => 0.3416, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.48% (0.6484 => 0.6064, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: -6.47% (7.0961 => 6.6373, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/trivial-interface: -6.43% (0.3812 => 0.3567, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -6.40% (1.2515 => 1.1714, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -6.40% (9.2283 => 8.6378, std.dev.: 0.0168) SingleSource/UnitTests/ObjC/for-in: -6.40% (0.4033 => 0.3775, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -6.39% (0.2160 => 0.2022, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -6.38% (16.1920 => 15.1583, std.dev.: 0.0209) MultiSource/Benchmarks/Prolangs-C/football/football: -6.37% (0.9179 => 0.8594, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: -6.37% (0.3831 => 0.3587, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.37% (0.3880 => 0.3633, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/synchronized: -6.34% (0.3896 => 0.3649, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.34% (1.0544 => 0.9876, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -6.31% (0.3848 => 0.3605, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.30% (0.4176 => 0.3913, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.30% (0.3891 => 0.3646, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.27% (1.2784 => 1.1982, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: -6.27% (4.3330 => 4.0615, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.24% (0.9852 => 0.9237, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.24% (0.1716 => 0.1609, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.23% (1.6364 => 1.5344, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.23% (0.3884 => 0.3642, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -6.23% (0.1879 => 0.1762, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -6.21% (0.2659 => 0.2494, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.20% (4.0323 => 3.7821, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.20% (0.2548 => 0.2390, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.20% (0.2355 => 0.2209, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.19% (1.2300 => 1.1539, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.16% (1.6474 => 1.5459, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.15% (0.7919 => 0.7432, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.14% (1.3722 => 1.2879, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -6.14% (1.1450 => 1.0747, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -6.13% (0.2985 => 0.2802, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.13% (1.4642 => 1.3745, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.12% (0.1796 => 0.1686, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/parameter-passing: -6.12% (0.4280 => 0.4018, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -6.12% (0.4199 => 0.3942, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.11% (4.5069 => 4.2315, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: -6.08% (1.1530 => 1.0829, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.08% (4.8161 => 4.5235, std.dev.: 0.0098) MultiSource/Applications/siod/siod: -6.03% (2.4021 => 2.2572, std.dev.: 0.0155) MultiSource/Applications/hexxagon/hexxagon: -6.03% (1.3148 => 1.2355, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.00% (0.4151 => 0.3902, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -5.99% (4.0594 => 3.8161, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: -5.99% (0.4861 => 0.4570, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.98% (0.6736 => 0.6333, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.97% (0.3483 => 0.3275, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.96% (14.2083 => 13.3609, std.dev.: 0.0120) SingleSource/Benchmarks/McGill/chomp: -5.96% (0.1761 => 0.1656, std.dev.: 0.0032) MultiSource/Benchmarks/sim/sim: -5.96% (0.3406 => 0.3203, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.96% (0.7198 => 0.6769, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.95% (0.3931 => 0.3697, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -5.95% (0.3446 => 0.3241, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.93% (4.8802 => 4.5906, std.dev.: 0.0129) MultiSource/Applications/SPASS/SPASS: -5.92% (15.5079 => 14.5906, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.91% (6.7716 => 6.3713, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.90% (0.3849 => 0.3622, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.89% (0.3837 => 0.3611, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.87% (2.1713 => 2.0439, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.86% (0.8521 => 0.8022, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -5.85% (0.2989 => 0.2814, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.85% (0.3025 => 0.2848, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -5.85% (17.1032 => 16.1034, std.dev.: 0.0194) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.83% (0.2695 => 0.2538, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -5.81% (0.3581 => 0.3373, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.81% (0.3323 => 0.3130, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.81% (0.3255 => 0.3066, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (0.7021 => 0.6614, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/moments: -5.79% (0.4248 => 0.4002, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -5.78% (0.3026 => 0.2851, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -5.78% (0.2871 => 0.2705, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: -5.77% (0.7447 => 0.7017, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.76% (0.3194 => 0.3010, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.76% (0.3057 => 0.2881, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.76% (0.4083 => 0.3848, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.75% (0.5168 => 0.4871, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.73% (5.4682 => 5.1547, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: -5.73% (0.4524 => 0.4265, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.72% (0.5999 => 0.5656, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.72% (0.4321 => 0.4074, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -5.72% (0.2939 => 0.2771, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.71% (0.2278 => 0.2148, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -5.69% (0.3481 => 0.3283, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -5.68% (34.0927 => 32.1548, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/05-eks/eks: -5.67% (0.4515 => 0.4259, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.66% (0.3252 => 0.3068, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.65% (0.5329 => 0.5028, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.64% (2.2587 => 2.1312, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -5.64% (0.6750 => 0.6369, std.dev.: 0.0134) MultiSource/Applications/d/make_dparser: -5.64% (3.5154 => 3.3170, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.64% (0.3491 => 0.3294, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.64% (0.3016 => 0.2846, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.64% (0.2999 => 0.2830, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.63% (0.6230 => 0.5879, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: -5.63% (0.3394 => 0.3203, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.63% (0.2933 => 0.2768, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -5.62% (0.2849 => 0.2689, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.61% (0.2903 => 0.2740, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.60% (0.6304 => 0.5951, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -5.60% (1.3864 => 1.3088, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.59% (0.5849 => 0.5522, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.59% (0.7339 => 0.6929, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -5.59% (0.3205 => 0.3026, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.57% (0.6052 => 0.5715, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.57% (0.5857 => 0.5531, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.55% (0.5925 => 0.5596, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: -5.55% (2.1401 => 2.0213, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.54% (0.6194 => 0.5851, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.53% (0.6667 => 0.6298, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.53% (0.4427 => 0.4182, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.53% (0.4916 => 0.4644, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.53% (0.5478 => 0.5175, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.53% (0.5591 => 0.5282, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: -5.52% (18.2933 => 17.2841, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.51% (0.6260 => 0.5915, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.51% (0.6446 => 0.6091, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -5.50% (0.3621 => 0.3422, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.49% (0.6681 => 0.6314, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.49% (0.5575 => 0.5269, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -5.49% (0.7982 => 0.7544, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.49% (0.4813 => 0.4549, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.48% (0.6293 => 0.5948, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.48% (0.5456 => 0.5157, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.47% (0.6395 => 0.6045, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.47% (0.9557 => 0.9034, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -5.46% (0.3788 => 0.3581, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -5.46% (0.3867 => 0.3656, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.45% (0.2385 => 0.2255, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.44% (0.5859 => 0.5540, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.42% (8.0126 => 7.5780, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.42% (0.5570 => 0.5268, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.41% (0.6676 => 0.6315, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.40% (0.7524 => 0.7118, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.39% (0.3319 => 0.3140, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.36% (0.5802 => 0.5491, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.34% (0.5863 => 0.5550, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -5.33% (0.3059 => 0.2896, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.33% (0.6440 => 0.6097, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.32% (0.6297 => 0.5962, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.32% (0.6395 => 0.6055, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.30% (0.5941 => 0.5626, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.29% (0.5581 => 0.5286, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.28% (1.2210 => 1.1565, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.27% (0.6189 => 0.5863, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.25% (1.2221 => 1.1580, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -5.23% (15.2527 => 14.4545, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.22% (0.2106 => 0.1996, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.21% (0.5567 => 0.5277, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.21% (0.5705 => 0.5408, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.20% (0.5805 => 0.5503, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.17% (0.6660 => 0.6316, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -5.12% (0.8418 => 0.7987, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.11% (0.6033 => 0.5725, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.10% (0.5569 => 0.5285, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -5.01% (0.3271 => 0.3107, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.89% (0.5688 => 0.5410, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.67% (0.9077 => 0.8653, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: -4.67% (5.0226 => 4.7880, std.dev.: 0.0133) SingleSource/UnitTests/ObjC++/property-reference: -4.59% (0.7779 => 0.7422, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: -4.52% (0.6347 => 0.6060, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -4.35% (1.5610 => 1.4931, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference-object: -4.27% (0.6441 => 0.6166, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -2.41% (20.7746 => 20.2745, std.dev.: 0.0250) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.48% (7.5137 => 5.7496, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/richards_benchmark: -8.68% (1.2842 => 1.1727, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.94% (2.2633 => 2.1742, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.84% (1.7753 => 1.7071, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.44% (1.3096 => 1.2777, std.dev.: 0.0108) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.70% (6.5735 => 6.4615, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0002) Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 5 21:10:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 5 Nov 2012 23:10:06 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121106051006.E90B32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5615?compare_to=5613&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5615, Order: 167435, Start Time: 2012-11-06 03:43:07, End Time: 2012-11-06 05:10:14 To: 5613, Order: 167429, Start Time: 2012-11-06 01:59:49, End Time: 2012-11-06 03:25:51 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 9 (118 on baseline) Performance Improvements: 3 (24 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 979 (832 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.81% (0.2135 => 0.2259, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.05% (0.3261 => 0.3393, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: 3.60% (1.4445 => 1.4965, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.98% (0.8717 => 0.8977, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.72% (0.5037 => 0.5174, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.93% (1.2047 => 1.2280, std.dev.: 0.0048) MultiSource/Applications/ClamAV/clamscan: 1.50% (15.0166 => 15.2417, std.dev.: 0.0478) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.92% (6.2819 => 6.9050, std.dev.: 0.0698) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 2.04% (1.8505 => 1.8882, std.dev.: 0.0077) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.06% (2.4356 => 2.4099, std.dev.: 0.0097) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.99% (0.3447 => 0.3275, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.31% (2.5870 => 2.5532, std.dev.: 0.0095) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.15% (16.7290 => 16.7043, std.dev.: 0.0831) MultiSource/Applications/obsequi/Obsequi: 0.99% (1.0607 => 1.0712, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.60% (21.7916 => 21.6610, std.dev.: 0.2807) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.22% (0.3649 => 0.3657, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: -0.51% (0.6059 => 0.6028, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.69% (0.3335 => 0.3358, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 2.05% (0.2003 => 0.2044, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0218 => 0.0218, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0427 => 0.0427, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 2.80% (0.0321 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.64% (0.0314 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -10.12% (0.0425 => 0.0382, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/casts: -11.82% (0.0203 => 0.0179, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/test1: 29.94% (0.0167 => 0.0217, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 116.67% (0.0006 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -1.73% (0.1449 => 0.1424, std.dev.: 0.0031) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: 6.73% (1.0885 => 1.1618, std.dev.: 0.0265) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 4.59% (0.1459 => 0.1526, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.46% (0.4161 => 0.4430, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.44% (0.1396 => 0.1444, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.65% (0.0645 => 0.0615, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 4.17% (0.0264 => 0.0275, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.18% (0.0566 => 0.0567, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.39% (1.1923 => 1.1877, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.51% (0.0591 => 0.0588, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.54% (0.0226 => 0.0218, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.85% (0.7749 => 0.7815, std.dev.: 0.0089) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 2.27% (0.0044 => 0.0045, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2306.19% (0.6332 => 15.2360, std.dev.: 0.2388) MultiSource/Benchmarks/McCat/08-main/main: 48.39% (0.1831 => 0.2717, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.77% (0.1559 => 0.1469, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1484.66% (0.3344 => 5.2991, std.dev.: 0.1243) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.31% (0.2364 => 0.3246, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0429 => 0.0439, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -19.20% (0.0224 => 0.0181, std.dev.: 0.0026) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4184, std.dev.: 0.0269) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0682, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4957, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3403, std.dev.: 0.0497) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1329, std.dev.: 0.0306) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4081, std.dev.: 0.0070) SingleSource/Regression/C/uint64_to_float: -23.82% (2.1832 => 1.6631, std.dev.: 0.0046) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.28% (0.0810 => 0.0950, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: 11.78% (0.1112 => 0.1243, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.13% (0.2180 => 0.2379, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.12% (0.1425 => 0.1555, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.16% (0.3137 => 0.3393, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.88% (0.8321 => 0.8977, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.82% (0.6010 => 0.6480, std.dev.: 0.0111) MultiSource/Applications/viterbi/viterbi: 7.74% (0.1577 => 0.1699, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.82% (0.1905 => 0.2035, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.75% (0.4847 => 0.5174, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.42% (0.1885 => 0.2006, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.36% (0.2279 => 0.2424, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.91% (0.7473 => 0.7915, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.91% (0.2133 => 0.2259, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.61% (0.3295 => 0.3480, std.dev.: 0.0046) MultiSource/Applications/Burg/burg: 5.53% (1.2222 => 1.2898, std.dev.: 0.0235) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.40% (0.2240 => 0.2361, std.dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 5.34% (0.2999 => 0.3159, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.29% (0.8148 => 0.8579, std.dev.: 0.0112) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.20% (1.1606 => 1.2210, std.dev.: 0.0177) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.12% (0.2519 => 0.2648, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.09% (1.1685 => 1.2280, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.08% (0.9435 => 0.9914, std.dev.: 0.0079) MultiSource/Applications/spiff/spiff: 4.92% (0.7950 => 0.8341, std.dev.: 0.0112) MultiSource/Applications/hbd/hbd: 4.88% (1.4269 => 1.4965, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.42% (0.2378 => 0.2483, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.33% (0.6287 => 0.6559, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.24% (0.2998 => 0.3125, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.77% (0.3657 => 0.3795, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 3.74% (0.2755 => 0.2858, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 3.56% (3.8189 => 3.9549, std.dev.: 0.0309) MultiSource/Applications/treecc/treecc: 3.48% (1.9948 => 2.0643, std.dev.: 0.0211) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.33% (6.6074 => 6.8276, std.dev.: 0.0524) MultiSource/Applications/ClamAV/clamscan: 3.20% (14.7684 => 15.2417, std.dev.: 0.0478) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.18% (0.5817 => 0.6002, std.dev.: 0.0069) MultiSource/Benchmarks/nbench/nbench: 3.06% (1.1271 => 1.1616, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.05% (8.6476 => 8.9116, std.dev.: 0.0780) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.03% (0.4783 => 0.4928, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 3.02% (0.4397 => 0.4530, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.99% (4.4873 => 4.6214, std.dev.: 0.0137) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.97% (1.2526 => 1.2898, std.dev.: 0.0067) MultiSource/Applications/SIBsim4/SIBsim4: 2.96% (1.2568 => 1.2940, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.87% (4.1763 => 4.2963, std.dev.: 0.0144) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.85% (0.3717 => 0.3823, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.83% (1.6386 => 1.6850, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.69% (0.8697 => 0.8931, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.67% (1.4479 => 1.4866, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 2.66% (0.9810 => 1.0071, std.dev.: 0.0084) MultiSource/Applications/minisat/minisat: 2.65% (0.6834 => 0.7015, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.54% (0.8457 => 0.8672, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.48% (0.8050 => 0.8250, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.48% (0.4559 => 0.4672, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.47% (0.8007 => 0.8205, std.dev.: 0.0042) MultiSource/Applications/JM/ldecod/ldecod: 2.36% (6.7320 => 6.8908, std.dev.: 0.0425) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.33% (0.9688 => 0.9914, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.33% (0.8331 => 0.8525, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.32% (0.9908 => 1.0138, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.29% (0.8611 => 0.8808, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.26% (0.8805 => 0.9004, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.24% (0.8261 => 0.8446, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.22% (0.8597 => 0.8788, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 2.22% (15.3280 => 15.6680, std.dev.: 0.0672) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.22% (0.8712 => 0.8905, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.21% (0.7966 => 0.8142, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.20% (13.1811 => 13.4713, std.dev.: 0.0550) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.19% (0.9069 => 0.9268, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.19% (0.8048 => 0.8224, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.15% (0.8656 => 0.8842, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.09% (0.7932 => 0.8098, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.09% (0.8420 => 0.8596, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: 2.08% (3.2366 => 3.3040, std.dev.: 0.0223) MultiSource/Benchmarks/Bullet/bullet: 2.08% (31.8598 => 32.5217, std.dev.: 0.1472) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.04% (0.9039 => 0.9223, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.00% (0.9056 => 0.9237, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.00% (0.8066 => 0.8227, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.99% (0.8885 => 0.9062, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.98% (0.8317 => 0.8482, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.97% (0.8086 => 0.8245, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.94% (0.8204 => 0.8363, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.93% (0.8855 => 0.9026, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.93% (0.8716 => 0.8884, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.92% (0.8069 => 0.8224, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.91% (0.8518 => 0.8681, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.89% (0.8338 => 0.8496, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 1.76% (2.2184 => 2.2575, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.76% (0.8316 => 0.8462, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.69% (0.8927 => 0.9078, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.55% (0.8177 => 0.8304, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: 1.41% (2.3764 => 2.4099, std.dev.: 0.0097) MultiSource/Applications/oggenc/oggenc: 1.28% (4.9628 => 5.0262, std.dev.: 0.0191) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 93.47% (0.0199 => 0.0385, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/pi: 57.25% (1.5795 => 2.4838, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.85% (0.7597 => 0.8877, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.26% (2.9753 => 3.4590, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.54% (2.7995 => 3.2065, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.49% (5.0261 => 5.6038, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.24% (1.1857 => 1.2834, std.dev.: 0.0063) SingleSource/Benchmarks/McGill/queens: 7.39% (1.7056 => 1.8317, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.55% (4.7794 => 5.0924, std.dev.: 0.0044) MultiSource/Applications/SIBsim4/SIBsim4: 6.45% (3.1873 => 3.3928, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/richards_benchmark: 5.84% (1.3037 => 1.3799, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.81% (4.5327 => 4.7959, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.66% (3.3761 => 3.5335, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.41% (4.9453 => 5.1635, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.22% (6.2275 => 6.4905, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.12% (4.9469 => 5.1508, std.dev.: 0.0358) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.04% (1.2337 => 1.2836, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 3.92% (14.0064 => 14.5550, std.dev.: 0.0266) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.32% (0.3587 => 0.3706, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.88% (11.5690 => 11.9018, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.72% (8.2783 => 8.5036, std.dev.: 0.0130) MultiSource/Applications/lambda-0_1_3/lambda: 2.61% (7.4933 => 7.6889, std.dev.: 0.0274) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.57% (4.8660 => 4.9909, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.41% (4.8362 => 4.9527, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.38% (1.1365 => 1.1636, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: 2.08% (7.3375 => 7.4901, std.dev.: 0.0168) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.42% (2.4647 => 2.4998, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/power/power: 1.09% (1.2061 => 1.2193, std.dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.16% (5.4641 => 4.3077, std.dev.: 0.0222) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.76% (1.0512 => 0.9276, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/chomp: -10.60% (1.1216 => 1.0027, std.dev.: 0.0111) MultiSource/Benchmarks/mafft/pairlocalalign: -8.55% (63.1822 => 57.7789, std.dev.: 0.1564) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.87% (4.7482 => 4.4221, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.45% (0.3269 => 0.3058, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.86% (5.4972 => 5.1749, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.08% (5.1557 => 4.8938, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.32% (4.7449 => 4.5397, std.dev.: 0.0414) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.27% (7.2130 => 6.9050, std.dev.: 0.0698) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.74% (6.0224 => 5.7974, std.dev.: 0.0078) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.39% (2.8773 => 2.7799, std.dev.: 0.0371) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.25% (0.5807 => 0.5618, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/life/life: -3.13% (2.6356 => 2.5532, std.dev.: 0.0095) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.05% (28.5821 => 27.7115, std.dev.: 0.1326) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -2.64% (0.3937 => 0.3833, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.46% (9.9065 => 9.6625, std.dev.: 0.0483) MultiSource/Benchmarks/FreeBench/mason/mason: -2.38% (0.5415 => 0.5286, std.dev.: 0.0034) MultiSource/Applications/aha/aha: -2.18% (3.3398 => 3.2669, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.07% (11.5316 => 11.2926, std.dev.: 0.0092) MultiSource/Applications/lua/lua: -1.79% (29.8330 => 29.2976, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.57% (4.9994 => 4.9210, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: -1.49% (3.4237 => 3.3727, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.21% (5.6343 => 5.5663, std.dev.: 0.0009) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.57% (16.4461 => 16.7043, std.dev.: 0.0831) MultiSource/Applications/obsequi/Obsequi: 4.39% (1.0262 => 1.0712, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6835.96% (0.3123 => 21.6610, std.dev.: 0.2807) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.48% (0.2463 => 0.3657, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 0.30% (0.6010 => 0.6028, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.82% (0.3266 => 0.3358, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 3.81% (0.1969 => 0.2044, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.52% (0.0384 => 0.0382, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/casts: -5.79% (0.0190 => 0.0179, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.97% (0.1438 => 0.1424, std.dev.: 0.0031) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: 2.55% (1.1329 => 1.1618, std.dev.: 0.0265) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 4.38% (0.1462 => 0.1526, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.39% (0.4164 => 0.4430, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.48% (0.1369 => 0.1444, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.06% (0.0641 => 0.0615, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.03% (0.0195 => 0.0275, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.90% (0.0578 => 0.0567, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.85% (1.1437 => 1.1877, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.22% (0.0627 => 0.0588, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 21.11% (0.0180 => 0.0218, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.52% (0.8017 => 0.7815, std.dev.: 0.0089) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -27.42% (0.0062 => 0.0045, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 5 21:37:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 5 Nov 2012 23:37:32 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121106053732.2ACAB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5616?compare_to=5614&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5616, Order: 167437, Start Time: 2012-11-06 04:12:51, End Time: 2012-11-06 05:37:38 To: 5614, Order: 167431, Start Time: 2012-11-06 02:25:13, End Time: 2012-11-06 03:49:54 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (182 on baseline) Unchanged Tests: 1041 (855 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.54% (54.5236 => 55.9072, std.dev.: 0.2838) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.80% (2.0478 => 2.1051, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: 2.53% (7.4937 => 7.6834, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.44% (54.5751 => 55.9072, std.dev.: 0.2838) SingleSource/Benchmarks/Shootout-C++/hash2: 2.23% (3.1932 => 3.2645, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.22% (0.1431 => 0.1299, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.24% (0.3821 => 0.3506, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.90% (2.4924 => 2.2956, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.13% (0.3142 => 0.2918, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -7.09% (0.3880 => 0.3605, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -7.08% (0.3812 => 0.3542, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -7.04% (0.4033 => 0.3749, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.04% (0.3891 => 0.3617, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -7.02% (0.3831 => 0.3562, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.98% (0.3896 => 0.3624, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/exceptions-3: -6.96% (0.3848 => 0.3580, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.94% (0.3357 => 0.3124, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.93% (0.3884 => 0.3615, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -6.92% (0.4176 => 0.3887, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.92% (0.2428 => 0.2260, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: -6.88% (0.4199 => 0.3910, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.83% (0.9542 => 0.8890, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.82% (3.5339 => 3.2929, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: -6.80% (0.4280 => 0.3989, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.78% (0.3658 => 0.3410, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.78% (22.4056 => 20.8870, std.dev.: 0.0154) MultiSource/Benchmarks/MallocBench/gs/gs: -6.62% (4.3330 => 4.0461, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/oourafft: -6.57% (0.2160 => 0.2018, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.55% (9.2283 => 8.6240, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.52% (0.6484 => 0.6061, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: -6.51% (7.0961 => 6.6344, std.dev.: 0.0056) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.50% (0.1584 => 0.1481, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.49% (0.9852 => 0.9213, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: -6.48% (16.1920 => 15.1425, std.dev.: 0.0130) SingleSource/Benchmarks/McGill/chomp: -6.47% (0.1761 => 0.1647, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -6.47% (0.9179 => 0.8585, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: -6.46% (1.2515 => 1.1707, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.43% (1.2784 => 1.1962, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.40% (1.6364 => 1.5316, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -6.40% (1.1450 => 1.0717, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.40% (1.2300 => 1.1513, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: -6.39% (0.1879 => 0.1759, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: -6.36% (1.1530 => 1.0797, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: -6.36% (0.2659 => 0.2490, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.35% (1.3722 => 1.2851, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.35% (0.1796 => 0.1682, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.34% (4.0323 => 3.7768, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.33% (0.2355 => 0.2206, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.33% (1.0544 => 0.9877, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.32% (1.6474 => 1.5433, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.31% (4.5069 => 4.2224, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.29% (0.1716 => 0.1608, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -6.26% (0.2985 => 0.2798, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.26% (0.4151 => 0.3891, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.26% (0.7919 => 0.7423, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.24% (0.2548 => 0.2389, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.24% (1.4642 => 1.3729, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.21% (0.6736 => 0.6318, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.16% (4.8161 => 4.5194, std.dev.: 0.0021) MultiSource/Applications/lua/lua: -6.14% (4.0594 => 3.8100, std.dev.: 0.0033) MultiSource/Applications/siod/siod: -6.13% (2.4021 => 2.2549, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.09% (4.8802 => 4.5831, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -6.08% (0.3406 => 0.3199, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -6.08% (1.3148 => 1.2349, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.07% (5.4682 => 5.1362, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: -6.07% (0.4861 => 0.4566, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.06% (0.3483 => 0.3272, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: -6.02% (0.7447 => 0.6999, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.01% (0.6293 => 0.5915, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.00% (0.3931 => 0.3695, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -5.99% (15.5079 => 14.5791, std.dev.: 0.0210) MultiSource/Benchmarks/McCat/18-imp/imp: -5.98% (0.3581 => 0.3367, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.97% (14.2083 => 13.3597, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/hash: -5.97% (0.4524 => 0.4254, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.96% (0.5168 => 0.4860, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: -5.96% (34.0927 => 32.0613, std.dev.: 0.0141) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.95% (6.7716 => 6.3686, std.dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.94% (2.2587 => 2.1246, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.94% (0.2695 => 0.2535, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.92% (0.3849 => 0.3621, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.92% (0.5999 => 0.5644, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.90% (0.4321 => 0.4066, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.89% (0.4515 => 0.4249, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.87% (0.5329 => 0.5016, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.85% (0.7021 => 0.6610, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -5.85% (17.1032 => 16.1026, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/moments: -5.84% (0.4248 => 0.4000, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.84% (0.3837 => 0.3613, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.84% (0.3255 => 0.3065, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -5.83% (0.3446 => 0.3245, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.83% (0.4083 => 0.3845, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.82% (0.6304 => 0.5937, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.82% (0.7339 => 0.6912, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.82% (0.6052 => 0.5700, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/except: -5.82% (0.3026 => 0.2850, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -5.80% (0.3394 => 0.3197, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.80% (0.6446 => 0.6072, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: -5.79% (0.2989 => 0.2816, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.79% (0.9557 => 0.9004, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.79% (0.8521 => 0.8028, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.78% (0.5849 => 0.5511, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.78% (0.6230 => 0.5870, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.78% (0.6681 => 0.6295, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.77% (0.6667 => 0.6282, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.77% (0.5857 => 0.5519, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.77% (0.6395 => 0.6026, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.75% (0.3252 => 0.3065, std.dev.: 0.0037) MultiSource/Applications/d/make_dparser: -5.75% (3.5154 => 3.3133, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.75% (0.3323 => 0.3132, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.74% (0.5591 => 0.5270, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.74% (0.3016 => 0.2843, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.74% (0.2999 => 0.2827, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.73% (2.1713 => 2.0469, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.73% (0.7524 => 0.7093, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.72% (0.6189 => 0.5835, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.72% (0.6260 => 0.5902, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.72% (0.5859 => 0.5524, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -5.71% (2.1401 => 2.0178, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.71% (0.2278 => 0.2148, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -5.71% (1.3864 => 1.3073, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.70% (0.5925 => 0.5587, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.70% (0.5575 => 0.5257, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.70% (0.3194 => 0.3012, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.69% (0.3057 => 0.2883, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -5.69% (0.3621 => 0.3415, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -5.69% (0.3481 => 0.3283, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.69% (0.5802 => 0.5472, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -5.69% (0.3025 => 0.2853, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.68% (0.6194 => 0.5842, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.68% (0.5456 => 0.5146, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -5.68% (0.2871 => 0.2708, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.67% (0.5805 => 0.5476, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.66% (0.5478 => 0.5168, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.65% (0.2903 => 0.2739, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.64% (0.3491 => 0.3294, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.64% (0.6440 => 0.6077, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.62% (0.4427 => 0.4178, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.62% (0.6676 => 0.6301, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: -5.62% (0.3205 => 0.3025, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -5.62% (0.2849 => 0.2689, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.58% (0.7198 => 0.6796, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.58% (0.5570 => 0.5259, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -5.58% (0.2939 => 0.2775, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -5.57% (18.2933 => 17.2744, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.57% (0.4813 => 0.4545, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -5.56% (0.6750 => 0.6375, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.54% (0.5863 => 0.5538, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.53% (0.6297 => 0.5949, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.52% (0.2933 => 0.2771, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.52% (8.0126 => 7.5703, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.52% (0.6395 => 0.6042, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.49% (0.2385 => 0.2254, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.49% (0.5941 => 0.5615, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.48% (0.3319 => 0.3137, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.48% (0.5569 => 0.5264, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -5.47% (0.7982 => 0.7545, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.47% (1.2221 => 1.1552, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: -5.46% (0.3788 => 0.3581, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.46% (0.2106 => 0.1991, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.45% (0.5705 => 0.5394, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.45% (0.5581 => 0.5277, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.44% (0.6033 => 0.5705, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/lists1: -5.43% (0.3867 => 0.3657, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -5.43% (0.3059 => 0.2893, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.42% (0.6660 => 0.6299, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.37% (0.4916 => 0.4652, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.35% (0.5567 => 0.5269, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -5.34% (15.2527 => 14.4376, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.29% (1.2210 => 1.1564, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/09-vor/vor: -5.14% (0.3271 => 0.3103, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.06% (0.5688 => 0.5400, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -5.01% (0.8418 => 0.7996, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -4.98% (0.6347 => 0.6031, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -4.91% (0.6441 => 0.6125, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -4.77% (5.0226 => 4.7832, std.dev.: 0.0052) SingleSource/UnitTests/ObjC++/property-reference: -4.74% (0.7779 => 0.7410, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: -4.39% (1.5610 => 1.4924, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.78% (0.9077 => 0.8734, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -2.36% (20.7746 => 20.2845, std.dev.: 0.0387) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7512, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/richards_benchmark: -8.78% (1.2842 => 1.1714, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: -4.01% (2.2633 => 2.1726, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7068, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.51% (1.3096 => 1.2767, std.dev.: 0.0072) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4734, std.dev.: 0.0004) Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 5 22:52:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 6 Nov 2012 00:52:20 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121106065220.D771A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5617?compare_to=5615&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5617, Order: 167440, Start Time: 2012-11-06 05:26:54, End Time: 2012-11-06 06:52:29 To: 5615, Order: 167435, Start Time: 2012-11-06 03:43:07, End Time: 2012-11-06 05:10:14 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 9 (127 on baseline) Performance Improvements: 4 (27 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 978 (820 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.76% (0.6559 => 0.6740, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 1.45% (4.2524 => 4.3140, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.12% (1.3593 => 1.3745, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 9.48% (0.1392 => 0.1524, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.44% (0.3275 => 0.3453, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.46% (4.3351 => 4.4417, std.dev.: 0.0173) MultiSource/Benchmarks/BitBench/five11/five11: 1.47% (5.6066 => 5.6892, std.dev.: 0.0217) SingleSource/Benchmarks/Shootout-C++/methcall: 1.17% (8.9114 => 9.0153, std.dev.: 0.0272) SingleSource/Benchmarks/Misc/fp-convert: 1.02% (15.7383 => 15.8989, std.dev.: 0.0475) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.63% (3.2695 => 3.2162, std.dev.: 0.0114) MultiSource/Applications/hexxagon/hexxagon: -1.37% (1.0071 => 0.9933, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -12.44% (0.1037 => 0.0908, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.49% (1.4318 => 1.4105, std.dev.: 0.0079) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.01% (16.7043 => 16.7056, std.dev.: 0.2633) MultiSource/Applications/obsequi/Obsequi: -0.91% (1.0712 => 1.0615, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.56% (21.6610 => 21.7817, std.dev.: 0.0858) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.33% (0.3657 => 0.3645, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: -0.07% (0.6028 => 0.6024, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: -1.01% (0.3358 => 0.3324, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: -3.03% (0.2044 => 0.1982, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -35.32% (0.0218 => 0.0141, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.70% (0.0427 => 0.0424, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -26.67% (0.0330 => 0.0242, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0312 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.73% (0.0382 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 12.85% (0.0179 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -26.27% (0.0217 => 0.0160, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1424 => 0.1425, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/lemon/lemon: 3.35% (1.1618 => 1.2007, std.dev.: 0.0115) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -1.77% (0.1526 => 0.1499, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.08% (0.4430 => 0.4205, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.48% (0.1444 => 0.1437, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.27% (0.0615 => 0.0558, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -23.64% (0.0275 => 0.0210, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.18% (0.0567 => 0.0568, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.01% (1.1877 => 1.1876, std.dev.: 0.0134) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.48% (0.0588 => 0.0632, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.97% (0.0218 => 0.0181, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.13% (0.7815 => 0.7805, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -6.67% (0.0045 => 0.0042, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2311.51% (0.6332 => 15.2697, std.dev.: 0.0608) MultiSource/Benchmarks/McCat/08-main/main: 46.97% (0.1831 => 0.2691, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.09% (0.1559 => 0.1464, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1486.75% (0.3344 => 5.3061, std.dev.: 0.0182) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.72% (0.2364 => 0.3232, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/mandel: 2.80% (0.0429 => 0.0441, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.89% (0.0224 => 0.0226, std.dev.: 0.0011) SingleSource/UnitTests/byval-alignment: -31.30% (0.0230 => 0.0158, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4428, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0692, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4952, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3374, std.dev.: 0.0177) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1295, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4049, std.dev.: 0.0031) SingleSource/Regression/C/uint64_to_float: -23.79% (2.1832 => 1.6638, std.dev.: 0.0024) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.30% (0.0810 => 0.0942, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.60% (0.2180 => 0.2411, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 9.98% (0.1112 => 0.1223, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.13% (0.1905 => 0.2079, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.44% (0.6010 => 0.6517, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.30% (0.7473 => 0.8093, std.dev.: 0.0089) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.68% (0.2240 => 0.2412, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.67% (0.1983 => 0.2135, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.55% (0.3137 => 0.3374, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 7.21% (0.6287 => 0.6740, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.06% (0.4847 => 0.5189, std.dev.: 0.0067) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.73% (0.8321 => 0.8881, std.dev.: 0.0079) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.68% (0.1885 => 0.2011, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.16% (0.3295 => 0.3498, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.72% (0.9435 => 0.9975, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.52% (0.5961 => 0.6290, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.49% (1.1606 => 1.2243, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.20% (0.2998 => 0.3154, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.79% (0.2378 => 0.2492, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.75% (0.8148 => 0.8535, std.dev.: 0.0147) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.73% (0.4783 => 0.5009, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.72% (1.1685 => 1.2236, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.52% (0.3717 => 0.3885, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/gs/gs: 4.44% (4.1305 => 4.3140, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.36% (0.4127 => 0.4307, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.02% (1.2526 => 1.3029, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.82% (1.6386 => 1.7012, std.dev.: 0.0075) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.76% (6.6074 => 6.8559, std.dev.: 0.0451) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.67% (8.6476 => 8.9647, std.dev.: 0.0315) MultiSource/Applications/hbd/hbd: 3.61% (1.4269 => 1.4784, std.dev.: 0.0124) MultiSource/Benchmarks/Olden/bh/bh: 3.58% (0.2985 => 0.3092, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.51% (1.3279 => 1.3745, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.32% (0.6227 => 0.6434, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.14% (4.1763 => 4.3074, std.dev.: 0.0155) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.10% (4.4880 => 4.6273, std.dev.: 0.0303) MultiSource/Applications/lua/lua: 3.10% (3.8189 => 3.9373, std.dev.: 0.0235) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.09% (4.5702 => 4.7115, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.08% (0.9039 => 0.9317, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.02% (13.1811 => 13.5797, std.dev.: 0.0239) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.99% (0.8697 => 0.8957, std.dev.: 0.0032) MultiSource/Applications/ClamAV/clamscan: 2.91% (14.7684 => 15.1987, std.dev.: 0.0381) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.84% (0.8007 => 0.8234, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.75% (0.9688 => 0.9954, std.dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: 2.71% (1.2568 => 1.2909, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 2.60% (0.6834 => 0.7012, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.58% (1.1271 => 1.1562, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.58% (0.8611 => 0.8833, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.55% (0.8518 => 0.8735, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.52% (0.4559 => 0.4674, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.51% (0.8457 => 0.8669, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.49% (0.8597 => 0.8811, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.41% (0.9056 => 0.9274, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.40% (0.8204 => 0.8401, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.40% (0.8331 => 0.8531, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.40% (0.7966 => 0.8157, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.37% (0.8086 => 0.8278, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 2.37% (15.3280 => 15.6907, std.dev.: 0.0297) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.36% (0.8716 => 0.8922, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 2.36% (8.6247 => 8.8283, std.dev.: 0.0347) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.34% (0.7932 => 0.8118, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.31% (0.9074 => 0.9284, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.30% (0.8317 => 0.8508, std.dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: 2.29% (14.2605 => 14.5873, std.dev.: 0.0278) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.26% (0.8885 => 0.9086, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.22% (0.8048 => 0.8227, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.21% (0.8420 => 0.8606, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.20% (1.5315 => 1.5652, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.19% (0.9069 => 0.9268, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.18% (0.8712 => 0.8902, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.18% (0.8359 => 0.8541, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.18% (1.4479 => 1.4794, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.14% (0.9908 => 1.0120, std.dev.: 0.0044) MultiSource/Applications/lemon/lemon: 2.13% (1.0945 => 1.1178, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.12% (0.8316 => 0.8492, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 2.06% (0.8768 => 0.8949, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.06% (0.6943 => 0.7086, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.03% (0.8338 => 0.8507, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.02% (0.8066 => 0.8229, std.dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 2.02% (6.7320 => 6.8677, std.dev.: 0.0165) MultiSource/Applications/d/make_dparser: 1.96% (3.2366 => 3.3000, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.94% (0.8855 => 0.9027, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.93% (0.8927 => 0.9099, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.81% (1.2423 => 1.2648, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.72% (2.1401 => 2.1769, std.dev.: 0.0040) MultiSource/Benchmarks/PAQ8p/paq8p: 1.71% (2.3764 => 2.4170, std.dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: 1.67% (31.8598 => 32.3928, std.dev.: 0.0645) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.62% (0.8340 => 0.8475, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.60% (0.8995 => 0.9139, std.dev.: 0.0052) MultiSource/Applications/siod/siod: 1.43% (2.2184 => 2.2501, std.dev.: 0.0078) MultiSource/Applications/oggenc/oggenc: 1.33% (4.9628 => 5.0290, std.dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: 1.25% (0.9810 => 0.9933, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.04% (3.1832 => 3.2162, std.dev.: 0.0114) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 117.09% (0.0199 => 0.0432, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/pi: 57.92% (1.5795 => 2.4943, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.54% (2.9753 => 3.4674, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.89% (0.7597 => 0.8804, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.73% (2.7995 => 3.2118, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.62% (5.0261 => 5.6103, std.dev.: 0.0118) MultiSource/Benchmarks/Olden/mst/mst: 9.96% (0.1386 => 0.1524, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.38% (0.3186 => 0.3453, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.16% (1.1857 => 1.2824, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 7.18% (1.7056 => 1.8280, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.96% (4.7794 => 5.1122, std.dev.: 0.0510) MultiSource/Applications/SIBsim4/SIBsim4: 6.31% (3.1873 => 3.3884, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/richards_benchmark: 6.14% (1.3037 => 1.3838, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.92% (4.9686 => 5.2626, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.83% (4.5327 => 4.7968, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.72% (3.3761 => 3.5356, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.52% (6.2275 => 6.5092, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.38% (4.9453 => 5.1617, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.19% (2.2485 => 2.3426, std.dev.: 0.0277) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.11% (4.9469 => 5.1500, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.95% (14.0064 => 14.5603, std.dev.: 0.0247) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.68% (0.3587 => 0.3719, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.03% (1.2337 => 1.2711, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.01% (4.8660 => 5.0125, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.88% (11.5690 => 11.9022, std.dev.: 0.0098) MultiSource/Applications/lambda-0_1_3/lambda: 2.65% (7.4933 => 7.6916, std.dev.: 0.0235) MultiSource/Applications/siod/siod: 2.64% (3.6643 => 3.7611, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.36% (8.2783 => 8.4737, std.dev.: 0.0197) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 2.32% (0.4353 => 0.4454, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.99% (4.3552 => 4.4417, std.dev.: 0.0173) MultiSource/Benchmarks/Olden/power/power: 1.75% (1.2061 => 1.2272, std.dev.: 0.0034) MultiSource/Benchmarks/BitBench/five11/five11: 1.54% (5.6030 => 5.6892, std.dev.: 0.0217) SingleSource/Benchmarks/Misc/ReedSolomon: 1.33% (8.5322 => 8.6453, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.28% (3.5679 => 3.6134, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: 1.07% (2.3560 => 2.3811, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.26% (5.4641 => 4.3024, std.dev.: 0.0208) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.92% (1.0512 => 0.9364, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -10.81% (1.1216 => 1.0003, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: -8.54% (63.1822 => 57.7885, std.dev.: 0.1516) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.56% (0.3269 => 0.3022, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.87% (4.7482 => 4.4221, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.86% (3.7148 => 3.4971, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.82% (5.4972 => 5.1775, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.10% (5.1557 => 4.8929, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.37% (4.7449 => 4.5377, std.dev.: 0.0137) MultiSource/Benchmarks/nbench/nbench: -3.93% (21.9654 => 21.1032, std.dev.: 0.3024) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.63% (6.0224 => 5.8036, std.dev.: 0.0075) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.21% (2.8773 => 2.7848, std.dev.: 0.0241) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.05% (2.4490 => 2.3744, std.dev.: 0.0242) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.04% (28.5821 => 27.7139, std.dev.: 0.0357) MultiSource/Applications/lua/lua: -2.95% (29.8330 => 28.9516, std.dev.: 0.1935) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.69% (0.5807 => 0.5651, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bisort/bisort: -2.64% (0.6636 => 0.6461, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.55% (2.6356 => 2.5683, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.44% (9.9065 => 9.6652, std.dev.: 0.0266) MultiSource/Applications/aha/aha: -2.39% (3.3398 => 3.2600, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.07% (2.3487 => 2.3000, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.01% (11.5316 => 11.2996, std.dev.: 0.0171) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.53% (3.2169 => 3.1676, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/hash2: -1.45% (3.4237 => 3.3741, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.44% (4.9994 => 4.9275, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.15% (5.6343 => 5.5694, std.dev.: 0.0056) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.58% (16.4461 => 16.7056, std.dev.: 0.2633) MultiSource/Applications/obsequi/Obsequi: 3.44% (1.0262 => 1.0615, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6874.61% (0.3123 => 21.7817, std.dev.: 0.0858) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.99% (0.2463 => 0.3645, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 0.23% (0.6010 => 0.6024, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.78% (0.3266 => 0.3324, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 0.66% (0.1969 => 0.1982, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 14.63% (0.0123 => 0.0141, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -4.72% (0.0254 => 0.0242, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -11.11% (0.0180 => 0.0160, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.90% (0.1438 => 0.1425, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: 5.98% (1.1329 => 1.2007, std.dev.: 0.0115) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 2.53% (0.1462 => 0.1499, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.98% (0.4164 => 0.4205, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.97% (0.1369 => 0.1437, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -12.95% (0.0641 => 0.0558, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 7.69% (0.0195 => 0.0210, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.73% (0.0578 => 0.0568, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.84% (1.1437 => 1.1876, std.dev.: 0.0134) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.80% (0.0627 => 0.0632, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.56% (0.0180 => 0.0181, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.64% (0.8017 => 0.7805, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -32.26% (0.0062 => 0.0042, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 5 23:08:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 6 Nov 2012 01:08:36 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121106070836.D7A1A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5618?compare_to=5612&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5618, Order: 167433, Start Time: 2012-11-06 03:53:10, End Time: 2012-11-06 07:08:44 To: 5612, Order: 167419, Start Time: 2012-11-05 23:49:59, End Time: 2012-11-06 03:05:18 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (171 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (719 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.31% (54.0474 => 54.7552, std.dev.: 0.1306) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.64% (0.0625 => 0.0879, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.80% (0.1063 => 0.1401, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.63% (0.4253 => 0.5343, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.26% (0.2969 => 0.3719, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.86% (0.1106 => 0.1381, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.81% (0.0714 => 0.0884, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 23.77% (0.4139 => 0.5123, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.15% (0.5900 => 0.7266, std.dev.: 0.0067) MultiSource/Applications/oggenc/oggenc: 23.07% (1.5932 => 1.9607, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.90% (0.0642 => 0.0789, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.49% (0.4994 => 0.6117, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.22% (0.5000 => 0.6111, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.12% (0.0547 => 0.0668, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.09% (0.0584 => 0.0713, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.25% (0.1021 => 0.1238, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 21.20% (0.0599 => 0.0726, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.18% (0.0897 => 0.1087, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.17% (0.1620 => 0.1963, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.87% (0.1107 => 0.1338, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/em3d/em3d: 19.94% (0.0948 => 0.1137, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.91% (0.0633 => 0.0759, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.69% (0.0584 => 0.0699, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.59% (0.0541 => 0.0647, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.57% (0.3903 => 0.4667, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 19.50% (0.0605 => 0.0723, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.49% (0.1103 => 0.1318, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 19.37% (0.0821 => 0.0980, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.34% (0.0822 => 0.0981, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.17% (0.1549 => 0.1846, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.04% (0.1003 => 0.1194, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 19.04% (0.0604 => 0.0719, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.01% (0.1604 => 0.1909, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 18.84% (0.1619 => 0.1924, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.19% (0.1462 => 0.1728, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.06% (0.0947 => 0.1118, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 17.83% (0.0561 => 0.0661, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 17.82% (0.0808 => 0.0952, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.58% (0.3890 => 0.4574, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 17.58% (0.5826 => 0.6850, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.53% (0.2014 => 0.2367, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 17.42% (0.5889 => 0.6915, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 17.24% (0.1218 => 0.1428, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.10% (0.2866 => 0.3356, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 16.96% (0.2736 => 0.3200, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 16.93% (0.4029 => 0.4711, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 16.82% (0.1088 => 0.1271, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.78% (1.3152 => 1.5359, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/mst/mst: 16.76% (0.0698 => 0.0815, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 16.61% (0.1505 => 0.1755, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 16.30% (0.5546 => 0.6450, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.16% (3.5627 => 4.1386, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.02% (0.4658 => 0.5404, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.96% (0.1968 => 0.2282, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 15.95% (1.8794 => 2.1792, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.91% (1.6211 => 1.8790, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.69% (0.1160 => 0.1342, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.69% (0.2875 => 0.3326, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 15.67% (0.9697 => 1.1217, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.44% (0.3271 => 0.3776, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/18-imp/imp: 15.27% (0.1421 => 0.1638, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.16% (0.4361 => 0.5022, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 15.09% (0.7171 => 0.8253, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: 14.93% (1.0781 => 1.2391, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.91% (2.7292 => 3.1362, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.90% (0.5026 => 0.5775, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/fibo: 14.90% (0.2725 => 0.3131, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.88% (4.4195 => 5.0772, std.dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.81% (0.3930 => 0.4512, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 14.80% (0.2750 => 0.3157, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 14.76% (0.2738 => 0.3142, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 14.75% (0.3004 => 0.3447, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.74% (0.3195 => 0.3666, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 14.72% (0.1284 => 0.1473, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 14.70% (0.2714 => 0.3113, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 14.66% (0.2729 => 0.3129, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 14.57% (0.2780 => 0.3185, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 14.56% (0.2823 => 0.3234, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 14.52% (4.2109 => 4.8225, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/methcall: 14.50% (0.2813 => 0.3221, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.46% (0.2911 => 0.3332, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 14.44% (23.5202 => 26.9169, std.dev.: 0.0195) MultiSource/Applications/hexxagon/hexxagon: 14.42% (0.9909 => 1.1338, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 14.37% (0.2811 => 0.3215, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.36% (0.2792 => 0.3193, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.34% (2.0673 => 2.3637, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 14.31% (0.2803 => 0.3204, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 14.24% (0.3096 => 0.3537, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.24% (1.9694 => 2.2498, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.22% (0.1090 => 0.1245, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 14.20% (0.3267 => 0.3731, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.08% (1.9966 => 2.2777, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.04% (0.3362 => 0.3834, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 14.00% (0.3258 => 0.3714, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 13.84% (0.3317 => 0.3776, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 13.73% (0.2075 => 0.2360, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.48% (0.3124 => 0.3545, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.42% (0.3488 => 0.3956, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.40% (0.3060 => 0.3470, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 13.35% (0.3460 => 0.3922, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.34% (0.3845 => 0.4358, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-4: 13.25% (0.3465 => 0.3924, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.24% (0.3496 => 0.3959, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 13.23% (0.3446 => 0.3902, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 13.21% (0.2566 => 0.2905, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/moments: 13.19% (0.3678 => 0.4163, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 13.17% (0.3348 => 0.3789, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 13.13% (1.4269 => 1.6142, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/synchronized: 13.12% (0.3469 => 0.3924, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.07% (0.3442 => 0.3892, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 13.04% (0.3726 => 0.4212, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 12.97% (0.3477 => 0.3928, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 12.92% (0.3282 => 0.3706, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 12.89% (0.4251 => 0.4799, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.88% (0.3650 => 0.4120, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 12.86% (0.3625 => 0.4091, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.76% (0.3643 => 0.4108, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.67% (0.3724 => 0.4196, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.66% (0.3690 => 0.4157, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 12.61% (0.7875 => 0.8868, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 12.57% (0.4146 => 0.4667, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.53% (0.3981 => 0.4480, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 12.38% (2.1653 => 2.4334, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 12.04% (2.1013 => 2.3544, std.dev.: 0.0134) MultiSource/Applications/JM/lencod/lencod: 12.04% (4.6177 => 5.1738, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/bigfib: 11.99% (0.5012 => 0.5613, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.37% (0.2040 => 0.2272, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 11.19% (0.2691 => 0.2992, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 10.99% (5.5417 => 6.1506, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.69% (0.6435 => 0.7123, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 10.29% (0.3498 => 0.3858, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.16% (0.2737 => 0.3015, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.92% (0.1028 => 0.1130, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.83% (0.1383 => 0.1519, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.82% (0.2068 => 0.2271, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 9.68% (0.6634 => 0.7276, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: 9.66% (0.4847 => 0.5315, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.57% (0.3084 => 0.3379, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 9.29% (0.3336 => 0.3646, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.65% (0.2103 => 0.2285, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 8.55% (2.0346 => 2.2086, std.dev.: 0.0053) MultiSource/Applications/lemon/lemon: 8.53% (0.2391 => 0.2595, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.98% (4.6926 => 5.0671, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.74% (11.6398 => 12.5404, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.63% (0.5361 => 0.5770, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.23% (0.5584 => 0.5988, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.72% (0.7426 => 0.7925, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 5.88% (11.9555 => 12.6585, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.93% (0.3792 => 0.3941, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.35% (0.2802 => 0.3064, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6114, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6742, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops: 4.66% (15.4430 => 16.1620, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-2: 4.36% (1.8057 => 1.8845, std.dev.: 0.0068) SingleSource/Benchmarks/Dhrystone/dry: 4.21% (14.0481 => 14.6402, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.30% (0.3693 => 0.3815, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1911, std.dev.: 0.0097) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2246, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.2991, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.36% (7.1849 => 7.2826, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5896, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.07% (2.4764 => 2.4251, std.dev.: 0.0146) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.72% (25.4195 => 16.5950, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ary2: -7.99% (0.2402 => 0.2210, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9758, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8074, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: -7.19% (2.1113 => 1.9596, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.56% (11.2080 => 10.8087, std.dev.: 0.0067) SingleSource/Benchmarks/Dhrystone/fldry: -3.10% (17.2379 => 16.7036, std.dev.: 0.0567) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.61% (0.6293 => 0.6129, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.25% (41.7953 => 40.8555, std.dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5779, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4967, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.11% (105.3826 => 104.2154, std.dev.: 0.0481) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0470, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 5 23:25:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 6 Nov 2012 01:25:38 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121106072538.EE3C92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5619?compare_to=5616&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5619, Order: 167441, Start Time: 2012-11-06 06:00:59, End Time: 2012-11-06 07:25:45 To: 5616, Order: 167437, Start Time: 2012-11-06 04:12:51, End Time: 2012-11-06 05:37:38 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (4 on baseline) Performance Improvements: 0 (180 on baseline) Unchanged Tests: 1040 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.31% (41.4354 => 42.8088, std.dev.: 0.1205) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.16% (78.1243 => 80.5905, std.dev.: 0.8682) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.29% (1.2783 => 1.3715, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1017, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/salsa20: 2.42% (7.4937 => 7.6749, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: 2.18% (3.1932 => 3.2629, std.dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.15% (0.1431 => 0.1300, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.06% (0.3821 => 0.3513, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -8.00% (2.4924 => 2.2931, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.00% (0.3142 => 0.2922, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.97% (0.9542 => 0.8877, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.73% (0.3357 => 0.3131, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.69% (22.4056 => 20.9069, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.63% (0.2428 => 0.2267, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.61% (3.5339 => 3.3003, std.dev.: 0.0160) SingleSource/UnitTests/ObjC/exceptions-2: -6.60% (0.3831 => 0.3578, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.60% (0.4033 => 0.3767, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.58% (0.3891 => 0.3635, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -6.57% (0.3848 => 0.3595, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -6.57% (0.2160 => 0.2018) SingleSource/UnitTests/ObjC/trivial-interface: -6.56% (0.3812 => 0.3562, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.53% (0.3658 => 0.3419, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -6.49% (0.3896 => 0.3643, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -6.49% (0.4176 => 0.3905, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: -6.48% (0.4199 => 0.3927, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: -6.47% (7.0961 => 6.6373, std.dev.: 0.0081) MultiSource/Applications/JM/lencod/lencod: -6.46% (16.1920 => 15.1453, std.dev.: 0.0143) SingleSource/UnitTests/ObjC/exceptions-4: -6.44% (0.3880 => 0.3630, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.44% (0.9852 => 0.9218, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -6.43% (4.3330 => 4.0545, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.40% (1.0544 => 0.9869, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -6.38% (9.2283 => 8.6393, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/football/football: -6.32% (0.9179 => 0.8599, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: -6.29% (1.2515 => 1.1728, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.28% (0.3884 => 0.3640, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.28% (1.2300 => 1.1528, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.27% (1.2784 => 1.1983, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.20% (0.2548 => 0.2390, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.20% (4.0323 => 3.7824, std.dev.: 0.0085) SingleSource/Benchmarks/McGill/chomp: -6.19% (0.1761 => 0.1652, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.18% (0.6484 => 0.6083, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.18% (0.1796 => 0.1685, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.18% (1.6474 => 1.5456, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -6.17% (0.1879 => 0.1763, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.16% (0.2355 => 0.2210, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.14% (1.3722 => 1.2879, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -6.13% (1.1530 => 1.0823, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -6.13% (0.2985 => 0.2802, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: -6.13% (0.2659 => 0.2496, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.12% (0.7919 => 0.7434, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.12% (4.5069 => 4.2311, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.11% (1.4642 => 1.3747, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.09% (0.6736 => 0.6326, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -6.09% (2.4021 => 2.2559, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -6.08% (1.1450 => 1.0754, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.07% (4.8161 => 4.5240, std.dev.: 0.0029) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.06% (0.1716 => 0.1612, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.03% (1.6364 => 1.5377, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.97% (4.8802 => 4.5887, std.dev.: 0.0064) MultiSource/Applications/lua/lua: -5.97% (4.0594 => 3.8171, std.dev.: 0.0096) MultiSource/Benchmarks/sim/sim: -5.96% (0.3406 => 0.3203, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -5.96% (0.4280 => 0.4025, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.94% (5.4682 => 5.1436, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: -5.91% (15.5079 => 14.5917, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.90% (14.2083 => 13.3704, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.88% (0.5863 => 0.5518, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.88% (6.7716 => 6.3735, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.87% (0.5591 => 0.5263, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.83% (0.6052 => 0.5699, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.82% (0.5168 => 0.4867, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.82% (0.6304 => 0.5937, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.79% (0.5805 => 0.5469, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -5.79% (0.7447 => 0.7016, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.79% (0.6446 => 0.6073, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.79% (2.2587 => 2.1280, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.78% (0.4151 => 0.3911, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -5.78% (0.3581 => 0.3374, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.78% (0.6230 => 0.5870, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.77% (0.5478 => 0.5162, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.76% (0.6194 => 0.5837, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.75% (0.2695 => 0.2540, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.74% (0.6667 => 0.6284, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.74% (0.5329 => 0.5023, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.74% (0.5925 => 0.5585, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.74% (0.4916 => 0.4634, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.73% (0.5999 => 0.5655, std.dev.: 0.0029) MultiSource/Applications/d/make_dparser: -5.72% (3.5154 => 3.3142, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.72% (0.6676 => 0.6294, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: -5.71% (0.4515 => 0.4257, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.71% (0.5849 => 0.5515, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.71% (0.7339 => 0.6920, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.70% (0.6293 => 0.5934, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.70% (0.6189 => 0.5836, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.70% (0.6297 => 0.5938, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.67% (0.7021 => 0.6623, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.66% (0.5456 => 0.5147, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.66% (0.6660 => 0.6283, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -5.65% (34.0927 => 32.1663, std.dev.: 0.0088) MultiSource/Applications/sqlite3/sqlite3: -5.65% (17.1032 => 16.1368, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.65% (0.5575 => 0.5260, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.65% (0.3931 => 0.3709, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.64% (0.8521 => 0.8040, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.64% (0.6260 => 0.5907, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.64% (0.5802 => 0.5475, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -5.64% (1.3148 => 1.2407, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.63% (0.5859 => 0.5529, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.63% (0.6395 => 0.6035, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.62% (0.2278 => 0.2150, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.61% (0.3491 => 0.3295, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.61% (0.7524 => 0.7102, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.60% (0.3837 => 0.3622, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.60% (0.2999 => 0.2831, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.60% (0.6395 => 0.6037, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -5.60% (1.3864 => 1.3088, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash2: -5.60% (0.4861 => 0.4589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.57% (0.5857 => 0.5531, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -5.57% (2.1401 => 2.0210, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.56% (0.3849 => 0.3635, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.56% (0.6440 => 0.6082, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.54% (0.9557 => 0.9028, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -5.53% (0.4524 => 0.4274, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.52% (0.5941 => 0.5613, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.51% (2.1713 => 2.0517, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: -5.50% (18.2933 => 17.2880, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.49% (0.5570 => 0.5264, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.48% (0.4321 => 0.4084, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.48% (0.5581 => 0.5275, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/moments: -5.46% (0.4248 => 0.4016, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/methcall: -5.45% (0.3025 => 0.2860, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -5.42% (0.7982 => 0.7549, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.42% (0.3319 => 0.3139, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.42% (8.0126 => 7.5784, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/objinst: -5.42% (0.3194 => 0.3021, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -5.39% (0.6750 => 0.6386, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.37% (0.5567 => 0.5268, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.37% (0.6033 => 0.5709, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.37% (0.5569 => 0.5270, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.37% (0.2106 => 0.1993, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.36% (0.5705 => 0.5399, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.36% (0.6681 => 0.6323, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.35% (0.3252 => 0.3078, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.34% (0.4083 => 0.3865, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.32% (0.2385 => 0.2258, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -5.31% (0.3481 => 0.3296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.31% (1.2210 => 1.1562, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.31% (0.7198 => 0.6816, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.30% (0.4813 => 0.4558, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -5.28% (15.2527 => 14.4474, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/lists: -5.25% (0.3621 => 0.3431, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.22% (1.2221 => 1.1583, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/fibo: -5.19% (0.2871 => 0.2722, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.17% (0.5688 => 0.5394, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -5.17% (0.3271 => 0.3102, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -5.15% (0.3867 => 0.3668, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.15% (0.3323 => 0.3152, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.14% (0.2939 => 0.2788, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.14% (0.3057 => 0.2900, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.13% (0.3255 => 0.3088, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -5.12% (0.3026 => 0.2871, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.11% (0.2933 => 0.2783, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: -5.10% (0.3059 => 0.2903, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: -5.09% (0.7779 => 0.7383, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.07% (0.3016 => 0.2863, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.06% (0.2903 => 0.2756, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -5.06% (0.6347 => 0.6026, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: -5.05% (0.3205 => 0.3043, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.04% (0.4427 => 0.4204, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -5.02% (0.2849 => 0.2706, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -5.02% (0.2989 => 0.2839, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -5.01% (0.8418 => 0.7996, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary: -5.01% (0.3394 => 0.3224, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: -4.97% (0.6441 => 0.6121, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: -4.94% (5.0226 => 4.7746, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: -4.86% (0.3788 => 0.3604, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -4.85% (0.3446 => 0.3279, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.67% (0.9077 => 0.8653, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: -4.03% (1.5610 => 1.4981, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.45% (20.7746 => 20.2653, std.dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.55% (7.5137 => 5.7442, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/richards_benchmark: -8.70% (1.2842 => 1.1725, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.91% (1.7753 => 1.7058, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.62% (2.2633 => 2.1813, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.01% (1.0557 => 1.0239, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.31% (1.3096 => 1.2794, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4669, std.dev.: 0.0014) Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 6 00:36:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 6 Nov 2012 02:36:02 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121106083602.731AD2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5620?compare_to=5617&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5620, Order: 167442, Start Time: 2012-11-06 07:09:18, End Time: 2012-11-06 08:36:11 To: 5617, Order: 167440, Start Time: 2012-11-06 05:26:54, End Time: 2012-11-06 06:52:29 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 7 (120 on baseline) Performance Improvements: 2 (25 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 982 (829 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/bc/bc: 3.90% (1.1269 => 1.1709, std.dev.: 0.0123) MultiSource/Applications/hexxagon/hexxagon: 1.51% (0.9933 => 1.0083, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.38% (0.8860 => 0.8982, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 1.24% (1.2909 => 1.3069, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.95% (21.6009 => 22.4540, std.dev.: 0.1480) SingleSource/Benchmarks/Misc/ffbench: 3.42% (1.3734 => 1.4204, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.16% (1.4105 => 1.4269, std.dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.16% (0.9317 => 0.9209, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -2.84% (2.3426 => 2.2761, std.dev.: 0.0126) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.61% (16.7056 => 16.8079, std.dev.: 0.2198) MultiSource/Applications/obsequi/Obsequi: 2.50% (1.0615 => 1.0880, std.dev.: 0.0069) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.73% (21.7817 => 21.6232, std.dev.: 0.1029) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.08% (0.3645 => 0.3648, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: -0.12% (0.6024 => 0.6017, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.27% (0.3324 => 0.3315, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 0.71% (0.1982 => 0.1996, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 53.19% (0.0141 => 0.0216, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0424 => 0.0426, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 11.16% (0.0242 => 0.0269, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.64% (0.0312 => 0.0314, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.24% (0.0423 => 0.0422, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0202 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 34.37% (0.0160 => 0.0215, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.84% (0.1425 => 0.1437, std.dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 3.24% (1.2007 => 1.2396, std.dev.: 0.0385) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.00% (0.1499 => 0.1439, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.42% (0.4205 => 0.4349, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.84% (0.1437 => 0.1449, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 14.34% (0.0558 => 0.0638, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.81% (0.0210 => 0.0202, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.94% (0.0568 => 0.0579, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.85% (1.1876 => 1.1977, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.90% (0.0632 => 0.0644, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 40.33% (0.0181 => 0.0254, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.23% (0.7805 => 0.7787, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 19.05% (0.0042 => 0.0050, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2341.85% (0.6332 => 15.4618, std.dev.: 0.2353) MultiSource/Benchmarks/McCat/08-main/main: 48.33% (0.1831 => 0.2716, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -11.87% (0.1559 => 0.1374, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1490.82% (0.3344 => 5.3197, std.dev.: 0.0284) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.01% (0.2364 => 0.3239, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/mandel: -0.47% (0.0429 => 0.0427, std.dev.: 0.0008) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.89% (0.0224 => 0.0226, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -30.00% (0.0230 => 0.0161, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4436, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0710, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4864, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3422, std.dev.: 0.0306) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1369, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4008, std.dev.: 0.0039) SingleSource/Regression/C/uint64_to_float: -23.71% (2.1832 => 1.6655, std.dev.: 0.0018) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 13.76% (0.1112 => 0.1265, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.91% (0.0848 => 0.0949, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.32% (0.2180 => 0.2405, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.00% (0.4847 => 0.5283, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.77% (0.6010 => 0.6537, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.28% (0.7473 => 0.8092, std.dev.: 0.0079) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.59% (0.3137 => 0.3375, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.25% (0.8321 => 0.8924, std.dev.: 0.0142) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.18% (0.8148 => 0.8733, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.75% (0.2519 => 0.2689, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.58% (0.2279 => 0.2429, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.98% (0.3295 => 0.3492, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.94% (0.2998 => 0.3176, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.92% (0.9435 => 0.9994, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.89% (1.1606 => 1.2290, std.dev.: 0.0140) MultiSource/Applications/spiff/spiff: 5.69% (0.7950 => 0.8402, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.39% (0.6287 => 0.6626, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.28% (0.5961 => 0.6276, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.87% (1.3279 => 1.3926, std.dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.83% (1.1170 => 1.1709, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.66% (0.3003 => 0.3143, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 4.65% (1.2222 => 1.2790, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.44% (1.1685 => 1.2204, std.dev.: 0.0079) MultiSource/Applications/hbd/hbd: 4.43% (1.4269 => 1.4901, std.dev.: 0.0223) MultiSource/Benchmarks/MallocBench/gs/gs: 4.24% (4.1305 => 4.3055, std.dev.: 0.0302) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.14% (0.5817 => 0.6058, std.dev.: 0.0056) MultiSource/Applications/SIBsim4/SIBsim4: 3.99% (1.2568 => 1.3069, std.dev.: 0.0047) MultiSource/Applications/lua/lua: 3.85% (3.8189 => 3.9660, std.dev.: 0.0244) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.77% (0.8656 => 0.8982, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.71% (0.6227 => 0.6458, std.dev.: 0.0085) MultiSource/Applications/SPASS/SPASS: 3.64% (14.2605 => 14.7796, std.dev.: 0.1321) MultiSource/Applications/minisat/minisat: 3.42% (0.6834 => 0.7068, std.dev.: 0.0065) MultiSource/Applications/ClamAV/clamscan: 3.41% (14.7684 => 15.2721, std.dev.: 0.1170) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.37% (8.6476 => 8.9392, std.dev.: 0.0518) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.34% (1.6386 => 1.6933, std.dev.: 0.0212) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.23% (0.3717 => 0.3837, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: 3.20% (0.7557 => 0.7799, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.97% (4.4880 => 4.6215, std.dev.: 0.0376) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.95% (1.2526 => 1.2896, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.89% (4.1763 => 4.2968, std.dev.: 0.0420) MultiSource/Applications/JM/lencod/lencod: 2.85% (15.3280 => 15.7651, std.dev.: 0.0779) MultiSource/Applications/d/make_dparser: 2.81% (3.2366 => 3.3275, std.dev.: 0.0254) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.79% (4.5702 => 4.6978, std.dev.: 0.0371) MultiSource/Applications/hexxagon/hexxagon: 2.78% (0.9810 => 1.0083, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.77% (0.8697 => 0.8938, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.63% (0.9074 => 0.9313, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.59% (0.8611 => 0.8834, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.58% (0.8597 => 0.8819, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.57% (1.2602 => 1.2926, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.46% (0.8048 => 0.8246, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.46% (0.8261 => 0.8464, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.42% (0.8007 => 0.8201, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.42% (0.8069 => 0.8264, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.40% (0.8317 => 0.8517, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.39% (0.4559 => 0.4668, std.dev.: 0.0023) MultiSource/Applications/siod/siod: 2.36% (2.2184 => 2.2708, std.dev.: 0.0132) MultiSource/Benchmarks/nbench/nbench: 2.36% (1.1271 => 1.1537, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.34% (0.8177 => 0.8368, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.32% (0.8050 => 0.8237, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.31% (0.8359 => 0.8552, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.29% (0.8805 => 0.9007, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.26% (0.8086 => 0.8269, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.23% (0.8457 => 0.8646, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.16% (0.8712 => 0.8900, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.14% (0.7932 => 0.8102, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.12% (0.9056 => 0.9248, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.09% (0.8316 => 0.8490, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.09% (0.9908 => 1.0115, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.08% (0.8518 => 0.8695, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.04% (0.8420 => 0.8592, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.04% (0.9069 => 0.9254, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.99% (0.8927 => 0.9105, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.97% (0.8204 => 0.8366, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.94% (1.2423 => 1.2664, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.88% (0.9039 => 0.9209, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.82% (2.1401 => 2.1790, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.80% (0.8340 => 0.8490, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: 1.80% (2.3764 => 2.4191, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.77% (0.8885 => 0.9042, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.76% (0.8338 => 0.8485, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.73% (0.8855 => 0.9008, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.73% (1.4479 => 1.4729, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.66% (0.8066 => 0.8200, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: 1.51% (31.8598 => 32.3409, std.dev.: 0.1369) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.26% (1.5315 => 1.5508, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 107.54% (0.0199 => 0.0413, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/pi: 58.91% (1.5795 => 2.5100, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/mst/mst: 17.10% (0.1386 => 0.1623, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.38% (2.9753 => 3.4626, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.95% (0.7597 => 0.8809, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.44% (2.7995 => 3.2038, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.63% (5.0261 => 5.6106, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.04% (0.3186 => 0.3474, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.07% (1.1857 => 1.2814, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/queens: 7.56% (1.7056 => 1.8346, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.64% (4.7794 => 5.0966, std.dev.: 0.0125) MultiSource/Applications/SIBsim4/SIBsim4: 6.51% (3.1873 => 3.3949, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.95% (4.5327 => 4.8025, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.88% (4.9686 => 5.2607, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 5.87% (1.3037 => 1.3802, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.63% (6.3772 => 6.7365, std.dev.: 0.1377) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.61% (1.2337 => 1.2906, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.50% (3.3761 => 3.5279, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.47% (6.2275 => 6.5058, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.45% (4.9453 => 5.1653, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 4.01% (14.0064 => 14.5675, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.91% (4.9469 => 5.1402, std.dev.: 0.0246) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.89% (4.3552 => 4.5246, std.dev.: 0.0495) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.07% (8.2783 => 8.5326, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.81% (11.5690 => 11.8942, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 2.79% (7.4933 => 7.7023, std.dev.: 0.0120) MultiSource/Applications/siod/siod: 2.78% (3.6643 => 3.7660, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.26% (4.8660 => 4.9759, std.dev.: 0.0292) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.21% (4.8362 => 4.9432, std.dev.: 0.0354) SingleSource/Benchmarks/Shootout/lists: 2.20% (7.3375 => 7.4987, std.dev.: 0.0164) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.75% (1.1365 => 1.1564, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.35% (2.4647 => 2.4979, std.dev.: 0.0083) MultiSource/Benchmarks/FreeBench/neural/neural: 1.31% (1.0841 => 1.0983, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 1.14% (8.5322 => 8.6294, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/power/power: 1.05% (1.2061 => 1.2188, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.84% (5.4641 => 4.3254, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.29% (7.2130 => 6.3986, std.dev.: 0.1568) SingleSource/Benchmarks/McGill/chomp: -10.98% (1.1216 => 0.9984, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.84% (1.0512 => 0.9373, std.dev.: 0.0311) MultiSource/Benchmarks/mafft/pairlocalalign: -8.52% (63.1822 => 57.7960, std.dev.: 0.0429) SingleSource/Benchmarks/Shootout/heapsort: -8.22% (3.2926 => 3.0219, std.dev.: 0.0179) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.16% (0.3269 => 0.3035, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.86% (4.7482 => 4.4226, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.13% (3.7148 => 3.4869, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.89% (5.4972 => 5.1734, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.03% (5.1557 => 4.8963, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.54% (4.7449 => 4.5297, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.77% (6.0224 => 5.7953, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.58% (2.8773 => 2.7742, std.dev.: 0.0231) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.12% (0.5807 => 0.5626, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (28.5821 => 27.6993, std.dev.: 0.0237) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.84% (2.6356 => 2.5607, std.dev.: 0.0134) MultiSource/Applications/lua/lua: -2.64% (29.8330 => 29.0443, std.dev.: 0.2654) MultiSource/Applications/aha/aha: -2.36% (3.3398 => 3.2609, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (11.5316 => 11.2984, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.74% (4.9994 => 4.9123, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.63% (2.3487 => 2.3105, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: -1.60% (3.4237 => 3.3688, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.59% (9.9065 => 9.7491, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.22% (5.6343 => 5.5656, std.dev.: 0.0011) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.20% (16.4461 => 16.8079, std.dev.: 0.2198) MultiSource/Applications/obsequi/Obsequi: 6.02% (1.0262 => 1.0880, std.dev.: 0.0069) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6823.86% (0.3123 => 21.6232, std.dev.: 0.1029) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.11% (0.2463 => 0.3648, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: 0.12% (0.6010 => 0.6017, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.50% (0.3266 => 0.3315, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 1.37% (0.1969 => 0.1996, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 75.61% (0.0123 => 0.0216, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 5.91% (0.0254 => 0.0269, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 19.44% (0.0180 => 0.0215, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1438 => 0.1437, std.dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 9.42% (1.1329 => 1.2396, std.dev.: 0.0385) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.57% (0.1462 => 0.1439, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.44% (0.4164 => 0.4349, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.84% (0.1369 => 0.1449, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -62.50% (0.0008 => 0.0003, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.47% (0.0641 => 0.0638, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.59% (0.0195 => 0.0202, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.17% (0.0578 => 0.0579, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.72% (1.1437 => 1.1977, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.71% (0.0627 => 0.0644, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 41.11% (0.0180 => 0.0254, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.87% (0.8017 => 0.7787, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -19.35% (0.0062 => 0.0050, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 6 01:17:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 6 Nov 2012 03:17:04 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121106091704.1F19A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5621?compare_to=5619&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5621, Order: 167444, Start Time: 2012-11-06 07:48:39, End Time: 2012-11-06 09:17:10 To: 5619, Order: 167441, Start Time: 2012-11-06 06:00:59, End Time: 2012-11-06 07:25:45 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (153 on baseline) Unchanged Tests: 1041 (885 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 20.38% (0.3645 => 0.4388, std.dev.: 0.0225) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/salsa20: 2.79% (7.4937 => 7.7026, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.66% (2.0478 => 2.1022, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hash2: 2.28% (3.1932 => 3.2660, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.01% (0.3821 => 0.3515, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: -7.35% (2.4924 => 2.3092, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.91% (0.3142 => 0.2925, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.68% (0.9542 => 0.8905, std.dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: -6.64% (0.3357 => 0.3134, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.61% (3.5339 => 3.3004, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/oourafft: -6.53% (0.2160 => 0.2019, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.47% (0.2428 => 0.2271, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.45% (0.3658 => 0.3422, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.43% (0.3812 => 0.3567, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.43% (22.4056 => 20.9658, std.dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.40% (0.6484 => 0.6069, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.34% (1.0544 => 0.9876, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.32% (0.3891 => 0.3645, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: -6.31% (16.1920 => 15.1701, std.dev.: 0.3332) SingleSource/UnitTests/ObjC/exceptions: -6.30% (0.4176 => 0.3913, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.29% (1.6474 => 1.5437, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: -6.29% (0.3880 => 0.3636, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.28% (0.3884 => 0.3640, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: -6.27% (4.3330 => 4.0612, std.dev.: 0.0299) SingleSource/UnitTests/ObjC/exceptions-2: -6.26% (0.3831 => 0.3591, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.26% (0.3848 => 0.3607, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.23% (0.9852 => 0.9238, std.dev.: 0.0219) SingleSource/UnitTests/ObjC/property: -6.22% (0.4199 => 0.3938, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -6.20% (0.4033 => 0.3783) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.17% (1.2784 => 1.1995, std.dev.: 0.0080) SingleSource/Benchmarks/McGill/chomp: -6.13% (0.1761 => 0.1653, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: -6.12% (0.9179 => 0.8617, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/synchronized: -6.11% (0.3896 => 0.3658, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -6.10% (0.4280 => 0.4019, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.09% (1.3722 => 1.2886, std.dev.: 0.0132) MultiSource/Benchmarks/mafft/pairlocalalign: -6.08% (9.2283 => 8.6669, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.06% (1.6364 => 1.5373, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.01% (0.1796 => 0.1688, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.99% (0.2355 => 0.2214, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.97% (4.0323 => 3.7915, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: -5.96% (0.2985 => 0.2807, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/ReedSolomon: -5.96% (0.1879 => 0.1767, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.94% (0.3483 => 0.3276, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.91% (0.7919 => 0.7451, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.90% (4.5069 => 4.2412, std.dev.: 0.0565) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.87% (1.4642 => 1.3782, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.86% (0.6736 => 0.6341, std.dev.: 0.0145) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.86% (0.2695 => 0.2537, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.83% (4.8161 => 4.5354, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.82% (14.2083 => 13.3820, std.dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: -5.79% (1.1530 => 1.0862, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.71% (4.8802 => 4.6015, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.71% (5.4682 => 5.1560, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.67% (0.5168 => 0.4875, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.67% (0.5857 => 0.5525, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.63% (0.5999 => 0.5661, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.63% (0.6230 => 0.5879, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.63% (2.2587 => 2.1315, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.63% (0.6293 => 0.5939, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: -5.56% (15.5079 => 14.6454, std.dev.: 0.3182) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.55% (0.4916 => 0.4643, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.55% (0.6052 => 0.5716, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.53% (0.7339 => 0.6933, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (0.7021 => 0.6633, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.52% (6.7716 => 6.3976, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.52% (0.4151 => 0.3922, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.51% (0.6260 => 0.5915, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.49% (0.6446 => 0.6092, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.47% (0.6667 => 0.6302, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.47% (0.5591 => 0.5285, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.46% (0.7524 => 0.7113, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.44% (0.6304 => 0.5961, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.44% (0.2999 => 0.2836, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.42% (0.6194 => 0.5858, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: -5.42% (3.5154 => 3.3250, std.dev.: 0.0721) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.41% (0.5456 => 0.5161, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.40% (0.5329 => 0.5041, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.40% (0.5478 => 0.5182, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.39% (0.6440 => 0.6093, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -5.37% (0.4861 => 0.4600, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.37% (0.6297 => 0.5959, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: -5.36% (18.2933 => 17.3122, std.dev.: 0.3292) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.36% (0.6676 => 0.6318, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.36% (0.3491 => 0.3304, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.35% (0.5575 => 0.5277, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.34% (0.3931 => 0.3721, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.34% (0.5581 => 0.5283, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.33% (0.3319 => 0.3142, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.33% (0.9557 => 0.9048, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.32% (0.5925 => 0.5610, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.32% (0.6660 => 0.6306, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.31% (0.5805 => 0.5497, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.30% (0.4321 => 0.4092, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.29% (0.5863 => 0.5553, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.27% (0.5941 => 0.5628, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -5.27% (34.0927 => 32.2966, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.25% (0.6681 => 0.6330, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.24% (0.3837 => 0.3636, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.24% (0.6395 => 0.6060, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.24% (0.6033 => 0.5717, std.dev.: 0.0103) MultiSource/Applications/SIBsim4/SIBsim4: -5.21% (1.3864 => 1.3141, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.21% (0.5849 => 0.5544, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.20% (8.0126 => 7.5958, std.dev.: 0.0332) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.20% (0.3849 => 0.3649, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -5.19% (0.3025 => 0.2868, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.18% (0.6395 => 0.6064, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.17% (0.5570 => 0.5282, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.15% (0.5802 => 0.5503, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -5.13% (0.4248 => 0.4030, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.09% (0.3323 => 0.3154, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -5.06% (0.7779 => 0.7385, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.05% (0.5705 => 0.5417, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -5.00% (0.3481 => 0.3307, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.99% (2.1713 => 2.0629, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.94% (0.5567 => 0.5292, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.92% (0.4813 => 0.4576, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.92% (0.5569 => 0.5295, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.89% (1.2221 => 1.1623, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.89% (0.7198 => 0.6846, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.89% (0.5688 => 0.5410, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.87% (0.3057 => 0.2908, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -4.85% (0.6347 => 0.6039, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.85% (0.4083 => 0.3885, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: -4.84% (0.3059 => 0.2911, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.83% (0.3252 => 0.3095, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: -4.82% (0.3026 => 0.2880, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -4.80% (0.2939 => 0.2798, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -4.77% (0.6750 => 0.6428, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists: -4.75% (0.3621 => 0.3449, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -4.73% (0.3194 => 0.3043, std.dev.: 0.0048) SingleSource/UnitTests/ObjC++/property-reference-object: -4.70% (0.6441 => 0.6138, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.70% (0.4427 => 0.4219, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.69% (1.2210 => 1.1637, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -4.67% (0.3446 => 0.3285, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.67% (0.2849 => 0.2716, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -4.65% (0.3205 => 0.3056, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.60% (0.2933 => 0.2798, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: -4.60% (0.2871 => 0.2739, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -4.59% (0.3788 => 0.3614, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -4.58% (0.3867 => 0.3690, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: -4.55% (0.2989 => 0.2853, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -4.52% (0.3255 => 0.3108) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.51% (0.3016 => 0.2880, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.48% (0.2903 => 0.2773, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: -4.47% (0.4524 => 0.4322, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: -4.33% (0.3394 => 0.3247, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.16% (0.9077 => 0.8699, std.dev.: 0.0030) SingleSource/UnitTests/Vector/constpool: -2.01% (20.7746 => 20.3575, std.dev.: 0.0253) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7549, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1723, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.75% (2.2633 => 2.1784, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.62% (1.3096 => 1.2884, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4710, std.dev.: 0.0052) Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 6 02:05:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 6 Nov 2012 04:05:28 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121106100528.E00C82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5622?compare_to=5591&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5622, Order: 167379, Start Time: 2012-11-05 10:07:01, End Time: 2012-11-06 10:05:36 To: 5591, Order: 167369, Start Time: 2012-11-04 09:37:59, End Time: 2012-11-05 09:36:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (36 on baseline) New Passes: 0 (12 on baseline) Performance Regressions: 2 (169 on baseline) Performance Improvements: 1 (41 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 43 (7 on baseline) Unchanged Tests: 996 (643 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.06% (11.1300 => 11.2484, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.99% (78.7898 => 80.3586, std.dev.: 0.3580) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.34% (10.6209 => 10.4790, std.dev.: 0.0074) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/ClamAV/clamscan: -0.18% (28.2907 => 28.2384, std.dev.: 0.0294) MultiSource/Applications/JM/ldecod/ldecod: -0.15% (6.3167 => 6.3071, std.dev.: 0.0180) MultiSource/Applications/JM/lencod/lencod: -0.28% (18.7270 => 18.6749, std.dev.: 0.0278) MultiSource/Applications/oggenc/oggenc: - (0.0020 => 0.0020) MultiSource/Applications/sqlite3/sqlite3: 0.06% (0.5237 => 0.5240, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -0.53% (47.1681 => 46.9172, std.dev.: 0.0642) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -0.09% (5.0615 => 5.0569, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 0.29% (1.4122 => 1.4163, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 0.23% (0.3039 => 0.3046, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.67% (0.0299 => 0.0301, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -0.88% (1.3232 => 1.3115, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/voronoi/voronoi: 0.98% (0.1941 => 0.1960, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.00% (0.0020 => 0.0019, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 5.26% (0.0019 => 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.34% (0.2864 => 0.2797, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.44% (1.3160 => 1.3102, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -0.16% (5.2128 => 5.2045, std.dev.: 0.0091) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.01% (1.3812 => 1.3814, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 0.11% (1.0890 => 1.0902, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0020 => 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/ClamAV/clamscan: - (0.0001 => 0.0001) MultiSource/Applications/JM/ldecod/ldecod: - (0.0001 => 0.0001) MultiSource/Applications/JM/lencod/lencod: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.55% (0.0721 => 0.0725, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: - (0.0001 => 0.0001) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8220 => 499.8054, std.dev.: 0.0280) MultiSource/Benchmarks/Olden/voronoi/voronoi: - (0.0001 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: - (0.0001 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: - (0.0001 => 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/nbench/nbench: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/nbench/nbench MultiSource/Applications/ClamAV/clamscan: 27.34% (22.1758 => 28.2384, std.dev.: 0.0294) MultiSource/Applications/JM/ldecod/ldecod: -39.56% (10.4361 => 6.3071, std.dev.: 0.0180) MultiSource/Applications/JM/lencod/lencod: -14.87% (21.9371 => 18.6749, std.dev.: 0.0278) MultiSource/Applications/oggenc/oggenc: -99.97% (5.7591 => 0.0020) MultiSource/Applications/sqlite3/sqlite3: -96.95% (17.1811 => 0.5240, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -25.82% (63.2438 => 46.9172, std.dev.: 0.0642) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.26% (4.9449 => 5.0569, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -8.12% (1.5415 => 1.4163, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -37.57% (0.4879 => 0.3046, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.55% (6.6874 => 0.0301, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -75.50% (5.3526 => 1.3115, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/voronoi/voronoi: -27.41% (0.2700 => 0.1960, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -99.94% (2.9384 => 0.0019, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -99.82% (1.1194 => 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -11.96% (0.3177 => 0.2797, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -75.67% (5.3855 => 1.3102, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.05% (5.0018 => 5.2045, std.dev.: 0.0091) MultiSource/Benchmarks/nbench/nbench: -7.92% (1.1840 => 1.0902, std.dev.: 0.0014) New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/nbench/nbench MultiSource/Applications/ClamAV/clamscan: -99.94% (0.1629 => 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -99.92% (0.1298 => 0.0001) MultiSource/Applications/sqlite3/sqlite3: -100.00% (4.6441 => 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -98.00% (0.0050 => 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -50.00% (0.0002 => 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -75.00% (0.0004 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -99.97% (0.3987 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 44220.78% (1.1277 => 499.8054, std.dev.: 0.0280) MultiSource/Benchmarks/Olden/voronoi/voronoi: -99.97% (0.3070 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -100.00% (2.6546 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -100.00% (2.6778 => 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -100.00% (4.5009 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -99.80% (0.0506 => 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -97.30% (0.0037 => 0.0001) MultiSource/Benchmarks/nbench/nbench: -100.00% (11.6436 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 189.98% (0.5229 => 1.5163, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 11.87% (14.9895 => 16.7686, std.dev.: 0.0232) MultiSource/Applications/kimwitu++/kc: 35.77% (14.1553 => 19.2185, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 12.45% (4.1105 => 4.6223, std.dev.: 0.0266) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.71% (3.4629 => 5.8075, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 61.94% (0.6222 => 1.0076, std.dev.: 0.0010) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3839200.00% (0.0001 => 3.8393, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11180300.00% (0.0001 => 11.1804, std.dev.: 0.0304) MultiSource/Applications/kimwitu++/kc: 50700.00% (0.0001 => 0.0508, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049900.00% (0.0001 => 10.0500, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5492300.00% (0.0001 => 5.4924, std.dev.: 0.0116) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 48.96% (0.1056 => 0.1573, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 48.55% (7.0540 => 10.4790, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/n-body: 40.48% (0.0746 => 0.1048, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 36.87% (0.1432 => 0.1960, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 36.71% (0.0730 => 0.0998, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Oscar: 23.58% (0.0636 => 0.0786, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.48% (0.1566 => 0.1871, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 19.42% (0.2554 => 0.3050, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: 19.06% (0.1175 => 0.1399, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.38% (8.1363 => 9.6319, std.dev.: 0.0112) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 17.87% (0.1125 => 0.1326, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 17.81% (0.1555 => 0.1832, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.02% (0.0793 => 0.0928, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.98% (0.0648 => 0.0758, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.66% (0.2065 => 0.2409, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.05% (0.0953 => 0.1106, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 15.73% (0.0871 => 0.1008, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.72% (0.1584 => 0.1833, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.59% (0.8172 => 0.9446, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 15.54% (0.0798 => 0.0922, std.dev.: 0.0021) MultiSource/Applications/aha/aha: 15.03% (0.1151 => 0.1324, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.96% (0.0842 => 0.0968, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: 14.55% (0.0818 => 0.0937, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 14.10% (0.1163 => 0.1327, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.07% (0.1940 => 0.2213, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.84% (0.1337 => 0.1522, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.81% (0.2758 => 0.3139, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.77% (0.0886 => 0.1008, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/em3d/em3d: 13.75% (0.1695 => 0.1928, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.70% (0.1117 => 0.1270, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/health/health: 13.49% (0.1268 => 0.1439, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 13.45% (1.1642 => 1.3208, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.43% (0.2107 => 0.2390, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.31% (0.0834 => 0.0945, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 13.28% (0.7433 => 0.8420, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.25% (0.0770 => 0.0872, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.22% (0.1906 => 0.2158, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 13.05% (0.1655 => 0.1871, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.90% (14.3668 => 16.2208, std.dev.: 0.0101) MultiSource/Applications/minisat/minisat: 12.83% (0.7115 => 0.8028, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.83% (0.4615 => 0.5207, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 12.75% (0.7835 => 0.8834, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.61% (0.5569 => 0.6271, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.59% (0.5981 => 0.6734, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.54% (0.1029 => 0.1158, std.dev.: 0.0016) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.51% (0.1143 => 0.1286, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.50% (0.1032 => 0.1161, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.43% (0.3121 => 0.3509, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.05% (0.0838 => 0.0939, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.00% (0.5860 => 0.6563, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/04-bisect/bisect: 11.96% (0.1062 => 0.1189, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 11.93% (0.3109 => 0.3480, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.91% (0.5105 => 0.5713, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.81% (0.1236 => 0.1382, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.80% (0.2271 => 0.2539, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.74% (0.9765 => 1.0911, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.66% (0.1510 => 0.1686, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 11.58% (0.0933 => 0.1041, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 11.57% (0.3423 => 0.3819, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 11.54% (3.8723 => 4.3192, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.42% (0.3441 => 0.3834, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.35% (4.2646 => 4.7486, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.33% (0.6675 => 0.7431, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.32% (1.3050 => 1.4527, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 11.01% (3.3354 => 3.7026, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.73% (0.3307 => 0.3662, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 10.68% (2.0273 => 2.2439, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.52% (0.5020 => 0.5548, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.44% (0.1044 => 0.1153, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 10.34% (0.3927 => 0.4333, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.09% (0.3886 => 0.4278, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.06% (2.2969 => 2.5279, std.dev.: 0.0093) SingleSource/UnitTests/ObjC/trivial-interface: 9.93% (0.3473 => 0.3818, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.92% (1.5859 => 1.7432, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 9.91% (0.6456 => 0.7096) MultiSource/Benchmarks/McCat/05-eks/eks: 9.91% (0.4299 => 0.4725, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.88% (0.8067 => 0.8864, std.dev.: 0.0079) SingleSource/UnitTests/ObjC/exceptions: 9.87% (0.3828 => 0.4206, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/exceptions-4: 9.85% (0.3543 => 0.3892, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.82% (0.3543 => 0.3891, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 9.78% (0.3180 => 0.3491, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 9.78% (0.3497 => 0.3839, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: 9.74% (1.0722 => 1.1766, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.73% (2.2022 => 2.4164, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 9.72% (9.4845 => 10.4064, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/synchronized: 9.69% (0.3561 => 0.3906, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.67% (0.3516 => 0.3856, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.64% (0.3694 => 0.4050, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.63% (0.2430 => 0.2664, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.59% (1.1861 => 1.2998, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.44% (0.1695 => 0.1855, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.39% (2.2024 => 2.4091, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.37% (0.8101 => 0.8860, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.34% (0.2603 => 0.2846, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.30% (0.6450 => 0.7050, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.28% (3.8922 => 4.2533, std.dev.: 0.0173) SingleSource/Benchmarks/Stanford/Puzzle: 9.23% (0.1268 => 0.1385, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 9.21% (0.4289 => 0.4684, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.16% (0.4103 => 0.4479, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.04% (0.1892 => 0.2063, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 8.99% (0.8921 => 0.9723, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists: 8.97% (0.3422 => 0.3729, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: 8.95% (1.5603 => 1.6999, std.dev.: 0.0074) SingleSource/UnitTests/SignlessTypes/rem: 8.92% (0.1144 => 0.1246, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.90% (0.4203 => 0.4577, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 8.79% (0.4620 => 0.5026, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.75% (0.3865 => 0.4203, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.74% (0.4636 => 0.5041, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: 8.68% (0.3387 => 0.3681, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 8.54% (0.6030 => 0.6545, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 8.50% (10.3673 => 11.2484, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/neural/neural: 8.41% (0.1463 => 0.1586, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.37% (1.4186 => 1.5374, std.dev.: 0.0072) SingleSource/UnitTests/ObjC++/property-reference: 8.37% (0.7326 => 0.7939, std.dev.: 0.0135) SingleSource/UnitTests/ObjC++/Hello: 8.30% (0.5925 => 0.6417, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.21% (0.3826 => 0.4140, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/sieve: 8.10% (0.3603 => 0.3895, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 7.98% (0.3684 => 0.3978, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 7.91% (0.4048 => 0.4368, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.89% (0.3650 => 0.3938, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.75% (0.2905 => 0.3130, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.74% (0.2831 => 0.3050, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.40% (0.2891 => 0.3105, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 7.38% (0.2725 => 0.2926, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.37% (0.2756 => 0.2959, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.36% (0.3232 => 0.3470, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 7.31% (0.3283 => 0.3523, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 7.17% (0.2049 => 0.2196, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 7.15% (0.2714 => 0.2908, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.08% (0.3162 => 0.3386, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.05% (0.2793 => 0.2990, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.04% (0.2871 => 0.3073, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.01% (0.4064 => 0.4349, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.00% (2.0665 => 2.2112, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/matrix: 6.84% (0.3098 => 0.3310, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 6.74% (0.2877 => 0.3071, std.dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: 6.63% (1.2842 => 1.3693, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.62% (0.2872 => 0.3062, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 6.52% (0.3052 => 0.3251, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 6.51% (0.3379 => 0.3599, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.32% (0.2802 => 0.2979, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.77% (0.3136 => 0.3317, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 5.73% (0.3282 => 0.3470, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 5.69% (0.3092 => 0.3268, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.54% (0.3427 => 0.3617, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 4.79% (0.3131 => 0.3281, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.41% (0.3935 => 0.4069, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.58% (1.1145 => 1.2993, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/oourafft: 13.90% (6.6465 => 7.5703, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 10.01% (1.1396 => 1.2537, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.89% (1.7254 => 1.8788, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 8.12% (0.9505 => 1.0277, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.11% (0.9540 => 1.0218) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3676, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.47% (4.2280 => 4.4168, std.dev.: 0.0025) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.68% (0.4162 => 0.4315, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.56% (8.6802 => 8.9028, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.97% (0.8333 => 0.8497, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 1.83% (3.1595 => 3.2173, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (3.6395 => 3.6846, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0496, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.19% (5.2763 => 1.2037, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -75.64% (0.8651 => 0.2107, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -46.05% (0.1622 => 0.0875, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -27.94% (1.7609 => 1.2689, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -11.95% (0.1330 => 0.1171, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -9.11% (54.1659 => 49.2337, std.dev.: 0.0276) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.33% (7.9617 => 7.8556, std.dev.: 0.0109) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.85% (0.0628 => 0.0384, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: -19.44% (0.2161 => 0.1741, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: -15.62% (1.6925 => 1.4281, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -10.98% (9.5636 => 8.5134, std.dev.: 0.0081) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.96% (32.5116 => 28.9471, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: -10.92% (1.5373 => 1.3695, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.13% (1.5660 => 1.4230, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -8.73% (0.1592 => 0.1453, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (19.9488 => 18.2823, std.dev.: 0.0127) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.08% (1.8329 => 1.7031, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -6.05% (0.4808 => 0.4517, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -6.01% (1.2373 => 1.1629, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.21% (1.6805 => 1.5930, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-5: -4.71% (1.5835 => 1.5089, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.48% (0.9957 => 0.9511, std.dev.: 0.0074) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1547, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.74% (1.3677 => 1.3165, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -3.24% (5.0483 => 4.8848, std.dev.: 0.0014) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.93% (8.1563 => 7.9989, std.dev.: 0.0172) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0863, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.69% (85.0658 => 83.6245, std.dev.: 0.0067) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5118, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8581, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2349, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 25.04% (1.1048 => 1.3814, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -99.97% (7.1582 => 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: -99.86% (0.0720 => 0.0001) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -65.74% (0.2116 => 0.0725, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 6 02:19:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 6 Nov 2012 04:19:29 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121106101929.42F4A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5623?compare_to=5620&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5623, Order: 167445, Start Time: 2012-11-06 08:53:13, End Time: 2012-11-06 10:19:37 To: 5620, Order: 167442, Start Time: 2012-11-06 07:09:18, End Time: 2012-11-06 08:36:11 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 6 (121 on baseline) Performance Improvements: 0 (24 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 985 (829 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.42% (0.8517 => 0.8638, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.38% (0.9209 => 0.9336, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/recursive: 6.48% (2.2784 => 2.4261, std.dev.: 0.0426) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.16% (0.8362 => 0.8877, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.30% (4.5330 => 4.5920, std.dev.: 0.0179) MultiSource/Benchmarks/BitBench/five11/five11: 1.11% (5.6358 => 5.6982, std.dev.: 0.0061) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.26% (16.8079 => 16.7634, std.dev.: 0.0733) MultiSource/Applications/obsequi/Obsequi: -2.66% (1.0880 => 1.0591, std.dev.: 0.0155) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.32% (21.6232 => 21.6933, std.dev.: 0.5165) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.03% (0.3648 => 0.3647, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 0.75% (0.6017 => 0.6062, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.3315 => 0.3315, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/strcat: 0.75% (0.1996 => 0.2011, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.39% (0.0216 => 0.0219, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.94% (0.0426 => 0.0430, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.35% (0.0269 => 0.0260, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.59% (0.0314 => 0.0319, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.18% (0.0422 => 0.0427, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0202 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -19.07% (0.0215 => 0.0174, std.dev.: 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: - (0.1437 => 0.1437, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -7.14% (1.2396 => 1.1511, std.dev.: 0.0211) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 5.28% (0.1439 => 0.1515, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.56% (0.4349 => 0.4194, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.07% (0.1449 => 0.1448, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 133.33% (0.0003 => 0.0007, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.76% (0.0638 => 0.0662, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 37.13% (0.0202 => 0.0277, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.25% (0.0579 => 0.0592, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.17% (1.1977 => 1.1957, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0644 => 0.0644, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.51% (0.0254 => 0.0268) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.69% (0.7787 => 0.7841, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 116.00% (0.0050 => 0.0108, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2310.01% (0.6332 => 15.2602, std.dev.: 0.1089) MultiSource/Benchmarks/McCat/08-main/main: 45.82% (0.1831 => 0.2670, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.94% (0.1559 => 0.1482, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1484.96% (0.3344 => 5.3001, std.dev.: 0.0407) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.80% (0.2364 => 0.3234, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: 3.96% (0.0429 => 0.0446, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.70% (0.0224 => 0.0239, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -26.09% (0.0230 => 0.0170, std.dev.: 0.0000) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4146, std.dev.: 0.0109) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0709, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4950, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3459, std.dev.: 0.0222) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1389, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4075, std.dev.: 0.0018) SingleSource/Regression/C/uint64_to_float: -23.89% (2.1832 => 1.6616, std.dev.: 0.0049) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.30% (0.0830 => 0.0957, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.20% (0.0773 => 0.0875, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: 11.78% (0.1112 => 0.1243, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.68% (0.1425 => 0.1563, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.82% (0.1157 => 0.1259, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.67% (0.2998 => 0.3258, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.40% (0.4847 => 0.5254, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.90% (0.8321 => 0.8978, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.2279 => 0.2451, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.45% (0.7473 => 0.8030, std.dev.: 0.0079) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.40% (0.3137 => 0.3369, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.31% (0.1983 => 0.2128, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.97% (0.2180 => 0.2332, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.80% (1.1606 => 1.2395, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.80% (0.3295 => 0.3519, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.53% (0.1639 => 0.1746, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 6.40% (0.1577 => 0.1678, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.32% (0.6010 => 0.6390, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.68% (0.6287 => 0.6644, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.47% (0.2378 => 0.2508, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 5.17% (0.7950 => 0.8361, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.96% (0.3003 => 0.3152, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.91% (0.9435 => 0.9898, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: 4.61% (1.2222 => 1.2785, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: 4.56% (4.1305 => 4.3190, std.dev.: 0.0353) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.51% (0.5961 => 0.6230, std.dev.: 0.0074) MultiSource/Applications/hbd/hbd: 4.25% (1.4269 => 1.4876, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.22% (0.3717 => 0.3874, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.07% (0.9056 => 0.9425, std.dev.: 0.0119) MultiSource/Applications/sgefa/sgefa: 4.00% (0.2999 => 0.3119, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.89% (1.3279 => 1.3795, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.86% (0.8317 => 0.8638, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 3.79% (3.8189 => 3.9638, std.dev.: 0.0109) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.68% (0.4783 => 0.4959, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.68% (0.8697 => 0.9017, std.dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.65% (6.6074 => 6.8483, std.dev.: 0.0788) MultiSource/Applications/SIBsim4/SIBsim4: 3.59% (1.2568 => 1.3019, std.dev.: 0.0056) MultiSource/Applications/treecc/treecc: 3.58% (1.9948 => 2.0662, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.53% (4.4873 => 4.6459, std.dev.: 0.0438) MultiSource/Applications/ClamAV/clamscan: 3.41% (14.7684 => 15.2713, std.dev.: 0.0370) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.30% (0.4127 => 0.4263, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.29% (0.9039 => 0.9336, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.26% (0.8007 => 0.8268, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.26% (8.6476 => 8.9292, std.dev.: 0.0268) MultiSource/Benchmarks/McCat/18-imp/imp: 3.17% (0.3503 => 0.3614, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.15% (0.5817 => 0.6000, std.dev.: 0.0047) MultiSource/Applications/SPASS/SPASS: 3.04% (14.2605 => 14.6937, std.dev.: 0.0354) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.93% (1.1170 => 1.1497, std.dev.: 0.0113) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.91% (4.4880 => 4.6184, std.dev.: 0.0356) MultiSource/Applications/JM/ldecod/ldecod: 2.86% (6.7320 => 6.9245, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.78% (0.8069 => 0.8293, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.75% (0.8050 => 0.8271, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.70% (0.7966 => 0.8181, std.dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: 2.65% (15.3280 => 15.7343, std.dev.: 0.0495) MultiSource/Applications/d/make_dparser: 2.64% (3.2366 => 3.3219, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.64% (0.9069 => 0.9308, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.61% (1.2526 => 1.2853, std.dev.: 0.0107) MultiSource/Applications/hexxagon/hexxagon: 2.61% (0.9810 => 1.0066, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.58% (0.9074 => 0.9308, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.57% (0.4559 => 0.4676, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.56% (0.9908 => 1.0162, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/football/football: 2.51% (0.8768 => 0.8988, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.49% (0.8086 => 0.8287, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.48% (0.8805 => 0.9023, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.48% (1.2602 => 1.2914, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.45% (0.8204 => 0.8405, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: 2.44% (2.3764 => 2.4344, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.44% (0.8286 => 0.8488, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.44% (0.8656 => 0.8867, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.41% (0.8518 => 0.8723, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.37% (1.4479 => 1.4822, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.35% (1.2423 => 1.2715, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.35% (0.8855 => 0.9063, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.22% (0.8927 => 0.9125, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.21% (0.8420 => 0.8606, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.13% (0.8066 => 0.8238, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.11% (0.8338 => 0.8514, std.dev.: 0.0041) MultiSource/Applications/siod/siod: 2.10% (2.2184 => 2.2649, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.03% (0.8885 => 0.9065, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.02% (0.8995 => 0.9177, std.dev.: 0.0063) MultiSource/Applications/oggenc/oggenc: 2.00% (4.9628 => 5.0619, std.dev.: 0.0202) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.86% (0.8340 => 0.8495, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.81% (0.6943 => 0.7069, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (3.1832 => 3.2372, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 1.51% (1.0945 => 1.1110, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 115.08% (0.0199 => 0.0428, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/pi: 57.75% (1.5795 => 2.4916, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 19.32% (0.0528 => 0.0630, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.88% (0.7597 => 0.8879, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.26% (2.9753 => 3.4591, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.73% (2.7995 => 3.2118, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.54% (5.0261 => 5.6063, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.66% (1.1857 => 1.2765, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 7.15% (1.7056 => 1.8275, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.52% (4.7794 => 5.0909, std.dev.: 0.0101) MultiSource/Applications/SIBsim4/SIBsim4: 6.44% (3.1873 => 3.3925, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/richards_benchmark: 6.11% (1.3037 => 1.3834, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.90% (4.9686 => 5.2615, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.76% (4.5327 => 4.7938, std.dev.: 0.0583) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.50% (6.2275 => 6.5079, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.43% (3.3761 => 3.5258, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.42% (4.9453 => 5.1637, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.13% (4.9469 => 5.1512, std.dev.: 0.0514) MultiSource/Applications/hexxagon/hexxagon: 3.88% (14.0064 => 14.5495, std.dev.: 0.0043) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.63% (1.2337 => 1.2785, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.21% (0.3587 => 0.3702, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.89% (11.5690 => 11.9035, std.dev.: 0.0244) MultiSource/Applications/siod/siod: 2.74% (3.6643 => 3.7647, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.73% (8.2783 => 8.5046, std.dev.: 0.0111) MultiSource/Applications/lambda-0_1_3/lambda: 2.63% (7.4933 => 7.6907, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.37% (4.8660 => 4.9815, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout/lists: 2.27% (7.3375 => 7.5037, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.96% (4.8362 => 4.9308, std.dev.: 0.0102) MultiSource/Benchmarks/BitBench/five11/five11: 1.70% (5.6030 => 5.6982, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/power/power: 1.54% (1.2061 => 1.2247, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.30% (2.4647 => 2.4967, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: 1.27% (1.0841 => 1.0979, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.27% (3.5679 => 3.6132, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/ReedSolomon: 1.03% (8.5322 => 8.6199, std.dev.: 0.0123) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.03% (39.2082 => 39.6112, std.dev.: 0.0374) MultiSource/Applications/spiff/spiff: 1.02% (2.8561 => 2.8853, std.dev.: 0.0099) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.10% (5.4641 => 4.3112, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.71% (7.2130 => 6.2964, std.dev.: 0.1525) SingleSource/Benchmarks/McGill/chomp: -11.21% (1.1216 => 0.9959, std.dev.: 0.0141) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.80% (1.0512 => 0.9377, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -8.55% (63.1822 => 57.7818, std.dev.: 0.1290) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.85% (4.7482 => 4.4229, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.42% (0.3269 => 0.3059, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.98% (3.7148 => 3.4925, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.98% (5.4972 => 5.1683, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.03% (5.1557 => 4.8964, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.34% (4.7449 => 4.5391, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.16% (2.8773 => 2.7576, std.dev.: 0.0312) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.75% (6.0224 => 5.7966, std.dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (28.5821 => 27.6905, std.dev.: 0.0917) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.82% (0.5807 => 0.5643, std.dev.: 0.0007) MultiSource/Applications/lua/lua: -2.72% (29.8330 => 29.0222, std.dev.: 0.0641) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.57% (9.9065 => 9.6521, std.dev.: 0.0784) MultiSource/Applications/aha/aha: -2.42% (3.3398 => 3.2589, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.98% (11.5316 => 11.3034, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.68% (3.2169 => 3.1630, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.57% (4.9994 => 4.9208, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.48% (2.3487 => 2.3140, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/hash2: -1.45% (3.4237 => 3.3739, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.17% (5.6343 => 5.5683, std.dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.93% (16.4461 => 16.7634, std.dev.: 0.0733) MultiSource/Applications/obsequi/Obsequi: 3.21% (1.0262 => 1.0591, std.dev.: 0.0155) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6846.30% (0.3123 => 21.6933, std.dev.: 0.5165) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.07% (0.2463 => 0.3647, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 0.87% (0.6010 => 0.6062, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.50% (0.3266 => 0.3315, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/strcat: 2.13% (0.1969 => 0.2011, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.39% (0.0408 => 0.0430, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 2.36% (0.0254 => 0.0260, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.63% (0.0302 => 0.0319, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.20% (0.0384 => 0.0427, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -3.33% (0.0180 => 0.0174, std.dev.: 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1438 => 0.1437, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.61% (1.1329 => 1.1511, std.dev.: 0.0211) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.63% (0.1462 => 0.1515, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.72% (0.4164 => 0.4194, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.77% (0.1369 => 0.1448, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.28% (0.0641 => 0.0662, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.42% (0.0578 => 0.0592, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.55% (1.1437 => 1.1957, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.71% (0.0627 => 0.0644, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.89% (0.0180 => 0.0268) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.20% (0.8017 => 0.7841, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 74.19% (0.0062 => 0.0108, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 6 03:05:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 6 Nov 2012 05:05:37 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121106110537.03A532A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5624?compare_to=5621&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5624, Order: 167445, Start Time: 2012-11-06 09:40:35, End Time: 2012-11-06 11:05:44 To: 5621, Order: 167444, Start Time: 2012-11-06 07:48:39, End Time: 2012-11-06 09:17:10 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (179 on baseline) Unchanged Tests: 1042 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1017, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/salsa20: 2.54% (7.4937 => 7.6840, std.dev.: 0.0245) SingleSource/Benchmarks/Shootout-C++/hash2: 2.19% (3.1932 => 3.2631, std.dev.: 0.0013) MultiSource/Benchmarks/llubenchmark/llu: 1.08% (3.7435 => 3.7840, std.dev.: 0.0115) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.80% (0.3821 => 0.3523, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -7.38% (2.4924 => 2.3084, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.91% (0.3142 => 0.2925, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.67% (0.3357 => 0.3133, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.64% (0.9542 => 0.8908, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.63% (0.2428 => 0.2267, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.56% (3.5339 => 3.3019, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.46% (22.4056 => 20.9575, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/trivial-interface: -6.45% (0.3812 => 0.3566, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.45% (0.3658 => 0.3422, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.43% (1.0544 => 0.9866, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.40% (0.3891 => 0.3642, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.40% (0.3831 => 0.3586, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.39% (0.3880 => 0.3632, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.37% (0.3848 => 0.3603, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -6.34% (0.2160 => 0.2023, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.32% (0.6484 => 0.6074, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: -6.30% (0.4033 => 0.3779, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: -6.29% (0.3896 => 0.3651, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.27% (0.4176 => 0.3914, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -6.27% (7.0961 => 6.6509, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: -6.27% (16.1920 => 15.1773, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/gs/gs: -6.24% (4.3330 => 4.0626, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.20% (1.6474 => 1.5452, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: -6.20% (1.2515 => 1.1739, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: -6.19% (0.4199 => 0.3939, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.19% (0.9852 => 0.9242, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.18% (0.3884 => 0.3644, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.16% (0.7919 => 0.7431, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: -6.16% (9.2283 => 8.6600, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/football/football: -6.16% (0.9179 => 0.8614, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/parameter-passing: -6.14% (0.4280 => 0.4017, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -6.10% (1.1450 => 1.0751, std.dev.: 0.0153) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.09% (1.2784 => 1.2005, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.09% (1.6364 => 1.5367, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.08% (1.3722 => 1.2888, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.07% (1.2300 => 1.1553, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.03% (0.2355 => 0.2213, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -6.02% (0.1761 => 0.1655, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: -6.02% (0.2659 => 0.2499, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.01% (0.1796 => 0.1688, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -5.99% (0.3406 => 0.3202, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.97% (0.3483 => 0.3275, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -5.96% (0.1879 => 0.1767, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.95% (4.8161 => 4.5296, std.dev.: 0.0130) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.93% (0.2548 => 0.2397, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -5.92% (4.0594 => 3.8190, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.91% (4.5069 => 4.2406, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.88% (1.4642 => 1.3781, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.85% (4.8802 => 4.5946, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.83% (0.2695 => 0.2538, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.82% (0.6293 => 0.5927, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.78% (14.2083 => 13.3868, std.dev.: 0.0051) MultiSource/Applications/siod/siod: -5.78% (2.4021 => 2.2633, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.77% (0.6736 => 0.6347, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.76% (4.0323 => 3.8001, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: -5.73% (15.5079 => 14.6191, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bh/bh: -5.73% (0.2985 => 0.2814, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.72% (0.8521 => 0.8034, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.70% (0.5857 => 0.5523, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: -5.70% (0.3581 => 0.3377, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: -5.68% (1.1530 => 1.0875, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.67% (5.4682 => 5.1581, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -5.65% (17.1032 => 16.1366, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.65% (6.7716 => 6.3892, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.62% (0.6230 => 0.5880, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -5.62% (2.1401 => 2.0199, std.dev.: 0.0109) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.61% (0.4916 => 0.4640, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.61% (0.5168 => 0.4878, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.60% (0.6304 => 0.5951, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.55% (0.5999 => 0.5666, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: -5.54% (3.5154 => 3.3206, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.54% (0.6052 => 0.5717, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.54% (0.2999 => 0.2833, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.53% (0.7339 => 0.6933, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.53% (0.6297 => 0.5949, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.53% (2.2587 => 2.1339, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.52% (0.6446 => 0.6090, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: -5.49% (0.4515 => 0.4267, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.49% (0.4151 => 0.3923, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.49% (0.2278 => 0.2153, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.48% (0.7021 => 0.6636, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.48% (0.5329 => 0.5037, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.46% (0.5863 => 0.5543, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.45% (0.3319 => 0.3138, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.45% (0.5925 => 0.5602, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.45% (0.6260 => 0.5919, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.44% (0.5859 => 0.5540, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.44% (0.6395 => 0.6047, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: -5.44% (0.7447 => 0.7042, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.42% (0.5478 => 0.5181, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.42% (0.6660 => 0.6299, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.42% (0.5849 => 0.5532, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.42% (0.6440 => 0.6091, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.41% (0.7524 => 0.7117, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.39% (0.5941 => 0.5621, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.37% (0.5456 => 0.5163, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -5.37% (1.3148 => 1.2442, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.36% (0.5802 => 0.5491, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.36% (0.6681 => 0.6323, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.36% (0.3491 => 0.3304, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -5.35% (0.4861 => 0.4601, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.35% (0.9557 => 0.9046, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.35% (0.5575 => 0.5277, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -5.34% (34.0927 => 32.2709, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.34% (0.5805 => 0.5495, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.34% (0.6667 => 0.6311, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.33% (0.5591 => 0.5293, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.32% (0.6189 => 0.5860, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.27% (0.3849 => 0.3646, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.26% (0.6194 => 0.5868, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.25% (0.5581 => 0.5288, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -5.25% (0.7982 => 0.7563, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.24% (0.5570 => 0.5278, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -5.24% (18.2933 => 17.3350, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.24% (0.6033 => 0.5717, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.23% (8.0126 => 7.5936, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.22% (0.5705 => 0.5407, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.21% (0.3837 => 0.3637, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.18% (0.4321 => 0.4097, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.17% (0.5569 => 0.5281, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.17% (0.6676 => 0.6331, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -5.16% (15.2527 => 14.4657, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/methcall: -5.16% (0.3025 => 0.2869, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -5.16% (0.4248 => 0.4029, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.14% (1.2221 => 1.1593, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: -5.14% (0.3271 => 0.3103, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -5.13% (1.3864 => 1.3153, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.13% (0.2106 => 0.1998, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.12% (0.2385 => 0.2263, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.10% (0.5567 => 0.5283, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.08% (0.6395 => 0.6070, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.08% (2.1713 => 2.0611, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: -5.06% (0.3481 => 0.3305, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -5.00% (0.3621 => 0.3440, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -4.98% (0.3194 => 0.3035, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.98% (0.5688 => 0.5405, std.dev.: 0.0055) SingleSource/Regression/C++/ofstream_ctor: -4.94% (0.3059 => 0.2908, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -4.92% (0.3026 => 0.2877, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.87% (0.3057 => 0.2908, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.87% (0.6347 => 0.6038, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -4.85% (0.3255 => 0.3097, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.85% (0.7198 => 0.6849, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.85% (1.2210 => 1.1618, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.85% (0.7779 => 0.7402, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: -4.82% (0.8418 => 0.8012, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: -4.82% (5.0226 => 4.7806, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -4.80% (0.6750 => 0.6426, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -4.80% (0.6441 => 0.6132, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.80% (0.3252 => 0.3096, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -4.78% (0.3867 => 0.3682, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.78% (0.4083 => 0.3888, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.75% (0.2903 => 0.2765, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: -4.74% (0.2849 => 0.2714, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.74% (0.2871 => 0.2735, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -4.73% (0.2939 => 0.2800, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.72% (0.4427 => 0.4218, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.71% (0.2933 => 0.2795, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -4.70% (0.3446 => 0.3284, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -4.64% (0.4524 => 0.4314, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.64% (0.3016 => 0.2876, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.60% (0.3931 => 0.3750, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -4.58% (0.2989 => 0.2852, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -4.57% (0.3788 => 0.3615, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -4.57% (0.3394 => 0.3239, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -4.56% (0.3205 => 0.3059, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.53% (0.4813 => 0.4595, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.36% (0.3323 => 0.3178, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.13% (0.9077 => 0.8702, std.dev.: 0.0041) MultiSource/Applications/hbd/hbd: -4.07% (1.5610 => 1.4975, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -2.12% (20.7746 => 20.3337, std.dev.: 0.0367) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7532, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: -8.70% (1.2842 => 1.1725, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7068, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.80% (2.2633 => 2.1773, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4723, std.dev.: 0.0013) Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 6 03:14:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 6 Nov 2012 05:14:03 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121106111403.0A2C72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5625?compare_to=5618&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5625, Order: 167442, Start Time: 2012-11-06 07:56:43, End Time: 2012-11-06 11:14:11 To: 5618, Order: 167433, Start Time: 2012-11-06 03:53:10, End Time: 2012-11-06 07:08:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 6 (167 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1036 (723 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.89% (0.5775 => 0.5884, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.11% (2.2086 => 2.2332, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 1.11% (6.1506 => 6.2186, std.dev.: 0.0064) MultiSource/Applications/lua/lua: 1.03% (1.6142 => 1.6309, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 1.01% (2.1792 => 2.2013, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.62% (0.3815 => 0.3915, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.84% (0.0625 => 0.0874, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.33% (0.1063 => 0.1396, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.37% (0.2969 => 0.3752, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.31% (0.1106 => 0.1397, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.50% (0.4253 => 0.5295, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.35% (0.4139 => 0.5147, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 24.12% (0.1107 => 0.1374, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.07% (0.4994 => 0.6196, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.69% (0.5900 => 0.7298, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.58% (0.0475 => 0.0587, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 23.27% (1.5932 => 1.9640, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.97% (0.0714 => 0.0878, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.77% (0.0584 => 0.0717, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.64% (0.5000 => 0.6132, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.41% (0.1620 => 0.1983, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.07% (0.0897 => 0.1095, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.94% (0.1021 => 0.1245, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 20.78% (0.0948 => 0.1145, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.76% (0.1103 => 0.1332, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.72% (0.0584 => 0.0705, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.70% (0.0541 => 0.0653, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.70% (0.0633 => 0.0764, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.55% (0.3903 => 0.4705, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.40% (0.0642 => 0.0773, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.40% (0.0495 => 0.0596, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 20.22% (0.0821 => 0.0987, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.14% (0.1549 => 0.1861, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.14% (0.1003 => 0.1205, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.01% (0.1604 => 0.1925, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.95% (0.0822 => 0.0986, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 19.89% (0.1619 => 0.1941, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.22% (0.1462 => 0.1743) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.07% (0.0582 => 0.0693, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 18.90% (0.0947 => 0.1126, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 18.69% (0.0808 => 0.0959, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.59% (0.3890 => 0.4613, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 18.35% (0.5826 => 0.6895, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.32% (0.2014 => 0.2383, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/08-main/main: 18.31% (0.1218 => 0.1441, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 18.07% (0.0581 => 0.0686, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 18.00% (0.5889 => 0.6949, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 17.94% (0.4029 => 0.4752, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 17.81% (0.1505 => 0.1773, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.80% (0.2736 => 0.3223, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 17.77% (0.0698 => 0.0822, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.70% (1.3152 => 1.5480, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.65% (0.1088 => 0.1280, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.27% (0.2866 => 0.3361, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.19% (0.0605 => 0.0709, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 17.15% (0.5546 => 0.6497, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 17.13% (1.8794 => 2.2013, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.07% (0.5026 => 0.5884, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.06% (3.5627 => 4.1704, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.02% (0.1968 => 0.2303, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.83% (0.4658 => 0.5442, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.61% (1.6211 => 1.8904, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.47% (0.1160 => 0.1351, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.42% (0.3271 => 0.3808, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 16.40% (0.7171 => 0.8347, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 16.40% (0.1421 => 0.1654, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 16.24% (0.9697 => 1.1272, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.21% (0.4361 => 0.5068, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 15.94% (1.0781 => 1.2500, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.86% (0.2875 => 0.3331, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.85% (4.4195 => 5.1201, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/bh/bh: 15.81% (0.1284 => 0.1487, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.80% (2.7292 => 3.1605, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.80% (0.3930 => 0.4551, std.dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: 15.59% (4.2109 => 4.8674, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.29% (0.3362 => 0.3876, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 15.24% (0.2566 => 0.2957, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 15.14% (0.9909 => 1.1409, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 15.09% (23.5202 => 27.0691, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/fibo: 15.08% (0.2725 => 0.3136, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/hello: 15.03% (0.2714 => 0.3122, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.95% (0.1090 => 0.1253, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.95% (1.9694 => 2.2638, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/nestedloop: 14.88% (0.2729 => 0.3135, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.88% (1.9966 => 2.2936, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/methcall: 14.86% (0.2813 => 0.3231, std.dev.: 0.0025) SingleSource/Regression/C++/ofstream_ctor: 14.85% (0.3004 => 0.3450, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 14.82% (0.2780 => 0.3192, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/random: 14.81% (0.2803 => 0.3218, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.80% (0.3195 => 0.3668, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 14.80% (0.2750 => 0.3157, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.70% (0.2911 => 0.3339, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.56% (2.0673 => 2.3683, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/except: 14.55% (0.2811 => 0.3220, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/football/football: 14.51% (0.2075 => 0.2376, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wc: 14.50% (0.3096 => 0.3545, std.dev.: 0.0102) MultiSource/Applications/lua/lua: 14.30% (1.4269 => 1.6309, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.16% (0.3488 => 0.3982, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 14.13% (0.3460 => 0.3949, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: 14.08% (0.3267 => 0.3727, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary2: 14.05% (0.3317 => 0.3783, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/exceptions-2: 14.05% (0.3446 => 0.3930, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 14.03% (0.3465 => 0.3951, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 14.00% (0.3258 => 0.3714, std.dev.: 0.0073) SingleSource/UnitTests/ObjC/for-in: 13.99% (0.3496 => 0.3985, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.95% (0.3442 => 0.3922, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.92% (0.3469 => 0.3952, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.79% (0.3060 => 0.3482, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 13.68% (0.3348 => 0.3806, std.dev.: 0.0091) SingleSource/UnitTests/ObjC/property: 13.64% (0.3650 => 0.4148, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.60% (0.3124 => 0.3549, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 13.59% (0.3643 => 0.4138, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 13.58% (0.4146 => 0.4709, std.dev.: 0.0136) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.58% (0.3845 => 0.4367, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 13.56% (0.7875 => 0.8943, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 13.51% (0.3724 => 0.4227, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 13.41% (2.1653 => 2.4556, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.38% (0.3282 => 0.3721, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.35% (0.3625 => 0.4109, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/sieve: 13.18% (0.3726 => 0.4217, std.dev.: 0.0158) MultiSource/Benchmarks/mafft/pairlocalalign: 13.14% (2.1013 => 2.3775, std.dev.: 0.0047) MultiSource/Applications/JM/lencod/lencod: 13.12% (4.6177 => 5.2237, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash2: 13.03% (0.4251 => 0.4805, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.94% (0.1383 => 0.1562, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.93% (0.3690 => 0.4167, std.dev.: 0.0105) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.89% (0.2040 => 0.2303, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 12.34% (0.2691 => 0.3023, std.dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 12.21% (5.5417 => 6.2186, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/bigfib: 12.21% (0.5012 => 0.5624, std.dev.: 0.0055) MultiSource/Applications/siod/siod: 11.29% (0.6634 => 0.7383, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.13% (0.6435 => 0.7151, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.09% (0.1028 => 0.1142, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.93% (0.2068 => 0.2294, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 10.71% (0.4847 => 0.5366, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.71% (0.2737 => 0.3030, std.dev.: 0.0084) MultiSource/Applications/lambda-0_1_3/lambda: 10.58% (0.3498 => 0.3868, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.47% (0.3084 => 0.3407, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.43% (0.3336 => 0.3684, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 9.87% (0.2391 => 0.2627, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 9.76% (2.0346 => 2.2332, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.70% (0.2103 => 0.2307, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.62% (4.6926 => 5.0971, std.dev.: 0.0056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.57% (11.6398 => 12.6378, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.47% (0.5361 => 0.5815, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.86% (0.7426 => 0.8010, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.83% (0.5584 => 0.6021, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 6.57% (11.9555 => 12.7407, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.72% (0.3792 => 0.3971, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0146) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.21% (0.2802 => 0.3060, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6092, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.01% (0.3693 => 0.3915, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/objinst: 4.98% (12.0509 => 12.6509, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1721, std.dev.: 0.0153) SingleSource/Benchmarks/Dhrystone/dry: 4.21% (14.0481 => 14.6400, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/flops-2: 4.15% (1.8057 => 1.8806, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary3: 1.83% (15.8721 => 16.1629, std.dev.: 0.0152) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2252, std.dev.: 0.0036) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3058, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2896, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5865, std.dev.: 0.0279) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.30% (2.4764 => 2.4441, std.dev.: 0.0118) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -36.35% (25.4195 => 16.1806, std.dev.: 0.1915) SingleSource/Benchmarks/Shootout-C++/ary2: -7.95% (0.2402 => 0.2211, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9770, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8027, std.dev.: 0.0869) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8003, std.dev.: 0.0058) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7730, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.99% (0.6293 => 0.6105, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std.dev.: 0.0126) SingleSource/Benchmarks/Dhrystone/fldry: -2.89% (17.2379 => 16.7403, std.dev.: 0.0892) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8587, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5746, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4951, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.31% (5.7935 => 5.7177, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1628, std.dev.: 0.0802) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0415, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 6 07:17:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 6 Nov 2012 09:17:33 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121106151733.090D72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5626?compare_to=5625&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5626, Order: 167445, Start Time: 2012-11-06 12:02:07, End Time: 2012-11-06 15:17:41 To: 5625, Order: 167442, Start Time: 2012-11-06 07:56:43, End Time: 2012-11-06 11:14:11 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (178 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1039 (713 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 2.47% (16.1806 => 16.5798, std.dev.: 0.0154) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.56% (2.0758 => 2.1082, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.35% (54.1886 => 54.9178, std.dev.: 0.0413) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.96% (0.0625 => 0.0881, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.36% (0.1063 => 0.1407, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.28% (0.2969 => 0.3779, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.13% (0.1106 => 0.1395, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.32% (0.4139 => 0.5187, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.83% (0.5900 => 0.7365, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.62% (0.4253 => 0.5300, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.57% (0.4994 => 0.6221, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.42% (0.0475 => 0.0591, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.37% (0.0714 => 0.0888, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.34% (0.0415 => 0.0516, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.95% (0.0547 => 0.0678, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.84% (0.5000 => 0.6192, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.80% (0.0584 => 0.0723, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 23.61% (1.5932 => 1.9694, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.84% (0.1620 => 0.1990, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.72% (0.1021 => 0.1253, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 22.70% (0.0599 => 0.0735, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.52% (0.0897 => 0.1099, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.31% (0.1107 => 0.1354, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 21.73% (0.0948 => 0.1154, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.48% (0.0633 => 0.0769, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.40% (0.0584 => 0.0709, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.40% (0.1103 => 0.1339, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.34% (0.0642 => 0.0779, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.26% (0.0541 => 0.0656) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.21% (0.0495 => 0.0600, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.04% (0.3903 => 0.4724, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 20.95% (0.0821 => 0.0993, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.85% (0.1549 => 0.1872, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.84% (0.1003 => 0.1212, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 20.82% (0.1619 => 0.1956, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.68% (0.0822 => 0.0992, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.64% (0.1604 => 0.1935, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 20.36% (0.0604 => 0.0727, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 19.64% (0.0947 => 0.1133, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.49% (0.1462 => 0.1747, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.33% (0.2736 => 0.3265, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 19.31% (0.0808 => 0.0964, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 19.28% (0.0581 => 0.0693, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.17% (0.2014 => 0.2400, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.89% (0.3890 => 0.4625, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 18.88% (0.1218 => 0.1448) SingleSource/UnitTests/ObjC++/Hello: 18.71% (0.5826 => 0.6916, std.dev.: 0.0032) MultiSource/Applications/spiff/spiff: 18.69% (0.4029 => 0.4782, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/mst/mst: 18.48% (0.0698 => 0.0827, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.45% (1.3152 => 1.5578, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.38% (0.1088 => 0.1288, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.36% (0.0572 => 0.0677, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 18.34% (0.5889 => 0.6969, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 18.21% (0.1505 => 0.1779, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.00% (0.2866 => 0.3382, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 17.73% (1.8794 => 2.2127, std.dev.: 0.0067) MultiSource/Applications/Burg/burg: 17.71% (0.5546 => 0.6528, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.48% (0.1968 => 0.2312, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.45% (0.0573 => 0.0673, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.44% (3.5627 => 4.1839, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.33% (0.5026 => 0.5897, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.30% (0.4658 => 0.5464, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.07% (0.1160 => 0.1358, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.02% (1.6211 => 1.8970, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.00% (0.3271 => 0.3827, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 16.89% (0.1421 => 0.1661, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 16.86% (0.0605 => 0.0707, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 16.62% (0.9697 => 1.1309, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.60% (0.4361 => 0.5085, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.54% (0.3930 => 0.4580, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 16.31% (1.0781 => 1.2539, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: 16.20% (0.1284 => 0.1492, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.17% (2.7292 => 3.1705, std.dev.: 0.0063) MultiSource/Applications/ClamAV/clamscan: 16.10% (4.2109 => 4.8889, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.03% (0.2875 => 0.3336, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 16.02% (0.7171 => 0.8320, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.92% (1.9694 => 2.2829, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.90% (4.4195 => 5.1223, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.45% (1.9966 => 2.3050, std.dev.: 0.0089) SingleSource/Regression/C++/ofstream_ctor: 15.38% (0.3004 => 0.3466, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 15.36% (0.2714 => 0.3131, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.27% (0.2738 => 0.3156, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 15.24% (0.2566 => 0.2957, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 15.23% (0.2725 => 0.3140, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.23% (0.1090 => 0.1256, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.21% (0.2729 => 0.3144, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.18% (0.3195 => 0.3680, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 15.13% (0.2750 => 0.3166, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 15.07% (0.2780 => 0.3199, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/random: 14.98% (0.2803 => 0.3223, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 14.98% (0.2811 => 0.3232, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 14.96% (23.5202 => 27.0397, std.dev.: 0.0325) MultiSource/Benchmarks/Prolangs-C/football/football: 14.94% (0.2075 => 0.2385, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 14.90% (0.2813 => 0.3232, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 14.86% (0.9909 => 1.1381, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 14.84% (0.2823 => 0.3242, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.84% (0.2911 => 0.3343, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.83% (0.2792 => 0.3206, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 14.76% (0.3096 => 0.3553, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.66% (2.0673 => 2.3704, std.dev.: 0.0029) MultiSource/Applications/lua/lua: 14.47% (1.4269 => 1.6334, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 14.42% (0.3460 => 0.3959, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 14.39% (0.3446 => 0.3942, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 14.36% (0.3496 => 0.3998, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.33% (0.3488 => 0.3988, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 14.33% (0.3267 => 0.3735, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.32% (0.3442 => 0.3935, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 14.31% (0.3465 => 0.3961, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.28% (0.3845 => 0.4394, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.28% (0.3362 => 0.3842, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 14.21% (0.3258 => 0.3721, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 14.18% (0.3469 => 0.3961, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 14.08% (0.3317 => 0.3784, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 13.99% (0.7875 => 0.8977, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.99% (0.3060 => 0.3488, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 13.97% (0.3678 => 0.4192, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.89% (0.3124 => 0.3558, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 13.89% (0.3650 => 0.4157, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.83% (0.3643 => 0.4147, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.78% (0.3724 => 0.4237, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash: 13.72% (0.4146 => 0.4715, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.66% (0.3625 => 0.4120, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 13.63% (2.1653 => 2.4604, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 13.59% (0.3348 => 0.3803, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.47% (0.3282 => 0.3724, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 13.37% (0.3477 => 0.3942, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 13.37% (0.3726 => 0.4224, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 13.36% (2.1013 => 2.3820, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 13.34% (4.6177 => 5.2335, std.dev.: 0.0096) MultiSource/Benchmarks/sim/sim: 13.32% (0.0758 => 0.0859, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 13.29% (0.4251 => 0.4816, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.06% (0.3690 => 0.4172, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.99% (0.3981 => 0.4498, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.87% (0.1383 => 0.1561, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.84% (0.2040 => 0.2302, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 12.49% (0.2691 => 0.3027, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 12.43% (0.5012 => 0.5635, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 12.21% (5.5417 => 6.2183, std.dev.: 0.0094) MultiSource/Applications/lambda-0_1_3/lambda: 11.55% (0.3498 => 0.3902, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 11.47% (0.6634 => 0.7395, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.36% (0.6435 => 0.7166, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.28% (0.1028 => 0.1144, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.83% (0.2068 => 0.2292, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.81% (0.2737 => 0.3033, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: 10.81% (0.4847 => 0.5371, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 10.25% (0.3336 => 0.3678, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.21% (0.3084 => 0.3399, std.dev.: 0.0115) MultiSource/Applications/lemon/lemon: 9.91% (0.2391 => 0.2628, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.75% (0.2103 => 0.2308, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 9.73% (2.0346 => 2.2325, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.75% (11.6398 => 12.6580, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.62% (4.6926 => 5.0969, std.dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.47% (0.5361 => 0.5815, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.01% (0.7426 => 0.8021, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.93% (0.5584 => 0.6027, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 6.53% (11.9555 => 12.7356, std.dev.: 0.0122) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.98% (0.3792 => 0.3981, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.46% (0.2162 => 0.3534, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 9.53% (0.2802 => 0.3069, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.58% (0.3693 => 0.3936, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6090, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6724, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary: 4.71% (0.2122 => 0.2222, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1670, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-2: 4.67% (1.8057 => 1.8900, std.dev.: 0.0061) SingleSource/Benchmarks/Dhrystone/dry: 4.13% (14.0481 => 14.6283, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1942, std.dev.: 0.0031) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2229, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.47% (7.1849 => 7.2906, std.dev.: 0.0048) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3039, std.dev.: 0.0179) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.26% (2.0820 => 2.1082, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.13% (8.4155 => 8.5109, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 1.02% (50.0626 => 50.5752, std.dev.: 0.0228) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.63% (2.4764 => 2.4360, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.78% (25.4195 => 16.5798, std.dev.: 0.0154) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9742, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7997, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -7.12% (0.2402 => 0.2231, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.57% (11.2080 => 10.8080, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -3.24% (17.2379 => 16.6797, std.dev.: 0.0665) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7724, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.26% (41.7953 => 40.8493, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5739, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4949, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1490, std.dev.: 0.0833) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0456, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 6 08:58:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 6 Nov 2012 10:58:02 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121106165802.02BF22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5627?compare_to=5623&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5627, Order: 167460, Start Time: 2012-11-06 15:31:56, End Time: 2012-11-06 16:58:11 To: 5623, Order: 167445, Start Time: 2012-11-06 08:53:13, End Time: 2012-11-06 10:19:37 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 3 (125 on baseline) Performance Improvements: 3 (24 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 985 (825 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.38% (6.7303 => 7.3614, std.dev.: 0.0939) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.82% (0.2007 => 0.2164, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/ffbench: 2.09% (1.4089 => 1.4384, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.34% (0.3519 => 0.3331, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -3.62% (0.5254 => 0.5064, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: -1.42% (1.0066 => 0.9923, std.dev.: 0.0050) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.14% (16.7634 => 16.7394, std.dev.: 0.0946) MultiSource/Applications/obsequi/Obsequi: -0.73% (1.0591 => 1.0514, std.dev.: 0.0085) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.12% (21.6933 => 21.6670, std.dev.: 0.4305) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.03% (0.3647 => 0.3646, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/bigfib: -0.59% (0.6062 => 0.6026, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.06% (0.3315 => 0.3313, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -0.70% (0.2011 => 0.1997, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.46% (0.0219 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.63% (0.0430 => 0.0423, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 28.08% (0.0260 => 0.0333, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.31% (0.0319 => 0.0318, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.11% (0.0427 => 0.0418, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: 0.99% (0.0202 => 0.0204, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 9.77% (0.0174 => 0.0191, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.56% (0.1437 => 0.1429, std.dev.: 0.0050) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.06% (1.1511 => 1.1633, std.dev.: 0.0179) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.12% (0.1515 => 0.1532, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.33% (0.4194 => 0.4208, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.21% (0.1448 => 0.1445, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.32% (0.0662 => 0.0640, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.69% (0.0277 => 0.0264, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.76% (0.0592 => 0.0632, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.18% (1.1957 => 1.1979, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -32.26% (0.0031 => 0.0021, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.50% (0.0644 => 0.0615, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -23.13% (0.0268 => 0.0206, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.52% (0.7841 => 0.7800, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -34.26% (0.0108 => 0.0071, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2312.57% (0.6332 => 15.2764, std.dev.: 0.2614) MultiSource/Benchmarks/McCat/08-main/main: 48.83% (0.1831 => 0.2725, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.09% (0.1559 => 0.1464, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1482.21% (0.3344 => 5.2909, std.dev.: 0.0154) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.42% (0.2364 => 0.3225, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: 3.96% (0.0429 => 0.0446, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.80% (0.0224 => 0.0237, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4181, std.dev.: 0.0322) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0700, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4944, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3467, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1240, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4018, std.dev.: 0.0031) SingleSource/Regression/C/uint64_to_float: -23.92% (2.1832 => 1.6610, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.40% (0.0810 => 0.0959, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 12.14% (0.1112 => 0.1247, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.03% (0.0848 => 0.0950, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.20% (0.2180 => 0.2337, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.20% (0.2279 => 0.2443, std.dev.: 0.0049) MultiSource/Applications/viterbi/viterbi: 7.04% (0.1577 => 0.1688, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.89% (0.8321 => 0.8894, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/em3d/em3d: 6.68% (0.1721 => 0.1836, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.64% (0.7473 => 0.7969, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.45% (0.1983 => 0.2111, std.dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.83% (0.3137 => 0.3320, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.59% (0.6010 => 0.6346, std.dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.46% (0.1905 => 0.2009, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.39% (0.8148 => 0.8587, std.dev.: 0.0100) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.36% (0.2240 => 0.2360, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.31% (0.1885 => 0.1985, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.96% (0.2378 => 0.2496, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.91% (1.1685 => 1.2259, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.84% (0.2519 => 0.2641, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.65% (0.3717 => 0.3890, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.58% (1.1606 => 1.2137, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.48% (0.4847 => 0.5064, std.dev.: 0.0045) MultiSource/Applications/spiff/spiff: 4.47% (0.7950 => 0.8305, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.44% (0.2998 => 0.3131, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.24% (0.4783 => 0.4986, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.19% (0.9435 => 0.9830, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.78% (0.4127 => 0.4283, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.58% (0.5817 => 0.6025, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.52% (0.5961 => 0.6171, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.50% (0.3003 => 0.3108, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 3.39% (1.9948 => 2.0624, std.dev.: 0.0108) MultiSource/Applications/sgefa/sgefa: 3.33% (0.2999 => 0.3099, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.12% (0.6227 => 0.6421, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.02% (6.6074 => 6.8070, std.dev.: 0.0546) MultiSource/Applications/hbd/hbd: 2.96% (1.4269 => 1.4692, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.94% (0.8697 => 0.8953, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.91% (0.8338 => 0.8581, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.89% (4.1763 => 4.2971, std.dev.: 0.0342) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.88% (0.8359 => 0.8600, std.dev.: 0.0056) MultiSource/Applications/lua/lua: 2.88% (3.8189 => 3.9290, std.dev.: 0.0356) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.86% (0.8050 => 0.8280, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.83% (0.9069 => 0.9326, std.dev.: 0.0040) MultiSource/Applications/ClamAV/clamscan: 2.83% (14.7684 => 15.1869, std.dev.: 0.1252) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.81% (0.8069 => 0.8296, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 2.81% (4.1305 => 4.2464, std.dev.: 0.0357) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.79% (0.8420 => 0.8655, std.dev.: 0.0072) MultiSource/Applications/minisat/minisat: 2.71% (0.6834 => 0.7019, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.70% (1.6386 => 1.6828, std.dev.: 0.0083) MultiSource/Applications/JM/ldecod/ldecod: 2.69% (6.7320 => 6.9128, std.dev.: 0.0303) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.65% (0.8597 => 0.8825, std.dev.: 0.0063) MultiSource/Applications/SPASS/SPASS: 2.65% (14.2605 => 14.6385, std.dev.: 0.1125) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.60% (0.8457 => 0.8677, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.59% (1.1170 => 1.1459, std.dev.: 0.0041) MultiSource/Benchmarks/PAQ8p/paq8p: 2.56% (2.3764 => 2.4373, std.dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 2.52% (1.1271 => 1.1555, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.51% (0.8518 => 0.8732, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.51% (0.8286 => 0.8494, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.51% (0.8331 => 0.8540, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.50% (0.8656 => 0.8872, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.49% (0.9074 => 0.9300, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.49% (0.8204 => 0.8408, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.49% (0.7966 => 0.8164, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.47% (0.8712 => 0.8927, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.46% (0.8716 => 0.8930, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.44% (0.9039 => 0.9260, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.42% (0.8086 => 0.8282, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.41% (0.8048 => 0.8242, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 2.41% (15.3280 => 15.6974, std.dev.: 0.1277) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.38% (0.9688 => 0.9919, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.37% (0.9908 => 1.0143, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.32% (0.8805 => 0.9009, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.27% (0.8007 => 0.8189, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.24% (0.8066 => 0.8247, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.22% (4.4873 => 4.5869, std.dev.: 0.0313) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.21% (0.7932 => 0.8107, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.19% (0.8885 => 0.9080, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.08% (1.2423 => 1.2682, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.08% (0.8927 => 0.9113, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 2.08% (8.6247 => 8.8041, std.dev.: 0.0491) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.07% (0.8177 => 0.8346, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/football/football: 2.06% (0.8768 => 0.8949, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.03% (0.8316 => 0.8485, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.99% (0.8340 => 0.8506, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.99% (8.6476 => 8.8193, std.dev.: 0.0615) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.95% (2.1401 => 2.1819, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.91% (4.4880 => 4.5736, std.dev.: 0.0321) MultiSource/Applications/siod/siod: 1.76% (2.2184 => 2.2575, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.65% (13.1811 => 13.3982, std.dev.: 0.0767) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.50% (0.6943 => 0.7047, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.49% (0.8995 => 0.9129, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.37% (3.1832 => 3.2268, std.dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 96.98% (0.0199 => 0.0392, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/pi: 57.70% (1.5795 => 2.4909, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.22% (0.7597 => 0.8905, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.39% (2.9753 => 3.4629, std.dev.: 0.0298) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 15.43% (6.3772 => 7.3614, std.dev.: 0.0939) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.73% (2.7995 => 3.2118, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.63% (5.0261 => 5.6104, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.05% (1.1857 => 1.2811, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 7.38% (1.7056 => 1.8315, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.83% (4.7794 => 5.1057, std.dev.: 0.0941) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.76% (0.2027 => 0.2164, std.dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: 6.49% (3.1873 => 3.3940, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.86% (4.5327 => 4.7983, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.80% (4.9686 => 5.2567, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/richards_benchmark: 4.94% (1.3037 => 1.3681, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.75% (3.3761 => 3.5363, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.43% (6.2275 => 6.5034, std.dev.: 0.0218) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.16% (4.9453 => 5.1511, std.dev.: 0.0471) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.06% (4.9469 => 5.1475, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 3.89% (14.0064 => 14.5516, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.96% (0.3587 => 0.3693, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.89% (8.2783 => 8.5173, std.dev.: 0.0056) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.85% (1.2337 => 1.2689, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.85% (11.5690 => 11.8984, std.dev.: 0.0066) MultiSource/Applications/lambda-0_1_3/lambda: 2.83% (7.4933 => 7.7050, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.66% (4.8660 => 4.9955, std.dev.: 0.0423) MultiSource/Applications/siod/siod: 2.58% (3.6643 => 3.7587, std.dev.: 0.0281) SingleSource/Benchmarks/Shootout/lists: 2.22% (7.3375 => 7.5006, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.47% (1.5941 => 1.6176, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/neural/neural: 1.31% (1.0841 => 1.0983, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.26% (2.4647 => 2.4957, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/ReedSolomon: 1.16% (8.5322 => 8.6312, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/power/power: 1.07% (1.2061 => 1.2190, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.07% (3.5679 => 3.6060, std.dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.09% (5.4641 => 4.3118, std.dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.22% (1.0512 => 0.9333, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: -11.21% (1.1216 => 0.9959, std.dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: -8.53% (63.1822 => 57.7936, std.dev.: 0.1302) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.90% (3.9188 => 3.6485, std.dev.: 0.0841) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.88% (4.7482 => 4.4215, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.12% (0.3269 => 0.3069, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.98% (3.7148 => 3.4927, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.84% (5.4972 => 5.1764, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.11% (5.1557 => 4.8924, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.35% (4.7449 => 4.5386, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.70% (6.0224 => 5.7995, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.00% (28.5821 => 27.7235, std.dev.: 0.0705) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.99% (2.6356 => 2.5567, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.98% (0.5807 => 0.5634, std.dev.: 0.0024) MultiSource/Applications/lua/lua: -2.90% (29.8330 => 28.9669, std.dev.: 0.0811) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.49% (9.9065 => 9.6596, std.dev.: 0.0491) MultiSource/Applications/aha/aha: -2.46% (3.3398 => 3.2575, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.04% (11.5316 => 11.2962, std.dev.: 0.0306) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.56% (4.9994 => 4.9212, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.3487 => 2.3155, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.25% (1.0388 => 1.0258, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.22% (3.2169 => 3.1778, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.21% (5.6343 => 5.5664, std.dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.78% (16.4461 => 16.7394, std.dev.: 0.0946) MultiSource/Applications/obsequi/Obsequi: 2.46% (1.0262 => 1.0514, std.dev.: 0.0085) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6837.88% (0.3123 => 21.6670, std.dev.: 0.4305) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.03% (0.2463 => 0.3646, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/bigfib: 0.27% (0.6010 => 0.6026, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.44% (0.3266 => 0.3313, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 1.42% (0.1969 => 0.1997, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.68% (0.0408 => 0.0423, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.30% (0.0302 => 0.0318, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.85% (0.0384 => 0.0418, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 6.11% (0.0180 => 0.0191, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.63% (0.1438 => 0.1429, std.dev.: 0.0050) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.68% (1.1329 => 1.1633, std.dev.: 0.0179) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 4.79% (0.1462 => 0.1532, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.06% (0.4164 => 0.4208, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.55% (0.1369 => 0.1445, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.16% (0.0641 => 0.0640, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 35.38% (0.0195 => 0.0264, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.34% (0.0578 => 0.0632, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.74% (1.1437 => 1.1979, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2000.00% (0.0001 => 0.0021, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.91% (0.0627 => 0.0615, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.44% (0.0180 => 0.0206, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.71% (0.8017 => 0.7800, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 14.52% (0.0062 => 0.0071, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 6 09:02:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 6 Nov 2012 11:02:42 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121106170242.105742A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5628?compare_to=5624&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5628, Order: 167460, Start Time: 2012-11-06 15:37:45, End Time: 2012-11-06 17:02:49 To: 5624, Order: 167445, Start Time: 2012-11-06 09:40:35, End Time: 2012-11-06 11:05:44 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 1 (179 on baseline) Unchanged Tests: 1040 (859 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.85% (78.3258 => 79.7782, std.dev.: 0.5005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.85% (1.2998 => 1.2757, std.dev.: 0.0072) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1014, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4937 => 7.6769, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/hash2: 2.19% (3.1932 => 3.2630, std.dev.: 0.0073) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.30% (0.3821 => 0.3542, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -7.15% (2.4924 => 2.3142, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.72% (0.3142 => 0.2931, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.38% (0.2428 => 0.2273, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.34% (0.9542 => 0.8937, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -6.27% (0.3812 => 0.3573, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions-4: -6.24% (0.3880 => 0.3638, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.21% (3.5339 => 3.3145, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.19% (0.3891 => 0.3650, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -6.19% (0.3831 => 0.3594, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.18% (0.3658 => 0.3432, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.16% (0.3848 => 0.3611, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.15% (0.3884 => 0.3645, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: -6.15% (0.4033 => 0.3785, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -6.08% (0.3896 => 0.3659, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.08% (22.4056 => 21.0438, std.dev.: 0.0100) SingleSource/UnitTests/ObjC/exceptions: -6.06% (0.4176 => 0.3923, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.05% (0.3357 => 0.3154, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: -6.03% (16.1920 => 15.2155, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.03% (0.6484 => 0.6093, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.02% (1.0544 => 0.9909, std.dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: -6.02% (7.0961 => 6.6690, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/oourafft: -5.97% (0.2160 => 0.2031, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/property: -5.93% (0.4199 => 0.3950, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.93% (0.9852 => 0.9268, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -5.89% (0.4280 => 0.4028, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -5.85% (1.2515 => 1.1783, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: -5.84% (0.9179 => 0.8643, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.82% (1.6364 => 1.5412, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.80% (1.3722 => 1.2926, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.79% (1.6474 => 1.5520, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -5.79% (1.1450 => 1.0787, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -5.78% (9.2283 => 8.6945, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.75% (1.2784 => 1.2049, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.75% (1.2300 => 1.1593, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: -5.75% (0.1879 => 0.1771, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: -5.74% (4.3330 => 4.0845, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.65% (1.4642 => 1.3814, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: -5.64% (0.2659 => 0.2509, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.63% (0.6293 => 0.5939, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.61% (4.8161 => 4.5460, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.60% (0.3483 => 0.3288, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.58% (0.3406 => 0.3216, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -5.58% (1.1530 => 1.0887, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.57% (4.0323 => 3.8076, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.57% (14.2083 => 13.4168, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.57% (0.1796 => 0.1696, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.57% (0.2695 => 0.2545, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.54% (4.5069 => 4.2571, std.dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: -5.54% (17.1032 => 16.1555, std.dev.: 0.0184) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.53% (0.2548 => 0.2407, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.48% (4.8802 => 4.6126, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -5.48% (2.4021 => 2.2705, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.47% (0.4151 => 0.3924, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.45% (0.6736 => 0.6369, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.41% (0.8521 => 0.8060, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: -5.40% (15.5079 => 14.6697, std.dev.: 0.0194) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.39% (6.7716 => 6.4065, std.dev.: 0.0182) MultiSource/Applications/lua/lua: -5.37% (4.0594 => 3.8413, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.34% (0.7919 => 0.7496, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: -5.33% (0.3581 => 0.3390, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: -5.27% (0.4861 => 0.4605, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -5.24% (3.5154 => 3.3313, std.dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.23% (0.4916 => 0.4659, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.22% (0.5168 => 0.4898, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.22% (0.2278 => 0.2159, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: -5.21% (1.3148 => 1.2463, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: -5.16% (1.3864 => 1.3148, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: -5.16% (0.2985 => 0.2831, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -5.14% (0.3446 => 0.3269, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.13% (0.7021 => 0.6661, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.12% (2.1713 => 2.0601, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.09% (5.4682 => 5.1896, std.dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: -5.09% (34.0927 => 32.3574, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.09% (0.5329 => 0.5058, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.08% (0.3837 => 0.3642, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.08% (2.2587 => 2.1440, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.07% (0.2999 => 0.2847, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.07% (0.3849 => 0.3654, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.06% (0.3931 => 0.3732, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.06% (8.0126 => 7.6070, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/moments: -5.06% (0.4248 => 0.4033, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: -5.05% (0.2989 => 0.2838, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.04% (0.6230 => 0.5916, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: -5.02% (0.3025 => 0.2873, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -5.02% (0.3026 => 0.2874, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -5.01% (0.3394 => 0.3224, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -5.01% (0.3255 => 0.3092, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -5.00% (2.1401 => 2.0331, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.00% (0.4083 => 0.3879, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: -4.98% (0.2871 => 0.2728, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.97% (0.7198 => 0.6840, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.97% (0.3016 => 0.2866, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary2: -4.97% (0.3481 => 0.3308, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.97% (0.7447 => 0.7077, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.97% (0.2355 => 0.2238, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.94% (0.3057 => 0.2906, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.94% (0.6297 => 0.5986, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -4.93% (0.6750 => 0.6417, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.92% (0.5999 => 0.5704, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.92% (0.5857 => 0.5569, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: -4.92% (0.4515 => 0.4293, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: -4.92% (0.3194 => 0.3037, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.91% (0.7339 => 0.6979, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.90% (0.3491 => 0.3320, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.89% (0.6260 => 0.5954, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.88% (0.9557 => 0.9091, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.88% (0.6194 => 0.5892, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/random: -4.87% (0.2939 => 0.2796, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.86% (1.2221 => 1.1627, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.86% (0.3252 => 0.3094, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.86% (0.2903 => 0.2762, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.84% (0.2849 => 0.2711, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.84% (0.5581 => 0.5311, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -4.83% (0.3621 => 0.3446, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.82% (0.6052 => 0.5760, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.82% (0.7524 => 0.7161, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.82% (0.3319 => 0.3159, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -4.81% (15.2527 => 14.5183, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.81% (0.6667 => 0.6346, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.81% (0.5925 => 0.5640, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -4.81% (0.3867 => 0.3681, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.81% (0.2933 => 0.2792, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.81% (0.6304 => 0.6001, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.80% (0.5478 => 0.5215, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.80% (0.6440 => 0.6131, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: -4.80% (0.4524 => 0.4307, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.79% (0.5591 => 0.5323, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.78% (1.2210 => 1.1626, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.78% (0.5859 => 0.5579, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -4.77% (0.3205 => 0.3052, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.77% (0.6395 => 0.6090, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.76% (0.6681 => 0.6363, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.75% (0.6189 => 0.5895, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -4.75% (0.7982 => 0.7603, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.74% (0.4427 => 0.4217, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.73% (0.6676 => 0.6360, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.73% (0.6446 => 0.6141, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: -4.71% (0.6347 => 0.6048, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.71% (0.5456 => 0.5199, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -4.71% (0.3059 => 0.2915, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.70% (0.5705 => 0.5437, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: -4.69% (5.0226 => 4.7871, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.67% (0.4321 => 0.4119, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.66% (0.5941 => 0.5664, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.65% (0.6660 => 0.6350, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.65% (0.5802 => 0.5532, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.65% (0.5805 => 0.5535, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -4.65% (0.3271 => 0.3119, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: -4.65% (0.3788 => 0.3612, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: -4.64% (18.2933 => 17.4450, std.dev.: 0.0204) MultiSource/Applications/spiff/spiff: -4.63% (0.8418 => 0.8028, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.61% (0.2385 => 0.2275, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.61% (0.5863 => 0.5593, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.59% (0.6033 => 0.5756, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.57% (0.5575 => 0.5320, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.57% (0.4813 => 0.4593, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.57% (0.6395 => 0.6103, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.56% (0.5849 => 0.5582, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: -4.55% (0.7779 => 0.7425, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.49% (0.5570 => 0.5320, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: -4.46% (0.6441 => 0.6154, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.44% (0.5569 => 0.5322, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.36% (0.3323 => 0.3178, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.33% (0.5567 => 0.5326, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.15% (0.5688 => 0.5452, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.05% (0.9077 => 0.8709, std.dev.: 0.0025) MultiSource/Applications/hbd/hbd: -3.72% (1.5610 => 1.5030, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -2.01% (20.7746 => 20.3566, std.dev.: 0.0137) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7569, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: -8.61% (1.2842 => 1.1736, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.85% (2.2633 => 2.1761, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.59% (1.3096 => 1.2757, std.dev.: 0.0072) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4686, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 6 10:41:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 6 Nov 2012 12:41:04 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121106184104.122FA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5629?compare_to=5627&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5629, Order: 167465, Start Time: 2012-11-06 17:15:17, End Time: 2012-11-06 18:41:13 To: 5627, Order: 167460, Start Time: 2012-11-06 15:31:56, End Time: 2012-11-06 16:58:11 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 13 (116 on baseline) Performance Improvements: 4 (26 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 974 (832 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.80% (0.3331 => 0.3491, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/05-eks/eks: 2.40% (0.4465 => 0.4572, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.56% (0.9129 => 0.9271, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.32% (4.5736 => 4.6340, std.dev.: 0.0092) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.21% (0.3351 => 0.3492, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.57% (2.7030 => 2.7726, std.dev.: 0.0107) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.66% (14.5237 => 14.7644, std.dev.: 0.0464) SingleSource/Benchmarks/Shootout-C++/ary3: 1.52% (1.9980 => 2.0283, std.dev.: 0.0113) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.36% (2.4420 => 2.4752, std.dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.11% (1.1478 => 1.1605, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.09% (4.9065 => 4.9599, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.02% (1.2446 => 1.2573, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/fp-convert: 1.01% (15.7366 => 15.8958, std.dev.: 0.0331) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.48% (0.8894 => 0.8673, std.dev.: 0.0070) MultiSource/Applications/treecc/treecc: -1.64% (2.0624 => 2.0285, std.dev.: 0.0112) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -8.82% (7.3614 => 6.7120, std.dev.: 0.0663) SingleSource/Benchmarks/Misc/ffbench: -2.20% (1.4384 => 1.4068, std.dev.: 0.0117) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.18% (16.7394 => 16.7698, std.dev.: 0.0234) MultiSource/Applications/obsequi/Obsequi: 1.98% (1.0514 => 1.0722, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.01% (21.6670 => 21.6693, std.dev.: 0.2920) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.27% (0.3646 => 0.3636, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 0.32% (0.6026 => 0.6045, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.30% (0.3313 => 0.3323, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/strcat: 0.50% (0.1997 => 0.2007, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.92% (0.0218 => 0.0216, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0423 => 0.0423, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.60% (0.0333 => 0.0331, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.89% (0.0318 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -6.94% (0.0418 => 0.0389, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/casts: -0.98% (0.0204 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -23.04% (0.0191 => 0.0147, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1429 => 0.1430, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.12% (1.1633 => 1.1763, std.dev.: 0.0141) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.57% (0.1532 => 0.1462, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.59% (0.4208 => 0.4141, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.42% (0.1445 => 0.1451, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.94% (0.0640 => 0.0602, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.74% (0.0264 => 0.0233, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.01% (0.0632 => 0.0613, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.37% (1.1979 => 1.1935, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -95.24% (0.0021 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.58% (0.0615 => 0.0593, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.94% (0.0206 => 0.0202, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.01% (0.7800 => 0.7799, std.dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -15.49% (0.0071 => 0.0060, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2317.88% (0.6332 => 15.3100, std.dev.: 0.0635) MultiSource/Benchmarks/McCat/08-main/main: 48.61% (0.1831 => 0.2721, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.57% (0.1559 => 0.1441, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1492.40% (0.3344 => 5.3250, std.dev.: 0.0470) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.41% (0.2364 => 0.3201, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: 2.80% (0.0429 => 0.0441, std.dev.: 0.0019) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -28.57% (0.0224 => 0.0160, std.dev.: 0.0032) SingleSource/UnitTests/byval-alignment: -32.17% (0.0230 => 0.0156, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4167, std.dev.: 0.0211) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0688, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4950, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3572, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1398, std.dev.: 0.0436) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4016, std.dev.: 0.0040) SingleSource/Regression/C/uint64_to_float: -24.30% (2.1832 => 1.6526, std.dev.: 0.0042) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.44% (0.0810 => 0.0927, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.65% (0.0830 => 0.0935, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.07% (0.2180 => 0.2356, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.85% (0.7473 => 0.7985, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.04% (0.1905 => 0.2020, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.95% (0.3295 => 0.3491, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.84% (0.2519 => 0.2666, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.64% (0.3137 => 0.3314, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.44% (1.1606 => 1.2237, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.30% (0.6287 => 0.6620, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.16% (0.3003 => 0.3158, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.14% (0.2998 => 0.3152, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.54% (0.8148 => 0.8518, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.38% (0.5817 => 0.6072, std.dev.: 0.0086) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.33% (0.2378 => 0.2481, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.30% (1.1685 => 1.2188, std.dev.: 0.0068) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.23% (0.8321 => 0.8673, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.13% (0.5961 => 0.6207, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/05-eks/eks: 3.98% (0.4397 => 0.4572, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.92% (0.9435 => 0.9805, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.90% (0.4127 => 0.4288, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.81% (0.4783 => 0.4965, std.dev.: 0.0033) MultiSource/Applications/spiff/spiff: 3.60% (0.7950 => 0.8236, std.dev.: 0.0035) MultiSource/Applications/Burg/burg: 3.41% (1.2222 => 1.2639, std.dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.33% (6.6074 => 6.8277, std.dev.: 0.0253) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.25% (4.4880 => 4.6340, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.07% (0.8995 => 0.9271, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.99% (0.9074 => 0.9345, std.dev.: 0.0068) MultiSource/Applications/ClamAV/clamscan: 2.84% (14.7684 => 15.1873, std.dev.: 0.0768) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.83% (4.1763 => 4.2945, std.dev.: 0.0347) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.81% (8.6476 => 8.8905, std.dev.: 0.0329) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.74% (0.8204 => 0.8429, std.dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 2.74% (1.1271 => 1.1580, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.74% (0.8317 => 0.8545, std.dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 2.73% (1.2568 => 1.2911, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.68% (0.8597 => 0.8827, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.65% (0.4559 => 0.4680, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 2.63% (4.1305 => 4.2393, std.dev.: 0.0332) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.62% (0.8050 => 0.8261, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.61% (0.9688 => 0.9941, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.59% (0.8518 => 0.8739, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.59% (0.8007 => 0.8214, std.dev.: 0.0050) MultiSource/Applications/SPASS/SPASS: 2.58% (14.2605 => 14.6285, std.dev.: 0.0331) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.58% (0.8697 => 0.8921, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.58% (1.3279 => 1.3621, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.53% (0.7932 => 0.8133, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.49% (0.8177 => 0.8381, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.48% (0.8457 => 0.8667, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 2.46% (3.8189 => 3.9128, std.dev.: 0.0218) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.39% (0.8359 => 0.8559, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.35% (0.8712 => 0.8917, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.35% (0.8331 => 0.8527, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (0.8656 => 0.8859, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.31% (0.9908 => 1.0137, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.30% (0.8420 => 0.8614, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.30% (0.8316 => 0.8507, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.24% (0.8069 => 0.8250, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.20% (0.8286 => 0.8468, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.18% (4.5702 => 4.6697, std.dev.: 0.0226) MultiSource/Applications/JM/ldecod/ldecod: 2.16% (6.7320 => 6.8773, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.15% (1.6386 => 1.6739, std.dev.: 0.0136) MultiSource/Applications/JM/lencod/lencod: 2.14% (15.3280 => 15.6564, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.12% (0.8716 => 0.8901, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.10% (0.8805 => 0.8990, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.09% (0.9039 => 0.9228, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.09% (0.8048 => 0.8216, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.09% (0.8338 => 0.8512, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.07% (2.1401 => 2.1845, std.dev.: 0.0171) MultiSource/Benchmarks/PAQ8p/paq8p: 2.04% (2.3764 => 2.4248, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/football/football: 2.03% (0.8768 => 0.8946, std.dev.: 0.0064) MultiSource/Applications/minisat/minisat: 2.02% (0.6834 => 0.6972, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.98% (0.8885 => 0.9061, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 1.93% (2.2184 => 2.2613, std.dev.: 0.0050) MultiSource/Benchmarks/Bullet/bullet: 1.91% (31.8598 => 32.4684, std.dev.: 0.0475) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.85% (1.2526 => 1.2758, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.82% (0.7966 => 0.8111, std.dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: 1.79% (4.9628 => 5.0516, std.dev.: 0.0096) MultiSource/Applications/d/make_dparser: 1.72% (3.2366 => 3.2924, std.dev.: 0.0152) MultiSource/Applications/treecc/treecc: 1.69% (1.9948 => 2.0285, std.dev.: 0.0112) MultiSource/Benchmarks/mafft/pairlocalalign: 1.59% (8.6247 => 8.7622, std.dev.: 0.0203) MultiSource/Applications/lemon/lemon: 1.45% (1.0945 => 1.1104, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 120.10% (0.0199 => 0.0438, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/pi: 57.52% (1.5795 => 2.4881, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.61% (0.7597 => 0.8859, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.39% (2.9753 => 3.4629, std.dev.: 0.0328) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.75% (2.7995 => 3.2124, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.62% (5.0261 => 5.6103, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.60% (0.3186 => 0.3492, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 7.48% (1.7056 => 1.8331, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.42% (1.1857 => 1.2737, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.64% (4.7794 => 5.0966, std.dev.: 0.0045) MultiSource/Applications/SIBsim4/SIBsim4: 6.48% (3.1873 => 3.3939, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.93% (4.9686 => 5.2630, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/richards_benchmark: 5.81% (1.3037 => 1.3795, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.81% (4.5327 => 4.7961, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.25% (6.3772 => 6.7120, std.dev.: 0.0663) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.72% (3.3761 => 3.5354, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.33% (4.9453 => 5.1596, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.18% (6.2275 => 6.4880, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.11% (4.9469 => 5.1500, std.dev.: 0.0093) MultiSource/Applications/hexxagon/hexxagon: 3.91% (14.0064 => 14.5546, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.42% (2.2485 => 2.3255, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.03% (11.5690 => 11.9197, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.74% (4.8660 => 4.9993, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.66% (8.2783 => 8.4987, std.dev.: 0.0244) MultiSource/Applications/siod/siod: 2.63% (3.6643 => 3.7608, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 2.63% (7.4933 => 7.6903, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.56% (4.8362 => 4.9599, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout/lists: 2.47% (7.3375 => 7.5184, std.dev.: 0.0173) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.28% (4.3552 => 4.4547, std.dev.: 0.0271) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.11% (1.1365 => 1.1605, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.73% (2.4647 => 2.5074, std.dev.: 0.0134) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.72% (2.4333 => 2.4752, std.dev.: 0.0083) SingleSource/Benchmarks/Stanford/FloatMM: 1.53% (0.8807 => 0.8942, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 1.26% (8.5322 => 8.6398, std.dev.: 0.0156) MultiSource/Benchmarks/Olden/power/power: 1.17% (1.2061 => 1.2202, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.00% (5.4641 => 4.3168, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.05% (7.2130 => 6.3441, std.dev.: 0.1138) SingleSource/Benchmarks/McGill/chomp: -11.20% (1.1216 => 0.9960, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.06% (1.0512 => 0.9349, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: -8.57% (63.1822 => 57.7678, std.dev.: 0.0422) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.89% (0.3269 => 0.3011, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -7.01% (4.7482 => 4.4155, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.97% (3.7148 => 3.4930, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.96% (5.4972 => 5.1697, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.07% (5.1557 => 4.8943, std.dev.: 0.0105) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.58% (2.8773 => 2.7454, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.38% (4.7449 => 4.5370, std.dev.: 0.0271) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.91% (2.4490 => 2.3533, std.dev.: 0.0330) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.66% (6.0224 => 5.8017, std.dev.: 0.0295) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (28.5821 => 27.6657, std.dev.: 0.0723) MultiSource/Applications/lua/lua: -3.00% (29.8330 => 28.9380, std.dev.: 0.0546) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.93% (2.6356 => 2.5584, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.82% (0.5807 => 0.5643, std.dev.: 0.0031) MultiSource/Applications/aha/aha: -2.43% (3.3398 => 3.2585, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.09% (11.5316 => 11.2901, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.92% (9.9065 => 9.7162, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/hash2: -1.64% (3.4237 => 3.3674, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.63% (3.2169 => 3.1646, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.58% (4.9994 => 4.9203, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.38% (2.3487 => 2.3163, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.21% (5.6343 => 5.5661, std.dev.: 0.0257) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.97% (16.4461 => 16.7698, std.dev.: 0.0234) MultiSource/Applications/obsequi/Obsequi: 4.48% (1.0262 => 1.0722, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6838.62% (0.3123 => 21.6693, std.dev.: 0.2920) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.62% (0.2463 => 0.3636, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 0.58% (0.6010 => 0.6045, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.75% (0.3266 => 0.3323, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/strcat: 1.93% (0.1969 => 0.2007, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 75.61% (0.0123 => 0.0216, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.68% (0.0408 => 0.0423, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.30% (0.0384 => 0.0389, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -18.33% (0.0180 => 0.0147, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.56% (0.1438 => 0.1430, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 3.83% (1.1329 => 1.1763, std.dev.: 0.0141) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: - (0.1462 => 0.1462, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.55% (0.4164 => 0.4141, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.99% (0.1369 => 0.1451, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.08% (0.0641 => 0.0602, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 19.49% (0.0195 => 0.0233, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.06% (0.0578 => 0.0613, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.35% (1.1437 => 1.1935, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -7.14% (0.0014 => 0.0013, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.42% (0.0627 => 0.0593, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 12.22% (0.0180 => 0.0202, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.72% (0.8017 => 0.7799, std.dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -3.23% (0.0062 => 0.0060, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 6 10:51:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 6 Nov 2012 12:51:06 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121106185106.502362A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5630?compare_to=5628&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5630, Order: 167465, Start Time: 2012-11-06 17:25:51, End Time: 2012-11-06 18:51:12 To: 5628, Order: 167460, Start Time: 2012-11-06 15:37:45, End Time: 2012-11-06 17:02:49 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (5 on baseline) Performance Improvements: 0 (177 on baseline) Unchanged Tests: 1040 (860 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.72% (54.5859 => 56.0697, std.dev.: 0.3280) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.21% (42.1249 => 43.0572, std.dev.: 0.0140) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.30% (1.2783 => 1.3716, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.36% (2.0478 => 2.1167, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.74% (54.5751 => 56.0697, std.dev.: 0.3280) SingleSource/Benchmarks/Misc/salsa20: 2.48% (7.4937 => 7.6792, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/hash2: 1.89% (3.1932 => 3.2534, std.dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.98% (0.3821 => 0.3516, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -7.19% (2.4924 => 2.3131, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.68% (0.3142 => 0.2932, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.38% (0.2428 => 0.2273, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.28% (0.9542 => 0.8943, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.22% (0.3891 => 0.3649, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.21% (3.5339 => 3.3146, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/for-in: -6.20% (0.4033 => 0.3783, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.19% (0.3848 => 0.3610, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.12% (0.3658 => 0.3434, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: -6.11% (0.3812 => 0.3579, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -6.11% (0.3896 => 0.3658, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.11% (0.3831 => 0.3597, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.11% (0.3357 => 0.3152, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.08% (0.3884 => 0.3648, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.07% (22.4056 => 21.0454, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions: -6.06% (0.4176 => 0.3923, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.06% (0.3880 => 0.3645, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -6.02% (7.0961 => 6.6690, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.01% (0.6484 => 0.6094, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: -6.01% (16.1920 => 15.2188, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.97% (1.0544 => 0.9914, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/oourafft: -5.97% (0.2160 => 0.2031, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.90% (0.2355 => 0.2216, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.90% (0.9852 => 0.9271, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.88% (0.4199 => 0.3952) MultiSource/Benchmarks/mafft/pairlocalalign: -5.87% (9.2283 => 8.6868, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.82% (1.2784 => 1.2040, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.81% (1.6364 => 1.5414, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/parameter-passing: -5.79% (0.4280 => 0.4032, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: -5.78% (0.9179 => 0.8648, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -5.77% (4.3330 => 4.0829, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.76% (1.3722 => 1.2931, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.75% (1.6474 => 1.5526, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -5.75% (0.1879 => 0.1771, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.72% (1.4642 => 1.3805, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: -5.71% (1.2515 => 1.1800, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.69% (0.6293 => 0.5935, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.67% (1.2300 => 1.1602, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.66% (4.0323 => 3.8041, std.dev.: 0.0132) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.64% (4.5069 => 4.2526, std.dev.: 0.0118) MultiSource/Applications/lemon/lemon: -5.63% (1.1450 => 1.0805, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.61% (14.2083 => 13.4114, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/bh/bh: -5.59% (0.2985 => 0.2818, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.59% (4.8161 => 4.5469, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: -5.58% (0.3406 => 0.3216, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -5.58% (1.1530 => 1.0887, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.56% (0.7919 => 0.7479, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.54% (0.3483 => 0.3290, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.53% (0.2695 => 0.2546, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.49% (4.8802 => 4.6121, std.dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: -5.49% (17.1032 => 16.1637, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.49% (0.4151 => 0.3923, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.46% (0.2548 => 0.2409, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: -5.45% (0.2659 => 0.2514, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.45% (0.6736 => 0.6369, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash2: -5.37% (0.4861 => 0.4600, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.37% (0.5999 => 0.5677, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: -5.36% (15.5079 => 14.6760, std.dev.: 0.0169) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.35% (0.8521 => 0.8065, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -5.35% (2.4021 => 2.2736, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: -5.31% (1.3148 => 1.2450, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/18-imp/imp: -5.31% (0.3581 => 0.3391, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.30% (6.7716 => 6.4124, std.dev.: 0.0064) MultiSource/Applications/lua/lua: -5.29% (4.0594 => 3.8446, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.20% (0.2999 => 0.2843, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.20% (0.3849 => 0.3649, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -5.19% (0.3446 => 0.3267, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.19% (0.4916 => 0.4661, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -5.17% (3.5154 => 3.3337, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.17% (0.5168 => 0.4901, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.16% (0.7021 => 0.6659, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.15% (5.4682 => 5.1865, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.13% (0.3837 => 0.3640, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: -5.13% (0.3394 => 0.3220, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.11% (0.3931 => 0.3730, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.10% (2.1713 => 2.0606, std.dev.: 0.0111) MultiSource/Benchmarks/Bullet/bullet: -5.09% (34.0927 => 32.3580, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.08% (2.2587 => 2.1440, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.05% (0.5857 => 0.5561, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: -5.05% (0.2989 => 0.2838, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.05% (0.2278 => 0.2163, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -5.02% (0.3025 => 0.2873) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.02% (8.0126 => 7.6100, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/except: -5.02% (0.3026 => 0.2874, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.02% (0.4083 => 0.3878, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: -5.02% (0.2871 => 0.2727, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.99% (0.7198 => 0.6839, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -4.98% (0.7447 => 0.7076, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.97% (1.2210 => 1.1603, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: -4.97% (0.3481 => 0.3308, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -4.96% (1.3864 => 1.3176, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.95% (0.3252 => 0.3091, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -4.95% (0.6750 => 0.6416, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: -4.95% (0.3194 => 0.3036, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -4.95% (0.3255 => 0.3094, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -4.94% (15.2527 => 14.4989, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/random: -4.93% (0.2939 => 0.2794, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.93% (0.9557 => 0.9086, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.93% (0.3491 => 0.3319, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.91% (1.2221 => 1.1621, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.91% (0.3016 => 0.2868, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.90% (0.6304 => 0.5995, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.90% (0.5329 => 0.5068, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.88% (0.3319 => 0.3157, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.88% (0.6230 => 0.5926, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: -4.88% (0.2849 => 0.2710, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.87% (0.6667 => 0.6342, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.86% (0.5591 => 0.5319, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.86% (0.2385 => 0.2269, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.86% (0.6260 => 0.5956, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: -4.85% (2.1401 => 2.0362, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.85% (0.3323 => 0.3162, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.84% (0.5925 => 0.5638, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.84% (0.6446 => 0.6134, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.84% (0.4321 => 0.4112, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: -4.84% (0.3205 => 0.3050, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.82% (0.6052 => 0.5760, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.82% (0.4813 => 0.4581, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.82% (0.5478 => 0.5214, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.81% (0.6194 => 0.5896, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -4.81% (0.3867 => 0.3681, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.81% (0.2933 => 0.2792, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -4.81% (0.4515 => 0.4298, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: -4.80% (0.4248 => 0.4044, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.78% (0.6189 => 0.5893, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.77% (0.7524 => 0.7165, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.77% (0.6440 => 0.6133, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.77% (0.5581 => 0.5315, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.77% (0.5456 => 0.5196, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.76% (0.6297 => 0.5997, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.75% (0.5575 => 0.5310, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.74% (0.5859 => 0.5581, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.74% (0.6395 => 0.6092, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.73% (0.6676 => 0.6360, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: -4.73% (0.4524 => 0.4310, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.73% (0.7339 => 0.6992, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.72% (0.5802 => 0.5528, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.71% (0.6681 => 0.6366, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.71% (0.3057 => 0.2913, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -4.71% (0.3059 => 0.2915, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.68% (0.5705 => 0.5438, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -4.68% (0.6347 => 0.6050, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.67% (0.5863 => 0.5589, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -4.67% (0.3788 => 0.3611, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: -4.67% (0.3621 => 0.3452, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -4.65% (5.0226 => 4.7888, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.65% (0.6660 => 0.6350, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.65% (0.2903 => 0.2768, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.64% (0.6033 => 0.5753, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.64% (0.7779 => 0.7418, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.63% (0.6395 => 0.6099, std.dev.: 0.0040) MultiSource/Applications/kimwitu++/kc: -4.62% (18.2933 => 17.4488, std.dev.: 0.0140) MultiSource/Applications/lambda-0_1_3/lambda: -4.60% (0.7982 => 0.7615, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference-object: -4.60% (0.6441 => 0.6145, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.60% (0.5941 => 0.5668, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.58% (0.5805 => 0.5539, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.58% (0.5570 => 0.5315, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.56% (0.5849 => 0.5582, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -4.56% (0.3271 => 0.3122, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.54% (0.4427 => 0.4226, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.49% (0.5569 => 0.5319, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -4.29% (0.8418 => 0.8057, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.26% (0.5567 => 0.5330, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.19% (0.9077 => 0.8697, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.11% (0.5688 => 0.5454, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -3.68% (1.5610 => 1.5035, std.dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -2.08% (20.7746 => 20.3418, std.dev.: 0.0115) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7562, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1729, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.93% (2.2633 => 2.1744, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.83% (1.7753 => 1.7073, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.96% (1.3096 => 1.2709, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4736, std.dev.: 0.0013) Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 6 11:21:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 6 Nov 2012 13:21:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121106192120.2DFE72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5631?compare_to=5626&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5631, Order: 167460, Start Time: 2012-11-06 16:05:36, End Time: 2012-11-06 19:21:28 To: 5626, Order: 167445, Start Time: 2012-11-06 12:02:07, End Time: 2012-11-06 15:17:41 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (177 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (714 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 1.06% (16.6797 => 16.8558, std.dev.: 0.0132) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.00% (0.0625 => 0.0875, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.17% (0.1063 => 0.1405, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.72% (0.2969 => 0.3792, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.40% (0.1106 => 0.1398, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.59% (0.4139 => 0.5198, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.29% (0.5900 => 0.7392, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.21% (0.0714 => 0.0894, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.84% (0.0475 => 0.0593) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.82% (0.0415 => 0.0518, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.33% (0.4994 => 0.6209, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.31% (0.0547 => 0.0680, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.14% (0.0584 => 0.0725, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.08% (0.4253 => 0.5277, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.98% (0.5000 => 0.6199, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.41% (0.1021 => 0.1260, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.40% (0.1107 => 0.1366, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 23.39% (1.5932 => 1.9658, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.27% (0.1620 => 0.1997, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 23.21% (0.0599 => 0.0738, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.85% (0.0897 => 0.1102, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 22.26% (0.0948 => 0.1159, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.92% (0.0584 => 0.0712, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.67% (0.1103 => 0.1342, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.64% (0.0633 => 0.0770, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.63% (0.0541 => 0.0658, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.62% (0.0495 => 0.0602, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.50% (0.0642 => 0.0780, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.45% (0.3903 => 0.4740, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 21.32% (0.0821 => 0.0996, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.14% (0.1003 => 0.1215, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.11% (0.1549 => 0.1876, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.07% (0.1604 => 0.1942, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 20.94% (0.1619 => 0.1958, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.80% (0.0822 => 0.0993, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 20.70% (0.0604 => 0.0729, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 20.06% (0.0947 => 0.1137, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.84% (0.1462 => 0.1752, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 19.68% (0.0808 => 0.0967, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.36% (0.2014 => 0.2404, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.28% (0.3890 => 0.4640, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 19.06% (0.4029 => 0.4797, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/mst/mst: 19.05% (0.0698 => 0.0831, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 19.05% (0.1218 => 0.1450, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.80% (0.1968 => 0.2338, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: 18.74% (0.1505 => 0.1787, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.64% (0.2736 => 0.3246, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 18.59% (0.0581 => 0.0689, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.53% (0.0572 => 0.0678, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.51% (1.3152 => 1.5587, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.49% (0.2866 => 0.3396, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.47% (0.1088 => 0.1289, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 18.01% (0.5826 => 0.6875, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.98% (0.0573 => 0.0676, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 17.97% (1.8794 => 2.2171, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.97% (0.5026 => 0.5929, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 17.94% (0.5546 => 0.6541, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.85% (3.5627 => 4.1986, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.82% (0.3271 => 0.3854, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.69% (0.4658 => 0.5482, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 17.64% (0.5889 => 0.6928, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.48% (1.6211 => 1.9045, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.33% (0.1160 => 0.1361, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 17.10% (0.1421 => 0.1664, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.95% (2.7292 => 3.1918, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.90% (0.4361 => 0.5098, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 16.69% (0.0605 => 0.0706, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 16.69% (1.0781 => 1.2580, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 16.67% (0.1284 => 0.1498, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.59% (0.3930 => 0.4582, std.dev.: 0.0025) MultiSource/Applications/hbd/hbd: 16.41% (0.9697 => 1.1288, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.13% (4.4195 => 5.1324, std.dev.: 0.0084) MultiSource/Applications/ClamAV/clamscan: 16.11% (4.2109 => 4.8893, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.99% (1.9694 => 2.2843, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.92% (0.2738 => 0.3174, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.88% (1.9966 => 2.3137, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.55% (0.2875 => 0.3322, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 15.35% (0.7171 => 0.8272, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.32% (0.1090 => 0.1257, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 15.04% (0.2566 => 0.2952, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: 15.03% (0.2714 => 0.3122, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 14.98% (0.3465 => 0.3984, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/fibo: 14.97% (0.2725 => 0.3133, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.96% (0.3195 => 0.3673, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 14.96% (1.4269 => 1.6403, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 14.94% (0.2075 => 0.2385, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.88% (0.3488 => 0.4007, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 14.88% (0.2729 => 0.3135, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 14.85% (0.3004 => 0.3450, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 14.84% (0.2750 => 0.3158, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 14.82% (0.9909 => 1.1378, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-3: 14.80% (0.3460 => 0.3972, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 14.79% (23.5202 => 26.9997, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-2: 14.77% (0.3446 => 0.3955, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 14.76% (0.3496 => 0.4012, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.67% (0.3469 => 0.3978, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 14.67% (0.3442 => 0.3947, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 14.63% (0.2803 => 0.3213, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 14.60% (0.2780 => 0.3186, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 14.58% (0.7875 => 0.9023, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 14.58% (0.2813 => 0.3223, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.57% (0.2911 => 0.3335, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 14.55% (0.2811 => 0.3220, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 14.52% (0.2823 => 0.3233, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 14.44% (0.3096 => 0.3543, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.43% (0.2792 => 0.3195, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.42% (2.0673 => 2.3655, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 14.33% (0.3643 => 0.4165, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 14.33% (0.3650 => 0.4173, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 14.10% (0.3724 => 0.4249, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.04% (0.3362 => 0.3834, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 13.99% (0.3267 => 0.3724, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 13.90% (0.3258 => 0.3711, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 13.90% (2.1653 => 2.4663, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 13.82% (2.1013 => 2.3916, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ary2: 13.78% (0.3317 => 0.3774, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.73% (0.3060 => 0.3480, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 13.71% (4.6177 => 5.2509, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.60% (0.3625 => 0.4118, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/lists: 13.56% (0.3348 => 0.3802, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 13.46% (0.0758 => 0.0860, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.44% (0.3124 => 0.3544, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 13.40% (0.3678 => 0.4171, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 13.14% (0.3477 => 0.3934, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.14% (0.2040 => 0.2308, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.13% (0.3282 => 0.3713, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 13.10% (0.4146 => 0.4689, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/hash2: 13.08% (0.4251 => 0.4807, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 13.02% (0.3726 => 0.4211, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.02% (0.1383 => 0.1563, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 12.86% (0.2691 => 0.3037, std.dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.85% (0.3845 => 0.4339, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.82% (0.3690 => 0.4163, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.69% (0.3981 => 0.4486, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 12.42% (5.5417 => 6.2301, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/bigfib: 12.37% (0.5012 => 0.5632, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 11.61% (0.6634 => 0.7404, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 11.61% (0.3498 => 0.3904, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.38% (0.1028 => 0.1145, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.34% (0.6435 => 0.7165, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.64% (0.2068 => 0.2288, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.56% (0.2737 => 0.3026, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 10.50% (0.4847 => 0.5356, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.41% (0.3084 => 0.3405, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 10.25% (0.3336 => 0.3678, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 10.12% (0.2391 => 0.2633, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 9.95% (2.0346 => 2.2371, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.75% (0.2103 => 0.2308, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.80% (0.5361 => 0.5833, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.57% (4.6926 => 5.0948, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.56% (11.6398 => 12.6366, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.18% (0.5584 => 0.6041, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.16% (0.7426 => 0.8032, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 6.45% (11.9555 => 12.7271, std.dev.: 0.0171) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.30% (0.3792 => 0.3993, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 9.56% (0.2802 => 0.3070, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6122, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6751, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 4.66% (15.4430 => 16.1633, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-2: 4.52% (1.8057 => 1.8873, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.22% (0.3693 => 0.3849, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6405, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1979, std.dev.: 0.0079) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.54% (3.1722 => 3.2210, std.dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.46% (2.0820 => 2.1124, std.dev.: 0.0095) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3054, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2865, std.dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5923, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.91% (25.4195 => 16.5443, std.dev.: 0.0198) SingleSource/Benchmarks/Shootout-C++/ary2: -7.79% (0.2402 => 0.2215, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9753, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7967, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8035, std.dev.: 0.0022) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.94% (0.6293 => 0.6108, std.dev.: 0.0059) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8627, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -2.22% (17.2379 => 16.8558, std.dev.: 0.0132) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5748, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4949, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.11% (105.3826 => 104.2106, std.dev.: 0.0597) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0452, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 6 12:25:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 6 Nov 2012 14:25:26 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121106202526.5F6F02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5632?compare_to=5629&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5632, Order: 167472, Start Time: 2012-11-06 18:58:18, End Time: 2012-11-06 20:25:35 To: 5629, Order: 167465, Start Time: 2012-11-06 17:15:17, End Time: 2012-11-06 18:41:13 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 6 (89 on baseline) Performance Improvements: 1 (23 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 984 (862 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/sgefa/sgefa: 5.36% (0.2948 => 0.3106, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.93% (0.8673 => 0.9014, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.36% (0.8901 => 0.9022, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.26% (0.9291 => 0.9408, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.10% (13.4507 => 13.5985, std.dev.: 0.0130) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 4.94% (1.8061 => 1.8954, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.72% (8.3638 => 8.2197, std.dev.: 0.0397) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.48% (16.7698 => 16.6899, std.dev.: 0.3462) MultiSource/Applications/obsequi/Obsequi: -1.66% (1.0722 => 1.0544, std.dev.: 0.0273) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.07% (21.6693 => 21.6843, std.dev.: 0.2203) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.80% (0.3636 => 0.3607, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: -1.01% (0.6045 => 0.5984, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.69% (0.3323 => 0.3300, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: -0.80% (0.2007 => 0.1991, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.46% (0.0216 => 0.0217, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.24% (0.0423 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -15.71% (0.0331 => 0.0279, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0312 => 0.0312, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.23% (0.0389 => 0.0421, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: 0.50% (0.0202 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 36.05% (0.0147 => 0.0200, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1430 => 0.1432, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 1.43% (1.1763 => 1.1931, std.dev.: 0.0177) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.14% (0.1462 => 0.1464, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.29% (0.4141 => 0.4129, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.93% (0.1451 => 0.1423, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.33% (0.0602 => 0.0616, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.44% (0.0233 => 0.0248, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.73% (0.0613 => 0.0584, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.44% (1.1935 => 1.1883, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1900.00% (0.0001 => 0.0020, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 76.92% (0.0013 => 0.0023, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.58% (0.0593 => 0.0554, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 17.33% (0.0202 => 0.0237, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.7799 => 0.7799, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -31.67% (0.0060 => 0.0041, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2313.00% (0.6332 => 15.2791, std.dev.: 0.2024) MultiSource/Benchmarks/McCat/08-main/main: 48.33% (0.1831 => 0.2716, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.97% (0.1559 => 0.1466, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1484.66% (0.3344 => 5.2991, std.dev.: 0.0505) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.04% (0.2364 => 0.3216, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: 3.50% (0.0429 => 0.0444, std.dev.: 0.0008) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0224 => 0.0224, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4194, std.dev.: 0.0418) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0680, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4902, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3428, std.dev.: 0.0471) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1345, std.dev.: 0.0234) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4096, std.dev.: 0.0153) SingleSource/Regression/C/uint64_to_float: -23.63% (2.1832 => 1.6673, std.dev.: 0.0062) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.57% (0.0810 => 0.0928, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: 10.97% (0.1112 => 0.1234, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.33% (0.8321 => 0.9014, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.37% (0.2279 => 0.2447, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.95% (0.1983 => 0.2101, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.67% (0.1905 => 0.2013, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.07% (0.2998 => 0.3150, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.3137 => 0.3291, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 4.61% (0.8007 => 0.8376, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.36% (1.1606 => 1.2112, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.30% (1.1685 => 1.2188, std.dev.: 0.0027) MultiSource/Applications/spiff/spiff: 4.16% (0.7950 => 0.8281, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.14% (0.8885 => 0.9253, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.93% (0.8316 => 0.8643, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.89% (0.9056 => 0.9408, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.81% (0.9688 => 1.0057, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.76% (0.8261 => 0.8572, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.69% (0.8697 => 0.9018, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: 3.65% (1.2222 => 1.2668, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.61% (0.5817 => 0.6027, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.54% (0.9039 => 0.9359, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.51% (0.8716 => 0.9022, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.38% (0.8611 => 0.8902, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.37% (0.4127 => 0.4266, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.33% (0.8066 => 0.8335, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.33% (0.8050 => 0.8318, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.23% (0.8338 => 0.8607, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.22% (6.6074 => 6.8199, std.dev.: 0.0200) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.17% (13.1811 => 13.5985, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.15% (0.9074 => 0.9360, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/gs/gs: 3.01% (4.1305 => 4.2548, std.dev.: 0.0434) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.99% (4.4873 => 4.6214, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.97% (0.8656 => 0.8913, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.94% (0.8712 => 0.8968, std.dev.: 0.0064) MultiSource/Applications/JM/ldecod/ldecod: 2.94% (6.7320 => 6.9298, std.dev.: 0.0154) MultiSource/Applications/ClamAV/clamscan: 2.88% (14.7684 => 15.1941, std.dev.: 0.0575) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.85% (0.8805 => 0.9056, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 2.84% (0.6834 => 0.7028, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.84% (4.1763 => 4.2948, std.dev.: 0.0374) MultiSource/Applications/treecc/treecc: 2.70% (1.9948 => 2.0486, std.dev.: 0.0199) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.66% (1.3279 => 1.3632, std.dev.: 0.0106) MultiSource/Applications/JM/lencod/lencod: 2.61% (15.3280 => 15.7288, std.dev.: 0.0670) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.57% (0.4559 => 0.4676, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.46% (0.8995 => 0.9216, std.dev.: 0.0055) MultiSource/Applications/SPASS/SPASS: 2.45% (14.2605 => 14.6093, std.dev.: 0.0804) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.42% (0.8317 => 0.8518, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.29% (0.8927 => 0.9131, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.15% (0.8086 => 0.8260, std.dev.: 0.0067) MultiSource/Applications/d/make_dparser: 2.11% (3.2366 => 3.3050, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.06% (0.5191 => 0.5298, std.dev.: 0.0024) MultiSource/Applications/lua/lua: 1.98% (3.8189 => 3.8946, std.dev.: 0.0244) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.96% (1.2423 => 1.2667, std.dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: 1.86% (31.8598 => 32.4509, std.dev.: 0.1198) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.74% (0.6943 => 0.7064, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.64% (1.4479 => 1.4717, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.64% (2.1401 => 2.1751, std.dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 90.95% (0.0199 => 0.0380, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/pi: 58.08% (1.5795 => 2.4968, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.05% (0.7597 => 0.8892, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.39% (2.9753 => 3.4629, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.51% (2.7995 => 3.2057, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.67% (5.0261 => 5.6124, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.67% (0.3186 => 0.3494, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.15% (1.1857 => 1.2823, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 7.42% (1.7056 => 1.8322, std.dev.: 0.0103) MultiSource/Applications/SIBsim4/SIBsim4: 6.96% (3.1873 => 3.4091, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.90% (4.7794 => 5.1094, std.dev.: 0.0210) SingleSource/Benchmarks/Misc/richards_benchmark: 6.42% (1.3037 => 1.3874, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.01% (4.5327 => 4.8050, std.dev.: 0.0258) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.94% (4.9686 => 5.2635, std.dev.: 0.0409) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.99% (3.3761 => 3.5444, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.35% (6.2275 => 6.4982, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.16% (4.9453 => 5.1510, std.dev.: 0.0311) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.12% (4.9469 => 5.1509, std.dev.: 0.0579) MultiSource/Applications/hexxagon/hexxagon: 3.96% (14.0064 => 14.5607, std.dev.: 0.0204) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.14% (11.5690 => 11.9322, std.dev.: 0.0277) MultiSource/Applications/siod/siod: 2.98% (3.6643 => 3.7734, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.96% (4.3552 => 4.4843, std.dev.: 0.0209) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.93% (0.3587 => 0.3692, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 2.66% (7.4933 => 7.6927, std.dev.: 0.0289) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.48% (8.2783 => 8.4838, std.dev.: 0.0169) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.30% (2.4647 => 2.5215, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: 2.27% (7.3375 => 7.5038, std.dev.: 0.0272) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.99% (4.8362 => 4.9325, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/hash: 1.64% (0.6205 => 0.6307, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.61% (3.9006 => 3.9634, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.30% (4.4340 => 4.4916, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/power/power: 1.08% (1.2061 => 1.2191, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.01% (3.5679 => 3.6038, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.35% (8.4179 => 8.2197, std.dev.: 0.0397) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.94% (5.4641 => 4.3201, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.29% (7.2130 => 6.1826, std.dev.: 0.2400) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.89% (1.0512 => 0.9367, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: -8.46% (63.1822 => 57.8374, std.dev.: 0.0758) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.89% (4.7482 => 4.4211, std.dev.: 0.0237) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.39% (0.3269 => 0.3060, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.94% (3.7148 => 3.4943, std.dev.: 0.0366) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.89% (5.4972 => 5.1735, std.dev.: 0.0469) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.09% (5.1557 => 4.8933, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.88% (2.8773 => 2.7368, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.35% (4.7449 => 4.5384, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.74% (6.0224 => 5.7974, std.dev.: 0.0722) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.16% (2.4490 => 2.3717, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.05% (0.5807 => 0.5630, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.99% (28.5821 => 27.7269, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.28% (2.6356 => 2.5755, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.91% (11.5316 => 11.3109, std.dev.: 0.0168) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.78% (3.2169 => 3.1596, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.56% (4.9994 => 4.9214, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/hash2: -1.43% (3.4237 => 3.3747, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.22% (5.6343 => 5.5658, std.dev.: 0.0158) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.08% (2.3487 => 2.3234, std.dev.: 0.0089) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.48% (16.4461 => 16.6899, std.dev.: 0.3462) MultiSource/Applications/obsequi/Obsequi: 2.75% (1.0262 => 1.0544, std.dev.: 0.0273) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6843.42% (0.3123 => 21.6843, std.dev.: 0.2203) SingleSource/Benchmarks/CoyoteBench/fftbench: 46.45% (0.2463 => 0.3607, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: -0.43% (0.6010 => 0.5984, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.04% (0.3266 => 0.3300, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: 1.12% (0.1969 => 0.1991, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 9.84% (0.0254 => 0.0279, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.64% (0.0384 => 0.0421, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 11.11% (0.0180 => 0.0200, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.42% (0.1438 => 0.1432, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 5.31% (1.1329 => 1.1931, std.dev.: 0.0177) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.14% (0.1462 => 0.1464, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.84% (0.4164 => 0.4129, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.94% (0.1369 => 0.1423, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.90% (0.0641 => 0.0616, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 27.18% (0.0195 => 0.0248, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.04% (0.0578 => 0.0584, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.90% (1.1437 => 1.1883, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1900.00% (0.0001 => 0.0020, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 64.29% (0.0014 => 0.0023, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.64% (0.0627 => 0.0554, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.67% (0.0180 => 0.0237, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.72% (0.8017 => 0.7799, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -33.87% (0.0062 => 0.0041, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 6 12:39:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 6 Nov 2012 14:39:56 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121106203956.8F7D02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5633?compare_to=5630&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5633, Order: 167472, Start Time: 2012-11-06 19:14:29, End Time: 2012-11-06 20:39:21 To: 5630, Order: 167465, Start Time: 2012-11-06 17:25:51, End Time: 2012-11-06 18:51:12 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 2 (179 on baseline) Unchanged Tests: 1039 (859 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.56% (28.0565 => 29.6153, std.dev.: 0.0899) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.12% (20.3418 => 20.1131, std.dev.: 0.0458) MultiSource/Applications/kimwitu++/kc: -1.02% (17.4488 => 17.2701, std.dev.: 0.0086) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1013, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/salsa20: 2.53% (7.4937 => 7.6835, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash2: 2.28% (3.1932 => 3.2659, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.09% (0.3821 => 0.3512, std.dev.: 0.0044) MultiSource/Benchmarks/PAQ8p/paq8p: -7.54% (2.4924 => 2.3044, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.13% (0.3142 => 0.2918, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.89% (0.9542 => 0.8885, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.82% (0.3357 => 0.3128, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.80% (0.2428 => 0.2263, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.76% (22.4056 => 20.8900, std.dev.: 0.0209) SingleSource/Benchmarks/Misc/oourafft: -6.76% (0.2160 => 0.2014, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.71% (3.5339 => 3.2967, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.70% (0.3658 => 0.3413, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.57% (0.1584 => 0.1480, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.56% (0.9852 => 0.9206, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -6.52% (7.0961 => 6.6333, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: -6.52% (4.3330 => 4.0505, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.50% (1.0544 => 0.9859, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -6.47% (9.2283 => 8.6311, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: -6.47% (16.1920 => 15.1448, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.46% (0.6484 => 0.6065, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -6.42% (1.2515 => 1.1712, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.41% (0.1716 => 0.1606, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: -6.36% (0.2659 => 0.2490, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.33% (0.7919 => 0.7418, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.32% (1.3722 => 1.2855, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -6.30% (1.1450 => 1.0729, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.28% (0.2355 => 0.2207, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.26% (1.6474 => 1.5443, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.26% (1.2784 => 1.1984, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: -6.25% (0.1761 => 0.1651, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.24% (1.2300 => 1.1533, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.24% (1.4642 => 1.3729, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -6.20% (0.2985 => 0.2800, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.20% (0.6293 => 0.5903, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.19% (0.4151 => 0.3894, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.19% (1.6364 => 1.5351, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -6.17% (0.3406 => 0.3196, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -6.14% (2.4021 => 2.2546, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.14% (4.0323 => 3.7849, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash2: -6.13% (0.4861 => 0.4563, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.09% (0.6736 => 0.6326, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.08% (0.2548 => 0.2393, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -6.08% (0.9179 => 0.8621, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.06% (4.8161 => 4.5243, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.03% (0.3483 => 0.3273, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.01% (0.5857 => 0.5505, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -6.00% (1.3148 => 1.2359, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.97% (0.2695 => 0.2534, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -5.97% (4.0594 => 3.8172, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.96% (5.4682 => 5.1422, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.95% (4.5069 => 4.2386, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.95% (4.8802 => 4.5898, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: -5.92% (0.3581 => 0.3369, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.92% (0.6304 => 0.5931, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.92% (6.7716 => 6.3710, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.91% (2.1713 => 2.0429, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.91% (0.6230 => 0.5862, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: -5.89% (0.3194 => 0.3006, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.88% (14.2083 => 13.3723, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.88% (0.5168 => 0.4864, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -5.88% (0.4524 => 0.4258, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: -5.86% (0.3481 => 0.3277, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -5.85% (0.7447 => 0.7011, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: -5.85% (0.4515 => 0.4251, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.85% (0.3849 => 0.3624, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -5.84% (15.5079 => 14.6017, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.83% (0.8521 => 0.8024, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.83% (0.6297 => 0.5930, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: -5.82% (0.3025 => 0.2849, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.81% (0.7524 => 0.7087, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -5.80% (0.3621 => 0.3411, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (0.7021 => 0.6614, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.79% (0.5925 => 0.5582, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.79% (0.6446 => 0.6073, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -5.79% (17.1032 => 16.1137, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.78% (0.6260 => 0.5898, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.78% (0.3255 => 0.3067, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.77% (0.6667 => 0.6282, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: -5.77% (0.4248 => 0.4003, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.76% (0.6194 => 0.5837, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.76% (0.5591 => 0.5269, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.76% (0.5575 => 0.5254, std.dev.: 0.0049) SingleSource/Regression/C++/ofstream_ctor: -5.75% (0.3059 => 0.2883, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.75% (0.5859 => 0.5522, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.75% (0.3252 => 0.3065, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.74% (0.4916 => 0.4634, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.73% (0.3837 => 0.3617, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: -5.72% (1.1530 => 1.0870, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.71% (0.5478 => 0.5165, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.71% (0.6395 => 0.6030, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.71% (0.2278 => 0.2148, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.70% (0.5329 => 0.5025, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.69% (0.9557 => 0.9013, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -5.68% (0.3026 => 0.2854, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.68% (0.4083 => 0.3851, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.68% (0.6660 => 0.6282, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.67% (0.3491 => 0.3293, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.67% (0.2999 => 0.2829, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.66% (0.5863 => 0.5531, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.66% (0.5581 => 0.5265, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: -5.65% (0.4033 => 0.3805, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/fibo: -5.64% (0.2871 => 0.2709, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: -5.64% (1.3864 => 1.3082, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.64% (0.3016 => 0.2846, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.64% (0.5802 => 0.5475, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.63% (0.3891 => 0.3672, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.63% (0.4176 => 0.3941, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.62% (0.5849 => 0.5520, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.62% (0.6440 => 0.6078, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.62% (0.5805 => 0.5479, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -5.61% (0.2939 => 0.2774, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.61% (0.6681 => 0.6306, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.60% (2.2587 => 2.1322, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.60% (0.7339 => 0.6928, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.59% (0.3057 => 0.2886, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: -5.59% (18.2933 => 17.2701, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.59% (0.5705 => 0.5386, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.59% (0.3812 => 0.3599, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.57% (0.6189 => 0.5844, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.57% (0.3319 => 0.3134, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/property: -5.57% (0.4199 => 0.3965, std.dev.: 0.0090) SingleSource/UnitTests/ObjC/synchronized: -5.57% (0.3896 => 0.3679, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -5.56% (0.3848 => 0.3634, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.56% (0.6676 => 0.6305, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.55% (0.6033 => 0.5698, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: -5.55% (3.5154 => 3.3202, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.55% (0.6395 => 0.6040, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.55% (0.5999 => 0.5666, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.55% (0.4813 => 0.4546, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.54% (0.3880 => 0.3665, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.54% (0.5456 => 0.5154, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -5.53% (34.0927 => 32.2062, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.52% (0.5941 => 0.5613, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.52% (0.7198 => 0.6801, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hello: -5.51% (0.2849 => 0.2692, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.51% (0.4321 => 0.4083, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.49% (0.5570 => 0.5264, std.dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: -5.49% (0.7982 => 0.7544, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/strcat: -5.49% (0.2989 => 0.2825, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: -5.49% (2.1401 => 2.0227, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.48% (0.3884 => 0.3671, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -5.48% (0.3831 => 0.3621, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.48% (0.2903 => 0.2744, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: -5.46% (0.3205 => 0.3030, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -5.46% (0.3867 => 0.3656, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -5.46% (0.3446 => 0.3258, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.45% (0.2385 => 0.2255, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -5.44% (0.4280 => 0.4047, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.44% (0.4427 => 0.4186, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.42% (0.2933 => 0.2774, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.42% (0.3931 => 0.3718, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.41% (0.2106 => 0.1992, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.40% (0.5569 => 0.5268, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.40% (8.0126 => 7.5802, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary: -5.39% (0.3394 => 0.3211, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.37% (1.2221 => 1.1565, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -5.36% (0.6750 => 0.6388, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: -5.35% (0.3271 => 0.3096, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: -5.33% (0.3788 => 0.3586, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.32% (0.5567 => 0.5271, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.29% (1.2210 => 1.1564, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.26% (0.5688 => 0.5389, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: -5.17% (5.0226 => 4.7629, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -5.13% (15.2527 => 14.4707, std.dev.: 0.0087) MultiSource/Applications/spiff/spiff: -5.10% (0.8418 => 0.7989, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.09% (0.3323 => 0.3154) SingleSource/UnitTests/ObjC++/property-reference: -4.68% (0.7779 => 0.7415, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.41% (0.9077 => 0.8677, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference-object: -4.36% (0.6441 => 0.6160, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.33% (0.6347 => 0.6072, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: -4.33% (1.5610 => 1.4934, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -3.18% (20.7746 => 20.1131, std.dev.: 0.0458) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7499, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1728, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.93% (1.7753 => 1.7056, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.91% (2.2633 => 2.1747, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.97% (1.3096 => 1.2838, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.50% (6.5735 => 6.4751, std.dev.: 0.0007) Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 6 14:10:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 6 Nov 2012 16:10:06 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121106221006.E71062A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5634?compare_to=5632&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5634, Order: 167484, Start Time: 2012-11-06 20:43:03, End Time: 2012-11-06 22:10:14 To: 5632, Order: 167472, Start Time: 2012-11-06 18:58:18, End Time: 2012-11-06 20:25:35 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 9 (109 on baseline) Performance Improvements: 6 (21 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 976 (844 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.58% (0.4947 => 0.5223, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.43% (0.6248 => 0.6587, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.87% (0.3359 => 0.3489, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: 3.62% (8.2197 => 8.5175, std.dev.: 0.0782) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.14% (0.7760 => 0.8004, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.57% (0.6468 => 0.6634, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.24% (4.6263 => 4.6837, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.03% (1.6771 => 1.6944, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/ffbench: 1.72% (1.3845 => 1.4083, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -2.08% (0.9253 => 0.9061, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -2.04% (0.8376 => 0.8205, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.66% (0.8572 => 0.8430, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.41% (0.8640 => 0.8518, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -3.50% (3.8585 => 3.7234, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: -1.02% (1.0084 => 0.9981, std.dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.32% (16.6899 => 16.6364, std.dev.: 0.2779) MultiSource/Applications/obsequi/Obsequi: 1.01% (1.0544 => 1.0650, std.dev.: 0.0105) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.38% (21.6843 => 21.6023, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.64% (0.3607 => 0.3630, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/bigfib: 0.42% (0.5984 => 0.6009, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.55% (0.3300 => 0.3318, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 0.55% (0.1991 => 0.2002, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.46% (0.0217 => 0.0218, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.94% (0.0424 => 0.0428, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 18.28% (0.0279 => 0.0330, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0312 => 0.0313, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.48% (0.0421 => 0.0423, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -18.23% (0.0203 => 0.0166, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/test1: 8.50% (0.0200 => 0.0217, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.35% (0.1432 => 0.1427, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -3.77% (1.1931 => 1.1481, std.dev.: 0.0292) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.48% (0.1464 => 0.1515, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.17% (0.4129 => 0.4122, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.69% (0.1423 => 0.1399, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.01% (0.0616 => 0.0653, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.47% (0.0248 => 0.0269, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.77% (0.0584 => 0.0606, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.75% (1.1883 => 1.1972, std.dev.: 0.0317) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 55.00% (0.0020 => 0.0031, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 13.04% (0.0023 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 15.52% (0.0554 => 0.0640, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0237 => 0.0237, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.42% (0.7799 => 0.7832, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 70.73% (0.0041 => 0.0070, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2308.91% (0.6332 => 15.2532, std.dev.: 0.2895) MultiSource/Benchmarks/McCat/08-main/main: 47.57% (0.1831 => 0.2702, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.16% (0.1559 => 0.1463, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1481.88% (0.3344 => 5.2898, std.dev.: 0.0582) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.28% (0.2364 => 0.3198, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: 1.63% (0.0429 => 0.0436, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.36% (0.0224 => 0.0236, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: -27.83% (0.0230 => 0.0166, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4183, std.dev.: 0.0237) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0698, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4945, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3397, std.dev.: 0.0176) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1445, std.dev.: 0.0217) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4028, std.dev.: 0.0138) SingleSource/Regression/C/uint64_to_float: -23.75% (2.1832 => 1.6646, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.65% (0.0810 => 0.0953, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.10% (0.0773 => 0.0882, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 12.86% (0.1112 => 0.1255, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.77% (0.0830 => 0.0936, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.60% (0.6010 => 0.6587, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.19% (0.8321 => 0.9086, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.89% (0.2180 => 0.2352, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.76% (0.4847 => 0.5223, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.11% (0.7473 => 0.8004, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.93% (0.2279 => 0.2437, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.66% (0.1983 => 0.2115, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.64% (0.8148 => 0.8689, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.47% (0.2133 => 0.2271, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.12% (0.3137 => 0.3329, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.89% (0.3295 => 0.3489, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.83% (1.1606 => 1.2283, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.52% (0.6287 => 0.6634, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.44% (0.2998 => 0.3161, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.60% (0.2240 => 0.2343, std.dev.: 0.0028) MultiSource/Applications/sgefa/sgefa: 4.33% (0.2999 => 0.3129, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.12% (1.1685 => 1.2167, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.92% (0.5817 => 0.6045, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 3.84% (4.1305 => 4.2890, std.dev.: 0.0445) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.78% (0.9435 => 0.9792, std.dev.: 0.0074) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.61% (6.6074 => 6.8462, std.dev.: 0.0361) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.46% (0.3003 => 0.3107, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.41% (1.6386 => 1.6944, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: 3.39% (1.2222 => 1.2636, std.dev.: 0.0110) MultiSource/Applications/treecc/treecc: 3.37% (1.9948 => 2.0620, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.34% (0.4127 => 0.4265, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 3.20% (14.7684 => 15.2416, std.dev.: 0.0436) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.15% (4.1763 => 4.3078, std.dev.: 0.0331) MultiSource/Applications/SIBsim4/SIBsim4: 2.98% (1.2568 => 1.2942, std.dev.: 0.0066) MultiSource/Applications/hbd/hbd: 2.94% (1.4269 => 1.4688, std.dev.: 0.0147) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.93% (0.3717 => 0.3826, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.80% (0.4783 => 0.4917, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.77% (0.8697 => 0.8938, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.76% (4.4873 => 4.6111, std.dev.: 0.0227) MultiSource/Benchmarks/nbench/nbench: 2.74% (1.1271 => 1.1580, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 2.61% (3.8189 => 3.9186, std.dev.: 0.0231) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (6.7320 => 6.9073, std.dev.: 0.0359) MultiSource/Applications/d/make_dparser: 2.50% (3.2366 => 3.3175, std.dev.: 0.0159) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.49% (0.6227 => 0.6382, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.48% (4.5702 => 4.6837, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.47% (0.8007 => 0.8205, std.dev.: 0.0050) MultiSource/Applications/SPASS/SPASS: 2.47% (14.2605 => 14.6126, std.dev.: 0.0795) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.43% (0.8518 => 0.8725, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.36% (1.3279 => 1.3593, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.36% (0.8050 => 0.8240, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 2.27% (15.3280 => 15.6759, std.dev.: 0.0725) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.24% (0.8656 => 0.8850, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.24% (0.4559 => 0.4661, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.23% (0.7966 => 0.8144, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.23% (13.1811 => 13.4747, std.dev.: 0.1121) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.20% (0.9074 => 0.9274, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.19% (0.9069 => 0.9268, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.18% (0.8331 => 0.8513, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.16% (0.8286 => 0.8465, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.13% (0.7932 => 0.8101, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.08% (0.8420 => 0.8595, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.07% (0.8317 => 0.8489, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.07% (0.8805 => 0.8987, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.07% (0.8177 => 0.8346, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.05% (0.8261 => 0.8430, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.02% (0.8204 => 0.8370, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.02% (0.8712 => 0.8888, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.02% (0.8069 => 0.8232, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.96% (1.2526 => 1.2771, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.95% (0.8086 => 0.8244, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.90% (0.8359 => 0.8518, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.82% (0.8855 => 0.9016, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.81% (0.8048 => 0.8194, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.76% (1.2423 => 1.2642, std.dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (8.6247 => 8.7590, std.dev.: 0.0317) MultiSource/Benchmarks/Bullet/bullet: 1.49% (31.8598 => 32.3346, std.dev.: 0.0510) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.27% (1.4479 => 1.4663, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 95.48% (0.0199 => 0.0389, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/pi: 57.24% (1.5795 => 2.4836, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.19% (0.7597 => 0.8827, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.07% (2.9753 => 3.4533, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.71% (2.7995 => 3.2114, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.43% (5.0261 => 5.6005, std.dev.: 0.0139) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.06% (1.1857 => 1.2813, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 7.46% (1.7056 => 1.8328, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 6.96% (3.1873 => 3.4090, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.95% (4.7794 => 5.1118, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: 6.36% (1.3037 => 1.3866, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.90% (4.5327 => 4.8003, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.88% (4.9686 => 5.2607, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.68% (3.3761 => 3.5341, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.62% (4.9453 => 5.1736, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.33% (6.2275 => 6.4974, std.dev.: 0.0401) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.99% (4.9469 => 5.1445, std.dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: 3.91% (14.0064 => 14.5541, std.dev.: 0.1355) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.71% (1.2337 => 1.2795, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.97% (8.2783 => 8.5239, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.94% (11.5690 => 11.9093, std.dev.: 0.0116) MultiSource/Applications/lambda-0_1_3/lambda: 2.80% (7.4933 => 7.7029, std.dev.: 0.0510) MultiSource/Applications/siod/siod: 2.68% (3.6643 => 3.7624, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout/lists: 2.25% (7.3375 => 7.5023, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.16% (4.8362 => 4.9409, std.dev.: 0.0189) SingleSource/Benchmarks/Dhrystone/dry: 2.01% (0.5081 => 0.5183, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/five11/five11: 1.93% (5.6030 => 5.7114, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.84% (1.1365 => 1.1574, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/neural/neural: 1.27% (1.0841 => 1.0979, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.27% (1.2474 => 1.2632, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/ReedSolomon: 1.20% (8.5322 => 8.6349, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.14% (1.5941 => 1.6122, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.05% (3.5679 => 3.6055, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.13% (5.4641 => 4.3094, std.dev.: 0.0241) SingleSource/Benchmarks/McGill/chomp: -11.01% (1.1216 => 0.9981, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.87% (1.0512 => 0.9369, std.dev.: 0.0310) MultiSource/Benchmarks/mafft/pairlocalalign: -8.56% (63.1822 => 57.7739, std.dev.: 0.0876) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.86% (4.7482 => 4.4226, std.dev.: 0.0399) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.18% (0.3269 => 0.3067, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.95% (3.7148 => 3.4936, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.89% (5.4972 => 5.1735, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.04% (5.1557 => 4.8959, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.99% (3.9188 => 3.7234, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.77% (6.0224 => 5.7955, std.dev.: 0.0139) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.05% (28.5821 => 27.7096, std.dev.: 0.0207) MultiSource/Applications/lua/lua: -2.95% (29.8330 => 28.9529, std.dev.: 0.3157) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.65% (2.6356 => 2.5657, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.64% (9.9065 => 9.6454, std.dev.: 0.0715) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.51% (0.5807 => 0.5661, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.00% (11.5316 => 11.3006, std.dev.: 0.0387) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.64% (4.9994 => 4.9174, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.62% (3.2169 => 3.1648, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ffbench: -1.49% (1.4296 => 1.4083, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: -1.47% (3.4237 => 3.3735, std.dev.: 0.0013) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.16% (16.4461 => 16.6364, std.dev.: 0.2779) MultiSource/Applications/obsequi/Obsequi: 3.78% (1.0262 => 1.0650, std.dev.: 0.0105) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6817.16% (0.3123 => 21.6023, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.38% (0.2463 => 0.3630, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/bigfib: -0.02% (0.6010 => 0.6009, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.59% (0.3266 => 0.3318, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 1.68% (0.1969 => 0.2002, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -12.63% (0.0190 => 0.0166, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.76% (0.1438 => 0.1427, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.34% (1.1329 => 1.1481, std.dev.: 0.0292) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.63% (0.1462 => 0.1515, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.01% (0.4164 => 0.4122, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.19% (0.1369 => 0.1399, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.87% (0.0641 => 0.0653, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 37.95% (0.0195 => 0.0269, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.84% (0.0578 => 0.0606, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.68% (1.1437 => 1.1972, std.dev.: 0.0317) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.07% (0.0627 => 0.0640, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.67% (0.0180 => 0.0237, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.31% (0.8017 => 0.7832, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 12.90% (0.0062 => 0.0070, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 6 15:25:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 6 Nov 2012 17:25:11 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121106232511.7B7902A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5635?compare_to=5631&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5635, Order: 167478, Start Time: 2012-11-06 20:09:22, End Time: 2012-11-06 23:25:17 To: 5631, Order: 167460, Start Time: 2012-11-06 16:05:36, End Time: 2012-11-06 19:21:28 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (170 on baseline) Performance Improvements: 5 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1036 (720 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.21% (0.2168 => 0.2281, std.dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.66% (0.7392 => 0.7269, std.dev.: 0.0017) MultiSource/Applications/lua/lua: -1.15% (1.6403 => 1.6214, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: -1.13% (2.2171 => 2.1920, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: -1.07% (1.2580 => 1.2446, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.06% (1.9045 => 1.8844, std.dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.04% (0.0625 => 0.0869, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.95% (0.1063 => 0.1392, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.00% (0.2969 => 0.3741, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.47% (0.0475 => 0.0596, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.32% (0.1106 => 0.1386, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.09% (0.0714 => 0.0886, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 23.92% (0.4139 => 0.5129, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.81% (0.4994 => 0.6183, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.63% (0.4253 => 0.5258, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.20% (0.5900 => 0.7269, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.96% (0.5000 => 0.6148, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 22.88% (1.5932 => 1.9577, std.dev.: 0.0061) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.60% (0.0584 => 0.0716, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.04% (0.1021 => 0.1246, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.98% (0.1620 => 0.1976, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.52% (0.0897 => 0.1090, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 21.37% (0.0599 => 0.0727, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.23% (0.1107 => 0.1342, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.70% (0.0633 => 0.0764, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 20.46% (0.0948 => 0.1142, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.40% (0.0642 => 0.0773) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.38% (0.0584 => 0.0703, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.13% (0.1103 => 0.1325, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.06% (0.3903 => 0.4686, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 19.98% (0.0821 => 0.0985, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.84% (0.1003 => 0.1202, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.71% (0.0822 => 0.0984, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.70% (0.1604 => 0.1920, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.69% (0.1549 => 0.1854, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 19.64% (0.1619 => 0.1937, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 19.54% (0.0604 => 0.0722, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 18.80% (0.0947 => 0.1125, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 18.80% (0.5826 => 0.6921, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.57% (0.2014 => 0.2388, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.54% (0.1462 => 0.1733, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 18.25% (0.5889 => 0.6964, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.15% (0.3890 => 0.4596, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 18.06% (0.1218 => 0.1438, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.56% (0.1088 => 0.1279) MultiSource/Applications/spiff/spiff: 17.50% (0.4029 => 0.4734, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 17.48% (0.1505 => 0.1768, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.26% (1.3152 => 1.5422, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.25% (0.2736 => 0.3208, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.99% (0.2866 => 0.3353, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.88% (3.5627 => 4.1642, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 16.82% (0.5546 => 0.6479, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.63% (0.5026 => 0.5862, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 16.63% (1.8794 => 2.1920, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.57% (0.1968 => 0.2294, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.38% (0.4658 => 0.5421, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.29% (0.1160 => 0.1349, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.24% (1.6211 => 1.8844, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 16.16% (0.7171 => 0.8330, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.99% (0.3271 => 0.3794, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 15.90% (0.1421 => 0.1647, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.89% (0.2738 => 0.3173, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.86% (0.2875 => 0.3331, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.82% (2.7292 => 3.1610, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.73% (0.4361 => 0.5047, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 15.72% (0.9697 => 1.1221, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: 15.58% (0.1284 => 0.1484, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.47% (0.3930 => 0.4538, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 15.44% (1.0781 => 1.2446, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.44% (4.4195 => 5.1017, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/fibo: 15.34% (0.2725 => 0.3143, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 15.33% (4.2109 => 4.8564, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hello: 15.22% (0.2714 => 0.3127, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.13% (0.2729 => 0.3142, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 15.11% (0.3004 => 0.3458, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.08% (1.9694 => 2.2664, std.dev.: 0.0187) SingleSource/Benchmarks/Shootout-C++/strcat: 15.02% (0.2750 => 0.3163, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.99% (2.0673 => 2.3771, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/random: 14.95% (0.2803 => 0.3222, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/objinst: 14.91% (0.2823 => 0.3244, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.91% (1.9966 => 2.2942, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/methcall: 14.90% (0.2813 => 0.3232, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 14.89% (0.2780 => 0.3194, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.87% (0.3195 => 0.3670, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.86% (0.2792 => 0.3207, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 14.82% (0.9909 => 1.1378, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/except: 14.80% (0.2811 => 0.3227, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.77% (0.2911 => 0.3341, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 14.70% (0.3096 => 0.3551, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.31% (0.1090 => 0.1246, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.28% (0.3488 => 0.3986, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 14.26% (0.3267 => 0.3733, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 14.24% (0.3258 => 0.3722, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.19% (0.3362 => 0.3839, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 14.19% (0.3496 => 0.3992, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 14.19% (0.2566 => 0.2930, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 14.17% (0.2075 => 0.2369, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 14.08% (23.5202 => 26.8326, std.dev.: 0.0198) SingleSource/UnitTests/ObjC/trivial-interface: 14.06% (0.3442 => 0.3926, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.05% (0.3465 => 0.3952, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 14.05% (0.3446 => 0.3930, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.98% (0.3469 => 0.3954, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-3: 13.96% (0.3460 => 0.3943, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 13.90% (0.3317 => 0.3778, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.89% (0.3060 => 0.3485, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.77% (0.3625 => 0.4124, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.73% (0.3124 => 0.3553, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 13.73% (0.3678 => 0.4183, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 13.63% (1.4269 => 1.6214, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 13.62% (0.3650 => 0.4147, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.59% (0.3643 => 0.4138, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 13.50% (0.7875 => 0.8938, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 13.45% (0.3724 => 0.4225, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 13.44% (0.3348 => 0.3798, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.32% (0.3282 => 0.3719, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 13.20% (0.3726 => 0.4218, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 13.19% (0.4146 => 0.4693, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 13.14% (0.3477 => 0.3934, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 13.08% (2.1653 => 2.4486, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.95% (0.3690 => 0.4168, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 12.94% (4.6177 => 5.2152, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash2: 12.91% (0.4251 => 0.4800, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.79% (0.3981 => 0.4490, std.dev.: 0.0123) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.72% (0.3845 => 0.4334, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 12.69% (2.1013 => 2.3679, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.35% (0.2040 => 0.2292, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 12.25% (0.5012 => 0.5626, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 11.89% (0.2691 => 0.3011, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 11.61% (5.5417 => 6.1849, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.46% (0.2068 => 0.2305, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.06% (0.6435 => 0.7147, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.99% (0.1383 => 0.1535, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.80% (0.1028 => 0.1139, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.76% (0.6634 => 0.7348, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 10.58% (0.3498 => 0.3868, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.30% (0.2737 => 0.3019, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 10.23% (0.4847 => 0.5343, std.dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.76% (0.3084 => 0.3385, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 9.71% (0.3336 => 0.3660, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: 9.50% (2.0346 => 2.2279, std.dev.: 0.0052) MultiSource/Applications/lemon/lemon: 9.33% (0.2391 => 0.2614, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.27% (0.2103 => 0.2298, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.34% (0.5361 => 0.5808, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.03% (11.6398 => 12.5744, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.01% (4.6926 => 5.0684, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.69% (0.7426 => 0.7997, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.56% (0.5584 => 0.6006, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 6.14% (11.9555 => 12.6890, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.64% (0.3792 => 0.3968, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 9.28% (0.2802 => 0.3062, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 7.49% (0.2122 => 0.2281, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6109, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6747, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-2: 4.76% (1.8057 => 1.8917, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1684, std.dev.: 0.0280) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.49% (0.3693 => 0.3859, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/dry: 4.14% (14.0481 => 14.6296, std.dev.: 0.0176) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1922, std.dev.: 0.0062) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.55% (3.1722 => 3.2214, std.dev.: 0.0020) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3032, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2843, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6031, std.dev.: 0.0180) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.60% (2.4764 => 2.4120, std.dev.: 0.0176) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5592, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/ary2: -7.79% (0.2402 => 0.2215, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9766, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7870, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7990, std.dev.: 0.0108) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.99% (0.6293 => 0.6105, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.36% (17.2379 => 16.8316, std.dev.: 0.0261) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8689, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.81% (10.7630 => 10.5684, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4957, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1471, std.dev.: 0.0336) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0484, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 6 15:53:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 6 Nov 2012 17:53:25 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121106235325.6EEE02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5636?compare_to=5634&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5636, Order: 167494, Start Time: 2012-11-06 22:27:06, End Time: 2012-11-06 23:53:34 To: 5634, Order: 167484, Start Time: 2012-11-06 20:43:03, End Time: 2012-11-06 22:10:14 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 10 (101 on baseline) Performance Improvements: 4 (22 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 977 (851 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.11% (0.8513 => 0.8693, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 1.34% (2.2543 => 2.2846, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.01% (1.1362 => 1.1477, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.55% (2.3596 => 2.5850, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.26% (0.3329 => 0.3504, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.71% (4.3301 => 4.5340, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.70% (3.0635 => 3.2076, std.dev.: 0.0255) SingleSource/Benchmarks/Misc/ffbench: 1.61% (1.4083 => 1.4310, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.54% (40.8606 => 41.4889, std.dev.: 0.2427) SingleSource/Benchmarks/Misc/pi: 1.07% (2.4836 => 2.5102, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.28% (0.6587 => 0.6305, std.dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -3.68% (3.1216 => 3.0067, std.dev.: 0.0223) MultiSource/Applications/SPASS/SPASS: -2.01% (8.7575 => 8.5818, std.dev.: 0.0533) MultiSource/Benchmarks/BitBench/five11/five11: -1.79% (5.7114 => 5.6094, std.dev.: 0.0237) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.38% (16.6364 => 16.8667, std.dev.: 0.0526) MultiSource/Applications/obsequi/Obsequi: 1.51% (1.0650 => 1.0811, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.59% (21.6023 => 21.7295, std.dev.: 0.4502) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (0.3630 => 0.3674, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 0.40% (0.6009 => 0.6033, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.81% (0.3318 => 0.3291, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/strcat: -0.40% (0.2002 => 0.1994, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.92% (0.0218 => 0.0216, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.17% (0.0428 => 0.0423, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.30% (0.0330 => 0.0329, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.64% (0.0313 => 0.0311, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.71% (0.0423 => 0.0420, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/casts: 21.69% (0.0166 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -0.92% (0.0217 => 0.0215, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1427 => 0.1430, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.95% (1.1481 => 1.1705, std.dev.: 0.0574) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -0.79% (0.1515 => 0.1503, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.68% (0.4122 => 0.4315, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.71% (0.1399 => 0.1409, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.84% (0.0653 => 0.0641, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.74% (0.0269 => 0.0271, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.60% (0.0606 => 0.0566, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.18% (1.1972 => 1.1951, std.dev.: 0.0223) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -35.48% (0.0031 => 0.0020, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -73.08% (0.0026 => 0.0007, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.62% (0.0640 => 0.0644, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.84% (0.0237 => 0.0239, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.36% (0.7832 => 0.7804, std.dev.: 0.0244) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: -66.67% (0.0003 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 25.71% (0.0070 => 0.0088, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2319.28% (0.6332 => 15.3189, std.dev.: 0.1205) MultiSource/Benchmarks/McCat/08-main/main: 48.88% (0.1831 => 0.2726, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.74% (0.1559 => 0.1454, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1500.15% (0.3344 => 5.3509, std.dev.: 0.0800) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.58% (0.2364 => 0.3205, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel: -1.63% (0.0429 => 0.0422, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.91% (0.0224 => 0.0235, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0000) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4456, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0687, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4946, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3454, std.dev.: 0.0422) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1472, std.dev.: 0.0236) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4085, std.dev.: 0.0031) SingleSource/Regression/C/uint64_to_float: -24.09% (2.1832 => 1.6573, std.dev.: 0.0078) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.53% (0.0810 => 0.0952, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.38% (0.0848 => 0.0953, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 11.96% (0.1112 => 0.1245, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.57% (0.2180 => 0.2345, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.99% (0.4847 => 0.5186, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.51% (0.1983 => 0.2112, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.09% (0.7473 => 0.7928, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.90% (0.8148 => 0.8629, std.dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.80% (0.3137 => 0.3319, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.73% (0.1885 => 0.1993, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.54% (0.2240 => 0.2364, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.91% (0.6010 => 0.6305, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.74% (0.2998 => 0.3140, std.dev.: 0.0048) MultiSource/Applications/spiff/spiff: 4.62% (0.7950 => 0.8317, std.dev.: 0.0121) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.42% (1.1606 => 1.2119, std.dev.: 0.0177) MultiSource/Applications/Burg/burg: 4.36% (1.2222 => 1.2755, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.35% (0.8331 => 0.8693, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 4.30% (0.2999 => 0.3128, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.22% (1.1685 => 1.2178, std.dev.: 0.0111) MultiSource/Applications/ClamAV/clamscan: 4.00% (14.7684 => 15.3593, std.dev.: 0.0754) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.99% (0.6287 => 0.6538, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.70% (0.8518 => 0.8833, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.59% (0.4127 => 0.4275, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.44% (0.9688 => 1.0021, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.41% (0.8611 => 0.8905, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.37% (0.8359 => 0.8641, std.dev.: 0.0103) MultiSource/Applications/lua/lua: 3.33% (3.8189 => 3.9462, std.dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.09% (0.3717 => 0.3832, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.05% (0.8420 => 0.8677, std.dev.: 0.0081) MultiSource/Applications/treecc/treecc: 3.04% (1.9948 => 2.0555, std.dev.: 0.0113) MultiSource/Applications/SIBsim4/SIBsim4: 3.03% (1.2568 => 1.2949, std.dev.: 0.0142) MultiSource/Applications/siod/siod: 2.98% (2.2184 => 2.2846, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 2.91% (4.1305 => 4.2505, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.90% (0.7932 => 0.8162, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.89% (0.8050 => 0.8283, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.86% (0.8177 => 0.8411, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/05-eks/eks: 2.84% (0.4397 => 0.4522, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.83% (0.9435 => 0.9702, std.dev.: 0.0077) MultiSource/Applications/SPASS/SPASS: 2.78% (14.2605 => 14.6571, std.dev.: 0.1005) MultiSource/Applications/d/make_dparser: 2.77% (3.2366 => 3.3264, std.dev.: 0.0203) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.75% (1.1170 => 1.1477, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.75% (1.6386 => 1.6836, std.dev.: 0.0102) MultiSource/Applications/JM/ldecod/ldecod: 2.74% (6.7320 => 6.9162, std.dev.: 0.0421) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.68% (0.5817 => 0.5973, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.66% (0.8261 => 0.8481, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.66% (0.8656 => 0.8886, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.63% (0.8805 => 0.9037, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.63% (0.9908 => 1.0169, std.dev.: 0.0075) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.60% (6.6074 => 6.7792, std.dev.: 0.0463) MultiSource/Applications/JM/lencod/lencod: 2.57% (15.3280 => 15.7222, std.dev.: 0.0830) MultiSource/Applications/minisat/minisat: 2.41% (0.6834 => 0.6999, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.40% (1.1271 => 1.1541, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.29% (0.8338 => 0.8529, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.26% (0.6227 => 0.6368, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.26% (0.8066 => 0.8248, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.26% (13.1811 => 13.4784, std.dev.: 0.0351) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.22% (0.9069 => 0.9270, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.96% (8.6476 => 8.8169, std.dev.: 0.0638) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.90% (4.4880 => 4.5733, std.dev.: 0.0188) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (8.6247 => 8.7681, std.dev.: 0.0485) MultiSource/Applications/lemon/lemon: 1.65% (1.0945 => 1.1126, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.54% (1.2602 => 1.2796, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/football/football: 1.53% (0.8768 => 0.8902, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.28% (0.8995 => 0.9110, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 92.46% (0.0199 => 0.0383, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/pi: 58.92% (1.5795 => 2.5102, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.59% (0.7597 => 0.8857, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.51% (2.9753 => 3.4665, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.59% (2.7995 => 3.2079, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.63% (5.0261 => 5.6107, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.98% (0.3186 => 0.3504, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.90% (1.1857 => 1.2794, std.dev.: 0.0050) SingleSource/Benchmarks/McGill/queens: 7.12% (1.7056 => 1.8271, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.09% (6.3772 => 6.8294, std.dev.: 0.1264) MultiSource/Applications/SIBsim4/SIBsim4: 7.06% (3.1873 => 3.4124, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/richards_benchmark: 7.01% (1.3037 => 1.3951, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.92% (4.7794 => 5.1101, std.dev.: 0.0415) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.89% (4.9686 => 5.2611, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.85% (4.5327 => 4.7978, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.12% (3.0515 => 3.2076, std.dev.: 0.0255) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.85% (6.2275 => 6.5297, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.69% (3.3761 => 3.5344, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.25% (4.9453 => 5.1554, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.17% (4.9469 => 5.1531, std.dev.: 0.0225) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.11% (4.3552 => 4.5340, std.dev.: 0.0163) MultiSource/Applications/hexxagon/hexxagon: 3.96% (14.0064 => 14.5612, std.dev.: 0.1005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.86% (1.2337 => 1.2813, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.46% (0.3587 => 0.3711, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 2.92% (7.4933 => 7.7123, std.dev.: 0.0458) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.79% (4.8362 => 4.9713, std.dev.: 0.0292) MultiSource/Applications/siod/siod: 2.78% (3.6643 => 3.7660, std.dev.: 0.0234) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.70% (11.5690 => 11.8814, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.66% (8.2783 => 8.4986, std.dev.: 0.0120) SingleSource/Benchmarks/Dhrystone/dry: 2.44% (0.5081 => 0.5205, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.41% (4.8660 => 4.9835, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/lists: 2.32% (7.3375 => 7.5076, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 1.77% (8.4326 => 8.5818, std.dev.: 0.0533) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.57% (1.1365 => 1.1543, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.28% (2.4647 => 2.4962, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: 1.27% (1.0841 => 1.0979, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 1.15% (1.2061 => 1.2200, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.80% (5.4641 => 4.3273, std.dev.: 0.0302) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.51% (7.2130 => 6.2384, std.dev.: 0.2964) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.82% (1.0512 => 0.9375, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -8.68% (3.2926 => 3.0067, std.dev.: 0.0223) MultiSource/Benchmarks/mafft/pairlocalalign: -8.47% (63.1822 => 57.8308, std.dev.: 0.0329) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.80% (4.7482 => 4.4255, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.55% (0.3269 => 0.3055, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.96% (3.7148 => 3.4933, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.75% (5.4972 => 5.1812, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.13% (5.1557 => 4.8912, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.57% (2.8773 => 2.7458, std.dev.: 0.0396) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.62% (6.0224 => 5.8045, std.dev.: 0.0665) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.57% (4.7449 => 4.5754, std.dev.: 0.0220) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.03% (0.5807 => 0.5631, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.01% (28.5821 => 27.7220, std.dev.: 0.0049) MultiSource/Applications/lua/lua: -2.62% (29.8330 => 29.0507, std.dev.: 0.0497) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.22% (2.6356 => 2.5770, std.dev.: 0.0021) MultiSource/Applications/aha/aha: -2.20% (3.3398 => 3.2664, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.99% (11.5316 => 11.3016, std.dev.: 0.0199) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.76% (2.3487 => 2.3073, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/hash2: -1.62% (3.4237 => 3.3682, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.31% (2.4490 => 2.4169, std.dev.: 0.0086) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.56% (16.4461 => 16.8667, std.dev.: 0.0526) MultiSource/Applications/obsequi/Obsequi: 5.35% (1.0262 => 1.0811, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6857.89% (0.3123 => 21.7295, std.dev.: 0.4502) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.17% (0.2463 => 0.3674, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 0.38% (0.6010 => 0.6033, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.77% (0.3266 => 0.3291, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/strcat: 1.27% (0.1969 => 0.1994, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 75.61% (0.0123 => 0.0216, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.68% (0.0408 => 0.0423, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.53% (0.0254 => 0.0329, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.98% (0.0302 => 0.0311, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.38% (0.0384 => 0.0420, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 19.44% (0.0180 => 0.0215, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.56% (0.1438 => 0.1430, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 3.32% (1.1329 => 1.1705, std.dev.: 0.0574) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 2.80% (0.1462 => 0.1503, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.63% (0.4164 => 0.4315, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.92% (0.1369 => 0.1409, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0641 => 0.0641, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 38.97% (0.0195 => 0.0271, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.08% (0.0578 => 0.0566, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.49% (1.1437 => 1.1951, std.dev.: 0.0223) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1900.00% (0.0001 => 0.0020, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0014 => 0.0007, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.71% (0.0627 => 0.0644, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 32.78% (0.0180 => 0.0239, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.66% (0.8017 => 0.7804, std.dev.: 0.0244) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 41.94% (0.0062 => 0.0088, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 6 16:24:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 6 Nov 2012 18:24:45 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121107002445.C6CFC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5637?compare_to=5633&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5637, Order: 167495, Start Time: 2012-11-06 22:59:46, End Time: 2012-11-07 00:24:49 To: 5633, Order: 167472, Start Time: 2012-11-06 19:14:29, End Time: 2012-11-06 20:39:21 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (177 on baseline) Unchanged Tests: 1041 (860 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 6.22% (0.3808 => 0.4045, std.dev.: 0.0025) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 5.50% (0.3834 => 0.4045, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1013, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/salsa20: 2.51% (7.4937 => 7.6818, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/hash2: 2.29% (3.1932 => 3.2662, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.53% (0.1431 => 0.1309, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.69% (0.3821 => 0.3527, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -7.60% (2.4924 => 2.3030, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.84% (0.3142 => 0.2927, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.79% (0.3357 => 0.3129, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.67% (0.2428 => 0.2266, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.60% (3.5339 => 3.3008, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/oourafft: -6.57% (0.2160 => 0.2018, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.52% (22.4056 => 20.9447, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.42% (0.3658 => 0.3423, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.40% (0.9542 => 0.8931, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.32% (0.9852 => 0.9229, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -6.27% (16.1920 => 15.1761, std.dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: -6.20% (9.2283 => 8.6557, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.20% (1.0544 => 0.9890, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: -6.17% (7.0961 => 6.6582, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/football/football: -6.16% (0.9179 => 0.8614, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: -6.15% (1.2515 => 1.1745, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.06% (0.1716 => 0.1612, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.02% (1.6474 => 1.5482, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: -6.02% (4.3330 => 4.0721, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.01% (0.6484 => 0.6094, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -6.00% (1.1450 => 1.0763, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.00% (4.0323 => 3.7904, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.99% (0.7919 => 0.7445, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.98% (1.3722 => 1.2901, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -5.96% (0.1761 => 0.1656, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.95% (1.2784 => 1.2023, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.90% (0.4151 => 0.3906, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.86% (0.6293 => 0.5924, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.84% (1.4642 => 1.3787, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.84% (1.2300 => 1.1582, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.82% (0.6736 => 0.6344, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: -5.81% (0.3406 => 0.3208, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.80% (4.5069 => 4.2455, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.76% (1.6364 => 1.5421, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: -5.74% (0.4861 => 0.4582, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.73% (0.6681 => 0.6298, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.73% (0.6230 => 0.5873, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.71% (0.2695 => 0.2541, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.71% (0.7339 => 0.6920, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.70% (0.5857 => 0.5523, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -5.69% (2.4021 => 2.2655, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -5.66% (1.3148 => 1.2404, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.66% (0.3483 => 0.3286, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.65% (4.8161 => 4.5440, std.dev.: 0.0092) MultiSource/Applications/lua/lua: -5.64% (4.0594 => 3.8303, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: -5.64% (17.1032 => 16.1383, std.dev.: 0.0148) MultiSource/Benchmarks/McCat/08-main/main: -5.64% (0.2659 => 0.2509, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -5.64% (0.3812 => 0.3597, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.62% (0.5478 => 0.5170, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.62% (14.2083 => 13.4105, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.61% (0.7021 => 0.6627, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.61% (5.4682 => 5.1614, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.61% (0.7524 => 0.7102, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.61% (0.2355 => 0.2223, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -5.60% (0.4176 => 0.3942, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -5.59% (0.2985 => 0.2818, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.59% (0.5863 => 0.5535, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.58% (0.5805 => 0.5481, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.58% (6.7716 => 6.3938, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.57% (4.8802 => 4.6082, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.56% (0.6260 => 0.5912, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.56% (0.6297 => 0.5947, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.56% (0.5849 => 0.5524, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.55% (0.5925 => 0.5596, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.55% (0.3891 => 0.3675, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.54% (0.3880 => 0.3665, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -5.54% (15.5079 => 14.6488, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.54% (0.6194 => 0.5851, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: -5.53% (0.3831 => 0.3619, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -5.53% (0.7447 => 0.7035, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.53% (0.6440 => 0.6084, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.53% (0.8521 => 0.8050, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.53% (0.5591 => 0.5282, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.52% (0.6446 => 0.6090, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.52% (0.5999 => 0.5668, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -5.52% (1.1530 => 1.0894, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -5.52% (0.3481 => 0.3289, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -5.51% (0.3848 => 0.3636, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -5.50% (34.0927 => 32.2160, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.50% (0.6033 => 0.5701, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.50% (0.5581 => 0.5274, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.50% (0.6660 => 0.6294, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.49% (2.2587 => 2.1346, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.49% (0.6052 => 0.5720, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.48% (0.3849 => 0.3638, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.48% (2.1713 => 2.0524, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: -5.47% (1.3864 => 1.3105, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.46% (0.5456 => 0.5158, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.46% (0.5859 => 0.5539, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.46% (0.6189 => 0.5851, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.46% (0.3884 => 0.3672, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.46% (0.2548 => 0.2409, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -5.45% (0.4033 => 0.3813, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: -5.45% (0.4515 => 0.4269, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.44% (0.2278 => 0.2154, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.44% (0.6395 => 0.6047, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.44% (0.5168 => 0.4887, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.43% (0.9557 => 0.9038, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.42% (0.5329 => 0.5040, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.42% (0.6676 => 0.6314, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.42% (0.7198 => 0.6808, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -5.42% (0.3581 => 0.3387, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.41% (0.6667 => 0.6306, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.40% (0.5569 => 0.5268, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.39% (0.3837 => 0.3630, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.39% (0.5802 => 0.5489, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -5.39% (0.4248 => 0.4019, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -5.39% (0.3621 => 0.3426, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -5.36% (0.4199 => 0.3974, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.35% (0.5570 => 0.5272, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.34% (0.5567 => 0.5270, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.33% (0.6304 => 0.5968, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -5.33% (0.3059 => 0.2896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -5.32% (0.6750 => 0.6391, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.31% (0.4083 => 0.3866, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: -5.31% (0.3896 => 0.3689, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.30% (0.6395 => 0.6056, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: -5.28% (0.3446 => 0.3264, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -5.28% (0.4280 => 0.4054, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -5.28% (0.3867 => 0.3663, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.27% (0.3491 => 0.3307, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.26% (0.5705 => 0.5405, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.26% (0.3025 => 0.2866, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.25% (0.4916 => 0.4658, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: -5.24% (0.3394 => 0.3216, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -5.24% (3.5154 => 3.3311, std.dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: -5.21% (18.2933 => 17.3411, std.dev.: 0.0027) MultiSource/Applications/treecc/treecc: -5.19% (2.1401 => 2.0291, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: -5.19% (0.2989 => 0.2834, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.15% (0.4813 => 0.4565, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.15% (0.5941 => 0.5635, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.14% (0.2999 => 0.2845, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: -5.12% (0.2871 => 0.2724, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.11% (0.5575 => 0.5290, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.10% (0.3057 => 0.2901, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.10% (0.5688 => 0.5398, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.09% (0.3319 => 0.3150, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.06% (0.2903 => 0.2756, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.04% (0.3252 => 0.3088, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -5.02% (0.2849 => 0.2706, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -5.01% (0.7982 => 0.7582, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.00% (8.0126 => 7.6117, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/random: -5.00% (0.2939 => 0.2792, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.00% (0.4321 => 0.4105, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: -5.00% (0.4524 => 0.4298, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.99% (0.2385 => 0.2266, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -4.98% (0.3255 => 0.3093, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.98% (1.2221 => 1.1613, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.97% (1.2210 => 1.1603, std.dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/wc: -4.96% (0.3205 => 0.3046, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -4.95% (0.3194 => 0.3036, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -4.93% (15.2527 => 14.5013, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/except: -4.92% (0.3026 => 0.2877, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.91% (0.2933 => 0.2789, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.88% (0.3931 => 0.3739, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.81% (0.3323 => 0.3163, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.81% (0.4427 => 0.4214, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.77% (0.3016 => 0.2872, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -4.75% (0.3788 => 0.3608, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.71% (0.3271 => 0.3117, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -4.57% (0.8418 => 0.8033, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: -4.50% (5.0226 => 4.7966, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: -4.44% (0.6347 => 0.6065, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -4.32% (0.6441 => 0.6163, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.19% (0.7779 => 0.7453, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -4.06% (1.5610 => 1.4976, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.05% (0.9077 => 0.8709, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -2.71% (20.7746 => 20.2111, std.dev.: 0.0163) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7518, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: -8.78% (1.2842 => 1.1714, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7061, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.76% (2.2633 => 2.1783, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4695, std.dev.: 0.0054) Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 6 17:37:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 6 Nov 2012 19:37:25 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121107013725.9DF6F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5638?compare_to=5636&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5638, Order: 167504, Start Time: 2012-11-07 00:11:03, End Time: 2012-11-07 01:37:33 To: 5636, Order: 167494, Start Time: 2012-11-06 22:27:06, End Time: 2012-11-06 23:53:34 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 4 (77 on baseline) Performance Improvements: 6 (25 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 981 (872 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 2.52% (1.8297 => 1.8758, std.dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.41% (14.5428 => 14.8926, std.dev.: 0.1008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.10% (59.5241 => 60.7731, std.dev.: 0.3195) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.89% (45.0457 => 45.8963, std.dev.: 0.2406) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.16% (0.8903 => 0.8622, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.17% (0.8693 => 0.8504, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.27% (1.0021 => 0.9894, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.26% (0.8833 => 0.8722, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: -2.63% (4.5340 => 4.4146, std.dev.: 0.0179) SingleSource/Benchmarks/Misc/ffbench: -1.43% (1.4310 => 1.4106, std.dev.: 0.0050) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -1.23% (16.8667 => 16.6585, std.dev.: 0.3188) MultiSource/Applications/obsequi/Obsequi: -1.16% (1.0811 => 1.0686, std.dev.: 0.0529) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.29% (21.7295 => 21.6667, std.dev.: 0.1655) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.52% (0.3674 => 0.3655, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 0.02% (0.6033 => 0.6034, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.73% (0.3291 => 0.3315, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 0.35% (0.1994 => 0.2001, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.93% (0.0216 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0423 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.91% (0.0329 => 0.0332, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0311 => 0.0311, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -13.33% (0.0420 => 0.0364, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0202 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 0.47% (0.0215 => 0.0216, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.26% (0.1430 => 0.1448, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -4.03% (1.1705 => 1.1233, std.dev.: 0.0331) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.67% (0.1503 => 0.1513, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.36% (0.4315 => 0.4213, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.20% (0.1409 => 0.1378, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.96% (0.0641 => 0.0590, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -16.61% (0.0271 => 0.0226, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.18% (0.0566 => 0.0565, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.12% (1.1951 => 1.1965, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -95.00% (0.0020 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -71.43% (0.0007 => 0.0002, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.89% (0.0644 => 0.0561, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -23.85% (0.0239 => 0.0182, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.73% (0.7804 => 0.7747, std.dev.: 0.0123) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -20.45% (0.0088 => 0.0070, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2308.23% (0.6332 => 15.2489, std.dev.: 0.2948) MultiSource/Benchmarks/McCat/08-main/main: 48.06% (0.1831 => 0.2711, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.62% (0.1559 => 0.1409, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1480.65% (0.3344 => 5.2857, std.dev.: 0.0386) SingleSource/Benchmarks/Misc-C++/Large/ray: 34.64% (0.2364 => 0.3183, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel: -0.70% (0.0429 => 0.0426, std.dev.: 0.0010) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -3.12% (0.0224 => 0.0217, std.dev.: 0.0010) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4329, std.dev.: 0.0244) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0692, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4953, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3421, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1330, std.dev.: 0.0509) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3991, std.dev.: 0.0057) SingleSource/Regression/C/uint64_to_float: -23.90% (2.1832 => 1.6614, std.dev.: 0.0014) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.93% (0.0810 => 0.0939, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.96% (0.1885 => 0.2035, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.65% (0.1425 => 0.1534, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.43% (0.2240 => 0.2384, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.50% (0.2180 => 0.2300, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.14% (0.1983 => 0.2085, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.00% (0.2998 => 0.3148, std.dev.: 0.0033) MultiSource/Applications/spiff/spiff: 3.79% (0.7950 => 0.8251, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.70% (1.1685 => 1.2117, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.62% (0.8321 => 0.8622, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.51% (0.4127 => 0.4272, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.19% (0.8611 => 0.8886, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.87% (0.8359 => 0.8599, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.77% (0.8007 => 0.8229, std.dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.72% (6.6074 => 6.7874, std.dev.: 0.0681) MultiSource/Applications/ClamAV/clamscan: 2.62% (14.7684 => 15.1547, std.dev.: 0.0956) MultiSource/Applications/minisat/minisat: 2.49% (0.6834 => 0.7004, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.39% (0.8518 => 0.8722, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.35% (0.8597 => 0.8799, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.33% (0.8457 => 0.8654, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.30% (0.4559 => 0.4664, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.24% (0.8050 => 0.8230, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.21% (0.9908 => 1.0127, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.17% (0.9074 => 0.9271, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.13% (0.9688 => 0.9894, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.08% (0.8331 => 0.8504, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.05% (0.8420 => 0.8593, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.02% (1.4479 => 1.4772, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.00% (0.8338 => 0.8505, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.99% (0.8656 => 0.8828, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.94% (0.9039 => 0.9214, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.93% (0.8048 => 0.8203, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.92% (0.8855 => 0.9025, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.91% (13.1811 => 13.4327, std.dev.: 0.0642) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.90% (0.8204 => 0.8360, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.79% (0.8716 => 0.8872, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.74% (0.8885 => 0.9040, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 1.59% (8.6247 => 8.7616, std.dev.: 0.0095) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 85.93% (0.0199 => 0.0370, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/pi: 58.41% (1.5795 => 2.5021, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.91% (0.7597 => 0.8882, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.39% (2.9753 => 3.4630, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.41% (2.7995 => 3.2029, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6090, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.76% (0.3186 => 0.3465, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.59% (6.3772 => 6.8611, std.dev.: 0.1113) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.57% (1.1857 => 1.2755, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/richards_benchmark: 7.46% (1.3037 => 1.4009, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 7.23% (1.7056 => 1.8289, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.74% (4.7794 => 5.1015, std.dev.: 0.0567) MultiSource/Applications/SIBsim4/SIBsim4: 6.57% (3.1873 => 3.3966, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.86% (4.5327 => 4.7985, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.86% (4.9686 => 5.2599, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.69% (3.3761 => 3.5346, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.45% (6.2275 => 6.5048, std.dev.: 0.0345) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.37% (4.9453 => 5.1616, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.13% (4.9469 => 5.1514, std.dev.: 0.0177) MultiSource/Applications/hexxagon/hexxagon: 3.88% (14.0064 => 14.5504, std.dev.: 0.0315) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.01% (0.3587 => 0.3695, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.00% (44.5605 => 45.8963, std.dev.: 0.2406) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.85% (1.2337 => 1.2688, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.78% (8.2783 => 8.5081, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.70% (11.5690 => 11.8809, std.dev.: 0.0323) MultiSource/Applications/siod/siod: 2.63% (3.6643 => 3.7606, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.56% (4.8660 => 4.9906, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.55% (4.8362 => 4.9596, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.55% (59.2638 => 60.7731, std.dev.: 0.3195) MultiSource/Applications/lambda-0_1_3/lambda: 2.54% (7.4933 => 7.6834, std.dev.: 0.0188) SingleSource/Benchmarks/Shootout/lists: 2.36% (7.3375 => 7.5106, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.48% (2.4647 => 2.5012, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.36% (4.3552 => 4.4146, std.dev.: 0.0179) SingleSource/Benchmarks/Misc/ReedSolomon: 1.32% (8.5322 => 8.6452, std.dev.: 0.0120) MultiSource/Benchmarks/FreeBench/neural/neural: 1.28% (1.0841 => 1.0980, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.28% (1.5941 => 1.6145, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.27% (3.5679 => 3.6132, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.2061 => 1.2203, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/bh/bh: 1.06% (2.3560 => 2.3810, std.dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.15% (5.4641 => 4.3082, std.dev.: 0.0265) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.30% (7.2130 => 6.2536, std.dev.: 0.1681) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.78% (1.0512 => 0.9379, std.dev.: 0.0065) SingleSource/Benchmarks/McGill/chomp: -10.17% (1.1216 => 1.0075, std.dev.: 0.0075) MultiSource/Benchmarks/mafft/pairlocalalign: -8.53% (63.1822 => 57.7911, std.dev.: 0.0367) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.50% (0.3269 => 0.2991, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.86% (4.7482 => 4.4224, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.07% (3.7148 => 3.4892, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.84% (5.4972 => 5.1763, std.dev.: 0.0244) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.00% (5.1557 => 4.8977, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.52% (4.7449 => 4.5305, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.83% (2.8773 => 2.7672, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.77% (6.0224 => 5.7952, std.dev.: 0.0120) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.00% (28.5821 => 27.7240, std.dev.: 0.0282) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.91% (0.5807 => 0.5638, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.74% (2.6356 => 2.5633, std.dev.: 0.0072) MultiSource/Applications/aha/aha: -2.46% (3.3398 => 3.2578, std.dev.: 0.0036) MultiSource/Applications/lua/lua: -2.38% (29.8330 => 29.1226, std.dev.: 0.2065) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.18% (9.9065 => 9.6910, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.95% (11.5316 => 11.3073, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.65% (2.3487 => 2.3100, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.58% (4.9994 => 4.9203, std.dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/hash2: -1.37% (3.4237 => 3.3767, std.dev.: 0.0181) SingleSource/Benchmarks/Misc/ffbench: -1.33% (1.4296 => 1.4106, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.01% (1.4205 => 1.4062, std.dev.: 0.0046) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.29% (16.4461 => 16.6585, std.dev.: 0.3188) MultiSource/Applications/obsequi/Obsequi: 4.13% (1.0262 => 1.0686, std.dev.: 0.0529) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6837.78% (0.3123 => 21.6667, std.dev.: 0.1655) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.40% (0.2463 => 0.3655, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 0.40% (0.6010 => 0.6034, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.50% (0.3266 => 0.3315, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 1.63% (0.1969 => 0.2001, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.98% (0.0302 => 0.0311, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.21% (0.0384 => 0.0364, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.70% (0.1438 => 0.1448, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.85% (1.1329 => 1.1233, std.dev.: 0.0331) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.49% (0.1462 => 0.1513, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.18% (0.4164 => 0.4213, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.66% (0.1369 => 0.1378, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.96% (0.0641 => 0.0590, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 15.90% (0.0195 => 0.0226, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.25% (0.0578 => 0.0565, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.62% (1.1437 => 1.1965, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -85.71% (0.0014 => 0.0002, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.53% (0.0627 => 0.0561, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.11% (0.0180 => 0.0182, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.37% (0.8017 => 0.7747, std.dev.: 0.0123) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 12.90% (0.0062 => 0.0070, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 6 18:12:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 6 Nov 2012 20:12:54 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121107021254.974AE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5639?compare_to=5637&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5639, Order: 167508, Start Time: 2012-11-07 00:48:10, End Time: 2012-11-07 02:13:01 To: 5637, Order: 167495, Start Time: 2012-11-06 22:59:46, End Time: 2012-11-07 00:24:49 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (183 on baseline) Unchanged Tests: 1042 (855 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1012, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: 2.60% (7.4937 => 7.6888, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 1.92% (3.1932 => 3.2546, std.dev.: 0.0116) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.24% (0.3821 => 0.3506, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -7.92% (2.4924 => 2.2951, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.22% (0.3142 => 0.2915, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.17% (0.9542 => 0.8858, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: -6.94% (0.2160 => 0.2010, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.80% (0.2428 => 0.2263, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.79% (0.3357 => 0.3129, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.72% (3.5339 => 3.2964, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.62% (22.4056 => 20.9222, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.62% (0.3658 => 0.3416, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: -6.59% (7.0961 => 6.6282, std.dev.: 0.0164) MultiSource/Applications/JM/lencod/lencod: -6.57% (16.1920 => 15.1285, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: -6.56% (9.2283 => 8.6226, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.56% (0.9852 => 0.9206, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: -6.53% (0.9179 => 0.8580, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.48% (1.0544 => 0.9861, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -6.39% (0.1879 => 0.1759, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.38% (0.6484 => 0.6070, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.35% (0.1796 => 0.1682, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -6.32% (0.3812 => 0.3571, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.32% (0.3831 => 0.3589, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.28% (1.4642 => 1.3722, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.28% (1.2784 => 1.1981, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.27% (4.0323 => 3.7793, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.27% (1.6364 => 1.5338, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.26% (0.3880 => 0.3637, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.26% (1.3722 => 1.2863, std.dev.: 0.0037) MultiSource/Applications/Burg/burg: -6.26% (1.2515 => 1.1732, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -6.24% (1.1450 => 1.0735, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.24% (0.2355 => 0.2208, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: -6.24% (4.3330 => 4.0628, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions: -6.23% (0.4176 => 0.3916, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.23% (0.7919 => 0.7426, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: -6.21% (0.3848 => 0.3609, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: -6.20% (1.1530 => 1.0815, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/for-in: -6.20% (0.4033 => 0.3783, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.19% (0.3891 => 0.3650, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -6.19% (0.3896 => 0.3655, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.15% (0.6293 => 0.5906, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: -6.13% (0.1761 => 0.1653, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.13% (0.3884 => 0.3646, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.12% (0.1716 => 0.1611, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.11% (4.8802 => 4.5822, std.dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.10% (0.6736 => 0.6325, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.09% (4.8161 => 4.5229, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.08% (4.5069 => 4.2328, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.08% (1.2300 => 1.1552, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.08% (1.6474 => 1.5473, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.06% (6.7716 => 6.3611, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.05% (0.2695 => 0.2532, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.03% (14.2083 => 13.3512, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.03% (0.6681 => 0.6278, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.01% (0.7339 => 0.6898, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.00% (0.6230 => 0.5856, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.97% (0.3483 => 0.3275, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.96% (0.3406 => 0.3203) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.96% (0.5857 => 0.5508, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -5.95% (0.4199 => 0.3949, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.95% (0.4151 => 0.3904, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.95% (0.6052 => 0.5692, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.93% (0.5478 => 0.5153, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -5.93% (0.2985 => 0.2808, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/parameter-passing: -5.91% (0.4280 => 0.4027, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: -5.90% (0.2659 => 0.2502, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.89% (0.5925 => 0.5576, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.88% (0.6395 => 0.6019, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.88% (0.5802 => 0.5461, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -5.86% (17.1032 => 16.1008, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.86% (0.6194 => 0.5831, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.85% (0.6304 => 0.5935, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -5.85% (1.3148 => 1.2379, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.85% (0.6446 => 0.6069, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.84% (0.6297 => 0.5929, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.84% (0.5805 => 0.5466, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.83% (0.5863 => 0.5521, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.83% (0.6260 => 0.5895, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.82% (0.7524 => 0.7086) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.81% (0.6440 => 0.6066, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.81% (0.5581 => 0.5257, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.80% (0.5705 => 0.5374, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.80% (0.6189 => 0.5830, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.80% (0.5849 => 0.5510, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.80% (0.5591 => 0.5267, std.dev.: 0.0007) MultiSource/Applications/lua/lua: -5.79% (4.0594 => 3.8243, std.dev.: 0.0126) MultiSource/Benchmarks/McCat/18-imp/imp: -5.78% (0.3581 => 0.3374, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.77% (0.6033 => 0.5685, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.77% (0.5168 => 0.4870, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.75% (0.7021 => 0.6617, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.75% (0.5570 => 0.5250, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -5.74% (2.4021 => 2.2642, std.dev.: 0.0045) MultiSource/Applications/SIBsim4/SIBsim4: -5.73% (1.3864 => 1.3069, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: -5.73% (15.5079 => 14.6187, std.dev.: 0.0137) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.73% (0.2548 => 0.2402, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.72% (0.5456 => 0.5144, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.68% (0.6667 => 0.6288, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -5.68% (0.7447 => 0.7024, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.68% (2.2587 => 2.1305, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.67% (0.5569 => 0.5253, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.67% (0.9557 => 0.9015, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.67% (0.2999 => 0.2829, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.66% (0.2278 => 0.2149, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: -5.66% (3.5154 => 3.3164, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.66% (0.6660 => 0.6283, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.65% (0.5999 => 0.5660, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.65% (0.5859 => 0.5528, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -5.64% (0.4861 => 0.4587, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.64% (5.4682 => 5.1600, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/ary2: -5.63% (0.3481 => 0.3285, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -5.63% (0.3446 => 0.3252, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.63% (0.3837 => 0.3621, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.63% (0.6395 => 0.6035, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.60% (0.5567 => 0.5255, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: -5.60% (0.4515 => 0.4262, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.60% (0.6676 => 0.6302, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary: -5.60% (0.3394 => 0.3204, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.60% (0.5575 => 0.5263, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.59% (0.4916 => 0.4641, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.59% (0.3255 => 0.3073, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -5.59% (0.2989 => 0.2822, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: -5.58% (2.1401 => 2.0207, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.57% (0.5329 => 0.5032, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.56% (0.4083 => 0.3856, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: -5.56% (0.4248 => 0.4012, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -5.55% (0.3026 => 0.2858, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -5.55% (0.3621 => 0.3420, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.50% (0.3016 => 0.2850, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.50% (2.1713 => 2.0518, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: -5.50% (0.6750 => 0.6379, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.50% (0.3057 => 0.2889, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.49% (0.5941 => 0.5615, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.47% (0.7198 => 0.6804, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists1: -5.46% (0.3867 => 0.3656, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.43% (0.2871 => 0.2715, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.41% (8.0126 => 7.5788, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.41% (0.3252 => 0.3076, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.41% (0.8521 => 0.8060, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.41% (0.2385 => 0.2256, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.41% (0.2903 => 0.2746, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.40% (0.3849 => 0.3641, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.40% (0.4427 => 0.4188, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.40% (0.5688 => 0.5381, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -5.39% (0.3059 => 0.2894, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.39% (0.3491 => 0.3303, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.37% (0.4321 => 0.4089, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.37% (1.2221 => 1.1565, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: -5.37% (0.3205 => 0.3033, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.36% (1.2210 => 1.1556, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hello: -5.34% (0.2849 => 0.2697, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.32% (0.2933 => 0.2777, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -5.31% (0.2939 => 0.2783, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.30% (0.4813 => 0.4558, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/methcall: -5.29% (0.3025 => 0.2865, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -5.28% (0.3788 => 0.3588, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -5.28% (34.0927 => 32.2939, std.dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: -5.25% (15.2527 => 14.4526, std.dev.: 0.0108) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.18% (0.3319 => 0.3147, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.18% (0.2106 => 0.1997, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -5.16% (18.2933 => 17.3492, std.dev.: 0.0078) MultiSource/Applications/lambda-0_1_3/lambda: -5.11% (0.7982 => 0.7574, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -5.07% (0.3194 => 0.3032, std.dev.: 0.0034) MultiSource/Applications/spiff/spiff: -5.04% (0.8418 => 0.7994, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/09-vor/vor: -4.98% (0.3271 => 0.3108, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: -4.95% (0.4524 => 0.4300, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -4.94% (5.0226 => 4.7744, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.88% (0.3931 => 0.3739, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.78% (0.3323 => 0.3164, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.56% (0.9077 => 0.8663, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/Hello: -4.49% (0.6347 => 0.6062, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.36% (0.6441 => 0.6160, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.31% (0.7779 => 0.7444, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: -4.16% (1.5610 => 1.4960, std.dev.: 0.0066) SingleSource/UnitTests/Vector/constpool: -2.40% (20.7746 => 20.2755, std.dev.: 0.0102) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7581, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/richards_benchmark: -8.66% (1.2842 => 1.1730, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7068, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.62% (2.2633 => 2.1813, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.36% (1.0557 => 1.0202, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.84% (1.3096 => 1.2724, std.dev.: 0.0074) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4719, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0001) Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 6 19:21:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 6 Nov 2012 21:21:49 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121107032149.970082A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5640?compare_to=5638&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5640, Order: 167515, Start Time: 2012-11-07 01:54:50, End Time: 2012-11-07 03:21:58 To: 5638, Order: 167504, Start Time: 2012-11-07 00:11:03, End Time: 2012-11-07 01:37:33 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 17 (105 on baseline) Performance Improvements: 2 (25 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 972 (844 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 19.46% (0.0735 => 0.0878, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 16.69% (0.0767 => 0.0895, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.46% (0.2141 => 0.2258, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.36% (0.8622 => 0.9084, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.30% (0.3262 => 0.3435, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/05-eks/eks: 4.62% (0.4370 => 0.4572, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: 3.91% (0.2967 => 0.3083, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 3.89% (0.3164 => 0.3287, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.66% (0.9496 => 0.9844, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.20% (0.5033 => 0.5194, std.dev.: 0.0035) MultiSource/Applications/spiff/spiff: 2.62% (0.8251 => 0.8467, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/gs/gs: 1.79% (4.1883 => 4.2634, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.32% (8.7782 => 8.8940, std.dev.: 0.0441) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 12.48% (6.2536 => 7.0341, std.dev.: 0.0770) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.39% (1.3520 => 1.3978, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.65% (22.0435 => 22.6266, std.dev.: 0.0555) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.05% (2.7537 => 2.7825, std.dev.: 0.0077) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.16% (0.8886 => 0.8783, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.09% (14.8926 => 14.2840, std.dev.: 0.1157) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.05% (16.6585 => 16.6663, std.dev.: 0.0719) MultiSource/Applications/obsequi/Obsequi: 0.82% (1.0686 => 1.0774, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.48% (21.6667 => 21.7701, std.dev.: 0.3453) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.08% (0.3655 => 0.3658, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 0.58% (0.6034 => 0.6069, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.42% (0.3315 => 0.3329, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/strcat: 0.05% (0.2001 => 0.2002, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -38.99% (0.0218 => 0.0133, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -11.29% (0.0425 => 0.0377, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.94% (0.0332 => 0.0299, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -21.86% (0.0311 => 0.0243, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 16.21% (0.0364 => 0.0423, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 0.50% (0.0202 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -4.63% (0.0216 => 0.0206, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: - (0.1448 => 0.1448, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 4.53% (1.1233 => 1.1742, std.dev.: 0.0347) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: - (0.1513 => 0.1513, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.24% (0.4213 => 0.4223, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.69% (0.1378 => 0.1484, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.49% (0.0590 => 0.0534, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 9.29% (0.0226 => 0.0247, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.59% (0.0565 => 0.0556, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.21% (1.1965 => 1.1940, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 600.00% (0.0001 => 0.0007, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0002 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.18% (0.0561 => 0.0560, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 36.26% (0.0182 => 0.0248, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.41% (0.7747 => 0.7856, std.dev.: 0.0090) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -37.14% (0.0070 => 0.0044, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2297.13% (0.6332 => 15.1786, std.dev.: 0.3341) MultiSource/Benchmarks/McCat/08-main/main: 48.61% (0.1831 => 0.2721, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.08% (0.1559 => 0.1433, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1488.61% (0.3344 => 5.3123, std.dev.: 0.0772) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.89% (0.2364 => 0.3236, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel: 2.56% (0.0429 => 0.0440, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.70% (0.0224 => 0.0239, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0009) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4186, std.dev.: 0.0395) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0724, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4947) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3428, std.dev.: 0.2194) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1395, std.dev.: 0.0228) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4018, std.dev.: 0.0049) SingleSource/Regression/C/uint64_to_float: -23.80% (2.1832 => 1.6635, std.dev.: 0.0040) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.27% (0.0810 => 0.0958, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 13.94% (0.1112 => 0.1267, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.58% (0.0773 => 0.0878, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.13% (0.0830 => 0.0939, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.68% (0.1157 => 0.1269, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.50% (0.3137 => 0.3435, std.dev.: 0.0060) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.17% (0.8321 => 0.9084, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.44% (0.2180 => 0.2364, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.07% (0.2279 => 0.2463, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.93% (0.1425 => 0.1538, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.66% (0.1905 => 0.2051, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.16% (0.4847 => 0.5194, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.74% (0.7473 => 0.7977, std.dev.: 0.0131) MultiSource/Applications/spiff/spiff: 6.50% (0.7950 => 0.8467, std.dev.: 0.0068) MultiSource/Applications/hbd/hbd: 6.21% (1.4269 => 1.5155, std.dev.: 0.0320) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.90% (0.8148 => 0.8629, std.dev.: 0.0132) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.86% (0.2133 => 0.2258, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.61% (0.3295 => 0.3480, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.39% (1.1606 => 1.2231, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.36% (0.2240 => 0.2360, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.15% (1.1685 => 1.2287, std.dev.: 0.0101) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.09% (0.1983 => 0.2084, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.97% (0.5961 => 0.6257, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.80% (0.2519 => 0.2640, std.dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: 4.47% (0.2999 => 0.3133, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.33% (0.9435 => 0.9844, std.dev.: 0.0064) MultiSource/Applications/Burg/burg: 4.16% (1.2222 => 1.2730, std.dev.: 0.0157) MultiSource/Benchmarks/McCat/05-eks/eks: 3.98% (0.4397 => 0.4572, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.76% (0.5817 => 0.6036, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.34% (0.3717 => 0.3841, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.31% (0.6287 => 0.6495, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/gs/gs: 3.22% (4.1305 => 4.2634, std.dev.: 0.0079) MultiSource/Applications/lua/lua: 3.12% (3.8189 => 3.9382, std.dev.: 0.0459) MultiSource/Applications/ClamAV/clamscan: 2.98% (14.7684 => 15.2081, std.dev.: 0.1136) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.85% (8.6476 => 8.8940, std.dev.: 0.0441) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.72% (1.4479 => 1.4873, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.18% (0.8697 => 0.8887, std.dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 2.17% (1.1271 => 1.1516, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.11% (4.4880 => 4.5826, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.06% (0.8317 => 0.8488, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.03% (0.8712 => 0.8889, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.03% (0.8340 => 0.8509, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.00% (0.8611 => 0.8783, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.99% (0.6586 => 0.6717, std.dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: 1.97% (31.8598 => 32.4866, std.dev.: 0.1063) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (0.9908 => 1.0101, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.95% (0.8069 => 0.8226, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.93% (0.8457 => 0.8620, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.92% (0.7966 => 0.8119, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.88% (0.7932 => 0.8081, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.88% (0.8050 => 0.8201, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.86% (0.9688 => 0.9868, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.84% (0.8716 => 0.8876, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.81% (0.8286 => 0.8436, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.80% (0.8656 => 0.8812, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.78% (0.8518 => 0.8670, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.77% (0.8086 => 0.8229, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.73% (0.8805 => 0.8957, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.68% (0.9056 => 0.9208, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.67% (0.8204 => 0.8341, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.63% (0.8855 => 0.8999, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.62% (0.8331 => 0.8466, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.61% (0.8261 => 0.8394, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.60% (0.8316 => 0.8449, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.59% (0.8066 => 0.8194, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.53% (0.8885 => 0.9021, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.52% (1.1170 => 1.1340, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.52% (0.9074 => 0.9212, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.52% (0.9039 => 0.9176, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.50% (0.8420 => 0.8546, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 1.31% (8.6247 => 8.7377, std.dev.: 0.0273) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 111.06% (0.0199 => 0.0420, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/pi: 57.36% (1.5795 => 2.4855, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.37% (2.9753 => 3.4624, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.15% (0.7597 => 0.8824, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.57% (2.7995 => 3.2073, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.63% (5.0261 => 5.6105, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.09% (1.1857 => 1.2816, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/queens: 7.33% (1.7056 => 1.8306, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: 6.87% (1.3037 => 1.3933, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.77% (4.7794 => 5.1029, std.dev.: 0.0043) MultiSource/Applications/SIBsim4/SIBsim4: 6.21% (3.1873 => 3.3853, std.dev.: 0.0252) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.92% (4.5327 => 4.8012, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.45% (3.3761 => 3.5263, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.30% (6.2275 => 6.4950, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.24% (4.9453 => 5.1551, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.06% (4.9469 => 5.1478, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 3.87% (14.0064 => 14.5490, std.dev.: 0.0156) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.57% (0.3587 => 0.3715, std.dev.: 0.0029) MultiSource/Applications/siod/siod: 2.91% (3.6643 => 3.7708, std.dev.: 0.0389) MultiSource/Applications/lambda-0_1_3/lambda: 2.83% (7.4933 => 7.7056, std.dev.: 0.0176) SingleSource/Benchmarks/Shootout-C++/hash: 2.82% (0.6205 => 0.6380, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.81% (11.5690 => 11.8941, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.68% (4.8660 => 4.9962, std.dev.: 0.0222) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.64% (8.2783 => 8.4967, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: 2.38% (7.3375 => 7.5119, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.01% (4.8362 => 4.9334, std.dev.: 0.0307) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.97% (2.4647 => 2.5133, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.87% (1.1365 => 1.1577, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.74% (1.5941 => 1.6219, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.47% (22.2997 => 22.6266, std.dev.: 0.0555) MultiSource/Benchmarks/Olden/power/power: 1.20% (1.2061 => 1.2206, std.dev.: 0.0017) SingleSource/Benchmarks/Stanford/FloatMM: 1.14% (0.8807 => 0.8907, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: 1.12% (8.5322 => 8.6281, std.dev.: 0.0157) MultiSource/Benchmarks/FreeBench/neural/neural: 1.11% (1.0841 => 1.0961, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.19% (5.4641 => 4.3064, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.79% (1.0512 => 0.9378, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -8.54% (63.1822 => 57.7885, std.dev.: 0.0919) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.93% (4.7482 => 4.4190, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.39% (0.3269 => 0.3060, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.94% (3.7148 => 3.4942, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.76% (5.4972 => 5.1805, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.09% (5.1557 => 4.8931, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.43% (2.8773 => 2.7498, std.dev.: 0.0389) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.35% (4.7449 => 4.5385, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.77% (6.0224 => 5.7952, std.dev.: 0.0120) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.07% (28.5821 => 27.7034, std.dev.: 0.1368) MultiSource/Benchmarks/Prolangs-C++/life/life: -3.01% (2.6356 => 2.5563, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.79% (0.5807 => 0.5645, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bisort/bisort: -2.79% (0.6636 => 0.6451, std.dev.: 0.0040) MultiSource/Applications/lua/lua: -2.69% (29.8330 => 29.0302, std.dev.: 0.2478) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.67% (9.9065 => 9.6424, std.dev.: 0.0200) MultiSource/Applications/aha/aha: -2.53% (3.3398 => 3.2552, std.dev.: 0.0275) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.47% (14.6451 => 14.2840, std.dev.: 0.1157) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.99% (11.5316 => 11.3020, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.64% (2.3487 => 2.3102, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: -1.48% (3.4237 => 3.3730, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.48% (4.9994 => 4.9255, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.39% (3.2169 => 3.1722, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.23% (5.6343 => 5.5651, std.dev.: 0.0019) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.34% (16.4461 => 16.6663, std.dev.: 0.0719) MultiSource/Applications/obsequi/Obsequi: 4.99% (1.0262 => 1.0774, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6870.89% (0.3123 => 21.7701, std.dev.: 0.3453) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.52% (0.2463 => 0.3658, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 0.98% (0.6010 => 0.6069, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.93% (0.3266 => 0.3329, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/strcat: 1.68% (0.1969 => 0.2002, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 8.13% (0.0123 => 0.0133, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -7.60% (0.0408 => 0.0377, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 17.72% (0.0254 => 0.0299, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -19.54% (0.0302 => 0.0243, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 14.44% (0.0180 => 0.0206, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.70% (0.1438 => 0.1448, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 3.65% (1.1329 => 1.1742, std.dev.: 0.0347) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.49% (0.1462 => 0.1513, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.42% (0.4164 => 0.4223, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.40% (0.1369 => 0.1484, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -16.69% (0.0641 => 0.0534, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 26.67% (0.0195 => 0.0247, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.81% (0.0578 => 0.0556, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.40% (1.1437 => 1.1940, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 600.00% (0.0001 => 0.0007, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.69% (0.0627 => 0.0560, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 37.78% (0.0180 => 0.0248, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.01% (0.8017 => 0.7856, std.dev.: 0.0090) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -29.03% (0.0062 => 0.0044, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 6 19:29:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 6 Nov 2012 21:29:01 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121107032901.D4CE32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5641?compare_to=5635&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5641, Order: 167499, Start Time: 2012-11-07 00:13:24, End Time: 2012-11-07 03:29:09 To: 5635, Order: 167478, Start Time: 2012-11-06 20:09:22, End Time: 2012-11-06 23:25:17 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (170 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (721 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.33% (125.3135 => 129.4907, std.dev.: 0.9815) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.43% (54.0972 => 54.8720, std.dev.: 0.0570) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.68% (0.0625 => 0.0873) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.23% (0.1063 => 0.1395, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.10% (0.2969 => 0.3744, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.32% (0.1106 => 0.1386, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.59% (0.4253 => 0.5299, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.51% (0.0714 => 0.0889, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.11% (0.4139 => 0.5137, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 23.56% (1.5932 => 1.9685, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.54% (0.5900 => 0.7289, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.09% (0.4994 => 0.6147, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.95% (0.0584 => 0.0718, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.85% (0.0547 => 0.0672) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.60% (0.5000 => 0.6130, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 21.62% (0.0481 => 0.0585, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.60% (0.1620 => 0.1970, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 21.54% (0.0599 => 0.0728, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.52% (0.0897 => 0.1090, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.35% (0.1021 => 0.1239, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.23% (0.1107 => 0.1342, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.94% (0.1103 => 0.1334, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 20.57% (0.0948 => 0.1143, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.06% (0.0633 => 0.0760, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.03% (0.0584 => 0.0701, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.94% (0.0642 => 0.0770, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.93% (0.3903 => 0.4681, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.82% (0.1549 => 0.1856, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.64% (0.1003 => 0.1200, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 19.61% (0.0821 => 0.0982, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.59% (0.0822 => 0.0983, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.51% (0.1604 => 0.1917, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 19.46% (0.1619 => 0.1934, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.74% (0.1462 => 0.1736, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 18.48% (0.0947 => 0.1122, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.30% (0.3890 => 0.4602, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.93% (0.1160 => 0.1368, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.92% (0.2014 => 0.2375, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: 17.90% (0.5826 => 0.6869, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 17.73% (0.1218 => 0.1434, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.53% (1.3152 => 1.5458, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 17.51% (0.5889 => 0.6920, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.43% (0.2736 => 0.3213, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 17.37% (0.4029 => 0.4729, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.37% (0.1088 => 0.1277, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 17.14% (0.1505 => 0.1763, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.99% (0.2866 => 0.3353, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.72% (0.1968 => 0.2297, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 16.70% (0.5546 => 0.6472, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.62% (3.5627 => 4.1548, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/gs/gs: 16.55% (1.8794 => 2.1905, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.45% (0.5026 => 0.5853, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.44% (0.4658 => 0.5424, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.24% (0.2875 => 0.3342, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.20% (1.6211 => 1.8837, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.14% (0.3271 => 0.3799, std.dev.: 0.0072) MultiSource/Applications/hbd/hbd: 16.11% (0.9697 => 1.1259, std.dev.: 0.0042) MultiSource/Applications/d/make_dparser: 16.01% (1.0781 => 1.2507, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 15.76% (0.1421 => 0.1645, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.68% (0.4361 => 0.5045, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 15.64% (0.2750 => 0.3180, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 15.60% (0.7171 => 0.8290, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/fibo: 15.52% (0.2725 => 0.3148, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 15.51% (0.2714 => 0.3135, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.49% (0.2738 => 0.3162, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.47% (0.3930 => 0.4538, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.45% (4.4195 => 5.1023, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/bh/bh: 15.42% (0.1284 => 0.1482, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 15.29% (0.9909 => 1.1424, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 15.28% (4.2109 => 4.8545, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.28% (0.2729 => 0.3146, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 15.25% (0.2780 => 0.3204, std.dev.: 0.0069) SingleSource/Regression/C++/ofstream_ctor: 15.21% (0.3004 => 0.3461, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.21% (0.3195 => 0.3681, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.19% (0.2792 => 0.3216, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 15.18% (0.2813 => 0.3240, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 15.16% (0.2803 => 0.3228, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 15.16% (0.2823 => 0.3251, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 15.12% (0.2811 => 0.3236, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 15.08% (0.3096 => 0.3563, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.01% (0.2911 => 0.3348, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.01% (2.7292 => 3.1388, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.90% (2.0673 => 2.3753, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 14.88% (0.3267 => 0.3753, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 14.73% (0.3258 => 0.3738, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.71% (1.9694 => 2.2591, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.68% (0.1090 => 0.1250, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.66% (0.3362 => 0.3855, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 14.53% (0.3317 => 0.3799, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.52% (1.9966 => 2.2865, std.dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 14.34% (0.2566 => 0.2934, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 14.31% (23.5202 => 26.8867, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/football/football: 14.22% (0.2075 => 0.2370, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.22% (0.3060 => 0.3495, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 14.07% (0.3348 => 0.3819, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.96% (0.3124 => 0.3560, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.91% (0.3845 => 0.4380, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 13.84% (0.3678 => 0.4187, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.71% (0.3282 => 0.3732, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 13.69% (0.3726 => 0.4236, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 13.63% (0.3477 => 0.3951, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.60% (0.3625 => 0.4118, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 13.56% (1.4269 => 1.6204, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 13.43% (0.4251 => 0.4822, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 13.41% (0.7875 => 0.8931, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 13.36% (0.4146 => 0.4700, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.26% (0.3981 => 0.4509, std.dev.: 0.0037) MultiSource/Applications/JM/ldecod/ldecod: 13.13% (2.1653 => 2.4495, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.06% (0.3690 => 0.4172, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 12.79% (0.5012 => 0.5653, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-4: 12.76% (0.3465 => 0.3907, std.dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 12.74% (4.6177 => 5.2058, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/for-in: 12.61% (0.3496 => 0.3937, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.59% (0.3488 => 0.3927, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 12.57% (2.1013 => 2.3655, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 12.51% (0.3446 => 0.3877, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.46% (0.3442 => 0.3871, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.43% (0.3460 => 0.3890, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/synchronized: 12.40% (0.3469 => 0.3899, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.35% (0.2040 => 0.2292, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 12.24% (0.3643 => 0.4089, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.16% (0.3650 => 0.4094, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.06% (0.3724 => 0.4173, std.dev.: 0.0058) MultiSource/Applications/SIBsim4/SIBsim4: 12.04% (0.2691 => 0.3015, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.39% (0.6435 => 0.7168, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 11.29% (5.5417 => 6.1671, std.dev.: 0.0071) MultiSource/Applications/lambda-0_1_3/lambda: 11.01% (0.3498 => 0.3883, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.70% (0.1028 => 0.1138, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 10.69% (0.6634 => 0.7343, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.69% (0.2068 => 0.2289, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.56% (0.1383 => 0.1529, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.49% (0.2737 => 0.3024, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.99% (0.3084 => 0.3392, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 9.99% (0.4847 => 0.5331, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 9.80% (0.3336 => 0.3663, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 9.55% (2.0346 => 2.2289, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.51% (0.2103 => 0.2303, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 9.37% (0.2391 => 0.2615, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.29% (4.6926 => 5.0818, std.dev.: 0.0150) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.23% (0.5361 => 0.5802, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.21% (11.6398 => 12.5953, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.88% (0.5584 => 0.6024, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.73% (0.7426 => 0.8000, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 6.65% (11.9555 => 12.7509, std.dev.: 0.0109) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.30% (0.3792 => 0.3917, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 9.21% (0.2802 => 0.3060, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6121, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.28% (0.3693 => 0.3925, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.10% (12.0509 => 12.6650, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1671, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-2: 4.53% (1.8057 => 1.8875, std.dev.: 0.0046) SingleSource/Benchmarks/Dhrystone/dry: 4.15% (14.0481 => 14.6312, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2094, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2244, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.50% (7.1849 => 7.2926, std.dev.: 0.0029) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3036, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5840, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5548, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/ary2: -8.53% (0.2402 => 0.2197, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9767, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7859, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8059, std.dev.: 0.0025) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.95% (17.2379 => 16.7290, std.dev.: 0.0426) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.92% (0.6293 => 0.6109, std.dev.: 0.0055) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8716, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5730, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4965, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.2036, std.dev.: 0.0614) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0444, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 6 20:00:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 6 Nov 2012 22:00:50 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121107040050.0807F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5642?compare_to=5639&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5642, Order: 167521, Start Time: 2012-11-07 02:36:07, End Time: 2012-11-07 04:00:57 To: 5639, Order: 167508, Start Time: 2012-11-07 00:48:10, End Time: 2012-11-07 02:13:01 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 1 (184 on baseline) Unchanged Tests: 1040 (853 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.38% (1.2724 => 1.2900, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.19% (2.0518 => 2.0273, std.dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1016, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/salsa20: 2.56% (7.4937 => 7.6857, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/hash2: 2.30% (3.1932 => 3.2667, std.dev.: 0.0027) MultiSource/Benchmarks/llubenchmark/llu: 1.52% (3.7435 => 3.8004, std.dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.08% (0.1431 => 0.1301, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.24% (0.3821 => 0.3506, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -8.14% (2.4924 => 2.2894, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.38% (0.3142 => 0.2910, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.26% (0.9542 => 0.8849, std.dev.: 0.0101) SingleSource/UnitTests/ObjC/trivial-interface: -7.24% (0.3812 => 0.3536, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -7.20% (0.3831 => 0.3555, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -7.15% (0.3848 => 0.3573, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -7.14% (0.3880 => 0.3603, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -7.11% (0.3896 => 0.3619, std.dev.: 0.0055) MultiSource/Applications/sgefa/sgefa: -7.09% (0.3357 => 0.3119, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.05% (0.3884 => 0.3610, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.04% (0.2428 => 0.2257, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -7.04% (0.4033 => 0.3749, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.04% (0.3891 => 0.3617, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.97% (0.4176 => 0.3885, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -6.90% (0.2160 => 0.2011, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.89% (0.4151 => 0.3865, std.dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: -6.88% (16.1920 => 15.0779, std.dev.: 0.0079) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.78% (22.4056 => 20.8867, std.dev.: 0.0198) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.75% (0.3658 => 0.3411, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -6.74% (0.4199 => 0.3916, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.72% (3.5339 => 3.2963, std.dev.: 0.0152) MultiSource/Applications/JM/ldecod/ldecod: -6.70% (7.0961 => 6.6205, std.dev.: 0.0124) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.67% (0.2355 => 0.2198, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -6.66% (0.3481 => 0.3249, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.66% (9.2283 => 8.6135, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.65% (0.9852 => 0.9197, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.63% (2.1713 => 2.0273, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -6.62% (0.2989 => 0.2791, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: -6.62% (0.9179 => 0.8571, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.62% (0.3323 => 0.3103, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.61% (1.0544 => 0.9847, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -6.60% (1.3148 => 1.2280, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: -6.60% (0.3394 => 0.3170, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.59% (0.6484 => 0.6057, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.57% (6.7716 => 6.3267, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.56% (0.3016 => 0.2818, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -6.54% (0.4280 => 0.4000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.54% (4.8161 => 4.5011, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.54% (4.0323 => 3.7686, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/matrix: -6.51% (0.3255 => 0.3043, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: -6.51% (0.3026 => 0.2829, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.50% (0.1584 => 0.1481, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.50% (1.2784 => 1.1953, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.49% (0.3837 => 0.3588, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.48% (1.3722 => 1.2833, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -6.48% (0.2871 => 0.2685, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -6.46% (0.3621 => 0.3387, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -6.46% (1.2515 => 1.1707, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.45% (1.6364 => 1.5308, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.44% (0.3057 => 0.2860, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.44% (0.3849 => 0.3601, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -6.44% (4.3330 => 4.0540, std.dev.: 0.0033) SingleSource/Regression/C++/ofstream_ctor: -6.41% (0.3059 => 0.2863) MultiSource/Benchmarks/nbench/nbench: -6.40% (1.1530 => 1.0792, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: -6.39% (0.2659 => 0.2489, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -6.38% (0.3446 => 0.3226, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.38% (0.3025 => 0.2832, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -6.38% (1.1450 => 1.0720, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.37% (1.4642 => 1.3709, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.37% (4.5069 => 4.2200, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/random: -6.36% (0.2939 => 0.2752, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.35% (0.1621 => 0.1518, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -6.34% (0.2933 => 0.2747, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: -6.32% (0.3194 => 0.2992, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.32% (1.2300 => 1.1523, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -6.31% (0.3867 => 0.3623, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.30% (0.2903 => 0.2720, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.30% (0.3252 => 0.3047, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.30% (0.1761 => 0.1650, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -6.30% (0.4861 => 0.4555, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.29% (4.8802 => 4.5730, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.29% (0.4083 => 0.3826, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.28% (1.6474 => 1.5439, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: -6.26% (0.4427 => 0.4150, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -6.26% (0.3788 => 0.3551, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.26% (14.2083 => 13.3194, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.25% (0.4813 => 0.4512, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.25% (0.7919 => 0.7424, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: -6.25% (0.2849 => 0.2671, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -6.23% (0.2985 => 0.2799, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.22% (0.6736 => 0.6317, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.20% (0.2695 => 0.2528, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.18% (0.3931 => 0.3688, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: -6.18% (0.4515 => 0.4236, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -6.18% (0.3205 => 0.3007, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.18% (0.1716 => 0.1610, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.15% (0.5857 => 0.5497, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -6.11% (0.3406 => 0.3198, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.10% (0.6293 => 0.5909) MultiSource/Applications/minisat/minisat: -6.08% (0.7447 => 0.6994, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.08% (0.5168 => 0.4854, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -6.07% (0.4248 => 0.3990, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.07% (0.7198 => 0.6761, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.06% (0.9557 => 0.8978, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.04% (0.3491 => 0.3280, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.04% (0.2548 => 0.2394, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.03% (0.3483 => 0.3273, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.02% (0.7524 => 0.7071, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.02% (0.5999 => 0.5638, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.00% (0.6681 => 0.6280, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: -5.99% (15.5079 => 14.5785, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.98% (0.7339 => 0.6900, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.98% (0.6052 => 0.5690, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -5.98% (17.1032 => 16.0810, std.dev.: 0.0205) MultiSource/Benchmarks/McCat/18-imp/imp: -5.98% (0.3581 => 0.3367, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -5.97% (0.6750 => 0.6347, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.97% (0.7021 => 0.6602, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.96% (0.4916 => 0.4623, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.96% (0.6395 => 0.6014, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.96% (0.6446 => 0.6062, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.96% (0.6230 => 0.5859, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.95% (0.6304 => 0.5929, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.95% (0.5802 => 0.5457, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.93% (0.6440 => 0.6058, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.93% (0.2278 => 0.2143, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.93% (0.5805 => 0.5461, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.91% (0.5478 => 0.5154, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -5.91% (34.0927 => 32.0772, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.90% (0.2999 => 0.2822, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.90% (0.5863 => 0.5517, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.90% (5.4682 => 5.1456, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.89% (0.6194 => 0.5829, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.88% (0.5591 => 0.5262, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.88% (0.5849 => 0.5505, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.88% (0.6260 => 0.5892, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.88% (0.6297 => 0.5927, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.87% (0.5705 => 0.5370, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: -5.86% (3.5154 => 3.3093, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.86% (8.0126 => 7.5430, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.86% (0.5581 => 0.5254, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.86% (0.5925 => 0.5578, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -5.83% (4.0594 => 3.8226, std.dev.: 0.0074) MultiSource/Applications/SIBsim4/SIBsim4: -5.83% (1.3864 => 1.3056, std.dev.: 0.0160) MultiSource/Applications/treecc/treecc: -5.83% (2.1401 => 2.0154, std.dev.: 0.0016) MultiSource/Applications/siod/siod: -5.81% (2.4021 => 2.2625, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.81% (0.6660 => 0.6273, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.80% (0.5570 => 0.5247, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.80% (0.8521 => 0.8027, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: -5.79% (0.4524 => 0.4262, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.79% (0.5859 => 0.5520, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.78% (0.6189 => 0.5831, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.77% (0.6667 => 0.6282, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.76% (0.5569 => 0.5248, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.76% (0.4321 => 0.4072, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.76% (2.2587 => 2.1287, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.76% (0.5456 => 0.5142, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.75% (0.6033 => 0.5686, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.75% (0.5567 => 0.5247, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.72% (0.5575 => 0.5256, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.70% (0.2385 => 0.2249, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.69% (0.6676 => 0.6296, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.66% (0.6395 => 0.6033, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: -5.66% (0.6347 => 0.5988, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.65% (0.5329 => 0.5028, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.64% (1.2221 => 1.1532, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.63% (0.3319 => 0.3132, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -5.60% (18.2933 => 17.2694, std.dev.: 0.0164) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.55% (1.2210 => 1.1532, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: -5.51% (0.7779 => 0.7350, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: -5.51% (0.6441 => 0.6086, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -5.49% (15.2527 => 14.4150, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.49% (0.5688 => 0.5376, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: -5.48% (0.1879 => 0.1776, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -5.45% (0.8418 => 0.7959, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.41% (0.2106 => 0.1992, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -5.37% (0.7982 => 0.7553, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -5.35% (0.3271 => 0.3096, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.34% (0.5941 => 0.5624, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.20% (0.2001 => 0.1897, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -5.16% (5.0226 => 4.7634, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.98% (0.9077 => 0.8625, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: -4.69% (1.5610 => 1.4878, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.61% (0.2277 => 0.2172, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.46% (20.7746 => 20.2640, std.dev.: 0.0346) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7568, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/richards_benchmark: -8.77% (1.2842 => 1.1716, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7068, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.81% (2.2633 => 2.1770, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.61% (6.5735 => 6.4679, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.50% (1.3096 => 1.2900, std.dev.: 0.0064) Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 6 21:04:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 6 Nov 2012 23:04:31 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121107050431.040BA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5643?compare_to=5640&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5643, Order: 167523, Start Time: 2012-11-07 03:38:45, End Time: 2012-11-07 05:04:41 To: 5640, Order: 167515, Start Time: 2012-11-07 01:54:50, End Time: 2012-11-07 03:21:58 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 4 (77 on baseline) Performance Improvements: 19 (24 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 968 (873 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.80% (0.3333 => 0.3493, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.05% (14.2840 => 14.8625, std.dev.: 0.1269) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.26% (40.1445 => 41.4526, std.dev.: 0.1660) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.72% (1.2367 => 1.2580, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.05% (0.2258 => 0.2144, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.72% (0.9084 => 0.8655, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.51% (0.2463 => 0.2352, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.20% (0.6257 => 0.5994, std.dev.: 0.0052) MultiSource/Applications/hbd/hbd: -3.96% (1.5155 => 1.4555, std.dev.: 0.0096) MultiSource/Applications/minisat/minisat: -2.61% (0.7154 => 0.6967, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.57% (1.2231 => 1.1917, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.46% (1.2287 => 1.1985, std.dev.: 0.0101) MultiSource/Benchmarks/MallocBench/gs/gs: -2.13% (4.2634 => 4.1725, std.dev.: 0.0298) MultiSource/Applications/lua/lua: -1.70% (3.9382 => 3.8712, std.dev.: 0.0200) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.68% (8.8940 => 8.7447, std.dev.: 0.0476) MultiSource/Applications/lambda-0_1_3/lambda: -1.61% (0.7692 => 0.7568, std.dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: -1.44% (1.0070 => 0.9925, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.32% (2.1893 => 2.1605, std.dev.: 0.0101) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.31% (6.8334 => 6.7441, std.dev.: 0.0322) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.28% (3.2487 => 3.2070, std.dev.: 0.0157) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -10.63% (7.0341 => 6.2864, std.dev.: 0.1049) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.42% (4.7375 => 4.5755, std.dev.: 0.0170) MultiSource/Applications/SPASS/SPASS: -1.23% (8.6289 => 8.5227, std.dev.: 0.0353) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.00% (16.6663 => 16.6658, std.dev.: 0.1905) MultiSource/Applications/obsequi/Obsequi: -2.31% (1.0774 => 1.0525, std.dev.: 0.0110) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.61% (21.7701 => 21.6369, std.dev.: 0.2547) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.30% (0.3658 => 0.3669, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: -0.59% (0.6069 => 0.6033, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.21% (0.3329 => 0.3336, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 0.25% (0.2002 => 0.2007, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 48.87% (0.0133 => 0.0198, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 12.73% (0.0377 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 10.70% (0.0299 => 0.0331, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 7.41% (0.0243 => 0.0261, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.09% (0.0423 => 0.0393, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0203 => 0.0204, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/test1: -19.42% (0.0206 => 0.0166, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1448 => 0.1445, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -2.35% (1.1742 => 1.1466, std.dev.: 0.0688) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1513 => 0.1460, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.64% (0.4223 => 0.4196, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.96% (0.1484 => 0.1440, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 13.30% (0.0534 => 0.0605, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.26% (0.0247 => 0.0234, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.16% (0.0556 => 0.0544, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.28% (1.1940 => 1.1906, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -85.71% (0.0007 => 0.0001, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.93% (0.0560 => 0.0638, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.23% (0.0248 => 0.0256, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.02% (0.7856 => 0.7776, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 20.45% (0.0044 => 0.0053, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2302.94% (0.6332 => 15.2154, std.dev.: 0.1333) MultiSource/Benchmarks/McCat/08-main/main: 47.13% (0.1831 => 0.2694, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -10.01% (0.1559 => 0.1403, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1487.56% (0.3344 => 5.3088, std.dev.: 0.0257) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.13% (0.2364 => 0.3218, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: 2.56% (0.0429 => 0.0440, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.23% (0.0224 => 0.0229, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -29.57% (0.0230 => 0.0162, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4179, std.dev.: 0.0129) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0696, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4896, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3542, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1298, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4012, std.dev.: 0.0023) SingleSource/Regression/C/uint64_to_float: -23.74% (2.1832 => 1.6650, std.dev.: 0.0095) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.28% (0.0810 => 0.0950, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 11.51% (0.1112 => 0.1240, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2998 => 0.3129, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.08% (0.7473 => 0.7778, std.dev.: 0.0109) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.01% (0.8321 => 0.8655, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.70% (0.6287 => 0.6457, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.68% (1.1606 => 1.1917, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.57% (1.1685 => 1.1985, std.dev.: 0.0101) MultiSource/Applications/SPASS/SPASS: 2.52% (14.2605 => 14.6196, std.dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.47% (1.4479 => 1.4837, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.40% (1.1170 => 1.1438, std.dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 2.34% (6.7320 => 6.8895, std.dev.: 0.0125) MultiSource/Applications/ClamAV/clamscan: 2.33% (14.7684 => 15.1132, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.33% (0.8697 => 0.8900, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.32% (0.9056 => 0.9266, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.17% (4.1763 => 4.2671, std.dev.: 0.0079) MultiSource/Applications/SIBsim4/SIBsim4: 2.14% (1.2568 => 1.2837, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.10% (0.8050 => 0.8219, std.dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.07% (6.6074 => 6.7441, std.dev.: 0.0322) MultiSource/Applications/hbd/hbd: 2.00% (1.4269 => 1.4555, std.dev.: 0.0096) MultiSource/Applications/siod/siod: 1.99% (2.2184 => 2.2625, std.dev.: 0.0043) MultiSource/Applications/d/make_dparser: 1.91% (3.2366 => 3.2985, std.dev.: 0.0199) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.82% (0.8340 => 0.8492, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.82% (0.8420 => 0.8573, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.81% (0.8656 => 0.8813, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.81% (0.7966 => 0.8110, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.80% (0.8177 => 0.8324, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.78% (4.4880 => 4.5677, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.77% (0.8069 => 0.8212, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.77% (1.6386 => 1.6676, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.76% (0.8855 => 0.9011, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.69% (0.8204 => 0.8343, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.69% (4.4873 => 4.5632, std.dev.: 0.0245) MultiSource/Benchmarks/nbench/nbench: 1.65% (1.1271 => 1.1457, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.62% (0.6586 => 0.6693, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.62% (1.2423 => 1.2624, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 1.61% (15.3280 => 15.5742, std.dev.: 0.0933) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.51% (13.1811 => 13.3801, std.dev.: 0.0705) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.50% (0.9069 => 0.9205, std.dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: 1.44% (2.3764 => 2.4107, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.44% (0.8885 => 0.9013, std.dev.: 0.0039) MultiSource/Applications/lua/lua: 1.37% (3.8189 => 3.8712, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.30% (0.8316 => 0.8424, std.dev.: 0.0038) MultiSource/Applications/lemon/lemon: 1.23% (1.0945 => 1.1080, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 1.17% (0.9810 => 0.9925, std.dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 1.07% (4.9628 => 5.0160, std.dev.: 0.0144) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 90.45% (0.0199 => 0.0379, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/pi: 57.14% (1.5795 => 2.4821, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.36% (0.7597 => 0.8840, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.48% (2.7995 => 3.2048, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6087, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.64% (0.3186 => 0.3493, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.15% (1.1857 => 1.2823, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 7.19% (1.7056 => 1.8283, std.dev.: 0.0053) MultiSource/Applications/SIBsim4/SIBsim4: 6.74% (3.1873 => 3.4021, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.62% (4.7794 => 5.0960, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/richards_benchmark: 6.01% (1.3037 => 1.3820, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.93% (4.9686 => 5.2630, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.91% (4.5327 => 4.8004, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.73% (3.3761 => 3.5357, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.58% (6.2275 => 6.5129, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.41% (4.9453 => 5.1634, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.12% (4.9469 => 5.1505, std.dev.: 0.0055) MultiSource/Applications/hexxagon/hexxagon: 3.87% (14.0064 => 14.5488, std.dev.: 0.0265) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.07% (0.3587 => 0.3697, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 2.76% (3.6643 => 3.7656, std.dev.: 0.0242) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.75% (8.2783 => 8.5061, std.dev.: 0.0116) MultiSource/Applications/lambda-0_1_3/lambda: 2.67% (7.4933 => 7.6937, std.dev.: 0.0276) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.56% (11.5690 => 11.8656, std.dev.: 0.0212) SingleSource/Benchmarks/Shootout/lists: 2.43% (7.3375 => 7.5160, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.30% (4.8660 => 4.9780, std.dev.: 0.0195) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.88% (4.8362 => 4.9272, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/hash: 1.69% (0.6205 => 0.6310, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.66% (2.4647 => 2.5055, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/ReedSolomon: 1.23% (8.5322 => 8.6370, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: 1.18% (2.3560 => 2.3838, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/power/power: 1.07% (1.2061 => 1.2190, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.17% (5.4641 => 4.3073, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.85% (7.2130 => 6.2864, std.dev.: 0.1049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.32% (1.0512 => 0.9322, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: -8.52% (63.1822 => 57.8000, std.dev.: 0.1193) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.80% (0.3269 => 0.3014, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -7.06% (4.7482 => 4.4130, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.02% (5.4972 => 5.1662, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.90% (3.7148 => 3.4955, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.12% (5.1557 => 4.8916, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.33% (4.7449 => 4.5393, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.21% (2.8773 => 2.7562, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.81% (6.0224 => 5.7928, std.dev.: 0.0232) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.03% (0.5807 => 0.5631, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.03% (28.5821 => 27.7173, std.dev.: 0.0292) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -3.00% (0.3937 => 0.3819, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.70% (2.6356 => 2.5645, std.dev.: 0.0036) MultiSource/Applications/lua/lua: -2.68% (29.8330 => 29.0347, std.dev.: 0.0389) MultiSource/Applications/aha/aha: -2.43% (3.3398 => 3.2586, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.99% (11.5316 => 11.3019, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: -1.69% (3.4237 => 3.3660, std.dev.: 0.0223) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.68% (3.2169 => 3.1629, std.dev.: 0.0161) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.55% (1.0388 => 1.0227, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.38% (2.3487 => 2.3164, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.16% (5.6343 => 5.5687, std.dev.: 0.0253) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.34% (16.4461 => 16.6658, std.dev.: 0.1905) MultiSource/Applications/obsequi/Obsequi: 2.56% (1.0262 => 1.0525, std.dev.: 0.0110) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6828.24% (0.3123 => 21.6369, std.dev.: 0.2547) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.96% (0.2463 => 0.3669, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 0.38% (0.6010 => 0.6033, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.14% (0.3266 => 0.3336, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 1.93% (0.1969 => 0.2007, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 60.98% (0.0123 => 0.0198, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -13.58% (0.0302 => 0.0261, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.34% (0.0384 => 0.0393, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/test1: -7.78% (0.0180 => 0.0166, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.49% (0.1438 => 0.1445, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.21% (1.1329 => 1.1466, std.dev.: 0.0688) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -0.14% (0.1462 => 0.1460, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.77% (0.4164 => 0.4196, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.19% (0.1369 => 0.1440, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.62% (0.0641 => 0.0605, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 20.00% (0.0195 => 0.0234, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.88% (0.0578 => 0.0544, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.10% (1.1437 => 1.1906, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.75% (0.0627 => 0.0638, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 42.22% (0.0180 => 0.0256, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.01% (0.8017 => 0.7776, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -14.52% (0.0062 => 0.0053, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 6 21:48:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 6 Nov 2012 23:48:42 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121107054842.6D5A62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5644?compare_to=5642&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5644, Order: 167523, Start Time: 2012-11-07 04:24:02, End Time: 2012-11-07 05:48:50 To: 5642, Order: 167521, Start Time: 2012-11-07 02:36:07, End Time: 2012-11-07 04:00:57 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 1 (184 on baseline) Unchanged Tests: 1041 (854 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.71% (1.2900 => 1.2679, std.dev.: 0.0081) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.72% (2.0478 => 2.1034, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/salsa20: 2.47% (7.4937 => 7.6788, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash2: 2.15% (3.1932 => 3.2619, std.dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.08% (0.1431 => 0.1301) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.27% (0.3821 => 0.3505, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -8.14% (2.4924 => 2.2895, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.35% (0.3142 => 0.2911, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.28% (0.9542 => 0.8847, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -7.16% (0.3812 => 0.3539, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -7.15% (0.3831 => 0.3557, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -7.12% (0.3848 => 0.3574, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.12% (0.3891 => 0.3614, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-4: -7.09% (0.3880 => 0.3605, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -7.06% (0.3896 => 0.3621, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.05% (0.3884 => 0.3610, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: -7.04% (0.4033 => 0.3749, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.99% (0.4176 => 0.3884, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -6.99% (0.2160 => 0.2009, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.97% (0.3357 => 0.3123, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.92% (0.2428 => 0.2260, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.87% (0.4151 => 0.3866, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -6.83% (16.1920 => 15.0857, std.dev.: 0.0160) SingleSource/UnitTests/ObjC/property: -6.74% (0.4199 => 0.3916, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -6.73% (9.2283 => 8.6068, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.73% (3.5339 => 3.2961, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.72% (0.3658 => 0.3412, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -6.72% (0.2989 => 0.2788, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.72% (22.4056 => 20.8996, std.dev.: 0.0176) SingleSource/UnitTests/ObjC/parameter-passing: -6.71% (0.4280 => 0.3993, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.68% (0.3323 => 0.3101, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: -6.68% (1.3148 => 1.2270, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.67% (2.1713 => 2.0265, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.66% (1.0544 => 0.9842, std.dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: -6.65% (7.0961 => 6.6241, std.dev.: 0.0081) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.64% (0.9852 => 0.9198, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.62% (0.2355 => 0.2199, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.62% (0.6484 => 0.6055, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: -6.61% (0.9179 => 0.8572, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -6.61% (0.3481 => 0.3251, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -6.61% (0.3255 => 0.3040, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -6.59% (0.3446 => 0.3219, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.58% (6.7716 => 6.3258, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/moments: -6.54% (0.4248 => 0.3970, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -6.54% (0.3026 => 0.2828, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -6.51% (0.3059 => 0.2860, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.50% (0.1584 => 0.1481, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.49% (0.3837 => 0.3588, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -6.49% (1.2515 => 1.1703, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.49% (4.0323 => 3.7708, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/fibo: -6.48% (0.2871 => 0.2685, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.48% (4.8161 => 4.5041, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.48% (0.3057 => 0.2859, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.47% (1.3722 => 1.2834, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.47% (0.3016 => 0.2821, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -6.46% (0.3621 => 0.3387, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.46% (0.1796 => 0.1680, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: -6.46% (4.3330 => 4.0532, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/ReedSolomon: -6.44% (0.1879 => 0.1758, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.44% (4.5069 => 4.2168, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: -6.42% (0.1761 => 0.1648, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.41% (1.6364 => 1.5315, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.41% (0.2903 => 0.2717, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -6.40% (0.2939 => 0.2751, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -6.39% (1.1530 => 1.0793, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.39% (0.3849 => 0.3603, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -6.39% (0.2849 => 0.2667, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -6.38% (0.4861 => 0.4551, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.36% (1.4642 => 1.3711, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.36% (1.2300 => 1.1518, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -6.36% (0.2659 => 0.2490, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.35% (4.8802 => 4.5702, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.35% (0.1716 => 0.1607, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -6.35% (1.1450 => 1.0723, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.34% (0.4083 => 0.3824, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -6.32% (0.3194 => 0.2992, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -6.31% (0.3867 => 0.3623, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -6.30% (0.3205 => 0.3003, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.29% (0.1621 => 0.1519, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.29% (14.2083 => 13.3151, std.dev.: 0.0255) SingleSource/Benchmarks/Shootout-C++/sieve: -6.28% (0.3788 => 0.3550, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -6.28% (0.4524 => 0.4240, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/nestedloop: -6.27% (0.2933 => 0.2749, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.27% (0.3252 => 0.3048, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.25% (0.3025 => 0.2836, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/spellcheck: -6.23% (0.4427 => 0.4151, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.23% (1.2784 => 1.1987, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.22% (0.6736 => 0.6317, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.21% (0.6293 => 0.5902, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.21% (0.3931 => 0.3687, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -6.20% (0.2985 => 0.2800, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.20% (0.2695 => 0.2528, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.19% (0.7919 => 0.7429, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.17% (0.4813 => 0.4516, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.16% (0.2548 => 0.2391, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.16% (0.4321 => 0.4055, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.15% (0.9557 => 0.8969, std.dev.: 0.0146) MultiSource/Benchmarks/McCat/18-imp/imp: -6.12% (0.3581 => 0.3362, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.11% (1.6474 => 1.5468, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/05-eks/eks: -6.09% (0.4515 => 0.4240, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.07% (0.7198 => 0.6761, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -6.07% (0.7447 => 0.6995, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.06% (0.7524 => 0.7068, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: -6.04% (15.5079 => 14.5714, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.04% (0.5168 => 0.4856, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.02% (0.6230 => 0.5855, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.02% (0.3491 => 0.3281, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.99% (0.5805 => 0.5457, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.97% (0.3483 => 0.3275, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -5.97% (0.6750 => 0.6347, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -5.97% (2.4021 => 2.2587, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.97% (0.5863 => 0.5513, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.97% (0.5478 => 0.5151, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -5.96% (17.1032 => 16.0841, std.dev.: 0.0257) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.96% (0.6395 => 0.6014, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.96% (0.6446 => 0.6062, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.95% (0.6304 => 0.5929, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.92% (0.5705 => 0.5367, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -5.92% (4.0594 => 3.8190, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: -5.92% (34.0927 => 32.0739, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.91% (0.7339 => 0.6905, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.91% (0.5802 => 0.5459, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.91% (0.6260 => 0.5890, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.91% (0.6297 => 0.5925, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: -5.89% (3.5154 => 3.3085, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.88% (8.0126 => 7.5414, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.86% (0.5849 => 0.5506, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.86% (5.4682 => 5.1478, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.86% (0.5925 => 0.5578, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.86% (0.5857 => 0.5514, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -5.84% (1.3864 => 1.3054, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.84% (0.5581 => 0.5255, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.83% (0.6052 => 0.5699, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.82% (0.5859 => 0.5518, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.81% (0.7021 => 0.6613, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.81% (0.6660 => 0.6273, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.80% (0.5570 => 0.5247, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.80% (0.8521 => 0.8027, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.80% (0.4916 => 0.4631, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: -5.78% (0.3406 => 0.3209, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: -5.78% (2.1401 => 2.0165, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.74% (0.5591 => 0.5270, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.70% (0.2385 => 0.2249, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.70% (0.6033 => 0.5689, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.68% (0.6194 => 0.5842, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: -5.67% (0.6347 => 0.5987, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.67% (0.6189 => 0.5838, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.67% (0.5575 => 0.5259, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.67% (0.5999 => 0.5659, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.66% (0.5456 => 0.5147, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.66% (0.2278 => 0.2149, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.65% (2.2587 => 2.1311, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.64% (0.5569 => 0.5255, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.64% (0.6440 => 0.6077, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -5.63% (0.7779 => 0.7341, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.63% (1.2210 => 1.1523, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.62% (0.6667 => 0.6292, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.62% (0.5567 => 0.5254, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.61% (0.5329 => 0.5030, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: -5.57% (18.2933 => 17.2748, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.56% (1.2221 => 1.1541, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.56% (0.6676 => 0.6305, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.54% (0.6681 => 0.6311, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -5.50% (0.6441 => 0.6087) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.47% (0.6395 => 0.6045, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.42% (0.5941 => 0.5619, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -5.42% (0.8418 => 0.7962, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.37% (0.2106 => 0.1993, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -5.36% (15.2527 => 14.4346, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: -5.35% (0.3271 => 0.3096, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -5.34% (0.7982 => 0.7556, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.30% (0.2999 => 0.2840, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.27% (0.3319 => 0.3144, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: -5.16% (5.0226 => 4.7634, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.10% (0.2001 => 0.1899, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.97% (0.9077 => 0.8626, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.66% (0.2277 => 0.2171, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -4.61% (1.5610 => 1.4890, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -2.42% (20.7746 => 20.2717, std.dev.: 0.0252) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7501, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.67% (2.2633 => 2.1802, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.18% (1.3096 => 1.2679, std.dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.01% (1.0557 => 1.0239, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.61% (6.5735 => 6.4675, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 6 22:47:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 7 Nov 2012 00:47:27 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121107064727.692FD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5645?compare_to=5643&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5645, Order: 167524, Start Time: 2012-11-07 05:21:30, End Time: 2012-11-07 06:47:37 To: 5643, Order: 167523, Start Time: 2012-11-07 03:38:45, End Time: 2012-11-07 05:04:41 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 13 (103 on baseline) Performance Improvements: 0 (23 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 978 (848 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/NPB-serial/is/is: 17.03% (0.0634 => 0.0742, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/mst/mst: 16.23% (0.1060 => 0.1232, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.33% (0.2232 => 0.2351, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.95% (0.5994 => 0.6231, std.dev.: 0.0088) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.48% (0.8655 => 0.8956, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.96% (1.3379 => 1.3775, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.39% (0.6457 => 0.6611, std.dev.: 0.0050) MultiSource/Applications/treecc/treecc: 2.01% (2.0280 => 2.0688, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/gs/gs: 1.88% (4.1725 => 4.2511, std.dev.: 0.0297) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.73% (1.1917 => 1.2123, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.70% (6.8505 => 7.3779, std.dev.: 0.1145) MultiSource/Benchmarks/Bullet/bullet: 1.47% (7.0859 => 7.1903, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/fp-convert: 1.00% (15.7246 => 15.8824, std.dev.: 0.0273) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.25% (16.6658 => 16.7080, std.dev.: 0.0339) MultiSource/Applications/obsequi/Obsequi: 1.19% (1.0525 => 1.0650, std.dev.: 0.0084) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.61% (21.6369 => 21.7691, std.dev.: 0.2709) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.30% (0.3669 => 0.3680, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: 0.03% (0.6033 => 0.6035, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.33% (0.3336 => 0.3347, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 1.49% (0.2007 => 0.2037, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 10.10% (0.0198 => 0.0218, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0425 => 0.0427, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0331 => 0.0331, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 20.31% (0.0261 => 0.0314, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.14% (0.0393 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -6.37% (0.0204 => 0.0191, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/test1: 8.43% (0.0166 => 0.0180, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.97% (0.1445 => 0.1431, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -3.66% (1.1466 => 1.1046, std.dev.: 0.0392) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.64% (0.1460 => 0.1484, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.15% (0.4196 => 0.4064, std.dev.: 0.0210) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.50% (0.1440 => 0.1404, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.31% (0.0605 => 0.0591, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.71% (0.0234 => 0.0230, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.70% (0.0544 => 0.0575, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.31% (1.1906 => 1.1943, std.dev.: 0.0326) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.80% (0.0638 => 0.0601, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.02% (0.0256 => 0.0215, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.78% (0.7776 => 0.7715, std.dev.: 0.0124) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 50.94% (0.0053 => 0.0080, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2306.36% (0.6332 => 15.2371, std.dev.: 0.0482) MultiSource/Benchmarks/McCat/08-main/main: 48.01% (0.1831 => 0.2710, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.48% (0.1559 => 0.1458, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1501.14% (0.3344 => 5.3542, std.dev.: 0.0503) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.28% (0.2364 => 0.3269, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.91% (0.0224 => 0.0235, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -27.83% (0.0230 => 0.0166, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4285, std.dev.: 0.0143) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0739, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4948, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3664, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1349, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4022, std.dev.: 0.0019) SingleSource/Regression/C/uint64_to_float: -23.31% (2.1832 => 1.6742, std.dev.: 0.0018) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.17% (0.0810 => 0.0941, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.20% (0.0773 => 0.0875, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.84% (0.2180 => 0.2351, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.63% (0.8321 => 0.8956, std.dev.: 0.0090) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.31% (0.3137 => 0.3335, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.89% (0.1885 => 0.1996, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.34% (0.7473 => 0.7872, std.dev.: 0.0154) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.25% (0.1905 => 0.2005, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.15% (0.6287 => 0.6611, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.00% (0.2279 => 0.2393, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.89% (0.3295 => 0.3456, std.dev.: 0.0052) MultiSource/Applications/Burg/burg: 4.65% (1.2222 => 1.2790, std.dev.: 0.0217) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.53% (0.5961 => 0.6231, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.45% (1.1606 => 1.2123, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.42% (0.8148 => 0.8508, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.40% (0.2998 => 0.3130, std.dev.: 0.0043) MultiSource/Applications/spiff/spiff: 4.40% (0.7950 => 0.8300, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.83% (1.1685 => 1.2133, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.74% (1.3279 => 1.3775, std.dev.: 0.0098) MultiSource/Applications/treecc/treecc: 3.71% (1.9948 => 2.0688, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.66% (0.4127 => 0.4278, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.55% (0.4783 => 0.4953, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 3.24% (14.2605 => 14.7224, std.dev.: 0.0727) MultiSource/Benchmarks/MallocBench/gs/gs: 2.92% (4.1305 => 4.2511, std.dev.: 0.0297) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.81% (0.5191 => 0.5337, std.dev.: 0.0034) MultiSource/Applications/JM/ldecod/ldecod: 2.81% (6.7320 => 6.9213, std.dev.: 0.0169) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.81% (0.6227 => 0.6402, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: 2.63% (0.3800 => 0.3900, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.59% (0.8697 => 0.8922, std.dev.: 0.0058) MultiSource/Applications/d/make_dparser: 2.51% (3.2366 => 3.3178, std.dev.: 0.0224) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.41% (4.1763 => 4.2768, std.dev.: 0.0322) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.30% (0.4559 => 0.4664, std.dev.: 0.0036) MultiSource/Applications/SIBsim4/SIBsim4: 2.27% (1.2568 => 1.2853, std.dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 2.21% (14.7684 => 15.0942, std.dev.: 0.0778) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.18% (0.8457 => 0.8641, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 2.16% (3.8189 => 3.9014, std.dev.: 0.0276) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.16% (0.9908 => 1.0122, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.15% (0.9069 => 0.9264, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.11% (0.8611 => 0.8793, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.11% (0.8007 => 0.8176, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.05% (0.9074 => 0.9260, std.dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: 2.04% (31.8598 => 32.5096, std.dev.: 0.2340) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.96% (0.8317 => 0.8480, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.95% (0.8597 => 0.8765, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.95% (0.6834 => 0.6967, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.93% (0.8177 => 0.8335, std.dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 1.90% (1.1271 => 1.1485, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.88% (0.8086 => 0.8238, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.87% (0.7966 => 0.8115, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.83% (0.9039 => 0.9204, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.82% (0.9056 => 0.9221, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.79% (0.8712 => 0.8868, std.dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: 1.78% (15.3280 => 15.6012, std.dev.: 0.0442) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.71% (0.8805 => 0.8956, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 1.70% (8.6247 => 8.7715, std.dev.: 0.0259) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.68% (0.8885 => 0.9034, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 1.67% (2.3764 => 2.4162, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.67% (1.2423 => 1.2631, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.66% (0.8420 => 0.8560, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.66% (0.9688 => 0.9849, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.46% (0.8286 => 0.8407, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.43% (0.8316 => 0.8435, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.34% (0.8716 => 0.8833, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.32% (0.8359 => 0.8469, std.dev.: 0.0032) MultiSource/Applications/lemon/lemon: 1.24% (1.0945 => 1.1081, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.16% (0.8995 => 0.9099, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 103.52% (0.0199 => 0.0405, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/pi: 57.82% (1.5795 => 2.4928, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.66% (0.7597 => 0.8939, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.39% (2.9753 => 3.4631, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 15.69% (6.3772 => 7.3779, std.dev.: 0.1145) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.44% (2.7995 => 3.2037, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.52% (5.0261 => 5.6052, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.60% (0.3186 => 0.3460, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.89% (1.1857 => 1.2793, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.03% (4.7794 => 5.1152, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 6.92% (1.7056 => 1.8236, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/richards_benchmark: 6.47% (1.3037 => 1.3881, std.dev.: 0.0040) MultiSource/Applications/SIBsim4/SIBsim4: 6.24% (3.1873 => 3.3862, std.dev.: 0.0269) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.90% (4.9686 => 5.2619, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.86% (4.5327 => 4.7983, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.57% (3.3761 => 3.5305, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.40% (6.2275 => 6.5016, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.34% (4.9453 => 5.1601, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.91% (4.9469 => 5.1401, std.dev.: 0.0130) MultiSource/Applications/hexxagon/hexxagon: 3.80% (14.0064 => 14.5389, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.88% (11.5690 => 11.9021, std.dev.: 0.0179) MultiSource/Applications/siod/siod: 2.84% (3.6643 => 3.7683, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.77% (8.2783 => 8.5073, std.dev.: 0.0070) MultiSource/Applications/lambda-0_1_3/lambda: 2.62% (7.4933 => 7.6897, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout/lists: 2.36% (7.3375 => 7.5109, std.dev.: 0.0123) SingleSource/Benchmarks/Dhrystone/dry: 2.24% (0.5081 => 0.5195, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.15% (4.8362 => 4.9402, std.dev.: 0.0199) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.74% (14.6451 => 14.9003, std.dev.: 0.0285) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.29% (4.4340 => 4.4913, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.25% (1.5941 => 1.6140, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.25% (59.2638 => 60.0023, std.dev.: 0.2417) SingleSource/Benchmarks/Misc/ReedSolomon: 1.24% (8.5322 => 8.6381, std.dev.: 0.0112) MultiSource/Benchmarks/FreeBench/neural/neural: 1.11% (1.0841 => 1.0961, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 1.08% (2.8561 => 2.8869, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 1.07% (2.1224 => 2.1451, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/power/power: 1.04% (1.2061 => 1.2187, std.dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: 1.01% (7.1181 => 7.1903, std.dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.67% (5.4641 => 4.3347, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.89% (1.0512 => 0.9367, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -10.61% (7.2130 => 6.4478, std.dev.: 0.2796) MultiSource/Benchmarks/mafft/pairlocalalign: -8.39% (63.1822 => 57.8786, std.dev.: 0.0505) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.49% (0.3269 => 0.3024, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.86% (4.7482 => 4.4227, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.97% (3.7148 => 3.4932, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.90% (5.4972 => 5.1728, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.08% (5.1557 => 4.8940, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.36% (4.7449 => 4.5379, std.dev.: 0.0119) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.97% (2.8773 => 2.7630, std.dev.: 0.0372) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.78% (6.0224 => 5.7945, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/life/life: -3.06% (2.6356 => 2.5549, std.dev.: 0.0246) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.02% (28.5821 => 27.7186, std.dev.: 0.0360) MultiSource/Applications/lua/lua: -2.93% (29.8330 => 28.9600, std.dev.: 0.0791) MultiSource/Benchmarks/FreeBench/mason/mason: -2.64% (0.5415 => 0.5272, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bisort/bisort: -2.61% (0.6636 => 0.6463, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.55% (0.5807 => 0.5659, std.dev.: 0.0016) MultiSource/Applications/aha/aha: -2.32% (3.3398 => 3.2624, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.05% (11.5316 => 11.2949, std.dev.: 0.0079) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.86% (2.3487 => 2.3051, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.50% (4.9994 => 4.9243, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.06% (5.6343 => 5.5744, std.dev.: 0.0209) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.59% (16.4461 => 16.7080, std.dev.: 0.0339) MultiSource/Applications/obsequi/Obsequi: 3.78% (1.0262 => 1.0650, std.dev.: 0.0084) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6870.57% (0.3123 => 21.7691, std.dev.: 0.2709) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.41% (0.2463 => 0.3680, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: 0.42% (0.6010 => 0.6035, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.48% (0.3266 => 0.3347, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 3.45% (0.1969 => 0.2037, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 0.53% (0.0190 => 0.0191, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0180 => 0.0180, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.49% (0.1438 => 0.1431, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -2.50% (1.1329 => 1.1046, std.dev.: 0.0392) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.50% (0.1462 => 0.1484, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.40% (0.4164 => 0.4064, std.dev.: 0.0210) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.56% (0.1369 => 0.1404, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.80% (0.0641 => 0.0591, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 17.95% (0.0195 => 0.0230, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.52% (0.0578 => 0.0575, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.42% (1.1437 => 1.1943, std.dev.: 0.0326) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.15% (0.0627 => 0.0601, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.44% (0.0180 => 0.0215, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.77% (0.8017 => 0.7715, std.dev.: 0.0124) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 29.03% (0.0062 => 0.0080, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 6 23:32:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 7 Nov 2012 01:32:33 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121107073233.54AA72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5646?compare_to=5641&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5646, Order: 167523, Start Time: 2012-11-07 04:17:11, End Time: 2012-11-07 07:32:42 To: 5641, Order: 167499, Start Time: 2012-11-07 00:13:24, End Time: 2012-11-07 03:29:09 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (171 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (721 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.93% (2.0674 => 2.1072, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/perimeter/perimeter: 1.87% (0.6109 => 0.6223, std.dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.36% (0.0625 => 0.0871, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.33% (0.1063 => 0.1396, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.47% (0.2969 => 0.3755, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.95% (0.1106 => 0.1393, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.68% (0.4253 => 0.5345, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.60% (0.4139 => 0.5157, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.22% (0.5900 => 0.7329, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.95% (0.0714 => 0.0885, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.79% (0.0475 => 0.0588, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 23.76% (1.5932 => 1.9718, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.75% (0.4994 => 0.6180, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.58% (0.0547 => 0.0676, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.30% (0.5000 => 0.6165, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.29% (0.0584 => 0.0720, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 22.20% (0.0599 => 0.0732, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.19% (0.0897 => 0.1096, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.10% (0.1620 => 0.1978, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.94% (0.1021 => 0.1245, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.50% (0.1107 => 0.1345, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 21.25% (0.1619 => 0.1963, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.18% (0.0642 => 0.0778, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 20.99% (0.0948 => 0.1147, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.72% (0.0584 => 0.0705, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.70% (0.0541 => 0.0653, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.61% (0.0495 => 0.0597) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.58% (0.1103 => 0.1330, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.57% (0.3903 => 0.4706, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.34% (0.1003 => 0.1207, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 20.22% (0.0821 => 0.0987, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.20% (0.1604 => 0.1928, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.14% (0.1549 => 0.1861, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.95% (0.0822 => 0.0986, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.22% (0.1462 => 0.1743, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 19.20% (0.1505 => 0.1794, std.dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: 19.06% (0.0808 => 0.0962, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 19.01% (0.0947 => 0.1127, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.71% (0.3890 => 0.4618, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.64% (0.2736 => 0.3246, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.37% (0.2014 => 0.2384, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: 18.23% (0.1218 => 0.1440, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.21% (0.2866 => 0.3388, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 18.05% (0.0698 => 0.0824, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.99% (1.3152 => 1.5518, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.92% (0.1088 => 0.1283, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 17.89% (0.5826 => 0.6868, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 17.87% (0.4029 => 0.4749, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 17.60% (0.1284 => 0.1510, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 17.56% (0.5889 => 0.6923, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.39% (0.4658 => 0.5468, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 17.37% (1.8794 => 2.2059, std.dev.: 0.0059) MultiSource/Applications/Burg/burg: 17.33% (0.5546 => 0.6507, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 17.07% (0.9697 => 1.1352, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.02% (0.1968 => 0.2303, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.01% (0.2875 => 0.3364, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.94% (3.5627 => 4.1661, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.88% (0.3271 => 0.3823, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.73% (1.6211 => 1.8923, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.62% (0.4361 => 0.5086, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.47% (0.5026 => 0.5854, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.47% (0.1160 => 0.1351, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 16.33% (0.1421 => 0.1653, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.33% (0.2738 => 0.3185, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 16.15% (0.2725 => 0.3165, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 16.14% (0.2714 => 0.3152, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.98% (0.2729 => 0.3165, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 15.90% (0.2780 => 0.3222, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 15.89% (0.2750 => 0.3187, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.88% (4.4195 => 5.1214, std.dev.: 0.0090) MultiSource/Applications/d/make_dparser: 15.83% (1.0781 => 1.2488, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.83% (0.2792 => 0.3234, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 15.81% (0.3004 => 0.3479, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 15.71% (0.2075 => 0.2401, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 15.70% (0.2803 => 0.3243, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 15.69% (0.2811 => 0.3252, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.67% (2.7292 => 3.1570, std.dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference: 15.67% (0.7171 => 0.8295, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.62% (0.3930 => 0.4544, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 15.59% (0.9909 => 1.1454, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 15.59% (0.2823 => 0.3263, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.56% (0.3195 => 0.3692, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 15.54% (0.2813 => 0.3250, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 15.53% (4.2109 => 4.8650, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/wc: 15.47% (0.3096 => 0.3575, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.44% (2.0673 => 2.3865, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.32% (0.2911 => 0.3357, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 15.27% (23.5202 => 27.1125, std.dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.20% (0.3362 => 0.3873, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 15.15% (0.3267 => 0.3762, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 15.10% (0.3258 => 0.3750, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.08% (1.9694 => 2.2664, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.07% (1.9966 => 2.2974, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.77% (0.1090 => 0.1251, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.67% (0.3060 => 0.3509, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 14.62% (0.3317 => 0.3802, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.53% (0.3124 => 0.3578, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 14.46% (0.2566 => 0.2937, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 14.29% (1.4269 => 1.6308, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 14.25% (0.3726 => 0.4257, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 14.25% (0.3348 => 0.3825, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 14.22% (0.3678 => 0.4201, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 14.18% (0.4251 => 0.4854, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.14% (0.3282 => 0.3746, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 14.13% (0.4146 => 0.4732, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists1: 14.04% (0.3477 => 0.3965, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.01% (0.3625 => 0.4133, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 13.90% (0.7875 => 0.8970, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.74% (0.3981 => 0.4528, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.71% (0.3690 => 0.4196, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 13.55% (0.3446 => 0.3913, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 13.47% (0.5012 => 0.5687, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.45% (0.3845 => 0.4362, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/for-in: 13.44% (0.3496 => 0.3966, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 13.39% (0.3465 => 0.3929, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.39% (0.3488 => 0.3955, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 13.32% (0.3460 => 0.3921, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 13.31% (0.3442 => 0.3900, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 13.26% (0.3469 => 0.3929, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 13.18% (2.1653 => 2.4506, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/exceptions: 13.07% (0.3643 => 0.4119, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 13.01% (0.3650 => 0.4125, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 12.95% (2.1013 => 2.3734, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 12.89% (0.3724 => 0.4204, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 12.81% (4.6177 => 5.2093, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.50% (0.2040 => 0.2295, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 12.30% (0.2691 => 0.3022, std.dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 11.96% (5.5417 => 6.2047, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.90% (0.2068 => 0.2314, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.72% (0.6435 => 0.7189, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.64% (0.1383 => 0.1544, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 11.52% (0.6634 => 0.7398, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.48% (0.1028 => 0.1146, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 11.32% (0.3498 => 0.3894, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.93% (0.3084 => 0.3421, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.92% (0.2737 => 0.3036, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 10.56% (0.4847 => 0.5359, std.dev.: 0.0062) MultiSource/Applications/minisat/minisat: 10.25% (0.3336 => 0.3678, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.89% (0.2103 => 0.2311, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 9.77% (2.0346 => 2.2334, std.dev.: 0.0111) MultiSource/Applications/lemon/lemon: 9.74% (0.2391 => 0.2624, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.91% (4.6926 => 5.1108, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.88% (0.5361 => 0.5837, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.81% (11.6398 => 12.6654, std.dev.: 0.0164) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.31% (0.5584 => 0.6048, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.21% (0.7426 => 0.8036, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 6.67% (11.9555 => 12.7532, std.dev.: 0.0088) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.22% (0.3792 => 0.3952, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.03% (0.2802 => 0.3055, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6096, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6761, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-2: 4.87% (1.8057 => 1.8936, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1654, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.25% (0.3693 => 0.3850, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6385, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1938, std.dev.: 0.0066) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2230, std.dev.: 0.0033) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3078, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2885, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.21% (2.0820 => 2.1072, std.dev.: 0.0079) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5145, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5390, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6033, std.dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5630, std.dev.: 0.0220) SingleSource/Benchmarks/Shootout-C++/ary2: -8.91% (0.2402 => 0.2188, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9776, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8003, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7988, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/fldry: -3.04% (17.2379 => 16.7134, std.dev.: 0.1211) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7728, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8610, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5769, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4951, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.18% (105.3826 => 104.1429, std.dev.: 0.0604) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0479, std.dev.: 0.0034) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 6 23:36:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 7 Nov 2012 01:36:52 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121107073652.88EB02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5647?compare_to=5644&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5647, Order: 167525, Start Time: 2012-11-07 06:12:02, End Time: 2012-11-07 07:37:00 To: 5644, Order: 167523, Start Time: 2012-11-07 04:24:02, End Time: 2012-11-07 05:48:50 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (184 on baseline) Unchanged Tests: 1041 (854 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.18% (42.4134 => 42.9135, std.dev.: 0.0767) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.94% (2.0478 => 2.1080, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.4937 => 7.6740, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/hash2: 2.17% (3.1932 => 3.2624, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.01% (0.1431 => 0.1302, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -8.08% (2.4924 => 2.2910, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.69% (0.3821 => 0.3527, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.48% (0.3142 => 0.2907, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -7.29% (0.3812 => 0.3534, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -7.27% (0.2160 => 0.2003, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -7.23% (0.3831 => 0.3554, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -7.19% (0.3880 => 0.3601, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -7.14% (0.4033 => 0.3745, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.12% (0.3891 => 0.3614, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -7.11% (0.3896 => 0.3619, std.dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: -7.09% (0.3357 => 0.3119, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: -7.09% (0.4176 => 0.3880, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.08% (0.9542 => 0.8866, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.08% (0.3884 => 0.3609, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.04% (0.2428 => 0.2257, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -7.02% (0.3848 => 0.3578, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.96% (3.5339 => 3.2878, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: -6.91% (9.2283 => 8.5906, std.dev.: 0.0110) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.88% (22.4056 => 20.8651, std.dev.: 0.0180) MultiSource/Applications/JM/lencod/lencod: -6.87% (16.1920 => 15.0796, std.dev.: 0.0122) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.86% (0.9852 => 0.9176, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.84% (0.4151 => 0.3867, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -6.83% (0.4199 => 0.3912, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.83% (0.3658 => 0.3408, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -6.83% (7.0961 => 6.6117, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -6.76% (0.1879 => 0.1752, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.76% (0.6484 => 0.6046, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: -6.70% (0.9179 => 0.8564, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/parameter-passing: -6.66% (0.4280 => 0.3995, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -6.66% (0.2989 => 0.2790, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -6.65% (1.3148 => 1.2274, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.63% (0.1796 => 0.1677, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.62% (1.3722 => 1.2813, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: -6.61% (0.3026 => 0.2826, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -6.59% (0.4248 => 0.3968, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -6.59% (0.3446 => 0.3219, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -6.58% (1.2515 => 1.1691, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.58% (1.0544 => 0.9850, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.58% (0.2355 => 0.2200, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: -6.58% (0.3481 => 0.3252, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.56% (2.1713 => 2.0288, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/matrix: -6.54% (0.3255 => 0.3042, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.54% (0.3837 => 0.3586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.54% (0.4083 => 0.3816, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.54% (6.7716 => 6.3289, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.53% (0.3323 => 0.3106, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: -6.53% (0.2849 => 0.2663, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: -6.52% (1.1530 => 1.0778, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.52% (0.3252 => 0.3040, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.52% (4.8802 => 4.5622, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.51% (0.2903 => 0.2714, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.51% (0.3057 => 0.2858, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.50% (4.0323 => 3.7702, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.49% (0.3931 => 0.3676, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.48% (1.4642 => 1.3693, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.48% (4.5069 => 4.2149, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.47% (4.8161 => 4.5043, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: -6.47% (0.1761 => 0.1647, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.47% (0.3016 => 0.2821, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.46% (1.2300 => 1.1506, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.45% (1.2784 => 1.1959, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.45% (1.6474 => 1.5412, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -6.45% (1.1450 => 1.0712, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -6.44% (0.2933 => 0.2744, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -6.44% (0.3059 => 0.2862, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -6.44% (0.4861 => 0.4548, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -6.43% (0.2659 => 0.2488) SingleSource/Benchmarks/Shootout-C++/random: -6.43% (0.2939 => 0.2750, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.38% (1.6364 => 1.5320, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: -6.37% (0.2871 => 0.2688, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.37% (0.6736 => 0.6307, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: -6.37% (0.3205 => 0.3001, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.36% (0.7919 => 0.7415, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.34% (0.3849 => 0.3605, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.34% (14.2083 => 13.3080, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/lists1: -6.34% (0.3867 => 0.3622, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -6.32% (0.3621 => 0.3392, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.31% (0.2695 => 0.2525, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.29% (0.1716 => 0.1608, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.29% (0.1621 => 0.1519, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.28% (0.5857 => 0.5489, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -6.28% (0.3394 => 0.3181, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/methcall: -6.25% (0.3025 => 0.2836, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -6.23% (0.3194 => 0.2995, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.23% (0.6230 => 0.5842, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.23% (0.7339 => 0.6882, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -6.22% (0.3406 => 0.3194, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.22% (0.5805 => 0.5444, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.21% (0.6052 => 0.5676, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: -6.21% (0.4427 => 0.4152, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -6.21% (4.3330 => 4.0641, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/05-eks/eks: -6.20% (0.4515 => 0.4235, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.20% (0.6293 => 0.5903, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.19% (0.7524 => 0.7058, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -6.18% (15.5079 => 14.5492, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/sieve: -6.18% (0.3788 => 0.3554, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.17% (0.3483 => 0.3268, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.16% (0.9557 => 0.8968, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.15% (0.7021 => 0.6589, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.15% (0.4813 => 0.4517, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -6.15% (0.6750 => 0.6335, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.13% (0.5478 => 0.5142, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.13% (0.4321 => 0.4056, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.13% (0.6446 => 0.6051, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.13% (0.5925 => 0.5562, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.12% (0.2548 => 0.2392, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.12% (0.5591 => 0.5249, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.10% (0.5705 => 0.5357, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.10% (0.6297 => 0.5913, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -6.10% (0.2985 => 0.2803, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.09% (0.5581 => 0.5241, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -6.09% (4.0594 => 3.8123, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.09% (0.6440 => 0.6048, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.09% (0.6194 => 0.5817, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -6.09% (0.5849 => 0.5493, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.08% (5.4682 => 5.1358, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.07% (0.5863 => 0.5507, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.07% (0.5999 => 0.5635, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -6.07% (0.6033 => 0.5667, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -6.06% (0.2278 => 0.2140, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.06% (0.5168 => 0.4855, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.04% (0.3491 => 0.3280, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.04% (0.6304 => 0.5923, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.04% (0.6189 => 0.5815, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.04% (0.5329 => 0.5007, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: -6.03% (0.3581 => 0.3365, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.02% (0.5802 => 0.5453, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.01% (0.5859 => 0.5507, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -6.00% (17.1032 => 16.0766, std.dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -6.00% (8.0126 => 7.5322, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.99% (0.5456 => 0.5129, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.99% (0.6660 => 0.6261, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.99% (0.6260 => 0.5885, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.99% (0.7198 => 0.6767, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.98% (0.6667 => 0.6268, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.98% (0.4916 => 0.4622, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.97% (0.6395 => 0.6013, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.97% (0.6681 => 0.6282, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.97% (0.2999 => 0.2820, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: -5.97% (1.3864 => 1.3037, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.96% (0.6676 => 0.6278, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -5.94% (2.4021 => 2.2593, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.91% (0.8521 => 0.8017, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.90% (0.6395 => 0.6018, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: -5.88% (3.5154 => 3.3087, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.87% (0.5567 => 0.5240, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -5.86% (0.7779 => 0.7323, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.85% (0.5569 => 0.5243, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.85% (0.5575 => 0.5249, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -5.84% (34.0927 => 32.1011, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.84% (2.2587 => 2.1268, std.dev.: 0.0173) MultiSource/Applications/treecc/treecc: -5.77% (2.1401 => 2.0167, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: -5.76% (0.7447 => 0.7018, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.68% (0.5688 => 0.5365, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -5.67% (0.6347 => 0.5987, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.67% (1.2210 => 1.1518, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.66% (0.2385 => 0.2250, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.66% (0.5941 => 0.5605, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -5.64% (0.4524 => 0.4269, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -5.64% (18.2933 => 17.2623, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.63% (1.2221 => 1.1533, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.60% (0.3319 => 0.3133, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: -5.50% (0.6441 => 0.6087, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -5.47% (15.2527 => 14.4186, std.dev.: 0.0214) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.46% (0.2106 => 0.1991, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -5.36% (0.7982 => 0.7554, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -5.32% (0.3271 => 0.3097, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -5.26% (0.8418 => 0.7975, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: -5.25% (5.0226 => 4.7589, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.25% (0.2001 => 0.1896) MultiSource/Applications/hbd/hbd: -4.69% (1.5610 => 1.4878, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.57% (0.9077 => 0.8662, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.57% (0.2277 => 0.2173, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -2.48% (20.7746 => 20.2594, std.dev.: 0.0383) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7578, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7069, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.63% (2.2633 => 2.1811, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.49% (6.5735 => 6.4753, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 7 00:31:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 7 Nov 2012 02:31:20 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121107083120.6443B2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5648?compare_to=5645&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5648, Order: 167525, Start Time: 2012-11-07 07:04:41, End Time: 2012-11-07 08:31:30 To: 5645, Order: 167524, Start Time: 2012-11-07 05:21:30, End Time: 2012-11-07 06:47:37 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 14 (88 on baseline) Performance Improvements: 1 (24 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 976 (862 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.61% (0.0861 => 0.0961, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.82% (0.5023 => 0.5265, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.18% (0.6156 => 0.6352, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.50% (0.8833 => 0.9054, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.07% (4.5170 => 4.6105, std.dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.05% (0.7872 => 0.8033, std.dev.: 0.0040) MultiSource/Applications/lua/lua: 1.91% (3.9014 => 3.9760, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.86% (0.8176 => 0.8328, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.58% (4.5644 => 4.6366, std.dev.: 0.0269) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.25% (8.8006 => 8.9110, std.dev.: 0.0378) MultiSource/Applications/ClamAV/clamscan: 1.24% (15.0942 => 15.2808, std.dev.: 0.0659) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.60% (2.6746 => 2.7708, std.dev.: 0.0205) SingleSource/Benchmarks/Misc/ffbench: 3.37% (1.3813 => 1.4279, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.70% (2.4240 => 2.4651, std.dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.10% (4.4913 => 4.4418, std.dev.: 0.0137) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.08% (16.7080 => 16.6943, std.dev.: 0.3065) MultiSource/Applications/obsequi/Obsequi: 0.29% (1.0650 => 1.0681, std.dev.: 0.0082) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.07% (21.7691 => 22.0024, std.dev.: 0.1683) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.95% (0.3680 => 0.3645, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 0.23% (0.6035 => 0.6049, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.06% (0.3347 => 0.3345, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -1.33% (0.2037 => 0.2010, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -33.94% (0.0218 => 0.0144, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -10.54% (0.0427 => 0.0382, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.20% (0.0331 => 0.0284, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.50% (0.0314 => 0.0303, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -12.00% (0.0425 => 0.0374, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/casts: 6.28% (0.0191 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -23.08% (0.0013 => 0.0010, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.26% (0.1431 => 0.1449, std.dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 3.59% (1.1046 => 1.1443, std.dev.: 0.0404) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.74% (0.1484 => 0.1495, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 9.01% (0.4064 => 0.4430, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.28% (0.1404 => 0.1386, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.86% (0.0591 => 0.0667, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 14.78% (0.0230 => 0.0264, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.96% (0.0575 => 0.0592, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.95% (1.1943 => 1.2057, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0001 => 0.0002, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.32% (0.0601 => 0.0563, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 10.23% (0.0215 => 0.0237, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.21% (0.7715 => 0.7731, std.dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: -66.67% (0.0003 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -18.75% (0.0080 => 0.0065, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2298.15% (0.6332 => 15.1851, std.dev.: 0.3580) MultiSource/Benchmarks/McCat/08-main/main: 48.94% (0.1831 => 0.2727, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.74% (0.1559 => 0.1454, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1496.38% (0.3344 => 5.3383, std.dev.: 0.0244) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.77% (0.2364 => 0.3257, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: -5.83% (0.0429 => 0.0404, std.dev.: 0.0020) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.02% (0.0224 => 0.0233, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -32.17% (0.0230 => 0.0156, std.dev.: 0.0007) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4193, std.dev.: 0.0262) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0696, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4900, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3381, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1305, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3993, std.dev.: 0.0011) SingleSource/Regression/C/uint64_to_float: -23.78% (2.1832 => 1.6641, std.dev.: 0.0052) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.56% (0.0810 => 0.0936, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.33% (0.0848 => 0.0961, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.25% (0.0830 => 0.0940, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 12.05% (0.1112 => 0.1246, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.62% (0.4847 => 0.5265, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.42% (0.1425 => 0.1545, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.93% (0.8148 => 0.8794, std.dev.: 0.0138) MultiSource/Applications/viterbi/viterbi: 7.67% (0.1577 => 0.1698, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.49% (0.7473 => 0.8033, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.67% (0.2998 => 0.3198, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.50% (0.3137 => 0.3341, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.25% (0.3295 => 0.3501, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.18% (0.8321 => 0.8835, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.69% (0.6010 => 0.6352, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.35% (1.1606 => 1.2227, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.56% (0.5961 => 0.6233, std.dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.29% (0.4783 => 0.4988, std.dev.: 0.0045) MultiSource/Applications/Burg/burg: 4.14% (1.2222 => 1.2728, std.dev.: 0.0111) MultiSource/Applications/lua/lua: 4.11% (3.8189 => 3.9760, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 4.01% (0.8007 => 0.8328, std.dev.: 0.0052) MultiSource/Applications/sgefa/sgefa: 3.93% (0.2999 => 0.3117, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.91% (0.9435 => 0.9804, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.88% (0.8716 => 0.9054, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.87% (1.1685 => 1.2137, std.dev.: 0.0051) MultiSource/Applications/spiff/spiff: 3.71% (0.7950 => 0.8245, std.dev.: 0.0094) MultiSource/Benchmarks/MallocBench/gs/gs: 3.71% (4.1305 => 4.2836, std.dev.: 0.0299) MultiSource/Applications/ClamAV/clamscan: 3.47% (14.7684 => 15.2808, std.dev.: 0.0659) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.42% (4.1763 => 4.3191, std.dev.: 0.0271) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.33% (6.6074 => 6.8273, std.dev.: 0.0588) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.33% (4.4873 => 4.6366, std.dev.: 0.0269) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.31% (1.4479 => 1.4958, std.dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: 3.23% (0.9810 => 1.0127, std.dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.19% (1.1170 => 1.1526, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.13% (1.3279 => 1.3694, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.08% (0.5817 => 0.5996, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.05% (8.6476 => 8.9110, std.dev.: 0.0378) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.88% (0.8048 => 0.8280, std.dev.: 0.0062) MultiSource/Applications/SIBsim4/SIBsim4: 2.86% (1.2568 => 1.2927, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.76% (1.6386 => 1.6839, std.dev.: 0.0109) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.73% (4.4880 => 4.6105, std.dev.: 0.0180) MultiSource/Benchmarks/nbench/nbench: 2.63% (1.1271 => 1.1567, std.dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 2.59% (6.7320 => 6.9062, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.54% (0.8317 => 0.8528, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.47% (13.1811 => 13.5073, std.dev.: 0.0369) MultiSource/Applications/SPASS/SPASS: 2.45% (14.2605 => 14.6098, std.dev.: 0.0977) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.39% (0.8069 => 0.8262, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.30% (0.8611 => 0.8809, std.dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 2.27% (15.3280 => 15.6763, std.dev.: 0.0892) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.19% (0.8050 => 0.8226, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.15% (0.8457 => 0.8639, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.10% (0.9069 => 0.9259, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.03% (0.8340 => 0.8509, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.99% (0.8204 => 0.8367, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.91% (0.8597 => 0.8761, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.66% (0.8420 => 0.8560, std.dev.: 0.0030) SingleSource/UnitTests/Vector/constpool: 1.64% (8.4179 => 8.5558, std.dev.: 0.0320) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 108.54% (0.0199 => 0.0415, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/pi: 57.27% (1.5795 => 2.4841, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.68% (0.7597 => 0.8864, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.40% (2.9753 => 3.4632, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.48% (2.7995 => 3.2049, std.dev.: 0.0514) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.61% (5.0261 => 5.6098, std.dev.: 0.0185) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.44% (1.1857 => 1.2739, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/queens: 7.28% (1.7056 => 1.8297, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.76% (4.7794 => 5.1026, std.dev.: 0.0053) MultiSource/Applications/SIBsim4/SIBsim4: 6.53% (3.1873 => 3.3955, std.dev.: 0.0387) SingleSource/Benchmarks/Misc/richards_benchmark: 6.37% (1.3037 => 1.3868, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.37% (0.3186 => 0.3389, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.88% (4.5327 => 4.7991, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.83% (4.9686 => 5.2584, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.69% (3.3761 => 3.5344, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.56% (6.2275 => 6.5116, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.30% (4.9453 => 5.1581, std.dev.: 0.0112) MultiSource/Applications/hexxagon/hexxagon: 3.92% (14.0064 => 14.5553, std.dev.: 0.0615) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.09% (0.3587 => 0.3698, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.03% (11.5690 => 11.9197, std.dev.: 0.0222) MultiSource/Applications/siod/siod: 2.70% (3.6643 => 3.7632, std.dev.: 0.0102) MultiSource/Applications/lambda-0_1_3/lambda: 2.60% (7.4933 => 7.6885, std.dev.: 0.0463) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.44% (2.2485 => 2.3033, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.43% (8.2783 => 8.4793, std.dev.: 0.0216) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.32% (4.8362 => 4.9486, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout/lists: 2.22% (7.3375 => 7.5003, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/hash: 2.08% (0.6205 => 0.6334, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: 1.32% (1.0841 => 1.0984, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.31% (2.4333 => 2.4651, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/ReedSolomon: 1.25% (8.5322 => 8.6388, std.dev.: 0.0330) MultiSource/Benchmarks/Olden/power/power: 1.20% (1.2061 => 1.2206, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.05% (3.5679 => 3.6052, std.dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.32% (5.4641 => 4.2994, std.dev.: 0.0291) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.60% (7.2130 => 6.3042, std.dev.: 0.2184) SingleSource/Benchmarks/McGill/chomp: -11.31% (1.1216 => 0.9947, std.dev.: 0.0114) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.93% (1.0512 => 0.9363, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: -8.55% (63.1822 => 57.7809, std.dev.: 0.1156) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.83% (0.3269 => 0.3013, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.87% (4.7482 => 4.4221, std.dev.: 0.0213) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.97% (3.7148 => 3.4929, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.83% (5.4972 => 5.1768, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.13% (5.1557 => 4.8913, std.dev.: 0.0105) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.21% (2.8773 => 2.7561, std.dev.: 0.0270) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.72% (6.0224 => 5.7981, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.68% (4.7449 => 4.5705, std.dev.: 0.0670) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.29% (2.4490 => 2.3685, std.dev.: 0.0156) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.19% (0.5807 => 0.5622, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.02% (28.5821 => 27.7191, std.dev.: 0.0779) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.54% (2.6356 => 2.5686, std.dev.: 0.0072) MultiSource/Applications/aha/aha: -2.45% (3.3398 => 3.2581, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.41% (9.9065 => 9.6675, std.dev.: 0.0910) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.04% (11.5316 => 11.2965, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.68% (2.3487 => 2.3093, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.56% (4.9994 => 4.9214, std.dev.: 0.0209) SingleSource/Benchmarks/Shootout-C++/hash2: -1.46% (3.4237 => 3.3737, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.24% (5.6343 => 5.5643, std.dev.: 0.0030) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.51% (16.4461 => 16.6943, std.dev.: 0.3065) MultiSource/Applications/obsequi/Obsequi: 4.08% (1.0262 => 1.0681, std.dev.: 0.0082) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6945.28% (0.3123 => 22.0024, std.dev.: 0.1683) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.99% (0.2463 => 0.3645, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 0.65% (0.6010 => 0.6049, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.42% (0.3266 => 0.3345, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 2.08% (0.1969 => 0.2010, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 17.07% (0.0123 => 0.0144, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -6.37% (0.0408 => 0.0382, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 11.81% (0.0254 => 0.0284, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.33% (0.0302 => 0.0303, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.60% (0.0384 => 0.0374, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 42.86% (0.0007 => 0.0010, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.76% (0.1438 => 0.1449, std.dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.01% (1.1329 => 1.1443, std.dev.: 0.0404) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.26% (0.1462 => 0.1495, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.39% (0.4164 => 0.4430, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.24% (0.1369 => 0.1386, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.06% (0.0641 => 0.0667, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 35.38% (0.0195 => 0.0264, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.42% (0.0578 => 0.0592, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.42% (1.1437 => 1.2057, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0001 => 0.0002, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.21% (0.0627 => 0.0563, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.67% (0.0180 => 0.0237, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.57% (0.8017 => 0.7731, std.dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 4.84% (0.0062 => 0.0065, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 7 01:27:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 7 Nov 2012 03:27:57 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121107092757.6B6112A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5649?compare_to=5647&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5649, Order: 167527, Start Time: 2012-11-07 08:00:20, End Time: 2012-11-07 09:28:06 To: 5647, Order: 167525, Start Time: 2012-11-07 06:12:02, End Time: 2012-11-07 07:37:00 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (158 on baseline) Unchanged Tests: 1041 (880 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.75% (54.4129 => 56.4508, std.dev.: 0.1206) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.44% (54.5751 => 56.4508, std.dev.: 0.1206) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.99% (2.0478 => 2.1090, std.dev.: 0.0210) SingleSource/Benchmarks/Misc/salsa20: 2.43% (7.4937 => 7.6760, std.dev.: 0.0154) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.90% (0.3821 => 0.3519, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -7.71% (2.4924 => 2.3002, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.13% (0.3142 => 0.2918, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/trivial-interface: -6.77% (0.3812 => 0.3554, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions-4: -6.73% (0.3880 => 0.3619, std.dev.: 0.0076) MultiSource/Applications/sgefa/sgefa: -6.70% (0.3357 => 0.3132, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: -6.70% (0.3896 => 0.3635, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/exceptions-2: -6.68% (0.3831 => 0.3575, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.68% (0.3891 => 0.3631, std.dev.: 0.0099) SingleSource/UnitTests/ObjC/exceptions-3: -6.68% (0.3848 => 0.3591, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.64% (0.3884 => 0.3626, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions: -6.63% (0.4176 => 0.3899, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/for-in: -6.62% (0.4033 => 0.3766, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/property: -6.55% (0.4199 => 0.3924, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: -6.50% (9.2283 => 8.6281, std.dev.: 0.0210) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.49% (3.5339 => 3.3046, std.dev.: 0.0777) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.48% (0.3658 => 0.3421, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.44% (22.4056 => 20.9632, std.dev.: 0.0266) SingleSource/UnitTests/ObjC/parameter-passing: -6.43% (0.4280 => 0.4005, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.39% (1.0544 => 0.9870, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.38% (0.2428 => 0.2273, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: -6.37% (7.0961 => 6.6439, std.dev.: 0.0075) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.35% (0.1716 => 0.1607, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: -6.33% (1.2515 => 1.1723, std.dev.: 0.0031) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.31% (0.1584 => 0.1484, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -6.28% (16.1920 => 15.1754, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.28% (0.9542 => 0.8943, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.25% (0.6484 => 0.6079, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.24% (0.2355 => 0.2208, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: -6.23% (1.3148 => 1.2329, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.22% (1.3722 => 1.2868, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: -6.22% (0.9179 => 0.8608, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.20% (0.9852 => 0.9241, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.18% (0.3837 => 0.3600, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: -6.17% (0.4861 => 0.4561, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/objinst: -6.14% (0.3194 => 0.2998, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.13% (2.1713 => 2.0382, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/strcat: -6.12% (0.2989 => 0.2806, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/gs/gs: -6.11% (4.3330 => 4.0684, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.11% (0.3931 => 0.3691, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.10% (0.6293 => 0.5909, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.10% (1.2784 => 1.2004, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: -6.09% (0.2659 => 0.2497, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -6.09% (0.3481 => 0.3269, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.09% (0.4321 => 0.4058, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.08% (0.2548 => 0.2393, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.08% (1.2300 => 1.1552, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.08% (0.3323 => 0.3121, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.06% (1.4642 => 1.3754, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.06% (4.8161 => 4.5241, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: -6.05% (0.3025 => 0.2842, std.dev.: 0.0048) MultiSource/Applications/siod/siod: -6.04% (2.4021 => 2.2571, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.04% (4.0323 => 3.7889, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/ary3: -6.04% (0.3446 => 0.3238, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: -6.03% (0.2985 => 0.2805, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.03% (0.3252 => 0.3056, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: -6.02% (0.3255 => 0.3059, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.02% (1.6364 => 1.5379, std.dev.: 0.0053) MultiSource/Benchmarks/nbench/nbench: -6.02% (1.1530 => 1.0836, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.01% (6.7716 => 6.3647, std.dev.: 0.0070) MultiSource/Applications/lemon/lemon: -6.01% (1.1450 => 1.0762, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.99% (1.6474 => 1.5487, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.99% (0.7919 => 0.7445, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: -5.98% (0.3026 => 0.2845, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.98% (4.5069 => 4.2374, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.97% (0.5999 => 0.5641, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.94% (0.3483 => 0.3276, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.94% (0.6736 => 0.6336, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.91% (4.8802 => 4.5919, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.90% (0.3849 => 0.3622, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.89% (0.3057 => 0.2877, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.83% (0.2695 => 0.2538, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -5.80% (0.1879 => 0.1770, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.80% (0.8521 => 0.8027, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.79% (14.2083 => 13.3852, std.dev.: 0.0075) MultiSource/Applications/lua/lua: -5.79% (4.0594 => 3.8243, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.76% (0.3491 => 0.3290, std.dev.: 0.0076) MultiSource/Applications/SPASS/SPASS: -5.76% (15.5079 => 14.6153, std.dev.: 0.0132) MultiSource/Benchmarks/McCat/18-imp/imp: -5.75% (0.3581 => 0.3375, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.74% (0.2999 => 0.2827, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.73% (0.3406 => 0.3211, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.72% (0.4916 => 0.4635, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -5.71% (0.7447 => 0.7022, std.dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: -5.67% (18.2933 => 17.2558, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.66% (0.2933 => 0.2767, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.65% (0.6260 => 0.5906, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.65% (0.5857 => 0.5526, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.64% (0.7339 => 0.6925, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -5.64% (34.0927 => 32.1703, std.dev.: 0.0169) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.62% (0.1796 => 0.1695, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.62% (0.5591 => 0.5277, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -5.60% (17.1032 => 16.1448, std.dev.: 0.0329) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.60% (0.6230 => 0.5881, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.59% (0.5925 => 0.5594, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.59% (0.5478 => 0.5172, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -5.56% (0.4515 => 0.4264, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.55% (0.6194 => 0.5850, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.55% (0.2939 => 0.2776, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.55% (0.9557 => 0.9027, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.54% (0.5581 => 0.5272, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.54% (0.6395 => 0.6041, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.53% (0.6667 => 0.6298, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.52% (0.6052 => 0.5718, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.50% (0.6304 => 0.5957, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -5.50% (2.1401 => 2.0225, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.49% (2.2587 => 2.1348, std.dev.: 0.0397) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.48% (0.7021 => 0.6636, std.dev.: 0.0067) MultiSource/Applications/d/make_dparser: -5.48% (3.5154 => 3.3227, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.48% (0.6440 => 0.6087, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.48% (0.6189 => 0.5850, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: -5.47% (1.3864 => 1.3105, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.46% (0.2106 => 0.1991, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.45% (8.0126 => 7.5762, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.44% (0.5456 => 0.5159, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -5.44% (0.7982 => 0.7548, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.41% (0.5802 => 0.5488, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.41% (0.5863 => 0.5546, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.40% (0.5941 => 0.5620, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.40% (0.2278 => 0.2155, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.40% (0.6446 => 0.6098, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.37% (0.6033 => 0.5709, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.36% (0.7524 => 0.7121, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.35% (0.5849 => 0.5536, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.35% (0.5329 => 0.5044, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.35% (0.5705 => 0.5400, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.34% (0.5859 => 0.5546, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.33% (0.6676 => 0.6320, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.33% (0.6681 => 0.6325, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.32% (0.2385 => 0.2258, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.30% (0.5567 => 0.5272, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.28% (0.5569 => 0.5275, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.27% (0.6297 => 0.5965, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.27% (0.6660 => 0.6309, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -5.23% (0.3271 => 0.3100, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.20% (0.5575 => 0.5285, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.17% (0.5570 => 0.5282, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.17% (0.5805 => 0.5505, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -5.13% (0.8418 => 0.7986, std.dev.: 0.0055) SingleSource/UnitTests/ObjC++/Hello: -5.10% (0.6347 => 0.6023, std.dev.: 0.0075) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.09% (0.3319 => 0.3150, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -5.07% (15.2527 => 14.4792, std.dev.: 0.0065) SingleSource/UnitTests/ObjC++/property-reference-object: -5.06% (0.6441 => 0.6115, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.04% (1.2221 => 1.1605, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.03% (0.5688 => 0.5402, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.88% (1.2210 => 1.1614, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.88% (0.7198 => 0.6847, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: -4.44% (5.0226 => 4.7995, std.dev.: 0.0031) MultiSource/Applications/hbd/hbd: -4.36% (1.5610 => 1.4930, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.27% (0.9077 => 0.8689, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.55% (7.5137 => 5.7440, std.dev.: 0.0404) SingleSource/Benchmarks/Misc/richards_benchmark: -8.68% (1.2842 => 1.1727, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/fbench: -4.00% (2.2633 => 2.1727, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.81% (1.7753 => 1.7077, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4692, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.16% (1.3096 => 1.2944, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0003) Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 7 01:44:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 7 Nov 2012 03:44:15 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121107094415.868F52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5650?compare_to=5622&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5650, Order: 167445, Start Time: 2012-11-06 10:35:51, End Time: 2012-11-07 09:44:24 To: 5622, Order: 167379, Start Time: 2012-11-05 10:07:01, End Time: 2012-11-06 10:05:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 6 (42 on baseline) New Passes: 0 (12 on baseline) Performance Regressions: 3 (165 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 43 (7 on baseline) Unchanged Tests: 990 (643 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Applications/siod/siod MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Applications/siod/siod: -37.40% (2.5279 => 1.5824, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -3.59% (0.8860 => 0.8542, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -0.11% (10.4790 => 10.4671, std.dev.: 0.0085) New Failures - Execution Time ----------------------------- MultiSource/Applications/siod/siod MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Applications/siod/siod: -100.00% (3.1547 => 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -100.00% (2.2994 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -99.96% (0.2366 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 24.95% (1.2689 => 1.5855, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 15.83% (1.2037 => 1.3942, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.15% (55.3199 => 56.5070, std.dev.: 0.1213) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/ClamAV/clamscan: -3.19% (28.2384 => 27.3376, std.dev.: 0.0459) MultiSource/Applications/JM/ldecod/ldecod: 0.23% (6.3071 => 6.3215, std.dev.: 0.0212) MultiSource/Applications/JM/lencod/lencod: 4.81% (18.6749 => 19.5735, std.dev.: 0.0286) MultiSource/Applications/oggenc/oggenc: - (0.0020 => 0.0020) MultiSource/Applications/sqlite3/sqlite3: -0.06% (0.5240 => 0.5237, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: 6.65% (46.9172 => 50.0386, std.dev.: 469.9343) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -0.09% (5.0569 => 5.0524, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 0.24% (1.4163 => 1.4197, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.58% (0.3046 => 0.3277, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.31% (0.0301 => 0.0282, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 32.06% (1.3115 => 1.7320, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: -1.38% (0.1960 => 0.1933, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.26% (0.0019 => 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: - (0.0020 => 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -8.94% (0.2797 => 0.2547, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.54% (1.3102 => 1.7234, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 0.37% (5.2045 => 5.2237, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -19.99% (1.3814 => 1.1053, std.dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: -72.67% (1.0902 => 0.2979, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0020 => 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/ClamAV/clamscan: - (0.0001 => 0.0001) MultiSource/Applications/JM/ldecod/ldecod: - (0.0001 => 0.0001) MultiSource/Applications/JM/lencod/lencod: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.21% (0.0725 => 0.0709, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: - (0.0001 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 0.01% (499.8054 => 499.8545, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/voronoi/voronoi: - (0.0001 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: - (0.0001 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: - (0.0001 => 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/nbench/nbench: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/nbench/nbench MultiSource/Applications/ClamAV/clamscan: 23.28% (22.1758 => 27.3376, std.dev.: 0.0459) MultiSource/Applications/JM/ldecod/ldecod: -39.43% (10.4361 => 6.3215, std.dev.: 0.0212) MultiSource/Applications/JM/lencod/lencod: -10.77% (21.9371 => 19.5735, std.dev.: 0.0286) MultiSource/Applications/oggenc/oggenc: -99.97% (5.7591 => 0.0020) MultiSource/Applications/siod/siod: -31.11% (2.2969 => 1.5824, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: -96.95% (17.1811 => 0.5237, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: -20.88% (63.2438 => 50.0386, std.dev.: 469.9343) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.44% (0.8101 => 0.8542, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.17% (4.9449 => 5.0524, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 48.39% (7.0540 => 10.4671, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -7.90% (1.5415 => 1.4197, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -32.83% (0.4879 => 0.3277, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.58% (6.6874 => 0.0282, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -67.64% (5.3526 => 1.7320, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: -28.41% (0.2700 => 0.1933, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -99.93% (2.9384 => 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -99.82% (1.1194 => 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -19.83% (0.3177 => 0.2547, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -68.00% (5.3855 => 1.7234, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.44% (5.0018 => 5.2237, std.dev.: 0.0126) MultiSource/Benchmarks/nbench/nbench: -74.84% (1.1840 => 0.2979, std.dev.: 0.0008) New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/nbench/nbench MultiSource/Applications/ClamAV/clamscan: -99.94% (0.1629 => 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -99.92% (0.1298 => 0.0001) MultiSource/Applications/siod/siod: -100.00% (3.2827 => 0.0001) MultiSource/Applications/sqlite3/sqlite3: -100.00% (4.6441 => 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -100.00% (2.3135 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -98.00% (0.0050 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -99.96% (0.2497 => 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -50.00% (0.0002 => 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -75.00% (0.0004 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -99.97% (0.3987 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 44225.13% (1.1277 => 499.8545, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/voronoi/voronoi: -99.97% (0.3070 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -100.00% (2.6546 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -100.00% (2.6778 => 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -100.00% (4.5009 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -99.80% (0.0506 => 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -97.30% (0.0037 => 0.0001) MultiSource/Benchmarks/nbench/nbench: -100.00% (11.6436 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 191.09% (0.5229 => 1.5221, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 11.62% (14.9895 => 16.7312, std.dev.: 0.0208) MultiSource/Applications/kimwitu++/kc: 35.00% (14.1553 => 19.1101, std.dev.: 0.0105) MultiSource/Benchmarks/MallocBench/gs/gs: 12.88% (4.1105 => 4.6401, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.99% (3.4629 => 5.8173, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/stepanov_container: 61.33% (0.6222 => 1.0038, std.dev.: 0.0010) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3839300.00% (0.0001 => 3.8394, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 11193500.00% (0.0001 => 11.1936, std.dev.: 0.0571) MultiSource/Applications/kimwitu++/kc: 50400.00% (0.0001 => 0.0505, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10002700.00% (0.0001 => 10.0028, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5492000.00% (0.0001 => 5.4921, std.dev.: 0.0016) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 50.19% (0.1056 => 0.1586, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 40.88% (0.0746 => 0.1051, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 37.53% (0.0730 => 0.1004, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 36.87% (0.1432 => 0.1960, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 23.27% (0.0636 => 0.0784, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.48% (0.1566 => 0.1871, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 19.38% (0.2554 => 0.3049, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: 19.23% (0.1175 => 0.1401, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 18.81% (0.1584 => 0.1882, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.49% (8.1363 => 9.6406, std.dev.: 0.0126) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.28% (0.0648 => 0.0760, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 17.23% (0.1555 => 0.1823, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.98% (0.0842 => 0.0985, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.52% (0.0793 => 0.0924, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 16.27% (0.1125 => 0.1308, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.16% (0.0953 => 0.1107, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.81% (0.8172 => 0.9464, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.69% (0.0886 => 0.1025, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 15.50% (0.0871 => 0.1006, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.30% (0.2065 => 0.2381, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.96% (0.1337 => 0.1537, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.91% (0.0798 => 0.0917, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.38% (0.1029 => 0.1177, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/matrix: 14.18% (0.0818 => 0.0934, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.91% (0.0834 => 0.0950, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.90% (0.0770 => 0.0877, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.87% (0.1940 => 0.2209, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 13.84% (0.1163 => 0.1324, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.60% (0.2758 => 0.3133, std.dev.: 0.0043) MultiSource/Applications/Burg/burg: 13.56% (1.1642 => 1.3221, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 13.51% (0.1695 => 0.1924, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.38% (0.2107 => 0.2389, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 13.29% (0.1151 => 0.1304, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.25% (0.1117 => 0.1265, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/health/health: 13.25% (0.1268 => 0.1436, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.22% (0.1906 => 0.2158, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.07% (14.3668 => 16.2446, std.dev.: 0.0130) MultiSource/Applications/spiff/spiff: 12.85% (0.7835 => 0.8842, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.84% (0.5569 => 0.6284, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.62% (0.3121 => 0.3515, std.dev.: 0.0050) MultiSource/Applications/lambda-0_1_3/lambda: 12.57% (0.7433 => 0.8367, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.44% (0.5981 => 0.6725, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.34% (0.5860 => 0.6583, std.dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.26% (0.4615 => 0.5181, std.dev.: 0.0034) MultiSource/Applications/sgefa/sgefa: 12.13% (0.3109 => 0.3486, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 12.04% (0.7115 => 0.7972, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.02% (0.2271 => 0.2544, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/04-bisect/bisect: 11.96% (0.1062 => 0.1189, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 11.69% (0.3423 => 0.3823, std.dev.: 0.0054) SingleSource/Benchmarks/McGill/chomp: 11.66% (0.1655 => 0.1848, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.59% (1.3050 => 1.4563, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.57% (0.9765 => 1.0895, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.42% (0.3441 => 0.3834, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.32% (0.1510 => 0.1681, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.14% (0.1032 => 0.1147, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.08% (0.1236 => 0.1373, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.03% (0.5105 => 0.5668, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.03% (4.2646 => 4.7348, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/life/life: 10.93% (0.0933 => 0.1035, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 10.93% (3.3354 => 3.6999, std.dev.: 0.0184) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.86% (0.6675 => 0.7400, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 10.79% (3.8723 => 4.2900, std.dev.: 0.0181) MultiSource/Benchmarks/McCat/09-vor/vor: 10.72% (0.3180 => 0.3521, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 10.57% (2.0273 => 2.2415, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/exceptions-4: 10.44% (0.3543 => 0.3913, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 10.44% (0.3927 => 0.4337, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.42% (0.3473 => 0.3835, std.dev.: 0.0014) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.41% (0.1143 => 0.1262, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.41% (0.3497 => 0.3861, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.37% (0.3307 => 0.3650, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.33% (0.3543 => 0.3909, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 10.29% (0.3886 => 0.4286, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.21% (0.3516 => 0.3875, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 10.19% (0.4299 => 0.4737, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions: 10.19% (0.3828 => 0.4218, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.17% (0.3561 => 0.3923, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: 10.07% (0.3694 => 0.4066, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.94% (0.8067 => 0.8869, std.dev.: 0.0074) MultiSource/Benchmarks/mafft/pairlocalalign: 9.91% (9.4845 => 10.4240, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.87% (1.5859 => 1.7425, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 9.81% (1.5603 => 1.7133, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.68% (3.8922 => 4.2691, std.dev.: 0.0098) SingleSource/Benchmarks/Stanford/Puzzle: 9.62% (0.1268 => 0.1390, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 9.61% (1.0722 => 1.1752, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.49% (0.4636 => 0.5076, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.46% (0.1892 => 0.2071, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.44% (0.5020 => 0.5494, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.40% (1.1861 => 1.2976, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: 9.40% (10.3673 => 11.3418, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.40% (0.6450 => 0.7056, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 9.37% (0.6456 => 0.7061, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.34% (0.2603 => 0.2846, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.33% (2.2024 => 2.4079, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 9.10% (0.8921 => 0.9733, std.dev.: 0.0112) SingleSource/UnitTests/SignlessTypes/rem: 9.09% (0.1144 => 0.1248, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.06% (2.2022 => 2.4018, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 8.98% (0.4289 => 0.4674, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.93% (0.2430 => 0.2647, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.92% (1.4186 => 1.5451, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.79% (0.1695 => 0.1844, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 8.56% (0.3387 => 0.3677, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 8.48% (0.1463 => 0.1587, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.43% (0.3865 => 0.4191, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 8.25% (0.4620 => 0.5001, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.24% (0.4103 => 0.4441, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 8.21% (0.3422 => 0.3703, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.09% (0.4203 => 0.4543, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 7.88% (0.7326 => 0.7903, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 7.79% (0.3684 => 0.3971, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 7.51% (0.4048 => 0.4352, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/sieve: 7.44% (0.3603 => 0.3871, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 7.41% (0.6030 => 0.6477, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 7.39% (0.5925 => 0.6363, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.18% (0.3650 => 0.3912, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.87% (0.3379 => 0.3611, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 6.85% (0.2905 => 0.3104, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.85% (0.2891 => 0.3089, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.80% (0.3826 => 0.4086, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.69% (2.0665 => 2.2047, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 6.68% (0.2831 => 0.3020, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 6.67% (0.2714 => 0.2895, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.61% (0.3162 => 0.3371, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.59% (0.4064 => 0.4332, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.58% (0.2871 => 0.3060, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 6.44% (0.2049 => 0.2181, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 6.39% (1.2842 => 1.3663, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: 6.39% (0.3098 => 0.3296, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.34% (0.3283 => 0.3491, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.31% (0.3232 => 0.3436, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.24% (0.2756 => 0.2928, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 6.18% (0.3092 => 0.3283, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.16% (0.2872 => 0.3049, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 6.09% (0.3282 => 0.3482, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 6.08% (0.2877 => 0.3052, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.06% (0.3052 => 0.3237, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.06% (0.2725 => 0.2890, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.87% (0.2793 => 0.2957, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 5.75% (0.2802 => 0.2963, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.72% (0.3427 => 0.3623, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.13% (0.3136 => 0.3297, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.3131 => 0.3265, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.85% (0.3935 => 0.4047, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.75% (0.3817 => 0.3922, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.72% (1.1145 => 1.3009, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 13.90% (6.6465 => 7.5701, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.84% (1.1396 => 1.2517, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.91% (1.7254 => 1.8791, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 8.12% (0.9505 => 1.0277, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3683, std.dev.: 0.0026) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.03% (4.2280 => 4.3983, std.dev.: 0.0131) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.65% (8.6802 => 8.9098, std.dev.: 0.0131) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 1.94% (3.1595 => 3.2207, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bisort/bisort: 1.81% (0.8333 => 0.8484, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0496, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5776, std.dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -75.34% (0.8651 => 0.2133, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -73.58% (5.2763 => 1.3942, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -45.99% (0.1622 => 0.0876, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -13.38% (0.1330 => 0.1152, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -9.96% (1.7609 => 1.5855, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -8.93% (54.1659 => 49.3263, std.dev.: 0.0295) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.51% (7.9617 => 7.8412, std.dev.: 0.0126) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: -19.94% (0.2161 => 0.1730, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: -15.79% (1.6925 => 1.4252, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.98% (32.5116 => 28.9420, std.dev.: 0.0042) MultiSource/Benchmarks/NPB-serial/is/is: -10.98% (9.5636 => 8.5136, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/mandel-2: -10.79% (1.5373 => 1.3715, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.14% (1.5660 => 1.4229, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: -8.73% (0.1592 => 0.1453, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2949, std.dev.: 0.0374) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.99% (1.8329 => 1.7047, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -6.68% (1.2373 => 1.1546, std.dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -6.07% (0.4808 => 0.4516, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.17% (1.6805 => 1.5937, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5073, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.16% (0.9957 => 0.9543, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.84% (1.3677 => 1.3152, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -3.24% (5.0483 => 4.8848, std.dev.: 0.0013) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.81% (8.1563 => 8.0086, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6769, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -1.77% (85.0658 => 83.5599, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: -1.66% (10.2830 => 10.1123, std.dev.: 0.0064) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.09% (6.2999 => 6.2311, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8576, std.dev.: 0.0008) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.05% (1.1048 => 1.1053, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -99.97% (7.1582 => 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: -99.86% (0.0720 => 0.0001) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -66.49% (0.2116 => 0.0709, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 7 02:15:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 7 Nov 2012 04:15:12 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121107101512.593542A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5651?compare_to=5648&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5651, Order: 167527, Start Time: 2012-11-07 08:49:47, End Time: 2012-11-07 10:15:22 To: 5648, Order: 167525, Start Time: 2012-11-07 07:04:41, End Time: 2012-11-07 08:31:30 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 7 (115 on baseline) Performance Improvements: 8 (27 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 976 (832 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.51% (0.2904 => 0.3093, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (0.8835 => 0.9005, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 1.70% (1.4785 => 1.5037, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.93% (14.4314 => 15.1423, std.dev.: 0.1276) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.65% (40.2984 => 41.3658, std.dev.: 0.0911) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.13% (2.9099 => 2.9428, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.05% (1.1361 => 1.1480, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -3.82% (0.5265 => 0.5064, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.89% (0.8794 => 0.8540, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.00% (0.9054 => 0.8873, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -1.98% (0.8328 => 0.8163, std.dev.: 0.0038) MultiSource/Applications/lua/lua: -1.54% (3.9760 => 3.9147, std.dev.: 0.0185) MultiSource/Applications/JM/ldecod/ldecod: -1.07% (6.9062 => 6.8326, std.dev.: 0.0250) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -1.72% (3.0836 => 3.0307, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/ft/ft: -1.20% (0.8868 => 0.8762, std.dev.: 0.0018) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.20% (16.6943 => 16.6602, std.dev.: 0.1461) MultiSource/Applications/obsequi/Obsequi: -0.24% (1.0681 => 1.0655, std.dev.: 0.0060) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.92% (22.0024 => 21.5789, std.dev.: 0.0873) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.11% (0.3645 => 0.3649, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 0.13% (0.6049 => 0.6057, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.66% (0.3345 => 0.3323, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/strcat: 0.15% (0.2010 => 0.2013, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 34.03% (0.0144 => 0.0193, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 10.99% (0.0382 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.70% (0.0284 => 0.0286, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.64% (0.0303 => 0.0311) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 12.83% (0.0374 => 0.0422, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -19.70% (0.0203 => 0.0163, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/test1: -34.56% (0.0217 => 0.0142, std.dev.: 0.0035) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 30.00% (0.0010 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.55% (0.1449 => 0.1441, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.57% (1.1443 => 1.1623, std.dev.: 0.0358) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.20% (0.1495 => 0.1477, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.26% (0.4430 => 0.4197, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.01% (0.1386 => 0.1400, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.65% (0.0667 => 0.0636, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -21.59% (0.0264 => 0.0207, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.52% (0.0592 => 0.0601, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.99% (1.2057 => 1.1938, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 250.00% (0.0002 => 0.0007, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.71% (0.0563 => 0.0567, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.03% (0.0237 => 0.0199, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.83% (0.7731 => 0.7795, std.dev.: 0.0281) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -26.15% (0.0065 => 0.0048, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2319.20% (0.6332 => 15.3184, std.dev.: 0.0787) MultiSource/Benchmarks/McCat/08-main/main: 46.64% (0.1831 => 0.2685, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.03% (0.1559 => 0.1465, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1484.00% (0.3344 => 5.2969, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.79% (0.2364 => 0.3210, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: -1.40% (0.0429 => 0.0423, std.dev.: 0.0008) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0224 => 0.0224, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4246, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0710, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4905, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3419, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1358, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4061, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: -23.90% (2.1832 => 1.6614, std.dev.: 0.0032) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.06% (0.0810 => 0.0932, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.89% (0.1425 => 0.1566, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 9.26% (0.1112 => 0.1215, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.22% (0.8321 => 0.9005, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.98% (0.2279 => 0.2438, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.61% (0.2180 => 0.2324, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.34% (0.3137 => 0.3336, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.95% (0.7473 => 0.7918, std.dev.: 0.0062) MultiSource/Applications/hbd/hbd: 5.38% (1.4269 => 1.5037, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.30% (0.2998 => 0.3157, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.84% (0.3717 => 0.3897, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.81% (0.8148 => 0.8540, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.51% (0.6010 => 0.6281, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.48% (0.4847 => 0.5064, std.dev.: 0.0075) MultiSource/Applications/spiff/spiff: 4.35% (0.7950 => 0.8296, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.98% (1.1685 => 1.2150, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.81% (0.5961 => 0.6188, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.81% (0.4783 => 0.4965, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.69% (1.4479 => 1.5013, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.50% (1.6386 => 1.6959, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.49% (0.3295 => 0.3410, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.43% (0.3124 => 0.3231, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 3.37% (0.4397 => 0.4545, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: 3.31% (1.2222 => 1.2626, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.27% (0.4127 => 0.4262, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.26% (0.6287 => 0.6492, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.26% (4.1763 => 4.3123, std.dev.: 0.0308) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.06% (4.4873 => 4.6247, std.dev.: 0.0283) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.99% (0.8697 => 0.8957, std.dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.95% (6.6074 => 6.8020, std.dev.: 0.0418) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.84% (0.5817 => 0.5982, std.dev.: 0.0060) MultiSource/Applications/ClamAV/clamscan: 2.74% (14.7684 => 15.1726, std.dev.: 0.0187) MultiSource/Applications/minisat/minisat: 2.68% (0.6834 => 0.7017, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.62% (0.8855 => 0.9087, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.62% (0.8286 => 0.8503, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.61% (0.8050 => 0.8260, std.dev.: 0.0040) MultiSource/Applications/lua/lua: 2.51% (3.8189 => 3.9147, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.51% (0.9688 => 0.9931, std.dev.: 0.0088) MultiSource/Applications/hexxagon/hexxagon: 2.50% (0.9810 => 1.0055, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.43% (13.1811 => 13.5008, std.dev.: 0.0858) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.38% (0.8611 => 0.8816, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.38% (0.8359 => 0.8558, std.dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 2.34% (14.2605 => 14.5945, std.dev.: 0.0228) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.19% (0.8420 => 0.8604, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.12% (0.8177 => 0.8350, std.dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 2.07% (1.2568 => 1.2828, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.07% (0.8317 => 0.8489, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.06% (0.8048 => 0.8214, std.dev.: 0.0052) MultiSource/Applications/treecc/treecc: 2.05% (1.9948 => 2.0357, std.dev.: 0.0135) MultiSource/Benchmarks/nbench/nbench: 2.02% (1.1271 => 1.1499, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.02% (1.3279 => 1.3547, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.95% (0.8007 => 0.8163, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.93% (0.8086 => 0.8242, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 1.92% (3.2366 => 3.2987, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.92% (0.8457 => 0.8619, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.87% (8.6476 => 8.8094, std.dev.: 0.0513) MultiSource/Applications/JM/lencod/lencod: 1.86% (15.3280 => 15.6133, std.dev.: 0.0269) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.85% (0.8204 => 0.8356, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.83% (0.9069 => 0.9235, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.82% (0.8340 => 0.8492, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.80% (0.8716 => 0.8873, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.78% (0.8656 => 0.8810, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.77% (0.8712 => 0.8866, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.73% (4.4880 => 4.5657, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.73% (0.9908 => 1.0079, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.69% (0.8338 => 0.8479, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.66% (0.7966 => 0.8098, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.55% (0.8885 => 0.9023, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.54% (2.1401 => 2.1730, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.50% (0.8331 => 0.8456, std.dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 1.49% (6.7320 => 6.8326, std.dev.: 0.0250) MultiSource/Applications/lambda-0_1_3/lambda: 1.47% (0.7557 => 0.7668, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.37% (0.9039 => 0.9163, std.dev.: 0.0023) MultiSource/Benchmarks/PAQ8p/paq8p: 1.32% (2.3764 => 2.4077, std.dev.: 0.0088) MultiSource/Benchmarks/Bullet/bullet: 1.29% (31.8598 => 32.2700, std.dev.: 0.0263) MultiSource/Applications/siod/siod: 1.21% (2.2184 => 2.2452, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.18% (1.5315 => 1.5496, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 1.10% (8.6247 => 8.7193, std.dev.: 0.0070) MultiSource/Applications/oggenc/oggenc: 1.03% (4.9628 => 5.0141, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 104.02% (0.0199 => 0.0406, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/pi: 57.54% (1.5795 => 2.4883, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.66% (2.9753 => 3.4710, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.45% (0.7597 => 0.8847, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.74% (2.7995 => 3.2122, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6090, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.20% (1.1857 => 1.2829, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/queens: 7.10% (1.7056 => 1.8267, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.00% (4.7794 => 5.1140, std.dev.: 0.0177) MultiSource/Applications/SIBsim4/SIBsim4: 6.32% (3.1873 => 3.3887, std.dev.: 0.0180) SingleSource/Benchmarks/Misc/richards_benchmark: 6.17% (1.3037 => 1.3841, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.92% (4.9686 => 5.2625, std.dev.: 0.0953) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.84% (4.5327 => 4.7976, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.70% (3.3761 => 3.5347, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.53% (6.2275 => 6.5098, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.44% (4.9453 => 5.1650, std.dev.: 0.0279) MultiSource/Applications/hexxagon/hexxagon: 4.10% (14.0064 => 14.5809, std.dev.: 0.0633) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.07% (4.9469 => 5.1482, std.dev.: 0.0303) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.68% (0.3587 => 0.3719, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.39% (14.6451 => 15.1423, std.dev.: 0.1276) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.13% (4.8660 => 5.0184, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.83% (11.5690 => 11.8963, std.dev.: 0.0088) MultiSource/Applications/lambda-0_1_3/lambda: 2.72% (7.4933 => 7.6974, std.dev.: 0.0245) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.72% (8.2783 => 8.5031, std.dev.: 0.0279) MultiSource/Applications/siod/siod: 2.63% (3.6643 => 3.7607, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: 2.36% (7.3375 => 7.5107, std.dev.: 0.0080) SingleSource/Benchmarks/Dhrystone/dry: 2.11% (0.5081 => 0.5188, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.67% (4.8362 => 4.9168, std.dev.: 0.0163) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.52% (44.5605 => 45.2358, std.dev.: 0.1718) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.29% (2.4647 => 2.4965, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.25% (1.5941 => 1.6141, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.18% (3.5679 => 3.6101, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/ReedSolomon: 1.15% (8.5322 => 8.6305, std.dev.: 0.0186) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.14% (2.9096 => 2.9428, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.01% (1.1365 => 1.1480, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.00% (4.0473 => 4.0878, std.dev.: 0.0079) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.32% (5.4641 => 4.2990, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.91% (7.2130 => 6.1372, std.dev.: 0.2951) SingleSource/Benchmarks/McGill/chomp: -10.94% (1.1216 => 0.9989, std.dev.: 0.0140) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.66% (1.0512 => 0.9391, std.dev.: 0.0283) SingleSource/Benchmarks/Shootout/heapsort: -8.61% (3.2926 => 3.0090, std.dev.: 0.0599) MultiSource/Benchmarks/mafft/pairlocalalign: -8.54% (63.1822 => 57.7863, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.86% (4.7482 => 4.4227, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.42% (0.3269 => 0.3059, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.99% (3.7148 => 3.4922, std.dev.: 0.0298) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.83% (5.4972 => 5.1769, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.04% (5.1557 => 4.8960, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.36% (4.7449 => 4.5378, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.69% (6.0224 => 5.8004, std.dev.: 0.0152) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.32% (2.4490 => 2.3677, std.dev.: 0.0061) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (28.5821 => 27.6888, std.dev.: 0.0691) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.00% (0.5807 => 0.5633, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.71% (2.6356 => 2.5641, std.dev.: 0.0069) MultiSource/Applications/lua/lua: -2.67% (29.8330 => 29.0375, std.dev.: 0.1783) MultiSource/Applications/aha/aha: -2.60% (3.3398 => 3.2531, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/mason/mason: -2.59% (0.5415 => 0.5275, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.39% (9.9065 => 9.6698, std.dev.: 0.0819) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.06% (11.5316 => 11.2942, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.58% (4.9994 => 4.9202, std.dev.: 0.0300) SingleSource/Benchmarks/Shootout-C++/hash2: -1.55% (3.4237 => 3.3708, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.45% (3.2169 => 3.1703, std.dev.: 0.0072) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.3487 => 2.3203, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout/hash: -1.20% (4.3087 => 4.2572, std.dev.: 0.0195) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.30% (16.4461 => 16.6602, std.dev.: 0.1461) MultiSource/Applications/obsequi/Obsequi: 3.83% (1.0262 => 1.0655, std.dev.: 0.0060) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6809.67% (0.3123 => 21.5789, std.dev.: 0.0873) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.15% (0.2463 => 0.3649, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 0.78% (0.6010 => 0.6057, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.75% (0.3266 => 0.3323, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/strcat: 2.23% (0.1969 => 0.2013, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 56.91% (0.0123 => 0.0193, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 12.60% (0.0254 => 0.0286, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.98% (0.0302 => 0.0311) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -14.21% (0.0190 => 0.0163, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/test1: -21.11% (0.0180 => 0.0142, std.dev.: 0.0035) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1438 => 0.1441, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.60% (1.1329 => 1.1623, std.dev.: 0.0358) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.03% (0.1462 => 0.1477, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.79% (0.4164 => 0.4197, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.26% (0.1369 => 0.1400, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.78% (0.0641 => 0.0636, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.15% (0.0195 => 0.0207, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.98% (0.0578 => 0.0601, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.38% (1.1437 => 1.1938, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 600.00% (0.0001 => 0.0007, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.57% (0.0627 => 0.0567, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 10.56% (0.0180 => 0.0199, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.77% (0.8017 => 0.7795, std.dev.: 0.0281) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -22.58% (0.0062 => 0.0048, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 7 03:43:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 7 Nov 2012 05:43:00 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121107114300.2E26A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5652?compare_to=5646&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5652, Order: 167527, Start Time: 2012-11-07 08:27:29, End Time: 2012-11-07 11:43:10 To: 5646, Order: 167523, Start Time: 2012-11-07 04:17:11, End Time: 2012-11-07 07:32:42 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (172 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (718 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 10.40% (67.8467 => 74.9037, std.dev.: 0.0260) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.31% (54.1319 => 54.8408, std.dev.: 0.0277) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.48% (0.0625 => 0.0878, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.08% (0.1063 => 0.1404, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.97% (0.2969 => 0.3740, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.86% (0.1106 => 0.1392, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.70% (0.4253 => 0.5346, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.51% (0.0714 => 0.0889, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.47% (0.4139 => 0.5152, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 24.25% (1.5932 => 1.9796, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.58% (0.0475 => 0.0587, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.51% (0.5900 => 0.7287, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.41% (0.4994 => 0.6163, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.12% (0.0584 => 0.0719, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.86% (0.5000 => 0.6143, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.19% (0.0897 => 0.1096, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.04% (0.1620 => 0.1977, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 22.04% (0.0599 => 0.0731, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.94% (0.1021 => 0.1245) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.77% (0.1107 => 0.1348, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.58% (0.0584 => 0.0710, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.33% (0.0633 => 0.0768, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 20.99% (0.0948 => 0.1147, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.61% (0.0495 => 0.0597, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.58% (0.1103 => 0.1330, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.52% (0.0541 => 0.0652, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.40% (0.0642 => 0.0773) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.24% (0.3903 => 0.4693, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/health/health: 20.22% (0.0821 => 0.0987, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.21% (0.1549 => 0.1862, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.14% (0.1003 => 0.1205, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.95% (0.0822 => 0.0986, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 19.95% (0.1619 => 0.1942, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.95% (0.1604 => 0.1924, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.29% (0.1462 => 0.1744, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 19.11% (0.0947 => 0.1128, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 18.97% (0.1218 => 0.1449, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 18.69% (0.0808 => 0.0959, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.56% (0.3890 => 0.4612, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: 18.47% (0.1505 => 0.1783, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 18.33% (0.5826 => 0.6894, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.32% (0.2014 => 0.2383, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.91% (0.2736 => 0.3226, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 17.91% (0.0698 => 0.0823, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 17.90% (0.4029 => 0.4750, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 17.76% (0.5889 => 0.6935, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.74% (0.1088 => 0.1281, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.73% (0.0581 => 0.0684, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.64% (1.3152 => 1.5472, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.52% (0.2866 => 0.3368, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 17.23% (1.8794 => 2.2033, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.23% (0.1968 => 0.2307, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 17.09% (0.5546 => 0.6494, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.07% (0.4658 => 0.5453, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.95% (3.5627 => 4.1667, std.dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 16.86% (0.0605 => 0.0707, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 16.82% (0.1421 => 0.1660, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.63% (0.3271 => 0.3815, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.45% (0.2875 => 0.3348, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.41% (1.6211 => 1.8872, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.38% (0.1160 => 0.1350, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 16.25% (0.9697 => 1.1273, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.23% (0.4361 => 0.5069, std.dev.: 0.0020) MultiSource/Applications/d/make_dparser: 16.17% (1.0781 => 1.2524, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/fibo: 16.04% (0.2725 => 0.3162, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.03% (0.3930 => 0.4560, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.98% (0.5026 => 0.5829, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/bh/bh: 15.97% (0.1284 => 0.1489, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 15.95% (0.7171 => 0.8315, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hello: 15.88% (0.2714 => 0.3145, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.78% (0.2738 => 0.3170, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.77% (4.4195 => 5.1165, std.dev.: 0.0091) MultiSource/Applications/ClamAV/clamscan: 15.70% (4.2109 => 4.8719, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.68% (0.2729 => 0.3157, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.59% (2.7292 => 3.1548, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/except: 15.55% (0.2811 => 0.3248, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: 15.54% (0.2780 => 0.3212, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 15.53% (0.2750 => 0.3177, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 15.48% (0.3004 => 0.3469, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.44% (0.2792 => 0.3223, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.41% (0.1090 => 0.1258, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 15.41% (0.2823 => 0.3258, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.39% (0.2911 => 0.3359, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: 15.36% (0.2813 => 0.3245, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 15.34% (0.3096 => 0.3571, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 15.34% (0.2803 => 0.3233, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 15.33% (0.9909 => 1.1428, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.31% (0.3195 => 0.3684, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 15.23% (23.5202 => 27.1013, std.dev.: 0.0215) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.18% (2.0673 => 2.3811, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.13% (1.9694 => 2.2674, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 15.08% (0.2075 => 0.2388, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.99% (1.9966 => 2.2959, std.dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 14.85% (0.2566 => 0.2947, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 14.79% (0.3258 => 0.3740, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 14.78% (0.3267 => 0.3750, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.63% (0.3362 => 0.3854, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 14.59% (0.3317 => 0.3801, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.51% (0.3060 => 0.3504, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.18% (0.3124 => 0.3567, std.dev.: 0.0118) MultiSource/Applications/lua/lua: 14.09% (1.4269 => 1.6279, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/moments: 14.06% (0.3678 => 0.4195, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.05% (0.3282 => 0.3743, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 14.01% (0.3726 => 0.4248, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 14.01% (0.3348 => 0.3817, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.90% (0.3625 => 0.4129, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 13.88% (0.3465 => 0.3946, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.82% (0.3488 => 0.3970, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 13.81% (0.3477 => 0.3957, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 13.80% (0.7875 => 0.8962, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.79% (0.3981 => 0.4530, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.76% (0.3496 => 0.3977, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 13.76% (0.3446 => 0.3920, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.74% (0.3442 => 0.3915, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.73% (0.3460 => 0.3935, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.69% (0.3469 => 0.3944, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 13.69% (0.4251 => 0.4833, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 13.58% (0.4146 => 0.4709, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 13.51% (4.6177 => 5.2417, std.dev.: 0.0079) SingleSource/UnitTests/ObjC/exceptions: 13.51% (0.3643 => 0.4135, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.50% (0.3690 => 0.4188, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 13.45% (2.1653 => 2.4566, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/property: 13.40% (0.3650 => 0.4139, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 13.32% (0.0758 => 0.0859, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.32% (0.3724 => 0.4220, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.24% (0.3845 => 0.4354, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 13.04% (2.1013 => 2.3753, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/bigfib: 12.91% (0.5012 => 0.5659, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.79% (0.2040 => 0.2301, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 12.60% (0.2691 => 0.3030, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 12.12% (5.5417 => 6.2136, std.dev.: 0.0130) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.79% (0.6435 => 0.7194, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.48% (0.1028 => 0.1146, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 11.44% (0.3498 => 0.3898, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.14% (0.1383 => 0.1537, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 10.96% (0.4847 => 0.5378, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.93% (0.2068 => 0.2294, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.92% (0.2737 => 0.3036, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 10.88% (0.6634 => 0.7356, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.73% (0.3084 => 0.3415, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 10.43% (0.3336 => 0.3684, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.32% (0.2103 => 0.2320, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 9.96% (2.0346 => 2.2372, std.dev.: 0.0046) MultiSource/Applications/lemon/lemon: 9.95% (0.2391 => 0.2629, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.91% (4.6926 => 5.1109, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.90% (11.6398 => 12.6758, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.69% (0.5361 => 0.5827, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.60% (0.5584 => 0.6064, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.40% (0.7426 => 0.8050, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 6.72% (11.9555 => 12.7585, std.dev.: 0.0101) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.43% (0.3792 => 0.3960, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 9.96% (0.2802 => 0.3081, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6096, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.24% (12.0509 => 12.6823, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1715, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-2: 4.49% (1.8057 => 1.8868, std.dev.: 0.0046) SingleSource/Benchmarks/Dhrystone/dry: 4.27% (14.0481 => 14.6473, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2044, std.dev.: 0.0047) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2226, std.dev.: 0.0043) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3053, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2872, std.dev.: 0.0027) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5938, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.74% (2.4764 => 2.4333, std.dev.: 0.0165) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.91% (25.4195 => 16.5453, std.dev.: 0.0296) SingleSource/Benchmarks/Shootout-C++/ary2: -9.33% (0.2402 => 0.2178, std.dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9762, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7984, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8003, std.dev.: 0.0043) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7734, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.97% (0.6293 => 0.6106, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.29% (17.2379 => 16.8426, std.dev.: 0.0691) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8705, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5794, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4960, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1647, std.dev.: 0.0607) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0426, std.dev.: 0.0038) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 7 06:34:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 7 Nov 2012 08:34:22 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121107143422.D73162A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5653?compare_to=5651&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5653, Order: 167529, Start Time: 2012-11-07 13:08:23, End Time: 2012-11-07 14:34:33 To: 5651, Order: 167527, Start Time: 2012-11-07 08:49:47, End Time: 2012-11-07 10:15:22 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 15 (114 on baseline) Performance Improvements: 1 (25 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 975 (835 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest: 14.50% (0.0786 => 0.0900, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.76% (0.2187 => 0.2291, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.43% (0.9594 => 1.0019, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.03% (2.0357 => 2.0770, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.94% (0.5982 => 0.6098, std.dev.: 0.0036) MultiSource/Applications/spiff/spiff: 1.84% (0.8296 => 0.8449, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.83% (1.2086 => 1.2307, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.77% (1.1299 => 1.1499, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.60% (0.6492 => 0.6596, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.37% (1.2656 => 1.2830, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.17% (8.8094 => 8.9122, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.09% (4.5657 => 4.6153, std.dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 10.63% (0.1994 => 0.2206, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.46% (1.0218 => 1.0367, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: 1.15% (1.5618 => 1.5797, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.29% (15.1423 => 14.4928, std.dev.: 0.1208) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.00% (16.6602 => 16.6594, std.dev.: 0.1746) MultiSource/Applications/obsequi/Obsequi: -0.05% (1.0655 => 1.0650, std.dev.: 0.0056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.10% (21.5789 => 21.5581, std.dev.: 0.4120) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.38% (0.3649 => 0.3663, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -0.23% (0.6057 => 0.6043, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.35% (0.3323 => 0.3368, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/strcat: -0.40% (0.2013 => 0.2005, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -19.69% (0.0193 => 0.0155, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0424 => 0.0426, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 16.08% (0.0286 => 0.0332, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.64% (0.0311 => 0.0313, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0422 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 24.54% (0.0163 => 0.0203, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 37.32% (0.0142 => 0.0195, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -1.04% (0.1441 => 0.1426, std.dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -3.62% (1.1623 => 1.1202, std.dev.: 0.0105) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.76% (0.1477 => 0.1451, std.dev.: 0.0106) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.02% (0.4197 => 0.4154, std.dev.: 0.0296) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.43% (0.1400 => 0.1448, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.69% (0.0636 => 0.0568, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.22% (0.0207 => 0.0253, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.82% (0.0601 => 0.0542, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.34% (1.1938 => 1.1979, std.dev.: 0.0541) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0007 => 0.0007, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0567 => 0.0567, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.58% (0.0199 => 0.0230, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.23% (0.7795 => 0.7813, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 27.08% (0.0048 => 0.0061, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2299.95% (0.6332 => 15.1965, std.dev.: 0.2682) MultiSource/Benchmarks/McCat/08-main/main: 47.90% (0.1831 => 0.2708, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.22% (0.1559 => 0.1462, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1476.76% (0.3344 => 5.2727, std.dev.: 0.0272) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.06% (0.2364 => 0.3240, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: 3.73% (0.0429 => 0.0445, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.91% (0.0224 => 0.0235, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -26.09% (0.0230 => 0.0170, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4173, std.dev.: 0.0384) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0700, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4946, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3318, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1225, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3992, std.dev.: 0.0057) SingleSource/Regression/C/uint64_to_float: -23.83% (2.1832 => 1.6630, std.dev.: 0.0034) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.04% (0.0810 => 0.0948, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 14.30% (0.1112 => 0.1271, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.45% (0.0773 => 0.0877, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.29% (0.0830 => 0.0932, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.68% (0.1157 => 0.1269, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.45% (0.8321 => 0.9107, std.dev.: 0.0062) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.19% (0.3137 => 0.3394, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.79% (0.1425 => 0.1536, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.56% (0.1905 => 0.2049, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.41% (0.2133 => 0.2291, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.89% (0.2279 => 0.2436, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.68% (0.8148 => 0.8692, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.39% (0.2519 => 0.2680, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.30% (0.2998 => 0.3187, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.28% (0.7950 => 0.8449, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/em3d/em3d: 6.22% (0.1721 => 0.1828, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.19% (0.9435 => 1.0019, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.12% (0.2240 => 0.2377, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.11% (0.4847 => 0.5143, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.04% (1.1606 => 1.2307, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.87% (0.2180 => 0.2308, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.62% (0.1885 => 0.1991, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.47% (0.5961 => 0.6287, std.dev.: 0.0024) MultiSource/Applications/hbd/hbd: 5.27% (1.4269 => 1.5021, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.91% (0.6287 => 0.6596, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.83% (0.5817 => 0.6098, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.27% (1.1685 => 1.2184, std.dev.: 0.0058) MultiSource/Applications/Burg/burg: 4.23% (1.2222 => 1.2739, std.dev.: 0.0117) MultiSource/Applications/treecc/treecc: 4.12% (1.9948 => 2.0770, std.dev.: 0.0127) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.97% (0.4783 => 0.4973, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/18-imp/imp: 3.94% (0.3503 => 0.3641, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: 3.67% (4.1305 => 4.2819, std.dev.: 0.0276) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.53% (1.3279 => 1.3748, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.4479 => 1.4980, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.45% (6.6074 => 6.8353, std.dev.: 0.0355) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.32% (0.4127 => 0.4264, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.12% (4.1763 => 4.3065, std.dev.: 0.0432) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.08% (1.2526 => 1.2912, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.06% (8.6476 => 8.9122, std.dev.: 0.0082) MultiSource/Applications/ClamAV/clamscan: 3.04% (14.7684 => 15.2180, std.dev.: 0.1666) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.95% (1.1170 => 1.1499, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.89% (4.4873 => 4.6170, std.dev.: 0.0488) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.85% (0.7966 => 0.8193, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.84% (4.4880 => 4.6153, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.70% (1.6386 => 1.6829, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.69% (4.5702 => 4.6931, std.dev.: 0.0448) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.67% (0.8007 => 0.8221, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.67% (0.8317 => 0.8539, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.62% (0.6227 => 0.6390, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: 2.60% (0.6834 => 0.7012, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.47% (0.8697 => 0.8912, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.46% (0.8331 => 0.8536, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/05-eks/eks: 2.37% (0.4397 => 0.4501, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.36% (0.8716 => 0.8922, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.26% (0.8086 => 0.8269, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.21% (0.8457 => 0.8644, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.16% (0.9074 => 0.9270, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.14% (0.8069 => 0.8242, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.12% (0.8286 => 0.8462, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.11% (0.8518 => 0.8698, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 2.11% (0.8768 => 0.8953, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.10% (0.8712 => 0.8895, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.08% (0.8855 => 0.9039, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.05% (0.8204 => 0.8372, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.99% (0.9908 => 1.0105, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.99% (0.8050 => 0.8210, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.92% (0.8656 => 0.8822, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.91% (0.8261 => 0.8419, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.91% (0.9069 => 0.9242, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.88% (0.8066 => 0.8218, std.dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: 1.85% (31.8598 => 32.4489, std.dev.: 0.1713) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.83% (0.9039 => 0.9204, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.81% (1.2602 => 1.2830, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.78% (0.7932 => 0.8073, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.75% (0.8177 => 0.8320, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.74% (0.9688 => 0.9857, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.72% (0.8338 => 0.8481, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.61% (0.8316 => 0.8450, std.dev.: 0.0045) MultiSource/Benchmarks/PAQ8p/paq8p: 1.59% (2.3764 => 2.4143, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.52% (0.8340 => 0.8467, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 1.36% (8.6247 => 8.7416, std.dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.16% (3.1832 => 3.2200, std.dev.: 0.0098) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 101.51% (0.0199 => 0.0401, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/pi: 57.57% (1.5795 => 2.4888, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.85% (0.7597 => 0.8877, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.67% (2.7995 => 3.2102, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6091, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout/nestedloop: 9.05% (0.2023 => 0.2206, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.50% (6.3772 => 6.9192, std.dev.: 0.1164) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.18% (1.1857 => 1.2827, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 7.46% (1.7056 => 1.8329, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/strcat: 7.09% (0.1538 => 0.1647, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: 6.74% (1.3037 => 1.3916, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.68% (4.7794 => 5.0986, std.dev.: 0.0089) MultiSource/Applications/SIBsim4/SIBsim4: 6.32% (3.1873 => 3.3888, std.dev.: 0.0354) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.87% (4.9686 => 5.2605, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.86% (4.5327 => 4.7984, std.dev.: 0.0100) MultiSource/Benchmarks/BitBench/drop3/drop3: 4.78% (0.2887 => 0.3025, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.58% (3.3761 => 3.5308, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.38% (6.2275 => 6.5005, std.dev.: 0.0228) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.20% (4.9453 => 5.1530, std.dev.: 0.0121) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.01% (1.2337 => 1.2832, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 3.98% (14.0064 => 14.5643, std.dev.: 0.0148) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.96% (0.3587 => 0.3729, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.92% (11.5690 => 11.9065, std.dev.: 0.0141) MultiSource/Applications/lambda-0_1_3/lambda: 2.76% (7.4933 => 7.7002, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.74% (8.2783 => 8.5049, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.69% (4.8660 => 4.9970, std.dev.: 0.0138) MultiSource/Applications/siod/siod: 2.63% (3.6643 => 3.7607, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.23% (4.8362 => 4.9442, std.dev.: 0.0158) MultiSource/Benchmarks/FreeBench/neural/neural: 1.31% (1.0841 => 1.0983, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 1.16% (8.5322 => 8.6316, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/power/power: 1.14% (1.2061 => 1.2198, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.12% (2.9096 => 2.9422, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.20% (5.4641 => 4.3058, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.41% (1.0512 => 0.9313, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: -10.40% (1.1216 => 1.0049, std.dev.: 0.0112) MultiSource/Benchmarks/mafft/pairlocalalign: -8.56% (63.1822 => 57.7769, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.92% (0.3269 => 0.3010, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.87% (4.7482 => 4.4221, std.dev.: 0.0570) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.16% (3.7148 => 3.4858, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.73% (5.4972 => 5.1820, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.08% (5.1557 => 4.8936, std.dev.: 0.0281) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.35% (4.7449 => 4.5385, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.72% (6.0224 => 5.7981, std.dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.52% (2.4490 => 2.3629, std.dev.: 0.0259) MultiSource/Benchmarks/Prolangs-C++/life/life: -3.05% (2.6356 => 2.5553, std.dev.: 0.0065) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.04% (28.5821 => 27.7122, std.dev.: 0.0200) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.03% (0.5807 => 0.5631, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -2.91% (29.8330 => 28.9647, std.dev.: 0.0608) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.45% (9.9065 => 9.6635, std.dev.: 0.0598) MultiSource/Applications/aha/aha: -2.45% (3.3398 => 3.2579, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.07% (11.5316 => 11.2924, std.dev.: 0.0262) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.93% (3.2169 => 3.1547, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.59% (4.9994 => 4.9197, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.55% (2.3487 => 2.3124, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: -1.52% (3.4237 => 3.3717, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: -1.49% (1.4296 => 1.4083, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.20% (5.6343 => 5.5665, std.dev.: 0.0037) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.30% (16.4461 => 16.6594, std.dev.: 0.1746) MultiSource/Applications/obsequi/Obsequi: 3.78% (1.0262 => 1.0650, std.dev.: 0.0056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6803.01% (0.3123 => 21.5581, std.dev.: 0.4120) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.72% (0.2463 => 0.3663, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 0.55% (0.6010 => 0.6043, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.12% (0.3266 => 0.3368, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/strcat: 1.83% (0.1969 => 0.2005, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 26.02% (0.0123 => 0.0155, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 8.33% (0.0180 => 0.0195, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.83% (0.1438 => 0.1426, std.dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.12% (1.1329 => 1.1202, std.dev.: 0.0105) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.75% (0.1462 => 0.1451, std.dev.: 0.0106) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.24% (0.4164 => 0.4154, std.dev.: 0.0296) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.77% (0.1369 => 0.1448, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.39% (0.0641 => 0.0568, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 29.74% (0.0195 => 0.0253, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.23% (0.0578 => 0.0542, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.74% (1.1437 => 1.1979, std.dev.: 0.0541) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 600.00% (0.0001 => 0.0007, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.57% (0.0627 => 0.0567, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 27.78% (0.0180 => 0.0230, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.54% (0.8017 => 0.7813, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -1.61% (0.0062 => 0.0061, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 7 06:39:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 7 Nov 2012 08:39:09 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121107143909.17F802A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5654?compare_to=5649&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5654, Order: 167529, Start Time: 2012-11-07 13:14:11, End Time: 2012-11-07 14:39:19 To: 5649, Order: 167527, Start Time: 2012-11-07 08:00:20, End Time: 2012-11-07 09:28:06 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (4 on baseline) Performance Improvements: 0 (182 on baseline) Unchanged Tests: 1040 (856 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.26% (78.3223 => 80.0919, std.dev.: 0.6600) SingleSource/Benchmarks/Shootout/lists: 1.47% (6.1261 => 6.2159, std.dev.: 0.0120) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.79% (2.0478 => 2.1050, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/salsa20: 2.68% (7.4937 => 7.6948, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/hash2: 2.31% (3.1932 => 3.2671, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.01% (0.3821 => 0.3515, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -7.72% (2.4924 => 2.3001, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.10% (0.3142 => 0.2919, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -6.77% (0.3812 => 0.3554, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.71% (0.2428 => 0.2265, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: -6.70% (0.3880 => 0.3620, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.68% (0.3831 => 0.3575, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/exceptions-3: -6.68% (0.3848 => 0.3591, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/synchronized: -6.67% (0.3896 => 0.3636, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.64% (0.3658 => 0.3415, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.64% (0.3884 => 0.3626, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.63% (0.3891 => 0.3633, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.62% (0.4033 => 0.3766, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.61% (0.4176 => 0.3900, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.55% (0.3357 => 0.3137, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/property: -6.50% (0.4199 => 0.3926, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.45% (3.5339 => 3.3060, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.44% (1.0544 => 0.9865, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/oourafft: -6.44% (0.2160 => 0.2021, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.40% (22.4056 => 20.9709, std.dev.: 0.0151) SingleSource/UnitTests/ObjC/parameter-passing: -6.40% (0.4280 => 0.4006, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.39% (9.2283 => 8.6390, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/gs/gs: -6.37% (4.3330 => 4.0568, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.36% (0.4151 => 0.3887, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -6.34% (7.0961 => 6.6461, std.dev.: 0.0223) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.29% (0.1716 => 0.1608, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: -6.28% (0.2659 => 0.2492, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: -6.25% (16.1920 => 15.1805, std.dev.: 0.0072) MultiSource/Applications/Burg/burg: -6.24% (1.2515 => 1.1734, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.23% (0.9852 => 0.9238, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -6.22% (0.9179 => 0.8608, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: -6.21% (0.3025 => 0.2837, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.20% (0.3837 => 0.3599, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.20% (0.2355 => 0.2209, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.17% (0.3323 => 0.3118, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -6.16% (0.2989 => 0.2805, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -6.15% (0.3026 => 0.2840, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.14% (1.3722 => 1.2880, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: -6.13% (0.4861 => 0.4563, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -6.13% (1.3148 => 1.2342, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.08% (0.1761 => 0.1654, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -6.07% (0.3194 => 0.3000, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.07% (4.8161 => 4.5240, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.06% (1.2784 => 1.2009, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary2: -6.06% (0.3481 => 0.3270, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.06% (2.1713 => 2.0398, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.05% (4.5069 => 4.2341, std.dev.: 0.0054) SingleSource/Regression/C++/ofstream_ctor: -6.05% (0.3059 => 0.2874, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -6.04% (0.3446 => 0.3238, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: -6.03% (1.1450 => 1.0759, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.03% (6.7716 => 6.3635, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/ary: -6.01% (0.3394 => 0.3190, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.01% (4.8802 => 4.5870, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.00% (0.2548 => 0.2395, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -6.00% (0.2985 => 0.2806, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.99% (4.0323 => 3.7907, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: -5.99% (0.3255 => 0.3060, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.98% (1.2300 => 1.1564, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.98% (1.6474 => 1.5489, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.97% (0.3016 => 0.2836, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.96% (0.1796 => 0.1689, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.96% (1.4642 => 1.3770, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.95% (0.3931 => 0.3697, std.dev.: 0.0009) MultiSource/Applications/siod/siod: -5.93% (2.4021 => 2.2597, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.91% (0.3483 => 0.3277, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -5.91% (0.3621 => 0.3407, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.89% (0.6484 => 0.6102, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: -5.89% (0.2871 => 0.2702, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.87% (0.3849 => 0.3623, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.87% (0.9542 => 0.8982, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.87% (1.6364 => 1.5404, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.85% (0.4083 => 0.3844, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.83% (0.5999 => 0.5649, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.83% (0.4321 => 0.4069, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.83% (0.2695 => 0.2538, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -5.81% (2.1401 => 2.0157, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hello: -5.79% (0.2849 => 0.2684, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: -5.78% (0.2939 => 0.2769, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -5.78% (4.0594 => 3.8247, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.77% (0.7919 => 0.7462, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.77% (0.6293 => 0.5930, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.77% (14.2083 => 13.3889, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.76% (0.3057 => 0.2881, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.75% (0.2903 => 0.2736, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.73% (5.4682 => 5.1547, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.73% (0.2933 => 0.2765, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: -5.73% (18.2933 => 17.2455, std.dev.: 0.0341) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.72% (0.6395 => 0.6029, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: -5.72% (0.4248 => 0.4005, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.72% (0.3252 => 0.3066, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.71% (0.6304 => 0.5944, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: -5.71% (0.3205 => 0.3022, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -5.71% (1.1530 => 1.0872, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: -5.70% (15.5079 => 14.6238, std.dev.: 0.0187) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.68% (0.9557 => 0.9014, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.67% (0.5857 => 0.5525, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/sieve: -5.65% (0.3788 => 0.3574, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.65% (0.4427 => 0.4177, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.64% (0.7339 => 0.6925, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.64% (0.5478 => 0.5169, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (0.7021 => 0.6625, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.63% (0.4916 => 0.4639, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: -5.63% (34.0927 => 32.1725, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.62% (0.6230 => 0.5880, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.60% (0.5925 => 0.5593, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.60% (0.2999 => 0.2831, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -5.60% (0.6750 => 0.6372, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.59% (0.5168 => 0.4879, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: -5.58% (0.4515 => 0.4263, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.58% (0.5591 => 0.5279, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.58% (0.6260 => 0.5911, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.56% (0.5863 => 0.5537, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.55% (0.6667 => 0.6297, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.55% (0.4813 => 0.4546, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.54% (0.6194 => 0.5851, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.53% (0.5802 => 0.5481, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.53% (0.5805 => 0.5484, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.53% (0.3491 => 0.3298, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.53% (0.6660 => 0.6292, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.52% (0.5705 => 0.5390, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.50% (0.5581 => 0.5274, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.49% (0.6736 => 0.6366, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -5.49% (0.3406 => 0.3219, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.48% (0.5859 => 0.5538, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.48% (0.6189 => 0.5850, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: -5.48% (17.1032 => 16.1665, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.47% (0.5849 => 0.5529, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.47% (0.6052 => 0.5721, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.47% (0.6440 => 0.6088, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.46% (0.7524 => 0.7113, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.46% (0.5329 => 0.5038, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -5.46% (0.3867 => 0.3656, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.44% (2.2587 => 2.1358, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.44% (8.0126 => 7.5767, std.dev.: 0.0065) MultiSource/Applications/lambda-0_1_3/lambda: -5.42% (0.7982 => 0.7549, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.42% (0.5575 => 0.5273, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.42% (0.6297 => 0.5956, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.41% (0.2106 => 0.1992, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.40% (0.8521 => 0.8061, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: -5.40% (3.5154 => 3.3257, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.39% (0.5569 => 0.5269, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: -5.37% (0.4524 => 0.4281, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.35% (0.6446 => 0.6101, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.35% (0.6395 => 0.6053, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.32% (0.6033 => 0.5712, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.32% (0.5456 => 0.5166, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -5.29% (0.7447 => 0.7053, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.29% (0.5941 => 0.5627, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.28% (0.2385 => 0.2259, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.26% (0.6676 => 0.6325, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.21% (0.5567 => 0.5277, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.19% (1.2210 => 1.1576, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.19% (0.5688 => 0.5393, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: -5.18% (1.3864 => 1.3146, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -5.16% (15.2527 => 14.4663, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.15% (0.5570 => 0.5283, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.13% (0.6681 => 0.6338, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: -5.11% (0.3271 => 0.3104, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -5.07% (0.6347 => 0.6025, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -5.06% (0.6441 => 0.6115, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -4.95% (0.8418 => 0.8001, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.89% (1.2221 => 1.1624, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.87% (0.2278 => 0.2167, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: -4.74% (0.7779 => 0.7410, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.57% (0.7198 => 0.6869, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.49% (5.0226 => 4.7971, std.dev.: 0.0076) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.40% (0.3319 => 0.3173, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.27% (0.9077 => 0.8689, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: -4.25% (1.5610 => 1.4947, std.dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -2.04% (20.7746 => 20.3518, std.dev.: 0.0196) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7559, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: -8.78% (1.2842 => 1.1715, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.91% (1.7753 => 1.7058, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.86% (2.2633 => 2.1759, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.09% (1.3096 => 1.2822, std.dev.: 0.0084) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.63% (6.5735 => 6.4661, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.07% (1.6086 => 1.5914, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 7 08:54:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 7 Nov 2012 10:54:21 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121107165421.B031A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5655?compare_to=5652&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5655, Order: 167529, Start Time: 2012-11-07 13:38:37, End Time: 2012-11-07 16:54:29 To: 5652, Order: 167527, Start Time: 2012-11-07 08:27:29, End Time: 2012-11-07 11:43:10 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (172 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (719 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.68% (0.3811 => 0.3913, std.dev.: 0.0010) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.64% (0.0625 => 0.0879, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.08% (0.1063 => 0.1404, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.24% (0.4253 => 0.5369, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.17% (0.2969 => 0.3746, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.68% (0.1106 => 0.1390, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.69% (0.4139 => 0.5161, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.51% (0.0714 => 0.0889, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 24.17% (1.5932 => 1.9782, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.80% (0.5900 => 0.7304, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.79% (0.4994 => 0.6182, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.29% (0.0584 => 0.0720, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.00% (0.5000 => 0.6150, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.16% (0.1620 => 0.1979, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.96% (0.0897 => 0.1094, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.84% (0.1021 => 0.1244, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.68% (0.1107 => 0.1347, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 20.89% (0.0948 => 0.1146, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.72% (0.0584 => 0.0705, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.70% (0.0541 => 0.0653, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.40% (0.1103 => 0.1328, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.25% (0.0642 => 0.0772, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/health/health: 20.22% (0.0821 => 0.0987, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.22% (0.3903 => 0.4692, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.04% (0.1003 => 0.1204, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 20.03% (0.0604 => 0.0725, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.95% (0.1604 => 0.1924, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.83% (0.0822 => 0.0985, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 19.83% (0.1619 => 0.1940, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.82% (0.1549 => 0.1856, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 19.22% (0.0947 => 0.1129, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.15% (0.1462 => 0.1742, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.61% (0.3890 => 0.4614, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 18.56% (0.0808 => 0.0958, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 18.47% (0.1218 => 0.1443, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 18.46% (0.2823 => 0.3344, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 18.29% (0.4029 => 0.4766, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.27% (0.2014 => 0.2382, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 18.26% (0.5826 => 0.6890, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.25% (0.2866 => 0.3389, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 18.24% (0.0581 => 0.0687, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.17% (1.3152 => 1.5542, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.95% (0.2736 => 0.3227, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 17.91% (0.0698 => 0.0823, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 17.81% (0.1505 => 0.1773, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 17.78% (0.5889 => 0.6936, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.65% (0.1088 => 0.1280, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.46% (0.3271 => 0.3842, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.35% (0.4658 => 0.5466, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.23% (0.5026 => 0.5892, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.12% (3.5627 => 4.1727, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 17.12% (1.8794 => 2.2011, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.02% (0.0605 => 0.0708, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 17.00% (0.5546 => 0.6489, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.92% (0.1968 => 0.2301, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.59% (1.6211 => 1.8901, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 16.59% (0.1284 => 0.1497, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.45% (0.2875 => 0.3348, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.38% (0.1160 => 0.1350, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.37% (0.4361 => 0.5075, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 16.35% (1.0781 => 1.2544, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 16.33% (0.1421 => 0.1653, std.dev.: 0.0055) MultiSource/Applications/hbd/hbd: 16.25% (0.9697 => 1.1273, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference: 16.04% (0.7171 => 0.8321, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.93% (0.3930 => 0.4556, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.92% (0.2738 => 0.3174, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.87% (4.4195 => 5.1208, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/fibo: 15.85% (0.2725 => 0.3157, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 15.81% (4.2109 => 4.8766, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/hello: 15.77% (0.2714 => 0.3142, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 15.76% (0.2780 => 0.3218, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.68% (0.2729 => 0.3157, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 15.66% (0.2075 => 0.2400, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.62% (2.7292 => 3.1555, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: 15.60% (0.2750 => 0.3179, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.56% (0.2911 => 0.3364, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 15.51% (0.3004 => 0.3470, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 15.51% (0.2811 => 0.3247, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.50% (0.1090 => 0.1259, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.43% (0.3195 => 0.3688, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 15.41% (0.2803 => 0.3235, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.40% (0.2792 => 0.3222, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 15.39% (0.2813 => 0.3246, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 15.37% (0.9909 => 1.1432, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.36% (2.0673 => 2.3848, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.25% (1.9694 => 2.2698, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wc: 15.21% (0.3096 => 0.3567, std.dev.: 0.0054) MultiSource/Benchmarks/Bullet/bullet: 15.17% (23.5202 => 27.0890, std.dev.: 0.0205) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.06% (1.9966 => 2.2973, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary3: 14.94% (0.3267 => 0.3755, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 14.89% (0.3258 => 0.3743, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 14.68% (0.3317 => 0.3804, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.63% (0.3362 => 0.3854, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 14.61% (0.2566 => 0.2941, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.41% (0.3060 => 0.3501, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.28% (0.3124 => 0.3570, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.26% (0.3282 => 0.3750, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 14.14% (0.3678 => 0.4198, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 14.10% (0.3496 => 0.3989, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sieve: 14.09% (0.3726 => 0.4251, std.dev.: 0.0120) MultiSource/Applications/treecc/treecc: 14.06% (0.7875 => 0.8982, std.dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.04% (0.3845 => 0.4385, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.04% (0.3625 => 0.4134, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists: 14.04% (0.3348 => 0.3818, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 14.02% (0.3446 => 0.3929, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 14.00% (1.4269 => 1.6267, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.99% (0.3488 => 0.3976, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/synchronized: 13.98% (0.3469 => 0.3954, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.91% (0.3465 => 0.3947, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.87% (0.3460 => 0.3940, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.86% (0.3442 => 0.3919, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: 13.71% (0.4251 => 0.4834, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 13.69% (0.3477 => 0.3953, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.64% (0.3981 => 0.4524, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash: 13.60% (0.4146 => 0.4710, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 13.58% (2.1653 => 2.4593, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 13.56% (0.3650 => 0.4145, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.48% (0.3643 => 0.4134, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.41% (0.3690 => 0.4185, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 13.40% (0.3724 => 0.4223, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 13.33% (4.6177 => 5.2334, std.dev.: 0.0114) MultiSource/Benchmarks/mafft/pairlocalalign: 13.15% (2.1013 => 2.3776, std.dev.: 0.0169) SingleSource/Benchmarks/Misc-C++/bigfib: 12.99% (0.5012 => 0.5663, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.87% (0.1383 => 0.1561, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 12.71% (0.2691 => 0.3033, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.60% (0.2040 => 0.2297, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 12.01% (5.5417 => 6.2070, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.72% (0.6435 => 0.7189, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 11.49% (0.3498 => 0.3900, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.28% (0.1028 => 0.1144, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 11.12% (0.4847 => 0.5386, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 11.00% (0.6634 => 0.7364, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.78% (0.2068 => 0.2291, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.78% (0.2737 => 0.3032, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.51% (0.3084 => 0.3408, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.40% (0.3336 => 0.3683, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 9.91% (0.2391 => 0.2628, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 9.90% (2.0346 => 2.2360, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.84% (0.2103 => 0.2310, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.85% (11.6398 => 12.6700, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.77% (4.6926 => 5.1043, std.dev.: 0.0198) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.52% (0.5361 => 0.5818, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.36% (0.5584 => 0.6051, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.27% (0.7426 => 0.8040, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 6.75% (11.9555 => 12.7622, std.dev.: 0.0281) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.48% (0.3792 => 0.3962, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 9.24% (0.2802 => 0.3061, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.56% (3.3903 => 3.6127, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 6.46% (0.2122 => 0.2259, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.96% (0.3693 => 0.3913, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.10% (12.0509 => 12.6653, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-2: 4.89% (1.8057 => 1.8940, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1657, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6433, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2035, std.dev.: 0.0398) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2223, std.dev.: 0.0035) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3116, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2899, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.19% (8.4155 => 8.5160, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5852, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.77% (25.4195 => 16.5819, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary2: -9.58% (0.2402 => 0.2172, std.dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9757, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7964, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9587, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8060, std.dev.: 0.0036) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.59% (0.6293 => 0.6130, std.dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/fldry: -2.33% (17.2379 => 16.8358, std.dev.: 0.0280) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8699, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5722, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4971, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1861, std.dev.: 0.0947) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0412, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 7 10:43:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 7 Nov 2012 12:43:03 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121107184303.680482A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5656?compare_to=5653&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5656, Order: 167534, Start Time: 2012-11-07 17:16:04, End Time: 2012-11-07 18:43:13 To: 5653, Order: 167529, Start Time: 2012-11-07 13:08:23, End Time: 2012-11-07 14:34:33 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 8 (79 on baseline) Performance Improvements: 4 (25 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 979 (870 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 10.04% (19.8583 => 21.8523, std.dev.: 0.6657) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.89% (0.3165 => 0.3478, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.55% (2.3887 => 2.5690, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.79% (2.2581 => 2.3888, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.62% (2.6566 => 2.7528, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.61% (40.7830 => 41.8489, std.dev.: 0.2844) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.10% (22.1832 => 22.6482, std.dev.: 0.0623) SingleSource/Benchmarks/Shootout/lists: 1.78% (7.3820 => 7.5135, std.dev.: 0.0101) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.38% (1.4980 => 1.4774, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: -5.62% (0.2206 => 0.2082, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: -3.01% (0.6442 => 0.6248, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/matrix: -1.25% (1.5797 => 1.5599, std.dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.19% (16.6594 => 16.6271, std.dev.: 0.0513) MultiSource/Applications/obsequi/Obsequi: -1.17% (1.0650 => 1.0525, std.dev.: 0.0099) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.99% (21.5581 => 21.7720, std.dev.: 0.3127) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.74% (0.3663 => 0.3636, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: -0.60% (0.6043 => 0.6007, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/reversefile: -1.60% (0.3368 => 0.3314, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/strcat: -0.50% (0.2005 => 0.1995, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 40.65% (0.0155 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0426 => 0.0428, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.30% (0.0332 => 0.0331, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0313 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.18% (0.0424 => 0.0429, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 0.99% (0.0203 => 0.0205, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 11.79% (0.0195 => 0.0218, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.19% (0.1426 => 0.1443, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 5.14% (1.1202 => 1.1778, std.dev.: 0.0497) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 4.62% (0.1451 => 0.1518, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.23% (0.4154 => 0.4205, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.55% (0.1448 => 0.1440, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 13.03% (0.0568 => 0.0642, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 9.88% (0.0253 => 0.0278, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.03% (0.0542 => 0.0553, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.22% (1.1979 => 1.1953, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 342.86% (0.0007 => 0.0031, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 14.29% (0.0567 => 0.0648, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.04% (0.0230 => 0.0237, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.08% (0.7813 => 0.7819, std.dev.: 0.0167) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 32.79% (0.0061 => 0.0081, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2302.81% (0.6332 => 15.2146, std.dev.: 0.2714) MultiSource/Benchmarks/McCat/08-main/main: 47.08% (0.1831 => 0.2693, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.13% (0.1559 => 0.1479, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1478.83% (0.3344 => 5.2796, std.dev.: 0.1168) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.74% (0.2364 => 0.3209, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: 3.03% (0.0429 => 0.0442, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.45% (0.0224 => 0.0225, std.dev.: 0.0046) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0000) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4420, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0687, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4958, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3530, std.dev.: 0.0212) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1344, std.dev.: 0.0328) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4021, std.dev.: 0.0101) SingleSource/Regression/C/uint64_to_float: -24.18% (2.1832 => 1.6554, std.dev.: 0.0016) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.31% (0.0810 => 0.0934, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: 12.23% (0.1112 => 0.1248, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.43% (0.2180 => 0.2342, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.71% (0.8321 => 0.8879, std.dev.: 0.0147) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.32% (0.2279 => 0.2423, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.68% (0.1885 => 0.1992, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.28% (0.8148 => 0.8578, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.13% (0.3003 => 0.3157, std.dev.: 0.0056) MultiSource/Applications/hbd/hbd: 4.39% (1.4269 => 1.4895, std.dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.16% (0.5961 => 0.6209, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.59% (1.1606 => 1.2023, std.dev.: 0.0144) MultiSource/Applications/Burg/burg: 3.51% (1.2222 => 1.2651, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.97% (0.4783 => 0.4925, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 2.91% (0.4125 => 0.4245, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 2.65% (3.8189 => 3.9201, std.dev.: 0.0375) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.44% (0.8697 => 0.8909, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.37% (0.8050 => 0.8241, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.04% (0.8716 => 0.8894, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.04% (1.4479 => 1.4774, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.04% (1.2526 => 1.2781, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.93% (0.8457 => 0.8620, std.dev.: 0.0057) MultiSource/Benchmarks/Bullet/bullet: 1.90% (31.8598 => 32.4655, std.dev.: 0.1070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.88% (0.8611 => 0.8773, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.80% (0.7932 => 0.8075, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 1.79% (0.6834 => 0.6956, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.74% (0.8204 => 0.8347, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.70% (0.8656 => 0.8803, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.69% (0.8885 => 0.9035, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.68% (0.9074 => 0.9226, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.68% (0.8597 => 0.8741, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.65% (0.8420 => 0.8559, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.65% (0.8066 => 0.8199, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.64% (0.9688 => 0.9847, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.59% (0.9056 => 0.9200, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.58% (0.8359 => 0.8491, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 1.57% (0.9810 => 0.9964, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.56% (0.8340 => 0.8470, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.56% (1.6386 => 1.6641, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.54% (0.8048 => 0.8172, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.52% (0.8086 => 0.8209, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.51% (0.8805 => 0.8938, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.49% (0.9039 => 0.9174, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.48% (0.8286 => 0.8409, std.dev.: 0.0045) MultiSource/Benchmarks/PAQ8p/paq8p: 1.43% (2.3764 => 2.4103, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.24% (0.8338 => 0.8441, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 123.62% (0.0199 => 0.0445, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/pi: 57.88% (1.5795 => 2.4937, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.85% (0.7597 => 0.8877, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.19% (2.9753 => 3.4569, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.73% (2.7995 => 3.2119, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.90% (6.3772 => 7.1359, std.dev.: 0.1558) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.62% (5.0261 => 5.6102, std.dev.: 0.0395) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.17% (0.3186 => 0.3478, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.18% (1.1857 => 1.2827, std.dev.: 0.0067) SingleSource/Benchmarks/McGill/queens: 7.13% (1.7056 => 1.8272, std.dev.: 0.0044) MultiSource/Applications/SIBsim4/SIBsim4: 6.68% (3.1873 => 3.4001, std.dev.: 0.0525) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.64% (4.7794 => 5.0968, std.dev.: 0.0314) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.24% (2.2485 => 2.3888, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.82% (4.9686 => 5.2578, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.80% (4.5327 => 4.7955, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.53% (3.3761 => 3.5292, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.39% (4.9453 => 5.1622, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.37% (6.2275 => 6.4995, std.dev.: 0.0132) MultiSource/Applications/hexxagon/hexxagon: 3.98% (14.0064 => 14.5645, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.23% (0.3587 => 0.3703, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.91% (11.5690 => 11.9055, std.dev.: 0.0290) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.85% (1.2337 => 1.2688, std.dev.: 0.0077) MultiSource/Applications/siod/siod: 2.65% (3.6643 => 3.7613, std.dev.: 0.0146) MultiSource/Applications/lambda-0_1_3/lambda: 2.54% (7.4933 => 7.6836, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/lists: 2.40% (7.3375 => 7.5135, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.33% (4.8362 => 4.9490, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 2.32% (0.4353 => 0.4454, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.23% (8.2783 => 8.4632, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.16% (4.8660 => 4.9710, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.56% (22.2997 => 22.6482, std.dev.: 0.0623) MultiSource/Benchmarks/FreeBench/neural/neural: 1.33% (1.0841 => 1.0985, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.31% (1.5941 => 1.6150, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.29% (2.4647 => 2.4966, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.22% (3.5679 => 3.6115, std.dev.: 0.0110) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.11% (5.4641 => 4.3108, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.98% (7.2130 => 6.2765, std.dev.: 0.0698) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.82% (1.0512 => 0.9375, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -10.60% (1.1216 => 1.0027, std.dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: -8.53% (63.1822 => 57.7909, std.dev.: 0.0482) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.96% (4.7482 => 4.4175, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.94% (3.7148 => 3.4943, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.92% (5.4972 => 5.1717, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.07% (5.1557 => 4.8943, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.36% (4.7449 => 4.5380, std.dev.: 0.0290) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.88% (2.8773 => 2.7658, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.38% (6.0224 => 5.8189, std.dev.: 0.0241) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.07% (2.4490 => 2.3739, std.dev.: 0.0145) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.05% (28.5821 => 27.7101, std.dev.: 0.1409) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.01% (0.5807 => 0.5632, std.dev.: 0.0012) MultiSource/Applications/lua/lua: -2.84% (29.8330 => 28.9848, std.dev.: 0.1028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.81% (14.6451 => 14.2339, std.dev.: 0.1337) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.69% (2.6356 => 2.5647, std.dev.: 0.0140) MultiSource/Applications/aha/aha: -2.44% (3.3398 => 3.2582, std.dev.: 0.0142) MultiSource/Benchmarks/Olden/bisort/bisort: -2.32% (0.6636 => 0.6482, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.20% (9.9065 => 9.6886, std.dev.: 0.0697) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.04% (11.5316 => 11.2963, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.58% (4.9994 => 4.9206, std.dev.: 0.0152) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.31% (2.3487 => 2.3179, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.20% (5.6343 => 5.5668, std.dev.: 0.0073) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.10% (16.4461 => 16.6271, std.dev.: 0.0513) MultiSource/Applications/obsequi/Obsequi: 2.56% (1.0262 => 1.0525, std.dev.: 0.0099) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6871.50% (0.3123 => 21.7720, std.dev.: 0.3127) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.62% (0.2463 => 0.3636, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: -0.05% (0.6010 => 0.6007, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.47% (0.3266 => 0.3314, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/strcat: 1.32% (0.1969 => 0.1995, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.72% (0.0384 => 0.0429, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.35% (0.1438 => 0.1443, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 3.96% (1.1329 => 1.1778, std.dev.: 0.0497) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.83% (0.1462 => 0.1518, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.98% (0.4164 => 0.4205, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.19% (0.1369 => 0.1440, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.16% (0.0641 => 0.0642, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.56% (0.0195 => 0.0278, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.33% (0.0578 => 0.0553, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.51% (1.1437 => 1.1953, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.35% (0.0627 => 0.0648, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.67% (0.0180 => 0.0237, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.47% (0.8017 => 0.7819, std.dev.: 0.0167) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 30.65% (0.0062 => 0.0081, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 7 10:46:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 7 Nov 2012 12:46:34 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121107184634.8ABD22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5657?compare_to=5654&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5657, Order: 167534, Start Time: 2012-11-07 17:21:49, End Time: 2012-11-07 18:46:44 To: 5654, Order: 167529, Start Time: 2012-11-07 13:14:11, End Time: 2012-11-07 14:39:19 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (182 on baseline) Unchanged Tests: 1041 (855 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.27% (54.5353 => 56.3179, std.dev.: 0.0300) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.19% (54.5751 => 56.3179, std.dev.: 0.0300) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.86% (2.0478 => 2.1063, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.4937 => 7.6827, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/hash2: 2.29% (3.1932 => 3.2663, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.93% (0.3821 => 0.3518, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: -7.64% (2.4924 => 2.3021, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.91% (0.3142 => 0.2925, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -6.87% (0.3812 => 0.3550, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.80% (0.3896 => 0.3631, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -6.78% (0.3880 => 0.3617, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/for-in: -6.77% (0.4033 => 0.3760, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.76% (0.3848 => 0.3588, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.73% (0.3891 => 0.3629, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.73% (0.4176 => 0.3895, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -6.71% (0.3831 => 0.3574, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.67% (0.3884 => 0.3625, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.63% (0.2428 => 0.2267, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: -6.57% (0.4199 => 0.3923, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.48% (0.3658 => 0.3421, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.45% (3.5339 => 3.3060, std.dev.: 0.0073) SingleSource/UnitTests/ObjC/parameter-passing: -6.45% (0.4280 => 0.4004, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.40% (0.3357 => 0.3142, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.37% (22.4056 => 20.9782, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.36% (0.4151 => 0.3887, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.29% (0.6484 => 0.6076, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: -6.28% (7.0961 => 6.6504, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.27% (1.0544 => 0.9883, std.dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: -6.24% (16.1920 => 15.1818, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: -6.23% (9.2283 => 8.6538, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/hash2: -6.21% (0.4861 => 0.4559, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -6.17% (0.1879 => 0.1763, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.15% (0.3025 => 0.2839, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.14% (1.3722 => 1.2879, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: -6.14% (1.3148 => 1.2341, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/objinst: -6.14% (0.3194 => 0.2998, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -6.12% (0.2989 => 0.2806, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.11% (0.2355 => 0.2211, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: -6.10% (4.3330 => 4.0688, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.07% (1.4642 => 1.3753, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.05% (0.3837 => 0.3605, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.04% (4.8161 => 4.5250, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -6.04% (0.3394 => 0.3189, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.04% (1.2784 => 1.2012, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: -6.04% (0.3446 => 0.3238, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -6.03% (0.3481 => 0.3271, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.02% (0.9852 => 0.9259, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -6.02% (0.2659 => 0.2499, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.02% (1.2300 => 1.1560, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: -6.00% (0.9179 => 0.8628, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -6.00% (0.2985 => 0.2806, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.00% (0.3252 => 0.3057, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.99% (4.5069 => 4.2370, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/except: -5.98% (0.3026 => 0.2845, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.98% (1.6474 => 1.5489, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.98% (2.1713 => 2.0415, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -5.96% (1.2515 => 1.1769, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.95% (0.9542 => 0.8974, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: -5.95% (1.1530 => 1.0844, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.95% (6.7716 => 6.3688, std.dev.: 0.0075) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.94% (0.3016 => 0.2837, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -5.93% (0.3255 => 0.3062, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.92% (0.4321 => 0.4065, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.92% (4.8802 => 4.5911, std.dev.: 0.0042) SingleSource/Regression/C++/ofstream_ctor: -5.92% (0.3059 => 0.2878, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.90% (0.1796 => 0.1690) MultiSource/Applications/lemon/lemon: -5.88% (1.1450 => 1.0777, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.86% (0.3057 => 0.2878, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -5.85% (0.1761 => 0.1658, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.85% (0.2548 => 0.2399, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.82% (0.7919 => 0.7458, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.82% (0.3849 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: -5.82% (0.2871 => 0.2704, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.81% (4.0323 => 3.7980, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.81% (0.3323 => 0.3130, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: -5.80% (0.3621 => 0.3411, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.79% (0.2278 => 0.2146, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.79% (0.6736 => 0.6346, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.79% (0.2695 => 0.2539, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.77% (1.6364 => 1.5419, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: -5.76% (0.2849 => 0.2685, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.76% (0.4083 => 0.3848, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: -5.75% (0.2939 => 0.2770, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.75% (0.3931 => 0.3705, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.74% (0.8521 => 0.8032, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.72% (0.5857 => 0.5522, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.71% (0.3483 => 0.3284, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.71% (0.6395 => 0.6030, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.70% (0.2999 => 0.2828, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/moments: -5.70% (0.4248 => 0.4006, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -5.69% (15.5079 => 14.6257, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.68% (0.2903 => 0.2738, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -5.68% (0.3205 => 0.3023, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -5.68% (4.0594 => 3.8290, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/bigfib: -5.67% (0.6750 => 0.6367, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -5.67% (0.3406 => 0.3213, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.66% (5.4682 => 5.1589, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: -5.64% (18.2933 => 17.2610, std.dev.: 0.0180) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.63% (0.4916 => 0.4639, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -5.63% (2.4021 => 2.2669, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.63% (0.2933 => 0.2768, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.63% (0.6293 => 0.5939, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.62% (14.2083 => 13.4095, std.dev.: 0.0128) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.59% (0.4813 => 0.4544, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: -5.59% (2.1401 => 2.0205, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.57% (0.5478 => 0.5173, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.56% (0.4427 => 0.4181, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.55% (0.7021 => 0.6631, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.53% (0.5802 => 0.5481, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -5.53% (17.1032 => 16.1577, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.52% (0.5925 => 0.5598, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.52% (0.7339 => 0.6934, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.51% (0.9557 => 0.9030, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.51% (0.5591 => 0.5283, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -5.51% (0.3867 => 0.3654, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -5.50% (34.0927 => 32.2162, std.dev.: 0.0276) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.49% (0.6304 => 0.5958, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.48% (0.5863 => 0.5542, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.47% (0.6230 => 0.5889, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: -5.47% (0.3581 => 0.3385, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.47% (0.5849 => 0.5529, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.45% (0.5999 => 0.5672, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.45% (8.0126 => 7.5763, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.44% (0.6194 => 0.5857, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.44% (0.6052 => 0.5723, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.43% (0.5805 => 0.5490, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.42% (0.5329 => 0.5040, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.41% (0.6667 => 0.6306, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: -5.41% (0.3788 => 0.3583, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.40% (0.6260 => 0.5922, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.39% (0.5859 => 0.5543, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.39% (0.6440 => 0.6093, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.39% (0.3491 => 0.3303, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.38% (0.6297 => 0.5958, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: -5.38% (0.4515 => 0.4272, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.38% (0.5705 => 0.5398, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.38% (0.5575 => 0.5275, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.38% (0.6660 => 0.6302, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.37% (2.2587 => 2.1373, std.dev.: 0.0071) MultiSource/Applications/minisat/minisat: -5.37% (0.7447 => 0.7047, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.37% (0.5567 => 0.5268, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.37% (0.5569 => 0.5270, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.37% (0.2385 => 0.2257, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.37% (0.2106 => 0.1993, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.36% (0.7524 => 0.7121, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -5.35% (0.7982 => 0.7555, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.34% (0.6446 => 0.6102, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.33% (0.3319 => 0.3142, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash: -5.33% (0.4524 => 0.4283, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: -5.32% (0.2160 => 0.2045) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.30% (0.5941 => 0.5626, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.30% (0.6189 => 0.5861, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -5.29% (3.5154 => 3.3295, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.28% (0.5168 => 0.4895, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.28% (0.5456 => 0.5168, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.22% (0.6395 => 0.6061, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: -5.21% (1.3864 => 1.3142, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.21% (0.5570 => 0.5280, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.20% (0.6033 => 0.5719, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -5.15% (0.6347 => 0.6020, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.15% (0.5688 => 0.5395, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.12% (0.6676 => 0.6334, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.11% (1.2221 => 1.1596, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.10% (0.6681 => 0.6340, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -5.08% (15.2527 => 14.4779, std.dev.: 0.0122) SingleSource/UnitTests/ObjC++/property-reference-object: -5.06% (0.6441 => 0.6115, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.95% (1.2210 => 1.1606, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: -4.92% (0.8418 => 0.8004, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.83% (0.3271 => 0.3113, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -4.74% (0.7779 => 0.7410, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.58% (0.7198 => 0.6868, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.44% (0.2277 => 0.2176, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.30% (0.9077 => 0.8687, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: -4.27% (1.5610 => 1.4943, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: -3.94% (5.0226 => 4.8246, std.dev.: 0.0064) SingleSource/UnitTests/Vector/constpool: -2.08% (20.7746 => 20.3425, std.dev.: 0.0274) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7577, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.97% (2.2633 => 2.1735, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.91% (1.7753 => 1.7058, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.07% (1.0557 => 1.0233, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4703, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.46% (1.3096 => 1.2905, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0011) Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 7 12:29:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 7 Nov 2012 14:29:06 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121107202906.DDDF42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5658?compare_to=5656&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5658, Order: 167544, Start Time: 2012-11-07 19:02:22, End Time: 2012-11-07 20:29:14 To: 5656, Order: 167534, Start Time: 2012-11-07 17:16:04, End Time: 2012-11-07 18:43:13 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 2 (56 on baseline) Performance Improvements: 2 (23 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 987 (895 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 13.11% (1.6711 => 1.8902, std.dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.91% (14.2339 => 14.7898, std.dev.: 0.1111) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.38% (8.5824 => 8.3779, std.dev.: 0.0511) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.02% (7.1359 => 6.8492, std.dev.: 0.0786) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.46% (16.6271 => 16.5508, std.dev.: 0.3358) MultiSource/Applications/obsequi/Obsequi: -1.30% (1.0525 => 1.0388, std.dev.: 0.0178) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.71% (21.7720 => 21.6168, std.dev.: 0.2988) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.41% (0.3636 => 0.3651, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -0.07% (0.6007 => 0.6003, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.06% (0.3314 => 0.3312, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.1995 => 0.1995, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.46% (0.0218 => 0.0217, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.93% (0.0428 => 0.0424, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.30% (0.0331 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0312 => 0.0313, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.86% (0.0429 => 0.0421, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/casts: -1.46% (0.0205 => 0.0202, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -0.92% (0.0218 => 0.0216, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.35% (0.1443 => 0.1438, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -2.56% (1.1778 => 1.1477, std.dev.: 0.0692) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -0.53% (0.1518 => 0.1510, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.66% (0.4205 => 0.4093, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.31% (0.1440 => 0.1378, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.78% (0.0642 => 0.0637, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -21.58% (0.0278 => 0.0218, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.08% (0.0553 => 0.0559, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.59% (1.1953 => 1.1883, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -74.19% (0.0031 => 0.0008, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.80% (0.0648 => 0.0578, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.27% (0.0237 => 0.0240, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.38% (0.7819 => 0.7789, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0001 => 0.0004, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -48.15% (0.0081 => 0.0042, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2295.70% (0.6332 => 15.1696, std.dev.: 0.3413) MultiSource/Benchmarks/McCat/08-main/main: 43.86% (0.1831 => 0.2634, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.31% (0.1559 => 0.1445, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1474.34% (0.3344 => 5.2646, std.dev.: 0.1204) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.38% (0.2364 => 0.3224, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: 2.56% (0.0429 => 0.0440, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.36% (0.0224 => 0.0236, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -32.61% (0.0230 => 0.0155, std.dev.: 0.0007) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4292, std.dev.: 0.0247) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0684, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4943, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3460, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1328, std.dev.: 0.0299) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4077, std.dev.: 0.0013) SingleSource/Regression/C/uint64_to_float: -23.91% (2.1832 => 1.6613, std.dev.: 0.0026) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.31% (0.0810 => 0.0934, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.91% (0.0848 => 0.0949, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 11.24% (0.1112 => 0.1237, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.81% (0.8148 => 0.8621, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.69% (1.1606 => 1.2034, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.33% (0.8697 => 0.8987, std.dev.: 0.0048) MultiSource/Applications/Burg/burg: 3.30% (1.2222 => 1.2625, std.dev.: 0.0104) MultiSource/Applications/treecc/treecc: 3.11% (1.9948 => 2.0569, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.98% (0.4127 => 0.4250, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.95% (0.8716 => 0.8973, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.76% (0.8066 => 0.8289, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.75% (0.8597 => 0.8833, std.dev.: 0.0088) MultiSource/Applications/SIBsim4/SIBsim4: 2.70% (1.2568 => 1.2907, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.62% (0.8611 => 0.8837, std.dev.: 0.0072) MultiSource/Applications/d/make_dparser: 2.47% (3.2366 => 3.3164, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.35% (0.8050 => 0.8239, std.dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.32% (0.4783 => 0.4894, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.30% (0.8317 => 0.8508, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.23% (0.8712 => 0.8906, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.19% (1.1170 => 1.1415, std.dev.: 0.0086) MultiSource/Applications/SPASS/SPASS: 2.18% (14.2605 => 14.5709, std.dev.: 0.1075) MultiSource/Benchmarks/nbench/nbench: 2.13% (1.1271 => 1.1511, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.04% (0.8048 => 0.8212, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 1.93% (8.6247 => 8.7913, std.dev.: 0.0266) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 100.50% (0.0199 => 0.0399, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/pi: 57.08% (1.5795 => 2.4810, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.37% (2.9753 => 3.4624, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.20% (0.7597 => 0.8828, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.46% (2.7995 => 3.2044, std.dev.: 0.0607) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.64% (5.0261 => 5.6110, std.dev.: 0.0228) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.10% (1.1857 => 1.2818, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.40% (6.3772 => 6.8492, std.dev.: 0.0786) SingleSource/Benchmarks/McGill/queens: 7.25% (1.7056 => 1.8293, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.03% (0.3186 => 0.3410, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.75% (4.7794 => 5.1021, std.dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 6.59% (3.1873 => 3.3974, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.89% (4.9686 => 5.2611, std.dev.: 0.0354) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.86% (4.5327 => 4.7982, std.dev.: 0.0254) SingleSource/Benchmarks/Misc/richards_benchmark: 5.69% (1.3037 => 1.3779, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.66% (3.3761 => 3.5334, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.56% (6.2275 => 6.5117, std.dev.: 0.0239) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.28% (4.9453 => 5.1571, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.13% (4.9469 => 5.1514, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 3.88% (14.0064 => 14.5496, std.dev.: 0.0756) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.64% (1.2337 => 1.2786, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.04% (0.3587 => 0.3696, std.dev.: 0.0034) MultiSource/Applications/lambda-0_1_3/lambda: 2.75% (7.4933 => 7.6994, std.dev.: 0.0366) MultiSource/Applications/siod/siod: 2.72% (3.6643 => 3.7641, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.68% (11.5690 => 11.8796, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.67% (8.2783 => 8.4991, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.53% (4.8660 => 4.9890, std.dev.: 0.0237) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.44% (4.8362 => 4.9540, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout/lists: 2.14% (7.3375 => 7.4943, std.dev.: 0.0198) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.44% (2.4647 => 2.5002, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/ReedSolomon: 1.24% (8.5322 => 8.6379, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.02% (3.5679 => 3.6044, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.18% (5.4641 => 4.3067, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.87% (1.0512 => 0.9369, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: -10.68% (1.1216 => 1.0018, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -9.71% (7.2130 => 6.5129, std.dev.: 0.2708) MultiSource/Benchmarks/mafft/pairlocalalign: -8.55% (63.1822 => 57.7803, std.dev.: 0.1975) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.20% (0.3269 => 0.3001, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.96% (4.7482 => 4.4178, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.02% (3.7148 => 3.4912, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.93% (5.4972 => 5.1714, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.03% (5.1557 => 4.8962, std.dev.: 0.0875) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.76% (2.4490 => 2.3325, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.39% (4.7449 => 4.5368, std.dev.: 0.0116) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.18% (2.8773 => 2.7571, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.72% (6.0224 => 5.7981, std.dev.: 0.0078) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (28.5821 => 27.7010, std.dev.: 0.0463) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.96% (0.5807 => 0.5635, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -2.95% (29.8330 => 28.9531, std.dev.: 0.2640) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.16% (9.9065 => 9.6927, std.dev.: 0.0724) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.03% (11.5316 => 11.2977, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/hash2: -1.82% (3.4237 => 3.3614, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.78% (1.0388 => 1.0203, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.58% (4.9994 => 4.9202, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.54% (2.3487 => 2.3126, std.dev.: 0.0030) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.64% (16.4461 => 16.5508, std.dev.: 0.3358) MultiSource/Applications/obsequi/Obsequi: 1.23% (1.0262 => 1.0388, std.dev.: 0.0178) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6821.81% (0.3123 => 21.6168, std.dev.: 0.2988) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.23% (0.2463 => 0.3651, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -0.12% (0.6010 => 0.6003, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.41% (0.3266 => 0.3312, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 1.32% (0.1969 => 0.1995, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.64% (0.0384 => 0.0421, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: - (0.1438 => 0.1438, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.31% (1.1329 => 1.1477, std.dev.: 0.0692) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.28% (0.1462 => 0.1510, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.71% (0.4164 => 0.4093, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.66% (0.1369 => 0.1378, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.62% (0.0641 => 0.0637, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.79% (0.0195 => 0.0218, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.29% (0.0578 => 0.0559, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.90% (1.1437 => 1.1883, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 700.00% (0.0001 => 0.0008, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.81% (0.0627 => 0.0578, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 33.33% (0.0180 => 0.0240, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.84% (0.8017 => 0.7789, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0001 => 0.0004, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -32.26% (0.0062 => 0.0042, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 3.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 7 12:35:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 7 Nov 2012 14:35:15 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121107203515.DFC102A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5659?compare_to=5657&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5659, Order: 167544, Start Time: 2012-11-07 19:10:12, End Time: 2012-11-07 20:35:26 To: 5657, Order: 167534, Start Time: 2012-11-07 17:21:49, End Time: 2012-11-07 18:46:44 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (184 on baseline) Unchanged Tests: 1041 (853 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.02% (78.8695 => 79.6748, std.dev.: 0.2480) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.49% (54.5751 => 56.4785, std.dev.: 0.1339) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.07% (2.0478 => 2.1107, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4937 => 7.6767, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 2.09% (3.1932 => 3.2599, std.dev.: 0.0063) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.08% (0.1431 => 0.1301, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.14% (0.3821 => 0.3510, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -7.51% (2.4924 => 2.3052, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: -7.37% (0.3812 => 0.3531, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -7.31% (0.3831 => 0.3551, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -7.27% (0.3880 => 0.3598, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.26% (0.3142 => 0.2914, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.23% (0.3884 => 0.3603, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -7.22% (0.3848 => 0.3570, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -7.22% (0.4033 => 0.3742, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -7.19% (0.3896 => 0.3616, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -7.18% (0.4176 => 0.3876, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.17% (0.3891 => 0.3612, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -7.07% (0.4199 => 0.3902, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/parameter-passing: -6.99% (0.4280 => 0.3981, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.88% (0.3357 => 0.3126, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.75% (0.2428 => 0.2264, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.75% (0.3658 => 0.3411, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.71% (3.5339 => 3.2967, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.70% (1.0544 => 0.9838, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.65% (0.4151 => 0.3875, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.65% (22.4056 => 20.9159, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.59% (0.6484 => 0.6057, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: -6.58% (1.2515 => 1.1691, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: -6.54% (0.2659 => 0.2485, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.54% (0.2355 => 0.2201, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -6.53% (9.2283 => 8.6254, std.dev.: 0.0091) MultiSource/Applications/JM/lencod/lencod: -6.48% (16.1920 => 15.1422, std.dev.: 0.0129) MultiSource/Benchmarks/MallocBench/gs/gs: -6.48% (4.3330 => 4.0521, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.48% (0.9852 => 0.9214, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -6.46% (7.0961 => 6.6375, std.dev.: 0.0107) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.44% (0.1584 => 0.1482, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: -6.41% (1.3148 => 1.2305, std.dev.: 0.0053) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.41% (0.1716 => 0.1606, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -6.39% (0.1879 => 0.1759, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.38% (0.3025 => 0.2832, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -6.36% (0.3255 => 0.3048, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.36% (0.3837 => 0.3593, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.34% (0.9542 => 0.8937, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.34% (1.4642 => 1.3714, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.34% (2.1713 => 2.0337, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: -6.34% (0.4861 => 0.4553, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.33% (0.3931 => 0.3682, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ary3: -6.33% (0.3446 => 0.3228, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.33% (1.3722 => 1.2854, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/strcat: -6.32% (0.2989 => 0.2800, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.31% (4.8161 => 4.5121, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/except: -6.31% (0.3026 => 0.2835, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -6.31% (0.3394 => 0.3180, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.30% (0.1761 => 0.1650, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -6.29% (0.3194 => 0.2993, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.28% (0.2548 => 0.2388, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.27% (4.5069 => 4.2242, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.27% (6.7716 => 6.3473, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.26% (1.6474 => 1.5442, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.25% (0.3057 => 0.2866, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -6.24% (0.9179 => 0.8606, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.23% (0.3016 => 0.2828, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -6.23% (0.2985 => 0.2799, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.23% (0.1621 => 0.1520, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.23% (4.8802 => 4.5764, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.20% (0.7919 => 0.7428, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.20% (0.6293 => 0.5903, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.19% (4.0323 => 3.7825, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -6.18% (1.1450 => 1.0742, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.18% (0.1796 => 0.1685, std.dev.: 0.0020) SingleSource/Regression/C++/ofstream_ctor: -6.18% (0.3059 => 0.2870, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -6.18% (0.3481 => 0.3266, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -6.17% (0.2871 => 0.2694, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.15% (0.4083 => 0.3832, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: -6.12% (0.2939 => 0.2759, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -6.12% (0.3205 => 0.3009, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -6.10% (2.4021 => 2.2555, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.10% (0.2903 => 0.2726, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.09% (0.3252 => 0.3054, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.09% (0.3483 => 0.3271, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.09% (0.4321 => 0.4058, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.09% (1.6364 => 1.5368, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hello: -6.07% (0.2849 => 0.2676, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -6.07% (0.2933 => 0.2755, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.06% (1.2784 => 1.2009, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.05% (0.3849 => 0.3616, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -6.03% (0.4248 => 0.3992, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/lists: -6.02% (0.3621 => 0.3403, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.01% (0.2695 => 0.2533, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.00% (1.2300 => 1.1562, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: -5.99% (34.0927 => 32.0495, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.97% (0.2999 => 0.2820, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -5.96% (1.1530 => 1.0843, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.94% (0.5168 => 0.4861, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: -5.92% (0.3867 => 0.3638, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.92% (0.4916 => 0.4625, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.91% (14.2083 => 13.3685, std.dev.: 0.0200) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.91% (5.4682 => 5.1451, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.90% (0.4427 => 0.4166, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -5.89% (0.3788 => 0.3565, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -5.87% (15.5079 => 14.5978, std.dev.: 0.0051) MultiSource/Applications/kimwitu++/kc: -5.83% (18.2933 => 17.2267, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.83% (0.9557 => 0.9000, std.dev.: 0.0012) MultiSource/Applications/lua/lua: -5.82% (4.0594 => 3.8230, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.81% (0.7021 => 0.6613, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++/bigfib: -5.79% (0.6750 => 0.6359, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.79% (0.6736 => 0.6346, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.78% (0.6681 => 0.6295, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: -5.77% (0.7447 => 0.7017, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.77% (0.6304 => 0.5940, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.77% (0.5478 => 0.5162, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.75% (0.5857 => 0.5520, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -5.75% (0.3581 => 0.3375, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.75% (2.2587 => 2.1289, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.74% (0.5591 => 0.5270, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.73% (0.3406 => 0.3211, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.72% (0.6395 => 0.6029, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.72% (0.5925 => 0.5586, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: -5.72% (2.1401 => 2.0177, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.72% (0.6194 => 0.5840, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.71% (0.7339 => 0.6920, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.71% (0.2278 => 0.2148, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: -5.69% (0.2160 => 0.2037, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: -5.69% (0.4515 => 0.4258, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.68% (0.5863 => 0.5530, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.67% (0.4813 => 0.4540, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.67% (0.6260 => 0.5905, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.67% (0.5859 => 0.5527, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.66% (0.6189 => 0.5839, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.65% (0.6667 => 0.6290, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.65% (0.2106 => 0.1987, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.64% (1.3864 => 1.3082, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.63% (8.0126 => 7.5612, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.63% (0.5329 => 0.5029, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.62% (0.7524 => 0.7101, std.dev.: 0.0078) MultiSource/Applications/sqlite3/sqlite3: -5.62% (17.1032 => 16.1424, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.62% (0.6446 => 0.6084, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.62% (0.5805 => 0.5479, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.61% (0.3491 => 0.3295, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.61% (0.8521 => 0.8043, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.61% (0.5581 => 0.5268, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.61% (0.6440 => 0.6079, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.59% (0.6230 => 0.5882, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.58% (0.2385 => 0.2252, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.57% (0.5567 => 0.5257, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.57% (0.6052 => 0.5715, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -5.56% (0.3271 => 0.3089, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -5.55% (0.7982 => 0.7539, std.dev.: 0.0159) MultiSource/Applications/d/make_dparser: -5.55% (3.5154 => 3.3203, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.53% (0.5999 => 0.5667, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.53% (0.5569 => 0.5261, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.51% (0.5575 => 0.5268, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.50% (0.6676 => 0.6309, std.dev.: 0.0061) MultiSource/Applications/spiff/spiff: -5.49% (0.8418 => 0.7956, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.49% (0.5705 => 0.5392, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.47% (0.6395 => 0.6045, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.47% (0.5849 => 0.5529, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.47% (0.6660 => 0.6296, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.46% (0.6297 => 0.5953, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.46% (0.5456 => 0.5158, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.44% (0.6033 => 0.5705, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.43% (0.5802 => 0.5487, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.42% (0.5941 => 0.5619, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -5.42% (0.4524 => 0.4279, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.39% (1.2210 => 1.1552, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.36% (0.3323 => 0.3145, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.29% (1.2221 => 1.1574, std.dev.: 0.0065) MultiSource/Applications/ClamAV/clamscan: -5.28% (15.2527 => 14.4467, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.26% (0.5570 => 0.5277, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -5.18% (0.6347 => 0.6018, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: -5.17% (0.6441 => 0.6108, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -5.17% (0.7779 => 0.7377, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.15% (0.3319 => 0.3148, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.05% (0.2001 => 0.1900, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.03% (0.5688 => 0.5402, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.83% (0.7198 => 0.6850, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: -4.81% (5.0226 => 4.7812, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.57% (0.2277 => 0.2173, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: -4.44% (1.5610 => 1.4917, std.dev.: 0.0046) SingleSource/UnitTests/Vector/constpool: -2.03% (20.7746 => 20.3539, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7533, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: -8.73% (1.2842 => 1.1721, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.84% (2.2633 => 2.1765, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.50% (6.5735 => 6.4750, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.28% (1.3096 => 1.2929, std.dev.: 0.0027) Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 7 13:01:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 7 Nov 2012 15:01:53 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121107210153.DCDBB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5660?compare_to=5655&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5660, Order: 167534, Start Time: 2012-11-07 17:46:34, End Time: 2012-11-07 21:02:04 To: 5655, Order: 167529, Start Time: 2012-11-07 13:38:37, End Time: 2012-11-07 16:54:29 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (172 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1042 (718 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.32% (0.0625 => 0.0877, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.27% (0.1063 => 0.1406, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.92% (0.4253 => 0.5398, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.31% (0.2969 => 0.3750, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.77% (0.1106 => 0.1391, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 25.04% (1.5932 => 1.9921, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.65% (0.0714 => 0.0890, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 24.56% (0.0452 => 0.0563, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.52% (0.4139 => 0.5154, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.12% (0.5900 => 0.7323, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.83% (0.4994 => 0.6184, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.58% (0.0475 => 0.0587, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.46% (0.0584 => 0.0721, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.32% (0.5000 => 0.6166, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.85% (0.0897 => 0.1102, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.78% (0.1620 => 0.1989, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 22.20% (0.0599 => 0.0732, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.84% (0.1021 => 0.1244, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.78% (0.0822 => 0.1001, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.41% (0.1107 => 0.1344, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 20.68% (0.0948 => 0.1144, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.52% (0.0541 => 0.0652, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.40% (0.1103 => 0.1328, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.38% (0.0584 => 0.0703, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.29% (0.3903 => 0.4695, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.25% (0.0642 => 0.0772, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.24% (0.1003 => 0.1206, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.95% (0.1549 => 0.1858, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724) MultiSource/Benchmarks/Olden/health/health: 19.85% (0.0821 => 0.0984, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.76% (0.1604 => 0.1921, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 19.64% (0.1619 => 0.1937, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.49% (0.1462 => 0.1747, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 19.06% (0.0808 => 0.0962, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 18.93% (0.5826 => 0.6929, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 18.80% (0.0947 => 0.1125, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.66% (0.3890 => 0.4616, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 18.63% (0.5889 => 0.6986, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 18.49% (0.4029 => 0.4774, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.31% (1.3152 => 1.5560, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.27% (0.2014 => 0.2382, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 18.23% (0.1218 => 0.1440, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 18.05% (0.0698 => 0.0824, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.00% (0.2866 => 0.3382, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.95% (0.2736 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.74% (0.1088 => 0.1281, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 17.67% (0.1505 => 0.1771, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.47% (0.5026 => 0.5904, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 17.30% (1.8794 => 2.2046, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 17.29% (0.5546 => 0.6505, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.28% (0.1968 => 0.2308, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.05% (0.4658 => 0.5452, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.03% (3.5627 => 4.1695, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.02% (0.0605 => 0.0708, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.94% (0.3271 => 0.3825, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.70% (1.6211 => 1.8918, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.69% (0.4361 => 0.5089, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 16.64% (0.9697 => 1.1311, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 16.64% (1.0781 => 1.2575, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 16.54% (0.7171 => 0.8357, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.49% (0.2875 => 0.3349, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 16.40% (0.1421 => 0.1654, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.38% (0.1160 => 0.1350, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/strcat: 16.11% (0.2750 => 0.3193, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.08% (4.4195 => 5.1303, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.08% (0.3930 => 0.4562, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: 16.08% (0.2780 => 0.3227, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 15.99% (0.2714 => 0.3148, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 15.94% (4.2109 => 4.8821, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.94% (0.2911 => 0.3375, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 15.89% (0.2725 => 0.3158, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.89% (0.2738 => 0.3173, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 15.81% (0.1284 => 0.1487, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 15.80% (0.2811 => 0.3255, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 15.78% (0.3004 => 0.3478, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.72% (0.2792 => 0.3231, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.72% (0.2729 => 0.3158, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.72% (2.7292 => 3.1581, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 15.64% (0.9909 => 1.1459, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 15.62% (0.2823 => 0.3264, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.60% (0.1090 => 0.1260, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.56% (0.3195 => 0.3692, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.55% (2.0673 => 2.3887, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 15.52% (0.2803 => 0.3238, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/methcall: 15.50% (0.2813 => 0.3249, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 15.41% (0.3258 => 0.3760, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 15.37% (0.3096 => 0.3572, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 15.37% (23.5202 => 27.1359, std.dev.: 0.0178) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.36% (1.9966 => 2.3032, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.33% (1.9694 => 2.2714, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary3: 15.21% (0.3267 => 0.3764, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 15.18% (0.2075 => 0.2390, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 15.04% (0.3317 => 0.3816, std.dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 14.81% (0.2566 => 0.2946, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.77% (0.3060 => 0.3512, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.75% (0.3362 => 0.3858, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 14.55% (0.3348 => 0.3835, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.40% (0.3124 => 0.3574, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.29% (0.3282 => 0.3751, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 14.27% (1.4269 => 1.6305, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: 14.25% (0.3678 => 0.4202, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 14.23% (0.7875 => 0.8996, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/sieve: 14.14% (0.3726 => 0.4253, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.10% (0.3625 => 0.4136, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 14.06% (0.4146 => 0.4729, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 13.95% (0.3477 => 0.3962, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.90% (0.3488 => 0.3973, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 13.89% (2.1653 => 2.4660, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/for-in: 13.87% (0.3496 => 0.3981, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 13.85% (0.0758 => 0.0863, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.82% (0.3981 => 0.4531, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 13.78% (0.3446 => 0.3921, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 13.76% (0.4251 => 0.4836, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 13.75% (0.2691 => 0.3061, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.74% (0.3690 => 0.4197, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.72% (0.3469 => 0.3945, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.71% (0.3442 => 0.3914, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-4: 13.71% (0.3465 => 0.3940, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.61% (0.3460 => 0.3931, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.50% (0.3845 => 0.4364, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 13.46% (4.6177 => 5.2392, std.dev.: 0.0106) SingleSource/UnitTests/ObjC/property: 13.42% (0.3650 => 0.4140, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 13.33% (2.1013 => 2.3815, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/exceptions: 13.31% (0.3643 => 0.4128, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.24% (0.2040 => 0.2310, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 13.21% (0.5012 => 0.5674, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 13.16% (0.3724 => 0.4214, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 12.34% (5.5417 => 6.2253, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.93% (0.6435 => 0.7203, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 11.66% (0.3498 => 0.3906, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.58% (0.1028 => 0.1147, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 11.43% (0.6634 => 0.7392, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.42% (0.1383 => 0.1541, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 11.41% (0.4847 => 0.5400, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.03% (0.2068 => 0.2296, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.96% (0.2737 => 0.3037, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.77% (0.3084 => 0.3416, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 10.64% (0.3336 => 0.3691, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 10.38% (2.0346 => 2.2457, std.dev.: 0.0050) MultiSource/Applications/lemon/lemon: 10.37% (0.2391 => 0.2639, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.08% (0.2103 => 0.2315, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.07% (4.6926 => 5.1182, std.dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.00% (11.6398 => 12.6869, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.84% (0.5361 => 0.5835, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.74% (0.5584 => 0.6072, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.47% (0.7426 => 0.8055, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 6.93% (11.9555 => 12.7838, std.dev.: 0.0079) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.32% (0.3792 => 0.3956, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0294, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 9.64% (0.2802 => 0.3072, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6099, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.42% (0.3693 => 0.3893, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 5.10% (12.0509 => 12.6659, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1701, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-2: 4.63% (1.8057 => 1.8893, std.dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/dry: 4.27% (14.0481 => 14.6486, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2036, std.dev.: 0.0046) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.56% (3.1722 => 3.2217, std.dev.: 0.0043) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3071, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.37% (7.1849 => 7.2832, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5920, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.90% (2.4764 => 2.4293, std.dev.: 0.0125) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5566, std.dev.: 0.0211) SingleSource/Benchmarks/Shootout-C++/ary2: -7.83% (0.2402 => 0.2214, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9789, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7945, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9576, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8053, std.dev.: 0.0027) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7754, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.37% (0.6293 => 0.6144, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8694, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/fldry: -1.90% (17.2379 => 16.9111, std.dev.: 0.0196) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5744, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4971, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.29% (105.3826 => 104.0280, std.dev.: 0.1296) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0469, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 7 14:12:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 7 Nov 2012 16:12:18 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121107221218.1ACBF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5661?compare_to=5658&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5661, Order: 167549, Start Time: 2012-11-07 20:46:26, End Time: 2012-11-07 22:12:28 To: 5658, Order: 167544, Start Time: 2012-11-07 19:02:22, End Time: 2012-11-07 20:29:14 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 27 (111 on baseline) Performance Improvements: 1 (27 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 963 (836 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.14% (0.8441 => 0.9044, std.dev.: 0.0077) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.95% (0.3209 => 0.3368, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.38% (0.6071 => 0.6337, std.dev.: 0.0103) MultiSource/Benchmarks/McCat/08-main/main: 4.06% (0.2634 => 0.2741, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.03% (0.3004 => 0.3125, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.95% (0.3340 => 0.3472, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: 3.39% (0.4400 => 0.4549, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 3.23% (4.1466 => 4.2807, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.63% (0.5808 => 0.5961, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.62% (0.9559 => 0.9809, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.33% (1.3406 => 1.3718, std.dev.: 0.0087) MultiSource/Applications/Burg/burg: 2.27% (1.2625 => 1.2911, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.87% (1.1947 => 1.2170, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.73% (4.5825 => 4.6618, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.51% (1.2034 => 1.2216, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.44% (1.2627 => 1.2809, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.38% (1.2580 => 1.2753, std.dev.: 0.0024) MultiSource/Applications/lua/lua: 1.37% (3.8719 => 3.9248, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.32% (4.5169 => 4.5764, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.14% (8.7464 => 8.8462, std.dev.: 0.0155) MultiSource/Applications/ClamAV/clamscan: 1.11% (15.0410 => 15.2086, std.dev.: 0.0569) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.93% (1.3484 => 1.4283, std.dev.: 0.0251) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.17% (44.9572 => 46.3832, std.dev.: 0.4771) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.3325 => 2.3928, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.37% (58.9605 => 60.3568, std.dev.: 0.4920) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 1.33% (3.9719 => 4.0248, std.dev.: 0.0148) SingleSource/Benchmarks/Misc/pi: 1.11% (2.4810 => 2.5085, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -6.30% (21.8517 => 20.4751, std.dev.: 0.4482) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.89% (16.5508 => 16.6976, std.dev.: 0.0123) MultiSource/Applications/obsequi/Obsequi: 1.86% (1.0388 => 1.0581, std.dev.: 0.0064) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.32% (21.6168 => 21.6855, std.dev.: 0.1546) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.44% (0.3651 => 0.3635, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -0.02% (0.6003 => 0.6002, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.12% (0.3312 => 0.3308, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/strcat: 0.10% (0.1995 => 0.1997, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.46% (0.0217 => 0.0218, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.24% (0.0424 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -16.67% (0.0330 => 0.0275, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0313 => 0.0313, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -13.54% (0.0421 => 0.0364, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/casts: 0.50% (0.0202 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 0.46% (0.0216 => 0.0217, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.56% (0.1438 => 0.1430, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: -4.41% (1.1477 => 1.0971, std.dev.: 0.0561) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -2.05% (0.1510 => 0.1479, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.08% (0.4093 => 0.4178, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.65% (0.1378 => 0.1387, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.77% (0.0637 => 0.0613, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 23.85% (0.0218 => 0.0270, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.18% (0.0559 => 0.0560, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.35% (1.1883 => 1.1924, std.dev.: 0.0110) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 287.50% (0.0008 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.69% (0.0578 => 0.0574, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -15.42% (0.0240 => 0.0203, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.50% (0.7789 => 0.7750, std.dev.: 0.0134) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -7.14% (0.0042 => 0.0039, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2301.91% (0.6332 => 15.2089, std.dev.: 0.0590) MultiSource/Benchmarks/McCat/08-main/main: 49.70% (0.1831 => 0.2741, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.99% (0.1559 => 0.1450, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1482.45% (0.3344 => 5.2917, std.dev.: 0.0510) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.83% (0.2364 => 0.3211, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/mandel: 2.10% (0.0429 => 0.0438, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.25% (0.0224 => 0.0238, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -24.35% (0.0230 => 0.0174, std.dev.: 0.0007) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4304, std.dev.: 0.0196) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0695, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4941, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3457, std.dev.: 0.0169) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1412, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4089, std.dev.: 0.0065) SingleSource/Regression/C/uint64_to_float: -23.87% (2.1832 => 1.6620, std.dev.: 0.0044) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.05% (0.0810 => 0.0940, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.20% (0.0773 => 0.0875, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: 12.14% (0.1112 => 0.1247, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.69% (0.8321 => 0.9044, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.35% (0.2180 => 0.2362, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/health/health: 7.80% (0.1347 => 0.1452, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.77% (0.2279 => 0.2456, std.dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.36% (0.3137 => 0.3368, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.83% (0.2240 => 0.2393, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2998 => 0.3192, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.01% (0.7473 => 0.7922, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.77% (0.8148 => 0.8618, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 5.64% (1.2222 => 1.2911, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.44% (0.6010 => 0.6337, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.37% (0.3295 => 0.3472, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.26% (1.1606 => 1.2216, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: 4.57% (0.7950 => 0.8313, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.15% (1.1685 => 1.2170, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.06% (0.3003 => 0.3125, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.96% (0.9435 => 0.9809, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.78% (0.4127 => 0.4283, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 3.64% (4.1305 => 4.2807, std.dev.: 0.0080) MultiSource/Applications/sgefa/sgefa: 3.57% (0.2999 => 0.3106, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 3.46% (0.4397 => 0.4549, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.44% (0.3717 => 0.3845, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.31% (1.3279 => 1.3718, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.24% (0.6287 => 0.6491, std.dev.: 0.0048) MultiSource/Applications/hbd/hbd: 3.08% (1.4269 => 1.4708, std.dev.: 0.0098) MultiSource/Applications/ClamAV/clamscan: 2.98% (14.7684 => 15.2086, std.dev.: 0.0569) MultiSource/Applications/minisat/minisat: 2.90% (0.6834 => 0.7032, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.82% (0.8611 => 0.8854, std.dev.: 0.0084) MultiSource/Applications/SIBsim4/SIBsim4: 2.82% (1.2568 => 1.2922, std.dev.: 0.0046) MultiSource/Applications/lua/lua: 2.77% (3.8189 => 3.9248, std.dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.64% (6.6074 => 6.7819, std.dev.: 0.0324) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.51% (1.6386 => 1.6798, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.48% (0.5817 => 0.5961, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.41% (0.8340 => 0.8541, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.39% (0.8697 => 0.8905, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.36% (4.1763 => 4.2747, std.dev.: 0.0232) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.30% (8.6476 => 8.8462, std.dev.: 0.0155) MultiSource/Applications/SPASS/SPASS: 2.24% (14.2605 => 14.5798, std.dev.: 0.0742) MultiSource/Applications/hexxagon/hexxagon: 2.12% (0.9810 => 1.0018, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.12% (0.8597 => 0.8779, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.09% (0.8050 => 0.8218, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.03% (0.8855 => 0.9035, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.03% (0.7932 => 0.8093, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.02% (0.6227 => 0.6353, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.02% (0.9908 => 1.0108, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.01% (1.1271 => 1.1497, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.00% (4.5702 => 4.6618, std.dev.: 0.0070) MultiSource/Applications/JM/ldecod/ldecod: 2.00% (6.7320 => 6.8664, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.00% (0.7966 => 0.8125, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.00% (0.8518 => 0.8688, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.99% (4.4873 => 4.5764, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.98% (0.9074 => 0.9254, std.dev.: 0.0066) MultiSource/Applications/treecc/treecc: 1.97% (1.9948 => 2.0340, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.95% (0.8420 => 0.8584, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.87% (0.8286 => 0.8441, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.86% (0.8712 => 0.8874, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.86% (0.9056 => 0.9224, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.84% (0.9069 => 0.9236, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.83% (4.4880 => 4.5701, std.dev.: 0.0234) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.82% (13.1811 => 13.4212, std.dev.: 0.0600) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.81% (1.2526 => 1.2753, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: 1.79% (2.3764 => 2.4190, std.dev.: 0.0026) MultiSource/Applications/oggenc/oggenc: 1.78% (4.9628 => 5.0510, std.dev.: 0.0155) MultiSource/Applications/d/make_dparser: 1.76% (3.2366 => 3.2935, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.71% (0.8805 => 0.8956, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 1.68% (0.8768 => 0.8915, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.67% (0.8066 => 0.8201, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.67% (0.8069 => 0.8204, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.64% (1.2602 => 1.2809, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: 1.60% (31.8598 => 32.3701, std.dev.: 0.1940) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.54% (0.8656 => 0.8789, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.53% (0.8885 => 0.9021, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.52% (0.8048 => 0.8170, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.49% (0.9688 => 0.9832, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.47% (0.8316 => 0.8438, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.43% (0.8338 => 0.8457, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.13% (0.8995 => 0.9097, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 98.99% (0.0199 => 0.0396, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/pi: 58.82% (1.5795 => 2.5085, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.38% (2.9753 => 3.4628, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.77% (0.7597 => 0.8795, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.61% (2.7995 => 3.2084, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.61% (5.0261 => 5.6095, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.72% (6.3772 => 6.9336, std.dev.: 0.1766) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.80% (1.1857 => 1.2782, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/queens: 7.18% (1.7056 => 1.8281, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.74% (4.7794 => 5.1015, std.dev.: 0.0050) MultiSource/Applications/SIBsim4/SIBsim4: 6.66% (3.1873 => 3.3996, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.89% (4.9686 => 5.2612, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.79% (4.5327 => 4.7952, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/richards_benchmark: 5.05% (1.3037 => 1.3695, std.dev.: 0.0236) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.67% (6.2275 => 6.5186, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.62% (4.9453 => 5.1738, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.44% (3.3761 => 3.5261, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 4.09% (44.5605 => 46.3832, std.dev.: 0.4771) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.09% (4.9469 => 5.1491, std.dev.: 0.0117) MultiSource/Applications/hexxagon/hexxagon: 3.91% (14.0064 => 14.5537, std.dev.: 0.0327) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.98% (0.3587 => 0.3694, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.88% (1.2337 => 1.2692, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.83% (11.5690 => 11.8961, std.dev.: 0.0094) MultiSource/Applications/lambda-0_1_3/lambda: 2.63% (7.4933 => 7.6907, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.63% (8.2783 => 8.4957, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout/lists: 2.36% (7.3375 => 7.5104, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.26% (4.8660 => 4.9759, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.05% (4.8362 => 4.9355, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/hash: 1.87% (0.6205 => 0.6321, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.33% (3.5679 => 3.6152, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/ReedSolomon: 1.28% (8.5322 => 8.6418, std.dev.: 0.0204) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.50% (5.4641 => 4.2895, std.dev.: 0.0395) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.93% (1.0512 => 0.9363, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/chomp: -10.52% (1.1216 => 1.0036, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -10.51% (7.2130 => 6.4547, std.dev.: 0.0874) MultiSource/Benchmarks/mafft/pairlocalalign: -8.52% (63.1822 => 57.8004, std.dev.: 0.0919) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.86% (4.7482 => 4.4225, std.dev.: 0.0158) MultiSource/Benchmarks/nbench/nbench: -6.78% (21.9654 => 20.4751, std.dev.: 0.4482) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.52% (0.3269 => 0.3056, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.94% (3.7148 => 3.4940, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.80% (5.4972 => 5.1783, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.09% (5.1557 => 4.8933, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.32% (4.7449 => 4.5399, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.92% (2.8773 => 2.7645, std.dev.: 0.0382) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.73% (6.0224 => 5.7979, std.dev.: 0.0178) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.12% (0.5807 => 0.5626, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -3.06% (29.8330 => 28.9190, std.dev.: 0.0855) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.01% (28.5821 => 27.7223, std.dev.: 0.0360) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.79% (9.9065 => 9.6300, std.dev.: 0.0292) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.74% (2.6356 => 2.5633, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.29% (2.4490 => 2.3928, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.20% (3.2169 => 3.1462, std.dev.: 0.0155) MultiSource/Benchmarks/FreeBench/mason/mason: -2.07% (0.5415 => 0.5303, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.95% (11.5316 => 11.3063, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.60% (4.9994 => 4.9194, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/hash2: -1.38% (3.4237 => 3.3763, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.33% (2.3487 => 2.3175, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.19% (5.6343 => 5.5671, std.dev.: 0.0006) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.53% (16.4461 => 16.6976, std.dev.: 0.0123) MultiSource/Applications/obsequi/Obsequi: 3.11% (1.0262 => 1.0581, std.dev.: 0.0064) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6843.80% (0.3123 => 21.6855, std.dev.: 0.1546) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.58% (0.2463 => 0.3635, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -0.13% (0.6010 => 0.6002, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.29% (0.3266 => 0.3308, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/strcat: 1.42% (0.1969 => 0.1997, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.68% (0.0408 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 8.27% (0.0254 => 0.0275, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.21% (0.0384 => 0.0364, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.56% (0.1438 => 0.1430, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: -3.16% (1.1329 => 1.0971, std.dev.: 0.0561) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 1.16% (0.1462 => 0.1479, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.34% (0.4164 => 0.4178, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.31% (0.1369 => 0.1387, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.37% (0.0641 => 0.0613, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 38.46% (0.0195 => 0.0270, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.11% (0.0578 => 0.0560, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.26% (1.1437 => 1.1924, std.dev.: 0.0110) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.45% (0.0627 => 0.0574, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 12.78% (0.0180 => 0.0203, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.33% (0.8017 => 0.7750, std.dev.: 0.0134) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -37.10% (0.0062 => 0.0039, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 7 14:23:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 7 Nov 2012 16:23:34 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121107222334.F112B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5662?compare_to=5659&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5662, Order: 167549, Start Time: 2012-11-07 20:58:51, End Time: 2012-11-07 22:23:45 To: 5659, Order: 167544, Start Time: 2012-11-07 19:10:12, End Time: 2012-11-07 20:35:26 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (180 on baseline) Unchanged Tests: 1042 (857 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.45% (54.5751 => 56.4575, std.dev.: 0.0721) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.05% (2.0478 => 2.1103, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/salsa20: 2.45% (7.4937 => 7.6773, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 2.25% (3.1932 => 3.2650, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.06% (0.3821 => 0.3513, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -7.79% (2.4924 => 2.2982, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.03% (0.3142 => 0.2921, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.91% (0.3357 => 0.3125, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.77% (3.5339 => 3.2945, std.dev.: 0.0107) SingleSource/UnitTests/ObjC/trivial-interface: -6.77% (0.3812 => 0.3554, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.76% (0.3831 => 0.3572, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.75% (0.2428 => 0.2264, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.70% (0.3880 => 0.3620, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.68% (0.3891 => 0.3631, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.68% (0.3848 => 0.3591, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.62% (0.3896 => 0.3638, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.60% (0.4033 => 0.3767, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.59% (0.3884 => 0.3628, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.59% (0.4176 => 0.3901, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.57% (22.4056 => 20.9331, std.dev.: 0.0162) MultiSource/Benchmarks/mafft/pairlocalalign: -6.57% (9.2283 => 8.6222, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.56% (0.3658 => 0.3418, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.56% (0.9542 => 0.8916, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -6.55% (0.4199 => 0.3924, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.51% (1.0544 => 0.9858, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: -6.47% (0.9179 => 0.8585, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: -6.45% (0.4280 => 0.4004, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -6.44% (16.1920 => 15.1487, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/ReedSolomon: -6.44% (0.1879 => 0.1758, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.44% (0.1584 => 0.1482, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -6.40% (7.0961 => 6.6420, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.36% (0.9852 => 0.9225, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -6.34% (4.3330 => 4.0581, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.31% (0.6484 => 0.6075, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.27% (1.2784 => 1.1982, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.26% (0.7919 => 0.7423, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -6.25% (1.1450 => 1.0734, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: -6.24% (1.2515 => 1.1734, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.24% (0.1796 => 0.1684, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.22% (1.3722 => 1.2868, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.22% (0.4151 => 0.3893, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.21% (1.4642 => 1.3733, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.17% (4.0323 => 3.7837, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/oourafft: -6.16% (0.2160 => 0.2027, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.15% (1.2300 => 1.1544, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -6.13% (0.1761 => 0.1653, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: -6.13% (1.1530 => 1.0823, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.11% (0.2355 => 0.2211, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.11% (4.5069 => 4.2317, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.10% (4.8802 => 4.5824, std.dev.: 0.0095) MultiSource/Benchmarks/McCat/08-main/main: -6.09% (0.2659 => 0.2497, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -6.06% (2.4021 => 2.2566, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.05% (4.8161 => 4.5246, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -6.03% (1.3148 => 1.2355, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -6.03% (0.2985 => 0.2805, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.03% (0.3931 => 0.3694, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.00% (0.2548 => 0.2395, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.00% (0.3483 => 0.3274, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.97% (0.2695 => 0.2534, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.97% (1.6364 => 1.5387, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.97% (0.3837 => 0.3608, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.97% (0.6736 => 0.6334, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.96% (0.6304 => 0.5928, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.96% (1.6474 => 1.5492, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.96% (0.5857 => 0.5508, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.96% (0.6395 => 0.6014, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: -5.95% (0.3025 => 0.2845, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -5.95% (0.3446 => 0.3241, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.95% (6.7716 => 6.3689, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.93% (0.5478 => 0.5153, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: -5.92% (0.3394 => 0.3193, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -5.92% (0.3481 => 0.3275, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -5.91% (0.4248 => 0.3997, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -5.91% (15.5079 => 14.5917, std.dev.: 0.0128) MultiSource/Benchmarks/sim/sim: -5.90% (0.3406 => 0.3205, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.89% (0.5925 => 0.5576, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/strcat: -5.89% (0.2989 => 0.2813, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.89% (0.3194 => 0.3006, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.88% (14.2083 => 13.3723, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.87% (0.5591 => 0.5263, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.85% (0.6293 => 0.5925, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.85% (0.5849 => 0.5507, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash2: -5.84% (0.4861 => 0.4577, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -5.84% (0.3255 => 0.3065, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.83% (0.4083 => 0.3845, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.82% (0.3057 => 0.2879, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.82% (0.2903 => 0.2734, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.82% (0.5999 => 0.5650, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: -5.82% (0.2871 => 0.2704, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.82% (0.5863 => 0.5522, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.81% (0.5802 => 0.5465, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -5.80% (17.1032 => 16.1106, std.dev.: 0.0213) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.80% (0.5859 => 0.5519, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.79% (0.7524 => 0.7088, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -5.79% (4.0594 => 3.8242, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.79% (0.5168 => 0.4869, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -5.78% (0.2939 => 0.2769, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.77% (0.5805 => 0.5470, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.77% (0.3016 => 0.2842, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.77% (2.1713 => 2.0461, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -5.75% (0.3059 => 0.2883, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.75% (0.6194 => 0.5838, std.dev.: 0.0049) MultiSource/Applications/treecc/treecc: -5.74% (2.1401 => 2.0172, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wc: -5.74% (0.3205 => 0.3021, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.74% (0.2999 => 0.2827, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.73% (0.6297 => 0.5936, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.73% (0.5705 => 0.5378, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.73% (0.5567 => 0.5248, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.73% (0.2933 => 0.2765, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.72% (0.7339 => 0.6919, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: -5.72% (0.3867 => 0.3646, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -5.71% (0.4515 => 0.4257, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.71% (0.6660 => 0.6280, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.70% (0.6052 => 0.5707, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.70% (0.4916 => 0.4636, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.69% (0.6446 => 0.6079, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.69% (0.4321 => 0.4075, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.69% (0.8521 => 0.8036, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists: -5.69% (0.3621 => 0.3415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.69% (0.6260 => 0.5904, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -5.69% (0.2849 => 0.2687, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -5.68% (0.3026 => 0.2854, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -5.67% (34.0927 => 32.1590, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.67% (0.5575 => 0.5259, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -5.66% (0.6750 => 0.6368, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.65% (0.6667 => 0.6290, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.65% (0.6440 => 0.6076, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.64% (0.5569 => 0.5255, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (0.7021 => 0.6626, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -5.63% (0.7982 => 0.7533, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.62% (0.2278 => 0.2150, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.61% (0.5581 => 0.5268, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.60% (0.6230 => 0.5881, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -5.58% (18.2933 => 17.2722, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.58% (2.2587 => 2.1327, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.57% (0.6189 => 0.5844, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -5.56% (3.5154 => 3.3199, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: -5.55% (1.3864 => 1.3094, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.54% (0.3252 => 0.3072, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.50% (0.9557 => 0.9031, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.50% (0.3491 => 0.3299, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.50% (0.5456 => 0.5156, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.50% (0.6676 => 0.6309, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.49% (0.4427 => 0.4184, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.48% (0.5570 => 0.5265, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.48% (5.4682 => 5.1688, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.46% (0.5329 => 0.5038, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: -5.45% (0.3581 => 0.3386, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: -5.44% (0.3788 => 0.3582, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.44% (0.5941 => 0.5618, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.43% (0.5688 => 0.5379, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.41% (0.6395 => 0.6049, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.40% (0.6033 => 0.5707, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -5.40% (0.7447 => 0.7045, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.39% (8.0126 => 7.5810, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.37% (0.6681 => 0.6322, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.36% (0.4813 => 0.4555, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.32% (0.2385 => 0.2258, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: -5.31% (0.4524 => 0.4284, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.27% (0.3849 => 0.3646, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -5.21% (15.2527 => 14.4573, std.dev.: 0.0156) MultiSource/Benchmarks/McCat/09-vor/vor: -5.20% (0.3271 => 0.3101, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.18% (0.3323 => 0.3151, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.13% (1.2221 => 1.1594, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.12% (0.3319 => 0.3149, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: -5.12% (0.8418 => 0.7987, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.05% (1.2210 => 1.1594, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -4.96% (0.7779 => 0.7393, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference-object: -4.91% (0.6441 => 0.6125, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.90% (0.6347 => 0.6036, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.81% (5.0226 => 4.7810, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.47% (0.9077 => 0.8671, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: -4.32% (1.5610 => 1.4935, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.08% (0.7198 => 0.6904, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -1.99% (20.7746 => 20.3604, std.dev.: 0.0132) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7507, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/richards_benchmark: -8.75% (1.2842 => 1.1718, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: -3.86% (2.2633 => 2.1760, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4717, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0001) Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 7 15:55:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 7 Nov 2012 17:55:24 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121107235524.E105B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5663?compare_to=5661&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5663, Order: 167552, Start Time: 2012-11-07 22:29:22, End Time: 2012-11-07 23:55:35 To: 5661, Order: 167549, Start Time: 2012-11-07 20:46:26, End Time: 2012-11-07 22:12:28 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 7 (70 on baseline) Performance Improvements: 3 (25 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 981 (879 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.89% (0.1021 => 0.1122, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.82% (0.8590 => 0.8746, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.22% (0.8347 => 0.8449, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.05% (0.3334 => 0.3469, std.dev.: 0.0027) MultiSource/Benchmarks/llubenchmark/llu: 1.60% (2.0037 => 2.0358, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.18% (1.6077 => 1.6266, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/ffbench: 1.15% (1.4128 => 1.4291, std.dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -3.31% (0.9809 => 0.9484, std.dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -1.03% (4.0248 => 3.9835, std.dev.: 0.0107) MultiSource/Benchmarks/PAQ8p/paq8p: -1.01% (92.2118 => 91.2798, std.dev.: 0.3171) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.06% (16.6976 => 16.7079, std.dev.: 0.0822) MultiSource/Applications/obsequi/Obsequi: 0.09% (1.0581 => 1.0591, std.dev.: 0.0071) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.34% (21.6855 => 21.6114, std.dev.: 0.1850) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.06% (0.3635 => 0.3633, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: 0.43% (0.6002 => 0.6028, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.03% (0.3308 => 0.3309, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/strcat: 1.30% (0.1997 => 0.2023, std.dev.: 0.0075) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0218 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.24% (0.0423 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 19.64% (0.0275 => 0.0329, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -26.84% (0.0313 => 0.0229, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 5.22% (0.0364 => 0.0383, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/casts: -5.91% (0.0203 => 0.0191, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: 0.46% (0.0217 => 0.0218, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1430 => 0.1427, std.dev.: 0.0052) MultiSource/Applications/kimwitu++/kc: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 8.53% (1.0971 => 1.1907, std.dev.: 0.0120) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.38% (0.1479 => 0.1529, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.65% (0.4178 => 0.4205, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.80% (0.1387 => 0.1412, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.98% (0.0613 => 0.0607, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.70% (0.0270 => 0.0233, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.75% (0.0560 => 0.0581, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.39% (1.1924 => 1.1971, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -54.84% (0.0031 => 0.0014, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.36% (0.0574 => 0.0622, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.91% (0.0203 => 0.0215, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.61% (0.7750 => 0.7703, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 51.28% (0.0039 => 0.0059, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2304.91% (0.6332 => 15.2279, std.dev.: 0.1278) MultiSource/Benchmarks/McCat/08-main/main: 48.23% (0.1831 => 0.2714, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.86% (0.1559 => 0.1452, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1485.74% (0.3344 => 5.3027, std.dev.: 0.0736) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.03% (0.2364 => 0.3192, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/mandel: -1.63% (0.0429 => 0.0422, std.dev.: 0.0037) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.80% (0.0224 => 0.0237, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -29.13% (0.0230 => 0.0163, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4156, std.dev.: 0.0376) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0682, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4935, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3545, std.dev.: 0.0220) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1419, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4079, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: -24.12% (2.1832 => 1.6567, std.dev.: 0.0285) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.52% (0.2180 => 0.2344, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.51% (0.2240 => 0.2341, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.14% (0.2998 => 0.3122, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.02% (1.1606 => 1.2073, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 3.76% (0.8885 => 0.9219, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.42% (0.8457 => 0.8746, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.30% (0.3124 => 0.3227, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.30% (0.4127 => 0.4263, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 3.19% (0.8069 => 0.8326, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.18% (0.8050 => 0.8306, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.14% (0.7966 => 0.8216, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.99% (0.9074 => 0.9345, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.99% (0.8204 => 0.8449, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.98% (0.8007 => 0.8246, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.90% (0.9056 => 0.9319, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.58% (0.8331 => 0.8546, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.52% (0.9688 => 0.9932, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.51% (0.8805 => 0.9026, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.46% (0.6227 => 0.6380, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.45% (0.8066 => 0.8264, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.42% (0.8177 => 0.8375, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.38% (0.9039 => 0.9254, std.dev.: 0.0069) MultiSource/Applications/SIBsim4/SIBsim4: 2.36% (1.2568 => 1.2864, std.dev.: 0.0103) MultiSource/Applications/minisat/minisat: 2.33% (0.6834 => 0.6993, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.30% (0.8927 => 0.9132, std.dev.: 0.0073) MultiSource/Benchmarks/nbench/nbench: 2.24% (1.1271 => 1.1524, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.19% (0.7932 => 0.8106, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.04% (0.9908 => 1.0110, std.dev.: 0.0066) MultiSource/Applications/lua/lua: 1.85% (3.8189 => 3.8895, std.dev.: 0.0181) MultiSource/Benchmarks/PAQ8p/paq8p: 1.82% (2.3764 => 2.4196, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/football/football: 1.56% (0.8768 => 0.8905, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.42% (1.2423 => 1.2599, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.29% (0.8995 => 0.9111, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 1.22% (0.9810 => 0.9930, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 1.19% (1.0945 => 1.1075, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 124.12% (0.0199 => 0.0446, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/pi: 58.02% (1.5795 => 2.4960, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.51% (2.9753 => 3.4666, std.dev.: 0.0584) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.31% (0.7597 => 0.8836, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.55% (2.7995 => 3.2069, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.88% (6.3772 => 7.1346, std.dev.: 0.1423) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.61% (5.0261 => 5.6098, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.88% (0.3186 => 0.3469, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.28% (3.0515 => 3.3042, std.dev.: 0.0476) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.09% (1.1857 => 1.2816, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/queens: 7.19% (1.7056 => 1.8282, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.78% (4.7794 => 5.1036, std.dev.: 0.0087) MultiSource/Applications/SIBsim4/SIBsim4: 6.35% (3.1873 => 3.3897, std.dev.: 0.0219) SingleSource/Benchmarks/Misc/richards_benchmark: 6.13% (1.3037 => 1.3836, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.07% (4.9686 => 5.2703, std.dev.: 0.0296) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.86% (4.5327 => 4.7984, std.dev.: 0.0475) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.27% (2.2485 => 2.3671, std.dev.: 0.0431) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.65% (3.3761 => 3.5332, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.59% (6.2275 => 6.5134, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.47% (4.9453 => 5.1665, std.dev.: 0.0141) MultiSource/Applications/hexxagon/hexxagon: 3.92% (14.0064 => 14.5559, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.88% (1.2337 => 1.2816, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.34% (4.8362 => 4.9976, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.72% (11.5690 => 11.8834, std.dev.: 0.0287) MultiSource/Applications/siod/siod: 2.69% (3.6643 => 3.7630, std.dev.: 0.0198) MultiSource/Applications/lambda-0_1_3/lambda: 2.65% (7.4933 => 7.6921, std.dev.: 0.0266) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.60% (8.2783 => 8.4939, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.49% (4.8660 => 4.9872, std.dev.: 0.0118) SingleSource/Benchmarks/Dhrystone/dry: 2.46% (0.5081 => 0.5206, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: 2.24% (7.3375 => 7.5021, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.04% (1.5941 => 1.6266, std.dev.: 0.0053) MultiSource/Benchmarks/llubenchmark/llu: 1.96% (1.9967 => 2.0358, std.dev.: 0.0085) SingleSource/Benchmarks/Stanford/FloatMM: 1.57% (0.8807 => 0.8945, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.47% (2.4647 => 2.5009, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/neural/neural: 1.31% (1.0841 => 1.0983, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.12% (5.4641 => 4.3101, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.41% (7.2130 => 6.2456, std.dev.: 0.2400) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.12% (1.0512 => 0.9343, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: -9.72% (1.1216 => 1.0126, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: -8.44% (63.1822 => 57.8511, std.dev.: 0.0348) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.68% (0.3269 => 0.3018, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.88% (4.7482 => 4.4215, std.dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: -6.44% (21.9654 => 20.5513, std.dev.: 0.5483) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.85% (5.4972 => 5.1756, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.83% (3.7148 => 3.4983, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.95% (5.1557 => 4.9005, std.dev.: 0.0123) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.41% (2.8773 => 2.7505, std.dev.: 0.0289) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.35% (4.7449 => 4.5384, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.65% (6.0224 => 5.8028, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.19% (0.5807 => 0.5622, std.dev.: 0.0031) MultiSource/Applications/lua/lua: -3.10% (29.8330 => 28.9070, std.dev.: 0.0675) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.05% (28.5821 => 27.7106, std.dev.: 0.0265) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.83% (2.6356 => 2.5611, std.dev.: 0.0131) MultiSource/Applications/aha/aha: -2.60% (3.3398 => 3.2529, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.20% (9.9065 => 9.6882, std.dev.: 0.0266) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.98% (11.5316 => 11.3029, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.70% (2.3487 => 2.3088, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.58% (2.4490 => 2.4102, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hash2: -1.52% (3.4237 => 3.3718, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.51% (4.9994 => 4.9239, std.dev.: 0.0069) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.59% (16.4461 => 16.7079, std.dev.: 0.0822) MultiSource/Applications/obsequi/Obsequi: 3.21% (1.0262 => 1.0591, std.dev.: 0.0071) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6820.08% (0.3123 => 21.6114, std.dev.: 0.1850) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.50% (0.2463 => 0.3633, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: 0.30% (0.6010 => 0.6028, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.32% (0.3266 => 0.3309, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/strcat: 2.74% (0.1969 => 0.2023, std.dev.: 0.0075) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.53% (0.0254 => 0.0329, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -24.17% (0.0302 => 0.0229, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.26% (0.0384 => 0.0383, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/casts: 0.53% (0.0190 => 0.0191, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.76% (0.1438 => 0.1427, std.dev.: 0.0052) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 5.10% (1.1329 => 1.1907, std.dev.: 0.0120) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 4.58% (0.1462 => 0.1529, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.98% (0.4164 => 0.4205, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.14% (0.1369 => 0.1412, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.30% (0.0641 => 0.0607, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 19.49% (0.0195 => 0.0233, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.52% (0.0578 => 0.0581, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.67% (1.1437 => 1.1971, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1300.00% (0.0001 => 0.0014, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.80% (0.0627 => 0.0622, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.44% (0.0180 => 0.0215, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.92% (0.8017 => 0.7703, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -4.84% (0.0062 => 0.0059, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 7 16:11:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 7 Nov 2012 18:11:49 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121108001149.DE5D82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5664?compare_to=5662&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5664, Order: 167552, Start Time: 2012-11-07 22:47:06, End Time: 2012-11-08 00:12:00 To: 5662, Order: 167549, Start Time: 2012-11-07 20:58:51, End Time: 2012-11-07 22:23:45 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 1 (181 on baseline) Unchanged Tests: 1040 (856 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.11% (78.5814 => 80.2394, std.dev.: 0.5727) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.66% (56.4575 => 54.3933, std.dev.: 0.7846) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.64% (2.0478 => 2.1018, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.4937 => 7.6783, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hash2: 2.21% (3.1932 => 3.2638, std.dev.: 0.0114) MultiSource/Benchmarks/llubenchmark/llu: 1.46% (3.7435 => 3.7981, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.60% (0.1431 => 0.1308) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.85% (0.3821 => 0.3521, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.59% (2.4924 => 2.3032, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -7.14% (0.3812 => 0.3540, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -7.07% (0.3831 => 0.3560, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -7.07% (0.3848 => 0.3576, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.05% (0.3884 => 0.3610, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.99% (0.3891 => 0.3619, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: -6.98% (0.3880 => 0.3609, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -6.96% (0.3896 => 0.3625, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.91% (0.3142 => 0.2925, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -6.90% (0.4176 => 0.3888, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -6.84% (0.4033 => 0.3757, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -6.73% (0.4280 => 0.3992, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -6.67% (0.4199 => 0.3919, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.63% (0.2428 => 0.2267, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.52% (0.3357 => 0.3138, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.48% (0.4151 => 0.3882, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.47% (0.9542 => 0.8925, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.45% (22.4056 => 20.9600, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/methcall: -6.45% (0.3025 => 0.2830, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.44% (3.5339 => 3.3064, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.42% (0.3658 => 0.3423, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -6.36% (0.3446 => 0.3227, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.35% (1.0544 => 0.9874, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: -6.34% (0.2160 => 0.2023, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: -6.32% (7.0961 => 6.6478, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.31% (0.6484 => 0.6075, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: -6.30% (16.1920 => 15.1720, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/hash2: -6.30% (0.4861 => 0.4555, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary2: -6.29% (0.3481 => 0.3262, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: -6.29% (0.2989 => 0.2801, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -6.26% (0.3194 => 0.2994, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -6.26% (9.2283 => 8.6510, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/except: -6.25% (0.3026 => 0.2837, std.dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: -6.24% (1.3148 => 1.2327, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/matrix: -6.24% (0.3255 => 0.3052, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.23% (0.3837 => 0.3598, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.21% (0.9852 => 0.9240, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.21% (0.3849 => 0.3610, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.19% (2.1713 => 2.0369, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.18% (0.3931 => 0.3688, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.17% (1.2784 => 1.1995, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: -6.17% (0.4248 => 0.3986, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.15% (0.3252 => 0.3052, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -6.13% (0.2871 => 0.2695, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -6.12% (0.2939 => 0.2759, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.11% (0.2355 => 0.2211, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.10% (0.3016 => 0.2832, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -6.10% (4.3330 => 4.0687, std.dev.: 0.0033) MultiSource/Applications/Burg/burg: -6.10% (1.2515 => 1.1752, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.09% (1.3722 => 1.2886, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.08% (0.3057 => 0.2871, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -6.02% (0.3205 => 0.3012, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -6.01% (0.1879 => 0.1766) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.00% (1.4642 => 1.3763, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.00% (4.8161 => 4.5272, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.99% (0.2903 => 0.2729, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: -5.98% (0.3394 => 0.3191, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/lists1: -5.97% (0.3867 => 0.3636, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -5.97% (0.9179 => 0.8631, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: -5.97% (0.2849 => 0.2679, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.97% (0.2933 => 0.2758, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.96% (1.6364 => 1.5389, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.96% (0.1796 => 0.1689, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.95% (0.7919 => 0.7448, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -5.94% (0.3621 => 0.3406, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.92% (0.4321 => 0.4065, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: -5.92% (0.3059 => 0.2878, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -5.91% (1.1450 => 1.0773, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.90% (0.4427 => 0.4166, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.88% (4.5069 => 4.2417, std.dev.: 0.0075) MultiSource/Benchmarks/nbench/nbench: -5.87% (1.1530 => 1.0853, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: -5.87% (0.2659 => 0.2503, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -5.86% (0.3788 => 0.3566, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.84% (4.8802 => 4.5950, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.80% (0.4083 => 0.3846, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -5.78% (0.3406 => 0.3209, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.78% (4.0323 => 3.7991, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/bigfib: -5.78% (0.6750 => 0.6360, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.76% (1.6474 => 1.5525, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.74% (0.3483 => 0.3283, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.74% (0.2999 => 0.2827, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.73% (0.2548 => 0.2402, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.73% (14.2083 => 13.3942, std.dev.: 0.0143) MultiSource/Benchmarks/Olden/bh/bh: -5.73% (0.2985 => 0.2814, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.72% (6.7716 => 6.3840, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.71% (0.2695 => 0.2541, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.69% (0.4813 => 0.4539, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.69% (1.2300 => 1.1600, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.68% (0.5999 => 0.5658, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -5.68% (0.1761 => 0.1661, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -5.67% (2.4021 => 2.2659, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/05-eks/eks: -5.67% (0.4515 => 0.4259, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -5.64% (4.0594 => 3.8303, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.63% (0.6293 => 0.5939, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: -5.61% (15.5079 => 14.6378, std.dev.: 0.0095) MultiSource/Benchmarks/Bullet/bullet: -5.60% (34.0927 => 32.1823, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.59% (0.9557 => 0.9023, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: -5.59% (0.3581 => 0.3381, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -5.58% (0.6347 => 0.5993, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.57% (0.7021 => 0.6630, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.55% (5.4682 => 5.1645, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.53% (0.2278 => 0.2152, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.53% (0.3491 => 0.3298, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.52% (0.6736 => 0.6364, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: -5.52% (17.1032 => 16.1597, std.dev.: 0.0251) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.51% (0.3323 => 0.3140, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -5.49% (0.7447 => 0.7038, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.48% (0.5857 => 0.5536, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: -5.48% (18.2933 => 17.2908, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.42% (0.5478 => 0.5181, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: -5.42% (0.4524 => 0.4279, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.41% (8.0126 => 7.5789, std.dev.: 0.0068) SingleSource/UnitTests/ObjC++/property-reference: -5.41% (0.7779 => 0.7358, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.41% (0.5863 => 0.5546, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: -5.41% (2.1401 => 2.0244, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.40% (0.5925 => 0.5605, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.40% (0.5168 => 0.4889, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -5.40% (1.3864 => 1.3116, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: -5.38% (3.5154 => 3.3261, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.38% (0.5591 => 0.5290, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.38% (0.6260 => 0.5923, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.38% (0.5802 => 0.5490, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.37% (0.5849 => 0.5535, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.36% (0.5805 => 0.5494, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.34% (0.5581 => 0.5283, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.33% (0.7524 => 0.7123, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.33% (0.7339 => 0.6948, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.32% (0.6189 => 0.5860, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.31% (0.4916 => 0.4655, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.30% (0.3319 => 0.3143, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.30% (0.6395 => 0.6056, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.30% (0.5567 => 0.5272, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.30% (0.6304 => 0.5970, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.30% (0.6440 => 0.6099, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.29% (0.5329 => 0.5047, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.28% (0.6230 => 0.5901, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.28% (0.6667 => 0.6315, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.28% (0.6194 => 0.5867, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.27% (0.6660 => 0.6309, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.26% (2.2587 => 2.1398, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.26% (0.5859 => 0.5551, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.25% (0.6052 => 0.5734, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.25% (0.8521 => 0.8074, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.24% (0.6676 => 0.6326, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.24% (0.5456 => 0.5170, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.24% (0.6033 => 0.5717, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.23% (0.5941 => 0.5630, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.22% (0.5705 => 0.5407, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.21% (0.6297 => 0.5969, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: -5.20% (0.6441 => 0.6106, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.20% (0.2385 => 0.2261, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.19% (0.6395 => 0.6063, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -5.19% (0.8418 => 0.7981, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.15% (0.5575 => 0.5288, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.14% (1.2210 => 1.1583, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.13% (0.7198 => 0.6829, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: -5.12% (0.7982 => 0.7573, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.10% (0.6446 => 0.6117, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.08% (1.2221 => 1.1600, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.03% (0.2106 => 0.2000, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.03% (0.5570 => 0.5290, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.01% (0.5569 => 0.5290, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -5.00% (15.2527 => 14.4903, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.00% (0.2001 => 0.1901, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: -4.98% (0.3271 => 0.3108, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.95% (0.6681 => 0.6350, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.85% (0.5688 => 0.5412, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.72% (0.9077 => 0.8649, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: -4.50% (5.0226 => 4.7966, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: -4.23% (1.5610 => 1.4950, std.dev.: 0.0082) SingleSource/UnitTests/Vector/constpool: -2.44% (20.7746 => 20.2675, std.dev.: 0.0147) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7521, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1733, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.92% (2.2633 => 2.1746, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7060, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3339, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4732, std.dev.: 0.0022) Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 7 17:05:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 7 Nov 2012 19:05:54 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121108010554.3E2442A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5665?compare_to=5660&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5665, Order: 167549, Start Time: 2012-11-07 21:50:09, End Time: 2012-11-08 01:06:02 To: 5660, Order: 167534, Start Time: 2012-11-07 17:46:34, End Time: 2012-11-07 21:02:04 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (173 on baseline) Performance Improvements: 2 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1038 (718 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 11.75% (116.3252 => 129.9923, std.dev.: 0.7626) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.39% (2.0853 => 2.1143, std.dev.: 0.0083) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/Hello: -1.49% (0.6929 => 0.6826, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -1.41% (0.8357 => 0.8239, std.dev.: 0.0010) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.84% (0.0625 => 0.0874, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.89% (0.1063 => 0.1402, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.27% (0.2969 => 0.3749, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.50% (0.1106 => 0.1388, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.46% (0.4253 => 0.5336, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.45% (0.4139 => 0.5151, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.23% (0.0714 => 0.0887, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 24.11% (1.5932 => 1.9774, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.76% (0.5900 => 0.7302, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.29% (0.0584 => 0.0720, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.00% (0.5000 => 0.6150, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.95% (0.4994 => 0.6140, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.19% (0.0897 => 0.1096, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.94% (0.1021 => 0.1245, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.79% (0.1620 => 0.1973, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.68% (0.1107 => 0.1347, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 20.78% (0.0948 => 0.1145, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.60% (0.3903 => 0.4707, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0584 => 0.0704, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.31% (0.1103 => 0.1327, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/health/health: 20.22% (0.0821 => 0.0987, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.09% (0.0642 => 0.0771, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.04% (0.1003 => 0.1204, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.88% (0.1549 => 0.1857, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.83% (0.1604 => 0.1922, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 19.77% (0.1619 => 0.1939, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.71% (0.0822 => 0.0984, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.63% (0.1462 => 0.1749, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 19.06% (0.0808 => 0.0962, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.89% (0.3890 => 0.4625, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 18.80% (0.0947 => 0.1125, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 18.37% (0.4029 => 0.4769, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.27% (0.2014 => 0.2382, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: 18.23% (0.1218 => 0.1440, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.91% (0.2736 => 0.3226, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.77% (1.3152 => 1.5489, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/09-vor/vor: 17.67% (0.1505 => 0.1771, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.65% (0.1088 => 0.1280, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 17.62% (0.0698 => 0.0821, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 17.51% (0.5546 => 0.6517, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.48% (0.2866 => 0.3367, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.28% (0.1968 => 0.2308, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.19% (0.0605 => 0.0709, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 17.16% (0.5826 => 0.6826, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.07% (3.5627 => 4.1707, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/gs/gs: 17.05% (1.8794 => 2.1999, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.98% (0.4658 => 0.5449, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 16.98% (0.5889 => 0.6889, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.94% (0.3271 => 0.3825, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.63% (0.5026 => 0.5862, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.62% (1.6211 => 1.8906, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.56% (0.3930 => 0.4581, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 16.47% (0.1421 => 0.1655, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.47% (0.1160 => 0.1351, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.30% (0.4361 => 0.5072, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: 16.19% (0.9697 => 1.1267, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.14% (0.2875 => 0.3339, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 16.11% (1.0781 => 1.2518, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.04% (4.4195 => 5.1282, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: 15.81% (0.1284 => 0.1487, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 15.81% (4.2109 => 4.8766, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.69% (0.1090 => 0.1261, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 15.66% (0.2075 => 0.2400, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.33% (2.7292 => 3.1476, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.30% (0.2738 => 0.3157, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/fibo: 15.27% (0.2725 => 0.3141, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.21% (0.2729 => 0.3144, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 15.18% (0.3004 => 0.3460, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/strcat: 15.16% (0.2750 => 0.3167, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 15.14% (0.2714 => 0.3125, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.05% (0.3195 => 0.3676, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 15.04% (0.2780 => 0.3198, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.02% (1.9694 => 2.2652, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 15.00% (0.2813 => 0.3235, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 14.98% (0.2823 => 0.3246, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.98% (1.9966 => 2.2957, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/except: 14.94% (0.2811 => 0.3231, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 14.94% (0.9909 => 1.1389, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.90% (0.3362 => 0.3863, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 14.89% (0.7171 => 0.8239, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 14.84% (0.2803 => 0.3219, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 14.83% (23.5202 => 27.0082, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.79% (0.2792 => 0.3205, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.79% (2.0673 => 2.3731, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 14.73% (0.2566 => 0.2944, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.70% (0.2911 => 0.3339, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 14.63% (0.3096 => 0.3549, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 14.39% (0.3267 => 0.3737, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 14.36% (1.4269 => 1.6318, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 14.21% (0.3258 => 0.3721, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 14.17% (0.3317 => 0.3787, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.02% (0.3060 => 0.3489, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 13.97% (0.7875 => 0.8975, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.92% (0.3124 => 0.3559, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists: 13.77% (0.3348 => 0.3809, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/moments: 13.73% (0.3678 => 0.4183, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.71% (0.3282 => 0.3732, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 13.63% (0.3726 => 0.4234, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.63% (0.3625 => 0.4119, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 13.46% (0.0758 => 0.0860, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 13.45% (2.1653 => 2.4566, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 13.39% (0.4251 => 0.4820, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 13.38% (4.6177 => 5.2356, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/lists1: 13.37% (0.3477 => 0.3942, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 13.37% (2.1013 => 2.3822, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.34% (0.3845 => 0.4358, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 13.29% (0.4146 => 0.4697, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.28% (0.2040 => 0.2311, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.16% (0.1383 => 0.1565, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.09% (0.3690 => 0.4173, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.09% (0.3981 => 0.4502, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 12.87% (0.5012 => 0.5657, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 12.82% (0.2691 => 0.3036, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.74% (0.3469 => 0.3911, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.73% (0.3496 => 0.3941, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.64% (0.3488 => 0.3929, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.64% (0.3465 => 0.3903, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.62% (0.3446 => 0.3881, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.60% (0.3460 => 0.3896, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.55% (0.3442 => 0.3874, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.47% (0.3650 => 0.4105, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 12.26% (5.5417 => 6.2212, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/parameter-passing: 12.24% (0.3724 => 0.4180, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.24% (0.3643 => 0.4089, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.92% (0.6435 => 0.7202, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 11.61% (0.3498 => 0.3904, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 11.43% (0.6634 => 0.7392, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.38% (0.1028 => 0.1145, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 11.08% (0.4847 => 0.5384, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.64% (0.2068 => 0.2288, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.51% (0.3084 => 0.3408, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.45% (0.2737 => 0.3023, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 10.41% (0.2391 => 0.2640, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 10.34% (0.3336 => 0.3681, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 10.34% (2.0346 => 2.2449, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.80% (0.2103 => 0.2309, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.98% (4.6926 => 5.1141, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.95% (0.5361 => 0.5841, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.90% (11.6398 => 12.6756, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.76% (0.5584 => 0.6073, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.56% (0.7426 => 0.8062, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 6.73% (11.9555 => 12.7599, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.90% (0.3792 => 0.3940, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.81% (0.2802 => 0.3077, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6086, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.22% (12.0509 => 12.6794, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.12% (0.3693 => 0.3882, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary: 4.95% (0.2122 => 0.2227, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1693, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-2: 4.68% (1.8057 => 1.8902, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6425, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ary3: 2.00% (15.8721 => 16.1888, std.dev.: 0.0455) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.64% (3.1722 => 3.2243, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.55% (2.0820 => 2.1143, std.dev.: 0.0083) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3074, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.36% (7.1849 => 7.2825, std.dev.: 0.0042) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5140, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5882, std.dev.: 0.0164) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5555, std.dev.: 0.0283) SingleSource/Benchmarks/Shootout-C++/ary2: -8.53% (0.2402 => 0.2197, std.dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9783, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8010, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8038, std.dev.: 0.0024) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.32% (17.2379 => 16.8376, std.dev.: 0.0197) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.27% (0.6293 => 0.6150, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8655, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5772, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4951, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.22% (105.3826 => 104.0938, std.dev.: 0.1338) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0437, std.dev.: 0.0046) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 7 17:38:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 7 Nov 2012 19:38:30 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121108013830.C201D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5666?compare_to=5663&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5666, Order: 167560, Start Time: 2012-11-08 00:12:37, End Time: 2012-11-08 01:38:41 To: 5663, Order: 167552, Start Time: 2012-11-07 22:29:22, End Time: 2012-11-07 23:55:35 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 13 (102 on baseline) Performance Improvements: 3 (25 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 975 (847 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.92% (0.4758 => 0.5135, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.39% (0.8548 => 0.9009, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.29% (0.2985 => 0.3143, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.36% (0.3234 => 0.3375, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.49% (0.3354 => 0.3471, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.14% (0.5828 => 0.6011, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.85% (0.6384 => 0.6566, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.78% (4.5945 => 4.6763, std.dev.: 0.0213) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.52% (1.3574 => 1.3780, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.19% (4.2689 => 4.3199, std.dev.: 0.0161) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.17% (1.1123 => 1.1476, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (4.3369 => 4.4699, std.dev.: 0.0413) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.68% (14.3580 => 14.7431, std.dev.: 0.0126) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.21% (0.8449 => 0.8347, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -5.12% (3.8597 => 3.6622, std.dev.: 0.0510) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.32% (4.9976 => 4.9318, std.dev.: 0.0088) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.26% (16.7079 => 16.6648, std.dev.: 0.1438) MultiSource/Applications/obsequi/Obsequi: -0.71% (1.0591 => 1.0516, std.dev.: 0.0185) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.30% (21.6114 => 21.5461, std.dev.: 0.3383) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.36% (0.3633 => 0.3620, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 0.73% (0.6028 => 0.6072, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.24% (0.3309 => 0.3317, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -3.41% (0.2023 => 0.1954, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -24.31% (0.0218 => 0.0165, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.94% (0.0424 => 0.0428, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -24.92% (0.0329 => 0.0247, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 35.81% (0.0229 => 0.0311, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.70% (0.0383 => 0.0424, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 6.81% (0.0191 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -17.89% (0.0218 => 0.0179, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1427 => 0.1426, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -4.55% (1.1907 => 1.1365, std.dev.: 0.0368) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.59% (0.1529 => 0.1520, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.07% (0.4205 => 0.4202, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.06% (0.1412 => 0.1397, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.08% (0.0607 => 0.0650, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -18.88% (0.0233 => 0.0189, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.47% (0.0581 => 0.0636, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.30% (1.1971 => 1.1935, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.32% (0.0622 => 0.0564, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 12.09% (0.0215 => 0.0241, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 2.31% (0.7703 => 0.7881, std.dev.: 0.0137) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 16.95% (0.0059 => 0.0069, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2300.28% (0.6332 => 15.1986, std.dev.: 0.1485) MultiSource/Benchmarks/McCat/08-main/main: 48.23% (0.1831 => 0.2714, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.90% (0.1559 => 0.1467, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1504.43% (0.3344 => 5.3652, std.dev.: 0.0454) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.00% (0.2364 => 0.3215, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel: 2.56% (0.0429 => 0.0440, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.25% (0.0224 => 0.0238, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -25.65% (0.0230 => 0.0171, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4281, std.dev.: 0.0238) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0708, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4946, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3475, std.dev.: 0.0271) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1277, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4040, std.dev.: 0.0075) SingleSource/Regression/C/uint64_to_float: -24.04% (2.1832 => 1.6584, std.dev.: 0.0045) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.67% (0.0810 => 0.0945, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 10.97% (0.1112 => 0.1234, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.90% (0.1157 => 0.1260, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.27% (0.8321 => 0.9009, std.dev.: 0.0071) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.59% (0.3137 => 0.3375, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.25% (0.2180 => 0.2338, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.20% (0.1983 => 0.2106, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.10% (0.2279 => 0.2418, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.99% (0.7473 => 0.7921, std.dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.99% (0.1885 => 0.1998, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.94% (0.4847 => 0.5135, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.34% (0.3295 => 0.3471, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.76% (0.6010 => 0.6296, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.69% (0.2240 => 0.2345, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.66% (0.3003 => 0.3143, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.44% (0.6287 => 0.6566, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.39% (1.1606 => 1.2115, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.29% (0.2378 => 0.2480, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.97% (0.2519 => 0.2619, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.93% (1.1685 => 1.2144, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.77% (1.3279 => 1.3780, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.71% (0.3717 => 0.3855, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.66% (0.4783 => 0.4958, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.44% (4.1763 => 4.3199, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.38% (0.8286 => 0.8566, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.34% (0.5817 => 0.6011, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.27% (0.5961 => 0.6156, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/gs/gs: 3.23% (4.1305 => 4.2640, std.dev.: 0.0291) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.21% (6.6074 => 6.8197, std.dev.: 0.0814) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.11% (0.9039 => 0.9320, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.00% (0.4127 => 0.4251, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.96% (0.8697 => 0.8954, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: 2.81% (1.2222 => 1.2565, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.51% (0.8611 => 0.8827, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.42% (0.9908 => 1.0148, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.36% (4.4873 => 4.5932, std.dev.: 0.0311) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.34% (0.8597 => 0.8798, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.32% (4.5702 => 4.6763, std.dev.: 0.0213) MultiSource/Applications/lua/lua: 2.31% (3.8189 => 3.9070, std.dev.: 0.0208) MultiSource/Applications/ClamAV/clamscan: 2.30% (14.7684 => 15.1076, std.dev.: 0.0686) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.23% (0.8656 => 0.8849, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.21% (0.8995 => 0.9194, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.20% (0.8331 => 0.8514, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.19% (0.8050 => 0.8226, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.18% (0.6227 => 0.6363, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.15% (0.8518 => 0.8701, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.13% (0.8855 => 0.9044, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.04% (14.2605 => 14.5517, std.dev.: 0.0361) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.00% (0.8316 => 0.8482, std.dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: 1.99% (15.3280 => 15.6330, std.dev.: 0.0257) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.99% (4.4880 => 4.5771, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.98% (0.9069 => 0.9249, std.dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 1.95% (6.7320 => 6.8635, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.91% (0.8317 => 0.8476, std.dev.: 0.0037) MultiSource/Applications/SIBsim4/SIBsim4: 1.90% (1.2568 => 1.2807, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.89% (0.8338 => 0.8496, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.87% (0.8340 => 0.8496, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.83% (2.1401 => 2.1792, std.dev.: 0.0132) MultiSource/Applications/d/make_dparser: 1.78% (3.2366 => 3.2942, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.75% (1.4479 => 1.4733, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.74% (0.8204 => 0.8347, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.72% (0.8420 => 0.8565, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.71% (0.8927 => 0.9080, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 1.59% (0.6834 => 0.6943, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.57% (1.2526 => 1.2723, std.dev.: 0.0050) MultiSource/Applications/siod/siod: 1.53% (2.2184 => 2.2523, std.dev.: 0.0046) MultiSource/Benchmarks/PAQ8p/paq8p: 1.48% (2.3764 => 2.4116, std.dev.: 0.0125) MultiSource/Benchmarks/mafft/pairlocalalign: 1.41% (8.6247 => 8.7461, std.dev.: 0.0333) MultiSource/Benchmarks/Bullet/bullet: 1.39% (31.8598 => 32.3038, std.dev.: 0.0805) MultiSource/Benchmarks/Prolangs-C/football/football: 1.28% (0.8768 => 0.8880, std.dev.: 0.0034) MultiSource/Applications/lemon/lemon: 1.17% (1.0945 => 1.1073, std.dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: 1.12% (4.9628 => 5.0185, std.dev.: 0.0187) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 112.06% (0.0199 => 0.0422, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/pi: 56.90% (1.5795 => 2.4782, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.35% (2.9753 => 3.4618, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 14.87% (0.7597 => 0.8727, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.75% (2.7995 => 3.2123, std.dev.: 0.1185) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.62% (5.0261 => 5.6102, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 7.54% (1.7056 => 1.8342, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.47% (1.1857 => 1.2743, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/richards_benchmark: 6.47% (1.3037 => 1.3880, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.32% (4.7794 => 5.0814, std.dev.: 0.0181) MultiSource/Applications/SIBsim4/SIBsim4: 6.22% (3.1873 => 3.3856, std.dev.: 0.0235) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.88% (4.9686 => 5.2609, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.84% (4.5327 => 4.7972, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/treeadd/treeadd: 5.46% (0.3587 => 0.3783, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.69% (3.3761 => 3.5343, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.44% (4.9453 => 5.1651, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.26% (6.2275 => 6.4926, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.01% (4.9469 => 5.1452, std.dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: 3.87% (14.0064 => 14.5491, std.dev.: 0.0054) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.16% (1.2337 => 1.2727, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.85% (11.5690 => 11.8983, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.78% (4.8660 => 5.0013, std.dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: 2.78% (7.4933 => 7.7014, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 2.71% (3.6643 => 3.7637, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.63% (4.3552 => 4.4699, std.dev.: 0.0413) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.47% (8.2783 => 8.4830, std.dev.: 0.0203) SingleSource/Benchmarks/Shootout/lists: 2.40% (7.3375 => 7.5138, std.dev.: 0.0206) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.98% (4.8362 => 4.9318, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/power/power: 1.48% (1.2061 => 1.2239, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 1.06% (8.5322 => 8.6223, std.dev.: 0.0285) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.04% (5.4641 => 4.3144, std.dev.: 0.0159) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.02% (1.0512 => 0.9354, std.dev.: 0.0297) SingleSource/Benchmarks/McGill/chomp: -10.99% (1.1216 => 0.9983, std.dev.: 0.0249) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -9.19% (7.2130 => 6.5502, std.dev.: 0.1971) MultiSource/Benchmarks/mafft/pairlocalalign: -8.51% (63.1822 => 57.8055, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.41% (0.3269 => 0.2994, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.87% (4.7482 => 4.4222, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.55% (3.9188 => 3.6622, std.dev.: 0.0510) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.99% (3.7148 => 3.4922, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.84% (5.4972 => 5.1762, std.dev.: 0.0268) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.04% (5.1557 => 4.8956, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.45% (4.7449 => 4.5337, std.dev.: 0.0127) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.26% (2.8773 => 2.7546, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.15% (0.5807 => 0.5624, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (28.5821 => 27.6883, std.dev.: 0.0318) MultiSource/Applications/lua/lua: -2.94% (29.8330 => 28.9574, std.dev.: 0.0457) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.62% (2.6356 => 2.5666, std.dev.: 0.0142) MultiSource/Benchmarks/FreeBench/mason/mason: -2.59% (0.5415 => 0.5275, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.58% (9.9065 => 9.6506, std.dev.: 0.0896) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.07% (11.5316 => 11.2924, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.94% (3.2169 => 3.1544, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.61% (2.3487 => 2.3108, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.54% (4.9994 => 4.9222, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/hash2: -1.37% (3.4237 => 3.3768, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.19% (5.6343 => 5.5671, std.dev.: 0.0027) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.33% (16.4461 => 16.6648, std.dev.: 0.1438) MultiSource/Applications/obsequi/Obsequi: 2.48% (1.0262 => 1.0516, std.dev.: 0.0185) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6799.17% (0.3123 => 21.5461, std.dev.: 0.3383) SingleSource/Benchmarks/CoyoteBench/fftbench: 46.98% (0.2463 => 0.3620, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 1.03% (0.6010 => 0.6072, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.56% (0.3266 => 0.3317, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -0.76% (0.1969 => 0.1954, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 34.15% (0.0123 => 0.0165, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.76% (0.0254 => 0.0247, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.98% (0.0302 => 0.0311, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -0.56% (0.0180 => 0.0179, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.83% (0.1438 => 0.1426, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.32% (1.1329 => 1.1365, std.dev.: 0.0368) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 3.97% (0.1462 => 0.1520, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.91% (0.4164 => 0.4202, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.05% (0.1369 => 0.1397, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.40% (0.0641 => 0.0650, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.08% (0.0195 => 0.0189, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.03% (0.0578 => 0.0636, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.35% (1.1437 => 1.1935, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.05% (0.0627 => 0.0564, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 33.89% (0.0180 => 0.0241, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.70% (0.8017 => 0.7881, std.dev.: 0.0137) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 11.29% (0.0062 => 0.0069, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 7 18:00:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 7 Nov 2012 20:00:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121108020031.593EB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5667?compare_to=5664&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5667, Order: 167562, Start Time: 2012-11-08 00:35:28, End Time: 2012-11-08 02:00:41 To: 5664, Order: 167552, Start Time: 2012-11-07 22:47:06, End Time: 2012-11-08 00:12:00 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (176 on baseline) Unchanged Tests: 1042 (862 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1014, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/salsa20: 2.39% (7.4937 => 7.6731, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash2: 1.95% (3.1932 => 3.2556, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.46% (0.1431 => 0.1310) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.62% (0.3821 => 0.3530, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -7.58% (2.4924 => 2.3036, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.56% (0.3142 => 0.2936, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -6.52% (0.3357 => 0.3138, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.51% (0.2428 => 0.2270, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.44% (3.5339 => 3.3064, std.dev.: 0.0210) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.42% (0.9542 => 0.8929, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -6.39% (0.2160 => 0.2022, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.34% (22.4056 => 20.9859, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.31% (0.3658 => 0.3427, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: -6.27% (0.3812 => 0.3573, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.26% (0.3831 => 0.3591, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.26% (0.3848 => 0.3607, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.20% (0.3884 => 0.3643, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.19% (0.3891 => 0.3650, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.17% (1.0544 => 0.9893, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.17% (0.9852 => 0.9244, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -6.17% (9.2283 => 8.6590, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-4: -6.16% (0.3880 => 0.3641, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -6.15% (0.4176 => 0.3919, std.dev.: 0.0053) MultiSource/Applications/JM/lencod/lencod: -6.13% (16.1920 => 15.1998, std.dev.: 0.0132) MultiSource/Applications/JM/ldecod/ldecod: -6.09% (7.0961 => 6.6640, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/synchronized: -6.08% (0.3896 => 0.3659, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -6.05% (0.4033 => 0.3789, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.03% (0.6484 => 0.6093, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/property: -6.00% (0.4199 => 0.3947, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.98% (1.2784 => 1.2020, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: -5.96% (1.2515 => 1.1769, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: -5.96% (4.3330 => 4.0749, std.dev.: 0.0116) SingleSource/UnitTests/ObjC/parameter-passing: -5.93% (0.4280 => 0.4026, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.90% (1.3722 => 1.2912, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: -5.89% (1.1450 => 1.0776, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.88% (0.4151 => 0.3907, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.83% (0.1716 => 0.1616, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -5.80% (1.3148 => 1.2385, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.77% (0.2355 => 0.2219, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.77% (0.3483 => 0.3282, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.77% (1.6474 => 1.5524, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -5.76% (0.9179 => 0.8650, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.76% (1.2300 => 1.1592, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/methcall: -5.75% (0.3025 => 0.2851, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -5.75% (1.1530 => 1.0867, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: -5.74% (0.4861 => 0.4582, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.74% (4.0323 => 3.8009, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.72% (4.8161 => 4.5407, std.dev.: 0.0125) MultiSource/Benchmarks/McCat/08-main/main: -5.72% (0.2659 => 0.2507, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.71% (4.5069 => 4.2495, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.71% (1.4642 => 1.3806, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.71% (0.3837 => 0.3618, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary3: -5.69% (0.3446 => 0.3250, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -5.68% (0.3255 => 0.3070, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.65% (4.8802 => 4.6044, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: -5.65% (0.3026 => 0.2855, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -5.64% (2.4021 => 2.2666, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.64% (0.2695 => 0.2543, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: -5.64% (0.3194 => 0.3014, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -5.63% (0.3481 => 0.3285, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -5.62% (0.2989 => 0.2821, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.61% (0.3849 => 0.3633, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.60% (0.3931 => 0.3711, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -5.59% (0.2985 => 0.2818, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.58% (0.6304 => 0.5952, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: -5.57% (0.3394 => 0.3205, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.55% (0.3406 => 0.3217, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.55% (14.2083 => 13.4202, std.dev.: 0.0103) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.54% (6.7716 => 6.3965, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/moments: -5.51% (0.4248 => 0.4014, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -5.51% (17.1032 => 16.1612, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.50% (0.3016 => 0.2850, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -5.50% (15.5079 => 14.6544, std.dev.: 0.0147) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.49% (0.2548 => 0.2408, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.49% (0.8521 => 0.8053, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.49% (0.4083 => 0.3859, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.48% (0.5857 => 0.5536, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.48% (0.7919 => 0.7485, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.48% (1.6364 => 1.5468, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.46% (0.7524 => 0.7113, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.45% (2.1713 => 2.0530, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.45% (0.6736 => 0.6369, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.45% (5.4682 => 5.1704, std.dev.: 0.0074) MultiSource/Applications/lua/lua: -5.44% (4.0594 => 3.8386, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: -5.40% (0.4515 => 0.4271, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: -5.40% (0.2871 => 0.2716, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -5.40% (0.7447 => 0.7045, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.40% (0.3057 => 0.2892, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.39% (0.6395 => 0.6050, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -5.39% (0.3581 => 0.3388, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.38% (2.2587 => 2.1372, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -5.36% (0.6750 => 0.6388, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.36% (0.7021 => 0.6645, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.35% (0.5567 => 0.5269, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.35% (0.3252 => 0.3078, std.dev.: 0.0029) MultiSource/Applications/treecc/treecc: -5.35% (2.1401 => 2.0257, std.dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: -5.34% (18.2933 => 17.3158, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.34% (0.5859 => 0.5546, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -5.34% (0.2939 => 0.2782, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.33% (0.5478 => 0.5186, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.32% (0.6293 => 0.5958, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.32% (0.6260 => 0.5927, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -5.31% (3.5154 => 3.3289, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: -5.30% (0.3205 => 0.3035, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -5.30% (0.3621 => 0.3429, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.30% (0.2999 => 0.2840, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: -5.30% (0.3867 => 0.3662, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: -5.30% (0.2849 => 0.2698, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.29% (0.9557 => 0.9051, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.29% (0.5805 => 0.5498, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.29% (0.5581 => 0.5286, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.29% (0.4427 => 0.4193, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.28% (0.5925 => 0.5612, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.28% (0.5168 => 0.4895, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.27% (0.5863 => 0.5554, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.27% (0.5849 => 0.5541, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -5.26% (0.3059 => 0.2898, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.25% (0.4916 => 0.4658, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.24% (0.5802 => 0.5498, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.23% (0.4321 => 0.4095, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.23% (0.6660 => 0.6312, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.22% (0.6440 => 0.6104, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.22% (0.2933 => 0.2780, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.21% (0.6446 => 0.6110, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.21% (0.6297 => 0.5969, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.21% (0.6681 => 0.6333, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.20% (0.6052 => 0.5737, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -5.20% (34.0927 => 32.3194, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.19% (0.4813 => 0.4563, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.19% (0.5705 => 0.5409, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.18% (0.2278 => 0.2160, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: -5.17% (0.3788 => 0.3592, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.17% (0.5591 => 0.5302, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.17% (0.5456 => 0.5174, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.17% (0.5941 => 0.5634, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.16% (0.7339 => 0.6960, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.16% (1.3864 => 1.3149, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.15% (0.3323 => 0.3152, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.13% (0.5575 => 0.5289, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.13% (0.3491 => 0.3312, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.12% (0.5329 => 0.5056, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.11% (8.0126 => 7.6029, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.10% (0.5999 => 0.5693, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.10% (0.6667 => 0.6327, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.09% (0.6230 => 0.5913, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.08% (0.5569 => 0.5286, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.07% (0.6395 => 0.6071, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.06% (0.2903 => 0.2756, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.06% (0.6189 => 0.5876, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.03% (0.5688 => 0.5402, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.00% (0.6194 => 0.5884, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.99% (0.6676 => 0.6343, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.95% (0.2385 => 0.2267, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.93% (0.7198 => 0.6843, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.93% (1.2210 => 1.1608, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.90% (0.5570 => 0.5297, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -4.89% (0.4524 => 0.4303, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.84% (15.2527 => 14.5152, std.dev.: 0.0169) MultiSource/Benchmarks/McCat/09-vor/vor: -4.80% (0.3271 => 0.3114, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: -4.64% (5.0226 => 4.7896, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.62% (1.2221 => 1.1656, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: -4.58% (0.6347 => 0.6056, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -4.55% (0.8418 => 0.8035, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.55% (0.3319 => 0.3168, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: -4.43% (0.7982 => 0.7628, std.dev.: 0.0112) SingleSource/UnitTests/ObjC++/property-reference-object: -4.24% (0.6441 => 0.6168, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -4.22% (0.7779 => 0.7451, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.93% (0.9077 => 0.8720, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: -3.87% (1.5610 => 1.5006, std.dev.: 0.0026) SingleSource/UnitTests/Vector/constpool: -2.38% (20.7746 => 20.2802, std.dev.: 0.0222) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7557, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: -8.65% (1.2842 => 1.1731, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.99% (2.2633 => 2.1730, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7067, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4709, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0001) Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 7 19:23:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 7 Nov 2012 21:23:24 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121108032324.149482A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5668?compare_to=5666&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5668, Order: 167568, Start Time: 2012-11-08 01:57:59, End Time: 2012-11-08 03:23:34 To: 5666, Order: 167560, Start Time: 2012-11-08 00:12:37, End Time: 2012-11-08 01:38:41 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 7 (100 on baseline) Performance Improvements: 7 (29 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 977 (845 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.41% (0.2723 => 0.2843, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.16% (0.9555 => 0.9857, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.72% (0.6296 => 0.6467, std.dev.: 0.0052) MultiSource/Applications/hbd/hbd: 1.96% (1.4483 => 1.4767, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/football/football: 1.13% (0.8880 => 0.8980, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.56% (0.8727 => 0.8950, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/five11/five11: 1.06% (5.6031 => 5.6627, std.dev.: 0.0223) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.77% (8.5771 => 8.1678, std.dev.: 0.1472) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.42% (0.8566 => 0.8444, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -31.75% (0.0315 => 0.0215, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -6.09% (2.3908 => 2.2452, std.dev.: 0.0255) SingleSource/Benchmarks/Shootout/nestedloop: -5.50% (0.2108 => 0.1992, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.90% (4.6483 => 4.5136, std.dev.: 0.0493) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.68% (1.3884 => 1.3512, std.dev.: 0.0139) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.69% (16.6648 => 16.5496, std.dev.: 0.0798) MultiSource/Applications/obsequi/Obsequi: 0.95% (1.0516 => 1.0616, std.dev.: 0.0131) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.42% (21.5461 => 21.8521, std.dev.: 0.0620) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.72% (0.3620 => 0.3646, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: -0.16% (0.6072 => 0.6062, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.21% (0.3317 => 0.3310, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/strcat: 3.07% (0.1954 => 0.2014, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 19.39% (0.0165 => 0.0197, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0428 => 0.0427, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 10.53% (0.0247 => 0.0273, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0311 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.90% (0.0424 => 0.0399, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/casts: -0.98% (0.0204 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.67% (0.0179 => 0.0216, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.35% (0.1426 => 0.1431, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.66% (1.1365 => 1.1554, std.dev.: 0.0251) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.37% (0.1520 => 0.1484, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.59% (0.4202 => 0.4093, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.00% (0.1397 => 0.1383, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.00% (0.0650 => 0.0624, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 28.04% (0.0189 => 0.0242, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.89% (0.0636 => 0.0554, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.05% (1.1935 => 1.1929, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.53% (0.0564 => 0.0561, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.73% (0.0241 => 0.0250, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.86% (0.7881 => 0.7813, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -13.04% (0.0069 => 0.0060, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2308.35% (0.6332 => 15.2497, std.dev.: 0.1868) MultiSource/Benchmarks/McCat/08-main/main: 44.89% (0.1831 => 0.2653, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.34% (0.1559 => 0.1429, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1492.52% (0.3344 => 5.3254, std.dev.: 0.0223) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.28% (0.2364 => 0.3198, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/mandel: 2.80% (0.0429 => 0.0441, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.70% (0.0224 => 0.0239, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -53.04% (0.0230 => 0.0108, std.dev.: 0.0028) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4241, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0745, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4900, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3439, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1296, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4108, std.dev.: 0.0047) SingleSource/Regression/C/uint64_to_float: -23.86% (2.1832 => 1.6623, std.dev.: 0.0112) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.46% (0.0810 => 0.0919, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.16% (0.8321 => 0.9000, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.03% (0.2279 => 0.2462, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.60% (0.6010 => 0.6467, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.77% (0.4847 => 0.5175, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.39% (0.8148 => 0.8669, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.06% (0.3003 => 0.3185, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.67% (0.2133 => 0.2254, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.38% (0.7473 => 0.7875, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.20% (1.1606 => 1.2210, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.47% (0.9435 => 0.9857, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.25% (1.1685 => 1.2182, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.87% (0.2998 => 0.3114, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.71% (1.6386 => 1.6994, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.55% (0.8716 => 0.9025, std.dev.: 0.0044) MultiSource/Applications/hbd/hbd: 3.49% (1.4269 => 1.4767, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.30% (1.1170 => 1.1539, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.06% (0.5817 => 0.5995, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.99% (1.2526 => 1.2900, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.92% (1.3279 => 1.3667, std.dev.: 0.0073) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.92% (6.6074 => 6.8004, std.dev.: 0.0626) MultiSource/Benchmarks/nbench/nbench: 2.79% (1.1271 => 1.1585, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.65% (4.4873 => 4.6063, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.57% (1.4479 => 1.4851, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.57% (4.5702 => 4.6876, std.dev.: 0.0250) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.52% (0.8697 => 0.8916, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/football/football: 2.42% (0.8768 => 0.8980, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.41% (0.8885 => 0.9099, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.35% (0.8338 => 0.8534, std.dev.: 0.0058) MultiSource/Applications/ClamAV/clamscan: 2.33% (14.7684 => 15.1132, std.dev.: 0.1308) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.33% (4.1763 => 4.2737, std.dev.: 0.0287) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.30% (0.8597 => 0.8795, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 2.26% (14.2605 => 14.5833, std.dev.: 0.1126) MultiSource/Applications/SIBsim4/SIBsim4: 2.22% (1.2568 => 1.2847, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.21% (13.1811 => 13.4721, std.dev.: 0.0773) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.14% (0.8177 => 0.8352, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.10% (1.2423 => 1.2684, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.09% (0.8995 => 0.9183, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.07% (0.8317 => 0.8489, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.06% (0.8331 => 0.8503, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.05% (0.8050 => 0.8215, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.05% (0.8261 => 0.8430, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.05% (0.8359 => 0.8530, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.91% (0.8286 => 0.8444, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.90% (0.8316 => 0.8474, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.90% (0.9074 => 0.9246, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.88% (0.8656 => 0.8819, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.87% (0.8086 => 0.8237, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.83% (0.8805 => 0.8966, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.82% (0.8066 => 0.8213, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.82% (0.7966 => 0.8111, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.82% (8.6476 => 8.8049, std.dev.: 0.0591) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.82% (0.8855 => 0.9016, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.81% (0.9056 => 0.9220, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.78% (0.9908 => 1.0084, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 1.76% (31.8598 => 32.4205, std.dev.: 0.0659) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.75% (0.8518 => 0.8667, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.74% (0.8712 => 0.8864, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.72% (0.8420 => 0.8565, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.65% (0.8340 => 0.8478, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.59% (0.8927 => 0.9069, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: 1.45% (2.3764 => 2.4108, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.34% (1.5315 => 1.5520, std.dev.: 0.0047) MultiSource/Applications/lemon/lemon: 1.26% (1.0945 => 1.1083, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.25% (8.6247 => 8.7326, std.dev.: 0.0241) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.02% (2.1401 => 2.1619, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 97.49% (0.0199 => 0.0393, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/pi: 57.60% (1.5795 => 2.4893, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.81% (0.7597 => 0.8950, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.27% (2.9753 => 3.4594, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.73% (2.7995 => 3.2119, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.50% (5.0261 => 5.6043, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.39% (1.1857 => 1.2733, std.dev.: 0.0050) SingleSource/Benchmarks/McGill/queens: 7.37% (1.7056 => 1.8313, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.89% (4.7794 => 5.1085, std.dev.: 0.0588) SingleSource/Benchmarks/Misc/richards_benchmark: 6.57% (1.3037 => 1.3894, std.dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: 6.48% (3.1873 => 3.3937, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.89% (4.9686 => 5.2614, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.85% (4.5327 => 4.7980, std.dev.: 0.0254) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.72% (3.3761 => 3.5354, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.61% (6.2275 => 6.5145, std.dev.: 0.0307) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.49% (4.9453 => 5.1671, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.12% (4.9469 => 5.1509, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.90% (14.0064 => 14.5533, std.dev.: 0.0150) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.49% (1.2337 => 1.2768, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.99% (8.2783 => 8.5256, std.dev.: 0.0048) MultiSource/Applications/siod/siod: 2.95% (3.6643 => 3.7723, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.90% (11.5690 => 11.9040, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 2.59% (7.4933 => 7.6871, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout/lists: 2.36% (7.3375 => 7.5108, std.dev.: 0.0072) SingleSource/Benchmarks/Dhrystone/dry: 2.36% (0.5081 => 0.5201, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.35% (4.8362 => 4.9500, std.dev.: 0.0418) SingleSource/Benchmarks/Stanford/FloatMM: 1.51% (0.8807 => 0.8940, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.50% (1.1365 => 1.1536, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/neural/neural: 1.31% (1.0841 => 1.0983, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.22% (2.4647 => 2.4948, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.16% (3.5679 => 3.6093, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: 1.10% (1.2061 => 1.2194, std.dev.: 0.0037) MultiSource/Benchmarks/BitBench/five11/five11: 1.07% (5.6030 => 5.6627, std.dev.: 0.0223) MultiSource/Benchmarks/Olden/bh/bh: 1.04% (2.3560 => 2.3806, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.94% (5.4641 => 4.3201, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.66% (7.2130 => 6.3721, std.dev.: 0.1459) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.93% (1.0512 => 0.9363, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -10.53% (1.1216 => 1.0035, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: -8.55% (63.1822 => 57.7799, std.dev.: 0.1428) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.23% (0.3269 => 0.3000, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/heapsort: -8.02% (3.2926 => 3.0286, std.dev.: 0.0907) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.39% (4.7482 => 4.4447, std.dev.: 0.0442) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.11% (3.7148 => 3.4880, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.90% (5.4972 => 5.1731, std.dev.: 0.0515) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.89% (5.1557 => 4.9038, std.dev.: 0.0305) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.41% (4.7449 => 4.5357, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.79% (2.4490 => 2.3561, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.74% (6.0224 => 5.7973, std.dev.: 0.0097) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.61% (2.8773 => 2.7734, std.dev.: 0.0197) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.20% (0.5807 => 0.5621, std.dev.: 0.0027) MultiSource/Applications/lua/lua: -2.98% (29.8330 => 28.9446, std.dev.: 0.1304) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.84% (28.5821 => 27.7692, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.69% (2.6356 => 2.5647, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.67% (1.3882 => 1.3512, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.41% (9.9065 => 9.6673, std.dev.: 0.0217) MultiSource/Benchmarks/Olden/bisort/bisort: -2.34% (0.6636 => 0.6481, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -2.31% (0.5415 => 0.5290, std.dev.: 0.0033) MultiSource/Applications/aha/aha: -2.08% (3.3398 => 3.2702, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.04% (3.2169 => 3.1513, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.95% (11.5316 => 11.3073, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/ffbench: -1.90% (1.4296 => 1.4024, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.62% (4.9994 => 4.9186, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.3487 => 2.3196, std.dev.: 0.0112) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.63% (16.4461 => 16.5496, std.dev.: 0.0798) MultiSource/Applications/obsequi/Obsequi: 3.45% (1.0262 => 1.0616, std.dev.: 0.0131) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6897.15% (0.3123 => 21.8521, std.dev.: 0.0620) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.03% (0.2463 => 0.3646, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 0.87% (0.6010 => 0.6062, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.35% (0.3266 => 0.3310, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/strcat: 2.29% (0.1969 => 0.2014, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 60.16% (0.0123 => 0.0197, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 7.48% (0.0254 => 0.0273, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 3.91% (0.0384 => 0.0399, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.49% (0.1438 => 0.1431, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.99% (1.1329 => 1.1554, std.dev.: 0.0251) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.50% (0.1462 => 0.1484, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.71% (0.4164 => 0.4093, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.02% (0.1369 => 0.1383, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.65% (0.0641 => 0.0624, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 24.10% (0.0195 => 0.0242, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.15% (0.0578 => 0.0554, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.30% (1.1437 => 1.1929, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.53% (0.0627 => 0.0561, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 38.89% (0.0180 => 0.0250, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.54% (0.8017 => 0.7813, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -3.23% (0.0062 => 0.0060, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 7 19:48:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 7 Nov 2012 21:48:42 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121108034842.204612A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5669?compare_to=5667&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5669, Order: 167568, Start Time: 2012-11-08 02:24:00, End Time: 2012-11-08 03:48:52 To: 5667, Order: 167562, Start Time: 2012-11-08 00:35:28, End Time: 2012-11-08 02:00:41 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (180 on baseline) Unchanged Tests: 1041 (857 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.85% (54.2638 => 56.3506, std.dev.: 0.1008) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.25% (54.5751 => 56.3506, std.dev.: 0.1008) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.87% (2.0478 => 2.1065, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4937 => 7.6672, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/hash2: 1.92% (3.1932 => 3.2545, std.dev.: 0.0100) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.08% (0.1431 => 0.1301, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.32% (0.3821 => 0.3503, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -7.93% (2.4924 => 2.2947, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.38% (0.3142 => 0.2910, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.32% (0.9542 => 0.8844, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -7.10% (0.3831 => 0.3559, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.04% (0.3891 => 0.3617, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -7.04% (0.3880 => 0.3607, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: -6.99% (0.4033 => 0.3751, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.98% (0.3896 => 0.3624, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: -6.98% (0.3812 => 0.3546, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.95% (0.3884 => 0.3614, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -6.94% (0.2160 => 0.2010, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -6.94% (0.3848 => 0.3581, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.92% (0.4176 => 0.3887, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.88% (0.3357 => 0.3126, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.72% (3.5339 => 3.2964, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.71% (0.2428 => 0.2265, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: -6.71% (16.1920 => 15.1061, std.dev.: 0.0314) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.64% (0.9852 => 0.9198, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -6.60% (7.0961 => 6.6278, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: -6.59% (9.2283 => 8.6201, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/parameter-passing: -6.59% (0.4280 => 0.3998, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.51% (0.3658 => 0.3420, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -6.50% (0.4199 => 0.3926, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.50% (0.2355 => 0.2202, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.47% (22.4056 => 20.9559, std.dev.: 0.0209) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.41% (1.0544 => 0.9868, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.40% (0.6484 => 0.6069, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.37% (1.2784 => 1.1970, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.34% (4.0323 => 3.7766, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.30% (6.7716 => 6.3450, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.30% (1.3722 => 1.2858, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.29% (1.6364 => 1.5334, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.29% (1.2300 => 1.1526, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: -6.27% (1.2515 => 1.1730, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.22% (0.4151 => 0.3893, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.19% (4.8161 => 4.5179, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.19% (1.4642 => 1.3736, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.16% (4.5069 => 4.2293, std.dev.: 0.0048) MultiSource/Applications/lemon/lemon: -6.12% (1.1450 => 1.0749, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.12% (0.1716 => 0.1611, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -6.11% (0.3406 => 0.3198, std.dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: -6.09% (1.3148 => 1.2347, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: -6.08% (0.9179 => 0.8621, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.08% (4.8802 => 4.5836, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: -6.08% (0.1761 => 0.1654, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.06% (0.5478 => 0.5146, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.06% (0.7524 => 0.7068, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.05% (0.2695 => 0.2532, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -6.05% (0.4861 => 0.4567, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -6.03% (4.3330 => 4.0716, std.dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: -6.03% (1.1530 => 1.0835, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.02% (0.5863 => 0.5510, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -6.00% (0.5849 => 0.5498, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.98% (0.2659 => 0.2500, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -5.98% (0.3481 => 0.3273, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.97% (0.7919 => 0.7446, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.96% (0.5857 => 0.5508, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.96% (14.2083 => 13.3617, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.95% (1.6474 => 1.5494, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.92% (0.3849 => 0.3621, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.91% (2.1713 => 2.0430, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.91% (0.5859 => 0.5513, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.90% (0.5575 => 0.5246, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -5.90% (15.5079 => 14.5928, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.89% (0.5805 => 0.5463, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.89% (0.3483 => 0.3278, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -5.88% (0.3025 => 0.2847, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -5.88% (0.3059 => 0.2879, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -5.88% (17.1032 => 16.0976, std.dev.: 0.0267) MultiSource/Applications/SIBsim4/SIBsim4: -5.87% (1.3864 => 1.3050, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.87% (0.3323 => 0.3128, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: -5.86% (0.4248 => 0.3999, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.86% (0.5802 => 0.5462, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.85% (0.3194 => 0.3007, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.85% (0.6304 => 0.5935, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.85% (0.6736 => 0.6342, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: -5.85% (0.4515 => 0.4251, std.dev.: 0.0011) MultiSource/Applications/lua/lua: -5.84% (4.0594 => 3.8224, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.83% (0.6297 => 0.5930, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.83% (0.6660 => 0.6272, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.82% (0.5581 => 0.5256, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.80% (0.5567 => 0.5244, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.80% (0.3931 => 0.3703, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.79% (0.5925 => 0.5582, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.78% (0.6230 => 0.5870, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -5.77% (0.3446 => 0.3247, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -5.77% (0.3621 => 0.3412, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -5.77% (2.4021 => 2.2635, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.77% (0.2548 => 0.2401, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.77% (0.6052 => 0.5703, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.76% (0.6194 => 0.5837, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.76% (0.5591 => 0.5269, std.dev.: 0.0054) MultiSource/Applications/minisat/minisat: -5.75% (0.7447 => 0.7019, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.74% (0.4916 => 0.4634, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.73% (0.5570 => 0.5251, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -5.72% (0.2989 => 0.2818, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.72% (0.3252 => 0.3066, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.71% (0.3837 => 0.3618, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.71% (0.2278 => 0.2148, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.70% (0.6260 => 0.5903, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.70% (0.7021 => 0.6621, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -5.70% (0.3581 => 0.3377, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -5.70% (0.2985 => 0.2815, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.69% (0.6446 => 0.6079, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.69% (0.5569 => 0.5252, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.69% (0.6676 => 0.6296, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -5.69% (0.3394 => 0.3201, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.68% (0.4083 => 0.3851, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.68% (0.7339 => 0.6922, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.68% (0.5705 => 0.5381, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.68% (0.6395 => 0.6032, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.67% (0.6293 => 0.5936, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.67% (0.6440 => 0.6075, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.67% (0.5999 => 0.5659, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.66% (0.5456 => 0.5147, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.66% (0.3057 => 0.2884, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.66% (0.5941 => 0.5605, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.66% (0.6189 => 0.5839, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -5.65% (34.0927 => 32.1663, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.65% (0.9557 => 0.9017, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.65% (0.5168 => 0.4876, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.64% (0.6667 => 0.6291, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.64% (0.6033 => 0.5693, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -5.62% (3.5154 => 3.3177, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/random: -5.61% (0.2939 => 0.2774, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.61% (0.2871 => 0.2710, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.59% (2.2587 => 2.1324, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: -5.59% (0.3205 => 0.3026, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -5.57% (0.6750 => 0.6374, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.57% (0.2999 => 0.2832, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.56% (5.4682 => 5.1643, std.dev.: 0.0320) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.55% (0.4813 => 0.4546, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.55% (8.0126 => 7.5683, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.51% (0.2903 => 0.2743, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -5.51% (0.3867 => 0.3654, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.50% (0.6395 => 0.6043, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.50% (0.5688 => 0.5375, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: -5.50% (0.3255 => 0.3076, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: -5.50% (2.1401 => 2.0225, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.49% (0.2385 => 0.2254, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.49% (0.2933 => 0.2772, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.44% (0.5329 => 0.5039, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -5.44% (0.2849 => 0.2694, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/except: -5.42% (0.3026 => 0.2862, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.42% (0.6681 => 0.6319, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.39% (0.4321 => 0.4088, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.36% (0.8521 => 0.8064, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.34% (1.2221 => 1.1568, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: -5.31% (0.4524 => 0.4284, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.31% (0.3016 => 0.2856, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.30% (0.3491 => 0.3306, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -5.28% (15.2527 => 14.4475, std.dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: -5.24% (18.2933 => 17.3340, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.22% (0.7198 => 0.6822, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -5.19% (0.7982 => 0.7568, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.17% (0.4427 => 0.4198, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -5.11% (0.8418 => 0.7988, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: -5.10% (0.3788 => 0.3595, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.09% (1.2210 => 1.1588, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.00% (0.2001 => 0.1901, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.99% (0.2106 => 0.2001, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: -4.89% (0.3271 => 0.3111, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.88% (0.3319 => 0.3157, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference: -4.83% (0.7779 => 0.7403, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: -4.77% (5.0226 => 4.7829, std.dev.: 0.0145) SingleSource/UnitTests/ObjC++/property-reference-object: -4.66% (0.6441 => 0.6141, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.63% (0.9077 => 0.8657, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/Hello: -4.52% (0.6347 => 0.6060, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: -3.82% (1.5610 => 1.5014, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -3.12% (20.7746 => 20.1264, std.dev.: 0.0389) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7530, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7061, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.67% (2.2633 => 2.1803, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.72% (1.3096 => 1.2871, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4684, std.dev.: 0.0055) Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 7 21:09:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 7 Nov 2012 23:09:18 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121108050918.51E2E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5670?compare_to=5665&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5670, Order: 167565, Start Time: 2012-11-08 01:53:58, End Time: 2012-11-08 05:09:27 To: 5665, Order: 167549, Start Time: 2012-11-07 21:50:09, End Time: 2012-11-08 01:06:02 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (171 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (719 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.22% (1.3510 => 1.3675, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.16% (129.9923 => 125.8781, std.dev.: 1.3469) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.84% (0.0625 => 0.0874, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.23% (0.1063 => 0.1395, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.73% (0.2969 => 0.3733, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.14% (0.1106 => 0.1384, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.93% (0.0714 => 0.0892, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.76% (0.4253 => 0.5306, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 24.11% (1.5932 => 1.9773, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.02% (0.4139 => 0.5133, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.35% (0.4994 => 0.6160, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 23.01% (0.0452 => 0.0556, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.98% (0.5900 => 0.7256, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.67% (0.0547 => 0.0671, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.62% (0.5000 => 0.6131, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.60% (0.0584 => 0.0716, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.65% (0.0822 => 0.1000, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.54% (0.1620 => 0.1969, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.52% (0.0897 => 0.1090, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 21.37% (0.0599 => 0.0727, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.35% (0.1021 => 0.1239, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.79% (0.1549 => 0.1871, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.78% (0.1107 => 0.1337, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.64% (0.1604 => 0.1935, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 20.36% (0.0948 => 0.1141, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.06% (0.0633 => 0.0760, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.04% (0.1103 => 0.1324, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.03% (0.0584 => 0.0701, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.86% (0.3903 => 0.4678, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.78% (0.0642 => 0.0769, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 19.73% (0.0821 => 0.0983, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.54% (0.1003 => 0.1199, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 19.37% (0.0604 => 0.0721, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 19.33% (0.1619 => 0.1932, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.67% (0.1462 => 0.1735, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.27% (0.0947 => 0.1120, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.12% (0.3890 => 0.4595, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.92% (0.2014 => 0.2375, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 17.82% (0.1218 => 0.1435, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.75% (1.3152 => 1.5486, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/mst/mst: 17.62% (0.0698 => 0.0821, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 17.61% (0.5826 => 0.6852, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 17.60% (0.1284 => 0.1510, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.56% (0.1088 => 0.1279, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.52% (0.2866 => 0.3368, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference-object: 17.46% (0.5889 => 0.6917, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/09-vor/vor: 17.28% (0.1505 => 0.1765, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.25% (0.2736 => 0.3208, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 17.25% (0.4029 => 0.4724, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.91% (0.3271 => 0.3824, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.90% (0.2875 => 0.3361, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/gs/gs: 16.82% (1.8794 => 2.1955, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.79% (0.4658 => 0.5440, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 16.75% (0.5546 => 0.6475, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.70% (3.5627 => 4.1575, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.62% (0.1968 => 0.2295, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.58% (0.2738 => 0.3192, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 16.58% (0.3004 => 0.3502, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.49% (0.5026 => 0.5855, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.29% (0.1160 => 0.1349, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 16.26% (0.2725 => 0.3168, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.22% (1.6211 => 1.8841, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 16.16% (0.9697 => 1.1264, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 16.12% (0.2780 => 0.3228, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 16.10% (0.2714 => 0.3151, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.05% (0.2729 => 0.3167, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 15.96% (0.2750 => 0.3189, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 15.84% (1.0781 => 1.2489, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/18-imp/imp: 15.83% (0.1421 => 0.1646, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 15.80% (0.2803 => 0.3246, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 15.80% (0.9909 => 1.1475, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.80% (0.2792 => 0.3233, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.78% (0.3930 => 0.4550, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 15.75% (0.2813 => 0.3256, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.71% (0.4361 => 0.5046, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 15.66% (0.2823 => 0.3265, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 15.65% (0.2811 => 0.3251, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.59% (0.3195 => 0.3693, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.56% (4.4195 => 5.1070, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 15.53% (0.7171 => 0.8285, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wc: 15.50% (0.3096 => 0.3576, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.49% (0.2911 => 0.3362, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.44% (2.0673 => 2.3865, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/ary3: 15.24% (0.3267 => 0.3765, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 15.15% (23.5202 => 27.0831, std.dev.: 0.0212) MultiSource/Applications/ClamAV/clamscan: 15.15% (4.2109 => 4.8487, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.14% (0.1090 => 0.1255, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 15.07% (0.3258 => 0.3749, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 14.95% (0.3317 => 0.3813, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.93% (0.3362 => 0.3864, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.91% (2.7292 => 3.1360, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.76% (1.9694 => 2.2600, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.74% (0.3060 => 0.3511, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.55% (1.9966 => 2.2872, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.50% (0.3124 => 0.3577, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 14.41% (0.3678 => 0.4208, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 14.40% (0.4146 => 0.4743, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 14.31% (0.2075 => 0.2372, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 14.31% (0.3348 => 0.3827, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.17% (0.3282 => 0.3747, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 14.12% (0.3477 => 0.3968, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 14.12% (0.3726 => 0.4252, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 14.11% (0.2566 => 0.2928, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.10% (0.3625 => 0.4136, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.04% (0.3690 => 0.4208, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/hash2: 13.76% (0.4251 => 0.4836, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 13.68% (1.4269 => 1.6221, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.66% (0.3981 => 0.4525, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.58% (0.3845 => 0.4367, std.dev.: 0.0034) MultiSource/Applications/treecc/treecc: 13.57% (0.7875 => 0.8944, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 13.09% (0.5012 => 0.5668, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 12.93% (0.3496 => 0.3948, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.91% (0.3446 => 0.3891, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.90% (0.3465 => 0.3912, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.87% (0.3488 => 0.3937, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 12.87% (2.1653 => 2.4440, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/synchronized: 12.86% (0.3469 => 0.3915, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.75% (0.3442 => 0.3881, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.72% (0.3460 => 0.3900, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 12.64% (4.6177 => 5.2015, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.55% (0.2040 => 0.2296, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/property: 12.52% (0.3650 => 0.4107, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.51% (0.1383 => 0.1556, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.49% (0.3643 => 0.4098, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 12.48% (2.1013 => 2.3635, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/parameter-passing: 12.38% (0.3724 => 0.4185, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 12.11% (0.2691 => 0.3017, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.03% (0.6435 => 0.7209, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 11.50% (5.5417 => 6.1789, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.36% (0.2068 => 0.2303, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 11.12% (0.3498 => 0.3887, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.89% (0.1028 => 0.1140, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 10.66% (0.6634 => 0.7341, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.60% (0.2737 => 0.3027, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 10.48% (0.4847 => 0.5355, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.44% (0.3084 => 0.3406, std.dev.: 0.0103) MultiSource/Applications/minisat/minisat: 9.83% (0.3336 => 0.3664, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 9.70% (0.2391 => 0.2623, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 9.70% (2.0346 => 2.2319, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.42% (0.2103 => 0.2301, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.72% (4.6926 => 5.1018, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.56% (0.5361 => 0.5820, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.55% (11.6398 => 12.6354, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.11% (0.5584 => 0.6037, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.97% (0.7426 => 0.8018, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 6.60% (11.9555 => 12.7449, std.dev.: 0.0217) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.59% (0.3792 => 0.3928, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 9.28% (0.2802 => 0.3062, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6093, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary: 5.47% (0.2122 => 0.2238, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6676, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/flops: 4.73% (15.4430 => 16.1733, std.dev.: 0.1276) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.63% (0.3693 => 0.3864, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-2: 4.49% (1.8057 => 1.8867, std.dev.: 0.0049) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6370, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2103, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2224, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3044, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2843, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5128, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5389, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5845, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.77% (2.4764 => 2.4325, std.dev.: 0.0111) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5595, std.dev.: 0.0248) SingleSource/Benchmarks/Shootout-C++/ary2: -9.53% (0.2402 => 0.2173, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9742, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7938, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9572, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8026, std.dev.: 0.0079) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.64% (0.6293 => 0.6127, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8582, std.dev.: 0.0099) SingleSource/Benchmarks/Dhrystone/fldry: -2.19% (17.2379 => 16.8602, std.dev.: 0.0701) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5790, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4954, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (105.3826 => 104.1963, std.dev.: 0.0432) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0455, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 7 21:25:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 7 Nov 2012 23:25:10 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121108052510.58B992A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5671?compare_to=5668&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5671, Order: 167571, Start Time: 2012-11-08 03:59:24, End Time: 2012-11-08 05:25:21 To: 5668, Order: 167568, Start Time: 2012-11-08 01:57:59, End Time: 2012-11-08 03:23:34 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 10 (114 on baseline) Performance Improvements: 6 (25 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 975 (835 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/gs/gs: 1.98% (4.1713 => 4.2541, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.60% (1.4851 => 1.5089, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.15% (1.2557 => 1.2701, std.dev.: 0.0050) MultiSource/Applications/d/make_dparser: 1.07% (3.3046 => 3.3400, std.dev.: 0.0107) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 8.06% (20.4601 => 22.1094, std.dev.: 0.1060) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.46% (0.3357 => 0.3473, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.34% (4.2943 => 4.4377, std.dev.: 0.0469) SingleSource/Benchmarks/Shootout-C++/except: 2.72% (0.4848 => 0.4980, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.23% (4.5136 => 4.6144, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/ffbench: 1.83% (1.4024 => 1.4281, std.dev.: 0.0068) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -3.94% (0.5175 => 0.4971, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/loader/loader: -3.14% (0.3185 => 0.3085, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.77% (1.6994 => 1.6694, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.46% (0.9025 => 0.8893, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: -2.40% (0.8792 => 0.8581, std.dev.: 0.0074) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.03% (2.6024 => 2.5756, std.dev.: 0.0046) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.94% (16.5496 => 16.7049, std.dev.: 0.0197) MultiSource/Applications/obsequi/Obsequi: -1.35% (1.0616 => 1.0473, std.dev.: 0.0126) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.17% (21.8521 => 21.8160, std.dev.: 0.7540) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.60% (0.3646 => 0.3668, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/bigfib: 0.69% (0.6062 => 0.6104, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.48% (0.3310 => 0.3359, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -0.05% (0.2014 => 0.2013, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -29.95% (0.0197 => 0.0138, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.13% (0.0427 => 0.0388, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -5.49% (0.0273 => 0.0258, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -8.65% (0.0312 => 0.0285, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -8.02% (0.0399 => 0.0367, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/casts: 0.50% (0.0202 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -36.11% (0.0216 => 0.0138, std.dev.: 0.0036) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1431 => 0.1430, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -8.21% (1.1554 => 1.0605, std.dev.: 0.0659) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.10% (0.1484 => 0.1530, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.37% (0.4093 => 0.4190, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.74% (0.1383 => 0.1407, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.17% (0.0624 => 0.0573, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -16.12% (0.0242 => 0.0203, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.23% (0.0554 => 0.0583, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.34% (1.1929 => 1.1970, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.59% (0.0561 => 0.0626, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.20% (0.0250 => 0.0197, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.08% (0.7813 => 0.7819, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 81.67% (0.0060 => 0.0109, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2315.08% (0.6332 => 15.2923, std.dev.: 0.0532) MultiSource/Benchmarks/McCat/08-main/main: 45.66% (0.1831 => 0.2667, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.30% (0.1559 => 0.1414, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1508.43% (0.3344 => 5.3786, std.dev.: 0.0197) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.29% (0.2364 => 0.3222, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel: 0.23% (0.0429 => 0.0430, std.dev.: 0.0039) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.89% (0.0224 => 0.0226, std.dev.: 0.0008) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4241, std.dev.: 0.0420) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0668, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4885, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3438, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1473, std.dev.: 0.0167) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4089, std.dev.: 0.0015) SingleSource/Regression/C/uint64_to_float: -23.96% (2.1832 => 1.6600, std.dev.: 0.0103) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 12.96% (0.0810 => 0.0915, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: 11.24% (0.1112 => 0.1237, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.09% (0.3137 => 0.3422, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.98% (0.2180 => 0.2354, std.dev.: 0.0017) MultiSource/Applications/viterbi/viterbi: 6.85% (0.1577 => 0.1685, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.22% (0.7473 => 0.7938, std.dev.: 0.0091) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.89% (0.8148 => 0.8628, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.78% (0.1885 => 0.1994, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 5.60% (0.7950 => 0.8395, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.51% (1.1606 => 1.2246, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.06% (0.6010 => 0.6314, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/moments: 4.36% (0.3645 => 0.3804, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.21% (1.4479 => 1.5089, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/hash: 4.08% (0.3800 => 0.3955, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.93% (1.1685 => 1.2144, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.80% (0.6287 => 0.6526, std.dev.: 0.0050) MultiSource/Applications/minisat/minisat: 3.44% (0.6834 => 0.7069, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.38% (1.4269 => 1.4752, std.dev.: 0.0183) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.28% (0.3717 => 0.3839, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.25% (0.3295 => 0.3402, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 3.21% (14.2605 => 14.7185, std.dev.: 0.0347) MultiSource/Applications/d/make_dparser: 3.19% (3.2366 => 3.3400, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.11% (0.9908 => 1.0216, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.09% (0.9435 => 0.9727, std.dev.: 0.0067) MultiSource/Applications/treecc/treecc: 3.07% (1.9948 => 2.0561, std.dev.: 0.0167) MultiSource/Benchmarks/nbench/nbench: 3.07% (1.1271 => 1.1617, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.00% (0.4127 => 0.4251, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 2.99% (4.1305 => 4.2541, std.dev.: 0.0156) MultiSource/Applications/SIBsim4/SIBsim4: 2.94% (1.2568 => 1.2938, std.dev.: 0.0116) MultiSource/Applications/siod/siod: 2.94% (2.2184 => 2.2837, std.dev.: 0.0116) MultiSource/Applications/ClamAV/clamscan: 2.84% (14.7684 => 15.1885, std.dev.: 0.0263) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.82% (0.4783 => 0.4918, std.dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.71% (6.6074 => 6.7864, std.dev.: 0.0362) MultiSource/Applications/JM/lencod/lencod: 2.70% (15.3280 => 15.7411, std.dev.: 0.0122) MultiSource/Applications/JM/ldecod/ldecod: 2.63% (6.7320 => 6.9093, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.63% (0.8457 => 0.8679, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.62% (0.8697 => 0.8925, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.57% (8.6476 => 8.8696, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.56% (0.8317 => 0.8530, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.54% (0.8597 => 0.8815, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.49% (4.1763 => 4.2804, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.39% (1.2526 => 1.2825, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.32% (4.4880 => 4.5921, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.29% (0.9069 => 0.9277, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.28% (0.7966 => 0.8148, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.27% (0.8331 => 0.8520, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.24% (0.8007 => 0.8186, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.18% (0.8261 => 0.8441, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.18% (0.8177 => 0.8355, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.17% (0.9074 => 0.9271, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.15% (0.8359 => 0.8539, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.13% (0.8340 => 0.8518, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.13% (0.8656 => 0.8840, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.12% (1.3279 => 1.3560, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.11% (0.8518 => 0.8698, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.08% (0.8069 => 0.8237, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.08% (0.8712 => 0.8893, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.05% (0.7932 => 0.8095, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.05% (0.9688 => 0.9887, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.03% (0.8716 => 0.8893, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.99% (0.8204 => 0.8367, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.97% (0.9039 => 0.9217, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.96% (0.8855 => 0.9029, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.96% (0.8066 => 0.8224, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.93% (0.8286 => 0.8446, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.88% (1.6386 => 1.6694, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.87% (4.4873 => 4.5714, std.dev.: 0.0297) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.86% (0.8338 => 0.8493, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.80% (0.8927 => 0.9088, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.79% (0.6586 => 0.6704, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.78% (13.1811 => 13.4159, std.dev.: 0.0232) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.75% (1.5315 => 1.5583, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.72% (0.8316 => 0.8459, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.65% (2.1401 => 2.1755, std.dev.: 0.0102) MultiSource/Applications/oggenc/oggenc: 1.50% (4.9628 => 5.0370, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.37% (0.8050 => 0.8160, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/football/football: 1.35% (0.8768 => 0.8886, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: 1.32% (1.0945 => 1.1089, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 115.58% (0.0199 => 0.0429, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/pi: 58.29% (1.5795 => 2.5002, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.43% (0.7597 => 0.8921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.47% (2.9753 => 3.4654, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.75% (2.7995 => 3.2125, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.64% (5.0261 => 5.6110, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.01% (0.3186 => 0.3473, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.50% (1.1857 => 1.2746, std.dev.: 0.0087) SingleSource/Benchmarks/McGill/queens: 7.44% (1.7056 => 1.8325, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.02% (4.7794 => 5.1149, std.dev.: 0.0307) MultiSource/Applications/SIBsim4/SIBsim4: 6.84% (3.1873 => 3.4052, std.dev.: 0.0173) SingleSource/Benchmarks/Misc/richards_benchmark: 6.61% (1.3037 => 1.3899, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.87% (4.5327 => 4.7989, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.86% (4.9686 => 5.2600, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.88% (6.2275 => 6.5317, std.dev.: 0.0339) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.70% (3.3761 => 3.5348, std.dev.: 0.0252) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.47% (4.9453 => 5.1662, std.dev.: 0.0293) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.99% (4.9469 => 5.1442, std.dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 3.90% (14.0064 => 14.5525, std.dev.: 0.0239) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.70% (1.2337 => 1.2794, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.32% (0.3587 => 0.3706, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.91% (11.5690 => 11.9055, std.dev.: 0.0125) MultiSource/Applications/siod/siod: 2.73% (3.6643 => 3.7644, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.64% (8.2783 => 8.4967, std.dev.: 0.0074) MultiSource/Applications/lambda-0_1_3/lambda: 2.62% (7.4933 => 7.6899, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/lists: 2.40% (7.3375 => 7.5133, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.35% (4.8362 => 4.9498, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.25% (4.8660 => 4.9754, std.dev.: 0.0096) SingleSource/Benchmarks/Dhrystone/dry: 2.24% (0.5081 => 0.5195, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.31% (3.5679 => 3.6148, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.31% (4.5547 => 4.6144, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.30% (2.4647 => 2.4968, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/ReedSolomon: 1.29% (8.5322 => 8.6425, std.dev.: 0.0220) MultiSource/Benchmarks/FreeBench/neural/neural: 1.28% (1.0841 => 1.0980, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.28% (1.1365 => 1.1510, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: 1.05% (2.3560 => 2.3808, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.09% (5.4641 => 4.3115, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.08% (7.2130 => 6.3417, std.dev.: 0.0662) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.89% (1.0512 => 0.9367, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: -8.54% (63.1822 => 57.7843, std.dev.: 0.1706) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.94% (4.7482 => 4.4185, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.61% (0.3269 => 0.3053, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.94% (3.7148 => 3.4943, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.85% (5.4972 => 5.1755, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.04% (5.1557 => 4.8958, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.37% (4.7449 => 4.5377, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.71% (6.0224 => 5.7990, std.dev.: 0.0291) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.13% (2.4490 => 2.3724, std.dev.: 0.0142) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.06% (28.5821 => 27.7074, std.dev.: 0.0098) MultiSource/Applications/lua/lua: -2.96% (29.8330 => 28.9500, std.dev.: 0.0288) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.88% (0.5807 => 0.5640, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.65% (2.6356 => 2.5658, std.dev.: 0.0152) MultiSource/Benchmarks/Ptrdist/ft/ft: -2.37% (0.8789 => 0.8581, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.33% (9.9065 => 9.6761, std.dev.: 0.0140) MultiSource/Applications/aha/aha: -2.23% (3.3398 => 3.2652, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.05% (11.5316 => 11.2951, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.69% (3.2169 => 3.1624, std.dev.: 0.0088) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.68% (2.3487 => 2.3093, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash2: -1.61% (3.4237 => 3.3686, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.58% (4.9994 => 4.9205, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.11% (5.6343 => 5.5718, std.dev.: 0.0103) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.57% (16.4461 => 16.7049, std.dev.: 0.0197) MultiSource/Applications/obsequi/Obsequi: 2.06% (1.0262 => 1.0473, std.dev.: 0.0126) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6885.59% (0.3123 => 21.8160, std.dev.: 0.7540) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.92% (0.2463 => 0.3668, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/bigfib: 1.56% (0.6010 => 0.6104, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.85% (0.3266 => 0.3359, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 2.23% (0.1969 => 0.2013, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 12.20% (0.0123 => 0.0138, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.90% (0.0408 => 0.0388, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.57% (0.0254 => 0.0258, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -5.63% (0.0302 => 0.0285, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.43% (0.0384 => 0.0367, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -23.33% (0.0180 => 0.0138, std.dev.: 0.0036) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.56% (0.1438 => 0.1430, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -6.39% (1.1329 => 1.0605, std.dev.: 0.0659) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 4.65% (0.1462 => 0.1530, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.62% (0.4164 => 0.4190, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.78% (0.1369 => 0.1407, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.61% (0.0641 => 0.0573, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 4.10% (0.0195 => 0.0203, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.87% (0.0578 => 0.0583, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.66% (1.1437 => 1.1970, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.16% (0.0627 => 0.0626, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.44% (0.0180 => 0.0197, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.47% (0.8017 => 0.7819, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 75.81% (0.0062 => 0.0109, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 7 21:36:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 7 Nov 2012 23:36:32 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121108053632.2B5B22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5672?compare_to=5669&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5672, Order: 167571, Start Time: 2012-11-08 04:11:54, End Time: 2012-11-08 05:36:43 To: 5669, Order: 167568, Start Time: 2012-11-08 02:24:00, End Time: 2012-11-08 03:48:52 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (179 on baseline) Unchanged Tests: 1042 (859 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 2.63% (7.4937 => 7.6907, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.57% (2.0478 => 2.1004, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hash2: 2.29% (3.1932 => 3.2663, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.15% (0.1431 => 0.1300, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.27% (0.3821 => 0.3505, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -7.74% (2.4924 => 2.2995, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.38% (0.3142 => 0.2910, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -7.15% (0.3831 => 0.3557, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -7.14% (0.3880 => 0.3603, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -7.14% (0.3812 => 0.3540, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -7.07% (0.3848 => 0.3576, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.06% (0.9542 => 0.8868, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -7.04% (0.4033 => 0.3749, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.04% (0.3891 => 0.3617, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/synchronized: -7.01% (0.3896 => 0.3623, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.95% (0.3884 => 0.3614, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.90% (0.4176 => 0.3888, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -6.85% (0.2160 => 0.2012, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -6.68% (16.1920 => 15.1109, std.dev.: 0.0134) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.63% (0.2428 => 0.2267, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -6.59% (0.4280 => 0.3998, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.57% (3.5339 => 3.3018, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: -6.55% (0.4199 => 0.3924, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -6.52% (0.3357 => 0.3138, std.dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: -6.50% (7.0961 => 6.6347, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.50% (0.9852 => 0.9212, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.46% (9.2283 => 8.6317, std.dev.: 0.0119) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.45% (0.2355 => 0.2203, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.40% (0.3658 => 0.3424, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.39% (22.4056 => 20.9729, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.38% (0.4151 => 0.3886, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: -6.33% (0.9179 => 0.8598, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.31% (0.3849 => 0.3606, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.26% (1.3722 => 1.2863, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.25% (1.6364 => 1.5341, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.25% (0.6484 => 0.6079, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.24% (4.0323 => 3.7805, std.dev.: 0.0086) SingleSource/Regression/C++/ofstream_ctor: -6.24% (0.3059 => 0.2868, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -6.23% (0.3481 => 0.3264, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.20% (6.7716 => 6.3519, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.19% (1.0544 => 0.9891, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: -6.18% (1.1530 => 1.0817, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -6.15% (1.3148 => 1.2340, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/moments: -6.14% (0.4248 => 0.3987, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.14% (4.8161 => 4.5202, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.14% (1.2784 => 1.1999, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -6.12% (0.2989 => 0.2806, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -6.11% (0.4861 => 0.4564, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.11% (0.3323 => 0.3120, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.11% (2.1713 => 2.0387, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.11% (1.2300 => 1.1549, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.07% (4.5069 => 4.2332, std.dev.: 0.0107) MultiSource/Applications/Burg/burg: -6.06% (1.2515 => 1.1756, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists: -6.05% (0.3621 => 0.3402, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.02% (0.3025 => 0.2843, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.01% (0.1796 => 0.1688, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: -6.01% (0.3446 => 0.3239, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -5.99% (1.1450 => 1.0764, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -5.99% (0.3406 => 0.3202, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: -5.98% (4.3330 => 4.0737, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.98% (0.6736 => 0.6333, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary: -5.98% (0.3394 => 0.3191, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.98% (0.3931 => 0.3696, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -5.96% (0.1761 => 0.1656, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -5.95% (0.3194 => 0.3004, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.93% (1.4642 => 1.3773, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.92% (14.2083 => 13.3673, std.dev.: 0.0130) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.91% (4.8802 => 4.5916, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.90% (0.3252 => 0.3060, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -5.90% (34.0927 => 32.0823, std.dev.: 0.0214) MultiSource/Benchmarks/Olden/bh/bh: -5.90% (0.2985 => 0.2809, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.89% (0.5857 => 0.5512, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.89% (0.3057 => 0.2877, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -5.89% (0.2871 => 0.2702, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.89% (0.1716 => 0.1615, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.87% (0.7919 => 0.7454, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/ReedSolomon: -5.85% (0.1879 => 0.1769, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.85% (0.5575 => 0.5249, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.84% (0.3837 => 0.3613, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -5.83% (0.2659 => 0.2504, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.83% (0.3483 => 0.3280, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.82% (0.2903 => 0.2734, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.82% (0.7524 => 0.7086, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.81% (1.6474 => 1.5517, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -5.80% (0.7447 => 0.7015, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.80% (0.6260 => 0.5897, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.79% (0.2695 => 0.2539, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: -5.79% (15.5079 => 14.6103, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.78% (0.6189 => 0.5831, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: -5.78% (17.1032 => 16.1140, std.dev.: 0.0171) MultiSource/Benchmarks/McCat/05-eks/eks: -5.78% (0.4515 => 0.4254, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.78% (0.5591 => 0.5268, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: -5.76% (0.6750 => 0.6361, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.76% (0.5849 => 0.5512, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.75% (0.5863 => 0.5526, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -5.74% (0.3205 => 0.3021, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.73% (0.4083 => 0.3849, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.73% (0.6230 => 0.5873, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: -5.72% (0.2849 => 0.2686, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.72% (0.5859 => 0.5524, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.72% (0.6052 => 0.5706, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: -5.71% (1.3864 => 1.3072, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.71% (0.5567 => 0.5249, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.70% (0.3491 => 0.3292, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.70% (0.5581 => 0.5263, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.70% (0.5478 => 0.5166, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.69% (0.6304 => 0.5945, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -5.68% (0.3026 => 0.2854, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -5.68% (0.3255 => 0.3070, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.68% (0.7021 => 0.6622, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.66% (0.5456 => 0.5147, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.66% (0.5570 => 0.5255, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -5.65% (0.2939 => 0.2773, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.65% (0.6446 => 0.6082, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: -5.64% (0.3581 => 0.3379, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.64% (0.9557 => 0.9018, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.64% (0.3016 => 0.2846, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.62% (0.5941 => 0.5607, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.62% (0.5802 => 0.5476, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -5.62% (3.5154 => 3.3180, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: -5.61% (0.4524 => 0.4270, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists1: -5.61% (0.3867 => 0.3650, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.61% (0.6440 => 0.6079, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.60% (0.5999 => 0.5663, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.59% (0.5329 => 0.5031, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.58% (0.6395 => 0.6038, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.58% (0.6293 => 0.5942, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.58% (0.2278 => 0.2151, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.57% (0.6297 => 0.5946, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.57% (0.2548 => 0.2406, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.57% (0.5168 => 0.4880, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.57% (0.6660 => 0.6289, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.57% (0.6194 => 0.5849, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.57% (0.4813 => 0.4545, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.57% (0.6681 => 0.6309, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.56% (0.2933 => 0.2770, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.55% (0.8521 => 0.8048, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.55% (0.6667 => 0.6297, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.54% (0.6033 => 0.5699, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.53% (0.4916 => 0.4644, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.53% (0.4321 => 0.4082, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.53% (8.0126 => 7.5697, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.52% (0.6395 => 0.6042, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.51% (0.5805 => 0.5485, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.51% (2.2587 => 2.1342, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.51% (5.4682 => 5.1670, std.dev.: 0.0018) MultiSource/Applications/lua/lua: -5.51% (4.0594 => 3.8359, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.49% (0.7339 => 0.6936, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.47% (0.2999 => 0.2835, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -5.45% (2.4021 => 2.2712, std.dev.: 0.0110) MultiSource/Applications/treecc/treecc: -5.44% (2.1401 => 2.0236, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.43% (0.5705 => 0.5395, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.43% (1.2221 => 1.1558, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: -5.42% (0.7779 => 0.7357, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.42% (0.5569 => 0.5267, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.42% (0.5925 => 0.5604, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.40% (0.7198 => 0.6809, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.37% (0.2385 => 0.2257, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -5.36% (0.6347 => 0.6007, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -5.34% (15.2527 => 14.4386, std.dev.: 0.0111) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.32% (1.2210 => 1.1560, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.31% (0.4427 => 0.4192, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -5.31% (0.3788 => 0.3587, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.27% (0.3319 => 0.3144, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: -5.23% (0.6441 => 0.6104, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: -5.22% (18.2933 => 17.3378, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.22% (0.5688 => 0.5391, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -5.06% (0.7982 => 0.7578, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.99% (0.2106 => 0.2001, std.dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: -4.98% (5.0226 => 4.7724, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: -4.94% (0.8418 => 0.8002, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: -4.83% (0.3271 => 0.3113, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.52% (0.9077 => 0.8667, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: -3.97% (1.5610 => 1.4990, std.dev.: 0.0030) SingleSource/UnitTests/Vector/constpool: -3.16% (20.7746 => 20.1185, std.dev.: 0.0470) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7554, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1723, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7060, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.88% (2.2633 => 2.1755, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.50% (6.5735 => 6.4750, std.dev.: 0.0008) Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 8 00:33:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 8 Nov 2012 02:33:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121108083320.DB28D2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5673?compare_to=5650&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5673, Order: 167527, Start Time: 2012-11-07 10:14:38, End Time: 2012-11-08 08:33:30 To: 5650, Order: 167445, Start Time: 2012-11-06 10:35:51, End Time: 2012-11-07 09:44:24 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 1 (43 on baseline) New Passes: 0 (12 on baseline) Performance Regressions: 0 (170 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 49 (7 on baseline) Unchanged Tests: 991 (639 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -9.44% (3.2221 => 2.9178, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.11% (56.5070 => 55.8792, std.dev.: 0.2049) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/ClamAV/clamscan: 0.80% (27.3376 => 27.5569, std.dev.: 0.0353) MultiSource/Applications/JM/ldecod/ldecod: -0.20% (6.3215 => 6.3089, std.dev.: 0.0326) MultiSource/Applications/JM/lencod/lencod: -0.02% (19.5735 => 19.5699, std.dev.: 0.0226) MultiSource/Applications/oggenc/oggenc: - (0.0020 => 0.0020) MultiSource/Applications/siod/siod: -1.23% (1.5824 => 1.5629, std.dev.: 0.0125) MultiSource/Applications/sqlite3/sqlite3: -0.27% (0.5237 => 0.5223, std.dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: 6.36% (50.0386 => 53.2195, std.dev.: 0.0773) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 0.32% (0.8542 => 0.8569, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 0.15% (5.0524 => 5.0600, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 0.71% (10.4671 => 10.5417, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -0.75% (1.4197 => 1.4090, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 1.28% (0.3277 => 0.3319, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.03% (0.0282 => 0.0299, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 0.20% (1.7320 => 1.7354, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/voronoi/voronoi: -0.72% (0.1933 => 0.1919, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.00% (0.0020 => 0.0019, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: - (0.0020 => 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -0.16% (0.2547 => 0.2543, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.41% (1.7234 => 1.7304, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 0.04% (5.2237 => 5.2256, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.50% (1.1053 => 1.1108, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: -0.57% (0.2979 => 0.2962, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0020 => 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/ClamAV/clamscan: - (0.0001 => 0.0001) MultiSource/Applications/JM/ldecod/ldecod: - (0.0001 => 0.0001) MultiSource/Applications/JM/lencod/lencod: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Applications/siod/siod: - (0.0001 => 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.48% (0.0416 => 0.0418, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.83% (0.0709 => 0.0722, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: - (0.0001 => 0.0001) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8545 => 499.8510, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/voronoi/voronoi: - (0.0001 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: - (0.0001 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: - (0.0001 => 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/nbench/nbench: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/nbench/nbench MultiSource/Applications/ClamAV/clamscan: 24.27% (22.1758 => 27.5569, std.dev.: 0.0353) MultiSource/Applications/JM/ldecod/ldecod: -39.55% (10.4361 => 6.3089, std.dev.: 0.0326) MultiSource/Applications/JM/lencod/lencod: -10.79% (21.9371 => 19.5699, std.dev.: 0.0226) MultiSource/Applications/oggenc/oggenc: -99.97% (5.7591 => 0.0020) MultiSource/Applications/siod/siod: -31.96% (2.2969 => 1.5629, std.dev.: 0.0125) MultiSource/Applications/sqlite3/sqlite3: -96.96% (17.1811 => 0.5223, std.dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: -15.85% (63.2438 => 53.2195, std.dev.: 0.0773) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.78% (0.8101 => 0.8569, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.33% (4.9449 => 5.0600, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 49.44% (7.0540 => 10.5417, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -8.60% (1.5415 => 1.4090, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -31.97% (0.4879 => 0.3319, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.55% (6.6874 => 0.0299, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -67.58% (5.3526 => 1.7354, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/voronoi/voronoi: -28.93% (0.2700 => 0.1919, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -99.94% (2.9384 => 0.0019, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -99.82% (1.1194 => 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -19.96% (0.3177 => 0.2543, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -67.87% (5.3855 => 1.7304, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.47% (5.0018 => 5.2256, std.dev.: 0.0068) MultiSource/Benchmarks/nbench/nbench: -74.98% (1.1840 => 0.2962, std.dev.: 0.0003) New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/nbench/nbench SingleSource/Benchmarks/Misc-C++/Large/sphereflake MultiSource/Applications/ClamAV/clamscan: -99.94% (0.1629 => 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -99.92% (0.1298 => 0.0001) MultiSource/Applications/siod/siod: -100.00% (3.2827 => 0.0001) MultiSource/Applications/sqlite3/sqlite3: -100.00% (4.6441 => 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -100.00% (2.3135 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -98.00% (0.0050 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -99.96% (0.2497 => 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -50.00% (0.0002 => 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -75.00% (0.0004 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -99.97% (0.3987 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 44224.82% (1.1277 => 499.8510, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/voronoi/voronoi: -99.97% (0.3070 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -100.00% (2.6546 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -100.00% (2.6778 => 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -100.00% (4.5009 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -99.80% (0.0506 => 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -97.30% (0.0037 => 0.0001) MultiSource/Benchmarks/nbench/nbench: -100.00% (11.6436 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -9.99% (3.2416 => 2.9178, std.dev.: 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 190.07% (0.5229 => 1.5168, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 11.57% (14.9895 => 16.7231, std.dev.: 0.0157) MultiSource/Applications/kimwitu++/kc: 35.75% (14.1553 => 19.2161, std.dev.: 0.0071) MultiSource/Benchmarks/MallocBench/gs/gs: 12.35% (4.1105 => 4.6181, std.dev.: 0.0193) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.52% (3.4629 => 5.8357, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 62.12% (0.6222 => 1.0087, std.dev.: 0.0013) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3840500.00% (0.0001 => 3.8406, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11204000.00% (0.0001 => 11.2041, std.dev.: 0.0516) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 66300.00% (0.0001 => 0.0664, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10002600.00% (0.0001 => 10.0027, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488100.00% (0.0001 => 5.4882, std.dev.: 0.0298) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 50.85% (0.1056 => 0.1593, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 40.62% (0.0746 => 0.1049, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 37.85% (0.1432 => 0.1974, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/almabench: 37.53% (0.0730 => 0.1004, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Oscar: 23.43% (0.0636 => 0.0785, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 19.97% (0.2554 => 0.3064, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 19.95% (0.1584 => 0.1900, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.54% (0.1566 => 0.1872, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 19.23% (0.1175 => 0.1401, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 18.79% (0.0793 => 0.0942, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.44% (8.1363 => 9.6363, std.dev.: 0.0047) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 17.96% (0.1125 => 0.1327, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 17.49% (0.1555 => 0.1827, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.42% (0.0798 => 0.0937, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.13% (0.0648 => 0.0759, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.86% (0.0842 => 0.0984, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.59% (0.0675 => 0.0787, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bisort/bisort: 16.29% (0.0614 => 0.0714) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.05% (0.0953 => 0.1106, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.64% (0.2065 => 0.2388, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.58% (0.0770 => 0.0890, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.58% (0.0886 => 0.1024, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 15.38% (0.1151 => 0.1328, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 15.27% (0.0871 => 0.1004, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.23% (0.8172 => 0.9417, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.93% (0.0730 => 0.0839, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 14.75% (0.1695 => 0.1945, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.43% (0.2107 => 0.2411, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.32% (0.3121 => 0.3568, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.19% (0.1029 => 0.1175, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 14.02% (0.1163 => 0.1326, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/matrix: 13.94% (0.0818 => 0.0932, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.84% (0.5981 => 0.6809, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.76% (0.1337 => 0.1521, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.65% (0.1062 => 0.1207, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.63% (0.2758 => 0.3134, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.56% (0.2271 => 0.2579, std.dev.: 0.0032) MultiSource/Applications/Burg/burg: 13.34% (1.1642 => 1.3195, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.19% (0.0834 => 0.0944, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.07% (0.1117 => 0.1263, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/health/health: 13.01% (0.1268 => 0.1433) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.01% (0.1906 => 0.2154, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 12.97% (0.7115 => 0.8038, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 12.90% (0.7433 => 0.8392, std.dev.: 0.0054) SingleSource/Benchmarks/McGill/chomp: 12.87% (0.1655 => 0.1868, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.62% (0.5569 => 0.6272, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.61% (0.5860 => 0.6599, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.53% (0.0838 => 0.0943, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.53% (0.1940 => 0.2183, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.45% (14.3668 => 16.1550, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.33% (0.9765 => 1.0969, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 12.27% (0.3423 => 0.3843, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.22% (0.4615 => 0.5179, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 12.01% (0.7835 => 0.8776, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.94% (0.3441 => 0.3852, std.dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 11.87% (0.3109 => 0.3478, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.54% (0.5105 => 0.5694, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.46% (0.1510 => 0.1683, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.41% (0.1236 => 0.1377, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.37% (0.1143 => 0.1273, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.33% (1.3050 => 1.4529, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 11.14% (3.8723 => 4.3038, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.05% (0.1032 => 0.1146, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.00% (4.2646 => 4.7338, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.98% (0.3307 => 0.3670, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.86% (0.6675 => 0.7400, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 10.86% (3.3354 => 3.6975, std.dev.: 0.0141) SingleSource/UnitTests/ObjC/exceptions-4: 10.81% (0.3543 => 0.3926, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 10.80% (0.3927 => 0.4351, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.45% (0.3473 => 0.3836, std.dev.: 0.0026) MultiSource/Applications/treecc/treecc: 10.44% (2.0273 => 2.2390, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.42% (0.5020 => 0.5543, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-2: 10.32% (0.3497 => 0.3858, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.32% (0.3886 => 0.4287, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.30% (0.3543 => 0.3908, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/synchronized: 10.28% (0.3561 => 0.3927, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.24% (0.3516 => 0.3876, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 10.19% (0.3180 => 0.3504, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 10.17% (10.3673 => 11.4221, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/exceptions: 10.16% (0.3828 => 0.4217, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.07% (0.3694 => 0.4066, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash: 9.98% (0.4289 => 0.4717, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.94% (0.1892 => 0.2080, std.dev.: 0.0027) MultiSource/Applications/hbd/hbd: 9.93% (1.5603 => 1.7152, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.92% (1.5859 => 1.7432, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 9.88% (0.6456 => 0.7094, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.87% (0.1044 => 0.1147, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 9.79% (1.0722 => 1.1772, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.78% (3.8922 => 4.2728, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 9.68% (0.4299 => 0.4715, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.64% (0.8067 => 0.8845, std.dev.: 0.0081) MultiSource/Benchmarks/mafft/pairlocalalign: 9.63% (9.4845 => 10.3981, std.dev.: 0.0136) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.57% (0.6450 => 0.7067, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Puzzle: 9.54% (0.1268 => 0.1389, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.49% (0.2603 => 0.2850, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.39% (2.2024 => 2.4091, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.37% (0.3865 => 0.4227, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.26% (0.1695 => 0.1852, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.26% (0.4203 => 0.4592, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 9.24% (0.4620 => 0.5047, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.21% (0.4636 => 0.5063, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: 9.21% (0.3422 => 0.3737, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 9.20% (0.8921 => 0.9742, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.20% (1.4186 => 1.5491, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.19% (0.4103 => 0.4480, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.17% (2.2022 => 2.4041, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.11% (1.1861 => 1.2942, std.dev.: 0.0029) SingleSource/UnitTests/SignlessTypes/rem: 8.92% (0.1144 => 0.1246, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.81% (0.2430 => 0.2644, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 8.81% (0.6030 => 0.6561, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 8.79% (0.7326 => 0.7970, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 8.74% (0.5925 => 0.6443, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists1: 8.71% (0.3684 => 0.4005, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 8.59% (0.3387 => 0.3678, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 8.49% (0.3603 => 0.3909, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 8.46% (0.3379 => 0.3665, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.36% (0.2905 => 0.3148, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: 8.34% (0.1463 => 0.1585, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 8.30% (0.4048 => 0.4384, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.15% (0.3826 => 0.4138, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.96% (0.2725 => 0.2942, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.95% (0.2756 => 0.2975, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.94% (0.3162 => 0.3413, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.86% (0.3650 => 0.3937, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.78% (0.2891 => 0.3116, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.77% (0.2831 => 0.3051, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.74% (0.2714 => 0.2924, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.73% (0.2793 => 0.3009, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.58% (2.0665 => 2.2231, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 7.56% (0.2871 => 0.3088, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 7.49% (0.3232 => 0.3474, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 7.37% (0.3283 => 0.3525, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.33% (0.3098 => 0.3325, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.28% (0.4064 => 0.4360, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.23% (0.2877 => 0.3085, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 7.14% (0.3052 => 0.3270, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.14% (0.2872 => 0.3077, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 7.13% (0.2049 => 0.2195, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.10% (1.2842 => 1.3754, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/random: 7.00% (0.2802 => 0.2998, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.38% (0.3136 => 0.3336, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 5.98% (0.3092 => 0.3277, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 5.97% (0.3282 => 0.3478, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.69% (0.3427 => 0.3622, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.27% (0.3131 => 0.3296, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.96% (0.3935 => 0.4091, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.78% (0.3817 => 0.3923, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.65% (1.1145 => 1.3001, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: 13.89% (6.6465 => 7.5699, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.92% (1.1396 => 1.2526, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.92% (1.7254 => 1.8793, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 8.11% (0.9505 => 1.0276, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3688, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.43% (0.3463 => 0.3651, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.91% (4.2280 => 4.3934, std.dev.: 0.0101) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.84% (8.6802 => 8.9269, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.51% (1.0313 => 1.0572, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 2.03% (0.8333 => 0.8502, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2197, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: 1.16% (5.9798 => 6.0494, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.10% (3.6395 => 3.6794, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5796, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -75.54% (0.8651 => 0.2116, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -73.46% (5.2763 => 1.4004, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -45.93% (0.1622 => 0.0877, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -12.11% (0.1330 => 0.1169, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -9.71% (1.7609 => 1.5899, std.dev.: 0.0090) SingleSource/UnitTests/Vector/constpool: -9.13% (54.1659 => 49.2224, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.49% (7.9617 => 7.8428, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.33% (0.0628 => 0.0381, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7636, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: -18.56% (0.2161 => 0.1760, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -16.05% (1.6925 => 1.4208, std.dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.96% (32.5116 => 28.9473, std.dev.: 0.0034) MultiSource/Benchmarks/NPB-serial/is/is: -10.96% (9.5636 => 8.5153, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -10.87% (1.5373 => 1.3702, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.14% (1.5660 => 1.4229, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.26% (19.9488 => 18.3010, std.dev.: 0.0195) MultiSource/Benchmarks/FreeBench/distray/distray: -7.16% (0.1592 => 0.1478, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.08% (1.8329 => 1.7031, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.32% (1.2373 => 1.1591, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -5.97% (0.4808 => 0.4521, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.18% (1.6805 => 1.5935, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -4.87% (1.5835 => 1.5064, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.16% (0.9957 => 0.9543, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.77% (1.3677 => 1.3162, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -3.23% (5.0483 => 4.8851, std.dev.: 0.0013) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.83% (10.2830 => 10.0945, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6759, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -1.78% (85.0658 => 83.5510, std.dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (8.1563 => 8.0204, std.dev.: 0.0088) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5116, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0034) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.54% (1.1048 => 1.1108, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -99.97% (7.1582 => 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: -99.86% (0.0720 => 0.0001) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -65.88% (0.2116 => 0.0722, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 2.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 8 01:16:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 8 Nov 2012 03:16:43 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121108091643.3ACE22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5674?compare_to=5670&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5674, Order: 167571, Start Time: 2012-11-08 05:57:19, End Time: 2012-11-08 09:16:53 To: 5670, Order: 167565, Start Time: 2012-11-08 01:53:58, End Time: 2012-11-08 05:09:27 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (173 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1042 (718 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.28% (0.0625 => 0.0883, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.55% (0.1063 => 0.1409, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.17% (0.2969 => 0.3746, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.82% (0.4253 => 0.5351, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.68% (0.1106 => 0.1390, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.27% (0.4139 => 0.5185, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.10% (0.5900 => 0.7322, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.97% (0.4994 => 0.6191, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 23.89% (0.0452 => 0.0560, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 23.64% (1.5932 => 1.9699, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.58% (0.0475 => 0.0587, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.53% (0.0714 => 0.0882, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.12% (0.0584 => 0.0719, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.66% (0.5000 => 0.6133, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.19% (0.0897 => 0.1096, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.16% (0.1620 => 0.1979, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.14% (0.1021 => 0.1247, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.13% (0.1107 => 0.1352, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 21.69% (0.0581 => 0.0707, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.89% (0.0584 => 0.0706, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 20.89% (0.0948 => 0.1146, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.67% (0.1103 => 0.1331, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.52% (0.0541 => 0.0652, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.40% (0.0642 => 0.0773, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.40% (0.0495 => 0.0596, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.37% (0.3903 => 0.4698, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/health/health: 20.34% (0.0821 => 0.0988, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.34% (0.1003 => 0.1207, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.14% (0.1549 => 0.1861, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.07% (0.0822 => 0.0987, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.01% (0.1604 => 0.1925, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 19.95% (0.1619 => 0.1942, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.02% (0.1462 => 0.1740, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 18.90% (0.0947 => 0.1126, std.dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 18.81% (0.0808 => 0.0960, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.66% (0.3890 => 0.4616, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.64% (0.2736 => 0.3246, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.56% (0.0582 => 0.0690, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 18.47% (0.1218 => 0.1443, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 18.21% (0.5826 => 0.6887, std.dev.: 0.0140) MultiSource/Benchmarks/Olden/mst/mst: 18.19% (0.0698 => 0.0825, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.17% (0.2014 => 0.2380, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 17.86% (0.5889 => 0.6941, std.dev.: 0.0124) MultiSource/Applications/spiff/spiff: 17.85% (0.4029 => 0.4748, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.83% (0.1088 => 0.1282, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.82% (1.3152 => 1.5496, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/09-vor/vor: 17.67% (0.1505 => 0.1771, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.48% (0.2866 => 0.3367, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 17.24% (0.5546 => 0.6502, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/gs/gs: 17.22% (1.8794 => 2.2030, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.17% (0.1968 => 0.2306, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.11% (0.5026 => 0.5886, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.10% (3.5627 => 4.1719, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.92% (0.4658 => 0.5446, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.90% (0.1160 => 0.1356, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.86% (1.6211 => 1.8944, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.59% (0.2875 => 0.3352, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.57% (0.3271 => 0.3813, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.46% (0.3930 => 0.4577, std.dev.: 0.0030) SingleSource/Regression/C++/ofstream_ctor: 16.44% (0.3004 => 0.3498, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.44% (0.2738 => 0.3188, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 16.40% (0.9697 => 1.1287, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 16.33% (0.1421 => 0.1653, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.14% (0.4361 => 0.5065, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 16.13% (1.0781 => 1.2520, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 15.93% (0.2725 => 0.3159, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 15.92% (0.2714 => 0.3146, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 15.90% (4.2109 => 4.8806, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.90% (4.4195 => 5.1220, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: 15.89% (0.1284 => 0.1488, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.87% (0.2729 => 0.3162, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.81% (0.3195 => 0.3700, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.76% (2.7292 => 3.1594, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: 15.76% (0.2780 => 0.3218, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 15.75% (0.2750 => 0.3183, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 15.72% (0.7171 => 0.8298, std.dev.: 0.0203) MultiSource/Applications/hexxagon/hexxagon: 15.66% (0.9909 => 1.1461, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/except: 15.65% (0.2811 => 0.3251, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 15.59% (0.2803 => 0.3240, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.56% (0.2911 => 0.3364, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.47% (0.2792 => 0.3224, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 15.44% (0.2823 => 0.3259, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.40% (0.3488 => 0.4025, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.39% (1.9694 => 2.2725, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/wc: 15.37% (0.3096 => 0.3572, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 15.36% (0.2813 => 0.3245, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.30% (2.0673 => 2.3835, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 15.26% (23.5202 => 27.1087, std.dev.: 0.6718) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.04% (1.9966 => 2.2969, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 14.97% (0.3267 => 0.3756, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.90% (0.3362 => 0.3863, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 14.86% (0.4146 => 0.4762, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 14.79% (0.3258 => 0.3740, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.77% (0.1090 => 0.1251, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 14.74% (0.3317 => 0.3806, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 14.60% (0.2075 => 0.2378, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.51% (0.3060 => 0.3504, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 14.34% (0.2566 => 0.2934, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.30% (0.3845 => 0.4395, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/moments: 14.30% (0.3678 => 0.4204, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.28% (0.3124 => 0.3570, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 14.16% (0.3348 => 0.3822, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 14.16% (1.4269 => 1.6289, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sieve: 14.14% (0.3726 => 0.4253, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.11% (0.3282 => 0.3745, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 14.09% (0.4251 => 0.4850, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.96% (0.3625 => 0.4131, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 13.81% (0.3477 => 0.3957, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 13.73% (0.3496 => 0.3976, std.dev.: 0.0029) MultiSource/Applications/treecc/treecc: 13.73% (0.7875 => 0.8956, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-4: 13.68% (0.3465 => 0.3939, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/exceptions-2: 13.61% (0.3446 => 0.3915, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/trivial-interface: 13.60% (0.3442 => 0.3910, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.59% (0.3981 => 0.4522, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.58% (0.3690 => 0.4191, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/synchronized: 13.55% (0.3469 => 0.3939, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 13.49% (0.5012 => 0.5688, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 13.47% (0.3460 => 0.3926, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/property: 13.34% (0.3650 => 0.4137, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/exceptions: 13.29% (0.3643 => 0.4127, std.dev.: 0.0094) MultiSource/Applications/JM/lencod/lencod: 13.16% (4.6177 => 5.2255, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/parameter-passing: 13.16% (0.3724 => 0.4214, std.dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 13.07% (2.1653 => 2.4484, std.dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: 12.94% (2.1013 => 2.3733, std.dev.: 0.0826) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.75% (0.2040 => 0.2300, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.51% (0.1383 => 0.1556, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 12.45% (0.2691 => 0.3026, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 11.96% (5.5417 => 6.2045, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.72% (0.6435 => 0.7189, std.dev.: 0.0032) MultiSource/Applications/siod/siod: 11.49% (0.6634 => 0.7396, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.38% (0.1028 => 0.1145, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 11.32% (0.3498 => 0.3894, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.00% (0.2737 => 0.3038, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.93% (0.2068 => 0.2294, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.89% (0.3084 => 0.3420, std.dev.: 0.0098) MultiSource/Applications/minisat/minisat: 10.82% (0.3336 => 0.3697, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 10.63% (0.4847 => 0.5362, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 10.29% (0.2391 => 0.2637, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.08% (0.2103 => 0.2315, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 9.90% (2.0346 => 2.2360, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.88% (4.6926 => 5.1095, std.dev.: 0.0064) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.80% (11.6398 => 12.6642, std.dev.: 0.2569) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.79% (0.5361 => 0.5832, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.31% (0.7426 => 0.8043, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.09% (0.5584 => 0.6036, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 6.78% (11.9555 => 12.7659, std.dev.: 0.0180) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.32% (0.3792 => 0.3956, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 65.31% (0.2162 => 0.3574, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.49% (0.2802 => 0.3068, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6123, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.47% (0.3693 => 0.3932, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (12.0509 => 12.6673, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-2: 4.78% (1.8057 => 1.8921, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1670, std.dev.: 0.1483) SingleSource/Benchmarks/Dhrystone/dry: 3.01% (14.0481 => 14.4712, std.dev.: 0.0806) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1966, std.dev.: 0.0143) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.72% (3.1722 => 3.2268, std.dev.: 0.0057) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3067, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2840, std.dev.: 0.0051) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5922, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.78% (25.4195 => 16.5786, std.dev.: 0.0115) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9777, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8015, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -6.83% (0.2402 => 0.2238, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8068, std.dev.: 0.1440) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7734, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.80% (17.2379 => 16.7557, std.dev.: 0.0792) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.20% (41.7953 => 40.8765, std.dev.: 0.3456) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.11% (0.6293 => 0.6160, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5752, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4959, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1444, std.dev.: 0.0774) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0463, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 8 01:18:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 8 Nov 2012 03:18:20 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121108091820.1340A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5675?compare_to=5671&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5675, Order: 167573, Start Time: 2012-11-08 07:52:03, End Time: 2012-11-08 09:18:30 To: 5671, Order: 167571, Start Time: 2012-11-08 03:59:24, End Time: 2012-11-08 05:25:21 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 5 (98 on baseline) Performance Improvements: 4 (24 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 982 (852 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.30% (0.3090 => 0.3192, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.24% (0.8581 => 0.8859, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.09% (1.3942 => 1.4373, std.dev.: 0.0134) MultiSource/Benchmarks/BitBench/five11/five11: 1.94% (5.5861 => 5.6944, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.24% (2.9126 => 2.9487, std.dev.: 0.0123) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -4.88% (0.3422 => 0.3255, std.dev.: 0.0064) MultiSource/Applications/d/make_dparser: -1.92% (3.3400 => 3.2759, std.dev.: 0.0211) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -7.75% (1.0856 => 1.0015, std.dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.45% (4.6144 => 4.5477, std.dev.: 0.0239) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.38% (16.7049 => 16.6416, std.dev.: 0.0244) MultiSource/Applications/obsequi/Obsequi: 0.68% (1.0473 => 1.0544, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.81% (21.8160 => 21.6389, std.dev.: 0.1312) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.68% (0.3668 => 0.3693, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: -0.72% (0.6104 => 0.6060, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.06% (0.3359 => 0.3357, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: 0.30% (0.2013 => 0.2019, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 26.81% (0.0138 => 0.0175, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.84% (0.0388 => 0.0399, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 27.52% (0.0258 => 0.0329, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -13.33% (0.0285 => 0.0247, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -6.27% (0.0367 => 0.0344, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/casts: -39.41% (0.0203 => 0.0123, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/test1: 37.68% (0.0138 => 0.0190, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.70% (0.1430 => 0.1440, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.89% (1.0605 => 1.0805, std.dev.: 0.0523) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -6.08% (0.1530 => 0.1437, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.29% (0.4190 => 0.4202, std.dev.: 0.0192) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.50% (0.1407 => 0.1400, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.93% (0.0573 => 0.0607, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.46% (0.0203 => 0.0198, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.17% (0.0583 => 0.0584, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.59% (1.1970 => 1.1899, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.07% (0.0626 => 0.0588, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 10.66% (0.0197 => 0.0218, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.09% (0.7819 => 0.7734, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -18.35% (0.0109 => 0.0089, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2298.23% (0.6332 => 15.1856, std.dev.: 0.0408) MultiSource/Benchmarks/McCat/08-main/main: 47.41% (0.1831 => 0.2699, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.95% (0.1559 => 0.1435, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1491.63% (0.3344 => 5.3224, std.dev.: 0.0444) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.77% (0.2364 => 0.3257, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: 3.03% (0.0429 => 0.0442, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.12% (0.0224 => 0.0231, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -27.83% (0.0230 => 0.0166, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4228, std.dev.: 0.0434) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0700, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4956, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3400, std.dev.: 0.0150) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1296, std.dev.: 0.0166) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4078, std.dev.: 0.0009) SingleSource/Regression/C/uint64_to_float: -23.53% (2.1832 => 1.6694, std.dev.: 0.0015) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.32% (0.0810 => 0.0926, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.26% (0.0848 => 0.0952, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 10.79% (0.1112 => 0.1232, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.08% (0.1157 => 0.1262, std.dev.: 0.0016) MultiSource/Applications/viterbi/viterbi: 6.85% (0.1577 => 0.1685, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.40% (0.1983 => 0.2110, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.04% (0.2240 => 0.2353, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.34% (0.8148 => 0.8502, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.08% (0.3115 => 0.3242, std.dev.: 0.0025) MultiSource/Applications/hbd/hbd: 3.70% (1.4269 => 1.4797, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.68% (0.4127 => 0.4279, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.46% (0.3295 => 0.3409, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash2: 3.35% (0.4125 => 0.4263, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.32% (0.7473 => 0.7721, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.30% (1.1685 => 1.2071, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.22% (1.4479 => 1.4945, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.06% (0.8716 => 0.8983, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.93% (0.3657 => 0.3764, std.dev.: 0.0039) MultiSource/Applications/treecc/treecc: 2.88% (1.9948 => 2.0523, std.dev.: 0.0174) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.67% (6.6074 => 6.7837, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.52% (0.8048 => 0.8251, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.46% (0.8177 => 0.8378, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 2.43% (1.2568 => 1.2873, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.35% (0.8007 => 0.8195, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.32% (0.8611 => 0.8811, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 2.28% (14.2605 => 14.5858, std.dev.: 0.0417) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.26% (0.9069 => 0.9274, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.23% (0.8597 => 0.8789, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.22% (0.9688 => 0.9903, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.17% (0.8069 => 0.8244, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 2.17% (0.6834 => 0.6982, std.dev.: 0.0034) MultiSource/Applications/lua/lua: 2.14% (3.8189 => 3.9005, std.dev.: 0.0229) MultiSource/Applications/ClamAV/clamscan: 2.13% (14.7684 => 15.0823, std.dev.: 0.0460) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.11% (0.8050 => 0.8220, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.08% (0.9074 => 0.9263, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.07% (0.8340 => 0.8513, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.07% (4.1763 => 4.2628, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.07% (0.8457 => 0.8632, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.07% (0.8656 => 0.8835, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.04% (13.1811 => 13.4502, std.dev.: 0.0469) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.03% (0.7966 => 0.8128, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.98% (0.8885 => 0.9061, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.98% (0.8086 => 0.8246, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.97% (0.7932 => 0.8088, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 1.91% (15.3280 => 15.6212, std.dev.: 0.0538) MultiSource/Applications/hexxagon/hexxagon: 1.91% (0.9810 => 0.9997, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.88% (0.8518 => 0.8678, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.87% (0.8338 => 0.8494, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.84% (0.8805 => 0.8967, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.81% (0.8359 => 0.8510, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.80% (0.9039 => 0.9202, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.77% (0.8420 => 0.8569, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.76% (0.8712 => 0.8865, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.71% (0.8286 => 0.8428, std.dev.: 0.0017) MultiSource/Applications/siod/siod: 1.67% (2.2184 => 2.2554, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.62% (0.8316 => 0.8451, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.61% (0.8927 => 0.9071, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.56% (0.8855 => 0.8993, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.47% (4.4880 => 4.5540, std.dev.: 0.0255) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.46% (2.1401 => 2.1714, std.dev.: 0.0061) MultiSource/Applications/lambda-0_1_3/lambda: 1.34% (0.7557 => 0.7658, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.19% (1.2423 => 1.2571, std.dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: 1.03% (2.3764 => 2.4009, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 93.47% (0.0199 => 0.0385, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/pi: 58.39% (1.5795 => 2.5018, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.42% (2.9753 => 3.4638, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.95% (0.7597 => 0.8809, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.41% (2.7995 => 3.2028, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.58% (5.0261 => 5.6083, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.03% (1.1857 => 1.2809, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 7.08% (1.7056 => 1.8264, std.dev.: 0.0143) MultiSource/Applications/SIBsim4/SIBsim4: 6.35% (3.1873 => 3.3897, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/richards_benchmark: 6.23% (1.3037 => 1.3849, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.89% (4.9686 => 5.2612, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.87% (4.5327 => 4.7988, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.56% (3.3761 => 3.5301, std.dev.: 0.0349) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.53% (6.2275 => 6.5096, std.dev.: 0.0706) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.20% (4.9453 => 5.1530, std.dev.: 0.0250) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.10% (4.9469 => 5.1496, std.dev.: 0.0087) MultiSource/Applications/hexxagon/hexxagon: 3.96% (14.0064 => 14.5604, std.dev.: 0.1847) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.54% (1.3882 => 1.4373, std.dev.: 0.0134) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.83% (1.2337 => 1.2686, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.83% (11.5690 => 11.8959, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 2.74% (7.4933 => 7.6988, std.dev.: 0.0395) MultiSource/Applications/siod/siod: 2.64% (3.6643 => 3.7609, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.24% (4.8660 => 4.9752, std.dev.: 0.0226) SingleSource/Benchmarks/Dhrystone/dry: 2.05% (0.5081 => 0.5185, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash: 1.87% (0.6205 => 0.6321, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.69% (4.8362 => 4.9178, std.dev.: 0.0244) MultiSource/Benchmarks/BitBench/five11/five11: 1.63% (5.6030 => 5.6944, std.dev.: 0.0116) SingleSource/Benchmarks/Stanford/FloatMM: 1.58% (0.8807 => 0.8946, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/lists: 1.56% (7.3375 => 7.4520, std.dev.: 0.0350) SingleSource/Benchmarks/Misc/ReedSolomon: 1.37% (8.5322 => 8.6487, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.34% (2.9096 => 2.9487, std.dev.: 0.0123) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.31% (2.4647 => 2.4969, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/power/power: 1.12% (1.2061 => 1.2196, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: 1.09% (1.0841 => 1.0959, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 1.05% (2.3560 => 2.3808, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.84% (5.4641 => 4.3255, std.dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.72% (1.0512 => 0.9280, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/chomp: -10.71% (1.1216 => 1.0015, std.dev.: 0.0166) MultiSource/Benchmarks/mafft/pairlocalalign: -8.53% (63.1822 => 57.7932, std.dev.: 0.1899) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.84% (4.7482 => 4.4233, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.15% (0.3269 => 0.3068, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.99% (3.7148 => 3.4924, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.93% (5.4972 => 5.1712, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.04% (5.1557 => 4.8957, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.39% (4.7449 => 4.5368, std.dev.: 0.0090) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (28.5821 => 27.6952, std.dev.: 0.0165) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.94% (0.5807 => 0.5636, std.dev.: 0.0016) MultiSource/Applications/lua/lua: -2.77% (29.8330 => 29.0070, std.dev.: 0.0533) MultiSource/Benchmarks/Olden/bisort/bisort: -2.76% (0.6636 => 0.6453, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.68% (2.6356 => 2.5649, std.dev.: 0.0154) MultiSource/Applications/aha/aha: -2.47% (3.3398 => 3.2573, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.41% (2.4490 => 2.3900, std.dev.: 0.0226) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.25% (9.9065 => 9.6837, std.dev.: 0.0358) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.96% (11.5316 => 11.3053, std.dev.: 0.0215) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.95% (3.2169 => 3.1541, std.dev.: 0.0123) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.91% (1.2822 => 1.2577, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/hash2: -1.47% (3.4237 => 3.3733, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.46% (2.3487 => 2.3145, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.18% (5.6343 => 5.5679, std.dev.: 0.0124) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.19% (16.4461 => 16.6416, std.dev.: 0.0244) MultiSource/Applications/obsequi/Obsequi: 2.75% (1.0262 => 1.0544, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6828.88% (0.3123 => 21.6389, std.dev.: 0.1312) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.94% (0.2463 => 0.3693, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 0.83% (0.6010 => 0.6060, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.79% (0.3266 => 0.3357, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: 2.54% (0.1969 => 0.2019, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 42.28% (0.0123 => 0.0175, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.21% (0.0408 => 0.0399, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.53% (0.0254 => 0.0329, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -18.21% (0.0302 => 0.0247, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -10.42% (0.0384 => 0.0344, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/casts: -35.26% (0.0190 => 0.0123, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/test1: 5.56% (0.0180 => 0.0190, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1438 => 0.1440, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -4.63% (1.1329 => 1.0805, std.dev.: 0.0523) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.71% (0.1462 => 0.1437, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.91% (0.4164 => 0.4202, std.dev.: 0.0192) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.26% (0.1369 => 0.1400, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.30% (0.0641 => 0.0607, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.54% (0.0195 => 0.0198, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.04% (0.0578 => 0.0584, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.04% (1.1437 => 1.1899, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.22% (0.0627 => 0.0588, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 21.11% (0.0180 => 0.0218, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.53% (0.8017 => 0.7734, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 43.55% (0.0062 => 0.0089, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 8 01:24:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 8 Nov 2012 03:24:29 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121108092429.60E052A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5676?compare_to=5672&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5676, Order: 167573, Start Time: 2012-11-08 07:57:48, End Time: 2012-11-08 09:24:40 To: 5672, Order: 167571, Start Time: 2012-11-08 04:11:54, End Time: 2012-11-08 05:36:43 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (2 on baseline) Performance Improvements: 0 (168 on baseline) Unchanged Tests: 1042 (872 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 2.48% (7.4937 => 7.6795, std.dev.: 0.0177) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.36% (0.1431 => 0.1297, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.03% (0.3821 => 0.3514, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: -7.55% (2.4924 => 2.3042, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.16% (0.3142 => 0.2917, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -7.06% (0.3357 => 0.3120, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/trivial-interface: -6.98% (0.3812 => 0.3546, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.97% (0.3658 => 0.3403, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.96% (3.5339 => 3.2879, std.dev.: 0.0925) SingleSource/UnitTests/ObjC/exceptions-2: -6.92% (0.3831 => 0.3566, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.91% (0.3891 => 0.3622, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.91% (0.9542 => 0.8883, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: -6.90% (0.3896 => 0.3627, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -6.89% (0.3848 => 0.3583, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: -6.88% (0.3880 => 0.3613, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.88% (0.1584 => 0.1475, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: -6.87% (0.4176 => 0.3889, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -6.87% (0.4033 => 0.3756, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.80% (0.3884 => 0.3620, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.79% (0.2355 => 0.2195, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/property: -6.76% (0.4199 => 0.3915, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.74% (0.3931 => 0.3666, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.73% (0.9852 => 0.9189, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -6.73% (0.4280 => 0.3992, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -6.70% (9.2283 => 8.6098, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: -6.70% (1.3148 => 1.2267, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.66% (1.0544 => 0.9842, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: -6.63% (16.1920 => 15.1183, std.dev.: 0.0085) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.59% (22.4056 => 20.9292, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/08-main/main: -6.58% (0.2659 => 0.2484, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.55% (0.6484 => 0.6059, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/gs/gs: -6.55% (4.3330 => 4.0494, std.dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: -6.53% (7.0961 => 6.6324, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: -6.53% (0.1761 => 0.1646, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.53% (0.3323 => 0.3106, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.53% (0.1716 => 0.1604, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.52% (0.3849 => 0.3598, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.46% (2.1713 => 2.0310, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/football/football: -6.46% (0.9179 => 0.8586, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.46% (1.3722 => 1.2836, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.45% (4.8161 => 4.5056, std.dev.: 0.0127) MultiSource/Applications/Burg/burg: -6.44% (1.2515 => 1.1709, std.dev.: 0.0065) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.43% (6.7716 => 6.3363, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.42% (4.8802 => 4.5669, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.41% (1.2784 => 1.1964, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.40% (0.2548 => 0.2385, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -6.39% (0.3194 => 0.2990, std.dev.: 0.0055) SingleSource/Regression/C++/ofstream_ctor: -6.37% (0.3059 => 0.2864, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.36% (0.3837 => 0.3593) SingleSource/Benchmarks/Shootout-C++/strcat: -6.36% (0.2989 => 0.2799, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/lists: -6.35% (0.3621 => 0.3391, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/hash2: -6.34% (0.4861 => 0.4553, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/moments: -6.33% (0.4248 => 0.3979, std.dev.: 0.0094) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.33% (4.5069 => 4.2216, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.31% (4.0323 => 3.7777, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: -6.30% (34.0927 => 31.9443, std.dev.: 0.0348) SingleSource/Benchmarks/Shootout-C++/hash: -6.28% (0.4524 => 0.4240, std.dev.: 0.0101) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.27% (1.2300 => 1.1529, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.26% (0.2428 => 0.2276, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -6.24% (2.4021 => 2.2523, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.24% (1.4642 => 1.3729, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.23% (0.1621 => 0.1520, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -6.20% (1.1450 => 1.0740, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: -6.20% (0.2871 => 0.2693, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.20% (0.2695 => 0.2528, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.19% (0.7919 => 0.7429, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: -6.18% (0.3025 => 0.2838, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: -6.16% (0.2985 => 0.2801, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.16% (0.4321 => 0.4055, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.15% (0.3252 => 0.3052, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.15% (0.3057 => 0.2869, std.dev.: 0.0033) MultiSource/Applications/kimwitu++/kc: -6.14% (18.2933 => 17.1706, std.dev.: 0.0228) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.12% (0.4916 => 0.4615, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -6.12% (0.3581 => 0.3362, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -6.11% (0.4515 => 0.4239, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.07% (1.6364 => 1.5370, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.07% (0.4813 => 0.4521, std.dev.: 0.0014) MultiSource/Applications/lua/lua: -6.03% (4.0594 => 3.8145, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: -6.02% (0.3255 => 0.3059, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary3: -6.01% (0.3446 => 0.3239, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/wc: -5.96% (0.3205 => 0.3014, std.dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: -5.95% (1.1530 => 1.0844, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.94% (0.3483 => 0.3276, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.94% (0.3016 => 0.2837, std.dev.: 0.0059) MultiSource/Applications/minisat/minisat: -5.89% (0.7447 => 0.7008, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.88% (5.4682 => 5.1465, std.dev.: 0.1170) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.88% (0.9557 => 0.8995, std.dev.: 0.0198) MultiSource/Applications/SPASS/SPASS: -5.86% (15.5079 => 14.5998, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/ReedSolomon: -5.85% (0.1879 => 0.1769, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/random: -5.85% (0.2939 => 0.2767, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.85% (14.2083 => 13.3777, std.dev.: 0.0158) MultiSource/Applications/sqlite3/sqlite3: -5.83% (17.1032 => 16.1066, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.82% (0.5863 => 0.5522, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.80% (0.2999 => 0.2825, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.79% (8.0126 => 7.5483, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.79% (0.2106 => 0.1984, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -5.79% (0.3867 => 0.3643, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hello: -5.79% (0.2849 => 0.2684, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.79% (0.5857 => 0.5518, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/except: -5.78% (0.3026 => 0.2851, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.77% (0.5478 => 0.5162, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.75% (0.3406 => 0.3210, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.75% (0.6736 => 0.6349, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.74% (0.5591 => 0.5270, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.73% (0.6230 => 0.5873, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.73% (0.3491 => 0.3291, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.73% (0.7524 => 0.7093, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.73% (0.5849 => 0.5514, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: -5.73% (1.3864 => 1.3070, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -5.73% (0.7982 => 0.7525, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: -5.69% (0.3271 => 0.3085, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -5.68% (3.5154 => 3.3157, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.68% (0.6660 => 0.6282, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -5.67% (2.1401 => 2.0188, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.67% (0.5999 => 0.5659, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.66% (0.3319 => 0.3131, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.66% (0.8521 => 0.8039, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: -5.65% (0.3788 => 0.3574, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.64% (0.7339 => 0.6925, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.64% (0.7198 => 0.6792, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.64% (0.6297 => 0.5942, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.63% (0.6052 => 0.5711, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.63% (0.6194 => 0.5845, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.63% (0.5805 => 0.5478, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.63% (0.6293 => 0.5939, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.62% (0.6304 => 0.5950, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.62% (0.5859 => 0.5530, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.59% (0.5925 => 0.5594, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.58% (0.5575 => 0.5264, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -5.58% (0.6347 => 0.5993, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -5.57% (0.7779 => 0.7346, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.55% (0.5802 => 0.5480, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.55% (0.5570 => 0.5261, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.54% (0.5581 => 0.5272, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.50% (0.6395 => 0.6043, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -5.50% (0.6441 => 0.6087, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.49% (0.6189 => 0.5849, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.48% (0.6260 => 0.5917, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.48% (0.6446 => 0.6093, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.46% (0.5567 => 0.5263, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.46% (0.6395 => 0.6046, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.45% (0.5705 => 0.5394, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.45% (0.2001 => 0.1892, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.43% (0.6667 => 0.6305, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.42% (0.6676 => 0.6314, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: -5.42% (0.8418 => 0.7962, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.36% (1.2210 => 1.1556, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -5.36% (15.2527 => 14.4358, std.dev.: 0.0226) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.33% (0.5456 => 0.5165, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.33% (0.5569 => 0.5272, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.32% (0.6033 => 0.5712, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.32% (0.5941 => 0.5625, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.27% (1.2221 => 1.1577, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.22% (0.6681 => 0.6332, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.17% (0.5688 => 0.5394, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.16% (0.6440 => 0.6108, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.05% (0.2278 => 0.2163, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -4.99% (5.0226 => 4.7720, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.95% (0.2385 => 0.2267, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.89% (0.9077 => 0.8633, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.74% (0.2277 => 0.2169, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: -4.54% (1.5610 => 1.4902, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -2.73% (20.7746 => 20.2077, std.dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.35% (7.5137 => 5.7596, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/richards_benchmark: -8.62% (1.2842 => 1.1735, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/fbench: -3.87% (2.2633 => 2.1758, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.84% (1.7753 => 1.7071, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4717, std.dev.: 0.0033) Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 8 03:45:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 8 Nov 2012 05:45:12 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121108114512.09F202A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5677?compare_to=5675&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5677, Order: 167574, Start Time: 2012-11-08 10:18:51, End Time: 2012-11-08 11:45:23 To: 5675, Order: 167573, Start Time: 2012-11-08 07:52:03, End Time: 2012-11-08 09:18:30 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 19 (110 on baseline) Performance Improvements: 2 (24 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 970 (840 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.03% (0.1436 => 0.1537, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.69% (0.2468 => 0.2633, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.92% (0.3255 => 0.3415, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.77% (0.2265 => 0.2373, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.30% (0.4978 => 0.5192, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.68% (0.8796 => 0.9120, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.24% (0.7721 => 0.7971, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.96% (0.5873 => 0.6047, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.84% (1.3458 => 1.3706, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.81% (0.8416 => 0.8568, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.81% (1.2071 => 1.2289, std.dev.: 0.0043) MultiSource/Applications/d/make_dparser: 1.39% (3.2759 => 3.3214, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.32% (1.6687 => 1.6907, std.dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 10.15% (3.7624 => 4.1442, std.dev.: 0.1071) SingleSource/Benchmarks/Shootout/heapsort: 6.30% (3.0131 => 3.2029, std.dev.: 0.0646) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.88% (4.0073 => 4.0826, std.dev.: 0.0288) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.46% (1.2489 => 1.2671, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/matrix: 1.38% (1.5568 => 1.5783, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.04% (8.4044 => 8.4916, std.dev.: 0.0173) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.34% (2.9487 => 2.9091, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.34% (3.6132 => 3.5649, std.dev.: 0.0088) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.21% (16.6416 => 16.6758, std.dev.: 0.0653) MultiSource/Applications/obsequi/Obsequi: -0.23% (1.0544 => 1.0520, std.dev.: 0.0160) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.60% (21.6389 => 21.9841, std.dev.: 0.1359) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.79% (0.3693 => 0.3664, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 0.36% (0.6060 => 0.6082, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.82% (0.3357 => 0.3418, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/strcat: 0.94% (0.2019 => 0.2038, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 24.00% (0.0175 => 0.0217, std.dev.: 0.0092) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 6.27% (0.0399 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0329 => 0.0330, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 26.32% (0.0247 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 22.67% (0.0344 => 0.0422, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 64.23% (0.0123 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 13.16% (0.0190 => 0.0215, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1440 => 0.1439, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 7.53% (1.0805 => 1.1619, std.dev.: 0.0345) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.90% (0.1437 => 0.1493, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.90% (0.4202 => 0.4164, std.dev.: 0.2743) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.57% (0.1400 => 0.1408, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.82% (0.0607 => 0.0612, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 40.40% (0.0198 => 0.0278, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.36% (0.0584 => 0.0627, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.06% (1.1899 => 1.1892, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.84% (0.0588 => 0.0640, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.94% (0.0218 => 0.0268, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.97% (0.7734 => 0.7809, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -26.97% (0.0089 => 0.0065, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2335.03% (0.6332 => 15.4186, std.dev.: 0.1646) MultiSource/Benchmarks/McCat/08-main/main: 48.50% (0.1831 => 0.2719, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.09% (0.1559 => 0.1464, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1495.63% (0.3344 => 5.3358, std.dev.: 0.0248) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.01% (0.2364 => 0.3239, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: 0.23% (0.0429 => 0.0430, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.80% (0.0224 => 0.0237, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4203, std.dev.: 0.0186) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0698, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4894, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3420, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1280, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4079, std.dev.: 0.0041) SingleSource/Regression/C/uint64_to_float: -23.83% (2.1832 => 1.6629, std.dev.: 0.0032) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.80% (0.0810 => 0.0938, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: 12.14% (0.1112 => 0.1247, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.60% (0.8321 => 0.9120, std.dev.: 0.0075) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.86% (0.3137 => 0.3415, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.85% (0.2180 => 0.2373, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 8.69% (0.1347 => 0.1464, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.86% (0.1425 => 0.1537, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.69% (0.6010 => 0.6472, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.12% (0.4847 => 0.5192, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.66% (0.7473 => 0.7971, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.54% (1.1606 => 1.2365, std.dev.: 0.0138) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.47% (0.2240 => 0.2385, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.62% (0.1905 => 0.2012, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 5.19% (0.7950 => 0.8363, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.19% (0.2060 => 0.2167, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.17% (1.1685 => 1.2289, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.04% (0.1983 => 0.2083, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.01% (0.6287 => 0.6602, std.dev.: 0.0117) MultiSource/Applications/hbd/hbd: 4.97% (1.4269 => 1.4978, std.dev.: 0.0184) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.72% (1.4479 => 1.5163, std.dev.: 0.0208) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.53% (0.2519 => 0.2633, std.dev.: 0.0027) MultiSource/Applications/Burg/burg: 4.49% (1.2222 => 1.2771, std.dev.: 0.0130) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.22% (0.4783 => 0.4985, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.98% (0.5961 => 0.6198, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.95% (0.5817 => 0.6047, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.80% (0.4127 => 0.4284, std.dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.52% (6.6074 => 6.8397, std.dev.: 0.0334) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.40% (0.8697 => 0.8993, std.dev.: 0.0079) MultiSource/Applications/treecc/treecc: 3.33% (1.9948 => 2.0613, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.22% (1.3279 => 1.3706, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.21% (0.7966 => 0.8222, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.19% (0.9069 => 0.9358, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.18% (1.6386 => 1.6907, std.dev.: 0.0064) MultiSource/Applications/SPASS/SPASS: 3.16% (14.2605 => 14.7106, std.dev.: 0.1270) MultiSource/Applications/SIBsim4/SIBsim4: 3.13% (1.2568 => 1.2962, std.dev.: 0.0049) MultiSource/Applications/ClamAV/clamscan: 3.07% (14.7684 => 15.2211, std.dev.: 0.0804) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.02% (0.8317 => 0.8568, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.02% (4.4880 => 4.6234, std.dev.: 0.0470) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.96% (8.6476 => 8.9034, std.dev.: 0.0781) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.82% (0.8007 => 0.8233, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.73% (0.9056 => 0.9303, std.dev.: 0.0049) MultiSource/Applications/lua/lua: 2.72% (3.8189 => 3.9226, std.dev.: 0.0098) MultiSource/Applications/d/make_dparser: 2.62% (3.2366 => 3.3214, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.61% (0.9908 => 1.0167, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.60% (0.8086 => 0.8296, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.56% (1.1170 => 1.1456, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.54% (0.8656 => 0.8876, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 2.53% (0.9810 => 1.0058, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.51% (0.8457 => 0.8669, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.51% (0.8420 => 0.8631, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.49% (0.9074 => 0.9300, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.48% (13.1811 => 13.5079, std.dev.: 0.1158) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.47% (0.8611 => 0.8824, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.44% (0.8331 => 0.8534, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.43% (4.1763 => 4.2778, std.dev.: 0.0165) MultiSource/Applications/siod/siod: 2.41% (2.2184 => 2.2719, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.41% (0.5191 => 0.5316, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.36% (0.7932 => 0.8119, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.35% (0.8597 => 0.8799, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.32% (0.8359 => 0.8553, std.dev.: 0.0065) MultiSource/Applications/minisat/minisat: 2.31% (0.6834 => 0.6992, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.28% (0.6227 => 0.6369, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.26% (0.8805 => 0.9004, std.dev.: 0.0056) MultiSource/Benchmarks/Bullet/bullet: 2.13% (31.8598 => 32.5377, std.dev.: 0.1447) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.05% (0.8066 => 0.8231, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.03% (0.9688 => 0.9885, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.03% (0.8338 => 0.8507, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.95% (0.8885 => 0.9058, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.92% (0.8316 => 0.8476, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.92% (1.2602 => 1.2844, std.dev.: 0.0084) MultiSource/Benchmarks/mafft/pairlocalalign: 1.77% (8.6247 => 8.7770, std.dev.: 0.0264) MultiSource/Benchmarks/PAQ8p/paq8p: 1.75% (2.3764 => 2.4181, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 1.63% (0.7557 => 0.7680, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.29% (1.2423 => 1.2583, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 113.07% (0.0199 => 0.0424, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/pi: 57.89% (1.5795 => 2.4939, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.07% (0.7597 => 0.8894, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.35% (2.9753 => 3.4618, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.55% (2.7995 => 3.2069, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.61% (5.0261 => 5.6095, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.13% (6.3772 => 7.0234, std.dev.: 0.2220) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.65% (1.1857 => 1.2764, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/queens: 7.34% (1.7056 => 1.8308, std.dev.: 0.0232) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.86% (4.7794 => 5.1071, std.dev.: 0.0323) MultiSource/Applications/SIBsim4/SIBsim4: 6.38% (3.1873 => 3.3905, std.dev.: 0.0162) SingleSource/Benchmarks/Misc/richards_benchmark: 6.01% (1.3037 => 1.3821, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.80% (4.5327 => 4.7957, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.78% (4.9686 => 5.2558, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/treeadd/treeadd: 5.16% (0.3587 => 0.3772, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.89% (2.2485 => 2.3585, std.dev.: 0.0248) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.59% (3.3761 => 3.5310, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.18% (6.2275 => 6.4881, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.18% (4.9453 => 5.1521, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.06% (4.9469 => 5.1477, std.dev.: 0.0119) MultiSource/Applications/hexxagon/hexxagon: 3.91% (14.0064 => 14.5543, std.dev.: 0.0689) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.64% (0.2887 => 0.2992, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.12% (4.8660 => 5.0178, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.85% (11.5690 => 11.8986, std.dev.: 0.0267) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.77% (1.2337 => 1.2679, std.dev.: 0.0088) MultiSource/Applications/lambda-0_1_3/lambda: 2.69% (7.4933 => 7.6949, std.dev.: 0.0347) MultiSource/Applications/siod/siod: 2.62% (3.6643 => 3.7604, std.dev.: 0.0253) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.58% (8.2783 => 8.4916, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout/lists: 2.08% (7.3375 => 7.4904, std.dev.: 0.0188) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.04% (4.8362 => 4.9351, std.dev.: 0.0271) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.58% (1.2474 => 1.2671, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.55% (1.1365 => 1.1541, std.dev.: 0.0053) MultiSource/Benchmarks/BitBench/five11/five11: 1.53% (5.6030 => 5.6885, std.dev.: 0.0162) MultiSource/Benchmarks/FreeBench/neural/neural: 1.32% (1.0841 => 1.0984, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.20% (4.4340 => 4.4872, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/ReedSolomon: 1.18% (8.5322 => 8.6326, std.dev.: 0.0094) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.19% (5.4641 => 4.3062, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.10% (1.0512 => 0.9345, std.dev.: 0.0059) SingleSource/Benchmarks/McGill/chomp: -11.03% (1.1216 => 0.9979, std.dev.: 0.0165) MultiSource/Benchmarks/mafft/pairlocalalign: -8.53% (63.1822 => 57.7914, std.dev.: 0.2406) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.83% (4.7482 => 4.4238, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.91% (5.4972 => 5.1723, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.66% (0.3269 => 0.3084, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.11% (5.1557 => 4.8925, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.35% (4.7449 => 4.5384, std.dev.: 0.0585) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.81% (2.8773 => 2.7676, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.70% (6.0224 => 5.7996, std.dev.: 0.0320) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.10% (2.4490 => 2.3730, std.dev.: 0.0123) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.02% (28.5821 => 27.7183, std.dev.: 0.1841) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.93% (2.6356 => 2.5583, std.dev.: 0.0156) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.88% (1.2822 => 1.2453, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.58% (0.5807 => 0.5657, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.46% (9.9065 => 9.6624, std.dev.: 0.0406) MultiSource/Applications/aha/aha: -2.34% (3.3398 => 3.2617, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bisort/bisort: -2.05% (0.6636 => 0.6500, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (11.5316 => 11.2989, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.54% (4.9994 => 4.9222, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.50% (3.2169 => 3.1686, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.33% (2.3487 => 2.3175, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.19% (5.6343 => 5.5673, std.dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.40% (16.4461 => 16.6758, std.dev.: 0.0653) MultiSource/Applications/obsequi/Obsequi: 2.51% (1.0262 => 1.0520, std.dev.: 0.0160) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6939.42% (0.3123 => 21.9841, std.dev.: 0.1359) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.76% (0.2463 => 0.3664, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 1.20% (0.6010 => 0.6082, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.65% (0.3266 => 0.3418, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/strcat: 3.50% (0.1969 => 0.2038, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0092) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 19.44% (0.0180 => 0.0215, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1438 => 0.1439, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.56% (1.1329 => 1.1619, std.dev.: 0.0345) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.12% (0.1462 => 0.1493, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/12-IOtest/iotest: - (0.4164 => 0.4164, std.dev.: 0.2743) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.85% (0.1369 => 0.1408, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.52% (0.0641 => 0.0612, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.56% (0.0195 => 0.0278, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.48% (0.0578 => 0.0627, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.98% (1.1437 => 1.1892, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.07% (0.0627 => 0.0640, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.89% (0.0180 => 0.0268, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.59% (0.8017 => 0.7809, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 4.84% (0.0062 => 0.0065, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 8 03:50:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 8 Nov 2012 05:50:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121108115020.A59A12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5678?compare_to=5676&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5678, Order: 167574, Start Time: 2012-11-08 10:25:10, End Time: 2012-11-08 11:50:31 To: 5676, Order: 167573, Start Time: 2012-11-08 07:57:48, End Time: 2012-11-08 09:24:40 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (180 on baseline) Unchanged Tests: 1041 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/lists: 1.35% (6.1581 => 6.2413, std.dev.: 0.0062) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1017, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/salsa20: 2.47% (7.4937 => 7.6788, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash2: 2.03% (3.1932 => 3.2580, std.dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.22% (0.1431 => 0.1299, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.69% (0.3821 => 0.3527, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -7.51% (2.4924 => 2.3052, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.10% (0.3142 => 0.2919, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.96% (0.9542 => 0.8878, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.92% (0.2428 => 0.2260, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.91% (0.4151 => 0.3864, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -6.90% (0.2160 => 0.2011, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.88% (3.5339 => 3.2908, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.83% (0.9852 => 0.9179, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -6.75% (1.3148 => 1.2260, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.74% (0.3931 => 0.3666, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-2: -6.73% (0.3831 => 0.3573, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.72% (2.1713 => 2.0253, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/trivial-interface: -6.69% (0.3812 => 0.3557, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.67% (0.2355 => 0.2198, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -6.66% (0.3481 => 0.3249, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.65% (1.0544 => 0.9843, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.64% (0.3658 => 0.3415, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -6.64% (16.1920 => 15.1170, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/synchronized: -6.62% (0.3896 => 0.3638, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.61% (22.4056 => 20.9253, std.dev.: 0.0112) SingleSource/Regression/C++/ofstream_ctor: -6.60% (0.3059 => 0.2857, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.60% (0.3848 => 0.3594, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.60% (0.3849 => 0.3595, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -6.60% (0.3880 => 0.3624, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/for-in: -6.60% (0.4033 => 0.3767, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -6.59% (7.0961 => 6.6288, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/methcall: -6.58% (0.3025 => 0.2826, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.57% (9.2283 => 8.6216, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.57% (0.6484 => 0.6058, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: -6.56% (0.4861 => 0.4542, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -6.56% (0.3446 => 0.3220, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -6.56% (0.2989 => 0.2793, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: -6.53% (4.3330 => 4.0499, std.dev.: 0.0112) SingleSource/Benchmarks/McGill/chomp: -6.53% (0.1761 => 0.1646, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.51% (0.2548 => 0.2382, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.51% (0.1796 => 0.1679, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -6.51% (0.2659 => 0.2486, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.50% (1.3722 => 1.2830, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: -6.48% (0.3394 => 0.3174, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -6.48% (0.3194 => 0.2987, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.48% (0.3891 => 0.3639, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.47% (0.1716 => 0.1605, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -6.46% (0.3357 => 0.3140, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.46% (0.3837 => 0.3589, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -6.45% (0.4199 => 0.3928, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -6.45% (34.0927 => 31.8936, std.dev.: 0.0210) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.41% (1.2300 => 1.1511, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: -6.40% (0.4248 => 0.3976, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -6.39% (0.4176 => 0.3909, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -6.39% (0.1879 => 0.1759, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -6.38% (0.4280 => 0.4007, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.36% (4.8161 => 4.5098, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.36% (0.3884 => 0.3637, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.35% (4.5069 => 4.2205, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/lists: -6.35% (0.3621 => 0.3391, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: -6.34% (1.2515 => 1.1721, std.dev.: 0.0097) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.32% (6.7716 => 6.3437, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.28% (4.0323 => 3.7791, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: -6.26% (0.9179 => 0.8604, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.25% (1.4642 => 1.3727, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.25% (0.4321 => 0.4051, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.25% (0.3057 => 0.2866, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.24% (4.8802 => 4.5756, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/fibo: -6.23% (0.2871 => 0.2692, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.21% (0.4813 => 0.4514, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.20% (0.6293 => 0.5903, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: -6.19% (18.2933 => 17.1601, std.dev.: 0.0111) MultiSource/Applications/lemon/lemon: -6.19% (1.1450 => 1.0741, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.18% (0.3252 => 0.3051, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -6.18% (0.3026 => 0.2839, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.16% (1.2784 => 1.1996, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.16% (0.2695 => 0.2529, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -6.14% (0.3255 => 0.3055, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.12% (0.4083 => 0.3833, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/wc: -6.12% (0.3205 => 0.3009, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -6.11% (0.4515 => 0.4239, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.11% (1.6474 => 1.5467, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: -6.11% (0.2849 => 0.2675, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -6.10% (4.0594 => 3.8117, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.10% (0.3016 => 0.2832, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.07% (0.7919 => 0.7438, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.06% (0.2903 => 0.2727, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -6.06% (0.6750 => 0.6341, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.05% (0.3323 => 0.3122, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -6.05% (0.3406 => 0.3200, std.dev.: 0.0009) MultiSource/Applications/siod/siod: -6.04% (2.4021 => 2.2569, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/nestedloop: -6.03% (0.2933 => 0.2756, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -6.02% (0.2939 => 0.2762, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.00% (1.6364 => 1.5382, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.00% (0.3483 => 0.3274, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.99% (0.5857 => 0.5506, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -5.98% (0.7982 => 0.7505, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.97% (0.8521 => 0.8012, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.97% (0.2278 => 0.2142, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: -5.95% (0.3581 => 0.3368, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: -5.95% (0.4524 => 0.4255, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.93% (0.9557 => 0.8990, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.92% (0.4916 => 0.4625, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.90% (0.7524 => 0.7080, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.90% (0.3491 => 0.3285, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -5.90% (1.1530 => 1.0850, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.88% (0.5863 => 0.5518, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.87% (5.4682 => 5.1472, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.85% (14.2083 => 13.3768, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/lists1: -5.84% (0.3867 => 0.3641, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -5.84% (0.7779 => 0.7325, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.82% (0.5168 => 0.4867, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.82% (0.5478 => 0.5159, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: -5.82% (15.5079 => 14.6052, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.80% (0.6736 => 0.6345, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -5.80% (0.2985 => 0.2812, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.80% (0.5591 => 0.5267, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.78% (0.6230 => 0.5870, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: -5.77% (3.5154 => 3.3126, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.77% (0.2999 => 0.2826, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -5.77% (17.1032 => 16.1171, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.76% (0.5849 => 0.5512, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.75% (0.6260 => 0.5900, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.74% (0.7021 => 0.6618, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.74% (0.4427 => 0.4173, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -5.73% (0.6347 => 0.5983, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.73% (0.6052 => 0.5705, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: -5.73% (0.3788 => 0.3571, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.72% (2.2587 => 2.1294, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.71% (8.0126 => 7.5551, std.dev.: 0.0079) MultiSource/Applications/minisat/minisat: -5.71% (0.7447 => 0.7022, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.70% (0.2385 => 0.2249, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.70% (0.2106 => 0.1986, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: -5.68% (0.6441 => 0.6075, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.68% (1.2210 => 1.1517, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.67% (0.6189 => 0.5838, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.65% (0.5925 => 0.5590, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.65% (0.6297 => 0.5941, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.65% (0.6446 => 0.6082, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.63% (0.5805 => 0.5478, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.63% (0.6676 => 0.6300, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -5.63% (0.3271 => 0.3087, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.62% (0.5999 => 0.5662, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.62% (0.6304 => 0.5950, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.60% (0.5802 => 0.5477, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.60% (0.5570 => 0.5258, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.59% (0.6194 => 0.5848, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.58% (0.5859 => 0.5532, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.57% (0.5329 => 0.5032, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.56% (1.2221 => 1.1541, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.56% (0.5575 => 0.5265, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.55% (0.6667 => 0.6297, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.51% (0.5567 => 0.5260, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.51% (0.5569 => 0.5262, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.51% (0.6440 => 0.6085, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.51% (0.6660 => 0.6293, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.50% (0.7339 => 0.6935, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.50% (0.6395 => 0.6043, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.48% (0.3319 => 0.3137, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.47% (0.5705 => 0.5393, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -5.47% (1.3864 => 1.3106, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.45% (0.6033 => 0.5704, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.44% (0.6395 => 0.6047, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.38% (0.5581 => 0.5281, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.37% (0.6681 => 0.6322, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -5.36% (15.2527 => 14.4348, std.dev.: 0.0203) MultiSource/Applications/treecc/treecc: -5.28% (2.1401 => 2.0271, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.22% (0.5456 => 0.5171, std.dev.: 0.0085) MultiSource/Applications/oggenc/oggenc: -5.18% (5.0226 => 4.7625, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.15% (0.2001 => 0.1898, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: -4.91% (0.8418 => 0.8005, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: -4.77% (1.5610 => 1.4865, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.74% (0.7198 => 0.6857, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.44% (0.9077 => 0.8674, std.dev.: 0.0132) SingleSource/UnitTests/Vector/constpool: -2.89% (20.7746 => 20.1746, std.dev.: 0.0213) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.50% (7.5137 => 5.7478, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/richards_benchmark: -8.61% (1.2842 => 1.1736, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.89% (2.2633 => 2.1752, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4720, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 8 05:20:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 8 Nov 2012 07:20:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121108132020.9BCFC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5679?compare_to=5674&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5679, Order: 167573, Start Time: 2012-11-08 10:04:55, End Time: 2012-11-08 13:20:31 To: 5674, Order: 167571, Start Time: 2012-11-08 05:57:19, End Time: 2012-11-08 09:16:53 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (171 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1039 (719 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.50% (123.9849 => 130.7987, std.dev.: 0.4907) SingleSource/Benchmarks/Dhrystone/dry: 1.16% (14.4712 => 14.6392, std.dev.: 0.0137) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/siod/siod: -1.42% (0.7396 => 0.7291, std.dev.: 0.0025) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.80% (0.0625 => 0.0880, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.98% (0.1063 => 0.1403, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.83% (0.2969 => 0.3736, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.05% (0.1106 => 0.1383, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.71% (0.4253 => 0.5304, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.28% (0.4139 => 0.5144, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.95% (0.0714 => 0.0885, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 23.49% (1.5932 => 1.9674, std.dev.: 0.0136) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.42% (0.5900 => 0.7282, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.85% (0.4994 => 0.6135, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.77% (0.0584 => 0.0717, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.34% (0.5000 => 0.6117, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.98% (0.1620 => 0.1976, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.94% (0.1021 => 0.1245, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.85% (0.0897 => 0.1093, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 21.70% (0.0599 => 0.0729, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.14% (0.1107 => 0.1341, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 20.78% (0.0948 => 0.1145, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.61% (0.0495 => 0.0597, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0584 => 0.0704, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.40% (0.0642 => 0.0773, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/health/health: 20.22% (0.0821 => 0.0987) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.22% (0.1103 => 0.1326, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.11% (0.3903 => 0.4688, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.89% (0.1604 => 0.1923, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.84% (0.1003 => 0.1202, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.83% (0.0822 => 0.0985, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 19.70% (0.1619 => 0.1938, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.63% (0.1549 => 0.1853, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 19.54% (0.0604 => 0.0722, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.74% (0.1462 => 0.1736, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 18.69% (0.0947 => 0.1124, std.dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: 18.32% (0.0808 => 0.0956, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.28% (0.3890 => 0.4601, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.17% (0.2014 => 0.2380, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 17.89% (0.5826 => 0.6868, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 17.82% (0.1218 => 0.1435, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 17.77% (0.4029 => 0.4745, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 17.77% (0.0698 => 0.0822, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 17.56% (0.5889 => 0.6923, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.40% (0.2736 => 0.3212, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.19% (0.1088 => 0.1275, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 17.14% (0.1505 => 0.1763, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.13% (1.3152 => 1.5405, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.06% (0.2866 => 0.3355, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: 16.86% (0.5546 => 0.6481, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.68% (3.5627 => 4.1570, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.67% (0.1968 => 0.2296, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.44% (0.4658 => 0.5424, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 16.43% (1.8794 => 2.1882, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.38% (1.6211 => 1.8867, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.29% (0.1160 => 0.1349, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.24% (0.2875 => 0.3342, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.23% (0.3271 => 0.3802, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 15.77% (0.9697 => 1.1226, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 15.76% (0.1421 => 0.1645, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.70% (0.2738 => 0.3168, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 15.63% (0.2725 => 0.3151, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 15.62% (0.2714 => 0.3138, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.60% (0.5026 => 0.5810, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.59% (0.4361 => 0.5041, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/strcat: 15.56% (0.2750 => 0.3178, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/matrix: 15.50% (0.2780 => 0.3211, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.47% (0.3930 => 0.4538, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.46% (0.2729 => 0.3151, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 15.44% (0.7171 => 0.8278, std.dev.: 0.0037) MultiSource/Applications/d/make_dparser: 15.42% (1.0781 => 1.2443, std.dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: 15.41% (0.3004 => 0.3467, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 15.37% (0.2811 => 0.3243, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 15.34% (0.1284 => 0.1481, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 15.31% (0.2803 => 0.3232, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 15.29% (0.2813 => 0.3243, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.26% (0.2792 => 0.3218, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 15.20% (0.2823 => 0.3252, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 15.19% (0.9909 => 1.1414, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.11% (2.7292 => 3.1415, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.08% (0.2911 => 0.3350, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 15.05% (0.3096 => 0.3562, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 15.04% (4.2109 => 4.8442, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.02% (0.3195 => 0.3675, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.95% (2.0673 => 2.3764, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 14.93% (23.5202 => 27.0306, std.dev.: 0.0255) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.88% (4.4195 => 5.0773, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.76% (1.9966 => 2.2913, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 14.65% (0.3317 => 0.3803, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.60% (1.9694 => 2.2570, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary3: 14.60% (0.3267 => 0.3744, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 14.55% (0.3258 => 0.3732, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.40% (0.3362 => 0.3846, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.31% (0.1090 => 0.1246, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.22% (0.3060 => 0.3495, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.18% (0.3124 => 0.3567, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 14.07% (0.3348 => 0.3819, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 14.03% (0.3678 => 0.4194, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.92% (0.3282 => 0.3739, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 13.91% (0.2566 => 0.2923, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.90% (0.3625 => 0.4129, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 13.67% (1.4269 => 1.6219, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sieve: 13.63% (0.3726 => 0.4234, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.61% (0.3446 => 0.3915, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 13.60% (0.3477 => 0.3950, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.56% (0.3488 => 0.3961, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 13.54% (0.2075 => 0.2356, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.47% (0.3496 => 0.3967, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 13.39% (0.3465 => 0.3929, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/exceptions-3: 13.38% (0.3460 => 0.3923, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 13.36% (0.3442 => 0.3902, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.35% (0.3469 => 0.3932, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hash2: 13.31% (0.4251 => 0.4817, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.29% (0.3981 => 0.4510, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.26% (0.3845 => 0.4355, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.25% (0.3690 => 0.4179, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.23% (0.3643 => 0.4125, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash: 13.17% (0.4146 => 0.4692, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 13.16% (0.7875 => 0.8911, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/property: 13.01% (0.3650 => 0.4125, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 12.94% (0.3724 => 0.4206, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 12.73% (0.5012 => 0.5650, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 12.49% (2.1653 => 2.4357, std.dev.: 0.0049) MultiSource/Applications/JM/lencod/lencod: 12.42% (4.6177 => 5.1913, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 12.40% (2.1013 => 2.3619, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.62% (0.2040 => 0.2277, std.dev.: 0.0058) MultiSource/Applications/SIBsim4/SIBsim4: 11.59% (0.2691 => 0.3003, std.dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 11.38% (5.5417 => 6.1721, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.33% (0.6435 => 0.7164, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.89% (0.1028 => 0.1140, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 10.83% (0.3498 => 0.3877, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.54% (0.2068 => 0.2286, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.38% (0.2737 => 0.3021, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.20% (0.1383 => 0.1524, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 10.01% (0.4847 => 0.5332, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 9.90% (0.6634 => 0.7291, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.82% (0.3084 => 0.3387, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 9.71% (0.3336 => 0.3660, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.32% (0.2103 => 0.2299, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 8.91% (2.0346 => 2.2159, std.dev.: 0.0046) MultiSource/Applications/lemon/lemon: 8.91% (0.2391 => 0.2604, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.40% (11.6398 => 12.6181, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.37% (4.6926 => 5.0856, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.93% (0.5361 => 0.5786, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.54% (0.7426 => 0.7986, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.32% (0.5584 => 0.5993, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 6.38% (11.9555 => 12.7185, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.25% (0.3792 => 0.3953, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 9.06% (0.2802 => 0.3056, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.58% (3.3903 => 3.6133, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6721, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary: 4.85% (0.2122 => 0.2225, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-2: 4.81% (1.8057 => 1.8925, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1685, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/dry: 4.21% (14.0481 => 14.6392, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.52% (0.3693 => 0.3823, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1923, std.dev.: 0.0079) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.61% (3.1722 => 3.2234, std.dev.: 0.0020) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3045, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2894, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5838, std.dev.: 0.0350) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.33% (2.4764 => 2.4435, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.74% (25.4195 => 16.5883, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/ary2: -8.95% (0.2402 => 0.2187, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9769, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7940, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9572, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.7998, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0054) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7727, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.69% (17.2379 => 16.7749, std.dev.: 0.0872) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8582, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5781, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4969, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.29% (105.3826 => 104.0236, std.dev.: 0.0883) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0437, std.dev.: 0.0040) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 8 06:46:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 8 Nov 2012 08:46:00 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121108144600.B517E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5680?compare_to=5677&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5680, Order: 167576, Start Time: 2012-11-08 13:19:36, End Time: 2012-11-08 14:46:10 To: 5677, Order: 167574, Start Time: 2012-11-08 10:18:51, End Time: 2012-11-08 11:45:23 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 3 (93 on baseline) Performance Improvements: 5 (26 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 983 (855 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.43% (1.3470 => 1.4336, std.dev.: 0.0264) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.60% (3.0406 => 3.2110, std.dev.: 0.0457) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.20% (0.3349 => 0.3523, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.28% (0.9120 => 0.8821, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.95% (1.2289 => 1.1927, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -2.80% (1.2973 => 1.2610, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.57% (1.2365 => 1.2047, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.10% (1.5163 => 1.4996, std.dev.: 0.0029) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.07% (16.6758 => 16.6638, std.dev.: 0.1218) MultiSource/Applications/obsequi/Obsequi: 0.63% (1.0520 => 1.0586, std.dev.: 0.0142) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.22% (21.9841 => 21.7152, std.dev.: 0.1555) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.49% (0.3664 => 0.3646, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: -0.20% (0.6082 => 0.6070, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.84% (0.3418 => 0.3321, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/strcat: -0.29% (0.2038 => 0.2032, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0217 => 0.0217, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0424 => 0.0424, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0330 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0312 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.24% (0.0422 => 0.0421, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0202 => 0.0202, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -5.58% (0.0215 => 0.0203, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.28% (0.1439 => 0.1435, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.13% (1.1619 => 1.1488, std.dev.: 0.0451) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -3.28% (0.1493 => 0.1444, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.43% (0.4164 => 0.4146, std.dev.: 0.0352) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.07% (0.1408 => 0.1423, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.12% (0.0612 => 0.0599, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -28.78% (0.0278 => 0.0198, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.38% (0.0627 => 0.0587, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.48% (1.1892 => 1.1949, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -16.13% (0.0031 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.03% (0.0640 => 0.0563, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.46% (0.0268 => 0.0181, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.04% (0.7809 => 0.7728, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -33.85% (0.0065 => 0.0043, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2311.59% (0.6332 => 15.2702, std.dev.: 0.1703) MultiSource/Benchmarks/McCat/08-main/main: 45.28% (0.1831 => 0.2660, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.03% (0.1559 => 0.1465, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1490.52% (0.3344 => 5.3187, std.dev.: 0.0551) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.73% (0.2364 => 0.3256, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel: -0.93% (0.0429 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.68% (0.0224 => 0.0230, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -28.70% (0.0230 => 0.0164, std.dev.: 0.0014) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4204, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0693, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4867, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3317, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1449, std.dev.: 0.0450) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4008, std.dev.: 0.0072) SingleSource/Regression/C/uint64_to_float: -23.89% (2.1832 => 1.6616, std.dev.: 0.0020) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.90% (0.0810 => 0.0955, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.91% (0.0848 => 0.0949, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 11.78% (0.1112 => 0.1243, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.37% (0.2279 => 0.2447, std.dev.: 0.0032) MultiSource/Applications/viterbi/viterbi: 7.36% (0.1577 => 0.1693, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.13% (0.7473 => 0.8006, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.33% (0.2180 => 0.2318, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.31% (0.3137 => 0.3335, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.01% (0.8321 => 0.8821, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.80% (0.3295 => 0.3486, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.00% (0.2519 => 0.2645, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.97% (0.4847 => 0.5088, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.89% (0.5961 => 0.6193, std.dev.: 0.0027) MultiSource/Applications/hbd/hbd: 3.83% (1.4269 => 1.4815, std.dev.: 0.0160) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.80% (1.1606 => 1.2047, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.78% (1.3279 => 1.3781, std.dev.: 0.0066) MultiSource/Applications/spiff/spiff: 3.64% (0.7950 => 0.8239, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.57% (1.4479 => 1.4996, std.dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 3.37% (0.2999 => 0.3100, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.26% (0.4783 => 0.4939, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 3.10% (14.2605 => 14.7023, std.dev.: 0.0115) MultiSource/Applications/SIBsim4/SIBsim4: 3.07% (1.2568 => 1.2954, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.04% (0.8086 => 0.8332, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 3.01% (0.9810 => 1.0105, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.00% (0.8007 => 0.8247, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.96% (4.1763 => 4.2998, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/hash2: 2.88% (0.4125 => 0.4244, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.84% (0.8066 => 0.8295, std.dev.: 0.0056) MultiSource/Applications/ClamAV/clamscan: 2.83% (14.7684 => 15.1858, std.dev.: 0.0691) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.82% (0.7932 => 0.8156, std.dev.: 0.0058) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.82% (6.6074 => 6.7939, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.76% (0.3657 => 0.3758, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.70% (0.8697 => 0.8932, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.70% (0.8885 => 0.9125, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.67% (0.8359 => 0.8582, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.57% (0.8712 => 0.8936, std.dev.: 0.0043) MultiSource/Applications/lua/lua: 2.57% (3.8189 => 3.9170, std.dev.: 0.0240) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.51% (0.9069 => 0.9297, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.42% (1.6386 => 1.6782, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.40% (0.8656 => 0.8864, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.37% (0.6586 => 0.6742, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.34% (0.8805 => 0.9011, std.dev.: 0.0061) MultiSource/Benchmarks/nbench/nbench: 2.32% (1.1271 => 1.1533, std.dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.27% (1.1170 => 1.1424, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.1401 => 2.1885, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.23% (8.6476 => 8.8401, std.dev.: 0.0412) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.22% (0.9688 => 0.9903, std.dev.: 0.0075) MultiSource/Applications/JM/lencod/lencod: 2.21% (15.3280 => 15.6668, std.dev.: 0.0105) MultiSource/Applications/lambda-0_1_3/lambda: 2.21% (0.7557 => 0.7724, std.dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (6.7320 => 6.8794, std.dev.: 0.0277) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.17% (13.1811 => 13.4672, std.dev.: 0.0803) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.07% (4.4880 => 4.5811, std.dev.: 0.0200) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.07% (1.1685 => 1.1927, std.dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: 2.01% (8.6247 => 8.7981, std.dev.: 0.0285) MultiSource/Benchmarks/PAQ8p/paq8p: 1.87% (2.3764 => 2.4209, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.61% (1.2423 => 1.2623, std.dev.: 0.0065) MultiSource/Applications/lemon/lemon: 1.46% (1.0945 => 1.1105, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (3.1832 => 3.2279, std.dev.: 0.0164) MultiSource/Applications/oggenc/oggenc: 1.26% (4.9628 => 5.0253, std.dev.: 0.0185) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 77.89% (0.0199 => 0.0354, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/pi: 57.64% (1.5795 => 2.4900, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.56% (0.7597 => 0.8855, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.36% (2.9753 => 3.4622, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.74% (2.7995 => 3.2121, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.62% (5.0261 => 5.6103, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.07% (6.3772 => 7.0833, std.dev.: 0.1937) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.58% (0.3186 => 0.3523, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.05% (1.1857 => 1.2811, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 7.08% (1.7056 => 1.8264, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.72% (4.7794 => 5.1007, std.dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: 6.59% (3.1873 => 3.3975, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/richards_benchmark: 6.57% (1.3037 => 1.3894, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.93% (4.9686 => 5.2633, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.89% (4.5327 => 4.7996, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.23% (3.0515 => 3.2110, std.dev.: 0.0457) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.53% (6.2275 => 6.5097, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.48% (4.9453 => 5.1670, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.07% (4.9469 => 5.1480, std.dev.: 0.0339) MultiSource/Applications/hexxagon/hexxagon: 3.93% (14.0064 => 14.5568, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.15% (0.3587 => 0.3700, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.88% (11.5690 => 11.9017, std.dev.: 0.0668) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.78% (8.2783 => 8.5087, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 2.75% (3.6643 => 3.7651, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.75% (4.8660 => 4.9996, std.dev.: 0.0342) MultiSource/Applications/lambda-0_1_3/lambda: 2.55% (7.4933 => 7.6844, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout/lists: 2.14% (7.3375 => 7.4947, std.dev.: 0.0330) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.09% (4.8362 => 4.9375, std.dev.: 0.0342) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.51% (1.1365 => 1.1537, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/power/power: 1.49% (1.2061 => 1.2241, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 1.37% (8.5322 => 8.6492, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.19% (4.0473 => 4.0955, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.09% (3.5679 => 3.6067, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 1.00% (2.8561 => 2.8848, std.dev.: 0.0105) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.84% (5.4641 => 4.3253, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.38% (7.2130 => 6.3198, std.dev.: 0.2688) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.90% (1.0512 => 0.9366, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: -10.85% (1.1216 => 0.9999, std.dev.: 0.0086) MultiSource/Benchmarks/mafft/pairlocalalign: -8.48% (63.1822 => 57.8260, std.dev.: 0.0512) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.86% (0.3269 => 0.3012, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.83% (4.7482 => 4.4241, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.10% (3.7148 => 3.4881, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.60% (5.4972 => 5.1891, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.12% (5.1557 => 4.8916, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.38% (4.7449 => 4.5371, std.dev.: 0.0237) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.97% (2.8773 => 2.7632, std.dev.: 0.0377) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.69% (6.0224 => 5.8002, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.47% (2.4490 => 2.3640, std.dev.: 0.0149) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.06% (28.5821 => 27.7067, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.98% (0.5807 => 0.5634, std.dev.: 0.0010) MultiSource/Applications/lua/lua: -2.98% (29.8330 => 28.9449, std.dev.: 0.2410) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.77% (2.6356 => 2.5627, std.dev.: 0.0111) MultiSource/Applications/aha/aha: -2.27% (3.3398 => 3.2639, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.27% (9.9065 => 9.6815, std.dev.: 0.0685) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.05% (11.5316 => 11.2954, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.74% (3.2169 => 3.1610, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.59% (2.3487 => 2.3113, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: -1.59% (3.4237 => 3.3693, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.55% (4.9994 => 4.9220, std.dev.: 0.0253) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.20% (5.6343 => 5.5669, std.dev.: 0.0045) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.32% (16.4461 => 16.6638, std.dev.: 0.1218) MultiSource/Applications/obsequi/Obsequi: 3.16% (1.0262 => 1.0586, std.dev.: 0.0142) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6853.31% (0.3123 => 21.7152, std.dev.: 0.1555) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.03% (0.2463 => 0.3646, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 1.00% (0.6010 => 0.6070, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.68% (0.3266 => 0.3321, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/strcat: 3.20% (0.1969 => 0.2032, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.64% (0.0384 => 0.0421, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 12.78% (0.0180 => 0.0203, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1438 => 0.1435, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.40% (1.1329 => 1.1488, std.dev.: 0.0451) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -1.23% (0.1462 => 0.1444, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.43% (0.4164 => 0.4146, std.dev.: 0.0352) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.94% (0.1369 => 0.1423, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.55% (0.0641 => 0.0599, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.54% (0.0195 => 0.0198, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.56% (0.0578 => 0.0587, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.48% (1.1437 => 1.1949, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.21% (0.0627 => 0.0563, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.56% (0.0180 => 0.0181, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.60% (0.8017 => 0.7728, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -30.65% (0.0062 => 0.0043, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 8 06:50:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 8 Nov 2012 08:50:47 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121108145047.211392A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5681?compare_to=5678&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5681, Order: 167576, Start Time: 2012-11-08 13:25:59, End Time: 2012-11-08 14:50:58 To: 5678, Order: 167574, Start Time: 2012-11-08 10:25:10, End Time: 2012-11-08 11:50:31 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (180 on baseline) Unchanged Tests: 1042 (857 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 2.82% (0.3834 => 0.3942, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.66% (2.0478 => 2.1023, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.4937 => 7.6695, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/hash2: 2.05% (3.1932 => 3.2586, std.dev.: 0.0083) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.36% (0.1431 => 0.1297, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.98% (0.3821 => 0.3516, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -7.58% (2.4924 => 2.3036, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.26% (0.3142 => 0.2914, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.23% (0.9542 => 0.8852, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: -7.18% (0.2160 => 0.2005, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.17% (0.2428 => 0.2254, std.dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: -7.12% (0.3357 => 0.3118, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.92% (3.5339 => 3.2894, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.82% (0.1584 => 0.1476, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.78% (0.3658 => 0.3410, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -6.76% (7.0961 => 6.6167, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.75% (0.2355 => 0.2196, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/trivial-interface: -6.74% (0.3812 => 0.3555, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.72% (2.1713 => 2.0254, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.72% (0.9852 => 0.9190, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.72% (9.2283 => 8.6085, std.dev.: 0.0105) SingleSource/UnitTests/ObjC/exceptions-2: -6.71% (0.3831 => 0.3574, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -6.69% (16.1920 => 15.1085, std.dev.: 0.0141) SingleSource/UnitTests/ObjC/exceptions-4: -6.68% (0.3880 => 0.3621, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.67% (0.4151 => 0.3874, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -6.66% (0.3481 => 0.3249, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -6.66% (1.3148 => 1.2272, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: -6.65% (0.3848 => 0.3592, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.65% (0.3323 => 0.3102, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.65% (1.0544 => 0.9843, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.65% (0.3896 => 0.3637, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.65% (0.4033 => 0.3765, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -6.64% (4.3330 => 4.0451, std.dev.: 0.0079) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.63% (0.3891 => 0.3633, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.61% (0.3025 => 0.2825, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -6.61% (0.4176 => 0.3900, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -6.60% (0.3059 => 0.2857, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.60% (0.3849 => 0.3595, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -6.59% (1.2515 => 1.1690, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.59% (0.3884 => 0.3628, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: -6.56% (0.2989 => 0.2793, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.55% (22.4056 => 20.9389, std.dev.: 0.0155) MultiSource/Benchmarks/McCat/08-main/main: -6.54% (0.2659 => 0.2485, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: -6.54% (0.3194 => 0.2985, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -6.54% (0.4280 => 0.4000, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: -6.54% (0.4861 => 0.4543, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -6.53% (0.3446 => 0.3221, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -6.53% (0.4199 => 0.3925, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.51% (0.3931 => 0.3675, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.51% (0.6484 => 0.6062, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -6.50% (0.2985 => 0.2791, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.49% (1.3722 => 1.2831, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -6.45% (34.0927 => 31.8938, std.dev.: 0.0149) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.44% (1.2300 => 1.1508, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -6.42% (0.1761 => 0.1648, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.40% (4.8161 => 4.5078, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.38% (6.7716 => 6.3398, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.36% (0.3837 => 0.3593, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.34% (4.0323 => 3.7765, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.34% (1.2784 => 1.1974, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -6.33% (0.4248 => 0.3979, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -6.33% (1.1450 => 1.0725, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.32% (4.5069 => 4.2222, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.30% (1.4642 => 1.3720, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.29% (4.8802 => 4.5734, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: -6.28% (0.9179 => 0.8603, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.27% (0.3252 => 0.3048, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.25% (1.6474 => 1.5444, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -6.25% (0.3394 => 0.3182) SingleSource/Benchmarks/Shootout-C++/fibo: -6.23% (0.2871 => 0.2692, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.23% (0.2695 => 0.2527, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -6.23% (2.4021 => 2.2525, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.23% (0.7919 => 0.7426, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.22% (0.4916 => 0.4610, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: -6.21% (0.3621 => 0.3396, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: -6.19% (0.2939 => 0.2757, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.18% (0.3057 => 0.2868, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -6.18% (0.4515 => 0.4236, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -6.17% (4.0594 => 3.8088, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.17% (1.6364 => 1.5355, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.16% (0.4321 => 0.4055, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.15% (0.4083 => 0.3832, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: -6.14% (0.2849 => 0.2674, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: -6.14% (18.2933 => 17.1704, std.dev.: 0.0101) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.13% (0.4813 => 0.4518, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.12% (0.3483 => 0.3270, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -6.11% (0.3026 => 0.2841) SingleSource/Benchmarks/Shootout-C++/matrix: -6.11% (0.3255 => 0.3056, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.07% (0.2999 => 0.2817, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -6.06% (0.3581 => 0.3364, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: -6.05% (0.3205 => 0.3011, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.04% (0.9557 => 0.8980, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -6.03% (0.2933 => 0.2756, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: -6.01% (0.4524 => 0.4252, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.00% (0.1716 => 0.1613, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.97% (0.3016 => 0.2836, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -5.96% (0.3406 => 0.3203, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: -5.96% (0.6750 => 0.6348, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.95% (14.2083 => 13.3631, std.dev.: 0.0212) MultiSource/Benchmarks/nbench/nbench: -5.94% (1.1530 => 1.0845, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.93% (0.6293 => 0.5920, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.92% (0.5863 => 0.5516, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.91% (0.5478 => 0.5154, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -5.90% (15.5079 => 14.5925, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.88% (5.4682 => 5.1469, std.dev.: 0.0307) MultiSource/Applications/sqlite3/sqlite3: -5.85% (17.1032 => 16.1026, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.85% (0.5591 => 0.5264, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.84% (0.7021 => 0.6611, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.82% (0.2903 => 0.2734, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.82% (0.6736 => 0.6344, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.82% (0.3319 => 0.3126, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: -5.81% (0.7779 => 0.7327, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -5.80% (0.6347 => 0.5979, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.79% (0.2278 => 0.2146, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.79% (0.6230 => 0.5869, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -5.79% (1.3864 => 1.3061, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.79% (0.5857 => 0.5518, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -5.79% (0.7447 => 0.7016, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.77% (0.7524 => 0.7090, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -5.77% (0.3867 => 0.3644, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.77% (0.6052 => 0.5703, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.76% (0.6304 => 0.5941, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.74% (0.5575 => 0.5255, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.73% (0.6297 => 0.5936, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.73% (0.5168 => 0.4872, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.73% (0.8521 => 0.8033, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.73% (8.0126 => 7.5538, std.dev.: 0.0044) MultiSource/Applications/treecc/treecc: -5.72% (2.1401 => 2.0177, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.72% (0.5999 => 0.5656, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: -5.71% (3.5154 => 3.3148, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.70% (0.5581 => 0.5263, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: -5.70% (0.6441 => 0.6074, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.69% (0.6660 => 0.6281, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.68% (0.5805 => 0.5475, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.68% (0.5859 => 0.5526, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.68% (0.6676 => 0.6297, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.67% (0.6260 => 0.5905, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.67% (0.5925 => 0.5589, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.66% (2.2587 => 2.1308, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.66% (1.2221 => 1.1529, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.66% (0.2385 => 0.2250, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.66% (0.6189 => 0.5839, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.65% (0.7339 => 0.6924, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.65% (0.6667 => 0.6290, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.65% (0.5802 => 0.5474, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.65% (0.6194 => 0.5844, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.64% (0.3491 => 0.3294, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.63% (0.5329 => 0.5029, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.62% (0.4427 => 0.4178, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.61% (0.5849 => 0.5521, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.60% (0.2106 => 0.1988, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.60% (0.5570 => 0.5258, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.59% (1.2210 => 1.1528, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.57% (0.6395 => 0.6039, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.56% (0.6440 => 0.6082, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.56% (0.5705 => 0.5388, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.55% (0.5941 => 0.5611, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.55% (0.5567 => 0.5258, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: -5.53% (0.3271 => 0.3090, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.51% (0.5569 => 0.5262, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.51% (0.6681 => 0.6313, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.50% (0.6395 => 0.6043, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.50% (0.5456 => 0.5156, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.48% (0.6446 => 0.6093, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: -5.46% (0.3788 => 0.3581, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.45% (0.6033 => 0.5704, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -5.33% (15.2527 => 14.4401, std.dev.: 0.0065) MultiSource/Applications/lambda-0_1_3/lambda: -5.31% (0.7982 => 0.7558, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.30% (0.2001 => 0.1895, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.29% (0.5688 => 0.5387, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: -5.20% (5.0226 => 4.7616, std.dev.: 0.0039) MultiSource/Applications/spiff/spiff: -5.17% (0.8418 => 0.7983, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.74% (0.7198 => 0.6857, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -4.52% (1.5610 => 1.4905, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.41% (0.9077 => 0.8677, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -2.73% (20.7746 => 20.2067, std.dev.: 0.0493) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.35% (7.5137 => 5.7589, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: -8.75% (1.2842 => 1.1718, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.82% (2.2633 => 2.1769, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4689, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 8 08:28:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 8 Nov 2012 10:28:45 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121108162845.CEF732A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5682?compare_to=5680&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5682, Order: 167582, Start Time: 2012-11-08 15:03:02, End Time: 2012-11-08 16:28:56 To: 5680, Order: 167576, Start Time: 2012-11-08 13:19:36, End Time: 2012-11-08 14:46:10 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 6 (89 on baseline) Performance Improvements: 3 (27 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 982 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/Burg/burg: 1.53% (1.2467 => 1.2658, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 13.63% (0.7743 => 0.8798, std.dev.: 0.0364) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.70% (6.3198 => 6.6168, std.dev.: 0.0505) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.77% (4.3176 => 4.4804, std.dev.: 0.0446) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 1.22% (0.8855 => 0.8963, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 1.16% (1.2398 => 1.2542, std.dev.: 0.0053) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.93% (0.3486 => 0.3349, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -12.17% (0.0830 => 0.0729, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: -3.91% (8.9152 => 8.5665, std.dev.: 0.0405) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.77% (16.6638 => 16.7924, std.dev.: 0.0225) MultiSource/Applications/obsequi/Obsequi: 0.67% (1.0586 => 1.0657, std.dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.04% (21.7152 => 21.7069, std.dev.: 0.2815) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.66% (0.3646 => 0.3670, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 0.21% (0.6070 => 0.6083, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.99% (0.3321 => 0.3354, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/strcat: -0.59% (0.2032 => 0.2020, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -13.82% (0.0217 => 0.0187, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.71% (0.0424 => 0.0427, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.61% (0.0330 => 0.0332, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.88% (0.0312 => 0.0303, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.48% (0.0421 => 0.0423, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/casts: -18.81% (0.0202 => 0.0164, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: -24.63% (0.0203 => 0.0153, std.dev.: 0.0031) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1435 => 0.1432, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.93% (1.1488 => 1.1825, std.dev.: 0.0240) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.76% (0.1444 => 0.1455, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.24% (0.4146 => 0.4136, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.81% (0.1423 => 0.1463, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.01% (0.0599 => 0.0641, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 16.67% (0.0198 => 0.0231, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.77% (0.0587 => 0.0559, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.05% (1.1949 => 1.1943, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.20% (0.0563 => 0.0581, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.10% (0.0181 => 0.0179, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.04% (0.7728 => 0.7725, std.dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 32.56% (0.0043 => 0.0057, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2314.53% (0.6332 => 15.2888, std.dev.: 0.0887) MultiSource/Benchmarks/McCat/08-main/main: 48.01% (0.1831 => 0.2710, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.36% (0.1559 => 0.1413, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1497.34% (0.3344 => 5.3415, std.dev.: 0.0253) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.06% (0.2364 => 0.3240, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: - (0.0429 => 0.0429, std.dev.: 0.0014) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.80% (0.0224 => 0.0237, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -31.74% (0.0230 => 0.0157, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4320, std.dev.: 0.0260) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0702, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4946, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3412, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1389, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4052, std.dev.: 0.0013) SingleSource/Regression/C/uint64_to_float: -23.87% (2.1832 => 1.6621, std.dev.: 0.0076) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.79% (0.0810 => 0.0946, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.24% (0.2279 => 0.2444, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.04% (0.8321 => 0.8824, std.dev.: 0.0120) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.52% (0.1885 => 0.1989, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.08% (0.4847 => 0.5093, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.00% (0.7473 => 0.7847, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.79% (0.9435 => 0.9887, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.25% (1.1606 => 1.2099, std.dev.: 0.0052) MultiSource/Applications/hbd/hbd: 3.76% (1.4269 => 1.4806, std.dev.: 0.0100) MultiSource/Applications/Burg/burg: 3.57% (1.2222 => 1.2658, std.dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: 3.32% (1.2568 => 1.2985, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.13% (0.4127 => 0.4256, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.13% (6.6074 => 6.8139, std.dev.: 0.0758) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.12% (0.8066 => 0.8318, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.08% (0.8611 => 0.8876, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.07% (0.3717 => 0.3831, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.95% (0.7966 => 0.8201, std.dev.: 0.0061) MultiSource/Applications/spiff/spiff: 2.94% (0.7950 => 0.8184, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.92% (0.8697 => 0.8951, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.87% (0.9069 => 0.9329, std.dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 2.85% (14.7684 => 15.1887, std.dev.: 0.0713) MultiSource/Applications/d/make_dparser: 2.82% (3.2366 => 3.3278, std.dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.79% (0.6227 => 0.6401, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 2.72% (1.9948 => 2.0491, std.dev.: 0.0098) MultiSource/Applications/SPASS/SPASS: 2.60% (14.2605 => 14.6318, std.dev.: 0.0935) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.54% (0.8420 => 0.8634, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.51% (0.9039 => 0.9266, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.51% (0.5817 => 0.5963, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.50% (0.8069 => 0.8271, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.50% (4.1763 => 4.2805, std.dev.: 0.0337) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.48% (0.8331 => 0.8538, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.39% (4.4880 => 4.5953, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.38% (0.8317 => 0.8515, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.37% (0.8286 => 0.8482, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 2.31% (15.3280 => 15.6827, std.dev.: 0.0936) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.30% (0.8086 => 0.8272, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.27% (1.6386 => 1.6758, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.24% (0.8050 => 0.8230, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.22% (1.2423 => 1.2699, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.18% (0.8338 => 0.8520, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.13% (0.8885 => 0.9074, std.dev.: 0.0058) MultiSource/Benchmarks/nbench/nbench: 2.12% (1.1271 => 1.1510, std.dev.: 0.0087) MultiSource/Applications/JM/ldecod/ldecod: 2.10% (6.7320 => 6.8733, std.dev.: 0.0389) MultiSource/Applications/lemon/lemon: 2.09% (1.0945 => 1.1174, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.06% (13.1811 => 13.4524, std.dev.: 0.0623) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.02% (0.8927 => 0.9107, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: 1.89% (4.1305 => 4.2087, std.dev.: 0.0229) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.88% (0.6586 => 0.6710, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.64% (2.1401 => 2.1751, std.dev.: 0.0088) MultiSource/Benchmarks/PAQ8p/paq8p: 1.59% (2.3764 => 2.4142, std.dev.: 0.0072) MultiSource/Applications/siod/siod: 1.48% (2.2184 => 2.2512, std.dev.: 0.0035) MultiSource/Applications/oggenc/oggenc: 1.22% (4.9628 => 5.0232, std.dev.: 0.0229) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.16% (1.5315 => 1.5493, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.13% (3.1832 => 3.2191, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 87.94% (0.0199 => 0.0374, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/pi: 57.54% (1.5795 => 2.4884, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.98% (0.7597 => 0.8963, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.41% (2.9753 => 3.4636, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.72% (2.7995 => 3.2117, std.dev.: 0.0494) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.43% (5.0261 => 5.6006, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.51% (0.3186 => 0.3489, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.05% (1.1857 => 1.2812, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/queens: 7.46% (1.7056 => 1.8329, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 6.78% (3.1873 => 3.4035, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.71% (4.7794 => 5.1001, std.dev.: 0.0326) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.87% (4.9686 => 5.2605, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.71% (4.5327 => 4.7916, std.dev.: 0.0345) SingleSource/Benchmarks/Misc/richards_benchmark: 5.53% (1.3037 => 1.3758, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.68% (6.2275 => 6.5190, std.dev.: 0.0349) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.27% (4.9453 => 5.1565, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.05% (4.9469 => 5.1471, std.dev.: 0.0316) MultiSource/Applications/hexxagon/hexxagon: 3.88% (14.0064 => 14.5496, std.dev.: 0.0279) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.81% (0.2887 => 0.2997, std.dev.: 0.0031) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.23% (1.2337 => 1.2735, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.87% (4.3552 => 4.4804, std.dev.: 0.0446) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.81% (11.5690 => 11.8945, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.65% (44.5605 => 45.7425, std.dev.: 0.3579) MultiSource/Applications/lambda-0_1_3/lambda: 2.65% (7.4933 => 7.6917, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.57% (8.2783 => 8.4909, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.45% (4.8660 => 4.9854, std.dev.: 0.0243) MultiSource/Applications/siod/siod: 2.41% (3.6643 => 3.7527, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/lists: 2.31% (7.3375 => 7.5070, std.dev.: 0.0163) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.08% (4.8362 => 4.9367, std.dev.: 0.0285) MultiSource/Applications/SPASS/SPASS: 1.59% (8.4326 => 8.5665, std.dev.: 0.0405) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.47% (2.4333 => 2.4691, std.dev.: 0.0121) SingleSource/Benchmarks/Misc/ReedSolomon: 1.28% (8.5322 => 8.6416, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.19% (3.5679 => 3.6104, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: 1.11% (2.3560 => 2.3822, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.06% (2.4647 => 2.4909, std.dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.35% (5.4641 => 4.2974, std.dev.: 0.0385) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.30% (1.0512 => 0.9324, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: -8.36% (63.1822 => 57.8988, std.dev.: 0.3461) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -8.27% (7.2130 => 6.6168, std.dev.: 0.0505) SingleSource/Benchmarks/McGill/chomp: -8.22% (1.1216 => 1.0294, std.dev.: 0.0237) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.86% (4.7482 => 4.4224, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.36% (0.3269 => 0.3061, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.08% (3.7148 => 3.4888, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.93% (5.4972 => 5.1714, std.dev.: 0.0331) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.53% (2.8773 => 2.7471, std.dev.: 0.0465) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.33% (4.7449 => 4.5394, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.79% (2.4490 => 2.3561, std.dev.: 0.0252) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.53% (0.5807 => 0.5602, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.41% (6.0224 => 5.8173, std.dev.: 0.0289) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.04% (28.5821 => 27.7126, std.dev.: 0.0119) MultiSource/Applications/lua/lua: -2.78% (29.8330 => 29.0036, std.dev.: 0.0646) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.36% (2.6356 => 2.5735, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.35% (3.2169 => 3.1414, std.dev.: 0.0162) MultiSource/Applications/aha/aha: -2.33% (3.3398 => 3.2620, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.21% (9.9065 => 9.6874, std.dev.: 0.0610) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.18% (1.2822 => 1.2542, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.98% (11.5316 => 11.3036, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/mason/mason: -1.96% (0.5415 => 0.5309, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: -1.70% (3.4237 => 3.3655, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.64% (4.9994 => 4.9172, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.18% (5.6343 => 5.5680, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.02% (4.2466 => 4.2034, std.dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.11% (16.4461 => 16.7924, std.dev.: 0.0225) MultiSource/Applications/obsequi/Obsequi: 3.85% (1.0262 => 1.0657, std.dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6850.66% (0.3123 => 21.7069, std.dev.: 0.2815) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.01% (0.2463 => 0.3670, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 1.21% (0.6010 => 0.6083, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.69% (0.3266 => 0.3354, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/strcat: 2.59% (0.1969 => 0.2020, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 52.03% (0.0123 => 0.0187, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.33% (0.0302 => 0.0303, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/casts: -13.68% (0.0190 => 0.0164, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: -15.00% (0.0180 => 0.0153, std.dev.: 0.0031) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.42% (0.1438 => 0.1432, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 4.38% (1.1329 => 1.1825, std.dev.: 0.0240) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -0.48% (0.1462 => 0.1455, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.67% (0.4164 => 0.4136, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.87% (0.1369 => 0.1463, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0641 => 0.0641, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 18.46% (0.0195 => 0.0231, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.29% (0.0578 => 0.0559, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.42% (1.1437 => 1.1943, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.34% (0.0627 => 0.0581, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.56% (0.0180 => 0.0179, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.64% (0.8017 => 0.7725, std.dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -8.06% (0.0062 => 0.0057, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 8 08:38:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 8 Nov 2012 10:38:58 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121108163858.751AE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5683?compare_to=5681&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5683, Order: 167583, Start Time: 2012-11-08 15:14:14, End Time: 2012-11-08 16:39:08 To: 5681, Order: 167576, Start Time: 2012-11-08 13:25:59, End Time: 2012-11-08 14:50:58 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (180 on baseline) Unchanged Tests: 1042 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.22% (2.0478 => 2.1137, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.4937 => 7.6823, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hash2: 2.25% (3.1932 => 3.2649, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.15% (0.1431 => 0.1300, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.19% (0.3821 => 0.3508, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: -7.74% (2.4924 => 2.2996, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.11% (0.9542 => 0.8864, std.dev.: 0.0108) MultiSource/Applications/sgefa/sgefa: -6.91% (0.3357 => 0.3125, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: -6.81% (0.2160 => 0.2013, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.78% (0.3142 => 0.2929, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.65% (3.5339 => 3.2989, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.64% (22.4056 => 20.9174, std.dev.: 0.0114) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.59% (0.2428 => 0.2268, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -6.58% (9.2283 => 8.6208, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: -6.57% (7.0961 => 6.6301, std.dev.: 0.0142) MultiSource/Applications/JM/lencod/lencod: -6.51% (16.1920 => 15.1381, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.51% (0.3658 => 0.3420, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.50% (0.1584 => 0.1481, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.49% (0.9852 => 0.9213, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.43% (0.4151 => 0.3884, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.32% (1.0544 => 0.9878, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.31% (6.7716 => 6.3442, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.29% (0.1796 => 0.1683, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/ReedSolomon: -6.28% (0.1879 => 0.1761, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.28% (0.6484 => 0.6077, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -6.25% (0.9179 => 0.8605, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.24% (0.2355 => 0.2208, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.24% (1.6364 => 1.5343, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.23% (1.3722 => 1.2867, std.dev.: 0.0047) MultiSource/Applications/Burg/burg: -6.22% (1.2515 => 1.1737, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary3: -6.21% (0.3446 => 0.3232, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.20% (1.2784 => 1.1992, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: -6.19% (0.2989 => 0.2804, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -6.18% (1.3148 => 1.2336, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.17% (4.0323 => 3.7834, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.15% (1.2300 => 1.1543, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.15% (0.3837 => 0.3601, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: -6.15% (4.3330 => 4.0667, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/moments: -6.14% (0.4248 => 0.3987, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -6.13% (0.3394 => 0.3186, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -6.12% (0.3481 => 0.3268, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.11% (4.5069 => 4.2317, std.dev.: 0.0089) MultiSource/Benchmarks/McCat/08-main/main: -6.09% (0.2659 => 0.2497, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.09% (1.4642 => 1.3750, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/except: -6.08% (0.3026 => 0.2842, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -6.08% (1.1530 => 1.0829, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: -6.07% (0.4861 => 0.4566, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.06% (0.3812 => 0.3581, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -6.05% (0.3255 => 0.3058, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.03% (0.3016 => 0.2834, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -6.03% (0.3831 => 0.3600, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -6.01% (1.1450 => 1.0762, std.dev.: 0.0114) SingleSource/UnitTests/ObjC/exceptions-4: -6.01% (0.3880 => 0.3647, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.00% (0.3849 => 0.3618, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.00% (0.4033 => 0.3791, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -5.99% (0.3621 => 0.3404, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.99% (0.2871 => 0.2699, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.99% (0.3057 => 0.2874, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -5.98% (0.3059 => 0.2876, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.98% (2.1713 => 2.0415, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.97% (0.3884 => 0.3652, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.97% (4.8802 => 4.5887, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: -5.96% (0.2985 => 0.2807, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: -5.96% (0.4176 => 0.3927, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -5.96% (0.1761 => 0.1656, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: -5.95% (0.3025 => 0.2845, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.95% (1.6474 => 1.5494, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -5.94% (4.0594 => 3.8183, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.94% (0.2695 => 0.2535, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.94% (0.3891 => 0.3660, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.93% (0.9557 => 0.8990, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.93% (0.3896 => 0.3665, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.93% (0.4083 => 0.3841, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.93% (4.8161 => 4.5307, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/exceptions-3: -5.93% (0.3848 => 0.3620, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.90% (5.4682 => 5.1456, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.89% (0.6736 => 0.6339, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.89% (0.2548 => 0.2398, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.87% (14.2083 => 13.3738, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.87% (0.3252 => 0.3061, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.87% (0.7919 => 0.7454, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: -5.87% (0.3867 => 0.3640, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -5.85% (0.3194 => 0.3007, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.85% (0.7021 => 0.6610, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -5.85% (34.0927 => 32.0972, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.84% (0.5857 => 0.5515, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: -5.84% (0.6750 => 0.6356, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: -5.83% (0.4515 => 0.4252, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.81% (0.5478 => 0.5160, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.80% (0.3483 => 0.3281, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -5.79% (2.4021 => 2.2629, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.79% (0.2903 => 0.2735, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: -5.77% (0.7447 => 0.7017, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.76% (0.4427 => 0.4172, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -5.76% (0.2849 => 0.2685, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.76% (0.4813 => 0.4536, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -5.74% (0.4199 => 0.3958, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.73% (0.5999 => 0.5655, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: -5.73% (17.1032 => 16.1227, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.73% (0.5863 => 0.5527, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.73% (0.3406 => 0.3211, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.72% (0.5591 => 0.5271, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -5.71% (0.3205 => 0.3022, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.71% (0.2278 => 0.2148, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: -5.70% (0.3788 => 0.3572, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -5.70% (0.3581 => 0.3377, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.69% (0.2933 => 0.2766, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -5.66% (15.5079 => 14.6296, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.66% (0.8521 => 0.8039, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.66% (0.4916 => 0.4638, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -5.65% (0.4280 => 0.4038, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.64% (0.3491 => 0.3294, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.61% (0.6189 => 0.5842, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.60% (0.4321 => 0.4079, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.59% (0.5168 => 0.4879, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.59% (0.5329 => 0.5031, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.59% (0.6297 => 0.5945, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.58% (0.7524 => 0.7104, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.58% (0.6293 => 0.5942, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.58% (0.6260 => 0.5911, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.57% (0.5581 => 0.5270, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.57% (0.6052 => 0.5715, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -5.56% (1.3864 => 1.3093, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.56% (0.5849 => 0.5524, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.54% (0.6230 => 0.5885, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.53% (0.5805 => 0.5484, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.52% (0.5925 => 0.5598, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: -5.51% (18.2933 => 17.2848, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.51% (0.5859 => 0.5536, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.51% (0.6681 => 0.6313, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.51% (0.6446 => 0.6091, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.51% (0.3323 => 0.3140, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.50% (0.7339 => 0.6935, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.50% (2.2587 => 2.1344, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.50% (8.0126 => 7.5722, std.dev.: 0.0032) MultiSource/Applications/d/make_dparser: -5.48% (3.5154 => 3.3227, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.47% (0.7198 => 0.6804, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.47% (0.5575 => 0.5270, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.46% (0.5569 => 0.5265, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.46% (0.5570 => 0.5266, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.46% (0.6194 => 0.5856, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.44% (0.3931 => 0.3717, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.44% (0.6304 => 0.5961, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.44% (0.6676 => 0.6313, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.44% (0.2999 => 0.2836, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.43% (0.6667 => 0.6305, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.43% (0.5456 => 0.5160, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: -5.42% (0.4524 => 0.4279, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.41% (0.2385 => 0.2256, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.39% (0.5802 => 0.5489, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.39% (0.6660 => 0.6301, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.39% (0.5567 => 0.5267, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -5.37% (0.7982 => 0.7553, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.37% (0.5941 => 0.5622, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.36% (0.6440 => 0.6095, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.33% (0.6395 => 0.6054, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.32% (1.2210 => 1.1560, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.30% (0.6033 => 0.5713, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -5.29% (2.1401 => 2.0269, std.dev.: 0.0124) MultiSource/Applications/ClamAV/clamscan: -5.27% (15.2527 => 14.4486, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.24% (0.5705 => 0.5406, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.24% (0.6395 => 0.6060, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.20% (0.5688 => 0.5392, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: -5.19% (0.7779 => 0.7375, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.16% (1.2221 => 1.1591, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: -5.10% (0.6347 => 0.6023, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.06% (0.3319 => 0.3151, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: -5.04% (0.3271 => 0.3106, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: -4.97% (0.6441 => 0.6121, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.89% (0.8418 => 0.8006, std.dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: -4.85% (5.0226 => 4.7792, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.54% (0.9077 => 0.8665, std.dev.: 0.0036) MultiSource/Applications/hbd/hbd: -4.16% (1.5610 => 1.4960, std.dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -2.85% (20.7746 => 20.1827, std.dev.: 0.0198) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7571, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1723, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.91% (1.7753 => 1.7058, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.81% (2.2633 => 2.1771, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.44% (1.3096 => 1.2776, std.dev.: 0.0088) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.61% (6.5735 => 6.4677, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0011) Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 8 09:23:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 8 Nov 2012 11:23:38 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121108172338.0B2332A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5684?compare_to=5679&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5684, Order: 167576, Start Time: 2012-11-08 14:08:24, End Time: 2012-11-08 17:23:48 To: 5679, Order: 167573, Start Time: 2012-11-08 10:04:55, End Time: 2012-11-08 13:20:31 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (168 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (722 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.40% (54.1254 => 54.8842, std.dev.: 0.0909) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.48% (0.0625 => 0.0878, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.08% (0.1063 => 0.1404, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.73% (0.2969 => 0.3733, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.23% (0.4253 => 0.5326, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.23% (0.1106 => 0.1385, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.79% (0.0714 => 0.0891, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.23% (0.4139 => 0.5142, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.75% (0.5900 => 0.7301, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.40% (0.0547 => 0.0675, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.37% (0.0475 => 0.0586, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 23.28% (1.5932 => 1.9641, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.97% (0.4994 => 0.6141, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.77% (0.0584 => 0.0717, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.62% (0.5000 => 0.6131, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.98% (0.1620 => 0.1976, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.84% (0.1021 => 0.1244, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.74% (0.0897 => 0.1092, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 21.54% (0.0599 => 0.0728, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.41% (0.1107 => 0.1344, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 20.89% (0.0948 => 0.1146, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0584 => 0.0704, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.40% (0.0642 => 0.0773, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.22% (0.1103 => 0.1326, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.11% (0.3903 => 0.4688, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 20.10% (0.0821 => 0.0986, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.94% (0.1003 => 0.1203, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 19.89% (0.1619 => 0.1941, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.83% (0.0822 => 0.0985, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.76% (0.1604 => 0.1921, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.75% (0.1549 => 0.1855, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 19.54% (0.0604 => 0.0722, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.74% (0.1462 => 0.1736, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 18.59% (0.0947 => 0.1123, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.35% (0.3890 => 0.4604, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 18.31% (0.5826 => 0.6893, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.17% (0.2014 => 0.2380, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 18.06% (0.1218 => 0.1438, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 17.97% (0.5889 => 0.6947, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 17.77% (0.0698 => 0.0822, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.65% (0.1088 => 0.1280, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.62% (0.2736 => 0.3218, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/09-vor/vor: 17.61% (0.1505 => 0.1770, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 17.55% (0.4029 => 0.4736, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.20% (0.2866 => 0.3359, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.10% (1.3152 => 1.5401, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.82% (0.1968 => 0.2299, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.77% (3.5627 => 4.1600, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 16.71% (0.5546 => 0.6473, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 16.51% (1.8794 => 2.1896, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.44% (0.4658 => 0.5424, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.33% (1.6211 => 1.8858, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.28% (0.2875 => 0.3343, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.12% (0.1160 => 0.1347, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.05% (0.3271 => 0.3796, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.98% (0.5026 => 0.5829, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 15.97% (0.1421 => 0.1648, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 15.96% (0.9697 => 1.1245, std.dev.: 0.0057) SingleSource/UnitTests/ObjC++/property-reference: 15.86% (0.7171 => 0.8308, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.80% (0.4361 => 0.5050, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 15.63% (0.2725 => 0.3151, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.60% (0.2738 => 0.3165, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 15.58% (0.1284 => 0.1484, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 15.55% (0.2714 => 0.3136, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 15.54% (0.2780 => 0.3212, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 15.53% (0.2750 => 0.3177, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 15.45% (0.3004 => 0.3468, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.45% (0.3930 => 0.4537, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.43% (0.2729 => 0.3150, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 15.38% (0.2803 => 0.3234, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 15.35% (1.0781 => 1.2436, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 15.30% (0.9909 => 1.1425, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/except: 15.30% (0.2811 => 0.3241, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.26% (0.2792 => 0.3218, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 15.23% (0.2823 => 0.3253, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 15.18% (0.2813 => 0.3240, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.11% (4.4195 => 5.0874, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.05% (0.3195 => 0.3676, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 15.05% (4.2109 => 4.8446, std.dev.: 0.0086) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.04% (2.7292 => 3.1396, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.01% (0.2911 => 0.3348, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.93% (2.0673 => 2.3759, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 14.89% (0.3096 => 0.3557, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.76% (1.9694 => 2.2601, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.72% (0.3362 => 0.3857, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 14.66% (23.5202 => 26.9677, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary2: 14.65% (0.3317 => 0.3803, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 14.60% (0.3267 => 0.3744, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 14.52% (0.3258 => 0.3731, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.51% (1.9966 => 2.2863, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.31% (0.3060 => 0.3498, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.22% (0.1090 => 0.1245, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 14.13% (0.3348 => 0.3821, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 14.07% (0.2566 => 0.2927, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.02% (0.3124 => 0.3562, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 13.89% (0.3678 => 0.4189, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.80% (0.3282 => 0.3735, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 13.77% (0.3726 => 0.4239, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 13.73% (0.2075 => 0.2360, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 13.57% (1.4269 => 1.6206, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.57% (0.3625 => 0.4117, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 13.43% (0.3477 => 0.3944, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 13.39% (0.4251 => 0.4820, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.36% (0.3690 => 0.4183, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.30% (0.3488 => 0.3952, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-4: 13.25% (0.3465 => 0.3924, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.24% (0.3981 => 0.4508, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 13.22% (0.3496 => 0.3958, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.21% (0.3845 => 0.4353, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 13.19% (0.4146 => 0.4693, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 13.10% (0.7875 => 0.8907, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 13.06% (0.3460 => 0.3912, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 13.06% (0.3446 => 0.3896, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 13.06% (0.3469 => 0.3922, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.99% (0.3442 => 0.3889, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.74% (0.3643 => 0.4107, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.71% (0.3650 => 0.4114, std.dev.: 0.0044) MultiSource/Applications/JM/ldecod/ldecod: 12.70% (2.1653 => 2.4403, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/bigfib: 12.57% (0.5012 => 0.5642, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 12.54% (0.3724 => 0.4191, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 12.40% (2.1013 => 2.3619, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 12.36% (4.6177 => 5.1885, std.dev.: 0.0086) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.91% (0.2040 => 0.2283, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 11.82% (0.2691 => 0.3009, std.dev.: 0.0048) MultiSource/Applications/SPASS/SPASS: 11.54% (5.5417 => 6.1812, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.28% (0.6435 => 0.7161, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.83% (0.2068 => 0.2292, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.71% (0.2737 => 0.3030, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.70% (0.1028 => 0.1138, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 10.52% (0.3498 => 0.3866, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.20% (0.1383 => 0.1524, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 10.05% (0.6634 => 0.7301, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.02% (0.3084 => 0.3393, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 9.99% (0.4847 => 0.5331, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 9.86% (0.3336 => 0.3665, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.46% (0.2103 => 0.2302, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 9.03% (0.2391 => 0.2607, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 8.93% (2.0346 => 2.2162, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.31% (4.6926 => 5.0825, std.dev.: 0.0054) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.25% (11.6398 => 12.5999, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.23% (0.5361 => 0.5802, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.61% (0.7426 => 0.7991, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.50% (0.5584 => 0.6003, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 6.30% (11.9555 => 12.7088, std.dev.: 0.0156) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.77% (0.3792 => 0.3935, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 9.99% (0.2802 => 0.3082, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6102, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6710, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1697, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-2: 4.59% (1.8057 => 1.8885, std.dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/dry: 4.16% (14.0481 => 14.6328, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2008, std.dev.: 0.0042) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.82% (3.1722 => 3.2299, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 1.44% (46.6247 => 47.2961, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2877, std.dev.: 0.0028) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5390, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5896, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.41% (2.4764 => 2.4414, std.dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5625, std.dev.: 0.0204) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9760, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7927, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -6.33% (0.2402 => 0.2250, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8055, std.dev.: 0.0033) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7724, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: -2.60% (17.2379 => 16.7893, std.dev.: 0.0734) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.34% (0.6293 => 0.6146, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8626, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5706, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4957, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1706, std.dev.: 0.0467) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0445, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 8 10:12:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 8 Nov 2012 12:12:10 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121108181210.863A12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5685?compare_to=5682&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5685, Order: 167587, Start Time: 2012-11-08 16:46:08, End Time: 2012-11-08 18:12:21 To: 5682, Order: 167582, Start Time: 2012-11-08 15:03:02, End Time: 2012-11-08 16:28:56 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 11 (103 on baseline) Performance Improvements: 2 (24 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 978 (847 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.76% (0.2223 => 0.2351, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.12% (0.3349 => 0.3487, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.48% (0.5093 => 0.5270, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.96% (0.8824 => 0.9085, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.85% (0.4764 => 0.4900, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.10% (0.5963 => 0.6088, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.17% (1.2099 => 1.2241, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.53% (0.3655 => 0.3784, std.dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 2.53% (8.5665 => 8.7829, std.dev.: 0.0749) SingleSource/Benchmarks/Misc/ffbench: 1.92% (1.3941 => 1.4208, std.dev.: 0.0102) MultiSource/Applications/lua/lua: 1.16% (29.0036 => 29.3397, std.dev.: 0.1273) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.35% (0.8318 => 0.8206, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -2.51% (1.0294 => 1.0036, std.dev.: 0.0098) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -1.09% (16.7924 => 16.6090, std.dev.: 0.2953) MultiSource/Applications/obsequi/Obsequi: 0.42% (1.0657 => 1.0702, std.dev.: 0.0067) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.77% (21.7069 => 21.5399, std.dev.: 0.0398) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.68% (0.3670 => 0.3645, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: -0.90% (0.6083 => 0.6028, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.57% (0.3354 => 0.3335, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/strcat: -0.64% (0.2020 => 0.2007, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 17.11% (0.0187 => 0.0219, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.84% (0.0427 => 0.0385, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -4.82% (0.0332 => 0.0316, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -9.90% (0.0303 => 0.0273, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -13.48% (0.0423 => 0.0366, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/casts: -21.95% (0.0164 => 0.0128, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/test1: -10.46% (0.0153 => 0.0137, std.dev.: 0.0039) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.26% (0.1432 => 0.1450, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -3.13% (1.1825 => 1.1455, std.dev.: 0.0295) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.85% (0.1455 => 0.1511, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.29% (0.4136 => 0.4124, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.19% (0.1463 => 0.1387, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.71% (0.0641 => 0.0598, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.33% (0.0231 => 0.0221, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.36% (0.0559 => 0.0561, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.16% (1.1943 => 1.1962, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.47% (0.0581 => 0.0636, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 37.99% (0.0179 => 0.0247, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.18% (0.7725 => 0.7711, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -66.67% (0.0003 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 38.60% (0.0057 => 0.0079, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2298.29% (0.6332 => 15.1860, std.dev.: 0.1432) MultiSource/Benchmarks/McCat/08-main/main: 47.02% (0.1831 => 0.2692, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.26% (0.1559 => 0.1477, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1479.43% (0.3344 => 5.2816, std.dev.: 0.0844) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.97% (0.2364 => 0.3238, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: 2.10% (0.0429 => 0.0438, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.36% (0.0224 => 0.0236, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -30.00% (0.0230 => 0.0161, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4334, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0693, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4947, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3379, std.dev.: 0.0437) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1183, std.dev.: 0.0202) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4012, std.dev.: 0.0065) SingleSource/Regression/C/uint64_to_float: -23.88% (2.1832 => 1.6619, std.dev.: 0.0020) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.17% (0.0810 => 0.0941, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 12.95% (0.1112 => 0.1256, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.52% (0.2279 => 0.2496, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.18% (0.8321 => 0.9085, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.73% (0.4847 => 0.5270, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.21% (0.1425 => 0.1542, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.84% (0.2180 => 0.2351, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.11% (0.1885 => 0.2019, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.61% (0.6010 => 0.6407, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.57% (0.7473 => 0.7964, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.00% (0.2998 => 0.3178, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.96% (0.8148 => 0.8634, std.dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.83% (0.3295 => 0.3487, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.47% (1.1606 => 1.2241, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.88% (0.2133 => 0.2237, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.79% (0.6287 => 0.6588, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.66% (0.5817 => 0.6088, std.dev.: 0.0037) MultiSource/Applications/Burg/burg: 4.11% (1.2222 => 1.2724, std.dev.: 0.0044) MultiSource/Applications/hbd/hbd: 3.85% (1.4269 => 1.4819, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.79% (1.1685 => 1.2128, std.dev.: 0.0075) MultiSource/Applications/spiff/spiff: 3.71% (0.7950 => 0.8245, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.43% (0.9435 => 0.9759, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.98% (0.4127 => 0.4250, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 2.86% (0.4125 => 0.4243, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.75% (4.1763 => 4.2913, std.dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.71% (1.4479 => 1.4871, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.69% (1.6386 => 1.6826, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.67% (0.8697 => 0.8929, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.67% (6.6074 => 6.7835, std.dev.: 0.0444) MultiSource/Applications/treecc/treecc: 2.65% (1.9948 => 2.0477, std.dev.: 0.0133) MultiSource/Applications/ClamAV/clamscan: 2.55% (14.7684 => 15.1456, std.dev.: 0.0259) MultiSource/Applications/SIBsim4/SIBsim4: 2.50% (1.2568 => 1.2882, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.45% (0.4783 => 0.4900, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 2.40% (14.2605 => 14.6024, std.dev.: 0.0630) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.38% (0.8457 => 0.8658, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.37% (0.4559 => 0.4667, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.32% (0.8204 => 0.8394, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.26% (0.8331 => 0.8519, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.25% (0.8007 => 0.8187, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.23% (0.8261 => 0.8445, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.20% (0.8050 => 0.8227, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.16% (0.7966 => 0.8138, std.dev.: 0.0024) MultiSource/Applications/d/make_dparser: 2.11% (3.2366 => 3.3050, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.08% (0.7932 => 0.8097, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.07% (0.9908 => 1.0113, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.07% (0.8420 => 0.8594, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.06% (0.8927 => 0.9111, std.dev.: 0.0054) MultiSource/Applications/JM/lencod/lencod: 2.06% (15.3280 => 15.6437, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.04% (0.9074 => 0.9259, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.02% (0.8359 => 0.8528, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.02% (0.8317 => 0.8485, std.dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: 2.01% (6.7320 => 6.8674, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.99% (0.8048 => 0.8208, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.96% (0.9688 => 0.9878, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.94% (0.8716 => 0.8885, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.93% (0.8656 => 0.8823, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.92% (4.4880 => 4.5743, std.dev.: 0.0218) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.90% (0.8086 => 0.8240, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.89% (0.8712 => 0.8877, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.85% (0.8518 => 0.8676, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.85% (0.8805 => 0.8968, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.84% (0.8855 => 0.9018, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.78% (0.8316 => 0.8464, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.74% (0.8066 => 0.8206, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.71% (0.8340 => 0.8483, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.62% (13.1811 => 13.3950, std.dev.: 0.0665) MultiSource/Applications/lemon/lemon: 1.37% (1.0945 => 1.1095, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 1.36% (8.6247 => 8.7416, std.dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: 1.20% (2.3764 => 2.4049, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 1.16% (31.8598 => 32.2295, std.dev.: 0.0413) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 108.54% (0.0199 => 0.0415, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/pi: 57.33% (1.5795 => 2.4850, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.05% (2.9753 => 3.4527, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.89% (0.7597 => 0.8804, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.93% (2.7995 => 3.2175, std.dev.: 0.0520) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.58% (5.0261 => 5.6079, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.98% (6.3772 => 6.9500, std.dev.: 0.2082) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.20% (1.1857 => 1.2829, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 7.31% (1.7056 => 1.8302, std.dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 6.50% (3.1873 => 3.3945, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: 5.99% (1.3037 => 1.3818, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.90% (4.9686 => 5.2616, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.86% (4.5327 => 4.7981, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/treeadd/treeadd: 5.49% (0.3587 => 0.3784, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.54% (6.2275 => 6.5104, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.42% (3.3761 => 3.5254, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.22% (4.9453 => 5.1541, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 4.15% (8.4326 => 8.7829, std.dev.: 0.0749) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.07% (4.9469 => 5.1481, std.dev.: 0.0135) MultiSource/Applications/hexxagon/hexxagon: 3.89% (14.0064 => 14.5518, std.dev.: 0.0139) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.88% (0.2887 => 0.2999, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.88% (11.5690 => 11.9019, std.dev.: 0.0085) MultiSource/Applications/siod/siod: 2.78% (3.6643 => 3.7663, std.dev.: 0.0053) MultiSource/Applications/lambda-0_1_3/lambda: 2.74% (7.4933 => 7.6984, std.dev.: 0.0354) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.72% (8.2783 => 8.5034, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout/lists: 2.31% (7.3375 => 7.5071, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.28% (4.8660 => 4.9768, std.dev.: 0.0220) SingleSource/Benchmarks/Dhrystone/dry: 2.09% (0.5081 => 0.5187, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (1.1365 => 1.1523, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/ReedSolomon: 1.39% (8.5322 => 8.6507, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.37% (4.0473 => 4.1027, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.29% (2.4647 => 2.4964, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.26% (3.5679 => 3.6129, std.dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.43% (5.4641 => 4.2929, std.dev.: 0.0212) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.11% (1.0512 => 0.9344, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: -10.52% (1.1216 => 1.0036, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.75% (0.3269 => 0.2983, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: -8.59% (63.1822 => 57.7552, std.dev.: 0.0273) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.83% (4.7482 => 4.4237, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.90% (5.4972 => 5.1727, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.07% (5.1557 => 4.8941, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.32% (4.7449 => 4.5398, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.82% (2.8773 => 2.7675, std.dev.: 0.0387) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.77% (6.0224 => 5.7953, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.30% (2.4490 => 2.3682, std.dev.: 0.0281) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (28.5821 => 27.6901, std.dev.: 0.0204) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.96% (0.5807 => 0.5635, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.52% (9.9065 => 9.6572, std.dev.: 0.0857) MultiSource/Applications/aha/aha: -2.50% (3.3398 => 3.2564, std.dev.: 0.0229) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.28% (2.6356 => 2.5756, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.94% (11.5316 => 11.3079, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.75% (4.9994 => 4.9120, std.dev.: 0.0045) MultiSource/Applications/lua/lua: -1.65% (29.8330 => 29.3397, std.dev.: 0.1273) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.62% (3.2169 => 3.1647, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/hash2: -1.47% (3.4237 => 3.3734, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.33% (2.3487 => 2.3175, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.23% (5.6343 => 5.5649, std.dev.: 0.0011) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.99% (16.4461 => 16.6090, std.dev.: 0.2953) MultiSource/Applications/obsequi/Obsequi: 4.29% (1.0262 => 1.0702, std.dev.: 0.0067) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6797.18% (0.3123 => 21.5399, std.dev.: 0.0398) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.99% (0.2463 => 0.3645, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 0.30% (0.6010 => 0.6028, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.11% (0.3266 => 0.3335, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/strcat: 1.93% (0.1969 => 0.2007, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.64% (0.0408 => 0.0385, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 24.41% (0.0254 => 0.0316, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -9.60% (0.0302 => 0.0273, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.69% (0.0384 => 0.0366, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/casts: -32.63% (0.0190 => 0.0128, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/test1: -23.89% (0.0180 => 0.0137, std.dev.: 0.0039) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.83% (0.1438 => 0.1450, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.11% (1.1329 => 1.1455, std.dev.: 0.0295) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.35% (0.1462 => 0.1511, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.96% (0.4164 => 0.4124, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.31% (0.1369 => 0.1387, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.71% (0.0641 => 0.0598, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 13.33% (0.0195 => 0.0221, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.94% (0.0578 => 0.0561, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.59% (1.1437 => 1.1962, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.44% (0.0627 => 0.0636, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 37.22% (0.0180 => 0.0247, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.82% (0.8017 => 0.7711, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 27.42% (0.0062 => 0.0079, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 8 10:27:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 8 Nov 2012 12:27:27 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121108182727.76EC22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5686?compare_to=5683&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5686, Order: 167588, Start Time: 2012-11-08 17:02:39, End Time: 2012-11-08 18:27:37 To: 5683, Order: 167583, Start Time: 2012-11-08 15:14:14, End Time: 2012-11-08 16:39:08 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 1 (179 on baseline) Unchanged Tests: 1041 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.01% (3.7248 => 3.6870, std.dev.: 0.0105) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1014, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 2.55% (7.4937 => 7.6847, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash2: 2.10% (3.1932 => 3.2602, std.dev.: 0.0051) MultiSource/Benchmarks/llubenchmark/llu: 1.55% (3.7435 => 3.8016, std.dev.: 0.0126) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.15% (0.1431 => 0.1300, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.93% (0.3821 => 0.3518, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -7.73% (2.4924 => 2.2998, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.03% (0.3142 => 0.2921, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.90% (0.9542 => 0.8884, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -6.85% (0.2160 => 0.2012, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.85% (0.3357 => 0.3127, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.78% (3.5339 => 3.2944, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.69% (22.4056 => 20.9060, std.dev.: 0.0085) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.63% (0.2428 => 0.2267, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -6.52% (9.2283 => 8.6262, std.dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: -6.51% (7.0961 => 6.6340, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: -6.50% (16.1920 => 15.1395, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.42% (0.6484 => 0.6068, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.41% (0.9852 => 0.9220, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.34% (0.4151 => 0.3888, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.31% (1.3722 => 1.2856, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.30% (1.0544 => 0.9880, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.26% (0.3658 => 0.3429, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.24% (6.7716 => 6.3488, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.24% (0.2355 => 0.2208, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: -6.22% (0.2989 => 0.2803, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -6.19% (1.2515 => 1.1740, std.dev.: 0.0047) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.18% (0.1716 => 0.1610, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: -6.14% (4.3330 => 4.0670, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/football/football: -6.12% (0.9179 => 0.8617, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/ary2: -6.09% (0.3481 => 0.3269, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.09% (1.2300 => 1.1551, std.dev.: 0.0098) MultiSource/Applications/lemon/lemon: -6.08% (1.1450 => 1.0754, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.07% (0.3837 => 0.3604, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.05% (1.2784 => 1.2010, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -6.05% (0.3026 => 0.2843, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -6.05% (1.3148 => 1.2353, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -6.04% (0.3446 => 0.3238, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.03% (0.3831 => 0.3600, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -6.03% (0.4248 => 0.3992, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.02% (1.6474 => 1.5483, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/ary: -6.01% (0.3394 => 0.3190, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.01% (0.3812 => 0.3583, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -6.01% (0.4861 => 0.4569, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.00% (0.3849 => 0.3618, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -6.00% (0.4033 => 0.3791, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.99% (0.3891 => 0.3658, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: -5.98% (0.3880 => 0.3648, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.98% (1.6364 => 1.5386, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.97% (4.8161 => 4.5285, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.97% (4.8802 => 4.5889, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.97% (4.5069 => 4.2379, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/synchronized: -5.95% (0.3896 => 0.3664, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.95% (4.0323 => 3.7922, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-3: -5.95% (0.3848 => 0.3619, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: -5.95% (0.3059 => 0.2877, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -5.94% (0.3621 => 0.3406, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.94% (2.1713 => 2.0424, std.dev.: 0.0131) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.92% (0.3884 => 0.3654, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.92% (0.2871 => 0.2701, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: -5.91% (0.4176 => 0.3929, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.91% (5.4682 => 5.1451, std.dev.: 0.0215) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.89% (14.2083 => 13.3718, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/methcall: -5.88% (0.3025 => 0.2847, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.88% (0.4083 => 0.3843, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.87% (0.3016 => 0.2839, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.87% (0.2659 => 0.2503, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.86% (0.2695 => 0.2537, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: -5.85% (0.7447 => 0.7011, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -5.83% (0.2985 => 0.2811, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.83% (0.7021 => 0.6612, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.82% (0.3057 => 0.2879, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -5.82% (0.2939 => 0.2768, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.81% (1.4642 => 1.3791, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.81% (0.3252 => 0.3063, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.81% (0.9557 => 0.9002, std.dev.: 0.0013) MultiSource/Applications/lua/lua: -5.80% (4.0594 => 3.8241, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -5.80% (34.0927 => 32.1169, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.78% (0.5863 => 0.5524, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -5.78% (0.6750 => 0.6360, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -5.78% (0.3255 => 0.3067, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.77% (0.3483 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.76% (0.3194 => 0.3010, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -5.76% (0.2849 => 0.2685, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.75% (0.5478 => 0.5163, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/lists1: -5.74% (0.3867 => 0.3645, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.73% (0.2933 => 0.2765, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.73% (0.3406 => 0.3211, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -5.72% (17.1032 => 16.1250, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/05-eks/eks: -5.71% (0.4515 => 0.4257, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -5.71% (15.5079 => 14.6220, std.dev.: 0.0176) MultiSource/Applications/siod/siod: -5.71% (2.4021 => 2.2649, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: -5.71% (0.3205 => 0.3022, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: -5.71% (1.1530 => 1.0872, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -5.70% (0.4280 => 0.4036, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.69% (0.4427 => 0.4175, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.69% (0.2548 => 0.2403, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.69% (0.5591 => 0.5273, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.69% (0.6736 => 0.6353, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: -5.67% (0.4199 => 0.3961, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.66% (1.3864 => 1.3079, std.dev.: 0.0089) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.65% (0.4813 => 0.4541, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.64% (0.6297 => 0.5942, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.63% (0.5329 => 0.5029, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.62% (0.5849 => 0.5520, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.62% (0.4321 => 0.4078, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: -5.62% (0.3788 => 0.3575, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.62% (0.7524 => 0.7101, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.62% (0.5857 => 0.5528, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: -5.61% (0.3581 => 0.3380, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.60% (2.2587 => 2.1321, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.60% (0.6304 => 0.5951, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.59% (0.6293 => 0.5941, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.59% (0.5581 => 0.5269, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.57% (0.4916 => 0.4642, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.56% (0.7919 => 0.7479, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.54% (0.5925 => 0.5597, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -5.53% (3.5154 => 3.3209, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.53% (0.5570 => 0.5262, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.53% (0.3491 => 0.3298, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.52% (0.5999 => 0.5668, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.51% (0.5168 => 0.4883, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.51% (0.6194 => 0.5853, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.50% (0.5802 => 0.5483, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.49% (0.3931 => 0.3715, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.49% (0.2278 => 0.2153, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.48% (0.5805 => 0.5487, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.48% (0.6189 => 0.5850, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.48% (0.5569 => 0.5264, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.47% (0.7198 => 0.6804, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.47% (8.0126 => 7.5742, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.47% (0.6052 => 0.5721, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.47% (0.2999 => 0.2835, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.46% (0.6230 => 0.5890, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.44% (0.7339 => 0.6940, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.43% (0.6260 => 0.5920, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: -5.42% (18.2933 => 17.3017, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.41% (0.5859 => 0.5542, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.41% (0.6676 => 0.6315, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.41% (0.6660 => 0.6300, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.40% (1.2221 => 1.1561, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.40% (0.5575 => 0.5274, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.40% (0.5705 => 0.5397, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.40% (0.6446 => 0.6098, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.39% (0.5941 => 0.5621, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.38% (0.6395 => 0.6051, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.38% (0.6395 => 0.6051, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: -5.37% (0.4524 => 0.4281, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.35% (0.6667 => 0.6310, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.35% (0.5567 => 0.5269, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.33% (0.5456 => 0.5165, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.32% (1.2210 => 1.1560, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: -5.32% (0.1879 => 0.1779, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.30% (0.8521 => 0.8069, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.25% (0.6681 => 0.6330, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -5.22% (0.7982 => 0.7565, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -5.21% (0.7779 => 0.7374, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.21% (0.3323 => 0.3150, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -5.20% (15.2527 => 14.4592, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.19% (0.5688 => 0.5393, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.17% (0.6033 => 0.5721, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.17% (0.2903 => 0.2753, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: -5.12% (2.1401 => 2.0305, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.07% (0.2385 => 0.2264, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -5.04% (0.6347 => 0.6027, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: -4.98% (0.6441 => 0.6120, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.92% (0.3271 => 0.3110, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.89% (0.2106 => 0.2003, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -4.85% (5.0226 => 4.7791, std.dev.: 0.0137) MultiSource/Applications/spiff/spiff: -4.82% (0.8418 => 0.8012, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.49% (0.3319 => 0.3170, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -4.16% (1.5610 => 1.4960, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.11% (0.9077 => 0.8704, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -2.88% (20.7746 => 20.1761, std.dev.: 0.0089) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7517, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/richards_benchmark: -8.69% (1.2842 => 1.1726, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.99% (2.2633 => 2.1729, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.01% (1.0557 => 1.0239, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.48% (6.5735 => 6.4762, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0003) Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 8 11:54:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 8 Nov 2012 13:54:45 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121108195445.3FCC42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5687?compare_to=5685&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5687, Order: 167588, Start Time: 2012-11-08 18:29:09, End Time: 2012-11-08 19:54:57 To: 5685, Order: 167587, Start Time: 2012-11-08 16:46:08, End Time: 2012-11-08 18:12:21 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 6 (80 on baseline) Performance Improvements: 8 (28 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 977 (866 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.14% (1.4975 => 1.8890, std.dev.: 0.0415) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.72% (40.4528 => 41.5549, std.dev.: 0.2192) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.61% (44.5557 => 45.7165, std.dev.: 0.2662) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.69% (3.8933 => 3.9592, std.dev.: 0.0194) SingleSource/Benchmarks/Misc/fp-convert: 1.64% (15.6185 => 15.8747, std.dev.: 0.0245) SingleSource/Benchmarks/Shootout-C++/methcall: 1.07% (8.9331 => 9.0284, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.81% (0.6407 => 0.6163, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/loader/loader: -3.33% (0.3122 => 0.3018, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -2.61% (0.6088 => 0.5929, std.dev.: 0.0054) SingleSource/UnitTests/Vector/constpool: -2.61% (8.5472 => 8.3242, std.dev.: 0.0828) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.17% (1.2762 => 1.2613, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -8.31% (3.2947 => 3.0208, std.dev.: 0.0895) MultiSource/Applications/SPASS/SPASS: -3.32% (8.7829 => 8.4911, std.dev.: 0.1025) SingleSource/Benchmarks/Misc/ffbench: -1.37% (1.4208 => 1.4013, std.dev.: 0.0071) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.02% (16.6090 => 16.6131, std.dev.: 0.0919) MultiSource/Applications/obsequi/Obsequi: -1.21% (1.0702 => 1.0573, std.dev.: 0.0118) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.69% (21.5399 => 21.6893, std.dev.: 0.1850) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.05% (0.3645 => 0.3643, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 0.12% (0.6028 => 0.6035, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.30% (0.3335 => 0.3325, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 0.60% (0.2007 => 0.2019, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0219 => 0.0219, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 10.39% (0.0385 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -20.25% (0.0316 => 0.0252, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -15.38% (0.0273 => 0.0231, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 15.03% (0.0366 => 0.0421, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 57.81% (0.0128 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 58.39% (0.0137 => 0.0217, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1000.00% (0.0001 => 0.0011, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: - (0.1450 => 0.1450, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: 0.86% (1.1455 => 1.1553, std.dev.: 0.0193) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -6.09% (0.1511 => 0.1419, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.75% (0.4124 => 0.4155, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.31% (0.1387 => 0.1419, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.70% (0.0598 => 0.0650, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 4.07% (0.0221 => 0.0230, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.07% (0.0561 => 0.0567, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.20% (1.1962 => 1.1986, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -42.31% (0.0026 => 0.0015, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.11% (0.0636 => 0.0559, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.02% (0.0247 => 0.0242, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.00% (0.7711 => 0.7788, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -39.24% (0.0079 => 0.0048, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2319.77% (0.6332 => 15.3220, std.dev.: 0.0688) MultiSource/Benchmarks/McCat/08-main/main: 46.70% (0.1831 => 0.2686, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.66% (0.1559 => 0.1424, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1482.30% (0.3344 => 5.2912, std.dev.: 0.0159) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.45% (0.2364 => 0.3202, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: 3.73% (0.0429 => 0.0445, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -18.30% (0.0224 => 0.0183, std.dev.: 0.0025) SingleSource/UnitTests/byval-alignment: -30.87% (0.0230 => 0.0159, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4261, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0714, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4893, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3442, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1614, std.dev.: 0.0237) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4024, std.dev.: 0.0041) SingleSource/Regression/C/uint64_to_float: -23.74% (2.1832 => 1.6648, std.dev.: 0.0039) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 12.84% (0.0810 => 0.0914, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/tsp/tsp: 9.62% (0.1112 => 0.1219, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.96% (0.2180 => 0.2310, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.66% (0.2279 => 0.2408, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.61% (0.2519 => 0.2635, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.82% (0.8148 => 0.8459, std.dev.: 0.0069) MultiSource/Applications/spiff/spiff: 3.30% (0.7950 => 0.8212, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.25% (0.3295 => 0.3402, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.25% (0.4127 => 0.4261, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 2.94% (1.4269 => 1.4688, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.83% (0.8697 => 0.8943, std.dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: 2.55% (14.7684 => 15.1448, std.dev.: 0.0962) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.51% (1.6386 => 1.6797, std.dev.: 0.0077) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.50% (6.6074 => 6.7723, std.dev.: 0.0635) MultiSource/Applications/SIBsim4/SIBsim4: 2.49% (1.2568 => 1.2881, std.dev.: 0.0054) MultiSource/Applications/SPASS/SPASS: 2.39% (14.2605 => 14.6007, std.dev.: 0.1055) MultiSource/Applications/lua/lua: 2.32% (3.8189 => 3.9076, std.dev.: 0.0265) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.28% (13.1811 => 13.4813, std.dev.: 0.0291) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.24% (0.8317 => 0.8503, std.dev.: 0.0052) MultiSource/Applications/d/make_dparser: 2.23% (3.2366 => 3.3087, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.20% (0.8177 => 0.8357, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.17% (0.8261 => 0.8440, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.16% (0.5961 => 0.6090, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.16% (0.8069 => 0.8243, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.15% (0.8518 => 0.8701, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.09% (0.8286 => 0.8459, std.dev.: 0.0052) MultiSource/Applications/minisat/minisat: 2.05% (0.6834 => 0.6974, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.05% (0.8066 => 0.8231, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.00% (0.7932 => 0.8091, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.97% (0.8340 => 0.8504, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.96% (0.8716 => 0.8887, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.93% (0.8457 => 0.8620, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.90% (0.8048 => 0.8201, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.89% (0.8712 => 0.8877, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.89% (4.1763 => 4.2553, std.dev.: 0.0142) MultiSource/Benchmarks/MallocBench/gs/gs: 1.87% (4.1305 => 4.2076, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.86% (0.8885 => 0.9050, std.dev.: 0.0058) MultiSource/Applications/JM/ldecod/ldecod: 1.80% (6.7320 => 6.8532, std.dev.: 0.0262) MultiSource/Applications/oggenc/oggenc: 1.70% (4.9628 => 5.0473, std.dev.: 0.0130) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.59% (4.4880 => 4.5593, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.58% (0.8995 => 0.9137, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.56% (0.8927 => 0.9066, std.dev.: 0.0051) MultiSource/Applications/siod/siod: 1.53% (2.2184 => 2.2524, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.50% (0.8805 => 0.8937, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.45% (2.1401 => 2.1712, std.dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: 1.43% (2.3764 => 2.4103, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.28% (8.6476 => 8.7585, std.dev.: 0.0393) MultiSource/Applications/lemon/lemon: 1.02% (1.0945 => 1.1057, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 95.98% (0.0199 => 0.0390, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/pi: 58.37% (1.5795 => 2.5015, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.09% (0.7597 => 0.8895, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.36% (2.9753 => 3.4622, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.57% (2.7995 => 3.2073, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.61% (5.0261 => 5.6095, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.06% (1.1857 => 1.2813, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.01% (4.7794 => 5.1145, std.dev.: 0.0117) SingleSource/Benchmarks/McGill/queens: 6.97% (1.7056 => 1.8245, std.dev.: 0.0036) MultiSource/Applications/SIBsim4/SIBsim4: 6.32% (3.1873 => 3.3887, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.89% (4.5327 => 4.7998, std.dev.: 0.0519) SingleSource/Benchmarks/Misc/richards_benchmark: 5.78% (1.3037 => 1.3790, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.74% (4.9686 => 5.2540, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.70% (3.3761 => 3.5349, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.46% (4.9453 => 5.1659, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.31% (6.2275 => 6.4958, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.16% (4.9469 => 5.1526, std.dev.: 0.0073) MultiSource/Applications/hexxagon/hexxagon: 3.93% (14.0064 => 14.5575, std.dev.: 0.0214) MultiSource/Applications/lambda-0_1_3/lambda: 3.09% (7.4933 => 7.7249, std.dev.: 0.0118) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.93% (0.3587 => 0.3692, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.80% (8.2783 => 8.5101, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.80% (11.5690 => 11.8927, std.dev.: 0.0062) MultiSource/Applications/siod/siod: 2.70% (3.6643 => 3.7631, std.dev.: 0.0291) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.59% (44.5605 => 45.7165, std.dev.: 0.2662) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.43% (4.8362 => 4.9535, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout/lists: 2.14% (7.3375 => 7.4944, std.dev.: 0.0122) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.58% (2.4647 => 2.5036, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.50% (3.9006 => 3.9592, std.dev.: 0.0194) SingleSource/Benchmarks/Stanford/FloatMM: 1.34% (0.8807 => 0.8925, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 1.28% (8.5322 => 8.6415, std.dev.: 0.0336) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.16% (3.5679 => 3.6094, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 1.12% (2.3560 => 2.3825, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.08% (5.4641 => 4.3123, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.09% (7.2130 => 6.1968, std.dev.: 0.1472) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.12% (1.0512 => 0.9343, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -10.89% (1.1216 => 0.9995, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: -8.50% (63.1822 => 57.8101, std.dev.: 0.1311) SingleSource/Benchmarks/Shootout/heapsort: -8.25% (3.2926 => 3.0208, std.dev.: 0.0895) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.95% (0.3269 => 0.3009, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.81% (4.7482 => 4.4248, std.dev.: 0.0465) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.97% (3.7148 => 3.4930, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.72% (5.4972 => 5.1825, std.dev.: 0.0918) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.03% (5.1557 => 4.8963, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.36% (4.7449 => 4.5379, std.dev.: 0.0169) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.01% (2.4490 => 2.3508, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.73% (6.0224 => 5.7976, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.22% (0.5807 => 0.5620, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (28.5821 => 27.6678, std.dev.: 0.0211) MultiSource/Benchmarks/Prolangs-C++/life/life: -3.02% (2.6356 => 2.5559, std.dev.: 0.0103) MultiSource/Applications/lua/lua: -2.47% (29.8330 => 29.0951, std.dev.: 0.0844) MultiSource/Applications/aha/aha: -2.38% (3.3398 => 3.2604, std.dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.26% (1.0388 => 1.0153, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/mason/mason: -2.22% (0.5415 => 0.5295, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.16% (11.5316 => 11.2830, std.dev.: 0.0249) SingleSource/Benchmarks/Misc/ffbench: -1.98% (1.4296 => 1.4013, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.94% (9.9065 => 9.7146, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/hash2: -1.47% (3.4237 => 3.3735, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.3487 => 2.3156, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.40% (4.9994 => 4.9296, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.31% (3.2169 => 3.1749, std.dev.: 0.0130) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.02% (16.4461 => 16.6131, std.dev.: 0.0919) MultiSource/Applications/obsequi/Obsequi: 3.03% (1.0262 => 1.0573, std.dev.: 0.0118) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6845.02% (0.3123 => 21.6893, std.dev.: 0.1850) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.91% (0.2463 => 0.3643, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 0.42% (0.6010 => 0.6035, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.81% (0.3266 => 0.3325, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 2.54% (0.1969 => 0.2019, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.79% (0.0254 => 0.0252, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -23.51% (0.0302 => 0.0231, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.64% (0.0384 => 0.0421, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 57.14% (0.0007 => 0.0011, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.83% (0.1438 => 0.1450, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: 1.98% (1.1329 => 1.1553, std.dev.: 0.0193) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -2.94% (0.1462 => 0.1419, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.22% (0.4164 => 0.4155, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.65% (0.1369 => 0.1419, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.40% (0.0641 => 0.0650, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 17.95% (0.0195 => 0.0230, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.90% (0.0578 => 0.0567, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.80% (1.1437 => 1.1986, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 7.14% (0.0014 => 0.0015, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.85% (0.0627 => 0.0559, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 34.44% (0.0180 => 0.0242, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.86% (0.8017 => 0.7788, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -22.58% (0.0062 => 0.0048, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 8 12:36:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 8 Nov 2012 14:36:24 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121108203624.2F36A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5688?compare_to=5686&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5688, Order: 167591, Start Time: 2012-11-08 19:11:48, End Time: 2012-11-08 20:36:34 To: 5686, Order: 167588, Start Time: 2012-11-08 17:02:39, End Time: 2012-11-08 18:27:37 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 1 (184 on baseline) Unchanged Tests: 1040 (853 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.63% (54.4329 => 55.8641, std.dev.: 0.3766) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -4.19% (0.3914 => 0.3750, std.dev.: 0.0051) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.72% (2.0478 => 2.1035, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/salsa20: 2.39% (7.4937 => 7.6728, std.dev.: 0.0182) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.36% (54.5751 => 55.8641, std.dev.: 0.3766) SingleSource/Benchmarks/Shootout-C++/hash2: 1.92% (3.1932 => 3.2544, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.29% (0.1431 => 0.1298, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -7.74% (2.4924 => 2.2994, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.67% (0.3821 => 0.3528, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -7.26% (0.3831 => 0.3553, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -7.24% (0.3880 => 0.3599, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -7.21% (0.3812 => 0.3537, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -7.20% (0.3848 => 0.3571, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -7.17% (0.4033 => 0.3744, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.16% (0.3142 => 0.2917, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.16% (0.3884 => 0.3606, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.14% (0.3891 => 0.3613, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/synchronized: -7.14% (0.3896 => 0.3618, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/oourafft: -6.94% (0.2160 => 0.2010, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -6.92% (0.4176 => 0.3887, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.91% (0.3357 => 0.3125, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.87% (0.9542 => 0.8886, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -6.86% (0.4199 => 0.3911, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.79% (3.5339 => 3.2939, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.75% (0.2428 => 0.2264, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -6.68% (0.4280 => 0.3994, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -6.66% (7.0961 => 6.6234, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.65% (22.4056 => 20.9148, std.dev.: 0.0187) MultiSource/Benchmarks/mafft/pairlocalalign: -6.60% (9.2283 => 8.6191, std.dev.: 0.0043) MultiSource/Applications/JM/lencod/lencod: -6.56% (16.1920 => 15.1299, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.53% (0.3658 => 0.3419, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.52% (0.9852 => 0.9210, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.50% (6.7716 => 6.3315, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.48% (0.6484 => 0.6064, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.47% (1.0544 => 0.9862, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.44% (0.1584 => 0.1482, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.41% (0.2355 => 0.2204, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.40% (0.1796 => 0.1681, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: -6.40% (1.2515 => 1.1714, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.34% (0.4151 => 0.3888, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: -6.33% (4.3330 => 4.0587, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/football/football: -6.33% (0.9179 => 0.8598, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.33% (1.3722 => 1.2854, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.29% (0.1716 => 0.1608, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.28% (4.5069 => 4.2238, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ReedSolomon: -6.28% (0.1879 => 0.1761, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.27% (4.8161 => 4.5141, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.25% (1.2784 => 1.1985, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.24% (4.0323 => 3.7806, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.24% (1.2300 => 1.1533, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -6.23% (0.2985 => 0.2799, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.22% (4.8802 => 4.5765, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.20% (0.6293 => 0.5903, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.19% (1.4642 => 1.3736, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: -6.17% (0.2659 => 0.2495, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.15% (1.6364 => 1.5358, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -6.14% (1.1450 => 1.0747, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -6.08% (1.3148 => 1.2348, std.dev.: 0.0015) MultiSource/Applications/lua/lua: -6.06% (4.0594 => 3.8133, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.05% (0.2695 => 0.2532, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.04% (14.2083 => 13.3503, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.99% (1.6474 => 1.5488, std.dev.: 0.0155) MultiSource/Benchmarks/McCat/05-eks/eks: -5.98% (0.4515 => 0.4245, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.97% (0.7919 => 0.7446, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.97% (0.3483 => 0.3275, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.97% (0.3837 => 0.3608, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -5.96% (34.0927 => 32.0619, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/ary2: -5.95% (0.3481 => 0.3274, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -5.93% (0.3406 => 0.3204, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.93% (0.2278 => 0.2143, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.93% (0.2548 => 0.2397, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -5.92% (1.1530 => 1.0847, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: -5.92% (0.2989 => 0.2812, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -5.92% (0.3446 => 0.3242, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -5.91% (0.4248 => 0.3997, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.91% (0.6736 => 0.6338, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -5.91% (0.1761 => 0.1657, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.90% (0.7198 => 0.6773, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: -5.89% (0.3394 => 0.3194, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -5.88% (0.7447 => 0.7009, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.87% (0.3849 => 0.3623, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -5.87% (15.5079 => 14.5981, std.dev.: 0.0223) MultiSource/Benchmarks/McCat/18-imp/imp: -5.86% (0.3581 => 0.3371, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: -5.86% (0.4861 => 0.4576, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.84% (0.3016 => 0.2840, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.83% (0.5863 => 0.5521, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.83% (5.4682 => 5.1494, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/lists: -5.83% (0.3621 => 0.3410, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.82% (0.8521 => 0.8025, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/except: -5.82% (0.3026 => 0.2850, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.81% (1.3864 => 1.3059, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.79% (0.2385 => 0.2247, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.78% (0.5849 => 0.5511, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: -5.78% (0.3255 => 0.3067, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.77% (0.7021 => 0.6616, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.76% (0.4916 => 0.4633, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.75% (0.5999 => 0.5654, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.75% (0.5478 => 0.5163, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.75% (8.0126 => 7.5522, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.74% (0.9557 => 0.9008, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.73% (0.4813 => 0.4537, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -5.71% (0.2871 => 0.2707, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -5.70% (2.4021 => 2.2651, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.70% (0.2999 => 0.2828, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.69% (0.3057 => 0.2883, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -5.69% (0.3059 => 0.2885, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.69% (0.5857 => 0.5524, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.67% (0.5591 => 0.5274, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.67% (2.1713 => 2.0482, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: -5.67% (17.1032 => 16.1337, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.66% (0.4083 => 0.3852) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.65% (0.6297 => 0.5941, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: -5.65% (0.3025 => 0.2854, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -5.65% (3.5154 => 3.3167, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/lists1: -5.64% (0.3867 => 0.3649, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.63% (0.5575 => 0.5261, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.63% (0.5581 => 0.5267, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.62% (0.6230 => 0.5880, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.62% (0.6052 => 0.5712, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.62% (0.5859 => 0.5530, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: -5.61% (0.2939 => 0.2774, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.61% (0.5168 => 0.4878, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.61% (0.5329 => 0.5030, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.61% (1.2210 => 1.1525, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.60% (0.3252 => 0.3070, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.59% (0.5925 => 0.5594, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.58% (0.5802 => 0.5478, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.58% (0.7524 => 0.7104, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.58% (0.5805 => 0.5481, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.58% (1.2221 => 1.1539, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.58% (2.2587 => 2.1327, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: -5.57% (0.3194 => 0.3016, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.56% (0.3491 => 0.3297, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -5.54% (0.3788 => 0.3578, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.54% (0.6194 => 0.5851, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.54% (0.6304 => 0.5955, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.53% (0.6260 => 0.5914, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.53% (0.6189 => 0.5847, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: -5.53% (0.6750 => 0.6377, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.52% (0.2933 => 0.2771, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -5.52% (0.3205 => 0.3028, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.51% (0.5569 => 0.5262, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.51% (0.4427 => 0.4183, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.51% (0.2903 => 0.2743, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -5.51% (0.2849 => 0.2692, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.51% (0.6446 => 0.6091, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.50% (0.7339 => 0.6935, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.50% (0.6676 => 0.6309, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.50% (0.5567 => 0.5261, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: -5.49% (2.1401 => 2.0227, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.47% (0.6660 => 0.6296, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.46% (0.6667 => 0.6303, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: -5.44% (18.2933 => 17.2988, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.43% (0.6440 => 0.6090, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.42% (0.5570 => 0.5268, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.42% (0.5941 => 0.5619, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.42% (0.5705 => 0.5396, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.41% (0.6395 => 0.6049, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.41% (0.5456 => 0.5161, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.36% (0.6395 => 0.6052, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -5.35% (15.2527 => 14.4364, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.34% (0.6033 => 0.5711, std.dev.: 0.0103) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.30% (0.2001 => 0.1895, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.29% (0.3931 => 0.3723, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -5.22% (0.7982 => 0.7565, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.21% (0.6681 => 0.6333, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.19% (0.5688 => 0.5393, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.18% (0.2106 => 0.1997, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.15% (0.3323 => 0.3152) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.14% (0.4321 => 0.4099, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -5.11% (0.3271 => 0.3104, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: -5.06% (0.4524 => 0.4295, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -4.93% (0.8418 => 0.8003, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.88% (0.3319 => 0.3157, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: -4.83% (5.0226 => 4.7800, std.dev.: 0.0150) SingleSource/UnitTests/ObjC++/Hello: -4.79% (0.6347 => 0.6043, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -4.66% (0.6441 => 0.6141, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -4.63% (1.5610 => 1.4887, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -4.60% (0.7779 => 0.7421, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.15% (0.9077 => 0.8700, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -2.98% (20.7746 => 20.1563, std.dev.: 0.0519) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7559, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/richards_benchmark: -8.65% (1.2842 => 1.1731, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -4.00% (2.2633 => 2.1728, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.93% (1.7753 => 1.7056, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.27% (1.0557 => 1.0212, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.60% (1.3096 => 1.2756, std.dev.: 0.0081) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4729, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 8 13:27:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 8 Nov 2012 15:27:22 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121108212722.CBBFE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5689?compare_to=5684&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5689, Order: 167588, Start Time: 2012-11-08 18:11:56, End Time: 2012-11-08 21:27:32 To: 5684, Order: 167576, Start Time: 2012-11-08 14:08:24, End Time: 2012-11-08 17:23:48 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (169 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (721 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.07% (124.5653 => 130.8834, std.dev.: 0.3884) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 38.88% (0.0625 => 0.0868, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.95% (0.1063 => 0.1392, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.63% (0.2969 => 0.3730, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.44% (0.4253 => 0.5335, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.05% (0.1106 => 0.1383, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 23.85% (0.4139 => 0.5126, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.67% (0.0714 => 0.0883, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.15% (0.5900 => 0.7266, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 23.01% (1.5932 => 1.9598, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.85% (0.0547 => 0.0672, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.60% (0.0584 => 0.0716, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.53% (0.0475 => 0.0582, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.37% (0.4994 => 0.6111, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.08% (0.5000 => 0.6104, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.63% (0.0897 => 0.1091, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/tsp/tsp: 21.37% (0.0599 => 0.0727, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.25% (0.1021 => 0.1238, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.17% (0.1620 => 0.1963, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.51% (0.1107 => 0.1334, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 20.04% (0.0948 => 0.1138, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.91% (0.0633 => 0.0759) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.86% (0.0584 => 0.0700, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.76% (0.1103 => 0.1321, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.68% (0.3903 => 0.4671, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.59% (0.0541 => 0.0647, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.50% (0.1549 => 0.1851, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 19.49% (0.0821 => 0.0981, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.47% (0.0642 => 0.0767, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.34% (0.0822 => 0.0981, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.34% (0.1003 => 0.1197, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 19.21% (0.0604 => 0.0720, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.20% (0.1604 => 0.1912, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 18.90% (0.1619 => 0.1925, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 18.56% (0.0808 => 0.0958, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.26% (0.1462 => 0.1729, std.dev.: 0.0016) MultiSource/Applications/viterbi/viterbi: 18.16% (0.0947 => 0.1119, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.76% (0.3890 => 0.4581, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.48% (0.2014 => 0.2366, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 17.41% (0.1218 => 0.1430, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.21% (0.2736 => 0.3207, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.20% (1.3152 => 1.5414, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/mst/mst: 17.19% (0.0698 => 0.0818, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 17.15% (0.4029 => 0.4720, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 17.03% (0.5826 => 0.6818, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 17.01% (0.1505 => 0.1761, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.00% (0.1088 => 0.1273, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 16.64% (0.5889 => 0.6869, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 16.62% (0.5546 => 0.6468, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.61% (0.2866 => 0.3342, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 16.55% (1.8794 => 2.1904, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.21% (0.1968 => 0.2287, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 16.18% (0.9697 => 1.1266, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.10% (0.5026 => 0.5835, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.04% (0.4658 => 0.5405, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.00% (3.5627 => 4.1329, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.93% (0.2875 => 0.3333, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.91% (1.6211 => 1.8790, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.77% (0.3271 => 0.3787, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.69% (0.1160 => 0.1342, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.41% (0.2738 => 0.3160, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 15.34% (0.1421 => 0.1639, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.32% (0.4361 => 0.5029, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.31% (4.4195 => 5.0961, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 15.29% (0.2714 => 0.3129, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 15.27% (0.2750 => 0.3170, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 15.27% (0.2725 => 0.3141, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 15.26% (0.1284 => 0.1480, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.13% (0.2729 => 0.3142, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 15.05% (1.0781 => 1.2404, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/matrix: 15.00% (0.2780 => 0.3197, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 14.98% (0.3004 => 0.3454, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 14.95% (0.2823 => 0.3245, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 14.93% (0.9909 => 1.1388, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 14.91% (0.2803 => 0.3221, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 14.90% (0.2813 => 0.3232, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.89% (0.3930 => 0.4515, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/except: 14.87% (0.2811 => 0.3229, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.79% (0.2792 => 0.3205, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.77% (0.2911 => 0.3341, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 14.76% (4.2109 => 4.8324, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.74% (0.3195 => 0.3666, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 14.71% (0.7171 => 0.8226, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: 14.70% (0.3096 => 0.3551, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.63% (2.0673 => 2.3697, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 14.51% (0.3267 => 0.3741, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.50% (0.1090 => 0.1248, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 14.41% (0.3317 => 0.3795, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 14.40% (0.3258 => 0.3727, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.30% (1.9966 => 2.2822, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.29% (1.9694 => 2.2509, std.dev.: 0.0039) MultiSource/Benchmarks/Bullet/bullet: 14.28% (23.5202 => 26.8799, std.dev.: 0.0237) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.20% (2.7292 => 3.1168, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.19% (0.3362 => 0.3839, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.99% (0.3060 => 0.3488, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 13.95% (0.2566 => 0.2924, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 13.86% (0.3348 => 0.3812, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.73% (0.3124 => 0.3553, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.68% (0.3625 => 0.4121, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.68% (0.3845 => 0.4371, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/moments: 13.57% (0.3678 => 0.4177, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 13.53% (0.3726 => 0.4230, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.44% (0.3282 => 0.3723, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 13.40% (0.3477 => 0.3943, std.dev.: 0.0055) MultiSource/Applications/lua/lua: 13.40% (1.4269 => 1.6181, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: 13.40% (0.2075 => 0.2353, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 13.22% (0.4251 => 0.4813, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 13.02% (0.4146 => 0.4686, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.99% (0.3981 => 0.4498, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.95% (0.3690 => 0.4168, std.dev.: 0.0056) MultiSource/Applications/treecc/treecc: 12.72% (0.7875 => 0.8877, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.56% (0.3488 => 0.3926, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/for-in: 12.53% (0.3496 => 0.3934, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.53% (0.3465 => 0.3899, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-2: 12.48% (0.3446 => 0.3876, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.46% (0.3460 => 0.3891, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.37% (0.3469 => 0.3898, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 12.35% (0.5012 => 0.5631, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 12.29% (0.3442 => 0.3865, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 12.21% (2.1653 => 2.4296, std.dev.: 0.0168) SingleSource/UnitTests/ObjC/property: 12.16% (0.3650 => 0.4094, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.08% (0.3643 => 0.4083, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.98% (0.3724 => 0.4170, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 11.98% (4.6177 => 5.1707, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 11.67% (2.1013 => 2.3465, std.dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: 11.59% (0.2691 => 0.3003, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.42% (0.2040 => 0.2273, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.27% (0.6435 => 0.7160, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 10.96% (5.5417 => 6.1488, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.41% (0.1028 => 0.1135, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 10.41% (0.3498 => 0.3862, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.19% (0.2737 => 0.3016, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 10.11% (0.4847 => 0.5337, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.11% (0.2068 => 0.2277, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 9.80% (0.6634 => 0.7284, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.79% (0.3084 => 0.3386, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.76% (0.1383 => 0.1518, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 9.53% (0.3336 => 0.3654, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 9.20% (0.2391 => 0.2611, std.dev.: 0.0071) MultiSource/Applications/sqlite3/sqlite3: 9.10% (2.0346 => 2.2198, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.03% (0.2103 => 0.2293, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.23% (4.6926 => 5.0787, std.dev.: 0.0118) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.04% (11.6398 => 12.5761, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.93% (0.5361 => 0.5786, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.56% (0.5584 => 0.6006, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.34% (0.7426 => 0.7971, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 6.06% (11.9555 => 12.6796, std.dev.: 0.0227) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.27% (0.3792 => 0.3916, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.78% (0.2802 => 0.3076, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6098, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6746, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1717, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-2: 4.41% (1.8057 => 1.8853, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.31% (0.3693 => 0.3852, std.dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/dry: 4.07% (14.0481 => 14.6204, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1917, std.dev.: 0.0090) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.69% (3.1722 => 3.2259, std.dev.: 0.0024) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3074, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2874, std.dev.: 0.0051) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1051, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5925, std.dev.: 0.0151) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.89% (2.4764 => 2.4049, std.dev.: 0.0236) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5562, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary2: -10.66% (0.2402 => 0.2146, std.dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9757, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7942, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.57% (11.2080 => 10.8080, std.dev.: 0.0022) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.65% (17.2379 => 16.7803, std.dev.: 0.0527) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.20% (41.7953 => 40.8746, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.11% (0.6293 => 0.6160, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5787, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4962, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1555, std.dev.: 0.0227) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0459, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 3.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 8 13:38:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 8 Nov 2012 15:38:00 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121108213800.F19E12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5690?compare_to=5687&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5690, Order: 167594, Start Time: 2012-11-08 20:11:55, End Time: 2012-11-08 21:38:11 To: 5687, Order: 167588, Start Time: 2012-11-08 18:29:09, End Time: 2012-11-08 19:54:57 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 20 (123 on baseline) Performance Improvements: 2 (21 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 969 (830 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.51% (0.8408 => 0.8955, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.54% (0.4821 => 0.5088, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/bh/bh: 4.80% (0.2915 => 0.3055, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.25% (0.2775 => 0.2893, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.41% (0.3077 => 0.3182, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.38% (0.3018 => 0.3120, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.15% (1.3211 => 1.3627, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.03% (0.7721 => 0.7955, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.01% (1.1774 => 1.2128, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/05-eks/eks: 2.80% (0.4421 => 0.4545, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.26% (0.5254 => 0.5373, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.26% (1.1908 => 1.2177, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.77% (0.6667 => 0.6785, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.69% (0.9576 => 0.9738, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.49% (0.8805 => 0.8936, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.15% (1.6797 => 1.6990, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.57% (0.3163 => 0.3434, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.31% (21.6554 => 22.5882, std.dev.: 0.0637) MultiSource/Applications/SPASS/SPASS: 2.99% (8.4911 => 8.7450, std.dev.: 0.0643) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.82% (14.4669 => 14.7303, std.dev.: 0.0819) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/except: -2.91% (0.4984 => 0.4839, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.33% (1.4146 => 1.3816, std.dev.: 0.0065) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.56% (16.6131 => 16.7062, std.dev.: 0.1119) MultiSource/Applications/obsequi/Obsequi: -0.79% (1.0573 => 1.0490, std.dev.: 0.0139) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.01% (21.6893 => 21.6904, std.dev.: 0.0489) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (0.3643 => 0.3687, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 0.30% (0.6035 => 0.6053, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.32% (0.3325 => 0.3369, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/strcat: 1.39% (0.2019 => 0.2047, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -14.61% (0.0219 => 0.0187, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.65% (0.0425 => 0.0432, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 32.54% (0.0252 => 0.0334, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 36.80% (0.0231 => 0.0316, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.95% (0.0421 => 0.0425, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 0.50% (0.0202 => 0.0203, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0217 => 0.0217, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -27.27% (0.0011 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -1.38% (0.1450 => 0.1430, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.45% (1.1553 => 1.1721, std.dev.: 0.0098) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 6.34% (0.1419 => 0.1509, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.01% (0.4155 => 0.4197, std.dev.: 0.0436) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.49% (0.1419 => 0.1412, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.62% (0.0650 => 0.0646, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 18.70% (0.0230 => 0.0273, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.29% (0.0567 => 0.0554, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.43% (1.1986 => 1.1934, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 80.00% (0.0015 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 15.03% (0.0559 => 0.0643, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.92% (0.0242 => 0.0266, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.44% (0.7788 => 0.7822, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 35.42% (0.0048 => 0.0065, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2306.35% (0.6332 => 15.2370, std.dev.: 0.1173) MultiSource/Benchmarks/McCat/08-main/main: 46.64% (0.1831 => 0.2685, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.60% (0.1559 => 0.1425, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1512.29% (0.3344 => 5.3915, std.dev.: 0.0410) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.03% (0.2364 => 0.3263, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: 3.50% (0.0429 => 0.0444, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.25% (0.0224 => 0.0238, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0000) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4255, std.dev.: 0.0118) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0707, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4953, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3549, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1493, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4105, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: -24.36% (2.1832 => 1.6513, std.dev.: 0.0079) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.44% (0.0810 => 0.0927, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.49% (0.0830 => 0.0942, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/tsp/tsp: 11.06% (0.1112 => 0.1235, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.08% (0.8148 => 0.8806, std.dev.: 0.0140) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.89% (0.2180 => 0.2352, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.62% (0.8321 => 0.8955, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.45% (0.7473 => 0.7955, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.14% (0.2998 => 0.3182, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.10% (0.2279 => 0.2418, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.01% (0.6010 => 0.6371, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.97% (0.4847 => 0.5088, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.96% (0.2519 => 0.2644, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 4.93% (0.2513 => 0.2637, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.50% (1.1606 => 1.2128, std.dev.: 0.0088) MultiSource/Applications/spiff/spiff: 4.26% (0.7950 => 0.8289, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/sieve: 4.21% (0.2755 => 0.2871, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.21% (1.1685 => 1.2177, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.13% (0.3295 => 0.3431, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 3.97% (0.3800 => 0.3951, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 3.93% (0.2999 => 0.3117, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.90% (0.3003 => 0.3120, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.90% (1.4479 => 1.5043, std.dev.: 0.0189) MultiSource/Applications/Burg/burg: 3.86% (1.2222 => 1.2694, std.dev.: 0.0175) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.83% (6.6074 => 6.8602, std.dev.: 0.0417) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.77% (0.8611 => 0.8936, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.71% (0.4127 => 0.4280, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.69% (1.6386 => 1.6990, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.55% (0.3657 => 0.3787, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.51% (0.5191 => 0.5373, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.40% (0.6287 => 0.6501, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/05-eks/eks: 3.37% (0.4397 => 0.4545, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 3.28% (14.2605 => 14.7288, std.dev.: 0.0555) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.21% (0.9435 => 0.9738, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.02% (0.6586 => 0.6785, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash2: 3.01% (0.4125 => 0.4249, std.dev.: 0.0043) MultiSource/Applications/JM/ldecod/ldecod: 2.99% (6.7320 => 6.9330, std.dev.: 0.0330) MultiSource/Applications/SIBsim4/SIBsim4: 2.92% (1.2568 => 1.2935, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.90% (0.8007 => 0.8239, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (4.1763 => 4.2959, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.66% (0.9039 => 0.9279, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.65% (8.6476 => 8.8767, std.dev.: 0.0626) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.63% (0.9688 => 0.9943, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.62% (1.3279 => 1.3627, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.61% (0.4559 => 0.4678, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.58% (0.8069 => 0.8277, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 2.56% (3.2366 => 3.3195, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.55% (0.8317 => 0.8529, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 2.52% (0.6834 => 0.7006, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.45% (0.8331 => 0.8535, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.44% (0.8597 => 0.8807, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.39% (0.8359 => 0.8559, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.38% (0.8995 => 0.9209, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.37% (0.8340 => 0.8538, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.37% (0.8697 => 0.8903, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.34% (0.8316 => 0.8511, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.33% (13.1811 => 13.4888, std.dev.: 0.0515) MultiSource/Applications/ClamAV/clamscan: 2.30% (14.7684 => 15.1086, std.dev.: 0.1126) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.30% (0.8050 => 0.8235, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.26% (0.9074 => 0.9279, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.19% (0.7932 => 0.8106, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.18% (0.8716 => 0.8906, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.15% (0.8518 => 0.8701, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.11% (0.8204 => 0.8377, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.10% (0.8086 => 0.8256, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.07% (0.8066 => 0.8233, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 2.07% (1.1271 => 1.1504, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.06% (0.8885 => 0.9068, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.03% (0.8048 => 0.8211, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.01% (0.8338 => 0.8506, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.00% (0.8805 => 0.8981, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.99% (0.8656 => 0.8828, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.98% (0.8420 => 0.8587, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.93% (0.8927 => 0.9099, std.dev.: 0.0040) MultiSource/Applications/oggenc/oggenc: 1.92% (4.9628 => 5.0580, std.dev.: 0.0173) MultiSource/Benchmarks/PAQ8p/paq8p: 1.83% (2.3764 => 2.4200, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.81% (4.4873 => 4.5686, std.dev.: 0.0162) MultiSource/Benchmarks/Bullet/bullet: 1.81% (31.8598 => 32.4350, std.dev.: 0.0932) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.69% (0.8286 => 0.8426, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.68% (4.5702 => 4.6469, std.dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.68% (1.5315 => 1.5572, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/football/football: 1.61% (0.8768 => 0.8909, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.50% (1.2526 => 1.2714, std.dev.: 0.0071) MultiSource/Applications/lemon/lemon: 1.48% (1.0945 => 1.1107, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.38% (1.2423 => 1.2594, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 1.37% (8.6247 => 8.7431, std.dev.: 0.0248) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 106.03% (0.0199 => 0.0410, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/pi: 56.99% (1.5795 => 2.4796, std.dev.: 0.0193) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 20.64% (0.0528 => 0.0637, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.20% (2.9753 => 3.4572, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 14.85% (0.7597 => 0.8725, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.48% (2.7995 => 3.2050, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.51% (5.0261 => 5.6048, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.23% (1.1857 => 1.2833, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.78% (0.3186 => 0.3434, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/queens: 7.48% (1.7056 => 1.8332, std.dev.: 0.0130) MultiSource/Applications/SIBsim4/SIBsim4: 6.52% (3.1873 => 3.3951, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/richards_benchmark: 6.11% (1.3037 => 1.3833, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.90% (4.5327 => 4.8001, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.80% (4.9686 => 5.2566, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.69% (3.3761 => 3.5343, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.61% (6.2275 => 6.5143, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.26% (4.9453 => 5.1559, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.00% (4.9469 => 5.1449, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 3.91% (14.0064 => 14.5545, std.dev.: 0.0050) MultiSource/Applications/SPASS/SPASS: 3.70% (8.4326 => 8.7450, std.dev.: 0.0643) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.69% (1.2337 => 1.2792, std.dev.: 0.0051) MultiSource/Applications/siod/siod: 3.30% (3.6643 => 3.7852, std.dev.: 0.0167) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.26% (0.3587 => 0.3704, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.95% (11.5690 => 11.9103, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout/lists: 2.77% (7.3375 => 7.5404, std.dev.: 0.0280) MultiSource/Applications/lambda-0_1_3/lambda: 2.76% (7.4933 => 7.7003, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.75% (8.2783 => 8.5061, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.40% (4.8362 => 4.9524, std.dev.: 0.0238) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.40% (4.8660 => 4.9826, std.dev.: 0.0297) SingleSource/Benchmarks/Dhrystone/dry: 2.34% (0.5081 => 0.5200, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: 1.53% (1.2061 => 1.2246, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.39% (2.4647 => 2.4990, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/neural/neural: 1.36% (1.0841 => 1.0988, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.34% (4.4340 => 4.4936, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.29% (22.2997 => 22.5882, std.dev.: 0.0637) SingleSource/Benchmarks/Misc/ReedSolomon: 1.25% (8.5322 => 8.6385, std.dev.: 0.0156) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.15% (1.1365 => 1.1496, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.12% (3.5679 => 3.6078, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.97% (5.4641 => 4.3183, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.02% (7.2130 => 6.3461, std.dev.: 0.2651) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.42% (1.0512 => 0.9312, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: -8.47% (63.1822 => 57.8277, std.dev.: 0.0313) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.88% (4.7482 => 4.4216, std.dev.: 0.0486) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.39% (0.3269 => 0.3060, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.15% (3.7148 => 3.4863, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.87% (5.4972 => 5.1746, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.01% (5.1557 => 4.8973, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.39% (4.7449 => 4.5364, std.dev.: 0.0112) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.14% (2.8773 => 2.7583, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.82% (6.0224 => 5.7925, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.12% (0.5807 => 0.5626, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.05% (28.5821 => 27.7115, std.dev.: 0.0174) MultiSource/Applications/lua/lua: -2.84% (29.8330 => 28.9854, std.dev.: 0.2952) MultiSource/Applications/aha/aha: -2.15% (3.3398 => 3.2679, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.92% (11.5316 => 11.3106, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.81% (9.9065 => 9.7273, std.dev.: 0.0440) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.67% (4.9994 => 4.9157, std.dev.: 0.0067) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.58% (2.3487 => 2.3116, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.30% (5.6343 => 5.5613, std.dev.: 0.0179) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.58% (16.4461 => 16.7062, std.dev.: 0.1119) MultiSource/Applications/obsequi/Obsequi: 2.22% (1.0262 => 1.0490, std.dev.: 0.0139) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6845.37% (0.3123 => 21.6904, std.dev.: 0.0489) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.70% (0.2463 => 0.3687, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 0.72% (0.6010 => 0.6053, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.15% (0.3266 => 0.3369, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/strcat: 3.96% (0.1969 => 0.2047, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 52.03% (0.0123 => 0.0187, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.88% (0.0408 => 0.0432, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.50% (0.0254 => 0.0334, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.56% (0.1438 => 0.1430, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 3.46% (1.1329 => 1.1721, std.dev.: 0.0098) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.21% (0.1462 => 0.1509, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.79% (0.4164 => 0.4197, std.dev.: 0.0436) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.14% (0.1369 => 0.1412, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.78% (0.0641 => 0.0646, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 40.00% (0.0195 => 0.0273, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.15% (0.0578 => 0.0554, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.35% (1.1437 => 1.1934, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.55% (0.0627 => 0.0643, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.43% (0.8017 => 0.7822, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 4.84% (0.0062 => 0.0065, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 8 14:24:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 8 Nov 2012 16:24:27 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121108222427.2187F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5691?compare_to=5688&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5691, Order: 167594, Start Time: 2012-11-08 20:59:44, End Time: 2012-11-08 22:24:35 To: 5688, Order: 167591, Start Time: 2012-11-08 19:11:48, End Time: 2012-11-08 20:36:34 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (180 on baseline) Unchanged Tests: 1042 (857 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1010, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.55% (54.5751 => 55.9681, std.dev.: 0.3342) SingleSource/Benchmarks/Misc/salsa20: 2.40% (7.4937 => 7.6733, std.dev.: 0.0200) SingleSource/Benchmarks/Shootout-C++/hash2: 2.20% (3.1932 => 3.2636, std.dev.: 0.0118) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.22% (0.1431 => 0.1299, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.32% (0.3821 => 0.3503, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -7.64% (2.4924 => 2.3020, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.29% (0.9542 => 0.8846, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/oourafft: -6.99% (0.2160 => 0.2009, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: -6.97% (0.3357 => 0.3123, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.91% (0.3142 => 0.2925, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-2: -6.84% (0.3831 => 0.3569, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.81% (0.3891 => 0.3626, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.81% (0.3848 => 0.3586, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -6.80% (0.3880 => 0.3616, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.80% (0.2428 => 0.2263, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -6.79% (0.3812 => 0.3553, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.79% (3.5339 => 3.2938, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: -6.78% (0.3896 => 0.3632, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.77% (0.4033 => 0.3760, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.72% (0.3884 => 0.3623, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -6.70% (0.4176 => 0.3896, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.67% (22.4056 => 20.9114, std.dev.: 0.0148) MultiSource/Applications/JM/lencod/lencod: -6.63% (16.1920 => 15.1182, std.dev.: 0.0098) MultiSource/Applications/JM/ldecod/ldecod: -6.59% (7.0961 => 6.6283, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.58% (0.9852 => 0.9204, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.50% (0.1584 => 0.1481, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.50% (0.2355 => 0.2202, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -6.50% (9.2283 => 8.6288, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.48% (0.3658 => 0.3421, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -6.48% (0.4199 => 0.3927, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.45% (0.6484 => 0.6066, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: -6.43% (0.4280 => 0.4005, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.38% (0.4151 => 0.3886, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.36% (6.7716 => 6.3410, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.34% (1.0544 => 0.9875, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.32% (1.3722 => 1.2855, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.31% (4.8161 => 4.5121, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/football/football: -6.31% (0.9179 => 0.8600, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.28% (4.0323 => 3.7792, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.25% (1.6364 => 1.5341, std.dev.: 0.0046) SingleSource/Benchmarks/McGill/chomp: -6.25% (0.1761 => 0.1651, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.24% (1.2300 => 1.1532, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.24% (0.1716 => 0.1609, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.22% (1.2784 => 1.1989, std.dev.: 0.0035) MultiSource/Applications/lemon/lemon: -6.21% (1.1450 => 1.0739, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.20% (4.8802 => 4.5774, std.dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: -6.19% (1.1530 => 1.0816, std.dev.: 0.0063) MultiSource/Applications/hexxagon/hexxagon: -6.18% (1.3148 => 1.2335, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -6.18% (1.2515 => 1.1742, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: -6.14% (4.3330 => 4.0669, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.14% (4.5069 => 4.2302, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: -6.13% (0.2659 => 0.2496, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.13% (1.4642 => 1.3745, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary3: -6.09% (0.3446 => 0.3236, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.08% (0.3323 => 0.3121, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: -6.07% (0.3394 => 0.3188, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -6.06% (0.2989 => 0.2808, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -6.05% (0.3026 => 0.2843, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.05% (0.3837 => 0.3605, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.04% (0.6736 => 0.6329, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.04% (1.6474 => 1.5479, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.04% (14.2083 => 13.3508, std.dev.: 0.0216) SingleSource/Benchmarks/Shootout-C++/hash2: -6.03% (0.4861 => 0.4568, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -6.01% (4.0594 => 3.8153, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.01% (0.2695 => 0.2533, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.00% (0.3931 => 0.3695, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -5.99% (0.3255 => 0.3060, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: -5.98% (0.7447 => 0.7002, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.97% (0.3016 => 0.2836, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -5.97% (0.3621 => 0.3405, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -5.96% (0.2985 => 0.2807, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.94% (5.4682 => 5.1434, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.92% (0.3849 => 0.3621, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -5.92% (0.3059 => 0.2878, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.90% (2.1713 => 2.0433, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -5.89% (2.4021 => 2.2605, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.89% (0.2548 => 0.2398, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.89% (0.3483 => 0.3278, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -5.85% (0.4515 => 0.4251, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.84% (0.5168 => 0.4866, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: -5.84% (17.1032 => 16.1041, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.84% (0.5478 => 0.5158, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: -5.84% (0.4248 => 0.4000, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -5.84% (15.5079 => 14.6029, std.dev.: 0.0226) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.82% (0.3057 => 0.2879, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.82% (0.5857 => 0.5516, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.82% (0.2871 => 0.2704, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.82% (0.5863 => 0.5522, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.81% (0.3252 => 0.3063, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.81% (0.7919 => 0.7459, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: -5.81% (0.3581 => 0.3373, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.81% (0.9557 => 0.9002, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.80% (0.4083 => 0.3846, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.80% (0.4916 => 0.4631, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: -5.79% (0.3025 => 0.2850, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/random: -5.78% (0.2939 => 0.2769, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -5.77% (0.3481 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -5.77% (0.3867 => 0.3644, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -5.76% (1.3864 => 1.3065, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.76% (0.4321 => 0.4072, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.76% (0.5591 => 0.5269, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.75% (0.2278 => 0.2147, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.72% (0.2903 => 0.2737, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.71% (0.4813 => 0.4538, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -5.71% (34.0927 => 32.1456, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/wc: -5.71% (0.3205 => 0.3022, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.70% (0.6293 => 0.5934, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.70% (0.6230 => 0.5875, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: -5.70% (0.3194 => 0.3012, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -5.69% (3.5154 => 3.3155, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.68% (0.7524 => 0.7097, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.67% (0.6260 => 0.5905, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -5.66% (0.4524 => 0.4268, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: -5.65% (0.2849 => 0.2688, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.65% (0.6052 => 0.5710, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.65% (2.2587 => 2.1311, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.64% (0.7339 => 0.6925, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.64% (0.6189 => 0.5840, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (0.7021 => 0.6626, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/bigfib: -5.61% (0.6750 => 0.6371, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.61% (0.5329 => 0.5030, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.61% (8.0126 => 7.5632, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.61% (0.5581 => 0.5268, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.61% (0.5849 => 0.5521, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.60% (0.6681 => 0.6307, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.59% (0.2933 => 0.2769, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.59% (0.5925 => 0.5594, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.59% (0.8521 => 0.8045, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.59% (0.3491 => 0.3296, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.57% (0.6194 => 0.5849, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.56% (0.6676 => 0.6305, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.56% (0.4427 => 0.4181, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.55% (0.6446 => 0.6088, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.54% (1.2210 => 1.1533, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.52% (0.5802 => 0.5482, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.51% (0.5805 => 0.5485, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.51% (0.6440 => 0.6085, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.51% (0.6297 => 0.5950, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.51% (0.6660 => 0.6293, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.50% (0.2999 => 0.2834, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.50% (1.2221 => 1.1549, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.49% (0.2385 => 0.2254, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -5.49% (0.3788 => 0.3580, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.49% (0.6667 => 0.6301, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -5.46% (18.2933 => 17.2936, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.46% (0.5456 => 0.5158, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.45% (0.5575 => 0.5271, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.45% (0.5999 => 0.5672, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.44% (0.5941 => 0.5618, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -5.42% (0.7982 => 0.7549, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.41% (0.5859 => 0.5542, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: -5.41% (2.1401 => 2.0244, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.40% (0.5570 => 0.5269, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.39% (0.6395 => 0.6050, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.37% (0.5567 => 0.5268, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.37% (0.6033 => 0.5709, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.36% (0.6304 => 0.5966, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -5.35% (15.2527 => 14.4370, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/ReedSolomon: -5.32% (0.1879 => 0.1779, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.32% (0.6395 => 0.6055, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.30% (0.5569 => 0.5274, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.29% (0.7198 => 0.6817, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.27% (0.2106 => 0.1995, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.24% (0.5705 => 0.5406, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -5.20% (0.3271 => 0.3101, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: -5.17% (0.8418 => 0.7983, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: -5.07% (5.0226 => 4.7682, std.dev.: 0.0181) SingleSource/UnitTests/ObjC++/property-reference: -5.03% (0.7779 => 0.7388, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: -4.98% (0.6347 => 0.6031, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.98% (0.5688 => 0.5405, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.91% (0.3319 => 0.3156, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -4.77% (0.6441 => 0.6134, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -4.52% (1.5610 => 1.4905, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.44% (0.9077 => 0.8674, std.dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: -2.93% (20.7746 => 20.1661, std.dev.: 0.0528) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.34% (7.5137 => 5.7599, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/richards_benchmark: -8.70% (1.2842 => 1.1725, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.80% (2.2633 => 2.1774, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.49% (6.5735 => 6.4756, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0001) Report Time: 2.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 8 15:21:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 8 Nov 2012 17:21:33 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121108232133.D6DED2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5692?compare_to=5690&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5692, Order: 167596, Start Time: 2012-11-08 21:55:11, End Time: 2012-11-08 23:21:45 To: 5690, Order: 167594, Start Time: 2012-11-08 20:11:55, End Time: 2012-11-08 21:38:11 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 7 (87 on baseline) Performance Improvements: 6 (22 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 978 (865 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 2.26% (1.4707 => 1.5039, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.08% (0.5088 => 0.5194, std.dev.: 0.0034) MultiSource/Applications/lua/lua: 1.39% (3.8851 => 3.9392, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.41% (28.9854 => 29.6852, std.dev.: 0.1009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.81% (59.8201 => 60.9040, std.dev.: 0.2058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.42% (3.5532 => 3.6037, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/pi: 1.22% (2.4796 => 2.5098, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash: -3.34% (0.3951 => 0.3819, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: -2.80% (0.4249 => 0.4130, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -1.92% (0.5373 => 0.5270, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.68% (1.6990 => 1.6705, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.52% (0.6785 => 0.6682, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -1.79% (0.6602 => 0.6484, std.dev.: 0.0025) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.13% (16.7062 => 16.6843, std.dev.: 0.0529) MultiSource/Applications/obsequi/Obsequi: 1.74% (1.0490 => 1.0673, std.dev.: 0.0086) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.30% (21.6904 => 21.6257, std.dev.: 0.6980) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.68% (0.3687 => 0.3662, std.dev.: 0.0231) SingleSource/Benchmarks/Misc-C++/bigfib: 0.03% (0.6053 => 0.6055, std.dev.: 0.0239) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.89% (0.3369 => 0.3339, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: -1.51% (0.2047 => 0.2016, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 16.58% (0.0187 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -12.27% (0.0432 => 0.0379, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -17.37% (0.0334 => 0.0276, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -7.91% (0.0316 => 0.0291, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0425 => 0.0427, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0203 => 0.0202, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0217 => 0.0217, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -12.50% (0.0008 => 0.0007, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.54% (0.1430 => 0.1452, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -3.84% (1.1721 => 1.1271, std.dev.: 0.0660) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -6.23% (0.1509 => 0.1415, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.36% (0.4197 => 0.4140, std.dev.: 0.0182) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.41% (0.1412 => 0.1378, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.28% (0.0646 => 0.0599, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -30.04% (0.0273 => 0.0191, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.17% (0.0554 => 0.0566, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.04% (1.1934 => 1.1929, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.55% (0.0643 => 0.0588, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.75% (0.0266 => 0.0268) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.24% (0.7822 => 0.7725, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: 500.00% (0.0001 => 0.0006, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0007 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -43.08% (0.0065 => 0.0037, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2306.73% (0.6332 => 15.2394, std.dev.: 0.0454) MultiSource/Benchmarks/McCat/08-main/main: 43.26% (0.1831 => 0.2623, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.84% (0.1559 => 0.1468, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1485.17% (0.3344 => 5.3008, std.dev.: 0.0758) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.11% (0.2364 => 0.3265, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/mandel: 3.03% (0.0429 => 0.0442, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.34% (0.0224 => 0.0227, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4247, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0716, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4950, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3436, std.dev.: 0.0301) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1134, std.dev.: 0.0442) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4015, std.dev.: 0.0209) SingleSource/Regression/C/uint64_to_float: -23.59% (2.1832 => 1.6681, std.dev.: 0.0096) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.67% (0.0810 => 0.0945, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: 12.59% (0.1112 => 0.1252, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.91% (0.0848 => 0.0949, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.67% (0.2180 => 0.2369, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.28% (0.2279 => 0.2445, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.16% (0.4847 => 0.5194, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.14% (0.1905 => 0.2041, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.92% (0.7473 => 0.7990, std.dev.: 0.0039) MultiSource/Applications/viterbi/viterbi: 6.91% (0.1577 => 0.1686, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.21% (0.2240 => 0.2379, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.12% (0.3137 => 0.3329, std.dev.: 0.0069) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.06% (0.8321 => 0.8825, std.dev.: 0.0126) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.82% (0.8148 => 0.8622, std.dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.73% (0.1885 => 0.1993, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 5.40% (1.4269 => 1.5039, std.dev.: 0.0071) MultiSource/Applications/spiff/spiff: 5.13% (0.7950 => 0.8358, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.04% (0.6010 => 0.6313, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.94% (0.2998 => 0.3146, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.68% (0.2519 => 0.2637, std.dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 4.60% (0.2999 => 0.3137, std.dev.: 0.0044) MultiSource/Applications/Burg/burg: 4.49% (1.2222 => 1.2771, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.30% (0.9435 => 0.9841, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.02% (1.1606 => 1.2073, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.97% (0.3124 => 0.3248, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.64% (0.5961 => 0.6178, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.41% (1.4479 => 1.4973, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.22% (4.1763 => 4.3107, std.dev.: 0.0155) MultiSource/Applications/lua/lua: 3.15% (3.8189 => 3.9392, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.09% (0.4783 => 0.4931, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 2.98% (1.2568 => 1.2943, std.dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 2.59% (1.1271 => 1.1563, std.dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: 2.56% (14.7684 => 15.1460, std.dev.: 0.1006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.54% (0.8697 => 0.8918, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 2.45% (4.1305 => 4.2315, std.dev.: 0.0309) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.43% (6.6074 => 6.7678, std.dev.: 0.0415) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.36% (1.1685 => 1.1961, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.35% (0.6287 => 0.6435, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.24% (0.8069 => 0.8250, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.23% (0.9069 => 0.9271, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.22% (0.4559 => 0.4660, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 2.21% (0.6834 => 0.6985, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.21% (1.3279 => 1.3572, std.dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: 2.19% (15.3280 => 15.6634, std.dev.: 0.0830) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.18% (0.8286 => 0.8467, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.17% (13.1811 => 13.4672, std.dev.: 0.0079) MultiSource/Benchmarks/PAQ8p/paq8p: 2.13% (2.3764 => 2.4271, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/football/football: 2.11% (0.8768 => 0.8953, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.08% (0.9810 => 1.0014, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.03% (0.9056 => 0.9240, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.99% (0.8855 => 0.9031, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.95% (1.6386 => 1.6705, std.dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.89% (1.1170 => 1.1381, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.87% (8.6476 => 8.8096, std.dev.: 0.0333) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.62% (4.5702 => 4.6443, std.dev.: 0.0175) MultiSource/Applications/lemon/lemon: 1.24% (1.0945 => 1.1081, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 95.98% (0.0199 => 0.0390, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/pi: 58.90% (1.5795 => 2.5098, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.34% (2.9753 => 3.4614, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.94% (0.7597 => 0.8808, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.72% (2.7995 => 3.2117, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.90% (6.3772 => 7.1360, std.dev.: 0.2071) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6088, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.00% (1.1857 => 1.2806, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 7.47% (1.7056 => 1.8330, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.81% (4.7794 => 5.1050, std.dev.: 0.0167) SingleSource/Benchmarks/Misc/richards_benchmark: 6.69% (1.3037 => 1.3909, std.dev.: 0.0071) MultiSource/Applications/SIBsim4/SIBsim4: 6.38% (3.1873 => 3.3906, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.93% (4.5327 => 4.8014, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.91% (4.9686 => 5.2621, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.60% (3.3761 => 3.5314, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.56% (6.2275 => 6.5116, std.dev.: 0.0290) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.24% (4.9453 => 5.1552, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.10% (4.9469 => 5.1496, std.dev.: 0.0415) MultiSource/Applications/hexxagon/hexxagon: 3.83% (14.0064 => 14.5424, std.dev.: 0.0987) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.85% (1.2337 => 1.2688, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.77% (59.2638 => 60.9040, std.dev.: 0.2058) MultiSource/Applications/lambda-0_1_3/lambda: 2.64% (7.4933 => 7.6914, std.dev.: 0.0061) SingleSource/Benchmarks/Dhrystone/dry: 2.56% (0.5081 => 0.5211, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 2.55% (3.6643 => 3.7577, std.dev.: 0.0321) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.43% (4.8660 => 4.9843, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout/lists: 2.39% (7.3375 => 7.5132, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.39% (8.2783 => 8.4759, std.dev.: 0.0181) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.00% (1.1365 => 1.1592, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.60% (4.8362 => 4.9135, std.dev.: 0.0270) SingleSource/Benchmarks/Stanford/FloatMM: 1.57% (0.8807 => 0.8945, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.21% (3.5679 => 3.6109, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.11% (2.4647 => 2.4921, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.12% (5.4641 => 4.3102, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.36% (1.0512 => 0.9318, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: -10.42% (1.1216 => 1.0047, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -9.57% (7.2130 => 6.5227, std.dev.: 0.2536) MultiSource/Benchmarks/mafft/pairlocalalign: -8.56% (63.1822 => 57.7738, std.dev.: 0.0562) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.53% (0.3269 => 0.2990, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.84% (4.7482 => 4.4232, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.00% (3.7148 => 3.4920, std.dev.: 0.0365) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.84% (5.4972 => 5.1761, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.06% (5.1557 => 4.8948, std.dev.: 0.0071) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.26% (2.8773 => 2.7548, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.71% (6.0224 => 5.7988, std.dev.: 0.0366) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.63% (2.4490 => 2.3602, std.dev.: 0.0334) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.03% (28.5821 => 27.7149, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.94% (0.5807 => 0.5636, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.92% (2.6356 => 2.5587, std.dev.: 0.0263) SingleSource/Benchmarks/Shootout-C++/hash2: -2.30% (3.4237 => 3.3448, std.dev.: 0.0136) MultiSource/Benchmarks/Olden/bisort/bisort: -2.29% (0.6636 => 0.6484, std.dev.: 0.0025) MultiSource/Applications/aha/aha: -2.26% (3.3398 => 3.2642, std.dev.: 0.0113) MultiSource/Benchmarks/FreeBench/mason/mason: -1.99% (0.5415 => 0.5307, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.95% (11.5316 => 11.3072, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.18% (5.6343 => 5.5678, std.dev.: 0.0132) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.45% (16.4461 => 16.6843, std.dev.: 0.0529) MultiSource/Applications/obsequi/Obsequi: 4.01% (1.0262 => 1.0673, std.dev.: 0.0086) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6824.66% (0.3123 => 21.6257, std.dev.: 0.6980) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.68% (0.2463 => 0.3662, std.dev.: 0.0231) SingleSource/Benchmarks/Misc-C++/bigfib: 0.75% (0.6010 => 0.6055, std.dev.: 0.0239) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.24% (0.3266 => 0.3339, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 2.39% (0.1969 => 0.2016, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -7.11% (0.0408 => 0.0379, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 8.66% (0.0254 => 0.0276, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.64% (0.0302 => 0.0291, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.20% (0.0384 => 0.0427, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0007 => 0.0007, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.97% (0.1438 => 0.1452, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.51% (1.1329 => 1.1271, std.dev.: 0.0660) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.21% (0.1462 => 0.1415, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.58% (0.4164 => 0.4140, std.dev.: 0.0182) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.66% (0.1369 => 0.1378, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.55% (0.0641 => 0.0599, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.05% (0.0195 => 0.0191, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.08% (0.0578 => 0.0566, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.30% (1.1437 => 1.1929, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.22% (0.0627 => 0.0588, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.89% (0.0180 => 0.0268) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.64% (0.8017 => 0.7725, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: 500.00% (0.0001 => 0.0006, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -40.32% (0.0062 => 0.0037, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 8 16:12:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 8 Nov 2012 18:12:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121109001231.8C24B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5693?compare_to=5691&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5693, Order: 167596, Start Time: 2012-11-08 22:47:50, End Time: 2012-11-09 00:12:41 To: 5691, Order: 167594, Start Time: 2012-11-08 20:59:44, End Time: 2012-11-08 22:24:35 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (180 on baseline) Unchanged Tests: 1042 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1011, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.4937 => 7.6745, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/hash2: 2.12% (3.1932 => 3.2608, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.22% (0.1431 => 0.1299, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -8.24% (2.4924 => 2.2870, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.22% (0.3821 => 0.3507, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.05% (0.9542 => 0.8869, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.03% (0.3142 => 0.2921, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: -6.81% (0.2160 => 0.2013, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.75% (0.2428 => 0.2264, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.75% (22.4056 => 20.8932, std.dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.73% (3.5339 => 3.2962, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: -6.67% (0.3357 => 0.3133, std.dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: -6.64% (7.0961 => 6.6248, std.dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: -6.62% (9.2283 => 8.6173, std.dev.: 0.0111) MultiSource/Applications/JM/lencod/lencod: -6.62% (16.1920 => 15.1200, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.53% (0.3658 => 0.3419, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.49% (0.9852 => 0.9213, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -6.48% (0.9179 => 0.8584, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -6.44% (0.1879 => 0.1758, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: -6.43% (1.2515 => 1.1710, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.43% (0.6484 => 0.6067, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.34% (6.7716 => 6.3422, std.dev.: 0.0135) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.33% (0.2355 => 0.2206, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.32% (1.3722 => 1.2855, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.24% (0.4151 => 0.3892, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.23% (1.0544 => 0.9887, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.21% (1.6364 => 1.5347, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: -6.21% (0.2659 => 0.2494, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.20% (1.2784 => 1.1991, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.19% (1.4642 => 1.3735, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -6.19% (1.1530 => 1.0816, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.19% (4.0323 => 3.7829, std.dev.: 0.0119) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.18% (0.1716 => 0.1610, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.16% (1.2300 => 1.1542, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.13% (4.8161 => 4.5211, std.dev.: 0.0040) MultiSource/Applications/lemon/lemon: -6.12% (1.1450 => 1.0749, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: -6.12% (4.3330 => 4.0680, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.10% (4.5069 => 4.2322, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.07% (14.2083 => 13.3458, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.07% (0.1796 => 0.1687, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: -6.07% (0.4861 => 0.4566, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -6.04% (0.3194 => 0.3001, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.03% (0.3831 => 0.3600, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.02% (1.6474 => 1.5482, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -6.02% (0.3406 => 0.3201, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.02% (0.3025 => 0.2843, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.01% (4.8802 => 4.5868, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.00% (0.2548 => 0.2395, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.00% (0.3483 => 0.3274, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -5.99% (1.3148 => 1.2360, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: -5.99% (0.7447 => 0.7001, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-4: -5.98% (0.3880 => 0.3648, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.97% (0.3837 => 0.3608, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.96% (0.7919 => 0.7447, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: -5.96% (0.4248 => 0.3995, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -5.96% (0.2989 => 0.2811, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: -5.95% (0.3812 => 0.3585, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.95% (0.6736 => 0.6335, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.94% (5.4682 => 5.1434, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: -5.93% (0.2985 => 0.2808, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: -5.93% (0.4033 => 0.3794, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -5.91% (15.5079 => 14.5911, std.dev.: 0.0172) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.90% (0.2695 => 0.2536, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -5.90% (2.4021 => 2.2604, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.90% (0.3849 => 0.3622, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -5.89% (0.3446 => 0.3243, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -5.89% (0.3481 => 0.3276, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: -5.88% (0.4524 => 0.4258, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/synchronized: -5.88% (0.3896 => 0.3667, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -5.87% (0.3848 => 0.3622, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.87% (2.1713 => 2.0439, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.85% (0.4083 => 0.3844, std.dev.: 0.0013) MultiSource/Applications/lua/lua: -5.84% (4.0594 => 3.8222, std.dev.: 0.0095) MultiSource/Applications/sqlite3/sqlite3: -5.84% (17.1032 => 16.1042, std.dev.: 0.0188) SingleSource/Benchmarks/Shootout-C++/matrix: -5.84% (0.3255 => 0.3065, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -5.83% (0.3394 => 0.3196, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/lists: -5.83% (0.3621 => 0.3410, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.82% (0.5168 => 0.4867, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.82% (0.3057 => 0.2879, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.82% (0.2871 => 0.2704, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.81% (0.3891 => 0.3665, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.81% (0.5857 => 0.5517, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.80% (0.3016 => 0.2841, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.79% (0.2278 => 0.2146, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.79% (0.9557 => 0.9004, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: -5.78% (0.2939 => 0.2769, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.78% (0.7524 => 0.7089, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: -5.78% (0.3581 => 0.3374, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: -5.77% (0.4176 => 0.3935, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.75% (0.7021 => 0.6617, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.75% (0.5999 => 0.5654, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.74% (0.3884 => 0.3661, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.71% (0.4813 => 0.4538, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -5.71% (0.3205 => 0.3022, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.70% (0.6293 => 0.5934, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -5.70% (1.3864 => 1.3074, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.70% (0.5478 => 0.5166, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: -5.69% (0.3867 => 0.3647, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.69% (0.5591 => 0.5273, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -5.69% (0.2849 => 0.2687, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.68% (0.2903 => 0.2738, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.67% (2.2587 => 2.1306, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.66% (0.3252 => 0.3068, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.64% (0.8521 => 0.8040, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -5.64% (0.6750 => 0.6369, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -5.64% (0.4199 => 0.3962, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.64% (0.3491 => 0.3294, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -5.62% (0.3026 => 0.2856, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: -5.61% (3.5154 => 3.3181, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: -5.60% (34.0927 => 32.1820, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.59% (0.5329 => 0.5031, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.59% (0.5581 => 0.5269, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.59% (0.6194 => 0.5848, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.58% (8.0126 => 7.5657, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.58% (0.4321 => 0.4080, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.58% (0.5863 => 0.5536, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.57% (0.6230 => 0.5883, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.57% (0.6052 => 0.5715, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.57% (0.6681 => 0.6309, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.56% (0.2933 => 0.2770, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.55% (0.6446 => 0.6088, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.55% (0.5859 => 0.5534, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.55% (0.7339 => 0.6932, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.54% (0.6260 => 0.5913, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.54% (0.5575 => 0.5266, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.54% (0.5849 => 0.5525, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.54% (0.2999 => 0.2833, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.53% (0.2385 => 0.2253, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.53% (0.4427 => 0.4182, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.52% (0.3931 => 0.3714, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -5.51% (0.4515 => 0.4266, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.51% (0.4916 => 0.4645, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.49% (0.5570 => 0.5264, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -5.49% (0.3059 => 0.2891, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -5.49% (0.3788 => 0.3580, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -5.48% (2.1401 => 2.0228, std.dev.: 0.0086) SingleSource/UnitTests/ObjC/parameter-passing: -5.47% (0.4280 => 0.4046, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.47% (0.6440 => 0.6088, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.46% (0.6297 => 0.5953, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.45% (0.6676 => 0.6312, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.45% (0.5802 => 0.5486, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.43% (0.5805 => 0.5490, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.43% (0.6304 => 0.5962, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.42% (0.5925 => 0.5604, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.41% (0.6667 => 0.6306, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.41% (0.5567 => 0.5266, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -5.40% (18.2933 => 17.3057, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.39% (0.5941 => 0.5621, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.38% (1.2210 => 1.1553, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.38% (0.6395 => 0.6051, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -5.36% (15.2527 => 14.4359, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.35% (0.6660 => 0.6304, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.34% (0.6033 => 0.5711, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.32% (0.7198 => 0.6815, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.32% (0.6395 => 0.6055, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.32% (0.5456 => 0.5166, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.29% (0.5705 => 0.5403, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.29% (1.2221 => 1.1575, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.28% (0.5569 => 0.5275, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.21% (0.3323 => 0.3150, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -5.20% (0.7982 => 0.7567, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.18% (0.2106 => 0.1997, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -5.11% (0.3271 => 0.3104, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.06% (0.5688 => 0.5400, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -5.00% (0.7779 => 0.7390, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: -4.90% (5.0226 => 4.7766, std.dev.: 0.0076) MultiSource/Applications/spiff/spiff: -4.89% (0.8418 => 0.8006, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.67% (0.9077 => 0.8653, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.52% (0.3319 => 0.3169, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/Hello: -4.49% (0.6347 => 0.6062, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: -4.38% (0.6441 => 0.6159, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -4.25% (1.5610 => 1.4947, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -2.52% (20.7746 => 20.2505, std.dev.: 0.0314) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.48% (7.5137 => 5.7496, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.90% (2.2633 => 2.1751, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.12% (1.3096 => 1.2688, std.dev.: 0.0145) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4742, std.dev.: 0.0023) Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 8 17:05:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 8 Nov 2012 19:05:09 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121109010509.92DDB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5694?compare_to=5692&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5694, Order: 167597, Start Time: 2012-11-08 23:39:50, End Time: 2012-11-09 01:05:21 To: 5692, Order: 167596, Start Time: 2012-11-08 21:55:11, End Time: 2012-11-08 23:21:45 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 7 (89 on baseline) Performance Improvements: 8 (27 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 976 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.74% (0.1968 => 0.2081, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.69% (1.1961 => 1.2163, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.69% (0.3303 => 0.3491, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.58% (21.2523 => 21.8012, std.dev.: 0.1572) MultiSource/Benchmarks/llubenchmark/llu: 2.16% (1.9892 => 2.0321, std.dev.: 0.0097) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.29% (3.9033 => 3.9535, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.15% (4.9135 => 4.9699, std.dev.: 0.0088) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -5.87% (0.5194 => 0.4889, std.dev.: 0.0109) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.63% (0.3329 => 0.3208, std.dev.: 0.0047) MultiSource/Applications/hbd/hbd: -1.99% (1.5039 => 1.4739, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.64% (4.3107 => 4.2398, std.dev.: 0.0272) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -6.00% (3.9932 => 3.7535, std.dev.: 0.0301) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.35% (60.9040 => 58.8660, std.dev.: 0.5084) SingleSource/Benchmarks/Misc/ffbench: -1.79% (1.4302 => 1.4046, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.07% (3.6037 => 3.5650, std.dev.: 0.0062) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.34% (16.6843 => 16.7403, std.dev.: 0.0653) MultiSource/Applications/obsequi/Obsequi: -1.99% (1.0673 => 1.0461, std.dev.: 0.0107) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.96% (21.6257 => 21.8343, std.dev.: 0.1316) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.35% (0.3662 => 0.3675, std.dev.: 0.0160) SingleSource/Benchmarks/Misc-C++/bigfib: 0.08% (0.6055 => 0.6060, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.09% (0.3339 => 0.3336, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 0.05% (0.2016 => 0.2017, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -38.99% (0.0218 => 0.0133, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 12.14% (0.0379 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 6.16% (0.0276 => 0.0293, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 7.22% (0.0291 => 0.0312, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.47% (0.0427 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -8.91% (0.0202 => 0.0184, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/test1: -10.60% (0.0217 => 0.0194, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1452 => 0.1455, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.37% (1.1271 => 1.1117, std.dev.: 0.0333) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.76% (0.1415 => 0.1454, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.89% (0.4140 => 0.4177, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.41% (0.1378 => 0.1425, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.68% (0.0599 => 0.0633, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 10.47% (0.0191 => 0.0211, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.77% (0.0566 => 0.0556, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.30% (1.1929 => 1.1965, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.40% (0.0588 => 0.0568, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -25.75% (0.0268 => 0.0199, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.84% (0.7725 => 0.7790, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: -83.33% (0.0006 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 232.43% (0.0037 => 0.0123) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2304.61% (0.6332 => 15.2260, std.dev.: 0.0216) MultiSource/Benchmarks/McCat/08-main/main: 46.81% (0.1831 => 0.2688, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.53% (0.1559 => 0.1426, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1496.08% (0.3344 => 5.3373, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.90% (0.2364 => 0.3260, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -0.23% (0.0429 => 0.0428, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.12% (0.0224 => 0.0231, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -32.17% (0.0230 => 0.0156, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4391, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0735, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4945, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3477, std.dev.: 0.0195) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1488, std.dev.: 0.0224) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4028, std.dev.: 0.0040) SingleSource/Regression/C/uint64_to_float: -24.02% (2.1832 => 1.6589, std.dev.: 0.0060) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.57% (0.0810 => 0.0928, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 12.41% (0.1112 => 0.1250, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.11% (0.2180 => 0.2335, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.78% (0.8321 => 0.8719, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.39% (0.8148 => 0.8506, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.09% (1.1685 => 1.2163, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.77% (0.6287 => 0.6524, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.76% (0.3295 => 0.3419, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.59% (0.9069 => 0.9395, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.51% (0.4127 => 0.4272, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.32% (1.4479 => 1.4959, std.dev.: 0.0049) MultiSource/Applications/hbd/hbd: 3.29% (1.4269 => 1.4739, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.98% (0.8331 => 0.8579, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.95% (0.4783 => 0.4924, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.94% (0.8069 => 0.8306, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.70% (0.7966 => 0.8181, std.dev.: 0.0051) MultiSource/Applications/lua/lua: 2.68% (3.8189 => 3.9214, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.67% (0.8050 => 0.8265, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.65% (0.8007 => 0.8219, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.61% (0.8457 => 0.8678, std.dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: 2.61% (0.9810 => 1.0066, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 2.59% (0.7557 => 0.7753, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.59% (0.8611 => 0.8834, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 2.57% (1.1271 => 1.1561, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.53% (0.8697 => 0.8917, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.48% (6.6074 => 6.7713, std.dev.: 0.0101) MultiSource/Applications/minisat/minisat: 2.37% (0.6834 => 0.6996, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.36% (0.8597 => 0.8800, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.27% (0.8317 => 0.8506, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.23% (0.9908 => 1.0129, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.20% (0.9688 => 0.9901, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.19% (0.8359 => 0.8542, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.18% (0.8656 => 0.8845, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.18% (0.8855 => 0.9048, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.17% (0.8066 => 0.8241, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.13% (0.8261 => 0.8437, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.13% (0.9074 => 0.9267, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/gs/gs: 2.12% (4.1305 => 4.2182, std.dev.: 0.0277) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.11% (0.8805 => 0.8991, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.06% (1.6386 => 1.6724, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.06% (0.8204 => 0.8373, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.04% (0.7932 => 0.8094, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.03% (0.8712 => 0.8889, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.02% (0.8927 => 0.9107, std.dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: 1.95% (31.8598 => 32.4808, std.dev.: 0.0976) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.86% (0.9039 => 0.9207, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.84% (0.8048 => 0.8196, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.80% (0.8177 => 0.8324, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 1.76% (8.6247 => 8.7769, std.dev.: 0.0389) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.74% (1.5315 => 1.5581, std.dev.: 0.0088) MultiSource/Applications/oggenc/oggenc: 1.72% (4.9628 => 5.0480, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.62% (13.1811 => 13.3951, std.dev.: 0.0433) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.62% (0.8316 => 0.8451, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.23% (3.1832 => 3.2223, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.17% (4.4873 => 4.5398, std.dev.: 0.0174) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.16% (0.8995 => 0.9099, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 88.44% (0.0199 => 0.0375, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/pi: 59.14% (1.5795 => 2.5136, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.29% (2.9753 => 3.4600, std.dev.: 0.0425) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.80% (0.7597 => 0.8797, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.71% (2.7995 => 3.2114, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.62% (5.0261 => 5.6103, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.57% (0.3186 => 0.3491, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.02% (1.1857 => 1.2808, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 6.97% (1.7056 => 1.8245, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.47% (4.7794 => 5.0887, std.dev.: 0.0127) MultiSource/Applications/SIBsim4/SIBsim4: 6.12% (3.1873 => 3.3824, std.dev.: 0.0474) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.98% (4.5327 => 4.8038, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.92% (4.9686 => 5.2627, std.dev.: 0.0196) SingleSource/Benchmarks/Misc/richards_benchmark: 5.90% (1.3037 => 1.3806, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.85% (6.2275 => 6.5293, std.dev.: 0.0529) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.69% (3.3761 => 3.5346, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.35% (4.9453 => 5.1605, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.10% (4.9469 => 5.1496, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 3.91% (14.0064 => 14.5534, std.dev.: 0.0021) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.52% (1.2337 => 1.2771, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.48% (0.3587 => 0.3712, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.91% (11.5690 => 11.9051, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.89% (8.2783 => 8.5172, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.76% (4.8362 => 4.9699, std.dev.: 0.0088) MultiSource/Applications/siod/siod: 2.63% (3.6643 => 3.7606, std.dev.: 0.0172) MultiSource/Applications/lambda-0_1_3/lambda: 2.56% (7.4933 => 7.6850, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 2.34% (0.4353 => 0.4455, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: 2.30% (7.3375 => 7.5062, std.dev.: 0.0186) MultiSource/Benchmarks/llubenchmark/llu: 1.77% (1.9967 => 2.0321, std.dev.: 0.0097) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.51% (2.4647 => 2.5018, std.dev.: 0.0091) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.36% (3.9006 => 3.9535, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.17% (3.5679 => 3.6098, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/neural/neural: 1.10% (1.0841 => 1.0960, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.08% (5.4641 => 4.3125, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.34% (7.2130 => 6.3230, std.dev.: 0.0836) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.89% (1.0512 => 0.9367, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.76% (1.1216 => 1.0009, std.dev.: 0.0071) MultiSource/Benchmarks/mafft/pairlocalalign: -8.50% (63.1822 => 57.8126, std.dev.: 0.1018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.17% (0.3269 => 0.3002, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.68% (4.7482 => 4.4311, std.dev.: 0.0337) SingleSource/Benchmarks/Shootout/heapsort: -6.25% (3.2926 => 3.0867, std.dev.: 0.0687) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.97% (5.4972 => 5.1690, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.97% (3.7148 => 3.4932, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.21% (5.1557 => 4.8872, std.dev.: 0.0554) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.22% (3.9188 => 3.7535, std.dev.: 0.0301) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.19% (4.7449 => 4.5463, std.dev.: 0.0491) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.86% (2.8773 => 2.7662, std.dev.: 0.0262) SingleSource/Benchmarks/Dhrystone/fldry: -3.79% (0.6910 => 0.6648, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.64% (6.0224 => 5.8029, std.dev.: 0.0093) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.07% (28.5821 => 27.7038, std.dev.: 0.0238) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.83% (2.6356 => 2.5610, std.dev.: 0.0100) MultiSource/Benchmarks/Olden/bisort/bisort: -2.67% (0.6636 => 0.6459, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.63% (9.9065 => 9.6458, std.dev.: 0.0326) SingleSource/Benchmarks/Shootout-C++/hash2: -2.25% (3.4237 => 3.3466, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.08% (11.5316 => 11.2921, std.dev.: 0.0304) SingleSource/Benchmarks/Misc/ffbench: -1.75% (1.4296 => 1.4046, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.52% (4.9994 => 4.9235, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.42% (3.2169 => 3.1713, std.dev.: 0.0112) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.30% (2.3487 => 2.3181, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.15% (5.6343 => 5.5697, std.dev.: 0.0091) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.79% (16.4461 => 16.7403, std.dev.: 0.0653) MultiSource/Applications/obsequi/Obsequi: 1.94% (1.0262 => 1.0461, std.dev.: 0.0107) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6891.45% (0.3123 => 21.8343, std.dev.: 0.1316) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.21% (0.2463 => 0.3675, std.dev.: 0.0160) SingleSource/Benchmarks/Misc-C++/bigfib: 0.83% (0.6010 => 0.6060, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.14% (0.3266 => 0.3336, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 2.44% (0.1969 => 0.2017, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 8.13% (0.0123 => 0.0133, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 15.35% (0.0254 => 0.0293, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -3.16% (0.0190 => 0.0184, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/test1: 7.78% (0.0180 => 0.0194, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.18% (0.1438 => 0.1455, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.87% (1.1329 => 1.1117, std.dev.: 0.0333) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.55% (0.1462 => 0.1454, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.31% (0.4164 => 0.4177, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.09% (0.1369 => 0.1425, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.25% (0.0641 => 0.0633, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.21% (0.0195 => 0.0211, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.81% (0.0578 => 0.0556, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.62% (1.1437 => 1.1965, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.41% (0.0627 => 0.0568, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 10.56% (0.0180 => 0.0199, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.83% (0.8017 => 0.7790, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 98.39% (0.0062 => 0.0123) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 8 17:30:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 8 Nov 2012 19:30:53 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121109013053.5B97B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5695?compare_to=5689&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5695, Order: 167596, Start Time: 2012-11-08 22:15:37, End Time: 2012-11-09 01:31:04 To: 5689, Order: 167588, Start Time: 2012-11-08 18:11:56, End Time: 2012-11-08 21:27:32 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (170 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (720 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.41% (2.4049 => 2.4389, std.dev.: 0.0064) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.12% (0.0625 => 0.0882, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.36% (0.1063 => 0.1407, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.85% (0.1106 => 0.1403, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.80% (0.2969 => 0.3735, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.83% (0.4253 => 0.5309, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.50% (0.4139 => 0.5153, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 23.75% (1.5932 => 1.9716, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.47% (0.5900 => 0.7285, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.33% (0.4994 => 0.6159, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.11% (0.0714 => 0.0879, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.56% (0.5000 => 0.6128, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.43% (0.0584 => 0.0715, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.30% (0.0547 => 0.0669, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.29% (0.0897 => 0.1088, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.25% (0.1021 => 0.1238, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 21.20% (0.0599 => 0.0726, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.17% (0.1620 => 0.1963, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.69% (0.1107 => 0.1336, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.91% (0.0633 => 0.0759, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 19.83% (0.0948 => 0.1136, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.75% (0.3903 => 0.4674, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.69% (0.0584 => 0.0699, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.67% (0.1103 => 0.1320, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.59% (0.0541 => 0.0647, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 19.49% (0.0821 => 0.0981, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.47% (0.0642 => 0.0767, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.24% (0.1003 => 0.1196, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.24% (0.1549 => 0.1847, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.20% (0.1604 => 0.1912, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.10% (0.0822 => 0.0979, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 19.04% (0.0604 => 0.0719, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 18.90% (0.1619 => 0.1925, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.84% (0.0605 => 0.0719, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.67% (0.2014 => 0.2390, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.26% (0.1462 => 0.1729, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 17.95% (0.0947 => 0.1117, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 17.95% (0.0808 => 0.0953, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.79% (0.3890 => 0.4582, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 17.46% (0.5826 => 0.6843, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 17.32% (0.1218 => 0.1429, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.31% (0.2866 => 0.3362, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 17.12% (0.5889 => 0.6897, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.11% (0.2736 => 0.3204, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 17.05% (0.0698 => 0.0817, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.97% (1.3152 => 1.5384, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 16.94% (0.1505 => 0.1760, std.dev.: 0.0036) MultiSource/Applications/spiff/spiff: 16.88% (0.4029 => 0.4709, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 16.73% (0.1088 => 0.1270, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.47% (0.4658 => 0.5425, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 16.46% (0.5546 => 0.6459, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 16.39% (1.8794 => 2.1874, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.36% (0.3271 => 0.3806, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.23% (3.5627 => 4.1410, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.14% (0.5026 => 0.5837, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.06% (0.1968 => 0.2284, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.86% (0.2875 => 0.3331, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 15.83% (0.9697 => 1.1232, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.83% (1.6211 => 1.8777, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.69% (0.1160 => 0.1342, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 15.40% (0.2714 => 0.3132, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/18-imp/imp: 15.34% (0.1421 => 0.1639, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.25% (0.4361 => 0.5026, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 15.21% (0.3004 => 0.3461, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.20% (4.4195 => 5.0912, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/fibo: 15.19% (0.2725 => 0.3139, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 15.16% (0.2750 => 0.3167, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.16% (0.2738 => 0.3153, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 15.14% (0.7171 => 0.8257, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.02% (0.2729 => 0.3139, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 15.02% (0.2803 => 0.3224, std.dev.: 0.0025) MultiSource/Applications/d/make_dparser: 14.99% (1.0781 => 1.2397, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.99% (0.3930 => 0.4519, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: 14.89% (0.2780 => 0.3194, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 14.88% (0.1284 => 0.1475, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 14.84% (0.2823 => 0.3242, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 14.82% (0.2813 => 0.3230, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 14.77% (0.9909 => 1.1373, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 14.63% (0.3096 => 0.3549, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 14.62% (0.2811 => 0.3222, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.60% (0.2911 => 0.3336, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.59% (0.3195 => 0.3661, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.58% (0.2792 => 0.3199, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.54% (2.0673 => 2.3679, std.dev.: 0.0051) MultiSource/Applications/ClamAV/clamscan: 14.52% (4.2109 => 4.8222, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.45% (1.9694 => 2.2539, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.37% (2.7292 => 3.1215, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/football/football: 14.36% (0.2075 => 0.2373, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.29% (1.9966 => 2.2819, std.dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: 14.26% (23.5202 => 26.8745, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/ary3: 14.17% (0.3267 => 0.3730, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 14.17% (0.3317 => 0.3787, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.13% (0.1090 => 0.1244, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 14.06% (0.3258 => 0.3716, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.86% (0.3362 => 0.3828, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 13.68% (0.2566 => 0.2917, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.66% (0.3060 => 0.3478, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 13.65% (0.3348 => 0.3805, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 13.59% (0.3678 => 0.4178, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.51% (0.3124 => 0.3546, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 13.51% (0.4146 => 0.4706, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.47% (0.3282 => 0.3724, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.41% (0.3625 => 0.4111, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 13.11% (0.3477 => 0.3933, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 13.10% (0.3726 => 0.4214, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 13.04% (1.4269 => 1.6130, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.87% (0.3488 => 0.3937, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 12.80% (0.4251 => 0.4795, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.76% (0.3690 => 0.4161, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.76% (0.3496 => 0.3942, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.76% (0.3465 => 0.3907, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.74% (0.3981 => 0.4488, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.68% (0.3446 => 0.3883, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 12.64% (0.3442 => 0.3877, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 12.62% (0.7875 => 0.8869, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-3: 12.60% (0.3460 => 0.3896, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.60% (0.3469 => 0.3906, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.51% (0.3845 => 0.4326, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 12.36% (2.1653 => 2.4329, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/property: 12.33% (0.3650 => 0.4100, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions: 12.30% (0.3643 => 0.4091, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.11% (0.3724 => 0.4175, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 12.01% (0.5012 => 0.5614, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 11.99% (2.1013 => 2.3532, std.dev.: 0.0093) MultiSource/Applications/JM/lencod/lencod: 11.90% (4.6177 => 5.1671, std.dev.: 0.0133) MultiSource/Applications/SIBsim4/SIBsim4: 11.59% (0.2691 => 0.3003, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.37% (0.2040 => 0.2272, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 10.73% (5.5417 => 6.1362, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.66% (0.6435 => 0.7121, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.41% (0.1028 => 0.1135, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 10.18% (0.3498 => 0.3854, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.15% (0.2068 => 0.2278, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.08% (0.2737 => 0.3013, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.98% (0.1383 => 0.1521, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 9.82% (0.4847 => 0.5323, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.57% (0.3084 => 0.3379, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 9.56% (0.6634 => 0.7268, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 9.26% (0.3336 => 0.3645, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.99% (0.2103 => 0.2292, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 8.85% (2.0346 => 2.2146, std.dev.: 0.0033) MultiSource/Applications/lemon/lemon: 8.70% (0.2391 => 0.2599, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.85% (4.6926 => 5.0611, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.76% (11.6398 => 12.5429, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.61% (0.5361 => 0.5769, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.20% (0.7426 => 0.7961, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.09% (0.5584 => 0.5980, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 5.95% (11.9555 => 12.6674, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.51% (0.3792 => 0.3925, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 10.10% (0.2802 => 0.3085, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6089, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6759, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-2: 4.92% (1.8057 => 1.8945, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1662, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/dry: 4.35% (14.0481 => 14.6592, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.14% (0.3693 => 0.3809, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1932, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.56% (3.1722 => 3.2217, std.dev.: 0.0057) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3031, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2884, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5141, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5942, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.51% (2.4764 => 2.4389, std.dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5592, std.dev.: 0.0167) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9762, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.66% (35.5013 => 32.7832, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary2: -6.99% (0.2402 => 0.2234, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: -3.72% (3.3665 => 3.2414, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8039, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0020) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7748, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -2.92% (17.2379 => 16.7339, std.dev.: 0.0507) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8629, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5734, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4957, std.dev.: 0.0066) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7166, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.08% (105.3826 => 104.2477, std.dev.: 0.0461) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0434, std.dev.: 0.0034) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 8 18:00:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 8 Nov 2012 20:00:32 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121109020032.36C902A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5696?compare_to=5693&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5696, Order: 167602, Start Time: 2012-11-09 00:35:51, End Time: 2012-11-09 02:00:43 To: 5693, Order: 167596, Start Time: 2012-11-08 22:47:50, End Time: 2012-11-09 00:12:41 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (5 on baseline) Performance Improvements: 0 (182 on baseline) Unchanged Tests: 1040 (855 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.23% (54.7460 => 56.5146, std.dev.: 0.0560) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.21% (1.2688 => 1.2842, std.dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.55% (54.5751 => 56.5146, std.dev.: 0.0560) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.08% (2.0478 => 2.1109, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.4937 => 7.6743, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/hash2: 2.30% (3.1932 => 3.2667, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.22% (0.1431 => 0.1299, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.24% (0.3821 => 0.3506, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -8.17% (2.4924 => 2.2887, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.16% (0.3142 => 0.2917, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.97% (0.3357 => 0.3123, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.92% (0.2428 => 0.2260, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.84% (0.9542 => 0.8889, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -6.81% (7.0961 => 6.6131, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/oourafft: -6.81% (0.2160 => 0.2013, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.80% (3.5339 => 3.2937, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: -6.77% (16.1920 => 15.0955, std.dev.: 0.0166) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.75% (22.4056 => 20.8935, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.68% (0.6484 => 0.6051, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -6.68% (9.2283 => 8.6121, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.62% (0.3658 => 0.3416, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.55% (0.4151 => 0.3879, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.55% (0.3025 => 0.2827, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -6.53% (1.3148 => 1.2290, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.51% (1.0544 => 0.9858, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.50% (0.3849 => 0.3599, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.48% (0.3057 => 0.2859, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.46% (0.1796 => 0.1680, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.46% (0.9852 => 0.9216, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.45% (1.2784 => 1.1959, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: -6.44% (0.2871 => 0.2686, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.44% (6.7716 => 6.3357, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: -6.42% (0.2989 => 0.2797, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -6.42% (0.9179 => 0.8590, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.42% (2.1713 => 2.0320, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: -6.40% (4.3330 => 4.0558, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: -6.39% (0.2659 => 0.2489, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: -6.39% (0.1879 => 0.1759, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: -6.38% (0.3026 => 0.2833, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.37% (0.2355 => 0.2205, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.37% (1.3722 => 1.2848, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: -6.36% (0.2939 => 0.2752, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -6.36% (0.3194 => 0.2991, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -6.36% (0.3446 => 0.3227, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.35% (0.1716 => 0.1607, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.34% (1.6364 => 1.5326, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary: -6.33% (0.3394 => 0.3179, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -6.33% (0.3255 => 0.3049, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: -6.32% (0.2849 => 0.2669, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.32% (1.2300 => 1.1523, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.30% (0.3016 => 0.2826, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -6.29% (0.3481 => 0.3262, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -6.29% (0.4248 => 0.3981, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.28% (4.0323 => 3.7791, std.dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: -6.28% (1.1530 => 1.0806, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: -6.28% (0.3059 => 0.2867, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.27% (4.8161 => 4.5140, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.27% (0.4083 => 0.3827, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.27% (0.2903 => 0.2721, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.26% (0.7919 => 0.7423, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.26% (4.5069 => 4.2249, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash: -6.26% (0.4524 => 0.4241, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.25% (0.3837 => 0.3597, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wc: -6.24% (0.3205 => 0.3005, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -6.24% (0.2933 => 0.2750, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/bh/bh: -6.23% (0.2985 => 0.2799, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.20% (1.4642 => 1.3734, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: -6.20% (1.2515 => 1.1739, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: -6.19% (0.4861 => 0.4560, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -6.19% (0.3621 => 0.3397, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.18% (4.8802 => 4.5786, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.14% (0.3483 => 0.3269, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -6.13% (0.1761 => 0.1653, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -6.11% (0.3406 => 0.3198, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.10% (1.6474 => 1.5469, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.09% (0.8521 => 0.8002, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.09% (0.3252 => 0.3054, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.09% (0.3812 => 0.3580, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.08% (0.3880 => 0.3644, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -6.08% (0.3831 => 0.3598, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.08% (5.4682 => 5.1359, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/spellcheck: -6.08% (0.4427 => 0.4158, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.08% (14.2083 => 13.3451, std.dev.: 0.0250) MultiSource/Applications/lemon/lemon: -6.05% (1.1450 => 1.0757, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -6.05% (0.4033 => 0.3789, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -6.03% (2.4021 => 2.2573, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists1: -6.03% (0.3867 => 0.3634, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.00% (0.2548 => 0.2395, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.00% (0.3848 => 0.3617, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -6.00% (0.7447 => 0.7000, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.00% (0.6736 => 0.6332, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.00% (0.9557 => 0.8984, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -5.99% (15.5079 => 14.5790, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.99% (0.3891 => 0.3658, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/synchronized: -5.98% (0.3896 => 0.3663, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.97% (0.4321 => 0.4063, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/sieve: -5.97% (0.3788 => 0.3562, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.96% (0.3491 => 0.3283, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -5.94% (4.0594 => 3.8182, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.94% (0.2695 => 0.2535, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.93% (0.5999 => 0.5643, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.93% (0.2278 => 0.2143, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.92% (0.3884 => 0.3654, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.90% (0.5168 => 0.4863, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -5.90% (0.6750 => 0.6352, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.90% (0.6293 => 0.5922, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: -5.89% (0.3581 => 0.3370, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -5.89% (0.4176 => 0.3930, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.85% (0.7021 => 0.6610, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.85% (0.4515 => 0.4251, std.dev.: 0.0020) MultiSource/Applications/d/make_dparser: -5.83% (3.5154 => 3.3104, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.82% (0.4813 => 0.4533, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: -5.81% (0.4199 => 0.3955, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.80% (0.3931 => 0.3703, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.79% (0.5857 => 0.5518, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -5.78% (17.1032 => 16.1142, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.77% (2.2587 => 2.1283, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.77% (0.2999 => 0.2826, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.74% (0.2385 => 0.2248, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.74% (0.5329 => 0.5023, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.74% (0.7524 => 0.7092, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.74% (0.4916 => 0.4634, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -5.73% (1.3864 => 1.3069, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.70% (8.0126 => 7.5555, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.69% (0.3323 => 0.3134, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -5.68% (0.4280 => 0.4037, std.dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: -5.66% (34.0927 => 32.1625, std.dev.: 0.0142) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.64% (1.2210 => 1.1521, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.63% (0.5591 => 0.5276, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -5.63% (2.1401 => 2.0197, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.61% (1.2221 => 1.1535, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.61% (0.5849 => 0.5521, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.61% (0.6297 => 0.5944, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.59% (0.5863 => 0.5535, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.57% (0.6052 => 0.5715, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -5.57% (18.2933 => 17.2752, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.56% (0.6189 => 0.5845, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.55% (0.5581 => 0.5271, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.55% (0.6230 => 0.5884, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.53% (0.7339 => 0.6933, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.53% (0.5859 => 0.5535, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.53% (0.6676 => 0.6307, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.52% (0.5802 => 0.5482, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.51% (0.3319 => 0.3136, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.51% (0.5575 => 0.5268, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.50% (0.6660 => 0.6294, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.50% (0.6260 => 0.5916, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.49% (0.6446 => 0.6092, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.49% (0.6194 => 0.5854, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.49% (0.6304 => 0.5958, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.48% (0.5570 => 0.5265, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.46% (0.2106 => 0.1991, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.44% (0.5805 => 0.5489, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.42% (0.5567 => 0.5265, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.40% (0.5925 => 0.5605, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -5.39% (0.7982 => 0.7552, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.38% (0.6667 => 0.6308, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.36% (0.6395 => 0.6052, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.35% (0.5456 => 0.5164, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.35% (0.7198 => 0.6813, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.35% (0.5705 => 0.5400, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.34% (0.6681 => 0.6324, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -5.33% (15.2527 => 14.4390, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.32% (0.5941 => 0.5625, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.31% (0.6440 => 0.6098, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.30% (0.6395 => 0.6056, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -5.28% (0.7779 => 0.7368, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.28% (0.5569 => 0.5275, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.24% (0.6033 => 0.5717, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -5.23% (0.3271 => 0.3100, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.20% (0.2001 => 0.1897, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -5.19% (0.8418 => 0.7981, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: -5.09% (5.0226 => 4.7670, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.05% (0.5688 => 0.5401, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -5.01% (0.6441 => 0.6118, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.95% (0.6347 => 0.6033, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.59% (0.9077 => 0.8660, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: -4.43% (1.5610 => 1.4918, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -2.46% (20.7746 => 20.2644, std.dev.: 0.0235) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7565, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/richards_benchmark: -8.66% (1.2842 => 1.1730, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.85% (2.2633 => 2.1761, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.05% (1.0557 => 1.0235, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.94% (1.3096 => 1.2842, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4686, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0002) Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 8 18:48:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 8 Nov 2012 20:48:10 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121109024810.114BA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5697?compare_to=5694&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5697, Order: 167602, Start Time: 2012-11-09 01:22:24, End Time: 2012-11-09 02:48:22 To: 5694, Order: 167597, Start Time: 2012-11-08 23:39:50, End Time: 2012-11-09 01:05:21 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 25 (125 on baseline) Performance Improvements: 0 (29 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 966 (820 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.81% (0.4889 => 0.5271, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 7.64% (0.1545 => 0.1663, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.39% (0.3208 => 0.3413, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.21% (0.6086 => 0.6464, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.84% (0.1729 => 0.1830, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.94% (0.2348 => 0.2464, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.08% (1.3320 => 1.3863, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.04% (1.1621 => 1.2091, std.dev.: 0.0098) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.84% (0.8719 => 0.9054, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: 2.96% (1.2442 => 1.2810, std.dev.: 0.0104) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.69% (0.8506 => 0.8735, std.dev.: 0.0066) MultiSource/Applications/treecc/treecc: 2.22% (2.0133 => 2.0580, std.dev.: 0.0094) MultiSource/Applications/hbd/hbd: 1.74% (1.4739 => 1.4996, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.72% (4.6006 => 4.6798, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.57% (4.2398 => 4.3064, std.dev.: 0.0132) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.25% (4.5395 => 4.5962, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.23% (8.7586 => 8.8667, std.dev.: 0.0304) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 7.24% (3.7535 => 4.0253, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.68% (21.7811 => 22.5816, std.dev.: 0.0266) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.47% (1.0201 => 1.0555, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.20% (58.8660 => 60.7518, std.dev.: 0.2451) SingleSource/Benchmarks/Dhrystone/fldry: 2.02% (0.6648 => 0.6782, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.87% (4.3688 => 4.4506, std.dev.: 0.0285) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.48% (4.4390 => 4.5045, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout/hash: 1.30% (4.2663 => 4.3218, std.dev.: 0.0129) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.49% (16.7403 => 16.8221, std.dev.: 0.0428) MultiSource/Applications/obsequi/Obsequi: 1.19% (1.0461 => 1.0585, std.dev.: 0.0052) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.74% (21.8343 => 21.6724, std.dev.: 0.2631) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.22% (0.3675 => 0.3667, std.dev.: 0.0414) SingleSource/Benchmarks/Misc-C++/bigfib: 0.02% (0.6060 => 0.6061, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.06% (0.3336 => 0.3338, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: -0.40% (0.2017 => 0.2009, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 27.82% (0.0133 => 0.0170, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -20.71% (0.0425 => 0.0337, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 4.78% (0.0293 => 0.0307, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0312 => 0.0312, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.41% (0.0425 => 0.0419, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 9.78% (0.0184 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -10.31% (0.0194 => 0.0174, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.48% (0.1455 => 0.1462, std.dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 3.31% (1.1117 => 1.1485, std.dev.: 0.0230) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.20% (0.1454 => 0.1393, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.10% (0.4177 => 0.4223, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.04% (0.1425 => 0.1396, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0633 => 0.0633, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.47% (0.0211 => 0.0210, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.08% (0.0556 => 0.0550, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.18% (1.1965 => 1.1944, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.05% (0.0568 => 0.0591, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.03% (0.0199 => 0.0209, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.17% (0.7790 => 0.7803, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: -69.11% (0.0123 => 0.0038, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2315.19% (0.6332 => 15.2930, std.dev.: 0.1739) MultiSource/Benchmarks/McCat/08-main/main: 47.90% (0.1831 => 0.2708, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.29% (0.1559 => 0.1461, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1494.14% (0.3344 => 5.3308, std.dev.: 0.0327) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.89% (0.2364 => 0.3236, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/mandel: 0.93% (0.0429 => 0.0433, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.14% (0.0224 => 0.0240, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4395, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0751, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4943, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3448, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1391, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4099, std.dev.: 0.0014) SingleSource/Regression/C/uint64_to_float: -23.92% (2.1832 => 1.6610, std.dev.: 0.0046) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.06% (0.0810 => 0.0932, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: 13.67% (0.1112 => 0.1264, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.91% (0.0848 => 0.0949, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.81% (0.8321 => 0.9054, std.dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.80% (0.3137 => 0.3413, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.75% (0.4847 => 0.5271, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.12% (0.2279 => 0.2464, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.79% (0.1425 => 0.1536, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.55% (0.6010 => 0.6464, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.20% (0.8148 => 0.8735, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.97% (0.2180 => 0.2332, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.73% (0.7473 => 0.7976, std.dev.: 0.0083) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.41% (0.1885 => 0.1987, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 5.09% (1.4269 => 1.4996, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.92% (0.2133 => 0.2238, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.89% (0.3295 => 0.3456, std.dev.: 0.0048) MultiSource/Applications/Burg/burg: 4.81% (1.2222 => 1.2810, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.70% (0.3003 => 0.3144, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.63% (0.5961 => 0.6237, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.40% (1.3279 => 1.3863, std.dev.: 0.0048) MultiSource/Applications/spiff/spiff: 4.33% (0.7950 => 0.8294, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.18% (1.1606 => 1.2091, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.09% (0.4127 => 0.4296, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.04% (0.2998 => 0.3119, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.80% (0.9435 => 0.9794, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.79% (0.6287 => 0.6525, std.dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 3.45% (1.1271 => 1.1660, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.31% (1.1685 => 1.2072, std.dev.: 0.0109) MultiSource/Benchmarks/MallocBench/gs/gs: 3.18% (4.1305 => 4.2618, std.dev.: 0.0329) MultiSource/Applications/treecc/treecc: 3.17% (1.9948 => 2.0580, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.12% (4.1763 => 4.3064, std.dev.: 0.0132) MultiSource/Applications/lua/lua: 3.09% (3.8189 => 3.9368, std.dev.: 0.0144) MultiSource/Applications/ClamAV/clamscan: 3.09% (14.7684 => 15.2243, std.dev.: 0.1454) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.03% (0.8656 => 0.8918, std.dev.: 0.0046) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.98% (6.6074 => 6.8042, std.dev.: 0.0330) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.93% (0.4783 => 0.4923, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 2.91% (0.6834 => 0.7033, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.84% (0.9074 => 0.9332, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 2.82% (0.9810 => 1.0087, std.dev.: 0.0067) MultiSource/Applications/SPASS/SPASS: 2.81% (14.2605 => 14.6616, std.dev.: 0.1019) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.69% (0.8261 => 0.8483, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.69% (0.8007 => 0.8222, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.68% (0.8457 => 0.8684, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.68% (0.4559 => 0.4681, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.67% (0.8716 => 0.8949, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.63% (0.8050 => 0.8262, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.63% (0.8286 => 0.8504, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.59% (0.8518 => 0.8739, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.59% (0.8712 => 0.8938, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.57% (0.8855 => 0.9083, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.53% (0.7932 => 0.8133, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.53% (8.6476 => 8.8667, std.dev.: 0.0304) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.52% (0.8611 => 0.8828, std.dev.: 0.0038) MultiSource/Applications/SIBsim4/SIBsim4: 2.50% (1.2568 => 1.2882, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.43% (0.8805 => 0.9019, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 2.41% (15.3280 => 15.6978, std.dev.: 0.0917) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.41% (4.4880 => 4.5962, std.dev.: 0.0176) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.40% (4.5702 => 4.6798, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.39% (13.1811 => 13.4964, std.dev.: 0.0216) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.34% (1.6386 => 1.6769, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.32% (0.8331 => 0.8524, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.31% (0.8317 => 0.8509, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.31% (0.9056 => 0.9265, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.27% (4.4873 => 4.5893, std.dev.: 0.0323) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.26% (0.8420 => 0.8610, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.24% (0.8927 => 0.9127, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: 2.23% (2.3764 => 2.4295, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.22% (0.9908 => 1.0128, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.19% (0.8086 => 0.8263, std.dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 2.16% (6.7320 => 6.8776, std.dev.: 0.0358) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.15% (0.9688 => 0.9896, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.12% (0.7966 => 0.8135, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.12% (0.8597 => 0.8779, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.11% (0.8340 => 0.8516, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 2.04% (2.2184 => 2.2637, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.02% (0.8177 => 0.8342, std.dev.: 0.0048) MultiSource/Applications/oggenc/oggenc: 1.99% (4.9628 => 5.0617, std.dev.: 0.0193) MultiSource/Applications/lambda-0_1_3/lambda: 1.96% (0.7557 => 0.7705, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.87% (0.8066 => 0.8217, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/football/football: 1.84% (0.8768 => 0.8929, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.81% (2.1401 => 2.1789, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.79% (0.8316 => 0.8465, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.76% (0.8885 => 0.9041, std.dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: 1.70% (31.8598 => 32.4012, std.dev.: 0.1661) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.56% (0.8995 => 0.9135, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.51% (1.5315 => 1.5546, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.27% (3.1832 => 3.2237, std.dev.: 0.0150) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 114.57% (0.0199 => 0.0427, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/pi: 58.49% (1.5795 => 2.5034, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.61% (2.9753 => 3.4695, std.dev.: 0.1097) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.89% (0.7597 => 0.8804, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.89% (2.7995 => 3.2164, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.76% (5.0261 => 5.6170, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.14% (1.1857 => 1.2822, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 7.48% (1.7056 => 1.8332, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.03% (4.7794 => 5.1153, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (1.3037 => 1.3905, std.dev.: 0.0090) MultiSource/Applications/SIBsim4/SIBsim4: 6.43% (3.1873 => 3.3924, std.dev.: 0.0275) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.98% (4.5327 => 4.8039, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.87% (4.9686 => 5.2604, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.87% (6.2275 => 6.5307, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.68% (3.3761 => 3.5341, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.50% (4.9453 => 5.1677, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.26% (4.9469 => 5.1577, std.dev.: 0.0408) MultiSource/Applications/hexxagon/hexxagon: 3.99% (14.0064 => 14.5648, std.dev.: 0.0110) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.60% (0.3587 => 0.3716, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 3.00% (3.6643 => 3.7741, std.dev.: 0.0218) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.89% (8.2783 => 8.5175, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.84% (11.5690 => 11.8976, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.83% (4.8660 => 5.0039, std.dev.: 0.0407) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.72% (3.9188 => 4.0253, std.dev.: 0.0148) MultiSource/Applications/lambda-0_1_3/lambda: 2.66% (7.4933 => 7.6928, std.dev.: 0.0167) SingleSource/Benchmarks/Dhrystone/dry: 2.52% (0.5081 => 0.5209, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.51% (59.2638 => 60.7518, std.dev.: 0.2451) SingleSource/Benchmarks/Shootout/lists: 2.35% (7.3375 => 7.5099, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.19% (4.3552 => 4.4506, std.dev.: 0.0285) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.90% (4.8362 => 4.9279, std.dev.: 0.0185) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.74% (44.5605 => 45.3343, std.dev.: 0.2373) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.61% (1.0388 => 1.0555, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.61% (1.5941 => 1.6197, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.59% (4.4340 => 4.5045, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/ReedSolomon: 1.35% (8.5322 => 8.6477, std.dev.: 0.0325) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.26% (22.2997 => 22.5816, std.dev.: 0.0266) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.22% (2.4647 => 2.4947, std.dev.: 0.0061) MultiSource/Applications/spiff/spiff: 1.14% (2.8561 => 2.8887, std.dev.: 0.0121) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.94% (5.4641 => 4.3198, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.37% (7.2130 => 6.3932, std.dev.: 0.1863) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.02% (1.0512 => 0.9354, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -10.01% (1.1216 => 1.0093, std.dev.: 0.0163) MultiSource/Benchmarks/mafft/pairlocalalign: -8.53% (63.1822 => 57.7953, std.dev.: 0.1214) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.77% (0.3269 => 0.3015, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.84% (4.7482 => 4.4232, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.87% (5.4972 => 5.1745, std.dev.: 0.0290) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.80% (3.7148 => 3.4994, std.dev.: 0.0224) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.05% (5.1557 => 4.8951, std.dev.: 0.0161) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.66% (2.4490 => 2.3348, std.dev.: 0.0358) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.77% (4.7449 => 4.5658, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.64% (6.0224 => 5.8032, std.dev.: 0.0153) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (28.5821 => 27.6862, std.dev.: 0.0213) MultiSource/Benchmarks/Olden/bisort/bisort: -2.91% (0.6636 => 0.6443, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/mason/mason: -2.88% (0.5415 => 0.5259, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.84% (0.5807 => 0.5642, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.83% (2.6356 => 2.5610, std.dev.: 0.0168) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.70% (1.2822 => 1.2476, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.43% (3.2169 => 3.1386, std.dev.: 0.0196) MultiSource/Applications/aha/aha: -2.38% (3.3398 => 3.2603, std.dev.: 0.0069) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.31% (2.8773 => 2.8107, std.dev.: 0.0210) SingleSource/Benchmarks/Shootout-C++/hash2: -2.21% (3.4237 => 3.3482, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.10% (11.5316 => 11.2894, std.dev.: 0.0277) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.02% (9.9065 => 9.7060, std.dev.: 0.0519) SingleSource/Benchmarks/Dhrystone/fldry: -1.85% (0.6910 => 0.6782, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.48% (4.9994 => 4.9252, std.dev.: 0.0197) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.32% (2.3487 => 2.3177, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.16% (5.6343 => 5.5687, std.dev.: 0.0200) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.29% (16.4461 => 16.8221, std.dev.: 0.0428) MultiSource/Applications/obsequi/Obsequi: 3.15% (1.0262 => 1.0585, std.dev.: 0.0052) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6839.61% (0.3123 => 21.6724, std.dev.: 0.2631) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.88% (0.2463 => 0.3667, std.dev.: 0.0414) SingleSource/Benchmarks/Misc-C++/bigfib: 0.85% (0.6010 => 0.6061, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.20% (0.3266 => 0.3338, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 2.03% (0.1969 => 0.2009, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 38.21% (0.0123 => 0.0170, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -17.40% (0.0408 => 0.0337, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 20.87% (0.0254 => 0.0307, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.11% (0.0384 => 0.0419, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -3.33% (0.0180 => 0.0174, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.67% (0.1438 => 0.1462, std.dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.38% (1.1329 => 1.1485, std.dev.: 0.0230) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.72% (0.1462 => 0.1393, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.42% (0.4164 => 0.4223, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.97% (0.1369 => 0.1396, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.25% (0.0641 => 0.0633, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 7.69% (0.0195 => 0.0210, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.84% (0.0578 => 0.0550, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.43% (1.1437 => 1.1944, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.74% (0.0627 => 0.0591, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.11% (0.0180 => 0.0209, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.67% (0.8017 => 0.7803, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: -38.71% (0.0062 => 0.0038, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 8 19:50:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 8 Nov 2012 21:50:21 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121109035021.0BCC22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5698?compare_to=5696&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5698, Order: 167603, Start Time: 2012-11-09 02:25:46, End Time: 2012-11-09 03:50:32 To: 5696, Order: 167602, Start Time: 2012-11-09 00:35:51, End Time: 2012-11-09 02:00:43 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (187 on baseline) Unchanged Tests: 1042 (850 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.82% (54.5751 => 56.6594, std.dev.: 0.0303) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1013, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/salsa20: 2.39% (7.4937 => 7.6728, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/hash2: 2.25% (3.1932 => 3.2649, std.dev.: 0.0113) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.43% (0.1431 => 0.1296, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -8.48% (2.4924 => 2.2811, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.14% (0.3821 => 0.3510, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: -7.90% (0.3812 => 0.3511, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -7.81% (0.3880 => 0.3577, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -7.80% (0.3831 => 0.3532, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -7.80% (0.3848 => 0.3548, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: -7.78% (0.3896 => 0.3593, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.76% (0.3891 => 0.3589, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -7.74% (0.4033 => 0.3721, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.72% (0.3884 => 0.3584, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/property: -7.64% (0.4199 => 0.3878, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -7.64% (0.4176 => 0.3857, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -7.59% (0.4280 => 0.3955, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.46% (0.9542 => 0.8830, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -7.31% (0.2160 => 0.2002, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -7.30% (0.3357 => 0.3112, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.25% (0.2428 => 0.2252, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -7.16% (0.3658 => 0.3396, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.12% (3.5339 => 3.2824, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: -7.11% (4.3330 => 4.0249, std.dev.: 0.0080) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.07% (0.1584 => 0.1472, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.07% (0.3142 => 0.2920, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.05% (0.1716 => 0.1595, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -7.04% (16.1920 => 15.0526, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -7.02% (0.6484 => 0.6029, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.92% (1.0544 => 0.9814, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.92% (0.9852 => 0.9170, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -6.88% (0.2659 => 0.2476, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.85% (6.7716 => 6.3078, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.85% (0.1796 => 0.1673, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -6.84% (9.2283 => 8.5967, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.84% (0.2355 => 0.2194, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.81% (4.5069 => 4.2001, std.dev.: 0.0061) MultiSource/Applications/JM/ldecod/ldecod: -6.79% (7.0961 => 6.6146, std.dev.: 0.0052) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.76% (22.4056 => 20.8899, std.dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.76% (0.7919 => 0.7384, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.75% (1.2784 => 1.1921, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: -6.74% (1.2515 => 1.1672, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -6.73% (0.2985 => 0.2784, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.72% (4.0323 => 3.7612, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.71% (4.8161 => 4.4927, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.71% (0.2548 => 0.2377, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -6.69% (0.9179 => 0.8565, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.65% (1.3722 => 1.2809, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -6.65% (0.1879 => 0.1754, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.65% (1.6364 => 1.5276, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: -6.64% (0.1761 => 0.1644, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.63% (1.2300 => 1.1485, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.60% (0.1621 => 0.1514, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.60% (1.4642 => 1.3676, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.53% (4.8802 => 4.5615, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: -6.52% (1.1530 => 1.0778, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: -6.50% (1.1450 => 1.0706, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.46% (0.6736 => 0.6301, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.45% (1.6474 => 1.5411, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.45% (0.6293 => 0.5887, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -6.45% (0.4515 => 0.4224, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.43% (0.4151 => 0.3884, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.43% (0.3483 => 0.3259, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.43% (0.8521 => 0.7973, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -6.41% (0.2278 => 0.2132, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -6.41% (2.4021 => 2.2482, std.dev.: 0.0009) MultiSource/Applications/lua/lua: -6.38% (4.0594 => 3.8004, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: -6.32% (1.3148 => 1.2317, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.31% (0.2695 => 0.2525, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.30% (0.2999 => 0.2810, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -6.26% (0.3581 => 0.3357, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -6.25% (0.3406 => 0.3193, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: -6.24% (0.7447 => 0.6982, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.24% (0.3849 => 0.3609, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -6.21% (0.4861 => 0.4559, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -6.21% (15.5079 => 14.5445, std.dev.: 0.0242) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.18% (0.4321 => 0.4054, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.16% (0.3931 => 0.3689, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: -6.15% (18.2933 => 17.1689, std.dev.: 0.0064) MultiSource/Benchmarks/SciMark2-C/scimark2: -6.15% (0.3319 => 0.3115, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.14% (0.3323 => 0.3119, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.13% (14.2083 => 13.3372, std.dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.10% (0.4916 => 0.4616, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.10% (0.5999 => 0.5633, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.08% (0.2385 => 0.2240, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: -6.08% (0.2106 => 0.1978, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.07% (0.3837 => 0.3604, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: -6.06% (2.1401 => 2.0104, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.06% (2.1713 => 2.0398, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: -6.05% (1.3864 => 1.3025, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -6.04% (8.0126 => 7.5290, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/ary2: -6.03% (0.3481 => 0.3271, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.02% (0.7524 => 0.7071, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -6.02% (34.0927 => 32.0405, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.02% (0.5168 => 0.4857, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -6.02% (0.3025 => 0.2843, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -6.00% (0.4248 => 0.3993, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.00% (0.7021 => 0.6600, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -5.98% (0.3059 => 0.2876, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.98% (2.2587 => 2.1236, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.98% (0.5857 => 0.5507, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -5.97% (17.1032 => 16.0821, std.dev.: 0.0172) MultiSource/Applications/d/make_dparser: -5.96% (3.5154 => 3.3059, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.95% (0.9557 => 0.8988, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.95% (0.5478 => 0.5152, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: -5.95% (0.3194 => 0.3004, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -5.95% (0.4524 => 0.4255, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.94% (0.6297 => 0.5923, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: -5.94% (0.3621 => 0.3406, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.93% (1.2221 => 1.1496, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: -5.93% (0.7982 => 0.7509, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -5.92% (0.2989 => 0.2812, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.92% (1.2210 => 1.1487, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.92% (0.5863 => 0.5516, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.90% (0.5591 => 0.5261, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: -5.90% (0.3271 => 0.3078, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.86% (5.4682 => 5.1476, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: -5.86% (0.3446 => 0.3244, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.85% (0.5849 => 0.5507, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.83% (0.7198 => 0.6778, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary: -5.83% (0.3394 => 0.3196, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.83% (0.6052 => 0.5699, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.82% (0.6446 => 0.6071, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.81% (0.5575 => 0.5251, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.80% (0.6260 => 0.5897, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.80% (0.5329 => 0.5020, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.79% (0.6230 => 0.5869, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: -5.79% (0.3867 => 0.3643, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.79% (0.7339 => 0.6914, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.78% (0.6194 => 0.5836, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.77% (0.5581 => 0.5259, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.77% (0.6189 => 0.5832, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -5.76% (0.6750 => 0.6361, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.76% (0.6304 => 0.5941, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.76% (0.5802 => 0.5468, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.76% (0.4813 => 0.4536, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.75% (0.5859 => 0.5522, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.75% (0.6440 => 0.6070, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.74% (0.6660 => 0.6278, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.72% (0.5925 => 0.5586, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -5.72% (0.6347 => 0.5984, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.71% (0.5570 => 0.5252, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.69% (0.3252 => 0.3067, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.68% (0.5805 => 0.5475, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.68% (0.6667 => 0.6288, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -5.68% (0.8418 => 0.7940, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.68% (0.6676 => 0.6297, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.65% (0.2001 => 0.1888, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.64% (0.3491 => 0.3294, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.64% (0.6681 => 0.6304, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/em3d/em3d: -5.64% (0.1862 => 0.1757, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.62% (0.5567 => 0.5254, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.62% (0.5941 => 0.5607, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -5.62% (15.2527 => 14.3962, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/fibo: -5.61% (0.2871 => 0.2710, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -5.60% (0.7779 => 0.7343, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.60% (0.5569 => 0.5257, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.60% (0.6395 => 0.6037, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.58% (0.4083 => 0.3855, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.58% (0.6395 => 0.6038, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.57% (0.6033 => 0.5697, std.dev.: 0.0064) SingleSource/UnitTests/ObjC++/property-reference-object: -5.56% (0.6441 => 0.6083, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.54% (0.5705 => 0.5389, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/matrix: -5.53% (0.3255 => 0.3075, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -5.52% (0.3026 => 0.2859, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.52% (0.5456 => 0.5155, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -5.51% (0.2939 => 0.2777, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -5.46% (0.3205 => 0.3030, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.44% (0.2903 => 0.2745, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.44% (0.3016 => 0.2852, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.43% (0.3057 => 0.2891, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.39% (0.2933 => 0.2775, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.38% (0.5688 => 0.5382, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: -5.34% (0.2849 => 0.2697, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.20% (0.4427 => 0.4197, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -5.16% (5.0226 => 4.7632, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -5.16% (0.9077 => 0.8609, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: -5.10% (0.3788 => 0.3595, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -4.93% (1.5610 => 1.4840, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.92% (0.2277 => 0.2165, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -2.73% (20.7746 => 20.2065, std.dev.: 0.0564) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7567, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -8.74% (1.2842 => 1.1720, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.95% (1.7753 => 1.7052, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: -3.90% (2.2633 => 2.1751, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.33% (1.0557 => 1.0205, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.95% (1.3096 => 1.2710, std.dev.: 0.0129) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.68% (6.5735 => 6.4630, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0001) Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 8 20:31:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 8 Nov 2012 22:31:26 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121109043126.7F6F02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5699?compare_to=5697&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5699, Order: 167603, Start Time: 2012-11-09 03:05:22, End Time: 2012-11-09 04:31:38 To: 5697, Order: 167602, Start Time: 2012-11-09 01:22:24, End Time: 2012-11-09 02:48:22 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 9 (82 on baseline) Performance Improvements: 4 (21 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 978 (871 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.07% (0.2532 => 0.2635, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: 2.57% (8.2276 => 8.4391, std.dev.: 0.0536) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.62% (0.6284 => 0.6386, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.22% (0.8828 => 0.8936, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.13% (1.1270 => 1.1397, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.92% (0.3169 => 0.3325, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/mason/mason: 2.61% (0.5259 => 0.5396, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.06% (2.3348 => 2.3830, std.dev.: 0.0179) SingleSource/Benchmarks/Misc/fp-convert: 1.75% (15.6238 => 15.8966, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -6.58% (4.0253 => 3.7603, std.dev.: 0.0303) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.79% (1.0555 => 1.0261, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.52% (60.7518 => 59.2236, std.dev.: 0.1101) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.10% (22.5816 => 22.1071, std.dev.: 0.1811) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.83% (16.8221 => 16.6820, std.dev.: 0.2012) MultiSource/Applications/obsequi/Obsequi: -0.22% (1.0585 => 1.0562, std.dev.: 0.0147) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.11% (21.6724 => 21.6490, std.dev.: 0.1762) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.87% (0.3667 => 0.3635, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -0.13% (0.6061 => 0.6053, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.81% (0.3338 => 0.3311, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/strcat: -0.25% (0.2009 => 0.2004, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 28.82% (0.0170 => 0.0219) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 26.71% (0.0337 => 0.0427, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 7.82% (0.0307 => 0.0331, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.64% (0.0312 => 0.0314, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -10.26% (0.0419 => 0.0376, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/casts: 1.49% (0.0202 => 0.0205, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -0.57% (0.0174 => 0.0173, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.27% (0.1462 => 0.1466, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.23% (1.1485 => 1.1626, std.dev.: 0.0259) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.29% (0.1393 => 0.1411, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.31% (0.4223 => 0.4210, std.dev.: 0.0356) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.59% (0.1396 => 0.1474, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.53% (0.0633 => 0.0560, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.71% (0.0210 => 0.0198, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.36% (0.0550 => 0.0574, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.42% (1.1944 => 1.1994, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 600.00% (0.0001 => 0.0007, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.09% (0.0591 => 0.0555, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.92% (0.0209 => 0.0182, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.21% (0.7803 => 0.7819, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 42.11% (0.0038 => 0.0054, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2298.70% (0.6332 => 15.1886, std.dev.: 0.3109) MultiSource/Benchmarks/McCat/08-main/main: 46.75% (0.1831 => 0.2687, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.06% (0.1559 => 0.1449, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1485.11% (0.3344 => 5.3006, std.dev.: 0.0392) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.25% (0.2364 => 0.3221, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/mandel: 3.03% (0.0429 => 0.0442, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.25% (0.0224 => 0.0238, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0000) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4292, std.dev.: 0.0301) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0746, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4875, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3429, std.dev.: 0.0195) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1269, std.dev.: 0.0196) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4021, std.dev.: 0.0030) SingleSource/Regression/C/uint64_to_float: -24.30% (2.1832 => 1.6527, std.dev.: 0.0020) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.91% (0.0810 => 0.0947, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 11.33% (0.1112 => 0.1238, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.82% (0.8321 => 0.8972, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.74% (0.4847 => 0.5222, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.07% (0.6010 => 0.6435, std.dev.: 0.0075) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.63% (0.3137 => 0.3345, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.94% (0.2998 => 0.3176, std.dev.: 0.0026) MultiSource/Applications/hbd/hbd: 5.73% (1.4269 => 1.5086, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.73% (0.3295 => 0.3451, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.70% (0.9435 => 0.9878, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.61% (0.2519 => 0.2635, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.54% (0.7473 => 0.7812, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.47% (0.6287 => 0.6568, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.77% (0.8611 => 0.8936, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.54% (1.1685 => 1.2099, std.dev.: 0.0083) MultiSource/Applications/lua/lua: 3.47% (3.8189 => 3.9513, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.25% (1.3279 => 1.3710, std.dev.: 0.0107) MultiSource/Benchmarks/MallocBench/gs/gs: 3.21% (4.1305 => 4.2632, std.dev.: 0.0286) MultiSource/Applications/ClamAV/clamscan: 3.20% (14.7684 => 15.2413, std.dev.: 0.1622) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.15% (1.1606 => 1.1972, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.11% (0.8359 => 0.8619, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 3.06% (1.2568 => 1.2953, std.dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: 3.04% (1.1271 => 1.1614, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.00% (0.5961 => 0.6140, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.93% (0.8086 => 0.8323, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.91% (0.4127 => 0.4247, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.65% (4.1763 => 4.2870, std.dev.: 0.0199) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.64% (6.6074 => 6.7819, std.dev.: 0.0310) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.62% (1.6386 => 1.6815, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.59% (0.8331 => 0.8547, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.55% (0.6227 => 0.6386, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.55% (1.2526 => 1.2845, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.51% (0.8805 => 0.9026, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.49% (0.8007 => 0.8206, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.34% (0.8261 => 0.8454, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 2.33% (0.9810 => 1.0039, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.33% (13.1811 => 13.4878, std.dev.: 0.0604) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.30% (0.9688 => 0.9911, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.26% (0.8457 => 0.8648, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.14% (4.4873 => 4.5835, std.dev.: 0.0230) MultiSource/Benchmarks/Bullet/bullet: 2.04% (31.8598 => 32.5113, std.dev.: 0.0335) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.04% (0.9074 => 0.9259, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.03% (1.1170 => 1.1397, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 1.98% (8.6247 => 8.7959, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.97% (0.8927 => 0.9103, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.94% (0.8177 => 0.8336, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/football/football: 1.44% (0.8768 => 0.8894, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.43% (2.1401 => 2.1707, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.30% (0.7932 => 0.8035, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.09% (1.5315 => 1.5482, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.02% (1.2602 => 1.2731, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 117.09% (0.0199 => 0.0432, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/pi: 57.04% (1.5795 => 2.4805, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.43% (0.7597 => 0.8921, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.35% (2.9753 => 3.4617, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.71% (2.7995 => 3.2114, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.48% (5.0261 => 5.6031, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.14% (1.1857 => 1.2822, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 7.19% (1.7056 => 1.8283, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.76% (4.7794 => 5.1023, std.dev.: 0.0164) MultiSource/Applications/SIBsim4/SIBsim4: 6.46% (3.1873 => 3.3933, std.dev.: 0.0224) SingleSource/Benchmarks/Misc/richards_benchmark: 6.45% (1.3037 => 1.3878, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.91% (4.9686 => 5.2623, std.dev.: 0.0312) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.87% (4.5327 => 4.7986, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.81% (6.2275 => 6.5272, std.dev.: 0.0244) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.59% (3.3761 => 3.5309, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.36% (0.3186 => 0.3325, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.25% (4.9453 => 5.1556, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.12% (4.9469 => 5.1508, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.92% (14.0064 => 14.5550, std.dev.: 0.0920) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.43% (0.3587 => 0.3710, std.dev.: 0.0031) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.06% (1.2337 => 1.2714, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.84% (4.8362 => 4.9735, std.dev.: 0.0290) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.76% (11.5690 => 11.8879, std.dev.: 0.0084) MultiSource/Applications/lambda-0_1_3/lambda: 2.72% (7.4933 => 7.6973, std.dev.: 0.0158) MultiSource/Applications/siod/siod: 2.70% (3.6643 => 3.7632, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.38% (4.8660 => 4.9819, std.dev.: 0.0233) SingleSource/Benchmarks/Shootout/lists: 2.29% (7.3375 => 7.5056, std.dev.: 0.0433) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.23% (8.2783 => 8.4627, std.dev.: 0.0211) MultiSource/Benchmarks/Olden/power/power: 1.53% (1.2061 => 1.2246, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 1.49% (2.3560 => 2.3911, std.dev.: 0.0128) MultiSource/Benchmarks/FreeBench/neural/neural: 1.01% (1.0841 => 1.0951, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.87% (5.4641 => 4.3239, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.23% (7.2130 => 6.1867, std.dev.: 0.2264) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.05% (1.0512 => 0.9350, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/chomp: -10.73% (1.1216 => 1.0012, std.dev.: 0.0161) MultiSource/Benchmarks/mafft/pairlocalalign: -8.47% (63.1822 => 57.8296, std.dev.: 0.0739) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.90% (4.7482 => 4.4208, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.39% (0.3269 => 0.3060, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.90% (3.7148 => 3.4958, std.dev.: 0.0297) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.75% (5.4972 => 5.1811, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.14% (5.1557 => 4.8905, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.36% (4.7449 => 4.5382, std.dev.: 0.0204) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.04% (3.9188 => 3.7603, std.dev.: 0.0303) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.67% (6.0224 => 5.8013, std.dev.: 0.0251) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.34% (0.5807 => 0.5613, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (28.5821 => 27.6881, std.dev.: 0.0296) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.69% (2.4490 => 2.3830, std.dev.: 0.0179) SingleSource/Benchmarks/Dhrystone/fldry: -2.40% (0.6910 => 0.6744, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: -2.26% (3.4237 => 3.3462, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.97% (11.5316 => 11.3042, std.dev.: 0.0308) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.52% (4.9994 => 4.9234, std.dev.: 0.0119) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.15% (2.3487 => 2.3218, std.dev.: 0.0015) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.43% (16.4461 => 16.6820, std.dev.: 0.2012) MultiSource/Applications/obsequi/Obsequi: 2.92% (1.0262 => 1.0562, std.dev.: 0.0147) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6832.12% (0.3123 => 21.6490, std.dev.: 0.1762) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.58% (0.2463 => 0.3635, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 0.72% (0.6010 => 0.6053, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.38% (0.3266 => 0.3311, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/strcat: 1.78% (0.1969 => 0.2004, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.08% (0.0384 => 0.0376, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -3.89% (0.0180 => 0.0173, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.95% (0.1438 => 0.1466, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.62% (1.1329 => 1.1626, std.dev.: 0.0259) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.49% (0.1462 => 0.1411, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.10% (0.4164 => 0.4210, std.dev.: 0.0356) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.67% (0.1369 => 0.1474, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -12.64% (0.0641 => 0.0560, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.54% (0.0195 => 0.0198, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.69% (0.0578 => 0.0574, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.87% (1.1437 => 1.1994, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 600.00% (0.0001 => 0.0007, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.48% (0.0627 => 0.0555, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.11% (0.0180 => 0.0182, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.47% (0.8017 => 0.7819, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -12.90% (0.0062 => 0.0054, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 8 21:34:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 8 Nov 2012 23:34:19 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121109053419.C26162A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5700?compare_to=5695&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5700, Order: 167602, Start Time: 2012-11-09 02:19:07, End Time: 2012-11-09 05:34:31 To: 5695, Order: 167596, Start Time: 2012-11-08 22:15:37, End Time: 2012-11-09 01:31:04 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (170 on baseline) Performance Improvements: 2 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1039 (720 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.04% (1.5939 => 1.6105, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.10% (1.9716 => 1.9500, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.13% (126.5841 => 123.8850, std.dev.: 0.9161) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 38.56% (0.0625 => 0.0866, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.67% (0.1063 => 0.1389, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.33% (0.2969 => 0.3721, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.23% (0.4253 => 0.5326, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.32% (0.1106 => 0.1375, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 23.85% (0.4139 => 0.5126, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.31% (0.5900 => 0.7275, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.11% (0.0714 => 0.0879, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.74% (0.0475 => 0.0583) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.49% (0.0547 => 0.0670, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.43% (0.4994 => 0.6114, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 22.40% (1.5932 => 1.9500, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.26% (0.0584 => 0.0714, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.02% (0.5000 => 0.6101, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/tsp/tsp: 21.37% (0.0599 => 0.0727, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.29% (0.0897 => 0.1088, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.25% (0.1021 => 0.1238, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.23% (0.1620 => 0.1964, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.42% (0.1107 => 0.1333, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.06% (0.0633 => 0.0760, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 19.94% (0.0948 => 0.1137, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.86% (0.0584 => 0.0700, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.78% (0.0642 => 0.0769, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.67% (0.1103 => 0.1320, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.64% (0.1604 => 0.1919, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.59% (0.0541 => 0.0647) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.52% (0.3903 => 0.4665, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 19.49% (0.0821 => 0.0981, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.34% (0.1003 => 0.1197, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.24% (0.1549 => 0.1847, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.22% (0.0822 => 0.0980, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 19.15% (0.1619 => 0.1929, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 19.04% (0.0604 => 0.0719, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.40% (0.1462 => 0.1731, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.06% (0.0947 => 0.1118, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 17.82% (0.0808 => 0.0952, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.74% (0.3890 => 0.4580, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.58% (0.2014 => 0.2368, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 17.49% (0.1218 => 0.1431, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.29% (0.2736 => 0.3209, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 17.05% (0.0698 => 0.0817, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 17.00% (0.4029 => 0.4714, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 16.99% (0.5826 => 0.6816, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 16.88% (0.1505 => 0.1759, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 16.82% (0.1088 => 0.1271, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.79% (1.3152 => 1.5360, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.68% (0.2866 => 0.3344, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 16.61% (0.5889 => 0.6867, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 16.53% (1.8794 => 2.1900, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.48% (0.3271 => 0.3810, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 16.37% (0.5546 => 0.6454, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.16% (0.1968 => 0.2286, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.14% (3.5627 => 4.1376, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.14% (0.5026 => 0.5837, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 15.97% (0.4658 => 0.5402, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.89% (1.6211 => 1.8787, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.79% (0.2875 => 0.3329, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.60% (0.1160 => 0.1341, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 15.41% (0.1421 => 0.1640, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 15.41% (0.9697 => 1.1191, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.25% (0.4361 => 0.5026, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hello: 15.22% (0.2714 => 0.3127, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.16% (0.2738 => 0.3153, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 15.16% (0.2725 => 0.3138, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.13% (0.2729 => 0.3142, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 15.09% (1.0781 => 1.2408, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/bh/bh: 15.03% (0.1284 => 0.1477, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 15.02% (0.2750 => 0.3163, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 15.01% (0.3004 => 0.3455, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 14.92% (4.2109 => 4.8393, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.91% (0.3930 => 0.4516, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.86% (4.4195 => 5.0761, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference: 14.80% (0.7171 => 0.8232, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/random: 14.77% (0.2803 => 0.3217, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 14.76% (0.9909 => 1.1372, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: 14.75% (0.2780 => 0.3190, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 14.73% (0.2811 => 0.3225, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 14.70% (0.2823 => 0.3238, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 14.68% (0.2813 => 0.3226, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.63% (2.7292 => 3.1285, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.61% (0.2792 => 0.3200, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 14.60% (0.3096 => 0.3548, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.55% (0.3195 => 0.3660, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.53% (0.2911 => 0.3334, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.50% (2.0673 => 2.3670, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.45% (1.9694 => 2.2539, std.dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: 14.32% (23.5202 => 26.8880, std.dev.: 0.0082) MultiSource/Benchmarks/nbench/nbench: 14.22% (0.2566 => 0.2931, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 14.17% (0.3267 => 0.3730, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 14.11% (0.3317 => 0.3785, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.05% (1.9966 => 2.2772, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.04% (0.1090 => 0.1243, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 14.03% (0.3258 => 0.3715, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 13.93% (0.2075 => 0.2364, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.89% (0.3362 => 0.3829, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.79% (0.3488 => 0.3969) SingleSource/UnitTests/ObjC/for-in: 13.79% (0.3496 => 0.3978, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.78% (0.3469 => 0.3947, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 13.76% (0.3446 => 0.3920, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.74% (0.3465 => 0.3941, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 13.71% (0.3348 => 0.3807, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.63% (0.3060 => 0.3477, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.61% (0.3460 => 0.3931, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 13.60% (1.4269 => 1.6210, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash: 13.56% (0.4146 => 0.4708, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.51% (0.3442 => 0.3907, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.49% (0.3625 => 0.4114, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.48% (0.3124 => 0.3545, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.44% (0.3282 => 0.3723, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 13.40% (0.3678 => 0.4171, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 13.40% (0.3643 => 0.4131, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 13.34% (0.3650 => 0.4137, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.27% (0.3724 => 0.4218, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 13.15% (0.3726 => 0.4216, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 13.03% (0.3477 => 0.3930, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.85% (0.3845 => 0.4339, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 12.84% (0.4251 => 0.4797, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.84% (0.3981 => 0.4492, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.82% (0.3690 => 0.4163, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 12.81% (0.7875 => 0.8884, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 12.27% (2.1653 => 2.4310, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 12.27% (0.5012 => 0.5627, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 11.98% (4.6177 => 5.1707, std.dev.: 0.0090) MultiSource/Benchmarks/mafft/pairlocalalign: 11.95% (2.1013 => 2.3525, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.42% (0.2040 => 0.2273, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 11.26% (0.2691 => 0.2994, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.97% (0.6435 => 0.7141, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 10.95% (5.5417 => 6.1484, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.51% (0.1028 => 0.1136, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.44% (0.2068 => 0.2284, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.23% (0.2737 => 0.3017, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 10.06% (0.3498 => 0.3850, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.82% (0.3084 => 0.3387, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 9.80% (0.4847 => 0.5322, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.62% (0.1383 => 0.1516, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 9.60% (0.6634 => 0.7271, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: 9.41% (0.3336 => 0.3650, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.13% (0.2103 => 0.2295, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 8.66% (0.2391 => 0.2598, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 8.62% (2.0346 => 2.2100, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.15% (4.6926 => 5.0751, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.00% (0.5361 => 0.5790, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.00% (11.6398 => 12.5711, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.38% (0.7426 => 0.7974, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.32% (0.5584 => 0.5993, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 6.16% (11.9555 => 12.6919, std.dev.: 0.0086) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.48% (0.3792 => 0.3962, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.66% (0.5917 => 0.6725, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 9.42% (0.2802 => 0.3066, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6110, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 6.17% (0.2122 => 0.2253, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6736, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1703, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/flops-2: 4.66% (1.8057 => 1.8898, std.dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/dry: 4.25% (14.0481 => 14.6445, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.14% (0.3693 => 0.3846, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1996, std.dev.: 0.0046) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.66% (3.1722 => 3.2250, std.dev.: 0.0036) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3084, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2854, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.02% (50.0626 => 50.5755, std.dev.: 0.0098) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.68% (2.4764 => 2.4347, std.dev.: 0.0142) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.65% (25.4195 => 16.6106, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary2: -8.33% (0.2402 => 0.2202, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9800, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7994, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9572, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8033, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0037) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7726, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -2.68% (17.2379 => 16.7765, std.dev.: 0.0284) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8675, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5735, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4960, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.19% (105.3826 => 104.1246, std.dev.: 0.0475) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0472, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 8 23:56:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 01:56:24 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121109075624.CC2442A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5701?compare_to=5699&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5701, Order: 167604, Start Time: 2012-11-09 06:29:36, End Time: 2012-11-09 07:56:36 To: 5699, Order: 167603, Start Time: 2012-11-09 03:05:22, End Time: 2012-11-09 04:31:38 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 14 (107 on baseline) Performance Improvements: 4 (25 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 973 (842 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 9.67% (0.1862 => 0.2042, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: 3.70% (0.2972 => 0.3082, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 3.62% (0.3152 => 0.3266, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.92% (0.7812 => 0.8040, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.80% (1.1972 => 1.2307, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.05% (0.5952 => 0.6074, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.78% (0.6140 => 0.6249, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 1.75% (0.8894 => 0.9050, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.17% (1.4964 => 1.8880, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.44% (2.3513 => 2.6204, std.dev.: 0.0304) SingleSource/Benchmarks/Dhrystone/dry: 2.60% (0.5152 => 0.5286, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.12% (44.6443 => 45.5888, std.dev.: 0.3538) MultiSource/Benchmarks/Bullet/bullet: 1.03% (7.1435 => 7.2170, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/pi: 1.01% (2.4805 => 2.5056, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.42% (0.8936 => 0.8809, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -10.37% (3.4230 => 3.0682, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.28% (0.3171 => 0.3067, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.16% (1.2595 => 1.2449, std.dev.: 0.0048) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.14% (16.6820 => 16.7057, std.dev.: 0.1936) MultiSource/Applications/obsequi/Obsequi: 0.59% (1.0562 => 1.0624, std.dev.: 0.0075) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.22% (21.6490 => 22.1299, std.dev.: 0.5007) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.03% (0.3635 => 0.3636, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: -0.58% (0.6053 => 0.6018, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.12% (0.3311 => 0.3315, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.2004 => 0.2004, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.46% (0.0219 => 0.0218, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0427 => 0.0427, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.60% (0.0331 => 0.0333, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0314 => 0.0315, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 12.23% (0.0376 => 0.0422, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: -1.46% (0.0205 => 0.0202, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 24.86% (0.0173 => 0.0216, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1466 => 0.1464, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 3.44% (1.1626 => 1.2026, std.dev.: 0.0066) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 4.82% (0.1411 => 0.1479, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.92% (0.4210 => 0.4129, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.45% (0.1474 => 0.1379, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.79% (0.0560 => 0.0626, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 38.38% (0.0198 => 0.0274, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.01% (0.0574 => 0.0551, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.30% (1.1994 => 1.1958, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 257.14% (0.0007 => 0.0025, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 600.00% (0.0001 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 15.50% (0.0555 => 0.0641, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.24% (0.0182 => 0.0197, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.24% (0.7819 => 0.7838, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 38.89% (0.0054 => 0.0075, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2313.20% (0.6332 => 15.2804, std.dev.: 0.1928) MultiSource/Benchmarks/McCat/08-main/main: 50.19% (0.1831 => 0.2750, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.77% (0.1559 => 0.1469, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1494.71% (0.3344 => 5.3327, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.97% (0.2364 => 0.3238, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0429 => 0.0439, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.70% (0.0224 => 0.0239, std.dev.: 0.0013) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4443, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0723, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4937, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3409, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1317, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4097, std.dev.: 0.0041) SingleSource/Regression/C/uint64_to_float: -23.66% (2.1832 => 1.6667, std.dev.: 0.0033) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.53% (0.0810 => 0.0952, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.77% (0.0830 => 0.0936, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.62% (0.0848 => 0.0955, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 11.96% (0.1112 => 0.1245, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.32% (0.1137 => 0.1243, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.21% (0.2180 => 0.2359, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.19% (0.6010 => 0.6502, std.dev.: 0.0086) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.16% (0.3137 => 0.3393, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.00% (0.1425 => 0.1539, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.59% (0.7473 => 0.8040, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.28% (0.4847 => 0.5200, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.19% (0.1905 => 0.2042, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.91% (0.8321 => 0.8896, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.89% (0.3295 => 0.3522, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.63% (0.2279 => 0.2430, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.40% (0.1983 => 0.2110, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.34% (0.2240 => 0.2382, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.04% (1.1606 => 1.2307, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.03% (0.8148 => 0.8639, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.86% (0.9435 => 0.9988, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.50% (0.6287 => 0.6633, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.16% (0.2133 => 0.2243, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 5.03% (1.4269 => 1.4987, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.83% (0.5961 => 0.6249, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.42% (0.5817 => 0.6074, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.26% (0.3003 => 0.3131, std.dev.: 0.0044) MultiSource/Applications/Burg/burg: 4.12% (1.2222 => 1.2726, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.09% (0.4127 => 0.4296, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.07% (0.2998 => 0.3120, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.04% (1.1685 => 1.2157, std.dev.: 0.0109) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.58% (6.6074 => 6.8442, std.dev.: 0.0270) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.50% (1.3279 => 1.3744, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.50% (4.1763 => 4.3223, std.dev.: 0.0395) MultiSource/Applications/lua/lua: 3.44% (3.8189 => 3.9503, std.dev.: 0.0248) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.36% (1.2526 => 1.2947, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/05-eks/eks: 3.30% (0.4397 => 0.4542, std.dev.: 0.0048) MultiSource/Applications/spiff/spiff: 3.30% (0.7950 => 0.8212, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/football/football: 3.22% (0.8768 => 0.9050, std.dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 3.10% (1.1271 => 1.1620, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.06% (4.4873 => 4.6245, std.dev.: 0.0409) MultiSource/Benchmarks/MallocBench/gs/gs: 2.88% (4.1305 => 4.2496, std.dev.: 0.0333) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.78% (8.6476 => 8.8878, std.dev.: 0.0362) MultiSource/Applications/d/make_dparser: 2.74% (3.2366 => 3.3253, std.dev.: 0.0206) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.65% (1.1170 => 1.1466, std.dev.: 0.0090) MultiSource/Applications/hexxagon/hexxagon: 2.62% (0.9810 => 1.0067, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 2.56% (14.7684 => 15.1467, std.dev.: 0.0748) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.55% (0.6227 => 0.6386, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.51% (4.5702 => 4.6851, std.dev.: 0.0321) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.45% (0.8007 => 0.8203, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.30% (0.8611 => 0.8809, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (4.4880 => 4.5905, std.dev.: 0.0216) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.21% (0.8340 => 0.8524, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: 2.15% (31.8598 => 32.5455, std.dev.: 0.1775) MultiSource/Benchmarks/mafft/pairlocalalign: 2.07% (8.6247 => 8.8031, std.dev.: 0.0557) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.06% (0.8050 => 0.8216, std.dev.: 0.0057) MultiSource/Applications/lambda-0_1_3/lambda: 1.95% (0.7557 => 0.7704, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.94% (0.9056 => 0.9232, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.84% (0.9039 => 0.9205, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 1.78% (15.3280 => 15.6002, std.dev.: 0.1030) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.72% (0.8716 => 0.8866, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 1.67% (2.2184 => 2.2554, std.dev.: 0.0046) MultiSource/Applications/JM/ldecod/ldecod: 1.65% (6.7320 => 6.8433, std.dev.: 0.0416) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.58% (2.1401 => 2.1739, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.55% (0.8518 => 0.8650, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.48% (0.8066 => 0.8185, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.44% (0.8885 => 0.9013, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 1.43% (4.9628 => 5.0337, std.dev.: 0.0222) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.35% (0.8316 => 0.8428, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 74.87% (0.0199 => 0.0348, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/pi: 58.63% (1.5795 => 2.5056, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.35% (2.9753 => 3.4619, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.32% (0.7597 => 0.8761, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.66% (2.7995 => 3.2100, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.55% (5.0261 => 5.6064, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.10% (1.1857 => 1.2818, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.07% (0.3186 => 0.3443, std.dev.: 0.0082) SingleSource/Benchmarks/McGill/queens: 7.18% (1.7056 => 1.8281, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.81% (6.3772 => 6.8112, std.dev.: 0.0975) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.71% (4.7794 => 5.1000, std.dev.: 0.0101) MultiSource/Applications/SIBsim4/SIBsim4: 6.55% (3.1873 => 3.3962, std.dev.: 0.0261) SingleSource/Benchmarks/Misc/richards_benchmark: 6.09% (1.3037 => 1.3831, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.92% (4.9686 => 5.2629, std.dev.: 0.0406) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.88% (4.5327 => 4.7992, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.73% (4.9453 => 5.1794, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.71% (6.2275 => 6.5208, std.dev.: 0.0213) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.69% (3.3761 => 3.5343, std.dev.: 0.0120) SingleSource/Benchmarks/Dhrystone/dry: 4.03% (0.5081 => 0.5286, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.03% (4.9469 => 5.1464, std.dev.: 0.0218) MultiSource/Applications/hexxagon/hexxagon: 3.92% (14.0064 => 14.5556, std.dev.: 0.0079) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.31% (1.2337 => 1.2745, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.92% (11.5690 => 11.9067, std.dev.: 0.0476) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.90% (0.3587 => 0.3691, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 2.84% (7.4933 => 7.7061, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 2.80% (3.6643 => 3.7670, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.56% (4.8660 => 4.9905, std.dev.: 0.0383) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.51% (8.2783 => 8.4861, std.dev.: 0.0246) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.31% (44.5605 => 45.5888, std.dev.: 0.3538) SingleSource/Benchmarks/Shootout/lists: 2.28% (7.3375 => 7.5049, std.dev.: 0.0495) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.14% (4.8362 => 4.9396, std.dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.63% (1.1365 => 1.1550, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.48% (2.4647 => 2.5012, std.dev.: 0.0072) MultiSource/Benchmarks/Bullet/bullet: 1.39% (7.1181 => 7.2170, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/neural/neural: 1.30% (1.0841 => 1.0982, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.29% (1.5941 => 1.6147, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.16% (3.5679 => 3.6094, std.dev.: 0.0115) SingleSource/Benchmarks/Stanford/FloatMM: 1.16% (0.8807 => 0.8909, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 1.01% (8.5322 => 8.6180, std.dev.: 0.0114) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.73% (5.4641 => 4.3314, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.67% (7.2130 => 6.3713, std.dev.: 0.1842) SingleSource/Benchmarks/McGill/chomp: -11.40% (1.1216 => 0.9937, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.87% (1.0512 => 0.9369, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -8.64% (3.2926 => 3.0082, std.dev.: 0.0887) MultiSource/Benchmarks/mafft/pairlocalalign: -8.25% (63.1822 => 57.9701, std.dev.: 0.0575) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.97% (4.7482 => 4.4174, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.24% (0.3269 => 0.3065, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.95% (3.7148 => 3.4939, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.77% (5.4972 => 5.1801, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.05% (5.1557 => 4.8952, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.38% (4.7449 => 4.5369, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.63% (6.0224 => 5.8035, std.dev.: 0.0135) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.13% (0.5807 => 0.5625, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.05% (28.5821 => 27.7116, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.94% (2.6356 => 2.5581, std.dev.: 0.0210) MultiSource/Applications/aha/aha: -2.33% (3.3398 => 3.2620, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.17% (9.9065 => 9.6917, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: -2.14% (3.4237 => 3.3506, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.05% (11.5316 => 11.2950, std.dev.: 0.0097) SingleSource/Benchmarks/Dhrystone/fldry: -1.85% (0.6910 => 0.6782, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.64% (3.2169 => 3.1640, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.64% (4.9994 => 4.9176, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.3487 => 2.3199, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.20% (5.6343 => 5.5665, std.dev.: 0.0184) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.58% (16.4461 => 16.7057, std.dev.: 0.1936) MultiSource/Applications/obsequi/Obsequi: 3.53% (1.0262 => 1.0624, std.dev.: 0.0075) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6986.10% (0.3123 => 22.1299, std.dev.: 0.5007) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.62% (0.2463 => 0.3636, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 0.13% (0.6010 => 0.6018, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.50% (0.3266 => 0.3315, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/strcat: 1.78% (0.1969 => 0.2004, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.81% (0.1438 => 0.1464, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 6.15% (1.1329 => 1.2026, std.dev.: 0.0066) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.16% (0.1462 => 0.1479, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.84% (0.4164 => 0.4129, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.73% (0.1369 => 0.1379, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.34% (0.0641 => 0.0626, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 40.51% (0.0195 => 0.0274, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.67% (0.0578 => 0.0551, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.56% (1.1437 => 1.1958, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2400.00% (0.0001 => 0.0025, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0014 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.23% (0.0627 => 0.0641, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.44% (0.0180 => 0.0197, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.23% (0.8017 => 0.7838, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 20.97% (0.0062 => 0.0075, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 00:00:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 02:00:48 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121109080048.803922A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5702?compare_to=5698&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5702, Order: 167604, Start Time: 2012-11-09 06:35:53, End Time: 2012-11-09 08:00:59 To: 5698, Order: 167603, Start Time: 2012-11-09 02:25:46, End Time: 2012-11-09 03:50:32 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 1 (186 on baseline) Unchanged Tests: 1040 (851 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.36% (1.2710 => 1.2883, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.13% (3.8282 => 3.7851, std.dev.: 0.0118) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.95% (2.0478 => 2.1083, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/salsa20: 2.56% (7.4937 => 7.6857, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash2: 2.11% (3.1932 => 3.2607, std.dev.: 0.0038) MultiSource/Benchmarks/llubenchmark/llu: 1.11% (3.7435 => 3.7851, std.dev.: 0.0118) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.43% (0.1431 => 0.1296, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -8.51% (2.4924 => 2.2804, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.17% (0.3821 => 0.3509, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: -7.50% (0.3812 => 0.3526, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.44% (0.9542 => 0.8832, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -7.44% (0.3831 => 0.3546, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.39% (0.3884 => 0.3597, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -7.39% (0.3357 => 0.3109, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: -7.37% (0.3880 => 0.3594, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -7.35% (0.3848 => 0.3565, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.35% (0.3891 => 0.3605, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.33% (0.2428 => 0.2250, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -7.33% (0.4176 => 0.3870, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -7.32% (0.3896 => 0.3611, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -7.31% (0.4033 => 0.3738, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.26% (0.3142 => 0.2914, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -7.22% (0.2160 => 0.2004, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/property: -7.19% (0.4199 => 0.3897, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -7.15% (0.4280 => 0.3974, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.11% (3.5339 => 3.2827, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -7.08% (0.3658 => 0.3399, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.07% (0.1584 => 0.1472, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: -6.98% (1.2515 => 1.1641, std.dev.: 0.0040) MultiSource/Applications/JM/ldecod/ldecod: -6.97% (7.0961 => 6.6012, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: -6.94% (16.1920 => 15.0682, std.dev.: 0.0170) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.90% (0.1796 => 0.1672, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.89% (1.0544 => 0.9817, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.89% (0.9852 => 0.9173, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -6.88% (0.2659 => 0.2476, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -6.86% (9.2283 => 8.5949, std.dev.: 0.1549) MultiSource/Benchmarks/MallocBench/gs/gs: -6.85% (4.3330 => 4.0363, std.dev.: 0.0069) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.82% (0.1716 => 0.1599, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.82% (0.6484 => 0.6042, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.80% (4.5069 => 4.2005, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.79% (0.2355 => 0.2195, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.76% (22.4056 => 20.8904, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.72% (1.4642 => 1.3658, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.70% (6.7716 => 6.3177, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.69% (4.0323 => 3.7625, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.67% (0.2548 => 0.2378, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.67% (1.3722 => 1.2807, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/football/football: -6.67% (0.9179 => 0.8567, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.66% (4.8161 => 4.4952, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.66% (1.2300 => 1.1481, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -6.64% (0.1761 => 0.1644) SingleSource/Benchmarks/Misc/ReedSolomon: -6.60% (0.1879 => 0.1755, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.55% (0.7919 => 0.7400, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.54% (4.8802 => 4.5609, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.54% (0.1621 => 0.1515, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.53% (0.6736 => 0.6296, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.51% (1.2784 => 1.1952, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/bh/bh: -6.50% (0.2985 => 0.2791, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.48% (0.6293 => 0.5885, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.48% (1.6364 => 1.5304, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/05-eks/eks: -6.47% (0.4515 => 0.4223, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.46% (1.6474 => 1.5409, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -6.45% (1.1450 => 1.0712, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: -6.43% (1.1530 => 1.0789, std.dev.: 0.0016) MultiSource/Applications/lua/lua: -6.41% (4.0594 => 3.7991, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.41% (0.8521 => 0.7975, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.38% (0.5999 => 0.5616, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.38% (0.2695 => 0.2523, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -6.38% (2.4021 => 2.2488, std.dev.: 0.0153) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -6.37% (0.2278 => 0.2133, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -6.34% (0.3581 => 0.3354, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.34% (0.2999 => 0.2809, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.32% (0.3483 => 0.3263, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -6.28% (15.5079 => 14.5347, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.22% (0.4151 => 0.3893, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.20% (0.4916 => 0.4611, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -6.17% (0.3406 => 0.3196, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.09% (14.2083 => 13.3425, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.08% (0.2385 => 0.2240, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.07% (0.7524 => 0.7067, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: -6.07% (2.1401 => 2.0103, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: -6.06% (0.7447 => 0.6996, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -6.05% (1.3148 => 1.2352, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -6.05% (18.2933 => 17.1868, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ft/ft: -6.03% (0.2106 => 0.1979, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.03% (0.5857 => 0.5504, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: -6.01% (1.3864 => 1.3031, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.01% (0.5478 => 0.5149, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -6.00% (0.3319 => 0.3120, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.99% (8.0126 => 7.5323, std.dev.: 0.0258) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.98% (0.3931 => 0.3696, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.98% (0.3849 => 0.3619, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -5.97% (17.1032 => 16.0820, std.dev.: 0.0220) MultiSource/Applications/lambda-0_1_3/lambda: -5.96% (0.7982 => 0.7506, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -5.93% (3.5154 => 3.3069, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: -5.93% (0.3271 => 0.3077, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.92% (0.5168 => 0.4862, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -5.90% (0.4861 => 0.4574, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.90% (0.5863 => 0.5517, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -5.89% (34.0927 => 32.0846, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.88% (1.2221 => 1.1502, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.88% (0.5849 => 0.5505, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.87% (0.7021 => 0.6609, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.87% (0.5591 => 0.5263, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.86% (0.5925 => 0.5578, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.86% (0.6660 => 0.6270, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.85% (0.6052 => 0.5698, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.84% (0.5802 => 0.5463, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.84% (0.3323 => 0.3129, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.84% (0.3837 => 0.3613, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.84% (0.6304 => 0.5936, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.84% (0.5329 => 0.5018, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.83% (0.4321 => 0.4069, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: -5.83% (0.3481 => 0.3278, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.83% (0.6230 => 0.5867, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.83% (2.2587 => 2.1271, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.82% (0.5805 => 0.5467, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.81% (0.6297 => 0.5931, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.80% (5.4682 => 5.1510, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.80% (0.6189 => 0.5830, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.80% (0.6260 => 0.5897, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -5.79% (0.4248 => 0.4002, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.79% (0.6446 => 0.6073, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -5.79% (0.3025 => 0.2850, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.77% (0.5859 => 0.5521, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.76% (0.6194 => 0.5837, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.74% (0.9557 => 0.9008, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.74% (0.5575 => 0.5255, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.72% (2.1713 => 2.0470, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.72% (0.6395 => 0.6029, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -5.72% (0.3621 => 0.3414, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.71% (0.5567 => 0.5249, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.70% (0.5581 => 0.5263, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.68% (1.2210 => 1.1517, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.67% (0.5569 => 0.5253, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.67% (0.6667 => 0.6289, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -5.66% (0.6750 => 0.6368, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -5.64% (0.8418 => 0.7943, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.64% (0.7339 => 0.6925, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.64% (0.5570 => 0.5256, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/ary3: -5.63% (0.3446 => 0.3252, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.63% (0.6395 => 0.6035, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: -5.62% (0.3059 => 0.2887, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.60% (0.3194 => 0.3015, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.60% (0.2001 => 0.1889, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: -5.59% (0.1862 => 0.1758, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.57% (0.5705 => 0.5387, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.57% (0.5456 => 0.5152, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.57% (0.5941 => 0.5610, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: -5.57% (0.4524 => 0.4272, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.56% (0.3491 => 0.3297, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -5.55% (0.2989 => 0.2823, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: -5.53% (0.3867 => 0.3653, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.53% (0.7198 => 0.6800, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.51% (0.6681 => 0.6313, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -5.49% (15.2527 => 14.4156, std.dev.: 0.0188) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.49% (0.4813 => 0.4549, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.48% (0.6440 => 0.6087, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -5.48% (0.3394 => 0.3208, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.47% (0.6033 => 0.5703, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.44% (0.3252 => 0.3075, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.36% (0.4083 => 0.3864, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -5.27% (5.0226 => 4.7577, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: -5.26% (0.2871 => 0.2720, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.22% (0.5688 => 0.5391, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/matrix: -5.19% (0.3255 => 0.3086, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.17% (0.3057 => 0.2899, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hello: -5.12% (0.2849 => 0.2703, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -5.12% (0.3026 => 0.2871, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.10% (0.2939 => 0.2789, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -5.09% (0.3205 => 0.3042, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.08% (0.2933 => 0.2784, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.07% (0.3016 => 0.2863, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -5.06% (0.6347 => 0.6026, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.99% (0.2903 => 0.2758, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.99% (0.4427 => 0.4206, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.97% (0.7779 => 0.7392, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -4.91% (0.6441 => 0.6125, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.90% (0.9077 => 0.8632, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: -4.83% (0.3788 => 0.3605, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.83% (0.2277 => 0.2167, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: -4.73% (1.5610 => 1.4872, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -2.47% (20.7746 => 20.2623, std.dev.: 0.0160) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7531, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.92% (1.7753 => 1.7057, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.85% (2.2633 => 2.1762, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.65% (6.5735 => 6.4653, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.63% (1.3096 => 1.2883, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.06% (1.6086 => 1.5916, std.dev.: 0.0060) Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 00:12:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 02:12:28 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121109081228.C19362A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5703?compare_to=5673&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5703, Order: 167573, Start Time: 2012-11-08 09:03:54, End Time: 2012-11-09 08:12:40 To: 5673, Order: 167527, Start Time: 2012-11-07 10:14:38, End Time: 2012-11-08 08:33:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (43 on baseline) New Passes: 0 (12 on baseline) Performance Regressions: 0 (167 on baseline) Performance Improvements: 2 (39 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 50 (7 on baseline) Unchanged Tests: 990 (640 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.39% (0.7970 => 0.7859, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.16% (2.2231 => 2.1973, std.dev.: 0.0008) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/ClamAV/clamscan: 0.31% (27.5569 => 27.6437, std.dev.: 0.0310) MultiSource/Applications/JM/ldecod/ldecod: 0.32% (6.3089 => 6.3288, std.dev.: 0.0194) MultiSource/Applications/JM/lencod/lencod: 0.57% (19.5699 => 19.6815, std.dev.: 0.0278) MultiSource/Applications/oggenc/oggenc: - (0.0020 => 0.0020, std.dev.: 222.1308) MultiSource/Applications/siod/siod: -0.04% (1.5629 => 1.5623, std.dev.: 0.0079) MultiSource/Applications/sqlite3/sqlite3: 0.29% (0.5223 => 0.5238, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -3.50% (53.2195 => 51.3553, std.dev.: 0.0802) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.8569 => 0.8569, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 0.17% (5.0600 => 5.0684, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -0.75% (10.5417 => 10.4624, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -0.07% (1.4090 => 1.4080, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 0.69% (0.3319 => 0.3342, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.33% (0.0299 => 0.0300, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -0.11% (1.7354 => 1.7335, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/voronoi/voronoi: 0.57% (0.1919 => 0.1930, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.26% (0.0019 => 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: - (0.0020 => 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -0.08% (0.2543 => 0.2541, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.06% (1.7304 => 1.7293, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -0.03% (5.2256 => 5.2241, std.dev.: 0.0135) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.14% (1.1108 => 1.1124, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 0.27% (0.2962 => 0.2970, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0020 => 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/Large/sphereflake MultiSource/Applications/ClamAV/clamscan: - (0.0001 => 0.0001) MultiSource/Applications/JM/ldecod/ldecod: - (0.0001 => 0.0001) MultiSource/Applications/JM/lencod/lencod: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Applications/siod/siod: - (0.0001 => 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.28% (0.0722 => 0.0724, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: - (0.0001 => 0.0001) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8510 => 499.8288, std.dev.: 0.0119) MultiSource/Benchmarks/Olden/voronoi/voronoi: - (0.0001 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: - (0.0001 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: - (0.0001 => 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/nbench/nbench: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -0.04% (2.9178 => 2.9166, std.dev.: 0.0008) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/nbench/nbench MultiSource/Applications/ClamAV/clamscan: 24.66% (22.1758 => 27.6437, std.dev.: 0.0310) MultiSource/Applications/JM/ldecod/ldecod: -39.36% (10.4361 => 6.3288, std.dev.: 0.0194) MultiSource/Applications/JM/lencod/lencod: -10.28% (21.9371 => 19.6815, std.dev.: 0.0278) MultiSource/Applications/oggenc/oggenc: -99.97% (5.7591 => 0.0020, std.dev.: 222.1308) MultiSource/Applications/siod/siod: -31.98% (2.2969 => 1.5623, std.dev.: 0.0079) MultiSource/Applications/sqlite3/sqlite3: -96.95% (17.1811 => 0.5238, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -18.80% (63.2438 => 51.3553, std.dev.: 0.0802) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.78% (0.8101 => 0.8569, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.50% (4.9449 => 5.0684, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 48.32% (7.0540 => 10.4624, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -8.66% (1.5415 => 1.4080, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -31.50% (0.4879 => 0.3342, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.55% (6.6874 => 0.0300, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -67.61% (5.3526 => 1.7335, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/voronoi/voronoi: -28.52% (0.2700 => 0.1930, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -99.93% (2.9384 => 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -99.82% (1.1194 => 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -20.02% (0.3177 => 0.2541, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -67.89% (5.3855 => 1.7293, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.44% (5.0018 => 5.2241, std.dev.: 0.0135) MultiSource/Benchmarks/nbench/nbench: -74.92% (1.1840 => 0.2970, std.dev.: 0.0004) New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/nbench/nbench SingleSource/Benchmarks/Misc-C++/Large/sphereflake MultiSource/Applications/ClamAV/clamscan: -99.94% (0.1629 => 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -99.92% (0.1298 => 0.0001) MultiSource/Applications/siod/siod: -100.00% (3.2827 => 0.0001) MultiSource/Applications/sqlite3/sqlite3: -100.00% (4.6441 => 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -100.00% (2.3135 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -98.00% (0.0050 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -99.96% (0.2497 => 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -50.00% (0.0002 => 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -75.00% (0.0004 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -99.97% (0.3987 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 44222.85% (1.1277 => 499.8288, std.dev.: 0.0119) MultiSource/Benchmarks/Olden/voronoi/voronoi: -99.97% (0.3070 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -100.00% (2.6546 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -100.00% (2.6778 => 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -100.00% (4.5009 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -99.80% (0.0506 => 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -97.30% (0.0037 => 0.0001) MultiSource/Benchmarks/nbench/nbench: -100.00% (11.6436 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.03% (3.2416 => 2.9166, std.dev.: 0.0008) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 191.05% (0.5229 => 1.5219, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 11.67% (14.9895 => 16.7389, std.dev.: 0.0308) MultiSource/Applications/kimwitu++/kc: 35.08% (14.1553 => 19.1207, std.dev.: 0.0146) MultiSource/Benchmarks/MallocBench/gs/gs: 12.18% (4.1105 => 4.6113, std.dev.: 0.0183) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.30% (3.4629 => 5.8282, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 61.44% (0.6222 => 1.0045, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3840000.00% (0.0001 => 3.8401, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 11191600.00% (0.0001 => 11.1917, std.dev.: 0.0477) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 66300.00% (0.0001 => 0.0664, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10002900.00% (0.0001 => 10.0030, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5510500.00% (0.0001 => 5.5106, std.dev.: 0.0046) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 51.61% (0.1056 => 0.1601, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 41.02% (0.0746 => 0.1052, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 37.67% (0.0730 => 0.1005, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 37.57% (0.1432 => 0.1970, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Oscar: 23.43% (0.0636 => 0.0785, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 20.55% (0.0798 => 0.0962, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.27% (0.1584 => 0.1905, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 20.20% (0.2554 => 0.3070, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.41% (0.1566 => 0.1870, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 19.32% (0.1175 => 0.1402, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.79% (8.1363 => 9.6654, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 18.66% (0.0793 => 0.0941, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.13% (0.1125 => 0.1329, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.98% (0.0648 => 0.0758, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 16.72% (0.1555 => 0.1815, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.51% (0.0842 => 0.0981, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.95% (0.0953 => 0.1105, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.85% (0.0675 => 0.0782, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 15.73% (0.0871 => 0.1008, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 15.53% (0.0818 => 0.0945, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.47% (0.0834 => 0.0963, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.45% (0.0770 => 0.0889, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.35% (0.2065 => 0.2382, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 15.29% (0.1151 => 0.1327, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.18% (0.1337 => 0.1540, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.12% (0.0886 => 0.1020, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.04% (0.8172 => 0.9401, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/em3d/em3d: 14.63% (0.1695 => 0.1943, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.48% (0.2107 => 0.2412, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.45% (0.3121 => 0.3572, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.44% (0.2271 => 0.2599) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.09% (0.1029 => 0.1174, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.03% (0.5981 => 0.6820, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 13.76% (0.1163 => 0.1323, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 13.70% (0.0730 => 0.0830, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.37% (0.1062 => 0.1204, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.31% (0.2758 => 0.3125, std.dev.: 0.0041) MultiSource/Applications/Burg/burg: 13.11% (1.1642 => 1.3168, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 12.98% (0.1117 => 0.1262, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 12.97% (0.7115 => 0.8038, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.95% (0.5569 => 0.6290, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/health/health: 12.93% (0.1268 => 0.1432, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 12.90% (0.7433 => 0.8392, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/chomp: 12.87% (0.1655 => 0.1868, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.80% (0.1906 => 0.2150, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.73% (14.3668 => 16.1955, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.65% (0.0838 => 0.0944, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.63% (0.5860 => 0.6600, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.43% (0.9765 => 1.0979, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.32% (0.1940 => 0.2179, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 12.28% (0.7835 => 0.8797, std.dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.13% (0.4615 => 0.5175, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 12.06% (0.3109 => 0.3484, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 11.98% (0.3423 => 0.3833, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.80% (0.3441 => 0.3847, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.44% (0.5105 => 0.5689, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.38% (1.3050 => 1.4535, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.32% (0.1510 => 0.1681, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 11.23% (3.3354 => 3.7099, std.dev.: 0.0171) MultiSource/Applications/lua/lua: 11.15% (3.8723 => 4.3041, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.15% (0.6675 => 0.7419, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.08% (0.1236 => 0.1373, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.99% (0.1892 => 0.2100, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.96% (4.2646 => 4.7322, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.95% (0.1032 => 0.1145, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 10.72% (0.0933 => 0.1033, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 10.71% (10.3673 => 11.4773, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.46% (0.3307 => 0.3653, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 10.28% (2.0273 => 2.2358, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.15% (0.8067 => 0.8886, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.10% (0.5020 => 0.5527, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.04% (3.8922 => 4.2828, std.dev.: 0.0149) MultiSource/Benchmarks/McCat/09-vor/vor: 10.00% (0.3180 => 0.3498, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 9.97% (9.4845 => 10.4302, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.94% (1.5859 => 1.7435, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 9.93% (1.5603 => 1.7152, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/05-eks/eks: 9.91% (0.4299 => 0.4725, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.77% (0.1044 => 0.1146, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 9.70% (1.0722 => 1.1762, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.62% (0.1143 => 0.1253, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/Puzzle: 9.54% (0.1268 => 0.1389, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.53% (0.6450 => 0.7065, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 9.51% (0.8921 => 0.9769, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.49% (0.2603 => 0.2850, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 9.36% (0.6456 => 0.7060, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.27% (1.1861 => 1.2960, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.26% (0.1695 => 0.1852, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.25% (2.2024 => 2.4062, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.19% (2.2022 => 2.4045, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.15% (1.4186 => 1.5484, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: 9.07% (0.3927 => 0.4283, std.dev.: 0.0006) SingleSource/UnitTests/SignlessTypes/rem: 9.00% (0.1144 => 0.1247, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 8.81% (0.3473 => 0.3779, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.81% (0.2430 => 0.2644, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 8.81% (0.3543 => 0.3855, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 8.80% (0.3387 => 0.3685, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 8.75% (0.3886 => 0.4226, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 8.75% (0.1463 => 0.1591, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions-2: 8.64% (0.3497 => 0.3799, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.62% (0.3561 => 0.3868, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.62% (0.3828 => 0.4158, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.61% (0.3543 => 0.3848, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.50% (0.3516 => 0.3815, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.50% (0.3694 => 0.4008, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.39% (0.4636 => 0.5025, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 8.37% (0.4289 => 0.4648, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.31% (0.3865 => 0.4186, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 8.12% (0.4620 => 0.4995, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.07% (0.4103 => 0.4434, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.04% (0.4203 => 0.4541, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: 7.81% (0.2049 => 0.2209, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.80% (0.3422 => 0.3689, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 7.60% (0.3603 => 0.3877, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/moments: 7.34% (0.4048 => 0.4345, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.28% (0.6030 => 0.6469, std.dev.: 0.0057) SingleSource/UnitTests/ObjC++/property-reference: 7.28% (0.7326 => 0.7859, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: 7.27% (0.3684 => 0.3952, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.16% (0.3826 => 0.4100, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 7.07% (0.5925 => 0.6344, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.04% (0.3379 => 0.3617, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.01% (0.3650 => 0.3906, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.92% (0.2905 => 0.3106, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.71% (0.2756 => 0.2941, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.61% (0.2831 => 0.3018, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.57% (0.2891 => 0.3081, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 6.57% (0.2725 => 0.2904, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.56% (0.3232 => 0.3444, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 6.55% (0.3282 => 0.3497, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.41% (0.2714 => 0.2888, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.41% (0.2793 => 0.2972, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.35% (0.4064 => 0.4322, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.33% (2.0665 => 2.1973, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.33% (0.3162 => 0.3362, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 6.21% (0.3283 => 0.3487, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.20% (0.2871 => 0.3049, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 6.18% (1.2842 => 1.3636, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 6.13% (0.3098 => 0.3288, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 6.05% (0.3092 => 0.3279, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.01% (0.2877 => 0.3050, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.87% (0.3052 => 0.3231, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.85% (0.2872 => 0.3040, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.72% (0.3427 => 0.3623, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 5.64% (0.2802 => 0.2960, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.97% (0.3136 => 0.3292, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 3.96% (0.3131 => 0.3255, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.90% (0.3935 => 0.4049, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.66% (1.1145 => 1.3002, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 13.90% (6.6465 => 7.5704, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 10.05% (1.1396 => 1.2541, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.91% (1.7254 => 1.8792, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 8.11% (0.9505 => 1.0276, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.62% (3.1578 => 3.3669, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.43% (0.3463 => 0.3651, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.07% (4.2280 => 4.4001, std.dev.: 0.0059) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.82% (0.4162 => 0.4321, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.72% (8.6802 => 8.9162, std.dev.: 0.0138) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2204, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.91% (0.8333 => 0.8492, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0495, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -75.16% (0.8651 => 0.2149, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -73.46% (5.2763 => 1.4005, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/richards_benchmark: -45.93% (0.1622 => 0.0877, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -11.80% (0.1330 => 0.1173, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -9.47% (1.7609 => 1.5942, std.dev.: 0.0054) SingleSource/UnitTests/Vector/constpool: -9.06% (54.1659 => 49.2576, std.dev.: 0.0138) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.44% (7.9617 => 7.8468, std.dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.17% (0.0628 => 0.0382, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.56% (1.1492 => 0.7635, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/mason/mason: -18.51% (0.2161 => 0.1761, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4241, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -11.00% (9.5636 => 8.5120, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.98% (32.5116 => 28.9428, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel-2: -10.84% (1.5373 => 1.3707, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.13% (1.5660 => 1.4230, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2898, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/distray/distray: -7.16% (0.1592 => 0.1478, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7045, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.23% (1.2373 => 1.1602, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -6.07% (0.4808 => 0.4516, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.18% (1.6805 => 1.5935, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.58% (1.5835 => 1.5109, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.37% (0.9957 => 0.9522, std.dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.74% (1.3677 => 1.3165, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -3.23% (5.0483 => 4.8850, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.97% (8.1563 => 7.9957, std.dev.: 0.0150) MultiSource/Benchmarks/PAQ8p/paq8p: -1.78% (85.0658 => 83.5521, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.76% (10.2830 => 10.1017, std.dev.: 0.0061) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5136, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.14% (6.2999 => 6.2282, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8584, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.69% (1.1048 => 1.1124, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -99.97% (7.1582 => 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: -99.86% (0.0720 => 0.0001) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -65.78% (0.2116 => 0.0724, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 01:38:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 03:38:14 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121109093814.32F5F2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5704?compare_to=5700&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5704, Order: 167603, Start Time: 2012-11-09 06:22:33, End Time: 2012-11-09 09:38:25 To: 5700, Order: 167602, Start Time: 2012-11-09 02:19:07, End Time: 2012-11-09 05:34:31 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (169 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (722 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.45% (54.0990 => 54.8842, std.dev.: 0.1470) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.16% (0.0625 => 0.0876, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.51% (0.1063 => 0.1398, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.73% (0.2969 => 0.3733, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.14% (0.1106 => 0.1384, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.57% (0.4139 => 0.5156, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.55% (0.4253 => 0.5297, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.09% (0.0714 => 0.0886, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.52% (0.0897 => 0.1108, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 23.34% (1.5932 => 1.9650, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.31% (0.5900 => 0.7275, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.09% (0.4994 => 0.6147, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.60% (0.0584 => 0.0716, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.52% (0.5000 => 0.6126, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.49% (0.0547 => 0.0670, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.65% (0.1021 => 0.1242, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.42% (0.1620 => 0.1967, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 21.37% (0.0599 => 0.0727, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.78% (0.1107 => 0.1337, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.06% (0.0633 => 0.0760, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 20.04% (0.0948 => 0.1138, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.03% (0.0584 => 0.0701, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.94% (0.0642 => 0.0770, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.85% (0.1103 => 0.1322, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.81% (0.3903 => 0.4676, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/health/health: 19.61% (0.0821 => 0.0982, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.54% (0.1003 => 0.1199, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.43% (0.1549 => 0.1850, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 19.37% (0.0604 => 0.0721, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.34% (0.0822 => 0.0981, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 19.27% (0.1619 => 0.1931, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.20% (0.1604 => 0.1912, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.54% (0.1462 => 0.1733, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.37% (0.0947 => 0.1121, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.12% (0.3890 => 0.4595, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 17.82% (0.4029 => 0.4747, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.63% (0.2014 => 0.2369, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.62% (0.2736 => 0.3218, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 17.49% (0.1218 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.37% (0.1088 => 0.1277, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.21% (1.3152 => 1.5415, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/mst/mst: 17.19% (0.0698 => 0.0818, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 17.01% (0.1505 => 0.1761, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.82% (0.2866 => 0.3348, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 16.80% (0.5826 => 0.6805, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.79% (0.4658 => 0.5440, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: 16.62% (1.8794 => 2.1918, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 16.61% (0.5546 => 0.6467, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.46% (0.1968 => 0.2292, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.38% (3.5627 => 4.1463, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 16.35% (0.5889 => 0.6852, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.32% (0.5026 => 0.5846, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.14% (0.3271 => 0.3799, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.99% (1.6211 => 1.8803, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.86% (0.1160 => 0.1344, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 15.75% (0.9697 => 1.1224, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 15.62% (0.1421 => 0.1643, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.58% (0.2875 => 0.3323, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.57% (0.4361 => 0.5040, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 15.46% (1.0781 => 1.2448, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.41% (0.2738 => 0.3160, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 15.34% (0.1284 => 0.1481, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 15.28% (0.3004 => 0.3463, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.20% (4.4195 => 5.0911, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.17% (0.3930 => 0.4526, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: 14.96% (0.2780 => 0.3196, std.dev.: 0.0083) MultiSource/Applications/ClamAV/clamscan: 14.92% (4.2109 => 4.8393, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/methcall: 14.90% (0.2813 => 0.3232, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 14.81% (0.2714 => 0.3116, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.73% (2.7292 => 3.1313, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/fibo: 14.72% (0.2725 => 0.3126, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 14.66% (0.2811 => 0.3223, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 14.62% (0.2729 => 0.3128, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 14.59% (0.2823 => 0.3235, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 14.58% (0.2750 => 0.3151, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.56% (1.9694 => 2.2561, std.dev.: 0.0053) MultiSource/Benchmarks/nbench/nbench: 14.54% (0.2566 => 0.2939, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 14.50% (0.9909 => 1.1346, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.47% (1.9966 => 2.2855, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/random: 14.45% (0.2803 => 0.3208, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.43% (0.3195 => 0.3656, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 14.41% (0.7171 => 0.8204, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.32% (0.2911 => 0.3328, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.31% (0.1090 => 0.1246, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.29% (0.2792 => 0.3191, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.27% (2.0673 => 2.3624, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 14.25% (23.5202 => 26.8723, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/wc: 14.21% (0.3096 => 0.3536, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 13.87% (0.3267 => 0.3720, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 13.78% (0.2075 => 0.2361, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 13.72% (0.3258 => 0.3705, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.71% (0.3362 => 0.3823, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 13.71% (1.4269 => 1.6225, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.56% (0.3060 => 0.3475, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 13.51% (0.3317 => 0.3765, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.25% (0.3124 => 0.3538, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 13.21% (0.7875 => 0.8915, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 13.20% (0.3348 => 0.3790, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 13.10% (0.3678 => 0.4160, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 13.00% (0.3477 => 0.3929, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 12.98% (0.3282 => 0.3708, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 12.96% (0.3726 => 0.4209, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 12.88% (0.3625 => 0.4092, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.87% (0.3488 => 0.3937, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/for-in: 12.84% (0.3496 => 0.3945, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.84% (0.3465 => 0.3910, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.77% (0.3446 => 0.3886, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.74% (0.3469 => 0.3911, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.72% (0.3460 => 0.3900, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 12.70% (0.4251 => 0.4791, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 12.69% (0.4146 => 0.4672, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 12.67% (0.3442 => 0.3878, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.58% (0.3981 => 0.4482, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 12.52% (2.1653 => 2.4365, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 12.48% (2.1013 => 2.3636, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.44% (0.3690 => 0.4149, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.41% (0.3650 => 0.4103, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.41% (0.3643 => 0.4095, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.35% (0.3845 => 0.4320, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 12.35% (4.6177 => 5.1878, std.dev.: 0.0116) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.30% (0.2040 => 0.2291, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 12.22% (0.3724 => 0.4179, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 11.99% (0.5012 => 0.5613, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 11.85% (0.2691 => 0.3010, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 11.30% (5.5417 => 6.1678, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: 10.81% (0.4847 => 0.5371, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.80% (0.6435 => 0.7130, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 10.64% (0.6634 => 0.7340, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.60% (0.1028 => 0.1137, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.56% (0.1383 => 0.1529, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 10.43% (0.3498 => 0.3863, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.30% (0.2068 => 0.2281, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.94% (0.2737 => 0.3009, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.66% (0.3084 => 0.3382, std.dev.: 0.0100) MultiSource/Applications/minisat/minisat: 9.62% (0.3336 => 0.3657, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 9.39% (2.0346 => 2.2256, std.dev.: 0.0038) MultiSource/Applications/lemon/lemon: 9.33% (0.2391 => 0.2614, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.22% (0.2103 => 0.2297, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.14% (4.6926 => 5.0746, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.10% (0.5361 => 0.5795, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.04% (11.6398 => 12.5761, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.63% (0.5584 => 0.6010, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.50% (0.7426 => 0.7983, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 6.00% (11.9555 => 12.6723, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.64% (0.3792 => 0.3930, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.96% (0.2802 => 0.3081, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 7.02% (0.2122 => 0.2271, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6099, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.23% (12.0509 => 12.6815, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-2: 5.06% (1.8057 => 1.8970, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1712, std.dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6418, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2072, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2230, std.dev.: 0.0035) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3088, std.dev.: 0.0115) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2840, std.dev.: 0.0037) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5784, std.dev.: 0.0153) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5615, std.dev.: 0.0238) SingleSource/Benchmarks/Shootout-C++/ary2: -9.16% (0.2402 => 0.2182, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9759, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8013, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -3.55% (11.2080 => 10.8097, std.dev.: 0.0066) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7725, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.91% (0.6293 => 0.6110, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: -2.61% (17.2379 => 16.7882, std.dev.: 0.0692) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8705, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5694, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/bh/bh: -1.55% (5.5810 => 5.4946, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1662, std.dev.: 0.0876) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0463, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 01:39:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 03:39:41 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121109093941.6DA852A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5705?compare_to=5701&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5705, Order: 167608, Start Time: 2012-11-09 08:13:26, End Time: 2012-11-09 09:39:53 To: 5701, Order: 167604, Start Time: 2012-11-09 06:29:36, End Time: 2012-11-09 07:56:36 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 3 (111 on baseline) Performance Improvements: 2 (26 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 986 (837 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.38% (0.8344 => 0.8459, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.36% (1.9964 => 2.0235, std.dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.00% (1.1550 => 1.1666, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: -4.91% (0.2465 => 0.2344, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: -1.04% (7.2170 => 7.1419, std.dev.: 0.0150) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.35% (16.7057 => 16.6470, std.dev.: 0.3254) MultiSource/Applications/obsequi/Obsequi: 0.30% (1.0624 => 1.0656, std.dev.: 0.0169) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.54% (22.1299 => 21.7880, std.dev.: 0.1267) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.44% (0.3636 => 0.3652, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 0.20% (0.6018 => 0.6030, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.3315 => 0.3315, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/strcat: 0.30% (0.2004 => 0.2010, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.83% (0.0218 => 0.0222, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0427 => 0.0428, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0333 => 0.0333, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0315 => 0.0315, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.71% (0.0422 => 0.0425, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 1.49% (0.0202 => 0.0205, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 1.85% (0.0216 => 0.0220, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.61% (0.1464 => 0.1455, std.dev.: 0.0032) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -6.86% (1.2026 => 1.1201, std.dev.: 0.0408) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.27% (0.1479 => 0.1475, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.03% (0.4129 => 0.4213, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.58% (0.1379 => 0.1387, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.29% (0.0007 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.50% (0.0626 => 0.0698, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.92% (0.0274 => 0.0266, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.81% (0.0551 => 0.0561, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.13% (1.1958 => 1.1973, std.dev.: 0.0259) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.00% (0.0025 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -14.29% (0.0007 => 0.0006, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.64% (0.0641 => 0.0592, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.63% (0.0197 => 0.0214, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.36% (0.7838 => 0.7866, std.dev.: 0.0155) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -26.67% (0.0075 => 0.0055, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2301.41% (0.6332 => 15.2057, std.dev.: 0.3203) MultiSource/Benchmarks/McCat/08-main/main: 44.84% (0.1831 => 0.2652, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.47% (0.1559 => 0.1427, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1481.73% (0.3344 => 5.2893, std.dev.: 0.1008) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.51% (0.2364 => 0.3227, std.dev.: 0.0171) SingleSource/Benchmarks/Misc/mandel: 3.03% (0.0429 => 0.0442, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.14% (0.0224 => 0.0240, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -27.83% (0.0230 => 0.0166, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4314, std.dev.: 0.0497) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0726, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4909, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3394, std.dev.: 0.0163) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1409, std.dev.: 0.0183) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4002, std.dev.: 0.0102) SingleSource/Regression/C/uint64_to_float: -23.79% (2.1832 => 1.6638, std.dev.: 0.0049) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.19% (0.0810 => 0.0933, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/tsp/tsp: 12.59% (0.1112 => 0.1252, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.68% (0.1425 => 0.1563, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.43% (0.8321 => 0.9106, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.95% (0.2279 => 0.2483, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.90% (0.1157 => 0.1260, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.42% (0.1983 => 0.2150, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.24% (0.6010 => 0.6445, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.20% (0.2998 => 0.3214, std.dev.: 0.0052) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.69% (0.3137 => 0.3347, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.54% (0.7473 => 0.7962, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.19% (0.2180 => 0.2315, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.96% (0.4847 => 0.5136, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.30% (0.1905 => 0.2006, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.29% (0.8148 => 0.8579, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.10% (0.9435 => 0.9916, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.71% (0.5961 => 0.6242, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.67% (0.3295 => 0.3449, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.67% (1.1685 => 1.2231, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.57% (0.5817 => 0.6083, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.56% (0.3003 => 0.3140, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.53% (1.1606 => 1.2132, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.49% (0.2519 => 0.2632, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: 4.48% (1.2222 => 1.2770, std.dev.: 0.0052) MultiSource/Applications/hbd/hbd: 4.37% (1.4269 => 1.4893, std.dev.: 0.0193) MultiSource/Applications/spiff/spiff: 4.11% (0.7950 => 0.8277, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.99% (0.6287 => 0.6538, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.99% (4.1763 => 4.3428, std.dev.: 0.0304) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.80% (0.4127 => 0.4284, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.75% (13.1811 => 13.6756, std.dev.: 0.1027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.73% (1.3279 => 1.3774, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.68% (0.8611 => 0.8928, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.68% (0.4783 => 0.4959, std.dev.: 0.0054) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.1271 => 1.1678, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.29% (4.4873 => 4.6350, std.dev.: 0.0254) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.11% (0.8204 => 0.8459, std.dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.95% (6.6074 => 6.8026, std.dev.: 0.0450) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.88% (0.8007 => 0.8238, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.82% (1.4479 => 1.4888, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.78% (0.8457 => 0.8692, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.77% (0.8697 => 0.8938, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.73% (8.6476 => 8.8836, std.dev.: 0.0102) MultiSource/Applications/SIBsim4/SIBsim4: 2.67% (1.2568 => 1.2904, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.63% (0.8286 => 0.8504, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.62% (0.8805 => 0.9036, std.dev.: 0.0065) MultiSource/Applications/treecc/treecc: 2.61% (1.9948 => 2.0469, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.60% (0.9039 => 0.9274, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.53% (0.8069 => 0.8273, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.52% (0.8317 => 0.8527, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.49% (0.9908 => 1.0155, std.dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: 2.47% (14.7684 => 15.1339, std.dev.: 0.0569) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.46% (0.9056 => 0.9279, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.43% (1.2423 => 1.2725, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.42% (0.9074 => 0.9294, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.42% (0.8597 => 0.8805, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: 2.38% (0.8768 => 0.8977, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.38% (0.8656 => 0.8862, std.dev.: 0.0066) MultiSource/Applications/SPASS/SPASS: 2.36% (14.2605 => 14.5964, std.dev.: 0.0670) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.35% (0.8340 => 0.8536, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.35% (0.8086 => 0.8276, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.33% (0.4559 => 0.4665, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.30% (0.9688 => 0.9911, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.25% (1.2602 => 1.2885, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.22% (0.8066 => 0.8245, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.22% (0.8885 => 0.9082, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.21% (0.8716 => 0.8909, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.18% (0.8338 => 0.8520, std.dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: 2.13% (31.8598 => 32.5387, std.dev.: 0.0309) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.11% (0.8048 => 0.8218, std.dev.: 0.0042) MultiSource/Applications/d/make_dparser: 2.10% (3.2366 => 3.3045, std.dev.: 0.0067) MultiSource/Applications/JM/lencod/lencod: 2.03% (15.3280 => 15.6386, std.dev.: 0.0514) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.95% (0.8359 => 0.8522, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.94% (0.8316 => 0.8477, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 1.92% (4.9628 => 5.0583, std.dev.: 0.0328) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.88% (4.5702 => 4.6562, std.dev.: 0.0284) MultiSource/Applications/JM/ldecod/ldecod: 1.78% (6.7320 => 6.8519, std.dev.: 0.0371) MultiSource/Benchmarks/mafft/pairlocalalign: 1.71% (8.6247 => 8.7720, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.70% (0.6586 => 0.6698, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.66% (0.8995 => 0.9144, std.dev.: 0.0032) MultiSource/Applications/siod/siod: 1.53% (2.2184 => 2.2523, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 104.02% (0.0199 => 0.0406, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/pi: 58.58% (1.5795 => 2.5048, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.78% (0.7597 => 0.8872, std.dev.: 0.0351) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.25% (2.9753 => 3.4588, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.46% (2.7995 => 3.2042, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.63% (5.0261 => 5.6104, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 7.65% (1.7056 => 1.8360, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.00% (4.7794 => 5.1139, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 6.89% (1.1857 => 1.2674, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (1.3037 => 1.3897, std.dev.: 0.0187) MultiSource/Applications/SIBsim4/SIBsim4: 6.38% (3.1873 => 3.3906, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.85% (4.9686 => 5.2594, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.82% (4.5327 => 4.7966, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.50% (6.2275 => 6.5078, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.41% (3.3761 => 3.5250, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.24% (4.9453 => 5.1548, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.05% (4.9469 => 5.1471, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.90% (14.0064 => 14.5523, std.dev.: 0.0874) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.51% (1.2337 => 1.2770, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.85% (11.5690 => 11.8989, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 2.65% (7.4933 => 7.6921, std.dev.: 0.0453) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.65% (1.1365 => 1.1666, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 2.61% (3.6643 => 3.7601, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.47% (8.2783 => 8.4830, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout/lists: 2.16% (7.3375 => 7.4961, std.dev.: 0.0160) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.07% (4.8362 => 4.9363, std.dev.: 0.0166) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.82% (44.5605 => 45.3723, std.dev.: 0.1688) MultiSource/Benchmarks/llubenchmark/llu: 1.34% (1.9967 => 2.0235, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/whetstone: 1.19% (2.1224 => 2.1477, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.14% (3.5679 => 3.6087, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.14% (2.4647 => 2.4927, std.dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.85% (5.4641 => 4.3251, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.90% (1.0512 => 0.9366, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: -10.65% (1.1216 => 1.0021, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -9.26% (7.2130 => 6.5452, std.dev.: 0.2523) MultiSource/Benchmarks/mafft/pairlocalalign: -8.54% (63.1822 => 57.7880, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.31% (0.3269 => 0.3030, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.88% (4.7482 => 4.4214, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.98% (3.7148 => 3.4926, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.94% (5.4972 => 5.1704, std.dev.: 0.0062) SingleSource/Benchmarks/Stanford/Puzzle: -5.89% (0.1698 => 0.1598, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.24% (5.1557 => 4.8854, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.46% (4.7449 => 4.5331, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.73% (6.0224 => 5.7977, std.dev.: 0.0138) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.50% (2.8773 => 2.7766, std.dev.: 0.0235) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (28.5821 => 27.6964, std.dev.: 0.0795) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.08% (0.5807 => 0.5628, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.49% (2.6356 => 2.5701, std.dev.: 0.0133) MultiSource/Applications/aha/aha: -2.27% (3.3398 => 3.2640, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.25% (9.9065 => 9.6840, std.dev.: 0.0431) SingleSource/Benchmarks/Shootout-C++/hash2: -2.23% (3.4237 => 3.3473, std.dev.: 0.0072) SingleSource/Benchmarks/Dhrystone/fldry: -2.19% (0.6910 => 0.6759, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.07% (2.4490 => 2.3984, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.96% (11.5316 => 11.3052, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.61% (4.9994 => 4.9188, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.56% (3.2169 => 3.1668, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.24% (5.6343 => 5.5646, std.dev.: 0.0048) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.22% (16.4461 => 16.6470, std.dev.: 0.3254) MultiSource/Applications/obsequi/Obsequi: 3.84% (1.0262 => 1.0656, std.dev.: 0.0169) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6876.63% (0.3123 => 21.7880, std.dev.: 0.1267) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.27% (0.2463 => 0.3652, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 0.33% (0.6010 => 0.6030, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.50% (0.3266 => 0.3315, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/strcat: 2.08% (0.1969 => 0.2010, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 80.49% (0.0123 => 0.0222, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 22.22% (0.0180 => 0.0220, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.18% (0.1438 => 0.1455, std.dev.: 0.0032) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.13% (1.1329 => 1.1201, std.dev.: 0.0408) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.89% (0.1462 => 0.1475, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.18% (0.4164 => 0.4213, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.31% (0.1369 => 0.1387, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.89% (0.0641 => 0.0698, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 36.41% (0.0195 => 0.0266, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.94% (0.0578 => 0.0561, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.69% (1.1437 => 1.1973, std.dev.: 0.0259) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -57.14% (0.0014 => 0.0006, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.58% (0.0627 => 0.0592, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.89% (0.0180 => 0.0214, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.88% (0.8017 => 0.7866, std.dev.: 0.0155) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -11.29% (0.0062 => 0.0055, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 01:54:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 03:54:00 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121109095400.3DF8D2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5706?compare_to=5702&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5706, Order: 167608, Start Time: 2012-11-09 08:29:11, End Time: 2012-11-09 09:54:12 To: 5702, Order: 167604, Start Time: 2012-11-09 06:35:53, End Time: 2012-11-09 08:00:59 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (182 on baseline) Unchanged Tests: 1041 (855 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.86% (55.4956 => 56.5255, std.dev.: 0.0649) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.57% (54.5751 => 56.5255, std.dev.: 0.0649) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1008, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/salsa20: 2.49% (7.4937 => 7.6804, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hash2: 2.18% (3.1932 => 3.2628, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.29% (0.1431 => 0.1298, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -8.09% (2.4924 => 2.2908, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.51% (0.3821 => 0.3534, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -7.40% (0.3812 => 0.3530, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -7.35% (0.3880 => 0.3595, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.34% (0.3884 => 0.3599, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: -7.31% (0.4033 => 0.3738, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -7.31% (0.3831 => 0.3551, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -7.29% (0.3896 => 0.3612, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -7.28% (0.3848 => 0.3568, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.24% (0.9542 => 0.8851, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/exceptions: -7.18% (0.4176 => 0.3876, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.14% (0.3891 => 0.3613, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.10% (0.3142 => 0.2919, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/property: -7.00% (0.4199 => 0.3905, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.00% (0.2428 => 0.2258, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -6.94% (0.2160 => 0.2010, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -6.94% (0.4280 => 0.3983, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.88% (0.3357 => 0.3126, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: -6.81% (16.1920 => 15.0897, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.81% (0.3658 => 0.3409, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: -6.78% (7.0961 => 6.6151, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.78% (3.5339 => 3.2944, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.71% (0.6484 => 0.6049, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.66% (1.0544 => 0.9842, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: -6.65% (9.2283 => 8.6150, std.dev.: 0.0120) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.63% (22.4056 => 20.9196, std.dev.: 0.0081) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.58% (0.2355 => 0.2200, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.56% (0.9852 => 0.9206, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -6.53% (1.2515 => 1.1698, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.51% (0.1796 => 0.1679, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -6.44% (0.1879 => 0.1758, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: -6.42% (4.3330 => 4.0547, std.dev.: 0.0129) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.41% (6.7716 => 6.3374, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.41% (1.2300 => 1.1512, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.40% (1.3722 => 1.2844, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.40% (4.5069 => 4.2186, std.dev.: 0.0057) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: -6.36% (0.9179 => 0.8595, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.35% (0.1716 => 0.1607, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.32% (4.8802 => 4.5720, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.31% (4.0323 => 3.7779, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: -6.30% (0.2985 => 0.2797, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.29% (4.8161 => 4.5134, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.25% (1.2784 => 1.1985, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.23% (0.1621 => 0.1520, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.23% (0.6293 => 0.5901, std.dev.: 0.0047) MultiSource/Applications/lemon/lemon: -6.23% (1.1450 => 1.0737, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.21% (1.6364 => 1.5348, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.19% (0.4151 => 0.3894, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -6.18% (1.1530 => 1.0817, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.18% (1.4642 => 1.3737, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.16% (0.2695 => 0.2529, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.16% (1.6474 => 1.5460, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.14% (0.3483 => 0.3269, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -6.14% (0.3406 => 0.3197, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.11% (0.4813 => 0.4519, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: -6.09% (0.2659 => 0.2497, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.09% (0.6736 => 0.6326, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.08% (0.2548 => 0.2393, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -6.08% (0.1761 => 0.1654, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: -6.06% (1.3148 => 1.2351, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/ary3: -6.04% (0.3446 => 0.3238, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.02% (0.4916 => 0.4620, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.02% (14.2083 => 13.3530, std.dev.: 0.0135) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -6.01% (0.2278 => 0.2141, std.dev.: 0.0013) MultiSource/Applications/lua/lua: -5.98% (4.0594 => 3.8167, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.96% (0.7919 => 0.7447, std.dev.: 0.0027) MultiSource/Applications/siod/siod: -5.94% (2.4021 => 2.2593, std.dev.: 0.0054) MultiSource/Applications/minisat/minisat: -5.92% (0.7447 => 0.7006, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: -5.92% (0.2989 => 0.2812, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -5.91% (0.4248 => 0.3997, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -5.91% (15.5079 => 14.5916, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.90% (0.3931 => 0.3699, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.90% (0.3323 => 0.3127, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.90% (0.3849 => 0.3622, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -5.89% (0.3481 => 0.3276, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -5.88% (0.3025 => 0.2847, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: -5.87% (0.4515 => 0.4250, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.87% (8.0126 => 7.5426, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.86% (0.3837 => 0.3612, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: -5.85% (0.2939 => 0.2767, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.85% (0.5999 => 0.5648, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/except: -5.85% (0.3026 => 0.2849, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -5.84% (0.3581 => 0.3372, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.83% (0.4083 => 0.3845, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.81% (0.7021 => 0.6613, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.81% (0.5857 => 0.5517, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.80% (0.5168 => 0.4868, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.80% (2.1713 => 2.0454, std.dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: -5.79% (17.1032 => 16.1123, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.79% (0.3057 => 0.2880, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.79% (0.5478 => 0.5161, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.79% (0.2385 => 0.2247, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: -5.76% (0.3194 => 0.3010, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -5.75% (0.3394 => 0.3199, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.75% (0.3255 => 0.3068, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.74% (0.7524 => 0.7092, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.74% (2.2587 => 2.1291, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.74% (0.3016 => 0.2843, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.73% (0.2933 => 0.2765, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.73% (0.5849 => 0.5514, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: -5.73% (0.4524 => 0.4265, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hello: -5.72% (0.2849 => 0.2686, std.dev.: 0.0049) MultiSource/Applications/d/make_dparser: -5.70% (3.5154 => 3.3149, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.70% (0.9557 => 0.9012, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.70% (0.5863 => 0.5529, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -5.69% (2.1401 => 2.0183, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.69% (0.5329 => 0.5026, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.69% (5.4682 => 5.1573, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.68% (0.2903 => 0.2738, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -5.68% (0.3205 => 0.3023, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -5.68% (0.4861 => 0.4585, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.66% (0.8521 => 0.8039, std.dev.: 0.0039) SingleSource/Regression/C++/ofstream_ctor: -5.66% (0.3059 => 0.2886, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.63% (1.2210 => 1.1523, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.61% (0.3491 => 0.3295, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: -5.61% (1.3864 => 1.3086, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.61% (0.6297 => 0.5944, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.60% (0.5805 => 0.5480, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.60% (1.2221 => 1.1537, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -5.57% (0.6750 => 0.6374, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.56% (0.5591 => 0.5280, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.56% (0.6660 => 0.6290, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.55% (0.5859 => 0.5534, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.54% (0.6446 => 0.6089, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.54% (0.6304 => 0.5955, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.54% (0.6052 => 0.5717, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.53% (0.4427 => 0.4182, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.52% (0.6667 => 0.6299, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.52% (0.5581 => 0.5273, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: -5.52% (0.3788 => 0.3579, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.51% (0.5575 => 0.5268, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.49% (0.5925 => 0.5600, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -5.48% (0.3867 => 0.3655, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.48% (0.6260 => 0.5917, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.47% (0.6194 => 0.5855, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.46% (0.7339 => 0.6938, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.46% (0.5802 => 0.5485, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.46% (0.2106 => 0.1991, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.46% (0.7198 => 0.6805, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -5.45% (15.2527 => 14.4211, std.dev.: 0.0231) MultiSource/Benchmarks/McCat/09-vor/vor: -5.44% (0.3271 => 0.3093, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.43% (0.6395 => 0.6048, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -5.42% (0.7779 => 0.7357, std.dev.: 0.0053) MultiSource/Applications/lambda-0_1_3/lambda: -5.42% (0.7982 => 0.7549, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.41% (0.5567 => 0.5266, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: -5.39% (18.2933 => 17.3071, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.39% (0.5569 => 0.5269, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.39% (0.5570 => 0.5270, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.38% (0.3252 => 0.3077, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.38% (0.6189 => 0.5856, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.38% (0.6230 => 0.5895, std.dev.: 0.0031) MultiSource/Applications/spiff/spiff: -5.37% (0.8418 => 0.7966, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.36% (0.5705 => 0.5399, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.35% (0.2001 => 0.1894, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -5.35% (34.0927 => 32.2701, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.30% (0.6676 => 0.6322, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.29% (0.6395 => 0.6057, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.27% (0.2999 => 0.2841, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.25% (0.6033 => 0.5716, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.21% (0.5456 => 0.5172, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.20% (0.5688 => 0.5392, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.19% (0.6440 => 0.6106, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -5.15% (0.6347 => 0.6020, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (0.5941 => 0.5636, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.11% (0.4321 => 0.4100, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -5.06% (0.6441 => 0.6115, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.04% (0.6681 => 0.6344, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: -5.02% (5.0226 => 4.7703, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.97% (0.3319 => 0.3154, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -4.52% (1.5610 => 1.4904, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.33% (0.9077 => 0.8684, std.dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -2.58% (20.7746 => 20.2386, std.dev.: 0.0079) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7554, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: -8.76% (1.2842 => 1.1717, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7061, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.77% (2.2633 => 2.1779, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4744, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0004) Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 03:23:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 05:23:05 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121109112305.BB6A62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5707?compare_to=5705&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5707, Order: 167609, Start Time: 2012-11-09 09:56:55, End Time: 2012-11-09 11:23:17 To: 5705, Order: 167608, Start Time: 2012-11-09 08:13:26, End Time: 2012-11-09 09:39:53 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 5 (130 on baseline) Performance Improvements: 1 (26 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 985 (818 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 2.10% (8.3286 => 8.5037, std.dev.: 0.0406) MultiSource/Applications/lambda-0_1_3/lambda: 1.44% (0.7586 => 0.7695, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 7.01% (3.7860 => 4.0514, std.dev.: 0.0245) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.64% (6.8879 => 7.2074, std.dev.: 0.0974) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 2.20% (1.4110 => 1.4420, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -6.32% (6.5452 => 6.1316, std.dev.: 0.1318) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.43% (16.6470 => 16.7194, std.dev.: 0.0878) MultiSource/Applications/obsequi/Obsequi: 0.38% (1.0656 => 1.0696, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.38% (21.7880 => 21.8711, std.dev.: 0.1545) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.33% (0.3652 => 0.3640, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: 0.38% (0.6030 => 0.6053, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.09% (0.3315 => 0.3312, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/strcat: -1.09% (0.2010 => 0.1988, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.25% (0.0222 => 0.0217, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.93% (0.0428 => 0.0424, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.90% (0.0333 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.27% (0.0315 => 0.0311, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -18.82% (0.0425 => 0.0345, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/casts: -3.90% (0.0205 => 0.0197, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: -23.64% (0.0220 => 0.0168, std.dev.: 0.0025) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.27% (0.1455 => 0.1451, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.46% (1.1201 => 1.1252, std.dev.: 0.0596) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -5.29% (0.1475 => 0.1397, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.85% (0.4213 => 0.4375, std.dev.: 0.0198) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.14% (0.1387 => 0.1389, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -21.78% (0.0698 => 0.0546, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -30.08% (0.0266 => 0.0186, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.10% (0.0561 => 0.0584, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.02% (1.1973 => 1.1971, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1100.00% (0.0001 => 0.0012, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -83.33% (0.0006 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.68% (0.0592 => 0.0588, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.07% (0.0214 => 0.0227, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.11% (0.7866 => 0.7875, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 60.00% (0.0055 => 0.0088, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2300.79% (0.6332 => 15.2018, std.dev.: 0.0959) MultiSource/Benchmarks/McCat/08-main/main: 48.39% (0.1831 => 0.2717, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.89% (0.1559 => 0.1436, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1487.41% (0.3344 => 5.3083, std.dev.: 0.0619) SingleSource/Benchmarks/Misc-C++/Large/ray: 34.98% (0.2364 => 0.3191, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: 1.86% (0.0429 => 0.0437, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.48% (0.0224 => 0.0243, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -30.00% (0.0230 => 0.0161, std.dev.: 0.0007) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4205, std.dev.: 0.0277) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0730, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4947, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3382, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1257, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4077, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: -24.02% (2.1832 => 1.6587, std.dev.: 0.0098) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.28% (0.0810 => 0.0950, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 14.12% (0.1112 => 0.1269, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.81% (0.1425 => 0.1579, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.11% (0.1137 => 0.1252, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 9.60% (0.1062 => 0.1164, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.76% (0.2180 => 0.2371, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.64% (0.1157 => 0.1257, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: 8.02% (0.1347 => 0.1455, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.16% (0.8321 => 0.8917, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.10% (0.4847 => 0.5191, std.dev.: 0.0128) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.81% (0.1983 => 0.2118, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.63% (0.2279 => 0.2430, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.29% (0.6010 => 0.6388, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.01% (0.7473 => 0.7922, std.dev.: 0.0106) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.76% (0.8148 => 0.8617, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.72% (0.1905 => 0.2014, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.64% (0.2998 => 0.3167, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.31% (0.1885 => 0.1985, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.28% (0.6287 => 0.6619, std.dev.: 0.0114) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.09% (0.2240 => 0.2354, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: 4.37% (1.4269 => 1.4893, std.dev.: 0.0034) MultiSource/Applications/spiff/spiff: 4.36% (0.7950 => 0.8297, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.35% (0.9435 => 0.9845, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: 4.23% (0.2999 => 0.3126, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.99% (1.1685 => 1.2151, std.dev.: 0.0081) MultiSource/Benchmarks/McCat/05-eks/eks: 3.75% (0.4397 => 0.4562, std.dev.: 0.0039) MultiSource/Applications/Burg/burg: 3.67% (1.2222 => 1.2670, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.65% (1.3279 => 1.3764, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.37% (0.8457 => 0.8742, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.31% (1.1606 => 1.1990, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.30% (1.6386 => 1.6927, std.dev.: 0.0119) MultiSource/Applications/treecc/treecc: 3.17% (1.9948 => 2.0580, std.dev.: 0.0046) MultiSource/Applications/lua/lua: 3.13% (3.8189 => 3.9383, std.dev.: 0.0042) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.07% (6.6074 => 6.8105, std.dev.: 0.0417) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.04% (0.8697 => 0.8961, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.04% (0.6227 => 0.6416, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.01% (0.9056 => 0.9329, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.99% (0.5817 => 0.5991, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.98% (0.9688 => 0.9977, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.98% (0.4127 => 0.4250, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.97% (0.8204 => 0.8448, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.89% (4.1763 => 4.2971, std.dev.: 0.0357) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.89% (0.7932 => 0.8161, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.89% (8.6476 => 8.8971, std.dev.: 0.0258) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.87% (4.4873 => 4.6162, std.dev.: 0.0118) MultiSource/Benchmarks/McCat/18-imp/imp: 2.85% (0.3503 => 0.3603, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.82% (0.9069 => 0.9325, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.76% (0.8007 => 0.8228, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: 2.74% (4.1305 => 4.2435, std.dev.: 0.0406) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.71% (1.4479 => 1.4872, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.63% (0.8069 => 0.8281, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.60% (0.8359 => 0.8576, std.dev.: 0.0059) MultiSource/Applications/SPASS/SPASS: 2.59% (14.2605 => 14.6304, std.dev.: 0.0411) MultiSource/Benchmarks/nbench/nbench: 2.59% (1.1271 => 1.1563, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.56% (1.1170 => 1.1456, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.53% (0.9908 => 1.0159, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.53% (13.1811 => 13.5146, std.dev.: 0.0836) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.48% (0.8050 => 0.8250, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.46% (0.8317 => 0.8522, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 2.46% (14.7684 => 15.1314, std.dev.: 0.0976) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.45% (0.8597 => 0.8808, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.45% (0.8048 => 0.8245, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.43% (0.8261 => 0.8462, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.41% (0.8855 => 0.9068, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.41% (0.8066 => 0.8260, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.38% (0.8611 => 0.8816, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.38% (0.9074 => 0.9290, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.35% (0.8286 => 0.8481, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.35% (0.9039 => 0.9251, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.34% (4.4880 => 4.5931, std.dev.: 0.0126) MultiSource/Applications/oggenc/oggenc: 2.34% (4.9628 => 5.0790, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.31% (0.8177 => 0.8366, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.31% (0.8805 => 0.9008, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.30% (0.7966 => 0.8149, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.29% (0.8420 => 0.8613, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.28% (0.8656 => 0.8853, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.22% (4.5702 => 4.6718, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.22% (0.8927 => 0.9125, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.21% (0.8086 => 0.8265, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.19% (0.8712 => 0.8903, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.19% (3.2366 => 3.3074, std.dev.: 0.0190) MultiSource/Benchmarks/Prolangs-C/football/football: 2.17% (0.8768 => 0.8958, std.dev.: 0.0056) MultiSource/Benchmarks/PAQ8p/paq8p: 2.09% (2.3764 => 2.4261, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.03% (0.8518 => 0.8691, std.dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 1.93% (6.7320 => 6.8621, std.dev.: 0.0259) MultiSource/Applications/hexxagon/hexxagon: 1.92% (0.9810 => 0.9998, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.91% (0.8338 => 0.8497, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.89% (0.8316 => 0.8473, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.85% (0.8885 => 0.9049, std.dev.: 0.0046) MultiSource/Benchmarks/Bullet/bullet: 1.84% (31.8598 => 32.4448, std.dev.: 0.0781) MultiSource/Applications/lambda-0_1_3/lambda: 1.83% (0.7557 => 0.7695, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.70% (1.2423 => 1.2634, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.65% (1.2526 => 1.2733, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.61% (0.8340 => 0.8474, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 1.60% (8.6247 => 8.7631, std.dev.: 0.0217) MultiSource/Applications/lemon/lemon: 1.25% (1.0945 => 1.1082, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 100.00% (0.0199 => 0.0398, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/pi: 56.89% (1.5795 => 2.4781, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.56% (0.7597 => 0.8855, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.45% (2.9753 => 3.4648, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.42% (2.7995 => 3.2033, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 13.02% (6.3772 => 7.2074, std.dev.: 0.0974) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.50% (5.0261 => 5.6040, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.38% (0.3186 => 0.3453, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.57% (1.1857 => 1.2754, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/queens: 7.46% (1.7056 => 1.8328, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.86% (4.7794 => 5.1073, std.dev.: 0.0083) MultiSource/Applications/SIBsim4/SIBsim4: 6.29% (3.1873 => 3.3879, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.88% (4.9686 => 5.2610, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/richards_benchmark: 5.86% (1.3037 => 1.3801, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.85% (4.5327 => 4.7980, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/treeadd/treeadd: 5.30% (0.3587 => 0.3777, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.92% (6.2275 => 6.5338, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.45% (3.3761 => 3.5262, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.40% (4.9453 => 5.1631, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.09% (4.9469 => 5.1492, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 3.83% (14.0064 => 14.5432, std.dev.: 0.0227) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.38% (3.9188 => 4.0514, std.dev.: 0.0245) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.04% (1.2337 => 1.2712, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.84% (11.5690 => 11.8979, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.74% (8.2783 => 8.5054, std.dev.: 0.0063) MultiSource/Applications/siod/siod: 2.70% (3.6643 => 3.7634, std.dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: 2.68% (7.4933 => 7.6944, std.dev.: 0.0538) SingleSource/Benchmarks/Shootout/lists: 2.17% (7.3375 => 7.4969, std.dev.: 0.0186) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.97% (4.8362 => 4.9315, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.51% (1.4205 => 1.4420, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.29% (1.5941 => 1.6147, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/power/power: 1.26% (1.2061 => 1.2213, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.10% (3.5679 => 3.6072, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/ReedSolomon: 1.10% (8.5322 => 8.6257, std.dev.: 0.0119) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.33% (5.4641 => 4.2985, std.dev.: 0.0545) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.99% (7.2130 => 6.1316, std.dev.: 0.1318) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.84% (1.0512 => 0.9373, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -10.53% (1.1216 => 1.0035, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: -8.56% (63.1822 => 57.7760, std.dev.: 0.0426) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.40% (0.3269 => 0.3027, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.87% (4.7482 => 4.4222, std.dev.: 0.0481) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.94% (3.7148 => 3.4941, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.86% (5.4972 => 5.1750, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.06% (5.1557 => 4.8949, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.36% (4.7449 => 4.5379, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.75% (6.0224 => 5.7963, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.17% (0.5807 => 0.5623, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (28.5821 => 27.6904, std.dev.: 0.0232) SingleSource/Benchmarks/Dhrystone/fldry: -2.75% (0.6910 => 0.6720, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.68% (1.2822 => 1.2479, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.62% (2.6356 => 2.5666, std.dev.: 0.0040) MultiSource/Applications/aha/aha: -2.54% (3.3398 => 3.2551, std.dev.: 0.0224) SingleSource/Benchmarks/Shootout-C++/hash2: -2.42% (3.4237 => 3.3409, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.21% (9.9065 => 9.6880, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/mason/mason: -2.18% (0.5415 => 0.5297, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.10% (3.2169 => 3.1492, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.06% (11.5316 => 11.2939, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.60% (4.9994 => 4.9196, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.52% (2.3487 => 2.3131, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.17% (5.6343 => 5.5681, std.dev.: 0.0013) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.66% (16.4461 => 16.7194, std.dev.: 0.0878) MultiSource/Applications/obsequi/Obsequi: 4.23% (1.0262 => 1.0696, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6903.23% (0.3123 => 21.8711, std.dev.: 0.1545) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.79% (0.2463 => 0.3640, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: 0.72% (0.6010 => 0.6053, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.41% (0.3266 => 0.3312, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/strcat: 0.96% (0.1969 => 0.1988, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.98% (0.0302 => 0.0311, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -10.16% (0.0384 => 0.0345, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/casts: 3.68% (0.0190 => 0.0197, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: -6.67% (0.0180 => 0.0168, std.dev.: 0.0025) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.90% (0.1438 => 0.1451, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.68% (1.1329 => 1.1252, std.dev.: 0.0596) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.45% (0.1462 => 0.1397, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.07% (0.4164 => 0.4375, std.dev.: 0.0198) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.46% (0.1369 => 0.1389, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -14.82% (0.0641 => 0.0546, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.62% (0.0195 => 0.0186, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.04% (0.0578 => 0.0584, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.67% (1.1437 => 1.1971, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1100.00% (0.0001 => 0.0012, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.22% (0.0627 => 0.0588, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.11% (0.0180 => 0.0227, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.77% (0.8017 => 0.7875, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 41.94% (0.0062 => 0.0088, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 03:42:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 05:42:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121109114231.C88482A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5708?compare_to=5706&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5708, Order: 167609, Start Time: 2012-11-09 10:17:34, End Time: 2012-11-09 11:42:44 To: 5706, Order: 167608, Start Time: 2012-11-09 08:29:11, End Time: 2012-11-09 09:54:12 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (6 on baseline) Performance Improvements: 0 (182 on baseline) Unchanged Tests: 1040 (854 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.72% (0.9546 => 0.9710, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/chomp: 1.20% (1.1496 => 1.1634, std.dev.: 0.0034) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.86% (2.0478 => 2.1064, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: 2.70% (7.4937 => 7.6959, std.dev.: 0.0147) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.32% (54.5751 => 55.8388, std.dev.: 0.4467) SingleSource/Benchmarks/Shootout-C++/hash2: 2.28% (3.1932 => 3.2661, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.88% (0.9531 => 0.9710, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.22% (0.1431 => 0.1299, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -8.15% (2.4924 => 2.2892, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.03% (0.3821 => 0.3514, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: -7.48% (0.3812 => 0.3527, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -7.37% (0.3880 => 0.3594, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -7.33% (0.3831 => 0.3550, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-3: -7.30% (0.3848 => 0.3567, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.27% (0.3891 => 0.3608, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/for-in: -7.27% (0.4033 => 0.3740, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.26% (0.3884 => 0.3602, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: -7.24% (0.3896 => 0.3614, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -7.18% (0.4176 => 0.3876, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.07% (0.3142 => 0.2920, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.06% (0.9542 => 0.8868, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: -7.03% (0.4199 => 0.3904, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -6.94% (0.2160 => 0.2010, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.92% (0.2428 => 0.2260, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -6.92% (0.4280 => 0.3984, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.91% (0.3357 => 0.3125, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: -6.79% (16.1920 => 15.0923, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.78% (0.3658 => 0.3410, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.76% (3.5339 => 3.2949, std.dev.: 0.0147) MultiSource/Applications/JM/ldecod/ldecod: -6.75% (7.0961 => 6.6174, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: -6.68% (9.2283 => 8.6120, std.dev.: 0.0128) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.58% (0.2355 => 0.2200, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.57% (22.4056 => 20.9334, std.dev.: 0.0124) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.57% (0.9852 => 0.9205, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.56% (1.0544 => 0.9852, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.51% (0.6484 => 0.6062, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.45% (1.2784 => 1.1960, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.41% (4.0323 => 3.7737, std.dev.: 0.0100) MultiSource/Benchmarks/MallocBench/gs/gs: -6.41% (4.3330 => 4.0552, std.dev.: 0.0053) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.41% (0.1716 => 0.1606, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.41% (4.5069 => 4.2181, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.41% (1.3722 => 1.2843, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.39% (6.7716 => 6.3387, std.dev.: 0.0057) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.36% (1.2300 => 1.1518, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -6.33% (0.2985 => 0.2796, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.32% (4.8161 => 4.5116, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.29% (0.1621 => 0.1519, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.28% (1.4642 => 1.3723, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.26% (0.6736 => 0.6314, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.23% (4.8802 => 4.5761, std.dev.: 0.0083) MultiSource/Applications/Burg/burg: -6.22% (1.2515 => 1.1737, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/08-main/main: -6.21% (0.2659 => 0.2494, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -6.18% (0.9179 => 0.8612, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -6.14% (1.1450 => 1.0747, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.12% (0.2695 => 0.2530, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.12% (0.3483 => 0.3270, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.09% (0.7919 => 0.7437, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.08% (0.2548 => 0.2393, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.08% (1.6474 => 1.5473, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.07% (0.4151 => 0.3899, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -6.05% (1.3148 => 1.2352, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -6.05% (0.3406 => 0.3200, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.03% (1.6364 => 1.5378, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -6.02% (0.1761 => 0.1655, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: -5.98% (1.1530 => 1.0840, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: -5.98% (0.4515 => 0.4245, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.97% (0.2278 => 0.2142, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: -5.95% (0.3581 => 0.3368, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: -5.94% (15.5079 => 14.5863, std.dev.: 0.0219) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.93% (14.2083 => 13.3661, std.dev.: 0.0052) MultiSource/Applications/lua/lua: -5.93% (4.0594 => 3.8188, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.90% (0.3931 => 0.3699, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.90% (0.3849 => 0.3622, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.90% (0.6293 => 0.5922, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: -5.89% (0.7447 => 0.7008, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: -5.89% (0.3394 => 0.3194, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: -5.89% (0.3446 => 0.3243, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.86% (8.0126 => 7.5428, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/hash: -5.86% (0.4524 => 0.4259, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: -5.85% (17.1032 => 16.1030, std.dev.: 0.0196) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.84% (2.1713 => 2.0445, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.84% (0.4916 => 0.4629, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: -5.84% (0.4248 => 0.4000, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.84% (0.3837 => 0.3613, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -5.84% (0.3255 => 0.3065, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.84% (0.2999 => 0.2824, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.82% (0.3057 => 0.2879, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.81% (0.3323 => 0.3130, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: -5.80% (0.3481 => 0.3279, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -5.80% (2.4021 => 2.2628, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: -5.79% (0.2989 => 0.2816, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -5.78% (0.3026 => 0.2851, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (0.7021 => 0.6615, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/fibo: -5.78% (0.2871 => 0.2705, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: -5.78% (1.3864 => 1.3063, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: -5.76% (0.3194 => 0.3010, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/random: -5.75% (0.2939 => 0.2770, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.75% (0.5863 => 0.5526, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.74% (0.3016 => 0.2843, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.72% (0.9557 => 0.9010, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: -5.72% (0.2849 => 0.2686, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -5.72% (0.3621 => 0.3414, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.72% (1.2210 => 1.1512, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.70% (0.8521 => 0.8035, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -5.70% (3.5154 => 3.3149, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.70% (0.5999 => 0.5657, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.69% (5.4682 => 5.1569, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: -5.69% (0.3059 => 0.2885, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.69% (0.5591 => 0.5273, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.69% (0.5329 => 0.5026, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.68% (0.2903 => 0.2738, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.67% (0.5168 => 0.4875, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -5.66% (2.1401 => 2.0189, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.66% (0.4083 => 0.3852, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash2: -5.66% (0.4861 => 0.4586, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.65% (2.2587 => 2.1310, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: -5.64% (0.3867 => 0.3649, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.62% (0.4427 => 0.4178, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.60% (0.4321 => 0.4079, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.59% (0.5581 => 0.5269, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.58% (0.6260 => 0.5911, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.56% (0.2933 => 0.2770, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.55% (0.6230 => 0.5884, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.54% (0.6676 => 0.6306, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.54% (0.3252 => 0.3072, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.53% (0.7198 => 0.6800, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.53% (0.6189 => 0.5847, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.52% (1.2221 => 1.1546, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.52% (0.5925 => 0.5598, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/bigfib: -5.51% (0.6750 => 0.6378, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.51% (0.6297 => 0.5950, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.51% (0.6194 => 0.5853, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: -5.50% (0.3271 => 0.3091, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.50% (0.5805 => 0.5486, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.49% (0.6681 => 0.6314, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -5.49% (0.3205 => 0.3029, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -5.49% (34.0927 => 32.2211, std.dev.: 0.0242) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.48% (0.5857 => 0.5536, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.47% (0.5849 => 0.5529, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: -5.46% (0.3788 => 0.3581, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.46% (0.7524 => 0.7113, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -5.46% (18.2933 => 17.2944, std.dev.: 0.0113) SingleSource/UnitTests/ObjC++/property-reference: -5.45% (0.7779 => 0.7355, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.44% (0.3491 => 0.3301, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.42% (0.5569 => 0.5267, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.41% (0.5456 => 0.5161, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.41% (0.6660 => 0.6300, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.40% (0.4813 => 0.4553, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.40% (0.6667 => 0.6307, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.40% (0.5575 => 0.5274, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -5.39% (15.2527 => 14.4301, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.38% (0.7339 => 0.6944, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.38% (0.6304 => 0.5965, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.37% (0.6440 => 0.6094, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.36% (0.5802 => 0.5491, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.36% (0.5859 => 0.5545, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.35% (0.5941 => 0.5623, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.35% (0.2001 => 0.1894, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.34% (0.6052 => 0.5729, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.32% (0.2385 => 0.2258, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -5.32% (0.7982 => 0.7557, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/ReedSolomon: -5.32% (0.1879 => 0.1779, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.32% (0.6446 => 0.6103, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.30% (0.6033 => 0.5713, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.29% (0.6395 => 0.6057, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.27% (0.2106 => 0.1995, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.26% (0.5567 => 0.5274, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.26% (0.5570 => 0.5277, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.25% (0.6395 => 0.6059, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.24% (0.5705 => 0.5406, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -5.17% (0.6347 => 0.6019, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -5.12% (0.3025 => 0.2870, std.dev.: 0.0026) MultiSource/Applications/spiff/spiff: -5.07% (0.8418 => 0.7991, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: -5.05% (0.6441 => 0.6116, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -5.04% (5.0226 => 4.7697, std.dev.: 0.0038) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.00% (0.3319 => 0.3153, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.98% (0.5688 => 0.5405, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.83% (0.9077 => 0.8639, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: -4.54% (1.5610 => 1.4901, std.dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: -2.33% (20.7746 => 20.2899, std.dev.: 0.0148) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7540, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1729, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7067, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.57% (2.2633 => 2.1826, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.25% (1.0557 => 1.0214, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.69% (6.5735 => 6.4626, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.51% (79.7170 => 78.5122, std.dev.: 0.4648) Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 05:41:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 07:41:43 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121109134143.89FC12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5709?compare_to=5704&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5709, Order: 167609, Start Time: 2012-11-09 10:26:21, End Time: 2012-11-09 13:41:55 To: 5704, Order: 167603, Start Time: 2012-11-09 06:22:33, End Time: 2012-11-09 09:38:25 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (171 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1038 (720 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hexxagon/hexxagon: 1.20% (1.1346 => 1.1482, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 1.19% (1.1224 => 1.1358, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.12% (2.3624 => 2.3888, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.84% (0.3701 => 0.3843, std.dev.: 0.0035) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.48% (0.0625 => 0.0878, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.89% (0.1063 => 0.1402, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.70% (0.2969 => 0.3732, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.23% (0.1106 => 0.1385, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.90% (0.4253 => 0.5312, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.23% (0.0714 => 0.0887, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 24.20% (1.5932 => 1.9788, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.02% (0.4139 => 0.5133, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.31% (0.5900 => 0.7275, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.23% (0.4994 => 0.6154, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.77% (0.0584 => 0.0717, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.74% (0.5000 => 0.6137, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.74% (0.0475 => 0.0583, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.67% (0.0547 => 0.0671, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.07% (0.0897 => 0.1095, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 21.73% (0.0948 => 0.1154, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 21.37% (0.0599 => 0.0727) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.16% (0.1021 => 0.1237, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.11% (0.1620 => 0.1962, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.60% (0.1107 => 0.1335, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.88% (0.3903 => 0.4679, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.78% (0.0541 => 0.0648, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.75% (0.0633 => 0.0758, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.69% (0.0584 => 0.0699, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.67% (0.1103 => 0.1320, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.47% (0.0642 => 0.0767, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.44% (0.1003 => 0.1198, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.39% (0.1604 => 0.1915, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.37% (0.1549 => 0.1849, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 19.24% (0.0821 => 0.0979, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 19.21% (0.0604 => 0.0720, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 19.09% (0.1619 => 0.1928, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 19.01% (0.0605 => 0.0720, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.86% (0.0822 => 0.0977, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 18.56% (0.0808 => 0.0958, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.54% (0.1462 => 0.1733, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 18.16% (0.0947 => 0.1119, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.07% (0.3890 => 0.4593, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.06% (0.2736 => 0.3230, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 17.80% (0.5826 => 0.6863, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.68% (0.2014 => 0.2370, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 17.65% (0.1218 => 0.1433) SingleSource/UnitTests/ObjC++/property-reference-object: 17.51% (0.5889 => 0.6920, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.48% (0.1968 => 0.2312, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.33% (1.3152 => 1.5431, std.dev.: 0.0038) MultiSource/Applications/spiff/spiff: 17.25% (0.4029 => 0.4724, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: 17.13% (0.9697 => 1.1358, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 17.05% (0.0698 => 0.0817, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.00% (0.1088 => 0.1273, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 16.94% (0.1505 => 0.1760, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.94% (0.2875 => 0.3362, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.92% (0.2866 => 0.3351, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: 16.86% (1.8794 => 2.1963, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 16.62% (0.5546 => 0.6468, std.dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 16.44% (0.3004 => 0.3498, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.36% (0.4658 => 0.5420, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.29% (0.2738 => 0.3184, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.27% (3.5627 => 4.1424, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/fibo: 16.22% (0.2725 => 0.3167, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 16.22% (0.2750 => 0.3196, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.16% (0.2729 => 0.3170, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 16.14% (0.2714 => 0.3152, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.09% (1.6211 => 1.8819, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.00% (0.5026 => 0.5830, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/matrix: 15.90% (0.2780 => 0.3222, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 15.87% (0.9909 => 1.1482, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.87% (0.3271 => 0.3790, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.86% (0.1160 => 0.1344, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 15.80% (0.2803 => 0.3246, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 15.78% (0.2813 => 0.3257, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 15.76% (0.2823 => 0.3268, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 15.73% (1.0781 => 1.2477, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/wc: 15.73% (0.3096 => 0.3583, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.71% (0.4361 => 0.5046, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 15.69% (0.2811 => 0.3252, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.69% (0.2792 => 0.3230, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.56% (0.2911 => 0.3364, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.55% (2.0673 => 2.3888, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 15.48% (0.1421 => 0.1641, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.46% (0.3195 => 0.3689, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 15.40% (0.3267 => 0.3770, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 15.38% (0.7171 => 0.8274, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.36% (4.4195 => 5.0985, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary: 15.19% (0.3258 => 0.3753, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.19% (0.3930 => 0.4527, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: 15.19% (0.1284 => 0.1479, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 15.16% (0.3317 => 0.3820, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 15.08% (4.2109 => 4.8459, std.dev.: 0.0113) MultiSource/Benchmarks/Bullet/bullet: 15.03% (23.5202 => 27.0554, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.99% (0.3362 => 0.3866, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.77% (0.1090 => 0.1251, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 14.77% (0.2566 => 0.2945, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.61% (0.3060 => 0.3507, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.57% (1.9694 => 2.2564, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.56% (1.9966 => 2.2873, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.55% (2.7292 => 3.1264, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/lists: 14.55% (0.3348 => 0.3835, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 14.45% (0.4146 => 0.4745, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.44% (0.3282 => 0.3756, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.44% (0.3124 => 0.3575, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 14.41% (0.3678 => 0.4208, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.40% (0.3625 => 0.4147, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 14.07% (0.2075 => 0.2367, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.07% (0.3845 => 0.4386, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 14.06% (0.3726 => 0.4250, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.93% (0.3690 => 0.4204, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 13.86% (0.3477 => 0.3959, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 13.69% (0.4251 => 0.4833, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 13.65% (1.4269 => 1.6217, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.56% (0.3981 => 0.4521, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.56% (0.3488 => 0.3961, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 13.47% (0.3496 => 0.3967, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.33% (0.3465 => 0.3927, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.32% (0.3446 => 0.3905, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.29% (0.3460 => 0.3920, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 13.23% (0.7875 => 0.8917, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/synchronized: 13.20% (0.3469 => 0.3927, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.13% (0.3442 => 0.3894, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.96% (0.3643 => 0.4115, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 12.95% (0.5012 => 0.5661, std.dev.: 0.0119) SingleSource/UnitTests/ObjC/property: 12.93% (0.3650 => 0.4122, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 12.90% (2.1653 => 2.4447, std.dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 12.78% (0.2691 => 0.3035, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.73% (0.3724 => 0.4198, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 12.70% (4.6177 => 5.2041, std.dev.: 0.0071) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.21% (0.2040 => 0.2289, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 12.11% (2.1013 => 2.3558, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.58% (0.6435 => 0.7180, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11.46% (5.5417 => 6.1767, std.dev.: 0.0067) MultiSource/Applications/lambda-0_1_3/lambda: 10.83% (0.3498 => 0.3877, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.70% (0.1383 => 0.1531, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.70% (0.1028 => 0.1138, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.60% (0.2737 => 0.3027, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.49% (0.2068 => 0.2285, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 10.25% (0.4847 => 0.5344, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.18% (0.3084 => 0.3398, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.07% (0.6634 => 0.7302, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 9.71% (0.3336 => 0.3660, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 9.49% (2.0346 => 2.2276, std.dev.: 0.0066) MultiSource/Applications/lemon/lemon: 9.45% (0.2391 => 0.2617, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.32% (0.2103 => 0.2299, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.36% (4.6926 => 5.0850, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.16% (11.6398 => 12.5896, std.dev.: 0.0150) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.15% (0.5361 => 0.5798, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.77% (0.5584 => 0.6018, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.69% (0.7426 => 0.7997, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 6.25% (11.9555 => 12.7029, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.11% (0.3792 => 0.3948, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 9.49% (0.2802 => 0.3068, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6094, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 5.61% (0.2122 => 0.2241, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6757, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1715, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-2: 4.71% (1.8057 => 1.8908, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: 4.11% (14.0481 => 14.6254, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.06% (0.3693 => 0.3843, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1981, std.dev.: 0.0053) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.73% (3.1722 => 3.2270, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3000, std.dev.: 0.0075) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2883, std.dev.: 0.0019) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1051, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5897, std.dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.76% (25.4195 => 16.5828, std.dev.: 0.0119) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9761, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7983, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: -6.62% (0.2402 => 0.2243, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.57% (11.2080 => 10.8081, std.dev.: 0.0119) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.05% (0.6293 => 0.6101, std.dev.: 0.0053) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7726, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5191, std.dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: -2.92% (17.2379 => 16.7350, std.dev.: 0.0754) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8700, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5765, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4956, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1818, std.dev.: 0.0952) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0424, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 06:49:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 08:49:14 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121109144915.0042D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5710?compare_to=5707&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5710, Order: 167612, Start Time: 2012-11-09 13:22:11, End Time: 2012-11-09 14:49:26 To: 5707, Order: 167609, Start Time: 2012-11-09 09:56:55, End Time: 2012-11-09 11:23:17 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 9 (103 on baseline) Performance Improvements: 3 (25 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 979 (846 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout-C++/fibo: 6.41% (0.1872 => 0.1992, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 3.68% (0.2798 => 0.2901, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.60% (0.6388 => 0.6490, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.36% (1.1990 => 1.2153, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/SPASS/SPASS: 3.82% (8.4119 => 8.7330, std.dev.: 0.0365) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.52% (14.1613 => 14.6600, std.dev.: 0.1322) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.51% (4.3452 => 4.4542, std.dev.: 0.0417) SingleSource/Benchmarks/Misc/pi: 1.35% (2.4781 => 2.5116, std.dev.: 0.0059) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.31% (1.2712 => 1.2879, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -8.36% (4.0514 => 3.7129, std.dev.: 0.1186) MultiSource/Benchmarks/Ptrdist/ft/ft: -2.73% (0.8898 => 0.8655, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.13% (2.9406 => 2.9075, std.dev.: 0.0061) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.34% (16.7194 => 16.7757, std.dev.: 0.0396) MultiSource/Applications/obsequi/Obsequi: -0.93% (1.0696 => 1.0596, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.59% (21.8711 => 21.7417, std.dev.: 0.1292) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.36% (0.3640 => 0.3653, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 1.93% (0.6053 => 0.6170, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.39% (0.3312 => 0.3358, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 0.60% (0.1988 => 0.2000, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -10.14% (0.0217 => 0.0195, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.24% (0.0424 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -18.79% (0.0330 => 0.0268, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.29% (0.0311 => 0.0307, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.03% (0.0345 => 0.0352, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/casts: 2.54% (0.0197 => 0.0202, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 19.64% (0.0168 => 0.0201, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.28% (0.1451 => 0.1455, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 8.04% (1.1252 => 1.2157, std.dev.: 0.0433) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 5.65% (0.1397 => 0.1476, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.91% (0.4375 => 0.4204, std.dev.: 0.0166) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.45% (0.1389 => 0.1423, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 19.41% (0.0546 => 0.0652, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 43.01% (0.0186 => 0.0266, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.86% (0.0584 => 0.0589, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.33% (1.1971 => 1.1931, std.dev.: 0.0377) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 58.33% (0.0012 => 0.0019, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.01% (0.0588 => 0.0641, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.30% (0.0227 => 0.0264, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.57% (0.7875 => 0.7830, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -34.09% (0.0088 => 0.0058, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2299.91% (0.6332 => 15.1962, std.dev.: 0.2140) MultiSource/Benchmarks/McCat/08-main/main: 48.44% (0.1831 => 0.2718, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.26% (0.1559 => 0.1477, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1515.10% (0.3344 => 5.4009, std.dev.: 0.0364) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.56% (0.2364 => 0.3252, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/mandel: -4.43% (0.0429 => 0.0410, std.dev.: 0.0020) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.89% (0.0224 => 0.0226, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4360, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0740, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4953, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3411, std.dev.: 0.0181) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1398, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4035, std.dev.: 0.0020) SingleSource/Regression/C/uint64_to_float: -23.76% (2.1832 => 1.6645, std.dev.: 0.0036) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.90% (0.0810 => 0.0955, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.75% (0.0773 => 0.0887, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.77% (0.0830 => 0.0936, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 11.15% (0.1112 => 0.1236, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/health/health: 8.31% (0.1347 => 0.1459, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.18% (0.7473 => 0.8084, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.99% (0.6010 => 0.6490, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.88% (0.8321 => 0.8977, std.dev.: 0.0254) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.84% (0.2180 => 0.2351, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.79% (0.1425 => 0.1536, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/fibo: 7.10% (0.1860 => 0.1992, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.95% (0.3137 => 0.3355, std.dev.: 0.0026) MultiSource/Applications/viterbi/viterbi: 6.79% (0.1577 => 0.1684, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.77% (0.1905 => 0.2034, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.30% (0.2998 => 0.3187, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.27% (0.8148 => 0.8659, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.88% (0.4847 => 0.5132, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.76% (0.2519 => 0.2664, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.73% (0.6287 => 0.6647, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.31% (0.3295 => 0.3470, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/sieve: 5.30% (0.2755 => 0.2901, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.25% (1.1685 => 1.2299, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.09% (0.3003 => 0.3156, std.dev.: 0.0030) MultiSource/Applications/spiff/spiff: 4.96% (0.7950 => 0.8344, std.dev.: 0.0108) MultiSource/Applications/sgefa/sgefa: 4.83% (0.2999 => 0.3144, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.71% (1.1606 => 1.2153, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.17% (1.3279 => 1.3833, std.dev.: 0.0054) MultiSource/Applications/Burg/burg: 4.16% (1.2222 => 1.2731, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.84% (1.6386 => 1.7016, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 3.70% (4.1305 => 4.2833, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.61% (8.6476 => 8.9600, std.dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.52% (0.5961 => 0.6171, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.44% (0.4127 => 0.4269, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.42% (1.4479 => 1.4974, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.42% (6.6074 => 6.8331, std.dev.: 0.0211) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.14% (4.1763 => 4.3073, std.dev.: 0.0309) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.13% (0.6227 => 0.6422, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 3.13% (1.9948 => 2.0572, std.dev.: 0.0063) MultiSource/Applications/lua/lua: 3.03% (3.8189 => 3.9347, std.dev.: 0.0296) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.01% (0.9435 => 0.9719, std.dev.: 0.0096) MultiSource/Benchmarks/nbench/nbench: 2.98% (1.1271 => 1.1607, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.92% (0.5817 => 0.5987, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.86% (0.7966 => 0.8194, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.57% (0.8331 => 0.8545, std.dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: 2.56% (1.2568 => 1.2890, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.49% (4.5702 => 4.6842, std.dev.: 0.0141) MultiSource/Applications/SPASS/SPASS: 2.41% (14.2605 => 14.6035, std.dev.: 0.0403) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.40% (0.8204 => 0.8401, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.34% (0.9908 => 1.0140, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.31% (0.9074 => 0.9284, std.dev.: 0.0049) MultiSource/Applications/d/make_dparser: 2.31% (3.2366 => 3.3115, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.28% (0.8317 => 0.8507, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.25% (0.8518 => 0.8710, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.25% (13.1811 => 13.4782, std.dev.: 0.0651) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.24% (0.8069 => 0.8250, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.23% (4.4880 => 4.5879, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.22% (0.8261 => 0.8444, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.21% (4.4873 => 4.5863, std.dev.: 0.0272) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.20% (0.8420 => 0.8605, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: 2.13% (31.8598 => 32.5395, std.dev.: 0.1067) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.11% (0.8855 => 0.9042, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 2.09% (0.7557 => 0.7715, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 2.02% (0.6834 => 0.6972, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.88% (0.8066 => 0.8218, std.dev.: 0.0059) MultiSource/Applications/JM/lencod/lencod: 1.87% (15.3280 => 15.6148, std.dev.: 0.0926) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.79% (0.8338 => 0.8487, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.76% (1.2602 => 1.2824, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 1.41% (8.6247 => 8.7463, std.dev.: 0.0317) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 94.97% (0.0199 => 0.0388, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/pi: 59.01% (1.5795 => 2.5116, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.78% (0.7597 => 0.8872, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.46% (2.9753 => 3.4650, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.53% (2.7995 => 3.2064, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.61% (5.0261 => 5.6096, std.dev.: 0.0336) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.62% (6.3772 => 6.9904, std.dev.: 0.1513) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.22% (1.1857 => 1.2832, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/queens: 7.64% (1.7056 => 1.8359, std.dev.: 0.0378) SingleSource/Benchmarks/Misc/richards_benchmark: 7.01% (1.3037 => 1.3951, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.76% (4.7794 => 5.1027, std.dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 6.65% (3.1873 => 3.3992, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.08% (4.9686 => 5.2707, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.73% (4.5327 => 4.7923, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.63% (3.3761 => 3.5323, std.dev.: 0.0431) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.50% (6.2275 => 6.5077, std.dev.: 0.0828) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.39% (1.2337 => 1.2879, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.23% (4.9453 => 5.1544, std.dev.: 0.0266) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.10% (4.9469 => 5.1495, std.dev.: 0.0711) MultiSource/Applications/hexxagon/hexxagon: 3.91% (14.0064 => 14.5546, std.dev.: 0.0992) MultiSource/Applications/SPASS/SPASS: 3.56% (8.4326 => 8.7330, std.dev.: 0.0365) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.97% (11.5690 => 11.9128, std.dev.: 0.0134) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.87% (0.3587 => 0.3690, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.77% (8.2783 => 8.5080, std.dev.: 0.0146) MultiSource/Applications/siod/siod: 2.76% (3.6643 => 3.7654, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.62% (4.8362 => 4.9627, std.dev.: 0.0137) MultiSource/Applications/lambda-0_1_3/lambda: 2.62% (7.4933 => 7.6893, std.dev.: 0.0467) SingleSource/Benchmarks/Shootout/lists: 2.53% (7.3375 => 7.5231, std.dev.: 0.0299) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.51% (2.4647 => 2.5018, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.31% (3.5679 => 3.6148, std.dev.: 0.0048) MultiSource/Benchmarks/llubenchmark/llu: 1.29% (1.9967 => 2.0224, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/neural/neural: 1.27% (1.0841 => 1.0979, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 1.25% (8.5322 => 8.6389, std.dev.: 0.0154) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.10% (4.4340 => 4.4828, std.dev.: 0.0152) MultiSource/Benchmarks/Olden/bh/bh: 1.06% (2.3560 => 2.3809, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.72% (5.4641 => 4.3317, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.25% (7.2130 => 6.2575, std.dev.: 0.3185) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.83% (1.0512 => 0.9374, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.36% (1.1216 => 1.0054, std.dev.: 0.0226) MultiSource/Benchmarks/mafft/pairlocalalign: -8.53% (63.1822 => 57.7956, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -7.02% (4.7482 => 4.4149, std.dev.: 0.0328) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.67% (0.3269 => 0.3051, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.10% (5.4972 => 5.1621, std.dev.: 0.0659) MultiSource/Benchmarks/nbench/nbench: -5.90% (21.9654 => 20.6695, std.dev.: 0.3125) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.46% (3.7148 => 3.5119, std.dev.: 0.0292) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.99% (5.1557 => 4.8983, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.32% (4.7449 => 4.5399, std.dev.: 0.0162) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.71% (2.8773 => 2.7705, std.dev.: 0.0339) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.63% (6.0224 => 5.8040, std.dev.: 0.0061) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.90% (28.5821 => 27.7541, std.dev.: 0.0409) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.86% (0.5807 => 0.5641, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: -2.45% (0.6910 => 0.6741, std.dev.: 0.0025) MultiSource/Applications/aha/aha: -2.21% (3.3398 => 3.2661, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: -2.21% (3.4237 => 3.3482, std.dev.: 0.0197) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.09% (2.3487 => 2.2995, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (11.5316 => 11.2981, std.dev.: 0.0207) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.67% (3.2169 => 3.1632, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.54% (4.9994 => 4.9223, std.dev.: 0.0284) MultiSource/Benchmarks/Ptrdist/ft/ft: -1.52% (0.8789 => 0.8655, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.17% (5.6343 => 5.5681, std.dev.: 0.0071) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.00% (16.4461 => 16.7757, std.dev.: 0.0396) MultiSource/Applications/obsequi/Obsequi: 3.25% (1.0262 => 1.0596, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6861.80% (0.3123 => 21.7417, std.dev.: 0.1292) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.32% (0.2463 => 0.3653, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 2.66% (0.6010 => 0.6170, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.82% (0.3266 => 0.3358, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 1.57% (0.1969 => 0.2000, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 58.54% (0.0123 => 0.0195, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 5.51% (0.0254 => 0.0268, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.66% (0.0302 => 0.0307, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -8.33% (0.0384 => 0.0352, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 11.67% (0.0180 => 0.0201, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.18% (0.1438 => 0.1455, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 7.31% (1.1329 => 1.2157, std.dev.: 0.0433) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.96% (0.1462 => 0.1476, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.96% (0.4164 => 0.4204, std.dev.: 0.0166) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.94% (0.1369 => 0.1423, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.72% (0.0641 => 0.0652, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 36.41% (0.0195 => 0.0266, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.90% (0.0578 => 0.0589, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.32% (1.1437 => 1.1931, std.dev.: 0.0377) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1800.00% (0.0001 => 0.0019, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.23% (0.0627 => 0.0641, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 46.67% (0.0180 => 0.0264, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.33% (0.8017 => 0.7830, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -6.45% (0.0062 => 0.0058, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 06:52:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 08:52:56 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121109145256.4E49A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5711?compare_to=5708&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5711, Order: 167612, Start Time: 2012-11-09 13:28:03, End Time: 2012-11-09 14:53:08 To: 5708, Order: 167609, Start Time: 2012-11-09 10:17:34, End Time: 2012-11-09 11:42:44 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (181 on baseline) Unchanged Tests: 1041 (857 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.90% (0.7355 => 0.7495, std.dev.: 0.0018) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1011, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/salsa20: 2.48% (7.4937 => 7.6794, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/hash2: 2.28% (3.1932 => 3.2660, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.15% (0.1431 => 0.1300, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -8.01% (2.4924 => 2.2927, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.98% (0.3821 => 0.3516, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.07% (0.3142 => 0.2920, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -6.97% (0.3357 => 0.3123, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: -6.95% (0.3812 => 0.3547, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.94% (0.3831 => 0.3565, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.93% (0.3880 => 0.3611, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.93% (0.9542 => 0.8881, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.86% (0.3891 => 0.3624, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -6.85% (0.2160 => 0.2012, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.84% (0.2428 => 0.2262, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.83% (0.3848 => 0.3585, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.78% (0.3896 => 0.3632, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.77% (0.4033 => 0.3760, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.75% (0.4176 => 0.3894, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.64% (0.3884 => 0.3626, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.61% (3.5339 => 3.3002, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.59% (0.3658 => 0.3417, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: -6.57% (0.4199 => 0.3923, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.56% (22.4056 => 20.9365, std.dev.: 0.0247) MultiSource/Applications/JM/lencod/lencod: -6.52% (16.1920 => 15.1356, std.dev.: 0.0093) SingleSource/UnitTests/ObjC/parameter-passing: -6.52% (0.4280 => 0.4001, std.dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: -6.52% (9.2283 => 8.6269, std.dev.: 0.0105) MultiSource/Applications/JM/ldecod/ldecod: -6.49% (7.0961 => 6.6359, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.46% (0.6484 => 0.6065, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.43% (0.9852 => 0.9219, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.41% (1.0544 => 0.9868, std.dev.: 0.0056) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.35% (0.1796 => 0.1682, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.33% (0.2355 => 0.2206, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: -6.30% (1.2515 => 1.1727, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.29% (0.1716 => 0.1608, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.28% (1.3722 => 1.2860, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: -6.28% (0.1879 => 0.1761, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.23% (1.2784 => 1.1987, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: -6.21% (0.2659 => 0.2494, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -6.16% (4.3330 => 4.0659, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.15% (4.5069 => 4.2297, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.15% (4.0323 => 3.7843, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/football/football: -6.11% (0.9179 => 0.8618, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.08% (6.7716 => 6.3598, std.dev.: 0.0060) SingleSource/Benchmarks/McGill/chomp: -6.08% (0.1761 => 0.1654, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.04% (4.8161 => 4.5251, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.99% (0.6293 => 0.5916, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.97% (0.3483 => 0.3275, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.95% (4.8802 => 4.5899, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/05-eks/eks: -5.94% (0.4515 => 0.4247, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: -5.92% (1.1450 => 1.0772, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.91% (1.4642 => 1.3776, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.90% (1.6474 => 1.5502, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.87% (0.5863 => 0.5519, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.86% (0.2695 => 0.2537, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.86% (14.2083 => 13.3754, std.dev.: 0.0166) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.85% (0.2548 => 0.2399, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -5.84% (0.3406 => 0.3207, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: -5.84% (15.5079 => 14.6022, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.83% (0.7524 => 0.7085, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.82% (0.5857 => 0.5516, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.81% (1.6364 => 1.5414, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.78% (0.5591 => 0.5268, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -5.77% (4.0594 => 3.8252, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.76% (1.2300 => 1.1592, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.73% (0.5478 => 0.5164, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.73% (0.8521 => 0.8033, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: -5.72% (1.1530 => 1.0870, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.71% (0.2278 => 0.2148, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.70% (0.6230 => 0.5875, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.69% (0.6736 => 0.6353, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.67% (0.7919 => 0.7470, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.66% (0.5849 => 0.5518, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -5.66% (17.1032 => 16.1360, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.65% (0.5575 => 0.5260, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.64% (0.5925 => 0.5591, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.63% (0.6052 => 0.5711, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.63% (0.6660 => 0.6285, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.62% (0.6297 => 0.5943, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.62% (0.2385 => 0.2251, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: -5.62% (0.4861 => 0.4588, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.60% (0.2999 => 0.2831, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.60% (0.5805 => 0.5480, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.59% (0.4916 => 0.4641, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.59% (0.6189 => 0.5843, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.59% (0.4151 => 0.3919, std.dev.: 0.0020) MultiSource/Applications/siod/siod: -5.59% (2.4021 => 2.2679, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.58% (0.5802 => 0.5478, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.57% (0.5329 => 0.5032, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.57% (0.7021 => 0.6630, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.57% (1.3864 => 1.3092, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.57% (0.6304 => 0.5953, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: -5.56% (0.7447 => 0.7033, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.55% (0.6194 => 0.5850, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.55% (5.4682 => 5.1648, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.55% (0.7339 => 0.6932, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.54% (0.5581 => 0.5272, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.53% (2.2587 => 2.1337, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.53% (0.5567 => 0.5259, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.53% (0.5859 => 0.5535, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -5.50% (3.5154 => 3.3219, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.49% (0.5570 => 0.5264, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.49% (8.0126 => 7.5726, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.49% (0.6667 => 0.6301, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.48% (0.6260 => 0.5917, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.48% (0.6446 => 0.6093, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.46% (0.5569 => 0.5265, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.46% (0.6395 => 0.6046, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.42% (0.5168 => 0.4888, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.40% (0.5705 => 0.5397, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -5.39% (0.2985 => 0.2824, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.39% (0.6440 => 0.6093, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.38% (0.5999 => 0.5676, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.38% (0.6395 => 0.6051, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.38% (0.3849 => 0.3642, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.37% (0.9557 => 0.9044, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.35% (0.5456 => 0.5164, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.35% (1.2210 => 1.1557, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.35% (0.6676 => 0.6319, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.31% (0.4083 => 0.3866, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -5.31% (34.0927 => 32.2839, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/hash: -5.28% (0.4524 => 0.4285, std.dev.: 0.0084) MultiSource/Applications/treecc/treecc: -5.28% (2.1401 => 2.0271, std.dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: -5.28% (1.3148 => 1.2454, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.25% (1.2221 => 1.1579, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.24% (0.6033 => 0.5717, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: -5.23% (0.3194 => 0.3027, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.22% (0.2106 => 0.1996, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -5.22% (0.3255 => 0.3085, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.22% (0.5688 => 0.5391, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -5.21% (0.6750 => 0.6398, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/moments: -5.20% (0.4248 => 0.4027) SingleSource/Benchmarks/Shootout-C++/methcall: -5.19% (0.3025 => 0.2868, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -5.19% (0.3026 => 0.2869, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.19% (0.3837 => 0.3638, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -5.19% (0.2989 => 0.2834, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -5.17% (0.3481 => 0.3301, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.17% (0.3057 => 0.2899, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -5.17% (0.3271 => 0.3102, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: -5.17% (0.3446 => 0.3268, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.16% (0.3931 => 0.3728, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: -5.15% (18.2933 => 17.3505, std.dev.: 0.0175) MultiSource/Applications/ClamAV/clamscan: -5.14% (15.2527 => 14.4684, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.13% (2.1713 => 2.0599, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: -5.13% (0.3394 => 0.3220, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.13% (0.7198 => 0.6829, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.12% (0.6681 => 0.6339, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -5.11% (0.3581 => 0.3398, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.10% (0.3491 => 0.3313, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.10% (0.2001 => 0.1899, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -5.08% (0.3621 => 0.3437, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.07% (0.3016 => 0.2863, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -5.07% (0.3867 => 0.3671, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.05% (0.2871 => 0.2726, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.05% (0.4321 => 0.4103, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.04% (0.3252 => 0.3088, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: -5.03% (0.3059 => 0.2905, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: -5.02% (0.2849 => 0.2706, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.01% (0.4427 => 0.4205, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: -4.97% (0.2939 => 0.2793, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -4.95% (0.7982 => 0.7587, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.94% (0.2933 => 0.2788, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.94% (0.3319 => 0.3155, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.93% (0.2903 => 0.2760, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.90% (0.3205 => 0.3048, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.83% (5.0226 => 4.7798, std.dev.: 0.0066) MultiSource/Applications/spiff/spiff: -4.82% (0.8418 => 0.8012, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.78% (0.3323 => 0.3164, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.65% (0.4813 => 0.4589, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.21% (0.9077 => 0.8695, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: -4.19% (0.6441 => 0.6171, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: -4.10% (0.6347 => 0.6087, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: -3.70% (1.5610 => 1.5033, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: -3.65% (0.7779 => 0.7495, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -2.01% (20.7746 => 20.3564, std.dev.: 0.0213) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7524, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/richards_benchmark: -8.63% (1.2842 => 1.1734, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.92% (1.7753 => 1.7057, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.76% (2.2633 => 2.1783, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.25% (1.3096 => 1.2670, std.dev.: 0.0119) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.72% (6.5735 => 6.4604, std.dev.: 0.0057) Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 08:32:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 10:32:39 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121109163239.8A2C52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5712?compare_to=5710&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5712, Order: 167615, Start Time: 2012-11-09 15:06:16, End Time: 2012-11-09 16:32:48 To: 5710, Order: 167612, Start Time: 2012-11-09 13:22:11, End Time: 2012-11-09 14:49:26 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 14 (102 on baseline) Performance Improvements: 9 (28 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 968 (844 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.45% (0.9284 => 0.9511, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.23% (0.9821 => 1.0040, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.21% (0.9719 => 0.9934, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.96% (0.8528 => 0.8695, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.62% (0.8356 => 0.8491, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.57% (0.8835 => 0.8974, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.56% (0.8218 => 0.8346, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.29% (0.8710 => 0.8822, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.24% (0.9080 => 0.9193, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.16% (0.8896 => 0.8999, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 11.92% (3.7129 => 4.1556, std.dev.: 0.0596) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.50% (58.5263 => 59.9895, std.dev.: 0.3030) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 2.22% (1.8408 => 1.8817, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: 1.66% (15.6374 => 15.8971, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/fibo: -6.02% (0.1992 => 0.1872, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: -3.83% (0.2901 => 0.2790, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -2.03% (1.3833 => 1.3552, std.dev.: 0.0070) MultiSource/Applications/lambda-0_1_3/lambda: -1.44% (0.7715 => 0.7604, std.dev.: 0.0015) MultiSource/Applications/lua/lua: -1.13% (3.9347 => 3.8904, std.dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -6.53% (3.2427 => 3.0308, std.dev.: 0.0439) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.69% (1.0478 => 1.0301, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/lists: -1.23% (16.9143 => 16.7064, std.dev.: 0.0806) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.3062 => 4.2608, std.dev.: 0.0161) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.87% (16.7757 => 16.6300, std.dev.: 0.0721) MultiSource/Applications/obsequi/Obsequi: -0.10% (1.0596 => 1.0585, std.dev.: 0.0056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.83% (21.7417 => 21.5607, std.dev.: 0.3715) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.74% (0.3653 => 0.3626, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: -2.66% (0.6170 => 0.6006, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: -1.67% (0.3358 => 0.3302, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: -0.60% (0.2000 => 0.1988, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 12.31% (0.0195 => 0.0219, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.47% (0.0425 => 0.0423, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 24.25% (0.0268 => 0.0333, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.28% (0.0307 => 0.0314, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 19.60% (0.0352 => 0.0421, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 0.50% (0.0202 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 9.45% (0.0201 => 0.0220, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1455 => 0.1456, std.dev.: 0.0079) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -7.57% (1.2157 => 1.1237, std.dev.: 0.0384) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.34% (0.1476 => 0.1481, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.16% (0.4204 => 0.4463, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.23% (0.1423 => 0.1377, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.59% (0.0652 => 0.0596, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.76% (0.0266 => 0.0276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.81% (0.0589 => 0.0543, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.09% (1.1931 => 1.1942, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 5.26% (0.0019 => 0.0020, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.16% (0.0641 => 0.0640, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.52% (0.0264 => 0.0268, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.48% (0.7830 => 0.7714, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -8.62% (0.0058 => 0.0053, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2294.01% (0.6332 => 15.1589, std.dev.: 0.2050) MultiSource/Benchmarks/McCat/08-main/main: 47.52% (0.1831 => 0.2701, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.03% (0.1559 => 0.1465, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1479.49% (0.3344 => 5.2818, std.dev.: 0.0716) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.77% (0.2364 => 0.3257, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: -0.93% (0.0429 => 0.0425, std.dev.: 0.0010) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.68% (0.0224 => 0.0230, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4360, std.dev.: 0.0173) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0696, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4858, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3391, std.dev.: 0.0254) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1439, std.dev.: 0.0481) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4079, std.dev.: 0.0014) SingleSource/Regression/C/uint64_to_float: -24.25% (2.1832 => 1.6537, std.dev.: 0.0035) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.70% (0.0810 => 0.0921, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: 13.49% (0.1112 => 0.1262, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.89% (0.6010 => 0.6484, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.43% (0.4847 => 0.5207, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.24% (0.2279 => 0.2444, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.93% (0.2180 => 0.2331, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.66% (0.7473 => 0.7971, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.47% (0.2133 => 0.2271, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.78% (0.1885 => 0.1994, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.43% (1.1606 => 1.2236, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.29% (0.9435 => 0.9934, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.82% (0.9074 => 0.9511, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 4.81% (0.8007 => 0.8392, std.dev.: 0.0106) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.73% (0.8148 => 0.8533, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.37% (0.7932 => 0.8279, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.28% (0.6287 => 0.6556, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 4.09% (0.8712 => 0.9068, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 4.03% (0.8805 => 0.9160, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 4.02% (0.8359 => 0.8695, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 4.02% (1.2222 => 1.2713, std.dev.: 0.0101) MultiSource/Applications/spiff/spiff: 3.87% (0.7950 => 0.8258, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.85% (0.5817 => 0.6041, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.84% (0.8177 => 0.8491, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.63% (0.9688 => 1.0040, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.57% (0.8518 => 0.8822, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.49% (0.3124 => 0.3233, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.47% (0.8066 => 0.8346, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 3.47% (0.8885 => 0.9193, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 3.40% (0.8069 => 0.8343, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.39% (0.8457 => 0.8744, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.27% (0.8317 => 0.8589, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.25% (0.8716 => 0.8999, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.19% (0.8697 => 0.8974, std.dev.: 0.0045) MultiSource/Applications/hbd/hbd: 3.10% (1.4269 => 1.4712, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.07% (0.8261 => 0.8515, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.03% (0.9908 => 1.0208, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/05-eks/eks: 3.02% (0.4397 => 0.4530, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.01% (0.9039 => 0.9311, std.dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: 2.88% (1.2568 => 1.2930, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.86% (0.8855 => 0.9108, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.84% (0.8086 => 0.8316, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.84% (0.4783 => 0.4919, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.82% (0.8048 => 0.8275, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.75% (1.2526 => 1.2870, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.71% (0.8927 => 0.9169, std.dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 2.69% (14.7684 => 15.1663, std.dev.: 0.1037) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.65% (0.8338 => 0.8559, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.61% (0.8316 => 0.8533, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.58% (0.8204 => 0.8416, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.52% (4.1763 => 4.2814, std.dev.: 0.0309) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.50% (0.8286 => 0.8493, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.47% (0.7966 => 0.8163, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.47% (0.8331 => 0.8537, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.45% (6.6074 => 6.7695, std.dev.: 0.0426) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.45% (0.8050 => 0.8247, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.18% (0.8656 => 0.8845, std.dev.: 0.0072) MultiSource/Benchmarks/PAQ8p/paq8p: 2.12% (2.3764 => 2.4267, std.dev.: 0.0176) MultiSource/Applications/SPASS/SPASS: 2.09% (14.2605 => 14.5588, std.dev.: 0.0847) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.06% (1.3279 => 1.3552, std.dev.: 0.0070) MultiSource/Applications/minisat/minisat: 1.93% (0.6834 => 0.6966, std.dev.: 0.0037) MultiSource/Applications/lua/lua: 1.87% (3.8189 => 3.8904, std.dev.: 0.0077) MultiSource/Applications/d/make_dparser: 1.63% (3.2366 => 3.2893, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/football/football: 1.60% (0.8768 => 0.8908, std.dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 1.53% (0.9810 => 0.9960, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.35% (0.8340 => 0.8453, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 97.99% (0.0199 => 0.0394, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/pi: 57.08% (1.5795 => 2.4810, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.47% (2.9753 => 3.4652, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.23% (0.7597 => 0.8830, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.47% (2.7995 => 3.2046, std.dev.: 0.0251) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.64% (5.0261 => 5.6112, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.49% (1.1857 => 1.2745, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/queens: 7.05% (1.7056 => 1.8258, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.61% (4.7794 => 5.0951, std.dev.: 0.0305) SingleSource/Benchmarks/Misc/richards_benchmark: 6.35% (1.3037 => 1.3865, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 6.33% (3.1873 => 3.3889, std.dev.: 0.0277) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.04% (3.9188 => 4.1556, std.dev.: 0.0596) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.95% (4.9686 => 5.2643, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.82% (4.5327 => 4.7965, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.71% (6.2275 => 6.5209, std.dev.: 0.0732) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.71% (3.3761 => 3.5351, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.38% (4.9453 => 5.1621, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.10% (4.9469 => 5.1497, std.dev.: 0.0526) MultiSource/Applications/hexxagon/hexxagon: 3.89% (14.0064 => 14.5507, std.dev.: 0.0055) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.67% (1.2337 => 1.2790, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.51% (0.3587 => 0.3713, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.74% (11.5690 => 11.8856, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.65% (4.8660 => 4.9949, std.dev.: 0.0067) MultiSource/Applications/lambda-0_1_3/lambda: 2.64% (7.4933 => 7.6913, std.dev.: 0.0089) MultiSource/Applications/siod/siod: 2.62% (3.6643 => 3.7602, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.57% (8.2783 => 8.4908, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout/lists: 2.20% (7.3375 => 7.4989, std.dev.: 0.0473) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.10% (4.8362 => 4.9377, std.dev.: 0.0257) MultiSource/Benchmarks/Bullet/bullet: 1.89% (7.1181 => 7.2526, std.dev.: 0.0475) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.50% (2.4647 => 2.5016, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/power/power: 1.33% (1.2061 => 1.2222, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/neural/neural: 1.31% (1.0841 => 1.0983, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 1.19% (8.5322 => 8.6339, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/whetstone: 1.17% (2.1224 => 2.1473, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.16% (3.5679 => 3.6094, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.07% (4.4340 => 4.4813, std.dev.: 0.0132) MultiSource/Benchmarks/BitBench/five11/five11: 1.07% (5.6030 => 5.6627, std.dev.: 0.0220) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.28% (5.4641 => 4.3014, std.dev.: 0.1579) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.79% (7.2130 => 6.1461, std.dev.: 0.1415) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.72% (1.0512 => 0.9385, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: -10.54% (1.1216 => 1.0034, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: -8.51% (63.1822 => 57.8074, std.dev.: 0.1080) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.86% (0.3269 => 0.3012, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.81% (4.7482 => 4.4250, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.87% (3.7148 => 3.4969, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.82% (5.4972 => 5.1775, std.dev.: 0.0280) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.99% (5.1557 => 4.8982, std.dev.: 0.0447) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.25% (2.8773 => 2.7550, std.dev.: 0.0304) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.90% (6.0224 => 5.7875, std.dev.: 0.0145) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.26% (2.4490 => 2.3691, std.dev.: 0.0287) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (28.5821 => 27.6743, std.dev.: 0.0880) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.13% (0.5807 => 0.5625, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -3.02% (0.6910 => 0.6701, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.82% (2.6356 => 2.5614, std.dev.: 0.0285) MultiSource/Benchmarks/Olden/bisort/bisort: -2.49% (0.6636 => 0.6471, std.dev.: 0.0063) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.36% (1.2822 => 1.2520, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/hash2: -2.31% (3.4237 => 3.3447, std.dev.: 0.0014) MultiSource/Applications/aha/aha: -2.07% (3.3398 => 3.2705, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.00% (11.5316 => 11.3008, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.94% (9.9065 => 9.7148, std.dev.: 0.0593) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.73% (3.2169 => 3.1612, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.66% (2.3487 => 2.3098, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.58% (4.9994 => 4.9205, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.19% (5.6343 => 5.5672, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/hash: -1.11% (4.3087 => 4.2608, std.dev.: 0.0161) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.12% (16.4461 => 16.6300, std.dev.: 0.0721) MultiSource/Applications/obsequi/Obsequi: 3.15% (1.0262 => 1.0585, std.dev.: 0.0056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6803.84% (0.3123 => 21.5607, std.dev.: 0.3715) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.22% (0.2463 => 0.3626, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: -0.07% (0.6010 => 0.6006, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.10% (0.3266 => 0.3302, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 0.96% (0.1969 => 0.1988, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.68% (0.0408 => 0.0423, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.64% (0.0384 => 0.0421, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 22.22% (0.0180 => 0.0220, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.25% (0.1438 => 0.1456, std.dev.: 0.0079) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.81% (1.1329 => 1.1237, std.dev.: 0.0384) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.30% (0.1462 => 0.1481, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 7.18% (0.4164 => 0.4463, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.58% (0.1369 => 0.1377, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.02% (0.0641 => 0.0596, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.54% (0.0195 => 0.0276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.06% (0.0578 => 0.0543, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.42% (1.1437 => 1.1942, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1900.00% (0.0001 => 0.0020, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.07% (0.0627 => 0.0640, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.89% (0.0180 => 0.0268, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.78% (0.8017 => 0.7714, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -14.52% (0.0062 => 0.0053, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 4.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 08:41:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 10:41:39 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121109164139.05DCE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5713?compare_to=5711&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5713, Order: 167615, Start Time: 2012-11-09 15:16:41, End Time: 2012-11-09 16:41:49 To: 5711, Order: 167612, Start Time: 2012-11-09 13:28:03, End Time: 2012-11-09 14:53:08 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 1 (185 on baseline) Unchanged Tests: 1040 (853 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.33% (1.2670 => 1.2839, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.39% (0.7495 => 0.7391, std.dev.: 0.0025) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1017, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/hash2: 2.25% (3.1932 => 3.2651, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/salsa20: 2.17% (7.4937 => 7.6566, std.dev.: 0.0145) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.15% (0.1431 => 0.1300, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -8.11% (2.4924 => 2.2902, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.03% (0.3821 => 0.3514, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -7.40% (0.3812 => 0.3530, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -7.35% (0.3880 => 0.3595, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -7.33% (0.3831 => 0.3550, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.30% (0.3891 => 0.3607, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.28% (0.9542 => 0.8847, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: -7.26% (0.3896 => 0.3613, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -7.24% (0.4033 => 0.3741, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -7.17% (0.3848 => 0.3572, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -7.06% (0.3357 => 0.3120, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/property: -7.05% (0.4199 => 0.3903, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.04% (0.2428 => 0.2257, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -7.04% (0.4176 => 0.3882, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.97% (0.3142 => 0.2923, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -6.96% (0.4280 => 0.3982, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.79% (0.6484 => 0.6044, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.77% (0.3884 => 0.3621, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/oourafft: -6.76% (0.2160 => 0.2014, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.75% (0.3658 => 0.3411, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.67% (3.5339 => 3.2982, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: -6.65% (16.1920 => 15.1156, std.dev.: 0.0051) MultiSource/Applications/JM/ldecod/ldecod: -6.60% (7.0961 => 6.6281, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.58% (1.0544 => 0.9850, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.55% (22.4056 => 20.9391, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.54% (0.2355 => 0.2201, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -6.53% (9.2283 => 8.6258, std.dev.: 0.0168) MultiSource/Applications/Burg/burg: -6.50% (1.2515 => 1.1701, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.50% (0.1584 => 0.1481, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.48% (4.0323 => 3.7709, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.47% (0.9852 => 0.9215, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.46% (0.1796 => 0.1680, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.44% (1.2784 => 1.1961, std.dev.: 0.0084) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.41% (6.7716 => 6.3377, std.dev.: 0.0096) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.40% (4.5069 => 4.2183, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.38% (1.3722 => 1.2847, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.37% (4.8161 => 4.5093, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/08-main/main: -6.36% (0.2659 => 0.2490, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -6.35% (4.3330 => 4.0578, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/ReedSolomon: -6.33% (0.1879 => 0.1760, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -6.30% (0.1761 => 0.1650, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.29% (0.1716 => 0.1608, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.25% (1.2300 => 1.1531, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.23% (0.1621 => 0.1520, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -6.23% (1.1530 => 1.0812, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/05-eks/eks: -6.20% (0.4515 => 0.4235, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.20% (1.4642 => 1.3734, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.18% (0.6293 => 0.5904, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.18% (4.8802 => 4.5788, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.16% (0.2548 => 0.2391, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -6.14% (0.9179 => 0.8615, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -6.13% (0.2985 => 0.2802, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.07% (1.6364 => 1.5371, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.05% (0.4151 => 0.3900, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -6.04% (1.1450 => 1.0758, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.04% (0.2999 => 0.2818, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.03% (0.3483 => 0.3273, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.01% (0.2695 => 0.2533, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.01% (0.8521 => 0.8009, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.99% (14.2083 => 13.3579, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.98% (0.4916 => 0.4622, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.98% (1.6474 => 1.5489, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: -5.98% (0.3581 => 0.3367, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: -5.97% (15.5079 => 14.5820, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/hash2: -5.97% (0.4861 => 0.4571, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.94% (0.7919 => 0.7449, std.dev.: 0.0034) MultiSource/Applications/lua/lua: -5.92% (4.0594 => 3.8192, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.90% (0.3849 => 0.3622, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -5.89% (2.4021 => 2.2606, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: -5.88% (0.3025 => 0.2847, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.86% (0.5478 => 0.5157, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.85% (0.5863 => 0.5520, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.81% (8.0126 => 7.5468, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.78% (0.7524 => 0.7089, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.78% (0.4083 => 0.3847, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.77% (0.5857 => 0.5519, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.77% (0.7021 => 0.6616, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: -5.75% (0.3026 => 0.2852, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.75% (0.3931 => 0.3705, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.75% (5.4682 => 5.1539, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: -5.75% (0.7447 => 0.7019, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.74% (0.5849 => 0.5513, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.74% (17.1032 => 16.1216, std.dev.: 0.0258) MultiSource/Applications/hexxagon/hexxagon: -5.73% (1.3148 => 1.2394, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.73% (2.1713 => 2.0468, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: -5.73% (0.3194 => 0.3011, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -5.73% (3.5154 => 3.3140, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: -5.73% (0.4524 => 0.4265, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: -5.72% (0.2989 => 0.2818, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -5.72% (0.3481 => 0.3282, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.72% (0.6736 => 0.6351, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: -5.71% (0.3255 => 0.3069, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.70% (0.6297 => 0.5938, std.dev.: 0.0063) MultiSource/Applications/SIBsim4/SIBsim4: -5.68% (1.3864 => 1.3076, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.67% (0.5591 => 0.5274, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.67% (0.5329 => 0.5027, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.66% (0.2278 => 0.2149, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.66% (0.3057 => 0.2884, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: -5.66% (0.3446 => 0.3251, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.64% (0.2871 => 0.2709, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -5.63% (0.3621 => 0.3417, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.63% (0.5575 => 0.5261, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -5.63% (0.4248 => 0.4009, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.62% (0.5802 => 0.5476, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: -5.61% (0.2939 => 0.2774, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.61% (2.2587 => 2.1319, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.61% (1.2221 => 1.1536, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.60% (0.3016 => 0.2847, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.60% (0.5925 => 0.5593, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.60% (0.5999 => 0.5663, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.60% (0.5805 => 0.5480, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.60% (0.6681 => 0.6307, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.59% (0.6660 => 0.6288, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.58% (0.3837 => 0.3623, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.57% (0.5581 => 0.5270, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.57% (0.6446 => 0.6087, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.57% (0.9557 => 0.9025, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: -5.57% (2.1401 => 2.0210, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.55% (0.6194 => 0.5850, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.55% (0.5168 => 0.4881, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.55% (0.5859 => 0.5534, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -5.54% (0.6750 => 0.6376, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -5.54% (0.3394 => 0.3206, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.54% (0.6304 => 0.5955, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.53% (0.2385 => 0.2253, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.53% (0.5569 => 0.5261, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.52% (0.2933 => 0.2771, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -5.52% (0.3205 => 0.3028, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.52% (0.6230 => 0.5886, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.51% (0.2903 => 0.2743, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -5.51% (0.2849 => 0.2692, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.50% (0.3252 => 0.3073, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.50% (1.2210 => 1.1538, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.50% (0.5567 => 0.5261, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -5.49% (34.0927 => 32.2216, std.dev.: 0.0380) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.49% (0.5705 => 0.5392, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.47% (0.6052 => 0.5721, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.46% (0.6189 => 0.5851, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.46% (0.2106 => 0.1991, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: -5.46% (0.3867 => 0.3656, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.44% (0.6667 => 0.6304, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.44% (0.4427 => 0.4186, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.44% (0.5570 => 0.5267, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.41% (0.3491 => 0.3302, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: -5.41% (0.3271 => 0.3094, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.41% (0.7339 => 0.6942, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.40% (0.6260 => 0.5922, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.40% (0.2001 => 0.1893, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -5.39% (0.3059 => 0.2894, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -5.38% (15.2527 => 14.4319, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.38% (0.6676 => 0.6317, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -5.37% (18.2933 => 17.3104, std.dev.: 0.0122) MultiSource/Benchmarks/sim/sim: -5.37% (0.3406 => 0.3223, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.37% (0.6440 => 0.6094, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -5.37% (0.8418 => 0.7966, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.32% (0.6395 => 0.6055, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -5.31% (0.3788 => 0.3587, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.29% (0.6395 => 0.6057, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.28% (0.5456 => 0.5168, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.25% (0.5941 => 0.5629, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -5.22% (0.7982 => 0.7565, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.22% (0.5688 => 0.5391, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.19% (0.4813 => 0.4563, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.14% (0.4321 => 0.4099, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: -5.13% (0.9077 => 0.8611, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.12% (0.3319 => 0.3149, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.07% (0.7198 => 0.6833, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.06% (0.6033 => 0.5728, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: -4.99% (0.7779 => 0.7391, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.94% (0.3323 => 0.3159, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: -4.93% (5.0226 => 4.7752, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: -4.89% (0.6441 => 0.6126, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.83% (0.2277 => 0.2167, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/Hello: -4.79% (0.6347 => 0.6043, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -4.59% (1.5610 => 1.4894, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -2.04% (20.7746 => 20.3506, std.dev.: 0.0488) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7518, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/richards_benchmark: -8.69% (1.2842 => 1.1726, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7068, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.81% (2.2633 => 2.1771, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.19% (1.0557 => 1.0220, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.96% (1.3096 => 1.2839, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4668, std.dev.: 0.0039) Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 09:45:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 11:45:16 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121109174516.21F572A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5714?compare_to=5709&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5714, Order: 167613, Start Time: 2012-11-09 14:29:54, End Time: 2012-11-09 17:45:27 To: 5709, Order: 167609, Start Time: 2012-11-09 10:26:21, End Time: 2012-11-09 13:41:55 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (170 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1042 (720 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.96% (0.0625 => 0.0881, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.08% (0.1063 => 0.1404, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.34% (0.2969 => 0.3751, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.50% (0.1106 => 0.1388, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.06% (0.4253 => 0.5319, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.38% (0.4139 => 0.5148, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.92% (0.5900 => 0.7311, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 23.48% (1.5932 => 1.9673, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.39% (0.0714 => 0.0881, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.37% (0.0475 => 0.0586, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.29% (0.0584 => 0.0720, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.13% (0.4994 => 0.6149, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.04% (0.5000 => 0.6152, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.96% (0.0897 => 0.1094, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.79% (0.1620 => 0.1973, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.55% (0.1021 => 0.1241, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.23% (0.1107 => 0.1342, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.70% (0.3903 => 0.4711, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 20.46% (0.0948 => 0.1142, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.45% (0.1604 => 0.1932, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.38% (0.0584 => 0.0703, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.22% (0.1103 => 0.1326, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.06% (0.0633 => 0.0760, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.94% (0.0642 => 0.0770, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.74% (0.1003 => 0.1201, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 19.73% (0.0821 => 0.0983, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.63% (0.1549 => 0.1853, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 19.54% (0.0604 => 0.0722, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.46% (0.0822 => 0.0982, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 19.46% (0.1619 => 0.1934, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.95% (0.1462 => 0.1739, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 18.69% (0.0947 => 0.1124, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 18.69% (0.0808 => 0.0959, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.38% (0.0582 => 0.0689, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.23% (0.3890 => 0.4599, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference-object: 18.00% (0.5889 => 0.6949, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/mst/mst: 17.91% (0.0698 => 0.0823, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 17.89% (0.5826 => 0.6868, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.78% (0.2014 => 0.2372, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 17.73% (0.1218 => 0.1434, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.66% (0.2866 => 0.3372, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.62% (0.2736 => 0.3218, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.47% (1.3152 => 1.5450, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/09-vor/vor: 17.41% (0.1505 => 0.1767, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 17.37% (0.4029 => 0.4729, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.19% (0.1088 => 0.1275, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.02% (0.4658 => 0.5451, std.dev.: 0.0047) MultiSource/Applications/Burg/burg: 16.88% (0.5546 => 0.6482, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.81% (0.3271 => 0.3821, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 16.65% (1.8794 => 2.1923, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.55% (3.5627 => 4.1525, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.51% (0.1968 => 0.2293, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.45% (0.5026 => 0.5853, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.35% (0.2875 => 0.3345, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.31% (1.6211 => 1.8855, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 16.08% (0.9697 => 1.1256, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.03% (0.1160 => 0.1346, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.87% (0.2729 => 0.3162, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 15.76% (0.1421 => 0.1645, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.67% (0.2738 => 0.3167, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 15.66% (0.2714 => 0.3139, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 15.64% (1.0781 => 1.2467, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/fibo: 15.63% (0.2725 => 0.3151, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.57% (0.4361 => 0.5040, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 15.51% (0.7171 => 0.8283, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: 15.50% (0.1284 => 0.1483, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 15.49% (0.2750 => 0.3176, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 15.43% (0.2780 => 0.3209, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.43% (0.3195 => 0.3688, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 15.38% (0.9909 => 1.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.37% (0.3930 => 0.4534, std.dev.: 0.0027) SingleSource/Regression/C++/ofstream_ctor: 15.35% (0.3004 => 0.3465, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 15.31% (0.2803 => 0.3232, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 15.25% (0.2813 => 0.3242, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.24% (4.4195 => 5.0931, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 15.20% (0.2823 => 0.3252, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 15.19% (0.2811 => 0.3238, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.15% (0.2911 => 0.3352, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.11% (0.2792 => 0.3214, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 15.08% (0.3096 => 0.3563, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 15.08% (0.2566 => 0.2953, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.01% (2.0673 => 2.3775, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 14.97% (4.2109 => 4.8411, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/football/football: 14.80% (0.2075 => 0.2382, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.77% (2.7292 => 3.1323, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.77% (1.9694 => 2.2602, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary3: 14.69% (0.3267 => 0.3747, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.61% (1.9966 => 2.2884, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 14.52% (0.3258 => 0.3731, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.41% (0.3060 => 0.3501, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.40% (0.1090 => 0.1247, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 14.32% (0.3317 => 0.3792, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.25% (0.3362 => 0.3841, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 14.12% (23.5202 => 26.8403, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.95% (0.3282 => 0.3740, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.92% (0.3124 => 0.3559, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 13.87% (0.3678 => 0.4188, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 13.77% (0.4146 => 0.4717, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 13.77% (0.3348 => 0.3809, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.76% (0.3845 => 0.4374, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 13.73% (0.3496 => 0.3976, std.dev.: 0.0030) MultiSource/Applications/lua/lua: 13.69% (1.4269 => 1.6223, std.dev.: 0.0106) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.62% (0.3488 => 0.3963, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.60% (0.3625 => 0.4118, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.59% (0.3465 => 0.3936, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 13.55% (0.3726 => 0.4231, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 13.55% (0.3477 => 0.3948, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.49% (0.3446 => 0.3911, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.40% (0.3469 => 0.3934, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.35% (0.3460 => 0.3922, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 13.31% (0.3442 => 0.3900, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 13.23% (0.3643 => 0.4125, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.22% (0.3690 => 0.4178, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 13.22% (0.4251 => 0.4813, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.19% (0.3981 => 0.4506, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.07% (0.3650 => 0.4127, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 13.07% (0.7875 => 0.8904, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 12.94% (0.3724 => 0.4206, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 12.70% (2.1653 => 2.4403, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/bigfib: 12.53% (0.5012 => 0.5640, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 12.38% (4.6177 => 5.1893, std.dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 12.34% (2.1013 => 2.3606, std.dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: 12.26% (0.2691 => 0.3021, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.91% (0.2040 => 0.2283, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.64% (0.6435 => 0.7184, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 11.25% (5.5417 => 6.1653, std.dev.: 0.0046) MultiSource/Applications/lambda-0_1_3/lambda: 10.61% (0.3498 => 0.3869, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.60% (0.1028 => 0.1137, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.41% (0.1383 => 0.1527, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.25% (0.2068 => 0.2280, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.23% (0.2737 => 0.3017, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.16% (0.6634 => 0.7308, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: 10.15% (0.4847 => 0.5339, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.05% (0.3084 => 0.3394, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 9.50% (0.3336 => 0.3653, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 9.29% (2.0346 => 2.2236, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.18% (0.2103 => 0.2296, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 9.16% (0.2391 => 0.2610, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.23% (4.6926 => 5.0786, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.07% (11.6398 => 12.5790, std.dev.: 0.0201) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.06% (0.5361 => 0.5793, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.58% (0.7426 => 0.7989, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.49% (0.5584 => 0.6002, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 6.18% (11.9555 => 12.6948, std.dev.: 0.0099) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.35% (0.3792 => 0.3957, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 8.39% (0.2802 => 0.3037, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6119, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.79% (0.3693 => 0.3907, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6761, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-2: 4.87% (1.8057 => 1.8936, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1674, std.dev.: 0.0458) SingleSource/Benchmarks/Dhrystone/dry: 4.30% (14.0481 => 14.6526, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1954, std.dev.: 0.0062) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.55% (3.1722 => 3.2213, std.dev.: 0.0048) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3069, std.dev.: 0.0189) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2882, std.dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5151, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5894, std.dev.: 0.0138) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.83% (2.4764 => 2.4312, std.dev.: 0.0123) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.72% (25.4195 => 16.5927, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/ary2: -9.53% (0.2402 => 0.2173, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9763, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7957, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8023, std.dev.: 0.0038) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7730, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.38% (0.6293 => 0.6143, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -2.26% (17.2379 => 16.8490, std.dev.: 0.0444) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8667, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5746, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4961, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.09% (105.3826 => 104.2330, std.dev.: 0.0579) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0430, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 10:15:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 12:15:33 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121109181533.51D552A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5715?compare_to=5712&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5715, Order: 167618, Start Time: 2012-11-09 16:49:43, End Time: 2012-11-09 18:15:45 To: 5712, Order: 167615, Start Time: 2012-11-09 15:06:16, End Time: 2012-11-09 16:32:48 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 6 (87 on baseline) Performance Improvements: 8 (30 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 977 (857 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.93% (1.6607 => 1.6927, std.dev.: 0.0106) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 7.67% (2.2405 => 2.4124, std.dev.: 0.0415) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.69% (0.3169 => 0.3381, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/methcall: 3.41% (8.6845 => 8.9808, std.dev.: 0.0404) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.26% (6.1461 => 6.2848, std.dev.: 0.0298) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.02% (1.5781 => 1.5942, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -7.01% (0.5207 => 0.4842, std.dev.: 0.0118) MultiSource/Benchmarks/McCat/05-eks/eks: -2.30% (0.4530 => 0.4426, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -2.02% (0.8279 => 0.8112, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.65% (0.8491 => 0.8351, std.dev.: 0.0047) MultiSource/Applications/SIBsim4/SIBsim4: -1.23% (1.2930 => 1.2771, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/ffbench: -2.66% (1.4250 => 1.3871, std.dev.: 0.0145) MultiSource/Benchmarks/Bullet/bullet: -1.46% (7.2526 => 7.1469, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout/methcall: -1.16% (8.2898 => 8.1939, std.dev.: 0.0319) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.47% (16.6300 => 16.7079, std.dev.: 0.0208) MultiSource/Applications/obsequi/Obsequi: -1.86% (1.0585 => 1.0388, std.dev.: 0.0140) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.26% (21.5607 => 21.6159, std.dev.: 0.1874) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.47% (0.3626 => 0.3643, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 0.72% (0.6006 => 0.6049, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.73% (0.3302 => 0.3326, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/strcat: 1.36% (0.1988 => 0.2015, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -33.79% (0.0219 => 0.0145, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0423 => 0.0425, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.20% (0.0333 => 0.0329, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0314 => 0.0314, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.90% (0.0421 => 0.0429, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: 1.97% (0.0203 => 0.0207, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: -2.27% (0.0220 => 0.0215, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1456 => 0.1459, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 1.76% (1.1237 => 1.1435, std.dev.: 0.0213) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.93% (0.1481 => 0.1408, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.34% (0.4463 => 0.4180, std.dev.: 0.0266) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.58% (0.1377 => 0.1440, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.72% (0.0596 => 0.0642, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.71% (0.0276 => 0.0263, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.21% (0.0543 => 0.0593, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.12% (1.1942 => 1.1928, std.dev.: 0.0212) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -95.00% (0.0020 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.69% (0.0640 => 0.0578, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.69% (0.0268 => 0.0234, std.dev.: 0.0065) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.04% (0.7714 => 0.7794, std.dev.: 0.0142) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 56.60% (0.0053 => 0.0083, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2306.46% (0.6332 => 15.2377, std.dev.: 0.0227) MultiSource/Benchmarks/McCat/08-main/main: 47.08% (0.1831 => 0.2693, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.77% (0.1559 => 0.1469, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1492.49% (0.3344 => 5.3253, std.dev.: 0.0346) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.84% (0.2364 => 0.3235, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: 1.63% (0.0429 => 0.0436, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.14% (0.0224 => 0.0240, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -26.09% (0.0230 => 0.0170, std.dev.: 0.0000) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4300, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0699, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4876, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3387, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1478, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4058, std.dev.: 0.0109) SingleSource/Regression/C/uint64_to_float: -24.07% (2.1832 => 1.6578, std.dev.: 0.0038) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0008) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.68% (0.0810 => 0.0937, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.17% (0.2279 => 0.2488, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.10% (0.1885 => 0.2000, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.79% (0.7473 => 0.7906, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.95% (0.2103 => 0.2207, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.78% (0.3137 => 0.3287, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.58% (1.1606 => 1.2137, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.95% (0.4127 => 0.4290, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.87% (0.2998 => 0.3114, std.dev.: 0.0037) MultiSource/Applications/Burg/burg: 3.74% (1.2222 => 1.2679, std.dev.: 0.0082) MultiSource/Applications/hbd/hbd: 3.66% (1.4269 => 1.4791, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.63% (0.8286 => 0.8587, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.30% (1.6386 => 1.6927, std.dev.: 0.0106) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.27% (6.6074 => 6.8232, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.22% (0.9435 => 0.9739, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.10% (0.8086 => 0.8337, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.05% (4.1763 => 4.3036, std.dev.: 0.0454) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.88% (0.8359 => 0.8600, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.83% (0.8697 => 0.8943, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.66% (0.8331 => 0.8553, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.57% (0.8317 => 0.8531, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.54% (4.4873 => 4.6013, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.50% (0.8048 => 0.8249, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.49% (0.8204 => 0.8408, std.dev.: 0.0067) MultiSource/Applications/SPASS/SPASS: 2.45% (14.2605 => 14.6103, std.dev.: 0.0397) MultiSource/Applications/minisat/minisat: 2.44% (0.6834 => 0.7001, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.35% (0.8716 => 0.8921, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.35% (0.8805 => 0.9012, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.32% (0.8518 => 0.8716, std.dev.: 0.0077) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.28% (0.4783 => 0.4892, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.27% (0.7932 => 0.8112, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.26% (0.6227 => 0.6368, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.26% (1.2526 => 1.2809, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.19% (0.8611 => 0.8800, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.13% (0.8177 => 0.8351, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.12% (0.8338 => 0.8515, std.dev.: 0.0061) MultiSource/Applications/ClamAV/clamscan: 2.04% (14.7684 => 15.0695, std.dev.: 0.0585) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.02% (4.5702 => 4.6623, std.dev.: 0.0166) MultiSource/Applications/JM/ldecod/ldecod: 1.94% (6.7320 => 6.8624, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.85% (8.6476 => 8.8080, std.dev.: 0.0490) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.82% (0.8316 => 0.8467, std.dev.: 0.0047) MultiSource/Applications/JM/lencod/lencod: 1.80% (15.3280 => 15.6044, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.78% (0.8597 => 0.8750, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.76% (4.4880 => 4.5671, std.dev.: 0.0208) MultiSource/Applications/SIBsim4/SIBsim4: 1.62% (1.2568 => 1.2771, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.60% (1.1170 => 1.1349, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.51% (2.1401 => 2.1725, std.dev.: 0.0089) MultiSource/Applications/oggenc/oggenc: 1.45% (4.9628 => 5.0349, std.dev.: 0.0162) MultiSource/Applications/hexxagon/hexxagon: 1.38% (0.9810 => 0.9945, std.dev.: 0.0049) MultiSource/Applications/siod/siod: 1.37% (2.2184 => 2.2488, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.26% (1.2423 => 1.2580, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/football/football: 1.16% (0.8768 => 0.8870, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.00% (3.1832 => 3.2151, std.dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 114.57% (0.0199 => 0.0427, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/pi: 58.26% (1.5795 => 2.4997, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.26% (2.9753 => 3.4591, std.dev.: 0.0307) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.87% (0.7597 => 0.8803, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.75% (2.7995 => 3.2123, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.64% (5.0261 => 5.6110, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.62% (1.1857 => 1.2761, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 7.29% (2.2485 => 2.4124, std.dev.: 0.0415) SingleSource/Benchmarks/McGill/queens: 7.04% (1.7056 => 1.8256, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.57% (4.7794 => 5.0936, std.dev.: 0.0247) SingleSource/Benchmarks/Misc/richards_benchmark: 6.42% (1.3037 => 1.3874, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.12% (0.3186 => 0.3381, std.dev.: 0.0066) MultiSource/Applications/SIBsim4/SIBsim4: 6.08% (3.1873 => 3.3810, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.89% (4.5327 => 4.7997, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.85% (4.9686 => 5.2591, std.dev.: 0.0635) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.71% (6.2275 => 6.5210, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.71% (3.3761 => 3.5351, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.22% (4.9453 => 5.1538, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.13% (4.9469 => 5.1512, std.dev.: 0.0087) MultiSource/Applications/hexxagon/hexxagon: 3.88% (14.0064 => 14.5505, std.dev.: 0.0188) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.35% (0.3587 => 0.3707, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.08% (1.2337 => 1.2717, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.88% (11.5690 => 11.9024, std.dev.: 0.0375) MultiSource/Applications/lambda-0_1_3/lambda: 2.81% (7.4933 => 7.7042, std.dev.: 0.0439) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.63% (4.8660 => 4.9942, std.dev.: 0.0232) MultiSource/Applications/siod/siod: 2.58% (3.6643 => 3.7589, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.53% (4.8362 => 4.9584, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.41% (8.2783 => 8.4775, std.dev.: 0.0271) MultiSource/Benchmarks/Olden/power/power: 1.48% (1.2061 => 1.2240, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.46% (2.4647 => 2.5007, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 1.32% (1.0841 => 1.0984, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 1.31% (2.3560 => 2.3869, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.26% (1.1365 => 1.1508, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.15% (3.5679 => 3.6090, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.94% (5.4641 => 4.3197, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.87% (7.2130 => 6.2848, std.dev.: 0.0298) SingleSource/Benchmarks/McGill/chomp: -11.05% (1.1216 => 0.9977, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.88% (1.0512 => 0.9368, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: -8.55% (63.1822 => 57.7805, std.dev.: 0.0728) SingleSource/Benchmarks/Shootout/heapsort: -8.51% (3.2926 => 3.0123, std.dev.: 0.0747) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.95% (4.7482 => 4.4183, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.33% (0.3269 => 0.3062, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.98% (3.7148 => 3.4926, std.dev.: 0.0242) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.86% (5.4972 => 5.1751, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/recursive: -5.36% (2.4490 => 2.3177, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.98% (5.1557 => 4.8989, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.33% (4.7449 => 4.5393, std.dev.: 0.0154) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.99% (2.8773 => 2.7626, std.dev.: 0.0339) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.72% (6.0224 => 5.7984, std.dev.: 0.0074) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.02% (28.5821 => 27.7182, std.dev.: 0.0595) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.98% (0.5807 => 0.5634, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: -2.97% (1.4296 => 1.3871, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.90% (2.6356 => 2.5591, std.dev.: 0.0114) MultiSource/Benchmarks/FreeBench/mason/mason: -2.84% (0.5415 => 0.5261, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.38% (9.9065 => 9.6710, std.dev.: 0.0583) SingleSource/Benchmarks/Shootout-C++/hash2: -2.32% (3.4237 => 3.3442, std.dev.: 0.0171) MultiSource/Applications/aha/aha: -2.27% (3.3398 => 3.2639, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (11.5316 => 11.2988, std.dev.: 0.0126) SingleSource/Benchmarks/Dhrystone/fldry: -1.91% (0.6910 => 0.6778, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.73% (3.2169 => 3.1612, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/bisort/bisort: -1.70% (0.6636 => 0.6523, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.57% (4.9994 => 4.9208, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.41% (1.0388 => 1.0242, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.31% (5.6343 => 5.5604, std.dev.: 0.0148) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.59% (16.4461 => 16.7079, std.dev.: 0.0208) MultiSource/Applications/obsequi/Obsequi: 1.23% (1.0262 => 1.0388, std.dev.: 0.0140) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6821.52% (0.3123 => 21.6159, std.dev.: 0.1874) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.91% (0.2463 => 0.3643, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 0.65% (0.6010 => 0.6049, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.84% (0.3266 => 0.3326, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/strcat: 2.34% (0.1969 => 0.2015, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 17.89% (0.0123 => 0.0145, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.53% (0.0254 => 0.0329, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.72% (0.0384 => 0.0429, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: 8.95% (0.0190 => 0.0207, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: 19.44% (0.0180 => 0.0215, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.46% (0.1438 => 0.1459, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.94% (1.1329 => 1.1435, std.dev.: 0.0213) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.69% (0.1462 => 0.1408, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.38% (0.4164 => 0.4180, std.dev.: 0.0266) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.19% (0.1369 => 0.1440, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.16% (0.0641 => 0.0642, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 34.87% (0.0195 => 0.0263, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.60% (0.0578 => 0.0593, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.29% (1.1437 => 1.1928, std.dev.: 0.0212) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.81% (0.0627 => 0.0578, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 30.00% (0.0180 => 0.0234, std.dev.: 0.0065) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.78% (0.8017 => 0.7794, std.dev.: 0.0142) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 33.87% (0.0062 => 0.0083, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 10:30:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 12:30:35 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121109183035.164352A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5716?compare_to=5713&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5716, Order: 167618, Start Time: 2012-11-09 17:05:13, End Time: 2012-11-09 18:30:46 To: 5713, Order: 167615, Start Time: 2012-11-09 15:16:41, End Time: 2012-11-09 16:41:49 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 1 (181 on baseline) Unchanged Tests: 1041 (857 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.26% (20.3506 => 20.0941, std.dev.: 0.0169) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.77% (2.0478 => 2.1046, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/salsa20: 2.74% (7.4937 => 7.6988, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/hash2: 2.29% (3.1932 => 3.2663, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.08% (0.1431 => 0.1301, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -8.05% (2.4924 => 2.2917, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.01% (0.3821 => 0.3515, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.09% (0.9542 => 0.8865, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -6.97% (0.3357 => 0.3123, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.94% (0.3142 => 0.2924, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.87% (0.3812 => 0.3550, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -6.85% (0.2160 => 0.2012, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -6.84% (0.3831 => 0.3569, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.84% (0.2428 => 0.2262, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -6.83% (0.3880 => 0.3615, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.81% (0.3891 => 0.3626, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.80% (0.3884 => 0.3620, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.76% (0.3848 => 0.3588, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/synchronized: -6.75% (0.3896 => 0.3633, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.73% (3.5339 => 3.2961, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: -6.69% (0.4033 => 0.3763, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.66% (0.4176 => 0.3898, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.66% (22.4056 => 20.9145, std.dev.: 0.0064) MultiSource/Applications/JM/ldecod/ldecod: -6.64% (7.0961 => 6.6246, std.dev.: 0.0089) MultiSource/Applications/JM/lencod/lencod: -6.63% (16.1920 => 15.1185, std.dev.: 0.0090) MultiSource/Benchmarks/mafft/pairlocalalign: -6.63% (9.2283 => 8.6169, std.dev.: 0.0075) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.57% (0.1584 => 0.1480, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.54% (0.6484 => 0.6060, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.54% (0.9852 => 0.9208, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.48% (0.3658 => 0.3421, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -6.47% (0.4280 => 0.4003, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -6.43% (0.4199 => 0.3929, std.dev.: 0.0037) MultiSource/Applications/Burg/burg: -6.39% (1.2515 => 1.1715, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.37% (1.0544 => 0.9872, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.34% (4.8161 => 4.5109, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.27% (4.0323 => 3.7796, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: -6.26% (0.9179 => 0.8604, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.26% (6.7716 => 6.3478, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.22% (1.3722 => 1.2868, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -6.19% (0.1761 => 0.1652, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.19% (4.8802 => 4.5782, std.dev.: 0.0104) MultiSource/Benchmarks/MallocBench/gs/gs: -6.18% (4.3330 => 4.0654, std.dev.: 0.0139) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.17% (4.5069 => 4.2286, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.16% (1.2784 => 1.1997, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.15% (1.6364 => 1.5358, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: -6.13% (1.1450 => 1.0748, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/08-main/main: -6.13% (0.2659 => 0.2496, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.10% (1.4642 => 1.3749, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.09% (0.2695 => 0.2531, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.08% (1.2300 => 1.1552, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: -6.03% (0.2985 => 0.2805, std.dev.: 0.0069) MultiSource/Applications/SPASS/SPASS: -6.03% (15.5079 => 14.5735, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.00% (0.5863 => 0.5511, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: -6.00% (0.4515 => 0.4244, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.99% (0.5478 => 0.5150, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -5.97% (4.0594 => 3.8172, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.97% (0.2548 => 0.2396, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.94% (0.3483 => 0.3276, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.94% (0.7524 => 0.7077, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.94% (14.2083 => 13.3642, std.dev.: 0.0219) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.93% (0.6293 => 0.5920, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.92% (0.5591 => 0.5260, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -5.90% (0.3406 => 0.3205, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.89% (1.6474 => 1.5503, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.89% (0.5857 => 0.5512, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -5.87% (2.4021 => 2.2610, std.dev.: 0.0096) MultiSource/Applications/minisat/minisat: -5.85% (0.7447 => 0.7011, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: -5.85% (1.1530 => 1.0855, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.83% (0.6052 => 0.5699, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.83% (0.5802 => 0.5464, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.81% (0.5849 => 0.5509, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.79% (0.5925 => 0.5582, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.79% (0.5859 => 0.5520, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.78% (17.1032 => 16.1138, std.dev.: 0.0213) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.78% (0.6189 => 0.5831, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.78% (0.7919 => 0.7461, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.78% (0.6297 => 0.5933, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.78% (0.5575 => 0.5253, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.77% (0.6446 => 0.6074, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.77% (0.5581 => 0.5259, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.75% (0.5805 => 0.5471, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -5.75% (0.3581 => 0.3375, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.75% (0.7339 => 0.6917, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.75% (0.5570 => 0.5250, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.74% (0.4916 => 0.4634, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.72% (0.6660 => 0.6279, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -5.72% (1.3864 => 1.3071, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.72% (0.5999 => 0.5656, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.72% (0.8521 => 0.8034, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.71% (0.2278 => 0.2148, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.70% (0.7021 => 0.6621, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.69% (0.6736 => 0.6353, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.68% (2.2587 => 2.1303, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.68% (0.6304 => 0.5946, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.68% (8.0126 => 7.5577, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.67% (0.6260 => 0.5905, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.67% (0.5329 => 0.5027, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.67% (0.6230 => 0.5877, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.66% (0.6395 => 0.6033, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.66% (0.5569 => 0.5254, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.64% (0.5567 => 0.5253, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.63% (0.5705 => 0.5384, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.61% (0.5941 => 0.5608, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: -5.60% (3.5154 => 3.3187, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.59% (5.4682 => 5.1625, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.59% (0.6676 => 0.6303, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.57% (0.6440 => 0.6081, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.57% (0.5456 => 0.5152, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.57% (0.6194 => 0.5849, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.54% (0.6395 => 0.6041, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.54% (0.2999 => 0.2833, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: -5.52% (2.1401 => 2.0219, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.51% (0.5168 => 0.4883, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.50% (0.7198 => 0.6802, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.50% (1.2210 => 1.1539, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.49% (0.2385 => 0.2254, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.49% (1.2221 => 1.1550, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.49% (0.6667 => 0.6301, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.48% (0.2355 => 0.2226, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.44% (0.4151 => 0.3925, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.44% (0.6033 => 0.5705, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -5.43% (0.4861 => 0.4597, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.41% (0.5688 => 0.5380, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -5.40% (0.7982 => 0.7551, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: -5.38% (0.1879 => 0.1778, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.34% (0.6681 => 0.6324, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -5.31% (15.2527 => 14.4427, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.29% (0.9557 => 0.9051, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.24% (0.3491 => 0.3308, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -5.24% (18.2933 => 17.3352, std.dev.: 0.0053) MultiSource/Benchmarks/Bullet/bullet: -5.24% (34.0927 => 32.3074, std.dev.: 0.0209) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.22% (0.3849 => 0.3648, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.21% (0.3319 => 0.3146, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.19% (0.3931 => 0.3727, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: -5.19% (0.6750 => 0.6400, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -5.17% (1.3148 => 1.2468, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.09% (0.3323 => 0.3154, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.08% (0.3837 => 0.3642, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.07% (0.4083 => 0.3876, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: -5.06% (0.3025 => 0.2872, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: -5.04% (0.3271 => 0.3106, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: -5.04% (0.3194 => 0.3033, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.03% (0.2106 => 0.2000, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.02% (2.1713 => 2.0624, std.dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: -4.99% (5.0226 => 4.7718, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/lists: -4.97% (0.3621 => 0.3441, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -4.97% (0.3481 => 0.3308, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -4.96% (0.3446 => 0.3275, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -4.95% (0.2989 => 0.2841, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.93% (0.8418 => 0.8003, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -4.92% (0.3394 => 0.3227, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -4.92% (0.4248 => 0.4039, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -4.89% (0.3867 => 0.3678, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (0.2871 => 0.2731, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -4.85% (0.3255 => 0.3097, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.84% (0.3057 => 0.2909, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -4.84% (0.3059 => 0.2911, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -4.80% (0.2939 => 0.2798, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.79% (0.4427 => 0.4215, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -4.76% (0.3026 => 0.2882, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.74% (0.4321 => 0.4116, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.74% (0.3016 => 0.2873, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.72% (0.2903 => 0.2766, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: -4.70% (0.2849 => 0.2715, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.67% (0.3252 => 0.3100, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -4.62% (0.3788 => 0.3613, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.62% (0.3205 => 0.3057, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.60% (0.2933 => 0.2798, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -4.58% (0.4524 => 0.4317, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.37% (0.9077 => 0.8680, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.34% (0.4813 => 0.4604, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: -4.32% (0.7779 => 0.7443, std.dev.: 0.0031) MultiSource/Applications/hbd/hbd: -4.26% (1.5610 => 1.4945, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: -3.91% (0.6441 => 0.6189, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -3.88% (0.6347 => 0.6101, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -3.28% (20.7746 => 20.0941, std.dev.: 0.0169) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7575, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1723, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.91% (2.2633 => 2.1747, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7060, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3339, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4718, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/ary3: -1.09% (3.7241 => 3.6835, std.dev.: 0.0148) Report Time: 2.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 11:59:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 13:59:26 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121109195926.02B6A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5717?compare_to=5715&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5717, Order: 167621, Start Time: 2012-11-09 18:32:49, End Time: 2012-11-09 19:59:37 To: 5715, Order: 167618, Start Time: 2012-11-09 16:49:43, End Time: 2012-11-09 18:15:45 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 11 (88 on baseline) Performance Improvements: 1 (21 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 979 (865 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.74% (0.0667 => 0.0772, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.71% (0.4842 => 0.5167, std.dev.: 0.0108) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.51% (0.8538 => 0.8923, std.dev.: 0.0065) MultiSource/Applications/lambda-0_1_3/lambda: 1.87% (0.7531 => 0.7672, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.70% (0.8605 => 0.8751, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 1.34% (0.9945 => 1.0078, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.14% (1.5025 => 1.5196, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 13.75% (19.2370 => 21.8819, std.dev.: 0.6672) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.93% (44.6196 => 45.9284, std.dev.: 0.3907) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.87% (2.3177 => 2.3842, std.dev.: 0.0212) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.31% (5.8193 => 5.8958, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -3.14% (2.4124 => 2.3366, std.dev.: 0.0263) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.22% (16.7079 => 16.6709, std.dev.: 0.1318) MultiSource/Applications/obsequi/Obsequi: 1.80% (1.0388 => 1.0575, std.dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.21% (21.6159 => 21.6623, std.dev.: 0.5077) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.60% (0.3643 => 0.3665, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: -0.12% (0.6049 => 0.6042, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.44% (0.3326 => 0.3374, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: -0.20% (0.2015 => 0.2011, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 50.34% (0.0145 => 0.0218, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0425 => 0.0427, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.22% (0.0329 => 0.0333, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0314 => 0.0315, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.20% (0.0429 => 0.0411, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/casts: -1.45% (0.0207 => 0.0204, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 1.40% (0.0215 => 0.0218, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1100.00% (0.0001 => 0.0012, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.41% (0.1459 => 0.1465, std.dev.: 0.0043) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.73% (1.1435 => 1.1352, std.dev.: 0.0641) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 4.19% (0.1408 => 0.1467, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.60% (0.4180 => 0.4113, std.dev.: 0.0237) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.15% (0.1440 => 0.1409, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.31% (0.0642 => 0.0644, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -26.62% (0.0263 => 0.0193, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.37% (0.0593 => 0.0573, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.01% (1.1928 => 1.1929, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 700.00% (0.0001 => 0.0008, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 600.00% (0.0001 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.42% (0.0578 => 0.0644, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.53% (0.0234 => 0.0268) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.23% (0.7794 => 0.7776, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -10.84% (0.0083 => 0.0074, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2308.42% (0.6332 => 15.2501, std.dev.: 0.3039) MultiSource/Benchmarks/McCat/08-main/main: 47.35% (0.1831 => 0.2698, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.45% (0.1559 => 0.1474, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1488.07% (0.3344 => 5.3105, std.dev.: 0.0802) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.35% (0.2364 => 0.3247, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -0.70% (0.0429 => 0.0426, std.dev.: 0.0008) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 9.38% (0.0224 => 0.0245, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -31.74% (0.0230 => 0.0157, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4366, std.dev.: 0.0236) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0702, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4961, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3390, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1400, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4046, std.dev.: 0.0027) SingleSource/Regression/C/uint64_to_float: -23.80% (2.1832 => 1.6636, std.dev.: 0.0024) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0005, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.30% (0.0810 => 0.0942, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: 9.44% (0.1112 => 0.1217, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.73% (0.3137 => 0.3411, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.23% (0.8321 => 0.8923, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.60% (0.4847 => 0.5167, std.dev.: 0.0108) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.50% (0.1983 => 0.2092, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.13% (0.7473 => 0.7856, std.dev.: 0.0124) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.00% (0.2180 => 0.2289, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.95% (1.4479 => 1.5196, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.91% (0.6010 => 0.6305, std.dev.: 0.0101) MultiSource/Applications/spiff/spiff: 4.63% (0.7950 => 0.8318, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.39% (1.1606 => 1.2115, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.33% (0.2519 => 0.2628, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.16% (0.9908 => 1.0320, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.99% (0.6287 => 0.6538, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.94% (0.9435 => 0.9807, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.93% (0.8420 => 0.8751, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.79% (0.5961 => 0.6187, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.44% (0.8805 => 0.9108, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.39% (0.8457 => 0.8744, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.12% (4.1763 => 4.3066, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.07% (0.9074 => 0.9353, std.dev.: 0.0082) MultiSource/Benchmarks/nbench/nbench: 2.95% (1.1271 => 1.1603, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.88% (0.8086 => 0.8319, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 2.83% (14.2605 => 14.6643, std.dev.: 0.0675) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.81% (0.8855 => 0.9104, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.81% (0.7966 => 0.8190, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.78% (0.8177 => 0.8404, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/moments: 2.77% (0.3645 => 0.3746, std.dev.: 0.0026) MultiSource/Applications/lua/lua: 2.75% (3.8189 => 3.9240, std.dev.: 0.0403) MultiSource/Applications/hexxagon/hexxagon: 2.73% (0.9810 => 1.0078, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.70% (0.4559 => 0.4682, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.68% (0.8050 => 0.8266, std.dev.: 0.0071) MultiSource/Applications/SIBsim4/SIBsim4: 2.68% (1.2568 => 1.2905, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.55% (4.4873 => 4.6019, std.dev.: 0.0384) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.53% (0.8069 => 0.8273, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.48% (0.9069 => 0.9294, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.42% (0.8712 => 0.8923, std.dev.: 0.0058) MultiSource/Applications/minisat/minisat: 2.41% (0.6834 => 0.6999, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.40% (0.8611 => 0.8818, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.20% (0.8359 => 0.8543, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.16% (0.8338 => 0.8518, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.08% (0.8597 => 0.8776, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.04% (0.6227 => 0.6354, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.99% (1.1170 => 1.1392, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 1.93% (3.2366 => 3.2991, std.dev.: 0.0166) MultiSource/Applications/treecc/treecc: 1.93% (1.9948 => 2.0332, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.91% (0.9688 => 0.9873, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.79% (8.6476 => 8.8027, std.dev.: 0.0534) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.63% (13.1811 => 13.3960, std.dev.: 0.0365) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.57% (2.1401 => 2.1736, std.dev.: 0.0075) MultiSource/Applications/lambda-0_1_3/lambda: 1.52% (0.7557 => 0.7672, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 92.46% (0.0199 => 0.0383, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/pi: 58.47% (1.5795 => 2.5031, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.10% (2.9753 => 3.4543, std.dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.94% (0.7597 => 0.8808, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.77% (2.7995 => 3.2130, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.67% (5.0261 => 5.6125, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.13% (0.3186 => 0.3445, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.05% (1.1857 => 1.2812, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 7.48% (1.7056 => 1.8332, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 7.24% (1.3037 => 1.3981, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.92% (4.7794 => 5.1100, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 6.26% (3.1873 => 3.3868, std.dev.: 0.0541) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.78% (4.5327 => 4.7948, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.75% (4.9686 => 5.2541, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.72% (3.3761 => 3.5353, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.70% (6.2275 => 6.5204, std.dev.: 0.0728) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.45% (4.9469 => 5.1669, std.dev.: 0.0325) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.41% (4.9453 => 5.1632, std.dev.: 0.0117) MultiSource/Applications/hexxagon/hexxagon: 3.93% (14.0064 => 14.5567, std.dev.: 0.0386) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.92% (2.2485 => 2.3366, std.dev.: 0.0263) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.26% (0.3587 => 0.3704, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.07% (44.5605 => 45.9284, std.dev.: 0.3907) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.05% (11.5690 => 11.9219, std.dev.: 0.0215) MultiSource/Applications/SPASS/SPASS: 3.03% (8.4326 => 8.6884, std.dev.: 0.0251) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.96% (1.2337 => 1.2702, std.dev.: 0.0107) MultiSource/Applications/siod/siod: 2.67% (3.6643 => 3.7620, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.55% (4.8660 => 4.9902, std.dev.: 0.0227) MultiSource/Applications/lambda-0_1_3/lambda: 2.52% (7.4933 => 7.6818, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.45% (8.2783 => 8.4809, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout/lists: 2.43% (7.3375 => 7.5160, std.dev.: 0.0606) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.22% (1.1365 => 1.1617, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.85% (4.8362 => 4.9258, std.dev.: 0.0316) MultiSource/Benchmarks/FreeBench/neural/neural: 1.33% (1.0841 => 1.0985, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 1.21% (8.5322 => 8.6358, std.dev.: 0.0200) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.06% (2.4647 => 2.4908, std.dev.: 0.0076) MultiSource/Applications/spiff/spiff: 1.06% (2.8561 => 2.8863, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.28% (5.4641 => 4.3014, std.dev.: 0.0152) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.20% (1.0512 => 0.9335, std.dev.: 0.0317) SingleSource/Benchmarks/McGill/chomp: -10.92% (1.1216 => 0.9991, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -10.16% (7.2130 => 6.4804, std.dev.: 0.0787) MultiSource/Benchmarks/mafft/pairlocalalign: -8.52% (63.1822 => 57.7983, std.dev.: 0.0373) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.85% (4.7482 => 4.4231, std.dev.: 0.0604) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.36% (0.3269 => 0.3061, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.91% (3.7148 => 3.4953, std.dev.: 0.0250) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.88% (5.4972 => 5.1738, std.dev.: 0.0357) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.09% (5.1557 => 4.8935, std.dev.: 0.0365) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.33% (4.7449 => 4.5394, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.16% (2.8773 => 2.7576, std.dev.: 0.0266) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.62% (6.0224 => 5.8041, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.46% (0.5807 => 0.5606, std.dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.05% (28.5821 => 27.7096, std.dev.: 0.0846) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.83% (2.6356 => 2.5611, std.dev.: 0.0174) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.65% (2.4490 => 2.3842, std.dev.: 0.0212) SingleSource/Benchmarks/Dhrystone/fldry: -2.36% (0.6910 => 0.6747, std.dev.: 0.0012) MultiSource/Applications/aha/aha: -2.08% (3.3398 => 3.2702, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.07% (11.5316 => 11.2932, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.03% (3.2169 => 3.1516, std.dev.: 0.0210) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.37% (16.4461 => 16.6709, std.dev.: 0.1318) MultiSource/Applications/obsequi/Obsequi: 3.05% (1.0262 => 1.0575, std.dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6836.38% (0.3123 => 21.6623, std.dev.: 0.5077) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.80% (0.2463 => 0.3665, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 0.53% (0.6010 => 0.6042, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.31% (0.3266 => 0.3374, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 2.13% (0.1969 => 0.2011, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 7.03% (0.0384 => 0.0411, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 71.43% (0.0007 => 0.0012, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 1.88% (0.1438 => 0.1465, std.dev.: 0.0043) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.20% (1.1329 => 1.1352, std.dev.: 0.0641) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.34% (0.1462 => 0.1467, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.22% (0.4164 => 0.4113, std.dev.: 0.0237) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.92% (0.1369 => 0.1409, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.47% (0.0641 => 0.0644, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.03% (0.0195 => 0.0193, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.87% (0.0578 => 0.0573, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.30% (1.1437 => 1.1929, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 700.00% (0.0001 => 0.0008, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0014 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.71% (0.0627 => 0.0644, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.89% (0.0180 => 0.0268) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.01% (0.8017 => 0.7776, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 19.35% (0.0062 => 0.0074, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 12:18:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 14:18:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121109201841.E061A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5718?compare_to=5716&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5718, Order: 167621, Start Time: 2012-11-09 18:53:55, End Time: 2012-11-09 20:18:53 To: 5716, Order: 167618, Start Time: 2012-11-09 17:05:13, End Time: 2012-11-09 18:30:46 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (184 on baseline) Unchanged Tests: 1042 (854 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.20% (2.0478 => 2.1133, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/salsa20: 2.49% (7.4937 => 7.6805, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/hash2: 2.21% (3.1932 => 3.2637, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.75% (0.3821 => 0.3525, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -7.73% (2.4924 => 2.2998, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: -7.21% (0.3357 => 0.3115, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.04% (0.2428 => 0.2257, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.01% (3.5339 => 3.2863, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.94% (0.3658 => 0.3404, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -6.85% (0.2160 => 0.2012, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.84% (0.9542 => 0.8889, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.84% (0.3142 => 0.2927, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.82% (0.1584 => 0.1476, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -6.79% (4.3330 => 4.0390, std.dev.: 0.0075) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.76% (22.4056 => 20.8914, std.dev.: 0.0085) MultiSource/Applications/Burg/burg: -6.72% (1.2515 => 1.1674, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: -6.70% (0.1761 => 0.1643, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.69% (0.9852 => 0.9193, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -6.68% (16.1920 => 15.1096, std.dev.: 0.0183) MultiSource/Applications/JM/ldecod/ldecod: -6.64% (7.0961 => 6.6249, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.62% (1.0544 => 0.9846, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.60% (0.6484 => 0.6056, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -6.60% (9.2283 => 8.6192, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: -6.58% (0.2659 => 0.2484, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.55% (0.2548 => 0.2381, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -6.53% (0.2985 => 0.2790, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.51% (1.6474 => 1.5402, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.47% (0.1716 => 0.1605, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.46% (1.3722 => 1.2836, std.dev.: 0.0010) MultiSource/Applications/siod/siod: -6.45% (2.4021 => 2.2472, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.44% (4.0323 => 3.7728, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.41% (4.5069 => 4.2178, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/exceptions-4: -6.39% (0.3880 => 0.3632, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.39% (0.7919 => 0.7413, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -6.37% (0.3812 => 0.3569, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.35% (4.8161 => 4.5103, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.35% (0.1796 => 0.1682, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.34% (0.6736 => 0.6309, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.34% (1.2784 => 1.1974, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.33% (0.2355 => 0.2206, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.33% (1.2300 => 1.1522, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.31% (6.7716 => 6.3442, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.31% (0.6293 => 0.5896, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -6.30% (0.9179 => 0.8601, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -6.30% (1.1450 => 1.0729, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.29% (0.1621 => 0.1519, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -6.28% (0.1879 => 0.1761, std.dev.: 0.0010) MultiSource/Applications/lua/lua: -6.27% (4.0594 => 3.8047, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions: -6.27% (0.4176 => 0.3914, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.26% (0.3831 => 0.3591, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -6.26% (0.4199 => 0.3936, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -6.26% (0.3896 => 0.3652, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.26% (0.3884 => 0.3641, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.26% (1.4642 => 1.3726, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: -6.25% (0.4033 => 0.3781, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.24% (0.3848 => 0.3608, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.20% (0.2695 => 0.2528, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -6.17% (0.3581 => 0.3360, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.17% (4.8802 => 4.5791, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.17% (0.3891 => 0.3651, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: -6.15% (1.1530 => 1.0821, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.15% (1.6364 => 1.5358, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.13% (0.7524 => 0.7063, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.12% (0.3483 => 0.3270, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.12% (0.5478 => 0.5143, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: -6.11% (0.4515 => 0.4239, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: -6.11% (0.3406 => 0.3198, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -6.10% (0.4280 => 0.4019, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.09% (2.2587 => 2.1212, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: -6.08% (15.5079 => 14.5648, std.dev.: 0.0151) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.04% (0.4916 => 0.4619, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.03% (0.5857 => 0.5504, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.03% (5.4682 => 5.1387, std.dev.: 0.0224) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.02% (0.8521 => 0.8008, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.00% (0.5863 => 0.5511, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -5.96% (0.7447 => 0.7003, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.96% (0.5591 => 0.5258, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.93% (0.4151 => 0.3905, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -5.92% (18.2933 => 17.2105, std.dev.: 0.0034) MultiSource/Applications/treecc/treecc: -5.91% (2.1401 => 2.0136, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.90% (0.3931 => 0.3699, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.90% (0.6052 => 0.5695, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.90% (0.5849 => 0.5504, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.88% (0.5575 => 0.5247, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.88% (0.2278 => 0.2144, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.87% (0.6230 => 0.5864, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.87% (0.2999 => 0.2823, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.87% (0.3323 => 0.3128, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: -5.86% (0.4861 => 0.4576, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.86% (0.5805 => 0.5465, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -5.86% (1.3148 => 1.2378, std.dev.: 0.0119) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.85% (0.3319 => 0.3125, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.84% (0.5581 => 0.5255, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.84% (0.5925 => 0.5579, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.83% (14.2083 => 13.3799, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.83% (0.6194 => 0.5833, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.82% (0.6304 => 0.5937, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.82% (0.5570 => 0.5246, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.82% (0.6189 => 0.5829, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.81% (0.6297 => 0.5931, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.81% (0.6676 => 0.6288, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.81% (0.7021 => 0.6613, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -5.80% (34.0927 => 32.1142, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.80% (0.6446 => 0.6072, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: -5.80% (17.1032 => 16.1111, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -5.80% (0.7982 => 0.7519, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.79% (0.3849 => 0.3626, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.79% (0.7339 => 0.6914, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.78% (0.5999 => 0.5652, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.77% (0.6667 => 0.6282, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.77% (0.5168 => 0.4870, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.76% (0.5802 => 0.5468, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.74% (0.5329 => 0.5023, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.73% (0.6260 => 0.5901, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.73% (0.5859 => 0.5523, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -5.72% (0.3025 => 0.2852, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.72% (2.1713 => 2.0472, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.71% (0.5941 => 0.5602, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.71% (0.6660 => 0.6280, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.68% (0.6440 => 0.6074, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.68% (0.4083 => 0.3851, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.68% (0.5567 => 0.5251, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -5.67% (0.3194 => 0.3013, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.66% (0.5456 => 0.5147, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.66% (0.5569 => 0.5254, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: -5.66% (0.3271 => 0.3086, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.65% (0.6395 => 0.6034, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.64% (0.9557 => 0.9018, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.63% (0.3837 => 0.3621, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.63% (0.6395 => 0.6035, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: -5.63% (1.3864 => 1.3084, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.62% (0.4321 => 0.4078, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/matrix: -5.62% (0.3255 => 0.3072, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.62% (0.2385 => 0.2251, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/except: -5.62% (0.3026 => 0.2856, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.60% (0.2106 => 0.1988, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.60% (0.7198 => 0.6795, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.60% (8.0126 => 7.5640, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: -5.59% (0.2989 => 0.2822, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.57% (0.5705 => 0.5387, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -5.57% (0.3446 => 0.3254, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.57% (0.6033 => 0.5697, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -5.55% (3.5154 => 3.3204, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: -5.54% (0.2871 => 0.2712, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.54% (0.6681 => 0.6311, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.54% (0.3016 => 0.2849, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -5.53% (0.6750 => 0.6377, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -5.52% (0.3621 => 0.3421, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -5.51% (0.3394 => 0.3207, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -5.51% (0.4248 => 0.4014, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.50% (0.3252 => 0.3073, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.50% (1.2221 => 1.1549, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.46% (0.3057 => 0.2890, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: -5.46% (0.3059 => 0.2892, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -5.46% (0.3481 => 0.3291, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -5.46% (0.3867 => 0.3656, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -5.44% (0.2849 => 0.2694, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.44% (1.2210 => 1.1546, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/random: -5.41% (0.2939 => 0.2780, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.39% (0.3491 => 0.3303) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.37% (0.2903 => 0.2747, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.35% (0.4427 => 0.4190, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.32% (0.2933 => 0.2777, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.31% (0.5688 => 0.5386, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -5.31% (0.3788 => 0.3587) SingleSource/Benchmarks/Shootout-C++/wc: -5.27% (0.3205 => 0.3036, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -5.23% (15.2527 => 14.4544, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: -5.17% (0.8418 => 0.7983, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.05% (0.2001 => 0.1900, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -5.04% (0.4524 => 0.4296, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -5.00% (5.0226 => 4.7714, std.dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.80% (0.4813 => 0.4582, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.57% (0.9077 => 0.8662, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: -4.51% (0.7779 => 0.7428, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: -4.42% (0.6441 => 0.6156, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.41% (0.6347 => 0.6067, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -4.31% (1.5610 => 1.4937, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -2.53% (20.7746 => 20.2490, std.dev.: 0.0604) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7534, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1729, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.81% (2.2633 => 2.1770, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4740, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.02% (3.2107 => 3.1781, std.dev.: 0.0005) Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 13:49:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 15:49:08 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121109214908.9C4C52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5719?compare_to=5714&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5719, Order: 167620, Start Time: 2012-11-09 18:33:33, End Time: 2012-11-09 21:49:20 To: 5714, Order: 167613, Start Time: 2012-11-09 14:29:54, End Time: 2012-11-09 17:45:27 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (170 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (721 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.97% (124.4852 => 130.6692, std.dev.: 0.5688) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.12% (0.0625 => 0.0882, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.17% (0.1063 => 0.1405, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.56% (0.4253 => 0.5340, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.53% (0.2969 => 0.3727, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.23% (0.1106 => 0.1385, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.72% (0.4139 => 0.5162, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.97% (0.0584 => 0.0724, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 23.72% (1.5932 => 1.9711, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.53% (0.0714 => 0.0882, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.31% (0.4994 => 0.6158, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.29% (0.5900 => 0.7274, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.85% (0.0547 => 0.0672, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.64% (0.5000 => 0.6132, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.74% (0.0897 => 0.1092, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 21.54% (0.0599 => 0.0728, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.35% (0.1021 => 0.1239, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.17% (0.1620 => 0.1963, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.05% (0.1107 => 0.1340, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 20.78% (0.0948 => 0.1145, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.20% (0.1604 => 0.1928, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.06% (0.0633 => 0.0760) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.03% (0.0584 => 0.0701, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.96% (0.0541 => 0.0649, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.85% (0.1103 => 0.1322, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.81% (0.3903 => 0.4676, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.78% (0.0642 => 0.0769, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 19.73% (0.0821 => 0.0983, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 19.58% (0.1619 => 0.1936, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 19.54% (0.0604 => 0.0722, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.50% (0.1549 => 0.1851, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.44% (0.1003 => 0.1198, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.34% (0.0822 => 0.0981, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 19.07% (0.5826 => 0.6937, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.81% (0.1462 => 0.1737, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 18.80% (0.5889 => 0.6996, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 18.69% (0.0808 => 0.0959, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.59% (0.0947 => 0.1123, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.38% (0.0582 => 0.0689, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.35% (0.2736 => 0.3238, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.10% (0.3890 => 0.4594, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.04% (0.2866 => 0.3383, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.83% (0.2014 => 0.2373, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 17.65% (0.1218 => 0.1433, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 17.32% (0.4029 => 0.4727, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.28% (0.1088 => 0.1276, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 17.28% (0.1505 => 0.1765, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.15% (1.3152 => 1.5408, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.02% (0.2738 => 0.3204, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.01% (0.2875 => 0.3364, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.69% (0.3271 => 0.3817, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 16.68% (0.5546 => 0.6471, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/gs/gs: 16.60% (1.8794 => 2.1913, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.57% (0.1968 => 0.2294, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.52% (3.5627 => 4.1513, std.dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference: 16.51% (0.7171 => 0.8355, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.49% (0.4658 => 0.5426, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/fibo: 16.40% (0.2725 => 0.3172, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.35% (0.5026 => 0.5848, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 16.32% (0.2714 => 0.3157, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.31% (0.2729 => 0.3174, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/strcat: 16.22% (0.2750 => 0.3196, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 16.17% (0.9697 => 1.1265, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 16.12% (0.2823 => 0.3278, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.11% (0.2911 => 0.3380, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 16.10% (0.2813 => 0.3266, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.05% (1.6211 => 1.8813, std.dev.: 0.0030) SingleSource/Regression/C++/ofstream_ctor: 16.05% (0.3004 => 0.3486, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/matrix: 16.04% (0.2780 => 0.3226, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.03% (0.4361 => 0.5060, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 15.98% (0.2803 => 0.3251, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.97% (0.2792 => 0.3238, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.95% (0.1160 => 0.1345, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 15.94% (0.2811 => 0.3259, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.93% (0.3195 => 0.3704, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 15.88% (1.0781 => 1.2493, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wc: 15.76% (0.3096 => 0.3584, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 15.69% (0.1421 => 0.1644, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 15.63% (0.9909 => 1.1458, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.62% (0.3930 => 0.4544, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.62% (2.0673 => 2.3902, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: 15.50% (0.1284 => 0.1483, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.43% (4.4195 => 5.1013, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 15.21% (0.3267 => 0.3764, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 15.20% (23.5202 => 27.0946, std.dev.: 0.0101) MultiSource/Applications/ClamAV/clamscan: 15.15% (4.2109 => 4.8490, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.07% (0.3060 => 0.3521, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 15.01% (0.3258 => 0.3747, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.95% (0.1090 => 0.1253, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 14.95% (0.3317 => 0.3813, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.93% (0.3362 => 0.3864, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.88% (2.7292 => 3.1354, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.63% (0.3124 => 0.3581, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.55% (1.9694 => 2.2559, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.53% (0.3282 => 0.3759, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 14.52% (0.3348 => 0.3834, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 14.51% (0.2075 => 0.2376, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 14.46% (0.3678 => 0.4210, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.40% (0.3625 => 0.4147, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 14.40% (0.4146 => 0.4743, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.36% (1.9966 => 2.2834, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/sieve: 14.22% (0.3726 => 0.4256, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 14.15% (0.3477 => 0.3969, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.15% (0.3845 => 0.4389, std.dev.: 0.0048) MultiSource/Benchmarks/nbench/nbench: 14.15% (0.2566 => 0.2929, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.92% (0.3981 => 0.4535, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.90% (0.3496 => 0.3982, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 13.86% (0.4251 => 0.4840, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.82% (0.3690 => 0.4200, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.73% (0.3488 => 0.3967, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.67% (0.3446 => 0.3917, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.65% (0.3465 => 0.3938, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.60% (0.3442 => 0.3910, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.58% (0.3460 => 0.3930, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.58% (0.3469 => 0.3940, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 13.57% (1.4269 => 1.6206, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 13.40% (0.3650 => 0.4139, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.40% (0.3643 => 0.4131, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 13.37% (0.7875 => 0.8928, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/parameter-passing: 13.29% (0.3724 => 0.4219, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 13.00% (2.1653 => 2.4468, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 12.99% (0.5012 => 0.5663, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 12.61% (4.6177 => 5.2000, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.58% (0.1383 => 0.1557) MultiSource/Benchmarks/mafft/pairlocalalign: 12.49% (2.1013 => 2.3638, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.30% (0.2040 => 0.2291, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.97% (0.6435 => 0.7205, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 11.97% (0.2691 => 0.3013, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.85% (0.2068 => 0.2313, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 11.64% (5.5417 => 6.1867, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.99% (0.1028 => 0.1141, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 10.92% (0.3498 => 0.3880, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.81% (0.2737 => 0.3033, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 10.71% (0.4847 => 0.5366, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 10.55% (0.6634 => 0.7334, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.34% (0.3084 => 0.3403, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.01% (0.3336 => 0.3670, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 9.56% (2.0346 => 2.2292, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.46% (0.2103 => 0.2302, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 9.37% (0.2391 => 0.2615, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.49% (4.6926 => 5.0910, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.34% (11.6398 => 12.6105, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.26% (0.5361 => 0.5804, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.69% (0.7426 => 0.7997) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.58% (0.5584 => 0.6007, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 6.71% (11.9555 => 12.7573, std.dev.: 0.0101) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.48% (0.3792 => 0.3962, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 9.74% (0.2802 => 0.3075, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6109, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.22% (12.0509 => 12.6795, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-2: 4.79% (1.8057 => 1.8922, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 4.73% (15.4430 => 16.1738, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: 4.28% (14.0481 => 14.6494, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.87% (0.3693 => 0.3836, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1935, std.dev.: 0.0095) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.54% (3.1722 => 3.2211, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.47% (7.1849 => 7.2907, std.dev.: 0.0032) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3070, std.dev.: 0.0123) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5879, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5689, std.dev.: 0.0067) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9766, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8026, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9576, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: -6.08% (0.2402 => 0.2256, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.53% (11.2080 => 10.8118, std.dev.: 0.0066) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7743, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5191, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -2.68% (17.2379 => 16.7764, std.dev.: 0.0909) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8572, std.dev.: 0.0106) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5745, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.62% (0.6293 => 0.6191, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4957, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.26% (105.3826 => 104.0552, std.dev.: 0.0962) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0449, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 13:52:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 15:52:23 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121109215224.00B9B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5720?compare_to=5717&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5720, Order: 167631, Start Time: 2012-11-09 20:25:31, End Time: 2012-11-09 21:52:36 To: 5717, Order: 167621, Start Time: 2012-11-09 18:32:49, End Time: 2012-11-09 19:59:37 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 16 (91 on baseline) Performance Improvements: 1 (23 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 974 (860 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.18% (0.2356 => 0.2478, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.06% (0.8414 => 0.8756, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.04% (0.3365 => 0.3501, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.59% (0.8923 => 0.9243, std.dev.: 0.0106) SingleSource/UnitTests/Vector/constpool: 3.30% (8.2081 => 8.4789, std.dev.: 0.0399) MultiSource/Benchmarks/McCat/05-eks/eks: 3.06% (0.4472 => 0.4609, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/football/football: 2.10% (0.8845 => 0.9031, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.92% (1.6755 => 1.7077, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.74% (1.2600 => 1.2819, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.73% (1.2115 => 1.2324, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.55% (1.2742 => 1.2940, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.69% (6.7688 => 7.3568, std.dev.: 0.1981) MultiSource/Benchmarks/Olden/bisort/bisort: 7.50% (0.6428 => 0.6910, std.dev.: 0.0136) SingleSource/Benchmarks/Stanford/Puzzle: 6.75% (0.1616 => 0.1725, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.96% (21.6346 => 22.2740, std.dev.: 0.1734) SingleSource/Benchmarks/Shootout/methcall: 1.06% (8.1853 => 8.2719, std.dev.: 0.0106) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/lists: -1.16% (16.8853 => 16.6887, std.dev.: 0.0613) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.47% (16.6709 => 16.7500, std.dev.: 0.2890) MultiSource/Applications/obsequi/Obsequi: 1.43% (1.0575 => 1.0726, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.16% (21.6623 => 21.6286, std.dev.: 0.1847) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.14% (0.3665 => 0.3670, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 0.15% (0.6042 => 0.6051, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: -1.22% (0.3374 => 0.3333, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/strcat: 0.05% (0.2011 => 0.2012, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.92% (0.0218 => 0.0220, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0427 => 0.0426, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.30% (0.0333 => 0.0332, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0315 => 0.0315, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 3.89% (0.0411 => 0.0427, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0204 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0218 => 0.0218, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 8.33% (0.0012 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.61% (0.1465 => 0.1474, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: 1.00% (1.1352 => 1.1466, std.dev.: 0.0278) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.16% (0.1467 => 0.1406, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.29% (0.4113 => 0.4060, std.dev.: 0.0278) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.64% (0.1409 => 0.1400, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.86% (0.0644 => 0.0656, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.45% (0.0193 => 0.0273, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.14% (0.0573 => 0.0555, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.60% (1.1929 => 1.2001, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 287.50% (0.0008 => 0.0031, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 271.43% (0.0007 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.16% (0.0644 => 0.0645, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.24% (0.0268 => 0.0262, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.72% (0.7776 => 0.7720, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -33.78% (0.0074 => 0.0049, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2303.08% (0.6332 => 15.2163, std.dev.: 0.3329) MultiSource/Benchmarks/McCat/08-main/main: 49.04% (0.1831 => 0.2729, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.13% (0.1559 => 0.1479, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1484.15% (0.3344 => 5.2974, std.dev.: 0.1010) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.10% (0.2364 => 0.3241, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: 4.20% (0.0429 => 0.0447, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.14% (0.0224 => 0.0240, std.dev.: 0.0021) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4237, std.dev.: 0.0119) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0707, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4948, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3472, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1599, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4078, std.dev.: 0.0048) SingleSource/Regression/C/uint64_to_float: -24.32% (2.1832 => 1.6523, std.dev.: 0.0088) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0008) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.02% (0.0810 => 0.0956, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/tsp/tsp: 15.74% (0.1112 => 0.1287, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.08% (0.8321 => 0.9243, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.73% (0.2279 => 0.2478, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.17% (0.2180 => 0.2358, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.46% (0.8148 => 0.8756, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.35% (0.6010 => 0.6452, std.dev.: 0.0082) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.66% (0.3137 => 0.3346, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.46% (0.7473 => 0.7956, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.31% (0.2519 => 0.2678, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.25% (0.3295 => 0.3501, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/em3d/em3d: 6.22% (0.1721 => 0.1828, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.19% (1.1606 => 1.2324, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.84% (0.4847 => 0.5130, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.67% (0.1905 => 0.2013, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.45% (0.5961 => 0.6286, std.dev.: 0.0112) MultiSource/Applications/spiff/spiff: 5.08% (0.7950 => 0.8354, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.04% (0.6287 => 0.6604, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/05-eks/eks: 4.82% (0.4397 => 0.4609, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.77% (0.9435 => 0.9885, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.56% (1.1685 => 1.2218, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.22% (1.6386 => 1.7077, std.dev.: 0.0103) MultiSource/Applications/sgefa/sgefa: 4.17% (0.2999 => 0.3124, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.14% (1.3279 => 1.3829, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/bh/bh: 3.92% (0.2985 => 0.3102, std.dev.: 0.0025) MultiSource/Applications/treecc/treecc: 3.70% (1.9948 => 2.0686, std.dev.: 0.0212) MultiSource/Applications/lua/lua: 3.63% (3.8189 => 3.9575, std.dev.: 0.0303) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.59% (0.5817 => 0.6026, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.58% (0.2794 => 0.2894, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.45% (0.4783 => 0.4948, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/gs/gs: 3.43% (4.1305 => 4.2720, std.dev.: 0.0424) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.31% (1.2526 => 1.2940, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.29% (1.4479 => 1.4956, std.dev.: 0.0108) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.25% (6.6074 => 6.8224, std.dev.: 0.0636) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.20% (0.4127 => 0.4259, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.17% (0.8331 => 0.8595, std.dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: 3.16% (14.7684 => 15.2345, std.dev.: 0.1780) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.14% (4.1763 => 4.3076, std.dev.: 0.0397) MultiSource/Applications/SPASS/SPASS: 3.11% (14.2605 => 14.7041, std.dev.: 0.1508) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.06% (0.3657 => 0.3769, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.03% (1.1271 => 1.1613, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/football/football: 3.00% (0.8768 => 0.9031, std.dev.: 0.0037) MultiSource/Applications/JM/ldecod/ldecod: 2.93% (6.7320 => 6.9291, std.dev.: 0.0678) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.87% (0.9069 => 0.9329, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.76% (0.8697 => 0.8937, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.67% (0.9688 => 0.9947, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.57% (0.7932 => 0.8136, std.dev.: 0.0067) MultiSource/Applications/lambda-0_1_3/lambda: 2.55% (0.7557 => 0.7750, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.53% (0.8457 => 0.8671, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.46% (4.4873 => 4.5976, std.dev.: 0.0395) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.30% (0.8927 => 0.9132, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.29% (1.1170 => 1.1426, std.dev.: 0.0089) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.27% (4.4880 => 4.5897, std.dev.: 0.0362) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.24% (4.5702 => 4.6725, std.dev.: 0.0258) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.24% (0.8712 => 0.8907, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.22% (0.8885 => 0.9082, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.19% (0.8716 => 0.8907, std.dev.: 0.0073) MultiSource/Benchmarks/Bullet/bullet: 2.10% (31.8598 => 32.5287, std.dev.: 0.0696) MultiSource/Benchmarks/mafft/pairlocalalign: 1.88% (8.6247 => 8.7872, std.dev.: 0.0330) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.72% (1.2602 => 1.2819, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 93.97% (0.0199 => 0.0386, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/pi: 57.12% (1.5795 => 2.4817, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.74% (0.7597 => 0.8869, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.37% (2.9753 => 3.4623, std.dev.: 0.0273) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 15.36% (6.3772 => 7.3568, std.dev.: 0.1981) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.51% (2.7995 => 3.2057, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.63% (5.0261 => 5.6105, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.85% (1.1857 => 1.2788, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/queens: 7.18% (1.7056 => 1.8281, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.94% (4.7794 => 5.1109, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: 6.73% (1.3037 => 1.3914, std.dev.: 0.0131) MultiSource/Applications/SIBsim4/SIBsim4: 6.32% (3.1873 => 3.3887, std.dev.: 0.0238) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.88% (4.5327 => 4.7994, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.81% (4.9686 => 5.2571, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.68% (3.3761 => 3.5342, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.55% (6.2275 => 6.5109, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.47% (4.9453 => 5.1665, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.11% (4.9469 => 5.1503, std.dev.: 0.0159) MultiSource/Applications/hexxagon/hexxagon: 3.91% (14.0064 => 14.5535, std.dev.: 0.0089) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.49% (1.2337 => 1.2768, std.dev.: 0.0060) MultiSource/Applications/siod/siod: 2.75% (3.6643 => 3.7652, std.dev.: 0.0079) MultiSource/Applications/lambda-0_1_3/lambda: 2.62% (7.4933 => 7.6897, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.60% (11.5690 => 11.8701, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.57% (8.2783 => 8.4912, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/lists: 2.43% (7.3375 => 7.5159, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.33% (4.8362 => 4.9489, std.dev.: 0.0055) MultiSource/Benchmarks/BitBench/five11/five11: 1.60% (5.6030 => 5.6926, std.dev.: 0.0200) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.44% (2.4647 => 2.5001, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: 1.32% (1.0841 => 1.0984, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 1.21% (2.3560 => 2.3846, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.04% (1.5941 => 1.6106, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.77% (5.4641 => 4.3293, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.65% (7.2130 => 6.2286, std.dev.: 0.3236) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.80% (1.0512 => 0.9377, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: -10.79% (1.1216 => 1.0006, std.dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: -8.57% (63.1822 => 57.7662, std.dev.: 0.1550) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.90% (4.7482 => 4.4206, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.15% (0.3269 => 0.3068, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.00% (3.7148 => 3.4920, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.00% (5.4972 => 5.1676, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.08% (5.1557 => 4.8940, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.34% (4.7449 => 4.5392, std.dev.: 0.0112) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.10% (2.8773 => 2.7593, std.dev.: 0.0272) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.05% (2.4490 => 2.3497, std.dev.: 0.0368) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.69% (6.0224 => 5.8004, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.13% (0.5807 => 0.5625, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.99% (28.5821 => 27.7278, std.dev.: 0.0123) MultiSource/Applications/aha/aha: -2.78% (3.3398 => 3.2470, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.74% (9.9065 => 9.6350, std.dev.: 0.0844) SingleSource/Benchmarks/Shootout-C++/hash2: -2.44% (3.4237 => 3.3400, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.05% (11.5316 => 11.2953, std.dev.: 0.0109) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.68% (2.3487 => 2.3092, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.68% (3.2169 => 3.1628, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.53% (4.9994 => 4.9228, std.dev.: 0.0050) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.85% (16.4461 => 16.7500, std.dev.: 0.2890) MultiSource/Applications/obsequi/Obsequi: 4.52% (1.0262 => 1.0726, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6825.58% (0.3123 => 21.6286, std.dev.: 0.1847) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.01% (0.2463 => 0.3670, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 0.68% (0.6010 => 0.6051, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.05% (0.3266 => 0.3333, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/strcat: 2.18% (0.1969 => 0.2012, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.20% (0.0384 => 0.0427, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.50% (0.1438 => 0.1474, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: 1.21% (1.1329 => 1.1466, std.dev.: 0.0278) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.83% (0.1462 => 0.1406, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.50% (0.4164 => 0.4060, std.dev.: 0.0278) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.26% (0.1369 => 0.1400, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.34% (0.0641 => 0.0656, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 40.00% (0.0195 => 0.0273, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.98% (0.0578 => 0.0555, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.93% (1.1437 => 1.2001, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.87% (0.0627 => 0.0645, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 45.56% (0.0180 => 0.0262, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.70% (0.8017 => 0.7720, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -20.97% (0.0062 => 0.0049, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 14:08:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 16:08:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121109220841.674132A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5721?compare_to=5718&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5721, Order: 167632, Start Time: 2012-11-09 20:44:12, End Time: 2012-11-09 22:08:49 To: 5718, Order: 167621, Start Time: 2012-11-09 18:53:55, End Time: 2012-11-09 20:18:53 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 1 (181 on baseline) Unchanged Tests: 1041 (857 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.91% (1.3015 => 1.2767, std.dev.: 0.0073) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.55% (2.0478 => 2.1001, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: 2.48% (7.4937 => 7.6798, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/hash2: 2.32% (3.1932 => 3.2674, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.08% (0.1431 => 0.1301, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -8.08% (2.4924 => 2.2910, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.88% (0.3821 => 0.3520, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.16% (0.9542 => 0.8859, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -7.09% (0.3357 => 0.3119, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.96% (0.2428 => 0.2259, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.91% (0.3142 => 0.2925, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.81% (22.4056 => 20.8805, std.dev.: 0.0149) MultiSource/Applications/JM/lencod/lencod: -6.73% (16.1920 => 15.1019, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.70% (0.9852 => 0.9192, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.67% (0.3658 => 0.3414, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -6.67% (7.0961 => 6.6230, std.dev.: 0.0205) MultiSource/Benchmarks/mafft/pairlocalalign: -6.65% (9.2283 => 8.6144, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: -6.61% (4.3330 => 4.0465, std.dev.: 0.0120) MultiSource/Applications/Burg/burg: -6.61% (1.2515 => 1.1688, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/chomp: -6.59% (0.1761 => 0.1645, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/oourafft: -6.57% (0.2160 => 0.2018, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.57% (0.1796 => 0.1678, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.55% (3.5339 => 3.3026, std.dev.: 0.0189) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.53% (0.1716 => 0.1604, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: -6.53% (0.9179 => 0.8580, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: -6.49% (1.1450 => 1.0707, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.44% (1.4642 => 1.3699, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: -6.43% (0.2985 => 0.2793, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.40% (0.6484 => 0.6069, std.dev.: 0.0021) MultiSource/Applications/siod/siod: -6.40% (2.4021 => 2.2484, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -6.39% (0.1879 => 0.1759, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.38% (0.7919 => 0.7414, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.36% (1.3722 => 1.2849, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: -6.36% (0.2659 => 0.2490, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.33% (4.5069 => 4.2217, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/trivial-interface: -6.32% (0.3812 => 0.3571, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.32% (0.3831 => 0.3589, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.32% (1.0544 => 0.9878, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.29% (1.2300 => 1.1526, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: -6.29% (0.3880 => 0.3636, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.28% (0.2548 => 0.2388, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.27% (0.3891 => 0.3647, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: -6.26% (0.3848 => 0.3607, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -6.26% (1.1530 => 1.0808, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: -6.24% (0.3896 => 0.3653, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.23% (0.4176 => 0.3916, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.22% (0.4033 => 0.3782, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.22% (4.0323 => 3.7815, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.21% (4.8802 => 4.5769, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.21% (1.6364 => 1.5348, std.dev.: 0.0025) MultiSource/Applications/lua/lua: -6.21% (4.0594 => 3.8075, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.20% (1.2784 => 1.1991, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.20% (0.2355 => 0.2209, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.18% (0.3884 => 0.3644, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: -6.17% (0.4199 => 0.3940, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -6.16% (15.5079 => 14.5523, std.dev.: 0.0081) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.16% (0.2695 => 0.2529, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.13% (0.6293 => 0.5907, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.12% (4.8161 => 4.5214, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/parameter-passing: -6.10% (0.4280 => 0.4019, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.09% (0.3483 => 0.3271, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -6.08% (0.3406 => 0.3199, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -6.06% (0.7447 => 0.6996, std.dev.: 0.0111) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.03% (6.7716 => 6.3631, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.98% (5.4682 => 5.1414, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.97% (1.6474 => 1.5491, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -5.96% (18.2933 => 17.2031, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.95% (0.4151 => 0.3904, std.dev.: 0.0047) MultiSource/Applications/SIBsim4/SIBsim4: -5.94% (1.3864 => 1.3041, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: -5.91% (0.4515 => 0.4248, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.91% (0.6736 => 0.6338, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: -5.89% (17.1032 => 16.0966, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.85% (0.5859 => 0.5516, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -5.84% (2.1401 => 2.0151, std.dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.84% (0.4916 => 0.4629, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.83% (0.8521 => 0.8024, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.83% (14.2083 => 13.3796, std.dev.: 0.0137) MultiSource/Applications/d/make_dparser: -5.81% (3.5154 => 3.3111, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.80% (0.2999 => 0.2825, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.80% (0.5999 => 0.5651, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.79% (0.7524 => 0.7088, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -5.79% (0.7982 => 0.7520, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.78% (0.7339 => 0.6915, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.76% (0.6667 => 0.6283, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.75% (0.3931 => 0.3705, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.75% (0.5168 => 0.4871, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.74% (0.6660 => 0.6278, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -5.73% (1.3148 => 1.2394, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.72% (2.2587 => 2.1294, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.71% (0.5705 => 0.5379, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.71% (0.5863 => 0.5528, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.71% (0.6304 => 0.5944, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.71% (0.6395 => 0.6030, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: -5.70% (0.4861 => 0.4584, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.70% (0.7021 => 0.6621, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.69% (0.5925 => 0.5588, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.69% (0.5857 => 0.5524, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.68% (0.6052 => 0.5708, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.67% (0.6260 => 0.5905, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.67% (0.5802 => 0.5473, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.67% (0.4321 => 0.4076, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.65% (0.2106 => 0.1987, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.65% (0.6446 => 0.6082, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.63% (0.5329 => 0.5029, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.63% (0.5581 => 0.5267, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.62% (0.5849 => 0.5520, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.60% (0.5478 => 0.5171, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.60% (0.3319 => 0.3133, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/methcall: -5.59% (0.3025 => 0.2856, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.59% (0.3849 => 0.3634, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.58% (0.7198 => 0.6796, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.58% (0.6681 => 0.6308, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.56% (0.6440 => 0.6082, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.56% (0.6676 => 0.6305, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -5.55% (0.4524 => 0.4273, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.53% (0.2278 => 0.2152, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.51% (0.5569 => 0.5262, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.51% (0.6189 => 0.5848, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.50% (0.5941 => 0.5614, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.50% (2.1713 => 2.0518, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.48% (8.0126 => 7.5733, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/objinst: -5.48% (0.3194 => 0.3019, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.48% (0.6297 => 0.5952, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.48% (0.3323 => 0.3141, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.47% (0.3837 => 0.3627, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.47% (0.6395 => 0.6045, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.47% (0.9557 => 0.9034, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.47% (0.5688 => 0.5377, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: -5.46% (0.4248 => 0.4016, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.46% (0.5591 => 0.5286, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.44% (0.5567 => 0.5264, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.44% (0.6230 => 0.5891, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.44% (0.6194 => 0.5857, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.43% (0.5456 => 0.5160, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.42% (0.5570 => 0.5268, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.40% (1.2221 => 1.1561, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.40% (0.5575 => 0.5274, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.39% (0.5805 => 0.5492, std.dev.: 0.0110) MultiSource/Benchmarks/McCat/18-imp/imp: -5.39% (0.3581 => 0.3388, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -5.39% (0.3026 => 0.2863, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.39% (0.3491 => 0.3303, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -5.38% (0.3271 => 0.3095, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.37% (0.2385 => 0.2257, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.36% (1.2210 => 1.1555, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: -5.35% (0.3255 => 0.3081, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -5.32% (0.6750 => 0.6391, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -5.31% (34.0927 => 32.2837, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/lists: -5.27% (0.3621 => 0.3430, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.27% (0.3016 => 0.2857, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -5.27% (15.2527 => 14.4491, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.27% (0.4083 => 0.3868, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.26% (0.4427 => 0.4194, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.25% (0.6033 => 0.5716, std.dev.: 0.0040) MultiSource/Applications/spiff/spiff: -5.25% (0.8418 => 0.7976, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.24% (0.2903 => 0.2751, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -5.23% (0.3059 => 0.2899, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -5.23% (0.3481 => 0.3299, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.23% (0.3252 => 0.3082, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.22% (0.4813 => 0.4562, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: -5.21% (0.2939 => 0.2786, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -5.17% (0.3867 => 0.3667, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.17% (0.3057 => 0.2899, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.15% (0.2871 => 0.2723, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.15% (0.2933 => 0.2782, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hello: -5.09% (0.2849 => 0.2704, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: -5.05% (0.2989 => 0.2838, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -5.02% (0.3788 => 0.3598, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -4.99% (0.3205 => 0.3045, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.98% (5.0226 => 4.7724, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary3: -4.96% (0.3446 => 0.3275, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -4.89% (0.3394 => 0.3228, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -4.47% (1.5610 => 1.4913, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: -4.32% (0.6347 => 0.6073, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -4.24% (0.6441 => 0.6168, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -4.23% (0.7779 => 0.7450, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.05% (0.9077 => 0.8709, std.dev.: 0.0049) SingleSource/UnitTests/Vector/constpool: -2.97% (20.7746 => 20.1574, std.dev.: 0.0122) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.48% (7.5137 => 5.7493, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/richards_benchmark: -8.68% (1.2842 => 1.1727, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.88% (2.2633 => 2.1754, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.51% (1.3096 => 1.2767, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4713, std.dev.: 0.0022) Report Time: 3.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 15:35:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 17:35:16 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121109233516.C4BD12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5722?compare_to=5720&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5722, Order: 167635, Start Time: 2012-11-09 22:09:41, End Time: 2012-11-09 23:35:29 To: 5720, Order: 167631, Start Time: 2012-11-09 20:25:31, End Time: 2012-11-09 21:52:36 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 4 (105 on baseline) Performance Improvements: 14 (26 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 973 (843 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.52% (0.8347 => 0.8474, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 5.79% (3.0315 => 3.2071, std.dev.: 0.0451) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.10% (0.3342 => 0.3479, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.60% (1.1472 => 1.1656, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: -6.70% (0.1672 => 0.1560, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.00% (0.2678 => 0.2571, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -3.85% (0.8756 => 0.8419, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/hash: -2.60% (0.3845 => 0.3745, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.56% (0.9243 => 0.9006, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: -2.47% (0.4609 => 0.4495, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -2.39% (1.3829 => 1.3499, std.dev.: 0.0097) MultiSource/Applications/lambda-0_1_3/lambda: -1.86% (0.7750 => 0.7606, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.15% (1.2324 => 1.2182, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -8.40% (7.3568 => 6.7386, std.dev.: 0.2268) MultiSource/Benchmarks/Olden/bisort/bisort: -6.31% (0.6910 => 0.6474, std.dev.: 0.0042) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.33% (2.5198 => 2.4358, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/ft/ft: -2.67% (0.8887 => 0.8650, std.dev.: 0.0052) MultiSource/Benchmarks/llubenchmark/llu: -2.35% (2.0506 => 2.0025, std.dev.: 0.0051) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.42% (16.7500 => 16.8209, std.dev.: 0.1107) MultiSource/Applications/obsequi/Obsequi: -2.70% (1.0726 => 1.0436, std.dev.: 0.0230) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.17% (21.6286 => 21.6648, std.dev.: 0.2020) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.33% (0.3670 => 0.3658, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/bigfib: -0.30% (0.6051 => 0.6033, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.24% (0.3333 => 0.3325, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: -0.45% (0.2012 => 0.2003, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.91% (0.0220 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0426 => 0.0426, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.24% (0.0332 => 0.0298, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0315 => 0.0314, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.70% (0.0427 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0203 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -0.92% (0.0218 => 0.0216, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -1.70% (0.1474 => 0.1449, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: -100.00% (0.0001 => 0.0000) MultiSource/Applications/lemon/lemon: -0.31% (1.1466 => 1.1430, std.dev.: 0.0177) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.70% (0.1406 => 0.1458, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.15% (0.4060 => 0.4188, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.50% (0.1400 => 0.1379, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.93% (0.0656 => 0.0604, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -8.79% (0.0273 => 0.0249, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.90% (0.0555 => 0.0560, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.41% (1.2001 => 1.1952, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -74.19% (0.0031 => 0.0008, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -34.62% (0.0026 => 0.0017, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.68% (0.0645 => 0.0589, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.37% (0.0262 => 0.0206, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.98% (0.7720 => 0.7796, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -16.33% (0.0049 => 0.0041, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2314.06% (0.6332 => 15.2858, std.dev.: 0.1229) MultiSource/Benchmarks/McCat/08-main/main: 47.68% (0.1831 => 0.2704, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -10.20% (0.1559 => 0.1400, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1487.80% (0.3344 => 5.3096, std.dev.: 0.0237) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.59% (0.2364 => 0.3229, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: 3.73% (0.0429 => 0.0445, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.70% (0.0224 => 0.0239, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4303, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0733, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4897, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3450, std.dev.: 0.0168) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1320, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4093, std.dev.: 0.0060) SingleSource/Regression/C/uint64_to_float: -23.67% (2.1832 => 1.6664, std.dev.: 0.0096) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.42% (0.0810 => 0.0943, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 13.40% (0.1112 => 0.1261, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.23% (0.8321 => 0.9006, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.11% (0.2180 => 0.2335, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.40% (0.1905 => 0.2027, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.85% (0.7473 => 0.7910, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.61% (0.6010 => 0.6347, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.54% (0.2998 => 0.3164, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.27% (0.2279 => 0.2399, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.96% (1.1606 => 1.2182, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.87% (0.4847 => 0.5083, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.67% (0.3295 => 0.3449, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: 4.28% (1.4269 => 1.4879, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.98% (0.5961 => 0.6198, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.74% (1.2526 => 1.2994, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.54% (0.9435 => 0.9769, std.dev.: 0.0052) MultiSource/Applications/Burg/burg: 3.49% (1.2222 => 1.2649, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.47% (1.1685 => 1.2090, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.27% (0.8597 => 0.8878, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 3.03% (0.7950 => 0.8191, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.99% (0.8697 => 0.8957, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.90% (0.4559 => 0.4691, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.87% (0.9056 => 0.9316, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 2.83% (4.1305 => 4.2475, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.83% (0.9074 => 0.9331, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.77% (0.8457 => 0.8691, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.76% (0.9908 => 1.0181, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.75% (6.6074 => 6.7892, std.dev.: 0.0664) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.66% (4.4873 => 4.6066, std.dev.: 0.0065) MultiSource/Applications/SPASS/SPASS: 2.64% (14.2605 => 14.6372, std.dev.: 0.1039) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.64% (0.8611 => 0.8838, std.dev.: 0.0088) MultiSource/Applications/SIBsim4/SIBsim4: 2.63% (1.2568 => 1.2899, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.62% (0.9039 => 0.9276, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.58% (0.8261 => 0.8474, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 2.57% (3.8189 => 3.9172, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.54% (0.8007 => 0.8210, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.48% (0.9688 => 0.9928, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.43% (0.8518 => 0.8725, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.41% (0.8331 => 0.8532, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.40% (0.8177 => 0.8373, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.39% (0.8359 => 0.8559, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.38% (0.9069 => 0.9285, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.37% (0.8656 => 0.8861, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 2.36% (3.2366 => 3.3130, std.dev.: 0.0264) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.35% (0.8286 => 0.8481, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.35% (0.8338 => 0.8534, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.29% (0.8204 => 0.8392, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.28% (0.8716 => 0.8915, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.26% (0.8927 => 0.9129, std.dev.: 0.0072) MultiSource/Applications/ClamAV/clamscan: 2.24% (14.7684 => 15.0999, std.dev.: 0.1199) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.13% (0.8069 => 0.8241, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.13% (4.1763 => 4.2653, std.dev.: 0.0336) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.10% (0.8712 => 0.8895, std.dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: 2.02% (31.8598 => 32.5038, std.dev.: 0.1665) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.01% (0.8805 => 0.8982, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.00% (0.8855 => 0.9032, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.98% (0.8048 => 0.8207, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.96% (8.6476 => 8.8175, std.dev.: 0.0197) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.95% (0.8340 => 0.8503, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.92% (13.1811 => 13.4338, std.dev.: 0.0579) MultiSource/Applications/lemon/lemon: 1.88% (1.0945 => 1.1151, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.81% (0.8050 => 0.8196, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.75% (2.1401 => 2.1776, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.73% (0.8420 => 0.8566, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.67% (4.4880 => 4.5630, std.dev.: 0.0196) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.59% (0.6586 => 0.6691, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 1.57% (8.6247 => 8.7601, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.56% (0.7966 => 0.8090, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.55% (1.5315 => 1.5553, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.26% (3.1832 => 3.2233, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.17% (1.2602 => 1.2750, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 128.64% (0.0199 => 0.0455, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/pi: 57.09% (1.5795 => 2.4812, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.42% (2.9753 => 3.4638, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.34% (0.7597 => 0.8838, std.dev.: 0.0236) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.77% (2.7995 => 3.2130, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.63% (5.0261 => 5.6107, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.20% (0.3186 => 0.3479, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.07% (1.1857 => 1.2814, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/queens: 7.16% (1.7056 => 1.8278, std.dev.: 0.0056) MultiSource/Applications/SIBsim4/SIBsim4: 6.47% (3.1873 => 3.3936, std.dev.: 0.0221) SingleSource/Benchmarks/Misc/richards_benchmark: 6.31% (1.3037 => 1.3859, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.94% (4.5327 => 4.8018, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.92% (4.9686 => 5.2629, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.10% (3.0515 => 3.2071, std.dev.: 0.0451) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.78% (6.2275 => 6.5253, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.73% (3.3761 => 3.5358, std.dev.: 0.0237) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.51% (4.9453 => 5.1683, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.16% (4.9469 => 5.1529, std.dev.: 0.0201) MultiSource/Applications/hexxagon/hexxagon: 4.06% (14.0064 => 14.5744, std.dev.: 0.0053) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (1.2337 => 1.2710, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.89% (11.5690 => 11.9039, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.88% (8.2783 => 8.5164, std.dev.: 0.0219) SingleSource/Benchmarks/Dhrystone/dry: 2.87% (0.5081 => 0.5227, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 2.77% (7.4933 => 7.7009, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.75% (4.8660 => 4.9999, std.dev.: 0.0084) MultiSource/Applications/siod/siod: 2.69% (3.6643 => 3.7630, std.dev.: 0.0181) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.56% (1.1365 => 1.1656, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/lists: 2.49% (7.3375 => 7.5202, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/power/power: 1.53% (1.2061 => 1.2245, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 1.25% (8.5322 => 8.6386, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.18% (2.4647 => 2.4938, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.15% (1.4205 => 1.4369, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/bh/bh: 1.10% (2.3560 => 2.3818, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.07% (3.5679 => 3.6060, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.99% (5.4641 => 4.3174, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.63% (7.2130 => 6.1577, std.dev.: 0.2505) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.87% (1.0512 => 0.9369, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -8.55% (63.1822 => 57.7779, std.dev.: 0.0764) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.82% (4.7482 => 4.4246, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.39% (0.3269 => 0.3060, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.97% (3.7148 => 3.4930, std.dev.: 0.0656) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.84% (5.4972 => 5.1764, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.05% (5.1557 => 4.8952, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.34% (4.7449 => 4.5388, std.dev.: 0.0102) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.29% (2.8773 => 2.7539, std.dev.: 0.0222) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.85% (6.0224 => 5.7907, std.dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (28.5821 => 27.6946, std.dev.: 0.0203) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.70% (0.5807 => 0.5650, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.68% (2.4490 => 2.3833, std.dev.: 0.0153) MultiSource/Benchmarks/FreeBench/mason/mason: -2.53% (0.5415 => 0.5278, std.dev.: 0.0026) MultiSource/Applications/aha/aha: -2.48% (3.3398 => 3.2570, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/bisort/bisort: -2.44% (0.6636 => 0.6474, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash2: -2.25% (3.4237 => 3.3467, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.17% (11.5316 => 11.2812, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.14% (2.6356 => 2.5791, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.75% (9.9065 => 9.7329, std.dev.: 0.0468) MultiSource/Benchmarks/Ptrdist/ft/ft: -1.58% (0.8789 => 0.8650, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.57% (4.9994 => 4.9208, std.dev.: 0.0080) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.53% (2.3487 => 2.3128, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.19% (5.6343 => 5.5671, std.dev.: 0.0138) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.28% (16.4461 => 16.8209, std.dev.: 0.1107) MultiSource/Applications/obsequi/Obsequi: 1.70% (1.0262 => 1.0436, std.dev.: 0.0230) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6837.18% (0.3123 => 21.6648, std.dev.: 0.2020) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.52% (0.2463 => 0.3658, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/bigfib: 0.38% (0.6010 => 0.6033, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.81% (0.3266 => 0.3325, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: 1.73% (0.1969 => 0.2003, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 17.32% (0.0254 => 0.0298, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.76% (0.1438 => 0.1449, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.89% (1.1329 => 1.1430, std.dev.: 0.0177) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.27% (0.1462 => 0.1458, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.58% (0.4164 => 0.4188, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.73% (0.1369 => 0.1379, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.77% (0.0641 => 0.0604, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 27.69% (0.0195 => 0.0249, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.11% (0.0578 => 0.0560, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.50% (1.1437 => 1.1952, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 700.00% (0.0001 => 0.0008, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 21.43% (0.0014 => 0.0017, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.06% (0.0627 => 0.0589, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.44% (0.0180 => 0.0206, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.76% (0.8017 => 0.7796, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -33.87% (0.0062 => 0.0041, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 15:58:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 17:58:02 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121109235802.F2FF72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5723?compare_to=5721&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5723, Order: 167635, Start Time: 2012-11-09 22:31:55, End Time: 2012-11-09 23:57:03 To: 5721, Order: 167632, Start Time: 2012-11-09 20:44:12, End Time: 2012-11-09 22:08:49 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (182 on baseline) Unchanged Tests: 1041 (856 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.35% (79.0522 => 80.1159, std.dev.: 0.3962) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.15% (2.0478 => 2.1124, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: 2.50% (7.4937 => 7.6813, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/hash2: 2.28% (3.1932 => 3.2660, std.dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -7.98% (2.4924 => 2.2934, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.83% (0.3821 => 0.3522, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -7.12% (0.3357 => 0.3118, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.04% (0.2428 => 0.2257, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.89% (0.9542 => 0.8885, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.88% (3.5339 => 3.2907, std.dev.: 0.0050) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.82% (22.4056 => 20.8783, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: -6.60% (7.0961 => 6.6278, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: -6.59% (16.1920 => 15.1242, std.dev.: 0.0097) MultiSource/Benchmarks/MallocBench/gs/gs: -6.58% (4.3330 => 4.0478, std.dev.: 0.0216) MultiSource/Applications/Burg/burg: -6.58% (1.2515 => 1.1692, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.55% (0.7919 => 0.7400, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.53% (0.3658 => 0.3419, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.53% (0.3891 => 0.3637, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.52% (1.0544 => 0.9857, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.51% (0.1796 => 0.1679, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.48% (0.6484 => 0.6064, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: -6.47% (9.2283 => 8.6309, std.dev.: 0.0081) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.47% (0.1716 => 0.1605, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.47% (0.9852 => 0.9215, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.45% (0.3831 => 0.3584, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.44% (0.1584 => 0.1482, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: -6.41% (0.9179 => 0.8591, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/trivial-interface: -6.40% (0.3812 => 0.3568, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.40% (0.4033 => 0.3775, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.39% (0.3880 => 0.3632, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.39% (0.3884 => 0.3636, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -6.37% (0.3848 => 0.3603, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -6.37% (1.1450 => 1.0721, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -6.37% (0.3896 => 0.3648, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -6.36% (0.1761 => 0.1649, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.35% (0.4176 => 0.3911, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -6.33% (0.1879 => 0.1760, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -6.33% (0.2985 => 0.2796, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.32% (0.2548 => 0.2387, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -6.32% (0.2659 => 0.2491, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.31% (4.5069 => 4.2227, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.30% (1.4642 => 1.3720, std.dev.: 0.0130) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.29% (1.2300 => 1.1526, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/property: -6.29% (0.4199 => 0.3935, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.26% (1.3722 => 1.2863, std.dev.: 0.0178) SingleSource/UnitTests/ObjC/parameter-passing: -6.24% (0.4280 => 0.4013, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.23% (1.2784 => 1.1987, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.23% (4.8161 => 4.5161, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -6.22% (2.4021 => 2.2526, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.18% (4.8802 => 4.5784, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.17% (0.3483 => 0.3268, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.13% (0.6736 => 0.6323, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.13% (4.0323 => 3.7853, std.dev.: 0.0024) MultiSource/Applications/lua/lua: -6.12% (4.0594 => 3.8108, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.12% (0.4151 => 0.3897, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -6.09% (15.5079 => 14.5641, std.dev.: 0.0185) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.08% (6.7716 => 6.3601, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.05% (0.6293 => 0.5912, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.05% (5.4682 => 5.1374, std.dev.: 0.0202) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.05% (0.2695 => 0.2532, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.03% (1.6364 => 1.5377, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.03% (0.2355 => 0.2213, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: -6.00% (0.3581 => 0.3366, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.96% (0.3406 => 0.3203, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.94% (1.6474 => 1.5495, std.dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.93% (0.5999 => 0.5643, std.dev.: 0.0082) MultiSource/Applications/minisat/minisat: -5.92% (0.7447 => 0.7006, std.dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: -5.92% (1.3864 => 1.3043, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: -5.91% (18.2933 => 17.2120, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: -5.89% (1.3148 => 1.2373, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.87% (0.3323 => 0.3128, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.84% (0.8521 => 0.8023, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.83% (0.7339 => 0.6911, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.82% (0.3849 => 0.3625, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.82% (0.4916 => 0.4630, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.81% (2.2587 => 2.1274, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.81% (0.4321 => 0.4070, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -5.81% (17.1032 => 16.1101, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.80% (14.2083 => 13.3838, std.dev.: 0.0107) MultiSource/Benchmarks/nbench/nbench: -5.80% (1.1530 => 1.0861, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.79% (0.2278 => 0.2146, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -5.79% (0.3194 => 0.3009, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.79% (0.3837 => 0.3615, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/methcall: -5.79% (0.3025 => 0.2850, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.78% (0.4515 => 0.4254, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.77% (0.6667 => 0.6282, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.73% (0.6052 => 0.5705, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.72% (0.5802 => 0.5470, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: -5.72% (3.5154 => 3.3144, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.71% (2.1713 => 2.0474, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.70% (0.2999 => 0.2828, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.69% (0.7524 => 0.7096, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.68% (0.5705 => 0.5381, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.67% (0.5168 => 0.4875, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.66% (0.3319 => 0.3131, std.dev.: 0.0022) MultiSource/Applications/treecc/treecc: -5.66% (2.1401 => 2.0189, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -5.66% (0.7982 => 0.7530, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.66% (0.4083 => 0.3852, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.65% (0.2106 => 0.1987, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.65% (0.6395 => 0.6034, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.63% (0.5857 => 0.5527, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.63% (0.5859 => 0.5529, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.62% (0.6260 => 0.5908, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.62% (0.5478 => 0.5170, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.62% (0.5591 => 0.5277, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.62% (0.6446 => 0.6084, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -5.61% (0.4524 => 0.4270, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.61% (0.5863 => 0.5534, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/moments: -5.60% (0.4248 => 0.4010, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.60% (0.6194 => 0.5847, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -5.60% (0.3481 => 0.3286, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.60% (0.3931 => 0.3711, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.59% (0.5581 => 0.5269, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.59% (0.6230 => 0.5882, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: -5.58% (0.3621 => 0.3419, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: -5.56% (0.3271 => 0.3089, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.55% (0.5925 => 0.5596, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.55% (0.6304 => 0.5954, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -5.55% (0.3026 => 0.2858, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.55% (0.9557 => 0.9027, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.53% (0.2385 => 0.2253, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: -5.53% (0.3255 => 0.3075, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.52% (0.5329 => 0.5035, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.50% (0.5805 => 0.5486, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.49% (0.5849 => 0.5528, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.49% (0.5941 => 0.5615, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.48% (0.6676 => 0.6310, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -5.48% (0.2939 => 0.2778, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.48% (0.6189 => 0.5850, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.48% (0.2903 => 0.2744, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.46% (0.6681 => 0.6316, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.46% (0.3057 => 0.2890, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.46% (0.5569 => 0.5265, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -5.45% (0.2989 => 0.2826, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.44% (0.3016 => 0.2852, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.43% (0.6440 => 0.6090, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: -5.43% (0.2871 => 0.2715, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.42% (0.4427 => 0.4187, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.41% (8.0126 => 7.5793, std.dev.: 0.0671) SingleSource/Benchmarks/Misc-C++/bigfib: -5.41% (0.6750 => 0.6385, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.41% (0.5456 => 0.5161, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: -5.41% (0.2849 => 0.2695, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -5.40% (0.3446 => 0.3260, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.39% (0.6660 => 0.6301, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.39% (0.2933 => 0.2775, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.38% (0.7198 => 0.6811, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.37% (0.5570 => 0.5271, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -5.36% (0.3394 => 0.3212, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.35% (0.6297 => 0.5960, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.34% (0.7021 => 0.6646, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -5.34% (0.3205 => 0.3034, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.33% (0.3491 => 0.3305, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -5.32% (34.0927 => 32.2780, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.32% (0.3252 => 0.3079, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.32% (0.5567 => 0.5271, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -5.30% (15.2527 => 14.4442, std.dev.: 0.0121) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.28% (0.4813 => 0.4559, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: -5.28% (0.3867 => 0.3663, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.27% (0.6395 => 0.6058, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.25% (1.2210 => 1.1569, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.24% (0.6033 => 0.5717, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -5.17% (0.3788 => 0.3592, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.17% (0.5688 => 0.5394, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -5.17% (0.3059 => 0.2901, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.10% (0.2001 => 0.1899, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.07% (1.2221 => 1.1602, std.dev.: 0.0045) MultiSource/Applications/spiff/spiff: -5.00% (0.8418 => 0.7997, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: -4.97% (5.0226 => 4.7729, std.dev.: 0.0142) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.61% (0.9077 => 0.8659, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference-object: -4.38% (0.6441 => 0.6159, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -4.35% (0.6347 => 0.6071, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -4.34% (1.5610 => 1.4933, std.dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference: -4.08% (0.7779 => 0.7462, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -2.66% (20.7746 => 20.2221, std.dev.: 0.0482) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7515, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/richards_benchmark: -8.66% (1.2842 => 1.1730, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.78% (2.2633 => 2.1778, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.76% (1.3096 => 1.2735, std.dev.: 0.0126) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4697, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0000) Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 17:18:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 19:18:57 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121110011857.25E032A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5724?compare_to=5722&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5724, Order: 167644, Start Time: 2012-11-09 23:52:36, End Time: 2012-11-10 01:19:09 To: 5722, Order: 167635, Start Time: 2012-11-09 22:09:41, End Time: 2012-11-09 23:35:29 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 7 (100 on baseline) Performance Improvements: 0 (26 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 984 (848 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/sgefa/sgefa: 5.25% (0.2971 => 0.3127, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: 2.17% (0.8191 => 0.8369, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.08% (0.5869 => 0.5991, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.72% (1.6585 => 1.6871, std.dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 6.36% (20.6309 => 21.9423, std.dev.: 0.0467) MultiSource/Applications/SPASS/SPASS: 3.03% (8.4537 => 8.7098, std.dev.: 0.0757) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.49% (1.0172 => 1.0425, std.dev.: 0.0051) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.63% (16.8209 => 16.7145, std.dev.: 0.2457) MultiSource/Applications/obsequi/Obsequi: 0.96% (1.0436 => 1.0536, std.dev.: 0.0193) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.53% (21.6648 => 21.7789, std.dev.: 0.3812) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.30% (0.3658 => 0.3669, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/bigfib: 0.53% (0.6033 => 0.6065, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.15% (0.3325 => 0.3320, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/strcat: -0.55% (0.2003 => 0.1992, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -27.06% (0.0218 => 0.0159, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0426 => 0.0426, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.34% (0.0298 => 0.0299, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0314 => 0.0314, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.77% (0.0424 => 0.0408, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0203 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 0.46% (0.0216 => 0.0217, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.41% (0.1449 => 0.1455, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.05% (1.1430 => 1.1436, std.dev.: 0.0322) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.10% (0.1458 => 0.1474, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.21% (0.4188 => 0.4179, std.dev.: 0.0240) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.44% (0.1379 => 0.1454, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.16% (0.0604 => 0.0611, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.85% (0.0249 => 0.0217, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.71% (0.0560 => 0.0592, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.09% (1.1952 => 1.1963, std.dev.: 0.0573) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -87.50% (0.0008 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -94.12% (0.0017 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.19% (0.0589 => 0.0582, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.11% (0.0206 => 0.0179, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.33% (0.7796 => 0.7770, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 68.29% (0.0041 => 0.0069, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2301.39% (0.6332 => 15.2056, std.dev.: 0.4597) MultiSource/Benchmarks/McCat/08-main/main: 49.92% (0.1831 => 0.2745, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.25% (0.1559 => 0.1446, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1492.55% (0.3344 => 5.3255, std.dev.: 0.0163) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.91% (0.2364 => 0.3213, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: 0.23% (0.0429 => 0.0430, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.46% (0.0224 => 0.0234, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0013) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4331, std.dev.: 0.0395) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0752, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4926, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3429, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1571, std.dev.: 0.0283) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4025, std.dev.: 0.0107) SingleSource/Regression/C/uint64_to_float: -24.06% (2.1832 => 1.6579, std.dev.: 0.0034) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.01% (0.0830 => 0.0938, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/tsp/tsp: 11.69% (0.1112 => 0.1242, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.58% (0.1425 => 0.1533, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.06% (0.2279 => 0.2440, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.48% (0.4847 => 0.5161, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.47% (0.1885 => 0.2007, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.36% (0.7473 => 0.7948, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.34% (0.6010 => 0.6391, std.dev.: 0.0098) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.07% (0.8321 => 0.8826, std.dev.: 0.0146) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.05% (0.1983 => 0.2103, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 5.27% (0.7950 => 0.8369, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.16% (0.3295 => 0.3465, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.11% (0.2133 => 0.2242, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.06% (1.1606 => 1.2193, std.dev.: 0.0052) MultiSource/Applications/sgefa/sgefa: 4.27% (0.2999 => 0.3127, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.99% (0.4783 => 0.4974, std.dev.: 0.0039) MultiSource/Applications/Burg/burg: 3.82% (1.2222 => 1.2689, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.68% (0.4127 => 0.4279, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.65% (1.1685 => 1.2112, std.dev.: 0.0072) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.14% (6.6074 => 6.8146, std.dev.: 0.0357) MultiSource/Applications/SPASS/SPASS: 3.12% (14.2605 => 14.7048, std.dev.: 0.0631) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.99% (0.5817 => 0.5991, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.96% (1.6386 => 1.6871, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.85% (0.8611 => 0.8856, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.83% (0.6287 => 0.6465, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.83% (0.8597 => 0.8840, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.74% (0.9908 => 1.0179, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.68% (0.5961 => 0.6121, std.dev.: 0.0044) MultiSource/Applications/treecc/treecc: 2.68% (1.9948 => 2.0483, std.dev.: 0.0183) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.1401 => 2.1974, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.68% (0.4559 => 0.4681, std.dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 2.65% (1.1271 => 1.1570, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.60% (0.7966 => 0.8173, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.52% (0.8457 => 0.8670, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.49% (0.8007 => 0.8206, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.48% (4.4873 => 4.5985, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.47% (0.8050 => 0.8249, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.41% (0.8805 => 0.9017, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.39% (0.8712 => 0.8920, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.37% (0.8086 => 0.8278, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.33% (1.2526 => 1.2818, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.33% (0.9056 => 0.9267, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.32% (0.8331 => 0.8524, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.31% (0.8338 => 0.8531, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.31% (0.7932 => 0.8115, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.26% (0.8069 => 0.8251, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.25% (0.8261 => 0.8447, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.25% (0.9039 => 0.9242, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.16% (0.8066 => 0.8240, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.12% (0.8885 => 0.9073, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.11% (0.8340 => 0.8516, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.11% (0.8359 => 0.8535, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.08% (0.8420 => 0.8595, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.06% (0.8286 => 0.8457, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.05% (0.8716 => 0.8895, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 2.04% (6.7320 => 6.8694, std.dev.: 0.0289) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.00% (0.8855 => 0.9032, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.00% (0.9069 => 0.9250, std.dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: 1.93% (8.6247 => 8.7915, std.dev.: 0.0439) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.92% (0.8317 => 0.8477, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.90% (0.8048 => 0.8201, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.89% (13.1811 => 13.4296, std.dev.: 0.0552) MultiSource/Applications/lambda-0_1_3/lambda: 1.67% (0.7557 => 0.7683, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.65% (0.8316 => 0.8453, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.54% (1.5315 => 1.5551, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.41% (3.1832 => 3.2282, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.39% (1.2423 => 1.2596, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 87.94% (0.0199 => 0.0374, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/pi: 57.56% (1.5795 => 2.4887, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.21% (2.9753 => 3.4577, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.18% (0.7597 => 0.8826, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.40% (2.7995 => 3.2026, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.51% (5.0261 => 5.6047, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.07% (6.3772 => 7.0194, std.dev.: 0.2307) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.38% (0.3186 => 0.3453, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.06% (1.1857 => 1.2813, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 7.43% (1.7056 => 1.8324, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.51% (4.7794 => 5.0906, std.dev.: 0.0176) MultiSource/Applications/SIBsim4/SIBsim4: 6.30% (3.1873 => 3.3880, std.dev.: 0.0221) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.85% (4.5327 => 4.7978, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.84% (4.9686 => 5.2586, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: 5.14% (1.3037 => 1.3707, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.69% (4.9453 => 5.1770, std.dev.: 0.0447) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.68% (3.3761 => 3.5342, std.dev.: 0.0294) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.49% (6.2275 => 6.5069, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.03% (4.9469 => 5.1461, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 3.81% (14.0064 => 14.5404, std.dev.: 0.0370) MultiSource/Applications/SPASS/SPASS: 3.29% (8.4326 => 8.7098, std.dev.: 0.0757) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.89% (11.5690 => 11.9033, std.dev.: 0.0068) MultiSource/Applications/lambda-0_1_3/lambda: 2.71% (7.4933 => 7.6965, std.dev.: 0.0111) MultiSource/Applications/siod/siod: 2.69% (3.6643 => 3.7630, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.59% (4.8660 => 4.9919, std.dev.: 0.0273) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.53% (4.8362 => 4.9584, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout/lists: 2.46% (7.3375 => 7.5181, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/dry: 2.36% (0.5081 => 0.5201, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.26% (8.2783 => 8.4651, std.dev.: 0.0205) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.23% (3.5679 => 3.6118, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/ReedSolomon: 1.17% (8.5322 => 8.6319, std.dev.: 0.0125) MultiSource/Benchmarks/Olden/power/power: 1.14% (1.2061 => 1.2199, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 1.09% (1.0841 => 1.0959, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.05% (5.4641 => 4.3138, std.dev.: 0.3823) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -10.99% (7.2130 => 6.4202, std.dev.: 0.1199) SingleSource/Benchmarks/McGill/chomp: -10.59% (1.1216 => 1.0028, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.58% (1.0512 => 0.9400, std.dev.: 0.0275) MultiSource/Benchmarks/mafft/pairlocalalign: -8.52% (63.1822 => 57.7980, std.dev.: 0.1928) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.26% (0.3269 => 0.2999, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -7.05% (4.7482 => 4.4133, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.11% (3.7148 => 3.4880, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.89% (5.4972 => 5.1732, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.14% (5.1557 => 4.8907, std.dev.: 0.0348) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.26% (4.7449 => 4.5427, std.dev.: 0.0079) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.86% (2.8773 => 2.7661, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.69% (6.0224 => 5.7999, std.dev.: 0.0213) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.46% (2.4490 => 2.3642, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.98% (0.5807 => 0.5634, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.93% (28.5821 => 27.7435, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.41% (9.9065 => 9.6682, std.dev.: 0.0533) MultiSource/Applications/aha/aha: -2.38% (3.3398 => 3.2602, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/hash2: -2.24% (3.4237 => 3.3471, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.22% (3.2169 => 3.1454, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.03% (11.5316 => 11.2979, std.dev.: 0.0398) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.68% (2.3487 => 2.3092, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.47% (4.9994 => 4.9261, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.15% (5.6343 => 5.5695, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/methcall: -1.13% (8.2676 => 8.1738, std.dev.: 0.0334) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.00% (4.2466 => 4.2040, std.dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.63% (16.4461 => 16.7145, std.dev.: 0.2457) MultiSource/Applications/obsequi/Obsequi: 2.67% (1.0262 => 1.0536, std.dev.: 0.0193) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6873.71% (0.3123 => 21.7789, std.dev.: 0.3812) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.96% (0.2463 => 0.3669, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/bigfib: 0.92% (0.6010 => 0.6065, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.65% (0.3266 => 0.3320, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/strcat: 1.17% (0.1969 => 0.1992, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 29.27% (0.0123 => 0.0159, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 17.72% (0.0254 => 0.0299, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 6.25% (0.0384 => 0.0408, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 1.18% (0.1438 => 0.1455, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.94% (1.1329 => 1.1436, std.dev.: 0.0322) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.82% (0.1462 => 0.1474, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.36% (0.4164 => 0.4179, std.dev.: 0.0240) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.21% (0.1369 => 0.1454, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.68% (0.0641 => 0.0611, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.28% (0.0195 => 0.0217, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.42% (0.0578 => 0.0592, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.60% (1.1437 => 1.1963, std.dev.: 0.0573) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.18% (0.0627 => 0.0582, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.56% (0.0180 => 0.0179, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.08% (0.8017 => 0.7770, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 11.29% (0.0062 => 0.0069, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 17:48:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 19:48:35 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121110014835.71A462A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5725?compare_to=5723&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5725, Order: 167647, Start Time: 2012-11-10 00:23:51, End Time: 2012-11-10 01:48:46 To: 5723, Order: 167635, Start Time: 2012-11-09 22:31:55, End Time: 2012-11-09 23:57:03 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 1 (181 on baseline) Unchanged Tests: 1041 (856 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -3.65% (3.8883 => 3.7465, std.dev.: 0.0271) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1015, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4937 => 7.6769, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/hash2: 2.10% (3.1932 => 3.2604, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.07% (0.9531 => 0.9633, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305) MultiSource/Benchmarks/PAQ8p/paq8p: -7.90% (2.4924 => 2.2956, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.85% (0.3821 => 0.3521, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: -7.09% (0.3357 => 0.3119, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.08% (0.2428 => 0.2256, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.78% (0.9542 => 0.8895, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.78% (0.3142 => 0.2929, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.77% (3.5339 => 3.2947, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.72% (22.4056 => 20.9004, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.70% (0.3658 => 0.3413, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: -6.66% (0.3831 => 0.3576, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.60% (0.3880 => 0.3624, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -6.57% (0.3848 => 0.3595, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -6.56% (0.3812 => 0.3562, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -6.54% (16.1920 => 15.1330, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.53% (1.0544 => 0.9856, std.dev.: 0.0039) MultiSource/Applications/Burg/burg: -6.51% (1.2515 => 1.1700, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/for-in: -6.50% (0.4033 => 0.3771, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -6.49% (7.0961 => 6.6357, std.dev.: 0.0159) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.48% (0.3891 => 0.3639, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/synchronized: -6.47% (0.3896 => 0.3644, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions: -6.47% (0.4176 => 0.3906, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -6.45% (0.9179 => 0.8587, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.44% (0.1584 => 0.1482, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.44% (0.3884 => 0.3634, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: -6.43% (4.3330 => 4.0546, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.43% (0.9852 => 0.9219, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -6.39% (9.2283 => 8.6384, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.38% (0.6484 => 0.6070, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/property: -6.36% (0.4199 => 0.3932, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.35% (0.1716 => 0.1607, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.35% (0.1796 => 0.1682, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -6.33% (0.1879 => 0.1760, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.29% (1.3722 => 1.2859, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -6.29% (0.4280 => 0.4011, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -6.28% (1.1450 => 1.0731, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/bh/bh: -6.26% (0.2985 => 0.2798, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.26% (0.4151 => 0.3891, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.26% (1.2300 => 1.1530, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: -6.25% (0.2160 => 0.2025, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.24% (4.8161 => 4.5157, std.dev.: 0.0115) MultiSource/Benchmarks/McCat/08-main/main: -6.21% (0.2659 => 0.2494, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -6.20% (2.4021 => 2.2531, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -6.19% (0.1761 => 0.1652, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.19% (1.2784 => 1.1993, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.18% (4.5069 => 4.2284, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.17% (4.8802 => 4.5790, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.17% (1.4642 => 1.3739, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.16% (0.2548 => 0.2391, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.16% (0.2355 => 0.2210, std.dev.: 0.0010) MultiSource/Applications/lua/lua: -6.14% (4.0594 => 3.8101, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.09% (0.6293 => 0.5910, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.07% (0.6736 => 0.6327, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.07% (6.7716 => 6.3606, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.06% (1.6474 => 1.5475, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.05% (0.3323 => 0.3122, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.03% (0.3483 => 0.3273, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.02% (0.8521 => 0.8008, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: -6.02% (1.3148 => 1.2357, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: -6.01% (15.5079 => 14.5755, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.01% (0.2695 => 0.2533, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: -6.01% (0.4861 => 0.4569, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.01% (4.0323 => 3.7901, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.00% (0.3931 => 0.3695, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.00% (5.4682 => 5.1402, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: -5.96% (0.7447 => 0.7003, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: -5.92% (0.3581 => 0.3369, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: -5.92% (0.3025 => 0.2846, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.92% (0.3837 => 0.3610, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.90% (0.3406 => 0.3205, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: -5.90% (1.1530 => 1.0850, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.90% (0.3849 => 0.3622, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -5.89% (0.2989 => 0.2813, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.89% (2.1713 => 2.0435, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.88% (1.6364 => 1.5401, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: -5.85% (0.2871 => 0.2703, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.84% (0.4916 => 0.4629, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.83% (0.4083 => 0.3845, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.82% (0.2903 => 0.2734, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -5.82% (0.2939 => 0.2768, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.81% (0.4321 => 0.4070, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -5.81% (1.3864 => 1.3059, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.80% (14.2083 => 13.3839, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.80% (2.2587 => 2.1277, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/moments: -5.79% (0.4248 => 0.4002, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.79% (0.3057 => 0.2880, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.78% (0.7919 => 0.7461, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.78% (0.7339 => 0.6915, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: -5.77% (0.3481 => 0.3280, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -5.77% (0.3621 => 0.3412, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.76% (17.1032 => 16.1179, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/objinst: -5.76% (0.3194 => 0.3010, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -5.75% (0.3026 => 0.2852, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.73% (0.5859 => 0.5523, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: -5.72% (0.2849 => 0.2686, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -5.72% (0.3059 => 0.2884, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -5.72% (18.2933 => 17.2468, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/ary3: -5.72% (0.3446 => 0.3249, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.69% (0.2933 => 0.2766, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.69% (0.3252 => 0.3067, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.68% (0.3255 => 0.3070, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -5.68% (2.1401 => 2.0185, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.68% (0.5705 => 0.5381, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: -5.67% (3.5154 => 3.3162, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.65% (0.6667 => 0.6290, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.65% (0.4813 => 0.4541, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.63% (0.6660 => 0.6285, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.63% (0.9557 => 0.9019, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.63% (0.5863 => 0.5533, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: -5.62% (0.3205 => 0.3025, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.61% (0.6395 => 0.6036, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.60% (0.5478 => 0.5171, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.60% (0.3016 => 0.2847, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.60% (0.5802 => 0.5477, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -5.60% (0.3394 => 0.3204, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -5.59% (0.4524 => 0.4271, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.59% (0.5925 => 0.5594, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.58% (0.6304 => 0.5952, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.58% (0.7524 => 0.7104, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.58% (0.4515 => 0.4263, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -5.58% (0.7982 => 0.7537, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.57% (0.6052 => 0.5715, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.56% (0.2106 => 0.1989, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.55% (0.7021 => 0.6631, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.54% (0.6230 => 0.5885, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: -5.53% (0.3867 => 0.3653, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (0.5857 => 0.5533, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.53% (0.3491 => 0.3298, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.51% (0.5805 => 0.5485, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.51% (0.4427 => 0.4183, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.48% (0.5581 => 0.5275, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.48% (0.5168 => 0.4885, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.47% (0.5849 => 0.5529, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.47% (0.5999 => 0.5671, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.46% (0.5569 => 0.5265, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.45% (0.6260 => 0.5919, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -5.44% (0.3271 => 0.3093, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.44% (8.0126 => 7.5770, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/bigfib: -5.42% (0.6750 => 0.6384, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.42% (0.7198 => 0.6808, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.41% (0.6446 => 0.6097, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.41% (0.2385 => 0.2256, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.41% (0.6676 => 0.6315, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.40% (0.2278 => 0.2155, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.37% (0.5941 => 0.5622, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -5.36% (34.0927 => 32.2643, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sieve: -5.36% (0.3788 => 0.3585, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.35% (0.5456 => 0.5164, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.35% (0.5575 => 0.5277, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.34% (0.5567 => 0.5270, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.33% (0.5570 => 0.5273, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.30% (0.6297 => 0.5963, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.28% (0.5591 => 0.5296, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.27% (0.5688 => 0.5388, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.27% (0.6189 => 0.5863, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.26% (0.6440 => 0.6101, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.26% (1.2210 => 1.1568, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.24% (0.6395 => 0.6060, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -5.18% (15.2527 => 14.4624, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.17% (1.2221 => 1.1589, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.14% (0.6033 => 0.5723, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.12% (0.6681 => 0.6339, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -5.08% (0.8418 => 0.7990, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.00% (0.3319 => 0.3153, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.87% (0.2999 => 0.2853, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -4.85% (5.0226 => 4.7790, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.55% (0.9077 => 0.8664, std.dev.: 0.0047) SingleSource/UnitTests/ObjC++/property-reference: -4.51% (0.7779 => 0.7428, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: -4.32% (1.5610 => 1.4935, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -4.19% (0.6347 => 0.6081, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.13% (0.6441 => 0.6175, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.80% (20.7746 => 20.1919, std.dev.: 0.0249) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7525, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/richards_benchmark: -8.76% (1.2842 => 1.1717, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: -4.02% (2.2633 => 2.1724, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7060, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.08% (1.3096 => 1.2692, std.dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.50% (6.5735 => 6.4750, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 17:52:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 19:52:55 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121110015255.21DA02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5726?compare_to=5719&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5726, Order: 167635, Start Time: 2012-11-09 22:37:24, End Time: 2012-11-10 01:53:07 To: 5719, Order: 167620, Start Time: 2012-11-09 18:33:33, End Time: 2012-11-09 21:49:20 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 19 (176 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1023 (714 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.42% (3.1354 => 3.2113, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 2.14% (2.3638 => 2.4144, std.dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 2.05% (1.9711 => 2.0115, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.97% (1.5408 => 1.5712, std.dev.: 0.0085) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.92% (2.2834 => 2.3273, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.90% (4.1513 => 4.2300, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.83% (0.6132 => 0.6244, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.78% (1.8813 => 1.9147, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.75% (2.2559 => 2.2953, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (0.7274 => 0.7396, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 1.56% (4.8490 => 4.9247, std.dev.: 0.0066) MultiSource/Applications/d/make_dparser: 1.54% (1.2493 => 1.2686, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 1.54% (5.2000 => 5.2801, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/gs/gs: 1.52% (2.1913 => 2.2247, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.48% (5.1013 => 5.1766, std.dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 1.38% (2.4468 => 2.4806, std.dev.: 0.0024) MultiSource/Applications/lua/lua: 1.30% (1.6206 => 1.6416, std.dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 1.27% (6.1867 => 6.2653, std.dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: 1.04% (2.2292 => 2.2524, std.dev.: 0.0031) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.20% (0.0625 => 0.0895, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.96% (0.1063 => 0.1424, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.05% (0.2969 => 0.3772, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.76% (0.4253 => 0.5391, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.67% (0.1106 => 0.1401, std.dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 26.26% (1.5932 => 2.0115, std.dev.: 0.0153) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.73% (0.4139 => 0.5204, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.36% (0.5900 => 0.7396, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.88% (0.5000 => 0.6244, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.65% (0.0714 => 0.0890, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.63% (0.4994 => 0.6224, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.58% (0.0415 => 0.0517, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.42% (0.0475 => 0.0591, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.95% (0.0547 => 0.0678, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 23.87% (0.0599 => 0.0742, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.83% (0.1620 => 0.2006, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.63% (0.0584 => 0.0722, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.60% (0.1021 => 0.1262, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.49% (0.1107 => 0.1367, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.97% (0.0897 => 0.1103, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.43% (0.0642 => 0.0786, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.27% (0.0633 => 0.0774, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 22.26% (0.0948 => 0.1159, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/health/health: 22.05% (0.0821 => 0.1002, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.94% (0.1103 => 0.1345, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.92% (0.0584 => 0.0712, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 21.65% (0.0605 => 0.0736) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.63% (0.0541 => 0.0658, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.53% (0.0822 => 0.0999, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 21.31% (0.1619 => 0.1964, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.24% (0.1549 => 0.1878, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.21% (0.0495 => 0.0600, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.14% (0.3903 => 0.4728, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.14% (0.1003 => 0.1215, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.07% (0.1604 => 0.1942, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 20.86% (0.0604 => 0.0730, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 20.38% (0.0947 => 0.1140, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.16% (0.2014 => 0.2420, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.04% (0.1462 => 0.1755, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 19.95% (0.5826 => 0.6988, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 19.80% (0.0808 => 0.0968, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 19.80% (0.5889 => 0.7055, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 19.79% (0.1218 => 0.1459, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.72% (0.3890 => 0.4657, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.52% (0.2736 => 0.3270, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.46% (1.3152 => 1.5712, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/mst/mst: 19.34% (0.0698 => 0.0833, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 19.14% (0.4029 => 0.4800, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 19.10% (0.0581 => 0.0692, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.03% (0.1088 => 0.1295, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 18.80% (0.1505 => 0.1788, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.73% (3.5627 => 4.2300, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.63% (0.2866 => 0.3400, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.53% (0.0572 => 0.0678, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.40% (0.4658 => 0.5515, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/gs/gs: 18.37% (1.8794 => 2.2247, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.29% (0.1968 => 0.2328, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.15% (0.0573 => 0.0677, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.15% (0.5026 => 0.5938, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.11% (1.6211 => 1.9147, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 18.03% (0.5546 => 0.6546, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.01% (0.3271 => 0.3860, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 17.67% (1.0781 => 1.2686, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.66% (2.7292 => 3.2113, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/18-imp/imp: 17.52% (0.1421 => 0.1670, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.48% (0.3930 => 0.4617, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 17.45% (0.7171 => 0.8422, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.43% (0.4361 => 0.5121, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.41% (0.1160 => 0.1362, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.32% (0.2875 => 0.3373, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.13% (4.4195 => 5.1766, std.dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: 16.95% (4.2109 => 4.9247, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/bh/bh: 16.74% (0.1284 => 0.1499, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 16.71% (0.9697 => 1.1317, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.56% (1.9966 => 2.3273, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: 16.55% (0.2725 => 0.3176, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.55% (1.9694 => 2.2953, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/football/football: 16.48% (0.2075 => 0.2417, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 16.47% (0.2714 => 0.3161, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.44% (0.2738 => 0.3188, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 16.33% (0.2566 => 0.2985, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.31% (0.3488 => 0.4057, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 16.30% (0.3442 => 0.4003, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.30% (0.2792 => 0.3247, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 16.27% (0.2803 => 0.3259, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/exceptions-2: 16.25% (0.3446 => 0.4006, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 16.25% (0.3465 => 0.4028, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 16.25% (0.3496 => 0.4064, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.23% (0.2729 => 0.3172, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 16.16% (0.3460 => 0.4019, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.15% (0.1090 => 0.1266, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 16.15% (0.2750 => 0.3194, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 16.15% (0.3004 => 0.3489, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/synchronized: 16.11% (0.3469 => 0.4028, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 16.10% (0.9909 => 1.1504, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 16.04% (0.2780 => 0.3226, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 16.00% (0.2813 => 0.3263, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 15.97% (0.2811 => 0.3260, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.87% (0.2911 => 0.3373, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 15.87% (0.2823 => 0.3271, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.81% (0.3195 => 0.3700, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 15.73% (0.3650 => 0.4224, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 15.70% (0.3643 => 0.4215, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 15.70% (0.3096 => 0.3582, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.68% (2.0673 => 2.3914, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/parameter-passing: 15.57% (0.3724 => 0.4304, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 15.37% (0.3267 => 0.3769, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 15.36% (23.5202 => 27.1332, std.dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.26% (0.3060 => 0.3527, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 15.25% (0.3317 => 0.3823, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 15.10% (0.3258 => 0.3750, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 15.05% (1.4269 => 1.6416, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 14.90% (2.1013 => 2.4144, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.81% (0.3362 => 0.3860, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 14.73% (0.3348 => 0.3841, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 14.60% (0.3678 => 0.4215, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.60% (0.3124 => 0.3580, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 14.56% (2.1653 => 2.4806, std.dev.: 0.0024) MultiSource/Applications/treecc/treecc: 14.53% (0.7875 => 0.9019, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.51% (0.3845 => 0.4403, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.47% (0.3282 => 0.3757, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 14.41% (0.3726 => 0.4263, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 14.38% (0.0758 => 0.0867, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 14.34% (4.6177 => 5.2801, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.23% (0.3625 => 0.4141, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 14.23% (0.4146 => 0.4736, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists1: 14.18% (0.3477 => 0.3970, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.02% (0.2040 => 0.2326, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 14.00% (0.4251 => 0.4846, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.96% (0.3690 => 0.4205, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.94% (0.3981 => 0.4536, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 13.53% (0.2691 => 0.3055, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 13.25% (0.5012 => 0.5676, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 13.06% (5.5417 => 6.2653, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.44% (0.1383 => 0.1555, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.29% (0.6435 => 0.7226, std.dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.90% (0.2068 => 0.2314, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.58% (0.1028 => 0.1147, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.49% (0.3498 => 0.3900, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.44% (0.2737 => 0.3050, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 11.41% (0.6634 => 0.7391, std.dev.: 0.0043) MultiSource/Benchmarks/PAQ8p/paq8p: 11.06% (0.4847 => 0.5383, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.89% (0.3084 => 0.3420, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 10.70% (2.0346 => 2.2524, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: 10.62% (0.2391 => 0.2645, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 10.52% (0.3336 => 0.3687, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.18% (0.2103 => 0.2317, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.97% (0.5361 => 0.5842, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.90% (4.6926 => 5.1103, std.dev.: 0.0047) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.76% (11.6398 => 12.6593, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.35% (0.5584 => 0.6050, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.12% (0.7426 => 0.8029, std.dev.: 0.0041) MultiSource/Applications/kimwitu++/kc: 7.22% (11.9555 => 12.8192, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.65% (0.3792 => 0.4044, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6530, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 9.46% (0.2802 => 0.3067, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6095, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.52% (0.3693 => 0.3897, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6758, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1724, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-2: 4.64% (1.8057 => 1.8894, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: 4.27% (14.0481 => 14.6474, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1946, std.dev.: 0.0085) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2224, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2899, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.2991, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5822, std.dev.: 0.0197) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.33% (2.4764 => 2.4435, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5559, std.dev.: 0.0234) SingleSource/Benchmarks/Shootout-C++/ary2: -8.24% (0.2402 => 0.2204, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9749, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7897, std.dev.: 0.0081) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8010, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.05% (0.6293 => 0.6101, std.dev.: 0.0048) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7745, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.60% (17.2379 => 16.7894, std.dev.: 0.0712) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.25% (41.7953 => 40.8541, std.dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5701, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4960, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.30% (105.3826 => 104.0096, std.dev.: 0.1079) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0467, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 19:03:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 21:03:30 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121110030330.CEF582A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5727?compare_to=5724&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5727, Order: 167650, Start Time: 2012-11-10 01:36:24, End Time: 2012-11-10 03:03:44 To: 5724, Order: 167644, Start Time: 2012-11-09 23:52:36, End Time: 2012-11-10 01:19:09 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 3 (95 on baseline) Performance Improvements: 1 (20 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 987 (859 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 24.07% (1.5152 => 1.8799, std.dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.11% (0.7673 => 0.8756, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.38% (1.3566 => 1.4025, std.dev.: 0.0137) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.29% (2.4687 => 2.4368, std.dev.: 0.0081) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.85% (16.7145 => 16.5716, std.dev.: 0.2433) MultiSource/Applications/obsequi/Obsequi: 0.85% (1.0536 => 1.0626, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.91% (21.7789 => 21.5801, std.dev.: 0.3948) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.95% (0.3669 => 0.3634, std.dev.: 0.0141) SingleSource/Benchmarks/Misc-C++/bigfib: -0.66% (0.6065 => 0.6025, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.09% (0.3320 => 0.3317, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 0.55% (0.1992 => 0.2003, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 8.18% (0.0159 => 0.0172, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0426 => 0.0428, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 11.04% (0.0299 => 0.0332, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.96% (0.0314 => 0.0317, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0203 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 0.46% (0.0217 => 0.0218, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.96% (0.1455 => 0.1469, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: -1.37% (1.1436 => 1.1279, std.dev.: 0.0468) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.90% (0.1474 => 0.1446, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.89% (0.4179 => 0.4216, std.dev.: 0.0193) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: - (0.1454 => 0.1454, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.33% (0.0611 => 0.0668, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 25.35% (0.0217 => 0.0272, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.93% (0.0592 => 0.0551, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.15% (1.1963 => 1.1945, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.97% (0.0582 => 0.0640, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 49.72% (0.0179 => 0.0268, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.35% (0.7770 => 0.7797, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 69.57% (0.0069 => 0.0117, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2323.70% (0.6332 => 15.3469, std.dev.: 0.2207) MultiSource/Benchmarks/McCat/08-main/main: 48.61% (0.1831 => 0.2721, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.61% (0.1559 => 0.1456, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1479.96% (0.3344 => 5.2834, std.dev.: 0.0313) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.19% (0.2364 => 0.3196, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0429 => 0.0439, std.dev.: 0.0045) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.68% (0.0224 => 0.0230, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4283, std.dev.: 0.0177) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0691, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4951, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3510, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1314, std.dev.: 0.0223) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4084, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: -23.88% (2.1832 => 1.6619, std.dev.: 0.0162) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.53% (0.0830 => 0.0934, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.85% (0.1137 => 0.1249, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.26% (0.1425 => 0.1557, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.10% (0.8321 => 0.8995, std.dev.: 0.0108) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.27% (0.1885 => 0.2022, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.25% (0.2180 => 0.2338, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.45% (0.2279 => 0.2426, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.18% (0.3137 => 0.3331, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.85% (0.1983 => 0.2099, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 4.89% (0.7950 => 0.8339, std.dev.: 0.0096) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.87% (0.2240 => 0.2349, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.84% (0.2998 => 0.3143, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.57% (0.2519 => 0.2634, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.39% (1.1606 => 1.2115, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.05% (1.1685 => 1.2158, std.dev.: 0.0091) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.97% (0.4783 => 0.4973, std.dev.: 0.0064) MultiSource/Applications/Burg/burg: 3.78% (1.2222 => 1.2684, std.dev.: 0.0101) MultiSource/Applications/hbd/hbd: 3.61% (1.4269 => 1.4784, std.dev.: 0.0127) MultiSource/Benchmarks/McCat/05-eks/eks: 3.53% (0.4397 => 0.4552, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.08% (1.6386 => 1.6891, std.dev.: 0.0033) MultiSource/Applications/lua/lua: 2.96% (3.8189 => 3.9319, std.dev.: 0.0351) MultiSource/Applications/SPASS/SPASS: 2.92% (14.2605 => 14.6769, std.dev.: 0.1069) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.92% (6.6074 => 6.8001, std.dev.: 0.0338) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.67% (4.1763 => 4.2879, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.61% (0.8611 => 0.8836, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.51% (0.8697 => 0.8915, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.41% (0.8050 => 0.8244, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.35% (0.8086 => 0.8276, std.dev.: 0.0034) MultiSource/Applications/d/make_dparser: 2.31% (3.2366 => 3.3114, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.31% (0.8007 => 0.8192, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.30% (0.8204 => 0.8393, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 2.26% (15.3280 => 15.6740, std.dev.: 0.1198) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.25% (0.6227 => 0.6367, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.22% (0.8518 => 0.8707, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.15% (0.9074 => 0.9269, std.dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 2.13% (6.7320 => 6.8753, std.dev.: 0.0480) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.10% (0.8331 => 0.8506, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.09% (0.8069 => 0.8238, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.08% (0.8317 => 0.8490, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.08% (0.8716 => 0.8897, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.07% (0.8855 => 0.9038, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.00% (0.9039 => 0.9220, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.98% (0.9688 => 0.9880, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.98% (0.7932 => 0.8089, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.94% (13.1811 => 13.4367, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.92% (0.8712 => 0.8879, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.91% (0.9908 => 1.0097, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.89% (0.8286 => 0.8443, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.89% (0.8359 => 0.8517, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.89% (0.8261 => 0.8417, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.87% (0.8805 => 0.8970, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.84% (0.8316 => 0.8469, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.75% (1.1170 => 1.1365, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 1.72% (8.6247 => 8.7730, std.dev.: 0.0545) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.71% (0.8048 => 0.8186, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.71% (0.8656 => 0.8804, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.61% (0.8340 => 0.8474, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.33% (0.9056 => 0.9176, std.dev.: 0.0045) MultiSource/Benchmarks/PAQ8p/paq8p: 1.25% (2.3764 => 2.4060, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 83.92% (0.0199 => 0.0366, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/pi: 56.61% (1.5795 => 2.4737, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.99% (0.7597 => 0.8888, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.10% (2.9753 => 3.4542, std.dev.: 0.0290) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.40% (2.7995 => 3.2026, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.62% (5.0261 => 5.6101, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.90% (1.1857 => 1.2794, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 7.14% (1.7056 => 1.8274, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.64% (4.7794 => 5.0968, std.dev.: 0.0105) MultiSource/Applications/SIBsim4/SIBsim4: 6.21% (3.1873 => 3.3852, std.dev.: 0.0243) SingleSource/Benchmarks/Misc/richards_benchmark: 6.04% (1.3037 => 1.3825, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.88% (4.9686 => 5.2607, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.77% (4.5327 => 4.7941, std.dev.: 0.0398) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.27% (0.3186 => 0.3354, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.49% (6.2275 => 6.5073, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.44% (3.3761 => 3.5261, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.06% (4.9469 => 5.1477, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.98% (4.9453 => 5.1421, std.dev.: 0.0284) MultiSource/Applications/hexxagon/hexxagon: 3.85% (14.0064 => 14.5450, std.dev.: 0.0170) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.76% (0.3587 => 0.3722, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.92% (11.5690 => 11.9070, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.88% (8.2783 => 8.5164, std.dev.: 0.0050) MultiSource/Applications/lambda-0_1_3/lambda: 2.73% (7.4933 => 7.6978, std.dev.: 0.0283) MultiSource/Applications/siod/siod: 2.66% (3.6643 => 3.7617, std.dev.: 0.0104) SingleSource/Benchmarks/Dhrystone/dry: 2.66% (0.5081 => 0.5216, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.49% (4.8660 => 4.9872, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout/lists: 2.41% (7.3375 => 7.5145, std.dev.: 0.0160) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.21% (4.8362 => 4.9430, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.57% (4.4340 => 4.5034, std.dev.: 0.0244) MultiSource/Benchmarks/Olden/power/power: 1.44% (1.2061 => 1.2235, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (1.1365 => 1.1528, std.dev.: 0.0027) SingleSource/Benchmarks/Stanford/FloatMM: 1.37% (0.8807 => 0.8928, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 1.32% (1.0841 => 1.0984, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.27% (2.4647 => 2.4960, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/ReedSolomon: 1.19% (8.5322 => 8.6341, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.03% (3.5679 => 3.6048, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.14% (5.4641 => 4.3089, std.dev.: 0.0290) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.99% (1.0512 => 0.9357, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -8.55% (63.1822 => 57.7790, std.dev.: 0.0544) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.88% (4.7482 => 4.4217, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.27% (0.3269 => 0.3064, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.01% (3.7148 => 3.4915, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.00% (5.4972 => 5.1676, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.09% (5.1557 => 4.8932, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.42% (4.7449 => 4.5351, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.73% (6.0224 => 5.7978, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.21% (2.4490 => 2.3704, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.15% (0.5807 => 0.5624, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (28.5821 => 27.6951, std.dev.: 0.0674) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.74% (2.6356 => 2.5633, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.33% (9.9065 => 9.6755, std.dev.: 0.0089) MultiSource/Applications/aha/aha: -2.19% (3.3398 => 3.2665, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.06% (11.5316 => 11.2943, std.dev.: 0.0115) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.69% (2.3487 => 2.3089, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.59% (4.9994 => 4.9198, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.27% (5.6343 => 5.5629, std.dev.: 0.0025) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.76% (16.4461 => 16.5716, std.dev.: 0.2433) MultiSource/Applications/obsequi/Obsequi: 3.55% (1.0262 => 1.0626, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6810.05% (0.3123 => 21.5801, std.dev.: 0.3948) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.54% (0.2463 => 0.3634, std.dev.: 0.0141) SingleSource/Benchmarks/Misc-C++/bigfib: 0.25% (0.6010 => 0.6025, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.56% (0.3266 => 0.3317, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 1.73% (0.1969 => 0.2003, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 39.84% (0.0123 => 0.0172, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.97% (0.0302 => 0.0317, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.16% (0.1438 => 0.1469, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: -0.44% (1.1329 => 1.1279, std.dev.: 0.0468) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.09% (0.1462 => 0.1446, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.25% (0.4164 => 0.4216, std.dev.: 0.0193) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.21% (0.1369 => 0.1454, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.21% (0.0641 => 0.0668, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 39.49% (0.0195 => 0.0272, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.67% (0.0578 => 0.0551, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.44% (1.1437 => 1.1945, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.07% (0.0627 => 0.0640, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.89% (0.0180 => 0.0268, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.74% (0.8017 => 0.7797, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 88.71% (0.0062 => 0.0117, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 19:36:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 21:36:38 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121110033638.C2AF22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5728?compare_to=5725&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5728, Order: 167654, Start Time: 2012-11-10 02:11:57, End Time: 2012-11-10 03:36:50 To: 5725, Order: 167647, Start Time: 2012-11-10 00:23:51, End Time: 2012-11-10 01:48:46 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (182 on baseline) Unchanged Tests: 1041 (856 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.35% (42.3806 => 42.9525, std.dev.: 0.0682) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.80% (2.0478 => 2.1051, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/salsa20: 2.37% (7.4937 => 7.6715, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/hash2: 2.08% (3.1932 => 3.2597, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.08% (0.1431 => 0.1301, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -8.06% (2.4924 => 2.2915, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.96% (0.3821 => 0.3517, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -7.30% (0.3357 => 0.3112, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.13% (0.2428 => 0.2255, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.08% (0.9542 => 0.8866, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.01% (3.5339 => 3.2860, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.97% (0.3142 => 0.2923, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -6.84% (4.3330 => 4.0365, std.dev.: 0.0065) MultiSource/Applications/JM/lencod/lencod: -6.84% (16.1920 => 15.0850, std.dev.: 0.0186) MultiSource/Applications/Burg/burg: -6.78% (1.2515 => 1.1666, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: -6.78% (7.0961 => 6.6150, std.dev.: 0.0050) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.78% (22.4056 => 20.8866, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.74% (1.0544 => 0.9833, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.64% (0.9852 => 0.9198, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.63% (0.1584 => 0.1479, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -6.62% (0.2160 => 0.2017, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.62% (0.3658 => 0.3416, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -6.61% (9.2283 => 8.6187, std.dev.: 0.0058) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.59% (0.1716 => 0.1603, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -6.58% (0.9179 => 0.8575, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.58% (0.7919 => 0.7398, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -6.57% (2.4021 => 2.2444, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.55% (0.6484 => 0.6059, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.55% (0.2548 => 0.2381, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.55% (4.5069 => 4.2116, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/08-main/main: -6.54% (0.2659 => 0.2485, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.53% (0.1761 => 0.1646, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -6.50% (0.2985 => 0.2791, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.46% (6.7716 => 6.3342, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.46% (1.3722 => 1.2836, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.46% (0.4151 => 0.3883, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.45% (0.3812 => 0.3566, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.44% (1.2300 => 1.1508, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.43% (0.3891 => 0.3641, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.42% (0.4033 => 0.3774, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.42% (0.3831 => 0.3585, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.42% (0.7198 => 0.6736, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: -6.42% (0.3880 => 0.3631, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.40% (1.4642 => 1.3705, std.dev.: 0.0096) SingleSource/UnitTests/ObjC/exceptions-3: -6.39% (0.3848 => 0.3602, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.39% (1.6364 => 1.5319, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.36% (1.2784 => 1.1971, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.35% (0.1621 => 0.1518, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -6.35% (1.1450 => 1.0723, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -6.35% (0.4176 => 0.3911, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.34% (0.6293 => 0.5894, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/synchronized: -6.34% (0.3896 => 0.3649, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.29% (4.8161 => 4.5133, std.dev.: 0.0036) MultiSource/Applications/lua/lua: -6.29% (4.0594 => 3.8042, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.28% (0.2355 => 0.2207, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.28% (0.3884 => 0.3640, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.27% (4.8802 => 4.5742, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.26% (4.0323 => 3.7798, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.26% (0.3483 => 0.3265, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -6.24% (1.3148 => 1.2327, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.24% (5.4682 => 5.1268, std.dev.: 0.0176) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.23% (0.2695 => 0.2527, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.18% (0.5999 => 0.5628, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.18% (0.6736 => 0.6320, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: -6.17% (15.5079 => 14.5508, std.dev.: 0.0132) MultiSource/Benchmarks/McCat/18-imp/imp: -6.17% (0.3581 => 0.3360, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -6.17% (0.4199 => 0.3940, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.17% (1.6474 => 1.5458, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/parameter-passing: -6.14% (0.4280 => 0.4017, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.13% (0.3931 => 0.3690, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.13% (0.8521 => 0.7999, std.dev.: 0.0023) MultiSource/Benchmarks/sim/sim: -6.11% (0.3406 => 0.3198, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.10% (0.3837 => 0.3603, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -6.10% (0.7447 => 0.6993, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -6.09% (0.4861 => 0.4565, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.08% (0.4916 => 0.4617, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.06% (2.1713 => 2.0397, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.04% (14.2083 => 13.3502, std.dev.: 0.0161) MultiSource/Applications/kimwitu++/kc: -6.03% (18.2933 => 17.1903, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/methcall: -6.02% (0.3025 => 0.2843) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.01% (2.2587 => 2.1229, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: -6.01% (0.3194 => 0.3002, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -5.99% (2.1401 => 2.0120, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: -5.96% (0.4515 => 0.4246, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: -5.95% (1.1530 => 1.0844, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.95% (0.3849 => 0.3620, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -5.92% (0.2989 => 0.2812, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.91% (0.7339 => 0.6905, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: -5.91% (0.4248 => 0.3997, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.90% (0.4321 => 0.4066, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.89% (0.3057 => 0.2877, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.89% (0.2106 => 0.1982, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: -5.89% (0.2871 => 0.2702, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.88% (0.2278 => 0.2144, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: -5.88% (0.3026 => 0.2848, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: -5.88% (3.5154 => 3.3088, std.dev.: 0.0182) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.88% (0.3319 => 0.3124, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.86% (0.5478 => 0.5157, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -5.85% (17.1032 => 16.1022, std.dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.84% (0.3323 => 0.3129, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -5.84% (0.3255 => 0.3065, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.84% (0.3016 => 0.2840, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.82% (0.2903 => 0.2734, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: -5.82% (0.3059 => 0.2881, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -5.81% (0.7982 => 0.7518, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary3: -5.80% (0.3446 => 0.3246, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (0.7021 => 0.6614, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.80% (0.2933 => 0.2763, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -5.78% (0.2939 => 0.2769, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.78% (0.3252 => 0.3064, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.78% (0.4083 => 0.3847, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -5.77% (0.3394 => 0.3198, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.76% (0.5802 => 0.5468, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -5.76% (0.2849 => 0.2685, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.76% (0.5925 => 0.5584, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.75% (0.5705 => 0.5377, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -5.75% (0.3481 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.74% (0.9557 => 0.9008, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -5.74% (0.3621 => 0.3413, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.74% (0.4427 => 0.4173, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.74% (0.6660 => 0.6278, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.73% (0.6667 => 0.6285, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -5.72% (0.6750 => 0.6364, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.72% (0.6681 => 0.6299, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.70% (0.3491 => 0.3292, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.69% (0.6395 => 0.6031, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.69% (0.6260 => 0.5904, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: -5.69% (0.3271 => 0.3085, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.68% (0.5859 => 0.5526, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.68% (0.6194 => 0.5842, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.67% (0.5591 => 0.5274, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.66% (0.5863 => 0.5531, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.66% (0.5581 => 0.5265, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.66% (0.2385 => 0.2250, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: -5.65% (0.3205 => 0.3024, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.65% (0.6446 => 0.6082, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.63% (0.4813 => 0.4542, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.62% (0.5849 => 0.5520, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.62% (0.5569 => 0.5256, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.62% (8.0126 => 7.5623, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.62% (0.6230 => 0.5880, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.61% (0.5329 => 0.5030, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.60% (0.6676 => 0.6302, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -5.59% (34.0927 => 32.1858, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.58% (0.7524 => 0.7104, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -5.57% (0.3788 => 0.3577, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: -5.57% (1.3864 => 1.3092, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.57% (0.1796 => 0.1696, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.56% (0.5805 => 0.5482, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: -5.56% (0.3867 => 0.3652, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.55% (1.2210 => 1.1532, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.55% (0.5857 => 0.5532, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.54% (0.6304 => 0.5955, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.52% (0.5575 => 0.5267, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.52% (0.6052 => 0.5718, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.51% (0.5168 => 0.4883, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -5.50% (0.8418 => 0.7955, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.49% (0.6297 => 0.5951, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.49% (0.6189 => 0.5849, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.47% (1.2221 => 1.1552, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.47% (0.2999 => 0.2835, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.46% (0.5456 => 0.5158, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.46% (0.5567 => 0.5263, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.46% (0.6395 => 0.6046, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.42% (0.5941 => 0.5619, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -5.42% (0.4524 => 0.4279, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.40% (0.6440 => 0.6092, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -5.40% (15.2527 => 14.4290, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.36% (0.5688 => 0.5383, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.31% (0.5570 => 0.5274, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.27% (0.6033 => 0.5715, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.05% (0.2001 => 0.1900, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -5.03% (5.0226 => 4.7700, std.dev.: 0.0097) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.55% (0.9077 => 0.8664, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference: -4.45% (0.7779 => 0.7433, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: -4.41% (1.5610 => 1.4921, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference-object: -4.29% (0.6441 => 0.6165, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.21% (0.6347 => 0.6080, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -2.84% (20.7746 => 20.1856, std.dev.: 0.0429) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.36% (7.5137 => 5.7582, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/richards_benchmark: -8.72% (1.2842 => 1.1722, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: -3.91% (2.2633 => 2.1747, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.91% (1.7753 => 1.7059, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.68% (6.5735 => 6.4628, std.dev.: 0.0075) Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 20:46:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 22:46:25 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121110044625.DA4BE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5729?compare_to=5727&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5729, Order: 167658, Start Time: 2012-11-10 03:20:30, End Time: 2012-11-10 04:46:39 To: 5727, Order: 167650, Start Time: 2012-11-10 01:36:24, End Time: 2012-11-10 03:03:44 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 4 (92 on baseline) Performance Improvements: 1 (26 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 986 (856 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.82% (0.8431 => 0.8669, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.94% (0.6092 => 0.6210, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.73% (1.4711 => 1.4965, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.31% (0.9176 => 0.9296, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/nestedloop: -9.83% (0.2248 => 0.2027, std.dev.: 0.0032) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.29% (16.5716 => 16.7857, std.dev.: 0.1351) MultiSource/Applications/obsequi/Obsequi: 0.11% (1.0626 => 1.0638, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.39% (21.5801 => 21.8799, std.dev.: 0.2407) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.28% (0.3634 => 0.3624, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 0.05% (0.6025 => 0.6028, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.09% (0.3317 => 0.3320, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: -0.20% (0.2003 => 0.1999, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 25.58% (0.0172 => 0.0216, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.70% (0.0428 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.60% (0.0332 => 0.0330, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.89% (0.0317 => 0.0311, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.71% (0.0425 => 0.0422, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0204 => 0.0205, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -0.46% (0.0218 => 0.0217, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.48% (0.1469 => 0.1462, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.72% (1.1279 => 1.1473, std.dev.: 0.0386) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.76% (0.1446 => 0.1435, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 7.59% (0.4216 => 0.4536, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.44% (0.1454 => 0.1433, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -12.87% (0.0668 => 0.0582, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -17.65% (0.0272 => 0.0224, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.72% (0.0551 => 0.0566, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.39% (1.1945 => 1.1898, std.dev.: 0.0282) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.22% (0.0640 => 0.0581, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.66% (0.0268 => 0.0218, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.21% (0.7797 => 0.7781, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -56.41% (0.0117 => 0.0051, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2303.63% (0.6332 => 15.2198, std.dev.: 0.1189) MultiSource/Benchmarks/McCat/08-main/main: 48.12% (0.1831 => 0.2712, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.06% (0.1559 => 0.1449, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1494.56% (0.3344 => 5.3322, std.dev.: 0.0812) SingleSource/Benchmarks/Misc-C++/Large/ray: 33.88% (0.2364 => 0.3165, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel: 2.80% (0.0429 => 0.0441, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.36% (0.0224 => 0.0236, std.dev.: 0.0019) SingleSource/UnitTests/byval-alignment: -28.26% (0.0230 => 0.0165, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4431, std.dev.: 0.0490) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0691, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4957, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3378, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1344, std.dev.: 0.0362) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4094, std.dev.: 0.0043) SingleSource/Regression/C/uint64_to_float: -24.16% (2.1832 => 1.6558, std.dev.: 0.0042) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.93% (0.0810 => 0.0939, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 12.95% (0.1112 => 0.1256, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.45% (0.1905 => 0.2047, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.79% (0.2180 => 0.2328, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.76% (0.1983 => 0.2117, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.39% (0.8148 => 0.8669, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.25% (0.3295 => 0.3468, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.95% (0.7473 => 0.7843, std.dev.: 0.0137) MultiSource/Applications/spiff/spiff: 4.30% (0.7950 => 0.8292, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.18% (0.5961 => 0.6210, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.05% (0.4127 => 0.4294, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.63% (0.6287 => 0.6515, std.dev.: 0.0080) MultiSource/Applications/hbd/hbd: 3.52% (1.4269 => 1.4771, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.36% (1.4479 => 1.4965, std.dev.: 0.0067) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.00% (6.6074 => 6.8054, std.dev.: 0.0479) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.97% (4.1763 => 4.3002, std.dev.: 0.0340) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.84% (0.8697 => 0.8944, std.dev.: 0.0070) MultiSource/Applications/SPASS/SPASS: 2.81% (14.2605 => 14.6613, std.dev.: 0.0929) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.78% (1.1170 => 1.1481, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.77% (0.7932 => 0.8152, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.72% (0.8611 => 0.8845, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 2.71% (1.1271 => 1.1577, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.65% (0.9056 => 0.9296, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.62% (0.8007 => 0.8217, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 2.55% (2.2184 => 2.2750, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.48% (0.8457 => 0.8667, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.45% (0.8597 => 0.8808, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.45% (0.8317 => 0.8521, std.dev.: 0.0070) MultiSource/Benchmarks/Bullet/bullet: 2.45% (31.8598 => 32.6407, std.dev.: 0.1290) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.41% (0.6227 => 0.6377, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 2.36% (6.7320 => 6.8906, std.dev.: 0.0573) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.35% (0.9688 => 0.9916, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.35% (0.9074 => 0.9287, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.34% (0.8805 => 0.9011, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.27% (4.4880 => 4.5901, std.dev.: 0.0256) MultiSource/Applications/lua/lua: 2.27% (3.8189 => 3.9054, std.dev.: 0.0266) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.26% (0.8716 => 0.8913, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.25% (0.8261 => 0.8447, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 2.22% (8.6247 => 8.8159, std.dev.: 0.0076) MultiSource/Applications/d/make_dparser: 2.19% (3.2366 => 3.3074, std.dev.: 0.0223) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.16% (0.8712 => 0.8900, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.14% (0.8069 => 0.8242, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.13% (0.8338 => 0.8516, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.10% (0.8066 => 0.8235, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.09% (0.8359 => 0.8534, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.09% (0.8768 => 0.8951, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.06% (4.5702 => 4.6645, std.dev.: 0.0274) MultiSource/Benchmarks/PAQ8p/paq8p: 2.06% (2.3764 => 2.4253, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.06% (13.1811 => 13.4523, std.dev.: 0.0498) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.01% (0.8656 => 0.8830, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.94% (0.8177 => 0.8336, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.94% (0.8927 => 0.9100, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.91% (1.5315 => 1.5608, std.dev.: 0.0104) MultiSource/Applications/oggenc/oggenc: 1.84% (4.9628 => 5.0542, std.dev.: 0.0350) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.79% (0.8316 => 0.8465, std.dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 1.77% (15.3280 => 15.5996, std.dev.: 0.1029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.69% (0.6586 => 0.6697, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.62% (1.2423 => 1.2624, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.60% (0.8995 => 0.9139, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 107.04% (0.0199 => 0.0412, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/pi: 57.61% (1.5795 => 2.4895, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.39% (2.9753 => 3.4631, std.dev.: 0.1185) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.23% (0.7597 => 0.8830, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.42% (2.7995 => 3.2031, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.63% (5.0261 => 5.6106, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.60% (6.3772 => 6.9254, std.dev.: 0.1487) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.96% (1.1857 => 1.2801, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 7.02% (1.7056 => 1.8254, std.dev.: 0.0078) MultiSource/Applications/SIBsim4/SIBsim4: 6.66% (3.1873 => 3.3995, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.57% (4.7794 => 5.0934, std.dev.: 0.0910) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.34% (0.3186 => 0.3388, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.91% (4.9686 => 5.2624, std.dev.: 0.1086) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.91% (4.5327 => 4.8004, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/richards_benchmark: 5.77% (1.3037 => 1.3789, std.dev.: 0.0244) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.69% (3.3761 => 3.5344, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.52% (6.2275 => 6.5091, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.31% (4.9453 => 5.1583, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.15% (4.9469 => 5.1521, std.dev.: 0.0546) MultiSource/Benchmarks/Olden/treeadd/treeadd: 4.01% (0.3587 => 0.3731, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.35% (1.2337 => 1.2750, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.81% (11.5690 => 11.8939, std.dev.: 0.0163) MultiSource/Applications/lambda-0_1_3/lambda: 2.74% (7.4933 => 7.6988, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout/lists: 2.63% (7.3375 => 7.5308, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.59% (8.2783 => 8.4924, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.54% (4.8660 => 4.9897, std.dev.: 0.0207) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.33% (4.8362 => 4.9487, std.dev.: 0.0241) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.96% (1.1365 => 1.1588, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.47% (2.4647 => 2.5010, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/neural/neural: 1.36% (1.0841 => 1.0988) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.14% (4.4340 => 4.4846, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/ReedSolomon: 1.14% (8.5322 => 8.6295, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.12% (3.5679 => 3.6078, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.56% (5.4641 => 4.3405, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.43% (1.0512 => 0.9311, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: -10.48% (1.1216 => 1.0041, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -9.65% (7.2130 => 6.5166, std.dev.: 0.1870) MultiSource/Benchmarks/mafft/pairlocalalign: -8.47% (63.1822 => 57.8329, std.dev.: 0.1436) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.94% (4.7482 => 4.4186, std.dev.: 0.0230) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.27% (0.3269 => 0.3064, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.98% (3.7148 => 3.4927, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.84% (5.4972 => 5.1759, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.06% (5.1557 => 4.8946, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.40% (4.7449 => 4.5362, std.dev.: 0.0145) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.37% (2.8773 => 2.7516, std.dev.: 0.0240) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.76% (6.0224 => 5.7959, std.dev.: 0.0123) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.16% (1.2822 => 1.2417, std.dev.: 0.0087) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.06% (28.5821 => 27.7076, std.dev.: 0.0163) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.84% (0.5807 => 0.5642, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.69% (2.6356 => 2.5647, std.dev.: 0.0060) MultiSource/Applications/aha/aha: -2.44% (3.3398 => 3.2584, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.23% (9.9065 => 9.6854, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/hash2: -2.20% (3.4237 => 3.3484, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bisort/bisort: -2.11% (0.6636 => 0.6496, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.03% (11.5316 => 11.2971, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.60% (4.9994 => 4.9192, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/ffbench: -1.56% (1.4296 => 1.4073, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.3487 => 2.3206, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.18% (3.2169 => 3.1789, std.dev.: 0.0126) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.06% (16.4461 => 16.7857, std.dev.: 0.1351) MultiSource/Applications/obsequi/Obsequi: 3.66% (1.0262 => 1.0638, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6906.05% (0.3123 => 21.8799, std.dev.: 0.2407) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.14% (0.2463 => 0.3624, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 0.30% (0.6010 => 0.6028, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.65% (0.3266 => 0.3320, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 1.52% (0.1969 => 0.1999, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 75.61% (0.0123 => 0.0216, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.98% (0.0302 => 0.0311, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.67% (0.1438 => 0.1462, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.27% (1.1329 => 1.1473, std.dev.: 0.0386) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.85% (0.1462 => 0.1435, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 8.93% (0.4164 => 0.4536, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.67% (0.1369 => 0.1433, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.20% (0.0641 => 0.0582, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 14.87% (0.0195 => 0.0224, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.08% (0.0578 => 0.0566, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.03% (1.1437 => 1.1898, std.dev.: 0.0282) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.34% (0.0627 => 0.0581, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 21.11% (0.0180 => 0.0218, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.94% (0.8017 => 0.7781, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -17.74% (0.0062 => 0.0051, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 21:24:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 23:24:40 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121110052440.294792A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5730?compare_to=5728&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5730, Order: 167660, Start Time: 2012-11-10 04:00:01, End Time: 2012-11-10 05:24:50 To: 5728, Order: 167654, Start Time: 2012-11-10 02:11:57, End Time: 2012-11-10 03:36:50 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (182 on baseline) Unchanged Tests: 1041 (856 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.54% (78.9600 => 80.1764, std.dev.: 0.3400) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1008, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.4937 => 7.6822, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 1.85% (3.1932 => 3.2524, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.43% (0.1431 => 0.1296, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.11% (0.3821 => 0.3511, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -7.93% (2.4924 => 2.2948, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.20% (0.9542 => 0.8855, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: -7.15% (0.3357 => 0.3117, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.03% (0.3142 => 0.2921, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.92% (0.2428 => 0.2260, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.89% (3.5339 => 3.2905, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/oourafft: -6.85% (0.2160 => 0.2012, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -6.74% (0.3812 => 0.3555, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -6.73% (9.2283 => 8.6068, std.dev.: 0.0086) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.73% (0.9852 => 0.9189, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.73% (22.4056 => 20.8978, std.dev.: 0.0182) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.71% (0.3891 => 0.3630, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.70% (0.3848 => 0.3590, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -6.69% (16.1920 => 15.1086, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: -6.68% (7.0961 => 6.6224, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.64% (0.3884 => 0.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.62% (0.4151 => 0.3876, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: -6.62% (0.4033 => 0.3766, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.62% (0.3658 => 0.3416, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.60% (0.3831 => 0.3578, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -6.60% (0.3880 => 0.3624, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.59% (0.6484 => 0.6057, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -6.59% (0.4176 => 0.3901, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.58% (1.0544 => 0.9850, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/synchronized: -6.57% (0.3896 => 0.3640, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.57% (0.1796 => 0.1678, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -6.53% (0.9179 => 0.8580, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.52% (1.3722 => 1.2828, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -6.48% (0.4199 => 0.3927, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: -6.46% (1.2515 => 1.1706, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash2: -6.46% (0.4861 => 0.4547, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.45% (1.4642 => 1.3698, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: -6.45% (0.3025 => 0.2830, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -6.43% (1.3148 => 1.2303, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.41% (0.2355 => 0.2204) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.41% (0.1716 => 0.1606, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.41% (1.2300 => 1.1512, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.41% (2.1713 => 2.0322, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/strcat: -6.39% (0.2989 => 0.2798, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -6.39% (0.1879 => 0.1759, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.39% (4.5069 => 4.2191, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -6.37% (0.2871 => 0.2688, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -6.37% (0.2985 => 0.2795, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.36% (1.6364 => 1.5324, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/except: -6.35% (0.3026 => 0.2834, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.34% (1.2784 => 1.1974, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/parameter-passing: -6.33% (0.4280 => 0.4009, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -6.33% (0.3446 => 0.3228, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.31% (4.8802 => 4.5725, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: -6.29% (0.2939 => 0.2754, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.29% (4.8161 => 4.5130, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: -6.29% (0.3194 => 0.2993, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.28% (0.3931 => 0.3684, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: -6.28% (0.2849 => 0.2670, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.28% (0.3057 => 0.2865, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -6.28% (1.1450 => 1.0731, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.28% (4.0323 => 3.7791, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: -6.28% (0.3394 => 0.3181, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.27% (0.3016 => 0.2827, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -6.25% (0.1761 => 0.1651, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.25% (0.4083 => 0.3828, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.24% (0.3849 => 0.3609, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.23% (0.3837 => 0.3598, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: -6.22% (15.5079 => 14.5433, std.dev.: 0.0150) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.21% (6.7716 => 6.3510, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: -6.21% (0.3255 => 0.3053, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/nestedloop: -6.21% (0.2933 => 0.2751, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.20% (0.7919 => 0.7428, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.18% (0.6293 => 0.5904, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: -6.18% (0.3059 => 0.2870, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -6.17% (4.3330 => 4.0655, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/08-main/main: -6.17% (0.2659 => 0.2495, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.15% (0.3252 => 0.3052, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: -6.14% (0.7447 => 0.6990, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: -6.12% (1.1530 => 1.0824, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -6.12% (0.3481 => 0.3268, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/wc: -6.12% (0.3205 => 0.3009, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.10% (0.5999 => 0.5633, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: -6.09% (0.4515 => 0.4240, std.dev.: 0.0012) MultiSource/Applications/lua/lua: -6.09% (4.0594 => 3.8123, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.09% (0.3483 => 0.3271, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.09% (0.2695 => 0.2531, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -6.07% (0.4248 => 0.3990) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.05% (0.3323 => 0.3122, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -6.05% (0.3406 => 0.3200, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.04% (0.4321 => 0.4060, std.dev.: 0.0009) MultiSource/Applications/siod/siod: -6.04% (2.4021 => 2.2571, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.03% (1.6474 => 1.5480, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.02% (5.4682 => 5.1391, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.00% (0.2548 => 0.2395, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.99% (0.2903 => 0.2729, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.98% (0.7021 => 0.6601, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.98% (0.5168 => 0.4859, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -5.97% (0.4524 => 0.4254, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: -5.97% (0.3788 => 0.3562, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.94% (0.4813 => 0.4527, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: -5.94% (34.0927 => 32.0673, std.dev.: 0.0137) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.94% (0.4916 => 0.4624, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.93% (0.9557 => 0.8990, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: -5.93% (0.6750 => 0.6350, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -5.91% (0.3621 => 0.3407, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.90% (0.8521 => 0.8018, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.90% (0.2999 => 0.2822, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.90% (0.7339 => 0.6906, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.88% (0.6736 => 0.6340, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.87% (0.5705 => 0.5370, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.86% (0.7524 => 0.7083, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: -5.85% (1.3864 => 1.3053, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.85% (0.6395 => 0.6021, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.85% (14.2083 => 13.3776, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.84% (0.6304 => 0.5936, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: -5.84% (0.3581 => 0.3372, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.83% (0.6052 => 0.5699, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: -5.83% (3.5154 => 3.3104, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: -5.82% (17.1032 => 16.1073, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.82% (0.5863 => 0.5522, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.81% (0.5802 => 0.5465, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.80% (0.6260 => 0.5897, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.80% (0.5329 => 0.5020, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.79% (2.2587 => 2.1279, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.79% (0.6446 => 0.6073, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.79% (0.3491 => 0.3289, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.78% (0.7198 => 0.6782, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: -5.76% (18.2933 => 17.2388, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.76% (8.0126 => 7.5511, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.75% (0.5581 => 0.5260, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -5.74% (0.3867 => 0.3645, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.72% (0.5857 => 0.5522, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.71% (0.5478 => 0.5165, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.71% (0.2278 => 0.2148, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.70% (0.5925 => 0.5587, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.70% (0.6230 => 0.5875, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.68% (0.6667 => 0.6288, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.68% (0.6194 => 0.5842, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.67% (0.5591 => 0.5274, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.66% (0.6676 => 0.6298, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.66% (0.6660 => 0.6283, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.66% (0.5941 => 0.5605, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.64% (0.5570 => 0.5256, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.62% (0.5849 => 0.5520, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.62% (0.5569 => 0.5256, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.62% (0.2385 => 0.2251, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.60% (0.6681 => 0.6307, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.60% (0.5575 => 0.5263, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: -5.59% (2.1401 => 2.0204, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.59% (0.5456 => 0.5151, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.58% (0.6395 => 0.6038, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.57% (0.6440 => 0.6081, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.57% (0.6189 => 0.5844, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -5.56% (0.7982 => 0.7538, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.56% (0.2106 => 0.1989, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.55% (0.5805 => 0.5483, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.48% (0.3319 => 0.3137, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.46% (0.5567 => 0.5263, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.43% (0.6297 => 0.5955, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.43% (1.2210 => 1.1547, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.42% (0.6033 => 0.5706, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -5.40% (15.2527 => 14.4292, std.dev.: 0.0063) MultiSource/Applications/spiff/spiff: -5.38% (0.8418 => 0.7965, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.38% (0.5688 => 0.5382, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: -5.32% (0.3271 => 0.3097, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.30% (1.2221 => 1.1573, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.30% (0.2001 => 0.1895, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: -5.10% (0.7779 => 0.7382, std.dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: -4.90% (5.0226 => 4.7764, std.dev.: 0.0044) SingleSource/UnitTests/ObjC++/Hello: -4.70% (0.6347 => 0.6049, std.dev.: 0.0062) SingleSource/UnitTests/ObjC++/property-reference-object: -4.61% (0.6441 => 0.6144, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.51% (0.9077 => 0.8668, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: -4.48% (1.5610 => 1.4910, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -2.54% (20.7746 => 20.2462, std.dev.: 0.0254) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7516, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: -3.92% (2.2633 => 2.1746, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7069, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4699, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.02% (1.6086 => 1.5922, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0004) Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 21:56:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 9 Nov 2012 23:56:42 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121110055642.9C6EE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5731?compare_to=5726&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5731, Order: 167655, Start Time: 2012-11-10 02:41:09, End Time: 2012-11-10 05:56:54 To: 5726, Order: 167635, Start Time: 2012-11-09 22:37:24, End Time: 2012-11-10 01:53:07 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (174 on baseline) Performance Improvements: 9 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1031 (717 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.16% (124.1520 => 128.0781, std.dev.: 1.3461) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.41% (2.0883 => 2.1178, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (2.4144 => 2.3778, std.dev.: 0.0042) SingleSource/UnitTests/ObjC++/property-reference-object: -1.43% (0.7055 => 0.6954, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.39% (3.2113 => 3.1667, std.dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: -1.37% (2.0115 => 1.9840, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.36% (5.1766 => 5.1063, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: -1.34% (0.8422 => 0.8309, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.27% (1.5712 => 1.5512, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: -1.25% (1.2686 => 1.2527, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.08% (4.2300 => 4.1845, std.dev.: 0.0039) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.76% (0.0625 => 0.0886, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.74% (0.1063 => 0.1411, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.37% (0.2969 => 0.3752, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.68% (0.1106 => 0.1390, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.51% (0.4253 => 0.5338, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.96% (0.4139 => 0.5172, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.93% (0.0714 => 0.0892, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 24.53% (1.5932 => 1.9840, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.39% (0.5900 => 0.7339, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.79% (0.0475 => 0.0588, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.67% (0.4994 => 0.6176, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.58% (0.0547 => 0.0676, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.32% (0.5000 => 0.6166, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.29% (0.0584 => 0.0720, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.78% (0.1620 => 0.1989, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.33% (0.1021 => 0.1249, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.30% (0.0897 => 0.1097, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/tsp/tsp: 22.20% (0.0599 => 0.0732, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.13% (0.1107 => 0.1352, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.32% (0.1604 => 0.1946, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 21.20% (0.0948 => 0.1149, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.17% (0.0633 => 0.0767) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.06% (0.0584 => 0.0707, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.03% (0.1103 => 0.1335, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.81% (0.0495 => 0.0598) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.72% (0.0642 => 0.0775, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.63% (0.3903 => 0.4708, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 20.58% (0.0821 => 0.0990, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.56% (0.0822 => 0.0991, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.34% (0.1003 => 0.1207, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.34% (0.1549 => 0.1864, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 20.26% (0.1619 => 0.1947, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 20.03% (0.0604 => 0.0725, std.dev.: 0.0019) MultiSource/Applications/viterbi/viterbi: 19.32% (0.0947 => 0.1130, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.24% (0.0582 => 0.0694, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.15% (0.1462 => 0.1742, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 18.94% (0.0808 => 0.0961, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.77% (0.2014 => 0.2392, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.66% (0.3890 => 0.4616, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: 18.56% (0.1218 => 0.1444, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 18.48% (0.0698 => 0.0827, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.28% (0.1160 => 0.1372, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 18.26% (0.5826 => 0.6890, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 18.09% (0.4029 => 0.4758, std.dev.: 0.0057) SingleSource/UnitTests/ObjC++/property-reference-object: 18.08% (0.5889 => 0.6954, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 18.07% (0.0581 => 0.0686, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.94% (1.3152 => 1.5512, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.92% (0.1088 => 0.1283, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.91% (0.2736 => 0.3226, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 17.81% (0.1505 => 0.1773, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.79% (0.2866 => 0.3376, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.66% (0.0572 => 0.0673, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.54% (0.4658 => 0.5475, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.53% (0.1968 => 0.2313, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 17.52% (1.8794 => 2.2087, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.46% (0.3271 => 0.3842, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.45% (3.5627 => 4.1845, std.dev.: 0.0039) MultiSource/Applications/Burg/burg: 17.20% (0.5546 => 0.6500, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.05% (0.5026 => 0.5883, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.93% (1.6211 => 1.8956, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: 16.71% (0.9697 => 1.1317, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.54% (0.3930 => 0.4580, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.52% (0.2875 => 0.3350, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 16.40% (0.1421 => 0.1654, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.37% (0.4361 => 0.5075, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 16.20% (1.0781 => 1.2527, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: 16.04% (0.1284 => 0.1490, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.03% (2.7292 => 3.1667, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.00% (0.2738 => 0.3176, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 15.95% (0.2714 => 0.3147, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 15.90% (4.2109 => 4.8804, std.dev.: 0.0102) SingleSource/UnitTests/ObjC++/property-reference: 15.87% (0.7171 => 0.8309, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: 15.83% (0.2780 => 0.3220, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 15.82% (0.2725 => 0.3156, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 15.78% (0.2813 => 0.3257, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 15.73% (0.2823 => 0.3267, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 15.71% (0.2750 => 0.3182, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.68% (0.2729 => 0.3157, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 15.62% (0.2811 => 0.3250, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 15.61% (0.3004 => 0.3473, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 15.59% (0.2803 => 0.3240, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.57% (1.9694 => 2.2760, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.54% (0.2792 => 0.3226, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.54% (4.4195 => 5.1063, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.45% (1.9966 => 2.3050, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 15.38% (0.9909 => 1.1433, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.34% (0.3195 => 0.3685, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 15.28% (0.3096 => 0.3569, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.22% (2.0673 => 2.3820, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.18% (0.2911 => 0.3353, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 15.16% (0.2566 => 0.2955, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.05% (0.1090 => 0.1254, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 14.97% (0.3267 => 0.3756, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 14.78% (23.5202 => 26.9959, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary: 14.76% (0.3258 => 0.3739, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 14.65% (0.2075 => 0.2379, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 14.59% (0.3317 => 0.3801, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.54% (0.3362 => 0.3851, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.54% (0.3845 => 0.4404, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.51% (0.3060 => 0.3504, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 14.33% (0.4146 => 0.4740, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.18% (0.3124 => 0.3567, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 14.15% (0.3442 => 0.3929, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 14.11% (1.4269 => 1.6282, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.11% (0.3282 => 0.3745, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.11% (0.3488 => 0.3980, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 14.07% (0.3446 => 0.3931, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.07% (0.3496 => 0.3988, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 14.03% (0.3678 => 0.4194, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 14.01% (0.3469 => 0.3955, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.00% (0.3465 => 0.3950, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 13.98% (0.3726 => 0.4247, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.93% (0.3460 => 0.3942, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 13.92% (0.3348 => 0.3814, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.74% (0.3625 => 0.4123, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.72% (0.3981 => 0.4527, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists1: 13.69% (0.3477 => 0.3953, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 13.67% (0.3650 => 0.4149, std.dev.: 0.0079) MultiSource/Applications/treecc/treecc: 13.60% (0.7875 => 0.8946, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions: 13.59% (0.3643 => 0.4138, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 13.55% (0.4251 => 0.4827, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 13.53% (2.1653 => 2.4582, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.52% (0.3690 => 0.4189, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 13.45% (0.3724 => 0.4225, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 13.37% (4.6177 => 5.2351, std.dev.: 0.0075) MultiSource/Benchmarks/mafft/pairlocalalign: 13.16% (2.1013 => 2.3778, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/bigfib: 12.95% (0.5012 => 0.5661, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.79% (0.2040 => 0.2301, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.65% (0.1383 => 0.1558, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 12.34% (0.2691 => 0.3023, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 11.99% (5.5417 => 6.2063, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.78% (0.6435 => 0.7193, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 11.26% (0.3498 => 0.3892, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.19% (0.1028 => 0.1143, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.98% (0.2068 => 0.2295, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 10.91% (0.6634 => 0.7358, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.89% (0.2737 => 0.3035) MultiSource/Benchmarks/PAQ8p/paq8p: 10.65% (0.4847 => 0.5363, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.47% (0.3084 => 0.3407, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 10.07% (0.3336 => 0.3672, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.94% (0.2103 => 0.2312, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 9.77% (2.0346 => 2.2334, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 9.37% (0.2391 => 0.2615, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.86% (0.5361 => 0.5836, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.71% (4.6926 => 5.1012, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.59% (11.6398 => 12.6402, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.13% (0.7426 => 0.8030, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.02% (0.5584 => 0.6032, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 6.73% (11.9555 => 12.7598, std.dev.: 0.0134) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.64% (0.3792 => 0.3968, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 9.39% (0.2802 => 0.3065, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6089, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.88% (0.3693 => 0.3910, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6704, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops: 4.66% (15.4430 => 16.1625, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-2: 4.57% (1.8057 => 1.8882, std.dev.: 0.0058) SingleSource/Benchmarks/Dhrystone/dry: 4.17% (14.0481 => 14.6338, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary3: 2.15% (15.8721 => 16.2128, std.dev.: 0.0406) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.72% (2.0820 => 2.1178, std.dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.61% (3.1722 => 3.2232, std.dev.: 0.0040) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3046, std.dev.: 0.0154) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2887, std.dev.: 0.0041) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5941, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5607, std.dev.: 0.0129) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9776, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8007, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -6.58% (0.2402 => 0.2244, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8016, std.dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/fldry: -3.33% (17.2379 => 16.6642, std.dev.: 0.1216) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.26% (0.6293 => 0.6151, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8594, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5767, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4953, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1626, std.dev.: 0.0817) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0436, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 22:29:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 10 Nov 2012 00:29:47 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121110062947.40BA12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5732?compare_to=5729&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5732, Order: 167663, Start Time: 2012-11-10 05:04:03, End Time: 2012-11-10 06:30:00 To: 5729, Order: 167658, Start Time: 2012-11-10 03:20:30, End Time: 2012-11-10 04:46:39 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 1 (88 on baseline) Performance Improvements: 2 (26 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 988 (860 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.94% (1.1985 => 1.2218, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.86% (1.4965 => 1.4686, std.dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -2.21% (6.9254 => 6.7726, std.dev.: 0.0467) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.47% (16.7857 => 16.7073, std.dev.: 0.0670) MultiSource/Applications/obsequi/Obsequi: -1.96% (1.0638 => 1.0429, std.dev.: 0.0165) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.78% (21.8799 => 21.7103, std.dev.: 0.1216) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.25% (0.3624 => 0.3633, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: -0.25% (0.6028 => 0.6013, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.54% (0.3320 => 0.3302, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: -0.05% (0.1999 => 0.1998, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.31% (0.0216 => 0.0211, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -11.76% (0.0425 => 0.0375, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -20.30% (0.0330 => 0.0263, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.64% (0.0311 => 0.0313, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.24% (0.0422 => 0.0423, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: -18.05% (0.0205 => 0.0168, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/test1: -39.63% (0.0217 => 0.0131, std.dev.: 0.0038) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: - (0.1462 => 0.1462, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.12% (1.1473 => 1.1345, std.dev.: 0.0180) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1435 => 0.1434, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.46% (0.4536 => 0.4243, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.77% (0.1433 => 0.1487, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.23% (0.0582 => 0.0595, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.46% (0.0224 => 0.0214, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.24% (0.0566 => 0.0590, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.48% (1.1898 => 1.1955, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.44% (0.0581 => 0.0561, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 13.30% (0.0218 => 0.0247, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.10% (0.7781 => 0.7773, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 19.61% (0.0051 => 0.0061, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2303.55% (0.6332 => 15.2193, std.dev.: 0.1082) MultiSource/Benchmarks/McCat/08-main/main: 47.57% (0.1831 => 0.2702, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.62% (0.1559 => 0.1409, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1485.26% (0.3344 => 5.3011, std.dev.: 0.0353) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.46% (0.2364 => 0.3226, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: 3.03% (0.0429 => 0.0442, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -12.05% (0.0224 => 0.0197, std.dev.: 0.0021) SingleSource/UnitTests/byval-alignment: -31.30% (0.0230 => 0.0158, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4395, std.dev.: 0.0128) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0719, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4951, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3341, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1351, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4055, std.dev.: 0.0009) SingleSource/Regression/C/uint64_to_float: -23.96% (2.1832 => 1.6602, std.dev.: 0.0044) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.43% (0.0810 => 0.0935, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 10.17% (0.1062 => 0.1170, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/tsp/tsp: 9.35% (0.1112 => 0.1216, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.29% (0.8321 => 0.8844, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.88% (0.2279 => 0.2413, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.83% (0.1905 => 0.2016, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.75% (0.1983 => 0.2097, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.27% (1.1606 => 1.2218, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.56% (0.4127 => 0.4315, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.10% (0.2998 => 0.3121, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.45% (0.8611 => 0.8908, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.29% (0.8261 => 0.8533, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.00% (0.8007 => 0.8247, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.88% (0.9056 => 0.9317, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.83% (0.8457 => 0.8696, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.70% (0.5817 => 0.5974, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.67% (0.8204 => 0.8423, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.66% (0.9908 => 1.0172, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.61% (0.9074 => 0.9311, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.59% (0.4559 => 0.4677, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.56% (0.9688 => 0.9936, std.dev.: 0.0051) MultiSource/Applications/lua/lua: 2.55% (3.8189 => 3.9163, std.dev.: 0.0366) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.54% (0.9039 => 0.9269, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.53% (0.8331 => 0.8542, std.dev.: 0.0021) MultiSource/Applications/SIBsim4/SIBsim4: 2.50% (1.2568 => 1.2882, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.47% (0.8855 => 0.9074, std.dev.: 0.0059) MultiSource/Applications/minisat/minisat: 2.47% (0.6834 => 0.7003, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.44% (0.9069 => 0.9290, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.42% (0.8885 => 0.9100, std.dev.: 0.0056) MultiSource/Applications/SPASS/SPASS: 2.32% (14.2605 => 14.5918, std.dev.: 0.0828) MultiSource/Applications/siod/siod: 2.30% (2.2184 => 2.2694, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.29% (4.1763 => 4.2721, std.dev.: 0.0305) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.28% (0.8597 => 0.8793, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.25% (0.8317 => 0.8504, std.dev.: 0.0037) MultiSource/Applications/oggenc/oggenc: 2.24% (4.9628 => 5.0739, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.23% (0.8359 => 0.8545, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 2.17% (3.2366 => 3.3068, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.14% (0.8316 => 0.8494, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.14% (0.8518 => 0.8700, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.12% (0.7932 => 0.8100, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.06% (0.8066 => 0.8232, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.05% (0.8086 => 0.8252, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.02% (0.8656 => 0.8831, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.98% (0.8716 => 0.8889, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.97% (0.8177 => 0.8338, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.95% (0.8805 => 0.8977, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.95% (1.6386 => 1.6705, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.92% (0.8697 => 0.8864, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.89% (0.8420 => 0.8579, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.86% (0.7966 => 0.8114, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.80% (0.8712 => 0.8869, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.1401 => 2.1763, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.63% (1.5315 => 1.5565, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.62% (0.8340 => 0.8475, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.61% (0.8927 => 0.9071, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 1.32% (1.0945 => 1.1089, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.18% (3.1832 => 3.2207, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 122.61% (0.0199 => 0.0443, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/pi: 58.66% (1.5795 => 2.5061, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.56% (0.7597 => 0.8855, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.42% (2.9753 => 3.4638, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.75% (2.7995 => 3.2125, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 12.27% (5.0261 => 5.6427, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.60% (0.3186 => 0.3460, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.90% (1.1857 => 1.2794, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 7.50% (1.7056 => 1.8336, std.dev.: 0.0113) MultiSource/Applications/SIBsim4/SIBsim4: 6.90% (3.1873 => 3.4073, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.69% (4.7794 => 5.0992, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.20% (6.3772 => 6.7726, std.dev.: 0.0467) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.04% (4.5327 => 4.8065, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.77% (4.9686 => 5.2554, std.dev.: 0.0341) SingleSource/Benchmarks/Misc/richards_benchmark: 5.75% (1.3037 => 1.3786, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.71% (3.3761 => 3.5352, std.dev.: 0.0301) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.50% (6.2275 => 6.5079, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.34% (4.9453 => 5.1598, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.08% (4.9469 => 5.1486, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 3.84% (14.0064 => 14.5443, std.dev.: 0.0859) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.15% (0.3587 => 0.3700, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.81% (1.2337 => 1.2684, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.75% (4.8362 => 4.9691, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.70% (11.5690 => 11.8817, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.70% (8.2783 => 8.5015, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.58% (4.8660 => 4.9914, std.dev.: 0.0113) MultiSource/Applications/lambda-0_1_3/lambda: 2.56% (7.4933 => 7.6849, std.dev.: 0.0411) SingleSource/Benchmarks/Shootout/lists: 2.35% (7.3375 => 7.5096, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.14% (1.1365 => 1.1608, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.65% (2.4647 => 2.5053, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.15% (3.5679 => 3.6090, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.20% (5.4641 => 4.3059, std.dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.31% (1.0512 => 0.9323, std.dev.: 0.0063) SingleSource/Benchmarks/McGill/chomp: -11.05% (1.1216 => 0.9977, std.dev.: 0.0375) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -9.59% (7.2130 => 6.5210, std.dev.: 0.0317) MultiSource/Benchmarks/mafft/pairlocalalign: -8.54% (63.1822 => 57.7834, std.dev.: 0.0328) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.82% (4.7482 => 4.4244, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.42% (0.3269 => 0.3059, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: -6.07% (0.1698 => 0.1595, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.87% (5.4972 => 5.1745, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.02% (5.1557 => 4.8969, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.37% (4.7449 => 4.5375, std.dev.: 0.0136) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.81% (2.8773 => 2.7678, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.61% (6.0224 => 5.8052, std.dev.: 0.0417) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.28% (1.2822 => 1.2402, std.dev.: 0.0149) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.06% (28.5821 => 27.7074, std.dev.: 0.0154) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.89% (0.5807 => 0.5639, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.75% (2.6356 => 2.5631, std.dev.: 0.0020) MultiSource/Applications/aha/aha: -2.41% (3.3398 => 3.2592, std.dev.: 0.0137) MultiSource/Benchmarks/FreeBench/mason/mason: -2.31% (0.5415 => 0.5290, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.29% (9.9065 => 9.6800, std.dev.: 0.0434) SingleSource/Benchmarks/Shootout-C++/hash2: -2.07% (3.4237 => 3.3527, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.02% (3.2169 => 3.1519, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.90% (11.5316 => 11.3128, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.43% (4.9994 => 4.9281, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.3487 => 2.3200, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.18% (5.6343 => 5.5680, std.dev.: 0.0237) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.59% (16.4461 => 16.7073, std.dev.: 0.0670) MultiSource/Applications/obsequi/Obsequi: 1.63% (1.0262 => 1.0429, std.dev.: 0.0165) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6851.75% (0.3123 => 21.7103, std.dev.: 0.1216) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.50% (0.2463 => 0.3633, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: 0.05% (0.6010 => 0.6013, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.10% (0.3266 => 0.3302, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 1.47% (0.1969 => 0.1998, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 71.54% (0.0123 => 0.0211, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -8.09% (0.0408 => 0.0375, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.54% (0.0254 => 0.0263, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: -11.58% (0.0190 => 0.0168, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/test1: -27.22% (0.0180 => 0.0131, std.dev.: 0.0038) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.67% (0.1438 => 0.1462, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.14% (1.1329 => 1.1345, std.dev.: 0.0180) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.92% (0.1462 => 0.1434, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.90% (0.4164 => 0.4243, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.62% (0.1369 => 0.1487, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.18% (0.0641 => 0.0595, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 9.74% (0.0195 => 0.0214, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.08% (0.0578 => 0.0590, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.53% (1.1437 => 1.1955, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.53% (0.0627 => 0.0561, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 37.22% (0.0180 => 0.0247, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.04% (0.8017 => 0.7773, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -1.61% (0.0062 => 0.0061, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 23:12:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 10 Nov 2012 01:12:28 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121110071228.1E8A92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5733?compare_to=5730&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5733, Order: 167665, Start Time: 2012-11-10 05:47:56, End Time: 2012-11-10 07:12:40 To: 5730, Order: 167660, Start Time: 2012-11-10 04:00:01, End Time: 2012-11-10 05:24:50 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (180 on baseline) Unchanged Tests: 1041 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.61% (0.7382 => 0.7501, std.dev.: 0.0021) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1016, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4937 => 7.6678, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/hash2: 1.88% (3.1932 => 3.2531, std.dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.08% (0.1431 => 0.1301, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.24% (0.3821 => 0.3506, std.dev.: 0.0062) MultiSource/Benchmarks/PAQ8p/paq8p: -8.01% (2.4924 => 2.2928, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.26% (0.9542 => 0.8849, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -7.06% (0.3357 => 0.3120, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.00% (0.3142 => 0.2922, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.97% (3.5339 => 3.2876, std.dev.: 0.0114) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.96% (0.2428 => 0.2259, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.86% (22.4056 => 20.8694, std.dev.: 0.0204) SingleSource/Benchmarks/Misc/oourafft: -6.76% (0.2160 => 0.2014, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.74% (9.2283 => 8.6063, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.72% (0.9852 => 0.9190, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -6.68% (16.1920 => 15.1103, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.67% (0.3658 => 0.3414, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.67% (0.7198 => 0.6718, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -6.65% (7.0961 => 6.6241, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.63% (0.1796 => 0.1677, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.57% (1.0544 => 0.9851, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: -6.57% (0.9179 => 0.8576, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: -6.54% (1.2515 => 1.1696, std.dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.50% (0.1584 => 0.1481, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: -6.47% (4.3330 => 4.0525, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.45% (1.3722 => 1.2837, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.40% (4.0323 => 3.7744, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/ReedSolomon: -6.39% (0.1879 => 0.1759, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.37% (1.2784 => 1.1970, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.35% (0.6484 => 0.6072, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.35% (0.1716 => 0.1607, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.33% (1.4642 => 1.3715, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: -6.31% (1.1530 => 1.0802, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.31% (0.7919 => 0.7419, std.dev.: 0.0027) MultiSource/Applications/lemon/lemon: -6.29% (1.1450 => 1.0730, std.dev.: 0.0070) MultiSource/Applications/siod/siod: -6.27% (2.4021 => 2.2514, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.27% (0.2695 => 0.2526, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.27% (4.5069 => 4.2244, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.26% (0.3483 => 0.3265, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.24% (0.2355 => 0.2208, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.24% (1.6364 => 1.5343, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.20% (1.2300 => 1.1537, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: -6.18% (15.5079 => 14.5499, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.16% (0.6736 => 0.6321, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: -6.13% (0.2985 => 0.2802, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.12% (4.8161 => 4.5214, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.11% (4.8802 => 4.5819, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.09% (1.6474 => 1.5470, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: -6.09% (0.2659 => 0.2497, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.08% (0.2548 => 0.2393, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -6.08% (0.3406 => 0.3199, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.07% (0.6293 => 0.5911, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -6.07% (1.3148 => 1.2350, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.04% (6.7716 => 6.3625, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.03% (5.4682 => 5.1385, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.02% (0.5478 => 0.5148, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -6.00% (4.0594 => 3.8159, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/hash2: -5.99% (0.4861 => 0.4570, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.98% (0.5999 => 0.5640, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.98% (0.5802 => 0.5455, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.97% (0.8521 => 0.8012, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -5.95% (0.7447 => 0.7004, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: -5.93% (0.3255 => 0.3062, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -5.93% (17.1032 => 16.0896, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.92% (0.5857 => 0.5510, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.92% (0.5849 => 0.5503, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: -5.92% (0.3026 => 0.2847, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.90% (14.2083 => 13.3697, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.90% (0.5863 => 0.5517, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.90% (0.6660 => 0.6267, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.90% (2.1713 => 2.0432, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.90% (0.6395 => 0.6018, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.89% (0.5805 => 0.5463, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.88% (0.4083 => 0.3843, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.87% (0.5705 => 0.5370, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.86% (0.3837 => 0.3612, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.86% (2.2587 => 2.1263, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.85% (0.5329 => 0.5017, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.84% (0.9557 => 0.8999, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.84% (0.6304 => 0.5936, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.83% (0.6194 => 0.5833, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.82% (0.6681 => 0.6292, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -5.82% (0.2871 => 0.2704, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.81% (0.5925 => 0.5581, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.81% (0.4427 => 0.4170, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: -5.80% (0.3205 => 0.3019, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.80% (0.3016 => 0.2841, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.80% (0.5591 => 0.5267, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -5.79% (0.3831 => 0.3609, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -5.79% (3.5154 => 3.3117, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.79% (0.3057 => 0.2880, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -5.79% (0.2989 => 0.2816, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.79% (0.5168 => 0.4869, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.78% (0.6676 => 0.6290, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: -5.77% (0.3446 => 0.3247, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.77% (0.3931 => 0.3704, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: -5.77% (0.3880 => 0.3656, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -5.77% (1.3864 => 1.3064, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.77% (0.7021 => 0.6616, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.77% (0.7524 => 0.7090, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -5.77% (0.4248 => 0.4003, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.76% (0.6667 => 0.6283, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.76% (0.6446 => 0.6075, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.75% (0.2903 => 0.2736, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.75% (0.4033 => 0.3801, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -5.75% (0.3025 => 0.2851, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.75% (0.2939 => 0.2770, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -5.75% (0.4176 => 0.3936, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.75% (0.6230 => 0.5872, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -5.75% (0.3394 => 0.3199, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.74% (0.3849 => 0.3628, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.74% (0.6395 => 0.6028, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.74% (0.4916 => 0.4634, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -5.72% (0.3812 => 0.3594, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.72% (0.5859 => 0.5524, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -5.71% (2.1401 => 2.0179, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.70% (0.2999 => 0.2828, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.70% (0.3194 => 0.3012, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: -5.69% (18.2933 => 17.2516, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.69% (0.2933 => 0.2766, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -5.69% (0.2849 => 0.2687, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -5.68% (0.4524 => 0.4267, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.68% (0.3891 => 0.3670, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -5.68% (0.3788 => 0.3573, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.67% (0.7339 => 0.6923, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.67% (0.3848 => 0.3630, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.66% (0.2278 => 0.2149, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.65% (0.5575 => 0.5260, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -5.65% (0.7982 => 0.7531, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/synchronized: -5.65% (0.3896 => 0.3676, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.65% (0.5456 => 0.5148, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -5.64% (0.6750 => 0.6369, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.64% (0.5581 => 0.5266, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/property: -5.62% (0.4199 => 0.3963, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.61% (0.3491 => 0.3295, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.61% (0.3884 => 0.3666, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.61% (0.6297 => 0.5944, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.60% (0.6052 => 0.5713, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/lists1: -5.59% (0.3867 => 0.3651, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.58% (0.6260 => 0.5911, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.57% (0.6189 => 0.5844, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.57% (0.6033 => 0.5697, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.57% (0.3252 => 0.3071, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -5.56% (34.0927 => 32.1965, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.55% (0.5941 => 0.5611, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.55% (0.4813 => 0.4546, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.53% (0.5567 => 0.5259, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -5.51% (0.4515 => 0.4266, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.51% (0.3319 => 0.3136, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.51% (0.3323 => 0.3140, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.50% (0.5688 => 0.5375, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: -5.50% (0.3621 => 0.3422, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -5.49% (0.3059 => 0.2891, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.48% (0.4321 => 0.4084, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.48% (8.0126 => 7.5733, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.48% (0.5569 => 0.5264, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.47% (1.2221 => 1.1552, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -5.47% (0.4280 => 0.4046, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.45% (1.2210 => 1.1544, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.43% (0.6440 => 0.6090, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/ary2: -5.43% (0.3481 => 0.3292, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.42% (0.5570 => 0.5268, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.37% (0.2385 => 0.2257, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.37% (0.2106 => 0.1993, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: -5.36% (0.3581 => 0.3389, std.dev.: 0.0040) MultiSource/Applications/ClamAV/clamscan: -5.33% (15.2527 => 14.4391, std.dev.: 0.0158) MultiSource/Benchmarks/McCat/09-vor/vor: -5.29% (0.3271 => 0.3098, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -5.20% (5.0226 => 4.7612, std.dev.: 0.0038) MultiSource/Applications/spiff/spiff: -5.12% (0.8418 => 0.7987, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.26% (0.9077 => 0.8690, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: -4.22% (1.5610 => 1.4952, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -3.68% (0.6441 => 0.6204, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -3.57% (0.7779 => 0.7501, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: -3.39% (0.6347 => 0.6132, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -2.61% (20.7746 => 20.2322, std.dev.: 0.0271) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.56% (7.5137 => 5.7437, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1732, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.84% (1.7753 => 1.7071, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.83% (2.2633 => 2.1767, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.81% (1.3096 => 1.2728, std.dev.: 0.0094) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4723, std.dev.: 0.0039) Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 9 23:50:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 10 Nov 2012 01:50:34 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121110075034.C7D772A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5734?compare_to=5703&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5734, Order: 167608, Start Time: 2012-11-09 08:42:58, End Time: 2012-11-10 07:50:47 To: 5703, Order: 167573, Start Time: 2012-11-08 09:03:54, End Time: 2012-11-09 08:12:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (43 on baseline) New Passes: 0 (12 on baseline) Performance Regressions: 2 (165 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 50 (7 on baseline) Unchanged Tests: 990 (643 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.39% (11.4773 => 11.7515, std.dev.: 0.0079) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.00% (1.2883 => 1.3141, std.dev.: 0.0048) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/ClamAV/clamscan: 0.17% (27.6437 => 27.6904, std.dev.: 0.0176) MultiSource/Applications/JM/ldecod/ldecod: 0.20% (6.3288 => 6.3417, std.dev.: 0.0159) MultiSource/Applications/JM/lencod/lencod: 0.06% (19.6815 => 19.6924, std.dev.: 0.0310) MultiSource/Applications/oggenc/oggenc: - (0.0020 => 0.0020) MultiSource/Applications/siod/siod: 1.09% (1.5623 => 1.5793, std.dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 0.04% (0.5238 => 0.5240, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 0.37% (51.3553 => 51.5431, std.dev.: 0.0791) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 0.22% (0.8569 => 0.8588, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -0.26% (5.0684 => 5.0550, std.dev.: 0.0244) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.07% (10.4624 => 10.5746, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 0.48% (1.4080 => 1.4147, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -0.54% (0.3342 => 0.3324, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.00% (0.0300 => 0.0282, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 0.18% (1.7335 => 1.7367, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/voronoi/voronoi: 0.16% (0.1930 => 0.1933, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: - (0.0020 => 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.00% (0.0020 => 0.0019, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 0.87% (0.2541 => 0.2563, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.05% (1.7293 => 1.7301, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 0.16% (5.2241 => 5.2322, std.dev.: 0.0148) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.52% (1.1124 => 1.1066, std.dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 0.13% (0.2970 => 0.2974, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0020 => 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/Large/sphereflake MultiSource/Applications/ClamAV/clamscan: - (0.0001 => 0.0001) MultiSource/Applications/JM/ldecod/ldecod: - (0.0001 => 0.0001) MultiSource/Applications/JM/lencod/lencod: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Applications/siod/siod: - (0.0001 => 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -7.18% (0.0724 => 0.0672, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: - (0.0001 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8288 => 499.8412, std.dev.: 0.0168) MultiSource/Benchmarks/Olden/voronoi/voronoi: - (0.0001 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: - (0.0001 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: - (0.0001 => 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/nbench/nbench: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 0.03% (2.9166 => 2.9174, std.dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/nbench/nbench MultiSource/Applications/ClamAV/clamscan: 24.87% (22.1758 => 27.6904, std.dev.: 0.0176) MultiSource/Applications/JM/ldecod/ldecod: -39.23% (10.4361 => 6.3417, std.dev.: 0.0159) MultiSource/Applications/JM/lencod/lencod: -10.23% (21.9371 => 19.6924, std.dev.: 0.0310) MultiSource/Applications/oggenc/oggenc: -99.97% (5.7591 => 0.0020) MultiSource/Applications/siod/siod: -31.24% (2.2969 => 1.5793, std.dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: -96.95% (17.1811 => 0.5240, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: -18.50% (63.2438 => 51.5431, std.dev.: 0.0791) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.01% (0.8101 => 0.8588, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.23% (4.9449 => 5.0550, std.dev.: 0.0244) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 49.91% (7.0540 => 10.5746, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -8.23% (1.5415 => 1.4147, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -31.87% (0.4879 => 0.3324, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.58% (6.6874 => 0.0282, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -67.55% (5.3526 => 1.7367, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/voronoi/voronoi: -28.41% (0.2700 => 0.1933, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -99.93% (2.9384 => 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -99.83% (1.1194 => 0.0019, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -19.33% (0.3177 => 0.2563, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -67.87% (5.3855 => 1.7301, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.61% (5.0018 => 5.2322, std.dev.: 0.0148) MultiSource/Benchmarks/nbench/nbench: -74.88% (1.1840 => 0.2974, std.dev.: 0.0011) New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/nbench/nbench SingleSource/Benchmarks/Misc-C++/Large/sphereflake MultiSource/Applications/ClamAV/clamscan: -99.94% (0.1629 => 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -99.92% (0.1298 => 0.0001) MultiSource/Applications/siod/siod: -100.00% (3.2827 => 0.0001) MultiSource/Applications/sqlite3/sqlite3: -100.00% (4.6441 => 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -100.00% (2.3135 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -98.00% (0.0050 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -99.96% (0.2497 => 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -50.00% (0.0002 => 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -75.00% (0.0004 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -99.97% (0.3987 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 44223.95% (1.1277 => 499.8412, std.dev.: 0.0168) MultiSource/Benchmarks/Olden/voronoi/voronoi: -99.97% (0.3070 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -100.00% (2.6546 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -100.00% (2.6778 => 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -100.00% (4.5009 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -99.80% (0.0506 => 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -97.30% (0.0037 => 0.0001) MultiSource/Benchmarks/nbench/nbench: -100.00% (11.6436 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.00% (3.2416 => 2.9174, std.dev.: 0.0003) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 190.90% (0.5229 => 1.5211, std.dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 11.84% (14.9895 => 16.7636, std.dev.: 0.0362) MultiSource/Applications/kimwitu++/kc: 35.20% (14.1553 => 19.1379, std.dev.: 0.0097) MultiSource/Benchmarks/MallocBench/gs/gs: 12.62% (4.1105 => 4.6294, std.dev.: 0.0169) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.01% (3.4629 => 5.8179, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/stepanov_container: 61.40% (0.6222 => 1.0042, std.dev.: 0.0012) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3839400.00% (0.0001 => 3.8395, std.dev.: 0.0061) MultiSource/Applications/SPASS/SPASS: 11169300.00% (0.0001 => 11.1694, std.dev.: 0.0694) MultiSource/Applications/kimwitu++/kc: 50200.00% (0.0001 => 0.0503, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10003100.00% (0.0001 => 10.0032, std.dev.: 0.0506) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5490300.00% (0.0001 => 5.4904, std.dev.: 0.0119) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 50.66% (0.1056 => 0.1591, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 41.82% (0.0746 => 0.1058, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 38.62% (0.1432 => 0.1985) SingleSource/Benchmarks/CoyoteBench/almabench: 38.08% (0.0730 => 0.1008, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Oscar: 23.58% (0.0636 => 0.0786, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 20.71% (0.2554 => 0.3083, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.20% (0.1584 => 0.1904, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.67% (0.1566 => 0.1874, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 19.40% (0.1175 => 0.1403, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.17% (8.1363 => 9.6960, std.dev.: 0.0058) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.40% (0.1125 => 0.1332, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 16.45% (0.0614 => 0.0715, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.39% (0.0793 => 0.0923, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.26% (0.0953 => 0.1108, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 15.84% (0.0871 => 0.1009, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.42% (0.8172 => 0.9432, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/matrix: 15.28% (0.0818 => 0.0943, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.06% (0.2065 => 0.2376, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.87% (0.1029 => 0.1182, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.49% (0.0842 => 0.0964, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/mst/mst: 14.19% (0.1163 => 0.1328, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.05% (0.2107 => 0.2403, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.66% (0.0886 => 0.1007, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.63% (0.2758 => 0.3134, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/em3d/em3d: 13.57% (0.1695 => 0.1925, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.43% (0.1117 => 0.1267, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: 13.35% (10.3673 => 11.7515, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/health/health: 13.33% (0.1268 => 0.1437, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 13.25% (0.1555 => 0.1761, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.25% (0.0770 => 0.0872, std.dev.: 0.0019) MultiSource/Applications/aha/aha: 13.12% (0.1151 => 0.1302, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.03% (0.2271 => 0.2567, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.97% (14.3668 => 16.2302, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 12.96% (0.7115 => 0.8037, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.89% (0.0838 => 0.0946, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.84% (0.1940 => 0.2189, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.71% (0.5981 => 0.6741, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.69% (0.3121 => 0.3517, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.66% (0.0798 => 0.0899, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: 12.59% (0.7433 => 0.8369, std.dev.: 0.0036) MultiSource/Applications/spiff/spiff: 12.57% (0.7835 => 0.8820, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.47% (0.0834 => 0.0938, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 12.45% (1.1642 => 1.3091, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.37% (0.5860 => 0.6585, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.28% (0.5569 => 0.6253, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.05% (0.1062 => 0.1190, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 11.90% (0.1655 => 0.1852, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 11.89% (0.1337 => 0.1496, std.dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 11.84% (0.3109 => 0.3477, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.81% (0.9765 => 1.0918, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/18-imp/imp: 11.74% (0.3423 => 0.3825, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.66% (0.1510 => 0.1686, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.57% (0.4615 => 0.5149, std.dev.: 0.0039) MultiSource/Applications/d/make_dparser: 11.49% (3.3354 => 3.7185, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.43% (1.3050 => 1.4541, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.36% (0.3441 => 0.3832, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.34% (0.1032 => 0.1149, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.32% (0.5105 => 0.5683, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.26% (4.2646 => 4.7448, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 11.05% (3.8723 => 4.3003, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.00% (0.1236 => 0.1372, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.98% (0.6675 => 0.7408, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 10.95% (0.3927 => 0.4357, std.dev.: 0.0079) SingleSource/UnitTests/ObjC/trivial-interface: 10.94% (0.3473 => 0.3853, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.92% (0.3561 => 0.3950, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.89% (0.3516 => 0.3899, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 10.84% (0.3543 => 0.3927, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.84% (0.3543 => 0.3927, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 10.83% (0.3886 => 0.4307, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.81% (0.3497 => 0.3875, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.77% (0.3694 => 0.4092, std.dev.: 0.0030) MultiSource/Applications/treecc/treecc: 10.65% (2.0273 => 2.2432, std.dev.: 0.0120) SingleSource/UnitTests/ObjC/exceptions: 10.63% (0.3828 => 0.4235, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.46% (0.3307 => 0.3653, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.44% (0.1906 => 0.2105, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.19% (0.8067 => 0.8889, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/09-vor/vor: 10.16% (0.3180 => 0.3503, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 10.05% (9.4845 => 10.4377, std.dev.: 0.0370) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.04% (2.2022 => 2.4233, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.04% (0.5020 => 0.5524, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.01% (3.8922 => 4.2817, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 9.93% (1.5603 => 1.7152, std.dev.: 0.0085) MultiSource/Applications/lemon/lemon: 9.86% (1.0722 => 1.1779, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 9.85% (0.6456 => 0.7092, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.81% (1.5859 => 1.7415, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.77% (0.1044 => 0.1146, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 9.75% (0.4289 => 0.4707, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.74% (0.6450 => 0.7078, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.64% (0.2603 => 0.2854, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.63% (1.1861 => 1.3003, std.dev.: 0.0011) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.62% (0.1143 => 0.1253, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 9.58% (0.4299 => 0.4711, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.24% (2.2024 => 2.4059, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/football/football: 9.12% (0.8921 => 0.9735, std.dev.: 0.0025) SingleSource/UnitTests/SignlessTypes/rem: 9.09% (0.1144 => 0.1248, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.07% (0.1268 => 0.1383, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.97% (0.1695 => 0.1847, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 8.95% (0.3387 => 0.3690, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.75% (0.3865 => 0.4203, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 8.70% (0.4620 => 0.5022, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 8.68% (0.3422 => 0.3719, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.66% (0.4203 => 0.4567, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: 8.61% (0.1463 => 0.1589, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.56% (1.4186 => 1.5400, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.41% (0.4103 => 0.4448, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.30% (0.1892 => 0.2049, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.26% (0.4636 => 0.5019, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.15% (0.2430 => 0.2628, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 8.14% (0.3684 => 0.3984, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 8.14% (0.6030 => 0.6521, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 8.03% (0.5925 => 0.6401, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 7.91% (0.4048 => 0.4368, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 7.72% (0.3379 => 0.3640, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 7.72% (0.3603 => 0.3881, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 7.56% (0.2049 => 0.2204, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.40% (0.7326 => 0.7868, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.40% (0.3650 => 0.3920, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 7.37% (0.2905 => 0.3119, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.24% (0.2831 => 0.3036, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.14% (0.3826 => 0.4099, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 7.04% (0.3282 => 0.3513, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.00% (2.0665 => 2.2111, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.93% (0.3162 => 0.3381, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.92% (0.2891 => 0.3091, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.84% (0.3232 => 0.3453, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.79% (0.2725 => 0.2910, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.72% (0.4064 => 0.4337, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.70% (0.3283 => 0.3503, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 6.65% (0.2871 => 0.3062, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.65% (0.3098 => 0.3304, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.53% (0.2756 => 0.2936, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 6.42% (0.3052 => 0.3248, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.40% (0.2877 => 0.3061, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 6.37% (1.2842 => 1.3660, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.34% (0.2872 => 0.3054, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.27% (0.2793 => 0.2968, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 6.23% (0.2714 => 0.2883, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 6.17% (0.2802 => 0.2975, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 6.05% (0.3092 => 0.3279, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.90% (0.3136 => 0.3321, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.72% (0.3427 => 0.3623, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.41% (0.3131 => 0.3269, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (0.3935 => 0.4080, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.38% (0.3817 => 0.3946, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.62% (1.1145 => 1.2997, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 13.89% (6.6465 => 7.5695, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.95% (1.1396 => 1.2530, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.90% (1.7254 => 1.8789, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 8.11% (0.9505 => 1.0276, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.11% (0.9540 => 1.0218) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3685, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.43% (0.3463 => 0.3651, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.86% (4.2280 => 4.3913, std.dev.: 0.0157) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.90% (8.6802 => 8.9319, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.39% (1.0313 => 1.0559, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 1.84% (0.8333 => 0.8486, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0495, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -75.15% (0.8651 => 0.2150, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -73.43% (5.2763 => 1.4021, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: -46.12% (0.1622 => 0.0874, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -13.16% (0.1330 => 0.1155, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -9.82% (1.7609 => 1.5879, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -9.09% (54.1659 => 49.2409, std.dev.: 0.0199) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.08% (7.9617 => 7.8758, std.dev.: 0.0110) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.52% (0.0628 => 0.0361, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -18.46% (0.2161 => 0.1762, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -16.03% (1.6925 => 1.4212, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.98% (32.5116 => 28.9412, std.dev.: 0.0024) MultiSource/Benchmarks/NPB-serial/is/is: -10.97% (9.5636 => 8.5141, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -10.76% (1.5373 => 1.3719, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.13% (1.5660 => 1.4230, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.18% (19.9488 => 18.3161, std.dev.: 0.0376) MultiSource/Benchmarks/FreeBench/distray/distray: -7.16% (0.1592 => 0.1478, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.11% (1.8329 => 1.7026, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.41% (1.2373 => 1.1580, std.dev.: 0.0043) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -6.09% (0.4808 => 0.4515, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.24% (1.6805 => 1.5925, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -4.64% (1.5835 => 1.5100, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.85% (1.3677 => 1.3150, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.68% (0.9957 => 0.9591, std.dev.: 0.0060) MultiSource/Benchmarks/sim/sim: -3.23% (5.0483 => 4.8850, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.20% (8.1563 => 7.9770, std.dev.: 0.0323) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6760, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -1.78% (85.0658 => 83.5517, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: -1.75% (10.2830 => 10.1027, std.dev.: 0.0082) SingleSource/UnitTests/Vector/multiplies: -1.72% (2.5528 => 2.5088, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8595, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.16% (1.1048 => 1.1066, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -99.97% (7.1582 => 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: -99.86% (0.0720 => 0.0001) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.24% (0.2116 => 0.0672, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 10 00:13:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 10 Nov 2012 02:13:39 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121110081339.0AFF02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5735?compare_to=5732&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5735, Order: 167665, Start Time: 2012-11-10 06:47:10, End Time: 2012-11-10 08:13:52 To: 5732, Order: 167663, Start Time: 2012-11-10 05:04:03, End Time: 2012-11-10 06:30:00 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 23 (114 on baseline) Performance Improvements: 2 (24 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 966 (836 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 8.77% (0.3159 => 0.3436, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.80% (0.4909 => 0.5243, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.12% (0.6096 => 0.6469, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.46% (0.2126 => 0.2242, std.dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: 5.22% (8.2650 => 8.6967, std.dev.: 0.1613) MultiSource/Applications/spiff/spiff: 4.50% (0.8071 => 0.8434, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.33% (0.7673 => 0.8005, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/bh/bh: 4.15% (0.2961 => 0.3084, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.74% (0.3024 => 0.3137, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: 3.67% (1.4399 => 1.4928, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/gs/gs: 2.66% (4.1940 => 4.3055, std.dev.: 0.0290) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.63% (0.9690 => 0.9945, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.62% (0.6070 => 0.6229, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.24% (0.8844 => 0.9042, std.dev.: 0.0038) MultiSource/Applications/treecc/treecc: 2.12% (2.0350 => 2.0781, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.50% (1.4686 => 1.4907, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.44% (1.2065 => 1.2239, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.41% (4.5343 => 4.5981, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.16% (1.6705 => 1.6899, std.dev.: 0.0066) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.36% (21.7547 => 22.7025, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.49% (4.3107 => 4.4179, std.dev.: 0.0326) SingleSource/Benchmarks/Misc/richards_benchmark: 2.36% (1.3786 => 1.4111, std.dev.: 0.0060) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.54% (1.2684 => 1.2879, std.dev.: 0.0076) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.23% (0.8533 => 0.8428, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.17% (0.8908 => 0.8804, std.dev.: 0.0018) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.05% (16.7073 => 16.7149, std.dev.: 0.1913) MultiSource/Applications/obsequi/Obsequi: 2.75% (1.0429 => 1.0716, std.dev.: 0.0090) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.37% (21.7103 => 21.6289, std.dev.: 0.3730) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.58% (0.3633 => 0.3654, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 0.18% (0.6013 => 0.6024, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.82% (0.3302 => 0.3329, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/strcat: 0.35% (0.1998 => 0.2005, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -8.53% (0.0211 => 0.0193, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.80% (0.0375 => 0.0372, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0263 => 0.0263, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0313 => 0.0313, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0423 => 0.0423, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 20.83% (0.0168 => 0.0203, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 29.77% (0.0131 => 0.0170, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.27% (0.1462 => 0.1458, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.64% (1.1345 => 1.1418, std.dev.: 0.0621) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.65% (0.1434 => 0.1472, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.58% (0.4243 => 0.4176, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.63% (0.1487 => 0.1433, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.57% (0.0595 => 0.0646, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 25.23% (0.0214 => 0.0268, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.71% (0.0590 => 0.0574, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.60% (1.1955 => 1.2027, std.dev.: 0.0121) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2400.00% (0.0001 => 0.0025, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.03% (0.0561 => 0.0578, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.50% (0.0247 => 0.0268) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.86% (0.7773 => 0.7840, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 19.67% (0.0061 => 0.0073, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2292.58% (0.6332 => 15.1498, std.dev.: 0.1170) MultiSource/Benchmarks/McCat/08-main/main: 49.70% (0.1831 => 0.2741, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.03% (0.1559 => 0.1465, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1485.32% (0.3344 => 5.3013, std.dev.: 0.0857) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.49% (0.2364 => 0.3203, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel: 1.17% (0.0429 => 0.0434, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.14% (0.0224 => 0.0240, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -27.83% (0.0230 => 0.0166, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4347, std.dev.: 0.0117) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0704, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4895, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3421, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1379, std.dev.: 0.0578) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3995, std.dev.: 0.0068) SingleSource/Regression/C/uint64_to_float: -23.71% (2.1832 => 1.6656, std.dev.: 0.0224) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 12.47% (0.0810 => 0.0911, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: 10.07% (0.1112 => 0.1224, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.53% (0.3137 => 0.3436, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.76% (0.2180 => 0.2371, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.66% (0.8321 => 0.9042, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.38% (0.2279 => 0.2470, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.17% (0.4847 => 0.5243, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.64% (0.6010 => 0.6469, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.37% (0.1425 => 0.1530, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.36% (0.1983 => 0.2129, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.12% (0.7473 => 0.8005, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.25% (0.2240 => 0.2380, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.25% (0.1905 => 0.2024, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.11% (0.8148 => 0.8646, std.dev.: 0.0142) MultiSource/Applications/spiff/spiff: 6.09% (0.7950 => 0.8434, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.41% (0.9435 => 0.9945, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.11% (0.2133 => 0.2242, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.07% (1.1606 => 1.2195, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.76% (0.3295 => 0.3452, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.74% (1.1685 => 1.2239, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 4.64% (1.2222 => 1.2789, std.dev.: 0.0159) MultiSource/Applications/hbd/hbd: 4.62% (1.4269 => 1.4928, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.50% (0.5961 => 0.6229, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.46% (0.3003 => 0.3137, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.39% (0.6287 => 0.6563, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/gs/gs: 4.24% (4.1305 => 4.3055, std.dev.: 0.0290) MultiSource/Applications/treecc/treecc: 4.18% (1.9948 => 2.0781, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.73% (0.4127 => 0.4281, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.54% (0.2998 => 0.3104, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.52% (0.5817 => 0.6022, std.dev.: 0.0067) MultiSource/Applications/lua/lua: 3.50% (3.8189 => 3.9527, std.dev.: 0.0367) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.13% (1.6386 => 1.6899, std.dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.97% (0.4783 => 0.4925, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.96% (1.4479 => 1.4907, std.dev.: 0.0060) MultiSource/Benchmarks/nbench/nbench: 2.93% (1.1271 => 1.1601, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.92% (4.1763 => 4.2981, std.dev.: 0.0226) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.92% (8.6476 => 8.8998, std.dev.: 0.0865) MultiSource/Applications/SPASS/SPASS: 2.91% (14.2605 => 14.6756, std.dev.: 0.0573) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.83% (6.6074 => 6.7947, std.dev.: 0.0340) MultiSource/Benchmarks/McCat/05-eks/eks: 2.68% (0.4397 => 0.4515, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.67% (0.8697 => 0.8929, std.dev.: 0.0050) MultiSource/Applications/ClamAV/clamscan: 2.62% (14.7684 => 15.1552, std.dev.: 0.0788) MultiSource/Applications/d/make_dparser: 2.56% (3.2366 => 3.3195, std.dev.: 0.0055) MultiSource/Benchmarks/PAQ8p/paq8p: 2.54% (2.3764 => 2.4367, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.47% (4.4873 => 4.5981, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.40% (0.8457 => 0.8660, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.39% (0.8317 => 0.8516, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.34% (0.9074 => 0.9286, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.34% (0.8050 => 0.8238, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.32% (0.8712 => 0.8914, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.26% (0.8007 => 0.8188, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.26% (0.8331 => 0.8519, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.24% (0.8611 => 0.8804, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.21% (0.9069 => 0.9269, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.18% (0.8518 => 0.8704, std.dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: 2.12% (0.7557 => 0.7717, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.11% (0.8597 => 0.8778, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.04% (0.9039 => 0.9223, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.02% (0.8261 => 0.8428, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.02% (0.8855 => 0.9034, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.02% (0.9056 => 0.9239, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 2.01% (2.2184 => 2.2631, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.01% (0.8204 => 0.8369, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.01% (0.7966 => 0.8126, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 1.99% (31.8598 => 32.4950, std.dev.: 0.1353) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.99% (0.8805 => 0.8980, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.91% (0.8885 => 0.9055, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.91% (0.9908 => 1.0097, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.90% (0.9688 => 0.9872, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.89% (0.8656 => 0.8820, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.89% (0.8420 => 0.8579, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.87% (0.7932 => 0.8080, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.86% (0.8177 => 0.8329, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.85% (13.1811 => 13.4246, std.dev.: 0.0276) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.85% (0.8066 => 0.8215, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.84% (0.6834 => 0.6960, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.77% (0.8286 => 0.8433, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 1.71% (0.8768 => 0.8918, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.68% (0.8927 => 0.9077, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.64% (0.8048 => 0.8180, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.54% (0.8316 => 0.8444, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.48% (0.8086 => 0.8206, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 1.46% (8.6247 => 8.7507, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.06% (1.2423 => 1.2555, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 78.39% (0.0199 => 0.0355, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/pi: 47.39% (1.5795 => 2.3281, std.dev.: 0.0814) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.57% (0.7597 => 0.8856, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.54% (2.7995 => 3.2066, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6091, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 8.24% (1.3037 => 1.4111, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.05% (1.1857 => 1.2811, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 7.35% (1.7056 => 1.8309, std.dev.: 0.0157) MultiSource/Applications/SIBsim4/SIBsim4: 6.28% (3.1873 => 3.3876, std.dev.: 0.0246) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.92% (4.5327 => 4.8012, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.84% (4.9686 => 5.2589, std.dev.: 0.0301) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.70% (6.2275 => 6.5203, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.41% (3.3761 => 3.5251, std.dev.: 0.0047) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.39% (1.2337 => 1.2879, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.22% (4.9453 => 5.1542, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/treeadd/treeadd: 4.07% (0.3587 => 0.3733, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.07% (4.9469 => 5.1482, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.87% (14.0064 => 14.5487, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.86% (11.5690 => 11.8996, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.82% (8.2783 => 8.5120, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 2.72% (3.6643 => 3.7639, std.dev.: 0.0181) MultiSource/Applications/lambda-0_1_3/lambda: 2.71% (7.4933 => 7.6962, std.dev.: 0.0245) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.52% (4.8660 => 4.9884, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.38% (4.8362 => 4.9511, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/lists: 2.24% (7.3375 => 7.5019, std.dev.: 0.0180) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.96% (1.1365 => 1.1588, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.81% (22.2997 => 22.7025, std.dev.: 0.0158) SingleSource/Benchmarks/Stanford/FloatMM: 1.43% (0.8807 => 0.8933, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 1.33% (1.2061 => 1.2222, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/neural/neural: 1.33% (1.0841 => 1.0985, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.06% (5.4641 => 4.3132, std.dev.: 0.0479) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.64% (1.0512 => 0.9394, std.dev.: 0.0265) SingleSource/Benchmarks/McGill/chomp: -10.56% (1.1216 => 1.0032, std.dev.: 0.0068) MultiSource/Benchmarks/mafft/pairlocalalign: -8.54% (63.1822 => 57.7892, std.dev.: 0.0555) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.94% (0.3269 => 0.3042, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.88% (4.7482 => 4.4213, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.96% (3.7148 => 3.4934, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.86% (5.4972 => 5.1748, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.27% (5.1557 => 4.8842, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/recursive: -5.06% (2.4490 => 2.3251, std.dev.: 0.0432) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.36% (4.7449 => 4.5381, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.75% (6.0224 => 5.7967, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.33% (2.8773 => 2.7814, std.dev.: 0.0223) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (28.5821 => 27.6962, std.dev.: 0.0223) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.87% (2.6356 => 2.5600, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.77% (0.5807 => 0.5646, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.77% (9.9065 => 9.6320, std.dev.: 0.0461) MultiSource/Applications/aha/aha: -2.44% (3.3398 => 3.2584, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/mason/mason: -2.42% (0.5415 => 0.5284, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: -2.30% (3.4237 => 3.3451, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.06% (11.5316 => 11.2942, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.04% (2.3487 => 2.3008, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.72% (4.9994 => 4.9133, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.49% (3.2169 => 3.1689, std.dev.: 0.0050) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.63% (16.4461 => 16.7149, std.dev.: 0.1913) MultiSource/Applications/obsequi/Obsequi: 4.42% (1.0262 => 1.0716, std.dev.: 0.0090) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6825.68% (0.3123 => 21.6289, std.dev.: 0.3730) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.36% (0.2463 => 0.3654, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 0.23% (0.6010 => 0.6024, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.93% (0.3266 => 0.3329, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/strcat: 1.83% (0.1969 => 0.2005, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 56.91% (0.0123 => 0.0193, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -8.82% (0.0408 => 0.0372, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.54% (0.0254 => 0.0263, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -5.56% (0.0180 => 0.0170, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.39% (0.1438 => 0.1458, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.79% (1.1329 => 1.1418, std.dev.: 0.0621) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.68% (0.1462 => 0.1472, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.29% (0.4164 => 0.4176, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.67% (0.1369 => 0.1433, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.78% (0.0641 => 0.0646, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 37.44% (0.0195 => 0.0268, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.69% (0.0578 => 0.0574, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.16% (1.1437 => 1.2027, std.dev.: 0.0121) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 78.57% (0.0014 => 0.0025, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.81% (0.0627 => 0.0578, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.89% (0.0180 => 0.0268) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.21% (0.8017 => 0.7840, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 17.74% (0.0062 => 0.0073, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 10 01:19:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 10 Nov 2012 03:19:58 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121110091958.C842F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5736?compare_to=5733&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5736, Order: 167668, Start Time: 2012-11-10 07:51:40, End Time: 2012-11-10 09:20:10 To: 5733, Order: 167665, Start Time: 2012-11-10 05:47:56, End Time: 2012-11-10 07:12:40 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (174 on baseline) Unchanged Tests: 1042 (864 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1014, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4937 => 7.6678, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/hash2: 2.09% (3.1932 => 3.2600, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.22% (0.1431 => 0.1299, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.06% (0.3821 => 0.3513, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -8.00% (2.4924 => 2.2929, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.90% (3.5339 => 3.2900, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.88% (0.2428 => 0.2261, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.81% (22.4056 => 20.8798, std.dev.: 0.0075) MultiSource/Applications/sgefa/sgefa: -6.76% (0.3357 => 0.3130, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.67% (0.3658 => 0.3414, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -6.65% (9.2283 => 8.6150, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.59% (0.9852 => 0.9203, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.55% (1.0544 => 0.9853, std.dev.: 0.0070) MultiSource/Applications/JM/ldecod/ldecod: -6.52% (7.0961 => 6.6332, std.dev.: 0.1704) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.47% (0.1716 => 0.1605, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: -6.46% (0.9179 => 0.8586, std.dev.: 0.0035) MultiSource/Applications/JM/lencod/lencod: -6.44% (16.1920 => 15.1485, std.dev.: 0.3330) SingleSource/Benchmarks/McGill/chomp: -6.42% (0.1761 => 0.1648, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.41% (0.2355 => 0.2204, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -6.40% (0.2985 => 0.2794, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: -6.39% (0.2160 => 0.2022, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -6.39% (0.1879 => 0.1759, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: -6.38% (4.3330 => 4.0564, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/08-main/main: -6.36% (0.2659 => 0.2490, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.35% (0.6484 => 0.6072, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.35% (1.3722 => 1.2851, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.34% (1.4642 => 1.3714, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.33% (1.2300 => 1.1521, std.dev.: 0.0055) MultiSource/Applications/lemon/lemon: -6.31% (1.1450 => 1.0728, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.29% (0.1621 => 0.1519, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.29% (0.4151 => 0.3890, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.27% (0.3142 => 0.2945, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.25% (4.8161 => 4.5149, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.24% (0.9542 => 0.8947, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: -6.22% (0.7447 => 0.6984, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.20% (0.3483 => 0.3267, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.20% (0.2548 => 0.2390, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.20% (0.6293 => 0.5903, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.20% (0.2695 => 0.2528, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.18% (0.1796 => 0.1685, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.17% (1.2784 => 1.1995, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.16% (4.5069 => 4.2291, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.16% (0.7919 => 0.7431, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -6.16% (0.3831 => 0.3595, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: -6.16% (0.3880 => 0.3641, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/trivial-interface: -6.14% (0.3812 => 0.3578, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.12% (0.3891 => 0.3653, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.12% (6.7716 => 6.3575, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/synchronized: -6.11% (0.3896 => 0.3658, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.11% (4.0323 => 3.7860, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.11% (1.6474 => 1.5468, std.dev.: 0.0171) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.11% (4.8802 => 4.5822, std.dev.: 0.0010) MultiSource/Applications/lua/lua: -6.09% (4.0594 => 3.8123, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/for-in: -6.07% (0.4033 => 0.3788, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.05% (1.6364 => 1.5374, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.04% (0.5857 => 0.5503, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.02% (0.3884 => 0.3650, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.01% (5.4682 => 5.1394, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions: -6.01% (0.4176 => 0.3925, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.01% (0.8521 => 0.8009, std.dev.: 0.0034) MultiSource/Benchmarks/sim/sim: -5.99% (0.3406 => 0.3202, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -5.98% (0.3848 => 0.3618, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.97% (0.3837 => 0.3608, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: -5.95% (15.5079 => 14.5845, std.dev.: 0.3555) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.95% (0.7021 => 0.6603, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -5.95% (0.3025 => 0.2845, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -5.95% (0.3026 => 0.2846, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/18-imp/imp: -5.95% (0.3581 => 0.3368, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.94% (0.3016 => 0.2837, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: -5.93% (1.1530 => 1.0846, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -5.93% (0.3255 => 0.3062, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.92% (0.4916 => 0.4625, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.88% (0.5863 => 0.5518, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.88% (0.5168 => 0.4864, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -5.88% (0.4199 => 0.3952, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.88% (0.5478 => 0.5156, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.88% (0.4083 => 0.3843, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.88% (0.5802 => 0.5461, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -5.87% (1.3148 => 1.2376, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.87% (0.5859 => 0.5515, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.87% (0.9557 => 0.8996, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -5.87% (17.1032 => 16.0997, std.dev.: 0.2391) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.86% (14.2083 => 13.3750, std.dev.: 0.0124) SingleSource/UnitTests/ObjC/parameter-passing: -5.86% (0.4280 => 0.4029, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.86% (0.6736 => 0.6341, std.dev.: 0.0093) MultiSource/Applications/kimwitu++/kc: -5.86% (18.2933 => 17.2207, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.86% (0.3057 => 0.2878, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.85% (0.6304 => 0.5935, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -5.85% (0.2871 => 0.2703, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.85% (0.6395 => 0.6021, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: -5.84% (0.4861 => 0.4577, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.84% (2.2587 => 2.1268, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.84% (0.3323 => 0.3129, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: -5.84% (0.4248 => 0.4000, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -5.82% (0.2989 => 0.2815, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.82% (0.6446 => 0.6071, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.81% (0.6660 => 0.6273, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.81% (0.7524 => 0.7087, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.81% (0.5805 => 0.5468, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.80% (0.5329 => 0.5020, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.80% (0.5849 => 0.5510, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.79% (0.7198 => 0.6781, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.79% (0.3194 => 0.3009, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.79% (0.2903 => 0.2735, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.79% (0.3491 => 0.3289, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.78% (0.5705 => 0.5375, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: -5.77% (0.3394 => 0.3198, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: -5.77% (0.3446 => 0.3247, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.75% (2.1713 => 2.0464, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.75% (0.5999 => 0.5654, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -5.75% (0.2939 => 0.2770, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.74% (0.5591 => 0.5270, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -5.74% (0.7982 => 0.7524, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.74% (0.6676 => 0.6293, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.72% (0.6033 => 0.5688, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: -5.72% (0.3481 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.71% (0.4427 => 0.4174, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -5.71% (0.3205 => 0.3022, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.70% (0.5925 => 0.5587, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -5.70% (0.4524 => 0.4266, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.70% (0.6667 => 0.6287, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.69% (0.3319 => 0.3130, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: -5.69% (0.4515 => 0.4258, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: -5.69% (0.3867 => 0.3647, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -5.69% (0.3621 => 0.3415, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: -5.68% (0.3788 => 0.3573, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.67% (0.6052 => 0.5709, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.67% (0.6230 => 0.5877, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -5.65% (0.2849 => 0.2688, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.65% (0.3931 => 0.3709, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.65% (0.4321 => 0.4077, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.63% (0.6194 => 0.5845, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.63% (1.2210 => 1.1523, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.63% (0.2933 => 0.2768, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.62% (0.6189 => 0.5841, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.57% (0.6297 => 0.5946, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.56% (0.5575 => 0.5265, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.56% (0.3849 => 0.3635, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.56% (0.6260 => 0.5912, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.55% (0.6395 => 0.6040, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.55% (8.0126 => 7.5683, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.54% (0.6440 => 0.6083, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.54% (0.5581 => 0.5272, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.52% (0.7339 => 0.6934, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.51% (0.5570 => 0.5263, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.50% (0.3252 => 0.3073, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.50% (0.5456 => 0.5156, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.48% (0.5567 => 0.5262, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.47% (0.5688 => 0.5377, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.46% (0.2106 => 0.1991, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.45% (1.2221 => 1.1555, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: -5.44% (0.3271 => 0.3093, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.44% (0.5569 => 0.5266, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.44% (0.5941 => 0.5618, std.dev.: 0.0065) MultiSource/Benchmarks/Bullet/bullet: -5.43% (34.0927 => 32.2410, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/bigfib: -5.41% (0.6750 => 0.6385, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -5.39% (0.3059 => 0.2894, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.37% (0.2999 => 0.2838, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.32% (0.2385 => 0.2258, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.32% (0.4813 => 0.4557, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.24% (0.6681 => 0.6331, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: -5.20% (5.0226 => 4.7615, std.dev.: 0.0826) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.70% (0.2278 => 0.2171, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -4.45% (0.7779 => 0.7433, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/Hello: -4.18% (0.6347 => 0.6082, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -4.13% (0.6441 => 0.6175, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.99% (0.9077 => 0.8715, std.dev.: 0.0030) MultiSource/Applications/hbd/hbd: -3.70% (1.5610 => 1.5033, std.dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: -2.70% (20.7746 => 20.2142, std.dev.: 0.0298) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7552, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/richards_benchmark: -8.72% (1.2842 => 1.1722, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7070, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.84% (2.2633 => 2.1763, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.49% (6.5735 => 6.4753, std.dev.: 0.0016) Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 10 01:56:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 10 Nov 2012 03:56:59 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121110095659.45EFE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5737?compare_to=5735&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5737, Order: 167668, Start Time: 2012-11-10 08:30:36, End Time: 2012-11-10 09:57:11 To: 5735, Order: 167665, Start Time: 2012-11-10 06:47:10, End Time: 2012-11-10 08:13:52 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 9 (98 on baseline) Performance Improvements: 4 (26 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 978 (850 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/sim/sim: 3.24% (0.3146 => 0.3248, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.80% (0.8881 => 0.9041, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.29% (1.4958 => 1.8890, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/pi: 7.71% (2.3281 => 2.5077, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.82% (0.3301 => 0.3526, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 4.05% (8.4371 => 8.7790, std.dev.: 0.0776) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.03% (0.3923 => 0.4042, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.65% (2.3251 => 2.3866, std.dev.: 0.0105) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.95% (2.4416 => 2.4893, std.dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.33% (2.4367 => 2.4044, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.32% (1.2239 => 1.2077, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.44% (22.7025 => 22.1475, std.dev.: 0.1887) SingleSource/Benchmarks/Misc/richards_benchmark: -1.76% (1.4111 => 1.3863, std.dev.: 0.0067) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.00% (16.7149 => 16.7153, std.dev.: 0.2478) MultiSource/Applications/obsequi/Obsequi: -1.02% (1.0716 => 1.0607, std.dev.: 0.0168) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.59% (21.6289 => 21.7563, std.dev.: 0.2965) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.14% (0.3654 => 0.3659, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 1.03% (0.6024 => 0.6086, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.21% (0.3329 => 0.3336, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 0.55% (0.2005 => 0.2016, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 12.44% (0.0193 => 0.0217, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 13.98% (0.0372 => 0.0424, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -8.37% (0.0263 => 0.0241, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0313 => 0.0313, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.47% (0.0423 => 0.0421, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -0.99% (0.0203 => 0.0201, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 25.88% (0.0170 => 0.0214, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -0.34% (0.1458 => 0.1453, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 4.14% (1.1418 => 1.1891, std.dev.: 0.0134) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.41% (0.1472 => 0.1478, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.13% (0.4176 => 0.4129, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.77% (0.1433 => 0.1487, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.62% (0.0646 => 0.0642, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.49% (0.0268 => 0.0272, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.48% (0.0574 => 0.0554, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.41% (1.2027 => 1.1978, std.dev.: 0.0112) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 8.00% (0.0025 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.42% (0.0578 => 0.0644, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.85% (0.0268 => 0.0255, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.83% (0.7840 => 0.7775, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -66.67% (0.0003 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -30.14% (0.0073 => 0.0051, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2295.04% (0.6332 => 15.1654, std.dev.: 0.3348) MultiSource/Benchmarks/McCat/08-main/main: 48.50% (0.1831 => 0.2719, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.16% (0.1559 => 0.1463, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1494.29% (0.3344 => 5.3313, std.dev.: 0.0314) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.56% (0.2364 => 0.3252, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: 0.93% (0.0429 => 0.0433, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.57% (0.0224 => 0.0232, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -29.57% (0.0230 => 0.0162, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4318, std.dev.: 0.0369) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0694, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4952, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3458, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1254, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4098, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: -24.22% (2.1832 => 1.6545, std.dev.: 0.0290) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.69% (0.0810 => 0.0929, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: 13.85% (0.1112 => 0.1266, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.08% (0.4847 => 0.5287, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.59% (0.6010 => 0.6466, std.dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.47% (0.3137 => 0.3340, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.31% (0.8321 => 0.8846, std.dev.: 0.0154) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.25% (0.1905 => 0.2024, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.14% (0.7473 => 0.7932, std.dev.: 0.0094) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.05% (0.1885 => 0.1999, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.60% (0.1983 => 0.2094, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.43% (0.3295 => 0.3474, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.85% (0.6287 => 0.6592, std.dev.: 0.0109) MultiSource/Applications/spiff/spiff: 4.79% (0.7950 => 0.8331, std.dev.: 0.0124) MultiSource/Applications/hbd/hbd: 4.67% (1.4269 => 1.4935, std.dev.: 0.0110) MultiSource/Applications/Burg/burg: 4.49% (1.2222 => 1.2771, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.97% (1.1606 => 1.2067, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.81% (0.5961 => 0.6188, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.73% (0.8716 => 0.9041, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.45% (0.4783 => 0.4948, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.40% (1.3279 => 1.3730, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.35% (1.1685 => 1.2077, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.18% (0.9688 => 0.9996, std.dev.: 0.0057) SingleSource/UnitTests/Vector/constpool: 3.16% (8.4179 => 8.6836, std.dev.: 0.0811) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.11% (4.1763 => 4.3061, std.dev.: 0.0364) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.11% (1.4479 => 1.4929, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.06% (0.8457 => 0.8716, std.dev.: 0.0070) MultiSource/Benchmarks/nbench/nbench: 3.05% (1.1271 => 1.1615, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.86% (0.9069 => 0.9328, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.84% (0.8712 => 0.8959, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.80% (0.8611 => 0.8852, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.78% (0.8697 => 0.8939, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.65% (0.8050 => 0.8263, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.55% (0.7932 => 0.8134, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.52% (0.9039 => 0.9267, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.50% (4.4873 => 4.5995, std.dev.: 0.0380) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.43% (0.8597 => 0.8806, std.dev.: 0.0065) MultiSource/Applications/SIBsim4/SIBsim4: 2.40% (1.2568 => 1.2870, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.38% (0.8261 => 0.8458, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.38% (1.6386 => 1.6776, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.36% (1.2526 => 1.2821, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.35% (0.4559 => 0.4666, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.34% (0.8286 => 0.8480, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.25% (0.8359 => 0.8547, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.18% (0.9056 => 0.9253, std.dev.: 0.0062) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.16% (6.6074 => 6.7501, std.dev.: 0.0402) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.11% (0.8855 => 0.9042, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.10% (0.8340 => 0.8515, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.00% (13.1811 => 13.4442, std.dev.: 0.0956) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.98% (0.8048 => 0.8207, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.97% (0.8518 => 0.8686, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.96% (2.1401 => 2.1820, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.90% (0.8086 => 0.8240, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/football/football: 1.89% (0.8768 => 0.8934, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.88% (0.8420 => 0.8578, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 1.74% (8.6247 => 8.7744, std.dev.: 0.0373) MultiSource/Benchmarks/Bullet/bullet: 1.73% (31.8598 => 32.4106, std.dev.: 0.1401) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.63% (4.5702 => 4.6445, std.dev.: 0.0245) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.62% (0.6586 => 0.6693, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.39% (1.5315 => 1.5528, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.38% (1.2423 => 1.2595, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.33% (0.8204 => 0.8313, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.25% (3.1832 => 3.2229, std.dev.: 0.0089) MultiSource/Benchmarks/PAQ8p/paq8p: 1.18% (2.3764 => 2.4044, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 73.37% (0.0199 => 0.0345, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/pi: 58.77% (1.5795 => 2.5077, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.73% (0.7597 => 0.8944, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.20% (2.9753 => 3.4572, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.53% (2.7995 => 3.2062, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.64% (5.0261 => 5.6109, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.67% (0.3186 => 0.3526, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.95% (1.1857 => 1.2800, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 7.50% (1.7056 => 1.8336, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.46% (4.7794 => 5.0882, std.dev.: 0.0636) SingleSource/Benchmarks/Misc/richards_benchmark: 6.34% (1.3037 => 1.3863, std.dev.: 0.0067) MultiSource/Applications/SIBsim4/SIBsim4: 6.17% (3.1873 => 3.3839, std.dev.: 0.0400) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.85% (4.5327 => 4.7977, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.74% (4.9686 => 5.2538, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.70% (3.3761 => 3.5348, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.68% (6.2275 => 6.5192, std.dev.: 0.0086) MultiSource/Applications/SPASS/SPASS: 4.11% (8.4326 => 8.7790, std.dev.: 0.0776) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.08% (4.9469 => 5.1485, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.93% (4.9453 => 5.1398, std.dev.: 0.0113) MultiSource/Applications/hexxagon/hexxagon: 3.88% (14.0064 => 14.5492, std.dev.: 0.0773) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.40% (0.3587 => 0.3709, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 3.14% (3.6643 => 3.7794, std.dev.: 0.0202) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.78% (1.1365 => 1.1681, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 2.69% (7.4933 => 7.6952, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.67% (11.5690 => 11.8778, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.43% (4.8362 => 4.9539, std.dev.: 0.0300) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.32% (4.8660 => 4.9789, std.dev.: 0.0189) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.30% (2.4333 => 2.4893, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/lists: 2.27% (7.3375 => 7.5039, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.82% (8.2783 => 8.4290, std.dev.: 0.0325) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.47% (2.4647 => 2.5010, std.dev.: 0.0091) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.46% (3.9006 => 3.9576, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/ReedSolomon: 1.39% (8.5322 => 8.6507, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/neural/neural: 1.30% (1.0841 => 1.0982, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 1.04% (1.2061 => 1.2187, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.29% (5.4641 => 4.3010, std.dev.: 0.0150) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.73% (1.0512 => 0.9384, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -9.61% (7.2130 => 6.5197, std.dev.: 0.1486) SingleSource/Benchmarks/McGill/chomp: -9.20% (1.1216 => 1.0184, std.dev.: 0.0272) MultiSource/Benchmarks/mafft/pairlocalalign: -8.53% (63.1822 => 57.7909, std.dev.: 0.1663) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.98% (4.7482 => 4.4166, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.24% (0.3269 => 0.3065, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.91% (5.4972 => 5.1721, std.dev.: 0.0270) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.90% (3.7148 => 3.4955, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.13% (5.1557 => 4.8912, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.73% (2.8773 => 2.7413, std.dev.: 0.0346) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.32% (4.7449 => 4.5399, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.80% (6.0224 => 5.7933, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.62% (0.5807 => 0.5597, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.94% (28.5821 => 27.7421, std.dev.: 0.0730) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.80% (2.6356 => 2.5617, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -2.59% (0.3937 => 0.3835, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.55% (2.4490 => 2.3866, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/hash2: -2.40% (3.4237 => 3.3415, std.dev.: 0.0040) MultiSource/Applications/aha/aha: -2.34% (3.3398 => 3.2616, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.20% (9.9065 => 9.6884, std.dev.: 0.0388) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.98% (11.5316 => 11.3028, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.57% (4.9994 => 4.9211, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.53% (3.2169 => 3.1677, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.3487 => 2.3148, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.36% (5.6343 => 5.5579, std.dev.: 0.0055) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.64% (16.4461 => 16.7153, std.dev.: 0.2478) MultiSource/Applications/obsequi/Obsequi: 3.36% (1.0262 => 1.0607, std.dev.: 0.0168) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6866.47% (0.3123 => 21.7563, std.dev.: 0.2965) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.56% (0.2463 => 0.3659, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 1.26% (0.6010 => 0.6086, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.14% (0.3266 => 0.3336, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 2.39% (0.1969 => 0.2016, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -5.12% (0.0254 => 0.0241, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.64% (0.0384 => 0.0421, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 5.79% (0.0190 => 0.0201, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 18.89% (0.0180 => 0.0214, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 1.04% (0.1438 => 0.1453, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 4.96% (1.1329 => 1.1891, std.dev.: 0.0134) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.09% (0.1462 => 0.1478, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.84% (0.4164 => 0.4129, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.62% (0.1369 => 0.1487, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.16% (0.0641 => 0.0642, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 39.49% (0.0195 => 0.0272, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.15% (0.0578 => 0.0554, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.73% (1.1437 => 1.1978, std.dev.: 0.0112) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.71% (0.0627 => 0.0644, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 41.67% (0.0180 => 0.0255, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.02% (0.8017 => 0.7775, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -17.74% (0.0062 => 0.0051, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 10 02:03:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 10 Nov 2012 04:03:23 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121110100323.1E8532A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5738?compare_to=5731&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5738, Order: 167665, Start Time: 2012-11-10 06:44:56, End Time: 2012-11-10 10:03:35 To: 5731, Order: 167655, Start Time: 2012-11-10 02:41:09, End Time: 2012-11-10 05:56:54 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (169 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1039 (723 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.81% (2.4656 => 2.5102, std.dev.: 0.0071) MultiSource/Applications/hbd/hbd: 1.25% (1.1317 => 1.1458, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 1.14% (16.6642 => 16.8540, std.dev.: 0.0201) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.04% (0.0625 => 0.0894, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.58% (0.1063 => 0.1420, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.54% (0.2969 => 0.3757, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.04% (0.1106 => 0.1394, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.88% (0.4139 => 0.5210, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.58% (0.4253 => 0.5341, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 25.36% (1.5932 => 1.9972, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.79% (0.0714 => 0.0891, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.29% (0.5900 => 0.7333, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.11% (0.4994 => 0.6198, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.00% (0.5000 => 0.6200, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.79% (0.0475 => 0.0588, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.63% (0.0584 => 0.0722, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.58% (0.0547 => 0.0676, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.84% (0.1620 => 0.1990, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.72% (0.1021 => 0.1253, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.31% (0.1107 => 0.1354, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.30% (0.1103 => 0.1349, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.30% (0.0897 => 0.1097, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 22.04% (0.0599 => 0.0731, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.48% (0.0633 => 0.0769, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 21.31% (0.0948 => 0.1150, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.23% (0.0584 => 0.0708, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.03% (0.0642 => 0.0777, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.84% (0.1003 => 0.1212, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.81% (0.0495 => 0.0598) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.78% (0.3903 => 0.4714, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 20.71% (0.0821 => 0.0991, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.66% (0.1549 => 0.1869, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.56% (0.0822 => 0.0991, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.32% (0.1604 => 0.1930, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 20.32% (0.1619 => 0.1948, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.59% (0.0582 => 0.0696, std.dev.: 0.0030) MultiSource/Applications/viterbi/viterbi: 19.54% (0.0947 => 0.1132, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.36% (0.1462 => 0.1745, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 19.31% (0.0808 => 0.0964, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 19.29% (0.5826 => 0.6950, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 19.10% (0.5889 => 0.7014, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.00% (0.3890 => 0.4629, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 18.88% (0.1218 => 0.1448) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.87% (0.2014 => 0.2394, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 18.74% (0.4029 => 0.4784, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.63% (1.3152 => 1.5602, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/mst/mst: 18.62% (0.0698 => 0.0828, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.53% (0.1160 => 0.1375, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.17% (0.2736 => 0.3233, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 18.16% (0.9697 => 1.1458, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.01% (0.1088 => 0.1284, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: 18.01% (0.5546 => 0.6545, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: 18.01% (0.1505 => 0.1776, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.89% (0.1968 => 0.2320, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.83% (0.2866 => 0.3377, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.69% (3.5627 => 4.1930, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.66% (0.0572 => 0.0673, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.64% (0.3271 => 0.3848, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 17.58% (1.8794 => 2.2098, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.52% (0.0605 => 0.0711, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.39% (0.2875 => 0.3375, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.29% (1.6211 => 1.9014, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.26% (0.4658 => 0.5462, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.02% (0.3930 => 0.4599, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 16.98% (0.1284 => 0.1502, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.91% (0.2738 => 0.3201, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 16.83% (0.7171 => 0.8378, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 16.78% (0.2813 => 0.3285, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 16.76% (0.2823 => 0.3296, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 16.75% (0.1421 => 0.1659, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 16.73% (1.0781 => 1.2585, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hello: 16.73% (0.2714 => 0.3168, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.72% (0.4361 => 0.5090, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 16.70% (0.2725 => 0.3180, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.69% (0.2792 => 0.3258, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 16.65% (0.2780 => 0.3243, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 16.62% (0.2750 => 0.3207, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.55% (2.7292 => 3.1810, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.53% (0.2729 => 0.3180, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.52% (0.2911 => 0.3392, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 16.47% (0.2811 => 0.3274, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 16.41% (0.3004 => 0.3497, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 16.41% (0.2803 => 0.3263, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.37% (0.5026 => 0.5849, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 16.31% (0.9909 => 1.1525, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/wc: 16.15% (0.3096 => 0.3596, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 16.12% (4.2109 => 4.8895, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.11% (2.0673 => 2.4004, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.08% (4.4195 => 5.1301, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.74% (1.9694 => 2.2794, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary3: 15.70% (0.3267 => 0.3780, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.69% (0.3060 => 0.3540, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.66% (1.9966 => 2.3092, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary: 15.62% (0.3258 => 0.3767, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.50% (0.1090 => 0.1259, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 15.47% (0.3317 => 0.3830, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.35% (0.3362 => 0.3878, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 15.32% (0.3446 => 0.3974, std.dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 15.32% (0.2566 => 0.2959, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 15.19% (0.3496 => 0.4027, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.17% (0.3124 => 0.3598, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 15.12% (0.3465 => 0.3989, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 15.11% (23.5202 => 27.0752, std.dev.: 0.0255) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.11% (0.3488 => 0.4015, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 15.08% (0.3442 => 0.3961, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 15.08% (0.3469 => 0.3992, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 14.98% (0.3678 => 0.4229, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 14.98% (0.3726 => 0.4284, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 14.97% (0.3460 => 0.3978, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 14.87% (0.3348 => 0.3846, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 14.85% (0.3650 => 0.4192, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 14.84% (0.2075 => 0.2383, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 14.81% (0.3477 => 0.3992, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.81% (0.3282 => 0.3768, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 14.80% (0.3724 => 0.4275, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.72% (0.3845 => 0.4411, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/exceptions: 14.58% (0.3643 => 0.4174, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 14.56% (1.4269 => 1.6346, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 14.42% (0.4146 => 0.4744, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.37% (0.3981 => 0.4553, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 14.30% (0.4251 => 0.4859, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.25% (0.3690 => 0.4216, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 14.25% (0.0758 => 0.0866, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 14.25% (0.7875 => 0.8997, std.dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 13.84% (2.1653 => 2.4650, std.dev.: 0.0135) MultiSource/Benchmarks/mafft/pairlocalalign: 13.66% (2.1013 => 2.3883, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 13.64% (0.2691 => 0.3058, std.dev.: 0.0043) MultiSource/Applications/JM/lencod/lencod: 13.57% (4.6177 => 5.2445, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.84% (0.2040 => 0.2302, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.58% (0.1383 => 0.1557, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 12.53% (5.5417 => 6.2358, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.25% (0.6435 => 0.7223, std.dev.: 0.0184) MultiSource/Applications/siod/siod: 11.77% (0.6634 => 0.7415, std.dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: 11.64% (0.3498 => 0.3905, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.33% (0.2737 => 0.3047, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 11.24% (0.3336 => 0.3711, std.dev.: 0.0045) MultiSource/Benchmarks/PAQ8p/paq8p: 11.20% (0.4847 => 0.5390, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.09% (0.3084 => 0.3426, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.32% (0.2103 => 0.2320, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 10.04% (0.2391 => 0.2631, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 9.86% (2.0346 => 2.2353, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.09% (4.6926 => 5.1193, std.dev.: 0.1375) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.05% (11.6398 => 12.6936, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.84% (0.5361 => 0.5835, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.31% (0.5584 => 0.6048, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.27% (0.7426 => 0.8040, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 7.03% (11.9555 => 12.7955, std.dev.: 0.0286) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.64% (0.3792 => 0.4006, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: 1.36% (2.4764 => 2.5102, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 9.92% (0.2802 => 0.3080, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6096, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6715, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1718, std.dev.: 0.0206) SingleSource/Benchmarks/Misc/flops-2: 4.43% (1.8057 => 1.8857, std.dev.: 0.0068) SingleSource/Benchmarks/Dhrystone/dry: 4.12% (14.0481 => 14.6269, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2013, std.dev.: 0.0048) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2239, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3044, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.44% (1.0927 => 1.1084, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2873, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6030, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5627, std.dev.: 0.0261) SingleSource/Benchmarks/Shootout-C++/ary2: -10.78% (0.2402 => 0.2143, std.dev.: 0.0076) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9757, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7888, std.dev.: 0.0952) MultiSource/Benchmarks/Olden/tsp/tsp: -7.21% (2.1113 => 1.9591, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8004, std.dev.: 0.0048) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7727, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.02% (0.6293 => 0.6103, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0126) SingleSource/Benchmarks/Dhrystone/fldry: -2.23% (17.2379 => 16.8540, std.dev.: 0.0201) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8646, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5769, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4954, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.08% (105.3826 => 104.2408, std.dev.: 0.0525) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 10 03:08:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 10 Nov 2012 05:08:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121110110831.A928B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5739?compare_to=5736&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5739, Order: 167671, Start Time: 2012-11-10 09:43:43, End Time: 2012-11-10 11:08:33 To: 5736, Order: 167668, Start Time: 2012-11-10 07:51:40, End Time: 2012-11-10 09:20:10 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (180 on baseline) Unchanged Tests: 1042 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.64% (2.0478 => 2.1019, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 2.47% (7.4937 => 7.6788, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash2: 2.42% (3.1932 => 3.2705, std.dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.22% (0.1431 => 0.1299, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -8.03% (2.4924 => 2.2923, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.85% (0.3821 => 0.3521, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.99% (0.9542 => 0.8875, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.79% (0.3357 => 0.3129, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.75% (0.3142 => 0.2930, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.71% (22.4056 => 20.9026, std.dev.: 0.0254) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.57% (3.5339 => 3.3018, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -6.57% (16.1920 => 15.1286, std.dev.: 0.0091) MultiSource/Applications/JM/ldecod/ldecod: -6.48% (7.0961 => 6.6362, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.47% (0.2428 => 0.2271, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.45% (0.9852 => 0.9217, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -6.44% (4.3330 => 4.0538, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/oourafft: -6.44% (0.2160 => 0.2021, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.43% (9.2283 => 8.6351, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/football/football: -6.43% (0.9179 => 0.8589, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.42% (0.3658 => 0.3423, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.39% (1.0544 => 0.9870, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: -6.36% (1.2515 => 1.1719, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.35% (0.1796 => 0.1682, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.31% (0.1584 => 0.1484, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.28% (0.6484 => 0.6077, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -6.26% (0.2985 => 0.2798, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.24% (0.1716 => 0.1609, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -6.23% (0.1879 => 0.1762, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.21% (1.3722 => 1.2870, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.19% (1.2300 => 1.1539, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.19% (4.0323 => 3.7829, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.17% (1.4642 => 1.3739, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.16% (4.5069 => 4.2294, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.14% (0.7919 => 0.7433, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.14% (1.6364 => 1.5360, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.13% (1.2784 => 1.2000, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -6.10% (1.1450 => 1.0752, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -6.09% (2.4021 => 2.2559, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/trivial-interface: -6.09% (0.3812 => 0.3580, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.08% (0.1761 => 0.1654, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -6.06% (0.4176 => 0.3923, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.06% (0.3848 => 0.3615, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -6.05% (0.2659 => 0.2498, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.04% (0.6736 => 0.6329, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.04% (6.7716 => 6.3629, std.dev.: 0.0107) SingleSource/UnitTests/ObjC/exceptions-2: -6.03% (0.3831 => 0.3600, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -6.02% (1.1530 => 1.0836, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.01% (4.8161 => 4.5268, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.99% (0.3891 => 0.3658, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.99% (0.2355 => 0.2214, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.98% (4.8802 => 4.5883, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-4: -5.98% (0.3880 => 0.3648, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.97% (0.2695 => 0.2534, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.97% (0.3884 => 0.3652, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: -5.96% (0.7447 => 0.7003, std.dev.: 0.0010) MultiSource/Applications/lua/lua: -5.96% (4.0594 => 3.8176, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.96% (14.2083 => 13.3620, std.dev.: 0.0145) SingleSource/UnitTests/ObjC/property: -5.93% (0.4199 => 0.3950, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.93% (0.2548 => 0.2397, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -5.90% (15.5079 => 14.5922, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/18-imp/imp: -5.89% (0.3581 => 0.3370, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.89% (0.3483 => 0.3278, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.88% (0.3896 => 0.3667, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/for-in: -5.88% (0.4033 => 0.3796, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.84% (0.3406 => 0.3207, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.82% (0.5857 => 0.5516, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.79% (0.7198 => 0.6781, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.78% (5.4682 => 5.1520, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.75% (0.5999 => 0.5654, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: -5.74% (0.4861 => 0.4582, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.73% (0.4151 => 0.3913, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: -5.73% (1.3864 => 1.3070, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.72% (0.8521 => 0.8034, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.71% (1.6474 => 1.5533, std.dev.: 0.0181) MultiSource/Applications/hexxagon/hexxagon: -5.70% (1.3148 => 1.2398, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -5.70% (0.4280 => 0.4036, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.68% (0.5478 => 0.5167, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.67% (0.7021 => 0.6623, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.66% (0.4083 => 0.3852, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.65% (2.2587 => 2.1311, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: -5.65% (0.4515 => 0.4260, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.63% (0.4916 => 0.4639, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.63% (0.5859 => 0.5529, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.63% (0.5168 => 0.4877, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -5.62% (0.3255 => 0.3072, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.62% (17.1032 => 16.1426, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/fibo: -5.61% (0.2871 => 0.2710, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -5.60% (18.2933 => 17.2684, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.59% (0.5329 => 0.5031, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.58% (0.5802 => 0.5478, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.58% (0.7524 => 0.7104, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.58% (0.6293 => 0.5942, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.57% (0.2999 => 0.2832, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.56% (0.3057 => 0.2887, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.56% (0.6676 => 0.6305, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.56% (0.9557 => 0.9026, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: -5.55% (0.3026 => 0.2858, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.54% (0.6660 => 0.6291, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.54% (0.3016 => 0.2849, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.52% (0.6446 => 0.6090, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.52% (0.5849 => 0.5526, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.52% (0.6667 => 0.6299, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -5.51% (0.3446 => 0.3256, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -5.51% (0.2939 => 0.2777, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.51% (0.6194 => 0.5853, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.50% (0.6395 => 0.6043, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.50% (0.5581 => 0.5274, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.50% (0.6260 => 0.5916, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.49% (0.7339 => 0.6936, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.49% (0.2933 => 0.2772, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.49% (0.2278 => 0.2153, std.dev.: 0.0022) MultiSource/Applications/treecc/treecc: -5.49% (2.1401 => 2.0227, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.48% (2.1713 => 2.0523, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.47% (0.6230 => 0.5889, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.47% (0.5591 => 0.5285, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.47% (0.6033 => 0.5703, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.46% (0.6681 => 0.6316, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.46% (0.5805 => 0.5488, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.46% (8.0126 => 7.5752, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.46% (0.5863 => 0.5543, std.dev.: 0.0045) MultiSource/Applications/d/make_dparser: -5.45% (3.5154 => 3.3237, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.44% (0.2903 => 0.2745, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.44% (0.6304 => 0.5961, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: -5.44% (0.4524 => 0.4278, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -5.42% (0.7982 => 0.7549, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: -5.41% (0.2849 => 0.2695, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.40% (0.5705 => 0.5397, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -5.39% (0.3394 => 0.3211, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.39% (0.5456 => 0.5162, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.38% (0.5925 => 0.5606, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.37% (0.3837 => 0.3631, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.36% (0.6189 => 0.5857, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.36% (0.5575 => 0.5276, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: -5.36% (0.3788 => 0.3585, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.36% (0.6440 => 0.6095, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.36% (0.3491 => 0.3304, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.35% (0.4427 => 0.4190, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -5.35% (0.3867 => 0.3660, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.35% (0.5941 => 0.5623, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -5.34% (34.0927 => 32.2713, std.dev.: 0.0256) SingleSource/Benchmarks/Shootout-C++/wc: -5.34% (0.3205 => 0.3034, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.32% (0.3025 => 0.2864, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.32% (0.2106 => 0.1994, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.32% (0.5567 => 0.5271, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -5.31% (15.2527 => 14.4429, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.30% (0.6395 => 0.6056, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.29% (1.2221 => 1.1574, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/objinst: -5.29% (0.3194 => 0.3025, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.29% (1.2210 => 1.1564, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: -5.27% (0.3621 => 0.3430, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.27% (0.3849 => 0.3646, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -5.27% (0.6750 => 0.6394, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: -5.27% (0.4248 => 0.4024, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.25% (0.4321 => 0.4094, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.24% (0.2385 => 0.2260, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.24% (0.6297 => 0.5967, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: -5.23% (0.3271 => 0.3100, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.21% (0.5570 => 0.5280, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -5.20% (0.3481 => 0.3300, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.18% (0.3319 => 0.3147, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -5.17% (0.3059 => 0.2901, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.10% (0.3252 => 0.3086, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.08% (0.5569 => 0.5286, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.05% (0.4813 => 0.4570, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.04% (0.3931 => 0.3733, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -5.02% (0.8418 => 0.7995, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.88% (0.3323 => 0.3161, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: -4.87% (5.0226 => 4.7780, std.dev.: 0.0100) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.52% (0.9077 => 0.8667, std.dev.: 0.0032) MultiSource/Applications/hbd/hbd: -4.11% (1.5610 => 1.4969, std.dev.: 0.0042) SingleSource/UnitTests/ObjC++/property-reference-object: -3.88% (0.6441 => 0.6191, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -3.82% (0.7779 => 0.7482, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: -3.80% (0.6347 => 0.6106, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -2.63% (20.7746 => 20.2289, std.dev.: 0.0805) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.32% (7.5137 => 5.7614, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/richards_benchmark: -8.68% (1.2842 => 1.1727, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.92% (2.2633 => 2.1745, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7069, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3339, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.36% (1.0557 => 1.0202, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4721, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.47% (1.3096 => 1.2903, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.02% (3.2107 => 3.1781, std.dev.: 0.0003) Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 10 03:40:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 10 Nov 2012 05:40:15 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121110114015.370CA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5740?compare_to=5737&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5740, Order: 167674, Start Time: 2012-11-10 10:14:29, End Time: 2012-11-10 11:40:29 To: 5737, Order: 167668, Start Time: 2012-11-10 08:30:36, End Time: 2012-11-10 09:57:11 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 8 (101 on baseline) Performance Improvements: 6 (25 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 977 (848 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/health/health: 7.64% (0.1348 => 0.1451, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.67% (0.4201 => 0.4313, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.55% (2.1820 => 2.2159, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.50% (1.2595 => 1.2784, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.04% (6.7501 => 6.8201, std.dev.: 0.0244) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.51% (1.3754 => 1.4512, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.92% (2.5617 => 2.6110, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.05% (8.4290 => 8.5172, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.39% (0.8846 => 0.8458, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.57% (0.9041 => 0.8899, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.16% (0.8716 => 0.8615, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.14% (0.9996 => 0.9882, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: -1.57% (1.4950 => 1.4716, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/primes/primes: -1.40% (0.8944 => 0.8819, std.dev.: 0.0019) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.15% (16.7153 => 16.6898, std.dev.: 0.0415) MultiSource/Applications/obsequi/Obsequi: -1.21% (1.0607 => 1.0479, std.dev.: 0.0194) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.13% (21.7563 => 22.0025, std.dev.: 0.1640) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.03% (0.3659 => 0.3660, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: -0.61% (0.6086 => 0.6049, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.12% (0.3336 => 0.3332, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.2016 => 0.2016, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.84% (0.0217 => 0.0221, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.71% (0.0424 => 0.0427, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 38.17% (0.0241 => 0.0333, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0313 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.24% (0.0421 => 0.0422, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 1.49% (0.0201 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -13.55% (0.0214 => 0.0185, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.28% (0.1453 => 0.1457, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.80% (1.1891 => 1.1796, std.dev.: 0.0295) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -5.68% (0.1478 => 0.1394, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.05% (0.4129 => 0.4127, std.dev.: 0.0350) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.83% (0.1487 => 0.1430, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.59% (0.0642 => 0.0574, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -25.00% (0.0272 => 0.0204, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.35% (0.0554 => 0.0567, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.92% (1.1978 => 1.1868, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.45% (0.0031 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -25.93% (0.0027 => 0.0020, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.35% (0.0644 => 0.0558, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.37% (0.0255 => 0.0226, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.21% (0.7775 => 0.7759, std.dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -7.84% (0.0051 => 0.0047, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2305.01% (0.6332 => 15.2285, std.dev.: 0.1065) MultiSource/Benchmarks/McCat/08-main/main: 46.26% (0.1831 => 0.2678, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -10.26% (0.1559 => 0.1399, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1505.32% (0.3344 => 5.3682, std.dev.: 0.0292) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.46% (0.2364 => 0.3226, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -0.47% (0.0429 => 0.0427, std.dev.: 0.0010) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.25% (0.0224 => 0.0238, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4322, std.dev.: 0.0311) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0703, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4960, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3725, std.dev.: 0.0217) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1327, std.dev.: 0.0296) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4011, std.dev.: 0.0095) SingleSource/Regression/C/uint64_to_float: -24.24% (2.1832 => 1.6541, std.dev.: 0.0090) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.53% (0.0810 => 0.0952, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 10.43% (0.1112 => 0.1228, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: 7.72% (0.1347 => 0.1451, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.95% (0.1983 => 0.2101, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.77% (0.6287 => 0.6650, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.58% (0.2133 => 0.2252, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.51% (0.3137 => 0.3310, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.74% (1.1606 => 1.2156, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.51% (0.4127 => 0.4313, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.01% (0.2519 => 0.2620, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 3.97% (0.2999 => 0.3118, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.74% (1.1685 => 1.2122, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.64% (0.2774 => 0.2875, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.54% (2.1401 => 2.2159, std.dev.: 0.0088) MultiSource/Benchmarks/nbench/nbench: 3.42% (1.1271 => 1.1657, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.36% (1.6386 => 1.6937, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.22% (6.6074 => 6.8201, std.dev.: 0.0244) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.15% (0.3717 => 0.3834, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.95% (1.2526 => 1.2896, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.91% (0.6227 => 0.6408, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.91% (1.2423 => 1.2784, std.dev.: 0.0059) MultiSource/Applications/hbd/hbd: 2.81% (1.4269 => 1.4670, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.72% (4.1763 => 4.2899, std.dev.: 0.0421) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.70% (1.4479 => 1.4870, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.65% (4.4873 => 4.6064, std.dev.: 0.0223) MultiSource/Applications/lua/lua: 2.62% (3.8189 => 3.9190, std.dev.: 0.0238) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.48% (1.5315 => 1.5695, std.dev.: 0.0083) MultiSource/Benchmarks/McCat/05-eks/eks: 2.48% (0.4397 => 0.4506, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.39% (4.5702 => 4.6796, std.dev.: 0.0294) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.31% (0.8656 => 0.8856, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.29% (0.9074 => 0.9282, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.28% (0.4783 => 0.4892, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.19% (0.9908 => 1.0125, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 2.17% (14.2605 => 14.5700, std.dev.: 0.0917) MultiSource/Applications/d/make_dparser: 2.14% (3.2366 => 3.3058, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.14% (0.8611 => 0.8795, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.12% (0.8331 => 0.8508, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.11% (0.8204 => 0.8377, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.10% (0.8716 => 0.8899, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 2.05% (0.6834 => 0.6974, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.05% (13.1811 => 13.4511, std.dev.: 0.0480) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.02% (0.8805 => 0.8983, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.01% (0.8317 => 0.8484, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.00% (0.9688 => 0.9882, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.98% (0.8069 => 0.8229, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.94% (0.7932 => 0.8086, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.87% (0.8340 => 0.8496, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.87% (0.8457 => 0.8615, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.85% (0.8177 => 0.8328, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.83% (0.8066 => 0.8214, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.79% (0.8086 => 0.8231, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.79% (0.8338 => 0.8487, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.74% (0.7966 => 0.8105, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.70% (0.8359 => 0.8501, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.67% (0.8885 => 0.9033, std.dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: 1.66% (4.9628 => 5.0451, std.dev.: 0.0305) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.61% (0.6586 => 0.6692, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.60% (0.8048 => 0.8177, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 1.58% (2.2184 => 2.2535, std.dev.: 0.0132) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.57% (4.4880 => 4.5585, std.dev.: 0.0245) MultiSource/Benchmarks/PAQ8p/paq8p: 1.52% (2.3764 => 2.4126, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.49% (0.8316 => 0.8440, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: 1.29% (1.0945 => 1.1086, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.20% (0.8995 => 0.9103, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 93.97% (0.0199 => 0.0386, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/pi: 58.72% (1.5795 => 2.5070, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.43% (2.9753 => 3.4641, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.09% (0.7597 => 0.8819, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.74% (2.7995 => 3.2121, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.63% (5.0261 => 5.6105, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.22% (0.3186 => 0.3448, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.09% (1.1857 => 1.2816, std.dev.: 0.0074) SingleSource/Benchmarks/McGill/queens: 7.33% (1.7056 => 1.8307, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.38% (4.7794 => 5.0844, std.dev.: 0.0154) SingleSource/Benchmarks/Misc/richards_benchmark: 6.35% (1.3037 => 1.3865, std.dev.: 0.0036) MultiSource/Applications/SIBsim4/SIBsim4: 6.35% (3.1873 => 3.3896, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.83% (4.9686 => 5.2585, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.70% (4.5327 => 4.7909, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.65% (6.2275 => 6.5169, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.54% (1.3882 => 1.4512, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.44% (3.3761 => 3.5259, std.dev.: 0.0303) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.17% (4.9469 => 5.1534, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 3.91% (14.0064 => 14.5543, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.64% (4.9453 => 5.1254, std.dev.: 0.0183) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.21% (0.3587 => 0.3702, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: 2.93% (0.5081 => 0.5230, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.89% (8.2783 => 8.5172, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.87% (11.5690 => 11.9015, std.dev.: 0.0060) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.85% (1.2337 => 1.2689, std.dev.: 0.0034) MultiSource/Applications/siod/siod: 2.67% (3.6643 => 3.7623, std.dev.: 0.0087) MultiSource/Applications/lambda-0_1_3/lambda: 2.48% (7.4933 => 7.6792, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.47% (4.8660 => 4.9862, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.30% (4.8362 => 4.9476, std.dev.: 0.0210) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.20% (1.1365 => 1.1615, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/lists: 2.12% (7.3375 => 7.4932, std.dev.: 0.0145) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.83% (59.2638 => 60.3496, std.dev.: 0.3821) MultiSource/Applications/minisat/minisat: 1.51% (6.1525 => 6.2453, std.dev.: 0.0304) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.40% (4.0473 => 4.1039, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.37% (2.4647 => 2.4984, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 1.21% (8.5322 => 8.6358, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.16% (3.5679 => 3.6093, std.dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.98% (5.4641 => 4.3175, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.29% (7.2130 => 6.3265, std.dev.: 0.2793) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.13% (1.0512 => 0.9342, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: -10.26% (1.1216 => 1.0065, std.dev.: 0.0176) MultiSource/Benchmarks/mafft/pairlocalalign: -8.37% (63.1822 => 57.8934, std.dev.: 0.1144) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -7.02% (4.7482 => 4.4150, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.55% (0.3269 => 0.3055, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.22% (3.7148 => 3.4839, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.08% (5.4972 => 5.1628, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.10% (5.1557 => 4.8927, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.22% (4.7449 => 4.5449, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.83% (6.0224 => 5.7918, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.38% (2.4490 => 2.3663, std.dev.: 0.0259) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.29% (2.8773 => 2.7827, std.dev.: 0.0168) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.15% (0.5807 => 0.5624, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.05% (28.5821 => 27.7100, std.dev.: 0.0220) MultiSource/Benchmarks/FreeBench/mason/mason: -2.90% (0.5415 => 0.5258, std.dev.: 0.0049) MultiSource/Applications/aha/aha: -2.70% (3.3398 => 3.2495, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash2: -2.51% (3.4237 => 3.3378, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.32% (9.9065 => 9.6765, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.27% (3.2169 => 3.1440, std.dev.: 0.0138) MultiSource/Benchmarks/Olden/bisort/bisort: -2.17% (0.6636 => 0.6492, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.05% (11.5316 => 11.2952, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.65% (2.3487 => 2.3100, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.60% (4.9994 => 4.9194, std.dev.: 0.0063) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.48% (16.4461 => 16.6898, std.dev.: 0.0415) MultiSource/Applications/obsequi/Obsequi: 2.11% (1.0262 => 1.0479, std.dev.: 0.0194) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6945.31% (0.3123 => 22.0025, std.dev.: 0.1640) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.60% (0.2463 => 0.3660, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 0.65% (0.6010 => 0.6049, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.02% (0.3266 => 0.3332, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: 2.39% (0.1969 => 0.2016, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 79.67% (0.0123 => 0.0221, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 2.78% (0.0180 => 0.0185, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.32% (0.1438 => 0.1457, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 4.12% (1.1329 => 1.1796, std.dev.: 0.0295) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.65% (0.1462 => 0.1394, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.89% (0.4164 => 0.4127, std.dev.: 0.0350) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.46% (0.1369 => 0.1430, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.45% (0.0641 => 0.0574, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 4.62% (0.0195 => 0.0204, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.90% (0.0578 => 0.0567, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.77% (1.1437 => 1.1868, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2800.00% (0.0001 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 42.86% (0.0014 => 0.0020, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.00% (0.0627 => 0.0558, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.56% (0.0180 => 0.0226, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.22% (0.8017 => 0.7759, std.dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -24.19% (0.0062 => 0.0047, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 10 04:59:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 10 Nov 2012 06:59:04 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121110125904.0FC092A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5741?compare_to=5739&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5741, Order: 167674, Start Time: 2012-11-10 11:34:13, End Time: 2012-11-10 12:59:17 To: 5739, Order: 167671, Start Time: 2012-11-10 09:43:43, End Time: 2012-11-10 11:08:33 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 1 (182 on baseline) Unchanged Tests: 1041 (856 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.06% (3.7321 => 3.6927, std.dev.: 0.0038) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.66% (2.0478 => 2.1023, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.4937 => 7.6741, std.dev.: 0.0221) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1932 => 3.2519, std.dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.15% (0.1431 => 0.1300, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -8.00% (2.4924 => 2.2931, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.93% (0.3821 => 0.3518, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.91% (0.9542 => 0.8883, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: -6.88% (0.3357 => 0.3126, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.84% (0.2428 => 0.2262, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.72% (0.3142 => 0.2931, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.70% (3.5339 => 3.2970, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.61% (22.4056 => 20.9239, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.59% (0.3658 => 0.3417, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -6.59% (16.1920 => 15.1254, std.dev.: 0.0133) MultiSource/Benchmarks/MallocBench/gs/gs: -6.49% (4.3330 => 4.0516, std.dev.: 0.0079) MultiSource/Applications/JM/ldecod/ldecod: -6.49% (7.0961 => 6.6355, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/oourafft: -6.48% (0.2160 => 0.2020, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.46% (9.2283 => 8.6323, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.46% (0.9852 => 0.9216, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.42% (1.0544 => 0.9867, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: -6.41% (0.9179 => 0.8591, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: -6.39% (1.2515 => 1.1715, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.35% (0.1796 => 0.1682, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.32% (0.6484 => 0.6074, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.29% (0.1716 => 0.1608, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.24% (0.2355 => 0.2208, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.24% (1.4642 => 1.3729, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.23% (1.3722 => 1.2867, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/ReedSolomon: -6.23% (0.1879 => 0.1762, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.22% (1.2784 => 1.1989, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.21% (1.6364 => 1.5347, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.21% (0.7919 => 0.7427, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.19% (4.0323 => 3.7827, std.dev.: 0.0158) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.18% (4.5069 => 4.2283, std.dev.: 0.0167) MultiSource/Benchmarks/Olden/bh/bh: -6.16% (0.2985 => 0.2801, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.15% (1.2300 => 1.1544, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: -6.13% (0.1761 => 0.1653, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -6.13% (1.1450 => 1.0748, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -6.11% (0.3880 => 0.3643, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -6.09% (0.2659 => 0.2497, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -6.08% (2.4021 => 2.2560, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.05% (4.8161 => 4.5247, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/trivial-interface: -6.03% (0.3812 => 0.3582, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -6.03% (0.3831 => 0.3600, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.03% (0.3848 => 0.3616, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -6.02% (0.7447 => 0.6999, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.01% (0.3891 => 0.3657, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.01% (0.2695 => 0.2533, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.01% (6.7716 => 6.3646, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.01% (0.6293 => 0.5915, std.dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: -6.00% (1.1530 => 1.0838, std.dev.: 0.0122) SingleSource/UnitTests/ObjC/for-in: -6.00% (0.4033 => 0.3791, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -5.99% (4.0594 => 3.8161, std.dev.: 0.0056) MultiSource/Applications/SPASS/SPASS: -5.98% (15.5079 => 14.5798, std.dev.: 0.0161) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.97% (0.2548 => 0.2396, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.93% (14.2083 => 13.3653, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/synchronized: -5.93% (0.3896 => 0.3665, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.91% (0.3483 => 0.3277, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.90% (0.3406 => 0.3205, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.90% (0.3884 => 0.3655, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: -5.89% (0.4176 => 0.3930, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.86% (4.8802 => 4.5944, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.85% (0.6736 => 0.6342, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: -5.84% (0.3581 => 0.3372, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.83% (0.8521 => 0.8024, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.80% (0.5329 => 0.5020, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.78% (0.5999 => 0.5652, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.77% (5.4682 => 5.1525, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/property: -5.76% (0.4199 => 0.3957, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: -5.74% (1.3864 => 1.3068, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.74% (1.6474 => 1.5529, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.73% (0.5863 => 0.5527, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.72% (0.5802 => 0.5470, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.71% (0.7198 => 0.6787, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.71% (0.6395 => 0.6030, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.71% (0.6660 => 0.6280, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -5.70% (0.4861 => 0.4584, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.70% (0.7021 => 0.6621, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.69% (0.5849 => 0.5516, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -5.69% (17.1032 => 16.1306, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.69% (0.5857 => 0.5524, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.68% (0.5805 => 0.5475, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.68% (0.5478 => 0.5167, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.66% (0.4151 => 0.3916, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -5.65% (0.4280 => 0.4038, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/05-eks/eks: -5.65% (0.4515 => 0.4260, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.64% (0.5705 => 0.5383, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -5.64% (1.3148 => 1.2406, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.62% (0.5925 => 0.5592, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.62% (0.9557 => 0.9020, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.62% (0.6446 => 0.6084, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.62% (0.5859 => 0.5530, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -5.60% (18.2933 => 17.2685, std.dev.: 0.0300) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.60% (0.6304 => 0.5951, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: -5.58% (3.5154 => 3.3194, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.57% (0.5168 => 0.4880, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.57% (0.7524 => 0.7105, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.57% (0.2999 => 0.2832, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.55% (2.2587 => 2.1334, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.53% (0.2278 => 0.2152, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.53% (0.4813 => 0.4547, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/except: -5.52% (0.3026 => 0.2859, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.52% (0.5581 => 0.5273, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -5.50% (2.1401 => 2.0224, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.50% (0.3057 => 0.2889, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -5.48% (0.4524 => 0.4276, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: -5.47% (0.7982 => 0.7545, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.47% (0.6194 => 0.5855, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.47% (0.3255 => 0.3077, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.47% (0.4427 => 0.4185, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.46% (0.6681 => 0.6316, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.46% (0.5567 => 0.5263, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.45% (0.5575 => 0.5271, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.45% (0.2385 => 0.2255, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.45% (2.1713 => 2.0530, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.45% (0.6297 => 0.5954, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.45% (0.3837 => 0.3628, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.44% (8.0126 => 7.5765, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.44% (0.6230 => 0.5891, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.44% (0.6676 => 0.6313, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.44% (0.7339 => 0.6940, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -5.42% (0.2989 => 0.2827, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.42% (0.3931 => 0.3718, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.41% (0.4916 => 0.4650, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -5.41% (0.2939 => 0.2780, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -5.41% (0.6750 => 0.6385, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -5.41% (0.2849 => 0.2695, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.40% (0.3016 => 0.2853, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.40% (0.5591 => 0.5289, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.39% (0.2933 => 0.2775, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.39% (0.6052 => 0.5726, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.36% (0.2871 => 0.2717, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.35% (0.6667 => 0.6310, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -5.35% (15.2527 => 14.4374, std.dev.: 0.0234) SingleSource/Benchmarks/Shootout-C++/moments: -5.34% (0.4248 => 0.4021, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.34% (0.2903 => 0.2748, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: -5.33% (0.3394 => 0.3213, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.33% (0.6395 => 0.6054, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.33% (0.3491 => 0.3305, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.33% (0.3323 => 0.3146, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.32% (0.6033 => 0.5712, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.31% (0.4083 => 0.3866, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -5.31% (0.3446 => 0.3263, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.31% (0.5688 => 0.5386, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -5.31% (34.0927 => 32.2826, std.dev.: 0.0494) SingleSource/Benchmarks/Shootout-C++/lists1: -5.30% (0.3867 => 0.3662, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.30% (0.5569 => 0.5274, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.28% (0.4321 => 0.4093, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: -5.27% (0.3205 => 0.3036, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.27% (0.3319 => 0.3144, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.27% (0.6260 => 0.5930, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.26% (0.5570 => 0.5277, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.25% (1.2210 => 1.1569, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.24% (0.5456 => 0.5170, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.24% (1.2221 => 1.1581, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.24% (0.6189 => 0.5865, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -5.23% (0.3788 => 0.3590) SingleSource/Benchmarks/Shootout-C++/methcall: -5.22% (0.3025 => 0.2867, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.22% (0.5941 => 0.5631, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.22% (0.6440 => 0.6104) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.20% (0.3252 => 0.3083, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.17% (0.3849 => 0.3650, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -5.17% (0.3194 => 0.3029, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -5.16% (0.3621 => 0.3434, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: -5.14% (0.3271 => 0.3103, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -5.11% (0.3481 => 0.3303, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.08% (0.2106 => 0.1999, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -5.01% (0.8418 => 0.7996, std.dev.: 0.0039) SingleSource/Regression/C++/ofstream_ctor: -4.97% (0.3059 => 0.2907, std.dev.: 0.0051) MultiSource/Applications/oggenc/oggenc: -4.85% (5.0226 => 4.7790, std.dev.: 0.0151) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.46% (0.9077 => 0.8672, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference: -4.15% (0.7779 => 0.7456, std.dev.: 0.0035) MultiSource/Applications/hbd/hbd: -4.11% (1.5610 => 1.4968, std.dev.: 0.0085) SingleSource/UnitTests/ObjC++/property-reference-object: -3.80% (0.6441 => 0.6196, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -3.78% (0.6347 => 0.6107, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.64% (20.7746 => 20.2258, std.dev.: 0.0157) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7550, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/richards_benchmark: -8.72% (1.2842 => 1.1722, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -4.11% (2.2633 => 2.1703, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7060, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.94% (1.3096 => 1.2842, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.61% (6.5735 => 6.4676, std.dev.: 0.0045) Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 10 06:08:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 10 Nov 2012 08:08:42 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121110140842.1E13C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5742?compare_to=5738&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5742, Order: 167674, Start Time: 2012-11-10 10:51:43, End Time: 2012-11-10 14:08:55 To: 5738, Order: 167665, Start Time: 2012-11-10 06:44:56, End Time: 2012-11-10 10:03:35 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (177 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1038 (715 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.69% (0.2124 => 0.2266, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 6.07% (0.2143 => 0.2273, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.01% (124.3933 => 129.3813, std.dev.: 0.5069) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.45% (2.0967 => 2.1272, std.dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.20% (0.0625 => 0.0895, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.49% (0.1063 => 0.1419, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.29% (0.4253 => 0.5371, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.17% (0.2969 => 0.3746, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.86% (0.1106 => 0.1392, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.49% (0.4139 => 0.5194, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 24.94% (1.5932 => 1.9906, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.79% (0.0714 => 0.0891, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.73% (0.4994 => 0.6229, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.71% (0.5900 => 0.7358, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.32% (0.0584 => 0.0726, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.21% (0.0475 => 0.0590) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.76% (0.5000 => 0.6188, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 23.45% (0.0452 => 0.0558, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.40% (0.0547 => 0.0675, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.12% (0.0584 => 0.0719, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.90% (0.1620 => 0.1991, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.53% (0.1021 => 0.1251, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.52% (0.0897 => 0.1099, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.30% (0.1103 => 0.1349, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.22% (0.1107 => 0.1353, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 22.04% (0.0599 => 0.0731, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 21.41% (0.0948 => 0.1151, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.17% (0.0633 => 0.0767, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.03% (0.0642 => 0.0777, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.84% (0.1003 => 0.1212, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.81% (0.0495 => 0.0598, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 20.71% (0.0821 => 0.0991, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.60% (0.3903 => 0.4707, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.45% (0.1604 => 0.1932, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.40% (0.1549 => 0.1865, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 20.20% (0.1619 => 0.1946, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 20.17% (0.0947 => 0.1138, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.07% (0.0822 => 0.0987, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.22% (0.1462 => 0.1743, std.dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 18.94% (0.0808 => 0.0961, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.82% (0.3890 => 0.4622, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 18.74% (0.5826 => 0.6918, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.72% (0.2014 => 0.2391, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 18.64% (0.4029 => 0.4780, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 18.64% (0.1218 => 0.1445, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 18.53% (0.5889 => 0.6980, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.48% (1.3152 => 1.5582, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.20% (0.2736 => 0.3234, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/mst/mst: 18.19% (0.0698 => 0.0825, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 18.07% (0.1505 => 0.1777, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.01% (0.1088 => 0.1284, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.80% (0.0573 => 0.0675, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 17.70% (1.8794 => 2.2120, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.69% (0.2866 => 0.3373, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.66% (0.0572 => 0.0673, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 17.65% (0.5546 => 0.6525, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.52% (0.4658 => 0.5474, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.43% (0.1968 => 0.2311, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.35% (3.5627 => 4.1807, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 17.27% (1.0781 => 1.2643, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 17.08% (0.9697 => 1.1353, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.06% (0.2738 => 0.3205, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.04% (0.2875 => 0.3365, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.98% (0.1160 => 0.1357, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.94% (0.3271 => 0.3825, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.93% (0.5026 => 0.5877, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.91% (1.6211 => 1.8952, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/18-imp/imp: 16.75% (0.1421 => 0.1659, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 16.69% (0.0605 => 0.0706, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.65% (0.4361 => 0.5087, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.49% (0.3930 => 0.4578, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: 16.44% (0.2780 => 0.3237, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 16.40% (0.7171 => 0.8347, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hello: 16.40% (0.2714 => 0.3159, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 16.33% (0.2725 => 0.3170, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 16.28% (0.1284 => 0.1493, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 16.27% (0.9909 => 1.1521, std.dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.26% (2.7292 => 3.1730, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.23% (0.2729 => 0.3172, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 16.18% (0.2750 => 0.3195, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 16.15% (0.2811 => 0.3265, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 16.09% (0.2803 => 0.3254, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 16.08% (4.2109 => 4.8882, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/methcall: 16.07% (0.2813 => 0.3265, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 16.05% (0.2823 => 0.3276, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 16.01% (0.3004 => 0.3485, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.01% (4.4195 => 5.1271, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.87% (0.2792 => 0.3235, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.84% (0.2911 => 0.3372, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 15.79% (0.3096 => 0.3585, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.68% (0.3195 => 0.3696, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.67% (2.0673 => 2.3912, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.61% (1.9694 => 2.2769, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/ary3: 15.55% (0.3267 => 0.3775, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.53% (1.9966 => 2.3067, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.50% (0.1090 => 0.1259, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 15.47% (0.3258 => 0.3762, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 15.43% (0.2566 => 0.2962, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 15.22% (0.3317 => 0.3822, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.00% (0.3060 => 0.3519, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.96% (0.3362 => 0.3865, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: 14.90% (0.3678 => 0.4226, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.88% (0.3124 => 0.3589, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 14.72% (23.5202 => 26.9814, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/football/football: 14.55% (0.2075 => 0.2377, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.50% (0.3282 => 0.3758, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 14.50% (0.3477 => 0.3981, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 14.46% (1.4269 => 1.6333, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists: 14.43% (0.3348 => 0.3831, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 14.42% (0.4146 => 0.4744, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: 14.41% (0.3726 => 0.4263, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.36% (0.3488 => 0.3989, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 14.31% (0.3446 => 0.3939, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 14.21% (0.4251 => 0.4855, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.21% (0.3442 => 0.3931, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 14.19% (0.3496 => 0.3992, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 14.17% (0.3465 => 0.3956, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 14.13% (0.3469 => 0.3959, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.12% (0.3625 => 0.4137, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 14.08% (0.3460 => 0.3947, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 14.06% (0.7875 => 0.8982, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 13.90% (0.2691 => 0.3065, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 13.86% (0.3650 => 0.4156, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.86% (0.3724 => 0.4240, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 13.81% (0.3643 => 0.4146, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.72% (0.3981 => 0.4527, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.71% (0.3690 => 0.4196, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.58% (0.3845 => 0.4367, std.dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 13.54% (2.1653 => 2.4584, std.dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: 13.50% (2.1013 => 2.3849, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 13.46% (0.0758 => 0.0860, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 13.44% (4.6177 => 5.2382, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/bigfib: 13.43% (0.5012 => 0.5685, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.50% (0.2040 => 0.2295, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 12.43% (5.5417 => 6.2305, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.06% (0.6435 => 0.7211, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 11.75% (0.3498 => 0.3909, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.58% (0.1028 => 0.1147, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 11.40% (0.6634 => 0.7390, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.36% (0.2737 => 0.3048, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.28% (0.3084 => 0.3432, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.21% (0.1383 => 0.1538, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.17% (0.2068 => 0.2299, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 10.89% (0.4847 => 0.5375, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 10.28% (0.3336 => 0.3679, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.22% (0.2103 => 0.2318, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 10.08% (0.2391 => 0.2632, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 9.86% (2.0346 => 2.2353, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.13% (4.6926 => 5.1210, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.02% (11.6398 => 12.6900, std.dev.: 0.0182) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.95% (0.5361 => 0.5841, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.33% (0.5584 => 0.6049, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.21% (0.7426 => 0.8036, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 7.24% (11.9555 => 12.8209, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.83% (0.3792 => 0.3975, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.12% (0.0734 => 0.0867, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.27% (0.5917 => 0.6702, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 10.39% (0.2802 => 0.3093, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.79% (0.2122 => 0.2266, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6108, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.01% (0.3693 => 0.3915, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6740, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-2: 4.83% (1.8057 => 1.8930, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1691, std.dev.: 0.0606) SingleSource/Benchmarks/Dhrystone/dry: 4.12% (14.0481 => 14.6266, std.dev.: 0.0160) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.17% (2.0820 => 2.1272, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1922, std.dev.: 0.0078) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2239, std.dev.: 0.0040) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3039, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2861, std.dev.: 0.0030) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.38% (1.0142 => 1.0282, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5389, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5827, std.dev.: 0.0288) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.89% (25.4195 => 16.5496, std.dev.: 0.0141) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9758, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7890, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/tsp/tsp: -7.17% (2.1113 => 1.9600, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: -5.37% (0.2402 => 0.2273, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7938, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0043) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7728, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.95% (17.2379 => 16.7286, std.dev.: 0.0964) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8607, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5759, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4957, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0434, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 10 09:08:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 10 Nov 2012 11:08:38 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121110170838.16DA32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5743?compare_to=5740&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5743, Order: 167675, Start Time: 2012-11-10 15:42:07, End Time: 2012-11-10 17:08:51 To: 5740, Order: 167674, Start Time: 2012-11-10 10:14:29, End Time: 2012-11-10 11:40:29 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 12 (102 on baseline) Performance Improvements: 3 (24 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 976 (848 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.93% (0.4619 => 0.5170, std.dev.: 0.0079) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.30% (0.8458 => 0.8906, std.dev.: 0.0134) MultiSource/Benchmarks/Olden/bh/bh: 4.77% (0.2956 => 0.3097, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.44% (0.2388 => 0.2494, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.3061 => 0.3188, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.81% (0.9570 => 0.9935, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.49% (0.9148 => 0.9376, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.25% (6.8657 => 7.5010, std.dev.: 0.0548) SingleSource/Benchmarks/Shootout/heapsort: 6.29% (2.9979 => 3.1864, std.dev.: 0.0523) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.03% (21.6298 => 22.2855, std.dev.: 0.2314) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.12% (40.9349 => 41.8034, std.dev.: 0.2443) SingleSource/Benchmarks/Shootout-C++/hash: 1.65% (0.6246 => 0.6349, std.dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.93% (2.2159 => 2.1732, std.dev.: 0.0161) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/life/life: -1.83% (2.6110 => 2.5632, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: -1.41% (9.0570 => 8.9294, std.dev.: 0.0363) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.54% (16.6898 => 16.7800, std.dev.: 0.1952) MultiSource/Applications/obsequi/Obsequi: 1.13% (1.0479 => 1.0597, std.dev.: 0.0099) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.31% (22.0025 => 21.9333, std.dev.: 0.0708) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.55% (0.3660 => 0.3640, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 2.25% (0.6049 => 0.6185, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.20% (0.3332 => 0.3372, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/strcat: -0.25% (0.2016 => 0.2011, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -13.57% (0.0221 => 0.0191, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.39% (0.0427 => 0.0404, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.90% (0.0333 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0312 => 0.0313, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.24% (0.0422 => 0.0423, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: -34.80% (0.0204 => 0.0133, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/test1: -0.54% (0.0185 => 0.0184, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1457 => 0.1455, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.02% (1.1796 => 1.1916, std.dev.: 0.0941) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 5.81% (0.1394 => 0.1475, std.dev.: 0.0095) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 8.55% (0.4127 => 0.4480, std.dev.: 0.2803) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.66% (0.1430 => 0.1392, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.85% (0.0574 => 0.0642, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 36.27% (0.0204 => 0.0278, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.47% (0.0567 => 0.0581, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.07% (1.1868 => 1.1995, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 6.90% (0.0029 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 30.00% (0.0020 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 15.41% (0.0558 => 0.0644, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.58% (0.0226 => 0.0268, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.30% (0.7759 => 0.7860, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -23.40% (0.0047 => 0.0036, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2305.32% (0.6332 => 15.2305, std.dev.: 0.2788) MultiSource/Benchmarks/McCat/08-main/main: 47.68% (0.1831 => 0.2704, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.13% (0.1559 => 0.1479, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1497.31% (0.3344 => 5.3414, std.dev.: 0.0382) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.52% (0.2364 => 0.3251, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: 0.70% (0.0429 => 0.0432, std.dev.: 0.0010) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.80% (0.0224 => 0.0237, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -32.17% (0.0230 => 0.0156, std.dev.: 0.0014) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4336, std.dev.: 0.0198) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0733, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4926, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3438, std.dev.: 0.0159) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1218, std.dev.: 0.0472) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4041, std.dev.: 0.0032) SingleSource/Regression/C/uint64_to_float: -24.00% (2.1832 => 1.6592, std.dev.: 0.0021) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 13.94% (0.1112 => 0.1267, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.17% (0.0830 => 0.0931, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.03% (0.0848 => 0.0950, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.43% (0.2279 => 0.2494, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.80% (0.2180 => 0.2350, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/health/health: 7.80% (0.1347 => 0.1452, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.14% (0.1905 => 0.2041, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.12% (0.7473 => 0.8005, std.dev.: 0.0125) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.03% (0.8321 => 0.8906, std.dev.: 0.0134) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.92% (0.3137 => 0.3354, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.66% (0.4847 => 0.5170, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.34% (0.2998 => 0.3188, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.52% (0.2519 => 0.2658, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.49% (0.3295 => 0.3476, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.49% (0.2133 => 0.2250, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.30% (0.9435 => 0.9935, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.19% (0.6287 => 0.6613, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.88% (0.5961 => 0.6252, std.dev.: 0.0054) MultiSource/Applications/spiff/spiff: 4.35% (0.7950 => 0.8296, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.94% (1.1606 => 1.2063, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.75% (4.1763 => 4.3331, std.dev.: 0.0290) MultiSource/Benchmarks/Olden/bh/bh: 3.75% (0.2985 => 0.3097, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.69% (1.6386 => 1.6991, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.54% (0.4127 => 0.4273, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 3.52% (3.8189 => 3.9533, std.dev.: 0.0306) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.48% (6.6074 => 6.8373, std.dev.: 0.0563) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.39% (0.9069 => 0.9376, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.18% (0.8518 => 0.8789, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.93% (0.8805 => 0.9063, std.dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 2.78% (1.1271 => 1.1584, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.72% (4.4873 => 4.6092, std.dev.: 0.0325) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.69% (0.8597 => 0.8828, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.67% (0.8286 => 0.8507, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.67% (1.2526 => 1.2860, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.59% (1.4479 => 1.4854, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.58% (0.8611 => 0.8833, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.48% (0.8359 => 0.8566, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.47% (0.9056 => 0.9280, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.42% (0.8317 => 0.8518, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.41% (0.8007 => 0.8200, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.41% (0.8261 => 0.8460, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.38% (0.9908 => 1.0144, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.38% (0.8457 => 0.8658, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.35% (0.8697 => 0.8901, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.35% (0.9039 => 0.9251, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.33% (0.8086 => 0.8274, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.30% (13.1811 => 13.4844, std.dev.: 0.0500) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.19% (0.8050 => 0.8226, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 2.09% (14.7684 => 15.0767, std.dev.: 0.0843) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.96% (0.8204 => 0.8365, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.95% (4.5702 => 4.6593, std.dev.: 0.0329) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.93% (0.8331 => 0.8492, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 1.82% (0.9810 => 0.9989, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.82% (0.7932 => 0.8076, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.79% (0.8716 => 0.8872, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/football/football: 1.78% (0.8768 => 0.8924, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.77% (0.8177 => 0.8322, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 1.76% (31.8598 => 32.4203, std.dev.: 0.1657) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.74% (0.8340 => 0.8485, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.73% (0.8316 => 0.8460, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.64% (0.8420 => 0.8558, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.61% (0.8338 => 0.8472, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.60% (0.8066 => 0.8195, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (0.6586 => 0.6689, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: 1.53% (2.3764 => 2.4127, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.53% (0.8712 => 0.8845, std.dev.: 0.0049) MultiSource/Applications/lemon/lemon: 1.31% (1.0945 => 1.1088, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 78.39% (0.0199 => 0.0355, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/pi: 58.20% (1.5795 => 2.4988, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 17.62% (6.3772 => 7.5010, std.dev.: 0.0548) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.85% (0.7597 => 0.8877, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.36% (2.9753 => 3.4622, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.57% (2.7995 => 3.2075, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.62% (5.0261 => 5.6101, std.dev.: 0.0131) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.09% (1.1857 => 1.2816, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 7.48% (1.7056 => 1.8331, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 7.17% (1.3037 => 1.3972, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.75% (4.7794 => 5.1021, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.47% (0.3186 => 0.3392, std.dev.: 0.0073) MultiSource/Applications/SIBsim4/SIBsim4: 6.40% (3.1873 => 3.3912, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.85% (4.5327 => 4.7980, std.dev.: 0.0720) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.75% (4.9686 => 5.2545, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.70% (3.3761 => 3.5347, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.54% (6.2275 => 6.5102, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.26% (4.9453 => 5.1561, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.12% (4.9469 => 5.1507, std.dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 3.82% (14.0064 => 14.5409, std.dev.: 0.0209) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.06% (1.2337 => 1.2714, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.86% (11.5690 => 11.8994, std.dev.: 0.0207) MultiSource/Applications/lambda-0_1_3/lambda: 2.67% (7.4933 => 7.6931, std.dev.: 0.0259) MultiSource/Applications/siod/siod: 2.66% (3.6643 => 3.7616, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.61% (4.8660 => 4.9932, std.dev.: 0.0215) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.60% (8.2783 => 8.4932, std.dev.: 0.0154) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.56% (4.8362 => 4.9598, std.dev.: 0.0046) SingleSource/Benchmarks/Dhrystone/dry: 2.40% (0.5081 => 0.5203, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: 2.34% (7.3375 => 7.5095, std.dev.: 0.0235) SingleSource/Benchmarks/Shootout-C++/hash: 2.32% (0.6205 => 0.6349, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.11% (1.1365 => 1.1605, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/power/power: 1.48% (1.2061 => 1.2240, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 1.33% (8.5322 => 8.6453, std.dev.: 0.0334) MultiSource/Benchmarks/FreeBench/neural/neural: 1.29% (1.0841 => 1.0981, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.24% (4.0473 => 4.0973, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.14% (5.4641 => 4.3088, std.dev.: 0.1054) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.79% (7.2130 => 6.3628, std.dev.: 0.0394) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.57% (1.0512 => 0.9296, std.dev.: 0.0327) MultiSource/Benchmarks/mafft/pairlocalalign: -8.49% (63.1822 => 57.8175, std.dev.: 0.0902) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.93% (4.7482 => 4.4193, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.18% (0.3269 => 0.3067, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.09% (3.7148 => 3.4887, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.92% (5.4972 => 5.1717, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.25% (5.1557 => 4.8848, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.38% (4.7449 => 4.5369, std.dev.: 0.0132) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.33% (2.8773 => 2.7527, std.dev.: 0.0216) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.10% (2.4490 => 2.3486, std.dev.: 0.0278) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.88% (6.0224 => 5.7886, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.24% (0.5807 => 0.5619, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.07% (28.5821 => 27.7055, std.dev.: 0.0348) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.75% (2.6356 => 2.5632, std.dev.: 0.0012) MultiSource/Applications/aha/aha: -2.51% (3.3398 => 3.2560, std.dev.: 0.0212) SingleSource/Benchmarks/Shootout-C++/hash2: -2.20% (3.4237 => 3.3483, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.16% (9.9065 => 9.6922, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.01% (11.5316 => 11.3003, std.dev.: 0.0357) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.55% (4.9994 => 4.9219, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.31% (3.2169 => 3.1749, std.dev.: 0.0103) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.3487 => 2.3187, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.22% (5.6343 => 5.5656, std.dev.: 0.0014) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.03% (16.4461 => 16.7800, std.dev.: 0.1952) MultiSource/Applications/obsequi/Obsequi: 3.26% (1.0262 => 1.0597, std.dev.: 0.0099) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6923.15% (0.3123 => 21.9333, std.dev.: 0.0708) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.79% (0.2463 => 0.3640, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 2.91% (0.6010 => 0.6185, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.25% (0.3266 => 0.3372, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/strcat: 2.13% (0.1969 => 0.2011, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 55.28% (0.0123 => 0.0191, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.98% (0.0408 => 0.0404, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: -30.00% (0.0190 => 0.0133, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/test1: 2.22% (0.0180 => 0.0184, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 1.18% (0.1438 => 0.1455, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 5.18% (1.1329 => 1.1916, std.dev.: 0.0941) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.89% (0.1462 => 0.1475, std.dev.: 0.0095) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 7.59% (0.4164 => 0.4480, std.dev.: 0.2803) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.68% (0.1369 => 0.1392, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.16% (0.0641 => 0.0642, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.56% (0.0195 => 0.0278, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.52% (0.0578 => 0.0581, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.88% (1.1437 => 1.1995, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.71% (0.0627 => 0.0644, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.89% (0.0180 => 0.0268, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.96% (0.8017 => 0.7860, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -41.94% (0.0062 => 0.0036, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 10 09:12:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 10 Nov 2012 11:12:21 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121110171221.EEF062A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5744?compare_to=5741&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5744, Order: 167675, Start Time: 2012-11-10 15:47:58, End Time: 2012-11-10 17:12:35 To: 5741, Order: 167674, Start Time: 2012-11-10 11:34:13, End Time: 2012-11-10 12:59:17 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (181 on baseline) Unchanged Tests: 1042 (856 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1010, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4937 => 7.6674, std.dev.: 0.0188) SingleSource/Benchmarks/Shootout-C++/hash2: 2.17% (3.1932 => 3.2626, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.36% (79.7170 => 80.8016, std.dev.: 0.0428) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.01% (0.1431 => 0.1302, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.01% (0.3821 => 0.3515, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -7.49% (2.4924 => 2.3058, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.91% (0.9542 => 0.8883, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.88% (0.3357 => 0.3126, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.84% (0.3142 => 0.2927, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.75% (0.2428 => 0.2264, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.62% (3.5339 => 3.3000, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: -6.59% (16.1920 => 15.1257, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.57% (0.6484 => 0.6058, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.55% (22.4056 => 20.9377, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.53% (0.3658 => 0.3419, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -6.51% (7.0961 => 6.6341, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/oourafft: -6.48% (0.2160 => 0.2020, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -6.45% (9.2283 => 8.6330, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.44% (1.0544 => 0.9865, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.41% (0.9852 => 0.9220, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -6.37% (4.3330 => 4.0572, std.dev.: 0.0083) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.31% (0.1584 => 0.1484, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -6.30% (1.2515 => 1.1727, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.29% (0.1796 => 0.1683, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.28% (1.3722 => 1.2860, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -6.28% (0.9179 => 0.8603, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.25% (1.2784 => 1.1985, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.24% (0.1716 => 0.1609, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.20% (0.2355 => 0.2209, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.19% (4.0323 => 3.7826, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -6.17% (0.1879 => 0.1763, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.15% (1.6364 => 1.5358, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -6.13% (0.2985 => 0.2802, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.11% (0.7919 => 0.7435, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: -6.09% (0.2659 => 0.2497, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.09% (1.2300 => 1.1551, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.08% (1.4642 => 1.3752, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.05% (0.6293 => 0.5912, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.05% (4.8161 => 4.5248, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -6.04% (1.1450 => 1.0758, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.04% (4.5069 => 4.2346, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: -6.01% (1.1530 => 1.0837, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.00% (0.2548 => 0.2395, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.98% (4.8802 => 4.5883, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.97% (5.4682 => 5.1420, std.dev.: 0.0122) SingleSource/UnitTests/ObjC/BoolLiteralTest: -5.92% (0.3834 => 0.3607, std.dev.: 0.0064) MultiSource/Applications/siod/siod: -5.92% (2.4021 => 2.2600, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.90% (6.7716 => 6.3720, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.89% (0.6736 => 0.6339, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -5.89% (4.0594 => 3.8204, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.89% (0.3483 => 0.3278, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.88% (14.2083 => 13.3730, std.dev.: 0.0161) MultiSource/Applications/SPASS/SPASS: -5.88% (15.5079 => 14.5964, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/trivial-interface: -5.88% (0.3812 => 0.3588, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -5.86% (0.3581 => 0.3371, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -5.85% (0.3831 => 0.3607, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.83% (0.7198 => 0.6778) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.83% (0.5999 => 0.5649, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.83% (0.2695 => 0.2538, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -5.82% (1.3864 => 1.3057, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.81% (0.8521 => 0.8026, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.80% (0.3880 => 0.3655, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: -5.79% (17.1032 => 16.1123, std.dev.: 0.0133) SingleSource/UnitTests/ObjC/for-in: -5.78% (0.4033 => 0.3800, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -5.76% (0.4515 => 0.4255, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -5.75% (0.3406 => 0.3210, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/synchronized: -5.75% (0.3896 => 0.3672, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.73% (0.3891 => 0.3668, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.68% (0.7021 => 0.6622, std.dev.: 0.0091) MultiSource/Applications/minisat/minisat: -5.68% (0.7447 => 0.7024, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.67% (0.2999 => 0.2829, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.67% (0.3848 => 0.3630, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.66% (0.4151 => 0.3916, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.65% (0.5859 => 0.5528, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.64% (0.3884 => 0.3665, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -5.63% (1.3148 => 1.2408, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.62% (0.5805 => 0.5479, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -5.60% (0.4176 => 0.3942, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.60% (0.5857 => 0.5529, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.59% (0.4813 => 0.4544, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.58% (0.2278 => 0.2151, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.57% (0.5329 => 0.5032, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: -5.55% (3.5154 => 3.3203, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.54% (0.6260 => 0.5913, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.53% (0.4916 => 0.4644, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.53% (0.5478 => 0.5175, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.53% (0.6660 => 0.6292, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -5.53% (0.4199 => 0.3967, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: -5.52% (18.2933 => 17.2843, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.51% (0.4083 => 0.3858, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.50% (0.6395 => 0.6043, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.50% (0.5802 => 0.5483, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.49% (2.1713 => 2.0520, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.49% (0.6230 => 0.5888, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.48% (0.6446 => 0.6093, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.48% (0.5168 => 0.4885, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.47% (0.6304 => 0.5959, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: -5.47% (0.4861 => 0.4595, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.47% (0.6052 => 0.5721, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.46% (0.5581 => 0.5276, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.46% (8.0126 => 7.5748, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.46% (0.7524 => 0.7113, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.46% (2.2587 => 2.1354, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.46% (0.5591 => 0.5286, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.45% (0.5925 => 0.5602, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.45% (0.3837 => 0.3628, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/parameter-passing: -5.44% (0.4280 => 0.4047, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.44% (0.3931 => 0.3717, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.43% (0.9557 => 0.9038, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.43% (0.6667 => 0.6305, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.42% (0.6681 => 0.6319, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -5.42% (2.1401 => 2.0242, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.41% (1.2221 => 1.1560, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.40% (0.5705 => 0.5397, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.39% (0.5849 => 0.5534, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.38% (0.5575 => 0.5275, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.37% (0.2903 => 0.2747, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.37% (0.4321 => 0.4089, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -5.36% (0.2871 => 0.2717, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: -5.36% (0.7982 => 0.7554, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.36% (0.3491 => 0.3304, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.36% (0.5863 => 0.5549, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.35% (0.5567 => 0.5269, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: -5.35% (0.3255 => 0.3081, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.34% (0.2939 => 0.2782, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.33% (0.3319 => 0.3142, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -5.33% (15.2527 => 14.4401, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/hash: -5.33% (0.4524 => 0.4283, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.33% (0.3323 => 0.3146, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: -5.32% (0.2989 => 0.2830, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -5.32% (0.6750 => 0.6391, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.32% (0.2106 => 0.1994, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.32% (0.6395 => 0.6055, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.32% (0.6189 => 0.5860, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.32% (0.5569 => 0.5273, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: -5.31% (0.3446 => 0.3263, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -5.30% (0.3205 => 0.3035, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.30% (0.6676 => 0.6322, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: -5.30% (0.2849 => 0.2698, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.30% (0.6440 => 0.6099, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.29% (1.2210 => 1.1564, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.29% (0.6297 => 0.5964, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.29% (0.5941 => 0.5627, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.28% (0.2933 => 0.2778, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.28% (0.2385 => 0.2259, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -5.28% (0.3867 => 0.3663, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -5.27% (0.3621 => 0.3430, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.27% (0.3849 => 0.3646, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.27% (0.3016 => 0.2857, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.27% (0.6033 => 0.5715, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.27% (0.3057 => 0.2896, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.26% (0.6194 => 0.5868, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -5.26% (34.0927 => 32.2992, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/ary: -5.24% (0.3394 => 0.3216, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.24% (0.5688 => 0.5390, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: -5.23% (0.3194 => 0.3027, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -5.23% (0.4248 => 0.4026, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -5.22% (0.3025 => 0.2867, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.21% (0.5456 => 0.5172, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -5.19% (0.3026 => 0.2869, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.17% (0.4427 => 0.4198, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -5.14% (0.3481 => 0.3302, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.13% (0.5570 => 0.5284, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: -5.11% (0.3271 => 0.3104, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.10% (0.3252 => 0.3086, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -5.08% (0.8418 => 0.7990, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: -5.04% (0.3788 => 0.3597, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.97% (1.6474 => 1.5655, std.dev.: 0.0031) SingleSource/Regression/C++/ofstream_ctor: -4.97% (0.3059 => 0.2907, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.80% (0.9077 => 0.8641, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: -4.69% (5.0226 => 4.7870, std.dev.: 0.0047) MultiSource/Applications/hbd/hbd: -4.23% (1.5610 => 1.4950, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -3.88% (0.7779 => 0.7477, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.49% (0.6441 => 0.6216, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.32% (0.6347 => 0.6136, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -2.97% (20.7746 => 20.1576, std.dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7537, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: -8.65% (1.2842 => 1.1731, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.89% (2.2633 => 2.1753, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4735, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 10 10:51:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 10 Nov 2012 12:51:51 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121110185151.6F6E92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5745?compare_to=5743&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5745, Order: 167676, Start Time: 2012-11-10 17:26:01, End Time: 2012-11-10 18:52:02 To: 5743, Order: 167675, Start Time: 2012-11-10 15:42:07, End Time: 2012-11-10 17:08:51 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 5 (97 on baseline) Performance Improvements: 3 (23 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 983 (854 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.56% (0.8100 => 0.8307, std.dev.: 0.0038) MultiSource/Applications/hbd/hbd: 2.47% (1.4530 => 1.4889, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.18% (0.8872 => 0.8977, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 2.43% (3.6568 => 3.7458, std.dev.: 0.0267) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.25% (3.5689 => 3.6135, std.dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: -4.35% (0.3307 => 0.3163, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -1.52% (1.3972 => 1.3760, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/whetstone: -1.31% (2.1393 => 2.1113, std.dev.: 0.0044) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.53% (16.7800 => 16.6906, std.dev.: 0.1328) MultiSource/Applications/obsequi/Obsequi: -0.51% (1.0597 => 1.0543, std.dev.: 0.0233) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.39% (21.9333 => 21.6283, std.dev.: 0.3391) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.63% (0.3640 => 0.3663, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/bigfib: -2.46% (0.6185 => 0.6033, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/reversefile: -1.87% (0.3372 => 0.3309, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/strcat: 0.50% (0.2011 => 0.2021, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -22.51% (0.0191 => 0.0148, std.dev.: 0.0048) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.45% (0.0404 => 0.0426, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -19.39% (0.0330 => 0.0266, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0313 => 0.0313, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.24% (0.0423 => 0.0422, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 52.63% (0.0133 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 7.61% (0.0184 => 0.0198, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.69% (0.1455 => 0.1465, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -3.65% (1.1916 => 1.1481, std.dev.: 0.0131) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.75% (0.1475 => 0.1464, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.38% (0.4480 => 0.4194, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.15% (0.1392 => 0.1408, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.31% (0.0642 => 0.0640, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -17.99% (0.0278 => 0.0228, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.27% (0.0581 => 0.0600, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.93% (1.1995 => 1.2107, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -45.16% (0.0031 => 0.0017, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -26.92% (0.0026 => 0.0019, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.99% (0.0644 => 0.0599, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.21% (0.0268 => 0.0179, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.38% (0.7860 => 0.7830, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 216.67% (0.0036 => 0.0114, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2292.58% (0.6332 => 15.1498, std.dev.: 0.2565) MultiSource/Benchmarks/McCat/08-main/main: 48.28% (0.1831 => 0.2715, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.32% (0.1559 => 0.1476, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1481.79% (0.3344 => 5.2895, std.dev.: 0.0486) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.91% (0.2364 => 0.3213, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/mandel: 3.03% (0.0429 => 0.0442, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.23% (0.0224 => 0.0229, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4369, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0701, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4911, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3347, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1336, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4095, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -24.19% (2.1832 => 1.6551, std.dev.: 0.0082) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0007, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.43% (0.0810 => 0.0935, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.76% (0.6010 => 0.6416, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.71% (0.4847 => 0.5172, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.93% (0.7473 => 0.7916, std.dev.: 0.0123) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.82% (0.8321 => 0.8805, std.dev.: 0.0168) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.41% (0.2180 => 0.2298, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.41% (0.1905 => 0.2008, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.00% (0.2240 => 0.2352, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.98% (1.1606 => 1.2184, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.87% (0.2998 => 0.3144, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.71% (0.2378 => 0.2490, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.61% (0.2519 => 0.2635, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: 4.35% (1.4269 => 1.4889, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.19% (0.8148 => 0.8489, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.11% (0.5961 => 0.6206, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.10% (0.3003 => 0.3126, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 4.04% (1.2222 => 1.2716, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.98% (0.3295 => 0.3426, std.dev.: 0.0047) MultiSource/Applications/sgefa/sgefa: 3.70% (0.2999 => 0.3110, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.53% (0.4783 => 0.4952, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.49% (0.4127 => 0.4271, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.45% (0.8805 => 0.9109, std.dev.: 0.0081) MultiSource/Applications/treecc/treecc: 3.24% (1.9948 => 2.0595, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.22% (0.8048 => 0.8307, std.dev.: 0.0038) MultiSource/Applications/lua/lua: 3.13% (3.8189 => 3.9386, std.dev.: 0.0305) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.99% (0.8716 => 0.8977, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.80% (0.3717 => 0.3821, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.70% (1.1170 => 1.1472, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.68% (0.8331 => 0.8554, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.66% (0.8007 => 0.8220, std.dev.: 0.0055) MultiSource/Applications/SIBsim4/SIBsim4: 2.62% (1.2568 => 1.2897, std.dev.: 0.0098) MultiSource/Applications/ClamAV/clamscan: 2.62% (14.7684 => 15.1549, std.dev.: 0.0924) MultiSource/Benchmarks/MallocBench/gs/gs: 2.56% (4.1305 => 4.2361, std.dev.: 0.0346) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.50% (0.8697 => 0.8914, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.40% (0.8927 => 0.9141, std.dev.: 0.0053) MultiSource/Applications/siod/siod: 2.38% (2.2184 => 2.2713, std.dev.: 0.0174) MultiSource/Benchmarks/nbench/nbench: 2.38% (1.1271 => 1.1539, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.36% (0.8050 => 0.8240, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.33% (0.4559 => 0.4665, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.32% (0.8518 => 0.8716, std.dev.: 0.0071) MultiSource/Applications/minisat/minisat: 2.30% (0.6834 => 0.6991, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.22% (0.8457 => 0.8645, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.21% (0.8611 => 0.8801, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.17% (0.8261 => 0.8440, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.16% (0.9069 => 0.9265, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.14% (4.4880 => 4.5842, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.11% (0.7966 => 0.8134, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.10% (0.8204 => 0.8376, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.09% (0.8359 => 0.8534, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.07% (4.5702 => 4.6646, std.dev.: 0.0362) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.04% (0.8177 => 0.8344, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.00% (0.9056 => 0.9237, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.99% (0.8597 => 0.8768, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.95% (0.8656 => 0.8825, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.91% (0.8885 => 0.9055, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 1.91% (0.9810 => 0.9997, std.dev.: 0.0067) MultiSource/Benchmarks/Bullet/bullet: 1.90% (31.8598 => 32.4657, std.dev.: 0.1559) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.90% (0.9688 => 0.9872, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.80% (0.7932 => 0.8075, std.dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 1.75% (15.3280 => 15.5965, std.dev.: 0.0972) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.75% (0.8340 => 0.8486, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.55% (2.1401 => 2.1733, std.dev.: 0.0125) MultiSource/Benchmarks/PAQ8p/paq8p: 1.42% (2.3764 => 2.4101, std.dev.: 0.0096) MultiSource/Benchmarks/mafft/pairlocalalign: 1.40% (8.6247 => 8.7455, std.dev.: 0.0242) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.35% (0.8316 => 0.8428, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 84.42% (0.0199 => 0.0367, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/pi: 57.02% (1.5795 => 2.4802, std.dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.88% (0.7597 => 0.8955, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.21% (2.9753 => 3.4576, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.57% (2.7995 => 3.2073, std.dev.: 0.0754) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.82% (5.0261 => 5.6202, std.dev.: 0.0129) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.81% (1.1857 => 1.2783, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/queens: 7.53% (1.7056 => 1.8341, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.86% (4.7794 => 5.1075, std.dev.: 0.0136) MultiSource/Applications/SIBsim4/SIBsim4: 6.50% (3.1873 => 3.3944, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.98% (4.5327 => 4.8037, std.dev.: 0.0978) SingleSource/Benchmarks/Misc/richards_benchmark: 5.55% (1.3037 => 1.3760, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.72% (3.3761 => 3.5354, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.47% (4.9453 => 5.1663, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.14% (4.9469 => 5.1516, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.13% (6.2275 => 6.4849, std.dev.: 0.0293) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.98% (0.2887 => 0.3002, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 3.97% (14.0064 => 14.5621, std.dev.: 0.0346) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.68% (0.3587 => 0.3719, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.95% (11.5690 => 11.9100, std.dev.: 0.0430) MultiSource/Applications/siod/siod: 2.82% (3.6643 => 3.7678, std.dev.: 0.0255) MultiSource/Applications/lambda-0_1_3/lambda: 2.74% (7.4933 => 7.6983, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.66% (8.2783 => 8.4984, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.40% (4.8660 => 4.9827, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout/lists: 2.35% (7.3375 => 7.5097, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: 1.49% (1.2061 => 1.2241, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.30% (3.5679 => 3.6142, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.29% (2.4647 => 2.4966, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/neural/neural: 1.28% (1.0841 => 1.0980, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.25% (1.1365 => 1.1507, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.14% (1.5941 => 1.6123, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/ReedSolomon: 1.11% (8.5322 => 8.6269, std.dev.: 0.0155) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.95% (5.4641 => 4.3192, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.13% (7.2130 => 6.2662, std.dev.: 0.3518) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.86% (1.0512 => 0.9370, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: -10.84% (1.1216 => 1.0000, std.dev.: 0.0080) MultiSource/Benchmarks/mafft/pairlocalalign: -8.47% (63.1822 => 57.8295, std.dev.: 0.1421) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -7.03% (4.7482 => 4.4143, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.12% (0.3269 => 0.3069, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.89% (5.4972 => 5.1733, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.85% (3.7148 => 3.4974, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.11% (5.1557 => 4.8925, std.dev.: 0.0108) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.63% (2.8773 => 2.7442, std.dev.: 0.0280) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.41% (3.9188 => 3.7458, std.dev.: 0.0267) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.33% (4.7449 => 4.5395, std.dev.: 0.0287) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.14% (2.4490 => 2.3475, std.dev.: 0.0337) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.68% (6.0224 => 5.8006, std.dev.: 0.0497) MultiSource/Benchmarks/Prolangs-C++/life/life: -3.26% (2.6356 => 2.5497, std.dev.: 0.0175) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.05% (28.5821 => 27.7098, std.dev.: 0.0145) MultiSource/Applications/aha/aha: -2.82% (3.3398 => 3.2456, std.dev.: 0.0181) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.77% (0.5807 => 0.5646, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -2.35% (3.4237 => 3.3433, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.03% (11.5316 => 11.2971, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.57% (2.3487 => 2.3119, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.42% (3.2169 => 3.1713, std.dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.49% (16.4461 => 16.6906, std.dev.: 0.1328) MultiSource/Applications/obsequi/Obsequi: 2.74% (1.0262 => 1.0543, std.dev.: 0.0233) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6825.49% (0.3123 => 21.6283, std.dev.: 0.3391) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.72% (0.2463 => 0.3663, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/bigfib: 0.38% (0.6010 => 0.6033, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.32% (0.3266 => 0.3309, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/strcat: 2.64% (0.1969 => 0.2021, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 20.33% (0.0123 => 0.0148, std.dev.: 0.0048) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 4.72% (0.0254 => 0.0266, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 10.00% (0.0180 => 0.0198, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.88% (0.1438 => 0.1465, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.34% (1.1329 => 1.1481, std.dev.: 0.0131) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.14% (0.1462 => 0.1464, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.72% (0.4164 => 0.4194, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.85% (0.1369 => 0.1408, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.16% (0.0641 => 0.0640, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 16.92% (0.0195 => 0.0228, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.81% (0.0578 => 0.0600, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.86% (1.1437 => 1.2107, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1600.00% (0.0001 => 0.0017, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 35.71% (0.0014 => 0.0019, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.47% (0.0627 => 0.0599, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.56% (0.0180 => 0.0179, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.33% (0.8017 => 0.7830, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 83.87% (0.0062 => 0.0114, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 4.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 10 10:59:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 10 Nov 2012 12:59:48 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121110185948.7F95C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5746?compare_to=5744&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5746, Order: 167676, Start Time: 2012-11-10 17:35:30, End Time: 2012-11-10 19:00:01 To: 5744, Order: 167675, Start Time: 2012-11-10 15:47:58, End Time: 2012-11-10 17:12:35 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (179 on baseline) Unchanged Tests: 1042 (859 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.64% (2.0478 => 2.1018, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: 2.34% (7.4937 => 7.6689, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout-C++/hash2: 2.11% (3.1932 => 3.2606, std.dev.: 0.0118) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.08% (0.1431 => 0.1301, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -7.55% (2.4924 => 2.3043, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.38% (0.3821 => 0.3539, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -6.91% (0.3357 => 0.3125, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.87% (0.9542 => 0.8886, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.87% (0.3142 => 0.2926, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.84% (0.2428 => 0.2262, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.67% (0.3658 => 0.3414, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.66% (3.5339 => 3.2985, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.64% (22.4056 => 20.9184, std.dev.: 0.0084) MultiSource/Applications/JM/lencod/lencod: -6.53% (16.1920 => 15.1349, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.52% (1.0544 => 0.9857, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: -6.51% (7.0961 => 6.6344, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: -6.46% (4.3330 => 4.0531, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: -6.45% (9.2283 => 8.6334, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.43% (0.6484 => 0.6067, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.41% (0.9852 => 0.9220, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.41% (0.1716 => 0.1606, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -6.39% (0.2160 => 0.2022, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: -6.34% (1.2515 => 1.1721, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.30% (1.3722 => 1.2857, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.29% (0.1796 => 0.1683, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -6.25% (0.9179 => 0.8605, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -6.23% (0.2985 => 0.2799, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -6.23% (0.1879 => 0.1762, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -6.21% (0.2659 => 0.2494, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.18% (1.6364 => 1.5352, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.17% (1.4642 => 1.3738, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.17% (1.2784 => 1.1995, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.12% (0.6293 => 0.5908, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -6.10% (1.1450 => 1.0752, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -6.08% (2.4021 => 2.2560, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.07% (0.6736 => 0.6327, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.07% (4.8161 => 4.5239, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.07% (1.2300 => 1.1554, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.06% (0.7919 => 0.7439, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.04% (0.2548 => 0.2394, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.03% (4.8802 => 4.5857, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.01% (4.0323 => 3.7899, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: -6.00% (1.1530 => 1.0838, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.99% (5.4682 => 5.1406, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.99% (4.5069 => 4.2371, std.dev.: 0.0014) MultiSource/Applications/lua/lua: -5.97% (4.0594 => 3.8169, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.96% (14.2083 => 13.3610, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: -5.96% (0.1761 => 0.1656, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.93% (0.8521 => 0.8016, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.92% (6.7716 => 6.3704, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.89% (0.3483 => 0.3278, std.dev.: 0.0056) MultiSource/Benchmarks/sim/sim: -5.87% (0.3406 => 0.3206, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.86% (0.2695 => 0.2537, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: -5.85% (0.7447 => 0.7011, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: -5.85% (1.3864 => 1.3053, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.85% (0.3831 => 0.3607, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -5.84% (15.5079 => 14.6017, std.dev.: 0.0077) MultiSource/Applications/sqlite3/sqlite3: -5.84% (17.1032 => 16.1044, std.dev.: 0.0088) SingleSource/UnitTests/ObjC/trivial-interface: -5.82% (0.3812 => 0.3590, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: -5.81% (0.3581 => 0.3373, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.81% (0.3891 => 0.3665, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.78% (0.7198 => 0.6782, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: -5.78% (0.4033 => 0.3800, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.75% (0.5857 => 0.5520, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -5.75% (0.3880 => 0.3657, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-3: -5.74% (0.3848 => 0.3627, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.73% (0.5999 => 0.5655, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: -5.72% (0.3896 => 0.3673, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.72% (0.4176 => 0.3937, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -5.71% (0.4515 => 0.4257, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.69% (0.3884 => 0.3663, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.68% (0.4916 => 0.4637, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.67% (0.7021 => 0.6623, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.66% (0.2278 => 0.2149, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.62% (0.5849 => 0.5520, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -5.62% (0.4199 => 0.3963, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.61% (0.4151 => 0.3918, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.60% (1.6474 => 1.5552, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.58% (0.5805 => 0.5481, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -5.57% (1.3148 => 1.2415, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.57% (0.4813 => 0.4545, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.56% (0.7339 => 0.6931, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.55% (0.5329 => 0.5033, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.55% (0.6681 => 0.6310, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.55% (0.6667 => 0.6297, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.54% (0.5591 => 0.5281, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -5.54% (18.2933 => 17.2791, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.54% (0.6446 => 0.6089, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.54% (0.4083 => 0.3857, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -5.51% (0.4861 => 0.4593, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.51% (8.0126 => 7.5709, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.51% (0.6660 => 0.6293, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -5.51% (3.5154 => 3.3217, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.50% (0.5581 => 0.5274, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.50% (0.5859 => 0.5537, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.49% (0.5478 => 0.5177, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.47% (0.6230 => 0.5889, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.47% (2.1713 => 2.0525, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/parameter-passing: -5.47% (0.4280 => 0.4046, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.46% (0.6260 => 0.5918, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.44% (0.2999 => 0.2836, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: -5.43% (0.2871 => 0.2715, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.42% (0.9557 => 0.9039, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.41% (2.2587 => 2.1364, std.dev.: 0.0023) MultiSource/Applications/treecc/treecc: -5.41% (2.1401 => 2.0243, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.41% (0.6395 => 0.6049, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.41% (0.7524 => 0.7117, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.41% (0.6304 => 0.5963, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.40% (0.5925 => 0.5605, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.39% (0.3837 => 0.3630, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: -5.39% (0.4524 => 0.4280, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.39% (0.6676 => 0.6316, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.38% (0.5802 => 0.5490, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.38% (0.2939 => 0.2781, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.37% (0.2385 => 0.2257, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.36% (0.3057 => 0.2893, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.36% (0.5705 => 0.5399, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -5.35% (0.3026 => 0.2864, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.35% (0.2933 => 0.2776, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.35% (0.5941 => 0.5623, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.35% (0.6189 => 0.5858, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.34% (1.2221 => 1.1568, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.34% (0.2903 => 0.2748, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -5.32% (0.6750 => 0.6391, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.32% (0.2106 => 0.1994, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -5.32% (15.2527 => 14.4417, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.32% (0.6395 => 0.6055, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.32% (0.5456 => 0.5166, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/matrix: -5.31% (0.3255 => 0.3082, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.31% (0.6440 => 0.6098, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: -5.31% (0.3446 => 0.3263, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.31% (0.2355 => 0.2230, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.30% (0.5863 => 0.5552, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -5.30% (0.7982 => 0.7559, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.30% (0.3491 => 0.3306, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.30% (0.5569 => 0.5274, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.29% (0.6297 => 0.5964, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.29% (0.6033 => 0.5714, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.28% (1.2210 => 1.1565, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -5.27% (0.3394 => 0.3215, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.27% (0.5575 => 0.5281, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -5.27% (0.4248 => 0.4024, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: -5.27% (0.2849 => 0.2699, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.26% (0.5168 => 0.4896, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/objinst: -5.26% (0.3194 => 0.3026, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.26% (0.3025 => 0.2866, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -5.25% (0.2989 => 0.2832, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -5.25% (0.3867 => 0.3664, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -5.25% (0.3621 => 0.3431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.22% (0.5570 => 0.5279, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.22% (0.4427 => 0.4196, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.21% (0.6194 => 0.5871, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -5.21% (0.3205 => 0.3038, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.21% (0.3016 => 0.2859, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -5.20% (0.3481 => 0.3300, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -5.20% (0.3271 => 0.3101, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -5.18% (34.0927 => 32.3262, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.17% (0.5567 => 0.5279, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.13% (0.5688 => 0.5396, std.dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.12% (0.3319 => 0.3149, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: -5.12% (0.8418 => 0.7987, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.09% (0.3849 => 0.3653, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -5.07% (0.3788 => 0.3596, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.07% (0.4321 => 0.4102, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: -5.07% (0.3059 => 0.2904, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.98% (0.3252 => 0.3090, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.73% (5.0226 => 4.7849, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.57% (0.3323 => 0.3171, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.54% (0.9077 => 0.8665, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: -4.23% (1.5610 => 1.4950, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: -3.90% (0.7779 => 0.7476, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -3.45% (0.6441 => 0.6219, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.42% (0.6347 => 0.6130, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.96% (20.7746 => 20.1598, std.dev.: 0.0301) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7549, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1732, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.95% (1.7753 => 1.7052, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.57% (2.2633 => 2.1826, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4728, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0001) Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 10 11:28:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 10 Nov 2012 13:28:38 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121110192838.212FD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5747?compare_to=5742&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5747, Order: 167675, Start Time: 2012-11-10 16:12:59, End Time: 2012-11-10 19:28:51 To: 5742, Order: 167674, Start Time: 2012-11-10 10:51:43, End Time: 2012-11-10 14:08:55 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (177 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1042 (714 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 44.16% (0.0625 => 0.0901, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.52% (0.1063 => 0.1430, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.09% (0.4253 => 0.5405, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.76% (0.1106 => 0.1402, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.64% (0.2969 => 0.3760, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 26.07% (1.5932 => 2.0086, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 25.66% (0.0452 => 0.0568, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.49% (0.0714 => 0.0896, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.47% (0.4139 => 0.5193, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.21% (0.4994 => 0.6253, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.98% (0.5900 => 0.7374, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.21% (0.0475 => 0.0590, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.95% (0.0547 => 0.0678, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.92% (0.5000 => 0.6196, std.dev.: 0.0031) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.46% (0.0584 => 0.0721, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.21% (0.1620 => 0.1996, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.04% (0.1107 => 0.1362, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.02% (0.1021 => 0.1256, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 22.87% (0.0599 => 0.0736, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 22.36% (0.0948 => 0.1160, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.30% (0.0897 => 0.1097, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.80% (0.0633 => 0.0771, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.58% (0.0584 => 0.0710, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.50% (0.0642 => 0.0780, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.49% (0.1103 => 0.1340, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.44% (0.0541 => 0.0657, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 21.07% (0.0821 => 0.0994, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.04% (0.1003 => 0.1214, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.01% (0.0495 => 0.0599, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 20.94% (0.1619 => 0.1958, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.92% (0.0822 => 0.0994, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.79% (0.1549 => 0.1871, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.65% (0.3903 => 0.4709, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.64% (0.1604 => 0.1935, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 20.53% (0.0604 => 0.0728, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 19.96% (0.0947 => 0.1136, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 19.77% (0.5826 => 0.6978, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.63% (0.1462 => 0.1749, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 19.63% (0.5889 => 0.7045, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 19.55% (0.0808 => 0.0966, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.33% (0.3890 => 0.4642, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.31% (0.2014 => 0.2403, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 19.29% (0.4029 => 0.4806, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.23% (0.2736 => 0.3262, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 19.21% (0.1218 => 0.1452, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.08% (1.3152 => 1.5662, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/mst/mst: 18.77% (0.0698 => 0.0829, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.53% (0.0572 => 0.0678, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.47% (0.1088 => 0.1289, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 18.47% (0.1505 => 0.1783, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.35% (0.2866 => 0.3392, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 18.24% (0.0581 => 0.0687, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 18.22% (0.9697 => 1.1464, std.dev.: 0.0022) MultiSource/Applications/Burg/burg: 18.10% (0.5546 => 0.6550, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.03% (0.4658 => 0.5498, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.02% (0.2875 => 0.3393, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.01% (0.2738 => 0.3231, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.98% (0.0573 => 0.0676, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.96% (3.5627 => 4.2026, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.95% (0.5026 => 0.5928, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.89% (0.1968 => 0.2320, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 17.73% (1.0781 => 1.2693, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 17.70% (0.0582 => 0.0685, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 17.67% (1.8794 => 2.2115, std.dev.: 0.0102) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.64% (1.6211 => 1.9071, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 17.58% (0.7171 => 0.8432, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.52% (0.0605 => 0.0711, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 17.38% (0.2750 => 0.3228, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.36% (0.3271 => 0.3839, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.34% (0.4361 => 0.5117, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.33% (0.1160 => 0.1361, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 17.32% (0.2714 => 0.3184, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 17.28% (0.2725 => 0.3196, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 17.24% (0.1421 => 0.1666, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 17.21% (0.1284 => 0.1505, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 17.16% (0.2780 => 0.3257, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.08% (0.2729 => 0.3195, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 17.04% (0.3004 => 0.3516, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.04% (2.7292 => 3.1943, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.00% (0.3930 => 0.4598, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.98% (0.2792 => 0.3266, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 16.91% (0.2803 => 0.3277, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 16.90% (0.2811 => 0.3286, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/objinst: 16.90% (0.2823 => 0.3300, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.87% (0.2911 => 0.3402, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/methcall: 16.85% (0.2813 => 0.3287, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.78% (0.3195 => 0.3731, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 16.76% (0.3096 => 0.3615, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 16.73% (0.9909 => 1.1567, std.dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 16.72% (4.2109 => 4.9151, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.71% (2.0673 => 2.4128, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.55% (4.4195 => 5.1508, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary3: 16.35% (0.3267 => 0.3801, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.24% (0.3362 => 0.3908, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.24% (0.1090 => 0.1267, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: 16.18% (0.3258 => 0.3785, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.11% (0.3060 => 0.3553, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.04% (1.9694 => 2.2852, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.97% (0.3488 => 0.4045, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 15.92% (0.3317 => 0.3845, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.88% (0.3124 => 0.3620, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.86% (1.9966 => 2.3132, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/moments: 15.80% (0.3678 => 0.4259, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 15.72% (23.5202 => 27.2179, std.dev.: 0.0237) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.66% (0.3845 => 0.4447, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 15.39% (0.2566 => 0.2961, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 15.35% (0.3348 => 0.3862, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 15.35% (0.3726 => 0.4298, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 15.34% (0.4146 => 0.4782, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 15.33% (0.3477 => 0.4010, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 15.33% (0.2075 => 0.2393, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 15.27% (0.3465 => 0.3994, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.27% (0.3282 => 0.3783, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 15.25% (0.3496 => 0.4029, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 15.19% (0.3442 => 0.3965, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 15.18% (0.3446 => 0.3969, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 15.11% (0.3469 => 0.3993, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 15.09% (0.3460 => 0.3982, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 15.07% (1.4269 => 1.6420, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.92% (0.3625 => 0.4166, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 14.84% (0.4251 => 0.4882, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 14.80% (0.3643 => 0.4182, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 14.79% (0.3650 => 0.4190, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.74% (0.3690 => 0.4234, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.69% (0.3981 => 0.4566, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 14.69% (0.7875 => 0.9032, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 14.66% (0.3724 => 0.4270, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 14.51% (2.1013 => 2.4063, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 14.42% (2.1653 => 2.4775, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 14.31% (0.2691 => 0.3076, std.dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 14.20% (4.6177 => 5.2733, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 14.12% (0.0758 => 0.0865, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 14.03% (0.5012 => 0.5715, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.96% (0.1383 => 0.1576, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.19% (0.2040 => 0.2309, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 12.75% (5.5417 => 6.2480, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.70% (0.6435 => 0.7252, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.06% (0.1028 => 0.1152, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 11.94% (0.6634 => 0.7426, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 11.92% (0.3498 => 0.3915, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.85% (0.2068 => 0.2313, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.80% (0.2737 => 0.3060, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 11.55% (0.4847 => 0.5407, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.25% (0.3084 => 0.3431, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.88% (0.3336 => 0.3699, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 10.54% (0.2391 => 0.2643, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 10.53% (2.0346 => 2.2489, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.51% (0.2103 => 0.2324, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.39% (4.6926 => 5.1333, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.35% (0.5361 => 0.5862, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.21% (11.6398 => 12.7121, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.81% (0.5584 => 0.6076, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.75% (0.7426 => 0.8076, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 7.64% (11.9555 => 12.8693, std.dev.: 0.0132) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.78% (0.3792 => 0.4011, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 10.03% (0.2802 => 0.3083, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6112, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.01% (0.3693 => 0.3915, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-2: 5.14% (1.8057 => 1.8986, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6702, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1675, std.dev.: 0.0060) SingleSource/Benchmarks/Dhrystone/dry: 4.11% (14.0481 => 14.6252, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1950, std.dev.: 0.0056) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2238, std.dev.: 0.0026) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3038, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2879, std.dev.: 0.0057) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5129, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5820, std.dev.: 0.0110) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5646, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/ary2: -10.41% (0.2402 => 0.2152, std.dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9760, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8054, std.dev.: 0.0129) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.56% (11.2080 => 10.8087, std.dev.: 0.0017) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.96% (0.6293 => 0.6107, std.dev.: 0.0053) SingleSource/Benchmarks/Dhrystone/fldry: -2.77% (17.2379 => 16.7597, std.dev.: 0.0480) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8694, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5753, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4952, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (105.3826 => 104.1881, std.dev.: 0.0635) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0437, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 10 12:34:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 10 Nov 2012 14:34:05 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121110203405.E0B142A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5748?compare_to=5745&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5748, Order: 167678, Start Time: 2012-11-10 19:08:57, End Time: 2012-11-10 20:34:20 To: 5745, Order: 167676, Start Time: 2012-11-10 17:26:01, End Time: 2012-11-10 18:52:02 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 4 (98 on baseline) Performance Improvements: 5 (24 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 982 (852 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.17% (1.3784 => 1.4496, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.49% (0.3294 => 0.3442, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.96% (6.8966 => 7.1698, std.dev.: 0.0809) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.05% (1.5781 => 1.5946, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.52% (0.8307 => 0.8181, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.39% (0.9109 => 0.8982, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -6.19% (2.4287 => 2.2783, std.dev.: 0.0556) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.48% (0.2664 => 0.2518, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.41% (41.5322 => 40.9453, std.dev.: 0.2041) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.23% (16.6906 => 16.7295, std.dev.: 0.1307) MultiSource/Applications/obsequi/Obsequi: 0.83% (1.0543 => 1.0631, std.dev.: 0.0128) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.24% (21.6283 => 21.6809, std.dev.: 0.2366) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.41% (0.3663 => 0.3648, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/bigfib: 0.31% (0.6033 => 0.6052, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.76% (0.3309 => 0.3334, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 0.30% (0.2021 => 0.2027, std.dev.: 0.0086) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.70% (0.0148 => 0.0144, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.29% (0.0426 => 0.0412, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 7.14% (0.0266 => 0.0285, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0313 => 0.0313, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -12.09% (0.0422 => 0.0371, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/casts: -33.00% (0.0203 => 0.0136, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/test1: -14.14% (0.0198 => 0.0170, std.dev.: 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.75% (0.1465 => 0.1454, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 2.50% (1.1481 => 1.1768, std.dev.: 0.0437) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.64% (0.1464 => 0.1396, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.41% (0.4194 => 0.4135, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.98% (0.1408 => 0.1450, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.63% (0.0640 => 0.0572, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.72% (0.0228 => 0.0199, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.67% (0.0600 => 0.0604, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.60% (1.2107 => 1.1913, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -29.41% (0.0017 => 0.0012, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -94.74% (0.0019 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.68% (0.0599 => 0.0565, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 27.37% (0.0179 => 0.0228, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.70% (0.7830 => 0.7775, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -28.07% (0.0114 => 0.0082, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2297.27% (0.6332 => 15.1795, std.dev.: 0.1499) MultiSource/Benchmarks/McCat/08-main/main: 50.52% (0.1831 => 0.2756, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.15% (0.1559 => 0.1432, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1499.01% (0.3344 => 5.3471, std.dev.: 0.0432) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.59% (0.2364 => 0.3229, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: 3.03% (0.0429 => 0.0442, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.25% (0.0224 => 0.0238, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -30.87% (0.0230 => 0.0159, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4279, std.dev.: 0.0221) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0695, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4859, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3443, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1266, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4073, std.dev.: 0.0011) SingleSource/Regression/C/uint64_to_float: -24.11% (2.1832 => 1.6568, std.dev.: 0.0022) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.90% (0.0810 => 0.0955, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.29% (0.0830 => 0.0932, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.22% (0.2180 => 0.2381, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.10% (0.7473 => 0.7854, std.dev.: 0.0116) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.82% (0.2240 => 0.2348, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.74% (0.8148 => 0.8534, std.dev.: 0.0146) MultiSource/Applications/spiff/spiff: 4.48% (0.7950 => 0.8306, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.29% (0.2519 => 0.2627, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.74% (1.1606 => 1.2040, std.dev.: 0.0099) MultiSource/Applications/Burg/burg: 3.67% (1.2222 => 1.2671, std.dev.: 0.0060) MultiSource/Applications/hbd/hbd: 3.65% (1.4269 => 1.4790, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.37% (1.4479 => 1.4967, std.dev.: 0.0076) SingleSource/UnitTests/Vector/constpool: 3.23% (8.4179 => 8.6898, std.dev.: 0.0715) MultiSource/Applications/lua/lua: 3.08% (3.8189 => 3.9366, std.dev.: 0.0162) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.72% (1.1170 => 1.1474, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 2.70% (14.2605 => 14.6449, std.dev.: 0.0943) MultiSource/Applications/d/make_dparser: 2.57% (3.2366 => 3.3197, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.54% (0.8069 => 0.8274, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.52% (0.8317 => 0.8527, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.52% (0.4559 => 0.4674, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.44% (0.8697 => 0.8909, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.42% (0.5817 => 0.5958, std.dev.: 0.0046) MultiSource/Applications/ClamAV/clamscan: 2.39% (14.7684 => 15.1207, std.dev.: 0.0710) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.30% (0.8611 => 0.8809, std.dev.: 0.0062) MultiSource/Applications/siod/siod: 2.28% (2.2184 => 2.2689, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 2.25% (0.6834 => 0.6988, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.23% (0.8457 => 0.8646, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.23% (1.6386 => 1.6752, std.dev.: 0.0102) MultiSource/Applications/JM/ldecod/ldecod: 2.23% (6.7320 => 6.8818, std.dev.: 0.0240) MultiSource/Benchmarks/Prolangs-C/football/football: 2.20% (0.8768 => 0.8961, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.09% (0.8086 => 0.8255, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.09% (0.8855 => 0.9040, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.09% (1.3279 => 1.3556, std.dev.: 0.0087) MultiSource/Applications/hexxagon/hexxagon: 2.05% (0.9810 => 1.0011, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.03% (0.8716 => 0.8893, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.02% (0.8927 => 0.9107, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.01% (0.8805 => 0.8982, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.00% (0.8007 => 0.8167, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.98% (0.9074 => 0.9254, std.dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: 1.96% (31.8598 => 32.4838, std.dev.: 0.1817) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.93% (0.9688 => 0.9875, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.90% (4.4880 => 4.5734, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.90% (0.8420 => 0.8580, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.89% (0.9069 => 0.9240, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.88% (0.8331 => 0.8488, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.87% (0.7932 => 0.8080, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.86% (2.1401 => 2.1800, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.85% (0.8359 => 0.8514, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.76% (1.2423 => 1.2642, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.76% (0.8518 => 0.8668, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.76% (0.7966 => 0.8106, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.75% (0.9039 => 0.9197, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.73% (0.8597 => 0.8746, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 1.72% (15.3280 => 15.5920, std.dev.: 0.0546) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.67% (0.8286 => 0.8424, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.65% (0.8048 => 0.8181, std.dev.: 0.0048) MultiSource/Applications/oggenc/oggenc: 1.56% (4.9628 => 5.0404, std.dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.53% (0.6586 => 0.6687, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.52% (0.8338 => 0.8465, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.51% (1.5315 => 1.5547, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.46% (0.8316 => 0.8437, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.40% (0.8261 => 0.8377, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.12% (1.0945 => 1.1068, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.02% (3.1832 => 3.2156, std.dev.: 0.0101) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 93.47% (0.0199 => 0.0385, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/pi: 56.94% (1.5795 => 2.4788, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.23% (2.9753 => 3.4582, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.11% (0.7597 => 0.8821, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.67% (2.7995 => 3.2102, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.43% (6.3772 => 7.1698, std.dev.: 0.0809) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.52% (5.0261 => 5.6052, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.04% (0.3186 => 0.3442, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.93% (1.1857 => 1.2797, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 7.33% (1.7056 => 1.8306, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.69% (4.7794 => 5.0993, std.dev.: 0.0044) MultiSource/Applications/SIBsim4/SIBsim4: 6.27% (3.1873 => 3.3872, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/richards_benchmark: 6.10% (1.3037 => 1.3832, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.95% (4.9686 => 5.2640, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.81% (4.5327 => 4.7960, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.68% (3.3761 => 3.5342, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.65% (6.2275 => 6.5171, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.47% (4.9453 => 5.1664, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.42% (1.3882 => 1.4496, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.02% (4.9469 => 5.1459, std.dev.: 0.0154) MultiSource/Applications/hexxagon/hexxagon: 3.95% (14.0064 => 14.5590, std.dev.: 0.0255) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.18% (0.3587 => 0.3701, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 2.72% (7.4933 => 7.6974, std.dev.: 0.0063) MultiSource/Applications/siod/siod: 2.58% (3.6643 => 3.7590, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.55% (4.8660 => 4.9901, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.41% (4.8362 => 4.9529, std.dev.: 0.0103) SingleSource/Benchmarks/Dhrystone/dry: 2.30% (0.5081 => 0.5198, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: 2.29% (7.3375 => 7.5052, std.dev.: 0.0221) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.27% (8.2783 => 8.4663, std.dev.: 0.0193) MultiSource/Benchmarks/Olden/power/power: 1.46% (1.2061 => 1.2237, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.33% (2.4647 => 2.4975, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/ReedSolomon: 1.30% (8.5322 => 8.6430, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: 1.26% (1.0841 => 1.0978, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.15% (3.5679 => 3.6091, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.03% (5.4641 => 4.3152, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.50% (7.2130 => 6.1671, std.dev.: 0.1307) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.31% (1.0512 => 0.9323, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: -11.14% (1.1216 => 0.9966, std.dev.: 0.0088) MultiSource/Benchmarks/mafft/pairlocalalign: -8.54% (63.1822 => 57.7875, std.dev.: 0.1294) SingleSource/Benchmarks/Shootout/heapsort: -8.49% (3.2926 => 3.0130, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.34% (0.3269 => 0.3029, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.86% (4.7482 => 4.4227, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/recursive: -6.08% (2.4490 => 2.3002, std.dev.: 0.0489) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.94% (3.7148 => 3.4940, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.92% (5.4972 => 5.1719, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.06% (5.1557 => 4.8947, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.33% (4.7449 => 4.5395, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.80% (6.0224 => 5.7935, std.dev.: 0.0153) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (28.5821 => 27.6880, std.dev.: 0.0434) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.00% (0.5807 => 0.5633, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.57% (1.2822 => 1.2492, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.55% (2.6356 => 2.5685, std.dev.: 0.0020) MultiSource/Applications/aha/aha: -2.50% (3.3398 => 3.2563, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/hash2: -2.37% (3.4237 => 3.3425, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.31% (9.9065 => 9.6776, std.dev.: 0.0759) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.05% (11.5316 => 11.2956, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/mason/mason: -1.92% (0.5415 => 0.5311, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.68% (4.9994 => 4.9152, std.dev.: 0.0045) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.72% (16.4461 => 16.7295, std.dev.: 0.1307) MultiSource/Applications/obsequi/Obsequi: 3.60% (1.0262 => 1.0631, std.dev.: 0.0128) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6842.33% (0.3123 => 21.6809, std.dev.: 0.2366) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.11% (0.2463 => 0.3648, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/bigfib: 0.70% (0.6010 => 0.6052, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.08% (0.3266 => 0.3334, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 2.95% (0.1969 => 0.2027, std.dev.: 0.0086) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 17.07% (0.0123 => 0.0144, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.98% (0.0408 => 0.0412, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 12.20% (0.0254 => 0.0285, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.39% (0.0384 => 0.0371, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/casts: -28.42% (0.0190 => 0.0136, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/test1: -5.56% (0.0180 => 0.0170, std.dev.: 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.11% (0.1438 => 0.1454, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 3.88% (1.1329 => 1.1768, std.dev.: 0.0437) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.51% (0.1462 => 0.1396, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.70% (0.4164 => 0.4135, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.92% (0.1369 => 0.1450, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.76% (0.0641 => 0.0572, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.05% (0.0195 => 0.0199, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.50% (0.0578 => 0.0604, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.16% (1.1437 => 1.1913, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1100.00% (0.0001 => 0.0012, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.89% (0.0627 => 0.0565, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.67% (0.0180 => 0.0228, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.02% (0.8017 => 0.7775, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 32.26% (0.0062 => 0.0082, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 10 12:47:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 10 Nov 2012 14:47:32 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121110204732.EE9442A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5749?compare_to=5746&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5749, Order: 167678, Start Time: 2012-11-10 19:23:01, End Time: 2012-11-10 20:47:46 To: 5746, Order: 167676, Start Time: 2012-11-10 17:35:30, End Time: 2012-11-10 19:00:01 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (182 on baseline) Unchanged Tests: 1041 (855 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.56% (78.0757 => 81.6361, std.dev.: 0.1466) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.96% (2.0478 => 2.1084, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.4937 => 7.6744, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.41% (79.7170 => 81.6361, std.dev.: 0.1466) SingleSource/Benchmarks/Shootout-C++/hash2: 2.21% (3.1932 => 3.2637, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.08% (0.1431 => 0.1301, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.09% (0.3821 => 0.3512, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -7.55% (2.4924 => 2.3043, std.dev.: 0.0069) MultiSource/Applications/sgefa/sgefa: -6.91% (0.3357 => 0.3125, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.91% (0.9542 => 0.8883, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.87% (0.3142 => 0.2926, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.80% (0.2428 => 0.2263, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.64% (0.3658 => 0.3415, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.59% (3.5339 => 3.3010, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: -6.57% (16.1920 => 15.1276, std.dev.: 0.0125) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.55% (22.4056 => 20.9382, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.54% (0.6484 => 0.6060, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: -6.52% (7.0961 => 6.6333, std.dev.: 0.0080) MultiSource/Benchmarks/mafft/pairlocalalign: -6.49% (9.2283 => 8.6294, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.43% (1.0544 => 0.9866, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.40% (0.9852 => 0.9221, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -6.38% (1.2515 => 1.1716, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -6.34% (0.2160 => 0.2023, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: -6.33% (0.9179 => 0.8598, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.29% (1.3722 => 1.2859, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.24% (0.1716 => 0.1609, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -6.23% (4.3330 => 4.0631, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.22% (4.0323 => 3.7813, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.19% (1.4642 => 1.3736, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.19% (0.7919 => 0.7429, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.18% (0.1796 => 0.1685, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.17% (1.2300 => 1.1541, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.17% (1.6364 => 1.5355, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -6.16% (0.2985 => 0.2801, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.13% (1.2784 => 1.2000, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.12% (0.6293 => 0.5908, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -6.10% (1.1450 => 1.0752, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -6.09% (1.1530 => 1.0828, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.07% (4.8161 => 4.5236, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.07% (4.5069 => 4.2334, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.03% (0.2355 => 0.2213, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: -6.02% (0.2659 => 0.2499, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.01% (4.8802 => 4.5871, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.97% (5.4682 => 5.1416, std.dev.: 0.0148) SingleSource/Benchmarks/McGill/chomp: -5.96% (0.1761 => 0.1656) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.95% (6.7716 => 6.3687, std.dev.: 0.0037) MultiSource/Applications/siod/siod: -5.94% (2.4021 => 2.2593, std.dev.: 0.0025) MultiSource/Applications/lua/lua: -5.92% (4.0594 => 3.8190, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.89% (0.6736 => 0.6339, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: -5.88% (15.5079 => 14.5961, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.87% (14.2083 => 13.3742, std.dev.: 0.0142) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.86% (0.2695 => 0.2537, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.86% (0.3483 => 0.3279, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -5.85% (0.3812 => 0.3589, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -5.83% (0.7447 => 0.7013, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.82% (0.7198 => 0.6779, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.81% (17.1032 => 16.1091, std.dev.: 0.0329) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.80% (0.5999 => 0.5651, std.dev.: 0.0065) SingleSource/UnitTests/ObjC/synchronized: -5.80% (0.3896 => 0.3670, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -5.80% (1.3864 => 1.3060, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -5.79% (0.3831 => 0.3609, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.79% (0.5857 => 0.5518, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.79% (0.8521 => 0.8028, std.dev.: 0.0073) MultiSource/Benchmarks/sim/sim: -5.78% (0.3406 => 0.3209, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: -5.78% (0.4515 => 0.4254, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: -5.78% (0.4033 => 0.3800, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.77% (0.3880 => 0.3656, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.76% (0.3891 => 0.3667, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: -5.75% (0.3581 => 0.3375, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: -5.72% (0.4176 => 0.3937, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.69% (0.2548 => 0.2403, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.67% (1.6474 => 1.5540, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.67% (0.2999 => 0.2829) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.66% (0.3884 => 0.3664, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.66% (0.2278 => 0.2149, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -5.64% (0.3848 => 0.3631, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (0.7021 => 0.6626, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.61% (0.4151 => 0.3918, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.60% (0.6395 => 0.6037, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -5.60% (1.3148 => 1.2412, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.59% (0.4916 => 0.4641, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -5.59% (3.5154 => 3.3188, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.59% (0.5168 => 0.4879, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.59% (0.4813 => 0.4544, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.57% (0.5329 => 0.5032, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.56% (0.5849 => 0.5524, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.55% (0.6052 => 0.5716, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.55% (0.4199 => 0.3966, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.55% (0.5805 => 0.5483, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.53% (0.6667 => 0.6298, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.53% (0.7339 => 0.6933, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.53% (0.5478 => 0.5175, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.51% (0.6230 => 0.5887, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: -5.50% (18.2933 => 17.2869, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.50% (8.0126 => 7.5722, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.49% (0.6446 => 0.6092, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.48% (0.6260 => 0.5917, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.48% (0.5859 => 0.5538, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.48% (0.6681 => 0.6315, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.46% (0.7524 => 0.7113, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.46% (0.9557 => 0.9035, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.46% (0.6304 => 0.5960, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.43% (0.5802 => 0.5487, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.43% (0.5581 => 0.5278, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.42% (0.3319 => 0.3139, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.42% (0.6676 => 0.6314, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.42% (0.5591 => 0.5288, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.42% (2.2587 => 2.1363, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.42% (0.5705 => 0.5396, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: -5.41% (2.1401 => 2.0243, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.40% (2.1713 => 2.0541, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.39% (0.3837 => 0.3630, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.38% (0.6660 => 0.6302, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -5.37% (0.4280 => 0.4050, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.37% (0.2106 => 0.1993, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.36% (0.4083 => 0.3864, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -5.36% (0.7982 => 0.7554, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.35% (0.5567 => 0.5269, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.35% (0.5456 => 0.5164, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -5.35% (0.4861 => 0.4601, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.34% (0.6440 => 0.6096, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: -5.34% (0.3446 => 0.3262, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.34% (0.5941 => 0.5624, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -5.33% (15.2527 => 14.4403, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.32% (0.2385 => 0.2258, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.32% (0.6033 => 0.5712, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.32% (1.2221 => 1.1571, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.32% (0.6189 => 0.5860, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.30% (0.3057 => 0.2895, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.30% (0.6194 => 0.5866, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: -5.29% (0.2871 => 0.2719, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.29% (0.5575 => 0.5280, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.29% (0.6395 => 0.6057, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.28% (0.4321 => 0.4093, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: -5.27% (0.2939 => 0.2784, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.27% (0.3016 => 0.2857, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.27% (0.3491 => 0.3307, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: -5.26% (34.0927 => 32.2991, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/matrix: -5.25% (0.3255 => 0.3084, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/strcat: -5.25% (0.2989 => 0.2832, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.25% (1.2210 => 1.1569, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.24% (0.3931 => 0.3725, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.24% (0.2903 => 0.2751, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -5.23% (0.4248 => 0.4026, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: -5.22% (0.3867 => 0.3665, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.22% (0.2933 => 0.2780, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -5.22% (0.3394 => 0.3217, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.21% (0.6297 => 0.5969, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.21% (0.3323 => 0.3150, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.20% (0.5688 => 0.5392, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: -5.19% (0.2849 => 0.2701, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -5.19% (0.3025 => 0.2868, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -5.19% (0.3026 => 0.2869, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.19% (0.5863 => 0.5559, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -5.17% (0.3481 => 0.3301, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.17% (0.3849 => 0.3650, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -5.16% (0.3621 => 0.3434, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: -5.15% (0.4524 => 0.4291, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.15% (0.5925 => 0.5620, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.13% (0.4427 => 0.4200, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -5.12% (0.3205 => 0.3041, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -5.11% (0.6750 => 0.6405, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.10% (0.3194 => 0.3031, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.10% (0.5570 => 0.5286, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -5.10% (0.8418 => 0.7989, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: -5.10% (0.3788 => 0.3595, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: -5.07% (0.3271 => 0.3105, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.98% (0.3252 => 0.3090, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.97% (0.3059 => 0.2907, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.71% (5.0226 => 4.7859, std.dev.: 0.0182) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.51% (0.9077 => 0.8668, std.dev.: 0.0024) MultiSource/Applications/hbd/hbd: -4.24% (1.5610 => 1.4948, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -3.87% (0.7779 => 0.7478, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -3.51% (0.6441 => 0.6215, std.dev.: 0.0049) SingleSource/UnitTests/ObjC++/Hello: -3.39% (0.6347 => 0.6132, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -2.88% (20.7746 => 20.1768, std.dev.: 0.0134) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7577, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -8.74% (1.2842 => 1.1719, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: -4.21% (2.2633 => 2.1681, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.91% (1.7753 => 1.7059, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.34% (1.3096 => 1.2789, std.dev.: 0.0094) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4701, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 10 15:32:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 10 Nov 2012 17:32:36 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121110233236.E9D0E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5750?compare_to=5747&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5750, Order: 167678, Start Time: 2012-11-10 20:16:55, End Time: 2012-11-10 23:32:50 To: 5747, Order: 167675, Start Time: 2012-11-10 16:12:59, End Time: 2012-11-10 19:28:51 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (176 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (715 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.26% (124.0743 => 129.3640, std.dev.: 0.8053) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 44.96% (0.0625 => 0.0906, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.71% (0.1063 => 0.1432, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.11% (0.4253 => 0.5406, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.51% (0.2969 => 0.3756, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.31% (0.1106 => 0.1397, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 26.04% (1.5932 => 2.0081, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.76% (0.4139 => 0.5205, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.49% (0.0714 => 0.0896, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.83% (0.5900 => 0.7365, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.42% (0.0475 => 0.0591, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.41% (0.4994 => 0.6213, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.34% (0.0415 => 0.0516) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.84% (0.5000 => 0.6192, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.58% (0.0547 => 0.0676, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.46% (0.0584 => 0.0721) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.22% (0.1107 => 0.1364, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.15% (0.1620 => 0.1995, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.92% (0.1021 => 0.1255) MultiSource/Benchmarks/Olden/tsp/tsp: 22.54% (0.0599 => 0.0734, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.07% (0.0897 => 0.1095, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.80% (0.0633 => 0.0771, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.67% (0.1103 => 0.1342, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 21.62% (0.0948 => 0.1153, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.58% (0.0584 => 0.0710, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.44% (0.0541 => 0.0657, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.34% (0.0642 => 0.0779, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 21.19% (0.0821 => 0.0995, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.01% (0.0495 => 0.0599, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.92% (0.0822 => 0.0994, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.91% (0.3903 => 0.4719, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.84% (0.1003 => 0.1212, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 20.82% (0.1619 => 0.1956, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.72% (0.1549 => 0.1870, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 20.70% (0.0604 => 0.0729, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.51% (0.1604 => 0.1933, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 19.96% (0.0947 => 0.1136, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 19.69% (0.5826 => 0.6973, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 19.68% (0.0808 => 0.0967, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.63% (0.1462 => 0.1749, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 19.53% (0.5889 => 0.7039, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.33% (0.2736 => 0.3265, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.31% (0.2014 => 0.2403, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 19.21% (0.1218 => 0.1452, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.20% (0.3890 => 0.4637, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.99% (1.3152 => 1.5649, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 18.86% (0.4029 => 0.4789, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 18.60% (0.1505 => 0.1785, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 18.59% (0.0581 => 0.0689, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.57% (0.1088 => 0.1290, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 18.48% (0.0698 => 0.0827, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 18.21% (0.9697 => 1.1463, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.18% (0.2866 => 0.3387, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.09% (3.5627 => 4.2071, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.01% (0.0572 => 0.0675, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.99% (0.1968 => 0.2322, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.98% (0.2875 => 0.3392, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.98% (0.0573 => 0.0676, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 17.89% (0.5546 => 0.6538, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 17.79% (1.8794 => 2.2137, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.69% (0.0605 => 0.0712, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.65% (1.6211 => 1.9073, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 17.63% (0.7171 => 0.8435, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.63% (0.4658 => 0.5479, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.53% (0.5026 => 0.5907, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: 17.52% (1.0781 => 1.2670, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.48% (0.3930 => 0.4617, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.41% (0.1160 => 0.1362, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.38% (0.2738 => 0.3214, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 17.25% (0.2725 => 0.3195, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 17.24% (0.2714 => 0.3182, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 17.24% (0.1421 => 0.1666, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 17.17% (0.9909 => 1.1610, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.15% (0.2729 => 0.3197, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 17.13% (0.2750 => 0.3221, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 17.11% (0.3004 => 0.3518, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.09% (2.7292 => 3.1955, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.06% (0.3271 => 0.3829, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 17.01% (0.2780 => 0.3253, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 16.99% (0.2813 => 0.3291, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 16.95% (0.2803 => 0.3278, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.94% (0.2792 => 0.3265, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 16.90% (0.2811 => 0.3286, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.88% (0.4361 => 0.5097, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 16.86% (0.2823 => 0.3299, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.80% (0.2911 => 0.3400, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.78% (0.3195 => 0.3731, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.71% (4.4195 => 5.1579, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/wc: 16.70% (0.3096 => 0.3613, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 16.68% (4.2109 => 4.9134, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: 16.67% (0.1284 => 0.1498, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.57% (2.0673 => 2.4098, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 16.38% (0.3267 => 0.3802, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.33% (0.1090 => 0.1268) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.19% (1.9694 => 2.2882, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 16.14% (0.3258 => 0.3784, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.98% (0.3060 => 0.3549, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 15.92% (0.3317 => 0.3845, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.91% (1.9966 => 2.3143, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.88% (0.3362 => 0.3896, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 15.75% (23.5202 => 27.2251, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/moments: 15.61% (0.3678 => 0.4252, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.56% (0.3124 => 0.3610, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 15.53% (0.4146 => 0.4790, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 15.51% (0.2566 => 0.2964, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 15.38% (0.3348 => 0.3863, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/exceptions-2: 15.35% (0.3446 => 0.3975, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.30% (0.3282 => 0.3784, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 15.28% (0.2075 => 0.2392, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 15.27% (0.3726 => 0.4295, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.25% (0.3488 => 0.4020, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 15.22% (0.3496 => 0.4028, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.19% (0.3845 => 0.4429, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 15.16% (0.3477 => 0.4004, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 15.12% (0.3465 => 0.3989, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 15.08% (0.3442 => 0.3961, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 15.06% (0.3460 => 0.3981, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 15.05% (0.3469 => 0.3991, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 14.99% (1.4269 => 1.6408, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.87% (0.3625 => 0.4164, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 14.80% (0.4251 => 0.4880, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 14.80% (0.3643 => 0.4182, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.72% (0.3981 => 0.4567, std.dev.: 0.0122) SingleSource/UnitTests/ObjC/property: 14.71% (0.3650 => 0.4187, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.66% (0.3690 => 0.4231, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 14.63% (0.3724 => 0.4269, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 14.63% (0.7875 => 0.9027, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 14.38% (2.1013 => 2.4034, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 14.34% (2.1653 => 2.4758, std.dev.: 0.0073) MultiSource/Benchmarks/sim/sim: 14.25% (0.0758 => 0.0866) SingleSource/Benchmarks/Misc-C++/bigfib: 14.03% (0.5012 => 0.5715, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 13.96% (4.6177 => 5.2622, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.81% (0.1383 => 0.1574, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 13.27% (0.2691 => 0.3048, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.14% (0.2040 => 0.2308, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 12.91% (5.5417 => 6.2569, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.71% (0.6435 => 0.7253, std.dev.: 0.0017) MultiSource/Applications/siod/siod: 12.16% (0.6634 => 0.7441, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 12.06% (0.3498 => 0.3920, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.96% (0.1028 => 0.1151, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.94% (0.2068 => 0.2315, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 11.72% (0.4847 => 0.5415, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.66% (0.2737 => 0.3056, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.35% (0.3084 => 0.3434, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 10.79% (0.3336 => 0.3696, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 10.68% (2.0346 => 2.2518, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 10.66% (0.2391 => 0.2646, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.51% (0.2103 => 0.2324, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.40% (4.6926 => 5.1339, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.40% (0.5361 => 0.5865, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.23% (11.6398 => 12.7147, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.90% (0.5584 => 0.6081, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.79% (0.7426 => 0.8079, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 7.61% (11.9555 => 12.8656, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.85% (0.3792 => 0.4014, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 10.06% (0.2802 => 0.3084, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6090, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.88% (0.3693 => 0.3910, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6719, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1683, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-2: 4.46% (1.8057 => 1.8863, std.dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6419, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2065, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.54% (3.1722 => 3.2210, std.dev.: 0.0049) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3076, std.dev.: 0.0136) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.25% (7.1849 => 7.2749, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5910, std.dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5594, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/ary2: -10.45% (0.2402 => 0.2151, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9748, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.66% (35.5013 => 32.7833, std.dev.: 0.0118) MultiSource/Benchmarks/Olden/tsp/tsp: -7.17% (2.1113 => 1.9600, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8021, std.dev.: 0.0119) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0051) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.75% (17.2379 => 16.7637, std.dev.: 0.0952) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8658, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5725, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4956, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.30% (5.7935 => 5.7181, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.2074, std.dev.: 0.0336) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0430, std.dev.: 0.0044) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 10 18:20:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 10 Nov 2012 20:20:22 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121111022022.7A7B22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5751?compare_to=5749&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5751, Order: 167679, Start Time: 2012-11-11 00:55:45, End Time: 2012-11-11 02:20:35 To: 5749, Order: 167678, Start Time: 2012-11-10 19:23:01, End Time: 2012-11-10 20:47:46 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 1 (180 on baseline) Unchanged Tests: 1041 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.19% (81.6361 => 79.8494, std.dev.: 0.3956) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1012, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/hash2: 2.40% (3.1932 => 3.2699, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: 2.38% (7.4937 => 7.6724, std.dev.: 0.0126) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.08% (0.1431 => 0.1301, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.01% (0.3821 => 0.3515, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.55% (2.4924 => 2.3042, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -7.00% (0.3357 => 0.3122, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.98% (0.9542 => 0.8876, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.80% (0.2428 => 0.2263, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.78% (0.3142 => 0.2929, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.70% (0.3658 => 0.3413, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: -6.59% (16.1920 => 15.1250, std.dev.: 0.0160) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.57% (22.4056 => 20.9334, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.56% (3.5339 => 3.3019, std.dev.: 0.0067) MultiSource/Applications/JM/ldecod/ldecod: -6.51% (7.0961 => 6.6342, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: -6.48% (0.2160 => 0.2020, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -6.44% (9.2283 => 8.6339, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.42% (0.6484 => 0.6068, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.40% (0.9852 => 0.9221, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -6.36% (4.3330 => 4.0575, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.34% (1.0544 => 0.9876, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.29% (0.1796 => 0.1683, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -6.28% (1.2515 => 1.1729, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.25% (1.3722 => 1.2864, std.dev.: 0.0080) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.20% (0.2355 => 0.2209, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: -6.20% (0.9179 => 0.8610, std.dev.: 0.0058) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.18% (0.1716 => 0.1610, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -6.17% (1.1450 => 1.0743, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -6.16% (0.2985 => 0.2801, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.15% (4.0323 => 3.7844, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.13% (1.2300 => 1.1546, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.12% (1.2784 => 1.2001, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.12% (0.7919 => 0.7434, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.12% (1.6364 => 1.5362, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.10% (4.5069 => 4.2320, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/08-main/main: -6.09% (0.2659 => 0.2497, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -6.08% (2.4021 => 2.2560, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.07% (0.6736 => 0.6327, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.05% (0.6293 => 0.5912, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.04% (1.4642 => 1.3757, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.04% (4.8161 => 4.5252, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.00% (4.8802 => 4.5874, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.98% (5.4682 => 5.1414, std.dev.: 0.0086) MultiSource/Benchmarks/nbench/nbench: -5.98% (1.1530 => 1.0841, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.97% (0.3483 => 0.3275, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.97% (0.2548 => 0.2396, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -5.96% (0.1879 => 0.1767, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -5.94% (4.0594 => 3.8182, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.93% (0.8521 => 0.8016, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: -5.92% (15.5079 => 14.5894, std.dev.: 0.0176) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.90% (0.2695 => 0.2536, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.89% (6.7716 => 6.3730, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.87% (14.2083 => 13.3739, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/exceptions-2: -5.85% (0.3831 => 0.3607, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -5.84% (0.3581 => 0.3372, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: -5.83% (1.3864 => 1.3056, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -5.82% (17.1032 => 16.1070, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.81% (0.7198 => 0.6780, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.80% (0.4033 => 0.3799, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.80% (0.5999 => 0.5651, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: -5.80% (0.3896 => 0.3670, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -5.78% (0.3406 => 0.3209, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -5.77% (0.7447 => 0.7017, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.77% (0.3880 => 0.3656, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -5.77% (0.3812 => 0.3592, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.74% (0.2999 => 0.2827, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.73% (0.3891 => 0.3668, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.66% (0.2278 => 0.2149, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: -5.65% (0.4515 => 0.4260, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.64% (0.3884 => 0.3665, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.64% (0.4151 => 0.3917, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.63% (0.4916 => 0.4639, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.63% (0.5857 => 0.5527, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -5.63% (1.3148 => 1.2408, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.63% (0.4176 => 0.3941, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.62% (0.5805 => 0.5479, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.61% (0.4813 => 0.4543, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.60% (0.5859 => 0.5531, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.60% (0.7021 => 0.6628, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.57% (0.5849 => 0.5523, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.57% (0.5329 => 0.5032, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -5.56% (0.3848 => 0.3634, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: -5.55% (18.2933 => 17.2774, std.dev.: 0.0044) MultiSource/Applications/d/make_dparser: -5.55% (3.5154 => 3.3202, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.53% (0.5168 => 0.4882, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -5.53% (0.4199 => 0.3967, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.52% (0.5802 => 0.5482, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.51% (0.6660 => 0.6293, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.51% (0.6446 => 0.6091, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.50% (8.0126 => 7.5718, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.50% (0.3837 => 0.3626, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.49% (0.5478 => 0.5177, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.49% (0.9557 => 0.9032, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.49% (0.6304 => 0.5958, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.49% (0.5925 => 0.5600, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.48% (0.5567 => 0.5262, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.48% (1.6474 => 1.5572, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.45% (0.5705 => 0.5394, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -5.45% (0.7982 => 0.7547, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.45% (0.7524 => 0.7114, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.45% (0.6681 => 0.6317, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.44% (0.4083 => 0.3861, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.43% (0.3057 => 0.2891, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.39% (0.6052 => 0.5726, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.38% (0.6260 => 0.5923, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.38% (2.1713 => 2.0545, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.38% (0.6395 => 0.6051, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.38% (0.5581 => 0.5281, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.37% (0.5863 => 0.5548, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.37% (0.5569 => 0.5270, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.37% (0.2385 => 0.2257, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -5.36% (0.2871 => 0.2717, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.36% (0.3323 => 0.3145, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.36% (1.2210 => 1.1556, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: -5.35% (2.1401 => 2.0255, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.35% (0.5941 => 0.5623, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.35% (0.6297 => 0.5960, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.35% (0.5575 => 0.5277, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.34% (1.2221 => 1.1568, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.34% (0.3931 => 0.3721, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.34% (0.2903 => 0.2748, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -5.33% (15.2527 => 14.4399, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/hash: -5.33% (0.4524 => 0.4283, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: -5.32% (0.2989 => 0.2830, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.32% (0.2933 => 0.2777, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -5.31% (0.3446 => 0.3263, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.31% (0.6667 => 0.6313, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.31% (0.2939 => 0.2783, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -5.31% (0.4861 => 0.4603, std.dev.: 0.0047) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.30% (0.3319 => 0.3143, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.30% (0.4321 => 0.4092, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.30% (0.6230 => 0.5900, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -5.29% (0.3271 => 0.3098, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -5.28% (0.3255 => 0.3083, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -5.28% (34.0927 => 32.2924, std.dev.: 0.0206) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.28% (0.5456 => 0.5168, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -5.28% (0.3867 => 0.3663, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.27% (0.5688 => 0.5388, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: -5.27% (0.4248 => 0.4024, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.27% (0.3016 => 0.2857, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.26% (0.5591 => 0.5297, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.26% (0.6676 => 0.6325, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -5.26% (0.3481 => 0.3298, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -5.25% (0.3026 => 0.2867, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.24% (0.3491 => 0.3308, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.24% (2.2587 => 2.1404, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/bigfib: -5.23% (0.6750 => 0.6397, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.22% (0.5570 => 0.5279, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.22% (0.2106 => 0.1996, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: -5.22% (0.3025 => 0.2867, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -5.22% (0.3621 => 0.3432, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.22% (0.6189 => 0.5866, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -5.21% (0.3205 => 0.3038, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/parameter-passing: -5.21% (0.4280 => 0.4057, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.17% (0.6440 => 0.6107, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -5.16% (0.3394 => 0.3219, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.15% (0.6033 => 0.5722, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.15% (0.6194 => 0.5875, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -5.13% (0.3194 => 0.3030, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -5.12% (0.2849 => 0.2703, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.09% (0.3849 => 0.3653, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.07% (0.3252 => 0.3087, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -5.06% (0.8418 => 0.7992, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.06% (0.4427 => 0.4203, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -4.99% (0.3788 => 0.3599, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -4.97% (0.3059 => 0.2907, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -4.70% (5.0226 => 4.7865, std.dev.: 0.0114) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.62% (0.9077 => 0.8658, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: -4.19% (1.5610 => 1.4956, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: -3.82% (0.7779 => 0.7482, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -3.45% (0.6441 => 0.6219, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -3.32% (0.6347 => 0.6136, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -3.03% (20.7746 => 20.1452, std.dev.: 0.0502) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7552, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/richards_benchmark: -8.69% (1.2842 => 1.1726, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7060, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: -3.88% (2.2633 => 2.1754, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.86% (1.3096 => 1.2722, std.dev.: 0.0138) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4723, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0003) Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 10 18:41:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 10 Nov 2012 20:41:24 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121111024124.0B1F32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5752?compare_to=5748&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5752, Order: 167679, Start Time: 2012-11-11 00:49:30, End Time: 2012-11-11 02:41:39 To: 5748, Order: 167678, Start Time: 2012-11-10 19:08:57, End Time: 2012-11-10 20:34:20 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 18 (98 on baseline) Performance Improvements: 1 (28 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 972 (848 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 6.51% (0.1889 => 0.2012, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 6.13% (0.3016 => 0.3201, std.dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: 4.07% (0.3019 => 0.3142, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.88% (0.6175 => 0.6353, std.dev.: 0.0058) MultiSource/Applications/treecc/treecc: 2.71% (2.0030 => 2.0572, std.dev.: 0.0144) MultiSource/Benchmarks/MallocBench/gs/gs: 1.87% (4.1786 => 4.2569, std.dev.: 0.0215) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.59% (0.8668 => 0.8806, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 9.43% (3.7020 => 4.0510, std.dev.: 0.0888) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 8.80% (20.3954 => 22.1902, std.dev.: 0.0578) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.05% (2.4103 => 2.5802, std.dev.: 0.0242) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.10% (57.2304 => 59.5742, std.dev.: 0.7106) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.47% (2.3002 => 2.3801, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/except: 2.32% (0.4867 => 0.4980, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.06% (14.2637 => 14.5575, std.dev.: 0.0768) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.45% (1.4171 => 1.4376, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.17% (4.8520 => 4.9088, std.dev.: 0.0177) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.14% (40.9453 => 41.4105, std.dev.: 0.0841) SingleSource/Benchmarks/Misc/pi: 1.11% (2.4788 => 2.5063, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -7.21% (1.4496 => 1.3451, std.dev.: 0.0319) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.14% (16.7295 => 16.7525, std.dev.: 0.0520) MultiSource/Applications/obsequi/Obsequi: -1.41% (1.0631 => 1.0481, std.dev.: 0.0123) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.18% (21.6809 => 21.7206, std.dev.: 0.2188) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.14% (0.3648 => 0.3653, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: 0.36% (0.6052 => 0.6074, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.09% (0.3334 => 0.3331, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: -2.91% (0.2027 => 0.1968, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.17% (0.0144 => 0.0138, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.64% (0.0412 => 0.0427, std.dev.: 0.0077) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 5.61% (0.0285 => 0.0301, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.88% (0.0313 => 0.0304, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.04% (0.0371 => 0.0356, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/casts: 49.26% (0.0136 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -21.18% (0.0170 => 0.0134, std.dev.: 0.0037) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1454 => 0.1456, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: -0.57% (1.1768 => 1.1701, std.dev.: 0.0376) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.30% (0.1396 => 0.1442, std.dev.: 0.0087) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.15% (0.4135 => 0.4224, std.dev.: 0.0293) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.34% (0.1450 => 0.1445, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.77% (0.0572 => 0.0605, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.54% (0.0199 => 0.0216, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.33% (0.0604 => 0.0606, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.18% (1.1913 => 1.1935, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -41.67% (0.0012 => 0.0007, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.42% (0.0565 => 0.0557, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.35% (0.0228 => 0.0263, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.48% (0.7775 => 0.7738, std.dev.: 0.0120) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 500.00% (0.0001 => 0.0006, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -51.22% (0.0082 => 0.0040, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2304.69% (0.6332 => 15.2265, std.dev.: 0.0797) MultiSource/Benchmarks/McCat/08-main/main: 47.73% (0.1831 => 0.2705, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.85% (0.1559 => 0.1421, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1484.30% (0.3344 => 5.2979, std.dev.: 0.0302) SingleSource/Benchmarks/Misc-C++/Large/ray: 34.64% (0.2364 => 0.3183, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/mandel: 2.56% (0.0429 => 0.0440, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.45% (0.0224 => 0.0225, std.dev.: 0.0017) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4327, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0701, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4949, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3470, std.dev.: 0.0206) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1453, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4012, std.dev.: 0.0039) SingleSource/Regression/C/uint64_to_float: -23.77% (2.1832 => 1.6642, std.dev.: 0.0049) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.30% (0.0810 => 0.0942, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.62% (0.0848 => 0.0955, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.93% (0.3137 => 0.3323, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.92% (0.2180 => 0.2309, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.79% (0.7473 => 0.7906, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.74% (0.8148 => 0.8616, std.dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.73% (0.1885 => 0.1993, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.71% (0.6010 => 0.6353, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.62% (0.1905 => 0.2012, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: 5.33% (1.2222 => 1.2873, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.96% (0.2240 => 0.2351, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 4.77% (0.2999 => 0.3142, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.87% (0.4783 => 0.4968, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.87% (0.2741 => 0.2847, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.77% (1.4479 => 1.5025, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.76% (0.4127 => 0.4282, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.60% (0.6227 => 0.6451, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 3.57% (1.4269 => 1.4779, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.40% (1.1606 => 1.2001, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.38% (0.8518 => 0.8806, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 3.36% (0.7950 => 0.8217, std.dev.: 0.0079) MultiSource/Applications/treecc/treecc: 3.13% (1.9948 => 2.0572, std.dev.: 0.0144) MultiSource/Benchmarks/MallocBench/gs/gs: 3.06% (4.1305 => 4.2569, std.dev.: 0.0215) MultiSource/Applications/SPASS/SPASS: 2.93% (14.2605 => 14.6788, std.dev.: 0.0520) SingleSource/UnitTests/Vector/constpool: 2.66% (8.4179 => 8.6419, std.dev.: 0.0760) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.64% (1.3279 => 1.3629, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.63% (0.4559 => 0.4679, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.61% (0.8697 => 0.8924, std.dev.: 0.0084) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (6.7320 => 6.9072, std.dev.: 0.0403) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.44% (0.5817 => 0.5959, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.36% (1.6386 => 1.6772, std.dev.: 0.0064) MultiSource/Benchmarks/PAQ8p/paq8p: 2.32% (2.3764 => 2.4315, std.dev.: 0.0052) MultiSource/Applications/JM/lencod/lencod: 2.29% (15.3280 => 15.6792, std.dev.: 0.0202) MultiSource/Applications/ClamAV/clamscan: 2.28% (14.7684 => 15.1057, std.dev.: 0.0733) MultiSource/Benchmarks/Bullet/bullet: 2.28% (31.8598 => 32.5861, std.dev.: 0.1041) MultiSource/Applications/siod/siod: 2.25% (2.2184 => 2.2684, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.23% (0.9056 => 0.9258, std.dev.: 0.0034) MultiSource/Applications/d/make_dparser: 2.22% (3.2366 => 3.3086, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.17% (0.8007 => 0.8181, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.14% (0.8086 => 0.8259, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.12% (0.8286 => 0.8462, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.12% (0.8457 => 0.8636, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.10% (4.4880 => 4.5822, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.10% (0.9688 => 0.9891, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.10% (0.8066 => 0.8235, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.08% (13.1811 => 13.4555, std.dev.: 0.0736) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.06% (1.2423 => 1.2679, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.00% (0.8716 => 0.8890, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 1.99% (3.8189 => 3.8948, std.dev.: 0.0270) MultiSource/Benchmarks/Prolangs-C/football/football: 1.96% (0.8768 => 0.8940, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.92% (0.8331 => 0.8491, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.91% (0.8855 => 0.9024, std.dev.: 0.0052) MultiSource/Applications/oggenc/oggenc: 1.87% (4.9628 => 5.0557, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.85% (0.8340 => 0.8494, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.78% (0.8359 => 0.8508, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.76% (4.4873 => 4.5664, std.dev.: 0.0271) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.76% (0.8177 => 0.8321, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.76% (0.8885 => 0.9041, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.69% (0.8656 => 0.8802, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.65% (0.8316 => 0.8453, std.dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 1.60% (8.6247 => 8.7627, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.57% (0.8261 => 0.8391, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.46% (0.8338 => 0.8460, std.dev.: 0.0045) MultiSource/Applications/lemon/lemon: 1.27% (1.0945 => 1.1084, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 97.99% (0.0199 => 0.0394, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/pi: 58.68% (1.5795 => 2.5063, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.81% (0.7597 => 0.8874, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.27% (2.9753 => 3.4593, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.73% (2.7995 => 3.2119, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.47% (5.0261 => 5.6025, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.06% (1.1857 => 1.2813, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: 7.03% (1.3037 => 1.3954, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/queens: 7.01% (1.7056 => 1.8252, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.76% (4.7794 => 5.1024, std.dev.: 0.0317) MultiSource/Applications/SIBsim4/SIBsim4: 6.26% (3.1873 => 3.3869, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.92% (4.9686 => 5.2628, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.82% (4.5327 => 4.7964, std.dev.: 0.0403) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.68% (3.3761 => 3.5341, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.55% (6.2275 => 6.5109, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.43% (4.9453 => 5.1646, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.11% (4.9469 => 5.1501, std.dev.: 0.0067) MultiSource/Applications/hexxagon/hexxagon: 3.89% (14.0064 => 14.5519, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.86% (11.5690 => 11.9000, std.dev.: 0.0140) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.76% (1.2337 => 1.2677, std.dev.: 0.0082) MultiSource/Applications/siod/siod: 2.71% (3.6643 => 3.7635, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.68% (4.8362 => 4.9657, std.dev.: 0.0133) MultiSource/Applications/lambda-0_1_3/lambda: 2.56% (7.4933 => 7.6854, std.dev.: 0.0518) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.36% (8.2783 => 8.4733, std.dev.: 0.0178) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.32% (44.5605 => 45.5964, std.dev.: 0.3704) SingleSource/Benchmarks/Shootout/lists: 2.21% (7.3375 => 7.5000, std.dev.: 0.0135) SingleSource/Benchmarks/Dhrystone/dry: 2.03% (0.5081 => 0.5184, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.49% (1.5941 => 1.6178, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.35% (4.8436 => 4.9088, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/ReedSolomon: 1.26% (8.5322 => 8.6400, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.26% (2.4647 => 2.4957, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/power/power: 1.24% (1.2061 => 1.2211, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.20% (1.4205 => 1.4376, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 1.04% (2.3560 => 2.3805, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.67% (5.4641 => 4.3344, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.30% (7.2130 => 6.3259, std.dev.: 0.2314) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.85% (1.0512 => 0.9371, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -10.19% (1.1216 => 1.0073, std.dev.: 0.0106) MultiSource/Benchmarks/mafft/pairlocalalign: -8.53% (63.1822 => 57.7933, std.dev.: 0.1537) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.80% (0.3269 => 0.3014, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.90% (4.7482 => 4.4205, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.00% (3.7148 => 3.4920, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.85% (5.4972 => 5.1756, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.05% (5.1557 => 4.8955, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.51% (4.7449 => 4.5311, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.69% (6.0224 => 5.8000, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.59% (2.8773 => 2.7740, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.31% (0.5807 => 0.5615, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (28.5821 => 27.6915, std.dev.: 0.0220) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.81% (2.4490 => 2.3801, std.dev.: 0.0160) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.68% (1.2822 => 1.2478, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/ffbench: -2.67% (1.4296 => 1.3914, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.67% (2.6356 => 2.5653, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/hash2: -2.41% (3.4237 => 3.3411, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.36% (9.9065 => 9.6732, std.dev.: 0.0636) MultiSource/Applications/aha/aha: -2.31% (3.3398 => 3.2627, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.09% (3.2169 => 3.1497, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.05% (11.5316 => 11.2948, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.73% (2.3487 => 2.3080, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.63% (4.9994 => 4.9178, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.22% (5.6343 => 5.5657, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/hash: -1.17% (4.3087 => 4.2584, std.dev.: 0.0172) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.86% (16.4461 => 16.7525, std.dev.: 0.0520) MultiSource/Applications/obsequi/Obsequi: 2.13% (1.0262 => 1.0481, std.dev.: 0.0123) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6855.04% (0.3123 => 21.7206, std.dev.: 0.2188) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.32% (0.2463 => 0.3653, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: 1.06% (0.6010 => 0.6074, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.99% (0.3266 => 0.3331, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: -0.05% (0.1969 => 0.1968, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 12.20% (0.0123 => 0.0138, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0077) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 18.50% (0.0254 => 0.0301, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.66% (0.0302 => 0.0304, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.29% (0.0384 => 0.0356, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -25.56% (0.0180 => 0.0134, std.dev.: 0.0037) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.25% (0.1438 => 0.1456, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: 3.28% (1.1329 => 1.1701, std.dev.: 0.0376) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -1.37% (0.1462 => 0.1442, std.dev.: 0.0087) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.44% (0.4164 => 0.4224, std.dev.: 0.0293) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.55% (0.1369 => 0.1445, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.62% (0.0641 => 0.0605, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 10.77% (0.0195 => 0.0216, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.84% (0.0578 => 0.0606, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.35% (1.1437 => 1.1935, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 600.00% (0.0001 => 0.0007, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.16% (0.0627 => 0.0557, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 46.11% (0.0180 => 0.0263, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.48% (0.8017 => 0.7738, std.dev.: 0.0120) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 500.00% (0.0001 => 0.0006, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -35.48% (0.0062 => 0.0040, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 10 20:08:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 10 Nov 2012 22:08:37 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121111040837.B9CCF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5753?compare_to=5751&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5753, Order: 167680, Start Time: 2012-11-11 02:43:48, End Time: 2012-11-11 04:08:50 To: 5751, Order: 167679, Start Time: 2012-11-11 00:55:45, End Time: 2012-11-11 02:20:35 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (5 on baseline) Performance Improvements: 0 (179 on baseline) Unchanged Tests: 1040 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.69% (54.6957 => 56.1660, std.dev.: 0.2819) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.41% (1.2722 => 1.2902, std.dev.: 0.0034) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.93% (2.0478 => 2.1079, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.92% (54.5751 => 56.1660, std.dev.: 0.2819) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.4937 => 7.6777, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/hash2: 2.15% (3.1932 => 3.2618, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.08% (0.1431 => 0.1301) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.88% (0.3821 => 0.3520, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -7.58% (2.4924 => 2.3034, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: -7.00% (0.3357 => 0.3122, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.91% (0.3142 => 0.2925, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.88% (0.2428 => 0.2261, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.87% (0.9542 => 0.8886, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.70% (0.3658 => 0.3413, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.68% (3.5339 => 3.2980, std.dev.: 0.0060) MultiSource/Applications/JM/lencod/lencod: -6.60% (16.1920 => 15.1226, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.58% (1.0544 => 0.9850, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.55% (22.4056 => 20.9371, std.dev.: 0.0134) MultiSource/Benchmarks/mafft/pairlocalalign: -6.54% (9.2283 => 8.6246, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/oourafft: -6.48% (0.2160 => 0.2020, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -6.43% (7.0961 => 6.6399, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.42% (0.6484 => 0.6068, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: -6.41% (4.3330 => 4.0554, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.36% (0.9852 => 0.9225, std.dev.: 0.0082) MultiSource/Applications/Burg/burg: -6.34% (1.2515 => 1.1722, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.29% (0.1796 => 0.1683, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.28% (0.2355 => 0.2207, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.27% (1.3722 => 1.2861, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.24% (0.1716 => 0.1609, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -6.23% (0.1879 => 0.1762, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.23% (1.2784 => 1.1988, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: -6.21% (0.9179 => 0.8609, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.20% (1.4642 => 1.3734, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: -6.20% (0.2985 => 0.2800, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.19% (4.0323 => 3.7825, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.18% (1.6364 => 1.5352, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.18% (0.7919 => 0.7430, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.16% (1.2300 => 1.1542, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: -6.13% (0.2659 => 0.2496, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.10% (0.6736 => 0.6325, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -6.10% (2.4021 => 2.2556, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -6.09% (1.1450 => 1.0753, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.08% (4.8161 => 4.5231, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.08% (0.2548 => 0.2393, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -6.05% (1.1530 => 1.0832, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.00% (4.5069 => 4.2365, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.99% (4.8802 => 4.5878, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.99% (0.6293 => 0.5916, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.97% (6.7716 => 6.3671, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.96% (5.4682 => 5.1421, std.dev.: 0.0053) MultiSource/Applications/lua/lua: -5.94% (4.0594 => 3.8182, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.94% (0.8521 => 0.8015, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.93% (14.2083 => 13.3659, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.91% (0.3483 => 0.3277, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -5.88% (15.5079 => 14.5960, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.86% (0.2695 => 0.2537, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: -5.84% (1.3864 => 1.3055, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.83% (0.7198 => 0.6778, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: -5.83% (0.7447 => 0.7013, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.82% (0.3880 => 0.3654, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.82% (0.5999 => 0.5650, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: -5.80% (17.1032 => 16.1110, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/18-imp/imp: -5.78% (0.3581 => 0.3374, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.77% (0.3812 => 0.3592, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.77% (0.3831 => 0.3610, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.75% (0.3896 => 0.3672) MultiSource/Benchmarks/McCat/05-eks/eks: -5.74% (0.4515 => 0.4256, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.74% (0.4916 => 0.4634, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: -5.73% (0.4033 => 0.3802, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -5.72% (0.4176 => 0.3937, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.72% (0.3884 => 0.3662, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.71% (0.7021 => 0.6620, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -5.69% (0.3848 => 0.3629, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.68% (0.3891 => 0.3670, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.64% (0.2999 => 0.2830, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.63% (1.6474 => 1.5546, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.63% (0.5859 => 0.5529, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.63% (0.5329 => 0.5029, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.61% (0.4813 => 0.4543, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -5.61% (0.3406 => 0.3215, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.59% (0.5849 => 0.5522, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.59% (0.5581 => 0.5269, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -5.58% (1.3148 => 1.2414, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.58% (0.2278 => 0.2151, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -5.57% (0.4199 => 0.3965, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -5.56% (3.5154 => 3.3198, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.53% (0.6667 => 0.6298, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.53% (0.5805 => 0.5484, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.52% (8.0126 => 7.5702, std.dev.: 0.0093) MultiSource/Applications/treecc/treecc: -5.51% (2.1401 => 2.0221, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/hash2: -5.51% (0.4861 => 0.4593, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.51% (0.6260 => 0.5915, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.51% (0.6446 => 0.6091, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.50% (0.6395 => 0.6043, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.50% (0.7524 => 0.7110, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -5.50% (18.2933 => 17.2868, std.dev.: 0.0230) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.49% (0.6681 => 0.6314, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.49% (0.6230 => 0.5888, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.49% (0.5705 => 0.5392, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.48% (0.7339 => 0.6937, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.47% (0.4151 => 0.3924, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.46% (0.5802 => 0.5485, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.46% (0.5456 => 0.5158, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.46% (0.5591 => 0.5286, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.45% (0.9557 => 0.9036, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.44% (0.3491 => 0.3301, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.44% (0.5168 => 0.4887, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.43% (0.5925 => 0.5603, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -5.42% (0.4280 => 0.4048, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.42% (0.6660 => 0.6299, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.42% (0.6052 => 0.5724, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.41% (2.2587 => 2.1364, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.41% (2.1713 => 2.0538, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.41% (0.6304 => 0.5963, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.40% (0.5478 => 0.5182, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.40% (0.3057 => 0.2892, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.39% (0.6395 => 0.6050, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.39% (0.3319 => 0.3140, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.39% (0.5567 => 0.5267, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.37% (0.5863 => 0.5548, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.37% (0.2385 => 0.2257, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -5.36% (0.7982 => 0.7554, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -5.36% (15.2527 => 14.4350, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.35% (0.5941 => 0.5623, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: -5.35% (0.3271 => 0.3096, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.35% (0.6189 => 0.5858, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.35% (0.6676 => 0.6319, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.32% (1.2210 => 1.1560, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.32% (0.6297 => 0.5962, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.32% (0.2106 => 0.1994, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.31% (0.3255 => 0.3082, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.31% (0.6194 => 0.5865, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.31% (0.6440 => 0.6098, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: -5.31% (0.3446 => 0.3263, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.31% (0.5575 => 0.5279, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.30% (0.2903 => 0.2749, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.30% (0.5569 => 0.5274, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: -5.29% (0.2871 => 0.2719, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.28% (0.4321 => 0.4093, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: -5.28% (0.3867 => 0.3663, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.27% (0.6033 => 0.5715, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.27% (0.4083 => 0.3868, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -5.27% (0.2849 => 0.2699, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.26% (0.3837 => 0.3635, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.25% (0.2933 => 0.2779, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -5.24% (0.6750 => 0.6396, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.24% (0.3931 => 0.3725, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: -5.23% (0.4248 => 0.4026, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -5.22% (0.3621 => 0.3432, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: -5.22% (0.3394 => 0.3217, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -5.21% (0.2939 => 0.2786, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -5.19% (0.3025 => 0.2868, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: -5.19% (0.3026 => 0.2869, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -5.18% (0.3205 => 0.3039, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.17% (0.4427 => 0.4198, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.17% (0.3016 => 0.2860, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.17% (1.2221 => 1.1589, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.17% (0.5570 => 0.5282, std.dev.: 0.0072) MultiSource/Benchmarks/Bullet/bullet: -5.17% (34.0927 => 32.3312, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.15% (0.5688 => 0.5395, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.15% (0.3323 => 0.3152, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.14% (0.3849 => 0.3651, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.10% (0.3194 => 0.3031, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: -5.09% (0.2989 => 0.2837, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -5.08% (0.3481 => 0.3304, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -5.07% (0.8418 => 0.7991, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: -5.07% (0.3788 => 0.3596, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.04% (0.3252 => 0.3088, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -4.97% (0.3059 => 0.2907, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -4.89% (0.4524 => 0.4303, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -4.79% (5.0226 => 4.7821, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.78% (0.9077 => 0.8643, std.dev.: 0.0025) MultiSource/Applications/hbd/hbd: -4.27% (1.5610 => 1.4943, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: -3.88% (0.7779 => 0.7477, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: -3.52% (0.6441 => 0.6214, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.39% (0.6347 => 0.6132, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -3.05% (20.7746 => 20.1418, std.dev.: 0.0228) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7577, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -8.66% (1.2842 => 1.1730, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.99% (2.2633 => 2.1729, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7060, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.64% (6.5735 => 6.4658, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.48% (1.3096 => 1.2902, std.dev.: 0.0034) Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 10 20:24:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 10 Nov 2012 22:24:43 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121111042443.184BF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5754?compare_to=5752&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5754, Order: 167680, Start Time: 2012-11-11 02:58:39, End Time: 2012-11-11 04:24:58 To: 5752, Order: 167679, Start Time: 2012-11-11 00:49:30, End Time: 2012-11-11 02:41:39 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 3 (77 on baseline) Performance Improvements: 4 (28 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 984 (869 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 2.45% (2.0876 => 2.1387, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/hash: 1.21% (4.2584 => 4.3099, std.dev.: 0.0181) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.11% (4.4227 => 4.4716, std.dev.: 0.0167) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.18% (0.8816 => 0.8536, std.dev.: 0.0097) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.86% (0.8616 => 0.8456, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.29% (0.8806 => 0.8692, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -8.75% (4.0510 => 3.6967, std.dev.: 0.0634) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.11% (16.7525 => 16.7342, std.dev.: 0.0502) MultiSource/Applications/obsequi/Obsequi: -0.18% (1.0481 => 1.0462, std.dev.: 0.0107) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.37% (21.7206 => 21.6394, std.dev.: 0.1723) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.55% (0.3653 => 0.3673, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: -0.15% (0.6074 => 0.6065, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.78% (0.3331 => 0.3357, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 2.13% (0.1968 => 0.2010, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 9.42% (0.0138 => 0.0151, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0427 => 0.0426, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.29% (0.0301 => 0.0264, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.96% (0.0304 => 0.0313, std.dev.: 0.0051) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.09% (0.0356 => 0.0345, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/casts: -6.40% (0.0203 => 0.0190, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/test1: 39.55% (0.0134 => 0.0187, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1456 => 0.1458, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.47% (1.1701 => 1.1873, std.dev.: 0.0072) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.88% (0.1442 => 0.1386, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.48% (0.4224 => 0.4077, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.98% (0.1445 => 0.1402, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.65% (0.0605 => 0.0595, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.39% (0.0216 => 0.0213, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.98% (0.0606 => 0.0594, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.03% (1.1935 => 1.1932, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0007 => 0.0014, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.54% (0.0557 => 0.0554, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -34.98% (0.0263 => 0.0171, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.67% (0.7738 => 0.7790, std.dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 80.00% (0.0040 => 0.0072, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2295.39% (0.6332 => 15.1676, std.dev.: 0.1954) MultiSource/Benchmarks/McCat/08-main/main: 47.24% (0.1831 => 0.2696, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.60% (0.1559 => 0.1425, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1496.74% (0.3344 => 5.3395, std.dev.: 0.1067) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.99% (0.2364 => 0.3262, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/mandel: 2.56% (0.0429 => 0.0440, std.dev.: 0.0025) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.89% (0.0224 => 0.0226, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: -26.09% (0.0230 => 0.0170, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4252, std.dev.: 0.0324) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0704, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4960, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3454, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1370, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4080, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: -23.91% (2.1832 => 1.6613, std.dev.: 0.0231) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0004, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 12.96% (0.0810 => 0.0915, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 10.25% (0.1112 => 0.1226, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.73% (0.2180 => 0.2305, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.09% (0.1983 => 0.2084, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 4.31% (1.2222 => 1.2749, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.78% (0.8148 => 0.8456, std.dev.: 0.0049) MultiSource/Applications/hbd/hbd: 3.69% (1.4269 => 1.4795, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.99% (0.8340 => 0.8589, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.69% (1.4479 => 1.4868, std.dev.: 0.0070) MultiSource/Applications/SIBsim4/SIBsim4: 2.68% (1.2568 => 1.2905, std.dev.: 0.0097) MultiSource/Applications/SPASS/SPASS: 2.51% (14.2605 => 14.6191, std.dev.: 0.1380) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.43% (0.8069 => 0.8265, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 2.40% (3.2366 => 3.3144, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.36% (0.7932 => 0.8119, std.dev.: 0.0068) MultiSource/Benchmarks/nbench/nbench: 2.24% (1.1271 => 1.1524, std.dev.: 0.0029) MultiSource/Applications/lua/lua: 2.23% (3.8189 => 3.9042, std.dev.: 0.0169) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.17% (0.4783 => 0.4887, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.14% (0.8317 => 0.8495, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.13% (0.9069 => 0.9262, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.13% (0.9074 => 0.9267, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.12% (0.8050 => 0.8221, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.10% (0.6227 => 0.6358, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.09% (0.8697 => 0.8879, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.04% (0.8518 => 0.8692, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.97% (1.2423 => 1.2668, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.89% (0.8261 => 0.8417, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.87% (0.8805 => 0.8970, std.dev.: 0.0038) MultiSource/Applications/minisat/minisat: 1.84% (0.6834 => 0.6960, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.83% (0.8457 => 0.8612, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.80% (0.8712 => 0.8869, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.78% (0.8716 => 0.8871, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.73% (0.8086 => 0.8226, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.73% (0.8204 => 0.8346, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.73% (0.8286 => 0.8429, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.70% (0.8066 => 0.8203, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.65% (0.8656 => 0.8799, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.57% (0.8338 => 0.8469, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.56% (0.8420 => 0.8551, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: 1.53% (31.8598 => 32.3479, std.dev.: 0.1643) MultiSource/Benchmarks/PAQ8p/paq8p: 1.47% (2.3764 => 2.4113, std.dev.: 0.0124) MultiSource/Applications/lambda-0_1_3/lambda: 1.39% (0.7557 => 0.7662, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.33% (0.8927 => 0.9046, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.29% (0.8995 => 0.9111, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.13% (13.1811 => 13.3307, std.dev.: 0.0473) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 127.14% (0.0199 => 0.0452, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/pi: 58.90% (1.5795 => 2.5098, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.14% (2.9753 => 3.4554, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.30% (0.7597 => 0.8759, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.66% (2.7995 => 3.2098, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.64% (5.0261 => 5.6112, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/queens: 7.52% (1.7056 => 1.8338, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.47% (1.1857 => 1.2743, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: 7.13% (1.3037 => 1.3966, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.90% (4.7794 => 5.1090, std.dev.: 0.0085) MultiSource/Applications/SIBsim4/SIBsim4: 6.74% (3.1873 => 3.4021, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.97% (4.9686 => 5.2650, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.82% (4.5327 => 4.7963, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.70% (3.3761 => 3.5348, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.37% (4.9453 => 5.1614, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.30% (6.2275 => 6.4952, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.06% (4.9469 => 5.1478, std.dev.: 0.0517) MultiSource/Applications/hexxagon/hexxagon: 3.87% (14.0064 => 14.5488, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.29% (0.3587 => 0.3705, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.95% (1.2337 => 1.2701, std.dev.: 0.0068) MultiSource/Applications/siod/siod: 2.89% (3.6643 => 3.7701, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.86% (8.2783 => 8.5154, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.84% (11.5690 => 11.8973, std.dev.: 0.0371) SingleSource/Benchmarks/Shootout/lists: 2.73% (7.3375 => 7.5380, std.dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: 2.67% (7.4933 => 7.6936, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.57% (4.8660 => 4.9909, std.dev.: 0.0173) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.11% (4.8362 => 4.9381, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout/ary3: 2.09% (2.0949 => 2.1387, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.01% (1.1365 => 1.1594, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/ReedSolomon: 1.37% (8.5322 => 8.6487, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.29% (3.5679 => 3.6139, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.4647 => 2.4914, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.03% (4.0473 => 4.0888, std.dev.: 0.0108) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.13% (5.4641 => 4.3095, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.56% (7.2130 => 6.3792, std.dev.: 0.0746) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.45% (1.0512 => 0.9308, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/chomp: -10.53% (1.1216 => 1.0035, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: -8.49% (63.1822 => 57.8202, std.dev.: 0.0595) SingleSource/Benchmarks/Shootout/heapsort: -7.76% (3.2926 => 3.0372, std.dev.: 0.0641) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.86% (4.7482 => 4.4224, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: -6.85% (21.9654 => 20.4614, std.dev.: 0.5459) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.36% (0.3269 => 0.3061, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.04% (3.7148 => 3.4904, std.dev.: 0.0331) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.85% (5.4972 => 5.1755, std.dev.: 0.1146) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.67% (3.9188 => 3.6967, std.dev.: 0.0634) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.21% (5.1557 => 4.8872, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.38% (4.7449 => 4.5371, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.79% (6.0224 => 5.7943, std.dev.: 0.0165) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.25% (0.5807 => 0.5618, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bisort/bisort: -3.07% (0.6636 => 0.6432, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.05% (28.5821 => 27.7092, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C++/life/life: -3.02% (2.6356 => 2.5559, std.dev.: 0.0190) MultiSource/Benchmarks/FreeBench/mason/mason: -2.84% (0.5415 => 0.5261, std.dev.: 0.0042) MultiSource/Applications/aha/aha: -2.34% (3.3398 => 3.2616, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash2: -2.32% (3.4237 => 3.3444, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.17% (1.2822 => 1.2544, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.95% (11.5316 => 11.3072, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.69% (9.9065 => 9.7386, std.dev.: 0.0594) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.56% (4.9994 => 4.9215, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.33% (2.3487 => 2.3174, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.31% (5.6343 => 5.5606, std.dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.75% (16.4461 => 16.7342, std.dev.: 0.0502) MultiSource/Applications/obsequi/Obsequi: 1.95% (1.0262 => 1.0462, std.dev.: 0.0107) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6829.04% (0.3123 => 21.6394, std.dev.: 0.1723) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.13% (0.2463 => 0.3673, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 0.92% (0.6010 => 0.6065, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.79% (0.3266 => 0.3357, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 2.08% (0.1969 => 0.2010, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 22.76% (0.0123 => 0.0151, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.94% (0.0254 => 0.0264, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0051) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -10.16% (0.0384 => 0.0345, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0190 => 0.0190, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/test1: 3.89% (0.0180 => 0.0187, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 1.39% (0.1438 => 0.1458, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 4.80% (1.1329 => 1.1873, std.dev.: 0.0072) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -5.20% (0.1462 => 0.1386, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.09% (0.4164 => 0.4077, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.41% (0.1369 => 0.1402, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.18% (0.0641 => 0.0595, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 9.23% (0.0195 => 0.0213, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.77% (0.0578 => 0.0594, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.33% (1.1437 => 1.1932, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1300.00% (0.0001 => 0.0014, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.64% (0.0627 => 0.0554, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.00% (0.0180 => 0.0171, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.83% (0.8017 => 0.7790, std.dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 16.13% (0.0062 => 0.0072, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 10 20:36:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 10 Nov 2012 22:36:24 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121111043624.285922A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5755?compare_to=5750&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5755, Order: 167679, Start Time: 2012-11-11 01:20:43, End Time: 2012-11-11 04:36:37 To: 5750, Order: 167678, Start Time: 2012-11-10 20:16:55, End Time: 2012-11-10 23:32:50 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (176 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1039 (715 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.50% (0.2134 => 0.2294, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.96% (16.4047 => 16.8910, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.43% (54.1333 => 54.9075, std.dev.: 0.0250) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 44.00% (0.0625 => 0.0900, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.34% (0.1063 => 0.1428, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.83% (0.4253 => 0.5394, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.57% (0.2969 => 0.3758, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.40% (0.1106 => 0.1398, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 25.99% (1.5932 => 2.0072, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.39% (0.4139 => 0.5190, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.21% (0.0714 => 0.0894, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.81% (0.4994 => 0.6233, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 24.75% (0.1107 => 0.1381, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.21% (0.0475 => 0.0590, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.10% (0.5900 => 0.7322, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.84% (0.5000 => 0.6192, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.77% (0.0547 => 0.0677, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.46% (0.0584 => 0.0721, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.15% (0.1620 => 0.1995, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.92% (0.1021 => 0.1255, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 22.37% (0.0599 => 0.0733, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.19% (0.0897 => 0.1096, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.96% (0.0642 => 0.0783, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 21.84% (0.0948 => 0.1155, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.64% (0.0633 => 0.0770, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.58% (0.0584 => 0.0710, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.40% (0.1103 => 0.1339, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: 21.32% (0.0821 => 0.0996, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.29% (0.0822 => 0.0997, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.07% (0.0541 => 0.0655, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.01% (0.0495 => 0.0599, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 20.83% (0.0605 => 0.0731, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 20.82% (0.1619 => 0.1956, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.74% (0.1003 => 0.1211, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.72% (0.1549 => 0.1870, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 20.70% (0.0604 => 0.0729, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.65% (0.3903 => 0.4709, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.45% (0.1604 => 0.1932, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 19.85% (0.0947 => 0.1135, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/Hello: 19.65% (0.5826 => 0.6971, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.56% (0.1462 => 0.1748, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 19.55% (0.0808 => 0.0966, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 19.51% (0.5889 => 0.7038, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.33% (0.3890 => 0.4642, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.27% (0.2014 => 0.2402, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 19.21% (0.1218 => 0.1452, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.19% (0.2736 => 0.3261, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 19.16% (0.4029 => 0.4801, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.92% (1.3152 => 1.5641, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.57% (0.1088 => 0.1290, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 18.42% (0.0581 => 0.0688, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 18.41% (0.1505 => 0.1782, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.36% (0.0572 => 0.0677, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/mst/mst: 18.34% (0.0698 => 0.0826, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 18.21% (0.9697 => 1.1463, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.18% (0.2866 => 0.3387, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 18.06% (1.8794 => 2.2188, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.03% (3.5627 => 4.2049, std.dev.: 0.0046) MultiSource/Applications/Burg/burg: 17.99% (0.5546 => 0.6544, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.98% (0.2875 => 0.3392, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.98% (0.0573 => 0.0676, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 17.96% (0.7171 => 0.8459, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.86% (0.2738 => 0.3227, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.85% (0.5026 => 0.5923, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.73% (0.1968 => 0.2317, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.70% (1.6211 => 1.9081, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.65% (0.4658 => 0.5480, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.33% (0.1160 => 0.1361, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 17.33% (1.0781 => 1.2649, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hello: 17.24% (0.2714 => 0.3182, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.18% (0.3271 => 0.3833, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 17.17% (0.2725 => 0.3193, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 17.17% (0.1421 => 0.1665, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 17.16% (0.2750 => 0.3222, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.15% (0.2729 => 0.3197, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: 16.98% (0.2780 => 0.3252, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 16.95% (0.2803 => 0.3278, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 16.94% (0.3004 => 0.3513, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.91% (0.2792 => 0.3264, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 16.89% (0.2813 => 0.3288, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.86% (0.3060 => 0.3576, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 16.86% (0.2811 => 0.3285, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 16.86% (0.2823 => 0.3299, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.85% (2.7292 => 3.1892, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.83% (0.4361 => 0.5095, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.82% (0.3930 => 0.4591, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.81% (0.3195 => 0.3732, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.76% (0.2911 => 0.3399, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 16.74% (0.1284 => 0.1499, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 16.73% (0.9909 => 1.1567, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wc: 16.73% (0.3096 => 0.3614, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 16.72% (4.2109 => 4.9150, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.64% (2.0673 => 2.4113, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.63% (4.4195 => 5.1546, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: 16.28% (0.3267 => 0.3799, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.27% (1.9694 => 2.2899, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.24% (0.1090 => 0.1267, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 16.08% (0.3258 => 0.3782, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 15.92% (0.3317 => 0.3845, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.88% (0.3362 => 0.3896, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.81% (1.9966 => 2.3123, std.dev.: 0.0064) MultiSource/Benchmarks/Bullet/bullet: 15.65% (23.5202 => 27.2000, std.dev.: 0.0187) SingleSource/Benchmarks/Shootout-C++/moments: 15.58% (0.3678 => 0.4251, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.46% (0.3124 => 0.3607, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: 15.30% (0.3496 => 0.4031, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 15.29% (0.3348 => 0.3860, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 15.28% (0.2075 => 0.2392, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.27% (0.3845 => 0.4432, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.27% (0.3282 => 0.3783, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 15.24% (0.3726 => 0.4294, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 15.24% (0.4146 => 0.4778, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 15.21% (0.3446 => 0.3970, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 15.19% (0.3477 => 0.4005, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.17% (0.3488 => 0.4017, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 15.15% (0.3465 => 0.3990, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 15.14% (0.3460 => 0.3984, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 15.12% (0.2566 => 0.2954, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: 15.11% (0.3442 => 0.3962, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 15.11% (0.3469 => 0.3993, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.95% (0.3625 => 0.4167, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 14.93% (1.4269 => 1.6399, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 14.80% (0.4251 => 0.4880, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 14.77% (0.3724 => 0.4274, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 14.77% (0.3643 => 0.4181, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 14.77% (0.3650 => 0.4189, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.69% (0.3690 => 0.4232, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.67% (0.3981 => 0.4565, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 14.67% (0.7875 => 0.9030, std.dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 14.47% (2.1653 => 2.4786, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 14.37% (2.1013 => 2.4033, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 14.01% (0.5012 => 0.5714, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 13.98% (0.0758 => 0.0864, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 13.92% (4.6177 => 5.2606, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.88% (0.1383 => 0.1575, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 13.34% (0.2691 => 0.3050, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.19% (0.2040 => 0.2309, std.dev.: 0.0084) MultiSource/Applications/SPASS/SPASS: 12.88% (5.5417 => 6.2554, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.59% (0.6435 => 0.7245, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 12.18% (0.6634 => 0.7442, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 11.92% (0.3498 => 0.3915, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.87% (0.1028 => 0.1150, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.70% (0.2068 => 0.2310, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 11.68% (0.4847 => 0.5413, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.66% (0.2737 => 0.3056, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.32% (0.3084 => 0.3433, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 10.79% (0.3336 => 0.3696, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 10.79% (0.2391 => 0.2649, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 10.70% (2.0346 => 2.2524, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.46% (0.2103 => 0.2323, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.37% (4.6926 => 5.1322, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.29% (0.5361 => 0.5859, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.19% (11.6398 => 12.7097, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.87% (0.7426 => 0.8085, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.81% (0.5584 => 0.6076, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 7.55% (11.9555 => 12.8581, std.dev.: 0.0151) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.78% (0.3792 => 0.4011, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 8.11% (0.2122 => 0.2294, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 6.92% (0.2802 => 0.2996, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6110, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.42% (0.3693 => 0.3930, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.23% (12.0509 => 12.6815, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1673, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/flops-2: 4.53% (1.8057 => 1.8875, std.dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/dry: 4.28% (14.0481 => 14.6493, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1912, std.dev.: 0.0078) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.68% (3.1722 => 3.2256, std.dev.: 0.0036) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3039, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2885, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5901, std.dev.: 0.0192) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.73% (25.4195 => 16.5917, std.dev.: 0.0080) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9778, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7937, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9572, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: -6.45% (0.2402 => 0.2247, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8004, std.dev.: 0.0020) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7750, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -2.37% (17.2379 => 16.8301, std.dev.: 0.0083) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.20% (41.7953 => 40.8752, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.07% (0.6293 => 0.6163, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5802, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4953, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1641, std.dev.: 0.0475) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0446, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 10 21:56:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 10 Nov 2012 23:56:43 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121111055643.AE9CE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5756?compare_to=5753&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5756, Order: 167682, Start Time: 2012-11-11 04:31:55, End Time: 2012-11-11 05:56:56 To: 5753, Order: 167680, Start Time: 2012-11-11 02:43:48, End Time: 2012-11-11 04:08:50 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (182 on baseline) Unchanged Tests: 1042 (855 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.30% (54.5751 => 56.3755, std.dev.: 0.1811) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1008, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/salsa20: 2.39% (7.4937 => 7.6731, std.dev.: 0.0203) SingleSource/Benchmarks/Shootout-C++/hash2: 2.04% (3.1932 => 3.2582, std.dev.: 0.0110) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.75% (0.3821 => 0.3525, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.58% (2.4924 => 2.3034, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: -6.85% (0.3357 => 0.3127, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.84% (0.2428 => 0.2262, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.75% (0.3142 => 0.2930, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.66% (3.5339 => 3.2984, std.dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.45% (22.4056 => 20.9600, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.44% (1.0544 => 0.9865, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.40% (0.3658 => 0.3424, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -6.39% (16.1920 => 15.1568, std.dev.: 0.0162) MultiSource/Applications/JM/ldecod/ldecod: -6.39% (7.0961 => 6.6428, std.dev.: 0.0087) MultiSource/Benchmarks/mafft/pairlocalalign: -6.38% (9.2283 => 8.6394, std.dev.: 0.0043) MultiSource/Applications/Burg/burg: -6.30% (1.2515 => 1.1726, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.29% (0.6484 => 0.6076, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.26% (0.9852 => 0.9235, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -6.26% (4.3330 => 4.0619, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.24% (0.1796 => 0.1684, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -6.23% (0.1879 => 0.1762, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.22% (1.3722 => 1.2869, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/football/football: -6.21% (0.9179 => 0.8609, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.17% (1.6364 => 1.5354, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.14% (1.4642 => 1.3743, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.13% (0.1761 => 0.1653, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.12% (0.1716 => 0.1611, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -6.11% (1.1450 => 1.0750, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.11% (1.2784 => 1.2003, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.06% (1.2300 => 1.1555, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.05% (0.6293 => 0.5912, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.05% (4.0323 => 3.7883, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.05% (4.5069 => 4.2343, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/oourafft: -6.02% (0.2160 => 0.2030, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: -6.02% (0.2659 => 0.2499, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -6.01% (1.1530 => 1.0837, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.99% (0.2355 => 0.2214, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.97% (0.4151 => 0.3903, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.97% (0.8521 => 0.8012, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.97% (0.3483 => 0.3275, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -5.96% (0.2985 => 0.2807, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.96% (0.3406 => 0.3203, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: -5.95% (0.3812 => 0.3585, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.94% (0.7919 => 0.7449, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.93% (4.8161 => 4.5304, std.dev.: 0.0067) MultiSource/Applications/SPASS/SPASS: -5.93% (15.5079 => 14.5885, std.dev.: 0.0118) SingleSource/UnitTests/ObjC/exceptions-4: -5.93% (0.3880 => 0.3650, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.91% (4.8802 => 4.5920, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-2: -5.90% (0.3831 => 0.3605, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -5.90% (2.4021 => 2.2604, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/synchronized: -5.88% (0.3896 => 0.3667, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.87% (0.9542 => 0.8982, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -5.85% (4.0594 => 3.8220, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.84% (6.7716 => 6.3759, std.dev.: 0.0093) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.83% (0.3891 => 0.3664, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.83% (1.6474 => 1.5513, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.82% (5.4682 => 5.1497, std.dev.: 0.0124) SingleSource/UnitTests/ObjC/exceptions: -5.82% (0.4176 => 0.3933, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.81% (0.2548 => 0.2400, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.81% (0.7198 => 0.6780, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.80% (0.6052 => 0.5701, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -5.80% (0.3848 => 0.3625, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.79% (0.3884 => 0.3659, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.79% (0.2695 => 0.2539, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.79% (14.2083 => 13.3863, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: -5.78% (17.1032 => 16.1150, std.dev.: 0.0152) MultiSource/Applications/minisat/minisat: -5.76% (0.7447 => 0.7018, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -5.76% (0.4861 => 0.4581, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -5.75% (0.3581 => 0.3375, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -5.75% (0.4033 => 0.3801, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.75% (0.6681 => 0.6297, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.75% (0.6736 => 0.6349, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -5.74% (1.3148 => 1.2393, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.73% (0.5859 => 0.5523, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.73% (0.5999 => 0.5655, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.73% (0.3837 => 0.3617, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.72% (0.5857 => 0.5522, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.72% (0.5805 => 0.5473, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: -5.72% (0.4199 => 0.3959, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: -5.71% (0.3255 => 0.3069, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.71% (0.5591 => 0.5272, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.70% (0.3016 => 0.2844, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.70% (0.7339 => 0.6921, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.69% (0.4813 => 0.4539, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: -5.69% (0.2989 => 0.2819, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.68% (0.5863 => 0.5530, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.68% (0.6304 => 0.5946, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.65% (2.2587 => 2.1310, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: -5.65% (0.3026 => 0.2855, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.65% (2.1713 => 2.0486, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.64% (0.7524 => 0.7100, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.63% (0.5575 => 0.5261, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -5.63% (0.3394 => 0.3203, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -5.63% (1.3864 => 1.3084, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.62% (0.5925 => 0.5592, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.61% (0.7021 => 0.6627, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.61% (0.5705 => 0.5385, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.60% (0.6676 => 0.6302, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: -5.60% (0.3446 => 0.3253, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.60% (0.6446 => 0.6085, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -5.59% (0.3025 => 0.2856, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.59% (0.5478 => 0.5172, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.59% (0.6660 => 0.6288, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.58% (0.2278 => 0.2151, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.57% (0.4916 => 0.4642, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: -5.56% (0.4280 => 0.4042, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -5.56% (0.4515 => 0.4264, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: -5.56% (3.5154 => 3.3200, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/ary2: -5.54% (0.3481 => 0.3288, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.54% (0.5849 => 0.5525, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.54% (0.5581 => 0.5272, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.53% (0.5168 => 0.4882, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists: -5.52% (0.3621 => 0.3421, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.52% (0.5329 => 0.5035, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.51% (0.9557 => 0.9030, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -5.51% (0.4248 => 0.4014, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.50% (0.6395 => 0.6043, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.50% (0.5802 => 0.5483, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.49% (0.6194 => 0.5854, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.47% (0.6230 => 0.5889, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.47% (0.6395 => 0.6045, std.dev.: 0.0126) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.45% (0.2385 => 0.2255, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -5.45% (0.3194 => 0.3020, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.45% (0.6260 => 0.5919, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.44% (0.4427 => 0.4186, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.44% (8.0126 => 7.5766, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.44% (0.2999 => 0.2836, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.43% (0.6440 => 0.6090, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.43% (0.5456 => 0.5160, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.42% (0.5567 => 0.5265, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -5.41% (0.3788 => 0.3583, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.41% (0.2903 => 0.2746, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.40% (0.5570 => 0.5269, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.40% (0.6297 => 0.5957, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: -5.39% (18.2933 => 17.3069, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.39% (0.4083 => 0.3863, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.39% (0.6033 => 0.5708, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.38% (1.2210 => 1.1553, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: -5.37% (2.1401 => 2.0251, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.37% (0.5569 => 0.5270, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.35% (0.6667 => 0.6310, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/lists1: -5.35% (0.3867 => 0.3660, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.34% (0.5688 => 0.5384, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -5.34% (15.2527 => 14.4388, std.dev.: 0.0134) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.33% (0.3319 => 0.3142, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.33% (0.6189 => 0.5859, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.33% (0.3057 => 0.2894, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.33% (0.2871 => 0.2718, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.32% (0.5941 => 0.5625, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.31% (1.2221 => 1.1572, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/random: -5.31% (0.2939 => 0.2783, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -5.30% (0.3059 => 0.2897, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.27% (0.3849 => 0.3646, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -5.27% (0.3205 => 0.3036, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.26% (0.3252 => 0.3081, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.23% (0.4321 => 0.4095, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.22% (0.2933 => 0.2780, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -5.20% (0.6750 => 0.6399, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -5.20% (0.7982 => 0.7567, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.18% (0.3491 => 0.3310, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.13% (0.2106 => 0.1998, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: -5.12% (0.2849 => 0.2703, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.11% (0.3931 => 0.3730, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -5.11% (34.0927 => 32.3500, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/09-vor/vor: -5.11% (0.3271 => 0.3104, std.dev.: 0.0043) MultiSource/Applications/spiff/spiff: -5.05% (0.8418 => 0.7993, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: -4.97% (0.4524 => 0.4299, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -4.87% (5.0226 => 4.7779, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.85% (0.3323 => 0.3162, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.60% (0.7779 => 0.7421, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.58% (0.9077 => 0.8661, std.dev.: 0.0027) MultiSource/Applications/hbd/hbd: -4.22% (1.5610 => 1.4951, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: -4.08% (0.6347 => 0.6088, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -3.83% (0.6441 => 0.6194, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.70% (20.7746 => 20.2128, std.dev.: 0.0336) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7573, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/richards_benchmark: -8.68% (1.2842 => 1.1727, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.90% (2.2633 => 2.1750, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.48% (6.5735 => 6.4763, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.38% (1.3096 => 1.2915, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 10 22:09:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 11 Nov 2012 00:09:50 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121111060950.3A3022A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5757?compare_to=5754&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5757, Order: 167682, Start Time: 2012-11-11 04:41:49, End Time: 2012-11-11 06:09:14 To: 5754, Order: 167680, Start Time: 2012-11-11 02:58:39, End Time: 2012-11-11 04:24:58 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 37 (106 on baseline) Performance Improvements: 0 (23 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 954 (845 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 16.58% (0.0754 => 0.0879, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 13.74% (0.4658 => 0.5298, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.58% (0.5868 => 0.6430, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 7.87% (0.6230 => 0.6720, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.62% (0.3334 => 0.3588, std.dev.: 0.0047) MultiSource/Benchmarks/Fhourstones/fhourstones: 6.45% (0.1550 => 0.1650, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.43% (0.3002 => 0.3195, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.92% (0.1961 => 0.2077, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.86% (0.8536 => 0.9036, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.09% (0.6055 => 0.6363, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.05% (1.3115 => 1.3777, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.73% (1.1676 => 1.2228, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.12% (0.7696 => 0.8013, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.97% (0.9392 => 0.9765, std.dev.: 0.0097) MultiSource/Benchmarks/MallocBench/gs/gs: 3.72% (4.1673 => 4.3222, std.dev.: 0.0393) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.60% (0.5856 => 0.6067, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.52% (0.9005 => 0.9232, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.42% (1.2640 => 1.2946, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.14% (8.6956 => 8.8817, std.dev.: 0.0500) SingleSource/UnitTests/Vector/constpool: 2.11% (8.3633 => 8.5400, std.dev.: 0.0495) MultiSource/Applications/siod/siod: 2.06% (2.2679 => 2.3147, std.dev.: 0.0080) MultiSource/Applications/minisat/minisat: 2.00% (0.6960 => 0.7099, std.dev.: 0.0035) MultiSource/Applications/oggenc/oggenc: 1.97% (5.0426 => 5.1420, std.dev.: 0.0211) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.97% (4.2101 => 4.2929, std.dev.: 0.0304) MultiSource/Applications/d/make_dparser: 1.91% (3.3144 => 3.3777, std.dev.: 0.0236) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.80% (1.1935 => 1.2150, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.68% (0.8469 => 0.8611, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 1.53% (0.9959 => 1.0111, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.51% (0.9267 => 0.9407, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.36% (0.9193 => 0.9318, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.22% (0.8829 => 0.8937, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.08% (0.9889 => 0.9996, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.47% (2.4359 => 2.5936, std.dev.: 0.0368) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.46% (3.6967 => 3.9355, std.dev.: 0.0742) MultiSource/Applications/minisat/minisat: 2.84% (6.1554 => 6.3305, std.dev.: 0.0625) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.70% (3.1589 => 3.2125, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/methcall: 1.46% (8.8725 => 9.0020, std.dev.: 0.0131) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.50% (16.7342 => 16.9851, std.dev.: 0.1348) MultiSource/Applications/obsequi/Obsequi: 1.65% (1.0462 => 1.0635, std.dev.: 0.0154) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.10% (21.6394 => 21.6617, std.dev.: 0.5184) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.27% (0.3673 => 0.3663, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: -0.21% (0.6065 => 0.6052, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.36% (0.3357 => 0.3345, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 0.75% (0.2010 => 0.2025, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 17.88% (0.0151 => 0.0178, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -11.50% (0.0426 => 0.0377, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.52% (0.0264 => 0.0260, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.64% (0.0313 => 0.0311, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 22.03% (0.0345 => 0.0421, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 16.04% (0.0187 => 0.0217) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -46.15% (0.0013 => 0.0007, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1458 => 0.1456, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.05% (1.1873 => 1.1748, std.dev.: 0.0155) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 5.70% (0.1386 => 0.1465, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.51% (0.4077 => 0.4220, std.dev.: 0.0190) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.07% (0.1402 => 0.1445, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.25% (0.0595 => 0.0656, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 30.05% (0.0213 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.69% (0.0594 => 0.0610, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.10% (1.1932 => 1.1944, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 28.57% (0.0014 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 16.61% (0.0554 => 0.0646, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 54.97% (0.0171 => 0.0265, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.69% (0.7790 => 0.7844, std.dev.: 0.0124) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -31.94% (0.0072 => 0.0049, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2317.80% (0.6332 => 15.3095, std.dev.: 0.2009) MultiSource/Benchmarks/McCat/08-main/main: 49.26% (0.1831 => 0.2733, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.64% (0.1559 => 0.1471, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1486.54% (0.3344 => 5.3054, std.dev.: 0.1009) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.01% (0.2364 => 0.3239, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/mandel: -0.23% (0.0429 => 0.0428, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -11.61% (0.0224 => 0.0198, std.dev.: 0.0018) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0011) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4298, std.dev.: 0.0095) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0716, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4861, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3420, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1414, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4049, std.dev.: 0.0032) SingleSource/Regression/C/uint64_to_float: -23.63% (2.1832 => 1.6674, std.dev.: 0.0010) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.79% (0.0810 => 0.0946, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/tsp/tsp: 13.22% (0.1112 => 0.1259, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.21% (0.0848 => 0.0960, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.29% (0.0830 => 0.0932, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.91% (0.1137 => 0.1261, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.30% (0.4847 => 0.5298, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.03% (0.1905 => 0.2077, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.94% (0.2180 => 0.2375, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.89% (0.3295 => 0.3588, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.59% (0.8321 => 0.9036, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.44% (0.1466 => 0.1575, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.23% (0.7473 => 0.8013, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.99% (0.6010 => 0.6430, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.89% (0.6287 => 0.6720, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.74% (0.5961 => 0.6363, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.71% (0.8148 => 0.8695, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.57% (0.2998 => 0.3195, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.63% (0.3124 => 0.3300, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.32% (0.2519 => 0.2653, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.19% (0.1983 => 0.2086, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: 5.12% (1.2222 => 1.2848, std.dev.: 0.0117) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.11% (0.2133 => 0.2242, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.69% (1.1606 => 1.2150, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.65% (1.1685 => 1.2228, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/gs/gs: 4.64% (4.1305 => 4.3222, std.dev.: 0.0393) MultiSource/Applications/sgefa/sgefa: 4.57% (0.2999 => 0.3136, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.42% (0.8457 => 0.8831, std.dev.: 0.0113) MultiSource/Applications/d/make_dparser: 4.36% (3.2366 => 3.3777, std.dev.: 0.0236) MultiSource/Applications/siod/siod: 4.34% (2.2184 => 2.3147, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.30% (0.5817 => 0.6067, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.01% (0.2741 => 0.2851, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.95% (0.8597 => 0.8937, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 3.91% (0.8885 => 0.9232, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: 3.90% (0.7950 => 0.8260, std.dev.: 0.0086) MultiSource/Applications/minisat/minisat: 3.88% (0.6834 => 0.7099, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.75% (1.3279 => 1.3777, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.67% (0.9074 => 0.9407, std.dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: 3.61% (4.9628 => 5.1420, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.58% (0.8611 => 0.8919, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.51% (0.4127 => 0.4272, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.50% (0.9435 => 0.9765, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.35% (1.2526 => 1.2946, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.31% (0.8697 => 0.8985, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.27% (0.8338 => 0.8611, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.18% (0.9688 => 0.9996, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.09% (0.9039 => 0.9318, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 3.07% (0.9810 => 1.0111, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.93% (0.8518 => 0.8768, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/football/football: 2.87% (0.8768 => 0.9020, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.79% (4.1763 => 4.2929, std.dev.: 0.0304) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.71% (8.6476 => 8.8817, std.dev.: 0.0500) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.68% (6.6074 => 6.7847, std.dev.: 0.0628) MultiSource/Benchmarks/nbench/nbench: 2.56% (1.1271 => 1.1560, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.55% (0.6586 => 0.6754, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.51% (0.8359 => 0.8569, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.50% (0.8086 => 0.8288, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.48% (1.2602 => 1.2914, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.37% (0.8995 => 0.9208, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.33% (4.4880 => 4.5927, std.dev.: 0.0362) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.27% (0.8805 => 0.9005, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.26% (0.8656 => 0.8852, std.dev.: 0.0064) MultiSource/Applications/lambda-0_1_3/lambda: 2.25% (0.7557 => 0.7727, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.24% (0.8007 => 0.8186, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.08% (13.1811 => 13.4551, std.dev.: 0.1058) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.06% (0.5191 => 0.5298, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 1.94% (31.8598 => 32.4782, std.dev.: 0.2085) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.93% (0.8340 => 0.8501, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.91% (0.8066 => 0.8220, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: 1.83% (1.0945 => 1.1145, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 94.97% (0.0199 => 0.0388, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/pi: 57.01% (1.5795 => 2.4799, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.55% (2.9753 => 3.4676, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.87% (0.7597 => 0.8803, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.58% (2.7995 => 3.2078, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.67% (5.0261 => 5.6125, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.69% (6.3772 => 6.9954, std.dev.: 0.1454) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.07% (0.3186 => 0.3443, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.57% (1.1857 => 1.2755, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/queens: 7.19% (1.7056 => 1.8283, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.96% (4.7794 => 5.1119, std.dev.: 0.0342) MultiSource/Applications/SIBsim4/SIBsim4: 6.67% (3.1873 => 3.4000, std.dev.: 0.0467) SingleSource/Benchmarks/Misc/richards_benchmark: 6.57% (1.3037 => 1.3893, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.05% (4.9686 => 5.2690, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.90% (4.5327 => 4.8003, std.dev.: 0.0358) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.74% (3.3761 => 3.5361, std.dev.: 0.0206) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.53% (4.9453 => 5.1691, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.11% (4.9469 => 5.1503, std.dev.: 0.0068) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.94% (1.2337 => 1.2823, std.dev.: 0.0182) MultiSource/Applications/hexxagon/hexxagon: 3.90% (14.0064 => 14.5525, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.68% (6.2275 => 6.4569, std.dev.: 0.0574) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.41% (44.5605 => 46.0810, std.dev.: 0.5475) MultiSource/Applications/siod/siod: 2.90% (3.6643 => 3.7704, std.dev.: 0.0117) MultiSource/Applications/minisat/minisat: 2.89% (6.1525 => 6.3305, std.dev.: 0.0625) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.74% (11.5690 => 11.8856, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 2.74% (7.4933 => 7.6983, std.dev.: 0.0410) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.66% (8.2783 => 8.4981, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/dry: 2.34% (0.5081 => 0.5200, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.23% (4.8660 => 4.9744, std.dev.: 0.0263) SingleSource/Benchmarks/Shootout/lists: 2.21% (7.3375 => 7.4994, std.dev.: 0.0118) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.08% (1.1365 => 1.1601, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/power/power: 1.48% (1.2061 => 1.2239, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.35% (1.5941 => 1.6157, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/ReedSolomon: 1.34% (8.5322 => 8.6465, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.23% (4.4340 => 4.4887, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.14% (3.5679 => 3.6084, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: 1.09% (1.0841 => 1.0959, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.59% (5.4641 => 4.3388, std.dev.: 0.0378) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -15.70% (7.2130 => 6.0806, std.dev.: 0.2991) SingleSource/Benchmarks/McGill/chomp: -10.73% (1.1216 => 1.0012, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.68% (1.0512 => 0.9389, std.dev.: 0.0277) MultiSource/Benchmarks/mafft/pairlocalalign: -8.55% (63.1822 => 57.7797, std.dev.: 0.1006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.97% (4.7482 => 4.4174, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.33% (0.3269 => 0.3062, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.14% (3.7148 => 3.4868, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.32% (5.4972 => 5.2050, std.dev.: 0.0527) MultiSource/Benchmarks/VersaBench/bmm/bmm: -5.04% (2.8773 => 2.7324, std.dev.: 0.0364) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.95% (5.1557 => 4.9004, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.27% (4.7449 => 4.5422, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.60% (6.0224 => 5.8055, std.dev.: 0.0119) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.21% (2.4490 => 2.3705, std.dev.: 0.0243) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.12% (0.5807 => 0.5626, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (28.5821 => 27.6936, std.dev.: 0.0606) SingleSource/Benchmarks/Shootout-C++/hash2: -2.26% (3.4237 => 3.3464, std.dev.: 0.0016) MultiSource/Applications/aha/aha: -2.11% (3.3398 => 3.2693, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.03% (11.5316 => 11.2970, std.dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.02% (2.6356 => 2.5823, std.dev.: 0.0203) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.61% (2.3487 => 2.3108, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.59% (4.9994 => 4.9199, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.21% (5.6343 => 5.5663, std.dev.: 0.0073) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 3.28% (16.4461 => 16.9851, std.dev.: 0.1348) MultiSource/Applications/obsequi/Obsequi: 3.63% (1.0262 => 1.0635, std.dev.: 0.0154) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6836.18% (0.3123 => 21.6617, std.dev.: 0.5184) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.72% (0.2463 => 0.3663, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 0.70% (0.6010 => 0.6052, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.42% (0.3266 => 0.3345, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 2.84% (0.1969 => 0.2025, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 44.72% (0.0123 => 0.0178, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -7.60% (0.0408 => 0.0377, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 2.36% (0.0254 => 0.0260, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.98% (0.0302 => 0.0311, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.64% (0.0384 => 0.0421, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0007 => 0.0007, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.25% (0.1438 => 0.1456, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 3.70% (1.1329 => 1.1748, std.dev.: 0.0155) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.21% (0.1462 => 0.1465, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.34% (0.4164 => 0.4220, std.dev.: 0.0190) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.55% (0.1369 => 0.1445, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.34% (0.0641 => 0.0656, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.54% (0.0578 => 0.0610, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.43% (1.1437 => 1.1944, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1700.00% (0.0001 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.03% (0.0627 => 0.0646, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.22% (0.0180 => 0.0265, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.16% (0.8017 => 0.7844, std.dev.: 0.0124) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -20.97% (0.0062 => 0.0049, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 10 23:45:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 11 Nov 2012 01:45:08 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121111074508.8B53D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5758?compare_to=5756&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5758, Order: 167685, Start Time: 2012-11-11 06:20:23, End Time: 2012-11-11 07:45:21 To: 5756, Order: 167682, Start Time: 2012-11-11 04:31:55, End Time: 2012-11-11 05:56:56 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (183 on baseline) Unchanged Tests: 1042 (855 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.57% (2.0478 => 2.1210, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4937 => 7.6764, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/hash2: 2.00% (3.1932 => 3.2571, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.83% (0.3821 => 0.3522, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -7.72% (2.4924 => 2.3001, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: -6.88% (0.3357 => 0.3126, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.88% (0.2428 => 0.2261, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.87% (0.3142 => 0.2926, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.81% (3.5339 => 3.2934, std.dev.: 0.0069) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.54% (22.4056 => 20.9413, std.dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.51% (0.3658 => 0.3420, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.45% (0.9852 => 0.9217, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.42% (1.0544 => 0.9867, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: -6.42% (7.0961 => 6.6408, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: -6.40% (9.2283 => 8.6374, std.dev.: 0.0053) MultiSource/Applications/JM/lencod/lencod: -6.39% (16.1920 => 15.1572, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/oourafft: -6.39% (0.2160 => 0.2022, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.37% (0.6484 => 0.6071, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: -6.35% (4.3330 => 4.0577, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.35% (0.1796 => 0.1682, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.31% (0.1584 => 0.1484, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.28% (0.2355 => 0.2207, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: -6.28% (0.1879 => 0.1761, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.26% (1.2300 => 1.1530, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: -6.25% (0.9179 => 0.8605, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -6.25% (1.2515 => 1.1733, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -6.25% (0.1761 => 0.1651, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.24% (0.4151 => 0.3892, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.22% (1.3722 => 1.2868, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.14% (1.2784 => 1.1999, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.12% (0.1716 => 0.1611, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.11% (1.4642 => 1.3747, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.11% (1.6364 => 1.5364, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -6.10% (0.2985 => 0.2803, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: -6.09% (0.3812 => 0.3580, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -6.07% (1.1450 => 1.0755, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.06% (4.5069 => 4.2339, std.dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: -6.05% (1.1530 => 1.0832, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.05% (0.7919 => 0.7440, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.05% (0.2695 => 0.2532, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.05% (0.4813 => 0.4522, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: -6.01% (0.3026 => 0.2844, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: -6.01% (1.3148 => 1.2358, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.01% (0.6293 => 0.5915, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -6.00% (0.3831 => 0.3601, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.00% (0.3016 => 0.2835, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.99% (0.9542 => 0.8970, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -5.98% (0.2659 => 0.2500, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.98% (0.3880 => 0.3648, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.98% (4.8161 => 4.5283, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -5.97% (0.4861 => 0.4571, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.96% (0.3891 => 0.3659, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.96% (0.3406 => 0.3203, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -5.96% (0.2989 => 0.2811, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -5.95% (0.4033 => 0.3793, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.95% (4.8802 => 4.5899, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.94% (0.3483 => 0.3276, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.94% (0.3837 => 0.3609, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.94% (4.0323 => 3.7927, std.dev.: 0.0130) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.94% (6.7716 => 6.3693, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.94% (0.6736 => 0.6336, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.93% (0.2548 => 0.2397, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -5.93% (0.3848 => 0.3620, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.90% (0.7198 => 0.6773, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -5.90% (0.3896 => 0.3666, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: -5.89% (15.5079 => 14.5950, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.88% (0.5478 => 0.5156, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.87% (1.6474 => 1.5507, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: -5.87% (0.4176 => 0.3931, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.86% (2.1713 => 2.0440, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -5.86% (0.3446 => 0.3244, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -5.84% (0.3581 => 0.3372, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.83% (0.6676 => 0.6287, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.82% (0.5925 => 0.5580, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.82% (0.6667 => 0.6279, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.82% (0.5999 => 0.5650, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.81% (0.6260 => 0.5896, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -5.81% (0.4248 => 0.4001, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: -5.81% (0.3255 => 0.3066, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.80% (0.6395 => 0.6024, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.80% (0.5863 => 0.5523, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.79% (0.7524 => 0.7088, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.79% (0.3884 => 0.3659, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.79% (0.5456 => 0.5140, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.78% (0.6681 => 0.6295, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.78% (0.7339 => 0.6915, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.78% (0.5591 => 0.5268, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.77% (0.8521 => 0.8029, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.77% (0.6660 => 0.6276, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.76% (5.4682 => 5.1532, std.dev.: 0.0097) MultiSource/Applications/minisat/minisat: -5.75% (0.7447 => 0.7019, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: -5.74% (0.4199 => 0.3958, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.74% (0.4427 => 0.4173, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.72% (0.4916 => 0.4635, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: -5.72% (0.3394 => 0.3200, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.71% (0.6230 => 0.5874, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -5.70% (2.4021 => 2.2651, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.70% (0.5805 => 0.5474, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.70% (14.2083 => 13.3984, std.dev.: 0.0124) MultiSource/Applications/sqlite3/sqlite3: -5.70% (17.1032 => 16.1283, std.dev.: 0.0201) MultiSource/Applications/lua/lua: -5.70% (4.0594 => 3.8282, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.69% (0.6304 => 0.5945, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.69% (0.5849 => 0.5516, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: -5.69% (0.3059 => 0.2885, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -5.69% (0.3481 => 0.3283, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.69% (0.6189 => 0.5837, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -5.68% (0.3788 => 0.3573, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.67% (0.5857 => 0.5525, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -5.66% (0.3867 => 0.3648, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.66% (0.5581 => 0.5265, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.66% (0.9557 => 0.9016, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.66% (0.3323 => 0.3135, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.65% (0.6194 => 0.5844, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.65% (0.2903 => 0.2739, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.64% (0.3849 => 0.3632, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.63% (0.6052 => 0.5711, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -5.63% (0.3621 => 0.3417, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -5.63% (0.4280 => 0.4039, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.63% (0.3057 => 0.2885, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.62% (0.5569 => 0.5256, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: -5.62% (0.3025 => 0.2855, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.61% (0.2939 => 0.2774, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.61% (0.5168 => 0.4878, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.61% (0.5705 => 0.5385, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -5.60% (3.5154 => 3.3185, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.59% (0.6440 => 0.6080, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.59% (1.3864 => 1.3089, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.58% (0.5802 => 0.5478, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.58% (0.5575 => 0.5264, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.57% (0.5941 => 0.5610, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.57% (0.7021 => 0.6630, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.57% (0.3252 => 0.3071, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.56% (0.5859 => 0.5533, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: -5.56% (0.4515 => 0.4264, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.55% (2.2587 => 2.1333, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.54% (0.6395 => 0.6041, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.54% (0.2999 => 0.2833, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.54% (0.4083 => 0.3857, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.53% (0.2385 => 0.2253, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -5.53% (0.4524 => 0.4274, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.52% (0.6446 => 0.6090, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.52% (0.5688 => 0.5374, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.51% (1.2221 => 1.1548, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: -5.50% (0.2871 => 0.2713, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.50% (0.6033 => 0.5701, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.50% (0.3491 => 0.3299, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.49% (0.2933 => 0.2772, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -5.48% (0.2849 => 0.2693, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.46% (0.6297 => 0.5953, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.46% (0.5567 => 0.5263, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -5.46% (0.3205 => 0.3030, std.dev.: 0.0046) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.45% (0.3319 => 0.3138, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.45% (8.0126 => 7.5760, std.dev.: 0.0073) MultiSource/Applications/kimwitu++/kc: -5.41% (18.2933 => 17.3034, std.dev.: 0.0173) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.40% (0.2278 => 0.2155, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.40% (1.2210 => 1.1551, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.37% (0.3931 => 0.3720, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: -5.36% (2.1401 => 2.0253, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -5.35% (0.6750 => 0.6389, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -5.34% (34.0927 => 32.2715, std.dev.: 0.0222) MultiSource/Applications/lambda-0_1_3/lambda: -5.31% (0.7982 => 0.7558, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -5.31% (15.2527 => 14.4425, std.dev.: 0.0216) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.29% (0.5329 => 0.5047, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.26% (0.5570 => 0.5277, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.26% (0.3194 => 0.3026, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -5.23% (0.3271 => 0.3100, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.18% (0.2106 => 0.1997, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -5.08% (0.8418 => 0.7990, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.02% (0.4321 => 0.4104, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -4.88% (5.0226 => 4.7776, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -4.81% (0.7779 => 0.7405, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: -4.52% (0.6347 => 0.6060, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.48% (0.9077 => 0.8670, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -4.27% (0.6441 => 0.6166, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: -4.04% (1.5610 => 1.4980, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/BoolLiteralTest: -3.52% (0.3834 => 0.3699, std.dev.: 0.0051) SingleSource/UnitTests/Vector/constpool: -2.14% (20.7746 => 20.3305, std.dev.: 0.0192) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7553, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -8.72% (1.2842 => 1.1722, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.96% (2.2633 => 2.1736, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.92% (1.7753 => 1.7057, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4703, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0003) Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 10 23:53:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 11 Nov 2012 01:53:07 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121111075307.B6DD22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5759?compare_to=5757&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5759, Order: 167686, Start Time: 2012-11-11 06:26:48, End Time: 2012-11-11 07:53:20 To: 5757, Order: 167682, Start Time: 2012-11-11 04:41:49, End Time: 2012-11-11 06:09:14 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 6 (102 on baseline) Performance Improvements: 20 (22 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 965 (850 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.48% (0.8442 => 0.8567, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.16% (1.0143 => 1.0464, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.06% (4.3243 => 4.4132, std.dev.: 0.0308) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 1.83% (0.5837 => 0.5944, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.61% (2.7324 => 2.7763, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/pi: 1.36% (2.4799 => 2.5136, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.36% (0.3300 => 0.3189, std.dev.: 0.0018) MultiSource/Applications/siod/siod: -2.58% (2.3147 => 2.2549, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.45% (0.8611 => 0.8400, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: -2.36% (4.3222 => 4.2200, std.dev.: 0.0304) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -2.32% (1.2914 => 1.2614, std.dev.: 0.0069) MultiSource/Applications/oggenc/oggenc: -2.17% (5.1420 => 5.0303, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -2.09% (0.9232 => 0.9039, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: -2.09% (3.3777 => 3.3072, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.82% (0.8831 => 0.8670, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.41% (1.1552 => 1.1389, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.39% (1.5153 => 1.4943, std.dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: -1.35% (0.7727 => 0.7623, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.32% (0.8937 => 0.8819, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.30% (0.9208 => 0.9088, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -6.74% (21.7914 => 20.3226, std.dev.: 0.1469) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.52% (0.9236 => 0.8726, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bisort/bisort: -4.34% (0.6799 => 0.6504, std.dev.: 0.0066) MultiSource/Applications/minisat/minisat: -2.68% (6.3305 => 6.1610, std.dev.: 0.0432) MultiSource/Benchmarks/llubenchmark/llu: -1.73% (2.0253 => 1.9902, std.dev.: 0.0095) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.42% (39.7088 => 39.1454, std.dev.: 0.1921) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -1.51% (16.9851 => 16.7294, std.dev.: 0.1749) MultiSource/Applications/obsequi/Obsequi: 0.43% (1.0635 => 1.0681, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.82% (21.6617 => 21.8390, std.dev.: 0.3193) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.27% (0.3663 => 0.3673, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 0.36% (0.6052 => 0.6074, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.03% (0.3345 => 0.3346, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 1.04% (0.2025 => 0.2046, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 23.60% (0.0178 => 0.0220, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 13.79% (0.0377 => 0.0429, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 27.69% (0.0260 => 0.0332, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.61% (0.0311 => 0.0316, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.24% (0.0421 => 0.0422, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 2.97% (0.0202 => 0.0208, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 3.23% (0.0217 => 0.0224, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1456 => 0.1458, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -2.14% (1.1748 => 1.1497, std.dev.: 0.0298) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.68% (0.1465 => 0.1475, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.88% (0.4220 => 0.4183, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.64% (0.1445 => 0.1378, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.52% (0.0656 => 0.0646, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0277 => 0.0278, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.05% (0.0610 => 0.0567, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.35% (1.1944 => 1.1986, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 72.22% (0.0018 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.31% (0.0646 => 0.0644, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -9.81% (0.0265 => 0.0239, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.47% (0.7844 => 0.7807, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -4.08% (0.0049 => 0.0047, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2306.33% (0.6332 => 15.2369, std.dev.: 0.1314) MultiSource/Benchmarks/McCat/08-main/main: 47.46% (0.1831 => 0.2700, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.22% (0.1559 => 0.1462, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1518.30% (0.3344 => 5.4116, std.dev.: 0.0806) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.48% (0.2364 => 0.3250, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: 3.03% (0.0429 => 0.0442, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.80% (0.0224 => 0.0237, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4282, std.dev.: 0.0119) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0725, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4908, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3568, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1370, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4040, std.dev.: 0.0088) SingleSource/Regression/C/uint64_to_float: -23.69% (2.1832 => 1.6660, std.dev.: 0.0251) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.05% (0.0810 => 0.0940, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: 12.50% (0.1112 => 0.1251, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.15% (0.0848 => 0.0951, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.08% (0.2180 => 0.2378, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.53% (0.8321 => 0.9031, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.59% (0.2279 => 0.2452, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.85% (0.8148 => 0.8706, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/em3d/em3d: 6.62% (0.1721 => 0.1835, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.46% (0.7473 => 0.7956, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.41% (0.6010 => 0.6395, std.dev.: 0.0107) MultiSource/Benchmarks/Fhourstones/fhourstones: 6.30% (0.1588 => 0.1688, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.25% (0.1905 => 0.2024, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.04% (0.4847 => 0.5140, std.dev.: 0.0100) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.89% (0.1885 => 0.1996, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.98% (1.1606 => 1.2184, std.dev.: 0.0090) MultiSource/Applications/Burg/burg: 4.81% (1.2222 => 1.2810, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.39% (1.1685 => 1.2198, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.21% (0.2519 => 0.2625, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.15% (0.6287 => 0.6548, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.89% (0.2774 => 0.2882, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.83% (0.3657 => 0.3797, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.51% (0.4783 => 0.4951, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.38% (0.8611 => 0.8902, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.27% (0.4559 => 0.4708, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.20% (1.4479 => 1.4943, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.13% (4.1763 => 4.3071, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.02% (0.8316 => 0.8567, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.00% (0.8805 => 0.9069, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.89% (0.9688 => 0.9968, std.dev.: 0.0105) MultiSource/Applications/hexxagon/hexxagon: 2.67% (0.9810 => 1.0072, std.dev.: 0.0064) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.63% (6.6074 => 6.7811, std.dev.: 0.0240) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.58% (0.8597 => 0.8819, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.56% (0.8716 => 0.8939, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.52% (0.8457 => 0.8670, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.48% (1.1271 => 1.1551, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.47% (0.8340 => 0.8546, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.46% (0.8048 => 0.8246, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 2.43% (1.2568 => 1.2874, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.43% (0.8066 => 0.8262, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.39% (0.8331 => 0.8530, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.36% (0.8007 => 0.8196, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.32% (0.8050 => 0.8237, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.32% (8.6476 => 8.8484, std.dev.: 0.0322) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.25% (0.9069 => 0.9273, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.24% (0.8286 => 0.8472, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.24% (0.9056 => 0.9259, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.21% (0.8204 => 0.8385, std.dev.: 0.0032) MultiSource/Applications/d/make_dparser: 2.18% (3.2366 => 3.3072, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.18% (0.8069 => 0.8245, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.17% (0.6586 => 0.6729, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/gs/gs: 2.17% (4.1305 => 4.2200, std.dev.: 0.0304) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.16% (0.8177 => 0.8354, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.13% (0.8855 => 0.9044, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.09% (0.9074 => 0.9264, std.dev.: 0.0061) MultiSource/Applications/JM/lencod/lencod: 2.08% (15.3280 => 15.6469, std.dev.: 0.0443) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.07% (0.8359 => 0.8532, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.07% (0.8420 => 0.8594, std.dev.: 0.0043) MultiSource/Applications/JM/ldecod/ldecod: 2.02% (6.7320 => 6.8683, std.dev.: 0.0306) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.99% (0.9039 => 0.9219, std.dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: 1.99% (31.8598 => 32.4927, std.dev.: 0.1837) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.99% (0.8712 => 0.8885, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.97% (0.8261 => 0.8424, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.96% (1.1170 => 1.1389, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.85% (0.8656 => 0.8816, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 1.77% (8.6247 => 8.7774, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.73% (0.8885 => 0.9039, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.70% (4.5702 => 4.6480, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.51% (0.7932 => 0.8052, std.dev.: 0.0045) MultiSource/Applications/oggenc/oggenc: 1.36% (4.9628 => 5.0303, std.dev.: 0.0149) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.33% (4.4880 => 4.5476, std.dev.: 0.0228) MultiSource/Benchmarks/PAQ8p/paq8p: 1.21% (2.3764 => 2.4052, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.20% (1.2423 => 1.2572, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 100.50% (0.0199 => 0.0399, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/pi: 59.14% (1.5795 => 2.5136, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.06% (0.7597 => 0.8893, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.39% (2.9753 => 3.4631, std.dev.: 0.1742) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.63% (2.7995 => 3.2091, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.63% (5.0261 => 5.6107, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.06% (1.1857 => 1.2813, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 7.31% (1.7056 => 1.8302, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.88% (4.7794 => 5.1081, std.dev.: 0.0144) MultiSource/Applications/SIBsim4/SIBsim4: 6.35% (3.1873 => 3.3896, std.dev.: 0.0279) SingleSource/Benchmarks/Misc/richards_benchmark: 6.04% (1.3037 => 1.3825, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.89% (4.9686 => 5.2614, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.78% (4.5327 => 4.7947, std.dev.: 0.0291) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.68% (3.3761 => 3.5340, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/treeadd/treeadd: 4.57% (0.3587 => 0.3751, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.54% (6.2275 => 6.5104, std.dev.: 0.0355) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.51% (4.9453 => 5.1685, std.dev.: 0.0390) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.12% (4.9469 => 5.1507, std.dev.: 0.0115) MultiSource/Applications/hexxagon/hexxagon: 3.88% (14.0064 => 14.5496, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.82% (11.5690 => 11.8954, std.dev.: 0.0231) MultiSource/Applications/siod/siod: 2.75% (3.6643 => 3.7650, std.dev.: 0.0364) MultiSource/Applications/lambda-0_1_3/lambda: 2.65% (7.4933 => 7.6915, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.64% (8.2783 => 8.4967, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.60% (4.8660 => 4.9925, std.dev.: 0.0229) SingleSource/Benchmarks/Dhrystone/dry: 2.42% (0.5081 => 0.5204, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 2.36% (7.3375 => 7.5104, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.07% (4.8362 => 4.9364, std.dev.: 0.0222) SingleSource/Benchmarks/Misc/ReedSolomon: 1.30% (8.5322 => 8.6432, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: 1.30% (1.0841 => 1.0982, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.05% (3.5679 => 3.6053, std.dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.82% (5.4641 => 4.3263, std.dev.: 0.0945) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.89% (7.2130 => 6.2832, std.dev.: 0.2323) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.90% (1.0512 => 0.9366, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -10.53% (1.1216 => 1.0035, std.dev.: 0.0118) MultiSource/Benchmarks/mafft/pairlocalalign: -8.58% (63.1822 => 57.7641, std.dev.: 0.1523) MultiSource/Benchmarks/nbench/nbench: -7.48% (21.9654 => 20.3226, std.dev.: 0.1469) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.86% (4.7482 => 4.4226, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.18% (0.3269 => 0.3067, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.97% (3.7148 => 3.4929, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.74% (5.4972 => 5.1817, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.05% (5.1557 => 4.8955, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.39% (4.7449 => 4.5365, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.77% (6.0224 => 5.7954, std.dev.: 0.0506) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.51% (2.8773 => 2.7763, std.dev.: 0.0137) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.43% (2.4490 => 2.3650, std.dev.: 0.0126) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (28.5821 => 27.6995, std.dev.: 0.0600) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.47% (2.6356 => 2.5704, std.dev.: 0.0164) MultiSource/Applications/aha/aha: -2.39% (3.3398 => 3.2601, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.98% (11.5316 => 11.3033, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.76% (9.9065 => 9.7323, std.dev.: 0.0420) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.65% (2.3487 => 2.3100, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.58% (4.9994 => 4.9204, std.dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.72% (16.4461 => 16.7294, std.dev.: 0.1749) MultiSource/Applications/obsequi/Obsequi: 4.08% (1.0262 => 1.0681, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6892.96% (0.3123 => 21.8390, std.dev.: 0.3193) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.13% (0.2463 => 0.3673, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 1.06% (0.6010 => 0.6074, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.45% (0.3266 => 0.3346, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 3.91% (0.1969 => 0.2046, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.15% (0.0408 => 0.0429, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 9.47% (0.0190 => 0.0208, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 24.44% (0.0180 => 0.0224, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.39% (0.1438 => 0.1458, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.48% (1.1329 => 1.1497, std.dev.: 0.0298) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.89% (0.1462 => 0.1475, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.46% (0.4164 => 0.4183, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.66% (0.1369 => 0.1378, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.78% (0.0641 => 0.0646, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.56% (0.0195 => 0.0278, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.90% (0.0578 => 0.0567, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.80% (1.1437 => 1.1986, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.71% (0.0627 => 0.0644, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 32.78% (0.0180 => 0.0239, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.62% (0.8017 => 0.7807, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -24.19% (0.0062 => 0.0047, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 10 23:59:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 11 Nov 2012 01:59:16 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121111075917.012A52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5760?compare_to=5734&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5760, Order: 167668, Start Time: 2012-11-10 08:25:55, End Time: 2012-11-11 07:59:30 To: 5734, Order: 167608, Start Time: 2012-11-09 08:42:58, End Time: 2012-11-10 07:50:47 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (43 on baseline) New Passes: 0 (12 on baseline) Performance Regressions: 1 (172 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 50 (7 on baseline) Unchanged Tests: 990 (636 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/Burg/burg: 1.34% (1.3091 => 1.3266, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.24% (1.3141 => 1.2978, std.dev.: 0.0042) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/ClamAV/clamscan: -0.52% (27.6904 => 27.5470, std.dev.: 0.0139) MultiSource/Applications/JM/ldecod/ldecod: 0.18% (6.3417 => 6.3528, std.dev.: 0.0206) MultiSource/Applications/JM/lencod/lencod: 0.12% (19.6924 => 19.7153, std.dev.: 0.0305) MultiSource/Applications/oggenc/oggenc: - (0.0020 => 0.0020) MultiSource/Applications/siod/siod: -0.52% (1.5793 => 1.5711, std.dev.: 0.0146) MultiSource/Applications/sqlite3/sqlite3: 0.13% (0.5240 => 0.5247, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 0.40% (51.5431 => 51.7491, std.dev.: 0.0598) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 0.10% (0.8588 => 0.8597, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 0.85% (5.0550 => 5.0979, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -0.67% (10.5746 => 10.5033, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 0.08% (1.4147 => 1.4159, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -8.06% (0.3324 => 0.3056, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.35% (0.0282 => 0.0283, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 0.19% (1.7367 => 1.7400, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/voronoi/voronoi: 0.47% (0.1933 => 0.1942, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.00% (0.0020 => 0.0019, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: - (0.0019 => 0.0019, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -0.16% (0.2563 => 0.2559, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.19% (1.7301 => 1.7334, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 0.42% (5.2322 => 5.2541, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.85% (1.1066 => 1.1160, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: - (0.2974 => 0.2974, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0020 => 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/Large/sphereflake MultiSource/Applications/ClamAV/clamscan: - (0.0001 => 0.0001) MultiSource/Applications/JM/ldecod/ldecod: - (0.0001 => 0.0001) MultiSource/Applications/JM/lencod/lencod: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Applications/siod/siod: - (0.0001 => 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0417 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.74% (0.0672 => 0.0724, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: - (0.0001 => 0.0001) MultiSource/Benchmarks/Olden/power/power: -0.01% (499.8412 => 499.7884, std.dev.: 0.0386) MultiSource/Benchmarks/Olden/voronoi/voronoi: - (0.0001 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: - (0.0001 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: - (0.0001 => 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/nbench/nbench: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -0.02% (2.9174 => 2.9168, std.dev.: 0.0010) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/nbench/nbench MultiSource/Applications/ClamAV/clamscan: 24.22% (22.1758 => 27.5470, std.dev.: 0.0139) MultiSource/Applications/JM/ldecod/ldecod: -39.13% (10.4361 => 6.3528, std.dev.: 0.0206) MultiSource/Applications/JM/lencod/lencod: -10.13% (21.9371 => 19.7153, std.dev.: 0.0305) MultiSource/Applications/oggenc/oggenc: -99.97% (5.7591 => 0.0020) MultiSource/Applications/siod/siod: -31.60% (2.2969 => 1.5711, std.dev.: 0.0146) MultiSource/Applications/sqlite3/sqlite3: -96.95% (17.1811 => 0.5247, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -18.18% (63.2438 => 51.7491, std.dev.: 0.0598) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.12% (0.8101 => 0.8597, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.09% (4.9449 => 5.0979, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 48.90% (7.0540 => 10.5033, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -8.15% (1.5415 => 1.4159, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -37.36% (0.4879 => 0.3056, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.58% (6.6874 => 0.0283, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -67.49% (5.3526 => 1.7400, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/voronoi/voronoi: -28.07% (0.2700 => 0.1942, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -99.94% (2.9384 => 0.0019, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -99.83% (1.1194 => 0.0019, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -19.45% (0.3177 => 0.2559, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -67.81% (5.3855 => 1.7334, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.04% (5.0018 => 5.2541, std.dev.: 0.0084) MultiSource/Benchmarks/nbench/nbench: -74.88% (1.1840 => 0.2974, std.dev.: 0.0008) New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/nbench/nbench SingleSource/Benchmarks/Misc-C++/Large/sphereflake MultiSource/Applications/ClamAV/clamscan: -99.94% (0.1629 => 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -99.92% (0.1298 => 0.0001) MultiSource/Applications/siod/siod: -100.00% (3.2827 => 0.0001) MultiSource/Applications/sqlite3/sqlite3: -100.00% (4.6441 => 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -100.00% (2.3135 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -98.00% (0.0050 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -99.96% (0.2497 => 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -50.00% (0.0002 => 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -75.00% (0.0004 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -99.97% (0.3987 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 44219.27% (1.1277 => 499.7884, std.dev.: 0.0386) MultiSource/Benchmarks/Olden/voronoi/voronoi: -99.97% (0.3070 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -100.00% (2.6546 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -100.00% (2.6778 => 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -100.00% (4.5009 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -99.80% (0.0506 => 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -97.30% (0.0037 => 0.0001) MultiSource/Benchmarks/nbench/nbench: -100.00% (11.6436 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.02% (3.2416 => 2.9168, std.dev.: 0.0010) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 191.99% (0.5229 => 1.5268, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 12.28% (14.9895 => 16.8309, std.dev.: 0.0261) MultiSource/Applications/kimwitu++/kc: 35.87% (14.1553 => 19.2334, std.dev.: 0.0193) MultiSource/Benchmarks/MallocBench/gs/gs: 12.70% (4.1105 => 4.6325, std.dev.: 0.0216) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.95% (3.4629 => 5.8506, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 62.23% (0.6222 => 1.0094, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3840300.00% (0.0001 => 3.8404, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11166400.00% (0.0001 => 11.1665, std.dev.: 0.0073) MultiSource/Applications/kimwitu++/kc: 51000.00% (0.0001 => 0.0511, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 66300.00% (0.0001 => 0.0664) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10002800.00% (0.0001 => 10.0029, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488800.00% (0.0001 => 5.4889, std.dev.: 0.0095) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 52.27% (0.1056 => 0.1608, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 41.82% (0.0746 => 0.1058, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 38.76% (0.1432 => 0.1987, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 38.36% (0.0730 => 0.1010, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Oscar: 24.37% (0.0636 => 0.0791, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 20.83% (0.2554 => 0.3086, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.64% (0.1584 => 0.1911, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.11% (0.1566 => 0.1881, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 19.83% (0.1175 => 0.1408, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.27% (8.1363 => 9.7043, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.17% (0.0793 => 0.0945, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.84% (0.1125 => 0.1337, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.71% (0.1555 => 0.1846, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 18.30% (0.0798 => 0.0944, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.28% (0.0648 => 0.0760, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.98% (0.0842 => 0.0985, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.68% (0.0953 => 0.1112, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 16.61% (0.0614 => 0.0716, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.44% (0.0675 => 0.0786, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.17% (0.2065 => 0.2399, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 15.99% (0.1151 => 0.1335, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.97% (0.0770 => 0.0893, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 15.84% (0.0871 => 0.1009, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.80% (0.0886 => 0.1026, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.72% (0.8172 => 0.9457, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout/matrix: 15.65% (0.0818 => 0.0946, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 15.58% (0.1695 => 0.1959, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.14% (0.2107 => 0.2426, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.93% (0.0730 => 0.0839, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.87% (0.1029 => 0.1182, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.84% (0.2271 => 0.2608, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.77% (0.3121 => 0.3582, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.22% (0.1062 => 0.1213, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.21% (0.5981 => 0.6831, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 14.19% (0.1163 => 0.1328, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.15% (0.0834 => 0.0952, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.14% (0.1337 => 0.1526, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 13.95% (1.1642 => 1.3266, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.92% (0.2758 => 0.3142, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/health/health: 13.49% (0.1268 => 0.1439, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 13.46% (0.7115 => 0.8073, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.43% (0.1906 => 0.2162, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 13.41% (0.1655 => 0.1877, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.34% (0.1117 => 0.1266, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 13.29% (0.7433 => 0.8421, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.27% (0.5569 => 0.6308, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.25% (0.1940 => 0.2197, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.03% (14.3668 => 16.2392, std.dev.: 0.0096) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.89% (0.0838 => 0.0946, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.82% (0.9765 => 1.1017, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.72% (0.4615 => 0.5202, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.66% (0.5860 => 0.6602, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/18-imp/imp: 12.62% (0.3423 => 0.3855, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.61% (0.3441 => 0.3875, std.dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 12.51% (0.3109 => 0.3498, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 12.46% (0.7835 => 0.8811, std.dev.: 0.0065) MultiSource/Benchmarks/PAQ8p/paq8p: 12.31% (10.3673 => 11.6432, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.98% (1.3050 => 1.4614, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.90% (0.1143 => 0.1279, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 11.86% (3.8723 => 4.3316, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.85% (0.1510 => 0.1689, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.77% (0.5105 => 0.5706, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.69% (0.6675 => 0.7455, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.63% (0.1032 => 0.1152, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.60% (4.2646 => 4.7591, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.49% (0.1236 => 0.1378, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 11.46% (3.3354 => 3.7175, std.dev.: 0.0215) MultiSource/Benchmarks/Prolangs-C++/life/life: 11.15% (0.0933 => 0.1037, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 10.86% (2.0273 => 2.2475, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.86% (0.3307 => 0.3666, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.68% (0.5020 => 0.5556, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/05-eks/eks: 10.61% (0.4299 => 0.4755, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 10.54% (9.4845 => 10.4838, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.51% (3.8922 => 4.3012, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 10.49% (0.3927 => 0.4339, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 10.49% (0.1268 => 0.1401, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.49% (1.5859 => 1.7522, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 10.47% (0.3180 => 0.3513, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 10.39% (0.3473 => 0.3834, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.37% (0.3886 => 0.4289, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 10.31% (1.0722 => 1.1827, std.dev.: 0.0054) MultiSource/Applications/hbd/hbd: 10.30% (1.5603 => 1.7210, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/exceptions-4: 10.25% (0.3543 => 0.3906, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 10.24% (0.3497 => 0.3855, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.22% (0.3543 => 0.3905, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 10.18% (0.3516 => 0.3874, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.17% (0.6450 => 0.7106, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 10.17% (0.3561 => 0.3923, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.15% (0.1044 => 0.1150, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.15% (0.1892 => 0.2084, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions: 10.11% (0.3828 => 0.4215, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.05% (0.8067 => 0.8878, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/for-in: 10.04% (0.3694 => 0.4065, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.99% (0.2603 => 0.2863, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 9.99% (0.8921 => 0.9812, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.78% (2.2024 => 2.4179, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.77% (2.2022 => 2.4174) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.64% (1.1861 => 1.3004, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 9.62% (0.6456 => 0.7077, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.54% (1.4186 => 1.5540, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.38% (0.1695 => 0.1854, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 9.27% (0.1144 => 0.1250, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.18% (0.2430 => 0.2653, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: 9.16% (0.1463 => 0.1597, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.11% (0.3865 => 0.4217, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 9.01% (0.3387 => 0.3692, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.92% (0.4103 => 0.4469, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.89% (0.4636 => 0.5048, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 8.84% (0.4289 => 0.4668, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.52% (0.4203 => 0.4561, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 8.48% (0.4620 => 0.5012, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 8.18% (0.3422 => 0.3702, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists1: 7.90% (0.3684 => 0.3975, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 7.86% (0.4048 => 0.4366, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 7.85% (0.3603 => 0.3886, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 7.81% (0.2049 => 0.2209, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.73% (0.6030 => 0.6496, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.69% (0.3379 => 0.3639, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.62% (0.2756 => 0.2966, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 7.56% (0.7326 => 0.7880, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.53% (0.3826 => 0.4114, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.42% (0.3650 => 0.3921, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.40% (0.2905 => 0.3120, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: 7.27% (0.2725 => 0.2923, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.22% (0.5925 => 0.6353, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.22% (0.2714 => 0.2910, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.21% (0.4064 => 0.4357, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.18% (0.3162 => 0.3389, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 7.14% (0.2831 => 0.3033, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 7.01% (0.3282 => 0.3512, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.99% (0.2891 => 0.3093, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.84% (0.2793 => 0.2984, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.84% (0.3232 => 0.3453, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.79% (2.0665 => 2.2069, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 6.78% (0.3098 => 0.3308, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.3283 => 0.3505, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 6.76% (0.3092 => 0.3301, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.69% (0.2871 => 0.3063, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 6.58% (1.2842 => 1.3687, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.44% (0.2872 => 0.3057, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 6.43% (0.2877 => 0.3062, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 6.39% (0.3052 => 0.3247, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.25% (0.2802 => 0.2977, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.04% (0.3427 => 0.3634, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.36% (0.3136 => 0.3304, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 4.47% (0.3131 => 0.3271, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (0.3935 => 0.4074, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.70% (0.3817 => 0.3920, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.64% (1.1145 => 1.2999, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 13.91% (6.6465 => 7.5710, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2180, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.87% (1.1396 => 1.2521, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.90% (1.7254 => 1.8790, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 8.12% (0.9505 => 1.0277, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3680, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.46% (0.3463 => 0.3652, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.97% (4.2280 => 4.3959, std.dev.: 0.0076) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.77% (0.4162 => 0.4319, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.83% (8.6802 => 8.9260, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.80% (0.8333 => 0.8483, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0495, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.07% (9.1159 => 9.2131, std.dev.: 0.0316) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5776, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.01% (3.6395 => 3.6763, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -75.11% (0.8651 => 0.2153, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -73.34% (5.2763 => 1.4066, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -45.68% (0.1622 => 0.0881, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -11.35% (0.1330 => 0.1179, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -9.06% (1.7609 => 1.6013, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -8.88% (54.1659 => 49.3580, std.dev.: 0.0441) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.17% (0.0628 => 0.0382, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -18.56% (0.2161 => 0.1760, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4257, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -10.99% (9.5636 => 8.5126, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.96% (32.5116 => 28.9497, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -10.84% (1.5373 => 1.3707, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.13% (1.5660 => 1.4230, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2876, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/distray/distray: -7.10% (0.1592 => 0.1479) SingleSource/Benchmarks/McGill/chomp: -7.03% (1.2373 => 1.1503, std.dev.: 0.0055) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7043, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -6.07% (0.4808 => 0.4516, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.17% (1.6805 => 1.5937, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5081, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.30% (0.9957 => 0.9529, std.dev.: 0.0138) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.76% (1.3677 => 1.3163, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -3.23% (5.0483 => 4.8850, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.08% (8.1563 => 7.9866, std.dev.: 0.0188) SingleSource/Benchmarks/Misc/salsa20: -1.88% (10.2830 => 10.0892, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -1.77% (85.0658 => 83.5612, std.dev.: 0.0089) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5108, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.21% (6.2999 => 6.2237, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8584, std.dev.: 0.0078) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.01% (1.1048 => 1.1160, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -99.97% (7.1582 => 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: -99.86% (0.0720 => 0.0001) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -65.78% (0.2116 => 0.0724, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 11 00:43:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 11 Nov 2012 02:43:58 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121111084358.5B7F52A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5761?compare_to=5755&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5761, Order: 167682, Start Time: 2012-11-11 05:24:43, End Time: 2012-11-11 08:44:10 To: 5755, Order: 167679, Start Time: 2012-11-11 01:20:43, End Time: 2012-11-11 04:36:37 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (176 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (716 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 32.14% (56.3140 => 74.4147, std.dev.: 0.2591) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.52% (0.0625 => 0.0897, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.24% (0.1063 => 0.1427, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.11% (0.4253 => 0.5406, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.57% (0.2969 => 0.3758, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.40% (0.1106 => 0.1398, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.83% (0.4139 => 0.5208, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 25.63% (1.5932 => 2.0015, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.35% (0.0714 => 0.0895, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.25% (0.4994 => 0.6255, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.86% (0.5900 => 0.7367, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.84% (0.0475 => 0.0593) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.34% (0.0415 => 0.0516, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.13% (0.0547 => 0.0679, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.10% (0.5000 => 0.6205, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.01% (0.1620 => 0.2009, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.97% (0.0584 => 0.0724, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.31% (0.1107 => 0.1365, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 23.23% (0.0947 => 0.1167, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.11% (0.1021 => 0.1257, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 22.54% (0.0599 => 0.0734, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.52% (0.0897 => 0.1099, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 22.26% (0.0948 => 0.1159, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.02% (0.0822 => 0.1003, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.96% (0.0633 => 0.0772, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.85% (0.1103 => 0.1344, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.81% (0.0642 => 0.0782) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.75% (0.0584 => 0.0711, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 21.56% (0.0821 => 0.0998, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.44% (0.0541 => 0.0657, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.34% (0.1003 => 0.1217, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.21% (0.0495 => 0.0600, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 21.12% (0.1619 => 0.1961, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.92% (0.1549 => 0.1873, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.91% (0.3903 => 0.4719, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.70% (0.1604 => 0.1936, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 20.70% (0.0604 => 0.0729, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 20.01% (0.5826 => 0.6992, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 19.94% (0.5889 => 0.7063, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.63% (0.1462 => 0.1749, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.46% (0.3890 => 0.4647, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 19.45% (0.0581 => 0.0694, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 19.38% (0.1218 => 0.1454, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.37% (0.2736 => 0.3266, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.31% (0.2014 => 0.2403, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 19.31% (0.0808 => 0.0964) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.16% (1.3152 => 1.5672, std.dev.: 0.0020) MultiSource/Applications/spiff/spiff: 18.94% (0.4029 => 0.4792, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/mst/mst: 18.91% (0.0698 => 0.0830, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.71% (0.0572 => 0.0679, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 18.60% (0.1505 => 0.1785, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.47% (0.1088 => 0.1289, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 18.37% (1.8794 => 2.2247, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.28% (0.2866 => 0.3390, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.18% (0.0605 => 0.0715, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.10% (3.5627 => 4.2077, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.02% (0.1160 => 0.1369, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.97% (0.5026 => 0.5929, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.94% (0.1968 => 0.2321, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.81% (0.2875 => 0.3387, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.80% (0.0573 => 0.0675, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 17.78% (0.7171 => 0.8446, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: 17.72% (0.5546 => 0.6529, std.dev.: 0.0051) MultiSource/Applications/hbd/hbd: 17.68% (0.9697 => 1.1411, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.67% (0.4658 => 0.5481, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.57% (1.6211 => 1.9059, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.43% (0.3930 => 0.4615, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 17.34% (1.0781 => 1.2650, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.32% (2.7292 => 3.2020, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/18-imp/imp: 17.31% (0.1421 => 0.1667, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.24% (0.3271 => 0.3835, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.13% (0.2738 => 0.3207, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 17.10% (0.2725 => 0.3191, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.08% (0.2729 => 0.3195, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 17.05% (0.2750 => 0.3219, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 16.95% (0.2714 => 0.3174, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.95% (0.4361 => 0.5100, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 16.93% (0.2823 => 0.3301, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 16.92% (0.2813 => 0.3289, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 16.80% (0.2780 => 0.3247, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 16.79% (4.2109 => 4.9178, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.76% (0.2911 => 0.3399, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.73% (0.2792 => 0.3259, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/except: 16.72% (0.2811 => 0.3281, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.68% (4.4195 => 5.1566, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.65% (0.3195 => 0.3727, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 16.64% (0.3004 => 0.3504, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 16.63% (0.2803 => 0.3269, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 16.51% (0.1284 => 0.1496, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 16.47% (0.3096 => 0.3606, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 16.41% (0.9909 => 1.1535, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.29% (1.9694 => 2.2903, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.15% (0.1090 => 0.1266, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.14% (2.0673 => 2.4010, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.06% (0.3488 => 0.4048, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.05% (1.9966 => 2.3170, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 16.04% (0.3267 => 0.3791, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 15.96% (0.3258 => 0.3778, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.88% (0.3362 => 0.3896, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 15.87% (0.3465 => 0.4015, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 15.86% (0.2566 => 0.2973, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 15.81% (23.5202 => 27.2391, std.dev.: 0.0194) SingleSource/UnitTests/ObjC/exceptions-3: 15.81% (0.3460 => 0.4007, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 15.80% (0.3442 => 0.3986, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/for-in: 15.79% (0.3496 => 0.4048, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 15.79% (0.3446 => 0.3990, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 15.73% (0.4146 => 0.4798, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 15.68% (0.3317 => 0.3837, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/synchronized: 15.65% (0.3469 => 0.4012, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.56% (0.3060 => 0.3536, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 15.37% (0.3650 => 0.4211, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.29% (0.3845 => 0.4433, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 15.29% (0.3643 => 0.4200, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: 15.23% (0.3678 => 0.4238, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 15.23% (0.3724 => 0.4291, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 15.21% (0.3477 => 0.4006, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.20% (0.3124 => 0.3599, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 15.17% (0.3348 => 0.3856, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.14% (0.3282 => 0.3779, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 15.04% (0.2075 => 0.2387) SingleSource/Benchmarks/Shootout-C++/sieve: 14.98% (0.3726 => 0.4284, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 14.97% (1.4269 => 1.6405, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.79% (0.3625 => 0.4161, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 14.66% (0.4251 => 0.4874, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.61% (0.3690 => 0.4229, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.52% (0.3981 => 0.4559, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 14.48% (0.7875 => 0.9015, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 14.44% (2.1653 => 2.4779, std.dev.: 0.0067) MultiSource/Applications/JM/lencod/lencod: 14.13% (4.6177 => 5.2701, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.96% (0.1383 => 0.1576, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 13.94% (2.1013 => 2.3943, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 13.91% (0.5012 => 0.5709, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 13.85% (0.0758 => 0.0863, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.24% (0.2040 => 0.2310, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 13.08% (0.2691 => 0.3043, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 12.68% (5.5417 => 6.2444, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.57% (0.6435 => 0.7244, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.35% (0.1028 => 0.1155, std.dev.: 0.0038) MultiSource/Applications/siod/siod: 12.19% (0.6634 => 0.7443, std.dev.: 0.0063) MultiSource/Applications/lambda-0_1_3/lambda: 12.18% (0.3498 => 0.3924, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.80% (0.2737 => 0.3060, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.65% (0.2068 => 0.2309, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 11.47% (0.4847 => 0.5403, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.41% (0.3084 => 0.3436, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 11.00% (0.3336 => 0.3703, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.70% (0.2103 => 0.2328, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 10.33% (0.2391 => 0.2638, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 10.17% (2.0346 => 2.2415, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.61% (4.6926 => 5.1434, std.dev.: 0.0117) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.47% (11.6398 => 12.7423, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.20% (0.5361 => 0.5854, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.65% (0.5584 => 0.6067, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.44% (0.7426 => 0.8053, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 7.91% (11.9555 => 12.9007, std.dev.: 0.0171) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.33% (0.3792 => 0.4032, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.32% (0.5917 => 0.6705) MultiSource/Applications/ClamAV/clamscan: 10.14% (0.2802 => 0.3086, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6109, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.42% (0.3693 => 0.3930, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6752, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-2: 4.75% (1.8057 => 1.8915, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1687, std.dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/dry: 4.17% (14.0481 => 14.6339, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2033, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.68% (3.1722 => 3.2255, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.49% (7.1849 => 7.2919, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3109, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5151, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.02% (50.0626 => 50.5743, std.dev.: 0.0166) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.74% (25.4195 => 16.5877, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/ary2: -10.28% (0.2402 => 0.2155, std.dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9757, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7970, std.dev.: 0.0132) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9587, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7959, std.dev.: 0.0080) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -2.92% (17.2379 => 16.7346, std.dev.: 0.0752) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.27% (41.7953 => 40.8455, std.dev.: 0.0135) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5763, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: -1.44% (5.5810 => 5.5006, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.10% (105.3826 => 104.2259, std.dev.: 0.2894) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.03% (16.2163 => 16.0493, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 11 01:35:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 11 Nov 2012 03:35:58 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121111093558.C15B22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5762?compare_to=5759&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5762, Order: 167691, Start Time: 2012-11-11 08:10:11, End Time: 2012-11-11 09:36:13 To: 5759, Order: 167686, Start Time: 2012-11-11 06:26:48, End Time: 2012-11-11 07:53:20 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 3 (89 on baseline) Performance Improvements: 7 (28 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 981 (857 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.50% (0.3344 => 0.3461, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.03% (1.1271 => 1.1612, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.64% (14.7428 => 14.9851, std.dev.: 0.0398) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -7.13% (8.7042 => 8.0837, std.dev.: 0.0948) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.55% (0.9031 => 0.8620, std.dev.: 0.0114) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (0.3060 => 0.2948, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.42% (0.9069 => 0.8940, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.29% (0.8902 => 0.8787, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/lpbench: -4.10% (4.0662 => 3.8993, std.dev.: 0.0139) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.65% (1.0464 => 1.0187, std.dev.: 0.0083) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.07% (16.7294 => 16.7174, std.dev.: 0.2064) MultiSource/Applications/obsequi/Obsequi: -1.44% (1.0681 => 1.0527, std.dev.: 0.0104) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.12% (21.8390 => 21.8138, std.dev.: 0.1328) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.33% (0.3673 => 0.3661, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/bigfib: -0.53% (0.6074 => 0.6042, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.48% (0.3346 => 0.3330, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: -1.32% (0.2046 => 0.2019, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -32.27% (0.0220 => 0.0149, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -8.39% (0.0429 => 0.0393, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -17.77% (0.0332 => 0.0273, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.22% (0.0316 => 0.0309, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -13.74% (0.0422 => 0.0364, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/casts: -1.44% (0.0208 => 0.0205, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/test1: -3.12% (0.0224 => 0.0217, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: - (0.1458 => 0.1458, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.36% (1.1497 => 1.1653, std.dev.: 0.0268) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -3.59% (0.1475 => 0.1422, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.31% (0.4183 => 0.4128, std.dev.: 0.0260) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.99% (0.1378 => 0.1433, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.95% (0.0646 => 0.0614, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -30.94% (0.0278 => 0.0192, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.35% (0.0567 => 0.0569, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.01% (1.1986 => 1.2107, std.dev.: 0.0463) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -46.15% (0.0026 => 0.0014, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.90% (0.0644 => 0.0606, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -22.18% (0.0239 => 0.0186, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.20% (0.7807 => 0.7791, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -12.77% (0.0047 => 0.0041, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2295.03% (0.6332 => 15.1653, std.dev.: 0.1494) MultiSource/Benchmarks/McCat/08-main/main: 46.04% (0.1831 => 0.2674, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.90% (0.1559 => 0.1467, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1494.23% (0.3344 => 5.3311, std.dev.: 0.0370) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.39% (0.2364 => 0.3248, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -0.23% (0.0429 => 0.0428, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.14% (0.0224 => 0.0240, std.dev.: 0.0015) SingleSource/UnitTests/byval-alignment: -32.61% (0.0230 => 0.0155, std.dev.: 0.0009) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4364, std.dev.: 0.0103) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0712, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4890, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3375, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1270, std.dev.: 0.0212) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4046, std.dev.: 0.0013) SingleSource/Regression/C/uint64_to_float: -24.27% (2.1832 => 1.6534, std.dev.: 0.0117) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0007, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 12.84% (0.0810 => 0.0914, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/tsp/tsp: 12.32% (0.1112 => 0.1249, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.91% (0.0848 => 0.0949, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.20% (0.2279 => 0.2443, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.09% (0.1905 => 0.2021, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.50% (0.2180 => 0.2300, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.46% (0.6287 => 0.6630, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.93% (0.5961 => 0.6255, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.64% (0.9435 => 0.9873, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2998 => 0.3128, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.27% (0.2741 => 0.2858, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.78% (1.1606 => 1.2045, std.dev.: 0.0149) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.59% (0.8321 => 0.8620, std.dev.: 0.0114) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.32% (0.4783 => 0.4942, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.30% (1.3279 => 1.3717, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.06% (1.4479 => 1.4922, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.89% (13.1811 => 13.5623, std.dev.: 0.0193) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.85% (6.6074 => 6.7955, std.dev.: 0.0563) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.49% (0.8007 => 0.8206, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.45% (1.1170 => 1.1444, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.45% (4.1763 => 4.2786, std.dev.: 0.0271) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.41% (0.8995 => 0.9212, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.36% (1.6386 => 1.6773, std.dev.: 0.0087) MultiSource/Applications/lua/lua: 2.33% (3.8189 => 3.9080, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.33% (0.9688 => 0.9914, std.dev.: 0.0079) MultiSource/Applications/hbd/hbd: 2.29% (1.4269 => 1.4596, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.25% (0.8457 => 0.8647, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 2.16% (1.2568 => 1.2840, std.dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 2.13% (14.2605 => 14.5643, std.dev.: 0.0821) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.11% (0.8340 => 0.8516, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.10% (0.8286 => 0.8460, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.10% (0.8204 => 0.8376, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.08% (0.8597 => 0.8776, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.04% (0.8611 => 0.8787, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.02% (0.8712 => 0.8888, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.92% (0.9069 => 0.9243, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.88% (0.9908 => 1.0094, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.84% (0.8359 => 0.8513, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.80% (0.9039 => 0.9202, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.79% (0.9074 => 0.9236, std.dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: 1.72% (0.7557 => 0.7687, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.69% (0.8331 => 0.8472, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.66% (2.1401 => 2.1757, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.61% (0.8177 => 0.8309, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.61% (0.8069 => 0.8199, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.61% (0.8716 => 0.8856, std.dev.: 0.0046) MultiSource/Benchmarks/Bullet/bullet: 1.58% (31.8598 => 32.3629, std.dev.: 0.1292) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.58% (0.8316 => 0.8447, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.54% (0.8338 => 0.8466, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.53% (0.8805 => 0.8940, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.48% (0.8048 => 0.8167, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.45% (0.8855 => 0.8983, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 1.41% (15.3280 => 15.5439, std.dev.: 0.0553) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.36% (1.5315 => 1.5523, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.34% (0.8885 => 0.9004, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 1.15% (8.6247 => 8.7243, std.dev.: 0.0194) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 100.50% (0.0199 => 0.0399, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/pi: 58.80% (1.5795 => 2.5082, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.36% (2.9753 => 3.4620, std.dev.: 0.0213) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.27% (0.7597 => 0.8833, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.70% (2.7995 => 3.2110, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.50% (5.0261 => 5.6041, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.63% (0.3186 => 0.3461, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 7.89% (2.2485 => 2.4258, std.dev.: 0.0483) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.36% (1.1857 => 1.2730, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/queens: 6.97% (1.7056 => 1.8245, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/richards_benchmark: 6.64% (1.3037 => 1.3903, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.61% (4.7794 => 5.0954, std.dev.: 0.1150) MultiSource/Applications/SIBsim4/SIBsim4: 6.30% (3.1873 => 3.3881, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.87% (4.5327 => 4.7986, std.dev.: 0.0280) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.75% (4.9686 => 5.2544, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.64% (6.2275 => 6.5166, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.47% (3.3761 => 3.5270, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.34% (4.9453 => 5.1600, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.15% (4.9469 => 5.1522, std.dev.: 0.0392) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.04% (1.2337 => 1.2836, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.86% (11.5690 => 11.9002, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.70% (8.2783 => 8.5018, std.dev.: 0.0047) MultiSource/Applications/siod/siod: 2.62% (3.6643 => 3.7603, std.dev.: 0.0126) MultiSource/Applications/lambda-0_1_3/lambda: 2.62% (7.4933 => 7.6894, std.dev.: 0.0218) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.45% (4.8660 => 4.9854, std.dev.: 0.0187) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.32% (14.6451 => 14.9851, std.dev.: 0.0398) SingleSource/Benchmarks/Shootout/lists: 2.30% (7.3375 => 7.5065, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.28% (4.8362 => 4.9463, std.dev.: 0.0164) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.17% (1.1365 => 1.1612, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.69% (2.4647 => 2.5063, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/ReedSolomon: 1.16% (8.5322 => 8.6309, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.14% (3.5679 => 3.6085, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 1.07% (1.2061 => 1.2190, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.97% (8.4179 => 8.0837, std.dev.: 0.0948) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.90% (5.4641 => 4.3219, std.dev.: 0.3734) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.91% (1.0512 => 0.9365, std.dev.: 0.0104) SingleSource/Benchmarks/McGill/chomp: -10.45% (1.1216 => 1.0044, std.dev.: 0.0248) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -9.81% (7.2130 => 6.5055, std.dev.: 0.2402) MultiSource/Benchmarks/mafft/pairlocalalign: -8.51% (63.1822 => 57.8078, std.dev.: 0.0178) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.14% (0.3269 => 0.3003, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.88% (4.7482 => 4.4216, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.88% (3.7148 => 3.4963, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.87% (5.4972 => 5.1747, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.15% (5.1557 => 4.8904, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.38% (4.7449 => 4.5373, std.dev.: 0.0087) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.17% (2.8773 => 2.7572, std.dev.: 0.0465) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.71% (6.0224 => 5.7989, std.dev.: 0.0102) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.98% (28.5821 => 27.7306, std.dev.: 0.0358) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.81% (0.5807 => 0.5644, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.70% (2.6356 => 2.5645, std.dev.: 0.0015) MultiSource/Applications/aha/aha: -2.48% (3.3398 => 3.2570, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/hash2: -2.31% (3.4237 => 3.3446, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.30% (9.9065 => 9.6787, std.dev.: 0.0840) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.26% (3.2169 => 3.1441, std.dev.: 0.0215) MultiSource/Benchmarks/FreeBench/mason/mason: -2.23% (0.5415 => 0.5294, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.98% (11.5316 => 11.3030, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.64% (4.9994 => 4.9176, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/ffbench: -1.55% (1.4296 => 1.4075, std.dev.: 0.0075) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.35% (2.3487 => 2.3170, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.17% (5.6343 => 5.5682, std.dev.: 0.0231) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.00% (4.2466 => 4.2040, std.dev.: 0.0047) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.65% (16.4461 => 16.7174, std.dev.: 0.2064) MultiSource/Applications/obsequi/Obsequi: 2.58% (1.0262 => 1.0527, std.dev.: 0.0104) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6884.89% (0.3123 => 21.8138, std.dev.: 0.1328) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.64% (0.2463 => 0.3661, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/bigfib: 0.53% (0.6010 => 0.6042, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.96% (0.3266 => 0.3330, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 2.54% (0.1969 => 0.2019, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 21.14% (0.0123 => 0.0149, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.68% (0.0408 => 0.0393, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 7.48% (0.0254 => 0.0273, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.32% (0.0302 => 0.0309, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.21% (0.0384 => 0.0364, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.39% (0.1438 => 0.1458, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.86% (1.1329 => 1.1653, std.dev.: 0.0268) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -2.74% (0.1462 => 0.1422, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.86% (0.4164 => 0.4128, std.dev.: 0.0260) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.67% (0.1369 => 0.1433, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.21% (0.0641 => 0.0614, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.54% (0.0195 => 0.0192, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.56% (0.0578 => 0.0569, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.86% (1.1437 => 1.2107, std.dev.: 0.0463) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0014 => 0.0014, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.35% (0.0627 => 0.0606, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.33% (0.0180 => 0.0186, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.82% (0.8017 => 0.7791, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -33.87% (0.0062 => 0.0041, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 11 01:37:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 11 Nov 2012 03:37:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121111093731.893BC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5763?compare_to=5758&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5763, Order: 167691, Start Time: 2012-11-11 08:12:42, End Time: 2012-11-11 09:37:45 To: 5758, Order: 167685, Start Time: 2012-11-11 06:20:23, End Time: 2012-11-11 07:45:21 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (180 on baseline) Unchanged Tests: 1042 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1013, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.4937 => 7.6746, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/hash2: 2.15% (3.1932 => 3.2619, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.83% (0.3821 => 0.3522, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -7.74% (2.4924 => 2.2994, std.dev.: 0.0042) MultiSource/Applications/sgefa/sgefa: -6.97% (0.3357 => 0.3123, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.75% (0.2428 => 0.2264, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.70% (3.5339 => 3.2972, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.59% (0.3142 => 0.2935, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.55% (1.0544 => 0.9853, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -6.55% (9.2283 => 8.6236, std.dev.: 0.0117) MultiSource/Applications/JM/ldecod/ldecod: -6.55% (7.0961 => 6.6313, std.dev.: 0.0118) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.51% (22.4056 => 20.9477, std.dev.: 0.0216) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.51% (0.3658 => 0.3420, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -6.50% (16.1920 => 15.1389, std.dev.: 0.0208) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.50% (0.1584 => 0.1481, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: -6.41% (0.9179 => 0.8591, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.39% (0.9852 => 0.9222, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -6.39% (0.2160 => 0.2022, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.37% (0.6484 => 0.6071, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: -6.36% (0.1761 => 0.1649, std.dev.: 0.0043) MultiSource/Applications/Burg/burg: -6.35% (1.2515 => 1.1720, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/ReedSolomon: -6.33% (0.1879 => 0.1760, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.29% (0.1796 => 0.1683, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -6.28% (1.1450 => 1.0731, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -6.27% (4.3330 => 4.0615, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.25% (1.3722 => 1.2864, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.24% (0.7919 => 0.7425, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.23% (1.6364 => 1.5344, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.21% (1.4642 => 1.3732, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-2: -6.21% (0.3831 => 0.3593, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.21% (0.3880 => 0.3639, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.20% (1.2300 => 1.1538, std.dev.: 0.0105) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.18% (0.1716 => 0.1610, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.17% (4.5069 => 4.2290, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: -6.16% (0.3812 => 0.3577, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -6.16% (0.2985 => 0.2801, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.14% (0.3891 => 0.3652, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -6.13% (0.2659 => 0.2496, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -6.12% (0.4033 => 0.3786, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.12% (0.5863 => 0.5504, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.12% (0.2695 => 0.2530, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.11% (0.7524 => 0.7064, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.11% (0.9542 => 0.8959, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions: -6.11% (0.4176 => 0.3921, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.09% (4.8161 => 4.5228, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/synchronized: -6.08% (0.3896 => 0.3659, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.08% (0.5857 => 0.5501, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.08% (4.8802 => 4.5836, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.06% (1.2784 => 1.2009, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.06% (0.5859 => 0.5504, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -6.06% (15.5079 => 14.5688, std.dev.: 0.0184) SingleSource/UnitTests/ObjC/exceptions-3: -6.06% (0.3848 => 0.3615, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.05% (0.3884 => 0.3649, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.04% (0.6304 => 0.5923, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.04% (0.6736 => 0.6329, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.04% (0.7339 => 0.6896, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.04% (0.6395 => 0.6009, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.03% (0.5802 => 0.5452, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.02% (0.6293 => 0.5914, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.02% (4.0323 => 3.7897, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.01% (0.5478 => 0.5149, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.00% (0.2548 => 0.2395, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.99% (0.5805 => 0.5457, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.99% (0.2355 => 0.2214, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.98% (0.5849 => 0.5499, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.98% (0.5705 => 0.5364, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.96% (0.6052 => 0.5691, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -5.95% (2.4021 => 2.2591, std.dev.: 0.0042) MultiSource/Applications/lua/lua: -5.94% (4.0594 => 3.8181, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.94% (0.3483 => 0.3276, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -5.94% (17.1032 => 16.0875, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.93% (0.7198 => 0.6771, std.dev.: 0.0045) MultiSource/Benchmarks/sim/sim: -5.90% (0.3406 => 0.3205, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.89% (6.7716 => 6.3726, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/18-imp/imp: -5.89% (0.3581 => 0.3370, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.89% (0.6230 => 0.5863, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.89% (1.6474 => 1.5504, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.88% (0.4151 => 0.3907, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.87% (0.5575 => 0.5248, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.86% (0.5925 => 0.5578, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -5.85% (0.7447 => 0.7011, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.85% (0.6446 => 0.6069, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -5.83% (0.4199 => 0.3954, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.83% (0.6660 => 0.6272, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.82% (0.6681 => 0.6292, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.82% (14.2083 => 13.3811, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.80% (0.6395 => 0.6024, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.80% (0.5999 => 0.5651, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.80% (0.6260 => 0.5897, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.80% (0.8521 => 0.8027, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.80% (0.6297 => 0.5932, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -5.79% (0.4280 => 0.4032, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.78% (0.5591 => 0.5268, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -5.77% (1.1530 => 1.0865, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.77% (0.5567 => 0.5246, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.76% (0.6667 => 0.6283, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.76% (0.5941 => 0.5599, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.75% (0.5569 => 0.5249, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.73% (0.4813 => 0.4537, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: -5.73% (1.3864 => 1.3069, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: -5.72% (3.5154 => 3.3143, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash2: -5.72% (0.4861 => 0.4583, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.71% (0.5688 => 0.5363, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.71% (0.7021 => 0.6620, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -5.69% (1.3148 => 1.2400, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -5.69% (0.3025 => 0.2853, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.68% (2.2587 => 2.1303, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.68% (0.6194 => 0.5842, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.67% (0.5570 => 0.5254, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.67% (0.3931 => 0.3708, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.67% (0.5329 => 0.5027, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.66% (0.3837 => 0.3620, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.64% (0.3016 => 0.2846, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.63% (0.5581 => 0.5267, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -5.63% (0.4515 => 0.4261, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.62% (0.6189 => 0.5841, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.62% (0.6440 => 0.6078, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -5.62% (0.3026 => 0.2856, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.61% (0.4916 => 0.4640, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.61% (0.5456 => 0.5150, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/objinst: -5.60% (0.3194 => 0.3015, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.60% (0.2999 => 0.2831, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.59% (0.6676 => 0.6303, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.58% (0.2278 => 0.2151, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.57% (0.5168 => 0.4880, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.56% (5.4682 => 5.1640, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/moments: -5.56% (0.4248 => 0.4012, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -5.54% (0.3446 => 0.3255, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -5.54% (0.3394 => 0.3206, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -5.54% (2.1401 => 2.0216, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.54% (2.1713 => 2.0511, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: -5.52% (0.3621 => 0.3421, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: -5.52% (0.2989 => 0.2824, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.51% (0.9557 => 0.9030, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -5.50% (0.7982 => 0.7543, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.49% (1.2210 => 1.1540, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/ary2: -5.49% (0.3481 => 0.3290, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.49% (0.6033 => 0.5702, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.48% (8.0126 => 7.5738, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/matrix: -5.47% (0.3255 => 0.3077, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.46% (1.2221 => 1.1554, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: -5.45% (18.2933 => 17.2972, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/lists1: -5.43% (0.3867 => 0.3657, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.38% (0.4427 => 0.4189, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -5.37% (0.4524 => 0.4281, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: -5.36% (0.3788 => 0.3585, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.33% (0.3319 => 0.3142, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.32% (0.2385 => 0.2258, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.32% (0.2106 => 0.1994, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.30% (0.3491 => 0.3306, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -5.25% (15.2527 => 14.4515, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.23% (0.3252 => 0.3082, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.17% (0.2939 => 0.2787, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.17% (0.4083 => 0.3872, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.15% (0.2871 => 0.2723, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -5.15% (34.0927 => 32.3356, std.dev.: 0.0310) SingleSource/Benchmarks/Misc-C++/bigfib: -5.14% (0.6750 => 0.6403, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.11% (0.2933 => 0.2783, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.10% (0.3057 => 0.2901, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -5.07% (0.8418 => 0.7991, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.04% (0.3849 => 0.3655, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -5.03% (0.3059 => 0.2905, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.03% (0.2903 => 0.2757, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -4.99% (0.3205 => 0.3045, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.97% (0.3323 => 0.3158, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.95% (0.4321 => 0.4107, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: -4.92% (5.0226 => 4.7756, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hello: -4.88% (0.2849 => 0.2710, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -4.60% (0.7779 => 0.7421, std.dev.: 0.0036) SingleSource/UnitTests/ObjC++/Hello: -4.30% (0.6347 => 0.6074, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.21% (0.9077 => 0.8695, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference-object: -3.91% (0.6441 => 0.6189, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: -3.70% (1.5610 => 1.5033, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -2.63% (20.7746 => 20.2287, std.dev.: 0.0484) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7548, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/richards_benchmark: -8.73% (1.2842 => 1.1721, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.93% (2.2633 => 2.1744, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.91% (1.7753 => 1.7059, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.64% (6.5735 => 6.4660, std.dev.: 0.0055) Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 11 04:48:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 11 Nov 2012 06:48:01 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121111124801.04DEC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5764?compare_to=5761&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5764, Order: 167691, Start Time: 2012-11-11 09:32:33, End Time: 2012-11-11 12:48:15 To: 5761, Order: 167682, Start Time: 2012-11-11 05:24:43, End Time: 2012-11-11 08:44:10 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (175 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1039 (716 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.96% (0.2097 => 0.2243, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.31% (2.0581 => 2.1263, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.71% (0.6207 => 0.6101, std.dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 44.80% (0.0625 => 0.0905, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.52% (0.1063 => 0.1430, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.51% (0.2969 => 0.3756, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.49% (0.1106 => 0.1399, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 26.27% (1.5932 => 2.0118, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.75% (0.4253 => 0.5348, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.21% (0.0714 => 0.0894, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.13% (0.4139 => 0.5179, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.19% (0.4994 => 0.6202, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.00% (0.0475 => 0.0589, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.95% (0.0547 => 0.0678, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.86% (0.5000 => 0.6193, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.80% (0.5900 => 0.7304, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.46% (0.0584 => 0.0721, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.09% (0.1620 => 0.1994, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.76% (0.1107 => 0.1359, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.62% (0.1021 => 0.1252, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 22.20% (0.0599 => 0.0732, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.19% (0.0897 => 0.1096, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 21.73% (0.0948 => 0.1154, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.48% (0.0633 => 0.0769, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.40% (0.0584 => 0.0709, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.26% (0.0541 => 0.0656, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.21% (0.1103 => 0.1337, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 21.19% (0.0821 => 0.0995, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.03% (0.0642 => 0.0777, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.84% (0.1003 => 0.1212, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.83% (0.3903 => 0.4716, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.81% (0.0495 => 0.0598, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.66% (0.1549 => 0.1869, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/05-eks/eks: 20.57% (0.1619 => 0.1952, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 20.53% (0.0604 => 0.0728, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.44% (0.0822 => 0.0990, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.26% (0.1604 => 0.1929, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 19.85% (0.0947 => 0.1135, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.56% (0.1462 => 0.1748, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 19.43% (0.0808 => 0.0965, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.28% (0.3890 => 0.4640, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.12% (0.2014 => 0.2399, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 19.09% (0.5826 => 0.6938, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 19.00% (0.5889 => 0.7008, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 18.97% (0.1218 => 0.1449, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 18.62% (0.0698 => 0.0828, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.51% (1.3152 => 1.5586, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.38% (0.1088 => 0.1288, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 18.34% (0.1505 => 0.1781, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.31% (0.2736 => 0.3237, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: 18.29% (0.4029 => 0.4766, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.02% (0.0605 => 0.0714, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.01% (0.0572 => 0.0675, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.83% (0.2866 => 0.3377, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.80% (3.5627 => 4.1968, std.dev.: 0.0044) MultiSource/Applications/Burg/burg: 17.69% (0.5546 => 0.6527, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.68% (0.1968 => 0.2316, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.63% (0.0573 => 0.0674, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.58% (0.4658 => 0.5477, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 17.55% (1.8794 => 2.2093, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.30% (1.6211 => 1.9015, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.29% (0.2875 => 0.3372, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 17.25% (0.9697 => 1.1370, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.07% (0.1160 => 0.1358, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.00% (0.3271 => 0.3827, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 16.96% (0.1421 => 0.1662, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 16.91% (1.0781 => 1.2604, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: 16.80% (0.2714 => 0.3170, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.74% (0.3930 => 0.4588, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.74% (0.4361 => 0.5091, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 16.71% (0.7171 => 0.8369, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.67% (0.5026 => 0.5864, std.dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.65% (2.7292 => 3.1837, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 16.44% (0.2725 => 0.3173, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 16.43% (0.1284 => 0.1495, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.42% (4.4195 => 5.1453, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/strcat: 16.40% (0.2750 => 0.3201, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.40% (0.2738 => 0.3187, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 16.33% (0.2823 => 0.3284, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 16.32% (0.2813 => 0.3272, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.31% (0.2729 => 0.3174, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 16.28% (4.2109 => 4.8966, std.dev.: 0.0074) SingleSource/Regression/C++/ofstream_ctor: 16.25% (0.3004 => 0.3492, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 16.22% (0.2780 => 0.3231, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 16.15% (0.2811 => 0.3265, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.15% (0.1090 => 0.1266, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.11% (0.2911 => 0.3380, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 16.09% (0.2803 => 0.3254, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.05% (0.2792 => 0.3240, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.03% (0.3195 => 0.3707, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 15.89% (0.9909 => 1.1484, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.87% (1.9694 => 2.2820, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/wc: 15.83% (0.3096 => 0.3586, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.81% (1.9966 => 2.3122, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.72% (2.0673 => 2.3922, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 15.43% (0.3267 => 0.3771, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 15.37% (0.2075 => 0.2394, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 15.35% (0.3258 => 0.3758, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 15.32% (0.2566 => 0.2959, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.20% (0.3060 => 0.3525) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.17% (0.3488 => 0.4017, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.11% (0.3362 => 0.3870, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 15.10% (0.3317 => 0.3818, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 15.10% (23.5202 => 27.0718, std.dev.: 0.0346) SingleSource/UnitTests/ObjC/for-in: 15.02% (0.3496 => 0.4021, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions-4: 14.95% (0.3465 => 0.3983, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 14.92% (0.3446 => 0.3960, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.88% (0.3442 => 0.3954, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.85% (0.3469 => 0.3984, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.83% (0.3460 => 0.3973, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 14.79% (0.3678 => 0.4222, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.72% (0.3124 => 0.3584, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.72% (0.3282 => 0.3765, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 14.65% (1.4269 => 1.6359, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists: 14.61% (0.3348 => 0.3837, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists1: 14.55% (0.3477 => 0.3983, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions: 14.52% (0.3643 => 0.4172, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/sieve: 14.52% (0.3726 => 0.4267, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 14.49% (0.3650 => 0.4179, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 14.42% (0.3724 => 0.4261, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 14.38% (0.4146 => 0.4742, std.dev.: 0.0026) MultiSource/Applications/treecc/treecc: 14.32% (0.7875 => 0.9003, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.29% (0.3625 => 0.4143, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash2: 14.26% (0.4251 => 0.4857, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 14.12% (0.0758 => 0.0865, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 14.09% (2.1653 => 2.4704, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.07% (0.3690 => 0.4209, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 13.92% (4.6177 => 5.2605, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.92% (0.3981 => 0.4535, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.91% (0.3845 => 0.4380, std.dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 13.88% (2.1013 => 2.3930, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.73% (0.2040 => 0.2320, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 13.53% (0.5012 => 0.5690, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 13.08% (0.2691 => 0.3043, std.dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 12.47% (5.5417 => 6.2330, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.44% (0.1383 => 0.1555, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.20% (0.6435 => 0.7220, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.87% (0.1028 => 0.1150, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 11.72% (0.3498 => 0.3908, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.56% (0.2068 => 0.2307, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.44% (0.2737 => 0.3050, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 11.43% (0.4847 => 0.5401, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 11.31% (0.6634 => 0.7384, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.09% (0.3084 => 0.3426, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.84% (0.2103 => 0.2331, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.64% (0.3336 => 0.3691, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 10.44% (2.0346 => 2.2471, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 10.33% (0.2391 => 0.2638, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.21% (4.6926 => 5.1246, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.20% (0.5361 => 0.5854, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.17% (11.6398 => 12.7067, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.67% (0.5584 => 0.6068, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.56% (0.7426 => 0.8062, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 7.40% (11.9555 => 12.8402, std.dev.: 0.0141) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.56% (0.3792 => 0.4003, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0300, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 9.56% (0.2802 => 0.3070, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6112, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 5.70% (0.2122 => 0.2243, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6779, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-2: 4.91% (1.8057 => 1.8943, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1672, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/dry: 4.12% (14.0481 => 14.6267, std.dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.13% (2.0820 => 2.1263, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1964, std.dev.: 0.0075) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2236, std.dev.: 0.0046) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3028, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2880, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5813, std.dev.: 0.0135) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.81% (25.4195 => 16.5716, std.dev.: 0.0085) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9761, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7976, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: -6.87% (0.2402 => 0.2237, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8030, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.05% (0.6293 => 0.6101, std.dev.: 0.0041) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.37% (17.2379 => 16.8285, std.dev.: 0.0116) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.25% (41.7953 => 40.8567, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5754, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: -1.55% (5.5810 => 5.4947, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (105.3826 => 104.1947, std.dev.: 0.0672) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0425, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 11 14:51:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 11 Nov 2012 16:51:36 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121111225136.24ACD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5765?compare_to=5762&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5765, Order: 167692, Start Time: 2012-11-11 21:25:42, End Time: 2012-11-11 22:51:51 To: 5762, Order: 167691, Start Time: 2012-11-11 08:10:11, End Time: 2012-11-11 09:36:13 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 14 (99 on baseline) Performance Improvements: 2 (24 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 975 (851 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.09% (0.2060 => 0.2206, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.59% (0.5089 => 0.5221, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.41% (1.1884 => 1.2170, std.dev.: 0.0082) MultiSource/Applications/treecc/treecc: 2.29% (2.0193 => 2.0655, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.15% (0.6377 => 0.6514, std.dev.: 0.0037) MultiSource/Applications/Burg/burg: 2.13% (1.2578 => 1.2846, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.88% (0.8787 => 0.8952, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 1.84% (0.9883 => 1.0065, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.80% (1.0094 => 1.0276, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.74% (0.8798 => 0.8951, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.46% (0.7885 => 0.8000, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.45% (0.8856 => 0.8984, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 15.44% (0.7705 => 0.8895, std.dev.: 0.0195) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.79% (1.3114 => 1.4004, std.dev.: 0.0179) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.01% (13.5623 => 13.4259, std.dev.: 0.0275) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -1.86% (14.9851 => 14.7057, std.dev.: 0.0521) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.04% (16.7174 => 16.7236, std.dev.: 0.0772) MultiSource/Applications/obsequi/Obsequi: 1.63% (1.0527 => 1.0699, std.dev.: 0.0055) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.44% (21.8138 => 21.7188, std.dev.: 0.2415) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.16% (0.3661 => 0.3667, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/bigfib: -0.36% (0.6042 => 0.6020, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.24% (0.3330 => 0.3338, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: -0.20% (0.2019 => 0.2015, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 42.95% (0.0149 => 0.0213, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 8.14% (0.0393 => 0.0425, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 5.13% (0.0273 => 0.0287, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.91% (0.0309 => 0.0300, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.26% (0.0364 => 0.0405, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0205 => 0.0205, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/test1: -27.19% (0.0217 => 0.0158, std.dev.: 0.0028) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.75% (0.1458 => 0.1469, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: -1.02% (1.1653 => 1.1534, std.dev.: 0.0750) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.28% (0.1422 => 0.1418, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.67% (0.4128 => 0.4197, std.dev.: 0.0382) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.42% (0.1433 => 0.1384, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.28% (0.0614 => 0.0600, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 14.06% (0.0192 => 0.0219, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.28% (0.0569 => 0.0582, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.64% (1.2107 => 1.1908, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.44% (0.0606 => 0.0567, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 40.32% (0.0186 => 0.0261, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.18% (0.7791 => 0.7805, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 7.32% (0.0041 => 0.0044, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2299.21% (0.6332 => 15.1918, std.dev.: 0.3141) MultiSource/Benchmarks/McCat/08-main/main: 49.32% (0.1831 => 0.2734, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.64% (0.1559 => 0.1471, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1493.63% (0.3344 => 5.3291, std.dev.: 0.0967) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.35% (0.2364 => 0.3247, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: -2.10% (0.0429 => 0.0420, std.dev.: 0.0017) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.36% (0.0224 => 0.0236, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0000) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4324, std.dev.: 0.0107) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0698, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4887, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3590, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1332, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4043, std.dev.: 0.0068) SingleSource/Regression/C/uint64_to_float: -24.06% (2.1832 => 1.6579, std.dev.: 0.0041) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.15% (0.0810 => 0.0957, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.84% (0.0773 => 0.0880, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 12.50% (0.1112 => 0.1251, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.39% (0.6010 => 0.6514, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.72% (0.4847 => 0.5221, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.2279 => 0.2451, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.34% (0.2180 => 0.2340, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.05% (0.7473 => 0.8000, std.dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.22% (0.3137 => 0.3332, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.80% (0.1983 => 0.2098, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.71% (0.8148 => 0.8613, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.37% (0.3295 => 0.3472, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 5.11% (1.2222 => 1.2846, std.dev.: 0.0072) MultiSource/Applications/spiff/spiff: 4.77% (0.7950 => 0.8329, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.58% (0.5961 => 0.6234, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.50% (0.3003 => 0.3138, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 4.17% (0.2999 => 0.3124, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.15% (1.1685 => 1.2170, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.09% (0.8697 => 0.9053, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.02% (0.6287 => 0.6540, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.01% (0.9435 => 0.9813, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.96% (0.8611 => 0.8952, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.95% (1.1606 => 1.2064, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.71% (0.9908 => 1.0276, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.64% (1.4479 => 1.5006, std.dev.: 0.0061) MultiSource/Applications/treecc/treecc: 3.54% (1.9948 => 2.0655, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.41% (0.8656 => 0.8951, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 3.38% (4.1305 => 4.2701, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.07% (0.8716 => 0.8984, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.03% (0.4127 => 0.4252, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.01% (0.5817 => 0.5992, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.89% (1.6386 => 1.6860, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.77% (0.3717 => 0.3820, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.76% (0.8069 => 0.8292, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.73% (0.8855 => 0.9097, std.dev.: 0.0071) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.73% (6.6074 => 6.7875, std.dev.: 0.0247) MultiSource/Benchmarks/McCat/05-eks/eks: 2.71% (0.4397 => 0.4516, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.67% (1.3279 => 1.3634, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.66% (0.8457 => 0.8682, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 2.60% (0.9810 => 1.0065, std.dev.: 0.0060) MultiSource/Applications/lua/lua: 2.51% (3.8189 => 3.9148, std.dev.: 0.0295) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.51% (4.1763 => 4.2811, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.51% (8.6476 => 8.8644, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.43% (0.8317 => 0.8519, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.34% (0.8286 => 0.8480, std.dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 2.33% (1.1271 => 1.1534, std.dev.: 0.0057) MultiSource/Applications/minisat/minisat: 2.33% (0.6834 => 0.6993, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.31% (0.8007 => 0.8192, std.dev.: 0.0064) MultiSource/Benchmarks/Bullet/bullet: 2.22% (31.8598 => 32.5661, std.dev.: 0.0564) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.12% (0.8261 => 0.8436, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.12% (4.4880 => 4.5830, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.12% (0.9688 => 0.9893, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.08% (0.8204 => 0.8375, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.05% (0.8340 => 0.8511, std.dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: 1.98% (0.7557 => 0.7707, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.91% (0.9056 => 0.9229, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.90% (0.9039 => 0.9211, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.89% (1.1170 => 1.1381, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.86% (0.8338 => 0.8493, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.86% (13.1811 => 13.4259, std.dev.: 0.0275) MultiSource/Applications/siod/siod: 1.82% (2.2184 => 2.2588, std.dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.59% (1.5315 => 1.5558, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.58% (4.4873 => 4.5582, std.dev.: 0.0238) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.51% (1.2526 => 1.2715, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/football/football: 1.49% (0.8768 => 0.8899, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.47% (4.5702 => 4.6374, std.dev.: 0.0114) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.31% (0.8995 => 0.9113, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 1.21% (8.6247 => 8.7287, std.dev.: 0.0240) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 121.61% (0.0199 => 0.0441, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.38% (2.9753 => 3.4627, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.12% (0.7597 => 0.8746, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.43% (2.7995 => 3.2034, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.62% (5.0261 => 5.6103, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.82% (6.3772 => 7.0671, std.dev.: 0.2413) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.91% (1.1857 => 1.2795, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 7.12% (1.7056 => 1.8270, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.90% (4.7794 => 5.1092, std.dev.: 0.0663) SingleSource/Benchmarks/Misc/richards_benchmark: 6.29% (1.3037 => 1.3857, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.89% (4.9686 => 5.2611, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.83% (4.5327 => 4.7970, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.44% (3.3761 => 3.5261, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.43% (4.9453 => 5.1646, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.19% (6.2275 => 6.4887, std.dev.: 0.0126) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.10% (1.2337 => 1.2843, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.92% (4.9469 => 5.1408, std.dev.: 0.0134) MultiSource/Applications/hexxagon/hexxagon: 3.91% (14.0064 => 14.5543, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.51% (0.3587 => 0.3713, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.88% (11.5690 => 11.9027, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.64% (4.8660 => 4.9946, std.dev.: 0.0415) MultiSource/Applications/lambda-0_1_3/lambda: 2.63% (7.4933 => 7.6902, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 2.58% (3.6643 => 3.7589, std.dev.: 0.0250) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.49% (4.8362 => 4.9565, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.48% (8.2783 => 8.4835, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout/lists: 2.42% (7.3375 => 7.5152, std.dev.: 0.0398) SingleSource/Benchmarks/Dhrystone/dry: 2.24% (0.5081 => 0.5195, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.83% (4.3552 => 4.4350, std.dev.: 0.0257) SingleSource/Benchmarks/Misc/ReedSolomon: 1.29% (8.5322 => 8.6421, std.dev.: 0.0305) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.21% (3.5679 => 3.6109, std.dev.: 0.0155) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.05% (1.2474 => 1.2605, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.08% (5.4641 => 4.3122, std.dev.: 0.0141) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.03% (1.0512 => 0.9353, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: -10.82% (1.1216 => 1.0002, std.dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: -8.55% (63.1822 => 57.7783, std.dev.: 0.0248) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.87% (4.7482 => 4.4222, std.dev.: 0.0979) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -6.67% (7.2130 => 6.7318, std.dev.: 0.1724) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.61% (0.3269 => 0.3053, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.95% (5.4972 => 5.1703, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.89% (3.7148 => 3.4959, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.14% (5.1557 => 4.8909, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.47% (2.8773 => 2.7487, std.dev.: 0.0447) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.36% (4.7449 => 4.5380, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.70% (6.0224 => 5.7997, std.dev.: 0.0294) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.24% (0.5807 => 0.5619, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/life/life: -3.18% (2.6356 => 2.5518, std.dev.: 0.0171) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.00% (28.5821 => 27.7245, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.45% (9.9065 => 9.6639, std.dev.: 0.0527) MultiSource/Applications/aha/aha: -2.28% (3.3398 => 3.2636, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/hash2: -2.22% (3.4237 => 3.3478, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.00% (11.5316 => 11.3011, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.61% (4.9994 => 4.9187, std.dev.: 0.0067) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.57% (2.3487 => 2.3118, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.37% (3.2169 => 3.1728, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.19% (5.6343 => 5.5670, std.dev.: 0.0162) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.69% (16.4461 => 16.7236, std.dev.: 0.0772) MultiSource/Applications/obsequi/Obsequi: 4.26% (1.0262 => 1.0699, std.dev.: 0.0055) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6854.47% (0.3123 => 21.7188, std.dev.: 0.2415) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.88% (0.2463 => 0.3667, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/bigfib: 0.17% (0.6010 => 0.6020, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.20% (0.3266 => 0.3338, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 2.34% (0.1969 => 0.2015, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 73.17% (0.0123 => 0.0213, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 12.99% (0.0254 => 0.0287, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.66% (0.0302 => 0.0300, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 5.47% (0.0384 => 0.0405, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/test1: -12.22% (0.0180 => 0.0158, std.dev.: 0.0028) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.16% (0.1438 => 0.1469, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: 1.81% (1.1329 => 1.1534, std.dev.: 0.0750) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.01% (0.1462 => 0.1418, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.79% (0.4164 => 0.4197, std.dev.: 0.0382) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.10% (0.1369 => 0.1384, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.40% (0.0641 => 0.0600, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.31% (0.0195 => 0.0219, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.69% (0.0578 => 0.0582, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.12% (1.1437 => 1.1908, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.57% (0.0627 => 0.0567, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 45.00% (0.0180 => 0.0261, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.64% (0.8017 => 0.7805, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -29.03% (0.0062 => 0.0044, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 11 14:56:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 11 Nov 2012 16:56:49 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121111225649.70A2C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5766?compare_to=5763&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5766, Order: 167692, Start Time: 2012-11-11 21:32:08, End Time: 2012-11-11 22:57:04 To: 5763, Order: 167691, Start Time: 2012-11-11 08:12:42, End Time: 2012-11-11 09:37:45 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (181 on baseline) Unchanged Tests: 1041 (856 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 3.10% (3.7728 => 3.8896, std.dev.: 0.0072) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 3.90% (3.7435 => 3.8896, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.06% (2.0478 => 2.1105, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/salsa20: 2.63% (7.4937 => 7.6910, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hash2: 2.04% (3.1932 => 3.2585, std.dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.60% (0.1431 => 0.1308, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.83% (0.3821 => 0.3522, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -7.81% (2.4924 => 2.2978, std.dev.: 0.0054) MultiSource/Applications/sgefa/sgefa: -6.85% (0.3357 => 0.3127, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.84% (0.2428 => 0.2262, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.65% (0.3142 => 0.2933, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -6.61% (9.2283 => 8.6185, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.59% (3.5339 => 3.3009, std.dev.: 0.0043) MultiSource/Applications/JM/ldecod/ldecod: -6.49% (7.0961 => 6.6356, std.dev.: 0.0076) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.46% (22.4056 => 20.9575, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: -6.45% (16.1920 => 15.1479, std.dev.: 0.0206) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.44% (0.1584 => 0.1482, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.38% (0.9852 => 0.9223, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.37% (0.3658 => 0.3425, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.35% (0.1796 => 0.1682, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -6.33% (0.1879 => 0.1760, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.33% (1.0544 => 0.9877, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -6.30% (0.2160 => 0.2024, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: -6.29% (0.9179 => 0.8602, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.18% (1.6364 => 1.5353, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.18% (0.1716 => 0.1610, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.15% (1.3722 => 1.2878, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -6.15% (1.1450 => 1.0746, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.14% (0.3891 => 0.3652, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.14% (0.5863 => 0.5503, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -6.14% (0.3812 => 0.3578, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.14% (0.6484 => 0.6086, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -6.13% (0.3896 => 0.3657, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -6.13% (0.3848 => 0.3612, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: -6.13% (0.4176 => 0.3920, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: -6.13% (0.2659 => 0.2496, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.12% (1.2300 => 1.1547, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: -6.12% (1.2515 => 1.1749, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.12% (1.4642 => 1.3746, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-4: -6.11% (0.3880 => 0.3643, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.10% (0.7524 => 0.7065, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.10% (0.9542 => 0.8960, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.10% (0.7919 => 0.7436, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: -6.10% (0.2985 => 0.2803, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -6.08% (0.3831 => 0.3598, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.08% (1.2784 => 1.2007, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -6.08% (0.1761 => 0.1654, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.06% (0.5478 => 0.5146, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.06% (4.5069 => 4.2340, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.05% (0.5802 => 0.5451, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.05% (0.2695 => 0.2532, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.05% (0.5805 => 0.5454, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: -6.03% (1.1530 => 1.0835, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.02% (4.8802 => 4.5866, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.01% (4.8161 => 4.5266, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.01% (0.5857 => 0.5505, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.01% (0.7339 => 0.6898, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: -6.00% (0.4199 => 0.3947, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.00% (0.6052 => 0.5689, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.98% (4.0323 => 3.7911, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -5.98% (0.4033 => 0.3792, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -5.98% (4.3330 => 4.0741, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: -5.97% (17.1032 => 16.0817, std.dev.: 0.0070) MultiSource/Applications/SPASS/SPASS: -5.97% (15.5079 => 14.5819, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.97% (0.6736 => 0.6334, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.94% (0.6260 => 0.5888, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.94% (0.5859 => 0.5511, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.94% (0.5591 => 0.5259, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.93% (0.2548 => 0.2397, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.92% (6.7716 => 6.3709, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.91% (0.3483 => 0.3277, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.91% (0.5705 => 0.5368, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.90% (0.7198 => 0.6773, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -5.90% (0.3406 => 0.3205, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.90% (0.6395 => 0.6018, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.89% (0.5925 => 0.5576, std.dev.: 0.0009) MultiSource/Applications/lua/lua: -5.88% (4.0594 => 3.8206, std.dev.: 0.0020) MultiSource/Applications/siod/siod: -5.88% (2.4021 => 2.2609, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.87% (0.6304 => 0.5934, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.86% (14.2083 => 13.3755, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.85% (0.5849 => 0.5507, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.83% (0.6446 => 0.6070, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.83% (0.4151 => 0.3909, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.83% (1.6474 => 1.5514, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.83% (0.6230 => 0.5867, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.82% (0.6667 => 0.6279, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.82% (0.5569 => 0.5245, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -5.80% (0.7447 => 0.7015, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.80% (0.4813 => 0.4534, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.80% (0.6660 => 0.6274, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.77% (0.5456 => 0.5141, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.77% (0.5941 => 0.5598, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.77% (0.6395 => 0.6026, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.77% (0.6033 => 0.5685, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: -5.75% (0.3581 => 0.3375, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.75% (0.6189 => 0.5833, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.75% (0.6676 => 0.6292, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.73% (0.5581 => 0.5261, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: -5.73% (1.3148 => 1.2395, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -5.72% (0.4280 => 0.4035, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: -5.72% (1.3864 => 1.3071, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: -5.72% (0.4861 => 0.4583, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.72% (0.5999 => 0.5656, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.72% (0.6297 => 0.5937, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.72% (0.8521 => 0.8034, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.70% (0.6681 => 0.6300, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.70% (0.4916 => 0.4636, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.68% (0.6194 => 0.5842, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.68% (0.5567 => 0.5251, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -5.66% (0.3446 => 0.3251, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.65% (0.3025 => 0.2854, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -5.65% (0.3026 => 0.2855, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.65% (0.5329 => 0.5028, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.65% (0.2355 => 0.2222, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.64% (0.5688 => 0.5367, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.64% (5.4682 => 5.1597, std.dev.: 0.0037) MultiSource/Applications/d/make_dparser: -5.64% (3.5154 => 3.3171, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.64% (0.3884 => 0.3665, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.64% (0.6440 => 0.6077, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.64% (0.3016 => 0.2846, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.63% (0.3837 => 0.3621, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.62% (0.3931 => 0.3710, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.61% (0.5575 => 0.5262, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.61% (2.1713 => 2.0494, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.60% (0.2999 => 0.2831, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.60% (0.3323 => 0.3137, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: -5.59% (0.3255 => 0.3073, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: -5.59% (0.2989 => 0.2822, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.58% (0.6293 => 0.5942, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/ary: -5.57% (0.3394 => 0.3205, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.55% (0.7021 => 0.6631, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.55% (0.5168 => 0.4881, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -5.55% (0.3621 => 0.3420, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.55% (2.2587 => 2.1334, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.55% (0.9557 => 0.9027, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: -5.54% (0.3194 => 0.3017, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: -5.53% (0.3867 => 0.3653, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.53% (0.2278 => 0.2152, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: -5.51% (0.4248 => 0.4014, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.49% (0.2385 => 0.2254, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.47% (0.3252 => 0.3074, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.44% (0.4427 => 0.4186, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.44% (1.2221 => 1.1556, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.44% (8.0126 => 7.5767, std.dev.: 0.0034) MultiSource/Applications/kimwitu++/kc: -5.41% (18.2933 => 17.3042, std.dev.: 0.0085) MultiSource/Benchmarks/McCat/05-eks/eks: -5.38% (0.4515 => 0.4272, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.36% (1.2210 => 1.1556, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: -5.33% (0.4524 => 0.4283, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.33% (0.3849 => 0.3644, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -5.32% (0.7982 => 0.7557, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.32% (0.2106 => 0.1994, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -5.31% (0.3481 => 0.3296, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -5.31% (15.2527 => 14.4424, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.30% (0.3491 => 0.3306, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: -5.28% (0.3788 => 0.3588, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.28% (0.4321 => 0.4093, std.dev.: 0.0021) MultiSource/Applications/treecc/treecc: -5.26% (2.1401 => 2.0276, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.24% (0.4083 => 0.3869, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: -5.22% (0.2871 => 0.2721, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -5.17% (0.3059 => 0.2901, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -5.16% (0.6750 => 0.6402, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -5.14% (0.3271 => 0.3103, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.14% (0.3057 => 0.2900, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.10% (0.2939 => 0.2789, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.09% (0.3319 => 0.3150, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -5.08% (34.0927 => 32.3591, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.08% (0.2933 => 0.2784, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -5.05% (0.3205 => 0.3043, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.03% (0.2903 => 0.2757, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -4.98% (0.2849 => 0.2707, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -4.91% (0.8418 => 0.8005, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -4.88% (5.0226 => 4.7775, std.dev.: 0.0126) SingleSource/UnitTests/ObjC++/property-reference: -4.63% (0.7779 => 0.7419, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.30% (0.6347 => 0.6074, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: -4.07% (0.6441 => 0.6179, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.03% (0.9077 => 0.8711, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: -3.65% (1.5610 => 1.5041, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -2.53% (20.7746 => 20.2490, std.dev.: 0.0144) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7565, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: -8.77% (1.2842 => 1.1716, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.85% (2.2633 => 2.1761, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.27% (1.3096 => 1.2799, std.dev.: 0.0097) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.79% (6.5735 => 6.4557, std.dev.: 0.0059) Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 11 16:34:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 11 Nov 2012 18:34:13 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121112003413.5DB602A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5767?compare_to=5765&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5767, Order: 167695, Start Time: 2012-11-11 23:08:51, End Time: 2012-11-12 00:34:26 To: 5765, Order: 167692, Start Time: 2012-11-11 21:25:42, End Time: 2012-11-11 22:51:51 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 9 (96 on baseline) Performance Improvements: 9 (28 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 973 (850 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.46% (0.8516 => 0.8640, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 30.65% (1.9093 => 2.4945, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.02% (1.4968 => 1.8862, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.46% (0.3299 => 0.3446, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.60% (40.8372 => 42.3089, std.dev.: 0.1625) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.98% (21.6417 => 22.2871, std.dev.: 0.2226) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.61% (1.4004 => 1.4370, std.dev.: 0.0120) MultiSource/Applications/SPASS/SPASS: 1.83% (8.3452 => 8.4980, std.dev.: 0.0407) SingleSource/Benchmarks/Shootout-C++/methcall: 1.19% (8.9010 => 9.0072, std.dev.: 0.0277) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.90% (0.8952 => 0.8782, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.75% (1.2170 => 1.1957, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.66% (0.8613 => 0.8470, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/gs/gs: -1.64% (4.2701 => 4.2002, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.47% (8.8644 => 8.7338, std.dev.: 0.0395) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.40% (1.0276 => 1.0132, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.27% (4.6374 => 4.5785, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.10% (0.9118 => 0.9018, std.dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: -3.34% (0.8895 => 0.8598, std.dev.: 0.0054) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.12% (16.7236 => 16.7430, std.dev.: 0.0529) MultiSource/Applications/obsequi/Obsequi: -2.06% (1.0699 => 1.0479, std.dev.: 0.0077) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.03% (21.7188 => 21.7132, std.dev.: 0.2009) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.41% (0.3667 => 0.3652, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 1.51% (0.6020 => 0.6111, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.24% (0.3338 => 0.3346, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/strcat: 0.30% (0.2015 => 0.2021, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -38.97% (0.0213 => 0.0130, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.24% (0.0425 => 0.0424, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 14.98% (0.0287 => 0.0330, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0300 => 0.0300, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.68% (0.0405 => 0.0382, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/casts: -0.98% (0.0205 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 37.34% (0.0158 => 0.0217, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -1.02% (0.1469 => 0.1454, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/lemon/lemon: 2.84% (1.1534 => 1.1861, std.dev.: 0.0125) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.28% (0.1418 => 0.1422, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.29% (0.4197 => 0.4209, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.67% (0.1384 => 0.1421, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.33% (0.0600 => 0.0608, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 21.46% (0.0219 => 0.0266, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.41% (0.0582 => 0.0568, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.39% (1.1908 => 1.1954, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.23% (0.0031 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.58% (0.0567 => 0.0627, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.84% (0.0261 => 0.0204, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.22% (0.7805 => 0.7710, std.dev.: 0.0191) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 15.91% (0.0044 => 0.0051, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2298.89% (0.6332 => 15.1898, std.dev.: 0.1218) MultiSource/Benchmarks/McCat/08-main/main: 45.77% (0.1831 => 0.2669, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.93% (0.1559 => 0.1451, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1496.59% (0.3344 => 5.3390, std.dev.: 0.0269) SingleSource/Benchmarks/Misc-C++/Large/ray: 34.48% (0.2364 => 0.3179, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel: 1.40% (0.0429 => 0.0435, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.89% (0.0224 => 0.0222, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: -28.70% (0.0230 => 0.0164, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4232, std.dev.: 0.0115) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0729, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4937, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3394, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1362, std.dev.: 0.0161) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4087, std.dev.: 0.0010) SingleSource/Regression/C/uint64_to_float: -23.99% (2.1832 => 1.6595, std.dev.: 0.0018) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.09% (0.0810 => 0.0916, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.11% (0.6010 => 0.6377, std.dev.: 0.0054) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.80% (0.3137 => 0.3319, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.55% (0.7473 => 0.7888, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.24% (0.1983 => 0.2087, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: 4.75% (1.2222 => 1.2803, std.dev.: 0.0145) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.68% (0.2180 => 0.2282, std.dev.: 0.0025) MultiSource/Applications/hbd/hbd: 4.48% (1.4269 => 1.4908, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.33% (0.4847 => 0.5057, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ary2: 4.26% (0.2509 => 0.2616, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 4.14% (0.2969 => 0.3092, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.95% (0.8148 => 0.8470, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.71% (0.8331 => 0.8640, std.dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: 3.67% (0.2999 => 0.3109, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.10% (0.4127 => 0.4255, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.00% (1.4479 => 1.4914, std.dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.97% (0.5961 => 0.6138, std.dev.: 0.0068) MultiSource/Applications/lua/lua: 2.56% (3.8189 => 3.9166, std.dev.: 0.0286) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.48% (0.8457 => 0.8667, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/05-eks/eks: 2.39% (0.4397 => 0.4502, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.37% (0.4559 => 0.4667, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.36% (1.3279 => 1.3592, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.33% (1.1685 => 1.1957, std.dev.: 0.0047) MultiSource/Applications/SPASS/SPASS: 2.32% (14.2605 => 14.5912, std.dev.: 0.0758) MultiSource/Applications/treecc/treecc: 2.28% (1.9948 => 2.0403, std.dev.: 0.0129) MultiSource/Applications/siod/siod: 2.27% (2.2184 => 2.2687, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.26% (0.9908 => 1.0132, std.dev.: 0.0050) MultiSource/Applications/SIBsim4/SIBsim4: 2.23% (1.2568 => 1.2848, std.dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 2.23% (1.1271 => 1.1522, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.22% (0.8597 => 0.8788, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 2.18% (0.6834 => 0.6983, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.17% (0.4783 => 0.4887, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 2.17% (0.9810 => 1.0023, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.16% (0.8007 => 0.8180, std.dev.: 0.0057) MultiSource/Applications/ClamAV/clamscan: 2.15% (14.7684 => 15.0864, std.dev.: 0.0438) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.99% (0.8086 => 0.8247, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.99% (0.8611 => 0.8782, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 1.93% (3.2366 => 3.2991, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.91% (0.8317 => 0.8476, std.dev.: 0.0055) MultiSource/Applications/JM/ldecod/ldecod: 1.85% (6.7320 => 6.8563, std.dev.: 0.0123) MultiSource/Benchmarks/Bullet/bullet: 1.84% (31.8598 => 32.4474, std.dev.: 0.0478) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.82% (0.8338 => 0.8490, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.80% (0.9688 => 0.9862, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.74% (2.1401 => 2.1774, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.71% (0.8204 => 0.8344, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.70% (6.6074 => 6.7200, std.dev.: 0.0206) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.70% (0.8712 => 0.8860, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.70% (4.1763 => 4.2472, std.dev.: 0.0184) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.69% (0.8340 => 0.8481, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/gs/gs: 1.69% (4.1305 => 4.2002, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.66% (0.8177 => 0.8313, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 1.52% (0.8768 => 0.8901, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.50% (0.8885 => 0.9018, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.42% (0.9056 => 0.9185, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.42% (1.5315 => 1.5533, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.33% (0.8927 => 0.9046, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.33% (0.8420 => 0.8532, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.29% (0.8316 => 0.8423, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.26% (4.4880 => 4.5444, std.dev.: 0.0058) MultiSource/Applications/JM/lencod/lencod: 1.24% (15.3280 => 15.5179, std.dev.: 0.0421) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.19% (13.1811 => 13.3380, std.dev.: 0.0119) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 107.54% (0.0199 => 0.0413, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/pi: 57.93% (1.5795 => 2.4945, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.51% (0.7597 => 0.8851, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.37% (2.9753 => 3.4625, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.73% (2.7995 => 3.2119, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.47% (5.0261 => 5.6025, std.dev.: 0.0215) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.66% (6.3772 => 6.9297, std.dev.: 0.1270) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.16% (0.3186 => 0.3446, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.89% (1.1857 => 1.2792, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.10% (4.7794 => 5.1187, std.dev.: 0.0097) SingleSource/Benchmarks/McGill/queens: 6.92% (1.7056 => 1.8236, std.dev.: 0.0047) MultiSource/Applications/SIBsim4/SIBsim4: 6.13% (3.1873 => 3.3827, std.dev.: 0.0246) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.90% (4.9686 => 5.2618, std.dev.: 0.0365) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.89% (4.5327 => 4.7998, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/richards_benchmark: 5.42% (1.3037 => 1.3744, std.dev.: 0.0241) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.67% (3.3761 => 3.5338, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.39% (4.9453 => 5.1623, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.30% (6.2275 => 6.4950, std.dev.: 0.0273) MultiSource/Applications/hexxagon/hexxagon: 3.96% (14.0064 => 14.5608, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.52% (1.3882 => 1.4370, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.21% (0.3587 => 0.3702, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.10% (1.2337 => 1.2719, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.79% (11.5690 => 11.8913, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.74% (8.2783 => 8.5052, std.dev.: 0.0177) MultiSource/Applications/lambda-0_1_3/lambda: 2.73% (7.4933 => 7.6981, std.dev.: 0.0029) MultiSource/Applications/siod/siod: 2.63% (3.6643 => 3.7606, std.dev.: 0.0187) SingleSource/Benchmarks/Shootout/lists: 2.38% (7.3375 => 7.5119, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 2.32% (0.4353 => 0.4454, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.14% (41.4238 => 42.3089, std.dev.: 0.1625) SingleSource/Benchmarks/Stanford/FloatMM: 1.42% (0.8807 => 0.8932, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.38% (44.5605 => 45.1746, std.dev.: 0.0857) SingleSource/Benchmarks/Misc/ReedSolomon: 1.33% (8.5322 => 8.6461, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/power/power: 1.28% (1.2061 => 1.2215, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.22% (1.5941 => 1.6135, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: 1.09% (2.3560 => 2.3816, std.dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.25% (5.4641 => 4.3032, std.dev.: 0.0155) SingleSource/Benchmarks/McGill/chomp: -10.99% (1.1216 => 0.9983, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.87% (1.0512 => 0.9369, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -8.49% (63.1822 => 57.8175, std.dev.: 0.0787) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.17% (0.3269 => 0.3002, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ackermann: -7.02% (3.9188 => 3.6437, std.dev.: 0.0606) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.84% (4.7482 => 4.4232, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.84% (5.4972 => 5.1762, std.dev.: 0.0451) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.54% (3.7148 => 3.5091, std.dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/recursive: -5.14% (2.4490 => 2.3230, std.dev.: 0.0366) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.02% (5.1557 => 4.8971, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.43% (4.7449 => 4.5347, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.22% (2.8773 => 2.7558, std.dev.: 0.0466) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.79% (6.0224 => 5.7940, std.dev.: 0.0184) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.04% (28.5821 => 27.7127, std.dev.: 0.0464) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.85% (2.6356 => 2.5604, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.77% (0.5807 => 0.5646, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.67% (1.2822 => 1.2480, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.37% (1.0388 => 1.0142, std.dev.: 0.0076) MultiSource/Applications/aha/aha: -2.19% (3.3398 => 3.2666, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: -2.17% (0.8789 => 0.8598, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash2: -2.10% (3.4237 => 3.3519, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.00% (11.5316 => 11.3007, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.99% (9.9065 => 9.7092, std.dev.: 0.0299) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.65% (3.2169 => 3.1638, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.53% (4.9994 => 4.9227, std.dev.: 0.0173) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.48% (2.3487 => 2.3139, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.27% (5.6343 => 5.5627, std.dev.: 0.0029) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.81% (16.4461 => 16.7430, std.dev.: 0.0529) MultiSource/Applications/obsequi/Obsequi: 2.11% (1.0262 => 1.0479, std.dev.: 0.0077) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6852.67% (0.3123 => 21.7132, std.dev.: 0.2009) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.27% (0.2463 => 0.3652, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 1.68% (0.6010 => 0.6111, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.45% (0.3266 => 0.3346, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/strcat: 2.64% (0.1969 => 0.2021, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 5.69% (0.0123 => 0.0130, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.66% (0.0302 => 0.0300, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.52% (0.0384 => 0.0382, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.11% (0.1438 => 0.1454, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: 4.70% (1.1329 => 1.1861, std.dev.: 0.0125) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -2.74% (0.1462 => 0.1422, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.08% (0.4164 => 0.4209, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.80% (0.1369 => 0.1421, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.15% (0.0641 => 0.0608, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 36.41% (0.0195 => 0.0266, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.73% (0.0578 => 0.0568, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.52% (1.1437 => 1.1954, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0627 => 0.0627, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 13.33% (0.0180 => 0.0204, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.83% (0.8017 => 0.7710, std.dev.: 0.0191) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -17.74% (0.0062 => 0.0051, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 3.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 11 16:45:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 11 Nov 2012 18:45:11 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121112004511.40D2E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5768?compare_to=5766&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5768, Order: 167696, Start Time: 2012-11-11 23:20:21, End Time: 2012-11-12 00:45:26 To: 5766, Order: 167692, Start Time: 2012-11-11 21:32:08, End Time: 2012-11-11 22:57:04 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 1 (178 on baseline) Unchanged Tests: 1040 (859 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.33% (54.5378 => 56.3552, std.dev.: 0.1409) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -3.46% (3.8896 => 3.7549, std.dev.: 0.0510) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.26% (54.5751 => 56.3552, std.dev.: 0.1409) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1011, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: 2.54% (7.4937 => 7.6839, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/hash2: 2.26% (3.1932 => 3.2654, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.77% (0.3821 => 0.3524, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -7.70% (2.4924 => 2.3004, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.75% (0.2428 => 0.2264, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -6.70% (0.3357 => 0.3132, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.59% (0.3142 => 0.2935, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.58% (3.5339 => 3.3014, std.dev.: 0.0145) MultiSource/Benchmarks/mafft/pairlocalalign: -6.48% (9.2283 => 8.6302, std.dev.: 0.0069) MultiSource/Applications/JM/ldecod/ldecod: -6.42% (7.0961 => 6.6403, std.dev.: 0.0181) MultiSource/Applications/JM/lencod/lencod: -6.36% (16.1920 => 15.1629, std.dev.: 0.0110) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.35% (0.9852 => 0.9226, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.34% (22.4056 => 20.9843, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.34% (0.3658 => 0.3426, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.33% (1.0544 => 0.9877, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.31% (0.1584 => 0.1484, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: -6.27% (4.3330 => 4.0613, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/football/football: -6.26% (0.9179 => 0.8604, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-4: -6.26% (0.3880 => 0.3637, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.24% (0.3896 => 0.3653, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.23% (0.6484 => 0.6080, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.22% (0.3891 => 0.3649, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.21% (0.3848 => 0.3609, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-2: -6.19% (0.3831 => 0.3594, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -6.18% (0.4176 => 0.3918) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.18% (0.1716 => 0.1610, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: -6.16% (0.3812 => 0.3577, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: -6.16% (1.2515 => 1.1744, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/for-in: -6.15% (0.4033 => 0.3785, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -6.13% (1.1450 => 1.0748, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -6.13% (0.2659 => 0.2496, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.13% (0.3884 => 0.3646, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.10% (4.5069 => 4.2322, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.09% (1.3722 => 1.2886, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.09% (1.6364 => 1.5368, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.07% (0.5863 => 0.5507, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -6.06% (0.2160 => 0.2029, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.06% (0.9542 => 0.8964, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -6.05% (0.4199 => 0.3945, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.05% (0.2695 => 0.2532, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.03% (0.2355 => 0.2213, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.02% (1.2784 => 1.2014, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.02% (0.4151 => 0.3901, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -6.02% (0.1761 => 0.1655, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.01% (6.7716 => 6.3643, std.dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: -6.01% (1.1530 => 1.0837, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.01% (0.5478 => 0.5149, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -6.00% (15.5079 => 14.5770, std.dev.: 0.0128) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.99% (4.8802 => 4.5879, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.99% (4.0323 => 3.7908, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.99% (4.8161 => 4.5278, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.96% (0.5802 => 0.5456, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.95% (1.2300 => 1.1568, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.95% (1.4642 => 1.3771, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.93% (0.6052 => 0.5693, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.91% (0.5857 => 0.5511, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.89% (0.7524 => 0.7081, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.89% (0.2548 => 0.2398, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -5.86% (0.4280 => 0.4029, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -5.86% (2.4021 => 2.2613, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.86% (0.5805 => 0.5465, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.85% (0.6304 => 0.5935, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -5.85% (17.1032 => 16.1025, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.85% (0.7339 => 0.6910, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.84% (0.6681 => 0.6291, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.83% (0.6736 => 0.6343, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.83% (0.5849 => 0.5508, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.82% (1.6474 => 1.5515, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.82% (14.2083 => 13.3818, std.dev.: 0.0106) MultiSource/Benchmarks/sim/sim: -5.81% (0.3406 => 0.3208, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.79% (0.5925 => 0.5582, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -5.79% (1.3148 => 1.2387, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.79% (0.5859 => 0.5520, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.79% (0.6395 => 0.6025, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.78% (0.6260 => 0.5898, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.78% (0.6230 => 0.5870, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.77% (0.6667 => 0.6282, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.77% (0.3931 => 0.3704, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -5.77% (4.0594 => 3.8252, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.77% (0.6293 => 0.5930, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: -5.75% (0.3025 => 0.2851, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.75% (0.5705 => 0.5377, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.74% (0.3483 => 0.3283, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.74% (0.3016 => 0.2843, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.73% (0.5581 => 0.5261, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: -5.73% (0.3194 => 0.3011, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.73% (0.5569 => 0.5250, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.72% (0.3323 => 0.3133, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.71% (0.6446 => 0.6078, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.71% (0.6395 => 0.6030, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -5.70% (0.4861 => 0.4584, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.70% (0.7198 => 0.6788, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.69% (0.5575 => 0.5258, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.69% (0.6033 => 0.5690, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: -5.68% (0.3255 => 0.3070, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.68% (0.7919 => 0.7469, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.68% (0.5456 => 0.5146, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.68% (0.3837 => 0.3619, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.68% (0.6676 => 0.6297, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.68% (0.4916 => 0.4637, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.66% (0.6660 => 0.6283, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -5.66% (0.3394 => 0.3202, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.65% (1.3864 => 1.3080, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/strcat: -5.65% (0.2989 => 0.2820, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.65% (0.6297 => 0.5941, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -5.65% (0.3026 => 0.2855, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -5.64% (0.3581 => 0.3379, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.64% (0.2999 => 0.2830, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: -5.63% (0.3446 => 0.3252, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.62% (0.2278 => 0.2150, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.61% (2.1713 => 2.0495, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.61% (0.6189 => 0.5842, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -5.61% (0.3621 => 0.3418, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.61% (0.5941 => 0.5608, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.60% (0.5567 => 0.5255, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/ary2: -5.60% (0.3481 => 0.3286, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -5.60% (0.7447 => 0.7030, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.59% (5.4682 => 5.1623, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.57% (0.5688 => 0.5371, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.56% (0.8521 => 0.8047, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.56% (0.6440 => 0.6082, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.56% (0.4427 => 0.4181, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: -5.56% (0.4248 => 0.4012, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -5.55% (3.5154 => 3.3203, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.55% (0.5570 => 0.5261, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.55% (0.9557 => 0.9027, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.54% (0.7021 => 0.6632, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.53% (2.2587 => 2.1339, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists1: -5.51% (0.3867 => 0.3654, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -5.50% (0.4524 => 0.4275, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.50% (0.5168 => 0.4884, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -5.49% (18.2933 => 17.2891, std.dev.: 0.0233) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.45% (0.2385 => 0.2255, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.44% (8.0126 => 7.5766, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/05-eks/eks: -5.43% (0.4515 => 0.4270, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: -5.41% (2.1401 => 2.0244, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.40% (0.5999 => 0.5675, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.38% (0.4813 => 0.4554, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -5.36% (0.2985 => 0.2825, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: -5.33% (0.3788 => 0.3586, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.33% (0.3491 => 0.3305, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.30% (0.3849 => 0.3645, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.30% (0.3057 => 0.2895, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: -5.29% (0.2871 => 0.2719, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.29% (0.4083 => 0.3867, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -5.29% (0.7982 => 0.7560, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.27% (0.2106 => 0.1995, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -5.26% (15.2527 => 14.4500, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.26% (1.2221 => 1.1578, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.23% (0.4321 => 0.4095, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.23% (0.3252 => 0.3082, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.22% (0.2933 => 0.2780, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -5.21% (0.6750 => 0.6398, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.21% (0.2939 => 0.2786, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -5.20% (0.3059 => 0.2900, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.18% (1.2210 => 1.1578, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.17% (0.2903 => 0.2753, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: -5.16% (0.2849 => 0.2702, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.12% (0.3319 => 0.3149, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: -5.12% (0.3205 => 0.3041, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -5.11% (0.3271 => 0.3104, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -5.08% (34.0927 => 32.3612, std.dev.: 0.0073) MultiSource/Applications/spiff/spiff: -4.89% (0.8418 => 0.8006, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: -4.76% (5.0226 => 4.7836, std.dev.: 0.0043) SingleSource/UnitTests/ObjC++/property-reference: -4.63% (0.7779 => 0.7419, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.22% (0.6347 => 0.6079, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -4.09% (1.5610 => 1.4971, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -3.99% (0.6441 => 0.6184, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.81% (0.9077 => 0.8731, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -2.52% (20.7746 => 20.2506, std.dev.: 0.0139) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7499, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1733, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.84% (2.2633 => 2.1763, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.81% (1.3096 => 1.2859, std.dev.: 0.0080) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.49% (6.5735 => 6.4755, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 11 17:12:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 11 Nov 2012 19:12:06 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121112011206.A50462A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5769?compare_to=5764&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5769, Order: 167692, Start Time: 2012-11-11 21:56:51, End Time: 2012-11-12 01:12:21 To: 5764, Order: 167691, Start Time: 2012-11-11 09:32:33, End Time: 2012-11-11 12:48:15 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (176 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (715 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.26% (54.0373 => 54.7200, std.dev.: 0.0978) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 44.96% (0.0625 => 0.0906, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.71% (0.1063 => 0.1432, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.54% (0.2969 => 0.3757, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.49% (0.1106 => 0.1399, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 26.40% (1.5932 => 2.0138, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.68% (0.4253 => 0.5345, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.44% (0.4139 => 0.5192, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.21% (0.0714 => 0.0894, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.25% (0.4994 => 0.6205, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.21% (0.0475 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.12% (0.5900 => 0.7323, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.98% (0.5000 => 0.6199, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.63% (0.0584 => 0.0722, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.58% (0.0547 => 0.0676, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.02% (0.1021 => 0.1256) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.96% (0.1620 => 0.1992, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.85% (0.1107 => 0.1360, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.74% (0.0897 => 0.1101, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 22.20% (0.0599 => 0.0732, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 21.73% (0.0948 => 0.1154, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.48% (0.0633 => 0.0769, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.31% (0.1103 => 0.1338, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.26% (0.0541 => 0.0656, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.23% (0.0584 => 0.0708, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.18% (0.0642 => 0.0778, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 21.07% (0.0821 => 0.0994, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.01% (0.0495 => 0.0599, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.94% (0.1003 => 0.1213, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.79% (0.1549 => 0.1871, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.75% (0.3903 => 0.4713, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.68% (0.0822 => 0.0992, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 20.63% (0.1619 => 0.1953, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 20.53% (0.0604 => 0.0728, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.51% (0.1604 => 0.1933, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 19.85% (0.0947 => 0.1135, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 19.79% (0.0581 => 0.0696, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.63% (0.1462 => 0.1749, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 19.31% (0.0808 => 0.0964, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.18% (0.3890 => 0.4636, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 19.17% (0.5826 => 0.6943, std.dev.: 0.0110) MultiSource/Benchmarks/McCat/08-main/main: 19.13% (0.1218 => 0.1451, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.07% (0.2014 => 0.2398, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 19.04% (0.5889 => 0.7010, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 18.54% (0.4029 => 0.4776, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.53% (1.3152 => 1.5589, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 18.48% (0.0698 => 0.0827, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.47% (0.1088 => 0.1289, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.27% (0.2736 => 0.3236, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 18.27% (0.1505 => 0.1780, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.02% (0.0605 => 0.0714, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.01% (0.0572 => 0.0675) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.00% (0.2866 => 0.3382, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.82% (0.4658 => 0.5488, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.81% (3.5627 => 4.1973, std.dev.: 0.0050) MultiSource/Applications/Burg/burg: 17.80% (0.5546 => 0.6533, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.73% (0.1968 => 0.2317, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 17.65% (1.8794 => 2.2111, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.63% (0.0573 => 0.0674, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 17.41% (0.9697 => 1.1385, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.35% (1.6211 => 1.9023, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.33% (0.5026 => 0.5897, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.27% (0.3271 => 0.3836, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.24% (0.1160 => 0.1360, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.04% (0.2875 => 0.3365, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 16.97% (1.0781 => 1.2610, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 16.89% (0.1421 => 0.1661, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.79% (0.4361 => 0.5093, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 16.76% (0.7171 => 0.8373, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.74% (0.3930 => 0.4588, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.72% (2.7292 => 3.1856, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.58% (4.4195 => 5.1521, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hello: 16.43% (0.2714 => 0.3160, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 16.43% (0.1284 => 0.1495, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 16.43% (4.2109 => 4.9027, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/fibo: 16.40% (0.2725 => 0.3172, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.40% (0.2738 => 0.3187, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.34% (0.2729 => 0.3175, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.30% (0.2792 => 0.3247, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 16.29% (0.2780 => 0.3233, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 16.26% (0.2823 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 16.25% (0.2813 => 0.3270, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 16.22% (0.2750 => 0.3196, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.18% (0.2911 => 0.3382, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.15% (0.1090 => 0.1266, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.06% (0.3195 => 0.3708, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 16.05% (0.3004 => 0.3486, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 16.04% (0.2811 => 0.3262, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 15.98% (0.2803 => 0.3251, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 15.97% (0.9909 => 1.1491, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 15.96% (0.3096 => 0.3590, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.85% (1.9694 => 2.2815, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.72% (2.0673 => 2.3922, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.70% (1.9966 => 2.3100, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 15.49% (0.3267 => 0.3773, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 15.42% (0.2075 => 0.2395, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 15.38% (0.3258 => 0.3759, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 15.26% (23.5202 => 27.1093, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 15.24% (0.2566 => 0.2957, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.16% (0.3060 => 0.3524, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.14% (0.3362 => 0.3871, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 15.13% (0.3317 => 0.3819, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.11% (0.3488 => 0.4015, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 14.99% (0.3496 => 0.4020, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.92% (0.3465 => 0.3982, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.92% (0.3124 => 0.3590, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.90% (0.3469 => 0.3986, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.88% (0.3442 => 0.3954, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 14.87% (0.3678 => 0.4225, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 14.86% (0.3446 => 0.3958, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.83% (0.3460 => 0.3973, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 14.81% (0.3477 => 0.3992, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 14.68% (0.3726 => 0.4273, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/lists: 14.67% (0.3348 => 0.3839, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.66% (0.3282 => 0.3763, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 14.65% (1.4269 => 1.6360, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: 14.55% (0.3643 => 0.4173, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 14.55% (0.3650 => 0.4181, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 14.50% (0.3724 => 0.4264, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 14.38% (0.4146 => 0.4742, std.dev.: 0.0022) MultiSource/Applications/treecc/treecc: 14.29% (0.7875 => 0.9000, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 14.26% (0.4251 => 0.4857, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.23% (0.3625 => 0.4141, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.19% (0.3981 => 0.4546, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 14.12% (0.0758 => 0.0865, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 14.11% (2.1653 => 2.4709, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.01% (0.3690 => 0.4207, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.86% (0.3845 => 0.4378, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 13.86% (4.6177 => 5.2578, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.82% (0.2040 => 0.2322, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 13.81% (2.1013 => 2.3915, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 13.57% (0.5012 => 0.5692, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 13.27% (0.2691 => 0.3048, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 12.71% (5.5417 => 6.2461, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.51% (0.1383 => 0.1556, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.20% (0.6435 => 0.7220, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.96% (0.1028 => 0.1151, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 11.78% (0.3498 => 0.3910, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.70% (0.2068 => 0.2310, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.51% (0.2737 => 0.3052, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 11.47% (0.4847 => 0.5403, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 11.31% (0.6634 => 0.7384, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.22% (0.3084 => 0.3430, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 10.67% (0.3336 => 0.3692, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: 10.58% (0.2391 => 0.2644, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 10.53% (2.0346 => 2.2489, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.51% (0.2103 => 0.2324, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.70% (0.5361 => 0.5881, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.26% (4.6926 => 5.1272, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.19% (11.6398 => 12.7098, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.79% (0.5584 => 0.6075, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.75% (0.7426 => 0.8076, std.dev.: 0.0033) MultiSource/Applications/kimwitu++/kc: 7.44% (11.9555 => 12.8453, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.54% (0.3792 => 0.4002, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 9.10% (0.2802 => 0.3057, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6104, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 5.84% (0.2122 => 0.2246, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6762, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1660, std.dev.: 0.0203) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.49% (0.3693 => 0.3859, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-2: 4.39% (1.8057 => 1.8850, std.dev.: 0.0064) SingleSource/Benchmarks/Dhrystone/dry: 4.17% (14.0481 => 14.6336, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1921, std.dev.: 0.0469) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.55% (3.1722 => 3.2213, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2896, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3021, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5912, std.dev.: 0.0285) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5688, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/ary2: -9.03% (0.2402 => 0.2185, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9769, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7941, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8047, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0059) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7729, std.dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/fldry: -3.02% (17.2379 => 16.7181, std.dev.: 0.0619) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.25% (41.7953 => 40.8569, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5740, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4955, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (105.3826 => 104.1870, std.dev.: 0.0755) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0436, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 11 18:17:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 11 Nov 2012 20:17:48 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121112021748.2FD352A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5770?compare_to=5767&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5770, Order: 167698, Start Time: 2012-11-12 00:52:17, End Time: 2012-11-12 02:18:03 To: 5767, Order: 167695, Start Time: 2012-11-11 23:08:51, End Time: 2012-11-12 00:34:26 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 8 (104 on baseline) Performance Improvements: 1 (25 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 982 (845 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 9.19% (0.1132 => 0.1236, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.77% (0.6347 => 0.6523, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.85% (0.9650 => 0.9829, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.81% (1.1957 => 1.2173, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.15% (0.8862 => 0.8964, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.07% (2.4528 => 2.5772, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.15% (2.2525 => 2.3010, std.dev.: 0.0148) SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.06% (0.9547 => 0.9648, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.76% (0.8640 => 0.8488, std.dev.: 0.0027) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.52% (16.7430 => 16.6552, std.dev.: 0.0519) MultiSource/Applications/obsequi/Obsequi: 2.00% (1.0479 => 1.0689, std.dev.: 0.0186) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.16% (21.7132 => 21.6792, std.dev.: 0.2434) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.05% (0.3652 => 0.3650, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/bigfib: -1.00% (0.6111 => 0.6050, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.75% (0.3346 => 0.3321, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/strcat: -0.40% (0.2021 => 0.2013, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 66.92% (0.0130 => 0.0217, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.24% (0.0424 => 0.0423, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.30% (0.0330 => 0.0329, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.00% (0.0300 => 0.0312, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.73% (0.0382 => 0.0423, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0203 => 0.0203, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -0.46% (0.0217 => 0.0216, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.28% (0.1454 => 0.1458, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.59% (1.1861 => 1.1672, std.dev.: 0.0247) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.83% (0.1422 => 0.1396, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.54% (0.4209 => 0.4144, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.22% (0.1421 => 0.1481, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.07% (0.0608 => 0.0565, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -19.92% (0.0266 => 0.0213, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.76% (0.0568 => 0.0578, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.32% (1.1954 => 1.1916, std.dev.: 0.0622) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.67% (0.0030 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.64% (0.0627 => 0.0631, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.29% (0.0204 => 0.0183, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.35% (0.7710 => 0.7814, std.dev.: 0.0186) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 90.20% (0.0051 => 0.0097, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2303.00% (0.6332 => 15.2158, std.dev.: 0.1120) MultiSource/Benchmarks/McCat/08-main/main: 47.13% (0.1831 => 0.2694, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.62% (0.1559 => 0.1409, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1505.56% (0.3344 => 5.3690, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.49% (0.2364 => 0.3203, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: 2.10% (0.0429 => 0.0438, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.45% (0.0224 => 0.0225, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -27.83% (0.0230 => 0.0166, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4245, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0738, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4970, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3463, std.dev.: 0.0192) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1303, std.dev.: 0.0287) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4095, std.dev.: 0.0023) SingleSource/Regression/C/uint64_to_float: -24.27% (2.1832 => 1.6533, std.dev.: 0.0054) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.16% (0.0810 => 0.0949, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.62% (0.0848 => 0.0955, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: 11.15% (0.1112 => 0.1236, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.70% (0.2180 => 0.2326, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.46% (0.7473 => 0.7956, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.46% (0.4847 => 0.5160, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.45% (0.1983 => 0.2091, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.26% (0.8321 => 0.8759, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.61% (0.2279 => 0.2384, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.48% (1.1606 => 1.2126, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.18% (1.1685 => 1.2173, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.18% (0.9435 => 0.9829, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.17% (0.2519 => 0.2624, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.13% (0.5961 => 0.6207, std.dev.: 0.0046) MultiSource/Applications/hbd/hbd: 3.87% (1.4269 => 1.4821, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.83% (0.4127 => 0.4285, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.75% (0.6287 => 0.6523, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.74% (0.2998 => 0.3110, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.28% (1.3279 => 1.3715, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.20% (0.4783 => 0.4936, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.07% (0.8697 => 0.8964, std.dev.: 0.0025) MultiSource/Applications/lua/lua: 2.89% (3.8189 => 3.9293, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 2.79% (0.6834 => 0.7025, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 2.64% (1.1271 => 1.1569, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.55% (1.4479 => 1.4848, std.dev.: 0.0134) MultiSource/Benchmarks/McCat/05-eks/eks: 2.55% (0.4397 => 0.4509, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.37% (14.7684 => 15.1178, std.dev.: 0.0356) MultiSource/Benchmarks/MallocBench/gs/gs: 2.34% (4.1305 => 4.2270, std.dev.: 0.0296) MultiSource/Applications/SPASS/SPASS: 2.33% (14.2605 => 14.5928, std.dev.: 0.0413) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.23% (6.6074 => 6.7545, std.dev.: 0.0325) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.21% (0.9069 => 0.9269, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.18% (0.8340 => 0.8522, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.16% (4.4880 => 4.5850, std.dev.: 0.0190) MultiSource/Applications/hexxagon/hexxagon: 2.10% (0.9810 => 1.0016, std.dev.: 0.0060) MultiSource/Applications/d/make_dparser: 2.08% (3.2366 => 3.3040, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.07% (0.8611 => 0.8789, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.02% (0.8518 => 0.8690, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.01% (0.6227 => 0.6352, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.93% (8.6476 => 8.8142, std.dev.: 0.0483) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.92% (0.8069 => 0.8224, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.91% (0.9908 => 1.0097, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.89% (0.8457 => 0.8617, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.88% (0.8331 => 0.8488, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.87% (0.9074 => 0.9244, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.87% (0.8007 => 0.8157, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.87% (0.9688 => 0.9869, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.85% (0.8359 => 0.8514, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.82% (0.8177 => 0.8326, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.82% (0.8420 => 0.8573, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.80% (0.9056 => 0.9219, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.78% (0.9039 => 0.9200, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.68% (0.8855 => 0.9004, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.67% (13.1811 => 13.4018, std.dev.: 0.0446) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.66% (0.8204 => 0.8340, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.65% (0.8716 => 0.8860, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 1.63% (31.8598 => 32.3781, std.dev.: 0.0731) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.61% (2.1401 => 2.1746, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.60% (1.1170 => 1.1349, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.60% (0.8805 => 0.8946, std.dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 1.58% (4.9628 => 5.0411, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.56% (3.1832 => 3.2327, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.45% (0.8048 => 0.8165, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 1.43% (2.2184 => 2.2501, std.dev.: 0.0099) MultiSource/Applications/JM/ldecod/ldecod: 1.41% (6.7320 => 6.8270, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.40% (0.8261 => 0.8377, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.40% (0.8885 => 0.9009, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 1.35% (8.6247 => 8.7409, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.33% (0.8066 => 0.8173, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.21% (0.8338 => 0.8439, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.18% (4.4873 => 4.5404, std.dev.: 0.0200) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 127.14% (0.0199 => 0.0452, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/pi: 58.14% (1.5795 => 2.4979, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.02% (0.7597 => 0.8890, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.39% (2.9753 => 3.4630, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.72% (2.7995 => 3.2117, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.62% (5.0261 => 5.6101, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.12% (6.3772 => 6.9591, std.dev.: 0.0802) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.05% (1.1857 => 1.2812, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.72% (0.3186 => 0.3432, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/queens: 7.36% (1.7056 => 1.8311, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.63% (4.7794 => 5.0961, std.dev.: 0.0308) SingleSource/Benchmarks/Misc/richards_benchmark: 6.46% (1.3037 => 1.3879, std.dev.: 0.0080) MultiSource/Applications/SIBsim4/SIBsim4: 6.46% (3.1873 => 3.3931, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.94% (4.9686 => 5.2637, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.87% (4.5327 => 4.7987, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.72% (3.3761 => 3.5354, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.45% (4.9453 => 5.1656, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.39% (6.2275 => 6.5009, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.08% (4.9469 => 5.1487, std.dev.: 0.0117) MultiSource/Applications/hexxagon/hexxagon: 3.77% (14.0064 => 14.5342, std.dev.: 0.0083) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.26% (1.2337 => 1.2739, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.90% (11.5690 => 11.9048, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.87% (8.2783 => 8.5157, std.dev.: 0.0091) MultiSource/Applications/siod/siod: 2.73% (3.6643 => 3.7643, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: 2.72% (7.4933 => 7.6974, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.67% (4.8660 => 4.9959, std.dev.: 0.0212) SingleSource/Benchmarks/Shootout/lists: 2.39% (7.3375 => 7.5129, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.33% (2.2485 => 2.3010, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.99% (4.8362 => 4.9322, std.dev.: 0.0345) SingleSource/Benchmarks/Dhrystone/dry: 1.97% (0.5081 => 0.5181, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.75% (2.4647 => 2.5078, std.dev.: 0.0141) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.28% (1.1365 => 1.1511, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/ReedSolomon: 1.27% (8.5322 => 8.6403, std.dev.: 0.0151) MultiSource/Benchmarks/Olden/bh/bh: 1.13% (2.3560 => 2.3826, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.46% (5.4641 => 4.2917, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.94% (7.2130 => 6.3518, std.dev.: 0.1117) SingleSource/Benchmarks/McGill/chomp: -11.18% (1.1216 => 0.9962, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.82% (1.0512 => 0.9375, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: -8.53% (63.1822 => 57.7920, std.dev.: 0.1007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -7.00% (4.7482 => 4.4157, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.42% (0.3269 => 0.3059, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.96% (3.7148 => 3.4934, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.86% (5.4972 => 5.1748, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.07% (5.1557 => 4.8942, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.88% (2.4490 => 2.3295, std.dev.: 0.0218) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.30% (4.7449 => 4.5411, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.65% (6.0224 => 5.8027, std.dev.: 0.0066) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.60% (2.8773 => 2.7738, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.24% (0.5807 => 0.5619, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.98% (28.5821 => 27.7314, std.dev.: 0.0497) MultiSource/Benchmarks/Olden/bisort/bisort: -2.68% (0.6636 => 0.6458, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash2: -2.46% (3.4237 => 3.3396, std.dev.: 0.0236) MultiSource/Applications/aha/aha: -2.37% (3.3398 => 3.2606, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.13% (9.9065 => 9.6956, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.04% (11.5316 => 11.2958, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.01% (3.2169 => 3.1521, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.58% (4.9994 => 4.9203, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.33% (2.3487 => 2.3174, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.31% (5.6343 => 5.5604, std.dev.: 0.0118) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.27% (16.4461 => 16.6552, std.dev.: 0.0519) MultiSource/Applications/obsequi/Obsequi: 4.16% (1.0262 => 1.0689, std.dev.: 0.0186) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6841.79% (0.3123 => 21.6792, std.dev.: 0.2434) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.19% (0.2463 => 0.3650, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/bigfib: 0.67% (0.6010 => 0.6050, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.68% (0.3266 => 0.3321, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/strcat: 2.23% (0.1969 => 0.2013, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.68% (0.0408 => 0.0423, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.53% (0.0254 => 0.0329, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.39% (0.1438 => 0.1458, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 3.03% (1.1329 => 1.1672, std.dev.: 0.0247) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.51% (0.1462 => 0.1396, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.48% (0.4164 => 0.4144, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.18% (0.1369 => 0.1481, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.86% (0.0641 => 0.0565, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 9.23% (0.0195 => 0.0213, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: - (0.0578 => 0.0578, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.19% (1.1437 => 1.1916, std.dev.: 0.0622) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.64% (0.0627 => 0.0631, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.67% (0.0180 => 0.0183, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.53% (0.8017 => 0.7814, std.dev.: 0.0186) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 56.45% (0.0062 => 0.0097, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 11 18:33:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 11 Nov 2012 20:33:36 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121112023336.3E9E32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5771?compare_to=5768&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5771, Order: 167698, Start Time: 2012-11-12 01:08:34, End Time: 2012-11-12 02:33:50 To: 5768, Order: 167696, Start Time: 2012-11-11 23:20:21, End Time: 2012-11-12 00:45:26 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (177 on baseline) Unchanged Tests: 1041 (861 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.78% (78.0230 => 80.1894, std.dev.: 0.4621) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.64% (2.0478 => 2.1019, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/salsa20: 2.42% (7.4937 => 7.6748, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash2: 2.29% (3.1932 => 3.2664, std.dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.80% (0.3821 => 0.3523, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -7.70% (2.4924 => 2.3004, std.dev.: 0.0119) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.80% (0.2428 => 0.2263, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.57% (3.5339 => 3.3018, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -6.49% (0.3357 => 0.3139, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.48% (0.3658 => 0.3421, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -6.47% (9.2283 => 8.6308, std.dev.: 0.0094) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.41% (22.4056 => 20.9702, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.40% (0.3142 => 0.2941, std.dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: -6.38% (7.0961 => 6.6437, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.34% (1.0544 => 0.9875, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-2: -6.32% (0.3831 => 0.3589, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.31% (0.1584 => 0.1484, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -6.30% (0.3812 => 0.3572, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.29% (0.6484 => 0.6076, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: -6.29% (16.1920 => 15.1733, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: -6.28% (1.2515 => 1.1729, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.27% (0.9852 => 0.9234, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -6.27% (4.3330 => 4.0612, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: -6.24% (0.2659 => 0.2493, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: -6.23% (0.9179 => 0.8607, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.19% (1.6364 => 1.5351, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-4: -6.19% (0.3880 => 0.3640, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -6.17% (1.1450 => 1.0743, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: -6.17% (0.4033 => 0.3784, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.16% (1.3722 => 1.2877, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.16% (0.2355 => 0.2210, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.11% (0.4176 => 0.3921, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.09% (0.3891 => 0.3654, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.09% (0.5863 => 0.5506, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.08% (0.3848 => 0.3614, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.08% (0.9542 => 0.8962, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.06% (1.2784 => 1.2009, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.06% (0.1716 => 0.1612, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: -6.06% (0.3896 => 0.3660, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.05% (4.5069 => 4.2342, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.05% (0.2695 => 0.2532, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.04% (1.2300 => 1.1557, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.02% (0.3884 => 0.3650, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.02% (0.5478 => 0.5148, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.01% (0.7919 => 0.7443, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.98% (0.5802 => 0.5455, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.98% (0.5705 => 0.5364, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.96% (4.8802 => 4.5892, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.96% (0.6395 => 0.6014, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.96% (6.7716 => 6.3683, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.96% (1.4642 => 1.3770, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: -5.95% (0.4199 => 0.3949, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -5.95% (15.5079 => 14.5847, std.dev.: 0.0204) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.95% (0.6736 => 0.6335, std.dev.: 0.0019) MultiSource/Applications/lua/lua: -5.95% (4.0594 => 3.8180, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.93% (1.6474 => 1.5497, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.93% (0.2548 => 0.2397, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.93% (0.5805 => 0.5461, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.92% (0.5857 => 0.5510, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.92% (0.5859 => 0.5512, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.91% (0.7524 => 0.7079, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.91% (4.0323 => 3.7940, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.88% (0.5849 => 0.5505, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -5.87% (2.4021 => 2.2611, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.86% (14.2083 => 13.3750, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.86% (0.6660 => 0.6270, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -5.85% (17.1032 => 16.1022, std.dev.: 0.0179) MultiSource/Benchmarks/sim/sim: -5.84% (0.3406 => 0.3207, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.83% (0.7339 => 0.6911, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: -5.82% (0.4280 => 0.4031, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.82% (0.6395 => 0.6023, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.81% (4.8161 => 4.5362, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.81% (0.5925 => 0.5581, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.81% (0.6304 => 0.5938, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -5.78% (0.3581 => 0.3374, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.77% (0.3483 => 0.3282, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.76% (0.6446 => 0.6075, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -5.75% (0.3025 => 0.2851, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.73% (0.6052 => 0.5705, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.73% (0.5569 => 0.5250, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.72% (0.6293 => 0.5933, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: -5.71% (0.3255 => 0.3069, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.71% (0.7198 => 0.6787, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: -5.71% (0.7447 => 0.7022, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.70% (0.3016 => 0.2844, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.70% (0.6260 => 0.5903, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.70% (0.2999 => 0.2828, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -5.69% (3.5154 => 3.3153, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.69% (0.5591 => 0.5273, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.69% (0.6297 => 0.5939, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.68% (0.7021 => 0.6622, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.67% (0.5941 => 0.5604, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.67% (0.5575 => 0.5259, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.66% (0.5581 => 0.5265, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.66% (0.6681 => 0.6303, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash2: -5.66% (0.4861 => 0.4586, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.66% (0.3837 => 0.3620, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.65% (0.3931 => 0.3709, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.64% (0.6667 => 0.6291, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.62% (2.2587 => 2.1318, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.62% (0.6230 => 0.5880, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/except: -5.62% (0.3026 => 0.2856, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.61% (5.4682 => 5.1614, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/lists: -5.61% (0.3621 => 0.3418, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.60% (0.5567 => 0.5255, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -5.60% (1.3864 => 1.3087, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: -5.60% (0.3194 => 0.3015, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.60% (2.1713 => 2.0497, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.59% (0.5688 => 0.5370, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.59% (0.6033 => 0.5696, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.57% (0.5570 => 0.5260, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -5.56% (0.2985 => 0.2819, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.55% (0.4916 => 0.4643, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -5.54% (0.3481 => 0.3288, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -5.54% (0.3394 => 0.3206, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.52% (0.9557 => 0.9029, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.52% (0.6194 => 0.5852, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: -5.52% (0.2989 => 0.2824, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.52% (0.5329 => 0.5035, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: -5.51% (1.3148 => 1.2423, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/moments: -5.51% (0.4248 => 0.4014, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: -5.51% (0.3867 => 0.3654, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -5.50% (0.4524 => 0.4275, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.49% (0.6189 => 0.5849, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: -5.49% (0.4515 => 0.4267, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.49% (0.2385 => 0.2254, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.49% (0.2278 => 0.2153, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: -5.49% (2.1401 => 2.0227, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ary3: -5.48% (0.3446 => 0.3257, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.48% (0.6676 => 0.6310, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.48% (0.6440 => 0.6087, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.47% (0.8521 => 0.8055, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.47% (0.4427 => 0.4185, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.46% (0.5456 => 0.5158, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.45% (0.3319 => 0.3138, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.44% (0.5168 => 0.4887, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.42% (8.0126 => 7.5782, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.42% (0.5999 => 0.5674, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.37% (0.4151 => 0.3928, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -5.37% (18.2933 => 17.3106, std.dev.: 0.0051) MultiSource/Applications/ClamAV/clamscan: -5.34% (15.2527 => 14.4383, std.dev.: 0.0076) MultiSource/Applications/lambda-0_1_3/lambda: -5.34% (0.7982 => 0.7556, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.32% (1.2210 => 1.1560, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.32% (0.3252 => 0.3079, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: -5.31% (0.3788 => 0.3587, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -5.27% (1.1530 => 1.0922, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.27% (0.3491 => 0.3307, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.26% (0.4813 => 0.4560, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.25% (0.3849 => 0.3647, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.23% (0.3057 => 0.2897, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.23% (1.2221 => 1.1582, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.22% (0.2106 => 0.1996, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: -5.21% (0.2939 => 0.2786, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.20% (0.2903 => 0.2752, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -5.20% (0.6750 => 0.6399, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.19% (0.4083 => 0.3871, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -5.19% (34.0927 => 32.3231, std.dev.: 0.0233) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.18% (0.2933 => 0.2781, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -5.17% (0.3271 => 0.3102, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: -5.17% (0.3059 => 0.2901, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.15% (0.2871 => 0.2723, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -5.04% (0.8418 => 0.7994, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.00% (0.3323 => 0.3157, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wc: -4.93% (0.3205 => 0.3047, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: -4.78% (5.0226 => 4.7825, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.57% (0.9077 => 0.8662, std.dev.: 0.0052) SingleSource/UnitTests/ObjC++/property-reference: -4.49% (0.7779 => 0.7430, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.42% (0.4321 => 0.4130, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: -4.23% (1.5610 => 1.4950, std.dev.: 0.0140) SingleSource/UnitTests/ObjC++/Hello: -4.21% (0.6347 => 0.6080, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -3.83% (0.6441 => 0.6194, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -2.58% (20.7746 => 20.2386, std.dev.: 0.0982) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7542, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fbench: -3.92% (2.2633 => 2.1746, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4680, std.dev.: 0.0025) Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 11 21:07:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 11 Nov 2012 23:07:29 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121112050729.05BB52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5772?compare_to=5770&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5772, Order: 167700, Start Time: 2012-11-12 03:41:50, End Time: 2012-11-12 05:07:43 To: 5770, Order: 167698, Start Time: 2012-11-12 00:52:17, End Time: 2012-11-12 02:18:03 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 8 (111 on baseline) Performance Improvements: 2 (27 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 981 (836 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.84% (0.8375 => 0.8613, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.67% (0.5888 => 0.6045, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.41% (0.8165 => 0.8362, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.37% (0.8750 => 0.8957, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.10% (0.9244 => 0.9438, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 6.66% (0.2042 => 0.2178, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/except: 4.48% (0.4885 => 0.5104, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.61% (2.3295 => 2.3670, std.dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/05-eks/eks: -2.71% (0.4509 => 0.4387, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -3.96% (3.1499 => 3.0252, std.dev.: 0.0387) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.27% (16.6552 => 16.7009, std.dev.: 0.0901) MultiSource/Applications/obsequi/Obsequi: -0.37% (1.0689 => 1.0649, std.dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.16% (21.6792 => 21.7141, std.dev.: 0.2277) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.30% (0.3650 => 0.3661, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/bigfib: 0.20% (0.6050 => 0.6062, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.15% (0.3321 => 0.3316, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 0.15% (0.2013 => 0.2016, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.30% (0.0217 => 0.0222, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.95% (0.0423 => 0.0427, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.82% (0.0329 => 0.0335) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0312 => 0.0311, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0423 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 1.48% (0.0203 => 0.0206, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 2.31% (0.0216 => 0.0221, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1458 => 0.1457, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.41% (1.1672 => 1.1508, std.dev.: 0.0445) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 4.37% (0.1396 => 0.1457, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.16% (0.4144 => 0.4192, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.25% (0.1481 => 0.1418, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.67% (0.0565 => 0.0614, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.21% (0.0213 => 0.0239, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.67% (0.0578 => 0.0605, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.64% (1.1916 => 1.1992, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1100.00% (0.0001 => 0.0012, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.98% (0.0631 => 0.0568, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 30.60% (0.0183 => 0.0239, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.15% (0.7814 => 0.7802, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -27.84% (0.0097 => 0.0070, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2293.97% (0.6332 => 15.1586, std.dev.: 0.3408) MultiSource/Benchmarks/McCat/08-main/main: 47.68% (0.1831 => 0.2704, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.64% (0.1559 => 0.1471, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1490.79% (0.3344 => 5.3196, std.dev.: 0.0438) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.80% (0.2364 => 0.3234, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: 3.03% (0.0429 => 0.0442, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.36% (0.0224 => 0.0236, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -31.74% (0.0230 => 0.0157, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4222, std.dev.: 0.0448) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0726, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4953, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3396, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1255, std.dev.: 0.0315) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4004, std.dev.: 0.0073) SingleSource/Regression/C/uint64_to_float: -23.86% (2.1832 => 1.6623, std.dev.: 0.0023) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.06% (0.0810 => 0.0932, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 10.25% (0.1112 => 0.1226, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.70% (0.2279 => 0.2500, std.dev.: 0.0049) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.36% (0.3137 => 0.3368, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.31% (0.1983 => 0.2128, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.65% (0.2180 => 0.2325, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.58% (0.1885 => 0.2009, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.92% (0.2519 => 0.2668, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.71% (0.8148 => 0.8613, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.34% (0.3295 => 0.3471, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.01% (0.9435 => 0.9908, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.95% (1.1606 => 1.2181, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.87% (0.4847 => 0.5083, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.82% (0.6287 => 0.6590, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.79% (0.6010 => 0.6298, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.20% (0.7473 => 0.7787, std.dev.: 0.0106) MultiSource/Applications/sgefa/sgefa: 4.20% (0.2999 => 0.3125, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.01% (0.9074 => 0.9438, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 4.01% (1.2222 => 1.2712, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.92% (0.5817 => 0.6045, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.90% (0.3003 => 0.3120, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.88% (0.8050 => 0.8362, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.83% (0.4127 => 0.4285, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.76% (1.1685 => 1.2124, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.69% (0.5961 => 0.6181, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.63% (0.8697 => 0.9013, std.dev.: 0.0058) MultiSource/Applications/spiff/spiff: 3.46% (0.7950 => 0.8225, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.40% (1.3279 => 1.3731, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 3.28% (4.1305 => 4.2659, std.dev.: 0.0250) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.13% (0.8331 => 0.8592, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.08% (0.8204 => 0.8457, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.01% (0.8611 => 0.8870, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.00% (6.6074 => 6.8055, std.dev.: 0.0628) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.96% (0.3717 => 0.3827, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.91% (1.4479 => 1.4901, std.dev.: 0.0086) MultiSource/Applications/lua/lua: 2.91% (3.8189 => 3.9299, std.dev.: 0.0216) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.90% (4.1763 => 4.2975, std.dev.: 0.0409) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.81% (0.8712 => 0.8957, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.74% (0.8007 => 0.8226, std.dev.: 0.0026) MultiSource/Applications/treecc/treecc: 2.71% (1.9948 => 2.0488, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.65% (1.6386 => 1.6820, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: 2.60% (0.6834 => 0.7012, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.51% (0.8656 => 0.8873, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.49% (0.8286 => 0.8492, std.dev.: 0.0045) MultiSource/Applications/SIBsim4/SIBsim4: 2.47% (1.2568 => 1.2879, std.dev.: 0.0048) MultiSource/Applications/SPASS/SPASS: 2.45% (14.2605 => 14.6101, std.dev.: 0.0773) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.44% (1.2423 => 1.2726, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.42% (0.8457 => 0.8662, std.dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: 2.36% (2.3764 => 2.4325, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.33% (0.8338 => 0.8532, std.dev.: 0.0030) MultiSource/Applications/d/make_dparser: 2.26% (3.2366 => 3.3097, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.26% (0.8420 => 0.8610, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.23% (0.9039 => 0.9241, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.18% (0.8597 => 0.8784, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.18% (13.1811 => 13.4678, std.dev.: 0.0586) MultiSource/Applications/ClamAV/clamscan: 2.16% (14.7684 => 15.0872, std.dev.: 0.0866) MultiSource/Benchmarks/Bullet/bullet: 2.15% (31.8598 => 32.5453, std.dev.: 0.1377) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.14% (0.8316 => 0.8494, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.10% (0.6227 => 0.6358, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.08% (0.9056 => 0.9244, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.07% (0.8066 => 0.8233, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.02% (0.8359 => 0.8528, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 2.01% (2.2184 => 2.2629, std.dev.: 0.0155) MultiSource/Applications/hexxagon/hexxagon: 2.00% (0.9810 => 1.0006, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.98% (0.8885 => 0.9061, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.92% (8.6476 => 8.8136, std.dev.: 0.0397) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.87% (4.4880 => 4.5721, std.dev.: 0.0253) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.85% (0.8048 => 0.8197, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.81% (2.1401 => 2.1789, std.dev.: 0.0134) MultiSource/Applications/JM/ldecod/ldecod: 1.81% (6.7320 => 6.8537, std.dev.: 0.0339) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.71% (0.8340 => 0.8483, std.dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (0.7557 => 0.7684, std.dev.: 0.0047) MultiSource/Applications/oggenc/oggenc: 1.66% (4.9628 => 5.0452, std.dev.: 0.0298) MultiSource/Applications/JM/lencod/lencod: 1.65% (15.3280 => 15.5810, std.dev.: 0.0689) MultiSource/Benchmarks/mafft/pairlocalalign: 1.48% (8.6247 => 8.7522, std.dev.: 0.0274) MultiSource/Benchmarks/Prolangs-C/football/football: 1.47% (0.8768 => 0.8897, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.16% (0.8995 => 0.9099, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 114.07% (0.0199 => 0.0426, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/pi: 57.66% (1.5795 => 2.4903, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.36% (2.9753 => 3.4622, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.23% (0.7597 => 0.8830, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.61% (2.7995 => 3.2085, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.44% (5.0261 => 5.6010, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.88% (0.3186 => 0.3469, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.10% (1.1857 => 1.2818, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/nestedloop: 7.66% (0.2023 => 0.2178, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/queens: 7.46% (1.7056 => 1.8328, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.06% (4.7794 => 5.1168, std.dev.: 0.0368) MultiSource/Applications/SIBsim4/SIBsim4: 6.19% (3.1873 => 3.3846, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/richards_benchmark: 6.14% (1.3037 => 1.3837, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.92% (4.9686 => 5.2626, std.dev.: 0.0283) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.86% (4.5327 => 4.7981, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.70% (3.3761 => 3.5348, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.48% (6.2275 => 6.5067, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.26% (4.9453 => 5.1559, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.18% (4.9469 => 5.1536, std.dev.: 0.0567) MultiSource/Applications/hexxagon/hexxagon: 3.91% (14.0064 => 14.5539, std.dev.: 0.0247) SingleSource/Benchmarks/Shootout-C++/except: 3.72% (0.4921 => 0.5104, std.dev.: 0.0048) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.54% (1.2337 => 1.2774, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.46% (0.3587 => 0.3711, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.81% (11.5690 => 11.8946, std.dev.: 0.0313) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.77% (8.2783 => 8.5072, std.dev.: 0.0219) MultiSource/Applications/siod/siod: 2.61% (3.6643 => 3.7598, std.dev.: 0.0120) MultiSource/Applications/lambda-0_1_3/lambda: 2.58% (7.4933 => 7.6864, std.dev.: 0.0301) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.20% (4.8660 => 4.9729, std.dev.: 0.0302) SingleSource/Benchmarks/Shootout/lists: 2.15% (7.3375 => 7.4952, std.dev.: 0.0071) SingleSource/Benchmarks/Dhrystone/dry: 1.97% (0.5081 => 0.5181, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.84% (4.8362 => 4.9253, std.dev.: 0.0161) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.18% (3.5679 => 3.6099, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: 1.16% (8.5322 => 8.6313, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/neural/neural: 1.12% (1.0841 => 1.0962, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.08% (5.4641 => 4.3122, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: -11.19% (1.1216 => 0.9961, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.87% (1.0512 => 0.9369, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -10.19% (7.2130 => 6.4777, std.dev.: 0.0587) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.18% (0.3269 => 0.2969, std.dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: -8.57% (63.1822 => 57.7649, std.dev.: 0.1091) SingleSource/Benchmarks/Shootout/heapsort: -8.12% (3.2926 => 3.0252, std.dev.: 0.0387) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.83% (4.7482 => 4.4240, std.dev.: 0.0495) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.99% (3.7148 => 3.4922, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.95% (5.4972 => 5.1703, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.06% (5.1557 => 4.8950, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.80% (2.8773 => 2.7393, std.dev.: 0.0204) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.23% (4.7449 => 4.5440, std.dev.: 0.0274) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.64% (6.0224 => 5.8030, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.35% (2.4490 => 2.3670, std.dev.: 0.0072) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (28.5821 => 27.6889, std.dev.: 0.0450) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.12% (0.5807 => 0.5626, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.69% (2.6356 => 2.5646, std.dev.: 0.0079) MultiSource/Applications/aha/aha: -2.57% (3.3398 => 3.2540, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: -2.26% (3.4237 => 3.3462, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.18% (9.9065 => 9.6906, std.dev.: 0.0602) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.00% (11.5316 => 11.3007, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/mason/mason: -1.98% (0.5415 => 0.5308, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.69% (2.3487 => 2.3091, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.65% (4.9994 => 4.9170, std.dev.: 0.0240) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.63% (3.2169 => 3.1644, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.17% (5.6343 => 5.5681, std.dev.: 0.0109) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.55% (16.4461 => 16.7009, std.dev.: 0.0901) MultiSource/Applications/obsequi/Obsequi: 3.77% (1.0262 => 1.0649, std.dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6852.96% (0.3123 => 21.7141, std.dev.: 0.2277) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.64% (0.2463 => 0.3661, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/bigfib: 0.87% (0.6010 => 0.6062, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.53% (0.3266 => 0.3316, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 2.39% (0.1969 => 0.2016, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 80.49% (0.0123 => 0.0222, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.89% (0.0254 => 0.0335) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.98% (0.0302 => 0.0311, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 8.42% (0.0190 => 0.0206, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 22.78% (0.0180 => 0.0221, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.32% (0.1438 => 0.1457, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.58% (1.1329 => 1.1508, std.dev.: 0.0445) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.34% (0.1462 => 0.1457, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.67% (0.4164 => 0.4192, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.58% (0.1369 => 0.1418, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.21% (0.0641 => 0.0614, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.56% (0.0195 => 0.0239, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.67% (0.0578 => 0.0605, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.85% (1.1437 => 1.1992, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1100.00% (0.0001 => 0.0012, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.41% (0.0627 => 0.0568, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 32.78% (0.0180 => 0.0239, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.68% (0.8017 => 0.7802, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 12.90% (0.0062 => 0.0070, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 11 21:12:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 11 Nov 2012 23:12:19 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121112051219.D1B072A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5773?compare_to=5771&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5773, Order: 167700, Start Time: 2012-11-12 03:47:41, End Time: 2012-11-12 05:12:34 To: 5771, Order: 167698, Start Time: 2012-11-12 01:08:34, End Time: 2012-11-12 02:33:50 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 1 (179 on baseline) Unchanged Tests: 1041 (859 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.34% (1.3059 => 1.2884, std.dev.: 0.0065) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1017, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: 2.37% (7.4937 => 7.6715, std.dev.: 0.0251) SingleSource/Benchmarks/Shootout-C++/hash2: 1.86% (3.1932 => 3.2527, std.dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.74% (0.1431 => 0.1306, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.90% (0.3821 => 0.3519, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -7.51% (2.4924 => 2.3052, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: -6.70% (0.3357 => 0.3132, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.67% (0.2428 => 0.2266, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.59% (0.3142 => 0.2935, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.41% (3.5339 => 3.3073, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.34% (0.6484 => 0.6073, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -6.31% (9.2283 => 8.6462, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.29% (0.3658 => 0.3428, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -6.27% (7.0961 => 6.6510, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/exceptions-3: -6.26% (0.3848 => 0.3607, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -6.26% (0.3896 => 0.3652, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -6.25% (16.1920 => 15.1797, std.dev.: 0.0155) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.25% (0.3891 => 0.3648, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.24% (1.0544 => 0.9886, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: -6.22% (0.3812 => 0.3575, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.20% (0.4176 => 0.3917, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -6.19% (0.3831 => 0.3594, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.19% (0.3880 => 0.3640, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -6.17% (0.4033 => 0.3784, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -6.17% (0.1879 => 0.1763, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: -6.14% (0.9179 => 0.8615, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.12% (0.1796 => 0.1686, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.10% (0.9852 => 0.9251, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.08% (1.3722 => 1.2888, std.dev.: 0.0070) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.05% (22.4056 => 21.0501, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/property: -6.03% (0.4199 => 0.3946, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.02% (0.3884 => 0.3650, std.dev.: 0.0043) MultiSource/Applications/Burg/burg: -6.00% (1.2515 => 1.1764, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.94% (1.2784 => 1.2025, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.94% (0.2695 => 0.2535, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.93% (0.9542 => 0.8976, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.92% (0.5857 => 0.5510, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.92% (0.5863 => 0.5516, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: -5.92% (4.3330 => 4.0767, std.dev.: 0.0121) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.90% (0.2355 => 0.2216, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.89% (1.4642 => 1.3779, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.87% (4.5069 => 4.2423, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.85% (0.5859 => 0.5516, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.84% (0.5802 => 0.5463, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.84% (0.6304 => 0.5936, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -5.83% (1.1450 => 1.0782, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.83% (0.6052 => 0.5699, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.82% (0.5478 => 0.5159, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.82% (0.5805 => 0.5467, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.81% (1.6364 => 1.5413, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.81% (4.0323 => 3.7980, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.81% (4.8802 => 4.5967, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.81% (0.7198 => 0.6780, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: -5.81% (17.1032 => 16.1103, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.80% (4.8161 => 4.5369, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.79% (0.6395 => 0.6025, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.78% (0.5849 => 0.5511, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -5.77% (0.4280 => 0.4033, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.76% (0.6681 => 0.6296, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.76% (14.2083 => 13.3902, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.75% (0.5705 => 0.5377, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.73% (0.6230 => 0.5873, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -5.73% (0.2985 => 0.2814, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -5.73% (0.3406 => 0.3211, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.72% (0.7339 => 0.6919, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.71% (0.5591 => 0.5272, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.70% (0.5925 => 0.5587, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.69% (0.5575 => 0.5258, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.69% (0.4151 => 0.3915, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.67% (1.2300 => 1.1603, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.66% (0.6446 => 0.6081, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.66% (0.7524 => 0.7098, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.66% (0.6660 => 0.6283, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.66% (0.7919 => 0.7471, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.64% (0.5581 => 0.5266, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -5.64% (15.5079 => 14.6337, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.63% (0.6194 => 0.5845, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.62% (0.6667 => 0.6292, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.62% (0.6297 => 0.5943, std.dev.: 0.0007) MultiSource/Applications/lua/lua: -5.60% (4.0594 => 3.8320, std.dev.: 0.0060) MultiSource/Applications/hexxagon/hexxagon: -5.59% (1.3148 => 1.2413, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.58% (6.7716 => 6.3936, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: -5.58% (1.3864 => 1.3091, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.58% (0.6260 => 0.5911, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.57% (0.5567 => 0.5257, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.57% (0.2999 => 0.2832, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.57% (0.5569 => 0.5259, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.57% (0.2659 => 0.2511, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.55% (0.6395 => 0.6040, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.53% (0.2548 => 0.2407, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.53% (0.3837 => 0.3625, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -5.52% (0.3025 => 0.2858, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.52% (0.5999 => 0.5668, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: -5.50% (0.3255 => 0.3076, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.50% (0.5456 => 0.5156, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -5.49% (0.3026 => 0.2860, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.48% (0.6676 => 0.6310, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.48% (0.5570 => 0.5265, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -5.47% (0.4861 => 0.4595, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.47% (0.3016 => 0.2851, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.47% (0.5941 => 0.5616, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -5.45% (2.4021 => 2.2711, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/random: -5.44% (0.2939 => 0.2779, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -5.44% (3.5154 => 3.3242, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.43% (0.6293 => 0.5951, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.43% (0.3057 => 0.2891, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.43% (0.3483 => 0.3294, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.42% (0.3931 => 0.3718, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.41% (0.2903 => 0.2746, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.40% (0.8521 => 0.8061, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.38% (0.5688 => 0.5382, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/ary2: -5.37% (0.3481 => 0.3294, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.37% (0.6033 => 0.5709, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hello: -5.37% (0.2849 => 0.2696, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.36% (0.2871 => 0.2717, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.36% (0.6736 => 0.6375, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.36% (0.3323 => 0.3145, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: -5.35% (0.2989 => 0.2829, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.35% (0.2933 => 0.2776, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.35% (0.4916 => 0.4653, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -5.34% (0.4248 => 0.4021, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.34% (0.4083 => 0.3865, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -5.34% (0.4515 => 0.4274, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: -5.33% (0.3394 => 0.3213, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.33% (8.0126 => 7.5855, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.33% (0.5329 => 0.5045, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.32% (2.1713 => 2.0557, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: -5.32% (0.3194 => 0.3024, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.31% (0.7021 => 0.6648, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -5.30% (0.3205 => 0.3035, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.30% (0.5168 => 0.4894, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.29% (5.4682 => 5.1787, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.29% (1.2221 => 1.1574, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.28% (0.2385 => 0.2259, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: -5.28% (0.3446 => 0.3264, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.28% (0.6440 => 0.6100, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -5.27% (0.3621 => 0.3430, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.24% (1.2210 => 1.1570, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: -5.24% (2.1401 => 2.0280, std.dev.: 0.0028) SingleSource/Regression/C++/ofstream_ctor: -5.23% (0.3059 => 0.2899, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.22% (0.2278 => 0.2159, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.22% (0.9557 => 0.9058, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.22% (0.4427 => 0.4196, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -5.22% (0.4524 => 0.4288, std.dev.: 0.0036) MultiSource/Applications/minisat/minisat: -5.18% (0.7447 => 0.7061, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: -5.17% (0.3867 => 0.3667, std.dev.: 0.0033) MultiSource/Applications/ClamAV/clamscan: -5.15% (15.2527 => 14.4679, std.dev.: 0.0109) MultiSource/Benchmarks/Bullet/bullet: -5.14% (34.0927 => 32.3420, std.dev.: 0.0245) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.07% (0.3252 => 0.3087, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.06% (0.3319 => 0.3151, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.05% (1.6474 => 1.5642, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.04% (0.3849 => 0.3655, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: -5.02% (1.1530 => 1.0951, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/bigfib: -5.01% (0.6750 => 0.6412, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.96% (2.2587 => 2.1467, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: -4.94% (0.3581 => 0.3404, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -4.91% (18.2933 => 17.3956, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.88% (0.4813 => 0.4578, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: -4.87% (5.0226 => 4.7779, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.84% (0.4321 => 0.4112, std.dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: -4.84% (0.7982 => 0.7596, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.81% (0.3491 => 0.3323, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: -4.81% (0.8418 => 0.8013, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.80% (0.2106 => 0.2005, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -4.77% (0.3271 => 0.3115, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: -4.74% (0.7779 => 0.7410, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.49% (0.9077 => 0.8669, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/Hello: -4.49% (0.6347 => 0.6062, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -4.32% (0.6441 => 0.6163, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -4.11% (1.5610 => 1.4969, std.dev.: 0.0065) SingleSource/UnitTests/Vector/constpool: -2.84% (20.7746 => 20.1846, std.dev.: 0.0750) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7554, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/richards_benchmark: -8.75% (1.2842 => 1.1718, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: -3.90% (2.2633 => 2.1751, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.62% (1.3096 => 1.2884, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4701, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0009) Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 11 21:16:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 11 Nov 2012 23:16:02 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121112051602.0DA152A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5774?compare_to=5769&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5774, Order: 167698, Start Time: 2012-11-12 02:00:51, End Time: 2012-11-12 05:16:15 To: 5769, Order: 167692, Start Time: 2012-11-11 21:56:51, End Time: 2012-11-12 01:12:21 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (175 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1042 (716 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.40% (0.0625 => 0.0890, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.21% (0.1063 => 0.1416, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.47% (0.2969 => 0.3755, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.36% (0.4253 => 0.5374, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.31% (0.1106 => 0.1397, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 25.53% (1.5932 => 1.9999, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.08% (0.4139 => 0.5177, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.79% (0.0714 => 0.0891, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.93% (0.4994 => 0.6189, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.79% (0.0475 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.69% (0.5900 => 0.7298, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.58% (0.0547 => 0.0676, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.58% (0.5000 => 0.6179, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.29% (0.0584 => 0.0720, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.78% (0.1620 => 0.1989, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.62% (0.1021 => 0.1252, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.49% (0.1107 => 0.1356, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 22.37% (0.0599 => 0.0733, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.30% (0.0897 => 0.1097, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 21.52% (0.0948 => 0.1152, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.26% (0.0541 => 0.0656, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.21% (0.1103 => 0.1337, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.17% (0.0633 => 0.0767, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.06% (0.0584 => 0.0707, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.03% (0.0642 => 0.0777, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.01% (0.0495 => 0.0599, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 20.83% (0.0821 => 0.0992, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.74% (0.1003 => 0.1211, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.57% (0.3903 => 0.4706, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.44% (0.0822 => 0.0990, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.40% (0.1549 => 0.1865, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 20.36% (0.0604 => 0.0727, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 20.32% (0.1619 => 0.1948, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.26% (0.1604 => 0.1929, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 19.54% (0.0947 => 0.1132, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.36% (0.1462 => 0.1745, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.28% (0.3890 => 0.4640, std.dev.: 0.0035) MultiSource/Applications/sgefa/sgefa: 19.18% (0.0808 => 0.0963, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 19.14% (0.5826 => 0.6941, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 19.09% (0.5889 => 0.7013, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.97% (0.2014 => 0.2396, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 18.88% (0.1218 => 0.1448, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 18.84% (0.4029 => 0.4788, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 18.48% (0.0698 => 0.0827, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 18.42% (0.0581 => 0.0688, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.42% (1.3152 => 1.5574, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 18.27% (0.1505 => 0.1780, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.20% (0.2736 => 0.3234, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.18% (0.0605 => 0.0715, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.11% (0.1088 => 0.1285, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.01% (0.0572 => 0.0675) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.77% (3.5627 => 4.1957, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.76% (0.2866 => 0.3375, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: 17.71% (0.9697 => 1.1414, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.63% (0.0573 => 0.0674, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 17.53% (0.5546 => 0.6518, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.48% (0.1968 => 0.2312, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 17.39% (1.8794 => 2.2063, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.26% (0.4658 => 0.5462, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.25% (1.6211 => 1.9008, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.25% (0.2875 => 0.3371, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.07% (0.5026 => 0.5884, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.07% (0.1160 => 0.1358, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.94% (0.3271 => 0.3825, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.90% (0.4361 => 0.5098, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 16.82% (0.1421 => 0.1660, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 16.80% (0.7171 => 0.8376, std.dev.: 0.0040) MultiSource/Applications/d/make_dparser: 16.68% (1.0781 => 1.2579, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.65% (2.7292 => 3.1837, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.64% (0.2729 => 0.3183, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 16.58% (0.2714 => 0.3164, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.56% (0.3930 => 0.4581, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 16.51% (0.2725 => 0.3175, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.51% (0.2738 => 0.3190, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 16.50% (4.2109 => 4.9059, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 16.46% (0.2813 => 0.3276, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.44% (4.4195 => 5.1460, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 16.44% (0.2750 => 0.3202, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 16.40% (0.2780 => 0.3236, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 16.37% (0.2823 => 0.3285, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 16.28% (0.1284 => 0.1493, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.26% (0.2792 => 0.3246, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 16.21% (0.3004 => 0.3491, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 16.19% (0.2811 => 0.3266, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.15% (0.2911 => 0.3381, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 16.13% (0.2803 => 0.3255, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.06% (0.1090 => 0.1265, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.96% (0.3195 => 0.3705, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 15.96% (0.3096 => 0.3590, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 15.95% (0.9909 => 1.1489, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.89% (2.0673 => 2.3957, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.76% (1.9694 => 2.2798, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.69% (1.9966 => 2.3098, std.dev.: 0.0045) MultiSource/Benchmarks/Bullet/bullet: 15.68% (23.5202 => 27.2072, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary3: 15.52% (0.3267 => 0.3774, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 15.47% (0.3258 => 0.3762, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 15.31% (0.3678 => 0.4241, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.29% (0.3060 => 0.3528, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 15.28% (0.2075 => 0.2392, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.23% (0.3362 => 0.3874, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 15.22% (0.3317 => 0.3822, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 15.16% (0.2566 => 0.2955, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.95% (0.3124 => 0.3591, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 14.73% (0.3477 => 0.3989, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 14.67% (0.3348 => 0.3839, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.66% (0.3282 => 0.3763, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 14.61% (1.4269 => 1.6353, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: 14.55% (0.3726 => 0.4268, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.51% (0.3488 => 0.3994, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 14.50% (0.4146 => 0.4747, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/exceptions-4: 14.49% (0.3465 => 0.3967, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.47% (0.3496 => 0.4002, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/exceptions-2: 14.45% (0.3446 => 0.3944, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.42% (0.3460 => 0.3959, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.41% (0.3469 => 0.3969, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 14.41% (0.3442 => 0.3938, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.32% (0.3625 => 0.4144, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 14.31% (0.7875 => 0.9002, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 14.30% (0.4251 => 0.4859, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.14% (0.3981 => 0.4544, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 14.11% (0.3650 => 0.4165, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.09% (0.3690 => 0.4210, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 14.08% (0.3643 => 0.4156, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 14.04% (0.3724 => 0.4247, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 13.98% (0.0758 => 0.0864, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.97% (0.3845 => 0.4382, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 13.96% (2.1653 => 2.4675, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/bigfib: 13.79% (0.5012 => 0.5703, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 13.75% (4.6177 => 5.2526, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 13.74% (2.1013 => 2.3900, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.68% (0.2040 => 0.2319, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 13.15% (0.2691 => 0.3045, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.51% (0.1383 => 0.1556, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 12.47% (5.5417 => 6.2325, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.25% (0.6435 => 0.7223, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.96% (0.1028 => 0.1151) MultiSource/Applications/lambda-0_1_3/lambda: 11.81% (0.3498 => 0.3911, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 11.67% (0.6634 => 0.7408, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.51% (0.2737 => 0.3052, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 11.49% (0.4847 => 0.5404, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.46% (0.2068 => 0.2305, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.25% (0.3084 => 0.3431, std.dev.: 0.0101) MultiSource/Applications/minisat/minisat: 10.64% (0.3336 => 0.3691, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.60% (0.2103 => 0.2326, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 10.46% (0.2391 => 0.2641, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 10.38% (2.0346 => 2.2457, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.25% (0.5361 => 0.5857, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.21% (4.6926 => 5.1246, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.17% (11.6398 => 12.7077, std.dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.78% (0.5584 => 0.6074, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.66% (0.7426 => 0.8069, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 7.57% (11.9555 => 12.8600, std.dev.: 0.0200) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.14% (0.3792 => 0.3987, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 9.89% (0.2802 => 0.3079, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6100, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 5.89% (0.2122 => 0.2247, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6728, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1700, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-2: 4.71% (1.8057 => 1.8907, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/dry: 4.17% (14.0481 => 14.6335, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1994, std.dev.: 0.0480) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.68% (3.1722 => 3.2255, std.dev.: 0.0030) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3051, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2872, std.dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5780, std.dev.: 0.0136) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.74% (25.4195 => 16.5890, std.dev.: 0.0081) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9758, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8057, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -6.54% (0.2402 => 0.2245, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8018, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0046) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -2.54% (17.2379 => 16.8004, std.dev.: 0.0607) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.25% (41.7953 => 40.8565, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5736, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4957, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.09% (105.3826 => 104.2348, std.dev.: 0.0279) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0440, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 3.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 11 22:50:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 00:50:33 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121112065033.E276B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5775?compare_to=5772&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5775, Order: 167714, Start Time: 2012-11-12 05:24:38, End Time: 2012-11-12 06:50:49 To: 5772, Order: 167700, Start Time: 2012-11-12 03:41:50, End Time: 2012-11-12 05:07:43 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 8 (76 on baseline) Performance Improvements: 5 (29 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 978 (869 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/spiff/spiff: 2.63% (0.8225 => 0.8441, std.dev.: 0.0028) MultiSource/Applications/hbd/hbd: 1.55% (1.4553 => 1.4778, std.dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/ffbench: 5.74% (1.3703 => 1.4489, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.70% (3.6486 => 3.8564, std.dev.: 0.0770) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.15% (0.8446 => 0.8712, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.40% (4.3614 => 4.4660, std.dev.: 0.0378) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.04% (58.7894 => 59.9867, std.dev.: 0.3728) SingleSource/Benchmarks/Shootout-C++/methcall: 1.02% (8.9596 => 9.0512, std.dev.: 0.0158) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.45% (1.2726 => 1.2541, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: -7.44% (0.2178 => 0.2016, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: -4.86% (0.5104 => 0.4856, std.dev.: 0.0062) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.00% (1.2794 => 1.2538, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout/methcall: -1.89% (8.2760 => 8.1197, std.dev.: 0.0550) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.33% (16.7009 => 16.7562, std.dev.: 0.0463) MultiSource/Applications/obsequi/Obsequi: 0.88% (1.0649 => 1.0743, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.27% (21.7141 => 21.7718, std.dev.: 0.2842) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.57% (0.3661 => 0.3682, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/bigfib: -0.30% (0.6062 => 0.6044, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.24% (0.3316 => 0.3357, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 0.50% (0.2016 => 0.2026, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -13.51% (0.0222 => 0.0192, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.60% (0.0427 => 0.0386, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -17.31% (0.0335 => 0.0277, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.93% (0.0311 => 0.0317, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.94% (0.0425 => 0.0429, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -4.85% (0.0206 => 0.0196, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: -13.57% (0.0221 => 0.0191, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1457 => 0.1460, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 4.51% (1.1508 => 1.2027, std.dev.: 0.0218) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.44% (0.1457 => 0.1436, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.26% (0.4192 => 0.4181, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.37% (0.1418 => 0.1356, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.91% (0.0614 => 0.0590, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.51% (0.0239 => 0.0233, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.66% (0.0605 => 0.0609, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.48% (1.1992 => 1.1935, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 58.33% (0.0012 => 0.0019, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.06% (0.0568 => 0.0574, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.45% (0.0239 => 0.0171, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.26% (0.7802 => 0.7782, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007) SingleSource/UnitTests/SignlessTypes/Large/cast: 65.71% (0.0070 => 0.0116, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2317.42% (0.6332 => 15.3071, std.dev.: 0.0335) MultiSource/Benchmarks/McCat/08-main/main: 44.24% (0.1831 => 0.2641, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.44% (0.1559 => 0.1443, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1515.19% (0.3344 => 5.4012, std.dev.: 0.1247) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.69% (0.2364 => 0.3255, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: -0.23% (0.0429 => 0.0428, std.dev.: 0.0010) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.80% (0.0224 => 0.0237, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4235, std.dev.: 0.0124) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0678, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4917, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3461, std.dev.: 0.0419) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1633, std.dev.: 0.0206) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4043, std.dev.: 0.0029) SingleSource/Regression/C/uint64_to_float: -23.98% (2.1832 => 1.6597, std.dev.: 0.0021) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0008) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.56% (0.0810 => 0.0936, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 13.22% (0.1112 => 0.1259, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.91% (0.0848 => 0.0949, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.2279 => 0.2435, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.51% (0.1983 => 0.2112, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.25% (0.1905 => 0.2024, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 6.18% (0.7950 => 0.8441, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.10% (0.1885 => 0.2000, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.64% (0.2180 => 0.2303, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.32% (0.3137 => 0.3304, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.29% (0.8148 => 0.8579, std.dev.: 0.0166) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.40% (0.2998 => 0.3130, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.29% (0.2519 => 0.2627, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.26% (1.1606 => 1.2100, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.64% (0.5961 => 0.6178, std.dev.: 0.0083) MultiSource/Applications/hbd/hbd: 3.57% (1.4269 => 1.4778, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.56% (1.4479 => 1.4995, std.dev.: 0.0097) MultiSource/Applications/lua/lua: 3.39% (3.8189 => 3.9485, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.39% (0.4127 => 0.4267, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.22% (1.3279 => 1.3707, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.11% (0.9435 => 0.9728, std.dev.: 0.0112) MultiSource/Benchmarks/nbench/nbench: 3.02% (1.1271 => 1.1611, std.dev.: 0.0058) MultiSource/Applications/SPASS/SPASS: 2.85% (14.2605 => 14.6671, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.64% (0.9074 => 0.9314, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.51% (0.8611 => 0.8827, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.47% (1.1170 => 1.1446, std.dev.: 0.0081) MultiSource/Applications/d/make_dparser: 2.46% (3.2366 => 3.3161, std.dev.: 0.0117) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.44% (6.6074 => 6.7688, std.dev.: 0.0532) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.44% (0.6227 => 0.6379, std.dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: 2.42% (14.7684 => 15.1258, std.dev.: 0.0545) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.36% (0.9688 => 0.9917, std.dev.: 0.0079) MultiSource/Applications/treecc/treecc: 2.36% (1.9948 => 2.0418, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.30% (0.9056 => 0.9264, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.27% (0.8069 => 0.8252, std.dev.: 0.0061) MultiSource/Applications/oggenc/oggenc: 2.25% (4.9628 => 5.0744, std.dev.: 0.0093) MultiSource/Applications/hexxagon/hexxagon: 2.23% (0.9810 => 1.0029, std.dev.: 0.0044) MultiSource/Applications/siod/siod: 2.07% (2.2184 => 2.2644, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.07% (8.6476 => 8.8268, std.dev.: 0.0571) MultiSource/Applications/JM/lencod/lencod: 2.06% (15.3280 => 15.6441, std.dev.: 0.0377) MultiSource/Applications/minisat/minisat: 2.02% (0.6834 => 0.6972, std.dev.: 0.0041) MultiSource/Applications/JM/ldecod/ldecod: 1.82% (6.7320 => 6.8543, std.dev.: 0.0309) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 91.96% (0.0199 => 0.0382, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/pi: 50.34% (1.5795 => 2.3746, std.dev.: 0.0645) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.40% (2.9753 => 3.4632, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.99% (0.7597 => 0.8812, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.77% (2.7995 => 3.2129, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.64% (5.0261 => 5.6111, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.97% (6.3772 => 7.0769, std.dev.: 0.2146) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.04% (0.3186 => 0.3474, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.04% (1.1857 => 1.2810, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 7.19% (1.7056 => 1.8282, std.dev.: 0.0268) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.08% (4.7794 => 5.1176, std.dev.: 0.0052) MultiSource/Applications/SIBsim4/SIBsim4: 6.49% (3.1873 => 3.3940, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.94% (4.9686 => 5.2638, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/richards_benchmark: 5.94% (1.3037 => 1.3811, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.90% (4.5327 => 4.8000, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.50% (3.3761 => 3.5279, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.34% (6.2275 => 6.4976, std.dev.: 0.0380) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.31% (4.9453 => 5.1586, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.14% (4.9469 => 5.1515, std.dev.: 0.0140) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.96% (0.3587 => 0.3729, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.88% (14.0064 => 14.5500, std.dev.: 0.0158) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.62% (1.2337 => 1.2783, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.75% (4.8362 => 4.9690, std.dev.: 0.0324) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.73% (11.5690 => 11.8851, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.70% (8.2783 => 8.5019, std.dev.: 0.0106) MultiSource/Applications/lambda-0_1_3/lambda: 2.65% (7.4933 => 7.6916, std.dev.: 0.0360) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.56% (4.8660 => 4.9904, std.dev.: 0.0369) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.54% (4.3552 => 4.4660, std.dev.: 0.0378) SingleSource/Benchmarks/Shootout/lists: 2.39% (7.3375 => 7.5131, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.52% (1.5941 => 1.6183, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/power/power: 1.48% (1.2061 => 1.2240, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: 1.21% (1.0841 => 1.0972, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 1.19% (8.5322 => 8.6336, std.dev.: 0.0301) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.16% (3.5679 => 3.6093, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.15% (2.4647 => 2.4931, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.97% (5.4641 => 4.3183, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.96% (7.2130 => 6.1336, std.dev.: 0.3555) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.43% (1.0512 => 0.9311, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.32% (0.3269 => 0.2997, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: -8.25% (63.1822 => 57.9728, std.dev.: 0.0959) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.90% (4.7482 => 4.4205, std.dev.: 0.0301) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.91% (3.7148 => 3.4951, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.76% (5.4972 => 5.1804, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.09% (5.1557 => 4.8931, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.38% (4.7449 => 4.5371, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.82% (2.8773 => 2.7675, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.64% (6.0224 => 5.8031, std.dev.: 0.0222) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.13% (0.5807 => 0.5625, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (28.5821 => 27.6913, std.dev.: 0.0354) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.07% (1.0388 => 1.0069, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.77% (2.6356 => 2.5627, std.dev.: 0.0208) MultiSource/Applications/aha/aha: -2.36% (3.3398 => 3.2609, std.dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.22% (2.4490 => 2.3947, std.dev.: 0.0183) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.21% (1.2822 => 1.2538, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.21% (9.9065 => 9.6875, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.15% (11.5316 => 11.2834, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.04% (3.2169 => 3.1512, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash2: -2.03% (3.4237 => 3.3543, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/bisort/bisort: -1.94% (0.6636 => 0.6507, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/methcall: -1.79% (8.2676 => 8.1197, std.dev.: 0.0550) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.64% (4.9994 => 4.9172, std.dev.: 0.0098) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.37% (2.3487 => 2.3166, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.19% (5.6343 => 5.5672, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.01% (4.2466 => 4.2035, std.dev.: 0.0073) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.89% (16.4461 => 16.7562, std.dev.: 0.0463) MultiSource/Applications/obsequi/Obsequi: 4.69% (1.0262 => 1.0743, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6871.44% (0.3123 => 21.7718, std.dev.: 0.2842) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.49% (0.2463 => 0.3682, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/bigfib: 0.57% (0.6010 => 0.6044, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.79% (0.3266 => 0.3357, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 2.89% (0.1969 => 0.2026, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 56.10% (0.0123 => 0.0192, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.39% (0.0408 => 0.0386, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 9.06% (0.0254 => 0.0277, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.97% (0.0302 => 0.0317, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.72% (0.0384 => 0.0429, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 3.16% (0.0190 => 0.0196, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: 6.11% (0.0180 => 0.0191, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.53% (0.1438 => 0.1460, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 6.16% (1.1329 => 1.2027, std.dev.: 0.0218) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.78% (0.1462 => 0.1436, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.41% (0.4164 => 0.4181, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.95% (0.1369 => 0.1356, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.96% (0.0641 => 0.0590, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 19.49% (0.0195 => 0.0233, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.36% (0.0578 => 0.0609, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.35% (1.1437 => 1.1935, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1800.00% (0.0001 => 0.0019, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.45% (0.0627 => 0.0574, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.00% (0.0180 => 0.0171, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.93% (0.8017 => 0.7782, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007) SingleSource/UnitTests/SignlessTypes/Large/cast: 87.10% (0.0062 => 0.0116, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 11 23:00:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 01:00:15 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121112070015.B5BA72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5776?compare_to=5773&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5776, Order: 167714, Start Time: 2012-11-12 05:35:39, End Time: 2012-11-12 07:00:30 To: 5773, Order: 167700, Start Time: 2012-11-12 03:47:41, End Time: 2012-11-12 05:12:34 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 1 (177 on baseline) Unchanged Tests: 1041 (861 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.38% (1.2884 => 1.2706, std.dev.: 0.0058) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.69% (2.0478 => 2.1029, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: 2.48% (7.4937 => 7.6798, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash2: 2.16% (3.1932 => 3.2622, std.dev.: 0.0099) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.53% (0.1431 => 0.1309, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.75% (0.3821 => 0.3525, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -7.60% (2.4924 => 2.3029, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: -6.73% (0.3357 => 0.3131, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.63% (0.2428 => 0.2267, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.47% (0.3880 => 0.3629, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/trivial-interface: -6.45% (0.3812 => 0.3566, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -6.45% (0.3831 => 0.3584, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.37% (0.3891 => 0.3643, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.37% (0.4033 => 0.3776, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -6.37% (0.3896 => 0.3648, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.33% (0.3884 => 0.3638, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.33% (3.5339 => 3.3102, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.30% (0.3142 => 0.2944, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -6.29% (0.3848 => 0.3606, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.28% (9.2283 => 8.6484, std.dev.: 0.0108) MultiSource/Applications/JM/lencod/lencod: -6.25% (16.1920 => 15.1801, std.dev.: 0.0120) MultiSource/Applications/JM/ldecod/ldecod: -6.23% (7.0961 => 6.6538, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.23% (0.3658 => 0.3430, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.23% (0.6484 => 0.6080, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: -6.23% (0.1879 => 0.1762, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -6.20% (0.9179 => 0.8610, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions: -6.15% (0.4176 => 0.3919, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.12% (0.1796 => 0.1686, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.11% (1.0544 => 0.9900, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: -6.02% (0.2160 => 0.2030, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.01% (22.4056 => 21.0591, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.99% (0.9852 => 0.9262, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.98% (1.6364 => 1.5386, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.97% (0.5478 => 0.5151, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -5.96% (1.2515 => 1.1769, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.95% (0.4199 => 0.3949, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.95% (1.3722 => 1.2906, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.91% (0.9542 => 0.8978, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.91% (0.5857 => 0.5511, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.90% (0.5863 => 0.5517, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -5.90% (1.1450 => 1.0775, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.87% (1.2784 => 1.2033, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.87% (0.5859 => 0.5515, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: -5.84% (0.4280 => 0.4030, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.84% (0.5805 => 0.5466, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.83% (0.7198 => 0.6778, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -5.82% (1.1530 => 1.0859, std.dev.: 0.0098) MultiSource/Benchmarks/sim/sim: -5.81% (0.3406 => 0.3208, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.81% (4.0323 => 3.7979, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: -5.81% (17.1032 => 16.1099, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.80% (0.5849 => 0.5510, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: -5.79% (4.3330 => 4.0821, std.dev.: 0.0099) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.77% (0.2355 => 0.2219, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.77% (14.2083 => 13.3883, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.74% (0.5591 => 0.5270, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.74% (0.5802 => 0.5469, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.73% (4.8161 => 4.5401, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.72% (1.2300 => 1.1596, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.72% (0.6681 => 0.6299, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.70% (0.7524 => 0.7095, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.69% (0.6304 => 0.5945, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.68% (4.8802 => 4.6029, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -5.68% (0.1761 => 0.1661, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.66% (0.3483 => 0.3286, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.65% (0.6446 => 0.6082, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.65% (4.5069 => 4.2524, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.64% (1.4642 => 1.3816, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.64% (0.6260 => 0.5907, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.64% (0.5925 => 0.5591, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -5.63% (15.5079 => 14.6346, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.62% (0.6660 => 0.6286, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.61% (6.7716 => 6.3915, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.61% (0.5581 => 0.5268, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.60% (0.7339 => 0.6928, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.60% (0.6736 => 0.6359, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.59% (0.5705 => 0.5386, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.58% (0.6052 => 0.5714, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.58% (0.5575 => 0.5264, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.57% (0.5569 => 0.5259, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.56% (0.6297 => 0.5947, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.55% (0.6395 => 0.6040, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -5.54% (1.3864 => 1.3096, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.54% (0.6194 => 0.5851, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: -5.53% (3.5154 => 3.3209, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.53% (0.7919 => 0.7481, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.53% (0.2695 => 0.2546, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.53% (0.2985 => 0.2820, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.52% (0.6230 => 0.5886, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.47% (0.6667 => 0.6302, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -5.47% (0.7447 => 0.7040, std.dev.: 0.0027) MultiSource/Applications/lua/lua: -5.45% (4.0594 => 3.8383, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.44% (0.5456 => 0.5159, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.44% (0.6676 => 0.6313, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.43% (0.8521 => 0.8058, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.42% (0.5570 => 0.5268, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.40% (0.5941 => 0.5620, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.40% (0.5999 => 0.5675, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.40% (0.5688 => 0.5381, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.39% (0.5567 => 0.5267, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.39% (0.6293 => 0.5954, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -5.38% (2.4021 => 2.2729, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.38% (0.2548 => 0.2411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.34% (0.6033 => 0.5711) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.33% (0.6189 => 0.5859, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.31% (0.6440 => 0.6098, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: -5.30% (0.2659 => 0.2518, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.30% (0.2999 => 0.2840, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.30% (0.7021 => 0.6649, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -5.28% (0.3581 => 0.3392, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.25% (0.5329 => 0.5049, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.22% (1.2210 => 1.1573, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.19% (0.5168 => 0.4900, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.14% (8.0126 => 7.6004, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.14% (0.2278 => 0.2161, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -5.12% (15.2527 => 14.4718, std.dev.: 0.0101) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.12% (0.2385 => 0.2263, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -5.09% (0.4515 => 0.4285, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.08% (0.4151 => 0.3940, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.07% (1.6474 => 1.5638, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.07% (0.4916 => 0.4667, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: -5.05% (2.1401 => 2.0320, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.04% (5.4682 => 5.1927, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.99% (1.2221 => 1.1611, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.99% (2.2587 => 2.1461, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -4.94% (1.3148 => 1.2498, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.90% (0.9557 => 0.9089, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.85% (0.3837 => 0.3651, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -4.79% (0.3255 => 0.3099, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -4.77% (0.4861 => 0.4629, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -4.76% (34.0927 => 32.4705, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.76% (0.3931 => 0.3744, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.76% (0.3491 => 0.3325, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -4.75% (18.2933 => 17.4236, std.dev.: 0.0105) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.73% (0.3319 => 0.3162, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -4.70% (0.7982 => 0.7607, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: -4.68% (5.0226 => 4.7875, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.68% (0.3016 => 0.2875, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.65% (0.4083 => 0.3893, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.65% (0.3057 => 0.2915, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -4.64% (0.3621 => 0.3453, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -4.63% (0.3194 => 0.3046, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -4.61% (0.4248 => 0.4052, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: -4.60% (0.4524 => 0.4316, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: -4.60% (0.3025 => 0.2886, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.56% (2.1713 => 2.0723, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: -4.56% (0.2939 => 0.2805, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -4.56% (0.3271 => 0.3122, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: -4.55% (0.3867 => 0.3691, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.55% (0.2903 => 0.2771, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -4.54% (0.3481 => 0.3323, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -4.52% (0.2989 => 0.2854, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -4.49% (0.2871 => 0.2742, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -4.48% (0.8418 => 0.8041, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: -4.46% (0.6750 => 0.6449, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -4.45% (0.3394 => 0.3243, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wc: -4.40% (0.3205 => 0.3064, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.40% (0.2933 => 0.2804, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -4.40% (0.3026 => 0.2893, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -4.35% (0.3446 => 0.3296, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -4.33% (0.3788 => 0.3624, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -4.28% (0.3059 => 0.2928, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -4.25% (0.6347 => 0.6077, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.23% (0.3849 => 0.3686, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -4.21% (0.2849 => 0.2729, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.18% (0.3252 => 0.3116, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.16% (0.9077 => 0.8699, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: -4.08% (0.6441 => 0.6178, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: -4.06% (0.7779 => 0.7463, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.01% (0.4813 => 0.4620, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.91% (0.3323 => 0.3193, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: -3.38% (1.5610 => 1.5082, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -2.96% (20.7746 => 20.1595, std.dev.: 0.0975) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7540, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: -8.77% (1.2842 => 1.1716, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: -4.22% (2.2633 => 2.1678, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.98% (1.3096 => 1.2706, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4724, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.02% (3.2107 => 3.1781, std.dev.: 0.0003) Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 00:34:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 02:34:35 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121112083435.8AB6D2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5777?compare_to=5775&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5777, Order: 167717, Start Time: 2012-11-12 07:08:10, End Time: 2012-11-12 08:34:50 To: 5775, Order: 167714, Start Time: 2012-11-12 05:24:38, End Time: 2012-11-12 06:50:49 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 15 (94 on baseline) Performance Improvements: 3 (24 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 973 (856 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.84% (0.4880 => 0.5214, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.79% (0.2903 => 0.3100, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.71% (0.6134 => 0.6484, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.91% (0.2343 => 0.2458, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.04% (0.6318 => 0.6573, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.78% (4.2559 => 4.3315, std.dev.: 0.0193) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.65% (1.2039 => 1.2238, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.39% (4.5655 => 4.6288, std.dev.: 0.0140) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.28% (1.2100 => 1.2255, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.27% (13.3756 => 13.5456, std.dev.: 0.0444) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 5.50% (2.3746 => 2.5052, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/distray/distray: 4.61% (0.2342 => 0.2450, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.41% (14.5266 => 15.0218, std.dev.: 0.1167) MultiSource/Benchmarks/BitBench/five11/five11: 1.56% (5.6411 => 5.7291, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.13% (4.5367 => 4.5880, std.dev.: 0.0076) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.02% (8.6361 => 8.3753, std.dev.: 0.0591) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.53% (5.4012 => 5.3187, std.dev.: 0.0172) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/ffbench: -2.76% (1.4489 => 1.4089, std.dev.: 0.0080) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.38% (16.7562 => 16.6921, std.dev.: 0.2276) MultiSource/Applications/obsequi/Obsequi: -0.39% (1.0743 => 1.0701, std.dev.: 0.0068) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.01% (21.7718 => 21.7692, std.dev.: 0.0951) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.30% (0.3682 => 0.3634, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 0.48% (0.6044 => 0.6073, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/reversefile: -1.49% (0.3357 => 0.3307, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: -1.33% (0.2026 => 0.1999, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.73% (0.0192 => 0.0181, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 10.62% (0.0386 => 0.0427, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 19.13% (0.0277 => 0.0330, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.58% (0.0317 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.10% (0.0429 => 0.0420, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 3.06% (0.0196 => 0.0202, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -12.04% (0.0191 => 0.0168, std.dev.: 0.0025) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.27% (0.1460 => 0.1464, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.40% (1.2027 => 1.1859, std.dev.: 0.0444) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.72% (0.1436 => 0.1475, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.98% (0.4181 => 0.4222, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.69% (0.1356 => 0.1406, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.64% (0.0590 => 0.0641, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 18.88% (0.0233 => 0.0277, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.72% (0.0609 => 0.0562, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.53% (1.1935 => 1.1998, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 63.16% (0.0019 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.15% (0.0574 => 0.0638, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 53.80% (0.0171 => 0.0263, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.26% (0.7782 => 0.7802, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -51.72% (0.0116 => 0.0056, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2295.48% (0.6332 => 15.1682, std.dev.: 0.2995) MultiSource/Benchmarks/McCat/08-main/main: 48.12% (0.1831 => 0.2712, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.67% (0.1559 => 0.1455, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1490.52% (0.3344 => 5.3187, std.dev.: 0.0172) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.08% (0.2364 => 0.3217, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0429 => 0.0439, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.45% (0.0224 => 0.0225, std.dev.: 0.0008) SingleSource/UnitTests/byval-alignment: -33.48% (0.0230 => 0.0153, std.dev.: 0.0007) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4149, std.dev.: 0.0302) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0709, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4945, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3319, std.dev.: 0.0471) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1447, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4051, std.dev.: 0.0054) SingleSource/Regression/C/uint64_to_float: -23.94% (2.1832 => 1.6605, std.dev.: 0.0015) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.90% (0.0810 => 0.0955, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 11.24% (0.1112 => 0.1237, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.89% (0.6010 => 0.6484, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.57% (0.4847 => 0.5214, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.48% (0.2180 => 0.2343, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.14% (0.2998 => 0.3212, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.84% (0.8321 => 0.8890, std.dev.: 0.0119) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.53% (0.3137 => 0.3342, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.07% (0.2240 => 0.2376, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.59% (1.1606 => 1.2255, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.58% (0.3295 => 0.3479, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.50% (0.1983 => 0.2092, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.15% (0.7473 => 0.7858, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.86% (0.5961 => 0.6251, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.73% (1.1685 => 1.2238, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.55% (0.6287 => 0.6573, std.dev.: 0.0058) MultiSource/Applications/spiff/spiff: 4.53% (0.7950 => 0.8310, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.39% (0.2279 => 0.2379, std.dev.: 0.0031) MultiSource/Applications/hbd/hbd: 4.29% (1.4269 => 1.4881, std.dev.: 0.0195) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.72% (4.1763 => 4.3315, std.dev.: 0.0193) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.32% (0.4127 => 0.4264, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.31% (1.3279 => 1.3718, std.dev.: 0.0067) MultiSource/Applications/ClamAV/clamscan: 3.21% (14.7684 => 15.2423, std.dev.: 0.0572) MultiSource/Applications/SIBsim4/SIBsim4: 3.20% (1.2568 => 1.2970, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.20% (0.8697 => 0.8975, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.17% (0.3717 => 0.3835, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 3.17% (3.8189 => 3.9399, std.dev.: 0.0363) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.15% (4.4873 => 4.6288, std.dev.: 0.0140) MultiSource/Applications/minisat/minisat: 2.94% (0.6834 => 0.7035, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.79% (1.2526 => 1.2875, std.dev.: 0.0042) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.78% (6.6074 => 6.7912, std.dev.: 0.0316) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.77% (13.1811 => 13.5456, std.dev.: 0.0444) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.69% (8.6476 => 8.8801, std.dev.: 0.0472) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.60% (0.9074 => 0.9310, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.51% (1.6386 => 1.6797, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.50% (0.8086 => 0.8288, std.dev.: 0.0049) MultiSource/Applications/d/make_dparser: 2.47% (3.2366 => 3.3164, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.40% (0.8885 => 0.9098, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.39% (0.8007 => 0.8198, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.33% (0.9908 => 1.0139, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 2.27% (0.4397 => 0.4497, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 2.27% (1.1271 => 1.1527, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.26% (0.9688 => 0.9907, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.24% (0.8927 => 0.9127, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.20% (0.8457 => 0.8643, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.17% (0.8611 => 0.8798, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 2.11% (31.8598 => 32.5326, std.dev.: 0.0378) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.03% (0.8805 => 0.8984, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.01% (0.8048 => 0.8210, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.99% (0.8261 => 0.8425, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.95% (0.7932 => 0.8087, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.92% (0.8066 => 0.8221, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.91% (0.8359 => 0.8519, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.89% (2.1401 => 2.1806, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.85% (0.8656 => 0.8816, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.83% (0.8286 => 0.8438, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.79% (4.5702 => 4.6522, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.58% (0.8716 => 0.8854, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.44% (3.1832 => 3.2290, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.43% (1.5315 => 1.5534, std.dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 1.38% (8.6247 => 8.7433, std.dev.: 0.0121) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 75.38% (0.0199 => 0.0349, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/pi: 58.61% (1.5795 => 2.5052, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 19.89% (0.0528 => 0.0633, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.39% (2.9753 => 3.4630, std.dev.: 0.0313) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.69% (0.7597 => 0.8789, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.53% (2.7995 => 3.2064, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.53% (5.0261 => 5.6058, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.89% (0.3186 => 0.3501, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.24% (1.1857 => 1.2834, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 7.23% (1.7056 => 1.8289, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.09% (4.7794 => 5.1183, std.dev.: 0.0277) MultiSource/Applications/SIBsim4/SIBsim4: 6.65% (3.1873 => 3.3992, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.03% (4.5327 => 4.8059, std.dev.: 0.0836) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.94% (4.9686 => 5.2635, std.dev.: 0.0309) SingleSource/Benchmarks/Misc/richards_benchmark: 5.48% (1.3037 => 1.3751, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.56% (3.3761 => 3.5301, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.45% (4.9453 => 5.1653, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.17% (6.2275 => 6.4874, std.dev.: 0.0295) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.06% (4.9469 => 5.1476, std.dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: 3.89% (14.0064 => 14.5517, std.dev.: 0.1026) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.01% (4.8660 => 5.0123, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.93% (11.5690 => 11.9085, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.89% (8.2783 => 8.5172, std.dev.: 0.0061) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.86% (1.2337 => 1.2690, std.dev.: 0.0063) MultiSource/Applications/lambda-0_1_3/lambda: 2.78% (7.4933 => 7.7016, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 2.71% (3.6643 => 3.7636, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.57% (14.6451 => 15.0218, std.dev.: 0.1167) SingleSource/Benchmarks/Shootout/lists: 2.43% (7.3375 => 7.5156, std.dev.: 0.0079) MultiSource/Benchmarks/BitBench/five11/five11: 2.25% (5.6030 => 5.7291, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/neural/neural: 1.33% (1.0841 => 1.0985, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 1.28% (8.5322 => 8.6410, std.dev.: 0.0385) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.27% (3.5679 => 3.6131, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.24% (1.5941 => 1.6139, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.65% (5.4641 => 4.3355, std.dev.: 0.0159) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.02% (1.0512 => 0.9354, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: -10.49% (1.1216 => 1.0039, std.dev.: 0.0215) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -10.14% (7.2130 => 6.4817, std.dev.: 0.2176) SingleSource/Benchmarks/Shootout/heapsort: -8.94% (3.2926 => 2.9983, std.dev.: 0.0683) MultiSource/Benchmarks/mafft/pairlocalalign: -8.54% (63.1822 => 57.7857, std.dev.: 0.0452) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.92% (4.7482 => 4.4196, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.36% (0.3269 => 0.3061, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.82% (5.4972 => 5.1770, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.79% (3.7148 => 3.4998, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.19% (5.1557 => 4.8879, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.32% (4.7449 => 4.5400, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.64% (6.0224 => 5.8031, std.dev.: 0.0246) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.37% (2.8773 => 2.7804, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.13% (0.5807 => 0.5625, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (28.5821 => 27.6890, std.dev.: 0.0444) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.55% (2.4490 => 2.3866, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash2: -2.33% (3.4237 => 3.3438, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.89% (11.5316 => 11.3142, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.60% (9.9065 => 9.7480, std.dev.: 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.56% (2.3487 => 2.3120, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.54% (4.9994 => 4.9226, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/ffbench: -1.45% (1.4296 => 1.4089, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.14% (5.6343 => 5.5698, std.dev.: 0.0112) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.50% (16.4461 => 16.6921, std.dev.: 0.2276) MultiSource/Applications/obsequi/Obsequi: 4.28% (1.0262 => 1.0701, std.dev.: 0.0068) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6870.61% (0.3123 => 21.7692, std.dev.: 0.0951) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.54% (0.2463 => 0.3634, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 1.05% (0.6010 => 0.6073, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.26% (0.3266 => 0.3307, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 1.52% (0.1969 => 0.1999, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 47.15% (0.0123 => 0.0181, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.38% (0.0384 => 0.0420, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -6.67% (0.0180 => 0.0168, std.dev.: 0.0025) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.81% (0.1438 => 0.1464, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 4.68% (1.1329 => 1.1859, std.dev.: 0.0444) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.89% (0.1462 => 0.1475, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.39% (0.4164 => 0.4222, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.70% (0.1369 => 0.1406, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0641 => 0.0641, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.77% (0.0578 => 0.0562, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.91% (1.1437 => 1.1998, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.75% (0.0627 => 0.0638, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 46.11% (0.0180 => 0.0263, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.68% (0.8017 => 0.7802, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -9.68% (0.0062 => 0.0056, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 00:51:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 02:51:35 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121112085135.5F20B2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5778?compare_to=5776&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5778, Order: 167718, Start Time: 2012-11-12 07:23:45, End Time: 2012-11-12 08:51:49 To: 5776, Order: 167714, Start Time: 2012-11-12 05:35:39, End Time: 2012-11-12 07:00:30 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (172 on baseline) Unchanged Tests: 1042 (866 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.25% (1.2783 => 1.3710, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.65% (2.0478 => 2.1020, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/salsa20: 2.53% (7.4937 => 7.6831, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/hash2: 2.20% (3.1932 => 3.2634, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.74% (0.1431 => 0.1306, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.77% (0.3821 => 0.3524, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: -7.54% (2.4924 => 2.3044, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: -6.91% (0.3357 => 0.3125, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.59% (0.2428 => 0.2268, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.53% (0.3658 => 0.3419, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.52% (0.3142 => 0.2937, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.51% (3.5339 => 3.3039, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.40% (0.1796 => 0.1681, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.40% (0.6484 => 0.6069, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.38% (0.9852 => 0.9223, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -6.37% (9.2283 => 8.6404, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: -6.36% (0.1761 => 0.1649, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.31% (1.0544 => 0.9879, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: -6.30% (16.1920 => 15.1717, std.dev.: 0.3282) SingleSource/Benchmarks/Misc/oourafft: -6.30% (0.2160 => 0.2024, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.30% (22.4056 => 20.9951, std.dev.: 0.0791) MultiSource/Applications/JM/ldecod/ldecod: -6.29% (7.0961 => 6.6501, std.dev.: 0.1398) SingleSource/Benchmarks/Misc/ReedSolomon: -6.28% (0.1879 => 0.1761, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -6.21% (1.1450 => 1.0739, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.17% (0.7198 => 0.6754, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.17% (1.3722 => 1.2876, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/trivial-interface: -6.16% (0.3812 => 0.3577, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.16% (0.3848 => 0.3611, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.15% (0.5478 => 0.5141, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.14% (0.5863 => 0.5503, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -6.11% (4.3330 => 4.0682, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/exceptions-4: -6.08% (0.3880 => 0.3644, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -6.08% (0.3831 => 0.3598, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.07% (0.3891 => 0.3655, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -6.06% (0.9179 => 0.8623, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.05% (0.5802 => 0.5451, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: -6.03% (0.4176 => 0.3924, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -6.03% (0.3896 => 0.3661, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.02% (0.3884 => 0.3650, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.01% (0.2695 => 0.2533, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.01% (0.5859 => 0.5507, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.00% (0.6395 => 0.6011, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.99% (0.5805 => 0.5457, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.99% (1.2784 => 1.2018, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.97% (4.8161 => 4.5286, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.96% (0.6660 => 0.6263, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: -5.95% (0.4033 => 0.3793, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.94% (0.2355 => 0.2215, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.94% (0.5705 => 0.5366, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.93% (1.2300 => 1.1570, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.92% (0.5591 => 0.5260, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.91% (4.5069 => 4.2404, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.91% (0.6395 => 0.6017, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.91% (0.6230 => 0.5862, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.90% (0.6304 => 0.5932, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.90% (0.7339 => 0.6906, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.90% (0.5849 => 0.5504, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -5.90% (0.2985 => 0.2809, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.88% (0.5575 => 0.5247, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -5.88% (0.4199 => 0.3952, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.88% (1.6364 => 1.5402, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.87% (0.5857 => 0.5513, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.87% (0.9542 => 0.8982, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.87% (4.0323 => 3.7957, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.87% (1.4642 => 1.3783, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.86% (0.6293 => 0.5924, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.86% (0.5925 => 0.5578, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.83% (0.6052 => 0.5699, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.82% (0.7919 => 0.7458, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -5.81% (0.3406 => 0.3208, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.81% (0.6297 => 0.5931, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.81% (0.2548 => 0.2400, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.80% (4.8802 => 4.5971, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/08-main/main: -5.79% (0.2659 => 0.2505, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.79% (0.6446 => 0.6073, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.77% (0.7524 => 0.7090, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.76% (0.5569 => 0.5248, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.76% (0.6667 => 0.6283, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.75% (0.6260 => 0.5900, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.75% (0.6194 => 0.5838, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -5.75% (17.1032 => 16.1206, std.dev.: 0.0204) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.74% (0.3483 => 0.3283, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.74% (0.6676 => 0.6293, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.74% (6.7716 => 6.3832, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.73% (0.5581 => 0.5261, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.73% (0.8521 => 0.8033, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/parameter-passing: -5.72% (0.4280 => 0.4035, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.72% (14.2083 => 13.3955, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.70% (0.5456 => 0.5145, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.70% (0.5688 => 0.5364, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: -5.67% (15.5079 => 14.6283, std.dev.: 0.3276) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.66% (0.5941 => 0.5605, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.66% (0.5570 => 0.5255, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.66% (0.6189 => 0.5839, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -5.65% (0.7447 => 0.7026, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/18-imp/imp: -5.64% (0.3581 => 0.3379, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.57% (1.6474 => 1.5556, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.57% (0.6033 => 0.5697, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -5.56% (4.0594 => 3.8336, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.56% (0.6440 => 0.6082, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.55% (0.5168 => 0.4881, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.55% (0.4916 => 0.4643, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.54% (0.4151 => 0.3921, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.50% (2.2587 => 2.1345, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.49% (0.6736 => 0.6366, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: -5.49% (0.4515 => 0.4267, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.44% (0.5329 => 0.5039, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.38% (0.7021 => 0.6643, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -5.37% (1.3864 => 1.3119, std.dev.: 0.0206) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.34% (0.6681 => 0.6324, std.dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: -5.33% (1.1530 => 1.0915, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: -5.33% (0.4861 => 0.4602, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.32% (5.4682 => 5.1773, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.31% (1.2221 => 1.1572, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.29% (0.3931 => 0.3723, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.29% (1.2210 => 1.1564, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.27% (0.3016 => 0.2857, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -5.25% (0.3255 => 0.3084, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.24% (0.3837 => 0.3636, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.23% (8.0126 => 7.5937, std.dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: -5.21% (0.7982 => 0.7566, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: -5.20% (0.3194 => 0.3028, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.18% (0.9557 => 0.9062, std.dev.: 0.0109) MultiSource/Applications/ClamAV/clamscan: -5.18% (15.2527 => 14.4628, std.dev.: 0.1330) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.15% (0.5999 => 0.5690, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.13% (0.3491 => 0.3312, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -5.12% (1.3148 => 1.2475, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/lists: -5.11% (0.3621 => 0.3436, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -5.09% (0.3026 => 0.2872, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.08% (0.4427 => 0.4202, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary3: -5.08% (0.3446 => 0.3271, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -5.06% (34.0927 => 32.3663, std.dev.: 0.0206) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.06% (0.3319 => 0.3151, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: -5.06% (0.4248 => 0.4033, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -5.06% (0.3025 => 0.2872, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -5.03% (18.2933 => 17.3736, std.dev.: 0.0203) MultiSource/Benchmarks/McCat/09-vor/vor: -5.01% (0.3271 => 0.3107, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.00% (0.3057 => 0.2904, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.98% (0.2989 => 0.2840, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.97% (0.4083 => 0.3880, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: -4.95% (0.3394 => 0.3226, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -4.94% (0.3867 => 0.3676, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.91% (2.1713 => 2.0646, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: -4.91% (0.2871 => 0.2730, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.91% (0.3849 => 0.3660, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.90% (0.4813 => 0.4577, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.89% (0.2903 => 0.2761, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.89% (0.2106 => 0.2003, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -4.88% (0.3481 => 0.3311, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -4.87% (0.2939 => 0.2796, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.81% (0.2849 => 0.2712, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -4.80% (0.3788 => 0.3606, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: -4.77% (0.3059 => 0.2913, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.74% (0.2933 => 0.2794, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -4.73% (0.6750 => 0.6431, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.71% (0.3205 => 0.3054, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.70% (0.2385 => 0.2273, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.64% (0.3252 => 0.3101, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.63% (0.2999 => 0.2860, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -4.53% (0.4524 => 0.4319, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.28% (0.7779 => 0.7446, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.24% (0.3323 => 0.3182, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -4.14% (0.6347 => 0.6084, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.00% (0.4321 => 0.4148, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.97% (0.9077 => 0.8717, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference-object: -3.91% (0.6441 => 0.6189, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: -3.53% (1.5610 => 1.5059, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -2.92% (20.7746 => 20.1684, std.dev.: 0.0250) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.53% (7.5137 => 5.7460, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/richards_benchmark: -8.70% (1.2842 => 1.1725, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.92% (1.7753 => 1.7057, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: -3.81% (2.2633 => 2.1771, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4695, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0003) Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 00:56:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 02:56:45 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121112085645.49FC52A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5779?compare_to=5760&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5779, Order: 167691, Start Time: 2012-11-11 08:34:22, End Time: 2012-11-12 08:56:59 To: 5760, Order: 167668, Start Time: 2012-11-10 08:25:55, End Time: 2012-11-11 07:59:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (43 on baseline) New Passes: 0 (12 on baseline) Performance Regressions: 0 (168 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 50 (7 on baseline) Unchanged Tests: 991 (641 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -12.53% (1.4066 => 1.2304, std.dev.: 0.0036) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/ClamAV/clamscan: -0.32% (27.5470 => 27.4584, std.dev.: 0.0321) MultiSource/Applications/JM/ldecod/ldecod: -0.03% (6.3528 => 6.3511, std.dev.: 0.0257) MultiSource/Applications/JM/lencod/lencod: 0.09% (19.7153 => 19.7322, std.dev.: 0.0423) MultiSource/Applications/oggenc/oggenc: - (0.0020 => 0.0020) MultiSource/Applications/siod/siod: 0.82% (1.5711 => 1.5840, std.dev.: 0.0131) MultiSource/Applications/sqlite3/sqlite3: 0.65% (0.5247 => 0.5281, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -6.90% (51.7491 => 48.1763, std.dev.: 0.1845) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -0.01% (0.8597 => 0.8596, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -0.51% (5.0979 => 5.0720, std.dev.: 0.0230) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 0.43% (10.5033 => 10.5484, std.dev.: 0.0225) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 0.05% (1.4159 => 1.4166, std.dev.: 0.0205) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -0.69% (0.3056 => 0.3035, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.71% (0.0283 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -0.81% (1.7400 => 1.7259, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/voronoi/voronoi: 0.36% (0.1942 => 0.1949, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: - (0.0019 => 0.0019) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: - (0.0019 => 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 0.08% (0.2559 => 0.2561, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.10% (1.7334 => 1.7351, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -0.20% (5.2541 => 5.2436, std.dev.: 0.0116) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.60% (1.1160 => 1.1093, std.dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: -0.64% (0.2974 => 0.2955, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0020 => 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/Large/sphereflake MultiSource/Applications/ClamAV/clamscan: - (0.0001 => 0.0001) MultiSource/Applications/JM/ldecod/ldecod: - (0.0001 => 0.0001) MultiSource/Applications/JM/lencod/lencod: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Applications/siod/siod: - (0.0001 => 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.91% (0.0724 => 0.0674, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: - (0.0001 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 0.01% (499.7884 => 499.8624, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/voronoi/voronoi: - (0.0001 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: - (0.0001 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: - (0.0001 => 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/nbench/nbench: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -0.00% (2.9168 => 2.9167, std.dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/nbench/nbench MultiSource/Applications/ClamAV/clamscan: 23.82% (22.1758 => 27.4584, std.dev.: 0.0321) MultiSource/Applications/JM/ldecod/ldecod: -39.14% (10.4361 => 6.3511, std.dev.: 0.0257) MultiSource/Applications/JM/lencod/lencod: -10.05% (21.9371 => 19.7322, std.dev.: 0.0423) MultiSource/Applications/oggenc/oggenc: -99.97% (5.7591 => 0.0020) MultiSource/Applications/siod/siod: -31.04% (2.2969 => 1.5840, std.dev.: 0.0131) MultiSource/Applications/sqlite3/sqlite3: -96.93% (17.1811 => 0.5281, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -23.82% (63.2438 => 48.1763, std.dev.: 0.1845) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.11% (0.8101 => 0.8596, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.57% (4.9449 => 5.0720, std.dev.: 0.0230) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 49.54% (7.0540 => 10.5484, std.dev.: 0.0225) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -8.10% (1.5415 => 1.4166, std.dev.: 0.0205) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -37.79% (0.4879 => 0.3035, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.55% (6.6874 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -67.76% (5.3526 => 1.7259, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/voronoi/voronoi: -27.81% (0.2700 => 0.1949, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -99.94% (2.9384 => 0.0019) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -99.83% (1.1194 => 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -19.39% (0.3177 => 0.2561, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -67.78% (5.3855 => 1.7351, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.83% (5.0018 => 5.2436, std.dev.: 0.0116) MultiSource/Benchmarks/nbench/nbench: -75.04% (1.1840 => 0.2955, std.dev.: 0.0014) New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/nbench/nbench SingleSource/Benchmarks/Misc-C++/Large/sphereflake MultiSource/Applications/ClamAV/clamscan: -99.94% (0.1629 => 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -99.92% (0.1298 => 0.0001) MultiSource/Applications/siod/siod: -100.00% (3.2827 => 0.0001) MultiSource/Applications/sqlite3/sqlite3: -100.00% (4.6441 => 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -100.00% (2.3135 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -98.00% (0.0050 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -99.96% (0.2497 => 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -50.00% (0.0002 => 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -75.00% (0.0004 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -99.97% (0.3987 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 44225.83% (1.1277 => 499.8624, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/voronoi/voronoi: -99.97% (0.3070 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -100.00% (2.6546 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -100.00% (2.6778 => 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -100.00% (4.5009 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -99.80% (0.0506 => 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -97.30% (0.0037 => 0.0001) MultiSource/Benchmarks/nbench/nbench: -100.00% (11.6436 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.02% (3.2416 => 2.9167, std.dev.: 0.0006) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 191.20% (0.5229 => 1.5227, std.dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: 12.55% (14.9895 => 16.8711, std.dev.: 0.0150) MultiSource/Applications/kimwitu++/kc: 36.76% (14.1553 => 19.3582, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/gs/gs: 13.29% (4.1105 => 4.6566, std.dev.: 0.0180) SingleSource/Benchmarks/Misc-C++-EH/spirit: 70.53% (3.4629 => 5.9052, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/stepanov_container: 62.97% (0.6222 => 1.0140, std.dev.: 0.0066) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3839600.00% (0.0001 => 3.8397, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 11174100.00% (0.0001 => 11.1742, std.dev.: 0.0192) MultiSource/Applications/kimwitu++/kc: 50600.00% (0.0001 => 0.0507, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10002400.00% (0.0001 => 10.0025, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5490700.00% (0.0001 => 5.4908, std.dev.: 0.0036) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 50.00% (0.1056 => 0.1584, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: 41.82% (0.0746 => 0.1058, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 38.13% (0.1432 => 0.1978, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 38.08% (0.0730 => 0.1008, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 24.21% (0.0636 => 0.0790, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.90% (0.1584 => 0.1915, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.18% (0.1566 => 0.1882, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 20.16% (0.2554 => 0.3069, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/tsp/tsp: 19.74% (0.1175 => 0.1407, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.93% (8.1363 => 9.6769, std.dev.: 0.0155) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.53% (0.0793 => 0.0932, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 17.07% (0.1125 => 0.1317, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.00% (0.0953 => 0.1115, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.07% (0.0871 => 0.1011, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.79% (0.8172 => 0.9462, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/matrix: 15.28% (0.0818 => 0.0943, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.96% (0.0842 => 0.0968, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.67% (0.1029 => 0.1180, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.38% (0.2065 => 0.2362, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/mst/mst: 14.36% (0.1163 => 0.1330, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.35% (0.3121 => 0.3569, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/em3d/em3d: 14.34% (0.1695 => 0.1938, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.27% (0.0834 => 0.0953, std.dev.: 0.0021) MultiSource/Applications/aha/aha: 13.90% (0.1151 => 0.1311, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.88% (0.0886 => 0.1009, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.78% (0.2758 => 0.3138, std.dev.: 0.0049) MultiSource/Applications/viterbi/viterbi: 13.63% (0.1555 => 0.1767, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.43% (0.1117 => 0.1267, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 13.38% (0.7115 => 0.8067, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.38% (0.0770 => 0.0873, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/health/health: 13.33% (0.1268 => 0.1437, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.12% (0.0770 => 0.0871, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.09% (0.1940 => 0.2194, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.08% (14.3668 => 16.2463, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.96% (0.2107 => 0.2380, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 12.96% (0.7433 => 0.8396, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.91% (0.0798 => 0.0901, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.87% (0.5981 => 0.6751, std.dev.: 0.0038) MultiSource/Applications/sgefa/sgefa: 12.80% (0.3109 => 0.3507, std.dev.: 0.0008) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.77% (0.1143 => 0.1289, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 12.73% (1.1642 => 1.3124, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.71% (0.5569 => 0.6277, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/chomp: 12.69% (0.1655 => 0.1865, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.51% (0.2271 => 0.2555, std.dev.: 0.0029) MultiSource/Applications/spiff/spiff: 12.44% (0.7835 => 0.8810, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.42% (0.1337 => 0.1503, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.38% (0.5105 => 0.5737, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.24% (0.1062 => 0.1192, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.24% (0.9765 => 1.0960, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.22% (0.5860 => 0.6576, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.22% (0.1236 => 0.1387, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.03% (0.6675 => 0.7478, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.03% (0.4615 => 0.5170, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.02% (0.1032 => 0.1156, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 12.01% (0.3423 => 0.3834, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: 12.00% (10.3673 => 11.6118, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.92% (0.3441 => 0.3851, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.84% (1.3050 => 1.4595, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.79% (0.1510 => 0.1688, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 11.69% (3.8723 => 4.3249, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.67% (0.3307 => 0.3693, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 11.58% (3.3354 => 3.7215, std.dev.: 0.0195) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.53% (4.2646 => 4.7565, std.dev.: 0.0140) SingleSource/UnitTests/ObjC/parameter-passing: 11.08% (0.3927 => 0.4362, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.94% (1.5859 => 1.7594, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 10.94% (2.0273 => 2.2490, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/life/life: 10.93% (0.0933 => 0.1035, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 10.86% (0.3886 => 0.4308, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.84% (0.3543 => 0.3927, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 10.83% (0.3473 => 0.3849, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.81% (0.3497 => 0.3875, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.73% (0.1892 => 0.2095, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 10.67% (0.3561 => 0.3941, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.67% (0.3543 => 0.3921, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 10.67% (0.3516 => 0.3891, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.65% (3.8922 => 4.3068, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.63% (0.1044 => 0.1155, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.60% (0.5020 => 0.5552, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/05-eks/eks: 10.58% (0.4299 => 0.4754, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions: 10.58% (0.3828 => 0.4233, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 10.57% (9.4845 => 10.4868, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/09-vor/vor: 10.50% (0.3180 => 0.3514, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 10.45% (0.3694 => 0.4080, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.39% (0.1906 => 0.2104, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.37% (0.6450 => 0.7119, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 10.32% (1.0722 => 1.1829, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 10.32% (0.6456 => 0.7122, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.30% (2.2024 => 2.4293, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.30% (0.8067 => 0.8898, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.27% (0.1695 => 0.1869, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 10.02% (0.1268 => 0.1395, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.95% (0.2603 => 0.2862, std.dev.: 0.0075) MultiSource/Applications/hbd/hbd: 9.91% (1.5603 => 1.7150, std.dev.: 0.0168) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.89% (2.2022 => 2.4200, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.75% (1.1861 => 1.3018, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.57% (0.3865 => 0.4235, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.53% (0.4103 => 0.4494, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 9.52% (0.8921 => 0.9770, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash: 9.51% (0.4289 => 0.4697, std.dev.: 0.0054) SingleSource/UnitTests/SignlessTypes/rem: 9.27% (0.1144 => 0.1250, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 9.24% (0.3387 => 0.3700, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 9.23% (0.1463 => 0.1598, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 9.20% (0.4620 => 0.5045, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.18% (0.4203 => 0.4589, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 9.09% (0.3422 => 0.3733, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.06% (1.4186 => 1.5471, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.95% (0.4636 => 0.5051, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.64% (0.2430 => 0.2640, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 8.52% (0.3684 => 0.3998, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 8.50% (0.4048 => 0.4392, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.47% (0.3826 => 0.4150, std.dev.: 0.0044) SingleSource/UnitTests/ObjC++/property-reference-object: 8.44% (0.6030 => 0.6539, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 8.44% (0.3603 => 0.3907, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.10% (0.3162 => 0.3418, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 8.02% (0.2831 => 0.3058, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 7.93% (0.5925 => 0.6395, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.87% (0.4064 => 0.4384, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.84% (0.3650 => 0.3936, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.65% (0.3283 => 0.3534, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 7.64% (0.3232 => 0.3479, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.61% (0.2891 => 0.3111, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.60% (0.7326 => 0.7883, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary2: 7.55% (0.3379 => 0.3634, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.51% (2.0665 => 2.2217, std.dev.: 0.0052) SingleSource/Regression/C++/ofstream_ctor: 7.40% (0.2905 => 0.3120, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/except: 7.28% (0.2871 => 0.3080, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 7.25% (0.3282 => 0.3520, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 7.23% (0.3098 => 0.3322, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.18% (0.2756 => 0.2954, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 7.13% (0.2877 => 0.3082, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.05% (0.2725 => 0.2917, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 7.04% (0.3052 => 0.3267, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 6.98% (0.2049 => 0.2192, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.92% (0.3427 => 0.3664, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 6.89% (0.2802 => 0.2995, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.84% (0.2793 => 0.2984, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hello: 6.82% (0.2714 => 0.2899, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.79% (0.2872 => 0.3067, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 6.46% (1.2842 => 1.3672, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/bh/bh: 5.98% (0.3092 => 0.3277, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.96% (0.3136 => 0.3323, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.05% (0.3131 => 0.3289, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.04% (0.3935 => 0.4094, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.12% (0.3817 => 0.3936, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.72% (1.1145 => 1.3008, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 13.89% (6.6465 => 7.5699, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.96% (1.1396 => 1.2531, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.90% (1.7254 => 1.8790, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 8.12% (0.9505 => 1.0277) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3690, std.dev.: 0.0024) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.09% (4.2280 => 4.4008, std.dev.: 0.0114) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.77% (0.4162 => 0.4319, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.48% (8.6802 => 8.8955, std.dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0313 => 1.0562, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2200, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.80% (0.8333 => 0.8483, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.22% (3.6395 => 3.6839, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0495, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5777, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: 1.06% (1.4460 => 1.4613, std.dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.68% (5.2763 => 1.2304, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: -75.67% (0.8651 => 0.2105, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -45.56% (0.1622 => 0.0883, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -12.78% (0.1330 => 0.1160, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -9.26% (1.7609 => 1.5978, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -8.94% (54.1659 => 49.3232, std.dev.: 0.0243) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.04% (0.0628 => 0.0364, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7652, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/mason/mason: -19.48% (0.2161 => 0.1740, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4262, std.dev.: 0.0034) MultiSource/Benchmarks/NPB-serial/is/is: -10.99% (9.5636 => 8.5128, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.97% (32.5116 => 28.9448, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -10.93% (1.5373 => 1.3693, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.13% (1.5660 => 1.4230, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/distray/distray: -8.73% (0.1592 => 0.1453, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (19.9488 => 18.2833, std.dev.: 0.0197) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4780, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7052, std.dev.: 0.0055) SingleSource/Benchmarks/McGill/chomp: -6.22% (1.2373 => 1.1604, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -6.11% (0.4808 => 0.4514, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.64% (1.9577 => 1.8473, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5759, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.16% (1.6805 => 1.5938, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5090, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.09% (0.9957 => 0.9550, std.dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.74% (1.3677 => 1.3166, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -3.24% (5.0483 => 4.8849, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0855, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.78% (8.1563 => 8.0108, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6762, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -1.76% (85.0658 => 83.5653, std.dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.55% (2.5528 => 2.5132, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.33% (1.3045 => 1.2872, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.41% (1.1048 => 1.1093, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -99.97% (7.1582 => 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: -99.86% (0.0720 => 0.0001) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.15% (0.2116 => 0.0674, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 01:22:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 03:22:49 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121112092249.F108F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5780?compare_to=5774&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5780, Order: 167714, Start Time: 2012-11-12 06:04:30, End Time: 2012-11-12 09:23:05 To: 5774, Order: 167698, Start Time: 2012-11-12 02:00:51, End Time: 2012-11-12 05:16:15 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (177 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1039 (715 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.61% (125.4682 => 131.2485, std.dev.: 0.3555) MultiSource/Benchmarks/Olden/perimeter/perimeter: 1.82% (0.6099 => 0.6210, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.06% (1.3664 => 1.3519, std.dev.: 0.0051) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.40% (0.0625 => 0.0890, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.83% (0.1063 => 0.1412, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.61% (0.2969 => 0.3759, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.40% (0.1106 => 0.1398, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.32% (0.4253 => 0.5330, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.10% (0.4139 => 0.5178, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.07% (0.0714 => 0.0893, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 24.82% (1.5932 => 1.9886, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.21% (0.0475 => 0.0590) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.07% (0.4994 => 0.6196, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.90% (0.5900 => 0.7310, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.54% (0.5000 => 0.6177, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.46% (0.0584 => 0.0721, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.40% (0.0547 => 0.0675, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.15% (0.1620 => 0.1995, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.82% (0.1021 => 0.1254, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.58% (0.1107 => 0.1357, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 22.37% (0.0599 => 0.0733, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.30% (0.0897 => 0.1097, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.48% (0.0633 => 0.0769, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 21.41% (0.0948 => 0.1151, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.40% (0.0584 => 0.0709, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.31% (0.1103 => 0.1338, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.21% (0.0495 => 0.0600, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.18% (0.0642 => 0.0778, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.07% (0.0541 => 0.0655, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 21.07% (0.0821 => 0.0994, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.74% (0.1003 => 0.1211, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.72% (0.1549 => 0.1870, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.63% (0.3903 => 0.4708, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 20.57% (0.1619 => 0.1952, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.51% (0.1604 => 0.1933, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.44% (0.0822 => 0.0990, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 20.36% (0.0604 => 0.0727, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 20.22% (0.5826 => 0.7004, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 20.02% (0.5889 => 0.7068, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 19.54% (0.0947 => 0.1132, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.42% (0.0582 => 0.0695, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.36% (0.1462 => 0.1745, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 19.31% (0.0808 => 0.0964, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.20% (0.3890 => 0.4637, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.02% (0.2014 => 0.2397, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 18.97% (0.1218 => 0.1449, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.67% (1.3152 => 1.5608, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 18.59% (0.0581 => 0.0689, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 18.34% (0.4029 => 0.4768, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/mst/mst: 18.34% (0.0698 => 0.0826, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.31% (0.2736 => 0.3237, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.24% (0.1968 => 0.2327, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 18.21% (0.1505 => 0.1779, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.18% (0.0572 => 0.0676, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.14% (0.2866 => 0.3386, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.11% (0.1088 => 0.1285, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.79% (3.5627 => 4.1966, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.63% (0.0573 => 0.0674, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.60% (0.2875 => 0.3381, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 17.60% (0.7171 => 0.8433, std.dev.: 0.0043) MultiSource/Applications/Burg/burg: 17.58% (0.5546 => 0.6521, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.53% (0.2738 => 0.3218, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.52% (0.0605 => 0.0711, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.39% (0.4658 => 0.5468, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 17.38% (1.8794 => 2.2061, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.33% (1.6211 => 1.9021, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 17.29% (0.9697 => 1.1374, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.25% (0.5026 => 0.5893, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.24% (0.1160 => 0.1360, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.17% (0.4361 => 0.5110, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.03% (0.3271 => 0.3828, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: 16.99% (0.2714 => 0.3175, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 16.89% (0.1421 => 0.1661, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 16.84% (0.2725 => 0.3184, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.78% (0.2729 => 0.3187, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 16.73% (1.0781 => 1.2585, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: 16.62% (0.2750 => 0.3207, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.59% (2.7292 => 3.1820, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.59% (0.3195 => 0.3725, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.56% (0.3930 => 0.4581, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/random: 16.55% (0.2803 => 0.3267, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/bh/bh: 16.51% (0.1284 => 0.1496, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 16.49% (0.2813 => 0.3277, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 16.37% (0.2780 => 0.3235, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 16.37% (0.2823 => 0.3285, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 16.31% (0.3096 => 0.3601, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.29% (2.0673 => 2.4040, std.dev.: 0.0568) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.27% (4.4195 => 5.1387, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/except: 16.26% (0.2811 => 0.3268, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 16.23% (4.2109 => 4.8944, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.19% (0.2792 => 0.3244, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 16.18% (0.3004 => 0.3490, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.15% (0.2911 => 0.3381, std.dev.: 0.0065) MultiSource/Applications/hexxagon/hexxagon: 16.12% (0.9909 => 1.1506, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.05% (1.9694 => 2.2854, std.dev.: 0.0048) MultiSource/Benchmarks/Bullet/bullet: 15.88% (23.5202 => 27.2545, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.78% (0.1090 => 0.1262, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.73% (1.9966 => 2.3107, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 15.64% (0.3267 => 0.3778, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 15.59% (0.3258 => 0.3766, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.42% (0.3060 => 0.3532, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.41% (0.3362 => 0.3880, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/ary2: 15.22% (0.3317 => 0.3822, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.14% (0.3282 => 0.3779, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/football/football: 15.08% (0.2075 => 0.2388, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.04% (0.3124 => 0.3594, std.dev.: 0.0099) MultiSource/Benchmarks/nbench/nbench: 14.96% (0.2566 => 0.2950, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-4: 14.95% (0.3465 => 0.3983, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 14.85% (0.3496 => 0.4015, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 14.85% (0.3678 => 0.4224, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.82% (0.3488 => 0.4005, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 14.75% (0.3477 => 0.3990, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 14.74% (0.3446 => 0.3954, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 14.70% (0.3348 => 0.3840, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 14.67% (0.3469 => 0.3978, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 14.67% (0.3442 => 0.3947, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 14.65% (0.3460 => 0.3967, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 14.63% (1.4269 => 1.6357, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.61% (0.3690 => 0.4229, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: 14.57% (0.3726 => 0.4269, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 14.38% (0.3650 => 0.4175, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.36% (0.3845 => 0.4397, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 14.33% (0.3643 => 0.4165, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 14.31% (0.3724 => 0.4257, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.29% (0.3625 => 0.4143, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 14.23% (0.4251 => 0.4856, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 14.13% (0.4146 => 0.4732, std.dev.: 0.0022) MultiSource/Applications/treecc/treecc: 14.12% (0.7875 => 0.8987, std.dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 14.05% (2.1653 => 2.4695, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.02% (0.3981 => 0.4539, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 13.85% (0.0758 => 0.0863, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 13.64% (2.1013 => 2.3880, std.dev.: 0.0093) MultiSource/Applications/JM/lencod/lencod: 13.60% (4.6177 => 5.2458, std.dev.: 0.0136) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.33% (0.2040 => 0.2312, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 13.33% (0.5012 => 0.5680, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 12.93% (0.2691 => 0.3039, std.dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 12.45% (5.5417 => 6.2316, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.33% (0.2068 => 0.2323, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.22% (0.1383 => 0.1552, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.18% (0.6435 => 0.7219, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 11.55% (0.3498 => 0.3902, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.51% (0.2737 => 0.3052, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.48% (0.1028 => 0.1146, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 11.31% (0.6634 => 0.7384, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 11.16% (0.4847 => 0.5388, std.dev.: 0.0184) MultiSource/Applications/minisat/minisat: 10.82% (0.3336 => 0.3697, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.80% (0.3084 => 0.3417, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 10.25% (0.2391 => 0.2636, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 10.18% (2.0346 => 2.2417, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.03% (0.2103 => 0.2314, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.88% (4.6926 => 5.1093, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.80% (0.5361 => 0.5833, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.73% (11.6398 => 12.6556, std.dev.: 0.0328) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.29% (0.5584 => 0.6047, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.07% (0.7426 => 0.8025, std.dev.: 0.0050) MultiSource/Applications/kimwitu++/kc: 7.40% (11.9555 => 12.8398, std.dev.: 0.0682) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.33% (0.3792 => 0.3994, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 9.74% (0.2802 => 0.3075, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6109, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6678, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary: 4.90% (0.2122 => 0.2226, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-2: 4.78% (1.8057 => 1.8920, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1654, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.47% (0.3693 => 0.3858, std.dev.: 0.0059) SingleSource/Benchmarks/Dhrystone/dry: 4.28% (14.0481 => 14.6497, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1929, std.dev.: 0.0093) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.48% (3.1722 => 3.2191, std.dev.: 0.0053) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3036, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2861, std.dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5844, std.dev.: 0.0126) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5660, std.dev.: 0.0123) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9741, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7959, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/tsp/tsp: -7.21% (2.1113 => 1.9590, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -6.16% (0.2402 => 0.2254, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.57% (11.2080 => 10.8076, std.dev.: 0.0055) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.74% (17.2379 => 16.7651, std.dev.: 0.0255) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8607, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5785, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4955, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.11% (105.3826 => 104.2153, std.dev.: 0.0423) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0475, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 02:17:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 04:17:27 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121112101727.14B242A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5781?compare_to=5777&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5781, Order: 167719, Start Time: 2012-11-12 08:51:55, End Time: 2012-11-12 10:17:38 To: 5777, Order: 167717, Start Time: 2012-11-12 07:08:10, End Time: 2012-11-12 08:34:50 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 3 (103 on baseline) Performance Improvements: 4 (27 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 984 (844 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.76% (0.8652 => 0.8804, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.73% (0.8992 => 0.9148, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 13.96% (0.1368 => 0.1559, std.dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.24% (0.9321 => 0.9205, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -8.57% (0.3501 => 0.3201, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.22% (15.0218 => 14.2377, std.dev.: 0.1791) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.84% (0.6146 => 0.6033, std.dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.48% (16.6921 => 16.6117, std.dev.: 0.0867) MultiSource/Applications/obsequi/Obsequi: -0.30% (1.0701 => 1.0669, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.43% (21.7692 => 21.6748, std.dev.: 0.4674) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.06% (0.3634 => 0.3636, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -0.61% (0.6073 => 0.6036, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.21% (0.3307 => 0.3314, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 0.15% (0.1999 => 0.2002, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.10% (0.0181 => 0.0179, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.47% (0.0427 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0330 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0312 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.48% (0.0420 => 0.0422, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0202 => 0.0202, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 7.14% (0.0168 => 0.0180, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -15.38% (0.0013 => 0.0011, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1464 => 0.1465, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: -2.04% (1.1859 => 1.1617, std.dev.: 0.0155) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.12% (0.1475 => 0.1429, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.22% (0.4222 => 0.4086, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.98% (0.1406 => 0.1462, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.62% (0.0641 => 0.0605, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -19.49% (0.0277 => 0.0223, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.25% (0.0562 => 0.0555, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.26% (1.1998 => 1.1967, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -87.10% (0.0031 => 0.0004, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.90% (0.0638 => 0.0594, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -34.60% (0.0263 => 0.0172, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.14% (0.7802 => 0.7891, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -23.21% (0.0056 => 0.0043, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2295.85% (0.6332 => 15.1705, std.dev.: 0.0808) MultiSource/Benchmarks/McCat/08-main/main: 45.33% (0.1831 => 0.2661, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.76% (0.1559 => 0.1438, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1492.64% (0.3344 => 5.3258, std.dev.: 0.0833) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.84% (0.2364 => 0.3235, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: 2.56% (0.0429 => 0.0440, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.80% (0.0224 => 0.0237, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4316, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0770, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4938, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3375, std.dev.: 0.0305) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1310, std.dev.: 0.0154) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3981, std.dev.: 0.0085) SingleSource/Regression/C/uint64_to_float: -24.28% (2.1832 => 1.6531, std.dev.: 0.0097) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.40% (0.0810 => 0.0959, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.20% (0.0773 => 0.0875, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.13% (0.0830 => 0.0939, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 12.14% (0.1112 => 0.1247, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.84% (0.1425 => 0.1551, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.72% (0.2180 => 0.2370, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.87% (0.6010 => 0.6483, std.dev.: 0.0105) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.57% (0.8321 => 0.8951, std.dev.: 0.0204) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.46% (0.3137 => 0.3371, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.20% (0.7473 => 0.7936, std.dev.: 0.0118) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.12% (0.8148 => 0.8647, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.10% (0.1983 => 0.2104, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.73% (0.1885 => 0.1993, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.46% (0.1905 => 0.2009, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.40% (0.2240 => 0.2361, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.27% (0.2998 => 0.3156, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.55% (0.3295 => 0.3445, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.44% (1.1685 => 1.2204, std.dev.: 0.0119) MultiSource/Applications/spiff/spiff: 4.24% (0.7950 => 0.8287, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.14% (0.9435 => 0.9826, std.dev.: 0.0094) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.04% (0.4783 => 0.4976, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.03% (0.5961 => 0.6201, std.dev.: 0.0040) MultiSource/Applications/hbd/hbd: 3.64% (1.4269 => 1.4788, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.55% (0.6287 => 0.6510, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.52% (0.3717 => 0.3848, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 3.40% (1.2222 => 1.2637, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.39% (0.8050 => 0.8323, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.36% (0.8518 => 0.8804, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.31% (0.8855 => 0.9148, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 3.06% (0.8069 => 0.8316, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.03% (0.4127 => 0.4252, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.92% (0.8317 => 0.8560, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/gs/gs: 2.86% (4.1305 => 4.2488, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (4.1763 => 4.2959, std.dev.: 0.0211) MultiSource/Applications/SIBsim4/SIBsim4: 2.69% (1.2568 => 1.2906, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 2.63% (3.8189 => 3.9192, std.dev.: 0.0128) MultiSource/Benchmarks/nbench/nbench: 2.48% (1.1271 => 1.1550, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/05-eks/eks: 2.46% (0.4397 => 0.4505, std.dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: 2.45% (14.7684 => 15.1302, std.dev.: 0.0508) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.41% (6.6074 => 6.7668, std.dev.: 0.0512) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.39% (1.6386 => 1.6777, std.dev.: 0.0136) MultiSource/Applications/SPASS/SPASS: 2.37% (14.2605 => 14.5991, std.dev.: 0.0199) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.33% (8.6476 => 8.8487, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.23% (1.4479 => 1.4802, std.dev.: 0.0104) MultiSource/Benchmarks/Bullet/bullet: 2.19% (31.8598 => 32.5562, std.dev.: 0.1224) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.18% (0.6227 => 0.6363, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: 2.18% (2.3764 => 2.4282, std.dev.: 0.0136) MultiSource/Applications/minisat/minisat: 2.15% (0.6834 => 0.6981, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.11% (0.7966 => 0.8134, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.99% (13.1811 => 13.4431, std.dev.: 0.1011) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.95% (0.8597 => 0.8765, std.dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 1.86% (15.3280 => 15.6137, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.83% (4.4873 => 4.5694, std.dev.: 0.0289) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.83% (0.9039 => 0.9204, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.80% (0.8261 => 0.8410, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 1.80% (8.6247 => 8.7802, std.dev.: 0.0280) MultiSource/Applications/d/make_dparser: 1.79% (3.2366 => 3.2945, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.78% (0.9688 => 0.9860, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.75% (1.1170 => 1.1366, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.74% (0.8457 => 0.8604, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.73% (0.8716 => 0.8867, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 1.71% (0.9810 => 0.9978, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.65% (0.9056 => 0.9205, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.61% (0.8066 => 0.8196, std.dev.: 0.0032) MultiSource/Applications/siod/siod: 1.48% (2.2184 => 2.2513, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.45% (0.8885 => 0.9014, std.dev.: 0.0049) MultiSource/Applications/JM/ldecod/ldecod: 1.41% (6.7320 => 6.8267, std.dev.: 0.0306) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.37% (0.8338 => 0.8452, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.17% (1.2602 => 1.2750, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 89.45% (0.0199 => 0.0377, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/pi: 57.16% (1.5795 => 2.4823, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.18% (2.9753 => 3.4566, std.dev.: 0.1203) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.11% (0.7597 => 0.8821, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.49% (2.7995 => 3.2051, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/mst/mst: 12.48% (0.1386 => 0.1559, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.62% (5.0261 => 5.6101, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.13% (1.1857 => 1.2821, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/queens: 7.38% (1.7056 => 1.8315, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.75% (4.7794 => 5.1020, std.dev.: 0.0040) MultiSource/Applications/SIBsim4/SIBsim4: 6.24% (3.1873 => 3.3863, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.88% (4.5327 => 4.7992, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.86% (4.9686 => 5.2600, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/richards_benchmark: 5.61% (1.3037 => 1.3768, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.53% (3.3761 => 3.5289, std.dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: 4.50% (0.2887 => 0.3017, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.36% (6.2275 => 6.4989, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.30% (4.9453 => 5.1581, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.13% (4.9469 => 5.1512, std.dev.: 0.0073) MultiSource/Applications/hexxagon/hexxagon: 3.82% (14.0064 => 14.5421, std.dev.: 0.0312) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.35% (1.2337 => 1.2750, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.86% (11.5690 => 11.8996, std.dev.: 0.0047) MultiSource/Applications/siod/siod: 2.66% (3.6643 => 3.7619, std.dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 2.66% (7.4933 => 7.6924, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.47% (8.2783 => 8.4827, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.44% (4.8660 => 4.9849, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout/lists: 2.39% (7.3375 => 7.5132, std.dev.: 0.0255) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.37% (1.1365 => 1.1634, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.07% (4.8362 => 4.9361, std.dev.: 0.0234) MultiSource/Benchmarks/BitBench/five11/five11: 1.94% (5.6030 => 5.7116, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.24% (3.5679 => 3.6121, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/ReedSolomon: 1.19% (8.5322 => 8.6340, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/neural/neural: 1.13% (1.0841 => 1.0964, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.12% (4.4340 => 4.4837, std.dev.: 0.0115) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.99% (5.4641 => 4.3174, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.31% (7.2130 => 6.1809, std.dev.: 0.2391) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.30% (1.0512 => 0.9324, std.dev.: 0.0325) SingleSource/Benchmarks/McGill/chomp: -11.11% (1.1216 => 0.9970, std.dev.: 0.0160) MultiSource/Benchmarks/mafft/pairlocalalign: -8.51% (63.1822 => 57.8061, std.dev.: 0.0841) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.88% (4.7482 => 4.4216, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.61% (0.3269 => 0.3053, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.98% (3.7148 => 3.4927, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.95% (5.4972 => 5.1701, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.11% (5.1557 => 4.8924, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.35% (4.7449 => 4.5387, std.dev.: 0.0261) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.65% (6.0224 => 5.8027, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: -3.31% (0.8789 => 0.8498, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.17% (0.5807 => 0.5623, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (28.5821 => 27.6904, std.dev.: 0.0100) MultiSource/Benchmarks/Olden/bisort/bisort: -2.85% (0.6636 => 0.6447, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.65% (9.9065 => 9.6440, std.dev.: 0.0967) MultiSource/Applications/aha/aha: -2.62% (3.3398 => 3.2524, std.dev.: 0.0238) SingleSource/Benchmarks/Shootout-C++/hash2: -2.30% (3.4237 => 3.3449, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.30% (3.2169 => 3.1430, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (11.5316 => 11.2990, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.90% (0.6150 => 0.6033, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.68% (1.2822 => 1.2606, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.61% (4.9994 => 4.9188, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.46% (2.3487 => 2.3143, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.18% (5.6343 => 5.5676, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.02% (4.2466 => 4.2034, std.dev.: 0.0064) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.01% (16.4461 => 16.6117, std.dev.: 0.0867) MultiSource/Applications/obsequi/Obsequi: 3.97% (1.0262 => 1.0669, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6840.38% (0.3123 => 21.6748, std.dev.: 0.4674) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.62% (0.2463 => 0.3636, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 0.43% (0.6010 => 0.6036, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.47% (0.3266 => 0.3314, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 1.68% (0.1969 => 0.2002, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 45.53% (0.0123 => 0.0179, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0180 => 0.0180, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 57.14% (0.0007 => 0.0011, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 1.88% (0.1438 => 0.1465, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: 2.54% (1.1329 => 1.1617, std.dev.: 0.0155) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.26% (0.1462 => 0.1429, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.87% (0.4164 => 0.4086, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.79% (0.1369 => 0.1462, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.62% (0.0641 => 0.0605, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 14.36% (0.0195 => 0.0223, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.98% (0.0578 => 0.0555, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.63% (1.1437 => 1.1967, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 300.00% (0.0001 => 0.0004, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.26% (0.0627 => 0.0594, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.44% (0.0180 => 0.0172, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.57% (0.8017 => 0.7891, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -30.65% (0.0062 => 0.0043, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 5.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 02:39:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 04:39:52 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121112103952.C0FFD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5782?compare_to=5778&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5782, Order: 167719, Start Time: 2012-11-12 09:15:23, End Time: 2012-11-12 10:40:08 To: 5778, Order: 167718, Start Time: 2012-11-12 07:23:45, End Time: 2012-11-12 08:51:49 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (175 on baseline) Unchanged Tests: 1042 (863 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.64% (2.0478 => 2.1018, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4937 => 7.6767, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/hash2: 1.88% (3.1932 => 3.2531, std.dev.: 0.0079) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.80% (0.3821 => 0.3523, std.dev.: 0.0053) MultiSource/Benchmarks/PAQ8p/paq8p: -7.45% (2.4924 => 2.3068, std.dev.: 0.0114) MultiSource/Applications/sgefa/sgefa: -6.85% (0.3357 => 0.3127, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.59% (0.3142 => 0.2935, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.47% (3.5339 => 3.3053, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.43% (0.9852 => 0.9219, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -6.40% (9.2283 => 8.6374, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/ReedSolomon: -6.39% (0.1879 => 0.1759, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.35% (0.6484 => 0.6072, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: -6.34% (0.2160 => 0.2023, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.34% (0.3658 => 0.3426, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -6.32% (16.1920 => 15.1687, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/football/football: -6.32% (0.9179 => 0.8599, std.dev.: 0.0114) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.31% (0.1584 => 0.1484, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: -6.30% (7.0961 => 6.6487, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.26% (1.0544 => 0.9884, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.24% (0.1796 => 0.1684) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.23% (22.4056 => 21.0095, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.18% (1.3722 => 1.2874, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -6.18% (4.3330 => 4.0653, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-2: -6.16% (0.3831 => 0.3595, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.16% (0.5863 => 0.5502, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -6.13% (0.3880 => 0.3642, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.13% (0.3848 => 0.3612, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -6.13% (0.1761 => 0.1653, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.12% (1.6364 => 1.5362, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/trivial-interface: -6.11% (0.3812 => 0.3579, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: -6.10% (1.1450 => 1.0751, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.09% (0.3891 => 0.3654, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.09% (0.2695 => 0.2531, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.07% (0.7198 => 0.6761, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.06% (0.5859 => 0.5504, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: -6.06% (0.4176 => 0.3923, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.05% (0.3884 => 0.3649, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: -6.02% (1.1530 => 1.0836, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.01% (0.3896 => 0.3662, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.00% (1.4642 => 1.3763, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/for-in: -6.00% (0.4033 => 0.3791, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -6.00% (0.2985 => 0.2806, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.99% (1.2300 => 1.1563, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.99% (0.5478 => 0.5150, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.98% (4.0323 => 3.7913, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.98% (1.2784 => 1.2020, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.97% (0.6395 => 0.6013, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.96% (0.5805 => 0.5459, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.95% (0.7524 => 0.7076, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -5.95% (1.2515 => 1.1770, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.93% (0.7339 => 0.6904, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.93% (4.5069 => 4.2398, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.92% (4.8161 => 4.5310, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.90% (0.6304 => 0.5932, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.90% (0.9542 => 0.8979, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.90% (0.6052 => 0.5695, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.90% (0.6681 => 0.6287, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.89% (0.5802 => 0.5460, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.89% (0.5857 => 0.5512, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.88% (0.5591 => 0.5262, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -5.88% (17.1032 => 16.0978, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.87% (0.5705 => 0.5370, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.87% (0.3406 => 0.3206, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.87% (0.7919 => 0.7454, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.87% (0.6660 => 0.6269, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.86% (0.6293 => 0.5924, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.86% (0.8521 => 0.8022, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.82% (4.8802 => 4.5960, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.81% (0.6260 => 0.5896, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.81% (0.5849 => 0.5509, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.81% (0.4199 => 0.3955, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.81% (0.2548 => 0.2400, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.79% (0.6667 => 0.6281, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.79% (0.5925 => 0.5582, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.79% (0.6446 => 0.6073, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.78% (0.6230 => 0.5870, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.78% (0.5575 => 0.5253, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.77% (0.2355 => 0.2219, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.77% (0.3483 => 0.3282, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.77% (14.2083 => 13.3891, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.76% (0.5569 => 0.5248, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: -5.75% (0.2659 => 0.2506, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.75% (0.5581 => 0.5260, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.72% (0.6395 => 0.6029, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.72% (0.6676 => 0.6294, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.72% (0.6297 => 0.5937, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.72% (0.6736 => 0.6351, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.71% (0.5570 => 0.5252, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -5.70% (0.4280 => 0.4036, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.69% (0.5567 => 0.5250, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -5.69% (2.4021 => 2.2654, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.69% (0.5941 => 0.5603, std.dev.: 0.0059) MultiSource/Applications/SPASS/SPASS: -5.69% (15.5079 => 14.6259, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.67% (6.7716 => 6.3875, std.dev.: 0.0127) MultiSource/Benchmarks/McCat/18-imp/imp: -5.67% (0.3581 => 0.3378, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.66% (1.6474 => 1.5541, std.dev.: 0.0074) MultiSource/Applications/SIBsim4/SIBsim4: -5.64% (1.3864 => 1.3082, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.62% (0.6033 => 0.5694, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -5.61% (4.0594 => 3.8315, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.61% (0.5688 => 0.5369, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.57% (0.6189 => 0.5844, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.57% (0.5168 => 0.4880, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.57% (0.5456 => 0.5152, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -5.55% (3.5154 => 3.3202, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: -5.53% (0.7447 => 0.7035, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.51% (0.4916 => 0.4645, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.50% (0.5999 => 0.5669, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.46% (0.5329 => 0.5038, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.44% (0.4151 => 0.3925, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.40% (0.2278 => 0.2155, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: -5.38% (0.4515 => 0.4272, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.34% (5.4682 => 5.1761, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.34% (0.2999 => 0.2839, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.31% (0.7021 => 0.6648, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.30% (1.3148 => 1.2451, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.30% (1.2210 => 1.1563, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: -5.29% (2.1401 => 2.0269, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.29% (8.0126 => 7.5891, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.28% (1.2221 => 1.1576, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.24% (2.2587 => 2.1403, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.24% (0.2385 => 0.2260, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.24% (0.4813 => 0.4561, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -5.22% (15.2527 => 14.4558, std.dev.: 0.0251) SingleSource/Benchmarks/Shootout-C++/matrix: -5.22% (0.3255 => 0.3085, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.21% (0.3931 => 0.3726, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.21% (0.3837 => 0.3637, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.17% (0.3016 => 0.2860, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.13% (0.9557 => 0.9067, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -5.12% (0.3026 => 0.2871, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -5.09% (0.3025 => 0.2871, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -5.09% (18.2933 => 17.3630, std.dev.: 0.0203) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.08% (0.2106 => 0.1999, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: -5.06% (0.4524 => 0.4295, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: -5.05% (34.0927 => 32.3727, std.dev.: 0.0217) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.04% (0.3491 => 0.3315, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -5.04% (0.3194 => 0.3033, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -5.04% (5.0226 => 4.7696, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -5.04% (0.7982 => 0.7580, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.03% (2.1713 => 2.0620, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary3: -5.02% (0.3446 => 0.3273, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.00% (0.3319 => 0.3153, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -5.00% (0.3621 => 0.3440, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -4.97% (0.4248 => 0.4037, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.95% (0.3271 => 0.3109, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -4.95% (0.2989 => 0.2841, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -4.94% (0.3481 => 0.3309, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -4.94% (0.3867 => 0.3676, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.88% (0.4427 => 0.4211, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (0.2871 => 0.2731, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.87% (0.3057 => 0.2908, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.86% (0.3849 => 0.3662, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.86% (0.2903 => 0.2762, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.85% (0.4083 => 0.3885, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -4.83% (0.3788 => 0.3605, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -4.82% (0.8418 => 0.8012, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.81% (0.3323 => 0.3163, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.81% (0.2933 => 0.2792, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -4.80% (0.6750 => 0.6426, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: -4.76% (0.2939 => 0.2799, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.74% (0.3059 => 0.2914, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: -4.74% (0.2849 => 0.2714, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.68% (0.3205 => 0.3055, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.63% (0.4321 => 0.4121, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.61% (0.3252 => 0.3102, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: -4.47% (0.7779 => 0.7431, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.15% (0.9077 => 0.8700, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: -4.10% (0.6347 => 0.6087, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -3.79% (0.6441 => 0.6197, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -3.62% (1.5610 => 1.5045, std.dev.: 0.0046) SingleSource/UnitTests/Vector/constpool: -2.84% (20.7746 => 20.1856, std.dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7531, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: -8.65% (1.2842 => 1.1731, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.90% (2.2633 => 2.1750, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.31% (1.0557 => 1.0208, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.69% (6.5735 => 6.4624, std.dev.: 0.0054) Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 04:00:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 06:00:25 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121112120025.8BBF32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5783?compare_to=5781&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5783, Order: 167720, Start Time: 2012-11-12 10:34:35, End Time: 2012-11-12 12:00:41 To: 5781, Order: 167719, Start Time: 2012-11-12 08:51:55, End Time: 2012-11-12 10:17:38 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 9 (93 on baseline) Performance Improvements: 1 (23 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 981 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.93% (1.3453 => 1.3847, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.43% (1.1366 => 1.1529, std.dev.: 0.0034) MultiSource/Applications/treecc/treecc: 1.34% (2.0373 => 2.0646, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.53% (1.4957 => 1.8925, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.76% (44.3143 => 45.9789, std.dev.: 0.3347) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.15% (0.6033 => 0.6223, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/whetstone: 1.48% (2.1111 => 2.1423, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.13% (4.4166 => 4.4664, std.dev.: 0.0120) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.01% (3.1430 => 3.1747, std.dev.: 0.0069) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.28% (0.9148 => 0.8939, std.dev.: 0.0080) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.21% (16.6117 => 16.6469, std.dev.: 0.2801) MultiSource/Applications/obsequi/Obsequi: -0.52% (1.0669 => 1.0613, std.dev.: 0.0113) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.13% (21.6748 => 21.6476, std.dev.: 0.0862) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.03% (0.3636 => 0.3637, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/bigfib: -0.10% (0.6036 => 0.6030, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.03% (0.3314 => 0.3313, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: -0.10% (0.2002 => 0.2000, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 10.06% (0.0179 => 0.0197, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.24% (0.0425 => 0.0424, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0330 => 0.0330, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0312 => 0.0311, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.13% (0.0422 => 0.0413, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0202 => 0.0202, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -6.11% (0.0180 => 0.0169, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -90.91% (0.0011 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.20% (0.1465 => 0.1462, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.53% (1.1617 => 1.1678, std.dev.: 0.0265) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.45% (0.1429 => 0.1464, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.81% (0.4086 => 0.4160, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.04% (0.1462 => 0.1403, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.95% (0.0605 => 0.0641, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 24.66% (0.0223 => 0.0278, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.52% (0.0555 => 0.0569, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.19% (1.1967 => 1.1944, std.dev.: 0.0579) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 675.00% (0.0004 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.67% (0.0594 => 0.0598, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 45.93% (0.0172 => 0.0251, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.96% (0.7891 => 0.7815, std.dev.: 0.0123) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 25.58% (0.0043 => 0.0054, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2307.55% (0.6332 => 15.2446, std.dev.: 0.1532) MultiSource/Benchmarks/McCat/08-main/main: 46.26% (0.1831 => 0.2678, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.93% (0.1559 => 0.1451, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1491.18% (0.3344 => 5.3209, std.dev.: 0.0434) SingleSource/Benchmarks/Misc-C++/Large/ray: 34.86% (0.2364 => 0.3188, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -0.23% (0.0429 => 0.0428, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.79% (0.0224 => 0.0228, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -28.26% (0.0230 => 0.0165, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4469, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0702, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4894, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3441, std.dev.: 0.0220) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1317, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4005, std.dev.: 0.0110) SingleSource/Regression/C/uint64_to_float: -23.87% (2.1832 => 1.6620, std.dev.: 0.0023) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 11.96% (0.1112 => 0.1245, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.74% (0.8321 => 0.8965, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.20% (0.1983 => 0.2106, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.04% (0.1905 => 0.2020, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.89% (0.8148 => 0.8628, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.83% (0.3295 => 0.3487, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.22% (0.2279 => 0.2398, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.16% (0.2519 => 0.2649, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.95% (0.6287 => 0.6598, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.76% (0.5961 => 0.6245, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.46% (1.1685 => 1.2206, std.dev.: 0.0132) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.43% (0.3137 => 0.3276, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2998 => 0.3129, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.28% (1.3279 => 1.3847, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.91% (1.1606 => 1.2060, std.dev.: 0.0151) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.60% (0.4783 => 0.4955, std.dev.: 0.0021) MultiSource/Applications/treecc/treecc: 3.50% (1.9948 => 2.0646, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.41% (0.9435 => 0.9757, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.26% (0.3717 => 0.3838, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.21% (1.1170 => 1.1529, std.dev.: 0.0034) MultiSource/Applications/lua/lua: 3.02% (3.8189 => 3.9342, std.dev.: 0.0239) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.01% (0.5817 => 0.5992, std.dev.: 0.0044) MultiSource/Applications/spiff/spiff: 2.99% (0.7950 => 0.8188, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/gs/gs: 2.98% (4.1305 => 4.2536, std.dev.: 0.0235) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.97% (8.6476 => 8.9041, std.dev.: 0.0862) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.65% (0.8331 => 0.8552, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.59% (1.6386 => 1.6811, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.51% (0.8927 => 0.9151, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 2.43% (14.2605 => 14.6068, std.dev.: 0.0517) MultiSource/Applications/JM/ldecod/ldecod: 2.39% (6.7320 => 6.8931, std.dev.: 0.0337) MultiSource/Applications/minisat/minisat: 2.33% (0.6834 => 0.6993, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 2.31% (14.7684 => 15.1090, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.24% (0.8697 => 0.8892, std.dev.: 0.0055) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.24% (6.6074 => 6.7551, std.dev.: 0.0267) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.23% (4.1763 => 4.2695, std.dev.: 0.0319) MultiSource/Applications/SIBsim4/SIBsim4: 2.23% (1.2568 => 1.2848, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.22% (0.8261 => 0.8444, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.15% (0.8457 => 0.8639, std.dev.: 0.0029) MultiSource/Applications/d/make_dparser: 2.09% (3.2366 => 3.3041, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.07% (0.8050 => 0.8217, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.03% (0.8805 => 0.8984, std.dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 1.99% (15.3280 => 15.6336, std.dev.: 0.0469) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.89% (0.8204 => 0.8359, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.88% (13.1811 => 13.4295, std.dev.: 0.0561) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.86% (0.8317 => 0.8472, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.76% (0.8340 => 0.8487, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.73% (0.8597 => 0.8746, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.71% (0.8716 => 0.8865, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.71% (2.1401 => 2.1766, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.70% (0.9908 => 1.0076, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/football/football: 1.64% (0.8768 => 0.8912, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 1.61% (0.7557 => 0.7679, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.54% (0.9039 => 0.9178, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.45% (0.8066 => 0.8183, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.39% (0.8338 => 0.8454, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: 1.32% (2.3764 => 2.4077, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.30% (0.9056 => 0.9174, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.27% (0.8316 => 0.8422, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 1.14% (8.6247 => 8.7228, std.dev.: 0.0339) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.07% (1.2423 => 1.2556, std.dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 117.59% (0.0199 => 0.0433, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/pi: 57.23% (1.5795 => 2.4834, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.34% (2.9753 => 3.4616, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.31% (0.7597 => 0.8836, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.74% (2.7995 => 3.2121, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.62% (5.0261 => 5.6100, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.81% (1.1857 => 1.2783, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/queens: 7.43% (1.7056 => 1.8323, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 6.56% (3.1873 => 3.3963, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.42% (4.7794 => 5.0863, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.89% (4.5327 => 4.7998, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/richards_benchmark: 5.84% (1.3037 => 1.3799, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.79% (4.9686 => 5.2563, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.57% (3.3761 => 3.5305, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.36% (4.9453 => 5.1607, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.10% (4.9469 => 5.1495, std.dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: 3.95% (14.0064 => 14.5592, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.18% (44.5605 => 45.9789, std.dev.: 0.3347) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.85% (11.5690 => 11.8991, std.dev.: 0.0207) MultiSource/Applications/lambda-0_1_3/lambda: 2.72% (7.4933 => 7.6971, std.dev.: 0.0350) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.69% (8.2783 => 8.5014, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.60% (4.8362 => 4.9619, std.dev.: 0.0063) MultiSource/Applications/siod/siod: 2.59% (3.6643 => 3.7593, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.57% (4.8660 => 4.9911, std.dev.: 0.0193) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.55% (4.3552 => 4.4664, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout/lists: 2.46% (7.3375 => 7.5181, std.dev.: 0.0138) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.22% (1.1365 => 1.1617, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.65% (2.4647 => 2.5053, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/ReedSolomon: 1.53% (8.5322 => 8.6626, std.dev.: 0.0345) MultiSource/Benchmarks/Olden/power/power: 1.50% (1.2061 => 1.2242, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.49% (1.5941 => 1.6178, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 1.21% (1.0841 => 1.0972, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.15% (3.5679 => 3.6091, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.85% (5.4641 => 4.3250, std.dev.: 0.3264) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.00% (7.2130 => 6.2754, std.dev.: 0.1375) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.27% (1.0512 => 0.9327, std.dev.: 0.0309) SingleSource/Benchmarks/McGill/chomp: -10.61% (1.1216 => 1.0026, std.dev.: 0.0097) MultiSource/Benchmarks/mafft/pairlocalalign: -8.39% (63.1822 => 57.8830, std.dev.: 0.0236) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.83% (4.7482 => 4.4237, std.dev.: 0.0302) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.00% (0.3269 => 0.3073, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.81% (3.7148 => 3.4988, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.79% (5.4972 => 5.1787, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.15% (5.1557 => 4.8902, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.71% (6.0224 => 5.7991, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.22% (0.5807 => 0.5620, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (28.5821 => 27.6952, std.dev.: 0.0336) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.89% (2.6356 => 2.5593, std.dev.: 0.0127) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.28% (2.4490 => 2.3932, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: -2.15% (3.4237 => 3.3500, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.03% (11.5316 => 11.2977, std.dev.: 0.0241) MultiSource/Applications/aha/aha: -1.90% (3.3398 => 3.2765, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.58% (2.8773 => 2.8317, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.56% (4.9994 => 4.9214, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.37% (2.3487 => 2.3165, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.31% (3.2169 => 3.1747, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.19% (5.6343 => 5.5674, std.dev.: 0.0106) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.22% (16.4461 => 16.6469, std.dev.: 0.2801) MultiSource/Applications/obsequi/Obsequi: 3.42% (1.0262 => 1.0613, std.dev.: 0.0113) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6831.67% (0.3123 => 21.6476, std.dev.: 0.0862) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.67% (0.2463 => 0.3637, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/bigfib: 0.33% (0.6010 => 0.6030, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.44% (0.3266 => 0.3313, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: 1.57% (0.1969 => 0.2000, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 60.16% (0.0123 => 0.0197, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.98% (0.0302 => 0.0311, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 7.55% (0.0384 => 0.0413, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -6.11% (0.0180 => 0.0169, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.67% (0.1438 => 0.1462, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 3.08% (1.1329 => 1.1678, std.dev.: 0.0265) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.14% (0.1462 => 0.1464, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.10% (0.4164 => 0.4160, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.48% (0.1369 => 0.1403, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0641 => 0.0641, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.56% (0.0195 => 0.0278, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.56% (0.0578 => 0.0569, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.43% (1.1437 => 1.1944, std.dev.: 0.0579) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.63% (0.0627 => 0.0598, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.44% (0.0180 => 0.0251, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.52% (0.8017 => 0.7815, std.dev.: 0.0123) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -12.90% (0.0062 => 0.0054, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 04:27:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 06:27:44 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121112122744.932AB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5784?compare_to=5782&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5784, Order: 167720, Start Time: 2012-11-12 11:03:09, End Time: 2012-11-12 12:28:00 To: 5782, Order: 167719, Start Time: 2012-11-12 09:15:23, End Time: 2012-11-12 10:40:08 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (181 on baseline) Unchanged Tests: 1041 (856 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.94% (3.7506 => 3.8235, std.dev.: 0.0271) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.59% (7.4937 => 7.6878, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1007, std.dev.: 0.0110) MultiSource/Benchmarks/llubenchmark/llu: 2.14% (3.7435 => 3.8235, std.dev.: 0.0271) SingleSource/Benchmarks/Shootout-C++/hash2: 1.85% (3.1932 => 3.2522, std.dev.: 0.0075) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.74% (0.1431 => 0.1306, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.80% (0.3821 => 0.3523, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.02% (2.4924 => 2.3174, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: -6.91% (0.3357 => 0.3125, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.84% (0.2428 => 0.2262, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.72% (0.3142 => 0.2931, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.54% (3.5339 => 3.3027, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -6.49% (9.2283 => 8.6291, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.46% (0.1796 => 0.1680, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.45% (0.9852 => 0.9217, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: -6.41% (7.0961 => 6.6410, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/football/football: -6.40% (0.9179 => 0.8592, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: -6.39% (16.1920 => 15.1573, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -6.39% (0.1879 => 0.1759, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: -6.34% (0.2160 => 0.2023, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.34% (0.6484 => 0.6073, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.34% (1.0544 => 0.9876, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.31% (0.1584 => 0.1484, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.29% (0.3658 => 0.3428, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.27% (22.4056 => 21.0000, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: -6.25% (4.3330 => 4.0622, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/exceptions-2: -6.24% (0.3831 => 0.3592, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -6.22% (1.2515 => 1.1736, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.22% (1.3722 => 1.2869, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -6.21% (1.1450 => 1.0739, std.dev.: 0.0110) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.20% (0.2695 => 0.2528, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.19% (0.3880 => 0.3640, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.18% (0.1716 => 0.1610, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -6.16% (0.3812 => 0.3577, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.14% (0.9542 => 0.8956, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.14% (1.2300 => 1.1545, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: -6.13% (0.3896 => 0.3657, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.13% (0.3848 => 0.3612, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -6.13% (0.1761 => 0.1653, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.12% (0.7919 => 0.7434, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/for-in: -6.12% (0.4033 => 0.3786, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.11% (0.5857 => 0.5499, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.11% (0.5863 => 0.5505, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.10% (0.7198 => 0.6759, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.10% (1.6364 => 1.5366, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.09% (0.3891 => 0.3654, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.08% (1.4642 => 1.3752, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.06% (0.6736 => 0.6328, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: -6.05% (1.1530 => 1.0832, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.05% (4.5069 => 4.2343, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.05% (0.7524 => 0.7069, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.04% (0.5478 => 0.5147, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.04% (0.5859 => 0.5505, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.04% (1.2784 => 1.2012, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -6.03% (0.2985 => 0.2805, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.02% (0.3884 => 0.3650, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.01% (0.5805 => 0.5456, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.00% (4.0323 => 3.7903, std.dev.: 0.0090) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.99% (0.2355 => 0.2214, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.99% (0.4176 => 0.3926, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.99% (4.8161 => 4.5278, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.98% (4.8802 => 4.5883, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.97% (0.6395 => 0.6013, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.96% (0.5802 => 0.5456, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.95% (0.6304 => 0.5929, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/property: -5.93% (0.4199 => 0.3950, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.93% (0.6681 => 0.6285, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.92% (0.6052 => 0.5694, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.91% (0.6395 => 0.6017, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -5.90% (0.2659 => 0.2502, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: -5.90% (0.3406 => 0.3205, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.89% (0.5925 => 0.5576, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.89% (0.5705 => 0.5369, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.88% (0.6446 => 0.6067, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.88% (1.6474 => 1.5506, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.87% (0.5591 => 0.5263, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.85% (0.2548 => 0.2399, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -5.85% (17.1032 => 16.1031, std.dev.: 0.3544) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.85% (0.7339 => 0.6910, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.83% (0.3483 => 0.3280, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -5.82% (15.5079 => 14.6060, std.dev.: 0.0129) MultiSource/Applications/siod/siod: -5.79% (2.4021 => 2.2631, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.78% (0.5567 => 0.5245, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.78% (0.6660 => 0.6275, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -5.78% (0.3581 => 0.3374, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.78% (0.5849 => 0.5511, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.78% (14.2083 => 13.3874, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.78% (0.5575 => 0.5253, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -5.77% (4.0594 => 3.8252, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.77% (0.6676 => 0.6291, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.76% (0.6297 => 0.5934, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.76% (0.6230 => 0.5871, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.76% (0.6440 => 0.6069, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.76% (0.5456 => 0.5142, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.75% (0.6293 => 0.5931, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.75% (0.5581 => 0.5260, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.75% (0.5569 => 0.5249, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.74% (0.5941 => 0.5600, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.74% (0.6033 => 0.5687, std.dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.72% (6.7716 => 6.3843, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.72% (0.5999 => 0.5656, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.72% (0.8521 => 0.8034, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.72% (0.6194 => 0.5840, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -5.71% (1.3864 => 1.3072, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.70% (0.5688 => 0.5364, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.67% (0.6260 => 0.5905, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -5.65% (0.4280 => 0.4038, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.63% (0.4916 => 0.4639, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -5.61% (3.5154 => 3.3181, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.60% (0.4515 => 0.4262, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.60% (0.5570 => 0.5258, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.60% (0.7021 => 0.6628, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.59% (0.6667 => 0.6294, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.59% (0.6189 => 0.5843, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -5.56% (0.7447 => 0.7033, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.55% (0.4813 => 0.4546, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.54% (0.4151 => 0.3921, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.54% (0.2999 => 0.2833, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.53% (0.5168 => 0.4882, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.52% (0.5329 => 0.5035, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.50% (2.2587 => 2.1345, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.49% (0.2278 => 0.2153, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: -5.42% (1.3148 => 1.2435, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.42% (1.2210 => 1.1548, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.42% (8.0126 => 7.5786, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash2: -5.41% (0.4861 => 0.4598, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.37% (1.2221 => 1.1565, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.35% (5.4682 => 5.1754, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.32% (0.2385 => 0.2258) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.29% (0.3837 => 0.3634, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -5.25% (2.1401 => 2.0277, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: -5.22% (0.3025 => 0.2867, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: -5.22% (0.3255 => 0.3085, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -5.22% (15.2527 => 14.4563, std.dev.: 0.0431) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.22% (0.9557 => 0.9058, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.21% (0.3931 => 0.3726, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -5.19% (0.3026 => 0.2869, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.18% (0.3491 => 0.3310, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.16% (2.1713 => 2.0593, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -5.14% (0.3621 => 0.3435, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.13% (0.2106 => 0.1998, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.13% (0.4427 => 0.4200, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -5.12% (18.2933 => 17.3563, std.dev.: 0.0195) MultiSource/Benchmarks/Bullet/bullet: -5.12% (34.0927 => 32.3473, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.11% (0.3016 => 0.2862, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.10% (0.3194 => 0.3031, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -5.09% (0.3867 => 0.3670, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/strcat: -5.09% (0.2989 => 0.2837, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: -5.08% (0.4524 => 0.4294, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: -5.06% (0.7982 => 0.7578, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/moments: -5.06% (0.4248 => 0.4033, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -5.05% (0.3446 => 0.3272, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -5.04% (0.3394 => 0.3223, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -5.03% (0.3481 => 0.3306, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -5.01% (0.3271 => 0.3107, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.96% (0.3849 => 0.3658, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -4.95% (0.2871 => 0.2729, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.94% (0.3057 => 0.2906, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.94% (0.3323 => 0.3159, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.92% (0.4083 => 0.3882, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.89% (0.2903 => 0.2761, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -4.88% (0.3788 => 0.3603, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -4.87% (0.2939 => 0.2796, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -4.84% (0.3059 => 0.2911, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.84% (0.4321 => 0.4112, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/wc: -4.84% (0.3205 => 0.3050, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -4.83% (0.6750 => 0.6424, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -4.83% (5.0226 => 4.7802, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.81% (0.2933 => 0.2792, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -4.78% (0.8418 => 0.8016, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: -4.74% (0.2849 => 0.2714, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.58% (0.3319 => 0.3167, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.56% (0.9077 => 0.8663, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: -4.51% (0.7779 => 0.7428, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: -4.06% (0.6347 => 0.6089, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.87% (0.6441 => 0.6192, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: -3.70% (1.5610 => 1.5033, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -2.89% (20.7746 => 20.1745, std.dev.: 0.0131) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7565, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: -8.61% (1.2842 => 1.1736, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7060, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.65% (2.2633 => 2.1807, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0245, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4716, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 05:26:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 07:26:35 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121112132635.BF3CF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5785?compare_to=5780&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5785, Order: 167719, Start Time: 2012-11-12 10:11:21, End Time: 2012-11-12 13:26:51 To: 5780, Order: 167714, Start Time: 2012-11-12 06:04:30, End Time: 2012-11-12 09:23:05 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (174 on baseline) Performance Improvements: 3 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1038 (717 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.31% (54.2141 => 54.9240, std.dev.: 0.0388) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/Hello: -1.44% (0.7004 => 0.6903, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -1.43% (0.7068 => 0.6967, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -1.27% (0.8433 => 0.8326, std.dev.: 0.0019) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.88% (0.0625 => 0.0893, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.49% (0.1063 => 0.1419, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.64% (0.2969 => 0.3760, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.49% (0.1106 => 0.1399, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.68% (0.4253 => 0.5345, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 25.52% (1.5932 => 1.9998, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.39% (0.4139 => 0.5190, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.07% (0.0714 => 0.0893, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.15% (0.5900 => 0.7325, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.00% (0.0475 => 0.0589, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.93% (0.4994 => 0.6189, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.63% (0.0584 => 0.0722, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.62% (0.5000 => 0.6181, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.58% (0.0547 => 0.0676, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.72% (0.1021 => 0.1253, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.53% (0.1620 => 0.1985, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.49% (0.1107 => 0.1356, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.41% (0.0897 => 0.1098, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 22.37% (0.0599 => 0.0733, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 21.31% (0.0948 => 0.1150, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.17% (0.0633 => 0.0767, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.12% (0.1103 => 0.1336, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.07% (0.0541 => 0.0655, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.06% (0.0584 => 0.0707, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.01% (0.0495 => 0.0599, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.96% (0.3903 => 0.4721, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.87% (0.0642 => 0.0776, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 20.71% (0.0821 => 0.0991, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.64% (0.1003 => 0.1210, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 20.36% (0.0604 => 0.0727, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.32% (0.1604 => 0.1930, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.32% (0.0822 => 0.0989, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.27% (0.1549 => 0.1863, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 20.26% (0.1619 => 0.1947, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.77% (0.1462 => 0.1751, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 19.55% (0.0808 => 0.0966) MultiSource/Applications/viterbi/viterbi: 19.54% (0.0947 => 0.1132, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.25% (0.3890 => 0.4639, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 18.88% (0.1218 => 0.1448) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.87% (0.2014 => 0.2394, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 18.49% (0.5826 => 0.6903, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.35% (0.2736 => 0.3238, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 18.34% (0.0698 => 0.0826, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 18.32% (0.4029 => 0.4767, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 18.31% (0.5889 => 0.6967, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.30% (1.3152 => 1.5559, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 18.21% (0.1505 => 0.1779, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.11% (0.1088 => 0.1285) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.85% (0.0605 => 0.0713, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.83% (0.0572 => 0.0674, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.79% (0.2866 => 0.3376, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.68% (0.1968 => 0.2316, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.63% (0.0573 => 0.0674) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.62% (3.5627 => 4.1903, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 17.56% (0.5546 => 0.6520, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.41% (0.4658 => 0.5469, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 17.38% (1.8794 => 2.2060, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: 17.23% (0.9697 => 1.1368, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.21% (1.6211 => 1.9001, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.98% (0.1160 => 0.1357, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.94% (0.2875 => 0.3362, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.94% (0.3271 => 0.3825, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 16.83% (1.0781 => 1.2595, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 16.75% (0.1421 => 0.1659, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.67% (0.4361 => 0.5088, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.57% (0.5026 => 0.5859, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.54% (0.3930 => 0.4580, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 16.37% (0.2725 => 0.3171, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 16.36% (0.2714 => 0.3158, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.33% (4.4195 => 5.1410, std.dev.: 0.0086) MultiSource/Applications/ClamAV/clamscan: 16.25% (4.2109 => 4.8951, std.dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.20% (2.7292 => 3.1712, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.18% (0.2738 => 0.3181, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 16.11% (0.7171 => 0.8326, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: 16.04% (0.1284 => 0.1490, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.98% (0.2729 => 0.3165, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.87% (0.1090 => 0.1263, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/random: 15.84% (0.2803 => 0.3247, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 15.82% (0.2813 => 0.3258, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/strcat: 15.82% (0.2750 => 0.3185, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 15.81% (0.3004 => 0.3479, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.81% (0.3195 => 0.3700, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 15.73% (0.2823 => 0.3267, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 15.72% (0.2780 => 0.3217, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 15.65% (0.2811 => 0.3251, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 15.63% (0.3096 => 0.3580, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 15.63% (0.9909 => 1.1458, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.60% (1.9694 => 2.2766, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.56% (1.9966 => 2.3073, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.56% (2.0673 => 2.3890, std.dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: 15.55% (23.5202 => 27.1774, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.51% (0.2792 => 0.3225, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 15.37% (0.2075 => 0.2394, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.36% (0.2911 => 0.3358, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.20% (0.3362 => 0.3873, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 15.03% (0.3267 => 0.3758, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 14.98% (0.3258 => 0.3746, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 14.93% (0.2566 => 0.2949, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.71% (0.3060 => 0.3510, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 14.65% (0.3317 => 0.3803, std.dev.: 0.0052) MultiSource/Applications/lua/lua: 14.54% (1.4269 => 1.6343, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: 14.49% (0.3678 => 0.4211, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.47% (0.3124 => 0.3576, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 14.37% (0.7875 => 0.9007, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.32% (0.3282 => 0.3752, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 14.27% (0.3477 => 0.3973, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 14.22% (0.3348 => 0.3824, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.96% (0.3625 => 0.4131, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 13.94% (2.1653 => 2.4672, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/sieve: 13.93% (0.3726 => 0.4245, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.88% (0.3488 => 0.3972, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 13.85% (0.0758 => 0.0863, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.85% (0.3690 => 0.4201, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 13.83% (0.4251 => 0.4839, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 13.75% (0.4146 => 0.4716, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/trivial-interface: 13.71% (0.3442 => 0.3914, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 13.71% (0.3465 => 0.3940, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.68% (0.3845 => 0.4371, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 13.63% (4.6177 => 5.2471, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.63% (0.2040 => 0.2318, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.62% (0.3496 => 0.3972, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.61% (0.3446 => 0.3915, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.53% (0.3460 => 0.3928, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 13.52% (2.1013 => 2.3853, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.51% (0.3981 => 0.4519, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 13.46% (0.3469 => 0.3936, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 13.29% (0.3643 => 0.4127, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 13.26% (0.3650 => 0.4134, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.13% (0.3724 => 0.4213, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 13.12% (0.2691 => 0.3044, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 13.09% (0.5012 => 0.5668, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 12.70% (5.5417 => 6.2455, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.22% (0.1383 => 0.1552, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.97% (0.6435 => 0.7205, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.96% (0.1028 => 0.1151, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.66% (0.3498 => 0.3906, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.36% (0.2068 => 0.2303, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.29% (0.2737 => 0.3046, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 11.18% (0.4847 => 0.5389, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 11.12% (0.6634 => 0.7372, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.96% (0.3084 => 0.3422, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 10.82% (2.0346 => 2.2547, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 10.52% (0.3336 => 0.3687, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 10.46% (0.2391 => 0.2641, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.27% (0.2103 => 0.2319, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.16% (0.5361 => 0.5852, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.06% (4.6926 => 5.1178, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.92% (0.5584 => 0.6082, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.87% (11.6398 => 12.6720, std.dev.: 0.0161) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.59% (0.7426 => 0.8064, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 7.09% (11.9555 => 12.8026, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.30% (0.3792 => 0.3955, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700) MultiSource/Applications/ClamAV/clamscan: 9.42% (0.2802 => 0.3066, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6096, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6693, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-2: 4.86% (1.8057 => 1.8935, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1659, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.66% (0.3693 => 0.3865, std.dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6407, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2047, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.68% (3.1722 => 3.2255, std.dev.: 0.0022) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3056, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.36% (7.1849 => 7.2826, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5904, std.dev.: 0.0125) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.78% (25.4195 => 16.5779, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/ary2: -7.87% (0.2402 => 0.2213, std.dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9763, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8027, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8021, std.dev.: 0.0109) SingleSource/Benchmarks/Dhrystone/fldry: -3.50% (17.2379 => 16.6354, std.dev.: 0.0777) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7727, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.25% (41.7953 => 40.8533, std.dev.: 0.0119) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.99% (0.6293 => 0.6168, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5738, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4964, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.1978, std.dev.: 0.0361) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0468, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 05:43:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 07:43:05 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121112134305.E0D342A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5786?compare_to=5783&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5786, Order: 167723, Start Time: 2012-11-12 12:17:37, End Time: 2012-11-12 13:43:21 To: 5783, Order: 167720, Start Time: 2012-11-12 10:34:35, End Time: 2012-11-12 12:00:41 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 3 (83 on baseline) Performance Improvements: 8 (27 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 980 (864 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 12.39% (0.7757 => 0.8718, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.86% (1.3981 => 1.4520, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.28% (0.3385 => 0.3496, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -2.98% (0.3487 => 0.3383, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/05-eks/eks: -2.51% (0.4465 => 0.4353, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: -15.82% (0.1631 => 0.1373, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.54% (0.6223 => 0.6065, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/bisort/bisort: -1.99% (0.6621 => 0.6489, std.dev.: 0.0047) MultiSource/Applications/minisat/minisat: -1.97% (6.3151 => 6.1910, std.dev.: 0.0361) SingleSource/Benchmarks/Misc/ffbench: -1.46% (1.4257 => 1.4049, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: -1.11% (1.4895 => 1.4730, std.dev.: 0.0042) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.34% (16.6469 => 16.7039, std.dev.: 0.0136) MultiSource/Applications/obsequi/Obsequi: -1.99% (1.0613 => 1.0402, std.dev.: 0.0144) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.77% (21.6476 => 21.8136, std.dev.: 0.1461) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.27% (0.3637 => 0.3647, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 0.05% (0.6030 => 0.6033, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.29% (0.3313 => 0.3237, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/strcat: 0.10% (0.2000 => 0.2002, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -29.95% (0.0197 => 0.0138, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -7.55% (0.0424 => 0.0392, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -22.42% (0.0330 => 0.0256, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.64% (0.0311 => 0.0313, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.94% (0.0413 => 0.0421, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0202 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 28.40% (0.0169 => 0.0217, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.41% (0.1462 => 0.1456, std.dev.: 0.0088) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -7.61% (1.1678 => 1.0789, std.dev.: 0.0783) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -0.61% (0.1464 => 0.1455, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.94% (0.4160 => 0.4199, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.14% (0.1403 => 0.1419, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -13.88% (0.0641 => 0.0552, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.40% (0.0278 => 0.0263, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.45% (0.0569 => 0.0600, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.19% (1.1944 => 1.1967, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 100.00% (0.0001 => 0.0002, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.51% (0.0598 => 0.0613, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.77% (0.0251 => 0.0268, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.13% (0.7815 => 0.7805, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 53.70% (0.0054 => 0.0083, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2308.09% (0.6332 => 15.2480, std.dev.: 0.0687) MultiSource/Benchmarks/McCat/08-main/main: 45.00% (0.1831 => 0.2655, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.18% (0.1559 => 0.1447, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1497.19% (0.3344 => 5.3410, std.dev.: 0.0260) SingleSource/Benchmarks/Misc-C++/Large/ray: 33.38% (0.2364 => 0.3153, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel: -0.47% (0.0429 => 0.0427, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -29.02% (0.0224 => 0.0159, std.dev.: 0.0038) SingleSource/UnitTests/byval-alignment: -32.61% (0.0230 => 0.0155, std.dev.: 0.0007) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4264, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0731, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4953, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3356, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1247, std.dev.: 0.0404) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3997, std.dev.: 0.0046) SingleSource/Regression/C/uint64_to_float: -23.94% (2.1832 => 1.6606, std.dev.: 0.0086) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 12.84% (0.0810 => 0.0914, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.88% (0.2180 => 0.2330, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.76% (0.6010 => 0.6296, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.28% (0.7473 => 0.7793, std.dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.01% (0.3717 => 0.3829, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.91% (0.4127 => 0.4247, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.73% (1.1685 => 1.2004, std.dev.: 0.0121) MultiSource/Applications/SIBsim4/SIBsim4: 2.67% (1.2568 => 1.2904, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 2.64% (1.1271 => 1.1568, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.54% (0.8611 => 0.8830, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 2.49% (1.4269 => 1.4624, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.48% (0.8697 => 0.8913, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.48% (0.8885 => 0.9105, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.47% (1.4479 => 1.4837, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.20% (0.9074 => 0.9274, std.dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.20% (6.6074 => 6.7526, std.dev.: 0.0351) MultiSource/Applications/d/make_dparser: 2.18% (3.2366 => 3.3071, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.16% (0.8457 => 0.8640, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.16% (4.1763 => 4.2663, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.15% (0.8331 => 0.8510, std.dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 1.99% (14.7684 => 15.0622, std.dev.: 0.0608) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.89% (0.9069 => 0.9240, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 1.84% (0.8768 => 0.8929, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.83% (8.6476 => 8.8058, std.dev.: 0.0454) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.82% (0.7932 => 0.8076, std.dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: 1.81% (31.8598 => 32.4370, std.dev.: 0.1979) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.77% (0.8656 => 0.8809, std.dev.: 0.0055) MultiSource/Applications/lua/lua: 1.75% (3.8189 => 3.8859, std.dev.: 0.0248) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.74% (0.8286 => 0.8430, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.67% (2.1401 => 2.1758, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.66% (0.8420 => 0.8560, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 1.64% (15.3280 => 15.5796, std.dev.: 0.0453) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.63% (0.8518 => 0.8657, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.62% (0.8048 => 0.8178, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 1.61% (0.9810 => 0.9968, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.58% (0.8927 => 0.9068, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 1.55% (2.2184 => 2.2527, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.54% (0.8338 => 0.8466, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.52% (0.8177 => 0.8301, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.51% (0.8066 => 0.8188, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.50% (1.6386 => 1.6631, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.42% (0.8855 => 0.8981, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (8.6247 => 8.7470, std.dev.: 0.0284) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.37% (0.8716 => 0.8835, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.36% (0.9039 => 0.9162, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.12% (1.2423 => 1.2562, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.05% (1.2602 => 1.2734, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 109.05% (0.0199 => 0.0416, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/pi: 57.08% (1.5795 => 2.4811, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.11% (0.7597 => 0.8897, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.37% (2.9753 => 3.4625, std.dev.: 0.0794) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.76% (2.7995 => 3.2127, std.dev.: 0.0445) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.56% (5.0261 => 5.6071, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.73% (0.3186 => 0.3496, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 7.49% (1.7056 => 1.8333, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.40% (1.1857 => 1.2735, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.09% (4.7794 => 5.1182, std.dev.: 0.0063) MultiSource/Applications/SIBsim4/SIBsim4: 6.52% (3.1873 => 3.3952, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.94% (4.9686 => 5.2636, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: 5.94% (1.3037 => 1.3811, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.86% (4.5327 => 4.7983, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.71% (3.3761 => 3.5351, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.60% (1.3882 => 1.4520, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.48% (6.2275 => 6.5062, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.42% (4.9453 => 5.1638, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.15% (4.9469 => 5.1523, std.dev.: 0.0295) MultiSource/Applications/hexxagon/hexxagon: 3.93% (14.0064 => 14.5563, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.35% (4.8660 => 5.0292, std.dev.: 0.0069) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.96% (1.2337 => 1.2702, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.96% (0.3587 => 0.3693, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.81% (11.5690 => 11.8944, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.77% (8.2783 => 8.5073, std.dev.: 0.0120) MultiSource/Applications/lambda-0_1_3/lambda: 2.60% (7.4933 => 7.6883, std.dev.: 0.0102) MultiSource/Applications/siod/siod: 2.57% (3.6643 => 3.7586, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout/lists: 2.35% (7.3375 => 7.5096, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.16% (1.1365 => 1.1610, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.93% (4.8362 => 4.9297, std.dev.: 0.0109) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.57% (2.4647 => 2.5033, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: 1.43% (1.2061 => 1.2234, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: 1.29% (1.0841 => 1.0981, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.14% (3.5679 => 3.6086, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/ReedSolomon: 1.01% (8.5322 => 8.6186, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/bh/bh: 1.00% (2.3560 => 2.3796, std.dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.05% (5.4641 => 4.3140, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.33% (7.2130 => 6.1792, std.dev.: 0.1133) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.99% (1.0512 => 0.9357, std.dev.: 0.0085) SingleSource/Benchmarks/McGill/chomp: -10.33% (1.1216 => 1.0057, std.dev.: 0.0075) MultiSource/Benchmarks/mafft/pairlocalalign: -8.53% (63.1822 => 57.7958, std.dev.: 0.0474) SingleSource/Benchmarks/Shootout/heapsort: -7.22% (3.2926 => 3.0548, std.dev.: 0.0578) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.87% (4.7482 => 4.4220, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.33% (0.3269 => 0.3062, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.95% (3.7148 => 3.4937, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.91% (5.4972 => 5.1723, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.16% (5.1557 => 4.8899, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.64% (6.0224 => 5.8029, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.12% (0.5807 => 0.5626, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (28.5821 => 27.6983, std.dev.: 0.0144) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.02% (2.8773 => 2.7905, std.dev.: 0.0314) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.63% (2.6356 => 2.5662, std.dev.: 0.0257) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.55% (1.2822 => 1.2495, std.dev.: 0.0065) MultiSource/Applications/aha/aha: -2.49% (3.3398 => 3.2566, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/bisort/bisort: -2.22% (0.6636 => 0.6489, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.21% (9.9065 => 9.6875, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/hash2: -2.20% (3.4237 => 3.3485, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.97% (11.5316 => 11.3042, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.75% (2.3487 => 2.3077, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/ffbench: -1.73% (1.4296 => 1.4049, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.61% (3.2169 => 3.1651, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.58% (4.9994 => 4.9202, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.24% (5.6343 => 5.5646, std.dev.: 0.0221) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.57% (16.4461 => 16.7039, std.dev.: 0.0136) MultiSource/Applications/obsequi/Obsequi: 1.36% (1.0262 => 1.0402, std.dev.: 0.0144) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6884.82% (0.3123 => 21.8136, std.dev.: 0.1461) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.07% (0.2463 => 0.3647, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 0.38% (0.6010 => 0.6033, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.89% (0.3266 => 0.3237, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/strcat: 1.68% (0.1969 => 0.2002, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 12.20% (0.0123 => 0.0138, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.92% (0.0408 => 0.0392, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.79% (0.0254 => 0.0256, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.64% (0.0384 => 0.0421, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.25% (0.1438 => 0.1456, std.dev.: 0.0088) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -4.77% (1.1329 => 1.0789, std.dev.: 0.0783) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -0.48% (0.1462 => 0.1455, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.84% (0.4164 => 0.4199, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.65% (0.1369 => 0.1419, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -13.88% (0.0641 => 0.0552, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 34.87% (0.0195 => 0.0263, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.81% (0.0578 => 0.0600, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.63% (1.1437 => 1.1967, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -85.71% (0.0014 => 0.0002, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.23% (0.0627 => 0.0613, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.89% (0.0180 => 0.0268, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.64% (0.8017 => 0.7805, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 33.87% (0.0062 => 0.0083, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 06:15:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 08:15:44 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121112141544.C1D372A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5787?compare_to=5784&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5787, Order: 167723, Start Time: 2012-11-12 12:51:05, End Time: 2012-11-12 14:16:00 To: 5784, Order: 167720, Start Time: 2012-11-12 11:03:09, End Time: 2012-11-12 12:28:00 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (180 on baseline) Unchanged Tests: 1041 (856 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.32% (54.6702 => 56.4851, std.dev.: 0.0756) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.25% (1.2783 => 1.3710, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.50% (54.5751 => 56.4851, std.dev.: 0.0756) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1013, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4937 => 7.6766, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/hash2: 2.15% (3.1932 => 3.2619, std.dev.: 0.0028) MultiSource/Benchmarks/llubenchmark/llu: 1.68% (3.7435 => 3.8065, std.dev.: 0.0086) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.74% (0.1431 => 0.1306, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.80% (0.3821 => 0.3523, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -7.47% (2.4924 => 2.3061, std.dev.: 0.0055) MultiSource/Applications/sgefa/sgefa: -6.97% (0.3357 => 0.3123, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.80% (0.2428 => 0.2263, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.59% (0.3142 => 0.2935, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.53% (3.5339 => 3.3031, std.dev.: 0.0240) MultiSource/Benchmarks/mafft/pairlocalalign: -6.48% (9.2283 => 8.6300, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.45% (0.3658 => 0.3422, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -6.44% (0.9179 => 0.8588, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.38% (0.9852 => 0.9223, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -6.38% (7.0961 => 6.6436, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.37% (1.0544 => 0.9872, std.dev.: 0.0064) MultiSource/Applications/JM/lencod/lencod: -6.35% (16.1920 => 15.1635, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.35% (0.1796 => 0.1682, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.34% (0.6484 => 0.6073, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -6.33% (0.1879 => 0.1760, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.31% (0.1584 => 0.1484, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.30% (22.4056 => 20.9945, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/oourafft: -6.30% (0.2160 => 0.2024, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -6.26% (0.3880 => 0.3637, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.25% (1.3722 => 1.2865, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: -6.24% (0.3812 => 0.3574, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.21% (0.3831 => 0.3593, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: -6.20% (4.3330 => 4.0642, std.dev.: 0.0088) SingleSource/Benchmarks/McGill/chomp: -6.19% (0.1761 => 0.1652, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: -6.18% (1.2515 => 1.1741, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.18% (0.1716 => 0.1610, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.14% (0.9542 => 0.8956, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -6.13% (0.3848 => 0.3612, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.13% (0.4176 => 0.3920, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.12% (0.2695 => 0.2530, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -6.10% (1.1450 => 1.0751, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.09% (0.3891 => 0.3654, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.08% (0.3896 => 0.3659, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: -6.07% (1.1530 => 1.0830, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.07% (1.6364 => 1.5371, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.06% (0.5805 => 0.5453, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.05% (4.0323 => 3.7883, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.05% (0.3884 => 0.3649, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.04% (0.5857 => 0.5503, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -6.04% (0.5849 => 0.5496, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.03% (1.2784 => 1.2013, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.02% (0.5478 => 0.5148, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.02% (0.7919 => 0.7442, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/08-main/main: -6.02% (0.2659 => 0.2499, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.02% (0.5802 => 0.5453, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.01% (1.4642 => 1.3762, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.00% (0.6052 => 0.5689, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -6.00% (0.2985 => 0.2806, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.99% (1.2300 => 1.1563, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.99% (0.5863 => 0.5512, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.98% (0.4033 => 0.3792, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.97% (0.6395 => 0.6013, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.97% (0.7339 => 0.6901, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.95% (4.8802 => 4.5896, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.95% (0.6660 => 0.6264, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.94% (0.6681 => 0.6284, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.94% (0.5591 => 0.5259, std.dev.: 0.0033) MultiSource/Benchmarks/sim/sim: -5.93% (0.3406 => 0.3204, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.92% (4.8161 => 4.5308, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.91% (0.6395 => 0.6017, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.91% (0.6667 => 0.6273, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.91% (0.5705 => 0.5368, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.91% (0.5859 => 0.5513, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.90% (4.5069 => 4.2409, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.89% (0.7524 => 0.7081, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.89% (0.6304 => 0.5933, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -5.88% (0.4199 => 0.3952, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.88% (0.6293 => 0.5923, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.88% (0.6260 => 0.5892, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.86% (14.2083 => 13.3757, std.dev.: 0.0133) MultiSource/Applications/SPASS/SPASS: -5.86% (15.5079 => 14.5993, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.85% (0.2548 => 0.2399, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.84% (0.6230 => 0.5866, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -5.84% (4.0594 => 3.8225, std.dev.: 0.0118) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.83% (0.6736 => 0.6343, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.83% (0.5575 => 0.5250, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.83% (0.6194 => 0.5833, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -5.82% (0.4280 => 0.4031, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.81% (0.7198 => 0.6780, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.81% (0.5925 => 0.5581, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -5.80% (17.1032 => 16.1113, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.79% (1.6474 => 1.5520, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.77% (0.3483 => 0.3282, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.76% (0.5569 => 0.5248, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.76% (0.5456 => 0.5142, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.75% (0.5567 => 0.5247, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.74% (0.6446 => 0.6076, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.73% (0.5581 => 0.5261, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.72% (0.6676 => 0.6294, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -5.72% (2.4021 => 2.2648, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.71% (0.5570 => 0.5252, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.70% (6.7716 => 6.3858, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/18-imp/imp: -5.70% (0.3581 => 0.3377, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: -5.69% (0.7447 => 0.7023, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.69% (0.2355 => 0.2221, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.69% (0.5941 => 0.5603, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.69% (0.6297 => 0.5939, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -5.66% (3.5154 => 3.3163, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.65% (0.6440 => 0.6076, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.63% (0.5168 => 0.4877, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.62% (0.8521 => 0.8042, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.60% (0.5999 => 0.5663, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.59% (0.5688 => 0.5370, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.58% (0.4515 => 0.4263, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.57% (0.7021 => 0.6630, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -5.57% (1.3864 => 1.3092, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.56% (0.4151 => 0.3920, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.51% (0.4916 => 0.4645, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.49% (0.2278 => 0.2153, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.48% (0.5329 => 0.5037, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.47% (0.2999 => 0.2835, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.41% (8.0126 => 7.5793, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.41% (1.2210 => 1.1550, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: -5.40% (1.3148 => 1.2438, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: -5.37% (0.4861 => 0.4600, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.35% (2.2587 => 2.1378, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.34% (5.4682 => 5.1760, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.27% (0.3931 => 0.3724, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.25% (0.3255 => 0.3084, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.24% (0.3837 => 0.3636, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -5.22% (15.2527 => 14.4569, std.dev.: 0.0212) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.21% (0.9557 => 0.9059, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: -5.19% (0.3025 => 0.2868, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.18% (0.2106 => 0.1997, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.17% (0.3016 => 0.2860, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.15% (0.3319 => 0.3148, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.15% (1.2221 => 1.1592, std.dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: -5.14% (0.7982 => 0.7572, std.dev.: 0.0045) MultiSource/Benchmarks/Bullet/bullet: -5.12% (34.0927 => 32.3469, std.dev.: 0.0109) MultiSource/Applications/kimwitu++/kc: -5.11% (18.2933 => 17.3583, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/hash: -5.11% (0.4524 => 0.4293, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/09-vor/vor: -5.11% (0.3271 => 0.3104, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.10% (0.3194 => 0.3031, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.10% (2.1713 => 2.0605, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.10% (0.3491 => 0.3313, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -5.10% (2.1401 => 2.0310, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.06% (0.3323 => 0.3155, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: -5.05% (5.0226 => 4.7690, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/lists: -5.03% (0.3621 => 0.3439, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.02% (0.4083 => 0.3878, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -5.02% (0.2989 => 0.2839) SingleSource/Benchmarks/Shootout-C++/lists1: -5.02% (0.3867 => 0.3673, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -5.00% (0.3481 => 0.3307, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.99% (0.4427 => 0.4206, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -4.99% (0.3446 => 0.3274, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -4.99% (0.3026 => 0.2875, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.99% (0.2385 => 0.2266, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -4.97% (0.4248 => 0.4037, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -4.95% (0.2871 => 0.2729, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.94% (0.4813 => 0.4575, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -4.92% (0.3394 => 0.3227, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.91% (0.3057 => 0.2907, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.89% (0.2903 => 0.2761, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.88% (0.2849 => 0.2710, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -4.87% (0.2939 => 0.2796, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.86% (0.3849 => 0.3662, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.84% (0.2933 => 0.2791, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -4.84% (0.3059 => 0.2911, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: -4.83% (0.3788 => 0.3605, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -4.82% (0.8418 => 0.8012, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: -4.80% (0.3205 => 0.3051, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -4.73% (0.6750 => 0.6431, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.70% (0.3252 => 0.3099, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.45% (0.9077 => 0.8673, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: -4.19% (0.6347 => 0.6081, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.93% (0.4321 => 0.4151, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: -3.90% (0.7779 => 0.7476, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -3.85% (0.6441 => 0.6193, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: -3.66% (1.5610 => 1.5039, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -3.01% (20.7746 => 20.1494, std.dev.: 0.0235) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7519, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: -8.68% (1.2842 => 1.1727, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.84% (2.2633 => 2.1765, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.21% (1.3096 => 1.2807, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.61% (6.5735 => 6.4676, std.dev.: 0.0053) Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 07:29:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 09:29:06 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121112152906.E57E72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5788?compare_to=5786&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5788, Order: 167724, Start Time: 2012-11-12 14:02:12, End Time: 2012-11-12 15:29:23 To: 5786, Order: 167723, Start Time: 2012-11-12 12:17:37, End Time: 2012-11-12 13:43:21 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 34 (115 on baseline) Performance Improvements: 2 (24 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 955 (835 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.95% (0.2066 => 0.2251, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.52% (1.1654 => 1.2414, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.38% (0.2980 => 0.3170, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.47% (0.4992 => 0.5265, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.17% (0.4780 => 0.5027, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/09-vor/vor: 5.13% (0.3158 => 0.3320, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.10% (0.6022 => 0.6329, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.40% (0.3383 => 0.3532, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 4.27% (0.4353 => 0.4539, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.86% (0.7793 => 0.8094, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.51% (0.6379 => 0.6603, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.51% (0.5843 => 0.6048, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.44% (4.5699 => 4.7269, std.dev.: 0.0166) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.20% (1.1152 => 1.1509, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.81% (0.9617 => 0.9887, std.dev.: 0.0047) MultiSource/Applications/hbd/hbd: 2.39% (1.4624 => 1.4974, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.94% (1.6631 => 1.6954, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.75% (13.3407 => 13.5735, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.67% (0.8640 => 0.8784, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.66% (0.8178 => 0.8314, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.58% (4.2663 => 4.3335, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.57% (1.2004 => 1.2193, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.51% (0.8933 => 0.9068, std.dev.: 0.0044) MultiSource/Applications/lua/lua: 1.50% (3.8859 => 3.9442, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.26% (0.9162 => 0.9277, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 1.25% (0.9968 => 1.0093, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.20% (0.9145 => 0.9255, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.19% (0.8510 => 0.8611, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 1.06% (15.0622 => 15.2213, std.dev.: 0.0408) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 4.76% (45.1665 => 47.3175, std.dev.: 0.1469) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.53% (21.8561 => 22.4086, std.dev.: 0.1655) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.08% (4.0099 => 4.0934, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout/methcall: 2.06% (8.0947 => 8.2618, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 1.78% (0.5832 => 0.5936, std.dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -6.80% (1.4520 => 1.3532, std.dev.: 0.0317) MultiSource/Applications/spiff/spiff: -1.40% (2.9285 => 2.8874, std.dev.: 0.0059) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.17% (16.7039 => 16.7317, std.dev.: 0.1298) MultiSource/Applications/obsequi/Obsequi: 2.32% (1.0402 => 1.0643, std.dev.: 0.0098) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.03% (21.8136 => 21.8064, std.dev.: 0.3109) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.08% (0.3647 => 0.3650, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/bigfib: 0.13% (0.6033 => 0.6041, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.84% (0.3237 => 0.3329, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/strcat: 0.30% (0.2002 => 0.2008, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 57.97% (0.0138 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 8.42% (0.0392 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.30% (0.0256 => 0.0331, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.64% (0.0313 => 0.0311, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0421 => 0.0421, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0202 => 0.0202, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -0.46% (0.0217 => 0.0216, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 800.00% (0.0001 => 0.0009, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.41% (0.1456 => 0.1462, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 7.10% (1.0789 => 1.1555, std.dev.: 0.0142) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.51% (0.1455 => 0.1477, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.17% (0.4199 => 0.4458, std.dev.: 0.2276) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: - (0.1419 => 0.1419, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 17.57% (0.0552 => 0.0649, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.70% (0.0263 => 0.0278, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.17% (0.0600 => 0.0569, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.28% (1.1967 => 1.1934, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 1250.00% (0.0002 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.59% (0.0613 => 0.0635, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.37% (0.0268 => 0.0267, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.46% (0.7805 => 0.7841, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -33.73% (0.0083 => 0.0055, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2294.06% (0.6332 => 15.1592, std.dev.: 0.2166) MultiSource/Benchmarks/McCat/08-main/main: 49.54% (0.1831 => 0.2738, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.75% (0.1559 => 0.1485, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1499.43% (0.3344 => 5.3485, std.dev.: 0.0933) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.46% (0.2364 => 0.3226, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/mandel: 2.56% (0.0429 => 0.0440, std.dev.: 0.0014) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.25% (0.0224 => 0.0238, std.dev.: 0.0018) SingleSource/UnitTests/byval-alignment: -32.61% (0.0230 => 0.0155, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4277, std.dev.: 0.0147) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0700, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4940, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3456, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1383, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4117, std.dev.: 0.0066) SingleSource/Regression/C/uint64_to_float: -23.91% (2.1832 => 1.6613, std.dev.: 0.0019) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.05% (0.0810 => 0.0940, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.98% (0.0830 => 0.0946, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/tsp/tsp: 13.40% (0.1112 => 0.1261, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.62% (0.0848 => 0.0955, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 8.88% (0.1137 => 0.1238, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.62% (0.4847 => 0.5265, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.47% (0.6010 => 0.6519, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.31% (0.7473 => 0.8094, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.17% (0.2180 => 0.2358, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.70% (0.8321 => 0.8962, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.19% (0.3295 => 0.3532, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.96% (1.1606 => 1.2414, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.80% (0.2279 => 0.2434, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.45% (0.1983 => 0.2111, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.17% (0.5961 => 0.6329, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.95% (0.2519 => 0.2669, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.74% (0.2998 => 0.3170, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.67% (0.1905 => 0.2013, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.53% (0.2133 => 0.2251, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.41% (0.1885 => 0.1987, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.10% (0.4783 => 0.5027, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.03% (0.6287 => 0.6603, std.dev.: 0.0038) MultiSource/Applications/hbd/hbd: 4.94% (1.4269 => 1.4974, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.79% (0.9435 => 0.9887, std.dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 4.47% (1.1271 => 1.1775, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.35% (1.1685 => 1.2193, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.98% (1.3279 => 1.3807, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.97% (0.5817 => 0.6048, std.dev.: 0.0071) MultiSource/Applications/spiff/spiff: 3.91% (0.7950 => 0.8261, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.87% (0.8457 => 0.8784, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.76% (4.1763 => 4.3335, std.dev.: 0.0093) MultiSource/Applications/minisat/minisat: 3.67% (0.6834 => 0.7085, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.66% (0.3717 => 0.3853, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.47% (1.6386 => 1.6954, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.46% (0.4127 => 0.4270, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.43% (4.5702 => 4.7269, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.36% (0.8331 => 0.8611, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.34% (0.8316 => 0.8594, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.31% (0.8048 => 0.8314, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 3.28% (3.8189 => 3.9442, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/05-eks/eks: 3.23% (0.4397 => 0.4539, std.dev.: 0.0051) MultiSource/Applications/ClamAV/clamscan: 3.07% (14.7684 => 15.2213, std.dev.: 0.0408) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.06% (0.8518 => 0.8779, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.03% (1.1170 => 1.1509, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.00% (8.6476 => 8.9066, std.dev.: 0.0562) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.99% (0.8805 => 0.9068, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.98% (13.1811 => 13.5735, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.96% (0.9688 => 0.9975, std.dev.: 0.0094) MultiSource/Applications/hexxagon/hexxagon: 2.88% (0.9810 => 1.0093, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.87% (0.8007 => 0.8237, std.dev.: 0.0064) MultiSource/Applications/SIBsim4/SIBsim4: 2.76% (1.2568 => 1.2915, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.76% (6.6074 => 6.7896, std.dev.: 0.0456) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.74% (0.8204 => 0.8429, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.72% (0.8359 => 0.8586, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.63% (0.9039 => 0.9277, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.60% (0.8656 => 0.8881, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.50% (0.9908 => 1.0156, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.50% (1.2526 => 1.2839, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.47% (0.8340 => 0.8546, std.dev.: 0.0062) MultiSource/Applications/SPASS/SPASS: 2.41% (14.2605 => 14.6043, std.dev.: 0.0776) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.40% (0.8611 => 0.8818, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.35% (0.8716 => 0.8921, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.34% (4.4873 => 4.5924, std.dev.: 0.0397) MultiSource/Applications/JM/lencod/lencod: 2.34% (15.3280 => 15.6866, std.dev.: 0.0898) MultiSource/Benchmarks/PAQ8p/paq8p: 2.32% (2.3764 => 2.4315, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.26% (0.8885 => 0.9086, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.20% (0.9056 => 0.9255, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.17% (0.8066 => 0.8241, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.15% (0.9074 => 0.9269, std.dev.: 0.0055) MultiSource/Benchmarks/Bullet/bullet: 2.07% (31.8598 => 32.5200, std.dev.: 0.2147) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.02% (0.8261 => 0.8428, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.90% (1.2602 => 1.2842, std.dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: 1.87% (6.7320 => 6.8581, std.dev.: 0.0429) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.77% (4.4880 => 4.5675, std.dev.: 0.0265) MultiSource/Applications/lambda-0_1_3/lambda: 1.61% (0.7557 => 0.7679, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.36% (1.2423 => 1.2592, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 115.08% (0.0199 => 0.0428, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/pi: 57.79% (1.5795 => 2.4923, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 21.40% (0.0528 => 0.0641, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.42% (2.9753 => 3.4637, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.74% (0.7597 => 0.8793, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.74% (2.7995 => 3.2122, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.62% (5.0261 => 5.6100, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.53% (6.3772 => 6.9214, std.dev.: 0.1461) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.13% (1.1857 => 1.2821, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.82% (0.3186 => 0.3435, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/queens: 7.52% (1.7056 => 1.8338, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.89% (4.7794 => 5.1087, std.dev.: 0.0042) MultiSource/Applications/SIBsim4/SIBsim4: 6.47% (3.1873 => 3.3935, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 6.19% (44.5605 => 47.3175, std.dev.: 0.1469) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.98% (4.5327 => 4.8039, std.dev.: 0.0289) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.90% (4.9686 => 5.2619, std.dev.: 0.0185) SingleSource/Benchmarks/Misc/richards_benchmark: 5.68% (1.3037 => 1.3778, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.58% (6.2275 => 6.5130, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.51% (3.3761 => 3.5282, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.36% (4.9453 => 5.1611, std.dev.: 0.0076) MultiSource/Applications/hexxagon/hexxagon: 3.95% (14.0064 => 14.5596, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.48% (0.3587 => 0.3712, std.dev.: 0.0030) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.11% (1.2337 => 1.2721, std.dev.: 0.0059) MultiSource/Applications/siod/siod: 3.00% (3.6643 => 3.7744, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.92% (11.5690 => 11.9064, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout/lists: 2.62% (7.3375 => 7.5297, std.dev.: 0.0119) MultiSource/Applications/lambda-0_1_3/lambda: 2.59% (7.4933 => 7.6874, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.59% (4.8660 => 4.9918, std.dev.: 0.0243) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.58% (8.2783 => 8.4915, std.dev.: 0.0189) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.86% (1.1365 => 1.1576, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.70% (4.8362 => 4.9185, std.dev.: 0.0278) SingleSource/Benchmarks/Stanford/FloatMM: 1.56% (0.8807 => 0.8944, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.46% (2.4647 => 2.5007, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ReedSolomon: 1.36% (8.5322 => 8.6480, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/neural/neural: 1.31% (1.0841 => 1.0983, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.25% (3.5679 => 3.6125, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.14% (4.0473 => 4.0934, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/flops-6: 1.14% (2.4416 => 2.4694, std.dev.: 0.0069) MultiSource/Applications/spiff/spiff: 1.10% (2.8561 => 2.8874, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.27% (5.4641 => 4.3017, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.89% (7.2130 => 6.2111, std.dev.: 0.1300) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.87% (1.0512 => 0.9369, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -10.60% (1.1216 => 1.0027, std.dev.: 0.0354) MultiSource/Benchmarks/mafft/pairlocalalign: -8.48% (63.1822 => 57.8245, std.dev.: 0.0409) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.80% (4.7482 => 4.4252, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.55% (0.3269 => 0.3055, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.17% (3.7148 => 3.4857, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.81% (5.4972 => 5.1776, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.03% (5.1557 => 4.8966, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.48% (2.8773 => 2.7485, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.35% (4.7449 => 4.5387, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.62% (6.0224 => 5.8045, std.dev.: 0.0179) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.13% (0.5807 => 0.5625, std.dev.: 0.0047) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.00% (28.5821 => 27.7235, std.dev.: 0.0222) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.70% (2.4490 => 2.3829, std.dev.: 0.0123) MultiSource/Applications/aha/aha: -2.55% (3.3398 => 3.2547, std.dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.54% (2.6356 => 2.5687, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: -2.38% (3.4237 => 3.3423, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.97% (11.5316 => 11.3044, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.70% (9.9065 => 9.7384, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.58% (4.9994 => 4.9205, std.dev.: 0.0182) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.32% (2.3487 => 2.3178, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.27% (5.6343 => 5.5629, std.dev.: 0.0053) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.74% (16.4461 => 16.7317, std.dev.: 0.1298) MultiSource/Applications/obsequi/Obsequi: 3.71% (1.0262 => 1.0643, std.dev.: 0.0098) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6882.52% (0.3123 => 21.8064, std.dev.: 0.3109) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.19% (0.2463 => 0.3650, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/bigfib: 0.52% (0.6010 => 0.6041, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.93% (0.3266 => 0.3329, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/strcat: 1.98% (0.1969 => 0.2008, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.98% (0.0302 => 0.0311, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.64% (0.0384 => 0.0421, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 28.57% (0.0007 => 0.0009, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.67% (0.1438 => 0.1462, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.99% (1.1329 => 1.1555, std.dev.: 0.0142) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.03% (0.1462 => 0.1477, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 7.06% (0.4164 => 0.4458, std.dev.: 0.2276) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.65% (0.1369 => 0.1419, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.25% (0.0641 => 0.0649, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.56% (0.0195 => 0.0278, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.56% (0.0578 => 0.0569, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.35% (1.1437 => 1.1934, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.28% (0.0627 => 0.0635, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.20% (0.8017 => 0.7841, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -11.29% (0.0062 => 0.0055, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 08:03:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 10:03:57 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121112160357.1EF1D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5789?compare_to=5787&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5789, Order: 167726, Start Time: 2012-11-12 14:39:16, End Time: 2012-11-12 16:04:12 To: 5787, Order: 167723, Start Time: 2012-11-12 12:51:05, End Time: 2012-11-12 14:16:00 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (182 on baseline) Unchanged Tests: 1041 (856 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/nbench/nbench: 1.22% (1.0830 => 1.0962, std.dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1013, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 2.53% (7.4937 => 7.6831, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 2.25% (3.1932 => 3.2650, std.dev.: 0.0088) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.69% (0.3821 => 0.3527, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.21% (2.4924 => 2.3126, std.dev.: 0.0205) MultiSource/Applications/sgefa/sgefa: -6.82% (0.3357 => 0.3128, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.63% (0.2428 => 0.2267, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.46% (0.3142 => 0.2939, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.40% (3.5339 => 3.3076, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.40% (0.6484 => 0.6069, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: -6.25% (16.1920 => 15.1808, std.dev.: 0.0131) MultiSource/Applications/JM/ldecod/ldecod: -6.22% (7.0961 => 6.6544, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: -6.22% (0.9179 => 0.8608, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.21% (0.3658 => 0.3431, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -6.19% (9.2283 => 8.6568, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.18% (0.9852 => 0.9243, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.16% (1.0544 => 0.9894, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.15% (22.4056 => 21.0280, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.12% (0.1796 => 0.1686, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.11% (1.3722 => 1.2883, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: -6.11% (0.3812 => 0.3579, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -6.11% (0.3831 => 0.3597, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.07% (0.3891 => 0.3655, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -6.06% (0.3896 => 0.3660, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.06% (0.3880 => 0.3645, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -6.03% (1.2515 => 1.1760, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/gs/gs: -6.03% (4.3330 => 4.0718, std.dev.: 0.0033) MultiSource/Applications/lemon/lemon: -6.00% (1.1450 => 1.0763, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-3: -5.98% (0.3848 => 0.3618, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.97% (0.7919 => 0.7446, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -5.97% (0.2160 => 0.2031, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.96% (0.7198 => 0.6769, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.96% (1.4642 => 1.3770, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.95% (0.4033 => 0.3793, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.94% (0.2695 => 0.2535, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.92% (0.5863 => 0.5516, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.90% (1.2300 => 1.1574, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.90% (4.5069 => 4.2411, std.dev.: 0.0094) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.89% (0.1716 => 0.1615, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.87% (0.3884 => 0.3656, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.86% (0.2985 => 0.2810, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.86% (0.2355 => 0.2217, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.86% (4.8161 => 4.5341, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions: -5.84% (0.4176 => 0.3932, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.84% (1.2784 => 1.2038, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.83% (4.8802 => 4.5957, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.79% (0.5802 => 0.5466, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: -5.79% (0.4199 => 0.3956, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.78% (0.7339 => 0.6915, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.76% (4.0323 => 3.8002, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.75% (0.5478 => 0.5163, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -5.75% (17.1032 => 16.1200, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.74% (1.6364 => 1.5424, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.74% (0.8521 => 0.8032, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.74% (0.6293 => 0.5932, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.73% (0.5859 => 0.5523, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.73% (0.6736 => 0.6350, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.73% (0.3406 => 0.3211, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.72% (0.9542 => 0.8996, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.71% (0.5591 => 0.5272, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.70% (0.5805 => 0.5474, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.69% (0.6395 => 0.6031, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.69% (0.2548 => 0.2403, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.69% (0.5857 => 0.5524, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.68% (0.3483 => 0.3285, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -5.68% (0.4280 => 0.4037, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -5.65% (1.3864 => 1.3080, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.65% (0.6052 => 0.5710, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.64% (0.6681 => 0.6304, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: -5.64% (0.2659 => 0.2509, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -5.63% (15.5079 => 14.6345, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.63% (0.6395 => 0.6035, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.63% (0.5705 => 0.5384, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -5.62% (4.0594 => 3.8311, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.62% (0.5925 => 0.5592, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.60% (14.2083 => 13.4121, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.60% (0.6230 => 0.5881, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.60% (0.6304 => 0.5951, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.60% (6.7716 => 6.3926, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.60% (1.6474 => 1.5552, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.59% (0.6667 => 0.6294, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/18-imp/imp: -5.59% (0.3581 => 0.3381, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.58% (0.5569 => 0.5258, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.58% (0.5999 => 0.5664, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.57% (0.6194 => 0.5849, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.57% (0.7524 => 0.7105, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.54% (0.6260 => 0.5913, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.54% (0.2999 => 0.2833, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.51% (0.6297 => 0.5950, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.49% (0.6446 => 0.6092, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.48% (0.6676 => 0.6310, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.47% (0.5849 => 0.5529, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.45% (0.5575 => 0.5271, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.45% (0.6189 => 0.5852, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.44% (0.5456 => 0.5159, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -5.44% (0.7447 => 0.7042, std.dev.: 0.0026) MultiSource/Applications/siod/siod: -5.43% (2.4021 => 2.2716, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.43% (0.4916 => 0.4649, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.43% (0.5581 => 0.5278, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.36% (0.6660 => 0.6303, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -5.36% (0.4515 => 0.4273, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.36% (0.5168 => 0.4891, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.35% (0.5941 => 0.5623, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.33% (0.5688 => 0.5385, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.31% (0.2278 => 0.2157, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.31% (0.6440 => 0.6098, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.30% (0.6033 => 0.5713, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -5.30% (3.5154 => 3.3291, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.30% (0.5570 => 0.5275, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.29% (0.5329 => 0.5047, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.28% (0.7021 => 0.6650, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.28% (0.4151 => 0.3932, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.26% (0.5567 => 0.5274, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.25% (1.2221 => 1.1579, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.24% (0.3931 => 0.3725, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.24% (1.3148 => 1.2459, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.22% (8.0126 => 7.5941, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.22% (2.2587 => 2.1409, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.19% (5.4682 => 5.1842, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash2: -5.18% (0.4861 => 0.4609, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -5.16% (0.3255 => 0.3087, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.13% (0.3837 => 0.3640, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: -5.11% (2.1401 => 2.0307, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.09% (1.2210 => 1.1588, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.09% (0.3319 => 0.3150, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: -5.08% (34.0927 => 32.3609, std.dev.: 0.0126) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.07% (0.2385 => 0.2264, std.dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: -5.07% (15.2527 => 14.4795, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/except: -5.06% (0.3026 => 0.2873, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -5.05% (0.2989 => 0.2838, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.04% (0.9557 => 0.9075, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/moments: -4.99% (0.4248 => 0.4036, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.99% (0.2106 => 0.2001, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: -4.98% (0.3394 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: -4.97% (0.4524 => 0.4299, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: -4.97% (18.2933 => 17.3850, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/lists1: -4.97% (0.3867 => 0.3675, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary3: -4.96% (0.3446 => 0.3275, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -4.96% (0.3025 => 0.2875, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.95% (0.4427 => 0.4208, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.94% (2.1713 => 2.0640, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.94% (0.3016 => 0.2867, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -4.94% (5.0226 => 4.7745, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.93% (0.3491 => 0.3319, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -4.93% (1.1530 => 1.0962, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -4.89% (0.7982 => 0.7592, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: -4.86% (0.3271 => 0.3112, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.86% (0.3252 => 0.3094, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -4.85% (0.3194 => 0.3039, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.82% (0.4813 => 0.4581, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -4.81% (0.3621 => 0.3447, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.80% (0.4083 => 0.3887, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -4.75% (0.3788 => 0.3608, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -4.75% (0.8418 => 0.8018, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.74% (0.3057 => 0.2912, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary2: -4.74% (0.3481 => 0.3316, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.70% (0.3849 => 0.3668, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: -4.67% (0.2871 => 0.2737, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.66% (0.3323 => 0.3168, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: -4.66% (0.2939 => 0.2802, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -4.64% (0.6750 => 0.6437, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.64% (0.2933 => 0.2797, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.56% (0.3205 => 0.3059, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.51% (0.2903 => 0.2772, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: -4.49% (0.2849 => 0.2721, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -4.48% (0.3059 => 0.2922, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.42% (0.4321 => 0.4130, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: -4.40% (0.7779 => 0.7437, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: -4.25% (0.6347 => 0.6077, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.23% (0.9077 => 0.8693, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: -3.88% (0.6441 => 0.6191, std.dev.: 0.0079) MultiSource/Applications/hbd/hbd: -3.59% (1.5610 => 1.5049, std.dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -2.51% (20.7746 => 20.2534, std.dev.: 0.0256) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7553, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -4.01% (2.2633 => 2.1726, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7068, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.41% (1.0557 => 1.0197, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.23% (1.3096 => 1.2804, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4706, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0004) Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 09:29:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 11:29:55 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121112172955.F32CB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5790?compare_to=5785&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5790, Order: 167723, Start Time: 2012-11-12 14:14:55, End Time: 2012-11-12 17:30:11 To: 5785, Order: 167719, Start Time: 2012-11-12 10:11:21, End Time: 2012-11-12 13:26:51 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (175 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (716 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.76% (2.4596 => 2.5028, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.59% (0.3865 => 0.3765, std.dev.: 0.0028) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.88% (0.0625 => 0.0893, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.58% (0.1063 => 0.1420, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.61% (0.2969 => 0.3759, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.58% (0.1106 => 0.1400, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.70% (0.4253 => 0.5346, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 25.61% (1.5932 => 2.0012, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.22% (0.4139 => 0.5183, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.07% (0.0714 => 0.0893, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.21% (0.0475 => 0.0590, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.01% (0.4994 => 0.6193, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.93% (0.5900 => 0.7312, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.58% (0.0547 => 0.0676, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.54% (0.5000 => 0.6177, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.46% (0.0584 => 0.0721, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.53% (0.1021 => 0.1251, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.49% (0.1107 => 0.1356, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.41% (0.0897 => 0.1098, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: 22.37% (0.0599 => 0.0733, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.28% (0.1620 => 0.1981, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 21.31% (0.0948 => 0.1150, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.17% (0.0633 => 0.0767, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.06% (0.0584 => 0.0707, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.01% (0.0495 => 0.0599, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.91% (0.3903 => 0.4719, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.85% (0.1103 => 0.1333, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.74% (0.1003 => 0.1211, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.72% (0.0642 => 0.0775, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 20.71% (0.0821 => 0.0991, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.40% (0.1549 => 0.1865, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.39% (0.1604 => 0.1931, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 20.36% (0.0604 => 0.0727, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 20.20% (0.1619 => 0.1946, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.19% (0.0822 => 0.0988, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.63% (0.1462 => 0.1749, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 19.55% (0.0808 => 0.0966, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 19.43% (0.0947 => 0.1131, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.36% (0.3890 => 0.4643, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.87% (0.2014 => 0.2394, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 18.72% (0.1218 => 0.1446, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.46% (0.2736 => 0.3241, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 18.43% (0.5826 => 0.6900, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 18.34% (0.0698 => 0.0826, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 18.27% (0.5889 => 0.6965, std.dev.: 0.0031) MultiSource/Applications/spiff/spiff: 18.24% (0.4029 => 0.4764, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.19% (1.3152 => 1.5544, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.11% (0.1088 => 0.1285) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.02% (0.0605 => 0.0714, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 18.01% (0.1505 => 0.1776, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.69% (0.2866 => 0.3373, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.66% (3.5627 => 4.1919, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.66% (0.0572 => 0.0673, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.63% (0.0573 => 0.0674) MultiSource/Applications/Burg/burg: 17.62% (0.5546 => 0.6523, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.58% (0.1968 => 0.2314, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 17.56% (1.8794 => 2.2094, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.45% (0.4658 => 0.5471, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 17.23% (0.9697 => 1.1368, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.20% (1.6211 => 1.9000, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.98% (0.1160 => 0.1357, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.97% (0.3271 => 0.3826, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 16.86% (1.0781 => 1.2599, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.83% (0.2875 => 0.3359, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 16.68% (0.1421 => 0.1658, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.62% (0.4361 => 0.5086, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.47% (0.5026 => 0.5854, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.39% (0.3930 => 0.4574, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 16.36% (4.2109 => 4.8999, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.25% (4.4195 => 5.1376, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/fibo: 16.18% (0.2725 => 0.3166, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 16.14% (0.2714 => 0.3152, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.11% (2.7292 => 3.1689, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.07% (0.2738 => 0.3178, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.05% (0.2729 => 0.3167, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 16.04% (0.1284 => 0.1490, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 16.01% (0.7171 => 0.8319, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: 15.89% (0.2750 => 0.3187, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.87% (0.1090 => 0.1263, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 15.77% (0.2803 => 0.3245, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.71% (0.3195 => 0.3697, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 15.68% (0.2780 => 0.3216, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.65% (1.9694 => 2.2777, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.62% (1.9966 => 2.3085, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/methcall: 15.61% (0.2813 => 0.3252, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 15.59% (0.2823 => 0.3263, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 15.55% (23.5202 => 27.1777, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wc: 15.50% (0.3096 => 0.3576, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 15.48% (0.3004 => 0.3469, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/except: 15.47% (0.2811 => 0.3246, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.44% (0.2792 => 0.3223, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 15.42% (0.2075 => 0.2395, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.39% (2.0673 => 2.3855, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 15.36% (0.9909 => 1.1431, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 15.35% (0.2566 => 0.2960, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 15.34% (0.3267 => 0.3768, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.29% (0.2911 => 0.3356, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 15.07% (0.3258 => 0.3749, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.87% (0.3362 => 0.3862, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 14.74% (0.3317 => 0.3806, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 14.74% (1.4269 => 1.6372, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.64% (0.3060 => 0.3508, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.47% (0.3124 => 0.3576, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 14.38% (0.3678 => 0.4207, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 14.29% (0.3477 => 0.3974, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.17% (0.3282 => 0.3747, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 14.16% (0.7875 => 0.8990, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 14.10% (0.3348 => 0.3820, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 13.96% (0.3726 => 0.4246, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 13.91% (2.1653 => 2.4666, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 13.89% (0.4146 => 0.4722, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 13.85% (0.0758 => 0.0863, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.85% (0.3625 => 0.4127, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.77% (0.3690 => 0.4198, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.76% (0.3845 => 0.4374, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 13.71% (0.4251 => 0.4834, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.68% (0.2040 => 0.2319, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.65% (0.3488 => 0.3964, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.64% (0.3446 => 0.3916, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.62% (0.3496 => 0.3972, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 13.60% (4.6177 => 5.2458, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/trivial-interface: 13.54% (0.3442 => 0.3908, std.dev.: 0.0079) SingleSource/UnitTests/ObjC/exceptions-4: 13.51% (0.3465 => 0.3933, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/synchronized: 13.49% (0.3469 => 0.3937, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.49% (0.3981 => 0.4518, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.44% (0.3460 => 0.3925, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 13.40% (2.1013 => 2.3828, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/property: 13.34% (0.3650 => 0.4137, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 13.23% (0.2691 => 0.3047, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 13.21% (0.3724 => 0.4216, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 13.15% (0.3643 => 0.4122, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 13.01% (0.5012 => 0.5664, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 12.74% (5.5417 => 6.2475, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.08% (0.1383 => 0.1550, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.00% (0.6435 => 0.7207, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.67% (0.1028 => 0.1148, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.65% (0.2068 => 0.2309, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 11.58% (0.3498 => 0.3903, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 11.34% (0.6634 => 0.7386, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: 11.22% (0.4847 => 0.5391, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.14% (0.2737 => 0.3042, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 10.88% (2.0346 => 2.2560, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.80% (0.3084 => 0.3417, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 10.58% (0.2391 => 0.2644, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 10.52% (0.3336 => 0.3687, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.18% (0.2103 => 0.2317, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.09% (4.6926 => 5.1190, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.07% (0.5361 => 0.5847, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.91% (11.6398 => 12.6767, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.83% (0.5584 => 0.6077, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.60% (0.7426 => 0.8065, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: 7.08% (11.9555 => 12.8024, std.dev.: 0.0147) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.19% (0.3792 => 0.3951, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: 1.07% (2.4764 => 2.5028, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 9.78% (0.2802 => 0.3076, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6103, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary: 5.42% (0.2122 => 0.2237, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.09% (12.0509 => 12.6646, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-2: 4.67% (1.8057 => 1.8900, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1637, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/dry: 4.14% (14.0481 => 14.6302, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1926, std.dev.: 0.0071) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.71% (3.1722 => 3.2266, std.dev.: 0.0035) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3058, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2858, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5864, std.dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.81% (25.4195 => 16.5715, std.dev.: 0.0178) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9764, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7934, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -7.24% (0.2402 => 0.2228, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8038, std.dev.: 0.0059) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7733, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.66% (17.2379 => 16.7793, std.dev.: 0.0404) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.25% (41.7953 => 40.8536, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.11% (0.6293 => 0.6160, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5793, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4958, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.1992, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0431, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 09:38:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 11:38:14 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121112173814.45AD72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5791?compare_to=5788&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5791, Order: 167731, Start Time: 2012-11-12 16:12:46, End Time: 2012-11-12 17:38:29 To: 5788, Order: 167724, Start Time: 2012-11-12 14:02:12, End Time: 2012-11-12 15:29:23 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 7 (114 on baseline) Performance Improvements: 12 (28 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 972 (832 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/gs/gs: 1.69% (4.2376 => 4.3091, std.dev.: 0.0200) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 8.81% (3.0985 => 3.3716, std.dev.: 0.0516) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.95% (6.9214 => 7.3334, std.dev.: 0.1280) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.56% (6.2111 => 6.4945, std.dev.: 0.0854) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.27% (1.3532 => 1.3974, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.62% (1.4165 => 1.4395, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 1.54% (0.8793 => 0.8928, std.dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.22% (8.4878 => 8.2994, std.dev.: 0.0496) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.04% (0.8594 => 0.8419, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.91% (0.8314 => 0.8155, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.80% (1.2414 => 1.2191, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.66% (0.8779 => 0.8633, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.52% (0.9975 => 0.9823, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.50% (0.8611 => 0.8482, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.28% (4.7269 => 4.6662, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.27% (0.8985 => 0.8871, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: -10.28% (0.1343 => 0.1205, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.57% (47.3175 => 45.1536, std.dev.: 0.5391) MultiSource/Benchmarks/Olden/bisort/bisort: -3.28% (0.6711 => 0.6491, std.dev.: 0.0014) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.02% (16.7317 => 16.7349, std.dev.: 0.1592) MultiSource/Applications/obsequi/Obsequi: 0.31% (1.0643 => 1.0676, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.39% (21.8064 => 21.7210, std.dev.: 0.2912) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.55% (0.3650 => 0.3670, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: 0.51% (0.6041 => 0.6072, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.30% (0.3329 => 0.3339, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: -0.10% (0.2008 => 0.2006, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -37.61% (0.0218 => 0.0136, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.24% (0.0425 => 0.0424, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -23.26% (0.0331 => 0.0254, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0311 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.48% (0.0421 => 0.0423, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0202 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0216 => 0.0216, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 44.44% (0.0009 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.34% (0.1462 => 0.1467, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.37% (1.1555 => 1.1512, std.dev.: 0.0078) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.30% (0.1477 => 0.1443, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.43% (0.4458 => 0.4216, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.06% (0.1419 => 0.1434, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.15% (0.0649 => 0.0648, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -25.54% (0.0278 => 0.0207, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.23% (0.0569 => 0.0576, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.34% (1.1934 => 1.1893, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -58.06% (0.0031 => 0.0013, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.66% (0.0635 => 0.0580, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -34.46% (0.0267 => 0.0175, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.27% (0.7841 => 0.7862, std.dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: -50.00% (0.0002 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -7.27% (0.0055 => 0.0051, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2290.65% (0.6332 => 15.1376, std.dev.: 0.2926) MultiSource/Benchmarks/McCat/08-main/main: 48.61% (0.1831 => 0.2721, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.94% (0.1559 => 0.1404, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1494.20% (0.3344 => 5.3310, std.dev.: 0.0425) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.99% (0.2364 => 0.3262, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel: 3.03% (0.0429 => 0.0442, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.68% (0.0224 => 0.0230, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -25.65% (0.0230 => 0.0171, std.dev.: 0.0000) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4216, std.dev.: 0.0367) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0704, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4934, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3418, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1288, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4019, std.dev.: 0.0028) SingleSource/Regression/C/uint64_to_float: -24.28% (2.1832 => 1.6532, std.dev.: 0.0100) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.57% (0.0810 => 0.0928, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.36% (0.0773 => 0.0884, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.53% (0.0830 => 0.0934, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 12.23% (0.1112 => 0.1248, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.82% (0.1425 => 0.1565, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.30% (0.2279 => 0.2491, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.04% (0.8321 => 0.8990, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.43% (0.4847 => 0.5207, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.70% (0.2240 => 0.2390, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.64% (0.2998 => 0.3197, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.42% (0.1885 => 0.2006, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.37% (0.7473 => 0.7949, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.36% (0.8148 => 0.8666, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.96% (0.6010 => 0.6368, std.dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.72% (0.1905 => 0.2014, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.64% (0.2519 => 0.2661, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.61% (0.3295 => 0.3480, std.dev.: 0.0049) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.61% (0.3137 => 0.3313, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.35% (0.1983 => 0.2089, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.27% (0.5961 => 0.6275, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.04% (1.1606 => 1.2191, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.95% (0.6287 => 0.6598, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.83% (1.1685 => 1.2249, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.60% (0.9435 => 0.9869, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/gs/gs: 4.32% (4.1305 => 4.3091, std.dev.: 0.0200) MultiSource/Applications/hbd/hbd: 3.92% (1.4269 => 1.4828, std.dev.: 0.0115) MultiSource/Applications/Burg/burg: 3.76% (1.2222 => 1.2682, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 3.56% (0.7950 => 0.8233, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.49% (1.3279 => 1.3742, std.dev.: 0.0038) MultiSource/Applications/treecc/treecc: 3.26% (1.9948 => 2.0598, std.dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.24% (1.4479 => 1.4948, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.22% (1.6386 => 1.6913, std.dev.: 0.0143) MultiSource/Applications/minisat/minisat: 3.09% (0.6834 => 0.7045, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.03% (8.6476 => 8.9098, std.dev.: 0.0116) MultiSource/Benchmarks/nbench/nbench: 2.91% (1.1271 => 1.1599, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.89% (0.8885 => 0.9142, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 2.77% (3.8189 => 3.9247, std.dev.: 0.0283) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.67% (4.1763 => 4.2880, std.dev.: 0.0343) MultiSource/Applications/SPASS/SPASS: 2.65% (14.2605 => 14.6390, std.dev.: 0.0996) MultiSource/Benchmarks/McCat/05-eks/eks: 2.64% (0.4397 => 0.4513, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: 2.55% (14.7684 => 15.1444, std.dev.: 0.0893) MultiSource/Applications/SIBsim4/SIBsim4: 2.53% (1.2568 => 1.2886, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.50% (4.4880 => 4.6000, std.dev.: 0.0323) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.44% (1.1170 => 1.1442, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.43% (0.4559 => 0.4670, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.38% (1.2526 => 1.2824, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.36% (0.8457 => 0.8657, std.dev.: 0.0070) MultiSource/Benchmarks/Bullet/bullet: 2.30% (31.8598 => 32.5937, std.dev.: 0.0558) MultiSource/Applications/JM/ldecod/ldecod: 2.18% (6.7320 => 6.8790, std.dev.: 0.0363) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.13% (0.8697 => 0.8882, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.11% (0.9056 => 0.9247, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.10% (4.5702 => 4.6662, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.06% (0.8656 => 0.8834, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.00% (0.9039 => 0.9220, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.98% (0.8050 => 0.8209, std.dev.: 0.0029) MultiSource/Applications/siod/siod: 1.89% (2.2184 => 2.2604, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.88% (0.8611 => 0.8773, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.85% (0.8855 => 0.9019, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.83% (0.8712 => 0.8871, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.81% (0.8331 => 0.8482, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.81% (0.9069 => 0.9233, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.78% (0.8597 => 0.8750, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.77% (0.8069 => 0.8212, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.77% (0.7966 => 0.8107, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.77% (0.8420 => 0.8569, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/football/football: 1.73% (0.8768 => 0.8920, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.71% (0.8286 => 0.8428, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 1.71% (15.3280 => 15.5898, std.dev.: 0.0867) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.68% (0.8261 => 0.8400, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.67% (0.8204 => 0.8341, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.63% (0.7932 => 0.8061, std.dev.: 0.0034) MultiSource/Applications/d/make_dparser: 1.62% (3.2366 => 3.2891, std.dev.: 0.0195) MultiSource/Applications/lambda-0_1_3/lambda: 1.60% (0.7557 => 0.7678, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.47% (0.8927 => 0.9058, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.39% (0.9688 => 0.9823, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.35% (0.8066 => 0.8175, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.35% (0.8518 => 0.8633, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.30% (1.5315 => 1.5514, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.26% (2.1401 => 2.1671, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.24% (0.8316 => 0.8419, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 123.62% (0.0199 => 0.0445, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/pi: 57.08% (1.5795 => 2.4811, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.52% (0.7597 => 0.8928, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.08% (2.9753 => 3.4537, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 14.99% (6.3772 => 7.3334, std.dev.: 0.1280) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.51% (2.7995 => 3.2057, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.50% (5.0261 => 5.6043, std.dev.: 0.0135) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.10% (1.1857 => 1.2818, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 7.19% (1.7056 => 1.8282, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.74% (4.7794 => 5.1014, std.dev.: 0.0108) MultiSource/Applications/SIBsim4/SIBsim4: 6.31% (3.1873 => 3.3883, std.dev.: 0.0207) SingleSource/Benchmarks/Misc/richards_benchmark: 5.88% (1.3037 => 1.3804, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.80% (4.5327 => 4.7958, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.76% (4.9686 => 5.2546, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/treeadd/treeadd: 5.30% (0.3587 => 0.3777, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.63% (3.3761 => 3.5324, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.42% (6.2275 => 6.5026, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.25% (4.9453 => 5.1553, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.07% (4.9469 => 5.1480, std.dev.: 0.0135) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.91% (0.2887 => 0.3000, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 3.87% (14.0064 => 14.5489, std.dev.: 0.0272) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.93% (1.2337 => 1.2698, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.84% (11.5690 => 11.8977, std.dev.: 0.0220) MultiSource/Applications/siod/siod: 2.83% (3.6643 => 3.7681, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.75% (8.2783 => 8.5057, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 2.62% (7.4933 => 7.6893, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.55% (4.8660 => 4.9901, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout/lists: 2.33% (7.3375 => 7.5084, std.dev.: 0.0165) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.87% (4.8362 => 4.9268, std.dev.: 0.0249) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.34% (1.4205 => 1.4395, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/neural/neural: 1.34% (1.0841 => 1.0986, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.29% (3.5679 => 3.6140, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.28% (2.4647 => 2.4962, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/ReedSolomon: 1.16% (8.5322 => 8.6315, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.17% (5.4641 => 4.3071, std.dev.: 0.0131) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.28% (1.0512 => 0.9326, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: -10.92% (1.1216 => 0.9991, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -9.96% (7.2130 => 6.4945, std.dev.: 0.0854) MultiSource/Benchmarks/mafft/pairlocalalign: -8.56% (63.1822 => 57.7763, std.dev.: 0.0657) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.04% (0.3269 => 0.3039, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.87% (4.7482 => 4.4218, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.08% (3.7148 => 3.4891, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.92% (5.4972 => 5.1715, std.dev.: 0.0218) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.25% (5.1557 => 4.8851, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.55% (4.7449 => 4.5290, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.06% (2.8773 => 2.7606, std.dev.: 0.0400) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.78% (6.0224 => 5.7945, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.12% (2.4490 => 2.3726, std.dev.: 0.0116) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (28.5821 => 27.6936, std.dev.: 0.0177) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.10% (0.5807 => 0.5627, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.87% (2.6356 => 2.5599, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.49% (9.9065 => 9.6598, std.dev.: 0.0687) MultiSource/Applications/aha/aha: -2.38% (3.3398 => 3.2603, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: -2.23% (3.4237 => 3.3473, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/bisort/bisort: -2.19% (0.6636 => 0.6491, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.16% (11.5316 => 11.2830, std.dev.: 0.0099) MultiSource/Benchmarks/FreeBench/mason/mason: -1.90% (0.5415 => 0.5312, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.59% (4.9994 => 4.9197, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.37% (3.2169 => 3.1729, std.dev.: 0.0123) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.36% (2.3487 => 2.3167, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.35% (5.6343 => 5.5580, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.02% (4.2466 => 4.2033, std.dev.: 0.0063) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.76% (16.4461 => 16.7349, std.dev.: 0.1592) MultiSource/Applications/obsequi/Obsequi: 4.03% (1.0262 => 1.0676, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6855.17% (0.3123 => 21.7210, std.dev.: 0.2912) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.01% (0.2463 => 0.3670, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: 1.03% (0.6010 => 0.6072, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.24% (0.3266 => 0.3339, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: 1.88% (0.1969 => 0.2006, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 10.57% (0.0123 => 0.0136, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0254 => 0.0254, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.02% (0.1438 => 0.1467, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.62% (1.1329 => 1.1512, std.dev.: 0.0078) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.30% (0.1462 => 0.1443, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.25% (0.4164 => 0.4216, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.75% (0.1369 => 0.1434, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.09% (0.0641 => 0.0648, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.15% (0.0195 => 0.0207, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.35% (0.0578 => 0.0576, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.99% (1.1437 => 1.1893, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.50% (0.0627 => 0.0580, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.78% (0.0180 => 0.0175, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.93% (0.8017 => 0.7862, std.dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -17.74% (0.0062 => 0.0051, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 09:51:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 11:51:49 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121112175149.2F6482A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5792?compare_to=5789&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5792, Order: 167731, Start Time: 2012-11-12 16:27:12, End Time: 2012-11-12 17:52:05 To: 5789, Order: 167726, Start Time: 2012-11-12 14:39:16, End Time: 2012-11-12 16:04:12 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (180 on baseline) Unchanged Tests: 1042 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.25% (1.2783 => 1.3710, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.77% (2.0478 => 2.1045, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/salsa20: 2.71% (7.4937 => 7.6969, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 1.99% (3.1932 => 3.2569, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.67% (0.3821 => 0.3528, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -7.20% (2.4924 => 2.3130, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -6.76% (0.3357 => 0.3130, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.71% (0.2428 => 0.2265, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.56% (0.3142 => 0.2936, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.40% (3.5339 => 3.3077, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.31% (0.3658 => 0.3427, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -6.25% (7.0961 => 6.6527, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.21% (0.9852 => 0.9240, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.20% (1.0544 => 0.9890, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: -6.18% (16.1920 => 15.1915, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/ReedSolomon: -6.17% (0.1879 => 0.1763, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -6.16% (9.2283 => 8.6597, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-2: -6.16% (0.3831 => 0.3595) MultiSource/Benchmarks/Prolangs-C/football/football: -6.16% (0.9179 => 0.8614, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.14% (22.4056 => 21.0303, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-3: -6.13% (0.3848 => 0.3612, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.11% (0.3812 => 0.3579, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.11% (0.3880 => 0.3643, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.10% (0.4033 => 0.3787, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: -6.09% (1.2515 => 1.1753, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/synchronized: -6.08% (0.3896 => 0.3659, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.08% (1.3722 => 1.2888, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.07% (0.1796 => 0.1687, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -6.05% (1.1450 => 1.0757, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.04% (0.3891 => 0.3656, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.02% (0.3884 => 0.3650, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -6.02% (0.2160 => 0.2030, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.02% (0.9542 => 0.8968, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.99% (1.4642 => 1.3765, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions: -5.99% (0.4176 => 0.3926, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -5.98% (4.3330 => 4.0737, std.dev.: 0.0094) SingleSource/Benchmarks/McGill/chomp: -5.96% (0.1761 => 0.1656, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.90% (0.2695 => 0.2536, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.89% (0.6484 => 0.6102, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.89% (0.7198 => 0.6774, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.87% (4.8802 => 4.5935, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.85% (1.2784 => 1.2036, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/property: -5.83% (0.4199 => 0.3954, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.83% (4.8161 => 4.5352, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: -5.83% (0.2985 => 0.2811, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: -5.83% (1.1530 => 1.0858, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.82% (0.5857 => 0.5516, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.82% (0.2355 => 0.2218, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.80% (0.6293 => 0.5928, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.80% (0.6052 => 0.5701, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.79% (4.0323 => 3.7989, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.79% (0.6395 => 0.6025, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.78% (0.5863 => 0.5524, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -5.78% (17.1032 => 16.1153, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.77% (0.7919 => 0.7462, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.77% (4.5069 => 4.2469, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -5.75% (0.3406 => 0.3210, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.75% (1.2300 => 1.1593, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.74% (0.7339 => 0.6918, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.73% (0.5859 => 0.5523, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.73% (1.6364 => 1.5426, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.73% (0.2548 => 0.2402, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.73% (0.7524 => 0.7093, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.72% (0.5591 => 0.5271, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.67% (0.5802 => 0.5473, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.66% (14.2083 => 13.4038, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.66% (0.5705 => 0.5382, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.66% (0.5849 => 0.5518, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.66% (0.5478 => 0.5168, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.65% (0.6304 => 0.5948, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.63% (0.5805 => 0.5478, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -5.63% (0.7447 => 0.7028, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.62% (0.5999 => 0.5662, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.61% (6.7716 => 6.3914, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -5.59% (15.5079 => 14.6415, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/parameter-passing: -5.58% (0.4280 => 0.4041, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.58% (0.6667 => 0.6295, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.57% (0.6230 => 0.5883, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: -5.57% (0.2659 => 0.2511, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.56% (0.8521 => 0.8047, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.55% (0.6736 => 0.6362, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.55% (0.6395 => 0.6040, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.55% (0.5569 => 0.5260, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.54% (0.3483 => 0.3290, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.52% (0.6446 => 0.6090, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.52% (1.6474 => 1.5565, std.dev.: 0.0169) MultiSource/Applications/lua/lua: -5.52% (4.0594 => 3.8355, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.51% (0.5567 => 0.5260, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.51% (0.6676 => 0.6308, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.51% (0.6260 => 0.5915, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.51% (0.5575 => 0.5268, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.50% (0.5925 => 0.5599, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -5.50% (0.3581 => 0.3384, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -5.50% (2.4021 => 2.2701, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: -5.46% (1.3864 => 1.3107, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.46% (0.6194 => 0.5856, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.45% (0.6033 => 0.5704, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.43% (0.6189 => 0.5853, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.42% (0.6297 => 0.5956, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.40% (0.5570 => 0.5269, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.40% (0.5941 => 0.5620, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.40% (0.5168 => 0.4889, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: -5.40% (3.5154 => 3.3257, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.39% (0.4916 => 0.4651, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.39% (0.6660 => 0.6301, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.39% (0.5456 => 0.5162, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -5.38% (0.4515 => 0.4272, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.38% (1.2210 => 1.1553, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.38% (0.5581 => 0.5281, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.37% (0.6681 => 0.6322, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.36% (0.2278 => 0.2156, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.35% (0.4151 => 0.3929, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.35% (0.5329 => 0.5044, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -5.33% (0.4861 => 0.4602, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.30% (0.6440 => 0.6099, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.28% (0.2385 => 0.2259, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.28% (1.2221 => 1.1576, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.26% (0.5688 => 0.5389, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.24% (0.7021 => 0.6653, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.23% (8.0126 => 7.5934, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.22% (2.2587 => 2.1407, std.dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: -5.19% (1.3148 => 1.2465, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/except: -5.16% (0.3026 => 0.2870, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.15% (5.4682 => 5.1868, std.dev.: 0.0161) MultiSource/Applications/treecc/treecc: -5.14% (2.1401 => 2.0301, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.14% (0.9557 => 0.9066, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.13% (0.3255 => 0.3088, std.dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.12% (0.3319 => 0.3149, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.11% (0.3931 => 0.3730, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.11% (0.3016 => 0.2862, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.10% (0.3491 => 0.3313, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -5.09% (34.0927 => 32.3572, std.dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: -5.06% (15.2527 => 14.4802, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ary3: -5.05% (0.3446 => 0.3272, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.03% (0.3837 => 0.3644, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: -5.02% (0.4524 => 0.4297, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: -4.99% (0.3025 => 0.2874, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -4.98% (0.3394 => 0.3225, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.97% (2.1713 => 2.0633, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/lists1: -4.97% (0.3867 => 0.3675, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.95% (0.4427 => 0.4208, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -4.94% (18.2933 => 17.3900, std.dev.: 0.0081) MultiSource/Applications/oggenc/oggenc: -4.94% (5.0226 => 4.7746, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: -4.90% (0.7982 => 0.7591, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: -4.90% (0.4248 => 0.4040, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -4.89% (0.3271 => 0.3111, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -4.83% (0.3621 => 0.3446, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: -4.79% (0.3194 => 0.3041, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -4.78% (0.3788 => 0.3607, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.78% (0.4083 => 0.3888, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -4.77% (0.7779 => 0.7408, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.77% (0.3252 => 0.3097, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -4.75% (0.2989 => 0.2847, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.75% (0.2106 => 0.2006, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.74% (0.3057 => 0.2912, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -4.74% (0.3059 => 0.2914, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -4.71% (0.3481 => 0.3317, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.67% (0.2999 => 0.2859, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -4.66% (0.8418 => 0.8026, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: -4.65% (0.6750 => 0.6436, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.63% (0.4813 => 0.4590, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: -4.63% (0.2871 => 0.2738, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -4.63% (0.2939 => 0.2803, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.62% (0.3849 => 0.3671, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.62% (0.2903 => 0.2769, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -4.53% (0.2849 => 0.2720, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.40% (0.2933 => 0.2804, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -4.31% (0.3205 => 0.3067, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.24% (0.3323 => 0.3182, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: -4.21% (0.6347 => 0.6080, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.03% (0.9077 => 0.8711, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -3.90% (0.6441 => 0.6190, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -3.40% (1.5610 => 1.5080, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.57% (20.7746 => 20.2411, std.dev.: 0.0525) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7574, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: -8.63% (1.2842 => 1.1734, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.85% (2.2633 => 2.1762, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.63% (1.3096 => 1.2751, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4718, std.dev.: 0.0002) Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 12:39:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 14:39:26 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121112203926.AA0392A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5793?compare_to=5791&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5793, Order: 167734, Start Time: 2012-11-12 19:12:00, End Time: 2012-11-12 20:39:42 To: 5791, Order: 167731, Start Time: 2012-11-12 16:12:46, End Time: 2012-11-12 17:38:29 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 13 (84 on baseline) Performance Improvements: 5 (25 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 973 (865 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.09% (0.8468 => 0.8730, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.61% (0.9082 => 0.9319, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.38% (0.8107 => 0.8300, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.23% (0.8482 => 0.8671, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.22% (0.8428 => 0.8615, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.17% (0.8313 => 0.8493, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.02% (0.8400 => 0.8570, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.93% (0.8964 => 0.9137, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.86% (0.8882 => 0.9047, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 5.88% (20.6797 => 21.8961, std.dev.: 0.2127) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.18% (0.3300 => 0.3471, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.91% (4.5388 => 4.6255, std.dev.: 0.0218) SingleSource/Benchmarks/Misc/ffbench: 1.64% (1.3907 => 1.4135, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.18% (7.3334 => 6.8799, std.dev.: 0.0842) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.43% (6.4945 => 6.2066, std.dev.: 0.1060) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.52% (1.3974 => 1.3622, std.dev.: 0.0136) MultiSource/Benchmarks/PAQ8p/paq8p: -1.10% (92.0574 => 91.0451, std.dev.: 0.3840) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.06% (2.4712 => 2.4449, std.dev.: 0.0097) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.15% (16.7349 => 16.7604, std.dev.: 0.3461) MultiSource/Applications/obsequi/Obsequi: -0.86% (1.0676 => 1.0584, std.dev.: 0.0251) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.92% (21.7210 => 21.9207, std.dev.: 0.4270) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.35% (0.3670 => 0.3683, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -0.15% (0.6072 => 0.6063, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.24% (0.3339 => 0.3347, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/strcat: 1.35% (0.2006 => 0.2033, std.dev.: 0.0068) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 60.29% (0.0136 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.71% (0.0424 => 0.0427, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.64% (0.0312 => 0.0314, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.24% (0.0423 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0202 => 0.0202, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 0.46% (0.0216 => 0.0217, std.dev.: 0.0046) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.61% (0.1467 => 0.1476, std.dev.: 0.0053) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 3.44% (1.1512 => 1.1908, std.dev.: 0.0325) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.08% (0.1443 => 0.1473, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.49% (0.4216 => 0.4153, std.dev.: 0.0213) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.16% (0.1434 => 0.1403, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.86% (0.0648 => 0.0610, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 33.82% (0.0207 => 0.0277, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.52% (0.0576 => 0.0579, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.44% (1.1893 => 1.1945, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 138.46% (0.0013 => 0.0031, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2300.00% (0.0001 => 0.0024, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.07% (0.0580 => 0.0650, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 53.14% (0.0175 => 0.0268, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.69% (0.7862 => 0.7808, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -23.53% (0.0051 => 0.0039, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2319.69% (0.6332 => 15.3215, std.dev.: 0.2126) MultiSource/Benchmarks/McCat/08-main/main: 48.06% (0.1831 => 0.2711, std.dev.: 0.0249) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.39% (0.1559 => 0.1475, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1509.24% (0.3344 => 5.3813, std.dev.: 0.0552) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.61% (0.2364 => 0.3253, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: 2.56% (0.0429 => 0.0440, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.70% (0.0224 => 0.0239, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -27.83% (0.0230 => 0.0166, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4459, std.dev.: 0.0110) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0689, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4875, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3425, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1296, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4041, std.dev.: 0.0052) SingleSource/Regression/C/uint64_to_float: -23.96% (2.1832 => 1.6601, std.dev.: 0.0092) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.90% (0.0810 => 0.0955, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.01% (0.2998 => 0.3268, std.dev.: 0.0080) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.80% (0.8321 => 0.9053, std.dev.: 0.0242) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.67% (0.6010 => 0.6531, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/health/health: 8.24% (0.1347 => 0.1458, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.14% (0.8148 => 0.8730, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.83% (0.3295 => 0.3520, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.51% (0.1905 => 0.2029, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.60% (0.2519 => 0.2660, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.52% (0.1885 => 0.1989, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.25% (1.4479 => 1.5239, std.dev.: 0.0142) MultiSource/Applications/spiff/spiff: 5.19% (0.7950 => 0.8363, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.12% (0.5961 => 0.6266, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4.97% (0.8317 => 0.8730, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.80% (0.3003 => 0.3147, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: 4.75% (1.2222 => 1.2803, std.dev.: 0.0200) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.72% (0.2774 => 0.2905, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.55% (0.8611 => 0.9003, std.dev.: 0.0101) MultiSource/Applications/hbd/hbd: 4.37% (1.4269 => 1.4893, std.dev.: 0.0173) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.26% (0.6227 => 0.6492, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.19% (0.7966 => 0.8300, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.13% (1.6386 => 1.7062, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.08% (0.8331 => 0.8671, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.02% (0.8697 => 0.9047, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.97% (0.8286 => 0.8615, std.dev.: 0.0049) MultiSource/Applications/treecc/treecc: 3.90% (1.9948 => 2.0725, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.86% (0.8177 => 0.8493, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.77% (0.8805 => 0.9137, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.74% (0.8261 => 0.8570, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.60% (0.8995 => 0.9319, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.43% (0.8518 => 0.8810, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.17% (4.1763 => 4.3088, std.dev.: 0.0310) MultiSource/Applications/SPASS/SPASS: 3.08% (14.2605 => 14.6994, std.dev.: 0.0827) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.94% (0.8204 => 0.8445, std.dev.: 0.0065) MultiSource/Applications/lua/lua: 2.88% (3.8189 => 3.9290, std.dev.: 0.0308) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.85% (0.4559 => 0.4689, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.84% (0.9074 => 0.9332, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.83% (0.8086 => 0.8315, std.dev.: 0.0075) MultiSource/Applications/siod/siod: 2.74% (2.2184 => 2.2791, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.73% (0.8420 => 0.8650, std.dev.: 0.0079) MultiSource/Benchmarks/nbench/nbench: 2.59% (1.1271 => 1.1563, std.dev.: 0.0106) MultiSource/Benchmarks/mafft/pairlocalalign: 2.53% (8.6247 => 8.8426, std.dev.: 0.0790) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.52% (6.6074 => 6.7740, std.dev.: 0.0544) MultiSource/Applications/JM/ldecod/ldecod: 2.43% (6.7320 => 6.8955, std.dev.: 0.0466) MultiSource/Applications/hexxagon/hexxagon: 2.43% (0.9810 => 1.0048, std.dev.: 0.0088) MultiSource/Applications/d/make_dparser: 2.33% (3.2366 => 3.3120, std.dev.: 0.0138) MultiSource/Applications/ClamAV/clamscan: 2.30% (14.7684 => 15.1085, std.dev.: 0.0948) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.19% (13.1811 => 13.4693, std.dev.: 0.0797) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.12% (0.8340 => 0.8517, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: 1.90% (1.0945 => 1.1153, std.dev.: 0.0062) MultiSource/Benchmarks/PAQ8p/paq8p: 1.81% (2.3764 => 2.4194, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.31% (1.5315 => 1.5515, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 103.02% (0.0199 => 0.0404, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/pi: 58.52% (1.5795 => 2.5038, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 19.70% (0.0528 => 0.0632, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.51% (2.9753 => 3.4664, std.dev.: 0.1025) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.55% (2.7995 => 3.2069, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.57% (5.0261 => 5.6076, std.dev.: 0.0766) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.95% (0.3186 => 0.3471, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.16% (1.1857 => 1.2824, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.88% (6.3772 => 6.8799, std.dev.: 0.0842) SingleSource/Benchmarks/McGill/queens: 6.99% (1.7056 => 1.8248, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.79% (4.7794 => 5.1039, std.dev.: 0.0318) MultiSource/Applications/SIBsim4/SIBsim4: 6.62% (3.1873 => 3.3983, std.dev.: 0.0269) SingleSource/Benchmarks/Misc/richards_benchmark: 6.44% (1.3037 => 1.3877, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.08% (4.9686 => 5.2708, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.94% (4.5327 => 4.8019, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.71% (6.2275 => 6.5211, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.55% (3.3761 => 3.5296, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.36% (4.9453 => 5.1610, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.20% (4.9469 => 5.1545, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 3.94% (14.0064 => 14.5586, std.dev.: 0.0207) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.46% (0.3587 => 0.3711, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 2.78% (3.6643 => 3.7660, std.dev.: 0.0282) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.73% (4.8660 => 4.9990, std.dev.: 0.0068) MultiSource/Applications/lambda-0_1_3/lambda: 2.72% (7.4933 => 7.6968, std.dev.: 0.0346) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.62% (11.5690 => 11.8721, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.50% (8.2783 => 8.4850, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout/lists: 2.29% (7.3375 => 7.5058, std.dev.: 0.0365) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.79% (4.8362 => 4.9227, std.dev.: 0.0188) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.55% (4.5547 => 4.6255, std.dev.: 0.0218) SingleSource/Benchmarks/Misc/ReedSolomon: 1.38% (8.5322 => 8.6500, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/neural/neural: 1.29% (1.0841 => 1.0981, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.24% (3.5679 => 3.6123, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.00% (5.4641 => 4.3164, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.95% (7.2130 => 6.2066, std.dev.: 0.1060) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.73% (1.0512 => 0.9384, std.dev.: 0.0082) SingleSource/Benchmarks/McGill/chomp: -10.57% (1.1216 => 1.0031, std.dev.: 0.0079) MultiSource/Benchmarks/mafft/pairlocalalign: -8.43% (63.1822 => 57.8541, std.dev.: 0.0331) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.80% (4.7482 => 4.4252, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.33% (0.3269 => 0.3062, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.81% (3.7148 => 3.4991, std.dev.: 0.0301) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.79% (5.4972 => 5.1789, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.95% (5.1557 => 4.9006, std.dev.: 0.0255) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.42% (4.7449 => 4.5354, std.dev.: 0.0290) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.94% (2.4490 => 2.3526, std.dev.: 0.0258) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.56% (0.5807 => 0.5600, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.51% (6.0224 => 5.8109, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.07% (28.5821 => 27.7038, std.dev.: 0.0839) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.82% (2.6356 => 2.5613, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/hash2: -2.30% (3.4237 => 3.3448, std.dev.: 0.0041) MultiSource/Applications/aha/aha: -2.18% (3.3398 => 3.2670, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.02% (9.9065 => 9.7068, std.dev.: 0.0567) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.86% (11.5316 => 11.3169, std.dev.: 0.0225) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.63% (2.3487 => 2.3103, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.46% (4.9994 => 4.9263, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.20% (5.6343 => 5.5666, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/ffbench: -1.13% (1.4296 => 1.4135, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.06% (3.2169 => 3.1829, std.dev.: 0.0019) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.91% (16.4461 => 16.7604, std.dev.: 0.3461) MultiSource/Applications/obsequi/Obsequi: 3.14% (1.0262 => 1.0584, std.dev.: 0.0251) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6919.12% (0.3123 => 21.9207, std.dev.: 0.4270) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.53% (0.2463 => 0.3683, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 0.88% (0.6010 => 0.6063, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.48% (0.3266 => 0.3347, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/strcat: 3.25% (0.1969 => 0.2033, std.dev.: 0.0068) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0046) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.64% (0.1438 => 0.1476, std.dev.: 0.0053) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 5.11% (1.1329 => 1.1908, std.dev.: 0.0325) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.75% (0.1462 => 0.1473, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.26% (0.4164 => 0.4153, std.dev.: 0.0213) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.48% (0.1369 => 0.1403, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.84% (0.0641 => 0.0610, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.17% (0.0578 => 0.0579, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.44% (1.1437 => 1.1945, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 71.43% (0.0014 => 0.0024, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.67% (0.0627 => 0.0650, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.89% (0.0180 => 0.0268, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.61% (0.8017 => 0.7808, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -37.10% (0.0062 => 0.0039, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 12:42:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 14:42:47 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121112204247.8A1672A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5794?compare_to=5792&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5794, Order: 167734, Start Time: 2012-11-12 19:17:55, End Time: 2012-11-12 20:43:02 To: 5792, Order: 167731, Start Time: 2012-11-12 16:27:12, End Time: 2012-11-12 17:52:05 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (182 on baseline) Unchanged Tests: 1041 (855 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.27% (54.4122 => 56.1909, std.dev.: 0.2198) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.96% (54.5751 => 56.1909, std.dev.: 0.2198) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.71% (2.0478 => 2.1032, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4937 => 7.6767, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash2: 2.23% (3.1932 => 3.2644, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.46% (0.3821 => 0.3536, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -7.20% (2.4924 => 2.3130, std.dev.: 0.0072) MultiSource/Applications/sgefa/sgefa: -6.76% (0.3357 => 0.3130, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.75% (0.2428 => 0.2264, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.43% (0.3142 => 0.2940, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.42% (3.5339 => 3.3070, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.31% (0.6484 => 0.6075, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: -6.24% (16.1920 => 15.1823, std.dev.: 0.0121) MultiSource/Applications/JM/ldecod/ldecod: -6.23% (7.0961 => 6.6537, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.19% (1.0544 => 0.9891, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.18% (0.9852 => 0.9243, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.18% (0.3658 => 0.3432, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.18% (0.1716 => 0.1610, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -6.17% (0.1879 => 0.1763, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -6.14% (9.2283 => 8.6619, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-2: -6.13% (0.3831 => 0.3596, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.13% (0.3880 => 0.3642, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.12% (22.4056 => 21.0333, std.dev.: 0.0247) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.12% (0.1796 => 0.1686, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -6.11% (0.3812 => 0.3579, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -6.11% (0.9179 => 0.8618, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.09% (1.3722 => 1.2886, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: -6.05% (1.2515 => 1.1758, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -6.04% (1.1450 => 1.0758, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: -6.03% (0.3896 => 0.3661, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.03% (0.3848 => 0.3616, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.01% (0.3891 => 0.3657, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.00% (0.4033 => 0.3791, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.99% (0.9542 => 0.8970, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: -5.99% (4.3330 => 4.0733, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: -5.96% (0.1761 => 0.1656, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -5.93% (0.2160 => 0.2032, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.92% (0.7198 => 0.6772, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: -5.91% (0.4176 => 0.3929, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.90% (1.2300 => 1.1574, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.90% (1.4642 => 1.3778, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.90% (0.2695 => 0.2536, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.90% (0.3884 => 0.3655, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.87% (0.5857 => 0.5513, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.87% (0.7919 => 0.7454, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.86% (4.8802 => 4.5942, std.dev.: 0.0179) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.86% (0.2355 => 0.2217, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.85% (4.8161 => 4.5345, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.83% (0.8521 => 0.8024, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/property: -5.81% (0.4199 => 0.3955, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.80% (0.5863 => 0.5523, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.79% (0.7339 => 0.6914, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.79% (1.6364 => 1.5417, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.78% (0.6052 => 0.5702, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.76% (0.6736 => 0.6348, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.76% (1.2784 => 1.2048, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.75% (0.6395 => 0.6027, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.74% (4.0323 => 3.8009, std.dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: -5.73% (1.1530 => 1.0869, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.73% (0.3406 => 0.3211, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.72% (0.5802 => 0.5470, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -5.71% (17.1032 => 16.1265, std.dev.: 0.0281) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.70% (0.7524 => 0.7095, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.69% (4.5069 => 4.2503, std.dev.: 0.0111) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.69% (0.2548 => 0.2403, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.68% (0.6667 => 0.6288, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.68% (0.5859 => 0.5526, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: -5.68% (0.2659 => 0.2508, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.68% (0.5478 => 0.5167, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.68% (0.5849 => 0.5517, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.67% (0.5591 => 0.5274, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.66% (0.3483 => 0.3286, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.65% (0.6446 => 0.6082, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.63% (0.6304 => 0.5949, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/parameter-passing: -5.63% (0.4280 => 0.4039, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.62% (14.2083 => 13.4092, std.dev.: 0.0221) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.60% (6.7716 => 6.3924, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.58% (0.5805 => 0.5481, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -5.58% (15.5079 => 14.6427, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.57% (1.6474 => 1.5557, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: -5.56% (1.3864 => 1.3093, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.55% (0.6230 => 0.5884, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.54% (0.6260 => 0.5913, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: -5.53% (0.3581 => 0.3383, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.52% (0.5925 => 0.5598, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.51% (0.6676 => 0.6308, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.50% (0.6395 => 0.6043, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.50% (0.5705 => 0.5391, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.49% (0.5569 => 0.5263, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.49% (0.5575 => 0.5269, std.dev.: 0.0007) MultiSource/Applications/lua/lua: -5.48% (4.0594 => 3.8371, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.47% (0.5999 => 0.5671, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.47% (0.6660 => 0.6296, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.46% (0.6189 => 0.5851, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.45% (0.6293 => 0.5950, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.44% (0.5567 => 0.5264, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.44% (0.6194 => 0.5857, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.44% (0.5941 => 0.5618, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.44% (0.2999 => 0.2836, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.43% (0.4916 => 0.4649, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: -5.43% (3.5154 => 3.3246, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.43% (0.5456 => 0.5160, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.42% (0.6033 => 0.5706, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.42% (0.6297 => 0.5956, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.40% (0.4151 => 0.3927, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.37% (0.5570 => 0.5271, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.34% (0.5168 => 0.4892, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -5.33% (2.4021 => 2.2740, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.31% (0.2278 => 0.2157, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.31% (0.5688 => 0.5386, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.30% (0.5581 => 0.5285, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -5.29% (0.4515 => 0.4276, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.27% (0.5329 => 0.5048, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.27% (2.2587 => 2.1396, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.26% (1.2210 => 1.1568, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -5.23% (0.2985 => 0.2829, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.21% (0.3319 => 0.3146, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.20% (8.0126 => 7.5960, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.20% (0.2385 => 0.2261, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: -5.20% (0.7447 => 0.7060, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -5.18% (0.4861 => 0.4609, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.18% (1.3148 => 1.2467, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.17% (0.6440 => 0.6107, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.16% (0.3931 => 0.3728, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.14% (0.7021 => 0.6660, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.14% (5.4682 => 5.1874, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.13% (0.3837 => 0.3640, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.13% (1.2221 => 1.1594, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/strcat: -5.12% (0.2989 => 0.2836, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.11% (0.9557 => 0.9069, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -5.10% (34.0927 => 32.3532, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.07% (0.3491 => 0.3314, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.07% (0.3255 => 0.3090, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -5.06% (0.3026 => 0.2873, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.06% (0.3323 => 0.3155, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.04% (0.6681 => 0.6344, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -5.04% (15.2527 => 14.4839, std.dev.: 0.0124) MultiSource/Applications/treecc/treecc: -5.02% (2.1401 => 2.0326, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.01% (2.1713 => 2.0626, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.97% (0.3016 => 0.2866, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -4.97% (0.4248 => 0.4037, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -4.96% (5.0226 => 4.7736, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/lists: -4.94% (0.3621 => 0.3442, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: -4.93% (0.3446 => 0.3276, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -4.93% (0.3025 => 0.2876, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.92% (0.4427 => 0.4209, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary: -4.92% (0.3394 => 0.3227, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.89% (0.2106 => 0.2003, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: -4.89% (0.3867 => 0.3678, std.dev.: 0.0046) MultiSource/Applications/kimwitu++/kc: -4.85% (18.2933 => 17.4067, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: -4.80% (0.3271 => 0.3114, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -4.80% (0.7982 => 0.7599, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -4.77% (0.3481 => 0.3315, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.74% (0.3057 => 0.2912, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.73% (0.4083 => 0.3890, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -4.70% (0.3788 => 0.3610, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.69% (0.8418 => 0.8023, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: -4.68% (0.6750 => 0.6434, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.67% (0.3252 => 0.3100, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -4.67% (0.7779 => 0.7416, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -4.66% (0.3194 => 0.3045, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -4.66% (0.2939 => 0.2802, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: -4.63% (0.2871 => 0.2738, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.62% (0.3849 => 0.3671, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.62% (0.2903 => 0.2769, std.dev.: 0.0049) SingleSource/Regression/C++/ofstream_ctor: -4.61% (0.3059 => 0.2918, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.60% (0.2933 => 0.2798, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -4.56% (0.3205 => 0.3059, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: -4.53% (0.2849 => 0.2720, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: -4.51% (0.4524 => 0.4320, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.46% (0.9077 => 0.8672, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.40% (0.4813 => 0.4601, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.35% (0.4321 => 0.4133, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: -4.25% (0.6347 => 0.6077, std.dev.: 0.0071) SingleSource/UnitTests/ObjC++/property-reference-object: -3.85% (0.6441 => 0.6193, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -3.54% (1.5610 => 1.5057, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -2.49% (20.7746 => 20.2573, std.dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7526, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1733, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.99% (2.2633 => 2.1729, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.15% (1.3096 => 1.2814, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.69% (6.5735 => 6.4622, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0011) Report Time: 2.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 13:33:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 15:33:34 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121112213334.ECA532A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5795?compare_to=5790&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5795, Order: 167731, Start Time: 2012-11-12 18:18:19, End Time: 2012-11-12 21:33:48 To: 5790, Order: 167723, Start Time: 2012-11-12 14:14:55, End Time: 2012-11-12 17:30:11 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (176 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (715 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.05% (0.3765 => 0.3880, std.dev.: 0.0019) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.88% (0.0625 => 0.0893, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.49% (0.1063 => 0.1419, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.76% (0.1106 => 0.1402, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.68% (0.2969 => 0.3761, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 25.86% (1.5932 => 2.0052, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.72% (0.4253 => 0.5347, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.49% (0.0714 => 0.0896) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.25% (0.4139 => 0.5184, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.45% (0.4994 => 0.6215, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.00% (0.0475 => 0.0589, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.98% (0.5000 => 0.6199, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.97% (0.5900 => 0.7314, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.63% (0.0584 => 0.0722, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.40% (0.0547 => 0.0675, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.85% (0.0897 => 0.1102, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.62% (0.1021 => 0.1252, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.59% (0.1620 => 0.1986, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 22.54% (0.0599 => 0.0734, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.49% (0.1107 => 0.1356, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 21.31% (0.0948 => 0.1150, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.07% (0.0541 => 0.0655, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.06% (0.0584 => 0.0707) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.03% (0.1103 => 0.1335, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.03% (0.0642 => 0.0777) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.01% (0.0633 => 0.0766, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.01% (0.0495 => 0.0599, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.96% (0.3903 => 0.4721, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: 20.83% (0.0821 => 0.0992, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.74% (0.1003 => 0.1211, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.44% (0.0822 => 0.0990, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.40% (0.1549 => 0.1865, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 20.38% (0.1619 => 0.1949, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 20.36% (0.0604 => 0.0727, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.32% (0.1604 => 0.1930, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 19.68% (0.0808 => 0.0967, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 19.43% (0.0947 => 0.1131, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.36% (0.1462 => 0.1745, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.28% (0.3890 => 0.4640, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.02% (0.2014 => 0.2397, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 18.80% (0.1218 => 0.1447, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.36% (1.3152 => 1.5567, std.dev.: 0.0042) MultiSource/Applications/spiff/spiff: 18.34% (0.4029 => 0.4768, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/mst/mst: 18.34% (0.0698 => 0.0826, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 18.33% (0.5826 => 0.6894, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 18.29% (0.5889 => 0.6966, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.20% (0.2736 => 0.3234, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.20% (0.1088 => 0.1286, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 18.14% (0.1505 => 0.1778, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 18.07% (0.0581 => 0.0686, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.02% (0.0605 => 0.0714, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.90% (0.2866 => 0.3379, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.73% (0.3271 => 0.3851, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.66% (0.0572 => 0.0673, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.64% (3.5627 => 4.1912, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.63% (0.0573 => 0.0674, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.58% (0.1968 => 0.2314, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 17.45% (0.5546 => 0.6514, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.41% (0.4658 => 0.5469, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 17.39% (1.8794 => 2.2062, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.35% (1.6211 => 1.9023, std.dev.: 0.0026) MultiSource/Applications/hbd/hbd: 17.16% (0.9697 => 1.1361, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.11% (0.5026 => 0.5886, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.94% (0.2875 => 0.3362, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.90% (0.1160 => 0.1356, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 16.86% (1.0781 => 1.2599, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 16.82% (0.1421 => 0.1660, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.81% (0.4361 => 0.5094, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.72% (0.3930 => 0.4587, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: 16.36% (0.1284 => 0.1494, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.35% (2.7292 => 3.1753, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.27% (4.4195 => 5.1387, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 16.26% (4.2109 => 4.8956, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/strcat: 16.25% (0.2750 => 0.3197, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 16.25% (0.2714 => 0.3155, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.22% (0.2738 => 0.3182, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 16.14% (0.2813 => 0.3267, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 16.11% (0.2725 => 0.3164, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 16.08% (0.2823 => 0.3277, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.05% (0.2729 => 0.3167, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 16.02% (0.7171 => 0.8320, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 15.97% (0.2780 => 0.3224, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 15.84% (0.2803 => 0.3247, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.78% (0.1090 => 0.1262, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.72% (1.9694 => 2.2789, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.70% (0.2911 => 0.3368, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 15.68% (0.9909 => 1.1463, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.68% (0.3195 => 0.3696, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.68% (2.0673 => 2.3914, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 15.67% (0.3096 => 0.3581, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 15.65% (0.2811 => 0.3251, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.63% (1.9966 => 2.3086, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 15.61% (0.3004 => 0.3473, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 15.60% (23.5202 => 27.1891, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.58% (0.2792 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 15.42% (0.2075 => 0.2395, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 15.21% (0.3267 => 0.3764, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 15.10% (0.3258 => 0.3750, std.dev.: 0.0114) MultiSource/Benchmarks/nbench/nbench: 15.00% (0.2566 => 0.2951, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.99% (0.3362 => 0.3866, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.74% (0.3060 => 0.3511, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 14.65% (0.3317 => 0.3803, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.50% (0.3124 => 0.3577, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 14.49% (0.3678 => 0.4211, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 14.48% (1.4269 => 1.6335, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 14.41% (0.3477 => 0.3978, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.38% (0.3282 => 0.3754, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 14.34% (0.3348 => 0.3828, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 14.18% (0.7875 => 0.8992, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 14.12% (0.3726 => 0.4252, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 14.04% (0.3496 => 0.3987, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 13.98% (0.0758 => 0.0864, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.97% (0.2040 => 0.2325, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.94% (0.3465 => 0.3948, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.93% (0.3488 => 0.3974, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.93% (0.3460 => 0.3942, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 13.93% (0.4251 => 0.4843, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.90% (0.3690 => 0.4203, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 13.89% (2.1653 => 2.4661, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/trivial-interface: 13.89% (0.3442 => 0.3920, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.84% (0.3446 => 0.3923, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.84% (0.3845 => 0.4377, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.82% (0.3625 => 0.4126, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 13.78% (0.3469 => 0.3947, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 13.77% (0.4146 => 0.4717, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 13.66% (2.1013 => 2.3884, std.dev.: 0.0084) SingleSource/UnitTests/ObjC/property: 13.62% (0.3650 => 0.4147, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.61% (0.3981 => 0.4523, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 13.61% (4.6177 => 5.2462, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 13.56% (0.2691 => 0.3056, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 13.48% (0.3724 => 0.4226, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.48% (0.3643 => 0.4134, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 13.07% (0.5012 => 0.5667, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 12.64% (5.5417 => 6.2419, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.58% (0.1383 => 0.1557, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.07% (0.6435 => 0.7212, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 11.69% (0.3498 => 0.3907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.58% (0.1028 => 0.1147, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.27% (0.2068 => 0.2301, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.25% (0.2737 => 0.3045, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 11.20% (0.4847 => 0.5390, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 11.03% (0.6634 => 0.7366, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.86% (0.3084 => 0.3419, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 10.78% (2.0346 => 2.2539, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 10.50% (0.2391 => 0.2642, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 10.49% (0.3336 => 0.3686, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.22% (0.2103 => 0.2318, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.09% (4.6926 => 5.1192, std.dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.08% (0.5361 => 0.5848, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.86% (11.6398 => 12.6716, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.54% (0.5584 => 0.6061, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.36% (0.7426 => 0.8047, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 7.06% (11.9555 => 12.7994, std.dev.: 0.0075) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.56% (0.3792 => 0.3965, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0034) MultiSource/Applications/ClamAV/clamscan: 9.96% (0.2802 => 0.3081, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6087, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.66% (0.2122 => 0.2242, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6745, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.06% (0.3693 => 0.3880, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1672, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-2: 4.40% (1.8057 => 1.8851, std.dev.: 0.0075) SingleSource/Benchmarks/Dhrystone/dry: 4.21% (14.0481 => 14.6401, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2082, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.66% (3.1722 => 3.2248, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3041, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.31% (7.1849 => 7.2793, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5918, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5639, std.dev.: 0.0225) SingleSource/Benchmarks/Shootout-C++/ary2: -9.62% (0.2402 => 0.2171, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9770, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7960, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9588, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8058, std.dev.: 0.0076) SingleSource/Benchmarks/Dhrystone/fldry: -3.13% (17.2379 => 16.6986, std.dev.: 0.0925) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0058) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8698, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5714, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4960, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.09% (105.3826 => 104.2386, std.dev.: 0.0324) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0441, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 14:24:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 16:24:09 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121112222409.AD74C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5796?compare_to=5793&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5796, Order: 167744, Start Time: 2012-11-12 20:56:42, End Time: 2012-11-12 22:24:25 To: 5793, Order: 167734, Start Time: 2012-11-12 19:12:00, End Time: 2012-11-12 20:39:42 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 7 (95 on baseline) Performance Improvements: 4 (20 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 980 (859 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.20% (1.2643 => 1.2921, std.dev.: 0.0077) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 5.94% (1.2538 => 1.3283, std.dev.: 0.0262) MultiSource/Applications/SPASS/SPASS: 4.71% (8.3884 => 8.7834, std.dev.: 0.0379) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 4.17% (44.3239 => 46.1729, std.dev.: 0.4629) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.33% (0.9996 => 1.0229, std.dev.: 0.0090) MultiSource/Benchmarks/Bullet/bullet: 1.85% (7.1627 => 7.2951, std.dev.: 0.0225) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 1.85% (0.8716 => 0.8877, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -2.67% (0.8730 => 0.8497, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.10% (0.6531 => 0.6394, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.76% (0.8671 => 0.8518, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.56% (0.8615 => 0.8481, std.dev.: 0.0047) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.31% (16.7604 => 16.7085, std.dev.: 0.2428) MultiSource/Applications/obsequi/Obsequi: 0.47% (1.0584 => 1.0634, std.dev.: 0.0124) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.82% (21.9207 => 22.5379, std.dev.: 0.3768) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.19% (0.3683 => 0.3676, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/bigfib: -0.25% (0.6063 => 0.6048, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.12% (0.3347 => 0.3343, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/strcat: 0.34% (0.2033 => 0.2040, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -25.69% (0.0218 => 0.0162, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0427 => 0.0428, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.85% (0.0330 => 0.0281, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.64% (0.0314 => 0.0312, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.94% (0.0424 => 0.0420, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0202 => 0.0202, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: -0.46% (0.0217 => 0.0216, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -23.08% (0.0013 => 0.0010, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -1.69% (0.1476 => 0.1451, std.dev.: 0.0074) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -2.65% (1.1908 => 1.1592, std.dev.: 0.0527) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: - (0.1473 => 0.1473, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.25% (0.4153 => 0.4205, std.dev.: 0.0288) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.35% (0.1403 => 0.1436, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.26% (0.0610 => 0.0636, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.36% (0.0277 => 0.0276, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.35% (0.0579 => 0.0577, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.59% (1.1945 => 1.2016, std.dev.: 0.0142) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 12.50% (0.0024 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.31% (0.0650 => 0.0648, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.19% (0.0268 => 0.0238, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.13% (0.7808 => 0.7818, std.dev.: 0.0100) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 84.62% (0.0039 => 0.0072, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2346.08% (0.6332 => 15.4886, std.dev.: 0.2083) MultiSource/Benchmarks/McCat/08-main/main: 49.48% (0.1831 => 0.2737, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.16% (0.1559 => 0.1463, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1507.12% (0.3344 => 5.3742, std.dev.: 0.0962) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.62% (0.2364 => 0.3277, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: 0.93% (0.0429 => 0.0433, std.dev.: 0.0042) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.02% (0.0224 => 0.0233, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -28.70% (0.0230 => 0.0164, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4288, std.dev.: 0.0249) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0691, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4916, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3605, std.dev.: 0.0422) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1428, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4115, std.dev.: 0.0189) SingleSource/Regression/C/uint64_to_float: -23.96% (2.1832 => 1.6601, std.dev.: 0.0079) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.30% (0.0810 => 0.0942, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.85% (0.0848 => 0.0957, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.33% (0.8321 => 0.9097, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.03% (0.2279 => 0.2462, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.87% (0.3137 => 0.3384, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.41% (0.4847 => 0.5206, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.19% (0.1905 => 0.2042, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.57% (0.2998 => 0.3195, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.39% (0.6010 => 0.6394, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.10% (0.8148 => 0.8645, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.01% (0.7473 => 0.7922, std.dev.: 0.0145) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.89% (0.1885 => 0.1996, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 5.02% (1.2222 => 1.2836, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/sieve: 4.72% (0.2755 => 0.2885, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.72% (1.1685 => 1.2236, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.57% (0.2519 => 0.2634, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.49% (0.9435 => 0.9859, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.20% (0.6287 => 0.6551, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.04% (1.6386 => 1.7048, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.82% (0.5961 => 0.6189, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.69% (0.8611 => 0.8929, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.59% (1.1170 => 1.1571, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.52% (0.5817 => 0.6022, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.51% (0.8177 => 0.8464, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.45% (0.3657 => 0.3783, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.39% (0.3717 => 0.3843, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: 3.38% (4.1305 => 4.2703, std.dev.: 0.0422) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.30% (0.4783 => 0.4941, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.24% (0.5191 => 0.5359, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.15% (1.2526 => 1.2921, std.dev.: 0.0077) MultiSource/Applications/treecc/treecc: 3.14% (1.9948 => 2.0575, std.dev.: 0.0193) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.13% (4.1763 => 4.3071, std.dev.: 0.0404) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.10% (13.1811 => 13.5901, std.dev.: 0.0255) MultiSource/Applications/SPASS/SPASS: 3.10% (14.2605 => 14.7020, std.dev.: 0.1038) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.07% (0.8007 => 0.8253, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.03% (0.8457 => 0.8713, std.dev.: 0.0089) MultiSource/Applications/lua/lua: 3.00% (3.8189 => 3.9335, std.dev.: 0.0226) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.97% (1.3279 => 1.3674, std.dev.: 0.0121) MultiSource/Benchmarks/Bullet/bullet: 2.91% (31.8598 => 32.7873, std.dev.: 0.3254) MultiSource/Benchmarks/nbench/nbench: 2.91% (1.1271 => 1.1599, std.dev.: 0.0071) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.84% (6.6074 => 6.7953, std.dev.: 0.0294) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.78% (0.9056 => 0.9308, std.dev.: 0.0058) MultiSource/Applications/hbd/hbd: 2.78% (1.4269 => 1.4666, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.74% (0.8712 => 0.8951, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.74% (0.4559 => 0.4684, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.72% (4.4873 => 4.6095, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.71% (0.8697 => 0.8933, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.70% (0.9074 => 0.9319, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.68% (0.8359 => 0.8583, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.54% (0.8716 => 0.8937, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.52% (0.8885 => 0.9109, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.52% (0.8656 => 0.8874, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.50% (0.9069 => 0.9296, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.43% (0.9688 => 0.9923, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.35% (0.8286 => 0.8481, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.35% (0.8261 => 0.8455, std.dev.: 0.0049) MultiSource/Applications/JM/lencod/lencod: 2.32% (15.3280 => 15.6838, std.dev.: 0.1257) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.24% (0.8331 => 0.8518, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.13% (0.8086 => 0.8258, std.dev.: 0.0035) MultiSource/Applications/d/make_dparser: 2.11% (3.2366 => 3.3048, std.dev.: 0.0218) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.10% (0.8340 => 0.8515, std.dev.: 0.0063) MultiSource/Benchmarks/mafft/pairlocalalign: 1.99% (8.6247 => 8.7967, std.dev.: 0.0582) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.88% (0.8048 => 0.8199, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 1.47% (0.9810 => 0.9954, std.dev.: 0.0033) MultiSource/Applications/lemon/lemon: 1.20% (1.0945 => 1.1076, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 85.93% (0.0199 => 0.0370, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/pi: 58.31% (1.5795 => 2.5005, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.85% (0.7597 => 0.8877, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.38% (2.9753 => 3.4628, std.dev.: 0.0912) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.73% (2.7995 => 3.2119, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6093, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/18-imp/imp: 7.74% (0.1370 => 0.1476, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.49% (1.1857 => 1.2745, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/queens: 7.15% (1.7056 => 1.8275, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: 7.02% (1.3037 => 1.3952, std.dev.: 0.0049) MultiSource/Applications/SIBsim4/SIBsim4: 6.60% (3.1873 => 3.3978, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.91% (4.5327 => 4.8004, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.84% (4.9686 => 5.2586, std.dev.: 0.0843) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.30% (0.3186 => 0.3355, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.79% (6.2275 => 6.5260, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.69% (3.3761 => 3.5346, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.18% (4.9453 => 5.1520, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 4.16% (8.4326 => 8.7834, std.dev.: 0.0379) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.10% (4.9469 => 5.1497, std.dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: 3.85% (14.0064 => 14.5458, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.62% (44.5605 => 46.1729, std.dev.: 0.4629) MultiSource/Applications/siod/siod: 2.75% (3.6643 => 3.7652, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.74% (8.2783 => 8.5049, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.57% (11.5690 => 11.8659, std.dev.: 0.0149) MultiSource/Applications/lambda-0_1_3/lambda: 2.56% (7.4933 => 7.6853, std.dev.: 0.0087) MultiSource/Benchmarks/Bullet/bullet: 2.49% (7.1181 => 7.2951, std.dev.: 0.0225) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.43% (4.8362 => 4.9538, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout/lists: 2.30% (7.3375 => 7.5061, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.87% (1.1365 => 1.1578, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/neural/neural: 1.34% (1.0841 => 1.0986, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.21% (5.4641 => 4.3050, std.dev.: 0.0236) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.06% (7.2130 => 6.3432, std.dev.: 0.0781) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.85% (1.0512 => 0.9371, std.dev.: 0.0191) SingleSource/Benchmarks/McGill/chomp: -10.76% (1.1216 => 1.0009, std.dev.: 0.0227) MultiSource/Benchmarks/mafft/pairlocalalign: -8.38% (63.1822 => 57.8866, std.dev.: 0.1391) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -7.01% (4.7482 => 4.4154, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.13% (3.7148 => 3.4869, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.12% (0.3269 => 0.3069, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.98% (3.9188 => 3.6845, std.dev.: 0.0390) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.80% (5.4972 => 5.1781, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.09% (5.1557 => 4.8931, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.72% (6.0224 => 5.7982, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.44% (0.5807 => 0.5607, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (28.5821 => 27.6870, std.dev.: 0.0850) SingleSource/Benchmarks/Shootout-C++/hash2: -2.42% (3.4237 => 3.3408, std.dev.: 0.0050) MultiSource/Applications/aha/aha: -2.41% (3.3398 => 3.2592, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.27% (9.9065 => 9.6819, std.dev.: 0.0420) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.01% (11.5316 => 11.3002, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.53% (4.9994 => 4.9230, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.52% (2.3487 => 2.3131, std.dev.: 0.0056) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.60% (16.4461 => 16.7085, std.dev.: 0.2428) MultiSource/Applications/obsequi/Obsequi: 3.63% (1.0262 => 1.0634, std.dev.: 0.0124) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7116.75% (0.3123 => 22.5379, std.dev.: 0.3768) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.25% (0.2463 => 0.3676, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/bigfib: 0.63% (0.6010 => 0.6048, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.36% (0.3266 => 0.3343, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/strcat: 3.61% (0.1969 => 0.2040, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 31.71% (0.0123 => 0.0162, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 10.63% (0.0254 => 0.0281, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.38% (0.0384 => 0.0420, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 42.86% (0.0007 => 0.0010, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.90% (0.1438 => 0.1451, std.dev.: 0.0074) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.32% (1.1329 => 1.1592, std.dev.: 0.0527) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.75% (0.1462 => 0.1473, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.98% (0.4164 => 0.4205, std.dev.: 0.0288) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.89% (0.1369 => 0.1436, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.78% (0.0641 => 0.0636, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.54% (0.0195 => 0.0276, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.17% (0.0578 => 0.0577, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.06% (1.1437 => 1.2016, std.dev.: 0.0142) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.35% (0.0627 => 0.0648, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 32.22% (0.0180 => 0.0238, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.48% (0.8017 => 0.7818, std.dev.: 0.0100) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 16.13% (0.0062 => 0.0072, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 14:30:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 16:30:47 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121112223047.08C9E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5797?compare_to=5794&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5797, Order: 167744, Start Time: 2012-11-12 21:06:12, End Time: 2012-11-12 22:31:01 To: 5794, Order: 167734, Start Time: 2012-11-12 19:17:55, End Time: 2012-11-12 20:43:02 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 1 (179 on baseline) Unchanged Tests: 1041 (859 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.06% (2.0626 => 2.0408, std.dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.67% (2.0478 => 2.1025, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/salsa20: 2.59% (7.4937 => 7.6875, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/hash2: 2.25% (3.1932 => 3.2649, std.dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.80% (0.3821 => 0.3523, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -7.57% (2.4924 => 2.3037, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-4: -7.22% (0.3880 => 0.3600, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -7.21% (0.3812 => 0.3537, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -7.20% (0.3831 => 0.3555, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-3: -7.12% (0.3848 => 0.3574, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.09% (0.3891 => 0.3615, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -7.09% (0.4033 => 0.3747, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -7.06% (0.3896 => 0.3621, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.03% (0.3884 => 0.3611, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: -7.02% (0.4176 => 0.3883, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.79% (0.3357 => 0.3129, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: -6.79% (0.4199 => 0.3914, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.72% (0.9542 => 0.8901, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/parameter-passing: -6.61% (0.4280 => 0.3997, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.56% (0.3142 => 0.2936, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.55% (0.2428 => 0.2269, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.41% (3.5339 => 3.3073, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.37% (0.3658 => 0.3425, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -6.32% (16.1920 => 15.1684, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/oourafft: -6.30% (0.2160 => 0.2024, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.28% (9.2283 => 8.6486, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.28% (0.6484 => 0.6077, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.27% (1.0544 => 0.9883, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: -6.26% (7.0961 => 6.6522, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.25% (0.9852 => 0.9236, std.dev.: 0.0110) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.17% (22.4056 => 21.0242, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.12% (4.0323 => 3.7857, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/gs/gs: -6.08% (4.3330 => 4.0694, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/methcall: -6.08% (0.3025 => 0.2841, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: -6.08% (0.9179 => 0.8621, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.07% (0.4151 => 0.3899, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.06% (1.3722 => 1.2891, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/matrix: -6.05% (0.3255 => 0.3058, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -6.04% (0.3194 => 0.3001, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.03% (0.2355 => 0.2213, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.02% (4.5069 => 4.2358, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.01% (2.1713 => 2.0408, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.00% (0.1716 => 0.1613, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.99% (4.8161 => 4.5275, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.99% (1.4642 => 1.3765, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.98% (0.3931 => 0.3696, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.97% (1.2784 => 1.2021, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: -5.95% (1.3148 => 1.2366, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.94% (4.8802 => 4.5901, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: -5.94% (0.2659 => 0.2501, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.93% (1.2300 => 1.1570, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -5.92% (0.2989 => 0.2812, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -5.92% (0.2871 => 0.2701, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.92% (0.2939 => 0.2765, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.91% (0.1761 => 0.1657, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.90% (1.6364 => 1.5399, std.dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.90% (6.7716 => 6.3724, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.89% (0.3057 => 0.2877, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -5.88% (0.3026 => 0.2848) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.87% (0.7919 => 0.7454, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.87% (0.3016 => 0.2839, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -5.85% (0.3059 => 0.2880, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.85% (0.2548 => 0.2399, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.84% (0.3323 => 0.3129, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.84% (0.3837 => 0.3613, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -5.83% (1.2515 => 1.1785, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.83% (0.2933 => 0.2762, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -5.83% (0.2849 => 0.2683, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -5.83% (0.4515 => 0.4252, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -5.80% (0.3446 => 0.3246, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -5.80% (1.1530 => 1.0861, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary: -5.77% (0.3394 => 0.3198, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -5.77% (0.3481 => 0.3280, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.75% (0.2903 => 0.2736, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.75% (0.2695 => 0.2540, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.74% (0.3849 => 0.3628, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -5.74% (0.4861 => 0.4582, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: -5.72% (1.1450 => 1.0795, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.72% (0.4321 => 0.4074, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.72% (0.6736 => 0.6351, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: -5.70% (0.4248 => 0.4006, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -5.69% (0.3867 => 0.3647, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -5.68% (0.3205 => 0.3023, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.66% (14.2083 => 13.4039, std.dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.66% (0.3252 => 0.3068, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.66% (0.4083 => 0.3852, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -5.65% (4.0594 => 3.8300, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.63% (0.4916 => 0.4639, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.63% (0.5999 => 0.5661, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.63% (0.4813 => 0.4542, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: -5.61% (0.3621 => 0.3418, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.60% (0.2999 => 0.2831, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.55% (0.3406 => 0.3217, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.54% (0.3483 => 0.3290, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -5.54% (17.1032 => 16.1558, std.dev.: 0.0070) MultiSource/Applications/SIBsim4/SIBsim4: -5.53% (1.3864 => 1.3098, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.50% (0.6304 => 0.5957, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.50% (0.5705 => 0.5391, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.50% (0.5456 => 0.5156, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.50% (0.5857 => 0.5535, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.50% (0.5168 => 0.4884, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.49% (0.5478 => 0.5177, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.49% (0.8521 => 0.8053, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.49% (0.2278 => 0.2153, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: -5.47% (15.5079 => 14.6596, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.47% (0.5925 => 0.5601, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.47% (0.6293 => 0.5949, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.46% (0.5805 => 0.5488, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.46% (0.7198 => 0.6805, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.45% (0.3319 => 0.3138, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.45% (0.7524 => 0.7114, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.44% (0.5859 => 0.5540, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.44% (0.4427 => 0.4186, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.43% (0.6667 => 0.6305, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: -5.43% (0.7447 => 0.7043, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.42% (0.5849 => 0.5532, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.42% (0.5575 => 0.5273, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.41% (0.5863 => 0.5546, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -5.39% (0.2985 => 0.2824, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.39% (0.6230 => 0.5894, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.39% (0.9557 => 0.9042, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.39% (0.6052 => 0.5726, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.38% (0.5591 => 0.5290, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.38% (1.6474 => 1.5588, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.37% (0.7339 => 0.6945, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.37% (0.6297 => 0.5959, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.37% (0.2385 => 0.2257, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.36% (0.6395 => 0.6052, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.36% (8.0126 => 7.5833, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: -5.35% (3.5154 => 3.3273, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.35% (0.6189 => 0.5858, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.35% (0.6660 => 0.6304, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.34% (0.6260 => 0.5926, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.33% (0.6681 => 0.6325, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: -5.32% (0.7779 => 0.7365, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.31% (0.5802 => 0.5494, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -5.31% (2.4021 => 2.2746, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.31% (1.2210 => 1.1562, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -5.29% (34.0927 => 32.2896, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.29% (0.5581 => 0.5286, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: -5.28% (0.3788 => 0.3588, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.27% (0.6446 => 0.6106, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.27% (0.7021 => 0.6651, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.27% (0.6395 => 0.6058, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.26% (0.6676 => 0.6325, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.25% (1.2221 => 1.1580, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.24% (0.3491 => 0.3308, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.23% (0.5569 => 0.5278, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/bigfib: -5.21% (0.6750 => 0.6398, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.21% (0.5567 => 0.5277, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -5.19% (15.2527 => 14.4608, std.dev.: 0.0179) SingleSource/UnitTests/ObjC++/Hello: -5.17% (0.6347 => 0.6019, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.17% (0.5941 => 0.5634, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.16% (0.6440 => 0.6108, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: -5.15% (18.2933 => 17.3516, std.dev.: 0.0262) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.13% (0.6194 => 0.5876, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.12% (0.5688 => 0.5397, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -5.11% (0.4524 => 0.4293, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.10% (0.2001 => 0.1899, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -5.09% (0.6441 => 0.6113, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.09% (0.5329 => 0.5058, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -5.07% (2.1401 => 2.0316, std.dev.: 0.0107) MultiSource/Benchmarks/McCat/18-imp/imp: -5.05% (0.3581 => 0.3400, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.04% (5.4682 => 5.1927, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.99% (0.6033 => 0.5732, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.99% (0.2106 => 0.2001, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.98% (2.2587 => 2.1463, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -4.92% (0.7982 => 0.7589, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: -4.89% (0.3271 => 0.3111, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -4.88% (0.8418 => 0.8007, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.72% (0.9077 => 0.8649, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: -4.60% (5.0226 => 4.7914, std.dev.: 0.0136) MultiSource/Applications/hbd/hbd: -4.41% (1.5610 => 1.4921, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.61% (20.7746 => 20.2316, std.dev.: 0.0517) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7543, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/richards_benchmark: -8.76% (1.2842 => 1.1717, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7060, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: -3.90% (2.2633 => 2.1751, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4706, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.46% (1.3096 => 1.2905, std.dev.: 0.0074) Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 16:09:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 18:09:01 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121113000901.F0B9A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5798?compare_to=5796&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5798, Order: 167763, Start Time: 2012-11-12 22:42:40, End Time: 2012-11-13 00:09:17 To: 5796, Order: 167744, Start Time: 2012-11-12 20:56:42, End Time: 2012-11-12 22:24:25 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 8 (115 on baseline) Performance Improvements: 4 (22 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 979 (837 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 6.89% (8.0307 => 8.5842, std.dev.: 0.0691) MultiSource/Benchmarks/Olden/bh/bh: 3.36% (0.2974 => 0.3074, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.52% (0.7922 => 0.8122, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 1.00% (0.9954 => 1.0054, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 9.55% (0.7962 => 0.8722, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.54% (4.5140 => 4.6739, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.95% (6.3432 => 6.5304, std.dev.: 0.0350) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.92% (4.3573 => 4.4844, std.dev.: 0.0271) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.74% (1.5106 => 1.4843, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.56% (0.8929 => 0.8790, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: -5.22% (1.3283 => 1.2590, std.dev.: 0.0116) MultiSource/Benchmarks/Bullet/bullet: -1.78% (7.2951 => 7.1649, std.dev.: 0.0318) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.72% (16.7085 => 16.8285, std.dev.: 0.1694) MultiSource/Applications/obsequi/Obsequi: -0.67% (1.0634 => 1.0563, std.dev.: 0.0090) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.55% (22.5379 => 21.7385, std.dev.: 0.4148) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.63% (0.3676 => 0.3653, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 0.84% (0.6048 => 0.6099, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.60% (0.3343 => 0.3363, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: -1.42% (0.2040 => 0.2011, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 34.57% (0.0162 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.47% (0.0428 => 0.0426, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 17.44% (0.0281 => 0.0330, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0312 => 0.0313, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.48% (0.0420 => 0.0422, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 0.50% (0.0202 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0216 => 0.0216, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -80.00% (0.0010 => 0.0002, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.90% (0.1451 => 0.1464, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -5.50% (1.1592 => 1.0955, std.dev.: 0.0346) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.99% (0.1473 => 0.1429, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.69% (0.4205 => 0.4176, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.53% (0.1436 => 0.1458, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.89% (0.0636 => 0.0648, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.72% (0.0276 => 0.0278, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.73% (0.0577 => 0.0587, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.13% (1.2016 => 1.2000, std.dev.: 0.0406) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -25.93% (0.0027 => 0.0020, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.23% (0.0648 => 0.0640, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.84% (0.0238 => 0.0236, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.28% (0.7818 => 0.7796, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 31.94% (0.0072 => 0.0095, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2296.45% (0.6332 => 15.1743, std.dev.: 0.2580) MultiSource/Benchmarks/McCat/08-main/main: 45.00% (0.1831 => 0.2655, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.55% (0.1559 => 0.1488, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1518.18% (0.3344 => 5.4112, std.dev.: 0.0551) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.48% (0.2364 => 0.3250, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel: 0.93% (0.0429 => 0.0433, std.dev.: 0.0008) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0224 => 0.0224, std.dev.: 0.0013) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0021) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4231, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0687, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4956, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3453, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1633, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4061, std.dev.: 0.0019) SingleSource/Regression/C/uint64_to_float: -24.08% (2.1832 => 1.6575, std.dev.: 0.0081) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.56% (0.0810 => 0.0936, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.77% (0.0830 => 0.0936, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.08% (0.6010 => 0.6556, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.84% (0.1425 => 0.1551, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.73% (0.4847 => 0.5270, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.68% (0.7473 => 0.8122, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.71% (0.3137 => 0.3379, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.63% (0.2279 => 0.2453, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.89% (0.8321 => 0.8894, std.dev.: 0.0182) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1983 => 0.2116, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.30% (0.1905 => 0.2025, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.68% (0.1885 => 0.1992, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.47% (0.5961 => 0.6287, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.25% (0.3295 => 0.3468, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.15% (0.8148 => 0.8568, std.dev.: 0.0112) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.06% (1.1606 => 1.2193, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.71% (0.5817 => 0.6091, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.54% (0.9435 => 0.9863, std.dev.: 0.0147) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.47% (0.2998 => 0.3132, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 4.47% (0.7950 => 0.8305, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.23% (0.3003 => 0.3130, std.dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.07% (6.6074 => 6.8765, std.dev.: 0.0344) MultiSource/Applications/Burg/burg: 3.97% (1.2222 => 1.2707, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.93% (1.3279 => 1.3801, std.dev.: 0.0039) MultiSource/Applications/hbd/hbd: 3.81% (1.4269 => 1.4813, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.75% (1.2526 => 1.2996, std.dev.: 0.0098) MultiSource/Applications/lua/lua: 3.75% (3.8189 => 3.9621, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.50% (0.6287 => 0.6507, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.44% (0.4127 => 0.4269, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.33% (4.4873 => 4.6369, std.dev.: 0.0570) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.01% (0.8805 => 0.9070, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.01% (4.1763 => 4.3018, std.dev.: 0.0189) MultiSource/Benchmarks/nbench/nbench: 2.95% (1.1271 => 1.1604, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/gs/gs: 2.92% (4.1305 => 4.2510, std.dev.: 0.0379) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.89% (1.6386 => 1.6860, std.dev.: 0.0110) MultiSource/Applications/SPASS/SPASS: 2.89% (14.2605 => 14.6730, std.dev.: 0.0699) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.87% (0.9074 => 0.9334, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.75% (0.6227 => 0.6398, std.dev.: 0.0037) MultiSource/Applications/treecc/treecc: 2.73% (1.9948 => 2.0493, std.dev.: 0.0139) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.73% (1.1170 => 1.1475, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.72% (0.4559 => 0.4683, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.69% (4.5702 => 4.6932, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.68% (0.8457 => 0.8684, std.dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: 2.67% (31.8598 => 32.7089, std.dev.: 0.1533) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.51% (1.4479 => 1.4843, std.dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 2.49% (0.9810 => 1.0054, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 2.48% (1.2568 => 1.2880, std.dev.: 0.0107) MultiSource/Benchmarks/PAQ8p/paq8p: 2.43% (2.3764 => 2.4341, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.35% (0.8331 => 0.8527, std.dev.: 0.0057) MultiSource/Applications/ClamAV/clamscan: 2.34% (14.7684 => 15.1136, std.dev.: 0.0657) MultiSource/Benchmarks/Prolangs-C/football/football: 2.27% (0.8768 => 0.8967, std.dev.: 0.0060) MultiSource/Applications/d/make_dparser: 2.26% (3.2366 => 3.3098, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.19% (0.8317 => 0.8499, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.15% (4.4880 => 4.5847, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.13% (0.8086 => 0.8258, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.12% (0.8007 => 0.8177, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.12% (13.1811 => 13.4603, std.dev.: 0.0850) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.10% (0.9908 => 1.0116, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.08% (0.8611 => 0.8790, std.dev.: 0.0035) MultiSource/Applications/siod/siod: 2.08% (2.2184 => 2.2645, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.06% (0.8069 => 0.8235, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.00% (0.8340 => 0.8507, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.00% (0.8716 => 0.8890, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.99% (0.9056 => 0.9236, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.95% (0.8597 => 0.8765, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.95% (0.8927 => 0.9101, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.94% (0.8656 => 0.8824, std.dev.: 0.0043) MultiSource/Applications/JM/ldecod/ldecod: 1.91% (6.7320 => 6.8607, std.dev.: 0.0471) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.86% (0.7966 => 0.8114, std.dev.: 0.0034) MultiSource/Applications/minisat/minisat: 1.81% (0.6834 => 0.6958, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.77% (0.9688 => 0.9859, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 1.72% (8.6247 => 8.7732, std.dev.: 0.0342) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.71% (0.8261 => 0.8402, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.69% (0.8712 => 0.8859, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.69% (0.9069 => 0.9222, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.64% (0.8338 => 0.8475, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.56% (1.2602 => 1.2799, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.55% (0.8066 => 0.8191, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.34% (0.8518 => 0.8632, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.18% (1.2423 => 1.2569, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 110.05% (0.0199 => 0.0418, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/pi: 57.27% (1.5795 => 2.4841, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.15% (0.7597 => 0.8900, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.09% (2.9753 => 3.4539, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.69% (2.7995 => 3.2108, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6089, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.03% (1.1857 => 1.2809, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 7.28% (1.7056 => 1.8297, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: 6.85% (1.3037 => 1.3930, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.72% (4.7794 => 5.1008, std.dev.: 0.0065) MultiSource/Applications/SIBsim4/SIBsim4: 6.40% (3.1873 => 3.3912, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.34% (4.9686 => 5.2835, std.dev.: 0.0254) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.82% (4.5327 => 4.7965, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.62% (6.2275 => 6.5149, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.50% (3.3761 => 3.5281, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.10% (4.9453 => 5.1480, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.98% (4.9469 => 5.1439, std.dev.: 0.0127) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.93% (0.3587 => 0.3728, std.dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 3.85% (14.0064 => 14.5454, std.dev.: 0.0315) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.38% (1.2337 => 1.2754, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.97% (4.3552 => 4.4844, std.dev.: 0.0271) MultiSource/Applications/lambda-0_1_3/lambda: 2.93% (7.4933 => 7.7130, std.dev.: 0.0305) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.83% (8.2783 => 8.5123, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.81% (11.5690 => 11.8946, std.dev.: 0.0073) MultiSource/Applications/siod/siod: 2.62% (3.6643 => 3.7602, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.62% (4.5547 => 4.6739, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 2.46% (8.4326 => 8.6404, std.dev.: 0.0729) SingleSource/Benchmarks/Shootout/lists: 2.32% (7.3375 => 7.5075, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.23% (4.8660 => 4.9743, std.dev.: 0.0200) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.02% (4.8362 => 4.9337, std.dev.: 0.0209) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.60% (2.4647 => 2.5041, std.dev.: 0.0111) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.50% (1.1365 => 1.1536, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: 1.30% (1.0841 => 1.0982, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 1.25% (8.5322 => 8.6386, std.dev.: 0.0378) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.20% (3.5679 => 3.6106, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.70% (5.4641 => 4.3333, std.dev.: 0.1139) SingleSource/Benchmarks/McGill/chomp: -10.99% (1.1216 => 0.9983, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.88% (1.0512 => 0.9368, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -9.46% (7.2130 => 6.5304, std.dev.: 0.0350) MultiSource/Benchmarks/mafft/pairlocalalign: -8.51% (63.1822 => 57.8080, std.dev.: 0.1373) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.92% (4.7482 => 4.4198, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.21% (0.3269 => 0.3066, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.95% (3.7148 => 3.4938, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.90% (5.4972 => 5.1730, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.11% (5.1557 => 4.8921, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.38% (4.7449 => 4.5370, std.dev.: 0.0155) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.41% (2.4490 => 2.3655, std.dev.: 0.0216) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (28.5821 => 27.6982, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.81% (9.9065 => 9.6284, std.dev.: 0.0330) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.62% (2.6356 => 2.5666, std.dev.: 0.0240) MultiSource/Applications/aha/aha: -2.32% (3.3398 => 3.2623, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/hash2: -2.18% (3.4237 => 3.3492, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.98% (11.5316 => 11.3035, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.91% (3.2169 => 3.1554, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ffbench: -1.87% (1.4296 => 1.4029, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.73% (4.9994 => 4.9127, std.dev.: 0.0165) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.3487 => 2.3151, std.dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.33% (16.4461 => 16.8285, std.dev.: 0.1694) MultiSource/Applications/obsequi/Obsequi: 2.93% (1.0262 => 1.0563, std.dev.: 0.0090) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6860.77% (0.3123 => 21.7385, std.dev.: 0.4148) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.32% (0.2463 => 0.3653, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 1.48% (0.6010 => 0.6099, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.97% (0.3266 => 0.3363, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 2.13% (0.1969 => 0.2011, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -71.43% (0.0007 => 0.0002, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 1.81% (0.1438 => 0.1464, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -3.30% (1.1329 => 1.0955, std.dev.: 0.0346) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.26% (0.1462 => 0.1429, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.29% (0.4164 => 0.4176, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.50% (0.1369 => 0.1458, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.09% (0.0641 => 0.0648, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.56% (0.0195 => 0.0278, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.56% (0.0578 => 0.0587, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.92% (1.1437 => 1.2000, std.dev.: 0.0406) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 42.86% (0.0014 => 0.0020, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.07% (0.0627 => 0.0640, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.11% (0.0180 => 0.0236, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.76% (0.8017 => 0.7796, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 53.23% (0.0062 => 0.0095, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 16:19:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 18:19:08 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121113001908.045C22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5799?compare_to=5797&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5799, Order: 167765, Start Time: 2012-11-12 22:54:15, End Time: 2012-11-13 00:19:22 To: 5797, Order: 167744, Start Time: 2012-11-12 21:06:12, End Time: 2012-11-12 22:31:01 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 1 (179 on baseline) Unchanged Tests: 1040 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.49% (78.2202 => 80.9527, std.dev.: 0.1893) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.80% (55.4748 => 54.4752, std.dev.: 0.2920) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.71% (2.0478 => 2.1032, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/salsa20: 2.42% (7.4937 => 7.6751, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/hash2: 2.12% (3.1932 => 3.2608, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.55% (79.7170 => 80.9527, std.dev.: 0.1893) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.74% (0.1431 => 0.1306, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.09% (0.3821 => 0.3512, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.63% (2.4924 => 2.3022, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.92% (0.9542 => 0.8882, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.77% (0.3812 => 0.3554, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.75% (0.2428 => 0.2264, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.70% (0.3848 => 0.3590, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.68% (0.3831 => 0.3575, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.67% (0.3357 => 0.3133, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: -6.67% (0.4033 => 0.3764, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.66% (0.3891 => 0.3632, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -6.65% (0.3880 => 0.3622, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.65% (0.3896 => 0.3637, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.64% (0.3884 => 0.3626, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.56% (0.4176 => 0.3902, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.56% (0.3142 => 0.2936, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.51% (0.3658 => 0.3420, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -6.45% (0.4199 => 0.3928, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -6.39% (0.2160 => 0.2022, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -6.37% (16.1920 => 15.1610, std.dev.: 0.0116) MultiSource/Applications/JM/ldecod/ldecod: -6.32% (7.0961 => 6.6476, std.dev.: 0.0162) SingleSource/UnitTests/ObjC/parameter-passing: -6.29% (0.4280 => 0.4011, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.26% (0.9852 => 0.9235, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.23% (0.6484 => 0.6080, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -6.19% (9.2283 => 8.6568, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.18% (1.0544 => 0.9892, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.18% (0.3057 => 0.2868, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -6.17% (4.3330 => 4.0655, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/football/football: -6.17% (0.9179 => 0.8613, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.16% (2.1713 => 2.0376, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.11% (0.2355 => 0.2211, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.11% (3.5339 => 3.3181, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: -6.08% (0.3026 => 0.2842) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.06% (0.1716 => 0.1612, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -6.06% (0.2939 => 0.2761, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.04% (22.4056 => 21.0515, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/nestedloop: -6.03% (0.2933 => 0.2756, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.03% (0.2903 => 0.2728, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.03% (4.0323 => 3.7893, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/methcall: -6.02% (0.3025 => 0.2843, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.00% (0.3931 => 0.3695, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -6.00% (0.2849 => 0.2678, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.00% (0.3016 => 0.2835, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -6.00% (1.3148 => 1.2359, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.00% (1.3722 => 1.2899, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.99% (0.3837 => 0.3607, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -5.99% (1.2515 => 1.1765, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/fibo: -5.99% (0.2871 => 0.2699, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/matrix: -5.99% (0.3255 => 0.3060, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.98% (0.3194 => 0.3003, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -5.96% (0.1761 => 0.1656, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.95% (1.2784 => 1.2023, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: -5.95% (0.3059 => 0.2877, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.95% (0.3849 => 0.3620, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -5.95% (0.3446 => 0.3241, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.95% (0.7198 => 0.6770, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.92% (4.8802 => 4.5915, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/wc: -5.90% (0.3205 => 0.3016, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.89% (1.2300 => 1.1575, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -5.89% (0.2989 => 0.2813, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.87% (1.4642 => 1.3782, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.86% (1.6364 => 1.5405, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.85% (0.4151 => 0.3908, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.85% (4.8161 => 4.5344, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.83% (0.7919 => 0.7457, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/bh/bh: -5.83% (0.2985 => 0.2811, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.82% (4.5069 => 4.2447, std.dev.: 0.0181) MultiSource/Benchmarks/McCat/08-main/main: -5.79% (0.2659 => 0.2505, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -5.77% (0.3481 => 0.3280, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.73% (6.7716 => 6.3833, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.73% (0.4083 => 0.3849, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: -5.72% (0.4861 => 0.4583, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -5.71% (1.1450 => 1.0796, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.71% (14.2083 => 13.3974, std.dev.: 0.0134) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.70% (0.6736 => 0.6352, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: -5.70% (0.4248 => 0.4006, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -5.69% (0.4515 => 0.4258, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.69% (0.2548 => 0.2403, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.68% (0.3483 => 0.3285, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.68% (0.2695 => 0.2542, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.67% (0.3406 => 0.3213, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.66% (0.3252 => 0.3068, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -5.65% (2.4021 => 2.2665, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.64% (0.8521 => 0.8040, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: -5.64% (0.3867 => 0.3649, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.61% (0.5863 => 0.5534, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -5.61% (0.3621 => 0.3418, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: -5.60% (0.3394 => 0.3204, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: -5.59% (0.3581 => 0.3381, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.58% (0.4427 => 0.4180, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.55% (0.5478 => 0.5174, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: -5.55% (1.3864 => 1.3095, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.52% (0.5705 => 0.5390, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -5.52% (0.3788 => 0.3579, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: -5.52% (1.1530 => 1.0894, std.dev.: 0.0073) MultiSource/Applications/lua/lua: -5.51% (4.0594 => 3.8356, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.50% (0.5925 => 0.5599, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.50% (0.5999 => 0.5669, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.50% (0.6660 => 0.6294, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -5.49% (17.1032 => 16.1638, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.48% (0.5859 => 0.5538, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.45% (0.5575 => 0.5271, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.44% (0.6395 => 0.6047, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.44% (0.7339 => 0.6940, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.43% (0.6681 => 0.6318, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.42% (0.6293 => 0.5952, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: -5.42% (15.5079 => 14.6677, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.40% (0.6297 => 0.5957, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.39% (0.5805 => 0.5492, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: -5.39% (3.5154 => 3.3259, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.39% (0.5569 => 0.5269, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.38% (0.5857 => 0.5542, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.37% (0.2999 => 0.2838, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.36% (0.6395 => 0.6052, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.36% (0.5581 => 0.5282, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.35% (0.6052 => 0.5728, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.35% (0.5849 => 0.5536, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.35% (0.6230 => 0.5897, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -5.33% (0.7447 => 0.7050, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.33% (0.5591 => 0.5293, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -5.32% (34.0927 => 32.2788, std.dev.: 0.0237) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.31% (0.2278 => 0.2157, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.30% (0.5168 => 0.4894, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.29% (0.6667 => 0.6314, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.28% (8.0126 => 7.5893, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.28% (0.4813 => 0.4559, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.26% (0.6194 => 0.5868, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: -5.26% (18.2933 => 17.3311, std.dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.26% (0.7021 => 0.6652, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.25% (0.4916 => 0.4658, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.25% (0.5567 => 0.5275, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.24% (0.5456 => 0.5170, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.24% (0.2385 => 0.2260, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.24% (0.6260 => 0.5932, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -5.23% (0.6750 => 0.6397, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.23% (0.6446 => 0.6109, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.22% (0.5802 => 0.5499, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.22% (0.9557 => 0.9058, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.22% (0.6189 => 0.5866, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.22% (0.5941 => 0.5631, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.21% (0.3323 => 0.3150, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.20% (1.2221 => 1.1585, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.19% (0.6440 => 0.6106, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.18% (0.3491 => 0.3310, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.18% (1.2210 => 1.1577, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.17% (1.6474 => 1.5623, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -5.15% (0.7982 => 0.7571, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/09-vor/vor: -5.14% (0.3271 => 0.3103, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -5.14% (2.1401 => 2.0302, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.13% (0.5688 => 0.5396, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.13% (0.7524 => 0.7138, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.13% (0.2106 => 0.1998) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.12% (0.6676 => 0.6334, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/Hello: -5.10% (0.6347 => 0.6023, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -5.10% (15.2527 => 14.4750, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.10% (0.5570 => 0.5286, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.09% (0.3319 => 0.3150, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: -5.09% (0.7779 => 0.7383, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.07% (0.5329 => 0.5059, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.06% (0.6033 => 0.5728, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.02% (5.4682 => 5.1935, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: -4.97% (0.6441 => 0.6121, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -4.93% (0.4524 => 0.4301, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.88% (0.4321 => 0.4110, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: -4.82% (0.8418 => 0.8012, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.80% (2.2587 => 2.1503, std.dev.: 0.0118) MultiSource/Applications/oggenc/oggenc: -4.64% (5.0226 => 4.7896, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.55% (0.9077 => 0.8664, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: -4.25% (1.5610 => 1.4947, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -1.84% (20.7746 => 20.3923, std.dev.: 0.0273) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.48% (7.5137 => 5.7498, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/richards_benchmark: -8.74% (1.2842 => 1.1720, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.84% (2.2633 => 2.1764, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.86% (1.3096 => 1.2722, std.dev.: 0.0079) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4743, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0010) Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 17:38:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 19:38:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121113013831.B6AC72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5800?compare_to=5795&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5800, Order: 167753, Start Time: 2012-11-12 22:23:08, End Time: 2012-11-13 01:38:40 To: 5795, Order: 167731, Start Time: 2012-11-12 18:18:19, End Time: 2012-11-12 21:33:48 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (177 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (714 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.26% (126.5373 => 130.6626, std.dev.: 0.4759) SingleSource/Benchmarks/Dhrystone/fldry: 1.11% (16.6986 => 16.8840, std.dev.: 0.0685) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.52% (0.0625 => 0.0897, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.96% (0.1063 => 0.1424, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.57% (0.2969 => 0.3758, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.31% (0.1106 => 0.1397, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 25.61% (1.5932 => 2.0012, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.39% (0.4139 => 0.5190, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.53% (0.4994 => 0.6219, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.23% (0.0714 => 0.0887, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.08% (0.5000 => 0.6204, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.00% (0.0475 => 0.0589, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.95% (0.5900 => 0.7313, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.84% (0.4253 => 0.5267, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.63% (0.0584 => 0.0722, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.40% (0.0547 => 0.0675, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.22% (0.1107 => 0.1364, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.02% (0.1620 => 0.1993, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.82% (0.1021 => 0.1254, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 22.70% (0.0599 => 0.0735, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.63% (0.0897 => 0.1100) MultiSource/Benchmarks/Olden/em3d/em3d: 21.62% (0.0948 => 0.1153, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.58% (0.0584 => 0.0710) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.48% (0.0633 => 0.0769, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.31% (0.1103 => 0.1338, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.26% (0.0541 => 0.0656, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.18% (0.0642 => 0.0778, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.93% (0.3903 => 0.4720, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.85% (0.1549 => 0.1872, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.84% (0.1003 => 0.1212, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 20.83% (0.0821 => 0.0992, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.81% (0.0495 => 0.0598, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.57% (0.1604 => 0.1934, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 20.51% (0.1619 => 0.1951, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.44% (0.0822 => 0.0990, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 19.96% (0.0947 => 0.1136, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.77% (0.1462 => 0.1751, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 19.70% (0.5889 => 0.7049, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 19.55% (0.5826 => 0.6965, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 19.43% (0.0808 => 0.0965, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.36% (0.3890 => 0.4643, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 19.04% (0.4029 => 0.4796, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.97% (0.2014 => 0.2396, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.90% (0.0582 => 0.0692, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 18.80% (0.1218 => 0.1447, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.60% (0.2736 => 0.3245, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 18.48% (0.0698 => 0.0827, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.45% (1.3152 => 1.5578, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: 18.34% (0.1505 => 0.1781, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 18.24% (0.0581 => 0.0687, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.20% (0.1088 => 0.1286, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.01% (0.0572 => 0.0675, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.86% (0.2866 => 0.3378, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.80% (0.0573 => 0.0675, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.78% (0.1968 => 0.2318, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.78% (0.4658 => 0.5486, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 17.72% (0.5546 => 0.6529, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.69% (0.0605 => 0.0712, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.65% (3.5627 => 4.1915, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 17.40% (1.8794 => 2.2065, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.37% (1.6211 => 1.9027, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: 17.34% (0.9697 => 1.1378, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.25% (0.5026 => 0.5893, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.09% (0.3271 => 0.3830, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 17.00% (0.7171 => 0.8390, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.98% (0.2738 => 0.3203, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.98% (0.1160 => 0.1357, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.97% (0.2875 => 0.3363, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 16.96% (0.1421 => 0.1662, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 16.93% (1.0781 => 1.2606, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.72% (0.3930 => 0.4587, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.67% (0.4361 => 0.5088, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 16.65% (0.2714 => 0.3166, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.51% (2.7292 => 3.1799, std.dev.: 0.0044) MultiSource/Applications/ClamAV/clamscan: 16.47% (4.2109 => 4.9045, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.38% (4.4195 => 5.1432, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: 16.36% (0.1284 => 0.1494, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 16.28% (0.3004 => 0.3493, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 16.26% (0.2780 => 0.3232, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/fibo: 16.22% (0.2725 => 0.3167, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.20% (0.2729 => 0.3171) SingleSource/Benchmarks/Shootout-C++/strcat: 16.15% (0.2750 => 0.3194, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.12% (0.3195 => 0.3710, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 16.00% (0.2813 => 0.3263, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.97% (0.2792 => 0.3238, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 15.95% (0.2803 => 0.3250, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 15.94% (0.2823 => 0.3273, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 15.91% (0.9909 => 1.1486, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.90% (1.9694 => 2.2826, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/except: 15.90% (0.2811 => 0.3258, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.83% (1.9966 => 2.3126, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.80% (0.2911 => 0.3371, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.79% (2.0673 => 2.3938, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.78% (0.1090 => 0.1262, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 15.70% (0.3096 => 0.3582, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 15.39% (23.5202 => 27.1405, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ary: 15.35% (0.3258 => 0.3758, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 15.30% (0.3267 => 0.3767, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 15.28% (0.2075 => 0.2392, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 15.20% (0.2566 => 0.2956, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 15.16% (0.3317 => 0.3820, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.03% (0.3060 => 0.3520, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 14.92% (0.3465 => 0.3982, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 14.91% (0.3460 => 0.3976, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.91% (0.3488 => 0.4008, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.88% (0.3442 => 0.3954, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.87% (0.3362 => 0.3862, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 14.86% (0.3446 => 0.3958, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 14.76% (0.3496 => 0.4012, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 14.76% (0.3469 => 0.3981, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.72% (0.3124 => 0.3584, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 14.71% (0.3678 => 0.4219, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 14.64% (0.3477 => 0.3986, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 14.58% (0.3348 => 0.3836, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 14.57% (1.4269 => 1.6348, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.56% (0.3282 => 0.3760, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 14.47% (0.3726 => 0.4265, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 14.47% (0.3650 => 0.4178, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 14.38% (0.3643 => 0.4167, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 14.34% (0.3724 => 0.4258, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.32% (0.3625 => 0.4144, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 14.22% (0.7875 => 0.8995, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 14.14% (0.4251 => 0.4852, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 14.13% (0.4146 => 0.4732, std.dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 14.13% (2.1653 => 2.4713, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.07% (0.3690 => 0.4209, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.87% (0.3981 => 0.4533, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 13.72% (4.6177 => 5.2513, std.dev.: 0.0069) MultiSource/Benchmarks/sim/sim: 13.72% (0.0758 => 0.0862, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.65% (0.3845 => 0.4370, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 13.57% (0.5012 => 0.5692, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 13.55% (2.1013 => 2.3860, std.dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 13.12% (0.2691 => 0.3044, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.09% (0.2040 => 0.2307, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 12.55% (5.5417 => 6.2371, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.38% (0.2068 => 0.2324, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.26% (0.6435 => 0.7224, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 11.81% (0.3498 => 0.3911, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.77% (0.1028 => 0.1149, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.64% (0.1383 => 0.1544, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 11.53% (0.6634 => 0.7399, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.36% (0.2737 => 0.3048, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 11.33% (0.4847 => 0.5396, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: 10.97% (0.3336 => 0.3702, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.93% (0.3084 => 0.3421, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 10.41% (0.2391 => 0.2640, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.32% (0.2103 => 0.2320, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 10.30% (2.0346 => 2.2441, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.34% (4.6926 => 5.1310, std.dev.: 0.0102) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.31% (11.6398 => 12.7237, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.08% (0.5361 => 0.5848, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.63% (0.5584 => 0.6066, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.52% (0.7426 => 0.8059, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 7.25% (11.9555 => 12.8225, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.46% (0.3792 => 0.3999, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 9.64% (0.2802 => 0.3072, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6109, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6760, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.12% (0.3693 => 0.3882, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 5.04% (0.2122 => 0.2229, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-2: 4.93% (1.8057 => 1.8947, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1701, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6378, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1946, std.dev.: 0.0034) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2240, std.dev.: 0.0023) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3054, std.dev.: 0.0136) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2896, std.dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5125, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5884, std.dev.: 0.0211) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5635, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/ary2: -8.08% (0.2402 => 0.2208, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9768, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7951, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.57% (11.2080 => 10.8074, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.02% (0.6293 => 0.6103, std.dev.: 0.0039) MultiSource/Applications/siod/siod: -2.98% (6.9842 => 6.7758, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5184, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8652, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -2.05% (17.2379 => 16.8840, std.dev.: 0.0685) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5799, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4950, std.dev.: 0.0097) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0423, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.05% (105.3826 => 104.2782, std.dev.: 0.0153) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 17:54:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 19:54:49 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121113015449.A1FA22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5801?compare_to=5798&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5801, Order: 167785, Start Time: 2012-11-13 00:28:27, End Time: 2012-11-13 01:55:05 To: 5798, Order: 167763, Start Time: 2012-11-12 22:42:40, End Time: 2012-11-13 00:09:17 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 8 (97 on baseline) Performance Improvements: 1 (26 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 982 (851 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.62% (0.2226 => 0.2351, std.dev.: 0.0029) MultiSource/Applications/treecc/treecc: 1.41% (2.0493 => 2.0781, std.dev.: 0.0048) MultiSource/Applications/SIBsim4/SIBsim4: 1.31% (1.2880 => 1.3049, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 1.27% (5.0343 => 5.0981, std.dev.: 0.0225) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.15% (1.4843 => 1.5013, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.14% (2.4480 => 2.5738, std.dev.: 0.0432) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.51% (0.3360 => 0.3478, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/ffbench: 2.29% (1.4029 => 1.4350, std.dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -5.33% (22.3331 => 21.1417, std.dev.: 0.4261) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.24% (16.8285 => 16.7873, std.dev.: 0.0895) MultiSource/Applications/obsequi/Obsequi: 1.00% (1.0563 => 1.0669, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.23% (21.7385 => 21.7880, std.dev.: 0.0663) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.25% (0.3653 => 0.3662, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/bigfib: -0.56% (0.6099 => 0.6065, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.56% (0.3363 => 0.3344, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: -0.10% (0.2011 => 0.2009, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0218 => 0.0218, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0426 => 0.0426, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0330 => 0.0331, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.64% (0.0313 => 0.0315, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0422 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0203 => 0.0204, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 0.93% (0.0216 => 0.0218, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -50.00% (0.0002 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.75% (0.1464 => 0.1475, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 8.34% (1.0955 => 1.1869, std.dev.: 0.0491) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000) MultiSource/Applications/oggenc/oggenc: -0.35% (0.1429 => 0.1424, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.57% (0.4176 => 0.4200, std.dev.: 0.0291) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.60% (0.1458 => 0.1391, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.29% (0.0007 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.46% (0.0648 => 0.0651, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -29.14% (0.0278 => 0.0197, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.94% (0.0587 => 0.0558, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.13% (1.2000 => 1.1985, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -95.00% (0.0020 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.94% (0.0640 => 0.0646, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -22.88% (0.0236 => 0.0182, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.06% (0.7796 => 0.7791, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -21.05% (0.0095 => 0.0075, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2318.22% (0.6332 => 15.3122, std.dev.: 0.0921) MultiSource/Benchmarks/McCat/08-main/main: 48.66% (0.1831 => 0.2722, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.90% (0.1559 => 0.1467, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1498.42% (0.3344 => 5.3451, std.dev.: 0.0500) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.17% (0.2364 => 0.3219, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/mandel: 1.17% (0.0429 => 0.0434, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.89% (0.0224 => 0.0226, std.dev.: 0.0023) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0000) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4268, std.dev.: 0.0356) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0690, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4909, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3406, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1323, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4101, std.dev.: 0.0011) SingleSource/Regression/C/uint64_to_float: -24.07% (2.1832 => 1.6578, std.dev.: 0.0055) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.07% (0.0810 => 0.0924, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: 12.68% (0.1112 => 0.1253, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.84% (0.1425 => 0.1551, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.01% (0.3295 => 0.3559, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.84% (0.2180 => 0.2351, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.67% (0.2998 => 0.3228, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.36% (0.1983 => 0.2129, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.90% (0.8148 => 0.8710, std.dev.: 0.0190) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.89% (0.7473 => 0.7988, std.dev.: 0.0124) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.79% (0.2240 => 0.2392, std.dev.: 0.0042) MultiSource/Applications/viterbi/viterbi: 6.59% (0.1577 => 0.1681, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.46% (0.1905 => 0.2028, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.14% (0.2133 => 0.2264, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.98% (1.1606 => 1.2300, std.dev.: 0.0143) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.78% (0.1885 => 0.1994, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.75% (1.1685 => 1.2357, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.72% (0.2519 => 0.2663, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.47% (0.5961 => 0.6287, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.82% (0.6287 => 0.6590, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.33% (0.9435 => 0.9844, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.30% (0.5817 => 0.6067, std.dev.: 0.0093) MultiSource/Applications/treecc/treecc: 4.18% (1.9948 => 2.0781, std.dev.: 0.0048) MultiSource/Applications/Burg/burg: 4.05% (1.2222 => 1.2717, std.dev.: 0.0145) MultiSource/Applications/spiff/spiff: 3.96% (0.7950 => 0.8265, std.dev.: 0.0114) MultiSource/Applications/SIBsim4/SIBsim4: 3.83% (1.2568 => 1.3049, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.69% (1.4479 => 1.5013, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.68% (0.8611 => 0.8928, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.62% (0.8177 => 0.8473, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.48% (4.5702 => 4.7294, std.dev.: 0.0329) MultiSource/Applications/lua/lua: 3.46% (3.8189 => 3.9510, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.27% (8.6476 => 8.9301, std.dev.: 0.1061) MultiSource/Benchmarks/MallocBench/gs/gs: 3.03% (4.1305 => 4.2555, std.dev.: 0.0466) MultiSource/Applications/ClamAV/clamscan: 2.97% (14.7684 => 15.2072, std.dev.: 0.0668) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.96% (0.3717 => 0.3827, std.dev.: 0.0043) MultiSource/Applications/SPASS/SPASS: 2.92% (14.2605 => 14.6770, std.dev.: 0.0457) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.87% (0.4559 => 0.4690, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.85% (0.8007 => 0.8235, std.dev.: 0.0061) MultiSource/Applications/d/make_dparser: 2.74% (3.2366 => 3.3252, std.dev.: 0.0048) MultiSource/Applications/oggenc/oggenc: 2.73% (4.9628 => 5.0981, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.70% (0.9074 => 0.9319, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.70% (0.8338 => 0.8563, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.64% (0.8697 => 0.8927, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.58% (0.8331 => 0.8546, std.dev.: 0.0082) MultiSource/Applications/JM/ldecod/ldecod: 2.52% (6.7320 => 6.9016, std.dev.: 0.0289) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.52% (0.8261 => 0.8469, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.51% (0.8457 => 0.8669, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.46% (0.8340 => 0.8545, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 2.43% (0.9810 => 1.0048, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.39% (0.9688 => 0.9920, std.dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.35% (1.1170 => 1.1433, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.28% (0.8359 => 0.8550, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.24% (0.8048 => 0.8228, std.dev.: 0.0067) MultiSource/Applications/minisat/minisat: 2.22% (0.6834 => 0.6986, std.dev.: 0.0043) MultiSource/Applications/siod/siod: 2.21% (2.2184 => 2.2674, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.21% (2.1401 => 2.1873, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.19% (0.8712 => 0.8903, std.dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 2.17% (15.3280 => 15.6602, std.dev.: 0.0550) MultiSource/Benchmarks/PAQ8p/paq8p: 1.89% (2.3764 => 2.4214, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.77% (0.8855 => 0.9012, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.77% (0.6943 => 0.7066, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: 1.72% (31.8598 => 32.4072, std.dev.: 0.0852) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.59% (0.6586 => 0.6691, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 1.58% (8.6247 => 8.7608, std.dev.: 0.0289) MultiSource/Applications/lemon/lemon: 1.44% (1.0945 => 1.1103, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 123.62% (0.0199 => 0.0445, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/pi: 56.97% (1.5795 => 2.4793, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 18.09% (0.7597 => 0.8971, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.33% (2.9753 => 3.4611, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.69% (2.7995 => 3.2107, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.51% (5.0261 => 5.6048, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.98% (6.3772 => 7.0771, std.dev.: 0.1418) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.17% (0.3186 => 0.3478, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.17% (1.1857 => 1.2826, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 7.52% (1.7056 => 1.8339, std.dev.: 0.0107) MultiSource/Applications/SIBsim4/SIBsim4: 6.96% (3.1873 => 3.4091, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.74% (4.7794 => 5.1017, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.93% (4.5327 => 4.8013, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.86% (4.9686 => 5.2596, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.88% (6.2275 => 6.5314, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.67% (3.3761 => 3.5336, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.14% (4.9453 => 5.1500, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.01% (4.9469 => 5.1453, std.dev.: 0.0095) MultiSource/Applications/hexxagon/hexxagon: 3.94% (14.0064 => 14.5587, std.dev.: 0.0397) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.90% (1.2337 => 1.2695, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.72% (11.5690 => 11.8837, std.dev.: 0.0070) MultiSource/Applications/lambda-0_1_3/lambda: 2.68% (7.4933 => 7.6939, std.dev.: 0.0060) MultiSource/Applications/siod/siod: 2.56% (3.6643 => 3.7582, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.52% (8.2783 => 8.4872, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout/lists: 2.31% (7.3375 => 7.5073, std.dev.: 0.0187) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.25% (1.1365 => 1.1621, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.22% (4.8660 => 4.9742, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.22% (4.8362 => 4.9435, std.dev.: 0.0126) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.32% (2.4647 => 2.4972, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/ReedSolomon: 1.30% (8.5322 => 8.6435, std.dev.: 0.0130) MultiSource/Benchmarks/Olden/bh/bh: 1.22% (2.3560 => 2.3847, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: 1.13% (1.2061 => 1.2197, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.05% (3.5679 => 3.6053, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.87% (5.4641 => 4.3239, std.dev.: 0.0275) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.59% (7.2130 => 6.3051, std.dev.: 0.2879) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.26% (1.0512 => 0.9328, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: -10.77% (1.1216 => 1.0008, std.dev.: 0.0109) MultiSource/Benchmarks/mafft/pairlocalalign: -8.55% (63.1822 => 57.7770, std.dev.: 0.0251) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.89% (0.3269 => 0.3011, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.89% (4.7482 => 4.4212, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.96% (3.7148 => 3.4935, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.93% (5.4972 => 5.1714, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.12% (5.1557 => 4.8919, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.36% (4.7449 => 4.5378, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.79% (6.0224 => 5.7944, std.dev.: 0.0080) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.60% (2.8773 => 2.7736, std.dev.: 0.0122) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (28.5821 => 27.7018, std.dev.: 0.0738) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.00% (0.5807 => 0.5633, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.85% (2.6356 => 2.5604, std.dev.: 0.0200) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.78% (2.4490 => 2.3810, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.38% (9.9065 => 9.6704, std.dev.: 0.0394) MultiSource/Applications/aha/aha: -2.36% (3.3398 => 3.2611, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash2: -2.17% (3.4237 => 3.3494, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/mason/mason: -2.11% (0.5415 => 0.5301, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bisort/bisort: -1.99% (0.6636 => 0.6504, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.98% (11.5316 => 11.3035, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.56% (3.2169 => 3.1668, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.3487 => 2.3188, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.15% (5.6343 => 5.5694, std.dev.: 0.0053) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.07% (16.4461 => 16.7873, std.dev.: 0.0895) MultiSource/Applications/obsequi/Obsequi: 3.97% (1.0262 => 1.0669, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6876.63% (0.3123 => 21.7880, std.dev.: 0.0663) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.68% (0.2463 => 0.3662, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/bigfib: 0.92% (0.6010 => 0.6065, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.39% (0.3266 => 0.3344, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 2.03% (0.1969 => 0.2009, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.57% (0.1438 => 0.1475, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 4.77% (1.1329 => 1.1869, std.dev.: 0.0491) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -2.60% (0.1462 => 0.1424, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.86% (0.4164 => 0.4200, std.dev.: 0.0291) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.61% (0.1369 => 0.1391, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.56% (0.0641 => 0.0651, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.03% (0.0195 => 0.0197, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.46% (0.0578 => 0.0558, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.79% (1.1437 => 1.1985, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.03% (0.0627 => 0.0646, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.11% (0.0180 => 0.0182, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.82% (0.8017 => 0.7791, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 20.97% (0.0062 => 0.0075, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 18:07:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 20:07:05 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121113020705.514F02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5802?compare_to=5799&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5802, Order: 167790, Start Time: 2012-11-13 00:42:40, End Time: 2012-11-13 02:07:18 To: 5799, Order: 167765, Start Time: 2012-11-12 22:54:15, End Time: 2012-11-13 00:19:22 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 1 (181 on baseline) Unchanged Tests: 1040 (856 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.12% (3.7551 => 3.7971, std.dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.01% (80.9527 => 79.3218, std.dev.: 0.4748) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1008, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/salsa20: 2.40% (7.4937 => 7.6736, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/hash2: 2.09% (3.1932 => 3.2600, std.dev.: 0.0029) MultiSource/Benchmarks/llubenchmark/llu: 1.43% (3.7435 => 3.7971, std.dev.: 0.0101) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.06% (0.3821 => 0.3513, std.dev.: 0.0075) MultiSource/Benchmarks/PAQ8p/paq8p: -7.55% (2.4924 => 2.3041, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.22% (0.9542 => 0.8853, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.91% (0.3357 => 0.3125, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.75% (0.2428 => 0.2264, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.68% (0.3142 => 0.2932, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: -6.67% (0.2160 => 0.2016, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.62% (0.9852 => 0.9200, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.57% (3.5339 => 3.3017, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.53% (0.3658 => 0.3419, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: -6.53% (16.1920 => 15.1353, std.dev.: 0.0105) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.50% (0.1584 => 0.1481, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -6.48% (7.0961 => 6.6362, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.44% (1.0544 => 0.9865, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: -6.43% (0.9179 => 0.8589, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.40% (0.3812 => 0.3568, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.35% (0.1796 => 0.1682, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.34% (22.4056 => 20.9840, std.dev.: 0.0073) SingleSource/UnitTests/ObjC/synchronized: -6.31% (0.3896 => 0.3650, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -6.30% (9.2283 => 8.6472, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.29% (0.6484 => 0.6076, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: -6.29% (0.3831 => 0.3590, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.29% (0.3848 => 0.3606, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.29% (0.3880 => 0.3636, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.27% (0.4176 => 0.3914, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.27% (0.3891 => 0.3647, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.25% (0.4033 => 0.3781, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -6.23% (0.1879 => 0.1762, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: -6.19% (0.4199 => 0.3939, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.18% (1.4642 => 1.3737, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.18% (1.3722 => 1.2874, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.15% (0.3884 => 0.3645, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -6.15% (1.2515 => 1.1745, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: -6.13% (4.3330 => 4.0676, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.12% (0.2695 => 0.2530, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.12% (4.8161 => 4.5214, std.dev.: 0.0029) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.12% (0.1716 => 0.1611, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.11% (1.2784 => 1.2003, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.08% (1.6364 => 1.5369, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -6.08% (1.1450 => 1.0754, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.07% (4.0323 => 3.7874, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.06% (0.7919 => 0.7439, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: -6.05% (1.1530 => 1.0832, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.03% (4.8802 => 4.5858, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/bh/bh: -6.03% (0.2985 => 0.2805, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.03% (0.2355 => 0.2213, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.98% (1.2300 => 1.1565, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/parameter-passing: -5.96% (0.4280 => 0.4025, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.96% (4.5069 => 4.2384, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.95% (0.5478 => 0.5152, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.92% (0.5591 => 0.5260, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.92% (0.6304 => 0.5931, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.91% (0.5859 => 0.5513, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.90% (0.7524 => 0.7080, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.89% (0.6736 => 0.6339, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.89% (0.2548 => 0.2398, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.88% (0.6395 => 0.6019, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.87% (0.5805 => 0.5464, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.87% (0.5863 => 0.5519, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.87% (0.2659 => 0.2503, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.86% (0.6667 => 0.6276, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.86% (0.5849 => 0.5506, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.86% (0.5802 => 0.5462, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -5.86% (4.0594 => 3.8216, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.83% (0.4151 => 0.3909, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.83% (0.6660 => 0.6272, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.81% (1.6474 => 1.5517, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -5.80% (2.4021 => 2.2627, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.80% (0.5705 => 0.5374, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.80% (0.6052 => 0.5701, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.78% (17.1032 => 16.1149, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.77% (0.5567 => 0.5246, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.76% (0.6681 => 0.6296, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: -5.76% (0.4515 => 0.4255, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.75% (0.5857 => 0.5520, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.75% (0.5581 => 0.5260, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.75% (1.3148 => 1.2392, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -5.74% (15.5079 => 14.6173, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.72% (0.5925 => 0.5586, std.dev.: 0.0125) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.71% (6.7716 => 6.3847, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.71% (0.5569 => 0.5251, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.71% (0.3837 => 0.3618, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.70% (0.5575 => 0.5257, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.70% (0.5456 => 0.5145, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.70% (0.6440 => 0.6073, std.dev.: 0.0083) MultiSource/Benchmarks/sim/sim: -5.70% (0.3406 => 0.3212, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/methcall: -5.69% (0.3025 => 0.2853, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.69% (0.6297 => 0.5939, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.68% (0.3483 => 0.3285, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.67% (0.5168 => 0.4875, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.67% (0.5999 => 0.5659, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.67% (0.6194 => 0.5843, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.67% (0.6230 => 0.5877, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.66% (0.6676 => 0.6298, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.64% (0.7339 => 0.6925, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.64% (0.5570 => 0.5256, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -5.64% (0.4861 => 0.4587, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -5.64% (0.3194 => 0.3014, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.63% (14.2083 => 13.4077, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/ary3: -5.63% (0.3446 => 0.3252, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.62% (2.1713 => 2.0492, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/strcat: -5.62% (0.2989 => 0.2821, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: -5.62% (1.3864 => 1.3085, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/except: -5.62% (0.3026 => 0.2856, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: -5.61% (0.3581 => 0.3380, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.61% (0.5688 => 0.5369, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.60% (0.3323 => 0.3137, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.58% (0.6446 => 0.6086, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.57% (0.4916 => 0.4642, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.57% (0.3016 => 0.2848, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.57% (0.3252 => 0.3071, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.56% (0.3057 => 0.2887, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.56% (0.3255 => 0.3074, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.56% (0.7198 => 0.6798, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.55% (0.5941 => 0.5611, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.54% (0.6189 => 0.5846, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.54% (0.6033 => 0.5699, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.54% (0.6395 => 0.6041, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -5.53% (0.7447 => 0.7035, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.50% (0.8521 => 0.8052, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.50% (0.2999 => 0.2834, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.48% (0.6293 => 0.5948, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.48% (0.5329 => 0.5037, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.47% (0.3931 => 0.3716, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/moments: -5.46% (0.4248 => 0.4016, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.46% (0.7021 => 0.6638, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.45% (0.3319 => 0.3138, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -5.45% (0.3394 => 0.3209, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -5.45% (0.7982 => 0.7547, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.44% (0.4427 => 0.4186, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.44% (0.2278 => 0.2154, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: -5.44% (18.2933 => 17.2977, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: -5.44% (0.4524 => 0.4278, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.44% (0.4083 => 0.3861, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -5.43% (0.2871 => 0.2715, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -5.43% (0.3867 => 0.3657, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.42% (0.2933 => 0.2774, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.42% (0.4321 => 0.4087, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.42% (0.6260 => 0.5921, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.41% (2.2587 => 2.1364, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: -5.41% (2.1401 => 2.0243, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/random: -5.41% (0.2939 => 0.2780, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.41% (0.2903 => 0.2746, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -5.39% (3.5154 => 3.3258, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: -5.37% (0.2849 => 0.2696, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -5.34% (0.3481 => 0.3295, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.34% (0.4813 => 0.4556, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.34% (0.9557 => 0.9047, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -5.33% (0.3621 => 0.3428, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.30% (8.0126 => 7.5880, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/bigfib: -5.27% (0.6750 => 0.6394, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -5.27% (0.3205 => 0.3036, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.27% (0.3491 => 0.3307, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.19% (1.2221 => 1.1587, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.18% (5.4682 => 5.1847, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.17% (0.3849 => 0.3650, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -5.15% (0.3788 => 0.3593, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -5.14% (15.2527 => 14.4683, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/09-vor/vor: -5.14% (0.3271 => 0.3103, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: -5.13% (0.3059 => 0.2902, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.13% (0.2106 => 0.1998, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.06% (1.2210 => 1.1592, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: -5.04% (34.0927 => 32.3747, std.dev.: 0.0145) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.03% (0.2385 => 0.2265, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: -5.01% (0.6347 => 0.6029, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.96% (0.7779 => 0.7393, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -4.93% (0.8418 => 0.8003, std.dev.: 0.0057) SingleSource/UnitTests/ObjC++/property-reference-object: -4.81% (0.6441 => 0.6131, std.dev.: 0.0030) MultiSource/Applications/oggenc/oggenc: -4.48% (5.0226 => 4.7974, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.37% (0.9077 => 0.8680, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: -4.12% (1.5610 => 1.4967, std.dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -2.57% (20.7746 => 20.2415, std.dev.: 0.0075) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7573, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1728, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.82% (2.2633 => 2.1768, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.02% (1.0557 => 1.0238, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.62% (1.3096 => 1.2753, std.dev.: 0.0093) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.48% (6.5735 => 6.4759, std.dev.: 0.0006) Report Time: 2.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 19:39:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 21:39:08 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121113033908.875E52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5803?compare_to=5801&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5803, Order: 167801, Start Time: 2012-11-13 02:11:59, End Time: 2012-11-13 03:39:24 To: 5801, Order: 167785, Start Time: 2012-11-13 00:28:27, End Time: 2012-11-13 01:55:05 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 8 (98 on baseline) Performance Improvements: 4 (26 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 979 (850 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/sgefa/sgefa: 4.57% (0.3001 => 0.3138, std.dev.: 0.0033) MultiSource/Applications/hbd/hbd: 2.26% (1.4676 => 1.5007, std.dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: 2.10% (15.3122 => 15.6345, std.dev.: 0.1016) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.71% (0.8927 => 0.9080, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lambda-0_1_3/lambda: 1.95% (7.6939 => 7.8438, std.dev.: 0.0447) MultiSource/Benchmarks/llubenchmark/llu: 1.55% (1.9980 => 2.0290, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/pi: 1.33% (2.4793 => 2.5123, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.10% (4.4268 => 4.4753, std.dev.: 0.0128) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.15% (1.2300 => 1.2158, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.01% (14.5393 => 13.5200, std.dev.: 0.2746) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.32% (7.0771 => 6.7716, std.dev.: 0.0272) MultiSource/Applications/lua/lua: -2.44% (29.7911 => 29.0654, std.dev.: 0.1044) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.23% (16.7873 => 16.9943, std.dev.: 0.1054) MultiSource/Applications/obsequi/Obsequi: 0.10% (1.0669 => 1.0680, std.dev.: 0.0125) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.00% (21.7880 => 21.7888, std.dev.: 0.3494) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.41% (0.3662 => 0.3677, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/bigfib: 0.30% (0.6065 => 0.6083, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.51% (0.3344 => 0.3327, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/strcat: 0.35% (0.2009 => 0.2016, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -32.11% (0.0218 => 0.0148, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.15% (0.0426 => 0.0387, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.93% (0.0331 => 0.0318, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0315 => 0.0315, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -9.43% (0.0424 => 0.0384, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0204 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0218 => 0.0218, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.24% (0.1475 => 0.1508, std.dev.: 0.0076) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 1.43% (1.1869 => 1.2039, std.dev.: 0.0294) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.51% (0.1424 => 0.1474, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.21% (0.4200 => 0.4209, std.dev.: 0.0289) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.16% (0.1391 => 0.1435, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.46% (0.0651 => 0.0635, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 4.57% (0.0197 => 0.0206, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.17% (0.0558 => 0.0598, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.62% (1.1985 => 1.1911, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.18% (0.0646 => 0.0619, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 46.70% (0.0182 => 0.0267) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.68% (0.7791 => 0.7738, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -37.33% (0.0075 => 0.0047, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2369.13% (0.6332 => 15.6345, std.dev.: 0.1016) MultiSource/Benchmarks/McCat/08-main/main: 48.61% (0.1831 => 0.2721, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.35% (0.1559 => 0.1460, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1508.40% (0.3344 => 5.3785, std.dev.: 0.1048) SingleSource/Benchmarks/Misc-C++/Large/ray: 39.04% (0.2364 => 0.3287, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -23.21% (0.0224 => 0.0172, std.dev.: 0.0032) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4753, std.dev.: 0.0128) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0682, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4946, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3446, std.dev.: 0.0473) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1309, std.dev.: 0.0957) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4098, std.dev.: 0.0020) SingleSource/Regression/C/uint64_to_float: -23.53% (2.1832 => 1.6694, std.dev.: 0.0021) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.91% (0.0810 => 0.0947, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 13.58% (0.1112 => 0.1263, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.88% (0.8321 => 0.8977, std.dev.: 0.0206) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.24% (0.8148 => 0.8738, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.23% (0.7473 => 0.8013, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.46% (0.3295 => 0.3508, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.59% (0.6010 => 0.6346, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.28% (0.4847 => 0.5103, std.dev.: 0.0074) MultiSource/Applications/hbd/hbd: 5.17% (1.4269 => 1.5007, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.83% (0.5961 => 0.6249, std.dev.: 0.0074) MultiSource/Applications/Burg/burg: 4.79% (1.2222 => 1.2807, std.dev.: 0.0223) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.76% (1.1606 => 1.2158, std.dev.: 0.0051) MultiSource/Applications/sgefa/sgefa: 4.63% (0.2999 => 0.3138, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.45% (0.6287 => 0.6567, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.40% (0.8697 => 0.9080, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.33% (0.2519 => 0.2628, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.29% (0.4127 => 0.4304, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.18% (1.1685 => 1.2173, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 4.11% (0.8855 => 0.9219, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.03% (0.3124 => 0.3250, std.dev.: 0.0036) MultiSource/Applications/lua/lua: 3.89% (3.8189 => 3.9673, std.dev.: 0.0149) MultiSource/Applications/ClamAV/clamscan: 3.76% (14.7684 => 15.3237, std.dev.: 0.0358) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.54% (1.4479 => 1.4992, std.dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.51% (6.6074 => 6.8390, std.dev.: 0.0268) MultiSource/Applications/SPASS/SPASS: 3.37% (14.2605 => 14.7408, std.dev.: 0.1755) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.35% (0.5817 => 0.6012, std.dev.: 0.0046) MultiSource/Applications/oggenc/oggenc: 3.34% (4.9628 => 5.1287, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.26% (0.8805 => 0.9092, std.dev.: 0.0050) MultiSource/Benchmarks/nbench/nbench: 3.26% (1.1271 => 1.1638, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.22% (0.8420 => 0.8691, std.dev.: 0.0078) MultiSource/Applications/JM/lencod/lencod: 3.14% (15.3280 => 15.8091, std.dev.: 0.0337) MultiSource/Applications/d/make_dparser: 3.06% (3.2366 => 3.3356, std.dev.: 0.0240) MultiSource/Applications/minisat/minisat: 3.06% (0.6834 => 0.7043, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 3.05% (0.3503 => 0.3610, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.05% (4.1763 => 4.3038, std.dev.: 0.0310) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.05% (0.4783 => 0.4929, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.99% (4.4873 => 4.6214, std.dev.: 0.0236) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.98% (0.8716 => 0.8976, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: 2.90% (4.1305 => 4.2502, std.dev.: 0.0414) MultiSource/Applications/SIBsim4/SIBsim4: 2.86% (1.2568 => 1.2927, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.84% (4.4880 => 4.6153, std.dev.: 0.0320) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.82% (0.7932 => 0.8156, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 2.76% (0.9810 => 1.0081, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.75% (0.9069 => 0.9318, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.70% (0.4559 => 0.4682, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: 2.67% (0.7557 => 0.7759, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.67% (0.8007 => 0.8221, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.51% (0.8611 => 0.8827, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.51% (0.9688 => 0.9931, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.50% (0.8050 => 0.8251, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.48% (0.8597 => 0.8810, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.34% (0.8066 => 0.8255, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.31% (1.2423 => 1.2710, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.30% (4.5702 => 4.6752, std.dev.: 0.0222) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.29% (0.9039 => 0.9246, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.27% (0.8048 => 0.8231, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.24% (0.8885 => 0.9084, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.19% (0.8359 => 0.8542, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.15% (0.8177 => 0.8353, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.14% (0.8316 => 0.8494, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.14% (2.1401 => 2.1859, std.dev.: 0.0105) MultiSource/Applications/lemon/lemon: 2.14% (1.0945 => 1.1179, std.dev.: 0.0073) MultiSource/Benchmarks/Bullet/bullet: 2.08% (31.8598 => 32.5226, std.dev.: 0.2551) MultiSource/Benchmarks/mafft/pairlocalalign: 1.95% (8.6247 => 8.7931, std.dev.: 0.0473) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.51% (1.2602 => 1.2792, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 100.00% (0.0199 => 0.0398, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/pi: 59.06% (1.5795 => 2.5123, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.16% (2.9753 => 3.4561, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.59% (0.7597 => 0.8781, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.70% (2.7995 => 3.2109, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.49% (5.0261 => 5.6036, std.dev.: 0.0156) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.48% (1.1857 => 1.2744, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/queens: 7.08% (1.7056 => 1.8264, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.76% (4.7794 => 5.1024, std.dev.: 0.0234) MultiSource/Applications/SIBsim4/SIBsim4: 6.31% (3.1873 => 3.3885, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.18% (6.3772 => 6.7716, std.dev.: 0.0272) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.93% (0.3186 => 0.3375, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.87% (4.5327 => 4.7986, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.73% (4.9686 => 5.2532, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/richards_benchmark: 5.67% (1.3037 => 1.3776, std.dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: 4.68% (7.4933 => 7.8438, std.dev.: 0.0447) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.54% (6.2275 => 6.5104, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.51% (3.3761 => 3.5284, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.14% (4.9453 => 5.1501, std.dev.: 0.0134) MultiSource/Applications/hexxagon/hexxagon: 4.07% (14.0064 => 14.5761, std.dev.: 0.0073) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.51% (1.2337 => 1.2770, std.dev.: 0.0088) MultiSource/Applications/siod/siod: 3.21% (3.6643 => 3.7819, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.80% (11.5690 => 11.8933, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.79% (0.3587 => 0.3687, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.75% (8.2783 => 8.5061, std.dev.: 0.0251) SingleSource/Benchmarks/Shootout/lists: 2.35% (7.3375 => 7.5101, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.09% (4.8362 => 4.9371, std.dev.: 0.0322) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.93% (1.1365 => 1.1584, std.dev.: 0.0070) MultiSource/Benchmarks/llubenchmark/llu: 1.62% (1.9967 => 2.0290, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.53% (2.4647 => 2.5024, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/neural/neural: 1.32% (1.0841 => 1.0984, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.20% (3.5679 => 3.6108, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.16% (4.0473 => 4.0941, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.80% (5.4641 => 4.3273, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.57% (7.2130 => 6.1622, std.dev.: 0.2383) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.86% (1.0512 => 0.9370, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: -10.22% (1.1216 => 1.0070, std.dev.: 0.0080) MultiSource/Benchmarks/mafft/pairlocalalign: -8.52% (63.1822 => 57.7965, std.dev.: 0.2638) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.68% (14.6451 => 13.5200, std.dev.: 0.2746) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.95% (4.7482 => 4.4184, std.dev.: 0.0550) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.30% (0.3269 => 0.3063, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.00% (3.7148 => 3.4918, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.90% (5.4972 => 5.1731, std.dev.: 0.0264) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.11% (5.1557 => 4.8921, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.25% (2.4490 => 2.3450, std.dev.: 0.0254) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.18% (4.7449 => 4.5466, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.90% (2.8773 => 2.7651, std.dev.: 0.0377) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.45% (6.0224 => 5.8145, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.38% (0.5807 => 0.5611, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.98% (2.6356 => 2.5570, std.dev.: 0.0250) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.94% (28.5821 => 27.7418, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -2.87% (0.3937 => 0.3824, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.70% (9.9065 => 9.6394, std.dev.: 0.1001) MultiSource/Applications/lua/lua: -2.57% (29.8330 => 29.0654, std.dev.: 0.1044) MultiSource/Benchmarks/FreeBench/mason/mason: -2.27% (0.5415 => 0.5292, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: -2.20% (3.4237 => 3.3483, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.01% (2.3487 => 2.3016, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.96% (11.5316 => 11.3055, std.dev.: 0.0566) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.60% (4.9994 => 4.9192, std.dev.: 0.0093) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 3.33% (16.4461 => 16.9943, std.dev.: 0.1054) MultiSource/Applications/obsequi/Obsequi: 4.07% (1.0262 => 1.0680, std.dev.: 0.0125) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6876.88% (0.3123 => 21.7888, std.dev.: 0.3494) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.29% (0.2463 => 0.3677, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/bigfib: 1.21% (0.6010 => 0.6083, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.87% (0.3266 => 0.3327, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/strcat: 2.39% (0.1969 => 0.2016, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 20.33% (0.0123 => 0.0148, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.15% (0.0408 => 0.0387, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 25.20% (0.0254 => 0.0318, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0384 => 0.0384, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 4.87% (0.1438 => 0.1508, std.dev.: 0.0076) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 6.27% (1.1329 => 1.2039, std.dev.: 0.0294) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.82% (0.1462 => 0.1474, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.08% (0.4164 => 0.4209, std.dev.: 0.0289) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.82% (0.1369 => 0.1435, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.94% (0.0641 => 0.0635, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.64% (0.0195 => 0.0206, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.46% (0.0578 => 0.0598, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.14% (1.1437 => 1.1911, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.28% (0.0627 => 0.0619, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.48% (0.8017 => 0.7738, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -24.19% (0.0062 => 0.0047, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 19:55:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 21:55:08 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121113035508.735C52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5804?compare_to=5802&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5804, Order: 167801, Start Time: 2012-11-13 02:30:30, End Time: 2012-11-13 03:55:24 To: 5802, Order: 167790, Start Time: 2012-11-13 00:42:40, End Time: 2012-11-13 02:07:18 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 1 (182 on baseline) Unchanged Tests: 1040 (856 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.28% (79.3218 => 80.3360, std.dev.: 0.0902) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.12% (1.0218 => 1.0104, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.80% (2.0478 => 2.1051, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.4937 => 7.6744, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/hash2: 2.22% (3.1932 => 3.2642, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.24% (0.3821 => 0.3506, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: -7.99% (2.4924 => 2.2932, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: -7.00% (0.3357 => 0.3122, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.92% (0.2428 => 0.2260, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.78% (0.9542 => 0.8895, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.68% (3.5339 => 3.2979, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.58% (0.9852 => 0.9204, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -6.57% (0.2160 => 0.2018, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.51% (0.1796 => 0.1679, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -6.50% (0.9179 => 0.8582, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.49% (0.3142 => 0.2938, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -6.47% (7.0961 => 6.6372, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/ReedSolomon: -6.44% (0.1879 => 0.1758, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.40% (22.4056 => 20.9707, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.40% (0.3658 => 0.3424, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: -6.40% (16.1920 => 15.1563, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.39% (1.0544 => 0.9870, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.36% (9.2283 => 8.6415, std.dev.: 0.0031) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.31% (0.1584 => 0.1484, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -6.31% (4.3330 => 4.0596, std.dev.: 0.0048) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.29% (0.1716 => 0.1608, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.22% (0.6484 => 0.6081, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: -6.19% (0.1761 => 0.1652, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -6.15% (1.1450 => 1.0746, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.14% (1.3722 => 1.2879, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.12% (0.5591 => 0.5249, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.10% (1.2784 => 1.2004, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.09% (1.4642 => 1.3751, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.08% (4.0323 => 3.7871, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.08% (0.7339 => 0.6893, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.06% (0.7919 => 0.7439, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.05% (0.5802 => 0.5451, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.04% (4.8161 => 4.5250, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.04% (4.5069 => 4.2346, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.01% (0.6667 => 0.6266, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.01% (0.6052 => 0.5688, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.99% (0.7524 => 0.7073, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -5.99% (1.2515 => 1.1765, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.99% (0.5478 => 0.5150, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.98% (0.5849 => 0.5499, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.97% (0.6395 => 0.6013, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.94% (0.6446 => 0.6063, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.94% (0.5857 => 0.5509, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.94% (0.5859 => 0.5511, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.94% (0.6230 => 0.5860, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.94% (0.6736 => 0.6336, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.94% (0.2695 => 0.2535, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.93% (0.6304 => 0.5930, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.92% (4.8802 => 4.5912, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.91% (0.5569 => 0.5240, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.91% (0.5705 => 0.5368, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.91% (1.6474 => 1.5501, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.89% (1.2300 => 1.1575, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.88% (1.6364 => 1.5401, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.88% (0.5863 => 0.5518, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.87% (0.5570 => 0.5243, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.87% (0.5456 => 0.5136, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.84% (0.3406 => 0.3207, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.84% (0.5925 => 0.5579, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.84% (0.6681 => 0.6291, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.82% (0.5805 => 0.5467, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.81% (0.2548 => 0.2400, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.80% (0.5567 => 0.5244, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.80% (0.6189 => 0.5830, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.80% (0.6660 => 0.6274, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -5.79% (2.4021 => 2.2630, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: -5.78% (17.1032 => 16.1140, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: -5.78% (0.4515 => 0.4254, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.78% (0.6297 => 0.5933, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.78% (0.6440 => 0.6068, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.75% (0.6676 => 0.6292, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.73% (0.2355 => 0.2220, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.73% (0.6194 => 0.5839, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.72% (0.5575 => 0.5256, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.72% (14.2083 => 13.3957, std.dev.: 0.0143) MultiSource/Benchmarks/McCat/08-main/main: -5.72% (0.2659 => 0.2507, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.72% (0.5581 => 0.5262, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.71% (0.6395 => 0.6030, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: -5.70% (1.3864 => 1.3074, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: -5.70% (0.3581 => 0.3377, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -5.70% (0.2985 => 0.2815, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.69% (6.7716 => 6.3865, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.69% (0.6260 => 0.5904, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -5.68% (15.5079 => 14.6273, std.dev.: 0.0213) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.67% (0.7021 => 0.6623, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.67% (1.3148 => 1.2403, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.66% (0.4151 => 0.3916, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.66% (0.3483 => 0.3286, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.66% (0.5941 => 0.5605, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.65% (0.7198 => 0.6791, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: -5.64% (0.7447 => 0.7027, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.64% (0.6033 => 0.5693, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.62% (0.3255 => 0.3072, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -5.62% (4.0594 => 3.8313, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.60% (0.8521 => 0.8044, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.57% (0.5688 => 0.5371, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.57% (0.3931 => 0.3712, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -5.55% (0.3026 => 0.2858, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.53% (0.6293 => 0.5945, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.50% (0.3016 => 0.2850, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.50% (0.3057 => 0.2889, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -5.49% (0.3025 => 0.2859, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.47% (0.3837 => 0.3627, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/hash2: -5.47% (0.4861 => 0.4595, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.47% (0.4916 => 0.4647, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.47% (0.2999 => 0.2835, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -5.46% (34.0927 => 32.2302, std.dev.: 0.0270) MultiSource/Applications/lambda-0_1_3/lambda: -5.46% (0.7982 => 0.7546, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: -5.46% (0.3446 => 0.3258, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.45% (0.3194 => 0.3020, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: -5.44% (3.5154 => 3.3240, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/fibo: -5.43% (0.2871 => 0.2715, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.40% (0.5999 => 0.5675, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.37% (2.2587 => 2.1373, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.36% (0.5168 => 0.4891, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.35% (0.2933 => 0.2776, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -5.34% (0.2939 => 0.2782, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.34% (0.2903 => 0.2748, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -5.34% (0.2849 => 0.2697, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -5.32% (0.2989 => 0.2830, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: -5.32% (1.1530 => 1.0917, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.31% (0.2278 => 0.2157, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: -5.30% (0.3205 => 0.3035, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.30% (2.1713 => 2.0563, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.29% (0.4083 => 0.3867, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary2: -5.29% (0.3481 => 0.3297, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.27% (5.4682 => 5.1798, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary: -5.27% (0.3394 => 0.3215, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: -5.25% (18.2933 => 17.3322, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/lists1: -5.25% (0.3867 => 0.3664, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.24% (0.3319 => 0.3145, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -5.18% (0.4248 => 0.4028, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.17% (0.4427 => 0.4198, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.17% (0.3849 => 0.3650, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -5.16% (0.3621 => 0.3434, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: -5.16% (0.6750 => 0.6402, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -5.14% (2.1401 => 2.0301, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.14% (1.2221 => 1.1593, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.12% (0.5329 => 0.5056, std.dev.: 0.0040) MultiSource/Applications/ClamAV/clamscan: -5.12% (15.2527 => 14.4720, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.11% (0.9557 => 0.9069, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.10% (0.3252 => 0.3086, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.09% (8.0126 => 7.6049, std.dev.: 0.0103) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.08% (1.2210 => 1.1590, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.04% (0.3491 => 0.3315, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -5.03% (0.3059 => 0.2905, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.03% (0.4813 => 0.4571, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: -4.98% (0.3271 => 0.3108, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sieve: -4.94% (0.3788 => 0.3601, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.69% (0.3323 => 0.3167, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.63% (0.3891 => 0.3711, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.60% (0.4176 => 0.3984, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.57% (0.3896 => 0.3718, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.53% (0.3884 => 0.3708, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.52% (0.3848 => 0.3674, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/for-in: -4.51% (0.4033 => 0.3851, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.51% (0.3812 => 0.3640, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -4.51% (0.4524 => 0.4320, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/property: -4.50% (0.4199 => 0.4010, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.46% (0.3831 => 0.3660, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -4.43% (0.8418 => 0.8045, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: -4.41% (0.3880 => 0.3709, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -4.39% (0.4280 => 0.4092, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -4.38% (5.0226 => 4.8027, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.26% (0.4321 => 0.4137, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: -4.25% (1.5610 => 1.4946, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/Hello: -3.94% (0.6347 => 0.6097, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -3.79% (0.6441 => 0.6197, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -3.73% (0.7779 => 0.7489, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.29% (0.9077 => 0.8778, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -2.70% (20.7746 => 20.2132, std.dev.: 0.0247) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7553, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -8.73% (1.2842 => 1.1721, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7060, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.82% (2.2633 => 2.1769, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.21% (1.3096 => 1.2675, std.dev.: 0.0119) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4725, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 20:28:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 22:28:06 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121113042806.E419E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5805?compare_to=5779&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5805, Order: 167801, Start Time: 2012-11-13 02:19:15, End Time: 2012-11-13 04:28:19 To: 5779, Order: 167691, Start Time: 2012-11-11 08:34:22, End Time: 2012-11-12 08:56:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (8 on baseline) New Passes: 40 (17 on baseline) Performance Regressions: 114 (176 on baseline) Performance Improvements: 5 (37 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 10 (2 on baseline) Unchanged Tests: 873 (668 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/ldecod/ldecod: 52.59% (6.3511 => 9.6914, std.dev.: 0.0285) MultiSource/Applications/JM/lencod/lencod: 62.34% (19.7322 => 32.0325, std.dev.: 0.0929) MultiSource/Applications/oggenc/oggenc: 346630.00% (0.0020 => 6.9346, std.dev.: 0.0153) MultiSource/Applications/siod/siod: 74.36% (1.5840 => 2.7619, std.dev.: 0.0119) MultiSource/Applications/sqlite3/sqlite3: 3671.52% (0.5281 => 19.9174, std.dev.: 0.0608) MultiSource/Benchmarks/Bullet/bullet: 49.69% (48.1763 => 72.1129, std.dev.: 0.0683) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.60% (0.8596 => 0.9421, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.89% (5.0720 => 5.8777, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.70% (10.5484 => 11.2552, std.dev.: 0.0417) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 29.01% (1.4166 => 1.8275, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 67.78% (0.3035 => 0.5092, std.dev.: 0.0199) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 454.30% (0.0302 => 0.1674, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/voronoi/voronoi: 78.04% (0.1949 => 0.3470, std.dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 264521.05% (0.0019 => 5.0278, std.dev.: 0.0575) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1111047.37% (0.0019 => 21.1118, std.dev.: 0.1376) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 33.11% (0.2561 => 0.3409, std.dev.: 0.0120) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.38% (5.2436 => 5.8925, std.dev.: 0.0285) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 42.75% (1.1093 => 1.5835, std.dev.: 0.0101) MultiSource/Benchmarks/nbench/nbench: 376.18% (0.2955 => 1.4071, std.dev.: 0.0238) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1886020.00% (0.0020 => 37.7224, std.dev.: 0.0750) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/Large/sphereflake MultiSource/Applications/JM/ldecod/ldecod: 149200.00% (0.0001 => 0.1493, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 7933100.00% (0.0001 => 7.9332, std.dev.: 0.0280) MultiSource/Applications/siod/siod: 3293400.00% (0.0001 => 3.2935, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 4691300.00% (0.0001 => 4.6914, std.dev.: 0.0068) MultiSource/Benchmarks/Bullet/bullet: 8361000.00% (0.0001 => 8.3611, std.dev.: 0.0306) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2327200.00% (0.0001 => 2.3273, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4100.00% (0.0001 => 0.0042, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 238000.00% (0.0001 => 0.2381, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 100.00% (0.0001 => 0.0002, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 300.00% (0.0001 => 0.0004) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 20800.00% (0.0001 => 0.0209, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 314600.00% (0.0001 => 0.3147, std.dev.: 0.0150) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2013100.00% (0.0001 => 2.0132, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2284100.00% (0.0001 => 2.2842, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 2779000.00% (0.0001 => 2.7791, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3400.00% (0.0001 => 0.0035, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 12124700.00% (0.0001 => 12.1248, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 579800.00% (0.0001 => 0.5799, std.dev.: 0.0238) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.65% (2.9167 => 3.0524, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 27.75% (9.6769 => 12.3620, std.dev.: 0.0451) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.90% (0.6090 => 0.7119, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 14.88% (0.0672 => 0.0772, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 14.72% (0.1148 => 0.1317, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 14.43% (0.6382 => 0.7303, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/heapsort: 13.37% (0.3067 => 0.3477, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: 12.79% (49.3232 => 55.6339, std.dev.: 0.1519) SingleSource/UnitTests/ObjC/property: 12.63% (0.4308 => 0.4852, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.28% (0.1156 => 0.1298, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 11.53% (0.3998 => 0.4459, std.dev.: 0.0075) SingleSource/UnitTests/ObjC/exceptions-3: 11.08% (0.3891 => 0.4322, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.91% (0.7132 => 0.7910, std.dev.: 0.0166) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.20% (0.1882 => 0.2074, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.05% (2.4293 => 2.6735, std.dev.: 0.0168) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.25% (0.2194 => 0.2397, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.94% (0.3693 => 0.4023, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.48% (1.7594 => 1.9086, std.dev.: 0.0155) MultiSource/Applications/kimwitu++/kc: 8.25% (19.3582 => 20.9549, std.dev.: 0.0603) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.22% (1.5471 => 1.6743, std.dev.: 0.0050) MultiSource/Applications/treecc/treecc: 8.22% (2.2490 => 2.4339, std.dev.: 0.0185) SingleSource/Regression/C++/ofstream_ctor: 8.21% (0.3120 => 0.3376, std.dev.: 0.0099) MultiSource/Benchmarks/MallocBench/gs/gs: 8.11% (4.6566 => 5.0344, std.dev.: 0.0155) MultiSource/Applications/Burg/burg: 8.07% (1.3124 => 1.4183, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.96% (2.2217 => 2.3985, std.dev.: 0.0242) MultiSource/Applications/d/make_dparser: 7.81% (3.7215 => 4.0121, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.80% (5.9052 => 6.3660, std.dev.: 0.0682) MultiSource/Benchmarks/mafft/pairlocalalign: 7.58% (10.4868 => 11.2818, std.dev.: 0.0235) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.51% (4.3068 => 4.6301, std.dev.: 0.0285) MultiSource/Applications/lua/lua: 7.30% (4.3249 => 4.6407, std.dev.: 0.0690) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.22% (4.7565 => 5.1000, std.dev.: 0.0228) MultiSource/Applications/SIBsim4/SIBsim4: 7.01% (1.5227 => 1.6294, std.dev.: 0.0375) MultiSource/Applications/SPASS/SPASS: 7.01% (16.8711 => 18.0530, std.dev.: 0.0503) MultiSource/Applications/hbd/hbd: 6.86% (1.7150 => 1.8326, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.82% (1.0960 => 1.1708, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.67% (1.4595 => 1.5568, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.58% (16.2463 => 17.3158, std.dev.: 0.0487) MultiSource/Applications/hexxagon/hexxagon: 6.44% (1.3672 => 1.4553, std.dev.: 0.0087) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.21% (7.8968 => 8.3871, std.dev.: 0.0115) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.60% (1.3018 => 1.3747, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.80% (0.6751 => 0.7075, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.97% (0.9462 => 0.9838, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 60.52% (3.7612 => 6.0373, std.dev.: 0.0619) MultiSource/Applications/SPASS/SPASS: 31.04% (11.1742 => 14.6424, std.dev.: 0.1302) MultiSource/Benchmarks/McCat/09-vor/vor: 27.74% (0.1157 => 0.1478, std.dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 25.12% (13.3923 => 16.7561, std.dev.: 0.1335) MultiSource/Applications/minisat/minisat: 21.13% (9.2022 => 11.1468, std.dev.: 0.0489) SingleSource/Benchmarks/Shootout/ary3: 19.65% (3.7027 => 4.4304, std.dev.: 0.0982) SingleSource/Benchmarks/Shootout-C++/moments: 18.57% (0.1206 => 0.1430, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ary3: 18.38% (3.7157 => 4.3988, std.dev.: 0.0883) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.01% (5.4908 => 6.4798, std.dev.: 0.0599) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.81% (2.0361 => 2.3377, std.dev.: 0.0644) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.91% (10.3510 => 11.7908, std.dev.: 0.1258) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.49% (42.8980 => 48.6844, std.dev.: 0.1907) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 12.81% (54.4701 => 61.4465, std.dev.: 0.1074) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.70% (8.2979 => 9.2684, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 11.06% (79.1985 => 87.9548, std.dev.: 0.7247) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 10.66% (6.2853 => 6.9551, std.dev.: 0.0461) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.51% (3.8878 => 4.2963, std.dev.: 0.0201) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 10.46% (3.7646 => 4.1585, std.dev.: 0.0527) SingleSource/Benchmarks/McGill/chomp: 10.22% (1.1604 => 1.2790, std.dev.: 0.0190) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.79% (1.2840 => 1.4097, std.dev.: 0.0448) SingleSource/Benchmarks/Shootout/heapsort: 9.32% (3.8671 => 4.2274, std.dev.: 0.0167) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 9.03% (9.0617 => 9.8804, std.dev.: 0.0449) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 8.89% (5.4557 => 5.9409, std.dev.: 0.1262) SingleSource/Benchmarks/Dhrystone/fldry: 7.93% (1.8473 => 1.9938, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.92% (8.8955 => 9.6004, std.dev.: 0.0555) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 7.86% (29.6965 => 32.0317, std.dev.: 0.2165) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.35% (1.7052 => 1.8306, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout/hash: 6.34% (4.8618 => 5.1699, std.dev.: 0.0308) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.12% (1.3166 => 1.3972, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.42% (4.2115 => 4.4398, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/bh/bh: 4.91% (1.9334 => 2.0283, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 4.76% (5.1742 => 5.4206, std.dev.: 0.0437) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.31% (5.2422 => 5.4681, std.dev.: 0.0107) MultiSource/Applications/lua/lua: 4.25% (26.1106 => 27.2200, std.dev.: 0.0736) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 3.99% (0.4514 => 0.4694, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.89% (1.7115 => 1.7780, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.87% (4.9215 => 5.1119, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.82% (2.7539 => 2.8592, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: 3.65% (83.5653 => 86.6113, std.dev.: 0.0843) SingleSource/Benchmarks/Shootout-C++/hash2: 3.52% (3.3690 => 3.4877, std.dev.: 0.0092) MultiSource/Benchmarks/NPB-serial/is/is: 3.45% (8.5128 => 8.8066, std.dev.: 0.0371) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.39% (6.0923 => 6.2990, std.dev.: 0.0740) SingleSource/Benchmarks/Misc/oourafft: 3.25% (7.5699 => 7.8163, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.24% (3.6839 => 3.8034, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 3.23% (3.1320 => 3.2332, std.dev.: 0.0089) MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.06% (2.1409 => 2.2064, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.81% (4.8670 => 5.0036, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.59% (4.7417 => 4.8647, std.dev.: 0.0162) SingleSource/Benchmarks/Dhrystone/dry: 2.46% (2.4223 => 2.4819, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.30% (7.1992 => 7.3645, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.12% (4.1937 => 4.2826, std.dev.: 0.0232) SingleSource/Benchmarks/Shootout-C++/lists: 2.10% (12.4234 => 12.6838, std.dev.: 0.0140) MultiSource/Benchmarks/mafft/pairlocalalign: 2.08% (27.6889 => 28.2649, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.06% (5.6026 => 5.7180, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.87% (5.3964 => 5.4973, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.80% (2.1153 => 2.1534, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.73% (3.5668 => 3.6285, std.dev.: 0.0031) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.73% (1.5938 => 1.6213, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.68% (3.4391 => 3.4968, std.dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: 1.62% (2.5132 => 2.5540, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.62% (8.7911 => 8.9335, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.60% (8.7396 => 8.8795, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.56% (4.4008 => 4.4693, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.53% (5.3399 => 5.4218, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.51% (6.0332 => 6.1240, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/sieve: 1.47% (5.2136 => 5.2903, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 1.44% (3.8397 => 3.8948, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/sieve: 1.42% (2.4804 => 2.5157, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.40% (5.3823 => 5.4575, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.28% (1.3253 => 1.3423, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.20% (4.4772 => 4.5310, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/methcall: 1.17% (10.8957 => 11.0230, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.07% (4.0644 => 4.1080, std.dev.: 0.0098) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -12.45% (0.4593 => 0.4021, std.dev.: 0.0121) MultiSource/Benchmarks/PAQ8p/paq8p: -1.81% (11.6118 => 11.4014, std.dev.: 0.0593) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/lists: -3.32% (6.2401 => 6.0328, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.10% (1.0562 => 1.0446, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.07% (1.0217 => 1.0108, std.dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Applications/ClamAV/clamscan: 27.34% (27.4584 => 34.9665, std.dev.: 0.1024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 198.51% (1.7259 => 5.1519, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 200.05% (1.7351 => 5.2061, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Applications/ClamAV/clamscan: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 133500.00% (0.0001 => 0.1336, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.67% (0.0417 => 0.0474, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.74% (0.0674 => 0.0669, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: - (0.0001 => 0.0001) MultiSource/Benchmarks/Olden/power/power: -1.18% (499.8624 => 493.9646, std.dev.: 0.3669) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Applications/ClamAV/clamscan: 57.68% (22.1758 => 34.9665, std.dev.: 0.1024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.75% (5.3526 => 5.1519, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.33% (5.3855 => 5.2061, std.dev.: 0.0024) New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Applications/ClamAV/clamscan: -99.94% (0.1629 => 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.92% (4.3882 => 0.0474, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -99.97% (0.3987 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43702.84% (1.1277 => 493.9646, std.dev.: 0.3669) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -99.80% (0.0506 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 211.61% (0.5229 => 1.6294, std.dev.: 0.0375) MultiSource/Applications/SPASS/SPASS: 20.44% (14.9895 => 18.0530, std.dev.: 0.0503) MultiSource/Applications/kimwitu++/kc: 48.04% (14.1553 => 20.9549, std.dev.: 0.0603) MultiSource/Benchmarks/MallocBench/gs/gs: 22.48% (4.1105 => 5.0344, std.dev.: 0.0155) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 43.33% (1.1048 => 1.5835, std.dev.: 0.0101) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 426.98% (7.1582 => 37.7224, std.dev.: 0.0750) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.83% (3.4629 => 6.3660, std.dev.: 0.0682) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.76% (0.6222 => 1.0376, std.dev.: 0.0538) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10918.33% (0.0720 => 7.9332, std.dev.: 0.0280) MultiSource/Applications/SIBsim4/SIBsim4: 3894700.00% (0.0001 => 3.8948, std.dev.: 0.0062) MultiSource/Applications/SPASS/SPASS: 14642300.00% (0.0001 => 14.6424, std.dev.: 0.1302) MultiSource/Applications/kimwitu++/kc: 54200.00% (0.0001 => 0.0543, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 64900.00% (0.0001 => 0.0650, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 579800.00% (0.0001 => 0.5799, std.dev.: 0.0238) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10089300.00% (0.0001 => 10.0894, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6479700.00% (0.0001 => 6.4798, std.dev.: 0.0599) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1785.99% (1.1194 => 21.1118, std.dev.: 0.1376) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 71.11% (2.9384 => 5.0278, std.dev.: 0.0575) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 59.56% (7.0540 => 11.2552, std.dev.: 0.0417) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 51.94% (8.1363 => 12.3620, std.dev.: 0.0451) MultiSource/Applications/JM/lencod/lencod: 46.02% (21.9371 => 32.0325, std.dev.: 0.0929) MultiSource/Benchmarks/FreeBench/distray/distray: 44.79% (0.1056 => 0.1529, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/almabench: 40.96% (0.0730 => 0.1029, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 38.62% (0.1432 => 0.1985, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/n-body: 35.12% (0.0746 => 0.1008, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 32.44% (0.1566 => 0.2074, std.dev.: 0.0038) SingleSource/UnitTests/vla: 29.58% (0.0355 => 0.0460, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/voronoi/voronoi: 28.52% (0.2700 => 0.3470, std.dev.: 0.0078) SingleSource/Benchmarks/Stanford/Queens: 26.57% (0.0414 => 0.0524, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.78% (0.1032 => 0.1298, std.dev.: 0.0014) MultiSource/Benchmarks/llubenchmark/llu: 25.11% (0.0462 => 0.0578, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 24.86% (0.3886 => 0.4852, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/matrix: 24.69% (0.0818 => 0.1020, std.dev.: 0.0021) SingleSource/Benchmarks/Stanford/Oscar: 23.90% (0.0636 => 0.0788, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.56% (0.1940 => 0.2397, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/exceptions-3: 22.92% (0.3516 => 0.4322, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: 22.20% (0.0482 => 0.0589, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.07% (0.0793 => 0.0968, std.dev.: 0.0038) MultiSource/Applications/Burg/burg: 21.83% (1.1642 => 1.4183, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/08-main/main: 21.73% (0.2554 => 0.3109, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/wordfreq: 21.65% (0.3307 => 0.4023, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.39% (2.2024 => 2.6735, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/heapsort: 21.07% (0.2872 => 0.3477, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists1: 21.04% (0.3684 => 0.4459, std.dev.: 0.0075) MultiSource/Applications/lambda-0_1_3/lambda: 20.87% (0.7433 => 0.8984, std.dev.: 0.0378) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.77% (0.1584 => 0.1913, std.dev.: 0.0093) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.69% (0.2107 => 0.2543, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 20.53% (14.3668 => 17.3158, std.dev.: 0.0487) MultiSource/Applications/oggenc/oggenc: 20.41% (5.7591 => 6.9346, std.dev.: 0.0153) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.39% (0.8172 => 0.9838, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 20.35% (1.5859 => 1.9086, std.dev.: 0.0155) MultiSource/Applications/d/make_dparser: 20.29% (3.3354 => 4.0121, std.dev.: 0.0084) MultiSource/Applications/siod/siod: 20.24% (2.2969 => 2.7619, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/perlin: 20.15% (0.0536 => 0.0644, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 20.06% (2.0273 => 2.4339, std.dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.90% (0.9765 => 1.1708, std.dev.: 0.0132) MultiSource/Applications/lua/lua: 19.84% (3.8723 => 4.6407, std.dev.: 0.0690) MultiSource/Applications/aha/aha: 19.81% (0.1151 => 0.1379, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/tsp/tsp: 19.74% (0.1175 => 0.1407, std.dev.: 0.0054) MultiSource/Applications/viterbi/viterbi: 19.68% (0.1555 => 0.1861, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/espresso/espresso: 19.59% (4.2646 => 5.1000, std.dev.: 0.0228) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 19.30% (1.3050 => 1.5568, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 19.19% (0.6675 => 0.7956, std.dev.: 0.0269) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 18.96% (3.8922 => 4.6301, std.dev.: 0.0285) MultiSource/Benchmarks/mafft/pairlocalalign: 18.95% (9.4845 => 11.2818, std.dev.: 0.0235) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 18.86% (4.9449 => 5.8777, std.dev.: 0.0118) MultiSource/Benchmarks/nbench/nbench: 18.84% (1.1840 => 1.4071, std.dev.: 0.0238) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.76% (0.1125 => 0.1336, std.dev.: 0.0061) SingleSource/UnitTests/2006-12-11-LoadConstants: 18.72% (0.1143 => 0.1357, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.55% (1.5415 => 1.8275, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.48% (0.3441 => 0.4077, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 18.29% (0.5981 => 0.7075, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 18.22% (0.1114 => 0.1317, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 18.05% (0.1695 => 0.2001, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.02% (1.4186 => 1.6743, std.dev.: 0.0050) MultiSource/Applications/spiff/spiff: 17.82% (0.7835 => 0.9231, std.dev.: 0.0293) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.81% (5.0018 => 5.8925, std.dev.: 0.0285) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.58% (0.1337 => 0.1572, std.dev.: 0.0037) MultiSource/Applications/hbd/hbd: 17.45% (1.5603 => 1.8326, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.03% (0.8067 => 0.9441, std.dev.: 0.0242) MultiSource/Applications/lemon/lemon: 17.02% (1.0722 => 1.2547, std.dev.: 0.0297) SingleSource/UnitTests/ObjC/for-in: 16.84% (0.3694 => 0.4316, std.dev.: 0.0128) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.75% (0.0842 => 0.0983, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 16.72% (0.0640 => 0.0747, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 16.70% (0.4203 => 0.4905, std.dev.: 0.0198) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.59% (0.5569 => 0.6493, std.dev.: 0.0297) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 16.40% (0.1695 => 0.1973, std.dev.: 0.0094) MultiSource/Applications/minisat/minisat: 16.32% (0.7115 => 0.8276, std.dev.: 0.0314) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.29% (0.8101 => 0.9421, std.dev.: 0.0137) SingleSource/Regression/C++/ofstream_ctor: 16.21% (0.2905 => 0.3376, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.07% (2.0665 => 2.3985, std.dev.: 0.0242) SingleSource/Benchmarks/Shootout-C++/strcat: 16.00% (0.2831 => 0.3284, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/hash2: 16.00% (0.4620 => 0.5359, std.dev.: 0.0189) MultiSource/Applications/sqlite3/sqlite3: 15.93% (17.1811 => 19.9174, std.dev.: 0.0608) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.90% (1.1861 => 1.3747, std.dev.: 0.0177) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.84% (0.0953 => 0.1104, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.71% (0.0834 => 0.0965, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.59% (0.0648 => 0.0749, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.51% (0.4636 => 0.5355, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.40% (0.1117 => 0.1289, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/mst/mst: 15.39% (0.1163 => 0.1342, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.18% (0.6450 => 0.7429, std.dev.: 0.0241) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 15.15% (0.5860 => 0.6748, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.90% (0.0886 => 0.1018, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/ReedSolomon: 14.89% (0.2049 => 0.2354, std.dev.: 0.0074) MultiSource/Applications/sgefa/sgefa: 14.63% (0.3109 => 0.3564, std.dev.: 0.0096) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.20% (0.3543 => 0.4046, std.dev.: 0.0103) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3121 => 0.3562, std.dev.: 0.0162) MultiSource/Benchmarks/Bullet/bullet: 14.02% (63.2438 => 72.1129, std.dev.: 0.0683) SingleSource/UnitTests/ObjC/parameter-passing: 13.95% (0.3927 => 0.4475, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.85% (0.3162 => 0.3600, std.dev.: 0.0117) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.75% (0.1062 => 0.1208, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.69% (0.4615 => 0.5247, std.dev.: 0.0160) MultiSource/Benchmarks/Olden/bh/bh: 13.62% (0.3092 => 0.3513, std.dev.: 0.0109) SingleSource/Benchmarks/McGill/chomp: 13.60% (0.1655 => 0.1880, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 13.32% (1.2842 => 1.4553, std.dev.: 0.0087) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.30% (0.2271 => 0.2573, std.dev.: 0.0095) MultiSource/Benchmarks/McCat/18-imp/imp: 13.20% (0.3423 => 0.3875, std.dev.: 0.0106) SingleSource/UnitTests/ObjC/exceptions: 13.11% (0.3828 => 0.4330, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.99% (0.5105 => 0.5768, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/football/football: 12.78% (0.8921 => 1.0061, std.dev.: 0.0160) SingleSource/UnitTests/ObjC++/property-reference: 12.59% (0.7326 => 0.8248, std.dev.: 0.0229) SingleSource/UnitTests/ObjC/exceptions-4: 12.14% (0.3543 => 0.3973, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/synchronized: 12.02% (0.3561 => 0.3989, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-2: 11.98% (0.3497 => 0.3916, std.dev.: 0.0102) SingleSource/UnitTests/ObjC++/Hello: 11.56% (0.5925 => 0.6610, std.dev.: 0.0214) SingleSource/UnitTests/ObjC++/property-reference-object: 11.41% (0.6030 => 0.6718, std.dev.: 0.0095) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.39% (0.1906 => 0.2123, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.94% (0.3865 => 0.4288, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/lists: 10.34% (0.3422 => 0.3776, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/oourafft: 10.02% (0.3282 => 0.3611, std.dev.: 0.0049) MultiSource/Benchmarks/PAQ8p/paq8p: 9.97% (10.3673 => 11.4014, std.dev.: 0.0593) SingleSource/Benchmarks/Shootout-C++/sieve: 9.83% (0.3603 => 0.3957, std.dev.: 0.0123) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.57% (2.2022 => 2.4129, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.89% (0.2891 => 0.3148, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 8.84% (0.3098 => 0.3372, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 8.47% (0.2714 => 0.2944, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 6.39% (0.3131 => 0.3331, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.00% (0.3935 => 0.4171, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.34% (7.9617 => 8.3871, std.dev.: 0.0115) SingleSource/UnitTests/Vector/constpool: 2.71% (54.1659 => 55.6339, std.dev.: 0.1519) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.79% (4.3953 => 11.0230, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 147.67% (5.3999 => 13.3741, std.dev.: 0.0008) MultiSource/Benchmarks/llubenchmark/llu: 59.80% (3.7781 => 6.0373, std.dev.: 0.0619) MultiSource/Benchmarks/McCat/09-vor/vor: 28.08% (0.1154 => 0.1478, std.dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 24.69% (13.4384 => 16.7561, std.dev.: 0.1335) SingleSource/Benchmarks/Shootout-C++/moments: 23.38% (0.1159 => 0.1430, std.dev.: 0.0069) MultiSource/Applications/minisat/minisat: 22.28% (9.1159 => 11.1468, std.dev.: 0.0489) SingleSource/Benchmarks/Shootout/ary3: 19.76% (3.6994 => 4.4304, std.dev.: 0.0982) SingleSource/Benchmarks/Shootout-C++/ary3: 18.18% (3.7221 => 4.3988, std.dev.: 0.0883) SingleSource/Benchmarks/Misc/oourafft: 17.60% (6.6465 => 7.8163, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.86% (1.1145 => 1.3024, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 15.02% (0.1298 => 0.1493, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.82% (2.0360 => 2.3377, std.dev.: 0.0644) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.96% (10.3460 => 11.7908, std.dev.: 0.1258) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.15% (0.2944 => 0.3331, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.68% (2.8904 => 3.2279, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 11.50% (3.8532 => 4.2963, std.dev.: 0.0201) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.60% (8.6802 => 9.6004, std.dev.: 0.0555) SingleSource/Benchmarks/Shootout-C++/hash2: 10.45% (3.1578 => 3.4877, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/richards_benchmark: 10.33% (1.1396 => 1.2573, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.81% (1.2838 => 1.4097, std.dev.: 0.0448) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: 9.73% (3.8526 => 4.2274, std.dev.: 0.0167) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.38% (1.7254 => 1.8873, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.95% (0.9540 => 1.0108, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.71% (4.2280 => 4.4693, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/hash: 5.32% (4.9088 => 5.1699, std.dev.: 0.0308) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 4.52% (1.9405 => 2.0283, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.50% (3.6395 => 3.8034, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 4.32% (26.0924 => 27.2200, std.dev.: 0.0736) MultiSource/Benchmarks/nbench/nbench: 4.13% (11.6436 => 12.1248, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.78% (1.7133 => 1.7780, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 3.62% (1.4460 => 1.4984, std.dev.: 0.0157) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.44% (0.4162 => 0.4305, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 3.19% (3.1334 => 3.2332, std.dev.: 0.0089) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.99% (2.1424 => 2.2064, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/dry: 2.92% (2.4116 => 2.4819, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.16% (1.3677 => 1.3972, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 2.11% (3.1595 => 3.2262, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: 1.84% (1.9577 => 1.9938, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: 1.82% (85.0658 => 86.6113, std.dev.: 0.0843) MultiSource/Benchmarks/mafft/pairlocalalign: 1.51% (27.8444 => 28.2649, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.50% (6.5088 => 6.6062, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/sieve: 1.47% (5.2139 => 5.2903, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.29% (1.0313 => 1.0446, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 1.20% (2.4858 => 2.5157, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 1.19% (12.5348 => 12.6838, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0502, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.02% (4.6441 => 4.6914, std.dev.: 0.0068) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1674, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.15% (5.2763 => 1.2584, std.dev.: 0.0381) SingleSource/Benchmarks/Misc/salsa20: -75.73% (0.8651 => 0.2100, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -45.19% (0.1622 => 0.0889, std.dev.: 0.0088) MultiSource/Applications/JM/ldecod/ldecod: -7.14% (10.4361 => 9.6914, std.dev.: 0.0285) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.52% (1.7609 => 1.6637, std.dev.: 0.0267) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -47.75% (0.0400 => 0.0209, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.25% (4.5009 => 2.7791, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.16% (2.6546 => 2.0132, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -21.94% (10.7105 => 8.3611, std.dev.: 0.0306) MultiSource/Benchmarks/FreeBench/mason/mason: -19.20% (0.2161 => 0.1746, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4237, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2842, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.75% (32.5116 => 29.0165, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/mandel-2: -10.64% (1.5373 => 1.3738, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.76% (1.5660 => 1.4288, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -7.92% (9.5636 => 8.8066, std.dev.: 0.0371) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.51% (19.9488 => 18.4515, std.dev.: 0.3934) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.95% (4.8142 => 4.4796, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.84% (3.2416 => 3.0524, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.58% (2.7294 => 2.5771, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.73% (1.5835 => 1.5086, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.65% (0.2497 => 0.2381, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -4.24% (6.2999 => 6.0328, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.52% (1.6805 => 1.6213, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.31% (0.9957 => 0.9627, std.dev.: 0.0053) MultiSource/Benchmarks/sim/sim: -3.04% (5.0483 => 4.8948, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.37% (0.4808 => 0.4694, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.79% (8.1563 => 8.0100, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6772, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -1.46% (10.2830 => 10.1332, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.03% (0.1485 => 0.1336, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.38% (0.2116 => 0.0669, std.dev.: 0.0011) Report Time: 3.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 21:22:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 23:22:36 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121113052236.0C7662A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5806?compare_to=5803&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5806, Order: 167813, Start Time: 2012-11-13 03:56:25, End Time: 2012-11-13 05:22:51 To: 5803, Order: 167801, Start Time: 2012-11-13 02:11:59, End Time: 2012-11-13 03:39:24 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 6 (86 on baseline) Performance Improvements: 4 (26 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 981 (862 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.25% (0.8251 => 0.8354, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 14.96% (19.7846 => 22.7452, std.dev.: 0.3424) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.06% (0.3375 => 0.3512, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/except: 2.53% (0.4866 => 0.4989, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.83% (6.1622 => 6.2748, std.dev.: 0.0436) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 1.53% (0.8781 => 0.8915, std.dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.87% (0.7101 => 0.6968, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.12% (0.9092 => 0.8990, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.69% (2.9680 => 2.9177, std.dev.: 0.0152) MultiSource/Benchmarks/llubenchmark/llu: -1.63% (2.0290 => 1.9960, std.dev.: 0.0118) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -1.15% (16.9943 => 16.7992, std.dev.: 0.0633) MultiSource/Applications/obsequi/Obsequi: -1.73% (1.0680 => 1.0495, std.dev.: 0.0131) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.04% (21.7888 => 21.7795, std.dev.: 0.2106) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.33% (0.3677 => 0.3665, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -0.35% (0.6083 => 0.6062, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.66% (0.3327 => 0.3305, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/strcat: -0.45% (0.2016 => 0.2007, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 16.22% (0.0148 => 0.0172, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 8.27% (0.0387 => 0.0419, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.77% (0.0318 => 0.0330, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.63% (0.0315 => 0.0313, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0204 => 0.0203, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -13.30% (0.0218 => 0.0189, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -2.45% (0.1508 => 0.1471, std.dev.: 0.0084) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: -2.52% (1.2039 => 1.1736, std.dev.: 0.0469) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.20% (0.1474 => 0.1477, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.76% (0.4209 => 0.4135, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.05% (0.1435 => 0.1450, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.94% (0.0635 => 0.0610, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 18.93% (0.0206 => 0.0245, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.35% (0.0598 => 0.0566, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.24% (1.1911 => 1.1940, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 14.81% (0.0027 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.04% (0.0619 => 0.0644, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.24% (0.0267 => 0.0253, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.75% (0.7738 => 0.7796, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 2.13% (0.0047 => 0.0048, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2301.56% (0.6332 => 15.2067, std.dev.: 0.3709) MultiSource/Benchmarks/McCat/08-main/main: 48.61% (0.1831 => 0.2721, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.80% (0.1559 => 0.1453, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1498.77% (0.3344 => 5.3463, std.dev.: 0.0926) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.68% (0.2364 => 0.3231, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: 0.70% (0.0429 => 0.0432, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.02% (0.0224 => 0.0233, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0018) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4653, std.dev.: 0.0474) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0696, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4950, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3448, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1343, std.dev.: 0.0185) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4089, std.dev.: 0.0102) SingleSource/Regression/C/uint64_to_float: -23.67% (2.1832 => 1.6664, std.dev.: 0.0023) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.57% (0.0810 => 0.0928, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/tsp/tsp: 13.31% (0.1112 => 0.1260, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.20% (0.0773 => 0.0875, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.21% (0.2180 => 0.2359, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.31% (0.7473 => 0.8019, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.91% (0.6010 => 0.6425, std.dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.88% (0.1905 => 0.2036, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.71% (0.4847 => 0.5172, std.dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.41% (0.3137 => 0.3338, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.92% (0.2279 => 0.2414, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.48% (0.2519 => 0.2657, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.15% (0.8148 => 0.8568, std.dev.: 0.0101) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.13% (0.2240 => 0.2355, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.97% (0.2133 => 0.2239, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 4.61% (1.2222 => 1.2785, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.14% (0.5817 => 0.6058, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.78% (0.8050 => 0.8354, std.dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 3.77% (0.2999 => 0.3112, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.51% (0.4127 => 0.4272, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.11% (1.4479 => 1.4930, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 3.11% (0.8927 => 0.9205, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.04% (4.1763 => 4.3034, std.dev.: 0.0487) MultiSource/Applications/SIBsim4/SIBsim4: 2.94% (1.2568 => 1.2938, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.79% (1.1685 => 1.2011, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.74% (0.8611 => 0.8847, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.73% (0.9688 => 0.9952, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.72% (0.4559 => 0.4683, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.71% (0.6227 => 0.6396, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.68% (0.8331 => 0.8554, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.62% (0.5191 => 0.5327, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.61% (0.8518 => 0.8740, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.55% (0.8359 => 0.8572, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.54% (0.8597 => 0.8815, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/05-eks/eks: 2.52% (0.4397 => 0.4508, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.44% (0.8007 => 0.8202, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.43% (13.1811 => 13.5018, std.dev.: 0.1187) MultiSource/Applications/d/make_dparser: 2.42% (3.2366 => 3.3150, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.40% (0.8457 => 0.8660, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.33% (0.9074 => 0.9285, std.dev.: 0.0074) MultiSource/Benchmarks/Bullet/bullet: 2.25% (31.8598 => 32.5759, std.dev.: 0.1019) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.24% (0.8261 => 0.8446, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.22% (1.6386 => 1.6749, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.11% (0.9056 => 0.9247, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.11% (0.8066 => 0.8236, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.10% (0.8805 => 0.8990, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.04% (0.8885 => 0.9066, std.dev.: 0.0037) MultiSource/Applications/siod/siod: 2.02% (2.2184 => 2.2632, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/football/football: 2.00% (0.8768 => 0.8943, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 1.88% (8.6247 => 8.7866, std.dev.: 0.0425) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.74% (0.9039 => 0.9196, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.72% (0.8656 => 0.8805, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.15% (0.8995 => 0.9098, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 103.52% (0.0199 => 0.0405, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/pi: 58.88% (1.5795 => 2.5095, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.35% (0.7597 => 0.8915, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.35% (2.9753 => 3.4617, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.52% (2.7995 => 3.2061, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6086, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.23% (0.3186 => 0.3512, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.00% (1.1857 => 1.2805, std.dev.: 0.0050) SingleSource/Benchmarks/McGill/queens: 7.15% (1.7056 => 1.8276, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.68% (4.7794 => 5.0985, std.dev.: 0.0510) MultiSource/Applications/SIBsim4/SIBsim4: 6.32% (3.1873 => 3.3887, std.dev.: 0.0253) SingleSource/Benchmarks/Misc/richards_benchmark: 6.12% (1.3037 => 1.3835, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.86% (4.5327 => 4.7985, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.82% (4.9686 => 5.2579, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 4.72% (7.4933 => 7.8469, std.dev.: 0.0632) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.61% (6.2275 => 6.5147, std.dev.: 0.0262) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.43% (3.3761 => 3.5258, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.20% (4.9453 => 5.1531, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.96% (4.9469 => 5.1426, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 3.86% (14.0064 => 14.5471, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.65% (0.3587 => 0.3718, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.88% (1.2337 => 1.2692, std.dev.: 0.0071) MultiSource/Applications/siod/siod: 2.84% (3.6643 => 3.7685, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.82% (11.5690 => 11.8947, std.dev.: 0.0170) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.55% (4.8362 => 4.9596, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.44% (8.2783 => 8.4804, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout/lists: 2.30% (7.3375 => 7.5063, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.22% (4.8660 => 4.9739, std.dev.: 0.0172) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.55% (1.1365 => 1.1541, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/neural/neural: 1.33% (1.0841 => 1.0985, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.30% (3.5679 => 3.6144, std.dev.: 0.0014) SingleSource/Benchmarks/Stanford/FloatMM: 1.25% (0.8807 => 0.8917, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: 1.18% (8.5322 => 8.6326, std.dev.: 0.0299) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.18% (2.4647 => 2.4937, std.dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.05% (5.4641 => 4.3140, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.01% (7.2130 => 6.2748, std.dev.: 0.0436) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.25% (1.0512 => 0.9329, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.13% (14.6451 => 13.3086, std.dev.: 0.1466) MultiSource/Benchmarks/mafft/pairlocalalign: -8.50% (63.1822 => 57.8097, std.dev.: 0.1113) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.88% (4.7482 => 4.4217, std.dev.: 0.0297) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.45% (0.3269 => 0.3058, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.96% (3.7148 => 3.4933, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.79% (5.4972 => 5.1789, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.04% (5.1557 => 4.8959, std.dev.: 0.0093) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.93% (2.8773 => 2.7641, std.dev.: 0.0310) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.83% (2.4490 => 2.3552, std.dev.: 0.0343) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.75% (6.0224 => 5.7965, std.dev.: 0.0116) MultiSource/Applications/lua/lua: -3.25% (29.8330 => 28.8635, std.dev.: 0.0549) MultiSource/Benchmarks/Prolangs-C++/life/life: -3.24% (2.6356 => 2.5502, std.dev.: 0.0140) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.20% (0.5807 => 0.5621, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (28.5821 => 27.6787, std.dev.: 0.0428) MultiSource/Applications/aha/aha: -2.55% (3.3398 => 3.2547, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.52% (9.9065 => 9.6572, std.dev.: 0.0854) MultiSource/Benchmarks/Olden/bisort/bisort: -2.26% (0.6636 => 0.6486, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash2: -2.25% (3.4237 => 3.3466, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.98% (11.5316 => 11.3031, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.60% (4.9994 => 4.9195, std.dev.: 0.0211) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.3487 => 2.3159, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.34% (3.2169 => 3.1737, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.29% (5.6343 => 5.5615, std.dev.: 0.0042) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.15% (16.4461 => 16.7992, std.dev.: 0.0633) MultiSource/Applications/obsequi/Obsequi: 2.27% (1.0262 => 1.0495, std.dev.: 0.0131) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6873.90% (0.3123 => 21.7795, std.dev.: 0.2106) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.80% (0.2463 => 0.3665, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 0.87% (0.6010 => 0.6062, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.19% (0.3266 => 0.3305, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/strcat: 1.93% (0.1969 => 0.2007, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 39.84% (0.0123 => 0.0172, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.70% (0.0408 => 0.0419, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 5.00% (0.0180 => 0.0189, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.29% (0.1438 => 0.1471, std.dev.: 0.0084) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: 3.59% (1.1329 => 1.1736, std.dev.: 0.0469) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.03% (0.1462 => 0.1477, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.70% (0.4164 => 0.4135, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.92% (0.1369 => 0.1450, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.84% (0.0641 => 0.0610, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 25.64% (0.0195 => 0.0245, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.08% (0.0578 => 0.0566, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.40% (1.1437 => 1.1940, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.71% (0.0627 => 0.0644, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 40.56% (0.0180 => 0.0253, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.76% (0.8017 => 0.7796, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -22.58% (0.0062 => 0.0048, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 21:42:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 23:42:19 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121113054219.8B6ED2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5807?compare_to=5800&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5807, Order: 167801, Start Time: 2012-11-13 02:27:08, End Time: 2012-11-13 05:42:35 To: 5800, Order: 167753, Start Time: 2012-11-12 22:23:08, End Time: 2012-11-13 01:38:40 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (175 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (716 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.05% (2.4422 => 2.4679, std.dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.12% (0.0625 => 0.0882, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.46% (0.1063 => 0.1408, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 29.26% (0.0475 => 0.0614, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.41% (0.2969 => 0.3753, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.40% (0.1106 => 0.1398, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.19% (0.0714 => 0.0901, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 25.09% (1.5932 => 1.9930, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.01% (0.4139 => 0.5174, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.95% (0.4253 => 0.5314, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 24.30% (0.1107 => 0.1376, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.11% (0.4994 => 0.6198, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.98% (0.5900 => 0.7315, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.92% (0.5000 => 0.6196, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.63% (0.0584 => 0.0722, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.82% (0.1021 => 0.1254, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.72% (0.1620 => 0.1988, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.41% (0.0897 => 0.1098, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 22.37% (0.0599 => 0.0733, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.48% (0.0633 => 0.0769, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.44% (0.0541 => 0.0657, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.34% (0.0642 => 0.0779, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.31% (0.1103 => 0.1338, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.23% (0.0584 => 0.0708, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 21.20% (0.0948 => 0.1149, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.96% (0.3903 => 0.4721, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.94% (0.1003 => 0.1213, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.92% (0.0822 => 0.0994) MultiSource/Benchmarks/Olden/health/health: 20.83% (0.0821 => 0.0992, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.61% (0.0495 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 20.57% (0.1619 => 0.1952, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 20.53% (0.0604 => 0.0728, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.53% (0.1549 => 0.1867, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.26% (0.1604 => 0.1929, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 19.64% (0.0947 => 0.1133, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.63% (0.1462 => 0.1749, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 19.55% (0.0808 => 0.0966, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.31% (0.3890 => 0.4641, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.17% (0.2014 => 0.2400, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 19.05% (0.1218 => 0.1450, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 18.96% (0.4029 => 0.4793, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 18.93% (0.5826 => 0.6929, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.77% (1.3152 => 1.5621, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.46% (0.2736 => 0.3241, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 18.41% (0.5889 => 0.6973, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 18.34% (0.0698 => 0.0826, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 18.27% (0.1505 => 0.1780, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.11% (0.1088 => 0.1285, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.02% (0.0605 => 0.0714, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.01% (3.5627 => 4.2043, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.00% (0.2866 => 0.3382, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.98% (0.0573 => 0.0676, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 17.87% (0.5546 => 0.6537, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.72% (1.6211 => 1.9084, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.66% (0.0572 => 0.0673, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.63% (0.1968 => 0.2315, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.50% (0.1160 => 0.1363, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 17.47% (1.8794 => 2.2077, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.37% (0.4658 => 0.5467, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 17.31% (0.1421 => 0.1667, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.25% (0.5026 => 0.5893, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.06% (0.3271 => 0.3829, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 16.96% (1.0781 => 1.2609, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.94% (0.2875 => 0.3362, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.91% (0.2738 => 0.3201, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.88% (0.4361 => 0.5097, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.83% (4.4195 => 5.1635, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.80% (2.7292 => 3.1877, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 16.76% (0.9697 => 1.1322, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.59% (0.3930 => 0.4582, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference: 16.39% (0.7171 => 0.8346, std.dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 16.32% (4.2109 => 4.8983, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 16.32% (0.2714 => 0.3157, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/bh/bh: 16.28% (0.1284 => 0.1493, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.23% (1.9694 => 2.2890, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: 16.22% (0.2725 => 0.3167, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 16.15% (0.2780 => 0.3229, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.05% (0.2729 => 0.3167, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.02% (1.9966 => 2.3165, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/random: 16.02% (0.2803 => 0.3252, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 15.97% (0.2811 => 0.3260, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 15.96% (0.2750 => 0.3189, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 15.95% (0.3004 => 0.3483, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.87% (0.3195 => 0.3702, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 15.82% (0.2813 => 0.3258, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.80% (0.2792 => 0.3233, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 15.76% (0.2823 => 0.3268, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 15.68% (0.9909 => 1.1463, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: 15.67% (0.3096 => 0.3581, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.63% (0.2911 => 0.3366, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.60% (0.1090 => 0.1260, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.57% (2.0673 => 2.3891, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 15.42% (0.2075 => 0.2395, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 15.41% (23.5202 => 27.1452, std.dev.: 0.0107) SingleSource/UnitTests/ObjC/for-in: 15.39% (0.3496 => 0.4034, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 15.32% (0.3460 => 0.3990, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.28% (0.3488 => 0.4021, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 15.26% (0.3446 => 0.3972, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 15.21% (0.3465 => 0.3992, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 15.19% (0.3469 => 0.3996, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 15.16% (0.2566 => 0.2955, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 15.14% (0.3442 => 0.3963, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 15.12% (0.3267 => 0.3761, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 14.95% (0.3317 => 0.3813, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/ary: 14.95% (0.3258 => 0.3745, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.93% (0.3060 => 0.3517, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.87% (0.3362 => 0.3862, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 14.80% (0.3643 => 0.4182, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 14.79% (1.4269 => 1.6380, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 14.77% (0.3650 => 0.4189, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 14.72% (0.3724 => 0.4272, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 14.71% (0.3678 => 0.4219, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 14.64% (0.3348 => 0.3838, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.60% (0.3124 => 0.3580, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 14.50% (2.1653 => 2.4793, std.dev.: 0.0019) MultiSource/Applications/treecc/treecc: 14.44% (0.7875 => 0.9012, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.37% (0.3625 => 0.4146, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.35% (0.3282 => 0.3753, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 14.28% (4.6177 => 5.2773, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 14.25% (0.0758 => 0.0866, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 14.18% (0.3477 => 0.3970, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 14.14% (0.3726 => 0.4253, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 14.04% (2.1013 => 2.3964, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.89% (0.3845 => 0.4379, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 13.88% (0.4251 => 0.4841, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 13.84% (0.4146 => 0.4720, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.82% (0.3690 => 0.4200, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.66% (0.3981 => 0.4525, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.63% (0.2040 => 0.2318, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 13.23% (0.2691 => 0.3047, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 13.13% (0.5012 => 0.5670, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 12.72% (5.5417 => 6.2465, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.32% (0.6435 => 0.7228, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.08% (0.1383 => 0.1550, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 11.73% (0.6634 => 0.7412, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 11.32% (0.3498 => 0.3894, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.19% (0.1028 => 0.1143, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 11.04% (0.4847 => 0.5382, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.03% (0.2068 => 0.2296, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.96% (0.2737 => 0.3037, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.73% (0.3084 => 0.3415, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 10.50% (0.2391 => 0.2642, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 10.45% (2.0346 => 2.2472, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: 10.25% (0.3336 => 0.3678, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.08% (0.2103 => 0.2315, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.87% (4.6926 => 5.1090, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.75% (0.5361 => 0.5830, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.71% (11.6398 => 12.6535, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.49% (0.5584 => 0.6058, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.17% (0.7426 => 0.8033, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 6.97% (11.9555 => 12.7892, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.78% (0.3792 => 0.4011, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 9.42% (0.2802 => 0.3066, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 7.49% (0.2122 => 0.2281, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6118, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.28% (0.3693 => 0.3888, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6714, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-2: 4.74% (1.8057 => 1.8913, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1706, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/dry: 4.13% (14.0481 => 14.6285, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2001, std.dev.: 0.0077) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2220, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.47% (7.1849 => 7.2906, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3051, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5794, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.88% (25.4195 => 16.5531, std.dev.: 0.0278) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9740, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7978, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: -7.12% (0.2402 => 0.2231, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.75% (11.2080 => 10.7878, std.dev.: 0.0157) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0054) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7745, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: -2.91% (17.2379 => 16.7358, std.dev.: 0.0668) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8636, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5737, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4954, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.20% (105.3826 => 104.1152, std.dev.: 0.0359) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0428, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 21:43:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 12 Nov 2012 23:43:19 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121113054319.A11232A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5808?compare_to=5804&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5808, Order: 167814, Start Time: 2012-11-13 04:18:28, End Time: 2012-11-13 05:43:33 To: 5804, Order: 167801, Start Time: 2012-11-13 02:30:30, End Time: 2012-11-13 03:55:24 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (179 on baseline) Unchanged Tests: 1041 (859 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.10% (1.2675 => 1.2815, std.dev.: 0.0038) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.29% (1.2783 => 1.3715, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1007, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/salsa20: 2.48% (7.4937 => 7.6799, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 2.08% (3.1932 => 3.2597, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.14% (0.3821 => 0.3510, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.27% (2.4924 => 2.3112, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.70% (0.9542 => 0.8903, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.46% (0.3142 => 0.2939, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -6.43% (0.3357 => 0.3141, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.26% (0.2428 => 0.2276) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.18% (0.3658 => 0.3432, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.12% (0.6484 => 0.6087, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.11% (0.2355 => 0.2211, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: -6.11% (16.1920 => 15.2022, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.10% (1.0544 => 0.9901, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.10% (3.5339 => 3.3185, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/oourafft: -6.06% (0.2160 => 0.2029, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.02% (0.9852 => 0.9259, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -6.00% (9.2283 => 8.6743, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/football/football: -5.97% (0.9179 => 0.8631, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.97% (1.3722 => 1.2903, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -5.97% (7.0961 => 6.6726, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/ReedSolomon: -5.96% (0.1879 => 0.1767, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.86% (1.2784 => 1.2035, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.80% (22.4056 => 21.1062, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.80% (4.0323 => 3.7986, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.79% (0.1796 => 0.1692, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: -5.76% (1.1450 => 1.0790, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.75% (4.8161 => 4.5394, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/gs/gs: -5.74% (4.3330 => 4.0842, std.dev.: 0.0069) SingleSource/Benchmarks/McGill/chomp: -5.74% (0.1761 => 0.1660, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.71% (1.2300 => 1.1598, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.63% (4.8802 => 4.6056, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.62% (0.5857 => 0.5528, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: -5.61% (1.1530 => 1.0883, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.61% (1.4642 => 1.3821, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.60% (0.2695 => 0.2544, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -5.60% (1.2515 => 1.1814, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: -5.60% (17.1032 => 16.1457, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.55% (0.6681 => 0.6310, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.55% (4.5069 => 4.2567, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.53% (0.5591 => 0.5282, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.53% (0.5863 => 0.5539, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.52% (0.7919 => 0.7482, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.51% (1.6364 => 1.5463, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.49% (0.5569 => 0.5263, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.49% (0.6736 => 0.6366, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: -5.49% (0.3896 => 0.3682, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.49% (0.6230 => 0.5888, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -5.48% (0.3848 => 0.3637, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.48% (0.3812 => 0.3603, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -5.48% (0.3831 => 0.3621, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.47% (0.7198 => 0.6804, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.47% (0.6304 => 0.5959, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.47% (0.8521 => 0.8055, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.46% (0.6297 => 0.5953, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.46% (0.3406 => 0.3220, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/for-in: -5.45% (0.4033 => 0.3813, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.44% (0.5859 => 0.5540, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.44% (0.6395 => 0.6047, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: -5.44% (0.3880 => 0.3669, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.43% (0.5705 => 0.5395, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.43% (14.2083 => 13.4369, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.43% (0.5805 => 0.5490, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.42% (0.5478 => 0.5181, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -5.39% (0.2985 => 0.2824, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.38% (0.7339 => 0.6944, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -5.36% (0.4176 => 0.3952, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.36% (1.3864 => 1.3121, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.36% (0.3884 => 0.3676, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.35% (1.6474 => 1.5592, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.35% (0.3891 => 0.3683, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.34% (0.5802 => 0.5492, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.34% (0.3483 => 0.3297, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.33% (0.5849 => 0.5537, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.33% (0.5999 => 0.5679, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: -5.33% (0.3581 => 0.3390, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.33% (0.5925 => 0.5609, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.33% (0.7524 => 0.7123, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.30% (0.6676 => 0.6322, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.30% (0.2999 => 0.2840, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.30% (0.6395 => 0.6056, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.30% (6.7716 => 6.4128, std.dev.: 0.0148) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.30% (0.2548 => 0.2413, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.29% (0.6052 => 0.5732, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.28% (0.6189 => 0.5862, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -5.28% (1.3148 => 1.2454, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: -5.28% (0.7447 => 0.7054, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.25% (0.4916 => 0.4658, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -5.24% (15.5079 => 14.6953, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.23% (0.5581 => 0.5289, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: -5.23% (0.2659 => 0.2520, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.23% (0.5567 => 0.5276, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.23% (0.6660 => 0.6312, std.dev.: 0.0123) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.22% (0.2278 => 0.2159, std.dev.: 0.0011) MultiSource/Applications/lua/lua: -5.21% (4.0594 => 3.8479, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.20% (0.6667 => 0.6320, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.20% (0.6194 => 0.5872, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: -5.19% (0.4199 => 0.3981, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: -5.19% (3.5154 => 3.3330, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.18% (0.5575 => 0.5286, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.18% (0.6293 => 0.5967, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: -5.16% (0.4515 => 0.4282, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: -5.16% (0.3026 => 0.2870, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.15% (0.5688 => 0.5395, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.14% (1.2221 => 1.1593, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.13% (0.6446 => 0.6115, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -5.12% (0.4861 => 0.4612, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.12% (0.5570 => 0.5285, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.11% (0.5168 => 0.4904, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.10% (0.3255 => 0.3089, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -5.08% (34.0927 => 32.3596, std.dev.: 0.0380) SingleSource/Benchmarks/Shootout-C++/objinst: -5.07% (0.3194 => 0.3032, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.06% (8.0126 => 7.6070, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.06% (1.2210 => 1.1592, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.06% (0.5456 => 0.5180, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.04% (0.3016 => 0.2864, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.02% (0.3025 => 0.2873, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.02% (0.6033 => 0.5730, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -5.02% (2.4021 => 2.2816, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.02% (0.6440 => 0.6117, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.01% (0.4151 => 0.3943, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.99% (0.3849 => 0.3657, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.99% (0.3931 => 0.3735, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.99% (0.7021 => 0.6671, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.97% (0.3057 => 0.2905, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -4.97% (15.2527 => 14.4945, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.97% (0.5941 => 0.5646, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.95% (0.3837 => 0.3647, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.92% (0.5329 => 0.5067, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.91% (2.1713 => 2.0647, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.89% (0.3252 => 0.3093, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (0.2871 => 0.2731, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -4.87% (0.4248 => 0.4041, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.85% (0.3319 => 0.3158, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.84% (0.2933 => 0.2791, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -4.84% (0.4280 => 0.4073, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.83% (0.9557 => 0.9095, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: -4.83% (0.2939 => 0.2797, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -4.83% (0.3481 => 0.3313, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.82% (0.4083 => 0.3886, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.81% (0.4427 => 0.4214, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.81% (0.2849 => 0.2712, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -4.78% (0.2989 => 0.2846, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -4.76% (0.3867 => 0.3683, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary: -4.74% (0.3394 => 0.3233, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: -4.72% (2.1401 => 2.0390, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/wc: -4.71% (0.3205 => 0.3054, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.70% (0.3491 => 0.3327, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.70% (0.4813 => 0.4587, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -4.67% (0.3788 => 0.3611, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.67% (5.4682 => 5.2129, std.dev.: 0.0218) SingleSource/Benchmarks/Shootout-C++/lists: -4.67% (0.3621 => 0.3452, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.64% (2.2587 => 2.1538, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.62% (0.2903 => 0.2769, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -4.59% (0.6750 => 0.6440, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -4.58% (0.3059 => 0.2919, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -4.56% (0.3271 => 0.3122, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: -4.55% (0.7982 => 0.7619, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: -4.53% (0.4524 => 0.4319, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: -4.43% (18.2933 => 17.4832, std.dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: -4.32% (5.0226 => 4.8054, std.dev.: 0.0050) MultiSource/Applications/spiff/spiff: -4.31% (0.8418 => 0.8055, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.30% (0.4321 => 0.4135, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.30% (0.3323 => 0.3180, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/Hello: -4.22% (0.6347 => 0.6079, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.21% (0.6441 => 0.6170, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.17% (0.7779 => 0.7455, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.99% (0.9077 => 0.8715, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: -3.54% (1.5610 => 1.5057, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -2.59% (20.7746 => 20.2369, std.dev.: 0.0258) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7536, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/richards_benchmark: -8.66% (1.2842 => 1.1730, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.94% (1.7753 => 1.7054, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: -3.79% (2.2633 => 2.1775, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.15% (1.3096 => 1.2815, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4717, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0001) Report Time: 2.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 23:05:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 01:05:44 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121113070544.3B3B42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5809?compare_to=5806&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5809, Order: 167816, Start Time: 2012-11-13 05:39:50, End Time: 2012-11-13 07:06:00 To: 5806, Order: 167813, Start Time: 2012-11-13 03:56:25, End Time: 2012-11-13 05:22:51 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 11 (110 on baseline) Performance Improvements: 1 (28 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 979 (836 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.10% (0.8568 => 0.8834, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.87% (0.8562 => 0.8808, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.45% (0.6071 => 0.6220, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.19% (0.8416 => 0.8600, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/gs/gs: 1.69% (4.2249 => 4.2961, std.dev.: 0.0054) MultiSource/Applications/lua/lua: 1.58% (3.8971 => 3.9587, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.27% (0.8185 => 0.8289, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.09% (15.2067 => 15.3724, std.dev.: 0.0587) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.75% (21.4365 => 22.4557, std.dev.: 0.1237) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.78% (13.3086 => 13.5449, std.dev.: 0.0679) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.10% (1.4105 => 1.4260, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -5.37% (8.6619 => 8.1964, std.dev.: 0.1682) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.70% (16.7992 => 16.9167, std.dev.: 0.0543) MultiSource/Applications/obsequi/Obsequi: 0.91% (1.0495 => 1.0590, std.dev.: 0.0062) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.37% (21.7795 => 22.0787, std.dev.: 0.4172) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.08% (0.3665 => 0.3668, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 1.06% (0.6062 => 0.6126, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.69% (0.3305 => 0.3361, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 0.30% (0.2007 => 0.2013, std.dev.: 0.0085) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 27.33% (0.0172 => 0.0219, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.91% (0.0419 => 0.0427, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0330 => 0.0330, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.64% (0.0313 => 0.0315, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.24% (0.0425 => 0.0426, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0203 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 15.87% (0.0189 => 0.0219, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1471 => 0.1470, std.dev.: 0.0098) MultiSource/Applications/kimwitu++/kc: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.48% (1.1736 => 1.1910, std.dev.: 0.0334) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -4.33% (0.1477 => 0.1413, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.10% (0.4135 => 0.4131, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.90% (0.1450 => 0.1437, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.51% (0.0610 => 0.0552, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.57% (0.0245 => 0.0266, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.53% (0.0566 => 0.0563, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.26% (1.1940 => 1.1909, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.71% (0.0644 => 0.0633, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.65% (0.0253 => 0.0221, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.06% (0.7796 => 0.7801, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -16.67% (0.0048 => 0.0040, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2327.73% (0.6332 => 15.3724, std.dev.: 0.0587) MultiSource/Benchmarks/McCat/08-main/main: 50.08% (0.1831 => 0.2748, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.06% (0.1559 => 0.1449, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1524.73% (0.3344 => 5.4331, std.dev.: 0.1164) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.18% (0.2364 => 0.3243, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: 3.73% (0.0429 => 0.0445, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.45% (0.0224 => 0.0225, std.dev.: 0.0008) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4608, std.dev.: 0.0163) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0691, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4906, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3474, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1232, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4015, std.dev.: 0.0099) SingleSource/Regression/C/uint64_to_float: -24.41% (2.1832 => 1.6503, std.dev.: 0.0053) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.93% (0.0810 => 0.0939, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.50% (0.0848 => 0.0954, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 12.05% (0.1112 => 0.1246, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.42% (0.8148 => 0.8834, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.52% (0.2180 => 0.2344, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.66% (0.7473 => 0.7971, std.dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.99% (0.3137 => 0.3325, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.98% (0.1905 => 0.2019, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.85% (0.8321 => 0.8808, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.46% (0.1885 => 0.1988, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.34% (0.6010 => 0.6331, std.dev.: 0.0097) MultiSource/Applications/sgefa/sgefa: 5.00% (0.2999 => 0.3149, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.34% (0.5961 => 0.6220, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.20% (0.6287 => 0.6551, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/05-eks/eks: 4.16% (0.4397 => 0.4580, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.16% (0.3295 => 0.3432, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.10% (0.4783 => 0.4979, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 4.01% (4.1305 => 4.2961, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.00% (1.1685 => 1.2152, std.dev.: 0.0090) MultiSource/Applications/lua/lua: 3.66% (3.8189 => 3.9587, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.61% (0.4127 => 0.4276, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.50% (14.2605 => 14.7592, std.dev.: 0.1592) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.40% (0.8317 => 0.8600, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.29% (0.4559 => 0.4709, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.28% (0.5817 => 0.6008, std.dev.: 0.0060) MultiSource/Benchmarks/nbench/nbench: 3.28% (1.1271 => 1.1641, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.25% (2.1401 => 2.2096, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.14% (0.8697 => 0.8970, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.06% (1.4479 => 1.4922, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.05% (1.2526 => 1.2908, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.99% (0.8048 => 0.8289, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.98% (0.8927 => 0.9193, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.93% (0.8086 => 0.8323, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 2.89% (3.2366 => 3.3300, std.dev.: 0.0313) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.84% (0.9074 => 0.9332, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.83% (0.8611 => 0.8855, std.dev.: 0.0082) MultiSource/Applications/hbd/hbd: 2.81% (1.4269 => 1.4670, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.78% (0.8050 => 0.8274, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.78% (0.8340 => 0.8572, std.dev.: 0.0050) MultiSource/Applications/SIBsim4/SIBsim4: 2.76% (1.2568 => 1.2915, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.71% (4.4880 => 4.6097, std.dev.: 0.0237) MultiSource/Applications/ClamAV/clamscan: 2.70% (14.7684 => 15.1669, std.dev.: 0.0254) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.70% (1.3279 => 1.3637, std.dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.69% (0.3717 => 0.3817, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.68% (0.6227 => 0.6394, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (0.9908 => 1.0171, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.64% (0.8007 => 0.8218, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.63% (0.8331 => 0.8550, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.53% (0.8069 => 0.8273, std.dev.: 0.0049) MultiSource/Applications/minisat/minisat: 2.52% (0.6834 => 0.7006, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.44% (0.8805 => 0.9020, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/football/football: 2.42% (0.8768 => 0.8980, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.37% (0.6586 => 0.6742, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.36% (0.8204 => 0.8398, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.36% (0.9039 => 0.9252, std.dev.: 0.0046) MultiSource/Applications/oggenc/oggenc: 2.32% (4.9628 => 5.0777, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.29% (8.6476 => 8.8458, std.dev.: 0.0468) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.27% (0.5191 => 0.5309, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: 2.23% (2.3764 => 2.4293, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.18% (0.8855 => 0.9048, std.dev.: 0.0043) MultiSource/Applications/JM/lencod/lencod: 2.18% (15.3280 => 15.6620, std.dev.: 0.0527) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (6.7320 => 6.8758, std.dev.: 0.0293) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.10% (0.8316 => 0.8491, std.dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 2.09% (0.9810 => 1.0015, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.04% (0.8177 => 0.8344, std.dev.: 0.0063) MultiSource/Applications/lemon/lemon: 2.01% (1.0945 => 1.1165, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.95% (0.8338 => 0.8501, std.dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: 1.94% (8.6247 => 8.7921, std.dev.: 0.0430) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.90% (0.9056 => 0.9228, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.82% (0.8995 => 0.9159, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.81% (0.8597 => 0.8753, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.52% (1.2423 => 1.2612, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 109.55% (0.0199 => 0.0417, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/pi: 58.04% (1.5795 => 2.4963, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.90% (0.7597 => 0.8881, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.34% (2.9753 => 3.4615, std.dev.: 0.0291) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.68% (2.7995 => 3.2106, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6088, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.08% (0.3186 => 0.3507, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.67% (1.1857 => 1.2767, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/queens: 7.41% (1.7056 => 1.8320, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.75% (4.7794 => 5.1022, std.dev.: 0.0209) MultiSource/Applications/SIBsim4/SIBsim4: 6.01% (3.1873 => 3.3788, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/richards_benchmark: 5.99% (1.3037 => 1.3818, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.87% (4.5327 => 4.7989, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.76% (4.9686 => 5.2548, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 5.30% (7.4933 => 7.8907, std.dev.: 0.0571) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.67% (6.2275 => 6.5182, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.47% (3.3761 => 3.5270, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.09% (4.9453 => 5.1475, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.01% (4.9469 => 5.1453, std.dev.: 0.0066) MultiSource/Applications/hexxagon/hexxagon: 3.91% (14.0064 => 14.5542, std.dev.: 0.0345) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.93% (1.2337 => 1.2699, std.dev.: 0.0069) MultiSource/Applications/siod/siod: 2.86% (3.6643 => 3.7691, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.83% (11.5690 => 11.8965, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.68% (8.2783 => 8.4999, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout/lists: 2.46% (7.3375 => 7.5182, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.35% (1.1365 => 1.1632, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.31% (4.8660 => 4.9785, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.30% (4.8362 => 4.9475, std.dev.: 0.0214) SingleSource/Benchmarks/Dhrystone/dry: 2.18% (0.5081 => 0.5192, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.57% (1.5941 => 1.6192, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/FloatMM: 1.48% (0.8807 => 0.8937, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/whetstone: 1.39% (2.1224 => 2.1519, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.38% (2.4647 => 2.4987, std.dev.: 0.0112) MultiSource/Benchmarks/FreeBench/neural/neural: 1.31% (1.0841 => 1.0983, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.26% (3.5679 => 3.6129, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/ReedSolomon: 1.26% (8.5322 => 8.6398, std.dev.: 0.0128) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.12% (2.5763 => 2.6051, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.04% (4.0473 => 4.0892, std.dev.: 0.0096) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.52% (5.4641 => 4.3429, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.85% (7.2130 => 6.3585, std.dev.: 0.1525) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.88% (1.0512 => 0.9368, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -10.00% (1.1216 => 1.0094, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.60% (0.3269 => 0.2988, std.dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: -8.51% (63.1822 => 57.8047, std.dev.: 0.0961) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.51% (14.6451 => 13.5449, std.dev.: 0.0679) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.86% (4.7482 => 4.4227, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.96% (3.7148 => 3.4934, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.88% (5.4972 => 5.1742, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.07% (5.1557 => 4.8941, std.dev.: 0.0153) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.14% (2.8773 => 2.7581, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.77% (6.0224 => 5.7951, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.17% (0.5807 => 0.5623, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (28.5821 => 27.6983, std.dev.: 0.0157) MultiSource/Applications/lua/lua: -3.04% (29.8330 => 28.9256, std.dev.: 0.0552) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.00% (4.7449 => 4.6027, std.dev.: 0.0376) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.75% (2.6356 => 2.5632, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -2.73% (0.5415 => 0.5267, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bisort/bisort: -2.67% (0.6636 => 0.6459, std.dev.: 0.0039) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.51% (1.2822 => 1.2500, std.dev.: 0.0027) MultiSource/Applications/aha/aha: -2.34% (3.3398 => 3.2617, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.32% (9.9065 => 9.6764, std.dev.: 0.0880) SingleSource/Benchmarks/Shootout-C++/hash2: -2.20% (3.4237 => 3.3484, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.03% (11.5316 => 11.2971, std.dev.: 0.0209) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.85% (3.2169 => 3.1575, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.59% (4.9994 => 4.9198, std.dev.: 0.0183) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.32% (2.3487 => 2.3178, std.dev.: 0.0015) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.86% (16.4461 => 16.9167, std.dev.: 0.0543) MultiSource/Applications/obsequi/Obsequi: 3.20% (1.0262 => 1.0590, std.dev.: 0.0062) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6969.71% (0.3123 => 22.0787, std.dev.: 0.4172) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.92% (0.2463 => 0.3668, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 1.93% (0.6010 => 0.6126, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.91% (0.3266 => 0.3361, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 2.23% (0.1969 => 0.2013, std.dev.: 0.0085) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.94% (0.0384 => 0.0426, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.23% (0.1438 => 0.1470, std.dev.: 0.0098) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 5.13% (1.1329 => 1.1910, std.dev.: 0.0334) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -3.35% (0.1462 => 0.1413, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.79% (0.4164 => 0.4131, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.97% (0.1369 => 0.1437, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -13.88% (0.0641 => 0.0552, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 36.41% (0.0195 => 0.0266, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.60% (0.0578 => 0.0563, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.13% (1.1437 => 1.1909, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.96% (0.0627 => 0.0633, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.78% (0.0180 => 0.0221, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.69% (0.8017 => 0.7801, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -35.48% (0.0062 => 0.0040, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 23:26:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 01:26:28 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121113072628.DC5D92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5810?compare_to=5805&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5810, Order: 167815, Start Time: 2012-11-13 05:17:32, End Time: 2012-11-13 07:26:42 To: 5805, Order: 167801, Start Time: 2012-11-13 02:19:15, End Time: 2012-11-13 04:28:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 6 (17 on baseline) Performance Regressions: 38 (163 on baseline) Performance Improvements: 2 (41 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 992 (683 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Applications/ClamAV/clamscan: 2.01% (34.9665 => 35.6708, std.dev.: 0.2146) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.21% (5.1519 => 4.9864, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.04% (5.2061 => 4.9957, std.dev.: 0.0229) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Applications/ClamAV/clamscan: 153300.00% (0.0001 => 0.1534, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 239000.00% (0.0001 => 0.2391, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 30300.00% (0.0001 => 0.0304, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 18.38% (0.1638 => 0.1939, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/dot-syntax-1: 18.05% (0.0554 => 0.0654, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 15.64% (0.6229 => 0.7203, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 15.32% (0.6723 => 0.7753, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.02% (0.3366 => 0.3838, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.67% (0.4288 => 0.4874, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sieve: 13.57% (0.3957 => 0.4494, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.02% (0.5961 => 0.6737, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.75% (0.8100 => 0.9133, std.dev.: 0.0153) MultiSource/Benchmarks/Olden/em3d/em3d: 11.99% (0.2001 => 0.2241, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.10% (0.1036 => 0.1151, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/mst/mst: 10.66% (0.1342 => 0.1485, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.14% (0.1104 => 0.1216, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.19% (0.1708 => 0.1865, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 8.46% (0.1985 => 0.2153, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.21% (0.1973 => 0.2135, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 8.06% (0.5359 => 0.5791, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.99% (1.0376 => 1.1205, std.dev.: 0.0258) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 7.85% (0.1490 => 0.1607, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.46% (0.4905 => 0.5271, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.93% (0.3984 => 0.4260, std.dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.26% (0.2123 => 0.2256, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.01% (0.2543 => 0.2645, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.35% (1.5835 => 1.6365, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.28% (2.6735 => 2.7613, std.dev.: 0.0157) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.90% (6.3660 => 6.5504, std.dev.: 0.0544) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.26% (37.7224 => 38.5738, std.dev.: 0.0295) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.08% (4.6301 => 4.7263, std.dev.: 0.0213) MultiSource/Applications/kimwitu++/kc: 1.93% (20.9549 => 21.3588, std.dev.: 0.1020) MultiSource/Applications/JM/lencod/lencod: 1.23% (32.0325 => 32.4268, std.dev.: 0.0629) MultiSource/Applications/sqlite3/sqlite3: 1.13% (19.9174 => 20.1432, std.dev.: 0.0576) MultiSource/Applications/SPASS/SPASS: 1.12% (18.0530 => 18.2551, std.dev.: 0.0577) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 19.05% (0.0840 => 0.1000, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 9.80% (0.5318 => 0.5839, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/hash: 5.18% (0.7630 => 0.8025, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.38% (6.2990 => 6.3859, std.dev.: 0.0125) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.06% (0.9627 => 0.9729, std.dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 1.05% (3.8948 => 3.9357, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.34% (0.7174 => 0.6719, std.dev.: 0.0139) MultiSource/Benchmarks/PAQ8p/paq8p: -2.06% (11.4014 => 11.1663, std.dev.: 0.0435) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.97% (0.1336 => 0.1349, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.80% (0.0474 => 0.0492, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.69% (0.0669 => 0.0651, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -0.00% (493.9646 => 493.9489, std.dev.: 0.0802) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.88% (4.3882 => 0.0492, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: 43701.45% (1.1277 => 493.9489, std.dev.: 0.0802) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.26% (0.5229 => 1.6485, std.dev.: 0.0542) MultiSource/Applications/SPASS/SPASS: 21.79% (14.9895 => 18.2551, std.dev.: 0.0577) MultiSource/Applications/kimwitu++/kc: 50.89% (14.1553 => 21.3588, std.dev.: 0.1020) MultiSource/Benchmarks/MallocBench/gs/gs: 23.03% (4.1105 => 5.0571, std.dev.: 0.0312) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 48.13% (1.1048 => 1.6365, std.dev.: 0.0050) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 438.88% (7.1582 => 38.5738, std.dev.: 0.0295) SingleSource/Benchmarks/Misc-C++-EH/spirit: 89.16% (3.4629 => 6.5504, std.dev.: 0.0544) SingleSource/Benchmarks/Misc-C++/stepanov_container: 80.09% (0.6222 => 1.1205, std.dev.: 0.0258) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10936.11% (0.0720 => 7.9460, std.dev.: 0.0418) MultiSource/Applications/SIBsim4/SIBsim4: 3935600.00% (0.0001 => 3.9357, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 14760200.00% (0.0001 => 14.7603, std.dev.: 0.3111) MultiSource/Applications/kimwitu++/kc: 51900.00% (0.0001 => 0.0520, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 63800.00% (0.0001 => 0.0639, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 589100.00% (0.0001 => 0.5892, std.dev.: 0.0226) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10086600.00% (0.0001 => 10.0867, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6672000.00% (0.0001 => 6.6721, std.dev.: 0.0961) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1780.87% (1.1194 => 21.0545, std.dev.: 0.1870) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 70.89% (2.9384 => 5.0215, std.dev.: 0.0346) MultiSource/Applications/ClamAV/clamscan: 60.85% (22.1758 => 35.6708, std.dev.: 0.2146) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 59.83% (7.0540 => 11.2745, std.dev.: 0.0319) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 52.55% (8.1363 => 12.4117, std.dev.: 0.0225) SingleSource/Benchmarks/Misc/flops: 50.35% (0.1432 => 0.2153, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 47.82% (21.9371 => 32.4268, std.dev.: 0.0629) MultiSource/Benchmarks/FreeBench/distray/distray: 45.55% (0.1056 => 0.1537, std.dev.: 0.0020) SingleSource/UnitTests/vla: 40.56% (0.0355 => 0.0499, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 39.86% (0.0730 => 0.1021, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/dot-syntax-1: 36.53% (0.0479 => 0.0654, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 32.21% (0.1695 => 0.2241, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/15-trie/trie: 32.07% (0.0527 => 0.0696, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Oscar: 29.09% (0.0636 => 0.0821, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: 28.27% (0.0481 => 0.0617, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/mst/mst: 27.69% (0.1163 => 0.1485, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 27.60% (0.0953 => 0.1216, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 26.11% (0.3865 => 0.4874, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 25.96% (0.1695 => 0.2135, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/IntMM: 25.89% (0.0394 => 0.0496, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 25.73% (0.0443 => 0.0557, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 25.53% (0.2107 => 0.2645, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/spellcheck: 25.41% (0.4203 => 0.5271, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 25.38% (2.2024 => 2.7613, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/hash2: 25.35% (0.4620 => 0.5791, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 25.05% (0.0491 => 0.0614, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 24.73% (0.3603 => 0.4494, std.dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.26% (0.0746 => 0.0927, std.dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/lpbench: 23.90% (0.0929 => 0.1151, std.dev.: 0.0041) MultiSource/Benchmarks/BitBench/drop3/drop3: 23.86% (0.0482 => 0.0597, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 23.57% (0.1175 => 0.1452, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/ks/ks: 23.51% (0.1510 => 0.1865, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: 23.38% (0.2554 => 0.3151, std.dev.: 0.0195) MultiSource/Benchmarks/Prolangs-C++/office/office: 22.39% (0.3136 => 0.3838, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.10% (0.0457 => 0.0558, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.90% (0.1566 => 0.1909, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 21.84% (1.5859 => 1.9322, std.dev.: 0.0602) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.73% (14.3668 => 17.4886, std.dev.: 0.0602) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 21.43% (3.8922 => 4.7263, std.dev.: 0.0213) MultiSource/Applications/oggenc/oggenc: 21.40% (5.7591 => 6.9913, std.dev.: 0.0630) MultiSource/Applications/siod/siod: 21.29% (2.2969 => 2.7859, std.dev.: 0.0677) MultiSource/Applications/treecc/treecc: 21.26% (2.0273 => 2.4584, std.dev.: 0.0321) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 21.19% (0.0793 => 0.0961, std.dev.: 0.0052) SingleSource/UnitTests/SignlessTypes/Large/cast: 20.92% (0.0564 => 0.0682, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.83% (0.1584 => 0.1914, std.dev.: 0.0097) MultiSource/Applications/Burg/burg: 20.41% (1.1642 => 1.4018, std.dev.: 0.0483) MultiSource/Benchmarks/VersaBench/bmm/bmm: 20.29% (0.0759 => 0.0913, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 20.11% (4.2646 => 5.1223, std.dev.: 0.0155) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.08% (0.8172 => 0.9813, std.dev.: 0.0210) MultiSource/Applications/d/make_dparser: 19.99% (3.3354 => 4.0020, std.dev.: 0.0521) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.85% (0.2700 => 0.3236, std.dev.: 0.0203) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 19.32% (0.1625 => 0.1939, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 19.30% (3.8723 => 4.6195, std.dev.: 0.0757) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.20% (0.1125 => 0.1341, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.07% (0.1940 => 0.2310, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.91% (0.9765 => 1.1612, std.dev.: 0.0176) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.76% (0.0842 => 0.1000, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 18.70% (4.9449 => 5.8695, std.dev.: 0.0289) MultiSource/Applications/sgefa/sgefa: 18.62% (0.3109 => 0.3688, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 18.61% (0.5981 => 0.7094, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/matrix: 18.43% (0.3098 => 0.3669, std.dev.: 0.0120) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 18.36% (0.1906 => 0.2256, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 18.24% (9.4845 => 11.2145, std.dev.: 0.0416) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.73% (0.2758 => 0.3247, std.dev.: 0.0124) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.68% (0.0871 => 0.1025, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 17.26% (0.2271 => 0.2663, std.dev.: 0.0108) MultiSource/Applications/sqlite3/sqlite3: 17.24% (17.1811 => 20.1432, std.dev.: 0.0576) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.24% (0.5860 => 0.6870, std.dev.: 0.0199) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.09% (5.0018 => 5.8568, std.dev.: 0.0595) SingleSource/Benchmarks/Shootout-C++/ary2: 16.93% (0.3379 => 0.3951, std.dev.: 0.0104) MultiSource/Applications/hbd/hbd: 16.73% (1.5603 => 1.8214, std.dev.: 0.0232) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.58% (1.5415 => 1.7971, std.dev.: 0.0466) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.56% (0.1117 => 0.1302, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.51% (0.0648 => 0.0755, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.51% (2.0665 => 2.4077, std.dev.: 0.0584) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.48% (0.0886 => 0.1032, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bisort/bisort: 16.45% (0.0614 => 0.0715, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.42% (0.2065 => 0.2404, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/matrix: 16.38% (0.0818 => 0.0952, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: 16.33% (1.0722 => 1.2473, std.dev.: 0.0573) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.33% (0.6675 => 0.7765, std.dev.: 0.0394) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.31% (1.3050 => 1.5179, std.dev.: 0.0466) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.31% (0.0834 => 0.0970, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/for-in: 16.13% (0.3694 => 0.4290, std.dev.: 0.0133) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.08% (1.1861 => 1.3768, std.dev.: 0.0334) MultiSource/Applications/viterbi/viterbi: 16.08% (0.1555 => 0.1805, std.dev.: 0.0074) MultiSource/Benchmarks/nbench/nbench: 15.34% (1.1840 => 1.3656, std.dev.: 0.0274) MultiSource/Benchmarks/McCat/18-imp/imp: 15.34% (0.3423 => 0.3948, std.dev.: 0.0189) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.32% (0.0770 => 0.0888, std.dev.: 0.0039) SingleSource/Regression/C++/ofstream_ctor: 15.15% (0.2905 => 0.3345, std.dev.: 0.0099) MultiSource/Benchmarks/NPB-serial/is/is: 15.02% (0.0719 => 0.0827, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.89% (0.5569 => 0.6398, std.dev.: 0.0314) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.80% (0.3121 => 0.3583, std.dev.: 0.0168) MultiSource/Benchmarks/Bullet/bullet: 14.69% (63.2438 => 72.5336, std.dev.: 0.2856) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.58% (0.1029 => 0.1179, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.34% (0.3543 => 0.4051, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.28% (1.4186 => 1.6212, std.dev.: 0.0524) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.25% (0.0730 => 0.0834, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.84% (0.8101 => 0.9222, std.dev.: 0.0224) SingleSource/UnitTests/ObjC/trivial-interface: 13.42% (0.3473 => 0.3939, std.dev.: 0.0172) SingleSource/UnitTests/ObjC/exceptions-2: 13.30% (0.3497 => 0.3962, std.dev.: 0.0152) SingleSource/UnitTests/ObjC/exceptions: 13.24% (0.3828 => 0.4335, std.dev.: 0.0194) SingleSource/UnitTests/ObjC/exceptions-4: 13.12% (0.3543 => 0.4008, std.dev.: 0.0105) SingleSource/UnitTests/ObjC/synchronized: 13.09% (0.3561 => 0.4027, std.dev.: 0.0164) SingleSource/UnitTests/ObjC/exceptions-3: 13.05% (0.3516 => 0.3975, std.dev.: 0.0143) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.96% (0.2430 => 0.2745, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 12.74% (0.1044 => 0.1177, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 11.92% (0.3422 => 0.3830, std.dev.: 0.0153) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.85% (2.2022 => 2.4631, std.dev.: 0.0282) SingleSource/UnitTests/ObjC/block-byref-aggr: 11.61% (0.3817 => 0.4260, std.dev.: 0.0076) SingleSource/UnitTests/ObjC++/property-reference: 11.00% (0.7326 => 0.8132, std.dev.: 0.0218) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.13% (0.2891 => 0.3184, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/oourafft: 9.93% (0.3282 => 0.3608, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/wc: 9.80% (0.3052 => 0.3351, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 7.71% (10.3673 => 11.1663, std.dev.: 0.0435) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.40% (7.9617 => 8.3919, std.dev.: 0.1037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.72% (4.3953 => 11.0200, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/methcall: 147.64% (5.3999 => 13.3722, std.dev.: 0.0035) MultiSource/Benchmarks/llubenchmark/llu: 46.11% (3.7781 => 5.5202, std.dev.: 0.4567) MultiSource/Benchmarks/McCat/09-vor/vor: 37.00% (0.1154 => 0.1581, std.dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 24.28% (13.4384 => 16.7018, std.dev.: 0.1908) MultiSource/Applications/minisat/minisat: 23.51% (9.1159 => 11.2587, std.dev.: 0.1017) SingleSource/Benchmarks/Shootout/ary3: 21.20% (3.6994 => 4.4836, std.dev.: 0.0251) SingleSource/Benchmarks/Shootout-C++/ary3: 19.80% (3.7221 => 4.4590, std.dev.: 0.0486) SingleSource/Benchmarks/Misc/oourafft: 17.55% (6.6465 => 7.8128, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.07% (1.1145 => 1.3047, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/lpbench: 16.14% (10.3460 => 12.0157, std.dev.: 0.0929) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.74% (0.0864 => 0.1000, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.15% (0.2944 => 0.3331, std.dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.69% (2.8904 => 3.2282, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 11.25% (3.1578 => 3.5132, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.23% (8.6802 => 9.6553, std.dev.: 0.0486) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.23% (2.0360 => 2.2647, std.dev.: 0.0827) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.82% (3.8532 => 4.2702, std.dev.: 0.0294) SingleSource/Benchmarks/Misc/richards_benchmark: 10.21% (1.1396 => 1.2560, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: 10.15% (3.8526 => 4.2435, std.dev.: 0.0257) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.51% (1.7254 => 1.8895, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 7.65% (0.7455 => 0.8025, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.84% (4.2280 => 4.4749, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/hash: 5.36% (4.9088 => 5.1718, std.dev.: 0.0741) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.69% (26.0924 => 27.3164, std.dev.: 0.1676) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.6436 => 12.1318, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.18% (3.6395 => 3.7918, std.dev.: 0.0083) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.18% (1.7133 => 1.7677, std.dev.: 0.0088) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 3.13% (3.1334 => 3.2316, std.dev.: 0.0126) SingleSource/Benchmarks/Dhrystone/dry: 2.91% (2.4116 => 2.4817, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.43% (2.1424 => 2.1945, std.dev.: 0.0144) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.17% (1.3677 => 1.3974) MultiSource/Applications/aha/aha: 2.10% (3.1595 => 3.2260, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 2.06% (3.1023 => 3.1662, std.dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: 1.85% (4.6441 => 4.7298, std.dev.: 0.0073) MultiSource/Benchmarks/PAQ8p/paq8p: 1.67% (85.0658 => 86.4868, std.dev.: 0.1807) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.52% (6.5088 => 6.6080, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/sieve: 1.44% (5.2139 => 5.2892, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 1.41% (27.8444 => 28.2361, std.dev.: 0.0337) SingleSource/Benchmarks/Shootout-C++/lists: 1.28% (12.5348 => 12.6954, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0500, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1681, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.46% (5.2763 => 1.2422, std.dev.: 0.0477) SingleSource/Benchmarks/Misc/salsa20: -75.69% (0.8651 => 0.2103, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/richards_benchmark: -44.14% (0.1622 => 0.0906, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -11.73% (0.1330 => 0.1174, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.24% (5.3855 => 4.9957, std.dev.: 0.0229) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.84% (5.3526 => 4.9864, std.dev.: 0.0105) MultiSource/Applications/JM/ldecod/ldecod: -6.43% (10.4361 => 9.7651, std.dev.: 0.0499) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.03% (0.3987 => 0.2391, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.92% (0.0506 => 0.0304, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.33% (4.5009 => 2.7759, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.56% (1.1492 => 0.7635, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.10% (2.6546 => 2.0148, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -22.09% (10.7105 => 8.3444, std.dev.: 0.0477) MultiSource/Benchmarks/FreeBench/mason/mason: -19.30% (0.2161 => 0.1744, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.93% (1.6925 => 1.4229, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2842, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.70% (32.5116 => 29.0317, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.03% (1.5660 => 1.4246, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -7.51% (9.5636 => 8.8450, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.95% (4.8142 => 4.4795, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.04% (3.2416 => 3.0459, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.61% (2.7294 => 2.5764, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.29% (0.2497 => 0.2365, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5077, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.79% (19.9488 => 18.9940, std.dev.: 0.3107) SingleSource/Benchmarks/Shootout/lists: -4.19% (6.2999 => 6.0359, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.20% (1.6805 => 1.6267, std.dev.: 0.0046) MultiSource/Benchmarks/sim/sim: -3.04% (5.0483 => 4.8950, std.dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.33% (0.4808 => 0.4696, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.29% (0.9957 => 0.9729, std.dev.: 0.0025) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.82% (8.1563 => 8.0077, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6773, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.46% (10.2830 => 10.1328, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.16% (0.1485 => 0.1349, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0011) Report Time: 3.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 12 23:34:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 01:34:45 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121113073445.9B3892A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5811?compare_to=5808&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5811, Order: 167816, Start Time: 2012-11-13 06:06:45, End Time: 2012-11-13 07:31:49 To: 5808, Order: 167814, Start Time: 2012-11-13 04:18:28, End Time: 2012-11-13 05:43:33 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 5 (5 on baseline) Performance Improvements: 0 (180 on baseline) Unchanged Tests: 1037 (857 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.74% (5.2129 => 5.3035, std.dev.: 0.0047) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.25% (21.1062 => 21.3699, std.dev.: 0.0114) MultiSource/Benchmarks/nbench/nbench: 1.20% (1.0883 => 1.1014, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.08% (2.1538 => 2.1770, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.69% (54.5160 => 56.5301, std.dev.: 0.0456) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.58% (54.5751 => 56.5301, std.dev.: 0.0456) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1007, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/salsa20: 2.53% (7.4937 => 7.6830, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/hash2: 2.29% (3.1932 => 3.2663, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.39% (0.1431 => 0.1311, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.93% (0.3821 => 0.3518, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.95% (2.4924 => 2.3192, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.65% (0.9542 => 0.8907, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.49% (0.3142 => 0.2938, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.26% (0.3357 => 0.3147, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.05% (0.2428 => 0.2281, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -6.03% (0.3831 => 0.3600, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -6.01% (16.1920 => 15.2186, std.dev.: 0.0155) SingleSource/UnitTests/ObjC/trivial-interface: -6.01% (0.3812 => 0.3583, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.01% (0.3880 => 0.3647, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -5.98% (0.3896 => 0.3663, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -5.98% (0.3848 => 0.3618, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.98% (0.4033 => 0.3792, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.88% (0.6484 => 0.6103, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: -5.85% (7.0961 => 6.6807, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.81% (0.3891 => 0.3665, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.79% (0.1796 => 0.1692, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -5.77% (9.2283 => 8.6954, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.77% (0.3658 => 0.3447, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -5.76% (0.9179 => 0.8650, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/ReedSolomon: -5.75% (0.1879 => 0.1771, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.75% (0.9852 => 0.9286, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -5.74% (0.2160 => 0.2036, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -5.72% (0.4176 => 0.3937, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.71% (1.0544 => 0.9942, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.69% (0.2355 => 0.2221, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.69% (0.3884 => 0.3663, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.63% (1.3722 => 1.2950, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.57% (1.6364 => 1.5452, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.57% (0.4199 => 0.3965, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.55% (1.2784 => 1.2075, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.54% (1.2300 => 1.1618, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.54% (4.8161 => 4.5494, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.53% (4.0323 => 3.8093, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.49% (3.5339 => 3.3398, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.44% (4.8802 => 4.6146, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.43% (0.7198 => 0.6807, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -5.42% (1.1450 => 1.0829, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.40% (14.2083 => 13.4408, std.dev.: 0.0110) MultiSource/Applications/sqlite3/sqlite3: -5.37% (17.1032 => 16.1850, std.dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.33% (0.6736 => 0.6377, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: -5.31% (0.3406 => 0.3225, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.30% (4.5069 => 4.2680, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.29% (0.5863 => 0.5553, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.29% (1.4642 => 1.3868, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.23% (0.8521 => 0.8075, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.23% (0.2695 => 0.2554, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.21% (0.6676 => 0.6328, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: -5.21% (4.3330 => 4.1074, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.20% (0.6052 => 0.5737, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.20% (0.5591 => 0.5300, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.20% (0.5805 => 0.5503, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.20% (0.5581 => 0.5291, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.19% (0.5859 => 0.5555, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -5.19% (0.4280 => 0.4058, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.18% (0.5478 => 0.5194, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.18% (0.7339 => 0.6959, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.17% (0.6304 => 0.5978, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.17% (0.6230 => 0.5908, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -5.16% (0.2985 => 0.2831, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.15% (6.7716 => 6.4227, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.15% (0.5849 => 0.5548, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.14% (0.3483 => 0.3304, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.14% (0.5857 => 0.5556, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.14% (0.5802 => 0.5504, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.13% (0.6194 => 0.5876, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.13% (0.5925 => 0.5621, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.12% (0.5569 => 0.5284, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.11% (0.6297 => 0.5975, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.10% (0.6681 => 0.6340, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.10% (0.6667 => 0.6327, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.10% (0.6260 => 0.5941, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.08% (0.6395 => 0.6070, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.07% (0.6189 => 0.5875, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.05% (0.7919 => 0.7519, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.03% (0.5567 => 0.5287, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.02% (0.6395 => 0.6074, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -5.02% (1.2515 => 1.1887, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.99% (0.5575 => 0.5297, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.98% (0.7524 => 0.7149, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.96% (0.5705 => 0.5422, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/18-imp/imp: -4.94% (0.3581 => 0.3404, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.93% (0.5999 => 0.5703, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: -4.91% (1.3864 => 1.3183, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.91% (0.6440 => 0.6124, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.91% (0.6033 => 0.5737, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.90% (1.2221 => 1.1622, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.90% (1.2210 => 1.1612, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: -4.89% (0.2659 => 0.2529, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.88% (0.6660 => 0.6335, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.87% (0.6446 => 0.6132, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.86% (0.5456 => 0.5191, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: -4.86% (3.5154 => 3.3447, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.85% (0.5941 => 0.5653, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.84% (8.0126 => 7.6245, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.83% (0.2278 => 0.2168, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: -4.81% (0.4515 => 0.4298, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.80% (0.2999 => 0.2855, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.79% (0.5570 => 0.5303, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.74% (0.4916 => 0.4683, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -4.73% (15.5079 => 14.7741, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.72% (0.6293 => 0.5996, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.70% (0.2385 => 0.2273, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.66% (0.5688 => 0.5423, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.62% (22.4056 => 21.3699, std.dev.: 0.0114) MultiSource/Applications/hexxagon/hexxagon: -4.62% (1.3148 => 1.2541, std.dev.: 0.0039) MultiSource/Applications/ClamAV/clamscan: -4.60% (15.2527 => 14.5510, std.dev.: 0.0024) MultiSource/Applications/lua/lua: -4.59% (4.0594 => 3.8730, std.dev.: 0.0053) MultiSource/Applications/minisat/minisat: -4.57% (0.7447 => 0.7107, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/methcall: -4.56% (0.3025 => 0.2887, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.55% (0.5168 => 0.4933, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.55% (0.3057 => 0.2918, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.52% (1.6474 => 1.5730, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -4.52% (0.3255 => 0.3108, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.51% (0.3016 => 0.2880, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -4.51% (0.3194 => 0.3050, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.48% (0.4151 => 0.3965, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.48% (0.3931 => 0.3755, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -4.48% (1.1530 => 1.1014, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.43% (0.2548 => 0.2435, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.42% (0.3323 => 0.3176, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.40% (0.3319 => 0.3173, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -4.39% (2.1401 => 2.0462, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.37% (2.1713 => 2.0764, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/except: -4.36% (0.3026 => 0.2894) SingleSource/Benchmarks/Shootout-C++/fibo: -4.35% (0.2871 => 0.2746, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.35% (0.2989 => 0.2859, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -4.34% (0.4861 => 0.4650, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.34% (0.2903 => 0.2777, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.33% (0.2933 => 0.2806, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.33% (0.7021 => 0.6717, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -4.32% (0.2939 => 0.2812, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -4.31% (0.3481 => 0.3331, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -4.28% (0.7982 => 0.7640, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/moments: -4.28% (0.4248 => 0.4066, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.27% (0.3205 => 0.3068, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -4.25% (0.3271 => 0.3132, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: -4.25% (0.2849 => 0.2728, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.22% (0.3837 => 0.3675, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -4.22% (0.3059 => 0.2930, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -4.21% (2.4021 => 2.3009, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.21% (0.3849 => 0.3687, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -4.19% (0.6441 => 0.6171, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -4.19% (0.6347 => 0.6081, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -4.19% (5.0226 => 4.8124, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.18% (0.5329 => 0.5106, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.18% (0.3252 => 0.3116, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -4.15% (0.3394 => 0.3253, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -4.15% (0.3446 => 0.3303, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -4.15% (34.0927 => 32.6791, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/lists: -4.14% (0.3621 => 0.3471, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: -4.09% (0.7779 => 0.7461, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: -4.06% (0.3867 => 0.3710, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.05% (0.4321 => 0.4146, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: -4.05% (0.4524 => 0.4341, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.04% (0.9557 => 0.9171, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.95% (0.4813 => 0.4623, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.94% (0.9077 => 0.8719, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.89% (0.4083 => 0.3924, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.89% (0.4427 => 0.4255, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -3.76% (18.2933 => 17.6052, std.dev.: 0.0166) MultiSource/Applications/spiff/spiff: -3.74% (0.8418 => 0.8103, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -3.70% (0.6750 => 0.6500, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.64% (0.3491 => 0.3364, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.62% (2.2587 => 2.1770, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: -3.56% (0.3788 => 0.3653, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -3.28% (1.5610 => 1.5098, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.01% (5.4682 => 5.3035, std.dev.: 0.0047) SingleSource/UnitTests/Vector/constpool: -2.57% (20.7746 => 20.2399, std.dev.: 0.0346) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7578, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: -8.69% (1.2842 => 1.1726, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -4.07% (2.2633 => 2.1711, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.83% (1.3096 => 1.2856, std.dev.: 0.0079) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4694, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0006) Report Time: 3.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 00:49:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 02:49:18 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121113084918.4DBB82A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5812?compare_to=5809&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5812, Order: 167819, Start Time: 2012-11-13 07:23:10, End Time: 2012-11-13 08:49:35 To: 5809, Order: 167816, Start Time: 2012-11-13 05:39:50, End Time: 2012-11-13 07:06:00 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 9 (107 on baseline) Performance Improvements: 1 (25 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 981 (842 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/aha/aha: 11.32% (0.1025 => 0.1141, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: 3.77% (8.1964 => 8.5054, std.dev.: 0.0615) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.10% (0.5059 => 0.5216, std.dev.: 0.0055) MultiSource/Applications/hbd/hbd: 2.49% (1.4670 => 1.5035, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.98% (0.9694 => 0.9886, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.37% (0.9228 => 0.9354, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 4.72% (44.9785 => 47.1032, std.dev.: 0.7071) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.95% (2.3414 => 2.3871, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.84% (4.3991 => 4.4799, std.dev.: 0.0203) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.42% (4.6027 => 4.5372, std.dev.: 0.0027) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.10% (16.9167 => 16.8999, std.dev.: 0.0986) MultiSource/Applications/obsequi/Obsequi: 0.86% (1.0590 => 1.0681, std.dev.: 0.0154) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.12% (22.0787 => 22.1061, std.dev.: 0.3841) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.19% (0.3668 => 0.3675, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 0.07% (0.6126 => 0.6130, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.12% (0.3361 => 0.3365, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 0.05% (0.2013 => 0.2014, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.37% (0.0219 => 0.0216, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0427 => 0.0429, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.91% (0.0330 => 0.0333, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.63% (0.0315 => 0.0313, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.23% (0.0426 => 0.0427, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -1.47% (0.0204 => 0.0201, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -0.46% (0.0219 => 0.0218, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.61% (0.1470 => 0.1479, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -4.68% (1.1910 => 1.1353, std.dev.: 0.0341) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 1.63% (0.1413 => 0.1436, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.49% (0.4131 => 0.4234, std.dev.: 0.0430) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.88% (0.1437 => 0.1410, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.05% (0.0552 => 0.0613, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -24.06% (0.0266 => 0.0202, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.62% (0.0563 => 0.0589, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.55% (1.1909 => 1.1975, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -67.74% (0.0031 => 0.0010, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.64% (0.0633 => 0.0553, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.93% (0.0221 => 0.0188, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.28% (0.7801 => 0.7823, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 85.00% (0.0040 => 0.0074, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2308.43% (0.6332 => 15.2502, std.dev.: 0.3230) MultiSource/Benchmarks/McCat/08-main/main: 50.35% (0.1831 => 0.2753, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.61% (0.1559 => 0.1456, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1525.12% (0.3344 => 5.4344, std.dev.: 0.0258) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.11% (0.2364 => 0.3265, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: 4.20% (0.0429 => 0.0447, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.91% (0.0224 => 0.0235, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -25.65% (0.0230 => 0.0171, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4671, std.dev.: 0.0768) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0684, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4951, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3475, std.dev.: 0.0377) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1503, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4018, std.dev.: 0.0044) SingleSource/Regression/C/uint64_to_float: -23.91% (2.1832 => 1.6612, std.dev.: 0.0020) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.01% (0.0810 => 0.0964, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.13% (0.0830 => 0.0939, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.19% (0.1905 => 0.2061, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/health/health: 7.87% (0.1347 => 0.1453, std.dev.: 0.0017) MultiSource/Applications/viterbi/viterbi: 7.80% (0.1577 => 0.1700, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.77% (0.8148 => 0.8781, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.61% (0.4847 => 0.5216, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.16% (0.2180 => 0.2336, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.07% (0.7473 => 0.8001, std.dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.95% (0.3137 => 0.3355, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 6.45% (0.1721 => 0.1832, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.97% (0.2279 => 0.2415, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.67% (0.5961 => 0.6299, std.dev.: 0.0050) MultiSource/Applications/Burg/burg: 5.67% (1.2222 => 1.2915, std.dev.: 0.0140) MultiSource/Applications/hbd/hbd: 5.37% (1.4269 => 1.5035, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.19% (0.3295 => 0.3466, std.dev.: 0.0030) MultiSource/Applications/spiff/spiff: 5.02% (0.7950 => 0.8349, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.78% (0.9435 => 0.9886, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.46% (0.4127 => 0.4311, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.39% (1.1685 => 1.2198, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/gs/gs: 4.27% (4.1305 => 4.3068, std.dev.: 0.0531) MultiSource/Applications/lua/lua: 3.96% (3.8189 => 3.9701, std.dev.: 0.0468) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.83% (1.1606 => 1.2051, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.75% (0.5817 => 0.6035, std.dev.: 0.0053) MultiSource/Applications/siod/siod: 3.53% (2.2184 => 2.2967, std.dev.: 0.0176) MultiSource/Applications/SPASS/SPASS: 3.51% (14.2605 => 14.7606, std.dev.: 0.1455) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.49% (0.4559 => 0.4718, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 3.49% (1.1271 => 1.1664, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.47% (0.8340 => 0.8629, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.4479 => 1.4980, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.37% (0.3115 => 0.3220, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.34% (2.1401 => 2.2116, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.34% (1.3279 => 1.3722, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.29% (0.9056 => 0.9354, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 3.22% (0.6834 => 0.7054, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.20% (0.3124 => 0.3224, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.16% (6.6074 => 6.8163, std.dev.: 0.0292) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.13% (1.1170 => 1.1520, std.dev.: 0.0085) MultiSource/Benchmarks/McCat/05-eks/eks: 3.12% (0.4397 => 0.4534, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.10% (0.8317 => 0.8575, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.02% (4.1763 => 4.3026, std.dev.: 0.0390) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.01% (8.6476 => 8.9079, std.dev.: 0.0490) MultiSource/Applications/d/make_dparser: 2.90% (3.2366 => 3.3305, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.87% (0.9074 => 0.9334, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.84% (0.3657 => 0.3761, std.dev.: 0.0023) MultiSource/Applications/treecc/treecc: 2.82% (1.9948 => 2.0510, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.82% (0.8805 => 0.9053, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.71% (0.8697 => 0.8933, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.67% (0.8050 => 0.8265, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.67% (0.8204 => 0.8423, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.62% (0.8611 => 0.8837, std.dev.: 0.0058) MultiSource/Benchmarks/Bullet/bullet: 2.52% (31.8598 => 32.6627, std.dev.: 0.1848) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.41% (0.8286 => 0.8486, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.39% (0.8316 => 0.8515, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.39% (0.8066 => 0.8259, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.37% (0.8086 => 0.8278, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.28% (0.8855 => 0.9057, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.27% (0.9069 => 0.9275, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.18% (0.8712 => 0.8902, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.12% (0.8518 => 0.8699, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.10% (13.1811 => 13.4576, std.dev.: 0.0845) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.08% (0.8420 => 0.8595, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.04% (0.8069 => 0.8234, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.04% (0.5191 => 0.5297, std.dev.: 0.0035) MultiSource/Benchmarks/PAQ8p/paq8p: 2.00% (2.3764 => 2.4239, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.98% (4.4873 => 4.5763, std.dev.: 0.0315) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.98% (0.8927 => 0.9104, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.01% (1.2423 => 1.2548, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 107.54% (0.0199 => 0.0413, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/pi: 58.63% (1.5795 => 2.5056, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.35% (0.7597 => 0.8839, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.14% (2.9753 => 3.4556, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.53% (2.7995 => 3.2064, std.dev.: 0.0407) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.62% (5.0261 => 5.6103, std.dev.: 0.0379) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (6.3772 => 7.0017, std.dev.: 0.1714) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.47% (0.3186 => 0.3456, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/queens: 7.46% (1.7056 => 1.8329, std.dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.39% (1.1857 => 1.2733, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.68% (4.7794 => 5.0988, std.dev.: 0.1107) SingleSource/Benchmarks/Misc/richards_benchmark: 6.11% (1.3037 => 1.3833, std.dev.: 0.0036) MultiSource/Applications/SIBsim4/SIBsim4: 6.03% (3.1873 => 3.3796, std.dev.: 0.0443) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.88% (4.9686 => 5.2607, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.79% (4.5327 => 4.7953, std.dev.: 0.0269) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 5.71% (44.5605 => 47.1032, std.dev.: 0.7071) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.71% (3.3761 => 3.5352, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.69% (6.2275 => 6.5197, std.dev.: 0.0320) MultiSource/Applications/lambda-0_1_3/lambda: 4.29% (7.4933 => 7.8146, std.dev.: 0.0596) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.23% (4.9453 => 5.1544, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.08% (4.9469 => 5.1489, std.dev.: 0.0130) MultiSource/Applications/hexxagon/hexxagon: 3.86% (14.0064 => 14.5473, std.dev.: 0.0447) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.76% (0.3587 => 0.3722, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.86% (11.5690 => 11.9004, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.86% (4.3552 => 4.4799, std.dev.: 0.0203) MultiSource/Applications/siod/siod: 2.86% (3.6643 => 3.7692, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.70% (8.2783 => 8.5018, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.30% (4.8660 => 4.9777, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout/lists: 2.18% (7.3375 => 7.4978, std.dev.: 0.0187) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.88% (4.8362 => 4.9272, std.dev.: 0.0168) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.76% (1.1365 => 1.1565, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.51% (2.4647 => 2.5019, std.dev.: 0.0133) SingleSource/Benchmarks/Stanford/FloatMM: 1.50% (0.8807 => 0.8939, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 1.38% (8.5322 => 8.6497, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: 1.32% (1.0841 => 1.0984, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 1.24% (1.2061 => 1.2211, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.11% (2.5763 => 2.6049, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/methcall: 1.10% (8.9760 => 9.0748, std.dev.: 0.0168) MultiSource/Applications/spiff/spiff: 1.05% (2.8561 => 2.8860, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.82% (5.4641 => 4.3267, std.dev.: 0.0473) SingleSource/Benchmarks/McGill/chomp: -11.46% (1.1216 => 0.9931, std.dev.: 0.0188) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.36% (1.0512 => 0.9318, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.22% (7.2130 => 6.4040, std.dev.: 0.0386) MultiSource/Benchmarks/mafft/pairlocalalign: -8.51% (63.1822 => 57.8027, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.07% (14.6451 => 13.4639, std.dev.: 0.2053) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.22% (0.3269 => 0.3033, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.84% (4.7482 => 4.4234, std.dev.: 0.0539) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.95% (3.7148 => 3.4936, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.87% (5.4972 => 5.1743, std.dev.: 0.0504) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.04% (5.1557 => 4.8959, std.dev.: 0.0783) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.38% (4.7449 => 4.5372, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.79% (6.0224 => 5.7942, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.25% (0.5807 => 0.5618, std.dev.: 0.0071) MultiSource/Applications/lua/lua: -3.15% (29.8330 => 28.8929, std.dev.: 0.2766) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.96% (28.5821 => 27.7370, std.dev.: 0.0292) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.66% (2.6356 => 2.5654, std.dev.: 0.0173) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.53% (2.4490 => 2.3871, std.dev.: 0.0102) MultiSource/Applications/aha/aha: -2.43% (3.3398 => 3.2587, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: -2.25% (3.4237 => 3.3466, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/mason/mason: -2.20% (0.5415 => 0.5296, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.89% (11.5316 => 11.3141, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.60% (4.9994 => 4.9194, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.53% (3.2169 => 3.1678, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.3487 => 2.3197, std.dev.: 0.0022) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.76% (16.4461 => 16.8999, std.dev.: 0.0986) MultiSource/Applications/obsequi/Obsequi: 4.08% (1.0262 => 1.0681, std.dev.: 0.0154) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6978.48% (0.3123 => 22.1061, std.dev.: 0.3841) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.21% (0.2463 => 0.3675, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.00% (0.6010 => 0.6130, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.03% (0.3266 => 0.3365, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 2.29% (0.1969 => 0.2014, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 75.61% (0.0123 => 0.0216, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.15% (0.0408 => 0.0429, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.20% (0.0384 => 0.0427, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 5.79% (0.0190 => 0.0201, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.85% (0.1438 => 0.1479, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.21% (1.1329 => 1.1353, std.dev.: 0.0341) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -1.78% (0.1462 => 0.1436, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.68% (0.4164 => 0.4234, std.dev.: 0.0430) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.99% (0.1369 => 0.1410, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.37% (0.0641 => 0.0613, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.59% (0.0195 => 0.0202, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.90% (0.0578 => 0.0589, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.70% (1.1437 => 1.1975, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 900.00% (0.0001 => 0.0010, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.80% (0.0627 => 0.0553, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.44% (0.0180 => 0.0188, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.42% (0.8017 => 0.7823, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 19.35% (0.0062 => 0.0074, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 01:25:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 03:25:48 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121113092548.E9B9E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5813?compare_to=5811&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5813, Order: 167821, Start Time: 2012-11-13 07:58:18, End Time: 2012-11-13 09:26:03 To: 5811, Order: 167816, Start Time: 2012-11-13 06:06:45, End Time: 2012-11-13 07:31:49 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (3 on baseline) Performance Improvements: 0 (149 on baseline) Unchanged Tests: 1042 (890 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.25% (1.2783 => 1.3710, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.4937 => 7.6827, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/hash2: 2.24% (3.1932 => 3.2648, std.dev.: 0.0167) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.46% (0.1431 => 0.1310, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.56% (0.3821 => 0.3532, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -6.87% (2.4924 => 2.3212, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.38% (0.9542 => 0.8933, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.33% (0.3142 => 0.2943, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -6.20% (0.3357 => 0.3149, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: -6.03% (0.3880 => 0.3646, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.01% (0.3896 => 0.3662, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.98% (0.3848 => 0.3618, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -5.95% (0.3812 => 0.3585, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.90% (0.4033 => 0.3795, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.86% (0.3891 => 0.3663, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -5.85% (0.3831 => 0.3607, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -5.83% (16.1920 => 15.2477, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.80% (0.6484 => 0.6108, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.79% (0.3884 => 0.3659, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: -5.77% (0.4176 => 0.3935, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -5.73% (9.2283 => 8.6995, std.dev.: 0.0086) MultiSource/Applications/JM/ldecod/ldecod: -5.72% (7.0961 => 6.6900, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/football/football: -5.72% (0.9179 => 0.8654, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.69% (0.9852 => 0.9291, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.68% (1.3722 => 1.2943, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.66% (1.0544 => 0.9947, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.64% (0.2428 => 0.2291, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -5.59% (0.1879 => 0.1774, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/property: -5.57% (0.4199 => 0.3965, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.52% (0.3658 => 0.3456, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.38% (4.8802 => 4.6177, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.32% (4.0323 => 3.8176, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.32% (4.8161 => 4.5600, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.31% (0.5478 => 0.5187, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.28% (0.7198 => 0.6818, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.27% (0.5859 => 0.5550, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.27% (0.2695 => 0.2553, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.24% (0.5591 => 0.5298, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.23% (0.7339 => 0.6955, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.23% (0.3406 => 0.3228, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: -5.21% (17.1032 => 16.2118, std.dev.: 0.0193) MultiSource/Applications/lemon/lemon: -5.20% (1.1450 => 1.0855, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.18% (0.6676 => 0.6330, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.17% (0.6052 => 0.5739, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.17% (14.2083 => 13.4739, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.16% (0.6260 => 0.5937, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.15% (0.6681 => 0.6337, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.13% (0.6194 => 0.5876, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.12% (0.5863 => 0.5563, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.11% (1.3864 => 1.3156, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.10% (0.6230 => 0.5912, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.10% (0.5567 => 0.5283, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.10% (0.5705 => 0.5414, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.10% (4.5069 => 4.2772, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.10% (1.6364 => 1.5530, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.09% (0.6189 => 0.5874, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.08% (0.7524 => 0.7142, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.07% (1.2300 => 1.1676, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.07% (0.5857 => 0.5560, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.07% (0.6667 => 0.6329, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.06% (0.5849 => 0.5553, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.05% (6.7716 => 6.4297, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.04% (0.6304 => 0.5986, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.04% (0.6395 => 0.6073, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.03% (0.5805 => 0.5513, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -4.99% (1.2784 => 1.2146, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.99% (0.6297 => 0.5983, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.98% (0.5925 => 0.5630, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.95% (0.6440 => 0.6121, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: -4.95% (0.4280 => 0.4068, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.94% (1.4642 => 1.3919, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.92% (0.6446 => 0.6129, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.91% (0.5802 => 0.5517, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.90% (0.5575 => 0.5302, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.89% (0.5456 => 0.5189, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.88% (0.5569 => 0.5297, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.88% (0.6660 => 0.6335, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.88% (0.6395 => 0.6083, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.87% (0.5581 => 0.5309, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.87% (0.6033 => 0.5739, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.86% (0.5941 => 0.5652, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: -4.86% (0.3581 => 0.3407, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.82% (0.3483 => 0.3315, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -4.82% (1.2515 => 1.1912, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.81% (0.5570 => 0.5302, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.80% (0.5688 => 0.5415, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.80% (0.6736 => 0.6413, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -4.79% (0.2985 => 0.2842, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.71% (8.0126 => 7.6350, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/gs/gs: -4.71% (4.3330 => 4.1290, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.67% (0.2548 => 0.2429, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: -4.64% (3.5154 => 3.3522, std.dev.: 0.0033) MultiSource/Applications/ClamAV/clamscan: -4.64% (15.2527 => 14.5452, std.dev.: 0.0093) MultiSource/Benchmarks/nbench/nbench: -4.61% (1.1530 => 1.0999, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: -4.59% (0.2659 => 0.2537, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.58% (0.4916 => 0.4691, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.57% (0.8521 => 0.8132, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: -4.53% (15.5079 => 14.8060, std.dev.: 0.0102) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.49% (22.4056 => 21.4002, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.48% (1.2221 => 1.1673, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.48% (0.2278 => 0.2176, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.41% (1.2210 => 1.1671, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.40% (0.5999 => 0.5735, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.39% (0.6293 => 0.6017, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.34% (0.4813 => 0.4604, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: -4.32% (0.6441 => 0.6163, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -4.30% (1.3148 => 1.2582, std.dev.: 0.0197) SingleSource/UnitTests/ObjC++/Hello: -4.29% (0.6347 => 0.6075, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.28% (0.7919 => 0.7580, std.dev.: 0.0013) MultiSource/Applications/lua/lua: -4.25% (4.0594 => 3.8867, std.dev.: 0.0080) SingleSource/UnitTests/ObjC++/property-reference: -4.20% (0.7779 => 0.7452, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/05-eks/eks: -4.19% (0.4515 => 0.4326, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.17% (0.3931 => 0.3767, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -4.16% (0.3194 => 0.3061, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: -4.15% (0.7447 => 0.7138, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.12% (0.3057 => 0.2931, std.dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: -4.09% (34.0927 => 32.6969, std.dev.: 0.0452) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.09% (0.2933 => 0.2813, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: -4.08% (0.2871 => 0.2754, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.07% (0.3319 => 0.3184, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: -4.05% (0.3059 => 0.2935, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -4.05% (0.2939 => 0.2820, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/09-vor/vor: -4.00% (0.3271 => 0.3140, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: -3.95% (0.4861 => 0.4669, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.95% (0.3016 => 0.2897, std.dev.: 0.0035) MultiSource/Applications/siod/siod: -3.92% (2.4021 => 2.3079, std.dev.: 0.0073) MultiSource/Applications/oggenc/oggenc: -3.91% (5.0226 => 4.8261, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.91% (0.3837 => 0.3687, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.91% (2.1713 => 2.0865, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: -3.87% (0.2999 => 0.2883, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: -3.87% (0.3026 => 0.2909, std.dev.: 0.0028) MultiSource/Applications/treecc/treecc: -3.84% (2.1401 => 2.0579, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -3.83% (0.3867 => 0.3719, std.dev.: 0.0046) MultiSource/Applications/spiff/spiff: -3.81% (0.8418 => 0.8097, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -3.79% (0.3481 => 0.3349, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/strcat: -3.78% (0.2989 => 0.2876, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary3: -3.77% (0.3446 => 0.3316, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.66% (0.3252 => 0.3133, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -3.46% (0.7982 => 0.7706, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: -3.39% (18.2933 => 17.6738, std.dev.: 0.0302) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.34% (0.3323 => 0.3212, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.94% (0.9077 => 0.8810, std.dev.: 0.0025) MultiSource/Applications/hbd/hbd: -2.82% (1.5610 => 1.5170, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.45% (0.4321 => 0.4215, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -1.81% (20.7746 => 20.3994, std.dev.: 0.0258) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.48% (7.5137 => 5.7495, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/richards_benchmark: -8.65% (1.2842 => 1.1731, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7067, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fbench: -3.72% (2.2633 => 2.1791, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4702, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 01:49:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 03:49:52 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121113094952.2D6A82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5814?compare_to=5807&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5814, Order: 167816, Start Time: 2012-11-13 06:30:52, End Time: 2012-11-13 09:50:07 To: 5807, Order: 167801, Start Time: 2012-11-13 02:27:08, End Time: 2012-11-13 05:42:35 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (173 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (718 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.69% (124.9328 => 129.5419, std.dev.: 1.4019) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.44% (0.0625 => 0.0884, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.64% (0.1063 => 0.1410, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.61% (0.2969 => 0.3759, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.01% (0.4253 => 0.5359, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.86% (0.1106 => 0.1392, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.77% (0.0714 => 0.0898, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.76% (0.4139 => 0.5164, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 24.54% (1.5932 => 1.9842, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.36% (0.5900 => 0.7337, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.09% (0.4994 => 0.6197, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.00% (0.0475 => 0.0589, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 23.73% (0.0948 => 0.1173, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.63% (0.0584 => 0.0722, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.42% (0.5000 => 0.6171, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.40% (0.0547 => 0.0675, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.15% (0.1620 => 0.1995, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.72% (0.1021 => 0.1253, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.22% (0.1107 => 0.1353, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 22.20% (0.0599 => 0.0732, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.07% (0.0897 => 0.1095, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.40% (0.0584 => 0.0709, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.34% (0.0642 => 0.0779, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.33% (0.0633 => 0.0768, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.03% (0.1103 => 0.1335, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.92% (0.1549 => 0.1873, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 20.83% (0.0821 => 0.0992, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.81% (0.0495 => 0.0598, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.80% (0.0822 => 0.0993) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.57% (0.3903 => 0.4706, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.44% (0.1003 => 0.1208, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.26% (0.1604 => 0.1929, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 20.26% (0.1619 => 0.1947, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 19.64% (0.0947 => 0.1133, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.63% (0.1462 => 0.1749, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 19.60% (0.1505 => 0.1800, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 18.81% (0.0808 => 0.0960, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 18.80% (0.1218 => 0.1447, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.79% (0.1160 => 0.1378, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.77% (0.2866 => 0.3404, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.77% (0.2014 => 0.2392, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.71% (0.3890 => 0.4618, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 18.66% (0.4029 => 0.4781, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 18.66% (0.5826 => 0.6913, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/mst/mst: 18.34% (0.0698 => 0.0826, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 18.20% (0.5889 => 0.6961, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.18% (0.0572 => 0.0676, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.13% (0.2736 => 0.3232, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.11% (1.3152 => 1.5534, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: 18.10% (0.5546 => 0.6550, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 18.07% (0.0581 => 0.0686, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.01% (0.1088 => 0.1284, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 17.71% (1.8794 => 2.2123, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.65% (0.4658 => 0.5480, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.53% (3.5627 => 4.1873, std.dev.: 0.0049) MultiSource/Applications/hbd/hbd: 17.32% (0.9697 => 1.1377, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.28% (0.1968 => 0.2308, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.22% (1.6211 => 1.9003, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.06% (0.3271 => 0.3829, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.97% (0.5026 => 0.5879, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.80% (0.2875 => 0.3358, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 16.68% (0.1421 => 0.1658, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 16.59% (1.0781 => 1.2570, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.44% (0.4361 => 0.5078, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hello: 16.32% (0.2714 => 0.3157, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 16.31% (4.2109 => 4.8976, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.26% (0.3930 => 0.4569, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/fibo: 16.26% (0.2725 => 0.3168, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.18% (0.2738 => 0.3181, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.17% (2.7292 => 3.1704, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: 16.12% (0.1284 => 0.1491, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.09% (0.2729 => 0.3168, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 16.04% (0.2750 => 0.3191, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 15.98% (0.7171 => 0.8317, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 15.96% (0.9909 => 1.1490, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.85% (4.4195 => 5.1201, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/except: 15.83% (0.2811 => 0.3256, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 15.80% (0.2803 => 0.3246, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.80% (0.2911 => 0.3371, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 15.79% (0.2780 => 0.3219, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 15.78% (0.3004 => 0.3478, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 15.75% (0.2813 => 0.3256, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.72% (0.2792 => 0.3231, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.70% (1.9966 => 2.3101, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/wc: 15.70% (0.3096 => 0.3582, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 15.62% (0.2823 => 0.3264, std.dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 15.51% (0.2566 => 0.2964, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.50% (2.0673 => 2.3878, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.49% (1.9694 => 2.2745, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions-4: 15.44% (0.3465 => 0.4000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.40% (0.3195 => 0.3687, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 15.32% (0.3446 => 0.3974, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 15.27% (0.3496 => 0.4030, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 15.24% (0.3267 => 0.3765, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 15.23% (0.3460 => 0.3987, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.19% (0.3488 => 0.4018, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 15.19% (0.3442 => 0.3965, std.dev.: 0.0053) MultiSource/Benchmarks/Bullet/bullet: 15.17% (23.5202 => 27.0872, std.dev.: 0.0350) SingleSource/UnitTests/ObjC/synchronized: 15.16% (0.3469 => 0.3995, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.14% (0.1090 => 0.1255, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 15.10% (0.3258 => 0.3750, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.93% (0.3060 => 0.3517, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 14.86% (0.3317 => 0.3810, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/exceptions: 14.82% (0.3643 => 0.4183, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 14.79% (0.3650 => 0.4190, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.57% (0.3362 => 0.3852, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 14.57% (1.4269 => 1.6348, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/parameter-passing: 14.55% (0.3724 => 0.4266, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 14.55% (0.2075 => 0.2377, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.47% (0.3282 => 0.3757, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 14.46% (0.3678 => 0.4210, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.41% (0.3845 => 0.4399, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.40% (0.3124 => 0.3574, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 14.40% (0.4146 => 0.4743, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 14.25% (0.3726 => 0.4257, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.15% (0.3625 => 0.4138, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 14.13% (0.3348 => 0.3821, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 14.09% (0.3477 => 0.3967, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 13.97% (0.7875 => 0.8975, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.90% (0.3690 => 0.4203, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 13.78% (0.4251 => 0.4837, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 13.68% (2.1653 => 2.4616, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.66% (0.3981 => 0.4525, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 13.46% (0.0758 => 0.0860, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 13.40% (2.1013 => 2.3829, std.dev.: 0.0064) MultiSource/Applications/JM/lencod/lencod: 13.38% (4.6177 => 5.2357, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++/bigfib: 13.25% (0.5012 => 0.5676, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 12.34% (0.2691 => 0.3023, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 12.29% (5.5417 => 6.2225, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.11% (0.2040 => 0.2287, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.93% (0.6435 => 0.7203, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.71% (0.1383 => 0.1545, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 11.58% (0.3498 => 0.3903, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 11.34% (0.6634 => 0.7386, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.28% (0.1028 => 0.1144, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: 10.87% (0.4847 => 0.5374, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.83% (0.3084 => 0.3418, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.81% (0.2737 => 0.3033, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.64% (0.3336 => 0.3691, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.64% (0.2068 => 0.2288, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.89% (0.2103 => 0.2311, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 9.54% (0.2391 => 0.2619, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 9.47% (2.0346 => 2.2272, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.98% (4.6926 => 5.1138, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.77% (0.5361 => 0.5831, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.76% (11.6398 => 12.6590, std.dev.: 0.0184) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.16% (0.7426 => 0.8032, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.04% (0.5584 => 0.6033, std.dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: 7.04% (11.9555 => 12.7966, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.78% (0.3792 => 0.4011, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 65.40% (0.2162 => 0.3576, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.26% (0.0734 => 0.0868, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 10.81% (0.2802 => 0.3105, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.01% (0.3693 => 0.3952, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6117, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6704, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-2: 4.68% (1.8057 => 1.8902, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1646, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/dry: 4.13% (14.0481 => 14.6277, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1955, std.dev.: 0.0078) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2223, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.53% (7.1849 => 7.2947, std.dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3042, std.dev.: 0.0038) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5807, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.64% (2.4764 => 2.4357, std.dev.: 0.0145) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5755, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9767, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7970, std.dev.: 0.0123) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -5.50% (0.2402 => 0.2270, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.55% (11.2080 => 10.8106, std.dev.: 0.0023) MultiSource/Applications/siod/siod: -3.04% (6.9842 => 6.7721, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -2.56% (17.2379 => 16.7966, std.dev.: 0.0299) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.27% (41.7953 => 40.8473, std.dev.: 0.0122) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.07% (0.6293 => 0.6163, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5795, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4960, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0458, std.dev.: 0.0145) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 02:29:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 04:29:43 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121113102943.292022A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5815?compare_to=5810&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5815, Order: 167821, Start Time: 2012-11-13 08:19:43, End Time: 2012-11-13 10:29:57 To: 5810, Order: 167815, Start Time: 2012-11-13 05:17:32, End Time: 2012-11-13 07:26:42 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 34 (168 on baseline) Performance Improvements: 11 (39 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 993 (680 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 15.37% (0.7208 => 0.8316, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.00% (0.6629 => 0.7557, std.dev.: 0.0109) SingleSource/UnitTests/ObjC/messages-2: 13.44% (0.0774 => 0.0878, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 13.10% (0.6885 => 0.7787, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ary: 11.66% (0.3560 => 0.3975, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/heapsort: 11.42% (0.3153 => 0.3513, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/except: 11.29% (0.3161 => 0.3518, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.10% (0.2902 => 0.3224, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists: 10.60% (0.3830 => 0.4236, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.99% (0.5663 => 0.6229, std.dev.: 0.0110) SingleSource/UnitTests/ObjC/BoolLiteralTest: 9.97% (0.3960 => 0.4355, std.dev.: 0.0067) SingleSource/UnitTests/ObjC++/Hello: 8.94% (0.6553 => 0.7139, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.70% (0.3247 => 0.3497, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/trivial-interface: 6.83% (0.3939 => 0.4208, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.74% (0.5071 => 0.5413, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.74% (0.5256 => 0.5610, std.dev.: 0.0115) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.62% (0.4051 => 0.4319, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.43% (0.9222 => 0.9815, std.dev.: 0.0138) MultiSource/Benchmarks/Fhourstones/fhourstones: 5.81% (0.1909 => 0.2020, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/for-in: 4.83% (0.4290 => 0.4497, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary2: 3.42% (0.3951 => 0.4086, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.50% (1.1612 => 1.1902, std.dev.: 0.0070) MultiSource/Benchmarks/PAQ8p/paq8p: 2.45% (11.1663 => 11.4398, std.dev.: 0.0231) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.08% (5.1223 => 5.2289, std.dev.: 0.0204) MultiSource/Applications/lua/lua: 1.93% (4.6195 => 4.7087, std.dev.: 0.0176) MultiSource/Applications/d/make_dparser: 1.22% (4.0020 => 4.0507, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 19.34% (0.0760 => 0.0907, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.09% (1.6000 => 1.8574, std.dev.: 0.0212) MultiSource/Applications/lemon/lemon: 4.39% (1.4684 => 1.5329, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.75% (6.3269 => 6.5009, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.21% (9.1247 => 9.3263, std.dev.: 0.0701) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 1.59% (9.9219 => 10.0799, std.dev.: 0.0278) SingleSource/Benchmarks/Shootout/hash: 1.36% (5.1718 => 5.2422, std.dev.: 0.0202) SingleSource/Benchmarks/Shootout-C++/hash: 1.25% (0.8025 => 0.8125, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -11.40% (0.9133 => 0.8092, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: -9.82% (0.1151 => 0.1038, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.79% (1.9322 => 1.8010, std.dev.: 0.0257) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.56% (2.4631 => 2.3509, std.dev.: 0.0280) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.14% (2.7613 => 2.6745, std.dev.: 0.0246) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.57% (0.5950 => 0.5797, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.54% (11.2745 => 11.1011, std.dev.: 0.0274) MultiSource/Applications/JM/lencod/lencod: -1.04% (32.4268 => 32.0907, std.dev.: 0.0377) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -8.60% (0.5839 => 0.5337, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: -1.23% (3.9357 => 3.8872, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/hash2: -1.19% (3.5132 => 3.4715, std.dev.: 0.0086) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.82% (0.1349 => 0.1360, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -12.80% (0.0492 => 0.0429, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0651 => 0.0651, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 0.02% (493.9489 => 494.0521, std.dev.: 0.2009) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.02% (4.3882 => 0.0429, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/power/power: 43710.60% (1.1277 => 494.0521, std.dev.: 0.2009) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 205.07% (0.5229 => 1.5952, std.dev.: 0.0726) MultiSource/Applications/SPASS/SPASS: 21.60% (14.9895 => 18.2267, std.dev.: 0.0292) MultiSource/Applications/kimwitu++/kc: 51.83% (14.1553 => 21.4916, std.dev.: 0.0268) MultiSource/Benchmarks/MallocBench/gs/gs: 22.67% (4.1105 => 5.0424, std.dev.: 0.0575) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 46.42% (1.1048 => 1.6176, std.dev.: 0.0103) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 436.19% (7.1582 => 38.3818, std.dev.: 0.0605) SingleSource/Benchmarks/Misc-C++-EH/spirit: 88.64% (3.4629 => 6.5325, std.dev.: 0.1077) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.12% (0.6222 => 1.0336, std.dev.: 0.0695) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10913.47% (0.0720 => 7.9297, std.dev.: 0.0605) MultiSource/Applications/SIBsim4/SIBsim4: 3887100.00% (0.0001 => 3.8872, std.dev.: 0.0170) MultiSource/Applications/SPASS/SPASS: 14607600.00% (0.0001 => 14.6077, std.dev.: 0.1908) MultiSource/Applications/kimwitu++/kc: 52200.00% (0.0001 => 0.0523, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 63800.00% (0.0001 => 0.0639, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 578100.00% (0.0001 => 0.5782, std.dev.: 0.0268) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10086100.00% (0.0001 => 10.0862, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6589000.00% (0.0001 => 6.5891, std.dev.: 0.1104) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1791.49% (1.1194 => 21.1733, std.dev.: 0.2047) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 69.94% (2.9384 => 4.9935, std.dev.: 0.0592) MultiSource/Applications/ClamAV/clamscan: 60.92% (22.1758 => 35.6857, std.dev.: 0.1709) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.37% (7.0540 => 11.1011, std.dev.: 0.0274) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 51.45% (8.1363 => 12.3223, std.dev.: 0.0460) MultiSource/Applications/JM/lencod/lencod: 46.29% (21.9371 => 32.0907, std.dev.: 0.0377) MultiSource/Benchmarks/FreeBench/distray/distray: 45.27% (0.1056 => 0.1534, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/almabench: 39.73% (0.0730 => 0.1020, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: 38.48% (0.1432 => 0.1983, std.dev.: 0.0081) SingleSource/UnitTests/ObjC/messages-2: 32.63% (0.0662 => 0.0878, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/15-trie/trie: 31.50% (0.0527 => 0.0693, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/dot-syntax-1: 30.48% (0.0479 => 0.0625, std.dev.: 0.0003) SingleSource/UnitTests/vla: 30.14% (0.0355 => 0.0462, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 30.09% (0.1695 => 0.2205, std.dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/dry: 29.17% (0.0456 => 0.0589, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 28.99% (0.1566 => 0.2020, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 27.19% (0.4620 => 0.5876, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/loader/loader: 26.79% (0.2758 => 0.3497, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.49% (0.0408 => 0.0512, std.dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: 25.17% (0.0719 => 0.0900, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 24.95% (0.0457 => 0.0571, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 24.94% (0.0437 => 0.0546, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Queens: 24.64% (0.0414 => 0.0516, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.13% (0.0746 => 0.0926, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/functionobjects: 24.08% (0.5020 => 0.6229, std.dev.: 0.0110) SingleSource/Benchmarks/Stanford/Oscar: 24.06% (0.0636 => 0.0789, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.92% (0.1062 => 0.1316, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 23.86% (0.2603 => 0.3224, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists: 23.79% (0.3422 => 0.4236, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 23.26% (2.2969 => 2.8312, std.dev.: 0.0476) SingleSource/Benchmarks/Shootout-C++/ary: 22.99% (0.3232 => 0.3975, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/08-main/main: 22.67% (0.2554 => 0.3133, std.dev.: 0.0209) MultiSource/Benchmarks/MallocBench/espresso/espresso: 22.61% (4.2646 => 5.2289, std.dev.: 0.0204) SingleSource/Benchmarks/Shootout-C++/except: 22.54% (0.2871 => 0.3518, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/heapsort: 22.32% (0.2872 => 0.3513, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/instance-method-metadata: 21.90% (0.3543 => 0.4319, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.88% (0.9765 => 1.1902, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/for-in: 21.74% (0.3694 => 0.4497, std.dev.: 0.0050) MultiSource/Applications/lua/lua: 21.60% (3.8723 => 4.7087, std.dev.: 0.0176) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.56% (0.4615 => 0.5610, std.dev.: 0.0115) MultiSource/Applications/d/make_dparser: 21.45% (3.3354 => 4.0507, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.44% (2.2024 => 2.6745, std.dev.: 0.0246) SingleSource/UnitTests/ObjC/trivial-interface: 21.16% (0.3473 => 0.4208, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 21.16% (0.8101 => 0.9815, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/spellcheck: 21.06% (0.4203 => 0.5088, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout/matrix: 21.03% (0.0818 => 0.0990, std.dev.: 0.0057) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 21.02% (0.1584 => 0.1917, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ary2: 20.92% (0.3379 => 0.4086, std.dev.: 0.0045) MultiSource/Applications/treecc/treecc: 20.86% (2.0273 => 2.4501, std.dev.: 0.0381) MultiSource/Benchmarks/McCat/09-vor/vor: 20.66% (0.3180 => 0.3837, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/tsp/tsp: 20.60% (0.1175 => 0.1417, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 20.56% (14.3668 => 17.3202, std.dev.: 0.0797) SingleSource/UnitTests/ObjC++/Hello: 20.49% (0.5925 => 0.7139, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 20.47% (3.8922 => 4.6891, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/hash: 20.24% (0.4289 => 0.5157, std.dev.: 0.0136) MultiSource/Applications/oggenc/oggenc: 20.11% (5.7591 => 6.9173, std.dev.: 0.0835) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.11% (0.8172 => 0.9815, std.dev.: 0.0081) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 19.99% (0.1906 => 0.2287, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.93% (0.5569 => 0.6679, std.dev.: 0.0219) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 19.67% (0.0798 => 0.0955, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/neural/neural: 19.21% (0.1463 => 0.1744, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.19% (0.2700 => 0.3218, std.dev.: 0.0177) MultiSource/Applications/viterbi/viterbi: 18.97% (0.1555 => 0.1850, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.92% (0.3441 => 0.4092, std.dev.: 0.0133) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.76% (0.1125 => 0.1336, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hello: 18.61% (0.2714 => 0.3219, std.dev.: 0.0098) SingleSource/UnitTests/ObjC/exceptions: 18.55% (0.3828 => 0.4538, std.dev.: 0.0117) MultiSource/Applications/hbd/hbd: 18.36% (1.5603 => 1.8468, std.dev.: 0.0220) MultiSource/Benchmarks/mafft/pairlocalalign: 18.35% (9.4845 => 11.2253, std.dev.: 0.0567) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 18.11% (4.9449 => 5.8403, std.dev.: 0.0413) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.87% (5.0018 => 5.8956, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.42% (1.5415 => 1.8101, std.dev.: 0.0260) MultiSource/Applications/Burg/burg: 17.39% (1.1642 => 1.3667, std.dev.: 0.0547) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.28% (0.1117 => 0.1310, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.11% (0.0871 => 0.1020, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.00% (0.0953 => 0.1115, std.dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 16.92% (17.1811 => 20.0886, std.dev.: 0.0638) MultiSource/Applications/spiff/spiff: 16.91% (0.7835 => 0.9160, std.dev.: 0.0355) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.89% (0.0675 => 0.0789, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/health/health: 16.80% (0.1268 => 0.1481, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/mst/mst: 16.51% (0.1163 => 0.1355, std.dev.: 0.0068) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.36% (0.0648 => 0.0754, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.32% (0.2065 => 0.2402, std.dev.: 0.0078) MultiSource/Benchmarks/sim/sim: 16.30% (0.3387 => 0.3939, std.dev.: 0.0082) MultiSource/Benchmarks/nbench/nbench: 15.74% (1.1840 => 1.3704, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/fibo: 15.67% (0.2725 => 0.3152, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 15.45% (0.5981 => 0.6905, std.dev.: 0.0182) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.23% (0.0834 => 0.0961, std.dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: 15.04% (63.2438 => 72.7568, std.dev.: 0.1119) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.88% (0.1337 => 0.1536, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.83% (2.0665 => 2.3729, std.dev.: 0.0488) SingleSource/UnitTests/ObjC/block-byref-aggr: 14.44% (0.3817 => 0.4368, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.29% (0.1029 => 0.1176, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.00% (0.3307 => 0.3770, std.dev.: 0.0165) MultiSource/Applications/sgefa/sgefa: 13.96% (0.3109 => 0.3543, std.dev.: 0.0118) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.91% (0.2271 => 0.2587, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.86% (0.5860 => 0.6672, std.dev.: 0.0267) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.82% (1.3050 => 1.4854, std.dev.: 0.0502) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.65% (1.1861 => 1.3480, std.dev.: 0.0590) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 13.56% (1.5859 => 1.8010, std.dev.: 0.0257) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.56% (0.5105 => 0.5797, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 13.34% (0.3927 => 0.4451, std.dev.: 0.0151) SingleSource/UnitTests/ObjC++/property-reference-object: 13.32% (0.6030 => 0.6833, std.dev.: 0.0240) SingleSource/UnitTests/ObjC/exceptions-4: 13.01% (0.3543 => 0.4004, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/property: 12.97% (0.3886 => 0.4390, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.90% (0.3497 => 0.3948, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/synchronized: 12.86% (0.3561 => 0.4019, std.dev.: 0.0130) SingleSource/UnitTests/ObjC/exceptions-3: 12.80% (0.3516 => 0.3966, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 12.69% (1.4186 => 1.5986, std.dev.: 0.0353) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.60% (0.1143 => 0.1287, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.73% (0.0929 => 0.1038, std.dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 11.58% (1.2842 => 1.4329, std.dev.: 0.0448) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.94% (0.4879 => 0.5413, std.dev.: 0.0041) MultiSource/Benchmarks/PAQ8p/paq8p: 10.35% (10.3673 => 11.4398, std.dev.: 0.0231) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.75% (0.3826 => 0.4199, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/oourafft: 9.72% (0.3282 => 0.3601, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.65% (0.2756 => 0.3022, std.dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference: 9.65% (0.7326 => 0.8033, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.75% (2.2022 => 2.3509, std.dev.: 0.0280) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.02% (7.9617 => 8.3611, std.dev.: 0.0728) SingleSource/UnitTests/Vector/constpool: 3.35% (54.1659 => 55.9780, std.dev.: 0.0562) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.92% (4.3953 => 11.0287, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: 147.67% (5.3999 => 13.3740, std.dev.: 0.0020) MultiSource/Benchmarks/llubenchmark/llu: 61.61% (3.7781 => 6.1058, std.dev.: 0.3192) MultiSource/Benchmarks/McCat/09-vor/vor: 33.80% (0.1154 => 0.1544, std.dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 25.14% (13.4384 => 16.8165, std.dev.: 0.0581) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.12% (1.5086 => 1.8574, std.dev.: 0.0212) MultiSource/Applications/minisat/minisat: 22.43% (9.1159 => 11.1609, std.dev.: 0.1021) SingleSource/Benchmarks/Shootout/ary3: 20.73% (3.6994 => 4.4663, std.dev.: 0.1088) SingleSource/Benchmarks/Shootout-C++/ary2: 19.82% (0.0757 => 0.0907, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/oourafft: 17.63% (6.6465 => 7.8185, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 17.18% (3.7221 => 4.3616, std.dev.: 0.0465) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.81% (1.1145 => 1.3018, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.60% (10.3460 => 11.7530, std.dev.: 0.2105) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.91% (0.2944 => 0.3324, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.68% (2.8904 => 3.2280, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 10.28% (1.1396 => 1.2568, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 9.93% (3.1578 => 3.4715, std.dev.: 0.0086) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.92% (8.6802 => 9.5409, std.dev.: 0.0877) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.73% (3.8532 => 4.2283, std.dev.: 0.0183) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.63% (1.7254 => 1.8916, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 8.99% (0.7455 => 0.8125, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/heapsort: 8.65% (3.8526 => 4.1860, std.dev.: 0.0751) SingleSource/Benchmarks/Shootout/hash: 6.79% (4.9088 => 5.2422, std.dev.: 0.0202) MultiSource/Applications/lemon/lemon: 6.01% (1.4460 => 1.5329, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.92% (0.9540 => 1.0105, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.66% (4.2280 => 4.4674, std.dev.: 0.0062) SingleSource/Regression/C/uint64_to_float: 5.08% (0.5413 => 0.5688, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.79% (0.3463 => 0.3629, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.6436 => 12.1226, std.dev.: 0.0025) MultiSource/Applications/lua/lua: 3.92% (26.0924 => 27.1146, std.dev.: 0.2355) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.81% (3.6395 => 3.7780, std.dev.: 0.0229) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.36% (0.4162 => 0.4302, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.78% (1.7133 => 1.7610, std.dev.: 0.0124) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.72% (2.1424 => 2.2006, std.dev.: 0.0073) SingleSource/Benchmarks/Dhrystone/dry: 2.68% (2.4116 => 2.4762, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 2.12% (3.1595 => 3.2266, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 1.82% (85.0658 => 86.6138, std.dev.: 0.0244) MultiSource/Benchmarks/Olden/em3d/em3d: 1.57% (3.1023 => 3.1510, std.dev.: 0.0084) MultiSource/Benchmarks/mafft/pairlocalalign: 1.47% (27.8444 => 28.2537, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout/sieve: 1.45% (5.2139 => 5.2897, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.29% (6.5088 => 6.5929, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.27% (1.0313 => 1.0444, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.26% (12.5348 => 12.6924, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0503, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 1.06% (2.2771 => 2.3013, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1677, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.20% (5.2763 => 1.2560, std.dev.: 0.0490) SingleSource/Benchmarks/Misc/salsa20: -75.39% (0.8651 => 0.2129, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/richards_benchmark: -38.53% (0.1622 => 0.0997, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: -7.31% (10.4361 => 9.6734, std.dev.: 0.0469) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.79% (5.3526 => 4.9893, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.37% (5.3855 => 5.0427, std.dev.: 0.0133) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.20% (0.0628 => 0.0363) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.78% (0.3987 => 0.2401, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.53% (0.0506 => 0.0306, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.31% (4.5009 => 2.7767, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.15% (2.6546 => 2.0136, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -22.00% (10.7105 => 8.3543, std.dev.: 0.0502) MultiSource/Benchmarks/FreeBench/mason/mason: -19.39% (0.2161 => 0.1742, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4249, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2841, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.71% (32.5116 => 29.0305, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: -10.63% (1.5373 => 1.3739, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.05% (1.5660 => 1.4243, std.dev.: 0.0030) MultiSource/Benchmarks/NPB-serial/is/is: -8.01% (9.5636 => 8.7976, std.dev.: 0.0245) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4793, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.21% (3.2416 => 3.0402, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.60% (2.7294 => 2.5765, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: -4.75% (1.5835 => 1.5083, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.49% (1.6805 => 1.6051, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout/lists: -4.18% (6.2999 => 6.0366, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.70% (19.9488 => 19.2110, std.dev.: 0.1129) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.30% (0.9957 => 0.9628, std.dev.: 0.0070) MultiSource/Benchmarks/sim/sim: -3.01% (5.0483 => 4.8961, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.29% (0.4808 => 0.4698, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.72% (8.1563 => 8.0164, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/salsa20: -1.47% (10.2830 => 10.1319, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.42% (0.1485 => 0.1360, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0015) Report Time: 2.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 02:32:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 04:32:46 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121113103246.B266D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5816?compare_to=5812&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5816, Order: 167821, Start Time: 2012-11-13 09:07:00, End Time: 2012-11-13 10:33:04 To: 5812, Order: 167819, Start Time: 2012-11-13 07:23:10, End Time: 2012-11-13 08:49:35 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 7 (132 on baseline) Performance Improvements: 2 (28 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 982 (814 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.32% (0.8577 => 0.9119, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: 4.43% (0.2959 => 0.3090, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.59% (0.6355 => 0.6583, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.92% (1.2051 => 1.2403, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.71% (0.6035 => 0.6138, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 1.52% (0.8644 => 0.8775, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: 1.26% (0.9931 => 1.0056, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/football/football: -1.57% (0.9101 => 0.8958, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.66% (47.1032 => 44.9073, std.dev.: 0.1991) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.22% (16.8999 => 16.9366, std.dev.: 0.0631) MultiSource/Applications/obsequi/Obsequi: 0.11% (1.0681 => 1.0693, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.53% (22.1061 => 21.9892, std.dev.: 0.4492) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.49% (0.3675 => 0.3693, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.6130 => 0.6130, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.30% (0.3365 => 0.3355, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 1.69% (0.2014 => 0.2048, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -20.37% (0.0216 => 0.0172, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.86% (0.0429 => 0.0421, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -22.52% (0.0333 => 0.0258, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.64% (0.0313 => 0.0315, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.15% (0.0427 => 0.0405, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/casts: 0.50% (0.0201 => 0.0202, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -8.72% (0.0218 => 0.0199, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1479 => 0.1481, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: 0.89% (1.1353 => 1.1454, std.dev.: 0.0314) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.58% (0.1436 => 0.1399, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.20% (0.4234 => 0.4183, std.dev.: 0.1887) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.11% (0.1410 => 0.1468, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.61% (0.0613 => 0.0629, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 28.71% (0.0202 => 0.0260, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.04% (0.0589 => 0.0577, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.36% (1.1975 => 1.1932, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 40.00% (0.0010 => 0.0014, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.45% (0.0553 => 0.0561, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 28.72% (0.0188 => 0.0242, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.43% (0.7823 => 0.7789, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 14.86% (0.0074 => 0.0085, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2335.55% (0.6332 => 15.4219, std.dev.: 0.2108) MultiSource/Benchmarks/McCat/08-main/main: 49.43% (0.1831 => 0.2736, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.71% (0.1559 => 0.1470, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1526.44% (0.3344 => 5.4388, std.dev.: 0.0404) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.90% (0.2364 => 0.3260, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel: 0.47% (0.0429 => 0.0431, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0224 => 0.0224, std.dev.: 0.0010) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4545, std.dev.: 0.0130) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0708, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4907, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3156, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1279, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4083, std.dev.: 0.0013) SingleSource/Regression/C/uint64_to_float: -23.86% (2.1832 => 1.6623, std.dev.: 0.0053) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.16% (0.0810 => 0.0949, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 14.66% (0.1112 => 0.1275, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.98% (0.0830 => 0.0946, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.56% (0.0848 => 0.0963, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.59% (0.8321 => 0.9119, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.53% (0.6010 => 0.6583, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.40% (0.1425 => 0.1559, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.73% (0.3137 => 0.3411, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.21% (0.2180 => 0.2359, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.12% (0.1983 => 0.2144, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.07% (0.2279 => 0.2463, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.32% (0.7473 => 0.8020, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.88% (0.1905 => 0.2036, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.87% (1.1606 => 1.2403, std.dev.: 0.0038) MultiSource/Applications/Burg/burg: 6.65% (1.2222 => 1.3035, std.dev.: 0.0170) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.47% (0.2519 => 0.2682, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.31% (0.8148 => 0.8662, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.27% (0.4847 => 0.5151, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.61% (0.6287 => 0.6640, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.54% (0.2998 => 0.3164, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.52% (0.5817 => 0.6138, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.42% (0.5961 => 0.6284, std.dev.: 0.0060) MultiSource/Applications/hbd/hbd: 4.70% (1.4269 => 1.4940, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.68% (0.9435 => 0.9877, std.dev.: 0.0103) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.67% (0.2378 => 0.2489, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 4.66% (1.9948 => 2.0878, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.37% (0.3115 => 0.3251, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 4.32% (3.8189 => 3.9840, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.30% (0.3003 => 0.3132, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.28% (0.3295 => 0.3436, std.dev.: 0.0055) MultiSource/Applications/sgefa/sgefa: 4.27% (0.2999 => 0.3127, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.20% (1.1685 => 1.2176, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 4.12% (4.1305 => 4.3008, std.dev.: 0.0200) SingleSource/Benchmarks/Shootout-C++/sieve: 4.10% (0.2755 => 0.2868, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.68% (0.4783 => 0.4959, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.63% (1.4479 => 1.5005, std.dev.: 0.0071) MultiSource/Applications/SPASS/SPASS: 3.58% (14.2605 => 14.7710, std.dev.: 0.1375) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.56% (0.4127 => 0.4274, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 3.52% (0.2985 => 0.3090, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 3.40% (1.1271 => 1.1654, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.31% (1.3279 => 1.3718, std.dev.: 0.0068) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.29% (6.6074 => 6.8248, std.dev.: 0.0270) MultiSource/Benchmarks/McCat/05-eks/eks: 3.21% (0.4397 => 0.4538, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.18% (0.6227 => 0.6425, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 3.17% (1.2568 => 1.2966, std.dev.: 0.0048) MultiSource/Applications/ClamAV/clamscan: 3.12% (14.7684 => 15.2287, std.dev.: 0.0634) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.07% (0.3717 => 0.3831, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.05% (0.4559 => 0.4698, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.05% (0.8340 => 0.8594, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.88% (0.9069 => 0.9330, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.87% (4.1763 => 4.2961, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.87% (4.4873 => 4.6160, std.dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.85% (8.6476 => 8.8937, std.dev.: 0.0390) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.83% (0.9688 => 0.9962, std.dev.: 0.0066) MultiSource/Applications/hexxagon/hexxagon: 2.81% (0.9810 => 1.0086, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/moments: 2.80% (0.3645 => 0.3747, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.77% (0.8457 => 0.8691, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.71% (1.2526 => 1.2866, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.69% (0.8697 => 0.8931, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.64% (0.8611 => 0.8838, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.63% (1.6386 => 1.6817, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.62% (0.8927 => 0.9161, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.57% (0.8007 => 0.8213, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 2.57% (6.7320 => 6.9047, std.dev.: 0.0512) MultiSource/Benchmarks/Bullet/bullet: 2.50% (31.8598 => 32.6558, std.dev.: 0.2404) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.47% (1.1170 => 1.1446, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.46% (4.4880 => 4.5985, std.dev.: 0.0271) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.36% (4.5702 => 4.6782, std.dev.: 0.0185) MultiSource/Applications/lambda-0_1_3/lambda: 2.32% (0.7557 => 0.7732, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.29% (0.5191 => 0.5310, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.28% (0.8317 => 0.8507, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.28% (0.8286 => 0.8475, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.27% (0.8597 => 0.8792, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.27% (0.8069 => 0.8252, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.24% (0.8261 => 0.8446, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.19% (0.8805 => 0.8998, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.19% (0.8050 => 0.8226, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/football/football: 2.17% (0.8768 => 0.8958, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.16% (0.9908 => 1.0122, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.13% (0.8716 => 0.8902, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.13% (0.8086 => 0.8258, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.12% (0.8518 => 0.8699, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 2.12% (2.3764 => 2.4268, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.10% (0.8204 => 0.8376, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.10% (0.6586 => 0.6724, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.09% (0.8420 => 0.8596, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.07% (0.8338 => 0.8511, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.07% (0.8066 => 0.8233, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.06% (13.1811 => 13.4532, std.dev.: 0.0275) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.03% (0.8712 => 0.8889, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.01% (0.9039 => 0.9221, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.96% (0.8656 => 0.8826, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.94% (0.8855 => 0.9027, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.88% (0.7966 => 0.8116, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.86% (0.8316 => 0.8471, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.76% (0.8048 => 0.8190, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 1.75% (8.6247 => 8.7758, std.dev.: 0.0326) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.71% (0.8177 => 0.8317, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.58% (0.8359 => 0.8491, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: 1.44% (1.0945 => 1.1103, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 118.59% (0.0199 => 0.0435, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/pi: 56.63% (1.5795 => 2.4740, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.31% (2.9753 => 3.4607, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.31% (0.7597 => 0.8836, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.56% (2.7995 => 3.2071, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.58% (5.0261 => 5.6079, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.74% (1.1857 => 1.2775, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 7.23% (1.7056 => 1.8289, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.68% (4.7794 => 5.0986, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: 6.09% (1.3037 => 1.3831, std.dev.: 0.0078) MultiSource/Applications/SIBsim4/SIBsim4: 6.06% (3.1873 => 3.3804, std.dev.: 0.0515) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.89% (4.5327 => 4.7996, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.86% (4.9686 => 5.2600, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/treeadd/treeadd: 5.30% (0.3587 => 0.3777, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 5.02% (0.2887 => 0.3032, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.76% (6.2275 => 6.5238, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 4.75% (7.4933 => 7.8496, std.dev.: 0.0277) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.60% (3.3761 => 3.5313, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.20% (4.9453 => 5.1532, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.00% (4.9469 => 5.1446, std.dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 3.95% (14.0064 => 14.5602, std.dev.: 0.0047) MultiSource/Applications/siod/siod: 3.09% (3.6643 => 3.7776, std.dev.: 0.0053) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.84% (1.2337 => 1.2687, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.80% (11.5690 => 11.8924, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.58% (8.2783 => 8.4922, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout/lists: 2.30% (7.3375 => 7.5059, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.62% (1.1365 => 1.1549, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.40% (2.4647 => 2.4992, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: 1.30% (1.0841 => 1.0982, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 1.29% (8.5322 => 8.6420, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.24% (1.5941 => 1.6139, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.08% (3.5679 => 3.6064, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -36.98% (0.0338 => 0.0213, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/em3d/em3d: -21.27% (5.4641 => 4.3019, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.34% (7.2130 => 6.2506, std.dev.: 0.1941) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.03% (1.0512 => 0.9353, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -10.34% (1.1216 => 1.0056, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/heapsort: -8.82% (3.2926 => 3.0022, std.dev.: 0.0158) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.78% (14.6451 => 13.3590, std.dev.: 0.0877) MultiSource/Benchmarks/mafft/pairlocalalign: -8.53% (63.1822 => 57.7915, std.dev.: 0.1483) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.99% (4.7482 => 4.4161, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.49% (0.3269 => 0.3057, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.17% (3.7148 => 3.4855, std.dev.: 0.0375) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.99% (5.4972 => 5.1677, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.09% (5.1557 => 4.8934, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.40% (4.7449 => 4.5359, std.dev.: 0.0441) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.88% (6.0224 => 5.7888, std.dev.: 0.0209) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.87% (2.4490 => 2.3543, std.dev.: 0.0182) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.66% (2.8773 => 2.7720, std.dev.: 0.0230) MultiSource/Applications/lua/lua: -3.53% (29.8330 => 28.7804, std.dev.: 0.0563) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (28.5821 => 27.7026, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.00% (0.5807 => 0.5633, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.79% (9.9065 => 9.6298, std.dev.: 0.0188) SingleSource/Benchmarks/Shootout-C++/hash2: -2.51% (3.4237 => 3.3376, std.dev.: 0.0109) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.49% (1.0388 => 1.0129, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/bisort/bisort: -2.41% (0.6636 => 0.6476, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.08% (11.5316 => 11.2912, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.98% (3.2169 => 3.1533, std.dev.: 0.0076) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.63% (2.3487 => 2.3103, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.57% (4.9994 => 4.9209, std.dev.: 0.0072) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.98% (16.4461 => 16.9366, std.dev.: 0.0631) MultiSource/Applications/obsequi/Obsequi: 4.20% (1.0262 => 1.0693, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6941.05% (0.3123 => 21.9892, std.dev.: 0.4492) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.94% (0.2463 => 0.3693, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 2.00% (0.6010 => 0.6130, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.73% (0.3266 => 0.3355, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 4.01% (0.1969 => 0.2048, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 39.84% (0.0123 => 0.0172, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.19% (0.0408 => 0.0421, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.57% (0.0254 => 0.0258, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 5.47% (0.0384 => 0.0405, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 10.56% (0.0180 => 0.0199, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.99% (0.1438 => 0.1481, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: 1.10% (1.1329 => 1.1454, std.dev.: 0.0314) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.31% (0.1462 => 0.1399, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.46% (0.4164 => 0.4183, std.dev.: 0.1887) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.23% (0.1369 => 0.1468, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.87% (0.0641 => 0.0629, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 33.33% (0.0195 => 0.0260, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.17% (0.0578 => 0.0577, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.33% (1.1437 => 1.1932, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1300.00% (0.0001 => 0.0014, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.53% (0.0627 => 0.0561, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 34.44% (0.0180 => 0.0242, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.84% (0.8017 => 0.7789, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 37.10% (0.0062 => 0.0085, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 03:15:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 05:15:01 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121113111501.98BD22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5817?compare_to=5813&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5817, Order: 167826, Start Time: 2012-11-13 09:49:36, End Time: 2012-11-13 11:15:17 To: 5813, Order: 167821, Start Time: 2012-11-13 07:58:18, End Time: 2012-11-13 09:26:03 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 3 (6 on baseline) Performance Improvements: 2 (179 on baseline) Unchanged Tests: 1037 (857 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 10.38% (0.4077 => 0.4500, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.83% (54.4241 => 56.5096, std.dev.: 0.0886) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.83% (78.9110 => 80.3515, std.dev.: 0.3276) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.27% (2.0865 => 2.0601, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -1.09% (1.2582 => 1.2445, std.dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 17.37% (0.3834 => 0.4500, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.54% (54.5751 => 56.5096, std.dev.: 0.0886) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.73% (2.0478 => 2.1038, std.dev.: 0.0148) SingleSource/Benchmarks/Misc/salsa20: 2.53% (7.4937 => 7.6830, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash2: 2.09% (3.1932 => 3.2598, std.dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.46% (0.1431 => 0.1310, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.90% (0.3821 => 0.3519, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -6.96% (2.4924 => 2.3189, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -6.55% (0.3357 => 0.3137, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.48% (0.9542 => 0.8924, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.30% (0.3142 => 0.2944, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -6.17% (0.1879 => 0.1763, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -6.16% (16.1920 => 15.1940, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.07% (0.1796 => 0.1687, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -6.02% (7.0961 => 6.6692, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/oourafft: -5.97% (0.2160 => 0.2031, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.97% (0.2428 => 0.2283, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.94% (0.6484 => 0.6099, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: -5.94% (9.2283 => 8.6804, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.88% (1.0544 => 0.9924, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.84% (0.9852 => 0.9277, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.82% (0.3812 => 0.3590, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.78% (1.3722 => 1.2929, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/football/football: -5.75% (0.9179 => 0.8651, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-2: -5.74% (0.3831 => 0.3611, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -5.72% (0.3896 => 0.3673, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.72% (0.3880 => 0.3658, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.72% (0.3884 => 0.3662, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.65% (0.3891 => 0.3671, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/for-in: -5.65% (0.4033 => 0.3805, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.65% (1.2300 => 1.1605, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.64% (0.2695 => 0.2543, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -5.64% (0.3848 => 0.3631, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.63% (0.3658 => 0.3452, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.63% (4.8161 => 4.5450, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.63% (3.5339 => 3.3350, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.61% (4.8802 => 4.6064, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions: -5.56% (0.4176 => 0.3944, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.55% (0.3406 => 0.3217, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.51% (0.6736 => 0.6365, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.51% (4.0323 => 3.8103, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: -5.50% (1.1450 => 1.0820, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.50% (0.7198 => 0.6802, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.48% (0.5857 => 0.5536, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.47% (0.6395 => 0.6045, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.44% (6.7716 => 6.4032, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.44% (0.5849 => 0.5531, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.43% (4.5069 => 4.2621, std.dev.: 0.0248) MultiSource/Benchmarks/Olden/bh/bh: -5.43% (0.2985 => 0.2823, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.40% (14.2083 => 13.4408, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.40% (0.5591 => 0.5289, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.39% (0.6304 => 0.5964, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -5.38% (17.1032 => 16.1831, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.38% (0.5802 => 0.5490, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.37% (0.6052 => 0.5727, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: -5.35% (1.3148 => 1.2445, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.35% (0.5575 => 0.5277, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.34% (0.5805 => 0.5495, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.34% (0.5863 => 0.5550, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.33% (1.6364 => 1.5491, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: -5.31% (0.4199 => 0.3976, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.31% (0.5859 => 0.5548, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.31% (1.4642 => 1.3865, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.31% (0.3016 => 0.2856, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.30% (1.3864 => 1.3129, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.30% (0.3057 => 0.2895, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.29% (0.5478 => 0.5188, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.29% (0.6660 => 0.6308, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.28% (0.7524 => 0.7127, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.28% (0.5705 => 0.5404, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.26% (0.5569 => 0.5276, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -5.26% (0.3025 => 0.2866, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -5.25% (0.3255 => 0.3084, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.24% (0.6297 => 0.5967, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.23% (0.6194 => 0.5870, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.22% (0.6189 => 0.5866, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.22% (0.6230 => 0.5905, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.22% (0.5925 => 0.5616, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.21% (0.6676 => 0.6328, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.21% (0.6260 => 0.5934, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.21% (0.2939 => 0.2786, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.20% (0.4151 => 0.3935, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.20% (0.6446 => 0.6111, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -5.19% (0.2871 => 0.2722, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.18% (0.5581 => 0.5292, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.17% (0.2903 => 0.2753, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.16% (0.3931 => 0.3728, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -5.16% (1.2515 => 1.1869, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.16% (0.5567 => 0.5280, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.15% (1.2784 => 1.2126, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.12% (1.2221 => 1.1595, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.12% (2.1713 => 2.0601, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -5.12% (4.3330 => 4.1112, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.12% (0.5570 => 0.5285, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: -5.12% (0.4515 => 0.4284, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.12% (0.5688 => 0.5397, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.11% (0.2933 => 0.2783, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.08% (0.6667 => 0.6328, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: -5.08% (0.3581 => 0.3399, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.07% (8.0126 => 7.6065, std.dev.: 0.0344) SingleSource/Regression/C++/ofstream_ctor: -5.07% (0.3059 => 0.2904, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.06% (1.2210 => 1.1592, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.06% (0.5456 => 0.5180, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: -5.06% (0.3481 => 0.3305, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.06% (0.7339 => 0.6968, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.05% (0.3483 => 0.3307, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.05% (0.6395 => 0.6072, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -5.05% (0.4280 => 0.4064, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.04% (0.3194 => 0.3033, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -5.03% (3.5154 => 3.3384, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.03% (0.3837 => 0.3644, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: -5.02% (0.3205 => 0.3044, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -5.02% (0.3026 => 0.2874, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.98% (0.2548 => 0.2421, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.98% (0.3252 => 0.3090, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -4.98% (0.3394 => 0.3225, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.96% (0.6033 => 0.5734, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -4.91% (15.5079 => 14.7459, std.dev.: 0.0152) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.91% (0.3849 => 0.3660, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.91% (0.6440 => 0.6124, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.90% (0.4916 => 0.4675, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.90% (0.5941 => 0.5650, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: -4.90% (0.4248 => 0.4040, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -4.89% (0.2659 => 0.2529, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.88% (0.2989 => 0.2843, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -4.88% (0.2849 => 0.2710, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.88% (0.6293 => 0.5986, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.87% (22.4056 => 21.3136, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/lists1: -4.86% (0.3867 => 0.3679, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.84% (0.8521 => 0.8109, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: -4.83% (0.3621 => 0.3446, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -4.82% (15.2527 => 14.5181, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash2: -4.77% (0.4861 => 0.4629, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -4.76% (0.3446 => 0.3282, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.75% (0.7919 => 0.7543, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.74% (0.5168 => 0.4923, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.74% (0.4813 => 0.4585, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.71% (0.6681 => 0.6366, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -4.71% (34.0927 => 32.4862, std.dev.: 0.0120) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.70% (0.2278 => 0.2171, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.65% (1.6474 => 1.5708, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.64% (0.3319 => 0.3165, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: -4.63% (0.7447 => 0.7102, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -4.62% (0.4524 => 0.4315, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: -4.61% (1.1530 => 1.0999, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.58% (0.5999 => 0.5724, std.dev.: 0.0028) MultiSource/Applications/lua/lua: -4.58% (4.0594 => 3.8736, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.57% (0.7021 => 0.6700, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -4.55% (0.7779 => 0.7425, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.54% (0.3323 => 0.3172, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.45% (0.4427 => 0.4230, std.dev.: 0.0050) MultiSource/Applications/treecc/treecc: -4.45% (2.1401 => 2.0449, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/Hello: -4.44% (0.6347 => 0.6065, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -4.41% (0.7982 => 0.7630, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.35% (0.5329 => 0.5097) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.35% (0.9557 => 0.9141, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.34% (0.4083 => 0.3906, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.32% (0.6441 => 0.6163, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/sieve: -4.30% (0.3788 => 0.3625, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -4.30% (5.0226 => 4.8067, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/09-vor/vor: -4.28% (0.3271 => 0.3131, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.27% (0.2999 => 0.2871, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -4.25% (2.4021 => 2.3001, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -4.16% (0.6750 => 0.6469, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: -4.14% (18.2933 => 17.5352, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.07% (0.3491 => 0.3349, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -4.00% (0.8418 => 0.8081, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.77% (0.4321 => 0.4158, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.74% (2.2587 => 2.1743, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: -3.50% (1.5610 => 1.5064, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.36% (5.4682 => 5.2845, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.02% (0.9077 => 0.8803, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -2.19% (20.7746 => 20.3190, std.dev.: 0.0228) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7505, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/richards_benchmark: -8.66% (1.2842 => 1.1730, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.75% (2.2633 => 2.1785, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.94% (1.3096 => 1.2711, std.dev.: 0.0109) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4670, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 04:15:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 06:15:14 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121113121514.63D782A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5818?compare_to=5816&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5818, Order: 167826, Start Time: 2012-11-13 10:49:50, End Time: 2012-11-13 12:15:32 To: 5816, Order: 167821, Start Time: 2012-11-13 09:07:00, End Time: 2012-11-13 10:33:04 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 7 (107 on baseline) Performance Improvements: 6 (26 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 978 (841 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.28% (1.2405 => 1.4052, std.dev.: 0.0271) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.22% (0.3333 => 0.3507, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.56% (4.2965 => 4.4496, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 3.44% (1.8067 => 1.8689, std.dev.: 0.0150) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.04% (2.5393 => 2.5911, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout/hash: 2.01% (4.2704 => 4.3563, std.dev.: 0.0248) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.78% (4.8799 => 4.9666, std.dev.: 0.0136) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.69% (1.2403 => 1.1697, std.dev.: 0.0219) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -2.75% (0.6138 => 0.5969, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.27% (0.8662 => 0.8465, std.dev.: 0.0026) MultiSource/Applications/treecc/treecc: -1.90% (2.0878 => 2.0482, std.dev.: 0.0138) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/drop3/drop3: -4.09% (0.3032 => 0.2908, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ft/ft: -3.59% (0.8775 => 0.8460, std.dev.: 0.0117) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.26% (16.9366 => 16.8926, std.dev.: 0.0840) MultiSource/Applications/obsequi/Obsequi: -0.41% (1.0693 => 1.0649, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.09% (21.9892 => 22.0093, std.dev.: 0.2647) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.35% (0.3693 => 0.3680, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 0.47% (0.6130 => 0.6159, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.12% (0.3355 => 0.3351, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: -0.73% (0.2048 => 0.2033, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 16.28% (0.0172 => 0.0200, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.90% (0.0421 => 0.0429, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.16% (0.0258 => 0.0261, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -11.75% (0.0315 => 0.0278, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 4.44% (0.0405 => 0.0423, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -19.31% (0.0202 => 0.0163, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/test1: -10.05% (0.0199 => 0.0179, std.dev.: 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.81% (0.1481 => 0.1469, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 5.98% (1.1454 => 1.2139, std.dev.: 0.0162) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 2.07% (0.1399 => 0.1428, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.53% (0.4183 => 0.4205, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.41% (0.1468 => 0.1418, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.97% (0.0629 => 0.0560, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -16.54% (0.0260 => 0.0217, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.64% (0.0577 => 0.0556, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.24% (1.1932 => 1.1961, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.36% (0.0561 => 0.0559, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -23.97% (0.0242 => 0.0184, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.05% (0.7789 => 0.7785, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -14.12% (0.0085 => 0.0073, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2320.34% (0.6332 => 15.3256, std.dev.: 0.0719) MultiSource/Benchmarks/McCat/08-main/main: 46.70% (0.1831 => 0.2686, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.77% (0.1559 => 0.1469, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1527.78% (0.3344 => 5.4433, std.dev.: 0.0698) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.37% (0.2364 => 0.3271, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: 4.20% (0.0429 => 0.0447, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -2.23% (0.0224 => 0.0219, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: -27.83% (0.0230 => 0.0166, std.dev.: 0.0008) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4782, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0751, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4854, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3177, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1358, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4064, std.dev.: 0.0030) SingleSource/Regression/C/uint64_to_float: -24.13% (2.1832 => 1.6564, std.dev.: 0.0106) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.30% (0.0810 => 0.0942, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 13.76% (0.1112 => 0.1265, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.62% (0.0848 => 0.0955, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.90% (0.2180 => 0.2374, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.90% (0.7473 => 0.7989, std.dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.41% (0.3137 => 0.3338, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.33% (0.8321 => 0.8848, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.01% (0.2279 => 0.2416, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: 4.96% (1.2222 => 1.2828, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.33% (1.1685 => 1.2191, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.00% (0.4127 => 0.4292, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.93% (0.5961 => 0.6195, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.92% (0.9435 => 0.9805, std.dev.: 0.0072) MultiSource/Applications/hbd/hbd: 3.90% (1.4269 => 1.4826, std.dev.: 0.0175) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.89% (0.8148 => 0.8465, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 3.77% (14.2605 => 14.7975, std.dev.: 0.0997) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.76% (0.2741 => 0.2844, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 3.72% (0.7950 => 0.8246, std.dev.: 0.0094) MultiSource/Applications/lua/lua: 3.56% (3.8189 => 3.9548, std.dev.: 0.0318) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.50% (1.4479 => 1.4986, std.dev.: 0.0150) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.47% (6.6074 => 6.8365, std.dev.: 0.0259) MultiSource/Applications/hexxagon/hexxagon: 3.44% (0.9810 => 1.0147, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists1: 3.40% (0.2969 => 0.3070, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.28% (4.1763 => 4.3134, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.16% (2.1401 => 2.2077, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.08% (0.9069 => 0.9348, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.02% (1.6386 => 1.6881, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.01% (0.3657 => 0.3767, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.98% (0.4559 => 0.4695, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.92% (0.8331 => 0.8574, std.dev.: 0.0058) MultiSource/Benchmarks/nbench/nbench: 2.89% (1.1271 => 1.1597, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.88% (0.8340 => 0.8580, std.dev.: 0.0048) MultiSource/Applications/d/make_dparser: 2.78% (3.2366 => 3.3265, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.68% (0.9074 => 0.9317, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 2.68% (1.9948 => 2.0482, std.dev.: 0.0138) MultiSource/Applications/siod/siod: 2.66% (2.2184 => 2.2775, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.62% (0.8697 => 0.8925, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.62% (0.8518 => 0.8741, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.61% (0.8597 => 0.8821, std.dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 2.60% (14.7684 => 15.1522, std.dev.: 0.0912) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.55% (1.5315 => 1.5705, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.53% (0.7932 => 0.8133, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.48% (0.8805 => 0.9023, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.35% (1.2526 => 1.2820, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.32% (0.8007 => 0.8193, std.dev.: 0.0046) MultiSource/Applications/lemon/lemon: 2.30% (1.0945 => 1.1197, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.30% (0.9908 => 1.0136, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.29% (0.8050 => 0.8234, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.27% (13.1811 => 13.4805, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.22% (0.9056 => 0.9257, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.21% (0.7966 => 0.8142, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.21% (0.8611 => 0.8801, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.18% (0.8086 => 0.8262, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.17% (0.9039 => 0.9235, std.dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 2.15% (6.7320 => 6.8767, std.dev.: 0.0488) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.13% (0.8457 => 0.8637, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.13% (0.6586 => 0.6726, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.10% (0.8048 => 0.8217, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.07% (0.8359 => 0.8532, std.dev.: 0.0061) MultiSource/Benchmarks/Bullet/bullet: 2.07% (31.8598 => 32.5183, std.dev.: 0.2479) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.06% (0.8204 => 0.8373, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.02% (0.9688 => 0.9884, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.02% (0.8261 => 0.8428, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.02% (0.8712 => 0.8888, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 1.96% (15.3280 => 15.6282, std.dev.: 0.0994) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.91% (0.8177 => 0.8333, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 1.90% (0.8768 => 0.8935, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.86% (0.8885 => 0.9050, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.85% (0.8927 => 0.9092, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.58% (0.8338 => 0.8470, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.55% (1.2423 => 1.2615, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 98.99% (0.0199 => 0.0396, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/pi: 57.28% (1.5795 => 2.4843, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.56% (0.7597 => 0.8931, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.38% (2.9753 => 3.4628, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.72% (2.7995 => 3.2116, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6088, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.08% (0.3186 => 0.3507, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.72% (1.1857 => 1.2772, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/queens: 7.45% (1.7056 => 1.8326, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 6.73% (1.3037 => 1.3915, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.73% (4.7794 => 5.1012, std.dev.: 0.0312) MultiSource/Applications/SIBsim4/SIBsim4: 6.11% (3.1873 => 3.3822, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.10% (6.3772 => 6.7662, std.dev.: 0.1292) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.99% (4.5327 => 4.8042, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.91% (4.9686 => 5.2620, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.68% (3.3761 => 3.5342, std.dev.: 0.0171) MultiSource/Applications/lambda-0_1_3/lambda: 4.65% (7.4933 => 7.8414, std.dev.: 0.0368) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.27% (6.2275 => 6.4935, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.20% (4.9453 => 5.1532, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.07% (4.9469 => 5.1483, std.dev.: 0.0114) MultiSource/Applications/hexxagon/hexxagon: 3.89% (14.0064 => 14.5518, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.48% (0.3587 => 0.3712, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 2.96% (3.6643 => 3.7727, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.94% (11.5690 => 11.9090, std.dev.: 0.0131) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.70% (4.8362 => 4.9666, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.69% (8.2783 => 8.5009, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.44% (4.8660 => 4.9846, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: 2.42% (7.3375 => 7.5148, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.17% (4.3552 => 4.4496, std.dev.: 0.0161) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.91% (1.1365 => 1.1582, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/ReedSolomon: 1.59% (8.5322 => 8.6678, std.dev.: 0.0270) MultiSource/Benchmarks/Olden/power/power: 1.54% (1.2061 => 1.2247, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/FloatMM: 1.39% (0.8807 => 0.8929, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.37% (2.4647 => 2.4984, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.23% (3.5679 => 3.6118, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/neural/neural: 1.09% (1.0841 => 1.0959, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.08% (5.4641 => 4.3120, std.dev.: 0.0330) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -15.03% (7.2130 => 6.1290, std.dev.: 0.2126) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.70% (1.0512 => 0.9387, std.dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: -8.53% (63.1822 => 57.7910, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.47% (0.3269 => 0.2992, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.23% (14.6451 => 13.5857, std.dev.: 0.1683) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.87% (4.7482 => 4.4218, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.87% (5.4972 => 5.1747, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.58% (3.7148 => 3.5075, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.16% (5.1557 => 4.8895, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.36% (4.7449 => 4.5380, std.dev.: 0.0106) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.01% (2.8773 => 2.7618, std.dev.: 0.0340) MultiSource/Benchmarks/Ptrdist/ft/ft: -3.74% (0.8789 => 0.8460, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.44% (6.0224 => 5.8155, std.dev.: 0.0106) MultiSource/Applications/lua/lua: -3.27% (29.8330 => 28.8583, std.dev.: 0.1046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.12% (0.5807 => 0.5626, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (28.5821 => 27.7028, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.44% (2.6356 => 2.5714, std.dev.: 0.0205) SingleSource/Benchmarks/Shootout-C++/hash2: -2.27% (3.4237 => 3.3460, std.dev.: 0.0045) MultiSource/Applications/aha/aha: -2.25% (3.3398 => 3.2647, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.18% (9.9065 => 9.6904, std.dev.: 0.0608) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.04% (3.2169 => 3.1512, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.99% (2.3487 => 2.3020, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/bisort/bisort: -1.69% (0.6636 => 0.6524, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.49% (4.9994 => 4.9250, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.18% (5.6343 => 5.5679, std.dev.: 0.0202) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.71% (16.4461 => 16.8926, std.dev.: 0.0840) MultiSource/Applications/obsequi/Obsequi: 3.77% (1.0262 => 1.0649, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6947.49% (0.3123 => 22.0093, std.dev.: 0.2647) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.41% (0.2463 => 0.3680, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 2.48% (0.6010 => 0.6159, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.60% (0.3266 => 0.3351, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 3.25% (0.1969 => 0.2033, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 62.60% (0.0123 => 0.0200, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.15% (0.0408 => 0.0429, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 2.76% (0.0254 => 0.0261, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -7.95% (0.0302 => 0.0278, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -14.21% (0.0190 => 0.0163, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/test1: -0.56% (0.0180 => 0.0179, std.dev.: 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.16% (0.1438 => 0.1469, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 7.15% (1.1329 => 1.2139, std.dev.: 0.0162) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -2.33% (0.1462 => 0.1428, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.98% (0.4164 => 0.4205, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.58% (0.1369 => 0.1418, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -12.64% (0.0641 => 0.0560, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.28% (0.0195 => 0.0217, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.81% (0.0578 => 0.0556, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.58% (1.1437 => 1.1961, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.85% (0.0627 => 0.0559, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.22% (0.0180 => 0.0184, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.89% (0.8017 => 0.7785, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 17.74% (0.0062 => 0.0073, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 05:30:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 07:30:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121113133031.45FB62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5819?compare_to=5815&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5819, Order: 167826, Start Time: 2012-11-13 11:20:01, End Time: 2012-11-13 13:30:46 To: 5815, Order: 167821, Start Time: 2012-11-13 08:19:43, End Time: 2012-11-13 10:29:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 27 (158 on baseline) Performance Improvements: 9 (40 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1002 (689 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 16.33% (0.5963 => 0.6937, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.73% (0.1653 => 0.1913, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 12.72% (0.6889 => 0.7765, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 12.26% (0.4021 => 0.4514, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.09% (0.5136 => 0.5757, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/football/football: 11.91% (0.9860 => 1.1034, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.95% (0.3405 => 0.3778, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.85% (0.1917 => 0.2125, std.dev.: 0.0041) MultiSource/Applications/minisat/minisat: 10.61% (0.8178 => 0.9046, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.44% (0.3056 => 0.3375, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.19% (0.2100 => 0.2314, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.87% (0.7169 => 0.7805, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.17% (0.6672 => 0.7217, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/flops: 7.16% (0.1983 => 0.2125, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 6.46% (0.3543 => 0.3772, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 5.67% (0.7195 => 0.7603, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.45% (0.6679 => 0.7043, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/gs/gs: 2.94% (5.0424 => 5.1908, std.dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.35% (21.1733 => 21.6719, std.dev.: 0.1525) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/flops: 28.59% (6.7481 => 8.6774, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 21.93% (0.1213 => 0.1479, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.16% (14.6077 => 15.0698, std.dev.: 0.1389) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 2.59% (3.1996 => 3.2825, std.dev.: 0.0150) MultiSource/Benchmarks/Bullet/bullet: 1.79% (8.3543 => 8.5042, std.dev.: 0.0117) MultiSource/Applications/lua/lua: 1.18% (27.1146 => 27.4341, std.dev.: 0.0536) SingleSource/Benchmarks/Dhrystone/fldry: 1.03% (1.9822 => 2.0026, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.01% (2.1379 => 2.1594, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -12.78% (0.8316 => 0.7253, std.dev.: 0.0354) SingleSource/Benchmarks/Shootout-C++/hash2: -12.32% (0.5876 => 0.5152, std.dev.: 0.0261) MultiSource/Benchmarks/Prolangs-C/loader/loader: -9.41% (0.3497 => 0.3168, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/04-bisect/bisect: -7.98% (0.1316 => 0.1211, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -4.47% (1.1902 => 1.1370, std.dev.: 0.0125) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.88% (5.2289 => 5.0781, std.dev.: 0.0142) MultiSource/Applications/lua/lua: -1.33% (4.7087 => 4.6461, std.dev.: 0.0169) MultiSource/Benchmarks/PAQ8p/paq8p: -1.24% (11.4398 => 11.2978, std.dev.: 0.0202) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.23% (4.9893 => 4.9278, std.dev.: 0.0070) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -1.62% (0.1360 => 0.1338, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.10% (0.0429 => 0.0420, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.53% (0.0651 => 0.0674, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -0.02% (494.0521 => 493.9546, std.dev.: 0.1892) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: 43701.95% (1.1277 => 493.9546, std.dev.: 0.1892) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 198.64% (0.5229 => 1.5616, std.dev.: 0.0970) MultiSource/Applications/SPASS/SPASS: 21.30% (14.9895 => 18.1828, std.dev.: 0.0345) MultiSource/Applications/kimwitu++/kc: 51.14% (14.1553 => 21.3943, std.dev.: 0.0371) MultiSource/Benchmarks/MallocBench/gs/gs: 26.28% (4.1105 => 5.1908, std.dev.: 0.0099) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.06% (1.1048 => 1.5142, std.dev.: 0.0734) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 434.97% (7.1582 => 38.2939, std.dev.: 0.0803) SingleSource/Benchmarks/Misc-C++-EH/spirit: 87.67% (3.4629 => 6.4987, std.dev.: 0.0787) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.70% (0.6222 => 1.0372, std.dev.: 0.0573) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10953.61% (0.0720 => 7.9586, std.dev.: 0.0480) MultiSource/Applications/SIBsim4/SIBsim4: 3901900.00% (0.0001 => 3.9020, std.dev.: 0.0134) MultiSource/Applications/SPASS/SPASS: 15069700.00% (0.0001 => 15.0698, std.dev.: 0.1389) MultiSource/Applications/kimwitu++/kc: 52000.00% (0.0001 => 0.0521, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 64800.00% (0.0001 => 0.0649, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14500.00% (0.0001 => 0.0146, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 578000.00% (0.0001 => 0.5781, std.dev.: 0.0172) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10086800.00% (0.0001 => 10.0869, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6712100.00% (0.0001 => 6.7122, std.dev.: 0.0582) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1836.03% (1.1194 => 21.6719, std.dev.: 0.1525) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 68.18% (2.9384 => 4.9418, std.dev.: 0.1300) MultiSource/Applications/ClamAV/clamscan: 62.23% (22.1758 => 35.9763, std.dev.: 0.0918) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 58.06% (7.0540 => 11.1496, std.dev.: 0.0318) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 52.80% (8.1363 => 12.4319, std.dev.: 0.0338) SingleSource/Benchmarks/Misc/flops: 48.39% (0.1432 => 0.2125, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 45.33% (21.9371 => 31.8809, std.dev.: 0.0919) MultiSource/Benchmarks/FreeBench/distray/distray: 45.08% (0.1056 => 0.1532, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/almabench: 39.04% (0.0730 => 0.1015, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 34.15% (0.1584 => 0.2125, std.dev.: 0.0041) SingleSource/UnitTests/vla: 30.42% (0.0355 => 0.0463, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: 30.04% (0.0456 => 0.0593, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 28.98% (0.0842 => 0.1086, std.dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: 27.82% (0.0719 => 0.0919, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 27.14% (0.7115 => 0.9046, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 26.47% (0.5569 => 0.7043, std.dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_shift: 26.46% (0.0378 => 0.0478, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 26.02% (0.0953 => 0.1201, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Oscar: 25.47% (0.0636 => 0.0798, std.dev.: 0.0035) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 24.20% (0.0467 => 0.0580, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 24.18% (0.4636 => 0.5757, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.99% (0.0746 => 0.0925, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.80% (0.0479 => 0.0593, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 23.69% (0.8921 => 1.1034, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 23.67% (0.3650 => 0.4514, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 23.34% (0.0437 => 0.0539, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 23.16% (0.5860 => 0.7217, std.dev.: 0.0104) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 23.03% (0.0838 => 0.1031, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.71% (0.2065 => 0.2534, std.dev.: 0.0071) MultiSource/Applications/treecc/treecc: 22.46% (2.0273 => 2.4826, std.dev.: 0.0274) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 22.30% (0.1892 => 0.2314, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: 22.30% (0.0592 => 0.0724, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: 22.16% (3.3354 => 4.0745, std.dev.: 0.0285) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 22.08% (0.4103 => 0.5009, std.dev.: 0.0170) SingleSource/UnitTests/ObjC/messages-2: 21.90% (0.0662 => 0.0807, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 21.72% (0.1114 => 0.1356, std.dev.: 0.0061) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.52% (0.1566 => 0.1903, std.dev.: 0.0092) MultiSource/Applications/sgefa/sgefa: 21.33% (0.3109 => 0.3772, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.24% (0.1940 => 0.2352, std.dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 21.01% (0.6450 => 0.7805, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 20.96% (14.3668 => 17.3774, std.dev.: 0.1259) MultiSource/Applications/Burg/burg: 20.85% (1.1642 => 1.4069, std.dev.: 0.0283) SingleSource/Benchmarks/Shootout-C++/nestedloop: 20.84% (0.2793 => 0.3375, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: 20.78% (0.1463 => 0.1767, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.68% (0.0793 => 0.0957, std.dev.: 0.0062) MultiSource/Applications/oggenc/oggenc: 20.53% (5.7591 => 6.9417, std.dev.: 0.0309) MultiSource/Benchmarks/Olden/tsp/tsp: 20.51% (0.1175 => 0.1416, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/office/office: 20.47% (0.3136 => 0.3778, std.dev.: 0.0032) MultiSource/Applications/lua/lua: 19.98% (3.8723 => 4.6461, std.dev.: 0.0169) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 19.79% (3.8922 => 4.6624, std.dev.: 0.0196) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.73% (2.2024 => 2.6370, std.dev.: 0.1051) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.57% (0.8067 => 0.9646, std.dev.: 0.0310) MultiSource/Benchmarks/MallocBench/espresso/espresso: 19.08% (4.2646 => 5.0781, std.dev.: 0.0142) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.02% (0.1125 => 0.1339, std.dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: 18.87% (9.4845 => 11.2738, std.dev.: 0.0159) MultiSource/Benchmarks/SciMark2-C/scimark2: 18.71% (0.3121 => 0.3705, std.dev.: 0.0144) MultiSource/Benchmarks/VersaBench/bmm/bmm: 18.45% (0.0759 => 0.0899, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.03% (0.0871 => 0.1028, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.89% (1.5415 => 1.8172, std.dev.: 0.0340) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 17.72% (0.1625 => 0.1913, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.66% (0.8172 => 0.9615, std.dev.: 0.0211) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.61% (4.9449 => 5.8157, std.dev.: 0.0544) MultiSource/Applications/hbd/hbd: 17.41% (1.5603 => 1.8320, std.dev.: 0.0199) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.39% (5.0018 => 5.8717, std.dev.: 0.0577) MultiSource/Applications/sqlite3/sqlite3: 17.22% (17.1811 => 20.1397, std.dev.: 0.0610) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.86% (0.4064 => 0.4749, std.dev.: 0.0153) MultiSource/Applications/siod/siod: 16.62% (2.2969 => 2.6787, std.dev.: 0.0698) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.44% (0.9765 => 1.1370, std.dev.: 0.0125) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.19% (0.0834 => 0.0969, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 16.14% (0.0818 => 0.0950, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.05% (0.0648 => 0.0752, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 16.02% (0.2603 => 0.3020, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/ary: 15.81% (0.3232 => 0.3743, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.80% (0.0886 => 0.1026, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 15.61% (0.4299 => 0.4970, std.dev.: 0.0153) MultiSource/Applications/viterbi/viterbi: 15.50% (0.1555 => 0.1796, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 15.15% (0.5981 => 0.6887, std.dev.: 0.0193) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.10% (0.3543 => 0.4078, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.09% (0.2756 => 0.3172, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.87% (0.2758 => 0.3168, std.dev.: 0.0029) MultiSource/Applications/aha/aha: 14.86% (0.1151 => 0.1322, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 14.58% (0.8101 => 0.9282, std.dev.: 0.0255) MultiSource/Applications/lemon/lemon: 14.57% (1.0722 => 1.2284, std.dev.: 0.0464) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.36% (0.1337 => 0.1529, std.dev.: 0.0070) MultiSource/Applications/spiff/spiff: 14.33% (0.7835 => 0.8958, std.dev.: 0.0104) SingleSource/UnitTests/ObjC/synchronized: 14.15% (0.3561 => 0.4065, std.dev.: 0.0159) MultiSource/Benchmarks/Bullet/bullet: 14.05% (63.2438 => 72.1322, std.dev.: 0.2749) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.03% (0.1062 => 0.1211, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.99% (0.1029 => 0.1173, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.86% (1.4186 => 1.6152, std.dev.: 0.0469) MultiSource/Benchmarks/McCat/18-imp/imp: 13.79% (0.3423 => 0.3895, std.dev.: 0.0141) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.74% (0.2271 => 0.2583, std.dev.: 0.0063) SingleSource/Benchmarks/McGill/chomp: 13.53% (0.1655 => 0.1879, std.dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.35% (0.0929 => 0.1053, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.20% (1.3050 => 1.4773, std.dev.: 0.0099) SingleSource/UnitTests/ObjC/exceptions-3: 12.80% (0.3516 => 0.3966, std.dev.: 0.0136) SingleSource/UnitTests/ObjC/property: 12.79% (0.3886 => 0.4383, std.dev.: 0.0192) SingleSource/UnitTests/ObjC/exceptions: 12.72% (0.3828 => 0.4315, std.dev.: 0.0167) SingleSource/UnitTests/ObjC/exceptions-4: 12.67% (0.3543 => 0.3992, std.dev.: 0.0159) MultiSource/Applications/hexxagon/hexxagon: 12.41% (1.2842 => 1.4436, std.dev.: 0.0265) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.80% (0.1906 => 0.2131, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.69% (0.1044 => 0.1166, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.63% (2.0665 => 2.2861, std.dev.: 0.0670) SingleSource/UnitTests/SignlessTypes/rem: 10.31% (0.1144 => 0.1262, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 9.54% (0.2905 => 0.3182, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 9.33% (0.3098 => 0.3387, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 8.98% (10.3673 => 11.2978, std.dev.: 0.0202) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.67% (0.3427 => 0.3690, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.97% (2.2022 => 2.3556, std.dev.: 0.0436) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.88% (7.9617 => 8.4297, std.dev.: 0.0088) SingleSource/UnitTests/Vector/constpool: 3.50% (54.1659 => 56.0616, std.dev.: 0.2462) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.73% (4.3953 => 11.0202, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: 147.65% (5.3999 => 13.3729, std.dev.: 0.0018) MultiSource/Benchmarks/llubenchmark/llu: 56.73% (3.7781 => 5.9215, std.dev.: 0.1244) SingleSource/Benchmarks/Shootout-C++/moments: 27.61% (0.1159 => 0.1479, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.88% (1.5086 => 1.9141, std.dev.: 0.0638) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 24.89% (13.4384 => 16.7829, std.dev.: 0.2270) MultiSource/Applications/minisat/minisat: 23.18% (9.1159 => 11.2291, std.dev.: 0.0501) SingleSource/Benchmarks/Shootout/ary3: 22.44% (3.6994 => 4.5295, std.dev.: 0.1958) SingleSource/Benchmarks/Shootout-C++/ary3: 20.76% (3.7221 => 4.4948, std.dev.: 0.0768) SingleSource/Benchmarks/Misc/oourafft: 17.60% (6.6465 => 7.8160, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.84% (1.1145 => 1.3022, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/ary: 16.80% (0.0756 => 0.0883, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.72% (10.3460 => 11.7658, std.dev.: 0.1399) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.98% (0.2944 => 0.3326, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout/heapsort: 11.90% (3.8526 => 4.3112, std.dev.: 0.0904) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.66% (2.8904 => 3.2275, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.67% (8.6802 => 9.6066, std.dev.: 0.0913) SingleSource/Benchmarks/Misc/richards_benchmark: 10.25% (1.1396 => 1.2564, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 9.60% (3.1578 => 3.4611, std.dev.: 0.0764) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.59% (3.8532 => 4.2226, std.dev.: 0.0745) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.35% (1.7254 => 1.8867, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/ffbench: 8.30% (0.9505 => 1.0294, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout/hash: 7.00% (4.9088 => 5.2525, std.dev.: 0.0504) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.95% (0.9540 => 1.0108, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.70% (4.2280 => 4.4690, std.dev.: 0.0054) MultiSource/Applications/lua/lua: 5.14% (26.0924 => 27.4341, std.dev.: 0.0536) SingleSource/Regression/C/uint64_to_float: 5.06% (0.5413 => 0.5687, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.79% (0.3463 => 0.3629, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 4.76% (3.1334 => 3.2825, std.dev.: 0.0150) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.6436 => 12.1296, std.dev.: 0.0037) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.12% (3.6395 => 3.7532, std.dev.: 0.0343) SingleSource/Benchmarks/Dhrystone/dry: 2.60% (2.4116 => 2.4743, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.33% (2.1424 => 2.1923, std.dev.: 0.0126) SingleSource/Benchmarks/Dhrystone/fldry: 2.29% (1.9577 => 2.0026, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 2.07% (3.1595 => 3.2250, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 1.92% (85.0658 => 86.6964, std.dev.: 0.0136) MultiSource/Benchmarks/Olden/em3d/em3d: 1.69% (3.1023 => 3.1548, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout/sieve: 1.47% (5.2139 => 5.2905, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 1.46% (27.8444 => 28.2511, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/lists: 1.38% (12.5348 => 12.7074, std.dev.: 0.0211) MultiSource/Applications/sqlite3/sqlite3: 1.30% (4.6441 => 4.7045, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.25% (6.5088 => 6.5900, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0505, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.51% (6.6874 => 0.1668, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/salsa20: -75.81% (0.8651 => 0.2093, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.70% (5.2763 => 1.2821, std.dev.: 0.0343) SingleSource/Benchmarks/Misc/richards_benchmark: -38.78% (0.1622 => 0.0993, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.94% (5.3526 => 4.9278, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.15% (5.3855 => 5.0005, std.dev.: 0.0129) MultiSource/Applications/JM/ldecod/ldecod: -6.52% (10.4361 => 9.7557, std.dev.: 0.0547) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -47.50% (0.0400 => 0.0210) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.03% (0.3987 => 0.2391, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.72% (0.0506 => 0.0305, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.36% (4.5009 => 2.7743, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: -33.54% (1.1492 => 0.7638, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.18% (2.6546 => 2.0126, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -20.60% (10.7105 => 8.5042, std.dev.: 0.0117) MultiSource/Benchmarks/FreeBench/mason/mason: -19.44% (0.2161 => 0.1741, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4228, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2841, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.70% (32.5116 => 29.0343, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.53% (1.5660 => 1.4324, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -7.52% (9.5636 => 8.8445, std.dev.: 0.0278) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4789, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.51% (3.2416 => 3.0306, std.dev.: 0.0223) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.17% (0.2497 => 0.2368, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: -4.91% (1.5835 => 1.5058, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.31% (1.6805 => 1.6080, std.dev.: 0.0167) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.13% (19.9488 => 19.1240, std.dev.: 0.2794) SingleSource/Benchmarks/Shootout/lists: -4.08% (6.2999 => 6.0426, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.40% (0.9957 => 0.9618, std.dev.: 0.0046) MultiSource/Benchmarks/sim/sim: -3.02% (5.0483 => 4.8958, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.35% (0.4808 => 0.4695, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.82% (8.1563 => 8.0077, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6774, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -1.44% (10.2830 => 10.1345, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.15% (0.2116 => 0.0674, std.dev.: 0.0012) Report Time: 2.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 05:53:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 07:53:46 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121113135346.1FC142A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5820?compare_to=5814&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5820, Order: 167826, Start Time: 2012-11-13 10:38:32, End Time: 2012-11-13 13:54:02 To: 5814, Order: 167816, Start Time: 2012-11-13 06:30:52, End Time: 2012-11-13 09:50:07 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (169 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (722 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.01% (2.7841 => 2.8121, std.dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.00% (0.0625 => 0.0875, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.42% (0.1063 => 0.1397, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.34% (0.2969 => 0.3751, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.50% (0.1106 => 0.1388, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.79% (0.0714 => 0.0891, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.62% (0.4139 => 0.5158, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.50% (0.4253 => 0.5295, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 23.98% (1.5932 => 1.9752, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.86% (0.5900 => 0.7308, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.71% (0.4994 => 0.6178, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.58% (0.0475 => 0.0587, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.40% (0.0547 => 0.0675, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.34% (0.5000 => 0.6167, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.12% (0.0584 => 0.0719, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.84% (0.1620 => 0.1990, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.23% (0.1021 => 0.1248, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.19% (0.0897 => 0.1096, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.86% (0.1107 => 0.1349, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.17% (0.0633 => 0.0767, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 21.10% (0.0948 => 0.1148, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.06% (0.0584 => 0.0707, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.94% (0.1103 => 0.1334, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.72% (0.0642 => 0.0775, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.52% (0.0541 => 0.0652, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.42% (0.3903 => 0.4700, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/health/health: 20.34% (0.0821 => 0.0988, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.32% (0.0822 => 0.0989, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.21% (0.1549 => 0.1862, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.04% (0.1003 => 0.1204, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 20.03% (0.0604 => 0.0725, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 19.89% (0.1619 => 0.1941, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.89% (0.1604 => 0.1923, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.86% (0.2014 => 0.2414, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 19.22% (0.0947 => 0.1129, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.02% (0.1462 => 0.1740, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 18.86% (0.5826 => 0.6925, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 18.81% (0.0808 => 0.0960, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.79% (0.3890 => 0.4621, std.dev.: 0.0047) SingleSource/UnitTests/ObjC++/property-reference-object: 18.58% (0.5889 => 0.6983, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 18.39% (0.1218 => 0.1442, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.06% (0.2736 => 0.3230, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 17.99% (0.4029 => 0.4754, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.95% (1.3152 => 1.5513, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/mst/mst: 17.91% (0.0698 => 0.0823, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 17.84% (0.9697 => 1.1427, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 17.74% (0.1505 => 0.1772, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.74% (0.1088 => 0.1281, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.62% (0.2866 => 0.3371, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.62% (3.5627 => 4.1903, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: 17.24% (0.5546 => 0.6502, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.18% (0.2875 => 0.3369, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 17.12% (1.8794 => 2.2012, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.07% (0.1968 => 0.2304, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.98% (0.4658 => 0.5449, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.90% (1.6211 => 1.8951, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hello: 16.80% (0.2714 => 0.3170, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.72% (0.1160 => 0.1354, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.63% (0.3271 => 0.3815, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 16.55% (0.2725 => 0.3176, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.44% (0.2738 => 0.3188, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.42% (0.2729 => 0.3177, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 16.40% (0.1421 => 0.1654, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 16.31% (0.3004 => 0.3494, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.31% (2.7292 => 3.1742, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: 16.30% (0.7171 => 0.8340, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 16.26% (0.2823 => 0.3282, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 16.25% (0.2750 => 0.3197, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.24% (0.5026 => 0.5842, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/random: 16.23% (0.2803 => 0.3258, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.22% (0.2792 => 0.3245, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/matrix: 16.22% (0.2780 => 0.3231, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 16.17% (0.9909 => 1.1511, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.14% (0.4361 => 0.5065, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 16.11% (1.0781 => 1.2518, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.11% (0.2911 => 0.3380, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 16.09% (0.3096 => 0.3594, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 16.07% (0.2813 => 0.3265, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.05% (4.4195 => 5.1287, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/except: 16.04% (0.2811 => 0.3262, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.95% (0.3930 => 0.4557, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.81% (0.3195 => 0.3700, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.78% (2.0673 => 2.3935, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 15.73% (0.1284 => 0.1486, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 15.64% (0.3267 => 0.3778, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 15.57% (4.2109 => 4.8667, std.dev.: 0.0105) MultiSource/Benchmarks/Bullet/bullet: 15.36% (23.5202 => 27.1339, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/ary: 15.35% (0.3258 => 0.3758, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.31% (1.9694 => 2.2709, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.26% (1.9966 => 2.3013, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.23% (0.3060 => 0.3526, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 15.19% (0.3317 => 0.3821, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.14% (0.1090 => 0.1255, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.02% (0.3362 => 0.3867, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.97% (0.3488 => 0.4010, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.96% (0.3282 => 0.3773, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: 14.90% (0.3726 => 0.4281, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.88% (0.3124 => 0.3589, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 14.82% (0.3678 => 0.4223, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.81% (0.3465 => 0.3978, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 14.79% (0.3496 => 0.4013, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 14.74% (0.3446 => 0.3954, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 14.74% (0.3460 => 0.3970, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 14.69% (0.2566 => 0.2943, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 14.67% (0.3442 => 0.3947, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.64% (0.3469 => 0.3977, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 14.64% (0.3348 => 0.3838, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 14.55% (0.2075 => 0.2377, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists1: 14.50% (0.3477 => 0.3981, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/property: 14.33% (0.3650 => 0.4173, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.32% (0.3625 => 0.4144, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.27% (0.3981 => 0.4549, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 14.25% (0.3643 => 0.4162, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/hash: 14.23% (0.4146 => 0.4736, std.dev.: 0.0032) MultiSource/Applications/lua/lua: 14.21% (1.4269 => 1.6296, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 14.18% (0.3724 => 0.4252, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 14.09% (0.4251 => 0.4850, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.07% (0.3690 => 0.4209, std.dev.: 0.0089) MultiSource/Applications/treecc/treecc: 13.80% (0.7875 => 0.8962, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.65% (0.3845 => 0.4370, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/bigfib: 13.57% (0.5012 => 0.5692, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 13.17% (2.1653 => 2.4505, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 13.11% (2.1013 => 2.3768, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 12.97% (4.6177 => 5.2165, std.dev.: 0.0103) MultiSource/Applications/SIBsim4/SIBsim4: 12.67% (0.2691 => 0.3032, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.40% (0.2040 => 0.2293, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.36% (0.1383 => 0.1554, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.18% (0.6435 => 0.7219, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 12.08% (5.5417 => 6.2113, std.dev.: 0.0163) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.48% (0.1028 => 0.1146, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.44% (0.3498 => 0.3898, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 11.08% (0.4847 => 0.5384, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.07% (0.2737 => 0.3040, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.99% (0.3084 => 0.3423, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.88% (0.2068 => 0.2293, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 10.64% (0.6634 => 0.7340, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 10.37% (0.3336 => 0.3682, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.99% (0.2103 => 0.2313, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 9.66% (2.0346 => 2.2312, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 9.41% (0.2391 => 0.2616, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.97% (11.6398 => 12.6838, std.dev.: 0.0150) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.87% (4.6926 => 5.1087, std.dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.84% (0.5361 => 0.5835, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.12% (0.7426 => 0.8029, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.04% (0.5584 => 0.6033, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 6.97% (11.9555 => 12.7886, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.30% (0.3792 => 0.3993, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 8.74% (0.2802 => 0.3047, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6103, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6752, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.14% (0.3693 => 0.3883, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-2: 4.79% (1.8057 => 1.8922, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 4.66% (15.4430 => 16.1619, std.dev.: 0.0096) SingleSource/Benchmarks/Dhrystone/dry: 4.25% (14.0481 => 14.6446, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1981, std.dev.: 0.0440) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.68% (3.1722 => 3.2254, std.dev.: 0.0026) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3047, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2892, std.dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5152, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5390, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5896, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.81% (25.4195 => 16.5721, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/ary2: -10.66% (0.2402 => 0.2146, std.dev.: 0.0067) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9753, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7897, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8013, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0059) SingleSource/Benchmarks/Dhrystone/fldry: -3.04% (17.2379 => 16.7138, std.dev.: 0.0885) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7742, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8629, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5711, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4954, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.26% (105.3826 => 104.0536, std.dev.: 0.0883) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0448, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 06:04:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 08:04:36 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121113140436.C00AC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5821?compare_to=5818&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5821, Order: 167827, Start Time: 2012-11-13 12:38:08, End Time: 2012-11-13 14:04:54 To: 5818, Order: 167826, Start Time: 2012-11-13 10:49:50, End Time: 2012-11-13 12:15:32 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 16 (129 on baseline) Performance Improvements: 1 (25 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 974 (820 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 7.25% (0.3020 => 0.3239, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.43% (0.5075 => 0.5249, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.57% (0.6548 => 0.6716, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.20% (0.4869 => 0.4976, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.43% (0.8364 => 0.8484, std.dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: 1.37% (32.5183 => 32.9628, std.dev.: 0.0746) MultiSource/Benchmarks/mafft/pairlocalalign: 1.18% (8.7469 => 8.8501, std.dev.: 0.0185) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.20% (21.5913 => 22.4983, std.dev.: 0.1079) SingleSource/Benchmarks/Shootout/methcall: 2.55% (8.0857 => 8.2920, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.08% (1.2291 => 1.2547, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.86% (41.5914 => 42.3636, std.dev.: 0.1250) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 1.84% (2.2882 => 2.3302, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.22% (1.8689 => 1.8917, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.21% (1.5921 => 1.6114, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/pi: 1.13% (2.4843 => 2.5124, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.06% (4.4752 => 4.5226, std.dev.: 0.0167) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.02% (13.5857 => 13.1759, std.dev.: 0.0983) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.17% (16.8926 => 16.8638, std.dev.: 0.0487) MultiSource/Applications/obsequi/Obsequi: -0.21% (1.0649 => 1.0627, std.dev.: 0.0187) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.81% (22.0093 => 22.1885, std.dev.: 0.1667) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.60% (0.3680 => 0.3702, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: -0.28% (0.6159 => 0.6142, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.72% (0.3351 => 0.3375, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/strcat: 1.08% (0.2033 => 0.2055, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 4.00% (0.0200 => 0.0208, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0429 => 0.0429, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 27.97% (0.0261 => 0.0334, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.36% (0.0278 => 0.0277, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.95% (0.0423 => 0.0427, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 7.98% (0.0163 => 0.0176, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/test1: 19.55% (0.0179 => 0.0214, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1300.00% (0.0001 => 0.0014) MultiSource/Applications/ClamAV/clamscan: 0.34% (0.1469 => 0.1474, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -9.19% (1.2139 => 1.1023, std.dev.: 0.0680) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.71% (0.1428 => 0.1481, std.dev.: 0.0112) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.59% (0.4205 => 0.4138, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.20% (0.1418 => 0.1401, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 15.36% (0.0560 => 0.0646, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 23.04% (0.0217 => 0.0267, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 11.15% (0.0556 => 0.0618, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.17% (1.1961 => 1.1941, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 15.74% (0.0559 => 0.0647, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 44.57% (0.0184 => 0.0266, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.59% (0.7785 => 0.7831, std.dev.: 0.0099) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 12.33% (0.0073 => 0.0082, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2336.70% (0.6332 => 15.4292, std.dev.: 0.2243) MultiSource/Benchmarks/McCat/08-main/main: 48.55% (0.1831 => 0.2720, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.06% (0.1559 => 0.1449, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1527.63% (0.3344 => 5.4428, std.dev.: 0.0999) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.71% (0.2364 => 0.3279, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/mandel: 1.17% (0.0429 => 0.0434, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.04% (0.0224 => 0.0242, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4771, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0679, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4868, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3200, std.dev.: 0.0163) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1562, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4095, std.dev.: 0.0060) SingleSource/Regression/C/uint64_to_float: -24.13% (2.1832 => 1.6564, std.dev.: 0.0043) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.95% (0.0810 => 0.0923, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 10.88% (0.1112 => 0.1233, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.29% (0.4847 => 0.5249, std.dev.: 0.0053) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.10% (0.3137 => 0.3391, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.02% (0.2279 => 0.2439, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.88% (0.2180 => 0.2330, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.82% (0.6287 => 0.6716, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.31% (0.8321 => 0.8846, std.dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.77% (0.1905 => 0.2015, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.54% (0.7473 => 0.7887, std.dev.: 0.0105) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.36% (0.1885 => 0.1986, std.dev.: 0.0032) MultiSource/Applications/Burg/burg: 5.27% (1.2222 => 1.2866, std.dev.: 0.0131) MultiSource/Applications/sgefa/sgefa: 4.87% (0.2999 => 0.3145, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.64% (0.2998 => 0.3137, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.61% (0.8148 => 0.8524, std.dev.: 0.0087) MultiSource/Applications/lua/lua: 4.56% (3.8189 => 3.9931, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.55% (0.5961 => 0.6232, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/ary2: 4.54% (0.2509 => 0.2623, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.44% (0.9435 => 0.9854, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.24% (0.3115 => 0.3247, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.21% (0.2519 => 0.2625, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: 4.16% (0.7950 => 0.8281, std.dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.04% (0.4783 => 0.4976, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.88% (0.3657 => 0.3799, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.77% (1.4479 => 1.5025, std.dev.: 0.0148) MultiSource/Applications/SPASS/SPASS: 3.69% (14.2605 => 14.7863, std.dev.: 0.0709) MultiSource/Applications/d/make_dparser: 3.68% (3.2366 => 3.3556, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 3.58% (0.9810 => 1.0161, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.56% (1.1685 => 1.2101, std.dev.: 0.0096) MultiSource/Applications/ClamAV/clamscan: 3.55% (14.7684 => 15.2923, std.dev.: 0.0549) MultiSource/Applications/treecc/treecc: 3.53% (1.9948 => 2.0653, std.dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.51% (0.4559 => 0.4719, std.dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 3.50% (1.1271 => 1.1666, std.dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: 3.46% (31.8598 => 32.9628, std.dev.: 0.0746) MultiSource/Benchmarks/MallocBench/gs/gs: 3.36% (4.1305 => 4.2691, std.dev.: 0.0352) MultiSource/Applications/minisat/minisat: 3.26% (0.6834 => 0.7057, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.17% (0.8340 => 0.8604, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.09% (4.1763 => 4.3052, std.dev.: 0.0093) MultiSource/Applications/oggenc/oggenc: 3.04% (4.9628 => 5.1138, std.dev.: 0.0285) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.04% (1.3279 => 1.3683, std.dev.: 0.0103) MultiSource/Applications/JM/ldecod/ldecod: 3.00% (6.7320 => 6.9340, std.dev.: 0.0508) SingleSource/Benchmarks/Shootout-C++/moments: 2.99% (0.3645 => 0.3754, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.85% (0.3717 => 0.3823, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.85% (0.8697 => 0.8945, std.dev.: 0.0085) MultiSource/Applications/JM/lencod/lencod: 2.73% (15.3280 => 15.7471, std.dev.: 0.0479) MultiSource/Benchmarks/Prolangs-C/football/football: 2.67% (0.8768 => 0.9002, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.64% (1.6386 => 1.6818, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.62% (8.6476 => 8.8738, std.dev.: 0.0577) MultiSource/Benchmarks/mafft/pairlocalalign: 2.61% (8.6247 => 8.8501, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.55% (0.8204 => 0.8413, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 2.54% (2.2184 => 2.2747, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.50% (0.9069 => 0.9296, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.48% (0.8331 => 0.8538, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.43% (1.2526 => 1.2830, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.41% (0.6227 => 0.6377, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.39% (0.8286 => 0.8484, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.37% (6.6074 => 6.7643, std.dev.: 0.0393) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.36% (0.8007 => 0.8196, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.34% (0.8518 => 0.8717, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.32% (0.8050 => 0.8237, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.32% (0.7966 => 0.8151, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.30% (4.4873 => 4.5905, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 2.29% (1.2568 => 1.2856, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.24% (0.8086 => 0.8267, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.23% (0.9688 => 0.9904, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.19% (0.8359 => 0.8542, std.dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: 2.19% (2.3764 => 2.4284, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.18% (0.8457 => 0.8641, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.17% (0.9074 => 0.9271, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.12% (0.8716 => 0.8901, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.11% (4.4880 => 4.5826, std.dev.: 0.0232) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.06% (0.8597 => 0.8774, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 2.05% (1.0945 => 1.1169, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.02% (0.9056 => 0.9239, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.94% (0.8805 => 0.8976, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.88% (0.8069 => 0.8221, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.88% (0.8261 => 0.8416, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.87% (0.8712 => 0.8875, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.83% (0.8420 => 0.8574, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.83% (0.8927 => 0.9090, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.81% (0.8048 => 0.8194, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.79% (0.8066 => 0.8210, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.78% (13.1811 => 13.4156, std.dev.: 0.0289) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.71% (0.8656 => 0.8804, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.71% (0.8316 => 0.8458, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.68% (0.8338 => 0.8478, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.65% (4.5702 => 4.6454, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.51% (0.8885 => 0.9019, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.41% (1.2602 => 1.2780, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.26% (1.2423 => 1.2579, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 91.96% (0.0199 => 0.0382, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/pi: 59.06% (1.5795 => 2.5124, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.62% (0.7597 => 0.8860, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.27% (2.9753 => 3.4594, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.52% (2.7995 => 3.2060, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6091, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.04% (0.3186 => 0.3506, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.10% (1.1857 => 1.2817, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 7.05% (1.7056 => 1.8258, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.77% (4.7794 => 5.1030, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/richards_benchmark: 6.42% (1.3037 => 1.3874, std.dev.: 0.0124) MultiSource/Applications/SIBsim4/SIBsim4: 6.37% (3.1873 => 3.3902, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.91% (4.9686 => 5.2623, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.86% (4.5327 => 4.7983, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.71% (6.2275 => 6.5207, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.48% (3.3761 => 3.5274, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 4.38% (7.4933 => 7.8213, std.dev.: 0.0767) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.21% (4.9453 => 5.1536, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.97% (4.9469 => 5.1431, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 3.89% (14.0064 => 14.5513, std.dev.: 0.0165) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.63% (2.2485 => 2.3302, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.43% (0.3587 => 0.3710, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 3.18% (3.6643 => 3.7810, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 3.01% (8.4326 => 8.6865, std.dev.: 0.0692) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.83% (8.2783 => 8.5124, std.dev.: 0.0087) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.81% (1.2337 => 1.2684, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.80% (11.5690 => 11.8932, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.32% (4.8660 => 4.9790, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.27% (41.4238 => 42.3636, std.dev.: 0.1250) SingleSource/Benchmarks/Shootout/lists: 2.27% (7.3375 => 7.5038, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.26% (4.8362 => 4.9457, std.dev.: 0.0335) SingleSource/Benchmarks/Dhrystone/dry: 2.20% (0.5081 => 0.5193, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.00% (4.4340 => 4.5226, std.dev.: 0.0167) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.73% (1.1365 => 1.1562, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.56% (1.5866 => 1.6114, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.55% (2.4647 => 2.5029, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.43% (3.5679 => 3.6189, std.dev.: 0.0024) MultiSource/Applications/spiff/spiff: 1.07% (2.8561 => 2.8868, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.00% (2.7551 => 2.7827, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.35% (5.4641 => 4.2977, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.29% (7.2130 => 6.1826, std.dev.: 0.1458) SingleSource/Benchmarks/McGill/chomp: -11.61% (1.1216 => 0.9914, std.dev.: 0.0182) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.87% (1.0512 => 0.9369, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -10.03% (14.6451 => 13.1759, std.dev.: 0.0983) MultiSource/Benchmarks/mafft/pairlocalalign: -8.37% (63.1822 => 57.8930, std.dev.: 0.0285) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.89% (4.7482 => 4.4209, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.55% (0.3269 => 0.3055, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.02% (5.4972 => 5.1662, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.95% (3.7148 => 3.4939, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.17% (5.1557 => 4.8893, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.28% (4.7449 => 4.5419, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.69% (6.0224 => 5.8002, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.32% (0.5807 => 0.5614, std.dev.: 0.0018) MultiSource/Applications/lua/lua: -3.14% (29.8330 => 28.8975, std.dev.: 0.2080) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (28.5821 => 27.7019, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.73% (9.9065 => 9.6365, std.dev.: 0.0294) MultiSource/Applications/aha/aha: -2.35% (3.3398 => 3.2612, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/hash2: -2.28% (3.4237 => 3.3456, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.22% (2.6356 => 2.5770, std.dev.: 0.0050) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.14% (1.2822 => 1.2547, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.01% (11.5316 => 11.2997, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.71% (2.3487 => 2.3085, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.61% (4.9994 => 4.9187, std.dev.: 0.0258) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.26% (5.6343 => 5.5633, std.dev.: 0.0028) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.54% (16.4461 => 16.8638, std.dev.: 0.0487) MultiSource/Applications/obsequi/Obsequi: 3.56% (1.0262 => 1.0627, std.dev.: 0.0187) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7004.87% (0.3123 => 22.1885, std.dev.: 0.1667) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.30% (0.2463 => 0.3702, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 2.20% (0.6010 => 0.6142, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.34% (0.3266 => 0.3375, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/strcat: 4.37% (0.1969 => 0.2055, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 69.11% (0.0123 => 0.0208, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.15% (0.0408 => 0.0429, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.50% (0.0254 => 0.0334, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -8.28% (0.0302 => 0.0277, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.20% (0.0384 => 0.0427, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -7.37% (0.0190 => 0.0176, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/test1: 18.89% (0.0180 => 0.0214, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 100.00% (0.0007 => 0.0014) MultiSource/Applications/ClamAV/clamscan: 2.50% (0.1438 => 0.1474, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -2.70% (1.1329 => 1.1023, std.dev.: 0.0680) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.30% (0.1462 => 0.1481, std.dev.: 0.0112) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.62% (0.4164 => 0.4138, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.34% (0.1369 => 0.1401, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.78% (0.0641 => 0.0646, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 36.92% (0.0195 => 0.0267, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.92% (0.0578 => 0.0618, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.41% (1.1437 => 1.1941, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.19% (0.0627 => 0.0647, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.32% (0.8017 => 0.7831, std.dev.: 0.0099) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 32.26% (0.0062 => 0.0082, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 06:09:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 08:09:33 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121113140933.84BC92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5822?compare_to=5817&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5822, Order: 167827, Start Time: 2012-11-13 12:44:31, End Time: 2012-11-13 14:09:49 To: 5817, Order: 167826, Start Time: 2012-11-13 09:49:36, End Time: 2012-11-13 11:15:17 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (179 on baseline) Unchanged Tests: 1042 (859 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.25% (1.2783 => 1.3710, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 2.75% (7.4937 => 7.6995, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1008, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/hash2: 2.15% (3.1932 => 3.2619, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.96% (0.3821 => 0.3517, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -7.00% (2.4924 => 2.3180, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.73% (0.9542 => 0.8900, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -6.67% (0.3357 => 0.3133, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.37% (0.3142 => 0.2942, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -6.25% (16.1920 => 15.1806, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: -6.17% (0.1879 => 0.1763, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -6.16% (0.2160 => 0.2027, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.12% (0.1796 => 0.1686, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.10% (9.2283 => 8.6652, std.dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: -6.09% (7.0961 => 6.6636, std.dev.: 0.0142) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.05% (0.2428 => 0.2281, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.00% (0.6484 => 0.6095, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.97% (0.9852 => 0.9264, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -5.95% (0.3896 => 0.3664, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -5.95% (0.3880 => 0.3649, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.95% (0.3848 => 0.3619, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.91% (1.0544 => 0.9921, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -5.90% (0.3812 => 0.3587, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -5.88% (0.4033 => 0.3796, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -5.87% (0.3831 => 0.3606, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.86% (1.3722 => 1.2918, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: -5.77% (0.9179 => 0.8649, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.76% (0.3891 => 0.3667, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.74% (4.8161 => 4.5398, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: -5.74% (0.1761 => 0.1660, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.73% (4.8802 => 4.6006, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions: -5.72% (0.4176 => 0.3937, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.72% (3.5339 => 3.3317, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.70% (0.5857 => 0.5523, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.70% (1.2300 => 1.1599, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.66% (0.3884 => 0.3664, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.65% (0.7198 => 0.6791, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.64% (6.7716 => 6.3899, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.62% (0.5591 => 0.5277, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: -5.60% (0.4199 => 0.3964, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.58% (4.0323 => 3.8072, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.53% (0.2695 => 0.2546, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.53% (0.3057 => 0.2888, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.52% (0.3658 => 0.3456, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -5.52% (0.3406 => 0.3218, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.52% (0.6052 => 0.5718, std.dev.: 0.0052) MultiSource/Applications/lemon/lemon: -5.51% (1.1450 => 1.0819, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.51% (0.6230 => 0.5887, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -5.49% (0.4515 => 0.4267, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.49% (1.3148 => 1.2426, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.48% (0.5478 => 0.5178, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: -5.47% (0.2871 => 0.2714, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.46% (0.7339 => 0.6938, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.46% (0.5863 => 0.5543, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.46% (0.6304 => 0.5960, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.44% (0.3016 => 0.2852, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.43% (0.6189 => 0.5853, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.42% (0.6676 => 0.6314, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.42% (17.1032 => 16.1760, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.42% (0.5849 => 0.5532, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.42% (0.6260 => 0.5921, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.41% (1.4642 => 1.3850, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.41% (0.6194 => 0.5859, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: -5.41% (0.3255 => 0.3079, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.41% (4.5069 => 4.2633, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.40% (0.5575 => 0.5274, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.39% (0.5581 => 0.5280, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.39% (0.5805 => 0.5492, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.37% (0.5456 => 0.5163, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.37% (0.7524 => 0.7120, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.37% (0.6446 => 0.6100, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -5.36% (0.2985 => 0.2825, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.36% (0.5859 => 0.5545, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.35% (0.6667 => 0.6310, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.35% (14.2083 => 13.4477, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.35% (0.5567 => 0.5269, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.35% (0.2933 => 0.2776, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.34% (0.2548 => 0.2412, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -5.32% (4.3330 => 4.1026, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.32% (1.6364 => 1.5494, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: -5.31% (1.3864 => 1.3128, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.30% (0.2903 => 0.2749, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -5.30% (0.3205 => 0.3035, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -5.30% (0.2849 => 0.2698, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.29% (0.3025 => 0.2865, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.29% (0.6660 => 0.6308, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.27% (0.5802 => 0.5496, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.27% (0.2939 => 0.2784, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.27% (1.2784 => 1.2110, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.27% (0.6395 => 0.6058, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.27% (0.5941 => 0.5628, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.26% (0.6293 => 0.5962, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.26% (0.6297 => 0.5966, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.24% (0.5569 => 0.5277, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -5.22% (0.3581 => 0.3394, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/except: -5.22% (0.3026 => 0.2868, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.22% (1.2210 => 1.1573, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.21% (0.3931 => 0.3726, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.19% (8.0126 => 7.5967, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/08-main/main: -5.19% (0.2659 => 0.2521, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -5.19% (0.4280 => 0.4058, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.19% (0.5688 => 0.5393, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: -5.19% (0.2989 => 0.2834, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.18% (2.1713 => 2.0589, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.17% (0.6033 => 0.5721, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.17% (0.6736 => 0.6388, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -5.17% (0.3059 => 0.2901, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.16% (0.5925 => 0.5619, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.16% (0.4151 => 0.3937, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.15% (0.5570 => 0.5283, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.15% (0.4916 => 0.4663, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.14% (0.6440 => 0.6109, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.14% (0.5705 => 0.5412, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/objinst: -5.13% (0.3194 => 0.3030, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.13% (0.6681 => 0.6338, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.13% (1.2221 => 1.1594, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: -5.10% (3.5154 => 3.3361, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.10% (0.6395 => 0.6069, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.08% (0.3483 => 0.3306, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -5.05% (0.3446 => 0.3272, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.03% (22.4056 => 21.2789, std.dev.: 0.0164) MultiSource/Applications/Burg/burg: -5.00% (1.2515 => 1.1889, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.00% (0.2999 => 0.2849, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: -5.00% (0.4861 => 0.4618, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.99% (0.3849 => 0.3657, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.98% (0.3252 => 0.3090, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -4.98% (0.3394 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -4.97% (0.3621 => 0.3441, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -4.95% (0.7779 => 0.7394, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: -4.92% (15.5079 => 14.7453, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/lists1: -4.91% (0.3867 => 0.3677, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -4.90% (0.7447 => 0.7082, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.90% (0.3837 => 0.3649, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.90% (0.7919 => 0.7531, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.88% (0.5168 => 0.4916, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -4.87% (0.4248 => 0.4041, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.87% (0.8521 => 0.8106, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -4.85% (0.3481 => 0.3312, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.82% (0.2385 => 0.2270, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.81% (0.7021 => 0.6683, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -4.81% (34.0927 => 32.4517, std.dev.: 0.0177) MultiSource/Applications/ClamAV/clamscan: -4.80% (15.2527 => 14.5207, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.78% (0.4083 => 0.3888, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.76% (0.3319 => 0.3161, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.72% (0.4813 => 0.4586, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.70% (0.2278 => 0.2171, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: -4.69% (1.1530 => 1.0989, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.68% (0.5999 => 0.5718, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -4.68% (4.0594 => 3.8696, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.67% (1.6474 => 1.5705, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: -4.66% (0.6347 => 0.6051, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.65% (0.5329 => 0.5081, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: -4.62% (0.3271 => 0.3120, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: -4.61% (0.6441 => 0.6144, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.60% (0.3323 => 0.3170, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.54% (0.4427 => 0.4226, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -4.52% (0.7982 => 0.7621, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.50% (0.9557 => 0.9127, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: -4.48% (5.0226 => 4.7977, std.dev.: 0.0062) MultiSource/Applications/treecc/treecc: -4.47% (2.1401 => 2.0445, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: -4.36% (0.3788 => 0.3623, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -4.35% (2.4021 => 2.2976, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: -4.19% (18.2933 => 17.5261, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/hash: -4.16% (0.4524 => 0.4336, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/bigfib: -4.13% (0.6750 => 0.6471, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.04% (0.3491 => 0.3350, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -3.93% (0.8418 => 0.8087, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: -3.80% (1.5610 => 1.5017, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.79% (2.2587 => 2.1730, std.dev.: 0.0088) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.71% (0.9077 => 0.8740, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.70% (0.4321 => 0.4161, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.33% (5.4682 => 5.2862, std.dev.: 0.0073) SingleSource/UnitTests/Vector/constpool: -2.72% (20.7746 => 20.2086, std.dev.: 0.0211) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7566, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: -8.74% (1.2842 => 1.1720, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.91% (1.7753 => 1.7059, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: -3.88% (2.2633 => 2.1754, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.11% (1.3096 => 1.2689, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.70% (6.5735 => 6.4620, std.dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 07:48:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 09:48:27 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121113154827.615822A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5823?compare_to=5821&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5823, Order: 167830, Start Time: 2012-11-13 14:22:09, End Time: 2012-11-13 15:48:44 To: 5821, Order: 167827, Start Time: 2012-11-13 12:38:08, End Time: 2012-11-13 14:04:54 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 11 (112 on baseline) Performance Improvements: 1 (26 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 979 (836 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.47% (0.1428 => 0.1549, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.38% (1.2002 => 1.2288, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.95% (0.7887 => 0.8041, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.80% (1.2101 => 1.2319, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.69% (0.9056 => 0.9209, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.37% (1.1322 => 1.1477, std.dev.: 0.0046) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.25% (6.7643 => 6.8488, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.06% (4.3052 => 4.3510, std.dev.: 0.0143) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.35% (1.2803 => 1.4000, std.dev.: 0.0156) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 2.29% (1.4153 => 1.4477, std.dev.: 0.0122) MultiSource/Benchmarks/BitBench/five11/five11: 1.07% (5.6375 => 5.6976, std.dev.: 0.0203) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.91% (42.3636 => 41.1311, std.dev.: 0.3147) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.15% (16.8638 => 16.8895, std.dev.: 0.2648) MultiSource/Applications/obsequi/Obsequi: 1.34% (1.0627 => 1.0769, std.dev.: 0.0146) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.27% (22.1885 => 22.1279, std.dev.: 0.3830) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.11% (0.3702 => 0.3698, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/bigfib: 0.31% (0.6142 => 0.6161, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.24% (0.3375 => 0.3383, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/strcat: -0.68% (0.2055 => 0.2041, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -13.94% (0.0208 => 0.0179, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0429 => 0.0429, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -16.47% (0.0334 => 0.0279, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 13.36% (0.0277 => 0.0314, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.94% (0.0427 => 0.0423, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 15.34% (0.0176 => 0.0203, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 2.80% (0.0214 => 0.0220, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.22% (0.1474 => 0.1492, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.97% (1.1023 => 1.1130, std.dev.: 0.0264) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -6.21% (0.1481 => 0.1389, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.76% (0.4138 => 0.4335, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.50% (0.1401 => 0.1422, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.01% (0.0646 => 0.0659, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -23.60% (0.0267 => 0.0204, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.94% (0.0618 => 0.0630, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.36% (1.1941 => 1.1984, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -44.44% (0.0027 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.20% (0.0647 => 0.0581, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.45% (0.0266 => 0.0185, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.50% (0.7831 => 0.7792, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 35.37% (0.0082 => 0.0111, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2311.84% (0.6332 => 15.2718, std.dev.: 0.0959) MultiSource/Benchmarks/McCat/08-main/main: 50.96% (0.1831 => 0.2764, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.26% (0.1559 => 0.1477, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1528.53% (0.3344 => 5.4458, std.dev.: 0.0220) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.37% (0.2364 => 0.3271, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: 4.20% (0.0429 => 0.0447, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.14% (0.0224 => 0.0240, std.dev.: 0.0015) SingleSource/UnitTests/byval-alignment: -28.26% (0.0230 => 0.0165, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4641, std.dev.: 0.0101) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0725, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4952, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3160, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1344, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4028, std.dev.: 0.0038) SingleSource/Regression/C/uint64_to_float: -24.26% (2.1832 => 1.6536, std.dev.: 0.0031) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.64% (0.0810 => 0.0961, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 13.22% (0.1112 => 0.1259, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.77% (0.0830 => 0.0936, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.74% (0.0848 => 0.0956, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.67% (0.1137 => 0.1247, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.24% (0.3137 => 0.3427, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.70% (0.1425 => 0.1549, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.56% (0.4847 => 0.5262, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.51% (0.2279 => 0.2473, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/health/health: 7.65% (0.1347 => 0.1450, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.60% (0.7473 => 0.8041, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.57% (0.2180 => 0.2345, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.82% (0.6010 => 0.6420, std.dev.: 0.0109) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.77% (0.8321 => 0.8884, std.dev.: 0.0128) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.59% (0.2519 => 0.2685, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.03% (0.2240 => 0.2375, std.dev.: 0.0020) MultiSource/Applications/spiff/spiff: 5.92% (0.7950 => 0.8421, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.88% (1.1606 => 1.2288, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.82% (0.6287 => 0.6653, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.57% (0.1885 => 0.1990, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.43% (1.1685 => 1.2319, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.33% (0.8148 => 0.8582, std.dev.: 0.0094) MultiSource/Applications/Burg/burg: 5.15% (1.2222 => 1.2852, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/lists1: 4.98% (0.2969 => 0.3117, std.dev.: 0.0037) MultiSource/Applications/lua/lua: 4.90% (3.8189 => 4.0060, std.dev.: 0.0347) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.77% (0.2998 => 0.3141, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.65% (0.5961 => 0.6238, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/lists: 4.54% (0.2513 => 0.2627, std.dev.: 0.0023) MultiSource/Applications/treecc/treecc: 4.22% (1.9948 => 2.0789, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.18% (4.1763 => 4.3510, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.08% (1.4479 => 1.5070, std.dev.: 0.0058) MultiSource/Applications/hbd/hbd: 4.06% (1.4269 => 1.4848, std.dev.: 0.0086) MultiSource/Applications/siod/siod: 3.90% (2.2184 => 2.3050, std.dev.: 0.0124) MultiSource/Benchmarks/MallocBench/gs/gs: 3.90% (4.1305 => 4.2915, std.dev.: 0.0490) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.88% (0.8066 => 0.8379, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.78% (0.8340 => 0.8655, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 3.75% (14.2605 => 14.7946, std.dev.: 0.0644) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.68% (0.4783 => 0.4959, std.dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.65% (6.6074 => 6.8488, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.52% (1.6386 => 1.6963, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.50% (0.8204 => 0.8491, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 3.50% (1.1271 => 1.1665, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.49% (1.2526 => 1.2963, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.46% (0.5817 => 0.6018, std.dev.: 0.0054) MultiSource/Applications/d/make_dparser: 3.38% (3.2366 => 3.3460, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.35% (8.6476 => 8.9373, std.dev.: 0.0491) MultiSource/Applications/minisat/minisat: 3.28% (0.6834 => 0.7058, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.26% (2.1401 => 2.2098, std.dev.: 0.0073) MultiSource/Applications/SIBsim4/SIBsim4: 3.25% (1.2568 => 1.2976, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.25% (0.4559 => 0.4707, std.dev.: 0.0044) MultiSource/Applications/ClamAV/clamscan: 3.18% (14.7684 => 15.2377, std.dev.: 0.0854) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.12% (0.6227 => 0.6421, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.09% (0.3717 => 0.3832, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.06% (1.5315 => 1.5783, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 3.02% (0.9810 => 1.0106, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 3.01% (31.8598 => 32.8190, std.dev.: 0.2516) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.99% (0.8697 => 0.8957, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.95% (4.4873 => 4.6197, std.dev.: 0.0293) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.90% (0.8069 => 0.8303, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.75% (1.1170 => 1.1477, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.70% (0.5191 => 0.5331, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 2.69% (0.8768 => 0.9004, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.65% (0.8331 => 0.8552, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.57% (0.8317 => 0.8531, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.57% (13.1811 => 13.5192, std.dev.: 0.0586) MultiSource/Applications/JM/ldecod/ldecod: 2.56% (6.7320 => 6.9046, std.dev.: 0.0365) MultiSource/Applications/lambda-0_1_3/lambda: 2.55% (0.7557 => 0.7750, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.44% (4.5702 => 4.6817, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.39% (0.8050 => 0.8242, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.38% (0.8995 => 0.9209, std.dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 2.34% (15.3280 => 15.6874, std.dev.: 0.1369) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.23% (0.7966 => 0.8144, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.09% (0.8656 => 0.8837, std.dev.: 0.0065) MultiSource/Applications/oggenc/oggenc: 2.03% (4.9628 => 5.0635, std.dev.: 0.0259) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.96% (0.8927 => 0.9102, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.76% (3.1832 => 3.2392, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.59% (1.2423 => 1.2620, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 117.09% (0.0199 => 0.0432, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/pi: 57.05% (1.5795 => 2.4806, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.35% (2.9753 => 3.4617, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.14% (0.7597 => 0.8747, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.38% (2.7995 => 3.2021, std.dev.: 0.1422) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.43% (5.0261 => 5.6006, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.49% (1.1857 => 1.2745, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/queens: 7.00% (1.7056 => 1.8250, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.69% (4.7794 => 5.0992, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 6.11% (3.1873 => 3.3819, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/richards_benchmark: 6.01% (1.3037 => 1.3821, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.88% (4.5327 => 4.7994, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.71% (4.9686 => 5.2524, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.76% (6.2275 => 6.5237, std.dev.: 0.0293) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.65% (3.3761 => 3.5330, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.20% (4.9453 => 5.1529, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 4.18% (7.4933 => 7.8067, std.dev.: 0.0251) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.07% (4.9469 => 5.1482, std.dev.: 0.0179) MultiSource/Applications/hexxagon/hexxagon: 3.97% (14.0064 => 14.5622, std.dev.: 0.0741) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.54% (0.3587 => 0.3714, std.dev.: 0.0034) MultiSource/Applications/siod/siod: 3.12% (3.6643 => 3.7785, std.dev.: 0.0063) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.94% (1.2337 => 1.2700, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.65% (8.2783 => 8.4976, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.56% (11.5690 => 11.8654, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.30% (4.8660 => 4.9781, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/lists: 2.30% (7.3375 => 7.5064, std.dev.: 0.0259) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.75% (1.1365 => 1.1564, std.dev.: 0.0040) MultiSource/Benchmarks/BitBench/five11/five11: 1.69% (5.6030 => 5.6976, std.dev.: 0.0203) SingleSource/Benchmarks/Stanford/FloatMM: 1.45% (0.8807 => 0.8935, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.45% (2.4647 => 2.5005, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.24% (4.8362 => 4.8961, std.dev.: 0.0227) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.22% (3.5679 => 3.6115, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/ReedSolomon: 1.18% (8.5322 => 8.6333, std.dev.: 0.0140) MultiSource/Benchmarks/FreeBench/neural/neural: 1.15% (1.0841 => 1.0966, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 1.01% (1.2061 => 1.2183, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.20% (5.4641 => 4.3056, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.89% (7.2130 => 6.3553, std.dev.: 0.2701) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.85% (1.0512 => 0.9371, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.53% (14.6451 => 13.2491, std.dev.: 0.1882) SingleSource/Benchmarks/McGill/chomp: -9.16% (1.1216 => 1.0189, std.dev.: 0.0190) MultiSource/Benchmarks/mafft/pairlocalalign: -8.55% (63.1822 => 57.7823, std.dev.: 0.0637) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.89% (4.7482 => 4.4212, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.15% (0.3269 => 0.3068, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.10% (3.7148 => 3.4881, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.90% (5.4972 => 5.1727, std.dev.: 0.0405) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.07% (5.1557 => 4.8943, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.34% (2.8773 => 2.7523, std.dev.: 0.0373) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.31% (4.7449 => 4.5406, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.25% (2.4490 => 2.3450, std.dev.: 0.0217) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.76% (6.0224 => 5.7959, std.dev.: 0.0037) MultiSource/Applications/lua/lua: -3.44% (29.8330 => 28.8053, std.dev.: 0.2722) MultiSource/Benchmarks/Prolangs-C++/life/life: -3.27% (2.6356 => 2.5494, std.dev.: 0.0293) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (28.5821 => 27.6999, std.dev.: 0.0480) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.05% (0.5807 => 0.5630, std.dev.: 0.0009) MultiSource/Applications/aha/aha: -2.68% (3.3398 => 3.2504, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.19% (3.2169 => 3.1463, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/hash2: -2.19% (3.4237 => 3.3487, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.95% (11.5316 => 11.3067, std.dev.: 0.0169) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.94% (2.3487 => 2.3032, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.75% (4.9994 => 4.9119, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.16% (5.6343 => 5.5692, std.dev.: 0.0044) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.70% (16.4461 => 16.8895, std.dev.: 0.2648) MultiSource/Applications/obsequi/Obsequi: 4.94% (1.0262 => 1.0769, std.dev.: 0.0146) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6985.46% (0.3123 => 22.1279, std.dev.: 0.3830) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.14% (0.2463 => 0.3698, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/bigfib: 2.51% (0.6010 => 0.6161, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.58% (0.3266 => 0.3383, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/strcat: 3.66% (0.1969 => 0.2041, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 45.53% (0.0123 => 0.0179, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.15% (0.0408 => 0.0429, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 9.84% (0.0254 => 0.0279, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 22.22% (0.0180 => 0.0220, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 3.76% (0.1438 => 0.1492, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.76% (1.1329 => 1.1130, std.dev.: 0.0264) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.99% (0.1462 => 0.1389, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.11% (0.4164 => 0.4335, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.87% (0.1369 => 0.1422, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.81% (0.0641 => 0.0659, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 4.62% (0.0195 => 0.0204, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.00% (0.0578 => 0.0630, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.78% (1.1437 => 1.1984, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 7.14% (0.0014 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.34% (0.0627 => 0.0581, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.78% (0.0180 => 0.0185, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.81% (0.8017 => 0.7792, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 79.03% (0.0062 => 0.0111, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 07:58:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 09:58:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121113155820.027E52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5824?compare_to=5822&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5824, Order: 167830, Start Time: 2012-11-13 14:33:31, End Time: 2012-11-13 15:58:36 To: 5822, Order: 167827, Start Time: 2012-11-13 12:44:31, End Time: 2012-11-13 14:09:49 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (177 on baseline) Unchanged Tests: 1042 (861 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.24% (2.0478 => 2.1142, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.4937 => 7.6825, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: 2.21% (3.1932 => 3.2638, std.dev.: 0.0063) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.39% (0.1431 => 0.1311, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.14% (0.3821 => 0.3510, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.64% (0.9542 => 0.8908, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/trivial-interface: -6.51% (0.3812 => 0.3564, std.dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: -6.49% (0.3357 => 0.3139, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.46% (0.3142 => 0.2939, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.45% (0.3831 => 0.3584, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.39% (0.3848 => 0.3602, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.37% (0.3880 => 0.3633, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.37% (0.3896 => 0.3648, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -6.33% (2.4924 => 2.3346, std.dev.: 0.0158) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.30% (0.3891 => 0.3646, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.27% (0.4033 => 0.3780, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.26% (0.3884 => 0.3641, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.13% (0.4176 => 0.3920, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -5.98% (0.4199 => 0.3948, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.93% (0.2428 => 0.2284, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: -5.93% (0.2160 => 0.2032, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -5.92% (9.2283 => 8.6816, std.dev.: 0.0158) MultiSource/Applications/JM/lencod/lencod: -5.92% (16.1920 => 15.2339, std.dev.: 0.0113) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.90% (0.2355 => 0.2216, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.90% (0.1796 => 0.1690, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.85% (0.6484 => 0.6105, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.84% (0.9852 => 0.9277, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -5.80% (0.1879 => 0.1770, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -5.75% (7.0961 => 6.6879, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.74% (0.7198 => 0.6785, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.65% (1.0544 => 0.9948, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.65% (1.3722 => 1.2947, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.60% (4.0323 => 3.8064, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/football/football: -5.56% (0.9179 => 0.8669, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.53% (4.8161 => 4.5496, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.50% (3.5339 => 3.3395, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: -5.49% (0.4515 => 0.4267, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.49% (4.8802 => 4.6125, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.47% (0.3658 => 0.3458, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -5.47% (0.4280 => 0.4046, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.45% (0.2695 => 0.2548, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.40% (0.5478 => 0.5182, std.dev.: 0.0064) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.38% (6.7716 => 6.4072, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.38% (0.5857 => 0.5542, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.37% (1.2300 => 1.1639, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.35% (1.6364 => 1.5488, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.32% (1.4642 => 1.3863, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: -5.28% (0.3406 => 0.3226, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.28% (0.5591 => 0.5296, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.27% (0.3016 => 0.2857, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.25% (17.1032 => 16.2058, std.dev.: 0.0209) MultiSource/Applications/lemon/lemon: -5.23% (1.1450 => 1.0851, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.22% (0.6395 => 0.6061, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: -5.22% (1.1530 => 1.0928, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.22% (0.6189 => 0.5866, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.20% (0.6230 => 0.5906, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.20% (0.6194 => 0.5872, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -5.19% (0.3255 => 0.3086, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.19% (4.5069 => 4.2730, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.19% (0.6052 => 0.5738, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.19% (0.8521 => 0.8079, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.18% (1.2210 => 1.1577, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.18% (0.6736 => 0.6387, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.18% (0.7339 => 0.6959, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: -5.17% (1.3148 => 1.2468, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.15% (0.5863 => 0.5561, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.15% (0.5849 => 0.5548, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.14% (1.2221 => 1.1593, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.14% (0.3057 => 0.2900, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.14% (0.5569 => 0.5283, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.13% (1.2784 => 1.2128, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.12% (14.2083 => 13.4804, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.12% (0.5859 => 0.5559, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.12% (0.5802 => 0.5505, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.12% (0.7524 => 0.7139, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.10% (0.5805 => 0.5509, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.10% (0.6260 => 0.5941, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: -5.09% (0.3026 => 0.2872, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.09% (0.5581 => 0.5297, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.08% (0.5705 => 0.5415, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.08% (0.5925 => 0.5624, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.07% (0.6681 => 0.6342, std.dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: -5.07% (0.3059 => 0.2904, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.06% (0.3837 => 0.3643, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.05% (0.2933 => 0.2785, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.04% (0.6304 => 0.5986, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.04% (0.6446 => 0.6121, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.04% (0.2939 => 0.2791, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.03% (0.2903 => 0.2757, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.02% (0.5575 => 0.5295, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.02% (0.6676 => 0.6341, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: -5.02% (0.2871 => 0.2727, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.02% (0.6660 => 0.6326, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.00% (0.4916 => 0.4670, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.00% (0.5456 => 0.5183, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: -4.99% (4.3330 => 4.1167, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.98% (0.6667 => 0.6335, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -4.97% (1.3864 => 1.3175, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: -4.96% (0.3446 => 0.3275, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.96% (8.0126 => 7.6151, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.96% (0.3931 => 0.3736, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.95% (2.1713 => 2.0638, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hello: -4.95% (0.2849 => 0.2708, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.94% (0.6293 => 0.5982, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.94% (0.4151 => 0.3946, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -4.93% (0.3025 => 0.2876, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -4.92% (0.2985 => 0.2838, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.92% (0.5570 => 0.5296, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.91% (0.6440 => 0.6124, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.90% (0.5567 => 0.5294, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -4.89% (0.3394 => 0.3228, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: -4.89% (0.3581 => 0.3406, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.88% (0.2989 => 0.2843, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.87% (0.7919 => 0.7533, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: -4.87% (0.3205 => 0.3049, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -4.86% (1.2515 => 1.1907, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: -4.85% (0.3194 => 0.3039, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.85% (0.5941 => 0.5653, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -4.80% (0.3481 => 0.3314, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.79% (0.6033 => 0.5744, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.79% (0.2548 => 0.2426, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -4.78% (0.2659 => 0.2532, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.76% (0.5688 => 0.5417, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.74% (0.2278 => 0.2170, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.74% (0.6395 => 0.6092, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.74% (0.2385 => 0.2272, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.73% (0.5999 => 0.5715, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.71% (0.3483 => 0.3319, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -4.70% (15.2527 => 14.5352, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/hash2: -4.69% (0.4861 => 0.4633, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -4.67% (3.5154 => 3.3511, std.dev.: 0.0095) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.64% (0.3319 => 0.3165, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.63% (0.7447 => 0.7102, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists1: -4.63% (0.3867 => 0.3688, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.58% (0.3252 => 0.3103, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -4.56% (0.3621 => 0.3456, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -4.54% (15.5079 => 14.8031, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.49% (0.5168 => 0.4936, std.dev.: 0.0010) MultiSource/Applications/lua/lua: -4.48% (4.0594 => 3.8777, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: -4.47% (0.4248 => 0.4058, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.47% (0.7021 => 0.6707, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -4.41% (0.6347 => 0.6067, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.40% (1.6474 => 1.5749, std.dev.: 0.0075) MultiSource/Benchmarks/Bullet/bullet: -4.37% (34.0927 => 32.6036, std.dev.: 0.0281) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.36% (0.4813 => 0.4603, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: -4.35% (5.0226 => 4.8039, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.35% (0.5329 => 0.5097, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.34% (0.4083 => 0.3906, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: -4.30% (0.3788 => 0.3625, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.29% (0.4427 => 0.4237, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.28% (22.4056 => 21.4477, std.dev.: 0.0141) SingleSource/UnitTests/ObjC++/property-reference-object: -4.25% (0.6441 => 0.6167, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.24% (0.3323 => 0.3182, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.21% (0.9557 => 0.9155, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.20% (0.7779 => 0.7452, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.14% (0.9077 => 0.8701, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/09-vor/vor: -4.13% (0.3271 => 0.3136, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: -4.03% (2.1401 => 2.0539, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: -3.98% (0.8418 => 0.8083, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: -3.97% (0.2999 => 0.2880, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -3.92% (0.7982 => 0.7669, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: -3.85% (0.6750 => 0.6490, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -3.73% (2.4021 => 2.3124, std.dev.: 0.0066) MultiSource/Applications/hbd/hbd: -3.71% (1.5610 => 1.5031, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/hash: -3.69% (0.4524 => 0.4357, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.64% (0.3491 => 0.3364, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.56% (2.2587 => 2.1784, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: -3.40% (18.2933 => 17.6719, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.29% (0.4321 => 0.4179, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.89% (5.4682 => 5.3104, std.dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: -2.70% (20.7746 => 20.2137, std.dev.: 0.0288) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7511, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/richards_benchmark: -8.70% (1.2842 => 1.1725, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.91% (1.7753 => 1.7058, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.68% (2.2633 => 2.1801, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4668, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 08:31:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 10:31:46 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121113163146.AD2B62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5825?compare_to=5819&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5825, Order: 167830, Start Time: 2012-11-13 14:21:15, End Time: 2012-11-13 16:32:01 To: 5819, Order: 167826, Start Time: 2012-11-13 11:20:01, End Time: 2012-11-13 13:30:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 37 (151 on baseline) Performance Improvements: 9 (41 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 992 (695 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 14.77% (0.7861 => 0.9022, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.96% (0.6247 => 0.7119, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/hello: 11.90% (0.2957 => 0.3309, std.dev.: 0.0034) SingleSource/Regression/C++/ofstream_ctor: 11.79% (0.3182 => 0.3557, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 11.74% (0.3127 => 0.3494, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/power/power: 11.45% (0.1459 => 0.1626, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 11.27% (0.3328 => 0.3703, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/property: 10.84% (0.4383 => 0.4858, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: 10.80% (0.3730 => 0.4133, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.74% (0.4219 => 0.4672, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/mst/mst: 9.49% (0.1359 => 0.1488, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.39% (0.3355 => 0.3670, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-2: 8.80% (0.3953 => 0.4301, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/exceptions-3: 8.52% (0.3966 => 0.4304, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/lists: 8.46% (0.3807 => 0.4129, std.dev.: 0.0120) SingleSource/UnitTests/ObjC/trivial-interface: 8.44% (0.3923 => 0.4254, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.01% (1.6152 => 1.7445, std.dev.: 0.0119) SingleSource/UnitTests/ObjC/exceptions-4: 7.89% (0.3992 => 0.4307, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.88% (0.2131 => 0.2299, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.78% (1.1370 => 1.2255, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.78% (0.2583 => 0.2784, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/synchronized: 7.63% (0.4065 => 0.4375, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.84% (0.6887 => 0.7358, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/Hello: 6.46% (0.6501 => 0.6921, std.dev.: 0.0048) MultiSource/Applications/siod/siod: 6.39% (2.6787 => 2.8500, std.dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: 2.39% (11.2978 => 11.5673, std.dev.: 0.0327) MultiSource/Applications/JM/lencod/lencod: 1.76% (31.8809 => 32.4408, std.dev.: 0.0706) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.40% (5.8157 => 5.8974, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 16.40% (1.3150 => 1.5306, std.dev.: 0.0523) SingleSource/Benchmarks/Shootout-C++/ary2: 13.40% (0.0761 => 0.0863, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/mst/mst: 13.38% (0.1315 => 0.1491, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 9.26% (0.3434 => 0.3752, std.dev.: 0.0100) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.61% (0.5781 => 0.6221, std.dev.: 0.0083) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.80% (16.7829 => 17.0854, std.dev.: 0.0800) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.79% (3.7532 => 3.8202, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/hash2: 1.66% (3.4611 => 3.5184, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.33% (1.5607 => 1.5815, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -10.88% (0.4514 => 0.4023, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: -10.56% (1.1034 => 0.9869, std.dev.: 0.0311) MultiSource/Benchmarks/Prolangs-C++/office/office: -10.16% (0.3778 => 0.3394, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -9.61% (0.7043 => 0.6366, std.dev.: 0.0189) MultiSource/Benchmarks/FreeBench/neural/neural: -8.83% (0.1767 => 0.1611, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -8.38% (0.5009 => 0.4589, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/flops: -6.31% (0.2125 => 0.1991, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -3.35% (21.6719 => 20.9449, std.dev.: 0.2040) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/NPB-serial/is/is: -1.36% (8.8445 => 8.7245, std.dev.: 0.0191) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1338 => 0.1338, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0420 => 0.0420, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.26% (0.0674 => 0.0652, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -0.05% (493.9546 => 493.7168, std.dev.: 0.3646) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: 43680.86% (1.1277 => 493.7168, std.dev.: 0.3646) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 195.12% (0.5229 => 1.5432, std.dev.: 0.0482) MultiSource/Applications/SPASS/SPASS: 21.66% (14.9895 => 18.2357, std.dev.: 0.0730) MultiSource/Applications/kimwitu++/kc: 50.54% (14.1553 => 21.3090, std.dev.: 0.1458) MultiSource/Benchmarks/MallocBench/gs/gs: 25.07% (4.1105 => 5.1412, std.dev.: 0.0322) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 40.60% (1.1048 => 1.5533, std.dev.: 0.0540) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 437.75% (7.1582 => 38.4929, std.dev.: 0.0441) SingleSource/Benchmarks/Misc-C++-EH/spirit: 89.75% (3.4629 => 6.5707, std.dev.: 0.0721) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.99% (0.6222 => 1.0328, std.dev.: 0.0449) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10870.97% (0.0720 => 7.8991, std.dev.: 0.0097) MultiSource/Applications/SIBsim4/SIBsim4: 3891300.00% (0.0001 => 3.8914, std.dev.: 0.0105) MultiSource/Applications/SPASS/SPASS: 14716100.00% (0.0001 => 14.7162, std.dev.: 0.2163) MultiSource/Applications/kimwitu++/kc: 53600.00% (0.0001 => 0.0537, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 622000.00% (0.0001 => 0.6221, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10084300.00% (0.0001 => 10.0844, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6619000.00% (0.0001 => 6.6191, std.dev.: 0.1345) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1771.08% (1.1194 => 20.9449, std.dev.: 0.2040) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 67.93% (2.9384 => 4.9344, std.dev.: 0.1331) MultiSource/Applications/ClamAV/clamscan: 61.89% (22.1758 => 35.8994, std.dev.: 0.0519) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 59.14% (7.0540 => 11.2256, std.dev.: 0.0516) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 52.33% (8.1363 => 12.3941, std.dev.: 0.0398) MultiSource/Applications/JM/lencod/lencod: 47.88% (21.9371 => 32.4408, std.dev.: 0.0706) MultiSource/Benchmarks/FreeBench/distray/distray: 45.45% (0.1056 => 0.1536, std.dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/almabench: 39.45% (0.0730 => 0.1018, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 39.04% (0.1432 => 0.1991, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: 36.81% (0.2554 => 0.3494, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/dot-syntax-1: 36.33% (0.0479 => 0.0653) SingleSource/UnitTests/vla: 30.14% (0.0355 => 0.0462, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/five11/five11: 28.75% (0.0567 => 0.0730, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/mst/mst: 27.94% (0.1163 => 0.1488, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 25.50% (0.9765 => 1.2255, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.07% (0.0746 => 0.0933, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/property: 25.01% (0.3886 => 0.4858, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 24.08% (2.2969 => 2.8500, std.dev.: 0.0039) MultiSource/Benchmarks/BitBench/drop3/drop3: 24.07% (0.0482 => 0.0598, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Oscar: 23.90% (0.0636 => 0.0788, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 23.03% (0.0838 => 0.1031, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 23.02% (0.5981 => 0.7358, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-2: 22.99% (0.3497 => 0.4301, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 22.97% (1.4186 => 1.7445, std.dev.: 0.0119) SingleSource/UnitTests/ObjC/synchronized: 22.86% (0.3561 => 0.4375, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/whetstone: 22.73% (0.0660 => 0.0810, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 22.60% (0.0447 => 0.0548, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.59% (0.2271 => 0.2784, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/trivial-interface: 22.49% (0.3473 => 0.4254, std.dev.: 0.0073) SingleSource/Regression/C++/ofstream_ctor: 22.44% (0.2905 => 0.3557, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-3: 22.41% (0.3516 => 0.4304, std.dev.: 0.0066) MultiSource/Benchmarks/sim/sim: 22.03% (0.3387 => 0.4133, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hello: 21.92% (0.2714 => 0.3309, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.90% (2.2024 => 2.6848, std.dev.: 0.0366) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.89% (14.3668 => 17.5116, std.dev.: 0.0381) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.65% (0.1566 => 0.1905, std.dev.: 0.0101) SingleSource/UnitTests/ObjC/exceptions-4: 21.56% (0.3543 => 0.4307, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 21.56% (5.7591 => 7.0007, std.dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 21.52% (1.5859 => 1.9272, std.dev.: 0.0751) MultiSource/Applications/lua/lua: 21.45% (3.8723 => 4.7031, std.dev.: 0.0769) MultiSource/Applications/minisat/minisat: 20.83% (0.7115 => 0.8597, std.dev.: 0.0252) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.71% (0.1584 => 0.1912, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/lists: 20.66% (0.3422 => 0.4129, std.dev.: 0.0120) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 20.62% (0.1906 => 0.2299, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/tsp/tsp: 20.60% (0.1175 => 0.1417, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.45% (0.2758 => 0.3322, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/functionobjects: 20.18% (0.5020 => 0.6033, std.dev.: 0.0176) MultiSource/Benchmarks/MallocBench/espresso/espresso: 20.11% (4.2646 => 5.1224, std.dev.: 0.0371) MultiSource/Benchmarks/Olden/bh/bh: 19.76% (0.3092 => 0.3703, std.dev.: 0.0064) MultiSource/Applications/treecc/treecc: 19.75% (2.0273 => 2.4276, std.dev.: 0.0690) MultiSource/Applications/aha/aha: 19.46% (0.1151 => 0.1375, std.dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.29% (0.1125 => 0.1342, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.26% (4.9449 => 5.8974, std.dev.: 0.0029) MultiSource/Applications/d/make_dparser: 19.02% (3.3354 => 3.9699, std.dev.: 0.0979) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 19.00% (3.8922 => 4.6319, std.dev.: 0.0490) MultiSource/Benchmarks/mafft/pairlocalalign: 18.74% (9.4845 => 11.2619, std.dev.: 0.0431) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 18.73% (0.3935 => 0.4672, std.dev.: 0.0094) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.72% (0.4615 => 0.5479, std.dev.: 0.0181) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.56% (0.8172 => 0.9689, std.dev.: 0.0174) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.17% (0.0842 => 0.0995, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary2: 17.82% (0.3379 => 0.3981, std.dev.: 0.0125) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 17.73% (0.8101 => 0.9537, std.dev.: 0.0233) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.39% (2.0665 => 2.4258, std.dev.: 0.0689) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.28% (5.0018 => 5.8662, std.dev.: 0.0705) MultiSource/Benchmarks/nbench/nbench: 17.27% (1.1840 => 1.3885, std.dev.: 0.0517) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.11% (0.0871 => 0.1020, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/messages-2: 16.92% (0.0662 => 0.0774, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 16.88% (1.1642 => 1.3607, std.dev.: 0.0705) SingleSource/UnitTests/ObjC++/Hello: 16.81% (0.5925 => 0.6921, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.67% (0.0834 => 0.0973, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 16.57% (17.1811 => 20.0272, std.dev.: 0.1030) MultiSource/Benchmarks/Olden/em3d/em3d: 16.40% (0.1695 => 0.1973, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.37% (0.2065 => 0.2403, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.23% (0.0770 => 0.0895, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.20% (0.0648 => 0.0753, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.16% (0.0953 => 0.1107, std.dev.: 0.0056) MultiSource/Applications/viterbi/viterbi: 16.08% (0.1555 => 0.1805, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/health/health: 15.93% (0.1268 => 0.1470, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.67% (0.1117 => 0.1292, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 15.52% (0.3177 => 0.3670, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.33% (1.3050 => 1.5050, std.dev.: 0.0256) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.23% (1.1861 => 1.3667, std.dev.: 0.0515) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.19% (0.0770 => 0.0887, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 14.98% (63.2438 => 72.7199, std.dev.: 0.0496) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.67% (0.3121 => 0.3579, std.dev.: 0.0175) MultiSource/Benchmarks/NPB-serial/is/is: 14.60% (0.0719 => 0.0824, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.51% (0.1337 => 0.1531, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.41% (0.1062 => 0.1215, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.31% (0.5569 => 0.6366, std.dev.: 0.0189) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.72% (0.3441 => 0.3913, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions: 13.71% (0.3828 => 0.4353, std.dev.: 0.0108) MultiSource/Applications/hbd/hbd: 13.63% (1.5603 => 1.7730, std.dev.: 0.0706) SingleSource/UnitTests/ObjC/parameter-passing: 13.45% (0.3927 => 0.4455, std.dev.: 0.0129) MultiSource/Benchmarks/Olden/power/power: 12.92% (0.1440 => 0.1626, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.73% (0.3543 => 0.3994, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.70% (0.3694 => 0.4163, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.07% (0.1143 => 0.1281, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.84% (0.4103 => 0.4589, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.79% (0.8067 => 0.9018, std.dev.: 0.0285) MultiSource/Benchmarks/McCat/05-eks/eks: 11.61% (0.4299 => 0.4798, std.dev.: 0.0157) MultiSource/Benchmarks/PAQ8p/paq8p: 11.57% (10.3673 => 11.5673, std.dev.: 0.0327) MultiSource/Benchmarks/Prolangs-C/football/football: 10.63% (0.8921 => 0.9869, std.dev.: 0.0311) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.22% (0.3650 => 0.4023, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 10.03% (0.6030 => 0.6635, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.77% (0.3817 => 0.4190, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/oourafft: 9.54% (0.3282 => 0.3595, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference: 9.36% (0.7326 => 0.8012, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.23% (0.3136 => 0.3394, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.96% (7.9617 => 8.3569, std.dev.: 0.0477) SingleSource/UnitTests/Vector/constpool: 3.58% (54.1659 => 56.1050, std.dev.: 0.2365) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.82% (4.3953 => 11.0243, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 147.63% (5.3999 => 13.3720, std.dev.: 0.0021) MultiSource/Benchmarks/llubenchmark/llu: 46.34% (3.7781 => 5.5287, std.dev.: 0.4226) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 27.14% (13.4384 => 17.0854, std.dev.: 0.0800) MultiSource/Applications/minisat/minisat: 21.19% (9.1159 => 11.0478, std.dev.: 0.1872) SingleSource/Benchmarks/Misc/oourafft: 17.57% (6.6465 => 7.8143, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 17.56% (3.7221 => 4.3757, std.dev.: 0.2174) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 17.33% (1.3045 => 1.5306, std.dev.: 0.0523) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.73% (1.1145 => 1.3010, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/mst/mst: 16.03% (0.1285 => 0.1491, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/lpbench: 15.90% (10.3460 => 11.9910, std.dev.: 0.1906) SingleSource/Benchmarks/Shootout-C++/ary2: 14.00% (0.0757 => 0.0863, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.98% (0.2944 => 0.3326, std.dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.65% (2.8904 => 3.2270, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 11.42% (3.1578 => 3.5184, std.dev.: 0.0136) SingleSource/Benchmarks/Misc/richards_benchmark: 10.24% (1.1396 => 1.2563, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.94% (8.6802 => 9.5434, std.dev.: 0.0189) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.37% (1.7254 => 1.8870, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.49% (2.0360 => 2.2088, std.dev.: 0.0612) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.95% (0.9540 => 1.0108, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.68% (4.2280 => 4.4683, std.dev.: 0.0062) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.96% (3.6395 => 3.8202, std.dev.: 0.0175) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 4.93% (3.1334 => 3.2880, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.6436 => 12.1289, std.dev.: 0.0032) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.31% (2.1424 => 2.2134, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/dry: 2.62% (2.4116 => 2.4747, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: 2.16% (1.9577 => 1.9999, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 2.07% (3.1595 => 3.2250, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 2.06% (3.1023 => 3.1663, std.dev.: 0.0192) MultiSource/Benchmarks/PAQ8p/paq8p: 1.86% (85.0658 => 86.6447, std.dev.: 0.0204) MultiSource/Benchmarks/mafft/pairlocalalign: 1.50% (27.8444 => 28.2630, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.50% (6.5088 => 6.6066, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/sieve: 1.49% (5.2139 => 5.2917, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 1.26% (12.5348 => 12.6932, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0500, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1676, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.53% (5.2763 => 1.2382, std.dev.: 0.0501) SingleSource/Benchmarks/Misc/salsa20: -75.84% (0.8651 => 0.2090, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/richards_benchmark: -37.36% (0.1622 => 0.1016, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -11.95% (0.1330 => 0.1171, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.25% (5.3526 => 4.9644, std.dev.: 0.0164) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.42% (5.3855 => 5.0400, std.dev.: 0.0124) MultiSource/Applications/JM/ldecod/ldecod: -6.32% (10.4361 => 9.7764, std.dev.: 0.0223) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -47.50% (0.0400 => 0.0210, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.73% (0.3987 => 0.2403, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.72% (0.0506 => 0.0305, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.30% (4.5009 => 2.7772, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7636, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.19% (2.6546 => 2.0124, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: -21.62% (10.7105 => 8.3947, std.dev.: 0.0566) MultiSource/Benchmarks/FreeBench/mason/mason: -19.20% (0.2161 => 0.1746, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4227, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2841, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.71% (32.5116 => 29.0297, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel-2: -10.65% (1.5373 => 1.3736, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.05% (1.5660 => 1.4243, std.dev.: 0.0028) MultiSource/Benchmarks/NPB-serial/is/is: -8.77% (9.5636 => 8.7245, std.dev.: 0.0191) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.95% (4.8142 => 4.4796, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.55% (3.2416 => 3.0292, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.58% (2.7294 => 2.5770, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.80% (19.9488 => 18.9921, std.dev.: 0.1829) SingleSource/Benchmarks/Misc/flops-5: -4.60% (1.5835 => 1.5106, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.46% (1.6805 => 1.6056, std.dev.: 0.0224) SingleSource/Benchmarks/Shootout/lists: -4.21% (6.2999 => 6.0348, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.35% (0.9957 => 0.9623, std.dev.: 0.0071) MultiSource/Benchmarks/sim/sim: -3.04% (5.0483 => 4.8947, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.27% (0.4808 => 0.4699, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6774, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (8.1563 => 8.0204, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -1.49% (10.2830 => 10.1298, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0014) Report Time: 2.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 09:31:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 11:31:21 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121113173121.D5CAC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5826?compare_to=5823&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5826, Order: 167846, Start Time: 2012-11-13 16:05:34, End Time: 2012-11-13 17:31:38 To: 5823, Order: 167830, Start Time: 2012-11-13 14:22:09, End Time: 2012-11-13 15:48:44 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 12 (120 on baseline) Performance Improvements: 1 (28 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 978 (826 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.40% (1.0143 => 1.0386, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.92% (0.8506 => 0.8669, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 1.45% (4.2915 => 4.3536, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.38% (0.8531 => 0.8649, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.74% (1.5012 => 1.8876, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.13% (0.3188 => 0.3479, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.67% (2.2507 => 2.4009, std.dev.: 0.0232) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.01% (2.5873 => 2.6651, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.58% (13.2491 => 13.5910, std.dev.: 0.0413) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.60% (44.2543 => 44.9640, std.dev.: 0.2392) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.28% (4.8961 => 4.9590, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/pi: 1.02% (2.4806 => 2.5060, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.94% (1.4477 => 1.4196, std.dev.: 0.0056) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.15% (16.8895 => 16.9144, std.dev.: 0.0833) MultiSource/Applications/obsequi/Obsequi: -1.98% (1.0769 => 1.0556, std.dev.: 0.0173) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.09% (22.1279 => 22.1469, std.dev.: 0.1246) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.03% (0.3698 => 0.3697, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/bigfib: -0.47% (0.6161 => 0.6132, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.53% (0.3383 => 0.3365, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/strcat: -0.78% (0.2041 => 0.2025, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 13.41% (0.0179 => 0.0203, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0429 => 0.0429, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 20.43% (0.0279 => 0.0336, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0314 => 0.0314, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -6.15% (0.0423 => 0.0397, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/casts: -17.24% (0.0203 => 0.0168, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/test1: -0.45% (0.0220 => 0.0219, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.67% (0.1492 => 0.1482, std.dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 4.70% (1.1130 => 1.1653, std.dev.: 0.0115) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.79% (0.1389 => 0.1400, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.25% (0.4335 => 0.4194, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.95% (0.1422 => 0.1464, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.50% (0.0659 => 0.0603, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.43% (0.0204 => 0.0211, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.16% (0.0630 => 0.0629, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.23% (1.1984 => 1.1956, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -93.33% (0.0015 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.38% (0.0581 => 0.0573, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.05% (0.0185 => 0.0211, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.41% (0.7792 => 0.7824, std.dev.: 0.0218) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -63.96% (0.0111 => 0.0040, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2324.81% (0.6332 => 15.3539, std.dev.: 0.0577) MultiSource/Benchmarks/McCat/08-main/main: 48.66% (0.1831 => 0.2722, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.58% (0.1559 => 0.1472, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1529.84% (0.3344 => 5.4502, std.dev.: 0.0466) SingleSource/Benchmarks/Misc-C++/Large/ray: 39.00% (0.2364 => 0.3286, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: -0.47% (0.0429 => 0.0427, std.dev.: 0.0008) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -3.57% (0.0224 => 0.0216, std.dev.: 0.0013) SingleSource/UnitTests/byval-alignment: -32.17% (0.0230 => 0.0156, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4693, std.dev.: 0.0199) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0727, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4902, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3160, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1328, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3992, std.dev.: 0.0065) SingleSource/Regression/C/uint64_to_float: -24.00% (2.1832 => 1.6592, std.dev.: 0.0108) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0008) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.88% (0.0773 => 0.0888, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.95% (0.0810 => 0.0923, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.80% (0.0848 => 0.0965, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 12.95% (0.1112 => 0.1256, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.17% (0.0830 => 0.0931, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.78% (0.2279 => 0.2479, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.76% (0.2180 => 0.2371, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.99% (0.7473 => 0.8070, std.dev.: 0.0073) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.78% (0.3137 => 0.3381, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: 7.71% (0.1440 => 0.1551, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.56% (0.1905 => 0.2049, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.51% (0.4847 => 0.5211, std.dev.: 0.0104) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.40% (0.8148 => 0.8751, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.11% (0.2519 => 0.2698, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.35% (0.1983 => 0.2109, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.05% (0.1885 => 0.1999, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.74% (0.2998 => 0.3170, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.46% (0.6010 => 0.6338, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.40% (0.3295 => 0.3473, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/gs/gs: 5.40% (4.1305 => 4.3536, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.26% (0.9435 => 0.9931, std.dev.: 0.0141) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.17% (1.1606 => 1.2206, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.13% (0.5961 => 0.6267, std.dev.: 0.0111) MultiSource/Applications/Burg/burg: 4.93% (1.2222 => 1.2824, std.dev.: 0.0143) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.87% (0.2240 => 0.2349, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.82% (0.9908 => 1.0386, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.68% (0.6287 => 0.6581, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.62% (0.5817 => 0.6086, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.34% (0.6227 => 0.6497, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.22% (0.8066 => 0.8406, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.16% (1.3279 => 1.3832, std.dev.: 0.0093) MultiSource/Applications/lua/lua: 4.01% (3.8189 => 3.9721, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.99% (0.8317 => 0.8649, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.97% (0.8338 => 0.8669, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.91% (4.1763 => 4.3397, std.dev.: 0.0561) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.89% (6.6074 => 6.8647, std.dev.: 0.0726) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.87% (0.8457 => 0.8784, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/sieve: 3.77% (0.2755 => 0.2859, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 3.71% (14.2605 => 14.7896, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.65% (0.8518 => 0.8829, std.dev.: 0.0061) MultiSource/Applications/SIBsim4/SIBsim4: 3.61% (1.2568 => 1.3022, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.61% (1.4479 => 1.5001, std.dev.: 0.0094) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.61% (0.3717 => 0.3851, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.59% (8.6476 => 8.9581, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.51% (0.8340 => 0.8633, std.dev.: 0.0057) MultiSource/Applications/treecc/treecc: 3.46% (1.9948 => 2.0638, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.42% (2.1401 => 2.2133, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.37% (0.3115 => 0.3220, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 3.34% (0.8885 => 0.9182, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.33% (0.8697 => 0.8987, std.dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.21% (1.1170 => 1.1529, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.21% (0.8712 => 0.8992, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.20% (4.4873 => 4.6311, std.dev.: 0.0534) MultiSource/Applications/minisat/minisat: 3.19% (0.6834 => 0.7052, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.19% (4.4880 => 4.6310, std.dev.: 0.0270) MultiSource/Applications/ClamAV/clamscan: 3.16% (14.7684 => 15.2350, std.dev.: 0.0712) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.07% (0.8359 => 0.8616, std.dev.: 0.0065) MultiSource/Applications/JM/lencod/lencod: 3.06% (15.3280 => 15.7970, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.05% (0.8007 => 0.8251, std.dev.: 0.0060) MultiSource/Applications/siod/siod: 2.98% (2.2184 => 2.2844, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.94% (0.9039 => 0.9305, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.94% (0.9074 => 0.9341, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.91% (0.4127 => 0.4247, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.90% (0.3657 => 0.3763, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.89% (0.9688 => 0.9968, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.82% (0.8086 => 0.8314, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.80% (0.9056 => 0.9310, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.80% (0.8597 => 0.8838, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.79% (1.5315 => 1.5743, std.dev.: 0.0047) MultiSource/Benchmarks/PAQ8p/paq8p: 2.78% (2.3764 => 2.4425, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.73% (0.8050 => 0.8270, std.dev.: 0.0060) MultiSource/Benchmarks/Bullet/bullet: 2.66% (31.8598 => 32.7063, std.dev.: 0.1333) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.65% (0.8048 => 0.8261, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.64% (0.5191 => 0.5328, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.62% (0.9069 => 0.9307, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.61% (0.6586 => 0.6758, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 2.59% (6.7320 => 6.9063, std.dev.: 0.0357) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.56% (0.8316 => 0.8529, std.dev.: 0.0060) MultiSource/Applications/d/make_dparser: 2.48% (3.2366 => 3.3168, std.dev.: 0.0191) MultiSource/Applications/lemon/lemon: 2.47% (1.0945 => 1.1215, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.42% (0.8855 => 0.9069, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.37% (3.1832 => 3.2588, std.dev.: 0.0102) MultiSource/Benchmarks/mafft/pairlocalalign: 2.20% (8.6247 => 8.8148, std.dev.: 0.0301) MultiSource/Applications/oggenc/oggenc: 2.18% (4.9628 => 5.0710, std.dev.: 0.0291) MultiSource/Applications/lambda-0_1_3/lambda: 2.12% (0.7557 => 0.7717, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.86% (1.2602 => 1.2837, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 102.51% (0.0199 => 0.0403, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/pi: 58.66% (1.5795 => 2.5060, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.34% (2.9753 => 3.4616, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.06% (0.7597 => 0.8817, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.72% (2.7995 => 3.2117, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.62% (5.0261 => 5.6100, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.20% (0.3186 => 0.3479, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.01% (1.1857 => 1.2807, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 6.98% (1.7056 => 1.8247, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/richards_benchmark: 6.81% (1.3037 => 1.3925, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.78% (2.2485 => 2.4009, std.dev.: 0.0232) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.62% (4.7794 => 5.0959, std.dev.: 0.0448) MultiSource/Applications/SIBsim4/SIBsim4: 5.99% (3.1873 => 3.3781, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.91% (4.5327 => 4.8008, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.88% (4.9686 => 5.2608, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.82% (3.3761 => 3.5388, std.dev.: 0.0084) MultiSource/Applications/lambda-0_1_3/lambda: 4.33% (7.4933 => 7.8175, std.dev.: 0.0574) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.13% (4.9469 => 5.1510, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.03% (6.2275 => 6.4785, std.dev.: 0.0440) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.99% (4.9453 => 5.1426, std.dev.: 0.0195) MultiSource/Applications/hexxagon/hexxagon: 3.87% (14.0064 => 14.5482, std.dev.: 0.0728) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.45% (2.5763 => 2.6651, std.dev.: 0.0054) MultiSource/Applications/siod/siod: 2.97% (3.6643 => 3.7732, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.88% (1.2337 => 1.2692, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.75% (11.5690 => 11.8869, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.54% (4.8362 => 4.9590, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.51% (8.2783 => 8.4859, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout/lists: 2.35% (7.3375 => 7.5098, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.32% (1.1365 => 1.1629, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.30% (4.8660 => 4.9779, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/power/power: 1.48% (1.2061 => 1.2240, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.44% (2.4647 => 2.5003, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/neural/neural: 1.33% (1.0841 => 1.0985, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.16% (3.5679 => 3.6092, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.15% (5.4641 => 4.3087, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.39% (7.2130 => 6.3195, std.dev.: 0.0771) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.88% (1.0512 => 0.9368, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: -8.51% (63.1822 => 57.8045, std.dev.: 0.1056) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.20% (14.6451 => 13.5910, std.dev.: 0.0413) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.10% (0.3269 => 0.3037, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.74% (4.7482 => 4.4283, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.86% (5.4972 => 5.1749, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.74% (3.7148 => 3.5015, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.08% (5.1557 => 4.8937, std.dev.: 0.0508) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.16% (4.7449 => 4.5473, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.85% (6.0224 => 5.7906, std.dev.: 0.0105) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.78% (2.4490 => 2.3565, std.dev.: 0.0236) MultiSource/Applications/lua/lua: -3.43% (29.8330 => 28.8106, std.dev.: 0.1434) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.38% (0.5807 => 0.5611, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.23% (2.8773 => 2.7845, std.dev.: 0.0212) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.98% (28.5821 => 27.7313, std.dev.: 0.0155) MultiSource/Benchmarks/Olden/bisort/bisort: -2.59% (0.6636 => 0.6464, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.50% (1.2822 => 1.2502, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.35% (2.6356 => 2.5736, std.dev.: 0.0086) MultiSource/Applications/aha/aha: -2.31% (3.3398 => 3.2628, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: -2.02% (3.4237 => 3.3546, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.95% (9.9065 => 9.7130, std.dev.: 0.0466) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.92% (11.5316 => 11.3104, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.81% (2.3487 => 2.3062, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.54% (4.9994 => 4.9226, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.35% (3.2169 => 3.1735, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.17% (5.6343 => 5.5683, std.dev.: 0.0017) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.85% (16.4461 => 16.9144, std.dev.: 0.0833) MultiSource/Applications/obsequi/Obsequi: 2.86% (1.0262 => 1.0556, std.dev.: 0.0173) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6991.55% (0.3123 => 22.1469, std.dev.: 0.1246) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.10% (0.2463 => 0.3697, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/bigfib: 2.03% (0.6010 => 0.6132, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.03% (0.3266 => 0.3365, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/strcat: 2.84% (0.1969 => 0.2025, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 65.04% (0.0123 => 0.0203, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.15% (0.0408 => 0.0429, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 32.28% (0.0254 => 0.0336, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 3.39% (0.0384 => 0.0397, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/casts: -11.58% (0.0190 => 0.0168, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 3.06% (0.1438 => 0.1482, std.dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.86% (1.1329 => 1.1653, std.dev.: 0.0115) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.24% (0.1462 => 0.1400, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.72% (0.4164 => 0.4194, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.94% (0.1369 => 0.1464, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.93% (0.0641 => 0.0603, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.21% (0.0195 => 0.0211, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.82% (0.0578 => 0.0629, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.54% (1.1437 => 1.1956, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.61% (0.0627 => 0.0573, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 17.22% (0.0180 => 0.0211, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.41% (0.8017 => 0.7824, std.dev.: 0.0218) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -35.48% (0.0062 => 0.0040, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 09:46:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 11:46:44 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121113174644.E9A9F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5827?compare_to=5824&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5827, Order: 167846, Start Time: 2012-11-13 16:21:52, End Time: 2012-11-13 17:47:01 To: 5824, Order: 167830, Start Time: 2012-11-13 14:33:31, End Time: 2012-11-13 15:58:36 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (176 on baseline) Unchanged Tests: 1042 (862 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.97% (2.0478 => 2.1087, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/salsa20: 2.56% (7.4937 => 7.6858, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 2.25% (3.1932 => 3.2650, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.25% (0.1431 => 0.1313, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.96% (0.3821 => 0.3517, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.58% (0.9542 => 0.8914, std.dev.: 0.0038) MultiSource/Applications/sgefa/sgefa: -6.46% (0.3357 => 0.3140, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.30% (0.3142 => 0.2944, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -6.12% (2.4924 => 2.3399, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.00% (0.3831 => 0.3601, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -5.95% (0.3812 => 0.3585, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -5.95% (0.3880 => 0.3649, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -5.95% (0.3848 => 0.3619, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.91% (0.3891 => 0.3661, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.89% (0.2428 => 0.2285, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: -5.88% (0.3896 => 0.3667, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -5.85% (0.4033 => 0.3797, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.82% (0.3884 => 0.3658, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: -5.78% (16.1920 => 15.2561, std.dev.: 0.0162) SingleSource/Benchmarks/Misc/oourafft: -5.74% (0.2160 => 0.2036, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -5.71% (9.2283 => 8.7017, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.71% (0.6484 => 0.6114, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.65% (0.9852 => 0.9295, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/exceptions: -5.65% (0.4176 => 0.3940, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: -5.56% (7.0961 => 6.7019, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.53% (1.3722 => 1.2963, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.49% (0.7198 => 0.6803, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: -5.46% (0.9179 => 0.8678, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -5.45% (0.4199 => 0.3970, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.38% (4.8161 => 4.5570, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.35% (3.5339 => 3.3450, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.34% (1.0544 => 0.9981, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.30% (0.3658 => 0.3464, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.29% (0.5478 => 0.5188, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.29% (0.5857 => 0.5547, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.23% (4.8802 => 4.6248, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.22% (0.5591 => 0.5299, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.22% (1.2300 => 1.1658, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (4.0323 => 3.8221, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: -5.20% (0.3406 => 0.3229, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.17% (1.6364 => 1.5518, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.16% (0.6395 => 0.6065, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.14% (1.4642 => 1.3889, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.14% (0.6052 => 0.5741, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -5.14% (1.1450 => 1.0862, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -5.13% (17.1032 => 16.2263, std.dev.: 0.0233) SingleSource/UnitTests/ObjC/parameter-passing: -5.12% (0.4280 => 0.4061, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.10% (0.6194 => 0.5878, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.10% (0.7339 => 0.6965, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.09% (6.7716 => 6.4266, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.09% (0.5575 => 0.5291, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: -5.09% (1.3864 => 1.3158, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.08% (0.5802 => 0.5507, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.08% (0.2695 => 0.2558, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.08% (0.5863 => 0.5565, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.07% (0.6681 => 0.6342, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.07% (0.5859 => 0.5562, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.06% (0.7524 => 0.7143, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.06% (0.6304 => 0.5985, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.06% (0.6189 => 0.5876, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: -5.05% (0.4515 => 0.4287, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.04% (0.6230 => 0.5916, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.03% (0.5849 => 0.5555, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.03% (0.6446 => 0.6122, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.02% (4.5069 => 4.2807, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.02% (0.6736 => 0.6398, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.00% (0.6260 => 0.5947, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.00% (0.5581 => 0.5302, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: -4.98% (0.3255 => 0.3093, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.96% (0.5705 => 0.5422, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.94% (0.3016 => 0.2867, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.94% (0.5567 => 0.5292, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -4.92% (0.2985 => 0.2838, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.91% (0.6660 => 0.6333, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -4.90% (1.2784 => 1.2157, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.90% (0.5570 => 0.5297, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.90% (14.2083 => 13.5128, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.89% (0.5805 => 0.5521, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.89% (0.6297 => 0.5989, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -4.89% (1.3148 => 1.2505, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.88% (0.5456 => 0.5190, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.87% (1.2210 => 1.1615, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.87% (0.5569 => 0.5298, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.86% (0.5925 => 0.5637, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -4.85% (4.3330 => 4.1228, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.84% (1.2221 => 1.1629, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.84% (0.3057 => 0.2909, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.82% (0.5688 => 0.5414, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.81% (0.6667 => 0.6346, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.81% (0.5941 => 0.5655, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.81% (0.6676 => 0.6355, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -4.80% (1.2515 => 1.1914, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.80% (0.6293 => 0.5991, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.79% (0.6033 => 0.5744, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: -4.77% (0.2871 => 0.2734, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.77% (0.6440 => 0.6133, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.76% (0.8521 => 0.8115, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.74% (0.4916 => 0.4683, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.71% (0.2933 => 0.2795, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -4.70% (0.2939 => 0.2801, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.68% (8.0126 => 7.6378, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.67% (2.1713 => 2.0699, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: -4.66% (0.3581 => 0.3414, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.66% (0.6395 => 0.6097, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.64% (0.3837 => 0.3659, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.63% (0.2999 => 0.2860, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -4.60% (3.5154 => 3.3536, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.60% (0.5999 => 0.5723, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.59% (0.2548 => 0.2431, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.58% (0.3931 => 0.3751, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.58% (0.3059 => 0.2919, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.57% (0.3483 => 0.3324, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: -4.56% (0.3025 => 0.2887, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -4.56% (0.3026 => 0.2888, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -4.56% (0.3446 => 0.3289, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.53% (0.2385 => 0.2277, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: -4.51% (0.3194 => 0.3050, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -4.51% (0.3394 => 0.3241, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -4.50% (0.7447 => 0.7112, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.49% (0.3849 => 0.3676, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -4.48% (0.3481 => 0.3325, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.48% (0.2278 => 0.2176, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -4.46% (0.3205 => 0.3062, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.46% (0.7919 => 0.7566, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -4.46% (15.2527 => 14.5731, std.dev.: 0.0144) MultiSource/Applications/lua/lua: -4.42% (4.0594 => 3.8798, std.dev.: 0.0051) MultiSource/Applications/SPASS/SPASS: -4.42% (15.5079 => 14.8219, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/hash2: -4.36% (0.4861 => 0.4649, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.35% (0.2849 => 0.2725, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -4.34% (0.3621 => 0.3464, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: -4.32% (0.3867 => 0.3700, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -4.31% (5.0226 => 4.8062, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: -4.29% (1.1530 => 1.1035, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: -4.29% (0.2659 => 0.2545, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.28% (0.5329 => 0.5101, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: -4.27% (0.7779 => 0.7447, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: -4.26% (0.4248 => 0.4067, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.24% (0.5168 => 0.4949, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.22% (0.7021 => 0.6725, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.18% (22.4056 => 21.4696, std.dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.15% (1.6474 => 1.5791, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.09% (0.4813 => 0.4616, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.06% (0.9557 => 0.9169, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.04% (0.4427 => 0.4248, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: -4.04% (2.1401 => 2.0537, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: -4.03% (0.6347 => 0.6091, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.03% (0.3252 => 0.3121, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -4.03% (34.0927 => 32.7199, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.02% (0.4083 => 0.3919, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.00% (0.4151 => 0.3985, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.00% (0.2903 => 0.2787, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: -3.98% (0.4524 => 0.4344, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: -3.96% (0.3788 => 0.3638, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -3.92% (0.7982 => 0.7669, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.92% (0.3319 => 0.3189, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: -3.91% (0.3271 => 0.3143, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: -3.91% (0.6441 => 0.6189, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.86% (2.4021 => 2.3093, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: -3.80% (0.8418 => 0.8098, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.79% (0.3323 => 0.3197, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -3.69% (0.6750 => 0.6501, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.45% (2.2587 => 2.1808, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: -3.41% (1.5610 => 1.5077, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.41% (0.3491 => 0.3372, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: -3.37% (18.2933 => 17.6769, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.32% (0.9077 => 0.8776, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.94% (0.4321 => 0.4194, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.83% (5.4682 => 5.3133, std.dev.: 0.0065) SingleSource/UnitTests/Vector/constpool: -2.63% (20.7746 => 20.2273, std.dev.: 0.0314) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7550, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1728, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1738, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.91% (1.7753 => 1.7058, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.66% (1.3096 => 1.2747, std.dev.: 0.0095) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.75% (6.5735 => 6.4585, std.dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0013) Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 09:57:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 11:57:26 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121113175726.B39622A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5828?compare_to=5820&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5828, Order: 167830, Start Time: 2012-11-13 14:42:13, End Time: 2012-11-13 17:57:42 To: 5820, Order: 167826, Start Time: 2012-11-13 10:38:32, End Time: 2012-11-13 13:54:02 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (172 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1042 (719 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.32% (0.0625 => 0.0877, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.98% (0.1063 => 0.1403, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.04% (0.2969 => 0.3742, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.68% (0.1106 => 0.1390, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.11% (0.4253 => 0.5321, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.57% (0.4139 => 0.5156, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.23% (0.0714 => 0.0887, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 24.03% (1.5932 => 1.9761, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.58% (0.0475 => 0.0587, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.45% (0.4994 => 0.6165, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.40% (0.0547 => 0.0675, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.39% (0.5900 => 0.7280, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.12% (0.0584 => 0.0719, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.96% (0.5000 => 0.6148, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.35% (0.1620 => 0.1982, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.23% (0.1021 => 0.1248, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.19% (0.0897 => 0.1096, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.77% (0.1107 => 0.1348, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.06% (0.0584 => 0.0707) MultiSource/Benchmarks/Olden/em3d/em3d: 20.78% (0.0948 => 0.1145, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.70% (0.0633 => 0.0764, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.67% (0.1103 => 0.1331, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.56% (0.0642 => 0.0774, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.52% (0.0541 => 0.0652, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.47% (0.3903 => 0.4702, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.40% (0.0495 => 0.0596, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 20.34% (0.0821 => 0.0988, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.34% (0.1003 => 0.1207, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.21% (0.1549 => 0.1862, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.07% (0.1604 => 0.1926, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.07% (0.0822 => 0.0987, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 20.03% (0.0604 => 0.0725, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 19.89% (0.1619 => 0.1941, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.29% (0.1462 => 0.1744, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 19.22% (0.0947 => 0.1129, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 18.81% (0.0808 => 0.0960, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.74% (0.3890 => 0.4619, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.57% (0.2014 => 0.2388, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 18.47% (0.1218 => 0.1443, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 18.42% (0.5826 => 0.6899, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.17% (0.2736 => 0.3233, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 18.15% (0.5889 => 0.6958, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 18.12% (0.4029 => 0.4759, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 18.05% (0.0698 => 0.0824, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.92% (0.1088 => 0.1283, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.76% (1.3152 => 1.5488, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 17.74% (0.1505 => 0.1772, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.66% (0.0572 => 0.0673, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.48% (0.2866 => 0.3367, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 17.44% (0.5546 => 0.6513, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.17% (3.5627 => 4.1745, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 17.12% (1.8794 => 2.2011, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.07% (0.1968 => 0.2304, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.96% (0.4658 => 0.5448, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.91% (1.6211 => 1.8953, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 16.69% (0.0605 => 0.0706, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.66% (0.3271 => 0.3816, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.64% (0.1160 => 0.1353, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 16.47% (0.1421 => 0.1655, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.34% (0.5026 => 0.5847, std.dev.: 0.0030) MultiSource/Applications/hbd/hbd: 16.29% (0.9697 => 1.1277, std.dev.: 0.0073) MultiSource/Applications/d/make_dparser: 16.21% (1.0781 => 1.2529, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.18% (0.3930 => 0.4566, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.17% (0.2875 => 0.3340, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.17% (0.4361 => 0.5066, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.13% (2.7292 => 3.1695, std.dev.: 0.0045) SingleSource/UnitTests/ObjC++/property-reference: 15.95% (0.7171 => 0.8315, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.90% (4.4195 => 5.1220, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/bh/bh: 15.81% (0.1284 => 0.1487, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 15.62% (4.2109 => 4.8687, std.dev.: 0.0063) MultiSource/Benchmarks/Bullet/bullet: 15.54% (23.5202 => 27.1743, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/matrix: 15.47% (0.2780 => 0.3210, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.45% (0.2738 => 0.3161) SingleSource/Benchmarks/Shootout-C++/strcat: 15.38% (0.2750 => 0.3173, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.35% (0.2729 => 0.3148, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.34% (1.9694 => 2.2715, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/fibo: 15.34% (0.2725 => 0.3143, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.32% (0.2911 => 0.3357, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.32% (0.1090 => 0.1257) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.29% (0.2792 => 0.3219, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 15.29% (0.2714 => 0.3129, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 15.28% (0.9909 => 1.1423, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.27% (0.3195 => 0.3683, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 15.26% (0.2811 => 0.3240, std.dev.: 0.0055) SingleSource/Regression/C++/ofstream_ctor: 15.21% (0.3004 => 0.3461, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.20% (1.9966 => 2.3001, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 15.13% (0.2823 => 0.3250, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 15.09% (0.2803 => 0.3226, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 15.07% (0.2813 => 0.3237, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.91% (2.0673 => 2.3755, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 14.86% (0.3096 => 0.3556, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 14.84% (0.2075 => 0.2383, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 14.69% (0.3267 => 0.3747, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 14.69% (0.2566 => 0.2943, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.58% (0.3060 => 0.3506, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 14.55% (0.3258 => 0.3732) SingleSource/Benchmarks/Shootout-C++/ary2: 14.35% (0.3317 => 0.3793, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 14.35% (1.4269 => 1.6316, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.25% (0.3362 => 0.3841, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 14.24% (0.3496 => 0.3994, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 14.22% (0.3446 => 0.3936, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 14.15% (0.3469 => 0.3960, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 14.14% (0.3678 => 0.4198, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 14.08% (0.3465 => 0.3953, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.05% (0.3124 => 0.3563, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.02% (0.3488 => 0.3977, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 14.00% (0.3442 => 0.3924, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 13.99% (0.7875 => 0.8977, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-3: 13.99% (0.3460 => 0.3944, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 13.92% (0.3650 => 0.4158, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 13.89% (0.3348 => 0.3813, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 13.88% (0.3726 => 0.4243, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.86% (0.3282 => 0.3737, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.85% (0.3625 => 0.4127, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 13.83% (0.3477 => 0.3958, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.72% (0.3643 => 0.4143, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.56% (0.3724 => 0.4229, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.54% (0.3981 => 0.4520, std.dev.: 0.0124) MultiSource/Applications/JM/ldecod/ldecod: 13.51% (2.1653 => 2.4579, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 13.48% (0.4146 => 0.4705, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 13.43% (0.4251 => 0.4822, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.25% (0.3690 => 0.4179, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 13.12% (4.6177 => 5.2234, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.06% (0.3845 => 0.4347, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 13.02% (2.1013 => 2.3749, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 12.91% (0.5012 => 0.5659, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.75% (0.2040 => 0.2300, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.73% (0.1383 => 0.1559, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 12.67% (0.2691 => 0.3032, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 12.37% (5.5417 => 6.2270, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.89% (0.6435 => 0.7200, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.87% (0.1028 => 0.1150, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 11.29% (0.3498 => 0.3893, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.12% (0.2068 => 0.2298, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.07% (0.2737 => 0.3040, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 11.06% (0.6634 => 0.7368, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 10.98% (0.4847 => 0.5379, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.89% (0.3084 => 0.3420, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 10.70% (0.3336 => 0.3693, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.32% (0.2103 => 0.2320, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 10.17% (2.0346 => 2.2415, std.dev.: 0.0066) MultiSource/Applications/lemon/lemon: 10.00% (0.2391 => 0.2630, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.21% (0.5361 => 0.5855, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.18% (4.6926 => 5.1234, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.95% (11.6398 => 12.6812, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.58% (0.7426 => 0.8063, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.52% (0.5584 => 0.6060, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 6.93% (11.9555 => 12.7840, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.69% (0.3792 => 0.3970, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 9.35% (0.2802 => 0.3064, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6097, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6711, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-2: 5.05% (1.8057 => 1.8969, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 5.04% (0.2122 => 0.2229, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1642, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: 4.25% (14.0481 => 14.6454, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2086, std.dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2223, std.dev.: 0.0033) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3078, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2872, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5854, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.97% (25.4195 => 16.5314, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/ary2: -8.37% (0.2402 => 0.2201, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9770, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7865, std.dev.: 0.0126) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7957, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0053) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7730, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -2.84% (17.2379 => 16.7477, std.dev.: 0.0701) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8729, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5731, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4958, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.10% (105.3826 => 104.2269, std.dev.: 0.0269) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0452, std.dev.: 0.0008) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 11:15:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 13:15:33 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121113191533.EDF582A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5829?compare_to=5826&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5829, Order: 167850, Start Time: 2012-11-13 17:48:43, End Time: 2012-11-13 19:15:50 To: 5826, Order: 167846, Start Time: 2012-11-13 16:05:34, End Time: 2012-11-13 17:31:38 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 11 (118 on baseline) Performance Improvements: 3 (22 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 977 (834 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 30.77% (0.0364 => 0.0476, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: 2.42% (8.5041 => 8.7103, std.dev.: 0.0374) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.85% (0.8826 => 0.8989, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.36% (0.8314 => 0.8427, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 8.61% (3.7858 => 4.1119, std.dev.: 0.0417) SingleSource/Benchmarks/CoyoteBench/lpbench: 3.86% (3.8963 => 4.0468, std.dev.: 0.0450) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.29% (41.2203 => 42.5772, std.dev.: 0.0946) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.59% (59.1276 => 60.6610, std.dev.: 0.2037) MultiSource/Benchmarks/BitBench/five11/five11: 1.59% (5.6081 => 5.6972, std.dev.: 0.0186) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.24% (1.2692 => 1.2849, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 1.23% (28.8106 => 29.1655, std.dev.: 0.0916) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.58% (0.8406 => 0.8273, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.14% (0.9182 => 0.9077, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.05% (2.6651 => 2.6104, std.dev.: 0.0112) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.34% (16.9144 => 17.1408, std.dev.: 0.0500) MultiSource/Applications/obsequi/Obsequi: 2.70% (1.0556 => 1.0841, std.dev.: 0.0115) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.23% (22.1469 => 22.4203, std.dev.: 0.1079) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.73% (0.3697 => 0.3724, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 1.63% (0.6132 => 0.6232, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.42% (0.3365 => 0.3379, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 0.35% (0.2025 => 0.2032, std.dev.: 0.0082) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 8.37% (0.0203 => 0.0220, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0429 => 0.0431, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0336 => 0.0337, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.59% (0.0314 => 0.0319, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 7.56% (0.0397 => 0.0427, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 23.81% (0.0168 => 0.0208, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 0.46% (0.0219 => 0.0220, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.54% (0.1482 => 0.1474, std.dev.: 0.0036) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.87% (1.1653 => 1.1552, std.dev.: 0.0553) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.29% (0.1400 => 0.1396, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.24% (0.4194 => 0.4204, std.dev.: 0.0359) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.41% (0.1464 => 0.1458, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.63% (0.0603 => 0.0563, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.21% (0.0211 => 0.0200, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.17% (0.0629 => 0.0565, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.33% (1.1956 => 1.1917, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1700.00% (0.0001 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.79% (0.0573 => 0.0557, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.47% (0.0211 => 0.0210, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.18% (0.7824 => 0.7838, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 17.50% (0.0040 => 0.0047, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2339.39% (0.6332 => 15.4462, std.dev.: 0.2938) MultiSource/Benchmarks/McCat/08-main/main: 50.46% (0.1831 => 0.2755, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.35% (0.1559 => 0.1460, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1540.34% (0.3344 => 5.4853, std.dev.: 0.0840) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.71% (0.2364 => 0.3279, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: 2.80% (0.0429 => 0.0441, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 9.38% (0.0224 => 0.0245, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4905, std.dev.: 0.0143) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0725, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4960, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3224, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1325, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4046, std.dev.: 0.0032) SingleSource/Regression/C/uint64_to_float: -23.72% (2.1832 => 1.6654, std.dev.: 0.0265) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.02% (0.0810 => 0.0956, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.82% (0.0830 => 0.0953, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.56% (0.0848 => 0.0963, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: 12.68% (0.1112 => 0.1253, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.66% (0.1905 => 0.2089, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.50% (0.1137 => 0.1245, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.15% (0.3137 => 0.3424, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.46% (0.7473 => 0.8105, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.35% (0.2180 => 0.2362, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/health/health: 7.65% (0.1347 => 0.1450, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.24% (0.6010 => 0.6445, std.dev.: 0.0131) MultiSource/Applications/viterbi/viterbi: 7.10% (0.1577 => 0.1689, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.67% (0.2279 => 0.2431, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.56% (0.1983 => 0.2113, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.53% (0.1885 => 0.2008, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.35% (0.2519 => 0.2679, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.23% (0.8321 => 0.8839, std.dev.: 0.0150) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.88% (0.8148 => 0.8627, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.55% (0.6287 => 0.6636, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.50% (0.2998 => 0.3163, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.49% (0.2240 => 0.2363, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.42% (1.1606 => 1.2235, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.98% (0.5961 => 0.6258, std.dev.: 0.0035) MultiSource/Applications/Burg/burg: 4.80% (1.2222 => 1.2809, std.dev.: 0.0156) MultiSource/Applications/lua/lua: 4.77% (3.8189 => 4.0012, std.dev.: 0.0348) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.60% (1.1685 => 1.2223, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.39% (0.8611 => 0.8989, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.28% (0.3295 => 0.3436, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.23% (4.1763 => 4.3528, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.22% (0.8086 => 0.8427, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.17% (0.4847 => 0.5049, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.13% (1.2526 => 1.3043, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.09% (0.4127 => 0.4296, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.05% (6.6074 => 6.8753, std.dev.: 0.0498) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.05% (0.9435 => 0.9817, std.dev.: 0.0108) MultiSource/Applications/SIBsim4/SIBsim4: 3.93% (1.2568 => 1.3062, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 3.86% (14.2605 => 14.8108, std.dev.: 0.1306) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.75% (0.8340 => 0.8653, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.71% (0.3717 => 0.3855, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.69% (4.4880 => 4.6536, std.dev.: 0.0460) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.66% (1.6386 => 1.6985, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/18-imp/imp: 3.57% (0.3503 => 0.3628, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.56% (0.5191 => 0.5376, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.56% (0.3115 => 0.3226, std.dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: 3.47% (8.4179 => 8.7103, std.dev.: 0.0374) SingleSource/Benchmarks/Shootout-C++/lists1: 3.47% (0.2969 => 0.3072, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.31% (8.6476 => 8.9340, std.dev.: 0.0587) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.30% (0.5817 => 0.6009, std.dev.: 0.0050) MultiSource/Applications/lemon/lemon: 3.19% (1.0945 => 1.1294, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.16% (0.4559 => 0.4703, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 3.15% (0.9810 => 1.0119, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.14% (0.6586 => 0.6793, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.12% (0.3657 => 0.3771, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.00% (0.8697 => 0.8958, std.dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.00% (1.1170 => 1.1505, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.98% (0.8331 => 0.8579, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.91% (4.4873 => 4.6177, std.dev.: 0.0239) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.87% (0.8597 => 0.8844, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.84% (0.8050 => 0.8279, std.dev.: 0.0040) MultiSource/Applications/d/make_dparser: 2.80% (3.2366 => 3.3271, std.dev.: 0.0259) MultiSource/Benchmarks/Bullet/bullet: 2.68% (31.8598 => 32.7140, std.dev.: 0.2537) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.65% (0.8261 => 0.8480, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.65% (0.8457 => 0.8681, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.62% (0.7966 => 0.8175, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.61% (0.9688 => 0.9941, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.57% (0.8066 => 0.8273, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.48% (13.1811 => 13.5084, std.dev.: 0.1012) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.45% (0.8805 => 0.9021, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.41% (0.9056 => 0.9274, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.40% (0.8317 => 0.8517, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.35% (0.9039 => 0.9251, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/football/football: 2.33% (0.8768 => 0.8972, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.28% (0.8359 => 0.8550, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.25% (0.8177 => 0.8361, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.24% (0.8069 => 0.8250, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.16% (0.8885 => 0.9077, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 2.03% (8.6247 => 8.8002, std.dev.: 0.0679) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.98% (1.2423 => 1.2669, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.72% (0.8995 => 0.9150, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 102.01% (0.0199 => 0.0402, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/pi: 59.21% (1.5795 => 2.5147, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.95% (0.7597 => 0.8885, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.30% (2.9753 => 3.4604, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.70% (2.7995 => 3.2109, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6089, std.dev.: 0.0150) SingleSource/Benchmarks/McGill/queens: 7.62% (1.7056 => 1.8356, std.dev.: 0.0329) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.57% (1.1857 => 1.2754, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.44% (0.3186 => 0.3423, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.72% (4.7794 => 5.1004, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 6.47% (1.3037 => 1.3880, std.dev.: 0.0120) MultiSource/Applications/SIBsim4/SIBsim4: 6.19% (3.1873 => 3.3846, std.dev.: 0.0318) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.16% (4.5327 => 4.8118, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.91% (4.9686 => 5.2622, std.dev.: 0.0188) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.93% (3.9188 => 4.1119, std.dev.: 0.0417) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.76% (6.2275 => 6.5240, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.67% (3.3761 => 3.5339, std.dev.: 0.0404) MultiSource/Applications/lambda-0_1_3/lambda: 4.55% (7.4933 => 7.8339, std.dev.: 0.0468) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.15% (1.2337 => 1.2849, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.13% (4.9453 => 5.1495, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.10% (4.9469 => 5.1498, std.dev.: 0.0297) MultiSource/Applications/hexxagon/hexxagon: 4.08% (14.0064 => 14.5783, std.dev.: 0.0144) SingleSource/Benchmarks/CoyoteBench/lpbench: 3.75% (3.9006 => 4.0468, std.dev.: 0.0450) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.54% (0.3587 => 0.3714, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 3.12% (3.6643 => 3.7785, std.dev.: 0.0293) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.82% (11.5690 => 11.8947, std.dev.: 0.0155) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.78% (41.4238 => 42.5772, std.dev.: 0.0946) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.63% (8.2783 => 8.4958, std.dev.: 0.0172) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.36% (59.2638 => 60.6610, std.dev.: 0.2037) SingleSource/Benchmarks/Shootout/lists: 2.33% (7.3375 => 7.5081, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.32% (4.8660 => 4.9788, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.11% (1.1365 => 1.1605, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/five11/five11: 1.68% (5.6030 => 5.6972, std.dev.: 0.0186) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.32% (2.5763 => 2.6104, std.dev.: 0.0112) MultiSource/Benchmarks/FreeBench/neural/neural: 1.32% (1.0841 => 1.0984, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 1.29% (1.2061 => 1.2217, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.27% (2.4647 => 2.4960, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.12% (3.5679 => 3.6078, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/whetstone: 1.07% (2.1224 => 2.1451, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.64% (5.4641 => 4.2817, std.dev.: 0.0273) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.87% (7.2130 => 6.2847, std.dev.: 0.0937) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.39% (1.0512 => 0.9315, std.dev.: 0.0105) SingleSource/Benchmarks/McGill/chomp: -9.87% (1.1216 => 1.0109, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: -8.42% (63.1822 => 57.8618, std.dev.: 0.0183) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.06% (14.6451 => 13.4646, std.dev.: 0.0955) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.94% (0.3269 => 0.3042, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.89% (4.7482 => 4.4209, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.82% (5.4972 => 5.1775, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.77% (3.7148 => 3.5004, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.11% (5.1557 => 4.8923, std.dev.: 0.0133) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.31% (2.4490 => 2.3434, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.96% (4.7449 => 4.5572, std.dev.: 0.0095) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.80% (2.8773 => 2.7680, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.73% (6.0224 => 5.7978, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.13% (0.5807 => 0.5625, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.03% (28.5821 => 27.7147, std.dev.: 0.0145) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.62% (3.2169 => 3.1325, std.dev.: 0.0241) MultiSource/Applications/lua/lua: -2.24% (29.8330 => 29.1655, std.dev.: 0.0916) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.05% (11.5316 => 11.2953, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.64% (4.9994 => 4.9176, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.12% (5.6343 => 5.5712, std.dev.: 0.0076) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 4.22% (16.4461 => 17.1408, std.dev.: 0.0500) MultiSource/Applications/obsequi/Obsequi: 5.64% (1.0262 => 1.0841, std.dev.: 0.0115) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7079.09% (0.3123 => 22.4203, std.dev.: 0.1079) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.20% (0.2463 => 0.3724, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 3.69% (0.6010 => 0.6232, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.46% (0.3266 => 0.3379, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 3.20% (0.1969 => 0.2032, std.dev.: 0.0082) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.64% (0.0408 => 0.0431, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 32.68% (0.0254 => 0.0337, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.63% (0.0302 => 0.0319, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.20% (0.0384 => 0.0427, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 9.47% (0.0190 => 0.0208, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 22.22% (0.0180 => 0.0220, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.50% (0.1438 => 0.1474, std.dev.: 0.0036) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.97% (1.1329 => 1.1552, std.dev.: 0.0553) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.51% (0.1462 => 0.1396, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.96% (0.4164 => 0.4204, std.dev.: 0.0359) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.50% (0.1369 => 0.1458, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -12.17% (0.0641 => 0.0563, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.56% (0.0195 => 0.0200, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.25% (0.0578 => 0.0565, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.20% (1.1437 => 1.1917, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1700.00% (0.0001 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.16% (0.0627 => 0.0557, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.67% (0.0180 => 0.0210, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.23% (0.8017 => 0.7838, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -24.19% (0.0062 => 0.0047, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 11:33:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 13:33:15 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121113193315.65C102A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5830?compare_to=5825&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5830, Order: 167846, Start Time: 2012-11-13 17:22:35, End Time: 2012-11-13 19:33:22 To: 5825, Order: 167830, Start Time: 2012-11-13 14:21:15, End Time: 2012-11-13 16:32:01 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 41 (151 on baseline) Performance Improvements: 7 (41 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 990 (695 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 15.73% (0.6877 => 0.7959, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.54% (0.1409 => 0.1628, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 15.43% (0.8097 => 0.9346, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 14.74% (0.6445 => 0.7395, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 14.57% (0.5929 => 0.6793, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.47% (0.6892 => 0.7889, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 13.92% (0.5905 => 0.6727, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.87% (0.1651 => 0.1880, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.64% (0.7342 => 0.8270, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.56% (0.6304 => 0.7096, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/fibo: 12.55% (0.2980 => 0.3354, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash: 12.11% (0.4805 => 0.5387, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.33% (0.6195 => 0.6897, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 10.76% (0.7201 => 0.7976, std.dev.: 0.0238) SingleSource/Benchmarks/Shootout-C++/ary: 10.59% (0.3540 => 0.3915, std.dev.: 0.0076) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.46% (0.1912 => 0.2112, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.43% (0.7223 => 0.7976, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 9.67% (0.1334 => 0.1463, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/health/health: 9.46% (0.1470 => 0.1609, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 8.73% (0.4798 => 0.5217, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.27% (1.3667 => 1.4797, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 8.21% (0.3595 => 0.3890, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/distray/distray: 8.01% (0.1536 => 0.1659, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.64% (0.7161 => 0.7708, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.52% (0.2114 => 0.2273, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.43% (0.7152 => 0.7540, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.49% (2.3694 => 2.4758, std.dev.: 0.0339) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.78% (0.7092 => 0.7289, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.94% (20.9449 => 21.3505, std.dev.: 0.1274) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.52% (5.8662 => 5.9553, std.dev.: 0.0265) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 22.57% (0.0762 => 0.0934, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 20.55% (3.8852 => 4.6837, std.dev.: 0.0606) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 19.64% (0.0840 => 0.1005, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bisort/bisort: 16.84% (0.8664 => 1.0123, std.dev.: 0.0134) MultiSource/Benchmarks/Olden/tsp/tsp: 16.15% (1.1024 => 1.2804, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 7.47% (0.5355 => 0.5755, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 7.12% (2.7723 => 2.9696, std.dev.: 0.0537) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.10% (6.6191 => 6.9568, std.dev.: 0.0153) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.51% (4.7806 => 4.8529, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.44% (2.1424 => 2.1733, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ackermann: 1.26% (1.7517 => 1.7737, std.dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -12.38% (0.7119 => 0.6238, std.dev.: 0.0264) MultiSource/Benchmarks/Olden/power/power: -10.21% (0.1626 => 0.1460, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.44% (1.7445 => 1.5798, std.dev.: 0.0624) SingleSource/UnitTests/ObjC/exceptions-3: -3.04% (0.4304 => 0.4173, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -10.42% (1.5306 => 1.3711, std.dev.: 0.0249) SingleSource/Benchmarks/Shootout-C++/hash2: -2.61% (3.5184 => 3.4266, std.dev.: 0.0314) MultiSource/Benchmarks/Ptrdist/ft/ft: -2.17% (1.3479 => 1.3186, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1338 => 0.1338, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.52% (0.0420 => 0.0481, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.37% (0.0652 => 0.0674, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 0.12% (493.7168 => 494.2856, std.dev.: 0.1149) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.90% (4.3882 => 0.0481, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 43731.30% (1.1277 => 494.2856, std.dev.: 0.1149) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.99% (0.5229 => 1.5425, std.dev.: 0.0906) MultiSource/Applications/SPASS/SPASS: 21.89% (14.9895 => 18.2713, std.dev.: 0.0620) MultiSource/Applications/kimwitu++/kc: 49.13% (14.1553 => 21.1095, std.dev.: 0.2064) MultiSource/Benchmarks/MallocBench/gs/gs: 25.28% (4.1105 => 5.1498, std.dev.: 0.0129) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.13% (1.1048 => 1.5150, std.dev.: 0.0590) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 436.64% (7.1582 => 38.4136, std.dev.: 0.0220) SingleSource/Benchmarks/Misc-C++-EH/spirit: 90.43% (3.4629 => 6.5944, std.dev.: 0.0335) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.96% (0.6222 => 1.0326, std.dev.: 0.0444) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10912.50% (0.0720 => 7.9290, std.dev.: 0.0383) MultiSource/Applications/SIBsim4/SIBsim4: 3907500.00% (0.0001 => 3.9076, std.dev.: 0.0098) MultiSource/Applications/SPASS/SPASS: 14830000.00% (0.0001 => 14.8301, std.dev.: 0.0981) MultiSource/Applications/kimwitu++/kc: 52200.00% (0.0001 => 0.0523, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 578200.00% (0.0001 => 0.5783, std.dev.: 0.0210) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10087500.00% (0.0001 => 10.0876, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6956700.00% (0.0001 => 6.9568, std.dev.: 0.0153) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1807.32% (1.1194 => 21.3505, std.dev.: 0.1274) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 65.94% (2.9384 => 4.8761, std.dev.: 0.1904) MultiSource/Applications/ClamAV/clamscan: 60.55% (22.1758 => 35.6027, std.dev.: 0.0525) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 58.14% (7.0540 => 11.1550, std.dev.: 0.0419) MultiSource/Benchmarks/FreeBench/distray/distray: 57.10% (0.1056 => 0.1659, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 51.31% (8.1363 => 12.3112, std.dev.: 0.0845) MultiSource/Applications/JM/lencod/lencod: 46.84% (21.9371 => 32.2132, std.dev.: 0.0509) SingleSource/UnitTests/vla: 44.79% (0.0355 => 0.0514, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 43.01% (0.0730 => 0.1044, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: 38.90% (0.1432 => 0.1989, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/dot-syntax-1: 38.00% (0.0479 => 0.0661, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 35.25% (0.0746 => 0.1009, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 33.33% (0.1584 => 0.2112, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 31.72% (0.1236 => 0.1628, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bisort/bisort: 31.27% (0.0614 => 0.0806, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/dot-syntax: 28.73% (0.0355 => 0.0457, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 26.89% (0.1268 => 0.1609, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 25.60% (0.4289 => 0.5387, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/bc/bc: 24.75% (1.1861 => 1.4797, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 24.43% (0.0479 => 0.0596, std.dev.: 0.0023) SingleSource/Benchmarks/Stanford/Oscar: 23.74% (0.0636 => 0.0787, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 23.66% (0.6450 => 0.7976, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: 23.24% (0.0482 => 0.0594, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 23.09% (0.7115 => 0.8758, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/fibo: 23.08% (0.2725 => 0.3354, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/misr: 23.06% (0.0633 => 0.0779, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/whetstone: 23.03% (0.0660 => 0.0812, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 22.68% (2.0273 => 2.4871, std.dev.: 0.0488) MultiSource/Benchmarks/McCat/08-main/main: 22.40% (0.2554 => 0.3126, std.dev.: 0.0213) MultiSource/Applications/oggenc/oggenc: 21.65% (5.7591 => 7.0062, std.dev.: 0.0153) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.52% (0.1566 => 0.1903, std.dev.: 0.0103) SingleSource/UnitTests/ObjC/trivial-interface: 21.48% (0.3473 => 0.4219, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/05-eks/eks: 21.35% (0.4299 => 0.5217, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: 21.27% (0.0536 => 0.0650, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 21.23% (0.3561 => 0.4317, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.19% (14.3668 => 17.4116, std.dev.: 0.0355) SingleSource/Benchmarks/Shootout-C++/ary: 21.13% (0.3232 => 0.3915, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/exceptions-2: 20.96% (0.3497 => 0.4230, std.dev.: 0.0058) MultiSource/Applications/lua/lua: 20.94% (3.8723 => 4.6831, std.dev.: 0.0752) MultiSource/Benchmarks/MallocBench/espresso/espresso: 20.62% (4.2646 => 5.1441, std.dev.: 0.0159) MultiSource/Benchmarks/Olden/tsp/tsp: 20.60% (0.1175 => 0.1417, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.40% (0.9765 => 1.1757, std.dev.: 0.0252) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 20.14% (0.1892 => 0.2273, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.00% (0.0770 => 0.0924, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 19.91% (2.2969 => 2.7543, std.dev.: 0.0640) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.83% (4.9449 => 5.9254, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.47% (0.3935 => 0.4701, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.30% (0.2700 => 0.3221, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.06% (5.0018 => 5.9553, std.dev.: 0.0265) SingleSource/UnitTests/ObjC/exceptions-3: 18.69% (0.3516 => 0.4173, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/oourafft: 18.53% (0.3282 => 0.3890, std.dev.: 0.0029) MultiSource/Applications/d/make_dparser: 18.21% (3.3354 => 3.9428, std.dev.: 0.1131) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.02% (0.2891 => 0.3412, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 17.93% (2.2024 => 2.5972, std.dev.: 0.1338) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.81% (0.0842 => 0.0992, std.dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: 17.78% (9.4845 => 11.1704, std.dev.: 0.0673) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.68% (0.8172 => 0.9617, std.dev.: 0.0150) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 17.47% (3.8922 => 4.5721, std.dev.: 0.0737) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.45% (1.5415 => 1.8105, std.dev.: 0.0314) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.17% (0.5981 => 0.7008, std.dev.: 0.0148) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.11% (0.0871 => 0.1020, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 17.05% (0.8101 => 0.9482, std.dev.: 0.0215) SingleSource/Benchmarks/McGill/exptree: 16.95% (0.0814 => 0.0952, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/messages-2: 16.92% (0.0662 => 0.0774, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 16.74% (17.1811 => 20.0566, std.dev.: 0.0397) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.51% (1.3050 => 1.5204, std.dev.: 0.0459) MultiSource/Benchmarks/Olden/mst/mst: 16.34% (0.1163 => 0.1353, std.dev.: 0.0060) MultiSource/Applications/Burg/burg: 16.23% (1.1642 => 1.3532, std.dev.: 0.0623) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.13% (0.2065 => 0.2398, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.05% (0.0648 => 0.0752, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/matrix: 16.01% (0.0818 => 0.0949, std.dev.: 0.0039) MultiSource/Benchmarks/NPB-serial/is/is: 15.99% (0.0719 => 0.0834, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.80% (0.0886 => 0.1026, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.69% (0.1625 => 0.1880, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.41% (0.1940 => 0.2239, std.dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 15.31% (0.1555 => 0.1793, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.19% (0.0770 => 0.0887, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.13% (0.1117 => 0.1286, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.10% (0.4615 => 0.5312, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.97% (0.2758 => 0.3171, std.dev.: 0.0151) MultiSource/Benchmarks/sim/sim: 14.94% (0.3387 => 0.3893, std.dev.: 0.0118) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.57% (0.2107 => 0.2414, std.dev.: 0.0093) MultiSource/Benchmarks/Bullet/bullet: 14.43% (63.2438 => 72.3720, std.dev.: 0.0373) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 14.35% (0.3177 => 0.3633, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.34% (0.1032 => 0.1180) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.21% (0.1337 => 0.1527, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.09% (0.1029 => 0.1174, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.05% (0.2271 => 0.2590, std.dev.: 0.0113) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.94% (0.1062 => 0.1210, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.64% (0.1510 => 0.1716, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 13.00% (0.6456 => 0.7295, std.dev.: 0.0206) MultiSource/Applications/hbd/hbd: 12.65% (1.5603 => 1.7577, std.dev.: 0.0359) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.42% (2.2022 => 2.4758, std.dev.: 0.0339) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.41% (0.5020 => 0.5643, std.dev.: 0.0164) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.09% (0.1695 => 0.1900, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 11.95% (10.3673 => 11.6059, std.dev.: 0.0641) SingleSource/UnitTests/ObjC++/Hello: 11.90% (0.5925 => 0.6630, std.dev.: 0.0204) SingleSource/UnitTests/ObjC/block-byref-aggr: 11.84% (0.3817 => 0.4269, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.69% (0.3543 => 0.3957, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.65% (0.1906 => 0.2128, std.dev.: 0.0079) SingleSource/UnitTests/ObjC/exceptions: 11.60% (0.3828 => 0.4272, std.dev.: 0.0161) SingleSource/UnitTests/ObjC/for-in: 11.37% (0.3694 => 0.4114, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 11.36% (1.4186 => 1.5798, std.dev.: 0.0624) SingleSource/Benchmarks/Stanford/Puzzle: 11.20% (0.1268 => 0.1410, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.14% (0.2603 => 0.2893, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 9.98% (0.1463 => 0.1609, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.85% (0.7326 => 0.7974, std.dev.: 0.0071) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.19% (7.9617 => 8.3750, std.dev.: 0.0371) SingleSource/UnitTests/Vector/constpool: 4.01% (54.1659 => 56.3363, std.dev.: 0.0995) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.59% (4.3953 => 11.0144, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/methcall: 147.63% (5.3999 => 13.3719, std.dev.: 0.0010) MultiSource/Benchmarks/llubenchmark/llu: 45.54% (3.7781 => 5.4985, std.dev.: 0.2200) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 26.08% (13.4384 => 16.9426, std.dev.: 0.1015) SingleSource/Benchmarks/Shootout-C++/ary: 23.54% (0.0756 => 0.0934, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bisort/bisort: 21.48% (0.8333 => 1.0123, std.dev.: 0.0134) MultiSource/Applications/minisat/minisat: 18.84% (9.1159 => 10.8333, std.dev.: 0.4031) MultiSource/Benchmarks/Olden/tsp/tsp: 18.72% (1.0785 => 1.2804, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/oourafft: 17.60% (6.6465 => 7.8165, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.46% (1.1145 => 1.3091, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 16.32% (0.0864 => 0.1005, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.93% (10.3460 => 11.7877, std.dev.: 0.2404) MultiSource/Benchmarks/Olden/health/health: 13.66% (0.4445 => 0.5052, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.08% (0.2944 => 0.3329, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.70% (2.8904 => 3.2285, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.36% (8.6802 => 9.5798, std.dev.: 0.0710) SingleSource/Benchmarks/Misc/richards_benchmark: 10.25% (1.1396 => 1.2564, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.37% (1.7254 => 1.8870, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 8.51% (3.1578 => 3.4266, std.dev.: 0.0314) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.85% (4.2280 => 4.4753, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 5.11% (1.3045 => 1.3711, std.dev.: 0.0249) SingleSource/Regression/C/uint64_to_float: 5.08% (0.5413 => 0.5688, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.14% (11.6436 => 12.1256, std.dev.: 0.0039) MultiSource/Applications/lua/lua: 3.68% (26.0924 => 27.0517, std.dev.: 0.3518) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.53% (1.7133 => 1.7737, std.dev.: 0.0066) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.36% (0.4162 => 0.4302, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.71% (1.2838 => 1.3186, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: 2.67% (2.4116 => 2.4761, std.dev.: 0.0070) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.39% (2.1424 => 2.1935, std.dev.: 0.0136) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.15% (1.3677 => 1.3971, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 2.08% (3.1595 => 3.2252, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 1.74% (85.0658 => 86.5486, std.dev.: 0.0095) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.63% (6.5088 => 6.6146, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 1.45% (27.8444 => 28.2482, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/sieve: 1.41% (5.2139 => 5.2873, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: 1.27% (12.5348 => 12.6941, std.dev.: 0.0133) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0313 => 1.0441, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0505, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.17% (1.9577 => 1.9807, std.dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1675, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/salsa20: -75.78% (0.8651 => 0.2095, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.69% (5.2763 => 1.2827, std.dev.: 0.0316) SingleSource/Benchmarks/Misc/richards_benchmark: -44.64% (0.1622 => 0.0898, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.92% (1.7609 => 1.6214, std.dev.: 0.0514) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.61% (5.3526 => 4.9451, std.dev.: 0.0228) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.96% (5.3855 => 5.0105, std.dev.: 0.0145) MultiSource/Applications/JM/ldecod/ldecod: -6.53% (10.4361 => 9.7545, std.dev.: 0.0359) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -47.50% (0.0400 => 0.0210, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.93% (0.3987 => 0.2395, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.53% (0.0506 => 0.0306, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.27% (4.5009 => 2.7782, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7636, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.15% (2.6546 => 2.0135, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -22.46% (10.7105 => 8.3048, std.dev.: 0.0940) MultiSource/Benchmarks/FreeBench/mason/mason: -19.76% (0.2161 => 0.1734, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.75% (1.6925 => 1.4259, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2841, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.69% (32.5116 => 29.0361, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: -10.65% (1.5373 => 1.3736, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -9.34% (9.5636 => 8.6703, std.dev.: 0.0779) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4245, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.93% (4.8142 => 4.4804, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.51% (3.2416 => 3.0306, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5758, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5080, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.77% (0.2497 => 0.2378, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.52% (1.6805 => 1.6046, std.dev.: 0.0220) SingleSource/Benchmarks/Shootout/lists: -4.21% (6.2999 => 6.0346, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.39% (19.9488 => 19.2729, std.dev.: 0.1330) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.18% (0.9957 => 0.9640, std.dev.: 0.0086) MultiSource/Benchmarks/sim/sim: -3.05% (5.0483 => 4.8944, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.29% (0.4808 => 0.4698, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6771, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.61% (8.1563 => 8.0252, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/salsa20: -1.47% (10.2830 => 10.1321, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.15% (0.2116 => 0.0674, std.dev.: 0.0008) Report Time: 6.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 11:35:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 13:35:47 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121113193547.684012A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5831?compare_to=5827&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5831, Order: 167851, Start Time: 2012-11-13 18:10:28, End Time: 2012-11-13 19:35:54 To: 5827, Order: 167846, Start Time: 2012-11-13 16:21:52, End Time: 2012-11-13 17:47:01 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (176 on baseline) Unchanged Tests: 1042 (862 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.92% (2.0478 => 2.1075, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: 2.38% (7.4937 => 7.6723, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/hash2: 2.05% (3.1932 => 3.2588, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.18% (0.1431 => 0.1314, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.98% (0.3821 => 0.3516, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.43% (0.3357 => 0.3141, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.37% (0.9542 => 0.8934, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.14% (0.3142 => 0.2949, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -6.13% (2.4924 => 2.3395, std.dev.: 0.0157) SingleSource/UnitTests/ObjC/exceptions-2: -6.06% (0.3831 => 0.3599, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -6.01% (0.3812 => 0.3583) SingleSource/UnitTests/ObjC/exceptions-4: -6.01% (0.3880 => 0.3647, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.95% (0.3848 => 0.3619, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -5.93% (0.3896 => 0.3665, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.89% (0.3891 => 0.3662, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.88% (0.4033 => 0.3796, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.85% (0.2428 => 0.2286, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.84% (0.3884 => 0.3657, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: -5.77% (0.4176 => 0.3935, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -5.77% (16.1920 => 15.2576, std.dev.: 0.0133) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.76% (0.9852 => 0.9285, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -5.74% (0.2160 => 0.2036, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -5.73% (9.2283 => 8.6998, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.61% (0.2355 => 0.2223, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.58% (0.6484 => 0.6122, std.dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: -5.54% (7.0961 => 6.7031, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.52% (0.7198 => 0.6801, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.49% (1.0544 => 0.9965, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: -5.49% (0.9179 => 0.8675, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -5.48% (0.4199 => 0.3969, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.43% (1.3722 => 1.2977, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.37% (4.0323 => 3.8159, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.34% (4.8161 => 4.5588, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.33% (3.5339 => 3.3457, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.31% (0.5478 => 0.5187, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.29% (0.5857 => 0.5547, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -5.26% (0.3406 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.25% (0.3658 => 0.3466, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.20% (0.5849 => 0.5545, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.19% (0.2695 => 0.2555, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.17% (0.5591 => 0.5302, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.15% (1.6364 => 1.5521, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.15% (4.8802 => 4.6288, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.14% (0.6736 => 0.6390, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.13% (0.5863 => 0.5562, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -5.13% (1.1450 => 1.0863, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.11% (0.6395 => 0.6068, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -5.10% (17.1032 => 16.2313, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.09% (0.6304 => 0.5983, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.09% (1.2300 => 1.1674, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.09% (1.4642 => 1.3897, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.08% (0.5802 => 0.5507, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.08% (0.7339 => 0.6966, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.08% (0.5569 => 0.5286, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.07% (0.3016 => 0.2863, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -5.07% (0.4280 => 0.4063, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.07% (0.5705 => 0.5416, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.06% (0.5925 => 0.5625, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.06% (6.7716 => 6.4288, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.05% (0.5859 => 0.5563, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: -5.05% (1.1530 => 1.0948, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.04% (0.6446 => 0.6121, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: -5.04% (0.3255 => 0.3091, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.04% (0.7524 => 0.7145, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.03% (0.6189 => 0.5878, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.02% (4.5069 => 4.2805, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.02% (0.6297 => 0.5981, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.01% (0.5805 => 0.5514, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: -5.01% (0.4515 => 0.4289, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -4.99% (1.3148 => 1.2492, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.99% (0.8521 => 0.8096, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.99% (0.5575 => 0.5297, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.97% (0.3057 => 0.2905, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.97% (0.5456 => 0.5185, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.96% (0.5581 => 0.5304, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.96% (0.6230 => 0.5921, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.96% (0.6052 => 0.5752, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.96% (0.6194 => 0.5887, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.94% (0.6681 => 0.6351, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: -4.92% (1.3864 => 1.3182, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.91% (0.5941 => 0.5649, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -4.90% (1.2784 => 1.2158, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.89% (0.6660 => 0.6334, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.89% (0.6260 => 0.5954, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -4.86% (0.3026 => 0.2879, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.86% (14.2083 => 13.5182, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.85% (1.2221 => 1.1628, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.83% (0.5567 => 0.5298, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.83% (0.6395 => 0.6086, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.83% (0.6293 => 0.5989, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: -4.83% (4.3330 => 4.1238, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/bh/bh: -4.82% (0.2985 => 0.2841, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.82% (0.6676 => 0.6354, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.82% (0.3837 => 0.3652, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.81% (0.6667 => 0.6346, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -4.81% (0.2871 => 0.2733, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.80% (0.6440 => 0.6131, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.79% (2.1713 => 2.0672, std.dev.: 0.0068) MultiSource/Applications/Burg/burg: -4.77% (1.2515 => 1.1918, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.76% (0.3931 => 0.3744, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -4.75% (0.2989 => 0.2847, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.74% (0.6033 => 0.5747, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.74% (0.5570 => 0.5306, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.73% (1.2210 => 1.1632, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.72% (0.4916 => 0.4684, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.71% (0.7919 => 0.7546, std.dev.: 0.0026) SingleSource/Regression/C++/ofstream_ctor: -4.71% (0.3059 => 0.2915, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: -4.70% (0.3446 => 0.3284, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -4.70% (0.2939 => 0.2801, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.67% (0.2933 => 0.2796, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.67% (0.2849 => 0.2716, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -4.66% (0.3025 => 0.2884, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.66% (0.5688 => 0.5423, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -4.66% (0.3394 => 0.3236, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.65% (0.3483 => 0.3321, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.62% (0.5999 => 0.5722, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: -4.59% (0.3205 => 0.3058, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.58% (8.0126 => 7.6459, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.57% (0.2999 => 0.2862, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.55% (0.3849 => 0.3674, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -4.54% (0.3194 => 0.3049, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -4.51% (0.3481 => 0.3324, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -4.51% (0.4861 => 0.4642, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.49% (0.2385 => 0.2278, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.48% (0.2278 => 0.2176, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.47% (0.2548 => 0.2434, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: -4.47% (3.5154 => 3.3584, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.44% (0.2903 => 0.2774, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -4.44% (15.2527 => 14.5754, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/lists1: -4.42% (0.3867 => 0.3696, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.40% (0.3319 => 0.3173, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: -4.37% (15.5079 => 14.8301, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.37% (0.3252 => 0.3110, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -4.36% (0.3621 => 0.3463, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -4.35% (0.7779 => 0.7441, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: -4.34% (0.7447 => 0.7124, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.33% (0.5168 => 0.4944, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.25% (1.6474 => 1.5774, std.dev.: 0.0180) MultiSource/Applications/oggenc/oggenc: -4.25% (5.0226 => 4.8092, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.24% (0.7021 => 0.6723, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -4.24% (4.0594 => 3.8874, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.22% (0.5329 => 0.5104, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -4.22% (0.3581 => 0.3430, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -4.21% (0.4248 => 0.4069, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.19% (0.4151 => 0.3977, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.18% (0.6347 => 0.6082, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.17% (22.4056 => 21.4724, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.13% (0.4427 => 0.4244, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.10% (0.9557 => 0.9165, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: -4.09% (0.3788 => 0.3633, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -4.09% (0.4524 => 0.4339, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: -4.08% (34.0927 => 32.7028, std.dev.: 0.0153) SingleSource/UnitTests/ObjC++/property-reference-object: -3.97% (0.6441 => 0.6185, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.97% (0.4083 => 0.3921, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: -3.94% (0.3271 => 0.3142, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.94% (0.3323 => 0.3192, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.84% (0.4813 => 0.4628, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.83% (0.9077 => 0.8729, std.dev.: 0.0030) MultiSource/Applications/treecc/treecc: -3.80% (2.1401 => 2.0588, std.dev.: 0.0086) MultiSource/Applications/siod/siod: -3.78% (2.4021 => 2.3113, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: -3.75% (0.6750 => 0.6497, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -3.73% (0.7982 => 0.7684, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -3.50% (0.8418 => 0.8123, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: -3.45% (18.2933 => 17.6615, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.44% (0.3491 => 0.3371, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.42% (2.2587 => 2.1815, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.26% (0.4321 => 0.4180, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -3.25% (1.5610 => 1.5102, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.91% (5.4682 => 5.3093, std.dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -2.66% (20.7746 => 20.2217, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7512, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1728, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.92% (2.2633 => 2.1745, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.97% (1.3096 => 1.2838, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4697, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0001) Report Time: 2.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 13:00:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 15:00:46 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121113210046.08CBF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5832?compare_to=5829&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5832, Order: 167856, Start Time: 2012-11-13 19:33:48, End Time: 2012-11-13 21:01:04 To: 5829, Order: 167850, Start Time: 2012-11-13 17:48:43, End Time: 2012-11-13 19:15:50 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 1 (18 on baseline) Performance Regressions: 8 (108 on baseline) Performance Improvements: 2 (23 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 981 (843 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/oggenc/oggenc: 17.12% (0.1396 => 0.1635, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.10% (0.5049 => 0.5256, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.22% (0.8839 => 0.9124, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.81% (0.6009 => 0.6118, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.54% (1.4979 => 1.8955, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: 10.64% (8.1588 => 9.0265, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/recursive: 4.30% (2.3434 => 2.4441, std.dev.: 0.0299) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.37% (3.1325 => 3.1753, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.10% (4.8839 => 4.9378, std.dev.: 0.0156) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.36% (42.5772 => 41.5738, std.dev.: 0.3271) MultiSource/Applications/lua/lua: -1.17% (29.1655 => 28.8245, std.dev.: 0.1204) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -1.60% (17.1408 => 16.8665, std.dev.: 0.1805) MultiSource/Applications/obsequi/Obsequi: -1.01% (1.0841 => 1.0732, std.dev.: 0.0054) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.57% (22.4203 => 22.0693, std.dev.: 0.3629) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.26% (0.3724 => 0.3677, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/bigfib: -0.34% (0.6232 => 0.6211, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.71% (0.3379 => 0.3355, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/strcat: -0.49% (0.2032 => 0.2022, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.91% (0.0220 => 0.0222, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0431 => 0.0431, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.30% (0.0337 => 0.0336, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.94% (0.0319 => 0.0316, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.47% (0.0427 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -1.44% (0.0208 => 0.0205, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -13.64% (0.0220 => 0.0190, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.81% (0.1474 => 0.1486, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.19% (1.1552 => 1.1415, std.dev.: 0.0552) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.09% (0.4204 => 0.4158, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.46% (0.1458 => 0.1393, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 16.52% (0.0563 => 0.0656, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.50% (0.0200 => 0.0211, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.96% (0.0565 => 0.0537, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.75% (1.1917 => 1.2006, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0018 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -74.07% (0.0027 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 15.26% (0.0557 => 0.0642, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 12.38% (0.0210 => 0.0236, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.50% (0.7838 => 0.7799, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 95.74% (0.0047 => 0.0092, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2309.51% (0.6332 => 15.2570, std.dev.: 0.3271) MultiSource/Benchmarks/McCat/08-main/main: 51.12% (0.1831 => 0.2767, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.68% (0.1559 => 0.1486, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1526.14% (0.3344 => 5.4378, std.dev.: 0.1077) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.96% (0.2364 => 0.3285, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel: 3.03% (0.0429 => 0.0442, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.02% (0.0224 => 0.0233, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 11.83% (0.1462 => 0.1635, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4588, std.dev.: 0.0728) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0709, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4946, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3155, std.dev.: 0.0257) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1321, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4086, std.dev.: 0.0020) SingleSource/Regression/C/uint64_to_float: -23.94% (2.1832 => 1.6605, std.dev.: 0.0184) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.37% (0.0810 => 0.0975, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.85% (0.0848 => 0.0957, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.17% (0.0830 => 0.0931, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 10.97% (0.1112 => 0.1234, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.76% (0.1137 => 0.1248, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.65% (0.8321 => 0.9124, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.99% (0.1157 => 0.1261, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.95% (0.2279 => 0.2483, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.46% (0.7473 => 0.8105, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.44% (0.4847 => 0.5256, std.dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.19% (0.3137 => 0.3394, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/health/health: 7.94% (0.1347 => 0.1454, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.93% (0.1905 => 0.2056, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.47% (0.6010 => 0.6459, std.dev.: 0.0120) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.74% (0.2180 => 0.2327, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.24% (1.1606 => 1.2330, std.dev.: 0.0127) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.23% (0.2519 => 0.2676, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.12% (0.2240 => 0.2377, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.94% (0.1885 => 0.1997, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.94% (0.5961 => 0.6315, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.90% (0.2998 => 0.3175, std.dev.: 0.0023) MultiSource/Applications/spiff/spiff: 5.87% (0.7950 => 0.8417, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.87% (1.1685 => 1.2371, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.80% (0.3295 => 0.3486, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.60% (0.1983 => 0.2094, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 5.45% (1.2222 => 1.2888, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.39% (0.8148 => 0.8587, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.17% (0.5817 => 0.6118, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.14% (0.9435 => 0.9920, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.04% (0.6287 => 0.6604, std.dev.: 0.0043) MultiSource/Applications/treecc/treecc: 4.87% (1.9948 => 2.0920, std.dev.: 0.0153) MultiSource/Applications/lua/lua: 4.60% (3.8189 => 3.9944, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/ary3: 4.41% (0.2427 => 0.2534, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.29% (0.9688 => 1.0104, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.16% (4.1763 => 4.3502, std.dev.: 0.0216) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.10% (1.2526 => 1.3040, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/gs/gs: 4.02% (4.1305 => 4.2965, std.dev.: 0.0485) MultiSource/Applications/sgefa/sgefa: 3.90% (0.2999 => 0.3116, std.dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 3.85% (1.2568 => 1.3052, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.80% (6.6074 => 6.8583, std.dev.: 0.0381) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.76% (4.4873 => 4.6559, std.dev.: 0.0608) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.75% (0.8611 => 0.8934, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.60% (1.6386 => 1.6976, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.57% (0.6227 => 0.6449, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 3.57% (14.2605 => 14.7689, std.dev.: 0.1607) MultiSource/Applications/minisat/minisat: 3.56% (0.6834 => 0.7077, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 3.52% (0.2985 => 0.3090, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.41% (0.9069 => 0.9378, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.40% (0.3115 => 0.3221, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.39% (8.6476 => 8.9408, std.dev.: 0.0158) MultiSource/Benchmarks/McCat/18-imp/imp: 3.34% (0.3503 => 0.3620, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.25% (0.3657 => 0.3776, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.18% (1.3279 => 1.3701, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.13% (1.4479 => 1.4932, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.05% (4.5702 => 4.7094, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.05% (0.8340 => 0.8594, std.dev.: 0.0060) MultiSource/Applications/lambda-0_1_3/lambda: 3.03% (0.7557 => 0.7786, std.dev.: 0.0078) MultiSource/Applications/siod/siod: 3.02% (2.2184 => 2.2854, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/football/football: 2.91% (0.8768 => 0.9023, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.85% (0.8697 => 0.8945, std.dev.: 0.0081) MultiSource/Benchmarks/Bullet/bullet: 2.80% (31.8598 => 32.7530, std.dev.: 0.0962) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.77% (0.3717 => 0.3820, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.58% (1.1170 => 1.1458, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.48% (4.4880 => 4.5995, std.dev.: 0.0267) MultiSource/Applications/d/make_dparser: 2.43% (3.2366 => 3.3154, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.37% (0.8069 => 0.8260, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.31% (0.8086 => 0.8273, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.24% (0.8716 => 0.8911, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.16% (0.8805 => 0.8995, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.14% (0.8261 => 0.8438, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.12% (0.8066 => 0.8237, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.12% (0.8316 => 0.8492, std.dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 2.08% (8.6247 => 8.8038, std.dev.: 0.0131) MultiSource/Applications/oggenc/oggenc: 1.83% (4.9628 => 5.0535, std.dev.: 0.0311) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.79% (1.2602 => 1.2827, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.67% (0.8995 => 0.9145, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 119.10% (0.0199 => 0.0436, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/pi: 57.35% (1.5795 => 2.4853, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.74% (0.7597 => 0.8945, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.12% (2.9753 => 3.4548, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.70% (2.7995 => 3.2111, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.48% (5.0261 => 5.6031, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.96% (1.1857 => 1.2801, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/queens: 7.14% (1.7056 => 1.8273, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 7.04% (3.1873 => 3.4117, std.dev.: 0.0222) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.73% (4.7794 => 5.1009, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/richards_benchmark: 6.34% (1.3037 => 1.3864, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.87% (4.9686 => 5.2602, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.74% (4.5327 => 4.7931, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.77% (6.2275 => 6.5247, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.68% (3.3761 => 3.5340, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 4.19% (7.4933 => 7.8076, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.07% (4.9469 => 5.1482, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.06% (4.9453 => 5.1461, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.03% (1.2337 => 1.2834, std.dev.: 0.0070) MultiSource/Applications/hexxagon/hexxagon: 3.89% (14.0064 => 14.5507, std.dev.: 0.0181) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.76% (0.3587 => 0.3722, std.dev.: 0.0029) MultiSource/Applications/siod/siod: 2.83% (3.6643 => 3.7681, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.56% (11.5690 => 11.8653, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.34% (8.2783 => 8.4723, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.27% (4.8660 => 4.9763, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.25% (1.1365 => 1.1621, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout/lists: 2.25% (7.3375 => 7.5023, std.dev.: 0.0350) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.10% (4.8362 => 4.9378, std.dev.: 0.0156) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.48% (2.4647 => 2.5011, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/FloatMM: 1.34% (0.8807 => 0.8925, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.18% (3.5679 => 3.6101, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: 1.10% (1.2061 => 1.2194, std.dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.23% (5.4641 => 4.3042, std.dev.: 0.0339) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.93% (7.2130 => 6.1359, std.dev.: 0.2263) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.90% (1.0512 => 0.9366, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -10.90% (14.6451 => 13.0486, std.dev.: 0.2521) MultiSource/Benchmarks/mafft/pairlocalalign: -8.55% (63.1822 => 57.7794, std.dev.: 0.0821) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -7.05% (4.7482 => 4.4136, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.49% (0.3269 => 0.3057, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.24% (3.7148 => 3.4830, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.82% (5.4972 => 5.1773, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.14% (5.1557 => 4.8905, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.46% (4.7449 => 4.5331, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.93% (6.0224 => 5.7858, std.dev.: 0.0100) MultiSource/Applications/lua/lua: -3.38% (29.8330 => 28.8245, std.dev.: 0.1204) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.25% (0.5807 => 0.5618, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/life/life: -3.14% (2.6356 => 2.5529, std.dev.: 0.0072) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.01% (28.5821 => 27.7204, std.dev.: 0.0197) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.69% (2.8773 => 2.8000, std.dev.: 0.0236) MultiSource/Applications/aha/aha: -2.62% (3.3398 => 3.2524, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: -2.22% (3.4237 => 3.3476, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.99% (11.5316 => 11.3020, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.35% (4.9994 => 4.9317, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.29% (3.2169 => 3.1753, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.16% (5.6343 => 5.5689, std.dev.: 0.0214) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.56% (16.4461 => 16.8665, std.dev.: 0.1805) MultiSource/Applications/obsequi/Obsequi: 4.58% (1.0262 => 1.0732, std.dev.: 0.0054) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6966.70% (0.3123 => 22.0693, std.dev.: 0.3629) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.29% (0.2463 => 0.3677, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/bigfib: 3.34% (0.6010 => 0.6211, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.73% (0.3266 => 0.3355, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/strcat: 2.69% (0.1969 => 0.2022, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 80.49% (0.0123 => 0.0222, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.64% (0.0408 => 0.0431, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 32.28% (0.0254 => 0.0336, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 5.56% (0.0180 => 0.0190, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 3.34% (0.1438 => 0.1486, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.76% (1.1329 => 1.1415, std.dev.: 0.0552) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.14% (0.4164 => 0.4158, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.75% (0.1369 => 0.1393, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.34% (0.0641 => 0.0656, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.21% (0.0195 => 0.0211, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.09% (0.0578 => 0.0537, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.98% (1.1437 => 1.2006, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1700.00% (0.0001 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0014 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.39% (0.0627 => 0.0642, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.11% (0.0180 => 0.0236, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.72% (0.8017 => 0.7799, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 48.39% (0.0062 => 0.0092, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 13:24:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 15:24:33 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121113212433.E8C532A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5833?compare_to=5831&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5833, Order: 167864, Start Time: 2012-11-13 19:59:27, End Time: 2012-11-13 21:24:36 To: 5831, Order: 167851, Start Time: 2012-11-13 18:10:28, End Time: 2012-11-13 19:35:54 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (179 on baseline) Unchanged Tests: 1042 (859 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.79% (2.0478 => 2.1049, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: 2.61% (7.4937 => 7.6894, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/hash2: 2.38% (3.1932 => 3.2691, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.32% (0.1431 => 0.1312, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/trivial-interface: -7.37% (0.3812 => 0.3531, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -7.35% (0.3848 => 0.3565, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.35% (0.3821 => 0.3540, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -7.27% (0.3880 => 0.3598, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.25% (0.3891 => 0.3609, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -7.23% (0.3831 => 0.3554, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/synchronized: -7.21% (0.3896 => 0.3615, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -7.17% (0.4033 => 0.3744, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.13% (0.3884 => 0.3607, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -7.06% (0.4176 => 0.3881, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -6.76% (0.4199 => 0.3915, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.65% (0.9542 => 0.8907, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -6.55% (0.3357 => 0.3137, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.46% (2.4924 => 2.3314, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -6.38% (0.4280 => 0.4007, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.33% (0.3142 => 0.2943, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -6.01% (9.2283 => 8.6734, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -6.01% (16.1920 => 15.2195, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.96% (0.1796 => 0.1689, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.93% (0.2428 => 0.2284, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -5.83% (0.2160 => 0.2034, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -5.83% (7.0961 => 6.6825, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/ReedSolomon: -5.80% (0.1879 => 0.1770, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.80% (0.9852 => 0.9281, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.77% (0.6484 => 0.6110, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.77% (1.0544 => 0.9936, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.75% (1.3722 => 1.2933, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: -5.71% (0.9179 => 0.8655, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -5.68% (0.1761 => 0.1661, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.57% (4.8802 => 4.6083, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.57% (0.2695 => 0.2545, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.55% (3.5339 => 3.3379, std.dev.: 0.0055) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.53% (6.7716 => 6.3972, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.53% (1.2300 => 1.1620, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.47% (4.8161 => 4.5527, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.47% (4.0323 => 3.8119, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.44% (0.3658 => 0.3459, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -5.44% (0.3255 => 0.3078, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.44% (0.3016 => 0.2852, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.43% (0.3057 => 0.2891, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.43% (0.4515 => 0.4270, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.42% (1.4642 => 1.3848, std.dev.: 0.0067) MultiSource/Benchmarks/nbench/nbench: -5.40% (1.1530 => 1.0907, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.38% (1.6364 => 1.5483, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: -5.37% (0.3406 => 0.3223, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.37% (0.5591 => 0.5291, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.37% (4.5069 => 4.2651, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/except: -5.35% (0.3026 => 0.2864, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -5.34% (1.1450 => 1.0839, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.33% (0.5857 => 0.5545, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -5.32% (1.3148 => 1.2448, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.32% (0.2933 => 0.2777, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.32% (0.5849 => 0.5538, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.29% (0.7339 => 0.6951, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.29% (0.6395 => 0.6057, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.27% (0.6052 => 0.5733, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.27% (0.6189 => 0.5863, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.27% (0.6304 => 0.5972, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.27% (14.2083 => 13.4602, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.26% (0.6230 => 0.5902, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.26% (0.6194 => 0.5868, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: -5.26% (0.2871 => 0.2720, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.25% (0.6681 => 0.6330, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.25% (17.1032 => 16.2059, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout-C++/random: -5.24% (0.2939 => 0.2785, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.24% (0.2903 => 0.2751, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.23% (2.1713 => 2.0578, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -5.22% (0.3025 => 0.2867, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.22% (0.5863 => 0.5557, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.22% (0.7919 => 0.7506, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.21% (0.5705 => 0.5408, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -5.20% (1.3864 => 1.3143, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.19% (0.5802 => 0.5501, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -5.18% (4.3330 => 4.1084, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.18% (0.6676 => 0.6330, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.18% (0.6446 => 0.6112, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.17% (0.7524 => 0.7135, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.17% (0.6736 => 0.6388, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -5.17% (0.3059 => 0.2901, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.16% (0.6297 => 0.5972, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.16% (0.3837 => 0.3639, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.16% (0.6260 => 0.5937, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -5.16% (0.2849 => 0.2702, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.15% (0.5859 => 0.5557, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.15% (0.5478 => 0.5196, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.14% (0.6667 => 0.6324, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.14% (8.0126 => 7.6004, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.14% (0.3931 => 0.3729, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.13% (0.4151 => 0.3938, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.13% (0.8521 => 0.8084, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.13% (0.7198 => 0.6829, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.12% (1.2784 => 1.2130, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.11% (0.5925 => 0.5622, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.11% (0.4916 => 0.4665, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.10% (0.5569 => 0.5285, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: -5.09% (0.3205 => 0.3042, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -5.08% (0.3446 => 0.3271, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.08% (0.5575 => 0.5292, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -5.07% (0.3194 => 0.3032, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.07% (0.5581 => 0.5298, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -5.06% (1.2515 => 1.1882, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.05% (0.5567 => 0.5286, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -5.04% (0.2659 => 0.2525, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.04% (0.6395 => 0.6073, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.03% (0.5999 => 0.5697, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.03% (0.5941 => 0.5642, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.03% (1.2210 => 1.1596, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.02% (0.6660 => 0.6326, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.00% (0.5456 => 0.5183, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -4.99% (0.2985 => 0.2836, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: -4.98% (0.2989 => 0.2840, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.98% (0.5805 => 0.5516, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/18-imp/imp: -4.97% (0.3581 => 0.3403, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.97% (0.2999 => 0.2850, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.95% (0.3252 => 0.3091, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.94% (0.6440 => 0.6122, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.92% (0.2278 => 0.2166, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: -4.92% (0.6347 => 0.6035, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.91% (0.3483 => 0.3312, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.90% (0.5570 => 0.5297, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -4.89% (0.3394 => 0.3228, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.88% (0.3849 => 0.3661, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.86% (0.6033 => 0.5740, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -4.85% (0.3481 => 0.3312, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.83% (0.5688 => 0.5413, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.83% (0.6293 => 0.5989, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -4.82% (3.5154 => 3.3459, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.82% (1.2221 => 1.1632, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: -4.81% (0.4861 => 0.4627, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -4.78% (0.6441 => 0.6133, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -4.77% (15.5079 => 14.7683, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/moments: -4.76% (0.4248 => 0.4046, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -4.74% (0.7779 => 0.7410, std.dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: -4.74% (15.2527 => 14.5297, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/lists1: -4.68% (0.3867 => 0.3686, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -4.67% (0.7447 => 0.7099, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.63% (0.4813 => 0.4590, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.61% (0.5168 => 0.4930, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.57% (0.7021 => 0.6700, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -4.56% (0.3621 => 0.3456, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.55% (0.3319 => 0.3168, std.dev.: 0.0009) MultiSource/Applications/lua/lua: -4.52% (4.0594 => 3.8759, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.51% (0.4083 => 0.3899, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.49% (1.6474 => 1.5734, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.43% (0.4427 => 0.4231, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.41% (0.5329 => 0.5094, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: -4.41% (0.3788 => 0.3621, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -4.37% (2.1401 => 2.0465, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: -4.37% (0.3271 => 0.3128, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.35% (0.9557 => 0.9141, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.30% (22.4056 => 21.4420, std.dev.: 0.0199) MultiSource/Applications/oggenc/oggenc: -4.21% (5.0226 => 4.8110, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -4.19% (0.8418 => 0.8065, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -4.18% (34.0927 => 32.6689, std.dev.: 0.0183) MultiSource/Applications/lambda-0_1_3/lambda: -4.08% (0.7982 => 0.7656, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -4.07% (2.4021 => 2.3043, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.06% (0.3323 => 0.3188, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.90% (0.3491 => 0.3355, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -3.89% (0.4524 => 0.4348, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -3.87% (0.6750 => 0.6489, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -3.86% (1.5610 => 1.5007, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.77% (0.9077 => 0.8735, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.71% (2.2587 => 2.1748, std.dev.: 0.0131) MultiSource/Applications/kimwitu++/kc: -3.66% (18.2933 => 17.6235, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.45% (0.4321 => 0.4172, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.83% (5.4682 => 5.3137, std.dev.: 0.0134) SingleSource/UnitTests/Vector/constpool: -2.62% (20.7746 => 20.2304, std.dev.: 0.0340) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7533, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/richards_benchmark: -8.63% (1.2842 => 1.1734, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7069, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.71% (2.2633 => 2.1794, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.52% (1.3096 => 1.2766, std.dev.: 0.0100) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4711, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.02% (3.2107 => 3.1781, std.dev.: 0.0004) Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 14:01:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 16:01:46 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121113220146.631702A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5834?compare_to=5828&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5834, Order: 167851, Start Time: 2012-11-13 18:45:54, End Time: 2012-11-13 22:01:45 To: 5828, Order: 167830, Start Time: 2012-11-13 14:42:13, End Time: 2012-11-13 17:57:42 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (170 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (721 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.62% (124.5625 => 131.5689, std.dev.: 0.1436) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.26% (2.3142 => 2.2850, std.dev.: 0.0084) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.84% (0.0625 => 0.0874, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.70% (0.1063 => 0.1400, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.31% (0.2969 => 0.3750, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.04% (0.1106 => 0.1394, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.21% (0.0714 => 0.0894, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.60% (0.4139 => 0.5157, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 24.42% (1.5932 => 1.9823, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.03% (0.4253 => 0.5275, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.68% (0.5900 => 0.7297, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.58% (0.0475 => 0.0587, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.48% (0.5000 => 0.6174, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.43% (0.4994 => 0.6164, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.29% (0.0584 => 0.0720, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.59% (0.1620 => 0.1986, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.41% (0.0897 => 0.1098, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.23% (0.1021 => 0.1248, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.86% (0.1107 => 0.1349, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.06% (0.0584 => 0.0707, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.01% (0.0633 => 0.0766, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 20.89% (0.0948 => 0.1146, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.76% (0.1103 => 0.1332, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.63% (0.3903 => 0.4708, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.56% (0.0642 => 0.0774, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.52% (0.0541 => 0.0652, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 20.46% (0.0821 => 0.0989, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.40% (0.0495 => 0.0596, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.40% (0.1549 => 0.1865, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.32% (0.0822 => 0.0989, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.14% (0.1003 => 0.1205, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 20.01% (0.1619 => 0.1943, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.95% (0.1604 => 0.1924, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.36% (0.1462 => 0.1745, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 19.32% (0.0947 => 0.1130, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 19.06% (0.0808 => 0.0962, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.72% (0.2014 => 0.2391, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.71% (0.3890 => 0.4618, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 18.47% (0.1218 => 0.1443, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 18.30% (0.5826 => 0.6892, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 18.29% (0.4029 => 0.4766, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.13% (1.3152 => 1.5536, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 18.07% (0.1505 => 0.1777, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.06% (0.2736 => 0.3230, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/mst/mst: 18.05% (0.0698 => 0.0824, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 18.02% (0.5889 => 0.6950, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.83% (0.1088 => 0.1282, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.83% (0.2866 => 0.3377, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 17.53% (0.5546 => 0.6518, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.29% (3.5627 => 4.1788, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 17.29% (1.8794 => 2.2043, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.28% (0.1968 => 0.2308, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.21% (0.3271 => 0.3834, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 17.19% (0.9697 => 1.1364, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.19% (0.0605 => 0.0709, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.07% (0.4658 => 0.5453, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.02% (1.6211 => 1.8970, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.01% (0.2875 => 0.3364, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 16.68% (0.1421 => 0.1658, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.64% (0.1160 => 0.1353, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 16.52% (1.0781 => 1.2562, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: 16.36% (0.1284 => 0.1494, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.30% (0.4361 => 0.5072, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 16.29% (0.2750 => 0.3198, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 16.26% (0.2725 => 0.3168, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 16.25% (0.2714 => 0.3155, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.22% (0.5026 => 0.5841, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.21% (0.3930 => 0.4567, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.19% (2.7292 => 3.1711, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.18% (0.2738 => 0.3181, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.18% (4.4195 => 5.1345, std.dev.: 0.0043) SingleSource/UnitTests/ObjC++/property-reference: 16.12% (0.7171 => 0.8327, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.09% (0.2729 => 0.3168, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.05% (0.2792 => 0.3240, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 16.02% (0.2803 => 0.3252, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 16.01% (0.2823 => 0.3275, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.97% (0.2911 => 0.3376, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 15.90% (0.2780 => 0.3222, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 15.88% (0.3004 => 0.3481, std.dev.: 0.0077) MultiSource/Benchmarks/Bullet/bullet: 15.86% (23.5202 => 27.2509, std.dev.: 0.0139) MultiSource/Applications/ClamAV/clamscan: 15.86% (4.2109 => 4.8787, std.dev.: 0.0308) MultiSource/Applications/hexxagon/hexxagon: 15.85% (0.9909 => 1.1480, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 15.82% (0.2813 => 0.3258, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 15.80% (0.2811 => 0.3255, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 15.73% (0.3096 => 0.3583, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.60% (2.0673 => 2.3897, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 15.58% (0.3267 => 0.3776, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.56% (0.3195 => 0.3692, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.50% (0.1090 => 0.1259, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 15.41% (0.3258 => 0.3760, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.36% (1.9966 => 2.3032, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 15.33% (0.2075 => 0.2393, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.29% (1.9694 => 2.2705, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.84% (0.3060 => 0.3514, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 14.83% (0.3317 => 0.3809, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.79% (0.3124 => 0.3586, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.69% (0.3362 => 0.3856, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 14.69% (0.2566 => 0.2943, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.59% (0.3282 => 0.3761, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 14.55% (0.3678 => 0.4213, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 14.49% (0.3726 => 0.4266, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.36% (0.3845 => 0.4397, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists1: 14.35% (0.3477 => 0.3976, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists: 14.34% (0.3348 => 0.3828, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 14.30% (1.4269 => 1.6309, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.21% (0.3625 => 0.4140, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 14.21% (0.4146 => 0.4735, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 14.18% (0.4251 => 0.4854, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 14.10% (0.7875 => 0.8985, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/for-in: 14.04% (0.3496 => 0.3987, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 14.02% (0.3446 => 0.3929, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.97% (0.3981 => 0.4537, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.93% (0.3690 => 0.4204, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.91% (0.3465 => 0.3947, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions-3: 13.82% (0.3460 => 0.3938, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.81% (0.3469 => 0.3948, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.77% (0.3442 => 0.3916, std.dev.: 0.0093) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.76% (0.3488 => 0.3968, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.62% (0.3650 => 0.4147, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 13.57% (2.1653 => 2.4591, std.dev.: 0.0099) SingleSource/UnitTests/ObjC/exceptions: 13.51% (0.3643 => 0.4135, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 13.49% (0.5012 => 0.5688, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 13.46% (0.0758 => 0.0860, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 13.41% (2.1013 => 2.3830, std.dev.: 0.0086) MultiSource/Applications/JM/lencod/lencod: 13.38% (4.6177 => 5.2355, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/parameter-passing: 13.32% (0.3724 => 0.4220, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.09% (0.1383 => 0.1564, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.94% (0.2040 => 0.2304, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 12.82% (0.2691 => 0.3036, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 12.26% (5.5417 => 6.2213, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.17% (0.6435 => 0.7218, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.04% (0.2068 => 0.2317, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 11.78% (0.3498 => 0.3910, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 11.33% (0.4847 => 0.5396, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.07% (0.2737 => 0.3040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.02% (0.3084 => 0.3424, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 10.99% (0.6634 => 0.7363, std.dev.: 0.0059) MultiSource/Applications/minisat/minisat: 10.61% (0.3336 => 0.3690, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 10.58% (0.2391 => 0.2644, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.32% (0.2103 => 0.2320, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 10.29% (2.0346 => 2.2439, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.20% (0.5361 => 0.5854, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.17% (11.6398 => 12.7073, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.13% (4.6926 => 5.1210, std.dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.61% (0.5584 => 0.6065, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.48% (0.7426 => 0.8056, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 7.05% (11.9555 => 12.7983, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.64% (0.3792 => 0.3968, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 9.39% (0.2802 => 0.3065, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6106, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6727, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1680, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-2: 4.67% (1.8057 => 1.8901, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/dry: 4.07% (14.0481 => 14.6205, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1963, std.dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.48% (3.1722 => 3.2192, std.dev.: 0.0022) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3036, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2865, std.dev.: 0.0040) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5127, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5971, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5660, std.dev.: 0.0132) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9752, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7977, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/ary2: -5.54% (0.2402 => 0.2269, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8042, std.dev.: 0.0088) MultiSource/Applications/siod/siod: -3.04% (6.9842 => 6.7721, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -2.93% (17.2379 => 16.7329, std.dev.: 0.0514) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8577, std.dev.: 0.0100) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.05% (0.6293 => 0.6164, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5766, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4955, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.09% (105.3826 => 104.2380, std.dev.: 0.0657) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0438, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 14:35:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 16:35:44 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121113223544.51AF02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5835?compare_to=5830&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5835, Order: 167864, Start Time: 2012-11-13 20:24:08, End Time: 2012-11-13 22:35:53 To: 5830, Order: 167846, Start Time: 2012-11-13 17:22:35, End Time: 2012-11-13 19:33:22 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 54 (166 on baseline) Performance Improvements: 3 (40 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 981 (681 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.46% (0.4575 => 0.5328, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.69% (0.1173 => 0.1357, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/messages-2: 15.50% (0.0774 => 0.0894, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.02% (0.0832 => 0.0957, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 14.49% (0.6213 => 0.7113, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.44% (0.3145 => 0.3599, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.19% (0.5999 => 0.6850, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/richards_benchmark: 14.03% (0.0898 => 0.1024, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 13.75% (0.7295 => 0.8298, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ackermann: 13.16% (0.3008 => 0.3404, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.91% (0.5800 => 0.6549, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.51% (0.3764 => 0.4235, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.37% (0.3573 => 0.4015, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 12.23% (0.3337 => 0.3745, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.22% (0.2414 => 0.2709, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/except: 12.17% (0.3147 => 0.3530, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 11.91% (2.5972 => 2.9066, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 11.86% (0.6314 => 0.7063, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.61% (0.4064 => 0.4536, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/em3d/em3d: 11.02% (0.1969 => 0.2186, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.09% (0.3171 => 0.3491, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.78% (1.5150 => 1.6632, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/lists1: 9.63% (0.4072 => 0.4464, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.52% (0.2668 => 0.2922, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/tsp/tsp: 9.39% (0.1417 => 0.1550, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.36% (0.4190 => 0.4582, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.12% (0.2214 => 0.2416, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.95% (0.3957 => 0.4311, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.30% (0.6357 => 0.6821, std.dev.: 0.0136) MultiSource/Benchmarks/sim/sim: 6.47% (0.3893 => 0.4145, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/salsa20: 4.82% (0.2095 => 0.2196, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.77% (4.5721 => 4.7901, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.40% (0.7008 => 0.7246, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.35% (0.6897 => 0.7128, std.dev.: 0.0075) MultiSource/Applications/oggenc/oggenc: 2.01% (7.0062 => 7.1469, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 1.68% (21.1095 => 21.4644, std.dev.: 0.0644) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.10% (17.4116 => 17.6039, std.dev.: 0.0497) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: 79.06% (0.1046 => 0.1873, std.dev.: 0.0243) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 38.17% (0.3453 => 0.4771, std.dev.: 0.0044) MultiSource/Applications/JM/ldecod/ldecod: 22.26% (0.1213 => 0.1483, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/ary3: 12.51% (4.2899 => 4.8264, std.dev.: 0.0694) SingleSource/Benchmarks/Shootout/heapsort: 11.85% (4.0178 => 4.4940, std.dev.: 0.0301) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.09% (0.5783 => 0.6251, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/ffbench: 7.34% (0.9934 => 1.0663, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/bh/bh: 6.94% (1.9683 => 2.1049, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.90% (4.1944 => 4.4837, std.dev.: 0.0273) SingleSource/Benchmarks/Shootout/strcat: 6.32% (0.1931 => 0.2053, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 4.10% (14.8301 => 15.4383, std.dev.: 0.0957) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.56% (4.3592 => 4.4707, std.dev.: 0.0189) MultiSource/Benchmarks/NPB-serial/is/is: 1.94% (8.6703 => 8.8384, std.dev.: 0.0445) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.87% (9.2929 => 9.4668, std.dev.: 0.0425) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.73% (9.5798 => 9.7458, std.dev.: 0.0409) MultiSource/Applications/lua/lua: 1.60% (27.0517 => 27.4834, std.dev.: 0.0477) MultiSource/Applications/JM/lencod/lencod: 1.42% (7.9290 => 8.0419, std.dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: -7.87% (0.4219 => 0.3887, std.dev.: 0.0083) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: -18.31% (0.0934 => 0.0763, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash2: -1.09% (3.4266 => 3.3893, std.dev.: 0.0124) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.07% (0.1338 => 0.1337, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -12.68% (0.0481 => 0.0420, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.41% (0.0674 => 0.0651, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -0.07% (494.2856 => 493.9536, std.dev.: 0.2555) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/power/power: 43701.86% (1.1277 => 493.9536, std.dev.: 0.2555) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 209.28% (0.5229 => 1.6172, std.dev.: 0.0734) MultiSource/Applications/SPASS/SPASS: 21.43% (14.9895 => 18.2014, std.dev.: 0.1032) MultiSource/Applications/kimwitu++/kc: 51.64% (14.1553 => 21.4644, std.dev.: 0.0644) MultiSource/Benchmarks/MallocBench/gs/gs: 25.11% (4.1105 => 5.1426, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 50.54% (1.1048 => 1.6632, std.dev.: 0.0116) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 436.21% (7.1582 => 38.3830, std.dev.: 0.0588) SingleSource/Benchmarks/Misc-C++-EH/spirit: 87.35% (3.4629 => 6.4878, std.dev.: 0.1053) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.91% (0.6222 => 1.0385, std.dev.: 0.0062) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11069.31% (0.0720 => 8.0419, std.dev.: 0.0056) MultiSource/Applications/SIBsim4/SIBsim4: 3904300.00% (0.0001 => 3.9044, std.dev.: 0.0127) MultiSource/Applications/SPASS/SPASS: 15438200.00% (0.0001 => 15.4383, std.dev.: 0.0957) MultiSource/Applications/kimwitu++/kc: 53300.00% (0.0001 => 0.0534, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 64100.00% (0.0001 => 0.0642, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14500.00% (0.0001 => 0.0146, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 625000.00% (0.0001 => 0.6251, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10089800.00% (0.0001 => 10.0899, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6691800.00% (0.0001 => 6.6919, std.dev.: 0.2831) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1815.10% (1.1194 => 21.4376, std.dev.: 0.1116) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 65.32% (2.9384 => 4.8577, std.dev.: 0.1672) MultiSource/Applications/ClamAV/clamscan: 61.59% (22.1758 => 35.8331, std.dev.: 0.1828) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 58.97% (7.0540 => 11.2135, std.dev.: 0.0532) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 52.02% (8.1363 => 12.3691, std.dev.: 0.0848) MultiSource/Applications/JM/lencod/lencod: 48.12% (21.9371 => 32.4929, std.dev.: 0.0387) SingleSource/UnitTests/vla: 45.07% (0.0355 => 0.0515, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 44.79% (0.1056 => 0.1529, std.dev.: 0.0109) SingleSource/Benchmarks/BenchmarkGame/n-body: 41.82% (0.0746 => 0.1058, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 39.04% (0.0730 => 0.1015, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: 38.34% (0.1432 => 0.1981, std.dev.: 0.0060) SingleSource/UnitTests/block-byref-cxxobj-test: 37.83% (0.0267 => 0.0368, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/messages-2: 35.05% (0.0662 => 0.0894, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 32.79% (0.0793 => 0.1053, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/17-bintr/bintr: 32.44% (0.0675 => 0.0894, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 31.97% (2.2024 => 2.9066, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/tsp/tsp: 31.91% (0.1175 => 0.1550, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 31.29% (0.0326 => 0.0428, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.10% (0.0730 => 0.0957, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/messages: 30.89% (0.0327 => 0.0428, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 29.98% (0.1044 => 0.1357, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/family/family: 29.97% (0.0397 => 0.0516, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 29.86% (0.4103 => 0.5328, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/em3d/em3d: 28.97% (0.1695 => 0.2186, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 28.91% (0.0626 => 0.0807, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/hash: 28.87% (0.0485 => 0.0625, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 28.64% (0.3121 => 0.4015, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 28.57% (0.2107 => 0.2709, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 28.53% (0.6456 => 0.8298, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.29% (0.5105 => 0.6549, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/wordfreq: 28.06% (0.3307 => 0.4235, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: 27.86% (0.0481 => 0.0615, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.46% (0.0528 => 0.0673, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/FloatMM: 27.43% (0.0401 => 0.0511, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 27.23% (0.0672 => 0.0855, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 26.58% (0.2758 => 0.3491, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/heapsort: 25.31% (0.2872 => 0.3599, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash: 24.81% (0.4289 => 0.5353, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/matrix: 24.57% (0.0818 => 0.1019, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 24.43% (0.0479 => 0.0596, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 24.27% (0.3650 => 0.4536, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Oscar: 24.21% (0.0636 => 0.0790, std.dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: 24.10% (5.7591 => 7.1469, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.07% (0.1566 => 0.1943, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/ackermann: 23.51% (0.2756 => 0.3404, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 23.32% (0.6450 => 0.7954, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/perlin: 23.13% (0.0536 => 0.0660, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 23.07% (3.8922 => 4.7901, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/except: 22.95% (0.2871 => 0.3530, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/fibo: 22.94% (0.2725 => 0.3350, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/wc: 22.71% (0.3052 => 0.3745, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 22.53% (14.3668 => 17.6039, std.dev.: 0.0497) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 22.48% (0.5569 => 0.6821, std.dev.: 0.0136) MultiSource/Benchmarks/sim/sim: 22.38% (0.3387 => 0.4145, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/instance-method-metadata: 21.68% (0.3543 => 0.4311, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/lists1: 21.17% (0.3684 => 0.4464, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 21.15% (0.5981 => 0.7246, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/espresso/espresso: 20.86% (4.2646 => 5.1543, std.dev.: 0.0297) MultiSource/Applications/lua/lua: 20.27% (3.8723 => 4.6572, std.dev.: 0.0778) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 20.25% (0.2430 => 0.2922, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.19% (0.0842 => 0.1012, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 19.76% (0.3826 => 0.4582, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.41% (4.9449 => 5.9047, std.dev.: 0.0227) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.23% (5.0018 => 5.9635, std.dev.: 0.0118) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.07% (0.2700 => 0.3215, std.dev.: 0.0187) MultiSource/Benchmarks/mafft/pairlocalalign: 18.87% (9.4845 => 11.2746, std.dev.: 0.1195) SingleSource/UnitTests/ObjC/parameter-passing: 18.84% (0.3927 => 0.4667, std.dev.: 0.0100) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.49% (0.1125 => 0.1333, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.45% (1.4186 => 1.6804, std.dev.: 0.0405) SingleSource/Benchmarks/Shootout-C++/hash2: 18.23% (0.4620 => 0.5462, std.dev.: 0.0175) MultiSource/Applications/d/make_dparser: 17.87% (3.3354 => 3.9313, std.dev.: 0.0916) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 17.86% (0.2603 => 0.3068, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.45% (0.8067 => 0.9475, std.dev.: 0.0325) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.36% (0.8172 => 0.9591, std.dev.: 0.0341) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 17.17% (0.2271 => 0.2661, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.11% (0.0871 => 0.1020, std.dev.: 0.0046) MultiSource/Applications/sqlite3/sqlite3: 17.04% (17.1811 => 20.1085, std.dev.: 0.1626) SingleSource/Benchmarks/Misc/ffbench: 16.74% (0.0705 => 0.0823, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.31% (0.0834 => 0.0970, std.dev.: 0.0037) MultiSource/Applications/treecc/treecc: 16.12% (2.0273 => 2.3540, std.dev.: 0.1009) MultiSource/Applications/spiff/spiff: 16.08% (0.7835 => 0.9095, std.dev.: 0.0469) MultiSource/Benchmarks/Olden/mst/mst: 15.82% (0.1163 => 0.1347, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.74% (0.0648 => 0.0750, std.dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.74% (0.0953 => 0.1103, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.74% (0.2065 => 0.2390, std.dev.: 0.0111) MultiSource/Benchmarks/nbench/nbench: 15.51% (1.1840 => 1.3676, std.dev.: 0.0618) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.35% (0.0886 => 0.1022, std.dev.: 0.0052) MultiSource/Applications/viterbi/viterbi: 14.92% (0.1555 => 0.1787, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.81% (0.0770 => 0.0884, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/ReedSolomon: 14.79% (0.2049 => 0.2352, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.68% (0.1117 => 0.1281, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 14.49% (63.2438 => 72.4062, std.dev.: 0.1472) MultiSource/Applications/Burg/burg: 14.42% (1.1642 => 1.3321, std.dev.: 0.0621) MultiSource/Applications/hexxagon/hexxagon: 14.37% (1.2842 => 1.4687, std.dev.: 0.0417) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.36% (0.1337 => 0.1529, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.02% (0.4615 => 0.5262, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.61% (0.9765 => 1.1094, std.dev.: 0.0412) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.57% (1.5415 => 1.7507, std.dev.: 0.0808) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.57% (0.5860 => 0.6655, std.dev.: 0.0139) SingleSource/Benchmarks/McGill/chomp: 13.41% (0.1655 => 0.1877, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 13.41% (0.3423 => 0.3882, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.34% (0.3441 => 0.3900, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.93% (1.5859 => 1.7909, std.dev.: 0.0227) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.80% (1.3050 => 1.4721, std.dev.: 0.0476) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.21% (0.5020 => 0.5633, std.dev.: 0.0213) MultiSource/Benchmarks/McCat/09-vor/vor: 11.98% (0.3180 => 0.3561, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/trivial-interface: 11.92% (0.3473 => 0.3887, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.80% (0.1695 => 0.1895, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.71% (0.3561 => 0.3978, std.dev.: 0.0142) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.09% (0.0929 => 0.1032, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.80% (0.1143 => 0.1255, std.dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: 9.80% (10.3673 => 11.3830, std.dev.: 0.1455) SingleSource/Benchmarks/Shootout-C++/ary2: 9.65% (0.3379 => 0.3705, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 9.64% (0.5925 => 0.6496, std.dev.: 0.0088) SingleSource/Regression/C++/ofstream_ctor: 9.54% (0.2905 => 0.3182, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary3: 9.38% (0.3283 => 0.3591, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.10% (2.2022 => 2.4025, std.dev.: 0.0353) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.62% (0.2266 => 0.2416, std.dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.18% (7.9617 => 8.4537, std.dev.: 0.0294) SingleSource/UnitTests/Vector/constpool: 2.59% (54.1659 => 55.5706, std.dev.: 0.4680) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.73% (4.3953 => 11.0204, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/methcall: 147.63% (5.3999 => 13.3719, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/17-bintr/bintr: 79.58% (0.1043 => 0.1873, std.dev.: 0.0243) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 46.53% (0.3256 => 0.4771, std.dev.: 0.0044) MultiSource/Benchmarks/llubenchmark/llu: 43.77% (3.7781 => 5.4317, std.dev.: 0.4029) SingleSource/Benchmarks/Shootout/ary3: 30.46% (3.6994 => 4.8264, std.dev.: 0.0694) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 28.17% (13.4384 => 17.2236, std.dev.: 0.3579) MultiSource/Applications/minisat/minisat: 22.14% (9.1159 => 11.1344, std.dev.: 0.3016) SingleSource/Benchmarks/Misc/oourafft: 17.56% (6.6465 => 7.8138, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.05% (1.1145 => 1.3045, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/heapsort: 16.65% (3.8526 => 4.4940, std.dev.: 0.0301) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.36% (3.8532 => 4.4837, std.dev.: 0.0273) MultiSource/Applications/JM/ldecod/ldecod: 14.25% (0.1298 => 0.1483, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.11% (0.2944 => 0.3330, std.dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.28% (8.6802 => 9.7458, std.dev.: 0.0409) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.27% (10.3460 => 11.6155, std.dev.: 0.2592) SingleSource/Benchmarks/Misc/ffbench: 12.18% (0.9505 => 1.0663, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.70% (2.8904 => 3.2287, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 10.27% (1.1396 => 1.2566, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.30% (1.7254 => 1.8858, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 8.61% (0.7455 => 0.8097, std.dev.: 0.0180) MultiSource/Benchmarks/Olden/bh/bh: 8.47% (1.9405 => 2.1049, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout/strcat: 8.11% (0.1899 => 0.2053, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: 7.33% (3.1578 => 3.3893, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.10% (4.2280 => 4.4859, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 5.33% (26.0924 => 27.4834, std.dev.: 0.0477) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 4.29% (1.3045 => 1.3604, std.dev.: 0.0153) MultiSource/Benchmarks/nbench/nbench: 4.10% (11.6436 => 12.1206, std.dev.: 0.0098) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: 2.91% (2.4116 => 2.4818, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.51% (1.7133 => 1.7563, std.dev.: 0.0164) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.43% (2.1424 => 2.1945, std.dev.: 0.0177) MultiSource/Benchmarks/PAQ8p/paq8p: 2.30% (85.0658 => 87.0262, std.dev.: 0.0431) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.15% (1.3677 => 1.3971, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 2.10% (3.1595 => 3.2258, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.57% (27.8444 => 28.2817, std.dev.: 0.0081) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.46% (6.5088 => 6.6037, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/sieve: 1.37% (5.2139 => 5.2855, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0313 => 1.0441, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.20% (12.5348 => 12.6854, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0503) MultiSource/Benchmarks/Olden/em3d/em3d: 1.01% (3.1023 => 3.1335, std.dev.: 0.0084) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1669, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.50% (5.2763 => 1.2926, std.dev.: 0.0233) SingleSource/Benchmarks/Misc/salsa20: -74.62% (0.8651 => 0.2196, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: -36.87% (0.1622 => 0.1024, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.99% (5.3526 => 4.9247, std.dev.: 0.0561) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.26% (5.3855 => 4.9943, std.dev.: 0.0356) MultiSource/Applications/JM/ldecod/ldecod: -6.15% (10.4361 => 9.7948, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -47.50% (0.0400 => 0.0210, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.88% (0.3987 => 0.2397, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.72% (0.0506 => 0.0305, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.29% (4.5009 => 2.7774, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7636, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.12% (2.6546 => 2.0144, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -21.31% (10.7105 => 8.4278, std.dev.: 0.1661) MultiSource/Benchmarks/FreeBench/mason/mason: -19.20% (0.2161 => 0.1746, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.80% (1.6925 => 1.4251, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2839, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.68% (32.5116 => 29.0391, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4244, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -7.58% (9.5636 => 8.8384, std.dev.: 0.0445) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4791, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.79% (3.2416 => 3.0216, std.dev.: 0.0149) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.37% (19.9488 => 18.6789, std.dev.: 0.3557) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.54% (2.7294 => 2.5781, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: -4.80% (1.5835 => 1.5075, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.40% (1.6805 => 1.6065, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout/lists: -4.19% (6.2999 => 6.0361, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.09% (0.9957 => 0.9649, std.dev.: 0.0059) MultiSource/Benchmarks/sim/sim: -3.04% (5.0483 => 4.8947, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.29% (0.4808 => 0.4698, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.84% (8.1563 => 8.0066, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6774, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -1.47% (10.2830 => 10.1321, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.97% (0.1485 => 0.1337, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0013) Report Time: 3.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 15:13:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 17:13:32 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121113231332.7AC892A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5836?compare_to=5833&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5836, Order: 167872, Start Time: 2012-11-13 21:48:14, End Time: 2012-11-13 23:13:43 To: 5833, Order: 167864, Start Time: 2012-11-13 19:59:27, End Time: 2012-11-13 21:24:36 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (180 on baseline) Unchanged Tests: 1041 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.57% (1.2766 => 1.2966, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1012, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/salsa20: 2.38% (7.4937 => 7.6720, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/hash2: 2.06% (3.1932 => 3.2590, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.39% (0.1431 => 0.1311, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.51% (0.3821 => 0.3534, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -7.40% (0.3812 => 0.3530, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -7.31% (0.3831 => 0.3551, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -7.30% (0.3848 => 0.3567, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.21% (0.3884 => 0.3604, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.20% (0.3891 => 0.3611, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions-4: -7.19% (0.3880 => 0.3601, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -7.11% (0.3896 => 0.3619, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -7.04% (0.4176 => 0.3882, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -6.99% (0.4033 => 0.3751, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -6.79% (0.4199 => 0.3914, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.64% (0.3357 => 0.3134, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.56% (0.9542 => 0.8916, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -6.44% (2.4924 => 2.3320, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.43% (0.3142 => 0.2940, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -6.31% (0.4280 => 0.4010, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -6.08% (9.2283 => 8.6674, std.dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: -6.04% (16.1920 => 15.2138, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.01% (0.1796 => 0.1688, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: -5.97% (0.2160 => 0.2031, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.97% (0.6484 => 0.6097, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.96% (0.9852 => 0.9265, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.89% (0.2428 => 0.2285, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.86% (0.2355 => 0.2217, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -5.85% (0.1879 => 0.1769, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: -5.85% (7.0961 => 6.6807, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.84% (1.3722 => 1.2921, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.84% (0.3016 => 0.2840, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -5.77% (0.9179 => 0.8649, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/matrix: -5.75% (0.3255 => 0.3068, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.74% (0.1761 => 0.1660, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.72% (0.3057 => 0.2882, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.72% (6.7716 => 6.3840, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.72% (4.0323 => 3.8017, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.71% (0.2695 => 0.2541, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.71% (0.7198 => 0.6787, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.69% (0.3658 => 0.3450, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.66% (4.8802 => 4.6039, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.66% (0.2933 => 0.2767, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.63% (3.5339 => 3.3351, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: -5.62% (0.3025 => 0.2855, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -5.62% (0.3026 => 0.2856, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -5.62% (0.2849 => 0.2689, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.61% (0.2903 => 0.2740, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.61% (0.2871 => 0.2710, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.60% (0.6736 => 0.6359, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/random: -5.58% (0.2939 => 0.2775, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.57% (1.6364 => 1.5452, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.57% (1.2300 => 1.1615, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.56% (4.8161 => 4.5481, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.54% (1.0544 => 0.9960, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: -5.54% (0.4515 => 0.4265, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.53% (1.4642 => 1.3832, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/Hello: -5.53% (0.6347 => 0.5996, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.53% (0.3837 => 0.3625, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.51% (0.5478 => 0.5176, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: -5.51% (0.3194 => 0.3018, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.47% (2.1713 => 2.0525, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -5.47% (1.3148 => 1.2429, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.46% (0.3406 => 0.3220, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -5.46% (0.3059 => 0.2892, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -5.43% (0.2985 => 0.2823, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: -5.43% (0.3446 => 0.3259, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.42% (4.5069 => 4.2626, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/strcat: -5.42% (0.2989 => 0.2827, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.42% (0.3931 => 0.3718, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wc: -5.40% (0.3205 => 0.3032, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.40% (0.5857 => 0.5541, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -5.39% (1.1450 => 1.0833, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.38% (0.5591 => 0.5290, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.37% (0.6293 => 0.5955, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.37% (0.5849 => 0.5535, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.36% (0.6189 => 0.5857, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.36% (14.2083 => 13.4463, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.35% (0.6395 => 0.6053, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.35% (0.6230 => 0.5897, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: -5.34% (0.6441 => 0.6097, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.32% (0.3252 => 0.3079, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.31% (0.5802 => 0.5494, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.30% (0.6194 => 0.5866, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.29% (0.5863 => 0.5553, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -5.28% (17.1032 => 16.1995, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: -5.28% (0.7779 => 0.7368, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.28% (0.6304 => 0.5971, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.28% (0.7524 => 0.7127, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -5.27% (0.3394 => 0.3215, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.27% (0.6052 => 0.5733, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.27% (0.6681 => 0.6329, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.26% (0.8521 => 0.8073, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.24% (0.6676 => 0.6326, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.24% (8.0126 => 7.5926, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.24% (0.6260 => 0.5932, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.24% (0.5805 => 0.5501, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.23% (0.6446 => 0.6109, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.21% (0.6660 => 0.6313, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.20% (0.5925 => 0.5617, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.19% (0.6297 => 0.5970, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -5.19% (0.2659 => 0.2521, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: -5.19% (1.1530 => 1.0932, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.18% (1.2210 => 1.1577, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: -5.18% (1.3864 => 1.3146, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.18% (0.5581 => 0.5292, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.17% (0.5859 => 0.5556, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.17% (0.5569 => 0.5281, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.17% (0.3849 => 0.3650, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.16% (1.2784 => 1.2124, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.16% (0.6667 => 0.6323, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.15% (0.5999 => 0.5690, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.15% (0.7339 => 0.6961, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.15% (0.5575 => 0.5288, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.14% (0.2278 => 0.2161, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.13% (0.4151 => 0.3938, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.12% (0.5705 => 0.5413, std.dev.: 0.0095) MultiSource/Applications/Burg/burg: -5.11% (1.2515 => 1.1875, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: -5.11% (0.3581 => 0.3398, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.10% (0.5456 => 0.5178, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.09% (0.4916 => 0.4666, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -5.06% (0.3481 => 0.3305, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -5.03% (4.3330 => 4.1150, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.03% (0.5567 => 0.5287, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.03% (0.7919 => 0.7521, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.02% (0.2548 => 0.2420, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.01% (0.5570 => 0.5291, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -5.00% (0.4861 => 0.4618, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.00% (0.3483 => 0.3309, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.99% (0.2385 => 0.2266, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: -4.97% (0.3867 => 0.3675, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.95% (0.6440 => 0.6121, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.95% (1.2221 => 1.1616, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.93% (0.2999 => 0.2851, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: -4.93% (3.5154 => 3.3422, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.92% (0.6033 => 0.5736, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -4.92% (0.4248 => 0.4039, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -4.92% (0.3621 => 0.3443, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.91% (0.5688 => 0.5409, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.88% (0.5941 => 0.5651, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.88% (0.6395 => 0.6083, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: -4.83% (15.5079 => 14.7588, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.80% (0.4083 => 0.3887, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -4.78% (15.2527 => 14.5232, std.dev.: 0.0193) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.78% (0.5168 => 0.4921, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.74% (0.4427 => 0.4217, std.dev.: 0.0007) MultiSource/Applications/lua/lua: -4.73% (4.0594 => 3.8674, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.70% (0.3319 => 0.3163, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: -4.70% (0.3788 => 0.3610, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.69% (0.7447 => 0.7098, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.63% (0.7021 => 0.6696, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.61% (1.6474 => 1.5715, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -4.55% (34.0927 => 32.5416, std.dev.: 0.0610) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.48% (0.5329 => 0.5090, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -4.46% (2.1401 => 2.0447, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.46% (0.9557 => 0.9131, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: -4.43% (0.3271 => 0.3126, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.38% (0.4813 => 0.4602, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.35% (22.4056 => 21.4302, std.dev.: 0.0163) MultiSource/Applications/oggenc/oggenc: -4.33% (5.0226 => 4.8053, std.dev.: 0.0062) MultiSource/Applications/spiff/spiff: -4.29% (0.8418 => 0.8057, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.27% (0.3323 => 0.3181, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -4.20% (0.4524 => 0.4334, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.19% (0.9077 => 0.8697, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: -4.17% (0.7982 => 0.7649, std.dev.: 0.0016) MultiSource/Applications/siod/siod: -4.10% (2.4021 => 2.3036, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: -4.09% (0.6750 => 0.6474, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: -3.96% (1.5610 => 1.4992, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.95% (0.3491 => 0.3353, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -3.93% (18.2933 => 17.5741, std.dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.76% (2.2587 => 2.1737, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.56% (0.4321 => 0.4167, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.94% (5.4682 => 5.3073, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -2.42% (20.7746 => 20.2717, std.dev.: 0.0181) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7567, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: -8.63% (1.2842 => 1.1734, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.76% (2.2633 => 2.1781, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4682, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 16:41:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 18:41:24 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121114004124.8D5852A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5837?compare_to=5832&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5837, Order: 167881, Start Time: 2012-11-13 23:14:37, End Time: 2012-11-14 00:41:41 To: 5832, Order: 167856, Start Time: 2012-11-13 19:33:48, End Time: 2012-11-13 21:01:04 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 11 (121 on baseline) Performance Improvements: 6 (27 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 975 (826 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.29% (0.8820 => 0.8934, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 12.08% (3.3910 => 3.8008, std.dev.: 0.0941) SingleSource/Benchmarks/CoyoteBench/lpbench: 6.25% (3.8895 => 4.1324, std.dev.: 0.0311) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.17% (0.3223 => 0.3422, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.04% (13.0486 => 13.4447, std.dev.: 0.1224) SingleSource/Benchmarks/Shootout/ary3: 2.98% (2.0898 => 2.1520, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.29% (21.7814 => 22.2806, std.dev.: 0.1830) SingleSource/Benchmarks/Shootout-C++/ary3: 2.18% (1.9996 => 2.0431, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/flops-3: 1.75% (2.0389 => 2.0746, std.dev.: 0.0094) SingleSource/Benchmarks/Dhrystone/fldry: 1.75% (0.6856 => 0.6976, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/fibo: 1.38% (4.3044 => 4.3639, std.dev.: 0.0091) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.58% (8.7155 => 8.4032, std.dev.: 0.0958) MultiSource/Applications/hbd/hbd: -1.89% (1.5066 => 1.4781, std.dev.: 0.0092) MultiSource/Applications/lambda-0_1_3/lambda: -1.31% (0.7786 => 0.7684, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -5.88% (2.4005 => 2.2594, std.dev.: 0.0524) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.78% (2.4441 => 2.3761, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.20% (2.8000 => 2.7663, std.dev.: 0.0037) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.15% (16.8665 => 16.8405, std.dev.: 0.0821) MultiSource/Applications/obsequi/Obsequi: -0.14% (1.0732 => 1.0717, std.dev.: 0.0074) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.67% (22.0693 => 22.2163, std.dev.: 0.4043) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (0.3677 => 0.3721, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/bigfib: -1.56% (0.6211 => 0.6114, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.69% (0.3355 => 0.3378, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 0.49% (0.2022 => 0.2032, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.25% (0.0222 => 0.0217, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0431 => 0.0430, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.60% (0.0336 => 0.0334, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.63% (0.0316 => 0.0318, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0425 => 0.0427, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 0.98% (0.0205 => 0.0207, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/test1: 14.74% (0.0190 => 0.0218, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.27% (0.1486 => 0.1490, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -5.89% (1.1415 => 1.0743, std.dev.: 0.0444) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.06% (0.4158 => 0.4202, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.22% (0.1393 => 0.1410, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.68% (0.0656 => 0.0645, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 29.86% (0.0211 => 0.0274, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.77% (0.0537 => 0.0568, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.32% (1.2006 => 1.1968, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 72.22% (0.0018 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 285.71% (0.0007 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.47% (0.0642 => 0.0645, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.47% (0.0236 => 0.0256, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.09% (0.7799 => 0.7792, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -57.61% (0.0092 => 0.0039, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2310.90% (0.6332 => 15.2658, std.dev.: 0.0743) MultiSource/Benchmarks/McCat/08-main/main: 47.46% (0.1831 => 0.2700, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.16% (0.1559 => 0.1463, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1527.78% (0.3344 => 5.4433, std.dev.: 0.1171) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.48% (0.2364 => 0.3250, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel: 1.63% (0.0429 => 0.0436, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.34% (0.0224 => 0.0227, std.dev.: 0.0008) SingleSource/UnitTests/byval-alignment: -25.65% (0.0230 => 0.0171, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 12.31% (0.1462 => 0.1642, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4654, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0703, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4902, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3249, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1303, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4059, std.dev.: 0.0028) SingleSource/Regression/C/uint64_to_float: -23.86% (2.1832 => 1.6623, std.dev.: 0.0060) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 12.84% (0.0810 => 0.0914, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.91% (0.0848 => 0.0949, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 9.80% (0.1112 => 0.1221, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.13% (0.2279 => 0.2487, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.30% (0.7473 => 0.8093, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.29% (0.4847 => 0.5249, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.95% (0.3137 => 0.3355, std.dev.: 0.0057) MultiSource/Applications/viterbi/viterbi: 6.66% (0.1577 => 0.1682, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.35% (0.1905 => 0.2026, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.01% (0.6010 => 0.6371, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.90% (0.2998 => 0.3175, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.67% (0.9435 => 0.9970, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.44% (0.8148 => 0.8591, std.dev.: 0.0088) MultiSource/Applications/Burg/burg: 5.38% (1.2222 => 1.2880, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.13% (0.2240 => 0.2355, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.12% (1.1606 => 1.2200, std.dev.: 0.0061) MultiSource/Applications/spiff/spiff: 5.04% (0.7950 => 0.8351, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.88% (0.2133 => 0.2237, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.78% (0.5817 => 0.6095, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.77% (0.6287 => 0.6587, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.67% (0.3295 => 0.3449, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.33% (0.3003 => 0.3133, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.10% (0.3657 => 0.3807, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.09% (0.2519 => 0.2622, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sieve: 3.92% (0.2755 => 0.2863, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.90% (0.6227 => 0.6470, std.dev.: 0.0093) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.89% (6.6074 => 6.8641, std.dev.: 0.0382) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.85% (0.3115 => 0.3235, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 3.83% (3.8189 => 3.9650, std.dev.: 0.0116) MultiSource/Applications/SPASS/SPASS: 3.67% (14.2605 => 14.7843, std.dev.: 0.0607) SingleSource/Benchmarks/Shootout-C++/lists1: 3.64% (0.2969 => 0.3077, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.63% (0.4127 => 0.4277, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.59% (0.5961 => 0.6175, std.dev.: 0.0076) MultiSource/Applications/hbd/hbd: 3.59% (1.4269 => 1.4781, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.35% (1.3279 => 1.3724, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.21% (0.8656 => 0.8934, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 3.14% (1.2568 => 1.2963, std.dev.: 0.0111) MultiSource/Benchmarks/sim/sim: 3.13% (0.3226 => 0.3327, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.01% (0.4559 => 0.4696, std.dev.: 0.0032) MultiSource/Applications/treecc/treecc: 3.00% (1.9948 => 2.0546, std.dev.: 0.0223) MultiSource/Applications/minisat/minisat: 2.94% (0.6834 => 0.7035, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.88% (0.8712 => 0.8963, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/gs/gs: 2.87% (4.1305 => 4.2490, std.dev.: 0.0418) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.84% (1.1170 => 1.1487, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.82% (4.1763 => 4.2942, std.dev.: 0.0300) MultiSource/Applications/d/make_dparser: 2.82% (3.2366 => 3.3278, std.dev.: 0.0241) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.79% (0.8340 => 0.8573, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.79% (0.5191 => 0.5336, std.dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: 2.78% (2.3764 => 2.4424, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.75% (1.4479 => 1.4877, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.73% (3.1832 => 3.2700, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.72% (0.8331 => 0.8558, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.72% (0.3717 => 0.3818, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.68% (0.9074 => 0.9317, std.dev.: 0.0075) MultiSource/Applications/ClamAV/clamscan: 2.67% (14.7684 => 15.1625, std.dev.: 0.1309) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.62% (0.8359 => 0.8578, std.dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: 2.60% (31.8598 => 32.6887, std.dev.: 0.2017) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.54% (0.8338 => 0.8550, std.dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 2.52% (0.9810 => 1.0057, std.dev.: 0.0043) MultiSource/Applications/JM/ldecod/ldecod: 2.45% (6.7320 => 6.8966, std.dev.: 0.0579) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.44% (4.4873 => 4.5970, std.dev.: 0.0337) MultiSource/Applications/siod/siod: 2.42% (2.2184 => 2.2720, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.41% (0.8286 => 0.8486, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.40% (0.8317 => 0.8517, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.39% (0.8069 => 0.8262, std.dev.: 0.0064) MultiSource/Applications/JM/lencod/lencod: 2.37% (15.3280 => 15.6908, std.dev.: 0.1347) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.36% (0.8261 => 0.8456, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.35% (13.1811 => 13.4907, std.dev.: 0.0493) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.28% (0.8855 => 0.9057, std.dev.: 0.0076) MultiSource/Applications/oggenc/oggenc: 2.20% (4.9628 => 5.0719, std.dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.19% (0.6586 => 0.6730, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.18% (0.8086 => 0.8262, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.03% (4.4880 => 4.5792, std.dev.: 0.0259) MultiSource/Applications/lemon/lemon: 1.86% (1.0945 => 1.1149, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.86% (0.8885 => 0.9050, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.85% (0.8048 => 0.8197, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.85% (0.8177 => 0.8328, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.77% (4.5702 => 4.6510, std.dev.: 0.0261) MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (0.7557 => 0.7684, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.65% (0.8995 => 0.9143, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.60% (0.8066 => 0.8195, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.82% (1.5795 => 2.5085, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/heapsort: 24.56% (3.0515 => 3.8008, std.dev.: 0.0941) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.52% (0.7597 => 0.8852, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.45% (2.9753 => 3.4646, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.68% (2.7995 => 3.2105, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.61% (5.0261 => 5.6094, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.03% (1.1857 => 1.2809, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.41% (0.3186 => 0.3422, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.27% (6.3772 => 6.8408, std.dev.: 0.1529) SingleSource/Benchmarks/McGill/queens: 7.05% (1.7056 => 1.8258, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.71% (4.7794 => 5.1001, std.dev.: 0.0101) MultiSource/Applications/SIBsim4/SIBsim4: 6.17% (3.1873 => 3.3840, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/richards_benchmark: 6.16% (1.3037 => 1.3840, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/lpbench: 5.94% (3.9006 => 4.1324, std.dev.: 0.0311) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.89% (4.9686 => 5.2611, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.84% (4.5327 => 4.7973, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.74% (6.2275 => 6.5229, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.66% (3.3761 => 3.5335, std.dev.: 0.0152) MultiSource/Applications/lambda-0_1_3/lambda: 4.52% (7.4933 => 7.8321, std.dev.: 0.0651) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.15% (4.9453 => 5.1503, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.10% (4.9469 => 5.1498, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.88% (14.0064 => 14.5492, std.dev.: 0.0195) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.26% (0.3587 => 0.3704, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 2.98% (3.6643 => 3.7736, std.dev.: 0.0078) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.96% (1.2337 => 1.2702, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.79% (11.5690 => 11.8923, std.dev.: 0.0265) SingleSource/Benchmarks/Shootout/lists: 2.73% (7.3375 => 7.5378, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout/ary3: 2.73% (2.0949 => 2.1520, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.63% (4.8362 => 4.9634, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.27% (4.8660 => 4.9765, std.dev.: 0.0413) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.23% (1.1365 => 1.1619, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.20% (8.2783 => 8.4605, std.dev.: 0.0277) SingleSource/Benchmarks/Shootout-C++/ary3: 2.16% (1.9999 => 2.0431, std.dev.: 0.0095) SingleSource/Benchmarks/Dhrystone/dry: 1.97% (0.5081 => 0.5181, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 1.37% (4.3049 => 4.3639, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.33% (44.5605 => 45.1534, std.dev.: 0.2209) MultiSource/Benchmarks/FreeBench/neural/neural: 1.32% (1.0841 => 1.0984, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.24% (2.4647 => 2.4952, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: 1.23% (8.5322 => 8.6373, std.dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.03% (3.5679 => 3.6048, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.11% (5.4641 => 4.3106, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.60% (7.2130 => 6.2317, std.dev.: 0.0604) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.93% (1.0512 => 0.9363, std.dev.: 0.0273) SingleSource/Benchmarks/McGill/chomp: -9.99% (1.1216 => 1.0096, std.dev.: 0.0101) MultiSource/Benchmarks/mafft/pairlocalalign: -8.55% (63.1822 => 57.7804, std.dev.: 0.1200) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.20% (14.6451 => 13.4447, std.dev.: 0.1224) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -7.06% (4.7482 => 4.4132, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.42% (0.3269 => 0.3059, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.92% (3.7148 => 3.4950, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.86% (5.4972 => 5.1753, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.03% (5.1557 => 4.8964, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.55% (4.7449 => 4.5291, std.dev.: 0.0165) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.86% (2.8773 => 2.7663, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.74% (6.0224 => 5.7974, std.dev.: 0.0218) MultiSource/Applications/lua/lua: -3.29% (29.8330 => 28.8509, std.dev.: 0.1375) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (28.5821 => 27.6997, std.dev.: 0.0204) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.08% (0.5807 => 0.5628, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.98% (2.4490 => 2.3761, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.86% (2.6356 => 2.5602, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.32% (1.2822 => 1.2524, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/hash2: -2.16% (3.4237 => 3.3499, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.05% (3.2169 => 3.1508, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.05% (11.5316 => 11.2955, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.97% (9.9065 => 9.7114, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.64% (2.3487 => 2.3102, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.46% (4.9994 => 4.9264, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.17% (5.6343 => 5.5681, std.dev.: 0.0159) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.40% (16.4461 => 16.8405, std.dev.: 0.0821) MultiSource/Applications/obsequi/Obsequi: 4.43% (1.0262 => 1.0717, std.dev.: 0.0074) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7013.77% (0.3123 => 22.2163, std.dev.: 0.4043) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.08% (0.2463 => 0.3721, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/bigfib: 1.73% (0.6010 => 0.6114, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.43% (0.3266 => 0.3378, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 3.20% (0.1969 => 0.2032, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.39% (0.0408 => 0.0430, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.50% (0.0254 => 0.0334, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.30% (0.0302 => 0.0318, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.20% (0.0384 => 0.0427, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 8.95% (0.0190 => 0.0207, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 3.62% (0.1438 => 0.1490, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -5.17% (1.1329 => 1.0743, std.dev.: 0.0444) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.91% (0.4164 => 0.4202, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.99% (0.1369 => 0.1410, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.62% (0.0641 => 0.0645, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 40.51% (0.0195 => 0.0274, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.73% (0.0578 => 0.0568, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.64% (1.1437 => 1.1968, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.87% (0.0627 => 0.0645, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 42.22% (0.0180 => 0.0256, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.81% (0.8017 => 0.7792, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -37.10% (0.0062 => 0.0039, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 17:02:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 19:02:04 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121114010204.686452A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5838?compare_to=5836&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5838, Order: 167882, Start Time: 2012-11-13 23:37:16, End Time: 2012-11-14 01:02:19 To: 5836, Order: 167872, Start Time: 2012-11-13 21:48:14, End Time: 2012-11-13 23:13:43 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (6 on baseline) Performance Improvements: 0 (176 on baseline) Unchanged Tests: 1040 (860 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.64% (54.4742 => 55.9104, std.dev.: 0.2940) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.33% (79.3299 => 81.1784, std.dev.: 0.2753) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.13% (2.0478 => 2.1118, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.45% (54.5751 => 55.9104, std.dev.: 0.2940) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4937 => 7.6679, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/hash2: 2.14% (3.1932 => 3.2615, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.83% (79.7170 => 81.1784, std.dev.: 0.2753) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.46% (0.1431 => 0.1310, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.96% (0.3821 => 0.3517, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.79% (0.3812 => 0.3553, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.76% (0.3357 => 0.3130, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -6.69% (2.4924 => 2.3256, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.68% (0.3848 => 0.3591, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.68% (0.3880 => 0.3621, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -6.67% (0.3896 => 0.3636, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -6.66% (0.3831 => 0.3576, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.62% (0.9542 => 0.8910, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.54% (0.3884 => 0.3630, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.52% (0.3142 => 0.2937, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: -6.52% (0.4033 => 0.3770, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.50% (0.3891 => 0.3638, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions: -6.42% (0.4176 => 0.3908, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.26% (9.2283 => 8.6504, std.dev.: 0.0103) MultiSource/Applications/JM/lencod/lencod: -6.24% (16.1920 => 15.1824, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.20% (0.6484 => 0.6082, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.18% (0.1796 => 0.1685, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -6.14% (0.4199 => 0.3941, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.14% (0.2428 => 0.2279, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.09% (0.9852 => 0.9252, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/oourafft: -6.02% (0.2160 => 0.2030, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -6.01% (7.0961 => 6.6699, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/football/football: -5.98% (0.9179 => 0.8630, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.95% (1.3722 => 1.2906, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.91% (0.1761 => 0.1657, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.90% (0.2695 => 0.2536, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.87% (3.5339 => 3.3265, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.85% (0.3658 => 0.3444, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.78% (6.7716 => 6.3800, std.dev.: 0.0110) MultiSource/Benchmarks/sim/sim: -5.73% (0.3406 => 0.3211, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.71% (0.5478 => 0.5165, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.71% (4.8161 => 4.5412, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.71% (1.2300 => 1.1598, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/parameter-passing: -5.70% (0.4280 => 0.4036, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.70% (1.0544 => 0.9943, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.66% (4.8802 => 4.6039, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.66% (1.6364 => 1.5438, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.63% (4.0323 => 3.8054, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.62% (1.4642 => 1.3819, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -5.62% (1.1450 => 1.0807, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.58% (0.6736 => 0.6360, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.58% (4.5069 => 4.2556, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.56% (0.5591 => 0.5280, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -5.55% (1.1530 => 1.0890, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.54% (0.6230 => 0.5885, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: -5.54% (0.4515 => 0.4265, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.51% (0.6189 => 0.5848, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.47% (0.6194 => 0.5855, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.47% (0.5925 => 0.5601, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.46% (0.5802 => 0.5485, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.46% (0.6681 => 0.6316, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.46% (0.5863 => 0.5543, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.45% (0.7198 => 0.6806, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.44% (0.5569 => 0.5266, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.44% (0.5849 => 0.5531, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -5.43% (4.3330 => 4.0979, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.42% (0.6676 => 0.6314, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.42% (0.6260 => 0.5921, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.41% (14.2083 => 13.4391, std.dev.: 0.0258) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.41% (1.2784 => 1.2092, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -5.41% (17.1032 => 16.1775, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.40% (0.6297 => 0.5957, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.38% (0.5705 => 0.5398, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.38% (0.6395 => 0.6051, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.38% (0.6660 => 0.6302, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: -5.36% (0.3581 => 0.3389, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (0.5857 => 0.5543, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.36% (0.5805 => 0.5494, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.36% (0.7524 => 0.7121, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.35% (0.7339 => 0.6946, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: -5.35% (1.3864 => 1.3122, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.35% (0.8521 => 0.8065, std.dev.: 0.0026) MultiSource/Applications/Burg/burg: -5.35% (1.2515 => 1.1846, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.33% (0.6304 => 0.5968, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.32% (0.5581 => 0.5284, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.30% (0.6052 => 0.5731, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.28% (0.6667 => 0.6315, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.27% (0.6446 => 0.6106, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.23% (0.4916 => 0.4659, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: -5.23% (0.2659 => 0.2520, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.21% (0.5859 => 0.5554, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.20% (8.0126 => 7.5956, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.20% (0.3483 => 0.3302, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -5.19% (0.2985 => 0.2830, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.17% (0.3016 => 0.2860, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.17% (0.5688 => 0.5394, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.17% (0.5456 => 0.5174, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: -5.16% (0.3255 => 0.3087, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.16% (0.6440 => 0.6108, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.15% (0.5575 => 0.5288, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.14% (0.6033 => 0.5723, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.13% (0.6395 => 0.6067, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.12% (0.6293 => 0.5971, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.11% (1.2221 => 1.1597, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.10% (0.2548 => 0.2418, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.08% (0.5999 => 0.5694, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.08% (0.5570 => 0.5287, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -5.08% (1.3148 => 1.2480, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.07% (0.2385 => 0.2264, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.07% (0.3057 => 0.2902, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.07% (0.2999 => 0.2847, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.07% (0.5567 => 0.5285, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.06% (0.3837 => 0.3643, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -5.04% (0.6347 => 0.6027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.04% (1.2210 => 1.1595, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.03% (0.7919 => 0.7521, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: -5.00% (0.7779 => 0.7390, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: -4.99% (0.3025 => 0.2874, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -4.99% (0.3026 => 0.2875, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.99% (0.3931 => 0.3735, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.98% (0.2871 => 0.2728, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -4.98% (3.5154 => 3.3404, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.98% (0.2933 => 0.2787, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.97% (2.1713 => 2.0634, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -4.97% (0.2939 => 0.2793, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.96% (0.4151 => 0.3945, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -4.96% (15.2527 => 14.4964, std.dev.: 0.0144) SingleSource/UnitTests/ObjC++/property-reference-object: -4.95% (0.6441 => 0.6122, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -4.93% (15.5079 => 14.7431, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.93% (0.2903 => 0.2760, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.88% (0.3319 => 0.3157, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.86% (0.5168 => 0.4917, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: -4.85% (0.3194 => 0.3039, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -4.85% (0.3446 => 0.3279, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: -4.84% (0.2849 => 0.2711) MultiSource/Applications/lua/lua: -4.84% (4.0594 => 3.8630, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/wc: -4.84% (0.3205 => 0.3050, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -4.83% (0.3394 => 0.3230, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -4.83% (0.3481 => 0.3313, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -4.78% (0.2989 => 0.2846, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -4.74% (0.7447 => 0.7094, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: -4.71% (0.3059 => 0.2915, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.70% (0.2278 => 0.2171, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.69% (0.7021 => 0.6692, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -4.64% (0.3621 => 0.3453, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.62% (1.6474 => 1.5713, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.62% (0.5329 => 0.5083, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -4.59% (0.4248 => 0.4053, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -4.59% (2.1401 => 2.0419, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/09-vor/vor: -4.59% (0.3271 => 0.3121, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.51% (0.4813 => 0.4596, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: -4.51% (0.4861 => 0.4642, std.dev.: 0.0078) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.45% (22.4056 => 21.4084, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.43% (0.3252 => 0.3108, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.42% (0.3867 => 0.3696, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -4.41% (0.7982 => 0.7630, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.41% (0.4083 => 0.3903, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.38% (0.4427 => 0.4233, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -4.37% (34.0927 => 32.6015, std.dev.: 0.0157) MultiSource/Applications/spiff/spiff: -4.32% (0.8418 => 0.8054, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: -4.32% (5.0226 => 4.8056, std.dev.: 0.0024) MultiSource/Applications/siod/siod: -4.31% (2.4021 => 2.2985, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.28% (0.9557 => 0.9148, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -4.28% (0.3788 => 0.3626, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.09% (0.3323 => 0.3187, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -4.00% (0.6750 => 0.6480, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -3.93% (18.2933 => 17.5735, std.dev.: 0.0207) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.90% (2.2587 => 2.1707, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.90% (0.3491 => 0.3355, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.87% (0.9077 => 0.8726, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: -3.82% (0.4524 => 0.4351, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.56% (0.4321 => 0.4167, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: -3.52% (1.5610 => 1.5061, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.98% (5.4682 => 5.3052, std.dev.: 0.0049) SingleSource/UnitTests/Vector/constpool: -2.56% (20.7746 => 20.2432, std.dev.: 0.0275) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7550, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1732, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fbench: -3.84% (2.2633 => 2.1764, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.14% (1.0557 => 1.0225, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.46% (6.5735 => 6.4778, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Report Time: 2.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 17:38:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 19:38:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121114013820.951622A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5839?compare_to=5835&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5839, Order: 167880, Start Time: 2012-11-13 23:27:01, End Time: 2012-11-14 01:38:35 To: 5835, Order: 167864, Start Time: 2012-11-13 20:24:08, End Time: 2012-11-13 22:35:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 44 (160 on baseline) Performance Improvements: 10 (39 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 984 (688 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 17.44% (0.6881 => 0.8081, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 16.75% (0.7181 => 0.8384, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 15.49% (0.6423 => 0.7418, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 15.38% (0.5788 => 0.6678, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 15.24% (0.6862 => 0.7908, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 15.16% (0.7191 => 0.8281, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.99% (0.6164 => 0.7088, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 14.72% (0.7210 => 0.8271, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/moments: 12.93% (0.4484 => 0.5064, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.93% (0.1168 => 0.1319, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 12.89% (0.6236 => 0.7040, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/matrix: 12.80% (0.3383 => 0.3816, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.59% (0.1064 => 0.1198, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sieve: 12.44% (0.4002 => 0.4500, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.42% (0.4332 => 0.4870, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.82% (0.1032 => 0.1154, std.dev.: 0.0028) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.71% (0.1255 => 0.1402, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.86% (0.5911 => 0.6553, std.dev.: 0.0178) SingleSource/UnitTests/ObjC/property: 10.72% (0.4349 => 0.4815, std.dev.: 0.0050) SingleSource/Benchmarks/Stanford/Puzzle: 10.57% (0.1400 => 0.1548, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.51% (0.3215 => 0.3553, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.33% (0.9090 => 0.9938, std.dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: 8.89% (0.3520 => 0.3833, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/oourafft: 8.75% (0.3598 => 0.3913, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.72% (0.6583 => 0.7091, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/distray/distray: 7.65% (0.1529 => 0.1646, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.17% (1.7507 => 1.8762, std.dev.: 0.0324) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 7.09% (0.7249 => 0.7763, std.dev.: 0.0070) MultiSource/Applications/hexxagon/hexxagon: 6.28% (1.4687 => 1.5610, std.dev.: 0.0171) SingleSource/UnitTests/ObjC/parameter-passing: 4.65% (0.4667 => 0.4884, std.dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: 2.81% (55.5706 => 57.1342, std.dev.: 0.1375) MultiSource/Benchmarks/PAQ8p/paq8p: 1.46% (11.3830 => 11.5487, std.dev.: 0.0445) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 27.89% (1.3189 => 1.6868, std.dev.: 0.0223) MultiSource/Benchmarks/llubenchmark/llu: 24.75% (5.4317 => 6.7761, std.dev.: 0.1550) SingleSource/Benchmarks/CoyoteBench/fftbench: 21.95% (2.1167 => 2.5813, std.dev.: 0.0599) MultiSource/Benchmarks/Olden/health/health: 11.67% (0.4635 => 0.5176, std.dev.: 0.0154) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 9.03% (5.8305 => 6.3568, std.dev.: 0.0466) SingleSource/Benchmarks/CoyoteBench/lpbench: 5.54% (11.6155 => 12.2590, std.dev.: 0.0299) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.14% (0.3330 => 0.3468, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists1: 3.19% (0.6168 => 0.6365, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 2.01% (0.6306 => 0.6433, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.35% (87.4721 => 88.6493, std.dev.: 0.1000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.22% (3.6065 => 3.6504, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.08% (61.5680 => 62.2345, std.dev.: 0.1348) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/BenchmarkGame/n-body: -12.57% (0.1058 => 0.0925, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.07% (0.2709 => 0.2409, std.dev.: 0.0116) MultiSource/Benchmarks/sim/sim: -10.23% (0.4145 => 0.3721, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.98% (0.7954 => 0.7160, std.dev.: 0.0147) MultiSource/Benchmarks/Olden/tsp/tsp: -8.97% (0.1550 => 0.1411, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.67% (0.3068 => 0.2894, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.58% (0.6088 => 0.5505, std.dev.: 0.0171) MultiSource/Applications/SPASS/SPASS: -6.58% (15.4383 => 14.4225, std.dev.: 0.0666) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.11% (9.4668 => 9.0778, std.dev.: 0.0349) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -2.46% (6.2344 => 6.0813, std.dev.: 0.0086) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.15% (0.1337 => 0.1339, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0420 => 0.0420, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0651 => 0.0651, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: -0.00% (493.9536 => 493.9299, std.dev.: 0.2890) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/power/power: 43699.76% (1.1277 => 493.9299, std.dev.: 0.2890) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 211.63% (0.5229 => 1.6295, std.dev.: 0.0706) MultiSource/Applications/SPASS/SPASS: 22.62% (14.9895 => 18.3808, std.dev.: 0.0470) MultiSource/Applications/kimwitu++/kc: 51.36% (14.1553 => 21.4261, std.dev.: 0.0226) MultiSource/Benchmarks/MallocBench/gs/gs: 24.56% (4.1105 => 5.1202, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 41.26% (1.1048 => 1.5606, std.dev.: 0.0452) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 435.68% (7.1582 => 38.3450, std.dev.: 0.1909) SingleSource/Benchmarks/Misc-C++-EH/spirit: 89.53% (3.4629 => 6.5631, std.dev.: 0.1240) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.53% (0.6222 => 1.0299, std.dev.: 0.0713) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10978.89% (0.0720 => 7.9768, std.dev.: 0.0310) MultiSource/Applications/SIBsim4/SIBsim4: 3889900.00% (0.0001 => 3.8900, std.dev.: 0.0108) MultiSource/Applications/SPASS/SPASS: 14422400.00% (0.0001 => 14.4225, std.dev.: 0.0666) MultiSource/Applications/kimwitu++/kc: 52600.00% (0.0001 => 0.0527, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 578200.00% (0.0001 => 0.5783, std.dev.: 0.0199) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10085900.00% (0.0001 => 10.0860, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6313400.00% (0.0001 => 6.3135, std.dev.: 0.4907) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1817.26% (1.1194 => 21.4618, std.dev.: 0.1625) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 67.66% (2.9384 => 4.9265, std.dev.: 0.2365) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 61.13% (7.0540 => 11.3663, std.dev.: 0.0594) MultiSource/Applications/ClamAV/clamscan: 60.68% (22.1758 => 35.6313, std.dev.: 0.2305) MultiSource/Benchmarks/FreeBench/distray/distray: 55.87% (0.1056 => 0.1646, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 52.26% (8.1363 => 12.3886, std.dev.: 0.0447) SingleSource/Benchmarks/CoyoteBench/almabench: 51.37% (0.0730 => 0.1105, std.dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 47.98% (21.9371 => 32.4620, std.dev.: 0.0241) SingleSource/Benchmarks/Misc/flops: 38.62% (0.1432 => 0.1985, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 32.52% (0.0326 => 0.0432, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/messages: 31.80% (0.0327 => 0.0431, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 31.59% (0.2700 => 0.3553, std.dev.: 0.0026) SingleSource/Benchmarks/Stanford/Towers: 31.00% (0.0471 => 0.0617, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 30.49% (0.0528 => 0.0689, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/family/family: 30.23% (0.0397 => 0.0517, std.dev.: 0.0001) SingleSource/UnitTests/vla: 29.58% (0.0355 => 0.0460, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 29.46% (0.0672 => 0.0870, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.44% (0.5105 => 0.6557, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/life/life: 28.40% (0.0933 => 0.1198, std.dev.: 0.0029) SingleSource/Benchmarks/Stanford/Quicksort: 28.21% (0.0358 => 0.0459, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/treeadd/treeadd: 27.64% (0.0416 => 0.0531, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 27.08% (0.2758 => 0.3505, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 27.00% (0.4103 => 0.5211, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/hash: 26.81% (0.4289 => 0.5439, std.dev.: 0.0079) SingleSource/Benchmarks/Stanford/Queens: 26.57% (0.0414 => 0.0524, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 26.10% (0.0770 => 0.0971, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 26.00% (0.3865 => 0.4870, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/matrix: 25.79% (0.0818 => 0.1029, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: 25.66% (0.0456 => 0.0573, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/RealMM: 25.51% (0.0396 => 0.0497, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 25.43% (2.2024 => 2.7625, std.dev.: 0.0686) SingleSource/Benchmarks/Shootout-C++/moments: 25.10% (0.4048 => 0.5064, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/sieve: 24.90% (0.3603 => 0.4500, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/parameter-passing: 24.37% (0.3927 => 0.4884, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/lpbench: 24.22% (0.0929 => 0.1154, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ks/ks: 24.04% (0.1510 => 0.1873, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.99% (0.0746 => 0.0925, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/property: 23.91% (0.3886 => 0.4815, std.dev.: 0.0050) SingleSource/Benchmarks/Stanford/Oscar: 23.58% (0.0636 => 0.0786, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: 23.29% (0.3109 => 0.3833, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: 23.18% (0.3098 => 0.3816, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 23.14% (0.1655 => 0.2038, std.dev.: 0.0090) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 22.68% (0.8101 => 0.9938, std.dev.: 0.0031) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.66% (0.1143 => 0.1402, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: 22.47% (0.2554 => 0.3128, std.dev.: 0.0216) SingleSource/Benchmarks/Stanford/Puzzle: 22.08% (0.1268 => 0.1548, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 22.03% (0.5569 => 0.6796, std.dev.: 0.0122) MultiSource/Applications/oggenc/oggenc: 21.72% (5.7591 => 7.0101, std.dev.: 0.0666) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 21.71% (1.5415 => 1.8762, std.dev.: 0.0324) MultiSource/Applications/d/make_dparser: 21.66% (3.3354 => 4.0580, std.dev.: 0.0617) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.65% (0.1566 => 0.1905, std.dev.: 0.0100) MultiSource/Applications/hexxagon/hexxagon: 21.55% (1.2842 => 1.5610, std.dev.: 0.0171) SingleSource/Benchmarks/Misc/perlin: 21.27% (0.0536 => 0.0650, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 21.22% (4.2646 => 5.1694, std.dev.: 0.0270) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.11% (14.3668 => 17.3992, std.dev.: 0.0831) SingleSource/Benchmarks/Shootout-C++/except: 20.90% (0.2871 => 0.3471, std.dev.: 0.0025) MultiSource/Applications/lua/lua: 20.79% (3.8723 => 4.6772, std.dev.: 0.0782) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.77% (0.1584 => 0.1913, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/tsp/tsp: 20.09% (0.1175 => 0.1411, std.dev.: 0.0012) SingleSource/UnitTests/SignlessTypes/Large/cast: 19.86% (0.0564 => 0.0676, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.42% (0.0834 => 0.0996, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.33% (4.9449 => 5.9008, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/oourafft: 19.23% (0.3282 => 0.3913, std.dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.84% (0.1125 => 0.1337, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hello: 18.75% (0.2714 => 0.3223, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.64% (5.0018 => 5.9343, std.dev.: 0.0178) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.91% (0.8172 => 0.9636, std.dev.: 0.0317) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.58% (0.0842 => 0.0990, std.dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: 16.95% (9.4845 => 11.0919, std.dev.: 0.1421) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 16.94% (3.8922 => 4.5517, std.dev.: 0.1638) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.88% (0.0871 => 0.1018, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.74% (0.0675 => 0.0788, std.dev.: 0.0042) MultiSource/Applications/treecc/treecc: 16.61% (2.0273 => 2.3641, std.dev.: 0.0252) MultiSource/Applications/sqlite3/sqlite3: 16.38% (17.1811 => 19.9961, std.dev.: 0.1802) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.20% (0.0648 => 0.0753, std.dev.: 0.0032) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.95% (0.0953 => 0.1105, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 15.93% (0.3684 => 0.4271, std.dev.: 0.0208) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 15.67% (0.5981 => 0.6918, std.dev.: 0.0223) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.45% (0.0770 => 0.0889, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 15.41% (2.2969 => 2.6508, std.dev.: 0.0874) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 15.23% (0.2430 => 0.2800, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.22% (0.1117 => 0.1287, std.dev.: 0.0065) MultiSource/Benchmarks/Bullet/bullet: 15.14% (63.2438 => 72.8218, std.dev.: 0.1148) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 15.12% (1.4186 => 1.6331, std.dev.: 0.0556) MultiSource/Applications/aha/aha: 15.12% (0.1151 => 0.1325, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 14.94% (0.2905 => 0.3339, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.82% (0.3650 => 0.4191, std.dev.: 0.0204) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.79% (0.0798 => 0.0916, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.78% (0.4615 => 0.5297, std.dev.: 0.0221) MultiSource/Applications/Burg/burg: 14.60% (1.1642 => 1.3342, std.dev.: 0.0406) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.33% (0.2107 => 0.2409, std.dev.: 0.0116) MultiSource/Applications/spiff/spiff: 14.17% (0.7835 => 0.8945, std.dev.: 0.0221) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.03% (0.1062 => 0.1211, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/synchronized: 13.96% (0.3561 => 0.4058, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.70% (0.1029 => 0.1170, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.78% (1.3050 => 1.4718, std.dev.: 0.0641) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.70% (0.3543 => 0.3993, std.dev.: 0.0170) SingleSource/UnitTests/ObjC/trivial-interface: 12.67% (0.3473 => 0.3913, std.dev.: 0.0152) SingleSource/UnitTests/ObjC/exceptions-2: 12.55% (0.3497 => 0.3936, std.dev.: 0.0117) SingleSource/UnitTests/ObjC/exceptions-3: 12.43% (0.3516 => 0.3953, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: 11.40% (10.3673 => 11.5487, std.dev.: 0.0445) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.18% (0.2603 => 0.2894, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.01% (0.6450 => 0.7160, std.dev.: 0.0147) MultiSource/Benchmarks/Ptrdist/bc/bc: 10.93% (1.1861 => 1.3157, std.dev.: 0.0268) MultiSource/Benchmarks/FreeBench/neural/neural: 9.91% (0.1463 => 0.1608, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.89% (0.2891 => 0.3177, std.dev.: 0.0043) MultiSource/Benchmarks/sim/sim: 9.86% (0.3387 => 0.3721, std.dev.: 0.0075) SingleSource/UnitTests/ObjC++/property-reference-object: 9.73% (0.6030 => 0.6617, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/strcat: 9.71% (0.2831 => 0.3106, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.54% (2.0665 => 2.2637, std.dev.: 0.0340) SingleSource/Benchmarks/Shootout-C++/ary: 9.22% (0.3232 => 0.3530, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.82% (2.2022 => 2.3965, std.dev.: 0.0675) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.00% (0.3136 => 0.3387, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.83% (7.9617 => 8.4256, std.dev.: 0.0370) SingleSource/UnitTests/Vector/constpool: 5.48% (54.1659 => 57.1342, std.dev.: 0.1375) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.79% (4.3953 => 11.0231, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/methcall: 147.73% (5.3999 => 13.3770, std.dev.: 0.0010) MultiSource/Benchmarks/llubenchmark/llu: 79.35% (3.7781 => 6.7761, std.dev.: 0.1550) MultiSource/Benchmarks/Ptrdist/ft/ft: 31.39% (1.2838 => 1.6868, std.dev.: 0.0223) SingleSource/Benchmarks/Shootout-C++/ary3: 27.36% (3.7221 => 4.7405, std.dev.: 0.1542) SingleSource/Benchmarks/CoyoteBench/fftbench: 26.78% (2.0360 => 2.5813, std.dev.: 0.0599) MultiSource/Applications/minisat/minisat: 24.58% (9.1159 => 11.3563, std.dev.: 0.2343) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 24.23% (13.4384 => 16.6947, std.dev.: 0.6414) SingleSource/Benchmarks/Shootout/ary3: 22.33% (3.6994 => 4.5256, std.dev.: 0.2529) SingleSource/Benchmarks/CoyoteBench/lpbench: 18.49% (10.3460 => 12.2590, std.dev.: 0.0299) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.80% (0.2944 => 0.3468, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/oourafft: 17.64% (6.6465 => 7.8191, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.16% (3.8532 => 4.5143, std.dev.: 0.0544) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.81% (1.1145 => 1.3019, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/health/health: 16.45% (0.4445 => 0.5176, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout/heapsort: 14.25% (3.8526 => 4.4017, std.dev.: 0.0453) MultiSource/Applications/JM/ldecod/ldecod: 13.41% (0.1298 => 0.1472, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 13.37% (0.1159 => 0.1314, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.47% (8.6802 => 9.7625, std.dev.: 0.0363) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.77% (2.8904 => 3.2305, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 10.31% (1.1396 => 1.2571, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Puzzle: 10.06% (0.1421 => 0.1564, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.31% (1.7254 => 1.8861, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 7.97% (0.7455 => 0.8049, std.dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/hash2: 7.21% (3.1578 => 3.3855, std.dev.: 0.0373) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.41% (4.2280 => 4.4568, std.dev.: 0.0141) SingleSource/Regression/C/uint64_to_float: 5.10% (0.5413 => 0.5689, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.75% (26.0924 => 27.3327, std.dev.: 0.2171) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.06% (11.6436 => 12.1166, std.dev.: 0.0112) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 3.37% (0.6223 => 0.6433, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/hash: 3.24% (4.9088 => 5.0679, std.dev.: 0.0558) SingleSource/Benchmarks/Shootout-C++/lists1: 3.14% (0.6171 => 0.6365, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: 2.66% (2.4116 => 2.4758, std.dev.: 0.0077) MultiSource/Benchmarks/PAQ8p/paq8p: 2.17% (85.0658 => 86.9147, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 2.11% (3.1595 => 3.2262, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.64% (27.8444 => 28.3017, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/sieve: 1.49% (5.2139 => 5.2914, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.28% (6.5088 => 6.5923, std.dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0506, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.17% (12.5348 => 12.6818, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1673, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.66% (5.2763 => 1.2317, std.dev.: 0.0630) SingleSource/Benchmarks/Misc/salsa20: -75.70% (0.8651 => 0.2102, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/richards_benchmark: -44.70% (0.1622 => 0.0897, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.80% (5.3526 => 4.9351, std.dev.: 0.0704) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.78% (5.3855 => 5.0206, std.dev.: 0.0418) MultiSource/Applications/JM/ldecod/ldecod: -5.58% (10.4361 => 9.8540, std.dev.: 0.0110) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -47.50% (0.0400 => 0.0210) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.98% (0.3987 => 0.2393, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.92% (0.0506 => 0.0304, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.35% (4.5009 => 2.7746, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: -33.49% (1.1492 => 0.7643, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.16% (2.6546 => 2.0133, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -23.09% (10.7105 => 8.2371, std.dev.: 0.2982) MultiSource/Benchmarks/FreeBench/mason/mason: -19.30% (0.2161 => 0.1744, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4238, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.69% (2.6778 => 2.2843, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.70% (32.5116 => 29.0332, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/mandel-2: -10.65% (1.5373 => 1.3736, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.84% (1.5660 => 1.4275, std.dev.: 0.0037) MultiSource/Benchmarks/NPB-serial/is/is: -8.71% (9.5636 => 8.7307, std.dev.: 0.1723) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4790, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.04% (3.2416 => 3.0458, std.dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.59% (2.7294 => 2.5767, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: -4.98% (1.5835 => 1.5046, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.62% (1.6805 => 1.6029, std.dev.: 0.0241) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.59% (19.9488 => 19.0335, std.dev.: 0.1763) SingleSource/Benchmarks/Shootout/lists: -4.06% (6.2999 => 6.0440, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.36% (0.9957 => 0.9622, std.dev.: 0.0127) MultiSource/Benchmarks/sim/sim: -3.03% (5.0483 => 4.8955, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.25% (0.4808 => 0.4700, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.89% (8.1563 => 8.0025, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: -1.44% (10.2830 => 10.1350, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0017) Report Time: 2.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 18:05:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 20:05:43 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121114020543.44F7D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5840?compare_to=5834&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5840, Order: 167875, Start Time: 2012-11-13 22:50:43, End Time: 2012-11-14 02:05:59 To: 5834, Order: 167851, Start Time: 2012-11-13 18:45:54, End Time: 2012-11-13 22:01:45 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (170 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1042 (720 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.16% (0.0625 => 0.0876, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.89% (0.1063 => 0.1402, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.44% (0.2969 => 0.3754, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.41% (0.1106 => 0.1387, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.03% (0.4139 => 0.5175, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.66% (0.5900 => 0.7355, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.57% (0.4253 => 0.5298, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.51% (0.0714 => 0.0889, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.79% (0.0475 => 0.0588, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 23.49% (1.5932 => 1.9674, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.45% (0.4994 => 0.6165, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.40% (0.0547 => 0.0675, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.29% (0.0584 => 0.0720, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.18% (0.5000 => 0.6159, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.90% (0.1620 => 0.1991, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.62% (0.1021 => 0.1252, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 22.20% (0.0599 => 0.0732, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.07% (0.0897 => 0.1095, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.95% (0.1107 => 0.1350, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.64% (0.0633 => 0.0770, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.23% (0.0584 => 0.0708, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 21.10% (0.0948 => 0.1148, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.03% (0.0642 => 0.0777, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 20.95% (0.0821 => 0.0993, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.85% (0.1103 => 0.1333, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.80% (0.0822 => 0.0993, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.61% (0.0495 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.60% (0.3903 => 0.4707, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.59% (0.1549 => 0.1868, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.54% (0.1003 => 0.1209, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 20.51% (0.1619 => 0.1951, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.14% (0.1604 => 0.1927, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 20.03% (0.0604 => 0.0725, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 19.74% (0.5826 => 0.6976, std.dev.: 0.0084) MultiSource/Applications/viterbi/viterbi: 19.54% (0.0947 => 0.1132, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 19.17% (0.5889 => 0.7018, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 19.06% (0.0808 => 0.0962, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.02% (0.1462 => 0.1740, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.77% (0.2014 => 0.2392, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.66% (0.3890 => 0.4616, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 18.64% (0.1218 => 0.1445, std.dev.: 0.0041) MultiSource/Applications/spiff/spiff: 18.32% (0.4029 => 0.4767, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/mst/mst: 18.19% (0.0698 => 0.0825, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.09% (0.2736 => 0.3231, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.07% (1.3152 => 1.5528, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.01% (0.1088 => 0.1284, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 17.87% (0.1505 => 0.1774, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.66% (0.0572 => 0.0673, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.62% (0.2866 => 0.3371, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.37% (3.5627 => 4.1817, std.dev.: 0.0071) MultiSource/Applications/Burg/burg: 17.33% (0.5546 => 0.6507, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 17.28% (1.8794 => 2.2041, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.15% (0.4658 => 0.5457, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.12% (0.1968 => 0.2305, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 17.11% (0.7171 => 0.8398, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.04% (1.6211 => 1.8974, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.97% (0.2875 => 0.3363, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 16.82% (0.1421 => 0.1660, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.72% (0.1160 => 0.1354) MultiSource/Applications/hbd/hbd: 16.66% (0.9697 => 1.1313, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.62% (0.4361 => 0.5086, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.60% (0.3271 => 0.3814, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 16.33% (0.2725 => 0.3170, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: 16.32% (0.2714 => 0.3157, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 16.29% (0.2750 => 0.3198, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.29% (0.2738 => 0.3184, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 16.22% (0.2823 => 0.3281, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.20% (0.5026 => 0.5840, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.19% (2.7292 => 3.1711, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 16.19% (0.2780 => 0.3230, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.12% (0.2729 => 0.3169, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 16.12% (0.2811 => 0.3264, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 16.11% (0.3004 => 0.3488, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 16.10% (0.2813 => 0.3266, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.03% (0.3930 => 0.4560, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 16.02% (0.2803 => 0.3252, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.97% (0.2911 => 0.3376, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 15.97% (0.1284 => 0.1489, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.94% (0.2792 => 0.3237, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 15.92% (1.0781 => 1.2497, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.88% (2.0673 => 2.3956, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 15.85% (0.9909 => 1.1480, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 15.76% (0.3096 => 0.3584, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.71% (1.9966 => 2.3102, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.68% (0.3195 => 0.3696, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 15.58% (4.2109 => 4.8669, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.51% (1.9694 => 2.2749, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary3: 15.40% (0.3267 => 0.3770, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.37% (4.4195 => 5.0986, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary: 15.19% (0.3258 => 0.3753, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 15.04% (0.3317 => 0.3816, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.97% (0.3060 => 0.3518, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.88% (0.3124 => 0.3589, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 14.79% (23.5202 => 26.9988, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.77% (0.1090 => 0.1251, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 14.64% (0.4146 => 0.4753, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 14.64% (0.3348 => 0.3838, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.60% (0.3362 => 0.3853, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 14.60% (0.3678 => 0.4215, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 14.49% (0.4251 => 0.4867, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.47% (0.3282 => 0.3757, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 14.42% (0.2566 => 0.2936, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 14.41% (0.2075 => 0.2374, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.40% (0.3625 => 0.4147, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 14.39% (0.3726 => 0.4262, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 14.29% (0.3477 => 0.3974, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 14.22% (1.4269 => 1.6298, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-2: 14.16% (0.3446 => 0.3934, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.12% (0.3981 => 0.4543, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-4: 14.08% (0.3465 => 0.3953, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/for-in: 14.07% (0.3496 => 0.3988, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.96% (0.3460 => 0.3943, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/trivial-interface: 13.95% (0.3442 => 0.3922, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.94% (0.3845 => 0.4381, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 13.92% (0.3469 => 0.3952, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.90% (0.3488 => 0.3973, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.82% (0.3690 => 0.4200, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.75% (0.3643 => 0.4144, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 13.70% (0.7875 => 0.8954, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 13.67% (0.3650 => 0.4149, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 13.48% (0.3724 => 0.4226, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 13.43% (2.1653 => 2.4562, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/bigfib: 13.27% (0.5012 => 0.5677, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 13.00% (2.1013 => 2.3745, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 12.92% (4.6177 => 5.2142, std.dev.: 0.0055) MultiSource/Applications/SIBsim4/SIBsim4: 12.30% (0.2691 => 0.3022, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.11% (0.2040 => 0.2287, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.01% (0.6435 => 0.7208, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.00% (0.1383 => 0.1549, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 11.82% (5.5417 => 6.1968, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.48% (0.1028 => 0.1146, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 11.44% (0.3498 => 0.3898, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.12% (0.2068 => 0.2298, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.07% (0.2737 => 0.3040, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.70% (0.3084 => 0.3414, std.dev.: 0.0042) MultiSource/Applications/siod/siod: 10.58% (0.6634 => 0.7336, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 10.52% (0.4847 => 0.5357, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 10.43% (0.3336 => 0.3684, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.13% (0.2103 => 0.2316, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 9.60% (2.0346 => 2.2300, std.dev.: 0.0115) MultiSource/Applications/lemon/lemon: 9.49% (0.2391 => 0.2618, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.82% (4.6926 => 5.1067, std.dev.: 0.0056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.74% (11.6398 => 12.6573, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.67% (0.5361 => 0.5826, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.15% (0.5584 => 0.6039, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.03% (0.7426 => 0.8022, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 7.03% (11.9555 => 12.7965, std.dev.: 0.0152) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.56% (0.3792 => 0.3965, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.07% (0.2122 => 0.2272, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6117, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6752, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 4.66% (15.4430 => 16.1631, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-2: 4.64% (1.8057 => 1.8894, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6367, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1952, std.dev.: 0.0078) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.56% (3.1722 => 3.2216, std.dev.: 0.0043) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3066, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2892, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1051, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5980, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.01% (2.4764 => 2.4514, std.dev.: 0.0075) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5759, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: -8.62% (0.2402 => 0.2195, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9763, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7994, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7983, std.dev.: 0.0063) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.88% (0.6293 => 0.6112, std.dev.: 0.0056) SingleSource/Benchmarks/Dhrystone/fldry: -2.38% (17.2379 => 16.8275, std.dev.: 0.0400) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.26% (41.7953 => 40.8513, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5733, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4949, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.28% (105.3826 => 104.0355, std.dev.: 0.1477) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0453, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 18:25:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 20:25:49 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121114022549.E86F52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5841?compare_to=5837&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5841, Order: 167894, Start Time: 2012-11-14 00:58:40, End Time: 2012-11-14 02:26:07 To: 5837, Order: 167881, Start Time: 2012-11-13 23:14:37, End Time: 2012-11-14 00:41:41 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 13 (124 on baseline) Performance Improvements: 3 (23 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 976 (827 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.12% (0.8683 => 0.9128, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.11% (0.8689 => 0.8872, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.89% (0.8262 => 0.8418, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.52% (4.5970 => 4.6667, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.48% (1.6895 => 1.7145, std.dev.: 0.0080) MultiSource/Applications/lua/lua: 1.44% (3.9650 => 4.0219, std.dev.: 0.0171) MultiSource/Applications/ClamAV/clamscan: 1.30% (15.1625 => 15.3594, std.dev.: 0.0168) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.28% (4.2942 => 4.3491, std.dev.: 0.0183) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 6.42% (1.2524 => 1.3328, std.dev.: 0.0245) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.58% (4.3576 => 4.4699, std.dev.: 0.0103) MultiSource/Applications/SPASS/SPASS: 2.10% (8.4274 => 8.6047, std.dev.: 0.0153) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.11% (1.4102 => 1.4258, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.07% (22.2806 => 22.5186, std.dev.: 0.0857) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -1.63% (0.6976 => 0.6862, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/fibo: -1.14% (4.3639 => 4.3141, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/mandel-2: -1.12% (2.9146 => 2.8821, std.dev.: 0.0068) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.15% (16.8405 => 17.0344, std.dev.: 0.3060) MultiSource/Applications/obsequi/Obsequi: 1.48% (1.0717 => 1.0876, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.24% (22.2163 => 22.4910, std.dev.: 0.5051) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.40% (0.3721 => 0.3706, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 2.14% (0.6114 => 0.6245, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.69% (0.3378 => 0.3435, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 0.34% (0.2032 => 0.2039, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -9.22% (0.0217 => 0.0197, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.70% (0.0430 => 0.0427, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.88% (0.0334 => 0.0301, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -8.18% (0.0318 => 0.0292, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.47% (0.0427 => 0.0425, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -1.93% (0.0207 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -0.46% (0.0218 => 0.0217, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 62.50% (0.0008 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1490 => 0.1491, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 3.38% (1.0743 => 1.1106, std.dev.: 0.0565) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.36% (0.4202 => 0.4259, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.49% (0.1410 => 0.1389, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.65% (0.0645 => 0.0615, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.55% (0.0274 => 0.0267, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.88% (0.0568 => 0.0573, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.28% (1.1968 => 1.1935, std.dev.: 0.0115) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -12.90% (0.0031 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -74.07% (0.0027 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.11% (0.0645 => 0.0554, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.97% (0.0256 => 0.0210, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.21% (0.7792 => 0.7808, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 7.69% (0.0039 => 0.0042, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2317.67% (0.6332 => 15.3087, std.dev.: 0.1478) MultiSource/Benchmarks/McCat/08-main/main: 49.81% (0.1831 => 0.2743, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.32% (0.1559 => 0.1476, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1528.41% (0.3344 => 5.4454, std.dev.: 0.0962) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.39% (0.2364 => 0.3248, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel: 4.66% (0.0429 => 0.0449, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.04% (0.0224 => 0.0242, std.dev.: 0.0012) SingleSource/UnitTests/byval-alignment: -30.87% (0.0230 => 0.0159, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 12.11% (0.1462 => 0.1639, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4533, std.dev.: 0.0113) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0743, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4915, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3257, std.dev.: 0.0185) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1469, std.dev.: 0.0197) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4051, std.dev.: 0.0036) SingleSource/Regression/C/uint64_to_float: -24.12% (2.1832 => 1.6566, std.dev.: 0.0055) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.52% (0.0773 => 0.0893, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.70% (0.8321 => 0.9128, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.35% (0.2279 => 0.2492, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.99% (0.3137 => 0.3419, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.25% (0.6010 => 0.6506, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.19% (0.4847 => 0.5244, std.dev.: 0.0133) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.17% (0.2180 => 0.2358, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.64% (0.7473 => 0.8044, std.dev.: 0.0142) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.61% (0.1983 => 0.2134, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.09% (0.1905 => 0.2040, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.95% (0.6287 => 0.6724, std.dev.: 0.0100) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.79% (0.1885 => 0.2013, std.dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 6.34% (0.2999 => 0.3189, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.31% (0.2378 => 0.2528, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.27% (0.5961 => 0.6335, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.04% (0.3295 => 0.3494, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.94% (0.2240 => 0.2373, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 5.80% (0.7950 => 0.8411, std.dev.: 0.0114) MultiSource/Applications/Burg/burg: 5.57% (1.2222 => 1.2903, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.56% (0.3003 => 0.3170, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.47% (0.9435 => 0.9951, std.dev.: 0.0061) MultiSource/Applications/lua/lua: 5.32% (3.8189 => 4.0219, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.25% (1.1685 => 1.2299, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.05% (1.1606 => 1.2192, std.dev.: 0.0198) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.97% (0.2133 => 0.2239, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.76% (0.2103 => 0.2203, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.70% (0.4783 => 0.5008, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.63% (1.6386 => 1.7145, std.dev.: 0.0080) MultiSource/Applications/hbd/hbd: 4.51% (1.4269 => 1.4912, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.48% (0.8697 => 0.9087, std.dev.: 0.0061) MultiSource/Applications/SPASS/SPASS: 4.22% (14.2605 => 14.8624, std.dev.: 0.0827) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.16% (0.8518 => 0.8872, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.14% (4.1763 => 4.3491, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.11% (0.8086 => 0.8418, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/lists: 4.10% (0.2513 => 0.2616, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 4.10% (1.9948 => 2.0765, std.dev.: 0.0210) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.07% (0.4127 => 0.4295, std.dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.05% (6.6074 => 6.8752, std.dev.: 0.0309) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.01% (8.6476 => 8.9942, std.dev.: 0.1086) MultiSource/Applications/ClamAV/clamscan: 4.00% (14.7684 => 15.3594, std.dev.: 0.0168) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.00% (4.4873 => 4.6667, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.97% (0.8204 => 0.8530, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.97% (0.9069 => 0.9429, std.dev.: 0.0078) MultiSource/Benchmarks/Bullet/bullet: 3.91% (31.8598 => 33.1062, std.dev.: 0.1699) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.84% (0.6227 => 0.6466, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.81% (0.8050 => 0.8357, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.81% (0.8317 => 0.8634, std.dev.: 0.0062) MultiSource/Benchmarks/nbench/nbench: 3.81% (1.1271 => 1.1700, std.dev.: 0.0110) MultiSource/Applications/SIBsim4/SIBsim4: 3.80% (1.2568 => 1.3045, std.dev.: 0.0128) MultiSource/Applications/d/make_dparser: 3.76% (3.2366 => 3.3583, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.74% (0.3717 => 0.3856, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.71% (0.9074 => 0.9411, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.69% (1.2526 => 1.2988, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.66% (0.3115 => 0.3229, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.65% (1.3279 => 1.3764, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.59% (0.3124 => 0.3236, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.58% (0.3657 => 0.3788, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.56% (1.4479 => 1.4994, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.55% (0.7966 => 0.8249, std.dev.: 0.0067) MultiSource/Applications/siod/siod: 3.55% (2.2184 => 2.2972, std.dev.: 0.0143) MultiSource/Applications/hexxagon/hexxagon: 3.53% (0.9810 => 1.0156, std.dev.: 0.0050) MultiSource/Benchmarks/PAQ8p/paq8p: 3.51% (2.3764 => 2.4598, std.dev.: 0.0205) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.44% (0.4559 => 0.4716, std.dev.: 0.0037) MultiSource/Applications/JM/ldecod/ldecod: 3.43% (6.7320 => 6.9630, std.dev.: 0.0234) MultiSource/Applications/JM/lencod/lencod: 3.35% (15.3280 => 15.8410, std.dev.: 0.0348) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.29% (0.8286 => 0.8559, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.28% (0.8007 => 0.8270, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.23% (13.1811 => 13.6065, std.dev.: 0.0731) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.15% (0.7932 => 0.8182, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.05% (0.8340 => 0.8594, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.00% (0.9039 => 0.9310, std.dev.: 0.0051) MultiSource/Applications/lemon/lemon: 2.99% (1.0945 => 1.1272, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.95% (0.8069 => 0.8307, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.92% (0.9688 => 0.9971, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/moments: 2.91% (0.3645 => 0.3751, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.87% (0.8712 => 0.8962, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.86% (0.8359 => 0.8598, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.83% (0.8331 => 0.8567, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.78% (0.8261 => 0.8491, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.73% (0.6586 => 0.6766, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.70% (0.8927 => 0.9168, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.68% (0.9908 => 1.0174, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.62% (0.8066 => 0.8277, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.60% (0.8048 => 0.8257, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.55% (0.8656 => 0.8877, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 2.53% (8.6247 => 8.8432, std.dev.: 0.0299) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.52% (0.8805 => 0.9027, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.52% (0.8177 => 0.8383, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.52% (0.8457 => 0.8670, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.22% (0.6943 => 0.7097, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 138.69% (0.0199 => 0.0475, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/pi: 56.79% (1.5795 => 2.4765, std.dev.: 0.0173) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 20.64% (0.0528 => 0.0637, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.08% (2.9753 => 3.4537, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.68% (0.7597 => 0.8788, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.68% (2.7995 => 3.2106, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6090, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.19% (1.1857 => 1.2828, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 6.98% (1.7056 => 1.8246, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.59% (4.7794 => 5.0942, std.dev.: 0.0200) MultiSource/Applications/SIBsim4/SIBsim4: 6.27% (3.1873 => 3.3870, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: 5.93% (1.3037 => 1.3810, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.89% (4.9686 => 5.2613, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.78% (4.5327 => 4.7948, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.78% (0.3186 => 0.3370, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.92% (6.2275 => 6.5338, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.69% (3.3761 => 3.5344, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 4.43% (7.4933 => 7.8253, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.21% (4.9453 => 5.1537, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.11% (4.9469 => 5.1504, std.dev.: 0.0193) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.88% (0.3587 => 0.3726, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 3.86% (14.0064 => 14.5469, std.dev.: 0.0283) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.46% (0.2887 => 0.2987, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 2.91% (3.6643 => 3.7711, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.82% (11.5690 => 11.8952, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.64% (8.2783 => 8.4970, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.63% (4.3552 => 4.4699, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.49% (4.8660 => 4.9873, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout/lists: 2.30% (7.3375 => 7.5066, std.dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.26% (1.1365 => 1.1622, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.26% (4.8362 => 4.9455, std.dev.: 0.0320) MultiSource/Applications/SPASS/SPASS: 2.04% (8.4326 => 8.6047, std.dev.: 0.0153) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.37% (2.4647 => 2.4984, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/ReedSolomon: 1.01% (8.5322 => 8.6186, std.dev.: 0.0191) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.12% (5.4641 => 4.3103, std.dev.: 0.0452) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.21% (7.2130 => 6.3324, std.dev.: 0.1360) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.74% (1.0512 => 0.9383, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -10.31% (1.1216 => 1.0060, std.dev.: 0.0340) MultiSource/Benchmarks/mafft/pairlocalalign: -8.52% (63.1822 => 57.7976, std.dev.: 0.0254) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.95% (14.6451 => 13.4804, std.dev.: 0.1835) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.95% (4.7482 => 4.4182, std.dev.: 0.0413) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.58% (0.3269 => 0.3054, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.10% (3.7148 => 3.4881, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.97% (5.4972 => 5.1692, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.22% (5.1557 => 4.8867, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.51% (2.8773 => 2.7476, std.dev.: 0.0434) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.20% (4.7449 => 4.5457, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.70% (6.0224 => 5.7994, std.dev.: 0.0160) MultiSource/Applications/lua/lua: -3.17% (29.8330 => 28.8866, std.dev.: 0.1874) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (28.5821 => 27.7022, std.dev.: 0.0151) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.82% (0.5807 => 0.5643, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.77% (9.9065 => 9.6320, std.dev.: 0.0664) SingleSource/Benchmarks/Shootout-C++/hash2: -2.30% (3.4237 => 3.3450, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.97% (11.5316 => 11.3045, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.71% (4.9994 => 4.9137, std.dev.: 0.0116) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.35% (2.3487 => 2.3171, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.17% (5.6343 => 5.5685, std.dev.: 0.0054) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 3.58% (16.4461 => 17.0344, std.dev.: 0.3060) MultiSource/Applications/obsequi/Obsequi: 5.98% (1.0262 => 1.0876, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7101.73% (0.3123 => 22.4910, std.dev.: 0.5051) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.47% (0.2463 => 0.3706, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 3.91% (0.6010 => 0.6245, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.17% (0.3266 => 0.3435, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 3.56% (0.1969 => 0.2039, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 60.16% (0.0123 => 0.0197, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 18.50% (0.0254 => 0.0301, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.31% (0.0302 => 0.0292, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 3.69% (0.1438 => 0.1491, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.97% (1.1329 => 1.1106, std.dev.: 0.0565) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.28% (0.4164 => 0.4259, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.46% (0.1369 => 0.1389, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.06% (0.0641 => 0.0615, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 36.92% (0.0195 => 0.0267, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.87% (0.0578 => 0.0573, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.35% (1.1437 => 1.1935, std.dev.: 0.0115) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0014 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.64% (0.0627 => 0.0554, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.67% (0.0180 => 0.0210, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.61% (0.8017 => 0.7808, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -32.26% (0.0062 => 0.0042, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 18:50:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 20:50:26 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121114025026.049022A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5842?compare_to=5838&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5842, Order: 167897, Start Time: 2012-11-14 01:25:38, End Time: 2012-11-14 02:50:41 To: 5838, Order: 167882, Start Time: 2012-11-13 23:37:16, End Time: 2012-11-14 01:02:19 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (180 on baseline) Unchanged Tests: 1041 (857 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/nbench/nbench: 1.18% (1.0890 => 1.1018, std.dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.62% (2.0478 => 2.1220, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.19% (54.5751 => 56.3162, std.dev.: 0.1753) SingleSource/Benchmarks/Misc/salsa20: 2.40% (7.4937 => 7.6734, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/hash2: 2.21% (3.1932 => 3.2638, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.88% (0.3821 => 0.3520, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -6.73% (0.3357 => 0.3131, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.53% (0.9542 => 0.8919, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -6.25% (2.4924 => 2.3366, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.20% (0.2355 => 0.2209, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.18% (0.7198 => 0.6753, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -6.16% (0.3812 => 0.3577, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -6.11% (9.2283 => 8.6641, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/exceptions-4: -6.08% (0.3880 => 0.3644, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -6.08% (16.1920 => 15.2072, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/exceptions-3: -6.06% (0.3848 => 0.3615, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -6.03% (0.3896 => 0.3661, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.02% (0.9852 => 0.9259, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.00% (0.3831 => 0.3601, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.97% (0.6484 => 0.6097, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: -5.96% (7.0961 => 6.6734, std.dev.: 0.0208) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.94% (0.3891 => 0.3660, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.93% (0.2428 => 0.2284, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: -5.93% (0.2160 => 0.2032, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.91% (1.3722 => 1.2911, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.91% (0.1761 => 0.1657, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.90% (0.1796 => 0.1690, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -5.90% (0.4033 => 0.3795, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.90% (0.3884 => 0.3655, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.88% (0.3658 => 0.3443, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: -5.87% (0.4176 => 0.3931, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.84% (1.0544 => 0.9928, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: -5.83% (0.9179 => 0.8644, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.79% (0.2695 => 0.2539, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.76% (4.8161 => 4.5386, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.71% (3.5339 => 3.3322, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.70% (4.0323 => 3.8026, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/property: -5.67% (0.4199 => 0.3961, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.66% (6.7716 => 6.3880, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.61% (4.8802 => 4.6065, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/methcall: -5.59% (0.3025 => 0.2856, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.57% (1.6364 => 1.5452, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.57% (0.5478 => 0.5173, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.54% (0.6736 => 0.6363, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.52% (1.4642 => 1.3834, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.50% (1.2300 => 1.1624, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: -5.49% (4.3330 => 4.0950, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -5.48% (1.1450 => 1.0823, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.47% (0.3837 => 0.3627, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.46% (0.3057 => 0.2890, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.46% (0.3406 => 0.3220, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.45% (14.2083 => 13.4343, std.dev.: 0.0175) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.44% (4.5069 => 4.2618, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.44% (0.5591 => 0.5287, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/bh/bh: -5.43% (0.2985 => 0.2823, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -5.41% (1.3148 => 1.2437, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/matrix: -5.41% (0.3255 => 0.3079, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.41% (0.5863 => 0.5546, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -5.40% (17.1032 => 16.1788, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.40% (0.3016 => 0.2853, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.40% (0.2871 => 0.2716, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.39% (2.1713 => 2.0543, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/except: -5.39% (0.3026 => 0.2863, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: -5.38% (0.4515 => 0.4272, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.38% (0.6304 => 0.5965, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.37% (0.2903 => 0.2747, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.37% (0.4151 => 0.3928, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.36% (0.6681 => 0.6323, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.35% (0.6052 => 0.5728, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.35% (0.2933 => 0.2776, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.34% (0.5857 => 0.5544, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.34% (0.8521 => 0.8066, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.34% (1.2221 => 1.1569, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.33% (0.5849 => 0.5537, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.33% (0.6676 => 0.6320, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -5.33% (0.4280 => 0.4052, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.32% (1.2210 => 1.1560, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.32% (0.6260 => 0.5927, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.32% (0.3931 => 0.3722, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.32% (0.6189 => 0.5860, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.31% (0.6230 => 0.5899, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.31% (0.5805 => 0.5497, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.30% (0.6395 => 0.6056, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: -5.30% (0.2849 => 0.2698, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.30% (0.5925 => 0.5611, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.30% (0.6194 => 0.5866, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: -5.29% (0.3194 => 0.3025, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.28% (0.5569 => 0.5275, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: -5.28% (0.3581 => 0.3392, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.27% (0.5859 => 0.5550, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: -5.27% (0.2939 => 0.2784, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.26% (0.5705 => 0.5405, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -5.25% (1.2515 => 1.1858, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.24% (0.6660 => 0.6311, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.23% (0.6667 => 0.6318, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.23% (0.7339 => 0.6955, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.22% (0.6297 => 0.5968, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.22% (0.7524 => 0.7131, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -5.22% (0.2989 => 0.2833, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -5.21% (0.3205 => 0.3038, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.21% (0.5802 => 0.5500, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.20% (1.2784 => 1.2119, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.20% (0.5999 => 0.5687, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: -5.20% (1.3864 => 1.3143, std.dev.: 0.0025) SingleSource/Regression/C++/ofstream_ctor: -5.20% (0.3059 => 0.2900, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.18% (0.5575 => 0.5286, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.18% (0.5581 => 0.5292, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.17% (0.5456 => 0.5174, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.17% (0.4916 => 0.4662, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: -5.17% (0.3446 => 0.3268, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -5.15% (0.2659 => 0.2522, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.13% (0.6446 => 0.6115, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (0.5941 => 0.5636, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.11% (0.3483 => 0.3305, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.10% (0.5567 => 0.5283, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.09% (0.3849 => 0.3653, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.09% (8.0126 => 7.6051, std.dev.: 0.0074) MultiSource/Applications/d/make_dparser: -5.08% (3.5154 => 3.3367, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.08% (0.6395 => 0.6070, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.08% (0.6440 => 0.6113, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.07% (0.3252 => 0.3087, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.07% (0.6033 => 0.5727, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -5.07% (0.3394 => 0.3222, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.06% (0.5570 => 0.5288, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -5.06% (0.3481 => 0.3305, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.04% (0.7919 => 0.7520, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.01% (0.5688 => 0.5403, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.94% (0.6293 => 0.5982, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: -4.94% (0.4861 => 0.4621, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -4.92% (0.3621 => 0.3443, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -4.91% (0.3867 => 0.3677, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.90% (0.2999 => 0.2852, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -4.90% (15.2527 => 14.5051, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/moments: -4.90% (0.4248 => 0.4040, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -4.89% (15.5079 => 14.7489, std.dev.: 0.0113) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.87% (0.2278 => 0.2167, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: -4.87% (0.7779 => 0.7400, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.86% (0.5168 => 0.4917, std.dev.: 0.0007) MultiSource/Applications/lua/lua: -4.85% (4.0594 => 3.8624, std.dev.: 0.0094) MultiSource/Applications/minisat/minisat: -4.85% (0.7447 => 0.7086, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -4.82% (34.0927 => 32.4488, std.dev.: 0.0216) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.82% (0.2385 => 0.2270, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.79% (0.2548 => 0.2426, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -4.77% (0.6347 => 0.6044, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.73% (0.3319 => 0.3162, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.73% (0.4083 => 0.3890, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -4.67% (5.0226 => 4.7878, std.dev.: 0.0057) SingleSource/UnitTests/ObjC++/property-reference-object: -4.67% (0.6441 => 0.6140, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.66% (0.7021 => 0.6694, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.63% (1.6474 => 1.5711, std.dev.: 0.0061) MultiSource/Applications/treecc/treecc: -4.63% (2.1401 => 2.0411, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.59% (0.4813 => 0.4592, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -4.59% (0.3271 => 0.3121, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.59% (0.4427 => 0.4224, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -4.57% (0.7982 => 0.7617, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sieve: -4.57% (0.3788 => 0.3615, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.51% (22.4056 => 21.3956, std.dev.: 0.0190) MultiSource/Applications/siod/siod: -4.50% (2.4021 => 2.2939, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.48% (0.5329 => 0.5090, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.48% (0.3323 => 0.3174, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.48% (0.9557 => 0.9129, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: -4.44% (1.1530 => 1.1018, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -4.31% (0.8418 => 0.8055, std.dev.: 0.0033) MultiSource/Applications/kimwitu++/kc: -4.26% (18.2933 => 17.5145, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/bigfib: -4.24% (0.6750 => 0.6464, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.23% (0.9077 => 0.8693, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: -4.11% (0.4524 => 0.4338, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.07% (0.3491 => 0.3349, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.89% (2.2587 => 2.1708, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.77% (0.4321 => 0.4158, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -3.56% (1.5610 => 1.5055, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.27% (5.4682 => 5.2892, std.dev.: 0.0151) SingleSource/UnitTests/Vector/constpool: -2.30% (20.7746 => 20.2976, std.dev.: 0.0336) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7571, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -8.74% (1.2842 => 1.1719, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.91% (1.7753 => 1.7058, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.79% (2.2633 => 2.1775, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.42% (1.3096 => 1.2648, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.07% (1.0557 => 1.0233, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.61% (6.5735 => 6.4679, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0007) Report Time: 2.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 20:08:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 22:08:11 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121114040811.18FFC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5843?compare_to=5841&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5843, Order: 167907, Start Time: 2012-11-14 02:42:59, End Time: 2012-11-14 04:08:27 To: 5841, Order: 167894, Start Time: 2012-11-14 00:58:40, End Time: 2012-11-14 02:26:07 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 5 (129 on baseline) Performance Improvements: 21 (28 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 966 (817 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.44% (0.3370 => 0.3486, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.40% (6.6599 => 6.8865, std.dev.: 0.0810) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.07% (40.6270 => 41.4700, std.dev.: 0.2751) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.3530 => 2.3826, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: 1.11% (91.0208 => 92.0278, std.dev.: 0.3232) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -4.33% (0.3189 => 0.3051, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -3.64% (0.6724 => 0.6479, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/18-imp/imp: -3.17% (0.3658 => 0.3542, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -2.96% (1.2988 => 1.2604, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.68% (0.6335 => 0.6165, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.21% (0.8872 => 0.8676, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.15% (0.8418 => 0.8237, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.00% (0.8530 => 0.8359, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.00% (0.8357 => 0.8190, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.75% (0.9429 => 0.9264, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.74% (0.9087 => 0.8929, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -1.64% (33.1062 => 32.5637, std.dev.: 0.1440) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.62% (0.7097 => 0.6982, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.49% (0.9411 => 0.9271, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.43% (0.8249 => 0.8131, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.24% (0.8598 => 0.8491, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.06% (8.9942 => 8.8993, std.dev.: 0.0130) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -14.90% (4.3626 => 3.7126, std.dev.: 0.0735) MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.35% (2.6669 => 2.6042, std.dev.: 0.0158) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.88% (22.5186 => 22.0942, std.dev.: 0.0596) MultiSource/Benchmarks/Olden/tsp/tsp: -1.03% (1.4926 => 1.4772, std.dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.66% (17.0344 => 16.9228, std.dev.: 0.0987) MultiSource/Applications/obsequi/Obsequi: -2.29% (1.0876 => 1.0627, std.dev.: 0.0115) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.99% (22.4910 => 22.2689, std.dev.: 0.0840) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.92% (0.3706 => 0.3635, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: -1.99% (0.6245 => 0.6121, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.79% (0.3435 => 0.3339, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/strcat: -1.28% (0.2039 => 0.2013, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -8.12% (0.0197 => 0.0181, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.70% (0.0427 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 9.63% (0.0301 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 7.19% (0.0292 => 0.0313, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -6.59% (0.0425 => 0.0397, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0203 => 0.0202, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -15.21% (0.0217 => 0.0184, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -1.14% (0.1491 => 0.1474, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -6.98% (1.1106 => 1.0331, std.dev.: 0.1042) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.85% (0.4259 => 0.4180, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.02% (0.1389 => 0.1417, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.74% (0.0615 => 0.0592, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -28.09% (0.0267 => 0.0192, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.09% (0.0573 => 0.0585, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.21% (1.1935 => 1.1960, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -85.71% (0.0007 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.45% (0.0554 => 0.0623, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.33% (0.0210 => 0.0203, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.10% (0.7808 => 0.7816, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -4.76% (0.0042 => 0.0040, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2339.73% (0.6332 => 15.4484, std.dev.: 0.0645) MultiSource/Benchmarks/McCat/08-main/main: 48.61% (0.1831 => 0.2721, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.80% (0.1559 => 0.1453, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1536.06% (0.3344 => 5.4710, std.dev.: 0.0131) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.49% (0.2364 => 0.3274, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: 0.47% (0.0429 => 0.0431, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.45% (0.0224 => 0.0225, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 8.34% (0.1462 => 0.1584, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4838, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0718, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4900, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3506, std.dev.: 0.0244) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1384, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4010, std.dev.: 0.0064) SingleSource/Regression/C/uint64_to_float: -24.22% (2.1832 => 1.6544, std.dev.: 0.0074) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 15.11% (0.1112 => 0.1280, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.92% (0.0848 => 0.0966, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.61% (0.0830 => 0.0943, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.33% (0.0810 => 0.0918, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.32% (0.1137 => 0.1243, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.26% (0.2180 => 0.2360, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 8.18% (0.1577 => 0.1706, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.94% (0.2279 => 0.2460, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: 7.80% (0.1347 => 0.1452, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.79% (0.7473 => 0.8055, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.61% (0.1905 => 0.2050, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.59% (0.3137 => 0.3375, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.02% (0.1425 => 0.1525, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.95% (0.4847 => 0.5184, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.95% (0.8148 => 0.8714, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.72% (0.6010 => 0.6414, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.10% (0.3295 => 0.3496, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.59% (0.8321 => 0.8786, std.dev.: 0.0143) MultiSource/Applications/Burg/burg: 5.32% (1.2222 => 1.2872, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.27% (0.2240 => 0.2358, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.12% (0.2519 => 0.2648, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.76% (0.3003 => 0.3146, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 4.68% (0.7950 => 0.8322, std.dev.: 0.0138) MultiSource/Applications/treecc/treecc: 4.37% (1.9948 => 2.0820, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.30% (1.1606 => 1.2105, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.12% (0.4127 => 0.4297, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 3.97% (3.8189 => 3.9707, std.dev.: 0.0263) MultiSource/Applications/SPASS/SPASS: 3.85% (14.2605 => 14.8100, std.dev.: 0.1369) MultiSource/Benchmarks/MallocBench/gs/gs: 3.78% (4.1305 => 4.2866, std.dev.: 0.0489) MultiSource/Applications/minisat/minisat: 3.54% (0.6834 => 0.7076, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.47% (0.4783 => 0.4949, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.47% (0.6227 => 0.6443, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.42% (0.5961 => 0.6165, std.dev.: 0.0065) MultiSource/Applications/ClamAV/clamscan: 3.22% (14.7684 => 15.2441, std.dev.: 0.0443) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.18% (2.1401 => 2.2082, std.dev.: 0.0202) MultiSource/Applications/lemon/lemon: 3.13% (1.0945 => 1.1288, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.08% (0.9435 => 0.9726, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.05% (0.6287 => 0.6479, std.dev.: 0.0071) MultiSource/Applications/d/make_dparser: 3.01% (3.2366 => 3.3340, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.00% (1.6386 => 1.6878, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.91% (8.6476 => 8.8993, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.88% (4.1763 => 4.2964, std.dev.: 0.0298) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.85% (6.6074 => 6.7960, std.dev.: 0.0543) MultiSource/Applications/hexxagon/hexxagon: 2.85% (0.9810 => 1.0090, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/05-eks/eks: 2.82% (0.4397 => 0.4521, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.81% (0.8340 => 0.8574, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.79% (0.4559 => 0.4686, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 2.78% (1.2568 => 1.2917, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.68% (0.8805 => 0.9041, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.67% (0.8697 => 0.8929, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 2.62% (1.1271 => 1.1566, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.56% (4.4880 => 4.6029, std.dev.: 0.0326) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.54% (1.4479 => 1.4847, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.53% (0.8457 => 0.8671, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.52% (1.3279 => 1.3614, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.46% (0.8007 => 0.8204, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.42% (0.8597 => 0.8805, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 2.41% (4.9628 => 5.0825, std.dev.: 0.0214) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.39% (4.4873 => 4.5946, std.dev.: 0.0342) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.37% (0.8716 => 0.8923, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.37% (1.1170 => 1.1435, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.37% (0.8286 => 0.8482, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.35% (0.5191 => 0.5313, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 2.33% (2.3764 => 2.4317, std.dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (3.1832 => 3.2555, std.dev.: 0.0260) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.27% (13.1811 => 13.4798, std.dev.: 0.0856) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.27% (1.5315 => 1.5662, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.25% (0.9056 => 0.9260, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.22% (0.8317 => 0.8502, std.dev.: 0.0069) MultiSource/Benchmarks/Bullet/bullet: 2.21% (31.8598 => 32.5637, std.dev.: 0.1440) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.17% (0.9074 => 0.9271, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.15% (0.9069 => 0.9264, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.13% (0.8177 => 0.8351, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.13% (0.6586 => 0.6726, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.08% (0.8995 => 0.9182, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.07% (0.7966 => 0.8131, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.06% (0.9688 => 0.9888, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.05% (0.9908 => 1.0111, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.04% (0.8712 => 0.8890, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.04% (0.9039 => 0.9223, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.01% (0.8261 => 0.8427, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 1.99% (8.6247 => 8.7965, std.dev.: 0.0301) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.98% (0.8885 => 0.9061, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.98% (0.7932 => 0.8089, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.92% (0.8066 => 0.8221, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.92% (0.8611 => 0.8776, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.87% (0.8086 => 0.8237, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.85% (0.8518 => 0.8676, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.85% (0.8656 => 0.8816, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.82% (0.8316 => 0.8467, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.81% (4.5702 => 4.6531, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.79% (0.8338 => 0.8487, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.73% (0.8048 => 0.8187, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.58% (0.8359 => 0.8491, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 122.11% (0.0199 => 0.0442, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/pi: 57.02% (1.5795 => 2.4802, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.89% (0.7597 => 0.8880, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.35% (2.9753 => 3.4618, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.70% (2.7995 => 3.2109, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6093, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.42% (0.3186 => 0.3486, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.15% (1.1857 => 1.2823, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.99% (6.3772 => 6.8865, std.dev.: 0.0810) SingleSource/Benchmarks/McGill/queens: 7.40% (1.7056 => 1.8318, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.72% (2.2485 => 2.3996, std.dev.: 0.0246) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.57% (4.7794 => 5.0935, std.dev.: 0.0130) MultiSource/Applications/SIBsim4/SIBsim4: 5.95% (3.1873 => 3.3771, std.dev.: 0.0286) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.95% (4.9686 => 5.2643, std.dev.: 0.0307) SingleSource/Benchmarks/Misc/richards_benchmark: 5.94% (1.3037 => 1.3812, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.86% (4.5327 => 4.7985, std.dev.: 0.0103) MultiSource/Applications/lambda-0_1_3/lambda: 4.88% (7.4933 => 7.8593, std.dev.: 0.0326) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.51% (3.3761 => 3.5285, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.01% (4.9453 => 5.1435, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.94% (4.9469 => 5.1416, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.90% (6.2275 => 6.4702, std.dev.: 0.0260) MultiSource/Applications/hexxagon/hexxagon: 3.89% (14.0064 => 14.5517, std.dev.: 0.0348) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.74% (0.3587 => 0.3721, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.32% (1.2337 => 1.2747, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 3.07% (3.6643 => 3.7769, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.83% (8.2783 => 8.5124, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.77% (11.5690 => 11.8890, std.dev.: 0.0485) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.37% (4.8660 => 4.9811, std.dev.: 0.0385) SingleSource/Benchmarks/Shootout/lists: 2.17% (7.3375 => 7.4964, std.dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (1.1365 => 1.1529, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/power/power: 1.38% (1.2061 => 1.2228, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 1.30% (1.0841 => 1.0982, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.24% (59.2638 => 59.9979, std.dev.: 0.2199) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.23% (3.5679 => 3.6117, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.18% (2.4647 => 2.4938, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -23.75% (5.4641 => 4.1664, std.dev.: 0.0837) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.08% (7.2130 => 6.2699, std.dev.: 0.0577) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.09% (1.0512 => 0.9346, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -11.00% (1.1216 => 0.9982, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -10.00% (14.6451 => 13.1803, std.dev.: 0.2078) MultiSource/Benchmarks/mafft/pairlocalalign: -8.53% (63.1822 => 57.7923, std.dev.: 0.1092) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.71% (0.3269 => 0.3017, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.87% (4.7482 => 4.4222, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.95% (3.7148 => 3.4938, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.90% (5.4972 => 5.1730, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.26% (3.9188 => 3.7126, std.dev.: 0.0735) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.05% (5.1557 => 4.8955, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.41% (4.7449 => 4.5357, std.dev.: 0.0181) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.33% (2.8773 => 2.7528, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.75% (6.0224 => 5.7967, std.dev.: 0.0033) MultiSource/Applications/lua/lua: -3.23% (29.8330 => 28.8695, std.dev.: 0.2014) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (28.5821 => 27.6670, std.dev.: 0.0502) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.15% (0.5807 => 0.5624, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bisort/bisort: -2.71% (0.6636 => 0.6456, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.71% (2.4490 => 2.3826, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.50% (2.6356 => 2.5698, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.37% (9.9065 => 9.6722, std.dev.: 0.0663) SingleSource/Benchmarks/Shootout-C++/hash2: -2.27% (3.4237 => 3.3461, std.dev.: 0.0089) MultiSource/Applications/aha/aha: -2.25% (3.3398 => 3.2648, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (11.5316 => 11.2987, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.87% (3.2169 => 3.1567, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.68% (2.3487 => 2.3093, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.58% (4.9994 => 4.9206, std.dev.: 0.0085) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.90% (16.4461 => 16.9228, std.dev.: 0.0987) MultiSource/Applications/obsequi/Obsequi: 3.56% (1.0262 => 1.0627, std.dev.: 0.0115) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7030.61% (0.3123 => 22.2689, std.dev.: 0.0840) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.58% (0.2463 => 0.3635, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 1.85% (0.6010 => 0.6121, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.24% (0.3266 => 0.3339, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/strcat: 2.23% (0.1969 => 0.2013, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 47.15% (0.0123 => 0.0181, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 3.39% (0.0384 => 0.0397, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 2.22% (0.0180 => 0.0184, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.50% (0.1438 => 0.1474, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -8.81% (1.1329 => 1.0331, std.dev.: 0.1042) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.38% (0.4164 => 0.4180, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.51% (0.1369 => 0.1417, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.64% (0.0641 => 0.0592, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.54% (0.0195 => 0.0192, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.21% (0.0578 => 0.0585, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.57% (1.1437 => 1.1960, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.64% (0.0627 => 0.0623, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 12.78% (0.0180 => 0.0203, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.51% (0.8017 => 0.7816, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -35.48% (0.0062 => 0.0040, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 20:38:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 22:38:37 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121114043837.A4B9F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5844?compare_to=5842&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5844, Order: 167909, Start Time: 2012-11-14 03:13:56, End Time: 2012-11-14 04:38:53 To: 5842, Order: 167897, Start Time: 2012-11-14 01:25:38, End Time: 2012-11-14 02:50:41 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 3 (4 on baseline) Performance Improvements: 1 (176 on baseline) Unchanged Tests: 1038 (862 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.43% (2.0543 => 2.0837, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 1.18% (1.2437 => 1.2584, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 1.12% (1.5055 => 1.5224, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/nbench/nbench: -1.08% (1.1018 => 1.0899, std.dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1006, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/salsa20: 2.38% (7.4937 => 7.6719, std.dev.: 0.0243) SingleSource/Benchmarks/Shootout-C++/hash2: 2.01% (3.1932 => 3.2575, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.39% (0.1431 => 0.1311, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.62% (0.3821 => 0.3530, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.68% (0.9542 => 0.8905, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.64% (0.3357 => 0.3134, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -6.48% (2.4924 => 2.3310, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.33% (0.3142 => 0.2943, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -6.30% (0.2160 => 0.2024, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.18% (0.2428 => 0.2278, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.11% (0.6484 => 0.6088, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.07% (0.7198 => 0.6761, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -6.06% (16.1920 => 15.2114, std.dev.: 0.0157) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.05% (0.9852 => 0.9256, std.dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: -6.04% (9.2283 => 8.6712, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.01% (0.1796 => 0.1688, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -5.86% (7.0961 => 6.6800, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.82% (1.0544 => 0.9930, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -5.80% (0.1879 => 0.1770, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -5.77% (0.9179 => 0.8649, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.77% (1.3722 => 1.2930, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.73% (0.2355 => 0.2220, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.73% (0.5478 => 0.5164, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.69% (0.3658 => 0.3450, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.64% (0.2695 => 0.2543, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.62% (0.5857 => 0.5528, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: -5.61% (0.3812 => 0.3598, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.59% (0.3880 => 0.3663, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.59% (0.3831 => 0.3617, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.58% (0.4033 => 0.3808, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.57% (0.3896 => 0.3679, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/exceptions-3: -5.56% (0.3848 => 0.3634, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.56% (6.7716 => 6.3952, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.56% (3.5339 => 3.3375, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.55% (4.8161 => 4.5487, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.55% (0.3891 => 0.3675, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.54% (1.2300 => 1.1618, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.54% (0.5849 => 0.5525, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.52% (1.6364 => 1.5460, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.51% (4.8802 => 4.6113, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.49% (0.8521 => 0.8053, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.49% (0.6304 => 0.5958, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.48% (0.3884 => 0.3671, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -5.47% (1.1530 => 1.0899, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.45% (0.6052 => 0.5722, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.45% (0.6736 => 0.6369, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.45% (0.5802 => 0.5486, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.44% (0.5863 => 0.5544, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.43% (0.6681 => 0.6318, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.43% (0.5805 => 0.5490, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.43% (0.6395 => 0.6048, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.42% (0.5575 => 0.5273, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions: -5.41% (0.4176 => 0.3950, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.41% (4.5069 => 4.2631, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.41% (0.6660 => 0.6300, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -5.40% (0.3406 => 0.3222, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.40% (0.5925 => 0.5605, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.40% (0.7524 => 0.7118, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.39% (1.4642 => 1.3853, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.39% (0.5569 => 0.5269, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.38% (0.5591 => 0.5290, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.38% (0.6446 => 0.6099, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.38% (0.6230 => 0.5895, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.38% (4.0323 => 3.8155, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.37% (0.7339 => 0.6945, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.36% (0.5705 => 0.5399, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.35% (0.6297 => 0.5960, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.34% (0.5859 => 0.5546, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: -5.34% (0.4515 => 0.4274, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -5.34% (1.1450 => 1.0839, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.33% (14.2083 => 13.4511, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: -5.27% (4.3330 => 4.1047, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.26% (0.6676 => 0.6325, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.25% (0.6189 => 0.5864, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.25% (0.5581 => 0.5288, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.24% (0.5570 => 0.5278, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.24% (0.6260 => 0.5932, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -5.22% (17.1032 => 16.2105, std.dev.: 0.0185) SingleSource/UnitTests/ObjC/property: -5.22% (0.4199 => 0.3980, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.21% (0.6194 => 0.5871, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.20% (0.6667 => 0.6320, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -5.19% (0.2985 => 0.2830, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.19% (0.5567 => 0.5278, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: -5.19% (1.3864 => 1.3145, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: -5.16% (1.2515 => 1.1869, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.15% (0.5688 => 0.5395, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.14% (0.7919 => 0.7512, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.12% (1.2784 => 1.2129, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/18-imp/imp: -5.11% (0.3581 => 0.3398, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.09% (1.2221 => 1.1599, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.08% (0.6440 => 0.6113, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.08% (0.5456 => 0.5179, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.07% (0.5941 => 0.5640, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.05% (0.5999 => 0.5696, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.03% (1.2210 => 1.1596, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.02% (0.6033 => 0.5730, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -4.96% (0.2659 => 0.2527, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.96% (0.4916 => 0.4672, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.96% (0.6395 => 0.6078, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.95% (0.2385 => 0.2267, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.95% (0.2548 => 0.2422, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.91% (8.0126 => 7.6188, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.91% (0.6293 => 0.5984, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -4.88% (3.5154 => 3.3440, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: -4.87% (15.5079 => 14.7520, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.80% (0.2999 => 0.2855, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: -4.79% (0.7447 => 0.7090, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -4.79% (0.4280 => 0.4075, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.76% (0.5168 => 0.4922, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -4.72% (4.0594 => 3.8677, std.dev.: 0.0035) MultiSource/Applications/ClamAV/clamscan: -4.72% (15.2527 => 14.5334, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.70% (0.2278 => 0.2171, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.68% (0.3483 => 0.3320, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.64% (0.3319 => 0.3165, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.63% (1.6474 => 1.5712, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.53% (22.4056 => 21.3898, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.50% (0.5329 => 0.5089, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.44% (0.7021 => 0.6709, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -4.34% (2.1401 => 2.0473, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: -4.29% (5.0226 => 4.8071, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -4.29% (1.3148 => 1.2584, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: -4.28% (0.3271 => 0.3131, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.26% (0.4151 => 0.3974, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -4.21% (0.3255 => 0.3118, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -4.20% (0.3025 => 0.2898, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.20% (0.9077 => 0.8696, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.20% (0.3837 => 0.3676, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -4.19% (2.4021 => 2.3014, std.dev.: 0.0054) MultiSource/Benchmarks/Bullet/bullet: -4.18% (34.0927 => 32.6690, std.dev.: 0.0096) SingleSource/UnitTests/ObjC++/property-reference: -4.17% (0.7779 => 0.7455, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/objinst: -4.13% (0.3194 => 0.3062, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.12% (0.3057 => 0.2931, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.12% (0.3931 => 0.3769, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.11% (0.3016 => 0.2892, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: -4.04% (0.2871 => 0.2755, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.03% (2.1713 => 2.0837, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.00% (0.9557 => 0.9175, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: -3.98% (0.2939 => 0.2822, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -3.97% (0.3026 => 0.2906, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.96% (0.2903 => 0.2788, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.95% (0.2933 => 0.2817, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.93% (0.4813 => 0.4624, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/lists: -3.92% (0.3621 => 0.3479, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -3.92% (0.7982 => 0.7669, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: -3.90% (0.2849 => 0.2738, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.89% (2.2587 => 2.1709, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.84% (0.6347 => 0.6103, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -3.81% (0.4248 => 0.4086, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.81% (0.3491 => 0.3358, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: -3.80% (0.8418 => 0.8098, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -3.79% (0.3481 => 0.3349, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -3.77% (0.3446 => 0.3316, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -3.76% (18.2933 => 17.6058, std.dev.: 0.0226) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.75% (0.3252 => 0.3130, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.70% (0.4083 => 0.3932, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -3.68% (0.2989 => 0.2879, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -3.66% (0.6441 => 0.6205, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -3.62% (0.3394 => 0.3271, std.dev.: 0.0041) SingleSource/Regression/C++/ofstream_ctor: -3.60% (0.3059 => 0.2949, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -3.59% (0.6750 => 0.6508, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.57% (0.4427 => 0.4269, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -3.38% (0.3788 => 0.3660, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -3.29% (0.4524 => 0.4375, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.20% (5.4682 => 5.2931, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.10% (0.3323 => 0.3220, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.48% (0.4321 => 0.4214, std.dev.: 0.0034) MultiSource/Applications/hbd/hbd: -2.47% (1.5610 => 1.5224, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -2.18% (20.7746 => 20.3220, std.dev.: 0.0217) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7576, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -8.73% (1.2842 => 1.1721, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.91% (2.2633 => 2.1747, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7068, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.86% (1.3096 => 1.2591, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.07% (1.0557 => 1.0233, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4692, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 20:40:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 22:40:24 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121114044024.D2FC02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5845?compare_to=5839&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5845, Order: 167901, Start Time: 2012-11-14 02:29:12, End Time: 2012-11-14 04:40:39 To: 5839, Order: 167880, Start Time: 2012-11-13 23:27:01, End Time: 2012-11-14 01:38:35 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 44 (146 on baseline) Performance Improvements: 10 (40 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 984 (701 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 14.24% (0.6195 => 0.7077, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 13.66% (0.5913 => 0.6721, std.dev.: 0.0146) MultiSource/Applications/minisat/minisat: 13.31% (0.8165 => 0.9252, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 12.76% (0.6655 => 0.7504, std.dev.: 0.0114) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.35% (0.3361 => 0.3776, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.34% (0.5131 => 0.5764, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.88% (0.6744 => 0.7545, std.dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.61% (0.2231 => 0.2490, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 11.47% (0.1491 => 0.1662, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/health/health: 10.57% (0.1466 => 0.1621, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.48% (1.7908 => 1.9785, std.dev.: 0.0513) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.07% (0.8036 => 0.8845, std.dev.: 0.0189) MultiSource/Applications/viterbi/viterbi: 10.00% (0.1790 => 0.1969, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.90% (0.8998 => 0.9889, std.dev.: 0.0195) SingleSource/UnitTests/ObjC++/property-reference: 9.80% (0.7982 => 0.8764, std.dev.: 0.0089) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 9.59% (0.1105 => 0.1211, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary2: 9.37% (0.3714 => 0.4062, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.30% (1.2317 => 1.3463, std.dev.: 0.0110) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.13% (0.2125 => 0.2319, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.05% (0.1337 => 0.1458, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.95% (0.6617 => 0.7209, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/exceptions-2: 8.71% (0.3936 => 0.4279, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.19% (0.1673 => 0.1810, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.68% (0.2397 => 0.2581, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/exceptions-3: 7.67% (0.3953 => 0.4256, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/exceptions-4: 7.32% (0.3988 => 0.4280, std.dev.: 0.0024) MultiSource/Applications/hbd/hbd: 7.12% (1.7275 => 1.8505, std.dev.: 0.0378) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.24% (0.9636 => 1.0045, std.dev.: 0.0039) MultiSource/Applications/siod/siod: 3.49% (2.6508 => 2.7433, std.dev.: 0.0227) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.98% (17.3992 => 17.7431, std.dev.: 0.0280) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.27% (21.4618 => 21.7338, std.dev.: 0.0668) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest: 34.31% (0.3460 => 0.4647, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/flops: 28.58% (6.7486 => 8.6774, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.98% (1.6198 => 2.0083, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 21.88% (3.8294 => 4.6671, std.dev.: 0.0687) SingleSource/Benchmarks/Shootout-C++/ary2: 16.97% (0.0760 => 0.0889, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bisort/bisort: 15.89% (0.8665 => 1.0042, std.dev.: 0.0181) MultiSource/Applications/lemon/lemon: 9.72% (1.4388 => 1.5787, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 7.76% (0.3441 => 0.3708, std.dev.: 0.0103) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.16% (16.6947 => 17.8901, std.dev.: 0.1345) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.69% (6.0813 => 6.3667, std.dev.: 0.0675) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 3.87% (3.2168 => 3.3414, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: 1.10% (1.9801 => 2.0018, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.05% (3.8900 => 3.9309, std.dev.: 0.0110) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -11.76% (0.6557 => 0.5786, std.dev.: 0.0268) SingleSource/UnitTests/ObjC/property: -9.41% (0.4815 => 0.4362, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -9.34% (0.4884 => 0.4428, std.dev.: 0.0023) SingleSource/UnitTests/2006-12-11-LoadConstants: -8.92% (0.1402 => 0.1277, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -7.06% (1.8762 => 1.7437, std.dev.: 0.0367) SingleSource/Regression/C++/ofstream_ctor: -5.03% (0.3339 => 0.3171, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: -5.00% (1.6295 => 1.5480, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.16% (11.3663 => 11.1204, std.dev.: 0.0821) SingleSource/UnitTests/Vector/constpool: -1.56% (57.1342 => 56.2405, std.dev.: 0.0710) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/lpbench: -1.51% (12.2590 => 12.0745, std.dev.: 0.0456) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.07% (0.1339 => 0.1338, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0420 => 0.0419, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.53% (0.0651 => 0.0674, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 0.05% (493.9299 => 494.1545, std.dev.: 0.0525) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0419, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/power/power: 43719.68% (1.1277 => 494.1545, std.dev.: 0.0525) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 196.04% (0.5229 => 1.5480, std.dev.: 0.0053) MultiSource/Applications/SPASS/SPASS: 22.38% (14.9895 => 18.3437, std.dev.: 0.0978) MultiSource/Applications/kimwitu++/kc: 51.41% (14.1553 => 21.4324, std.dev.: 0.0237) MultiSource/Benchmarks/MallocBench/gs/gs: 25.24% (4.1105 => 5.1478, std.dev.: 0.0184) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.73% (1.1048 => 1.5216, std.dev.: 0.0788) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 434.47% (7.1582 => 38.2582, std.dev.: 0.1984) SingleSource/Benchmarks/Misc-C++-EH/spirit: 90.94% (3.4629 => 6.6121, std.dev.: 0.0831) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.59% (0.6222 => 1.0303, std.dev.: 0.0643) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10950.00% (0.0720 => 7.9560, std.dev.: 0.0083) MultiSource/Applications/SIBsim4/SIBsim4: 3930800.00% (0.0001 => 3.9309, std.dev.: 0.0110) MultiSource/Applications/SPASS/SPASS: 14232700.00% (0.0001 => 14.2328, std.dev.: 0.3258) MultiSource/Applications/kimwitu++/kc: 52000.00% (0.0001 => 0.0521, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 63800.00% (0.0001 => 0.0639, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 578400.00% (0.0001 => 0.5785, std.dev.: 0.0374) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10088000.00% (0.0001 => 10.0881, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6194100.00% (0.0001 => 6.1942, std.dev.: 0.5393) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1841.56% (1.1194 => 21.7338, std.dev.: 0.0668) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 69.91% (2.9384 => 4.9925, std.dev.: 0.1013) MultiSource/Applications/ClamAV/clamscan: 60.84% (22.1758 => 35.6676, std.dev.: 0.3159) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.65% (7.0540 => 11.1204, std.dev.: 0.0821) MultiSource/Benchmarks/FreeBench/distray/distray: 55.21% (0.1056 => 0.1639, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 53.06% (8.1363 => 12.4538, std.dev.: 0.0331) MultiSource/Applications/JM/lencod/lencod: 47.40% (21.9371 => 32.3354, std.dev.: 0.0527) SingleSource/UnitTests/vla: 45.35% (0.0355 => 0.0516, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 39.73% (0.0730 => 0.1020, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 39.46% (0.1432 => 0.1997, std.dev.: 0.0071) MultiSource/Applications/minisat/minisat: 30.04% (0.7115 => 0.9252, std.dev.: 0.0086) SingleSource/UnitTests/ObjC/dot-syntax-1: 29.65% (0.0479 => 0.0621, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 29.60% (0.1125 => 0.1458, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/dot-syntax: 29.58% (0.0355 => 0.0460, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 29.04% (0.0675 => 0.0871, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 28.35% (0.1940 => 0.2490, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/health/health: 27.84% (0.1268 => 0.1621, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 27.07% (0.0953 => 0.1211, std.dev.: 0.0038) MultiSource/Applications/viterbi/viterbi: 26.62% (0.1555 => 0.1969, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.89% (0.0479 => 0.0603, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: 25.58% (0.0770 => 0.0967, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/treeadd/treeadd: 25.24% (0.0416 => 0.0521, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.99% (0.2065 => 0.2581, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 24.76% (1.5859 => 1.9785, std.dev.: 0.0513) SingleSource/Benchmarks/CoyoteBench/fftbench: 24.33% (0.4636 => 0.5764, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.26% (0.0746 => 0.0927, std.dev.: 0.0043) SingleSource/Benchmarks/Stanford/Oscar: 24.21% (0.0636 => 0.0790, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/lpbench: 24.11% (0.0929 => 0.1153, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 23.50% (14.3668 => 17.7431, std.dev.: 0.0280) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 23.38% (0.8101 => 0.9995, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 23.30% (0.0442 => 0.0545, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.13% (0.1029 => 0.1267, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.92% (0.8172 => 1.0045, std.dev.: 0.0039) MultiSource/Applications/oggenc/oggenc: 22.70% (5.7591 => 7.0666, std.dev.: 0.0656) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 22.59% (0.8067 => 0.9889, std.dev.: 0.0195) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 22.57% (0.1892 => 0.2319, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 22.51% (0.2554 => 0.3129, std.dev.: 0.0197) SingleSource/UnitTests/Vector/SSE/sse_isamax: 22.44% (0.0704 => 0.0862, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-2: 22.36% (0.3497 => 0.4279, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/espresso/espresso: 22.01% (4.2646 => 5.2034, std.dev.: 0.0337) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 21.72% (0.1584 => 0.1928, std.dev.: 0.0091) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.71% (0.1566 => 0.1906, std.dev.: 0.0091) SingleSource/UnitTests/ObjC/exceptions-3: 21.05% (0.3516 => 0.4256, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/exceptions-4: 20.80% (0.3543 => 0.4280, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: 20.43% (0.1175 => 0.1415, std.dev.: 0.0074) MultiSource/Applications/lua/lua: 20.24% (3.8723 => 4.6560, std.dev.: 0.0506) SingleSource/Benchmarks/Shootout-C++/ary2: 20.21% (0.3379 => 0.4062, std.dev.: 0.0061) SingleSource/UnitTests/ObjC++/property-reference: 19.63% (0.7326 => 0.8764, std.dev.: 0.0089) SingleSource/UnitTests/ObjC++/property-reference-object: 19.55% (0.6030 => 0.7209, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 19.44% (0.0648 => 0.0774, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 19.43% (2.2969 => 2.7433, std.dev.: 0.0227) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.42% (4.9449 => 5.9052, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.19% (1.4186 => 1.6909, std.dev.: 0.0342) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 19.13% (3.8922 => 4.6368, std.dev.: 0.1040) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.01% (0.1510 => 0.1797, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 18.85% (0.3177 => 0.3776, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.84% (5.0018 => 5.9442, std.dev.: 0.0122) MultiSource/Applications/hbd/hbd: 18.60% (1.5603 => 1.8505, std.dev.: 0.0378) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.17% (0.0842 => 0.0995, std.dev.: 0.0054) SingleSource/UnitTests/SignlessTypes/Large/cast: 18.09% (0.0564 => 0.0666, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.89% (0.9765 => 1.1512, std.dev.: 0.0217) MultiSource/Applications/Burg/burg: 17.88% (1.1642 => 1.3724, std.dev.: 0.0281) MultiSource/Benchmarks/mafft/pairlocalalign: 17.62% (9.4845 => 11.1560, std.dev.: 0.1085) SingleSource/Benchmarks/Shootout/matrix: 17.60% (0.0818 => 0.0962, std.dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 17.57% (1.1840 => 1.3920, std.dev.: 0.0555) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.54% (0.0798 => 0.0938, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.39% (0.6675 => 0.7836, std.dev.: 0.0410) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.37% (0.1117 => 0.1311, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.22% (0.0871 => 0.1021, std.dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: 17.18% (17.1811 => 20.1324, std.dev.: 0.1121) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.67% (0.0834 => 0.0973, std.dev.: 0.0036) MultiSource/Applications/treecc/treecc: 16.39% (2.0273 => 2.3596, std.dev.: 0.0175) MultiSource/Benchmarks/Olden/mst/mst: 16.34% (0.1163 => 0.1353, std.dev.: 0.0060) MultiSource/Applications/d/make_dparser: 15.55% (3.3354 => 3.8540, std.dev.: 0.1505) SingleSource/UnitTests/ObjC/exceptions: 15.49% (0.3828 => 0.4421, std.dev.: 0.0159) MultiSource/Benchmarks/Bullet/bullet: 15.44% (63.2438 => 73.0092, std.dev.: 0.0831) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.06% (0.0770 => 0.0886, std.dev.: 0.0041) MultiSource/Benchmarks/NPB-serial/is/is: 15.02% (0.0719 => 0.0827, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.57% (0.2107 => 0.2414, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.22% (0.5569 => 0.6361, std.dev.: 0.0293) MultiSource/Benchmarks/Olden/bh/bh: 14.13% (0.3092 => 0.3529, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.09% (0.5981 => 0.6824, std.dev.: 0.0272) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.03% (0.1062 => 0.1211, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.37% (0.4615 => 0.5232, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.12% (1.5415 => 1.7437, std.dev.: 0.0367) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.02% (1.3050 => 1.4749, std.dev.: 0.0414) SingleSource/UnitTests/ObjC/parameter-passing: 12.76% (0.3927 => 0.4428, std.dev.: 0.0023) MultiSource/Benchmarks/PAQ8p/paq8p: 12.55% (10.3673 => 11.6683, std.dev.: 0.1354) SingleSource/UnitTests/ObjC++/Hello: 12.25% (0.5925 => 0.6651, std.dev.: 0.0231) SingleSource/UnitTests/ObjC/property: 12.25% (0.3886 => 0.4362, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 12.15% (0.3473 => 0.3895, std.dev.: 0.0164) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.72% (0.1143 => 0.1277, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.21% (0.6450 => 0.7173, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.18% (0.2603 => 0.2894, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.98% (2.2022 => 2.4439, std.dev.: 0.0539) MultiSource/Benchmarks/Prolangs-C/football/football: 10.55% (0.8921 => 0.9862, std.dev.: 0.0232) SingleSource/UnitTests/SignlessTypes/rem: 10.14% (0.1144 => 0.1260) MultiSource/Benchmarks/sim/sim: 10.07% (0.3387 => 0.3728, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 9.91% (0.1463 => 0.1608, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 9.16% (0.2905 => 0.3171, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.50% (7.9617 => 8.3995, std.dev.: 0.0389) SingleSource/UnitTests/Vector/constpool: 3.83% (54.1659 => 56.2405, std.dev.: 0.0710) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.70% (4.3953 => 11.0191, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/methcall: 147.74% (5.3999 => 13.3776, std.dev.: 0.0026) MultiSource/Benchmarks/llubenchmark/llu: 78.99% (3.7781 => 6.7625, std.dev.: 0.2612) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 42.72% (0.3256 => 0.4647, std.dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/ft/ft: 33.28% (1.2838 => 1.7110, std.dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 33.13% (13.4384 => 17.8901, std.dev.: 0.1345) MultiSource/Benchmarks/VersaBench/dbms/dbms: 33.12% (1.5086 => 2.0083, std.dev.: 0.0085) MultiSource/Applications/minisat/minisat: 22.75% (9.1159 => 11.1902, std.dev.: 0.3152) MultiSource/Benchmarks/Olden/bisort/bisort: 20.51% (0.8333 => 1.0042, std.dev.: 0.0181) MultiSource/Benchmarks/Olden/health/health: 20.22% (0.4445 => 0.5344, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/oourafft: 17.66% (6.6465 => 7.8201, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 17.44% (0.0757 => 0.0889, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/lpbench: 16.71% (10.3460 => 12.0745, std.dev.: 0.0456) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.64% (1.1145 => 1.2999, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.01% (0.2944 => 0.3386, std.dev.: 0.0090) MultiSource/Applications/JM/ldecod/ldecod: 14.02% (0.1298 => 0.1480, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.46% (8.6802 => 9.8483, std.dev.: 0.0161) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.70% (2.8904 => 3.2285, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: 11.01% (3.8526 => 4.2766, std.dev.: 0.1228) SingleSource/Benchmarks/Misc/richards_benchmark: 10.26% (1.1396 => 1.2565, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.35% (1.7254 => 1.8867, std.dev.: 0.0038) MultiSource/Applications/lemon/lemon: 9.18% (1.4460 => 1.5787, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.64% (3.1334 => 3.3414, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.61% (4.2280 => 4.4653, std.dev.: 0.0036) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.18% (3.6395 => 3.7915, std.dev.: 0.0275) MultiSource/Applications/lua/lua: 4.07% (26.0924 => 27.1545, std.dev.: 0.2780) MultiSource/Benchmarks/nbench/nbench: 4.06% (11.6436 => 12.1161, std.dev.: 0.0164) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: 2.64% (2.4116 => 2.4753, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/fldry: 2.25% (1.9577 => 2.0018, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 2.22% (2.9346 => 2.9998, std.dev.: 0.0136) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 2.13% (3.1595 => 3.2267, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 2.07% (85.0658 => 86.8303, std.dev.: 0.0777) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.81% (2.1424 => 2.1811, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.58% (27.8444 => 28.2843, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/sieve: 1.43% (5.2139 => 5.2882, std.dev.: 0.0071) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.40% (6.5088 => 6.5997, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0504, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.29% (6.6874 => 0.1810, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -75.48% (0.8651 => 0.2121, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -74.48% (5.2763 => 1.3463, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/richards_benchmark: -44.70% (0.1622 => 0.0897, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.46% (5.3526 => 4.8997, std.dev.: 0.0173) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.52% (5.3855 => 4.9807, std.dev.: 0.0898) MultiSource/Applications/JM/ldecod/ldecod: -6.25% (10.4361 => 9.7837, std.dev.: 0.0300) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -47.50% (0.0400 => 0.0210, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.20% (0.0628 => 0.0363, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.80% (0.3987 => 0.2400, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.72% (0.0506 => 0.0305, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.37% (4.5009 => 2.7740, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.11% (2.6546 => 2.0147, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -23.44% (10.7105 => 8.2000, std.dev.: 0.1478) MultiSource/Benchmarks/FreeBench/mason/mason: -19.16% (0.2161 => 0.1747, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4236, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.69% (2.6778 => 2.2844, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.74% (32.5116 => 29.0211, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.38% (1.5660 => 1.4348, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -7.85% (9.5636 => 8.8127, std.dev.: 0.0103) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4790, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.68% (3.2416 => 3.0575, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5761, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.14% (1.6805 => 1.5941, std.dev.: 0.0307) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.01% (0.2497 => 0.2372, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5081, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.52% (19.9488 => 19.0469, std.dev.: 0.3191) SingleSource/Benchmarks/Shootout/lists: -4.27% (6.2999 => 6.0307, std.dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.38% (0.9957 => 0.9620, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: -3.02% (5.0483 => 4.8957, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.39% (0.4808 => 0.4693, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6774, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.64% (8.1563 => 8.0226, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -1.46% (10.2830 => 10.1333, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.15% (0.2116 => 0.0674, std.dev.: 0.0013) Report Time: 3.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 21:51:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 13 Nov 2012 23:51:18 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121114055118.96C0E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5846?compare_to=5843&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5846, Order: 167909, Start Time: 2012-11-14 04:25:15, End Time: 2012-11-14 05:51:36 To: 5843, Order: 167907, Start Time: 2012-11-14 02:42:59, End Time: 2012-11-14 04:08:27 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 9 (93 on baseline) Performance Improvements: 1 (24 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 982 (857 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.40% (1.2604 => 1.3033, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.85% (1.1950 => 1.2171, std.dev.: 0.0081) MultiSource/Benchmarks/nbench/nbench: 1.46% (1.1566 => 1.1735, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.44% (1.2105 => 1.2279, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.25% (4.6531 => 4.7111, std.dev.: 0.0131) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: 3.63% (4.1664 => 4.3176, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.57% (41.4700 => 42.1219, std.dev.: 0.2160) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.44% (22.0942 => 22.4131, std.dev.: 0.0387) SingleSource/Benchmarks/Misc/pi: 1.16% (2.4802 => 2.5090, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -4.88% (2.3996 => 2.2825, std.dev.: 0.0446) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.29% (16.9228 => 16.9715, std.dev.: 0.2729) MultiSource/Applications/obsequi/Obsequi: -1.09% (1.0627 => 1.0511, std.dev.: 0.0187) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.17% (22.2689 => 22.2310, std.dev.: 0.4325) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.16% (0.3635 => 0.3677, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/bigfib: -0.36% (0.6121 => 0.6099, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.09% (0.3339 => 0.3342, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: -0.70% (0.2013 => 0.1999, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -27.62% (0.0181 => 0.0131, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.71% (0.0424 => 0.0427, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -16.97% (0.0330 => 0.0274, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0313 => 0.0314, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 6.55% (0.0397 => 0.0423, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: 0.99% (0.0202 => 0.0204, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 4.35% (0.0184 => 0.0192, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.10% (0.1474 => 0.1505, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 9.26% (1.0331 => 1.1288, std.dev.: 0.0389) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.53% (0.4180 => 0.4202, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.21% (0.1417 => 0.1414, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.73% (0.0592 => 0.0620, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.46% (0.0192 => 0.0214, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.56% (0.0585 => 0.0600, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.35% (1.1960 => 1.2002, std.dev.: 0.0117) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2400.00% (0.0001 => 0.0025, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.62% (0.0623 => 0.0588, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.82% (0.0203 => 0.0179, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.09% (0.7816 => 0.7731, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 102.50% (0.0040 => 0.0081, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2362.98% (0.6332 => 15.5956, std.dev.: 0.2152) MultiSource/Benchmarks/McCat/08-main/main: 48.94% (0.1831 => 0.2727, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.41% (0.1559 => 0.1459, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1524.76% (0.3344 => 5.4332, std.dev.: 0.0283) SingleSource/Benchmarks/Misc-C++/Large/ray: 33.16% (0.2364 => 0.3148, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel: -9.32% (0.0429 => 0.0389, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.70% (0.0224 => 0.0239, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 9.99% (0.1462 => 0.1608, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4623, std.dev.: 0.0320) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0703, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4955, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3147, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1466, std.dev.: 0.0121) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4064, std.dev.: 0.0018) SingleSource/Regression/C/uint64_to_float: -23.41% (2.1832 => 1.6721, std.dev.: 0.0232) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.44% (0.0810 => 0.0927, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: 12.32% (0.1112 => 0.1249, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.40% (0.1425 => 0.1559, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.78% (0.3137 => 0.3381, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.61% (0.2180 => 0.2346, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.74% (0.8321 => 0.8882, std.dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.61% (0.1905 => 0.2031, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.39% (0.6010 => 0.6394, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.01% (0.7473 => 0.7922, std.dev.: 0.0159) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.80% (1.1606 => 1.2279, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.22% (0.3295 => 0.3467, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.96% (0.2279 => 0.2392, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.82% (0.4127 => 0.4326, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.79% (0.9435 => 0.9887, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.58% (0.6287 => 0.6575, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.16% (1.1685 => 1.2171, std.dev.: 0.0081) MultiSource/Benchmarks/nbench/nbench: 4.12% (1.1271 => 1.1735, std.dev.: 0.0061) MultiSource/Applications/lua/lua: 4.06% (3.8189 => 3.9739, std.dev.: 0.0285) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.94% (0.2998 => 0.3116, std.dev.: 0.0025) MultiSource/Applications/treecc/treecc: 3.82% (1.9948 => 2.0710, std.dev.: 0.0260) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.79% (0.2741 => 0.2845, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.73% (0.3003 => 0.3115, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.42% (1.2602 => 1.3033, std.dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.24% (0.6227 => 0.6429, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.16% (14.2605 => 14.7116, std.dev.: 0.1177) MultiSource/Applications/siod/siod: 3.15% (2.2184 => 2.2883, std.dev.: 0.0230) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.08% (4.5702 => 4.7111, std.dev.: 0.0131) MultiSource/Applications/minisat/minisat: 2.99% (0.6834 => 0.7038, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.88% (2.1401 => 2.2018, std.dev.: 0.0044) MultiSource/Applications/d/make_dparser: 2.86% (3.2366 => 3.3291, std.dev.: 0.0222) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.82% (0.8340 => 0.8575, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.79% (14.7684 => 15.1806, std.dev.: 0.1306) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.74% (13.1811 => 13.5422, std.dev.: 0.0793) MultiSource/Applications/oggenc/oggenc: 2.73% (4.9628 => 5.0983, std.dev.: 0.0317) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.72% (0.8611 => 0.8845, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.62% (0.7932 => 0.8140, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.58% (1.1170 => 1.1458, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.52% (1.5315 => 1.5701, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.49% (0.8597 => 0.8811, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.46% (0.8007 => 0.8204, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.44% (0.9056 => 0.9277, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.43% (0.8712 => 0.8924, std.dev.: 0.0079) MultiSource/Benchmarks/Bullet/bullet: 2.38% (31.8598 => 32.6179, std.dev.: 0.1449) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.38% (0.8069 => 0.8261, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.28% (0.9069 => 0.9276, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (3.1832 => 3.2556, std.dev.: 0.0138) MultiSource/Applications/SIBsim4/SIBsim4: 2.27% (1.2568 => 1.2853, std.dev.: 0.0105) MultiSource/Applications/lemon/lemon: 2.24% (1.0945 => 1.1190, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.23% (1.4479 => 1.4802, std.dev.: 0.0068) MultiSource/Applications/JM/ldecod/ldecod: 2.22% (6.7320 => 6.8814, std.dev.: 0.0379) MultiSource/Applications/JM/lencod/lencod: 2.20% (15.3280 => 15.6652, std.dev.: 0.0850) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.19% (0.8457 => 0.8642, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.16% (0.8204 => 0.8381, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.15% (0.9688 => 0.9896, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.10% (0.8805 => 0.8990, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.00% (0.8048 => 0.8209, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.93% (0.6586 => 0.6713, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.91% (0.8885 => 0.9055, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.74% (0.8716 => 0.8868, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.72% (0.8995 => 0.9150, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 1.69% (8.6247 => 8.7702, std.dev.: 0.0395) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 112.56% (0.0199 => 0.0423, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/pi: 58.85% (1.5795 => 2.5090, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.13% (0.7597 => 0.8898, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.31% (2.9753 => 3.4607, std.dev.: 0.0420) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.65% (2.7995 => 3.2097, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.48% (5.0261 => 5.6032, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.94% (1.1857 => 1.2799, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 7.27% (1.7056 => 1.8296, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.66% (4.7794 => 5.0977, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/richards_benchmark: 6.37% (1.3037 => 1.3867, std.dev.: 0.0037) MultiSource/Applications/SIBsim4/SIBsim4: 6.09% (3.1873 => 3.3815, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.90% (4.5327 => 4.8001, std.dev.: 0.0303) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.89% (4.9686 => 5.2614, std.dev.: 0.0196) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.63% (1.2337 => 1.3031, std.dev.: 0.0120) MultiSource/Applications/lambda-0_1_3/lambda: 4.94% (7.4933 => 7.8633, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.57% (3.3761 => 3.5304, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.14% (4.9453 => 5.1498, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 4.06% (14.0064 => 14.5757, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.05% (4.9469 => 5.1472, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.88% (0.3587 => 0.3726, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.56% (6.2275 => 6.4489, std.dev.: 0.0614) MultiSource/Applications/siod/siod: 3.29% (3.6643 => 3.7848, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.71% (11.5690 => 11.8828, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.62% (8.2783 => 8.4953, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.34% (4.8660 => 4.9801, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout/lists: 2.33% (7.3375 => 7.5081, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.13% (1.1365 => 1.1607, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.83% (4.8362 => 4.9246, std.dev.: 0.0195) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.69% (41.4238 => 42.1219, std.dev.: 0.2160) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.23% (1.5941 => 1.6137, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/ReedSolomon: 1.16% (8.5322 => 8.6313, std.dev.: 0.0150) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.06% (3.5679 => 3.6057, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.98% (5.4641 => 4.3176, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.92% (7.2130 => 6.1371, std.dev.: 0.1498) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.33% (1.0512 => 0.9321, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: -10.40% (1.1216 => 1.0050, std.dev.: 0.0096) MultiSource/Benchmarks/mafft/pairlocalalign: -8.52% (63.1822 => 57.7991, std.dev.: 0.0519) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.40% (14.6451 => 13.4148, std.dev.: 0.1040) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.89% (4.7482 => 4.4211, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.33% (0.3269 => 0.3062, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.03% (5.4972 => 5.1658, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.95% (3.7148 => 3.4937, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.12% (5.1557 => 4.8917, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.38% (4.7449 => 4.5369, std.dev.: 0.0359) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.87% (6.0224 => 5.7894, std.dev.: 0.0139) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.15% (0.5807 => 0.5624, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.97% (28.5821 => 27.7322, std.dev.: 0.0292) MultiSource/Applications/lua/lua: -2.82% (29.8330 => 28.9930, std.dev.: 0.2829) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.72% (2.4490 => 2.3823, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.72% (2.6356 => 2.5640, std.dev.: 0.0085) MultiSource/Applications/aha/aha: -2.43% (3.3398 => 3.2588, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/hash2: -2.20% (3.4237 => 3.3483, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.06% (11.5316 => 11.2940, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.74% (3.2169 => 3.1610, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.73% (4.9994 => 4.9130, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.14% (5.6343 => 5.5700, std.dev.: 0.0161) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 3.19% (16.4461 => 16.9715, std.dev.: 0.2729) MultiSource/Applications/obsequi/Obsequi: 2.43% (1.0262 => 1.0511, std.dev.: 0.0187) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7018.48% (0.3123 => 22.2310, std.dev.: 0.4325) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.29% (0.2463 => 0.3677, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/bigfib: 1.48% (0.6010 => 0.6099, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.33% (0.3266 => 0.3342, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 1.52% (0.1969 => 0.1999, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 6.50% (0.0123 => 0.0131, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 7.87% (0.0254 => 0.0274, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 6.67% (0.0180 => 0.0192, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 4.66% (0.1438 => 0.1505, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.36% (1.1329 => 1.1288, std.dev.: 0.0389) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.91% (0.4164 => 0.4202, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.29% (0.1369 => 0.1414, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.28% (0.0641 => 0.0620, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 9.74% (0.0195 => 0.0214, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.81% (0.0578 => 0.0600, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.94% (1.1437 => 1.2002, std.dev.: 0.0117) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2400.00% (0.0001 => 0.0025, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.22% (0.0627 => 0.0588, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.56% (0.0180 => 0.0179, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.57% (0.8017 => 0.7731, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 30.65% (0.0062 => 0.0081, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 22:09:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 00:09:27 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121114060927.368852A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5847?compare_to=5840&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5847, Order: 167906, Start Time: 2012-11-14 02:54:20, End Time: 2012-11-14 06:09:43 To: 5840, Order: 167875, Start Time: 2012-11-13 22:50:43, End Time: 2012-11-14 02:05:59 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (172 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (719 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.53% (2.0804 => 2.1122, std.dev.: 0.0069) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 38.88% (0.0625 => 0.0868, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.04% (0.1063 => 0.1393, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.87% (0.2969 => 0.3737, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.14% (0.1106 => 0.1384, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 23.97% (0.4139 => 0.5131, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.86% (0.5900 => 0.7308, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.53% (0.0714 => 0.0882, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.49% (0.4253 => 0.5252, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.37% (0.0475 => 0.0586, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.07% (0.4994 => 0.6146, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 22.92% (1.5932 => 1.9583, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.77% (0.0584 => 0.0717, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.48% (0.5000 => 0.6124, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.35% (0.1620 => 0.1982, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.23% (0.1021 => 0.1248, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.77% (0.1107 => 0.1348, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 21.70% (0.0599 => 0.0729, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.52% (0.0897 => 0.1090, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.33% (0.0633 => 0.0768, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 20.89% (0.0948 => 0.1146, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.72% (0.0642 => 0.0775, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.58% (0.1103 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0584 => 0.0704, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.52% (0.0541 => 0.0652, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 20.46% (0.0821 => 0.0989) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.32% (0.0822 => 0.0989, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.11% (0.3903 => 0.4688, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 20.07% (0.1619 => 0.1944, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.04% (0.1003 => 0.1204, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.01% (0.1549 => 0.1859, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.76% (0.1604 => 0.1921, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 19.14% (0.1505 => 0.1793, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 19.01% (0.0947 => 0.1127, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.60% (0.1462 => 0.1734, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.57% (0.2014 => 0.2388, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 18.56% (0.1218 => 0.1444, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 18.52% (0.5826 => 0.6905, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.33% (0.3890 => 0.4603, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 18.32% (0.0808 => 0.0956, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 17.88% (0.5889 => 0.6942, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 17.87% (0.4029 => 0.4749, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.85% (1.3152 => 1.5500, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/mst/mst: 17.77% (0.0698 => 0.0822, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.74% (0.1088 => 0.1281, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.43% (0.2736 => 0.3213, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.31% (0.2866 => 0.3362, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.21% (3.5627 => 4.1760, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.18% (0.2875 => 0.3369, std.dev.: 0.0081) MultiSource/Applications/Burg/burg: 17.17% (0.5546 => 0.6498, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 17.05% (1.8794 => 2.1998, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.02% (0.2738 => 0.3204, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.85% (1.6211 => 1.8942, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.82% (0.1968 => 0.2299, std.dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 16.74% (0.3004 => 0.3507, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 16.69% (0.0605 => 0.0706, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 16.69% (0.9697 => 1.1315, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.53% (0.4658 => 0.5428, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 16.47% (0.2714 => 0.3161, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 16.33% (0.2725 => 0.3170, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 16.33% (0.1421 => 0.1653, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.33% (0.3271 => 0.3805, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.29% (0.1160 => 0.1349, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 16.21% (0.2813 => 0.3269, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.20% (0.5026 => 0.5840, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.16% (0.2729 => 0.3170, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 16.15% (0.2750 => 0.3194, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.14% (0.4361 => 0.5065, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 16.12% (0.2823 => 0.3278, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.08% (0.2792 => 0.3241, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 16.05% (0.2803 => 0.3253, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.01% (2.7292 => 3.1661, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: 16.01% (0.2780 => 0.3225, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 15.97% (0.7171 => 0.8316, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.91% (0.2911 => 0.3374, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 15.90% (0.2811 => 0.3258, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 15.80% (0.9909 => 1.1475, std.dev.: 0.0029) MultiSource/Applications/d/make_dparser: 15.80% (1.0781 => 1.2484, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.72% (2.0673 => 2.3923, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 15.63% (0.3096 => 0.3580, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.60% (0.3930 => 0.4543, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 15.58% (0.1284 => 0.1484, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.57% (4.4195 => 5.1074, std.dev.: 0.0150) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.52% (0.3195 => 0.3691, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 15.47% (4.2109 => 4.8625, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ary3: 15.43% (0.3267 => 0.3771, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.29% (0.3362 => 0.3876, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 15.29% (0.3258 => 0.3756, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.24% (1.9694 => 2.2696, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.16% (1.9966 => 2.2993, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 15.01% (0.3465 => 0.3985, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 14.96% (23.5202 => 27.0377, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary2: 14.95% (0.3317 => 0.3813, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.90% (0.3060 => 0.3516, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 14.85% (0.3496 => 0.4015, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 14.83% (0.3446 => 0.3957, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.82% (0.3488 => 0.4005, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 14.77% (0.3460 => 0.3971, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 14.70% (0.3469 => 0.3979, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 14.70% (0.3442 => 0.3948, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.63% (0.3124 => 0.3581, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 14.63% (0.3678 => 0.4216, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 14.50% (0.4146 => 0.4747, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.50% (0.1090 => 0.1248, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 14.46% (0.3348 => 0.3832, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 14.38% (0.3650 => 0.4175, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.38% (0.3282 => 0.3754, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 14.33% (0.3643 => 0.4165, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.32% (0.3625 => 0.4144, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 14.28% (0.3726 => 0.4258, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 14.27% (0.3477 => 0.3973, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 14.22% (1.4269 => 1.6298, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 14.19% (0.2566 => 0.2930, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 14.12% (0.2075 => 0.2368, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/parameter-passing: 14.02% (0.3724 => 0.4246, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.85% (0.3690 => 0.4201, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 13.83% (0.4251 => 0.4839, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.79% (0.3981 => 0.4530, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.50% (0.3845 => 0.4364, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 13.35% (0.7875 => 0.8926, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 13.05% (4.6177 => 5.2202, std.dev.: 0.0146) MultiSource/Applications/JM/ldecod/ldecod: 13.04% (2.1653 => 2.4477, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/bigfib: 13.03% (0.5012 => 0.5665, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 12.77% (2.1013 => 2.3697, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.21% (0.2040 => 0.2289, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 12.00% (0.2691 => 0.3014, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.93% (0.1383 => 0.1548, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.87% (0.6435 => 0.7199, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11.64% (5.5417 => 6.1870, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.22% (0.2737 => 0.3044, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.89% (0.1028 => 0.1140) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.88% (0.2068 => 0.2293, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 10.83% (0.3498 => 0.3877, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.41% (0.3084 => 0.3405, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 10.31% (0.6634 => 0.7318, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: 10.23% (0.4847 => 0.5343, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 9.89% (0.3336 => 0.3666, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.51% (0.2103 => 0.2303, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 9.25% (2.0346 => 2.2229, std.dev.: 0.0033) MultiSource/Applications/lemon/lemon: 9.24% (0.2391 => 0.2612, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.20% (4.6926 => 5.0772, std.dev.: 0.0052) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.15% (11.6398 => 12.5890, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.06% (0.5361 => 0.5793, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.52% (0.5584 => 0.6004, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.24% (0.7426 => 0.7964, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 6.63% (11.9555 => 12.7486, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.30% (0.3792 => 0.3993, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 8.21% (0.2802 => 0.3032, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6094, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 5.61% (0.2122 => 0.2241, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 5.23% (12.0509 => 12.6807, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1693, std.dev.: 0.0553) SingleSource/Benchmarks/Misc/flops-2: 4.49% (1.8057 => 1.8867, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/dry: 4.26% (14.0481 => 14.6471, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.98% (0.3693 => 0.3840, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1930, std.dev.: 0.0081) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2221, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3084, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.45% (2.0820 => 2.1122, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.30% (7.1849 => 7.2780, std.dev.: 0.0065) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5126, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5400, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5880, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.99% (25.4195 => 16.5246, std.dev.: 0.0326) SingleSource/Benchmarks/Shootout-C++/ary2: -8.33% (0.2402 => 0.2202, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9748, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7963, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.57% (11.2080 => 10.8077, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0049) MultiSource/Applications/siod/siod: -3.04% (6.9842 => 6.7721, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (17.2379 => 16.7853, std.dev.: 0.0528) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8660, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.68% (10.7630 => 10.5818, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4955, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.18% (105.3826 => 104.1432, std.dev.: 0.0640) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0475, std.dev.: 0.0043) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 22:36:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 00:36:46 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121114063646.399A62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5848?compare_to=5844&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5848, Order: 167911, Start Time: 2012-11-14 05:12:01, End Time: 2012-11-14 06:37:03 To: 5844, Order: 167909, Start Time: 2012-11-14 03:13:56, End Time: 2012-11-14 04:38:53 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (179 on baseline) Unchanged Tests: 1041 (859 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.50% (1.2591 => 1.2906, std.dev.: 0.0033) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1014, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/salsa20: 2.47% (7.4937 => 7.6786, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash2: 2.13% (3.1932 => 3.2611, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.39% (0.1431 => 0.1311, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.56% (0.3821 => 0.3532, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.71% (0.9542 => 0.8902, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.61% (0.3357 => 0.3135, std.dev.: 0.0048) MultiSource/Benchmarks/PAQ8p/paq8p: -6.42% (2.4924 => 2.3325, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.27% (0.3142 => 0.2945, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -6.25% (0.2160 => 0.2025, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.18% (0.2428 => 0.2278, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.04% (9.2283 => 8.6709, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.03% (0.9852 => 0.9258, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -6.00% (16.1920 => 15.2200, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.96% (0.1796 => 0.1689, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.88% (0.6484 => 0.6103, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: -5.84% (7.0961 => 6.6814, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.83% (1.0544 => 0.9929, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.82% (0.2355 => 0.2218, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -5.80% (0.1879 => 0.1770, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -5.74% (0.9179 => 0.8652, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.74% (0.3658 => 0.3448, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.72% (0.3812 => 0.3594, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.70% (0.5478 => 0.5166, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.69% (1.3722 => 1.2941, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -5.68% (0.1761 => 0.1661, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.67% (0.7198 => 0.6790, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -5.67% (0.3848 => 0.3630, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -5.66% (0.3831 => 0.3614, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -5.62% (0.3880 => 0.3662, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.61% (4.0323 => 3.8061, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.59% (4.8802 => 4.6074, std.dev.: 0.0141) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.57% (0.2695 => 0.2545, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.55% (0.3891 => 0.3675, std.dev.: 0.0078) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.53% (6.7716 => 6.3971, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: -5.53% (0.4033 => 0.3810, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.52% (0.6230 => 0.5886, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.52% (1.2300 => 1.1621, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.51% (0.5857 => 0.5534, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.51% (0.3884 => 0.3670, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: -5.49% (0.3896 => 0.3682, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.49% (0.6395 => 0.6044, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.49% (3.5339 => 3.3400, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.47% (0.6052 => 0.5721, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.46% (0.6681 => 0.6316, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -5.46% (0.4176 => 0.3948, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.46% (4.8161 => 4.5532, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.45% (0.7339 => 0.6939, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.44% (0.5805 => 0.5489, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.44% (0.5849 => 0.5531, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.43% (0.6189 => 0.5853, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.40% (0.5925 => 0.5605, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.40% (0.6260 => 0.5922, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.40% (0.5705 => 0.5397, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.39% (0.5802 => 0.5489, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.39% (0.6194 => 0.5860, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.39% (0.6736 => 0.6373, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.37% (0.5863 => 0.5548, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.37% (1.4642 => 1.3856, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.36% (0.6676 => 0.6318, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: -5.36% (0.4515 => 0.4273, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.36% (0.5581 => 0.5282, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -5.35% (1.1450 => 1.0837, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.35% (1.6364 => 1.5489, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.35% (4.5069 => 4.2660, std.dev.: 0.0036) MultiSource/Benchmarks/sim/sim: -5.34% (0.3406 => 0.3224, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -5.33% (0.2985 => 0.2826, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.32% (0.6297 => 0.5962, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.32% (0.5569 => 0.5273, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: -5.31% (1.1530 => 1.0918, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.29% (0.6667 => 0.6314, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.29% (14.2083 => 13.4565, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.29% (0.5859 => 0.5549, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.29% (0.6660 => 0.6308, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.28% (0.6304 => 0.5971, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.26% (0.6446 => 0.6107, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.25% (0.7524 => 0.7129, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.24% (0.6293 => 0.5963, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.24% (0.5456 => 0.5170, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -5.24% (17.1032 => 16.2068, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.22% (0.5941 => 0.5631, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: -5.22% (1.2515 => 1.1862, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.20% (0.5575 => 0.5285) SingleSource/UnitTests/ObjC/property: -5.19% (0.4199 => 0.3981, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.15% (0.5570 => 0.5283, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.14% (0.6033 => 0.5723, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.13% (0.5688 => 0.5396, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.12% (0.6440 => 0.6110, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.11% (0.6395 => 0.6068, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.11% (1.2784 => 1.2131, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: -5.08% (0.2659 => 0.2524, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: -5.06% (1.3864 => 1.3163, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: -5.04% (4.3330 => 4.1146, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/18-imp/imp: -5.03% (0.3581 => 0.3401, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.02% (0.4916 => 0.4669, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.01% (1.2210 => 1.1598, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.01% (0.5567 => 0.5288, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.00% (1.2221 => 1.1610, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.99% (8.0126 => 7.6127, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.97% (0.5999 => 0.5701, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.96% (0.8521 => 0.8098, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.95% (0.2548 => 0.2422, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.93% (0.2999 => 0.2851, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: -4.90% (15.5079 => 14.7483, std.dev.: 0.0163) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.87% (0.2278 => 0.2167, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: -4.84% (0.4280 => 0.4073, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.82% (0.7919 => 0.7537, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: -4.79% (3.5154 => 3.3471, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.78% (0.2385 => 0.2271, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.78% (0.5168 => 0.4921, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.74% (0.3483 => 0.3318, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -4.71% (0.7447 => 0.7096, std.dev.: 0.0027) MultiSource/Applications/lua/lua: -4.70% (4.0594 => 3.8686, std.dev.: 0.0034) MultiSource/Applications/ClamAV/clamscan: -4.70% (15.2527 => 14.5359, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.68% (1.6474 => 1.5703, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.56% (22.4056 => 21.3844, std.dev.: 0.0184) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (0.5329 => 0.5087, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: -4.42% (2.1401 => 2.0456, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.42% (0.7021 => 0.6711, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -4.31% (1.3148 => 1.2581, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.31% (0.4151 => 0.3972, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.28% (0.3271 => 0.3131, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: -4.25% (5.0226 => 4.8093, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: -4.21% (0.3255 => 0.3118, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -4.20% (0.3025 => 0.2898, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.19% (0.3057 => 0.2929, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.17% (0.3837 => 0.3677, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -4.16% (0.4861 => 0.4659, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.14% (0.3016 => 0.2891, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -4.14% (0.7779 => 0.7457, std.dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: -4.14% (34.0927 => 32.6823, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/objinst: -4.13% (0.3194 => 0.3062, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -4.13% (0.3026 => 0.2901, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.11% (2.1713 => 2.0821, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.10% (0.3931 => 0.3770, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.06% (0.9557 => 0.9169, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.04% (0.3319 => 0.3185, std.dev.: 0.0016) MultiSource/Applications/siod/siod: -4.02% (2.4021 => 2.3055, std.dev.: 0.0047) MultiSource/Applications/spiff/spiff: -4.02% (0.8418 => 0.8080, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/random: -4.01% (0.2939 => 0.2821, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.00% (0.3252 => 0.3122, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.99% (0.2933 => 0.2816, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -3.97% (0.2871 => 0.2757, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.97% (0.9077 => 0.8717, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.93% (0.2903 => 0.2789, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.91% (2.2587 => 2.1704, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: -3.91% (0.4248 => 0.4082, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -3.90% (0.2849 => 0.2738, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: -3.89% (0.6347 => 0.6100, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -3.88% (0.3867 => 0.3717, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.85% (0.3849 => 0.3701, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -3.82% (0.3059 => 0.2942, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.81% (0.3491 => 0.3358, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -3.80% (0.3446 => 0.3315, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -3.79% (0.3481 => 0.3349, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -3.78% (0.3621 => 0.3484, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -3.74% (0.3205 => 0.3085, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.73% (0.3323 => 0.3199, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: -3.71% (0.4524 => 0.4356, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: -3.69% (18.2933 => 17.6190, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.67% (0.4083 => 0.3933, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.66% (0.4427 => 0.4265, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -3.62% (0.3394 => 0.3271, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -3.59% (0.6441 => 0.6210, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -3.57% (0.7982 => 0.7697, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.56% (0.4321 => 0.4167, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: -3.50% (0.6750 => 0.6514, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/sieve: -3.35% (0.3788 => 0.3661, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.32% (0.4813 => 0.4653, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.30% (5.4682 => 5.2877, std.dev.: 0.0024) MultiSource/Applications/hbd/hbd: -2.42% (1.5610 => 1.5233, std.dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -2.17% (20.7746 => 20.3235, std.dev.: 0.0235) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.52% (7.5137 => 5.7462, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: -8.68% (1.2842 => 1.1727, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7067, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.81% (2.2633 => 2.1771, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4737, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.45% (1.3096 => 1.2906, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 23:35:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 01:35:20 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121114073520.673BE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5849?compare_to=5846&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5849, Order: 167913, Start Time: 2012-11-14 06:08:38, End Time: 2012-11-14 07:35:38 To: 5846, Order: 167909, Start Time: 2012-11-14 04:25:15, End Time: 2012-11-14 05:51:36 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 12 (98 on baseline) Performance Improvements: 5 (25 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 975 (851 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc-C++/Large/ray: 4.38% (0.3148 => 0.3286, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.11% (0.2557 => 0.2662, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 1.81% (0.7616 => 0.7754, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.51% (0.9005 => 0.9141, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.34% (4.5530 => 4.6139, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.32% (0.9276 => 0.9398, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/18-imp/imp: 7.57% (0.1373 => 0.1477, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.43% (1.3583 => 1.4320, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.24% (0.3342 => 0.3517, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.51% (4.5113 => 4.7147, std.dev.: 0.0353) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.61% (6.1371 => 6.2972, std.dev.: 0.0489) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.30% (1.2508 => 1.2670, std.dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -2.10% (1.3033 => 1.2759, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.48% (4.7111 => 4.6413, std.dev.: 0.0244) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.26% (1.2279 => 1.2124, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.80% (1.3031 => 1.2796, std.dev.: 0.0023) MultiSource/Benchmarks/llubenchmark/llu: -1.54% (2.0238 => 1.9926, std.dev.: 0.0102) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.67% (16.9715 => 16.8571, std.dev.: 0.2276) MultiSource/Applications/obsequi/Obsequi: 1.26% (1.0511 => 1.0643, std.dev.: 0.0097) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.13% (22.2310 => 21.9794, std.dev.: 0.3209) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.05% (0.3677 => 0.3675, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: 1.59% (0.6099 => 0.6196, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.36% (0.3342 => 0.3354, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 0.75% (0.1999 => 0.2014, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 67.94% (0.0131 => 0.0220, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0427 => 0.0427, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 20.80% (0.0274 => 0.0331, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.64% (0.0314 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0423 => 0.0425, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -0.98% (0.0204 => 0.0202, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 13.54% (0.0192 => 0.0218, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.66% (0.1505 => 0.1495, std.dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.88% (1.1288 => 1.1500, std.dev.: 0.0357) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.81% (0.4202 => 0.4168, std.dev.: 0.0287) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.42% (0.1414 => 0.1420, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.58% (0.0620 => 0.0667, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 24.77% (0.0214 => 0.0267, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.00% (0.0600 => 0.0564, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.27% (1.2002 => 1.1970, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 24.00% (0.0025 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.86% (0.0588 => 0.0646, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 49.16% (0.0179 => 0.0267) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.83% (0.7731 => 0.7795, std.dev.: 0.0093) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -45.68% (0.0081 => 0.0044, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2310.19% (0.6332 => 15.2613, std.dev.: 0.1911) MultiSource/Benchmarks/McCat/08-main/main: 49.86% (0.1831 => 0.2744, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.84% (0.1559 => 0.1468, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1542.55% (0.3344 => 5.4927, std.dev.: 0.0795) SingleSource/Benchmarks/Misc-C++/Large/ray: 39.00% (0.2364 => 0.3286, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.25% (0.0224 => 0.0238, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -31.74% (0.0230 => 0.0157, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 12.31% (0.1462 => 0.1642, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4705, std.dev.: 0.0281) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0689, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4934, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3257, std.dev.: 0.0643) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1461, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4123, std.dev.: 0.0062) SingleSource/Regression/C/uint64_to_float: -24.23% (2.1832 => 1.6543, std.dev.: 0.0119) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.17% (0.0810 => 0.0941, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 13.94% (0.1112 => 0.1267, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.38% (0.0848 => 0.0953, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.40% (0.2180 => 0.2385, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/em3d/em3d: 7.96% (0.1721 => 0.1858, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 7.50% (0.1347 => 0.1448, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.22% (0.6010 => 0.6444, std.dev.: 0.0112) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.19% (0.8321 => 0.8919, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.50% (0.4847 => 0.5162, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.46% (0.7473 => 0.7956, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.36% (0.2279 => 0.2424, std.dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.34% (0.3137 => 0.3336, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.34% (0.2240 => 0.2382, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.22% (0.8148 => 0.8655, std.dev.: 0.0142) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.68% (0.2519 => 0.2662, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.44% (0.5961 => 0.6285, std.dev.: 0.0045) MultiSource/Applications/Burg/burg: 5.14% (1.2222 => 1.2850, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.87% (0.2998 => 0.3144, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.79% (0.6287 => 0.6588, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.72% (1.1685 => 1.2237, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.53% (0.9435 => 0.9862, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.49% (0.3295 => 0.3443, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.46% (1.1606 => 1.2124, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.36% (0.4127 => 0.4307, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.89% (0.8697 => 0.9035, std.dev.: 0.0076) MultiSource/Applications/treecc/treecc: 3.87% (1.9948 => 2.0720, std.dev.: 0.0231) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.65% (0.2794 => 0.2896, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.63% (0.9069 => 0.9398, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 3.61% (3.8189 => 3.9567, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.59% (0.8338 => 0.8637, std.dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.58% (0.6227 => 0.6450, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.41% (0.8340 => 0.8624, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/gs/gs: 3.39% (4.1305 => 4.2706, std.dev.: 0.0472) MultiSource/Benchmarks/nbench/nbench: 3.28% (1.1271 => 1.1641, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.23% (0.8855 => 0.9141, std.dev.: 0.0036) MultiSource/Applications/SIBsim4/SIBsim4: 3.21% (1.2568 => 1.2972, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.17% (0.8457 => 0.8725, std.dev.: 0.0071) MultiSource/Applications/hbd/hbd: 3.10% (1.4269 => 1.4712, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.09% (1.3279 => 1.3689, std.dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.06% (1.1170 => 1.1512, std.dev.: 0.0040) MultiSource/Applications/siod/siod: 3.06% (2.2184 => 2.2863, std.dev.: 0.0242) MultiSource/Applications/SPASS/SPASS: 3.00% (14.2605 => 14.6890, std.dev.: 0.1189) MultiSource/Applications/minisat/minisat: 2.87% (0.6834 => 0.7030, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.84% (4.1763 => 4.2951, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.83% (1.6386 => 1.6850, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.81% (4.4880 => 4.6139, std.dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.80% (0.3717 => 0.3821, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 2.75% (31.8598 => 32.7358, std.dev.: 0.1527) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.75% (6.6074 => 6.7890, std.dev.: 0.0318) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.69% (13.1811 => 13.5363, std.dev.: 0.0376) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.64% (0.8359 => 0.8580, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/football/football: 2.61% (0.8768 => 0.8997, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 2.61% (0.7557 => 0.7754, std.dev.: 0.0036) MultiSource/Applications/ClamAV/clamscan: 2.56% (14.7684 => 15.1465, std.dev.: 0.0491) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.52% (0.9074 => 0.9303, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.35% (0.5191 => 0.5313, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.13% (4.4873 => 4.5830, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.09% (0.8261 => 0.8434, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.56% (4.5702 => 4.6413, std.dev.: 0.0244) MultiSource/Benchmarks/mafft/pairlocalalign: 1.44% (8.6247 => 8.7485, std.dev.: 0.0341) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 102.01% (0.0199 => 0.0402, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/pi: 57.06% (1.5795 => 2.4807, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.95% (0.7597 => 0.8961, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.77% (2.9753 => 3.4744, std.dev.: 0.0406) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.71% (2.7995 => 3.2112, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.82% (5.0261 => 5.6202, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.39% (0.3186 => 0.3517, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.11% (1.1857 => 1.2819, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 7.81% (0.1370 => 0.1477, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 7.39% (1.7056 => 1.8316, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: 7.26% (1.3037 => 1.3983, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.69% (4.7794 => 5.0992, std.dev.: 0.0144) MultiSource/Applications/SIBsim4/SIBsim4: 6.46% (3.1873 => 3.3932, std.dev.: 0.0387) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.93% (4.5327 => 4.8015, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.88% (4.9686 => 5.2608, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.74% (6.2275 => 6.5225, std.dev.: 0.0378) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.71% (3.3761 => 3.5350, std.dev.: 0.0466) MultiSource/Applications/lambda-0_1_3/lambda: 4.36% (7.4933 => 7.8198, std.dev.: 0.0541) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.14% (4.9453 => 5.1500, std.dev.: 0.0453) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.11% (4.9469 => 5.1504, std.dev.: 0.0095) MultiSource/Applications/hexxagon/hexxagon: 3.81% (14.0064 => 14.5405, std.dev.: 0.0106) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.72% (1.2337 => 1.2796, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.51% (4.5547 => 4.7147, std.dev.: 0.0353) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.11% (11.5690 => 11.9285, std.dev.: 0.0283) MultiSource/Applications/siod/siod: 3.03% (3.6643 => 3.7754, std.dev.: 0.0319) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.62% (8.2783 => 8.4953, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.45% (4.8660 => 4.9850, std.dev.: 0.0223) SingleSource/Benchmarks/Shootout/lists: 2.34% (7.3375 => 7.5093, std.dev.: 0.0334) SingleSource/Benchmarks/Dhrystone/dry: 2.09% (0.5081 => 0.5187, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.01% (1.1365 => 1.1594, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.84% (4.8362 => 4.9253, std.dev.: 0.0187) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.58% (4.4340 => 4.5041, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.57% (1.2474 => 1.2670, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.41% (2.4647 => 2.4994, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.33% (3.5679 => 3.6152, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/neural/neural: 1.31% (1.0841 => 1.0983, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 1.28% (8.5322 => 8.6412, std.dev.: 0.0411) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.06% (59.2638 => 59.8931, std.dev.: 0.2412) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.73% (5.4641 => 4.3313, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.70% (7.2130 => 6.2972, std.dev.: 0.0489) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.89% (1.0512 => 0.9367, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.87% (1.1216 => 0.9997, std.dev.: 0.0110) MultiSource/Benchmarks/mafft/pairlocalalign: -8.52% (63.1822 => 57.7967, std.dev.: 0.1173) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.10% (14.6451 => 13.6046, std.dev.: 0.1057) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -7.00% (4.7482 => 4.4159, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.36% (0.3269 => 0.3061, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.94% (3.7148 => 3.4942, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.77% (5.4972 => 5.1799, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.09% (5.1557 => 4.8934, std.dev.: 0.0342) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.35% (4.7449 => 4.5384, std.dev.: 0.0338) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.08% (2.8773 => 2.7600, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.66% (6.0224 => 5.8018, std.dev.: 0.0065) MultiSource/Applications/lua/lua: -3.40% (29.8330 => 28.8178, std.dev.: 0.2219) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.36% (0.5807 => 0.5612, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/life/life: -3.34% (2.6356 => 2.5476, std.dev.: 0.0176) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (28.5821 => 27.6950, std.dev.: 0.0279) SingleSource/Benchmarks/Shootout-C++/hash2: -2.40% (3.4237 => 3.3415, std.dev.: 0.0036) MultiSource/Applications/aha/aha: -2.25% (3.3398 => 3.2648, std.dev.: 0.0267) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.93% (11.5316 => 11.3093, std.dev.: 0.0602) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.79% (9.9065 => 9.7291, std.dev.: 0.0576) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.66% (4.9994 => 4.9164, std.dev.: 0.0219) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.3487 => 2.3161, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.12% (5.6343 => 5.5712, std.dev.: 0.0106) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.50% (16.4461 => 16.8571, std.dev.: 0.2276) MultiSource/Applications/obsequi/Obsequi: 3.71% (1.0262 => 1.0643, std.dev.: 0.0097) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6937.91% (0.3123 => 21.9794, std.dev.: 0.3209) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.21% (0.2463 => 0.3675, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: 3.09% (0.6010 => 0.6196, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.69% (0.3266 => 0.3354, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 2.29% (0.1969 => 0.2014, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 3.96% (0.1438 => 0.1495, std.dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.51% (1.1329 => 1.1500, std.dev.: 0.0357) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.10% (0.4164 => 0.4168, std.dev.: 0.0287) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.73% (0.1369 => 0.1420, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.06% (0.0641 => 0.0667, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 36.92% (0.0195 => 0.0267, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.42% (0.0578 => 0.0564, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.66% (1.1437 => 1.1970, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.03% (0.0627 => 0.0646, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.77% (0.8017 => 0.7795, std.dev.: 0.0093) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -29.03% (0.0062 => 0.0044, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 13 23:43:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 01:43:16 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121114074316.8FDC92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5850?compare_to=5845&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5850, Order: 167909, Start Time: 2012-11-14 05:31:43, End Time: 2012-11-14 07:43:33 To: 5845, Order: 167901, Start Time: 2012-11-14 02:29:12, End Time: 2012-11-14 04:40:39 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 49 (163 on baseline) Performance Improvements: 18 (40 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 971 (684 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/messages-2: 17.10% (0.0772 => 0.0904, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 16.64% (0.6713 => 0.7830, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.47% (0.1172 => 0.1365, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.29% (0.0835 => 0.0971, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 15.99% (0.6418 => 0.7444, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.76% (0.5915 => 0.6847, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.65% (0.3163 => 0.3658, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 14.76% (0.6234 => 0.7154, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.67% (0.6168 => 0.7073, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.54% (0.6900 => 0.7903, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/hash: 13.89% (0.4782 => 0.5446, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.78% (0.4187 => 0.4764, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 13.68% (0.5797 => 0.6590, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/office/office: 12.99% (0.3380 => 0.3819, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.71% (0.3761 => 0.4239, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 12.70% (0.6883 => 0.7757, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/fibo: 12.31% (0.2972 => 0.3338, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/lists: 11.68% (0.3817 => 0.4263, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hash2: 11.56% (0.5140 => 0.5734, std.dev.: 0.0110) SingleSource/Regression/C++/ofstream_ctor: 11.45% (0.3171 => 0.3534, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.00% (0.3465 => 0.3846, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.95% (0.4001 => 0.4439, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/methcall: 10.85% (0.3135 => 0.3475, std.dev.: 0.0049) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.81% (0.1277 => 0.1415, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/wc: 10.65% (0.3323 => 0.3677, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/except: 10.59% (0.3145 => 0.3478, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.56% (2.2701 => 2.5099, std.dev.: 0.0248) SingleSource/Benchmarks/Shootout-C++/hello: 10.33% (0.2962 => 0.3268, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/ReedSolomon: 10.00% (0.2200 => 0.2420, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.97% (0.5947 => 0.6540, std.dev.: 0.0210) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 9.17% (0.1330 => 0.1452, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.61% (0.2218 => 0.2409, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.58% (1.6125 => 1.7508, std.dev.: 0.0098) SingleSource/UnitTests/ObjC/parameter-passing: 8.54% (0.4428 => 0.4806, std.dev.: 0.0081) SingleSource/UnitTests/ObjC/for-in: 8.53% (0.4138 => 0.4491, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.14% (0.3969 => 0.4292, std.dev.: 0.0062) SingleSource/UnitTests/SignlessTypes/rem: 8.10% (0.1260 => 0.1362, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.39% (1.7437 => 1.8725, std.dev.: 0.0378) SingleSource/UnitTests/ObjC/exceptions: 5.13% (0.4421 => 0.4648, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.88% (4.8997 => 4.9917, std.dev.: 0.0227) SingleSource/UnitTests/Vector/constpool: 1.00% (56.2405 => 56.8055, std.dev.: 0.1179) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 20.33% (0.0841 => 0.1012, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary3: 19.13% (3.9123 => 4.6608, std.dev.: 0.1536) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.45% (0.5785 => 0.6216, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/hash: 7.17% (0.7603 => 0.8148, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout/hash: 5.43% (5.1220 => 5.4003, std.dev.: 0.0268) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.51% (4.2401 => 4.3467, std.dev.: 0.0186) SingleSource/Benchmarks/CoyoteBench/lpbench: 2.02% (12.0745 => 12.3188, std.dev.: 0.0355) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.33% (3.7915 => 3.8421, std.dev.: 0.0089) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench: -11.31% (0.5764 => 0.5112, std.dev.: 0.0116) SingleSource/Benchmarks/CoyoteBench/lpbench: -10.41% (0.1153 => 0.1033, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -9.33% (0.1662 => 0.1507, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary2: -8.94% (0.4062 => 0.3699, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -8.02% (0.7209 => 0.6631, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.57% (0.1810 => 0.1673, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: -6.16% (0.3814 => 0.3579, std.dev.: 0.0029) MultiSource/Applications/siod/siod: -4.15% (2.7433 => 2.6294, std.dev.: 0.0335) SingleSource/UnitTests/ObjC++/Hello: -2.23% (0.6651 => 0.6503, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.92% (17.7431 => 17.4033, std.dev.: 0.0867) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.68% (21.7338 => 21.3685, std.dev.: 0.1125) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.30% (5.9052 => 5.8283, std.dev.: 0.0265) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -18.40% (4.6671 => 3.8083, std.dev.: 0.3188) SingleSource/Benchmarks/Shootout-C++/ary2: -14.62% (0.0889 => 0.0759, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -8.39% (7.1482 => 6.5485, std.dev.: 0.2100) SingleSource/Benchmarks/Shootout/heapsort: -6.80% (4.2766 => 3.9860, std.dev.: 0.0549) SingleSource/Benchmarks/McGill/chomp: -1.99% (1.2366 => 1.2120, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/fldry: -1.08% (2.0018 => 1.9801, std.dev.: 0.0032) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1338 => 0.1338, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0419 => 0.0420, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.26% (0.0674 => 0.0652, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: 0.00% (494.1545 => 494.1598, std.dev.: 0.0509) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/power/power: 43720.15% (1.1277 => 494.1598, std.dev.: 0.0509) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.17% (0.5229 => 1.5382, std.dev.: 0.1007) MultiSource/Applications/SPASS/SPASS: 21.31% (14.9895 => 18.1834, std.dev.: 0.1441) MultiSource/Applications/kimwitu++/kc: 50.82% (14.1553 => 21.3488, std.dev.: 0.0717) MultiSource/Benchmarks/MallocBench/gs/gs: 22.52% (4.1105 => 5.0362, std.dev.: 0.0519) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.68% (1.1048 => 1.5211, std.dev.: 0.0674) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 438.27% (7.1582 => 38.5306, std.dev.: 0.0368) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.49% (3.4629 => 6.4233, std.dev.: 0.1511) SingleSource/Benchmarks/Misc-C++/stepanov_container: 67.68% (0.6222 => 1.0433, std.dev.: 0.0729) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10886.81% (0.0720 => 7.9105, std.dev.: 0.0811) MultiSource/Applications/SIBsim4/SIBsim4: 3867500.00% (0.0001 => 3.8676, std.dev.: 0.0321) MultiSource/Applications/SPASS/SPASS: 14462500.00% (0.0001 => 14.4626, std.dev.: 0.7189) MultiSource/Applications/kimwitu++/kc: 52100.00% (0.0001 => 0.0522, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 64000.00% (0.0001 => 0.0641, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 621500.00% (0.0001 => 0.6216, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10089600.00% (0.0001 => 10.0897, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6131300.00% (0.0001 => 6.1314, std.dev.: 0.5271) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1808.92% (1.1194 => 21.3685, std.dev.: 0.1125) MultiSource/Applications/ClamAV/clamscan: 61.26% (22.1758 => 35.7604, std.dev.: 0.1924) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 60.35% (2.9384 => 4.7116, std.dev.: 0.2315) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.94% (7.0540 => 11.1410, std.dev.: 0.1210) MultiSource/Benchmarks/FreeBench/distray/distray: 56.53% (0.1056 => 0.1653, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 52.18% (8.1363 => 12.3818, std.dev.: 0.0410) SingleSource/Benchmarks/CoyoteBench/almabench: 49.45% (0.0730 => 0.1091, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 47.31% (21.9371 => 32.3163, std.dev.: 0.1164) SingleSource/Benchmarks/Misc/flops: 38.69% (0.1432 => 0.1986, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/messages-2: 36.56% (0.0662 => 0.0904, std.dev.: 0.0030) SingleSource/Benchmarks/Stanford/Oscar: 35.85% (0.0636 => 0.0864, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 33.01% (0.0730 => 0.0971, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bisort/bisort: 31.76% (0.0614 => 0.0809, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: 31.36% (0.0456 => 0.0599, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 30.98% (0.0326 => 0.0427, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 30.75% (0.1044 => 0.1365, std.dev.: 0.0032) SingleSource/UnitTests/vla: 29.58% (0.0355 => 0.0460, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 28.18% (0.3307 => 0.4239, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 27.42% (0.1940 => 0.2472, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash: 26.98% (0.4289 => 0.5446, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/sumcol: 26.53% (0.2891 => 0.3658, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/FloatMM: 26.18% (0.0401 => 0.0506, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.82% (0.0834 => 0.1041, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists: 24.58% (0.3422 => 0.4263, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/huffbench: 24.57% (0.0871 => 0.1085, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 24.52% (0.3826 => 0.4764, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hash2: 24.11% (0.4620 => 0.5734, std.dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.99% (0.0746 => 0.0925, std.dev.: 0.0046) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 23.82% (0.1125 => 0.1393, std.dev.: 0.0053) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.80% (0.1143 => 0.1415, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/health/health: 22.79% (0.1268 => 0.1557, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 22.76% (0.0479 => 0.0588, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 22.50% (0.2725 => 0.3338, std.dev.: 0.0108) SingleSource/UnitTests/ObjC/parameter-passing: 22.38% (0.3927 => 0.4806, std.dev.: 0.0081) SingleSource/UnitTests/ObjC/exceptions-4: 22.35% (0.3543 => 0.4335, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.14% (0.8172 => 0.9981, std.dev.: 0.0169) MultiSource/Benchmarks/McCat/08-main/main: 22.08% (0.2554 => 0.3118, std.dev.: 0.0219) SingleSource/Benchmarks/Misc/fbench: 21.96% (0.0592 => 0.0722, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 21.78% (0.3136 => 0.3819, std.dev.: 0.0083) SingleSource/Regression/C++/ofstream_ctor: 21.65% (0.2905 => 0.3534, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 21.63% (0.3162 => 0.3846, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 21.62% (0.3650 => 0.4439, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/for-in: 21.58% (0.3694 => 0.4491, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 21.47% (1.5415 => 1.8725, std.dev.: 0.0378) MultiSource/Benchmarks/Prolangs-C++/city/city: 21.46% (2.0665 => 2.5099, std.dev.: 0.0248) SingleSource/UnitTests/ObjC/exceptions: 21.42% (0.3828 => 0.4648, std.dev.: 0.0034) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.20% (0.1566 => 0.1898, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 21.17% (0.1337 => 0.1620, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/except: 21.14% (0.2871 => 0.3478, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/instance-method-metadata: 21.14% (0.3543 => 0.4292, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.14% (14.3668 => 17.4033, std.dev.: 0.0867) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.83% (0.1584 => 0.1914, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/methcall: 20.79% (0.2877 => 0.3475, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 20.72% (0.4103 => 0.4953, std.dev.: 0.0272) MultiSource/Applications/lua/lua: 20.63% (3.8723 => 4.6713, std.dev.: 0.0834) MultiSource/Benchmarks/Olden/tsp/tsp: 20.60% (0.1175 => 0.1417, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.59% (0.5105 => 0.6156, std.dev.: 0.0207) SingleSource/Benchmarks/Shootout-C++/wc: 20.48% (0.3052 => 0.3677, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/hello: 20.41% (0.2714 => 0.3268, std.dev.: 0.0047) MultiSource/Applications/oggenc/oggenc: 20.09% (5.7591 => 6.9160, std.dev.: 0.1141) SingleSource/UnitTests/SignlessTypes/Large/cast: 19.68% (0.0564 => 0.0675, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 19.06% (0.1144 => 0.1362, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 19.05% (4.2646 => 5.0772, std.dev.: 0.0835) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 19.03% (3.8922 => 4.6330, std.dev.: 0.0761) SingleSource/UnitTests/initp1: 18.38% (0.0555 => 0.0657, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Puzzle: 18.14% (0.1268 => 0.1498, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: 18.11% (0.2049 => 0.2420, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.86% (4.9449 => 5.8283, std.dev.: 0.0265) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.83% (5.0018 => 5.8937, std.dev.: 0.0397) MultiSource/Benchmarks/Olden/em3d/em3d: 17.76% (0.1695 => 0.1996, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 17.52% (2.2024 => 2.5883, std.dev.: 0.1382) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.22% (0.0842 => 0.0987, std.dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: 16.99% (9.4845 => 11.0955, std.dev.: 0.1121) MultiSource/Applications/sqlite3/sqlite3: 16.99% (17.1811 => 20.0994, std.dev.: 0.1115) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.84% (1.4186 => 1.6575, std.dev.: 0.0479) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.81% (0.1892 => 0.2210, std.dev.: 0.0103) MultiSource/Applications/d/make_dparser: 16.59% (3.3354 => 3.8889, std.dev.: 0.1217) SingleSource/Benchmarks/Shootout/lists: 16.45% (0.0626 => 0.0729, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.30% (0.0675 => 0.0785, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/matrix: 16.01% (0.0818 => 0.0949, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-3: 15.96% (0.3516 => 0.4077, std.dev.: 0.0145) MultiSource/Applications/hbd/hbd: 15.71% (1.5603 => 1.8055, std.dev.: 0.0327) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.63% (0.1062 => 0.1228, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.59% (0.0648 => 0.0749, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 15.31% (2.0273 => 2.3376, std.dev.: 0.0784) MultiSource/Applications/spiff/spiff: 15.20% (0.7835 => 0.9026, std.dev.: 0.0418) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.81% (0.0770 => 0.0884, std.dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: 14.59% (63.2438 => 72.4699, std.dev.: 0.1319) MultiSource/Applications/Burg/burg: 14.52% (1.1642 => 1.3333, std.dev.: 0.0482) MultiSource/Applications/siod/siod: 14.48% (2.2969 => 2.6294, std.dev.: 0.0335) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.41% (0.0798 => 0.0913, std.dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.39% (0.3121 => 0.3570, std.dev.: 0.0174) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.19% (0.2107 => 0.2406, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 14.11% (1.3050 => 1.4891, std.dev.: 0.0554) SingleSource/UnitTests/ObjC/property: 14.02% (0.3886 => 0.4431, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.78% (0.5981 => 0.6805, std.dev.: 0.0249) SingleSource/Benchmarks/McGill/exptree: 13.76% (0.0814 => 0.0926, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.39% (0.8101 => 0.9186, std.dev.: 0.0400) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.30% (0.6450 => 0.7308, std.dev.: 0.0256) MultiSource/Benchmarks/PAQ8p/paq8p: 13.07% (10.3673 => 11.7225, std.dev.: 0.0811) SingleSource/UnitTests/ObjC/trivial-interface: 12.15% (0.3473 => 0.3895, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 11.99% (0.3561 => 0.3988, std.dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.19% (0.0929 => 0.1033, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.95% (0.1625 => 0.1803, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/moments: 10.38% (0.4048 => 0.4468, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 10.29% (0.3684 => 0.4063, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.27% (0.4636 => 0.5112, std.dev.: 0.0116) MultiSource/Benchmarks/FreeBench/neural/neural: 10.05% (0.1463 => 0.1610, std.dev.: 0.0057) SingleSource/UnitTests/ObjC++/property-reference-object: 9.97% (0.6030 => 0.6631, std.dev.: 0.0186) SingleSource/UnitTests/ObjC++/Hello: 9.76% (0.5925 => 0.6503, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 9.47% (0.3379 => 0.3699, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.13% (0.3232 => 0.3527, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 9.02% (0.3283 => 0.3579, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/matrix: 8.62% (0.3098 => 0.3365, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.49% (0.2793 => 0.3030, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.29% (0.2872 => 0.3110, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.31% (0.2266 => 0.2409, std.dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.07% (7.9617 => 8.3655, std.dev.: 0.0447) SingleSource/UnitTests/Vector/constpool: 4.87% (54.1659 => 56.8055, std.dev.: 0.1179) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.51% (0.3817 => 0.3989, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 151.06% (4.3953 => 11.0349, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/methcall: 147.76% (5.3999 => 13.3786, std.dev.: 0.0021) MultiSource/Benchmarks/llubenchmark/llu: 64.15% (3.7781 => 6.2018, std.dev.: 0.5088) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 27.24% (13.4384 => 17.0993, std.dev.: 0.3245) SingleSource/Benchmarks/Shootout-C++/ary3: 25.22% (3.7221 => 4.6608, std.dev.: 0.1536) MultiSource/Applications/minisat/minisat: 23.01% (9.1159 => 11.2133, std.dev.: 0.2303) MultiSource/Benchmarks/Olden/bisort/bisort: 19.15% (0.8333 => 0.9929, std.dev.: 0.0223) SingleSource/Benchmarks/CoyoteBench/lpbench: 19.07% (10.3460 => 12.3188, std.dev.: 0.0355) SingleSource/Benchmarks/Misc/oourafft: 17.61% (6.6465 => 7.8169, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 17.13% (0.0864 => 0.1012, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.71% (1.1145 => 1.3007, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.18% (0.2944 => 0.3332, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.67% (2.8904 => 3.2277, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.25% (8.6802 => 9.6564, std.dev.: 0.1043) SingleSource/Benchmarks/Misc/richards_benchmark: 10.24% (1.1396 => 1.2563, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 10.06% (0.1421 => 0.1564, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: 10.01% (4.9088 => 5.4003, std.dev.: 0.0268) SingleSource/Benchmarks/Shootout-C++/hash2: 9.54% (3.1578 => 3.4589, std.dev.: 0.0568) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.30% (1.7254 => 1.8859, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 9.30% (0.7455 => 0.8148, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.11% (3.8532 => 4.2044, std.dev.: 0.1130) SingleSource/Benchmarks/Shootout/strcat: 7.37% (0.1899 => 0.2039, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.57% (3.6395 => 3.8421, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.56% (4.2280 => 4.4630, std.dev.: 0.0064) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.07% (11.6436 => 12.1176, std.dev.: 0.0109) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: 3.24% (2.4116 => 2.4897, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.08% (0.3540 => 0.3649, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.28% (1.7133 => 1.7524, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 2.14% (3.1595 => 3.2270, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 2.01% (85.0658 => 86.7771, std.dev.: 0.0095) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.85% (2.1424 => 2.1820, std.dev.: 0.0144) MultiSource/Benchmarks/mafft/pairlocalalign: 1.58% (27.8444 => 28.2841, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.57% (6.5088 => 6.6109, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.48% (5.2139 => 5.2913, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/lists: 1.46% (12.5348 => 12.7172, std.dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0504, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.14% (1.9577 => 1.9801, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1673, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.69% (5.2763 => 1.2300, std.dev.: 0.0644) SingleSource/Benchmarks/Misc/salsa20: -75.89% (0.8651 => 0.2086, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/richards_benchmark: -44.88% (0.1622 => 0.0894, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.73% (5.3855 => 4.9155, std.dev.: 0.0906) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.74% (5.3526 => 4.9917, std.dev.: 0.0227) MultiSource/Applications/JM/ldecod/ldecod: -6.25% (10.4361 => 9.7839, std.dev.: 0.0217) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -47.50% (0.0400 => 0.0210) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.98% (0.3987 => 0.2393, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.92% (0.0506 => 0.0304, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.35% (4.5009 => 2.7748, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: -33.53% (1.1492 => 0.7639, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -24.24% (10.7105 => 8.1146, std.dev.: 0.3191) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.12% (2.6546 => 2.0143, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: -19.16% (0.2161 => 0.1747, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4233, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2840, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.73% (32.5116 => 29.0227, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/mandel-2: -10.62% (1.5373 => 1.3740, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -9.69% (9.5636 => 8.6370, std.dev.: 0.0991) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4244, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4793, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.48% (3.2416 => 3.0317, std.dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5760, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.17% (0.2497 => 0.2368, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -4.23% (6.2999 => 6.0336, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.14% (1.6805 => 1.6109, std.dev.: 0.0266) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.28% (0.9957 => 0.9630, std.dev.: 0.0059) MultiSource/Benchmarks/sim/sim: -3.08% (5.0483 => 4.8928, std.dev.: 0.0029) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.27% (0.4808 => 0.4699, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -2.04% (1.2373 => 1.2120, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.97% (8.1563 => 7.9954, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6771, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -1.45% (10.2830 => 10.1336, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0017) Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 00:27:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 02:27:48 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121114082748.AD7092A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5851?compare_to=5848&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5851, Order: 167914, Start Time: 2012-11-14 07:00:37, End Time: 2012-11-14 08:28:05 To: 5848, Order: 167911, Start Time: 2012-11-14 05:12:01, End Time: 2012-11-14 06:37:03 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (149 on baseline) Unchanged Tests: 1042 (889 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.29% (1.2783 => 1.3715, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.65% (2.0478 => 2.1020, std.dev.: 0.0204) SingleSource/Benchmarks/Misc/salsa20: 2.58% (7.4937 => 7.6873, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/hash2: 2.29% (3.1932 => 3.2662, std.dev.: 0.0239) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.39% (0.1431 => 0.1311, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.62% (0.3821 => 0.3530, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: -6.66% (0.3812 => 0.3558, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.63% (0.3831 => 0.3577, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.62% (0.3896 => 0.3638, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -6.60% (0.3880 => 0.3624, std.dev.: 0.0028) MultiSource/Applications/sgefa/sgefa: -6.58% (0.3357 => 0.3136, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.58% (0.9542 => 0.8914, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.55% (0.3891 => 0.3636, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.51% (0.3884 => 0.3631, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -6.44% (0.3848 => 0.3600, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.43% (0.3142 => 0.2940, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -6.40% (0.4033 => 0.3775, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -6.32% (0.4176 => 0.3912, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -6.23% (2.4924 => 2.3370, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: -6.16% (0.2160 => 0.2027, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.09% (0.6484 => 0.6089, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: -6.05% (9.2283 => 8.6698, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.04% (0.7198 => 0.6763, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: -6.00% (0.4199 => 0.3947, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.94% (0.9852 => 0.9267, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.93% (0.2428 => 0.2284, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: -5.91% (16.1920 => 15.2353, std.dev.: 0.0093) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.90% (0.2355 => 0.2216, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: -5.85% (7.0961 => 6.6810, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/parameter-passing: -5.82% (0.4280 => 0.4031, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.77% (1.0544 => 0.9936, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.72% (6.7716 => 6.3844, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.70% (1.3722 => 1.2940, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: -5.69% (0.1879 => 0.1772, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.69% (0.3658 => 0.3450, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -5.64% (0.9179 => 0.8661, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.57% (0.2695 => 0.2545, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.55% (0.5478 => 0.5174, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.53% (4.8161 => 4.5497, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.47% (4.8802 => 4.6134, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.44% (4.0323 => 3.8128, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.43% (1.6364 => 1.5475, std.dev.: 0.0107) MultiSource/Benchmarks/McCat/05-eks/eks: -5.43% (0.4515 => 0.4270, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.40% (0.6736 => 0.6372, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.39% (3.5339 => 3.3433, std.dev.: 0.0586) MultiSource/Benchmarks/nbench/nbench: -5.37% (1.1530 => 1.0911, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.36% (0.6304 => 0.5966, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -5.36% (0.2985 => 0.2825, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.36% (0.5805 => 0.5494, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.35% (0.6052 => 0.5728, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.35% (0.5849 => 0.5536, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.34% (0.5802 => 0.5492, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.33% (0.5591 => 0.5293, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.32% (0.6395 => 0.6055, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -5.31% (0.3406 => 0.3225, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.31% (1.2300 => 1.1647, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.30% (14.2083 => 13.4549, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.29% (0.5857 => 0.5547, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -5.28% (4.3330 => 4.1044, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.27% (0.5925 => 0.5613, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.27% (1.4642 => 1.3871, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.25% (0.7524 => 0.7129, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.24% (0.6293 => 0.5963, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.24% (0.5569 => 0.5277, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.24% (4.5069 => 4.2709, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.22% (0.5705 => 0.5407, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.22% (0.5859 => 0.5553, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.22% (0.5863 => 0.5557, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.22% (0.7339 => 0.6956, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.21% (0.6194 => 0.5871, std.dev.: 0.0090) MultiSource/Applications/lemon/lemon: -5.21% (1.1450 => 1.0853, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -5.20% (17.1032 => 16.2132, std.dev.: 0.0239) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.20% (0.5581 => 0.5291, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.18% (0.6260 => 0.5936, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.17% (0.6660 => 0.6316, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.16% (0.6297 => 0.5972, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.15% (0.5575 => 0.5288, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.14% (0.6230 => 0.5910, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.12% (0.6446 => 0.6116, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.12% (0.5999 => 0.5692, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.10% (0.6681 => 0.6340, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.10% (0.5570 => 0.5286, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -5.10% (1.2515 => 1.1877, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.08% (1.2784 => 1.2134, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.08% (0.5567 => 0.5284, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.07% (0.6189 => 0.5875, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: -5.07% (1.3864 => 1.3161, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.06% (0.5456 => 0.5180, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.06% (8.0126 => 7.6073, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.03% (0.6676 => 0.6340, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.03% (0.5941 => 0.5642, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.02% (0.6667 => 0.6332, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.99% (0.5688 => 0.5404, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.98% (0.2548 => 0.2421, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.97% (0.6033 => 0.5733, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.90% (0.4916 => 0.4675, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.90% (0.7919 => 0.7531, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.89% (0.6395 => 0.6082, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -4.86% (0.3581 => 0.3407, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.83% (0.6440 => 0.6129, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.83% (0.2278 => 0.2168, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.82% (0.2385 => 0.2270, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: -4.82% (15.5079 => 14.7611, std.dev.: 0.0311) MultiSource/Benchmarks/McCat/08-main/main: -4.81% (0.2659 => 0.2531, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.80% (0.2999 => 0.2855, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.80% (1.2221 => 1.1635, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -4.79% (4.0594 => 3.8651, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.77% (1.2210 => 1.1628, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.74% (0.3483 => 0.3318, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.73% (0.8521 => 0.8118, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -4.68% (15.2527 => 14.5385, std.dev.: 0.0136) MultiSource/Applications/d/make_dparser: -4.68% (3.5154 => 3.3508, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.67% (0.3319 => 0.3164, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: -4.53% (0.7447 => 0.7110, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.50% (22.4056 => 21.3967, std.dev.: 0.0208) MultiSource/Applications/treecc/treecc: -4.44% (2.1401 => 2.0451, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: -4.34% (1.3148 => 1.2578, std.dev.: 0.0185) MultiSource/Applications/oggenc/oggenc: -4.19% (5.0226 => 4.8124, std.dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: -4.18% (34.0927 => 32.6667, std.dev.: 0.0319) SingleSource/UnitTests/ObjC++/property-reference: -4.17% (0.7779 => 0.7455, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -4.13% (2.4021 => 2.3029, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/09-vor/vor: -4.13% (0.3271 => 0.3136, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.05% (2.1713 => 2.0834, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.04% (0.3931 => 0.3772, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -4.01% (0.3194 => 0.3066, std.dev.: 0.0045) MultiSource/Applications/spiff/spiff: -4.00% (0.8418 => 0.8081, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.00% (0.9077 => 0.8714, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.93% (0.3057 => 0.2937, std.dev.: 0.0041) SingleSource/Regression/C++/ofstream_ctor: -3.82% (0.3059 => 0.2942, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.82% (0.2933 => 0.2821, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.81% (0.3252 => 0.3128, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.81% (0.6347 => 0.6105, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -3.78% (0.2989 => 0.2876, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.76% (0.4813 => 0.4632, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -3.74% (0.2939 => 0.2829, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference-object: -3.74% (0.6441 => 0.6200, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -3.61% (18.2933 => 17.6320, std.dev.: 0.0254) SingleSource/Benchmarks/Shootout-C++/ary: -3.59% (0.3394 => 0.3272, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wc: -3.59% (0.3205 => 0.3090, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hello: -3.55% (0.2849 => 0.2748, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.47% (0.3491 => 0.3370, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: -3.29% (0.4524 => 0.4375, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.22% (0.3323 => 0.3216, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -2.50% (20.7746 => 20.2554, std.dev.: 0.0073) MultiSource/Applications/hbd/hbd: -2.06% (1.5610 => 1.5289, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.52% (7.5137 => 5.7465, std.dev.: 0.0161) SingleSource/Benchmarks/Misc/richards_benchmark: -8.75% (1.2842 => 1.1718, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/fbench: -4.09% (2.2633 => 2.1708, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7068, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4712, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0011) Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 01:18:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 03:18:35 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121114091835.7E4842A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5852?compare_to=5849&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5852, Order: 167918, Start Time: 2012-11-14 07:52:43, End Time: 2012-11-14 09:18:53 To: 5849, Order: 167913, Start Time: 2012-11-14 06:08:38, End Time: 2012-11-14 07:35:38 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 4 (98 on baseline) Performance Improvements: 9 (26 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 979 (850 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 2.00% (8.3925 => 8.5605, std.dev.: 0.0381) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 3.97% (0.8492 => 0.8829, std.dev.: 0.0115) MultiSource/Applications/lambda-0_1_3/lambda: 1.26% (7.8198 => 7.9183, std.dev.: 0.0168) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.14% (1.5751 => 1.5930, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.91% (0.8644 => 0.8479, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -1.90% (0.8637 => 0.8473, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.83% (0.9035 => 0.8870, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.60% (0.8942 => 0.8799, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.52% (0.9141 => 0.9002, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.32% (0.8567 => 0.8454, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.99% (1.2670 => 1.2418, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/lists1: -1.87% (0.6272 => 0.6155, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: -1.32% (1.3983 => 1.3799, std.dev.: 0.0045) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.17% (16.8571 => 17.0542, std.dev.: 0.1225) MultiSource/Applications/obsequi/Obsequi: -0.08% (1.0643 => 1.0635, std.dev.: 0.0060) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.16% (21.9794 => 22.0151, std.dev.: 0.3506) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.49% (0.3675 => 0.3657, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/bigfib: -1.03% (0.6196 => 0.6132, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.51% (0.3354 => 0.3371, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: -0.45% (0.2014 => 0.2005, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.36% (0.0220 => 0.0217, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.47% (0.0427 => 0.0425, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0331 => 0.0332, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0312 => 0.0312, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.47% (0.0425 => 0.0423, std.dev.: 0.0105) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0202 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -0.92% (0.0218 => 0.0216, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -1.34% (0.1495 => 0.1475, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.61% (1.1500 => 1.1685, std.dev.: 0.0674) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.24% (0.4168 => 0.4178, std.dev.: 0.0372) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.34% (0.1420 => 0.1401, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -62.50% (0.0008 => 0.0003, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.25% (0.0667 => 0.0632, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -21.72% (0.0267 => 0.0209, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.53% (0.0564 => 0.0561, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.08% (1.1970 => 1.1960, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -77.42% (0.0031 => 0.0007, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.01% (0.0646 => 0.0633, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.00% (0.0267 => 0.0259, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.01% (0.7795 => 0.7796, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -2.27% (0.0044 => 0.0043, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2319.44% (0.6332 => 15.3199, std.dev.: 0.2548) MultiSource/Benchmarks/McCat/08-main/main: 48.12% (0.1831 => 0.2712, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.69% (0.1559 => 0.1408, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1517.52% (0.3344 => 5.4090, std.dev.: 0.1137) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.35% (0.2364 => 0.3247, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: 2.80% (0.0429 => 0.0441, std.dev.: 0.0064) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.36% (0.0224 => 0.0236, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 6.43% (0.1462 => 0.1556, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4784, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0712, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4947, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3184, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1343, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4086, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: -23.98% (2.1832 => 1.6597, std.dev.: 0.0033) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.53% (0.0810 => 0.0952, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.62% (0.0848 => 0.0955, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 12.41% (0.1112 => 0.1250, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.29% (0.0830 => 0.0932, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.72% (0.1905 => 0.2052, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.43% (0.2180 => 0.2342, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.42% (0.6010 => 0.6456, std.dev.: 0.0145) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.73% (0.3137 => 0.3348, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.69% (0.7473 => 0.7973, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.55% (0.2519 => 0.2684, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.24% (0.2998 => 0.3155, std.dev.: 0.0056) MultiSource/Applications/spiff/spiff: 5.02% (0.7950 => 0.8349, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.48% (0.4847 => 0.5064, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.41% (0.5961 => 0.6224, std.dev.: 0.0067) MultiSource/Applications/Burg/burg: 3.78% (1.2222 => 1.2684, std.dev.: 0.0065) MultiSource/Applications/hbd/hbd: 3.74% (1.4269 => 1.4802, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.60% (1.1606 => 1.2024, std.dev.: 0.0158) MultiSource/Applications/minisat/minisat: 3.57% (0.6834 => 0.7078, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.56% (0.4127 => 0.4274, std.dev.: 0.0037) MultiSource/Applications/treecc/treecc: 3.51% (1.9948 => 2.0649, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.35% (0.8340 => 0.8619, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.32% (0.9435 => 0.9748, std.dev.: 0.0107) MultiSource/Applications/SPASS/SPASS: 3.08% (14.2605 => 14.6998, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.06% (0.5817 => 0.5995, std.dev.: 0.0047) MultiSource/Applications/SIBsim4/SIBsim4: 3.02% (1.2568 => 1.2947, std.dev.: 0.0065) MultiSource/Applications/lua/lua: 2.99% (3.8189 => 3.9331, std.dev.: 0.0282) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.99% (0.6227 => 0.6413, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.94% (1.1170 => 1.1498, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.88% (0.8597 => 0.8845, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.83% (0.4559 => 0.4688, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 2.76% (4.1305 => 4.2445, std.dev.: 0.0359) MultiSource/Applications/siod/siod: 2.70% (2.2184 => 2.2784, std.dev.: 0.0182) MultiSource/Applications/ClamAV/clamscan: 2.54% (14.7684 => 15.1440, std.dev.: 0.0821) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.45% (4.4880 => 4.5978, std.dev.: 0.0243) MultiSource/Applications/hexxagon/hexxagon: 2.42% (0.9810 => 1.0047, std.dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: 2.36% (31.8598 => 32.6107, std.dev.: 0.2270) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.33% (1.4479 => 1.4816, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.27% (8.6476 => 8.8442, std.dev.: 0.0406) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.16% (0.8007 => 0.8180, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.03% (0.8286 => 0.8454, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.99% (0.8697 => 0.8870, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.99% (0.8050 => 0.8210, std.dev.: 0.0055) MultiSource/Applications/JM/lencod/lencod: 1.97% (15.3280 => 15.6302, std.dev.: 0.0663) MultiSource/Benchmarks/PAQ8p/paq8p: 1.97% (2.3764 => 2.4232, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.96% (0.9074 => 0.9252, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.95% (0.8317 => 0.8479, std.dev.: 0.0020) MultiSource/Applications/d/make_dparser: 1.94% (3.2366 => 3.2993, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.91% (0.8359 => 0.8519, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.84% (0.9908 => 1.0090, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.82% (0.8177 => 0.8326, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.74% (0.8069 => 0.8209, std.dev.: 0.0022) SingleSource/UnitTests/Vector/constpool: 1.69% (8.4179 => 8.5605, std.dev.: 0.0381) MultiSource/Applications/JM/ldecod/ldecod: 1.67% (6.7320 => 6.8445, std.dev.: 0.0281) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.66% (0.8855 => 0.9002, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.65% (0.8656 => 0.8799, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.64% (0.7932 => 0.8062, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.63% (0.7966 => 0.8096, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.62% (0.8338 => 0.8473, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.53% (0.8316 => 0.8443, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.51% (0.8995 => 0.9131, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.34% (0.8048 => 0.8156, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.32% (0.8885 => 0.9002, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 1.30% (4.9628 => 5.0271, std.dev.: 0.0165) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 77.39% (0.0199 => 0.0353, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/pi: 48.16% (1.5795 => 2.3402, std.dev.: 0.0744) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.49% (0.7597 => 0.8850, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.63% (2.7995 => 3.2092, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.61% (5.0261 => 5.6095, std.dev.: 0.0193) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.89% (0.3186 => 0.3501, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.68% (1.1857 => 1.2768, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 7.12% (1.7056 => 1.8270, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.64% (4.7794 => 5.0967, std.dev.: 0.0116) MultiSource/Applications/SIBsim4/SIBsim4: 5.95% (3.1873 => 3.3769, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.87% (4.9686 => 5.2603, std.dev.: 0.0445) SingleSource/Benchmarks/Misc/richards_benchmark: 5.84% (1.3037 => 1.3799, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.81% (4.5327 => 4.7961, std.dev.: 0.0164) MultiSource/Applications/lambda-0_1_3/lambda: 5.67% (7.4933 => 7.9183, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.70% (3.3761 => 3.5348, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.61% (6.2275 => 6.5147, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.23% (4.9453 => 5.1543, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.06% (4.9469 => 5.1479, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.89% (14.0064 => 14.5510, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 3.15% (3.6643 => 3.7798, std.dev.: 0.0160) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.08% (1.2337 => 1.2717, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.01% (0.3587 => 0.3695, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.96% (8.2783 => 8.5237, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.82% (11.5690 => 11.8955, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/lists: 2.37% (7.3375 => 7.5115, std.dev.: 0.0307) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.28% (4.8660 => 4.9771, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.16% (1.1365 => 1.1611, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.86% (4.8362 => 4.9260, std.dev.: 0.0220) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.79% (41.4238 => 42.1661, std.dev.: 0.1732) MultiSource/Benchmarks/Olden/power/power: 1.55% (1.2061 => 1.2248, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.31% (2.4647 => 2.4970, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: 1.31% (8.5322 => 8.6437, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: 1.13% (2.3560 => 2.3826, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: 1.12% (1.0841 => 1.0962, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.12% (3.5679 => 3.6077, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -34.91% (0.0338 => 0.0220, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/em3d/em3d: -21.15% (5.4641 => 4.3083, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.80% (7.2130 => 6.2896, std.dev.: 0.3006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.12% (1.0512 => 0.9343, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -10.52% (1.1216 => 1.0036, std.dev.: 0.0083) MultiSource/Benchmarks/mafft/pairlocalalign: -8.41% (63.1822 => 57.8695, std.dev.: 0.0598) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.32% (14.6451 => 13.5732, std.dev.: 0.0485) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.92% (4.7482 => 4.4198, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.27% (0.3269 => 0.3064, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.92% (3.7148 => 3.4947, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.90% (5.4972 => 5.1728, std.dev.: 0.0264) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.09% (5.1557 => 4.8935, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.44% (4.7449 => 4.5342, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.29% (2.8773 => 2.7538, std.dev.: 0.0423) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.75% (6.0224 => 5.7965, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C++/life/life: -3.27% (2.6356 => 2.5494, std.dev.: 0.0098) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.01% (28.5821 => 27.7229, std.dev.: 0.0306) MultiSource/Applications/lua/lua: -2.99% (29.8330 => 28.9408, std.dev.: 0.1183) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.96% (0.5807 => 0.5635, std.dev.: 0.0003) MultiSource/Applications/aha/aha: -2.62% (3.3398 => 3.2524, std.dev.: 0.0193) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.42% (3.2169 => 3.1389, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/hash2: -2.40% (3.4237 => 3.3417, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.28% (2.4490 => 2.3931, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.04% (11.5316 => 11.2964, std.dev.: 0.0161) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.67% (2.3487 => 2.3094, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.58% (4.9994 => 4.9206, std.dev.: 0.0162) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 3.70% (16.4461 => 17.0542, std.dev.: 0.1225) MultiSource/Applications/obsequi/Obsequi: 3.63% (1.0262 => 1.0635, std.dev.: 0.0060) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6949.34% (0.3123 => 22.0151, std.dev.: 0.3506) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.48% (0.2463 => 0.3657, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/bigfib: 2.03% (0.6010 => 0.6132, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.21% (0.3266 => 0.3371, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: 1.83% (0.1969 => 0.2005, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0105) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.57% (0.1438 => 0.1475, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 3.14% (1.1329 => 1.1685, std.dev.: 0.0674) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.34% (0.4164 => 0.4178, std.dev.: 0.0372) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.34% (0.1369 => 0.1401, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -62.50% (0.0008 => 0.0003, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.40% (0.0641 => 0.0632, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 7.18% (0.0195 => 0.0209, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.94% (0.0578 => 0.0561, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.57% (1.1437 => 1.1960, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 600.00% (0.0001 => 0.0007, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.96% (0.0627 => 0.0633, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 43.89% (0.0180 => 0.0259, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.76% (0.8017 => 0.7796, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -30.65% (0.0062 => 0.0043, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 02:16:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 04:16:25 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121114101625.B946B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5853?compare_to=5851&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5853, Order: 167922, Start Time: 2012-11-14 08:51:40, End Time: 2012-11-14 10:16:42 To: 5851, Order: 167914, Start Time: 2012-11-14 07:00:37, End Time: 2012-11-14 08:28:05 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (6 on baseline) Performance Improvements: 0 (179 on baseline) Unchanged Tests: 1040 (857 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.20% (55.1103 => 56.3216, std.dev.: 0.1713) MultiSource/Benchmarks/llubenchmark/llu: 1.33% (3.7655 => 3.8154, std.dev.: 0.0114) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.21% (2.0478 => 2.1135, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.20% (54.5751 => 56.3216, std.dev.: 0.1713) SingleSource/Benchmarks/Misc/salsa20: 2.50% (7.4937 => 7.6814, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/hash2: 2.18% (3.1932 => 3.2627, std.dev.: 0.0018) MultiSource/Benchmarks/llubenchmark/llu: 1.92% (3.7435 => 3.8154, std.dev.: 0.0114) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.32% (0.1431 => 0.1312, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.56% (0.3821 => 0.3532, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -6.58% (0.3357 => 0.3136, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.51% (0.9542 => 0.8921, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.40% (0.3142 => 0.2941, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -6.21% (2.4924 => 2.3376, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.10% (0.7198 => 0.6759, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: -6.02% (0.2160 => 0.2030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.01% (0.2428 => 0.2282, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -5.97% (9.2283 => 8.6775, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.94% (0.9852 => 0.9267, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -5.90% (16.1920 => 15.2374, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.85% (0.1796 => 0.1691, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: -5.83% (0.3896 => 0.3669, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.82% (0.3880 => 0.3654, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -5.80% (0.1879 => 0.1770, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -5.80% (0.3812 => 0.3591, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.80% (0.3658 => 0.3446, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -5.80% (0.3848 => 0.3625, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.77% (0.2355 => 0.2219, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: -5.77% (0.3831 => 0.3610, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -5.76% (7.0961 => 6.6877, std.dev.: 0.0146) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.74% (0.3884 => 0.3661, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.71% (0.3891 => 0.3669, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -5.70% (0.4033 => 0.3803, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.70% (1.0544 => 0.9943, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.68% (1.3722 => 1.2942, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: -5.58% (0.4176 => 0.3943, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.58% (4.8161 => 4.5474, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.57% (0.5478 => 0.5173, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.57% (0.6484 => 0.6123, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.57% (6.7716 => 6.3947, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/football/football: -5.53% (0.9179 => 0.8671, std.dev.: 0.0115) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.50% (4.8802 => 4.6119, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.49% (0.2695 => 0.2547, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.43% (0.5857 => 0.5539, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: -5.43% (0.4515 => 0.4270, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.41% (1.2300 => 1.1634, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.41% (3.5339 => 3.3426, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.36% (0.6304 => 0.5966, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: -5.36% (0.4199 => 0.3974, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.36% (0.5863 => 0.5549, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.35% (0.5849 => 0.5536, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.33% (4.0323 => 3.8172, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.31% (0.5805 => 0.5497, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.30% (0.6395 => 0.6056, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.30% (0.6189 => 0.5861, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.30% (4.5069 => 4.2681, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.30% (1.6364 => 1.5497, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.27% (0.5925 => 0.5613, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.26% (14.2083 => 13.4607, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.26% (0.5802 => 0.5497, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.26% (0.5575 => 0.5282, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -5.26% (0.3406 => 0.3227, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -5.25% (1.1450 => 1.0849, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.24% (0.5569 => 0.5277, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.23% (0.6446 => 0.6109, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.23% (0.6676 => 0.6327, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.22% (0.5591 => 0.5299, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.21% (0.6660 => 0.6313, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: -5.20% (1.2515 => 1.1864, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.20% (0.6230 => 0.5906, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -5.20% (17.1032 => 16.2139, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.20% (0.6194 => 0.5872, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.20% (0.5581 => 0.5291, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.19% (0.6260 => 0.5935, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.19% (0.5859 => 0.5555, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.19% (0.5705 => 0.5409, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.18% (0.6297 => 0.5971, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.16% (1.2210 => 1.1580, std.dev.: 0.0091) MultiSource/Benchmarks/MallocBench/gs/gs: -5.15% (4.3330 => 4.1098, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.15% (1.2784 => 1.2126, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.14% (0.7524 => 0.7137, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.13% (0.6681 => 0.6338, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -5.13% (0.2985 => 0.2832, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.12% (0.7339 => 0.6963, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.12% (1.4642 => 1.3892, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.11% (0.6736 => 0.6392, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: -5.09% (1.3864 => 1.3159, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.07% (0.6052 => 0.5745) SingleSource/UnitTests/ObjC/parameter-passing: -5.07% (0.4280 => 0.4063, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.07% (0.8521 => 0.8089, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.07% (0.6667 => 0.6329, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.06% (0.5570 => 0.5288, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.06% (0.5456 => 0.5180, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.05% (8.0126 => 7.6080, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.05% (0.5567 => 0.5286, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: -5.04% (0.2659 => 0.2525, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.02% (0.2548 => 0.2420, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.00% (0.2999 => 0.2849, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.99% (0.6395 => 0.6076, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.95% (0.5941 => 0.5647, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.92% (0.5688 => 0.5408, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.92% (0.6440 => 0.6123, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.88% (0.6293 => 0.5986, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: -4.87% (15.5079 => 14.7528, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.86% (0.4916 => 0.4677, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.86% (0.6033 => 0.5740, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.84% (1.2221 => 1.1630, std.dev.: 0.0071) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.83% (0.2278 => 0.2168, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.78% (0.2385 => 0.2271, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.77% (0.3483 => 0.3317, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.74% (0.5168 => 0.4923, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -4.74% (0.7447 => 0.7094, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: -4.71% (3.5154 => 3.3497, std.dev.: 0.0038) MultiSource/Applications/lua/lua: -4.65% (4.0594 => 3.8708, std.dev.: 0.0106) MultiSource/Applications/ClamAV/clamscan: -4.63% (15.2527 => 14.5470, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.58% (0.5999 => 0.5724, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.57% (0.7919 => 0.7557, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.53% (1.6474 => 1.5727, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.48% (22.4056 => 21.4026, std.dev.: 0.0186) MultiSource/Benchmarks/McCat/18-imp/imp: -4.44% (0.3581 => 0.3422, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.43% (0.7021 => 0.6710, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.43% (0.5329 => 0.5093, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -4.42% (1.1530 => 1.1020, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -4.37% (1.3148 => 1.2573, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: -4.33% (2.1401 => 2.0475, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: -4.24% (5.0226 => 4.8096, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/matrix: -4.24% (0.3255 => 0.3117, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: -4.22% (0.3271 => 0.3133, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.22% (0.3319 => 0.3179, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: -4.21% (34.0927 => 32.6589, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/methcall: -4.20% (0.3025 => 0.2898, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.17% (0.3837 => 0.3677, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.12% (0.4151 => 0.3980, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.10% (2.1713 => 2.0823, std.dev.: 0.0036) MultiSource/Applications/siod/siod: -4.08% (2.4021 => 2.3041, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference: -4.06% (0.7779 => 0.7463, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: -4.05% (0.4861 => 0.4664, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.05% (0.3016 => 0.2894) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.04% (0.3931 => 0.3772, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/except: -4.03% (0.3026 => 0.2904, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -4.01% (0.3194 => 0.3066, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.99% (0.3057 => 0.2935, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.99% (0.9077 => 0.8715, std.dev.: 0.0040) MultiSource/Applications/spiff/spiff: -3.93% (0.8418 => 0.8087, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.91% (0.9557 => 0.9183, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.85% (2.2587 => 2.1718, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/fibo: -3.83% (0.2871 => 0.2761, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: -3.81% (0.2939 => 0.2827, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -3.79% (0.4248 => 0.4087, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists: -3.78% (0.3621 => 0.3484, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.77% (0.3849 => 0.3704, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -3.76% (0.3481 => 0.3350, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -3.75% (0.2989 => 0.2877, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: -3.73% (0.6347 => 0.6110, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.72% (0.2903 => 0.2795, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.72% (0.2933 => 0.2824, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -3.70% (0.3867 => 0.3724, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -3.69% (0.3446 => 0.3319, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -3.66% (0.3059 => 0.2947, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -3.66% (18.2933 => 17.6242, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.65% (0.4083 => 0.3934, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -3.65% (0.4524 => 0.4359, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.63% (0.3252 => 0.3134, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: -3.62% (0.3394 => 0.3271, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hello: -3.62% (0.2849 => 0.2746, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.62% (0.4813 => 0.4639, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.61% (0.3491 => 0.3365, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.59% (0.4427 => 0.4268, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -3.59% (0.3205 => 0.3090, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -3.57% (0.6441 => 0.6211, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: -3.57% (0.7982 => 0.7697, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -3.38% (0.6750 => 0.6522, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/sieve: -3.27% (0.3788 => 0.3664, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.22% (5.4682 => 5.2923, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.04% (0.3323 => 0.3222, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.54% (20.7746 => 20.2478, std.dev.: 0.0200) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.45% (0.4321 => 0.4215, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -2.43% (1.5610 => 1.5230, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7532, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -8.66% (1.2842 => 1.1730, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.83% (2.2633 => 2.1766, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4681, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0003) Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 02:19:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 04:19:02 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121114101902.602C22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5854?compare_to=5847&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5854, Order: 167914, Start Time: 2012-11-14 06:57:56, End Time: 2012-11-14 10:19:19 To: 5847, Order: 167906, Start Time: 2012-11-14 02:54:20, End Time: 2012-11-14 06:09:43 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (168 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (723 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 31.76% (0.4046 => 0.5331, std.dev.: 0.0276) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.56% (54.0326 => 54.8744, std.dev.: 0.0417) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.44% (0.0625 => 0.0884, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.55% (0.1063 => 0.1409, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.10% (0.2969 => 0.3744, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.89% (0.0475 => 0.0598, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.50% (0.1106 => 0.1388, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.79% (0.4139 => 0.5165, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.34% (0.5900 => 0.7336, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.31% (0.4253 => 0.5287, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 24.03% (1.5932 => 1.9761, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.81% (0.0714 => 0.0884, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.65% (0.4994 => 0.6175, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.30% (0.5000 => 0.6165, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.95% (0.0584 => 0.0718, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.78% (0.1620 => 0.1989, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.14% (0.1021 => 0.1247, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 22.04% (0.0599 => 0.0731, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.85% (0.0897 => 0.1093, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.77% (0.1107 => 0.1348, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.67% (0.1103 => 0.1342, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.17% (0.0633 => 0.0767, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 21.10% (0.0948 => 0.1148, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.06% (0.0584 => 0.0707, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.72% (0.0642 => 0.0775, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.52% (0.0541 => 0.0652, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 20.46% (0.0821 => 0.0989, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.44% (0.0822 => 0.0990, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.37% (0.3903 => 0.4698, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.26% (0.1604 => 0.1929, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.24% (0.1003 => 0.1206, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.21% (0.1549 => 0.1862, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 20.14% (0.1619 => 0.1945, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 19.22% (0.0947 => 0.1129, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.95% (0.1462 => 0.1739, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 18.56% (0.0808 => 0.0958, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.51% (0.3890 => 0.4610, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.37% (0.2014 => 0.2384, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 18.31% (0.1218 => 0.1441, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 18.24% (0.4029 => 0.4764, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.09% (1.3152 => 1.5531, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/mst/mst: 18.05% (0.0698 => 0.0824, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.00% (0.2866 => 0.3382, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 17.97% (0.5826 => 0.6873, std.dev.: 0.0139) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.93% (0.1160 => 0.1368, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.74% (0.1088 => 0.1281, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.68% (0.1968 => 0.2316, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 17.67% (0.1505 => 0.1771, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.58% (0.2736 => 0.3217, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 17.35% (0.5889 => 0.6911, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.32% (3.5627 => 4.1796, std.dev.: 0.0046) MultiSource/Applications/Burg/burg: 17.02% (0.5546 => 0.6490, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.92% (1.6211 => 1.8954, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.88% (0.3271 => 0.3823, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 16.87% (1.8794 => 2.1965, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.72% (0.4658 => 0.5437, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 16.55% (0.9697 => 1.1302, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.47% (0.2738 => 0.3189, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference: 16.41% (0.7171 => 0.8348, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.38% (0.2875 => 0.3346, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 16.33% (0.1421 => 0.1653, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.14% (0.4361 => 0.5065, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 16.00% (0.2750 => 0.3190, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 15.97% (0.1284 => 0.1489, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 15.91% (0.3004 => 0.3482, std.dev.: 0.0184) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.85% (0.3930 => 0.4553, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/objinst: 15.80% (0.2823 => 0.3269, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 15.80% (1.0781 => 1.2484, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: 15.78% (0.2813 => 0.3257, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 15.77% (0.2714 => 0.3142, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 15.67% (0.2725 => 0.3152, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/matrix: 15.65% (0.2780 => 0.3215, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.61% (2.7292 => 3.1553, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.52% (0.5026 => 0.5806, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.51% (0.2792 => 0.3225, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.50% (0.2729 => 0.3152, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 15.39% (4.2109 => 4.8588, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/random: 15.38% (0.2803 => 0.3234, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 15.37% (0.9909 => 1.1432, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/except: 15.37% (0.2811 => 0.3243, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.36% (0.2911 => 0.3358, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.26% (4.4195 => 5.0940, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.25% (2.0673 => 2.3825, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.15% (0.3195 => 0.3679, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/wc: 15.15% (0.3096 => 0.3565, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.07% (1.9694 => 2.2661, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 15.06% (0.3267 => 0.3759, std.dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 14.93% (0.2566 => 0.2949, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.90% (1.9966 => 2.2941, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/ary: 14.89% (0.3258 => 0.3743, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.85% (0.3488 => 0.4006, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.77% (0.1090 => 0.1251, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 14.59% (23.5202 => 26.9525, std.dev.: 0.5920) SingleSource/UnitTests/ObjC/for-in: 14.50% (0.3496 => 0.4003, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary2: 14.50% (0.3317 => 0.3798, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions-2: 14.45% (0.3446 => 0.3944, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 14.38% (0.3469 => 0.3968, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.38% (0.3060 => 0.3500, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 14.35% (0.3442 => 0.3936, std.dev.: 0.0082) SingleSource/UnitTests/ObjC/exceptions-4: 14.31% (0.3465 => 0.3961, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.28% (0.3362 => 0.3842, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.28% (0.3124 => 0.3570, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 14.22% (0.3460 => 0.3952, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/moments: 14.08% (0.3678 => 0.4196, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.07% (0.3625 => 0.4135, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 14.03% (0.3650 => 0.4162, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/lists: 14.01% (0.3348 => 0.3817, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.99% (0.3282 => 0.3741, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 13.98% (0.2075 => 0.2365, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash: 13.94% (0.4146 => 0.4724, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 13.94% (0.2691 => 0.3066, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 13.89% (1.4269 => 1.6251, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 13.86% (0.3643 => 0.4148, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/sieve: 13.85% (0.3726 => 0.4242, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 13.81% (0.3477 => 0.3957, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/parameter-passing: 13.75% (0.3724 => 0.4236, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/hash2: 13.43% (0.4251 => 0.4822, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 13.31% (2.1653 => 2.4535, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 13.23% (0.7875 => 0.8917, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.22% (0.3690 => 0.4178, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.21% (0.3981 => 0.4507, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 12.91% (4.6177 => 5.2138, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 12.78% (2.1013 => 2.3698, std.dev.: 0.0699) SingleSource/Benchmarks/Misc-C++/bigfib: 12.59% (0.5012 => 0.5643, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.16% (0.2040 => 0.2288, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 11.79% (5.5417 => 6.1953, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.52% (0.6435 => 0.7176, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.35% (0.1383 => 0.1540, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 11.01% (0.3498 => 0.3883, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.60% (0.1028 => 0.1137, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.49% (0.2068 => 0.2285, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.43% (0.6634 => 0.7326, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.38% (0.2737 => 0.3021, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.34% (0.3084 => 0.3403, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.34% (0.3336 => 0.3681, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 9.96% (0.4847 => 0.5330, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 9.30% (2.0346 => 2.2238, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.27% (0.2103 => 0.2298, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 9.20% (0.2391 => 0.2611, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.13% (0.5361 => 0.5797, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.10% (4.6926 => 5.0728, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.08% (11.6398 => 12.5798, std.dev.: 0.0471) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.65% (0.5584 => 0.6011, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.23% (0.7426 => 0.7963, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 6.22% (11.9555 => 12.6989, std.dev.: 0.0173) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.01% (0.3792 => 0.3982, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 10.53% (0.2802 => 0.3097, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.61% (0.3693 => 0.3937, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6111, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6750, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary: 5.04% (0.2122 => 0.2229, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-2: 4.87% (1.8057 => 1.8937, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1697, std.dev.: 0.0211) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2012, std.dev.: 0.0408) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2236, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.50% (7.1849 => 7.2926, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3062, std.dev.: 0.0136) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.39% (1.0142 => 1.0283, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5151, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0062) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5886, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.76% (25.4195 => 16.5832, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/ary2: -8.16% (0.2402 => 0.2206, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9786, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8012, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8038, std.dev.: 0.1496) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.04% (0.6293 => 0.6102, std.dev.: 0.0053) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -2.86% (17.2379 => 16.7449, std.dev.: 0.1773) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8650, std.dev.: 0.2560) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5737, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4950, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.18% (105.3826 => 104.1397, std.dev.: 0.1036) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0416, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 02:51:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 04:51:23 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121114105123.11A4A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5855?compare_to=5850&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5855, Order: 167920, Start Time: 2012-11-14 08:40:39, End Time: 2012-11-14 10:51:38 To: 5850, Order: 167909, Start Time: 2012-11-14 05:31:43, End Time: 2012-11-14 07:43:33 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 45 (145 on baseline) Performance Improvements: 12 (39 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 981 (703 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 16.75% (0.1421 => 0.1659, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.89% (0.1048 => 0.1204, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.44% (0.1177 => 0.1347, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.99% (0.3210 => 0.3659, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 13.85% (0.0780 => 0.0888, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 13.45% (0.6307 => 0.7155, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 13.23% (0.6871 => 0.7780, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.12% (0.6165 => 0.6974, std.dev.: 0.0110) MultiSource/Applications/aha/aha: 13.12% (0.1326 => 0.1500, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 12.96% (1.3333 => 1.5061, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 12.66% (0.5918 => 0.6667, std.dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.36% (1.3135 => 1.4759, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.04% (0.5638 => 0.6317, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.41% (1.0433 => 1.1519, std.dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.26% (0.7308 => 0.8058, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.26% (0.3110 => 0.3429, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.00% (0.3030 => 0.3333, std.dev.: 0.0079) MultiSource/Applications/spiff/spiff: 9.37% (0.9026 => 0.9872, std.dev.: 0.0081) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.10% (0.3570 => 0.3895, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/bh/bh: 8.79% (0.3321 => 0.3613, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.76% (0.9186 => 0.9991, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 8.54% (1.0108 => 1.0971, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.00% (0.5063 => 0.5468, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/tsp/tsp: 7.27% (0.1417 => 0.1520, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.23% (0.3916 => 0.4199, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.07% (1.2300 => 1.3170, std.dev.: 0.0227) MultiSource/Applications/viterbi/viterbi: 6.54% (0.1788 => 0.1905, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.14% (0.4953 => 0.5257, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.03% (2.3613 => 2.5037, std.dev.: 0.0188) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.40% (6.4233 => 6.7703, std.dev.: 0.0621) MultiSource/Applications/oggenc/oggenc: 3.82% (6.9160 => 7.1804, std.dev.: 0.0287) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.08% (5.0772 => 5.1830, std.dev.: 0.0300) MultiSource/Applications/SPASS/SPASS: 1.37% (18.1834 => 18.4321, std.dev.: 0.0390) Performance Regressions - Execution Time ---------------------------------------- SingleSource/UnitTests/ObjC/synchronized: 78.38% (0.1073 => 0.1914, std.dev.: 0.0301) SingleSource/Benchmarks/Shootout-C++/moments: 18.68% (0.1210 => 0.1436, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.74% (3.8083 => 4.3696, std.dev.: 0.1973) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 12.62% (5.5304 => 6.2283, std.dev.: 0.1318) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 10.15% (2.9197 => 3.2161, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.19% (0.3144 => 0.3370, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.21% (6.1283 => 6.3865, std.dev.: 0.0992) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 3.53% (4.6599 => 4.8243, std.dev.: 0.0221) SingleSource/Benchmarks/Shootout-C++/lists1: 2.42% (0.6166 => 0.6315, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.73% (6.0616 => 6.1662, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ackermann: 1.57% (1.7524 => 1.7799, std.dev.: 0.0097) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.12% (2.1820 => 2.2064, std.dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/sumcol: -13.56% (0.3658 => 0.3162, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -11.80% (0.4764 => 0.4202, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: -11.18% (0.3819 => 0.3392, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: -9.71% (0.2472 => 0.2232, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: -9.24% (2.5099 => 2.2780, std.dev.: 0.0324) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.13% (0.7830 => 0.7507, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.55% (0.6847 => 0.6604, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.80% (0.7154 => 0.7025, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -17.09% (0.1012 => 0.0839, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/bisort/bisort: -12.83% (0.9929 => 0.8655, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: -10.01% (1.4641 => 1.3175, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: -6.71% (0.8148 => 0.7601, std.dev.: 0.0196) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1338 => 0.1338, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0420 => 0.0420, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0652 => 0.0652, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -0.07% (494.1598 => 493.7895, std.dev.: 0.3365) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/power/power: 43687.31% (1.1277 => 493.7895, std.dev.: 0.3365) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.38% (0.5229 => 1.5393, std.dev.: 0.1060) MultiSource/Applications/SPASS/SPASS: 22.97% (14.9895 => 18.4321, std.dev.: 0.0390) MultiSource/Applications/kimwitu++/kc: 50.45% (14.1553 => 21.2970, std.dev.: 0.1749) MultiSource/Benchmarks/MallocBench/gs/gs: 23.62% (4.1105 => 5.0814, std.dev.: 0.0271) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 42.99% (1.1048 => 1.5798, std.dev.: 0.0397) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 439.13% (7.1582 => 38.5917, std.dev.: 0.0485) SingleSource/Benchmarks/Misc-C++-EH/spirit: 95.51% (3.4629 => 6.7703, std.dev.: 0.0621) SingleSource/Benchmarks/Misc-C++/stepanov_container: 85.13% (0.6222 => 1.1519, std.dev.: 0.0106) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10878.75% (0.0720 => 7.9047, std.dev.: 0.0722) MultiSource/Applications/SIBsim4/SIBsim4: 3913300.00% (0.0001 => 3.9134, std.dev.: 0.0204) MultiSource/Applications/SPASS/SPASS: 14674500.00% (0.0001 => 14.6746, std.dev.: 0.2267) MultiSource/Applications/kimwitu++/kc: 52200.00% (0.0001 => 0.0523, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 64700.00% (0.0001 => 0.0648, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 616300.00% (0.0001 => 0.6164, std.dev.: 0.0149) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10090600.00% (0.0001 => 10.0907, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6075300.00% (0.0001 => 6.0754, std.dev.: 0.1323) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1817.55% (1.1194 => 21.4651, std.dev.: 0.1185) MultiSource/Applications/ClamAV/clamscan: 61.54% (22.1758 => 35.8222, std.dev.: 0.2197) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 60.63% (2.9384 => 4.7200, std.dev.: 0.2776) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.95% (7.0540 => 11.1419, std.dev.: 0.1108) MultiSource/Benchmarks/FreeBench/distray/distray: 54.73% (0.1056 => 0.1634, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 51.64% (8.1363 => 12.3380, std.dev.: 0.0588) MultiSource/Applications/JM/lencod/lencod: 47.84% (21.9371 => 32.4323, std.dev.: 0.0739) SingleSource/Benchmarks/CoyoteBench/almabench: 47.81% (0.0730 => 0.1079, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 39.46% (0.1432 => 0.1997, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/voronoi/voronoi: 35.52% (0.2700 => 0.3659, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 34.58% (0.0746 => 0.1004, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 34.22% (0.1236 => 0.1659, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 32.14% (0.0672 => 0.0888, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 30.87% (0.0528 => 0.0691, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 30.52% (0.1032 => 0.1347, std.dev.: 0.0046) MultiSource/Applications/aha/aha: 30.32% (0.1151 => 0.1500, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/family/family: 30.23% (0.0397 => 0.0517, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 29.37% (1.1642 => 1.5061, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/tsp/tsp: 29.36% (0.1175 => 0.1520, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 29.05% (0.0933 => 0.1204, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 28.13% (0.4103 => 0.5257, std.dev.: 0.0070) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.73% (0.1125 => 0.1437, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 26.30% (0.0403 => 0.0509, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 26.00% (0.7835 => 0.9872, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/functionobjects: 25.84% (0.5020 => 0.6317, std.dev.: 0.0068) MultiSource/Benchmarks/BitBench/five11/five11: 25.22% (0.0567 => 0.0710, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/17-bintr/bintr: 25.04% (0.0675 => 0.0844, std.dev.: 0.0024) MultiSource/Benchmarks/NPB-serial/is/is: 25.03% (0.0719 => 0.0899, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 24.93% (0.6450 => 0.8058, std.dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.80% (0.3121 => 0.3895, std.dev.: 0.0044) MultiSource/Applications/oggenc/oggenc: 24.68% (5.7591 => 7.1804, std.dev.: 0.0287) MultiSource/Benchmarks/Ptrdist/bc/bc: 24.43% (1.1861 => 1.4759, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.92% (0.0648 => 0.0803, std.dev.: 0.0020) SingleSource/Benchmarks/Stanford/Oscar: 23.74% (0.0636 => 0.0787, std.dev.: 0.0038) MultiSource/Benchmarks/llubenchmark/llu: 23.59% (0.0462 => 0.0571, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 23.33% (0.8101 => 0.9991, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 22.98% (0.8921 => 1.0971, std.dev.: 0.0109) MultiSource/Applications/viterbi/viterbi: 22.51% (0.1555 => 0.1905, std.dev.: 0.0042) MultiSource/Applications/siod/siod: 22.38% (2.2969 => 2.8109, std.dev.: 0.1011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.62% (14.3668 => 17.4727, std.dev.: 0.0545) MultiSource/Benchmarks/MallocBench/espresso/espresso: 21.54% (4.2646 => 5.1830, std.dev.: 0.0300) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 21.19% (0.0793 => 0.0961, std.dev.: 0.0051) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.71% (0.1584 => 0.1912, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.44% (1.3050 => 1.5717, std.dev.: 0.0354) SingleSource/UnitTests/ObjC/exceptions-2: 20.07% (0.3497 => 0.4199, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 19.88% (0.5105 => 0.6120, std.dev.: 0.0263) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.61% (0.4203 => 0.5027, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/heapsort: 19.39% (0.2872 => 0.3429, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 19.37% (0.0640 => 0.0764, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 19.33% (0.2793 => 0.3333, std.dev.: 0.0079) MultiSource/Applications/lua/lua: 19.05% (3.8723 => 4.6099, std.dev.: 0.1094) SingleSource/UnitTests/SignlessTypes/Large/cast: 18.97% (0.0564 => 0.0671, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/matrix: 18.83% (0.0818 => 0.0972, std.dev.: 0.0046) SingleSource/UnitTests/SignlessTypes/rem: 18.27% (0.1144 => 0.1353, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.09% (5.0018 => 5.9066, std.dev.: 0.0376) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 18.06% (4.9449 => 5.8380, std.dev.: 0.0220) SingleSource/UnitTests/ObjC/property: 17.86% (0.3886 => 0.4580, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.62% (0.9765 => 1.1486, std.dev.: 0.0440) MultiSource/Benchmarks/mafft/pairlocalalign: 17.52% (9.4845 => 11.1466, std.dev.: 0.1356) MultiSource/Applications/sqlite3/sqlite3: 17.26% (17.1811 => 20.1465, std.dev.: 0.0740) SingleSource/UnitTests/Vector/SSE/sse_isamax: 17.05% (0.0704 => 0.0824, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 16.96% (1.5603 => 1.8249, std.dev.: 0.0391) MultiSource/Benchmarks/Olden/bh/bh: 16.85% (0.3092 => 0.3613, std.dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.76% (0.0871 => 0.1017, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/exceptions-3: 16.50% (0.3516 => 0.4096, std.dev.: 0.0133) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.48% (0.8172 => 0.9519, std.dev.: 0.0359) MultiSource/Benchmarks/Olden/mst/mst: 16.42% (0.1163 => 0.1354, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.08% (0.2065 => 0.2397, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 15.58% (0.5981 => 0.6913, std.dev.: 0.0220) MultiSource/Applications/d/make_dparser: 15.52% (3.3354 => 3.8529, std.dev.: 0.0609) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.35% (0.0886 => 0.1022, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/moments: 15.22% (0.4048 => 0.4664, std.dev.: 0.0183) MultiSource/Benchmarks/Bullet/bullet: 15.16% (63.2438 => 72.8336, std.dev.: 0.0348) MultiSource/Benchmarks/Olden/health/health: 15.06% (0.1268 => 0.1459, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.05% (0.1940 => 0.2232, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.94% (0.0770 => 0.0885, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.59% (0.1117 => 0.1280, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.41% (0.0798 => 0.0913, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.38% (0.2107 => 0.2410, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.27% (0.0834 => 0.0953, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.10% (0.5569 => 0.6354, std.dev.: 0.0267) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.06% (0.1337 => 0.1525, std.dev.: 0.0058) MultiSource/Applications/treecc/treecc: 13.97% (2.0273 => 2.3105, std.dev.: 0.0400) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.79% (3.8922 => 4.4291, std.dev.: 0.1729) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.69% (2.2022 => 2.5037, std.dev.: 0.0188) MultiSource/Applications/sgefa/sgefa: 13.44% (0.3109 => 0.3527, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.38% (0.1510 => 0.1712, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.30% (0.2271 => 0.2573, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 12.39% (10.3673 => 11.6515, std.dev.: 0.0831) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.07% (0.4879 => 0.5468, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/parameter-passing: 12.04% (0.3927 => 0.4400, std.dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.63% (0.8067 => 0.9005, std.dev.: 0.0207) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.23% (0.1906 => 0.2120, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.10% (0.2603 => 0.2892, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 10.80% (0.1268 => 0.1405, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.34% (1.4186 => 1.5653, std.dev.: 0.0533) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.23% (2.0665 => 2.2780, std.dev.: 0.0324) MultiSource/Benchmarks/FreeBench/neural/neural: 10.05% (0.1463 => 0.1610, std.dev.: 0.0034) MultiSource/Benchmarks/sim/sim: 10.01% (0.3387 => 0.3726, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 9.93% (0.3282 => 0.3608, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.83% (0.3826 => 0.4202, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.16% (0.3136 => 0.3392, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: 5.44% (54.1659 => 57.1151, std.dev.: 0.0839) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.36% (7.9617 => 8.3882, std.dev.: 0.0270) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.72% (4.3953 => 11.0198, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/methcall: 147.71% (5.3999 => 13.3762, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 82.11% (0.1051 => 0.1914, std.dev.: 0.0301) MultiSource/Benchmarks/llubenchmark/llu: 42.09% (3.7781 => 5.3683, std.dev.: 0.3560) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 25.71% (13.4384 => 16.8932, std.dev.: 0.3021) SingleSource/Benchmarks/Shootout-C++/moments: 23.90% (0.1159 => 0.1436, std.dev.: 0.0050) MultiSource/Applications/minisat/minisat: 21.47% (9.1159 => 11.0732, std.dev.: 0.2789) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.82% (1.1145 => 1.3131, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 17.65% (6.6465 => 7.8195, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/lpbench: 15.61% (10.3460 => 11.9611, std.dev.: 0.1923) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.01% (0.2944 => 0.3327, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.69% (2.8904 => 3.2282, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.53% (8.6802 => 9.5944, std.dev.: 0.1420) SingleSource/Benchmarks/Misc/richards_benchmark: 10.29% (1.1396 => 1.2569, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.77% (0.3070 => 0.3370, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.65% (1.7254 => 1.8919, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.88% (4.2280 => 4.4767, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.34% (3.6395 => 3.8339, std.dev.: 0.0106) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 4.18% (0.4445 => 0.4631, std.dev.: 0.0052) MultiSource/Benchmarks/nbench/nbench: 4.03% (11.6436 => 12.1130, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.89% (1.7133 => 1.7799, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/bisort/bisort: 3.86% (0.8333 => 0.8655, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.99% (2.1424 => 2.2064, std.dev.: 0.0065) SingleSource/Benchmarks/Dhrystone/dry: 2.65% (2.4116 => 2.4756, std.dev.: 0.0117) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.63% (1.2838 => 1.3175, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 2.33% (0.6171 => 0.6315, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 2.10% (3.1595 => 3.2257, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 2.00% (85.0658 => 86.7653, std.dev.: 0.0214) MultiSource/Benchmarks/mafft/pairlocalalign: 1.49% (27.8444 => 28.2586, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout/sieve: 1.38% (5.2139 => 5.2858, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0313 => 1.0441, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 1.23% (2.2771 => 2.3052, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.21% (6.5088 => 6.5875, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0498, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.15% (12.5348 => 12.6789, std.dev.: 0.0331) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1677, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/salsa20: -75.49% (0.8651 => 0.2120, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.04% (5.2763 => 1.3170, std.dev.: 0.0227) SingleSource/Benchmarks/Misc/richards_benchmark: -44.51% (0.1622 => 0.0900, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.23% (5.3526 => 4.8586, std.dev.: 0.0926) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.39% (5.3855 => 4.9337, std.dev.: 0.0993) MultiSource/Applications/JM/ldecod/ldecod: -5.95% (10.4361 => 9.8151, std.dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -47.50% (0.0400 => 0.0210) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.73% (0.3987 => 0.2403, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.72% (0.0506 => 0.0305, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.27% (4.5009 => 2.7782, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -33.53% (1.1492 => 0.7639, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.14% (2.6546 => 2.0137, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -22.40% (10.7105 => 8.3113, std.dev.: 0.2452) MultiSource/Benchmarks/FreeBench/mason/mason: -19.39% (0.2161 => 0.1742, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4246, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.67% (2.6778 => 2.2849, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.72% (32.5116 => 29.0252, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/mandel-2: -10.63% (1.5373 => 1.3739, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -10.05% (9.5636 => 8.6027, std.dev.: 0.1666) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.05% (1.5660 => 1.4243, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.2416 => 3.0209, std.dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.59% (2.7294 => 2.5768, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.07% (1.6805 => 1.5953, std.dev.: 0.0300) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5061, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/lists: -4.22% (6.2999 => 6.0339, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.42% (0.9957 => 0.9616, std.dev.: 0.0124) MultiSource/Benchmarks/sim/sim: -2.94% (5.0483 => 4.8998, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.69% (19.9488 => 19.4115, std.dev.: 0.1062) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.27% (0.4808 => 0.4699, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.92% (8.1563 => 7.9994, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/salsa20: -1.49% (10.2830 => 10.1295, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0011) Report Time: 2.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 03:02:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 05:02:27 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121114110227.346F32A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5856?compare_to=5852&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5856, Order: 167925, Start Time: 2012-11-14 09:36:11, End Time: 2012-11-14 11:02:45 To: 5852, Order: 167918, Start Time: 2012-11-14 07:52:43, End Time: 2012-11-14 09:18:53 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 4 (111 on baseline) Performance Improvements: 0 (28 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 988 (835 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 6.94% (2.3402 => 2.5025, std.dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/fldry: 1.52% (0.6834 => 0.6938, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/ffbench: 1.37% (1.4060 => 1.4253, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.28% (3.1389 => 3.1790, std.dev.: 0.0089) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -1.05% (17.0542 => 16.8751, std.dev.: 0.2132) MultiSource/Applications/obsequi/Obsequi: 0.29% (1.0635 => 1.0666, std.dev.: 0.0090) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.30% (22.0151 => 22.0802, std.dev.: 0.2407) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.03% (0.3657 => 0.3658, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: -0.78% (0.6132 => 0.6084, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.98% (0.3371 => 0.3338, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/strcat: 0.75% (0.2005 => 0.2020, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -23.96% (0.0217 => 0.0165, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -18.59% (0.0425 => 0.0346, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -6.93% (0.0332 => 0.0309, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -6.09% (0.0312 => 0.0293, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0423 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 0.99% (0.0202 => 0.0204, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -1.85% (0.0216 => 0.0212, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.61% (0.1475 => 0.1484, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -3.11% (1.1685 => 1.1322, std.dev.: 0.0456) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 7.37% (0.4178 => 0.4486, std.dev.: 0.0250) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.00% (0.1401 => 0.1415, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -66.67% (0.0003 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.48% (0.0632 => 0.0610, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 29.67% (0.0209 => 0.0271, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.17% (0.0561 => 0.0590, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.48% (1.1960 => 1.2017, std.dev.: 0.0916) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -85.71% (0.0007 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.58% (0.0633 => 0.0566, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.02% (0.0259 => 0.0246, std.dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.06% (0.7796 => 0.7791, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -6.98% (0.0043 => 0.0040, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2322.79% (0.6332 => 15.3411, std.dev.: 0.1820) MultiSource/Benchmarks/McCat/08-main/main: 49.81% (0.1831 => 0.2743, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.99% (0.1559 => 0.1450, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1524.25% (0.3344 => 5.4315, std.dev.: 0.1661) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.45% (0.2364 => 0.3273, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: 3.03% (0.0429 => 0.0442, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -3.12% (0.0224 => 0.0217, std.dev.: 0.0010) SingleSource/UnitTests/byval-alignment: -60.87% (0.0230 => 0.0090, std.dev.: 0.0037) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 11.97% (0.1462 => 0.1637, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4780, std.dev.: 0.0272) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0692, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4865, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3117, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1425, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4110, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: -23.87% (2.1832 => 1.6620, std.dev.: 0.0040) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0004, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.17% (0.0810 => 0.0941, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.74% (0.0848 => 0.0956, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.65% (0.0830 => 0.0935, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.12% (0.2180 => 0.2357, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.11% (0.3137 => 0.3360, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.44% (0.7473 => 0.7954, std.dev.: 0.0147) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.40% (0.1905 => 0.2027, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.88% (0.4847 => 0.5132, std.dev.: 0.0086) MultiSource/Applications/Burg/burg: 5.85% (1.2222 => 1.2937, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.04% (0.6287 => 0.6604, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.00% (0.2240 => 0.2352, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.47% (0.9435 => 0.9857, std.dev.: 0.0158) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.39% (1.1606 => 1.2115, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.14% (0.2998 => 0.3122, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.09% (0.5817 => 0.6055, std.dev.: 0.0068) MultiSource/Applications/hbd/hbd: 4.02% (1.4269 => 1.4842, std.dev.: 0.0100) MultiSource/Applications/treecc/treecc: 3.78% (1.9948 => 2.0703, std.dev.: 0.0284) MultiSource/Applications/lua/lua: 3.76% (3.8189 => 3.9625, std.dev.: 0.0332) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.56% (0.5961 => 0.6173, std.dev.: 0.0064) MultiSource/Applications/SPASS/SPASS: 3.38% (14.2605 => 14.7426, std.dev.: 0.0329) MultiSource/Applications/minisat/minisat: 3.28% (0.6834 => 0.7058, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.27% (6.6074 => 6.8237, std.dev.: 0.0550) MultiSource/Applications/siod/siod: 3.25% (2.2184 => 2.2904, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/gs/gs: 3.23% (4.1305 => 4.2638, std.dev.: 0.0319) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.22% (0.4559 => 0.4706, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.20% (0.4127 => 0.4259, std.dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 3.03% (1.1271 => 1.1613, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.01% (0.4783 => 0.4927, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 2.99% (1.2568 => 1.2944, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.96% (0.8340 => 0.8587, std.dev.: 0.0084) MultiSource/Benchmarks/Bullet/bullet: 2.94% (31.8598 => 32.7979, std.dev.: 0.0171) MultiSource/Applications/ClamAV/clamscan: 2.84% (14.7684 => 15.1883, std.dev.: 0.0949) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.76% (0.8697 => 0.8937, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.70% (0.8457 => 0.8685, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 2.67% (3.2366 => 3.3231, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.66% (0.8611 => 0.8840, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.43% (0.8050 => 0.8246, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.43% (0.9039 => 0.9259, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 2.32% (2.3764 => 2.4316, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.29% (0.9074 => 0.9282, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.29% (0.8597 => 0.8794, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (6.7320 => 6.8859, std.dev.: 0.0343) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.27% (1.4479 => 1.4808, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.21% (0.9908 => 1.0127, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.21% (0.9056 => 0.9256, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.20% (0.8177 => 0.8357, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.17% (0.8331 => 0.8512, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.17% (0.9069 => 0.9266, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.17% (0.8716 => 0.8905, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.16% (0.8885 => 0.9077, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.13% (0.9688 => 0.9894, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.12% (0.8317 => 0.8493, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.11% (0.8007 => 0.8176, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 2.11% (15.3280 => 15.6511, std.dev.: 0.0483) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.10% (0.8338 => 0.8513, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.09% (0.8518 => 0.8696, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.05% (0.8204 => 0.8372, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.03% (0.8359 => 0.8529, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.03% (0.8420 => 0.8591, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.02% (0.7966 => 0.8127, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.02% (13.1811 => 13.4475, std.dev.: 0.0531) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.00% (0.8286 => 0.8452, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.99% (0.8855 => 0.9031, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.99% (0.8805 => 0.8980, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.94% (0.8656 => 0.8824, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 1.94% (4.9628 => 5.0591, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.94% (0.8048 => 0.8204, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.92% (0.7932 => 0.8084, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.82% (0.8066 => 0.8213, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.80% (0.8316 => 0.8466, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.77% (0.8086 => 0.8229, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.75% (0.8927 => 0.9083, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.75% (0.6586 => 0.6701, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.60% (0.8069 => 0.8198, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.48% (1.2602 => 1.2789, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.40% (0.8712 => 0.8834, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.26% (1.2423 => 1.2579, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 107.04% (0.0199 => 0.0412, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/pi: 58.44% (1.5795 => 2.5025, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.25% (2.9753 => 3.4588, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.78% (0.7597 => 0.8796, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.55% (2.7995 => 3.2068, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.47% (5.0261 => 5.6026, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.36% (0.3186 => 0.3516, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.13% (1.1857 => 1.2821, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/queens: 7.49% (1.7056 => 1.8334, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 6.81% (1.3037 => 1.3925, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.59% (4.7794 => 5.0945, std.dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 6.54% (3.1873 => 3.3959, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.90% (4.9686 => 5.2617, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.86% (4.5327 => 4.7981, std.dev.: 0.0342) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.75% (6.2275 => 6.5234, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: 4.65% (7.4933 => 7.8419, std.dev.: 0.0487) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.56% (3.3761 => 3.5301, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.05% (4.9453 => 5.1458, std.dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 3.93% (14.0064 => 14.5572, std.dev.: 0.0246) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.92% (4.9469 => 5.1406, std.dev.: 0.0050) MultiSource/Applications/siod/siod: 3.38% (3.6643 => 3.7882, std.dev.: 0.0110) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.87% (1.2337 => 1.2691, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.79% (11.5690 => 11.8916, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.66% (8.2783 => 8.4985, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout/lists: 2.37% (7.3375 => 7.5113, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.09% (4.8660 => 4.9675, std.dev.: 0.0127) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.97% (1.1365 => 1.1589, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.81% (4.8362 => 4.9238, std.dev.: 0.0217) SingleSource/Benchmarks/Stanford/FloatMM: 1.53% (0.8807 => 0.8942, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 1.48% (1.2061 => 1.2240, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.34% (2.4647 => 2.4977, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: 1.30% (1.0841 => 1.0982, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 1.22% (8.5322 => 8.6367, std.dev.: 0.0397) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.18% (3.5679 => 3.6099, std.dev.: 0.0083) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.07% (5.4641 => 4.3127, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.99% (7.2130 => 6.1319, std.dev.: 0.0722) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.04% (1.0512 => 0.9352, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: -10.40% (1.1216 => 1.0049, std.dev.: 0.0119) MultiSource/Benchmarks/mafft/pairlocalalign: -8.53% (63.1822 => 57.7909, std.dev.: 0.1217) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.33% (14.6451 => 13.5713, std.dev.: 0.1118) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.83% (4.7482 => 4.4237, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: -6.73% (21.9654 => 20.4869, std.dev.: 0.5658) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.49% (0.3269 => 0.3057, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.97% (3.7148 => 3.4932, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.90% (5.4972 => 5.1727, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.23% (5.1557 => 4.8863, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.39% (4.7449 => 4.5368, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.79% (6.0224 => 5.7944, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.52% (2.8773 => 2.7760, std.dev.: 0.0338) MultiSource/Applications/lua/lua: -3.33% (29.8330 => 28.8396, std.dev.: 0.3002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.12% (0.5807 => 0.5626, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (28.5821 => 27.6951, std.dev.: 0.0246) MultiSource/Benchmarks/FreeBench/mason/mason: -2.92% (0.5415 => 0.5257, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.89% (2.6356 => 2.5593, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.40% (9.9065 => 9.6687, std.dev.: 0.0187) MultiSource/Applications/aha/aha: -2.28% (3.3398 => 3.2638, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash2: -2.27% (3.4237 => 3.3461, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.03% (11.5316 => 11.2970, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.85% (2.3487 => 2.3053, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.69% (4.9994 => 4.9150, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.25% (5.6343 => 5.5637, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.18% (3.2169 => 3.1790, std.dev.: 0.0089) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.61% (16.4461 => 16.8751, std.dev.: 0.2132) MultiSource/Applications/obsequi/Obsequi: 3.94% (1.0262 => 1.0666, std.dev.: 0.0090) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6970.19% (0.3123 => 22.0802, std.dev.: 0.2407) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.52% (0.2463 => 0.3658, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 1.23% (0.6010 => 0.6084, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.20% (0.3266 => 0.3338, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/strcat: 2.59% (0.1969 => 0.2020, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 34.15% (0.0123 => 0.0165, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -15.20% (0.0408 => 0.0346, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 21.65% (0.0254 => 0.0309, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.98% (0.0302 => 0.0293, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 17.78% (0.0180 => 0.0212, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 3.20% (0.1438 => 0.1484, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.06% (1.1329 => 1.1322, std.dev.: 0.0456) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 7.73% (0.4164 => 0.4486, std.dev.: 0.0250) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.36% (0.1369 => 0.1415, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.84% (0.0641 => 0.0610, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 38.97% (0.0195 => 0.0271, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.08% (0.0578 => 0.0590, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.07% (1.1437 => 1.2017, std.dev.: 0.0916) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.73% (0.0627 => 0.0566, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 36.67% (0.0180 => 0.0246, std.dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.82% (0.8017 => 0.7791, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -35.48% (0.0062 => 0.0040, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 04:04:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 06:04:55 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121114120455.917B72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5857?compare_to=5853&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5857, Order: 167926, Start Time: 2012-11-14 10:39:57, End Time: 2012-11-14 12:05:12 To: 5853, Order: 167922, Start Time: 2012-11-14 08:51:40, End Time: 2012-11-14 10:16:42 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (181 on baseline) Unchanged Tests: 1041 (855 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.35% (77.4928 => 80.0895, std.dev.: 0.3762) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.75% (54.5751 => 56.6235, std.dev.: 0.0963) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.73% (2.0478 => 2.1037, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.4937 => 7.6664, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/hash2: 2.26% (3.1932 => 3.2653, std.dev.: 0.0015) MultiSource/Benchmarks/llubenchmark/llu: 2.08% (3.7435 => 3.8212, std.dev.: 0.0294) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.39% (0.1431 => 0.1311) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.80% (0.3821 => 0.3523, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -6.95% (2.4924 => 2.3191, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.75% (0.3142 => 0.2930, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -6.70% (0.3357 => 0.3132, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.65% (0.7198 => 0.6719, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.61% (0.9542 => 0.8911, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.47% (0.2428 => 0.2271, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.18% (0.9852 => 0.9243, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: -6.16% (0.2160 => 0.2027, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: -6.15% (16.1920 => 15.1965, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.12% (0.1796 => 0.1686, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -6.12% (9.2283 => 8.6633, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.08% (0.6484 => 0.6090, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.05% (1.0544 => 0.9906, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: -6.03% (7.0961 => 6.6679, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.96% (0.3658 => 0.3440, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.89% (0.1716 => 0.1615, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -5.85% (0.1879 => 0.1769, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -5.85% (0.1761 => 0.1658, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.83% (0.2695 => 0.2538, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.73% (0.2355 => 0.2220, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -5.73% (0.3406 => 0.3211, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.70% (1.3722 => 1.2940, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: -5.70% (0.9179 => 0.8656, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.69% (0.6736 => 0.6353, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.67% (3.5339 => 3.3334, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.65% (1.2300 => 1.1605, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -5.64% (1.1450 => 1.0804, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.62% (4.8802 => 4.6059, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.60% (0.5478 => 0.5171, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: -5.60% (0.3896 => 0.3678, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.59% (1.4642 => 1.3823, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-3: -5.59% (0.3848 => 0.3633, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.58% (4.8161 => 4.5472, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.57% (4.0323 => 3.8075, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: -5.57% (4.3330 => 4.0917, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-4: -5.57% (0.3880 => 0.3664, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.56% (0.3831 => 0.3618, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -5.55% (1.2515 => 1.1820, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.55% (0.3891 => 0.3675, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.54% (1.6364 => 1.5458, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/bh/bh: -5.53% (0.2985 => 0.2820, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.52% (4.5069 => 4.2582, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/for-in: -5.50% (0.4033 => 0.3811, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.49% (0.5591 => 0.5284, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -5.48% (0.3812 => 0.3603, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.48% (6.7716 => 6.4007, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.48% (0.5863 => 0.5542, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: -5.46% (1.1530 => 1.0901, std.dev.: 0.0160) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.45% (0.8521 => 0.8057, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.44% (0.5849 => 0.5531, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -5.44% (0.4176 => 0.3949, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.42% (0.6676 => 0.6314, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.41% (0.5857 => 0.5540, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.41% (0.6230 => 0.5893, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.41% (0.3884 => 0.3674, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.40% (0.7339 => 0.6943, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.39% (0.6660 => 0.6301, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.38% (14.2083 => 13.4436, std.dev.: 0.0324) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.37% (0.5805 => 0.5493, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.37% (0.6052 => 0.5727, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.37% (1.2784 => 1.2098, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.36% (0.6194 => 0.5862, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: -5.36% (0.4199 => 0.3974, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.35% (0.7919 => 0.7495, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.35% (0.5575 => 0.5277, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: -5.34% (0.4515 => 0.4274, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: -5.34% (17.1032 => 16.1903, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.33% (0.6395 => 0.6054, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.32% (0.6297 => 0.5962, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.32% (0.6260 => 0.5927, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.32% (0.6189 => 0.5860, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.31% (0.5705 => 0.5402, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.31% (0.5802 => 0.5494, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: -5.30% (0.2659 => 0.2518, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.30% (0.5569 => 0.5274, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.28% (0.5925 => 0.5612, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.28% (0.6667 => 0.6315, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.27% (0.6304 => 0.5972, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.26% (0.2548 => 0.2414, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.25% (0.3483 => 0.3300, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.25% (0.5581 => 0.5288, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.24% (0.7524 => 0.7130, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.22% (0.5859 => 0.5553, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -5.20% (1.3864 => 1.3143, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/18-imp/imp: -5.19% (0.3581 => 0.3395, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.17% (0.5688 => 0.5394, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.15% (1.2210 => 1.1581, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.13% (0.6293 => 0.5970, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.13% (0.5456 => 0.5176, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.09% (0.2278 => 0.2162, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.08% (0.6440 => 0.6113, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.07% (0.6033 => 0.5727, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.05% (0.5999 => 0.5696, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: -5.05% (3.5154 => 3.3379, std.dev.: 0.0105) SingleSource/UnitTests/ObjC/parameter-passing: -5.05% (0.4280 => 0.4064, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.04% (0.6446 => 0.6121, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.02% (0.4916 => 0.4669, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.99% (0.5567 => 0.5289, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.98% (1.2221 => 1.1612, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.97% (0.5570 => 0.5293, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: -4.97% (15.5079 => 14.7368, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.97% (8.0126 => 7.6145, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.93% (0.5941 => 0.5648, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.89% (0.6395 => 0.6082, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.86% (1.6474 => 1.5673, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.86% (0.3931 => 0.3740, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -4.84% (15.2527 => 14.5147, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.84% (0.5168 => 0.4918, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -4.80% (4.0594 => 3.8644, std.dev.: 0.0102) MultiSource/Applications/hexxagon/hexxagon: -4.79% (1.3148 => 1.2518, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.77% (0.3837 => 0.3654, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -4.74% (0.7447 => 0.7094, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.68% (0.3057 => 0.2914, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -4.65% (2.1401 => 2.0405, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -4.65% (2.4021 => 2.2904, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.65% (2.1713 => 2.0704, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.63% (22.4056 => 21.3675, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/methcall: -4.63% (0.3025 => 0.2885, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -4.62% (0.7982 => 0.7613, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: -4.61% (0.3255 => 0.3105, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -4.60% (0.3194 => 0.3047, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.60% (0.5329 => 0.5084, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -4.59% (0.2939 => 0.2804, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.59% (0.3271 => 0.3121, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.58% (0.4151 => 0.3961, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.54% (0.3016 => 0.2879, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.53% (0.2933 => 0.2800, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.53% (0.2871 => 0.2741, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.50% (0.2999 => 0.2864, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -4.49% (5.0226 => 4.7973, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.48% (0.2903 => 0.2773, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.46% (0.3252 => 0.3107, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: -4.44% (0.4861 => 0.4645, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.43% (0.7021 => 0.6710, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/hello: -4.42% (0.2849 => 0.2723, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -4.40% (0.3026 => 0.2893, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -4.37% (0.3481 => 0.3329, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -4.36% (34.0927 => 32.6059, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/strcat: -4.35% (0.2989 => 0.2859, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -4.35% (0.3059 => 0.2926, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -4.34% (0.3205 => 0.3066, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -4.32% (0.3446 => 0.3297, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: -4.30% (0.8418 => 0.8056, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: -4.28% (0.4248 => 0.4066, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists: -4.28% (0.3621 => 0.3466, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: -4.27% (18.2933 => 17.5113, std.dev.: 0.0306) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.25% (0.3319 => 0.3178, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.25% (0.9557 => 0.9151, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: -4.24% (0.3394 => 0.3250, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: -4.16% (0.3867 => 0.3706, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: -4.16% (0.4524 => 0.4336, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.14% (0.4083 => 0.3914, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.11% (2.2587 => 2.1658, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: -4.04% (0.7779 => 0.7465, std.dev.: 0.0043) SingleSource/UnitTests/ObjC++/Hello: -3.92% (0.6347 => 0.6098, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.92% (0.3849 => 0.3698, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.89% (0.4813 => 0.4626, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.89% (0.4427 => 0.4255, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.87% (0.3491 => 0.3356, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -3.80% (0.6441 => 0.6196, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: -3.72% (0.3788 => 0.3647, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -3.72% (0.6750 => 0.6499, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.64% (0.9077 => 0.8747, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.61% (0.3323 => 0.3203, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.44% (5.4682 => 5.2801, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.17% (0.4321 => 0.4184, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: -2.98% (1.5610 => 1.5145, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -2.44% (20.7746 => 20.2681, std.dev.: 0.0287) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7559, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -8.69% (1.2842 => 1.1726, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7060, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.83% (2.2633 => 2.1767, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0245, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.89% (1.3096 => 1.2848, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4729, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 04:45:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 06:45:28 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121114124528.7A75F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5858?compare_to=5856&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5858, Order: 167926, Start Time: 2012-11-14 11:19:37, End Time: 2012-11-14 12:45:47 To: 5856, Order: 167925, Start Time: 2012-11-14 09:36:11, End Time: 2012-11-14 11:02:45 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 7 (106 on baseline) Performance Improvements: 2 (28 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 983 (840 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.03% (0.2122 => 0.2250, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.00% (0.3325 => 0.3458, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.90% (0.8176 => 0.8331, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.50% (0.8512 => 0.8640, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.50% (0.9083 => 0.9219, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.22% (0.8493 => 0.8597, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.34% (0.5811 => 0.5947, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.32% (0.3516 => 0.3329, std.dev.: 0.0057) SingleSource/Benchmarks/Dhrystone/fldry: -1.53% (0.6938 => 0.6832, std.dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.45% (16.8751 => 16.9510, std.dev.: 0.0852) MultiSource/Applications/obsequi/Obsequi: 0.24% (1.0666 => 1.0692, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.04% (22.0802 => 22.0722, std.dev.: 0.1809) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.30% (0.3658 => 0.3669, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/bigfib: 0.90% (0.6084 => 0.6139, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.27% (0.3338 => 0.3347, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: -0.59% (0.2020 => 0.2008, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 32.73% (0.0165 => 0.0219, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 24.57% (0.0346 => 0.0431, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 5.50% (0.0309 => 0.0326, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -15.70% (0.0293 => 0.0247, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0425 => 0.0427, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -34.80% (0.0204 => 0.0133, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/test1: -24.53% (0.0212 => 0.0160, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.47% (0.1484 => 0.1477, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.16% (1.1322 => 1.1567, std.dev.: 0.0260) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -8.49% (0.4486 => 0.4105, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.35% (0.1415 => 0.1420, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.48% (0.0610 => 0.0601, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -8.12% (0.0271 => 0.0249, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.42% (0.0590 => 0.0558, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.62% (1.2017 => 1.1942, std.dev.: 0.0254) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1100.00% (0.0001 => 0.0012, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.24% (0.0566 => 0.0559, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.70% (0.0246 => 0.0200, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.12% (0.7791 => 0.7704, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 47.50% (0.0040 => 0.0059, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2324.07% (0.6332 => 15.3492, std.dev.: 0.0570) MultiSource/Benchmarks/McCat/08-main/main: 43.97% (0.1831 => 0.2636, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.94% (0.1559 => 0.1404, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1537.17% (0.3344 => 5.4747, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.63% (0.2364 => 0.3230, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: 3.96% (0.0429 => 0.0446, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.04% (0.0224 => 0.0242, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -31.74% (0.0230 => 0.0157, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 6.84% (0.1462 => 0.1562, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4778, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0687, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4944, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3155, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1489, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4091, std.dev.: 0.0018) SingleSource/Regression/C/uint64_to_float: -23.93% (2.1832 => 1.6607, std.dev.: 0.0020) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.44% (0.0810 => 0.0927, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 12.42% (0.0829 => 0.0932, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: 10.97% (0.1112 => 0.1234, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.13% (0.2180 => 0.2379, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/health/health: 7.87% (0.1347 => 0.1453, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.04% (0.3137 => 0.3358, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.57% (0.7473 => 0.7964, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.92% (0.2519 => 0.2668, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 5.69% (0.7950 => 0.8402, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.66% (0.2279 => 0.2408, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.49% (0.2133 => 0.2250, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.19% (0.6010 => 0.6322, std.dev.: 0.0119) MultiSource/Applications/Burg/burg: 5.08% (1.2222 => 1.2843, std.dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.01% (0.6287 => 0.6602, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.95% (0.3295 => 0.3458, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.82% (1.1606 => 1.2165, std.dev.: 0.0082) MultiSource/Applications/lua/lua: 4.23% (3.8189 => 3.9803, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.14% (1.1685 => 1.2169, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 4.05% (0.8007 => 0.8331, std.dev.: 0.0030) MultiSource/Applications/treecc/treecc: 4.01% (1.9948 => 2.0748, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.86% (0.8855 => 0.9197, std.dev.: 0.0066) MultiSource/Applications/hbd/hbd: 3.85% (1.4269 => 1.4819, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.76% (0.5961 => 0.6185, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.71% (0.8331 => 0.8640, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.70% (0.8697 => 0.9019, std.dev.: 0.0074) MultiSource/Applications/SPASS/SPASS: 3.70% (14.2605 => 14.7884, std.dev.: 0.1060) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.55% (0.8340 => 0.8636, std.dev.: 0.0087) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.49% (6.6074 => 6.8382, std.dev.: 0.0261) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.49% (1.2526 => 1.2963, std.dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.42% (0.6227 => 0.6440, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 3.42% (2.2184 => 2.2942, std.dev.: 0.0204) MultiSource/Benchmarks/nbench/nbench: 3.42% (1.1271 => 1.1656, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.37% (0.8317 => 0.8597, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.34% (0.8204 => 0.8478, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.34% (0.8177 => 0.8450, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.31% (0.9069 => 0.9369, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/gs/gs: 3.30% (4.1305 => 4.2666, std.dev.: 0.0266) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.28% (4.1763 => 4.3132, std.dev.: 0.0389) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 3.27% (0.8927 => 0.9219, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.25% (0.7966 => 0.8225, std.dev.: 0.0039) MultiSource/Applications/d/make_dparser: 3.23% (3.2366 => 3.3413, std.dev.: 0.0300) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.21% (2.1401 => 2.2088, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.15% (1.4479 => 1.4935, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.11% (0.8457 => 0.8720, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.10% (0.8518 => 0.8782, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.10% (0.8359 => 0.8618, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 3.06% (0.8069 => 0.8316, std.dev.: 0.0069) MultiSource/Applications/SIBsim4/SIBsim4: 2.95% (1.2568 => 1.2939, std.dev.: 0.0116) MultiSource/Benchmarks/Bullet/bullet: 2.92% (31.8598 => 32.7887, std.dev.: 0.0629) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.90% (1.5315 => 1.5759, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.84% (0.9908 => 1.0189, std.dev.: 0.0056) MultiSource/Applications/ClamAV/clamscan: 2.83% (14.7684 => 15.1867, std.dev.: 0.0723) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.72% (13.1811 => 13.5392, std.dev.: 0.0707) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.72% (0.5191 => 0.5332, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.70% (0.9039 => 0.9283, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.69% (0.8805 => 0.9042, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.69% (0.7932 => 0.8145, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.63% (0.8716 => 0.8945, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.56% (1.3279 => 1.3619, std.dev.: 0.0122) MultiSource/Applications/JM/ldecod/ldecod: 2.54% (6.7320 => 6.9033, std.dev.: 0.0324) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.47% (4.5702 => 4.6832, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.47% (0.8712 => 0.8927, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.46% (0.8420 => 0.8627, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.39% (3.1832 => 3.2592, std.dev.: 0.0121) MultiSource/Applications/lemon/lemon: 2.38% (1.0945 => 1.1205, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.36% (4.4880 => 4.5939, std.dev.: 0.0274) MultiSource/Applications/hexxagon/hexxagon: 2.29% (0.9810 => 1.0035, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.28% (0.8066 => 0.8250, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.21% (4.4873 => 4.5863, std.dev.: 0.0285) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.20% (0.9056 => 0.9255, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.19% (8.6476 => 8.8367, std.dev.: 0.0468) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.15% (1.2602 => 1.2873, std.dev.: 0.0035) MultiSource/Applications/JM/lencod/lencod: 2.03% (15.3280 => 15.6394, std.dev.: 0.0643) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.02% (1.1170 => 1.1396, std.dev.: 0.0086) MultiSource/Benchmarks/mafft/pairlocalalign: 1.97% (8.6247 => 8.7948, std.dev.: 0.0305) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.60% (1.2423 => 1.2622, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.58% (0.6586 => 0.6690, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 106.53% (0.0199 => 0.0411, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.31% (0.7597 => 0.8912, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.35% (2.9753 => 3.4619, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.68% (2.7995 => 3.2105, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6090, std.dev.: 0.0310) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.03% (1.1857 => 1.2809, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 7.31% (1.7056 => 1.8303, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.72% (4.7794 => 5.1005, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/richards_benchmark: 6.31% (1.3037 => 1.3859, std.dev.: 0.0043) MultiSource/Applications/SIBsim4/SIBsim4: 6.07% (3.1873 => 3.3807, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.76% (4.5327 => 4.7938, std.dev.: 0.0359) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.68% (4.9686 => 5.2510, std.dev.: 0.0220) MultiSource/Applications/lambda-0_1_3/lambda: 4.86% (7.4933 => 7.8573, std.dev.: 0.0420) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.63% (6.2275 => 6.5161, std.dev.: 0.0758) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.40% (3.3761 => 3.5247, std.dev.: 0.0319) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.22% (4.9453 => 5.1541, std.dev.: 0.0328) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.96% (4.9469 => 5.1430, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 3.91% (14.0064 => 14.5545, std.dev.: 0.0223) MultiSource/Applications/siod/siod: 3.11% (3.6643 => 3.7784, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.82% (11.5690 => 11.8954, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.67% (8.2783 => 8.4991, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout/lists: 2.29% (7.3375 => 7.5052, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.23% (4.8660 => 4.9743, std.dev.: 0.0159) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.74% (1.1365 => 1.1563, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/power/power: 1.29% (1.2061 => 1.2216, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.24% (2.5763 => 2.6083, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.19% (3.5679 => 3.6105, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/ReedSolomon: 1.18% (8.5322 => 8.6329, std.dev.: 0.0353) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (5.6030 => 5.6674, std.dev.: 0.0232) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -30.47% (0.0338 => 0.0235, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/em3d/em3d: -21.39% (5.4641 => 4.2952, std.dev.: 0.0280) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.43% (7.2130 => 6.1724, std.dev.: 0.3844) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.99% (1.0512 => 0.9357, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.80% (1.1216 => 1.0005, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -10.23% (14.6451 => 13.1471, std.dev.: 0.3533) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.96% (0.3269 => 0.2976, std.dev.: 0.0080) MultiSource/Benchmarks/mafft/pairlocalalign: -8.56% (63.1822 => 57.7722, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.87% (4.7482 => 4.4222, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.96% (3.7148 => 3.4935, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.83% (5.4972 => 5.1768, std.dev.: 0.0397) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.05% (5.1557 => 4.8953, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.32% (4.7449 => 4.5401, std.dev.: 0.0457) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.90% (6.0224 => 5.7875, std.dev.: 0.0078) MultiSource/Applications/lua/lua: -3.47% (29.8330 => 28.7987, std.dev.: 0.2728) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.25% (2.8773 => 2.7839, std.dev.: 0.0269) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.24% (0.5807 => 0.5619, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (28.5821 => 27.6984, std.dev.: 0.0195) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.85% (2.4490 => 2.3791, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/bisort/bisort: -2.56% (0.6636 => 0.6466, std.dev.: 0.0013) MultiSource/Applications/aha/aha: -2.51% (3.3398 => 3.2561, std.dev.: 0.0261) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.40% (9.9065 => 9.6692, std.dev.: 0.0821) SingleSource/Benchmarks/Shootout-C++/hash2: -2.23% (3.4237 => 3.3472, std.dev.: 0.0055) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.06% (1.2822 => 1.2558, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.05% (11.5316 => 11.2950, std.dev.: 0.0384) MultiSource/Benchmarks/FreeBench/mason/mason: -2.03% (0.5415 => 0.5305, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.71% (4.9994 => 4.9140, std.dev.: 0.0313) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.14% (5.6343 => 5.5702, std.dev.: 0.0153) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 3.07% (16.4461 => 16.9510, std.dev.: 0.0852) MultiSource/Applications/obsequi/Obsequi: 4.19% (1.0262 => 1.0692, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6967.63% (0.3123 => 22.0722, std.dev.: 0.1809) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.96% (0.2463 => 0.3669, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/bigfib: 2.15% (0.6010 => 0.6139, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.48% (0.3266 => 0.3347, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 1.98% (0.1969 => 0.2008, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.64% (0.0408 => 0.0431, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 28.35% (0.0254 => 0.0326, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -18.21% (0.0302 => 0.0247, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.20% (0.0384 => 0.0427, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -30.00% (0.0190 => 0.0133, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/test1: -11.11% (0.0180 => 0.0160, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.71% (0.1438 => 0.1477, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.10% (1.1329 => 1.1567, std.dev.: 0.0260) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.42% (0.4164 => 0.4105, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.73% (0.1369 => 0.1420, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.24% (0.0641 => 0.0601, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 27.69% (0.0195 => 0.0249, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.46% (0.0578 => 0.0558, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.42% (1.1437 => 1.1942, std.dev.: 0.0254) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1100.00% (0.0001 => 0.0012, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.85% (0.0627 => 0.0559, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 11.11% (0.0180 => 0.0200, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.90% (0.8017 => 0.7704, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -4.84% (0.0062 => 0.0059, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 05:51:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 07:51:28 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121114135128.21E292A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5859?compare_to=5855&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5859, Order: 167926, Start Time: 2012-11-14 11:41:52, End Time: 2012-11-14 13:51:45 To: 5855, Order: 167920, Start Time: 2012-11-14 08:40:39, End Time: 2012-11-14 10:51:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 42 (145 on baseline) Performance Improvements: 18 (41 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 978 (701 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 14.97% (0.6300 => 0.7243, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 14.64% (0.6600 => 0.7566, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 14.64% (0.5924 => 0.6791, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 14.55% (0.6695 => 0.7669, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 14.53% (0.5783 => 0.6623, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.01% (0.6581 => 0.7503, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 13.67% (0.7863 => 0.8938, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 13.17% (0.6196 => 0.7012, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.96% (0.4268 => 0.4821, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 12.89% (0.0900 => 0.1016, std.dev.: 0.0040) MultiSource/Applications/treecc/treecc: 12.67% (2.3105 => 2.6032, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 12.42% (0.1329 => 0.1494, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.95% (0.6354 => 0.7113, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 11.75% (0.1889 => 0.2111, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.52% (0.4323 => 0.4821, std.dev.: 0.0070) MultiSource/Applications/d/make_dparser: 11.34% (3.8529 => 4.2899, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.07% (0.3163 => 0.3513, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.95% (0.9005 => 0.9991, std.dev.: 0.0134) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 10.83% (4.7200 => 5.2312, std.dev.: 0.0862) MultiSource/Applications/sgefa/sgefa: 10.80% (0.3527 => 0.3908, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.34% (0.1035 => 0.1142, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.28% (0.3016 => 0.3326, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.13% (0.1017 => 0.1120, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.83% (0.1170 => 0.1285, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hello: 9.51% (0.2954 => 0.3235, std.dev.: 0.0090) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.38% (0.2090 => 0.2286, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 9.15% (0.4009 => 0.4376, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/power/power: 8.56% (0.1460 => 0.1585, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/mst/mst: 7.98% (0.1354 => 0.1462, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.78% (0.3354 => 0.3615, std.dev.: 0.0099) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.57% (4.9337 => 5.0605, std.dev.: 0.0264) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.35% (11.1419 => 11.2924, std.dev.: 0.0102) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 30.12% (1.5561 => 2.0248, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/flops: 28.56% (6.7495 => 8.6771, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: 21.78% (3.8801 => 4.7253, std.dev.: 0.1802) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 20.06% (1.3514 => 1.6225, std.dev.: 0.0138) SingleSource/Benchmarks/BenchmarkGame/puzzle: 8.67% (0.6954 => 0.7557, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 4.53% (6.8046 => 7.1129, std.dev.: 0.0916) MultiSource/Benchmarks/NPB-serial/is/is: 2.94% (8.6027 => 8.8560, std.dev.: 0.0745) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.02% (87.3814 => 89.1422, std.dev.: 0.4800) MultiSource/Applications/sgefa/sgefa: 1.68% (0.6307 => 0.6413, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.09% (2.3098 => 2.3350, std.dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/life/life: -11.79% (0.1204 => 0.1062, std.dev.: 0.0039) MultiSource/Applications/aha/aha: -11.60% (0.1500 => 0.1326, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -11.57% (0.7780 => 0.6880, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -11.34% (0.6667 => 0.5911, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -11.33% (1.5061 => 1.3355, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/football/football: -10.09% (1.0971 => 0.9864, std.dev.: 0.0381) MultiSource/Applications/spiff/spiff: -7.58% (0.9872 => 0.9124, std.dev.: 0.0116) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.50% (2.5037 => 2.3660, std.dev.: 0.0481) MultiSource/Benchmarks/PAQ8p/paq8p: -2.54% (11.6515 => 11.3552, std.dev.: 0.0795) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.21% (5.1830 => 5.0682, std.dev.: 0.0226) MultiSource/Benchmarks/MallocBench/gs/gs: -1.01% (5.0814 => 5.0303, std.dev.: 0.0109) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/siod/siod: -4.40% (3.3237 => 3.1775, std.dev.: 0.0197) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.30% (16.8932 => 16.1667, std.dev.: 0.2043) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -3.51% (4.8243 => 4.6550, std.dev.: 0.0092) MultiSource/Applications/SPASS/SPASS: -3.35% (14.6746 => 14.1836, std.dev.: 0.0394) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.71% (6.1662 => 6.0607, std.dev.: 0.0378) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.34% (1.5852 => 1.5639, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.13% (2.2064 => 2.1815, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1338 => 0.1338, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.43% (0.0420 => 0.0489, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.31% (0.0652 => 0.0650, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 0.09% (493.7895 => 494.2563, std.dev.: 0.1463) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.89% (4.3882 => 0.0489, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: 43728.70% (1.1277 => 494.2563, std.dev.: 0.1463) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.13% (0.5229 => 1.5380, std.dev.: 0.0505) MultiSource/Applications/SPASS/SPASS: 21.84% (14.9895 => 18.2625, std.dev.: 0.0381) MultiSource/Applications/kimwitu++/kc: 50.67% (14.1553 => 21.3283, std.dev.: 0.1388) MultiSource/Benchmarks/MallocBench/gs/gs: 22.38% (4.1105 => 5.0303, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.23% (1.1048 => 1.5161, std.dev.: 0.0759) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 435.64% (7.1582 => 38.3421, std.dev.: 0.0863) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.45% (3.4629 => 6.4220, std.dev.: 0.1879) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.12% (0.6222 => 1.0336, std.dev.: 0.0652) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10846.53% (0.0720 => 7.8815, std.dev.: 0.0153) MultiSource/Applications/SIBsim4/SIBsim4: 3927100.00% (0.0001 => 3.9272, std.dev.: 0.0092) MultiSource/Applications/SPASS/SPASS: 14183500.00% (0.0001 => 14.1836, std.dev.: 0.0394) MultiSource/Applications/kimwitu++/kc: 52400.00% (0.0001 => 0.0525, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 64900.00% (0.0001 => 0.0650, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 578800.00% (0.0001 => 0.5789, std.dev.: 0.0252) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10091700.00% (0.0001 => 10.0918, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6133300.00% (0.0001 => 6.1334, std.dev.: 0.5007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1825.34% (1.1194 => 21.5522, std.dev.: 0.0452) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 78.03% (2.9384 => 5.2312, std.dev.: 0.0862) MultiSource/Applications/ClamAV/clamscan: 62.29% (22.1758 => 35.9881, std.dev.: 0.0992) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 60.09% (7.0540 => 11.2924, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/distray/distray: 55.68% (0.1056 => 0.1644, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 51.48% (8.1363 => 12.3249, std.dev.: 0.0510) MultiSource/Applications/JM/lencod/lencod: 47.68% (21.9371 => 32.3958, std.dev.: 0.0971) SingleSource/Benchmarks/CoyoteBench/almabench: 39.86% (0.0730 => 0.1021, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 39.32% (0.1432 => 0.1995, std.dev.: 0.0057) SingleSource/Benchmarks/Dhrystone/dry: 32.46% (0.0456 => 0.0604, std.dev.: 0.0001) SingleSource/UnitTests/vla: 30.14% (0.0355 => 0.0462, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 28.74% (0.0842 => 0.1084, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 28.62% (3.3354 => 4.2899, std.dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/huffbench: 28.59% (0.0871 => 0.1120, std.dev.: 0.0027) MultiSource/Applications/treecc/treecc: 28.41% (2.0273 => 2.6032, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 27.72% (0.5569 => 0.7113, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: 27.66% (0.1175 => 0.1500, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: 27.55% (0.1655 => 0.2111, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 27.37% (0.2758 => 0.3513, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.10% (0.0770 => 0.0971, std.dev.: 0.0027) MultiSource/Applications/viterbi/viterbi: 25.92% (0.1555 => 0.1958, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/mst/mst: 25.71% (0.1163 => 0.1462, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 25.70% (0.3109 => 0.3908, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 25.57% (0.0481 => 0.0604, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 25.34% (0.0442 => 0.0554, std.dev.: 0.0015) MultiSource/Benchmarks/llubenchmark/llu: 25.11% (0.0462 => 0.0578, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.88% (0.1029 => 0.1285, std.dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: 24.85% (5.7591 => 7.1905, std.dev.: 0.0189) SingleSource/Benchmarks/Shootout-C++/reversefile: 24.73% (0.3865 => 0.4821, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.53% (0.0746 => 0.0929, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 24.37% (1.1861 => 1.4752, std.dev.: 0.0099) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.22% (0.0834 => 0.1036, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 23.85% (0.8067 => 0.9991, std.dev.: 0.0134) SingleSource/Benchmarks/Stanford/Oscar: 23.58% (0.0636 => 0.0786, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 23.24% (0.8101 => 0.9984, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 23.19% (0.0457 => 0.0563, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 23.03% (0.0482 => 0.0593, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/lpbench: 22.93% (0.0929 => 0.1142, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 22.52% (0.3935 => 0.4821, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 22.40% (0.2554 => 0.3126, std.dev.: 0.0222) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.46% (0.1566 => 0.1902, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/sieve: 21.45% (0.3603 => 0.4376, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.41% (14.3668 => 17.4426, std.dev.: 0.0714) MultiSource/Benchmarks/VersaBench/dbms/dbms: 21.30% (0.8172 => 0.9913, std.dev.: 0.0197) MultiSource/Applications/lua/lua: 21.14% (3.8723 => 4.6909, std.dev.: 0.0591) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 21.02% (0.1584 => 0.1917, std.dev.: 0.0094) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 20.82% (0.1892 => 0.2286, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 20.77% (2.2969 => 2.7739, std.dev.: 0.0766) SingleSource/Benchmarks/Shootout-C++/ackermann: 20.68% (0.2756 => 0.3326, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 20.24% (0.0672 => 0.0808, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.98% (0.4615 => 0.5537, std.dev.: 0.0180) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.20% (0.1125 => 0.1341, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hello: 19.20% (0.2714 => 0.3235, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 19.13% (0.0528 => 0.0629, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.84% (4.2646 => 5.0682, std.dev.: 0.0226) MultiSource/Benchmarks/mafft/pairlocalalign: 17.72% (9.4845 => 11.1656, std.dev.: 0.1301) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.38% (5.0018 => 5.8712, std.dev.: 0.0720) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.35% (4.9449 => 5.8027, std.dev.: 0.0755) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 17.13% (0.2271 => 0.2660, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.93% (1.3050 => 1.5260, std.dev.: 0.0554) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 16.78% (3.8922 => 4.5454, std.dev.: 0.1743) MultiSource/Applications/spiff/spiff: 16.45% (0.7835 => 0.9124, std.dev.: 0.0116) MultiSource/Applications/sqlite3/sqlite3: 16.25% (17.1811 => 19.9732, std.dev.: 0.1312) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.16% (0.0953 => 0.1107, std.dev.: 0.0042) SingleSource/Regression/C++/ofstream_ctor: 16.14% (0.2905 => 0.3374, std.dev.: 0.0168) MultiSource/Benchmarks/nbench/nbench: 15.98% (1.1840 => 1.3732, std.dev.: 0.0448) SingleSource/UnitTests/ObjC++/property-reference-object: 15.92% (0.6030 => 0.6990, std.dev.: 0.0221) SingleSource/Benchmarks/Shootout/matrix: 15.89% (0.0818 => 0.0948, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.85% (0.1117 => 0.1294, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/05-eks/eks: 15.77% (0.4299 => 0.4977, std.dev.: 0.0179) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.74% (0.2065 => 0.2390, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.63% (0.6450 => 0.7458, std.dev.: 0.0310) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.43% (0.0648 => 0.0748, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 15.20% (0.1151 => 0.1326, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: 15.06% (0.1268 => 0.1459, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 15.02% (0.0719 => 0.0827, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.94% (0.0770 => 0.0885, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 14.73% (63.2438 => 72.5600, std.dev.: 0.0852) MultiSource/Applications/Burg/burg: 14.71% (1.1642 => 1.3355, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.54% (0.0798 => 0.0914, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.38% (0.2107 => 0.2410, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.23% (0.3121 => 0.3565, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.84% (0.5981 => 0.6809, std.dev.: 0.0253) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.83% (0.0933 => 0.1062, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 13.79% (0.3177 => 0.3615, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.59% (0.9765 => 1.1092, std.dev.: 0.0404) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.48% (0.3441 => 0.3905, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.44% (0.1510 => 0.1713) SingleSource/UnitTests/ObjC/exceptions-3: 12.91% (0.3516 => 0.3970, std.dev.: 0.0135) SingleSource/UnitTests/ObjC/exceptions-4: 12.90% (0.3543 => 0.4000, std.dev.: 0.0176) SingleSource/UnitTests/ObjC/for-in: 12.56% (0.3694 => 0.4158, std.dev.: 0.0144) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.86% (0.1695 => 0.1896, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.44% (0.1906 => 0.2124, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.14% (0.2603 => 0.2893, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 10.82% (0.5925 => 0.6566, std.dev.: 0.0236) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.81% (0.4636 => 0.5137, std.dev.: 0.0032) MultiSource/Benchmarks/sim/sim: 10.27% (0.3387 => 0.3735, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 10.18% (0.1463 => 0.1612, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 10.07% (0.1440 => 0.1585, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: 10.05% (0.3282 => 0.3612, std.dev.: 0.0061) MultiSource/Benchmarks/PAQ8p/paq8p: 9.53% (10.3673 => 11.3552, std.dev.: 0.0795) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.44% (2.2022 => 2.3660, std.dev.: 0.0481) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.63% (7.9617 => 8.4103, std.dev.: 0.0206) SingleSource/UnitTests/Vector/constpool: 3.07% (54.1659 => 55.8301, std.dev.: 0.6156) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.93% (4.3953 => 11.0291, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/methcall: 147.71% (5.3999 => 13.3762, std.dev.: 0.0010) MultiSource/Benchmarks/llubenchmark/llu: 59.91% (3.7781 => 6.0417, std.dev.: 0.3798) MultiSource/Benchmarks/VersaBench/dbms/dbms: 34.22% (1.5086 => 2.0248, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout/ary3: 27.73% (3.6994 => 4.7253, std.dev.: 0.1802) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 24.38% (1.3045 => 1.6225, std.dev.: 0.0138) MultiSource/Applications/minisat/minisat: 22.89% (9.1159 => 11.2028, std.dev.: 0.1001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.30% (13.4384 => 16.1667, std.dev.: 0.2043) SingleSource/Benchmarks/Misc/oourafft: 17.64% (6.6465 => 7.8190, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.64% (1.1145 => 1.3111, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/lpbench: 15.65% (10.3460 => 11.9652, std.dev.: 0.0877) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.94% (0.2944 => 0.3325, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.64% (2.8904 => 3.2268, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 11.35% (3.1578 => 3.5163, std.dev.: 0.0591) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.37% (8.6802 => 9.5804, std.dev.: 0.1115) SingleSource/Benchmarks/Misc/richards_benchmark: 10.17% (1.1396 => 1.2555, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.31% (1.7254 => 1.8860, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/puzzle: 8.55% (0.6962 => 0.7557, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout/strcat: 8.06% (0.1899 => 0.2052, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/hash: 6.87% (4.9088 => 5.2458, std.dev.: 0.1195) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.92% (4.2280 => 4.4781, std.dev.: 0.0052) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.96% (3.6395 => 3.8200, std.dev.: 0.0230) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.6436 => 12.1216, std.dev.: 0.0145) MultiSource/Benchmarks/Olden/health/health: 3.91% (0.4445 => 0.4619, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.36% (0.4162 => 0.4302, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: 3.17% (2.4116 => 2.4880, std.dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: 3.05% (0.6223 => 0.6413, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 2.11% (3.1595 => 3.2263, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 2.01% (3.1023 => 3.1648, std.dev.: 0.0203) MultiSource/Benchmarks/PAQ8p/paq8p: 1.84% (85.0658 => 86.6322, std.dev.: 0.0956) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.83% (2.1424 => 2.1815, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.47% (27.8444 => 28.2539, std.dev.: 0.0208) SingleSource/Benchmarks/Shootout/sieve: 1.34% (5.2139 => 5.2837, std.dev.: 0.0075) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.33% (6.5088 => 6.5955, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.26% (1.0313 => 1.0443, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0501, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1672, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.60% (5.2763 => 1.2348, std.dev.: 0.0621) SingleSource/Benchmarks/Misc/salsa20: -75.48% (0.8651 => 0.2121, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/richards_benchmark: -37.36% (0.1622 => 0.1016, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.39% (5.3526 => 4.8501, std.dev.: 0.0756) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.03% (5.3855 => 5.0605, std.dev.: 0.0264) MultiSource/Applications/JM/ldecod/ldecod: -5.91% (10.4361 => 9.8190, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -47.50% (0.0400 => 0.0210) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.83% (0.3987 => 0.2399, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.53% (0.0506 => 0.0306, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.26% (4.5009 => 2.7789, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.17% (2.6546 => 2.0129, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -24.11% (10.7105 => 8.1278, std.dev.: 0.3613) MultiSource/Benchmarks/FreeBench/mason/mason: -19.25% (0.2161 => 0.1745, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.77% (1.6925 => 1.4256, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2842) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.73% (32.5116 => 29.0243, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel-2: -10.64% (1.5373 => 1.3737, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.00% (1.5660 => 1.4251, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470) MultiSource/Benchmarks/NPB-serial/is/is: -7.40% (9.5636 => 8.8560, std.dev.: 0.0745) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4813, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.17% (3.2416 => 3.0417, std.dev.: 0.0178) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5760, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7497, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.96% (1.5835 => 1.5049, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.81% (1.6805 => 1.5996, std.dev.: 0.0279) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.77% (19.9488 => 18.9968, std.dev.: 0.2179) SingleSource/Benchmarks/Shootout/lists: -4.12% (6.2999 => 6.0405, std.dev.: 0.0017) MultiSource/Applications/siod/siod: -3.20% (3.2827 => 3.1775, std.dev.: 0.0197) MultiSource/Benchmarks/sim/sim: -2.98% (5.0483 => 4.8977, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.79% (0.9957 => 0.9679, std.dev.: 0.0039) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.25% (0.4808 => 0.4700, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.80% (8.1563 => 8.0094, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6771, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -1.47% (10.2830 => 10.1320, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.28% (0.2116 => 0.0650, std.dev.: 0.0015) Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 06:22:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 08:22:45 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121114142245.3F60F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5860?compare_to=5854&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5860, Order: 167926, Start Time: 2012-11-14 11:07:30, End Time: 2012-11-14 14:23:02 To: 5854, Order: 167914, Start Time: 2012-11-14 06:57:56, End Time: 2012-11-14 10:19:19 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (172 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (718 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.90% (2.0526 => 2.1121, std.dev.: 0.0098) SingleSource/Benchmarks/Dhrystone/dry: 1.94% (14.3465 => 14.6253, std.dev.: 0.0075) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.80% (0.0625 => 0.0880, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.08% (0.1063 => 0.1404, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.07% (0.2969 => 0.3743, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.41% (0.1106 => 0.1387, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.55% (0.4139 => 0.5155, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.51% (0.0714 => 0.0889, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.19% (0.4994 => 0.6202, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.17% (0.5900 => 0.7326, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.01% (0.4253 => 0.5274, std.dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 23.80% (1.5932 => 1.9724, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.79% (0.0475 => 0.0588, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.70% (0.5000 => 0.6185, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.84% (0.1620 => 0.1990, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.77% (0.0584 => 0.0717, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.62% (0.1021 => 0.1252, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.22% (0.1107 => 0.1353, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 22.20% (0.0599 => 0.0732) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.74% (0.0897 => 0.1092, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.48% (0.0633 => 0.0769, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 21.41% (0.0948 => 0.1151, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.06% (0.0584 => 0.0707, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.03% (0.0642 => 0.0777, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 20.95% (0.0821 => 0.0993, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.92% (0.0822 => 0.0994, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.70% (0.0541 => 0.0653) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.58% (0.1103 => 0.1330, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.47% (0.3903 => 0.4702, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 20.38% (0.1619 => 0.1949, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.34% (0.1003 => 0.1207, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.14% (0.1549 => 0.1861, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.06% (0.2014 => 0.2418, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.89% (0.1604 => 0.1923, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 19.43% (0.0947 => 0.1131, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.81% (0.1462 => 0.1737, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 18.64% (0.1218 => 0.1445, std.dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.30% (0.3890 => 0.4602, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 18.26% (0.5826 => 0.6890, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.16% (1.3152 => 1.5540, std.dev.: 0.0115) MultiSource/Applications/spiff/spiff: 17.92% (0.4029 => 0.4751, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 17.91% (0.0698 => 0.0823, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.90% (0.0581 => 0.0685, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 17.87% (0.5546 => 0.6537, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.83% (0.1088 => 0.1282, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.73% (0.2736 => 0.3221, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 17.67% (0.1505 => 0.1771, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 17.66% (0.5889 => 0.6929, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.66% (0.0572 => 0.0673, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.52% (3.5627 => 4.1870, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.41% (0.2866 => 0.3365, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.32% (0.2875 => 0.3373, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.16% (1.6211 => 1.8993, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.94% (0.3271 => 0.3825, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 16.93% (1.8794 => 2.1976, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.82% (0.1968 => 0.2299, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.71% (0.5026 => 0.5866, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: 16.66% (0.2725 => 0.3179, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.64% (0.1160 => 0.1353, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hello: 16.62% (0.2714 => 0.3165, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.58% (0.2738 => 0.3192, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.57% (0.4658 => 0.5430, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.53% (0.2729 => 0.3180) MultiSource/Applications/hbd/hbd: 16.47% (0.9697 => 1.1294, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 16.44% (0.2750 => 0.3202, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/matrix: 16.37% (0.2780 => 0.3235, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.32% (2.7292 => 3.1747, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 16.32% (0.2813 => 0.3272, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.30% (0.2792 => 0.3247, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 16.28% (0.3004 => 0.3493, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 16.26% (0.1421 => 0.1652, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 16.23% (0.2803 => 0.3258, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 16.22% (0.2823 => 0.3281, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.21% (0.4361 => 0.5068, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 16.09% (0.3096 => 0.3594, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 16.08% (0.2811 => 0.3263, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 16.03% (0.9909 => 1.1497, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.01% (0.2911 => 0.3377, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.92% (2.0673 => 2.3964, std.dev.: 0.0027) MultiSource/Applications/d/make_dparser: 15.92% (1.0781 => 1.2497, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.84% (0.3195 => 0.3701, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 15.81% (0.1284 => 0.1487, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 15.80% (0.7171 => 0.8304, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.70% (0.3930 => 0.4547, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 15.67% (0.3267 => 0.3779, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 15.50% (0.3258 => 0.3763, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.41% (4.4195 => 5.1006, std.dev.: 0.0090) MultiSource/Applications/ClamAV/clamscan: 15.33% (4.2109 => 4.8565, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.33% (1.9694 => 2.2713, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.27% (1.9966 => 2.3014, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.26% (0.3362 => 0.3875, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 15.22% (0.3317 => 0.3822, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.16% (0.3060 => 0.3524, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.04% (0.3124 => 0.3594, std.dev.: 0.0061) MultiSource/Benchmarks/Bullet/bullet: 15.01% (23.5202 => 27.0502, std.dev.: 0.0285) SingleSource/UnitTests/ObjC/exceptions-4: 14.92% (0.3465 => 0.3982, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/for-in: 14.90% (0.3496 => 0.4017, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 14.90% (0.3678 => 0.4226, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 14.82% (0.3442 => 0.3952, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 14.82% (0.3469 => 0.3983, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 14.80% (0.3446 => 0.3956, std.dev.: 0.0085) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.76% (0.3488 => 0.4003, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 14.71% (0.3460 => 0.3969, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.56% (0.3282 => 0.3760, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 14.55% (0.3348 => 0.3835, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sieve: 14.52% (0.3726 => 0.4267, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.50% (0.1090 => 0.1248, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 14.44% (0.3650 => 0.4177, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 14.41% (0.3643 => 0.4168, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 14.35% (0.3477 => 0.3976, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 14.30% (1.4269 => 1.6309, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.28% (0.3845 => 0.4394, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.21% (0.3625 => 0.4140, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.17% (0.3690 => 0.4213, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/parameter-passing: 14.12% (0.3724 => 0.4250, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 14.09% (0.4146 => 0.4730, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 14.02% (0.2075 => 0.2366) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.97% (0.3981 => 0.4537, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 13.95% (0.4251 => 0.4844, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 13.91% (0.2566 => 0.2923, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 13.35% (0.7875 => 0.8926, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 13.15% (2.1653 => 2.4501, std.dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/bigfib: 13.09% (0.5012 => 0.5668, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 12.87% (4.6177 => 5.2122, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 12.72% (2.1013 => 2.3686, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.01% (0.2040 => 0.2285, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 11.89% (0.2691 => 0.3011, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.79% (0.1383 => 0.1546, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.73% (0.6435 => 0.7190, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 11.69% (5.5417 => 6.1896, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.89% (0.2737 => 0.3035, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.80% (0.1028 => 0.1139, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.69% (0.2068 => 0.2289, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 10.63% (0.3498 => 0.3870, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.21% (0.3084 => 0.3399, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 10.07% (0.4847 => 0.5335, std.dev.: 0.0047) MultiSource/Applications/siod/siod: 10.05% (0.6634 => 0.7301, std.dev.: 0.0034) MultiSource/Applications/minisat/minisat: 9.80% (0.3336 => 0.3663, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.37% (0.2103 => 0.2300, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 8.93% (2.0346 => 2.2163, std.dev.: 0.0095) MultiSource/Applications/lemon/lemon: 8.91% (0.2391 => 0.2604, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.12% (4.6926 => 5.0738, std.dev.: 0.0131) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.00% (11.6398 => 12.5715, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.80% (0.5361 => 0.5779, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.36% (0.5584 => 0.5995) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.08% (0.7426 => 0.7952, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 6.50% (11.9555 => 12.7332, std.dev.: 0.0127) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.38% (0.3792 => 0.3996, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 10.03% (0.2802 => 0.3083, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6094, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.12% (0.3693 => 0.3919, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6735, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1648, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-2: 4.63% (1.8057 => 1.8893, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: 4.11% (14.0481 => 14.6253, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2021, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2224, std.dev.: 0.0030) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3023, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.45% (2.0820 => 2.1121, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2840, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5143, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5900, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.62% (2.4764 => 2.4364, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.74% (25.4195 => 16.5877, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ary2: -9.62% (0.2402 => 0.2171, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9784, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8033, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7952, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7742, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.80% (17.2379 => 16.7550, std.dev.: 0.0576) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8595, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5737, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4956, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.06% (105.3826 => 104.2639, std.dev.: 0.0168) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.03% (16.2163 => 16.0485, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 08:25:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 10:25:34 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121114162534.483412A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5861?compare_to=5858&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5861, Order: 167928, Start Time: 2012-11-14 14:58:34, End Time: 2012-11-14 16:25:53 To: 5858, Order: 167926, Start Time: 2012-11-14 11:19:37, End Time: 2012-11-14 12:45:47 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 10 (115 on baseline) Performance Improvements: 4 (25 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 978 (834 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.13% (0.8207 => 0.8792, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.71% (0.5974 => 0.6136, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.98% (1.6822 => 1.7155, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.95% (0.8253 => 0.8414, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.02% (4.5939 => 4.6408, std.dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 28.79% (1.9373 => 2.4950, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.23% (0.3329 => 0.3503, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.36% (1.3858 => 1.4323, std.dev.: 0.0157) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.78% (13.1471 => 13.5126, std.dev.: 0.1371) SingleSource/Benchmarks/Shootout-C++/methcall: 1.34% (8.8980 => 9.0170, std.dev.: 0.0311) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.39% (0.9197 => 0.9069, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.06% (1.4935 => 1.4776, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/life/life: -1.96% (2.6172 => 2.5660, std.dev.: 0.0055) MultiSource/Applications/minisat/minisat: -1.13% (6.2348 => 6.1641, std.dev.: 0.0112) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.17% (16.9510 => 16.9794, std.dev.: 0.0425) MultiSource/Applications/obsequi/Obsequi: 1.02% (1.0692 => 1.0801, std.dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.98% (22.0722 => 22.2881, std.dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.14% (0.3669 => 0.3664, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: -0.59% (0.6139 => 0.6103, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.33% (0.3347 => 0.3336, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/strcat: 1.25% (0.2008 => 0.2033, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -20.09% (0.0219 => 0.0175, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.70% (0.0431 => 0.0428, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -23.93% (0.0326 => 0.0248, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.26% (0.0247 => 0.0260, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.47% (0.0427 => 0.0425, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -11.28% (0.0133 => 0.0118, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/test1: 28.12% (0.0160 => 0.0205, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 300.00% (0.0001 => 0.0004, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 1.35% (0.1477 => 0.1497, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.34% (1.1567 => 1.1412, std.dev.: 0.0264) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.92% (0.4105 => 0.4184, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.48% (0.1420 => 0.1399, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.99% (0.0601 => 0.0643, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.02% (0.0249 => 0.0234, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.72% (0.0558 => 0.0554, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: - (1.1942 => 1.1942, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -33.33% (0.0012 => 0.0008, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.55% (0.0559 => 0.0618, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.50% (0.0200 => 0.0209, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.25% (0.7704 => 0.7800, std.dev.: 0.0111) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 6.78% (0.0059 => 0.0063, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2308.67% (0.6332 => 15.2517, std.dev.: 0.0926) MultiSource/Benchmarks/McCat/08-main/main: 48.99% (0.1831 => 0.2728, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.03% (0.1559 => 0.1465, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1556.94% (0.3344 => 5.5408, std.dev.: 0.2317) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.61% (0.2364 => 0.3253, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/mandel: 3.73% (0.0429 => 0.0445, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -8.04% (0.0224 => 0.0206, std.dev.: 0.0015) SingleSource/UnitTests/byval-alignment: -32.17% (0.0230 => 0.0156, std.dev.: 0.0008) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 10.60% (0.1462 => 0.1617, std.dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4655, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0707, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4920, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3581, std.dev.: 0.0850) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1279, std.dev.: 0.0607) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4093, std.dev.: 0.0015) SingleSource/Regression/C/uint64_to_float: -24.01% (2.1832 => 1.6590, std.dev.: 0.0148) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.06% (0.0810 => 0.0932, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/04-bisect/bisect: 8.97% (0.1137 => 0.1239, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.24% (0.1905 => 0.2062, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.96% (0.1885 => 0.2035, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.90% (0.8148 => 0.8792, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.72% (0.1425 => 0.1535, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 7.55% (0.1577 => 0.1696, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.30% (0.4847 => 0.5201, std.dev.: 0.0083) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.20% (0.3137 => 0.3363, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.01% (0.7473 => 0.7997, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.98% (0.2279 => 0.2438, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.70% (0.2240 => 0.2390, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.46% (0.3295 => 0.3508, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.19% (0.2519 => 0.2675, std.dev.: 0.0032) MultiSource/Applications/Burg/burg: 5.56% (1.2222 => 1.2901, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.48% (0.5817 => 0.6136, std.dev.: 0.0024) MultiSource/Applications/spiff/spiff: 5.16% (0.7950 => 0.8360, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.15% (1.1685 => 1.2287, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.89% (1.1606 => 1.2174, std.dev.: 0.0154) MultiSource/Benchmarks/MallocBench/gs/gs: 4.89% (4.1305 => 4.3323, std.dev.: 0.0376) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.69% (1.6386 => 1.7155, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.52% (0.8050 => 0.8414, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.41% (0.4783 => 0.4994, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.29% (0.9435 => 0.9840, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.23% (4.1763 => 4.3530, std.dev.: 0.0392) MultiSource/Applications/lua/lua: 4.10% (3.8189 => 3.9754, std.dev.: 0.0217) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.02% (0.4127 => 0.4293, std.dev.: 0.0026) MultiSource/Applications/hbd/hbd: 3.96% (1.4269 => 1.4834, std.dev.: 0.0172) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.94% (0.2741 => 0.2849, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.85% (14.2605 => 14.8100, std.dev.: 0.0687) MultiSource/Benchmarks/Prolangs-C/football/football: 3.83% (0.8768 => 0.9104, std.dev.: 0.0102) MultiSource/Benchmarks/nbench/nbench: 3.65% (1.1271 => 1.1682, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.64% (0.9908 => 1.0269, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.62% (4.4873 => 4.6499, std.dev.: 0.0341) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.57% (0.8611 => 0.8918, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.56% (0.8317 => 0.8613, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 3.50% (0.6834 => 0.7073, std.dev.: 0.0050) MultiSource/Applications/ClamAV/clamscan: 3.49% (14.7684 => 15.2835, std.dev.: 0.1602) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.43% (0.9074 => 0.9385, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.40% (4.4880 => 4.6408, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.40% (0.3003 => 0.3105, std.dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.39% (6.6074 => 6.8314, std.dev.: 0.0759) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.36% (0.8457 => 0.8741, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 3.35% (0.8885 => 0.9183, std.dev.: 0.0095) MultiSource/Applications/siod/siod: 3.33% (2.2184 => 2.2922, std.dev.: 0.0124) MultiSource/Applications/treecc/treecc: 3.32% (1.9948 => 2.0610, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.32% (0.8597 => 0.8882, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.26% (0.8331 => 0.8603, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.19% (1.1170 => 1.1526, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.17% (8.6476 => 8.9216, std.dev.: 0.0537) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.13% (0.8007 => 0.8258, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.99% (0.8805 => 0.9068, std.dev.: 0.0057) MultiSource/Applications/d/make_dparser: 2.94% (3.2366 => 3.3316, std.dev.: 0.0100) MultiSource/Applications/JM/ldecod/ldecod: 2.82% (6.7320 => 6.9218, std.dev.: 0.0418) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.73% (0.6227 => 0.6397, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.72% (0.3717 => 0.3818, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 2.69% (4.9628 => 5.0962, std.dev.: 0.0193) MultiSource/Applications/lambda-0_1_3/lambda: 2.69% (0.7557 => 0.7760, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.63% (0.8995 => 0.9232, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.63% (0.9039 => 0.9277, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.63% (0.8261 => 0.8478, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.61% (0.9056 => 0.9292, std.dev.: 0.0044) MultiSource/Benchmarks/Bullet/bullet: 2.56% (31.8598 => 32.6770, std.dev.: 0.1015) MultiSource/Benchmarks/PAQ8p/paq8p: 2.50% (2.3764 => 2.4357, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.48% (0.8716 => 0.8932, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.47% (0.9069 => 0.9293, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.42% (0.8855 => 0.9069, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.38% (0.8712 => 0.8919, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.31% (0.8927 => 0.9133, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.27% (0.8177 => 0.8363, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.17% (0.8066 => 0.8241, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.15% (0.8359 => 0.8539, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.09% (0.8069 => 0.8238, std.dev.: 0.0057) MultiSource/Applications/lemon/lemon: 2.06% (1.0945 => 1.1171, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.05% (1.4479 => 1.4776, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.01% (0.8316 => 0.8483, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.91% (0.8048 => 0.8202, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 1.50% (8.6247 => 8.7541, std.dev.: 0.0198) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 106.53% (0.0199 => 0.0411, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/pi: 57.96% (1.5795 => 2.4950, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.86% (0.7597 => 0.8878, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.48% (2.9753 => 3.4655, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.70% (2.7995 => 3.2111, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.45% (5.0261 => 5.6014, std.dev.: 0.0617) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.95% (0.3186 => 0.3503, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.49% (6.3772 => 6.9189, std.dev.: 0.1788) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.60% (1.1857 => 1.2758, std.dev.: 0.0195) SingleSource/Benchmarks/McGill/queens: 7.16% (1.7056 => 1.8278, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/richards_benchmark: 6.84% (1.3037 => 1.3929, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.66% (4.7794 => 5.0975, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.83% (4.9686 => 5.2582, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.80% (4.5327 => 4.7958, std.dev.: 0.0182) MultiSource/Applications/SIBsim4/SIBsim4: 5.63% (3.1873 => 3.3669, std.dev.: 0.0159) MultiSource/Applications/lambda-0_1_3/lambda: 4.99% (7.4933 => 7.8670, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.53% (3.3761 => 3.5290, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.25% (6.2275 => 6.4924, std.dev.: 0.0290) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.17% (4.9453 => 5.1516, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.16% (4.9469 => 5.1525, std.dev.: 0.0208) MultiSource/Applications/hexxagon/hexxagon: 3.88% (14.0064 => 14.5501, std.dev.: 0.0065) MultiSource/Applications/siod/siod: 3.18% (3.6643 => 3.7808, std.dev.: 0.0092) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.18% (0.3587 => 0.3701, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.18% (1.3882 => 1.4323, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.79% (11.5690 => 11.8922, std.dev.: 0.0030) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.74% (1.2337 => 1.2675, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.70% (8.2783 => 8.5017, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/lists: 2.52% (7.3375 => 7.5225, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.29% (4.8660 => 4.9776, std.dev.: 0.0090) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.90% (1.1365 => 1.1581, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.56% (1.5941 => 1.6190, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.32% (2.4647 => 2.4973, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/neural/neural: 1.32% (1.0841 => 1.0984, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.30% (3.5679 => 3.6143, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/whetstone: 1.27% (2.1224 => 2.1493, std.dev.: 0.0067) MultiSource/Applications/spiff/spiff: 1.21% (2.8561 => 2.8906, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: 1.02% (1.2061 => 1.2184, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -37.28% (0.0338 => 0.0212, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/em3d/em3d: -20.58% (5.4641 => 4.3398, std.dev.: 0.3592) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.91% (7.2130 => 6.1372, std.dev.: 0.0685) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.98% (1.0512 => 0.9358, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -10.03% (1.1216 => 1.0091, std.dev.: 0.0151) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.84% (0.3269 => 0.2980, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: -8.49% (63.1822 => 57.8175, std.dev.: 0.0652) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.73% (14.6451 => 13.5126, std.dev.: 0.1371) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.76% (4.7482 => 4.4271, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.99% (3.7148 => 3.4924, std.dev.: 0.0723) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.90% (5.4972 => 5.1727, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.04% (5.1557 => 4.8957, std.dev.: 0.0289) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.39% (4.7449 => 4.5366, std.dev.: 0.0417) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.64% (6.0224 => 5.8034, std.dev.: 0.0046) MultiSource/Applications/lua/lua: -3.50% (29.8330 => 28.7878, std.dev.: 0.0459) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.36% (0.5807 => 0.5612, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.99% (28.5821 => 27.7269, std.dev.: 0.0357) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.64% (2.6356 => 2.5660, std.dev.: 0.0055) MultiSource/Applications/aha/aha: -2.31% (3.3398 => 3.2626, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.22% (9.9065 => 9.6869, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.00% (11.5316 => 11.3009, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/hash2: -1.84% (3.4237 => 3.3608, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.71% (2.3487 => 2.3086, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.57% (4.9994 => 4.9207, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.50% (3.2169 => 3.1685, std.dev.: 0.0029) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 3.24% (16.4461 => 16.9794, std.dev.: 0.0425) MultiSource/Applications/obsequi/Obsequi: 5.25% (1.0262 => 1.0801, std.dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7036.76% (0.3123 => 22.2881, std.dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.76% (0.2463 => 0.3664, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 1.55% (0.6010 => 0.6103, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.14% (0.3266 => 0.3336, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/strcat: 3.25% (0.1969 => 0.2033, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 42.28% (0.0123 => 0.0175, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.36% (0.0254 => 0.0248, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -13.91% (0.0302 => 0.0260, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -37.89% (0.0190 => 0.0118, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/test1: 13.89% (0.0180 => 0.0205, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -42.86% (0.0007 => 0.0004, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 4.10% (0.1438 => 0.1497, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.73% (1.1329 => 1.1412, std.dev.: 0.0264) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.48% (0.4164 => 0.4184, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.19% (0.1369 => 0.1399, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.31% (0.0641 => 0.0643, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 20.00% (0.0195 => 0.0234, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.15% (0.0578 => 0.0554, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.42% (1.1437 => 1.1942, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 700.00% (0.0001 => 0.0008, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.44% (0.0627 => 0.0618, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.11% (0.0180 => 0.0209, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.71% (0.8017 => 0.7800, std.dev.: 0.0111) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 1.61% (0.0062 => 0.0063, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 08:29:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 10:29:49 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121114162949.8E46C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5862?compare_to=5857&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5862, Order: 167928, Start Time: 2012-11-14 15:05:03, End Time: 2012-11-14 16:30:08 To: 5857, Order: 167926, Start Time: 2012-11-14 10:39:57, End Time: 2012-11-14 12:05:12 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 1 (176 on baseline) Unchanged Tests: 1041 (862 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.75% (1.6222 => 1.5938, std.dev.: 0.0073) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.67% (2.0478 => 2.1025, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/salsa20: 2.40% (7.4937 => 7.6734, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 2.22% (3.1932 => 3.2641, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.53% (0.1431 => 0.1309, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.88% (0.3821 => 0.3520, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -6.89% (2.4924 => 2.3207, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -6.73% (0.3357 => 0.3131, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.62% (0.9542 => 0.8910, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.47% (0.2428 => 0.2271, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.24% (0.7198 => 0.6749, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -6.16% (9.2283 => 8.6594, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.13% (0.9852 => 0.9248, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.12% (1.0544 => 0.9899, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: -6.11% (16.1920 => 15.2024, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.11% (0.6484 => 0.6088, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -6.06% (0.2160 => 0.2029, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: -5.99% (7.0961 => 6.6707, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.88% (0.3658 => 0.3443, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.79% (1.3722 => 1.2927, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.69% (0.2355 => 0.2221, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: -5.69% (0.9179 => 0.8657, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.68% (0.2695 => 0.2542, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: -5.67% (0.3812 => 0.3596, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.66% (4.0323 => 3.8042, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.64% (3.5339 => 3.3345, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/exceptions-4: -5.62% (0.3880 => 0.3662, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.61% (0.3848 => 0.3632, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -5.61% (0.3831 => 0.3616, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.59% (4.8161 => 4.5469, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.59% (0.5478 => 0.5172, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -5.59% (4.3330 => 4.0910, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.58% (1.6364 => 1.5451, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.55% (0.3406 => 0.3217, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: -5.54% (0.3896 => 0.3680, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (0.5857 => 0.5533, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -5.53% (0.4033 => 0.3810, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.52% (0.6230 => 0.5886, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -5.52% (1.1450 => 1.0818, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.50% (4.5069 => 4.2588, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.50% (0.6052 => 0.5719, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.50% (0.3891 => 0.3677, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.50% (1.4642 => 1.3837, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -5.49% (0.2985 => 0.2821, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.49% (0.5591 => 0.5284, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.47% (0.6395 => 0.6045, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.46% (4.8802 => 4.6135, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: -5.46% (0.4176 => 0.3948, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -5.43% (1.2515 => 1.1835, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.43% (0.3884 => 0.3673, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.42% (0.5849 => 0.5532, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.42% (6.7716 => 6.4046, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.41% (0.6304 => 0.5963, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.41% (0.6194 => 0.5859, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.40% (0.8521 => 0.8061, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.38% (0.6446 => 0.6099, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.38% (14.2083 => 13.4444, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.37% (0.7524 => 0.7120, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.35% (0.6189 => 0.5858, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -5.34% (17.1032 => 16.1905, std.dev.: 0.0131) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.33% (1.2784 => 1.2102, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.33% (1.2300 => 1.1644, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.33% (0.6676 => 0.6320, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.33% (0.5705 => 0.5401, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.33% (0.5859 => 0.5547, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.32% (0.6667 => 0.6312, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/property: -5.31% (0.4199 => 0.3976, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.29% (0.5802 => 0.5495, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.29% (0.6260 => 0.5929, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.27% (0.5575 => 0.5281, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.27% (0.6736 => 0.6381, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.26% (0.2548 => 0.2414, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.25% (0.7339 => 0.6954, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/08-main/main: -5.23% (0.2659 => 0.2520, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.21% (0.5581 => 0.5290, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.21% (0.5569 => 0.5279, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.21% (0.5456 => 0.5172, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.20% (0.5805 => 0.5503, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.20% (0.5941 => 0.5632, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.20% (0.3483 => 0.3302, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.17% (0.5567 => 0.5279, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.16% (0.6293 => 0.5968, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.16% (0.6297 => 0.5972, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.15% (0.6660 => 0.6317, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.15% (0.5925 => 0.5620, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.14% (0.6033 => 0.5723, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.12% (1.2210 => 1.1585, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.12% (0.5570 => 0.5285, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -5.12% (0.4515 => 0.4284, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.10% (0.6395 => 0.6069, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -5.09% (1.3864 => 1.3158, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.08% (1.2221 => 1.1600, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.07% (0.5999 => 0.5695, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.06% (0.6440 => 0.6114, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.05% (0.2278 => 0.2163, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: -5.03% (3.5154 => 3.3385, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.03% (0.6681 => 0.6345, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: -5.00% (0.4280 => 0.4066, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -4.97% (1.3148 => 1.2494, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.97% (0.2999 => 0.2850, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: -4.96% (15.5079 => 14.7384, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.94% (0.5688 => 0.5407, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.93% (8.0126 => 7.6176, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.92% (0.4916 => 0.4674, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.88% (0.5168 => 0.4916, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -4.86% (15.2527 => 14.5114, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.82% (0.2385 => 0.2270, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.80% (1.6474 => 1.5683, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: -4.80% (1.1530 => 1.0977, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.78% (0.3931 => 0.3743, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.77% (0.7919 => 0.7541, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.74% (0.3837 => 0.3655, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.74% (0.3057 => 0.2912, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.70% (2.1713 => 2.0693, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: -4.69% (0.3025 => 0.2883) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.69% (0.5329 => 0.5079, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: -4.66% (0.3194 => 0.3045, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -4.64% (0.3255 => 0.3104, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -4.63% (4.0594 => 3.8715, std.dev.: 0.0120) MultiSource/Applications/minisat/minisat: -4.62% (0.7447 => 0.7103, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: -4.61% (0.3581 => 0.3416, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: -4.60% (0.2871 => 0.2739, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -4.59% (2.1401 => 2.0419, std.dev.: 0.0084) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.58% (22.4056 => 21.3797, std.dev.: 0.0189) MultiSource/Applications/siod/siod: -4.58% (2.4021 => 2.2922, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/random: -4.56% (0.2939 => 0.2805, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -4.56% (0.3271 => 0.3122, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.54% (0.3016 => 0.2879, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -4.53% (0.4861 => 0.4641, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.50% (0.4151 => 0.3964, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -4.49% (0.2849 => 0.2721, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.49% (0.7021 => 0.6706, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.47% (5.0226 => 4.7981, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/except: -4.46% (0.3026 => 0.2891, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.46% (0.3252 => 0.3107, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.44% (0.2903 => 0.2774, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -4.37% (0.3481 => 0.3329, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -4.35% (0.2989 => 0.2859, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -4.34% (0.3205 => 0.3066, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -4.33% (34.0927 => 32.6181, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: -4.32% (0.3446 => 0.3297, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -4.28% (0.7982 => 0.7640, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -4.27% (0.3394 => 0.3249, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -4.27% (18.2933 => 17.5128, std.dev.: 0.0234) SingleSource/Regression/C++/ofstream_ctor: -4.25% (0.3059 => 0.2929, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.25% (0.3319 => 0.3178, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: -4.23% (0.8418 => 0.8062, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.23% (0.9557 => 0.9153, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.21% (0.4083 => 0.3911, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -4.17% (0.3621 => 0.3470, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.14% (0.3867 => 0.3707, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -4.12% (0.4248 => 0.4073, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.11% (0.4813 => 0.4615, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.10% (0.3849 => 0.3691, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.03% (2.2587 => 2.1676, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -4.02% (0.7779 => 0.7466, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: -3.91% (0.6347 => 0.6099, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.83% (0.6441 => 0.6194, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.79% (0.9077 => 0.8733, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.78% (0.3491 => 0.3359, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.77% (0.4427 => 0.4260, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -3.76% (0.6750 => 0.6496, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.73% (0.3323 => 0.3199, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.59% (0.4321 => 0.4166, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: -3.54% (0.3788 => 0.3654, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: -3.54% (0.4524 => 0.4364, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.46% (5.4682 => 5.2791, std.dev.: 0.0169) MultiSource/Applications/hbd/hbd: -2.90% (1.5610 => 1.5158, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -2.34% (20.7746 => 20.2878, std.dev.: 0.0188) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7538, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1723, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -4.08% (2.2633 => 2.1709, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.06% (1.3096 => 1.2695, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.48% (6.5735 => 6.4760, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0000) Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 09:42:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 11:42:02 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121114174202.132612A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5863?compare_to=5859&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5863, Order: 167928, Start Time: 2012-11-14 15:31:41, End Time: 2012-11-14 17:42:19 To: 5859, Order: 167926, Start Time: 2012-11-14 11:41:52, End Time: 2012-11-14 13:51:45 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 21 (127 on baseline) Performance Improvements: 7 (40 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1010 (720 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/lambda-0_1_3/lambda: 14.83% (0.8674 => 0.9960, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/bigfib: 14.40% (0.7286 => 0.8335, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.81% (0.5634 => 0.6412, std.dev.: 0.0062) SingleSource/Benchmarks/McGill/exptree: 13.16% (0.0927 => 0.1049, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.90% (0.5797 => 0.6545, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.88% (0.1178 => 0.1318, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 11.78% (1.4128 => 1.5792, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.66% (0.3224 => 0.3600, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.41% (0.4471 => 0.4981, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 11.41% (2.5600 => 2.8520, std.dev.: 0.0246) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.40% (1.5161 => 1.6737, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 10.02% (1.5380 => 1.6921, std.dev.: 0.0281) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.74% (1.6101 => 1.7670, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/except: 9.33% (0.3150 => 0.3444, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.11% (0.6685 => 0.7294, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.74% (0.7458 => 0.8035, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 17.60% (0.1210 => 0.1423, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 7.19% (14.1836 => 15.2038, std.dev.: 0.2371) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.27% (0.3144 => 0.3341, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5.32% (6.0670 => 6.3900, std.dev.: 0.0788) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 4.86% (5.2986 => 5.5559, std.dev.: 0.0468) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -12.78% (0.4821 => 0.4205, std.dev.: 0.0040) MultiSource/Applications/treecc/treecc: -8.06% (2.6032 => 2.3935, std.dev.: 0.0750) MultiSource/Applications/d/make_dparser: -5.65% (4.2899 => 4.0474, std.dev.: 0.0708) MultiSource/Applications/JM/ldecod/ldecod: -1.15% (9.8190 => 9.7061, std.dev.: 0.0381) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: -7.95% (0.7557 => 0.6956, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -4.27% (7.1129 => 6.8093, std.dev.: 0.0700) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.20% (89.1422 => 87.1847, std.dev.: 0.6807) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 1.79% (0.1338 => 0.1362, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -14.11% (0.0489 => 0.0420, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.15% (0.0650 => 0.0677, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -0.00% (494.2563 => 494.2323, std.dev.: 0.2761) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/power/power: 43726.58% (1.1277 => 494.2323, std.dev.: 0.2761) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 223.60% (0.5229 => 1.6921, std.dev.: 0.0281) MultiSource/Applications/SPASS/SPASS: 22.06% (14.9895 => 18.2966, std.dev.: 0.0100) MultiSource/Applications/kimwitu++/kc: 49.89% (14.1553 => 21.2171, std.dev.: 0.1846) MultiSource/Benchmarks/MallocBench/gs/gs: 21.59% (4.1105 => 4.9979, std.dev.: 0.0141) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 51.49% (1.1048 => 1.6737, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 434.77% (7.1582 => 38.2799, std.dev.: 0.1185) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.84% (3.4629 => 6.4355, std.dev.: 0.2607) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.23% (0.6222 => 1.0343, std.dev.: 0.0544) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10965.00% (0.0720 => 7.9668, std.dev.: 0.0792) MultiSource/Applications/SIBsim4/SIBsim4: 3889800.00% (0.0001 => 3.8899, std.dev.: 0.0300) MultiSource/Applications/SPASS/SPASS: 15203700.00% (0.0001 => 15.2038, std.dev.: 0.2371) MultiSource/Applications/kimwitu++/kc: 52100.00% (0.0001 => 0.0522, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 65100.00% (0.0001 => 0.0652, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14500.00% (0.0001 => 0.0146) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 614800.00% (0.0001 => 0.6149, std.dev.: 0.0140) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10089000.00% (0.0001 => 10.0891, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6202100.00% (0.0001 => 6.2022, std.dev.: 0.5701) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1836.32% (1.1194 => 21.6752, std.dev.: 0.0163) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 63.96% (2.9384 => 4.8179, std.dev.: 0.2418) MultiSource/Applications/ClamAV/clamscan: 62.00% (22.1758 => 35.9249, std.dev.: 0.0195) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 60.32% (7.0540 => 11.3087, std.dev.: 0.0288) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.81% (8.1363 => 12.2700, std.dev.: 0.0743) MultiSource/Applications/JM/lencod/lencod: 46.98% (21.9371 => 32.2436, std.dev.: 0.1259) MultiSource/Benchmarks/FreeBench/distray/distray: 44.98% (0.1056 => 0.1531, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/almabench: 39.86% (0.0730 => 0.1021, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 39.46% (0.1432 => 0.1997, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/n-body: 34.85% (0.0746 => 0.1006, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 34.00% (0.7433 => 0.9960, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/voronoi/voronoi: 33.33% (0.2700 => 0.3600, std.dev.: 0.0081) SingleSource/UnitTests/vla: 30.14% (0.0355 => 0.0462, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 29.50% (2.2024 => 2.8520, std.dev.: 0.0246) SingleSource/Benchmarks/Misc-C++/bigfib: 29.10% (0.6456 => 0.8335, std.dev.: 0.0103) SingleSource/Benchmarks/McGill/exptree: 28.87% (0.0814 => 0.1049, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.21% (0.5105 => 0.6545, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 27.78% (0.5569 => 0.7116, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/functionobjects: 27.73% (0.5020 => 0.6412, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 27.71% (0.1032 => 0.1318, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/loader/loader: 26.54% (0.2758 => 0.3490, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 25.96% (0.8067 => 1.0161, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/08-main/main: 25.41% (0.2554 => 0.3203, std.dev.: 0.0227) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 24.94% (0.0437 => 0.0546, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 24.57% (0.6450 => 0.8035, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 24.47% (0.5860 => 0.7294, std.dev.: 0.0080) SingleSource/Benchmarks/Stanford/Oscar: 23.90% (0.0636 => 0.0788, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.51% (0.0770 => 0.0951, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 23.42% (0.8101 => 0.9998, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 22.97% (1.2842 => 1.5792, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.83% (0.1695 => 0.2082, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/Large/ray: 22.56% (0.4064 => 0.4981, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/misr: 22.12% (0.0633 => 0.0773, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.71% (0.1566 => 0.1906, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.46% (14.3668 => 17.4494, std.dev.: 0.0486) MultiSource/Applications/d/make_dparser: 21.35% (3.3354 => 4.0474, std.dev.: 0.0708) MultiSource/Benchmarks/Olden/tsp/tsp: 20.34% (0.1175 => 0.1414, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.30% (0.0793 => 0.0954, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/except: 19.96% (0.2871 => 0.3444, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/trivial-interface: 19.90% (0.3473 => 0.4164, std.dev.: 0.0094) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.02% (0.1125 => 0.1339, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/lpbench: 18.73% (0.0929 => 0.1103, std.dev.: 0.0033) MultiSource/Applications/Burg/burg: 18.60% (1.1642 => 1.3807, std.dev.: 0.0302) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.48% (4.2646 => 5.0529, std.dev.: 0.0740) MultiSource/Applications/oggenc/oggenc: 18.17% (5.7591 => 6.8056, std.dev.: 0.1507) MultiSource/Applications/treecc/treecc: 18.06% (2.0273 => 2.3935, std.dev.: 0.0750) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.93% (0.0842 => 0.0993, std.dev.: 0.0044) MultiSource/Applications/lua/lua: 17.71% (3.8723 => 4.5579, std.dev.: 0.1290) MultiSource/Benchmarks/mafft/pairlocalalign: 17.63% (9.4845 => 11.1568, std.dev.: 0.0823) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.46% (4.9449 => 5.8083, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.28% (5.0018 => 5.8660, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.24% (0.2065 => 0.2421, std.dev.: 0.0090) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.22% (0.8172 => 0.9579, std.dev.: 0.0288) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.06% (1.4186 => 1.6606, std.dev.: 0.0458) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 16.82% (0.0672 => 0.0785, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: 16.76% (0.3109 => 0.3630, std.dev.: 0.0176) MultiSource/Applications/sqlite3/sqlite3: 16.76% (17.1811 => 20.0599, std.dev.: 0.0810) SingleSource/Benchmarks/Shootout/matrix: 16.38% (0.0818 => 0.0952, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.34% (1.3050 => 1.5182, std.dev.: 0.0633) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.26% (0.0953 => 0.1108, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/mst/mst: 16.17% (0.1163 => 0.1351, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.90% (0.0648 => 0.0751, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.69% (0.0886 => 0.1025, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 15.65% (3.8922 => 4.5012, std.dev.: 0.0344) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.58% (0.0770 => 0.0890, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.47% (0.0834 => 0.0963, std.dev.: 0.0028) MultiSource/Benchmarks/NPB-serial/is/is: 15.30% (0.0719 => 0.0829, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.15% (0.1940 => 0.2234, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 15.11% (0.1555 => 0.1790, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.04% (0.1117 => 0.1285, std.dev.: 0.0045) MultiSource/Benchmarks/Bullet/bullet: 14.80% (63.2438 => 72.6022, std.dev.: 0.0432) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.73% (0.1337 => 0.1534, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.64% (0.3307 => 0.3791, std.dev.: 0.0173) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.55% (0.3121 => 0.3575, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 14.54% (1.1840 => 1.3562, std.dev.: 0.0596) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.48% (0.2107 => 0.2412, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.15% (0.9765 => 1.1147, std.dev.: 0.0390) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.98% (0.5981 => 0.6817, std.dev.: 0.0208) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.52% (0.2271 => 0.2578, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.40% (0.3441 => 0.3902, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 13.37% (1.5859 => 1.7980, std.dev.: 0.0406) MultiSource/Benchmarks/McCat/09-vor/vor: 13.11% (0.3180 => 0.3597, std.dev.: 0.0147) SingleSource/UnitTests/ObjC/exceptions-4: 12.98% (0.3543 => 0.4003, std.dev.: 0.0124) SingleSource/UnitTests/ObjC/synchronized: 12.83% (0.3561 => 0.4018, std.dev.: 0.0166) SingleSource/UnitTests/ObjC/exceptions-3: 12.83% (0.3516 => 0.3967, std.dev.: 0.0143) SingleSource/UnitTests/ObjC/for-in: 12.70% (0.3694 => 0.4163, std.dev.: 0.0168) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.28% (0.1906 => 0.2121, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.26% (0.2603 => 0.2896, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 10.78% (0.8921 => 0.9883, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.79% (0.2430 => 0.2668, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.68% (2.2022 => 2.4153, std.dev.: 0.0522) MultiSource/Benchmarks/PAQ8p/paq8p: 9.16% (10.3673 => 11.3172, std.dev.: 0.0780) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.86% (0.3935 => 0.4205, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.79% (7.9617 => 8.4226, std.dev.: 0.0182) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.73% (4.3953 => 11.0205, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/methcall: 147.73% (5.3999 => 13.3770) MultiSource/Applications/minisat/minisat: 22.98% (9.1159 => 11.2106, std.dev.: 0.1397) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.97% (13.4384 => 16.3909, std.dev.: 0.6293) SingleSource/Benchmarks/Misc/oourafft: 17.59% (6.6465 => 7.8154, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.19% (1.1145 => 1.3061, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/lpbench: 15.23% (10.3460 => 11.9215, std.dev.: 0.1860) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.94% (0.2944 => 0.3325, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.68% (2.8904 => 3.2281, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: 10.21% (1.1396 => 1.2559, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.05% (8.6802 => 9.5522, std.dev.: 0.1566) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 9.63% (0.1298 => 0.1423, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.40% (1.7254 => 1.8876, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 8.97% (3.1578 => 3.4412, std.dev.: 0.0912) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.83% (0.3070 => 0.3341, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.92% (0.9540 => 1.0105, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.84% (4.2280 => 4.4750, std.dev.: 0.0055) SingleSource/Regression/C/uint64_to_float: 5.10% (0.5413 => 0.5689, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.08% (11.6436 => 12.1192, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: 2.64% (2.4116 => 2.4752, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/tsp/tsp: 2.27% (1.0785 => 1.1030, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 2.07% (3.1595 => 3.2248, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 1.88% (85.0658 => 86.6668, std.dev.: 0.0370) MultiSource/Benchmarks/mafft/pairlocalalign: 1.48% (27.8444 => 28.2554, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout/sieve: 1.45% (5.2139 => 5.2894, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.39% (6.5088 => 6.5993, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0501, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.02% (12.5348 => 12.6632, std.dev.: 0.0406) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1672, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.58% (5.2763 => 1.2355, std.dev.: 0.0577) SingleSource/Benchmarks/Misc/salsa20: -75.48% (0.8651 => 0.2121, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/richards_benchmark: -45.07% (0.1622 => 0.0891, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.51% (5.3526 => 4.8435, std.dev.: 0.1183) MultiSource/Applications/JM/ldecod/ldecod: -6.99% (10.4361 => 9.7061, std.dev.: 0.0381) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.46% (5.3855 => 5.0375, std.dev.: 0.0596) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -47.50% (0.0400 => 0.0210) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.20% (0.0628 => 0.0363) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.06% (0.3987 => 0.2390, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.53% (0.0506 => 0.0306, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.31% (4.5009 => 2.7767, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -33.52% (1.1492 => 0.7640, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.13% (2.6546 => 2.0140, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -22.75% (10.7105 => 8.2741, std.dev.: 0.3014) MultiSource/Benchmarks/FreeBench/mason/mason: -19.30% (0.2161 => 0.1744, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2839, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.71% (32.5116 => 29.0309, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -9.76% (9.5636 => 8.6306, std.dev.: 0.1531) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.70% (1.5660 => 1.4297, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.95% (4.8142 => 4.4797, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.2416 => 3.0207, std.dev.: 0.0273) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5758, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -4.88% (1.5835 => 1.5062, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.60% (1.6805 => 1.6032, std.dev.: 0.0270) SingleSource/Benchmarks/Shootout/lists: -4.22% (6.2999 => 6.0340, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.50% (19.9488 => 19.2508, std.dev.: 0.1380) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.42% (0.9957 => 0.9616, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: -2.96% (5.0483 => 4.8991, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.29% (0.4808 => 0.4698, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.81% (8.1563 => 8.0088, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6773, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.46% (10.2830 => 10.1328, std.dev.: 0.0015) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.28% (0.1485 => 0.1362, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.01% (0.2116 => 0.0677, std.dev.: 0.0009) Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 10:12:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 12:12:06 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121114181206.93C822A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5864?compare_to=5861&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5864, Order: 167929, Start Time: 2012-11-14 16:42:40, End Time: 2012-11-14 18:12:25 To: 5861, Order: 167928, Start Time: 2012-11-14 14:58:34, End Time: 2012-11-14 16:25:53 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 2 (41 on baseline) Performance Improvements: 0 (16 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 990 (917 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.94% (1.2859 => 1.3109, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.40% (22.4750 => 22.7904, std.dev.: 0.0571) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.06% (16.9794 => 17.1597, std.dev.: 0.8319) MultiSource/Applications/obsequi/Obsequi: -0.89% (1.0801 => 1.0705, std.dev.: 0.0781) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.92% (22.2881 => 22.4937, std.dev.: 0.4610) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.87% (0.3664 => 0.3696, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 0.29% (0.6103 => 0.6121, std.dev.: 0.0213) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.57% (0.3336 => 0.3355, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/strcat: -1.08% (0.2033 => 0.2011, std.dev.: 0.0641) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 12.57% (0.0175 => 0.0197, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -13.08% (0.0428 => 0.0372, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 2.02% (0.0248 => 0.0253, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 21.15% (0.0260 => 0.0315, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.94% (0.0425 => 0.0429, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 72.03% (0.0118 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -2.93% (0.0205 => 0.0199, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 225.00% (0.0004 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -1.07% (0.1497 => 0.1481, std.dev.: 0.0333) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 4.67% (1.1412 => 1.1945, std.dev.: 0.2156) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.36% (0.4184 => 0.4199, std.dev.: 0.0219) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.57% (0.1399 => 0.1421, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.04% (0.0643 => 0.0617, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.28% (0.0234 => 0.0237, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.68% (0.0554 => 0.0591, std.dev.: 0.0148) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.52% (1.1942 => 1.2004, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -87.50% (0.0008 => 0.0001, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -29.63% (0.0027 => 0.0019, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.74% (0.0618 => 0.0564, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.79% (0.0209 => 0.0242, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.92% (0.7800 => 0.7728, std.dev.: 0.0590) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: -85.71% (0.0007 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 25.40% (0.0063 => 0.0079, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2340.65% (0.6332 => 15.4542, std.dev.: 0.5657) MultiSource/Benchmarks/McCat/08-main/main: 50.14% (0.1831 => 0.2749, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.81% (0.1559 => 0.1484, std.dev.: 0.0403) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1531.55% (0.3344 => 5.4559, std.dev.: 0.3381) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.77% (0.2364 => 0.3257, std.dev.: 0.1052) SingleSource/Benchmarks/Misc/mandel: 0.23% (0.0429 => 0.0430, std.dev.: 0.0097) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.57% (0.0224 => 0.0232, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -26.09% (0.0230 => 0.0170, std.dev.: 0.0017) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 10.26% (0.1462 => 0.1612, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4848, std.dev.: 0.0414) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0696, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4876, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3095, std.dev.: 0.4086) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1344, std.dev.: 0.0649) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4003, std.dev.: 0.0038) SingleSource/Regression/C/uint64_to_float: -23.64% (2.1832 => 1.6671, std.dev.: 0.0046) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.30% (0.0810 => 0.0942, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.15% (0.0848 => 0.0968, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.25% (0.0830 => 0.0940, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.65% (0.4847 => 0.5218, std.dev.: 0.0125) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.87% (0.2519 => 0.2692, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.39% (0.3003 => 0.3195, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.57% (1.1606 => 1.2253, std.dev.: 0.0220) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.65% (1.2526 => 1.3109, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 4.46% (0.6834 => 0.7139, std.dev.: 0.0108) MultiSource/Benchmarks/nbench/nbench: 3.87% (1.1271 => 1.1707, std.dev.: 0.0131) MultiSource/Applications/siod/siod: 3.87% (2.2184 => 2.3042, std.dev.: 0.0159) MultiSource/Applications/sgefa/sgefa: 3.47% (0.2999 => 0.3103, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.12% (0.8048 => 0.8299, std.dev.: 0.0091) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.83% (4.5702 => 4.6996, std.dev.: 0.0357) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 89.45% (0.0199 => 0.0377, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/pi: 59.26% (1.5795 => 2.5155, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 17.19% (2.9753 => 3.4869, std.dev.: 0.1019) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.15% (0.7597 => 0.8900, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.50% (2.7995 => 3.2055, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6091, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.86% (1.1857 => 1.2789, std.dev.: 0.0224) MultiSource/Applications/SIBsim4/SIBsim4: 6.71% (3.1873 => 3.4012, std.dev.: 0.0732) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.43% (4.7794 => 5.0868, std.dev.: 0.0289) SingleSource/Benchmarks/Misc/richards_benchmark: 6.09% (1.3037 => 1.3831, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.00% (4.9686 => 5.2668, std.dev.: 0.0884) MultiSource/Applications/lambda-0_1_3/lambda: 5.34% (7.4933 => 7.8934, std.dev.: 0.0558) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.96% (1.2337 => 1.2949, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.70% (3.3761 => 3.5348, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.61% (6.2275 => 6.5146, std.dev.: 0.0271) MultiSource/Applications/hexxagon/hexxagon: 4.32% (14.0064 => 14.6113, std.dev.: 0.0382) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.05% (4.9469 => 5.1474, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.04% (4.9453 => 5.1451, std.dev.: 0.0163) MultiSource/Applications/siod/siod: 3.87% (3.6643 => 3.8062, std.dev.: 0.0092) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.37% (0.3587 => 0.3708, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.05% (4.8362 => 4.9837, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.71% (11.5690 => 11.8820, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout/lists: 2.36% (7.3375 => 7.5106, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (1.1365 => 1.1623, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.20% (22.2997 => 22.7904, std.dev.: 0.0571) MultiSource/Benchmarks/Olden/power/power: 1.68% (1.2061 => 1.2264, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 1.37% (1.0841 => 1.0990, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -31.66% (0.0338 => 0.0231, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: -21.00% (5.4641 => 4.3167, std.dev.: 0.0222) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.04% (1.0512 => 0.9351, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: -8.35% (63.1822 => 57.9092, std.dev.: 0.1333) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.87% (4.7482 => 4.4218, std.dev.: 0.0263) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.86% (14.6451 => 13.6407, std.dev.: 0.0776) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.89% (5.4972 => 5.1733, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.77% (3.7148 => 3.5004, std.dev.: 0.0536) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.13% (5.1557 => 4.8912, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.29% (4.7449 => 4.5413, std.dev.: 0.0546) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.55% (2.8773 => 2.7751, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.41% (6.0224 => 5.8169, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.04% (28.5821 => 27.7136, std.dev.: 0.0625) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.00% (0.5807 => 0.5633, std.dev.: 0.0018) MultiSource/Applications/aha/aha: -2.71% (3.3398 => 3.2492, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.70% (2.6356 => 2.5644, std.dev.: 0.0075) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 4.34% (16.4461 => 17.1597, std.dev.: 0.8319) MultiSource/Applications/obsequi/Obsequi: 4.32% (1.0262 => 1.0705, std.dev.: 0.0781) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7102.59% (0.3123 => 22.4937, std.dev.: 0.4610) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.06% (0.2463 => 0.3696, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 1.85% (0.6010 => 0.6121, std.dev.: 0.0213) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.73% (0.3266 => 0.3355, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/strcat: 2.13% (0.1969 => 0.2011, std.dev.: 0.0641) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 60.16% (0.0123 => 0.0197, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -8.82% (0.0408 => 0.0372, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.39% (0.0254 => 0.0253, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.72% (0.0384 => 0.0429, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 10.56% (0.0180 => 0.0199, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.99% (0.1438 => 0.1481, std.dev.: 0.0333) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 5.44% (1.1329 => 1.1945, std.dev.: 0.2156) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.84% (0.4164 => 0.4199, std.dev.: 0.0219) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.80% (0.1369 => 0.1421, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.74% (0.0641 => 0.0617, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 21.54% (0.0195 => 0.0237, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.25% (0.0578 => 0.0591, std.dev.: 0.0148) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.96% (1.1437 => 1.2004, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 35.71% (0.0014 => 0.0019, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.05% (0.0627 => 0.0564, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 34.44% (0.0180 => 0.0242, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.60% (0.8017 => 0.7728, std.dev.: 0.0590) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 27.42% (0.0062 => 0.0079, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 10:18:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 12:18:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121114181841.AAB532A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5865?compare_to=5862&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5865, Order: 167929, Start Time: 2012-11-14 16:53:41, End Time: 2012-11-14 18:18:58 To: 5862, Order: 167928, Start Time: 2012-11-14 15:05:03, End Time: 2012-11-14 16:30:08 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 1 (181 on baseline) Unchanged Tests: 1041 (857 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.44% (80.2789 => 79.1221, std.dev.: 0.2439) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.57% (2.0478 => 2.1005, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.4937 => 7.6618, std.dev.: 0.0240) SingleSource/Benchmarks/Shootout-C++/hash2: 2.20% (3.1932 => 3.2634, std.dev.: 0.0096) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.53% (0.1431 => 0.1309, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.96% (0.3821 => 0.3517, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.88% (2.4924 => 2.3208, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.84% (0.9542 => 0.8889, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.60% (0.7198 => 0.6723, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.55% (0.3357 => 0.3137, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.51% (0.2428 => 0.2270, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -6.20% (0.2160 => 0.2026, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.18% (0.9852 => 0.9243, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -6.14% (16.1920 => 15.1975, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.10% (1.0544 => 0.9901, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -6.07% (9.2283 => 8.6682, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.05% (0.6484 => 0.6092, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: -5.97% (0.9179 => 0.8631, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: -5.97% (7.0961 => 6.6728, std.dev.: 0.0097) SingleSource/Benchmarks/McGill/chomp: -5.96% (0.1761 => 0.1656, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.90% (0.1796 => 0.1690, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.86% (0.2695 => 0.2537, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.82% (1.3722 => 1.2923, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: -5.80% (0.1879 => 0.1770, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.80% (0.3658 => 0.3446, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.77% (4.0323 => 3.7996, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.77% (3.5339 => 3.3301, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/trivial-interface: -5.69% (0.3812 => 0.3595, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.69% (0.2355 => 0.2221, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.66% (1.2300 => 1.1604, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: -5.65% (1.1450 => 1.0803, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: -5.65% (4.3330 => 4.0884, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.64% (0.6736 => 0.6356, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-2: -5.64% (0.3831 => 0.3615, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.63% (0.3891 => 0.3672, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.63% (1.4642 => 1.3818, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: -5.62% (0.3880 => 0.3662, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.61% (0.3848 => 0.3632, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.61% (0.3406 => 0.3215) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.60% (0.5478 => 0.5171, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.60% (1.6364 => 1.5447, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: -5.59% (0.2985 => 0.2818, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.59% (0.3884 => 0.3667, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -5.59% (1.1530 => 1.0886, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.57% (4.8161 => 4.5479, std.dev.: 0.0054) MultiSource/Applications/Burg/burg: -5.56% (1.2515 => 1.1819, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions: -5.53% (0.4176 => 0.3945, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.51% (0.5857 => 0.5534, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.50% (0.8521 => 0.8052, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.50% (4.5069 => 4.2591, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.46% (0.6304 => 0.5960, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.46% (6.7716 => 6.4021, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.45% (0.5849 => 0.5530, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.44% (0.3896 => 0.3684, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.44% (0.5863 => 0.5544, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.43% (0.5805 => 0.5490, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.43% (0.6395 => 0.6048, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.38% (0.5591 => 0.5290, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.36% (0.5705 => 0.5399, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.36% (4.8802 => 4.6185, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.35% (0.6052 => 0.5728, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.35% (0.5925 => 0.5608, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/05-eks/eks: -5.34% (0.4515 => 0.4274, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.34% (0.6297 => 0.5961, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.33% (0.5575 => 0.5278, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.33% (0.5802 => 0.5493, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.33% (0.5859 => 0.5547, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.32% (0.6446 => 0.6103, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.32% (0.6260 => 0.5927, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.32% (1.2784 => 1.2104, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.32% (14.2083 => 13.4530, std.dev.: 0.0090) SingleSource/UnitTests/ObjC/for-in: -5.31% (0.4033 => 0.3819, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -5.30% (17.1032 => 16.1967, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.30% (0.6230 => 0.5900, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.29% (0.6660 => 0.6308, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.28% (0.3483 => 0.3299) MultiSource/Benchmarks/McCat/08-main/main: -5.27% (0.2659 => 0.2519, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.26% (0.4199 => 0.3978, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.26% (0.5569 => 0.5276, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.26% (0.2548 => 0.2414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.22% (0.7339 => 0.6956, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.21% (0.6194 => 0.5871, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.21% (0.5581 => 0.5290, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.21% (0.7524 => 0.7132, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.21% (0.6395 => 0.6062, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.20% (0.6189 => 0.5867, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.19% (0.5570 => 0.5281, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.19% (0.5456 => 0.5173, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: -5.17% (0.3581 => 0.3396, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.16% (0.6440 => 0.6108, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.15% (0.6676 => 0.6332, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.15% (0.5941 => 0.5635, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.14% (0.6667 => 0.6324, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.14% (1.2210 => 1.1582, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.14% (0.5567 => 0.5281, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.14% (0.2999 => 0.2845, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.13% (0.5688 => 0.5396, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.08% (0.7919 => 0.7517, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.07% (0.5999 => 0.5695, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: -5.05% (0.4280 => 0.4064, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.03% (0.6681 => 0.6345, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -5.02% (3.5154 => 3.3388, std.dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: -5.01% (1.3864 => 1.3169, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.99% (0.6293 => 0.5979, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.98% (1.2221 => 1.1612, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -4.96% (15.5079 => 14.7388, std.dev.: 0.0161) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.92% (0.4916 => 0.4674, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.89% (8.0126 => 7.6210, std.dev.: 0.0047) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.88% (0.3319 => 0.3157, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: -4.87% (0.7447 => 0.7084, std.dev.: 0.0038) MultiSource/Applications/ClamAV/clamscan: -4.87% (15.2527 => 14.5098, std.dev.: 0.0070) MultiSource/Applications/lua/lua: -4.85% (4.0594 => 3.8624, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.84% (1.6474 => 1.5676, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.82% (0.6033 => 0.5742, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.82% (0.2385 => 0.2270, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.82% (0.5168 => 0.4919, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.78% (0.2278 => 0.2169, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.76% (0.3931 => 0.3744, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.74% (0.3837 => 0.3655, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.71% (0.3057 => 0.2913, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -4.69% (0.3025 => 0.2883, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -4.69% (1.3148 => 1.2531, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.66% (2.1713 => 2.0702, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.62% (0.5329 => 0.5083, std.dev.: 0.0042) MultiSource/Applications/siod/siod: -4.61% (2.4021 => 2.2914, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/matrix: -4.61% (0.3255 => 0.3105) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.61% (22.4056 => 21.3737, std.dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.60% (0.7021 => 0.6698, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: -4.59% (2.1401 => 2.0419, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: -4.57% (0.3194 => 0.3048, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: -4.53% (0.2871 => 0.2741, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.51% (0.2903 => 0.2772, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -4.50% (5.0226 => 4.7965, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.50% (0.2933 => 0.2801, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.48% (0.3016 => 0.2881, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -4.46% (0.3026 => 0.2891, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.46% (0.3252 => 0.3107, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -4.46% (0.2849 => 0.2722, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -4.41% (0.3059 => 0.2924, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -4.40% (0.4861 => 0.4647, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.38% (0.4151 => 0.3969, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -4.34% (0.3205 => 0.3066, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -4.31% (0.3271 => 0.3130, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: -4.31% (0.3481 => 0.3331, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -4.31% (0.3621 => 0.3465, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.28% (0.2989 => 0.2861, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -4.27% (0.3446 => 0.3299) SingleSource/Benchmarks/Shootout-C++/moments: -4.26% (0.4248 => 0.4067, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -4.26% (34.0927 => 32.6414, std.dev.: 0.0056) MultiSource/Applications/kimwitu++/kc: -4.24% (18.2933 => 17.5183, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary: -4.21% (0.3394 => 0.3251) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.21% (0.9557 => 0.9155, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -4.16% (0.3867 => 0.3706, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.14% (0.4083 => 0.3914, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.10% (0.3849 => 0.3691, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -4.01% (0.7982 => 0.7662, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.98% (2.2587 => 2.1688, std.dev.: 0.0060) SingleSource/UnitTests/ObjC++/property-reference: -3.95% (0.7779 => 0.7472, std.dev.: 0.0023) MultiSource/Applications/spiff/spiff: -3.94% (0.8418 => 0.8086, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: -3.94% (0.6347 => 0.6097, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.92% (0.3491 => 0.3354, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.91% (0.4427 => 0.4254, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.80% (0.9077 => 0.8732, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.76% (0.4813 => 0.4632, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -3.76% (0.6441 => 0.6199, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -3.67% (0.6750 => 0.6502, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: -3.64% (0.3788 => 0.3650, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.58% (0.3323 => 0.3204, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: -3.54% (0.4524 => 0.4364, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.44% (5.4682 => 5.2801, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.19% (0.4321 => 0.4183, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: -3.00% (1.5610 => 1.5141, std.dev.: 0.0046) SingleSource/UnitTests/Vector/constpool: -2.42% (20.7746 => 20.2710, std.dev.: 0.0253) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.36% (7.5137 => 5.7582, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/richards_benchmark: -8.66% (1.2842 => 1.1730, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.80% (2.2633 => 2.1773, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.17% (1.0557 => 1.0222, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.07% (1.3096 => 1.2694, std.dev.: 0.0096) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.61% (6.5735 => 6.4678, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0007) Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 10:44:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 12:44:39 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121114184439.B62BE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5866?compare_to=5860&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5866, Order: 167928, Start Time: 2012-11-14 15:29:23, End Time: 2012-11-14 18:44:57 To: 5860, Order: 167926, Start Time: 2012-11-14 11:07:30, End Time: 2012-11-14 14:23:02 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (171 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1042 (720 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.64% (0.0625 => 0.0879, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.17% (0.1063 => 0.1405, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.20% (0.2969 => 0.3747, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.41% (0.1106 => 0.1387, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.62% (0.4139 => 0.5158, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.37% (0.0714 => 0.0888, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.96% (0.4253 => 0.5272, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.90% (0.5900 => 0.7310, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.79% (0.0475 => 0.0588, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 23.73% (1.5932 => 1.9713, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.53% (0.4994 => 0.6169, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.08% (0.5000 => 0.6154, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.95% (0.0584 => 0.0718, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.84% (0.1620 => 0.1990, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.62% (0.1021 => 0.1252, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 22.04% (0.0599 => 0.0731, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.86% (0.1107 => 0.1349, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.64% (0.0633 => 0.0770) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.40% (0.0897 => 0.1089, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.18% (0.0642 => 0.0778, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 20.99% (0.0948 => 0.1147, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.85% (0.1103 => 0.1333, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 20.83% (0.0821 => 0.0992, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 20.82% (0.1619 => 0.1956, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.72% (0.0584 => 0.0705, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.70% (0.0541 => 0.0653, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.68% (0.0822 => 0.0992, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.44% (0.1003 => 0.1208, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.32% (0.3903 => 0.4696, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.26% (0.1604 => 0.1929, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.21% (0.1549 => 0.1862, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 19.32% (0.0947 => 0.1130, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.12% (0.2014 => 0.2399, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.81% (0.1462 => 0.1737, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 18.64% (0.1218 => 0.1445, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 18.56% (0.0808 => 0.0958, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.46% (0.3890 => 0.4608, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 18.18% (0.5826 => 0.6885, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 18.05% (0.0698 => 0.0824, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.86% (1.3152 => 1.5501, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 17.85% (0.4029 => 0.4748, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.76% (0.2736 => 0.3222, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.69% (0.2866 => 0.3373, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference-object: 17.66% (0.5889 => 0.6929, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.66% (0.0572 => 0.0673) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.65% (0.1088 => 0.1280, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/09-vor/vor: 17.61% (0.1505 => 0.1770, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.51% (3.5627 => 4.1865, std.dev.: 0.0051) MultiSource/Applications/Burg/burg: 17.31% (0.5546 => 0.6506, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.22% (0.2875 => 0.3370, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.21% (1.6211 => 1.9001, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/gs/gs: 16.96% (1.8794 => 2.1982, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.79% (0.5026 => 0.5870, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.77% (0.1968 => 0.2298, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.72% (0.4658 => 0.5437, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.58% (0.2738 => 0.3192, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.57% (0.3271 => 0.3813, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 16.55% (0.2725 => 0.3176, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 16.54% (0.2714 => 0.3163, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.49% (0.2729 => 0.3179, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.48% (0.2792 => 0.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 16.47% (0.2750 => 0.3203, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.47% (0.1160 => 0.1351, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 16.38% (0.9697 => 1.1285, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 16.38% (0.2803 => 0.3262, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.33% (0.4361 => 0.5073, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 16.26% (0.1421 => 0.1652, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 16.22% (0.2780 => 0.3231, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.21% (0.2911 => 0.3383, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.20% (2.7292 => 3.1712, std.dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 16.18% (0.3004 => 0.3490, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: 16.17% (0.2813 => 0.3268, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 16.15% (0.2823 => 0.3279, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 16.08% (0.2811 => 0.3263, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 15.99% (0.3096 => 0.3591, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 15.93% (1.0781 => 1.2498, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 15.91% (0.9909 => 1.1486, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 15.86% (0.7171 => 0.8308, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.83% (2.0673 => 2.3946, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 15.81% (0.1284 => 0.1487, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 15.79% (0.3267 => 0.3783, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.77% (0.3195 => 0.3699, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.70% (0.3930 => 0.4547, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary: 15.62% (0.3258 => 0.3767, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 15.44% (0.3317 => 0.3829, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.37% (4.4195 => 5.0989, std.dev.: 0.0095) MultiSource/Applications/ClamAV/clamscan: 15.32% (4.2109 => 4.8559, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.26% (1.9966 => 2.3012, std.dev.: 0.0055) MultiSource/Benchmarks/Bullet/bullet: 15.13% (23.5202 => 27.0797, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.13% (0.3060 => 0.3523, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.12% (1.9694 => 2.2672, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: 14.90% (0.3496 => 0.4017, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.87% (0.3362 => 0.3862, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions-2: 14.86% (0.3446 => 0.3958, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.85% (0.3124 => 0.3588, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 14.83% (0.3465 => 0.3979, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.79% (0.3469 => 0.3982, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.74% (0.3460 => 0.3970, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.74% (0.3488 => 0.4002, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 14.73% (0.3442 => 0.3949, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 14.71% (0.3678 => 0.4219, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.63% (0.3282 => 0.3762, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists: 14.61% (0.3348 => 0.3837, std.dev.: 0.0112) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.59% (0.3845 => 0.4406, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 14.47% (0.3726 => 0.4265, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.40% (0.1090 => 0.1247, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.40% (0.3625 => 0.4147, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 14.38% (0.3650 => 0.4175, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 14.35% (0.3477 => 0.3976, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 14.30% (0.2566 => 0.2933, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 14.30% (0.3643 => 0.4164, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 14.10% (0.3724 => 0.4249, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 14.00% (1.4269 => 1.6266, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash: 13.99% (0.4146 => 0.4726, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 13.95% (0.4251 => 0.4844, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 13.93% (0.2075 => 0.2364, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.88% (0.3690 => 0.4202, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.77% (0.3981 => 0.4529, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 13.38% (0.7875 => 0.8929, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 13.09% (0.5012 => 0.5668, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 13.05% (2.1653 => 2.4478, std.dev.: 0.0085) MultiSource/Applications/JM/lencod/lencod: 12.76% (4.6177 => 5.2067, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 12.66% (2.1013 => 2.3673, std.dev.: 0.0052) MultiSource/Applications/SIBsim4/SIBsim4: 11.93% (0.2691 => 0.3012, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.91% (0.2040 => 0.2283, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.78% (0.6435 => 0.7193, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11.69% (5.5417 => 6.1897, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.00% (0.2737 => 0.3038, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.80% (0.1028 => 0.1139) MultiSource/Applications/siod/siod: 10.75% (0.6634 => 0.7347, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 10.63% (0.3498 => 0.3870, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.59% (0.2068 => 0.2287, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.27% (0.1383 => 0.1525, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.25% (0.3084 => 0.3400, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 9.82% (0.4847 => 0.5323, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 9.77% (0.3336 => 0.3662) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.27% (0.2103 => 0.2298, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 9.09% (2.0346 => 2.2196, std.dev.: 0.0077) MultiSource/Applications/lemon/lemon: 8.95% (0.2391 => 0.2605, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.25% (4.6926 => 5.0797, std.dev.: 0.0138) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.99% (11.6398 => 12.5697, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.72% (0.5361 => 0.5775, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.31% (0.5584 => 0.5992, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.12% (0.7426 => 0.7955, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 6.53% (11.9555 => 12.7356, std.dev.: 0.0116) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.38% (0.3792 => 0.3996, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 9.28% (0.2802 => 0.3062, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 6.50% (0.2122 => 0.2260, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6100, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.44% (0.3693 => 0.3894, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6750, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-2: 4.81% (1.8057 => 1.8925, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1716, std.dev.: 0.0210) SingleSource/Benchmarks/Dhrystone/dry: 4.27% (14.0481 => 14.6485, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1944, std.dev.: 0.0089) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2251, std.dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3058, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2855, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5956, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.88% (25.4195 => 16.5527, std.dev.: 0.0208) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9764, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7904, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9573, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -5.54% (0.2402 => 0.2269, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.57% (11.2080 => 10.8078, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std.dev.: 0.0027) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.49% (17.2379 => 16.8095, std.dev.: 0.0655) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.25% (41.7953 => 40.8547, std.dev.: 0.0104) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.69% (10.7630 => 10.5807, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4963, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0416, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.01% (105.3826 => 104.3145, std.dev.: 0.0183) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 12:06:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 14:06:56 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121114200656.C0FFB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5867?compare_to=5864&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5867, Order: 167937, Start Time: 2012-11-14 18:34:15, End Time: 2012-11-14 20:07:15 To: 5864, Order: 167929, Start Time: 2012-11-14 16:42:40, End Time: 2012-11-14 18:12:25 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 15 (46 on baseline) Performance Improvements: 4 (16 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 973 (912 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 59.65% (0.0461 => 0.0736, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 51.27% (0.0236 => 0.0357, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 34.45% (0.2470 => 0.3321, std.dev.: 0.0272) SingleSource/UnitTests/Vector/constpool: 21.92% (8.5428 => 10.4151, std.dev.: 0.6499) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.67% (0.8875 => 0.9467, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 6.63% (0.8850 => 0.9437, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.29% (0.8472 => 0.9005, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 5.58% (0.9209 => 0.9723, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.94% (1.3109 => 1.3494, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.85% (1.5663 => 1.5953, std.dev.: 0.0095) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/employ/employ: 208.33% (0.0048 => 0.0148, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 10.81% (0.8900 => 0.9862, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.83% (8.1640 => 8.4764, std.dev.: 0.0443) MultiSource/Benchmarks/BitBench/five11/five11: 2.00% (5.6388 => 5.7513, std.dev.: 0.0193) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.51% (1.8764 => 1.9047, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.95% (42.1207 => 40.4561, std.dev.: 0.3113) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.18% (61.1978 => 59.2525, std.dev.: 0.6922) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.62% (22.7904 => 22.1933, std.dev.: 0.1062) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.31% (4.9837 => 4.9184, std.dev.: 0.0250) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -1.46% (17.1597 => 16.9090, std.dev.: 1.1765) MultiSource/Applications/obsequi/Obsequi: 1.24% (1.0705 => 1.0838, std.dev.: 0.2807) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.25% (22.4937 => 23.4504, std.dev.: 0.6077) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.92% (0.3696 => 0.3730, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/bigfib: 0.07% (0.6121 => 0.6125, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.07% (0.3355 => 0.3391, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/strcat: 0.20% (0.2011 => 0.2015, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 24.87% (0.0197 => 0.0246, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 14.78% (0.0372 => 0.0427, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 52.57% (0.0253 => 0.0386, std.dev.: 0.0072) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0315 => 0.0314, std.dev.: 0.0110) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0429 => 0.0429, std.dev.: 0.0149) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0203 => 0.0203, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/test1: 10.05% (0.0199 => 0.0219, std.dev.: 0.0071) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 3.24% (0.1481 => 0.1529, std.dev.: 0.0225) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -3.15% (1.1945 => 1.1569, std.dev.: 0.3139) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.45% (0.4199 => 0.4218, std.dev.: 0.1832) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.81% (0.1421 => 0.1461, std.dev.: 0.0261) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.37% (0.0617 => 0.0681, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.19% (0.0237 => 0.0201, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.71% (0.0591 => 0.0575, std.dev.: 0.0240) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.13% (1.2004 => 1.2020, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3100.00% (0.0001 => 0.0032, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 47.37% (0.0019 => 0.0028, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 14.54% (0.0564 => 0.0646, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.55% (0.0242 => 0.0253, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.82% (0.7728 => 0.7791, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 200.00% (0.0001 => 0.0003, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -36.71% (0.0079 => 0.0050, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2313.30% (0.6332 => 15.2810, std.dev.: 1.0225) MultiSource/Benchmarks/McCat/08-main/main: 49.48% (0.1831 => 0.2737, std.dev.: 0.0773) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.32% (0.1559 => 0.1476, std.dev.: 0.0466) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1526.02% (0.3344 => 5.4374, std.dev.: 0.2471) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.18% (0.2364 => 0.3243, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.48% (0.0224 => 0.0243, std.dev.: 0.0062) SingleSource/UnitTests/byval-alignment: -24.78% (0.0230 => 0.0173, std.dev.: 0.0027) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 12.04% (0.1462 => 0.1638, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4543, std.dev.: 0.3031) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0697, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4882, std.dev.: 0.0936) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3239, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1405, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4071, std.dev.: 0.0022) SingleSource/Regression/C/uint64_to_float: -23.84% (2.1832 => 1.6627, std.dev.: 0.0016) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 67.27% (0.0440 => 0.0736, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 60.81% (0.0222 => 0.0357, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 39.66% (0.2378 => 0.3321, std.dev.: 0.0272) SingleSource/UnitTests/Vector/constpool: 23.73% (8.4179 => 10.4151, std.dev.: 0.6499) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.62% (0.0848 => 0.0955, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.94% (0.8611 => 0.9467, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.68% (0.8069 => 0.8850, std.dev.: 0.0274) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.02% (0.8656 => 0.9437, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.01% (0.8261 => 0.9005, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.92% (0.8927 => 0.9723, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (0.9039 => 0.9806, std.dev.: 0.0285) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.73% (1.2526 => 1.3494, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 6.31% (0.8050 => 0.8558, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/lists1: 4.45% (0.2969 => 0.3101, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.17% (1.5315 => 1.5953, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.51% (0.5191 => 0.5373, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.98% (0.4559 => 0.4695, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.61% (0.6586 => 0.6758, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/employ/employ: 362.50% (0.0032 => 0.0148, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 123.62% (0.0199 => 0.0445, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/pi: 57.23% (1.5795 => 2.4835, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 29.81% (0.7597 => 0.9862, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.53% (2.9753 => 3.4671, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 15.00% (2.7995 => 3.2193, std.dev.: 0.0094) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.64% (2.5763 => 2.9020, std.dev.: 0.1194) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.83% (5.0261 => 5.6205, std.dev.: 0.0288) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.80% (0.3186 => 0.3530, std.dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.00% (1.1857 => 1.2805, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 7.31% (1.7056 => 1.8302, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.80% (4.7794 => 5.1042, std.dev.: 0.0354) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.17% (4.9686 => 5.2752, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.81% (6.3772 => 6.7479, std.dev.: 0.1244) SingleSource/Benchmarks/Misc/richards_benchmark: 5.77% (1.3037 => 1.3789, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.82% (4.9469 => 5.1852, std.dev.: 0.0358) MultiSource/Applications/lambda-0_1_3/lambda: 4.15% (7.4933 => 7.8042, std.dev.: 0.0671) MultiSource/Applications/hexxagon/hexxagon: 3.87% (14.0064 => 14.5483, std.dev.: 0.2048) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.65% (11.5690 => 11.8759, std.dev.: 0.0680) MultiSource/Benchmarks/BitBench/five11/five11: 2.65% (5.6030 => 5.7513, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.39% (8.2783 => 8.4764, std.dev.: 0.0443) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.09% (2.4647 => 2.5161, std.dev.: 0.0147) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.70% (4.8362 => 4.9184, std.dev.: 0.0250) SingleSource/Benchmarks/Misc/ReedSolomon: 1.46% (8.5322 => 8.6566, std.dev.: 0.0149) MultiSource/Benchmarks/FreeBench/neural/neural: 1.39% (1.0841 => 1.0992, std.dev.: 0.0018) SingleSource/Benchmarks/Stanford/FloatMM: 1.19% (0.8807 => 0.8912, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.16% (1.8829 => 1.9047, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.12% (3.5679 => 3.6078, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.23% (5.4641 => 4.3043, std.dev.: 0.0513) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.21% (7.2130 => 6.2602, std.dev.: 0.1582) MultiSource/Benchmarks/mafft/pairlocalalign: -8.23% (63.1822 => 57.9819, std.dev.: 0.7555) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.95% (14.6451 => 13.6274, std.dev.: 0.0839) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.58% (4.7482 => 4.4358, std.dev.: 0.0784) MultiSource/Benchmarks/nbench/nbench: -6.48% (21.9654 => 20.5410, std.dev.: 0.0357) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.68% (5.4972 => 5.1852, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.97% (5.1557 => 4.8995, std.dev.: 0.0267) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.16% (4.7449 => 4.5476, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.66% (6.0224 => 5.8019, std.dev.: 0.0634) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.08% (0.5807 => 0.5628, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.97% (28.5821 => 27.7334, std.dev.: 0.0564) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.80% (2.4490 => 2.3804, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.34% (41.4238 => 40.4561, std.dev.: 0.3113) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.80% (9.9065 => 9.7283, std.dev.: 0.0536) SingleSource/Benchmarks/Shootout-C++/hash2: -1.53% (3.4237 => 3.3714, std.dev.: 0.0008) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.81% (16.4461 => 16.9090, std.dev.: 1.1765) MultiSource/Applications/obsequi/Obsequi: 5.61% (1.0262 => 1.0838, std.dev.: 0.2807) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7408.93% (0.3123 => 23.4504, std.dev.: 0.6077) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.44% (0.2463 => 0.3730, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/bigfib: 1.91% (0.6010 => 0.6125, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.83% (0.3266 => 0.3391, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/strcat: 2.34% (0.1969 => 0.2015, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 100.00% (0.0123 => 0.0246, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 51.97% (0.0254 => 0.0386, std.dev.: 0.0072) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0110) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.72% (0.0384 => 0.0429, std.dev.: 0.0149) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0071) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 6.33% (0.1438 => 0.1529, std.dev.: 0.0225) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.12% (1.1329 => 1.1569, std.dev.: 0.3139) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.30% (0.4164 => 0.4218, std.dev.: 0.1832) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.72% (0.1369 => 0.1461, std.dev.: 0.0261) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.24% (0.0641 => 0.0681, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.08% (0.0195 => 0.0201, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.52% (0.0578 => 0.0575, std.dev.: 0.0240) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.10% (1.1437 => 1.2020, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3100.00% (0.0001 => 0.0032, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 100.00% (0.0014 => 0.0028, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.03% (0.0627 => 0.0646, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 40.56% (0.0180 => 0.0253, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.82% (0.8017 => 0.7791, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 200.00% (0.0001 => 0.0003, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -19.35% (0.0062 => 0.0050, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 12:07:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 14:07:03 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121114200703.C4C312A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5868?compare_to=5865&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5868, Order: 167937, Start Time: 2012-11-14 18:42:19, End Time: 2012-11-14 20:07:21 To: 5865, Order: 167929, Start Time: 2012-11-14 16:53:41, End Time: 2012-11-14 18:18:58 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (181 on baseline) Unchanged Tests: 1041 (857 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.75% (79.1221 => 80.5078, std.dev.: 0.3108) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.33% (1.2783 => 1.3720, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1009, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/salsa20: 2.54% (7.4937 => 7.6840, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 2.26% (3.1932 => 3.2655, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.60% (0.1431 => 0.1308, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.69% (0.3821 => 0.3527, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -6.99% (2.4924 => 2.3181, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.72% (0.3142 => 0.2931, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.65% (0.9542 => 0.8907, std.dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: -6.64% (0.3357 => 0.3134, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.47% (0.2428 => 0.2271, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.18% (0.1796 => 0.1685) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -6.10% (9.2283 => 8.6650, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.08% (0.9852 => 0.9253, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -6.07% (16.1920 => 15.2089, std.dev.: 0.0113) MultiSource/Applications/JM/ldecod/ldecod: -6.07% (7.0961 => 6.6653, std.dev.: 0.0198) SingleSource/Benchmarks/McGill/chomp: -6.02% (0.1761 => 0.1655, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.01% (0.6484 => 0.6094, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.98% (1.0544 => 0.9913, std.dev.: 0.0059) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: -5.89% (0.9179 => 0.8638, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.86% (1.3722 => 1.2918, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.85% (0.3658 => 0.3444, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.83% (0.7198 => 0.6778, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.83% (0.2695 => 0.2538, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.79% (0.5478 => 0.5161, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.75% (1.6364 => 1.5423, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: -5.72% (0.3880 => 0.3658, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.71% (0.5849 => 0.5515, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: -5.69% (0.3812 => 0.3595, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.69% (0.3831 => 0.3613, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.69% (1.4642 => 1.3809, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.67% (4.8161 => 4.5428, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.65% (0.5591 => 0.5275, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.65% (0.5857 => 0.5526, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.65% (0.6304 => 0.5948, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.63% (0.6230 => 0.5879, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.63% (3.5339 => 3.3349, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.63% (0.4033 => 0.3806, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.63% (4.8802 => 4.6056, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.62% (0.6052 => 0.5712, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.62% (1.2300 => 1.1609, std.dev.: 0.0027) MultiSource/Applications/lemon/lemon: -5.62% (1.1450 => 1.0807, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.61% (4.0323 => 3.8061, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.61% (0.2355 => 0.2223, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: -5.60% (4.3330 => 4.0904, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/synchronized: -5.60% (0.3896 => 0.3678, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.59% (0.3884 => 0.3667, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.58% (0.6260 => 0.5911, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.57% (0.6395 => 0.6039, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.56% (4.5069 => 4.2562, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-3: -5.56% (0.3848 => 0.3634, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.56% (0.6660 => 0.6290, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.55% (0.5925 => 0.5596, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.55% (0.6736 => 0.6362, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.55% (0.5802 => 0.5480, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.54% (0.8521 => 0.8049, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.53% (0.7339 => 0.6933, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.53% (0.5863 => 0.5539, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.52% (0.7524 => 0.7109, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.51% (0.5805 => 0.5485, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.51% (0.6189 => 0.5848, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.51% (0.5575 => 0.5268, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.51% (0.7919 => 0.7483, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: -5.50% (1.2515 => 1.1827, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.49% (0.5569 => 0.5263, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.49% (0.6297 => 0.5951, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.49% (0.6194 => 0.5854, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.49% (0.5705 => 0.5392, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: -5.48% (0.4176 => 0.3947, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.48% (0.5581 => 0.5275, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.47% (1.2784 => 1.2085, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.47% (0.6676 => 0.6311, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.46% (0.5859 => 0.5539, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.46% (0.6667 => 0.6303, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.45% (6.7716 => 6.4026, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/property: -5.41% (0.4199 => 0.3972, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.39% (0.5456 => 0.5162, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.37% (0.6446 => 0.6100, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -5.36% (17.1032 => 16.1857, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/05-eks/eks: -5.36% (0.4515 => 0.4273, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.35% (0.3891 => 0.3683, std.dev.: 0.0062) MultiSource/Benchmarks/sim/sim: -5.34% (0.3406 => 0.3224, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.33% (0.6440 => 0.6097, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.31% (14.2083 => 13.4533, std.dev.: 0.0195) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.31% (0.3483 => 0.3298, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.30% (0.5941 => 0.5626, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.29% (0.5688 => 0.5387, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: -5.29% (1.3864 => 1.3131, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.28% (0.6681 => 0.6328, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.28% (0.5567 => 0.5273, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: -5.27% (0.2659 => 0.2519, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.25% (0.6033 => 0.5716, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.24% (0.2999 => 0.2842, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.22% (0.6395 => 0.6061, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.22% (0.2548 => 0.2415, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.20% (1.2210 => 1.1575, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.19% (0.5570 => 0.5281, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -5.16% (15.5079 => 14.7074, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.16% (1.2221 => 1.1591, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -5.15% (3.5154 => 3.3343, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.13% (0.5999 => 0.5691, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -5.12% (0.4280 => 0.4061, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.04% (0.6293 => 0.5976, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -5.03% (4.0594 => 3.8552, std.dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.02% (0.4916 => 0.4669, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.00% (0.2278 => 0.2164, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.99% (8.0126 => 7.6130, std.dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: -4.96% (15.2527 => 14.4967, std.dev.: 0.0119) MultiSource/Applications/hexxagon/hexxagon: -4.95% (1.3148 => 1.2497, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.91% (0.5168 => 0.4914, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: -4.88% (0.3255 => 0.3096, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.85% (0.3319 => 0.3158, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: -4.85% (0.7447 => 0.7086, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.84% (0.3016 => 0.2870, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.81% (1.6474 => 1.5682, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: -4.79% (0.2985 => 0.2842, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: -4.78% (0.3581 => 0.3410, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -4.76% (1.1530 => 1.0981, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -4.76% (0.3026 => 0.2882, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.75% (0.2106 => 0.2006, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.74% (0.6347 => 0.6046, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.72% (0.4151 => 0.3955, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: -4.72% (2.1401 => 2.0391, std.dev.: 0.0087) MultiSource/Applications/siod/siod: -4.70% (2.4021 => 2.2892, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.69% (0.5329 => 0.5079, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.67% (22.4056 => 21.3602, std.dev.: 0.0238) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.67% (0.3837 => 0.3658, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -4.66% (0.3025 => 0.2884, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.63% (0.3931 => 0.3749, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: -4.62% (0.3271 => 0.3120, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: -4.61% (0.4861 => 0.4637, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.58% (5.0226 => 4.7926, std.dev.: 0.0098) SingleSource/UnitTests/ObjC++/property-reference-object: -4.56% (0.6441 => 0.6147, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.56% (0.7021 => 0.6701, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.55% (2.1713 => 2.0724, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/objinst: -4.54% (0.3194 => 0.3049, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.49% (0.3252 => 0.3106, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -4.49% (34.0927 => 32.5632, std.dev.: 0.0236) SingleSource/Benchmarks/Shootout-C++/strcat: -4.48% (0.2989 => 0.2855, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -4.47% (0.7982 => 0.7625, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: -4.45% (0.3059 => 0.2923, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: -4.44% (0.3446 => 0.3293, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -4.40% (0.4248 => 0.4061, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -4.39% (18.2933 => 17.4902, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/ary: -4.36% (0.3394 => 0.3246, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -4.35% (0.7779 => 0.7441, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.34% (0.3849 => 0.3682, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.29% (0.3057 => 0.2926, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -4.28% (0.3481 => 0.3332, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -4.28% (0.8418 => 0.8058, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists: -4.25% (0.3621 => 0.3467, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -4.24% (0.3867 => 0.3703, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.20% (0.4813 => 0.4611, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: -4.18% (0.2871 => 0.2751, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.17% (0.2903 => 0.2782, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.16% (0.2933 => 0.2811, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -4.15% (0.2939 => 0.2817, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.13% (0.4427 => 0.4244, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.13% (0.9557 => 0.9162, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.11% (2.2587 => 2.1658, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.11% (0.9077 => 0.8704, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: -4.07% (0.2849 => 0.2733, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -4.02% (0.3205 => 0.3076, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: -3.99% (0.3788 => 0.3637, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.81% (0.3491 => 0.3358, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: -3.75% (0.6750 => 0.6497, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.70% (0.3323 => 0.3200, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.66% (0.4321 => 0.4163, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.62% (0.4083 => 0.3935, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: -3.60% (0.4524 => 0.4361, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.35% (5.4682 => 5.2851, std.dev.: 0.0047) MultiSource/Applications/hbd/hbd: -3.04% (1.5610 => 1.5135, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -2.35% (20.7746 => 20.2856, std.dev.: 0.0277) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7530, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: -8.74% (1.2842 => 1.1719, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.58% (2.2633 => 2.1822, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.02% (1.0557 => 1.0238, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.68% (6.5735 => 6.4631, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 12:44:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 14:44:43 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121114204443.221902A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5869?compare_to=5863&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5869, Order: 167933, Start Time: 2012-11-14 18:33:45, End Time: 2012-11-14 20:45:00 To: 5863, Order: 167928, Start Time: 2012-11-14 15:31:41, End Time: 2012-11-14 17:42:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 39 (143 on baseline) Performance Improvements: 7 (39 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 992 (705 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/objects/objects: 19.50% (0.1169 => 0.1397, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 16.13% (0.1655 => 0.1922, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 15.06% (0.6241 => 0.7181, std.dev.: 0.0063) MultiSource/Applications/aha/aha: 14.53% (0.1328 => 0.1521, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.90% (0.3791 => 0.4318, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.71% (0.3902 => 0.4437, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 13.26% (0.3054 => 0.3459, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/football/football: 11.99% (0.9883 => 1.1068, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/lists1: 11.17% (0.4082 => 0.4538, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/wc: 11.11% (0.3339 => 0.3710, std.dev.: 0.0073) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.83% (0.3575 => 0.3962, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.08% (0.7576 => 0.8340, std.dev.: 0.0237) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.89% (0.1931 => 0.2122, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.87% (0.6817 => 0.7490, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/distray/distray: 9.67% (0.1531 => 0.1679, std.dev.: 0.0043) SingleSource/Benchmarks/Stanford/Puzzle: 9.33% (0.1393 => 0.1523, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.27% (0.2578 => 0.2817, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: 9.07% (0.4324 => 0.4716, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/em3d/em3d: 8.84% (0.1968 => 0.2142, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.31% (0.5066 => 0.5487, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 6.41% (0.4163 => 0.4430, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.25% (1.5182 => 1.5979, std.dev.: 0.0233) MultiSource/Applications/treecc/treecc: 4.98% (2.3935 => 2.5127, std.dev.: 0.0458) MultiSource/Benchmarks/PAQ8p/paq8p: 3.90% (11.3172 => 11.7588, std.dev.: 0.0214) MultiSource/Benchmarks/MallocBench/gs/gs: 3.02% (4.9979 => 5.1488, std.dev.: 0.0328) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.74% (2.8520 => 2.9301, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.65% (12.2700 => 12.5955, std.dev.: 0.0188) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (11.1568 => 11.3152, std.dev.: 0.0524) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.03% (1.6737 => 1.6910, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.03% (38.2799 => 38.6748, std.dev.: 0.1210) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 20.65% (3.8099 => 4.5967, std.dev.: 0.1235) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.54% (6.2022 => 6.8560, std.dev.: 0.0512) SingleSource/Benchmarks/Misc/ffbench: 7.94% (0.9934 => 1.0723, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.54% (87.1847 => 89.3967, std.dev.: 0.3140) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.28% (1.5694 => 1.6052, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.90% (2.3091 => 2.3530, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.63% (48.7605 => 49.5568, std.dev.: 0.0635) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.52% (32.0807 => 32.5685, std.dev.: 0.0297) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.09% (61.7609 => 62.4356, std.dev.: 0.0374) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/McGill/exptree: -11.44% (0.1049 => 0.0929, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -11.12% (1.0161 => 0.9031, std.dev.: 0.0342) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -10.69% (0.7116 => 0.6355, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -8.53% (0.7294 => 0.6672, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.59% (1.6606 => 1.5677, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.90% (2.4153 => 2.3211, std.dev.: 0.0264) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.77% (6.2664 => 6.1554, std.dev.: 0.0342) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.07% (0.1362 => 0.1363, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0420 => 0.0420, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.84% (0.0677 => 0.0651, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: -0.13% (494.2323 => 493.6141, std.dev.: 0.4599) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/power/power: 43671.76% (1.1277 => 493.6141, std.dev.: 0.4599) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.45% (0.5229 => 1.5397, std.dev.: 0.1172) MultiSource/Applications/SPASS/SPASS: 22.69% (14.9895 => 18.3903, std.dev.: 0.0985) MultiSource/Applications/kimwitu++/kc: 50.77% (14.1553 => 21.3416, std.dev.: 0.2267) MultiSource/Benchmarks/MallocBench/gs/gs: 25.26% (4.1105 => 5.1488, std.dev.: 0.0328) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 53.06% (1.1048 => 1.6910, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 440.29% (7.1582 => 38.6748, std.dev.: 0.1210) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.04% (3.4629 => 6.4079, std.dev.: 0.1758) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.23% (0.6222 => 1.0343, std.dev.: 0.0783) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10833.89% (0.0720 => 7.8724, std.dev.: 0.1417) MultiSource/Applications/SIBsim4/SIBsim4: 3876100.00% (0.0001 => 3.8762, std.dev.: 0.0289) MultiSource/Applications/SPASS/SPASS: 14600200.00% (0.0001 => 14.6003, std.dev.: 0.4879) MultiSource/Applications/kimwitu++/kc: 52300.00% (0.0001 => 0.0524, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 63800.00% (0.0001 => 0.0639, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14500.00% (0.0001 => 0.0146, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 578900.00% (0.0001 => 0.5790, std.dev.: 0.0260) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10091700.00% (0.0001 => 10.0918, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6855900.00% (0.0001 => 6.8560, std.dev.: 0.0512) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1831.20% (1.1194 => 21.6179, std.dev.: 0.1802) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 64.97% (2.9384 => 4.8475, std.dev.: 0.2802) MultiSource/Applications/ClamAV/clamscan: 62.09% (22.1758 => 35.9440, std.dev.: 0.3106) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 59.43% (7.0540 => 11.2463, std.dev.: 0.0582) MultiSource/Benchmarks/FreeBench/distray/distray: 59.00% (0.1056 => 0.1679, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 54.81% (8.1363 => 12.5955, std.dev.: 0.0188) MultiSource/Applications/JM/lencod/lencod: 47.95% (21.9371 => 32.4570, std.dev.: 0.0372) SingleSource/Benchmarks/CoyoteBench/almabench: 41.64% (0.0730 => 0.1034, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/Oscar: 38.68% (0.0636 => 0.0882, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 38.62% (0.1432 => 0.1985, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 34.37% (0.2700 => 0.3628, std.dev.: 0.0089) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 33.96% (0.1584 => 0.2122, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/n-body: 33.65% (0.0746 => 0.0997, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 33.04% (2.2024 => 2.9301, std.dev.: 0.0030) MultiSource/Applications/aha/aha: 32.15% (0.1151 => 0.1521, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/wordfreq: 30.57% (0.3307 => 0.4318, std.dev.: 0.0029) SingleSource/UnitTests/vla: 30.42% (0.0355 => 0.0463, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 28.95% (0.3441 => 0.4437, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 28.88% (0.1032 => 0.1330, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/FloatMM: 27.68% (0.0401 => 0.0512, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/hash: 27.42% (0.0485 => 0.0618, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/functionobjects: 27.35% (0.5020 => 0.6393, std.dev.: 0.0083) MultiSource/Benchmarks/llubenchmark/llu: 27.06% (0.0462 => 0.0587, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 26.95% (0.3121 => 0.3962, std.dev.: 0.0049) SingleSource/Benchmarks/Stanford/Queens: 26.57% (0.0414 => 0.0524, std.dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 26.56% (0.0719 => 0.0910, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 26.37% (0.1695 => 0.2142, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/loader/loader: 26.07% (0.2758 => 0.3477, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 25.40% (0.1114 => 0.1397, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.23% (0.5981 => 0.7490, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 24.94% (0.6675 => 0.8340, std.dev.: 0.0237) SingleSource/Benchmarks/Dhrystone/fldry: 24.53% (0.0481 => 0.0599, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 24.07% (0.8921 => 1.1068, std.dev.: 0.0081) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 24.04% (0.2271 => 0.2817, std.dev.: 0.0031) MultiSource/Applications/treecc/treecc: 23.94% (2.0273 => 2.5127, std.dev.: 0.0458) SingleSource/Benchmarks/Misc/perlin: 23.88% (0.0536 => 0.0664, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: 23.45% (0.2802 => 0.3459, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/exceptions: 23.20% (0.3828 => 0.4716, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/lists1: 23.18% (0.3684 => 0.4538, std.dev.: 0.0038) MultiSource/Applications/Burg/burg: 22.55% (1.1642 => 1.4267, std.dev.: 0.0455) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 22.44% (1.3050 => 1.5979, std.dev.: 0.0233) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 22.24% (14.3668 => 17.5615, std.dev.: 0.1157) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.03% (0.1566 => 0.1911, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 21.87% (0.0640 => 0.0780, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 21.56% (0.3052 => 0.3710, std.dev.: 0.0073) MultiSource/Applications/d/make_dparser: 20.88% (3.3354 => 4.0317, std.dev.: 0.1273) MultiSource/Benchmarks/Olden/tsp/tsp: 20.26% (0.1175 => 0.1413, std.dev.: 0.0050) SingleSource/Benchmarks/Stanford/Puzzle: 20.11% (0.1268 => 0.1523, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/for-in: 19.92% (0.3694 => 0.4430, std.dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.92% (0.6450 => 0.7735, std.dev.: 0.0174) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 19.81% (0.8101 => 0.9706, std.dev.: 0.0238) MultiSource/Benchmarks/mafft/pairlocalalign: 19.30% (9.4845 => 11.3152, std.dev.: 0.0524) MultiSource/Applications/oggenc/oggenc: 18.87% (5.7591 => 6.8456, std.dev.: 0.2147) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.76% (0.1125 => 0.1336, std.dev.: 0.0069) MultiSource/Applications/lua/lua: 18.62% (3.8723 => 4.5933, std.dev.: 0.1713) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 18.28% (0.1625 => 0.1922, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/bmm/bmm: 18.18% (0.0759 => 0.0897, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 18.04% (4.9449 => 5.8372, std.dev.: 0.0977) SingleSource/Benchmarks/Misc/ffbench: 17.87% (0.0705 => 0.0831, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.58% (0.0842 => 0.0990, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.52% (0.8172 => 0.9604, std.dev.: 0.0358) MultiSource/Applications/minisat/minisat: 17.44% (0.7115 => 0.8356, std.dev.: 0.0436) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.41% (4.2646 => 5.0070, std.dev.: 0.0267) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.39% (0.0834 => 0.0979, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.29% (5.0018 => 5.8664, std.dev.: 0.0114) MultiSource/Benchmarks/nbench/nbench: 16.97% (1.1840 => 1.3849, std.dev.: 0.0587) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.74% (0.0675 => 0.0788, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: 16.49% (17.1811 => 20.0139, std.dev.: 0.2200) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.36% (0.0770 => 0.0896, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.36% (0.0648 => 0.0754, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/matrix: 16.01% (0.0818 => 0.0949, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/mst/mst: 15.91% (0.1163 => 0.1348, std.dev.: 0.0067) MultiSource/Applications/hbd/hbd: 15.73% (1.5603 => 1.8057, std.dev.: 0.0606) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.41% (0.1940 => 0.2239, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/matrix: 15.40% (0.3098 => 0.3575, std.dev.: 0.0172) MultiSource/Applications/siod/siod: 15.29% (2.2969 => 2.6480, std.dev.: 0.0469) MultiSource/Benchmarks/Bullet/bullet: 15.08% (63.2438 => 72.7831, std.dev.: 0.2577) MultiSource/Applications/viterbi/viterbi: 15.05% (0.1555 => 0.1789, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.04% (0.1117 => 0.1285, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.81% (0.0770 => 0.0884, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.62% (0.2107 => 0.2415, std.dev.: 0.0096) MultiSource/Applications/spiff/spiff: 14.33% (0.7835 => 0.8958, std.dev.: 0.0152) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.28% (0.3543 => 0.4049, std.dev.: 0.0139) SingleSource/Benchmarks/McGill/exptree: 14.13% (0.0814 => 0.0929, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.11% (0.5569 => 0.6355, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 14.10% (3.8922 => 4.4409, std.dev.: 0.0632) SingleSource/Benchmarks/Shootout-C++/objinst: 14.02% (0.3131 => 0.3570, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.86% (0.5860 => 0.6672, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.84% (0.1062 => 0.1209, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.78% (0.9765 => 1.1111, std.dev.: 0.0352) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.61% (0.1029 => 0.1169, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/office/office: 13.58% (0.3136 => 0.3562, std.dev.: 0.0160) MultiSource/Benchmarks/PAQ8p/paq8p: 13.42% (10.3673 => 11.7588, std.dev.: 0.0214) SingleSource/UnitTests/ObjC/parameter-passing: 13.17% (0.3927 => 0.4444, std.dev.: 0.0200) SingleSource/UnitTests/ObjC/trivial-interface: 12.84% (0.3473 => 0.3919, std.dev.: 0.0168) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.46% (0.4879 => 0.5487, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.95% (0.8067 => 0.9031, std.dev.: 0.0342) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.65% (0.1906 => 0.2128, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/sieve: 11.07% (0.3603 => 0.4002, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.51% (1.4186 => 1.5677, std.dev.: 0.0069) MultiSource/Benchmarks/sim/sim: 10.33% (0.3387 => 0.3737, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.31% (0.5925 => 0.6536, std.dev.: 0.0229) MultiSource/Benchmarks/FreeBench/neural/neural: 10.18% (0.1463 => 0.1612, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.84% (0.2430 => 0.2669, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.60% (7.9617 => 8.4869, std.dev.: 0.0175) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.40% (2.2022 => 2.3211, std.dev.: 0.0264) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.93% (4.3953 => 11.0292, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: 147.72% (5.3999 => 13.3767, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 24.27% (13.4384 => 16.7005, std.dev.: 0.5796) MultiSource/Applications/minisat/minisat: 23.76% (9.1159 => 11.2820, std.dev.: 0.2028) SingleSource/Benchmarks/Misc/oourafft: 17.54% (6.6465 => 7.8123, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.52% (1.1145 => 1.3098, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/lpbench: 16.25% (10.3460 => 12.0269, std.dev.: 0.3632) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.04% (0.2944 => 0.3328, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/ffbench: 12.81% (0.9505 => 1.0723, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.76% (2.8904 => 3.2303, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.92% (8.6802 => 9.6280, std.dev.: 0.1654) SingleSource/Benchmarks/Misc/richards_benchmark: 10.26% (1.1396 => 1.2565, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.34% (1.7254 => 1.8865, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.28% (0.3070 => 0.3355, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.58% (4.2280 => 4.4640, std.dev.: 0.0130) SingleSource/Regression/C/uint64_to_float: 5.10% (0.5413 => 0.5689, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.21% (3.6395 => 3.7927, std.dev.: 0.0259) MultiSource/Applications/lua/lua: 4.19% (26.0924 => 27.1861, std.dev.: 0.3743) MultiSource/Benchmarks/nbench/nbench: 4.09% (11.6436 => 12.1201, std.dev.: 0.0063) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.21% (0.6171 => 0.6369, std.dev.: 0.0056) SingleSource/Benchmarks/Dhrystone/dry: 2.79% (2.4116 => 2.4789, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.74% (1.7133 => 1.7603, std.dev.: 0.0102) MultiSource/Benchmarks/PAQ8p/paq8p: 2.35% (85.0658 => 87.0619, std.dev.: 0.0275) MultiSource/Benchmarks/Olden/tsp/tsp: 2.27% (1.0785 => 1.1030, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 2.07% (3.1595 => 3.2250, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.71% (2.3135 => 2.3530, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 1.50% (27.8444 => 28.2629, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout/sieve: 1.42% (5.2139 => 5.2879, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.36% (6.5088 => 6.5972, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0313 => 1.0441, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0501, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.5348 => 12.6712, std.dev.: 0.0397) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1670, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/salsa20: -75.86% (0.8651 => 0.2088, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.57% (5.2763 => 1.2892, std.dev.: 0.0402) SingleSource/Benchmarks/Misc/richards_benchmark: -44.51% (0.1622 => 0.0900, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.49% (5.3526 => 4.8445, std.dev.: 0.0958) MultiSource/Applications/JM/ldecod/ldecod: -6.59% (10.4361 => 9.7484, std.dev.: 0.0717) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.11% (5.3855 => 5.0566, std.dev.: 0.0567) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -47.50% (0.0400 => 0.0210) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.98% (0.3987 => 0.2393, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.72% (0.0506 => 0.0305) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.31% (4.5009 => 2.7768, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7636, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.14% (2.6546 => 2.0138, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -22.62% (10.7105 => 8.2877, std.dev.: 0.3461) MultiSource/Benchmarks/FreeBench/mason/mason: -19.39% (0.2161 => 0.1742, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4218, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.69% (2.6778 => 2.2843, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.68% (32.5116 => 29.0407, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/mandel-2: -10.63% (1.5373 => 1.3739, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -10.16% (9.5636 => 8.5916, std.dev.: 0.1782) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.62% (1.5660 => 1.4310, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.93% (4.8142 => 4.4805, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.94% (3.2416 => 3.0491, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5068, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -4.25% (6.2999 => 6.0320, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.45% (0.9957 => 0.9613, std.dev.: 0.0079) MultiSource/Benchmarks/sim/sim: -2.95% (5.0483 => 4.8993, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.59% (19.9488 => 19.4322, std.dev.: 0.1375) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.31% (0.4808 => 0.4697, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.02% (8.1563 => 7.9915, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6771, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -1.49% (10.2830 => 10.1302, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.22% (0.1485 => 0.1363, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0019) Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 13:55:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 15:55:15 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121114215515.6B35B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5870?compare_to=5868&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5870, Order: 167966, Start Time: 2012-11-14 20:30:42, End Time: 2012-11-14 21:55:32 To: 5868, Order: 167937, Start Time: 2012-11-14 18:42:19, End Time: 2012-11-14 20:07:21 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 1 (179 on baseline) Unchanged Tests: 1040 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.69% (54.5807 => 56.5949, std.dev.: 0.1203) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/nbench/nbench: -1.06% (1.0981 => 1.0865, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.70% (54.5751 => 56.5949, std.dev.: 0.1203) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1006, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.4937 => 7.6741, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/hash2: 1.85% (3.1932 => 3.2522, std.dev.: 0.0081) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.01% (0.1431 => 0.1302, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.11% (0.3821 => 0.3511, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -7.29% (2.4924 => 2.3106, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.97% (0.3142 => 0.2923, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.96% (0.9542 => 0.8878, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.76% (0.3357 => 0.3130, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.71% (0.2428 => 0.2265, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.61% (0.3812 => 0.3560, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.53% (0.3831 => 0.3581, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.49% (0.3896 => 0.3643, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.47% (0.7198 => 0.6732, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.47% (0.3848 => 0.3599, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.47% (0.3880 => 0.3629, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -6.43% (16.1920 => 15.1506, std.dev.: 0.0185) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.41% (0.2355 => 0.2204, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.37% (0.4176 => 0.3910, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.35% (0.9852 => 0.9226, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.35% (0.3891 => 0.3644, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.33% (9.2283 => 8.6438, std.dev.: 0.0143) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.33% (0.3884 => 0.3638, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: -6.32% (7.0961 => 6.6477, std.dev.: 0.0105) SingleSource/UnitTests/ObjC/for-in: -6.30% (0.4033 => 0.3779, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: -6.28% (0.1879 => 0.1761, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.28% (0.6484 => 0.6077, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.24% (0.1796 => 0.1684, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -6.19% (0.4199 => 0.3939, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.15% (0.3658 => 0.3433, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -6.13% (0.1761 => 0.1653, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.06% (4.0323 => 3.7879, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.06% (1.3722 => 1.2891, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.05% (1.0544 => 0.9906, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -6.04% (0.9179 => 0.8625, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.00% (0.1716 => 0.1613, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.94% (4.8161 => 4.5299, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.93% (1.6364 => 1.5394, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.90% (0.2695 => 0.2536, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.88% (1.2300 => 1.1577, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -5.84% (1.1450 => 1.0781, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -5.83% (4.3330 => 4.0805, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.83% (1.4642 => 1.3789, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/parameter-passing: -5.82% (0.4280 => 0.4031, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.80% (6.7716 => 6.3790, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.79% (0.6736 => 0.6346, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.79% (4.5069 => 4.2461, std.dev.: 0.0073) MultiSource/Benchmarks/nbench/nbench: -5.77% (1.1530 => 1.0865, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.77% (3.5339 => 3.3301, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.72% (0.5857 => 0.5522, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.71% (4.8802 => 4.6013, std.dev.: 0.0084) MultiSource/Applications/Burg/burg: -5.70% (1.2515 => 1.1802, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.68% (0.5849 => 0.5517, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.67% (0.3406 => 0.3213, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.64% (0.7919 => 0.7472, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.64% (14.2083 => 13.4070, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.62% (0.6304 => 0.5950, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.60% (0.8521 => 0.8044, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: -5.59% (17.1032 => 16.1476, std.dev.: 0.0197) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.59% (1.2784 => 1.2070, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.57% (0.7524 => 0.7105, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.57% (0.5478 => 0.5173, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.57% (0.5802 => 0.5479, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.56% (0.6660 => 0.6290, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.55% (0.6395 => 0.6040, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.54% (0.6446 => 0.6089, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.54% (0.6052 => 0.5717, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: -5.53% (0.2659 => 0.2512, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.51% (0.5575 => 0.5268, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: -5.49% (0.4515 => 0.4267, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.49% (0.5863 => 0.5541, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.49% (0.7339 => 0.6936, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.49% (0.5591 => 0.5284, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.49% (0.5705 => 0.5392, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.48% (0.5569 => 0.5264, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -5.47% (0.3581 => 0.3385, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.46% (0.6260 => 0.5918, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.46% (0.5859 => 0.5539, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.46% (0.6230 => 0.5890, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.46% (0.2548 => 0.2409, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.45% (1.2210 => 1.1544, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.44% (0.5805 => 0.5489, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.44% (0.6194 => 0.5857, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.43% (0.6189 => 0.5853, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.42% (0.6297 => 0.5956, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -5.41% (3.5154 => 3.3253, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.40% (0.5999 => 0.5675, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.40% (0.3483 => 0.3295, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.39% (0.5570 => 0.5270, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.37% (0.5567 => 0.5268, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.37% (1.2221 => 1.1565, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.37% (0.5925 => 0.5607, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.36% (8.0126 => 7.5828, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.36% (0.6681 => 0.6323, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.36% (0.2278 => 0.2156, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: -5.34% (15.5079 => 14.6804, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.32% (0.6676 => 0.6321, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.32% (1.3864 => 1.3127, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.31% (0.6667 => 0.6313, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.27% (0.2999 => 0.2841, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.26% (0.5688 => 0.5389, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: -5.24% (0.7779 => 0.7371, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.23% (0.5941 => 0.5630, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.23% (0.4916 => 0.4659, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.22% (0.6440 => 0.6104, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.19% (0.5456 => 0.5173, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.16% (0.6293 => 0.5968, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.16% (0.6395 => 0.6065, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.12% (0.2385 => 0.2263, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -5.11% (15.2527 => 14.4733, std.dev.: 0.0109) MultiSource/Applications/hexxagon/hexxagon: -5.10% (1.3148 => 1.2478, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/Hello: -5.07% (0.6347 => 0.6025, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.07% (0.6033 => 0.5727, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -5.07% (0.3255 => 0.3090, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -5.06% (0.2985 => 0.2834, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.05% (0.5168 => 0.4907, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -5.05% (0.7447 => 0.7071, std.dev.: 0.0041) MultiSource/Applications/treecc/treecc: -5.03% (2.1401 => 2.0324, std.dev.: 0.0040) MultiSource/Applications/lua/lua: -5.03% (4.0594 => 3.8554, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.01% (0.4151 => 0.3943, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.00% (1.6474 => 1.5651, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: -4.99% (0.3025 => 0.2874, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -4.98% (0.3194 => 0.3035, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.97% (0.3016 => 0.2866, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: -4.96% (0.3026 => 0.2876, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.94% (0.3319 => 0.3155, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: -4.92% (0.3271 => 0.3110, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -4.92% (0.6441 => 0.6124, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.89% (0.2106 => 0.2003, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -4.82% (2.4021 => 2.2862, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.79% (22.4056 => 21.3324, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.78% (0.3931 => 0.3743, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -4.77% (0.7982 => 0.7601, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: -4.75% (0.4861 => 0.4630, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.75% (2.1713 => 2.0682, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.74% (0.3057 => 0.2912, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.71% (0.5329 => 0.5078, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -4.71% (0.3059 => 0.2915, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.68% (0.3849 => 0.3669, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -4.66% (5.0226 => 4.7884, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.64% (0.3252 => 0.3101, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.64% (0.7021 => 0.6695, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -4.63% (0.8418 => 0.8028, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/moments: -4.61% (0.4248 => 0.4052, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -4.60% (0.2871 => 0.2739, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -4.58% (0.2989 => 0.2852, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.55% (0.2903 => 0.2771, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.53% (0.2933 => 0.2800, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -4.53% (0.2939 => 0.2806, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -4.51% (0.3394 => 0.3241, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -4.47% (0.3621 => 0.3459, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.47% (0.4813 => 0.4598, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -4.45% (0.3481 => 0.3326, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -4.44% (34.0927 => 32.5775, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/lists1: -4.42% (0.3867 => 0.3696, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -4.41% (0.3446 => 0.3294, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -4.39% (0.2849 => 0.2724, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -4.37% (18.2933 => 17.4942, std.dev.: 0.0079) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.33% (0.9077 => 0.8684, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.31% (0.4427 => 0.4236, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.29% (0.9557 => 0.9147, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.17% (2.2587 => 2.1644, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: -4.12% (0.3205 => 0.3073, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -4.12% (0.3788 => 0.3632, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.09% (0.3323 => 0.3187, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.02% (0.4083 => 0.3919, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.98% (0.3491 => 0.3352, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -3.75% (0.6750 => 0.6497, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -3.71% (0.4524 => 0.4356, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.58% (1.5610 => 1.5051, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.46% (5.4682 => 5.2792, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.38% (0.4321 => 0.4175, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -1.88% (20.7746 => 20.3831, std.dev.: 0.0438) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7521, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/richards_benchmark: -8.72% (1.2842 => 1.1722, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.69% (2.2633 => 2.1798, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.15% (1.3096 => 1.2815, std.dev.: 0.0069) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.45% (6.5735 => 6.4780, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 13:59:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 15:59:44 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121114215944.B24032A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5871?compare_to=5867&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5871, Order: 167966, Start Time: 2012-11-14 20:27:55, End Time: 2012-11-14 22:00:02 To: 5867, Order: 167937, Start Time: 2012-11-14 18:34:15, End Time: 2012-11-14 20:07:15 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 5 (43 on baseline) Performance Improvements: 12 (16 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 975 (915 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/bison/mybison: 43.79% (1.3984 => 2.0107, std.dev.: 0.0595) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 33.52% (0.0698 => 0.0932, std.dev.: 0.0030) MultiSource/Applications/hbd/hbd: 19.63% (1.4970 => 1.7909, std.dev.: 0.0561) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/minisat/minisat: 24.93% (6.1711 => 7.7094, std.dev.: 0.1397) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.45% (1.2429 => 1.2734, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: -39.27% (0.0736 => 0.0447, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/primes/primes: -36.69% (0.0357 => 0.0226, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/objects/objects: -11.90% (0.1025 => 0.0903, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -9.89% (0.9139 => 0.8235, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.85% (0.9338 => 0.8792, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.31% (0.9058 => 0.8577, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -3.87% (0.9437 => 0.9072, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hash2: -2.97% (0.4240 => 0.4114, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.01% (0.8994 => 0.8813, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/employ/employ: -70.95% (0.0148 => 0.0043, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/primes/primes: -9.58% (0.9862 => 0.8917, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.26% (1.9047 => 1.8807, std.dev.: 0.0087) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 3.44% (16.9090 => 17.4915, std.dev.: 0.6223) MultiSource/Applications/obsequi/Obsequi: 1.33% (1.0838 => 1.0982, std.dev.: 0.2679) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.12% (23.4504 => 22.0141, std.dev.: 1.0733) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.54% (0.3730 => 0.3710, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/bigfib: -0.56% (0.6125 => 0.6091, std.dev.: 0.0297) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.42% (0.3391 => 0.3309, std.dev.: 0.0435) SingleSource/Benchmarks/Shootout-C++/strcat: -0.50% (0.2015 => 0.2005, std.dev.: 0.0349) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -10.16% (0.0246 => 0.0221, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.70% (0.0427 => 0.0430, std.dev.: 0.0128) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.47% (0.0386 => 0.0334, std.dev.: 0.0117) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.64% (0.0314 => 0.0316, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.23% (0.0429 => 0.0430, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0203 => 0.0203, std.dev.: 0.0066) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0219 => 0.0219, std.dev.: 0.0072) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.92% (0.1529 => 0.1515, std.dev.: 0.0177) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 9.47% (1.1569 => 1.2665, std.dev.: 0.4124) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.50% (0.4218 => 0.4492, std.dev.: 0.0258) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.87% (0.1461 => 0.1503, std.dev.: 0.0272) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.26% (0.0681 => 0.0652, std.dev.: 0.0178) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 38.31% (0.0201 => 0.0278, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.74% (0.0575 => 0.0585, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.21% (1.2020 => 1.1995, std.dev.: 0.0114) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.13% (0.0032 => 0.0031, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -7.14% (0.0028 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0646 => 0.0646, std.dev.: 0.0136) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.14% (0.0253 => 0.0266, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.68% (0.7791 => 0.7738, std.dev.: 0.0454) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -66.67% (0.0003 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 122.00% (0.0050 => 0.0111, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2435.12% (0.6332 => 16.0524, std.dev.: 0.3529) MultiSource/Benchmarks/McCat/08-main/main: 50.46% (0.1831 => 0.2755, std.dev.: 0.0865) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.12% (0.1559 => 0.1448, std.dev.: 0.0437) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1523.12% (0.3344 => 5.4277, std.dev.: 0.6438) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.51% (0.2364 => 0.3227, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.70% (0.0224 => 0.0239, std.dev.: 0.0066) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0007) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 12.24% (0.1462 => 0.1641, std.dev.: 0.0212) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.5013, std.dev.: 0.0583) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0723, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4903, std.dev.: 0.1015) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3178, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1254, std.dev.: 0.0335) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4020, std.dev.: 0.0049) SingleSource/Regression/C/uint64_to_float: -23.94% (2.1832 => 1.6606, std.dev.: 0.0025) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/bison/mybison: 51.42% (1.3279 => 2.0107, std.dev.: 0.0595) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 47.70% (0.0631 => 0.0932, std.dev.: 0.0030) MultiSource/Applications/hbd/hbd: 25.51% (1.4269 => 1.7909, std.dev.: 0.0561) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.66% (0.0830 => 0.0960, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.44% (0.2180 => 0.2364, std.dev.: 0.0068) MultiSource/Applications/viterbi/viterbi: 8.37% (0.1577 => 0.1709, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 4.94% (0.9069 => 0.9517, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.81% (0.8656 => 0.9072, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.59% (0.8086 => 0.8457, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.60% (0.8697 => 0.9010, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.53% (0.3115 => 0.3225, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.46% (0.8518 => 0.8813, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.13% (0.8317 => 0.8577, std.dev.: 0.0077) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 112.56% (0.0199 => 0.0423, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/pi: 57.35% (1.5795 => 2.4854, std.dev.: 0.0146) MultiSource/Applications/minisat/minisat: 25.31% (6.1525 => 7.7094, std.dev.: 0.1397) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.38% (0.7597 => 0.8917, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.48% (2.9753 => 3.4655, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.83% (2.7995 => 3.2146, std.dev.: 0.0290) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.61% (5.0261 => 5.6096, std.dev.: 0.0154) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.18% (1.1857 => 1.2827, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.94% (6.3772 => 6.8836, std.dev.: 0.1174) MultiSource/Applications/SIBsim4/SIBsim4: 7.62% (3.1873 => 3.4302, std.dev.: 0.0169) SingleSource/Benchmarks/McGill/queens: 7.12% (1.7056 => 1.8270, std.dev.: 0.0205) SingleSource/Benchmarks/Misc/richards_benchmark: 6.51% (1.3037 => 1.3886, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.48% (4.7794 => 5.0892, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.97% (4.5327 => 4.8032, std.dev.: 0.0204) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.86% (4.9686 => 5.2599, std.dev.: 0.0320) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.77% (6.2275 => 6.5243, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.73% (3.3761 => 3.5358, std.dev.: 0.0330) MultiSource/Applications/lambda-0_1_3/lambda: 4.61% (7.4933 => 7.8384, std.dev.: 0.0486) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.51% (4.9469 => 5.1699, std.dev.: 0.0484) MultiSource/Applications/hexxagon/hexxagon: 4.26% (14.0064 => 14.6034, std.dev.: 0.0519) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.74% (0.2887 => 0.2995, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 3.51% (3.6643 => 3.7929, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.65% (11.5690 => 11.8754, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.53% (8.2783 => 8.4877, std.dev.: 0.0092) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.48% (2.4647 => 2.5259, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout/lists: 2.47% (7.3375 => 7.5186, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.08% (1.2474 => 1.2734, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: 1.38% (1.0841 => 1.0991, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: 1.24% (8.5322 => 8.6382, std.dev.: 0.0389) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.17% (3.5679 => 3.6097, std.dev.: 0.0134) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.38% (5.4641 => 4.3506, std.dev.: 0.3390) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.05% (7.2130 => 6.2720, std.dev.: 0.0333) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.71% (1.0512 => 0.9386, std.dev.: 0.0235) MultiSource/Benchmarks/mafft/pairlocalalign: -8.46% (63.1822 => 57.8371, std.dev.: 0.1841) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.19% (14.6451 => 13.4460, std.dev.: 0.3183) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.86% (4.7482 => 4.4225, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.77% (3.7148 => 3.5006, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.65% (5.4972 => 5.1866, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.66% (6.0224 => 5.8021, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.05% (0.5807 => 0.5630, std.dev.: 0.0065) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.99% (28.5821 => 27.7286, std.dev.: 0.0961) SingleSource/Benchmarks/Shootout-C++/hash2: -2.44% (3.4237 => 3.3402, std.dev.: 0.0074) MultiSource/Applications/aha/aha: -2.10% (3.3398 => 3.2695, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.97% (9.9065 => 9.7112, std.dev.: 0.0343) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.90% (11.5316 => 11.3125, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.60% (4.9994 => 4.9194, std.dev.: 0.0183) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 6.36% (16.4461 => 17.4915, std.dev.: 0.6223) MultiSource/Applications/obsequi/Obsequi: 7.02% (1.0262 => 1.0982, std.dev.: 0.2679) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6949.02% (0.3123 => 22.0141, std.dev.: 1.0733) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.63% (0.2463 => 0.3710, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/bigfib: 1.35% (0.6010 => 0.6091, std.dev.: 0.0297) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.32% (0.3266 => 0.3309, std.dev.: 0.0435) SingleSource/Benchmarks/Shootout-C++/strcat: 1.83% (0.1969 => 0.2005, std.dev.: 0.0349) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 79.67% (0.0123 => 0.0221, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.39% (0.0408 => 0.0430, std.dev.: 0.0128) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.50% (0.0254 => 0.0334, std.dev.: 0.0117) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.98% (0.0384 => 0.0430, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0066) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0072) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.35% (0.1438 => 0.1515, std.dev.: 0.0177) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 11.79% (1.1329 => 1.2665, std.dev.: 0.4124) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 7.88% (0.4164 => 0.4492, std.dev.: 0.0258) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.79% (0.1369 => 0.1503, std.dev.: 0.0272) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.72% (0.0641 => 0.0652, std.dev.: 0.0178) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.56% (0.0195 => 0.0278, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.21% (0.0578 => 0.0585, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.88% (1.1437 => 1.1995, std.dev.: 0.0114) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.03% (0.0627 => 0.0646, std.dev.: 0.0136) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.48% (0.8017 => 0.7738, std.dev.: 0.0454) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 79.03% (0.0062 => 0.0111, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 14:48:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 16:48:46 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121114224846.6897F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5872?compare_to=5866&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5872, Order: 167942, Start Time: 2012-11-14 19:33:11, End Time: 2012-11-14 22:49:03 To: 5866, Order: 167928, Start Time: 2012-11-14 15:29:23, End Time: 2012-11-14 18:44:57 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (173 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1038 (718 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 2.11% (1.9713 => 2.0128, std.dev.: 0.0033) MultiSource/Applications/d/make_dparser: 1.03% (1.2498 => 1.2627, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.85% (126.1237 => 129.7166, std.dev.: 0.6935) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.21% (54.0713 => 54.7255, std.dev.: 0.0308) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.04% (0.0625 => 0.0894, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.40% (0.1063 => 0.1418, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.47% (0.2969 => 0.3755, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 26.34% (1.5932 => 2.0128, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.31% (0.1106 => 0.1397, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.11% (0.0475 => 0.0599, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.35% (0.0714 => 0.0895, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.13% (0.4139 => 0.5179, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.29% (0.4253 => 0.5286, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.29% (0.5900 => 0.7333, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 24.03% (0.1107 => 0.1373, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.90% (0.5000 => 0.6195, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.89% (0.4994 => 0.6187, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.58% (0.0547 => 0.0676, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.29% (0.0584 => 0.0720, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.78% (0.1620 => 0.1989, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.62% (0.1021 => 0.1252, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 22.37% (0.0599 => 0.0733, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.07% (0.0897 => 0.1095, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.48% (0.0633 => 0.0769, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 21.20% (0.0948 => 0.1149, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.06% (0.0584 => 0.0707, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.03% (0.0642 => 0.0777, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.76% (0.1103 => 0.1332, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 20.71% (0.0821 => 0.0991, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.68% (0.0822 => 0.0992, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 20.63% (0.1619 => 0.1953, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.55% (0.3903 => 0.4705, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.53% (0.1549 => 0.1867, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.44% (0.1003 => 0.1208, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.20% (0.1604 => 0.1928, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 19.43% (0.0947 => 0.1131, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.26% (0.2736 => 0.3263, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.22% (0.2014 => 0.2401, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 19.18% (0.0808 => 0.0963, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.02% (0.1462 => 0.1740, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 19.00% (0.1505 => 0.1791, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.97% (0.3890 => 0.4628, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 18.92% (0.5826 => 0.6928, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 18.72% (0.1218 => 0.1446, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 18.62% (0.4029 => 0.4779, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.60% (0.2866 => 0.3399, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.59% (1.3152 => 1.5597, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 18.46% (0.5889 => 0.6976, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.29% (0.1088 => 0.1287, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 18.05% (0.0698 => 0.0824, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 17.95% (1.8794 => 2.2168, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.85% (0.0605 => 0.0713, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.83% (0.0572 => 0.0674, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.77% (0.2875 => 0.3386, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.65% (1.6211 => 1.9072, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.60% (0.2738 => 0.3220, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.58% (3.5627 => 4.1891, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.51% (0.5026 => 0.5906, std.dev.: 0.0031) MultiSource/Applications/Burg/burg: 17.49% (0.5546 => 0.6516, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.45% (0.0573 => 0.0673) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.28% (0.1968 => 0.2308, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.27% (0.3271 => 0.3836, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.17% (0.4658 => 0.5458, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 17.14% (0.2725 => 0.3192, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 17.12% (1.0781 => 1.2627, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 17.10% (0.2714 => 0.3178, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.00% (0.2729 => 0.3193) SingleSource/Benchmarks/Shootout-C++/strcat: 16.98% (0.2750 => 0.3217, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 16.91% (0.2780 => 0.3250, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.87% (0.2792 => 0.3263, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.87% (0.2911 => 0.3402, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 16.79% (0.2811 => 0.3283, std.dev.: 0.0044) MultiSource/Applications/hbd/hbd: 16.79% (0.9697 => 1.1325, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 16.74% (0.3004 => 0.3507, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 16.73% (0.2803 => 0.3272, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 16.68% (0.1421 => 0.1658, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 16.65% (0.2823 => 0.3293, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.65% (0.4361 => 0.5087, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.64% (0.1160 => 0.1353, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 16.64% (0.2813 => 0.3281, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.59% (0.3195 => 0.3725, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/wc: 16.57% (0.3096 => 0.3609, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 16.55% (0.9909 => 1.1549, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 16.51% (0.7171 => 0.8355, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.44% (2.0673 => 2.4071, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.21% (4.4195 => 5.1360, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.21% (0.3930 => 0.4567, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 16.10% (0.3267 => 0.3793, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 15.97% (0.1284 => 0.1489, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary: 15.96% (0.3258 => 0.3778, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.91% (2.7292 => 3.1635, std.dev.: 0.0070) MultiSource/Benchmarks/Bullet/bullet: 15.91% (23.5202 => 27.2622, std.dev.: 0.0117) MultiSource/Applications/ClamAV/clamscan: 15.79% (4.2109 => 4.8758, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary2: 15.77% (0.3317 => 0.3840, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.72% (1.9966 => 2.3104, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.62% (0.3060 => 0.3538, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.61% (1.9694 => 2.2769, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.41% (0.1090 => 0.1258, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.40% (0.3845 => 0.4437, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.38% (0.3362 => 0.3879, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.36% (0.3282 => 0.3786, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 15.27% (0.3726 => 0.4295) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.27% (0.3124 => 0.3601, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 15.25% (0.3678 => 0.4239, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 15.21% (0.3465 => 0.3992, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists: 15.11% (0.3348 => 0.3854, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 15.07% (0.3477 => 0.4001, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 15.02% (0.3496 => 0.4021, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 15.00% (0.3446 => 0.3963, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.98% (0.3625 => 0.4168, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 14.96% (0.3469 => 0.3988, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.94% (0.3460 => 0.3977, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 14.94% (0.2075 => 0.2385, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 14.93% (0.3442 => 0.3956, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.91% (0.3488 => 0.4008, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 14.85% (0.2566 => 0.2947, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 14.71% (0.3643 => 0.4179, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 14.71% (0.4146 => 0.4756, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 14.61% (1.4269 => 1.6353, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 14.58% (0.4251 => 0.4871, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 14.58% (0.3650 => 0.4182, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.50% (0.3690 => 0.4225, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.39% (0.3981 => 0.4554, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 14.34% (0.3724 => 0.4258, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 13.98% (0.7875 => 0.8976, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 13.67% (0.5012 => 0.5697, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 13.59% (0.0758 => 0.0861, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 13.49% (2.1653 => 2.4574, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.43% (0.2040 => 0.2314, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 13.31% (4.6177 => 5.2324, std.dev.: 0.0090) MultiSource/Benchmarks/mafft/pairlocalalign: 13.26% (2.1013 => 2.3799, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 13.19% (0.2691 => 0.3046, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 12.40% (5.5417 => 6.2290, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.34% (0.6435 => 0.7229, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.58% (0.1028 => 0.1147, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.44% (0.2737 => 0.3050, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.41% (0.2068 => 0.2304, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 11.41% (0.3498 => 0.3897, std.dev.: 0.0107) MultiSource/Applications/siod/siod: 11.23% (0.6634 => 0.7379, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.21% (0.1383 => 0.1538, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.99% (0.3084 => 0.3423, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 10.77% (0.4847 => 0.5369, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 10.52% (0.3336 => 0.3687, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.03% (0.2103 => 0.2314, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 10.00% (0.2391 => 0.2630, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 9.95% (2.0346 => 2.2371, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.77% (4.6926 => 5.1041, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.64% (11.6398 => 12.6459, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.60% (0.5361 => 0.5822, std.dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.02% (0.5584 => 0.6032, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.81% (0.7426 => 0.8006, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 7.10% (11.9555 => 12.8042, std.dev.: 0.0098) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.67% (0.3792 => 0.4007, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 9.71% (0.2802 => 0.3074, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6106, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.28% (0.3693 => 0.3888, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6782, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1688, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-2: 4.64% (1.8057 => 1.8894, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/dry: 4.16% (14.0481 => 14.6327, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1976, std.dev.: 0.0068) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2223, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2901, std.dev.: 0.0032) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3069, std.dev.: 0.0040) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5858, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5670, std.dev.: 0.0120) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9749, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8001, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9574, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: -6.24% (0.2402 => 0.2252, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8025, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.04% (0.6293 => 0.6102, std.dev.: 0.0056) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7754, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -2.89% (17.2379 => 16.7390, std.dev.: 0.0964) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8735, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5762, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4959, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1828, std.dev.: 0.0742) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0429, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 15:43:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 17:43:40 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121114234340.9317B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5873?compare_to=5870&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5873, Order: 167982, Start Time: 2012-11-14 22:18:46, End Time: 2012-11-14 23:43:57 To: 5870, Order: 167966, Start Time: 2012-11-14 20:30:42, End Time: 2012-11-14 21:55:32 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (178 on baseline) Unchanged Tests: 1041 (860 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.20% (79.0323 => 79.9828, std.dev.: 0.1398) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1014, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/salsa20: 2.40% (7.4937 => 7.6732, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/hash2: 2.18% (3.1932 => 3.2627, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.19% (0.3821 => 0.3508, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.06% (2.4924 => 2.3164, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.87% (0.3142 => 0.2926, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.75% (0.9542 => 0.8898, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -6.70% (0.3357 => 0.3132, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -6.55% (0.3831 => 0.3580, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.53% (0.3812 => 0.3563, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.52% (0.3880 => 0.3627, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.47% (0.3848 => 0.3599, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.44% (0.3896 => 0.3645, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.44% (0.3884 => 0.3634, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.43% (0.2428 => 0.2272, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.42% (0.4033 => 0.3774, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.32% (0.3891 => 0.3645, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.30% (0.4176 => 0.3913, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.28% (0.2355 => 0.2207, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.27% (0.7198 => 0.6747, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: -6.26% (16.1920 => 15.1786, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/oourafft: -6.25% (0.2160 => 0.2025, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -6.24% (9.2283 => 8.6529, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.22% (0.9852 => 0.9239, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -6.19% (0.4199 => 0.3939, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -6.13% (7.0961 => 6.6613, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.12% (0.1796 => 0.1686, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.09% (0.6484 => 0.6089, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -6.01% (0.1879 => 0.1766, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.99% (0.3658 => 0.3439, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.98% (1.0544 => 0.9913, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.95% (1.3722 => 1.2905, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -5.91% (0.1761 => 0.1657, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.80% (1.2300 => 1.1587, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.79% (4.8161 => 4.5374, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: -5.76% (0.9179 => 0.8650, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.75% (0.2695 => 0.2540, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -5.75% (0.4280 => 0.4034, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.74% (4.0323 => 3.8010, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.71% (4.5069 => 4.2495, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.71% (4.8802 => 4.6015, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.71% (3.5339 => 3.3322, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.70% (1.4642 => 1.3807, std.dev.: 0.0107) MultiSource/Benchmarks/MallocBench/gs/gs: -5.69% (4.3330 => 4.0865, std.dev.: 0.0042) MultiSource/Applications/lemon/lemon: -5.65% (1.1450 => 1.0803, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.63% (6.7716 => 6.3904, std.dev.: 0.0125) MultiSource/Benchmarks/Olden/bh/bh: -5.63% (0.2985 => 0.2817, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.60% (0.5478 => 0.5171, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.57% (1.2784 => 1.2072, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.56% (1.6364 => 1.5454, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: -5.55% (0.3406 => 0.3217, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: -5.54% (1.1530 => 1.0891, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.51% (0.5857 => 0.5534, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.51% (0.6736 => 0.6365, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.49% (0.6681 => 0.6314, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.48% (14.2083 => 13.4298, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.46% (0.6230 => 0.5890, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.46% (0.5591 => 0.5286, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.44% (0.6052 => 0.5723, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -5.42% (17.1032 => 16.1762, std.dev.: 0.0160) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.42% (0.2548 => 0.2410, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.40% (0.6189 => 0.5855, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.39% (0.5863 => 0.5547, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.39% (0.8521 => 0.8062, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.38% (0.5575 => 0.5275, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: -5.38% (0.2659 => 0.2516, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.38% (0.6660 => 0.6302, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.37% (0.5849 => 0.5535, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.36% (0.6304 => 0.5966, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.35% (0.5999 => 0.5678, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.34% (0.5802 => 0.5492, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.34% (0.7524 => 0.7122, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.34% (0.7919 => 0.7496, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.34% (0.6667 => 0.6311, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/05-eks/eks: -5.34% (0.4515 => 0.4274, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.33% (0.6395 => 0.6054, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.33% (0.4916 => 0.4654, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.33% (0.6194 => 0.5864, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.32% (0.5925 => 0.5610, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.31% (0.3483 => 0.3298, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.30% (0.6676 => 0.6322, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.30% (0.2999 => 0.2840, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.30% (0.5569 => 0.5274, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.29% (0.5705 => 0.5403, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.29% (0.6297 => 0.5964, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.29% (0.6260 => 0.5929, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.29% (1.2221 => 1.1575, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: -5.28% (1.3864 => 1.3132, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.27% (1.2210 => 1.1566, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.27% (0.5859 => 0.5550, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.27% (0.5581 => 0.5287, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -5.27% (1.2515 => 1.1856, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.24% (0.6446 => 0.6108, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.24% (8.0126 => 7.5928, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.23% (0.7339 => 0.6955, std.dev.: 0.0069) MultiSource/Applications/SPASS/SPASS: -5.21% (15.5079 => 14.7006, std.dev.: 0.0117) SingleSource/UnitTests/ObjC++/property-reference: -5.19% (0.7779 => 0.7375, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.19% (0.5567 => 0.5278, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.15% (0.5456 => 0.5175, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -5.14% (0.3581 => 0.3397, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.12% (0.6440 => 0.6110, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: -5.12% (3.5154 => 3.3353, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (0.5941 => 0.5637, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.12% (0.5570 => 0.5285, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.10% (0.6293 => 0.5972, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.07% (0.2385 => 0.2264, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: -5.07% (1.3148 => 1.2481, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.07% (0.6033 => 0.5727, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.07% (0.6395 => 0.6071, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.05% (0.2278 => 0.2163, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.04% (0.3016 => 0.2864, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -5.04% (0.3255 => 0.3091, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -4.99% (15.2527 => 14.4919, std.dev.: 0.0072) MultiSource/Applications/minisat/minisat: -4.97% (0.7447 => 0.7077, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/methcall: -4.96% (0.3025 => 0.2875, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.95% (0.5168 => 0.4912, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: -4.92% (0.3194 => 0.3037, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.91% (0.4151 => 0.3947, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -4.90% (0.6347 => 0.6036, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -4.89% (4.0594 => 3.8609, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.87% (0.3837 => 0.3650, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.83% (0.5688 => 0.5413, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/except: -4.82% (0.3026 => 0.2880, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.80% (2.1713 => 2.0670, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.78% (1.6474 => 1.5686, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.78% (0.3931 => 0.3743, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: -4.77% (0.3271 => 0.3115, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: -4.76% (2.1401 => 2.0383, std.dev.: 0.0054) SingleSource/UnitTests/ObjC++/property-reference-object: -4.75% (0.6441 => 0.6135, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.68% (0.3057 => 0.2914, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.66% (22.4056 => 21.3604, std.dev.: 0.0126) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.61% (0.3319 => 0.3166, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: -4.60% (5.0226 => 4.7915, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -4.59% (0.2939 => 0.2804, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.59% (0.8418 => 0.8032, std.dev.: 0.0067) MultiSource/Applications/siod/siod: -4.58% (2.4021 => 2.2920, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.55% (0.3252 => 0.3104, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -4.53% (34.0927 => 32.5466, std.dev.: 0.0121) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.53% (0.4813 => 0.4595, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -4.51% (0.3059 => 0.2921, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.50% (0.2933 => 0.2801, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.48% (0.2903 => 0.2773, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -4.46% (0.7982 => 0.7626, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hello: -4.46% (0.2849 => 0.2722, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.44% (0.3849 => 0.3678, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -4.42% (0.3481 => 0.3327, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.40% (0.7021 => 0.6712, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -4.39% (0.3621 => 0.3462, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -4.39% (0.2871 => 0.2745, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -4.38% (0.4248 => 0.4062, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: -4.35% (0.4524 => 0.4327, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.33% (0.5329 => 0.5098, std.dev.: 0.0049) MultiSource/Applications/kimwitu++/kc: -4.32% (18.2933 => 17.5022, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.31% (0.4427 => 0.4236, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: -4.27% (0.3205 => 0.3068, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.24% (0.9557 => 0.9152, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -4.19% (0.3867 => 0.3705, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -4.18% (0.2989 => 0.2864, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.15% (0.9077 => 0.8700, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.15% (2.2587 => 2.1650, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.12% (0.3323 => 0.3186, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -4.09% (0.3788 => 0.3633, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -4.04% (0.3394 => 0.3257, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.99% (0.4083 => 0.3920, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.98% (0.3491 => 0.3352, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -3.98% (0.3446 => 0.3309, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.89% (0.4321 => 0.4153, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: -3.84% (0.6750 => 0.6491, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -3.39% (1.5610 => 1.5081, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.38% (5.4682 => 5.2834, std.dev.: 0.0061) SingleSource/UnitTests/Vector/constpool: -1.82% (20.7746 => 20.3968, std.dev.: 0.0202) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7546, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/richards_benchmark: -8.76% (1.2842 => 1.1717, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7067, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: -3.68% (2.2633 => 2.1799, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.08% (1.0557 => 1.0232, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.04% (1.3096 => 1.2698, std.dev.: 0.0133) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4669, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0000) Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 15:47:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 17:47:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121114234741.0D6402A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5874?compare_to=5869&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5874, Order: 167974, Start Time: 2012-11-14 21:36:28, End Time: 2012-11-14 23:47:57 To: 5869, Order: 167933, Start Time: 2012-11-14 18:33:45, End Time: 2012-11-14 20:45:00 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 43 (123 on baseline) Performance Improvements: 6 (39 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 989 (725 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 17.28% (0.5921 => 0.6944, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 15.56% (0.6164 => 0.7123, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 15.52% (0.7313 => 0.8448, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/lists: 14.89% (0.0732 => 0.0841, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.39% (0.6687 => 0.7649, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 14.04% (0.6219 => 0.7092, std.dev.: 0.0072) MultiSource/Applications/lemon/lemon: 13.54% (1.2023 => 1.3651, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 13.28% (0.6982 => 0.7909, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: 12.34% (0.3129 => 0.3515, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.19% (0.2239 => 0.2512, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 12.03% (4.8475 => 5.4307, std.dev.: 0.0330) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.37% (1.1111 => 1.2374, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.34% (0.1023 => 0.1139, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.43% (0.1534 => 0.1694, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.22% (0.1037 => 0.1143, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.85% (0.3716 => 0.4082, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/lists: 9.76% (0.3811 => 0.4183, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.42% (0.5937 => 0.6496, std.dev.: 0.0171) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.36% (0.1336 => 0.1461, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 9.27% (0.3528 => 0.3855, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/04-bisect/bisect: 8.60% (0.1209 => 0.1313, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.55% (0.1169 => 0.1269, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 8.07% (0.1413 => 0.1527, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.37% (0.9604 => 1.0312, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/BoolLiteralTest: 7.16% (0.4038 => 0.4327, std.dev.: 0.0077) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.87% (0.5283 => 0.5646, std.dev.: 0.0121) MultiSource/Applications/hbd/hbd: 6.82% (1.8057 => 1.9288, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.53% (0.1670 => 0.1779, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference-object: 5.92% (0.6635 => 0.7028, std.dev.: 0.0094) MultiSource/Applications/ClamAV/clamscan: 4.67% (35.9440 => 37.6224, std.dev.: 0.3030) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.87% (1.2892 => 1.3391, std.dev.: 0.0150) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 21.02% (0.0766 => 0.0927, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/ft/ft: 17.88% (1.3196 => 1.5556, std.dev.: 0.0832) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 10.23% (5.5492 => 6.1169, std.dev.: 0.1587) MultiSource/Benchmarks/Bullet/bullet: 8.69% (8.2877 => 9.0080, std.dev.: 0.0830) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.24% (0.5790 => 0.6209, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 5.93% (1.5324 => 1.6233, std.dev.: 0.0216) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 5.55% (0.2287 => 0.2414, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 3.07% (3.2232 => 3.3222, std.dev.: 0.0142) MultiSource/Applications/minisat/minisat: 2.64% (11.2820 => 11.5794, std.dev.: 0.0516) MultiSource/Benchmarks/Olden/em3d/em3d: 2.61% (3.1133 => 3.1946, std.dev.: 0.0111) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.65% (2.1852 => 2.2212, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.42% (4.8450 => 4.9138, std.dev.: 0.0134) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -8.93% (0.7490 => 0.6821, std.dev.: 0.0219) MultiSource/Benchmarks/Prolangs-C/loader/loader: -8.89% (0.3477 => 0.3168, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.87% (4.8445 => 4.7537, std.dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: -1.42% (72.7831 => 71.7518, std.dev.: 0.0473) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: -2.43% (19.4322 => 18.9602, std.dev.: 0.1173) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.37% (1.6052 => 1.5832, std.dev.: 0.0047) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -1.83% (0.1363 => 0.1338, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0420 => 0.0420, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0651 => 0.0650, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 0.12% (493.6141 => 494.1900, std.dev.: 0.1012) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/power/power: 43722.83% (1.1277 => 494.1900, std.dev.: 0.1012) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.86% (0.5229 => 1.5418, std.dev.: 0.1148) MultiSource/Applications/SPASS/SPASS: 22.23% (14.9895 => 18.3214, std.dev.: 0.1500) MultiSource/Applications/kimwitu++/kc: 49.48% (14.1553 => 21.1590, std.dev.: 0.3293) MultiSource/Benchmarks/MallocBench/gs/gs: 21.53% (4.1105 => 4.9953, std.dev.: 0.1130) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.11% (1.1048 => 1.5148, std.dev.: 0.0829) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 442.73% (7.1582 => 38.8497, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.47% (3.4629 => 6.3881, std.dev.: 0.2606) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.63% (0.6222 => 1.0803, std.dev.: 0.0418) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10866.53% (0.0720 => 7.8959, std.dev.: 0.1784) MultiSource/Applications/SIBsim4/SIBsim4: 3918200.00% (0.0001 => 3.9183, std.dev.: 0.0174) MultiSource/Applications/SPASS/SPASS: 14705900.00% (0.0001 => 14.7060, std.dev.: 0.5393) MultiSource/Applications/kimwitu++/kc: 52200.00% (0.0001 => 0.0523, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 620800.00% (0.0001 => 0.6209, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10087700.00% (0.0001 => 10.0878, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6417900.00% (0.0001 => 6.4180, std.dev.: 0.5287) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1825.32% (1.1194 => 21.5520, std.dev.: 0.0484) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 84.82% (2.9384 => 5.4307, std.dev.: 0.0330) MultiSource/Applications/ClamAV/clamscan: 69.66% (22.1758 => 37.6224, std.dev.: 0.3030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 59.14% (7.0540 => 11.2258, std.dev.: 0.0329) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.18% (8.1363 => 12.1380, std.dev.: 0.1944) MultiSource/Applications/JM/lencod/lencod: 47.60% (21.9371 => 32.3795, std.dev.: 0.1355) MultiSource/Benchmarks/FreeBench/distray/distray: 45.27% (0.1056 => 0.1534, std.dev.: 0.0064) SingleSource/UnitTests/vla: 43.94% (0.0355 => 0.0511, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 38.55% (0.1432 => 0.1984, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/almabench: 38.08% (0.0730 => 0.1008, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/08-main/main: 37.63% (0.2554 => 0.3515, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout/lists: 34.35% (0.0626 => 0.0841, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 29.96% (0.1175 => 0.1527, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 29.87% (0.1125 => 0.1461, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 29.48% (0.1940 => 0.2512, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 28.56% (0.0886 => 0.1139, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 28.55% (0.0648 => 0.0833, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_shift: 27.78% (0.0378 => 0.0483, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 27.32% (1.0722 => 1.3651, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 26.72% (0.9765 => 1.2374, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.70% (0.1337 => 0.1694, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 26.65% (0.0953 => 0.1207, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.19% (0.8172 => 1.0312, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.98% (0.0793 => 0.0999, std.dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: 25.44% (0.3121 => 0.3915, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 25.11% (0.0442 => 0.0553, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.13% (0.0746 => 0.0926, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/Oscar: 23.74% (0.0636 => 0.0787, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.63% (0.1062 => 0.1313, std.dev.: 0.0027) MultiSource/Applications/hbd/hbd: 23.62% (1.5603 => 1.9288, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 23.42% (14.3668 => 17.7317, std.dev.: 0.0398) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.32% (0.1029 => 0.1269, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 23.23% (1.1642 => 1.4346, std.dev.: 0.0356) SingleSource/Benchmarks/CoyoteBench/lpbench: 23.04% (0.0929 => 0.1143, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 22.98% (0.1114 => 0.1370, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/bmm/bmm: 22.40% (0.0759 => 0.0929, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 22.34% (0.4615 => 0.5646, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/lists: 22.24% (0.3422 => 0.4183, std.dev.: 0.0123) SingleSource/UnitTests/Vector/SSE/sse_isamax: 21.87% (0.0704 => 0.0858, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.58% (0.1566 => 0.1904, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/mst/mst: 20.89% (0.1163 => 0.1406, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ary: 19.28% (0.3232 => 0.3855, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 19.11% (0.3427 => 0.4082, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.04% (0.2700 => 0.3214, std.dev.: 0.0176) SingleSource/UnitTests/ObjC/instance-method-metadata: 18.97% (0.3543 => 0.4215, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 18.83% (4.9449 => 5.8762, std.dev.: 0.0254) MultiSource/Benchmarks/mafft/pairlocalalign: 18.81% (9.4845 => 11.2685, std.dev.: 0.0183) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 18.73% (1.5859 => 1.8830, std.dev.: 0.1033) SingleSource/UnitTests/ObjC/for-in: 18.62% (0.3694 => 0.4382, std.dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/fftbench: 18.53% (0.4636 => 0.5495, std.dev.: 0.0164) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.30% (4.2646 => 5.0452, std.dev.: 0.1014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.86% (1.4186 => 1.6720, std.dev.: 0.0534) MultiSource/Applications/sqlite3/sqlite3: 17.82% (17.1811 => 20.2422, std.dev.: 0.1932) MultiSource/Applications/lua/lua: 17.45% (3.8723 => 4.5481, std.dev.: 0.1516) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 17.35% (0.1625 => 0.1907, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.34% (5.0018 => 5.8692, std.dev.: 0.0879) MultiSource/Applications/oggenc/oggenc: 17.28% (5.7591 => 6.7543, std.dev.: 0.2219) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.89% (1.5415 => 1.8019, std.dev.: 0.0281) SingleSource/UnitTests/ObjC++/property-reference-object: 16.55% (0.6030 => 0.7028, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.17% (0.2065 => 0.2399, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.02% (0.2872 => 0.3332, std.dev.: 0.0112) MultiSource/Applications/spiff/spiff: 15.95% (0.7835 => 0.9085, std.dev.: 0.0437) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.95% (0.0834 => 0.0967, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: 15.77% (0.0818 => 0.0947, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.32% (0.0770 => 0.0888, std.dev.: 0.0041) MultiSource/Applications/minisat/minisat: 15.14% (0.7115 => 0.8192, std.dev.: 0.0368) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.13% (0.1117 => 0.1286, std.dev.: 0.0039) MultiSource/Applications/viterbi/viterbi: 15.11% (0.1555 => 0.1790, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.87% (0.2758 => 0.3168, std.dev.: 0.0068) MultiSource/Benchmarks/nbench/nbench: 14.76% (1.1840 => 1.3588, std.dev.: 0.0473) MultiSource/Benchmarks/PAQ8p/paq8p: 14.13% (10.3673 => 11.8323, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.04% (0.5981 => 0.6821, std.dev.: 0.0219) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.04% (0.5569 => 0.6351, std.dev.: 0.0289) MultiSource/Applications/sgefa/sgefa: 14.02% (0.3109 => 0.3545, std.dev.: 0.0139) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.65% (0.2271 => 0.2581, std.dev.: 0.0120) MultiSource/Benchmarks/McCat/18-imp/imp: 13.50% (0.3423 => 0.3885, std.dev.: 0.0101) MultiSource/Benchmarks/Bullet/bullet: 13.45% (63.2438 => 71.7518, std.dev.: 0.0473) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.18% (0.4879 => 0.5522, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions-2: 12.98% (0.3497 => 0.3951, std.dev.: 0.0173) SingleSource/UnitTests/ObjC++/property-reference: 12.42% (0.7326 => 0.8236, std.dev.: 0.0315) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.44% (0.1906 => 0.2124, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.04% (0.3162 => 0.3448, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.81% (2.0665 => 2.2486, std.dev.: 0.0702) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.58% (7.9617 => 8.4858, std.dev.: 0.0286) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.35% (0.3177 => 0.3347, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.78% (4.3953 => 11.0225, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/methcall: 147.73% (5.3999 => 13.3774, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 27.02% (9.1159 => 11.5794, std.dev.: 0.0516) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 24.76% (13.4384 => 16.7651, std.dev.: 0.4544) SingleSource/Benchmarks/Shootout-C++/ary: 22.62% (0.0756 => 0.0927, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.17% (1.2838 => 1.5556, std.dev.: 0.0832) SingleSource/Benchmarks/Misc/oourafft: 17.57% (6.6465 => 7.8144, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.63% (1.1145 => 1.2998, std.dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/lpbench: 15.27% (10.3460 => 11.9260, std.dev.: 0.3564) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.04% (0.2944 => 0.3328, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.38% (0.0864 => 0.0971, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.64% (2.8904 => 3.2268, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: 10.21% (1.1396 => 1.2560, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.51% (8.6802 => 9.5054, std.dev.: 0.2095) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.30% (1.7254 => 1.8859, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.03% (3.1334 => 3.3222, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.97% (4.2280 => 4.4805, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.70% (26.0924 => 27.3187, std.dev.: 0.1237) MultiSource/Benchmarks/nbench/nbench: 4.09% (11.6436 => 12.1194, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.02% (3.6395 => 3.7859, std.dev.: 0.0414) MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.68% (2.1424 => 2.2212, std.dev.: 0.0050) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.34% (0.4162 => 0.4301, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 2.98% (3.1023 => 3.1946, std.dev.: 0.0111) SingleSource/Benchmarks/Dhrystone/dry: 2.65% (2.4116 => 2.4754, std.dev.: 0.0087) MultiSource/Benchmarks/PAQ8p/paq8p: 2.20% (85.0658 => 86.9410, std.dev.: 0.0458) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 2.08% (3.1595 => 3.2251, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: 1.88% (1.9577 => 1.9946, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 1.52% (27.8444 => 28.2686, std.dev.: 0.0244) SingleSource/Benchmarks/Shootout-C++/lists: 1.46% (12.5348 => 12.7179, std.dev.: 0.0181) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.45% (6.5088 => 6.6032, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/sieve: 1.42% (5.2139 => 5.2881, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.29% (1.0313 => 1.0446, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0501, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.34% (6.6874 => 0.1779, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -75.76% (0.8651 => 0.2097, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -74.62% (5.2763 => 1.3391, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/richards_benchmark: -44.27% (0.1622 => 0.0904, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.19% (5.3526 => 4.7537, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.04% (5.3855 => 4.9524, std.dev.: 0.0536) MultiSource/Applications/JM/ldecod/ldecod: -6.20% (10.4361 => 9.7891, std.dev.: 0.0611) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.01% (0.3987 => 0.2392, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.92% (0.0506 => 0.0304, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.31% (4.5009 => 2.7766, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.09% (2.6546 => 2.0151, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.30% (0.2161 => 0.1744, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -15.90% (10.7105 => 9.0080, std.dev.: 0.0830) SingleSource/Benchmarks/Misc/flops-6: -15.66% (1.6925 => 1.4274, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.69% (2.6778 => 2.2843, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.72% (32.5116 => 29.0269, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -9.09% (9.5636 => 8.6938, std.dev.: 0.1086) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4245, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4790, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.47% (3.2416 => 3.0319, std.dev.: 0.0222) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5760, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.29% (0.2497 => 0.2365, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.96% (19.9488 => 18.9602, std.dev.: 0.1173) SingleSource/Benchmarks/Misc/flops-5: -4.60% (1.5835 => 1.5106, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -4.27% (6.2999 => 6.0309, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.45% (0.9957 => 0.9613, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: -3.00% (5.0483 => 4.8967, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.18% (0.4808 => 0.4703, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.80% (8.1563 => 8.0092, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6775, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -1.48% (10.2830 => 10.1310, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.28% (0.2116 => 0.0650, std.dev.: 0.0001) Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 15:51:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 17:51:14 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121114235114.3CE702A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5875?compare_to=5871&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5875, Order: 167982, Start Time: 2012-11-14 22:17:24, End Time: 2012-11-14 23:51:33 To: 5871, Order: 167966, Start Time: 2012-11-14 20:27:55, End Time: 2012-11-14 22:00:02 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 26 (57 on baseline) Performance Improvements: 2 (16 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 964 (901 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 75.09% (0.0269 => 0.0471, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 70.71% (0.0297 => 0.0507, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 66.51% (0.0624 => 0.1039, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/mandel-text: 60.75% (0.0214 => 0.0344, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 54.85% (0.0474 => 0.0734, std.dev.: 0.0034) MultiSource/Applications/treecc/treecc: 42.26% (2.0852 => 2.9664, std.dev.: 0.2690) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 40.52% (1.2065 => 1.6954, std.dev.: 0.0333) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 40.16% (0.1016 => 0.1424, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/treeadd/treeadd: 37.98% (0.0495 => 0.0683, std.dev.: 0.0042) MultiSource/Applications/spiff/spiff: 28.00% (0.8522 => 1.0908, std.dev.: 0.0833) SingleSource/Benchmarks/Misc-C++-EH/spirit: 13.39% (5.4277 => 6.1547, std.dev.: 0.1117) MultiSource/Applications/minisat/minisat: 10.23% (0.7322 => 0.8071, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.40% (0.3744 => 0.4021, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.52% (0.3227 => 0.3373, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.73% (0.5337 => 0.5536, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.23% (1.2215 => 1.2610, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.42% (1.6825 => 1.7233, std.dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: 2.18% (1.3123 => 1.3409, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/d/make_dparser: 47.91% (0.0382 => 0.0565, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones/fhourstones: 30.20% (1.2868 => 1.6754, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/nestedloop: 25.88% (0.2017 => 0.2539, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/stepanov_container: 25.38% (4.5972 => 5.7638, std.dev.: 0.3028) MultiSource/Benchmarks/nbench/nbench: 7.24% (20.4051 => 21.8816, std.dev.: 0.5299) MultiSource/Applications/minisat/minisat: 6.15% (7.7094 => 8.1832, std.dev.: 0.1558) MultiSource/Applications/lua/lua: 1.64% (29.5823 => 30.0679, std.dev.: 0.0614) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (3.4302 => 3.4785, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/bison/mybison: -29.79% (2.0107 => 1.4118, std.dev.: 0.1001) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: -11.59% (0.0932 => 0.0824, std.dev.: 0.0041) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 7.17% (17.4915 => 18.7451, std.dev.: 0.9922) MultiSource/Applications/obsequi/Obsequi: 11.07% (1.0982 => 1.2198, std.dev.: 0.1406) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.15% (22.0141 => 22.0482, std.dev.: 0.9821) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.73% (0.3710 => 0.3683, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/bigfib: 7.14% (0.6091 => 0.6526, std.dev.: 0.1854) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.29% (0.3309 => 0.3451, std.dev.: 0.0304) SingleSource/Benchmarks/Shootout-C++/strcat: 3.09% (0.2005 => 0.2067, std.dev.: 0.0124) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0221 => 0.0221, std.dev.: 0.0123) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.81% (0.0430 => 0.0405, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.20% (0.0334 => 0.0338, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0316 => 0.0315, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.23% (0.0430 => 0.0431, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: 0.99% (0.0203 => 0.0205, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0219 => 0.0219, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.40% (0.1515 => 0.1521, std.dev.: 0.0295) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -3.51% (1.2665 => 1.2221, std.dev.: 0.3646) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 7.32% (0.4492 => 0.4821, std.dev.: 0.1190) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.46% (0.1503 => 0.1436, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.98% (0.0652 => 0.0613, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0278 => 0.0278, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.22% (0.0585 => 0.0572, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 2.45% (1.1995 => 1.2289, std.dev.: 0.2914) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 38.71% (0.0031 => 0.0043, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 35.60% (0.0646 => 0.0876, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.53% (0.0266 => 0.0238, std.dev.: 0.0073) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 6.84% (0.7738 => 0.8267, std.dev.: 0.1169) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -1.80% (0.0111 => 0.0109, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2482.28% (0.6332 => 16.3510, std.dev.: 0.6106) MultiSource/Benchmarks/McCat/08-main/main: 79.79% (0.1831 => 0.3292, std.dev.: 0.0664) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.04% (0.1559 => 0.1496, std.dev.: 0.0277) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1740.52% (0.3344 => 6.1547, std.dev.: 0.1117) SingleSource/Benchmarks/Misc-C++/Large/ray: 42.68% (0.2364 => 0.3373, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: 13.29% (0.0429 => 0.0486, std.dev.: 0.0132) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.25% (0.0224 => 0.0238, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -24.78% (0.0230 => 0.0173, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 13.06% (0.1462 => 0.1653, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.5433, std.dev.: 0.0598) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0762, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4963, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3919, std.dev.: 0.0402) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1431, std.dev.: 0.0561) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4112, std.dev.: 0.1278) SingleSource/Regression/C/uint64_to_float: -23.83% (2.1832 => 1.6629, std.dev.: 0.1178) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 87.65% (0.0251 => 0.0471, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/mandel-text: 85.95% (0.0185 => 0.0344, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-4: 83.03% (0.0277 => 0.0507, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 75.80% (0.0810 => 0.1424, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 73.46% (0.0599 => 0.1039, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 67.96% (0.0437 => 0.0734, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/treeadd/treeadd: 61.08% (0.0424 => 0.0683, std.dev.: 0.0042) MultiSource/Applications/treecc/treecc: 48.71% (1.9948 => 2.9664, std.dev.: 0.2690) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 46.08% (1.1606 => 1.6954, std.dev.: 0.0333) MultiSource/Benchmarks/Olden/voronoi/voronoi: 45.38% (0.2519 => 0.3662, std.dev.: 0.0392) MultiSource/Applications/spiff/spiff: 37.21% (0.7950 => 1.0908, std.dev.: 0.0833) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 30.59% (0.0631 => 0.0824, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 25.31% (8.6476 => 10.8364, std.dev.: 0.7976) MultiSource/Applications/minisat/minisat: 18.10% (0.6834 => 0.8071, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.53% (0.1425 => 0.1575, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.95% (0.3657 => 0.4021, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.92% (1.1685 => 1.2610, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.43% (0.1885 => 0.2025, std.dev.: 0.0037) MultiSource/Applications/SIBsim4/SIBsim4: 6.69% (1.2568 => 1.3409, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.65% (0.5191 => 0.5536, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.17% (1.6386 => 1.7233, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.78% (0.8995 => 0.9425, std.dev.: 0.0113) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.34% (0.3717 => 0.3841, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 110.55% (0.0199 => 0.0419, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/pi: 58.22% (1.5795 => 2.4991, std.dev.: 0.0107) MultiSource/Applications/d/make_dparser: 47.14% (0.0384 => 0.0565, std.dev.: 0.0044) MultiSource/Applications/minisat/minisat: 33.01% (6.1525 => 8.1832, std.dev.: 0.1558) MultiSource/Benchmarks/Fhourstones/fhourstones: 30.67% (1.2822 => 1.6754, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_container: 26.55% (4.5547 => 5.7638, std.dev.: 0.3028) SingleSource/Benchmarks/Shootout-C++/nestedloop: 25.26% (0.2027 => 0.2539, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 21.02% (0.0528 => 0.0639, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.22% (0.7597 => 0.8905, std.dev.: 0.0306) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.33% (2.9753 => 3.4613, std.dev.: 0.0250) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.44% (2.7995 => 3.2038, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 12.36% (5.0261 => 5.6475, std.dev.: 0.0290) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.45% (0.3186 => 0.3487, std.dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: 9.14% (3.1873 => 3.4785, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.47% (6.3772 => 6.9172, std.dev.: 0.1426) SingleSource/Benchmarks/McGill/queens: 7.58% (1.7056 => 1.8349, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.66% (4.7794 => 5.0979, std.dev.: 0.0297) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.29% (59.2638 => 62.9888, std.dev.: 0.6566) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.00% (4.5327 => 4.8046, std.dev.: 0.0568) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.87% (4.9686 => 5.2603, std.dev.: 0.0508) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.72% (2.2485 => 2.3771, std.dev.: 0.0467) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.71% (6.2275 => 6.5207, std.dev.: 0.0275) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.69% (3.3761 => 3.5343, std.dev.: 0.0512) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.18% (4.9453 => 5.1522, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.10% (4.9469 => 5.1498, std.dev.: 0.0355) MultiSource/Applications/hexxagon/hexxagon: 4.01% (14.0064 => 14.5676, std.dev.: 0.0557) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.97% (8.2783 => 8.5239, std.dev.: 0.0790) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.88% (4.8362 => 4.9753, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.81% (11.5690 => 11.8940, std.dev.: 0.0230) SingleSource/Benchmarks/Shootout/lists: 2.62% (7.3375 => 7.5294, std.dev.: 0.0291) MultiSource/Benchmarks/BitBench/five11/five11: 2.31% (5.6030 => 5.7323, std.dev.: 0.0449) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.71% (3.5679 => 3.6288, std.dev.: 0.0118) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.52% (39.2082 => 39.8041, std.dev.: 0.1614) MultiSource/Benchmarks/FreeBench/neural/neural: 1.38% (1.0841 => 1.0991, std.dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.55% (5.4641 => 4.3412, std.dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.56% (1.0512 => 0.9402, std.dev.: 0.0316) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -10.53% (7.2130 => 6.4532, std.dev.: 0.1111) MultiSource/Benchmarks/mafft/pairlocalalign: -8.29% (63.1822 => 57.9416, std.dev.: 0.0400) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.17% (14.6451 => 13.5952, std.dev.: 0.2036) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.85% (4.7482 => 4.4229, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.00% (3.7148 => 3.4919, std.dev.: 0.0520) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.73% (5.4972 => 5.1821, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.35% (4.7449 => 4.5387, std.dev.: 0.0568) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.23% (2.8773 => 2.7556, std.dev.: 0.0217) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.48% (6.0224 => 5.8131, std.dev.: 0.0468) MultiSource/Benchmarks/Prolangs-C++/life/life: -3.18% (2.6356 => 2.5519, std.dev.: 0.0225) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.88% (28.5821 => 27.7589, std.dev.: 0.0841) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.23% (9.9065 => 9.6860, std.dev.: 0.0539) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (11.5316 => 11.2987, std.dev.: 0.0300) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.3487 => 2.3154, std.dev.: 0.0022) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 13.98% (16.4461 => 18.7451, std.dev.: 0.9922) MultiSource/Applications/obsequi/Obsequi: 18.87% (1.0262 => 1.2198, std.dev.: 0.1406) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6959.94% (0.3123 => 22.0482, std.dev.: 0.9821) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.53% (0.2463 => 0.3683, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/bigfib: 8.59% (0.6010 => 0.6526, std.dev.: 0.1854) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.66% (0.3266 => 0.3451, std.dev.: 0.0304) SingleSource/Benchmarks/Shootout-C++/strcat: 4.98% (0.1969 => 0.2067, std.dev.: 0.0124) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 79.67% (0.0123 => 0.0221, std.dev.: 0.0123) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.74% (0.0408 => 0.0405, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 33.07% (0.0254 => 0.0338, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 12.24% (0.0384 => 0.0431, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 100.00% (0.0007 => 0.0014, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 5.77% (0.1438 => 0.1521, std.dev.: 0.0295) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 7.87% (1.1329 => 1.2221, std.dev.: 0.3646) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 15.78% (0.4164 => 0.4821, std.dev.: 0.1190) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.89% (0.1369 => 0.1436, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.37% (0.0641 => 0.0613, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.56% (0.0195 => 0.0278, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.04% (0.0578 => 0.0572, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.45% (1.1437 => 1.2289, std.dev.: 0.2914) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 4200.00% (0.0001 => 0.0043, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 39.71% (0.0627 => 0.0876, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 32.22% (0.0180 => 0.0238, std.dev.: 0.0073) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.12% (0.8017 => 0.8267, std.dev.: 0.1169) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 75.81% (0.0062 => 0.0109, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 17:32:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 19:32:10 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121115013210.26C512A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5876?compare_to=5873&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5876, Order: 167999, Start Time: 2012-11-15 00:07:22, End Time: 2012-11-15 01:32:26 To: 5873, Order: 167982, Start Time: 2012-11-14 22:18:46, End Time: 2012-11-14 23:43:57 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (6 on baseline) Performance Improvements: 0 (178 on baseline) Unchanged Tests: 1040 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.41% (54.6270 => 56.4910, std.dev.: 0.1239) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.33% (79.9828 => 81.0477, std.dev.: 0.1277) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.51% (54.5751 => 56.4910, std.dev.: 0.1239) SingleSource/Benchmarks/Misc/salsa20: 2.66% (7.4937 => 7.6933, std.dev.: 0.0105) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.64% (2.0478 => 2.1018, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash2: 2.06% (3.1932 => 3.2589, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.67% (79.7170 => 81.0477, std.dev.: 0.1277) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.93% (0.3821 => 0.3518, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -6.99% (2.4924 => 2.3182, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-2: -6.94% (0.3831 => 0.3565, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -6.93% (0.3812 => 0.3548, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.91% (0.3880 => 0.3612, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -6.88% (0.3896 => 0.3628, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.82% (0.3884 => 0.3619, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.81% (0.3142 => 0.2928, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.81% (0.3848 => 0.3586, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.79% (0.4033 => 0.3759, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.73% (0.3357 => 0.3131, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.71% (0.3891 => 0.3630, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -6.59% (0.4176 => 0.3901, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.37% (0.2355 => 0.2205, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: -6.31% (0.4199 => 0.3934, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.27% (0.9542 => 0.8944, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -6.26% (9.2283 => 8.6503, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.22% (0.2428 => 0.2277, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.18% (0.6484 => 0.6083, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: -6.17% (16.1920 => 15.1936, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/oourafft: -6.16% (0.2160 => 0.2027, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.07% (0.1796 => 0.1687, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.07% (0.3658 => 0.3436, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: -6.07% (0.1879 => 0.1765, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.06% (1.0544 => 0.9905, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: -6.03% (0.4280 => 0.4022, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -6.00% (7.0961 => 6.6700, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.98% (0.9852 => 0.9263, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.98% (1.3722 => 1.2902, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.90% (4.0323 => 3.7943, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.88% (0.5591 => 0.5262, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.88% (4.8161 => 4.5327, std.dev.: 0.0063) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.88% (6.7716 => 6.3733, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.86% (1.6364 => 1.5405, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: -5.85% (0.1761 => 0.1658, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.79% (0.5478 => 0.5161, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.79% (0.3025 => 0.2850, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.77% (0.5805 => 0.5470, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: -5.76% (0.3194 => 0.3010, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.75% (0.7198 => 0.6784, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: -5.70% (1.3148 => 1.2398, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.70% (0.6189 => 0.5836, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.70% (0.6260 => 0.5903, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.70% (3.5339 => 3.3325, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.69% (4.5069 => 4.2506, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.69% (4.8802 => 4.6027, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.68% (1.4642 => 1.3810, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.68% (0.2695 => 0.2542, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.68% (0.6676 => 0.6297, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.67% (1.2300 => 1.1602, std.dev.: 0.0120) MultiSource/Benchmarks/nbench/nbench: -5.67% (1.1530 => 1.0876, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.67% (0.3016 => 0.2845, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.67% (0.5857 => 0.5525, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/football/football: -5.67% (0.9179 => 0.8659, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.66% (0.3057 => 0.2884, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.66% (0.6681 => 0.6303, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.66% (0.3837 => 0.3620, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.65% (0.5925 => 0.5590, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: -5.64% (0.2871 => 0.2709, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.64% (0.6667 => 0.6291, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.63% (0.6194 => 0.5845, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.63% (0.6230 => 0.5879, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.60% (2.1713 => 2.0496, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.60% (14.2083 => 13.4128, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.59% (0.2933 => 0.2769, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.58% (0.5802 => 0.5478, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -5.58% (0.2939 => 0.2775, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -5.57% (1.1450 => 1.0812, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.57% (0.6736 => 0.6361, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: -5.56% (0.3255 => 0.3074, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.56% (0.7339 => 0.6931, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.56% (0.6660 => 0.6290, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -5.55% (0.7779 => 0.7347, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.54% (0.5863 => 0.5538, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.53% (0.5569 => 0.5261, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.52% (0.3931 => 0.3714, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.52% (0.5581 => 0.5273, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.51% (0.2903 => 0.2743, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.50% (0.6304 => 0.5957, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.49% (0.6297 => 0.5951, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: -5.49% (0.4515 => 0.4267, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: -5.49% (0.3059 => 0.2891, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.49% (0.5941 => 0.5615, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.48% (0.3483 => 0.3292, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -5.48% (0.2849 => 0.2693, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -5.47% (4.3330 => 4.0962, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary2: -5.46% (0.3481 => 0.3291, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.45% (0.7524 => 0.7114, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: -5.44% (17.1032 => 16.1733, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.44% (0.6052 => 0.5723, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.43% (0.5575 => 0.5272, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.43% (0.6440 => 0.6090, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.43% (0.8521 => 0.8058, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.43% (0.6395 => 0.6048, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -5.42% (0.2989 => 0.2827, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.42% (0.5849 => 0.5532, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.41% (0.6395 => 0.6049, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.41% (0.5456 => 0.5161, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.40% (1.2784 => 1.2094, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.40% (0.5688 => 0.5381, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: -5.39% (1.2515 => 1.1840, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.39% (0.5859 => 0.5543, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.38% (0.6446 => 0.6099, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.38% (0.3252 => 0.3077, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.38% (0.3849 => 0.3642, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.35% (0.4151 => 0.3929, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.35% (0.5705 => 0.5400, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: -5.34% (1.3864 => 1.3123, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: -5.34% (0.6347 => 0.6008, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -5.34% (0.3205 => 0.3034, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -5.33% (0.3394 => 0.3213, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -5.31% (0.3446 => 0.3263, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.30% (0.2659 => 0.2518, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.30% (0.5570 => 0.5275, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -5.29% (0.4861 => 0.4604, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -5.27% (0.3621 => 0.3430, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.27% (0.2278 => 0.2158, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.26% (0.6293 => 0.5962, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.25% (0.6033 => 0.5716, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.25% (0.5999 => 0.5684, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: -5.25% (0.3581 => 0.3393, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.24% (1.2210 => 1.1570, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.24% (0.2999 => 0.2842, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.23% (1.2221 => 1.1582, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: -5.22% (15.5079 => 14.6977, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.22% (0.2548 => 0.2415, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.21% (0.5567 => 0.5277, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.21% (0.4916 => 0.4660, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.17% (8.0126 => 7.5984, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: -5.17% (0.3406 => 0.3230, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -5.15% (0.3867 => 0.3668, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -5.13% (3.5154 => 3.3350, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference-object: -5.12% (0.6441 => 0.6111, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.09% (0.2985 => 0.2833, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -5.09% (15.2527 => 14.4762, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.08% (0.7919 => 0.7517, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.07% (0.2385 => 0.2264, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.03% (0.4813 => 0.4571, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.01% (0.5168 => 0.4909, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.97% (0.3319 => 0.3154, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: -4.97% (0.7447 => 0.7077, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.94% (1.6474 => 1.5660, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.93% (0.7021 => 0.6675, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.82% (0.4083 => 0.3886, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.80% (0.5329 => 0.5073, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -4.75% (4.0594 => 3.8664, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: -4.75% (0.3788 => 0.3608, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.75% (0.9557 => 0.9103, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -4.71% (2.1401 => 2.0392, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: -4.65% (0.7982 => 0.7611, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.63% (0.3323 => 0.3169, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.63% (0.4427 => 0.4222, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.59% (22.4056 => 21.3779, std.dev.: 0.0106) MultiSource/Applications/siod/siod: -4.58% (2.4021 => 2.2921, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -4.51% (34.0927 => 32.5543, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/09-vor/vor: -4.49% (0.3271 => 0.3124, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: -4.49% (0.8418 => 0.8040, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: -4.36% (5.0226 => 4.8037, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hash: -4.35% (0.4524 => 0.4327, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.34% (0.9077 => 0.8683, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: -4.31% (0.6750 => 0.6459, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -4.29% (18.2933 => 17.5090, std.dev.: 0.0243) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.12% (0.3491 => 0.3347, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.06% (2.2587 => 2.1671, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: -3.88% (1.5610 => 1.5004, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.86% (0.4321 => 0.4154, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.52% (5.4682 => 5.2758, std.dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -2.60% (20.7746 => 20.2337, std.dev.: 0.0252) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7504, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: -8.69% (1.2842 => 1.1726, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.73% (2.2633 => 2.1788, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.61% (6.5735 => 6.4679, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 17:43:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 19:43:57 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121115014357.C35202A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5877?compare_to=5875&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5877, Order: 167999, Start Time: 2012-11-15 00:10:43, End Time: 2012-11-15 01:44:17 To: 5875, Order: 167982, Start Time: 2012-11-14 22:17:24, End Time: 2012-11-14 23:51:33 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 8 (68 on baseline) Performance Improvements: 14 (17 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 970 (889 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/DuffsDevice: 60.17% (0.0231 => 0.0370, std.dev.: 0.0004) SingleSource/Regression/C/compare: 57.80% (0.0218 => 0.0344, std.dev.: 0.0031) SingleSource/Regression/C/matrixTranspose: 52.12% (0.0259 => 0.0394, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: 49.55% (0.0331 => 0.0495, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.01% (0.8942 => 0.9122, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.72% (0.8487 => 0.8633, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/lpbench: 28.45% (3.9486 => 5.0720, std.dev.: 0.1323) SingleSource/Benchmarks/Misc/mandel-2: 2.67% (2.8952 => 2.9725, std.dev.: 0.0275) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -39.85% (0.1039 => 0.0625, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -34.13% (0.1424 => 0.0938, std.dev.: 0.0037) MultiSource/Applications/treecc/treecc: -28.61% (2.9664 => 2.1176, std.dev.: 0.1645) MultiSource/Benchmarks/Olden/voronoi/voronoi: -27.85% (0.3662 => 0.2642, std.dev.: 0.0357) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.23% (1.6954 => 1.2337, std.dev.: 0.0329) MultiSource/Benchmarks/McCat/04-bisect/bisect: -25.34% (0.1634 => 0.1220, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -22.50% (0.2973 => 0.2304, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: -17.72% (0.0824 => 0.0678, std.dev.: 0.0014) MultiSource/Applications/lua/lua: -17.20% (4.8143 => 3.9864, std.dev.: 0.0306) SingleSource/Benchmarks/Misc/oourafft: -7.92% (0.2385 => 0.2196, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/minisat/minisat: -22.35% (8.1832 => 6.3542, std.dev.: 0.1994) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -20.62% (0.1833 => 0.1455, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -15.72% (0.0636 => 0.0536, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.72% (6.4532 => 6.2776, std.dev.: 0.0596) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -9.74% (18.7451 => 16.9201, std.dev.: 1.5653) MultiSource/Applications/obsequi/Obsequi: -12.93% (1.2198 => 1.0621, std.dev.: 0.2560) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.64% (22.0482 => 22.4102, std.dev.: 1.1638) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.66% (0.3683 => 0.3744, std.dev.: 0.0854) SingleSource/Benchmarks/Misc-C++/bigfib: -1.95% (0.6526 => 0.6399, std.dev.: 0.0739) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.19% (0.3451 => 0.3492, std.dev.: 0.0714) SingleSource/Benchmarks/Shootout-C++/strcat: 3.39% (0.2067 => 0.2137, std.dev.: 0.0557) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.81% (0.0221 => 0.0225, std.dev.: 0.0045) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 8.15% (0.0405 => 0.0438, std.dev.: 0.0118) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0338 => 0.0339, std.dev.: 0.0137) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.90% (0.0315 => 0.0321, std.dev.: 0.0096) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.70% (0.0431 => 0.0428, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0205 => 0.0206, std.dev.: 0.0066) SingleSource/UnitTests/Vector/Altivec/test1: 2.28% (0.0219 => 0.0224, std.dev.: 0.0086) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0014 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -1.31% (0.1521 => 0.1501, std.dev.: 0.0244) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.43% (1.2221 => 1.2274, std.dev.: 0.3819) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -13.13% (0.4821 => 0.4188, std.dev.: 0.0147) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.83% (0.1436 => 0.1381, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.82% (0.0613 => 0.0618, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0278 => 0.0278, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.20% (0.0572 => 0.0596, std.dev.: 0.0189) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -2.71% (1.2289 => 1.1956, std.dev.: 0.0351) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -27.91% (0.0043 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -26.26% (0.0876 => 0.0646, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 11.76% (0.0238 => 0.0266, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -5.37% (0.8267 => 0.7823, std.dev.: 0.0264) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: 900.00% (0.0001 => 0.0010, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 500.00% (0.0001 => 0.0006, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: -23.85% (0.0109 => 0.0083, std.dev.: 0.0045) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2375.55% (0.6332 => 15.6752, std.dev.: 0.6761) MultiSource/Benchmarks/McCat/08-main/main: 50.30% (0.1831 => 0.2752, std.dev.: 0.0823) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.32% (0.1559 => 0.1476, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1561.24% (0.3344 => 5.5552, std.dev.: 0.4473) SingleSource/Benchmarks/Misc-C++/Large/ray: 41.29% (0.2364 => 0.3340, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/mandel: 10.72% (0.0429 => 0.0475, std.dev.: 0.0125) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.04% (0.0224 => 0.0242, std.dev.: 0.0103) SingleSource/UnitTests/byval-alignment: -24.78% (0.0230 => 0.0173, std.dev.: 0.0062) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 12.38% (0.1462 => 0.1643, std.dev.: 0.0260) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4937, std.dev.: 0.0659) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0740, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4928, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3288, std.dev.: 0.0695) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1490, std.dev.: 0.0517) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4130, std.dev.: 0.0967) SingleSource/Regression/C/uint64_to_float: -22.41% (2.1832 => 1.6940, std.dev.: 0.0274) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0008, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2008-01-07-LongDouble: 84.13% (0.0126 => 0.0232, std.dev.: 0.0007) SingleSource/Regression/C/2003-05-22-LocalTypeTest: 80.80% (0.0125 => 0.0226, std.dev.: 0.0012) SingleSource/Regression/C/DuffsDevice: 78.74% (0.0207 => 0.0370, std.dev.: 0.0004) SingleSource/Regression/C/compare: 76.41% (0.0195 => 0.0344, std.dev.: 0.0031) SingleSource/Regression/C/matrixTranspose: 70.56% (0.0231 => 0.0394, std.dev.: 0.0027) SingleSource/Regression/C++/BuiltinTypeInfo: 68.29% (0.0164 => 0.0276, std.dev.: 0.0015) SingleSource/Regression/C/badidx: 67.71% (0.0192 => 0.0322, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: 65.00% (0.0300 => 0.0495, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.80% (0.0810 => 0.0938, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 11.11% (0.1062 => 0.1180, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.31% (0.2279 => 0.2514, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.09% (2.1401 => 2.3560, std.dev.: 0.0211) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.70% (0.3137 => 0.3410, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.53% (0.2111 => 0.2291, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.02% (0.2133 => 0.2304, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.80% (0.7473 => 0.8056, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.63% (0.4559 => 0.4907, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/random: 6.97% (0.1994 => 0.2133, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.38% (0.1756 => 0.1868, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 6.23% (14.2605 => 15.1489, std.dev.: 0.2880) MultiSource/Benchmarks/nbench/nbench: 6.07% (1.1271 => 1.1955, std.dev.: 0.0172) MultiSource/Applications/siod/siod: 5.81% (2.2184 => 2.3473, std.dev.: 0.0384) SingleSource/Benchmarks/Misc/oourafft: 5.17% (0.2088 => 0.2196, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 4.71% (0.8712 => 0.9122, std.dev.: 0.0026) MultiSource/Applications/lua/lua: 4.39% (3.8189 => 3.9864, std.dev.: 0.0306) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.20% (0.5191 => 0.5409, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.19% (0.8286 => 0.8633, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 3.52% (0.8069 => 0.8353, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.37% (0.9074 => 0.9380, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.36% (0.9908 => 1.0241, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.13% (0.8518 => 0.8785, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.92% (0.9069 => 0.9334, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.41% (0.8177 => 0.8374, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 127.64% (0.0199 => 0.0453, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/pi: 57.76% (1.5795 => 2.4918, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/lpbench: 30.03% (3.9006 => 5.0720, std.dev.: 0.1323) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.41% (2.9753 => 3.4635, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.73% (0.7597 => 0.8792, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.56% (2.7995 => 3.2070, std.dev.: 0.0347) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.62% (5.0261 => 5.6099, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary3: 10.43% (1.9999 => 2.2084, std.dev.: 0.0466) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.14% (1.1857 => 1.2822, std.dev.: 0.0300) SingleSource/Benchmarks/McGill/queens: 7.87% (1.7056 => 1.8399, std.dev.: 0.0347) SingleSource/Benchmarks/Misc/richards_benchmark: 7.09% (1.3037 => 1.3961, std.dev.: 0.0273) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.69% (4.7794 => 5.0993, std.dev.: 0.0231) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.94% (4.9686 => 5.2635, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.86% (4.5327 => 4.7983, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.68% (3.3761 => 3.5341, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.59% (2.2485 => 2.3516, std.dev.: 0.0316) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.53% (6.2275 => 6.5098, std.dev.: 0.0328) MultiSource/Applications/lambda-0_1_3/lambda: 4.48% (7.4933 => 7.8291, std.dev.: 0.0427) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.03% (4.9453 => 5.1447, std.dev.: 0.0384) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.97% (4.9469 => 5.1434, std.dev.: 0.0090) MultiSource/Applications/hexxagon/hexxagon: 3.97% (14.0064 => 14.5618, std.dev.: 0.0680) MultiSource/Applications/siod/siod: 3.49% (3.6643 => 3.7921, std.dev.: 0.0181) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.20% (4.8362 => 4.9908, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.77% (4.8660 => 5.0010, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.76% (8.2783 => 8.5067, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/mandel-2: 2.67% (2.8951 => 2.9725, std.dev.: 0.0275) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.52% (11.5690 => 11.8601, std.dev.: 0.0351) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.20% (1.1365 => 1.1615, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.15% (4.3552 => 4.4488, std.dev.: 0.0313) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.86% (1.5941 => 1.6237, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 1.54% (8.5322 => 8.6638, std.dev.: 0.0358) MultiSource/Applications/JM/lencod/lencod: 1.33% (6.7064 => 6.7956, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.29% (1.8829 => 1.9071, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.23% (3.5679 => 3.6118, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: 1.17% (1.0841 => 1.0968, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.00% (5.4641 => 4.3167, std.dev.: 0.1197) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.97% (7.2130 => 6.2776, std.dev.: 0.0596) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.30% (14.6451 => 13.2830, std.dev.: 0.2201) MultiSource/Benchmarks/mafft/pairlocalalign: -8.21% (63.1822 => 57.9937, std.dev.: 0.3497) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.88% (4.7482 => 4.4214, std.dev.: 0.0271) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.84% (5.4972 => 5.1762, std.dev.: 0.0915) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.12% (5.1557 => 4.8917, std.dev.: 0.0222) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.29% (4.7449 => 4.5415, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.67% (6.0224 => 5.8011, std.dev.: 0.0444) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.67% (2.8773 => 2.7718, std.dev.: 0.0276) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.93% (28.5821 => 27.7459, std.dev.: 0.1334) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.88% (2.6356 => 2.5598, std.dev.: 0.0291) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.13% (9.9065 => 9.6956, std.dev.: 0.0456) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.96% (11.5316 => 11.3057, std.dev.: 0.0275) MultiSource/Applications/aha/aha: -1.68% (3.3398 => 3.2836, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.58% (4.9994 => 4.9202, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.15% (5.6343 => 5.5696, std.dev.: 0.0118) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.88% (16.4461 => 16.9201, std.dev.: 1.5653) MultiSource/Applications/obsequi/Obsequi: 3.50% (1.0262 => 1.0621, std.dev.: 0.2560) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7075.86% (0.3123 => 22.4102, std.dev.: 1.1638) SingleSource/Benchmarks/CoyoteBench/fftbench: 52.01% (0.2463 => 0.3744, std.dev.: 0.0854) SingleSource/Benchmarks/Misc-C++/bigfib: 6.47% (0.6010 => 0.6399, std.dev.: 0.0739) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.92% (0.3266 => 0.3492, std.dev.: 0.0714) SingleSource/Benchmarks/Shootout-C++/strcat: 8.53% (0.1969 => 0.2137, std.dev.: 0.0557) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 82.93% (0.0123 => 0.0225, std.dev.: 0.0045) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 7.35% (0.0408 => 0.0438, std.dev.: 0.0118) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 33.46% (0.0254 => 0.0339, std.dev.: 0.0137) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 6.29% (0.0302 => 0.0321, std.dev.: 0.0096) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.46% (0.0384 => 0.0428, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/casts: 8.42% (0.0190 => 0.0206, std.dev.: 0.0066) SingleSource/UnitTests/Vector/Altivec/test1: 24.44% (0.0180 => 0.0224, std.dev.: 0.0086) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 100.00% (0.0007 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.38% (0.1438 => 0.1501, std.dev.: 0.0244) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 8.34% (1.1329 => 1.2274, std.dev.: 0.3819) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.58% (0.4164 => 0.4188, std.dev.: 0.0147) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.88% (0.1369 => 0.1381, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.59% (0.0641 => 0.0618, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.56% (0.0195 => 0.0278, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.11% (0.0578 => 0.0596, std.dev.: 0.0189) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.54% (1.1437 => 1.1956, std.dev.: 0.0351) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.03% (0.0627 => 0.0646, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.42% (0.8017 => 0.7823, std.dev.: 0.0264) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: 900.00% (0.0001 => 0.0010, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 500.00% (0.0001 => 0.0006, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 33.87% (0.0062 => 0.0083, std.dev.: 0.0045) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 18:51:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 20:51:12 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121115025112.2DD3E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5878?compare_to=5874&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5878, Order: 167999, Start Time: 2012-11-15 00:40:09, End Time: 2012-11-15 02:51:29 To: 5874, Order: 167974, Start Time: 2012-11-14 21:36:28, End Time: 2012-11-14 23:47:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 47 (134 on baseline) Performance Improvements: 12 (39 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 979 (714 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 16.89% (0.7218 => 0.8437, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.18% (0.1179 => 0.1358, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 14.90% (0.6300 => 0.7239, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 14.84% (0.6705 => 0.7700, std.dev.: 0.0115) MultiSource/Applications/lambda-0_1_3/lambda: 14.68% (0.8543 => 0.9797, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 14.29% (0.6641 => 0.7590, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 14.14% (0.6883 => 0.7856, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 14.01% (0.7568 => 0.8628, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.32% (0.9015 => 1.0216, std.dev.: 0.0114) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.94% (0.3214 => 0.3630, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/except: 12.41% (0.3126 => 0.3514, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.02% (0.4186 => 0.4689, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.45% (0.2104 => 0.2345, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.69% (0.6351 => 0.7030, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.31% (0.7175 => 0.7915, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.23% (0.2581 => 0.2845, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.00% (0.2670 => 0.2937, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.96% (1.8830 => 2.0706, std.dev.: 0.0154) MultiSource/Benchmarks/FreeBench/distray/distray: 9.84% (0.1534 => 0.1685, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.81% (0.7214 => 0.7922, std.dev.: 0.0242) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.65% (1.4747 => 1.6170, std.dev.: 0.0212) SingleSource/Benchmarks/Shootout-C++/hello: 9.63% (0.2948 => 0.3232, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.32% (0.6682 => 0.7305, std.dev.: 0.0089) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.20% (0.2414 => 0.2636, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.16% (0.2894 => 0.3159, std.dev.: 0.0024) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.81% (0.1281 => 0.1381, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.48% (0.6806 => 0.7315, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.85% (1.3189 => 1.4093, std.dev.: 0.0275) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.68% (1.8019 => 1.9222, std.dev.: 0.0103) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.09% (0.4024 => 0.4269, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/gs/gs: 5.50% (4.9953 => 5.2700, std.dev.: 0.0342) SingleSource/UnitTests/ObjC++/property-reference: 5.00% (0.8236 => 0.8648, std.dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 49.09% (4.4112 => 6.5767, std.dev.: 0.4170) SingleSource/UnitTests/ObjC/synchronized: 45.92% (0.1374 => 0.2005, std.dev.: 0.0130) SingleSource/Benchmarks/CoyoteBench/fftbench: 17.70% (2.1087 => 2.4819, std.dev.: 0.0831) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.65% (6.3608 => 7.3560, std.dev.: 0.1559) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 10.19% (0.5329 => 0.5872, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.12% (0.3146 => 0.3370, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 6.71% (3.3690 => 3.5952, std.dev.: 0.0143) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.54% (0.3328 => 0.3479, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 4.53% (6.2446 => 6.5277, std.dev.: 0.0294) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.83% (6.0565 => 6.1671, std.dev.: 0.0192) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.70% (2.3129 => 2.3523, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.29% (1.3350 => 1.3522, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.19% (1.2998 => 1.3153, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.16% (49.1179 => 49.6900, std.dev.: 0.0310) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.04% (3.4749 => 3.5110, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: -11.15% (0.2512 => 0.2232, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -8.58% (0.5522 => 0.5048, std.dev.: 0.0172) MultiSource/Benchmarks/Olden/tsp/tsp: -7.73% (0.1527 => 0.1409, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.27% (2.3783 => 2.3242, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.44% (17.7317 => 17.4764, std.dev.: 0.0754) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: -15.27% (1.5556 => 1.3181, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -7.04% (0.2145 => 0.1994, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: -5.86% (9.0080 => 8.4798, std.dev.: 0.1605) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -5.53% (1.6233 => 1.5336, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -5.22% (0.2414 => 0.2288, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -4.93% (0.3612 => 0.3434, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: -2.68% (1.1332 => 1.1028, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.07% (0.1338 => 0.1337, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0420 => 0.0420, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0650 => 0.0651, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -0.06% (494.1900 => 493.8992, std.dev.: 0.1686) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/power/power: 43697.04% (1.1277 => 493.8992, std.dev.: 0.1686) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.26% (0.5229 => 1.5387, std.dev.: 0.0882) MultiSource/Applications/SPASS/SPASS: 21.61% (14.9895 => 18.2288, std.dev.: 0.1462) MultiSource/Applications/kimwitu++/kc: 48.47% (14.1553 => 21.0170, std.dev.: 0.3704) MultiSource/Benchmarks/MallocBench/gs/gs: 28.21% (4.1105 => 5.2700, std.dev.: 0.0342) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.78% (1.1048 => 1.5112, std.dev.: 0.0805) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 437.75% (7.1582 => 38.4934, std.dev.: 0.0669) SingleSource/Benchmarks/Misc-C++-EH/spirit: 81.46% (3.4629 => 6.2838, std.dev.: 0.1116) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.73% (0.6222 => 1.0312, std.dev.: 0.0672) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10793.06% (0.0720 => 7.8430, std.dev.: 0.1582) MultiSource/Applications/SIBsim4/SIBsim4: 3859900.00% (0.0001 => 3.8600, std.dev.: 0.0423) MultiSource/Applications/SPASS/SPASS: 14659100.00% (0.0001 => 14.6592, std.dev.: 0.4076) MultiSource/Applications/kimwitu++/kc: 53000.00% (0.0001 => 0.0531, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63800.00% (0.0001 => 0.0639, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 577900.00% (0.0001 => 0.5780, std.dev.: 0.0246) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10090900.00% (0.0001 => 10.0910, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6655600.00% (0.0001 => 6.6557, std.dev.: 0.4571) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1804.29% (1.1194 => 21.3166, std.dev.: 0.0930) MultiSource/Applications/ClamAV/clamscan: 70.97% (22.1758 => 37.9137, std.dev.: 0.0573) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 59.78% (2.9384 => 4.6949, std.dev.: 0.3216) MultiSource/Benchmarks/FreeBench/distray/distray: 59.56% (0.1056 => 0.1685, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 59.07% (7.0540 => 11.2205, std.dev.: 0.0251) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.23% (8.1363 => 12.1422, std.dev.: 0.0516) MultiSource/Applications/JM/lencod/lencod: 47.79% (21.9371 => 32.4206, std.dev.: 0.0641) SingleSource/Benchmarks/CoyoteBench/almabench: 38.63% (0.0730 => 0.1012, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: 38.20% (0.1432 => 0.1979, std.dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/n-body: 35.12% (0.0746 => 0.1008, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/voronoi/voronoi: 34.44% (0.2700 => 0.3630, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/treeadd/treeadd: 33.41% (0.0416 => 0.0555, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 31.80% (0.7433 => 0.9797, std.dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 31.59% (0.1032 => 0.1358, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 30.56% (1.5859 => 2.0706, std.dev.: 0.0154) SingleSource/UnitTests/vla: 29.86% (0.0355 => 0.0461, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.26% (0.6675 => 0.8628, std.dev.: 0.0065) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 28.53% (0.1125 => 0.1446, std.dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 28.51% (0.0719 => 0.0924, std.dev.: 0.0005) MultiSource/Benchmarks/llubenchmark/llu: 27.27% (0.0462 => 0.0588, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 26.64% (0.8067 => 1.0216, std.dev.: 0.0114) MultiSource/Benchmarks/Olden/perimeter/perimeter: 26.49% (0.0770 => 0.0974, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 26.23% (0.5569 => 0.7030, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.45% (0.0770 => 0.0966, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 25.28% (0.2271 => 0.2845, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 25.11% (0.2107 => 0.2636, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 24.70% (1.5415 => 1.9222, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 24.66% (0.5860 => 0.7305, std.dev.: 0.0089) MultiSource/Applications/viterbi/viterbi: 24.05% (0.1555 => 0.1929, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 23.94% (0.1892 => 0.2345, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 23.91% (1.3050 => 1.6170, std.dev.: 0.0212) SingleSource/Benchmarks/Stanford/Oscar: 23.58% (0.0636 => 0.0786, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 22.71% (0.6450 => 0.7915, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/08-main/main: 22.44% (0.2554 => 0.3127, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/except: 22.40% (0.2871 => 0.3514, std.dev.: 0.0038) MultiSource/Applications/Burg/burg: 21.88% (1.1642 => 1.4189, std.dev.: 0.0492) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.64% (14.3668 => 17.4764, std.dev.: 0.0754) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.39% (0.1566 => 0.1901, std.dev.: 0.0104) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 21.36% (0.2603 => 0.3159, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 20.86% (0.2430 => 0.2937, std.dev.: 0.0041) SingleSource/UnitTests/2006-12-11-LoadConstants: 20.82% (0.1143 => 0.1381, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.64% (0.1584 => 0.1911, std.dev.: 0.0101) MultiSource/Applications/minisat/minisat: 20.04% (0.7115 => 0.8541, std.dev.: 0.0387) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.96% (0.1117 => 0.1340, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/tsp/tsp: 19.91% (0.1175 => 0.1409, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.89% (0.4615 => 0.5533, std.dev.: 0.0177) MultiSource/Benchmarks/MallocBench/espresso/espresso: 19.79% (4.2646 => 5.1087, std.dev.: 0.0532) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.69% (2.2024 => 2.6361, std.dev.: 0.1344) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.16% (0.3935 => 0.4689, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hello: 19.09% (0.2714 => 0.3232, std.dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: 19.00% (9.4845 => 11.2868, std.dev.: 0.0381) SingleSource/Benchmarks/Shootout-C++/sieve: 18.93% (0.3603 => 0.4285, std.dev.: 0.0124) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.82% (1.1861 => 1.4093, std.dev.: 0.0275) SingleSource/UnitTests/ObjC++/property-reference: 18.05% (0.7326 => 0.8648, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 17.42% (3.8922 => 4.5702, std.dev.: 0.1125) MultiSource/Applications/sqlite3/sqlite3: 17.18% (17.1811 => 20.1329, std.dev.: 0.2182) MultiSource/Applications/d/make_dparser: 17.13% (3.3354 => 3.9068, std.dev.: 0.1103) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.96% (0.8172 => 0.9558, std.dev.: 0.0383) MultiSource/Applications/lua/lua: 16.87% (3.8723 => 4.5255, std.dev.: 0.1671) MultiSource/Applications/oggenc/oggenc: 16.87% (5.7591 => 6.7304, std.dev.: 0.2534) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.73% (4.9449 => 5.7722, std.dev.: 0.1318) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.73% (5.0018 => 5.8386, std.dev.: 0.1182) MultiSource/Benchmarks/VersaBench/bmm/bmm: 16.47% (0.0759 => 0.0884, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/matrix: 16.26% (0.0818 => 0.0951, std.dev.: 0.0048) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.16% (0.0953 => 0.1107, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.14% (0.0886 => 0.1029, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/ReedSolomon: 15.86% (0.2049 => 0.2374, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/methcall: 15.40% (0.2877 => 0.3320, std.dev.: 0.0158) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.11% (0.0834 => 0.0960, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.05% (0.1940 => 0.2232, std.dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: 14.92% (10.3673 => 11.9145, std.dev.: 0.0227) SingleSource/Benchmarks/Shootout-C++/fibo: 14.68% (0.2725 => 0.3125, std.dev.: 0.0151) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.49% (0.0704 => 0.0806, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.35% (0.3121 => 0.3569, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.99% (0.1337 => 0.1524, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.96% (0.5981 => 0.6816, std.dev.: 0.0270) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.90% (0.1029 => 0.1172, std.dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: 13.83% (63.2438 => 71.9893, std.dev.: 0.2675) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.40% (0.5105 => 0.5789, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.28% (0.3441 => 0.3898, std.dev.: 0.0101) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.25% (0.1510 => 0.1710, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.49% (0.3516 => 0.3955, std.dev.: 0.0157) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.42% (0.3543 => 0.3983, std.dev.: 0.0160) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.05% (0.8101 => 0.9077, std.dev.: 0.0196) SingleSource/UnitTests/ObjC/block-byref-aggr: 11.84% (0.3817 => 0.4269, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.68% (0.1695 => 0.1893, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.23% (0.1906 => 0.2120, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/football/football: 10.38% (0.8921 => 0.9847, std.dev.: 0.0195) MultiSource/Benchmarks/sim/sim: 10.13% (0.3387 => 0.3730, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.01% (7.9617 => 8.4404, std.dev.: 0.0380) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.54% (2.2022 => 2.3242, std.dev.: 0.0086) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.79% (4.3953 => 11.0230, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/methcall: 147.67% (5.3999 => 13.3740, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/synchronized: 90.77% (0.1051 => 0.2005, std.dev.: 0.0130) MultiSource/Benchmarks/llubenchmark/llu: 74.07% (3.7781 => 6.5767, std.dev.: 0.4170) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 24.94% (13.4384 => 16.7896, std.dev.: 0.3447) MultiSource/Applications/minisat/minisat: 22.95% (9.1159 => 11.2079, std.dev.: 0.2159) SingleSource/Benchmarks/CoyoteBench/fftbench: 21.90% (2.0360 => 2.4819, std.dev.: 0.0831) MultiSource/Benchmarks/Olden/perimeter/perimeter: 18.17% (0.2944 => 0.3479, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 18.02% (1.1145 => 1.3153, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 17.54% (6.6465 => 7.8126, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 13.85% (3.1578 => 3.5952, std.dev.: 0.0143) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.53% (10.3460 => 11.7456, std.dev.: 0.4575) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.76% (2.8904 => 3.2302, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 10.27% (1.1396 => 1.2566, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.03% (8.6802 => 9.5510, std.dev.: 0.2192) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.77% (0.3070 => 0.3370, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.30% (1.7254 => 1.8859, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.94% (0.9540 => 1.0107, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.72% (3.1334 => 3.3126, std.dev.: 0.0173) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.69% (4.2280 => 4.4684, std.dev.: 0.0085) SingleSource/Regression/C/uint64_to_float: 5.10% (0.5413 => 0.5689, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 5.09% (26.0924 => 27.4202, std.dev.: 0.2065) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.59% (3.6395 => 3.8064, std.dev.: 0.0280) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.6436 => 12.1224, std.dev.: 0.0132) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.36% (0.4162 => 0.4302, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.93% (2.1424 => 2.2051, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.67% (1.2838 => 1.3181, std.dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: 2.62% (2.4116 => 2.4749, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.53% (1.7133 => 1.7566, std.dev.: 0.0162) MultiSource/Benchmarks/Olden/tsp/tsp: 2.25% (1.0785 => 1.1028, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 2.24% (85.0658 => 86.9704, std.dev.: 0.0484) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.16% (1.3677 => 1.3973, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 2.06% (3.1595 => 3.2247, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.68% (2.3135 => 2.3523, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 1.55% (27.8444 => 28.2773, std.dev.: 0.0247) SingleSource/Benchmarks/Shootout-C++/lists: 1.52% (12.5348 => 12.7253, std.dev.: 0.0128) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.43% (6.5088 => 6.6016, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout/sieve: 1.32% (5.2139 => 5.2825, std.dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0501, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 1.12% (2.4858 => 2.5136, std.dev.: 0.0102) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.51% (6.6874 => 0.1666, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.62% (5.2763 => 1.2334, std.dev.: 0.0632) SingleSource/Benchmarks/Misc/salsa20: -75.61% (0.8651 => 0.2110, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/richards_benchmark: -44.82% (0.1622 => 0.0895, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.97% (5.3855 => 4.7409, std.dev.: 0.1460) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.05% (5.3526 => 4.8147, std.dev.: 0.1318) MultiSource/Applications/JM/ldecod/ldecod: -6.88% (10.4361 => 9.7176, std.dev.: 0.0842) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.52% (0.0628 => 0.0361, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.92% (0.0506 => 0.0304, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.85% (0.3987 => 0.2398, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.30% (4.5009 => 2.7770, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.09% (2.6546 => 2.0152, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -20.83% (10.7105 => 8.4798, std.dev.: 0.1605) MultiSource/Benchmarks/FreeBench/mason/mason: -19.11% (0.2161 => 0.1748, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.69% (1.6925 => 1.4270, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.72% (2.6778 => 2.2837, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.70% (32.5116 => 29.0340, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -10.28% (9.5636 => 8.5806, std.dev.: 0.0871) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.44% (1.5660 => 1.4338, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4789, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.52% (3.2416 => 3.0304, std.dev.: 0.0252) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.54% (2.7294 => 2.5781, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.63% (1.5835 => 1.5102, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -4.13% (6.2999 => 6.0397, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.95% (19.9488 => 19.1616, std.dev.: 0.2291) MultiSource/Benchmarks/sim/sim: -3.00% (5.0483 => 4.8968, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.86% (0.9957 => 0.9672, std.dev.: 0.0089) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.31% (0.4808 => 0.4697, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.90% (8.1563 => 8.0016, std.dev.: 0.0170) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6774, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -1.47% (10.2830 => 10.1322, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.97% (0.1485 => 0.1337, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0020) Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 18:54:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 20:54:48 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121115025448.C4BC32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5879?compare_to=5872&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5879, Order: 167991, Start Time: 2012-11-14 23:39:21, End Time: 2012-11-15 02:55:03 To: 5872, Order: 167942, Start Time: 2012-11-14 19:33:11, End Time: 2012-11-14 22:49:03 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (173 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (717 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.50% (2.4354 => 2.3745, std.dev.: 0.0107) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.08% (0.0625 => 0.0888, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.21% (0.1063 => 0.1416, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 26.64% (1.5932 => 2.0177, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.04% (0.2969 => 0.3742, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.91% (0.0714 => 0.0899, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.89% (0.4253 => 0.5354, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.59% (0.1106 => 0.1389, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.76% (0.4139 => 0.5164, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.08% (0.5000 => 0.6204, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.93% (0.4994 => 0.6189, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.83% (0.5900 => 0.7306, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.79% (0.0475 => 0.0588) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.40% (0.0547 => 0.0675, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.95% (0.0584 => 0.0718, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.84% (0.1620 => 0.1990, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.43% (0.1021 => 0.1250, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.13% (0.1107 => 0.1352, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 22.04% (0.0599 => 0.0731, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.85% (0.0897 => 0.1093, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.48% (0.0633 => 0.0769, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.18% (0.0642 => 0.0778, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.06% (0.0584 => 0.0707, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 20.99% (0.0948 => 0.1147, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.80% (0.0822 => 0.0993, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 20.71% (0.0821 => 0.0991, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.70% (0.0541 => 0.0653, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.67% (0.1103 => 0.1331, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.59% (0.1549 => 0.1868, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.45% (0.3903 => 0.4701, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 20.44% (0.1619 => 0.1950, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.40% (0.0495 => 0.0596, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.34% (0.1003 => 0.1207, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.01% (0.1604 => 0.1925, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 19.54% (0.0947 => 0.1132, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 19.34% (0.5826 => 0.6953, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.15% (0.1462 => 0.1742, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 18.98% (0.5889 => 0.7007, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.92% (0.2014 => 0.2395, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.82% (0.2736 => 0.3251, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 18.80% (0.1218 => 0.1447) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.79% (0.3890 => 0.4621, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 18.69% (0.0808 => 0.0959, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 18.59% (0.4029 => 0.4778, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.29% (1.3152 => 1.5558, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.23% (0.2875 => 0.3399, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 18.05% (0.0698 => 0.0824, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.92% (0.1088 => 0.1283, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 17.81% (0.1505 => 0.1773, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.71% (3.5627 => 4.1938, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.69% (0.2866 => 0.3373, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.66% (0.0572 => 0.0673, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 17.65% (0.2714 => 0.3193, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 17.58% (0.2725 => 0.3204, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 17.51% (0.3004 => 0.3530) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.49% (0.2738 => 0.3217, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.49% (1.6211 => 1.9047, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.48% (0.2729 => 0.3206, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 17.47% (0.5546 => 0.6515, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.43% (0.1968 => 0.2311, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 17.42% (0.2750 => 0.3229, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 17.37% (0.1284 => 0.1507, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 17.36% (1.8794 => 2.2057, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/matrix: 17.34% (0.2780 => 0.3262, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 17.23% (0.2803 => 0.3286, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 17.17% (0.2813 => 0.3296, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.16% (0.2792 => 0.3271, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 17.14% (0.2823 => 0.3307, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.14% (0.2911 => 0.3410, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 17.08% (0.2811 => 0.3291, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.07% (0.3930 => 0.4601, std.dev.: 0.0027) MultiSource/Applications/hbd/hbd: 17.06% (0.9697 => 1.1351, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.03% (0.5026 => 0.5882, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.00% (0.3271 => 0.3827, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.94% (2.0673 => 2.4174, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.90% (0.4658 => 0.5445, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 16.88% (0.9909 => 1.1582, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 16.86% (0.3096 => 0.3618, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 16.86% (0.0605 => 0.0707, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 16.75% (0.7171 => 0.8372, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.74% (0.3195 => 0.3730, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 16.71% (1.0781 => 1.2582, std.dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: 16.67% (23.5202 => 27.4412, std.dev.: 0.0159) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.64% (0.1160 => 0.1353, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 16.61% (0.1421 => 0.1657, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 16.50% (0.3267 => 0.3806, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 16.42% (0.3258 => 0.3793, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 16.28% (0.3317 => 0.3857, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.23% (0.4361 => 0.5069, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.12% (0.3362 => 0.3904, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.11% (2.7292 => 3.1690, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.01% (4.4195 => 5.1272, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.95% (0.3060 => 0.3548, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 15.80% (4.2109 => 4.8764, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/moments: 15.72% (0.3678 => 0.4256, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.69% (0.3124 => 0.3614, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists: 15.68% (0.3348 => 0.3873, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.60% (0.1090 => 0.1260, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 15.59% (0.3477 => 0.4019, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.57% (1.9694 => 2.2760, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.54% (0.3282 => 0.3792, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.52% (1.9966 => 2.3065, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.45% (0.3845 => 0.4439, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 15.30% (0.3726 => 0.4296, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.20% (0.3625 => 0.4176, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 15.12% (0.4146 => 0.4773, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 15.08% (0.4251 => 0.4892, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 15.00% (0.3446 => 0.3963, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.95% (0.3465 => 0.3983, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 14.93% (0.3496 => 0.4018, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 14.91% (0.3460 => 0.3976, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 14.90% (0.3469 => 0.3986, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.88% (0.3488 => 0.4007, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 14.88% (0.3442 => 0.3954, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 14.85% (0.2566 => 0.2947, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.82% (0.3690 => 0.4237, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.82% (0.3981 => 0.4571, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 14.63% (0.3650 => 0.4184, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: 14.46% (0.2075 => 0.2375, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 14.44% (0.3643 => 0.4169, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 14.39% (1.4269 => 1.6323, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/parameter-passing: 14.21% (0.3724 => 0.4253, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 13.99% (0.5012 => 0.5713, std.dev.: 0.0022) MultiSource/Applications/treecc/treecc: 13.87% (0.7875 => 0.8967, std.dev.: 0.0064) MultiSource/Applications/SIBsim4/SIBsim4: 13.86% (0.2691 => 0.3064, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 13.67% (2.1653 => 2.4614, std.dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 13.49% (4.6177 => 5.2404, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 12.99% (2.1013 => 2.3743, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.71% (0.6435 => 0.7253, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.65% (0.2040 => 0.2298, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 12.40% (5.5417 => 6.2289, std.dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: 12.32% (0.3498 => 0.3929, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.48% (0.1028 => 0.1146, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.40% (0.2737 => 0.3049, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.36% (0.2068 => 0.2303, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 11.21% (0.3336 => 0.3710, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 10.99% (0.6634 => 0.7363, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.89% (0.3084 => 0.3420, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 10.75% (0.4847 => 0.5368, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 10.54% (0.2391 => 0.2643, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.41% (0.1383 => 0.1527, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.99% (0.2103 => 0.2313, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 9.83% (2.0346 => 2.2346, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.02% (4.6926 => 5.1160, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.79% (11.6398 => 12.6634, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.51% (0.5361 => 0.5817, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.18% (0.5584 => 0.6041, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.07% (0.7426 => 0.8025, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 7.43% (11.9555 => 12.8434, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.43% (0.3792 => 0.3998, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 8.53% (0.2802 => 0.3041, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6115, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.07% (0.3693 => 0.3917, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary: 5.89% (0.2122 => 0.2247, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6724, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-2: 4.81% (1.8057 => 1.8925, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1722, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/dry: 4.14% (14.0481 => 14.6296, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2052, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.54% (3.1722 => 3.2211, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.49% (7.1849 => 7.2919, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3061, std.dev.: 0.0145) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.33% (1.0142 => 1.0277, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5123, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5878, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.11% (2.4764 => 2.3745, std.dev.: 0.0107) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.91% (25.4195 => 16.5461, std.dev.: 0.0239) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9739, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7877, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/ary2: -7.29% (0.2402 => 0.2227, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8022, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.05% (0.6293 => 0.6101, std.dev.: 0.0031) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: -2.38% (17.2379 => 16.8274, std.dev.: 0.0459) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8632, std.dev.: 0.0106) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5775, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4978, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0410, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.05% (105.3826 => 104.2729, std.dev.: 0.0368) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 3.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 19:20:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 21:20:29 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121115032029.BDB9C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5880?compare_to=5876&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5880, Order: 168016, Start Time: 2012-11-15 01:55:38, End Time: 2012-11-15 03:20:45 To: 5876, Order: 167999, Start Time: 2012-11-15 00:07:22, End Time: 2012-11-15 01:32:26 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (4 on baseline) Performance Improvements: 0 (177 on baseline) Unchanged Tests: 1040 (861 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.66% (2.0496 => 2.0836, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: 1.32% (1.5004 => 1.5202, std.dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: 2.59% (7.4937 => 7.6880, std.dev.: 0.0176) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.56% (2.0478 => 2.1002, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/hash2: 2.22% (3.1932 => 3.2640, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.90% (0.3821 => 0.3519, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -6.76% (0.3831 => 0.3572, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.75% (0.3880 => 0.3618, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -6.74% (0.3812 => 0.3555, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.72% (0.3896 => 0.3634, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.70% (0.3848 => 0.3590, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -6.68% (2.4924 => 2.3258, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: -6.60% (0.4033 => 0.3767) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.59% (0.3884 => 0.3628, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.53% (0.9542 => 0.8919, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.45% (0.3891 => 0.3640, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.40% (0.3357 => 0.3142, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: -6.35% (0.4176 => 0.3911, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.26% (0.2428 => 0.2276, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/property: -6.22% (0.4199 => 0.3938, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.07% (9.2283 => 8.6678, std.dev.: 0.0129) MultiSource/Applications/JM/lencod/lencod: -6.05% (16.1920 => 15.2116, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.01% (0.1796 => 0.1688, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.98% (0.6484 => 0.6096, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: -5.96% (0.1879 => 0.1767, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -5.95% (7.0961 => 6.6741, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.93% (1.0544 => 0.9919, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.81% (1.3722 => 1.2925, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.80% (0.9852 => 0.9281, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -5.79% (0.4280 => 0.4032, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/oourafft: -5.79% (0.2160 => 0.2035, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -5.77% (0.9179 => 0.8649, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.77% (0.3658 => 0.3447, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.68% (0.2695 => 0.2542, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.67% (0.7198 => 0.6790, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.66% (6.7716 => 6.3884, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.62% (4.8161 => 4.5456, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.61% (1.4642 => 1.3821, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.58% (3.5339 => 3.3367, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.58% (1.6364 => 1.5451, std.dev.: 0.0110) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.57% (1.2300 => 1.1615, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.56% (0.5591 => 0.5280, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.53% (0.5478 => 0.5175, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.51% (0.6736 => 0.6365, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.50% (4.8802 => 4.6116, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.50% (0.5857 => 0.5535, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.48% (4.0323 => 3.8112, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.48% (0.7524 => 0.7112, std.dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: -5.47% (17.1032 => 16.1676, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.46% (0.6681 => 0.6316, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -5.45% (1.1450 => 1.0826, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: -5.44% (4.3330 => 4.0971, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.44% (14.2083 => 13.4357, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.43% (0.6260 => 0.5920, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.43% (0.5805 => 0.5490, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.41% (0.6667 => 0.6306, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.41% (0.6230 => 0.5893, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.41% (0.6194 => 0.5859, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.40% (0.3406 => 0.3222, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.39% (0.6304 => 0.5964, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.38% (0.7339 => 0.6944, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.37% (0.3483 => 0.3296, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -5.33% (0.2985 => 0.2826, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.32% (4.5069 => 4.2672, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.30% (0.6660 => 0.6307, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.29% (0.6446 => 0.6105, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.29% (0.6676 => 0.6323, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.29% (0.6052 => 0.5732, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.27% (0.6395 => 0.6058, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.26% (0.8521 => 0.8073, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.26% (1.2784 => 1.2112, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.25% (0.5925 => 0.5614, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.23% (0.5941 => 0.5630, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.23% (0.5567 => 0.5276, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.22% (0.6297 => 0.5968, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.22% (0.6395 => 0.6061, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.22% (0.6440 => 0.6104, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.21% (0.5581 => 0.5290, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: -5.19% (1.3864 => 1.3144, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.19% (0.5569 => 0.5280, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.19% (0.5859 => 0.5555, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.19% (0.5705 => 0.5409, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.19% (0.5802 => 0.5501, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.19% (0.5456 => 0.5173, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -5.18% (1.2515 => 1.1867, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.18% (0.7919 => 0.7509, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/05-eks/eks: -5.16% (0.4515 => 0.4282, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.15% (0.5570 => 0.5283, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.15% (0.5863 => 0.5561, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.13% (0.5575 => 0.5289, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.12% (1.2221 => 1.1595, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.11% (0.5849 => 0.5550, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.11% (0.4916 => 0.4665, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.10% (0.5999 => 0.5693, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.08% (8.0126 => 7.6057, std.dev.: 0.0075) MultiSource/Applications/SPASS/SPASS: -5.07% (15.5079 => 14.7224, std.dev.: 0.0158) MultiSource/Applications/d/make_dparser: -5.05% (3.5154 => 3.3377, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: -5.04% (0.2659 => 0.2525, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.04% (0.6033 => 0.5729, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.02% (0.2548 => 0.2420, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.00% (0.2278 => 0.2164, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -5.00% (15.2527 => 14.4894, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.00% (1.2210 => 1.1600, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.99% (0.6293 => 0.5979, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.98% (0.5688 => 0.5405, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -4.86% (0.7447 => 0.7085, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -4.83% (0.3581 => 0.3408, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: -4.81% (1.1530 => 1.0975, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.80% (0.2999 => 0.2855, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.79% (0.3319 => 0.3160, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.78% (0.2385 => 0.2271, std.dev.: 0.0025) MultiSource/Applications/lua/lua: -4.75% (4.0594 => 3.8665, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.68% (0.5168 => 0.4926, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.68% (1.6474 => 1.5703, std.dev.: 0.0066) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.68% (22.4056 => 21.3575, std.dev.: 0.0152) MultiSource/Applications/hexxagon/hexxagon: -4.56% (1.3148 => 1.2549, std.dev.: 0.0067) MultiSource/Applications/treecc/treecc: -4.53% (2.1401 => 2.0432, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.50% (0.7021 => 0.6705, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.48% (5.0226 => 4.7974, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.41% (0.5329 => 0.5094, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.38% (0.4151 => 0.3969, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -4.38% (2.4021 => 2.2968, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/09-vor/vor: -4.31% (0.3271 => 0.3130, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: -4.28% (0.7779 => 0.7446, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.27% (0.3837 => 0.3673, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: -4.26% (0.8418 => 0.8059, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.22% (0.3931 => 0.3765, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -4.17% (0.3025 => 0.2899, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: -4.13% (0.3194 => 0.3062, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -4.09% (0.4861 => 0.4662, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.08% (0.3849 => 0.3692, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.04% (2.1713 => 2.0836, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: -4.00% (34.0927 => 32.7285, std.dev.: 0.0147) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.00% (0.9557 => 0.9175, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: -3.99% (18.2933 => 17.5634, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/matrix: -3.96% (0.3255 => 0.3126, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -3.96% (0.6441 => 0.6186, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.96% (0.3057 => 0.2936, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.95% (0.6347 => 0.6096, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -3.91% (0.2939 => 0.2824, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.91% (0.3252 => 0.3125, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.88% (0.3016 => 0.2899, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.87% (0.9077 => 0.8726, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/fibo: -3.87% (0.2871 => 0.2760, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.85% (0.2933 => 0.2820, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -3.80% (0.3867 => 0.3720, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.80% (2.2587 => 2.1729, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -3.78% (0.3621 => 0.3484, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.74% (0.4813 => 0.4633, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: -3.73% (0.3059 => 0.2945, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -3.72% (0.2849 => 0.2743, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.72% (0.2903 => 0.2795, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: -3.72% (0.4248 => 0.4090, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -3.71% (0.3481 => 0.3352, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -3.68% (0.2989 => 0.2879, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -3.67% (0.3026 => 0.2915, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.67% (0.3491 => 0.3363, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.65% (0.4083 => 0.3934, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: -3.63% (0.3446 => 0.3321, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -3.62% (0.3394 => 0.3271, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -3.59% (0.3205 => 0.3090, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -3.56% (0.4524 => 0.4363, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: -3.47% (0.6750 => 0.6516, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.31% (0.3323 => 0.3213, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.25% (0.4427 => 0.4283, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.18% (5.4682 => 5.2945, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sieve: -3.06% (0.3788 => 0.3672, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.99% (0.4321 => 0.4192, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -2.70% (20.7746 => 20.2147, std.dev.: 0.0030) MultiSource/Applications/hbd/hbd: -2.61% (1.5610 => 1.5202, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7551, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/richards_benchmark: -8.60% (1.2842 => 1.1737, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7069, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.83% (2.2633 => 2.1767, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.05% (1.0557 => 1.0235, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.53% (1.3096 => 1.2765, std.dev.: 0.0116) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.66% (6.5735 => 6.4641, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0006) Report Time: 2.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 19:30:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 21:30:33 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121115033033.8106F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5881?compare_to=5877&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5881, Order: 168017, Start Time: 2012-11-15 02:01:50, End Time: 2012-11-15 03:30:48 To: 5877, Order: 167999, Start Time: 2012-11-15 00:10:43, End Time: 2012-11-15 01:44:17 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 6 (48 on baseline) Performance Improvements: 54 (22 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 932 (904 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MallocBench/gs/gs: 17.28% (0.0758 => 0.0889, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.74% (1.3412 => 1.4182, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.89% (2.6747 => 2.7519, std.dev.: 0.0153) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.96% (13.2830 => 13.5440, std.dev.: 0.0838) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.92% (1.4200 => 1.4473, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 1.13% (7.8291 => 7.9178, std.dev.: 0.0129) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/DuffsDevice: -40.27% (0.0370 => 0.0221, std.dev.: 0.0001) SingleSource/Regression/C/compare: -39.24% (0.0344 => 0.0209, std.dev.: 0.0003) SingleSource/Regression/C/matrixTranspose: -38.07% (0.0394 => 0.0244, std.dev.: 0.0006) SingleSource/Regression/C++/BuiltinTypeInfo: -37.68% (0.0276 => 0.0172, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -37.17% (0.0495 => 0.0311, std.dev.: 0.0003) SingleSource/Regression/C/badidx: -31.37% (0.0322 => 0.0221, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/FloatMM: -19.43% (0.0525 => 0.0423, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -16.42% (0.1163 => 0.0972, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -14.02% (0.1691 => 0.1454, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -10.73% (0.0932 => 0.0832, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: -9.86% (0.2484 => 0.2239, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: -8.78% (0.9138 => 0.8336, std.dev.: 0.0256) SingleSource/Benchmarks/Shootout-C++/except: -7.85% (0.2241 => 0.2065, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary3: -7.84% (0.2704 => 0.2492, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.96% (0.2514 => 0.2339, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/ary2: -6.55% (0.2746 => 0.2566, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.31% (2.3560 => 2.2073, std.dev.: 0.0199) MultiSource/Benchmarks/mafft/pairlocalalign: -6.27% (9.3704 => 8.7829, std.dev.: 0.1575) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.11% (0.2291 => 0.2151, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.93% (1.7727 => 1.6676, std.dev.: 0.0314) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.92% (0.2093 => 0.1969, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: -5.64% (0.4414 => 0.4165, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: -5.47% (0.4061 => 0.3839, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.39% (1.2526 => 1.1851, std.dev.: 0.0226) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.02% (0.2032 => 0.1930, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.00% (14.1679 => 13.4594, std.dev.: 0.1729) SingleSource/Benchmarks/Shootout-C++/methcall: -4.71% (0.2187 => 0.2084, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.57% (0.8940 => 0.8531, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.28% (0.4907 => 0.4697, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sieve: -3.99% (0.2930 => 0.2813, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.40% (0.3914 => 0.3781, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.07% (0.3906 => 0.3786, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.15% (5.5552 => 5.4359, std.dev.: 0.0303) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.52% (0.7099 => 0.6991, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/lpbench: -22.99% (5.0720 => 3.9059, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout/heapsort: -21.58% (3.8486 => 3.0180, std.dev.: 0.1873) MultiSource/Applications/JM/ldecod/ldecod: -21.20% (0.0830 => 0.0654, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/heapsort: -16.65% (3.6656 => 3.0554, std.dev.: 0.2096) SingleSource/Benchmarks/Shootout-C++/ackermann: -13.14% (4.3696 => 3.7956, std.dev.: 0.1687) SingleSource/Benchmarks/Shootout-C++/ary3: -8.99% (2.2084 => 2.0099, std.dev.: 0.0491) SingleSource/Benchmarks/Shootout/ary3: -6.66% (2.2374 => 2.0884, std.dev.: 0.0150) SingleSource/Benchmarks/Stanford/Puzzle: -6.11% (0.1800 => 0.1690, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.15% (2.7086 => 2.5961, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -3.83% (3.0557 => 2.9388, std.dev.: 0.0408) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.11% (42.2579 => 40.9421, std.dev.: 0.4841) SingleSource/Benchmarks/Misc/mandel-2: -2.73% (2.9725 => 2.8913, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.69% (3.2556 => 3.1679, std.dev.: 0.0314) SingleSource/Benchmarks/Shootout/hash: -1.95% (4.3550 => 4.2702, std.dev.: 0.0273) SingleSource/Regression/C/uint64_to_float: -1.87% (1.6940 => 1.6624, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.63% (7.3367 => 7.2174, std.dev.: 0.0231) SingleSource/Benchmarks/Misc/flops-5: -1.38% (2.9363 => 2.8957, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/lists: -1.38% (16.9921 => 16.7583, std.dev.: 0.0861) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.38% (4.1156 => 4.0590, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.03% (1.4657 => 1.4506, std.dev.: 0.0046) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.11% (16.9201 => 16.9389, std.dev.: 0.8617) MultiSource/Applications/obsequi/Obsequi: -0.42% (1.0621 => 1.0576, std.dev.: 0.2628) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.74% (22.4102 => 22.2448, std.dev.: 0.2702) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.87% (0.3744 => 0.3674, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: -4.67% (0.6399 => 0.6100, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.98% (0.3492 => 0.3353, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/strcat: -5.80% (0.2137 => 0.2013, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.11% (0.0225 => 0.0218, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.60% (0.0438 => 0.0431, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.77% (0.0339 => 0.0333, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.56% (0.0321 => 0.0316) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.70% (0.0428 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -0.97% (0.0206 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -2.68% (0.0224 => 0.0218, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.13% (0.1501 => 0.1499, std.dev.: 0.0178) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -3.19% (1.2274 => 1.1882, std.dev.: 0.2702) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.12% (0.4188 => 0.4235, std.dev.: 0.1257) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.87% (0.1381 => 0.1462, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.65% (0.0618 => 0.0614, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.79% (0.0278 => 0.0248, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.87% (0.0596 => 0.0567, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.33% (1.1956 => 1.1995, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -45.16% (0.0031 => 0.0017, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -25.93% (0.0027 => 0.0020, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.97% (0.0646 => 0.0601, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -24.06% (0.0266 => 0.0202, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.08% (0.7823 => 0.7817, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: -90.00% (0.0010 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 13.25% (0.0083 => 0.0094, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2326.91% (0.6332 => 15.3672, std.dev.: 0.6528) MultiSource/Benchmarks/McCat/08-main/main: 52.81% (0.1831 => 0.2798, std.dev.: 0.0364) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.12% (0.1559 => 0.1448, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1525.57% (0.3344 => 5.4359, std.dev.: 0.0303) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.73% (0.2364 => 0.3256, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: 0.23% (0.0429 => 0.0430, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.70% (0.0224 => 0.0239, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0000) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 11.90% (0.1462 => 0.1636, std.dev.: 0.0266) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4642, std.dev.: 0.1212) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0704, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4896, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3167, std.dev.: 0.0347) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1323, std.dev.: 0.0265) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4078, std.dev.: 0.0033) SingleSource/Regression/C/uint64_to_float: -23.85% (2.1832 => 1.6624, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 7.20% (0.3137 => 0.3363, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.26% (0.1885 => 0.2003, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.49% (0.9435 => 0.9859, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.23% (0.5817 => 0.6063, std.dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.53% (0.4783 => 0.4952, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.53% (0.3115 => 0.3225, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.47% (0.8611 => 0.8910, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.39% (0.3657 => 0.3781, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.14% (2.1401 => 2.2073, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.13% (0.8338 => 0.8599, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.03% (0.4559 => 0.4697, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.54% (0.9688 => 0.9934, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.29% (0.8340 => 0.8531, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.15% (0.8716 => 0.8903, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.09% (0.9056 => 0.9245, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.93% (0.6586 => 0.6713, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (3.1832 => 3.2412, std.dev.: 0.0221) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 110.05% (0.0199 => 0.0418, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/pi: 57.27% (1.5795 => 2.4841, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.01% (0.7597 => 0.8889, std.dev.: 0.0466) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.33% (2.9753 => 3.4613, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.71% (2.7995 => 3.2113, std.dev.: 0.0280) MultiSource/Benchmarks/MallocBench/gs/gs: 12.82% (0.0788 => 0.0889, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6092, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.10% (0.3186 => 0.3476, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.05% (1.1857 => 1.2812, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 7.18% (1.7056 => 1.8281, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.72% (4.7794 => 5.1006, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/richards_benchmark: 6.10% (1.3037 => 1.3832, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.90% (4.5327 => 4.8000, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 5.67% (7.4933 => 7.9178, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.68% (3.3761 => 3.5342, std.dev.: 0.0314) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.61% (6.2275 => 6.5143, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.19% (4.9453 => 5.1525, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.02% (4.9469 => 5.1459, std.dev.: 0.0245) MultiSource/Applications/hexxagon/hexxagon: 3.92% (14.0064 => 14.5559, std.dev.: 0.1171) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.68% (11.5690 => 11.8786, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.52% (8.2783 => 8.4870, std.dev.: 0.0131) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.48% (4.8362 => 4.9562, std.dev.: 0.0317) SingleSource/Benchmarks/Shootout/lists: 2.45% (7.3375 => 7.5170, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/except: 2.26% (0.4921 => 0.5032, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 2.09% (2.8561 => 2.9157, std.dev.: 0.0158) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.89% (1.4205 => 1.4473, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.74% (1.1365 => 1.1563, std.dev.: 0.0023) SingleSource/Benchmarks/Stanford/FloatMM: 1.58% (0.8807 => 0.8946, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.41% (1.5941 => 1.6165, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 1.40% (7.1181 => 7.2174, std.dev.: 0.0231) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.20% (3.5679 => 3.6107, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.76% (5.4641 => 4.3295, std.dev.: 0.0512) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.91% (7.2130 => 6.1375, std.dev.: 0.0922) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.36% (1.0512 => 0.9318, std.dev.: 0.0311) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.81% (0.3269 => 0.2981, std.dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: -8.48% (63.1822 => 57.8254, std.dev.: 0.4722) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.52% (14.6451 => 13.5440, std.dev.: 0.0838) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.84% (4.7482 => 4.4233, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.19% (3.7148 => 3.4848, std.dev.: 0.0436) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.88% (5.4972 => 5.1741, std.dev.: 0.0424) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.20% (5.1557 => 4.8874, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.49% (4.7449 => 4.5317, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.89% (6.0224 => 5.7882, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.70% (2.8773 => 2.7708, std.dev.: 0.0281) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.35% (2.4490 => 2.3669, std.dev.: 0.0292) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.24% (0.5807 => 0.5619, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.00% (28.5821 => 27.7253, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/hash2: -2.30% (3.4237 => 3.3449, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.17% (9.9065 => 9.6919, std.dev.: 0.0518) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.96% (11.5316 => 11.3053, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.57% (4.9994 => 4.9209, std.dev.: 0.0273) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.49% (2.3487 => 2.3136, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.18% (5.6343 => 5.5677, std.dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 3.00% (16.4461 => 16.9389, std.dev.: 0.8617) MultiSource/Applications/obsequi/Obsequi: 3.06% (1.0262 => 1.0576, std.dev.: 0.2628) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7022.89% (0.3123 => 22.2448, std.dev.: 0.2702) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.17% (0.2463 => 0.3674, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 1.50% (0.6010 => 0.6100, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.66% (0.3266 => 0.3353, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/strcat: 2.23% (0.1969 => 0.2013, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.64% (0.0408 => 0.0431, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.24% (0.1438 => 0.1499, std.dev.: 0.0178) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 4.88% (1.1329 => 1.1882, std.dev.: 0.2702) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.71% (0.4164 => 0.4235, std.dev.: 0.1257) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.79% (0.1369 => 0.1462, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.21% (0.0641 => 0.0614, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 27.18% (0.0195 => 0.0248, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.90% (0.0578 => 0.0567, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.88% (1.1437 => 1.1995, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1600.00% (0.0001 => 0.0017, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 42.86% (0.0014 => 0.0020, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.15% (0.0627 => 0.0601, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 12.22% (0.0180 => 0.0202, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.49% (0.8017 => 0.7817, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 51.61% (0.0062 => 0.0094, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 3.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 21:08:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 23:08:27 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121115050827.46B802A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5882?compare_to=5880&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5882, Order: 168021, Start Time: 2012-11-15 03:43:42, End Time: 2012-11-15 05:08:45 To: 5880, Order: 168016, Start Time: 2012-11-15 01:55:38, End Time: 2012-11-15 03:20:45 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 2 (177 on baseline) Unchanged Tests: 1039 (861 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.72% (41.8181 => 42.9555, std.dev.: 0.0137) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.03% (2.0836 => 2.0621, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: -1.01% (1.5202 => 1.5049, std.dev.: 0.0019) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.93% (2.0478 => 2.1078, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: 2.42% (7.4937 => 7.6751, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/hash2: 2.15% (3.1932 => 3.2619, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.88% (0.3821 => 0.3520, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -6.78% (2.4924 => 2.3235, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -6.40% (0.3357 => 0.3142, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.40% (0.9542 => 0.8931, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.26% (0.2428 => 0.2276, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.96% (0.1796 => 0.1689, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.94% (0.6484 => 0.6099, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: -5.91% (16.1920 => 15.2344, std.dev.: 0.0197) MultiSource/Benchmarks/mafft/pairlocalalign: -5.91% (9.2283 => 8.6828, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.89% (1.0544 => 0.9923, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: -5.85% (0.1879 => 0.1769, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -5.79% (0.2160 => 0.2035, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.78% (0.9852 => 0.9283, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.77% (1.3722 => 1.2930, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: -5.75% (7.0961 => 6.6878, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/football/football: -5.69% (0.9179 => 0.8657, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.66% (0.3658 => 0.3451, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.65% (0.2355 => 0.2222, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: -5.64% (0.3812 => 0.3597, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.63% (0.5591 => 0.5276, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: -5.62% (0.3880 => 0.3662, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -5.59% (0.3831 => 0.3617, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.53% (0.5478 => 0.5175, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.53% (0.2695 => 0.2546, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.52% (3.5339 => 3.3388, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: -5.51% (0.3848 => 0.3636, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.50% (1.4642 => 1.3836, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: -5.50% (0.4033 => 0.3811, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.49% (0.3896 => 0.3682, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.49% (4.0323 => 3.8110, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.49% (0.7198 => 0.6803, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.47% (0.6194 => 0.5855, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.46% (4.8161 => 4.5531, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: -5.46% (0.4176 => 0.3948, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.45% (0.5857 => 0.5538, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.44% (1.6364 => 1.5473, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.44% (1.2300 => 1.1631, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: -5.43% (1.1450 => 1.0828, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.43% (0.5805 => 0.5490, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.42% (0.6260 => 0.5921, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.41% (0.6230 => 0.5893, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.40% (0.3891 => 0.3681, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.40% (0.7339 => 0.6943, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.38% (0.3884 => 0.3675, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -5.38% (1.1530 => 1.0910, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -5.37% (0.3406 => 0.3223, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.36% (0.6660 => 0.6303, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -5.36% (17.1032 => 16.1872, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.35% (0.6297 => 0.5960, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.35% (0.5925 => 0.5608, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.35% (0.6676 => 0.6319, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.34% (0.6736 => 0.6376, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.34% (4.8802 => 4.6195, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: -5.34% (4.3330 => 4.1016, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.33% (0.6189 => 0.5859, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.33% (0.6681 => 0.6325, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.32% (6.7716 => 6.4112, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.32% (0.5569 => 0.5273, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.31% (4.5069 => 4.2675, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.31% (0.5705 => 0.5402, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.30% (0.5581 => 0.5285, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.29% (0.8521 => 0.8070, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.28% (0.3483 => 0.3299, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.28% (0.6667 => 0.6315, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.25% (0.5863 => 0.5555, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.25% (14.2083 => 13.4629, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.24% (0.6395 => 0.6060, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.22% (0.6052 => 0.5736, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.22% (0.5941 => 0.5631, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.21% (0.7524 => 0.7132, std.dev.: 0.0096) MultiSource/Applications/hexxagon/hexxagon: -5.20% (1.3148 => 1.2464, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -5.19% (0.2985 => 0.2830, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/property: -5.19% (0.4199 => 0.3981, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.19% (0.6304 => 0.5977, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.18% (0.5849 => 0.5546, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.17% (0.5802 => 0.5502, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.16% (0.7919 => 0.7510, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: -5.15% (1.2515 => 1.1870, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.15% (0.6446 => 0.6114, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.15% (0.5456 => 0.5175, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.15% (1.2784 => 1.2126, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.14% (0.6395 => 0.6066, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: -5.14% (0.4515 => 0.4283, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.14% (0.3057 => 0.2900, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.14% (1.2210 => 1.1583, std.dev.: 0.0064) MultiSource/Applications/SIBsim4/SIBsim4: -5.13% (1.3864 => 1.3153, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.11% (0.5575 => 0.5290, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.10% (0.2548 => 0.2418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.08% (0.5688 => 0.5399, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.08% (0.6440 => 0.6113, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -5.07% (0.3194 => 0.3032, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.07% (0.5859 => 0.5562, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.06% (0.3931 => 0.3732, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.05% (0.5999 => 0.5696, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.05% (1.2221 => 1.1604, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.03% (0.3837 => 0.3644, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.03% (2.1713 => 2.0621, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -5.02% (0.2871 => 0.2727, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: -5.00% (0.3581 => 0.3402, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.99% (0.5570 => 0.5292, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.97% (0.6033 => 0.5733, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: -4.96% (0.2659 => 0.2527, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.95% (0.4280 => 0.4068, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -4.93% (0.3025 => 0.2876, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.92% (0.3252 => 0.3092, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.91% (0.2849 => 0.2709, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.90% (0.4916 => 0.4675, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.90% (0.2999 => 0.2852, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/matrix: -4.88% (0.3255 => 0.3096, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.88% (8.0126 => 7.6215, std.dev.: 0.0085) MultiSource/Applications/d/make_dparser: -4.88% (3.5154 => 3.3439, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.86% (0.2903 => 0.2762, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -4.84% (15.2527 => 14.5150, std.dev.: 0.0072) MultiSource/Applications/SPASS/SPASS: -4.83% (15.5079 => 14.7583, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.83% (0.6293 => 0.5989, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.82% (0.4151 => 0.3951, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.81% (0.3016 => 0.2871, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.74% (0.2278 => 0.2170, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.73% (0.3849 => 0.3667, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: -4.73% (0.7447 => 0.7095, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/except: -4.69% (0.3026 => 0.2884, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -4.69% (0.4861 => 0.4633, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.68% (0.2989 => 0.2849, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -4.66% (0.2939 => 0.2802) SingleSource/Benchmarks/Shootout-C++/wc: -4.65% (0.3205 => 0.3056, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -4.61% (0.3621 => 0.3454, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.61% (0.3319 => 0.3166, std.dev.: 0.0022) SingleSource/Regression/C++/ofstream_ctor: -4.61% (0.3059 => 0.2918, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -4.60% (0.3394 => 0.3238, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -4.58% (0.3867 => 0.3690, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.58% (22.4056 => 21.3801, std.dev.: 0.0154) MultiSource/Applications/lua/lua: -4.57% (4.0594 => 3.8738, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/ary2: -4.57% (0.3481 => 0.3322, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -4.56% (0.3446 => 0.3289, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -4.55% (5.0226 => 4.7942, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -4.51% (0.7982 => 0.7622, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.50% (1.6474 => 1.5733, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.49% (0.4321 => 0.4127, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.49% (0.4813 => 0.4597, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.44% (0.2385 => 0.2279, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: -4.43% (0.4248 => 0.4060, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.41% (0.5168 => 0.4940, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.40% (0.7021 => 0.6712, std.dev.: 0.0051) MultiSource/Applications/treecc/treecc: -4.36% (2.1401 => 2.0467, std.dev.: 0.0132) MultiSource/Applications/siod/siod: -4.36% (2.4021 => 2.2974, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.35% (0.5329 => 0.5097, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.34% (0.4083 => 0.3906) SingleSource/Benchmarks/Shootout-C++/hash: -4.33% (0.4524 => 0.4328, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: -4.31% (0.3271 => 0.3130, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.28% (0.9557 => 0.9148, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.13% (0.7779 => 0.7458, std.dev.: 0.0020) MultiSource/Applications/spiff/spiff: -4.12% (0.8418 => 0.8071, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -4.07% (18.2933 => 17.5480, std.dev.: 0.0222) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.07% (0.4427 => 0.4247, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -4.04% (34.0927 => 32.7143, std.dev.: 0.0204) SingleSource/Benchmarks/Misc-C++/bigfib: -3.97% (0.6750 => 0.6482, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -3.93% (0.3788 => 0.3639, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.92% (0.9077 => 0.8721, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.78% (2.2587 => 2.1733, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.67% (0.3491 => 0.3363, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference-object: -3.62% (0.6441 => 0.6208, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.61% (0.6347 => 0.6118, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.59% (1.5610 => 1.5049, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.32% (5.4682 => 5.2867, std.dev.: 0.0149) SingleSource/UnitTests/Vector/constpool: -3.26% (20.7746 => 20.0979, std.dev.: 0.0523) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7527, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1732, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -4.06% (2.2633 => 2.1715, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.05% (1.3096 => 1.2697, std.dev.: 0.0126) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4735, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 21:14:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 23:14:27 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121115051427.C91342A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5883?compare_to=5881&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5883, Order: 168021, Start Time: 2012-11-15 03:48:29, End Time: 2012-11-15 05:14:47 To: 5881, Order: 168017, Start Time: 2012-11-15 02:01:50, End Time: 2012-11-15 03:30:48 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 2 (106 on baseline) Performance Improvements: 12 (25 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 978 (843 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.55% (0.8336 => 0.8882, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.46% (4.5471 => 4.6137, std.dev.: 0.0224) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.76% (0.3594 => 0.3351, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.35% (0.6392 => 0.5986, std.dev.: 0.0153) MultiSource/Applications/JM/ldecod/ldecod: -2.57% (7.1117 => 6.9292, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -2.24% (1.3874 => 1.3563, std.dev.: 0.0107) MultiSource/Applications/oggenc/oggenc: -2.12% (5.1890 => 5.0788, std.dev.: 0.0227) MultiSource/Applications/JM/lencod/lencod: -1.14% (15.8465 => 15.6651, std.dev.: 0.0682) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MallocBench/gs/gs: -13.27% (0.0889 => 0.0771, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -5.70% (1.4182 => 1.3373, std.dev.: 0.0304) MultiSource/Benchmarks/llubenchmark/llu: -2.03% (2.0403 => 1.9989, std.dev.: 0.0151) MultiSource/Applications/SIBsim4/SIBsim4: -1.79% (3.4321 => 3.3706, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.71% (1.4473 => 1.4226, std.dev.: 0.0029) MultiSource/Applications/spiff/spiff: -1.04% (2.9157 => 2.8854, std.dev.: 0.0036) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.28% (16.9389 => 16.9858, std.dev.: 0.0307) MultiSource/Applications/obsequi/Obsequi: 0.21% (1.0576 => 1.0598, std.dev.: 0.0102) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.14% (22.2448 => 22.2762, std.dev.: 0.0795) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.33% (0.3674 => 0.3662, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/bigfib: 0.20% (0.6100 => 0.6112, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.60% (0.3353 => 0.3373, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/strcat: 0.35% (0.2013 => 0.2020, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -17.89% (0.0218 => 0.0179, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.16% (0.0431 => 0.0426, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.31% (0.0333 => 0.0302, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -28.48% (0.0316 => 0.0226, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0425 => 0.0425, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0204 => 0.0204, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -21.56% (0.0218 => 0.0171, std.dev.: 0.0037) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -1.80% (0.1499 => 0.1472, std.dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -3.74% (1.1882 => 1.1438, std.dev.: 0.0643) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.48% (0.4235 => 0.4130, std.dev.: 0.0299) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.24% (0.1462 => 0.1400, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.16% (0.0614 => 0.0613, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.06% (0.0248 => 0.0268, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: - (0.0567 => 0.0567, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.23% (1.1995 => 1.1968, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -94.12% (0.0017 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -95.00% (0.0020 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.99% (0.0601 => 0.0643, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.90% (0.0202 => 0.0222, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.37% (0.7817 => 0.7788, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -66.67% (0.0003 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -41.49% (0.0094 => 0.0055, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2321.24% (0.6332 => 15.3313, std.dev.: 0.1246) MultiSource/Benchmarks/McCat/08-main/main: 47.41% (0.1831 => 0.2699, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.83% (0.1559 => 0.1437, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1528.05% (0.3344 => 5.4442, std.dev.: 0.2683) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.90% (0.2364 => 0.3260, std.dev.: 0.0121) SingleSource/Benchmarks/Misc/mandel: 2.80% (0.0429 => 0.0441, std.dev.: 0.0017) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -12.05% (0.0224 => 0.0197, std.dev.: 0.0020) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 6.50% (0.1462 => 0.1557, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4790, std.dev.: 0.0413) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0731, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4946, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3199, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1210, std.dev.: 0.0352) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4046, std.dev.: 0.0106) SingleSource/Regression/C/uint64_to_float: -23.89% (2.1832 => 1.6617, std.dev.: 0.0161) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.17% (0.0830 => 0.0931, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 11.51% (0.1112 => 0.1240, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.98% (0.2180 => 0.2354, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.2279 => 0.2435, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.74% (0.8321 => 0.8882, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.69% (0.7473 => 0.7973, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.30% (0.4847 => 0.5104, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.28% (0.2519 => 0.2652, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.97% (0.3137 => 0.3293, std.dev.: 0.0038) MultiSource/Applications/Burg/burg: 4.81% (1.2222 => 1.2810, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.59% (1.1606 => 1.2139, std.dev.: 0.0182) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.55% (0.2240 => 0.2342, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.43% (0.9435 => 0.9853, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.22% (0.8148 => 0.8492, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.13% (1.1685 => 1.2168, std.dev.: 0.0173) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.94% (0.2998 => 0.3116, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.79% (4.4880 => 4.6580, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.76% (4.1763 => 4.3333, std.dev.: 0.0094) MultiSource/Applications/SPASS/SPASS: 3.74% (14.2605 => 14.7935, std.dev.: 0.0554) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.71% (0.4559 => 0.4728, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.58% (1.1271 => 1.1674, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.57% (0.8457 => 0.8759, std.dev.: 0.0026) MultiSource/Applications/lua/lua: 3.53% (3.8189 => 3.9537, std.dev.: 0.0223) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.42% (6.6074 => 6.8332, std.dev.: 0.0152) MultiSource/Applications/siod/siod: 3.38% (2.2184 => 2.2934, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.30% (1.1170 => 1.1539, std.dev.: 0.0133) MultiSource/Applications/d/make_dparser: 3.19% (3.2366 => 3.3399, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.07% (1.6386 => 1.6889, std.dev.: 0.0116) MultiSource/Applications/JM/ldecod/ldecod: 2.93% (6.7320 => 6.9292, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/football/football: 2.90% (0.8768 => 0.9022, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.87% (0.8050 => 0.8281, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.85% (13.1811 => 13.5571, std.dev.: 0.0382) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.82% (0.8331 => 0.8566, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.82% (4.4873 => 4.6137, std.dev.: 0.0224) MultiSource/Applications/hexxagon/hexxagon: 2.80% (0.9810 => 1.0085, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 2.78% (31.8598 => 32.7466, std.dev.: 0.0729) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.78% (0.8697 => 0.8939, std.dev.: 0.0071) MultiSource/Applications/SIBsim4/SIBsim4: 2.77% (1.2568 => 1.2916, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.76% (0.8069 => 0.8292, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.75% (0.8007 => 0.8227, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.73% (0.8204 => 0.8428, std.dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 2.72% (14.7684 => 15.1697, std.dev.: 0.0539) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.68% (8.6476 => 8.8794, std.dev.: 0.0430) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.65% (0.6227 => 0.6392, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/05-eks/eks: 2.59% (0.4397 => 0.4511, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.56% (0.9069 => 0.9301, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.51% (0.9908 => 1.0157, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.50% (0.8317 => 0.8525, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.48% (0.8927 => 0.9148, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.46% (0.8359 => 0.8565, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.43% (0.8518 => 0.8725, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.43% (0.8316 => 0.8518, std.dev.: 0.0069) MultiSource/Applications/oggenc/oggenc: 2.34% (4.9628 => 5.0788, std.dev.: 0.0227) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.30% (0.9039 => 0.9247, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.26% (0.8286 => 0.8473, std.dev.: 0.0033) MultiSource/Applications/lemon/lemon: 2.24% (1.0945 => 1.1190, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.22% (0.9688 => 0.9903, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.22% (0.8656 => 0.8848, std.dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 2.20% (15.3280 => 15.6651, std.dev.: 0.0682) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.18% (0.8855 => 0.9048, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.16% (0.8048 => 0.8222, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.15% (0.8805 => 0.8994, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.14% (1.3279 => 1.3563, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.13% (0.7966 => 0.8136, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.13% (0.8086 => 0.8258, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.06% (0.8338 => 0.8510, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.04% (0.7932 => 0.8094, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.02% (0.8261 => 0.8428, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.02% (0.8716 => 0.8892, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.86% (0.8420 => 0.8577, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.85% (0.8066 => 0.8215, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.84% (0.6943 => 0.7071, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 1.84% (8.6247 => 8.7836, std.dev.: 0.0410) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.47% (0.8995 => 0.9127, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 138.69% (0.0199 => 0.0475, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/pi: 38.49% (1.5795 => 2.1874, std.dev.: 0.1549) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.64% (0.7597 => 0.8937, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.35% (2.9753 => 3.4617, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.45% (2.7995 => 3.2040, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6088, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.14% (1.1857 => 1.2822, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.96% (6.3772 => 6.8851, std.dev.: 0.0771) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.72% (4.7794 => 5.1008, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.69% (0.3186 => 0.3399, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/richards_benchmark: 6.05% (1.3037 => 1.3826, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.90% (4.9686 => 5.2617, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.84% (4.5327 => 4.7976, std.dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: 5.75% (3.1873 => 3.3706, std.dev.: 0.0074) MultiSource/Applications/lambda-0_1_3/lambda: 5.25% (7.4933 => 7.8866, std.dev.: 0.0331) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.69% (6.2275 => 6.5197, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.53% (3.3761 => 3.5291, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.05% (4.9469 => 5.1474, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.03% (4.9453 => 5.1444, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 3.92% (14.0064 => 14.5560, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.23% (0.3587 => 0.3703, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.89% (11.5690 => 11.9030, std.dev.: 0.0054) MultiSource/Applications/siod/siod: 2.88% (3.6643 => 3.7698, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.70% (8.2783 => 8.5020, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout/lists: 2.43% (7.3375 => 7.5160, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.38% (4.8660 => 4.9819, std.dev.: 0.0217) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.18% (4.8362 => 4.9415, std.dev.: 0.0204) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.58% (1.1365 => 1.1544, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: 1.48% (1.2061 => 1.2239, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.26% (2.4647 => 2.4957, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/neural/neural: 1.20% (1.0841 => 1.0971, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 1.03% (2.8561 => 2.8854, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -37.28% (0.0338 => 0.0212, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/em3d/em3d: -21.18% (5.4641 => 4.3066, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.09% (7.2130 => 6.2690, std.dev.: 0.0638) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.71% (1.0512 => 0.9386, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: -8.41% (63.1822 => 57.8681, std.dev.: 0.0487) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.04% (14.6451 => 13.4674, std.dev.: 0.0837) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.85% (4.7482 => 4.4231, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.30% (0.3269 => 0.3063, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.97% (3.7148 => 3.4932, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.88% (5.4972 => 5.1737, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.14% (5.1557 => 4.8906, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.39% (4.7449 => 4.5365, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.68% (6.0224 => 5.8006, std.dev.: 0.0162) MultiSource/Applications/lua/lua: -3.15% (29.8330 => 28.8923, std.dev.: 0.1436) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.01% (28.5821 => 27.7229, std.dev.: 0.0164) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.00% (0.5807 => 0.5633, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.71% (2.8773 => 2.7992, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.71% (2.6356 => 2.5642, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.32% (9.9065 => 9.6763, std.dev.: 0.0661) SingleSource/Benchmarks/Shootout-C++/hash2: -2.21% (3.4237 => 3.3481, std.dev.: 0.0232) MultiSource/Benchmarks/Olden/bisort/bisort: -2.03% (0.6636 => 0.6501, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.01% (11.5316 => 11.2993, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.92% (2.3487 => 2.3035, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.72% (4.9994 => 4.9136, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.12% (5.6343 => 5.5712, std.dev.: 0.0060) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 3.28% (16.4461 => 16.9858, std.dev.: 0.0307) MultiSource/Applications/obsequi/Obsequi: 3.27% (1.0262 => 1.0598, std.dev.: 0.0102) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7032.95% (0.3123 => 22.2762, std.dev.: 0.0795) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.68% (0.2463 => 0.3662, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/bigfib: 1.70% (0.6010 => 0.6112, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.28% (0.3266 => 0.3373, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/strcat: 2.59% (0.1969 => 0.2020, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 45.53% (0.0123 => 0.0179, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 18.90% (0.0254 => 0.0302, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -25.17% (0.0302 => 0.0226, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -5.00% (0.0180 => 0.0171, std.dev.: 0.0037) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.36% (0.1438 => 0.1472, std.dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.96% (1.1329 => 1.1438, std.dev.: 0.0643) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.82% (0.4164 => 0.4130, std.dev.: 0.0299) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.26% (0.1369 => 0.1400, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.37% (0.0641 => 0.0613, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 37.44% (0.0195 => 0.0268, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.90% (0.0578 => 0.0567, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.64% (1.1437 => 1.1968, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.55% (0.0627 => 0.0643, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.33% (0.0180 => 0.0222, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.86% (0.8017 => 0.7788, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -11.29% (0.0062 => 0.0055, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 21:54:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 14 Nov 2012 23:54:21 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121115055421.952102A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5884?compare_to=5878&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5884, Order: 168021, Start Time: 2012-11-15 03:43:20, End Time: 2012-11-15 05:54:39 To: 5878, Order: 167999, Start Time: 2012-11-15 00:40:09, End Time: 2012-11-15 02:51:29 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 51 (140 on baseline) Performance Improvements: 13 (39 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 974 (708 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/messages-2: 16.97% (0.0772 => 0.0903, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.37% (0.5759 => 0.6644, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.07% (0.1407 => 0.1619, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 14.98% (0.6220 => 0.7152, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.90% (0.6201 => 0.7125, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/richards_benchmark: 14.86% (0.0895 => 0.1028, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.47% (0.5617 => 0.6430, std.dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.22% (0.2232 => 0.2527, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 13.00% (0.3346 => 0.3781, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.78% (1.0312 => 1.1630, std.dev.: 0.0212) SingleSource/Benchmarks/Misc-C++/Large/ray: 12.61% (0.4450 => 0.5011, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.36% (0.3771 => 0.4237, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.32% (0.0990 => 0.1112, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 12.29% (0.4002 => 0.4494, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/random: 12.09% (0.3053 => 0.3422, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/wc: 11.50% (0.3322 => 0.3704, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/09-vor/vor: 11.33% (0.3575 => 0.3980, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.14% (0.3008 => 0.3343, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/05-eks/eks: 10.98% (0.4773 => 0.5297, std.dev.: 0.0022) MultiSource/Applications/sgefa/sgefa: 10.73% (0.3522 => 0.3900, std.dev.: 0.0085) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.63% (0.1035 => 0.1145, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.14% (2.6361 => 2.9033, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.97% (0.6161 => 0.6775, std.dev.: 0.0205) SingleSource/UnitTests/ObjC/parameter-passing: 9.94% (0.4438 => 0.4879, std.dev.: 0.0086) MultiSource/Applications/hbd/hbd: 9.70% (1.7440 => 1.9132, std.dev.: 0.0130) MultiSource/Applications/lemon/lemon: 9.66% (1.1977 => 1.3134, std.dev.: 0.0436) SingleSource/Benchmarks/Stanford/Puzzle: 9.54% (0.1404 => 0.1538, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 9.36% (0.4381 => 0.4791, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.27% (0.3129 => 0.3419, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/for-in: 9.25% (0.4141 => 0.4524, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 8.59% (0.1979 => 0.2149, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.03% (0.3983 => 0.4303, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/18-imp/imp: 7.67% (0.3885 => 0.4183, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.34% (0.3459 => 0.3713, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.01% (0.6934 => 0.7420, std.dev.: 0.0178) SingleSource/Benchmarks/Misc/salsa20: 6.40% (0.2110 => 0.2245, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/synchronized: 4.46% (0.4010 => 0.4189, std.dev.: 0.0069) MultiSource/Applications/kimwitu++/kc: 3.10% (21.0170 => 21.6693, std.dev.: 0.1065) MultiSource/Benchmarks/PAQ8p/paq8p: 2.08% (11.9145 => 12.1625, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.54% (11.2205 => 11.3931, std.dev.: 0.0193) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 35.04% (0.1193 => 0.1611, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: 22.90% (3.9733 => 4.8831, std.dev.: 0.0855) SingleSource/Benchmarks/Shootout-C++/moments: 19.04% (0.1245 => 0.1482, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 17.62% (0.0840 => 0.0988, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/heapsort: 13.72% (3.9854 => 4.5322, std.dev.: 0.0422) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.27% (0.4107 => 0.4611, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 12.26% (2.7671 => 3.1064, std.dev.: 0.0633) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 5.68% (0.2288 => 0.2418, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.72% (9.6523 => 10.1078, std.dev.: 0.1389) MultiSource/Applications/minisat/minisat: 3.85% (11.2079 => 11.6397, std.dev.: 0.1035) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.18% (1.8954 => 1.9178, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.81% (0.4689 => 0.4182, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.53% (0.7915 => 0.7240, std.dev.: 0.0043) SingleSource/UnitTests/ObjC++/property-reference: -7.57% (0.8648 => 0.7993, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/sieve: -6.88% (0.4285 => 0.3990, std.dev.: 0.0084) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.84% (0.4269 => 0.3977, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -5.31% (5.2700 => 4.9904, std.dev.: 0.0913) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.63% (4.5702 => 4.4042, std.dev.: 0.0499) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.49% (0.7315 => 0.7133, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: -13.46% (6.6557 => 5.7599, std.dev.: 0.1519) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -9.04% (1.4779 => 1.3443, std.dev.: 0.0320) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.40% (0.3479 => 0.3326, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.78% (6.1671 => 6.0572, std.dev.: 0.0282) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.04% (1.3522 => 1.3382, std.dev.: 0.0036) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.07% (0.1337 => 0.1338, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0420 => 0.0421, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0651 => 0.0651, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: 0.02% (493.8992 => 494.0015, std.dev.: 0.1570) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0421, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: 43706.11% (1.1277 => 494.0015, std.dev.: 0.1570) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 205.55% (0.5229 => 1.5977, std.dev.: 0.0892) MultiSource/Applications/SPASS/SPASS: 22.24% (14.9895 => 18.3237, std.dev.: 0.1590) MultiSource/Applications/kimwitu++/kc: 53.08% (14.1553 => 21.6693, std.dev.: 0.1065) MultiSource/Benchmarks/MallocBench/gs/gs: 21.41% (4.1105 => 4.9904, std.dev.: 0.0913) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.40% (1.1048 => 1.5180, std.dev.: 0.0748) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 437.91% (7.1582 => 38.5047, std.dev.: 0.0550) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.05% (3.4629 => 6.3390, std.dev.: 0.1655) SingleSource/Benchmarks/Misc-C++/stepanov_container: 86.92% (0.6222 => 1.1630, std.dev.: 0.0212) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10779.03% (0.0720 => 7.8329, std.dev.: 0.1945) MultiSource/Applications/SIBsim4/SIBsim4: 3875700.00% (0.0001 => 3.8758, std.dev.: 0.0316) MultiSource/Applications/SPASS/SPASS: 14805700.00% (0.0001 => 14.8058, std.dev.: 0.3692) MultiSource/Applications/kimwitu++/kc: 52300.00% (0.0001 => 0.0524, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 578200.00% (0.0001 => 0.5783, std.dev.: 0.0301) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10085700.00% (0.0001 => 10.0858, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5759800.00% (0.0001 => 5.7599, std.dev.: 0.1519) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1795.97% (1.1194 => 21.2235, std.dev.: 0.1325) MultiSource/Applications/ClamAV/clamscan: 69.28% (22.1758 => 37.5381, std.dev.: 0.1958) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 61.51% (7.0540 => 11.3931, std.dev.: 0.0193) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 59.31% (2.9384 => 4.6811, std.dev.: 0.2944) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 51.11% (8.1363 => 12.2946, std.dev.: 0.1344) SingleSource/Benchmarks/Misc/flops: 50.07% (0.1432 => 0.2149, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 49.19% (21.9371 => 32.7276, std.dev.: 0.0956) MultiSource/Benchmarks/FreeBench/distray/distray: 45.27% (0.1056 => 0.1534, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/almabench: 38.63% (0.0730 => 0.1012) SingleSource/UnitTests/ObjC/messages-2: 36.40% (0.0662 => 0.0903, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/Oscar: 34.91% (0.0636 => 0.0858, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/15-trie/trie: 32.45% (0.0527 => 0.0698, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/messages: 32.11% (0.0327 => 0.0432, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 32.07% (0.0842 => 0.1112, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 31.82% (2.2024 => 2.9033, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.99% (0.1236 => 0.1619, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ft/ft: 30.26% (0.1940 => 0.2527, std.dev.: 0.0005) SingleSource/UnitTests/vla: 30.14% (0.0355 => 0.0462, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.39% (0.6675 => 0.8637, std.dev.: 0.0084) SingleSource/Benchmarks/Stanford/Towers: 29.30% (0.0471 => 0.0609, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/Queens: 28.26% (0.0414 => 0.0531, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 28.12% (0.3307 => 0.4237, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 28.09% (0.5020 => 0.6430, std.dev.: 0.0079) SingleSource/Benchmarks/Dhrystone/fldry: 27.86% (0.0481 => 0.0615, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.48% (0.0746 => 0.0951, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/matrix: 26.65% (0.0818 => 0.1036, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/RealMM: 26.01% (0.0396 => 0.0499, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 25.44% (0.3109 => 0.3900, std.dev.: 0.0085) MultiSource/Benchmarks/McCat/09-vor/vor: 25.16% (0.3180 => 0.3980, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/parameter-passing: 24.24% (0.3927 => 0.4879, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/whetstone: 24.24% (0.0660 => 0.0820, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 23.30% (0.4064 => 0.5011, std.dev.: 0.0087) SingleSource/UnitTests/ObjC/property: 23.29% (0.3886 => 0.4791, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/lpbench: 23.25% (0.0929 => 0.1145, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 23.21% (0.4299 => 0.5297, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 23.12% (0.3650 => 0.4494, std.dev.: 0.0038) MultiSource/Applications/hbd/hbd: 22.62% (1.5603 => 1.9132, std.dev.: 0.0130) MultiSource/Applications/lemon/lemon: 22.50% (1.0722 => 1.3134, std.dev.: 0.0436) SingleSource/UnitTests/ObjC/for-in: 22.47% (0.3694 => 0.4524, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/nestedloop: 22.41% (0.2793 => 0.3419, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 22.28% (14.3668 => 17.5674, std.dev.: 0.1218) MultiSource/Benchmarks/McCat/18-imp/imp: 22.20% (0.3423 => 0.4183, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/random: 22.13% (0.2802 => 0.3422, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.92% (0.0479 => 0.0584, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 21.84% (1.1861 => 1.4451, std.dev.: 0.0284) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.78% (0.1566 => 0.1907, std.dev.: 0.0104) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 21.53% (0.1584 => 0.1925, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/instance-method-metadata: 21.45% (0.3543 => 0.4303, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/wc: 21.36% (0.3052 => 0.3704, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ackermann: 21.30% (0.2756 => 0.3343, std.dev.: 0.0027) SingleSource/Benchmarks/Stanford/Puzzle: 21.29% (0.1268 => 0.1538, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 20.97% (0.2714 => 0.3283, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 20.76% (0.3131 => 0.3781, std.dev.: 0.0103) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.43% (0.0793 => 0.0955, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/tsp/tsp: 20.43% (0.1175 => 0.1415, std.dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: 19.59% (9.4845 => 11.3421, std.dev.: 0.0285) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.02% (0.1125 => 0.1339, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.86% (4.2646 => 5.0690, std.dev.: 0.1190) MultiSource/Applications/oggenc/oggenc: 18.26% (5.7591 => 6.8108, std.dev.: 0.2389) SingleSource/Benchmarks/Shootout-C++/lists: 17.74% (0.3422 => 0.4029, std.dev.: 0.0115) SingleSource/UnitTests/ObjC/synchronized: 17.64% (0.3561 => 0.4189, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.44% (4.9449 => 5.8075, std.dev.: 0.1063) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.43% (0.3162 => 0.3713, std.dev.: 0.0073) MultiSource/Benchmarks/PAQ8p/paq8p: 17.32% (10.3673 => 12.1625, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 17.32% (1.5859 => 1.8605, std.dev.: 0.0952) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.22% (0.0871 => 0.1021, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.87% (0.4103 => 0.4795, std.dev.: 0.0219) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.85% (5.0018 => 5.8444, std.dev.: 0.1292) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.83% (0.8172 => 0.9547, std.dev.: 0.0280) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.77% (0.3136 => 0.3662, std.dev.: 0.0147) MultiSource/Applications/lua/lua: 16.71% (3.8723 => 4.5192, std.dev.: 0.1266) MultiSource/Applications/d/make_dparser: 16.61% (3.3354 => 3.8893, std.dev.: 0.1957) MultiSource/Applications/spiff/spiff: 16.60% (0.7835 => 0.9136, std.dev.: 0.0409) MultiSource/Benchmarks/Olden/em3d/em3d: 16.40% (0.1695 => 0.1973, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.31% (0.0834 => 0.0970, std.dev.: 0.0043) MultiSource/Applications/Burg/burg: 16.27% (1.1642 => 1.3536, std.dev.: 0.0605) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.95% (0.0953 => 0.1105, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.93% (0.2065 => 0.2394, std.dev.: 0.0115) MultiSource/Benchmarks/Olden/health/health: 15.93% (0.1268 => 0.1470, std.dev.: 0.0073) MultiSource/Applications/sqlite3/sqlite3: 15.82% (17.1811 => 19.8984, std.dev.: 0.3108) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.74% (0.0648 => 0.0750, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.58% (0.0770 => 0.0890, std.dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 15.37% (0.1555 => 0.1794, std.dev.: 0.0080) MultiSource/Applications/minisat/minisat: 15.00% (0.7115 => 0.8182, std.dev.: 0.0320) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 14.48% (1.3050 => 1.4940, std.dev.: 0.0656) MultiSource/Benchmarks/Prolangs-C/football/football: 14.48% (0.8921 => 1.0213, std.dev.: 0.0451) MultiSource/Benchmarks/Bullet/bullet: 14.31% (63.2438 => 72.2939, std.dev.: 0.1312) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 14.30% (0.5105 => 0.5835, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.14% (0.5981 => 0.6827, std.dev.: 0.0282) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.94% (0.1062 => 0.1210, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.30% (1.5415 => 1.7465, std.dev.: 0.0795) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.15% (3.8922 => 4.4042, std.dev.: 0.0499) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.69% (0.1143 => 0.1288, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.25% (0.6450 => 0.7240, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.59% (0.1906 => 0.2127, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/sieve: 10.74% (0.3603 => 0.3990, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/oourafft: 10.24% (0.3282 => 0.3618, std.dev.: 0.0117) SingleSource/UnitTests/ObjC++/property-reference: 9.10% (0.7326 => 0.7993, std.dev.: 0.0174) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.28% (0.3935 => 0.4182, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.83% (7.9617 => 8.4257, std.dev.: 0.0608) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.19% (0.3817 => 0.3977, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: 3.50% (54.1659 => 56.0619, std.dev.: 0.4384) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.77% (4.3953 => 11.0223, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: 147.71% (5.3999 => 13.3762, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 39.60% (0.1154 => 0.1611, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: 32.00% (3.6994 => 4.8831, std.dev.: 0.0855) SingleSource/Benchmarks/Shootout-C++/moments: 27.87% (0.1159 => 0.1482, std.dev.: 0.0050) MultiSource/Applications/minisat/minisat: 27.69% (9.1159 => 11.6397, std.dev.: 0.1035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 24.55% (13.4384 => 16.7377, std.dev.: 0.2203) SingleSource/Benchmarks/Misc/oourafft: 17.68% (6.6465 => 7.8216, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.62% (3.8532 => 4.5322, std.dev.: 0.0422) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.61% (1.1145 => 1.2996, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.35% (0.0864 => 0.0988, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.77% (10.3460 => 11.7705, std.dev.: 0.0568) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.98% (0.2944 => 0.3326, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.77% (2.8904 => 3.2306, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.44% (8.6802 => 9.6731, std.dev.: 0.2111) SingleSource/Benchmarks/Misc/richards_benchmark: 10.35% (1.1396 => 1.2575, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.47% (1.7254 => 1.8888, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/strcat: 7.48% (0.1899 => 0.2041, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.96% (0.9540 => 1.0109, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.89% (4.2280 => 4.4772, std.dev.: 0.0039) MultiSource/Applications/lua/lua: 5.28% (26.0924 => 27.4688, std.dev.: 0.1000) SingleSource/Regression/C/uint64_to_float: 5.10% (0.5413 => 0.5689, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.6436 => 12.1312, std.dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/dry: 3.39% (2.4116 => 2.4934, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.36% (0.4162 => 0.4302, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 2.51% (0.6223 => 0.6379, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.45% (3.6395 => 3.7287, std.dev.: 0.0313) MultiSource/Benchmarks/PAQ8p/paq8p: 2.25% (85.0658 => 86.9780, std.dev.: 0.0256) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.15% (1.3677 => 1.3971, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 2.10% (3.1595 => 3.2257, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2783, std.dev.: 0.0115) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.54% (6.5088 => 6.6090, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/lists: 1.44% (12.5348 => 12.7147, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout/sieve: 1.43% (5.2139 => 5.2882, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.34% (1.0313 => 1.0451, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0501, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1679, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.60% (5.2763 => 1.2346, std.dev.: 0.0588) SingleSource/Benchmarks/Misc/salsa20: -74.05% (0.8651 => 0.2245, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -36.62% (0.1622 => 0.1028, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.58% (5.3855 => 4.8155, std.dev.: 0.1315) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.40% (5.3526 => 4.8495, std.dev.: 0.1151) MultiSource/Applications/JM/ldecod/ldecod: -6.62% (10.4361 => 9.7452, std.dev.: 0.0990) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.03% (0.3987 => 0.2391, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.72% (0.0506 => 0.0305, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.32% (4.5009 => 2.7763, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.12% (2.6546 => 2.0144, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -23.15% (10.7105 => 8.2306, std.dev.: 0.4552) MultiSource/Benchmarks/FreeBench/mason/mason: -19.25% (0.2161 => 0.1745, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4257, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2841, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.68% (32.5116 => 29.0405, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -9.66% (9.5636 => 8.6398, std.dev.: 0.2003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.05% (1.5660 => 1.4243, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.93% (4.8142 => 4.4807, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.2416 => 3.0212, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.58% (2.7294 => 2.5770, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -5.25% (1.5835 => 1.5003, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.50% (1.6805 => 1.6048, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/lists: -4.08% (6.2999 => 6.0427, std.dev.: 0.0024) MultiSource/Benchmarks/sim/sim: -3.04% (5.0483 => 4.8950, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.83% (0.9957 => 0.9675, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.27% (0.4808 => 0.4699, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.80% (8.1563 => 8.0093, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6770, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -1.43% (10.2830 => 10.1361, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0014) Report Time: 2.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 22:56:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 00:56:33 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121115065633.833702A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5885?compare_to=5882&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5885, Order: 168023, Start Time: 2012-11-15 05:31:51, End Time: 2012-11-15 06:56:51 To: 5882, Order: 168021, Start Time: 2012-11-15 03:43:42, End Time: 2012-11-15 05:08:45 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (177 on baseline) Unchanged Tests: 1041 (860 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.08% (54.6909 => 56.3772, std.dev.: 0.0717) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.30% (54.5751 => 56.3772, std.dev.: 0.0717) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.74% (2.0478 => 2.1040, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: 2.51% (7.4937 => 7.6820, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/hash2: 2.39% (3.1932 => 3.2694, std.dev.: 0.0108) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.74% (0.1431 => 0.1306) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.93% (0.3821 => 0.3518, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.79% (2.4924 => 2.3231, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.65% (0.3142 => 0.2933, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.52% (0.3357 => 0.3138, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.45% (0.9542 => 0.8927, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.30% (0.2428 => 0.2275, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.07% (0.2355 => 0.2212, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.06% (0.6484 => 0.6091, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.96% (0.1796 => 0.1689, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -5.92% (9.2283 => 8.6820, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.92% (1.0544 => 0.9920, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: -5.90% (16.1920 => 15.2368, std.dev.: 0.0185) SingleSource/Benchmarks/Misc/ReedSolomon: -5.85% (0.1879 => 0.1769, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.84% (0.9852 => 0.9277, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: -5.80% (0.9179 => 0.8647, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -5.79% (7.0961 => 6.6852, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/oourafft: -5.74% (0.2160 => 0.2036, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -5.74% (0.1761 => 0.1660, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.69% (0.3658 => 0.3450, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.67% (0.3812 => 0.3596, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -5.66% (0.3831 => 0.3614, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.66% (1.3722 => 1.2946, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.62% (3.5339 => 3.3352, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.62% (0.5591 => 0.5277, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: -5.59% (0.3880 => 0.3663, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.58% (0.4033 => 0.3808, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.57% (0.6736 => 0.6361, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.57% (0.2695 => 0.2545, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.55% (1.6364 => 1.5455, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.55% (1.2300 => 1.1617, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/synchronized: -5.54% (0.3896 => 0.3680, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.53% (4.0323 => 3.8092, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.53% (1.4642 => 1.3832, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (0.5857 => 0.5533, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.51% (0.5478 => 0.5176, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -5.51% (0.3848 => 0.3636, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.50% (0.3891 => 0.3677, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.48% (0.3884 => 0.3671, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.47% (0.7198 => 0.6804, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: -5.47% (1.1450 => 1.0824, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.45% (4.8161 => 4.5535, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.44% (4.8802 => 4.6146, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.44% (0.6304 => 0.5961, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -5.44% (0.4176 => 0.3949, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.43% (0.6230 => 0.5892, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.38% (0.7339 => 0.6944, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.38% (6.7716 => 6.4072, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.36% (0.6189 => 0.5857, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.36% (0.6395 => 0.6052, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.35% (0.5925 => 0.5608, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.35% (0.6676 => 0.6319, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.34% (0.5805 => 0.5495, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.34% (0.6297 => 0.5961, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.33% (0.6194 => 0.5864, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.32% (0.6667 => 0.6312, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: -5.31% (1.1530 => 1.0918, std.dev.: 0.0168) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.30% (0.8521 => 0.8069, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.30% (0.5849 => 0.5539, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.30% (0.5570 => 0.5275, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.29% (0.5802 => 0.5495, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.28% (0.7524 => 0.7127, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -5.27% (1.3148 => 1.2455, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.27% (0.5863 => 0.5554, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.27% (4.5069 => 4.2694, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.27% (0.6681 => 0.6329, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.26% (0.5569 => 0.5276, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.26% (14.2083 => 13.4611, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.26% (0.6660 => 0.6310, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.25% (0.3483 => 0.3300, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.24% (1.2210 => 1.1570, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.24% (0.5705 => 0.5406, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.24% (0.6052 => 0.5735, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.23% (0.5941 => 0.5630, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.23% (1.2784 => 1.2116, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: -5.22% (1.2515 => 1.1862, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.21% (0.5859 => 0.5554, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: -5.20% (4.3330 => 4.1076, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -5.19% (0.2985 => 0.2830, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.17% (0.3406 => 0.3230, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: -5.17% (17.1032 => 16.2198, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/methcall: -5.16% (0.3025 => 0.2869, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.15% (0.7919 => 0.7511, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.15% (0.6446 => 0.6114, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.14% (0.6440 => 0.6109, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.14% (0.3931 => 0.3729, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.14% (0.4515 => 0.4283, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.14% (0.5567 => 0.5281, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -5.14% (1.3864 => 1.3152, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.11% (0.5456 => 0.5177, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.10% (0.2548 => 0.2418, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -5.10% (0.4199 => 0.3985, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.09% (1.2221 => 1.1599, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.08% (0.4151 => 0.3940, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.08% (0.3837 => 0.3642, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.08% (0.5575 => 0.5292, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.07% (0.3057 => 0.2902, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.04% (2.1713 => 2.0618, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -5.04% (0.3194 => 0.3033, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.03% (0.5688 => 0.5402, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.02% (0.5999 => 0.5698, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: -5.02% (0.2871 => 0.2727, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -5.00% (0.2939 => 0.2792, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.00% (0.2999 => 0.2849, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: -5.00% (0.3581 => 0.3402, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.98% (0.2933 => 0.2787, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.96% (0.6033 => 0.5734, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -4.95% (3.5154 => 3.3413, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.95% (0.3252 => 0.3091, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: -4.93% (0.2659 => 0.2528, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.93% (0.2903 => 0.2760, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.92% (0.2278 => 0.2166, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: -4.91% (0.2849 => 0.2709, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.91% (0.6293 => 0.5984, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.90% (0.4916 => 0.4675, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -4.88% (0.4280 => 0.4071, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.87% (8.0126 => 7.6221, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: -4.85% (0.3255 => 0.3097, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.84% (15.2527 => 14.5144, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/wc: -4.84% (0.3205 => 0.3050, std.dev.: 0.0047) MultiSource/Applications/minisat/minisat: -4.83% (0.7447 => 0.7087, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.82% (0.2385 => 0.2270, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -4.79% (15.5079 => 14.7656, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.75% (1.6474 => 1.5692, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: -4.74% (0.3059 => 0.2914, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.73% (0.3319 => 0.3162, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -4.73% (0.3026 => 0.2883, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -4.71% (0.4861 => 0.4632, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.71% (0.3016 => 0.2874, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.70% (0.5168 => 0.4925, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -4.68% (0.3481 => 0.3318, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.65% (0.2989 => 0.2850, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -4.63% (4.0594 => 3.8714, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary3: -4.59% (0.3446 => 0.3288, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -4.58% (0.3621 => 0.3455, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -4.55% (5.0226 => 4.7943, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.54% (22.4056 => 21.3886, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary: -4.54% (0.3394 => 0.3240, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -4.52% (0.4248 => 0.4056, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.49% (0.3849 => 0.3676, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -4.45% (0.3867 => 0.3695) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.44% (0.7021 => 0.6709, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -4.43% (0.7982 => 0.7628, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.41% (0.5329 => 0.5094, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.40% (0.4813 => 0.4601, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -4.40% (0.3271 => 0.3127, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.38% (0.4083 => 0.3904, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: -4.35% (0.4524 => 0.4327, std.dev.: 0.0017) MultiSource/Applications/treecc/treecc: -4.35% (2.1401 => 2.0470, std.dev.: 0.0016) MultiSource/Applications/siod/siod: -4.34% (2.4021 => 2.2979, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.25% (0.9557 => 0.9151, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.18% (0.3323 => 0.3184, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.13% (0.9077 => 0.8702, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -4.06% (0.8418 => 0.8076, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.04% (0.7779 => 0.7465, std.dev.: 0.0083) MultiSource/Applications/kimwitu++/kc: -4.03% (18.2933 => 17.5564, std.dev.: 0.0183) MultiSource/Benchmarks/Bullet/bullet: -4.01% (34.0927 => 32.7250, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: -4.00% (0.6750 => 0.6480, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.00% (0.4427 => 0.4250, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.87% (2.2587 => 2.1712, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: -3.83% (0.3788 => 0.3643, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.73% (0.4321 => 0.4160, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: -3.69% (0.6347 => 0.6113, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.64% (0.3491 => 0.3364, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.61% (1.5610 => 1.5046, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: -3.56% (0.6441 => 0.6212) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.30% (5.4682 => 5.2878, std.dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -3.28% (20.7746 => 20.0934, std.dev.: 0.0733) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7532, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fbench: -3.86% (2.2633 => 2.1760, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.06% (1.0557 => 1.0234, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4694, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0003) Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 22:57:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 00:57:53 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121115065753.EDD652A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5886?compare_to=5883&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5886, Order: 168023, Start Time: 2012-11-15 05:31:19, End Time: 2012-11-15 06:58:14 To: 5883, Order: 168021, Start Time: 2012-11-15 03:48:29, End Time: 2012-11-15 05:14:47 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 7 (85 on baseline) Performance Improvements: 3 (24 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 982 (865 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.44% (0.1018 => 0.1165, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 14.57% (2.1874 => 2.5061, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.91% (6.2690 => 6.5771, std.dev.: 0.0670) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.28% (58.3172 => 60.8154, std.dev.: 0.2893) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.15% (44.9992 => 45.9673, std.dev.: 0.2834) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.43% (3.5422 => 3.5929, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/richards_benchmark: 1.39% (1.3826 => 1.4018, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/ffbench: -2.63% (1.4277 => 1.3902, std.dev.: 0.0081) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.98% (2.7992 => 2.7437, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/primes/primes: -1.17% (0.8937 => 0.8832, std.dev.: 0.0028) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.26% (16.9858 => 17.0293, std.dev.: 0.8274) MultiSource/Applications/obsequi/Obsequi: 0.07% (1.0598 => 1.0605, std.dev.: 0.1593) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.94% (22.2762 => 22.0674, std.dev.: 0.3247) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.16% (0.3662 => 0.3668, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 0.57% (0.6112 => 0.6147, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.39% (0.3373 => 0.3360, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -0.35% (0.2020 => 0.2013, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -10.61% (0.0179 => 0.0160, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0426 => 0.0426, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -18.21% (0.0302 => 0.0247, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 35.84% (0.0226 => 0.0307, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.47% (0.0425 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -28.43% (0.0204 => 0.0146, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/test1: -11.70% (0.0171 => 0.0151, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.48% (0.1472 => 0.1479, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.93% (1.1438 => 1.1544, std.dev.: 0.3368) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.32% (0.4130 => 0.4391, std.dev.: 0.0220) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.86% (0.1400 => 0.1374, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.06% (0.0613 => 0.0582, std.dev.: 0.0211) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.75% (0.0268 => 0.0270, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.53% (0.0567 => 0.0564, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.03% (1.1968 => 1.1972, std.dev.: 0.2414) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.38% (0.0643 => 0.0602, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.22% (0.0222 => 0.0186, std.dev.: 0.0093) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.36% (0.7788 => 0.7816, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 40.00% (0.0055 => 0.0077, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2331.90% (0.6332 => 15.3988, std.dev.: 0.5498) MultiSource/Benchmarks/McCat/08-main/main: 50.41% (0.1831 => 0.2754, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.02% (0.1559 => 0.1434, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1539.23% (0.3344 => 5.4816, std.dev.: 0.0657) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.58% (0.2364 => 0.3276, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/mandel: 0.23% (0.0429 => 0.0430, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.89% (0.0224 => 0.0226, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 8.82% (0.1462 => 0.1591, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4710, std.dev.: 0.0697) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0709, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4916, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3174, std.dev.: 0.0627) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1475, std.dev.: 0.0554) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4104, std.dev.: 0.0131) SingleSource/Regression/C/uint64_to_float: -24.08% (2.1832 => 1.6574, std.dev.: 0.0046) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.04% (0.0810 => 0.0948, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 11.78% (0.1112 => 0.1243, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.36% (0.3115 => 0.3313, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.92% (0.2279 => 0.2414, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.08% (0.8321 => 0.8744, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.77% (0.4127 => 0.4324, std.dev.: 0.0072) MultiSource/Applications/Burg/burg: 4.28% (1.2222 => 1.2745, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.14% (4.1763 => 4.3490, std.dev.: 0.0493) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.82% (0.3717 => 0.3859, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 3.81% (14.2605 => 14.8042, std.dev.: 0.0516) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.72% (0.2794 => 0.2898, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 3.64% (1.2568 => 1.3025, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.63% (13.1811 => 13.6591, std.dev.: 0.0252) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.59% (0.3124 => 0.3236, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.58% (0.4559 => 0.4722, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 3.41% (2.2184 => 2.2941, std.dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.24% (2.1401 => 2.2094, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.05% (0.8457 => 0.8715, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.03% (0.8261 => 0.8511, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.96% (1.4479 => 1.4907, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.84% (0.9688 => 0.9963, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.84% (4.4873 => 4.6146, std.dev.: 0.0361) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.82% (0.9074 => 0.9330, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.79% (0.8518 => 0.8756, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 2.75% (3.2366 => 3.3256, std.dev.: 0.0287) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.75% (0.8805 => 0.9047, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.73% (0.9039 => 0.9286, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.72% (1.5315 => 1.5732, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.69% (0.8316 => 0.8540, std.dev.: 0.0061) MultiSource/Benchmarks/Bullet/bullet: 2.67% (31.8598 => 32.7114, std.dev.: 0.1363) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.66% (0.8331 => 0.8553, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.65% (0.9069 => 0.9309, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.63% (0.8597 => 0.8823, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.61% (0.8611 => 0.8836, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.60% (0.8317 => 0.8533, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.59% (0.8855 => 0.9084, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.55% (0.8716 => 0.8938, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.54% (3.1832 => 3.2639, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.53% (0.8885 => 0.9110, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.48% (0.8050 => 0.8250, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.47% (0.6586 => 0.6749, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.45% (0.8359 => 0.8564, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.40% (0.9908 => 1.0146, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 2.37% (0.4397 => 0.4501, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.36% (0.8338 => 0.8535, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.32% (0.8048 => 0.8235, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.32% (0.8069 => 0.8256, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.30% (0.8086 => 0.8272, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.27% (0.8712 => 0.8910, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.26% (0.8286 => 0.8473, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.14% (0.8656 => 0.8841, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 2.07% (8.6247 => 8.8033, std.dev.: 0.0334) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.99% (0.8697 => 0.8870, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.65% (0.7932 => 0.8063, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.28% (1.2423 => 1.2582, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 114.57% (0.0199 => 0.0427, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/pi: 58.66% (1.5795 => 2.5061, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.31% (2.9753 => 3.4607, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.26% (0.7597 => 0.8832, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.55% (2.7995 => 3.2067, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.54% (5.0261 => 5.6060, std.dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.01% (1.1857 => 1.2807, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/richards_benchmark: 7.52% (1.3037 => 1.4018, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/queens: 7.25% (1.7056 => 1.8292, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.66% (4.7794 => 5.0978, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 6.13% (3.1873 => 3.3827, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.90% (4.5327 => 4.8002, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.85% (4.9686 => 5.2591, std.dev.: 0.0065) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.85% (1.2337 => 1.2935, std.dev.: 0.0163) MultiSource/Applications/lambda-0_1_3/lambda: 4.71% (7.4933 => 7.8463, std.dev.: 0.0338) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.67% (3.3761 => 3.5339, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.66% (6.2275 => 6.5179, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.19% (4.9453 => 5.1526, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.07% (4.9469 => 5.1483, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 4.01% (14.0064 => 14.5686, std.dev.: 0.0499) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.88% (0.3587 => 0.3726, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.16% (44.5605 => 45.9673, std.dev.: 0.2834) MultiSource/Applications/siod/siod: 2.97% (3.6643 => 3.7730, std.dev.: 0.0279) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.62% (59.2638 => 60.8154, std.dev.: 0.2893) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.62% (8.2783 => 8.4949, std.dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.45% (1.1365 => 1.1644, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.37% (4.8362 => 4.9506, std.dev.: 0.0238) SingleSource/Benchmarks/Shootout/lists: 2.33% (7.3375 => 7.5086, std.dev.: 0.0163) SingleSource/Benchmarks/Misc/ReedSolomon: 1.33% (8.5322 => 8.6453, std.dev.: 0.0223) MultiSource/Benchmarks/FreeBench/neural/neural: 1.21% (1.0841 => 1.0972, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.89% (5.4641 => 4.3226, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.76% (1.0512 => 0.9381, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: -9.86% (1.1216 => 1.0110, std.dev.: 0.0131) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.08% (14.6451 => 13.3157, std.dev.: 0.2148) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -8.82% (7.2130 => 6.5771, std.dev.: 0.0670) MultiSource/Benchmarks/mafft/pairlocalalign: -8.49% (63.1822 => 57.8166, std.dev.: 0.1129) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.86% (4.7482 => 4.4224, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.12% (0.3269 => 0.3069, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.93% (3.7148 => 3.4946, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.89% (5.4972 => 5.1736, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.06% (5.1557 => 4.8948, std.dev.: 0.0087) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.64% (2.8773 => 2.7437, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.38% (4.7449 => 4.5369, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.78% (6.0224 => 5.7948, std.dev.: 0.0121) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.36% (2.4490 => 2.3666, std.dev.: 0.0236) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.34% (0.5807 => 0.5613, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.92% (28.5821 => 27.7478, std.dev.: 0.1858) SingleSource/Benchmarks/Misc/ffbench: -2.76% (1.4296 => 1.3902, std.dev.: 0.0081) MultiSource/Applications/aha/aha: -2.44% (3.3398 => 3.2583, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hash2: -2.29% (3.4237 => 3.3452, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.04% (11.5316 => 11.2968, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.60% (4.9994 => 4.9194, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.41% (3.2169 => 3.1717, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.14% (5.6343 => 5.5699, std.dev.: 0.0081) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 3.55% (16.4461 => 17.0293, std.dev.: 0.8274) MultiSource/Applications/obsequi/Obsequi: 3.34% (1.0262 => 1.0605, std.dev.: 0.1593) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6966.09% (0.3123 => 22.0674, std.dev.: 0.3247) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.92% (0.2463 => 0.3668, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 2.28% (0.6010 => 0.6147, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.88% (0.3266 => 0.3360, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 2.23% (0.1969 => 0.2013, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 30.08% (0.0123 => 0.0160, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.76% (0.0254 => 0.0247, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.66% (0.0302 => 0.0307, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -23.16% (0.0190 => 0.0146, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/test1: -16.11% (0.0180 => 0.0151, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.85% (0.1438 => 0.1479, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 1.90% (1.1329 => 1.1544, std.dev.: 0.3368) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.45% (0.4164 => 0.4391, std.dev.: 0.0220) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.37% (0.1369 => 0.1374, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.20% (0.0641 => 0.0582, std.dev.: 0.0211) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 38.46% (0.0195 => 0.0270, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.42% (0.0578 => 0.0564, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.68% (1.1437 => 1.1972, std.dev.: 0.2414) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.99% (0.0627 => 0.0602, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.33% (0.0180 => 0.0186, std.dev.: 0.0093) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.51% (0.8017 => 0.7816, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 24.19% (0.0062 => 0.0077, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 14 22:58:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 00:58:14 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121115065814.60E732A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5887?compare_to=5879&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5887, Order: 168021, Start Time: 2012-11-15 03:42:59, End Time: 2012-11-15 06:58:33 To: 5879, Order: 167991, Start Time: 2012-11-14 23:39:21, End Time: 2012-11-15 02:55:03 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (172 on baseline) Performance Improvements: 2 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1038 (718 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.53% (2.3745 => 2.4109, std.dev.: 0.0077) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.73% (126.1801 => 130.8831, std.dev.: 0.2849) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.52% (2.0177 => 1.9870, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.10% (2.4174 => 2.3909, std.dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.28% (0.0625 => 0.0883, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.55% (0.1063 => 0.1409, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.14% (0.2969 => 0.3745, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.03% (0.4253 => 0.5360, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.77% (0.1106 => 0.1391, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 24.72% (1.5932 => 1.9870, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.67% (0.4139 => 0.5160, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.00% (0.0475 => 0.0589, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.81% (0.0714 => 0.0884, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.80% (0.5900 => 0.7304, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.55% (0.4994 => 0.6170, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.12% (0.5000 => 0.6156, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.12% (0.0584 => 0.0719, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.59% (0.1620 => 0.1986, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.58% (0.1107 => 0.1357, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.43% (0.1021 => 0.1250, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.07% (0.0897 => 0.1095, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 22.04% (0.0599 => 0.0731, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.17% (0.0822 => 0.0996, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.01% (0.0633 => 0.0766, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 20.99% (0.0948 => 0.1147, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.89% (0.0584 => 0.0706, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.72% (0.0642 => 0.0775, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 20.71% (0.0821 => 0.0991, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.70% (0.0541 => 0.0653, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.68% (0.3903 => 0.4710, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.67% (0.1103 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.40% (0.0495 => 0.0596, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.14% (0.1003 => 0.1205, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 20.14% (0.1619 => 0.1945, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.08% (0.1549 => 0.1860, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.01% (0.1604 => 0.1925, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.86% (0.2014 => 0.2414, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 19.11% (0.0947 => 0.1128, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.02% (0.3890 => 0.4630, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 18.94% (0.0808 => 0.0961) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.88% (0.1462 => 0.1738, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 18.56% (0.1218 => 0.1444, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 18.44% (0.4029 => 0.4772, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.10% (1.3152 => 1.5533, std.dev.: 0.0042) SingleSource/UnitTests/ObjC++/Hello: 17.97% (0.5826 => 0.6873, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.97% (0.2866 => 0.3381, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.92% (0.1088 => 0.1283, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 17.91% (0.0698 => 0.0823, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 17.90% (0.5889 => 0.6943, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 17.74% (0.1505 => 0.1772, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.73% (0.2736 => 0.3221, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.40% (3.5627 => 4.1826, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.36% (0.0605 => 0.0710, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 17.31% (0.5546 => 0.6506, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 17.29% (0.9697 => 1.1374, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.26% (0.4658 => 0.5462, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.24% (0.3271 => 0.3835, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 17.16% (1.8794 => 2.2019, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.02% (0.1968 => 0.2303, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.87% (1.6211 => 1.8945, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.71% (0.5026 => 0.5866, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.70% (0.2875 => 0.3355, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.49% (2.7292 => 3.1792, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.47% (0.1160 => 0.1351, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 16.33% (0.1421 => 0.1653, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 16.29% (1.0781 => 1.2537, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.19% (0.4361 => 0.5067, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 16.15% (0.2750 => 0.3194, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 16.12% (0.2780 => 0.3228, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.07% (0.2738 => 0.3178, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 16.06% (0.2714 => 0.3150, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 16.04% (0.2725 => 0.3162, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.98% (0.3930 => 0.4558, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/except: 15.97% (0.2811 => 0.3260, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.97% (4.4195 => 5.1252, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/bh/bh: 15.97% (0.1284 => 0.1489, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.90% (0.2729 => 0.3163, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 15.83% (0.2823 => 0.3270, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.83% (0.2792 => 0.3234, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 15.81% (0.3004 => 0.3479, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 15.79% (0.9909 => 1.1474, std.dev.: 0.0053) SingleSource/UnitTests/ObjC++/property-reference: 15.79% (0.7171 => 0.8303, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/methcall: 15.78% (0.2813 => 0.3257, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 15.73% (0.2803 => 0.3244, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.68% (0.3195 => 0.3696, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.66% (0.2911 => 0.3367, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.65% (2.0673 => 2.3909, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 15.58% (23.5202 => 27.1839, std.dev.: 0.0061) MultiSource/Applications/ClamAV/clamscan: 15.55% (4.2109 => 4.8656, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wc: 15.47% (0.3096 => 0.3575, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.45% (1.9694 => 2.2736, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary3: 15.43% (0.3267 => 0.3771, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 15.29% (0.3258 => 0.3756, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 15.25% (0.3317 => 0.3823, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.11% (1.9966 => 2.2982, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.95% (0.1090 => 0.1253, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 14.95% (0.3678 => 0.4228, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.71% (0.3488 => 0.4001, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.71% (0.3060 => 0.3510, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 14.69% (0.3465 => 0.3974, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 14.65% (0.3496 => 0.4008, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 14.63% (0.3446 => 0.3950, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 14.61% (0.3348 => 0.3837, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.60% (0.3362 => 0.3853, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 14.60% (0.2075 => 0.2378, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.59% (0.3282 => 0.3761, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 14.59% (0.3469 => 0.3975, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.57% (0.3625 => 0.4153, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.56% (0.3124 => 0.3579, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 14.54% (0.4146 => 0.4749, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 14.54% (0.2566 => 0.2939, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 14.53% (0.3442 => 0.3942, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.51% (0.3460 => 0.3962, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 14.36% (0.3726 => 0.4261, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 14.29% (0.3477 => 0.3974, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 14.29% (1.4269 => 1.6308, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 14.27% (0.3650 => 0.4171, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.25% (0.3845 => 0.4393, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 14.19% (0.3643 => 0.4160, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.94% (0.3724 => 0.4243, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 13.88% (0.4251 => 0.4841, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.74% (0.3981 => 0.4528, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.74% (0.3690 => 0.4197, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 13.64% (0.7875 => 0.8949, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 13.48% (2.1653 => 2.4571, std.dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 13.26% (4.6177 => 5.2302, std.dev.: 0.0075) MultiSource/Benchmarks/mafft/pairlocalalign: 13.26% (2.1013 => 2.3800, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 13.19% (0.5012 => 0.5673, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.94% (0.2040 => 0.2304, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 12.56% (0.2691 => 0.3029, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 12.24% (5.5417 => 6.2199, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.01% (0.6435 => 0.7208, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.58% (0.1028 => 0.1147, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.28% (0.1383 => 0.1539, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 11.18% (0.6634 => 0.7376, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 11.15% (0.3498 => 0.3888, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.00% (0.2737 => 0.3038, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.93% (0.2068 => 0.2294, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.77% (0.3084 => 0.3416, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 10.50% (0.4847 => 0.5356, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 10.46% (0.3336 => 0.3685, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.32% (0.2103 => 0.2320, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 9.77% (2.0346 => 2.2333, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 9.70% (0.2391 => 0.2623, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.87% (4.6926 => 5.1090, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.85% (11.6398 => 12.6699, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.77% (0.5361 => 0.5831, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.13% (0.5584 => 0.6038, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.11% (0.7426 => 0.8028, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 6.83% (11.9555 => 12.7726, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.12% (0.3792 => 0.3986, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 9.31% (0.2802 => 0.3063, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6119, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.47% (0.3693 => 0.3895, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6791, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary: 5.18% (0.2122 => 0.2232, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1664, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-2: 4.65% (1.8057 => 1.8897, std.dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: 4.12% (14.0481 => 14.6264, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1936, std.dev.: 0.0091) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.55% (3.1722 => 3.2215, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.48% (7.1849 => 7.2909, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3083, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5141, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5876, std.dev.: 0.0168) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.64% (2.4764 => 2.4109, std.dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5644, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/ary2: -8.16% (0.2402 => 0.2206, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9776, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8086, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.57% (11.2080 => 10.8082, std.dev.: 0.0108) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.05% (0.6293 => 0.6101, std.dev.: 0.0047) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7726, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: -2.56% (17.2379 => 16.7966, std.dev.: 0.0627) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8689, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5772, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4970, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1841, std.dev.: 0.0434) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0442, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 00:48:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 02:48:36 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121115084836.BBF432A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5888?compare_to=5885&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5888, Order: 168024, Start Time: 2012-11-15 07:19:48, End Time: 2012-11-15 08:48:54 To: 5885, Order: 168023, Start Time: 2012-11-15 05:31:51, End Time: 2012-11-15 06:56:51 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (141 on baseline) Unchanged Tests: 1042 (896 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.32% (1.2783 => 1.3719, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.61% (54.5751 => 56.5473, std.dev.: 0.1212) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.67% (2.0478 => 2.1024, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4937 => 7.6672, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/hash2: 2.14% (3.1932 => 3.2614, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.08% (0.1431 => 0.1301, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.11% (0.3821 => 0.3511, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -7.27% (2.4924 => 2.3112, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.91% (0.3142 => 0.2925, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.82% (0.9542 => 0.8891, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.43% (0.2428 => 0.2272, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.35% (0.1796 => 0.1682, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.33% (0.2355 => 0.2206, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: -6.29% (9.2283 => 8.6476, std.dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: -6.29% (0.3357 => 0.3146, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/ReedSolomon: -6.28% (0.1879 => 0.1761, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -6.16% (0.2160 => 0.2027, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.14% (0.3812 => 0.3578, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.13% (0.3880 => 0.3642, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.13% (0.3848 => 0.3612, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.07% (0.4033 => 0.3788, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.06% (0.3896 => 0.3660, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: -6.05% (16.1920 => 15.2125, std.dev.: 0.3389) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.05% (0.5591 => 0.5253, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.03% (0.9852 => 0.9258, std.dev.: 0.0203) SingleSource/UnitTests/ObjC/exceptions-2: -6.00% (0.3831 => 0.3601, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.97% (0.2695 => 0.2534, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.96% (1.6364 => 1.5389, std.dev.: 0.0065) MultiSource/Applications/JM/ldecod/ldecod: -5.96% (7.0961 => 6.6734, std.dev.: 0.1527) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.95% (0.3884 => 0.3653, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: -5.94% (0.4176 => 0.3928, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.92% (0.5857 => 0.5510, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.91% (0.3891 => 0.3661, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.89% (0.6304 => 0.5933, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.87% (0.5805 => 0.5464, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.87% (0.6676 => 0.6284, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.86% (0.6230 => 0.5865, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.83% (0.7524 => 0.7085, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.83% (0.6260 => 0.5895, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.82% (0.5925 => 0.5580, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.81% (0.6297 => 0.5931, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -5.81% (0.4199 => 0.3955, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.80% (0.6189 => 0.5830, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.80% (0.6052 => 0.5701, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.80% (3.5339 => 3.3290, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.78% (0.5569 => 0.5247, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.77% (0.5802 => 0.5467, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.77% (0.6395 => 0.6026, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.77% (0.5478 => 0.5162, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.76% (0.6667 => 0.6283, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.75% (0.6660 => 0.6277, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.73% (0.5570 => 0.5251, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.72% (0.6446 => 0.6077, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.71% (0.7339 => 0.6920, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.69% (4.0323 => 3.8027, std.dev.: 0.0050) MultiSource/Benchmarks/nbench/nbench: -5.69% (1.1530 => 1.0874, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.68% (0.6194 => 0.5842, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.68% (0.7198 => 0.6789, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.68% (0.5849 => 0.5517, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.67% (4.8161 => 4.5431, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.66% (0.5581 => 0.5265, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.66% (0.5705 => 0.5382, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.66% (0.5941 => 0.5605, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.64% (0.5567 => 0.5253, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.63% (0.5859 => 0.5529, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.63% (0.6395 => 0.6035, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.63% (0.6681 => 0.6305, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.62% (4.8802 => 4.6060, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.61% (1.2784 => 1.2067, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.61% (0.5456 => 0.5150, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.60% (6.7716 => 6.3922, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.60% (0.5575 => 0.5263, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.59% (0.5863 => 0.5535, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.57% (0.5688 => 0.5371, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.49% (0.6033 => 0.5702, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.45% (0.6440 => 0.6089, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.44% (0.4151 => 0.3925, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.40% (14.2083 => 13.4414, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/parameter-passing: -5.40% (0.4280 => 0.4049, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.35% (0.3255 => 0.3081, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.34% (0.3016 => 0.2855, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.29% (0.3931 => 0.3723, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/except: -5.29% (0.3026 => 0.2866, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.6736 => 0.6383, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.23% (1.2210 => 1.1571, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.20% (0.3057 => 0.2898, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -5.19% (0.3025 => 0.2868, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.19% (0.3837 => 0.3638, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -5.14% (15.5079 => 14.7110, std.dev.: 0.2723) SingleSource/Benchmarks/Shootout-C++/random: -5.10% (0.2939 => 0.2789, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -5.09% (0.2871 => 0.2725, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -5.02% (0.2989 => 0.2839, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.02% (2.1713 => 2.0624, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/objinst: -5.01% (0.3194 => 0.3034, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -5.00% (0.3059 => 0.2906, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.00% (0.3323 => 0.3157, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.99% (0.2903 => 0.2758, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -4.98% (0.2849 => 0.2707, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.98% (1.2221 => 1.1612, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.98% (0.3252 => 0.3090, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.98% (0.2933 => 0.2787, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.95% (0.5168 => 0.4912, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.95% (1.6474 => 1.5659, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: -4.93% (0.3446 => 0.3276, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -4.91% (0.3481 => 0.3310, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.90% (0.7779 => 0.7398, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: -4.86% (0.3867 => 0.3679, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: -4.85% (0.4248 => 0.4042, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -4.83% (0.3621 => 0.3446, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -4.83% (0.3394 => 0.3230, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -4.76% (3.5154 => 3.3481, std.dev.: 0.0435) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.76% (0.4813 => 0.4584, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.75% (0.3849 => 0.3666, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.75% (0.5329 => 0.5076, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.71% (0.3205 => 0.3054, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.70% (0.7021 => 0.6691, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash2: -4.69% (0.4861 => 0.4633, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.65% (0.6347 => 0.6052, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -4.63% (34.0927 => 32.5129, std.dev.: 0.0346) SingleSource/Benchmarks/Shootout-C++/hash: -4.58% (0.4524 => 0.4317, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.55% (0.9557 => 0.9122, std.dev.: 0.0098) SingleSource/UnitTests/ObjC++/property-reference-object: -4.50% (0.6441 => 0.6151, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.50% (0.4427 => 0.4228, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.49% (0.3319 => 0.3170, std.dev.: 0.0057) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.48% (22.4056 => 21.4019, std.dev.: 0.0116) MultiSource/Applications/oggenc/oggenc: -4.45% (5.0226 => 4.7991, std.dev.: 0.0837) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.38% (0.4083 => 0.3904, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: -4.36% (0.3788 => 0.3623, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -4.30% (2.4021 => 2.2987, std.dev.: 0.0306) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.28% (0.4321 => 0.4136, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.21% (0.4916 => 0.4709, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: -4.07% (0.6750 => 0.6475, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.07% (0.3491 => 0.3349, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.07% (0.9077 => 0.8708, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.06% (2.2587 => 2.1669, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.45% (5.4682 => 5.2793, std.dev.: 0.0142) SingleSource/UnitTests/Vector/constpool: -2.78% (20.7746 => 20.1980, std.dev.: 0.0150) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.50% (7.5137 => 5.7478, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7069) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.61% (2.2633 => 2.1817, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.60% (1.3096 => 1.2756, std.dev.: 0.0110) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.61% (6.5735 => 6.4677, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 00:51:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 02:51:09 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121115085109.57B3D2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5889?compare_to=5886&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5889, Order: 168025, Start Time: 2012-11-15 07:21:09, End Time: 2012-11-15 08:51:28 To: 5886, Order: 168023, Start Time: 2012-11-15 05:31:19, End Time: 2012-11-15 06:58:14 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 9 (68 on baseline) Performance Improvements: 1 (20 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 982 (886 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.49% (0.8744 => 0.9137, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.37% (1.2740 => 1.3042, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.06% (0.4895 => 0.4996, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 19.90% (3.0354 => 3.6394, std.dev.: 0.1108) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.83% (3.2100 => 3.8146, std.dev.: 0.1289) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.26% (1.3581 => 1.4160, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.23% (21.8568 => 22.5621, std.dev.: 0.1389) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.84% (11.5748 => 11.9038, std.dev.: 0.0686) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.40% (13.3157 => 13.6359, std.dev.: 0.0537) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.51% (0.9998 => 0.9847, std.dev.: 0.0057) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.96% (17.0293 => 17.3638, std.dev.: 0.6747) MultiSource/Applications/obsequi/Obsequi: 6.38% (1.0605 => 1.1282, std.dev.: 0.2276) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.01% (22.0674 => 22.0697, std.dev.: 1.1124) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.06% (0.3668 => 0.3707, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/bigfib: -0.94% (0.6147 => 0.6089, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.54% (0.3360 => 0.3378, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.2013 => 0.2013, std.dev.: 0.0722) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 15.62% (0.0160 => 0.0185, std.dev.: 0.0082) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.82% (0.0426 => 0.0414, std.dev.: 0.0132) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.21% (0.0247 => 0.0250, std.dev.: 0.0051) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.93% (0.0307 => 0.0316, std.dev.: 0.0102) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.18% (0.0423 => 0.0428, std.dev.: 0.0151) SingleSource/UnitTests/Vector/Altivec/casts: 39.73% (0.0146 => 0.0204, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/test1: 43.05% (0.0151 => 0.0216, std.dev.: 0.0064) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 7.37% (0.1479 => 0.1588, std.dev.: 0.0105) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 8.00% (1.1544 => 1.2467, std.dev.: 0.3953) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.53% (0.4391 => 0.4236, std.dev.: 0.0400) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.73% (0.1374 => 0.1439, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.70% (0.0582 => 0.0621, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.48% (0.0270 => 0.0266, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.13% (0.0564 => 0.0552, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.20% (1.1972 => 1.1948, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.14% (0.0602 => 0.0645, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 29.57% (0.0186 => 0.0241, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.37% (0.7816 => 0.7923, std.dev.: 0.1445) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 51.95% (0.0077 => 0.0117, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2395.25% (0.6332 => 15.7999, std.dev.: 0.6364) MultiSource/Benchmarks/McCat/08-main/main: 51.94% (0.1831 => 0.2782, std.dev.: 0.0239) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.26% (0.1559 => 0.1477, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1555.59% (0.3344 => 5.5363, std.dev.: 0.2167) SingleSource/Benchmarks/Misc-C++/Large/ray: 39.34% (0.2364 => 0.3294, std.dev.: 0.0188) SingleSource/Benchmarks/Misc/mandel: 5.13% (0.0429 => 0.0451, std.dev.: 0.0112) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.48% (0.0224 => 0.0243, std.dev.: 0.0073) SingleSource/UnitTests/byval-alignment: -25.22% (0.0230 => 0.0172, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 12.11% (0.1462 => 0.1639, std.dev.: 0.0173) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4954, std.dev.: 0.0514) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0736, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4935, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3320, std.dev.: 0.0288) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1448, std.dev.: 0.0337) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4083, std.dev.: 0.0189) SingleSource/Regression/C/uint64_to_float: -24.25% (2.1832 => 1.6538, std.dev.: 0.0070) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.50% (0.0848 => 0.0971, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.01% (0.0830 => 0.0938, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.94% (0.1157 => 0.1272, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.81% (0.8321 => 0.9137, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/mst/mst: 9.18% (0.1177 => 0.1285, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.44% (0.4847 => 0.5256, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.90% (0.7473 => 0.8063, std.dev.: 0.0086) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.52% (0.3137 => 0.3373, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.50% (0.6010 => 0.6461, std.dev.: 0.0125) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.15% (0.2519 => 0.2699, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.61% (0.1983 => 0.2114, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.42% (0.2133 => 0.2270, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.84% (0.2279 => 0.2412, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.67% (1.1606 => 1.2264, std.dev.: 0.0233) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.57% (0.1885 => 0.1990, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.46% (0.3295 => 0.3475, std.dev.: 0.0038) MultiSource/Applications/treecc/treecc: 4.72% (1.9948 => 2.0890, std.dev.: 0.0329) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.48% (1.1685 => 1.2208, std.dev.: 0.0198) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.45% (0.4783 => 0.4996, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.37% (0.9435 => 0.9847, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.12% (1.2526 => 1.3042, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.01% (0.5817 => 0.6050, std.dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 3.74% (1.1271 => 1.1692, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.73% (4.4873 => 4.6547, std.dev.: 0.0110) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.66% (6.6074 => 6.8490, std.dev.: 0.0708) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.48% (0.8316 => 0.8605, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.13% (1.4479 => 1.4932, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.07% (0.8338 => 0.8594, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/football/football: 3.03% (0.8768 => 0.9034, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.01% (0.3717 => 0.3829, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.92% (0.8007 => 0.8241, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.86% (0.8048 => 0.8278, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.81% (4.5702 => 4.6984, std.dev.: 0.0205) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 128.14% (0.0199 => 0.0454, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/pi: 57.20% (1.5795 => 2.4830, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/heapsort: 25.01% (3.0515 => 3.8146, std.dev.: 0.1289) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.43% (2.9753 => 3.4640, std.dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.05% (0.7597 => 0.8816, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.72% (2.7995 => 3.2117, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6093, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.57% (6.3772 => 7.0512, std.dev.: 0.1536) SingleSource/Benchmarks/Shootout/heapsort: 10.53% (3.2926 => 3.6394, std.dev.: 0.1108) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.23% (0.3186 => 0.3480, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.15% (1.1857 => 1.2823, std.dev.: 0.0040) MultiSource/Applications/SIBsim4/SIBsim4: 7.60% (3.1873 => 3.4296, std.dev.: 0.0504) SingleSource/Benchmarks/McGill/queens: 7.55% (1.7056 => 1.8344, std.dev.: 0.0265) SingleSource/Benchmarks/Misc/richards_benchmark: 7.19% (1.3037 => 1.3975, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.55% (4.7794 => 5.0925, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.96% (4.5327 => 4.8030, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.87% (4.9686 => 5.2602, std.dev.: 0.0285) MultiSource/Applications/lambda-0_1_3/lambda: 5.16% (7.4933 => 7.8803, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.05% (6.2275 => 6.5418, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.72% (3.3761 => 3.5353, std.dev.: 0.0392) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.12% (4.9453 => 5.1491, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.08% (4.9469 => 5.1486, std.dev.: 0.0419) MultiSource/Applications/hexxagon/hexxagon: 3.95% (14.0064 => 14.5602, std.dev.: 0.0461) MultiSource/Applications/siod/siod: 3.19% (3.6643 => 3.7812, std.dev.: 0.0323) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.89% (11.5690 => 11.9038, std.dev.: 0.0686) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.67% (8.2783 => 8.4996, std.dev.: 0.0140) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.54% (4.8362 => 4.9591, std.dev.: 0.0340) SingleSource/Benchmarks/Shootout/lists: 2.11% (7.3375 => 7.4921, std.dev.: 0.0384) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.03% (1.1365 => 1.1596, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.00% (1.3882 => 1.4160, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.71% (4.4340 => 4.5096, std.dev.: 0.0259) MultiSource/Applications/spiff/spiff: 1.50% (2.8561 => 2.8988, std.dev.: 0.0140) MultiSource/Benchmarks/FreeBench/neural/neural: 1.32% (1.0841 => 1.0984, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: 1.10% (1.2061 => 1.2194, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.05% (3.5679 => 3.6055, std.dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.06% (5.4641 => 4.3133, std.dev.: 0.4126) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.47% (7.2130 => 6.2414, std.dev.: 0.2461) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.84% (1.0512 => 0.9373, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: -8.48% (63.1822 => 57.8219, std.dev.: 0.0873) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.89% (14.6451 => 13.6359, std.dev.: 0.0537) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.87% (4.7482 => 4.4221, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.52% (0.3269 => 0.3056, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.98% (3.7148 => 3.4928, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.80% (5.4972 => 5.1785, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.06% (5.1557 => 4.8948, std.dev.: 0.0060) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.63% (2.8773 => 2.7441, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.72% (6.0224 => 5.7985, std.dev.: 0.0433) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.05% (28.5821 => 27.7095, std.dev.: 0.0341) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.82% (2.6356 => 2.5612, std.dev.: 0.0211) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -2.67% (0.3937 => 0.3832, std.dev.: 0.0015) MultiSource/Applications/aha/aha: -2.43% (3.3398 => 3.2585, std.dev.: 0.0026) MultiSource/Applications/lua/lua: -1.99% (29.8330 => 29.2386, std.dev.: 0.2016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.91% (11.5316 => 11.3109, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.58% (4.9994 => 4.9205, std.dev.: 0.0239) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.13% (5.6343 => 5.5707, std.dev.: 0.0163) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 5.58% (16.4461 => 17.3638, std.dev.: 0.6747) MultiSource/Applications/obsequi/Obsequi: 9.94% (1.0262 => 1.1282, std.dev.: 0.2276) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6966.83% (0.3123 => 22.0697, std.dev.: 1.1124) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.51% (0.2463 => 0.3707, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/bigfib: 1.31% (0.6010 => 0.6089, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.43% (0.3266 => 0.3378, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/strcat: 2.23% (0.1969 => 0.2013, std.dev.: 0.0722) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 50.41% (0.0123 => 0.0185, std.dev.: 0.0082) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.47% (0.0408 => 0.0414, std.dev.: 0.0132) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.57% (0.0254 => 0.0250, std.dev.: 0.0051) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0102) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.46% (0.0384 => 0.0428, std.dev.: 0.0151) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0064) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 10.43% (0.1438 => 0.1588, std.dev.: 0.0105) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 10.05% (1.1329 => 1.2467, std.dev.: 0.3953) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.73% (0.4164 => 0.4236, std.dev.: 0.0400) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.11% (0.1369 => 0.1439, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.12% (0.0641 => 0.0621, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 36.41% (0.0195 => 0.0266, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.50% (0.0578 => 0.0552, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.47% (1.1437 => 1.1948, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.87% (0.0627 => 0.0645, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 33.89% (0.0180 => 0.0241, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.17% (0.8017 => 0.7923, std.dev.: 0.1445) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 88.71% (0.0062 => 0.0117, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 01:02:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 03:02:46 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121115090246.81F142A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5890?compare_to=5884&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5890, Order: 168024, Start Time: 2012-11-15 06:48:24, End Time: 2012-11-15 09:03:04 To: 5884, Order: 168021, Start Time: 2012-11-15 03:43:20, End Time: 2012-11-15 05:54:39 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 39 (141 on baseline) Performance Improvements: 13 (40 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 986 (706 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/objects/objects: 16.24% (0.1170 => 0.1360, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 15.09% (0.5926 => 0.6820, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 15.05% (0.6165 => 0.7093, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.24% (0.5913 => 0.6755, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.46% (0.6440 => 0.7307, std.dev.: 0.0118) MultiSource/Applications/hexxagon/hexxagon: 12.54% (1.3865 => 1.5603, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 12.15% (0.3711 => 0.4162, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 12.07% (2.6013 => 2.9152, std.dev.: 0.0596) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.69% (1.8605 => 2.0594, std.dev.: 0.0260) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.68% (0.7240 => 0.8013, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.66% (0.3228 => 0.3572, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 10.60% (1.3330 => 1.4743, std.dev.: 0.0188) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.37% (0.1177 => 0.1299, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.18% (0.6879 => 0.7579, std.dev.: 0.0235) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.14% (0.2584 => 0.2846, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.87% (1.7465 => 1.9188, std.dev.: 0.0212) MultiSource/Benchmarks/FreeBench/distray/distray: 9.78% (0.1534 => 0.1684, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 9.61% (1.5977 => 1.7512, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.98% (0.2417 => 0.2634, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: 8.96% (0.9136 => 0.9955, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.79% (1.5180 => 1.6515, std.dev.: 0.0219) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.60% (0.2894 => 0.3143, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 8.42% (0.6245 => 0.6771, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.32% (0.1791 => 0.1940, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.07% (0.3919 => 0.4157, std.dev.: 0.0077) MultiSource/Applications/oggenc/oggenc: 4.62% (6.8108 => 7.1252, std.dev.: 0.0804) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.31% (0.3662 => 0.3820, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/gs/gs: 4.13% (4.9904 => 5.1965, std.dev.: 0.0390) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.97% (21.2235 => 21.6411, std.dev.: 0.0848) MultiSource/Applications/SPASS/SPASS: 1.29% (18.3237 => 18.5607, std.dev.: 0.0672) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 16.71% (0.1215 => 0.1418, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 11.66% (6.3598 => 7.1015, std.dev.: 0.2135) MultiSource/Applications/lemon/lemon: 9.77% (1.4371 => 1.5775, std.dev.: 0.0099) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.61% (0.5783 => 0.6281, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.25% (0.3143 => 0.3371, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 4.24% (3.1446 => 3.2778, std.dev.: 0.0301) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.47% (6.3045 => 6.5234, std.dev.: 0.0296) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.36% (10.1078 => 10.3467, std.dev.: 0.0258) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.69% (48.7205 => 49.5462, std.dev.: 0.0922) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: -11.99% (0.2527 => 0.2224, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -11.21% (0.4494 => 0.3990, std.dev.: 0.0124) MultiSource/Benchmarks/McCat/05-eks/eks: -9.72% (0.5297 => 0.4782, std.dev.: 0.0199) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -7.30% (0.3713 => 0.3442, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -3.02% (12.1625 => 11.7953, std.dev.: 0.0276) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.60% (2.4040 => 2.3416, std.dev.: 0.0123) SingleSource/UnitTests/ObjC/property: -2.30% (0.4791 => 0.4681, std.dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: -1.50% (32.7276 => 32.2360, std.dev.: 0.1008) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: -25.95% (0.1611 => 0.1193, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/moments: -18.08% (0.1482 => 0.1214, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/ft/ft: -7.76% (1.4336 => 1.3224, std.dev.: 0.0380) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -5.73% (0.4611 => 0.4347, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -4.40% (0.3590 => 0.3432, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 2.32% (0.1338 => 0.1369, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.20% (0.0421 => 0.0485, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.00% (0.0651 => 0.0664, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -2.45% (494.0015 => 481.8765, std.dev.: 5.8525) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.89% (4.3882 => 0.0485, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 42630.91% (1.1277 => 481.8765, std.dev.: 5.8525) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 234.90% (0.5229 => 1.7512, std.dev.: 0.0102) MultiSource/Applications/SPASS/SPASS: 23.82% (14.9895 => 18.5607, std.dev.: 0.0672) MultiSource/Applications/kimwitu++/kc: 48.90% (14.1553 => 21.0771, std.dev.: 0.2743) MultiSource/Benchmarks/MallocBench/gs/gs: 26.42% (4.1105 => 5.1965, std.dev.: 0.0390) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 49.48% (1.1048 => 1.6515, std.dev.: 0.0219) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 436.65% (7.1582 => 38.4145, std.dev.: 0.0580) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.23% (3.4629 => 6.3452, std.dev.: 0.1745) SingleSource/Benchmarks/Misc-C++/stepanov_container: 82.82% (0.6222 => 1.1375, std.dev.: 0.0253) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10837.08% (0.0720 => 7.8747, std.dev.: 0.1598) MultiSource/Applications/SIBsim4/SIBsim4: 3875400.00% (0.0001 => 3.8755, std.dev.: 0.0296) MultiSource/Applications/SPASS/SPASS: 14854300.00% (0.0001 => 14.8544, std.dev.: 0.0186) MultiSource/Applications/kimwitu++/kc: 52100.00% (0.0001 => 0.0522, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 64000.00% (0.0001 => 0.0641, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14400.00% (0.0001 => 0.0145, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 628000.00% (0.0001 => 0.6281, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10088800.00% (0.0001 => 10.0889, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5868300.00% (0.0001 => 5.8684, std.dev.: 0.5707) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1833.28% (1.1194 => 21.6411, std.dev.: 0.0848) MultiSource/Applications/ClamAV/clamscan: 69.57% (22.1758 => 37.6038, std.dev.: 0.1401) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 63.13% (2.9384 => 4.7934, std.dev.: 0.2324) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 60.54% (7.0540 => 11.3243, std.dev.: 0.0336) MultiSource/Benchmarks/FreeBench/distray/distray: 59.47% (0.1056 => 0.1684, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.07% (8.1363 => 12.1285, std.dev.: 0.1122) MultiSource/Applications/JM/lencod/lencod: 46.95% (21.9371 => 32.2360, std.dev.: 0.1008) SingleSource/Benchmarks/Misc/flops: 38.69% (0.1432 => 0.1986, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/almabench: 38.63% (0.0730 => 0.1012, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/n-body: 33.51% (0.0746 => 0.0996, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/voronoi/voronoi: 32.30% (0.2700 => 0.3572, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/messages: 32.11% (0.0327 => 0.0432, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 31.88% (0.1236 => 0.1630, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/messages-2: 31.72% (0.0662 => 0.0872, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.86% (1.5859 => 2.0594, std.dev.: 0.0260) SingleSource/UnitTests/vla: 29.30% (0.0355 => 0.0459, std.dev.: 0.0029) MultiSource/Applications/spiff/spiff: 27.06% (0.7835 => 0.9955, std.dev.: 0.0076) MultiSource/Applications/siod/siod: 26.92% (2.2969 => 2.9152, std.dev.: 0.0596) MultiSource/Applications/sgefa/sgefa: 26.02% (0.3109 => 0.3918, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.87% (0.1032 => 0.1299, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/lpbench: 25.40% (0.0929 => 0.1165, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 25.32% (0.2271 => 0.2846, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 25.01% (0.2107 => 0.2634, std.dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: 24.53% (0.0481 => 0.0599, std.dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 24.52% (1.1840 => 1.4743, std.dev.: 0.0188) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 24.48% (1.5415 => 1.9188, std.dev.: 0.0212) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 24.23% (0.6450 => 0.8013, std.dev.: 0.0054) MultiSource/Benchmarks/llubenchmark/llu: 23.81% (0.0462 => 0.0572, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 23.72% (5.7591 => 7.1252, std.dev.: 0.0804) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.46% (0.0648 => 0.0800, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Oscar: 23.27% (0.0636 => 0.0784, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 22.92% (0.6675 => 0.8205, std.dev.: 0.0215) SingleSource/Benchmarks/Misc-C++/Large/ray: 22.66% (0.4064 => 0.4985, std.dev.: 0.0118) SingleSource/UnitTests/ObjC/parameter-passing: 22.26% (0.3927 => 0.4801, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/08-main/main: 22.08% (0.2554 => 0.3118, std.dev.: 0.0191) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 22.08% (0.1114 => 0.1360, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/office/office: 21.81% (0.3136 => 0.3820, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/instance-method-metadata: 21.59% (0.3543 => 0.4308, std.dev.: 0.0083) MultiSource/Applications/hexxagon/hexxagon: 21.50% (1.2842 => 1.5603, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 21.47% (0.1337 => 0.1624, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 21.45% (0.3427 => 0.4162, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.43% (14.3668 => 17.4456, std.dev.: 0.1067) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.39% (0.1566 => 0.1901, std.dev.: 0.0107) SingleSource/UnitTests/ObjC/for-in: 20.93% (0.3694 => 0.4467, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.81% (0.3441 => 0.4157, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 20.75% (0.2603 => 0.3143, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.64% (0.1584 => 0.1911, std.dev.: 0.0116) SingleSource/UnitTests/ObjC/property: 20.46% (0.3886 => 0.4681, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 20.36% (0.1125 => 0.1354, std.dev.: 0.0082) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.12% (0.8172 => 0.9816, std.dev.: 0.0245) MultiSource/Benchmarks/Olden/tsp/tsp: 20.00% (0.1175 => 0.1410, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/espresso/espresso: 19.53% (4.2646 => 5.0974, std.dev.: 0.0715) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 19.38% (0.1625 => 0.1940, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.17% (0.0793 => 0.0945, std.dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 19.03% (9.4845 => 11.2891, std.dev.: 0.0374) MultiSource/Applications/minisat/minisat: 18.99% (0.7115 => 0.8466, std.dev.: 0.0461) SingleSource/UnitTests/SignlessTypes/Large/cast: 18.97% (0.0564 => 0.0671, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.85% (0.0886 => 0.1053, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/health/health: 18.45% (0.1268 => 0.1502, std.dev.: 0.0068) MultiSource/Applications/lemon/lemon: 18.13% (1.0722 => 1.2666, std.dev.: 0.0648) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.05% (0.0770 => 0.0909, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.83% (4.9449 => 5.8268, std.dev.: 0.1041) SingleSource/Benchmarks/Shootout-C++/ary: 17.70% (0.3232 => 0.3804, std.dev.: 0.0121) MultiSource/Applications/lua/lua: 17.67% (3.8723 => 4.5566, std.dev.: 0.1518) MultiSource/Applications/sqlite3/sqlite3: 17.48% (17.1811 => 20.1852, std.dev.: 0.1854) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.10% (0.0842 => 0.0986, std.dev.: 0.0049) SingleSource/UnitTests/SignlessTypes/rem: 17.05% (0.1144 => 0.1339, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.99% (0.0871 => 0.1019, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.83% (0.1117 => 0.1305, std.dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.53% (0.3121 => 0.3637, std.dev.: 0.0189) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.05% (0.0953 => 0.1106, std.dev.: 0.0045) MultiSource/Applications/d/make_dparser: 15.73% (3.3354 => 3.8600, std.dev.: 0.1466) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.64% (0.9765 => 1.1292, std.dev.: 0.0532) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.55% (5.0018 => 5.7797, std.dev.: 0.0479) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 15.44% (0.5569 => 0.6429, std.dev.: 0.0333) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.25% (0.2891 => 0.3332, std.dev.: 0.0122) MultiSource/Applications/viterbi/viterbi: 15.05% (0.1555 => 0.1789, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 14.78% (0.3098 => 0.3556, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.68% (0.2758 => 0.3163, std.dev.: 0.0134) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.64% (0.1940 => 0.2224, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 14.46% (1.1642 => 1.3326, std.dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.88% (0.5981 => 0.6811, std.dev.: 0.0214) MultiSource/Benchmarks/Bullet/bullet: 13.84% (63.2438 => 71.9969, std.dev.: 0.1116) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.80% (0.1029 => 0.1171, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 13.77% (10.3673 => 11.7953, std.dev.: 0.0276) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.43% (1.3050 => 1.4802, std.dev.: 0.0677) SingleSource/UnitTests/ObjC/synchronized: 13.42% (0.3561 => 0.4039, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.41% (0.3826 => 0.4339, std.dev.: 0.0187) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.01% (0.1906 => 0.2154, std.dev.: 0.0085) MultiSource/Applications/treecc/treecc: 12.67% (2.0273 => 2.2841, std.dev.: 0.0415) MultiSource/Benchmarks/FreeBench/mason/mason: 12.58% (0.0811 => 0.0913, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.16% (0.8101 => 0.9086, std.dev.: 0.0361) MultiSource/Benchmarks/sim/sim: 9.95% (0.3387 => 0.3724, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.55% (0.2430 => 0.2662, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.32% (0.3650 => 0.3990, std.dev.: 0.0124) SingleSource/UnitTests/ObjC++/property-reference: 9.13% (0.7326 => 0.7995, std.dev.: 0.0255) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.86% (0.3162 => 0.3442, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.33% (2.2022 => 2.3416, std.dev.: 0.0123) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.01% (7.9617 => 8.3608, std.dev.: 0.0664) SingleSource/UnitTests/Vector/constpool: 2.96% (54.1659 => 55.7666, std.dev.: 0.1703) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.83% (4.3953 => 11.0249, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/methcall: 147.62% (5.3999 => 13.3711, std.dev.: 0.0036) MultiSource/Benchmarks/llubenchmark/llu: 54.94% (3.7781 => 5.8536, std.dev.: 0.6134) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 23.61% (13.4384 => 16.6112, std.dev.: 0.3902) MultiSource/Applications/minisat/minisat: 21.03% (9.1159 => 11.0330, std.dev.: 0.2795) SingleSource/Benchmarks/Misc/oourafft: 17.61% (6.6465 => 7.8168, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.55% (1.1145 => 1.3101, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.58% (0.0864 => 0.0990, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.59% (0.2944 => 0.3344, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.72% (2.8904 => 3.2292, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: 10.28% (1.1396 => 1.2568, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.80% (0.3070 => 0.3371, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 9.68% (3.1578 => 3.4634, std.dev.: 0.0847) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.62% (8.6802 => 9.5156, std.dev.: 0.1950) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.28% (1.7254 => 1.8855, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 9.24% (0.1298 => 0.1418, std.dev.: 0.0040) MultiSource/Applications/lemon/lemon: 9.09% (1.4460 => 1.5775, std.dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.88% (4.2280 => 4.4765, std.dev.: 0.0069) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627) MultiSource/Applications/lua/lua: 4.66% (26.0924 => 27.3089, std.dev.: 0.1689) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 4.61% (3.1334 => 3.2778, std.dev.: 0.0301) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.6436 => 12.1346, std.dev.: 0.0071) MultiSource/Applications/sgefa/sgefa: 3.54% (0.6223 => 0.6443, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: 2.92% (2.4116 => 2.4821, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.62% (2.1424 => 2.1986, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.44% (1.7133 => 1.7551, std.dev.: 0.0159) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.16% (1.3677 => 1.3972, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 2.13% (85.0658 => 86.8797, std.dev.: 0.0411) MultiSource/Benchmarks/Olden/em3d/em3d: 2.12% (3.1023 => 3.1682, std.dev.: 0.0243) MultiSource/Applications/aha/aha: 2.07% (3.1595 => 3.2248, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.80% (2.3135 => 2.3551, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 1.64% (27.8444 => 28.2999, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/lists: 1.56% (12.5348 => 12.7304, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.51% (6.5088 => 6.6070, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout/sieve: 1.35% (5.2139 => 5.2841, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.26% (1.0313 => 1.0443, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0503, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1674, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.78% (5.2763 => 1.2251, std.dev.: 0.0469) SingleSource/Benchmarks/Misc/salsa20: -74.08% (0.8651 => 0.2242, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/richards_benchmark: -45.01% (0.1622 => 0.0892, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -9.14% (5.3855 => 4.8930, std.dev.: 0.0918) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.13% (5.3526 => 4.8640, std.dev.: 0.0976) MultiSource/Applications/JM/ldecod/ldecod: -7.64% (10.4361 => 9.6387, std.dev.: 0.0547) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.72% (0.0506 => 0.0305, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.70% (0.3987 => 0.2404, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.33% (4.5009 => 2.7758, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -25.69% (10.7105 => 7.9589, std.dev.: 0.1496) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.15% (2.6546 => 2.0136, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: -19.48% (0.2161 => 0.1740, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4257, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2838, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.67% (32.5116 => 29.0413, std.dev.: 0.0206) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -10.07% (9.5636 => 8.6004, std.dev.: 0.2124) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.05% (1.5660 => 1.4243, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.74% (3.2416 => 3.0230, std.dev.: 0.0185) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.57% (2.7294 => 2.5774, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.17% (0.2497 => 0.2368, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -5.00% (19.9488 => 18.9510, std.dev.: 0.2573) SingleSource/Benchmarks/Misc/flops-5: -4.92% (1.5835 => 1.5056, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: -4.13% (6.2999 => 6.0399, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.78% (1.6805 => 1.6170, std.dev.: 0.0209) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.40% (0.9957 => 0.9618, std.dev.: 0.0089) MultiSource/Benchmarks/sim/sim: -2.99% (5.0483 => 4.8975, std.dev.: 0.0034) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.35% (0.4808 => 0.4695, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.82% (8.1563 => 8.0080, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6770, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -1.45% (10.2830 => 10.1335, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -7.81% (0.1485 => 0.1369, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.62% (0.2116 => 0.0664, std.dev.: 0.0009) Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 02:34:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 04:34:43 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121115103443.571462A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5891?compare_to=5889&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5891, Order: 168031, Start Time: 2012-11-15 09:08:16, End Time: 2012-11-15 10:35:02 To: 5889, Order: 168025, Start Time: 2012-11-15 07:21:09, End Time: 2012-11-15 08:51:28 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 2 (119 on baseline) Performance Improvements: 26 (27 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 964 (828 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.29% (1.3685 => 1.3862, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.20% (0.9847 => 0.9965, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.27% (0.8995 => 0.8431, std.dev.: 0.0206) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.23% (0.3218 => 0.3082, std.dev.: 0.0053) MultiSource/Applications/hbd/hbd: -3.83% (1.5337 => 1.4750, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/08-main/main: -3.63% (0.2782 => 0.2681, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/gs/gs: -3.60% (4.4056 => 4.2468, std.dev.: 0.0490) MultiSource/Applications/sqlite3/sqlite3: -3.11% (15.7999 => 15.3081, std.dev.: 0.1332) MultiSource/Applications/lua/lua: -3.04% (4.0781 => 3.9540, std.dev.: 0.0199) MultiSource/Applications/SIBsim4/SIBsim4: -2.37% (1.3112 => 1.2801, std.dev.: 0.0117) MultiSource/Applications/minisat/minisat: -2.18% (0.7247 => 0.7089, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: -2.07% (0.7858 => 0.7695, std.dev.: 0.0050) MultiSource/Applications/ClamAV/clamscan: -1.98% (15.4376 => 15.1319, std.dev.: 0.0744) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.75% (0.9092 => 0.8933, std.dev.: 0.0051) MultiSource/Applications/d/make_dparser: -1.67% (3.3800 => 3.3237, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.52% (0.8605 => 0.8474, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: -1.38% (1.3059 => 1.2879, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.34% (0.8267 => 0.8156, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: -1.32% (15.8440 => 15.6351, std.dev.: 0.0661) MultiSource/Applications/SPASS/SPASS: -1.28% (14.9154 => 14.7245, std.dev.: 0.0396) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/minisat/minisat: -10.41% (6.8707 => 6.1555, std.dev.: 0.2030) SingleSource/Benchmarks/Stanford/Puzzle: -6.43% (0.1710 => 0.1600, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bisort/bisort: -2.24% (0.6687 => 0.6537, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.51% (2.9677 => 2.9230, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.45% (5.9380 => 5.8517, std.dev.: 0.0192) MultiSource/Applications/SIBsim4/SIBsim4: -1.41% (3.4296 => 3.3814, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.33% (4.5096 => 4.4495, std.dev.: 0.0164) MultiSource/Applications/lua/lua: -1.22% (29.2386 => 28.8818, std.dev.: 0.0406) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -2.34% (17.3638 => 16.9579, std.dev.: 0.0807) MultiSource/Applications/obsequi/Obsequi: -6.10% (1.1282 => 1.0594, std.dev.: 0.0183) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.41% (22.0697 => 22.1610, std.dev.: 0.1581) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.94% (0.3707 => 0.3672, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: -0.08% (0.6089 => 0.6084, std.dev.: 0.0241) SingleSource/Benchmarks/Shootout-C++/reversefile: -1.18% (0.3378 => 0.3338, std.dev.: 0.0448) SingleSource/Benchmarks/Shootout-C++/strcat: -0.35% (0.2013 => 0.2006, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 11.89% (0.0185 => 0.0207, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.35% (0.0414 => 0.0432, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 33.20% (0.0250 => 0.0333, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -17.72% (0.0316 => 0.0260, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0428 => 0.0428, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0204 => 0.0205, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: -10.19% (0.0216 => 0.0194, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -7.24% (0.1588 => 0.1473, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -3.37% (1.2467 => 1.2047, std.dev.: 0.0296) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.19% (0.4236 => 0.4456, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.22% (0.1439 => 0.1407, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.06% (0.0621 => 0.0640, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -24.44% (0.0266 => 0.0201, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.07% (0.0552 => 0.0580, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.19% (1.1948 => 1.1971, std.dev.: 0.0158) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -77.42% (0.0031 => 0.0007, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.37% (0.0645 => 0.0591, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.69% (0.0241 => 0.0208, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.53% (0.7923 => 0.7802, std.dev.: 0.0247) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -62.39% (0.0117 => 0.0044, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2317.58% (0.6332 => 15.3081, std.dev.: 0.1332) MultiSource/Benchmarks/McCat/08-main/main: 46.42% (0.1831 => 0.2681, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.52% (0.1559 => 0.1473, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1533.28% (0.3344 => 5.4617, std.dev.: 0.3477) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.61% (0.2364 => 0.3253, std.dev.: 0.0460) SingleSource/Benchmarks/Misc/mandel: 4.20% (0.0429 => 0.0447, std.dev.: 0.0140) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.25% (0.0224 => 0.0238, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -26.09% (0.0230 => 0.0170, std.dev.: 0.0012) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 10.40% (0.1462 => 0.1614, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4702, std.dev.: 0.0116) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0751, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4941, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3188, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1551, std.dev.: 0.0842) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4192, std.dev.: 0.0722) SingleSource/Regression/C/uint64_to_float: -23.92% (2.1832 => 1.6609, std.dev.: 0.0031) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.30% (0.0810 => 0.0942, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.15% (0.0848 => 0.0951, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 11.24% (0.1112 => 0.1237, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/04-bisect/bisect: 8.97% (0.1137 => 0.1239, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.91% (0.1425 => 0.1552, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.76% (0.2180 => 0.2371, std.dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.13% (0.3137 => 0.3392, std.dev.: 0.0082) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.04% (0.8321 => 0.8990, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.69% (0.7473 => 0.8048, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.50% (0.2279 => 0.2450, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.71% (0.6010 => 0.6413, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.61% (0.2133 => 0.2274, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.21% (0.1885 => 0.2002, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.62% (0.9435 => 0.9965, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.62% (0.1905 => 0.2012, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.52% (0.3295 => 0.3477, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.46% (0.3003 => 0.3167, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 5.38% (1.2222 => 1.2879, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.33% (0.5961 => 0.6279, std.dev.: 0.0082) MultiSource/Applications/spiff/spiff: 4.73% (0.7950 => 0.8326, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.39% (1.3279 => 1.3862, std.dev.: 0.0067) MultiSource/Applications/sgefa/sgefa: 4.23% (0.2999 => 0.3126, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.17% (1.1271 => 1.1741, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.07% (0.4127 => 0.4295, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.01% (1.2526 => 1.3028, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.97% (0.5817 => 0.6048, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.93% (1.1170 => 1.1609, std.dev.: 0.0052) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.93% (6.6074 => 6.8670, std.dev.: 0.0494) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.85% (4.1763 => 4.3369, std.dev.: 0.0300) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.75% (4.4873 => 4.6554, std.dev.: 0.0129) MultiSource/Applications/minisat/minisat: 3.73% (0.6834 => 0.7089, std.dev.: 0.0026) MultiSource/Applications/lua/lua: 3.54% (3.8189 => 3.9540, std.dev.: 0.0199) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.53% (1.1685 => 1.2098, std.dev.: 0.0153) MultiSource/Benchmarks/McCat/05-eks/eks: 3.46% (0.4397 => 0.4549, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 3.37% (1.4269 => 1.4750, std.dev.: 0.0098) MultiSource/Applications/SPASS/SPASS: 3.25% (14.2605 => 14.7245, std.dev.: 0.0396) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.16% (1.6386 => 1.6903, std.dev.: 0.0179) MultiSource/Applications/treecc/treecc: 3.08% (1.9948 => 2.0563, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.00% (0.8611 => 0.8869, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 2.98% (2.2184 => 2.2844, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.92% (8.6476 => 8.8997, std.dev.: 0.0817) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.91% (13.1811 => 13.5649, std.dev.: 0.0925) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.88% (0.3717 => 0.3824, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.80% (0.9069 => 0.9323, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.80% (0.8007 => 0.8231, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.73% (0.8697 => 0.8934, std.dev.: 0.0082) MultiSource/Applications/d/make_dparser: 2.69% (3.2366 => 3.3237, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.69% (4.5702 => 4.6931, std.dev.: 0.0370) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.59% (0.8457 => 0.8676, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.55% (4.4880 => 4.6025, std.dev.: 0.0403) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.54% (0.9056 => 0.9286, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 2.53% (31.8598 => 32.6657, std.dev.: 0.0343) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.49% (0.8716 => 0.8933, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.48% (0.8805 => 0.9023, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.47% (0.8331 => 0.8537, std.dev.: 0.0067) MultiSource/Applications/ClamAV/clamscan: 2.46% (14.7684 => 15.1319, std.dev.: 0.0744) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.45% (0.8597 => 0.8808, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.44% (0.8204 => 0.8404, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.42% (0.8261 => 0.8461, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.41% (0.8050 => 0.8244, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.41% (0.8066 => 0.8260, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.39% (1.4479 => 1.4825, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.39% (0.8086 => 0.8279, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.39% (0.7966 => 0.8156, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.36% (0.8656 => 0.8860, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.34% (0.8069 => 0.8258, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.33% (0.9074 => 0.9285, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.32% (0.9039 => 0.9249, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 2.31% (4.9628 => 5.0772, std.dev.: 0.0348) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.29% (0.8855 => 0.9058, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.24% (0.7932 => 0.8110, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 2.20% (1.0945 => 1.1186, std.dev.: 0.0053) MultiSource/Benchmarks/PAQ8p/paq8p: 2.20% (2.3764 => 2.4287, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.20% (0.9688 => 0.9901, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.17% (0.8420 => 0.8603, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.16% (0.8177 => 0.8354, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.14% (0.8885 => 0.9075, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.13% (0.8712 => 0.8898, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.11% (0.9810 => 1.0017, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.11% (0.8359 => 0.8535, std.dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 2.00% (15.3280 => 15.6351, std.dev.: 0.0661) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.00% (0.8048 => 0.8209, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.99% (0.9908 => 1.0105, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.98% (0.8286 => 0.8450, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.90% (0.8518 => 0.8680, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.90% (0.8316 => 0.8474, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.88% (0.8338 => 0.8495, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 1.83% (0.7557 => 0.7695, std.dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: 1.79% (8.6247 => 8.7792, std.dev.: 0.0136) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.79% (0.8995 => 0.9156, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.63% (0.6943 => 0.7056, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 112.56% (0.0199 => 0.0423, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/pi: 58.01% (1.5795 => 2.4957, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.32% (2.9753 => 3.4608, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.12% (0.7597 => 0.8822, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.71% (2.7995 => 3.2113, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6086, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.14% (1.1857 => 1.2822, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.73% (4.7794 => 5.1012, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: 6.36% (1.3037 => 1.3866, std.dev.: 0.0229) MultiSource/Applications/SIBsim4/SIBsim4: 6.09% (3.1873 => 3.3814, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.89% (4.5327 => 4.7997, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.88% (4.9686 => 5.2607, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.71% (0.3186 => 0.3368, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.83% (6.2275 => 6.5283, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 4.57% (7.4933 => 7.8357, std.dev.: 0.0299) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.54% (3.3761 => 3.5293, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.14% (4.9453 => 5.1498, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.04% (4.9469 => 5.1470, std.dev.: 0.0098) MultiSource/Applications/hexxagon/hexxagon: 3.87% (14.0064 => 14.5483, std.dev.: 0.0207) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.54% (0.3587 => 0.3714, std.dev.: 0.0029) MultiSource/Applications/siod/siod: 2.90% (3.6643 => 3.7705, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.82% (8.2783 => 8.5119, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.78% (11.5690 => 11.8909, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout/lists: 2.31% (7.3375 => 7.5072, std.dev.: 0.0608) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (1.1365 => 1.1624, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.10% (4.8362 => 4.9377, std.dev.: 0.0358) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.56% (1.5941 => 1.6190, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.41% (2.4647 => 2.4995, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.31% (5.4641 => 4.2996, std.dev.: 0.0243) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.38% (7.2130 => 6.3923, std.dev.: 0.2402) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.86% (1.0512 => 0.9370, std.dev.: 0.0064) SingleSource/Benchmarks/McGill/chomp: -10.65% (1.1216 => 1.0021, std.dev.: 0.0423) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.44% (14.6451 => 13.4091, std.dev.: 0.1661) MultiSource/Benchmarks/mafft/pairlocalalign: -8.36% (63.1822 => 57.9004, std.dev.: 0.1064) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.88% (0.3269 => 0.3044, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.81% (4.7482 => 4.4247, std.dev.: 0.0257) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.95% (3.7148 => 3.4936, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.76% (5.4972 => 5.1808, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.05% (5.1557 => 4.8954, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.42% (4.7449 => 4.5352, std.dev.: 0.0072) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.91% (2.8773 => 2.7647, std.dev.: 0.0357) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.80% (6.0224 => 5.7935, std.dev.: 0.0145) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.25% (0.5807 => 0.5618, std.dev.: 0.0050) MultiSource/Applications/lua/lua: -3.19% (29.8330 => 28.8818, std.dev.: 0.0406) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.03% (28.5821 => 27.7162, std.dev.: 0.0856) MultiSource/Applications/aha/aha: -2.65% (3.3398 => 3.2514, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -2.62% (0.3937 => 0.3834, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.55% (2.6356 => 2.5683, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.45% (9.9065 => 9.6633, std.dev.: 0.0122) MultiSource/Benchmarks/FreeBench/mason/mason: -2.18% (0.5415 => 0.5297, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: -2.15% (3.4237 => 3.3500, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.98% (11.5316 => 11.3029, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.65% (4.9994 => 4.9170, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.38% (3.2169 => 3.1724, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.16% (5.6343 => 5.5691, std.dev.: 0.0030) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 3.11% (16.4461 => 16.9579, std.dev.: 0.0807) MultiSource/Applications/obsequi/Obsequi: 3.24% (1.0262 => 1.0594, std.dev.: 0.0183) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6996.06% (0.3123 => 22.1610, std.dev.: 0.1581) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.09% (0.2463 => 0.3672, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 1.23% (0.6010 => 0.6084, std.dev.: 0.0241) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.20% (0.3266 => 0.3338, std.dev.: 0.0448) SingleSource/Benchmarks/Shootout-C++/strcat: 1.88% (0.1969 => 0.2006, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 68.29% (0.0123 => 0.0207, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.88% (0.0408 => 0.0432, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -13.91% (0.0302 => 0.0260, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.46% (0.0384 => 0.0428, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: 7.78% (0.0180 => 0.0194, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 2.43% (0.1438 => 0.1473, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 6.34% (1.1329 => 1.2047, std.dev.: 0.0296) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 7.01% (0.4164 => 0.4456, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.78% (0.1369 => 0.1407, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.16% (0.0641 => 0.0640, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.08% (0.0195 => 0.0201, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.35% (0.0578 => 0.0580, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.67% (1.1437 => 1.1971, std.dev.: 0.0158) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 600.00% (0.0001 => 0.0007, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.74% (0.0627 => 0.0591, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.56% (0.0180 => 0.0208, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.68% (0.8017 => 0.7802, std.dev.: 0.0247) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -29.03% (0.0062 => 0.0044, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 02:37:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 04:37:18 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121115103718.170A02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5892?compare_to=5888&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5892, Order: 168031, Start Time: 2012-11-15 09:12:40, End Time: 2012-11-15 10:37:36 To: 5888, Order: 168024, Start Time: 2012-11-15 07:19:48, End Time: 2012-11-15 08:48:54 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (182 on baseline) Unchanged Tests: 1041 (855 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.12% (1.2756 => 1.2899, std.dev.: 0.0038) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.87% (2.0478 => 2.1065, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/salsa20: 2.39% (7.4937 => 7.6730, std.dev.: 0.0092) MultiSource/Benchmarks/llubenchmark/llu: 2.12% (3.7435 => 3.8229, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/hash2: 2.10% (3.1932 => 3.2601, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.03% (0.3821 => 0.3514, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -7.21% (2.4924 => 2.3128, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -7.07% (0.3831 => 0.3560, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -7.06% (0.3812 => 0.3543, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.96% (0.3880 => 0.3610, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.95% (0.3884 => 0.3614, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: -6.94% (0.4033 => 0.3753, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -6.94% (0.3357 => 0.3124, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.94% (0.3142 => 0.2924, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -6.89% (0.3848 => 0.3583, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -6.88% (0.3896 => 0.3628, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.83% (0.9542 => 0.8890, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.81% (0.3891 => 0.3626, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -6.75% (0.4176 => 0.3894, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -6.48% (0.4199 => 0.3927, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.38% (0.2428 => 0.2273, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -6.28% (9.2283 => 8.6486, std.dev.: 0.0113) MultiSource/Applications/JM/lencod/lencod: -6.24% (16.1920 => 15.1817, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.23% (1.0544 => 0.9887, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: -6.23% (0.1879 => 0.1762, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: -6.19% (0.4280 => 0.4015, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.18% (0.1796 => 0.1685, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.17% (0.5591 => 0.5246, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.17% (0.6484 => 0.6084, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.13% (0.5478 => 0.5142, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.09% (0.9852 => 0.9252, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -6.08% (0.1761 => 0.1654, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.06% (1.3722 => 1.2890, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.04% (0.3658 => 0.3437, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.03% (0.5857 => 0.5504, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.02% (0.3057 => 0.2873, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -6.02% (0.2160 => 0.2030, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.02% (0.6681 => 0.6279, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: -6.01% (7.0961 => 6.6696, std.dev.: 0.0246) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.99% (0.5925 => 0.5570, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.97% (0.6260 => 0.5886, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.96% (0.6189 => 0.5820, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.96% (0.5805 => 0.5459, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.93% (0.6676 => 0.6280, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -5.92% (0.3025 => 0.2846, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.91% (0.7524 => 0.7079, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.91% (0.6667 => 0.6273, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.90% (0.2695 => 0.2536, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.89% (0.5569 => 0.5241, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.88% (3.5339 => 3.3260, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.88% (0.6194 => 0.5830, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -5.87% (0.3255 => 0.3064, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.86% (0.5849 => 0.5506, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: -5.86% (0.9179 => 0.8641, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.86% (1.3148 => 1.2378, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.85% (0.6304 => 0.5935, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.85% (0.2939 => 0.2767, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.85% (0.2871 => 0.2703, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.85% (4.0323 => 3.7964, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.85% (0.6052 => 0.5698, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.83% (0.1716 => 0.1616, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.82% (0.5941 => 0.5595, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.82% (6.7716 => 6.3774, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.81% (0.6230 => 0.5868, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.81% (4.8161 => 4.5364, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.80% (0.7339 => 0.6913, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.80% (2.1713 => 2.0453, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.80% (0.3016 => 0.2841, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.80% (0.6395 => 0.6024, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.80% (0.5863 => 0.5523, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -5.80% (0.7779 => 0.7328, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.80% (0.6660 => 0.6274, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -5.79% (0.3194 => 0.3009, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.79% (1.2300 => 1.1588, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.78% (0.5705 => 0.5375, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -5.77% (0.3205 => 0.3020, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.77% (0.6446 => 0.6074, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.77% (0.5581 => 0.5259, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.76% (0.5570 => 0.5249, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -5.76% (0.2849 => 0.2685, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.75% (0.2903 => 0.2736, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.74% (4.8802 => 4.6000, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/Hello: -5.73% (0.6347 => 0.5983, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.73% (0.4151 => 0.3913, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.73% (0.6297 => 0.5936, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.73% (0.6736 => 0.6350, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.73% (0.6440 => 0.6071, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.73% (0.2933 => 0.2765, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.72% (0.6395 => 0.6029, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.72% (0.5802 => 0.5470, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.72% (0.5575 => 0.5256, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.71% (0.5567 => 0.5249, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.70% (0.5859 => 0.5525, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.70% (0.5456 => 0.5145, std.dev.: 0.0104) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.69% (4.5069 => 4.2504, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/strcat: -5.69% (0.2989 => 0.2819, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.67% (1.6364 => 1.5436, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.66% (1.4642 => 1.3813, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.66% (0.5688 => 0.5366, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -5.66% (0.3446 => 0.3251, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.66% (0.3837 => 0.3620, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -5.65% (0.3026 => 0.2855, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.65% (0.3931 => 0.3709, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -5.62% (0.3059 => 0.2887, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -5.62% (0.6441 => 0.6079, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.61% (0.3406 => 0.3215, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.59% (0.6033 => 0.5696, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.55% (1.2784 => 1.2074, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.54% (0.3483 => 0.3290, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/05-eks/eks: -5.54% (0.4515 => 0.4265, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.52% (14.2083 => 13.4239, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.52% (0.7198 => 0.6801, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: -5.51% (0.3394 => 0.3207, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -5.49% (1.2515 => 1.1828, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary2: -5.46% (0.3481 => 0.3291, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.44% (0.3252 => 0.3075, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.42% (1.2221 => 1.1559, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: -5.41% (4.3330 => 4.0987, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: -5.41% (1.1450 => 1.0831, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -5.39% (0.2985 => 0.2824, std.dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: -5.39% (17.1032 => 16.1813, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/lists: -5.39% (0.3621 => 0.3426, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -5.37% (0.4248 => 0.4020, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -5.33% (0.3581 => 0.3390, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.30% (0.7919 => 0.7499, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: -5.27% (0.2659 => 0.2519, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.26% (0.2548 => 0.2414, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.25% (0.5999 => 0.5684, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.23% (8.0126 => 7.5935, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.22% (0.8521 => 0.8076, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.21% (0.3319 => 0.3146, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.21% (1.2210 => 1.1574, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -5.20% (0.4861 => 0.4608, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.20% (0.2385 => 0.2261, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.19% (0.4916 => 0.4661, std.dev.: 0.0073) MultiSource/Applications/SIBsim4/SIBsim4: -5.18% (1.3864 => 1.3146, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.17% (0.2999 => 0.2844, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: -5.17% (15.5079 => 14.7065, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/lists1: -5.15% (0.3867 => 0.3668, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -5.14% (3.5154 => 3.3346, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.12% (0.6293 => 0.5971, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: -5.08% (1.1530 => 1.0944, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.07% (0.4083 => 0.3876, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.07% (0.5168 => 0.4906, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.00% (0.2001 => 0.1901, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.97% (15.2527 => 14.4946, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.94% (0.3849 => 0.3659, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: -4.91% (0.7447 => 0.7081, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.86% (0.4427 => 0.4212, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.85% (0.3323 => 0.3162, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.84% (0.7021 => 0.6681, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.83% (0.2278 => 0.2168, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.82% (0.5329 => 0.5072, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.80% (1.6474 => 1.5683, std.dev.: 0.0061) MultiSource/Applications/lua/lua: -4.80% (4.0594 => 3.8647, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/sieve: -4.78% (0.3788 => 0.3607, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -4.76% (5.0226 => 4.7833, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash: -4.73% (0.4524 => 0.4310, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.71% (0.9557 => 0.9107, std.dev.: 0.0141) MultiSource/Applications/treecc/treecc: -4.66% (2.1401 => 2.0404, std.dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: -4.62% (34.0927 => 32.5176, std.dev.: 0.0111) MultiSource/Benchmarks/McCat/09-vor/vor: -4.62% (0.3271 => 0.3120, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.55% (22.4056 => 21.3853, std.dev.: 0.0192) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.54% (0.2355 => 0.2248, std.dev.: 0.0029) MultiSource/Applications/siod/siod: -4.45% (2.4021 => 2.2953, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/bigfib: -4.41% (0.6750 => 0.6452, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.37% (0.8418 => 0.8050, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.35% (0.3491 => 0.3339, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -4.18% (18.2933 => 17.5284, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.14% (0.4321 => 0.4142, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -4.13% (0.7982 => 0.7652, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.07% (0.9077 => 0.8708, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.04% (2.2587 => 2.1675, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: -3.53% (1.5610 => 1.5059, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.47% (5.4682 => 5.2784, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -2.26% (20.7746 => 20.3041, std.dev.: 0.0479) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7525, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/richards_benchmark: -8.72% (1.2842 => 1.1722, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.90% (2.2633 => 2.1750, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4698, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.50% (1.3096 => 1.2899, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0001) Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 03:08:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 05:08:22 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121115110822.167562A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5893?compare_to=5887&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5893, Order: 168025, Start Time: 2012-11-15 07:49:10, End Time: 2012-11-15 11:08:05 To: 5887, Order: 168021, Start Time: 2012-11-15 03:42:59, End Time: 2012-11-15 06:58:33 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (171 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1042 (720 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.76% (0.0625 => 0.0886, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.93% (0.1063 => 0.1413, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.88% (0.2969 => 0.3767, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.13% (0.1106 => 0.1395, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.54% (0.4139 => 0.5196, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.39% (0.4253 => 0.5333, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.35% (0.0714 => 0.0895, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.85% (0.5900 => 0.7366, std.dev.: 0.0035) MultiSource/Applications/oggenc/oggenc: 24.65% (1.5932 => 1.9859, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.42% (0.0475 => 0.0591, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.39% (0.4994 => 0.6212, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.31% (0.0547 => 0.0680, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.02% (0.5000 => 0.6201, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 23.84% (0.0948 => 0.1174, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.63% (0.0584 => 0.0722, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.33% (0.1620 => 0.1998, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.11% (0.1021 => 0.1257, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.85% (0.1107 => 0.1360, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 22.37% (0.0599 => 0.0733) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.34% (0.1549 => 0.1895, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.19% (0.0897 => 0.1096, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.92% (0.0584 => 0.0712, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.80% (0.0633 => 0.0771, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.65% (0.3903 => 0.4748, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.50% (0.0642 => 0.0780, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.31% (0.1103 => 0.1338, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.26% (0.0541 => 0.0656, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 21.19% (0.0821 => 0.0995, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.94% (0.1003 => 0.1213, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.92% (0.0822 => 0.0994, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.81% (0.0495 => 0.0598, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 20.70% (0.0947 => 0.1143, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 20.69% (0.1619 => 0.1954, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.64% (0.1604 => 0.1935, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 20.36% (0.0604 => 0.0727, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.29% (0.1462 => 0.1744, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.25% (0.3890 => 0.4639, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 19.21% (0.1218 => 0.1452, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 19.18% (0.0808 => 0.0963, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.17% (0.2014 => 0.2400, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.15% (0.2736 => 0.3260, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 19.00% (0.5826 => 0.6933, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.97% (1.3152 => 1.5647, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/09-vor/vor: 18.80% (0.1505 => 0.1788, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 18.79% (0.4029 => 0.4786, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 18.68% (0.5889 => 0.6989, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.66% (0.1088 => 0.1291, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 18.62% (0.0698 => 0.0828, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.53% (0.0572 => 0.0678, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.53% (0.2866 => 0.3397, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 18.27% (0.5546 => 0.6559, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.99% (0.4658 => 0.5496, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.98% (0.3271 => 0.3859, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.95% (3.5627 => 4.2021, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.83% (0.5026 => 0.5922, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.80% (0.0573 => 0.0675, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.73% (0.1968 => 0.2317, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.69% (1.6211 => 1.9079, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/gs/gs: 17.67% (1.8794 => 2.2115, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.33% (0.1160 => 0.1361, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 17.28% (0.7171 => 0.8410, std.dev.: 0.0095) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.23% (2.7292 => 3.1994, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.19% (0.0605 => 0.0709, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 17.09% (1.0781 => 1.2623, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 16.96% (0.1421 => 0.1662, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.87% (0.2875 => 0.3360, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 16.71% (0.9697 => 1.1317, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.69% (0.4361 => 0.5089, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 16.55% (0.2780 => 0.3240, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.51% (0.3930 => 0.4579, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/except: 16.36% (0.2811 => 0.3271, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: 16.36% (0.1284 => 0.1494, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 16.33% (4.2109 => 4.8984, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.29% (0.2738 => 0.3184, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 16.26% (0.2725 => 0.3168, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.26% (0.3488 => 0.4055, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 16.23% (0.9909 => 1.1517, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.18% (4.4195 => 5.1345, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hello: 15.99% (0.2714 => 0.3148, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.98% (0.2729 => 0.3165, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 15.93% (0.3446 => 0.3995, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/strcat: 15.93% (0.2750 => 0.3188, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.90% (0.2792 => 0.3236, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.89% (1.9966 => 2.3138, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/for-in: 15.88% (0.3496 => 0.4051, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 15.85% (0.3004 => 0.3480, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 15.84% (0.3460 => 0.4008, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.84% (1.9694 => 2.2813, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/synchronized: 15.83% (0.3469 => 0.4018, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 15.82% (0.2813 => 0.3258, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 15.82% (0.3465 => 0.4013, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.80% (0.2911 => 0.3371, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 15.80% (0.2823 => 0.3269) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.78% (0.1090 => 0.1262, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 15.73% (0.2803 => 0.3244, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 15.71% (23.5202 => 27.2156, std.dev.: 0.0315) SingleSource/UnitTests/ObjC/trivial-interface: 15.69% (0.3442 => 0.3982, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 15.67% (0.2566 => 0.2968, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.66% (2.0673 => 2.3910, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wc: 15.50% (0.3096 => 0.3576, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 15.37% (0.3650 => 0.4211, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 15.18% (0.3643 => 0.4196, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 15.15% (0.3267 => 0.3762, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 15.12% (0.3724 => 0.4287, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 15.01% (0.3258 => 0.3747, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.00% (0.3060 => 0.3519, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 14.99% (0.2075 => 0.2386, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 14.83% (0.3317 => 0.3809, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 14.82% (1.4269 => 1.6383, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.44% (0.3124 => 0.3575, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 14.43% (0.3348 => 0.3831, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.43% (0.3362 => 0.3847, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 14.41% (0.3678 => 0.4208, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 14.36% (0.3726 => 0.4261, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 14.31% (0.7875 => 0.9002, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: 14.28% (0.4146 => 0.4738, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 14.24% (0.3477 => 0.3972, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.23% (0.3845 => 0.4392, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.20% (0.3282 => 0.3748, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 14.19% (2.1653 => 2.4726, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.96% (0.3690 => 0.4205, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 13.91% (4.6177 => 5.2599, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.87% (0.3981 => 0.4533, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 13.73% (2.1013 => 2.3898, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 13.60% (0.4251 => 0.4829, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 13.59% (0.0758 => 0.0861, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.19% (0.2040 => 0.2309, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 13.09% (0.5012 => 0.5668, std.dev.: 0.0167) MultiSource/Applications/SIBsim4/SIBsim4: 13.01% (0.2691 => 0.3041, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.87% (0.1383 => 0.1561, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 12.76% (5.5417 => 6.2489, std.dev.: 0.0128) MultiSource/Applications/siod/siod: 11.55% (0.6634 => 0.7400, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.48% (0.1028 => 0.1146, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.44% (0.2737 => 0.3050, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 11.23% (0.3498 => 0.3891, std.dev.: 0.0053) MultiSource/Applications/minisat/minisat: 10.97% (0.3336 => 0.3702, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: 10.77% (0.4847 => 0.5369, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 10.75% (0.2391 => 0.2648, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.57% (0.3084 => 0.3410, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.18% (0.2103 => 0.2317, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 10.09% (2.0346 => 2.2399, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.12% (0.5361 => 0.5850, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.91% (4.6926 => 5.1109, std.dev.: 0.1434) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.75% (11.6398 => 12.6581, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.52% (0.5584 => 0.6060, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.11% (0.7426 => 0.8028, std.dev.: 0.0081) MultiSource/Applications/kimwitu++/kc: 7.12% (11.9555 => 12.8068, std.dev.: 0.0085) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.28% (0.3792 => 0.4030, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 65.40% (0.2162 => 0.3576, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.12% (0.0734 => 0.0867, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 9.56% (0.2802 => 0.3070, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6123, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/ary: 6.50% (0.2122 => 0.2260, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.12% (0.3693 => 0.3919, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6784, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1697, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/flops-2: 4.37% (1.8057 => 1.8846, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/dry: 4.09% (14.0481 => 14.6228, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1995, std.dev.: 0.0039) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2222, std.dev.: 0.0028) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3083, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2859, std.dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.02% (50.0626 => 50.5736, std.dev.: 0.0111) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.01% (2.4764 => 2.4018, std.dev.: 0.0160) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.75% (25.4195 => 16.5859, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/ary2: -7.79% (0.2402 => 0.2215, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9781, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8007, std.dev.: 0.1173) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.71% (11.2080 => 10.7925, std.dev.: 0.0141) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7753, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0132) SingleSource/Benchmarks/Dhrystone/fldry: -2.85% (17.2379 => 16.7460, std.dev.: 0.0918) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8623, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.10% (0.6293 => 0.6161, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5759, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4953, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1591, std.dev.: 0.0550) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 04:03:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 06:03:25 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121115120325.D2D4A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5894?compare_to=5890&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5894, Order: 168031, Start Time: 2012-11-15 09:52:46, End Time: 2012-11-15 12:03:43 To: 5890, Order: 168024, Start Time: 2012-11-15 06:48:24, End Time: 2012-11-15 09:03:04 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 43 (137 on baseline) Performance Improvements: 13 (39 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 982 (711 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.23% (0.6337 => 0.7302, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 15.23% (0.6200 => 0.7144, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 14.72% (0.6741 => 0.7733, std.dev.: 0.0100) MultiSource/Applications/treecc/treecc: 14.24% (2.2841 => 2.6093, std.dev.: 0.0079) MultiSource/Applications/aha/aha: 14.17% (0.1320 => 0.1507, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 14.17% (0.6890 => 0.7866, std.dev.: 0.0095) MultiSource/Applications/Burg/burg: 14.13% (1.3326 => 1.5209, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 13.97% (0.6233 => 0.7104, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 13.25% (0.5930 => 0.6716, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.17% (0.5628 => 0.6369, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/bigfib: 13.04% (0.7269 => 0.8217, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.88% (0.1902 => 0.2147, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/08-main/main: 12.64% (0.3118 => 0.3512, std.dev.: 0.0056) SingleSource/Benchmarks/McGill/exptree: 12.54% (0.0925 => 0.1041, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 12.52% (0.3787 => 0.4261, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.49% (0.8097 => 0.9108, std.dev.: 0.0140) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 12.29% (0.0879 => 0.0987, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 12.22% (2.4828 => 2.7861, std.dev.: 0.0694) MultiSource/Benchmarks/Olden/power/power: 11.63% (0.1453 => 0.1622, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hello: 11.33% (0.2948 => 0.3282, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 10.79% (0.9853 => 1.0916, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.64% (2.2442 => 2.4829, std.dev.: 0.0454) SingleSource/Benchmarks/Shootout-C++/lists1: 9.87% (0.4071 => 0.4473, std.dev.: 0.0119) MultiSource/Benchmarks/FreeBench/neural/neural: 9.64% (0.1619 => 0.1775, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 9.50% (0.3601 => 0.3943, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 9.33% (0.1490 => 0.1629, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.03% (0.4394 => 0.4659, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.80% (0.4157 => 0.4398, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.66% (0.8205 => 0.8669, std.dev.: 0.0101) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.56% (5.0974 => 5.3297, std.dev.: 0.0489) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.35% (0.7307 => 0.7552, std.dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 2.72% (9.6387 => 9.9004, std.dev.: 0.0382) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 23.40% (3.8088 => 4.7002, std.dev.: 0.0321) MultiSource/Benchmarks/Olden/mst/mst: 16.36% (0.1314 => 0.1529, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: 9.02% (1.2168 => 1.3265, std.dev.: 0.0171) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 8.10% (0.3432 => 0.3710, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 7.36% (0.2282 => 0.2450, std.dev.: 0.0058) MultiSource/Applications/siod/siod: 7.24% (3.1728 => 3.4024, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 3.05% (3.1424 => 3.2382, std.dev.: 0.0259) MultiSource/Applications/SPASS/SPASS: 2.97% (14.8544 => 15.2949, std.dev.: 0.0633) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.02% (6.0541 => 6.1764, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.18% (1.3340 => 1.3497, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.04% (32.2576 => 32.5945, std.dev.: 0.0911) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/CoyoteBench/lpbench: -10.90% (0.1165 => 0.1038, std.dev.: 0.0047) MultiSource/Applications/spiff/spiff: -10.14% (0.9955 => 0.8946, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -9.90% (0.3918 => 0.3530, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -8.28% (1.6515 => 1.5148, std.dev.: 0.0394) SingleSource/Benchmarks/Misc/salsa20: -6.42% (0.2242 => 0.2098, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.22% (0.3332 => 0.3158, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -2.22% (21.6411 => 21.1608, std.dev.: 0.1610) MultiSource/Applications/SPASS/SPASS: -2.08% (18.5607 => 18.1755, std.dev.: 0.0308) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -10.70% (7.1015 => 6.3416, std.dev.: 0.0355) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -8.00% (5.9667 => 5.4892, std.dev.: 0.0236) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -5.08% (10.3467 => 9.8211, std.dev.: 0.0311) MultiSource/Applications/sgefa/sgefa: -2.16% (0.6443 => 0.6304, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -1.51% (49.5462 => 48.7997, std.dev.: 0.0935) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -2.34% (0.1369 => 0.1337, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -13.40% (0.0485 => 0.0420, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.96% (0.0664 => 0.0651, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 2.49% (481.8765 => 493.8942, std.dev.: 0.1991) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/power/power: 43696.59% (1.1277 => 493.8942, std.dev.: 0.1991) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.61% (0.5229 => 1.5405, std.dev.: 0.1174) MultiSource/Applications/SPASS/SPASS: 21.25% (14.9895 => 18.1755, std.dev.: 0.0308) MultiSource/Applications/kimwitu++/kc: 48.28% (14.1553 => 20.9900, std.dev.: 0.4795) MultiSource/Benchmarks/MallocBench/gs/gs: 22.03% (4.1105 => 5.0162, std.dev.: 0.0782) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.11% (1.1048 => 1.5148, std.dev.: 0.0394) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 437.04% (7.1582 => 38.4424, std.dev.: 0.1373) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.44% (3.4629 => 6.3525, std.dev.: 0.3028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.73% (0.6222 => 1.0312, std.dev.: 0.0656) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10830.14% (0.0720 => 7.8697, std.dev.: 0.0691) MultiSource/Applications/SIBsim4/SIBsim4: 3881500.00% (0.0001 => 3.8816, std.dev.: 0.0191) MultiSource/Applications/SPASS/SPASS: 15294800.00% (0.0001 => 15.2949, std.dev.: 0.0633) MultiSource/Applications/kimwitu++/kc: 53200.00% (0.0001 => 0.0533, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 65100.00% (0.0001 => 0.0652, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 578600.00% (0.0001 => 0.5787, std.dev.: 0.0234) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10086100.00% (0.0001 => 10.0862, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5717200.00% (0.0001 => 5.7173, std.dev.: 0.6126) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1790.37% (1.1194 => 21.1608, std.dev.: 0.1610) MultiSource/Applications/ClamAV/clamscan: 69.86% (22.1758 => 37.6672, std.dev.: 0.0551) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 59.99% (7.0540 => 11.2859, std.dev.: 0.0136) MultiSource/Benchmarks/FreeBench/distray/distray: 58.33% (0.1056 => 0.1672, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.68% (2.9384 => 4.6332, std.dev.: 0.3456) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.83% (8.1363 => 12.2720, std.dev.: 0.0979) MultiSource/Applications/JM/lencod/lencod: 47.22% (21.9371 => 32.2950, std.dev.: 0.2005) SingleSource/Benchmarks/Misc/flops: 38.90% (0.1432 => 0.1989, std.dev.: 0.0106) SingleSource/Benchmarks/CoyoteBench/almabench: 38.49% (0.0730 => 0.1011, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/08-main/main: 37.51% (0.2554 => 0.3512, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/voronoi/voronoi: 35.37% (0.2700 => 0.3655, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 33.74% (0.0326 => 0.0436, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 31.20% (0.1032 => 0.1354, std.dev.: 0.0025) MultiSource/Applications/aha/aha: 30.93% (0.1151 => 0.1507, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 30.64% (1.1642 => 1.5209, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.87% (0.6675 => 0.8669, std.dev.: 0.0101) SingleSource/UnitTests/vla: 29.86% (0.0355 => 0.0461, std.dev.: 0.0029) MultiSource/Applications/treecc/treecc: 28.71% (2.0273 => 2.6093, std.dev.: 0.0079) SingleSource/Benchmarks/McGill/exptree: 27.89% (0.0814 => 0.1041, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/treeadd/treeadd: 27.88% (0.0416 => 0.0532, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.87% (0.0793 => 0.1014, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 27.81% (0.3441 => 0.4398, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/bigfib: 27.28% (0.6456 => 0.8217, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/functionobjects: 26.87% (0.5020 => 0.6369, std.dev.: 0.0051) MultiSource/Benchmarks/llubenchmark/llu: 26.84% (0.0462 => 0.0586, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 26.67% (0.1695 => 0.2147, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 26.53% (0.2107 => 0.2666, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 26.50% (2.2024 => 2.7861, std.dev.: 0.0694) SingleSource/Benchmarks/McGill/queens: 26.30% (0.0403 => 0.0509, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 25.63% (0.2271 => 0.2853, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/espresso/espresso: 24.98% (4.2646 => 5.3297, std.dev.: 0.0489) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.66% (0.0746 => 0.0930, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists: 24.52% (0.3422 => 0.4261, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.20% (0.1566 => 0.1945, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/matrix: 23.84% (0.0818 => 0.1013, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 23.63% (0.2603 => 0.3218, std.dev.: 0.0058) SingleSource/Benchmarks/McGill/misr: 23.22% (0.0633 => 0.0780, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 22.97% (1.5859 => 1.9502, std.dev.: 0.0809) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 22.96% (0.3427 => 0.4214, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/fbench: 22.64% (0.0592 => 0.0726, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 22.36% (0.8921 => 1.0916, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.98% (14.3668 => 17.5252, std.dev.: 0.1150) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.60% (0.3121 => 0.3795, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/lists1: 21.42% (0.3684 => 0.4473, std.dev.: 0.0119) MultiSource/Benchmarks/FreeBench/neural/neural: 21.33% (0.1463 => 0.1775, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 21.10% (1.2842 => 1.5552, std.dev.: 0.0183) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.96% (0.1584 => 0.1916, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/hello: 20.93% (0.2714 => 0.3282, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: 20.54% (0.3865 => 0.4659, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/tsp/tsp: 20.17% (0.1175 => 0.1412, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 20.15% (2.0665 => 2.4829, std.dev.: 0.0454) SingleSource/Benchmarks/Misc/oourafft: 20.14% (0.3282 => 0.3943, std.dev.: 0.0086) MultiSource/Applications/minisat/minisat: 19.85% (0.7115 => 0.8527, std.dev.: 0.0422) SingleSource/Benchmarks/Misc/whetstone: 19.70% (0.0660 => 0.0790, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.68% (0.1062 => 0.1271, std.dev.: 0.0022) MultiSource/Applications/d/make_dparser: 19.67% (3.3354 => 3.9916, std.dev.: 0.1037) MultiSource/Benchmarks/mafft/pairlocalalign: 19.59% (9.4845 => 11.3427, std.dev.: 0.0119) MultiSource/Applications/lua/lua: 19.32% (3.8723 => 4.6204, std.dev.: 0.1561) MultiSource/Applications/oggenc/oggenc: 19.17% (5.7591 => 6.8629, std.dev.: 0.2045) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.76% (0.1125 => 0.1336, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 18.12% (0.0640 => 0.0756, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.74% (5.0018 => 5.8890, std.dev.: 0.1082) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.70% (0.0842 => 0.0991, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.45% (0.0871 => 0.1023, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.14% (0.8172 => 0.9573, std.dev.: 0.0354) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.10% (1.1861 => 1.3889, std.dev.: 0.0502) MultiSource/Applications/lemon/lemon: 17.08% (1.0722 => 1.2553, std.dev.: 0.0615) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.75% (4.9449 => 5.7732, std.dev.: 0.1256) MultiSource/Applications/sqlite3/sqlite3: 16.67% (17.1811 => 20.0456, std.dev.: 0.2831) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.42% (1.5415 => 1.7946, std.dev.: 0.0787) MultiSource/Benchmarks/Olden/mst/mst: 16.34% (0.1163 => 0.1353, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.08% (0.2065 => 0.2397, std.dev.: 0.0129) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.05% (0.0648 => 0.0752, std.dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.74% (0.0953 => 0.1103, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 15.66% (1.4186 => 1.6408, std.dev.: 0.0676) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.59% (0.0834 => 0.0964, std.dev.: 0.0038) MultiSource/Applications/viterbi/viterbi: 15.24% (0.1555 => 0.1792, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.06% (0.0770 => 0.0886, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.95% (0.1117 => 0.1284, std.dev.: 0.0058) MultiSource/Benchmarks/NPB-serial/is/is: 14.74% (0.0719 => 0.0825, std.dev.: 0.0040) MultiSource/Benchmarks/PAQ8p/paq8p: 14.45% (10.3673 => 11.8658, std.dev.: 0.0248) SingleSource/UnitTests/ObjC/property: 14.44% (0.3886 => 0.4447, std.dev.: 0.0207) MultiSource/Applications/spiff/spiff: 14.18% (0.7835 => 0.8946, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.16% (0.5981 => 0.6828, std.dev.: 0.0251) MultiSource/Benchmarks/Bullet/bullet: 13.85% (63.2438 => 72.0041, std.dev.: 0.1503) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.72% (0.5860 => 0.6664, std.dev.: 0.0291) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.70% (3.8922 => 4.4256, std.dev.: 0.1104) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.59% (0.5105 => 0.5799, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 13.54% (0.3109 => 0.3530, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.51% (0.1510 => 0.1714, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 13.10% (0.2756 => 0.3117, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.97% (1.3050 => 1.4743, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/power/power: 12.64% (0.1440 => 0.1622, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.15% (0.8101 => 0.9085, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.66% (0.8067 => 0.9008, std.dev.: 0.0175) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.44% (0.1906 => 0.2124, std.dev.: 0.0079) MultiSource/Benchmarks/sim/sim: 9.98% (0.3387 => 0.3725, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.24% (0.2891 => 0.3158, std.dev.: 0.0052) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.05% (7.9617 => 8.3635, std.dev.: 0.1101) SingleSource/UnitTests/Vector/constpool: 3.04% (54.1659 => 55.8151, std.dev.: 0.4156) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.68% (4.3953 => 11.0180, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/methcall: 147.76% (5.3999 => 13.3786, std.dev.: 0.0003) MultiSource/Benchmarks/llubenchmark/llu: 84.58% (3.7781 => 6.9737, std.dev.: 0.7800) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 26.09% (13.4384 => 16.9446, std.dev.: 0.2546) MultiSource/Applications/minisat/minisat: 19.80% (9.1159 => 10.9209, std.dev.: 0.3365) MultiSource/Benchmarks/Olden/mst/mst: 18.99% (0.1285 => 0.1529, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.75% (1.1145 => 1.3123, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 17.52% (6.6465 => 7.8110, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.49% (0.2944 => 0.3341, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.66% (2.8904 => 3.2275, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/richards_benchmark: 10.25% (1.1396 => 1.2564, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.84% (0.3070 => 0.3372, std.dev.: 0.0093) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 9.70% (3.1578 => 3.4640, std.dev.: 0.0478) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.30% (1.7254 => 1.8859, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 7.41% (1.4460 => 1.5532, std.dev.: 0.0205) SingleSource/Benchmarks/McGill/chomp: 7.21% (1.2373 => 1.3265, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout/hash: 6.80% (4.9088 => 5.2425, std.dev.: 0.1225) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.92% (0.9540 => 1.0105, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.46% (4.2280 => 4.4587, std.dev.: 0.0041) SingleSource/Regression/C/uint64_to_float: 5.10% (0.5413 => 0.5689, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.79% (26.0924 => 27.3416, std.dev.: 0.0518) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.76% (0.3463 => 0.3628, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.14% (11.6436 => 12.1256, std.dev.: 0.0052) MultiSource/Applications/siod/siod: 3.65% (3.2827 => 3.4024, std.dev.: 0.0087) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: 2.65% (2.4116 => 2.4755, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/tsp/tsp: 2.27% (1.0785 => 1.1030, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 2.14% (85.0658 => 86.8881, std.dev.: 0.0758) MultiSource/Applications/aha/aha: 2.07% (3.1595 => 3.2250, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 1.61% (27.8444 => 28.2939, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 1.48% (12.5348 => 12.7203, std.dev.: 0.0068) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.42% (6.5088 => 6.6009, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/sieve: 1.37% (5.2139 => 5.2851, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.33% (1.0313 => 1.0450, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0502, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1677, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.75% (5.2763 => 1.2265, std.dev.: 0.0529) SingleSource/Benchmarks/Misc/salsa20: -75.75% (0.8651 => 0.2098, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/richards_benchmark: -44.70% (0.1622 => 0.0897, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.41% (5.3855 => 4.7174, std.dev.: 0.0864) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.22% (5.3526 => 4.7520, std.dev.: 0.1319) MultiSource/Applications/JM/ldecod/ldecod: -5.13% (10.4361 => 9.9004, std.dev.: 0.0382) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.95% (0.3987 => 0.2394, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.92% (0.0506 => 0.0304, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.27% (4.5009 => 2.7786, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -33.54% (1.1492 => 0.7638, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.11% (2.6546 => 2.0145, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -23.53% (10.7105 => 8.1903, std.dev.: 0.3528) MultiSource/Benchmarks/FreeBench/mason/mason: -19.20% (0.2161 => 0.1746, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.72% (1.6925 => 1.4265, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.72% (2.6778 => 2.2837, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.69% (32.5116 => 29.0355, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: -10.65% (1.5373 => 1.3736, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4245, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470) MultiSource/Benchmarks/NPB-serial/is/is: -7.59% (9.5636 => 8.8377, std.dev.: 0.1156) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.95% (4.8142 => 4.4795, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.06% (3.2416 => 3.0450, std.dev.: 0.0190) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.55% (2.7294 => 2.5779, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -5.00% (1.5835 => 1.5043, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: -4.24% (6.2999 => 6.0330, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.42% (0.9957 => 0.9616, std.dev.: 0.0106) MultiSource/Benchmarks/sim/sim: -3.07% (5.0483 => 4.8932, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.01% (19.9488 => 19.3475, std.dev.: 0.1721) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.29% (0.4808 => 0.4698, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.02% (8.1563 => 7.9912, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6775, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -1.48% (10.2830 => 10.1309, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.97% (0.1485 => 0.1337, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0015) Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 04:20:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 06:20:30 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121115122030.C4BC72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5895?compare_to=5891&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5895, Order: 168035, Start Time: 2012-11-15 10:53:10, End Time: 2012-11-15 12:20:50 To: 5891, Order: 168031, Start Time: 2012-11-15 09:08:16, End Time: 2012-11-15 10:35:02 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 4 (101 on baseline) Performance Improvements: 1 (23 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 987 (850 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: 6.03% (0.1741 => 0.1846, std.dev.: 0.0040) MultiSource/Applications/SIBsim4/SIBsim4: 1.70% (1.2801 => 1.3018, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: 4.46% (4.3296 => 4.5228, std.dev.: 0.0358) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.24% (1.4177 => 1.4353, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -3.39% (0.9965 => 0.9627, std.dev.: 0.0113) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.08% (16.9579 => 16.9711, std.dev.: 0.3135) MultiSource/Applications/obsequi/Obsequi: 2.32% (1.0594 => 1.0840, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.23% (22.1610 => 22.2124, std.dev.: 0.1403) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.08% (0.3672 => 0.3669, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/bigfib: -0.08% (0.6084 => 0.6079, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.21% (0.3338 => 0.3345, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/strcat: 0.85% (0.2006 => 0.2023, std.dev.: 0.0336) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -7.73% (0.0207 => 0.0191, std.dev.: 0.0077) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.39% (0.0432 => 0.0426, std.dev.: 0.0142) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0333 => 0.0333, std.dev.: 0.0096) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.54% (0.0260 => 0.0256, std.dev.: 0.0109) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0428 => 0.0424, std.dev.: 0.0130) SingleSource/UnitTests/Vector/Altivec/casts: -27.80% (0.0205 => 0.0148, std.dev.: 0.0072) SingleSource/UnitTests/Vector/Altivec/test1: -3.09% (0.0194 => 0.0188, std.dev.: 0.0083) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.27% (0.1473 => 0.1477, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -1.39% (1.2047 => 1.1880, std.dev.: 0.0076) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.19% (0.4456 => 0.4314, std.dev.: 0.0501) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.77% (0.1407 => 0.1446, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.13% (0.0640 => 0.0588, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 38.31% (0.0201 => 0.0278, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.76% (0.0580 => 0.0596, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.56% (1.1971 => 1.2038, std.dev.: 0.0499) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 185.71% (0.0007 => 0.0020, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.89% (0.0591 => 0.0614, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -9.13% (0.0208 => 0.0189, std.dev.: 0.0068) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.05% (0.7802 => 0.7798, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: -66.67% (0.0003 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 29.55% (0.0044 => 0.0057, std.dev.: 0.0062) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2307.80% (0.6332 => 15.2462, std.dev.: 0.1485) MultiSource/Benchmarks/McCat/08-main/main: 46.04% (0.1831 => 0.2674, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.86% (0.1559 => 0.1452, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1524.34% (0.3344 => 5.4318, std.dev.: 0.6337) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.18% (0.2364 => 0.3243, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/mandel: 2.56% (0.0429 => 0.0440, std.dev.: 0.0159) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.79% (0.0224 => 0.0220, std.dev.: 0.0085) SingleSource/UnitTests/byval-alignment: -31.74% (0.0230 => 0.0157, std.dev.: 0.0064) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 8.41% (0.1462 => 0.1585, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4657, std.dev.: 0.0437) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0721, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4941, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3119, std.dev.: 0.3336) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1294, std.dev.: 0.0267) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4072, std.dev.: 0.0355) SingleSource/Regression/C/uint64_to_float: -23.91% (2.1832 => 1.6611, std.dev.: 0.0064) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.16% (0.0810 => 0.0949, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.66% (0.0830 => 0.0960, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.49% (0.0773 => 0.0885, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.82% (0.1905 => 0.2073, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.34% (0.2279 => 0.2469, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.26% (0.2180 => 0.2360, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.32% (0.6010 => 0.6450, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/em3d/em3d: 7.26% (0.1721 => 0.1846, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.91% (0.8321 => 0.8896, std.dev.: 0.0197) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.76% (0.7473 => 0.7978, std.dev.: 0.0131) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.99% (0.1885 => 0.1998, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.93% (0.6287 => 0.6660, std.dev.: 0.0089) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.90% (0.8148 => 0.8629, std.dev.: 0.0133) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.23% (0.3137 => 0.3301, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.08% (1.1685 => 1.2279, std.dev.: 0.0078) MultiSource/Applications/spiff/spiff: 4.91% (0.7950 => 0.8340, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.88% (1.1606 => 1.2172, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.69% (0.2240 => 0.2345, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: 4.63% (1.2222 => 1.2788, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.46% (0.5961 => 0.6227, std.dev.: 0.0052) MultiSource/Applications/lua/lua: 4.24% (3.8189 => 3.9808, std.dev.: 0.0291) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.94% (4.1763 => 4.3409, std.dev.: 0.0498) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.93% (0.4127 => 0.4289, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 3.91% (1.4269 => 1.4827, std.dev.: 0.0094) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.76% (0.4783 => 0.4963, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/gs/gs: 3.75% (4.1305 => 4.2853, std.dev.: 0.0382) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.65% (0.2741 => 0.2841, std.dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 3.58% (1.2568 => 1.3018, std.dev.: 0.0061) MultiSource/Benchmarks/nbench/nbench: 3.52% (1.1271 => 1.1668, std.dev.: 0.0048) MultiSource/Applications/sgefa/sgefa: 3.43% (0.2999 => 0.3102, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.41% (1.2526 => 1.2953, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.40% (0.6227 => 0.6439, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.28% (6.6074 => 6.8241, std.dev.: 0.0459) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.04% (4.4873 => 4.6237, std.dev.: 0.0278) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.98% (0.9069 => 0.9339, std.dev.: 0.0100) MultiSource/Applications/SPASS/SPASS: 2.91% (14.2605 => 14.6760, std.dev.: 0.1025) MultiSource/Applications/ClamAV/clamscan: 2.88% (14.7684 => 15.1944, std.dev.: 0.0578) MultiSource/Applications/minisat/minisat: 2.79% (0.6834 => 0.7025, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.75% (8.6476 => 8.8854, std.dev.: 0.0808) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.73% (0.8317 => 0.8544, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.65% (0.8518 => 0.8744, std.dev.: 0.0052) MultiSource/Applications/siod/siod: 2.62% (2.2184 => 2.2766, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.60% (0.9074 => 0.9310, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.60% (4.5702 => 4.6889, std.dev.: 0.0409) MultiSource/Applications/d/make_dparser: 2.56% (3.2366 => 3.3194, std.dev.: 0.0230) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.52% (13.1811 => 13.5130, std.dev.: 0.0760) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.51% (0.8177 => 0.8382, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (0.9908 => 1.0154, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.39% (0.8712 => 0.8920, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.32% (0.8261 => 0.8453, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.30% (0.8611 => 0.8809, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: 2.29% (31.8598 => 32.5905, std.dev.: 0.1042) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.27% (0.8359 => 0.8549, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.27% (1.4479 => 1.4807, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.18% (0.8805 => 0.8997, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.15% (0.8204 => 0.8380, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.14% (0.8048 => 0.8220, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.12% (1.2602 => 1.2869, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.12% (0.8927 => 0.9116, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.10% (0.8331 => 0.8506, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.09% (0.8716 => 0.8898, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.09% (0.9688 => 0.9890, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.03% (0.7966 => 0.8128, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.02% (0.8420 => 0.8590, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.01% (0.9039 => 0.9221, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.88% (0.8066 => 0.8218, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: 1.79% (0.7557 => 0.7692, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.78% (0.8885 => 0.9043, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.68% (0.8316 => 0.8456, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.66% (0.8338 => 0.8476, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.50% (1.2423 => 1.2609, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 1.38% (8.6247 => 8.7434, std.dev.: 0.0363) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 136.68% (0.0199 => 0.0471, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/pi: 59.05% (1.5795 => 2.5122, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.45% (2.9753 => 3.4648, std.dev.: 0.0379) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.72% (0.7597 => 0.8791, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.57% (2.7995 => 3.2074, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.76% (5.0261 => 5.6170, std.dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.04% (1.1857 => 1.2810, std.dev.: 0.0232) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.34% (6.3772 => 6.8452, std.dev.: 0.1681) SingleSource/Benchmarks/Misc/richards_benchmark: 7.07% (1.3037 => 1.3959, std.dev.: 0.0122) SingleSource/Benchmarks/McGill/queens: 7.06% (1.7056 => 1.8260, std.dev.: 0.0433) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.64% (4.7794 => 5.0967, std.dev.: 0.0053) MultiSource/Applications/SIBsim4/SIBsim4: 6.64% (3.1873 => 3.3989, std.dev.: 0.0336) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.90% (4.5327 => 4.8003, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.84% (4.9686 => 5.2587, std.dev.: 0.0285) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.83% (2.2485 => 2.3571, std.dev.: 0.0248) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.81% (6.2275 => 6.5269, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.64% (3.3761 => 3.5326, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 4.33% (7.4933 => 7.8181, std.dev.: 0.0803) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.16% (4.9469 => 5.1525, std.dev.: 0.0331) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.99% (4.9453 => 5.1427, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.85% (4.3552 => 4.5228, std.dev.: 0.0358) MultiSource/Applications/siod/siod: 2.98% (3.6643 => 3.7734, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.82% (11.5690 => 11.8956, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout/lists: 2.56% (7.3375 => 7.5256, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.26% (1.1365 => 1.1622, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.25% (8.2783 => 8.4647, std.dev.: 0.0244) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.98% (4.8362 => 4.9320, std.dev.: 0.0181) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.43% (2.4647 => 2.4999, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.04% (1.4205 => 1.4353, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.22% (5.4641 => 4.3048, std.dev.: 0.0647) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.13% (7.2130 => 6.4104, std.dev.: 0.1751) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.12% (1.0512 => 0.9343, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.78% (14.6451 => 13.2126, std.dev.: 0.2167) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.93% (0.3269 => 0.2977, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: -8.56% (63.1822 => 57.7756, std.dev.: 0.1167) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.88% (4.7482 => 4.4215, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.13% (3.7148 => 3.4872, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.78% (5.4972 => 5.1797, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.11% (5.1557 => 4.8921, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.35% (4.7449 => 4.5385, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.61% (6.0224 => 5.8050, std.dev.: 0.0355) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.29% (0.5807 => 0.5616, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.19% (2.8773 => 2.7856, std.dev.: 0.0125) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (28.5821 => 27.6716, std.dev.: 0.0432) MultiSource/Applications/aha/aha: -2.59% (3.3398 => 3.2534, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.50% (2.6356 => 2.5697, std.dev.: 0.0205) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.23% (3.2169 => 3.1451, std.dev.: 0.0245) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.16% (9.9065 => 9.6924, std.dev.: 0.0592) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.03% (11.5316 => 11.2971, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.57% (4.9994 => 4.9210, std.dev.: 0.0103) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.3487 => 2.3213, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.12% (5.6343 => 5.5713, std.dev.: 0.0178) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 3.19% (16.4461 => 16.9711, std.dev.: 0.3135) MultiSource/Applications/obsequi/Obsequi: 5.63% (1.0262 => 1.0840, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7012.52% (0.3123 => 22.2124, std.dev.: 0.1403) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.96% (0.2463 => 0.3669, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/bigfib: 1.15% (0.6010 => 0.6079, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.42% (0.3266 => 0.3345, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/strcat: 2.74% (0.1969 => 0.2023, std.dev.: 0.0336) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 55.28% (0.0123 => 0.0191, std.dev.: 0.0077) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0142) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0096) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -15.23% (0.0302 => 0.0256, std.dev.: 0.0109) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0130) SingleSource/UnitTests/Vector/Altivec/casts: -22.11% (0.0190 => 0.0148, std.dev.: 0.0072) SingleSource/UnitTests/Vector/Altivec/test1: 4.44% (0.0180 => 0.0188, std.dev.: 0.0083) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.71% (0.1438 => 0.1477, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 4.86% (1.1329 => 1.1880, std.dev.: 0.0076) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.60% (0.4164 => 0.4314, std.dev.: 0.0501) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.62% (0.1369 => 0.1446, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.27% (0.0641 => 0.0588, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.56% (0.0195 => 0.0278, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.11% (0.0578 => 0.0596, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.25% (1.1437 => 1.2038, std.dev.: 0.0499) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1900.00% (0.0001 => 0.0020, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.07% (0.0627 => 0.0614, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.00% (0.0180 => 0.0189, std.dev.: 0.0068) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.73% (0.8017 => 0.7798, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -8.06% (0.0062 => 0.0057, std.dev.: 0.0062) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 04:25:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 06:25:53 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121115122553.4FCA02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5896?compare_to=5892&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5896, Order: 168035, Start Time: 2012-11-15 11:00:47, End Time: 2012-11-15 12:26:11 To: 5892, Order: 168031, Start Time: 2012-11-15 09:12:40, End Time: 2012-11-15 10:37:36 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (177 on baseline) Unchanged Tests: 1042 (861 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.29% (1.2783 => 1.3715, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.99% (2.0478 => 2.1091, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/salsa20: 2.50% (7.4937 => 7.6810, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/hash2: 2.00% (3.1932 => 3.2572, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.53% (0.1431 => 0.1309, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.90% (0.3821 => 0.3519, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -6.99% (2.4924 => 2.3182, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.89% (0.9542 => 0.8885, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.82% (0.3357 => 0.3128, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.78% (0.3142 => 0.2929, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.75% (0.3880 => 0.3618, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -6.71% (0.3831 => 0.3574, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -6.69% (0.3812 => 0.3557, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -6.67% (0.3896 => 0.3636, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -6.57% (0.3848 => 0.3595, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -6.57% (0.4033 => 0.3768, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.54% (0.3884 => 0.3630, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.50% (0.3891 => 0.3638, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -6.44% (0.4176 => 0.3907, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.40% (0.1796 => 0.1681, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.26% (0.2428 => 0.2276, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -6.23% (0.1879 => 0.1762, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.20% (0.6484 => 0.6082, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: -6.18% (9.2283 => 8.6578, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/oourafft: -6.16% (0.2160 => 0.2027, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.11% (0.2355 => 0.2211, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: -6.11% (16.1920 => 15.2021, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.08% (0.5591 => 0.5251, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -6.05% (0.4199 => 0.3945, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.01% (0.5857 => 0.5505, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.01% (0.5478 => 0.5149, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.99% (1.3722 => 1.2900, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.98% (0.6304 => 0.5927, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: -5.97% (7.0961 => 6.6727, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.96% (0.9852 => 0.9265, std.dev.: 0.0194) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.96% (1.0544 => 0.9916, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: -5.93% (0.9179 => 0.8635, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.93% (0.5805 => 0.5461, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.89% (0.6230 => 0.5863, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.88% (4.0323 => 3.7952, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.87% (0.5925 => 0.5577, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.86% (0.6395 => 0.6020, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.83% (0.6297 => 0.5930, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.82% (0.3658 => 0.3445, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.82% (0.5863 => 0.5522, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.81% (0.6660 => 0.6273, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.81% (0.5802 => 0.5465, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.81% (0.5941 => 0.5596, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.80% (0.7339 => 0.6913, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.80% (0.5569 => 0.5246, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.79% (0.7524 => 0.7088, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.78% (0.5705 => 0.5375) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.77% (0.6189 => 0.5832, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.76% (0.5849 => 0.5512, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.76% (0.6667 => 0.6283, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.74% (0.6676 => 0.6293, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.73% (0.6052 => 0.5705, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: -5.73% (1.1530 => 1.0869, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.73% (3.5339 => 3.3314, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.73% (0.5570 => 0.5251, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.70% (0.5575 => 0.5257, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -5.70% (0.4280 => 0.4036, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.70% (0.6194 => 0.5841, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.68% (0.5859 => 0.5526, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.68% (1.2300 => 1.1601, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.68% (4.8161 => 4.5426, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.68% (0.2695 => 0.2542, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/05-eks/eks: -5.67% (0.4515 => 0.4259, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.67% (4.8802 => 4.6036, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.66% (0.5567 => 0.5252, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.65% (0.6260 => 0.5906, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.64% (0.5581 => 0.5266, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.63% (0.6446 => 0.6083, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.63% (0.5456 => 0.5149, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.61% (1.4642 => 1.3821, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.58% (6.7716 => 6.3938, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.57% (0.6440 => 0.6081, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.56% (0.5688 => 0.5372, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -5.55% (0.3406 => 0.3217, std.dev.: 0.0056) MultiSource/Applications/lemon/lemon: -5.55% (1.1450 => 1.0815, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.54% (4.5069 => 4.2573, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.52% (0.6033 => 0.5700, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.45% (0.6681 => 0.6317, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.44% (14.2083 => 13.4348, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.43% (1.6364 => 1.5475, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.40% (0.8521 => 0.8061, std.dev.: 0.0099) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.40% (1.2784 => 1.2094, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.39% (0.6395 => 0.6050, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: -5.35% (1.3148 => 1.2445, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: -5.33% (17.1032 => 16.1923, std.dev.: 0.0147) MultiSource/Applications/SIBsim4/SIBsim4: -5.31% (1.3864 => 1.3128, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.29% (1.2210 => 1.1564, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: -5.28% (0.3255 => 0.3083, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: -5.26% (0.2985 => 0.2828, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: -5.26% (0.2871 => 0.2720, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.25% (0.3483 => 0.3300, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -5.24% (4.3330 => 4.1061, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/random: -5.21% (0.2939 => 0.2786, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -5.19% (0.3025 => 0.2868, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.19% (0.3837 => 0.3638, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -5.17% (1.2515 => 1.1868, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.17% (0.2999 => 0.2844, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.17% (0.3194 => 0.3029, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.16% (0.3931 => 0.3728, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.16% (8.0126 => 7.5995, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.15% (0.2933 => 0.2782, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.14% (0.2548 => 0.2417, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.14% (0.3016 => 0.2861, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.13% (0.4151 => 0.3938, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.12% (2.1713 => 2.0602, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: -5.11% (0.2659 => 0.2523, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -5.11% (15.5079 => 14.7158, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.11% (1.2221 => 1.1597, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.10% (0.6293 => 0.5972, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.10% (0.2903 => 0.2755, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.09% (0.4916 => 0.4666, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: -5.05% (0.3581 => 0.3400, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: -5.00% (0.6441 => 0.6119, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -5.00% (3.5154 => 3.3398, std.dev.: 0.0069) SingleSource/UnitTests/ObjC++/Hello: -4.99% (0.6347 => 0.6030, std.dev.: 0.0055) SingleSource/UnitTests/ObjC++/property-reference: -4.97% (0.7779 => 0.7392, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: -4.95% (0.2989 => 0.2841, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.95% (0.2385 => 0.2267, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.95% (0.7198 => 0.6842, std.dev.: 0.0082) MultiSource/Applications/minisat/minisat: -4.94% (0.7447 => 0.7079, std.dev.: 0.0029) SingleSource/Regression/C++/ofstream_ctor: -4.94% (0.3059 => 0.2908, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.90% (0.3205 => 0.3048, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -4.89% (0.3394 => 0.3228, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.89% (0.7919 => 0.7532, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -4.87% (15.2527 => 14.5106, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.86% (0.5168 => 0.4917, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: -4.85% (0.3446 => 0.3279, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/moments: -4.83% (0.4248 => 0.4043, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -4.81% (0.3621 => 0.3447, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.79% (0.3319 => 0.3160, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.78% (0.5999 => 0.5712, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists1: -4.78% (0.3867 => 0.3682, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -4.77% (0.2849 => 0.2713, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.77% (0.3252 => 0.3097, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.76% (1.6474 => 1.5690, std.dev.: 0.0056) MultiSource/Applications/oggenc/oggenc: -4.75% (5.0226 => 4.7839, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash2: -4.73% (0.4861 => 0.4631, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.73% (0.5329 => 0.5077, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: -4.73% (0.3026 => 0.2883, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -4.65% (4.0594 => 3.8708, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary2: -4.60% (0.3481 => 0.3321, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.58% (0.4083 => 0.3896, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.57% (0.3849 => 0.3673, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.53% (0.9557 => 0.9124, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (0.7021 => 0.6703, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -4.50% (2.1401 => 2.0438, std.dev.: 0.0055) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.48% (22.4056 => 21.4008, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/09-vor/vor: -4.46% (0.3271 => 0.3125, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.38% (0.4427 => 0.4233, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -4.34% (2.4021 => 2.2978, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash: -4.33% (0.4524 => 0.4328, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: -4.26% (0.8418 => 0.8059, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.26% (0.4813 => 0.4608, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.21% (0.3323 => 0.3183, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -4.20% (34.0927 => 32.6611, std.dev.: 0.0109) MultiSource/Applications/lambda-0_1_3/lambda: -4.20% (0.7982 => 0.7647, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: -4.17% (0.3788 => 0.3630, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -4.13% (0.6750 => 0.6471, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.01% (0.3491 => 0.3351, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.99% (2.2587 => 2.1685, std.dev.: 0.0058) MultiSource/Applications/kimwitu++/kc: -3.99% (18.2933 => 17.5639, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.84% (0.9077 => 0.8728, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: -3.62% (1.5610 => 1.5045, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.34% (5.4682 => 5.2858, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.24% (0.4321 => 0.4181, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.52% (20.7746 => 20.2520, std.dev.: 0.0403) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7576, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/richards_benchmark: -8.68% (1.2842 => 1.1727, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.92% (1.7753 => 1.7057, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.73% (2.2633 => 2.1789, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.65% (6.5735 => 6.4650, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.58% (1.3096 => 1.2889, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 06:04:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 08:04:19 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121115140419.50BFD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5897?compare_to=5895&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5897, Order: 168037, Start Time: 2012-11-15 12:37:41, End Time: 2012-11-15 14:04:39 To: 5895, Order: 168035, Start Time: 2012-11-15 10:53:10, End Time: 2012-11-15 12:20:50 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 9 (91 on baseline) Performance Improvements: 1 (24 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 982 (859 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/flops-5: 49.26% (0.0203 => 0.0303, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 1.09% (1.2788 => 1.2928, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 8.55% (3.7108 => 4.0281, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops: 7.38% (8.7270 => 9.3708, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/methcall: 5.67% (8.3987 => 8.8746, std.dev.: 0.0836) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.31% (21.5746 => 22.2893, std.dev.: 0.2394) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.14% (2.3798 => 2.4308, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.24% (1.2438 => 1.2592, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.22% (40.9512 => 41.4508, std.dev.: 0.1162) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.14% (2.7856 => 2.7539, std.dev.: 0.0102) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.37% (16.9711 => 16.9082, std.dev.: 0.6791) MultiSource/Applications/obsequi/Obsequi: -2.24% (1.0840 => 1.0597, std.dev.: 0.0977) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.16% (22.2124 => 22.1775, std.dev.: 0.2040) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.33% (0.3669 => 0.3681, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/bigfib: 0.63% (0.6079 => 0.6117, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.27% (0.3345 => 0.3336, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/strcat: -0.74% (0.2023 => 0.2008, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 14.14% (0.0191 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0426 => 0.0427, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0333 => 0.0333, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 22.66% (0.0256 => 0.0314, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0424 => 0.0426, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: 37.84% (0.0148 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 15.96% (0.0188 => 0.0218, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.54% (0.1477 => 0.1469, std.dev.: 0.0118) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -5.21% (1.1880 => 1.1261, std.dev.: 0.2237) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.36% (0.4314 => 0.4212, std.dev.: 0.0477) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.07% (0.1446 => 0.1416, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.78% (0.0588 => 0.0622, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -31.65% (0.0278 => 0.0190, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.53% (0.0596 => 0.0569, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.55% (1.2038 => 1.1852, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -95.00% (0.0020 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 700.00% (0.0001 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.51% (0.0614 => 0.0574, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 12.70% (0.0189 => 0.0213, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.37% (0.7798 => 0.7769, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 100.00% (0.0001 => 0.0002, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 35.09% (0.0057 => 0.0077, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2306.38% (0.6332 => 15.2372, std.dev.: 1.0247) MultiSource/Benchmarks/McCat/08-main/main: 46.59% (0.1831 => 0.2684, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.25% (0.1559 => 0.1446, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1522.07% (0.3344 => 5.4242, std.dev.: 0.1359) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.77% (0.2364 => 0.3257, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/mandel: 4.20% (0.0429 => 0.0447, std.dev.: 0.0008) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.70% (0.0224 => 0.0239, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 6.50% (0.1462 => 0.1557, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4730, std.dev.: 0.0490) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0716, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4940, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3142, std.dev.: 0.0238) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1404, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4052, std.dev.: 0.0068) SingleSource/Regression/C/uint64_to_float: -24.34% (2.1832 => 1.6518, std.dev.: 0.0281) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.15% (0.0848 => 0.0968, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.33% (0.0810 => 0.0918, std.dev.: 0.0040) MultiSource/Applications/viterbi/viterbi: 8.18% (0.1577 => 0.1706, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.95% (0.7473 => 0.7992, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.58% (0.2279 => 0.2429, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.18% (0.3137 => 0.3331, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.17% (0.4847 => 0.5146, std.dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.94% (0.1885 => 0.1997, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: 5.78% (1.2222 => 1.2928, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.74% (0.3295 => 0.3484, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.54% (0.2998 => 0.3164, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.36% (1.1685 => 1.2311, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.09% (0.1983 => 0.2084, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.09% (0.6010 => 0.6316, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.07% (1.1606 => 1.2195, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.14% (0.5817 => 0.6058, std.dev.: 0.0048) MultiSource/Applications/treecc/treecc: 3.93% (1.9948 => 2.0732, std.dev.: 0.0137) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.89% (0.4783 => 0.4969, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.84% (0.4559 => 0.4734, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.66% (0.3003 => 0.3113, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.61% (0.4127 => 0.4276, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.45% (4.1763 => 4.3203, std.dev.: 0.0058) MultiSource/Applications/SIBsim4/SIBsim4: 3.37% (1.2568 => 1.2991, std.dev.: 0.0083) MultiSource/Applications/siod/siod: 3.33% (2.2184 => 2.2922, std.dev.: 0.0148) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.22% (6.6074 => 6.8199, std.dev.: 0.0386) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.17% (2.1401 => 2.2080, std.dev.: 0.0194) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.12% (1.2526 => 1.2917, std.dev.: 0.0061) MultiSource/Benchmarks/nbench/nbench: 3.09% (1.1271 => 1.1619, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.01% (1.3279 => 1.3679, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.00% (0.9908 => 1.0205, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.96% (0.9435 => 0.9714, std.dev.: 0.0081) MultiSource/Applications/d/make_dparser: 2.94% (3.2366 => 3.3319, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.94% (1.6386 => 1.6867, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.86% (4.4873 => 4.6157, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.80% (0.8007 => 0.8231, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.79% (0.3657 => 0.3759, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.77% (0.8457 => 0.8691, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.75% (0.8611 => 0.8848, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.65% (1.4479 => 1.4862, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.62% (0.9074 => 0.9312, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.55% (0.8885 => 0.9112, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.52% (0.8597 => 0.8814, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.52% (0.8716 => 0.8936, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.50% (0.8359 => 0.8568, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.49% (0.8338 => 0.8546, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.49% (0.8518 => 0.8730, std.dev.: 0.0077) MultiSource/Applications/JM/lencod/lencod: 2.47% (15.3280 => 15.7066, std.dev.: 0.1288) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.46% (0.8261 => 0.8464, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.43% (0.8066 => 0.8262, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.43% (0.9056 => 0.9276, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.42% (0.9039 => 0.9258, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.40% (0.8331 => 0.8531, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.40% (0.8805 => 0.9016, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 2.28% (31.8598 => 32.5847, std.dev.: 0.2779) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.23% (0.8177 => 0.8359, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.20% (0.8927 => 0.9123, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: 2.10% (2.3764 => 2.4262, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.08% (0.7932 => 0.8097, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/football/football: 1.59% (0.8768 => 0.8907, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 119.10% (0.0199 => 0.0436, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/pi: 57.32% (1.5795 => 2.4849, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.66% (0.7597 => 0.8863, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.34% (2.9753 => 3.4616, std.dev.: 0.0415) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.45% (2.7995 => 3.2041, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.49% (5.0261 => 5.6038, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.81% (6.3772 => 7.0666, std.dev.: 0.2114) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.16% (1.1857 => 1.2824, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 7.48% (1.7056 => 1.8331, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.63% (4.7794 => 5.0965, std.dev.: 0.0049) MultiSource/Applications/SIBsim4/SIBsim4: 6.41% (3.1873 => 3.3915, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.90% (4.9686 => 5.2617, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 5.90% (1.3037 => 1.3806, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.89% (4.5327 => 4.7995, std.dev.: 0.0052) MultiSource/Benchmarks/BitBench/drop3/drop3: 5.40% (0.2887 => 0.3043, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 4.73% (7.4933 => 7.8478, std.dev.: 0.0602) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.61% (6.2275 => 6.5145, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.52% (3.3761 => 3.5288, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.18% (4.9453 => 5.1518, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.00% (4.9469 => 5.1448, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 3.89% (14.0064 => 14.5519, std.dev.: 0.0355) MultiSource/Applications/siod/siod: 2.92% (3.6643 => 3.7713, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.84% (11.5690 => 11.8978, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.80% (8.2783 => 8.5098, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.79% (3.9188 => 4.0281, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.38% (4.8660 => 4.9817, std.dev.: 0.0283) SingleSource/Benchmarks/Shootout/lists: 2.25% (7.3375 => 7.5026, std.dev.: 0.0122) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.22% (1.1365 => 1.1617, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.38% (4.8362 => 4.9030, std.dev.: 0.0236) SingleSource/Benchmarks/Misc/ReedSolomon: 1.15% (8.5322 => 8.6302, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.15% (3.5679 => 3.6088, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/power/power: 1.11% (1.2061 => 1.2195, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.33% (5.4641 => 4.3533, std.dev.: 0.0603) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.43% (7.2130 => 6.1721, std.dev.: 0.4001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.75% (1.0512 => 0.9382, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -10.29% (1.1216 => 1.0062, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.04% (14.6451 => 13.3213, std.dev.: 0.1249) MultiSource/Benchmarks/mafft/pairlocalalign: -8.51% (63.1822 => 57.8057, std.dev.: 0.1405) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.49% (0.3269 => 0.3024, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.89% (4.7482 => 4.4210, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.01% (5.4972 => 5.1669, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.97% (3.7148 => 3.4930, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.09% (5.1557 => 4.8934, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.54% (4.7449 => 4.5293, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.29% (2.8773 => 2.7539, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.76% (6.0224 => 5.7962, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.39% (0.5807 => 0.5610, std.dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (28.5821 => 27.6753, std.dev.: 0.0233) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.97% (2.6356 => 2.5574, std.dev.: 0.0013) MultiSource/Applications/aha/aha: -2.71% (3.3398 => 3.2494, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/hash2: -2.34% (3.4237 => 3.3436, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.03% (11.5316 => 11.2971, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.91% (3.2169 => 3.1556, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.59% (4.9994 => 4.9200, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.3487 => 2.3194, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.17% (5.6343 => 5.5684, std.dev.: 0.0096) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.81% (16.4461 => 16.9082, std.dev.: 0.6791) MultiSource/Applications/obsequi/Obsequi: 3.26% (1.0262 => 1.0597, std.dev.: 0.0977) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7001.34% (0.3123 => 22.1775, std.dev.: 0.2040) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.45% (0.2463 => 0.3681, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/bigfib: 1.78% (0.6010 => 0.6117, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.14% (0.3266 => 0.3336, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/strcat: 1.98% (0.1969 => 0.2008, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.94% (0.0384 => 0.0426, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.16% (0.1438 => 0.1469, std.dev.: 0.0118) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.60% (1.1329 => 1.1261, std.dev.: 0.2237) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.15% (0.4164 => 0.4212, std.dev.: 0.0477) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.43% (0.1369 => 0.1416, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.96% (0.0641 => 0.0622, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.56% (0.0195 => 0.0190, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.56% (0.0578 => 0.0569, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.63% (1.1437 => 1.1852, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -42.86% (0.0014 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.45% (0.0627 => 0.0574, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.33% (0.0180 => 0.0213, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.09% (0.8017 => 0.7769, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 100.00% (0.0001 => 0.0002, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 24.19% (0.0062 => 0.0077, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 06:14:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 08:14:15 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121115141415.8367B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5898?compare_to=5896&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5898, Order: 168037, Start Time: 2012-11-15 12:49:22, End Time: 2012-11-15 14:14:34 To: 5896, Order: 168035, Start Time: 2012-11-15 11:00:47, End Time: 2012-11-15 12:26:11 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (179 on baseline) Unchanged Tests: 1041 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.27% (79.8716 => 80.8859, std.dev.: 0.2426) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1012, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/salsa20: 2.42% (7.4937 => 7.6749, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/hash2: 2.32% (3.1932 => 3.2673, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.47% (79.7170 => 80.8859, std.dev.: 0.2426) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.74% (0.1431 => 0.1306) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.88% (0.3821 => 0.3520, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.95% (2.4924 => 2.3191, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.91% (0.9542 => 0.8883, std.dev.: 0.0042) MultiSource/Applications/sgefa/sgefa: -6.79% (0.3357 => 0.3129, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: -6.64% (0.3812 => 0.3559, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: -6.62% (0.3880 => 0.3623, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.60% (0.3848 => 0.3594, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -6.55% (0.3831 => 0.3580, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -6.55% (0.3896 => 0.3641, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.49% (0.3884 => 0.3632, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: -6.42% (0.4033 => 0.3774, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -6.37% (0.4176 => 0.3910, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.35% (0.3891 => 0.3644, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.33% (0.3142 => 0.2943, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.29% (0.1796 => 0.1683, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -6.23% (0.1879 => 0.1762, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.22% (0.2428 => 0.2277, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: -6.20% (0.2160 => 0.2026, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.18% (0.6484 => 0.6083, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -6.18% (9.2283 => 8.6578, std.dev.: 0.0092) SingleSource/UnitTests/ObjC/property: -6.10% (0.4199 => 0.3943, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -6.09% (16.1920 => 15.2062, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.03% (0.5591 => 0.5254, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: -5.97% (7.0961 => 6.6724, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.97% (1.0544 => 0.9915, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.95% (1.3722 => 1.2905, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.94% (0.9852 => 0.9267, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.88% (0.3658 => 0.3443, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.84% (0.5478 => 0.5158, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.81% (0.5805 => 0.5468, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.80% (0.6676 => 0.6289, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.79% (0.2695 => 0.2539, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.79% (0.5857 => 0.5518, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.77% (0.5925 => 0.5583, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.77% (0.6189 => 0.5832, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -5.75% (0.4280 => 0.4034, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.73% (3.5339 => 3.3313, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.73% (0.6667 => 0.6285, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.71% (0.6230 => 0.5874, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.71% (0.6304 => 0.5944, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.71% (6.7716 => 6.3852, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.70% (4.8161 => 4.5415, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.69% (0.6260 => 0.5904, std.dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.68% (1.2300 => 1.1601, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.68% (0.5863 => 0.5530, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -5.68% (0.1761 => 0.1661, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.68% (4.0323 => 3.8034, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.67% (0.7339 => 0.6923, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.66% (0.7524 => 0.7098, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.65% (0.6297 => 0.5941, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.65% (1.4642 => 1.3815, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.64% (0.5705 => 0.5383, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.64% (0.5802 => 0.5475, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.62% (0.5941 => 0.5607, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.61% (0.6395 => 0.6036, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.60% (0.5569 => 0.5257, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.60% (0.6681 => 0.6307, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: -5.59% (0.9179 => 0.8666, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.58% (0.6052 => 0.5714, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.58% (1.6364 => 1.5451, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.57% (0.5567 => 0.5257, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.56% (4.8802 => 4.6089, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.55% (0.6446 => 0.6088, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.54% (0.6194 => 0.5851, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -5.54% (1.3148 => 1.2420, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: -5.52% (0.3025 => 0.2858, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.52% (0.5456 => 0.5155, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.51% (0.5849 => 0.5527, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.50% (0.2871 => 0.2713, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -5.50% (1.1450 => 1.0820, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.49% (4.5069 => 4.2595, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.48% (1.2784 => 1.2084, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: -5.47% (0.3255 => 0.3077, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.46% (0.5859 => 0.5539, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.45% (0.5575 => 0.5271, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: -5.45% (0.3194 => 0.3020, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.45% (0.5581 => 0.5277, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.44% (0.5570 => 0.5267, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.44% (0.3016 => 0.2852, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.43% (0.6440 => 0.6090, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -5.43% (0.4515 => 0.4270, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: -5.41% (0.2939 => 0.2780, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.40% (0.5688 => 0.5381, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.39% (0.6395 => 0.6050, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -5.39% (0.7779 => 0.7360, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.38% (14.2083 => 13.4436, std.dev.: 0.0145) MultiSource/Applications/Burg/burg: -5.38% (1.2515 => 1.1842, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.37% (0.4151 => 0.3928, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.36% (2.1713 => 2.0550, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hello: -5.34% (0.2849 => 0.2697, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.32% (0.6033 => 0.5712, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.32% (0.2933 => 0.2777, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.32% (0.3931 => 0.3722, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: -5.31% (0.3406 => 0.3225, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: -5.31% (0.3581 => 0.3391, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.30% (0.2903 => 0.2749, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.30% (0.3057 => 0.2895, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.26% (0.3837 => 0.3635, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: -5.26% (0.2985 => 0.2828, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: -5.26% (1.3864 => 1.3135, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/except: -5.25% (0.3026 => 0.2867, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -5.25% (4.3330 => 4.1054, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: -5.25% (0.2989 => 0.2832, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.6736 => 0.6383, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.23% (0.3483 => 0.3301, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: -5.20% (0.6347 => 0.6017, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.20% (0.2385 => 0.2261, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.19% (0.8521 => 0.8079, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.18% (0.2548 => 0.2416, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.17% (0.2999 => 0.2844, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -5.17% (17.1032 => 16.2197, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/ary3: -5.17% (0.3446 => 0.3268, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: -5.16% (15.5079 => 14.7082, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout-C++/wc: -5.15% (0.3205 => 0.3040, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.15% (0.4916 => 0.4663, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.14% (8.0126 => 7.6007, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.14% (0.2278 => 0.2161, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.14% (0.3252 => 0.3085, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.13% (0.6293 => 0.5970, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: -5.13% (0.3394 => 0.3220, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.12% (0.5999 => 0.5692, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary2: -5.11% (0.3481 => 0.3303, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.09% (1.2210 => 1.1589, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: -5.08% (0.6441 => 0.6114, std.dev.: 0.0050) MultiSource/Applications/minisat/minisat: -5.05% (0.7447 => 0.7071, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: -5.04% (0.2659 => 0.2525, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -5.03% (0.3059 => 0.2905, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.02% (1.2221 => 1.1607, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.01% (0.7919 => 0.7522, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: -4.97% (0.4248 => 0.4037, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.93% (0.5168 => 0.4913, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.92% (0.4813 => 0.4576, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.92% (0.7198 => 0.6844, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: -4.92% (0.3621 => 0.3443, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -4.91% (0.3867 => 0.3677, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -4.84% (15.2527 => 14.5141, std.dev.: 0.0096) MultiSource/Applications/d/make_dparser: -4.84% (3.5154 => 3.3453, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: -4.83% (1.1530 => 1.0973, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.78% (1.6474 => 1.5687, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.76% (0.3319 => 0.3161, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.75% (0.3849 => 0.3666, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: -4.75% (0.4861 => 0.4630, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.74% (0.7021 => 0.6688, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.72% (5.0226 => 4.7855, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.71% (0.5329 => 0.5078, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -4.64% (4.0594 => 3.8709, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.60% (0.9557 => 0.9117, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -4.52% (0.3271 => 0.3123, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -4.51% (0.4524 => 0.4320, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: -4.45% (34.0927 => 32.5764, std.dev.: 0.0236) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.43% (22.4056 => 21.4130, std.dev.: 0.0117) MultiSource/Applications/siod/siod: -4.40% (2.4021 => 2.2964, std.dev.: 0.0162) MultiSource/Applications/treecc/treecc: -4.40% (2.1401 => 2.0460, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sieve: -4.33% (0.3788 => 0.3624, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.31% (0.4427 => 0.4236, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.29% (0.4083 => 0.3908, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -4.26% (0.7982 => 0.7642, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.24% (0.3323 => 0.3182, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -4.23% (0.8418 => 0.8062, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.18% (2.2587 => 2.1643, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: -4.07% (0.6750 => 0.6475, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -4.06% (18.2933 => 17.5501, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.92% (0.3491 => 0.3354, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.73% (0.9077 => 0.8738, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.68% (0.4321 => 0.4162, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: -3.66% (1.5610 => 1.5039, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.19% (5.4682 => 5.2937, std.dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -2.15% (20.7746 => 20.3279, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7557, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: -8.72% (1.2842 => 1.1722, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7067, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.84% (2.2633 => 2.1765, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.38% (1.3096 => 1.2784, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4672, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 07:03:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 09:03:58 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121115150358.ACAE12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5899?compare_to=5894&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5899, Order: 168037, Start Time: 2012-11-15 12:53:31, End Time: 2012-11-15 15:04:16 To: 5894, Order: 168031, Start Time: 2012-11-15 09:52:46, End Time: 2012-11-15 12:03:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 30 (134 on baseline) Performance Improvements: 9 (41 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 999 (712 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 14.75% (0.6650 => 0.7631, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/em3d/em3d: 13.88% (0.1967 => 0.2240, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 12.69% (0.6178 => 0.6962, std.dev.: 0.0108) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.58% (0.1916 => 0.2157, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.38% (0.2668 => 0.2945, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 10.08% (0.1022 => 0.1125, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/mst/mst: 9.83% (0.1353 => 0.1486, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.17% (0.5943 => 0.6488, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.09% (1.7946 => 1.9577, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.57% (0.1528 => 0.1659, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 8.44% (0.3911 => 0.4241, std.dev.: 0.0043) MultiSource/Applications/hbd/hbd: 7.24% (1.7326 => 1.8581, std.dev.: 0.0256) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.68% (0.9573 => 1.0212, std.dev.: 0.0095) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.45% (0.3795 => 0.3964, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.15% (5.8890 => 6.1334, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.90% (5.7732 => 5.9984, std.dev.: 0.0377) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.52% (4.7520 => 4.9194, std.dev.: 0.0516) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.75% (8.3635 => 8.5933, std.dev.: 0.0122) SingleSource/UnitTests/Vector/constpool: 2.62% (55.8151 => 57.2759, std.dev.: 0.2206) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.00% (21.1608 => 21.5847, std.dev.: 0.1513) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.09% (1.6058 => 1.9926, std.dev.: 0.0196) MultiSource/Applications/JM/ldecod/ldecod: 19.98% (0.1226 => 0.1471, std.dev.: 0.0031) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.89% (1.7372 => 1.9959, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: 9.63% (10.9209 => 11.9726, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 9.47% (6.3416 => 6.9420, std.dev.: 0.0976) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.05% (4.3280 => 4.5033, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.77% (5.3430 => 5.5443, std.dev.: 0.0193) MultiSource/Applications/sqlite3/sqlite3: 2.76% (4.5948 => 4.7215, std.dev.: 0.0305) MultiSource/Benchmarks/NPB-serial/is/is: 1.56% (8.8377 => 8.9756, std.dev.: 0.0422) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.31% (3.6077 => 3.6549, std.dev.: 0.0178) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -11.07% (1.5552 => 1.3831, std.dev.: 0.0120) MultiSource/Applications/lemon/lemon: -4.90% (1.2553 => 1.1938, std.dev.: 0.0193) MultiSource/Benchmarks/PAQ8p/paq8p: -4.56% (11.8658 => 11.3242, std.dev.: 0.0768) MultiSource/Applications/minisat/minisat: -4.30% (0.8527 => 0.8160, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -2.80% (4.6204 => 4.4910, std.dev.: 0.0387) MultiSource/Applications/JM/ldecod/ldecod: -2.33% (9.9004 => 9.6698, std.dev.: 0.0607) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lemon/lemon: -7.55% (1.5532 => 1.4360, std.dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: -1.51% (15.2949 => 15.0640, std.dev.: 0.0640) SingleSource/UnitTests/Vector/multiplies: -1.08% (2.5688 => 2.5411, std.dev.: 0.0096) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 1.80% (0.1337 => 0.1361, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.48% (0.0420 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.30% (0.0651 => 0.0679, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 0.06% (493.8942 => 494.1669, std.dev.: 0.2132) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 43720.78% (1.1277 => 494.1669, std.dev.: 0.2132) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.00% (0.5229 => 1.5373, std.dev.: 0.1196) MultiSource/Applications/SPASS/SPASS: 21.02% (14.9895 => 18.1401, std.dev.: 0.2227) MultiSource/Applications/kimwitu++/kc: 46.92% (14.1553 => 20.7976, std.dev.: 0.0510) MultiSource/Benchmarks/MallocBench/gs/gs: 21.84% (4.1105 => 5.0083, std.dev.: 0.0839) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.61% (1.1048 => 1.5093, std.dev.: 0.0128) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 432.03% (7.1582 => 38.0837, std.dev.: 0.1913) SingleSource/Benchmarks/Misc-C++-EH/spirit: 80.28% (3.4629 => 6.2428, std.dev.: 0.2712) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.08% (0.6222 => 1.0271, std.dev.: 0.0628) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11046.81% (0.0720 => 8.0257, std.dev.: 0.0910) MultiSource/Applications/SIBsim4/SIBsim4: 3901800.00% (0.0001 => 3.9019, std.dev.: 0.0182) MultiSource/Applications/SPASS/SPASS: 15063900.00% (0.0001 => 15.0640, std.dev.: 0.0640) MultiSource/Applications/kimwitu++/kc: 52200.00% (0.0001 => 0.0523, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 65100.00% (0.0001 => 0.0652, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 578400.00% (0.0001 => 0.5785, std.dev.: 0.0306) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10089500.00% (0.0001 => 10.0896, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5779600.00% (0.0001 => 5.7797, std.dev.: 0.8271) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1828.24% (1.1194 => 21.5847, std.dev.: 0.1513) MultiSource/Applications/ClamAV/clamscan: 71.37% (22.1758 => 38.0017, std.dev.: 0.1549) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 67.31% (2.9384 => 4.9163, std.dev.: 0.1418) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 59.61% (7.0540 => 11.2592, std.dev.: 0.0141) MultiSource/Benchmarks/FreeBench/distray/distray: 58.14% (0.1056 => 0.1670, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 51.88% (8.1363 => 12.3572, std.dev.: 0.0792) MultiSource/Applications/JM/lencod/lencod: 46.11% (21.9371 => 32.0526, std.dev.: 0.1452) SingleSource/Benchmarks/CoyoteBench/almabench: 38.36% (0.0730 => 0.1010, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 38.06% (0.1432 => 0.1977, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/08-main/main: 37.31% (0.2554 => 0.3507, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 36.17% (0.1584 => 0.2157, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/em3d/em3d: 32.15% (0.1695 => 0.2240, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 31.40% (0.0793 => 0.1042, std.dev.: 0.0009) SingleSource/UnitTests/vla: 29.86% (0.0355 => 0.0461, std.dev.: 0.0024) MultiSource/Benchmarks/BitBench/five11/five11: 28.57% (0.0567 => 0.0729, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 28.38% (0.0437 => 0.0561, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/mst/mst: 27.77% (0.1163 => 0.1486, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 27.70% (0.3441 => 0.4394, std.dev.: 0.0043) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0053) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.01% (0.3121 => 0.3964, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 27.00% (1.5415 => 1.9577, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 26.98% (0.0886 => 0.1125, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 25.96% (0.0443 => 0.0558, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.31% (0.0648 => 0.0812, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.96% (0.8172 => 1.0212, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.53% (0.0746 => 0.0929, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 24.24% (0.0491 => 0.0610, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 24.13% (0.2271 => 0.2819, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.08% (0.1337 => 0.1659, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.97% (0.2107 => 0.2612, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 23.13% (0.8921 => 1.0984, std.dev.: 0.0133) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.98% (0.1062 => 0.1306, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 22.62% (5.0018 => 6.1334, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/espresso/espresso: 22.15% (4.2646 => 5.2093, std.dev.: 0.0981) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 21.30% (4.9449 => 5.9984, std.dev.: 0.0377) SingleSource/UnitTests/ObjC/exceptions-2: 21.28% (0.3497 => 0.4241, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.19% (0.2430 => 0.2945, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 21.11% (3.3354 => 4.0395, std.dev.: 0.0510) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 21.07% (0.3427 => 0.4149, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 20.88% (14.3668 => 17.3669, std.dev.: 0.0649) MultiSource/Benchmarks/Olden/tsp/tsp: 20.17% (0.1175 => 0.1412, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.53% (1.4186 => 1.6956, std.dev.: 0.0311) MultiSource/Applications/hbd/hbd: 19.09% (1.5603 => 1.8581, std.dev.: 0.0256) MultiSource/Applications/oggenc/oggenc: 18.92% (5.7591 => 6.8490, std.dev.: 0.2380) MultiSource/Benchmarks/mafft/pairlocalalign: 18.85% (9.4845 => 11.2721, std.dev.: 0.0581) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 18.80% (0.0798 => 0.0948, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.58% (0.1125 => 0.1334, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 18.32% (0.5981 => 0.7077, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/lists: 18.21% (0.3422 => 0.4045, std.dev.: 0.0154) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.15% (0.2700 => 0.3190, std.dev.: 0.0186) SingleSource/UnitTests/ObjC/exceptions-3: 17.86% (0.3516 => 0.4144, std.dev.: 0.0112) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.34% (0.0842 => 0.0988, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 17.03% (0.0640 => 0.0749, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.88% (0.0871 => 0.1018, std.dev.: 0.0051) MultiSource/Applications/siod/siod: 16.86% (2.2969 => 2.6841, std.dev.: 0.1423) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 16.79% (0.2603 => 0.3040, std.dev.: 0.0123) MultiSource/Applications/sqlite3/sqlite3: 16.32% (17.1811 => 19.9848, std.dev.: 0.1008) MultiSource/Applications/lua/lua: 15.98% (3.8723 => 4.4910, std.dev.: 0.0387) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.93% (0.2065 => 0.2394, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 15.88% (3.8922 => 4.5104, std.dev.: 0.1696) SingleSource/Benchmarks/Shootout/matrix: 15.77% (0.0818 => 0.0947, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.19% (0.0770 => 0.0887, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/health/health: 15.14% (0.1268 => 0.1460, std.dev.: 0.0068) MultiSource/Applications/viterbi/viterbi: 14.98% (0.1555 => 0.1788, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.95% (0.1117 => 0.1284, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.94% (0.0770 => 0.0885, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.72% (0.2758 => 0.3164, std.dev.: 0.0119) MultiSource/Applications/minisat/minisat: 14.69% (0.7115 => 0.8160, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.63% (0.0834 => 0.0956, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 14.60% (0.0719 => 0.0824, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 14.21% (0.7433 => 0.8489, std.dev.: 0.0338) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.91% (0.9765 => 1.1123, std.dev.: 0.0453) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.88% (0.5569 => 0.6342, std.dev.: 0.0227) MultiSource/Benchmarks/Bullet/bullet: 13.87% (63.2438 => 72.0172, std.dev.: 0.0942) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.80% (0.1029 => 0.1171, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.63% (0.5860 => 0.6659, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/18-imp/imp: 13.41% (0.3423 => 0.3882, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.35% (0.4615 => 0.5231, std.dev.: 0.0231) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.80% (1.3050 => 1.4721, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/synchronized: 12.19% (0.3561 => 0.3995, std.dev.: 0.0157) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.11% (0.3543 => 0.3972, std.dev.: 0.0145) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.04% (0.8101 => 0.9076, std.dev.: 0.0124) MultiSource/Benchmarks/nbench/nbench: 12.00% (1.1840 => 1.3261, std.dev.: 0.0087) SingleSource/UnitTests/ObjC/for-in: 11.94% (0.3694 => 0.4135, std.dev.: 0.0171) MultiSource/Benchmarks/McCat/09-vor/vor: 11.79% (0.3180 => 0.3555, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.54% (0.1906 => 0.2126, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/05-eks/eks: 11.49% (0.4299 => 0.4793, std.dev.: 0.0040) MultiSource/Applications/lemon/lemon: 11.34% (1.0722 => 1.1938, std.dev.: 0.0193) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.21% (0.8067 => 0.8971, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: 9.93% (0.1440 => 0.1583, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 9.92% (0.3387 => 0.3723, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 9.23% (10.3673 => 11.3242, std.dev.: 0.0768) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.93% (7.9617 => 8.5933, std.dev.: 0.0122) MultiSource/Applications/hexxagon/hexxagon: 7.70% (1.2842 => 1.3831, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/bh/bh: 7.28% (0.3092 => 0.3317, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.29% (0.4879 => 0.5186, std.dev.: 0.0108) SingleSource/UnitTests/Vector/constpool: 5.74% (54.1659 => 57.2759, std.dev.: 0.2206) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.67% (4.3953 => 11.0179, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/methcall: 147.63% (5.3999 => 13.3720, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 32.08% (1.5086 => 1.9926, std.dev.: 0.0196) MultiSource/Applications/minisat/minisat: 31.34% (9.1159 => 11.9726, std.dev.: 0.0112) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 25.68% (13.4384 => 16.8888, std.dev.: 0.2441) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.68% (0.3256 => 0.4092, std.dev.: 0.0259) SingleSource/Benchmarks/Shootout-C++/ary3: 20.04% (3.7221 => 4.4681, std.dev.: 0.2672) SingleSource/Benchmarks/Misc/oourafft: 17.50% (6.6465 => 7.8095, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.55% (1.1145 => 1.2989, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/mst/mst: 16.26% (0.1285 => 0.1494, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.22% (0.2944 => 0.3392, std.dev.: 0.0037) MultiSource/Applications/JM/ldecod/ldecod: 13.33% (0.1298 => 0.1471, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.72% (8.6802 => 9.7842, std.dev.: 0.1768) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.66% (2.8904 => 3.2273, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 11.44% (3.1578 => 3.5189, std.dev.: 0.0619) SingleSource/Benchmarks/Misc/richards_benchmark: 10.26% (1.1396 => 1.2565, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.30% (1.7254 => 1.8859, std.dev.: 0.0034) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.89% (1.8329 => 1.9959, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.64% (4.2280 => 4.4665, std.dev.: 0.0075) MultiSource/Applications/lua/lua: 5.11% (26.0924 => 27.4269, std.dev.: 0.0327) SingleSource/Regression/C/uint64_to_float: 5.10% (0.5413 => 0.5689, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.6436 => 12.1308, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.77% (3.6395 => 3.7767, std.dev.: 0.0485) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: 2.67% (2.4116 => 2.4760, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.15% (1.3677 => 1.3971, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 2.12% (85.0658 => 86.8661, std.dev.: 0.0717) MultiSource/Applications/aha/aha: 2.09% (3.1595 => 3.2254, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 1.59% (27.8444 => 28.2861, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/lists: 1.47% (12.5348 => 12.7188, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/sieve: 1.36% (5.2139 => 5.2848, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.31% (6.5088 => 6.5942, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0313 => 1.0441, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0504, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1669, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.69% (5.2763 => 1.2297, std.dev.: 0.0280) SingleSource/Benchmarks/Misc/salsa20: -75.36% (0.8651 => 0.2132, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/richards_benchmark: -44.64% (0.1622 => 0.0898, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.57% (5.3855 => 4.7083, std.dev.: 0.0399) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -12.11% (0.1330 => 0.1169, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.77% (1.7609 => 1.6064, std.dev.: 0.0525) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.09% (5.3526 => 4.9194, std.dev.: 0.0516) MultiSource/Applications/JM/ldecod/ldecod: -7.34% (10.4361 => 9.6698, std.dev.: 0.0607) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.92% (0.0506 => 0.0304, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.75% (0.3987 => 0.2402, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.41% (4.5009 => 2.7720, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7636, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -26.15% (10.7105 => 7.9096, std.dev.: 0.4785) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.12% (2.6546 => 2.0142, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: -19.53% (0.2161 => 0.1739, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -16.03% (1.6925 => 1.4212, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2842, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.70% (32.5116 => 29.0342, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.05% (1.5660 => 1.4243, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -6.15% (9.5636 => 8.9756, std.dev.: 0.0422) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.11% (3.2416 => 3.0435, std.dev.: 0.0179) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367) SingleSource/Benchmarks/Misc/flops-5: -5.06% (1.5835 => 1.5034, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.98% (19.9488 => 18.9557, std.dev.: 0.3548) SingleSource/Benchmarks/Shootout/lists: -4.23% (6.2999 => 6.0335, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.40% (0.9957 => 0.9618, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: -3.03% (5.0483 => 4.8952, std.dev.: 0.0027) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.91% (8.1563 => 8.0007, std.dev.: 0.0187) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6772, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -1.47% (10.2830 => 10.1320, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.35% (0.1485 => 0.1361, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.91% (0.2116 => 0.0679, std.dev.: 0.0003) Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 07:12:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 09:12:14 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121115151214.C0D4D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5900?compare_to=5893&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5900, Order: 168036, Start Time: 2012-11-15 11:56:38, End Time: 2012-11-15 15:12:32 To: 5893, Order: 168025, Start Time: 2012-11-15 07:49:10, End Time: 2012-11-15 11:08:05 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (173 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (717 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.53% (2.4018 => 2.4385, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.58% (54.0723 => 54.9282, std.dev.: 0.0630) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.76% (0.0625 => 0.0886, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.55% (0.1063 => 0.1409, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.27% (0.2969 => 0.3749, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.68% (0.1106 => 0.1390, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 25.15% (1.5932 => 1.9939, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.09% (0.4253 => 0.5320, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.07% (0.0714 => 0.0893, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.91% (0.4139 => 0.5170, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.27% (0.4994 => 0.6206, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.00% (0.0475 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.80% (0.5900 => 0.7304, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.66% (0.5000 => 0.6183, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.40% (0.0547 => 0.0675, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.29% (0.0584 => 0.0720, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.65% (0.1620 => 0.1987, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.62% (0.1021 => 0.1252, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 22.20% (0.0599 => 0.0732, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.13% (0.1107 => 0.1352, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.07% (0.0897 => 0.1095, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.48% (0.0633 => 0.0769, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 21.10% (0.0948 => 0.1148, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.06% (0.0584 => 0.0707, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.03% (0.0642 => 0.0777, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.80% (0.0822 => 0.0993, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 20.71% (0.0821 => 0.0991, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 20.57% (0.1619 => 0.1952, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.49% (0.1103 => 0.1329, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.47% (0.3903 => 0.4702, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.34% (0.1003 => 0.1207, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.34% (0.1549 => 0.1864, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.95% (0.1604 => 0.1924, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 19.64% (0.0947 => 0.1133, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.02% (0.1462 => 0.1740, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 18.97% (0.1218 => 0.1449, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 18.94% (0.0808 => 0.0961, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.92% (0.2014 => 0.2395, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.64% (0.3890 => 0.4615, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 18.40% (0.5826 => 0.6898, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.09% (1.3152 => 1.5531, std.dev.: 0.0031) MultiSource/Applications/spiff/spiff: 18.04% (0.4029 => 0.4756, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 18.02% (0.5889 => 0.6950, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.01% (0.1088 => 0.1284, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 18.01% (0.1505 => 0.1776, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 17.91% (0.0698 => 0.0823, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.66% (0.0572 => 0.0673, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.65% (0.2736 => 0.3219, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 17.53% (0.5546 => 0.6518, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.48% (0.2866 => 0.3367, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.45% (3.5627 => 4.1844, std.dev.: 0.0092) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.28% (1.6211 => 1.9012, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 17.18% (1.8794 => 2.2023, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.97% (0.1968 => 0.2302, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 16.86% (0.0605 => 0.0707, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.75% (0.4658 => 0.5438, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 16.68% (0.1421 => 0.1658, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.63% (0.3271 => 0.3815, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.61% (0.5026 => 0.5861, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.55% (0.1160 => 0.1352, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 16.51% (1.0781 => 1.2561, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 16.50% (0.7171 => 0.8354, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: 16.40% (0.9697 => 1.1287, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.38% (0.2875 => 0.3346, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.34% (2.7292 => 3.1751, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.26% (0.4361 => 0.5070, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.18% (0.3930 => 0.4566, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: 16.12% (0.1284 => 0.1491, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 15.91% (4.2109 => 4.8810, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.85% (4.4195 => 5.1202, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 15.58% (0.2780 => 0.3213, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.52% (0.2738 => 0.3163, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 15.51% (0.2714 => 0.3135, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 15.51% (0.2811 => 0.3247, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 15.42% (0.2750 => 0.3174, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.41% (0.1090 => 0.1258, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 15.41% (0.2725 => 0.3145, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.39% (0.2729 => 0.3149, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.37% (0.2792 => 0.3221, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 15.35% (0.3004 => 0.3465, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 15.33% (0.9909 => 1.1428, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.31% (1.9694 => 2.2710, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.24% (1.9966 => 2.3008, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/methcall: 15.18% (0.2813 => 0.3240, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 15.13% (0.2803 => 0.3227, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 15.13% (0.2823 => 0.3250, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.05% (0.2911 => 0.3349, std.dev.: 0.0066) MultiSource/Benchmarks/Bullet/bullet: 14.97% (23.5202 => 27.0420, std.dev.: 0.0167) SingleSource/UnitTests/ObjC/for-in: 14.96% (0.3496 => 0.4019, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 14.94% (0.3446 => 0.3961, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.94% (0.3488 => 0.4009, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 14.92% (0.3465 => 0.3982, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.92% (2.0673 => 2.3757, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/trivial-interface: 14.90% (0.3442 => 0.3955, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.87% (0.3195 => 0.3670, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 14.86% (0.3096 => 0.3556, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.85% (0.3469 => 0.3984, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.83% (0.3460 => 0.3973, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 14.55% (0.3258 => 0.3732, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 14.55% (0.3650 => 0.4181, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 14.54% (0.3267 => 0.3742, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 14.54% (0.2566 => 0.2939, std.dev.: 0.0014) MultiSource/Applications/lua/lua: 14.43% (1.4269 => 1.6328, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 14.38% (0.3643 => 0.4167, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.38% (0.3060 => 0.3500, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 14.31% (0.2075 => 0.2372, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 14.18% (0.3724 => 0.4252, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 14.17% (0.3317 => 0.3787, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.99% (0.3124 => 0.3561, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.89% (0.3362 => 0.3829, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 13.84% (0.3678 => 0.4187, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 13.80% (0.3348 => 0.3810, std.dev.: 0.0017) MultiSource/Applications/treecc/treecc: 13.77% (0.7875 => 0.8959, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.71% (0.3282 => 0.3732, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 13.69% (0.3477 => 0.3953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 13.69% (0.3726 => 0.4236, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 13.67% (2.1653 => 2.4614, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.57% (0.3625 => 0.4117, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 13.52% (4.6177 => 5.2422, std.dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.34% (0.3845 => 0.4358, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 13.32% (0.0758 => 0.0859, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.29% (0.3981 => 0.4510, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 13.22% (0.4146 => 0.4694, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 13.20% (0.4251 => 0.4812, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 13.15% (0.2691 => 0.3045, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.14% (0.3690 => 0.4175, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 13.13% (2.1013 => 2.3771, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.75% (0.2040 => 0.2300, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 12.45% (0.5012 => 0.5636, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 12.24% (5.5417 => 6.2199, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.55% (0.6435 => 0.7178, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 11.26% (0.6634 => 0.7381, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 11.01% (0.3498 => 0.3883, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.99% (0.1028 => 0.1141, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 10.94% (0.3336 => 0.3701, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.88% (0.2068 => 0.2293, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.77% (0.1383 => 0.1532, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.74% (0.2737 => 0.3031, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 10.36% (0.4847 => 0.5349, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.31% (0.3084 => 0.3402, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 9.95% (0.2391 => 0.2629, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.70% (0.2103 => 0.2307, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 9.70% (2.0346 => 2.2319, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.46% (4.6926 => 5.0895, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.45% (0.5361 => 0.5814, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.21% (11.6398 => 12.5952, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.93% (0.5584 => 0.6027, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.86% (0.7426 => 0.8010, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 6.54% (11.9555 => 12.7374, std.dev.: 0.0201) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.46% (0.3792 => 0.3999, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 9.85% (0.2802 => 0.3078, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6123, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.47% (0.3693 => 0.3895, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6720, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-2: 4.75% (1.8057 => 1.8914, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1687, std.dev.: 0.1449) SingleSource/Benchmarks/Dhrystone/dry: 4.26% (14.0481 => 14.6470, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2090, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.65% (2.0820 => 2.1164, std.dev.: 0.0099) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.64% (3.1722 => 3.2241, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2898, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3022, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5930, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.53% (2.4764 => 2.4385, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.78% (25.4195 => 16.5787, std.dev.: 0.0079) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9759, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7864, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -4.75% (0.2402 => 0.2288, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.56% (11.2080 => 10.8092, std.dev.: 0.0047) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7730, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.88% (17.2379 => 16.7407, std.dev.: 0.0643) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.78% (0.6293 => 0.6118, std.dev.: 0.0052) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8710, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5797, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4955, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1602, std.dev.: 0.0529) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0458, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 07:50:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 09:50:09 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121115155009.A5A182A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5901?compare_to=5897&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5901, Order: 168039, Start Time: 2012-11-15 14:21:25, End Time: 2012-11-15 15:50:28 To: 5897, Order: 168037, Start Time: 2012-11-15 12:37:41, End Time: 2012-11-15 14:04:39 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 3 (75 on baseline) Performance Improvements: 0 (21 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 989 (878 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.48% (6.8199 => 6.9207, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.11% (1.2917 => 1.3060, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.29% (0.3331 => 0.3474, std.dev.: 0.0019) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.38% (16.9082 => 16.9723, std.dev.: 1.2109) MultiSource/Applications/obsequi/Obsequi: 2.94% (1.0597 => 1.0909, std.dev.: 0.3027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.63% (22.1775 => 22.3172, std.dev.: 0.1027) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.71% (0.3681 => 0.3655, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 0.77% (0.6117 => 0.6164, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.51% (0.3336 => 0.3353, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 2.34% (0.2008 => 0.2055, std.dev.: 0.0080) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.46% (0.0218 => 0.0219, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0427 => 0.0429, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -21.92% (0.0333 => 0.0260, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.64% (0.0314 => 0.0316, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0426 => 0.0428, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 0.98% (0.0204 => 0.0206, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -19.27% (0.0218 => 0.0176, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -87.50% (0.0008 => 0.0001, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 1.36% (0.1469 => 0.1489, std.dev.: 0.0030) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 7.26% (1.1261 => 1.2079, std.dev.: 0.2322) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.40% (0.4212 => 0.4355, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.75% (0.1416 => 0.1455, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.66% (0.0622 => 0.0651, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 45.79% (0.0190 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.04% (0.0569 => 0.0546, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 2.71% (1.1852 => 1.2173, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 237.50% (0.0008 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.54% (0.0574 => 0.0646, std.dev.: 0.0140) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.35% (0.0213 => 0.0267, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.40% (0.7769 => 0.7800, std.dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: -66.67% (0.0003 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -50.00% (0.0002 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -49.35% (0.0077 => 0.0039, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2323.17% (0.6332 => 15.3435, std.dev.: 0.4523) MultiSource/Benchmarks/McCat/08-main/main: 51.77% (0.1831 => 0.2779, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.53% (0.1559 => 0.1504, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1545.04% (0.3344 => 5.5010, std.dev.: 0.2449) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.66% (0.2364 => 0.3278, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/mandel: -0.47% (0.0429 => 0.0427, std.dev.: 0.0010) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.68% (0.0224 => 0.0230, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 12.38% (0.1462 => 0.1643, std.dev.: 0.0250) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4574, std.dev.: 0.0768) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0683, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4947, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3321, std.dev.: 0.0248) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1718, std.dev.: 0.0293) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4010, std.dev.: 0.0061) SingleSource/Regression/C/uint64_to_float: -23.94% (2.1832 => 1.6606, std.dev.: 0.0021) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.68% (0.0848 => 0.0964, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.48% (0.8321 => 0.9027, std.dev.: 0.0264) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1983 => 0.2116, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.17% (0.2998 => 0.3183, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.84% (0.1885 => 0.1995, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.56% (1.1685 => 1.2335, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.55% (0.4559 => 0.4812, std.dev.: 0.0050) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.74% (6.6074 => 6.9207, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.63% (0.4127 => 0.4318, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.26% (1.2526 => 1.3060, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.25% (4.1763 => 4.3540, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.98% (0.3717 => 0.3865, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.85% (0.4783 => 0.4967, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (4.5702 => 4.7434, std.dev.: 0.0318) MultiSource/Benchmarks/nbench/nbench: 3.62% (1.1271 => 1.1679, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.55% (1.6386 => 1.6967, std.dev.: 0.0135) MultiSource/Applications/oggenc/oggenc: 3.41% (4.9628 => 5.1322, std.dev.: 0.0530) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.41% (0.8597 => 0.8890, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.39% (4.4873 => 4.6394, std.dev.: 0.0231) MultiSource/Benchmarks/Bullet/bullet: 3.36% (31.8598 => 32.9311, std.dev.: 0.1959) SingleSource/Benchmarks/Shootout-C++/moments: 3.24% (0.3645 => 0.3763, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.10% (0.8611 => 0.8878, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.09% (0.8697 => 0.8966, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.95% (0.8716 => 0.8973, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.91% (0.8069 => 0.8304, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.84% (0.9069 => 0.9327, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.81% (0.8518 => 0.8757, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.79% (0.8457 => 0.8693, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.68% (0.9039 => 0.9281, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.62% (0.8656 => 0.8883, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.62% (0.8331 => 0.8549, std.dev.: 0.0081) MultiSource/Benchmarks/mafft/pairlocalalign: 2.61% (8.6247 => 8.8500, std.dev.: 0.0416) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.61% (0.7932 => 0.8139, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.60% (0.8927 => 0.9159, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.57% (0.8855 => 0.9083, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.57% (0.9688 => 0.9937, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.57% (1.4479 => 1.4851, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.57% (0.6586 => 0.6755, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.52% (0.8204 => 0.8411, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.52% (0.8805 => 0.9027, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.47% (0.8066 => 0.8265, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.41% (0.8338 => 0.8539, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.39% (0.8420 => 0.8621, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.29% (0.8286 => 0.8476, std.dev.: 0.0071) MultiSource/Benchmarks/PAQ8p/paq8p: 2.26% (2.3764 => 2.4300, std.dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 106.53% (0.0199 => 0.0411, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/pi: 57.06% (1.5795 => 2.4808, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.70% (0.7597 => 0.8866, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.09% (2.9753 => 3.4541, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.58% (2.7995 => 3.2076, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6089, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.04% (0.3186 => 0.3474, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.67% (1.1857 => 1.2767, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 7.48% (1.7056 => 1.8332, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/richards_benchmark: 7.48% (1.3037 => 1.4012, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.70% (4.7794 => 5.0998, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 6.23% (3.1873 => 3.3860, std.dev.: 0.0328) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.92% (4.9686 => 5.2626, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.89% (4.5327 => 4.7997, std.dev.: 0.0203) MultiSource/Applications/lambda-0_1_3/lambda: 4.90% (7.4933 => 7.8604, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.63% (3.3761 => 3.5325, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.50% (6.2275 => 6.5079, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.19% (4.9453 => 5.1525, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.02% (4.9469 => 5.1458, std.dev.: 0.0111) MultiSource/Applications/hexxagon/hexxagon: 3.84% (14.0064 => 14.5447, std.dev.: 0.0585) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.82% (0.3587 => 0.3724, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.83% (11.5690 => 11.8961, std.dev.: 0.1047) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.35% (8.2783 => 8.4729, std.dev.: 0.0222) SingleSource/Benchmarks/Shootout/lists: 2.16% (7.3375 => 7.4958, std.dev.: 0.0204) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.97% (1.1365 => 1.1589, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.87% (1.2474 => 1.2707, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/neural/neural: 1.36% (1.0841 => 1.0988, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/ReedSolomon: 1.25% (8.5322 => 8.6385, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/power/power: 1.22% (1.2061 => 1.2208, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.15% (3.5679 => 3.6090, std.dev.: 0.0124) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.33% (5.4641 => 4.3534, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.34% (7.2130 => 6.1787, std.dev.: 0.0613) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.44% (1.0512 => 0.9309, std.dev.: 0.0201) SingleSource/Benchmarks/McGill/chomp: -10.78% (1.1216 => 1.0007, std.dev.: 0.0078) MultiSource/Benchmarks/mafft/pairlocalalign: -8.55% (63.1822 => 57.7816, std.dev.: 0.0304) SingleSource/Benchmarks/Shootout/heapsort: -8.17% (3.2926 => 3.0235, std.dev.: 0.0641) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.91% (14.6451 => 13.4861, std.dev.: 0.1520) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -7.01% (4.7482 => 4.4152, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.30% (0.3269 => 0.3063, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.94% (3.7148 => 3.4940, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.90% (5.4972 => 5.1729, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.08% (5.1557 => 4.8940, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.36% (4.7449 => 4.5379, std.dev.: 0.0223) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.95% (2.8773 => 2.7637, std.dev.: 0.0440) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.71% (6.0224 => 5.7991, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.92% (28.5821 => 27.7476, std.dev.: 0.2811) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.56% (9.9065 => 9.6533, std.dev.: 0.0247) SingleSource/Benchmarks/Shootout-C++/hash2: -2.16% (3.4237 => 3.3497, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.96% (11.5316 => 11.3061, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.58% (4.9994 => 4.9203, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.12% (5.6343 => 5.5711, std.dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 3.20% (16.4461 => 16.9723, std.dev.: 1.2109) MultiSource/Applications/obsequi/Obsequi: 6.30% (1.0262 => 1.0909, std.dev.: 0.3027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7046.08% (0.3123 => 22.3172, std.dev.: 0.1027) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.40% (0.2463 => 0.3655, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 2.56% (0.6010 => 0.6164, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.66% (0.3266 => 0.3353, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 4.37% (0.1969 => 0.2055, std.dev.: 0.0080) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.15% (0.0408 => 0.0429, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 2.36% (0.0254 => 0.0260, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.46% (0.0384 => 0.0428, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 8.42% (0.0190 => 0.0206, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -2.22% (0.0180 => 0.0176, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 3.55% (0.1438 => 0.1489, std.dev.: 0.0030) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 6.62% (1.1329 => 1.2079, std.dev.: 0.2322) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.59% (0.4164 => 0.4355, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.28% (0.1369 => 0.1455, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.56% (0.0641 => 0.0651, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.54% (0.0578 => 0.0546, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.44% (1.1437 => 1.2173, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.03% (0.0627 => 0.0646, std.dev.: 0.0140) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.71% (0.8017 => 0.7800, std.dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -37.10% (0.0062 => 0.0039, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 08:02:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 10:02:27 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121115160227.5C01D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5902?compare_to=5898&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5902, Order: 168039, Start Time: 2012-11-15 14:37:41, End Time: 2012-11-15 16:02:45 To: 5898, Order: 168037, Start Time: 2012-11-15 12:49:22, End Time: 2012-11-15 14:14:34 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 1 (181 on baseline) Unchanged Tests: 1040 (856 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.35% (55.0864 => 56.3817, std.dev.: 0.1574) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.87% (3.8180 => 3.7467, std.dev.: 0.0171) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.25% (1.2783 => 1.3710, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.31% (54.5751 => 56.3817, std.dev.: 0.1574) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.06% (2.0478 => 2.1104, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: 2.59% (7.4937 => 7.6875, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 1.86% (3.1932 => 3.2527, std.dev.: 0.0068) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.77% (0.3821 => 0.3524, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -6.97% (2.4924 => 2.3187, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.92% (0.9542 => 0.8882, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -6.85% (0.3357 => 0.3127, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -6.66% (0.3812 => 0.3558, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.63% (0.3831 => 0.3577, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -6.57% (0.3880 => 0.3625, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -6.52% (0.3848 => 0.3597, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.52% (0.4033 => 0.3770, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -6.52% (0.3896 => 0.3642, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.46% (0.3884 => 0.3633, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.43% (0.3142 => 0.2940, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.35% (0.3891 => 0.3644, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -6.30% (0.4176 => 0.3913, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.29% (0.1796 => 0.1683, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.26% (0.2428 => 0.2276, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.22% (0.6484 => 0.6081, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -6.20% (9.2283 => 8.6563, std.dev.: 0.0073) SingleSource/UnitTests/ObjC/property: -6.14% (0.4199 => 0.3941, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -6.14% (16.1920 => 15.1977, std.dev.: 0.0165) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.11% (0.2355 => 0.2211, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.99% (0.9852 => 0.9262, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.97% (1.0544 => 0.9914, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.96% (0.5591 => 0.5258, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: -5.94% (7.0961 => 6.6748, std.dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.92% (1.3722 => 1.2910, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.91% (0.5478 => 0.5154, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.90% (0.3658 => 0.3442, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: -5.87% (0.9179 => 0.8640, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.82% (0.5805 => 0.5467, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.79% (0.6681 => 0.6294, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.77% (0.6304 => 0.5940, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.76% (6.7716 => 6.3813, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.76% (0.6194 => 0.5837, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.75% (4.0323 => 3.8003, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.75% (0.2695 => 0.2540, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.74% (0.6660 => 0.6278, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.72% (0.6395 => 0.6029, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.72% (0.7339 => 0.6919, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.72% (0.5857 => 0.5522, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.72% (0.6260 => 0.5902, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.71% (0.6667 => 0.6286, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.70% (4.8161 => 4.5414, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.70% (0.6189 => 0.5836, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.70% (0.7524 => 0.7095, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: -5.70% (0.4280 => 0.4036, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.70% (1.2300 => 1.1599, std.dev.: 0.0083) MultiSource/Benchmarks/nbench/nbench: -5.70% (1.1530 => 1.0873, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.69% (3.5339 => 3.3329, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.69% (0.6297 => 0.5939, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.68% (0.6230 => 0.5876, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.66% (0.6676 => 0.6298, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.66% (0.5569 => 0.5254, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.65% (0.5802 => 0.5474, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -5.65% (0.4515 => 0.4260, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.64% (4.8802 => 4.6048, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.62% (0.5925 => 0.5592, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.59% (0.5863 => 0.5535, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.57% (0.5705 => 0.5387, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.57% (0.5849 => 0.5523, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.57% (0.5581 => 0.5270, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.56% (0.5859 => 0.5533, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.55% (0.6446 => 0.6088, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.55% (1.4642 => 1.3829, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.55% (0.5567 => 0.5258, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: -5.55% (0.3406 => 0.3217, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.55% (0.5570 => 0.5261, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.52% (4.5069 => 4.2582, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.51% (0.5575 => 0.5268, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.50% (0.6395 => 0.6043, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.50% (0.5941 => 0.5614, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.50% (0.3255 => 0.3076, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -5.46% (1.1450 => 1.0825, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.46% (0.8521 => 0.8056, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/methcall: -5.45% (0.3025 => 0.2860, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.45% (1.2784 => 1.2087, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.44% (0.5456 => 0.5159, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.44% (0.6052 => 0.5723, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.43% (0.6440 => 0.6090, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: -5.43% (0.2871 => 0.2715, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.43% (0.3057 => 0.2891, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.41% (0.5688 => 0.5380, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.41% (0.2939 => 0.2780, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.40% (1.6364 => 1.5480, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.39% (0.3194 => 0.3022, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.37% (0.4151 => 0.3928, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.37% (14.2083 => 13.4458, std.dev.: 0.0181) MultiSource/Applications/Burg/burg: -5.35% (1.2515 => 1.1845, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.35% (0.2933 => 0.2776, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -5.35% (0.7779 => 0.7363, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.34% (0.3837 => 0.3632, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.34% (0.3016 => 0.2855, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.31% (2.1713 => 2.0559, std.dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.31% (0.6736 => 0.6378, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hello: -5.30% (0.2849 => 0.2698, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.30% (0.2548 => 0.2413, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -5.29% (0.2985 => 0.2827, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.28% (0.3483 => 0.3299, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -5.28% (1.3148 => 1.2454, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.27% (1.2210 => 1.1566, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.27% (0.2903 => 0.2750, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.27% (0.3931 => 0.3724, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: -5.25% (0.3026 => 0.2867, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -5.23% (4.3330 => 4.1063, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/18-imp/imp: -5.22% (0.3581 => 0.3394, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.21% (0.4916 => 0.4660, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -5.19% (17.1032 => 16.2148, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.18% (8.0126 => 7.5974, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.18% (0.2278 => 0.2160, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.17% (0.6033 => 0.5721, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -5.17% (0.6347 => 0.6019, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.16% (1.2221 => 1.1590, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -5.15% (1.3864 => 1.3150, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary3: -5.14% (0.3446 => 0.3269, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -5.08% (15.5079 => 14.7198, std.dev.: 0.0087) SingleSource/UnitTests/ObjC++/property-reference-object: -5.08% (0.6441 => 0.6114, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.07% (0.3252 => 0.3087, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -5.07% (0.3394 => 0.3222, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -5.06% (0.3481 => 0.3305, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -5.05% (0.3205 => 0.3043, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.05% (0.7919 => 0.7519, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: -5.04% (0.2659 => 0.2525, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -5.03% (0.3059 => 0.2905, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -5.01% (3.5154 => 3.3394, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.00% (0.3319 => 0.3153, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/strcat: -4.98% (0.2989 => 0.2840, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.98% (0.5999 => 0.5700, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.97% (0.2999 => 0.2850, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: -4.97% (0.4248 => 0.4037, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.95% (0.2385 => 0.2267, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.93% (0.7198 => 0.6843, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists1: -4.91% (0.3867 => 0.3677, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.91% (0.6293 => 0.5984, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -4.89% (0.3621 => 0.3444, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.86% (0.5168 => 0.4917, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -4.81% (15.2527 => 14.5193, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.79% (1.6474 => 1.5685, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.74% (0.4813 => 0.4585, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: -4.73% (0.4861 => 0.4631, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.73% (0.3849 => 0.3667, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -4.68% (4.0594 => 3.8693, std.dev.: 0.0067) MultiSource/Applications/oggenc/oggenc: -4.67% (5.0226 => 4.7879, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: -4.62% (0.7447 => 0.7103, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.62% (0.5329 => 0.5083, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.60% (0.4083 => 0.3895, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.59% (0.7021 => 0.6699, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -4.57% (0.3788 => 0.3615, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.53% (0.9557 => 0.9124, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.50% (0.4427 => 0.4228, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: -4.43% (0.3271 => 0.3126, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: -4.42% (0.8418 => 0.8046, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -4.41% (34.0927 => 32.5901, std.dev.: 0.0158) MultiSource/Applications/treecc/treecc: -4.40% (2.1401 => 2.0460, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -4.38% (2.4021 => 2.2968, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.35% (22.4056 => 21.4303, std.dev.: 0.0194) MultiSource/Applications/lambda-0_1_3/lambda: -4.22% (0.7982 => 0.7645, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: -4.20% (0.4524 => 0.4334, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.15% (0.3323 => 0.3185, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -4.08% (18.2933 => 17.5468, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.07% (0.3491 => 0.3349, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.03% (2.2587 => 2.1676, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/bigfib: -4.01% (0.6750 => 0.6479, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.83% (0.9077 => 0.8729, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.80% (0.4321 => 0.4157, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: -3.29% (1.5610 => 1.5096, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.28% (5.4682 => 5.2889, std.dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -2.29% (20.7746 => 20.2990, std.dev.: 0.0309) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7535, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/richards_benchmark: -8.68% (1.2842 => 1.1727, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.97% (1.7753 => 1.7049, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: -3.87% (2.2633 => 2.1758, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.00% (1.3096 => 1.2834, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.50% (6.5735 => 6.4746, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 09:35:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 11:35:09 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121115173509.6E7052A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5903?compare_to=5901&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5903, Order: 168045, Start Time: 2012-11-15 16:07:22, End Time: 2012-11-15 17:35:28 To: 5901, Order: 168039, Start Time: 2012-11-15 14:21:25, End Time: 2012-11-15 15:50:28 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 9 (82 on baseline) Performance Improvements: 9 (25 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 974 (867 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.88% (0.8265 => 0.8503, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.42% (0.6155 => 0.6304, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 2.10% (0.7014 => 0.7161, std.dev.: 0.0055) MultiSource/Applications/SIBsim4/SIBsim4: 1.51% (1.2890 => 1.3084, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.16% (6.1787 => 6.4973, std.dev.: 0.0543) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.89% (4.3423 => 4.4679, std.dev.: 0.0247) SingleSource/Benchmarks/Shootout-C++/lists1: 2.13% (0.6092 => 0.6222, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/pi: 1.02% (2.4808 => 2.5062, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.01% (59.1838 => 59.7826, std.dev.: 0.0843) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.55% (5.1322 => 5.0526, std.dev.: 0.0144) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.68% (47.4550 => 44.7617, std.dev.: 0.8121) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.26% (1.0597 => 1.0146, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.91% (1.6085 => 1.5777, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.84% (1.4485 => 1.4219, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/richards_benchmark: -1.23% (1.4012 => 1.3840, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.13% (3.1806 => 3.1448, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.02% (1.2707 => 1.2578, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-6: -1.00% (2.4703 => 2.4455, std.dev.: 0.0096) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.21% (16.9723 => 17.0082, std.dev.: 0.7653) MultiSource/Applications/obsequi/Obsequi: -1.47% (1.0909 => 1.0749, std.dev.: 0.1033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.66% (22.3172 => 22.1704, std.dev.: 0.8832) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.22% (0.3655 => 0.3663, std.dev.: 0.0771) SingleSource/Benchmarks/Misc-C++/bigfib: -1.18% (0.6164 => 0.6091, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: -1.91% (0.3353 => 0.3289, std.dev.: 0.0297) SingleSource/Benchmarks/Shootout-C++/strcat: -2.19% (0.2055 => 0.2010, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.91% (0.0219 => 0.0221, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -10.72% (0.0429 => 0.0383, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.54% (0.0260 => 0.0264, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0316 => 0.0316, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.23% (0.0428 => 0.0427, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0206 => 0.0206, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 20.45% (0.0176 => 0.0212, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 600.00% (0.0001 => 0.0007, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.67% (0.1489 => 0.1479, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.05% (1.2079 => 1.2206, std.dev.: 0.1663) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.09% (0.4355 => 0.4359, std.dev.: 0.0188) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.99% (0.1455 => 0.1484, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.61% (0.0651 => 0.0647, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -22.38% (0.0277 => 0.0215, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.56% (0.0546 => 0.0560, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.24% (1.2173 => 1.2022, std.dev.: 0.0560) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -41.94% (0.0031 => 0.0018, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.31% (0.0646 => 0.0644, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.37% (0.0267 => 0.0266, std.dev.: 0.0075) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.04% (0.7800 => 0.7797, std.dev.: 0.0196) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 82.05% (0.0039 => 0.0071, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2314.32% (0.6332 => 15.2875, std.dev.: 0.5208) MultiSource/Benchmarks/McCat/08-main/main: 57.07% (0.1831 => 0.2876, std.dev.: 0.0712) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.84% (0.1559 => 0.1468, std.dev.: 0.0196) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1523.53% (0.3344 => 5.4291, std.dev.: 0.0292) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.69% (0.2364 => 0.3255, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel: -0.23% (0.0429 => 0.0428, std.dev.: 0.0010) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.34% (0.0224 => 0.0221, std.dev.: 0.0086) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0085) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 10.74% (0.1462 => 0.1619, std.dev.: 0.0067) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4585, std.dev.: 0.0273) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0697, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4956, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3259, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1513, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4031, std.dev.: 0.0074) SingleSource/Regression/C/uint64_to_float: -23.97% (2.1832 => 1.6598, std.dev.: 0.0089) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.98% (0.0810 => 0.0988, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.98% (0.7473 => 0.8069, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.75% (0.5961 => 0.6304, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.58% (0.6287 => 0.6638, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.42% (0.8066 => 0.8503, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 4.79% (1.4269 => 1.4953, std.dev.: 0.0056) MultiSource/Applications/minisat/minisat: 4.78% (0.6834 => 0.7161, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.13% (0.8716 => 0.9076, std.dev.: 0.0078) MultiSource/Applications/SIBsim4/SIBsim4: 4.11% (1.2568 => 1.3084, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 4.05% (3.8189 => 3.9736, std.dev.: 0.0240) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.87% (0.5817 => 0.6042, std.dev.: 0.0083) MultiSource/Applications/ClamAV/clamscan: 3.58% (14.7684 => 15.2967, std.dev.: 0.0831) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.51% (2.1401 => 2.2152, std.dev.: 0.0056) MultiSource/Applications/sgefa/sgefa: 3.40% (0.2999 => 0.3101, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.38% (0.4559 => 0.4713, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.22% (14.2605 => 14.7203, std.dev.: 0.1042) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.11% (1.3279 => 1.3692, std.dev.: 0.0120) MultiSource/Applications/siod/siod: 2.98% (2.2184 => 2.2846, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.96% (0.7966 => 0.8202, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.95% (0.8359 => 0.8606, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.84% (0.8261 => 0.8496, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.83% (0.8457 => 0.8696, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.77% (0.8204 => 0.8431, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.76% (0.8518 => 0.8753, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.73% (0.8885 => 0.9128, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.68% (0.8317 => 0.8540, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.67% (0.8050 => 0.8265, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.62% (0.9056 => 0.9293, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.60% (0.9908 => 1.0166, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.56% (0.9688 => 0.9936, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.54% (0.8331 => 0.8543, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.53% (0.9074 => 0.9304, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.53% (0.8286 => 0.8496, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.53% (3.1832 => 3.2637, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.53% (0.9069 => 0.9298, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.45% (0.8069 => 0.8267, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.42% (0.8855 => 0.9069, std.dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: 2.36% (15.3280 => 15.6890, std.dev.: 0.0753) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.34% (0.8712 => 0.8916, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.31% (0.5191 => 0.5311, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.30% (1.5315 => 1.5668, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.29% (0.8656 => 0.8854, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.27% (0.8805 => 0.9005, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.26% (0.8927 => 0.9129, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.23% (0.8177 => 0.8359, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.21% (0.9039 => 0.9239, std.dev.: 0.0048) MultiSource/Applications/d/make_dparser: 2.08% (3.2366 => 3.3040, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.84% (0.8086 => 0.8235, std.dev.: 0.0049) MultiSource/Applications/oggenc/oggenc: 1.81% (4.9628 => 5.0526, std.dev.: 0.0144) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 113.07% (0.0199 => 0.0424, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/pi: 58.67% (1.5795 => 2.5062, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.39% (2.9753 => 3.4631, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.99% (0.7597 => 0.8812, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.66% (2.7995 => 3.2099, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.55% (5.0261 => 5.6064, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.60% (0.3186 => 0.3492, std.dev.: 0.0113) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.13% (1.1857 => 1.2821, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 7.19% (1.7056 => 1.8283, std.dev.: 0.0175) MultiSource/Applications/SIBsim4/SIBsim4: 6.75% (3.1873 => 3.4026, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.70% (4.7794 => 5.0996, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: 6.16% (1.3037 => 1.3840, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.89% (4.9686 => 5.2612, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.88% (4.5327 => 4.7992, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.59% (6.3772 => 6.7337, std.dev.: 0.1095) MultiSource/Applications/lambda-0_1_3/lambda: 5.47% (7.4933 => 7.9035, std.dev.: 0.0855) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.69% (3.3761 => 3.5345, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.67% (6.2275 => 6.5182, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.02% (4.9469 => 5.1460, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.00% (4.9453 => 5.1429, std.dev.: 0.0137) MultiSource/Applications/hexxagon/hexxagon: 3.92% (14.0064 => 14.5549, std.dev.: 0.1136) MultiSource/Applications/siod/siod: 2.91% (3.6643 => 3.7708, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.81% (11.5690 => 11.8944, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.71% (8.2783 => 8.5026, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.59% (4.3552 => 4.4679, std.dev.: 0.0247) SingleSource/Benchmarks/Shootout/lists: 2.30% (7.3375 => 7.5065, std.dev.: 0.0237) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.97% (4.8362 => 4.9316, std.dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.93% (1.1365 => 1.1584, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.52% (4.0473 => 4.1090, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/neural/neural: 1.37% (1.0841 => 1.0990, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.26% (3.5679 => 3.6130, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/ReedSolomon: 1.19% (8.5322 => 8.6335, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/power/power: 1.09% (1.2061 => 1.2192, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.05% (5.4641 => 4.3137, std.dev.: 0.0260) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.22% (1.0512 => 0.9333, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: -10.43% (1.1216 => 1.0046, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -9.92% (7.2130 => 6.4973, std.dev.: 0.0543) MultiSource/Benchmarks/mafft/pairlocalalign: -8.51% (63.1822 => 57.8067, std.dev.: 0.1279) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.43% (14.6451 => 13.4109, std.dev.: 0.1276) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.87% (4.7482 => 4.4218, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.01% (5.4972 => 5.1667, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.94% (3.7148 => 3.4941, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.06% (5.1557 => 4.8949, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.38% (4.7449 => 4.5370, std.dev.: 0.0066) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.03% (2.8773 => 2.7614, std.dev.: 0.0391) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.66% (6.0224 => 5.8019, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.28% (2.4490 => 2.3686, std.dev.: 0.0276) MultiSource/Benchmarks/Prolangs-C++/life/life: -3.10% (2.6356 => 2.5539, std.dev.: 0.0192) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.01% (0.5807 => 0.5632, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.93% (28.5821 => 27.7450, std.dev.: 0.0405) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.55% (9.9065 => 9.6534, std.dev.: 0.0665) MultiSource/Applications/aha/aha: -2.43% (3.3398 => 3.2588, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.24% (3.2169 => 3.1448, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/hash2: -2.20% (3.4237 => 3.3483, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.93% (11.5316 => 11.3090, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.43% (2.3487 => 2.3152, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.38% (4.9994 => 4.9305, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.00% (5.4187 => 5.3644, std.dev.: 0.0130) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 3.42% (16.4461 => 17.0082, std.dev.: 0.7653) MultiSource/Applications/obsequi/Obsequi: 4.75% (1.0262 => 1.0749, std.dev.: 0.1033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6999.07% (0.3123 => 22.1704, std.dev.: 0.8832) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.72% (0.2463 => 0.3663, std.dev.: 0.0771) SingleSource/Benchmarks/Misc-C++/bigfib: 1.35% (0.6010 => 0.6091, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.70% (0.3266 => 0.3289, std.dev.: 0.0297) SingleSource/Benchmarks/Shootout-C++/strcat: 2.08% (0.1969 => 0.2010, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 79.67% (0.0123 => 0.0221, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -6.13% (0.0408 => 0.0383, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.94% (0.0254 => 0.0264, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.20% (0.0384 => 0.0427, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/casts: 8.42% (0.0190 => 0.0206, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 17.78% (0.0180 => 0.0212, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0007 => 0.0007, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.85% (0.1438 => 0.1479, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 7.74% (1.1329 => 1.2206, std.dev.: 0.1663) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.68% (0.4164 => 0.4359, std.dev.: 0.0188) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.40% (0.1369 => 0.1484, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.94% (0.0641 => 0.0647, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 10.26% (0.0195 => 0.0215, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.11% (0.0578 => 0.0560, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.11% (1.1437 => 1.2022, std.dev.: 0.0560) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1700.00% (0.0001 => 0.0018, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.71% (0.0627 => 0.0644, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0075) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.74% (0.8017 => 0.7797, std.dev.: 0.0196) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 14.52% (0.0062 => 0.0071, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 09:50:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 11:50:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121115175041.2BDFC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5904?compare_to=5902&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5904, Order: 168045, Start Time: 2012-11-15 16:25:48, End Time: 2012-11-15 17:50:59 To: 5902, Order: 168039, Start Time: 2012-11-15 14:37:41, End Time: 2012-11-15 16:02:45 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (181 on baseline) Unchanged Tests: 1041 (857 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.41% (77.7980 => 78.8961, std.dev.: 0.2983) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.01% (2.0478 => 2.1094, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.4937 => 7.6780, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/hash2: 2.15% (3.1932 => 3.2620, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.74% (0.1431 => 0.1306, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.62% (0.3821 => 0.3530, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: -7.11% (2.4924 => 2.3152, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.84% (0.9542 => 0.8889, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.82% (0.3357 => 0.3128, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.34% (0.2428 => 0.2274, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.30% (0.3142 => 0.2944, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.18% (0.1796 => 0.1685, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: -6.16% (9.2283 => 8.6602, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.12% (0.6484 => 0.6087, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -6.05% (16.1920 => 15.2126, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.05% (0.5591 => 0.5253, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.03% (0.2355 => 0.2213, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: -6.02% (0.2160 => 0.2030, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.97% (1.0544 => 0.9914, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.95% (0.9852 => 0.9266, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.90% (1.3722 => 1.2913, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: -5.88% (7.0961 => 6.6791, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/football/football: -5.86% (0.9179 => 0.8641, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.83% (0.1716 => 0.1616, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.82% (0.3658 => 0.3445, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.79% (0.5478 => 0.5161, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/trivial-interface: -5.75% (0.3812 => 0.3593, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.74% (0.5805 => 0.5472, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.71% (0.6304 => 0.5944, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.71% (0.7339 => 0.6920, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.70% (0.6260 => 0.5903, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.70% (3.5339 => 3.3326, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions-3: -5.69% (0.3848 => 0.3629, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -5.69% (0.3831 => 0.3613, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.69% (0.5925 => 0.5588, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.69% (0.5857 => 0.5524, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.68% (0.6194 => 0.5842, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.67% (0.6189 => 0.5838, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.67% (0.6230 => 0.5877, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.66% (0.6676 => 0.6298, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -5.65% (0.3896 => 0.3676, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.64% (0.5705 => 0.5383, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.64% (1.6364 => 1.5441, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.64% (0.2695 => 0.2543, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -5.63% (0.4033 => 0.3806, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.62% (0.6667 => 0.6292, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -5.62% (0.3880 => 0.3662, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.61% (0.6297 => 0.5944, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.60% (0.5802 => 0.5477, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.60% (0.6395 => 0.6037, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.59% (0.3884 => 0.3667, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.59% (0.6660 => 0.6288, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/05-eks/eks: -5.58% (0.4515 => 0.4263, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.58% (0.5863 => 0.5536, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.58% (0.3891 => 0.3674, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.57% (0.6052 => 0.5715, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.57% (0.5569 => 0.5259, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.57% (1.4642 => 1.3827, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.55% (0.6446 => 0.6088, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.54% (0.5581 => 0.5272, std.dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.54% (1.2300 => 1.1619, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions: -5.53% (0.4176 => 0.3945, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.51% (1.2784 => 1.2079, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.51% (0.5570 => 0.5263, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.51% (0.6681 => 0.6313, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.51% (4.8161 => 4.5509, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.50% (4.0323 => 3.8107, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.49% (0.7524 => 0.7111, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.48% (6.7716 => 6.4003, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.48% (0.5859 => 0.5538, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.48% (0.5567 => 0.5262, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.48% (0.6736 => 0.6367, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.46% (4.8802 => 4.6135, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.45% (0.5941 => 0.5617, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.44% (0.6395 => 0.6047, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.44% (0.5849 => 0.5531, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.40% (0.3406 => 0.3222, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -5.38% (1.3864 => 1.3118, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -5.37% (1.1450 => 1.0835, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.37% (0.5456 => 0.5163, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.36% (0.5575 => 0.5276, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.36% (0.5688 => 0.5383, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.36% (0.6440 => 0.6095, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.35% (4.5069 => 4.2659, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.32% (14.2083 => 13.4520, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.31% (0.3483 => 0.3298, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -5.30% (1.2515 => 1.1852, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.27% (1.2210 => 1.1566, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.27% (0.6033 => 0.5715, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.27% (0.8521 => 0.8072, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: -5.26% (0.4199 => 0.3978, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.25% (1.2221 => 1.1580, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: -5.20% (17.1032 => 16.2134, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/gs/gs: -5.18% (4.3330 => 4.1085, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.16% (0.7919 => 0.7510, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: -5.14% (0.3581 => 0.3397, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -5.13% (0.2985 => 0.2832, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: -5.07% (1.3148 => 1.2482, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.04% (0.4916 => 0.4668, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.04% (8.0126 => 7.6091, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.02% (0.2548 => 0.2420, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -5.02% (15.5079 => 14.7296, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.01% (0.6293 => 0.5978, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.00% (0.7198 => 0.6838, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.99% (0.4151 => 0.3944, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.95% (0.4280 => 0.4068, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -4.95% (0.3255 => 0.3094, std.dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: -4.93% (1.1530 => 1.0961, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.93% (0.3837 => 0.3648, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: -4.93% (0.3025 => 0.2876, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -4.92% (0.3194 => 0.3037, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.91% (0.3931 => 0.3738, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -4.89% (0.2659 => 0.2529) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (0.2871 => 0.2731, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -4.87% (15.2527 => 14.5104, std.dev.: 0.0085) MultiSource/Applications/minisat/minisat: -4.86% (0.7447 => 0.7085, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: -4.85% (3.5154 => 3.3448, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.84% (0.3057 => 0.2909, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.84% (0.5168 => 0.4918, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -4.83% (0.2939 => 0.2797, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.83% (0.2278 => 0.2168, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.81% (1.6474 => 1.5681, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.81% (0.2933 => 0.2792, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.79% (0.2903 => 0.2764, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.77% (0.3016 => 0.2872, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.76% (0.3319 => 0.3161, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/except: -4.76% (0.3026 => 0.2882, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.75% (2.1713 => 2.0681, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hello: -4.74% (0.2849 => 0.2714, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -4.72% (4.0594 => 3.8679, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.69% (0.7021 => 0.6692, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.67% (0.5329 => 0.5080, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.67% (0.5999 => 0.5719, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.64% (0.3252 => 0.3101, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -4.64% (0.3446 => 0.3286, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: -4.64% (5.0226 => 4.7897, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -4.62% (0.3205 => 0.3057, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -4.62% (0.2989 => 0.2851, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -4.60% (0.3481 => 0.3321, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary: -4.60% (0.3394 => 0.3238, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -4.57% (0.4248 => 0.4054, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.51% (22.4056 => 21.3960, std.dev.: 0.0110) SingleSource/Regression/C++/ofstream_ctor: -4.48% (0.3059 => 0.2922, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.47% (0.4813 => 0.4598, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: -4.45% (0.3867 => 0.3695, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -4.44% (0.7779 => 0.7434, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: -4.43% (2.1401 => 2.0454, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists: -4.42% (0.3621 => 0.3461, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.41% (0.9557 => 0.9136, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -4.36% (0.7982 => 0.7634, std.dev.: 0.0023) MultiSource/Applications/siod/siod: -4.35% (2.4021 => 2.2976, std.dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.26% (0.3849 => 0.3685, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.25% (0.3271 => 0.3132, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: -4.24% (0.4524 => 0.4332, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.24% (0.4083 => 0.3910, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: -4.21% (0.6347 => 0.6080, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -4.19% (34.0927 => 32.6632, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: -4.16% (0.8418 => 0.8068, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.13% (0.2999 => 0.2875, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: -4.12% (0.3788 => 0.3632, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.07% (0.4427 => 0.4247, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -4.02% (18.2933 => 17.5570, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.02% (2.2587 => 2.1680, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.01% (0.6441 => 0.6183, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -3.93% (0.6750 => 0.6485, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.90% (0.3491 => 0.3355, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.64% (0.3323 => 0.3202, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.56% (0.9077 => 0.8754, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: -3.49% (1.5610 => 1.5065, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.33% (5.4682 => 5.2862, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.55% (0.4321 => 0.4211, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -2.53% (20.7746 => 20.2490, std.dev.: 0.0199) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7563, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: -8.69% (1.2842 => 1.1726, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.80% (2.2633 => 2.1772, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.10% (1.0557 => 1.0230, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.13% (1.3096 => 1.2817, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4743, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.03% (79.7170 => 78.8961, std.dev.: 0.2983) Report Time: 2.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 10:06:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 12:06:28 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121115180628.B49CA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5905?compare_to=5899&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5905, Order: 168042, Start Time: 2012-11-15 15:54:43, End Time: 2012-11-15 18:06:46 To: 5899, Order: 168037, Start Time: 2012-11-15 12:53:31, End Time: 2012-11-15 15:04:16 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 31 (117 on baseline) Performance Improvements: 5 (40 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1002 (730 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.94% (0.4002 => 0.4680, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 15.51% (0.7208 => 0.8326, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.35% (0.5920 => 0.6829, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.98% (0.4526 => 0.5204, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.57% (0.6183 => 0.7084, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 13.37% (0.0778 => 0.0882, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 13.26% (0.2971 => 0.3365, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 12.64% (0.3449 => 0.3885, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.44% (0.1045 => 0.1175, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.43% (0.7847 => 0.8744, std.dev.: 0.0270) MultiSource/Applications/lambda-0_1_3/lambda: 11.26% (0.8489 => 0.9445, std.dev.: 0.0304) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 10.65% (0.8091 => 0.8953, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.42% (0.6884 => 0.7601, std.dev.: 0.0188) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.15% (0.4326 => 0.4765, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.08% (0.6192 => 0.6816, std.dev.: 0.0167) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.93% (0.1904 => 0.2093, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.20% (0.3991 => 0.4358, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.08% (1.5093 => 1.6313, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.97% (0.3164 => 0.3353, std.dev.: 0.0068) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.81% (0.3470 => 0.3637, std.dev.: 0.0041) MultiSource/Benchmarks/PAQ8p/paq8p: 1.86% (11.3242 => 11.5347, std.dev.: 0.0300) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 13.81% (0.6951 => 0.7911, std.dev.: 0.0255) SingleSource/Benchmarks/Shootout-C++/heapsort: 11.86% (3.9363 => 4.4031, std.dev.: 0.0916) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 10.85% (5.3941 => 5.9794, std.dev.: 0.0775) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 10.18% (0.4105 => 0.4523, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/bh/bh: 6.98% (1.9577 => 2.0943, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.49% (4.2376 => 4.3431, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.72% (4.8428 => 4.9263, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.49% (61.3350 => 62.2490, std.dev.: 0.0721) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.29% (5.6840 => 5.7573, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.09% (5.4384 => 5.4978, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.60% (6.1334 => 5.7897, std.dev.: 0.1205) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.64% (0.6552 => 0.6248, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.41% (8.5933 => 8.2999, std.dev.: 0.1067) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: -11.94% (1.9959 => 1.7576, std.dev.: 0.0921) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -3.72% (5.5443 => 5.3380, std.dev.: 0.0335) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -1.62% (0.1361 => 0.1339, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.03% (0.0418 => 0.0485, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.98% (0.0679 => 0.0652, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: -0.11% (494.1669 => 493.6431, std.dev.: 0.3725) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.89% (4.3882 => 0.0485, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 43674.33% (1.1277 => 493.6431, std.dev.: 0.3725) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 193.96% (0.5229 => 1.5371, std.dev.: 0.1109) MultiSource/Applications/SPASS/SPASS: 20.80% (14.9895 => 18.1075, std.dev.: 0.2516) MultiSource/Applications/kimwitu++/kc: 48.55% (14.1553 => 21.0278, std.dev.: 0.3605) MultiSource/Benchmarks/MallocBench/gs/gs: 21.72% (4.1105 => 5.0035, std.dev.: 0.0671) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 47.66% (1.1048 => 1.6313, std.dev.: 0.0125) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 434.79% (7.1582 => 38.2814, std.dev.: 0.1471) SingleSource/Benchmarks/Misc-C++-EH/spirit: 82.08% (3.4629 => 6.3053, std.dev.: 0.3395) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.45% (0.6222 => 1.0294, std.dev.: 0.0760) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10887.64% (0.0720 => 7.9111, std.dev.: 0.1591) MultiSource/Applications/SIBsim4/SIBsim4: 3887900.00% (0.0001 => 3.8880, std.dev.: 0.0253) MultiSource/Applications/SPASS/SPASS: 15094100.00% (0.0001 => 15.0942, std.dev.: 0.0919) MultiSource/Applications/kimwitu++/kc: 53900.00% (0.0001 => 0.0540, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 578300.00% (0.0001 => 0.5784, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10083800.00% (0.0001 => 10.0839, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6182600.00% (0.0001 => 6.1827, std.dev.: 0.5891) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1811.42% (1.1194 => 21.3964, std.dev.: 0.2462) MultiSource/Applications/ClamAV/clamscan: 68.87% (22.1758 => 37.4481, std.dev.: 0.2622) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 59.08% (2.9384 => 4.6744, std.dev.: 0.3715) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 58.44% (7.0540 => 11.1767, std.dev.: 0.0486) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 51.91% (8.1363 => 12.3598, std.dev.: 0.0753) MultiSource/Applications/JM/lencod/lencod: 46.29% (21.9371 => 32.0912, std.dev.: 0.2191) SingleSource/UnitTests/vla: 45.07% (0.0355 => 0.0515, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/distray/distray: 44.51% (0.1056 => 0.1526, std.dev.: 0.0095) SingleSource/Benchmarks/CoyoteBench/almabench: 39.18% (0.0730 => 0.1016, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 38.06% (0.1432 => 0.1977, std.dev.: 0.0078) SingleSource/UnitTests/ObjC/dot-syntax-1: 35.28% (0.0479 => 0.0648, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 33.65% (0.1566 => 0.2093, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 31.44% (0.0528 => 0.0694, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 31.25% (0.0672 => 0.0882, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/family/family: 29.97% (0.0397 => 0.0516, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 28.22% (0.3650 => 0.4680, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 27.07% (0.7433 => 0.9445, std.dev.: 0.0304) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 26.83% (0.4103 => 0.5204, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 26.20% (0.2107 => 0.2659, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/life/life: 25.94% (0.0933 => 0.1175, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.26% (0.0746 => 0.0927, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/fibo: 23.49% (0.2725 => 0.3365, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: 23.29% (0.3865 => 0.4765, std.dev.: 0.0113) SingleSource/Benchmarks/Dhrystone/fldry: 23.28% (0.0481 => 0.0593, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/Oscar: 23.27% (0.0636 => 0.0784, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 22.87% (0.3162 => 0.3885, std.dev.: 0.0073) MultiSource/Applications/siod/siod: 22.43% (2.2969 => 2.8121, std.dev.: 0.0865) MultiSource/Benchmarks/McCat/08-main/main: 21.93% (0.2554 => 0.3114, std.dev.: 0.0156) MultiSource/Applications/lua/lua: 21.78% (3.8723 => 4.7157, std.dev.: 0.1045) SingleSource/UnitTests/ObjC/exceptions-2: 21.76% (0.3497 => 0.4258, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/messages-2: 21.60% (0.0662 => 0.0805, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.57% (0.2758 => 0.3353, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 20.78% (0.2603 => 0.3144, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 20.58% (14.3668 => 17.3228, std.dev.: 0.1979) SingleSource/UnitTests/ObjC/exceptions-3: 20.16% (0.3516 => 0.4225, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.05% (0.1117 => 0.1341, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: 20.00% (0.1175 => 0.1410, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: 19.71% (4.2646 => 5.1053, std.dev.: 0.1425) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 19.58% (1.5415 => 1.8433, std.dev.: 0.0578) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 19.38% (0.5981 => 0.7140, std.dev.: 0.0130) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.38% (0.1125 => 0.1343, std.dev.: 0.0062) SingleSource/UnitTests/initp1: 19.28% (0.0555 => 0.0662, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 19.28% (3.3354 => 3.9783, std.dev.: 0.0497) MultiSource/Benchmarks/mafft/pairlocalalign: 18.87% (9.4845 => 11.2745, std.dev.: 0.0524) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.52% (0.2700 => 0.3200, std.dev.: 0.0170) MultiSource/Applications/oggenc/oggenc: 18.34% (5.7591 => 6.8155, std.dev.: 0.2195) MultiSource/Benchmarks/Olden/em3d/em3d: 17.64% (0.1695 => 0.1994, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.49% (0.1029 => 0.1209, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/exceptions-4: 17.36% (0.3543 => 0.4158, std.dev.: 0.0090) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.99% (0.0871 => 0.1019, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.54% (0.8172 => 0.9524, std.dev.: 0.0461) MultiSource/Applications/sqlite3/sqlite3: 16.41% (17.1811 => 20.0009, std.dev.: 0.1972) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.37% (0.0953 => 0.1109, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/mst/mst: 16.08% (0.1163 => 0.1350, std.dev.: 0.0063) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.02% (0.3121 => 0.3621, std.dev.: 0.0192) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.01% (4.9449 => 5.7366, std.dev.: 0.1409) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.93% (0.2065 => 0.2394, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout/matrix: 15.77% (0.0818 => 0.0947, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.75% (5.0018 => 5.7897, std.dev.: 0.1205) SingleSource/Benchmarks/Shootout-C++/sieve: 15.54% (0.3603 => 0.4163, std.dev.: 0.0162) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.46% (0.0886 => 0.1023, std.dev.: 0.0042) MultiSource/Applications/viterbi/viterbi: 15.37% (0.1555 => 0.1794, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.35% (0.0834 => 0.0962, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hello: 15.22% (0.2714 => 0.3127, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/ffbench: 14.89% (0.0705 => 0.0810, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.81% (0.0770 => 0.0884, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 14.48% (0.3177 => 0.3637, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.28% (0.3543 => 0.4049, std.dev.: 0.0141) SingleSource/UnitTests/ObjC/block-byref-aggr: 14.17% (0.3817 => 0.4358, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.06% (0.1337 => 0.1525, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.96% (1.4186 => 1.6167, std.dev.: 0.0453) MultiSource/Benchmarks/Bullet/bullet: 13.95% (63.2438 => 72.0692, std.dev.: 0.2481) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.67% (0.3307 => 0.3759, std.dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.66% (0.9765 => 1.1099, std.dev.: 0.0506) SingleSource/UnitTests/ObjC/parameter-passing: 12.91% (0.3927 => 0.4434, std.dev.: 0.0178) SingleSource/UnitTests/ObjC/trivial-interface: 12.27% (0.3473 => 0.3899, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/synchronized: 12.22% (0.3561 => 0.3996, std.dev.: 0.0091) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.04% (0.8101 => 0.9076, std.dev.: 0.0377) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.59% (0.1044 => 0.1165, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 11.26% (10.3673 => 11.5347, std.dev.: 0.0300) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.99% (0.3826 => 0.4170, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 8.86% (0.2877 => 0.3132, std.dev.: 0.0091) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.25% (7.9617 => 8.2999, std.dev.: 0.1067) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.78% (4.3953 => 11.0224, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/methcall: 147.75% (5.3999 => 13.3784, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 26.57% (13.4384 => 17.0091, std.dev.: 0.0935) MultiSource/Applications/minisat/minisat: 21.08% (9.1159 => 11.0375, std.dev.: 0.4352) SingleSource/Benchmarks/Misc/oourafft: 17.56% (6.6465 => 7.8136, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.65% (1.1145 => 1.3001, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.27% (3.8532 => 4.4031, std.dev.: 0.0916) SingleSource/Benchmarks/BenchmarkGame/puzzle: 13.63% (0.6962 => 0.7911, std.dev.: 0.0255) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.15% (0.2944 => 0.3331, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.65% (2.8904 => 3.2270, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 10.18% (1.1396 => 1.2556, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.48% (1.7254 => 1.8890, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.01% (8.6802 => 9.4620, std.dev.: 0.2595) MultiSource/Benchmarks/Olden/bh/bh: 7.93% (1.9405 => 2.0943, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/ffbench: 7.68% (0.9505 => 1.0235, std.dev.: 0.0248) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.63% (4.2280 => 4.4661, std.dev.: 0.0072) SingleSource/Regression/C/uint64_to_float: 5.08% (0.5413 => 0.5688, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627) MultiSource/Applications/lua/lua: 4.63% (26.0924 => 27.3007, std.dev.: 0.2072) MultiSource/Benchmarks/nbench/nbench: 4.12% (11.6436 => 12.1230, std.dev.: 0.0059) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: 2.75% (2.4116 => 2.4778, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.15% (1.3677 => 1.3971, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.11% (2.1424 => 2.1875, std.dev.: 0.0138) MultiSource/Applications/aha/aha: 2.06% (3.1595 => 3.2245, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 2.02% (85.0658 => 86.7799, std.dev.: 0.0477) MultiSource/Benchmarks/mafft/pairlocalalign: 1.60% (27.8444 => 28.2889, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists: 1.46% (12.5348 => 12.7177, std.dev.: 0.0098) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.37% (6.5088 => 6.5980, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/sieve: 1.36% (5.2139 => 5.2846, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: 1.19% (5.9798 => 6.0507, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1674, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.63% (5.2763 => 1.2329, std.dev.: 0.0594) SingleSource/Benchmarks/Misc/salsa20: -75.40% (0.8651 => 0.2128, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/richards_benchmark: -44.76% (0.1622 => 0.0896, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.04% (5.3526 => 4.7082, std.dev.: 0.1655) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -9.91% (5.3855 => 4.8516, std.dev.: 0.0750) MultiSource/Applications/JM/ldecod/ldecod: -7.60% (10.4361 => 9.6426, std.dev.: 0.1493) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.92% (0.0506 => 0.0304, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.63% (0.3987 => 0.2407, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.31% (4.5009 => 2.7768, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7636, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.17% (2.6546 => 2.0129, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -24.06% (10.7105 => 8.1335, std.dev.: 0.2375) MultiSource/Benchmarks/FreeBench/mason/mason: -19.11% (0.2161 => 0.1748, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4243, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.69% (2.6778 => 2.2843, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.69% (32.5116 => 29.0345, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -10.32% (9.5636 => 8.5770, std.dev.: 0.2304) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.05% (1.5660 => 1.4243, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.93% (4.8142 => 4.4806, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.2416 => 3.0212, std.dev.: 0.0284) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -5.25% (19.9488 => 18.9020, std.dev.: 0.2165) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -4.94% (1.5835 => 1.5052, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.83% (1.6805 => 1.5993, std.dev.: 0.0293) SingleSource/Benchmarks/Shootout/lists: -4.24% (6.2999 => 6.0327, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.30% (0.9957 => 0.9628, std.dev.: 0.0049) MultiSource/Benchmarks/sim/sim: -3.07% (5.0483 => 4.8934, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.33% (0.4808 => 0.4696, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.00% (8.1563 => 7.9932, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6769, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.47% (10.2830 => 10.1320, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0019) Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 11:15:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 13:15:39 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121115191539.E3E082A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5906?compare_to=5900&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5906, Order: 168042, Start Time: 2012-11-15 16:00:19, End Time: 2012-11-15 19:15:58 To: 5900, Order: 168036, Start Time: 2012-11-15 11:56:38, End Time: 2012-11-15 15:12:32 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (171 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (719 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.51% (14.0476 => 14.3995, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.32% (128.2424 => 125.2665, std.dev.: 0.9686) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.72% (0.0625 => 0.0892, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.21% (0.1063 => 0.1416, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.10% (0.2969 => 0.3744, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.05% (0.0714 => 0.0900, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.86% (0.1106 => 0.1392, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 25.67% (1.5932 => 2.0022, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.10% (0.4139 => 0.5178, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.95% (0.4253 => 0.5314, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.79% (0.4994 => 0.6182, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.66% (0.5000 => 0.6183, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.05% (0.5900 => 0.7260, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.95% (0.0584 => 0.0718, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.85% (0.0897 => 0.1102, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.22% (0.1107 => 0.1353, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 22.04% (0.0599 => 0.0731, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.98% (0.1620 => 0.1976, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.84% (0.1021 => 0.1244, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.85% (0.0633 => 0.0765) MultiSource/Benchmarks/Olden/em3d/em3d: 20.78% (0.0948 => 0.1145, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.72% (0.0584 => 0.0705, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.52% (0.0541 => 0.0652) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.50% (0.3903 => 0.4703, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.40% (0.0642 => 0.0773, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.40% (0.1103 => 0.1328, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 20.36% (0.0604 => 0.0727, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 20.10% (0.0821 => 0.0986, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.08% (0.1549 => 0.1860, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.07% (0.1604 => 0.1926, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.07% (0.0822 => 0.0987, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.04% (0.1003 => 0.1204, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 19.95% (0.1619 => 0.1942, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: 19.31% (0.0808 => 0.0964, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.08% (0.1462 => 0.1741, std.dev.: 0.0023) MultiSource/Applications/viterbi/viterbi: 18.69% (0.0947 => 0.1124, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.64% (0.3890 => 0.4615, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 18.56% (0.1218 => 0.1444, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.49% (0.2736 => 0.3242, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.37% (0.2014 => 0.2384, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.01% (0.1088 => 0.1284, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.97% (1.3152 => 1.5516, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 17.71% (0.5826 => 0.6858, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 17.70% (0.4029 => 0.4742, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/mst/mst: 17.62% (0.0698 => 0.0821, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 17.61% (0.1505 => 0.1770, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.41% (0.2866 => 0.3365, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 17.40% (0.5546 => 0.6511, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 17.18% (0.5889 => 0.6901, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/gs/gs: 17.13% (1.8794 => 2.2013, std.dev.: 0.0105) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.12% (0.1968 => 0.2305, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.10% (3.5627 => 4.1718, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.05% (0.4658 => 0.5452, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.02% (0.0605 => 0.0708, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.95% (1.6211 => 1.8959, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.81% (0.1160 => 0.1355, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.60% (0.3271 => 0.3814, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 16.47% (0.1421 => 0.1655, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 16.46% (0.9697 => 1.1293, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.41% (0.5026 => 0.5851, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 16.40% (1.0781 => 1.2549, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.26% (0.4361 => 0.5070, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.15% (0.1090 => 0.1266, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.07% (0.2738 => 0.3178, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.01% (0.3930 => 0.4559, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.00% (0.2875 => 0.3335, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 15.97% (0.1284 => 0.1489, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.92% (4.4195 => 5.1232, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.82% (2.7292 => 3.1610, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 15.79% (0.7171 => 0.8303, std.dev.: 0.0024) MultiSource/Applications/ClamAV/clamscan: 15.73% (4.2109 => 4.8732, std.dev.: 0.0086) SingleSource/Regression/C++/ofstream_ctor: 15.65% (0.3004 => 0.3474, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.45% (1.9694 => 2.2737, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: 15.36% (0.2780 => 0.3207, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 15.35% (23.5202 => 27.1313, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 15.29% (0.2714 => 0.3129, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.24% (0.2729 => 0.3145, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 15.23% (0.2725 => 0.3140, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 15.20% (0.2750 => 0.3168, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.18% (0.2911 => 0.3353, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 15.17% (0.9909 => 1.1412, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/except: 15.12% (0.2811 => 0.3236, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 15.09% (0.2823 => 0.3249, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.00% (0.3060 => 0.3519, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/random: 14.98% (0.2803 => 0.3223, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.98% (1.9966 => 2.2957, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 14.97% (0.2813 => 0.3234, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.90% (0.2792 => 0.3208, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.86% (2.0673 => 2.3745, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/wc: 14.86% (0.3096 => 0.3556, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.74% (0.3195 => 0.3666, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 14.60% (0.2075 => 0.2378, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary3: 14.54% (0.3267 => 0.3742, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 14.50% (1.4269 => 1.6338, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: 14.49% (0.3258 => 0.3730, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 14.46% (0.2566 => 0.2937, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary2: 14.20% (0.3317 => 0.3788, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 14.08% (0.7875 => 0.8984, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.98% (0.3362 => 0.3832, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 13.77% (0.3348 => 0.3809, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.76% (0.3124 => 0.3554, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.74% (0.3282 => 0.3733, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 13.73% (0.3678 => 0.4183, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 13.68% (0.4146 => 0.4713, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 13.62% (0.3496 => 0.3972, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions-2: 13.58% (0.3446 => 0.3914, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 13.55% (2.1653 => 2.4588, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists1: 13.55% (0.3477 => 0.3948, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.54% (0.3465 => 0.3934, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.50% (0.3488 => 0.3959, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 13.50% (0.3726 => 0.4229, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.49% (0.3625 => 0.4114, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.47% (0.3460 => 0.3926, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 13.46% (0.0758 => 0.0860, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/synchronized: 13.43% (0.3469 => 0.3935, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.42% (0.3442 => 0.3904, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.33% (0.2040 => 0.2312, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 13.21% (4.6177 => 5.2278, std.dev.: 0.0169) SingleSource/UnitTests/ObjC/property: 13.21% (0.3650 => 0.4132, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 13.20% (0.4251 => 0.4812, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.13% (0.3845 => 0.4350, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.09% (0.3690 => 0.4173, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 13.05% (0.3724 => 0.4210, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 13.05% (2.1013 => 2.3755, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/exceptions: 13.04% (0.3643 => 0.4118, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.01% (0.3981 => 0.4499, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 12.63% (0.2691 => 0.3031, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/bigfib: 12.49% (0.5012 => 0.5638, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 12.33% (5.5417 => 6.2249, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.58% (0.6435 => 0.7180, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 11.34% (0.6634 => 0.7386, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.28% (0.1028 => 0.1144, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.09% (0.3498 => 0.3886, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.74% (0.2737 => 0.3031, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.74% (0.2068 => 0.2290, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 10.65% (0.4847 => 0.5363, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.47% (0.3084 => 0.3407, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 10.37% (0.2391 => 0.2639, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 10.31% (0.3336 => 0.3680, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 10.31% (2.0346 => 2.2443, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.99% (0.2103 => 0.2313, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.91% (4.6926 => 5.1107, std.dev.: 0.0137) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.78% (11.6398 => 12.6623, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.77% (0.5361 => 0.5831, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.49% (0.5584 => 0.6058, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.34% (0.7426 => 0.8045, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 6.78% (11.9555 => 12.7658, std.dev.: 0.0172) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.25% (0.3792 => 0.3953, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.64% (0.2802 => 0.3072, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6105, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.39% (0.3693 => 0.3892, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 5.33% (0.2122 => 0.2235, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6742, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1696, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-2: 4.70% (1.8057 => 1.8905, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/dry: 4.18% (14.0481 => 14.6352, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary3: 2.14% (15.8721 => 16.2117, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2235, std.dev.: 0.0041) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3104, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2892, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5849, std.dev.: 0.0112) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.25% (2.4764 => 2.3958, std.dev.: 0.0187) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5645, std.dev.: 0.0205) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9749, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7866, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary2: -7.24% (0.2402 => 0.2228, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8030, std.dev.: 0.0062) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7733, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.90% (17.2379 => 16.7377, std.dev.: 0.0868) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.54% (0.6293 => 0.6133, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.25% (41.7953 => 40.8536, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5789, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4960, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0474, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.04% (105.3826 => 104.2860, std.dev.: 0.0123) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 11:23:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 13:23:24 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121115192324.6E29C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5907?compare_to=5903&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5907, Order: 168049, Start Time: 2012-11-15 17:52:27, End Time: 2012-11-15 19:23:43 To: 5903, Order: 168045, Start Time: 2012-11-15 16:07:22, End Time: 2012-11-15 17:35:28 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 16 (70 on baseline) Performance Improvements: 1 (17 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 975 (887 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/BenchmarkGame/recursive: 74.90% (0.0263 => 0.0460, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/mandel-text: 74.26% (0.0202 => 0.0352, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 73.47% (0.1244 => 0.2158, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/lowercase: 66.39% (0.0238 => 0.0396, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 52.90% (0.1777 => 0.2717, std.dev.: 0.0161) SingleSource/Benchmarks/Misc-C++-EH/spirit: 11.69% (5.4291 => 6.0640, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.99% (0.8496 => 0.9090, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.80% (0.3126 => 0.3276, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.14% (1.4847 => 1.5016, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: 34.53% (4.5588 => 6.1330, std.dev.: 0.2247) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.67% (0.2052 => 0.2353, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.72% (1.3126 => 1.4008, std.dev.: 0.0230) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.19% (6.7337 => 7.1502, std.dev.: 0.1036) SingleSource/Benchmarks/BenchmarkGame/recursive: 4.43% (2.3686 => 2.4736, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout/fib2: 1.71% (4.3042 => 4.3779, std.dev.: 0.0283) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.40% (2.5539 => 2.5896, std.dev.: 0.0101) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: -3.82% (0.2876 => 0.2766, std.dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.34% (17.0082 => 17.0663, std.dev.: 0.2359) MultiSource/Applications/obsequi/Obsequi: 1.07% (1.0749 => 1.0864, std.dev.: 0.1656) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.74% (22.1704 => 22.0054, std.dev.: 0.4208) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.61% (0.3663 => 0.3722, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/bigfib: 7.04% (0.6091 => 0.6520, std.dev.: 0.1792) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.38% (0.3289 => 0.3433, std.dev.: 0.0257) SingleSource/Benchmarks/Shootout-C++/strcat: 5.22% (0.2010 => 0.2115, std.dev.: 0.0428) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.90% (0.0221 => 0.0223, std.dev.: 0.0048) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 14.88% (0.0383 => 0.0440, std.dev.: 0.0127) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 28.41% (0.0264 => 0.0339, std.dev.: 0.0098) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.27% (0.0316 => 0.0320, std.dev.: 0.0105) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 3.04% (0.0427 => 0.0440, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: 1.94% (0.0206 => 0.0210, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/test1: 8.49% (0.0212 => 0.0230, std.dev.: 0.0043) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.20% (0.1479 => 0.1482, std.dev.: 0.0161) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -4.76% (1.2206 => 1.1625, std.dev.: 0.1854) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.92% (0.4359 => 0.4188, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.04% (0.1484 => 0.1424, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.24% (0.0647 => 0.0639, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 28.84% (0.0215 => 0.0277, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.57% (0.0560 => 0.0580, std.dev.: 0.0116) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.46% (1.2022 => 1.1967, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 72.22% (0.0018 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.16% (0.0644 => 0.0643, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.64% (0.0266 => 0.0251, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.88% (0.7797 => 0.7866, std.dev.: 0.0351) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -18.31% (0.0071 => 0.0058, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2307.60% (0.6332 => 15.2449, std.dev.: 0.7432) MultiSource/Benchmarks/McCat/08-main/main: 51.06% (0.1831 => 0.2766, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.90% (0.1559 => 0.1573, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1713.40% (0.3344 => 6.0640, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++/Large/ray: 41.62% (0.2364 => 0.3348, std.dev.: 0.0200) SingleSource/Benchmarks/Misc/mandel: 11.42% (0.0429 => 0.0478, std.dev.: 0.0124) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.91% (0.0224 => 0.0235, std.dev.: 0.0017) SingleSource/UnitTests/byval-alignment: -32.61% (0.0230 => 0.0155, std.dev.: 0.0010) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 11.83% (0.1462 => 0.1635, std.dev.: 0.0217) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4669, std.dev.: 0.0434) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0685, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4908, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3421, std.dev.: 0.1436) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1554, std.dev.: 0.0267) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4133, std.dev.: 0.0903) SingleSource/Regression/C/uint64_to_float: -23.91% (2.1832 => 1.6613, std.dev.: 0.0249) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc-C++/mandel-text: 90.27% (0.0185 => 0.0352, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 87.76% (0.0245 => 0.0460, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/lowercase: 83.33% (0.0216 => 0.0396, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 82.42% (0.1183 => 0.2158, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 54.73% (0.1756 => 0.2717, std.dev.: 0.0161) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.41% (0.0810 => 0.0951, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 13.04% (0.1112 => 0.1257, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.62% (0.0848 => 0.0955, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.09% (0.3003 => 0.3276, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.99% (0.8340 => 0.9090, std.dev.: 0.0147) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.50% (0.1905 => 0.2067, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.17% (0.2180 => 0.2358, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.09% (0.1466 => 0.1570, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.97% (0.3657 => 0.3912, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.83% (0.2519 => 0.2691, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.77% (0.4847 => 0.5175, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.13% (0.3295 => 0.3497, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.05% (0.2133 => 0.2262, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.00% (1.1606 => 1.2302, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.74% (0.9435 => 0.9977, std.dev.: 0.0112) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.65% (0.1983 => 0.2095, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/oourafft: 5.41% (0.2088 => 0.2201, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.30% (0.6287 => 0.6620, std.dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 4.92% (1.1271 => 1.1825, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.68% (0.5961 => 0.6240, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.37% (1.3279 => 1.3859, std.dev.: 0.0201) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.29% (0.4127 => 0.4304, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.11% (0.6586 => 0.6857, std.dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.06% (1.1170 => 1.1623, std.dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.87% (0.6227 => 0.6468, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.71% (1.4479 => 1.5016, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.99% (0.8050 => 0.8291, std.dev.: 0.0071) MultiSource/Applications/SIBsim4/SIBsim4: 2.51% (1.2568 => 1.2883, std.dev.: 0.0121) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.25% (0.8995 => 0.9197, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 121.61% (0.0199 => 0.0441, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/pi: 55.91% (1.5795 => 2.4626, std.dev.: 0.0180) SingleSource/Benchmarks/Misc-C++/stepanov_container: 34.65% (4.5547 => 6.1330, std.dev.: 0.2247) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 16.77% (0.2015 => 0.2353, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.70% (0.7597 => 0.8866, std.dev.: 0.0204) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.33% (2.9753 => 3.4612, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.71% (2.7995 => 3.2114, std.dev.: 0.0239) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.12% (6.3772 => 7.1502, std.dev.: 0.1036) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6092, std.dev.: 0.0705) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.58% (0.3186 => 0.3555, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.21% (1.1857 => 1.2831, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.76% (4.7794 => 5.1027, std.dev.: 0.0424) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.13% (4.5327 => 4.8107, std.dev.: 0.0217) MultiSource/Applications/SIBsim4/SIBsim4: 6.00% (3.1873 => 3.3786, std.dev.: 0.0253) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.83% (4.9686 => 5.2583, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.76% (6.2275 => 6.5238, std.dev.: 0.0338) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.69% (3.3761 => 3.5345, std.dev.: 0.0074) MultiSource/Applications/lambda-0_1_3/lambda: 4.55% (7.4933 => 7.8344, std.dev.: 0.0666) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.41% (4.3552 => 4.5472, std.dev.: 0.0564) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.08% (4.9469 => 5.1485, std.dev.: 0.0635) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.02% (4.9453 => 5.1442, std.dev.: 0.0193) MultiSource/Applications/hexxagon/hexxagon: 3.87% (14.0064 => 14.5487, std.dev.: 0.0833) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.69% (1.2337 => 1.2792, std.dev.: 0.0040) MultiSource/Applications/siod/siod: 2.98% (3.6643 => 3.7734, std.dev.: 0.0358) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.70% (8.2783 => 8.5019, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/lists: 2.64% (7.3375 => 7.5309, std.dev.: 0.0695) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.54% (11.5690 => 11.8627, std.dev.: 0.0264) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.04% (2.4647 => 2.5149, std.dev.: 0.0175) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.79% (1.1365 => 1.1568, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/fib2: 1.75% (4.3025 => 4.3779, std.dev.: 0.0283) SingleSource/Benchmarks/Stanford/FloatMM: 1.65% (0.8807 => 0.8952, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 1.46% (1.2061 => 1.2237, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: 1.44% (8.5322 => 8.6548, std.dev.: 0.0294) MultiSource/Benchmarks/FreeBench/neural/neural: 1.32% (1.0841 => 1.0984, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.11% (4.4340 => 4.4831, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: 1.09% (2.3560 => 2.3817, std.dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.84% (5.4641 => 4.3253, std.dev.: 0.0343) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.07% (7.2130 => 6.1981, std.dev.: 0.1329) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.82% (1.0512 => 0.9375, std.dev.: 0.0103) MultiSource/Benchmarks/mafft/pairlocalalign: -8.41% (63.1822 => 57.8707, std.dev.: 0.1463) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.07% (14.6451 => 13.6090, std.dev.: 0.1450) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.89% (4.7482 => 4.4209, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.80% (5.4972 => 5.1781, std.dev.: 0.0369) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.91% (2.8773 => 2.7359, std.dev.: 0.0358) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.88% (5.1557 => 4.9041, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.44% (4.7449 => 4.5343, std.dev.: 0.0498) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.74% (6.0224 => 5.7973, std.dev.: 0.0243) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.00% (28.5821 => 27.7233, std.dev.: 0.0295) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.30% (9.9065 => 9.6790, std.dev.: 0.0668) MultiSource/Applications/aha/aha: -2.27% (3.3398 => 3.2639, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (11.5316 => 11.2984, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.75% (2.6356 => 2.5896, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.17% (5.6343 => 5.5683, std.dev.: 0.0025) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 3.77% (16.4461 => 17.0663, std.dev.: 0.2359) MultiSource/Applications/obsequi/Obsequi: 5.87% (1.0262 => 1.0864, std.dev.: 0.1656) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6946.24% (0.3123 => 22.0054, std.dev.: 0.4208) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.12% (0.2463 => 0.3722, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/bigfib: 8.49% (0.6010 => 0.6520, std.dev.: 0.1792) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.11% (0.3266 => 0.3433, std.dev.: 0.0257) SingleSource/Benchmarks/Shootout-C++/strcat: 7.41% (0.1969 => 0.2115, std.dev.: 0.0428) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 81.30% (0.0123 => 0.0223, std.dev.: 0.0048) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 7.84% (0.0408 => 0.0440, std.dev.: 0.0127) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 33.46% (0.0254 => 0.0339, std.dev.: 0.0098) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.96% (0.0302 => 0.0320, std.dev.: 0.0105) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 14.58% (0.0384 => 0.0440, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: 10.53% (0.0190 => 0.0210, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/test1: 27.78% (0.0180 => 0.0230, std.dev.: 0.0043) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 3.06% (0.1438 => 0.1482, std.dev.: 0.0161) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.61% (1.1329 => 1.1625, std.dev.: 0.1854) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.58% (0.4164 => 0.4188, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.02% (0.1369 => 0.1424, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.31% (0.0641 => 0.0639, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.35% (0.0578 => 0.0580, std.dev.: 0.0116) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.63% (1.1437 => 1.1967, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.55% (0.0627 => 0.0643, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.44% (0.0180 => 0.0251, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.88% (0.8017 => 0.7866, std.dev.: 0.0351) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -6.45% (0.0062 => 0.0058, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 11:38:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 13:38:47 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121115193847.7500C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5908?compare_to=5904&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5908, Order: 168049, Start Time: 2012-11-15 18:13:59, End Time: 2012-11-15 19:39:03 To: 5904, Order: 168045, Start Time: 2012-11-15 16:25:48, End Time: 2012-11-15 17:50:59 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (180 on baseline) Unchanged Tests: 1042 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1012, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4937 => 7.6767, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash2: 2.27% (3.1932 => 3.2656, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.69% (0.3821 => 0.3527, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -7.14% (2.4924 => 2.3145, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -6.88% (0.3357 => 0.3126, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.77% (0.9542 => 0.8896, std.dev.: 0.0117) MultiSource/Benchmarks/mafft/pairlocalalign: -6.36% (9.2283 => 8.6411, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.35% (0.1796 => 0.1682) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.34% (0.2428 => 0.2274, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -6.34% (0.2160 => 0.2023, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.31% (0.6484 => 0.6075, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.30% (0.3142 => 0.2944, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -6.28% (0.1879 => 0.1761, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -6.21% (16.1920 => 15.1869, std.dev.: 0.0089) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.20% (0.2355 => 0.2209, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.10% (1.0544 => 0.9901, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.09% (0.9852 => 0.9252, std.dev.: 0.0080) MultiSource/Applications/JM/ldecod/ldecod: -6.06% (7.0961 => 6.6663, std.dev.: 0.0211) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.04% (0.3658 => 0.3437, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -6.04% (0.9179 => 0.8625, std.dev.: 0.0081) SingleSource/UnitTests/ObjC/exceptions-4: -6.01% (0.3880 => 0.3647, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -6.00% (0.3831 => 0.3601, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -5.98% (0.3812 => 0.3584, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: -5.90% (0.3896 => 0.3666, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.90% (0.3848 => 0.3621, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.90% (6.7716 => 6.3722, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/for-in: -5.88% (0.4033 => 0.3796, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -5.87% (0.4515 => 0.4250, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.85% (0.1761 => 0.1658, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.85% (0.5591 => 0.5264, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.83% (4.0323 => 3.7971, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.83% (0.2695 => 0.2538, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.82% (0.5857 => 0.5516, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.82% (0.3884 => 0.3658, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.81% (1.3722 => 1.2925, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.81% (0.5805 => 0.5468, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.79% (0.6304 => 0.5939, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.79% (0.5925 => 0.5582, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.79% (0.5478 => 0.5161, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.78% (0.3891 => 0.3666, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.76% (1.4642 => 1.3798, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions: -5.75% (0.4176 => 0.3936, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.74% (0.5802 => 0.5469, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.74% (0.6395 => 0.6028, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.74% (0.6660 => 0.6278, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.73% (0.6297 => 0.5936, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.73% (1.2300 => 1.1595, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.73% (0.7524 => 0.7093, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.72% (0.6194 => 0.5840, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.71% (0.5705 => 0.5379, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.71% (0.5567 => 0.5249, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.70% (0.5863 => 0.5529, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.69% (0.6736 => 0.6353, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.68% (0.6052 => 0.5708, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.68% (4.8161 => 4.5426, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.67% (0.6681 => 0.6302, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.65% (1.6364 => 1.5440, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.64% (4.5069 => 4.2526, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.64% (4.8802 => 4.6050, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.64% (0.5569 => 0.5255, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.64% (0.5570 => 0.5256, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.63% (0.7339 => 0.6926, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.62% (0.6260 => 0.5908, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.62% (3.5339 => 3.3352, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.62% (0.6230 => 0.5880, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.62% (0.6676 => 0.6301, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.61% (0.6189 => 0.5842, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.60% (0.6446 => 0.6085, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.60% (0.5859 => 0.5531, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.59% (1.2784 => 1.2069, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.57% (0.5849 => 0.5523, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -5.57% (0.4199 => 0.3965, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.56% (0.6667 => 0.6296, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.54% (0.5575 => 0.5266, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.53% (0.8521 => 0.8050, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.52% (0.5688 => 0.5374, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -5.51% (1.1530 => 1.0895, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.50% (0.5941 => 0.5614, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.49% (0.3406 => 0.3219, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.48% (0.3483 => 0.3292, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -5.48% (1.1450 => 1.0823, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.44% (0.6395 => 0.6047, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.44% (1.3864 => 1.3110, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.43% (0.5581 => 0.5278, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.41% (14.2083 => 13.4397, std.dev.: 0.0286) MultiSource/Benchmarks/MallocBench/gs/gs: -5.39% (4.3330 => 4.0993, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.39% (0.5456 => 0.5162, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.37% (0.2999 => 0.2838, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.36% (0.6440 => 0.6095, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.31% (8.0126 => 7.5872, std.dev.: 0.0144) SingleSource/UnitTests/ObjC/parameter-passing: -5.28% (0.4280 => 0.4054, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -5.28% (0.3581 => 0.3392, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: -5.26% (17.1032 => 16.2035, std.dev.: 0.0167) MultiSource/Applications/Burg/burg: -5.23% (1.2515 => 1.1860, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.22% (0.2548 => 0.2415, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.21% (0.4916 => 0.4660, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.20% (0.2385 => 0.2261, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: -5.19% (0.2659 => 0.2521, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.19% (0.6033 => 0.5720, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -5.19% (15.5079 => 14.7034, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.14% (0.2278 => 0.2161, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.13% (1.2210 => 1.1584, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.10% (1.2221 => 1.1598, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.08% (0.7198 => 0.6832, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.06% (0.7919 => 0.7518, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.06% (0.3319 => 0.3151, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.05% (0.6293 => 0.5975, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: -5.04% (0.7447 => 0.7072, std.dev.: 0.0024) MultiSource/Applications/d/make_dparser: -5.00% (3.5154 => 3.3398, std.dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: -4.98% (15.2527 => 14.4924, std.dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: -4.95% (1.3148 => 1.2497, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: -4.92% (0.3255 => 0.3095, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.90% (0.5999 => 0.5705, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.90% (0.3837 => 0.3649, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.90% (0.5168 => 0.4915, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.87% (0.3057 => 0.2908, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -4.86% (0.3025 => 0.2878, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.86% (1.6474 => 1.5674, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.82% (0.5329 => 0.5072, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: -4.82% (0.3194 => 0.3040, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.82% (0.4151 => 0.3951, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.77% (0.3016 => 0.2872, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -4.77% (4.0594 => 3.8659, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.76% (0.3931 => 0.3744, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -4.74% (0.2871 => 0.2735, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.74% (5.0226 => 4.7847, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.72% (0.2903 => 0.2766, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.71% (0.2933 => 0.2795, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.70% (0.7021 => 0.6691, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -4.70% (0.2939 => 0.2801, std.dev.: 0.0048) SingleSource/UnitTests/ObjC++/property-reference: -4.61% (0.7779 => 0.7420, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hello: -4.60% (0.2849 => 0.2718, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -4.59% (0.4248 => 0.4053, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.57% (2.1713 => 2.0721, std.dev.: 0.0088) MultiSource/Applications/treecc/treecc: -4.56% (2.1401 => 2.0425, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.55% (22.4056 => 21.3869, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.53% (0.4813 => 0.4595, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: -4.51% (0.3394 => 0.3241, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -4.50% (0.3621 => 0.3458, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -4.50% (0.3446 => 0.3291, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -4.49% (0.3271 => 0.3124, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: -4.46% (0.3205 => 0.3062, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.45% (0.2989 => 0.2856, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.43% (0.9557 => 0.9134, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary2: -4.42% (0.3481 => 0.3327, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.42% (0.3323 => 0.3176, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: -4.42% (0.3867 => 0.3696, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -4.42% (2.4021 => 2.2959, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.42% (0.4321 => 0.4130, std.dev.: 0.0027) MultiSource/Applications/spiff/spiff: -4.40% (0.8418 => 0.8048, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: -4.38% (0.4861 => 0.4648, std.dev.: 0.0035) SingleSource/Regression/C++/ofstream_ctor: -4.35% (0.3059 => 0.2926, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -4.32% (0.6347 => 0.6073, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.31% (0.3252 => 0.3112, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -4.24% (34.0927 => 32.6486, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.23% (0.3849 => 0.3686, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -4.22% (0.7982 => 0.7645, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.18% (0.4427 => 0.4242, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.16% (0.4083 => 0.3913, std.dev.: 0.0053) MultiSource/Applications/kimwitu++/kc: -4.16% (18.2933 => 17.5320, std.dev.: 0.0265) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.12% (2.2587 => 2.1657, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -4.11% (0.6441 => 0.6176, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.10% (0.3491 => 0.3348, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.05% (0.9077 => 0.8709, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: -4.01% (0.3788 => 0.3636, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -3.81% (0.6750 => 0.6493, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -3.74% (0.4524 => 0.4355, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.43% (5.4682 => 5.2806, std.dev.: 0.0017) MultiSource/Applications/hbd/hbd: -3.13% (1.5610 => 1.5121, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -2.58% (20.7746 => 20.2381, std.dev.: 0.0466) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7533, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: -8.63% (1.2842 => 1.1734, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.72% (2.2633 => 2.1791, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.83% (1.3096 => 1.2856, std.dev.: 0.0074) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4741, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0004) Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 13:09:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 15:09:48 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121115210948.A4E542A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5909?compare_to=5905&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5909, Order: 168051, Start Time: 2012-11-15 18:58:30, End Time: 2012-11-15 21:10:04 To: 5905, Order: 168042, Start Time: 2012-11-15 15:54:43, End Time: 2012-11-15 18:06:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 86 (172 on baseline) Performance Improvements: 17 (42 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 935 (673 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.66% (0.6601 => 0.7833, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 16.49% (0.5793 => 0.6748, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 16.42% (0.1407 => 0.1638, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 16.15% (0.6884 => 0.7996, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.98% (0.5909 => 0.6853, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.92% (0.5931 => 0.6875, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 15.88% (0.6662 => 0.7720, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 15.63% (0.6219 => 0.7191, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 15.42% (0.6173 => 0.7125, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 15.13% (0.6226 => 0.7168, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.11% (0.6340 => 0.7298, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.70% (0.6449 => 0.7397, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.29% (0.6723 => 0.7684, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.29% (2.2510 => 2.5727, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ary: 13.94% (0.3514 => 0.4004, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 13.94% (0.6728 => 0.7666, std.dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 13.88% (4.6744 => 5.3232, std.dev.: 0.0565) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.41% (0.1171 => 0.1328, std.dev.: 0.0042) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.39% (0.1912 => 0.2168, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash: 13.35% (0.4771 => 0.5408, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.30% (0.3759 => 0.4259, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.23% (0.5792 => 0.6558, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/methcall: 12.96% (0.3132 => 0.3538, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wc: 12.90% (0.3326 => 0.3755, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash2: 12.66% (0.5125 => 0.5774, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/moments: 12.47% (0.4459 => 0.5015, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/nestedloop: 12.28% (0.3037 => 0.3410, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.28% (1.0294 => 1.1558, std.dev.: 0.0100) MultiSource/Benchmarks/VersaBench/bmm/bmm: 12.24% (0.0825 => 0.0926, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 12.19% (0.3691 => 0.4141, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 11.90% (0.3579 => 0.4005, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.53% (0.1023 => 0.1141, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.52% (0.4437 => 0.4948, std.dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.50% (0.5225 => 0.5826, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: 11.50% (0.0896 => 0.0999, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 11.46% (0.8937 => 0.9961, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/08-main/main: 11.18% (0.3114 => 0.3462, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/mst/mst: 11.11% (0.1350 => 0.1500, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 11.01% (0.6248 => 0.6936, std.dev.: 0.0227) MultiSource/Benchmarks/Olden/power/power: 11.00% (0.1455 => 0.1615, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/property: 10.90% (0.4366 => 0.4842, std.dev.: 0.0047) MultiSource/Applications/sgefa/sgefa: 10.78% (0.3526 => 0.3906, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.68% (4.3887 => 4.8572, std.dev.: 0.0747) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.50% (0.1019 => 0.1126, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/parameter-passing: 10.49% (0.4434 => 0.4899, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.46% (0.3165 => 0.3496, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.17% (0.1210 => 0.1333, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 10.09% (0.1794 => 0.1975, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.03% (0.1525 => 0.1678, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/oourafft: 9.91% (0.3582 => 0.3937, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 9.74% (0.2126 => 0.2333, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.62% (1.3185 => 1.4453, std.dev.: 0.0249) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 9.47% (0.1109 => 0.1214, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (0.7213 => 0.7893, std.dev.: 0.0200) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.16% (0.1343 => 0.1466, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.81% (0.5038 => 0.5482, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.50% (1.2329 => 1.3377, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 8.40% (0.3345 => 0.3626, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.19% (0.3906 => 0.4187, std.dev.: 0.0108) SingleSource/UnitTests/ObjC/synchronized: 6.18% (0.3996 => 0.4243, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.59% (2.3243 => 2.4542, std.dev.: 0.0408) MultiSource/Applications/lambda-0_1_3/lambda: 5.16% (0.9445 => 0.9932, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 3.46% (18.1075 => 18.7344, std.dev.: 0.0101) MultiSource/Applications/sqlite3/sqlite3: 2.77% (20.0009 => 20.5546, std.dev.: 0.0420) MultiSource/Applications/JM/lencod/lencod: 2.40% (32.0912 => 32.8604, std.dev.: 0.0183) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench: 23.11% (2.1047 => 2.5910, std.dev.: 0.0683) SingleSource/Benchmarks/Shootout-C++/moments: 22.36% (0.1212 => 0.1483, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 21.84% (0.0760 => 0.0926, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 19.03% (1.3670 => 1.6272, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/mst/mst: 14.85% (0.1313 => 0.1508, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.92% (1.7576 => 1.9495, std.dev.: 0.0277) SingleSource/Benchmarks/Shootout/hash: 7.61% (5.1060 => 5.4948, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/hash: 6.76% (0.7623 => 0.8138, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 6.41% (1.5297 => 1.6277, std.dev.: 0.0102) MultiSource/Applications/minisat/minisat: 5.78% (11.0375 => 11.6750, std.dev.: 0.1925) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.00% (0.2038 => 0.2140, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.81% (5.3380 => 5.5414, std.dev.: 0.0182) MultiSource/Benchmarks/Olden/em3d/em3d: 3.23% (3.1110 => 3.2114, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.94% (1.5595 => 1.6053, std.dev.: 0.0116) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.59% (1.5993 => 1.6408, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.37% (4.3273 => 4.4297, std.dev.: 0.0392) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.06% (1.7541 => 1.7902, std.dev.: 0.0046) MultiSource/Applications/sgefa/sgefa: 1.98% (0.6305 => 0.6430, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.89% (17.0091 => 17.3303, std.dev.: 0.0241) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.67% (6.0725 => 6.1742, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.21% (88.0731 => 89.1381, std.dev.: 0.2281) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -13.39% (0.8326 => 0.7211, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -13.11% (0.6829 => 0.5934, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -9.55% (0.8953 => 0.8098, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -9.07% (0.4765 => 0.4333, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -8.92% (0.6816 => 0.6208, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.71% (0.7254 => 0.6912, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.70% (0.4680 => 0.4507, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -3.08% (0.7442 => 0.7213, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.84% (0.5988 => 0.5818, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -6.29% (4.4031 => 4.1262, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.51% (9.2905 => 8.7790, std.dev.: 0.0655) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -5.27% (0.3624 => 0.3433, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -4.98% (0.2409 => 0.2289, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/ffbench: -2.91% (1.0235 => 0.9937, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: -1.59% (7.9111 => 7.7850, std.dev.: 0.0231) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.52% (9.4620 => 9.3185, std.dev.: 0.0338) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.29% (5.7573 => 5.6833, std.dev.: 0.0086) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 1.87% (0.1339 => 0.1364, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -13.40% (0.0485 => 0.0420, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0652 => 0.0651, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 0.07% (493.6431 => 494.0031, std.dev.: 0.2045) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/power/power: 43706.25% (1.1277 => 494.0031, std.dev.: 0.2045) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 201.36% (0.5229 => 1.5758, std.dev.: 0.0347) MultiSource/Applications/SPASS/SPASS: 24.98% (14.9895 => 18.7344, std.dev.: 0.0101) MultiSource/Applications/kimwitu++/kc: 47.89% (14.1553 => 20.9339, std.dev.: 0.0800) MultiSource/Benchmarks/MallocBench/gs/gs: 21.77% (4.1105 => 5.0055, std.dev.: 0.1638) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.17% (1.1048 => 1.5155, std.dev.: 0.0787) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 437.70% (7.1582 => 38.4894, std.dev.: 0.1013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 82.49% (3.4629 => 6.3193, std.dev.: 0.0958) SingleSource/Benchmarks/Misc-C++/stepanov_container: 85.76% (0.6222 => 1.1558, std.dev.: 0.0100) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10712.50% (0.0720 => 7.7850, std.dev.: 0.0231) MultiSource/Applications/SIBsim4/SIBsim4: 3859700.00% (0.0001 => 3.8598, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 15210800.00% (0.0001 => 15.2109, std.dev.: 0.0189) MultiSource/Applications/kimwitu++/kc: 52000.00% (0.0001 => 0.0521, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 64000.00% (0.0001 => 0.0641, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 578600.00% (0.0001 => 0.5787, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10093900.00% (0.0001 => 10.0940, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5873100.00% (0.0001 => 5.8732, std.dev.: 0.4838) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1803.38% (1.1194 => 21.3064, std.dev.: 0.1060) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 81.16% (2.9384 => 5.3232, std.dev.: 0.0565) MultiSource/Applications/ClamAV/clamscan: 69.16% (22.1758 => 37.5125, std.dev.: 0.0371) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 59.55% (7.0540 => 11.2546, std.dev.: 0.0496) MultiSource/Applications/JM/lencod/lencod: 49.79% (21.9371 => 32.8604, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.75% (8.1363 => 12.1838, std.dev.: 0.1745) SingleSource/Benchmarks/CoyoteBench/almabench: 47.26% (0.0730 => 0.1075, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/distray/distray: 45.45% (0.1056 => 0.1536, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/flops: 38.55% (0.1432 => 0.1984, std.dev.: 0.0078) SingleSource/Benchmarks/Stanford/Oscar: 37.74% (0.0636 => 0.0876, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 36.87% (0.1584 => 0.2168, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/messages-2: 36.25% (0.0662 => 0.0902, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 35.55% (0.2554 => 0.3462, std.dev.: 0.0046) MultiSource/Applications/lambda-0_1_3/lambda: 33.62% (0.7433 => 0.9932, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/messages: 33.03% (0.0327 => 0.0435, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.52% (0.1236 => 0.1638, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 30.52% (0.0793 => 0.1035, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 30.31% (0.1125 => 0.1466, std.dev.: 0.0020) SingleSource/UnitTests/vla: 30.14% (0.0355 => 0.0462, std.dev.: 0.0028) MultiSource/Benchmarks/NPB-serial/is/is: 29.35% (0.0719 => 0.0930, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 29.28% (0.0871 => 0.1126, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/mst/mst: 28.98% (0.1163 => 0.1500, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/IntMM: 28.93% (0.0394 => 0.0508, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 28.86% (0.1566 => 0.2018, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/wordfreq: 28.79% (0.3307 => 0.4259, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 28.78% (0.0886 => 0.1141, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.46% (0.5105 => 0.6558, std.dev.: 0.0053) SingleSource/UnitTests/Vector/SSE/sse_shift: 28.04% (0.0378 => 0.0484, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 27.96% (0.0447 => 0.0572, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 27.41% (0.0467 => 0.0595, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 27.39% (0.0953 => 0.1214, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/matrix: 27.38% (0.0818 => 0.1042, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.21% (0.0408 => 0.0519, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 27.13% (0.7835 => 0.9961, std.dev.: 0.0058) MultiSource/Applications/viterbi/viterbi: 27.01% (0.1555 => 0.1975, std.dev.: 0.0014) SingleSource/Benchmarks/Stanford/FloatMM: 26.43% (0.0401 => 0.0507, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 26.24% (0.4615 => 0.5826, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: 26.09% (0.4289 => 0.5408, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/em3d/em3d: 25.84% (0.1695 => 0.2133, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/family/family: 25.69% (0.0397 => 0.0499, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 25.64% (0.3109 => 0.3906, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.52% (0.1062 => 0.1333, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.50% (0.1337 => 0.1678, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 24.98% (0.4620 => 0.5774, std.dev.: 0.0078) MultiSource/Benchmarks/BitBench/drop3/drop3: 24.90% (0.0482 => 0.0602, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.79% (3.8922 => 4.8572, std.dev.: 0.0747) SingleSource/UnitTests/ObjC/parameter-passing: 24.75% (0.3927 => 0.4899, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.66% (0.0746 => 0.0930, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/property: 24.60% (0.3886 => 0.4842, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/city/city: 24.50% (2.0665 => 2.5727, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/moments: 23.89% (0.4048 => 0.5015, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/ary: 23.89% (0.3232 => 0.4004, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.86% (0.0834 => 0.1033, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 23.83% (0.0491 => 0.0608, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 23.48% (0.3650 => 0.4507, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/wc: 23.03% (0.3052 => 0.3755, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: 22.98% (0.2877 => 0.3538, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_isamax: 22.87% (0.0704 => 0.0865, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 22.55% (0.3379 => 0.4141, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 22.45% (0.3162 => 0.3872, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.40% (0.1906 => 0.2333, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/whetstone: 22.27% (0.0660 => 0.0807, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 22.09% (0.2793 => 0.3410, std.dev.: 0.0085) MultiSource/Benchmarks/VersaBench/bmm/bmm: 22.00% (0.0759 => 0.0926, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 21.99% (0.3283 => 0.4005, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: 21.85% (1.1861 => 1.4453, std.dev.: 0.0249) SingleSource/Benchmarks/Misc-C++/Large/ray: 21.75% (0.4064 => 0.4948, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.68% (0.3441 => 0.4187, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 21.67% (0.4103 => 0.4992, std.dev.: 0.0150) MultiSource/Applications/lua/lua: 21.24% (3.8723 => 4.6949, std.dev.: 0.0599) MultiSource/Benchmarks/Olden/tsp/tsp: 21.11% (0.1175 => 0.1423, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 20.95% (14.3668 => 17.3769, std.dev.: 0.1151) SingleSource/Benchmarks/Shootout-C++/sumcol: 20.93% (0.2891 => 0.3496, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 20.41% (0.0838 => 0.1009, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/oourafft: 19.96% (0.3282 => 0.3937, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: 19.63% (17.1811 => 20.5546, std.dev.: 0.0420) SingleSource/Benchmarks/Stanford/Puzzle: 19.24% (0.1268 => 0.1512, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.22% (0.2700 => 0.3219, std.dev.: 0.0196) SingleSource/UnitTests/ObjC/synchronized: 19.15% (0.3561 => 0.4243, std.dev.: 0.0084) MultiSource/Benchmarks/mafft/pairlocalalign: 18.98% (9.4845 => 11.2843, std.dev.: 0.0863) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 18.57% (4.9449 => 5.8631, std.dev.: 0.1151) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.17% (0.0842 => 0.0995, std.dev.: 0.0029) MultiSource/Applications/d/make_dparser: 17.58% (3.3354 => 3.9219, std.dev.: 0.1848) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.47% (0.6675 => 0.7841, std.dev.: 0.0323) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.42% (5.0018 => 5.8731, std.dev.: 0.1421) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 17.41% (0.0672 => 0.0789, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.31% (4.2646 => 5.0026, std.dev.: 0.2100) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.24% (0.8172 => 0.9581, std.dev.: 0.0216) MultiSource/Applications/oggenc/oggenc: 17.05% (5.7591 => 6.7413, std.dev.: 0.0370) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.67% (0.0648 => 0.0756, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.56% (0.2065 => 0.2407, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 16.36% (0.0770 => 0.0896, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 16.21% (0.5860 => 0.6810, std.dev.: 0.0310) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.94% (0.1117 => 0.1295, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.91% (1.5415 => 1.7867, std.dev.: 0.0893) SingleSource/Benchmarks/Shootout-C++/objinst: 15.81% (0.3131 => 0.3626, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/health/health: 15.62% (0.1268 => 0.1466, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.45% (0.0770 => 0.0889, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.41% (0.3543 => 0.4089, std.dev.: 0.0182) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.58% (0.1029 => 0.1179, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.43% (0.5981 => 0.6844, std.dev.: 0.0309) MultiSource/Benchmarks/Bullet/bullet: 13.80% (63.2438 => 71.9706, std.dev.: 0.3803) MultiSource/Benchmarks/McCat/18-imp/imp: 13.67% (0.3423 => 0.3891, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 13.66% (0.3543 => 0.4027, std.dev.: 0.0160) SingleSource/UnitTests/ObjC/exceptions-3: 13.65% (0.3516 => 0.3996, std.dev.: 0.0177) SingleSource/UnitTests/ObjC/trivial-interface: 13.65% (0.3473 => 0.3947, std.dev.: 0.0180) SingleSource/UnitTests/ObjC/for-in: 13.24% (0.3694 => 0.4183, std.dev.: 0.0175) MultiSource/Applications/treecc/treecc: 12.97% (2.0273 => 2.2902, std.dev.: 0.0477) MultiSource/Benchmarks/McCat/09-vor/vor: 12.52% (0.3180 => 0.3578, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.39% (0.5020 => 0.5642, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.36% (0.4879 => 0.5482, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: 12.15% (0.1440 => 0.1615, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.11% (0.3865 => 0.4333, std.dev.: 0.0157) MultiSource/Applications/lemon/lemon: 11.98% (1.0722 => 1.2007, std.dev.: 0.0146) MultiSource/Benchmarks/McCat/05-eks/eks: 11.91% (0.4299 => 0.4811, std.dev.: 0.0083) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.44% (2.2022 => 2.4542, std.dev.: 0.0408) MultiSource/Applications/hbd/hbd: 11.39% (1.5603 => 1.7380, std.dev.: 0.0135) MultiSource/Benchmarks/PAQ8p/paq8p: 10.10% (10.3673 => 11.4147, std.dev.: 0.1048) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.97% (0.1438 => 0.1567, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 8.14% (1.2842 => 1.3887, std.dev.: 0.0328) MultiSource/Benchmarks/Olden/bh/bh: 7.89% (0.3092 => 0.3336, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.58% (0.3935 => 0.4194, std.dev.: 0.0098) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.03% (7.9617 => 8.3625, std.dev.: 0.1436) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.66% (4.3953 => 11.0174, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/methcall: 147.64% (5.3999 => 13.3725, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 28.96% (13.4384 => 17.3303, std.dev.: 0.0241) MultiSource/Applications/minisat/minisat: 28.07% (9.1159 => 11.6750, std.dev.: 0.1925) SingleSource/Benchmarks/Shootout-C++/moments: 27.96% (0.1159 => 0.1483, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 27.26% (2.0360 => 2.5910, std.dev.: 0.0683) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 24.74% (1.3045 => 1.6272, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/ary2: 22.32% (0.0757 => 0.0926, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: 20.54% (3.6994 => 4.4592, std.dev.: 0.2938) SingleSource/Benchmarks/Misc/oourafft: 17.51% (6.6465 => 7.8106, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/mst/mst: 17.35% (0.1285 => 0.1508, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.31% (1.1145 => 1.3074, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.94% (0.2944 => 0.3325, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout/hash: 11.94% (4.9088 => 5.4948, std.dev.: 0.0166) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.65% (2.8904 => 3.2271, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: 10.30% (1.1396 => 1.2570, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 10.12% (3.1578 => 3.4775, std.dev.: 0.0886) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.44% (1.7254 => 1.8882, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: 9.16% (0.7455 => 0.8138, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/puzzle: 8.93% (0.6962 => 0.7584, std.dev.: 0.0201) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.35% (8.6802 => 9.3185, std.dev.: 0.0338) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.09% (3.8532 => 4.1262, std.dev.: 0.0180) MultiSource/Benchmarks/Fhourstones/fhourstones: 6.36% (1.8329 => 1.9495, std.dev.: 0.0277) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.95% (0.9540 => 1.0108, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.65% (4.2280 => 4.4667, std.dev.: 0.0112) MultiSource/Applications/lua/lua: 5.23% (26.0924 => 27.4571, std.dev.: 0.1192) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 4.54% (0.9505 => 0.9937, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.49% (1.7133 => 1.7902, std.dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 4.16% (11.6436 => 12.1277, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.95% (3.6395 => 3.7833, std.dev.: 0.0344) MultiSource/Benchmarks/Olden/em3d/em3d: 3.52% (3.1023 => 3.2114, std.dev.: 0.0038) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 3.33% (0.6223 => 0.6430, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.07% (1.5086 => 1.5549, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: 2.63% (2.4116 => 2.4750, std.dev.: 0.0077) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.36% (2.1424 => 2.1929, std.dev.: 0.0139) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.16% (1.3677 => 1.3973, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 2.14% (3.1595 => 3.2270, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 2.10% (85.0658 => 86.8480, std.dev.: 0.0296) MultiSource/Benchmarks/mafft/pairlocalalign: 1.58% (27.8444 => 28.2857, std.dev.: 0.0080) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.46% (6.5088 => 6.6037, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/lists: 1.43% (12.5348 => 12.7135, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout/sieve: 1.31% (5.2139 => 5.2823, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0313 => 1.0441, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0503, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 1.12% (2.2771 => 2.3027, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.33% (6.6874 => 0.1786, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/salsa20: -75.36% (0.8651 => 0.2132, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -74.65% (5.2763 => 1.3377, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/richards_benchmark: -38.41% (0.1622 => 0.0999, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.93% (5.3526 => 4.7143, std.dev.: 0.0519) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.79% (5.3855 => 4.7508, std.dev.: 0.1304) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -9.24% (1.7609 => 1.5982, std.dev.: 0.0328) MultiSource/Applications/JM/ldecod/ldecod: -7.03% (10.4361 => 9.7029, std.dev.: 0.0437) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.90% (0.3987 => 0.2396, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.33% (4.5009 => 2.7757, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: -33.56% (1.1492 => 0.7635, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -26.96% (10.7105 => 7.8230, std.dev.: 0.3940) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.14% (2.6546 => 2.0139, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: -19.16% (0.2161 => 0.1747, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4263, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.69% (2.6778 => 2.2844, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.72% (32.5116 => 29.0268, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -10.32% (9.5636 => 8.5769, std.dev.: 0.1074) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.50% (1.5660 => 1.4329, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4793, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.2416 => 3.0209, std.dev.: 0.0253) SingleSource/Benchmarks/CoyoteBench/huffbench: -5.97% (19.9488 => 18.7575, std.dev.: 0.2317) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.13% (0.2497 => 0.2369, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.75% (1.5835 => 1.5083, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -4.16% (6.2999 => 6.0380, std.dev.: 0.0040) MultiSource/Applications/siod/siod: -3.37% (3.2827 => 3.1720, std.dev.: 0.0280) MultiSource/Benchmarks/sim/sim: -3.03% (5.0483 => 4.8952, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.41% (0.9957 => 0.9717, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.36% (1.6805 => 1.6408, std.dev.: 0.0144) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.10% (0.4808 => 0.4707, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.89% (8.1563 => 8.0025, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6772, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -1.49% (10.2830 => 10.1301, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.15% (0.1485 => 0.1364, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0012) Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 13:16:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 15:16:12 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121115211612.90BDA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5910?compare_to=5907&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5910, Order: 168070, Start Time: 2012-11-15 19:44:33, End Time: 2012-11-15 21:16:32 To: 5907, Order: 168049, Start Time: 2012-11-15 17:52:27, End Time: 2012-11-15 19:23:43 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 5 (41 on baseline) Performance Improvements: 8 (15 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 979 (918 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.40% (0.2817 => 0.2941, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 15.97% (1.0173 => 1.1798, std.dev.: 0.0229) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.14% (4.1315 => 4.3437, std.dev.: 0.0527) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.43% (3.8066 => 3.8610, std.dev.: 0.0179) SingleSource/Benchmarks/Misc/pi: 1.41% (2.4626 => 2.4973, std.dev.: 0.0119) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/BenchmarkGame/recursive: -45.87% (0.0460 => 0.0249, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/mandel-text: -39.77% (0.0352 => 0.0212, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/lowercase: -38.64% (0.0396 => 0.0243, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.06% (0.1573 => 0.1462, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.20% (6.8976 => 6.8146, std.dev.: 0.0220) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.22% (7.1502 => 6.7056, std.dev.: 0.1157) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.61% (1.4008 => 1.3503, std.dev.: 0.0192) SingleSource/Benchmarks/Misc/flops-7: -2.02% (1.7538 => 1.7183, std.dev.: 0.0067) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.83% (17.0663 => 16.9242, std.dev.: 0.8185) MultiSource/Applications/obsequi/Obsequi: 0.43% (1.0864 => 1.0911, std.dev.: 0.2334) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.02% (22.0054 => 22.2296, std.dev.: 0.7042) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.85% (0.3722 => 0.3653, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/bigfib: -6.38% (0.6520 => 0.6104, std.dev.: 0.1530) SingleSource/Benchmarks/Shootout-C++/reversefile: -1.66% (0.3433 => 0.3376, std.dev.: 0.0546) SingleSource/Benchmarks/Shootout-C++/strcat: -4.82% (0.2115 => 0.2013, std.dev.: 0.0581) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.35% (0.0223 => 0.0220, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.50% (0.0440 => 0.0429, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.06% (0.0339 => 0.0332, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.25% (0.0320 => 0.0316, std.dev.: 0.0062) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.95% (0.0440 => 0.0427, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/casts: -1.43% (0.0210 => 0.0207, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/test1: -4.78% (0.0230 => 0.0219, std.dev.: 0.0101) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 0.74% (0.1482 => 0.1493, std.dev.: 0.0098) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 11.25% (1.1625 => 1.2933, std.dev.: 0.2995) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.27% (0.4188 => 0.4283, std.dev.: 0.0616) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.98% (0.1424 => 0.1410, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.19% (0.0639 => 0.0625, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.94% (0.0277 => 0.0255, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.62% (0.0580 => 0.0559, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.58% (1.1967 => 1.2036, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.16% (0.0643 => 0.0642, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0251 => 0.0251, std.dev.: 0.0062) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.08% (0.7866 => 0.7860, std.dev.: 0.0399) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 6.90% (0.0058 => 0.0062, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2377.08% (0.6332 => 15.6849, std.dev.: 0.4731) MultiSource/Benchmarks/McCat/08-main/main: 47.79% (0.1831 => 0.2706, std.dev.: 0.0912) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.22% (0.1559 => 0.1462, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1554.25% (0.3344 => 5.5318, std.dev.: 0.2960) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.06% (0.2364 => 0.3240, std.dev.: 0.1149) SingleSource/Benchmarks/Misc/mandel: 2.80% (0.0429 => 0.0441, std.dev.: 0.0157) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 19.20% (0.0224 => 0.0267, std.dev.: 0.0075) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0033) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 12.31% (0.1462 => 0.1642, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4958, std.dev.: 0.1437) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0756, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4918, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3216, std.dev.: 0.0802) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1253, std.dev.: 0.1128) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4107, std.dev.: 0.0149) SingleSource/Regression/C/uint64_to_float: -23.92% (2.1832 => 1.6609, std.dev.: 0.0064) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 14.66% (0.1112 => 0.1275, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.44% (0.2998 => 0.3251, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.21% (0.1425 => 0.1542, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.49% (0.2279 => 0.2427, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.33% (0.2133 => 0.2268, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.02% (0.2774 => 0.2941, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.14% (6.6074 => 6.8146, std.dev.: 0.0220) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.99% (0.3717 => 0.3828, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 2.55% (8.6247 => 8.8448, std.dev.: 0.0614) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.49% (0.6943 => 0.7116, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 103.02% (0.0199 => 0.0404, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/pi: 58.11% (1.5795 => 2.4973, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.72% (0.7597 => 0.8943, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.21% (2.9753 => 3.4575, std.dev.: 0.0570) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.85% (2.7995 => 3.2151, std.dev.: 0.0303) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.61% (5.0261 => 5.6094, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.84% (3.9188 => 4.3437, std.dev.: 0.0527) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.01% (0.3186 => 0.3505, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/queens: 9.12% (1.7056 => 1.8611, std.dev.: 0.0437) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.33% (1.1857 => 1.2845, std.dev.: 0.0203) MultiSource/Applications/SIBsim4/SIBsim4: 7.35% (3.1873 => 3.4215, std.dev.: 0.0394) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.23% (4.5327 => 4.8149, std.dev.: 0.0414) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.17% (4.9686 => 5.2754, std.dev.: 0.0964) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.15% (6.3772 => 6.7056, std.dev.: 0.1157) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.09% (3.3761 => 3.5478, std.dev.: 0.0181) MultiSource/Applications/lambda-0_1_3/lambda: 4.92% (7.4933 => 7.8621, std.dev.: 0.0724) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.78% (4.9469 => 5.1832, std.dev.: 0.0403) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.03% (4.9453 => 5.1448, std.dev.: 0.0465) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.98% (2.2485 => 2.3381, std.dev.: 0.0330) MultiSource/Applications/hexxagon/hexxagon: 3.96% (14.0064 => 14.5614, std.dev.: 0.1191) MultiSource/Applications/siod/siod: 3.11% (3.6643 => 3.7782, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.95% (4.8660 => 5.0097, std.dev.: 0.0328) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.73% (8.2783 => 8.5040, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.70% (11.5690 => 11.8818, std.dev.: 0.0490) SingleSource/Benchmarks/Shootout/lists: 2.48% (7.3375 => 7.5193, std.dev.: 0.0272) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.31% (4.8362 => 4.9477, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.19% (3.7781 => 3.8610, std.dev.: 0.0179) SingleSource/Benchmarks/Misc/ReedSolomon: 1.65% (8.5322 => 8.6728, std.dev.: 0.0421) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.57% (4.0473 => 4.1109, std.dev.: 0.0148) MultiSource/Benchmarks/FreeBench/neural/neural: 1.33% (1.0841 => 1.0985, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.08% (4.4340 => 4.4818, std.dev.: 0.0149) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.13% (5.4641 => 4.3096, std.dev.: 0.2343) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.73% (7.2130 => 6.2229, std.dev.: 0.0906) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.79% (1.0512 => 0.9378, std.dev.: 0.0391) MultiSource/Benchmarks/mafft/pairlocalalign: -8.42% (63.1822 => 57.8600, std.dev.: 0.0894) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.86% (4.7482 => 4.4225, std.dev.: 0.1208) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.37% (14.6451 => 13.7128, std.dev.: 0.1181) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.3269 => 0.3070, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.78% (5.4972 => 5.1797, std.dev.: 0.0929) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.55% (3.7148 => 3.5086, std.dev.: 0.0456) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.06% (5.1557 => 4.8949, std.dev.: 0.0761) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.25% (6.0224 => 5.8265, std.dev.: 0.0649) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.17% (0.5807 => 0.5623, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.02% (28.5821 => 27.7192, std.dev.: 0.2531) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.95% (11.5316 => 11.3063, std.dev.: 0.0221) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.62% (4.9994 => 4.9185, std.dev.: 0.0240) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.91% (16.4461 => 16.9242, std.dev.: 0.8185) MultiSource/Applications/obsequi/Obsequi: 6.32% (1.0262 => 1.0911, std.dev.: 0.2334) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7018.03% (0.3123 => 22.2296, std.dev.: 0.7042) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.32% (0.2463 => 0.3653, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/bigfib: 1.56% (0.6010 => 0.6104, std.dev.: 0.1530) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.37% (0.3266 => 0.3376, std.dev.: 0.0546) SingleSource/Benchmarks/Shootout-C++/strcat: 2.23% (0.1969 => 0.2013, std.dev.: 0.0581) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.15% (0.0408 => 0.0429, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0062) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.20% (0.0384 => 0.0427, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/casts: 8.95% (0.0190 => 0.0207, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0101) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 3.82% (0.1438 => 0.1493, std.dev.: 0.0098) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 14.16% (1.1329 => 1.2933, std.dev.: 0.2995) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.86% (0.4164 => 0.4283, std.dev.: 0.0616) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.99% (0.1369 => 0.1410, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.50% (0.0641 => 0.0625, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 30.77% (0.0195 => 0.0255, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.29% (0.0578 => 0.0559, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.24% (1.1437 => 1.2036, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.39% (0.0627 => 0.0642, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.44% (0.0180 => 0.0251, std.dev.: 0.0062) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.96% (0.8017 => 0.7860, std.dev.: 0.0399) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0062 => 0.0062, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 13:28:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 15:28:58 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121115212858.B73B12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5911?compare_to=5908&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5911, Order: 168074, Start Time: 2012-11-15 20:04:15, End Time: 2012-11-15 21:29:17 To: 5908, Order: 168049, Start Time: 2012-11-15 18:13:59, End Time: 2012-11-15 19:39:03 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 3 (7 on baseline) Performance Improvements: 0 (183 on baseline) Unchanged Tests: 1039 (852 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 3.43% (0.3844 => 0.3976, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.71% (54.5502 => 56.5767, std.dev.: 0.0354) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.26% (78.6081 => 79.5957, std.dev.: 0.2475) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 3.70% (0.3834 => 0.3976, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.24% (1.2783 => 1.3709, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.67% (54.5751 => 56.5767, std.dev.: 0.0354) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.08% (2.0478 => 2.1108, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.4937 => 7.6779, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/hash2: 2.20% (3.1932 => 3.2636, std.dev.: 0.0040) MultiSource/Benchmarks/llubenchmark/llu: 2.11% (3.7435 => 3.8225, std.dev.: 0.0125) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.98% (0.3821 => 0.3516, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -7.18% (2.4924 => 2.3135, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -7.09% (0.3357 => 0.3119, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.03% (0.9542 => 0.8871, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.75% (0.3142 => 0.2930, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.71% (0.2428 => 0.2265, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.48% (0.6484 => 0.6064, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.46% (0.1796 => 0.1680, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.31% (0.1584 => 0.1484, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: -6.31% (16.1920 => 15.1702, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/football/football: -6.30% (0.9179 => 0.8601, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -6.28% (0.1879 => 0.1761, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/oourafft: -6.25% (0.2160 => 0.2025, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -6.23% (9.2283 => 8.6530, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.16% (1.0544 => 0.9894, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: -6.16% (7.0961 => 6.6589, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.14% (0.9852 => 0.9247, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -6.13% (0.1761 => 0.1653, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.12% (0.3658 => 0.3434, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.12% (0.1716 => 0.1611, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.10% (1.3722 => 1.2885, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.09% (0.2695 => 0.2531, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.05% (0.5805 => 0.5454, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.03% (3.5339 => 3.3207, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.02% (0.5863 => 0.5510, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.96% (0.5802 => 0.5456, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.96% (0.5857 => 0.5508, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.95% (0.5478 => 0.5152, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.95% (0.6660 => 0.6264, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.94% (0.2355 => 0.2215, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.93% (0.6395 => 0.6016, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -5.92% (1.1450 => 1.0772, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.90% (0.6052 => 0.5695, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.89% (0.5859 => 0.5514, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.88% (0.6681 => 0.6288, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.88% (1.4642 => 1.3781, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.86% (0.6230 => 0.5865, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.86% (0.5925 => 0.5578, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.85% (1.2300 => 1.1580, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.85% (0.6736 => 0.6342, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.85% (0.5591 => 0.5264, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.85% (0.5575 => 0.5249, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.83% (4.8161 => 4.5355, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.81% (4.0323 => 3.7982, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.78% (0.5705 => 0.5375, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: -5.78% (1.1530 => 1.0864, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.77% (0.7198 => 0.6783, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -5.75% (0.3406 => 0.3210, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: -5.73% (1.3864 => 1.3069, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.73% (0.5688 => 0.5362, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.73% (0.5569 => 0.5250, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.71% (0.6667 => 0.6286, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.70% (0.7524 => 0.7095, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.70% (1.6364 => 1.5431, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.67% (4.8802 => 4.6035, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.66% (0.5849 => 0.5518, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.65% (4.5069 => 4.2521, std.dev.: 0.0086) MultiSource/Benchmarks/McCat/05-eks/eks: -5.63% (0.4515 => 0.4261, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.62% (0.5941 => 0.5607, std.dev.: 0.0129) MultiSource/Applications/sqlite3/sqlite3: -5.62% (17.1032 => 16.1428, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.60% (0.6676 => 0.6302, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.60% (0.5570 => 0.5258, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.60% (0.6446 => 0.6085, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.59% (0.5581 => 0.5269, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.57% (1.2784 => 1.2072, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.56% (0.6260 => 0.5912, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.55% (0.7339 => 0.6932, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -5.55% (1.2515 => 1.1821, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.54% (0.3483 => 0.3290, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.53% (0.6293 => 0.5945, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.52% (0.8521 => 0.8051, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.51% (0.5567 => 0.5260, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.50% (0.5456 => 0.5156, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.49% (14.2083 => 13.4279, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/trivial-interface: -5.48% (0.3812 => 0.3603, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -5.47% (4.3330 => 4.0960, std.dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.46% (6.7716 => 6.4019, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.46% (0.6395 => 0.6046, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.45% (0.6033 => 0.5704, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -5.42% (0.3581 => 0.3387, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: -5.41% (0.4033 => 0.3815, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.35% (1.2221 => 1.1567, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.32% (1.2210 => 1.1560, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.32% (0.7919 => 0.7498, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -5.31% (0.3880 => 0.3674, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.30% (0.3831 => 0.3628, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.30% (0.6440 => 0.6099, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.27% (0.4176 => 0.3956, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.27% (0.5999 => 0.5683, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: -5.26% (0.3896 => 0.3691, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.25% (0.3848 => 0.3646, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.24% (0.2999 => 0.2842, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.22% (8.0126 => 7.5947, std.dev.: 0.0078) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.19% (0.3891 => 0.3689, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: -5.19% (15.5079 => 14.7030, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.19% (0.4916 => 0.4661, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.18% (0.2278 => 0.2160, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.18% (1.6474 => 1.5621, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -5.16% (0.2985 => 0.2831, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.14% (0.2548 => 0.2417, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -5.14% (3.5154 => 3.3348, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.12% (0.3884 => 0.3685, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.09% (0.3319 => 0.3150, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.08% (0.6297 => 0.5977, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.05% (0.6194 => 0.5881, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: -5.05% (0.7447 => 0.7071, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: -5.05% (0.4199 => 0.3987, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -5.04% (15.2527 => 14.4847, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.03% (0.2385 => 0.2265, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.03% (0.6304 => 0.5987, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -5.00% (0.2659 => 0.2526, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.97% (0.5168 => 0.4911, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.94% (0.5329 => 0.5066, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.89% (0.7021 => 0.6678, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -4.79% (4.0594 => 3.8648, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.77% (0.6189 => 0.5894, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.73% (2.2587 => 2.1519, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/parameter-passing: -4.72% (0.4280 => 0.4078, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -4.70% (2.4021 => 2.2891, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.70% (22.4056 => 21.3522, std.dev.: 0.0125) MultiSource/Applications/lambda-0_1_3/lambda: -4.67% (0.7982 => 0.7609, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: -4.65% (2.1401 => 2.0405, std.dev.: 0.0050) MultiSource/Applications/oggenc/oggenc: -4.63% (5.0226 => 4.7902, std.dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: -4.58% (1.3148 => 1.2546, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.48% (0.3837 => 0.3665, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.43% (0.3271 => 0.3126, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.43% (0.4151 => 0.3967, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.35% (0.3931 => 0.3760, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -4.33% (0.3255 => 0.3114, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.32% (0.9557 => 0.9144, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: -4.31% (18.2933 => 17.5048, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/objinst: -4.26% (0.3194 => 0.3058, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.18% (2.1713 => 2.0805, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -4.17% (34.0927 => 32.6725, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/hash2: -4.16% (0.4861 => 0.4659, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -4.15% (0.8418 => 0.8069, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: -4.13% (0.3026 => 0.2901, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -4.12% (0.3394 => 0.3254, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.11% (0.3016 => 0.2892, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -4.11% (0.2871 => 0.2753, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -4.10% (0.3025 => 0.2901, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.10% (0.6347 => 0.6087, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.09% (0.3057 => 0.2932, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.06% (0.3323 => 0.3188, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: -4.03% (0.3446 => 0.3307, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -4.01% (0.3867 => 0.3712, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.00% (0.4321 => 0.4148, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists: -3.98% (0.3621 => 0.3477, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -3.96% (0.3481 => 0.3343, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.96% (0.2903 => 0.2788, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -3.95% (0.4248 => 0.4080, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/strcat: -3.95% (0.2989 => 0.2871, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -3.94% (0.6441 => 0.6187, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -3.93% (0.2849 => 0.2737, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.92% (0.2933 => 0.2818, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -3.89% (0.4524 => 0.4348, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.89% (0.4813 => 0.4626, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: -3.87% (0.3205 => 0.3081, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.84% (0.9077 => 0.8728, std.dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: -3.82% (0.3059 => 0.2942, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.82% (0.4427 => 0.4258, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.81% (0.3252 => 0.3128, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.81% (0.3491 => 0.3358, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.80% (0.4083 => 0.3928, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.79% (0.3849 => 0.3703, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -3.78% (0.2939 => 0.2828, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -3.68% (0.7779 => 0.7493, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -3.66% (0.6750 => 0.6503, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: -3.39% (1.5610 => 1.5081, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.37% (5.4682 => 5.2839, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/sieve: -3.35% (0.3788 => 0.3661, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.22% (20.7746 => 20.3128, std.dev.: 0.0081) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7554, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1729, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.76% (2.2633 => 2.1782, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.17% (1.3096 => 1.2812, std.dev.: 0.0081) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4695, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0010) Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 15:07:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 17:07:00 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121115230700.B56262A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5912?compare_to=5910&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5912, Order: 168087, Start Time: 2012-11-15 21:35:19, End Time: 2012-11-15 23:07:19 To: 5910, Order: 168070, Start Time: 2012-11-15 19:44:33, End Time: 2012-11-15 21:16:32 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 10 (52 on baseline) Performance Improvements: 7 (17 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 975 (905 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 47.98% (0.0692 => 0.1024, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.39% (1.5803 => 1.7287, std.dev.: 0.0443) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.46% (3.2689 => 3.4801, std.dev.: 0.0333) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/flops: 19.76% (7.8380 => 9.3868, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 10.95% (21.4262 => 23.7713, std.dev.: 0.2658) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.79% (40.2062 => 42.9350, std.dev.: 0.8971) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.01% (60.0647 => 63.6756, std.dev.: 0.2753) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.23% (6.2229 => 6.4860, std.dev.: 0.0466) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.93% (1.3503 => 1.3898, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.19% (2.7542 => 2.7869, std.dev.: 0.0096) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: -7.28% (0.2610 => 0.2420, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -14.43% (1.1798 => 1.0095, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/ackermann: -11.63% (4.3437 => 3.8387, std.dev.: 0.1574) SingleSource/Benchmarks/Shootout-C++/hash: -4.26% (0.6594 => 0.6313, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/queens: -1.46% (1.8611 => 1.8340, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-8: -1.08% (2.5930 => 2.5650, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.05% (5.4263 => 5.3693, std.dev.: 0.0100) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.70% (16.9242 => 17.0429, std.dev.: 0.7124) MultiSource/Applications/obsequi/Obsequi: -0.27% (1.0911 => 1.0882, std.dev.: 0.2186) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.28% (22.2296 => 22.1678, std.dev.: 1.5671) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.47% (0.3653 => 0.3670, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 2.57% (0.6104 => 0.6261, std.dev.: 0.0272) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.09% (0.3376 => 0.3379, std.dev.: 0.0477) SingleSource/Benchmarks/Shootout-C++/strcat: 0.55% (0.2013 => 0.2024, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.91% (0.0220 => 0.0218, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.47% (0.0429 => 0.0427, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 2.41% (0.0332 => 0.0340, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.95% (0.0316 => 0.0313, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.23% (0.0427 => 0.0428, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: -0.48% (0.0207 => 0.0206, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/test1: -1.37% (0.0219 => 0.0216, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.33% (0.1493 => 0.1488, std.dev.: 0.0301) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -8.11% (1.2933 => 1.1884, std.dev.: 0.3706) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.66% (0.4283 => 0.4212, std.dev.: 0.0349) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.35% (0.1410 => 0.1405, std.dev.: 0.0320) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.04% (0.0625 => 0.0644, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 4.31% (0.0255 => 0.0266, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.23% (0.0559 => 0.0605, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.60% (1.2036 => 1.1964, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.40% (0.0642 => 0.0651, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.37% (0.0251 => 0.0267, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.59% (0.7860 => 0.7814, std.dev.: 0.0175) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 29.03% (0.0062 => 0.0080, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2316.87% (0.6332 => 15.3036, std.dev.: 0.6747) MultiSource/Benchmarks/McCat/08-main/main: 49.97% (0.1831 => 0.2746, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.39% (0.1559 => 0.1475, std.dev.: 0.0270) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1568.30% (0.3344 => 5.5788, std.dev.: 0.2600) SingleSource/Benchmarks/Misc-C++/Large/ray: 42.39% (0.2364 => 0.3366, std.dev.: 0.1025) SingleSource/Benchmarks/Misc/mandel: 4.66% (0.0429 => 0.0449, std.dev.: 0.0148) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.04% (0.0224 => 0.0242, std.dev.: 0.0071) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0063) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 12.38% (0.1462 => 0.1643, std.dev.: 0.0190) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4799, std.dev.: 0.0450) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0684, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4959, std.dev.: 0.0722) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3279, std.dev.: 0.0155) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1408, std.dev.: 0.1917) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4122, std.dev.: 0.0069) SingleSource/Regression/C/uint64_to_float: -23.91% (2.1832 => 1.6611, std.dev.: 0.0033) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 48.84% (0.0688 => 0.1024, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.88% (1.5315 => 1.7287, std.dev.: 0.0443) MultiSource/Benchmarks/Olden/tsp/tsp: 12.86% (0.1112 => 0.1255, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.33% (3.1832 => 3.4801, std.dev.: 0.0333) MultiSource/Benchmarks/Olden/em3d/em3d: 9.06% (0.1721 => 0.1877, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.57% (0.2741 => 0.2976, std.dev.: 0.0078) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.74% (0.2378 => 0.2562, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.52% (0.1756 => 0.1888, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 3.68% (1.2568 => 1.3031, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/football/football: 3.56% (0.8768 => 0.9080, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/lists1: 3.40% (0.2969 => 0.3070, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.77% (0.8317 => 0.8547, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.65% (0.8927 => 0.9164, std.dev.: 0.0083) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 111.56% (0.0199 => 0.0421, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/pi: 57.53% (1.5795 => 2.4882, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.38% (2.9753 => 3.4626, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.68% (0.7597 => 0.8788, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6088, std.dev.: 0.0275) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.28% (1.1857 => 1.2839, std.dev.: 0.0252) SingleSource/Benchmarks/McGill/queens: 7.53% (1.7056 => 1.8340, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 7.44% (59.2638 => 63.6756, std.dev.: 0.2753) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 7.29% (2.2485 => 2.4125, std.dev.: 0.0629) SingleSource/Benchmarks/Misc/richards_benchmark: 7.08% (1.3037 => 1.3960, std.dev.: 0.0239) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.60% (22.2997 => 23.7713, std.dev.: 0.2658) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.59% (4.7794 => 5.0945, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 6.44% (3.1873 => 3.3926, std.dev.: 0.0355) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.85% (4.9686 => 5.2592, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.72% (4.5327 => 4.7918, std.dev.: 0.0313) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.69% (6.3772 => 6.7401, std.dev.: 0.0384) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.54% (3.3761 => 3.5293, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.51% (6.2275 => 6.5081, std.dev.: 0.0228) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.22% (4.9453 => 5.1541, std.dev.: 0.0636) MultiSource/Applications/siod/siod: 4.18% (3.6643 => 3.8174, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.06% (4.9469 => 5.1478, std.dev.: 0.0087) MultiSource/Applications/hexxagon/hexxagon: 3.90% (14.0064 => 14.5525, std.dev.: 0.0535) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.72% (11.5690 => 11.8831, std.dev.: 0.0664) SingleSource/Benchmarks/Shootout/lists: 2.62% (7.3375 => 7.5297, std.dev.: 0.0298) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.43% (8.2783 => 8.4797, std.dev.: 0.0168) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.40% (4.3552 => 4.4599, std.dev.: 0.0399) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.38% (4.8660 => 4.9816, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/except: 2.32% (0.4921 => 0.5035, std.dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: 2.09% (0.5081 => 0.5187, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.96% (1.1365 => 1.1588, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.89% (2.4647 => 2.5113, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash: 1.74% (0.6205 => 0.6313, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/FloatMM: 1.60% (0.8807 => 0.8948, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/power/power: 1.53% (1.2061 => 1.2245, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 1.34% (1.0841 => 1.0986, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/whetstone: 1.27% (2.1224 => 2.1494, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: 1.18% (2.3560 => 2.3838, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.15% (2.7551 => 2.7869, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/fbench: 1.07% (3.3840 => 3.4201, std.dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.92% (5.4641 => 4.3210, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.91% (1.0512 => 0.9365, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -10.08% (7.2130 => 6.4860, std.dev.: 0.0466) SingleSource/Benchmarks/McGill/chomp: -9.99% (1.1216 => 1.0095, std.dev.: 0.0125) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.58% (14.6451 => 13.3892, std.dev.: 0.2575) MultiSource/Benchmarks/mafft/pairlocalalign: -8.31% (63.1822 => 57.9329, std.dev.: 0.1181) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.16% (3.7148 => 3.4858, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.95% (5.4972 => 5.1699, std.dev.: 0.0271) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.11% (5.1557 => 4.8925, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.23% (4.7449 => 4.5444, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.49% (6.0224 => 5.8125, std.dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (28.5821 => 27.6966, std.dev.: 0.0343) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.21% (9.9065 => 9.6874, std.dev.: 0.0807) SingleSource/Benchmarks/Shootout-C++/hash2: -2.11% (3.4237 => 3.3515, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.06% (11.5316 => 11.2936, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.62% (4.9994 => 4.9184, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.24% (5.6343 => 5.5646, std.dev.: 0.0189) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 3.63% (16.4461 => 17.0429, std.dev.: 0.7124) MultiSource/Applications/obsequi/Obsequi: 6.04% (1.0262 => 1.0882, std.dev.: 0.2186) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6998.24% (0.3123 => 22.1678, std.dev.: 1.5671) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.01% (0.2463 => 0.3670, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 4.18% (0.6010 => 0.6261, std.dev.: 0.0272) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.46% (0.3266 => 0.3379, std.dev.: 0.0477) SingleSource/Benchmarks/Shootout-C++/strcat: 2.79% (0.1969 => 0.2024, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 33.86% (0.0254 => 0.0340, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.46% (0.0384 => 0.0428, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: 8.42% (0.0190 => 0.0206, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 3.48% (0.1438 => 0.1488, std.dev.: 0.0301) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 4.90% (1.1329 => 1.1884, std.dev.: 0.3706) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.15% (0.4164 => 0.4212, std.dev.: 0.0349) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.63% (0.1369 => 0.1405, std.dev.: 0.0320) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.47% (0.0641 => 0.0644, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 36.41% (0.0195 => 0.0266, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.67% (0.0578 => 0.0605, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.61% (1.1437 => 1.1964, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.83% (0.0627 => 0.0651, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.53% (0.8017 => 0.7814, std.dev.: 0.0175) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 29.03% (0.0062 => 0.0080, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 15:18:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 17:18:42 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121115231842.3CE072A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5913?compare_to=5911&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5913, Order: 168091, Start Time: 2012-11-15 21:53:58, End Time: 2012-11-15 23:19:01 To: 5911, Order: 168074, Start Time: 2012-11-15 20:04:15, End Time: 2012-11-15 21:29:17 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 1 (180 on baseline) Unchanged Tests: 1041 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.48% (56.5767 => 54.6102, std.dev.: 0.4169) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.79% (2.0478 => 2.1050, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: 2.40% (7.4937 => 7.6736, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hash2: 2.12% (3.1932 => 3.2608, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.03% (0.3821 => 0.3514, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -7.15% (2.4924 => 2.3141, std.dev.: 0.0077) MultiSource/Applications/sgefa/sgefa: -6.79% (0.3357 => 0.3129, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.79% (0.9542 => 0.8894, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.51% (0.2428 => 0.2270, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.43% (0.3142 => 0.2940, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.29% (0.1796 => 0.1683, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -6.25% (16.1920 => 15.1805, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.20% (0.6484 => 0.6082, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -6.11% (0.9179 => 0.8618, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -6.11% (9.2283 => 8.6649, std.dev.: 0.0226) MultiSource/Applications/JM/ldecod/ldecod: -6.07% (7.0961 => 6.6656, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.04% (1.0544 => 0.9907, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.03% (0.2355 => 0.2213, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.00% (1.3722 => 1.2899, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.98% (0.9852 => 0.9263, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: -5.96% (0.1879 => 0.1767, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.91% (0.1761 => 0.1657, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.90% (0.2695 => 0.2536, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.86% (1.6364 => 1.5405, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.82% (0.3658 => 0.3445, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.79% (1.2300 => 1.1588, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.75% (4.0323 => 3.8006, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.74% (0.7198 => 0.6785, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.72% (3.5339 => 3.3316, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.72% (0.6681 => 0.6299, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -5.69% (1.1450 => 1.0798, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.69% (1.4642 => 1.3809, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.67% (4.8161 => 4.5429, std.dev.: 0.0110) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.67% (6.7716 => 6.3878, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.66% (4.5069 => 4.2519, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.65% (0.6052 => 0.5710, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.64% (0.6736 => 0.6356, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -5.64% (0.3406 => 0.3214, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.63% (0.5863 => 0.5533, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.63% (4.8802 => 4.6056, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/05-eks/eks: -5.63% (0.4515 => 0.4261, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.62% (0.5591 => 0.5277, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.60% (0.5857 => 0.5529, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.58% (0.5805 => 0.5481, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.57% (0.6230 => 0.5883, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.57% (0.5802 => 0.5479, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: -5.56% (1.1530 => 1.0889, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: -5.53% (1.3864 => 1.3097, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.53% (0.5859 => 0.5535, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.53% (0.6293 => 0.5945, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -5.49% (4.3330 => 4.0950, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.49% (0.5925 => 0.5600, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.48% (1.2784 => 1.2084, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.47% (0.6395 => 0.6045, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.46% (0.5478 => 0.5179, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.45% (0.5575 => 0.5271, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.45% (0.6660 => 0.6297, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -5.45% (1.2515 => 1.1833, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.43% (0.5705 => 0.5395, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -5.43% (17.1032 => 16.1740, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.40% (0.6260 => 0.5922, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.40% (0.3483 => 0.3295, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.37% (14.2083 => 13.4458, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.36% (0.6676 => 0.6318, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.36% (0.5688 => 0.5383, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.33% (0.5849 => 0.5537, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.31% (0.7339 => 0.6949, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.31% (0.6446 => 0.6104, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -5.29% (0.2985 => 0.2827, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.27% (0.6395 => 0.6058, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -5.26% (0.3896 => 0.3691, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.26% (0.5570 => 0.5277, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.26% (0.5456 => 0.5169, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: -5.26% (0.4033 => 0.3821, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.25% (0.5941 => 0.5629, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: -5.25% (0.3581 => 0.3393, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.25% (1.2210 => 1.1569, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.23% (0.6667 => 0.6318, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.23% (0.7919 => 0.7505, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -5.22% (0.3812 => 0.3613, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.21% (0.5581 => 0.5290, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.21% (0.7524 => 0.7132, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions: -5.20% (0.4176 => 0.3959, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: -5.17% (0.3848 => 0.3649, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.17% (0.3891 => 0.3690, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.16% (8.0126 => 7.5990, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/08-main/main: -5.15% (0.2659 => 0.2522, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.14% (0.2548 => 0.2417, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.14% (1.2221 => 1.1593, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.13% (0.4916 => 0.4664, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.12% (0.6033 => 0.5724, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.12% (0.5567 => 0.5282, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/exceptions-4: -5.10% (0.3880 => 0.3682, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: -5.08% (3.5154 => 3.3367, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.05% (0.6440 => 0.6115, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: -5.04% (0.3831 => 0.3638, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.03% (0.2385 => 0.2265, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: -5.02% (15.5079 => 14.7295, std.dev.: 0.0190) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.01% (0.8521 => 0.8094, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.00% (0.2278 => 0.2164, std.dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: -4.99% (15.2527 => 14.4909, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.97% (0.3884 => 0.3691, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.91% (0.3319 => 0.3156, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.91% (0.4199 => 0.3993, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.88% (1.6474 => 1.5670, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.87% (0.7447 => 0.7084, std.dev.: 0.0012) MultiSource/Applications/lua/lua: -4.82% (4.0594 => 3.8637, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.82% (0.5999 => 0.5710, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.80% (0.5168 => 0.4920, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.73% (0.6194 => 0.5901, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.63% (0.6304 => 0.6012, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/parameter-passing: -4.63% (0.4280 => 0.4082, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -4.63% (2.1401 => 2.0411, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -4.62% (1.3148 => 1.2540, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -4.61% (2.4021 => 2.2913, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.60% (0.5329 => 0.5084, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.57% (0.6297 => 0.6009, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.57% (0.7021 => 0.6700, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.57% (22.4056 => 21.3823, std.dev.: 0.0198) MultiSource/Benchmarks/McCat/09-vor/vor: -4.56% (0.3271 => 0.3122, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.53% (5.0226 => 4.7952, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.48% (0.4151 => 0.3965, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.44% (0.6189 => 0.5914, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: -4.38% (0.8418 => 0.8049, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -4.37% (0.7982 => 0.7633, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.35% (2.2587 => 2.1604, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.35% (0.3931 => 0.3760, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.33% (0.3837 => 0.3671, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.30% (0.2999 => 0.2870, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: -4.29% (0.3194 => 0.3057, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -4.24% (0.3255 => 0.3117, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.21% (0.3016 => 0.2889, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -4.20% (0.3025 => 0.2898, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.19% (0.2933 => 0.2810, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.17% (2.1713 => 2.0807, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.16% (0.9557 => 0.9159, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -4.16% (18.2933 => 17.5316, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/fibo: -4.14% (0.2871 => 0.2752, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.12% (0.3252 => 0.3118, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: -4.10% (0.7779 => 0.7460, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.09% (0.3057 => 0.2932, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.08% (0.6347 => 0.6088, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -4.06% (0.3026 => 0.2903, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.06% (0.2903 => 0.2785, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -4.01% (0.2989 => 0.2869, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -3.99% (34.0927 => 32.7321, std.dev.: 0.2961) SingleSource/Benchmarks/Shootout-C++/random: -3.98% (0.2939 => 0.2822, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -3.97% (0.2849 => 0.2736, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wc: -3.96% (0.3205 => 0.3078, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.96% (0.6441 => 0.6186, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -3.96% (0.3059 => 0.2938, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -3.95% (0.4861 => 0.4669, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.95% (0.4813 => 0.4623, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: -3.92% (0.3394 => 0.3261, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -3.92% (0.3446 => 0.3311, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -3.90% (0.3867 => 0.3716, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.90% (0.9077 => 0.8723, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: -3.86% (0.4248 => 0.4084, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.85% (0.4083 => 0.3926, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -3.78% (0.3621 => 0.3484, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -3.76% (0.3481 => 0.3350, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.74% (0.3849 => 0.3705, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.58% (0.3491 => 0.3366, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.57% (0.4427 => 0.4269, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -3.56% (0.4524 => 0.4363, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -3.45% (0.6750 => 0.6517, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.31% (0.3323 => 0.3213, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.21% (5.4682 => 5.2924, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: -3.06% (0.3788 => 0.3672, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -2.98% (1.5610 => 1.5145, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.82% (0.4321 => 0.4199, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -1.84% (20.7746 => 20.3925, std.dev.: 0.0233) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.52% (7.5137 => 5.7462, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/richards_benchmark: -8.66% (1.2842 => 1.1730, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.81% (2.2633 => 2.1770, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4724, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0001) Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 15:19:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 17:19:25 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121115231925.78B382A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5914?compare_to=5906&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5914, Order: 168064, Start Time: 2012-11-15 20:03:54, End Time: 2012-11-15 23:19:44 To: 5906, Order: 168042, Start Time: 2012-11-15 16:00:19, End Time: 2012-11-15 19:15:58 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (170 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (721 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.23% (125.2665 => 129.3074, std.dev.: 1.1102) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.49% (1.5946 => 1.6184, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.40% (0.0625 => 0.0890, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.21% (0.1063 => 0.1416, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.97% (0.2969 => 0.3740, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.86% (0.1106 => 0.1392, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.11% (0.4253 => 0.5321, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.74% (0.4139 => 0.5163, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 24.71% (1.5932 => 1.9869, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.65% (0.0714 => 0.0890, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.45% (0.4994 => 0.6165, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.44% (0.5900 => 0.7283, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.29% (0.0584 => 0.0720, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.98% (0.5000 => 0.6149, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: 22.04% (0.0599 => 0.0731, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.74% (0.0897 => 0.1092, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.73% (0.1620 => 0.1972, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.65% (0.1021 => 0.1242, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.59% (0.1107 => 0.1346, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.85% (0.0633 => 0.0765, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.70% (0.0541 => 0.0653, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 20.57% (0.0948 => 0.1143, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.56% (0.0642 => 0.0774, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.38% (0.0584 => 0.0703, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.22% (0.1103 => 0.1326, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.04% (0.1003 => 0.1204, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: 20.03% (0.0604 => 0.0725, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.01% (0.1549 => 0.1859, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.01% (0.1604 => 0.1925, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.98% (0.3903 => 0.4683, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/health/health: 19.98% (0.0821 => 0.0985, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.83% (0.0822 => 0.0985, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 19.77% (0.1619 => 0.1939, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.95% (0.1462 => 0.1739, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 18.94% (0.0808 => 0.0961, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.71% (0.2736 => 0.3248, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 18.64% (0.1218 => 0.1445, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.59% (0.0947 => 0.1123, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.32% (0.2014 => 0.2383, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.30% (0.3890 => 0.4602, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 18.24% (0.4029 => 0.4764, std.dev.: 0.0047) SingleSource/UnitTests/ObjC++/Hello: 18.21% (0.5826 => 0.6887, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.13% (1.3152 => 1.5537, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: 17.85% (0.5889 => 0.6940, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 17.77% (0.0698 => 0.0822, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.65% (0.1088 => 0.1280, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 17.61% (0.1505 => 0.1770, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 17.45% (0.5546 => 0.6514, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.34% (0.2866 => 0.3363, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.19% (0.0605 => 0.0709, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 16.94% (1.8794 => 2.1978, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.87% (1.6211 => 1.8946, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 16.82% (0.7171 => 0.8377, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.72% (0.3271 => 0.3818, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.68% (3.5627 => 4.1569, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.66% (0.4658 => 0.5434, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.57% (0.1968 => 0.2294, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.29% (0.1160 => 0.1349, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 16.19% (0.1421 => 0.1651) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.18% (0.5026 => 0.5839, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 16.09% (1.0781 => 1.2516, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 16.08% (0.9697 => 1.1256, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.03% (0.2738 => 0.3177, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.98% (0.4361 => 0.5058, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.83% (0.2875 => 0.3330, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 15.81% (0.1284 => 0.1487, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.75% (0.3930 => 0.4549, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.65% (2.7292 => 3.1563, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.60% (4.4195 => 5.1090, std.dev.: 0.0051) MultiSource/Applications/ClamAV/clamscan: 15.48% (4.2109 => 4.8629, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.37% (0.2792 => 0.3221, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.32% (1.9694 => 2.2711, std.dev.: 0.0057) MultiSource/Benchmarks/Bullet/bullet: 15.24% (23.5202 => 27.1042, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/fibo: 15.16% (0.2725 => 0.3138, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 15.14% (0.9909 => 1.1409, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.14% (0.1090 => 0.1255, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 15.07% (0.2714 => 0.3123, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.02% (0.2729 => 0.3139, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 15.02% (0.2750 => 0.3163, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 15.00% (0.2813 => 0.3235, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 14.93% (0.2780 => 0.3195, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 14.81% (0.3004 => 0.3449, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 14.81% (0.2803 => 0.3218, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.79% (1.9966 => 2.2918, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 14.77% (0.2823 => 0.3240, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 14.69% (0.2811 => 0.3224, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 14.63% (0.3096 => 0.3549, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.60% (0.2911 => 0.3336, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.58% (2.0673 => 2.3688, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 14.50% (0.2566 => 0.2938, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 14.46% (0.2075 => 0.2375, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.40% (0.3195 => 0.3655, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 14.35% (1.4269 => 1.6316, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 14.27% (0.3496 => 0.3995, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 14.26% (0.3267 => 0.3733, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 14.20% (0.3465 => 0.3957, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.16% (0.3362 => 0.3838, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 14.15% (0.3258 => 0.3719, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 14.10% (0.3446 => 0.3932, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.08% (0.3488 => 0.3979, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.08% (0.3460 => 0.3947, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.01% (0.3469 => 0.3955, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.97% (0.3442 => 0.3923, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 13.93% (0.3317 => 0.3779, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 13.84% (0.7875 => 0.8965, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 13.78% (0.3650 => 0.4153, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 13.66% (0.3726 => 0.4235, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.57% (0.3124 => 0.3548, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 13.53% (0.3643 => 0.4136, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.53% (0.3060 => 0.3474, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 13.51% (0.3678 => 0.4175, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 13.51% (0.4146 => 0.4706, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 13.51% (0.3724 => 0.4227, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 13.46% (2.1653 => 2.4568, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists: 13.44% (0.3348 => 0.3798, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.32% (0.3625 => 0.4108, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 13.26% (0.3477 => 0.3938, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.25% (0.3282 => 0.3717, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.24% (0.3845 => 0.4354, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.21% (0.3981 => 0.4507, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 13.15% (4.6177 => 5.2248, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.95% (0.3690 => 0.4168, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 12.87% (0.4251 => 0.4798, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 12.76% (2.1013 => 2.3695, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.70% (0.2040 => 0.2299, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 12.27% (0.5012 => 0.5627, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 12.26% (0.2691 => 0.3021, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 12.22% (5.5417 => 6.2188, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.77% (0.1028 => 0.1149, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.45% (0.6435 => 0.7172, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 11.26% (0.6634 => 0.7381, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 10.89% (0.3498 => 0.3879, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.85% (0.1383 => 0.1533, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.78% (0.2068 => 0.2291, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 10.63% (0.4847 => 0.5362, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.60% (0.2737 => 0.3027, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 10.49% (0.3336 => 0.3686, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.34% (0.3084 => 0.3403, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 10.20% (0.2391 => 0.2635, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 9.94% (2.0346 => 2.2369, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.94% (0.2103 => 0.2312, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.21% (0.5361 => 0.5855, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.88% (4.6926 => 5.1094, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.87% (11.6398 => 12.6722, std.dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.65% (0.5584 => 0.6067, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.56% (0.7426 => 0.8062, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 6.50% (11.9555 => 12.7326, std.dev.: 0.0075) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.67% (0.3792 => 0.3969, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0300, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 10.56% (0.2802 => 0.3098, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6087, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 6.27% (0.2122 => 0.2255, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6699, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/flops-2: 4.81% (1.8057 => 1.8925, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1686, std.dev.: 0.0079) SingleSource/Benchmarks/Dhrystone/dry: 4.21% (14.0481 => 14.6391, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2006, std.dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.80% (3.1722 => 3.2292, std.dev.: 0.0017) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3055, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.37% (7.1849 => 7.2835, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5388, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5786, std.dev.: 0.0367) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5610, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/ary2: -8.91% (0.2402 => 0.2188, std.dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9752, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7899, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8065, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.13% (0.6293 => 0.6096, std.dev.: 0.0033) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7729, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.53% (17.2379 => 16.8023, std.dev.: 0.0646) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.26% (41.7953 => 40.8524, std.dev.: 0.0120) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5774, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4957, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1795, std.dev.: 0.0282) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0447, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 16:12:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 18:12:34 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121116001234.70BC12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5915?compare_to=5909&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5915, Order: 168087, Start Time: 2012-11-15 22:00:42, End Time: 2012-11-16 00:12:52 To: 5909, Order: 168051, Start Time: 2012-11-15 18:58:30, End Time: 2012-11-15 21:10:04 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 40 (172 on baseline) Performance Improvements: 16 (39 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 982 (676 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 20.16% (0.4032 => 0.4845, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.21% (0.4677 => 0.5295, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/lists: 13.01% (0.3789 => 0.4282, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hello: 12.48% (0.2956 => 0.3325, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/strcat: 12.47% (0.3096 => 0.3482, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/lists1: 12.38% (0.4070 => 0.4574, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/matrix: 12.33% (0.3367 => 0.3782, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.28% (0.3012 => 0.3382, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.27% (0.1051 => 0.1180, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 11.61% (1.3315 => 1.4861, std.dev.: 0.0101) SingleSource/UnitTests/SignlessTypes/rem: 11.11% (0.1260 => 0.1400, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.85% (0.1041 => 0.1154, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.84% (0.3182 => 0.3527, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.71% (0.6201 => 0.6865, std.dev.: 0.0125) SingleSource/UnitTests/ObjC++/property-reference: 10.09% (0.8035 => 0.8846, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.55% (1.5982 => 1.7508, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 9.42% (0.1497 => 0.1638, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.21% (0.2422 => 0.2645, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.14% (0.2592 => 0.2829, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/distray/distray: 9.11% (0.1536 => 0.1676, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference-object: 8.93% (0.6664 => 0.7259, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops: 8.67% (0.1984 => 0.2156, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.07% (0.4040 => 0.4366, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.82% (0.7841 => 0.8454, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.28% (0.2897 => 0.3079, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.71% (5.0026 => 5.2882, std.dev.: 0.0772) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.69% (0.4992 => 0.5276, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.28% (0.6844 => 0.7137, std.dev.: 0.0110) MultiSource/Benchmarks/PAQ8p/paq8p: 3.18% (11.4147 => 11.7782, std.dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.42% (12.1838 => 12.4790, std.dev.: 0.0196) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 12.82% (7.8230 => 8.8261, std.dev.: 0.1668) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 11.29% (6.3458 => 7.0620, std.dev.: 0.2205) MultiSource/Benchmarks/Olden/bisort/bisort: 10.95% (0.8658 => 0.9606, std.dev.: 0.0248) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 9.38% (0.3433 => 0.3755, std.dev.: 0.0121) SingleSource/Benchmarks/CoyoteBench/lpbench: 7.52% (11.4657 => 12.3283, std.dev.: 0.3007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 7.03% (0.2289 => 0.2450, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/strcat: 6.31% (0.1934 => 0.2056, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.46% (0.5787 => 0.6045, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/puzzle: 4.39% (0.7584 => 0.7917, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.64% (3.7833 => 3.8453, std.dev.: 0.0176) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/messages-2: -14.30% (0.0902 => 0.0773, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -9.58% (0.4842 => 0.4378, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.50% (0.1126 => 0.1019, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/parameter-passing: -9.37% (0.4899 => 0.4440, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.88% (1.3377 => 1.2323, std.dev.: 0.0351) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -7.72% (0.7833 => 0.7228, std.dev.: 0.0210) MultiSource/Applications/sqlite3/sqlite3: -3.44% (20.5546 => 19.8471, std.dev.: 0.2283) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.69% (0.4089 => 0.3979, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -2.14% (18.7344 => 18.3341, std.dev.: 0.1114) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench: -18.73% (2.5910 => 2.1056, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout/ary3: -16.08% (4.4592 => 3.7422, std.dev.: 0.1046) MultiSource/Applications/minisat/minisat: -7.83% (11.6750 => 10.7607, std.dev.: 0.2931) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -6.87% (0.2140 => 0.1993, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/hash: -6.72% (5.4948 => 5.1258, std.dev.: 0.1402) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.56% (17.3303 => 16.7138, std.dev.: 0.2304) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.55% (89.1381 => 87.7538, std.dev.: 0.5074) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -1.91% (0.1364 => 0.1338, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0420 => 0.0420, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.61% (0.0651 => 0.0681, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 0.02% (494.0031 => 494.0844, std.dev.: 0.3299) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/power/power: 43713.46% (1.1277 => 494.0844, std.dev.: 0.3299) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.05% (0.5229 => 1.5376, std.dev.: 0.1036) MultiSource/Applications/SPASS/SPASS: 22.31% (14.9895 => 18.3341, std.dev.: 0.1114) MultiSource/Applications/kimwitu++/kc: 48.49% (14.1553 => 21.0189, std.dev.: 0.4086) MultiSource/Benchmarks/MallocBench/gs/gs: 19.05% (4.1105 => 4.8934, std.dev.: 0.1208) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.73% (1.1048 => 1.5106, std.dev.: 0.0804) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 433.92% (7.1582 => 38.2190, std.dev.: 0.2835) SingleSource/Benchmarks/Misc-C++-EH/spirit: 81.00% (3.4629 => 6.2678, std.dev.: 0.2182) SingleSource/Benchmarks/Misc-C++/stepanov_container: 87.80% (0.6222 => 1.1685, std.dev.: 0.0089) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10647.64% (0.0720 => 7.7383, std.dev.: 0.2152) MultiSource/Applications/SIBsim4/SIBsim4: 3869200.00% (0.0001 => 3.8693, std.dev.: 0.0336) MultiSource/Applications/SPASS/SPASS: 15018100.00% (0.0001 => 15.0182, std.dev.: 0.1271) MultiSource/Applications/kimwitu++/kc: 53600.00% (0.0001 => 0.0537, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 604400.00% (0.0001 => 0.6045, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10090800.00% (0.0001 => 10.0909, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5890500.00% (0.0001 => 5.8906, std.dev.: 0.5938) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1784.62% (1.1194 => 21.0964, std.dev.: 0.2426) MultiSource/Applications/ClamAV/clamscan: 69.29% (22.1758 => 37.5425, std.dev.: 0.2493) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 60.60% (7.0540 => 11.3290, std.dev.: 0.0576) MultiSource/Benchmarks/FreeBench/distray/distray: 58.71% (0.1056 => 0.1676, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 58.55% (2.9384 => 4.6589, std.dev.: 0.3312) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 53.37% (8.1363 => 12.4790, std.dev.: 0.0196) SingleSource/Benchmarks/Misc/flops: 50.56% (0.1432 => 0.2156, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 47.02% (21.9371 => 32.2523, std.dev.: 0.2674) SingleSource/UnitTests/vla: 41.41% (0.0355 => 0.0502, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/almabench: 38.49% (0.0730 => 0.1011, std.dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/dry: 32.89% (0.0456 => 0.0606, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 32.31% (0.1566 => 0.2072, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 32.20% (0.0528 => 0.0698, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 31.96% (0.1236 => 0.1631, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/dot-syntax-1: 31.32% (0.0479 => 0.0629, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 30.51% (0.0672 => 0.0877, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/family/family: 29.22% (0.0397 => 0.0513, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 28.98% (0.1125 => 0.1451, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 28.59% (0.4103 => 0.5276, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 27.88% (0.2758 => 0.3527, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: 27.23% (0.0481 => 0.0612, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Oscar: 26.89% (0.0636 => 0.0807, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/wordfreq: 26.88% (0.3307 => 0.4196, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/puzzle: 26.72% (0.0408 => 0.0517, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 26.65% (0.6675 => 0.8454, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C++/life/life: 26.47% (0.0933 => 0.1180, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 26.34% (0.0953 => 0.1204, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/FloatMM: 26.18% (0.0401 => 0.0506, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 25.98% (0.4203 => 0.5295, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 25.53% (0.2107 => 0.2645, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 25.52% (1.1840 => 1.4861, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/lists: 25.13% (0.3422 => 0.4282, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash: 24.88% (0.4289 => 0.5356, std.dev.: 0.0083) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 24.57% (0.2271 => 0.2829, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/lpbench: 24.22% (0.0929 => 0.1154, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 24.16% (0.3684 => 0.4574, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/espresso/espresso: 24.00% (4.2646 => 5.2882, std.dev.: 0.0772) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 23.79% (0.4615 => 0.5713, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 23.62% (0.3650 => 0.4512, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 23.28% (0.3162 => 0.3898, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/sumcol: 23.21% (0.2891 => 0.3562, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/whetstone: 23.18% (0.0660 => 0.0813, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 23.11% (0.0437 => 0.0538, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_isamax: 23.01% (0.0704 => 0.0866, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 23.00% (0.2831 => 0.3482, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/Large/ray: 22.91% (0.4064 => 0.4995, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/hash: 22.89% (0.0485 => 0.0596, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 22.71% (0.2756 => 0.3382, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/health/health: 22.71% (0.1268 => 0.1556, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/wc: 22.64% (0.3052 => 0.3743, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 22.60% (0.1695 => 0.2078, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/hello: 22.51% (0.2714 => 0.3325, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/methcall: 22.49% (0.2877 => 0.3524, std.dev.: 0.0016) SingleSource/UnitTests/SignlessTypes/rem: 22.38% (0.1144 => 0.1400, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: 22.37% (0.0818 => 0.1001, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 22.12% (0.2554 => 0.3119, std.dev.: 0.0188) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (0.3098 => 0.3782, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.65% (14.3668 => 17.4770, std.dev.: 0.1721) SingleSource/Benchmarks/Shootout-C++/moments: 21.47% (0.4048 => 0.4917, std.dev.: 0.0060) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 21.21% (0.1584 => 0.1920, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.88% (2.2024 => 2.6622, std.dev.: 0.0981) MultiSource/Benchmarks/Olden/tsp/tsp: 20.85% (0.1175 => 0.1420, std.dev.: 0.0075) SingleSource/UnitTests/ObjC++/property-reference: 20.75% (0.7326 => 0.8846, std.dev.: 0.0043) MultiSource/Applications/minisat/minisat: 20.67% (0.7115 => 0.8586, std.dev.: 0.0330) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 20.48% (0.2065 => 0.2488, std.dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 20.41% (0.1906 => 0.2295, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference-object: 20.38% (0.6030 => 0.7259, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary: 19.74% (0.3232 => 0.3870, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/bisort/bisort: 19.71% (0.0614 => 0.0735, std.dev.: 0.0038) MultiSource/Applications/lua/lua: 19.48% (3.8723 => 4.6266, std.dev.: 0.1287) SingleSource/Benchmarks/Misc/oourafft: 19.41% (0.3282 => 0.3919, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 19.33% (0.5981 => 0.7137, std.dev.: 0.0110) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.30% (0.2700 => 0.3221, std.dev.: 0.0196) MultiSource/Benchmarks/mafft/pairlocalalign: 18.98% (9.4845 => 11.2845, std.dev.: 0.0583) MultiSource/Applications/d/make_dparser: 18.38% (3.3354 => 3.9486, std.dev.: 0.1434) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.33% (0.8067 => 0.9546, std.dev.: 0.0307) MultiSource/Applications/oggenc/oggenc: 18.33% (5.7591 => 6.8148, std.dev.: 0.1666) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 18.29% (0.2603 => 0.3079, std.dev.: 0.0062) SingleSource/UnitTests/initp1: 18.02% (0.0555 => 0.0655, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.58% (0.0842 => 0.0990, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.09% (0.8172 => 0.9569, std.dev.: 0.0360) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.99% (0.0871 => 0.1019, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.92% (0.1117 => 0.1306, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/messages-2: 16.77% (0.0662 => 0.0773, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 16.55% (3.8922 => 4.5362, std.dev.: 0.2189) MultiSource/Benchmarks/Olden/mst/mst: 16.34% (0.1163 => 0.1353, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/exceptions-2: 16.04% (0.3497 => 0.4058, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.84% (0.0770 => 0.0892, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.80% (0.0886 => 0.1026, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: 15.52% (17.1811 => 19.8471, std.dev.: 0.2283) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.36% (5.0018 => 5.7701, std.dev.: 0.0777) MultiSource/Applications/hexxagon/hexxagon: 15.19% (1.2842 => 1.4793, std.dev.: 0.0530) MultiSource/Applications/viterbi/viterbi: 15.11% (0.1555 => 0.1790, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.11% (4.9449 => 5.6920, std.dev.: 0.1162) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.87% (0.0834 => 0.0958, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.81% (0.0770 => 0.0884, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.79% (0.0730 => 0.0838, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 14.73% (0.5925 => 0.6798, std.dev.: 0.0201) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.51% (0.3121 => 0.3574, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/hash2: 14.50% (0.4620 => 0.5290, std.dev.: 0.0218) SingleSource/UnitTests/ObjC/block-byref-aggr: 14.38% (0.3817 => 0.4366, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.36% (0.1337 => 0.1529, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.19% (0.1029 => 0.1175, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.16% (0.0798 => 0.0911, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/exptree: 14.00% (0.0814 => 0.0928, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 13.80% (63.2438 => 71.9687, std.dev.: 0.1560) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.68% (0.9765 => 1.1101, std.dev.: 0.0518) MultiSource/Benchmarks/PAQ8p/paq8p: 13.61% (10.3673 => 11.7782, std.dev.: 0.0180) SingleSource/UnitTests/ObjC/parameter-passing: 13.06% (0.3927 => 0.4440, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.92% (1.5859 => 1.7908, std.dev.: 0.0662) SingleSource/UnitTests/ObjC/property: 12.66% (0.3886 => 0.4378, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.48% (0.3543 => 0.3985, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/ary2: 12.46% (0.3379 => 0.3800, std.dev.: 0.0150) SingleSource/UnitTests/ObjC/exceptions-3: 12.43% (0.3516 => 0.3953, std.dev.: 0.0156) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.31% (0.3543 => 0.3979, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.17% (0.3828 => 0.4294, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.10% (0.8101 => 0.9081, std.dev.: 0.0113) SingleSource/UnitTests/ObjC/for-in: 12.07% (0.3694 => 0.4140, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 12.07% (0.1044 => 0.1170, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.68% (0.1695 => 0.1893, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.89% (0.1892 => 0.2098, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.55% (1.4186 => 1.5683, std.dev.: 0.0412) MultiSource/Benchmarks/sim/sim: 10.07% (0.3387 => 0.3728, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.15% (0.3826 => 0.4176, std.dev.: 0.0049) SingleSource/Regression/C++/ofstream_ctor: 9.12% (0.2905 => 0.3170, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 8.95% (0.2871 => 0.3128, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.22% (0.2872 => 0.3108, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.27% (7.9617 => 8.3020, std.dev.: 0.1219) SingleSource/UnitTests/Vector/constpool: 3.75% (54.1659 => 56.1993, std.dev.: 0.5232) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.77% (4.3953 => 11.0222, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 147.59% (5.3999 => 13.3697, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 24.37% (13.4384 => 16.7138, std.dev.: 0.2304) SingleSource/Benchmarks/Shootout-C++/moments: 22.86% (0.1159 => 0.1424, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 22.41% (1.3045 => 1.5968, std.dev.: 0.0298) SingleSource/Benchmarks/CoyoteBench/lpbench: 19.16% (10.3460 => 12.3283, std.dev.: 0.3007) MultiSource/Applications/minisat/minisat: 18.04% (9.1159 => 10.7607, std.dev.: 0.2931) SingleSource/Benchmarks/Misc/oourafft: 17.52% (6.6465 => 7.8110, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.68% (1.1145 => 1.3004, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/bisort/bisort: 15.28% (0.8333 => 0.9606, std.dev.: 0.0248) SingleSource/Benchmarks/BenchmarkGame/puzzle: 13.72% (0.6962 => 0.7917, std.dev.: 0.0111) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.94% (0.2944 => 0.3325, std.dev.: 0.0138) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.65% (2.8904 => 3.2271, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 10.29% (1.1396 => 1.2569, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.49% (1.7254 => 1.8891, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/strcat: 8.27% (0.1899 => 0.2056, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 7.03% (0.7455 => 0.7979, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash2: 6.76% (3.1578 => 3.3712, std.dev.: 0.0629) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.98% (4.2280 => 4.4807, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.65% (3.6395 => 3.8453, std.dev.: 0.0176) SingleSource/Regression/C/uint64_to_float: 5.06% (0.5413 => 0.5687, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 4.93% (26.0924 => 27.3780, std.dev.: 0.1943) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 4.49% (0.9505 => 0.9932, std.dev.: 0.0085) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6436 => 12.1334, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.77% (1.7133 => 1.7779, std.dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.42% (2.0360 => 2.1056, std.dev.: 0.0102) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: 2.75% (2.4116 => 2.4778, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 2.08% (3.1595 => 3.2253, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 2.08% (85.0658 => 86.8322, std.dev.: 0.0297) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.83% (2.1424 => 2.1817, std.dev.: 0.0094) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (27.8444 => 28.2721, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout/sieve: 1.49% (5.2139 => 5.2914, std.dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/fldry: 1.41% (1.9577 => 1.9853, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists: 1.32% (12.5348 => 12.7002, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/sieve: 1.31% (2.4858 => 2.5183, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.30% (6.5088 => 6.5936, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0505, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1677, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.64% (5.2763 => 1.2323, std.dev.: 0.0351) SingleSource/Benchmarks/Misc/salsa20: -75.16% (0.8651 => 0.2149, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: -37.48% (0.1622 => 0.1014, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.50% (5.3855 => 4.9279, std.dev.: 0.0744) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.44% (5.3526 => 4.9011, std.dev.: 0.0856) MultiSource/Applications/JM/ldecod/ldecod: -7.89% (10.4361 => 9.6132, std.dev.: 0.1732) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.95% (0.3987 => 0.2394, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.92% (0.0506 => 0.0304, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.28% (4.5009 => 2.7778, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -33.54% (1.1492 => 0.7638, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.09% (2.6546 => 2.0151, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -19.25% (0.2161 => 0.1745, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -17.59% (10.7105 => 8.8261, std.dev.: 0.1668) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4249, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2842, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.71% (32.5116 => 29.0281, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -9.45% (9.5636 => 8.6602, std.dev.: 0.1676) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4244, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.93% (4.8142 => 4.4806, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.79% (3.2416 => 3.0215, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.61% (2.7294 => 2.5762, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5076, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/lists: -4.26% (6.2999 => 6.0315, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.35% (19.9488 => 19.2799, std.dev.: 0.2528) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.23% (0.9957 => 0.9635, std.dev.: 0.0069) MultiSource/Benchmarks/sim/sim: -3.08% (5.0483 => 4.8927, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.41% (0.4808 => 0.4692, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.83% (8.1563 => 8.0070, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6776, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -1.44% (10.2830 => 10.1353, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.82% (0.2116 => 0.0681, std.dev.: 0.0003) Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 16:56:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 18:56:40 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121116005640.B7CA72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5916?compare_to=5912&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5916, Order: 168110, Start Time: 2012-11-15 23:26:33, End Time: 2012-11-16 00:57:00 To: 5912, Order: 168087, Start Time: 2012-11-15 21:35:19, End Time: 2012-11-15 23:07:19 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 6 (107 on baseline) Performance Improvements: 7 (22 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 979 (845 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.81% (0.8282 => 0.8432, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.79% (0.6539 => 0.6656, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.56% (0.8541 => 0.8674, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 4.91% (21.6024 => 22.6635, std.dev.: 0.3207) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 2.76% (3.9825 => 4.0924, std.dev.: 0.0388) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 1.81% (0.6012 => 0.6121, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.61% (0.2976 => 0.2809, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.59% (1.7287 => 1.6493, std.dev.: 0.0294) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.14% (0.2562 => 0.2456, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.52% (0.9006 => 0.8779, std.dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.11% (0.3619 => 0.3434, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.16% (1.2971 => 1.2691, std.dev.: 0.0068) MultiSource/Benchmarks/llubenchmark/llu: -1.64% (2.0322 => 1.9989, std.dev.: 0.0079) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -1.09% (17.0429 => 16.8578, std.dev.: 0.0863) MultiSource/Applications/obsequi/Obsequi: -2.94% (1.0882 => 1.0562, std.dev.: 0.0139) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.00% (22.1678 => 21.9470, std.dev.: 1.1599) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.25% (0.3670 => 0.3661, std.dev.: 0.1113) SingleSource/Benchmarks/Misc-C++/bigfib: 0.59% (0.6261 => 0.6298, std.dev.: 0.0427) SingleSource/Benchmarks/Shootout-C++/reversefile: -1.01% (0.3379 => 0.3345, std.dev.: 0.0544) SingleSource/Benchmarks/Shootout-C++/strcat: -1.38% (0.2024 => 0.1996, std.dev.: 0.0394) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0218 => 0.0218, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0427 => 0.0429, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.35% (0.0340 => 0.0332, std.dev.: 0.0101) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0313 => 0.0313, std.dev.: 0.0085) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.23% (0.0428 => 0.0429, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0206 => 0.0205, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 0.46% (0.0216 => 0.0217, std.dev.: 0.0065) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.15% (0.1488 => 0.1520, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: -6.51% (1.1884 => 1.1110, std.dev.: 0.0705) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.73% (0.4212 => 0.4097, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.28% (0.1405 => 0.1401, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.31% (0.0644 => 0.0642, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 4.51% (0.0266 => 0.0278, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.12% (0.0605 => 0.0642, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.21% (1.1964 => 1.1989, std.dev.: 0.0535) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.00% (0.0651 => 0.0638, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.61% (0.0267 => 0.0236, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.79% (0.7814 => 0.7752, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 200.00% (0.0001 => 0.0003, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 38.75% (0.0080 => 0.0111, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2407.60% (0.6332 => 15.8781, std.dev.: 0.3484) MultiSource/Benchmarks/McCat/08-main/main: 47.35% (0.1831 => 0.2698, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.61% (0.1559 => 0.1456, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1602.33% (0.3344 => 5.6926, std.dev.: 0.2282) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.37% (0.2364 => 0.3271, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/mandel: 4.43% (0.0429 => 0.0448, std.dev.: 0.0055) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.59% (0.0224 => 0.0241, std.dev.: 0.0077) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 11.76% (0.1462 => 0.1634, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4738, std.dev.: 0.0398) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0687, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4935, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3429, std.dev.: 0.0420) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1734, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4090, std.dev.: 0.0323) SingleSource/Regression/C/uint64_to_float: -23.96% (2.1832 => 1.6600, std.dev.: 0.0389) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.75% (0.0810 => 0.0970, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.61% (0.0830 => 0.0943, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 12.94% (0.0773 => 0.0873, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 12.59% (0.1112 => 0.1252, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.09% (0.2279 => 0.2509, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.02% (0.4847 => 0.5284, std.dev.: 0.0050) MultiSource/Applications/viterbi/viterbi: 8.81% (0.1577 => 0.1716, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.74% (0.6010 => 0.6535, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.67% (0.2180 => 0.2369, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.30% (3.1832 => 3.4474, std.dev.: 0.0272) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.19% (0.3137 => 0.3394, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.03% (0.8321 => 0.8989, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.88% (0.7473 => 0.8062, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.74% (0.8148 => 0.8779, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.69% (1.5315 => 1.6493, std.dev.: 0.0294) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.50% (0.1466 => 0.1576, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.34% (2.1401 => 2.2972, std.dev.: 0.0433) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.25% (0.3295 => 0.3534, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.99% (0.3003 => 0.3213, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.95% (0.1885 => 0.2016, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.93% (0.1905 => 0.2037, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 6.65% (14.2605 => 15.2089, std.dev.: 0.2714) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.63% (1.1606 => 1.2375, std.dev.: 0.0202) MultiSource/Benchmarks/Olden/em3d/em3d: 6.28% (0.1721 => 0.1829, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.25% (1.1685 => 1.2415, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.91% (0.5961 => 0.6313, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.90% (0.2998 => 0.3175, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.87% (0.6287 => 0.6656, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.80% (0.2519 => 0.2665, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.71% (0.9435 => 0.9974, std.dev.: 0.0054) MultiSource/Applications/siod/siod: 5.67% (2.2184 => 2.3441, std.dev.: 0.0403) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.22% (0.2240 => 0.2357, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.16% (0.2133 => 0.2243, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.50% (0.8697 => 0.9088, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.29% (0.4127 => 0.4304, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.28% (0.8086 => 0.8432, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.27% (0.4783 => 0.4987, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.24% (1.2526 => 1.3057, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.12% (0.8331 => 0.8674, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.05% (6.6074 => 6.8750, std.dev.: 0.0595) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.04% (0.8656 => 0.9006, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.02% (0.5817 => 0.6051, std.dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: 3.95% (6.7320 => 6.9981, std.dev.: 0.0406) MultiSource/Benchmarks/MallocBench/gs/gs: 3.89% (4.1305 => 4.2911, std.dev.: 0.0384) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.89% (4.1763 => 4.3386, std.dev.: 0.0195) MultiSource/Applications/SIBsim4/SIBsim4: 3.87% (1.2568 => 1.3054, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.78% (0.8050 => 0.8354, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.74% (0.9908 => 1.0279, std.dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.47% (0.6227 => 0.6443, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 3.34% (0.8885 => 0.9182, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.33% (4.4873 => 4.6369, std.dev.: 0.0345) MultiSource/Benchmarks/nbench/nbench: 3.30% (1.1271 => 1.1643, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.30% (0.9039 => 0.9337, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.20% (0.8007 => 0.8263, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.20% (0.9074 => 0.9364, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.19% (0.8611 => 0.8886, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.19% (8.6476 => 8.9237, std.dev.: 0.0443) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.17% (0.3717 => 0.3835, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.16% (0.8597 => 0.8869, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.15% (1.6386 => 1.6902, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.09% (0.8177 => 0.8430, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/18-imp/imp: 3.05% (0.3503 => 0.3610, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.98% (4.4880 => 4.6218, std.dev.: 0.0223) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.93% (0.8261 => 0.8503, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.92% (4.5702 => 4.7036, std.dev.: 0.0472) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.88% (0.9056 => 0.9317, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.86% (13.1811 => 13.5585, std.dev.: 0.1275) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.85% (0.9688 => 0.9964, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.75% (0.8048 => 0.8269, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.68% (0.8518 => 0.8746, std.dev.: 0.0076) MultiSource/Applications/lambda-0_1_3/lambda: 2.62% (0.7557 => 0.7755, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/football/football: 2.10% (0.8768 => 0.8952, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 132.16% (0.0199 => 0.0462, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/pi: 58.81% (1.5795 => 2.5084, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 18.17% (0.7597 => 0.8977, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.39% (2.9753 => 3.4629, std.dev.: 0.0631) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.45% (2.7995 => 3.2039, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6085, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 8.66% (2.2485 => 2.4433, std.dev.: 0.0666) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.31% (1.1857 => 1.2842, std.dev.: 0.0218) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.78% (0.3186 => 0.3434, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/queens: 7.51% (1.7056 => 1.8337, std.dev.: 0.0294) MultiSource/Applications/SIBsim4/SIBsim4: 7.10% (3.1873 => 3.4136, std.dev.: 0.0280) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.73% (4.7794 => 5.1010, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.91% (4.9686 => 5.2624, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.89% (4.5327 => 4.7995, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.10% (59.2638 => 62.2844, std.dev.: 1.1115) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.62% (3.3761 => 3.5320, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.57% (6.2275 => 6.5122, std.dev.: 0.0068) MultiSource/Applications/lambda-0_1_3/lambda: 4.34% (7.4933 => 7.8184, std.dev.: 0.0811) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.25% (4.9469 => 5.1571, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.20% (4.9453 => 5.1528, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 4.00% (14.0064 => 14.5672, std.dev.: 0.0438) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.94% (0.5889 => 0.6121, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.57% (0.3587 => 0.3715, std.dev.: 0.0035) MultiSource/Applications/siod/siod: 3.42% (3.6643 => 3.7897, std.dev.: 0.0197) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.87% (1.2337 => 1.2691, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.82% (11.5690 => 11.8950, std.dev.: 0.0297) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 2.52% (3.9917 => 4.0924, std.dev.: 0.0388) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.09% (1.1365 => 1.1602, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.03% (8.2783 => 8.4462, std.dev.: 0.0322) SingleSource/Benchmarks/Stanford/FloatMM: 1.53% (0.8807 => 0.8942, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/neural/neural: 1.34% (1.0841 => 1.0986, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.31% (2.4647 => 2.4970, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: 1.24% (1.2061 => 1.2211, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.15% (1.5941 => 1.6125, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.05% (3.5679 => 3.6052, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.13% (5.4641 => 4.3094, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.26% (7.2130 => 6.3284, std.dev.: 0.2367) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.81% (1.0512 => 0.9376, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: -9.70% (1.1216 => 1.0128, std.dev.: 0.0192) MultiSource/Benchmarks/mafft/pairlocalalign: -8.55% (63.1822 => 57.7805, std.dev.: 0.1966) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.08% (14.6451 => 13.4616, std.dev.: 0.0433) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.94% (4.7482 => 4.4189, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.86% (5.4972 => 5.1752, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.73% (3.7148 => 3.5019, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.16% (5.1557 => 4.8899, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.46% (4.7449 => 4.5333, std.dev.: 0.0286) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.78% (2.8773 => 2.7684, std.dev.: 0.0336) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.73% (6.0224 => 5.7980, std.dev.: 0.0118) MultiSource/Applications/lua/lua: -3.13% (29.8330 => 28.8992, std.dev.: 0.0899) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (28.5821 => 27.6939, std.dev.: 0.1955) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.21% (2.6356 => 2.5774, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.10% (9.9065 => 9.6984, std.dev.: 0.0799) SingleSource/Benchmarks/Shootout-C++/hash2: -2.10% (3.4237 => 3.3518, std.dev.: 0.0213) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.01% (11.5316 => 11.3002, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.85% (2.3487 => 2.3052, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.54% (4.9994 => 4.9224, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.27% (5.6343 => 5.5630, std.dev.: 0.0115) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.50% (16.4461 => 16.8578, std.dev.: 0.0863) MultiSource/Applications/obsequi/Obsequi: 2.92% (1.0262 => 1.0562, std.dev.: 0.0139) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6927.54% (0.3123 => 21.9470, std.dev.: 1.1599) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.64% (0.2463 => 0.3661, std.dev.: 0.1113) SingleSource/Benchmarks/Misc-C++/bigfib: 4.79% (0.6010 => 0.6298, std.dev.: 0.0427) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.42% (0.3266 => 0.3345, std.dev.: 0.0544) SingleSource/Benchmarks/Shootout-C++/strcat: 1.37% (0.1969 => 0.1996, std.dev.: 0.0394) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.15% (0.0408 => 0.0429, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0101) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0085) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.72% (0.0384 => 0.0429, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0065) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 100.00% (0.0007 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.70% (0.1438 => 0.1520, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: -1.93% (1.1329 => 1.1110, std.dev.: 0.0705) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.61% (0.4164 => 0.4097, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.34% (0.1369 => 0.1401, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.16% (0.0641 => 0.0642, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.56% (0.0195 => 0.0278, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 11.07% (0.0578 => 0.0642, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.83% (1.1437 => 1.1989, std.dev.: 0.0535) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.75% (0.0627 => 0.0638, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.11% (0.0180 => 0.0236, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.31% (0.8017 => 0.7752, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 200.00% (0.0001 => 0.0003, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 79.03% (0.0062 => 0.0111, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 17:07:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 19:07:03 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121116010703.109362A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5917?compare_to=5913&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5917, Order: 168110, Start Time: 2012-11-15 23:41:59, End Time: 2012-11-16 01:07:22 To: 5913, Order: 168091, Start Time: 2012-11-15 21:53:58, End Time: 2012-11-15 23:19:01 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (178 on baseline) Unchanged Tests: 1041 (859 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.51% (0.3747 => 0.3916, std.dev.: 0.0062) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.06% (2.0478 => 2.1104, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: 2.27% (7.4937 => 7.6640, std.dev.: 0.0238) SingleSource/Benchmarks/Shootout-C++/hash2: 2.24% (3.1932 => 3.2648, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.09% (1.5103 => 1.5267, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.33% (0.3821 => 0.3541, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.16% (2.4924 => 2.3139, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -6.82% (0.3357 => 0.3128, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.71% (0.9542 => 0.8902, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.52% (0.3142 => 0.2937, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.51% (0.2428 => 0.2270, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: -6.20% (0.2160 => 0.2026, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -6.20% (16.1920 => 15.1888, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.18% (0.1796 => 0.1685, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.08% (0.6484 => 0.6090, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -6.07% (9.2283 => 8.6678, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/ReedSolomon: -6.07% (0.1879 => 0.1765, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: -6.06% (0.9179 => 0.8623, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: -6.05% (7.0961 => 6.6667, std.dev.: 0.0157) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.99% (0.2355 => 0.2214, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.96% (1.0544 => 0.9916, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.91% (0.9852 => 0.9270, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.90% (0.3658 => 0.3442, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.88% (1.3722 => 1.2915, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.86% (0.2695 => 0.2537, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -5.85% (0.1761 => 0.1658, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.85% (1.6364 => 1.5407, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.81% (3.5339 => 3.3286, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.80% (4.8161 => 4.5366, std.dev.: 0.0049) MultiSource/Applications/lemon/lemon: -5.76% (1.1450 => 1.0790, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.73% (0.5863 => 0.5527, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.71% (1.4642 => 1.3806, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.71% (4.0323 => 3.8021, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.71% (0.5591 => 0.5272, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -5.70% (0.3406 => 0.3212, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.64% (4.8802 => 4.6050, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.62% (4.5069 => 4.2536, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.62% (0.6052 => 0.5712, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.60% (0.6230 => 0.5881, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.60% (1.2300 => 1.1611, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.60% (0.5805 => 0.5480, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.59% (0.5478 => 0.5172, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: -5.57% (4.3330 => 4.0918, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.56% (0.5859 => 0.5533, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: -5.56% (1.1530 => 1.0889, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.56% (0.6660 => 0.6290, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.53% (0.7198 => 0.6800, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.52% (0.5705 => 0.5390, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.52% (0.5925 => 0.5598, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.50% (0.6395 => 0.6043, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: -5.49% (0.4515 => 0.4267, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: -5.49% (1.3864 => 1.3103, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.48% (0.6293 => 0.5948, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.48% (0.6736 => 0.6367, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.47% (1.2784 => 1.2085, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.47% (0.6676 => 0.6311, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.46% (0.6681 => 0.6316, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.45% (0.5575 => 0.5271, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.43% (0.5802 => 0.5487, std.dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: -5.42% (17.1032 => 16.1754, std.dev.: 0.0157) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.42% (6.7716 => 6.4048, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.40% (0.6667 => 0.6307, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.40% (0.8521 => 0.8061, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.37% (0.3483 => 0.3296, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.37% (0.6260 => 0.5924, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.34% (0.5857 => 0.5544, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.33% (14.2083 => 13.4511, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.33% (0.5688 => 0.5385, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.32% (0.5581 => 0.5284, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.31% (0.7339 => 0.6949, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.31% (1.2210 => 1.1562, std.dev.: 0.0057) MultiSource/Applications/Burg/burg: -5.29% (1.2515 => 1.1853, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.26% (0.5570 => 0.5277, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.25% (0.6395 => 0.6059, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.24% (0.5569 => 0.5277, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.22% (0.5456 => 0.5171, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.22% (0.5941 => 0.5631, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.21% (1.2221 => 1.1584, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.21% (0.7524 => 0.7132, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.18% (0.5849 => 0.5546, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.18% (0.2278 => 0.2160, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.16% (0.5567 => 0.5280, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.15% (0.7919 => 0.7511, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.15% (0.6446 => 0.6114, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.14% (8.0126 => 7.6006, std.dev.: 0.0088) SingleSource/UnitTests/ObjC/trivial-interface: -5.14% (0.3812 => 0.3616, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -5.11% (0.2659 => 0.2523, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.11% (0.6033 => 0.5725, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.10% (0.2548 => 0.2418, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -5.10% (3.5154 => 3.3362, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.08% (0.6440 => 0.6113, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -5.05% (0.4176 => 0.3965, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.03% (0.4033 => 0.3830, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.02% (0.3848 => 0.3655, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -5.01% (15.5079 => 14.7302, std.dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.00% (0.4916 => 0.4670, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: -5.00% (0.3880 => 0.3686, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.98% (0.5999 => 0.5700, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.97% (0.3884 => 0.3691, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.96% (0.3831 => 0.3641, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.95% (0.2385 => 0.2267, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.93% (0.2999 => 0.2851, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.93% (0.3891 => 0.3699, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/synchronized: -4.93% (0.3896 => 0.3704, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.90% (15.2527 => 14.5052, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.90% (1.6474 => 1.5667, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.81% (0.6194 => 0.5896, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: -4.81% (0.7447 => 0.7089, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -4.78% (2.4021 => 2.2872, std.dev.: 0.0016) MultiSource/Applications/lua/lua: -4.73% (4.0594 => 3.8672, std.dev.: 0.0136) SingleSource/UnitTests/ObjC/property: -4.72% (0.4199 => 0.4001, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.68% (0.5168 => 0.4926, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.67% (5.0226 => 4.7880, std.dev.: 0.0068) MultiSource/Applications/hexxagon/hexxagon: -4.66% (1.3148 => 1.2535, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: -4.64% (0.3581 => 0.3415, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.62% (0.5329 => 0.5083, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.59% (0.6297 => 0.6008, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -4.52% (0.3271 => 0.3123, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.51% (22.4056 => 21.3942, std.dev.: 0.0085) MultiSource/Applications/treecc/treecc: -4.51% (2.1401 => 2.0435, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.50% (0.7021 => 0.6705, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.49% (0.4280 => 0.4088, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.44% (0.6189 => 0.5914, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.43% (0.3837 => 0.3667, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -4.40% (0.7982 => 0.7631, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.36% (2.2587 => 2.1603, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.34% (0.3319 => 0.3175, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.34% (0.4151 => 0.3971, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.32% (0.3931 => 0.3761, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -4.30% (0.3255 => 0.3115, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -4.30% (0.3025 => 0.2895, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -4.29% (0.2985 => 0.2857, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -4.26% (0.3194 => 0.3058, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.25% (0.3057 => 0.2927, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.21% (0.3016 => 0.2889, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.20% (2.1713 => 2.0800, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.19% (0.2933 => 0.2810, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -4.15% (18.2933 => 17.5350, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/fibo: -4.14% (0.2871 => 0.2752, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -4.13% (0.7779 => 0.7458, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.11% (0.9557 => 0.9164, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/except: -4.10% (0.3026 => 0.2902, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -4.10% (0.6347 => 0.6087, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/moments: -4.07% (0.4248 => 0.4075, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.06% (0.2903 => 0.2785, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -4.05% (0.3059 => 0.2935, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -4.05% (0.2939 => 0.2820, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -4.04% (0.8418 => 0.8078, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -4.03% (0.3446 => 0.3307, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -4.01% (34.0927 => 32.7261, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/hello: -4.00% (0.2849 => 0.2735, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.99% (0.4813 => 0.4621, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -3.98% (0.3394 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -3.95% (0.2989 => 0.2871, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -3.94% (0.6441 => 0.6187, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -3.93% (0.3205 => 0.3079, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -3.93% (0.4861 => 0.4670, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -3.91% (0.3481 => 0.3345, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -3.90% (0.3867 => 0.3716, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -3.87% (0.3621 => 0.3481, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.78% (0.3252 => 0.3129, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.77% (0.3849 => 0.3704, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.68% (0.4427 => 0.4264, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -3.67% (0.4524 => 0.4358, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/bigfib: -3.63% (0.6750 => 0.6505, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.58% (0.3491 => 0.3366) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.58% (0.4083 => 0.3937, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.40% (0.3323 => 0.3210, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: -3.30% (0.3788 => 0.3663, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.29% (5.4682 => 5.2883, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: -3.01% (1.5610 => 1.5140, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.68% (0.4321 => 0.4205, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -1.61% (20.7746 => 20.4401, std.dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7518, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1732, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: -3.91% (2.2633 => 2.1747, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.70% (6.5735 => 6.4618, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 19:38:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 21:38:37 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121116033837.9BF582A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5918?compare_to=5916&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5918, Order: 168126, Start Time: 2012-11-16 02:10:47, End Time: 2012-11-16 03:38:57 To: 5916, Order: 168110, Start Time: 2012-11-15 23:26:33, End Time: 2012-11-16 00:57:00 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 7 (90 on baseline) Performance Improvements: 6 (27 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 979 (857 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.95% (0.8139 => 0.8298, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.70% (1.4773 => 1.5024, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 1.70% (1.0016 => 1.0186, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 95.16% (0.0124 => 0.0242, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.03% (0.3025 => 0.3147, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/random: 2.27% (2.4220 => 2.4771, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.41% (13.4616 => 13.6514, std.dev.: 0.0139) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.85% (5.6926 => 5.4735, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.28% (0.9006 => 0.8891, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -6.97% (22.6635 => 21.0844, std.dev.: 0.4763) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.60% (4.7142 => 4.5447, std.dev.: 0.0395) MultiSource/Benchmarks/Prolangs-C++/primes/primes: -1.58% (0.8977 => 0.8835, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (2.5774 => 2.5516, std.dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.55% (16.8578 => 16.9507, std.dev.: 0.7690) MultiSource/Applications/obsequi/Obsequi: -0.63% (1.0562 => 1.0495, std.dev.: 0.0145) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.60% (21.9470 => 22.2988, std.dev.: 1.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.49% (0.3661 => 0.3679, std.dev.: 0.0693) SingleSource/Benchmarks/Misc-C++/bigfib: -2.11% (0.6298 => 0.6165, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.42% (0.3345 => 0.3359, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/strcat: 1.40% (0.1996 => 0.2024, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.46% (0.0218 => 0.0219, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0429 => 0.0428, std.dev.: 0.0146) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0332 => 0.0333, std.dev.: 0.0106) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.96% (0.0313 => 0.0316, std.dev.: 0.0107) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.47% (0.0429 => 0.0427, std.dev.: 0.0128) SingleSource/UnitTests/Vector/Altivec/casts: -0.98% (0.0205 => 0.0203, std.dev.: 0.0065) SingleSource/UnitTests/Vector/Altivec/test1: -30.88% (0.0217 => 0.0150, std.dev.: 0.0076) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -3.16% (0.1520 => 0.1472, std.dev.: 0.0086) MultiSource/Applications/kimwitu++/kc: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 6.90% (1.1110 => 1.1877, std.dev.: 0.0121) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.64% (0.4097 => 0.4205, std.dev.: 0.2119) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.14% (0.1401 => 0.1371, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.16% (0.0642 => 0.0641, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -21.22% (0.0278 => 0.0219, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -14.95% (0.0642 => 0.0546, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.26% (1.1989 => 1.1958, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -70.37% (0.0027 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.55% (0.0638 => 0.0609, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 12.71% (0.0236 => 0.0266, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.32% (0.7752 => 0.7727, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: -66.67% (0.0003 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/SignlessTypes/Large/cast: -28.83% (0.0111 => 0.0079, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2325.08% (0.6332 => 15.3556, std.dev.: 0.5146) MultiSource/Benchmarks/McCat/08-main/main: 45.33% (0.1831 => 0.2661, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.02% (0.1559 => 0.1434, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1536.81% (0.3344 => 5.4735, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.03% (0.2364 => 0.3263, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: 0.23% (0.0429 => 0.0430, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.70% (0.0224 => 0.0239, std.dev.: 0.0077) SingleSource/UnitTests/byval-alignment: -27.83% (0.0230 => 0.0166, std.dev.: 0.0064) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 12.24% (0.1462 => 0.1641, std.dev.: 0.0266) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4579, std.dev.: 0.0280) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0747, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4914, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3141, std.dev.: 0.0363) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1357, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4087, std.dev.: 0.0091) SingleSource/Regression/C/uint64_to_float: -23.86% (2.1832 => 1.6622, std.dev.: 0.0115) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.02% (0.0810 => 0.0956, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.80% (0.0848 => 0.0965, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 13.49% (0.1112 => 0.1262, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.71% (0.7473 => 0.8049, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.02% (0.2279 => 0.2439, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.76% (0.1983 => 0.2117, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.75% (0.4847 => 0.5174, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.49% (0.3295 => 0.3509, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.47% (0.2180 => 0.2321, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.25% (0.1905 => 0.2024, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.87% (0.6010 => 0.6363, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.57% (0.5961 => 0.6293, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.37% (0.9435 => 0.9942, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.60% (0.3003 => 0.3141, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.55% (0.8069 => 0.8436, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.55% (0.3124 => 0.3266, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.53% (0.4127 => 0.4314, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 4.42% (0.8204 => 0.8567, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.42% (0.6586 => 0.6877, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.24% (0.3115 => 0.3247, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.24% (0.8050 => 0.8391, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: 4.22% (0.2985 => 0.3111, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.17% (0.7966 => 0.8298, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.14% (0.3717 => 0.3871, std.dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.92% (6.6074 => 6.8664, std.dev.: 0.0535) MultiSource/Applications/hexxagon/hexxagon: 3.83% (0.9810 => 1.0186, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.81% (0.5191 => 0.5389, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.76% (1.4479 => 1.5024, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.63% (0.8611 => 0.8924, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.60% (0.8331 => 0.8631, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.56% (0.8286 => 0.8581, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.49% (0.8340 => 0.8631, std.dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 3.48% (1.1271 => 1.1663, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.47% (4.1763 => 4.3211, std.dev.: 0.0323) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.44% (0.8697 => 0.8996, std.dev.: 0.0086) MultiSource/Benchmarks/PAQ8p/paq8p: 3.29% (2.3764 => 2.4546, std.dev.: 0.0274) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.20% (0.9039 => 0.9328, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.14% (4.4873 => 4.6281, std.dev.: 0.0339) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.13% (13.1811 => 13.5941, std.dev.: 0.0669) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.12% (0.8457 => 0.8721, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.09% (0.8855 => 0.9129, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/gs/gs: 3.03% (4.1305 => 4.2555, std.dev.: 0.0415) MultiSource/Benchmarks/Prolangs-C/football/football: 2.99% (0.8768 => 0.9030, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.90% (0.8177 => 0.8414, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.77% (0.9074 => 0.9325, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.75% (0.8885 => 0.9129, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.72% (1.1170 => 1.1474, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.71% (0.8656 => 0.8891, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.62% (0.9908 => 1.0168, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.57% (0.8716 => 0.8940, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.53% (0.8261 => 0.8470, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.52% (0.8359 => 0.8570, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.32% (0.9069 => 0.9279, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.31% (0.8927 => 0.9133, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.29% (0.8066 => 0.8251, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.21% (0.9056 => 0.9256, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.94% (0.8048 => 0.8204, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.76% (0.8995 => 0.9153, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.75% (1.2602 => 1.2822, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 122.11% (0.0199 => 0.0442, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/pi: 57.18% (1.5795 => 2.4826, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.58% (2.9753 => 3.4687, std.dev.: 0.0662) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.30% (0.7597 => 0.8835, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.40% (2.7995 => 3.2026, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.61% (5.0261 => 5.6094, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.25% (0.3186 => 0.3449, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.98% (1.1857 => 1.2803, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 7.48% (1.7056 => 1.8332, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.07% (6.3772 => 6.8278, std.dev.: 0.1344) SingleSource/Benchmarks/Misc/richards_benchmark: 6.87% (1.3037 => 1.3932, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.80% (4.7794 => 5.1043, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.92% (4.9686 => 5.2629, std.dev.: 0.0110) MultiSource/Applications/SIBsim4/SIBsim4: 5.85% (3.1873 => 3.3739, std.dev.: 0.0488) MultiSource/Applications/lambda-0_1_3/lambda: 5.16% (7.4933 => 7.8799, std.dev.: 0.1113) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.69% (3.3761 => 3.5345, std.dev.: 0.0236) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.59% (6.2275 => 6.5133, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.22% (4.9453 => 5.1542, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.91% (4.9469 => 5.1404, std.dev.: 0.0086) MultiSource/Applications/hexxagon/hexxagon: 3.85% (14.0064 => 14.5463, std.dev.: 0.0391) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.46% (1.2337 => 1.2764, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.85% (11.5690 => 11.8985, std.dev.: 0.0618) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.51% (4.8660 => 4.9882, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/lists: 2.28% (7.3375 => 7.5051, std.dev.: 0.0318) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.26% (1.1365 => 1.1622, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.25% (4.8362 => 4.9448, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.22% (8.2783 => 8.4619, std.dev.: 0.0224) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.46% (2.5763 => 2.6138, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/ReedSolomon: 1.43% (8.5322 => 8.6543, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/neural/neural: 1.33% (1.0841 => 1.0985, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.14% (3.5679 => 3.6086, std.dev.: 0.0097) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -37.28% (0.0338 => 0.0212, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/em3d/em3d: -20.98% (5.4641 => 4.3175, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.01% (7.2130 => 6.2028, std.dev.: 0.3373) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.94% (1.0512 => 0.9362, std.dev.: 0.0083) SingleSource/Benchmarks/McGill/chomp: -10.18% (1.1216 => 1.0074, std.dev.: 0.0089) MultiSource/Benchmarks/mafft/pairlocalalign: -8.53% (63.1822 => 57.7925, std.dev.: 0.4463) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.86% (4.7482 => 4.4223, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.79% (14.6451 => 13.6514, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.42% (0.3269 => 0.3059, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.93% (3.7148 => 3.4944, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.86% (5.4972 => 5.1751, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.15% (5.1557 => 4.8903, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.34% (4.7449 => 4.5391, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.82% (6.0224 => 5.7923, std.dev.: 0.0018) MultiSource/Applications/lua/lua: -3.22% (29.8330 => 28.8720, std.dev.: 0.2038) MultiSource/Benchmarks/Prolangs-C++/life/life: -3.19% (2.6356 => 2.5516, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (28.5821 => 27.7018, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.94% (0.5807 => 0.5636, std.dev.: 0.0041) MultiSource/Applications/aha/aha: -2.43% (3.3398 => 3.2588, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.42% (2.4490 => 2.3897, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.36% (9.9065 => 9.6728, std.dev.: 0.0575) MultiSource/Benchmarks/FreeBench/mason/mason: -2.33% (0.5415 => 0.5289, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: -2.13% (3.4237 => 3.3507, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.00% (11.5316 => 11.3008, std.dev.: 0.0846) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.57% (4.9994 => 4.9210, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.41% (2.3487 => 2.3155, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.19% (5.6343 => 5.5672, std.dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 3.07% (16.4461 => 16.9507, std.dev.: 0.7690) MultiSource/Applications/obsequi/Obsequi: 2.27% (1.0262 => 1.0495, std.dev.: 0.0145) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7040.19% (0.3123 => 22.2988, std.dev.: 1.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.37% (0.2463 => 0.3679, std.dev.: 0.0693) SingleSource/Benchmarks/Misc-C++/bigfib: 2.58% (0.6010 => 0.6165, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.85% (0.3266 => 0.3359, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/strcat: 2.79% (0.1969 => 0.2024, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0146) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0106) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0107) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.20% (0.0384 => 0.0427, std.dev.: 0.0128) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0065) SingleSource/UnitTests/Vector/Altivec/test1: -16.67% (0.0180 => 0.0150, std.dev.: 0.0076) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.36% (0.1438 => 0.1472, std.dev.: 0.0086) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 4.84% (1.1329 => 1.1877, std.dev.: 0.0121) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.98% (0.4164 => 0.4205, std.dev.: 0.2119) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.15% (0.1369 => 0.1371, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0641 => 0.0641, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.31% (0.0195 => 0.0219, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.54% (0.0578 => 0.0546, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.56% (1.1437 => 1.1958, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -42.86% (0.0014 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.87% (0.0627 => 0.0609, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.62% (0.8017 => 0.7727, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/SignlessTypes/Large/cast: 27.42% (0.0062 => 0.0079, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 19:41:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 21:41:21 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121116034121.CCB5C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5919?compare_to=5917&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5919, Order: 168126, Start Time: 2012-11-16 02:16:39, End Time: 2012-11-16 03:41:41 To: 5917, Order: 168110, Start Time: 2012-11-15 23:41:59, End Time: 2012-11-16 01:07:22 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (4 on baseline) Performance Improvements: 1 (176 on baseline) Unchanged Tests: 1039 (862 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.67% (1.2603 => 1.2939, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.65% (78.0411 => 80.1068, std.dev.: 0.4888) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -8.09% (0.3916 => 0.3599, std.dev.: 0.0075) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.16% (2.0478 => 2.1125, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/salsa20: 2.55% (7.4937 => 7.6847, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/hash2: 1.89% (3.1932 => 3.2536, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.01% (0.3821 => 0.3515, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -7.21% (2.4924 => 2.3128, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.76% (0.3357 => 0.3130, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.63% (0.2428 => 0.2267, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.59% (0.9542 => 0.8913, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: -6.51% (0.3812 => 0.3564, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.46% (0.3142 => 0.2939, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.38% (0.6484 => 0.6070, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -6.35% (0.4033 => 0.3777, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.29% (0.1796 => 0.1683, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: -6.29% (0.3880 => 0.3636, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.23% (0.3884 => 0.3642, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.21% (0.3896 => 0.3654, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.21% (0.3848 => 0.3609, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.17% (0.3891 => 0.3651, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -6.16% (0.3831 => 0.3595, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.15% (0.4176 => 0.3919, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -6.13% (16.1920 => 15.1990, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/BoolLiteralTest: -6.13% (0.3834 => 0.3599, std.dev.: 0.0075) MultiSource/Benchmarks/mafft/pairlocalalign: -6.08% (9.2283 => 8.6669, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/chomp: -6.08% (0.1761 => 0.1654, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -6.07% (0.1879 => 0.1765, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: -6.06% (0.9179 => 0.8623, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.04% (1.0544 => 0.9907, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: -6.04% (7.0961 => 6.6676, std.dev.: 0.0151) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.03% (0.2355 => 0.2213, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: -6.02% (0.2160 => 0.2030, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.96% (0.3658 => 0.3440, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: -5.93% (0.4199 => 0.3950, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.89% (0.1716 => 0.1615, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.87% (0.9852 => 0.9274, std.dev.: 0.0107) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.86% (0.2695 => 0.2537, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.80% (4.8161 => 4.5370, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.77% (1.4642 => 1.3797, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.76% (1.2300 => 1.1591, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.76% (1.3722 => 1.2932, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.75% (3.5339 => 3.3307, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.75% (4.5069 => 4.2478, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.73% (4.8802 => 4.6004, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: -5.71% (1.1450 => 1.0796, std.dev.: 0.0040) MultiSource/Benchmarks/sim/sim: -5.70% (0.3406 => 0.3212, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: -5.66% (1.1530 => 1.0877, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.65% (4.0323 => 3.8043, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/parameter-passing: -5.65% (0.4280 => 0.4038, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.65% (1.6364 => 1.5439, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.63% (0.5591 => 0.5276, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.63% (0.5863 => 0.5533, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.63% (0.6681 => 0.6305, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.63% (0.6293 => 0.5939, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.60% (0.5859 => 0.5531, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.59% (6.7716 => 6.3929, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.57% (0.6230 => 0.5883, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.57% (0.6052 => 0.5715, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.53% (0.7198 => 0.6800, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.52% (1.2784 => 1.2078, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.51% (0.5478 => 0.5176, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -5.50% (1.2515 => 1.1827, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: -5.49% (4.3330 => 4.0951, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.44% (0.5805 => 0.5489, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.43% (0.5925 => 0.5603, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.43% (0.3483 => 0.3294, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.42% (17.1032 => 16.1756, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.42% (0.6260 => 0.5921, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.41% (0.6395 => 0.6049, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.40% (0.5688 => 0.5381, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.40% (14.2083 => 13.4416, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.39% (0.5802 => 0.5489, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.38% (0.5705 => 0.5398, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.38% (0.6676 => 0.6317, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.37% (0.6736 => 0.6374, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.37% (0.7524 => 0.7120, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.36% (0.5575 => 0.5276, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.35% (0.7339 => 0.6946, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.35% (0.6667 => 0.6310, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.35% (0.8521 => 0.8065, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.35% (0.6660 => 0.6304, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.34% (1.2210 => 1.1558, std.dev.: 0.0036) MultiSource/Applications/SIBsim4/SIBsim4: -5.34% (1.3864 => 1.3124, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.30% (0.5456 => 0.5167, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: -5.28% (0.3581 => 0.3392, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.27% (0.6446 => 0.6106, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.27% (0.5581 => 0.5287, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -5.26% (0.2985 => 0.2828, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.25% (0.7919 => 0.7503, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.25% (8.0126 => 7.5917, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.25% (0.5567 => 0.5275, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.24% (0.6395 => 0.6060, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.23% (0.5941 => 0.5630, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.23% (0.5569 => 0.5278, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -5.17% (3.5154 => 3.3336, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.17% (0.4916 => 0.4662, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.15% (0.5570 => 0.5283, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: -5.15% (0.2659 => 0.2522, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.15% (0.5849 => 0.5548, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.14% (0.2548 => 0.2417, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: -5.14% (0.4515 => 0.4283, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.13% (1.2221 => 1.1594, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.12% (0.6440 => 0.6110, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.10% (0.2999 => 0.2846, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.09% (0.6033 => 0.5726, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.07% (0.2385 => 0.2264, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.06% (0.3319 => 0.3151, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.00% (0.2278 => 0.2164, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -4.98% (15.5079 => 14.7353, std.dev.: 0.0071) MultiSource/Applications/ClamAV/clamscan: -4.97% (15.2527 => 14.4944, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.97% (0.5999 => 0.5701, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -4.86% (4.0594 => 3.8620, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.78% (1.6474 => 1.5686, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.78% (0.7447 => 0.7091, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.74% (0.5168 => 0.4923, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -4.65% (2.1401 => 2.0405, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.65% (0.6194 => 0.5906, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -4.63% (2.4021 => 2.2908, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.63% (0.6304 => 0.6012, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -4.62% (0.3271 => 0.3120, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.61% (0.6297 => 0.6007, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -4.53% (0.7779 => 0.7427, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.49% (0.7021 => 0.6706, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -4.49% (5.0226 => 4.7973, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.48% (0.6189 => 0.5912, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.47% (22.4056 => 21.4041, std.dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.35% (0.5329 => 0.5097, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.28% (2.2587 => 2.1621, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: -4.27% (1.3148 => 1.2586, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -4.27% (0.7982 => 0.7641, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: -4.24% (0.6347 => 0.6078, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -4.23% (0.8418 => 0.8062, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -4.13% (0.6441 => 0.6175, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.09% (0.4813 => 0.4616, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.05% (0.4151 => 0.3983, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: -4.01% (18.2933 => 17.5594, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.97% (0.3931 => 0.3775, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.91% (0.9557 => 0.9183, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -3.86% (34.0927 => 32.7751, std.dev.: 0.0205) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.83% (0.3837 => 0.3690, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.80% (0.9077 => 0.8732, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: -3.77% (0.3025 => 0.2911, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -3.75% (0.3255 => 0.3133, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -3.73% (0.3194 => 0.3075, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: -3.70% (0.4861 => 0.4681, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.70% (2.1713 => 2.0910, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.66% (0.3252 => 0.3133, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.61% (0.3016 => 0.2907, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.58% (0.3323 => 0.3204, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.57% (0.3057 => 0.2948, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -3.55% (0.4248 => 0.4097, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.52% (0.3491 => 0.3368, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: -3.50% (0.3026 => 0.2920, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -3.45% (0.3481 => 0.3361, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -3.44% (0.3867 => 0.3734, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -3.42% (0.3621 => 0.3497, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.41% (0.2933 => 0.2833, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.40% (0.3849 => 0.3718, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -3.40% (0.3446 => 0.3329, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -3.38% (0.4524 => 0.4371, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: -3.37% (0.3059 => 0.2956, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -3.27% (0.3394 => 0.3283, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.25% (0.4427 => 0.4283, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -3.20% (0.6750 => 0.6534, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.19% (5.4682 => 5.2936, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.16% (0.4083 => 0.3954, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -3.15% (0.3205 => 0.3104, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: -2.77% (0.3788 => 0.3683, std.dev.: 0.0034) MultiSource/Applications/hbd/hbd: -2.60% (1.5610 => 1.5204, std.dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -1.79% (20.7746 => 20.4019, std.dev.: 0.0276) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7499, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: -8.61% (1.2842 => 1.1736) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.93% (1.7753 => 1.7056, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: -3.85% (2.2633 => 2.1762, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4727, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.20% (1.3096 => 1.2939, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0000) Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 20:52:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 22:52:27 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121116045227.537EA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5920?compare_to=5915&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5920, Order: 168126, Start Time: 2012-11-16 02:42:03, End Time: 2012-11-16 04:52:46 To: 5915, Order: 168087, Start Time: 2012-11-15 22:00:42, End Time: 2012-11-16 00:12:52 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 37 (147 on baseline) Performance Improvements: 14 (40 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 987 (700 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 17.82% (0.1650 => 0.1944, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.83% (0.1179 => 0.1342, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 12.86% (0.5792 => 0.6537, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/heapsort: 12.84% (0.3108 => 0.3507, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 12.71% (2.5962 => 2.9261, std.dev.: 0.0511) MultiSource/Benchmarks/Prolangs-C++/office/office: 12.50% (0.3369 => 0.3790, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.86% (0.6343 => 0.7095, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.47% (0.4176 => 0.4655, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 11.41% (1.5683 => 1.7472, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/sieve: 11.03% (0.3981 => 0.4420, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.84% (0.3221 => 0.3570, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.83% (1.1101 => 1.2303, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.77% (0.3574 => 0.3959, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 10.07% (0.8558 => 0.9420, std.dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.81% (1.4825 => 1.6280, std.dev.: 0.0129) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.80% (0.2663 => 0.2924, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.14% (0.4310 => 0.4704, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.08% (0.3689 => 0.4024, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.91% (2.3323 => 2.5168, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.19% (1.3275 => 1.4229, std.dev.: 0.0187) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.60% (2.6622 => 2.8380, std.dev.: 0.0358) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.24% (1.5106 => 1.6048, std.dev.: 0.0239) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.88% (0.3079 => 0.3260, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.58% (0.2488 => 0.2602, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.43% (5.7701 => 6.0255, std.dev.: 0.0494) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.93% (0.7285 => 0.7571, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.52% (4.9011 => 5.0737, std.dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: 2.69% (6.8148 => 6.9978, std.dev.: 0.0652) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.32% (21.0964 => 21.3740, std.dev.: 0.0858) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.06% (17.4770 => 17.6623, std.dev.: 0.0291) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 100.09% (4.2286 => 8.4611, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/synchronized: 51.24% (0.1091 => 0.1650, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/ary3: 20.27% (3.7872 => 4.5548, std.dev.: 0.2375) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 18.62% (0.0854 => 0.1013, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.92% (0.3144 => 0.3330, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.45% (0.3325 => 0.3473, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.55% (48.6086 => 49.3604, std.dev.: 0.0700) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -11.83% (0.3898 => 0.3437, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/methcall: -11.75% (0.3524 => 0.3110, std.dev.: 0.0143) MultiSource/Benchmarks/nbench/nbench: -10.64% (1.4861 => 1.3280, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/loader/loader: -10.29% (0.3527 => 0.3164, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/BoolLiteralTest: -9.08% (0.4845 => 0.4405, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.48% (1.7508 => 1.6199, std.dev.: 0.0421) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.54% (0.7137 => 0.6813, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -3.57% (11.7782 => 11.3575, std.dev.: 0.0785) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.32% (4.9279 => 4.7644, std.dev.: 0.0405) MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.08% (5.2882 => 5.1251, std.dev.: 0.0513) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -2.56% (12.4790 => 12.1600, std.dev.: 0.0324) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/moments: -14.82% (0.1424 => 0.1213, std.dev.: 0.0058) MultiSource/Benchmarks/Bullet/bullet: -9.48% (8.8261 => 7.9898, std.dev.: 0.2582) SingleSource/Benchmarks/Shootout/strcat: -5.06% (0.2056 => 0.1952, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.07% (0.1338 => 0.1339, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.62% (0.0420 => 0.0494, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.59% (0.0681 => 0.0677, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -0.01% (494.0844 => 494.0259, std.dev.: 0.2231) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.87% (4.3882 => 0.0494, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/power/power: 43708.27% (1.1277 => 494.0259, std.dev.: 0.2231) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 193.98% (0.5229 => 1.5372, std.dev.: 0.1054) MultiSource/Applications/SPASS/SPASS: 22.48% (14.9895 => 18.3584, std.dev.: 0.0189) MultiSource/Applications/kimwitu++/kc: 47.83% (14.1553 => 20.9256, std.dev.: 0.3873) MultiSource/Benchmarks/MallocBench/gs/gs: 20.84% (4.1105 => 4.9670, std.dev.: 0.0574) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 45.26% (1.1048 => 1.6048, std.dev.: 0.0239) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 432.66% (7.1582 => 38.1286, std.dev.: 0.2801) SingleSource/Benchmarks/Misc-C++-EH/spirit: 79.38% (3.4629 => 6.2116, std.dev.: 0.3652) SingleSource/Benchmarks/Misc-C++/stepanov_container: 86.48% (0.6222 => 1.1603, std.dev.: 0.0141) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10713.19% (0.0720 => 7.7855, std.dev.: 0.2017) MultiSource/Applications/SIBsim4/SIBsim4: 3884300.00% (0.0001 => 3.8844, std.dev.: 0.0171) MultiSource/Applications/SPASS/SPASS: 14828300.00% (0.0001 => 14.8284, std.dev.: 0.2761) MultiSource/Applications/kimwitu++/kc: 52100.00% (0.0001 => 0.0522, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576200.00% (0.0001 => 0.5763, std.dev.: 0.0235) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10089800.00% (0.0001 => 10.0899, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5699000.00% (0.0001 => 5.6991, std.dev.: 0.8616) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1809.42% (1.1194 => 21.3740, std.dev.: 0.0858) MultiSource/Applications/ClamAV/clamscan: 67.67% (22.1758 => 37.1819, std.dev.: 0.4068) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 59.28% (7.0540 => 11.2358, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 58.22% (2.9384 => 4.6492, std.dev.: 0.1315) SingleSource/Benchmarks/Misc/flops: 49.86% (0.1432 => 0.2146, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.45% (8.1363 => 12.1600, std.dev.: 0.0324) MultiSource/Applications/JM/lencod/lencod: 46.14% (21.9371 => 32.0586, std.dev.: 0.3279) MultiSource/Benchmarks/FreeBench/distray/distray: 44.60% (0.1056 => 0.1527, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/almabench: 38.08% (0.0730 => 0.1008, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/voronoi/voronoi: 32.22% (0.2700 => 0.3570, std.dev.: 0.0103) SingleSource/UnitTests/vla: 30.14% (0.0355 => 0.0462, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 30.04% (0.1032 => 0.1342, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/dot-syntax-1: 29.44% (0.0479 => 0.0620, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.97% (0.6675 => 0.8609, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 28.86% (2.2024 => 2.8380, std.dev.: 0.0358) MultiSource/Benchmarks/Olden/treeadd/treeadd: 28.61% (0.0416 => 0.0535, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 27.40% (0.5569 => 0.7095, std.dev.: 0.0064) MultiSource/Applications/siod/siod: 27.39% (2.2969 => 2.9261, std.dev.: 0.0511) MultiSource/Benchmarks/Olden/perimeter/perimeter: 27.27% (0.0770 => 0.0980, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 26.98% (0.0719 => 0.0913, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 26.91% (0.2107 => 0.2674, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 26.85% (0.3121 => 0.3959, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 26.73% (0.7433 => 0.9420, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 26.00% (0.2065 => 0.2602, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 25.99% (0.9765 => 1.2303, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 25.51% (0.0443 => 0.0556, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 25.24% (0.2603 => 0.3260, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.19% (0.0770 => 0.0964, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 24.92% (0.2271 => 0.2837, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 24.75% (1.3050 => 1.6280, std.dev.: 0.0129) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 24.63% (0.0479 => 0.0597, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 24.44% (0.0491 => 0.0611, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.13% (0.0746 => 0.0926, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Oscar: 23.58% (0.0636 => 0.0786, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 23.37% (0.1117 => 0.1378, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 23.34% (0.0437 => 0.0539, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.16% (1.4186 => 1.7472, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 22.94% (14.3668 => 17.6623, std.dev.: 0.0291) SingleSource/Benchmarks/Shootout-C++/sieve: 22.68% (0.3603 => 0.4420, std.dev.: 0.0116) MultiSource/Benchmarks/McCat/08-main/main: 22.16% (0.2554 => 0.3120, std.dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/heapsort: 22.11% (0.2872 => 0.3507, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 21.71% (0.3865 => 0.4704, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 21.67% (0.3826 => 0.4655, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/whetstone: 21.52% (0.0660 => 0.0802, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 21.51% (5.7591 => 6.9978, std.dev.: 0.0652) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.39% (0.1566 => 0.1901, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.10% (0.0730 => 0.0884, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/office/office: 20.85% (0.3136 => 0.3790, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.68% (0.0793 => 0.0957, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 20.47% (5.0018 => 6.0255, std.dev.: 0.0494) MultiSource/Benchmarks/Olden/tsp/tsp: 20.43% (0.1175 => 0.1415, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.39% (0.1584 => 0.1907, std.dev.: 0.0099) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 20.33% (0.2430 => 0.2924, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 20.18% (4.2646 => 5.1251, std.dev.: 0.0513) MultiSource/Benchmarks/Ptrdist/bc/bc: 19.96% (1.1861 => 1.4229, std.dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 19.63% (0.1625 => 0.1944, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.92% (0.5860 => 0.6969, std.dev.: 0.0249) MultiSource/Applications/lua/lua: 18.80% (3.8723 => 4.6001, std.dev.: 0.1788) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.31% (0.1125 => 0.1331, std.dev.: 0.0055) SingleSource/UnitTests/initp1: 18.02% (0.0555 => 0.0655, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 17.95% (9.4845 => 11.1870, std.dev.: 0.1144) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.80% (0.0871 => 0.1026, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/neural/neural: 17.50% (0.1463 => 0.1719, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.46% (0.0842 => 0.0989, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 17.42% (0.3427 => 0.4024, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 17.26% (0.8101 => 0.9499, std.dev.: 0.0171) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.16% (0.4615 => 0.5407, std.dev.: 0.0223) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.15% (0.0834 => 0.0977, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.72% (0.8172 => 0.9538, std.dev.: 0.0241) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.67% (0.0648 => 0.0756, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.34% (0.4064 => 0.4728, std.dev.: 0.0169) MultiSource/Benchmarks/Olden/mst/mst: 15.99% (0.1163 => 0.1349, std.dev.: 0.0062) MultiSource/Applications/sqlite3/sqlite3: 15.81% (17.1811 => 19.8971, std.dev.: 0.2597) SingleSource/Benchmarks/Shootout-C++/except: 15.74% (0.2871 => 0.3323, std.dev.: 0.0159) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.74% (0.0953 => 0.1103, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.71% (4.9449 => 5.7219, std.dev.: 0.0394) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.58% (0.0886 => 0.1024, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.55% (0.3441 => 0.3976, std.dev.: 0.0167) MultiSource/Benchmarks/Olden/health/health: 15.38% (0.1268 => 0.1463, std.dev.: 0.0074) MultiSource/Applications/viterbi/viterbi: 15.37% (0.1555 => 0.1794, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 15.16% (0.0798 => 0.0919, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: 14.75% (0.3282 => 0.3766, std.dev.: 0.0079) MultiSource/Applications/Burg/burg: 14.72% (1.1642 => 1.3356, std.dev.: 0.0620) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.72% (0.2758 => 0.3164, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.58% (0.1337 => 0.1532, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 14.34% (0.1144 => 0.1308, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.29% (2.2022 => 2.5168, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.91% (0.5981 => 0.6813, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 13.91% (0.4299 => 0.4897, std.dev.: 0.0142) MultiSource/Applications/hbd/hbd: 13.45% (1.5603 => 1.7701, std.dev.: 0.0626) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.44% (0.1510 => 0.1713, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 13.36% (63.2438 => 71.6935, std.dev.: 0.3348) MultiSource/Applications/d/make_dparser: 13.12% (3.3354 => 3.7730, std.dev.: 0.1460) SingleSource/UnitTests/ObjC/parameter-passing: 13.11% (0.3927 => 0.4442, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.06% (1.5415 => 1.7428, std.dev.: 0.0573) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.54% (0.6450 => 0.7259, std.dev.: 0.0298) SingleSource/UnitTests/ObjC/property: 12.53% (0.3886 => 0.4373, std.dev.: 0.0151) SingleSource/UnitTests/ObjC/for-in: 12.34% (0.3694 => 0.4150, std.dev.: 0.0170) SingleSource/UnitTests/ObjC/exceptions-3: 12.32% (0.3516 => 0.3949, std.dev.: 0.0161) MultiSource/Benchmarks/nbench/nbench: 12.16% (1.1840 => 1.3280, std.dev.: 0.0124) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.79% (0.1892 => 0.2115, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.74% (0.1695 => 0.1894, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.70% (0.8067 => 0.9011, std.dev.: 0.0294) SingleSource/UnitTests/ObjC/block-byref-aggr: 10.61% (0.3817 => 0.4222, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/football/football: 10.48% (0.8921 => 0.9856, std.dev.: 0.0240) MultiSource/Benchmarks/PAQ8p/paq8p: 9.55% (10.3673 => 11.3575, std.dev.: 0.0785) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.34% (7.9617 => 8.3071, std.dev.: 0.0513) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.57% (0.4879 => 0.5053, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.81% (4.3953 => 11.0240, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/methcall: 147.74% (5.3999 => 13.3777, std.dev.: 0.0010) MultiSource/Benchmarks/llubenchmark/llu: 123.95% (3.7781 => 8.4611, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/synchronized: 56.99% (0.1051 => 0.1650, std.dev.: 0.0161) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 25.96% (13.4384 => 16.9264, std.dev.: 0.3915) SingleSource/Benchmarks/Shootout-C++/ary3: 22.37% (3.7221 => 4.5548, std.dev.: 0.2375) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.97% (0.2944 => 0.3473, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.72% (1.1145 => 1.3120, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: 17.53% (6.6465 => 7.8119, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 17.25% (0.0864 => 0.1013, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 17.07% (9.1159 => 10.6719, std.dev.: 0.4037) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.66% (2.8904 => 3.2274, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 10.25% (1.1396 => 1.2564, std.dev.: 0.0016) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.30% (1.7254 => 1.8859, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.47% (0.3070 => 0.3330, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.20% (8.6802 => 9.3052, std.dev.: 0.2200) SingleSource/Benchmarks/Shootout/hash: 7.04% (4.9088 => 5.2545, std.dev.: 0.1274) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.57% (4.2280 => 4.4635, std.dev.: 0.0078) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.90% (26.0924 => 27.3704, std.dev.: 0.2569) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.79% (0.3463 => 0.3629, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.29% (3.6395 => 3.7957, std.dev.: 0.0361) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.6436 => 12.1291, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.79% (0.3540 => 0.3674, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: 2.63% (2.4116 => 2.4751, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 2.07% (3.1595 => 3.2249, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 1.92% (85.0658 => 86.6992, std.dev.: 0.0904) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.83% (2.1424 => 2.1816, std.dev.: 0.0074) SingleSource/Benchmarks/Dhrystone/fldry: 1.78% (1.9577 => 1.9926, std.dev.: 0.0091) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.56% (6.5088 => 6.6105, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 1.51% (27.8444 => 28.2657, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/lists: 1.39% (12.5348 => 12.7087, std.dev.: 0.0233) SingleSource/Benchmarks/Shootout/sieve: 1.35% (5.2139 => 5.2841, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0313 => 1.0440, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 1.19% (5.9798 => 6.0507, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1670, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.64% (5.2763 => 1.2326, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -75.88% (0.8651 => 0.2087, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/richards_benchmark: -44.70% (0.1622 => 0.0897, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -12.03% (0.1330 => 0.1170, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.53% (5.3855 => 4.7644, std.dev.: 0.0405) MultiSource/Applications/JM/ldecod/ldecod: -8.35% (10.4361 => 9.5644, std.dev.: 0.1403) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.01% (1.7609 => 1.6199, std.dev.: 0.0421) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.21% (5.3526 => 5.0737, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.92% (0.0506 => 0.0304, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.73% (0.3987 => 0.2403, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.25% (4.5009 => 2.7795, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: -33.54% (1.1492 => 0.7638, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -25.40% (10.7105 => 7.9898, std.dev.: 0.2582) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.14% (2.6546 => 2.0137, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: -19.11% (0.2161 => 0.1748, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -16.01% (1.6925 => 1.4215, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.68% (2.6778 => 2.2846, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.71% (32.5116 => 29.0309, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -9.23% (9.5636 => 8.6812, std.dev.: 0.0728) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4245, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.73% (3.2416 => 3.0234, std.dev.: 0.0225) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.54% (2.7294 => 2.5782, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5093, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.69% (0.2497 => 0.2380, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.30% (1.6805 => 1.6083, std.dev.: 0.0244) SingleSource/Benchmarks/Shootout/lists: -4.13% (6.2999 => 6.0396, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.27% (0.9957 => 0.9631, std.dev.: 0.0038) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8916, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.31% (0.4808 => 0.4697, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.77% (8.1563 => 8.0119, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -1.47% (10.2830 => 10.1323, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.01% (0.2116 => 0.0677, std.dev.: 0.0004) Report Time: 2.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 21:25:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 23:25:44 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121116052544.9ECA42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5921?compare_to=5918&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5921, Order: 168132, Start Time: 2012-11-16 03:58:01, End Time: 2012-11-16 05:26:03 To: 5918, Order: 168126, Start Time: 2012-11-16 02:10:47, End Time: 2012-11-16 03:38:57 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 13 (76 on baseline) Performance Improvements: 3 (19 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 976 (879 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.59% (0.8204 => 0.8745, std.dev.: 0.0067) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.40% (0.3241 => 0.3416, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 4.65% (0.8470 => 0.8864, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.61% (0.8996 => 0.9411, std.dev.: 0.0116) MultiSource/Benchmarks/McCat/08-main/main: 3.76% (0.2661 => 0.2761, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/09-vor/vor: 3.26% (0.3161 => 0.3264, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.45% (1.1982 => 1.2275, std.dev.: 0.0111) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 4.92% (21.0844 => 22.1223, std.dev.: 0.3503) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.85% (0.8583 => 0.8828, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.49% (58.8837 => 60.3524, std.dev.: 0.5305) SingleSource/Benchmarks/Shootout-C++/except: 2.08% (0.4859 => 0.4960, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.72% (9.6728 => 9.8394, std.dev.: 0.0214) SingleSource/Benchmarks/Misc/pi: 1.04% (2.4826 => 2.5084, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -1.27% (1.0186 => 1.0057, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -3.34% (4.1147 => 3.9772, std.dev.: 0.0383) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.20% (1.6278 => 1.6082, std.dev.: 0.0050) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.33% (16.9507 => 16.8943, std.dev.: 0.1847) MultiSource/Applications/obsequi/Obsequi: 1.77% (1.0495 => 1.0681, std.dev.: 0.0208) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.73% (22.2988 => 22.9078, std.dev.: 0.2829) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.16% (0.3679 => 0.3685, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: -0.15% (0.6165 => 0.6156, std.dev.: 0.0492) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.39% (0.3359 => 0.3346, std.dev.: 0.0618) SingleSource/Benchmarks/Shootout-C++/strcat: -0.05% (0.2024 => 0.2023, std.dev.: 0.0700) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.46% (0.0219 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.70% (0.0428 => 0.0425, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.90% (0.0333 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.95% (0.0316 => 0.0313, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.17% (0.0427 => 0.0422, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0203 => 0.0203, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 44.00% (0.0150 => 0.0216, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -23.08% (0.0013 => 0.0010, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 0.61% (0.1472 => 0.1481, std.dev.: 0.0032) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 4.17% (1.1877 => 1.2372, std.dev.: 0.2977) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.28% (0.4205 => 0.4151, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.66% (0.1371 => 0.1380, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.78% (0.0641 => 0.0646, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.83% (0.0219 => 0.0269, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.42% (0.0546 => 0.0592, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.26% (1.1958 => 1.1927, std.dev.: 0.0208) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2300.00% (0.0001 => 0.0024, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 237.50% (0.0008 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.24% (0.0609 => 0.0647, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0266 => 0.0266, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.92% (0.7727 => 0.7798, std.dev.: 0.0104) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -54.43% (0.0079 => 0.0036, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2311.31% (0.6332 => 15.2684, std.dev.: 0.3346) MultiSource/Benchmarks/McCat/08-main/main: 50.79% (0.1831 => 0.2761, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.94% (0.1559 => 0.1482, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1533.58% (0.3344 => 5.4627, std.dev.: 0.2599) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.97% (0.2364 => 0.3238, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/mandel: 0.93% (0.0429 => 0.0433, std.dev.: 0.0091) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.23% (0.0224 => 0.0229, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -31.30% (0.0230 => 0.0158, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 12.38% (0.1462 => 0.1643, std.dev.: 0.0085) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4671, std.dev.: 0.0262) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0703, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4887, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3250, std.dev.: 0.0634) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1300, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4003, std.dev.: 0.0100) SingleSource/Regression/C/uint64_to_float: -24.16% (2.1832 => 1.6558, std.dev.: 0.0046) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.53% (0.0810 => 0.0952, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 12.94% (0.0773 => 0.0873, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 12.23% (0.1112 => 0.1248, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 9.79% (0.1062 => 0.1166, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.89% (0.3137 => 0.3416, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.66% (0.8048 => 0.8745, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.21% (0.2180 => 0.2359, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.21% (0.8697 => 0.9411, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.90% (0.2279 => 0.2459, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.85% (0.6010 => 0.6482, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.78% (0.4847 => 0.5224, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.55% (0.7473 => 0.8037, std.dev.: 0.0187) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.44% (0.8321 => 0.8940, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.30% (0.8261 => 0.8864, std.dev.: 0.0142) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.49% (0.8148 => 0.8677, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 6.37% (0.8656 => 0.9207, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.28% (0.7932 => 0.8430, std.dev.: 0.0157) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.15% (0.2519 => 0.2674, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.06% (0.9435 => 1.0007, std.dev.: 0.0201) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.93% (0.6287 => 0.6660, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.76% (1.1606 => 1.2275, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.52% (0.5817 => 0.6138, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.34% (0.3295 => 0.3471, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.27% (0.2240 => 0.2358, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.77% (0.2998 => 0.3141, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.45% (0.8331 => 0.8702, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 4.32% (0.8597 => 0.8968, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.98% (1.1685 => 1.2150, std.dev.: 0.0075) MultiSource/Applications/lua/lua: 3.94% (3.8189 => 3.9695, std.dev.: 0.0355) MultiSource/Benchmarks/MallocBench/gs/gs: 3.74% (4.1305 => 4.2848, std.dev.: 0.0457) MultiSource/Applications/SIBsim4/SIBsim4: 3.65% (1.2568 => 1.3027, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.64% (1.3279 => 1.3763, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.55% (4.1763 => 4.3247, std.dev.: 0.0523) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.48% (6.6074 => 6.8375, std.dev.: 0.0776) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.26% (8.6476 => 8.9298, std.dev.: 0.0606) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.20% (0.4559 => 0.4705, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.01% (1.2526 => 1.2903, std.dev.: 0.0110) MultiSource/Benchmarks/McCat/05-eks/eks: 3.00% (0.4397 => 0.4529, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.74% (4.4873 => 4.6103, std.dev.: 0.0437) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.72% (0.3717 => 0.3818, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.63% (0.6227 => 0.6391, std.dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: 2.52% (0.9810 => 1.0057, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.42% (13.1811 => 13.4996, std.dev.: 0.0976) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.31% (1.6386 => 1.6765, std.dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.27% (1.1170 => 1.1424, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.43% (0.8995 => 0.9124, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 119.10% (0.0199 => 0.0436, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/pi: 58.81% (1.5795 => 2.5084, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 21.97% (0.0528 => 0.0644, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.20% (0.7597 => 0.8904, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.40% (2.9753 => 3.4633, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 15.26% (2.7995 => 3.2266, std.dev.: 0.1302) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 12.21% (5.0261 => 5.6396, std.dev.: 0.0188) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.11% (0.3186 => 0.3508, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.01% (1.1857 => 1.2807, std.dev.: 0.0197) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 7.31% (2.2485 => 2.4128, std.dev.: 0.0295) SingleSource/Benchmarks/McGill/queens: 7.13% (1.7056 => 1.8272, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.48% (4.7794 => 5.0893, std.dev.: 0.0507) MultiSource/Applications/SIBsim4/SIBsim4: 6.33% (3.1873 => 3.3892, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.07% (4.5327 => 4.8080, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.90% (4.9686 => 5.2616, std.dev.: 0.0488) MultiSource/Applications/lambda-0_1_3/lambda: 5.00% (7.4933 => 7.8682, std.dev.: 0.0863) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.71% (4.9469 => 5.1799, std.dev.: 0.0756) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.69% (3.3761 => 3.5345, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.65% (6.2275 => 6.5169, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.10% (4.9453 => 5.1480, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.85% (14.0064 => 14.5451, std.dev.: 0.0905) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.43% (1.2337 => 1.2760, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.63% (11.5690 => 11.8734, std.dev.: 0.0681) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.52% (4.8362 => 4.9582, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout/lists: 2.49% (7.3375 => 7.5201, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.49% (1.1365 => 1.1534, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.31% (2.4647 => 2.4971, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: 1.29% (1.0841 => 1.0981, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 1.18% (8.5322 => 8.6331, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.00% (3.5679 => 3.6037, std.dev.: 0.0127) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.91% (5.4641 => 4.3215, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.42% (7.2130 => 6.1728, std.dev.: 0.0437) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.80% (1.0512 => 0.9377, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: -10.42% (1.1216 => 1.0047, std.dev.: 0.0225) MultiSource/Benchmarks/mafft/pairlocalalign: -8.44% (63.1822 => 57.8496, std.dev.: 0.2671) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -7.00% (4.7482 => 4.4160, std.dev.: 0.0340) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.92% (14.6451 => 13.6316, std.dev.: 0.2966) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.36% (0.3269 => 0.3061, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.84% (3.7148 => 3.4978, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.49% (5.4972 => 5.1952, std.dev.: 0.0539) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.02% (4.7449 => 4.5543, std.dev.: 0.0230) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.50% (6.0224 => 5.8116, std.dev.: 0.0430) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.46% (0.5807 => 0.5606, std.dev.: 0.0066) MultiSource/Applications/lua/lua: -3.36% (29.8330 => 28.8293, std.dev.: 0.2366) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.07% (28.5821 => 27.7052, std.dev.: 0.1445) SingleSource/Benchmarks/Shootout-C++/hash2: -2.21% (3.4237 => 3.3481, std.dev.: 0.0110) MultiSource/Applications/aha/aha: -2.13% (3.3398 => 3.2687, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.95% (11.5316 => 11.3065, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.47% (4.9994 => 4.9259, std.dev.: 0.0213) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.73% (16.4461 => 16.8943, std.dev.: 0.1847) MultiSource/Applications/obsequi/Obsequi: 4.08% (1.0262 => 1.0681, std.dev.: 0.0208) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7235.19% (0.3123 => 22.9078, std.dev.: 0.2829) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.61% (0.2463 => 0.3685, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 2.43% (0.6010 => 0.6156, std.dev.: 0.0492) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.45% (0.3266 => 0.3346, std.dev.: 0.0618) SingleSource/Benchmarks/Shootout-C++/strcat: 2.74% (0.1969 => 0.2023, std.dev.: 0.0700) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 42.86% (0.0007 => 0.0010, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 2.99% (0.1438 => 0.1481, std.dev.: 0.0032) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 9.21% (1.1329 => 1.2372, std.dev.: 0.2977) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.31% (0.4164 => 0.4151, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.80% (0.1369 => 0.1380, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.78% (0.0641 => 0.0646, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 37.95% (0.0195 => 0.0269, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.42% (0.0578 => 0.0592, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.28% (1.1437 => 1.1927, std.dev.: 0.0208) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2300.00% (0.0001 => 0.0024, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.19% (0.0627 => 0.0647, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.73% (0.8017 => 0.7798, std.dev.: 0.0104) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -41.94% (0.0062 => 0.0036, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 21:29:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 23:29:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121116052920.21CD32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5922?compare_to=5919&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5922, Order: 168132, Start Time: 2012-11-16 04:04:35, End Time: 2012-11-16 05:29:38 To: 5919, Order: 168126, Start Time: 2012-11-16 02:16:39, End Time: 2012-11-16 03:41:41 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (179 on baseline) Unchanged Tests: 1042 (859 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.26% (2.0478 => 2.1145, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/salsa20: 2.48% (7.4937 => 7.6796, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/hash2: 2.06% (3.1932 => 3.2591, std.dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.01% (0.3821 => 0.3515, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: -7.33% (2.4924 => 2.3097, std.dev.: 0.0064) MultiSource/Applications/sgefa/sgefa: -6.73% (0.3357 => 0.3131, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.55% (0.2428 => 0.2269, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.54% (0.9542 => 0.8918, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.33% (0.3142 => 0.2943, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -6.19% (0.3812 => 0.3576, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.18% (0.1796 => 0.1685, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -6.15% (0.4033 => 0.3785, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -6.11% (0.3880 => 0.3643, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -6.11% (0.3831 => 0.3597, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.11% (0.3848 => 0.3613, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.09% (0.6484 => 0.6089, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: -6.09% (16.1920 => 15.2064, std.dev.: 0.0101) MultiSource/Benchmarks/mafft/pairlocalalign: -6.09% (9.2283 => 8.6666, std.dev.: 0.0038) MultiSource/Applications/JM/ldecod/ldecod: -6.06% (7.0961 => 6.6659, std.dev.: 0.0073) SingleSource/UnitTests/ObjC/synchronized: -6.06% (0.3896 => 0.3660, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.04% (0.3891 => 0.3656, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: -6.01% (0.1879 => 0.1766, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.01% (0.4176 => 0.3925, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.99% (0.2355 => 0.2214, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: -5.97% (0.9179 => 0.8631, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.95% (0.3884 => 0.3653, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.94% (1.0544 => 0.9918, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.87% (1.6364 => 1.5404, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.86% (0.9852 => 0.9275, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -5.85% (0.1761 => 0.1658, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.83% (0.2695 => 0.2538, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.82% (0.3658 => 0.3445, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.73% (4.8161 => 4.5401, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.71% (3.5339 => 3.3320, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.71% (1.3722 => 1.2939, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.70% (4.0323 => 3.8026, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: -5.69% (1.1450 => 1.0799, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.68% (4.8802 => 4.6031, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.67% (1.2300 => 1.1602, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/property: -5.64% (0.4199 => 0.3962, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: -5.64% (0.3406 => 0.3214, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.62% (6.7716 => 6.3910, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.62% (4.5069 => 4.2536, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.61% (0.5863 => 0.5534) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.60% (0.5591 => 0.5278, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.59% (1.4642 => 1.3823, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.58% (0.6736 => 0.6360, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.58% (0.5805 => 0.5481, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.57% (0.5802 => 0.5479, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -5.55% (1.1530 => 1.0890, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.54% (0.6660 => 0.6291, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: -5.52% (4.3330 => 4.0938, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.49% (0.5478 => 0.5177, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -5.49% (0.4280 => 0.4045, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.49% (0.7198 => 0.6803, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.47% (0.6052 => 0.5721, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -5.46% (17.1032 => 16.1691, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.45% (1.2784 => 1.2087, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.45% (0.6293 => 0.5950, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: -5.45% (0.4515 => 0.4269, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.42% (0.5925 => 0.5604, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -5.41% (1.2515 => 1.1838, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.41% (0.6230 => 0.5893, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.40% (0.6681 => 0.6320, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.36% (0.5705 => 0.5399, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.35% (0.5575 => 0.5277, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -5.34% (1.3864 => 1.3123, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.33% (0.8521 => 0.8067, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.31% (0.2278 => 0.2157, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.29% (0.5859 => 0.5549, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.28% (14.2083 => 13.4580, std.dev.: 0.0132) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.27% (1.2210 => 1.1566, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.27% (0.5688 => 0.5388, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.27% (0.6676 => 0.6324, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.27% (0.6395 => 0.6058, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.27% (0.5849 => 0.5541, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.26% (0.6260 => 0.5931, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.25% (0.6667 => 0.6317, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.25% (1.2221 => 1.1580, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.24% (0.5857 => 0.5550, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.21% (0.5581 => 0.5290, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.21% (8.0126 => 7.5953, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/bh/bh: -5.19% (0.2985 => 0.2830, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.18% (0.7919 => 0.7509, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.18% (0.6395 => 0.6064, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.17% (0.7524 => 0.7135, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -5.17% (0.3581 => 0.3396, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.15% (0.4916 => 0.4663, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.14% (0.7339 => 0.6962, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.11% (0.3483 => 0.3305, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.10% (0.5456 => 0.5178, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -5.09% (3.5154 => 3.3363, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.08% (0.5941 => 0.5639, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.08% (0.5570 => 0.5287, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -5.07% (15.5079 => 14.7212, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.07% (0.2999 => 0.2847, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.06% (0.6446 => 0.6120, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.02% (0.2548 => 0.2420, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.01% (0.6033 => 0.5731, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.99% (0.2385 => 0.2266, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.97% (0.6440 => 0.6120, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.95% (0.5999 => 0.5702, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.94% (0.3319 => 0.3155, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.92% (0.5567 => 0.5293, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -4.88% (15.2527 => 14.5084, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.86% (0.5168 => 0.4917, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -4.85% (0.7447 => 0.7086, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -4.84% (1.3148 => 1.2511, std.dev.: 0.0015) MultiSource/Applications/lua/lua: -4.80% (4.0594 => 3.8646, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.80% (1.6474 => 1.5684, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: -4.64% (2.1401 => 2.0407, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.63% (0.3931 => 0.3749, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.62% (0.6297 => 0.6006, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.61% (0.3837 => 0.3660, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -4.60% (2.4021 => 2.2916, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.59% (0.6194 => 0.5910, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.56% (0.7021 => 0.6701, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.55% (0.4151 => 0.3962, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.55% (22.4056 => 21.3865, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.51% (0.3016 => 0.2880, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -4.51% (0.3194 => 0.3050, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.50% (0.5329 => 0.5089, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -4.49% (0.3271 => 0.3124, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.46% (0.6304 => 0.6023, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -4.42% (0.3255 => 0.3111, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.42% (2.1713 => 2.0753, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/methcall: -4.40% (0.3025 => 0.2892, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -4.38% (0.8418 => 0.8049, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.38% (0.6189 => 0.5918, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: -4.36% (0.3026 => 0.2894, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -4.34% (0.4861 => 0.4650, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -4.32% (0.7982 => 0.7637, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.31% (0.3252 => 0.3112, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.29% (0.3057 => 0.2926, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.25% (2.2587 => 2.1626, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -4.25% (0.3059 => 0.2929, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -4.24% (0.6347 => 0.6078, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -4.23% (5.0226 => 4.8100, std.dev.: 0.0126) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.22% (0.9077 => 0.8694, std.dev.: 0.0054) MultiSource/Applications/kimwitu++/kc: -4.20% (18.2933 => 17.5241, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.19% (0.2933 => 0.2810, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -4.17% (0.3621 => 0.3470, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -4.15% (0.3446 => 0.3303, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.14% (0.2871 => 0.2752) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.13% (0.2903 => 0.2783, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -4.13% (0.6441 => 0.6175, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -4.12% (0.3394 => 0.3254, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -4.12% (0.4248 => 0.4073, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.12% (0.2989 => 0.2866, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.11% (0.9557 => 0.9164, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -4.11% (34.0927 => 32.6911, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/random: -4.08% (0.2939 => 0.2819, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -4.08% (0.3481 => 0.3339, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -4.07% (0.2849 => 0.2733, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.06% (0.3323 => 0.3188, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.03% (0.3867 => 0.3711, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.03% (0.4813 => 0.4619, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -4.01% (0.7779 => 0.7467, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.00% (0.3849 => 0.3695, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -3.99% (0.3205 => 0.3077, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.92% (0.4083 => 0.3923, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: -3.87% (0.4524 => 0.4349, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.80% (0.4321 => 0.4157, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.79% (0.4427 => 0.4259, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -3.73% (0.6750 => 0.6498, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.64% (0.3491 => 0.3364, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: -3.48% (0.3788 => 0.3656, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.18% (5.4682 => 5.2942, std.dev.: 0.0044) MultiSource/Applications/hbd/hbd: -3.14% (1.5610 => 1.5120, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -1.76% (20.7746 => 20.4099, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7556, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: -8.69% (1.2842 => 1.1726, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -4.20% (2.2633 => 2.1682, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7069, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.77% (1.3096 => 1.2733, std.dev.: 0.0119) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4702, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Report Time: 2.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 21:55:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 15 Nov 2012 23:55:28 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121116055528.029B62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5923?compare_to=5914&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5923, Order: 168126, Start Time: 2012-11-16 02:40:11, End Time: 2012-11-16 05:55:41 To: 5914, Order: 168064, Start Time: 2012-11-15 20:03:54, End Time: 2012-11-15 23:19:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (173 on baseline) Performance Improvements: 2 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (717 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.23% (2.4281 => 2.3983, std.dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: -1.01% (1.9869 => 1.9669, std.dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.52% (0.0625 => 0.0872) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.42% (0.1063 => 0.1397, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.90% (0.2969 => 0.3738, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.32% (0.1106 => 0.1386, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.93% (0.0714 => 0.0892, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.45% (0.4139 => 0.5151, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.29% (0.4253 => 0.5286, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.67% (0.4994 => 0.6176, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.54% (0.5900 => 0.7289, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 23.46% (1.5932 => 1.9669, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.40% (0.0547 => 0.0675, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.37% (0.0475 => 0.0586, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.29% (0.0584 => 0.0720, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.72% (0.5000 => 0.6136, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.35% (0.1620 => 0.1982, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.23% (0.1021 => 0.1248, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 22.20% (0.0599 => 0.0732, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.07% (0.0897 => 0.1095, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.50% (0.1107 => 0.1345, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.03% (0.0642 => 0.0777, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.01% (0.0633 => 0.0766, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 20.89% (0.0948 => 0.1146, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.72% (0.0584 => 0.0705, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.58% (0.1103 => 0.1330, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.52% (0.0541 => 0.0652, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 20.46% (0.0821 => 0.0989, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.34% (0.1003 => 0.1207, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.32% (0.0822 => 0.0989, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.27% (0.3903 => 0.4694, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.14% (0.1549 => 0.1861, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 20.14% (0.1619 => 0.1945, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.07% (0.1604 => 0.1926, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 19.22% (0.0947 => 0.1129) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.08% (0.1462 => 0.1741, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 18.94% (0.0808 => 0.0961, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.77% (0.2014 => 0.2392, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.77% (0.3890 => 0.4620, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 18.64% (0.1218 => 0.1445, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 18.43% (0.5826 => 0.6900, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 18.17% (0.4029 => 0.4761, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.09% (0.2736 => 0.3231, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.08% (1.3152 => 1.5530, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/mst/mst: 18.05% (0.0698 => 0.0824, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 18.02% (0.5889 => 0.6950, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.01% (0.1088 => 0.1284, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 17.74% (0.1505 => 0.1772, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.73% (0.2866 => 0.3374, std.dev.: 0.0031) MultiSource/Applications/Burg/burg: 17.63% (0.5546 => 0.6524, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 17.51% (1.8794 => 2.2085, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.34% (3.5627 => 4.1806, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.33% (0.3271 => 0.3838, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.19% (0.0605 => 0.0709, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.18% (0.2875 => 0.3369, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.12% (1.6211 => 1.8987, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.97% (0.1968 => 0.2302, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 16.93% (0.9697 => 1.1339, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.90% (0.4658 => 0.5445, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.73% (0.5026 => 0.5867, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 16.55% (0.7171 => 0.8358, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 16.51% (0.2750 => 0.3204, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.47% (0.1160 => 0.1351, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: 16.43% (0.2714 => 0.3160, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 16.41% (1.0781 => 1.2550, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/18-imp/imp: 16.40% (0.1421 => 0.1654, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 16.37% (0.2725 => 0.3171, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.36% (0.2738 => 0.3186, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.31% (0.2729 => 0.3174) SingleSource/Benchmarks/Shootout-C++/objinst: 16.29% (0.2823 => 0.3283, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 16.27% (0.2803 => 0.3259, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.17% (0.4361 => 0.5066, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/matrix: 16.15% (0.2780 => 0.3229, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.11% (2.7292 => 3.1689, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 16.10% (0.2813 => 0.3266, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 15.97% (0.2811 => 0.3260, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 15.97% (0.1284 => 0.1489, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.95% (0.3930 => 0.4557, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 15.95% (0.3004 => 0.3483, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/wc: 15.86% (0.3096 => 0.3587, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 15.75% (0.9909 => 1.1470, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.72% (0.2792 => 0.3231, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.70% (0.2911 => 0.3368, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.65% (4.4195 => 5.1113, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.63% (2.0673 => 2.3904, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 15.61% (4.2109 => 4.8683, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.59% (1.9694 => 2.2765, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.59% (0.3195 => 0.3693, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 15.55% (0.3267 => 0.3775, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary: 15.50% (0.3258 => 0.3763, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.23% (1.9966 => 2.3006, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 15.14% (23.5202 => 27.0800, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.00% (0.3060 => 0.3519, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 14.92% (0.3317 => 0.3812, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 14.82% (0.3678 => 0.4223, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 14.80% (0.3446 => 0.3956, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.77% (0.1090 => 0.1251, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 14.77% (0.2566 => 0.2945, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.72% (0.3362 => 0.3857, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-4: 14.66% (0.3465 => 0.3973, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 14.59% (1.4269 => 1.6351, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/for-in: 14.59% (0.3496 => 0.4006, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.59% (0.3469 => 0.3975, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.57% (0.3460 => 0.3964, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.56% (0.3124 => 0.3579, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.56% (0.3488 => 0.3996, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.56% (0.3442 => 0.3943, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 14.55% (0.2075 => 0.2377, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 14.54% (0.4146 => 0.4749, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 14.47% (0.3726 => 0.4265, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 14.46% (0.3348 => 0.3832, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 14.44% (0.3477 => 0.3979, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.41% (0.3282 => 0.3755, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 14.19% (0.3650 => 0.4168, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 14.18% (0.7875 => 0.8992, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.18% (0.3625 => 0.4139, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 14.08% (0.3643 => 0.4156, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.01% (0.3690 => 0.4207, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.94% (0.3724 => 0.4243, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 13.88% (0.4251 => 0.4841, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.72% (0.3981 => 0.4527, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.68% (0.3845 => 0.4371, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 13.55% (2.1653 => 2.4587, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 13.32% (0.0758 => 0.0859, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 13.23% (4.6177 => 5.2287, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/bigfib: 13.19% (0.5012 => 0.5673, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 13.03% (2.1013 => 2.3751, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.94% (0.2040 => 0.2304, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 12.63% (0.2691 => 0.3031, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 12.48% (5.5417 => 6.2335, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.37% (0.6435 => 0.7231, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.87% (0.1028 => 0.1150, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 11.32% (0.3498 => 0.3894, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 11.29% (0.6634 => 0.7383, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.22% (0.2068 => 0.2300, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.22% (0.2737 => 0.3044, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.77% (0.1383 => 0.1532, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.73% (0.3084 => 0.3415, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 10.65% (0.4847 => 0.5363, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.40% (0.3336 => 0.3683, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.32% (0.2103 => 0.2320, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 10.18% (2.0346 => 2.2418, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 10.00% (0.2391 => 0.2630, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.16% (0.5361 => 0.5852, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.02% (4.6926 => 5.1157, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.85% (11.6398 => 12.6703, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.42% (0.5584 => 0.6054, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.28% (0.7426 => 0.8041, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 6.94% (11.9555 => 12.7856, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.12% (0.3792 => 0.3986, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700) MultiSource/Applications/ClamAV/clamscan: 9.89% (0.2802 => 0.3079, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 7.26% (0.2122 => 0.2276, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6116, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6751, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-2: 4.75% (1.8057 => 1.8914, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1698, std.dev.: 0.0081) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6444, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.79% (0.3693 => 0.3833, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1980, std.dev.: 0.0068) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2231, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.53% (2.0820 => 2.1139, std.dev.: 0.0108) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3096, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2866, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5142, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5918, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.15% (2.4764 => 2.3983, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5568, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/ary2: -9.41% (0.2402 => 0.2176, std.dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9761, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7864, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8062, std.dev.: 0.0131) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0050) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7728, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: -3.02% (17.2379 => 16.7176, std.dev.: 0.0947) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8645, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5767, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4969, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.2035, std.dev.: 0.0332) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0434, std.dev.: 0.0048) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 6.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 23:12:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 01:12:00 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121116071200.75C9A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5924?compare_to=5921&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5924, Order: 168137, Start Time: 2012-11-16 05:42:58, End Time: 2012-11-16 07:12:19 To: 5921, Order: 168132, Start Time: 2012-11-16 03:58:01, End Time: 2012-11-16 05:26:03 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 7 (66 on baseline) Performance Improvements: 3 (20 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 982 (888 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.14% (1.2150 => 1.2410, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.82% (0.8169 => 0.8318, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.32% (4.6103 => 4.6710, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.11% (4.3247 => 4.3729, std.dev.: 0.0129) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 8.71% (0.1997 => 0.2171, std.dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.61% (2.4450 => 2.5576, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.74% (8.3468 => 8.4924, std.dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -2.29% (3.9772 => 3.8860, std.dev.: 0.0290) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.95% (9.8394 => 9.6480, std.dev.: 0.0597) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.09% (4.8984 => 4.8450, std.dev.: 0.0136) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.26% (16.8943 => 16.8497, std.dev.: 0.4808) MultiSource/Applications/obsequi/Obsequi: 0.43% (1.0681 => 1.0727, std.dev.: 0.0524) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.01% (22.9078 => 21.9887, std.dev.: 0.2687) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.11% (0.3685 => 0.3689, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/bigfib: -0.54% (0.6156 => 0.6123, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.15% (0.3346 => 0.3351, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: -0.74% (0.2023 => 0.2008, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0218 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.71% (0.0425 => 0.0428, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.33% (0.0330 => 0.0286, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -16.93% (0.0313 => 0.0260, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.18% (0.0422 => 0.0427, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 0.99% (0.0203 => 0.0205, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 0.93% (0.0216 => 0.0218, std.dev.: 0.0028) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 40.00% (0.0010 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 3.17% (0.1481 => 0.1528, std.dev.: 0.0278) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -9.30% (1.2372 => 1.1222, std.dev.: 0.4856) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.16% (0.4151 => 0.4199, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.30% (0.1380 => 0.1398, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.35% (0.0646 => 0.0605, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.41% (0.0269 => 0.0241, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.36% (0.0592 => 0.0578, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.28% (1.1927 => 1.1960, std.dev.: 0.0158) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -8.33% (0.0024 => 0.0022, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -59.26% (0.0027 => 0.0011, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.18% (0.0647 => 0.0607, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0266 => 0.0266, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.76% (0.7798 => 0.7857, std.dev.: 0.0431) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 77.78% (0.0036 => 0.0064, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2305.89% (0.6332 => 15.2341, std.dev.: 0.8212) MultiSource/Benchmarks/McCat/08-main/main: 51.61% (0.1831 => 0.2776, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.26% (0.1559 => 0.1477, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1557.57% (0.3344 => 5.5429, std.dev.: 0.0930) SingleSource/Benchmarks/Misc-C++/Large/ray: 39.09% (0.2364 => 0.3288, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: 3.50% (0.0429 => 0.0444, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -16.52% (0.0224 => 0.0187, std.dev.: 0.0020) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 11.97% (0.1462 => 0.1637, std.dev.: 0.0111) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4638, std.dev.: 0.1886) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0706, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4870, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3147, std.dev.: 0.0187) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1421, std.dev.: 0.0191) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4037, std.dev.: 0.0089) SingleSource/Regression/C/uint64_to_float: -24.02% (2.1832 => 1.6588, std.dev.: 0.0075) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.54% (0.0810 => 0.0944, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/tsp/tsp: 14.12% (0.1112 => 0.1269, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.04% (0.2279 => 0.2485, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.66% (0.1905 => 0.2070, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.12% (0.1983 => 0.2144, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.69% (1.1606 => 1.2383, std.dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.64% (0.5961 => 0.6357, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.42% (0.2133 => 0.2270, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.20% (1.1685 => 1.2410, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.95% (0.3295 => 0.3491, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.80% (0.2519 => 0.2665, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.57% (0.2998 => 0.3165, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.71% (4.1763 => 4.3729, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.42% (0.7966 => 0.8318, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.40% (0.9688 => 1.0114, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/sieve: 4.36% (0.2755 => 0.2875, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.28% (0.8069 => 0.8414, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.09% (4.4873 => 4.6710, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.94% (0.8316 => 0.8644, std.dev.: 0.0080) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.91% (6.6074 => 6.8655, std.dev.: 0.0413) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.80% (0.4127 => 0.4284, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.3279 => 1.3769, std.dev.: 0.0177) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.69% (1.2526 => 1.2988, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.66% (0.2844 => 0.2948, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.54% (13.1811 => 13.6475, std.dev.: 0.1230) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.53% (1.1170 => 1.1564, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.47% (0.3657 => 0.3784, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists1: 3.47% (0.2969 => 0.3072, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.28% (0.3717 => 0.3839, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: 3.27% (2.3764 => 2.4540, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.19% (0.8286 => 0.8550, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.16% (0.8420 => 0.8686, std.dev.: 0.0048) MultiSource/Benchmarks/Bullet/bullet: 2.68% (31.8598 => 32.7150, std.dev.: 0.2815) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.56% (1.2602 => 1.2925, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 101.51% (0.0199 => 0.0401, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/pi: 57.92% (1.5795 => 2.4943, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.95% (0.7597 => 0.8961, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.39% (2.9753 => 3.4631, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.69% (2.7995 => 3.2108, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.49% (5.0261 => 5.6034, std.dev.: 0.0553) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.80% (0.3186 => 0.3530, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.15% (1.1857 => 1.2823, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/nestedloop: 7.32% (0.2023 => 0.2171, std.dev.: 0.0053) SingleSource/Benchmarks/McGill/queens: 7.24% (1.7056 => 1.8291, std.dev.: 0.0464) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.80% (4.7794 => 5.1043, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: 6.35% (1.3037 => 1.3865, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.84% (4.9686 => 5.2590, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.78% (4.5327 => 4.7946, std.dev.: 0.0097) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.11% (2.4333 => 2.5576, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.68% (6.2275 => 6.5189, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.49% (3.3761 => 3.5276, std.dev.: 0.0302) MultiSource/Applications/lambda-0_1_3/lambda: 4.28% (7.4933 => 7.8138, std.dev.: 0.0718) MultiSource/Benchmarks/Olden/treeadd/treeadd: 4.13% (0.3587 => 0.3735, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.95% (4.9469 => 5.1422, std.dev.: 0.0110) MultiSource/Applications/hexxagon/hexxagon: 3.92% (14.0064 => 14.5548, std.dev.: 0.1237) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.54% (4.9453 => 5.1203, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.83% (11.5690 => 11.8959, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.59% (8.2783 => 8.4924, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.32% (4.8660 => 4.9791, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout/lists: 2.32% (7.3375 => 7.5078, std.dev.: 0.0393) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.98% (1.1365 => 1.1590, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.64% (4.4340 => 4.5065, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.47% (3.5679 => 3.6204, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.2061 => 1.2238, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/neural/neural: 1.34% (1.0841 => 1.0986, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/ReedSolomon: 1.25% (8.5322 => 8.6390, std.dev.: 0.0353) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.21% (5.4641 => 4.3052, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.14% (7.2130 => 6.1933, std.dev.: 0.3010) SingleSource/Benchmarks/McGill/chomp: -11.39% (1.1216 => 0.9938, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.72% (1.0512 => 0.9385, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.58% (14.6451 => 13.3881, std.dev.: 0.3141) MultiSource/Benchmarks/mafft/pairlocalalign: -8.56% (63.1822 => 57.7768, std.dev.: 0.1126) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.98% (4.7482 => 4.4168, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.39% (0.3269 => 0.3060, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.91% (5.4972 => 5.1724, std.dev.: 0.0768) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.18% (5.1557 => 4.8888, std.dev.: 0.0240) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.08% (2.8773 => 2.7598, std.dev.: 0.0446) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.75% (6.0224 => 5.7968, std.dev.: 0.0265) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.07% (28.5821 => 27.7038, std.dev.: 0.0400) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.03% (0.5807 => 0.5631, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.75% (2.6356 => 2.5631, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.61% (9.9065 => 9.6480, std.dev.: 0.0597) SingleSource/Benchmarks/Shootout-C++/hash2: -2.21% (3.4237 => 3.3479, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.95% (11.5316 => 11.3064, std.dev.: 0.0393) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.49% (4.9994 => 4.9250, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.15% (5.6343 => 5.5695, std.dev.: 0.0110) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.45% (16.4461 => 16.8497, std.dev.: 0.4808) MultiSource/Applications/obsequi/Obsequi: 4.53% (1.0262 => 1.0727, std.dev.: 0.0524) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6940.89% (0.3123 => 21.9887, std.dev.: 0.2687) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.78% (0.2463 => 0.3689, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/bigfib: 1.88% (0.6010 => 0.6123, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.60% (0.3266 => 0.3351, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: 1.98% (0.1969 => 0.2008, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 12.60% (0.0254 => 0.0286, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -13.91% (0.0302 => 0.0260, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.20% (0.0384 => 0.0427, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0028) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 100.00% (0.0007 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 6.26% (0.1438 => 0.1528, std.dev.: 0.0278) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.94% (1.1329 => 1.1222, std.dev.: 0.4856) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.84% (0.4164 => 0.4199, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.12% (0.1369 => 0.1398, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -75.00% (0.0008 => 0.0002, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.62% (0.0641 => 0.0605, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 23.59% (0.0195 => 0.0241, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: - (0.0578 => 0.0578, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.57% (1.1437 => 1.1960, std.dev.: 0.0158) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2100.00% (0.0001 => 0.0022, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -21.43% (0.0014 => 0.0011, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.19% (0.0627 => 0.0607, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.00% (0.8017 => 0.7857, std.dev.: 0.0431) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 3.23% (0.0062 => 0.0064, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 23:17:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 01:17:00 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121116071700.A78BE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5925?compare_to=5922&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5925, Order: 168137, Start Time: 2012-11-16 05:52:25, End Time: 2012-11-16 07:17:17 To: 5922, Order: 168132, Start Time: 2012-11-16 04:04:35, End Time: 2012-11-16 05:29:38 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (180 on baseline) Unchanged Tests: 1042 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.85% (2.0478 => 2.1061, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.4937 => 7.6619, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/hash2: 1.89% (3.1932 => 3.2534, std.dev.: 0.0053) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.01% (0.3821 => 0.3515, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -7.36% (2.4924 => 2.3089, std.dev.: 0.0056) MultiSource/Applications/sgefa/sgefa: -6.94% (0.3357 => 0.3124, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.50% (0.9542 => 0.8922, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.40% (0.3142 => 0.2941, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.38% (0.2428 => 0.2273, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.35% (0.1796 => 0.1682, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -6.32% (0.3812 => 0.3571, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.28% (0.6484 => 0.6077, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -6.27% (16.1920 => 15.1767, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/oourafft: -6.16% (0.2160 => 0.2027, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -6.13% (0.9179 => 0.8616, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: -6.12% (0.4033 => 0.3786, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.11% (9.2283 => 8.6641, std.dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: -6.06% (7.0961 => 6.6662, std.dev.: 0.0115) SingleSource/UnitTests/ObjC/exceptions-2: -6.03% (0.3831 => 0.3600, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.02% (1.6364 => 1.5379, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.01% (0.3891 => 0.3657, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -6.01% (0.1879 => 0.1766, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -6.01% (0.3896 => 0.3662, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.01% (0.3880 => 0.3647, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.00% (1.3722 => 1.2899, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.99% (0.3658 => 0.3439, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -5.99% (0.4176 => 0.3926, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.97% (0.3884 => 0.3652, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.96% (0.9852 => 0.9265, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.94% (0.2355 => 0.2215, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-3: -5.93% (0.3848 => 0.3620, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -5.91% (0.1761 => 0.1657, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.89% (4.8161 => 4.5322, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.89% (1.0544 => 0.9923, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (4.0323 => 3.7949, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.89% (0.1716 => 0.1615, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.88% (3.5339 => 3.3261, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.86% (0.2695 => 0.2537, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: -5.81% (1.1450 => 1.0785, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.80% (1.2300 => 1.1586, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.79% (4.5069 => 4.2459, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.78% (6.7716 => 6.3803, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.76% (4.8802 => 4.5993, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.73% (0.6736 => 0.6350, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.70% (0.5863 => 0.5529, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: -5.69% (0.4199 => 0.3960, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -5.69% (1.1530 => 1.0874, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.69% (1.4642 => 1.3809, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.67% (0.5802 => 0.5473, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.67% (0.6052 => 0.5709, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -5.67% (0.3406 => 0.3213, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.65% (0.5591 => 0.5275, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.65% (0.6230 => 0.5878, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -5.63% (4.3330 => 4.0890, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.59% (0.6293 => 0.5941, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.57% (0.6395 => 0.6039, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.57% (0.5857 => 0.5531, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.55% (1.2784 => 1.2074, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.53% (0.5805 => 0.5484, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.52% (0.7919 => 0.7482, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.52% (0.7198 => 0.6801, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -5.51% (0.4515 => 0.4266, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -5.51% (1.2515 => 1.1825, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.51% (0.5859 => 0.5536, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.51% (0.6660 => 0.6293, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: -5.50% (1.3864 => 1.3102, std.dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: -5.48% (17.1032 => 16.1664, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.45% (0.5925 => 0.5602, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -5.44% (0.4280 => 0.4047) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.43% (0.8521 => 0.8058, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.43% (0.6681 => 0.6318, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.43% (0.6667 => 0.6305, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.42% (0.5575 => 0.5273, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.41% (0.7339 => 0.6942, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.41% (0.6676 => 0.6315, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.38% (0.5999 => 0.5676, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.38% (0.5688 => 0.5382, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.37% (1.2210 => 1.1554, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.37% (14.2083 => 13.4456, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/18-imp/imp: -5.36% (0.3581 => 0.3389, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.34% (0.3483 => 0.3297, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.33% (0.5456 => 0.5165, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.33% (0.5569 => 0.5272, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.33% (0.5478 => 0.5186, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.32% (0.6260 => 0.5927, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.32% (0.7524 => 0.7124, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.31% (0.6446 => 0.6104, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.30% (0.5581 => 0.5285, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.30% (0.2999 => 0.2840, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.30% (8.0126 => 7.5878, std.dev.: 0.0050) MultiSource/Applications/SPASS/SPASS: -5.30% (15.5079 => 14.6862, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.29% (0.5705 => 0.5403, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.28% (0.5849 => 0.5540, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.28% (0.5570 => 0.5276, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.27% (0.5941 => 0.5628, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.27% (0.2278 => 0.2158, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: -5.26% (0.2985 => 0.2828, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.25% (0.6395 => 0.6059, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -5.24% (3.5154 => 3.3313, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.16% (0.2385 => 0.2262, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.16% (0.5567 => 0.5280, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.15% (1.2221 => 1.1592, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.11% (0.6033 => 0.5725, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -5.09% (15.2527 => 14.4767, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.08% (0.6440 => 0.6113, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.07% (0.4916 => 0.4667, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.06% (0.2548 => 0.2419, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.00% (0.3319 => 0.3153, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.93% (1.6474 => 1.5662, std.dev.: 0.0074) MultiSource/Applications/minisat/minisat: -4.93% (0.7447 => 0.7080, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: -4.93% (0.2659 => 0.2528, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.91% (0.5168 => 0.4914, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -4.90% (1.3148 => 1.2504, std.dev.: 0.0107) MultiSource/Applications/lua/lua: -4.81% (4.0594 => 3.8640, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.78% (0.6194 => 0.5898, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.73% (0.7021 => 0.6689, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.72% (0.4151 => 0.3955, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -4.69% (2.4021 => 2.2895, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.68% (0.3931 => 0.3747, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -4.67% (0.3255 => 0.3103, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -4.67% (2.1401 => 2.0402, std.dev.: 0.0079) SingleSource/UnitTests/ObjC++/Hello: -4.63% (0.6347 => 0.6053, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.62% (0.6297 => 0.6006, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -4.60% (0.3194 => 0.3047, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.59% (0.3837 => 0.3661, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: -4.58% (0.7779 => 0.7423, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.57% (22.4056 => 21.3816, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.56% (2.1713 => 2.0722, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: -4.56% (0.3025 => 0.2887, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.56% (0.5329 => 0.5086, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.54% (0.6304 => 0.6018, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.51% (0.3016 => 0.2880, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -4.50% (0.8418 => 0.8039, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: -4.50% (5.0226 => 4.7968, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: -4.48% (0.4861 => 0.4643, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.48% (0.6189 => 0.5912, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: -4.46% (0.3026 => 0.2891, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.46% (0.3252 => 0.3107, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -4.46% (0.6441 => 0.6154, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.42% (2.2587 => 2.1589, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.42% (0.3057 => 0.2922, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: -4.41% (0.3059 => 0.2924, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.40% (0.3271 => 0.3127, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.36% (0.3323 => 0.3178, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -4.36% (0.7982 => 0.7634, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: -4.35% (0.4248 => 0.4063, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.33% (0.2933 => 0.2806, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -4.31% (0.3481 => 0.3331, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.31% (0.2903 => 0.2778, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -4.29% (0.3446 => 0.3298, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -4.29% (0.2939 => 0.2813, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/strcat: -4.28% (0.2989 => 0.2861, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.28% (0.9557 => 0.9148, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -4.27% (0.3394 => 0.3249, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -4.27% (0.3867 => 0.3702, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -4.24% (18.2933 => 17.5174, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/lists: -4.23% (0.3621 => 0.3468, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -4.21% (0.2871 => 0.2750, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -4.16% (34.0927 => 32.6761, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/hello: -4.14% (0.2849 => 0.2731, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.10% (0.4321 => 0.4144, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.08% (0.3849 => 0.3692, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.07% (0.4813 => 0.4617, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: -4.06% (0.3205 => 0.3075, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.04% (0.4427 => 0.4248, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.02% (0.9077 => 0.8712, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.02% (0.4083 => 0.3919, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -3.85% (0.6750 => 0.6490, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -3.85% (0.4524 => 0.4350, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.70% (0.3491 => 0.3362, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -3.67% (0.3788 => 0.3649, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.40% (5.4682 => 5.2821, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: -3.22% (1.5610 => 1.5108, std.dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -1.79% (20.7746 => 20.4035, std.dev.: 0.0212) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7558, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1729, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.78% (2.2633 => 2.1777, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.66% (6.5735 => 6.4643, std.dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0003) Report Time: 3.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 15 23:53:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 01:53:48 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121116075348.9A7C22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5926?compare_to=5920&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5926, Order: 168137, Start Time: 2012-11-16 05:42:46, End Time: 2012-11-16 07:54:06 To: 5920, Order: 168126, Start Time: 2012-11-16 02:42:03, End Time: 2012-11-16 04:52:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 83 (171 on baseline) Performance Improvements: 11 (41 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 944 (675 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 16.62% (4.6492 => 5.4217, std.dev.: 0.0430) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 16.37% (0.7203 => 0.8382, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 16.07% (0.6329 => 0.7346, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.94% (0.5930 => 0.6875, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 15.26% (0.7208 => 0.8308, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 15.08% (0.6233 => 0.7173, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 14.92% (0.5919 => 0.6802, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 14.73% (0.6301 => 0.7229, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 14.67% (0.8097 => 0.9285, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.48% (0.4537 => 0.5194, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 14.44% (0.6947 => 0.7950, std.dev.: 0.0078) MultiSource/Applications/aha/aha: 14.39% (0.1327 => 0.1518, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.38% (0.5912 => 0.6762, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.19% (2.2400 => 2.5579, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 13.93% (0.6704 => 0.7638, std.dev.: 0.0082) SingleSource/Benchmarks/Stanford/Oscar: 13.74% (0.0786 => 0.0894, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.45% (0.1048 => 0.1189, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 13.41% (1.3356 => 1.5147, std.dev.: 0.0105) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.79% (0.5096 => 0.5748, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 12.65% (0.6231 => 0.7019, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/bmm/bmm: 12.62% (0.0824 => 0.0928) SingleSource/Regression/C++/ofstream_ctor: 12.57% (0.3159 => 0.3556, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.52% (1.7428 => 1.9610, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 12.50% (0.8149 => 0.9168, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.19% (0.5896 => 0.6615, std.dev.: 0.0100) MultiSource/Applications/d/make_dparser: 11.97% (3.7730 => 4.2245, std.dev.: 0.0263) MultiSource/Benchmarks/McCat/08-main/main: 11.79% (0.3120 => 0.3488, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 11.77% (0.8164 => 0.9125, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.34% (0.6604 => 0.7353, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.23% (0.3437 => 0.3823, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/bigfib: 11.17% (0.7227 => 0.8034, std.dev.: 0.0177) MultiSource/Applications/spiff/spiff: 11.15% (0.8944 => 0.9941, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/04-bisect/bisect: 11.01% (0.1208 => 0.1341, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 11.01% (0.1490 => 0.1654, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 10.57% (0.1410 => 0.1559, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 10.41% (1.3280 => 1.4662, std.dev.: 0.0252) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 10.06% (0.1332 => 0.1466, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.05% (0.1532 => 0.1686, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 9.86% (0.1024 => 0.1125, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.72% (0.4055 => 0.4449, std.dev.: 0.0152) MultiSource/Applications/sgefa/sgefa: 9.71% (0.3533 => 0.3876, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 9.42% (0.1794 => 0.1963, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.22% (0.2115 => 0.2310, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.12% (0.6236 => 0.6805, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/power/power: 8.85% (0.1457 => 0.1586, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-3: 8.58% (0.3949 => 0.4288, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.51% (0.5626 => 0.6105, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.31% (0.5053 => 0.5473, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.25% (1.6199 => 1.7535, std.dev.: 0.0095) SingleSource/UnitTests/ObjC/exceptions-2: 7.87% (0.3928 => 0.4237, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.78% (0.9538 => 1.0280, std.dev.: 0.0063) MultiSource/Applications/hbd/hbd: 7.51% (1.7701 => 1.9030, std.dev.: 0.0147) SingleSource/UnitTests/ObjC/exceptions-4: 6.28% (0.3982 => 0.4232, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.16% (0.3976 => 0.4221, std.dev.: 0.0079) MultiSource/Applications/lua/lua: 5.77% (4.6001 => 4.8656, std.dev.: 0.0462) MultiSource/Benchmarks/PAQ8p/paq8p: 4.38% (11.3575 => 11.8550, std.dev.: 0.0252) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.25% (0.4024 => 0.4195, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.73% (1.6048 => 1.6646, std.dev.: 0.0118) SingleSource/UnitTests/Vector/constpool: 2.84% (55.0440 => 56.6077, std.dev.: 0.5037) MultiSource/Applications/JM/ldecod/ldecod: 2.50% (9.5644 => 9.8037, std.dev.: 0.0672) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.36% (11.2358 => 11.5005, std.dev.: 0.0273) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/flops: 28.57% (6.7486 => 8.6769, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 26.96% (3.8056 => 4.8317, std.dev.: 0.0116) SingleSource/Benchmarks/CoyoteBench/fftbench: 22.83% (2.1016 => 2.5813, std.dev.: 0.0774) MultiSource/Applications/JM/ldecod/ldecod: 21.35% (0.1213 => 0.1472, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: 19.13% (4.1881 => 4.9892, std.dev.: 0.0278) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.22% (5.3848 => 6.0968, std.dev.: 0.1955) SingleSource/Benchmarks/Shootout/heapsort: 11.17% (3.9617 => 4.4044, std.dev.: 0.0474) MultiSource/Benchmarks/Bullet/bullet: 10.75% (7.9898 => 8.8484, std.dev.: 0.1004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.49% (9.3052 => 10.0955, std.dev.: 0.0504) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.31% (9.4700 => 10.0675, std.dev.: 0.0869) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.00% (3.1348 => 3.2914, std.dev.: 0.0255) MultiSource/Benchmarks/NPB-serial/is/is: 3.83% (8.6812 => 9.0139, std.dev.: 0.0408) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 3.30% (4.6739 => 4.8283, std.dev.: 0.0298) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.35% (2.8201 => 2.8864, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.09% (4.2400 => 4.3288, std.dev.: 0.0187) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.08% (2.1816 => 2.2269, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.01% (1.5591 => 1.5905, std.dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: 1.84% (0.6305 => 0.6421, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.58% (1.6083 => 1.6337, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.54% (2.1383 => 2.1713, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.28% (4.0897 => 4.1419, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.06% (1.3371 => 1.3513, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -15.02% (0.1944 => 0.1652, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -11.48% (0.3790 => 0.3355, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.21% (0.6537 => 0.5804, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -10.59% (0.4655 => 0.4162, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -9.23% (0.9420 => 0.8551, std.dev.: 0.0317) MultiSource/Applications/siod/siod: -8.03% (2.9261 => 2.6912, std.dev.: 0.0238) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.82% (5.0737 => 4.7279, std.dev.: 0.0798) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -4.88% (6.0255 => 5.7315, std.dev.: 0.0974) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -2.06% (21.3740 => 20.9327, std.dev.: 0.0280) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/ObjC/synchronized: -32.55% (0.1650 => 0.1113, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -16.98% (0.1013 => 0.0841, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.15% (0.1339 => 0.1337, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -15.18% (0.0494 => 0.0419, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.18% (0.0677 => 0.0685, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -0.01% (494.0259 => 493.9970, std.dev.: 0.0978) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0419, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/power/power: 43705.71% (1.1277 => 493.9970, std.dev.: 0.0978) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.84% (0.5229 => 1.5417, std.dev.: 0.0199) MultiSource/Applications/SPASS/SPASS: 23.12% (14.9895 => 18.4558, std.dev.: 0.0292) MultiSource/Applications/kimwitu++/kc: 49.54% (14.1553 => 21.1676, std.dev.: 0.1089) MultiSource/Benchmarks/MallocBench/gs/gs: 20.63% (4.1105 => 4.9586, std.dev.: 0.1908) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 50.67% (1.1048 => 1.6646, std.dev.: 0.0118) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 434.39% (7.1582 => 38.2530, std.dev.: 0.1921) SingleSource/Benchmarks/Misc-C++-EH/spirit: 79.44% (3.4629 => 6.2140, std.dev.: 0.2837) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.88% (0.6222 => 1.0383, std.dev.: 0.0531) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10903.19% (0.0720 => 7.9223, std.dev.: 0.1369) MultiSource/Applications/SIBsim4/SIBsim4: 3859500.00% (0.0001 => 3.8596, std.dev.: 0.0343) MultiSource/Applications/SPASS/SPASS: 14799300.00% (0.0001 => 14.7994, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 51600.00% (0.0001 => 0.0517, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 63800.00% (0.0001 => 0.0639, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14500.00% (0.0001 => 0.0146) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576100.00% (0.0001 => 0.5762, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10082000.00% (0.0001 => 10.0821, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5688300.00% (0.0001 => 5.6884, std.dev.: 0.7363) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1769.99% (1.1194 => 20.9327, std.dev.: 0.0280) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 84.51% (2.9384 => 5.4217, std.dev.: 0.0430) MultiSource/Applications/ClamAV/clamscan: 68.24% (22.1758 => 37.3094, std.dev.: 0.2725) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 63.04% (7.0540 => 11.5005, std.dev.: 0.0273) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.10% (8.1363 => 12.2122, std.dev.: 0.0528) SingleSource/Benchmarks/CoyoteBench/almabench: 49.86% (0.0730 => 0.1094, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 46.91% (21.9371 => 32.2286, std.dev.: 0.1153) MultiSource/Benchmarks/FreeBench/distray/distray: 45.36% (0.1056 => 0.1535, std.dev.: 0.0075) SingleSource/UnitTests/vla: 45.35% (0.0355 => 0.0516, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/Oscar: 40.57% (0.0636 => 0.0894, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 39.11% (0.1432 => 0.1992, std.dev.: 0.0069) SingleSource/UnitTests/block-byref-cxxobj-test: 38.95% (0.0267 => 0.0371, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/08-main/main: 36.57% (0.2554 => 0.3488, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/dot-syntax-1: 36.12% (0.0479 => 0.0652, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 34.78% (0.2700 => 0.3639, std.dev.: 0.0062) MultiSource/Applications/aha/aha: 31.89% (0.1151 => 0.1518, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 31.63% (0.0528 => 0.0695, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/family/family: 31.23% (0.0397 => 0.0521, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 30.65% (0.0672 => 0.0878, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 30.11% (1.1642 => 1.5147, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 29.75% (0.0437 => 0.0567, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 29.10% (0.0567 => 0.0732, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 28.25% (0.7115 => 0.9125, std.dev.: 0.0127) SingleSource/Benchmarks/CoyoteBench/huffbench: 27.90% (0.0871 => 0.1114, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: 27.44% (0.0933 => 0.1189, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 27.26% (0.2065 => 0.2628, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 27.21% (1.5415 => 1.9610, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.11% (0.0793 => 0.1008, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 26.98% (0.0886 => 0.1125, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 26.88% (0.7835 => 0.9941, std.dev.: 0.0044) MultiSource/Applications/d/make_dparser: 26.66% (3.3354 => 4.2245, std.dev.: 0.0263) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 26.59% (0.4103 => 0.5194, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: 26.52% (0.0626 => 0.0792, std.dev.: 0.0046) SingleSource/Benchmarks/Stanford/FloatMM: 26.43% (0.0401 => 0.0507, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 26.27% (0.1062 => 0.1341, std.dev.: 0.0024) MultiSource/Applications/viterbi/viterbi: 26.24% (0.1555 => 0.1963, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 26.16% (0.1032 => 0.1302, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.10% (0.1337 => 0.1686, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.80% (0.8172 => 1.0280, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 25.66% (0.0834 => 0.1048, std.dev.: 0.0015) MultiSource/Applications/lua/lua: 25.65% (3.8723 => 4.8656, std.dev.: 0.0462) SingleSource/Benchmarks/Stanford/Towers: 24.84% (0.0471 => 0.0588, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 24.67% (0.3109 => 0.3876, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.66% (0.0746 => 0.0930, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: 24.44% (0.6456 => 0.8034, std.dev.: 0.0177) SingleSource/Benchmarks/CoyoteBench/fftbench: 23.99% (0.4636 => 0.5748, std.dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 23.83% (1.1840 => 1.4662, std.dev.: 0.0252) MultiSource/Benchmarks/Prolangs-C++/city/city: 23.78% (2.0665 => 2.5579, std.dev.: 0.0113) MultiSource/Applications/oggenc/oggenc: 23.31% (5.7591 => 7.1015, std.dev.: 0.0824) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.02% (1.4186 => 1.7451, std.dev.: 0.0153) SingleSource/Benchmarks/Stanford/Puzzle: 22.95% (0.1268 => 0.1559, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 22.67% (0.3441 => 0.4221, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 22.41% (0.3427 => 0.4195, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 22.41% (0.2905 => 0.3556, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: 22.39% (0.0536 => 0.0656, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/bmm/bmm: 22.27% (0.0759 => 0.0928) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 22.09% (0.1892 => 0.2310, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 21.96% (1.5603 => 1.9030, std.dev.: 0.0147) SingleSource/UnitTests/ObjC/exceptions-3: 21.96% (0.3516 => 0.4288, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.92% (0.3121 => 0.3805, std.dev.: 0.0091) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.90% (0.1566 => 0.1909, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 21.89% (0.3650 => 0.4449, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/functionobjects: 21.61% (0.5020 => 0.6105, std.dev.: 0.0146) SingleSource/UnitTests/ObjC/exceptions-2: 21.16% (0.3497 => 0.4237, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 20.98% (14.3668 => 17.3814, std.dev.: 0.1433) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 20.90% (0.3162 => 0.3823, std.dev.: 0.0114) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 20.86% (0.2430 => 0.2937, std.dev.: 0.0030) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.83% (0.1584 => 0.1914, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 20.64% (1.5859 => 1.9132, std.dev.: 0.0877) MultiSource/Benchmarks/Olden/tsp/tsp: 20.43% (0.1175 => 0.1415, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 19.80% (0.0798 => 0.0956, std.dev.: 0.0029) SingleSource/UnitTests/initp1: 19.64% (0.0555 => 0.0664, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 19.45% (0.3543 => 0.4232, std.dev.: 0.0033) SingleSource/UnitTests/SignlessTypes/rem: 18.88% (0.1144 => 0.1360, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.58% (0.1125 => 0.1334, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 18.50% (9.4845 => 11.2393, std.dev.: 0.1135) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 18.29% (0.1695 => 0.2005, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/fbench: 17.74% (0.0592 => 0.0697, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.70% (0.0842 => 0.0991, std.dev.: 0.0054) MultiSource/Applications/siod/siod: 17.17% (2.2969 => 2.6912, std.dev.: 0.0238) SingleSource/UnitTests/ObjC/messages-2: 16.77% (0.0662 => 0.0773, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.67% (0.0648 => 0.0756, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: 16.61% (0.3828 => 0.4464, std.dev.: 0.0108) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 16.58% (0.1906 => 0.2222, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.50% (4.2646 => 4.9684, std.dev.: 0.1322) MultiSource/Benchmarks/Olden/mst/mst: 16.34% (0.1163 => 0.1353, std.dev.: 0.0067) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.05% (0.0953 => 0.1106, std.dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: 15.99% (17.1811 => 19.9275, std.dev.: 0.2422) SingleSource/Benchmarks/Shootout/matrix: 15.77% (0.0818 => 0.0947, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.75% (0.4615 => 0.5342, std.dev.: 0.0189) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.40% (0.1117 => 0.1289, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.32% (0.0770 => 0.0888, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.08% (0.2758 => 0.3174, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.07% (4.9449 => 5.6900, std.dev.: 0.0717) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.06% (0.0770 => 0.0886, std.dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: 15.04% (0.7433 => 0.8551, std.dev.: 0.0317) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.93% (0.0730 => 0.0839, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.77% (2.2022 => 2.5275, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.59% (5.0018 => 5.7315, std.dev.: 0.0974) MultiSource/Benchmarks/NPB-serial/is/is: 14.46% (0.0719 => 0.0823, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 14.38% (63.2438 => 72.3363, std.dev.: 0.2893) MultiSource/Benchmarks/PAQ8p/paq8p: 14.35% (10.3673 => 11.8550, std.dev.: 0.0252) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 14.34% (0.8101 => 0.9263, std.dev.: 0.0334) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.29% (0.1029 => 0.1176, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 14.28% (1.3050 => 1.4914, std.dev.: 0.0678) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.99% (0.5981 => 0.6818, std.dev.: 0.0232) MultiSource/Applications/hexxagon/hexxagon: 13.92% (1.2842 => 1.4630, std.dev.: 0.0578) SingleSource/Benchmarks/Shootout-C++/nestedloop: 13.75% (0.2793 => 0.3177, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.51% (0.1510 => 0.1714, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/block-byref-aggr: 13.44% (0.3817 => 0.4330, std.dev.: 0.0071) MultiSource/Applications/treecc/treecc: 13.02% (2.0273 => 2.2912, std.dev.: 0.0014) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.95% (0.1143 => 0.1291, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 12.38% (0.3927 => 0.4413, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 12.26% (0.1044 => 0.1172, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.17% (0.4879 => 0.5473, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 12.02% (0.3694 => 0.4138, std.dev.: 0.0143) SingleSource/UnitTests/ObjC/property: 12.02% (0.3886 => 0.4353, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.81% (0.8067 => 0.9020, std.dev.: 0.0095) SingleSource/UnitTests/ObjC/trivial-interface: 11.72% (0.3473 => 0.3880, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.66% (0.3543 => 0.3956, std.dev.: 0.0099) SingleSource/UnitTests/ObjC/synchronized: 11.51% (0.3561 => 0.3971, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 10.14% (0.1440 => 0.1586, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference-object: 10.08% (0.6030 => 0.6638, std.dev.: 0.0162) SingleSource/UnitTests/ObjC++/Hello: 9.74% (0.5925 => 0.6502, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.78% (0.3826 => 0.4162, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.98% (0.3136 => 0.3355, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: 4.51% (54.1659 => 56.6077, std.dev.: 0.5037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.49% (7.9617 => 8.2399, std.dev.: 0.0896) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.65% (4.3953 => 11.0169, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/methcall: 147.54% (5.3999 => 13.3668, std.dev.: 0.0054) MultiSource/Benchmarks/llubenchmark/llu: 83.99% (3.7781 => 6.9514, std.dev.: 0.8646) SingleSource/Benchmarks/Shootout/ary3: 34.87% (3.6994 => 4.9892, std.dev.: 0.0278) SingleSource/Benchmarks/CoyoteBench/fftbench: 26.78% (2.0360 => 2.5813, std.dev.: 0.0774) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 22.67% (13.4384 => 16.4850, std.dev.: 0.1830) MultiSource/Applications/minisat/minisat: 18.42% (9.1159 => 10.7951, std.dev.: 0.0965) SingleSource/Benchmarks/Misc/oourafft: 17.50% (6.6465 => 7.8095, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.97% (1.1145 => 1.3036, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 16.30% (8.6802 => 10.0955, std.dev.: 0.0504) SingleSource/Benchmarks/Shootout/heapsort: 14.32% (3.8526 => 4.4044, std.dev.: 0.0474) MultiSource/Applications/JM/ldecod/ldecod: 13.41% (0.1298 => 0.1472, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.94% (0.2944 => 0.3325, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.65% (2.8904 => 3.2270, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 10.25% (1.1396 => 1.2564, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.31% (1.7254 => 1.8860, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.59% (0.3070 => 0.3303, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/lpbench: 7.43% (10.3460 => 11.1149, std.dev.: 0.2701) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.69% (4.2280 => 4.4687, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 5.55% (26.0924 => 27.5418, std.dev.: 0.1071) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.04% (3.1334 => 3.2914, std.dev.: 0.0255) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.6436 => 12.1308, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.94% (2.1424 => 2.2269, std.dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 3.18% (0.6223 => 0.6421, std.dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/dry: 2.77% (2.4116 => 2.4785, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.71% (3.6395 => 3.7383, std.dev.: 0.0246) SingleSource/Benchmarks/Dhrystone/fldry: 2.32% (1.9577 => 2.0031, std.dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: 2.26% (4.6441 => 4.7492, std.dev.: 0.0381) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.20% (1.7133 => 1.7510, std.dev.: 0.0117) MultiSource/Applications/aha/aha: 2.14% (3.1595 => 3.2272, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 1.99% (85.0658 => 86.7591, std.dev.: 0.0347) MultiSource/Benchmarks/mafft/pairlocalalign: 1.46% (27.8444 => 28.2513, std.dev.: 0.0088) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.37% (6.5088 => 6.5979, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.32% (5.2139 => 5.2828, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/lists: 1.31% (12.5348 => 12.6987, std.dev.: 0.0233) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0499, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1681, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/salsa20: -75.73% (0.8651 => 0.2100, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.54% (5.2763 => 1.2906, std.dev.: 0.0231) SingleSource/Benchmarks/Misc/richards_benchmark: -44.45% (0.1622 => 0.0901, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.67% (5.3526 => 4.7279, std.dev.: 0.0798) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.58% (5.3855 => 4.9232, std.dev.: 0.0803) MultiSource/Applications/JM/ldecod/ldecod: -6.06% (10.4361 => 9.8037, std.dev.: 0.0672) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.92% (0.0506 => 0.0304, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.78% (0.3987 => 0.2401, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.33% (4.5009 => 2.7755, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.15% (2.6546 => 2.0136, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -19.30% (0.2161 => 0.1744, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -17.39% (10.7105 => 8.8484, std.dev.: 0.1004) SingleSource/Benchmarks/Misc/flops-6: -15.79% (1.6925 => 1.4253, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2841, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.71% (32.5116 => 29.0280, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.83% (1.5660 => 1.4278, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4792, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.66% (3.2416 => 3.0256, std.dev.: 0.0255) MultiSource/Benchmarks/NPB-serial/is/is: -5.75% (9.5636 => 9.0139, std.dev.: 0.0408) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5759, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5074, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/lists: -4.37% (6.2999 => 6.0244, std.dev.: 0.0106) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.22% (19.9488 => 19.1074, std.dev.: 0.1683) MultiSource/Applications/siod/siod: -3.34% (3.2827 => 3.1729, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8919, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.78% (1.6805 => 1.6337, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.57% (0.9957 => 0.9701, std.dev.: 0.0034) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.25% (0.4808 => 0.4700, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.80% (8.1563 => 8.0091, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6769, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -1.48% (10.2830 => 10.1312, std.dev.: 0.0015) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.97% (0.1485 => 0.1337, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.63% (0.2116 => 0.0685, std.dev.: 0.0001) Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 01:00:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 03:00:04 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121116090004.A3CBA2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5927?compare_to=5924&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5927, Order: 168142, Start Time: 2012-11-16 07:29:08, End Time: 2012-11-16 09:00:23 To: 5924, Order: 168137, Start Time: 2012-11-16 05:42:58, End Time: 2012-11-16 07:12:19 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 6 (73 on baseline) Performance Improvements: 7 (23 on baseline) Added Tests: 2 (2 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 979 (878 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.98% (0.1253 => 0.1353, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.42% (6.8515 => 7.1544, std.dev.: 0.1106) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.42% (40.0181 => 41.3874, std.dev.: 0.4649) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.04% (4.9496 => 5.0009, std.dev.: 0.0178) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.02% (2.3802 => 2.4044, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/methcall: 1.00% (8.1815 => 8.2637, std.dev.: 0.0162) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.25% (0.3174 => 0.3039, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.95% (0.8042 => 0.7805, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -2.03% (1.2925 => 1.2663, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.52% (4.7489 => 4.6767, std.dev.: 0.0256) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: -7.42% (0.2171 => 0.2010, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -3.95% (22.0990 => 21.2264, std.dev.: 0.2663) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.86% (60.5517 => 58.8194, std.dev.: 0.5962) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.58% (16.8497 => 16.9467, std.dev.: 0.0624) MultiSource/Applications/obsequi/Obsequi: -0.55% (1.0727 => 1.0668, std.dev.: 0.0067) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.06% (21.9887 => 22.4417, std.dev.: 0.7664) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.14% (0.3689 => 0.3684, std.dev.: 0.1201) SingleSource/Benchmarks/Misc-C++/bigfib: 1.22% (0.6123 => 0.6198, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.42% (0.3351 => 0.3365, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/strcat: 1.89% (0.2008 => 0.2046, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.46% (0.0218 => 0.0219, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0428 => 0.0427, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 16.08% (0.0286 => 0.0332, std.dev.: 0.0098) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 21.54% (0.0260 => 0.0316, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.94% (0.0427 => 0.0431, std.dev.: 0.0115) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0205 => 0.0204, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0218 => 0.0218, std.dev.: 0.0055) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -2.81% (0.1528 => 0.1485, std.dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.39% (1.1222 => 1.1378, std.dev.: 0.0330) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.93% (0.4199 => 0.4490, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.93% (0.1398 => 0.1371, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 300.00% (0.0002 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.76% (0.0605 => 0.0658, std.dev.: 0.0306) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.86% (0.0241 => 0.0272, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.08% (0.0578 => 0.0590, std.dev.: 0.0145) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.06% (1.1960 => 1.1953, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -13.64% (0.0022 => 0.0019, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -90.91% (0.0011 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.10% (0.0607 => 0.0644, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.53% (0.0266 => 0.0230, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.45% (0.7857 => 0.7822, std.dev.: 0.0171) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: -50.00% (0.0002 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -7.81% (0.0064 => 0.0059, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2311.51% (0.6332 => 15.2697, std.dev.: 0.1256) MultiSource/Benchmarks/McCat/08-main/main: 51.94% (0.1831 => 0.2782, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.20% (0.1559 => 0.1478, std.dev.: 0.0329) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1543.78% (0.3344 => 5.4968, std.dev.: 0.0656) SingleSource/Benchmarks/Misc-C++/Large/ray: 39.81% (0.2364 => 0.3305, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/mandel: 4.20% (0.0429 => 0.0447, std.dev.: 0.0087) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.14% (0.0224 => 0.0240, std.dev.: 0.0080) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 11.42% (0.1462 => 0.1629, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4616, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0703, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4915, std.dev.: 0.1034) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3211, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1419, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4148, std.dev.: 0.0102) SingleSource/Regression/C/uint64_to_float: -23.69% (2.1832 => 1.6659, std.dev.: 0.0197) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.37% (0.0810 => 0.0975, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 14.39% (0.1112 => 0.1272, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.98% (0.0830 => 0.0946, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.48% (0.2180 => 0.2343, std.dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.95% (0.3137 => 0.3355, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.42% (1.1606 => 1.2351, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.35% (0.4847 => 0.5155, std.dev.: 0.0066) MultiSource/Applications/spiff/spiff: 5.92% (0.7950 => 0.8421, std.dev.: 0.0047) MultiSource/Applications/Burg/burg: 5.66% (1.2222 => 1.2914, std.dev.: 0.0091) MultiSource/Applications/sgefa/sgefa: 5.20% (0.2999 => 0.3155, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.20% (0.2519 => 0.2650, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.44% (0.7473 => 0.7805, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.26% (0.4559 => 0.4753, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.17% (0.9435 => 0.9828, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.02% (0.4127 => 0.4293, std.dev.: 0.0050) MultiSource/Applications/SPASS/SPASS: 3.86% (14.2605 => 14.8109, std.dev.: 0.0290) MultiSource/Benchmarks/McCat/05-eks/eks: 3.75% (0.4397 => 0.4562, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 3.69% (3.8189 => 3.9597, std.dev.: 0.0215) MultiSource/Applications/hexxagon/hexxagon: 3.63% (0.9810 => 1.0166, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.55% (1.1170 => 1.1567, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.44% (1.2526 => 1.2957, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/18-imp/imp: 3.20% (0.3503 => 0.3615, std.dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 3.11% (1.1271 => 1.1622, std.dev.: 0.0122) MultiSource/Applications/siod/siod: 3.08% (2.2184 => 2.2867, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 3.00% (0.8069 => 0.8311, std.dev.: 0.0059) MultiSource/Applications/ClamAV/clamscan: 2.95% (14.7684 => 15.2034, std.dev.: 0.0715) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.94% (0.8697 => 0.8953, std.dev.: 0.0081) MultiSource/Applications/minisat/minisat: 2.88% (0.6834 => 0.7031, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.83% (2.1401 => 2.2007, std.dev.: 0.0111) MultiSource/Applications/d/make_dparser: 2.79% (3.2366 => 3.3269, std.dev.: 0.0225) MultiSource/Applications/JM/ldecod/ldecod: 2.70% (6.7320 => 6.9138, std.dev.: 0.0115) MultiSource/Applications/JM/lencod/lencod: 2.65% (15.3280 => 15.7338, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.57% (0.6227 => 0.6387, std.dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: 2.54% (0.7557 => 0.7749, std.dev.: 0.0066) MultiSource/Applications/SIBsim4/SIBsim4: 2.50% (1.2568 => 1.2882, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.46% (0.8050 => 0.8248, std.dev.: 0.0058) MultiSource/Applications/oggenc/oggenc: 2.38% (4.9628 => 5.0808, std.dev.: 0.0261) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.37% (0.7966 => 0.8155, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.33% (4.5702 => 4.6767, std.dev.: 0.0256) MultiSource/Benchmarks/PAQ8p/paq8p: 2.31% (2.3764 => 2.4314, std.dev.: 0.0208) MultiSource/Applications/lemon/lemon: 2.06% (1.0945 => 1.1171, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 131.66% (0.0199 => 0.0461, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/pi: 58.51% (1.5795 => 2.5037, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.34% (2.9753 => 3.4616, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.15% (0.7597 => 0.8824, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.71% (2.7995 => 3.2112, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.19% (6.3772 => 7.1544, std.dev.: 0.1106) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.49% (5.0261 => 5.6037, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.91% (1.1857 => 1.2795, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/queens: 7.17% (1.7056 => 1.8279, std.dev.: 0.0445) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.74% (4.7794 => 5.1017, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: 6.46% (1.3037 => 1.3879, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.90% (4.9686 => 5.2618, std.dev.: 0.0196) MultiSource/Applications/SIBsim4/SIBsim4: 5.86% (3.1873 => 3.3740, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.82% (4.5327 => 4.7965, std.dev.: 0.0280) MultiSource/Applications/lambda-0_1_3/lambda: 4.53% (7.4933 => 7.8328, std.dev.: 0.0525) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.45% (3.3761 => 3.5263, std.dev.: 0.0374) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.21% (4.9453 => 5.1533, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.99% (4.9469 => 5.1442, std.dev.: 0.0093) MultiSource/Applications/hexxagon/hexxagon: 3.82% (14.0064 => 14.5416, std.dev.: 0.0256) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.41% (4.8362 => 5.0009, std.dev.: 0.0178) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.26% (0.3587 => 0.3704, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 2.96% (3.6643 => 3.7729, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.79% (11.5690 => 11.8914, std.dev.: 0.0386) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.68% (8.2783 => 8.5003, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout/lists: 2.42% (7.3375 => 7.5148, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.26% (4.8660 => 4.9762, std.dev.: 0.0184) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.10% (1.1365 => 1.1604, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: 1.58% (1.2061 => 1.2251, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.55% (3.5679 => 3.6231, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/neural/neural: 1.30% (1.0841 => 1.0982, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: 1.07% (2.1224 => 2.1451, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.02% (2.9096 => 2.9393, std.dev.: 0.0113) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -30.77% (0.0338 => 0.0234, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: -21.15% (5.4641 => 4.3087, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -15.07% (7.2130 => 6.1260, std.dev.: 0.1335) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.73% (1.0512 => 0.9384, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -8.35% (63.1822 => 57.9080, std.dev.: 0.0884) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.00% (14.6451 => 13.4741, std.dev.: 0.2342) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -7.00% (4.7482 => 4.4158, std.dev.: 0.0746) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.94% (3.7148 => 3.4941, std.dev.: 0.0329) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.14% (5.1557 => 4.8909, std.dev.: 0.0421) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.81% (22.2997 => 21.2264, std.dev.: 0.2663) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.87% (6.0224 => 5.7896, std.dev.: 0.0093) MultiSource/Applications/lua/lua: -3.35% (29.8330 => 28.8348, std.dev.: 0.0857) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.34% (0.5807 => 0.5613, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (28.5821 => 27.6994, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.64% (2.6356 => 2.5659, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.60% (3.2169 => 3.1334, std.dev.: 0.0297) MultiSource/Applications/aha/aha: -2.24% (3.3398 => 3.2651, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.94% (11.5316 => 11.3077, std.dev.: 0.0428) MultiSource/Benchmarks/FreeBench/mason/mason: -1.85% (0.5415 => 0.5315, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.82% (2.4490 => 2.4044, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.66% (2.3487 => 2.3098, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.55% (4.9994 => 4.9217, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.17% (5.6343 => 5.5684, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 3.04% (16.4461 => 16.9467, std.dev.: 0.0624) MultiSource/Applications/obsequi/Obsequi: 3.96% (1.0262 => 1.0668, std.dev.: 0.0067) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7085.94% (0.3123 => 22.4417, std.dev.: 0.7664) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.57% (0.2463 => 0.3684, std.dev.: 0.1201) SingleSource/Benchmarks/Misc-C++/bigfib: 3.13% (0.6010 => 0.6198, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.03% (0.3266 => 0.3365, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/strcat: 3.91% (0.1969 => 0.2046, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0098) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 12.24% (0.0384 => 0.0431, std.dev.: 0.0115) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0055) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 3.27% (0.1438 => 0.1485, std.dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.43% (1.1329 => 1.1378, std.dev.: 0.0330) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 7.83% (0.4164 => 0.4490, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.15% (0.1369 => 0.1371, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.65% (0.0641 => 0.0658, std.dev.: 0.0306) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 39.49% (0.0195 => 0.0272, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.08% (0.0578 => 0.0590, std.dev.: 0.0145) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.51% (1.1437 => 1.1953, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1800.00% (0.0001 => 0.0019, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.71% (0.0627 => 0.0644, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 27.78% (0.0180 => 0.0230, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.43% (0.8017 => 0.7822, std.dev.: 0.0171) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -4.84% (0.0062 => 0.0059, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 01:16:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 03:16:08 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121116091608.4E7A92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5928?compare_to=5925&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5928, Order: 168142, Start Time: 2012-11-16 07:40:15, End Time: 2012-11-16 09:16:28 To: 5925, Order: 168137, Start Time: 2012-11-16 05:52:25, End Time: 2012-11-16 07:17:17 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (133 on baseline) Added Tests: 2 (2 on baseline) Unchanged Tests: 1042 (904 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1009, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/salsa20: 2.40% (7.4937 => 7.6739, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/hash2: 2.19% (3.1932 => 3.2632, std.dev.: 0.0113) MultiSource/Benchmarks/llubenchmark/llu: 1.37% (3.7435 => 3.7949, std.dev.: 0.0191) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.74% (0.1431 => 0.1306, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.90% (0.3821 => 0.3519, std.dev.: 0.0061) MultiSource/Benchmarks/PAQ8p/paq8p: -7.37% (2.4924 => 2.3087, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.67% (0.9542 => 0.8906, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.30% (0.3142 => 0.2944, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/oourafft: -6.20% (0.2160 => 0.2026, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -6.19% (16.1920 => 15.1892, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.18% (0.1796 => 0.1685, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -6.14% (0.3357 => 0.3151, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -6.13% (9.2283 => 8.6628, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/ReedSolomon: -6.07% (0.1879 => 0.1765, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.99% (0.7198 => 0.6767, std.dev.: 0.0075) MultiSource/Applications/JM/ldecod/ldecod: -5.98% (7.0961 => 6.6719, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.90% (0.9852 => 0.9271, std.dev.: 0.0220) SingleSource/UnitTests/ObjC/trivial-interface: -5.88% (0.3812 => 0.3588, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.85% (0.1761 => 0.1658, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: -5.80% (0.9179 => 0.8647, std.dev.: 0.0193) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.77% (4.8161 => 4.5382, std.dev.: 0.1078) SingleSource/UnitTests/ObjC/for-in: -5.75% (0.4033 => 0.3801, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.71% (0.2695 => 0.2541, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.71% (0.3891 => 0.3669, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.70% (0.3406 => 0.3212, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -5.69% (1.1450 => 1.0798, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -5.69% (0.3831 => 0.3613, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.69% (0.3884 => 0.3663, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.68% (0.5805 => 0.5475, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.68% (4.8802 => 4.6029, std.dev.: 0.0904) SingleSource/UnitTests/ObjC/synchronized: -5.67% (0.3896 => 0.3675, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.65% (0.4176 => 0.3940, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.65% (1.2300 => 1.1605, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.65% (0.5863 => 0.5532, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.64% (0.2428 => 0.2291, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/exceptions-3: -5.64% (0.3848 => 0.3631, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.63% (3.5339 => 3.3351, std.dev.: 0.0191) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.61% (4.5069 => 4.2540, std.dev.: 0.0857) SingleSource/UnitTests/ObjC/exceptions-4: -5.59% (0.3880 => 0.3663, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.55% (6.7716 => 6.3961, std.dev.: 0.1431) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.53% (0.6660 => 0.6292, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -5.50% (1.1530 => 1.0896, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.47% (0.5575 => 0.5270, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: -5.47% (0.4515 => 0.4268, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: -5.44% (17.1032 => 16.1729, std.dev.: 0.0223) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.42% (1.2784 => 1.2091, std.dev.: 0.0268) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.38% (0.5688 => 0.5382, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.34% (0.5859 => 0.5546, std.dev.: 0.0067) MultiSource/Applications/SIBsim4/SIBsim4: -5.33% (1.3864 => 1.3125, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.30% (0.6736 => 0.6379, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -5.26% (0.4199 => 0.3978, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.26% (0.6260 => 0.5931, std.dev.: 0.0113) MultiSource/Benchmarks/McCat/18-imp/imp: -5.25% (0.3581 => 0.3393, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.24% (0.6395 => 0.6060, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.22% (0.5456 => 0.5171, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.18% (0.5941 => 0.5633, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.12% (0.6033 => 0.5724, std.dev.: 0.0074) SingleSource/UnitTests/ObjC/parameter-passing: -5.12% (0.4280 => 0.4061, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.08% (0.6440 => 0.6113, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.07% (0.5567 => 0.5285, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.06% (0.2985 => 0.2834, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: -5.06% (1.2515 => 1.1882, std.dev.: 0.0058) MultiSource/Applications/SPASS/SPASS: -5.04% (15.5079 => 14.7258, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.02% (0.2548 => 0.2420, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: -4.99% (3.5154 => 3.3401, std.dev.: 0.0065) MultiSource/Applications/ClamAV/clamscan: -4.95% (15.2527 => 14.4971, std.dev.: 0.0164) MultiSource/Benchmarks/McCat/08-main/main: -4.85% (0.2659 => 0.2530, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -4.84% (4.0594 => 3.8628, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.75% (1.6474 => 1.5692, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.74% (0.5168 => 0.4923, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: -4.74% (0.7447 => 0.7094, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.63% (0.6194 => 0.5907, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.56% (0.5329 => 0.5086, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -4.53% (2.4021 => 2.2934, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.52% (0.7021 => 0.6704, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.51% (22.4056 => 21.3941, std.dev.: 0.0236) MultiSource/Benchmarks/McCat/09-vor/vor: -4.49% (0.3271 => 0.3124, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: -4.48% (2.1401 => 2.0443, std.dev.: 0.0060) MultiSource/Applications/oggenc/oggenc: -4.39% (5.0226 => 4.8021, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.35% (2.2587 => 2.1604, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.19% (0.4151 => 0.3977, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.19% (0.6347 => 0.6081, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -4.17% (1.3148 => 1.2600, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -4.12% (0.8418 => 0.8071, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.07% (0.3837 => 0.3681, std.dev.: 0.0033) MultiSource/Applications/kimwitu++/kc: -4.06% (18.2933 => 17.5502, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.02% (0.3931 => 0.3773, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -4.01% (0.7982 => 0.7662, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.96% (0.9557 => 0.9179, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: -3.93% (0.3025 => 0.2906, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: -3.93% (0.7779 => 0.7473, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference-object: -3.91% (0.6441 => 0.6189, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.89% (0.3057 => 0.2938, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.85% (0.2933 => 0.2820, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: -3.82% (0.3194 => 0.3072, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -3.81% (0.2939 => 0.2827, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -3.78% (34.0927 => 32.8051, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.75% (0.2903 => 0.2794, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.75% (0.3016 => 0.2903, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.74% (2.1713 => 2.0902, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout-C++/moments: -3.72% (0.4248 => 0.4090, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/matrix: -3.72% (0.3255 => 0.3134, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -3.70% (0.3621 => 0.3487, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -3.67% (0.3867 => 0.3725, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -3.67% (0.3026 => 0.2915, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -3.66% (0.2871 => 0.2766, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.66% (0.4813 => 0.4637, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: -3.66% (0.3446 => 0.3320, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -3.65% (0.2849 => 0.2745, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -3.62% (0.3481 => 0.3355, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -3.61% (0.2989 => 0.2881, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.60% (0.3252 => 0.3135, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -3.60% (0.3059 => 0.2949, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.58% (0.3491 => 0.3366, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -3.57% (0.3394 => 0.3273, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -3.56% (0.4861 => 0.4688, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.53% (0.3849 => 0.3713, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -3.53% (0.3205 => 0.3092, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.46% (0.4427 => 0.4274, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: -3.45% (0.6750 => 0.6517, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.40% (0.4083 => 0.3944, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: -3.23% (0.4524 => 0.4378, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.12% (5.4682 => 5.2976, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: -3.01% (0.3788 => 0.3674, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.01% (0.3323 => 0.3223, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: -2.26% (1.5610 => 1.5257, std.dev.: 0.0022) SingleSource/UnitTests/Vector/constpool: -1.79% (20.7746 => 20.4017, std.dev.: 0.0284) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7519, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: -3.78% (2.2633 => 2.1778, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.14% (1.0557 => 1.0226, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.15% (1.3096 => 1.2814, std.dev.: 0.0104) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4721, std.dev.: 0.0136) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 02:00:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 04:00:44 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121116100044.2994E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5929?compare_to=5923&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5929, Order: 168137, Start Time: 2012-11-16 06:43:24, End Time: 2012-11-16 10:01:02 To: 5923, Order: 168126, Start Time: 2012-11-16 02:40:11, End Time: 2012-11-16 05:55:41 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (168 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1044 (725 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.36% (0.0625 => 0.0871) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.51% (0.1063 => 0.1398, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.47% (0.0714 => 0.0903, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.33% (0.4253 => 0.5373, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.10% (0.2969 => 0.3744, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.68% (0.1106 => 0.1390, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.13% (0.4139 => 0.5179, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.63% (0.0475 => 0.0592, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.27% (0.4994 => 0.6206, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.22% (0.5900 => 0.7329, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.48% (0.5000 => 0.6174, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.46% (0.0584 => 0.0721, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.40% (0.0547 => 0.0675, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 23.22% (1.5932 => 1.9632, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.84% (0.1620 => 0.1990, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.72% (0.1021 => 0.1253, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 22.54% (0.0599 => 0.0734, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.96% (0.0897 => 0.1094, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.95% (0.1107 => 0.1350, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.76% (0.1549 => 0.1886, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/em3d/em3d: 21.41% (0.0948 => 0.1151, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.34% (0.0642 => 0.0779, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.33% (0.0633 => 0.0768, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.23% (0.0584 => 0.0708, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.21% (0.1103 => 0.1337, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 20.95% (0.0821 => 0.0993, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.81% (0.0495 => 0.0598, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.74% (0.1003 => 0.1211, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.68% (0.0822 => 0.0992, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.64% (0.1604 => 0.1935, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.57% (0.3903 => 0.4706, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 20.26% (0.1619 => 0.1947, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 19.43% (0.0947 => 0.1131, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.29% (0.1462 => 0.1744, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 19.18% (0.0808 => 0.0963, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 19.14% (0.5826 => 0.6941, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.97% (0.2736 => 0.3255, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.92% (0.2014 => 0.2395, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 18.80% (0.1218 => 0.1447, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 18.78% (0.5889 => 0.6995, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.77% (0.3890 => 0.4620, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.47% (1.3152 => 1.5581, std.dev.: 0.0026) MultiSource/Applications/spiff/spiff: 18.37% (0.4029 => 0.4769, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/mst/mst: 18.34% (0.0698 => 0.0826, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 18.21% (0.1505 => 0.1779, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.01% (0.1088 => 0.1284, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.00% (0.2866 => 0.3382, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 17.67% (0.5546 => 0.6526, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.66% (0.0572 => 0.0673, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 17.63% (1.8794 => 2.2107, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.63% (0.0573 => 0.0674, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.60% (3.5627 => 4.1896, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.57% (0.5026 => 0.5909, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.43% (0.2875 => 0.3376, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.32% (1.6211 => 1.9018, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.17% (0.4658 => 0.5458, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.15% (0.3271 => 0.3832, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.12% (0.1968 => 0.2305, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 16.93% (0.7171 => 0.8385, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: 16.90% (0.1284 => 0.1501, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.90% (0.1160 => 0.1356, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.90% (0.3930 => 0.4594, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 16.82% (0.1421 => 0.1660, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 16.73% (0.2725 => 0.3181, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 16.73% (0.2750 => 0.3210, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.58% (0.2738 => 0.3192, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 16.57% (0.9697 => 1.1304, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.56% (2.7292 => 3.1811, std.dev.: 0.0076) MultiSource/Applications/d/make_dparser: 16.56% (1.0781 => 1.2566, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/except: 16.54% (0.2811 => 0.3276) SingleSource/Benchmarks/Shootout-C++/objinst: 16.47% (0.2823 => 0.3288, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 16.47% (0.2714 => 0.3161, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 16.46% (0.2813 => 0.3276, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 16.41% (0.2803 => 0.3263, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.37% (0.4361 => 0.5075, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.34% (0.2729 => 0.3175, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 16.33% (0.2780 => 0.3234, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 16.11% (0.3004 => 0.3488, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 16.08% (4.2109 => 4.8880, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.97% (0.2911 => 0.3376, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 15.97% (0.9909 => 1.1491, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.94% (1.9694 => 2.2834, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/wc: 15.92% (0.3096 => 0.3589, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.92% (4.4195 => 5.1232, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.87% (0.2792 => 0.3235, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.77% (0.3195 => 0.3699, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.75% (2.0673 => 2.3930, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary3: 15.73% (0.3267 => 0.3781, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 15.59% (0.3258 => 0.3766, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 15.57% (23.5202 => 27.1823, std.dev.: 0.0274) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.41% (1.9966 => 2.3043, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.32% (0.1090 => 0.1257, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.16% (0.3060 => 0.3524, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 15.16% (0.2566 => 0.2955, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.11% (0.3362 => 0.3870, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 15.07% (0.3317 => 0.3817, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 15.03% (0.3446 => 0.3964, std.dev.: 0.0085) SingleSource/UnitTests/ObjC/synchronized: 14.96% (0.3469 => 0.3988, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 14.93% (0.3442 => 0.3956, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 14.93% (0.3496 => 0.4018, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 14.91% (0.3460 => 0.3976, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 14.86% (0.3465 => 0.3980, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 14.85% (0.3678 => 0.4224, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 14.84% (1.4269 => 1.6387, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.82% (0.3124 => 0.3587, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.74% (0.3488 => 0.4002, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 14.71% (0.4146 => 0.4756, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: 14.65% (0.2075 => 0.2379, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 14.61% (0.3348 => 0.3837, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.59% (0.3282 => 0.3761, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 14.58% (0.3477 => 0.3984, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 14.55% (0.7875 => 0.9021, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 14.49% (0.3650 => 0.4179, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 14.41% (0.3726 => 0.4263, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 14.41% (0.3643 => 0.4168, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 14.26% (0.3724 => 0.4255, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.07% (0.3690 => 0.4209, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 14.05% (2.1653 => 2.4695, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.94% (0.3981 => 0.4536, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 13.90% (0.4251 => 0.4842, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.78% (0.3845 => 0.4375, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 13.44% (4.6177 => 5.2384, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 13.42% (2.1013 => 2.3832, std.dev.: 0.0126) MultiSource/Benchmarks/sim/sim: 13.32% (0.0758 => 0.0859, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 13.27% (0.2691 => 0.3048, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.94% (0.2040 => 0.2304, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 12.64% (5.5417 => 6.2419, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.29% (0.6435 => 0.7226, std.dev.: 0.0127) MultiSource/Applications/siod/siod: 11.64% (0.6634 => 0.7406, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.58% (0.1028 => 0.1147, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.22% (0.2737 => 0.3044, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 11.12% (0.3498 => 0.3887, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.92% (0.1383 => 0.1534, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.80% (0.3084 => 0.3417, std.dev.: 0.0053) MultiSource/Benchmarks/PAQ8p/paq8p: 10.69% (0.4847 => 0.5365, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 10.55% (0.3336 => 0.3688, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 10.07% (2.0346 => 2.2394, std.dev.: 0.0049) MultiSource/Applications/lemon/lemon: 10.00% (0.2391 => 0.2630, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.14% (4.6926 => 5.1214, std.dev.: 0.1080) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.05% (0.5361 => 0.5846, std.dev.: 0.0098) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.86% (11.6398 => 12.6710, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.24% (0.5584 => 0.6044, std.dev.: 0.0132) MultiSource/Applications/kimwitu++/kc: 7.15% (11.9555 => 12.8104, std.dev.: 0.0126) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.41% (0.3792 => 0.3997, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 65.40% (0.2162 => 0.3576, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 9.89% (0.2802 => 0.3079, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6086, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary: 6.27% (0.2122 => 0.2255, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6755, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8939, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 4.73% (15.4430 => 16.1737, std.dev.: 0.0149) SingleSource/Benchmarks/Dhrystone/dry: 4.13% (14.0481 => 14.6287, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2014, std.dev.: 0.0055) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.68% (3.1722 => 3.2255, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3022, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2860, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.39% (1.0142 => 1.0283) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5911, std.dev.: 0.0215) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.14% (2.4764 => 2.3739, std.dev.: 0.0240) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5574, std.dev.: 0.0266) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9739, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7898, std.dev.: 0.1079) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -6.41% (0.2402 => 0.2248, std.dev.: 0.0022) SingleSource/UnitTests/Vector/build2: -3.73% (11.2080 => 10.7895, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -2.98% (6.9842 => 6.7761, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.92% (0.6293 => 0.6109, std.dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/fldry: -2.68% (17.2379 => 16.7764, std.dev.: 0.0323) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.26% (41.7953 => 40.8523, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5760, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4955, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.02% (105.3826 => 104.3079, std.dev.: 0.0369) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 02:46:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 04:46:51 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121116104651.F3F062A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5930?compare_to=5927&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5930, Order: 168145, Start Time: 2012-11-16 09:18:00, End Time: 2012-11-16 10:47:10 To: 5927, Order: 168142, Start Time: 2012-11-16 07:29:08, End Time: 2012-11-16 09:00:23 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 11 (108 on baseline) Performance Improvements: 7 (29 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 976 (837 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.75% (0.6423 => 0.6664, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.75% (0.3388 => 0.3515, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.55% (0.7805 => 0.8004, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.53% (0.5884 => 0.6033, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.02% (8.7398 => 8.9160, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.88% (1.3528 => 1.3782, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.63% (1.2120 => 1.2317, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.86% (58.8194 => 61.0904, std.dev.: 0.0674) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.53% (2.6894 => 2.7575, std.dev.: 0.0026) MultiSource/Benchmarks/llubenchmark/llu: 1.89% (1.9911 => 2.0287, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.29% (41.3874 => 41.9214, std.dev.: 0.1889) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.98% (8.6767 => 8.4182, std.dev.: 0.0460) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.59% (1.2351 => 1.2155, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -2.79% (0.6625 => 0.6440, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.86% (1.0308 => 1.0116, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.20% (2.4044 => 2.3756, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/lists: -1.17% (16.9081 => 16.7096, std.dev.: 0.0636) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.02% (1.1096 => 1.0983, std.dev.: 0.0017) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.24% (16.9467 => 16.9055, std.dev.: 0.0701) MultiSource/Applications/obsequi/Obsequi: -0.95% (1.0668 => 1.0567, std.dev.: 0.0130) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.94% (22.4417 => 22.2312, std.dev.: 0.6023) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.30% (0.3684 => 0.3673, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -0.77% (0.6198 => 0.6150, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.12% (0.3365 => 0.3361, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: -4.15% (0.2046 => 0.1961, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.74% (0.0219 => 0.0213, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -13.35% (0.0427 => 0.0370, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.41% (0.0332 => 0.0324, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -9.18% (0.0316 => 0.0287, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.62% (0.0431 => 0.0424, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: -5.39% (0.0204 => 0.0193, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: -38.07% (0.0218 => 0.0135, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -7.69% (0.0013 => 0.0012, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -0.67% (0.1485 => 0.1475, std.dev.: 0.0044) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 3.73% (1.1378 => 1.1802, std.dev.: 0.0280) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.33% (0.4490 => 0.4206, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.13% (0.1371 => 0.1455, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.21% (0.0658 => 0.0604, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -14.71% (0.0272 => 0.0232, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.73% (0.0590 => 0.0568, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.08% (1.1953 => 1.1943, std.dev.: 0.0099) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -94.74% (0.0019 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.98% (0.0644 => 0.0554, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -25.22% (0.0230 => 0.0172, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.32% (0.7822 => 0.7797, std.dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 10.17% (0.0059 => 0.0065, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2312.29% (0.6332 => 15.2746, std.dev.: 0.1086) MultiSource/Benchmarks/McCat/08-main/main: 48.94% (0.1831 => 0.2727, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.81% (0.1559 => 0.1484, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1534.03% (0.3344 => 5.4642, std.dev.: 0.0276) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.61% (0.2364 => 0.3253, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.23% (0.0224 => 0.0229, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: -26.09% (0.0230 => 0.0170, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 9.37% (0.1462 => 0.1599, std.dev.: 0.0103) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4667, std.dev.: 0.0123) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0697, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4947, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3196, std.dev.: 0.0161) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1349, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4044, std.dev.: 0.0063) SingleSource/Regression/C/uint64_to_float: -23.72% (2.1832 => 1.6653, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.65% (0.0810 => 0.0953, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.49% (0.0830 => 0.0942, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.85% (0.0848 => 0.0957, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/04-bisect/bisect: 8.88% (0.1137 => 0.1238, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.21% (0.2180 => 0.2359, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.78% (0.8321 => 0.8968, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.65% (0.1425 => 0.1534, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.14% (0.1905 => 0.2041, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.11% (0.7473 => 0.8004, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.68% (0.3295 => 0.3515, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.00% (0.6287 => 0.6664, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.64% (0.2519 => 0.2661, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.49% (0.2133 => 0.2250, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: 5.45% (1.2222 => 1.2888, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.44% (0.2279 => 0.2403, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.41% (1.1685 => 1.2317, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.80% (0.2998 => 0.3142, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.73% (1.1606 => 1.2155, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.46% (0.2378 => 0.2484, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.22% (0.9435 => 0.9833, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/gs/gs: 4.03% (4.1305 => 4.2969, std.dev.: 0.0391) MultiSource/Benchmarks/nbench/nbench: 3.98% (1.1271 => 1.1720, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.79% (1.3279 => 1.3782, std.dev.: 0.0093) MultiSource/Applications/treecc/treecc: 3.76% (1.9948 => 2.0699, std.dev.: 0.0227) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.76% (0.3003 => 0.3116, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.71% (0.5817 => 0.6033, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 3.50% (14.2605 => 14.7601, std.dev.: 0.0925) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.40% (0.3115 => 0.3221, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.39% (1.1170 => 1.1549, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.33% (0.4559 => 0.4711, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 3.32% (0.3226 => 0.3333, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 3.17% (1.2568 => 1.2967, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.12% (1.6386 => 1.6897, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.10% (8.6476 => 8.9160, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.09% (4.4880 => 4.6268, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.07% (2.1401 => 2.2058, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.00% (4.1763 => 4.3015, std.dev.: 0.0186) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.96% (6.6074 => 6.8028, std.dev.: 0.0490) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.95% (0.6227 => 0.6411, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 2.86% (2.2184 => 2.2819, std.dev.: 0.0200) MultiSource/Applications/minisat/minisat: 2.85% (0.6834 => 0.7029, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.80% (4.4873 => 4.6129, std.dev.: 0.0179) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.78% (1.5315 => 1.5740, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.70% (0.8340 => 0.8565, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.69% (0.9056 => 0.9300, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.59% (0.8611 => 0.8834, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.50% (0.4127 => 0.4230, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.49% (0.8457 => 0.8668, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.48% (3.2366 => 3.3168, std.dev.: 0.0303) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.45% (13.1811 => 13.5040, std.dev.: 0.0573) MultiSource/Applications/ClamAV/clamscan: 2.41% (14.7684 => 15.1250, std.dev.: 0.0989) MultiSource/Benchmarks/McCat/05-eks/eks: 2.34% (0.4397 => 0.4500, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 2.33% (0.7557 => 0.7733, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.30% (0.9688 => 0.9911, std.dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (6.7320 => 6.8859, std.dev.: 0.0389) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.27% (0.8597 => 0.8792, std.dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 2.25% (15.3280 => 15.6726, std.dev.: 0.1016) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.18% (0.7932 => 0.8105, std.dev.: 0.0058) MultiSource/Applications/oggenc/oggenc: 2.12% (4.9628 => 5.0682, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.09% (4.5702 => 4.6657, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.07% (0.8716 => 0.8896, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.06% (0.8007 => 0.8172, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.06% (0.9039 => 0.9225, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.04% (0.5191 => 0.5297, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.02% (3.1832 => 3.2475, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.01% (0.8066 => 0.8228, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.90% (0.8316 => 0.8474, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.64% (0.6586 => 0.6694, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.62% (0.8338 => 0.8473, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: 1.55% (1.0945 => 1.1115, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.52% (0.8995 => 0.9132, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 95.48% (0.0199 => 0.0389, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/pi: 57.35% (1.5795 => 2.4854, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.61% (0.7597 => 0.8859, std.dev.: 0.0235) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.35% (2.9753 => 3.4617, std.dev.: 0.0426) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.71% (2.7995 => 3.2112, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.54% (5.0261 => 5.6063, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.04% (0.3186 => 0.3474, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.15% (1.1857 => 1.2823, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 7.32% (1.7056 => 1.8304, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/richards_benchmark: 7.10% (1.3037 => 1.3962, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.59% (4.7794 => 5.0946, std.dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 6.18% (3.1873 => 3.3844, std.dev.: 0.0241) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.80% (4.5327 => 4.7955, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.66% (3.3761 => 3.5334, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.63% (6.2275 => 6.5160, std.dev.: 0.0058) MultiSource/Applications/lambda-0_1_3/lambda: 4.46% (7.4933 => 7.8272, std.dev.: 0.0410) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.19% (4.9453 => 5.1526, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.01% (4.9469 => 5.1451, std.dev.: 0.0116) MultiSource/Applications/hexxagon/hexxagon: 3.90% (14.0064 => 14.5530, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.08% (59.2638 => 61.0904, std.dev.: 0.0674) MultiSource/Applications/siod/siod: 3.02% (3.6643 => 3.7748, std.dev.: 0.0061) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.85% (1.2337 => 1.2688, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.59% (11.5690 => 11.8692, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.59% (8.2783 => 8.4927, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.52% (4.8660 => 4.9884, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.49% (4.8362 => 4.9567, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout/lists: 2.24% (7.3375 => 7.5022, std.dev.: 0.0168) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.23% (1.1365 => 1.1619, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/five11/five11: 1.73% (5.6030 => 5.6999, std.dev.: 0.0174) MultiSource/Benchmarks/llubenchmark/llu: 1.60% (1.9967 => 2.0287, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.48% (2.4647 => 2.5012, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.34% (1.5941 => 1.6154, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.20% (41.4238 => 41.9214, std.dev.: 0.1889) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.15% (3.5679 => 3.6088, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/power/power: 1.09% (1.2061 => 1.2193, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.08% (4.0473 => 4.0909, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/ReedSolomon: 1.06% (8.5322 => 8.6224, std.dev.: 0.0244) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.81% (5.4641 => 4.3272, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.17% (7.2130 => 6.2629, std.dev.: 0.0727) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.09% (1.0512 => 0.9346, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: -10.00% (1.1216 => 1.0094, std.dev.: 0.0125) MultiSource/Benchmarks/mafft/pairlocalalign: -8.47% (63.1822 => 57.8289, std.dev.: 0.9992) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.87% (14.6451 => 13.4932, std.dev.: 0.0529) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.89% (4.7482 => 4.4210, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.45% (0.3269 => 0.3058, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.97% (3.7148 => 3.4932, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.87% (5.4972 => 5.1743, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.08% (5.1557 => 4.8936, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.36% (4.7449 => 4.5382, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.74% (6.0224 => 5.7970, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.71% (2.8773 => 2.7706, std.dev.: 0.0244) MultiSource/Applications/lua/lua: -3.32% (29.8330 => 28.8433, std.dev.: 0.0693) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.29% (0.5807 => 0.5616, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (28.5821 => 27.6955, std.dev.: 0.0124) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.00% (2.4490 => 2.3756, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/bisort/bisort: -2.95% (0.6636 => 0.6440, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.89% (2.6356 => 2.5593, std.dev.: 0.0192) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.62% (1.0388 => 1.0116, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.60% (9.9065 => 9.6489, std.dev.: 0.0531) MultiSource/Applications/aha/aha: -2.47% (3.3398 => 3.2572, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/hash2: -2.33% (3.4237 => 3.3438, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.05% (11.5316 => 11.2956, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.73% (3.2169 => 3.1614, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.58% (4.9994 => 4.9202, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.52% (2.3487 => 2.3129, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.15% (5.6343 => 5.5697, std.dev.: 0.0156) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.79% (16.4461 => 16.9055, std.dev.: 0.0701) MultiSource/Applications/obsequi/Obsequi: 2.97% (1.0262 => 1.0567, std.dev.: 0.0130) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7018.54% (0.3123 => 22.2312, std.dev.: 0.6023) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.13% (0.2463 => 0.3673, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 2.33% (0.6010 => 0.6150, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.91% (0.3266 => 0.3361, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: -0.41% (0.1969 => 0.1961, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 73.17% (0.0123 => 0.0213, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.31% (0.0408 => 0.0370, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 27.56% (0.0254 => 0.0324, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -4.97% (0.0302 => 0.0287, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: 1.58% (0.0190 => 0.0193, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: -25.00% (0.0180 => 0.0135, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 71.43% (0.0007 => 0.0012, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 2.57% (0.1438 => 0.1475, std.dev.: 0.0044) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 4.18% (1.1329 => 1.1802, std.dev.: 0.0280) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.01% (0.4164 => 0.4206, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.28% (0.1369 => 0.1455, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.77% (0.0641 => 0.0604, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 18.97% (0.0195 => 0.0232, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.73% (0.0578 => 0.0568, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.42% (1.1437 => 1.1943, std.dev.: 0.0099) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.64% (0.0627 => 0.0554, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.44% (0.0180 => 0.0172, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.74% (0.8017 => 0.7797, std.dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 4.84% (0.0062 => 0.0065, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 03:09:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 05:09:05 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121116110905.2EACC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5931?compare_to=5926&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5931, Order: 168143, Start Time: 2012-11-16 08:48:53, End Time: 2012-11-16 11:09:20 To: 5926, Order: 168137, Start Time: 2012-11-16 05:42:46, End Time: 2012-11-16 07:54:06 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 60 (165 on baseline) Performance Improvements: 19 (39 on baseline) Added Tests: 2 (136 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 959 (683 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 17.17% (0.5811 => 0.6809, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 16.65% (0.1411 => 0.1646, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 16.15% (0.7200 => 0.8363, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 15.87% (0.6448 => 0.7471, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.52% (0.7204 => 0.8250, std.dev.: 0.0297) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.46% (0.6174 => 0.7067, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.37% (0.5804 => 0.6638, std.dev.: 0.0178) MultiSource/Applications/lemon/lemon: 14.34% (1.2017 => 1.3740, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 14.28% (0.6645 => 0.7594, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.05% (0.6165 => 0.7031, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/methcall: 13.92% (0.3118 => 0.3552, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 13.92% (0.3320 => 0.3782, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash: 13.70% (0.4765 => 0.5418, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/exptree: 13.46% (0.0929 => 0.1054, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 13.22% (0.5938 => 0.6723, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/ackermann: 13.01% (0.2991 => 0.3380, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/random: 12.83% (0.3025 => 0.3413, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/Large/ray: 12.74% (0.4435 => 0.5000, std.dev.: 0.0207) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.69% (1.0383 => 1.1701, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.65% (0.4299 => 0.4843, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.64% (0.1914 => 0.2156, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sieve: 12.14% (0.3971 => 0.4453, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 11.80% (0.5109 => 0.5712, std.dev.: 0.0206) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.52% (0.1909 => 0.2129, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 11.26% (6.2140 => 6.9138, std.dev.: 0.0324) MultiSource/Benchmarks/FreeBench/neural/neural: 10.81% (0.1609 => 0.1783, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 10.69% (0.2208 => 0.2444, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.27% (0.6241 => 0.6882, std.dev.: 0.0166) MultiSource/Benchmarks/Olden/mst/mst: 10.20% (0.1353 => 0.1491, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.14% (1.9132 => 2.0880, std.dev.: 0.0090) SingleSource/UnitTests/ObjC/for-in: 8.58% (0.4138 => 0.4493, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.38% (0.1289 => 0.1397, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.30% (0.5798 => 0.6279, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.29% (0.6818 => 0.7383, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.01% (0.5342 => 0.5770, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 7.46% (0.6688 => 0.7187, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.73% (4.7279 => 5.0461, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/flops: 6.28% (0.1992 => 0.2117, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.72% (0.6105 => 0.6393, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 4.28% (0.7353 => 0.7668, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.73% (0.8308 => 0.8452, std.dev.: 0.0052) MultiSource/Applications/ClamAV/clamscan: 1.44% (37.3094 => 37.8454, std.dev.: 0.0704) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.82% (5.6884 => 6.5316, std.dev.: 0.2764) MultiSource/Benchmarks/Olden/mst/mst: 14.27% (0.1317 => 0.1505, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.19% (1.7401 => 1.9349, std.dev.: 0.0246) MultiSource/Applications/lemon/lemon: 9.83% (1.4365 => 1.5777, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 7.73% (1.5365 => 1.6552, std.dev.: 0.0294) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 7.43% (0.1993 => 0.2141, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/strcat: 6.83% (0.1934 => 0.2066, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 6.57% (0.7627 => 0.8128, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: 5.38% (1.2166 => 1.2820, std.dev.: 0.0233) MultiSource/Benchmarks/FreeBench/neural/neural: 4.93% (0.2233 => 0.2343, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.62% (6.2157 => 6.5030, std.dev.: 0.0304) MultiSource/Benchmarks/Olden/em3d/em3d: 3.07% (3.1101 => 3.2057, std.dev.: 0.0238) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.03% (48.9370 => 49.9308, std.dev.: 0.0730) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.03% (1.6337 => 1.6668, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.92% (4.8115 => 4.9040, std.dev.: 0.0192) MultiSource/Applications/SIBsim4/SIBsim4: 1.80% (3.8596 => 3.9289, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.44% (3.6077 => 3.6596, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.13% (8.8965 => 8.9972, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -14.64% (5.4217 => 4.6281, std.dev.: 0.3033) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -14.37% (0.9168 => 0.7851, std.dev.: 0.0248) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -14.05% (0.8382 => 0.7204, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -13.21% (0.6805 => 0.5906, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -12.41% (0.7638 => 0.6690, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Oscar: -11.97% (0.0894 => 0.0787, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -11.04% (0.6615 => 0.5885, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: -9.62% (0.1559 => 0.1409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -8.03% (0.6985 => 0.6424, std.dev.: 0.0009) MultiSource/Applications/lua/lua: -7.11% (4.8656 => 4.5196, std.dev.: 0.0934) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.50% (0.7346 => 0.6942, std.dev.: 0.0157) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -5.44% (0.2005 => 0.1896, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.93% (9.2579 => 8.6161, std.dev.: 0.1355) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -4.84% (4.8317 => 4.5978, std.dev.: 0.0868) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.79% (4.1362 => 3.9380, std.dev.: 0.0551) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.11% (4.3288 => 4.2373, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.76% (7.4108 => 7.2801, std.dev.: 0.0456) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.26% (4.1419 => 4.0899, std.dev.: 0.0058) SingleSource/Benchmarks/Dhrystone/fldry: -1.07% (2.0031 => 1.9816, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 1.57% (0.1337 => 0.1358, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0419 => 0.0420, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.26% (0.0685 => 0.0649, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 0.01% (493.9970 => 494.0629, std.dev.: 0.2514) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/power/power: 43711.55% (1.1277 => 494.0629, std.dev.: 0.2514) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.24% (0.5229 => 1.5386, std.dev.: 0.1104) MultiSource/Applications/SPASS/SPASS: 21.64% (14.9895 => 18.2331, std.dev.: 0.1642) MultiSource/Applications/kimwitu++/kc: 51.50% (14.1553 => 21.4450, std.dev.: 0.2395) MultiSource/Benchmarks/MallocBench/gs/gs: 23.57% (4.1105 => 5.0795, std.dev.: 0.1198) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.84% (1.1048 => 1.5229, std.dev.: 0.0573) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 432.44% (7.1582 => 38.1134, std.dev.: 0.3558) SingleSource/Benchmarks/Misc-C++-EH/spirit: 99.65% (3.4629 => 6.9138, std.dev.: 0.0324) SingleSource/Benchmarks/Misc-C++/stepanov_container: 88.06% (0.6222 => 1.1701, std.dev.: 0.0011) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11093.61% (0.0720 => 8.0594, std.dev.: 0.1299) MultiSource/Applications/SIBsim4/SIBsim4: 3928800.00% (0.0001 => 3.9289, std.dev.: 0.0157) MultiSource/Applications/SPASS/SPASS: 14714600.00% (0.0001 => 14.7147, std.dev.: 0.6280) MultiSource/Applications/kimwitu++/kc: 54200.00% (0.0001 => 0.0543, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63800.00% (0.0001 => 0.0639, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 579300.00% (0.0001 => 0.5794, std.dev.: 0.0354) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10085600.00% (0.0001 => 10.0857, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6531500.00% (0.0001 => 6.5316, std.dev.: 0.2764) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1795.94% (1.1194 => 21.2232, std.dev.: 0.1355) MultiSource/Applications/ClamAV/clamscan: 70.66% (22.1758 => 37.8454, std.dev.: 0.0704) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 59.63% (7.0540 => 11.2604, std.dev.: 0.1567) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.50% (2.9384 => 4.6281, std.dev.: 0.3033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 51.14% (8.1363 => 12.2971, std.dev.: 0.0806) MultiSource/Applications/JM/lencod/lencod: 47.85% (21.9371 => 32.4339, std.dev.: 0.1001) SingleSource/Benchmarks/Misc/flops: 47.84% (0.1432 => 0.2117, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/distray/distray: 44.79% (0.1056 => 0.1529, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/dot-syntax-1: 39.25% (0.0479 => 0.0667, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 38.63% (0.0730 => 0.1012, std.dev.: 0.0043) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 36.11% (0.1584 => 0.2156, std.dev.: 0.0043) MultiSource/Benchmarks/Fhourstones/fhourstones: 35.95% (0.1566 => 0.2129, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 33.17% (0.1236 => 0.1646, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 31.66% (1.5859 => 2.0880, std.dev.: 0.0090) SingleSource/UnitTests/vla: 30.14% (0.0355 => 0.0462, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 29.48% (0.0814 => 0.1054, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/messages-2: 29.46% (0.0662 => 0.0857, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/family/family: 28.21% (0.0397 => 0.0509, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 28.20% (0.1163 => 0.1491, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 28.15% (1.0722 => 1.3740, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/hash: 27.84% (0.0485 => 0.0620, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 27.63% (0.1940 => 0.2476, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/functionobjects: 27.35% (0.5020 => 0.6393, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout/lists: 26.52% (0.0626 => 0.0792, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash: 26.32% (0.4289 => 0.5418, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 26.30% (0.0479 => 0.0605, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.89% (0.8172 => 1.0288, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.73% (0.0886 => 0.1114, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 25.56% (0.0403 => 0.0506, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 25.45% (0.0672 => 0.0843, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/reversefile: 25.30% (0.3865 => 0.4843, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 25.07% (0.1117 => 0.1397, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 25.03% (0.4615 => 0.5770, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 24.62% (0.0528 => 0.0658, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 24.52% (0.4103 => 0.5109, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.22% (0.0834 => 0.1036, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.99% (0.0746 => 0.0925, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 23.94% (0.0660 => 0.0818, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 23.86% (1.1642 => 1.4420, std.dev.: 0.0318) MultiSource/Benchmarks/BitBench/five11/five11: 23.81% (0.0567 => 0.0702, std.dev.: 0.0018) SingleSource/Benchmarks/Stanford/Oscar: 23.74% (0.0636 => 0.0787, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 23.64% (0.4620 => 0.5712, std.dev.: 0.0206) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 23.59% (0.3162 => 0.3908, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sieve: 23.59% (0.3603 => 0.4453, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 23.58% (2.0665 => 2.5538, std.dev.: 0.0131) SingleSource/UnitTests/ObjC/exceptions-4: 23.57% (0.3543 => 0.4378, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/methcall: 23.46% (0.2877 => 0.3552, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 23.44% (0.5981 => 0.7383, std.dev.: 0.0040) SingleSource/Regression/C++/ofstream_ctor: 23.24% (0.2905 => 0.3580, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: 23.03% (0.4064 => 0.5000, std.dev.: 0.0207) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 23.00% (0.5105 => 0.6279, std.dev.: 0.0123) SingleSource/UnitTests/ObjC/exceptions-3: 22.95% (0.3516 => 0.4323, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 22.64% (0.2756 => 0.3380, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 22.58% (0.3650 => 0.4474, std.dev.: 0.0139) MultiSource/Benchmarks/McCat/08-main/main: 22.32% (0.2554 => 0.3124, std.dev.: 0.0197) SingleSource/UnitTests/ObjC/exceptions-2: 22.16% (0.3497 => 0.4272, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/misr: 22.12% (0.0633 => 0.0773, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 22.08% (0.0838 => 0.1023, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.94% (14.3668 => 17.5184, std.dev.: 0.0664) MultiSource/Benchmarks/FreeBench/neural/neural: 21.87% (0.1463 => 0.1783, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 21.81% (0.2802 => 0.3413, std.dev.: 0.0084) SingleSource/UnitTests/ObjC/for-in: 21.63% (0.3694 => 0.4493, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 21.26% (5.7591 => 6.9836, std.dev.: 0.1693) MultiSource/Benchmarks/VersaBench/bmm/bmm: 21.21% (0.0759 => 0.0920, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 21.08% (0.3828 => 0.4635, std.dev.: 0.0158) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 20.83% (0.1906 => 0.2303, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/objinst: 20.79% (0.3131 => 0.3782, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.43% (0.0793 => 0.0955, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/tsp/tsp: 20.43% (0.1175 => 0.1415, std.dev.: 0.0049) MultiSource/Applications/d/make_dparser: 20.03% (3.3354 => 4.0035, std.dev.: 0.1107) SingleSource/Benchmarks/Misc/ReedSolomon: 19.28% (0.2049 => 0.2444, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.97% (4.2646 => 5.0738, std.dev.: 0.1044) MultiSource/Benchmarks/mafft/pairlocalalign: 18.71% (9.4845 => 11.2588, std.dev.: 0.1251) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.32% (5.0018 => 5.9182, std.dev.: 0.1211) MultiSource/Applications/siod/siod: 18.27% (2.2969 => 2.7165, std.dev.: 0.1577) SingleSource/Benchmarks/Shootout-C++/nestedloop: 18.22% (0.2793 => 0.3302, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.89% (0.1062 => 0.1252, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.77% (4.9449 => 5.8235, std.dev.: 0.0801) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.36% (0.5569 => 0.6536, std.dev.: 0.0322) SingleSource/UnitTests/ObjC/instance-method-metadata: 17.36% (0.3543 => 0.4158, std.dev.: 0.0099) MultiSource/Applications/lambda-0_1_3/lambda: 17.33% (0.7433 => 0.8721, std.dev.: 0.0471) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.22% (0.0871 => 0.1021, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 17.12% (17.1811 => 20.1219, std.dev.: 0.0134) MultiSource/Applications/lua/lua: 16.72% (3.8723 => 4.5196, std.dev.: 0.0934) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.62% (1.1861 => 1.3832, std.dev.: 0.0478) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.51% (0.0648 => 0.0755, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 16.39% (0.8921 => 1.0383, std.dev.: 0.0295) MultiSource/Benchmarks/Olden/em3d/em3d: 16.28% (0.1695 => 0.1971, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout/matrix: 15.89% (0.0818 => 0.0948, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.64% (0.1892 => 0.2188, std.dev.: 0.0112) MultiSource/Benchmarks/PAQ8p/paq8p: 15.57% (10.3673 => 11.9810, std.dev.: 0.0615) MultiSource/Benchmarks/Olden/health/health: 15.46% (0.1268 => 0.1464, std.dev.: 0.0069) MultiSource/Applications/viterbi/viterbi: 15.18% (0.1555 => 0.1791, std.dev.: 0.0069) MultiSource/Applications/treecc/treecc: 14.82% (2.0273 => 2.3277, std.dev.: 0.1163) MultiSource/Benchmarks/NPB-serial/is/is: 14.74% (0.0719 => 0.0825, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 14.67% (0.3817 => 0.4377, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 14.65% (3.8922 => 4.4624, std.dev.: 0.2048) MultiSource/Benchmarks/Bullet/bullet: 14.60% (63.2438 => 72.4781, std.dev.: 0.2512) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.52% (0.2107 => 0.2413, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.51% (0.1337 => 0.1531, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.81% (2.2022 => 2.5064, std.dev.: 0.0281) MultiSource/Applications/hexxagon/hexxagon: 13.81% (1.2842 => 1.4615, std.dev.: 0.0545) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.76% (0.3307 => 0.3762, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 13.53% (0.3423 => 0.3886, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.29% (0.3927 => 0.4449, std.dev.: 0.0200) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.21% (0.6675 => 0.7557, std.dev.: 0.0235) SingleSource/UnitTests/ObjC/trivial-interface: 12.99% (0.3473 => 0.3924, std.dev.: 0.0154) SingleSource/UnitTests/ObjC/property: 12.92% (0.3886 => 0.4388, std.dev.: 0.0193) MultiSource/Benchmarks/McCat/09-vor/vor: 12.77% (0.3180 => 0.3586, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/power/power: 12.29% (0.1440 => 0.1617, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.86% (0.1695 => 0.1896, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.23% (0.4203 => 0.4675, std.dev.: 0.0170) SingleSource/Benchmarks/Stanford/Puzzle: 11.12% (0.1268 => 0.1409, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 10.18% (0.6030 => 0.6644, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 10.10% (0.3684 => 0.4056, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 10.03% (0.5925 => 0.6519, std.dev.: 0.0136) SingleSource/UnitTests/ObjC++/property-reference: 9.69% (0.7326 => 0.8036, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.33% (0.3826 => 0.4183, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.17% (0.2891 => 0.3156, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 8.94% (0.3098 => 0.3375, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 8.85% (0.3052 => 0.3322, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.91% (0.3136 => 0.3384, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: 7.60% (0.3092 => 0.3327, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.15% (0.3935 => 0.4177, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: 5.06% (54.1659 => 56.9092, std.dev.: 0.3690) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.75% (4.3953 => 11.0213, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/methcall: 147.75% (5.3999 => 13.3780, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 27.64% (9.1159 => 11.6355, std.dev.: 0.3980) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 23.66% (13.4384 => 16.6184, std.dev.: 0.2325) SingleSource/Benchmarks/Misc/oourafft: 17.53% (6.6465 => 7.8117, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/mst/mst: 17.12% (0.1285 => 0.1505, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.01% (1.1145 => 1.3041, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/lpbench: 15.51% (10.3460 => 11.9509, std.dev.: 0.4541) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.98% (0.2944 => 0.3326, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.66% (2.8904 => 3.2275, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.31% (8.6802 => 9.6621, std.dev.: 0.2317) SingleSource/Benchmarks/Misc/richards_benchmark: 10.15% (1.1396 => 1.2553, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.31% (1.7254 => 1.8860, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 9.11% (1.4460 => 1.5777, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/hash: 9.03% (0.7455 => 0.8128, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash2: 8.80% (3.1578 => 3.4356, std.dev.: 0.0890) SingleSource/Benchmarks/Shootout/strcat: 8.79% (0.1899 => 0.2066, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.95% (0.9540 => 1.0108, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.72% (4.2280 => 4.4698, std.dev.: 0.0039) MultiSource/Benchmarks/Fhourstones/fhourstones: 5.56% (1.8329 => 1.9349, std.dev.: 0.0246) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 4.93% (0.2233 => 0.2343, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.6436 => 12.1289, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.45% (1.7133 => 1.7724, std.dev.: 0.0206) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 3.33% (3.1023 => 3.2057, std.dev.: 0.0238) MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.16% (2.1424 => 2.2100, std.dev.: 0.0085) SingleSource/Benchmarks/Dhrystone/dry: 2.64% (2.4116 => 2.4752, std.dev.: 0.0158) MultiSource/Benchmarks/PAQ8p/paq8p: 2.52% (85.0658 => 87.2088, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 2.05% (3.1595 => 3.2243, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 1.89% (12.5348 => 12.7715, std.dev.: 0.0174) MultiSource/Benchmarks/mafft/pairlocalalign: 1.52% (27.8444 => 28.2676, std.dev.: 0.0384) SingleSource/Benchmarks/Shootout/sieve: 1.50% (5.2139 => 5.2920, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.33% (6.5088 => 6.5954, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.22% (1.9577 => 1.9816, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0504, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1680, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.79% (5.2763 => 1.2244, std.dev.: 0.0592) SingleSource/Benchmarks/Misc/salsa20: -75.78% (0.8651 => 0.2095, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/richards_benchmark: -44.64% (0.1622 => 0.0898, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.47% (5.3855 => 4.7678, std.dev.: 0.1323) MultiSource/Applications/JM/ldecod/ldecod: -8.04% (10.4361 => 9.5973, std.dev.: 0.1344) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.73% (5.3526 => 5.0461, std.dev.: 0.0150) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.83% (0.3987 => 0.2399, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.72% (0.0506 => 0.0305, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.43% (4.5009 => 2.7714, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: -33.52% (1.1492 => 0.7640, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -26.52% (10.7105 => 7.8704, std.dev.: 0.5875) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.09% (2.6546 => 2.0151, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -19.11% (0.2161 => 0.1748, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4249, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2839, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.68% (32.5116 => 29.0399, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/mandel-2: -10.62% (1.5373 => 1.3741, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.98% (1.5660 => 1.4253, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.2416 => 3.0207, std.dev.: 0.0148) MultiSource/Benchmarks/NPB-serial/is/is: -6.23% (9.5636 => 8.9681, std.dev.: 0.0192) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.13% (0.2497 => 0.2369, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5061, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: -4.25% (6.2999 => 6.0320, std.dev.: 0.0104) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.71% (19.9488 => 19.2093, std.dev.: 0.0664) MultiSource/Benchmarks/sim/sim: -3.00% (5.0483 => 4.8971, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.40% (0.9957 => 0.9718, std.dev.: 0.0049) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.29% (0.4808 => 0.4698, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.78% (8.1563 => 8.0111, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6772, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.44% (10.2830 => 10.1353, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.55% (0.1485 => 0.1358, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0015) Report Time: 2.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 03:12:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 05:12:11 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121116111211.E48C62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5932?compare_to=5928&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5932, Order: 168145, Start Time: 2012-11-16 09:39:47, End Time: 2012-11-16 11:12:31 To: 5928, Order: 168142, Start Time: 2012-11-16 07:40:15, End Time: 2012-11-16 09:16:28 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (179 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1044 (859 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.40% (2.0478 => 2.1175, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 2.51% (7.4937 => 7.6816, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 2.13% (3.1932 => 3.2611, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.74% (0.1431 => 0.1306, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.98% (0.3821 => 0.3516, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -6.95% (2.4924 => 2.3193, std.dev.: 0.0055) MultiSource/Applications/sgefa/sgefa: -6.61% (0.3357 => 0.3135, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.33% (0.3142 => 0.2943, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.24% (0.9542 => 0.8947, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.20% (0.7198 => 0.6752, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: -6.10% (9.2283 => 8.6657, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.10% (0.2428 => 0.2280, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -5.95% (0.3812 => 0.3585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -5.93% (0.2160 => 0.2032, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.89% (0.9852 => 0.9272, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.88% (0.6484 => 0.6103, std.dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: -5.86% (16.1920 => 15.2435, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.85% (0.1796 => 0.1691, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: -5.78% (0.9179 => 0.8648, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/exceptions-3: -5.74% (0.3848 => 0.3627, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.74% (0.3884 => 0.3661, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.72% (0.3880 => 0.3658, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.72% (0.3831 => 0.3612, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.71% (0.2695 => 0.2541, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -5.70% (0.4176 => 0.3938, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -5.70% (0.3896 => 0.3674, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.68% (0.4033 => 0.3804, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -5.67% (7.0961 => 6.6934, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.65% (0.3891 => 0.3671, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.65% (1.0544 => 0.9948, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.64% (4.0323 => 3.8048, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.64% (1.3722 => 1.2948, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.63% (3.5339 => 3.3349, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.60% (0.3658 => 0.3453, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.56% (0.5805 => 0.5482, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.51% (0.5859 => 0.5536, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.48% (1.2300 => 1.1626, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.47% (0.6660 => 0.6296, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -5.45% (1.1450 => 1.0826, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.45% (0.6736 => 0.6369, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.44% (0.6052 => 0.5723, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.42% (0.5863 => 0.5545, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: -5.42% (1.1530 => 1.0905, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.41% (1.6364 => 1.5478, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/property: -5.41% (0.4199 => 0.3972, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.40% (0.3406 => 0.3222, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.39% (1.4642 => 1.3853, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.37% (0.6681 => 0.6322, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.37% (4.8161 => 4.5574, std.dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.36% (6.7716 => 6.4087, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.35% (0.5591 => 0.5292, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.35% (4.8802 => 4.6193, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.31% (0.5575 => 0.5279, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.30% (0.6260 => 0.5928, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.30% (0.6230 => 0.5900, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.29% (0.7524 => 0.7126, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.28% (0.5857 => 0.5548, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.27% (0.5802 => 0.5496, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.27% (0.4515 => 0.4277, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.27% (0.6395 => 0.6058, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.27% (4.5069 => 4.2695, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.26% (1.2784 => 1.2111, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.26% (0.6676 => 0.6325, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.24% (0.5688 => 0.5390, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -5.22% (17.1032 => 16.2107, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.21% (0.5705 => 0.5408, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.19% (0.5456 => 0.5173, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: -5.19% (0.4280 => 0.4058, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.17% (14.2083 => 13.4742, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: -5.17% (4.3330 => 4.1092, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.16% (0.5581 => 0.5293, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.14% (0.3483 => 0.3304, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.13% (0.5925 => 0.5621, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.13% (0.6395 => 0.6067, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.12% (0.5567 => 0.5282, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.11% (0.5478 => 0.5198, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.10% (0.7339 => 0.6965, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.09% (0.5849 => 0.5551, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.09% (0.6293 => 0.5973, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.08% (1.2221 => 1.1600, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.07% (0.5941 => 0.5640, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.06% (0.5569 => 0.5287, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.05% (0.5999 => 0.5696, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.05% (0.6440 => 0.6115, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.03% (0.8521 => 0.8092, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.03% (0.6446 => 0.6122, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.02% (0.6667 => 0.6332, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.01% (1.2210 => 1.1598, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: -5.00% (0.3581 => 0.3402, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.99% (0.5570 => 0.5292, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.99% (0.6033 => 0.5732, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -4.92% (0.2985 => 0.2838, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.92% (0.2278 => 0.2166, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.88% (8.0126 => 7.6213, std.dev.: 0.0032) MultiSource/Applications/Burg/burg: -4.87% (1.2515 => 1.1905, std.dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: -4.86% (1.3864 => 1.3190, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.84% (0.4916 => 0.4678, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -4.84% (15.5079 => 14.7577, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.80% (0.2355 => 0.2242, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.79% (0.2548 => 0.2426, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.76% (0.7919 => 0.7542, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.74% (0.2385 => 0.2272, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: -4.73% (0.7447 => 0.7095, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.72% (1.6474 => 1.5696, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: -4.70% (0.2659 => 0.2534, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -4.70% (15.2527 => 14.5364, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.61% (0.5168 => 0.4930, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.60% (0.2999 => 0.2861, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.60% (0.6304 => 0.6014, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: -4.60% (3.5154 => 3.3538, std.dev.: 0.0012) MultiSource/Applications/lua/lua: -4.56% (4.0594 => 3.8741, std.dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.49% (0.3319 => 0.3170, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.49% (0.7021 => 0.6706, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.43% (0.5329 => 0.5093, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.41% (0.6189 => 0.5916, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.41% (22.4056 => 21.4178, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.35% (0.6297 => 0.6023, std.dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: -4.35% (1.3148 => 1.2576, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.34% (0.4151 => 0.3971, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.33% (0.6194 => 0.5926, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.21% (2.2587 => 2.1635, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: -4.21% (0.3255 => 0.3118, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -4.20% (2.1401 => 2.0503, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: -4.20% (0.3194 => 0.3060, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -4.19% (2.4021 => 2.3014, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.17% (0.3837 => 0.3677, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -4.14% (0.7779 => 0.7457, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.13% (0.4813 => 0.4614, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: -4.13% (0.3025 => 0.2900, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.12% (0.3931 => 0.3769, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.09% (2.1713 => 2.0825, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.01% (0.3016 => 0.2895, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -4.00% (0.3271 => 0.3140, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.99% (0.2933 => 0.2816, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -3.98% (0.2939 => 0.2822, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -3.97% (0.8418 => 0.8084, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/fibo: -3.94% (0.2871 => 0.2758, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.92% (0.9557 => 0.9182, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: -3.91% (5.0226 => 4.8262, std.dev.: 0.0050) MultiSource/Benchmarks/Bullet/bullet: -3.91% (34.0927 => 32.7603, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.91% (0.3252 => 0.3125, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -3.88% (0.2989 => 0.2873, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: -3.88% (0.6347 => 0.6101, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -3.86% (0.3059 => 0.2941, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.85% (0.3323 => 0.3195, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: -3.83% (0.2849 => 0.2740, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -3.81% (0.4861 => 0.4676, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.79% (0.3057 => 0.2941, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.79% (0.2903 => 0.2793, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -3.77% (0.3446 => 0.3316, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -3.77% (0.3394 => 0.3266, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -3.75% (0.7982 => 0.7683, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.72% (0.3849 => 0.3706, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference-object: -3.71% (0.6441 => 0.6202, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: -3.70% (18.2933 => 17.6161, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.70% (0.4083 => 0.3932, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: -3.70% (0.3867 => 0.3724, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -3.65% (0.3205 => 0.3088, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.64% (0.9077 => 0.8747, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/moments: -3.63% (0.4248 => 0.4094, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -3.62% (0.3481 => 0.3355, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.61% (0.4321 => 0.4165, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: -3.56% (0.3621 => 0.3492, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -3.41% (0.6750 => 0.6520, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.32% (0.4427 => 0.4280, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: -3.32% (0.4524 => 0.4374, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.24% (0.3491 => 0.3378, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -3.01% (0.3788 => 0.3674, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.96% (5.4682 => 5.3065, std.dev.: 0.0178) MultiSource/Applications/hbd/hbd: -2.80% (1.5610 => 1.5173, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -2.22% (20.7746 => 20.3141, std.dev.: 0.0144) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7533, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: -8.74% (1.2842 => 1.1720, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7068, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.78% (2.2633 => 2.1778, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.31% (1.3096 => 1.2794, std.dev.: 0.0069) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4738, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 04:41:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 06:41:55 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121116124155.C5A082A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5933?compare_to=5930&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5933, Order: 168147, Start Time: 2012-11-16 11:08:15, End Time: 2012-11-16 12:42:16 To: 5930, Order: 168145, Start Time: 2012-11-16 09:18:00, End Time: 2012-11-16 10:47:10 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 5 (27 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 988 (929 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.10% (0.8968 => 0.9246, std.dev.: 0.0098) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.47% (0.0890 => 0.1001, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.30% (21.6754 => 22.3909, std.dev.: 0.1248) SingleSource/Benchmarks/Misc/ffbench: 1.28% (1.4037 => 1.4217, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.03% (1.8828 => 1.9021, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.26% (61.0904 => 59.7109, std.dev.: 0.2566) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.64% (16.9055 => 16.7976, std.dev.: 1.3115) MultiSource/Applications/obsequi/Obsequi: 2.15% (1.0567 => 1.0794, std.dev.: 0.1936) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (22.2312 => 22.5776, std.dev.: 0.5309) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.30% (0.3673 => 0.3662, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: -0.94% (0.6150 => 0.6092, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.12% (0.3361 => 0.3365, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 2.91% (0.1961 => 0.2018, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.88% (0.0213 => 0.0217, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 15.14% (0.0370 => 0.0426, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 2.47% (0.0324 => 0.0332, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 9.41% (0.0287 => 0.0314, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0424 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 4.66% (0.0193 => 0.0202, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 60.00% (0.0135 => 0.0216, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 8.33% (0.0012 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.07% (0.1475 => 0.1535, std.dev.: 0.0272) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 6.88% (1.1802 => 1.2614, std.dev.: 0.3211) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.38% (0.4206 => 0.4148, std.dev.: 0.0260) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.22% (0.1455 => 0.1379, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.12% (0.0604 => 0.0647, std.dev.: 0.0167) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 18.10% (0.0232 => 0.0274, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.22% (0.0568 => 0.0609, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.39% (1.1943 => 1.1989, std.dev.: 0.0664) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2000.00% (0.0001 => 0.0021, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 16.43% (0.0554 => 0.0645, std.dev.: 0.0143) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 52.33% (0.0172 => 0.0262, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.26% (0.7797 => 0.7817, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -20.00% (0.0065 => 0.0052, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2338.06% (0.6332 => 15.4378, std.dev.: 0.7288) MultiSource/Benchmarks/McCat/08-main/main: 51.28% (0.1831 => 0.2770, std.dev.: 0.0942) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.21% (0.1559 => 0.1509, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1519.26% (0.3344 => 5.4148, std.dev.: 0.0344) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.86% (0.2364 => 0.3259, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: 2.80% (0.0429 => 0.0441, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.70% (0.0224 => 0.0239, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 11.97% (0.1462 => 0.1637, std.dev.: 0.0159) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4850, std.dev.: 0.0661) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0744, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4937, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3194, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1294, std.dev.: 0.0309) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3992, std.dev.: 0.0047) SingleSource/Regression/C/uint64_to_float: -24.01% (2.1832 => 1.6590, std.dev.: 0.0025) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.12% (0.8321 => 0.9246, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.37% (0.3115 => 0.3220, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.31% (0.3657 => 0.3778, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.96% (8.6247 => 8.7940, std.dev.: 0.0506) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 101.01% (0.0199 => 0.0400, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/pi: 58.47% (1.5795 => 2.5030, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.41% (0.7597 => 0.8920, std.dev.: 0.0295) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.18% (2.9753 => 3.4566, std.dev.: 0.1166) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.72% (2.7995 => 3.2117, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 12.05% (5.0261 => 5.6317, std.dev.: 0.0443) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.58% (1.1857 => 1.2756, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/queens: 7.14% (1.7056 => 1.8273, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/richards_benchmark: 6.35% (1.3037 => 1.3865, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.86% (4.9686 => 5.2598, std.dev.: 0.0431) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.77% (4.5327 => 4.7942, std.dev.: 0.0115) MultiSource/Applications/lambda-0_1_3/lambda: 5.54% (7.4933 => 7.9088, std.dev.: 0.0439) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.91% (3.3761 => 3.5418, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.56% (6.2275 => 6.5116, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.17% (4.9453 => 5.1515, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.95% (4.9469 => 5.1425, std.dev.: 0.0550) MultiSource/Applications/hexxagon/hexxagon: 3.83% (14.0064 => 14.5434, std.dev.: 0.0667) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.79% (11.5690 => 11.8917, std.dev.: 0.0303) SingleSource/Benchmarks/Shootout/lists: 2.32% (7.3375 => 7.5078, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.22% (4.8362 => 4.9434, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/neural/neural: 1.33% (1.0841 => 1.0985, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.24% (3.5679 => 3.6122, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.02% (1.8829 => 1.9021, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.74% (5.4641 => 4.3310, std.dev.: 0.0510) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.81% (7.2130 => 6.3609, std.dev.: 0.2643) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.76% (1.0512 => 0.9381, std.dev.: 0.0346) SingleSource/Benchmarks/McGill/chomp: -10.19% (1.1216 => 1.0073, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.57% (14.6451 => 13.2439, std.dev.: 0.2616) MultiSource/Benchmarks/mafft/pairlocalalign: -8.48% (63.1822 => 57.8226, std.dev.: 0.0214) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.39% (0.3269 => 0.3060, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.25% (3.9188 => 3.6738, std.dev.: 0.0365) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.14% (3.7148 => 3.4868, std.dev.: 0.0355) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.86% (5.4972 => 5.1751, std.dev.: 0.0392) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.37% (2.8773 => 2.7515, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.81% (6.0224 => 5.7930, std.dev.: 0.0512) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.07% (28.5821 => 27.7046, std.dev.: 0.0667) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.01% (0.5807 => 0.5632, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: -2.35% (3.4237 => 3.3434, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.08% (9.9065 => 9.7002, std.dev.: 0.0585) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.97% (11.5316 => 11.3039, std.dev.: 0.0157) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.40% (2.3487 => 2.3158, std.dev.: 0.0067) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.14% (16.4461 => 16.7976, std.dev.: 1.3115) MultiSource/Applications/obsequi/Obsequi: 5.18% (1.0262 => 1.0794, std.dev.: 0.1936) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7129.46% (0.3123 => 22.5776, std.dev.: 0.5309) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.68% (0.2463 => 0.3662, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 1.36% (0.6010 => 0.6092, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.03% (0.3266 => 0.3365, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 2.49% (0.1969 => 0.2018, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 6.75% (0.1438 => 0.1535, std.dev.: 0.0272) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 11.34% (1.1329 => 1.2614, std.dev.: 0.3211) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.38% (0.4164 => 0.4148, std.dev.: 0.0260) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.73% (0.1369 => 0.1379, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.94% (0.0641 => 0.0647, std.dev.: 0.0167) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 40.51% (0.0195 => 0.0274, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.36% (0.0578 => 0.0609, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.83% (1.1437 => 1.1989, std.dev.: 0.0664) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2000.00% (0.0001 => 0.0021, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.87% (0.0627 => 0.0645, std.dev.: 0.0143) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 45.56% (0.0180 => 0.0262, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.49% (0.8017 => 0.7817, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -16.13% (0.0062 => 0.0052, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 05:07:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 07:07:59 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121116130759.60D042A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5934?compare_to=5932&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5934, Order: 168147, Start Time: 2012-11-16 11:35:26, End Time: 2012-11-16 13:08:19 To: 5932, Order: 168145, Start Time: 2012-11-16 09:39:47, End Time: 2012-11-16 11:12:31 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 1 (176 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1043 (862 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/SPASS/SPASS: -1.13% (11.2039 => 11.0776, std.dev.: 0.0265) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.86% (2.0478 => 2.1064, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/salsa20: 2.53% (7.4937 => 7.6830, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/hash2: 2.35% (3.1932 => 3.2683, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.74% (0.1431 => 0.1306, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.93% (0.3821 => 0.3518, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.03% (2.4924 => 2.3171, std.dev.: 0.0039) MultiSource/Applications/sgefa/sgefa: -6.64% (0.3357 => 0.3134, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.46% (0.3142 => 0.2939, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.26% (0.2428 => 0.2276, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.17% (0.9542 => 0.8953, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: -6.17% (9.2283 => 8.6588, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/oourafft: -6.06% (0.2160 => 0.2029, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.06% (0.7198 => 0.6762, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: -5.98% (16.1920 => 15.2242, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/football/football: -5.96% (0.9179 => 0.8632, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.95% (0.6484 => 0.6098, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.94% (0.9852 => 0.9267, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -5.82% (0.3812 => 0.3590, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.80% (1.0544 => 0.9932, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.77% (0.5805 => 0.5470, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.77% (0.6660 => 0.6276, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.75% (0.2695 => 0.2540, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.74% (0.1761 => 0.1660, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.72% (0.5591 => 0.5271, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.72% (0.6681 => 0.6299, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.72% (0.5859 => 0.5524, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.72% (0.6052 => 0.5706) SingleSource/UnitTests/ObjC/exceptions-2: -5.72% (0.3831 => 0.3612, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.71% (0.5863 => 0.5528, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.71% (0.3658 => 0.3449, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.71% (1.3722 => 1.2939, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.69% (3.5339 => 3.3327, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.69% (0.3884 => 0.3663, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.68% (1.6364 => 1.5434, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/for-in: -5.68% (0.4033 => 0.3804, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.67% (0.5802 => 0.5473, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.67% (0.5575 => 0.5259, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.67% (0.6230 => 0.5877, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.64% (4.0323 => 3.8047, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-4: -5.64% (0.3880 => 0.3661, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -5.64% (0.3848 => 0.3631, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -5.63% (0.4176 => 0.3941, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.62% (0.5857 => 0.5528, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -5.58% (1.1530 => 1.0887, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.57% (0.6395 => 0.6039, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.54% (1.2300 => 1.1618, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/synchronized: -5.54% (0.3896 => 0.3680, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.54% (0.5705 => 0.5389, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: -5.54% (7.0961 => 6.7031, std.dev.: 0.0079) MultiSource/Applications/lemon/lemon: -5.54% (1.1450 => 1.0816, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.53% (0.6676 => 0.6307, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.53% (0.3891 => 0.3676, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.52% (0.2355 => 0.2225, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.51% (0.6736 => 0.6365, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.49% (0.6667 => 0.6301, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.47% (4.8161 => 4.5526, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.46% (0.7524 => 0.7113, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.46% (0.5456 => 0.5158, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.45% (0.5849 => 0.5530, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.45% (0.5688 => 0.5378, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.44% (0.5478 => 0.5180, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.43% (4.8802 => 4.6150, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.42% (0.5941 => 0.5619, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.39% (0.6293 => 0.5954, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.38% (6.7716 => 6.4072, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.37% (0.7339 => 0.6945, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.37% (0.6446 => 0.6100, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.37% (4.5069 => 4.2650, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.35% (0.5567 => 0.5269, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.35% (0.6260 => 0.5925, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.35% (0.5570 => 0.5272, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.34% (0.6440 => 0.6096, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -5.33% (0.4199 => 0.3975, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: -5.32% (17.1032 => 16.1935, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.32% (0.5925 => 0.5610, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.32% (0.5569 => 0.5273, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.31% (0.3406 => 0.3225, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.29% (1.2784 => 1.2108, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.27% (0.5581 => 0.5287, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -5.26% (4.3330 => 4.1049, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.24% (1.4642 => 1.3875, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.24% (0.6033 => 0.5717, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.22% (0.6395 => 0.6061, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.20% (0.3483 => 0.3302, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.18% (0.8521 => 0.8080, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.16% (14.2083 => 13.4755, std.dev.: 0.0158) MultiSource/Benchmarks/McCat/18-imp/imp: -5.14% (0.3581 => 0.3397, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: -5.12% (1.3864 => 1.3154, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.10% (0.7919 => 0.7515, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: -5.10% (1.2515 => 1.1877, std.dev.: 0.0101) SingleSource/UnitTests/ObjC/parameter-passing: -5.05% (0.4280 => 0.4064, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.02% (1.2221 => 1.1607, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: -4.97% (15.5079 => 14.7375, std.dev.: 0.0150) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.96% (0.2278 => 0.2165, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.87% (0.2548 => 0.2424, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.86% (0.2385 => 0.2269, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.83% (1.6474 => 1.5678, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.82% (0.4916 => 0.4679, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -4.79% (15.2527 => 14.5220, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.79% (8.0126 => 7.6290, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: -4.77% (3.5154 => 3.3477, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.75% (0.6194 => 0.5900, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: -4.74% (0.2659 => 0.2533, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.70% (0.5999 => 0.5717, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.66% (0.5168 => 0.4927, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.64% (0.3319 => 0.3165, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.64% (0.6297 => 0.6005, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.62% (0.6189 => 0.5903, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.59% (1.2210 => 1.1650, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.57% (0.2999 => 0.2862, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (0.7021 => 0.6702, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -4.50% (2.4021 => 2.2939, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.47% (0.5329 => 0.5091, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -4.43% (0.4515 => 0.4315, std.dev.: 0.0048) MultiSource/Applications/lua/lua: -4.41% (4.0594 => 3.8802, std.dev.: 0.0074) MultiSource/Applications/hexxagon/hexxagon: -4.41% (1.3148 => 1.2568, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.40% (22.4056 => 21.4208, std.dev.: 0.0104) MultiSource/Applications/treecc/treecc: -4.33% (2.1401 => 2.0475, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.26% (0.4151 => 0.3974, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.24% (0.7447 => 0.7131, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.17% (0.3837 => 0.3677, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.14% (2.2587 => 2.1651, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.10% (0.8418 => 0.8073, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.10% (0.3931 => 0.3770, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -4.09% (0.3255 => 0.3122, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -4.08% (5.0226 => 4.8175, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: -4.04% (0.3194 => 0.3065, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.01% (0.3016 => 0.2895, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -4.00% (0.3025 => 0.2904, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: -3.97% (18.2933 => 17.5674, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.92% (0.2933 => 0.2818, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -3.90% (0.3026 => 0.2908, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.89% (2.1713 => 2.0868, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.89% (0.9077 => 0.8724, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: -3.84% (0.2939 => 0.2826, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.84% (0.3252 => 0.3127, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -3.83% (0.2871 => 0.2761, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -3.83% (34.0927 => 32.7876, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.83% (0.3057 => 0.2940, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.82% (0.2903 => 0.2792, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.82% (0.9557 => 0.9192, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.79% (0.3323 => 0.3197, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: -3.77% (0.6347 => 0.6108, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: -3.76% (0.4861 => 0.4678, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -3.73% (0.6441 => 0.6201, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.72% (0.4813 => 0.4634, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -3.71% (0.3394 => 0.3268, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -3.69% (0.2849 => 0.2744, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -3.68% (0.2989 => 0.2879, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -3.66% (0.3059 => 0.2947, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -3.63% (0.3446 => 0.3321, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -3.62% (0.3481 => 0.3355, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -3.62% (0.3205 => 0.3089, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.61% (0.4321 => 0.4165, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: -3.60% (0.7779 => 0.7499, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: -3.58% (0.4248 => 0.4096, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.58% (0.4083 => 0.3937, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.56% (0.3849 => 0.3712, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -3.56% (0.7982 => 0.7698, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: -3.52% (0.3867 => 0.3731, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -3.42% (0.3621 => 0.3497, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -3.39% (0.3271 => 0.3160, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -3.38% (0.6750 => 0.6522, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.32% (0.4427 => 0.4280, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.09% (0.3491 => 0.3383, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.05% (5.4682 => 5.3014, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/sieve: -2.90% (0.3788 => 0.3678, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -2.76% (0.4524 => 0.4399, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.53% (20.7746 => 20.2481, std.dev.: 0.0154) MultiSource/Applications/hbd/hbd: -2.49% (1.5610 => 1.5221, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7559, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.91% (1.7753 => 1.7058, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.69% (2.2633 => 2.1797, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.78% (1.3096 => 1.2732, std.dev.: 0.0074) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.67% (6.5735 => 6.4639, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 06:07:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 08:07:56 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121116140756.4199E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5935?compare_to=5929&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5935, Order: 168145, Start Time: 2012-11-16 10:49:09, End Time: 2012-11-16 14:08:14 To: 5929, Order: 168137, Start Time: 2012-11-16 06:43:24, End Time: 2012-11-16 10:01:02 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (172 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 2 (136 on baseline) Unchanged Tests: 1039 (718 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.81% (2.3739 => 2.4169, std.dev.: 0.0048) MultiSource/Applications/oggenc/oggenc: 1.07% (1.9632 => 1.9843, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.13% (2.0585 => 2.1024, std.dev.: 0.0102) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.80% (0.0625 => 0.0880, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.36% (0.1063 => 0.1407, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.97% (0.2969 => 0.3740, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.86% (0.1106 => 0.1392, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.28% (0.4253 => 0.5328, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.07% (0.0714 => 0.0893, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.79% (0.4139 => 0.5165, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 24.55% (1.5932 => 1.9843, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.58% (0.0475 => 0.0587, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.51% (0.5900 => 0.7287, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.47% (0.4994 => 0.6166, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.29% (0.0584 => 0.0720, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.88% (0.5000 => 0.6144, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.84% (0.1620 => 0.1990, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.43% (0.1021 => 0.1250, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 22.37% (0.0599 => 0.0733, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.77% (0.1107 => 0.1348, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.74% (0.0897 => 0.1092, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.30% (0.1549 => 0.1879, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.23% (0.0584 => 0.0708, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.17% (0.0633 => 0.0767, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.07% (0.0541 => 0.0655, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 20.99% (0.0948 => 0.1147, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.94% (0.1103 => 0.1334, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.87% (0.0642 => 0.0776, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.64% (0.1003 => 0.1210, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.44% (0.0822 => 0.0990, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.40% (0.0495 => 0.0596, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.37% (0.3903 => 0.4698, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 20.34% (0.0821 => 0.0988, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 20.20% (0.1619 => 0.1946, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.95% (0.1604 => 0.1924, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.22% (0.1462 => 0.1743, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 19.22% (0.0947 => 0.1129, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 19.06% (0.0808 => 0.0962, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.82% (0.3890 => 0.4622, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.72% (0.2014 => 0.2391, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 18.56% (0.1218 => 0.1444, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.53% (0.2866 => 0.3397, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 18.45% (0.5826 => 0.6901, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 18.34% (0.0698 => 0.0826, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.27% (0.2736 => 0.3236, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.26% (1.3152 => 1.5553, std.dev.: 0.0023) MultiSource/Applications/spiff/spiff: 18.19% (0.4029 => 0.4762, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 18.01% (0.1505 => 0.1776, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 17.93% (0.5889 => 0.6945, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.83% (0.1088 => 0.1282, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.66% (0.0572 => 0.0673, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 17.56% (0.5546 => 0.6520, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.55% (0.3271 => 0.3845, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.50% (3.5627 => 4.1861, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.50% (0.2875 => 0.3378, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.45% (0.0573 => 0.0673, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.37% (0.4658 => 0.5467, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.22% (1.6211 => 1.9003, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/gs/gs: 17.09% (1.8794 => 2.2005, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.02% (0.1968 => 0.2303, std.dev.: 0.0041) MultiSource/Applications/hbd/hbd: 16.82% (0.9697 => 1.1328, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.81% (0.1160 => 0.1355, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 16.69% (0.2750 => 0.3209, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/18-imp/imp: 16.68% (0.1421 => 0.1658, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 16.62% (0.2780 => 0.3242, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 16.51% (0.3004 => 0.3500, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 16.48% (0.2725 => 0.3174, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.47% (0.2738 => 0.3189, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 16.44% (0.2811 => 0.3273, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 16.43% (0.2714 => 0.3160, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 16.42% (1.0781 => 1.2551, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.41% (0.5026 => 0.5851, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 16.37% (0.2823 => 0.3285, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.34% (0.3930 => 0.4572, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.31% (0.2729 => 0.3174, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.28% (0.4361 => 0.5071, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.24% (4.4195 => 5.1374, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/random: 16.23% (0.2803 => 0.3258, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 16.21% (0.2813 => 0.3269, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 16.16% (0.7171 => 0.8330, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.15% (0.2792 => 0.3243, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 16.12% (0.3096 => 0.3595, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.10% (2.7292 => 3.1687, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.99% (0.3195 => 0.3706, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 15.99% (0.9909 => 1.1493, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.97% (0.2911 => 0.3376, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.95% (2.0673 => 2.3971, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: 15.89% (0.1284 => 0.1488, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 15.80% (4.2109 => 4.8763, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ary3: 15.67% (0.3267 => 0.3779, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 15.47% (0.3258 => 0.3762, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 15.45% (23.5202 => 27.1545, std.dev.: 0.0193) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.41% (0.1090 => 0.1258, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.32% (1.9694 => 2.2711, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 15.19% (0.3317 => 0.3821, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.09% (1.9966 => 2.2979, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.96% (0.3282 => 0.3773, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.93% (0.3362 => 0.3864, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 14.93% (0.3678 => 0.4227, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 14.92% (0.3465 => 0.3982, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/synchronized: 14.90% (0.3469 => 0.3986, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.90% (0.3060 => 0.3516, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 14.89% (0.3446 => 0.3959, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 14.85% (0.3496 => 0.4015, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.82% (0.3124 => 0.3587, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.80% (0.3460 => 0.3972, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 14.75% (0.2075 => 0.2381, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.74% (0.3488 => 0.4002, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 14.70% (0.3442 => 0.3948, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 14.70% (0.3477 => 0.3988, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 14.70% (0.3348 => 0.3840, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 14.69% (0.2566 => 0.2943, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.57% (0.3625 => 0.4153, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 14.47% (0.3650 => 0.4178, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 14.46% (1.4269 => 1.6332, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/sieve: 14.44% (0.3726 => 0.4264, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 14.30% (0.3643 => 0.4164, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 14.15% (0.3724 => 0.4251, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.12% (0.3981 => 0.4543, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 14.04% (0.4146 => 0.4728, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 14.01% (0.7875 => 0.8978, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.93% (0.3690 => 0.4204, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 13.93% (0.4251 => 0.4843, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.78% (0.3845 => 0.4375, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: 13.59% (0.0758 => 0.0861) MultiSource/Applications/JM/ldecod/ldecod: 13.55% (2.1653 => 2.4587, std.dev.: 0.0108) MultiSource/Applications/JM/lencod/lencod: 13.40% (4.6177 => 5.2365, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: 13.33% (0.5012 => 0.5680, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 13.32% (2.1013 => 2.3811, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.94% (0.2040 => 0.2304, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.87% (0.1383 => 0.1561, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 12.78% (0.2691 => 0.3035, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 12.43% (5.5417 => 6.2305, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.97% (0.6435 => 0.7205, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 11.26% (0.3498 => 0.3892, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.19% (0.1028 => 0.1143, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.17% (0.2068 => 0.2299) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.98% (0.2103 => 0.2334, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.81% (0.2737 => 0.3033, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 10.81% (0.4847 => 0.5371, std.dev.: 0.0055) MultiSource/Applications/siod/siod: 10.64% (0.6634 => 0.7340, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.38% (0.3084 => 0.3404, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 10.22% (0.3336 => 0.3677, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 10.17% (2.0346 => 2.2415, std.dev.: 0.0025) MultiSource/Applications/lemon/lemon: 9.91% (0.2391 => 0.2628, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.84% (0.5361 => 0.5835, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.65% (4.6926 => 5.0986, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.48% (11.6398 => 12.6268, std.dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.18% (0.5584 => 0.6041, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.04% (0.7426 => 0.8023, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 6.86% (11.9555 => 12.7761, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.33% (0.3792 => 0.3994, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.12% (0.0734 => 0.0867, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.39% (0.2802 => 0.3065, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6109, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6722, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-2: 4.84% (1.8057 => 1.8931, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 4.66% (15.4430 => 16.1622, std.dev.: 0.0049) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6406, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1963, std.dev.: 0.0077) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2240, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.47% (7.1849 => 7.2907, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3060, std.dev.: 0.0145) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5143, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5915, std.dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.40% (2.4764 => 2.4169, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5673, std.dev.: 0.0157) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9760, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7969, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -7.08% (0.2402 => 0.2232, std.dev.: 0.0026) SingleSource/UnitTests/Vector/build2: -3.79% (11.2080 => 10.7833, std.dev.: 0.0188) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7727, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.89% (0.6293 => 0.6111, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/fldry: -2.67% (17.2379 => 16.7769, std.dev.: 0.0745) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8597, std.dev.: 0.0106) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5736, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4957, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.2026, std.dev.: 0.0209) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0476, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 06:22:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 08:22:15 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121116142215.8C6C12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5936?compare_to=5931&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5936, Order: 168147, Start Time: 2012-11-16 12:01:32, End Time: 2012-11-16 14:22:34 To: 5931, Order: 168143, Start Time: 2012-11-16 08:48:53, End Time: 2012-11-16 11:09:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 17 (134 on baseline) Performance Improvements: 3 (39 on baseline) Added Tests: 0 (136 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1020 (714 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 15.77% (0.6176 => 0.7150, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 15.72% (0.7851 => 0.9085, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 15.51% (0.5885 => 0.6798, std.dev.: 0.0103) MultiSource/Applications/minisat/minisat: 14.15% (0.8170 => 0.9326, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.10% (1.7420 => 1.9527, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 11.49% (1.5767 => 1.7578, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.39% (0.4183 => 0.4534, std.dev.: 0.0111) MultiSource/Applications/hexxagon/hexxagon: 7.33% (1.4615 => 1.5686, std.dev.: 0.0126) MultiSource/Applications/hbd/hbd: 7.10% (1.7416 => 1.8652, std.dev.: 0.0336) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.18% (0.6279 => 0.6604, std.dev.: 0.0108) MultiSource/Applications/d/make_dparser: 4.45% (4.0035 => 4.1816, std.dev.: 0.0451) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 17.71% (0.1214 => 0.1429, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 15.55% (2.7744 => 3.2058, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 12.16% (6.3823 => 7.1582, std.dev.: 0.2007) SingleSource/Benchmarks/Shootout/hash: 7.07% (5.1013 => 5.4618, std.dev.: 0.0663) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 5.81% (6.1387 => 6.4952, std.dev.: 0.0512) MultiSource/Applications/sqlite3/sqlite3: 2.50% (4.6797 => 4.7969, std.dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: -9.05% (0.4378 => 0.3982, std.dev.: 0.0149) SingleSource/UnitTests/ObjC/exceptions-3: -8.63% (0.4323 => 0.3950, std.dev.: 0.0125) MultiSource/Benchmarks/PAQ8p/paq8p: -3.74% (11.9810 => 11.5333, std.dev.: 0.1256) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -1.47% (0.1358 => 0.1338, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0420 => 0.0420, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.46% (0.0649 => 0.0652, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 0.05% (494.0629 => 494.2965, std.dev.: 0.0548) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/power/power: 43732.27% (1.1277 => 494.2965, std.dev.: 0.0548) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.26% (0.5229 => 1.6485, std.dev.: 0.0542) MultiSource/Applications/SPASS/SPASS: 17.84% (14.9895 => 17.6637, std.dev.: 0.4561) MultiSource/Applications/kimwitu++/kc: 53.04% (14.1553 => 21.6639, std.dev.: 0.1477) MultiSource/Benchmarks/MallocBench/gs/gs: 22.25% (4.1105 => 5.0249, std.dev.: 0.1311) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 40.20% (1.1048 => 1.5489, std.dev.: 0.0669) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 436.43% (7.1582 => 38.3985, std.dev.: 0.1846) SingleSource/Benchmarks/Misc-C++-EH/spirit: 87.76% (3.4629 => 6.5019, std.dev.: 0.2946) SingleSource/Benchmarks/Misc-C++/stepanov_container: 82.58% (0.6222 => 1.1360, std.dev.: 0.0218) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10740.69% (0.0720 => 7.8053, std.dev.: 0.2374) MultiSource/Applications/SIBsim4/SIBsim4: 3942300.00% (0.0001 => 3.9424, std.dev.: 0.0096) MultiSource/Applications/SPASS/SPASS: 14627000.00% (0.0001 => 14.6271, std.dev.: 0.6014) MultiSource/Applications/kimwitu++/kc: 53100.00% (0.0001 => 0.0532, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 577100.00% (0.0001 => 0.5772, std.dev.: 0.0330) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10084600.00% (0.0001 => 10.0847, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5688000.00% (0.0001 => 5.6881, std.dev.: 0.8586) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1811.39% (1.1194 => 21.3961, std.dev.: 0.1736) MultiSource/Applications/ClamAV/clamscan: 70.71% (22.1758 => 37.8564, std.dev.: 0.1320) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 69.63% (2.9384 => 4.9845, std.dev.: 0.2045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 58.36% (7.0540 => 11.1710, std.dev.: 0.1569) MultiSource/Benchmarks/FreeBench/distray/distray: 53.98% (0.1056 => 0.1626, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 51.74% (8.1363 => 12.3464, std.dev.: 0.0342) MultiSource/Applications/JM/lencod/lencod: 48.33% (21.9371 => 32.5383, std.dev.: 0.0823) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 41.10% (0.1236 => 0.1744, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/almabench: 38.77% (0.0730 => 0.1013, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 38.34% (0.1432 => 0.1981, std.dev.: 0.0065) MultiSource/Benchmarks/Fhourstones/fhourstones: 35.12% (0.1566 => 0.2116, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 31.44% (0.1584 => 0.2082, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 31.08% (0.7115 => 0.9326, std.dev.: 0.0113) SingleSource/UnitTests/vla: 30.42% (0.0355 => 0.0463, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 29.36% (0.5105 => 0.6604, std.dev.: 0.0108) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 28.70% (0.0648 => 0.0834, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/mst/mst: 28.12% (0.1163 => 0.1490, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 27.84% (0.2554 => 0.3265, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.81% (0.0730 => 0.0933, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 26.68% (1.5415 => 1.9527, std.dev.: 0.0082) MultiSource/Applications/lemon/lemon: 25.59% (1.0722 => 1.3466, std.dev.: 0.0131) MultiSource/Applications/d/make_dparser: 25.37% (3.3354 => 4.1816, std.dev.: 0.0451) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 24.95% (0.0457 => 0.0571, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 24.42% (5.7591 => 7.1653, std.dev.: 0.0974) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.26% (0.0746 => 0.0927, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 24.15% (0.0886 => 0.1100, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.95% (0.1044 => 0.1294, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.91% (1.4186 => 1.7578, std.dev.: 0.0121) SingleSource/Benchmarks/Stanford/Oscar: 23.90% (0.0636 => 0.0788, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/perlin: 23.13% (0.0536 => 0.0660, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 22.15% (1.2842 => 1.5686, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 22.12% (14.3668 => 17.5445, std.dev.: 0.0350) SingleSource/Benchmarks/Misc/ReedSolomon: 21.28% (0.2049 => 0.2485, std.dev.: 0.0023) MultiSource/Applications/treecc/treecc: 21.04% (2.0273 => 2.4538, std.dev.: 0.0697) SingleSource/UnitTests/ObjC/dot-syntax-1: 20.88% (0.0479 => 0.0579, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 20.12% (0.1337 => 0.1606, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.56% (0.2700 => 0.3228, std.dev.: 0.0204) MultiSource/Applications/hbd/hbd: 19.54% (1.5603 => 1.8652, std.dev.: 0.0336) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.24% (0.8067 => 0.9619, std.dev.: 0.0292) MultiSource/Applications/Burg/burg: 19.23% (1.1642 => 1.3881, std.dev.: 0.0657) SingleSource/Regression/C++/ofstream_ctor: 19.14% (0.2905 => 0.3461, std.dev.: 0.0124) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.84% (0.1125 => 0.1337, std.dev.: 0.0077) MultiSource/Applications/lua/lua: 18.54% (3.8723 => 4.5902, std.dev.: 0.1024) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 18.50% (0.3826 => 0.4534, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.36% (4.2646 => 5.0477, std.dev.: 0.1458) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 17.81% (3.8922 => 4.5853, std.dev.: 0.1920) SingleSource/Benchmarks/Misc/whetstone: 17.73% (0.0660 => 0.0777, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.70% (0.0842 => 0.0991, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 17.67% (9.4845 => 11.1603, std.dev.: 0.2558) SingleSource/Benchmarks/Shootout/lists: 17.57% (0.0626 => 0.0736, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 17.48% (17.1811 => 20.1842, std.dev.: 0.1603) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.35% (2.0665 => 2.4250, std.dev.: 0.0562) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.22% (0.0871 => 0.1021, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 17.08% (0.2271 => 0.2659, std.dev.: 0.0115) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.96% (0.8172 => 0.9558, std.dev.: 0.0399) MultiSource/Benchmarks/Olden/bisort/bisort: 16.94% (0.0614 => 0.0718, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.74% (0.0675 => 0.0788, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.27% (0.3865 => 0.4494, std.dev.: 0.0192) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.10% (0.1062 => 0.1233, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.03% (0.2065 => 0.2396, std.dev.: 0.0118) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.58% (0.0770 => 0.0890, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/matrix: 15.53% (0.0818 => 0.0945, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/exceptions-2: 15.50% (0.3497 => 0.4039, std.dev.: 0.0209) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.47% (0.0834 => 0.0963, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.28% (0.8101 => 0.9339, std.dev.: 0.0354) MultiSource/Applications/aha/aha: 15.20% (0.1151 => 0.1326, std.dev.: 0.0057) MultiSource/Applications/viterbi/viterbi: 15.11% (0.1555 => 0.1790, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.06% (0.0770 => 0.0886, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/synchronized: 14.91% (0.3561 => 0.4092, std.dev.: 0.0037) MultiSource/Benchmarks/NPB-serial/is/is: 14.88% (0.0719 => 0.0826, std.dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: 14.70% (63.2438 => 72.5425, std.dev.: 0.2181) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.67% (0.3121 => 0.3579, std.dev.: 0.0177) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.57% (0.2107 => 0.2414, std.dev.: 0.0117) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.49% (0.0704 => 0.0806, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.19% (0.1029 => 0.1175, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.17% (0.5569 => 0.6358, std.dev.: 0.0293) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.09% (0.3427 => 0.3910, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.98% (0.5981 => 0.6817, std.dev.: 0.0256) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.97% (4.9449 => 5.6356, std.dev.: 0.2335) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.82% (0.1143 => 0.1301, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.71% (5.0018 => 5.6874, std.dev.: 0.2611) MultiSource/Benchmarks/McCat/18-imp/imp: 13.67% (0.3423 => 0.3891, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/trivial-interface: 13.22% (0.3473 => 0.3932, std.dev.: 0.0160) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.56% (0.3543 => 0.3988, std.dev.: 0.0134) SingleSource/UnitTests/ObjC/exceptions: 12.49% (0.3828 => 0.4306, std.dev.: 0.0166) MultiSource/Benchmarks/Olden/power/power: 12.43% (0.1440 => 0.1619, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 12.39% (0.3543 => 0.3982, std.dev.: 0.0149) SingleSource/UnitTests/ObjC/exceptions-3: 12.34% (0.3516 => 0.3950, std.dev.: 0.0125) MultiSource/Benchmarks/McCat/09-vor/vor: 12.30% (0.3180 => 0.3571, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 12.15% (0.3694 => 0.4143, std.dev.: 0.0158) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.73% (0.0929 => 0.1038, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/05-eks/eks: 11.37% (0.4299 => 0.4788, std.dev.: 0.0075) MultiSource/Benchmarks/PAQ8p/paq8p: 11.25% (10.3673 => 11.5333, std.dev.: 0.1256) SingleSource/UnitTests/SignlessTypes/rem: 10.31% (0.1144 => 0.1262, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.80% (0.3817 => 0.4153, std.dev.: 0.0092) MultiSource/Benchmarks/Olden/bh/bh: 7.96% (0.3092 => 0.3338, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.91% (4.3953 => 11.0283, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/methcall: 147.77% (5.3999 => 13.3794, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 26.81% (13.4384 => 17.0407, std.dev.: 0.5763) MultiSource/Applications/minisat/minisat: 23.05% (9.1159 => 11.2175, std.dev.: 0.5032) SingleSource/Benchmarks/CoyoteBench/lpbench: 19.75% (10.3460 => 12.3889, std.dev.: 0.2346) SingleSource/Benchmarks/Misc/oourafft: 17.53% (6.6465 => 7.8114, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.66% (1.1145 => 1.3002, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/mst/mst: 16.58% (0.1285 => 0.1498, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.98% (0.2944 => 0.3326, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.66% (2.8904 => 3.2274, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/hash: 11.27% (4.9088 => 5.4618, std.dev.: 0.0663) SingleSource/Benchmarks/Misc/richards_benchmark: 10.23% (1.1396 => 1.2562, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.10% (8.6802 => 9.5573, std.dev.: 0.2237) MultiSource/Applications/JM/ldecod/ldecod: 10.09% (0.1298 => 0.1429, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.29% (1.7254 => 1.8857, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 8.93% (3.1578 => 3.4397, std.dev.: 0.1012) MultiSource/Benchmarks/Fhourstones/fhourstones: 6.17% (1.8329 => 1.9459, std.dev.: 0.0384) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.46% (4.2280 => 4.4590, std.dev.: 0.0140) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.76% (0.3463 => 0.3628, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.12% (11.6436 => 12.1232, std.dev.: 0.0076) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 3.40% (3.1023 => 3.2078, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: 3.29% (4.6441 => 4.7969, std.dev.: 0.0074) MultiSource/Applications/lua/lua: 3.01% (26.0924 => 26.8781, std.dev.: 0.1529) SingleSource/Benchmarks/Dhrystone/dry: 2.57% (2.4116 => 2.4736, std.dev.: 0.0093) MultiSource/Benchmarks/PAQ8p/paq8p: 2.51% (85.0658 => 87.2017, std.dev.: 0.0217) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.21% (1.7133 => 1.7511, std.dev.: 0.0111) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 2.05% (3.1595 => 3.2243, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.62% (27.8444 => 28.2945, std.dev.: 0.0419) SingleSource/Benchmarks/Shootout/sieve: 1.54% (5.2139 => 5.2940, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.38% (6.5088 => 6.5989, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.33% (1.0313 => 1.0450, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.32% (12.5348 => 12.7001, std.dev.: 0.0593) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0502, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1669, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.73% (5.2763 => 1.2279, std.dev.: 0.0482) SingleSource/Benchmarks/Misc/salsa20: -75.75% (0.8651 => 0.2098, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/richards_benchmark: -44.76% (0.1622 => 0.0896, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.29% (5.3855 => 4.7773, std.dev.: 0.1384) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.63% (5.3526 => 4.7838, std.dev.: 0.1040) MultiSource/Applications/JM/ldecod/ldecod: -8.32% (10.4361 => 9.5680, std.dev.: 0.1430) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.03% (0.3987 => 0.2391, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.72% (0.0506 => 0.0305, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.30% (4.5009 => 2.7772, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: -33.53% (1.1492 => 0.7639, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -25.27% (10.7105 => 8.0042, std.dev.: 0.4707) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.16% (2.6546 => 2.0132, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/mason/mason: -19.25% (0.2161 => 0.1745, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4248, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2842, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.72% (32.5116 => 29.0272, std.dev.: 0.0217) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.88% (1.5660 => 1.4270, std.dev.: 0.0037) MultiSource/Benchmarks/NPB-serial/is/is: -8.74% (9.5636 => 8.7275, std.dev.: 0.1207) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.95% (4.8142 => 4.4796, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.73% (3.2416 => 3.0235, std.dev.: 0.0294) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5074, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/lists: -4.11% (6.2999 => 6.0412, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.69% (19.9488 => 19.2125, std.dev.: 0.1918) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.37% (0.9957 => 0.9621, std.dev.: 0.0049) MultiSource/Benchmarks/sim/sim: -3.07% (5.0483 => 4.8932, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.54% (0.4808 => 0.4686, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.90% (8.1563 => 8.0015, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6771, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.47% (10.2830 => 10.1318, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0013) Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 06:30:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 08:30:13 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121116143013.EAD5B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5937?compare_to=5933&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5937, Order: 168165, Start Time: 2012-11-16 13:01:26, End Time: 2012-11-16 14:30:34 To: 5933, Order: 168147, Start Time: 2012-11-16 11:08:15, End Time: 2012-11-16 12:42:16 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 3 (77 on baseline) Performance Improvements: 33 (30 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 958 (867 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.44% (0.3224 => 0.3464, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.13% (6.7588 => 7.2407, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.10% (5.8330 => 5.8969, std.dev.: 0.0086) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/04-bisect/bisect: -8.21% (0.1291 => 0.1185, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -7.93% (0.8901 => 0.8195, std.dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.35% (0.6552 => 0.6136, std.dev.: 0.0153) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -6.29% (0.2400 => 0.2249, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.12% (0.2273 => 0.2134, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/dbms/dbms: -5.10% (0.9246 => 0.8774, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.76% (0.8151 => 0.7763, std.dev.: 0.0104) MultiSource/Benchmarks/McCat/05-eks/eks: -4.42% (0.4611 => 0.4407, std.dev.: 0.0058) MultiSource/Applications/hbd/hbd: -3.76% (1.5097 => 1.4529, std.dev.: 0.0213) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.69% (0.2710 => 0.2610, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.40% (0.3206 => 0.3097, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: -3.22% (4.3205 => 4.1813, std.dev.: 0.0323) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.89% (1.1607 => 1.1271, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.39% (0.5066 => 0.4945, std.dev.: 0.0025) MultiSource/Applications/treecc/treecc: -2.33% (2.0942 => 2.0454, std.dev.: 0.0077) MultiSource/Applications/lua/lua: -2.33% (4.0090 => 3.9156, std.dev.: 0.0148) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.26% (0.6496 => 0.6349, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -2.21% (1.3819 => 1.3514, std.dev.: 0.0071) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.19% (4.6140 => 4.5130, std.dev.: 0.0299) MultiSource/Applications/minisat/minisat: -1.98% (0.7174 => 0.7032, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.92% (8.9399 => 8.7684, std.dev.: 0.0383) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.78% (1.2260 => 1.2042, std.dev.: 0.0032) MultiSource/Applications/ClamAV/clamscan: -1.68% (15.3795 => 15.1212, std.dev.: 0.0511) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/uudecode/uudecode: -10.49% (0.1001 => 0.0896, std.dev.: 0.0038) MultiSource/Applications/minisat/minisat: -7.80% (6.7193 => 6.1950, std.dev.: 0.0087) MultiSource/Applications/SPASS/SPASS: -5.69% (8.8369 => 8.3343, std.dev.: 0.0508) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.16% (0.3223 => 0.3089, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.83% (6.3609 => 6.1172, std.dev.: 0.0264) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.48% (1.2787 => 1.2470, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/mason/mason: -2.26% (0.5393 => 0.5271, std.dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: -1.37% (3.4266 => 3.3795, std.dev.: 0.0069) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.27% (1.2869 => 1.2706, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: -1.05% (6.7416 => 6.6711, std.dev.: 0.0078) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.07% (16.7976 => 16.7853, std.dev.: 0.0699) MultiSource/Applications/obsequi/Obsequi: -1.67% (1.0794 => 1.0614, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.14% (22.5776 => 22.0941, std.dev.: 0.0295) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.17% (0.3662 => 0.3619, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/bigfib: 0.51% (0.6092 => 0.6123, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.33% (0.3365 => 0.3354, std.dev.: 0.0524) SingleSource/Benchmarks/Shootout-C++/strcat: -0.20% (0.2018 => 0.2014, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0217 => 0.0217, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0426 => 0.0425, std.dev.: 0.0126) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -20.48% (0.0332 => 0.0264, std.dev.: 0.0077) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.96% (0.0314 => 0.0317, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.24% (0.0424 => 0.0423, std.dev.: 0.0156) SingleSource/UnitTests/Vector/Altivec/casts: -4.46% (0.0202 => 0.0193, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/test1: -1.85% (0.0216 => 0.0212, std.dev.: 0.0066) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -3.65% (0.1535 => 0.1479, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -10.17% (1.2614 => 1.1331, std.dev.: 0.0342) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.87% (0.4148 => 0.4184, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.32% (0.1379 => 0.1411, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.77% (0.0647 => 0.0652, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -8.76% (0.0274 => 0.0250, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.18% (0.0609 => 0.0547, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.53% (1.1989 => 1.1925, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -95.24% (0.0021 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.79% (0.0645 => 0.0627, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.94% (0.0262 => 0.0215, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.35% (0.7817 => 0.7790, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 9.62% (0.0052 => 0.0057, std.dev.: 0.0064) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2304.60% (0.6332 => 15.2259, std.dev.: 0.1014) MultiSource/Benchmarks/McCat/08-main/main: 46.64% (0.1831 => 0.2685, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.93% (0.1559 => 0.1451, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1517.08% (0.3344 => 5.4075, std.dev.: 0.1166) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.39% (0.2364 => 0.3248, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/mandel: 0.23% (0.0429 => 0.0430, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.79% (0.0224 => 0.0228, std.dev.: 0.0069) SingleSource/UnitTests/byval-alignment: -31.30% (0.0230 => 0.0158, std.dev.: 0.0059) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 12.11% (0.1462 => 0.1639, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4609, std.dev.: 0.0205) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0702, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4923, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3137, std.dev.: 0.0245) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1373, std.dev.: 0.0552) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4019, std.dev.: 0.0123) SingleSource/Regression/C/uint64_to_float: -24.18% (2.1832 => 1.6554, std.dev.: 0.0049) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0003, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.09% (0.0810 => 0.0916, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.03% (0.0848 => 0.0950, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 9.98% (0.1112 => 0.1223, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.33% (0.2180 => 0.2318, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.44% (0.8321 => 0.8774, std.dev.: 0.0101) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.41% (0.1905 => 0.2008, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.05% (0.2279 => 0.2394, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.83% (0.3295 => 0.3454, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.24% (1.1606 => 1.2098, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.88% (0.7473 => 0.7763, std.dev.: 0.0104) MultiSource/Applications/Burg/burg: 3.71% (1.2222 => 1.2675, std.dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.49% (0.4127 => 0.4271, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.39% (0.4783 => 0.4945, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.37% (0.3115 => 0.3220, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.28% (0.3717 => 0.3839, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.19% (6.6074 => 6.8181, std.dev.: 0.0136) MultiSource/Applications/SIBsim4/SIBsim4: 3.07% (1.2568 => 1.2954, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.06% (1.1685 => 1.2042, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.02% (2.1401 => 2.2047, std.dev.: 0.0079) MultiSource/Applications/minisat/minisat: 2.90% (0.6834 => 0.7032, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.87% (4.1763 => 4.2961, std.dev.: 0.0269) MultiSource/Applications/SPASS/SPASS: 2.75% (14.2605 => 14.6532, std.dev.: 0.0982) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.65% (0.4559 => 0.4680, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.57% (13.1811 => 13.5203, std.dev.: 0.0932) MultiSource/Applications/treecc/treecc: 2.54% (1.9948 => 2.0454, std.dev.: 0.0077) MultiSource/Applications/lua/lua: 2.53% (3.8189 => 3.9156, std.dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.45% (0.5191 => 0.5318, std.dev.: 0.0048) MultiSource/Applications/d/make_dparser: 2.40% (3.2366 => 3.3143, std.dev.: 0.0206) MultiSource/Applications/ClamAV/clamscan: 2.39% (14.7684 => 15.1212, std.dev.: 0.0511) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.37% (0.9688 => 0.9918, std.dev.: 0.0083) MultiSource/Benchmarks/Bullet/bullet: 2.31% (31.8598 => 32.5970, std.dev.: 0.0524) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.23% (4.4873 => 4.5873, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.20% (1.6386 => 1.6746, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.05% (0.7932 => 0.8095, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.05% (0.9039 => 0.9224, std.dev.: 0.0068) MultiSource/Applications/siod/siod: 2.01% (2.2184 => 2.2629, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.96% (0.6227 => 0.6349, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.90% (0.6586 => 0.6711, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.77% (1.3279 => 1.3514, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.75% (3.1832 => 3.2390, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/football/football: 1.63% (0.8768 => 0.8911, std.dev.: 0.0032) MultiSource/Applications/lemon/lemon: 1.46% (1.0945 => 1.1105, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.40% (8.6476 => 8.7684, std.dev.: 0.0383) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 126.13% (0.0199 => 0.0450, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/pi: 57.30% (1.5795 => 2.4846, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.34% (2.9753 => 3.4615, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.73% (0.7597 => 0.8792, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.71% (2.7995 => 3.2112, std.dev.: 0.0252) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 13.54% (6.3772 => 7.2407, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6088, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.73% (0.3186 => 0.3464, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.46% (1.1857 => 1.2741, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/queens: 7.08% (1.7056 => 1.8264, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.76% (4.7794 => 5.1026, std.dev.: 0.0210) SingleSource/Benchmarks/Misc/richards_benchmark: 6.14% (1.3037 => 1.3838, std.dev.: 0.0086) MultiSource/Applications/SIBsim4/SIBsim4: 6.03% (3.1873 => 3.3795, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.91% (4.9686 => 5.2620, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.82% (4.5327 => 4.7965, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.70% (3.3761 => 3.5347, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.55% (6.2275 => 6.5110, std.dev.: 0.0795) MultiSource/Applications/lambda-0_1_3/lambda: 4.32% (7.4933 => 7.8170, std.dev.: 0.0600) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.22% (4.9453 => 5.1542, std.dev.: 0.0315) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.99% (4.9469 => 5.1441, std.dev.: 0.0203) MultiSource/Applications/hexxagon/hexxagon: 3.91% (14.0064 => 14.5536, std.dev.: 0.0133) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.01% (0.3587 => 0.3695, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.99% (1.2337 => 1.2706, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 2.94% (3.6643 => 3.7720, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.89% (8.2783 => 8.5177, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.77% (11.5690 => 11.8890, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.33% (4.8660 => 4.9794, std.dev.: 0.0258) SingleSource/Benchmarks/Shootout/lists: 2.24% (7.3375 => 7.5020, std.dev.: 0.0595) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.15% (4.8362 => 4.9400, std.dev.: 0.0120) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.59% (1.1365 => 1.1546, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/FloatMM: 1.44% (0.8807 => 0.8934, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.16% (2.4647 => 2.4933, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/ReedSolomon: 1.14% (8.5322 => 8.6297, std.dev.: 0.0321) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.14% (3.5679 => 3.6085, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -33.14% (0.0338 => 0.0226, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/em3d/em3d: -21.18% (5.4641 => 4.3066, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -15.19% (7.2130 => 6.1172, std.dev.: 0.0264) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.84% (1.0512 => 0.9372, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -10.72% (1.1216 => 1.0014, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.53% (14.6451 => 13.3963, std.dev.: 0.1391) MultiSource/Benchmarks/mafft/pairlocalalign: -8.51% (63.1822 => 57.8074, std.dev.: 0.0483) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.95% (0.3269 => 0.3009, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.96% (4.7482 => 4.4177, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.96% (3.7148 => 3.4934, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.88% (5.4972 => 5.1741, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.04% (5.1557 => 4.8960, std.dev.: 0.0309) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.36% (4.7449 => 4.5380, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.74% (6.0224 => 5.7972, std.dev.: 0.0130) MultiSource/Applications/lua/lua: -3.37% (29.8330 => 28.8283, std.dev.: 0.1081) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.25% (0.5807 => 0.5618, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.91% (28.5821 => 27.7507, std.dev.: 0.0083) MultiSource/Applications/aha/aha: -2.77% (3.3398 => 3.2472, std.dev.: 0.0071) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.75% (1.2822 => 1.2470, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/bisort/bisort: -2.74% (0.6636 => 0.6454, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/mason/mason: -2.66% (0.5415 => 0.5271, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.29% (9.9065 => 9.6797, std.dev.: 0.0303) SingleSource/Benchmarks/Shootout-C++/hash2: -2.27% (3.4237 => 3.3460, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.01% (11.5316 => 11.2994, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.99% (3.2169 => 3.1529, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.97% (2.6356 => 2.5838, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.59% (4.9994 => 4.9201, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.17% (5.6343 => 5.5683, std.dev.: 0.0183) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.11% (1.0388 => 1.0273, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/tsp/tsp: -1.00% (1.4861 => 1.4712, std.dev.: 0.0043) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.06% (16.4461 => 16.7853, std.dev.: 0.0699) MultiSource/Applications/obsequi/Obsequi: 3.43% (1.0262 => 1.0614, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6974.64% (0.3123 => 22.0941, std.dev.: 0.0295) SingleSource/Benchmarks/CoyoteBench/fftbench: 46.93% (0.2463 => 0.3619, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/bigfib: 1.88% (0.6010 => 0.6123, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.69% (0.3266 => 0.3354, std.dev.: 0.0524) SingleSource/Benchmarks/Shootout-C++/strcat: 2.29% (0.1969 => 0.2014, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0126) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.94% (0.0254 => 0.0264, std.dev.: 0.0077) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.97% (0.0302 => 0.0317, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0156) SingleSource/UnitTests/Vector/Altivec/casts: 1.58% (0.0190 => 0.0193, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/test1: 17.78% (0.0180 => 0.0212, std.dev.: 0.0066) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.85% (0.1438 => 0.1479, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.02% (1.1329 => 1.1331, std.dev.: 0.0342) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.48% (0.4164 => 0.4184, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.07% (0.1369 => 0.1411, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.72% (0.0641 => 0.0652, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 28.21% (0.0195 => 0.0250, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.36% (0.0578 => 0.0547, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.27% (1.1437 => 1.1925, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0627 => 0.0627, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.44% (0.0180 => 0.0215, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.83% (0.8017 => 0.7790, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -8.06% (0.0062 => 0.0057, std.dev.: 0.0064) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 07:04:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 09:04:15 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121116150415.7C9B62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5938?compare_to=5934&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5938, Order: 168168, Start Time: 2012-11-16 13:31:30, End Time: 2012-11-16 15:04:35 To: 5934, Order: 168147, Start Time: 2012-11-16 11:35:26, End Time: 2012-11-16 13:08:19 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (5 on baseline) Performance Improvements: 1 (180 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1041 (857 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.88% (79.0821 => 80.5721, std.dev.: 0.1677) SingleSource/Benchmarks/McGill/chomp: 1.14% (1.1481 => 1.1612, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/lambda-0_1_3/lambda: -1.31% (0.7698 => 0.7597, std.dev.: 0.0023) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1009, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.4937 => 7.6777, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/hash2: 2.33% (3.1932 => 3.2675, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.07% (79.7170 => 80.5721, std.dev.: 0.1677) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.01% (0.1431 => 0.1302, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.35% (0.3821 => 0.3502, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -7.30% (2.4924 => 2.3105, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.97% (0.3142 => 0.2923, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.75% (0.2428 => 0.2264, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.65% (0.9542 => 0.8907, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -6.61% (0.3357 => 0.3135, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.50% (0.1584 => 0.1481, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -6.48% (0.2160 => 0.2020, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -6.29% (9.2283 => 8.6474, std.dev.: 0.0078) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.29% (0.1716 => 0.1608, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.28% (0.6484 => 0.6077, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: -6.28% (16.1920 => 15.1759, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.20% (0.2355 => 0.2209, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -6.12% (7.0961 => 6.6619, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.12% (1.0544 => 0.9899, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: -6.11% (0.9179 => 0.8618, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.10% (0.9852 => 0.9251, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.04% (0.7198 => 0.6763, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -6.02% (0.1761 => 0.1655, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.02% (0.6681 => 0.6279, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.93% (4.0323 => 3.7930, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.93% (0.3658 => 0.3441, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.92% (0.5859 => 0.5512, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.92% (0.5591 => 0.5260, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.92% (4.5069 => 4.2401, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.92% (1.2300 => 1.1572, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.92% (0.6660 => 0.6266, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.91% (1.6364 => 1.5397, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.91% (3.5339 => 3.3252, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.90% (4.8802 => 4.5921, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.90% (0.2695 => 0.2536, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.89% (0.6230 => 0.5863, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.88% (0.5863 => 0.5518, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.88% (0.6052 => 0.5696, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.88% (4.8161 => 4.5328, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.87% (0.5857 => 0.5513, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -5.87% (1.1450 => 1.0778, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.85% (1.4642 => 1.3786, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: -5.82% (4.3330 => 4.0809, std.dev.: 0.0048) MultiSource/Benchmarks/nbench/nbench: -5.81% (1.1530 => 1.0860, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.80% (1.3722 => 1.2926, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: -5.78% (0.4515 => 0.4254, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.77% (0.5478 => 0.5162, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.76% (0.5575 => 0.5254, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.76% (6.7716 => 6.3818, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.74% (0.5805 => 0.5472, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.73% (0.5688 => 0.5362, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.73% (0.6667 => 0.6285, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.71% (0.7919 => 0.7467, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.69% (0.6260 => 0.5904, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.68% (0.6676 => 0.6297, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.66% (0.5456 => 0.5147, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.66% (0.7524 => 0.7098, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.65% (0.2548 => 0.2404, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.64% (0.6736 => 0.6356, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.64% (0.6293 => 0.5938, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.62% (1.2784 => 1.2065, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.62% (0.5925 => 0.5592, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.61% (0.5581 => 0.5268, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.61% (0.5849 => 0.5521, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.60% (0.6395 => 0.6037, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.59% (0.7339 => 0.6929, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.58% (0.5802 => 0.5478, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.58% (0.3406 => 0.3216, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.54% (0.5941 => 0.5612, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.54% (0.6395 => 0.6041, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.53% (0.2278 => 0.2152, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.53% (14.2083 => 13.4227, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.51% (0.3483 => 0.3291, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.51% (0.5570 => 0.5263, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: -5.51% (0.3812 => 0.3602, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.49% (0.8521 => 0.8053, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -5.46% (0.2985 => 0.2822, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.46% (0.5569 => 0.5265, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: -5.45% (0.2659 => 0.2514, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.42% (0.5705 => 0.5396, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -5.41% (17.1032 => 16.1775, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/for-in: -5.41% (0.4033 => 0.3815, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.40% (0.6446 => 0.6098, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.39% (0.5567 => 0.5267, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -5.38% (1.3864 => 1.3118, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.37% (0.6440 => 0.6094, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.37% (0.3891 => 0.3682, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.37% (0.6033 => 0.5709, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.37% (0.2999 => 0.2838, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: -5.35% (0.3831 => 0.3626, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.34% (0.3896 => 0.3688, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -5.32% (0.4176 => 0.3954, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -5.31% (0.3581 => 0.3391, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: -5.30% (1.2515 => 1.1852, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.29% (1.2221 => 1.1574, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.29% (1.2210 => 1.1564, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: -5.28% (0.3880 => 0.3675, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.25% (0.4916 => 0.4658, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.23% (0.3884 => 0.3681, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -5.20% (0.3848 => 0.3648, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -5.19% (0.4199 => 0.3981, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.16% (8.0126 => 7.5988, std.dev.: 0.0047) MultiSource/Applications/d/make_dparser: -5.16% (3.5154 => 3.3340, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.16% (0.2385 => 0.2262, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.14% (1.6474 => 1.5627, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.13% (0.5999 => 0.5691, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -5.13% (15.5079 => 14.7130, std.dev.: 0.0109) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.12% (0.3319 => 0.3149, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: -5.09% (0.4280 => 0.4062, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -5.05% (0.7447 => 0.7071, std.dev.: 0.0018) MultiSource/Applications/lua/lua: -5.05% (4.0594 => 3.8545, std.dev.: 0.0060) MultiSource/Applications/siod/siod: -5.00% (2.4021 => 2.2820, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.99% (0.2106 => 0.2001, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -4.95% (2.1401 => 2.0341, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.92% (0.6194 => 0.5889, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -4.89% (15.2527 => 14.5074, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.89% (0.6304 => 0.5996, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.86% (0.5168 => 0.4917, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.83% (0.6297 => 0.5993, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -4.82% (0.7982 => 0.7597, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.79% (22.4056 => 21.3325, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.77% (0.6189 => 0.5894, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.73% (2.2587 => 2.1519, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.70% (0.7021 => 0.6691, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -4.65% (0.3271 => 0.3119, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: -4.61% (0.8418 => 0.8030, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.56% (0.5329 => 0.5086, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -4.56% (1.3148 => 1.2549, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.53% (0.9077 => 0.8666, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: -4.47% (5.0226 => 4.7980, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -4.46% (34.0927 => 32.5733, std.dev.: 0.0200) MultiSource/Applications/kimwitu++/kc: -4.37% (18.2933 => 17.4936, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.24% (0.4151 => 0.3975, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.20% (0.3931 => 0.3766, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.15% (0.3323 => 0.3185, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.14% (0.3837 => 0.3678, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.12% (0.3057 => 0.2931, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.12% (0.3252 => 0.3118, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -4.07% (0.3025 => 0.2902, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: -4.04% (0.2871 => 0.2755, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.03% (0.2903 => 0.2786, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -4.02% (0.3255 => 0.3124, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: -4.00% (0.4248 => 0.4078, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.99% (0.2933 => 0.2816, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -3.98% (0.2939 => 0.2822, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.95% (0.3016 => 0.2897, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.94% (0.9557 => 0.9180, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -3.86% (0.2849 => 0.2739, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: -3.83% (0.3026 => 0.2910, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: -3.83% (0.3394 => 0.3264, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.82% (0.4083 => 0.3927, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.82% (0.4321 => 0.4156, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/strcat: -3.81% (0.2989 => 0.2875, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.80% (2.1713 => 2.0888, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -3.76% (0.6750 => 0.6496, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: -3.74% (0.3446 => 0.3317, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.72% (0.3849 => 0.3706, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -3.70% (0.3621 => 0.3487, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.68% (0.4813 => 0.4636, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -3.68% (0.3481 => 0.3353, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/objinst: -3.60% (0.3194 => 0.3079, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: -3.59% (0.3867 => 0.3728, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: -3.49% (0.3205 => 0.3093, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.48% (0.4427 => 0.4273, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.47% (0.3491 => 0.3370, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: -3.43% (0.6347 => 0.6129, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -3.31% (0.6441 => 0.6228, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -3.30% (0.3059 => 0.2958, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.25% (5.4682 => 5.2906, std.dev.: 0.0150) SingleSource/UnitTests/ObjC++/property-reference: -3.11% (0.7779 => 0.7537, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: -3.10% (1.5610 => 1.5126, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: -3.07% (0.4524 => 0.4385, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -2.98% (0.3788 => 0.3675, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -2.57% (20.7746 => 20.2409, std.dev.: 0.0184) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7535, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1728, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7067, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.70% (2.2633 => 2.1796, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.44% (1.3096 => 1.2776, std.dev.: 0.0097) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4715, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 08:15:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 10:15:27 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121116161527.A392F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5939?compare_to=5937&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5939, Order: 168168, Start Time: 2012-11-16 14:47:25, End Time: 2012-11-16 16:15:48 To: 5937, Order: 168165, Start Time: 2012-11-16 13:01:26, End Time: 2012-11-16 14:30:34 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 12 (112 on baseline) Performance Improvements: 1 (28 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 981 (834 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.11% (0.6041 => 0.6289, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.07% (0.4960 => 0.5162, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/09-vor/vor: 3.59% (0.3144 => 0.3257, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.94% (0.5883 => 0.6056, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 2.89% (0.3458 => 0.3558, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.67% (4.5130 => 4.5882, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.64% (0.8796 => 0.8940, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.39% (0.8404 => 0.8521, std.dev.: 0.0037) MultiSource/Applications/treecc/treecc: 1.31% (2.0454 => 2.0722, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.12% (1.2098 => 1.2234, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/recursive: 1.64% (2.3786 => 2.4177, std.dev.: 0.0129) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.16% (3.5654 => 3.6069, std.dev.: 0.0130) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.69% (7.2407 => 6.8287, std.dev.: 0.1302) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.18% (16.7853 => 16.9837, std.dev.: 0.0197) MultiSource/Applications/obsequi/Obsequi: -2.03% (1.0614 => 1.0399, std.dev.: 0.0196) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.53% (22.0941 => 22.2103, std.dev.: 0.0697) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.94% (0.3619 => 0.3653, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: -0.29% (0.6123 => 0.6105, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.21% (0.3354 => 0.3347, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.2014 => 0.2014, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -35.94% (0.0217 => 0.0139, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0425 => 0.0427, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 10.98% (0.0264 => 0.0293, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -15.14% (0.0317 => 0.0269, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.60% (0.0423 => 0.0412, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/casts: 5.70% (0.0193 => 0.0204, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -21.70% (0.0212 => 0.0166, std.dev.: 0.0025) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.34% (0.1479 => 0.1474, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 4.39% (1.1331 => 1.1828, std.dev.: 0.0214) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.79% (0.4184 => 0.4109, std.dev.: 0.0223) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.99% (0.1411 => 0.1397, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.97% (0.0652 => 0.0587, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.40% (0.0250 => 0.0224, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.91% (0.0547 => 0.0552, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.44% (1.1925 => 1.1872, std.dev.: 0.0134) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.80% (0.0627 => 0.0553, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.93% (0.0215 => 0.0213, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.05% (0.7790 => 0.7794, std.dev.: 0.0253) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 3.51% (0.0057 => 0.0059, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2322.69% (0.6332 => 15.3405, std.dev.: 0.0276) MultiSource/Benchmarks/McCat/08-main/main: 46.48% (0.1831 => 0.2682, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.92% (0.1559 => 0.1420, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1515.37% (0.3344 => 5.4018, std.dev.: 0.0278) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.99% (0.2364 => 0.3262, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: - (0.0429 => 0.0429, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -21.87% (0.0224 => 0.0175, std.dev.: 0.0022) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0026) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 6.02% (0.1462 => 0.1550, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4601, std.dev.: 0.0265) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0762, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4917, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3211, std.dev.: 0.0736) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1207, std.dev.: 0.0317) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4032, std.dev.: 0.0025) SingleSource/Regression/C/uint64_to_float: -23.83% (2.1832 => 1.6629, std.dev.: 0.0051) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0008) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.20% (0.0810 => 0.0925, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/tsp/tsp: 9.98% (0.1112 => 0.1223, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.82% (0.2279 => 0.2480, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.64% (0.1157 => 0.1257, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.37% (0.8321 => 0.8934, std.dev.: 0.0098) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.73% (0.3137 => 0.3348, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.50% (0.4847 => 0.5162, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.13% (0.7473 => 0.7931, std.dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.09% (0.1905 => 0.2021, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.83% (0.2180 => 0.2307, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.50% (0.5961 => 0.6289, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.41% (1.1606 => 1.2234, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.07% (0.2998 => 0.3150, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.33% (0.2378 => 0.2481, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.11% (0.5817 => 0.6056, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: 4.01% (0.7950 => 0.8269, std.dev.: 0.0097) MultiSource/Applications/treecc/treecc: 3.88% (1.9948 => 2.0722, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.76% (0.9435 => 0.9790, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.66% (0.3003 => 0.3113, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.64% (0.4783 => 0.4957, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.53% (1.1685 => 1.2097, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.51% (0.4127 => 0.4272, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.48% (0.6287 => 0.6506, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.47% (4.1763 => 4.3212, std.dev.: 0.0111) MultiSource/Applications/SPASS/SPASS: 3.38% (14.2605 => 14.7431, std.dev.: 0.0298) MultiSource/Applications/siod/siod: 3.16% (2.2184 => 2.2886, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.15% (0.8261 => 0.8521, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.09% (0.8317 => 0.8574, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.04% (1.2526 => 1.2907, std.dev.: 0.0118) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.01% (6.6074 => 6.8066, std.dev.: 0.0312) MultiSource/Benchmarks/nbench/nbench: 2.93% (1.1271 => 1.1601, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.90% (1.6386 => 1.6861, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.85% (2.1401 => 2.2011, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.79% (0.8697 => 0.8940, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.68% (0.4559 => 0.4681, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.67% (0.9908 => 1.0173, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.64% (13.1811 => 13.5296, std.dev.: 0.0704) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.61% (0.8457 => 0.8678, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.56% (0.9074 => 0.9306, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.51% (0.9069 => 0.9297, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.49% (0.6227 => 0.6382, std.dev.: 0.0051) MultiSource/Applications/d/make_dparser: 2.48% (3.2366 => 3.3168, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.47% (0.8069 => 0.8268, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.46% (4.4873 => 4.5978, std.dev.: 0.0311) MultiSource/Applications/SIBsim4/SIBsim4: 2.43% (1.2568 => 1.2873, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.41% (1.1170 => 1.1439, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.37% (0.7966 => 0.8155, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.25% (1.3279 => 1.3578, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.24% (0.8359 => 0.8546, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.23% (4.4880 => 4.5882, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.18% (0.8656 => 0.8845, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.13% (0.8066 => 0.8238, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.11% (1.4479 => 1.4784, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.07% (0.7932 => 0.8096, std.dev.: 0.0063) MultiSource/Benchmarks/PAQ8p/paq8p: 2.05% (2.3764 => 2.4250, std.dev.: 0.0050) MultiSource/Applications/ClamAV/clamscan: 2.03% (14.7684 => 15.0685, std.dev.: 0.0558) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (3.1832 => 3.2468, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.97% (0.8597 => 0.8766, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.94% (0.6586 => 0.6714, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.91% (0.9056 => 0.9229, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.90% (0.8716 => 0.8882, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.80% (0.8885 => 0.9045, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.79% (0.8286 => 0.8434, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.70% (0.8927 => 0.9079, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.68% (0.8086 => 0.8222, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.66% (0.8518 => 0.8659, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.56% (0.8855 => 0.8993, std.dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: 1.55% (6.7320 => 6.8363, std.dev.: 0.0291) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.51% (1.2423 => 1.2611, std.dev.: 0.0037) MultiSource/Applications/oggenc/oggenc: 1.45% (4.9628 => 5.0350, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/football/football: 1.44% (0.8768 => 0.8894, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.42% (0.8048 => 0.8162, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.42% (0.8338 => 0.8456, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.37% (1.2602 => 1.2775, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.30% (0.8007 => 0.8111, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.26% (0.8316 => 0.8421, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 104.52% (0.0199 => 0.0407, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/pi: 58.87% (1.5795 => 2.5094, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.99% (0.7597 => 0.8888, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.39% (2.9753 => 3.4631, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.73% (2.7995 => 3.2118, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6093, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.41% (0.3186 => 0.3454, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.39% (4.7794 => 5.1326, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/richards_benchmark: 7.16% (1.3037 => 1.3970, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.08% (6.3772 => 6.8287, std.dev.: 0.1302) SingleSource/Benchmarks/McGill/queens: 7.02% (1.7056 => 1.8253, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 6.76% (1.1857 => 1.2659, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.87% (4.9686 => 5.2603, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 5.72% (3.1873 => 3.3697, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.70% (4.5327 => 4.7910, std.dev.: 0.0136) MultiSource/Applications/lambda-0_1_3/lambda: 5.27% (7.4933 => 7.8879, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.71% (6.2275 => 6.5206, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.68% (3.3761 => 3.5340, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.16% (4.9469 => 5.1525, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.02% (4.9453 => 5.1441, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 3.91% (14.0064 => 14.5542, std.dev.: 0.0244) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.21% (0.3587 => 0.3702, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 3.05% (3.6643 => 3.7759, std.dev.: 0.0171) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.78% (1.2337 => 1.2680, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.69% (11.5690 => 11.8804, std.dev.: 0.0399) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.62% (8.2783 => 8.4956, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.29% (4.8362 => 4.9469, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.23% (4.8660 => 4.9744, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout/lists: 2.18% (7.3375 => 7.4977, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.99% (1.1365 => 1.1591, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 1.48% (1.2061 => 1.2240, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.44% (2.4647 => 2.5001, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.27% (4.0473 => 4.0988, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 1.14% (1.0841 => 1.0965, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 1.07% (2.3560 => 2.3813, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.05% (3.5679 => 3.6054, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -35.50% (0.0338 => 0.0218, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/em3d/em3d: -21.29% (5.4641 => 4.3008, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.37% (7.2130 => 6.2484, std.dev.: 0.1071) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.27% (1.0512 => 0.9327, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.79% (14.6451 => 13.2112, std.dev.: 0.2309) MultiSource/Benchmarks/mafft/pairlocalalign: -8.48% (63.1822 => 57.8267, std.dev.: 0.0744) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.01% (0.3269 => 0.3007, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.87% (4.7482 => 4.4220, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.04% (3.7148 => 3.4906, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.98% (5.4972 => 5.1683, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.03% (5.1557 => 4.8963, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.43% (4.7449 => 4.5345, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.97% (2.8773 => 2.7630, std.dev.: 0.0375) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.79% (6.0224 => 5.7939, std.dev.: 0.0308) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.12% (0.5807 => 0.5626, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.97% (28.5821 => 27.7329, std.dev.: 0.0383) MultiSource/Applications/lua/lua: -2.94% (29.8330 => 28.9556, std.dev.: 0.0476) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.80% (1.2822 => 1.2463, std.dev.: 0.0133) MultiSource/Benchmarks/FreeBench/mason/mason: -2.71% (0.5415 => 0.5268, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.61% (2.6356 => 2.5668, std.dev.: 0.0146) MultiSource/Applications/aha/aha: -2.18% (3.3398 => 3.2669, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.99% (9.9065 => 9.7097, std.dev.: 0.0740) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.97% (11.5316 => 11.3047, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.76% (3.2169 => 3.1602, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.59% (1.0388 => 1.0223, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.54% (4.9994 => 4.9222, std.dev.: 0.0285) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.13% (2.3487 => 2.3221, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.11% (5.6343 => 5.5716, std.dev.: 0.0089) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 3.27% (16.4461 => 16.9837, std.dev.: 0.0197) MultiSource/Applications/obsequi/Obsequi: 1.34% (1.0262 => 1.0399, std.dev.: 0.0196) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7011.85% (0.3123 => 22.2103, std.dev.: 0.0697) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.32% (0.2463 => 0.3653, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 1.58% (0.6010 => 0.6105, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.48% (0.3266 => 0.3347, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/strcat: 2.29% (0.1969 => 0.2014, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 13.01% (0.0123 => 0.0139, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 15.35% (0.0254 => 0.0293, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -10.93% (0.0302 => 0.0269, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 7.29% (0.0384 => 0.0412, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -7.78% (0.0180 => 0.0166, std.dev.: 0.0025) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.50% (0.1438 => 0.1474, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 4.40% (1.1329 => 1.1828, std.dev.: 0.0214) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.32% (0.4164 => 0.4109, std.dev.: 0.0223) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.05% (0.1369 => 0.1397, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.42% (0.0641 => 0.0587, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 14.87% (0.0195 => 0.0224, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.50% (0.0578 => 0.0552, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.80% (1.1437 => 1.1872, std.dev.: 0.0134) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.80% (0.0627 => 0.0553, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.33% (0.0180 => 0.0213, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.78% (0.8017 => 0.7794, std.dev.: 0.0253) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -4.84% (0.0062 => 0.0059, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 09:34:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 11:34:39 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121116173439.58A672A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5940?compare_to=5936&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5940, Order: 168168, Start Time: 2012-11-16 15:14:49, End Time: 2012-11-16 17:34:58 To: 5936, Order: 168147, Start Time: 2012-11-16 12:01:32, End Time: 2012-11-16 14:22:34 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 61 (163 on baseline) Performance Improvements: 11 (40 on baseline) Added Tests: 0 (136 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 968 (684 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/objects/objects: 17.04% (0.1168 => 0.1367, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 16.58% (0.1659 => 0.1934, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 16.05% (2.4833 => 2.8819, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 15.48% (0.6630 => 0.7656, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 15.30% (0.6227 => 0.7180, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 15.22% (0.5927 => 0.6829, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.89% (0.6897 => 0.7924, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.82% (0.6949 => 0.7979, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 14.72% (0.5930 => 0.6803, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.66% (0.6611 => 0.7514, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/richards_benchmark: 13.50% (0.0896 => 0.1017, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 13.49% (0.6892 => 0.7822, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 13.47% (0.6888 => 0.7816, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C++/office/office: 13.28% (0.3382 => 0.3831, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sumcol: 12.62% (0.3169 => 0.3569, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash2: 12.47% (0.5148 => 0.5790, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wc: 12.30% (0.3333 => 0.3743, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.86% (0.6731 => 0.7529, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.60% (0.3008 => 0.3357, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.60% (0.4691 => 0.5235, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.36% (0.1901 => 0.2117, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.08% (0.2897 => 0.3218, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/strcat: 10.97% (0.3108 => 0.3449, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/neural/neural: 10.57% (0.1608 => 0.1778, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 10.42% (0.3530 => 0.3898, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.28% (0.4191 => 0.4622, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.03% (1.5875 => 1.7467, std.dev.: 0.0145) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.81% (0.5240 => 0.5754, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.34% (2.3189 => 2.5355, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.16% (0.3178 => 0.3469, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/football/football: 8.60% (0.9861 => 1.0709, std.dev.: 0.0160) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.13% (0.2202 => 0.2381, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/tsp/tsp: 7.92% (0.1415 => 0.1527, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.63% (0.6817 => 0.7337, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/salsa20: 7.48% (0.2098 => 0.2255, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.41% (0.9558 => 1.0266, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary: 7.03% (0.3541 => 0.3790, std.dev.: 0.0082) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.10% (0.2099 => 0.2227, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.97% (0.2126 => 0.2253, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.25% (4.7838 => 5.0351, std.dev.: 0.0301) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 29.24% (3.7419 => 4.8361, std.dev.: 0.1222) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 23.67% (1.3255 => 1.6393, std.dev.: 0.0198) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 19.51% (5.3758 => 6.4245, std.dev.: 0.0489) SingleSource/Benchmarks/Shootout-C++/ary: 19.08% (0.0765 => 0.0911, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 15.60% (1.1042 => 1.2764, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 13.64% (0.6960 => 0.7909, std.dev.: 0.0198) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 10.52% (0.3442 => 0.3804, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout/heapsort: 9.80% (3.9279 => 4.3128, std.dev.: 0.1112) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.70% (9.4199 => 10.0511, std.dev.: 0.0227) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 6.05% (5.2704 => 5.5894, std.dev.: 0.0437) SingleSource/Benchmarks/Shootout-C++/hash2: 5.65% (3.4397 => 3.6340, std.dev.: 0.0170) MultiSource/Benchmarks/FreeBench/neural/neural: 5.28% (0.2234 => 0.2352, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 4.31% (4.6784 => 4.8800, std.dev.: 0.0580) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.82% (5.3534 => 5.5579, std.dev.: 0.0130) MultiSource/Benchmarks/NPB-serial/is/is: 2.81% (8.7275 => 8.9725, std.dev.: 0.0627) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.19% (4.2728 => 4.3662, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.13% (6.0561 => 6.1851, std.dev.: 0.0082) MultiSource/Applications/sgefa/sgefa: 1.68% (0.6305 => 0.6411, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.39% (2.1822 => 2.2125, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.27% (3.0235 => 3.0619, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.22% (5.3805 => 5.4460, std.dev.: 0.0168) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -19.55% (0.1744 => 0.1403, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -12.57% (0.6604 => 0.5774, std.dev.: 0.0232) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -9.98% (1.9527 => 1.7578, std.dev.: 0.0208) SingleSource/Benchmarks/Misc-C++/stepanov_container: -9.56% (1.1360 => 1.0274, std.dev.: 0.0229) MultiSource/Applications/d/make_dparser: -9.14% (4.1816 => 3.7993, std.dev.: 0.1475) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.35% (0.6128 => 0.5800, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: -2.22% (11.5333 => 11.2778, std.dev.: 0.0152) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -5.41% (6.4952 => 6.1437, std.dev.: 0.1076) MultiSource/Applications/SIBsim4/SIBsim4: -2.09% (3.9424 => 3.8602, std.dev.: 0.0313) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -1.50% (17.0407 => 16.7845, std.dev.: 0.0945) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.12% (4.8647 => 4.8102, std.dev.: 0.0148) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1338 => 0.1338, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0420 => 0.0420, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0652 => 0.0652, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: -0.06% (494.2965 => 494.0111, std.dev.: 0.3287) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: 43706.96% (1.1277 => 494.0111, std.dev.: 0.3287) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 212.85% (0.5229 => 1.6359, std.dev.: 0.0647) MultiSource/Applications/SPASS/SPASS: 20.84% (14.9895 => 18.1132, std.dev.: 0.1950) MultiSource/Applications/kimwitu++/kc: 51.99% (14.1553 => 21.5152, std.dev.: 0.1553) MultiSource/Benchmarks/MallocBench/gs/gs: 25.23% (4.1105 => 5.1474, std.dev.: 0.1180) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 41.78% (1.1048 => 1.5664, std.dev.: 0.0427) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 433.15% (7.1582 => 38.1641, std.dev.: 0.1250) SingleSource/Benchmarks/Misc-C++-EH/spirit: 75.93% (3.4629 => 6.0922, std.dev.: 0.3261) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.12% (0.6222 => 1.0274, std.dev.: 0.0229) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10636.25% (0.0720 => 7.7301, std.dev.: 0.1531) MultiSource/Applications/SIBsim4/SIBsim4: 3860100.00% (0.0001 => 3.8602, std.dev.: 0.0313) MultiSource/Applications/SPASS/SPASS: 14695300.00% (0.0001 => 14.6954, std.dev.: 0.7622) MultiSource/Applications/kimwitu++/kc: 53200.00% (0.0001 => 0.0533, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 577000.00% (0.0001 => 0.5771, std.dev.: 0.0366) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10094400.00% (0.0001 => 10.0945, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6671600.00% (0.0001 => 6.6717, std.dev.: 0.4686) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1802.45% (1.1194 => 21.2960, std.dev.: 0.1428) MultiSource/Applications/ClamAV/clamscan: 70.95% (22.1758 => 37.9089, std.dev.: 0.1234) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.43% (7.0540 => 11.1051, std.dev.: 0.1917) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.02% (2.9384 => 4.6139, std.dev.: 0.3090) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 51.69% (8.1363 => 12.3423, std.dev.: 0.0609) MultiSource/Applications/JM/lencod/lencod: 49.15% (21.9371 => 32.7194, std.dev.: 0.0798) MultiSource/Benchmarks/FreeBench/distray/distray: 44.70% (0.1056 => 0.1528, std.dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/almabench: 38.36% (0.0730 => 0.1010, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 37.99% (0.1432 => 0.1976, std.dev.: 0.0108) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 35.92% (0.1584 => 0.2153, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones/fhourstones: 34.61% (0.1566 => 0.2108, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 32.82% (0.0326 => 0.0433, std.dev.: 0.0019) SingleSource/Benchmarks/Stanford/Oscar: 32.23% (0.0636 => 0.0841, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.37% (0.0730 => 0.0959, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.85% (2.2024 => 2.8819, std.dev.: 0.0116) SingleSource/UnitTests/vla: 30.14% (0.0355 => 0.0462, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: 29.96% (0.1175 => 0.1527, std.dev.: 0.0039) MultiSource/Applications/minisat/minisat: 29.78% (0.7115 => 0.9234, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 29.41% (0.1044 => 0.1351, std.dev.: 0.0032) MultiSource/Benchmarks/BitBench/five11/five11: 28.57% (0.0567 => 0.0729, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 27.69% (0.1163 => 0.1485, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 26.50% (0.0834 => 0.1055, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.98% (0.0408 => 0.0514, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 25.78% (0.2758 => 0.3469, std.dev.: 0.0109) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.62% (0.8172 => 1.0266, std.dev.: 0.0046) MultiSource/Applications/sgefa/sgefa: 25.38% (0.3109 => 0.3898, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 25.32% (0.4620 => 0.5790, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wordfreq: 25.13% (0.3307 => 0.4138, std.dev.: 0.0157) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 24.90% (0.1695 => 0.2117, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 24.68% (0.4615 => 0.5754, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/spellcheck: 24.55% (0.4203 => 0.5235, std.dev.: 0.0048) MultiSource/Benchmarks/llubenchmark/llu: 24.03% (0.0462 => 0.0573, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 23.99% (0.3826 => 0.4744, std.dev.: 0.0131) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 23.63% (0.2603 => 0.3218, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.59% (0.0746 => 0.0922, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sumcol: 23.45% (0.2891 => 0.3569, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.38% (0.0479 => 0.0591, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 23.23% (1.2842 => 1.5825, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/dot-syntax-1: 22.76% (0.0479 => 0.0588, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 22.71% (0.1114 => 0.1367, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 22.67% (0.5981 => 0.7337, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/wc: 22.64% (0.3052 => 0.3743, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.57% (0.2065 => 0.2531, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/office/office: 22.16% (0.3136 => 0.3831, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 21.96% (0.0838 => 0.1022, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 21.95% (1.5603 => 1.9028, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/strcat: 21.83% (0.2831 => 0.3449, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ackermann: 21.81% (0.2756 => 0.3357, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bisort/bisort: 21.66% (0.0614 => 0.0747, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/08-main/main: 21.61% (0.2554 => 0.3106, std.dev.: 0.0208) MultiSource/Benchmarks/FreeBench/neural/neural: 21.53% (0.1463 => 0.1778, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.44% (0.0886 => 0.1076, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.43% (14.3668 => 17.4463, std.dev.: 0.1083) MultiSource/Applications/treecc/treecc: 21.25% (2.0273 => 2.4581, std.dev.: 0.0668) MultiSource/Benchmarks/VersaBench/bmm/bmm: 20.82% (0.0759 => 0.0917, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 20.57% (0.0491 => 0.0592, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 20.04% (0.8921 => 1.0709, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.97% (0.8067 => 0.9678, std.dev.: 0.0234) MultiSource/Applications/siod/siod: 19.10% (2.2969 => 2.7357, std.dev.: 0.1454) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 19.02% (0.1625 => 0.1934, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 18.75% (0.0592 => 0.0703, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.63% (0.2700 => 0.3203, std.dev.: 0.0191) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.56% (0.2107 => 0.2498, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 18.40% (1.5859 => 1.8777, std.dev.: 0.1016) MultiSource/Applications/oggenc/oggenc: 18.37% (5.7591 => 6.8169, std.dev.: 0.1579) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.22% (0.1125 => 0.1330, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 18.21% (0.1906 => 0.2253, std.dev.: 0.0032) MultiSource/Applications/lua/lua: 18.13% (3.8723 => 4.5745, std.dev.: 0.1979) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.87% (5.0018 => 5.8956, std.dev.: 0.1458) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 17.71% (0.1892 => 0.2227, std.dev.: 0.0046) MultiSource/Applications/sqlite3/sqlite3: 17.64% (17.1811 => 20.2114, std.dev.: 0.0766) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.46% (0.3935 => 0.4622, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ary: 17.26% (0.3232 => 0.3790, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.22% (0.0842 => 0.0987, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions-3: 17.09% (0.3516 => 0.4117, std.dev.: 0.0165) SingleSource/UnitTests/ObjC/for-in: 17.08% (0.3694 => 0.4325, std.dev.: 0.0082) SingleSource/UnitTests/ObjC/exceptions-2: 17.04% (0.3497 => 0.4093, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/oourafft: 16.97% (0.3282 => 0.3839, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.72% (4.9449 => 5.7716, std.dev.: 0.1508) MultiSource/Benchmarks/mafft/pairlocalalign: 16.71% (9.4845 => 11.0691, std.dev.: 0.2197) SingleSource/UnitTests/ObjC/exceptions-4: 16.57% (0.3543 => 0.4130, std.dev.: 0.0100) SingleSource/UnitTests/ObjC/exceptions: 16.51% (0.3828 => 0.4460, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.19% (0.2872 => 0.3337, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/ary3: 16.17% (0.3283 => 0.3814, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout/matrix: 15.77% (0.0818 => 0.0947, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.13% (2.2022 => 2.5355, std.dev.: 0.0156) MultiSource/Applications/viterbi/viterbi: 15.11% (0.1555 => 0.1790, std.dev.: 0.0072) SingleSource/UnitTests/SignlessTypes/rem: 14.95% (0.1144 => 0.1315, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 14.92% (0.8101 => 0.9310, std.dev.: 0.0300) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.77% (0.1117 => 0.1282, std.dev.: 0.0051) MultiSource/Benchmarks/Bullet/bullet: 14.72% (63.2438 => 72.5528, std.dev.: 0.2389) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.68% (0.0770 => 0.0883, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.35% (0.3121 => 0.3569, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.34% (4.2646 => 4.8761, std.dev.: 0.1384) MultiSource/Applications/lambda-0_1_3/lambda: 14.33% (0.7433 => 0.8498, std.dev.: 0.0137) MultiSource/Benchmarks/NPB-serial/is/is: 14.33% (0.0719 => 0.0822, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.03% (1.5415 => 1.7578, std.dev.: 0.0208) MultiSource/Applications/d/make_dparser: 13.91% (3.3354 => 3.7993, std.dev.: 0.1475) SingleSource/Benchmarks/Shootout-C++/ary2: 13.82% (0.3379 => 0.3846, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.80% (0.1029 => 0.1171, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.61% (0.5569 => 0.6327, std.dev.: 0.0092) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.56% (0.1062 => 0.1206, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.51% (0.1236 => 0.1403, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 13.12% (0.3423 => 0.3872, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.10% (0.5105 => 0.5774, std.dev.: 0.0232) SingleSource/UnitTests/ObjC/property: 12.56% (0.3886 => 0.4374, std.dev.: 0.0095) SingleSource/UnitTests/ObjC/trivial-interface: 12.44% (0.3473 => 0.3905, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.28% (0.3543 => 0.3978, std.dev.: 0.0148) SingleSource/UnitTests/ObjC/synchronized: 12.16% (0.3561 => 0.3994, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/power/power: 11.94% (0.1440 => 0.1612, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 11.82% (0.3180 => 0.3556, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 10.86% (0.4299 => 0.4766, std.dev.: 0.0119) SingleSource/UnitTests/ObjC++/property-reference-object: 10.15% (0.6030 => 0.6642, std.dev.: 0.0135) SingleSource/UnitTests/ObjC++/Hello: 10.04% (0.5925 => 0.6520, std.dev.: 0.0140) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.96% (0.3817 => 0.4159, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.92% (0.3162 => 0.3444, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 8.78% (10.3673 => 11.2778, std.dev.: 0.0152) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.39% (7.9617 => 8.2315, std.dev.: 0.1012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.75% (4.3953 => 11.0214, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/methcall: 147.63% (5.3999 => 13.3717, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout/ary3: 30.73% (3.6994 => 4.8361, std.dev.: 0.1222) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 25.67% (1.3045 => 1.6393, std.dev.: 0.0198) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 24.90% (13.4384 => 16.7845, std.dev.: 0.0945) SingleSource/Benchmarks/Shootout-C++/ary: 20.50% (0.0756 => 0.0911, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 18.35% (1.0785 => 1.2764, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 17.56% (6.6465 => 7.8133, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/mst/mst: 16.65% (0.1285 => 0.1499, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.63% (1.1145 => 1.2998, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash2: 15.08% (3.1578 => 3.6340, std.dev.: 0.0170) SingleSource/Benchmarks/BenchmarkGame/puzzle: 13.60% (0.6962 => 0.7909, std.dev.: 0.0198) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.08% (0.2944 => 0.3329, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout/heapsort: 11.95% (3.8526 => 4.3128, std.dev.: 0.1112) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.64% (2.8904 => 3.2268, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: 10.31% (1.1396 => 1.2571, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.20% (8.6802 => 9.5656, std.dev.: 0.2573) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.51% (1.7254 => 1.8894, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/strcat: 6.06% (0.1899 => 0.2014, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.97% (4.2280 => 4.4803, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.95% (0.9540 => 1.0108, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 5.79% (1.8329 => 1.9390, std.dev.: 0.0249) MultiSource/Benchmarks/FreeBench/neural/neural: 5.33% (0.2233 => 0.2352, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 5.02% (0.5413 => 0.5685, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.76% (0.3463 => 0.3628, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.6436 => 12.1300, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.83% (1.7133 => 1.7790, std.dev.: 0.0177) MultiSource/Benchmarks/Olden/em3d/em3d: 3.68% (3.1023 => 3.2166, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.45% (0.3540 => 0.3662, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 3.41% (26.0924 => 26.9821, std.dev.: 0.1262) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.35% (3.6395 => 3.7614, std.dev.: 0.0341) MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.27% (2.1424 => 2.2125, std.dev.: 0.0061) MultiSource/Applications/sgefa/sgefa: 3.02% (0.6223 => 0.6411, std.dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/dry: 2.65% (2.4116 => 2.4755, std.dev.: 0.0086) MultiSource/Benchmarks/PAQ8p/paq8p: 2.39% (85.0658 => 87.0971, std.dev.: 0.0852) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 2.06% (3.1595 => 3.2247, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2790, std.dev.: 0.0454) SingleSource/Benchmarks/Shootout/sieve: 1.33% (5.2139 => 5.2832, std.dev.: 0.0077) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.27% (6.5088 => 6.5914, std.dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0313 => 1.0441, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.20% (1.9577 => 1.9811, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0499, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.51% (6.6874 => 0.1667, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.84% (5.2763 => 1.2221, std.dev.: 0.0482) SingleSource/Benchmarks/Misc/salsa20: -73.93% (0.8651 => 0.2255, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -37.30% (0.1622 => 0.1017, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.00% (5.3855 => 4.7394, std.dev.: 0.0878) MultiSource/Applications/JM/ldecod/ldecod: -6.14% (10.4361 => 9.7955, std.dev.: 0.1294) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.93% (5.3526 => 5.0351, std.dev.: 0.0301) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.92% (0.0506 => 0.0304, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.78% (0.3987 => 0.2401, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.38% (4.5009 => 2.7736, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -28.16% (10.7105 => 7.6948, std.dev.: 0.5437) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.09% (2.6546 => 2.0150, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/mason/mason: -19.11% (0.2161 => 0.1748, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.68% (1.6925 => 1.4272, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2842, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.71% (32.5116 => 29.0287, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/mandel-2: -10.64% (1.5373 => 1.3738, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.65% (1.5660 => 1.4305, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: -6.18% (9.5636 => 8.9725, std.dev.: 0.0627) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.54% (3.2416 => 3.0619, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (2.7294 => 2.5788, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5085, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -4.25% (6.2999 => 6.0321, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.43% (19.9488 => 19.2647, std.dev.: 0.0811) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.18% (1.6805 => 1.6271, std.dev.: 0.0152) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8915, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.92% (0.9957 => 0.9666, std.dev.: 0.0062) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.29% (0.4808 => 0.4698, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.87% (8.1563 => 8.0039, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6771, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -1.50% (10.2830 => 10.1289, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0022) Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 10:05:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 12:05:29 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121116180529.A433E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5941?compare_to=5939&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5941, Order: 168171, Start Time: 2012-11-16 16:35:11, End Time: 2012-11-16 18:05:50 To: 5939, Order: 168168, Start Time: 2012-11-16 14:47:25, End Time: 2012-11-16 16:15:48 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 6 (72 on baseline) Performance Improvements: 0 (23 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 988 (879 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.33% (4.5882 => 4.6493, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.24% (0.8434 => 0.8539, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 9.16% (8.2167 => 8.9692, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 3.26% (1.2453 => 1.2859, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.88% (13.2112 => 13.5918, std.dev.: 0.0245) SingleSource/Benchmarks/BenchmarkGame/n-body: 1.63% (1.5133 => 1.5380, std.dev.: 0.0015) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.84% (16.9837 => 16.8410, std.dev.: 0.2654) MultiSource/Applications/obsequi/Obsequi: 3.85% (1.0399 => 1.0799, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.09% (22.2103 => 21.9676, std.dev.: 0.3953) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.44% (0.3653 => 0.3669, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/bigfib: -0.20% (0.6105 => 0.6093, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.27% (0.3347 => 0.3338, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/strcat: 0.55% (0.2014 => 0.2025, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 57.55% (0.0139 => 0.0219, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.70% (0.0427 => 0.0430, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.29% (0.0293 => 0.0257, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 8.55% (0.0269 => 0.0292, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.40% (0.0412 => 0.0398, std.dev.: 0.0048) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0204 => 0.0205, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -14.46% (0.0166 => 0.0142, std.dev.: 0.0032) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.02% (0.1474 => 0.1489, std.dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.80% (1.1828 => 1.1615, std.dev.: 0.0561) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.68% (0.4109 => 0.4178, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.72% (0.1397 => 0.1449, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.05% (0.0587 => 0.0646, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 16.52% (0.0224 => 0.0261, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.72% (0.0552 => 0.0556, std.dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.52% (1.1872 => 1.1934, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1500.00% (0.0001 => 0.0016, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.90% (0.0553 => 0.0548, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -15.02% (0.0213 => 0.0181, std.dev.: 0.0103) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.41% (0.7794 => 0.7826, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.42% (0.0059 => 0.0044, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2312.46% (0.6332 => 15.2757, std.dev.: 0.2897) MultiSource/Benchmarks/McCat/08-main/main: 47.46% (0.1831 => 0.2700, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.49% (0.1559 => 0.1489, std.dev.: 0.0277) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1513.91% (0.3344 => 5.3969, std.dev.: 0.1207) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.20% (0.2364 => 0.3267, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: 3.73% (0.0429 => 0.0445, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -19.64% (0.0224 => 0.0180, std.dev.: 0.0028) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 9.17% (0.1462 => 0.1596, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4610, std.dev.: 0.0348) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0703, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4940, std.dev.: 0.0391) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3184, std.dev.: 0.0437) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1303, std.dev.: 0.0318) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4095, std.dev.: 0.0142) SingleSource/Regression/C/uint64_to_float: -23.99% (2.1832 => 1.6595, std.dev.: 0.0013) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0008) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.01% (0.0810 => 0.0964, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.37% (0.0830 => 0.0941, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.03% (0.0848 => 0.0950, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.66% (0.2279 => 0.2522, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.23% (0.1137 => 0.1242, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.34% (0.3295 => 0.3537, std.dev.: 0.0078) MultiSource/Applications/viterbi/viterbi: 7.04% (0.1577 => 0.1688, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.97% (0.2180 => 0.2332, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.43% (0.2519 => 0.2681, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.38% (0.8148 => 0.8668, std.dev.: 0.0159) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.30% (0.1983 => 0.2108, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.21% (0.1885 => 0.2002, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.51% (0.1905 => 0.2010, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.82% (0.2240 => 0.2348, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 3.71% (3.8189 => 3.9604, std.dev.: 0.0229) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.59% (4.4880 => 4.6493, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.08% (0.6227 => 0.6419, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.05% (0.8286 => 0.8539, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.82% (1.4479 => 1.4887, std.dev.: 0.0130) MultiSource/Benchmarks/Bullet/bullet: 2.78% (31.8598 => 32.7462, std.dev.: 0.0294) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.67% (0.8007 => 0.8221, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.61% (0.8597 => 0.8821, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.59% (0.8069 => 0.8278, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.57% (0.9039 => 0.9271, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.55% (0.8611 => 0.8831, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.48% (0.8697 => 0.8913, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.41% (0.8331 => 0.8532, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.40% (0.8261 => 0.8459, std.dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 2.39% (1.2568 => 1.2868, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.27% (1.2423 => 1.2705, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.26% (0.9688 => 0.9907, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.16% (0.8317 => 0.8497, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.14% (0.9908 => 1.0120, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.08% (0.9069 => 0.9258, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.06% (0.8316 => 0.8487, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.06% (0.8855 => 0.9037, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.99% (0.8359 => 0.8525, std.dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: 1.97% (0.7557 => 0.7706, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.97% (0.8420 => 0.8586, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.93% (0.8204 => 0.8362, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.83% (0.8712 => 0.8871, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.74% (0.8086 => 0.8227, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (8.6247 => 8.7471, std.dev.: 0.0430) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 125.63% (0.0199 => 0.0449, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/pi: 58.83% (1.5795 => 2.5087, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.84% (0.7597 => 0.8876, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.08% (2.9753 => 3.4538, std.dev.: 0.1023) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.47% (2.7995 => 3.2047, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6093, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.96% (1.1857 => 1.2801, std.dev.: 0.0118) SingleSource/Benchmarks/McGill/queens: 7.46% (1.7056 => 1.8329, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.69% (4.7794 => 5.0991, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 5.93% (3.1873 => 3.3762, std.dev.: 0.0402) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.91% (4.5327 => 4.8004, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.88% (4.9686 => 5.2610, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: 5.74% (1.3037 => 1.3785, std.dev.: 0.0170) MultiSource/Applications/lambda-0_1_3/lambda: 4.82% (7.4933 => 7.8548, std.dev.: 0.0281) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.71% (6.2275 => 6.5208, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.59% (3.3761 => 3.5312, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.17% (4.9469 => 5.1531, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.17% (4.9453 => 5.1513, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.89% (14.0064 => 14.5508, std.dev.: 0.0176) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.57% (0.3587 => 0.3715, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 3.09% (1.2474 => 1.2859, std.dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.88% (1.2337 => 1.2692, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.80% (11.5690 => 11.8933, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 2.78% (3.6643 => 3.7661, std.dev.: 0.0383) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.50% (8.2783 => 8.4853, std.dev.: 0.0104) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (1.1365 => 1.1624, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 2.17% (7.3375 => 7.4964, std.dev.: 0.0218) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.46% (2.4647 => 2.5008, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/ReedSolomon: 1.25% (8.5322 => 8.6390, std.dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.46% (5.4641 => 4.2915, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.47% (7.2130 => 6.3132, std.dev.: 0.1653) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.85% (1.0512 => 0.9266, std.dev.: 0.0054) SingleSource/Benchmarks/McGill/chomp: -10.85% (1.1216 => 0.9999, std.dev.: 0.0194) MultiSource/Benchmarks/mafft/pairlocalalign: -8.52% (63.1822 => 57.7988, std.dev.: 0.0285) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.19% (14.6451 => 13.5918, std.dev.: 0.0245) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -7.00% (4.7482 => 4.4159, std.dev.: 0.0668) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.49% (0.3269 => 0.3057, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.97% (3.7148 => 3.4932, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.83% (5.4972 => 5.1768, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.13% (5.1557 => 4.8914, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.34% (4.7449 => 4.5388, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.79% (6.0224 => 5.7944, std.dev.: 0.0227) MultiSource/Applications/lua/lua: -3.28% (29.8330 => 28.8539, std.dev.: 0.1677) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.24% (0.5807 => 0.5619, std.dev.: 0.0067) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (28.5821 => 27.6974, std.dev.: 0.1420) SingleSource/Benchmarks/Shootout-C++/hash2: -2.31% (3.4237 => 3.3447, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.11% (2.6356 => 2.5800, std.dev.: 0.0185) SingleSource/Benchmarks/Misc/ffbench: -2.05% (1.4296 => 1.4003, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.96% (11.5316 => 11.3055, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.63% (9.9065 => 9.7451, std.dev.: 0.0389) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.59% (2.3487 => 2.3114, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.44% (4.9994 => 4.9275, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.40% (16.4461 => 16.8410, std.dev.: 0.2654) MultiSource/Applications/obsequi/Obsequi: 5.23% (1.0262 => 1.0799, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6934.13% (0.3123 => 21.9676, std.dev.: 0.3953) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.96% (0.2463 => 0.3669, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/bigfib: 1.38% (0.6010 => 0.6093, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.20% (0.3266 => 0.3338, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/strcat: 2.84% (0.1969 => 0.2025, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.39% (0.0408 => 0.0430, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.18% (0.0254 => 0.0257, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.31% (0.0302 => 0.0292, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 3.65% (0.0384 => 0.0398, std.dev.: 0.0048) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -21.11% (0.0180 => 0.0142, std.dev.: 0.0032) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 3.55% (0.1438 => 0.1489, std.dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.52% (1.1329 => 1.1615, std.dev.: 0.0561) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.34% (0.4164 => 0.4178, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.84% (0.1369 => 0.1449, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.78% (0.0641 => 0.0646, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 33.85% (0.0195 => 0.0261, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.81% (0.0578 => 0.0556, std.dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.35% (1.1437 => 1.1934, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1500.00% (0.0001 => 0.0016, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.60% (0.0627 => 0.0548, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.56% (0.0180 => 0.0181, std.dev.: 0.0103) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.38% (0.8017 => 0.7826, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -29.03% (0.0062 => 0.0044, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 10:11:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 12:11:21 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121116181121.7FA4E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5942?compare_to=5938&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5942, Order: 168171, Start Time: 2012-11-16 16:38:59, End Time: 2012-11-16 18:11:41 To: 5938, Order: 168168, Start Time: 2012-11-16 13:31:30, End Time: 2012-11-16 15:04:35 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (179 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1044 (859 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.66% (2.0478 => 2.1023, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/salsa20: 2.36% (7.4937 => 7.6702, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/hash2: 2.09% (3.1932 => 3.2599, std.dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.01% (0.1431 => 0.1302, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.22% (0.3821 => 0.3507, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.27% (2.4924 => 2.3112, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -6.94% (0.3357 => 0.3124, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.94% (0.3142 => 0.2924, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.75% (0.2428 => 0.2264, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.69% (0.9542 => 0.8904, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.50% (0.1584 => 0.1481, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -6.44% (0.2160 => 0.2021, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.34% (9.2283 => 8.6436, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.33% (0.2355 => 0.2206, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -6.26% (16.1920 => 15.1780, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.20% (0.6484 => 0.6082, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.19% (0.1761 => 0.1652, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.16% (0.9852 => 0.9245, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -6.16% (0.9179 => 0.8614, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: -6.13% (7.0961 => 6.6613, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.08% (1.0544 => 0.9903, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.07% (0.3658 => 0.3436, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.03% (1.6364 => 1.5377, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.03% (3.5339 => 3.3209, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.01% (4.0323 => 3.7899, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.00% (0.6681 => 0.6280, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.98% (0.5805 => 0.5458, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.97% (0.7198 => 0.6768, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.96% (4.8802 => 4.5894, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.94% (4.8161 => 4.5301, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.94% (4.5069 => 4.2393, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.94% (0.2695 => 0.2535, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.93% (0.6660 => 0.6265, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.91% (0.5859 => 0.5513, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -5.90% (1.1450 => 1.0774, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.87% (0.5863 => 0.5519, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.84% (1.2300 => 1.1582, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.83% (0.6395 => 0.6022, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.83% (1.3722 => 1.2922, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.83% (0.6230 => 0.5867, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.81% (1.4642 => 1.3791, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.79% (0.6736 => 0.6346, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.79% (0.5478 => 0.5161, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -5.78% (0.4515 => 0.4254, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.77% (0.5802 => 0.5467, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -5.76% (4.3330 => 4.0833, std.dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: -5.74% (1.1530 => 1.0868, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.74% (0.5925 => 0.5585, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.74% (6.7716 => 6.3832, std.dev.: 0.0074) MultiSource/Applications/Burg/burg: -5.71% (1.2515 => 1.1800, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.70% (1.2784 => 1.2055, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.70% (0.5688 => 0.5364, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.69% (0.6293 => 0.5935, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.69% (0.5575 => 0.5258, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.69% (0.5857 => 0.5524, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.68% (0.6052 => 0.5708, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.68% (0.5705 => 0.5381, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.65% (0.2548 => 0.2404, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.64% (0.6260 => 0.5907, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.63% (0.6676 => 0.6300, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.63% (0.7919 => 0.7473, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.63% (0.3483 => 0.3287, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.62% (0.5849 => 0.5520, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -5.61% (0.3812 => 0.3598, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.60% (0.5591 => 0.5278, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.59% (0.5456 => 0.5151, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.58% (0.7524 => 0.7104, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -5.58% (0.3406 => 0.3216, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.57% (0.5569 => 0.5259, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.55% (0.5581 => 0.5271, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.54% (0.5941 => 0.5612, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.53% (0.7339 => 0.6933, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -5.53% (0.3581 => 0.3383, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.53% (14.2083 => 13.4227, std.dev.: 0.0085) MultiSource/Benchmarks/McCat/08-main/main: -5.53% (0.2659 => 0.2512, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.52% (0.6667 => 0.6299, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.50% (0.6395 => 0.6043, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -5.49% (0.2985 => 0.2821, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: -5.45% (17.1032 => 16.1712, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.44% (1.2210 => 1.1546, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.41% (0.6446 => 0.6097, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.40% (0.3891 => 0.3681, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.39% (0.4916 => 0.4651, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.39% (0.5567 => 0.5267, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.39% (0.8521 => 0.8062, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: -5.38% (0.4033 => 0.3816, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -5.38% (0.3831 => 0.3625, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -5.36% (0.4176 => 0.3952, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.34% (0.6440 => 0.6096, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.33% (0.3319 => 0.3142, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.33% (8.0126 => 7.5853, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.33% (0.3884 => 0.3677, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -5.33% (0.3848 => 0.3643, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -5.31% (0.3880 => 0.3674, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.30% (0.2999 => 0.2840, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -5.29% (0.3896 => 0.3690, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.29% (1.2221 => 1.1575, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.28% (0.2385 => 0.2259, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.28% (0.5570 => 0.5276, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.27% (0.2278 => 0.2158, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: -5.22% (0.4199 => 0.3980, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -5.21% (1.3864 => 1.3141, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: -5.21% (3.5154 => 3.3321, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.19% (1.6474 => 1.5619, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -5.15% (4.0594 => 3.8503, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: -5.14% (0.4280 => 0.4060, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -5.10% (2.4021 => 2.2795, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.07% (0.5999 => 0.5695, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: -5.05% (15.5079 => 14.7250, std.dev.: 0.0065) MultiSource/Applications/minisat/minisat: -5.01% (0.7447 => 0.7074, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -4.99% (15.2527 => 14.4913, std.dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.99% (0.2106 => 0.2001, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: -4.92% (0.3271 => 0.3110, std.dev.: 0.0025) MultiSource/Applications/treecc/treecc: -4.92% (2.1401 => 2.0348, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.90% (0.5168 => 0.4915, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.89% (0.6194 => 0.5891, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.89% (0.6297 => 0.5989, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.85% (0.6304 => 0.5998, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.78% (22.4056 => 21.3343, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.76% (0.7021 => 0.6687, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -4.72% (0.7982 => 0.7605, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.67% (0.5329 => 0.5080, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.62% (0.6189 => 0.5903, std.dev.: 0.0073) MultiSource/Applications/hexxagon/hexxagon: -4.61% (1.3148 => 1.2542, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.61% (2.2587 => 2.1546, std.dev.: 0.0078) MultiSource/Applications/kimwitu++/kc: -4.52% (18.2933 => 17.4671, std.dev.: 0.0215) MultiSource/Applications/oggenc/oggenc: -4.51% (5.0226 => 4.7962, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: -4.45% (34.0927 => 32.5762, std.dev.: 0.0279) MultiSource/Applications/spiff/spiff: -4.44% (0.8418 => 0.8044, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.38% (0.9077 => 0.8679, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.29% (0.4151 => 0.3973, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.20% (0.3931 => 0.3766, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.18% (0.3323 => 0.3184, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.12% (0.3057 => 0.2931, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.12% (0.3837 => 0.3679, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -4.12% (0.3255 => 0.3121, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: -4.09% (0.4861 => 0.4662, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.09% (0.3252 => 0.3119, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -4.07% (0.3025 => 0.2902, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.03% (0.2903 => 0.2786, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: -4.03% (0.4248 => 0.4077, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -3.98% (0.2939 => 0.2822, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/fibo: -3.97% (0.2871 => 0.2757, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.95% (0.2933 => 0.2817, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.94% (0.9557 => 0.9180, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.91% (0.3016 => 0.2898, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -3.90% (0.3026 => 0.2908, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.90% (0.3849 => 0.3699, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -3.86% (0.2849 => 0.2739, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -3.86% (0.3446 => 0.3313, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -3.85% (0.2989 => 0.2874, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: -3.83% (0.3394 => 0.3264, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -3.79% (0.3481 => 0.3349, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -3.78% (0.3205 => 0.3084, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -3.76% (0.6750 => 0.6496, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -3.76% (0.3621 => 0.3485, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.75% (0.4321 => 0.4159, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.75% (2.1713 => 2.0899, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.72% (0.4813 => 0.4634, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.65% (0.4083 => 0.3934, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -3.65% (0.3867 => 0.3726, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.58% (0.3491 => 0.3366, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.52% (0.4427 => 0.4271, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.51% (5.4682 => 5.2761, std.dev.: 0.0105) SingleSource/UnitTests/ObjC++/Hello: -3.43% (0.6347 => 0.6129, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -3.43% (0.3059 => 0.2954, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.34% (0.6441 => 0.6226, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -3.18% (0.7779 => 0.7532, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -3.14% (0.3788 => 0.3669, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.11% (1.5610 => 1.5124, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash: -3.07% (0.4524 => 0.4385, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -2.59% (20.7746 => 20.2371, std.dev.: 0.0081) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7542, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: -8.72% (1.2842 => 1.1722, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.91% (1.7753 => 1.7058, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: -3.91% (2.2633 => 2.1749, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.44% (1.3096 => 1.2777, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4699, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 10:14:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 12:14:38 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121116181438.E690F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5943?compare_to=5935&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5943, Order: 168168, Start Time: 2012-11-16 14:55:58, End Time: 2012-11-16 18:14:58 To: 5935, Order: 168145, Start Time: 2012-11-16 10:49:09, End Time: 2012-11-16 14:08:14 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (170 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (136 on baseline) Unchanged Tests: 1042 (721 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.29% (54.0691 => 54.7677, std.dev.: 0.1994) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.44% (1.9843 => 1.9558, std.dev.: 0.0008) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.20% (0.0625 => 0.0870, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.14% (0.1063 => 0.1394, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.14% (0.2969 => 0.3745, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.05% (0.1106 => 0.1383, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.40% (0.4139 => 0.5149, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.37% (0.0714 => 0.0888, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.85% (0.5900 => 0.7307, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.72% (0.4253 => 0.5262, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.37% (0.0475 => 0.0586, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.12% (0.0584 => 0.0719, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.03% (0.4994 => 0.6144, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.78% (0.1620 => 0.1989) MultiSource/Applications/oggenc/oggenc: 22.76% (1.5932 => 1.9558, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.56% (0.5000 => 0.6128, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.43% (0.1021 => 0.1250, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 22.20% (0.0599 => 0.0732, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.74% (0.0897 => 0.1092, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.59% (0.1107 => 0.1346, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.33% (0.0633 => 0.0768, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.18% (0.0642 => 0.0778, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 20.99% (0.0948 => 0.1147, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.76% (0.1103 => 0.1332, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.72% (0.0584 => 0.0705, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.54% (0.1003 => 0.1209, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.52% (0.0541 => 0.0652, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.44% (0.0822 => 0.0990, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 20.34% (0.0821 => 0.0988, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.32% (0.3903 => 0.4696, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 20.26% (0.1619 => 0.1947, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.20% (0.1604 => 0.1928, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.95% (0.1549 => 0.1858, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.15% (0.1462 => 0.1742, std.dev.: 0.0039) MultiSource/Applications/viterbi/viterbi: 19.01% (0.0947 => 0.1127, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.92% (0.2014 => 0.2395, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 18.69% (0.0808 => 0.0959, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.41% (0.3890 => 0.4606, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 18.39% (0.1218 => 0.1442, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 18.23% (0.5826 => 0.6888, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 18.19% (0.0698 => 0.0825, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 18.17% (0.4029 => 0.4761, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference-object: 18.14% (0.5889 => 0.6957, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.13% (0.2736 => 0.3232, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.04% (0.1968 => 0.2323, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.91% (1.3152 => 1.5508, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 17.74% (0.1505 => 0.1772, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.59% (0.2866 => 0.3370, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.56% (0.1088 => 0.1279, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.47% (3.5627 => 4.1852, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 17.27% (0.5546 => 0.6504, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.92% (1.6211 => 1.8954, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/gs/gs: 16.89% (1.8794 => 2.1968, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.70% (0.4658 => 0.5436, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.70% (0.2875 => 0.3355, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.64% (0.1160 => 0.1353, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.60% (0.3271 => 0.3814, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 16.33% (0.1421 => 0.1653, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.24% (2.7292 => 3.1723, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/strcat: 16.18% (0.2750 => 0.3195, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 15.98% (0.9697 => 1.1247, std.dev.: 0.0089) SingleSource/UnitTests/ObjC++/property-reference: 15.98% (0.7171 => 0.8317, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.94% (0.5026 => 0.5827, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.94% (0.4361 => 0.5056, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 15.91% (0.2823 => 0.3272, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 15.90% (0.2780 => 0.3222, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 15.82% (0.2725 => 0.3156, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.78% (0.2738 => 0.3170, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 15.77% (0.2714 => 0.3142, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 15.74% (1.0781 => 1.2478, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 15.73% (0.1284 => 0.1486, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.70% (0.3930 => 0.4547, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 15.69% (0.2811 => 0.3252, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.66% (0.2911 => 0.3367, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 15.66% (0.2803 => 0.3242, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 15.64% (0.2813 => 0.3253, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.61% (0.2729 => 0.3155, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 15.58% (0.9909 => 1.1453, std.dev.: 0.0048) SingleSource/Regression/C++/ofstream_ctor: 15.55% (0.3004 => 0.3471, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.44% (0.2792 => 0.3223, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.35% (4.4195 => 5.0981, std.dev.: 0.0090) MultiSource/Benchmarks/Bullet/bullet: 15.35% (23.5202 => 27.1305, std.dev.: 0.0048) MultiSource/Applications/ClamAV/clamscan: 15.31% (4.2109 => 4.8557, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.31% (0.3195 => 0.3684, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.30% (2.0673 => 2.3835, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.24% (1.9694 => 2.2695, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/wc: 15.21% (0.3096 => 0.3567, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 15.15% (0.3267 => 0.3762, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 15.07% (0.3258 => 0.3749, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 15.06% (0.3446 => 0.3965, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 14.91% (0.3460 => 0.3976, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.91% (1.9966 => 2.2942, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.90% (0.3060 => 0.3516, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.85% (0.3496 => 0.4015, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 14.83% (0.3465 => 0.3979, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.82% (0.3469 => 0.3983, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 14.80% (0.3317 => 0.3808, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.76% (0.3488 => 0.4003, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.70% (0.3442 => 0.3948, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.66% (0.3124 => 0.3582, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 14.49% (0.3678 => 0.4211, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 14.47% (0.3643 => 0.4170, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.40% (0.1090 => 0.1247, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 14.38% (0.3650 => 0.4175, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.31% (0.3362 => 0.3843, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 14.28% (0.3348 => 0.3826, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 14.19% (0.2566 => 0.2930, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 14.14% (1.4269 => 1.6286, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/lists1: 14.12% (0.3477 => 0.3968, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 14.07% (0.3724 => 0.4248, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.07% (0.3625 => 0.4135, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.05% (0.3282 => 0.3743, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 14.01% (0.3726 => 0.4248, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: 13.98% (0.2075 => 0.2365, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 13.69% (0.7875 => 0.8953, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: 13.68% (0.4146 => 0.4713, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: 13.60% (0.4251 => 0.4829, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.51% (0.3981 => 0.4519, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.45% (0.3845 => 0.4362, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.39% (0.3690 => 0.4184, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 13.19% (2.1653 => 2.4510, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 12.99% (2.1013 => 2.3742, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/bigfib: 12.95% (0.5012 => 0.5661, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 12.78% (4.6177 => 5.2079, std.dev.: 0.0035) MultiSource/Applications/SIBsim4/SIBsim4: 12.26% (0.2691 => 0.3021, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 11.89% (5.5417 => 6.2008, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.86% (0.2040 => 0.2282, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.79% (0.1383 => 0.1546, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.67% (0.6435 => 0.7186, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.19% (0.1028 => 0.1143, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 11.09% (0.3498 => 0.3886, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.74% (0.2068 => 0.2290, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.67% (0.2737 => 0.3029, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.34% (0.3084 => 0.3403, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.28% (0.6634 => 0.7316, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: 10.25% (0.3336 => 0.3678, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: 10.17% (0.4847 => 0.5340, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.70% (0.2103 => 0.2307, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 9.24% (0.2391 => 0.2612, std.dev.: 0.0051) MultiSource/Applications/sqlite3/sqlite3: 9.24% (2.0346 => 2.2226, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.63% (4.6926 => 5.0976, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.45% (0.5361 => 0.5814, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.43% (11.6398 => 12.6211, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.84% (0.5584 => 0.6022, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.77% (0.7426 => 0.8003, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 6.74% (11.9555 => 12.7609, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.38% (0.3792 => 0.3996, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 9.78% (0.2802 => 0.3076, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6098, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6756, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary: 4.90% (0.2122 => 0.2226, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-2: 4.81% (1.8057 => 1.8925, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1658, std.dev.: 0.0046) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6371, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.52% (0.3693 => 0.3823, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1972, std.dev.: 0.0075) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.73% (3.1722 => 3.2272, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3059, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2864, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5390, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5822, std.dev.: 0.0075) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.78% (25.4195 => 16.5791, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/ary2: -10.45% (0.2402 => 0.2151, std.dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9762, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7971, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9572, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8059, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0029) MultiSource/Applications/siod/siod: -2.98% (6.9842 => 6.7760, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.82% (17.2379 => 16.7522, std.dev.: 0.0644) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8671, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5785, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4960, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0432, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.00% (105.3826 => 104.3281, std.dev.: 0.0247) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 11:56:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 13:56:48 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121116195648.1AEB52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5944?compare_to=5941&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5944, Order: 168174, Start Time: 2012-11-16 18:22:36, End Time: 2012-11-16 19:57:08 To: 5941, Order: 168171, Start Time: 2012-11-16 16:35:11, End Time: 2012-11-16 18:05:50 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 10 (40 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 984 (919 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/NP/np: 77.33% (0.0172 => 0.0305, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/family/family: 60.09% (0.0436 => 0.0698, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 13.98% (0.8221 => 0.9370, std.dev.: 0.0252) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 13.94% (0.9073 => 1.0338, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.34% (0.8586 => 0.9216, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 4.22% (0.8525 => 0.8885, std.dev.: 0.0134) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/simul/simul: 792.86% (0.0014 => 0.0125, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.83% (6.5351 => 6.9815, std.dev.: 0.1505) MultiSource/Benchmarks/Bullet/bullet: 4.42% (7.1036 => 7.4178, std.dev.: 0.0994) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.18% (5.1531 => 5.2139, std.dev.: 0.0205) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.03% (16.8410 => 16.8364, std.dev.: 1.3255) MultiSource/Applications/obsequi/Obsequi: 0.05% (1.0799 => 1.0804, std.dev.: 0.2158) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.26% (21.9676 => 23.7826, std.dev.: 0.2929) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.49% (0.3669 => 0.3687, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 0.25% (0.6093 => 0.6108, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.96% (0.3338 => 0.3370, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 0.74% (0.2025 => 0.2040, std.dev.: 0.0713) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.37% (0.0219 => 0.0222, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.47% (0.0430 => 0.0428, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.18% (0.0257 => 0.0332, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 8.22% (0.0292 => 0.0316, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 7.04% (0.0398 => 0.0426, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: -0.98% (0.0205 => 0.0203, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 54.23% (0.0142 => 0.0219, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 4.37% (0.1489 => 0.1554, std.dev.: 0.0067) MultiSource/Applications/kimwitu++/kc: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.73% (1.1615 => 1.1816, std.dev.: 0.1506) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.20% (0.4178 => 0.4086, std.dev.: 0.0450) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.93% (0.1449 => 0.1392, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.24% (0.0646 => 0.0638, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.51% (0.0261 => 0.0278, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.08% (0.0556 => 0.0562, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.31% (1.1934 => 1.1971, std.dev.: 0.0193) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 93.75% (0.0016 => 0.0031, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 17.70% (0.0548 => 0.0645, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 30.39% (0.0181 => 0.0236, std.dev.: 0.0086) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.26% (0.7826 => 0.7806, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 102.27% (0.0044 => 0.0089, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2320.81% (0.6332 => 15.3286, std.dev.: 0.5738) MultiSource/Benchmarks/McCat/08-main/main: 48.44% (0.1831 => 0.2718, std.dev.: 0.0899) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.54% (0.1559 => 0.1457, std.dev.: 0.0253) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1517.28% (0.3344 => 5.4082, std.dev.: 0.2999) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.94% (0.2364 => 0.3261, std.dev.: 0.0314) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0429 => 0.0439, std.dev.: 0.0145) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.46% (0.0224 => 0.0234, std.dev.: 0.0011) SingleSource/UnitTests/byval-alignment: -31.74% (0.0230 => 0.0157, std.dev.: 0.0013) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 12.65% (0.1462 => 0.1647, std.dev.: 0.0286) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4869, std.dev.: 0.0494) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0684, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4884, std.dev.: 0.0355) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3163, std.dev.: 0.6256) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1358, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4093, std.dev.: 0.0084) SingleSource/Regression/C/uint64_to_float: -24.10% (2.1832 => 1.6570, std.dev.: 0.0051) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/NP/np: 73.30% (0.0176 => 0.0305, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/family/family: 69.83% (0.0411 => 0.0698, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/city/city: 29.64% (1.4479 => 1.8770, std.dev.: 0.1553) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 17.02% (0.8007 => 0.9370, std.dev.: 0.0252) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 15.81% (0.8927 => 1.0338, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.76% (0.8697 => 0.9981, std.dev.: 0.0459) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.11% (0.1425 => 0.1569, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.68% (0.1157 => 0.1269, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.45% (0.8420 => 0.9216, std.dev.: 0.0178) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.24% (0.2998 => 0.3245, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.29% (0.8359 => 0.8885, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.38% (1.6386 => 1.7268, std.dev.: 0.0117) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/simul/simul: 1036.36% (0.0011 => 0.0125, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 142.21% (0.0199 => 0.0482, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/pi: 57.35% (1.5795 => 2.4853, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 21.65% (0.7597 => 0.9242, std.dev.: 0.0568) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 17.03% (2.9753 => 3.4820, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.70% (2.7995 => 3.2109, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.80% (5.0261 => 5.6193, std.dev.: 0.0620) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.48% (6.3772 => 6.9815, std.dev.: 0.1505) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.06% (1.1857 => 1.2813, std.dev.: 0.0229) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.97% (0.3186 => 0.3440, std.dev.: 0.0074) SingleSource/Benchmarks/McGill/queens: 7.46% (1.7056 => 1.8329, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.86% (4.7794 => 5.1074, std.dev.: 0.1010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.08% (4.5327 => 4.8085, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 6.03% (3.1873 => 3.3796, std.dev.: 0.0577) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 5.40% (4.9469 => 5.2139, std.dev.: 0.0205) MultiSource/Applications/lambda-0_1_3/lambda: 4.73% (7.4933 => 7.8479, std.dev.: 0.0556) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.64% (6.2275 => 6.5165, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.27% (4.9453 => 5.1565, std.dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: 4.21% (7.1181 => 7.4178, std.dev.: 0.0994) MultiSource/Applications/hexxagon/hexxagon: 3.98% (14.0064 => 14.5644, std.dev.: 0.0561) MultiSource/Applications/siod/siod: 3.28% (3.6643 => 3.7845, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.89% (8.2783 => 8.5179, std.dev.: 0.0401) SingleSource/Benchmarks/Shootout/lists: 2.77% (7.3375 => 7.5404, std.dev.: 0.0213) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.56% (11.5690 => 11.8652, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.19% (1.1365 => 1.1614, std.dev.: 0.0030) SingleSource/Benchmarks/Stanford/FloatMM: 1.51% (0.8807 => 0.8940, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 1.25% (8.5322 => 8.6392, std.dev.: 0.0157) MultiSource/Benchmarks/FreeBench/neural/neural: 1.13% (1.0841 => 1.0963, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.18% (5.4641 => 4.3069, std.dev.: 0.1062) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.40% (7.2130 => 6.3907, std.dev.: 0.2118) SingleSource/Benchmarks/McGill/chomp: -10.31% (1.1216 => 1.0060, std.dev.: 0.0131) MultiSource/Benchmarks/mafft/pairlocalalign: -8.35% (63.1822 => 57.9089, std.dev.: 0.0549) SingleSource/Benchmarks/Shootout/heapsort: -8.01% (3.2926 => 3.0288, std.dev.: 0.0144) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.04% (14.6451 => 13.6139, std.dev.: 0.0527) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.73% (4.7482 => 4.4286, std.dev.: 0.0279) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.18% (0.3269 => 0.3067, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.78% (5.4972 => 5.1797, std.dev.: 0.0630) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.93% (5.1557 => 4.9017, std.dev.: 0.0332) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.92% (2.8773 => 2.7645, std.dev.: 0.0347) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.04% (28.5821 => 27.7134, std.dev.: 0.0352) MultiSource/Applications/aha/aha: -2.24% (3.3398 => 3.2649, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.88% (11.5316 => 11.3147, std.dev.: 0.0317) SingleSource/Benchmarks/Shootout-C++/hash2: -1.81% (3.4237 => 3.3619, std.dev.: 0.0043) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.37% (16.4461 => 16.8364, std.dev.: 1.3255) MultiSource/Applications/obsequi/Obsequi: 5.28% (1.0262 => 1.0804, std.dev.: 0.2158) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7515.31% (0.3123 => 23.7826, std.dev.: 0.2929) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.70% (0.2463 => 0.3687, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 1.63% (0.6010 => 0.6108, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.18% (0.3266 => 0.3370, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 3.61% (0.1969 => 0.2040, std.dev.: 0.0713) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 80.49% (0.0123 => 0.0222, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.94% (0.0384 => 0.0426, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 8.07% (0.1438 => 0.1554, std.dev.: 0.0067) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 4.30% (1.1329 => 1.1816, std.dev.: 0.1506) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.87% (0.4164 => 0.4086, std.dev.: 0.0450) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.68% (0.1369 => 0.1392, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.47% (0.0641 => 0.0638, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.56% (0.0195 => 0.0278, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.77% (0.0578 => 0.0562, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.67% (1.1437 => 1.1971, std.dev.: 0.0193) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.87% (0.0627 => 0.0645, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.11% (0.0180 => 0.0236, std.dev.: 0.0086) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.63% (0.8017 => 0.7806, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 43.55% (0.0062 => 0.0089, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 12:07:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 14:07:16 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121116200716.251D42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5945?compare_to=5942&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5945, Order: 168174, Start Time: 2012-11-16 18:34:40, End Time: 2012-11-16 20:07:36 To: 5942, Order: 168171, Start Time: 2012-11-16 16:38:59, End Time: 2012-11-16 18:11:41 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (178 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1044 (860 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.32% (1.2783 => 1.3719, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.56% (2.0478 => 2.1003, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/salsa20: 2.37% (7.4937 => 7.6711, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/hash2: 2.28% (3.1932 => 3.2660, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.60% (0.1431 => 0.1308, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.35% (0.3821 => 0.3502, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.22% (2.4924 => 2.3125, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -6.88% (0.3357 => 0.3126, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.84% (0.3142 => 0.2927, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.67% (0.2428 => 0.2266, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.67% (0.9542 => 0.8906, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.40% (0.1796 => 0.1681, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: -6.39% (0.2160 => 0.2022, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -6.34% (9.2283 => 8.6436, std.dev.: 0.0042) MultiSource/Applications/JM/lencod/lencod: -6.31% (16.1920 => 15.1709, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.28% (0.2355 => 0.2207, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.26% (0.9852 => 0.9235, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -6.25% (0.1761 => 0.1651, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.23% (0.6484 => 0.6080, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -6.23% (0.1879 => 0.1762, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: -6.18% (7.0961 => 6.6576, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.18% (0.3658 => 0.3432, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -6.18% (0.9179 => 0.8612, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.12% (1.0544 => 0.9899, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.03% (1.3722 => 1.2894, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.99% (4.8802 => 4.5880, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.97% (3.5339 => 3.3230, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: -5.97% (1.1450 => 1.0767, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.96% (4.0323 => 3.7920, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.96% (4.5069 => 4.2385, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.94% (0.5805 => 0.5460, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.94% (0.2695 => 0.2535, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.93% (0.6660 => 0.6265, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.92% (0.6052 => 0.5694, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.91% (0.5859 => 0.5513, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.88% (1.4642 => 1.3781, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.88% (1.2300 => 1.1577, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: -5.88% (4.3330 => 4.0784, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.87% (1.6364 => 1.5403, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.83% (0.5575 => 0.5250, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.81% (0.5591 => 0.5266, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.81% (0.5802 => 0.5465, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.81% (0.5478 => 0.5160, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.80% (0.5863 => 0.5523, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: -5.79% (1.1530 => 1.0862, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.79% (6.7716 => 6.3796, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.77% (0.5857 => 0.5519, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.76% (0.6736 => 0.6348, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: -5.75% (1.2515 => 1.1795, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.75% (0.6260 => 0.5900, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: -5.71% (0.4515 => 0.4257, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.70% (0.5705 => 0.5380, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.70% (0.5688 => 0.5364, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.70% (0.7919 => 0.7468, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.69% (0.6395 => 0.6031, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.69% (0.6681 => 0.6301, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.69% (1.2784 => 1.2057, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.67% (0.3406 => 0.3213, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.66% (0.3483 => 0.3286, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.65% (0.5925 => 0.5590, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.64% (0.6293 => 0.5938, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.64% (0.7198 => 0.6792, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.64% (0.6667 => 0.6291, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.63% (0.6395 => 0.6035, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.63% (0.7339 => 0.6926, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.62% (0.5941 => 0.5607, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.62% (4.8161 => 4.5456, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.61% (0.5849 => 0.5521, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.57% (0.5456 => 0.5152, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.57% (0.2999 => 0.2832, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -5.56% (0.3812 => 0.3600, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.56% (0.2985 => 0.2819, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.55% (0.5581 => 0.5271, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.55% (14.2083 => 13.4194, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.54% (0.7524 => 0.7107, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.54% (0.6676 => 0.6306, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.52% (0.6230 => 0.5886, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.48% (0.6440 => 0.6087, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.48% (0.5569 => 0.5264, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.48% (0.5570 => 0.5265, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -5.46% (17.1032 => 16.1693, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/08-main/main: -5.45% (0.2659 => 0.2514, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.44% (0.2278 => 0.2154, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.44% (0.6033 => 0.5705, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.43% (0.8521 => 0.8058, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/for-in: -5.43% (0.4033 => 0.3814, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.41% (0.4916 => 0.4650, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.41% (1.2221 => 1.1560, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: -5.40% (1.3864 => 1.3116, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/synchronized: -5.39% (0.3896 => 0.3686, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.39% (0.3880 => 0.3671, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.38% (0.2548 => 0.2411, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -5.36% (0.4176 => 0.3952, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.35% (0.3848 => 0.3642, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.35% (0.6446 => 0.6101, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.34% (8.0126 => 7.5844, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/exceptions-2: -5.32% (0.3831 => 0.3627, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.32% (1.2210 => 1.1560, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.32% (0.3891 => 0.3684, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.30% (0.3884 => 0.3678, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: -5.30% (15.5079 => 14.6866, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/property: -5.26% (0.4199 => 0.3978, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.24% (1.6474 => 1.5610, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.16% (0.2385 => 0.2262, std.dev.: 0.0018) MultiSource/Applications/lua/lua: -5.16% (4.0594 => 3.8501, std.dev.: 0.0052) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.15% (0.3319 => 0.3148, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: -5.15% (3.5154 => 3.3343, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.10% (0.5999 => 0.5693, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -5.09% (2.4021 => 2.2799, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.99% (0.2106 => 0.2001, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -4.98% (0.4280 => 0.4067, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: -4.97% (0.3581 => 0.3403, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.96% (0.7447 => 0.7078, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -4.95% (15.2527 => 14.4977, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.93% (0.5168 => 0.4913, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.93% (0.6304 => 0.5993, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: -4.93% (2.1401 => 2.0347, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: -4.91% (0.7982 => 0.7590, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.83% (0.3271 => 0.3113, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.81% (22.4056 => 21.3276, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.80% (0.6189 => 0.5892, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.77% (0.7021 => 0.6686, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.73% (0.6297 => 0.5999, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.71% (0.5329 => 0.5078, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -4.63% (0.8418 => 0.8028, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.61% (2.2587 => 2.1546, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: -4.56% (5.0226 => 4.7937, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.54% (0.6194 => 0.5913, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -4.53% (1.3148 => 1.2553, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -4.49% (34.0927 => 32.5621, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.46% (0.9077 => 0.8672, std.dev.: 0.0043) MultiSource/Applications/kimwitu++/kc: -4.38% (18.2933 => 17.4926, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.29% (0.4151 => 0.3973, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.21% (0.3323 => 0.3183, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.19% (0.3057 => 0.2929, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: -4.18% (0.3255 => 0.3119, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.15% (0.3931 => 0.3768, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -4.13% (0.3194 => 0.3062, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.09% (0.3837 => 0.3680, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.06% (0.2933 => 0.2814, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.00% (0.2903 => 0.2787, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -3.99% (0.4861 => 0.4667, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.98% (0.3016 => 0.2896, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -3.98% (0.4248 => 0.4079, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.98% (0.9557 => 0.9177, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.97% (0.3252 => 0.3123, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -3.95% (0.2989 => 0.2871, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -3.92% (0.3446 => 0.3311, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -3.91% (0.2939 => 0.2824, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -3.90% (0.3205 => 0.3080, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -3.89% (0.3394 => 0.3262, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -3.86% (0.2849 => 0.2739, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -3.82% (0.6750 => 0.6492, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: -3.82% (0.3481 => 0.3348, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.82% (0.3849 => 0.3702, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.80% (0.4321 => 0.4157, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -3.78% (0.3621 => 0.3484, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.78% (0.4813 => 0.4631, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.77% (2.1713 => 2.0894, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: -3.77% (0.3025 => 0.2911, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -3.75% (0.3867 => 0.3722, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.70% (0.4083 => 0.3932, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.64% (0.4427 => 0.4266, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.52% (5.4682 => 5.2756, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.44% (0.3491 => 0.3371, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: -3.42% (0.6347 => 0.6130, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: -3.42% (0.6441 => 0.6221, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -3.40% (0.3059 => 0.2955, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -3.27% (0.7779 => 0.7525, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -3.23% (1.5610 => 1.5106, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sieve: -3.19% (0.3788 => 0.3667, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -2.60% (20.7746 => 20.2348, std.dev.: 0.0205) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7552, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1733, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.88% (2.2633 => 2.1755, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.23% (1.3096 => 1.2804, std.dev.: 0.0087) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4683, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 12:50:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 14:50:22 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121116205022.AE1352A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5946?compare_to=5940&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5946, Order: 168171, Start Time: 2012-11-16 18:31:52, End Time: 2012-11-16 20:50:41 To: 5940, Order: 168168, Start Time: 2012-11-16 15:14:49, End Time: 2012-11-16 17:34:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 32 (144 on baseline) Performance Improvements: 7 (39 on baseline) Added Tests: 0 (136 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1001 (704 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 14.55% (0.5932 => 0.6795, std.dev.: 0.0215) MultiSource/Benchmarks/McCat/08-main/main: 13.52% (0.3106 => 0.3526, std.dev.: 0.0089) MultiSource/Applications/aha/aha: 13.26% (0.1320 => 0.1495, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash: 12.72% (0.4766 => 0.5372, std.dev.: 0.0069) MultiSource/Applications/Burg/burg: 12.70% (1.3304 => 1.4993, std.dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.40% (0.7143 => 0.8029, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/09-vor/vor: 12.20% (0.3556 => 0.3990, std.dev.: 0.0051) MultiSource/Applications/spiff/spiff: 11.58% (0.8923 => 0.9956, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 11.49% (0.0879 => 0.0980, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: 11.22% (3.7993 => 4.2257, std.dev.: 0.0266) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.94% (0.1170 => 0.1298, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 10.85% (0.0949 => 0.1052, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 10.23% (0.1486 => 0.1638, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 9.90% (0.4766 => 0.5238, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (1.2221 => 1.3399, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/04-bisect/bisect: 8.71% (0.1206 => 0.1311, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 7.80% (0.1667 => 0.1797, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.40% (0.6336 => 0.6805, std.dev.: 0.0054) MultiSource/Applications/oggenc/oggenc: 5.73% (6.8169 => 7.2075, std.dev.: 0.0668) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.56% (0.2498 => 0.2637, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.51% (0.9678 => 1.0211, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.46% (21.2960 => 21.6067, std.dev.: 0.0738) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: 89.48% (0.1046 => 0.1982, std.dev.: 0.0188) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 37.90% (0.3446 => 0.4752, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/09-vor/vor: 29.92% (0.1190 => 0.1546, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 23.00% (3.8218 => 4.7010, std.dev.: 0.0731) SingleSource/Benchmarks/Shootout/hash: 9.43% (4.9795 => 5.4492, std.dev.: 0.0406) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.49% (11.5984 => 12.5834, std.dev.: 0.2191) MultiSource/Applications/JM/lencod/lencod: 5.25% (7.7301 => 8.1361, std.dev.: 0.1004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.88% (9.7093 => 9.9891, std.dev.: 0.0444) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.16% (5.4753 => 5.5386, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.07% (7.3452 => 7.4238, std.dev.: 0.0192) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: -9.29% (0.1485 => 0.1347, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -7.30% (2.4581 => 2.2786, std.dev.: 0.0646) MultiSource/Applications/siod/siod: -5.56% (2.7357 => 2.5836, std.dev.: 0.0300) MultiSource/Applications/JM/ldecod/ldecod: -3.76% (9.7955 => 9.4275, std.dev.: 0.1184) SingleSource/Benchmarks/Shootout-C++/hash2: -2.75% (0.5790 => 0.5631, std.dev.: 0.0061) MultiSource/Applications/kimwitu++/kc: -2.02% (21.5152 => 21.0814, std.dev.: 0.1366) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -3.32% (3.2166 => 3.1098, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 2.17% (0.1338 => 0.1367, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 22.62% (0.0420 => 0.0515, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.46% (0.0652 => 0.0649, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -0.03% (494.0111 => 493.8639, std.dev.: 0.2332) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.83% (4.3882 => 0.0515, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: 43693.91% (1.1277 => 493.8639, std.dev.: 0.2332) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 193.31% (0.5229 => 1.5337, std.dev.: 0.0778) MultiSource/Applications/SPASS/SPASS: 19.38% (14.9895 => 17.8945, std.dev.: 0.1897) MultiSource/Applications/kimwitu++/kc: 48.93% (14.1553 => 21.0814, std.dev.: 0.1366) MultiSource/Benchmarks/MallocBench/gs/gs: 26.53% (4.1105 => 5.2012, std.dev.: 0.0855) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 45.16% (1.1048 => 1.6037, std.dev.: 0.0355) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 434.89% (7.1582 => 38.2885, std.dev.: 0.1499) SingleSource/Benchmarks/Misc-C++-EH/spirit: 79.95% (3.4629 => 6.2314, std.dev.: 0.2264) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.09% (0.6222 => 1.0272, std.dev.: 0.0814) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11200.14% (0.0720 => 8.1361, std.dev.: 0.1004) MultiSource/Applications/SIBsim4/SIBsim4: 3859200.00% (0.0001 => 3.8593, std.dev.: 0.0404) MultiSource/Applications/SPASS/SPASS: 14603000.00% (0.0001 => 14.6031, std.dev.: 0.4913) MultiSource/Applications/kimwitu++/kc: 51900.00% (0.0001 => 0.0520, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14500.00% (0.0001 => 0.0146, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575800.00% (0.0001 => 0.5759, std.dev.: 0.0267) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10095900.00% (0.0001 => 10.0960, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5807800.00% (0.0001 => 5.8079, std.dev.: 0.7757) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1830.20% (1.1194 => 21.6067, std.dev.: 0.0738) MultiSource/Applications/ClamAV/clamscan: 71.07% (22.1758 => 37.9356, std.dev.: 0.0492) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 58.40% (2.9384 => 4.6543, std.dev.: 0.3020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.63% (7.0540 => 11.0488, std.dev.: 0.1574) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 52.69% (8.1363 => 12.4230, std.dev.: 0.0081) MultiSource/Applications/JM/lencod/lencod: 49.45% (21.9371 => 32.7859, std.dev.: 0.0310) SingleSource/Benchmarks/CoyoteBench/almabench: 49.32% (0.0730 => 0.1090, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/distray/distray: 44.51% (0.1056 => 0.1526, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/08-main/main: 38.06% (0.2554 => 0.3526, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/flops: 37.99% (0.1432 => 0.1976, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 32.66% (0.0793 => 0.1052, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/17-bintr/bintr: 30.81% (0.0675 => 0.0883, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/15-trie/trie: 30.74% (0.0527 => 0.0689, std.dev.: 0.0021) SingleSource/UnitTests/vla: 30.14% (0.0355 => 0.0462, std.dev.: 0.0025) MultiSource/Applications/aha/aha: 29.89% (0.1151 => 0.1495, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/tsp/tsp: 29.02% (0.1175 => 0.1516, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 28.78% (1.1642 => 1.4993, std.dev.: 0.0087) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 27.55% (0.0842 => 0.1074, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 27.07% (0.7835 => 0.9956, std.dev.: 0.0063) MultiSource/Applications/d/make_dparser: 26.69% (3.3354 => 4.2257, std.dev.: 0.0266) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 26.58% (0.8067 => 1.0211, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/sumcol: 26.01% (0.2891 => 0.3643, std.dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.68% (0.0479 => 0.0602, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/loader/loader: 25.56% (0.2758 => 0.3463, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/09-vor/vor: 25.47% (0.3180 => 0.3990, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 25.29% (0.4615 => 0.5782, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 25.25% (0.4289 => 0.5372, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 25.15% (0.2107 => 0.2637, std.dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: 25.15% (5.7591 => 7.2075, std.dev.: 0.0668) MultiSource/Benchmarks/BitBench/five11/five11: 25.04% (0.0567 => 0.0709, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 24.98% (0.4203 => 0.5253, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 24.48% (0.6450 => 0.8029, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 24.44% (0.0491 => 0.0611, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 24.27% (0.0886 => 0.1101, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.99% (0.0746 => 0.0925, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/bisort/bisort: 23.94% (0.0614 => 0.0761, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 23.67% (0.2603 => 0.3219, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 23.65% (0.3307 => 0.4089, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 23.65% (1.5859 => 1.9609, std.dev.: 0.0634) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 23.48% (0.0443 => 0.0547, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.45% (0.1062 => 0.1311, std.dev.: 0.0022) SingleSource/Benchmarks/Stanford/Oscar: 23.43% (0.0636 => 0.0785, std.dev.: 0.0039) MultiSource/Benchmarks/llubenchmark/llu: 23.16% (0.0462 => 0.0569, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 22.08% (14.3668 => 17.5393, std.dev.: 0.0595) SingleSource/Benchmarks/Shootout-C++/strcat: 22.01% (0.2831 => 0.3454, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/hash2: 21.88% (0.4620 => 0.5631, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/05-eks/eks: 21.84% (0.4299 => 0.5238, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/neural/neural: 21.39% (0.1463 => 0.1776, std.dev.: 0.0048) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.14% (0.1566 => 0.1897, std.dev.: 0.0102) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.77% (0.1584 => 0.1913, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.51% (0.1029 => 0.1240, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/bmm/bmm: 20.42% (0.0759 => 0.0914, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 20.30% (0.1906 => 0.2293, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wc: 19.79% (0.3052 => 0.3656, std.dev.: 0.0113) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.77% (0.2271 => 0.2720, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/fbench: 19.26% (0.0592 => 0.0706, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 19.17% (0.3282 => 0.3911, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/bigfib: 18.53% (0.6456 => 0.7652, std.dev.: 0.0165) MultiSource/Benchmarks/McCat/18-imp/imp: 18.49% (0.3423 => 0.4056, std.dev.: 0.0225) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 18.40% (0.3935 => 0.4659, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 18.38% (0.0838 => 0.0992, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.09% (0.5020 => 0.5928, std.dev.: 0.0244) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.04% (0.1125 => 0.1328, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.65% (0.5860 => 0.6894, std.dev.: 0.0251) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.42% (0.2756 => 0.3236, std.dev.: 0.0139) MultiSource/Applications/sqlite3/sqlite3: 17.28% (17.1811 => 20.1492, std.dev.: 0.1086) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 17.27% (0.8101 => 0.9500, std.dev.: 0.0226) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.03% (0.0834 => 0.0976, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 17.03% (9.4845 => 11.0993, std.dev.: 0.1376) SingleSource/Regression/C++/ofstream_ctor: 16.83% (0.2905 => 0.3394, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout/lists: 16.45% (0.0626 => 0.0729, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.37% (0.2065 => 0.2403, std.dev.: 0.0084) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.28% (0.8172 => 0.9502, std.dev.: 0.0414) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 16.09% (0.2430 => 0.2821, std.dev.: 0.0110) MultiSource/Applications/lua/lua: 15.95% (3.8723 => 4.4901, std.dev.: 0.0840) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.92% (0.0672 => 0.0779, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 15.90% (0.5981 => 0.6932, std.dev.: 0.0210) MultiSource/Benchmarks/Olden/em3d/em3d: 15.87% (0.1695 => 0.1964, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 15.83% (1.1840 => 1.3714, std.dev.: 0.0610) MultiSource/Benchmarks/Olden/mst/mst: 15.82% (0.1163 => 0.1347, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.59% (0.0648 => 0.0749, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: 15.56% (0.3092 => 0.3573, std.dev.: 0.0165) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.53% (0.0953 => 0.1101, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout/matrix: 15.40% (0.0818 => 0.0944, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.21% (4.9449 => 5.6969, std.dev.: 0.1142) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.03% (0.1337 => 0.1538, std.dev.: 0.0066) MultiSource/Applications/viterbi/viterbi: 14.98% (0.1555 => 0.1788, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.96% (2.2022 => 2.5317, std.dev.: 0.0235) SingleSource/UnitTests/ObjC++/property-reference: 14.89% (0.7326 => 0.8417, std.dev.: 0.0193) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.55% (0.0770 => 0.0882, std.dev.: 0.0042) MultiSource/Benchmarks/Bullet/bullet: 14.29% (63.2438 => 72.2803, std.dev.: 0.3193) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.66% (0.5569 => 0.6330, std.dev.: 0.0209) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.44% (5.0018 => 5.6738, std.dev.: 0.2166) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.34% (4.2646 => 4.8334, std.dev.: 0.1399) MultiSource/Benchmarks/Prolangs-C++/city/city: 12.63% (2.0665 => 2.3275, std.dev.: 0.0849) SingleSource/UnitTests/ObjC/parameter-passing: 12.50% (0.3927 => 0.4418, std.dev.: 0.0186) MultiSource/Applications/siod/siod: 12.48% (2.2969 => 2.5836, std.dev.: 0.0300) MultiSource/Applications/treecc/treecc: 12.40% (2.0273 => 2.2786, std.dev.: 0.0646) MultiSource/Applications/hexxagon/hexxagon: 12.27% (1.2842 => 1.4418, std.dev.: 0.0607) SingleSource/UnitTests/ObjC/exceptions: 11.94% (0.3828 => 0.4285, std.dev.: 0.0170) SingleSource/UnitTests/ObjC/for-in: 11.80% (0.3694 => 0.4130, std.dev.: 0.0163) MultiSource/Benchmarks/sim/sim: 9.74% (0.3387 => 0.3717, std.dev.: 0.0122) MultiSource/Benchmarks/PAQ8p/paq8p: 9.06% (10.3673 => 11.3062, std.dev.: 0.1921) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.53% (0.2266 => 0.2414, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 151.26% (4.3953 => 11.0436, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/methcall: 147.71% (5.3999 => 13.3761, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/17-bintr/bintr: 90.03% (0.1043 => 0.1982, std.dev.: 0.0188) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 45.95% (0.3256 => 0.4752, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/09-vor/vor: 33.97% (0.1154 => 0.1546, std.dev.: 0.0034) MultiSource/Applications/minisat/minisat: 26.27% (9.1159 => 11.5105, std.dev.: 0.5550) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.94% (13.4384 => 16.3867, std.dev.: 0.2553) SingleSource/Benchmarks/CoyoteBench/lpbench: 21.63% (10.3460 => 12.5834, std.dev.: 0.2191) SingleSource/Benchmarks/Misc/oourafft: 17.60% (6.6465 => 7.8166, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.62% (1.1145 => 1.2997, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.69% (8.6802 => 9.8688, std.dev.: 0.1705) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.18% (0.2944 => 0.3332, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.65% (2.8904 => 3.2272, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/hash: 11.01% (4.9088 => 5.4492, std.dev.: 0.0406) SingleSource/Benchmarks/Misc/richards_benchmark: 10.32% (1.1396 => 1.2572, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.33% (1.7254 => 1.8863, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 9.22% (0.7455 => 0.8142, std.dev.: 0.0218) SingleSource/Benchmarks/Shootout-C++/hash2: 8.52% (3.1578 => 3.4269, std.dev.: 0.1038) SingleSource/Benchmarks/Shootout/strcat: 7.06% (0.1899 => 0.2033, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.71% (4.2280 => 4.4694, std.dev.: 0.0118) SingleSource/Regression/C/uint64_to_float: 5.10% (0.5413 => 0.5689, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 4.61% (0.2233 => 0.2336, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 4.53% (26.0924 => 27.2741, std.dev.: 0.4105) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.23% (3.6395 => 3.7933, std.dev.: 0.0312) MultiSource/Benchmarks/nbench/nbench: 4.13% (11.6436 => 12.1247, std.dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: 2.63% (2.4116 => 2.4750, std.dev.: 0.0067) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.56% (2.1424 => 2.1973, std.dev.: 0.0152) MultiSource/Benchmarks/PAQ8p/paq8p: 2.30% (85.0658 => 87.0254, std.dev.: 0.1147) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 2.10% (3.1595 => 3.2257, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (27.8444 => 28.2737, std.dev.: 0.0401) SingleSource/Benchmarks/Shootout/sieve: 1.51% (5.2139 => 5.2927, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.40% (6.5088 => 6.5998, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/lists: 1.32% (12.5348 => 12.7003, std.dev.: 0.0626) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0504, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.31% (6.6874 => 0.1797, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -74.61% (5.2763 => 1.3399, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: -74.25% (0.8651 => 0.2228, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -41.18% (0.1622 => 0.0954, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.61% (5.3855 => 4.7063, std.dev.: 0.1757) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.50% (5.3526 => 4.7373, std.dev.: 0.1521) MultiSource/Applications/JM/ldecod/ldecod: -9.66% (10.4361 => 9.4275, std.dev.: 0.1184) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.98% (0.3987 => 0.2393, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.92% (0.0506 => 0.0304, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.33% (4.5009 => 2.7759, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7636, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.09% (2.6546 => 2.0152, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -23.02% (10.7105 => 8.2449, std.dev.: 0.4006) MultiSource/Benchmarks/FreeBench/mason/mason: -19.30% (0.2161 => 0.1744, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.62% (1.6925 => 1.4281, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.67% (2.6778 => 2.2851, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.75% (32.5116 => 29.0162, std.dev.: 0.0241) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.37% (1.5660 => 1.4350, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5759, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496) MultiSource/Benchmarks/NPB-serial/is/is: -5.48% (9.5636 => 9.0399, std.dev.: 0.0272) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.84% (3.2416 => 3.0846, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-5: -4.72% (1.5835 => 1.5087, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -4.03% (6.2999 => 6.0462, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.29% (0.9957 => 0.9629, std.dev.: 0.0059) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8913, std.dev.: 0.0029) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.33% (0.4808 => 0.4696, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.85% (8.1563 => 8.0051, std.dev.: 0.0069) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.80% (1.6805 => 1.6502, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6774, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -1.46% (10.2830 => 10.1325, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -7.95% (0.1485 => 0.1367, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0015) Report Time: 2.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 13:52:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 15:52:38 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121116215238.C2FAA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5947?compare_to=5944&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5947, Order: 168189, Start Time: 2012-11-16 20:17:39, End Time: 2012-11-16 21:52:59 To: 5944, Order: 168174, Start Time: 2012-11-16 18:22:36, End Time: 2012-11-16 19:57:08 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 5 (38 on baseline) Performance Improvements: 6 (14 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 983 (922 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 38.67% (8.2970 => 11.5054, std.dev.: 0.5823) SingleSource/Benchmarks/Shootout-C++/sieve: 4.55% (0.2857 => 0.2987, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: 4.03% (0.8312 => 0.8647, std.dev.: 0.0100) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 9.05% (3.8059 => 4.1504, std.dev.: 0.0169) MultiSource/Applications/lua/lua: 2.55% (28.9007 => 29.6375, std.dev.: 0.2200) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -13.92% (0.9465 => 0.8147, std.dev.: 0.0247) MultiSource/Benchmarks/Prolangs-C++/life/life: -13.60% (0.1037 => 0.0896, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Bullet/bullet: -1.62% (7.4178 => 7.2979, std.dev.: 0.0228) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.40% (5.0942 => 5.0230, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.28% (5.6438 => 5.5716, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.26% (2.9909 => 2.9532, std.dev.: 0.0107) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.52% (16.8364 => 17.0918, std.dev.: 0.8012) MultiSource/Applications/obsequi/Obsequi: -1.17% (1.0804 => 1.0678, std.dev.: 0.2624) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.54% (23.7826 => 22.7035, std.dev.: 0.8518) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.11% (0.3687 => 0.3691, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/bigfib: -0.18% (0.6108 => 0.6097, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.65% (0.3370 => 0.3392, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/strcat: -0.39% (0.2040 => 0.2032, std.dev.: 0.0529) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.90% (0.0222 => 0.0220, std.dev.: 0.0063) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0428 => 0.0428, std.dev.: 0.0125) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.20% (0.0332 => 0.0336, std.dev.: 0.0087) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0316 => 0.0315, std.dev.: 0.0048) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0426 => 0.0426, std.dev.: 0.0103) SingleSource/UnitTests/Vector/Altivec/casts: 0.99% (0.0203 => 0.0205, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/test1: 1.83% (0.0219 => 0.0223, std.dev.: 0.0070) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.51% (0.1554 => 0.1562, std.dev.: 0.0256) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 6.53% (1.1816 => 1.2588, std.dev.: 0.3953) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 10.72% (0.4086 => 0.4524, std.dev.: 0.1548) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.72% (0.1392 => 0.1416, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.78% (0.0638 => 0.0643, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.08% (0.0278 => 0.0275, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.20% (0.0562 => 0.0580, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.16% (1.1971 => 1.2110, std.dev.: 0.0278) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -54.84% (0.0031 => 0.0014, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.88% (0.0645 => 0.0620, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 13.14% (0.0236 => 0.0267, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.46% (0.7806 => 0.7770, std.dev.: 0.0147) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -17.98% (0.0089 => 0.0073, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2327.98% (0.6332 => 15.3740, std.dev.: 0.7723) MultiSource/Benchmarks/McCat/08-main/main: 52.70% (0.1831 => 0.2796, std.dev.: 0.0836) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.34% (0.1559 => 0.1507, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1523.83% (0.3344 => 5.4301, std.dev.: 0.4168) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.94% (0.2364 => 0.3261, std.dev.: 0.0314) SingleSource/Benchmarks/Misc/mandel: 3.03% (0.0429 => 0.0442, std.dev.: 0.0151) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.70% (0.0224 => 0.0239, std.dev.: 0.0078) SingleSource/UnitTests/byval-alignment: -24.35% (0.0230 => 0.0174, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 11.97% (0.1462 => 0.1637, std.dev.: 0.0177) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4779, std.dev.: 0.0925) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0783, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4909, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3200, std.dev.: 0.0203) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1323, std.dev.: 0.0284) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4091, std.dev.: 0.1566) SingleSource/Regression/C/uint64_to_float: -24.02% (2.1832 => 1.6587, std.dev.: 0.0200) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 36.68% (8.4179 => 11.5054, std.dev.: 0.5823) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.53% (0.2279 => 0.2519, std.dev.: 0.0070) MultiSource/Applications/spiff/spiff: 8.77% (0.7950 => 0.8647, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.49% (0.1425 => 0.1546, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: 8.42% (0.2755 => 0.2987, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.92% (0.1983 => 0.2140, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.06% (0.1885 => 0.2018, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.02% (0.8420 => 0.9011, std.dev.: 0.0131) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.96% (1.2526 => 1.3022, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.69% (1.6386 => 1.6991, std.dev.: 0.0223) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.41% (4.4873 => 4.6405, std.dev.: 0.0450) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.28% (0.8597 => 0.8879, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.51% (1.2423 => 1.2611, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 112.56% (0.0199 => 0.0423, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/pi: 54.81% (1.5795 => 2.4453, std.dev.: 0.0282) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 18.74% (0.7597 => 0.9021, std.dev.: 0.0519) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.94% (2.9753 => 3.4793, std.dev.: 0.0254) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6091, std.dev.: 0.0117) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.14% (1.1857 => 1.2822, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.13% (0.3186 => 0.3445, std.dev.: 0.0070) SingleSource/Benchmarks/McGill/queens: 7.58% (1.7056 => 1.8348, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.22% (4.7794 => 5.1247, std.dev.: 0.0477) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.15% (4.9686 => 5.2743, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.91% (3.9188 => 4.1504, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.88% (4.5327 => 4.7991, std.dev.: 0.0328) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.81% (6.2275 => 6.5273, std.dev.: 0.0325) MultiSource/Applications/hexxagon/hexxagon: 4.07% (14.0064 => 14.5761, std.dev.: 0.0521) MultiSource/Applications/siod/siod: 3.11% (3.6643 => 3.7782, std.dev.: 0.0305) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.79% (11.5690 => 11.8921, std.dev.: 0.0485) SingleSource/Benchmarks/Shootout/lists: 2.63% (7.3375 => 7.5304, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.53% (8.2783 => 8.4878, std.dev.: 0.0083) MultiSource/Benchmarks/Bullet/bullet: 2.53% (7.1181 => 7.2979, std.dev.: 0.0228) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.35% (4.8362 => 4.9500, std.dev.: 0.0201) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.35% (1.1365 => 1.1632, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/five11/five11: 2.02% (5.6030 => 5.7164, std.dev.: 0.0356) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.50% (2.9096 => 2.9532, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/ReedSolomon: 1.29% (8.5322 => 8.6421, std.dev.: 0.0250) MultiSource/Benchmarks/FreeBench/neural/neural: 1.19% (1.0841 => 1.0970, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.81% (5.4641 => 4.3269, std.dev.: 0.0570) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.64% (7.2130 => 6.3015, std.dev.: 0.1536) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.87% (1.0512 => 0.9369, std.dev.: 0.0251) SingleSource/Benchmarks/McGill/chomp: -10.15% (1.1216 => 1.0078, std.dev.: 0.0372) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.39% (14.6451 => 13.4164, std.dev.: 0.1341) MultiSource/Benchmarks/mafft/pairlocalalign: -8.24% (63.1822 => 57.9777, std.dev.: 0.0302) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.87% (4.7482 => 4.4219, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.53% (6.0224 => 5.8101, std.dev.: 0.0706) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.36% (0.5807 => 0.5612, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.91% (28.5821 => 27.7490, std.dev.: 0.0767) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (11.5316 => 11.2983, std.dev.: 0.0294) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.97% (9.9065 => 9.7116, std.dev.: 0.0472) SingleSource/Benchmarks/Shootout-C++/hash2: -1.81% (3.4237 => 3.3618, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.11% (5.6343 => 5.5716, std.dev.: 0.0065) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 3.93% (16.4461 => 17.0918, std.dev.: 0.8012) MultiSource/Applications/obsequi/Obsequi: 4.05% (1.0262 => 1.0678, std.dev.: 0.2624) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7169.77% (0.3123 => 22.7035, std.dev.: 0.8518) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.86% (0.2463 => 0.3691, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/bigfib: 1.45% (0.6010 => 0.6097, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.86% (0.3266 => 0.3392, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/strcat: 3.20% (0.1969 => 0.2032, std.dev.: 0.0529) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0063) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0125) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 32.28% (0.0254 => 0.0336, std.dev.: 0.0087) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0048) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.94% (0.0384 => 0.0426, std.dev.: 0.0103) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/test1: 23.89% (0.0180 => 0.0223, std.dev.: 0.0070) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 8.62% (0.1438 => 0.1562, std.dev.: 0.0256) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 11.11% (1.1329 => 1.2588, std.dev.: 0.3953) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 8.65% (0.4164 => 0.4524, std.dev.: 0.1548) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.43% (0.1369 => 0.1416, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.31% (0.0641 => 0.0643, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.03% (0.0195 => 0.0275, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.35% (0.0578 => 0.0580, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.88% (1.1437 => 1.2110, std.dev.: 0.0278) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1300.00% (0.0001 => 0.0014, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.12% (0.0627 => 0.0620, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.08% (0.8017 => 0.7770, std.dev.: 0.0147) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 17.74% (0.0062 => 0.0073, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 14:06:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 16:06:06 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121116220606.76FE82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5948?compare_to=5945&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5948, Order: 168191, Start Time: 2012-11-16 20:33:31, End Time: 2012-11-16 22:06:26 To: 5945, Order: 168174, Start Time: 2012-11-16 18:34:40, End Time: 2012-11-16 20:07:36 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (179 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1044 (859 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.83% (2.0478 => 2.1058, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/salsa20: 2.53% (7.4937 => 7.6833, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash2: 2.26% (3.1932 => 3.2655, std.dev.: 0.0093) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.60% (0.1431 => 0.1308, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.17% (0.3821 => 0.3509, std.dev.: 0.0043) MultiSource/Benchmarks/PAQ8p/paq8p: -7.25% (2.4924 => 2.3118, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -6.94% (0.3357 => 0.3124, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.59% (0.2428 => 0.2268, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.59% (0.3142 => 0.2935, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.51% (0.1796 => 0.1679, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.51% (0.9542 => 0.8921, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.44% (0.1584 => 0.1482, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -6.41% (9.2283 => 8.6369, std.dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: -6.32% (16.1920 => 15.1681, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/oourafft: -6.25% (0.2160 => 0.2025, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -6.25% (0.1761 => 0.1651, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -6.23% (0.1879 => 0.1762, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.20% (0.9852 => 0.9241, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: -6.17% (0.9179 => 0.8613, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: -6.12% (7.0961 => 6.6615, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.11% (0.2355 => 0.2211, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.11% (1.0544 => 0.9900, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.07% (0.7198 => 0.6761, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.07% (0.3658 => 0.3436, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.02% (0.5863 => 0.5510, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.00% (0.6484 => 0.6095, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.98% (0.5805 => 0.5458, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.96% (1.3722 => 1.2904, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.96% (1.6364 => 1.5389, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.96% (0.5859 => 0.5510, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.95% (0.6052 => 0.5692, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.94% (0.5591 => 0.5259, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.93% (3.5339 => 3.3243, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.93% (0.6660 => 0.6265, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.91% (0.5857 => 0.5511, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.90% (0.5575 => 0.5246, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.90% (0.2695 => 0.2536, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.90% (4.8161 => 4.5320, std.dev.: 0.0072) MultiSource/Applications/lemon/lemon: -5.90% (1.1450 => 1.0775, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.89% (0.6230 => 0.5863, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.88% (0.6681 => 0.6288, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.86% (0.6395 => 0.6020, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.86% (0.5802 => 0.5462, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.84% (4.5069 => 4.2439, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.81% (1.4642 => 1.3791, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.80% (0.6260 => 0.5897, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.79% (0.6667 => 0.6281, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.79% (0.5925 => 0.5582, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.78% (0.6676 => 0.6290, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/05-eks/eks: -5.78% (0.4515 => 0.4254, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.77% (0.5688 => 0.5360, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.75% (4.8802 => 4.5996, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.75% (0.5705 => 0.5377, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.74% (0.5456 => 0.5143, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: -5.73% (1.1530 => 1.0869, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.73% (4.0323 => 3.8013, std.dev.: 0.0112) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.73% (6.7716 => 6.3839, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: -5.71% (4.3330 => 4.0854, std.dev.: 0.0072) MultiSource/Applications/Burg/burg: -5.71% (1.2515 => 1.1800, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.71% (1.2300 => 1.1598, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -5.70% (0.3406 => 0.3212, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.69% (0.5849 => 0.5516, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.68% (0.5581 => 0.5264, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.66% (0.5569 => 0.5254, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.65% (0.6395 => 0.6034, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.64% (0.6293 => 0.5938, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.62% (1.2784 => 1.2065, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.62% (0.7524 => 0.7101, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.61% (0.7339 => 0.6927, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.60% (0.6446 => 0.6085, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.59% (0.5941 => 0.5609, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.57% (0.5570 => 0.5260, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.54% (0.3483 => 0.3290, std.dev.: 0.0048) MultiSource/Applications/SIBsim4/SIBsim4: -5.53% (1.3864 => 1.3098, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.50% (0.6440 => 0.6086, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.49% (0.6736 => 0.6366, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: -5.48% (0.3812 => 0.3603, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.47% (0.7919 => 0.7486, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -5.47% (17.1032 => 16.1684, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.45% (0.6033 => 0.5704, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.42% (0.2548 => 0.2410, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.42% (14.2083 => 13.4389, std.dev.: 0.0144) MultiSource/Benchmarks/Olden/bh/bh: -5.39% (0.2985 => 0.2824, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: -5.38% (0.4033 => 0.3816, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: -5.38% (0.2659 => 0.2516, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -5.35% (0.3831 => 0.3626, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-4: -5.34% (0.3880 => 0.3673, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.33% (0.8521 => 0.8067, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.30% (0.2999 => 0.2840, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.30% (0.5999 => 0.5681, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: -5.28% (0.3581 => 0.3392, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -5.28% (0.3848 => 0.3645, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.27% (0.2278 => 0.2158, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: -5.26% (0.3896 => 0.3691, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.24% (0.4176 => 0.3957, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.24% (0.3891 => 0.3687, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -5.23% (15.5079 => 14.6973, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.22% (8.0126 => 7.5941, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.21% (1.2221 => 1.1584, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.20% (1.6474 => 1.5617, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: -5.17% (0.4199 => 0.3982, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.17% (0.4916 => 0.4662, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.14% (1.2210 => 1.1583, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: -5.09% (3.5154 => 3.3363, std.dev.: 0.0040) MultiSource/Applications/lua/lua: -5.09% (4.0594 => 3.8528, std.dev.: 0.0074) MultiSource/Applications/siod/siod: -5.06% (2.4021 => 2.2805, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.98% (0.6304 => 0.5990, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.97% (0.6297 => 0.5984, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.94% (0.6189 => 0.5883, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.94% (0.2106 => 0.2002, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -4.91% (0.7447 => 0.7081, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -4.91% (0.7982 => 0.7590, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: -4.91% (0.4280 => 0.4070, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.90% (0.5168 => 0.4915, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.89% (0.6194 => 0.5891, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.86% (0.2385 => 0.2269, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.86% (0.7021 => 0.6680, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -4.81% (1.3148 => 1.2516, std.dev.: 0.0040) MultiSource/Applications/ClamAV/clamscan: -4.80% (15.2527 => 14.5213, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.76% (0.3884 => 0.3699, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -4.75% (2.1401 => 2.0385, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -4.74% (0.3271 => 0.3116, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.72% (22.4056 => 21.3489, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.68% (2.2587 => 2.1531, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.67% (0.5329 => 0.5080, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.60% (0.4151 => 0.3960, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.58% (0.3319 => 0.3167, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.58% (0.3931 => 0.3751, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -4.58% (0.3255 => 0.3106, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -4.55% (0.8418 => 0.8035, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: -4.49% (18.2933 => 17.4725, std.dev.: 0.0286) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.45% (0.3323 => 0.3175, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.44% (0.3016 => 0.2882, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.43% (0.3837 => 0.3667, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -4.43% (0.3025 => 0.2891, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -4.41% (5.0226 => 4.8009, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/objinst: -4.38% (0.3194 => 0.3054, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.37% (0.2903 => 0.2776, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.35% (0.3057 => 0.2924, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -4.34% (34.0927 => 32.6142, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/except: -4.33% (0.3026 => 0.2895, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.31% (0.9077 => 0.8686, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.31% (0.3252 => 0.3112, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.30% (0.2933 => 0.2807, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -4.29% (0.2939 => 0.2813, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -4.26% (0.4248 => 0.4067, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.26% (0.4321 => 0.4137, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.23% (0.3849 => 0.3686, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.19% (2.1713 => 2.0803, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.19% (0.9557 => 0.9157, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.18% (0.2849 => 0.2730, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -4.15% (0.3205 => 0.3072, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -4.13% (0.4861 => 0.4660, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -4.12% (0.3394 => 0.3254, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.12% (0.2989 => 0.2866, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary2: -4.11% (0.3481 => 0.3338, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -4.03% (0.3867 => 0.3711, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -4.03% (0.3621 => 0.3475, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -3.94% (0.6750 => 0.6484, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: -3.92% (0.3446 => 0.3311, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.89% (0.4083 => 0.3924, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: -3.86% (0.3059 => 0.2941, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -3.82% (1.5610 => 1.5014, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.82% (0.4427 => 0.4258, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.70% (0.3491 => 0.3362, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: -3.62% (0.3788 => 0.3651, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.51% (0.4813 => 0.4644, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -3.48% (0.6347 => 0.6126, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -3.45% (0.6441 => 0.6219, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.38% (5.4682 => 5.2836, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: -3.32% (0.4524 => 0.4374, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -3.12% (0.7779 => 0.7536, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -2.80% (20.7746 => 20.1934, std.dev.: 0.0120) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7559, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/richards_benchmark: -8.62% (1.2842 => 1.1735, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.99% (2.2633 => 2.1730, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7068, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.39% (1.0557 => 1.0199, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.70% (1.3096 => 1.2743, std.dev.: 0.0114) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4724, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 14:21:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 16:21:32 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121116222132.040712A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5949?compare_to=5943&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5949, Order: 168174, Start Time: 2012-11-16 19:02:49, End Time: 2012-11-16 22:21:52 To: 5943, Order: 168168, Start Time: 2012-11-16 14:55:58, End Time: 2012-11-16 18:14:58 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (170 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (136 on baseline) Unchanged Tests: 1044 (720 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.04% (0.0625 => 0.0869, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.04% (0.1063 => 0.1393, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.93% (0.2969 => 0.3739, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.30% (0.4139 => 0.5186, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.14% (0.1106 => 0.1384, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.65% (0.0714 => 0.0890, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.88% (0.5900 => 0.7309, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.84% (0.4253 => 0.5267, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.37% (0.0475 => 0.0586, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.37% (0.4994 => 0.6161, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.29% (0.0584 => 0.0720, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.02% (0.5000 => 0.6151, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 22.92% (1.5932 => 1.9584, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.59% (0.1620 => 0.1986, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 22.54% (0.0599 => 0.0734, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.43% (0.1021 => 0.1250, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.74% (0.0897 => 0.1092, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.59% (0.1107 => 0.1346, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.33% (0.0633 => 0.0768) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.18% (0.0642 => 0.0778, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.94% (0.1103 => 0.1334, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.89% (0.0584 => 0.0706, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 20.89% (0.0948 => 0.1146, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.52% (0.0541 => 0.0652) MultiSource/Benchmarks/Olden/health/health: 20.46% (0.0821 => 0.0989, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.34% (0.3903 => 0.4697, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.34% (0.1003 => 0.1207, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.32% (0.1604 => 0.1930, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.32% (0.0822 => 0.0989, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 20.26% (0.1619 => 0.1947, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.95% (0.1549 => 0.1858, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 19.01% (0.0947 => 0.1127, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 18.69% (0.0808 => 0.0959, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.62% (0.2014 => 0.2389, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.54% (0.1462 => 0.1733, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 18.39% (0.1218 => 0.1442, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.33% (0.3890 => 0.4603, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 18.19% (0.0698 => 0.0825, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 18.16% (0.5826 => 0.6884, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 18.04% (0.4029 => 0.4756, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 17.97% (0.5889 => 0.6947, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.80% (0.2736 => 0.3223, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 17.74% (0.1505 => 0.1772, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.72% (1.3152 => 1.5483, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.65% (0.1088 => 0.1280, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.45% (0.2866 => 0.3366, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.31% (3.5627 => 4.1794, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 17.22% (0.5546 => 0.6501, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.02% (0.1968 => 0.2303, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 16.97% (1.8794 => 2.1984, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.78% (0.3271 => 0.3820, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.73% (0.2875 => 0.3356, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.70% (0.4658 => 0.5436, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.69% (1.6211 => 1.8916, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.64% (0.1160 => 0.1353, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 16.28% (0.1284 => 0.1493, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/18-imp/imp: 16.26% (0.1421 => 0.1652, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.20% (2.7292 => 3.1713, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 16.11% (0.2750 => 0.3193, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.98% (0.4361 => 0.5058, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 15.98% (0.7171 => 0.8317, std.dev.: 0.0031) MultiSource/Applications/hbd/hbd: 15.96% (0.9697 => 1.1245, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 15.91% (0.2823 => 0.3272, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.84% (0.5026 => 0.5822, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: 15.83% (0.2780 => 0.3220, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 15.80% (1.0781 => 1.2484, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 15.78% (0.2725 => 0.3155, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.78% (0.2738 => 0.3170, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 15.75% (0.2813 => 0.3256, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 15.73% (0.2714 => 0.3141, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.73% (0.3930 => 0.4548, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 15.70% (0.2803 => 0.3243, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.65% (0.2729 => 0.3156, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 15.62% (0.2811 => 0.3250, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.60% (0.2911 => 0.3365, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 15.55% (0.3004 => 0.3471, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 15.54% (0.9909 => 1.1449, std.dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 15.50% (4.2109 => 4.8636, std.dev.: 0.0039) MultiSource/Benchmarks/Bullet/bullet: 15.46% (23.5202 => 27.1566, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.44% (0.2792 => 0.3223, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.43% (4.4195 => 5.1016, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.43% (0.3195 => 0.3688, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.27% (2.0673 => 2.3830, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wc: 15.21% (0.3096 => 0.3567, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 15.09% (0.3267 => 0.3760, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.02% (1.9694 => 2.2653, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary: 15.01% (0.3258 => 0.3747, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-2: 14.94% (0.3446 => 0.3961, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.89% (0.3465 => 0.3981, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 14.85% (0.3469 => 0.3984, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 14.85% (0.3496 => 0.4015, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.83% (0.3460 => 0.3973, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.83% (1.9966 => 2.2926, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.74% (0.3060 => 0.3511, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.74% (0.3488 => 0.4002, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 14.70% (0.3442 => 0.3948, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 14.62% (0.3317 => 0.3802, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 14.46% (0.3678 => 0.4210, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.44% (0.3124 => 0.3575, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.43% (0.3362 => 0.3847, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 14.41% (0.3650 => 0.4176, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.40% (0.1090 => 0.1247, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 14.32% (0.3477 => 0.3975, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 14.30% (0.3643 => 0.4164, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 14.22% (0.2075 => 0.2370, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.21% (0.3625 => 0.4140, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 14.19% (0.2566 => 0.2930, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 14.13% (0.3348 => 0.3821, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 14.10% (0.3724 => 0.4249, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.05% (0.3282 => 0.3743, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 14.04% (1.4269 => 1.6273, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sieve: 13.88% (0.3726 => 0.4243, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 13.59% (0.7875 => 0.8945, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.55% (0.3690 => 0.4190, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 13.48% (0.4146 => 0.4705, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.46% (0.3981 => 0.4517, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 13.46% (0.4251 => 0.4823, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.29% (0.3845 => 0.4356, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 13.19% (2.1653 => 2.4508, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: 12.89% (0.5012 => 0.5658, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 12.88% (2.1013 => 2.3720, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 12.80% (4.6177 => 5.2088, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.29% (0.1383 => 0.1553, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 12.08% (0.2691 => 0.3016, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11.83% (5.5417 => 6.1974, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.81% (0.2040 => 0.2281, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.67% (0.6435 => 0.7186, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.28% (0.1028 => 0.1144, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 10.81% (0.3498 => 0.3876, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.74% (0.2737 => 0.3031, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.69% (0.2068 => 0.2289, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.27% (0.6634 => 0.7315, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 10.25% (0.4847 => 0.5344, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.18% (0.3084 => 0.3398, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 10.16% (0.3336 => 0.3675, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.80% (0.2103 => 0.2309, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 9.23% (2.0346 => 2.2223, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 9.16% (0.2391 => 0.2610, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.96% (4.6926 => 5.1129, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.59% (11.6398 => 12.6392, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.39% (0.5361 => 0.5811, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.85% (0.7426 => 0.8009, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.75% (0.5584 => 0.6017, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 6.75% (11.9555 => 12.7625, std.dev.: 0.0088) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.38% (0.3792 => 0.3996, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.28% (0.2802 => 0.3062, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6099, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6710, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ary: 5.14% (0.2122 => 0.2231, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-2: 4.83% (1.8057 => 1.8929, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1662, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.36% (0.3693 => 0.3854, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: 4.13% (14.0481 => 14.6287, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1996, std.dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.53% (3.1722 => 3.2207, std.dev.: 0.0051) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3019, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.36% (7.1849 => 7.2823, std.dev.: 0.0059) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5127, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5859, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.61% (2.4764 => 2.4366, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5620, std.dev.: 0.0260) SingleSource/Benchmarks/Shootout-C++/ary2: -7.95% (0.2402 => 0.2211, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9813, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8014, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8043, std.dev.: 0.0102) MultiSource/Applications/siod/siod: -2.98% (6.9842 => 6.7761, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.96% (0.6293 => 0.6107, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/fldry: -2.57% (17.2379 => 16.7947, std.dev.: 0.0977) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8626, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5716, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4962, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1845, std.dev.: 0.0838) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0472, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 15:47:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 17:47:36 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121116234736.9CF142A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5950?compare_to=5947&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5950, Order: 168206, Start Time: 2012-11-16 22:12:08, End Time: 2012-11-16 23:47:57 To: 5947, Order: 168189, Start Time: 2012-11-16 20:17:39, End Time: 2012-11-16 21:52:59 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 23 (75 on baseline) Performance Improvements: 5 (16 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 966 (883 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-02-ArgumentTest: 205.17% (0.0058 => 0.0177, std.dev.: 0.0021) SingleSource/Regression/C/matrixTranspose: 81.17% (0.0239 => 0.0433, std.dev.: 0.0017) SingleSource/Regression/C++/global_ctor: 75.49% (0.0204 => 0.0358, std.dev.: 0.0005) SingleSource/UnitTests/2002-08-19-CodegenBug: 74.46% (0.0184 => 0.0321, std.dev.: 0.0009) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 71.90% (0.0153 => 0.0263, std.dev.: 0.0014) SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 69.43% (0.0193 => 0.0327, std.dev.: 0.0012) SingleSource/UnitTests/SignlessTypes/div: 66.55% (0.0293 => 0.0488, std.dev.: 0.0029) SingleSource/UnitTests/2003-07-09-LoadShorts: 61.83% (0.0241 => 0.0390, std.dev.: 0.0013) SingleSource/UnitTests/Vector/sumarray: 61.26% (0.0191 => 0.0308, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: 58.70% (0.0247 => 0.0392, std.dev.: 0.0010) SingleSource/Regression/C++/fixups: 44.44% (0.0225 => 0.0325, std.dev.: 0.0031) SingleSource/Regression/C++/ofstream_ctor: 43.53% (0.2118 => 0.3040, std.dev.: 0.0223) SingleSource/UnitTests/SignlessTypes/rem: 41.27% (0.1100 => 0.1554, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.86% (0.8572 => 0.8817, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.36% (1.5682 => 1.6052, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.33% (3.2471 => 3.3228, std.dev.: 0.0271) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 6.73% (20.9067 => 22.3132, std.dev.: 0.4490) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.55% (1.0287 => 1.0652, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/pi: 1.65% (2.4453 => 2.4856, std.dev.: 0.0129) MultiSource/Applications/SIBsim4/SIBsim4: 1.53% (3.4101 => 3.4623, std.dev.: 0.0154) SingleSource/Benchmarks/Misc/mandel-2: 1.53% (2.8993 => 2.9436, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.29% (3.5569 => 3.6028, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: 1.02% (15.7466 => 15.9069, std.dev.: 0.0198) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.53% (0.9011 => 0.8603, std.dev.: 0.0156) MultiSource/Applications/spiff/spiff: -1.75% (0.8647 => 0.8496, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/ffbench: -3.46% (1.4330 => 1.3834, std.dev.: 0.0184) MultiSource/Benchmarks/Prolangs-C++/primes/primes: -1.33% (0.9021 => 0.8901, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.28% (6.3015 => 6.2211, std.dev.: 0.0208) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.18% (17.0918 => 17.0605, std.dev.: 1.2561) MultiSource/Applications/obsequi/Obsequi: 2.24% (1.0678 => 1.0917, std.dev.: 0.1507) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.78% (22.7035 => 22.0715, std.dev.: 1.0647) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.42% (0.3691 => 0.3854, std.dev.: 0.0306) SingleSource/Benchmarks/Misc-C++/bigfib: 2.28% (0.6097 => 0.6236, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.21% (0.3392 => 0.3433, std.dev.: 0.0404) SingleSource/Benchmarks/Shootout-C++/strcat: 1.18% (0.2032 => 0.2056, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 6.82% (0.0220 => 0.0235, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 36.45% (0.0428 => 0.0584, std.dev.: 0.0066) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 11.90% (0.0336 => 0.0376, std.dev.: 0.0083) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 49.84% (0.0315 => 0.0472, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 59.39% (0.0426 => 0.0679, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/casts: 65.85% (0.0205 => 0.0340, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/test1: 3.14% (0.0223 => 0.0230, std.dev.: 0.0061) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -6.59% (0.1562 => 0.1459, std.dev.: 0.0101) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -6.82% (1.2588 => 1.1729, std.dev.: 0.3149) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.61% (0.4524 => 0.4225, std.dev.: 0.0319) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.26% (0.1416 => 0.1448, std.dev.: 0.0310) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.27% (0.0643 => 0.0664, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.09% (0.0275 => 0.0278, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.38% (0.0580 => 0.0572, std.dev.: 0.0148) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.74% (1.2110 => 1.2020, std.dev.: 0.0246) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 121.43% (0.0014 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.71% (0.0620 => 0.0643, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.75% (0.0267 => 0.0265, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 2.64% (0.7770 => 0.7975, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 135.62% (0.0073 => 0.0172, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2433.72% (0.6332 => 16.0435, std.dev.: 0.4172) MultiSource/Benchmarks/McCat/08-main/main: 46.48% (0.1831 => 0.2682, std.dev.: 0.0740) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.01% (0.1559 => 0.1512, std.dev.: 0.0455) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1560.08% (0.3344 => 5.5513, std.dev.: 0.0749) SingleSource/Benchmarks/Misc-C++/Large/ray: 40.19% (0.2364 => 0.3314, std.dev.: 0.0565) SingleSource/Benchmarks/Misc/mandel: 7.69% (0.0429 => 0.0462, std.dev.: 0.0073) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 10.27% (0.0224 => 0.0247, std.dev.: 0.0078) SingleSource/UnitTests/byval-alignment: -23.48% (0.0230 => 0.0176, std.dev.: 0.0070) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 12.45% (0.1462 => 0.1644, std.dev.: 0.0252) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4958, std.dev.: 0.0764) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0733, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4929, std.dev.: 0.0865) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3270, std.dev.: 0.0231) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1523, std.dev.: 0.0249) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4179, std.dev.: 0.0478) SingleSource/Regression/C/uint64_to_float: -24.18% (2.1832 => 1.6553, std.dev.: 0.0309) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 94.81% (0.0135 => 0.0263, std.dev.: 0.0014) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 93.52% (0.0108 => 0.0209, std.dev.: 0.0023) SingleSource/Regression/C++/global_ctor: 93.51% (0.0185 => 0.0358, std.dev.: 0.0005) SingleSource/UnitTests/2002-08-19-CodegenBug: 92.22% (0.0167 => 0.0321, std.dev.: 0.0009) SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 90.12% (0.0172 => 0.0327, std.dev.: 0.0012) SingleSource/Regression/C/matrixTranspose: 87.45% (0.0231 => 0.0433, std.dev.: 0.0017) SingleSource/UnitTests/2008-04-18-LoopBug: 86.67% (0.0120 => 0.0224, std.dev.: 0.0018) SingleSource/UnitTests/2003-07-09-LoadShorts: 85.71% (0.0210 => 0.0390, std.dev.: 0.0013) SingleSource/UnitTests/SignlessTypes/div: 84.15% (0.0265 => 0.0488, std.dev.: 0.0029) SingleSource/UnitTests/2008-04-20-LoopBug2: 82.31% (0.0130 => 0.0237, std.dev.: 0.0011) SingleSource/Regression/C++/2003-05-14-array-init: 78.95% (0.0133 => 0.0238, std.dev.: 0.0010) SingleSource/UnitTests/Vector/sumarray: 76.00% (0.0175 => 0.0308, std.dev.: 0.0004) SingleSource/UnitTests/member-function-pointers: 74.70% (0.0166 => 0.0290, std.dev.: 0.0017) SingleSource/UnitTests/2003-05-07-VarArgs: 73.45% (0.0226 => 0.0392, std.dev.: 0.0010) SingleSource/UnitTests/Vector/sumarray-dbl: 59.24% (0.0184 => 0.0293, std.dev.: 0.0031) SingleSource/Regression/C++/fixups: 56.25% (0.0208 => 0.0325, std.dev.: 0.0031) SingleSource/Regression/C++/ofstream_ctor: 50.27% (0.2023 => 0.3040, std.dev.: 0.0223) SingleSource/UnitTests/SignlessTypes/rem: 50.14% (0.1035 => 0.1554, std.dev.: 0.0098) SingleSource/UnitTests/Vector/constpool: 42.39% (8.4179 => 11.9862, std.dev.: 0.8206) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 29.40% (0.0602 => 0.0779, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/tsp/tsp: 13.40% (0.1112 => 0.1261, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.50% (1.1606 => 1.2476, std.dev.: 0.0204) MultiSource/Applications/spiff/spiff: 6.87% (0.7950 => 0.8496, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists: 6.65% (0.2513 => 0.2680, std.dev.: 0.0040) MultiSource/Applications/Burg/burg: 6.55% (1.2222 => 1.3023, std.dev.: 0.0207) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.72% (0.8340 => 0.8817, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary2: 5.66% (0.2509 => 0.2651, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.61% (0.3657 => 0.3862, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.46% (0.6287 => 0.6630, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 5.45% (4.1305 => 4.3555, std.dev.: 0.0671) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.84% (1.4479 => 1.5180, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.81% (1.5315 => 1.6052, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.62% (0.3115 => 0.3259, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.61% (0.4559 => 0.4769, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.39% (3.1832 => 3.3228, std.dev.: 0.0271) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.16% (1.2526 => 1.3047, std.dev.: 0.0090) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.15% (4.4880 => 4.6741, std.dev.: 0.0711) MultiSource/Applications/d/make_dparser: 3.98% (3.2366 => 3.3653, std.dev.: 0.0153) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.87% (4.5702 => 4.7471, std.dev.: 0.0468) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.82% (0.2774 => 0.2880, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.72% (0.2794 => 0.2898, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.48% (0.6586 => 0.6815, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/lists1: 3.40% (0.2969 => 0.3070, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 3.24% (0.3800 => 0.3923, std.dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 2.91% (1.1271 => 1.1599, std.dev.: 0.0112) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 103.52% (0.0199 => 0.0405, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/pi: 57.37% (1.5795 => 2.4856, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.16% (0.7597 => 0.8901, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.33% (2.9753 => 3.4612, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.61% (2.7995 => 3.2086, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.43% (5.0261 => 5.6007, std.dev.: 0.0071) MultiSource/Applications/SIBsim4/SIBsim4: 8.63% (3.1873 => 3.4623, std.dev.: 0.0154) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.06% (1.1857 => 1.2813, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 7.50% (1.7056 => 1.8336, std.dev.: 0.0181) SingleSource/Benchmarks/Misc/richards_benchmark: 6.92% (1.3037 => 1.3939, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.78% (4.7794 => 5.1035, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/ary3: 6.45% (2.0949 => 2.2300, std.dev.: 0.0509) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.91% (4.5327 => 4.8004, std.dev.: 0.0286) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.81% (4.9686 => 5.2575, std.dev.: 0.0189) MultiSource/Applications/lambda-0_1_3/lambda: 4.81% (7.4933 => 7.8541, std.dev.: 0.0361) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.80% (6.2275 => 6.5266, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.42% (3.3761 => 3.5253, std.dev.: 0.0093) MultiSource/Applications/hexxagon/hexxagon: 4.20% (14.0064 => 14.5953, std.dev.: 0.0242) SingleSource/Benchmarks/Shootout/lists: 3.28% (7.3375 => 7.5784, std.dev.: 0.0115) MultiSource/Applications/siod/siod: 2.97% (3.6643 => 3.7733, std.dev.: 0.0267) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.94% (4.8362 => 4.9786, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.50% (8.2783 => 8.4851, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.72% (4.4340 => 4.5102, std.dev.: 0.0238) SingleSource/Benchmarks/Misc/mandel-2: 1.68% (2.8951 => 2.9436, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.65% (2.4647 => 2.5053, std.dev.: 0.0140) SingleSource/Benchmarks/Stanford/FloatMM: 1.43% (0.8807 => 0.8933, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 1.40% (8.5322 => 8.6513, std.dev.: 0.0262) MultiSource/Benchmarks/FreeBench/neural/neural: 1.32% (1.0841 => 1.0984, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/whetstone: 1.22% (2.1224 => 2.1482, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.20% (3.5679 => 3.6107, std.dev.: 0.0082) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.91% (5.4641 => 4.3217, std.dev.: 0.0423) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.75% (7.2130 => 6.2211, std.dev.: 0.0208) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.83% (1.0512 => 0.9374, std.dev.: 0.0385) SingleSource/Benchmarks/McGill/chomp: -9.91% (1.1216 => 1.0104, std.dev.: 0.0171) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.88% (14.6451 => 13.3447, std.dev.: 0.4363) MultiSource/Benchmarks/mafft/pairlocalalign: -8.35% (63.1822 => 57.9082, std.dev.: 0.1067) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.83% (4.7482 => 4.4237, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.97% (3.7148 => 3.4930, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.87% (5.4972 => 5.1743, std.dev.: 0.0606) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.07% (5.1557 => 4.8943, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.35% (4.7449 => 4.5385, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.80% (6.0224 => 5.7935, std.dev.: 0.0436) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.01% (28.5821 => 27.7231, std.dev.: 0.0504) MultiSource/Applications/aha/aha: -2.37% (3.3398 => 3.2607, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash2: -2.18% (3.4237 => 3.3492, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.02% (2.6356 => 2.5823, std.dev.: 0.0124) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 3.74% (16.4461 => 17.0605, std.dev.: 1.2561) MultiSource/Applications/obsequi/Obsequi: 6.38% (1.0262 => 1.0917, std.dev.: 0.1507) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6967.40% (0.3123 => 22.0715, std.dev.: 1.0647) SingleSource/Benchmarks/CoyoteBench/fftbench: 56.48% (0.2463 => 0.3854, std.dev.: 0.0306) SingleSource/Benchmarks/Misc-C++/bigfib: 3.76% (0.6010 => 0.6236, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.11% (0.3266 => 0.3433, std.dev.: 0.0404) SingleSource/Benchmarks/Shootout-C++/strcat: 4.42% (0.1969 => 0.2056, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 91.06% (0.0123 => 0.0235, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 43.14% (0.0408 => 0.0584, std.dev.: 0.0066) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 48.03% (0.0254 => 0.0376, std.dev.: 0.0083) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 56.29% (0.0302 => 0.0472, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 76.82% (0.0384 => 0.0679, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/casts: 78.95% (0.0190 => 0.0340, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/test1: 27.78% (0.0180 => 0.0230, std.dev.: 0.0061) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.46% (0.1438 => 0.1459, std.dev.: 0.0101) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 3.53% (1.1329 => 1.1729, std.dev.: 0.3149) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.46% (0.4164 => 0.4225, std.dev.: 0.0319) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.77% (0.1369 => 0.1448, std.dev.: 0.0310) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.59% (0.0641 => 0.0664, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.56% (0.0195 => 0.0278, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.04% (0.0578 => 0.0572, std.dev.: 0.0148) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.10% (1.1437 => 1.2020, std.dev.: 0.0246) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.55% (0.0627 => 0.0643, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.22% (0.0180 => 0.0265, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.52% (0.8017 => 0.7975, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 177.42% (0.0062 => 0.0172, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 16:00:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 18:00:58 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121117000058.8A9562A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5951?compare_to=5946&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5951, Order: 168191, Start Time: 2012-11-16 21:41:50, End Time: 2012-11-17 00:01:11 To: 5946, Order: 168171, Start Time: 2012-11-16 18:31:52, End Time: 2012-11-16 20:50:41 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 76 (188 on baseline) Performance Improvements: 43 (43 on baseline) Added Tests: 0 (136 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 921 (656 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 16.18% (0.6434 => 0.7475, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.16% (0.7542 => 0.8761, std.dev.: 0.0062) MultiSource/Applications/lambda-0_1_3/lambda: 15.89% (0.8498 => 0.9848, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 15.80% (0.6691 => 0.7748, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 15.77% (0.6145 => 0.7114, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 15.42% (0.8089 => 0.9336, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 15.32% (0.7199 => 0.8302, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 15.06% (0.7192 => 0.8275, std.dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 14.98% (4.6543 => 5.3514, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 14.49% (0.6216 => 0.7117, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 14.35% (0.5784 => 0.6614, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout/lists: 14.27% (0.0729 => 0.0833, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 13.87% (0.7203 => 0.8202, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 13.65% (0.6227 => 0.7077, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/random: 13.29% (0.3032 => 0.3435, std.dev.: 0.0094) SingleSource/Benchmarks/McGill/exptree: 12.85% (0.0926 => 0.1045, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 12.81% (0.3123 => 0.3523, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.76% (0.3895 => 0.4392, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 12.64% (0.3559 => 0.4009, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists: 12.59% (0.3773 => 0.4248, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 12.47% (0.3329 => 0.3744, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 12.45% (0.3124 => 0.3513, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 12.41% (0.9831 => 1.1051, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.37% (0.1035 => 0.1163, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/fibo: 12.25% (0.2956 => 0.3318, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 12.19% (0.3027 => 0.3396, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.00% (1.0272 => 1.1505, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.70% (1.7354 => 1.9384, std.dev.: 0.0111) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.66% (0.1706 => 0.1905, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.59% (0.7851 => 0.8761, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 11.57% (0.7185 => 0.8016, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/matrix: 11.26% (0.3357 => 0.3735, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/ReedSolomon: 11.14% (0.2191 => 0.2435, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/moments: 11.10% (0.4440 => 0.4933, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/em3d/em3d: 10.79% (0.1964 => 0.2176, std.dev.: 0.0020) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.28% (0.1265 => 0.1395, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.79% (6.2314 => 6.8414, std.dev.: 0.0913) MultiSource/Benchmarks/Olden/mst/mst: 9.73% (0.1347 => 0.1478, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hello: 9.63% (0.2939 => 0.3222, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.62% (0.2110 => 0.2313, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/distray/distray: 9.31% (0.1526 => 0.1668, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 9.16% (4.4901 => 4.9013, std.dev.: 0.0684) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.12% (0.1897 => 0.2070, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.96% (4.3629 => 4.7540, std.dev.: 0.1166) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.61% (0.1464 => 0.1590, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary2: 8.31% (0.3683 => 0.3989, std.dev.: 0.0112) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.06% (0.3326 => 0.3594, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/power/power: 7.79% (0.1451 => 0.1564, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.86% (0.6894 => 0.7367, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.59% (0.6932 => 0.7389, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.21% (0.9502 => 0.9997, std.dev.: 0.0192) SingleSource/UnitTests/ObjC++/property-reference-object: 5.03% (0.6641 => 0.6975, std.dev.: 0.0100) MultiSource/Applications/SPASS/SPASS: 3.30% (17.8945 => 18.4859, std.dev.: 0.0031) MultiSource/Applications/kimwitu++/kc: 1.72% (21.0814 => 21.4444, std.dev.: 0.1318) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 31.13% (1.5566 => 2.0411, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/ary3: 29.93% (3.8053 => 4.9441, std.dev.: 0.0542) MultiSource/Benchmarks/Ptrdist/ft/ft: 28.27% (1.3183 => 1.6910, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/ary2: 21.29% (0.0761 => 0.0923, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 18.50% (0.1211 => 0.1435, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 17.56% (5.5458 => 6.5196, std.dev.: 0.0253) SingleSource/Benchmarks/Shootout-C++/moments: 16.91% (0.1212 => 0.1417, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.07% (3.9394 => 4.5725, std.dev.: 0.0475) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.10% (16.3867 => 18.5333, std.dev.: 0.0312) MultiSource/Applications/lemon/lemon: 8.11% (1.4375 => 1.5541, std.dev.: 0.0172) MultiSource/Benchmarks/Olden/bh/bh: 7.78% (1.9559 => 2.1081, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.58% (3.1405 => 3.3473, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 6.42% (0.3474 => 0.3697, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.40% (6.0314 => 6.4173, std.dev.: 0.0978) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 5.70% (0.2352 => 0.2486, std.dev.: 0.0052) MultiSource/Applications/siod/siod: 5.32% (3.1819 => 3.3513, std.dev.: 0.0350) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.93% (4.3249 => 4.4950, std.dev.: 0.0214) MultiSource/Benchmarks/Olden/em3d/em3d: 3.39% (3.1098 => 3.2152, std.dev.: 0.0223) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 3.12% (4.6873 => 4.8336, std.dev.: 0.0300) MultiSource/Applications/SIBsim4/SIBsim4: 1.76% (3.8593 => 3.9272, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.29% (4.0884 => 4.1412, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.26% (5.6752 => 5.7465, std.dev.: 0.0137) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/sumcol: -13.51% (0.3643 => 0.3151, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -13.25% (0.6836 => 0.5930, std.dev.: 0.0319) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -12.96% (0.7899 => 0.6875, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -12.79% (0.7890 => 0.6881, std.dev.: 0.0250) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -12.04% (0.7535 => 0.6628, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -11.80% (0.3526 => 0.3110, std.dev.: 0.0002) MultiSource/Applications/aha/aha: -11.57% (0.1495 => 0.1322, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/spellcheck: -11.56% (0.5253 => 0.4646, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/hash: -11.45% (0.5372 => 0.4757, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -10.98% (0.6911 => 0.6152, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/strcat: -10.89% (0.3454 => 0.3078, std.dev.: 0.0103) MultiSource/Applications/spiff/spiff: -10.36% (0.9956 => 0.8925, std.dev.: 0.0285) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.94% (0.1298 => 0.1169, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -9.89% (0.1052 => 0.0948, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -9.52% (0.3656 => 0.3308, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/hash2: -9.34% (0.5631 => 0.5105, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: -9.03% (0.2414 => 0.2196, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.99% (1.3399 => 1.2194, std.dev.: 0.0251) MultiSource/Benchmarks/McCat/05-eks/eks: -8.38% (0.5238 => 0.4799, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: -8.26% (0.3911 => 0.3588, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/04-bisect/bisect: -7.86% (0.1311 => 0.1208, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.41% (0.2293 => 0.2123, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.12% (0.1797 => 0.1669, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -6.98% (0.3394 => 0.3157, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -4.76% (0.2228 => 0.2122, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: -4.29% (1.4418 => 1.3800, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: -47.23% (0.1982 => 0.1046, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -27.63% (0.4752 => 0.3439, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/lpbench: -12.79% (12.5834 => 10.9740, std.dev.: 0.3670) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -12.30% (9.9891 => 8.7606, std.dev.: 0.3879) MultiSource/Applications/minisat/minisat: -9.52% (11.5105 => 10.4146, std.dev.: 0.3049) SingleSource/Benchmarks/Shootout/hash: -9.08% (5.4492 => 4.9546, std.dev.: 0.1365) SingleSource/Benchmarks/Shootout-C++/hash: -6.60% (0.8142 => 0.7605, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -6.28% (9.8688 => 9.2494, std.dev.: 0.1716) MultiSource/Benchmarks/NPB-serial/is/is: -5.34% (9.0399 => 8.5576, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.52% (1.6502 => 1.5756, std.dev.: 0.0288) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -3.47% (5.5304 => 5.3386, std.dev.: 0.0643) MultiSource/Applications/sqlite3/sqlite3: -2.24% (4.6980 => 4.5927, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.07% (3.0846 => 3.0208, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.81% (5.4825 => 5.3834, std.dev.: 0.0363) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.48% (7.4238 => 7.3138, std.dev.: 0.0248) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.27% (5.1515 => 5.0862, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.13% (4.1419 => 4.0951, std.dev.: 0.0141) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.51% (0.1367 => 0.1360, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -18.45% (0.0515 => 0.0420, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.78% (0.0649 => 0.0680, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 0.01% (493.8639 => 493.8936, std.dev.: 0.2463) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: 43696.54% (1.1277 => 493.8936, std.dev.: 0.2463) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 193.77% (0.5229 => 1.5361, std.dev.: 0.0900) MultiSource/Applications/SPASS/SPASS: 23.33% (14.9895 => 18.4859, std.dev.: 0.0031) MultiSource/Applications/kimwitu++/kc: 51.49% (14.1553 => 21.4444, std.dev.: 0.1318) MultiSource/Benchmarks/MallocBench/gs/gs: 27.64% (4.1105 => 5.2465, std.dev.: 0.0595) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 43.56% (1.1048 => 1.5860, std.dev.: 0.0396) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 435.07% (7.1582 => 38.3016, std.dev.: 0.1368) SingleSource/Benchmarks/Misc-C++-EH/spirit: 97.56% (3.4629 => 6.8414, std.dev.: 0.0913) SingleSource/Benchmarks/Misc-C++/stepanov_container: 84.91% (0.6222 => 1.1505, std.dev.: 0.0141) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11316.39% (0.0720 => 8.2198, std.dev.: 0.0593) MultiSource/Applications/SIBsim4/SIBsim4: 3927100.00% (0.0001 => 3.9272, std.dev.: 0.0210) MultiSource/Applications/SPASS/SPASS: 14310800.00% (0.0001 => 14.3109, std.dev.: 0.1241) MultiSource/Applications/kimwitu++/kc: 53500.00% (0.0001 => 0.0536, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 63800.00% (0.0001 => 0.0639, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 580700.00% (0.0001 => 0.5808, std.dev.: 0.0258) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10083500.00% (0.0001 => 10.0836, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6416500.00% (0.0001 => 6.4166, std.dev.: 0.6326) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1811.88% (1.1194 => 21.4016, std.dev.: 0.0251) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 82.12% (2.9384 => 5.3514, std.dev.: 0.0120) MultiSource/Applications/ClamAV/clamscan: 70.90% (22.1758 => 37.8986, std.dev.: 0.0238) MultiSource/Benchmarks/FreeBench/distray/distray: 57.95% (0.1056 => 0.1668, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.80% (7.0540 => 11.0607, std.dev.: 0.0521) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 53.36% (8.1363 => 12.4781, std.dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: 48.82% (21.9371 => 32.6458, std.dev.: 0.0904) SingleSource/UnitTests/vla: 39.15% (0.0355 => 0.0494, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/almabench: 37.81% (0.0730 => 0.1006, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 37.71% (0.1432 => 0.1972, std.dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/n-body: 35.39% (0.0746 => 0.1010, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: 33.07% (0.0626 => 0.0833, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 32.49% (0.7433 => 0.9848, std.dev.: 0.0145) MultiSource/Benchmarks/Fhourstones/fhourstones: 32.18% (0.1566 => 0.2070, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 31.25% (0.6675 => 0.8761, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/dot-syntax-1: 30.06% (0.0479 => 0.0623, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/exptree: 28.38% (0.0814 => 0.1045, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 28.38% (0.1695 => 0.2176, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 28.27% (0.0467 => 0.0599, std.dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/fldry: 27.86% (0.0481 => 0.0615, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 27.64% (0.3441 => 0.4392, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 27.46% (0.0437 => 0.0557, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 27.09% (0.1163 => 0.1478, std.dev.: 0.0049) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 27.07% (0.0447 => 0.0568, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 26.98% (0.0719 => 0.0913, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 26.98% (0.0834 => 0.1059, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 26.93% (5.7591 => 7.3103, std.dev.: 0.0415) MultiSource/Benchmarks/Prolangs-C/loader/loader: 26.72% (0.2758 => 0.3495, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 26.57% (3.8723 => 4.9013, std.dev.: 0.0684) MultiSource/Benchmarks/Ptrdist/ks/ks: 26.16% (0.1510 => 0.1905, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/dry: 26.10% (0.0456 => 0.0575, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/matrix: 26.04% (0.0818 => 0.1031, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/tsp/tsp: 25.96% (0.1175 => 0.1480, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: 25.95% (0.0871 => 0.1097, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 25.75% (1.5415 => 1.9384, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 25.72% (0.5860 => 0.7367, std.dev.: 0.0106) SingleSource/Benchmarks/McGill/queens: 25.56% (0.0403 => 0.0506, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/messages-2: 25.38% (0.0662 => 0.0830, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 25.37% (0.8067 => 1.0114, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/lpbench: 25.19% (0.0929 => 0.1163, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.85% (0.0648 => 0.0809, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 24.79% (0.1940 => 0.2421, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 24.60% (0.0443 => 0.0552, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 24.39% (0.2107 => 0.2621, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/misr: 24.17% (0.0633 => 0.0786, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 24.14% (0.3422 => 0.4248, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 23.88% (0.8921 => 1.1051, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 23.54% (0.5981 => 0.7389, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 23.47% (0.2603 => 0.3214, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.25% (0.2271 => 0.2799, std.dev.: 0.0055) MultiSource/Benchmarks/BitBench/drop3/drop3: 23.03% (0.0482 => 0.0593, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 22.71% (0.2871 => 0.3523, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 22.61% (0.0491 => 0.0602, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 22.59% (0.2802 => 0.3435, std.dev.: 0.0094) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.33% (0.8172 => 0.9997, std.dev.: 0.0192) MultiSource/Applications/siod/siod: 22.33% (2.2969 => 2.8098, std.dev.: 0.1147) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 22.25% (0.1892 => 0.2313, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 22.23% (0.7115 => 0.8697, std.dev.: 0.0396) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 22.21% (14.3668 => 17.5577, std.dev.: 0.0541) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 22.14% (3.8922 => 4.7540, std.dev.: 0.1166) SingleSource/Benchmarks/Shootout-C++/ary3: 22.11% (0.3283 => 0.4009, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: 22.11% (0.2877 => 0.3513, std.dev.: 0.0018) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.05% (0.1143 => 0.1395, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: 22.01% (0.0536 => 0.0654, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/moments: 21.86% (0.4048 => 0.4933, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/08-main/main: 21.77% (0.2554 => 0.3110, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 21.76% (0.2725 => 0.3318, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 21.64% (0.6450 => 0.7846, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/nestedloop: 21.59% (0.2793 => 0.3396, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.15% (0.2430 => 0.2944, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/neural/neural: 20.85% (0.1463 => 0.1768, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 20.56% (0.3098 => 0.3735, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/objinst: 19.58% (0.3131 => 0.3744, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.55% (0.0793 => 0.0948, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 18.84% (0.2049 => 0.2435, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.74% (0.2700 => 0.3206, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 18.72% (0.2714 => 0.3222, std.dev.: 0.0049) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.40% (0.1125 => 0.1332, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 18.32% (0.1337 => 0.1582, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/ary2: 18.05% (0.3379 => 0.3989, std.dev.: 0.0112) MultiSource/Applications/sqlite3/sqlite3: 17.96% (17.1811 => 20.2668, std.dev.: 0.0368) SingleSource/Benchmarks/CoyoteBench/fftbench: 17.90% (0.4636 => 0.5466, std.dev.: 0.0289) SingleSource/Benchmarks/Misc/whetstone: 17.88% (0.0660 => 0.0778, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/parameter-passing: 17.80% (0.3927 => 0.4626, std.dev.: 0.0111) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.58% (0.0842 => 0.0990, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 17.42% (0.3886 => 0.4563, std.dev.: 0.0111) SingleSource/UnitTests/ObjC/instance-method-metadata: 17.30% (0.3543 => 0.4156, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.29% (4.9449 => 5.7999, std.dev.: 0.1682) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.28% (0.9765 => 1.1452, std.dev.: 0.0444) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 17.19% (0.0640 => 0.0750, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/Hello: 17.11% (0.5925 => 0.6939, std.dev.: 0.0225) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.92% (0.0798 => 0.0933, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 16.67% (0.3473 => 0.4052, std.dev.: 0.0092) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.63% (4.2646 => 4.9739, std.dev.: 0.0828) MultiSource/Benchmarks/mafft/pairlocalalign: 16.52% (9.4845 => 11.0514, std.dev.: 0.2494) MultiSource/Applications/d/make_dparser: 16.44% (3.3354 => 3.8836, std.dev.: 0.1697) SingleSource/UnitTests/ObjC/synchronized: 16.43% (0.3561 => 0.4146, std.dev.: 0.0092) SingleSource/UnitTests/ObjC/exceptions-3: 16.41% (0.3516 => 0.4093, std.dev.: 0.0160) SingleSource/UnitTests/ObjC/exceptions: 16.27% (0.3828 => 0.4451, std.dev.: 0.0121) SingleSource/UnitTests/ObjC/exceptions-4: 16.26% (0.3543 => 0.4119, std.dev.: 0.0094) SingleSource/UnitTests/ObjC/exceptions-2: 16.16% (0.3497 => 0.4062, std.dev.: 0.0104) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.15% (0.0675 => 0.0784, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 16.13% (0.3694 => 0.4290, std.dev.: 0.0147) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.13% (0.8101 => 0.9408, std.dev.: 0.0300) MultiSource/Applications/treecc/treecc: 15.99% (2.0273 => 2.3515, std.dev.: 0.1157) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.75% (5.0018 => 5.7894, std.dev.: 0.1675) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.74% (0.0953 => 0.1103, std.dev.: 0.0054) SingleSource/UnitTests/ObjC++/property-reference-object: 15.67% (0.6030 => 0.6975, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.64% (0.2065 => 0.2388, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.24% (0.0886 => 0.1021, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.06% (0.0770 => 0.0886, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/health/health: 15.06% (0.1268 => 0.1459, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.86% (0.4064 => 0.4668, std.dev.: 0.0220) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.86% (0.1117 => 0.1283, std.dev.: 0.0053) MultiSource/Applications/aha/aha: 14.86% (0.1151 => 0.1322, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.68% (0.0770 => 0.0883, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 14.38% (63.2438 => 72.3382, std.dev.: 0.1789) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.34% (2.2022 => 2.5181, std.dev.: 0.0239) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.26% (0.3121 => 0.3566, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.15% (0.1032 => 0.1178, std.dev.: 0.0026) MultiSource/Applications/spiff/spiff: 13.91% (0.7835 => 0.8925, std.dev.: 0.0285) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.80% (0.1029 => 0.1171, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.75% (0.1062 => 0.1208, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.70% (0.5569 => 0.6332, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.20% (0.4615 => 0.5224, std.dev.: 0.0223) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 13.13% (0.3177 => 0.3594, std.dev.: 0.0043) MultiSource/Applications/hbd/hbd: 12.79% (1.5603 => 1.7598, std.dev.: 0.0643) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.71% (1.3050 => 1.4709, std.dev.: 0.0180) MultiSource/Benchmarks/McCat/05-eks/eks: 11.63% (0.4299 => 0.4799, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.39% (0.1906 => 0.2123, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash: 10.91% (0.4289 => 0.4757, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.57% (0.1438 => 0.1590, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.54% (0.4203 => 0.4646, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/hash2: 10.50% (0.4620 => 0.5105, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.12% (1.4186 => 1.5621, std.dev.: 0.0229) SingleSource/UnitTests/SignlessTypes/rem: 9.79% (0.1144 => 0.1256, std.dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: 9.72% (10.3673 => 11.3748, std.dev.: 0.2149) MultiSource/Benchmarks/sim/sim: 9.71% (0.3387 => 0.3716, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.46% (0.7326 => 0.8019, std.dev.: 0.0163) SingleSource/Benchmarks/Misc/oourafft: 9.32% (0.3282 => 0.3588, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.99% (0.2891 => 0.3151, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.67% (0.2905 => 0.3157, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 8.61% (0.1440 => 0.1564, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/wc: 8.39% (0.3052 => 0.3308, std.dev.: 0.0090) MultiSource/Applications/hexxagon/hexxagon: 7.46% (1.2842 => 1.3800, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.52% (4.3953 => 11.0110, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/methcall: 147.72% (5.3999 => 13.3764, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 37.91% (13.4384 => 18.5333, std.dev.: 0.0312) MultiSource/Benchmarks/VersaBench/dbms/dbms: 35.30% (1.5086 => 2.0411, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/ary3: 32.83% (3.7221 => 4.9441, std.dev.: 0.0542) MultiSource/Benchmarks/Ptrdist/ft/ft: 31.72% (1.2838 => 1.6910, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/moments: 22.26% (0.1159 => 0.1417, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary2: 21.93% (0.0757 => 0.0923, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.67% (3.8532 => 4.5725, std.dev.: 0.0475) SingleSource/Benchmarks/Misc/oourafft: 17.46% (6.6465 => 7.8073, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.61% (1.1145 => 1.2996, std.dev.: 0.0056) MultiSource/Applications/minisat/minisat: 14.25% (9.1159 => 10.4146, std.dev.: 0.3049) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.98% (0.2944 => 0.3326, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.76% (2.8904 => 3.2304, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 10.14% (1.1396 => 1.2552, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.31% (1.7254 => 1.8860, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: 8.64% (1.9405 => 2.1081, std.dev.: 0.0063) MultiSource/Applications/lemon/lemon: 7.48% (1.4460 => 1.5541, std.dev.: 0.0172) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.83% (3.1334 => 3.3473, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 6.56% (8.6802 => 9.2494, std.dev.: 0.1716) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.92% (0.9540 => 1.0105, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.90% (4.2280 => 4.4775, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.62% (0.3256 => 0.3439, std.dev.: 0.0017) SingleSource/Regression/C/uint64_to_float: 5.10% (0.5413 => 0.5689, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 4.39% (26.0924 => 27.2391, std.dev.: 0.3277) MultiSource/Benchmarks/nbench/nbench: 4.20% (11.6436 => 12.1331, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/em3d/em3d: 3.64% (3.1023 => 3.2152, std.dev.: 0.0223) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: 2.98% (2.4116 => 2.4835, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.45% (1.7133 => 1.7553, std.dev.: 0.0159) MultiSource/Benchmarks/PAQ8p/paq8p: 2.29% (85.0658 => 87.0110, std.dev.: 0.1187) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.16% (1.3677 => 1.3973, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 2.06% (3.1595 => 3.2246, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 2.01% (0.7455 => 0.7605, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.81% (2.1424 => 2.1811, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 1.46% (27.8444 => 28.2510, std.dev.: 0.0631) SingleSource/Benchmarks/Shootout/sieve: 1.32% (5.2139 => 5.2828, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.26% (1.0313 => 1.0443, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.26% (6.5088 => 6.5905, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0499, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.5348 => 12.6661, std.dev.: 0.0207) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1669, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.89% (5.2763 => 1.2194, std.dev.: 0.0251) SingleSource/Benchmarks/Misc/salsa20: -75.47% (0.8651 => 0.2122, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: -45.19% (0.1622 => 0.0889, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -12.11% (0.1330 => 0.1169, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.90% (5.3855 => 4.7445, std.dev.: 0.0989) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.74% (5.3526 => 4.8311, std.dev.: 0.0544) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -9.51% (1.7609 => 1.5934, std.dev.: 0.0410) MultiSource/Applications/JM/ldecod/ldecod: -9.14% (10.4361 => 9.4824, std.dev.: 0.0494) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.92% (0.0506 => 0.0304) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.75% (0.3987 => 0.2402, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.27% (4.5009 => 2.7784, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.52% (1.1492 => 0.7640, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.09% (2.6546 => 2.0150, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -20.12% (10.7105 => 8.5556, std.dev.: 0.1731) MultiSource/Benchmarks/FreeBench/mason/mason: -19.02% (0.2161 => 0.1750, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.68% (1.6925 => 1.4271, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.72% (2.6778 => 2.2837, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.70% (32.5116 => 29.0320, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -10.52% (9.5636 => 8.5576, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.05% (1.5660 => 1.4243, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.94% (4.8142 => 4.4803, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.2416 => 3.0208, std.dev.: 0.0197) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.24% (1.6805 => 1.5756, std.dev.: 0.0288) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.57% (2.7294 => 2.5773, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -5.49% (19.9488 => 18.8528, std.dev.: 0.3390) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5080, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.73% (0.2497 => 0.2379, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -4.30% (6.2999 => 6.0291, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.42% (0.9957 => 0.9616, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -3.06% (5.0483 => 4.8937, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.33% (0.4808 => 0.4696, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.12% (8.1563 => 7.9833, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6771, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -1.47% (10.2830 => 10.1323, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: -1.11% (4.6441 => 4.5927, std.dev.: 0.0092) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.42% (0.1485 => 0.1360, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.86% (0.2116 => 0.0680, std.dev.: 0.0001) Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 16:01:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 18:01:56 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121117000156.1AA7C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5952?compare_to=5948&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5952, Order: 168207, Start Time: 2012-11-16 22:29:27, End Time: 2012-11-17 00:02:15 To: 5948, Order: 168191, Start Time: 2012-11-16 20:33:31, End Time: 2012-11-16 22:06:26 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (4 on baseline) Performance Improvements: 0 (173 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1042 (865 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.25% (1.5014 => 1.5202, std.dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.61% (1.2743 => 1.2948, std.dev.: 0.0007) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.95% (2.0478 => 2.1083, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: 2.45% (7.4937 => 7.6772, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/hash2: 2.25% (3.1932 => 3.2650, std.dev.: 0.0093) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.19% (0.3821 => 0.3508, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -6.92% (2.4924 => 2.3200, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.75% (0.3142 => 0.2930, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.57% (0.9542 => 0.8915, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -6.46% (0.3357 => 0.3140, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.14% (0.2428 => 0.2279, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.10% (9.2283 => 8.6658, std.dev.: 0.0145) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.95% (0.9852 => 0.9266, std.dev.: 0.0056) MultiSource/Applications/JM/lencod/lencod: -5.91% (16.1920 => 15.2350, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.88% (0.7198 => 0.6775, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.86% (0.2355 => 0.2217, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: -5.82% (0.9179 => 0.8645, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.75% (4.0323 => 3.8004, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.73% (0.6052 => 0.5705, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.71% (1.3722 => 1.2938, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.70% (0.5857 => 0.5523, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.70% (0.5859 => 0.5525, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: -5.69% (0.3812 => 0.3595, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.69% (0.6484 => 0.6115, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.65% (3.5339 => 3.3344, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.63% (1.0544 => 0.9950, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.63% (0.5805 => 0.5478, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.61% (0.5575 => 0.5262, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.60% (0.2695 => 0.2544, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.59% (0.5478 => 0.5172, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.59% (0.6230 => 0.5882, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.59% (0.6660 => 0.6288, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.58% (0.5591 => 0.5279, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.57% (1.6364 => 1.5452, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.57% (0.5802 => 0.5479, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.54% (6.7716 => 6.3963, std.dev.: 0.0081) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.54% (0.3884 => 0.3669, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: -5.54% (0.3848 => 0.3635, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -5.53% (1.1530 => 1.0892, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/for-in: -5.53% (0.4033 => 0.3810, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.52% (0.7524 => 0.7109, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: -5.52% (0.3880 => 0.3666, std.dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: -5.51% (7.0961 => 6.7053, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.49% (0.5863 => 0.5541, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.48% (0.4176 => 0.3947, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.48% (4.8161 => 4.5521, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions-2: -5.48% (0.3831 => 0.3621, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.47% (0.3658 => 0.3458, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.45% (0.6260 => 0.5919, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -5.44% (0.3896 => 0.3684, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.42% (0.3891 => 0.3680, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.42% (0.6676 => 0.6314, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.41% (4.8802 => 4.6160, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/05-eks/eks: -5.40% (0.4515 => 0.4271, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.40% (0.6681 => 0.6320, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.40% (0.5849 => 0.5533, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.40% (1.4642 => 1.3851, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.40% (1.2300 => 1.1636, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.39% (0.6395 => 0.6050, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.39% (0.5941 => 0.5621, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.38% (0.5581 => 0.5281, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -5.37% (0.3406 => 0.3223, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.37% (0.5456 => 0.5163, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.34% (0.6736 => 0.6376, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.33% (0.5705 => 0.5401, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.33% (0.7339 => 0.6948, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.31% (0.5688 => 0.5386, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.31% (4.5069 => 4.2677, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.30% (0.5925 => 0.5611, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.29% (0.6446 => 0.6105, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -5.28% (1.1450 => 1.0846, std.dev.: 0.0144) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.27% (1.2784 => 1.2110, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -5.26% (0.4199 => 0.3978, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.26% (0.5567 => 0.5274, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.25% (0.6395 => 0.6059, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.24% (0.6293 => 0.5963, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.22% (0.6440 => 0.6104, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.20% (0.6033 => 0.5719, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -5.20% (4.3330 => 4.1079, std.dev.: 0.0143) MultiSource/Benchmarks/Olden/bh/bh: -5.19% (0.2985 => 0.2830, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.19% (0.6667 => 0.6321, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.19% (0.5569 => 0.5280, std.dev.: 0.0051) MultiSource/Applications/Burg/burg: -5.18% (1.2515 => 1.1867, std.dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: -5.16% (1.3864 => 1.3149, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -5.16% (17.1032 => 16.2214, std.dev.: 0.1800) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.11% (1.2221 => 1.1597, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.09% (0.7919 => 0.7516, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.06% (1.2210 => 1.1592, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/18-imp/imp: -5.03% (0.3581 => 0.3401, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.98% (0.8521 => 0.8097, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.97% (0.5999 => 0.5701, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/parameter-passing: -4.95% (0.4280 => 0.4068, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.92% (0.4916 => 0.4674, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.90% (14.2083 => 13.5120, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.88% (0.3483 => 0.3313, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.86% (0.2385 => 0.2269, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: -4.84% (15.5079 => 14.7574, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.84% (8.0126 => 7.6250, std.dev.: 0.0034) MultiSource/Applications/d/make_dparser: -4.80% (3.5154 => 3.3465, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: -4.78% (0.2659 => 0.2532, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.77% (0.2999 => 0.2856, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.73% (0.6304 => 0.6006, std.dev.: 0.0103) MultiSource/Applications/ClamAV/clamscan: -4.72% (15.2527 => 14.5322, std.dev.: 0.0166) MultiSource/Applications/minisat/minisat: -4.70% (0.7447 => 0.7097, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.68% (1.6474 => 1.5703, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.67% (0.6194 => 0.5905, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.61% (0.7021 => 0.6697, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.59% (0.6297 => 0.6008, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.58% (0.3319 => 0.3167, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -4.58% (4.0594 => 3.8736, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.57% (0.2278 => 0.2174, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.47% (0.2548 => 0.2434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.41% (0.6189 => 0.5916, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.41% (0.5329 => 0.5094) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.39% (22.4056 => 21.4213, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.33% (0.5168 => 0.4944, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -4.29% (2.1401 => 2.0482, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.28% (2.2587 => 2.1621, std.dev.: 0.0018) MultiSource/Applications/siod/siod: -4.28% (2.4021 => 2.2994, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: -4.23% (5.0226 => 4.8101, std.dev.: 0.0133) MultiSource/Applications/spiff/spiff: -4.23% (0.8418 => 0.8062, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: -4.00% (0.3271 => 0.3140, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.99% (0.9077 => 0.8715, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: -3.95% (1.3148 => 1.2629, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.91% (0.9557 => 0.9183, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -3.85% (0.7982 => 0.7675, std.dev.: 0.0032) MultiSource/Applications/kimwitu++/kc: -3.83% (18.2933 => 17.5923, std.dev.: 0.0052) MultiSource/Benchmarks/Bullet/bullet: -3.79% (34.0927 => 32.7989, std.dev.: 0.0193) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.78% (0.3837 => 0.3692, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.75% (0.6347 => 0.6109, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -3.74% (0.3025 => 0.2912, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.73% (0.3057 => 0.2943, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -3.73% (0.3194 => 0.3075, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.71% (0.3931 => 0.3785, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -3.69% (0.2871 => 0.2765, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.61% (0.2933 => 0.2827, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: -3.60% (0.4248 => 0.4095, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.60% (2.1713 => 2.0932, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -3.57% (0.2939 => 0.2834, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -3.57% (0.6441 => 0.6211, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -3.56% (0.4861 => 0.4688, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -3.55% (0.2849 => 0.2748, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.53% (0.3849 => 0.3713, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -3.48% (0.3394 => 0.3276, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.45% (0.4083 => 0.3942, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.40% (0.4321 => 0.4174, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -3.40% (0.3205 => 0.3096, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -3.39% (0.3867 => 0.3736, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -3.35% (0.3255 => 0.3146, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -3.35% (0.2989 => 0.2889, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.35% (0.4813 => 0.4652, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.34% (0.3323 => 0.3212, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.32% (0.3491 => 0.3375, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.32% (0.3252 => 0.3144, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.30% (0.4151 => 0.4014, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -3.27% (0.3059 => 0.2959, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -3.26% (0.3621 => 0.3503, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -3.25% (0.3481 => 0.3368, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.24% (5.4682 => 5.2909, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary3: -3.22% (0.3446 => 0.3335, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -3.14% (0.6750 => 0.6538, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -3.06% (0.7779 => 0.7541, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.97% (20.7746 => 20.1583, std.dev.: 0.0202) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.91% (0.4427 => 0.4298, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -2.83% (0.4524 => 0.4396, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -2.61% (1.5610 => 1.5202, std.dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7542, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: -8.63% (1.2842 => 1.1734, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1738, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4727, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.13% (1.3096 => 1.2948, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 17:44:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 19:44:10 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121117014410.185F02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5953?compare_to=5950&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5953, Order: 168223, Start Time: 2012-11-17 00:10:07, End Time: 2012-11-17 01:44:31 To: 5950, Order: 168206, Start Time: 2012-11-16 22:12:08, End Time: 2012-11-16 23:47:57 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 14 (52 on baseline) Performance Improvements: 16 (21 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 964 (901 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 24.98% (1.4890 => 1.8610, std.dev.: 0.1252) MultiSource/Applications/ClamAV/clamscan: 13.27% (15.6247 => 17.6979, std.dev.: 0.4494) MultiSource/Applications/JM/lencod/lencod: 12.29% (15.9293 => 17.8877, std.dev.: 0.4418) MultiSource/Applications/oggenc/oggenc: 10.23% (5.1130 => 5.6360, std.dev.: 0.0840) MultiSource/Applications/lemon/lemon: 7.26% (1.1130 => 1.1938, std.dev.: 0.0250) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.46% (0.8263 => 0.8384, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 14.16% (3.6449 => 4.1610, std.dev.: 0.1853) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.13% (1.2923 => 1.4749, std.dev.: 0.0128) MultiSource/Applications/SPASS/SPASS: 12.45% (8.7601 => 9.8509, std.dev.: 0.2642) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 4.79% (45.9049 => 48.1017, std.dev.: 0.5092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.59% (11.5874 => 11.8877, std.dev.: 0.0237) MultiSource/Applications/siod/siod: 1.33% (3.7733 => 3.8234, std.dev.: 0.0182) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.19% (13.3447 => 13.5029, std.dev.: 0.0443) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.01% (1.4190 => 1.4333, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: -42.81% (0.0327 => 0.0187, std.dev.: 0.0012) SingleSource/UnitTests/2002-08-19-CodegenBug: -42.68% (0.0321 => 0.0184, std.dev.: 0.0006) SingleSource/Regression/C/matrixTranspose: -42.49% (0.0433 => 0.0249, std.dev.: 0.0005) SingleSource/Regression/C++/global_ctor: -41.90% (0.0358 => 0.0208, std.dev.: 0.0010) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: -41.83% (0.0263 => 0.0153, std.dev.: 0.0025) SingleSource/UnitTests/SignlessTypes/div: -41.80% (0.0488 => 0.0284, std.dev.: 0.0006) SingleSource/UnitTests/2003-07-09-LoadShorts: -38.97% (0.0390 => 0.0238, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-07-VarArgs: -38.78% (0.0392 => 0.0240, std.dev.: 0.0023) SingleSource/UnitTests/Vector/sumarray: -38.31% (0.0308 => 0.0190, std.dev.: 0.0010) SingleSource/UnitTests/member-function-pointers: -34.83% (0.0290 => 0.0189, std.dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: -32.07% (0.3040 => 0.2065, std.dev.: 0.0026) SingleSource/UnitTests/SignlessTypes/rem: -30.12% (0.1554 => 0.1086, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: -4.79% (9.2496 => 8.8063, std.dev.: 0.0554) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.23% (0.6281 => 0.6015, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -2.34% (4.7471 => 4.6362, std.dev.: 0.0188) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.88% (1.3047 => 1.2802, std.dev.: 0.0064) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 3.18% (17.0605 => 17.6037, std.dev.: 0.5260) MultiSource/Applications/obsequi/Obsequi: 3.01% (1.0917 => 1.1246, std.dev.: 0.2250) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.62% (22.0715 => 22.2081, std.dev.: 0.7787) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.18% (0.3854 => 0.3693, std.dev.: 0.0289) SingleSource/Benchmarks/Misc-C++/bigfib: -2.42% (0.6236 => 0.6085, std.dev.: 0.0227) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.18% (0.3433 => 0.3358, std.dev.: 0.1171) SingleSource/Benchmarks/Shootout-C++/strcat: -2.19% (0.2056 => 0.2011, std.dev.: 0.0609) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -6.38% (0.0235 => 0.0220, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -26.88% (0.0584 => 0.0427, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.31% (0.0376 => 0.0341, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -34.32% (0.0472 => 0.0310, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -37.11% (0.0679 => 0.0427, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: -39.71% (0.0340 => 0.0205, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -3.04% (0.0230 => 0.0223, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 5.21% (0.1459 => 0.1535, std.dev.: 0.0225) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 45.84% (1.1729 => 1.7105, std.dev.: 0.0760) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.80% (0.4225 => 0.4301, std.dev.: 0.0378) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.66% (0.1448 => 0.1366, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -25.00% (0.0008 => 0.0006, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.05% (0.0664 => 0.0657, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.76% (0.0278 => 0.0262, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.20% (0.0572 => 0.0596, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.39% (1.2020 => 1.2187, std.dev.: 0.0116) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.02% (0.0643 => 0.0585, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.19% (0.0265 => 0.0185, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.16% (0.7975 => 0.7723, std.dev.: 0.0458) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -54.07% (0.0172 => 0.0079, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2460.71% (0.6332 => 16.2144, std.dev.: 0.3819) MultiSource/Benchmarks/McCat/08-main/main: 58.77% (0.1831 => 0.2907, std.dev.: 0.0812) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.61% (0.1559 => 0.1456, std.dev.: 0.0255) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1515.70% (0.3344 => 5.4029, std.dev.: 0.3105) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.56% (0.2364 => 0.3252, std.dev.: 0.1049) SingleSource/Benchmarks/Misc/mandel: 3.03% (0.0429 => 0.0442, std.dev.: 0.0039) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.34% (0.0224 => 0.0227, std.dev.: 0.0021) SingleSource/UnitTests/byval-alignment: -27.83% (0.0230 => 0.0166, std.dev.: 0.0031) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 12.24% (0.1462 => 0.1641, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.6740, std.dev.: 0.1524) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0696, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4949, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3322, std.dev.: 0.0495) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1257, std.dev.: 0.0375) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4086, std.dev.: 0.0045) SingleSource/Regression/C/uint64_to_float: -23.90% (2.1832 => 1.6614, std.dev.: 0.0018) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/viterbi/viterbi: 42.87% (0.1577 => 0.2253, std.dev.: 0.0231) MultiSource/Applications/hbd/hbd: 30.42% (1.4269 => 1.8610, std.dev.: 0.1252) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 26.30% (0.0810 => 0.1023, std.dev.: 0.0047) MultiSource/Applications/ClamAV/clamscan: 19.84% (14.7684 => 17.6979, std.dev.: 0.4494) MultiSource/Applications/JM/lencod/lencod: 16.70% (15.3280 => 17.8877, std.dev.: 0.4418) MultiSource/Applications/oggenc/oggenc: 13.56% (4.9628 => 5.6360, std.dev.: 0.0840) MultiSource/Applications/lemon/lemon: 9.07% (1.0945 => 1.1938, std.dev.: 0.0250) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.54% (0.8321 => 0.9032, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.63% (0.4847 => 0.5217, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.23% (0.1425 => 0.1528, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.41% (0.1885 => 0.1987, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.76% (1.1685 => 1.2241, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.69% (0.8086 => 0.8384, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.64% (0.8177 => 0.8475, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.54% (0.8697 => 0.9005, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/football/football: 3.27% (0.8768 => 0.9055, std.dev.: 0.0110) MultiSource/Benchmarks/nbench/nbench: 3.03% (1.1271 => 1.1613, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.20% (1.2526 => 1.2802, std.dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: 2.11% (8.6247 => 8.8063, std.dev.: 0.0554) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.44% (4.5702 => 4.6362, std.dev.: 0.0188) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 112.06% (0.0199 => 0.0422, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/pi: 58.13% (1.5795 => 2.4976, std.dev.: 0.0125) MultiSource/Applications/minisat/minisat: 22.07% (6.1525 => 7.5102, std.dev.: 0.4441) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 19.55% (1.2337 => 1.4749, std.dev.: 0.0128) MultiSource/Applications/SPASS/SPASS: 16.82% (8.4326 => 9.8509, std.dev.: 0.2642) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.33% (2.9753 => 3.4613, std.dev.: 0.0323) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.15% (0.7597 => 0.8824, std.dev.: 0.0412) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.70% (2.7995 => 3.2111, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.73% (6.3772 => 7.1251, std.dev.: 0.1971) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.14% (0.3186 => 0.3509, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 7.95% (44.5605 => 48.1017, std.dev.: 0.5092) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.74% (1.1857 => 1.2775, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/queens: 7.34% (1.7056 => 1.8308, std.dev.: 0.0440) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.76% (4.7794 => 5.1024, std.dev.: 0.0171) SingleSource/Benchmarks/Misc/richards_benchmark: 6.58% (1.3037 => 1.3895, std.dev.: 0.0274) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.08% (4.5327 => 4.8083, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.88% (4.9686 => 5.2609, std.dev.: 0.0783) MultiSource/Applications/lambda-0_1_3/lambda: 5.88% (7.4933 => 7.9341, std.dev.: 0.0544) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.70% (6.2275 => 6.5204, std.dev.: 0.0127) MultiSource/Applications/siod/siod: 4.34% (3.6643 => 3.8234, std.dev.: 0.0182) MultiSource/Applications/hexxagon/hexxagon: 4.08% (14.0064 => 14.5777, std.dev.: 0.0708) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.05% (4.9469 => 5.1471, std.dev.: 0.0594) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.75% (11.5690 => 11.8877, std.dev.: 0.0237) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.63% (8.2783 => 8.4964, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.58% (4.0473 => 4.1517, std.dev.: 0.0361) SingleSource/Benchmarks/Shootout/lists: 2.48% (7.3375 => 7.5192, std.dev.: 0.0447) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.37% (4.8660 => 4.9814, std.dev.: 0.0327) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.99% (4.8362 => 4.9324, std.dev.: 0.0257) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.52% (1.1365 => 1.1538, std.dev.: 0.0039) MultiSource/Applications/JM/lencod/lencod: 1.49% (6.7064 => 6.8062, std.dev.: 0.0194) MultiSource/Benchmarks/FreeBench/neural/neural: 1.37% (1.0841 => 1.0990, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.28% (3.5679 => 3.6136, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -31.07% (0.0338 => 0.0233, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: -19.99% (5.4641 => 4.3719, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.53% (7.2130 => 6.3095, std.dev.: 0.2704) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.08% (1.0512 => 0.9452, std.dev.: 0.0301) SingleSource/Benchmarks/McGill/chomp: -9.73% (1.1216 => 1.0125, std.dev.: 0.0404) MultiSource/Benchmarks/mafft/pairlocalalign: -8.51% (63.1822 => 57.8042, std.dev.: 0.2864) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.80% (14.6451 => 13.5029, std.dev.: 0.0443) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.34% (0.3269 => 0.3029, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.87% (4.7482 => 4.4221, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.94% (3.7148 => 3.4942, std.dev.: 0.0238) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.81% (5.4972 => 5.1779, std.dev.: 0.0291) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.04% (5.1557 => 4.8956, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.32% (4.7449 => 4.5397, std.dev.: 0.0114) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.66% (2.8773 => 2.7721, std.dev.: 0.0408) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.64% (6.0224 => 5.8032, std.dev.: 0.0082) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.97% (28.5821 => 27.7341, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.12% (9.9065 => 9.6965, std.dev.: 0.0736) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.97% (11.5316 => 11.3045, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.3487 => 2.3154, std.dev.: 0.0045) MultiSource/Applications/aha/aha: -1.31% (3.3398 => 3.2959, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.13% (5.6343 => 5.5705, std.dev.: 0.0247) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 7.04% (16.4461 => 17.6037, std.dev.: 0.5260) MultiSource/Applications/obsequi/Obsequi: 9.59% (1.0262 => 1.1246, std.dev.: 0.2250) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7011.14% (0.3123 => 22.2081, std.dev.: 0.7787) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.94% (0.2463 => 0.3693, std.dev.: 0.0289) SingleSource/Benchmarks/Misc-C++/bigfib: 1.25% (0.6010 => 0.6085, std.dev.: 0.0227) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.82% (0.3266 => 0.3358, std.dev.: 0.1171) SingleSource/Benchmarks/Shootout-C++/strcat: 2.13% (0.1969 => 0.2011, std.dev.: 0.0609) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 34.25% (0.0254 => 0.0341, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.65% (0.0302 => 0.0310, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.20% (0.0384 => 0.0427, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 23.89% (0.0180 => 0.0223, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 100.00% (0.0007 => 0.0014, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 6.75% (0.1438 => 0.1535, std.dev.: 0.0225) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 50.98% (1.1329 => 1.7105, std.dev.: 0.0760) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.29% (0.4164 => 0.4301, std.dev.: 0.0378) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.22% (0.1369 => 0.1366, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -25.00% (0.0008 => 0.0006, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.50% (0.0641 => 0.0657, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 34.36% (0.0195 => 0.0262, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.11% (0.0578 => 0.0596, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.56% (1.1437 => 1.2187, std.dev.: 0.0116) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.70% (0.0627 => 0.0585, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.78% (0.0180 => 0.0185, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.67% (0.8017 => 0.7723, std.dev.: 0.0458) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 27.42% (0.0062 => 0.0079, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 17:58:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 19:58:18 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121117015818.71A3F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5954?compare_to=5952&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5954, Order: 168223, Start Time: 2012-11-17 00:25:34, End Time: 2012-11-17 01:58:38 To: 5952, Order: 168207, Start Time: 2012-11-16 22:29:27, End Time: 2012-11-17 00:02:15 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (5 on baseline) Performance Improvements: 0 (176 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1042 (861 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.38% (20.1583 => 20.4368, std.dev.: 0.0139) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.54% (54.7176 => 56.1060, std.dev.: 0.2668) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.25% (1.2783 => 1.3710, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.95% (2.0478 => 2.1082, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.81% (54.5751 => 56.1060, std.dev.: 0.2668) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.4937 => 7.6780, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/hash2: 2.20% (3.1932 => 3.2636, std.dev.: 0.0110) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.53% (0.1431 => 0.1309, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.24% (0.3821 => 0.3506, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -6.99% (2.4924 => 2.3183, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.73% (0.3357 => 0.3131, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.68% (0.3142 => 0.2932, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.68% (0.9542 => 0.8905, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: -6.39% (0.2160 => 0.2022, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.38% (0.2428 => 0.2273, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -6.35% (9.2283 => 8.6426, std.dev.: 0.0075) MultiSource/Applications/JM/lencod/lencod: -6.19% (16.1920 => 15.1904, std.dev.: 0.0083) MultiSource/Applications/JM/ldecod/ldecod: -6.06% (7.0961 => 6.6660, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/trivial-interface: -6.06% (0.3812 => 0.3581, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -6.04% (0.9179 => 0.8625, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.01% (0.6484 => 0.6094, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.01% (0.9852 => 0.9260, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.95% (0.3884 => 0.3653, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.94% (0.2355 => 0.2215, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -5.93% (0.3831 => 0.3604, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.93% (0.3848 => 0.3620, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.89% (0.4176 => 0.3930) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.86% (0.3891 => 0.3663, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -5.85% (0.4033 => 0.3797, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.85% (1.0544 => 0.9927, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.85% (0.3880 => 0.3653, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.84% (1.3722 => 1.2921, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.83% (4.0323 => 3.7972, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.80% (0.3658 => 0.3446, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.77% (1.6364 => 1.5419, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.76% (6.7716 => 6.3817, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.75% (0.2695 => 0.2540, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -5.75% (0.3896 => 0.3672, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.70% (0.5805 => 0.5474, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.70% (3.5339 => 3.3325, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.67% (0.6681 => 0.6302, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -5.64% (0.3406 => 0.3214, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.62% (4.8161 => 4.5455, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.62% (0.6052 => 0.5712, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.60% (0.6660 => 0.6287, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.60% (0.7198 => 0.6795, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.59% (1.2300 => 1.1613, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.58% (0.5802 => 0.5478, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.58% (0.5591 => 0.5279, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -5.57% (0.4199 => 0.3965, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -5.57% (1.1450 => 1.0812, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.57% (0.6736 => 0.6361, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: -5.56% (1.1530 => 1.0889, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.55% (4.8802 => 4.6095, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.54% (4.5069 => 4.2572, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.53% (0.5863 => 0.5539, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: -5.52% (1.3864 => 1.3099, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.50% (1.4642 => 1.3836, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.50% (0.6260 => 0.5916, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.49% (1.2784 => 1.2082, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.47% (0.6230 => 0.5889, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: -5.47% (17.1032 => 16.1676, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.47% (0.6293 => 0.5949, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.45% (0.5575 => 0.5271, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.44% (14.2083 => 13.4357, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.44% (0.6676 => 0.6313, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.41% (0.6667 => 0.6306, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.40% (0.8521 => 0.8061, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.39% (0.5859 => 0.5543, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.38% (0.5925 => 0.5606, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.38% (0.5581 => 0.5281, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (0.5857 => 0.5543, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.35% (0.5456 => 0.5164, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.32% (0.5849 => 0.5538, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.32% (0.6395 => 0.6055, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.32% (0.7524 => 0.7124, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.31% (0.5688 => 0.5386, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -5.30% (0.4280 => 0.4053, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -5.29% (1.2515 => 1.1853, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.28% (0.5705 => 0.5404, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: -5.27% (0.4515 => 0.4277, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.25% (0.3483 => 0.3300, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.25% (0.5941 => 0.5629, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: -5.25% (0.3581 => 0.3393, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: -5.23% (0.2985 => 0.2829, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.22% (0.7919 => 0.7506, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.21% (1.2221 => 1.1584, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.19% (0.5569 => 0.5280, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.19% (0.6033 => 0.5720, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.18% (1.2210 => 1.1578, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.16% (8.0126 => 7.5991, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: -5.16% (4.3330 => 4.1094, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.16% (0.6395 => 0.6065, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: -5.14% (3.5154 => 3.3348, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.12% (0.5999 => 0.5692, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.05% (0.2278 => 0.2163, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.04% (0.5570 => 0.5289, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.03% (0.6440 => 0.6116, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: -5.03% (15.5079 => 14.7277, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.02% (0.4916 => 0.4669, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.02% (0.2548 => 0.2420, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.01% (0.6446 => 0.6123, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.98% (0.5567 => 0.5290, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.94% (1.6474 => 1.5660, std.dev.: 0.0073) MultiSource/Applications/ClamAV/clamscan: -4.93% (15.2527 => 14.5008, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.83% (0.2999 => 0.2854, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.82% (0.2385 => 0.2270, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: -4.81% (0.2659 => 0.2531, std.dev.: 0.0038) MultiSource/Applications/lua/lua: -4.70% (4.0594 => 3.8686, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.70% (0.7021 => 0.6691, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.67% (0.3319 => 0.3164, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -4.67% (2.1401 => 2.0402, std.dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.66% (22.4056 => 21.3612, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.64% (0.5168 => 0.4928, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.62% (0.5329 => 0.5083, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.59% (0.6194 => 0.5910, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: -4.58% (5.0226 => 4.7926, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.56% (0.6297 => 0.6010, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.54% (0.6304 => 0.6018, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.49% (0.6189 => 0.5911, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -4.49% (1.3148 => 1.2558, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -4.49% (0.7447 => 0.7113, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.41% (0.4151 => 0.3968, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -4.37% (2.4021 => 2.2972, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.37% (2.2587 => 2.1601, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.27% (0.3837 => 0.3673, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -4.26% (0.8418 => 0.8059, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.20% (0.3931 => 0.3766, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -4.16% (0.3194 => 0.3061, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.15% (0.9557 => 0.9160, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: -4.13% (0.3025 => 0.2900, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -4.09% (0.3255 => 0.3122, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -4.08% (0.6347 => 0.6088, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: -4.07% (0.6441 => 0.6179, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.06% (2.1713 => 2.0832, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.06% (0.3057 => 0.2933, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.05% (0.3016 => 0.2894, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.03% (0.3252 => 0.3121, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.95% (0.4813 => 0.4623, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: -3.95% (0.7982 => 0.7667, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -3.93% (0.4248 => 0.4081, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.93% (0.2903 => 0.2789, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -3.92% (34.0927 => 32.7547, std.dev.: 0.0166) MultiSource/Applications/kimwitu++/kc: -3.92% (18.2933 => 17.5755, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.92% (0.2933 => 0.2818, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -3.91% (0.4861 => 0.4671, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -3.90% (0.2871 => 0.2759, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -3.90% (0.3026 => 0.2908, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.86% (0.9077 => 0.8727, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: -3.85% (0.2989 => 0.2874, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.82% (0.3323 => 0.3196, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -3.81% (0.2939 => 0.2827, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -3.81% (0.3205 => 0.3083, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: -3.76% (0.2849 => 0.2742, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -3.75% (0.3867 => 0.3722, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -3.74% (0.3446 => 0.3317, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: -3.73% (0.7779 => 0.7489, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.72% (0.4083 => 0.3931, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.72% (0.3849 => 0.3706, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -3.71% (0.3481 => 0.3352, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -3.68% (0.3394 => 0.3269, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -3.62% (0.3621 => 0.3490, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.61% (0.4321 => 0.4165, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: -3.61% (0.3271 => 0.3153, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.59% (0.4427 => 0.4268, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: -3.56% (0.3059 => 0.2950, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -3.47% (0.6750 => 0.6516, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.47% (0.3491 => 0.3370, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.26% (5.4682 => 5.2902, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: -3.19% (0.3788 => 0.3667, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -3.06% (1.5610 => 1.5133, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -1.63% (20.7746 => 20.4368, std.dev.: 0.0139) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7525, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1732, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.86% (2.2633 => 2.1760, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.15% (1.0557 => 1.0224, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.48% (1.3096 => 1.2771, std.dev.: 0.0095) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4731, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 18:28:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 20:28:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121117022841.1F9232A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5955?compare_to=5949&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5955, Order: 168208, Start Time: 2012-11-16 23:09:48, End Time: 2012-11-17 02:29:00 To: 5949, Order: 168174, Start Time: 2012-11-16 19:02:49, End Time: 2012-11-16 22:21:52 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (170 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (136 on baseline) Unchanged Tests: 1043 (720 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.45% (126.7116 => 131.0815, std.dev.: 0.2172) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.52% (0.0625 => 0.0872, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.33% (0.1063 => 0.1396, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.04% (0.2969 => 0.3742, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.68% (0.4253 => 0.5345, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.41% (0.1106 => 0.1387, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.65% (0.0714 => 0.0890, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.43% (0.4139 => 0.5150, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.75% (0.5900 => 0.7301, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.61% (0.4994 => 0.6173, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.58% (0.0475 => 0.0587, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 23.24% (1.5932 => 1.9635, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.95% (0.0584 => 0.0718, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.67% (0.0547 => 0.0671, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.48% (0.5000 => 0.6124, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: 22.20% (0.0599 => 0.0732, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.10% (0.1620 => 0.1978, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.94% (0.1021 => 0.1245, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.63% (0.0897 => 0.1091, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.32% (0.1107 => 0.1343, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.20% (0.1604 => 0.1944, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.85% (0.0633 => 0.0765, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 20.46% (0.0948 => 0.1142, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.40% (0.0642 => 0.0773, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.40% (0.1103 => 0.1328, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.38% (0.0584 => 0.0703, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.24% (0.1003 => 0.1206) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.19% (0.0822 => 0.0988, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.16% (0.3903 => 0.4690, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 19.98% (0.0821 => 0.0985, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 19.89% (0.1619 => 0.1941, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.82% (0.1549 => 0.1856, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 19.70% (0.0604 => 0.0723, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.95% (0.1462 => 0.1739, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 18.81% (0.0808 => 0.0960, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 18.69% (0.0947 => 0.1124, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 18.42% (0.4029 => 0.4771, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.37% (0.2014 => 0.2384, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.30% (0.3890 => 0.4602, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 18.14% (0.1218 => 0.1439, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.01% (1.3152 => 1.5521, std.dev.: 0.0053) SingleSource/UnitTests/ObjC++/Hello: 17.87% (0.5826 => 0.6867, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.84% (0.2736 => 0.3224, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/mst/mst: 17.77% (0.0698 => 0.0822, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.46% (0.1088 => 0.1278) SingleSource/UnitTests/ObjC++/property-reference-object: 17.44% (0.5889 => 0.6916, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 17.41% (0.1505 => 0.1767, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.27% (0.2866 => 0.3361, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 17.22% (1.8794 => 2.2031, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.07% (3.5627 => 4.1709, std.dev.: 0.0022) MultiSource/Applications/Burg/burg: 17.02% (0.5546 => 0.6490, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.00% (0.3271 => 0.3827, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.91% (0.5026 => 0.5876, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.83% (0.4658 => 0.5442, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.70% (1.6211 => 1.8919, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.67% (0.1968 => 0.2296, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.47% (0.1160 => 0.1351, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.42% (0.2875 => 0.3347, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 16.12% (0.1421 => 0.1650, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 15.93% (0.2750 => 0.3188, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 15.82% (1.0781 => 1.2487, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.79% (2.7292 => 3.1601, std.dev.: 0.0079) MultiSource/Applications/hbd/hbd: 15.76% (0.9697 => 1.1225, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.73% (0.4361 => 0.5047, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 15.69% (0.7171 => 0.8296, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: 15.65% (0.1284 => 0.1485, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.61% (4.4195 => 5.1096, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.60% (0.3930 => 0.4543, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 15.46% (4.2109 => 4.8620, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 15.43% (0.2780 => 0.3209, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 15.41% (0.2823 => 0.3258, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.34% (0.2738 => 0.3158, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 15.33% (0.2811 => 0.3242, std.dev.: 0.0031) SingleSource/Regression/C++/ofstream_ctor: 15.31% (0.3004 => 0.3464, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/random: 15.31% (0.2803 => 0.3232, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 15.30% (0.2725 => 0.3142, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 15.29% (0.2714 => 0.3129, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.25% (0.2911 => 0.3355, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 15.23% (0.9909 => 1.1418, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.17% (0.2729 => 0.3143, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.11% (0.2792 => 0.3214, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 15.00% (0.2813 => 0.3235, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.89% (1.9694 => 2.2627, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.87% (2.0673 => 2.3748, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.84% (0.3195 => 0.3669, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 14.83% (0.3258 => 0.3741, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 14.78% (0.3267 => 0.3750, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 14.73% (0.3096 => 0.3552, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 14.68% (23.5202 => 26.9727, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.59% (0.1090 => 0.1249, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.56% (1.9966 => 2.2873, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 14.55% (0.2075 => 0.2377, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 14.50% (0.2566 => 0.2938, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 14.41% (0.3317 => 0.3795, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.33% (0.3488 => 0.3988, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.18% (0.3060 => 0.3494, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.01% (0.3362 => 0.3833, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 14.00% (1.4269 => 1.6267, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.99% (0.3124 => 0.3561, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 13.98% (0.3348 => 0.3816, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/moments: 13.97% (0.3678 => 0.4192, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 13.93% (0.3446 => 0.3926, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.87% (0.3469 => 0.3950, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 13.85% (0.3465 => 0.3945, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 13.82% (0.4146 => 0.4719, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 13.81% (0.3477 => 0.3957, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.79% (0.3460 => 0.3937, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.76% (0.3496 => 0.3977, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.71% (0.3442 => 0.3914, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.71% (0.3282 => 0.3732, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.57% (0.3625 => 0.4117, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 13.54% (0.7875 => 0.8941, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 13.50% (0.3726 => 0.4229, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 13.42% (0.3650 => 0.4140, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.34% (0.3643 => 0.4129, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 13.28% (2.1653 => 2.4529, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: 13.27% (0.4251 => 0.4815, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 13.16% (0.3724 => 0.4214, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.14% (0.3690 => 0.4175, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.01% (0.3981 => 0.4499, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 13.00% (2.1013 => 2.3745, std.dev.: 0.0035) MultiSource/Applications/JM/lencod/lencod: 12.88% (4.6177 => 5.2124, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.87% (0.3845 => 0.4340, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.45% (0.2040 => 0.2294, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 12.39% (0.5012 => 0.5633, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.36% (0.1383 => 0.1554, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 12.26% (0.2691 => 0.3021, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 11.57% (5.5417 => 6.1827, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.34% (0.6435 => 0.7165, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.89% (0.1028 => 0.1140, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.84% (0.6634 => 0.7353, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 10.55% (0.3498 => 0.3867, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.40% (0.2068 => 0.2283, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 10.23% (0.4847 => 0.5343, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.23% (0.2737 => 0.3017, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.95% (0.3084 => 0.3391, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 9.89% (0.3336 => 0.3666, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 9.57% (2.0346 => 2.2293, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.56% (0.2103 => 0.2304, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 9.45% (0.2391 => 0.2617, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.45% (0.5361 => 0.5814, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.19% (4.6926 => 5.0771, std.dev.: 0.0064) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.02% (11.6398 => 12.5730, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.72% (0.5584 => 0.6015, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.57% (0.7426 => 0.7988, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 6.26% (11.9555 => 12.7036, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.40% (0.3792 => 0.3959, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 9.74% (0.2802 => 0.3075, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6092, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 5.47% (0.2122 => 0.2238, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6704, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.93% (0.3693 => 0.3875, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-2: 4.83% (1.8057 => 1.8930, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1711, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/dry: 4.25% (14.0481 => 14.6447, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1923, std.dev.: 0.0080) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2229, std.dev.: 0.0019) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3108, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2847, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5761, std.dev.: 0.0293) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.69% (2.4764 => 2.4346, std.dev.: 0.0138) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5671, std.dev.: 0.0214) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9746, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8027, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -6.29% (0.2402 => 0.2251, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419) SingleSource/UnitTests/Vector/build2: -3.54% (11.2080 => 10.8110, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.02% (0.6293 => 0.6103, std.dev.: 0.0042) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7744, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8656, std.dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/fldry: -2.12% (17.2379 => 16.8717, std.dev.: 0.0524) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5787, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: -1.44% (5.5810 => 5.5009, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1709, std.dev.: 0.0373) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.02% (16.2163 => 16.0507, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 19:11:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 21:11:16 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121117031116.3A8B12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5956?compare_to=5951&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5956, Order: 168223, Start Time: 2012-11-17 00:51:36, End Time: 2012-11-17 03:11:32 To: 5951, Order: 168191, Start Time: 2012-11-16 21:41:50, End Time: 2012-11-17 00:01:11 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 62 (176 on baseline) Performance Improvements: 19 (41 on baseline) Added Tests: 0 (136 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 959 (670 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 16.17% (0.5901 => 0.6855, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 15.31% (0.1489 => 0.1717, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 15.09% (0.6628 => 0.7628, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 15.07% (0.6185 => 0.7117, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 13.99% (0.6875 => 0.7837, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.88% (0.3206 => 0.3651, std.dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 13.79% (1.3280 => 1.5111, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.71% (0.1422 => 0.1617, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 13.50% (0.5105 => 0.5794, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 13.45% (0.2997 => 0.3400, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 13.24% (0.3308 => 0.3746, std.dev.: 0.0082) MultiSource/Applications/Burg/burg: 12.97% (1.3322 => 1.5050, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/bh/bh: 12.97% (0.3324 => 0.3755, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: 12.36% (1.1982 => 1.3463, std.dev.: 0.0278) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.83% (0.3752 => 0.4196, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: 11.66% (0.1887 => 0.2107, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/health/health: 11.58% (0.1459 => 0.1628, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.46% (0.1169 => 0.1303, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 11.37% (0.6678 => 0.7437, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/lists1: 11.20% (0.4045 => 0.4498, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.10% (0.5224 => 0.5804, std.dev.: 0.0090) SingleSource/UnitTests/ObjC++/property-reference: 10.91% (0.8019 => 0.8894, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.55% (0.3100 => 0.3427, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.19% (0.1178 => 0.1298, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: 10.04% (0.3507 => 0.3859, std.dev.: 0.0025) SingleSource/Benchmarks/Stanford/Puzzle: 9.55% (0.1392 => 0.1525, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 9.04% (0.2123 => 0.2315, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.87% (0.1669 => 0.1817, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops: 8.82% (0.1972 => 0.2146, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.18% (1.2194 => 1.3192, std.dev.: 0.0087) MultiSource/Benchmarks/McCat/18-imp/imp: 7.97% (0.3879 => 0.4188, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.20% (4.7445 => 5.0860, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.92% (1.1452 => 1.2245, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.03% (0.5161 => 0.5472, std.dev.: 0.0065) MultiSource/Applications/d/make_dparser: 6.02% (3.8836 => 4.1173, std.dev.: 0.0595) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.53% (0.9408 => 0.9928, std.dev.: 0.0099) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.17% (8.2623 => 8.6067, std.dev.: 0.0939) MultiSource/Benchmarks/PAQ8p/paq8p: 3.56% (11.3748 => 11.7798, std.dev.: 0.1076) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 101.40% (4.3539 => 8.7687, std.dev.: 0.1710) MultiSource/Benchmarks/Olden/bisort/bisort: 17.38% (0.8656 => 1.0160, std.dev.: 0.0263) SingleSource/Benchmarks/Shootout-C++/ary: 14.42% (0.0763 => 0.0873, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.37% (10.9740 => 12.4417, std.dev.: 0.2356) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 9.43% (0.5313 => 0.5814, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/health/health: 8.79% (0.4606 => 0.5011, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/hash2: 8.74% (3.3677 => 3.6619, std.dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: 7.46% (0.1435 => 0.1542, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/hash: 7.29% (4.9546 => 5.3157, std.dev.: 0.1016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 6.84% (9.2494 => 9.8824, std.dev.: 0.1188) SingleSource/Benchmarks/Misc/ffbench: 6.65% (1.0047 => 1.0715, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hash: 5.90% (0.7605 => 0.8054, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout/strcat: 5.53% (0.1934 => 0.2041, std.dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: 5.12% (8.5576 => 8.9954, std.dev.: 0.0270) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.52% (0.3145 => 0.3287, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.27% (0.3326 => 0.3468, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.34% (6.1417 => 6.3468, std.dev.: 0.0701) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.90% (3.7038 => 3.8111, std.dev.: 0.0328) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.71% (9.6209 => 9.8814, std.dev.: 0.0853) MultiSource/Applications/lua/lua: 2.70% (27.2391 => 27.9754, std.dev.: 0.0677) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.63% (1.7553 => 1.8015, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.42% (4.0951 => 4.1533, std.dev.: 0.0066) MultiSource/Applications/lemon/lemon: 1.40% (1.5541 => 1.5758, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.02% (4.3859 => 4.4305, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -13.41% (0.8275 => 0.7165, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -12.74% (0.7117 => 0.6210, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -12.72% (0.6614 => 0.5773, std.dev.: 0.0274) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -12.34% (0.7077 => 0.6204, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -12.22% (0.8202 => 0.7200, std.dev.: 0.0338) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -11.22% (0.4392 => 0.3899, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/fibo: -9.92% (0.3318 => 0.2989, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ks/ks: -9.87% (0.1905 => 0.1717, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -9.25% (0.2313 => 0.2099, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/distray/distray: -7.97% (0.1668 => 0.1535, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -7.12% (0.3594 => 0.3338, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -23.74% (2.0411 => 1.5565, std.dev.: 0.0905) MultiSource/Benchmarks/Ptrdist/ft/ft: -22.07% (1.6910 => 1.3178, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/heapsort: -12.19% (4.5725 => 4.0152, std.dev.: 0.1741) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -10.84% (18.5333 => 16.5236, std.dev.: 0.1430) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -8.09% (0.2486 => 0.2285, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.36% (3.3473 => 3.1344, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.33% (3.6527 => 3.6043, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.18% (2.1605 => 2.1351, std.dev.: 0.0031) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -1.62% (0.1360 => 0.1338, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.33% (0.0420 => 0.0476, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.26% (0.0680 => 0.0651, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: 0.06% (493.8936 => 494.1733, std.dev.: 0.1112) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.92% (4.3882 => 0.0476, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 43721.34% (1.1277 => 494.1733, std.dev.: 0.1112) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 217.46% (0.5229 => 1.6600, std.dev.: 0.0577) MultiSource/Applications/SPASS/SPASS: 21.87% (14.9895 => 18.2670, std.dev.: 0.1155) MultiSource/Applications/kimwitu++/kc: 51.92% (14.1553 => 21.5043, std.dev.: 0.0730) MultiSource/Benchmarks/MallocBench/gs/gs: 28.56% (4.1105 => 5.2845, std.dev.: 0.0590) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 39.34% (1.1048 => 1.5394, std.dev.: 0.0685) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 437.45% (7.1582 => 38.4721, std.dev.: 0.1189) SingleSource/Benchmarks/Misc-C++-EH/spirit: 86.82% (3.4629 => 6.4694, std.dev.: 0.2901) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.12% (0.6222 => 1.0834, std.dev.: 0.0522) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10653.33% (0.0720 => 7.7424, std.dev.: 0.2353) MultiSource/Applications/SIBsim4/SIBsim4: 3936400.00% (0.0001 => 3.9365, std.dev.: 0.0137) MultiSource/Applications/SPASS/SPASS: 14316400.00% (0.0001 => 14.3165, std.dev.: 0.7559) MultiSource/Applications/kimwitu++/kc: 52000.00% (0.0001 => 0.0521, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 64600.00% (0.0001 => 0.0647, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14500.00% (0.0001 => 0.0146, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 583400.00% (0.0001 => 0.5835, std.dev.: 0.0197) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10083900.00% (0.0001 => 10.0840, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5698100.00% (0.0001 => 5.6982, std.dev.: 0.7535) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1815.93% (1.1194 => 21.4469, std.dev.: 0.0709) MultiSource/Applications/ClamAV/clamscan: 71.53% (22.1758 => 38.0372, std.dev.: 0.0679) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 63.79% (2.9384 => 4.8127, std.dev.: 0.2335) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 58.70% (7.0540 => 11.1949, std.dev.: 0.0773) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 53.55% (8.1363 => 12.4932, std.dev.: 0.0179) SingleSource/Benchmarks/Misc/flops: 49.86% (0.1432 => 0.2146, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/almabench: 49.04% (0.0730 => 0.1088, std.dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 48.72% (21.9371 => 32.6251, std.dev.: 0.0535) MultiSource/Benchmarks/FreeBench/distray/distray: 45.36% (0.1056 => 0.1535, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Oscar: 37.89% (0.0636 => 0.0877, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 35.22% (0.2700 => 0.3651, std.dev.: 0.0046) MultiSource/Applications/lambda-0_1_3/lambda: 32.48% (0.7433 => 0.9847, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.83% (0.1236 => 0.1617, std.dev.: 0.0020) SingleSource/Benchmarks/Stanford/Towers: 30.79% (0.0471 => 0.0616, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/em3d/em3d: 30.15% (0.1695 => 0.2206, std.dev.: 0.0011) SingleSource/UnitTests/vla: 29.58% (0.0355 => 0.0460, std.dev.: 0.0039) MultiSource/Applications/Burg/burg: 29.27% (1.1642 => 1.5050, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/health/health: 28.39% (0.1268 => 0.1628, std.dev.: 0.0029) SingleSource/Benchmarks/Stanford/Queens: 28.26% (0.0414 => 0.0531, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 27.63% (1.1840 => 1.5111, std.dev.: 0.0027) MultiSource/Benchmarks/llubenchmark/llu: 27.49% (0.0462 => 0.0589, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 27.31% (0.1655 => 0.2107, std.dev.: 0.0046) SingleSource/Benchmarks/Stanford/Treesort: 27.25% (0.0411 => 0.0523, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: 26.88% (0.3307 => 0.4196, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 26.77% (1.5415 => 1.9541, std.dev.: 0.0066) SingleSource/Benchmarks/Stanford/FloatMM: 26.68% (0.0401 => 0.0508, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 26.65% (0.0394 => 0.0499, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 26.32% (0.0437 => 0.0552, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 26.26% (0.0457 => 0.0577, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/treeadd/treeadd: 25.96% (0.0416 => 0.0524, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.78% (0.1032 => 0.1298, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 25.76% (0.4615 => 0.5804, std.dev.: 0.0090) MultiSource/Applications/lemon/lemon: 25.56% (1.0722 => 1.3463, std.dev.: 0.0278) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 25.46% (0.0491 => 0.0616, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 25.41% (0.4620 => 0.5794, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 25.41% (0.5860 => 0.7349, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 25.40% (0.9765 => 1.2245, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/perimeter/perimeter: 25.32% (0.0770 => 0.0965, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 25.23% (0.8067 => 1.0102, std.dev.: 0.0094) MultiSource/Benchmarks/BitBench/five11/five11: 25.04% (0.0567 => 0.0709, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.80% (3.8922 => 4.8576, std.dev.: 0.0555) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.80% (0.0746 => 0.0931, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.68% (0.1337 => 0.1667, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 24.38% (0.0443 => 0.0551, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.74% (0.3121 => 0.3862, std.dev.: 0.0123) MultiSource/Applications/d/make_dparser: 23.44% (3.3354 => 4.1173, std.dev.: 0.0595) SingleSource/Benchmarks/Shootout-C++/ackermann: 23.37% (0.2756 => 0.3400, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 23.35% (14.3668 => 17.7214, std.dev.: 0.0235) SingleSource/Benchmarks/McGill/exptree: 23.22% (0.0814 => 0.1003, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wc: 22.74% (0.3052 => 0.3746, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 22.56% (0.6675 => 0.8181, std.dev.: 0.0277) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 22.55% (0.8101 => 0.9928, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/08-main/main: 22.51% (0.2554 => 0.3129, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/18-imp/imp: 22.35% (0.3423 => 0.4188, std.dev.: 0.0106) MultiSource/Applications/lua/lua: 22.21% (3.8723 => 4.7323, std.dev.: 0.1059) SingleSource/Benchmarks/Shootout-C++/lists1: 22.10% (0.3684 => 0.4498, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/neural/neural: 21.87% (0.1463 => 0.1783, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.46% (0.1906 => 0.2315, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: 21.44% (0.3092 => 0.3755, std.dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference: 21.40% (0.7326 => 0.8894, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/tsp/tsp: 21.19% (0.1175 => 0.1424, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.19% (0.1029 => 0.1247, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/bmm/bmm: 21.08% (0.0759 => 0.0919, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 20.82% (0.2430 => 0.2936, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.77% (0.1584 => 0.1913, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 20.68% (0.0798 => 0.0963, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.41% (0.1117 => 0.1345, std.dev.: 0.0065) SingleSource/Benchmarks/Stanford/Puzzle: 20.27% (0.1268 => 0.1525, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.94% (0.2758 => 0.3308, std.dev.: 0.0155) SingleSource/Benchmarks/McGill/misr: 19.43% (0.0633 => 0.0756, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: 19.43% (0.0592 => 0.0707, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 19.40% (0.3232 => 0.3859, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/heapsort: 19.32% (0.2872 => 0.3427, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.73% (0.8172 => 0.9703, std.dev.: 0.0311) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.49% (0.1125 => 0.1333, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 18.26% (0.0838 => 0.0991, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: 17.94% (17.1811 => 20.2627, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/moments: 17.76% (0.4048 => 0.4767, std.dev.: 0.0118) SingleSource/UnitTests/ObjC++/property-reference-object: 17.33% (0.6030 => 0.7075, std.dev.: 0.0207) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.22% (0.0871 => 0.1021, std.dev.: 0.0040) MultiSource/Applications/treecc/treecc: 16.81% (2.0273 => 2.3681, std.dev.: 0.1049) MultiSource/Benchmarks/mafft/pairlocalalign: 16.66% (9.4845 => 11.0650, std.dev.: 0.1392) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.66% (4.9449 => 5.7687, std.dev.: 0.0691) MultiSource/Applications/siod/siod: 16.50% (2.2969 => 2.6759, std.dev.: 0.1391) SingleSource/Benchmarks/Shootout-C++/ary3: 16.42% (0.3283 => 0.3822, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.32% (0.2065 => 0.2402, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.20% (0.0648 => 0.0753, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: 16.17% (0.0705 => 0.0819, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: 16.01% (0.0818 => 0.0949, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.95% (0.0953 => 0.1105, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.95% (0.0834 => 0.0967, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.80% (0.0886 => 0.1026, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.52% (1.3050 => 1.5075, std.dev.: 0.0677) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.36% (0.1940 => 0.2238, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/hash: 15.34% (0.4289 => 0.4947, std.dev.: 0.0255) MultiSource/Applications/viterbi/viterbi: 15.31% (0.1555 => 0.1793, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.27% (2.2022 => 2.5385, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.19% (0.2107 => 0.2427, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.06% (0.0770 => 0.0886, std.dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: 14.80% (63.2438 => 72.6045, std.dev.: 0.2726) MultiSource/Applications/minisat/minisat: 14.77% (0.7115 => 0.8166, std.dev.: 0.0339) SingleSource/Benchmarks/Shootout-C++/ary2: 14.53% (0.3379 => 0.3870, std.dev.: 0.0120) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.31% (4.2646 => 4.8747, std.dev.: 0.1019) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.22% (0.1062 => 0.1213, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.13% (0.5981 => 0.6826, std.dev.: 0.0253) SingleSource/UnitTests/ObjC/property: 14.02% (0.3886 => 0.4431, std.dev.: 0.0156) SingleSource/UnitTests/ObjC/trivial-interface: 13.96% (0.3473 => 0.3958, std.dev.: 0.0171) SingleSource/UnitTests/ObjC/synchronized: 13.96% (0.3561 => 0.4058, std.dev.: 0.0184) SingleSource/UnitTests/ObjC/exceptions-3: 13.91% (0.3516 => 0.4005, std.dev.: 0.0161) SingleSource/UnitTests/ObjC/exceptions-2: 13.73% (0.3497 => 0.3977, std.dev.: 0.0137) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.71% (0.1510 => 0.1717, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.66% (0.3543 => 0.4027, std.dev.: 0.0177) SingleSource/UnitTests/ObjC/exceptions-4: 13.63% (0.3543 => 0.4026, std.dev.: 0.0156) MultiSource/Benchmarks/PAQ8p/paq8p: 13.62% (10.3673 => 11.7798, std.dev.: 0.1076) SingleSource/UnitTests/ObjC/for-in: 13.59% (0.3694 => 0.4196, std.dev.: 0.0177) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.59% (5.0018 => 5.6813, std.dev.: 0.0705) SingleSource/Benchmarks/Shootout-C++/matrix: 13.52% (0.3098 => 0.3517, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.31% (0.3441 => 0.3899, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.29% (0.3865 => 0.4340, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.15% (0.4879 => 0.5472, std.dev.: 0.0065) MultiSource/Applications/hbd/hbd: 11.19% (1.5603 => 1.7349, std.dev.: 0.0303) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.94% (0.1892 => 0.2099, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.22% (1.4186 => 1.5636, std.dev.: 0.0368) SingleSource/Benchmarks/Shootout-C++/fibo: 9.69% (0.2725 => 0.2989, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.10% (7.9617 => 8.6067, std.dev.: 0.0939) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.67% (0.3427 => 0.3690, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.07% (0.3177 => 0.3338, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 151.32% (4.3953 => 11.0461, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 147.59% (5.3999 => 13.3696, std.dev.: 0.0045) MultiSource/Benchmarks/llubenchmark/llu: 132.09% (3.7781 => 8.7687, std.dev.: 0.1710) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 22.96% (13.4384 => 16.5236, std.dev.: 0.1430) MultiSource/Benchmarks/Olden/bisort/bisort: 21.92% (0.8333 => 1.0160, std.dev.: 0.0263) SingleSource/Benchmarks/CoyoteBench/lpbench: 20.26% (10.3460 => 12.4417, std.dev.: 0.2356) MultiSource/Applications/JM/ldecod/ldecod: 18.80% (0.1298 => 0.1542, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.80% (0.2944 => 0.3468, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 17.70% (6.6465 => 7.8226, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.25% (1.1145 => 1.3067, std.dev.: 0.0043) MultiSource/Applications/minisat/minisat: 16.89% (9.1159 => 10.6560, std.dev.: 0.5667) SingleSource/Benchmarks/Shootout-C++/hash2: 15.96% (3.1578 => 3.6619, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary: 15.48% (0.0756 => 0.0873, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.85% (8.6802 => 9.8824, std.dev.: 0.1188) MultiSource/Benchmarks/Olden/health/health: 12.73% (0.4445 => 0.5011, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/ffbench: 12.73% (0.9505 => 1.0715, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.68% (2.8904 => 3.2279, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 10.27% (1.1396 => 1.2566, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.31% (1.7254 => 1.8860, std.dev.: 0.0025) MultiSource/Applications/lemon/lemon: 8.98% (1.4460 => 1.5758, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/bh/bh: 8.37% (1.9405 => 2.1030, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/hash: 8.29% (4.9088 => 5.3157, std.dev.: 0.1016) SingleSource/Benchmarks/Shootout-C++/hash: 8.03% (0.7455 => 0.8054, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout/strcat: 7.48% (0.1899 => 0.2041, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 7.22% (26.0924 => 27.9754, std.dev.: 0.0677) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.07% (0.3070 => 0.3287, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.94% (0.9540 => 1.0107, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (4.2280 => 4.4602, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.15% (1.7133 => 1.8015, std.dev.: 0.0119) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 4.97% (0.2233 => 0.2344, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.76% (0.3463 => 0.3628, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.71% (3.6395 => 3.8111, std.dev.: 0.0328) MultiSource/Benchmarks/nbench/nbench: 4.12% (11.6436 => 12.1228, std.dev.: 0.0079) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.22% (2.1424 => 2.2114, std.dev.: 0.0189) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.65% (1.2838 => 1.3178, std.dev.: 0.0083) SingleSource/Benchmarks/Dhrystone/dry: 2.61% (2.4116 => 2.4745, std.dev.: 0.0060) MultiSource/Benchmarks/PAQ8p/paq8p: 2.24% (85.0658 => 86.9727, std.dev.: 0.1288) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 2.06% (3.1595 => 3.2245, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 2.02% (3.1023 => 3.1649, std.dev.: 0.0241) MultiSource/Benchmarks/mafft/pairlocalalign: 1.59% (27.8444 => 28.2858, std.dev.: 0.0416) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.58% (6.5088 => 6.6118, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/sieve: 1.49% (5.2139 => 5.2915, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0501, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 1.01% (2.2771 => 2.3002, std.dev.: 0.0073) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.28% (6.6874 => 0.1817, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/salsa20: -75.48% (0.8651 => 0.2121, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.00% (5.2763 => 1.3192, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/richards_benchmark: -45.07% (0.1622 => 0.0891, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.57% (5.3526 => 4.7335, std.dev.: 0.0773) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -9.83% (1.7609 => 1.5878, std.dev.: 0.0172) MultiSource/Applications/JM/ldecod/ldecod: -8.44% (10.4361 => 9.5557, std.dev.: 0.2992) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.56% (5.3855 => 5.0860, std.dev.: 0.0135) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.20% (0.0628 => 0.0363, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.06% (0.3987 => 0.2390, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.72% (0.0506 => 0.0305, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.35% (4.5009 => 2.7746, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7636, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.11% (2.6546 => 2.0145, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -23.69% (10.7105 => 8.1728, std.dev.: 0.3938) MultiSource/Benchmarks/FreeBench/mason/mason: -19.11% (0.2161 => 0.1748, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4224, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.67% (2.6778 => 2.2851, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.79% (32.5116 => 29.0022, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.49% (1.5660 => 1.4330, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.95% (4.8142 => 4.4797, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.2416 => 3.0210, std.dev.: 0.0260) MultiSource/Benchmarks/NPB-serial/is/is: -5.94% (9.5636 => 8.9954, std.dev.: 0.0270) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.88% (1.6805 => 1.5817, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5759, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7497, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.98% (1.5835 => 1.5046, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: -4.16% (6.2999 => 6.0380, std.dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.00% (19.9488 => 19.1516, std.dev.: 0.2428) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.25% (0.9957 => 0.9633, std.dev.: 0.0047) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8914, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.33% (0.4808 => 0.4696, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.13% (1.3861 => 1.3566, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.93% (8.1563 => 7.9991, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6774, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.45% (10.2830 => 10.1341, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0023) Report Time: 5.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 19:35:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 21:35:17 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121117033517.3C0A62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5957?compare_to=5953&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5957, Order: 168237, Start Time: 2012-11-17 02:02:26, End Time: 2012-11-17 03:35:37 To: 5953, Order: 168223, Start Time: 2012-11-17 00:10:07, End Time: 2012-11-17 01:44:31 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 3 (68 on baseline) Performance Improvements: 13 (21 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 978 (885 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 4.27% (1.0125 => 1.0557, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/methcall: 4.10% (8.6435 => 8.9983, std.dev.: 0.0256) SingleSource/Benchmarks/Linpack/linpack-pc: 1.19% (54.2778 => 54.9245, std.dev.: 0.0609) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -14.19% (17.6979 => 15.1865, std.dev.: 0.4097) MultiSource/Applications/SIBsim4/SIBsim4: -8.89% (1.4248 => 1.2981, std.dev.: 0.0457) MultiSource/Applications/sqlite3/sqlite3: -5.08% (16.2144 => 15.3915, std.dev.: 0.3169) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.90% (0.9285 => 0.9109, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.79% (0.8475 => 0.8323, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.35% (0.8384 => 0.8271, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.28% (0.9067 => 0.8951, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: -35.97% (1.3683 => 0.8761, std.dev.: 0.1874) MultiSource/Applications/SIBsim4/SIBsim4: -4.56% (3.5359 => 3.3748, std.dev.: 0.0469) MultiSource/Applications/sqlite3/sqlite3: -4.35% (4.6740 => 4.4707, std.dev.: 0.0561) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.48% (1.6271 => 1.6031, std.dev.: 0.0083) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (7.9341 => 7.8374, std.dev.: 0.0259) MultiSource/Benchmarks/PAQ8p/paq8p: -1.07% (92.8253 => 91.8309, std.dev.: 0.1723) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -3.41% (17.6037 => 17.0032, std.dev.: 1.7420) MultiSource/Applications/obsequi/Obsequi: -5.82% (1.1246 => 1.0592, std.dev.: 0.2914) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.25% (22.2081 => 22.2634, std.dev.: 0.1053) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.76% (0.3693 => 0.3665, std.dev.: 0.0527) SingleSource/Benchmarks/Misc-C++/bigfib: 1.69% (0.6085 => 0.6188, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.21% (0.3358 => 0.3365, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/strcat: 0.20% (0.2011 => 0.2015, std.dev.: 0.0624) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.45% (0.0220 => 0.0219, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.70% (0.0427 => 0.0430, std.dev.: 0.0120) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.05% (0.0341 => 0.0334, std.dev.: 0.0086) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.61% (0.0310 => 0.0315, std.dev.: 0.0105) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0427 => 0.0427, std.dev.: 0.0117) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0205 => 0.0205, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/test1: -1.35% (0.0223 => 0.0220, std.dev.: 0.0067) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -42.86% (0.0014 => 0.0008, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -2.74% (0.1535 => 0.1493, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -30.45% (1.7105 => 1.1897, std.dev.: 0.1244) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.09% (0.4301 => 0.4168, std.dev.: 0.0713) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.93% (0.1366 => 0.1406, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.94% (0.0657 => 0.0618, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.25% (0.0262 => 0.0243, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.87% (0.0596 => 0.0567, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.72% (1.2187 => 1.1977, std.dev.: 0.0710) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.09% (0.0585 => 0.0644, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 29.73% (0.0185 => 0.0240, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.07% (0.7723 => 0.7806, std.dev.: 0.0211) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -21.52% (0.0079 => 0.0062, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2330.75% (0.6332 => 15.3915, std.dev.: 0.3169) MultiSource/Benchmarks/McCat/08-main/main: 50.90% (0.1831 => 0.2763, std.dev.: 0.0241) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.45% (0.1559 => 0.1474, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1573.71% (0.3344 => 5.5969, std.dev.: 0.2618) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.41% (0.2364 => 0.3272, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/mandel: 3.03% (0.0429 => 0.0442, std.dev.: 0.0165) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.34% (0.0224 => 0.0227, std.dev.: 0.0018) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0058) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 12.45% (0.1462 => 0.1644, std.dev.: 0.0124) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4707, std.dev.: 0.0561) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0723, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4911, std.dev.: 0.0167) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3388, std.dev.: 0.0702) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1601, std.dev.: 0.0762) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4311, std.dev.: 0.0116) SingleSource/Regression/C/uint64_to_float: -24.47% (2.1832 => 1.6490, std.dev.: 0.0634) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 12.41% (0.1112 => 0.1250, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.51% (0.8321 => 0.8863, std.dev.: 0.0149) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.41% (0.1885 => 0.1987, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.18% (0.4783 => 0.4935, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.00% (0.9069 => 0.9341, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.91% (0.8697 => 0.8950, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.72% (0.8050 => 0.8269, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.70% (0.8716 => 0.8951, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.69% (1.4479 => 1.4869, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.69% (4.4880 => 4.6087, std.dev.: 0.0290) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.60% (0.8457 => 0.8677, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.56% (0.9039 => 0.9270, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.46% (0.9074 => 0.9297, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.42% (0.8007 => 0.8201, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.42% (0.8805 => 0.9018, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.40% (0.8069 => 0.8263, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.38% (0.9908 => 1.0144, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 2.37% (2.3764 => 2.4328, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.36% (0.8331 => 0.8528, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.36% (0.8317 => 0.8513, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.35% (0.8518 => 0.8718, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.34% (0.8066 => 0.8255, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.33% (0.8611 => 0.8812, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.33% (0.7932 => 0.8117, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.29% (0.8086 => 0.8271, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.24% (0.8286 => 0.8472, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.21% (0.8204 => 0.8385, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.18% (0.8855 => 0.9048, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.17% (0.7966 => 0.8139, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.16% (0.8656 => 0.8843, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.11% (0.8359 => 0.8535, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.08% (0.8712 => 0.8893, std.dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: 2.05% (8.6247 => 8.8013, std.dev.: 0.0650) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.04% (0.8927 => 0.9109, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.04% (0.8885 => 0.9066, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.82% (0.8420 => 0.8573, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.79% (0.8177 => 0.8323, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.76% (0.8338 => 0.8485, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 124.62% (0.0199 => 0.0447, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/pi: 58.02% (1.5795 => 2.4960, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.51% (0.7597 => 0.8851, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.13% (2.9753 => 3.4553, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.70% (2.7995 => 3.2111, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.48% (5.0261 => 5.6030, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.75% (6.3772 => 6.9355, std.dev.: 0.1634) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.35% (0.3186 => 0.3452, std.dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.83% (1.1857 => 1.2785, std.dev.: 0.0199) SingleSource/Benchmarks/McGill/queens: 7.47% (1.7056 => 1.8330, std.dev.: 0.0370) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.65% (4.7794 => 5.0970, std.dev.: 0.0055) MultiSource/Applications/SIBsim4/SIBsim4: 5.88% (3.1873 => 3.3748, std.dev.: 0.0469) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.85% (4.5327 => 4.7979, std.dev.: 0.0290) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.72% (4.9686 => 5.2529, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.73% (6.2275 => 6.5218, std.dev.: 0.0122) MultiSource/Applications/lambda-0_1_3/lambda: 4.59% (7.4933 => 7.8374, std.dev.: 0.0259) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.59% (3.3761 => 3.5310, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.12% (4.9453 => 5.1489, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.01% (4.9469 => 5.1452, std.dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: 3.94% (14.0064 => 14.5579, std.dev.: 0.0576) MultiSource/Applications/siod/siod: 3.39% (3.6643 => 3.7884, std.dev.: 0.0275) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.28% (0.5889 => 0.6082, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.86% (11.5690 => 11.8997, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.52% (8.2783 => 8.4866, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.30% (4.8660 => 4.9777, std.dev.: 0.0300) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.26% (4.8362 => 4.9456, std.dev.: 0.0291) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.87% (1.1365 => 1.1578, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: 1.37% (8.5322 => 8.6495, std.dev.: 0.0304) MultiSource/Benchmarks/Olden/power/power: 1.34% (1.2061 => 1.2223, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/neural/neural: 1.32% (1.0841 => 1.0984, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.15% (5.4641 => 4.3085, std.dev.: 0.0328) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.23% (7.2130 => 6.3307, std.dev.: 0.0250) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.73% (1.0512 => 0.9384, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.61% (14.6451 => 13.2371, std.dev.: 0.1334) MultiSource/Benchmarks/mafft/pairlocalalign: -8.51% (63.1822 => 57.8074, std.dev.: 0.1465) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.89% (4.7482 => 4.4209, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.97% (3.7148 => 3.4930, std.dev.: 0.0150) SingleSource/Benchmarks/McGill/chomp: -5.88% (1.1216 => 1.0557, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.82% (5.4972 => 5.1772, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.21% (5.1557 => 4.8869, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.56% (2.8773 => 2.7461, std.dev.: 0.0218) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.40% (4.7449 => 4.5360, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.66% (6.0224 => 5.8017, std.dev.: 0.0801) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.01% (28.5821 => 27.7230, std.dev.: 0.0523) SingleSource/Benchmarks/Shootout-C++/hash2: -2.32% (3.4237 => 3.3444, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.16% (9.9065 => 9.6921, std.dev.: 0.0494) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.03% (11.5316 => 11.2980, std.dev.: 0.0021) MultiSource/Applications/aha/aha: -1.95% (3.3398 => 3.2748, std.dev.: 0.0141) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.66% (2.3487 => 2.3097, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.60% (4.9994 => 4.9192, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.15% (5.6343 => 5.5695, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 3.39% (16.4461 => 17.0032, std.dev.: 1.7420) MultiSource/Applications/obsequi/Obsequi: 3.22% (1.0262 => 1.0592, std.dev.: 0.2914) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7028.85% (0.3123 => 22.2634, std.dev.: 0.1053) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.80% (0.2463 => 0.3665, std.dev.: 0.0527) SingleSource/Benchmarks/Misc-C++/bigfib: 2.96% (0.6010 => 0.6188, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.03% (0.3266 => 0.3365, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/strcat: 2.34% (0.1969 => 0.2015, std.dev.: 0.0624) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.39% (0.0408 => 0.0430, std.dev.: 0.0120) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.50% (0.0254 => 0.0334, std.dev.: 0.0086) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0105) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.20% (0.0384 => 0.0427, std.dev.: 0.0117) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/test1: 22.22% (0.0180 => 0.0220, std.dev.: 0.0067) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 3.82% (0.1438 => 0.1493, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 5.01% (1.1329 => 1.1897, std.dev.: 0.1244) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.10% (0.4164 => 0.4168, std.dev.: 0.0713) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.70% (0.1369 => 0.1406, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.59% (0.0641 => 0.0618, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 24.62% (0.0195 => 0.0243, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.90% (0.0578 => 0.0567, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.72% (1.1437 => 1.1977, std.dev.: 0.0710) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.71% (0.0627 => 0.0644, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 33.33% (0.0180 => 0.0240, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.63% (0.8017 => 0.7806, std.dev.: 0.0211) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0062 => 0.0062, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 19:55:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 21:55:48 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121117035548.BEFCB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5958?compare_to=5954&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5958, Order: 168240, Start Time: 2012-11-17 02:23:07, End Time: 2012-11-17 03:56:09 To: 5954, Order: 168223, Start Time: 2012-11-17 00:25:34, End Time: 2012-11-17 01:58:38 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (184 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1044 (854 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.13% (2.0478 => 2.1119, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: 2.43% (7.4937 => 7.6756, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/hash2: 1.99% (3.1932 => 3.2566, std.dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.40% (0.3821 => 0.3500, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.00% (0.3142 => 0.2922, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.94% (0.3357 => 0.3124, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: -6.81% (2.4924 => 2.3227, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.67% (0.2428 => 0.2266, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.67% (0.9542 => 0.8906, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.50% (0.1584 => 0.1481, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -6.48% (0.2160 => 0.2020, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.46% (0.1796 => 0.1680, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.34% (0.9852 => 0.9227, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.33% (0.2355 => 0.2206, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: -6.30% (0.1761 => 0.1650, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.22% (0.6484 => 0.6081, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: -6.20% (0.9179 => 0.8610, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.18% (0.1716 => 0.1610, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: -6.17% (7.0961 => 6.6582, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: -6.15% (16.1920 => 15.1960, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.15% (1.0544 => 0.9896, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -6.14% (9.2283 => 8.6616, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/trivial-interface: -6.09% (0.3812 => 0.3580, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -6.07% (0.1879 => 0.1765, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.01% (4.0323 => 3.7899, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.01% (0.2695 => 0.2533, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: -6.00% (0.4033 => 0.3791, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.99% (0.3658 => 0.3439, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.98% (1.3722 => 1.2901, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.96% (0.5805 => 0.5459, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: -5.95% (0.3831 => 0.3603, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.92% (6.7716 => 6.3704, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/synchronized: -5.90% (0.3896 => 0.3666, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.90% (0.3880 => 0.3651, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.90% (0.3884 => 0.3655, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.89% (0.3891 => 0.3662, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.88% (4.8161 => 4.5327, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: -5.87% (4.3330 => 4.0785, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.87% (0.6681 => 0.6289, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -5.87% (0.4176 => 0.3931, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.86% (0.6736 => 0.6341, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.86% (1.4642 => 1.3784, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: -5.84% (1.1450 => 1.0781, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.83% (0.6230 => 0.5867, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.83% (0.6660 => 0.6272, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -5.83% (0.4515 => 0.4252, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.82% (1.2300 => 1.1584, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.82% (0.6052 => 0.5700, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.82% (4.8802 => 4.5964, std.dev.: 0.0090) MultiSource/Benchmarks/sim/sim: -5.81% (0.3406 => 0.3208, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.81% (3.5339 => 3.3287, std.dev.: 0.0113) SingleSource/UnitTests/ObjC/exceptions-3: -5.80% (0.3848 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.80% (0.5591 => 0.5267, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: -5.79% (1.1530 => 1.0862, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -5.79% (0.4199 => 0.3956, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.78% (4.5069 => 4.2464, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.76% (1.6364 => 1.5422, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.74% (0.7198 => 0.6785, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.73% (0.5859 => 0.5523, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.73% (0.7919 => 0.7465, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.73% (0.5863 => 0.5527, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -5.73% (0.2985 => 0.2814, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.72% (0.5802 => 0.5470, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.70% (0.5857 => 0.5523, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.70% (0.5478 => 0.5166, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -5.69% (1.2515 => 1.1803, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.65% (1.2784 => 1.2062, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.65% (0.6676 => 0.6299, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.64% (0.6260 => 0.5907, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.63% (0.6395 => 0.6035, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.63% (0.5705 => 0.5384, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.61% (0.5575 => 0.5262, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.61% (0.7524 => 0.7102, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.57% (0.8521 => 0.8046, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.57% (0.5688 => 0.5371, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.57% (0.7339 => 0.6930, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.56% (0.6667 => 0.6296, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -5.53% (0.3581 => 0.3383, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.52% (0.5925 => 0.5598, std.dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: -5.51% (1.3864 => 1.3100, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.51% (0.5849 => 0.5527, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.50% (14.2083 => 13.4265, std.dev.: 0.0145) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.49% (0.4916 => 0.4646, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.49% (1.2221 => 1.1550, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.48% (0.3483 => 0.3292, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.48% (0.5456 => 0.5157, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.46% (1.2210 => 1.1543, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.46% (0.5569 => 0.5265, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.46% (0.2548 => 0.2409, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.45% (0.6446 => 0.6095, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -5.44% (0.4280 => 0.4047, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.43% (0.5581 => 0.5278, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.43% (0.6395 => 0.6048, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -5.42% (17.1032 => 16.1770, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.40% (0.5941 => 0.5620, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.36% (0.2278 => 0.2156, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/08-main/main: -5.34% (0.2659 => 0.2517, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.32% (0.5567 => 0.5271, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.30% (0.6033 => 0.5713, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -5.30% (3.5154 => 3.3290, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.30% (0.2999 => 0.2840, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.28% (0.5570 => 0.5276, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.26% (0.6440 => 0.6101, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.26% (0.6293 => 0.5962, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.26% (8.0126 => 7.5915, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.22% (0.5999 => 0.5686, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: -5.21% (15.5079 => 14.7002, std.dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: -5.12% (15.2527 => 14.4720, std.dev.: 0.0388) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.09% (0.3319 => 0.3150, std.dev.: 0.0010) MultiSource/Applications/lua/lua: -5.08% (4.0594 => 3.8531, std.dev.: 0.0090) MultiSource/Applications/minisat/minisat: -5.06% (0.7447 => 0.7070, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -5.04% (2.4021 => 2.2811, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.03% (0.2385 => 0.2265, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.01% (1.6474 => 1.5648, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.99% (0.5168 => 0.4910, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -4.91% (2.1401 => 2.0350, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.89% (0.2106 => 0.2003, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.86% (0.6194 => 0.5893, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -4.82% (0.7982 => 0.7597, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.81% (0.6304 => 0.6001, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.79% (0.7021 => 0.6685, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -4.77% (0.3271 => 0.3115, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.75% (0.6297 => 0.5998, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.75% (0.5329 => 0.5076, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -4.75% (1.3148 => 1.2524, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: -4.74% (5.0226 => 4.7845, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.72% (0.6189 => 0.5897, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.67% (0.4151 => 0.3957, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -4.62% (0.8418 => 0.8029, std.dev.: 0.0111) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.58% (22.4056 => 21.3792, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: -4.45% (0.3255 => 0.3110, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.42% (0.9077 => 0.8676, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: -4.42% (18.2933 => 17.4856, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.39% (2.2587 => 2.1595, std.dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: -4.33% (34.0927 => 32.6176, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.25% (0.3931 => 0.3764, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/objinst: -4.23% (0.3194 => 0.3059, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.22% (0.3837 => 0.3675, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.22% (0.3057 => 0.2928, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.21% (0.4321 => 0.4139, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.21% (0.3016 => 0.2889, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -4.20% (0.3025 => 0.2898, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -4.20% (0.4861 => 0.4657, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -4.19% (0.4248 => 0.4070, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.18% (0.3323 => 0.3184, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.18% (0.3849 => 0.3688, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.18% (0.3252 => 0.3116, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.17% (0.9557 => 0.9158, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.12% (2.1713 => 2.0818, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: -4.12% (0.2939 => 0.2818, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.09% (0.2933 => 0.2813, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.04% (0.2871 => 0.2755, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -4.03% (0.3446 => 0.3307, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.03% (0.6347 => 0.6091, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.03% (0.4813 => 0.4619, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: -4.01% (0.2989 => 0.2869, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -4.00% (0.3026 => 0.2905, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.00% (0.2903 => 0.2787, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -3.98% (0.3394 => 0.3259, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -3.97% (0.2849 => 0.2736, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -3.96% (0.3059 => 0.2938, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -3.94% (0.6441 => 0.6187, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -3.93% (0.3867 => 0.3715, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -3.86% (0.7779 => 0.7479, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -3.81% (0.3621 => 0.3483, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.75% (0.4427 => 0.4261, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.75% (0.4083 => 0.3930, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -3.74% (0.3205 => 0.3085, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -3.71% (0.3481 => 0.3352, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.61% (0.3491 => 0.3365, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -3.60% (0.6750 => 0.6507, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.44% (5.4682 => 5.2799, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: -3.41% (0.3788 => 0.3659, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.27% (1.5610 => 1.5099, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: -3.12% (0.4524 => 0.4383, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.03% (20.7746 => 20.3521, std.dev.: 0.0490) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7504, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/richards_benchmark: -8.74% (1.2842 => 1.1719, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.80% (2.2633 => 2.1772, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.97% (1.3096 => 1.2838, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4688, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 21:24:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 23:24:43 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121117052443.DC33A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5959?compare_to=5957&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5959, Order: 168245, Start Time: 2012-11-17 03:53:56, End Time: 2012-11-17 05:25:03 To: 5957, Order: 168237, Start Time: 2012-11-17 02:02:26, End Time: 2012-11-17 03:35:37 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 6 (99 on baseline) Performance Improvements: 10 (22 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 978 (853 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 6.15% (0.3253 => 0.3453, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.03% (1.2528 => 1.2782, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.87% (4.5986 => 4.6847, std.dev.: 0.0185) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 20.19% (0.0525 => 0.0631, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.24% (2.3932 => 2.5904, std.dev.: 0.0456) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.35% (1.2528 => 1.2697, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.69% (5.5969 => 5.4463, std.dev.: 0.0205) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -20.38% (3.8260 => 3.0464, std.dev.: 0.2702) SingleSource/Benchmarks/Shootout-C++/ackermann: -14.20% (4.3934 => 3.7694, std.dev.: 0.0573) SingleSource/Benchmarks/McGill/chomp: -5.43% (1.0557 => 0.9984, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -2.53% (0.6082 => 0.5928, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/richards_benchmark: -1.93% (1.4109 => 1.3837, std.dev.: 0.0069) MultiSource/Benchmarks/llubenchmark/llu: -1.55% (2.0286 => 1.9971, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/whetstone: -1.34% (2.1528 => 2.1239, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/lists: -1.31% (16.9685 => 16.7459, std.dev.: 0.0290) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.19% (1.4695 => 1.4520, std.dev.: 0.0032) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.08% (17.0032 => 16.9903, std.dev.: 0.3325) MultiSource/Applications/obsequi/Obsequi: 1.60% (1.0592 => 1.0761, std.dev.: 0.0204) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.69% (22.2634 => 22.1096, std.dev.: 0.7702) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.63% (0.3665 => 0.3688, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/bigfib: -1.00% (0.6188 => 0.6126, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.12% (0.3365 => 0.3361, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/strcat: -0.05% (0.2015 => 0.2014, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.91% (0.0219 => 0.0221, std.dev.: 0.0077) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0430 => 0.0431, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0334 => 0.0334, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -5.40% (0.0315 => 0.0298, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.23% (0.0427 => 0.0428, std.dev.: 0.0134) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0205 => 0.0205, std.dev.: 0.0062) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0220 => 0.0220, std.dev.: 0.0074) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 62.50% (0.0008 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.40% (0.1493 => 0.1499, std.dev.: 0.0083) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -4.59% (1.1897 => 1.1351, std.dev.: 0.3643) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.59% (0.4168 => 0.4276, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.40% (0.1406 => 0.1510, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.46% (0.0618 => 0.0609, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -16.87% (0.0243 => 0.0202, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.47% (0.0567 => 0.0553, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.89% (1.1977 => 1.1870, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -38.71% (0.0031 => 0.0019, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.89% (0.0644 => 0.0561, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.33% (0.0240 => 0.0248, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.70% (0.7806 => 0.7861, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -12.90% (0.0062 => 0.0054, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2365.07% (0.6332 => 15.6088, std.dev.: 0.3192) MultiSource/Benchmarks/McCat/08-main/main: 49.21% (0.1831 => 0.2732, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.40% (0.1559 => 0.1506, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1528.68% (0.3344 => 5.4463, std.dev.: 0.0205) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.96% (0.2364 => 0.3285, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: 0.93% (0.0429 => 0.0433, std.dev.: 0.0038) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.59% (0.0224 => 0.0241, std.dev.: 0.0045) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0054) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 9.44% (0.1462 => 0.1600, std.dev.: 0.0219) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4736, std.dev.: 0.0532) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0676, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4865, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3157, std.dev.: 0.0150) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1355, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3996, std.dev.: 0.0160) SingleSource/Regression/C/uint64_to_float: -24.26% (2.1832 => 1.6536, std.dev.: 0.0025) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.49% (0.0773 => 0.0885, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 13.58% (0.1112 => 0.1263, std.dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.07% (0.3137 => 0.3453, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.89% (0.1425 => 0.1566, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.86% (0.8148 => 0.8870, std.dev.: 0.0185) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.32% (0.8321 => 0.9013, std.dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.30% (0.7473 => 0.8093, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.29% (0.4847 => 0.5249, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.07% (0.2279 => 0.2463, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.87% (0.2998 => 0.3204, std.dev.: 0.0079) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.35% (0.1983 => 0.2109, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.35% (0.2519 => 0.2679, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.04% (0.3295 => 0.3494, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.93% (0.3003 => 0.3181, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.92% (0.6287 => 0.6659, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.81% (0.2133 => 0.2257, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.59% (0.9435 => 0.9962, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.57% (1.1606 => 1.2252, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.26% (0.5817 => 0.6123, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.84% (1.1685 => 1.2250, std.dev.: 0.0128) MultiSource/Applications/lua/lua: 4.73% (3.8189 => 3.9997, std.dev.: 0.0418) MultiSource/Benchmarks/MallocBench/gs/gs: 4.45% (4.1305 => 4.3144, std.dev.: 0.0203) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.40% (4.4873 => 4.6847, std.dev.: 0.0185) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.23% (6.6074 => 6.8872, std.dev.: 0.0257) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.17% (0.4127 => 0.4299, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.12% (0.2741 => 0.2854, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.95% (4.1763 => 4.3412, std.dev.: 0.0402) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.91% (0.4783 => 0.4970, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.89% (1.6386 => 1.7024, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.83% (0.2794 => 0.2901, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.73% (1.2526 => 1.2993, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.65% (1.4479 => 1.5008, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.60% (0.8697 => 0.9010, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.58% (8.6476 => 8.9574, std.dev.: 0.0066) MultiSource/Benchmarks/sim/sim: 3.47% (0.3226 => 0.3338, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.47% (0.3115 => 0.3223, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.38% (0.8340 => 0.8622, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.34% (0.6227 => 0.6435, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.28% (0.3717 => 0.3839, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/18-imp/imp: 3.05% (0.3503 => 0.3610, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.05% (0.8177 => 0.8426, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.03% (0.7932 => 0.8172, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.01% (0.9074 => 0.9347, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.99% (0.8805 => 0.9068, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.93% (4.5702 => 4.7039, std.dev.: 0.0461) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.92% (0.8457 => 0.8704, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.89% (1.2423 => 1.2782, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.83% (0.8317 => 0.8552, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.81% (0.8050 => 0.8276, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.72% (0.5191 => 0.5332, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.69% (0.9908 => 1.0175, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.69% (0.8359 => 0.8584, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.66% (0.8712 => 0.8944, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.63% (0.4559 => 0.4679, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.61% (0.9069 => 0.9306, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.58% (0.8286 => 0.8500, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.51% (0.8927 => 0.9151, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.50% (0.8885 => 0.9107, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.48% (0.8518 => 0.8729, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.38% (0.8261 => 0.8458, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.34% (0.8420 => 0.8617, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.31% (0.6586 => 0.6738, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 2.30% (0.8768 => 0.8970, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.24% (0.8656 => 0.8850, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.20% (1.2602 => 1.2879, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.16% (0.8855 => 0.9046, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 90.45% (0.0199 => 0.0379, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/pi: 57.77% (1.5795 => 2.4920, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 19.51% (0.0528 => 0.0631, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.82% (0.7597 => 0.8875, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.14% (2.9753 => 3.4555, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.42% (2.7995 => 3.2031, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.58% (5.0261 => 5.6081, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.98% (0.3186 => 0.3472, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.89% (1.1857 => 1.2792, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 7.18% (1.7056 => 1.8280, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.91% (6.3772 => 6.8178, std.dev.: 0.1493) MultiSource/Applications/SIBsim4/SIBsim4: 6.39% (3.1873 => 3.3909, std.dev.: 0.0732) SingleSource/Benchmarks/Misc/richards_benchmark: 6.14% (1.3037 => 1.3837, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.89% (4.5327 => 4.7997, std.dev.: 0.1027) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.84% (4.9686 => 5.2590, std.dev.: 0.0091) MultiSource/Applications/lambda-0_1_3/lambda: 4.74% (7.4933 => 7.8487, std.dev.: 0.0575) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.68% (3.3761 => 3.5341, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.60% (6.2275 => 6.5138, std.dev.: 0.0600) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.18% (4.9453 => 5.1518, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.07% (4.9469 => 5.1480, std.dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: 3.92% (14.0064 => 14.5560, std.dev.: 0.0370) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.81% (0.2887 => 0.2997, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.15% (0.3587 => 0.3700, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 2.76% (3.6643 => 3.7654, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.75% (11.5690 => 11.8874, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.31% (4.8660 => 4.9784, std.dev.: 0.0239) SingleSource/Benchmarks/Shootout/lists: 2.23% (7.3375 => 7.5011, std.dev.: 0.0361) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.13% (1.1365 => 1.1607, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.79% (1.2474 => 1.2697, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/power/power: 1.41% (1.2061 => 1.2231, std.dev.: 0.0027) SingleSource/Benchmarks/Stanford/FloatMM: 1.33% (0.8807 => 0.8924, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.23% (2.4647 => 2.4950, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.18% (3.5679 => 3.6099, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.24% (5.4641 => 4.3033, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.72% (7.2130 => 6.2958, std.dev.: 0.3236) SingleSource/Benchmarks/McGill/chomp: -10.98% (1.1216 => 0.9984, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.98% (1.0512 => 0.9358, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.96% (14.6451 => 13.3323, std.dev.: 0.2789) MultiSource/Benchmarks/mafft/pairlocalalign: -8.55% (63.1822 => 57.7771, std.dev.: 0.3121) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -7.02% (4.7482 => 4.4151, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.24% (0.3269 => 0.3065, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.96% (3.7148 => 3.4935, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.86% (5.4972 => 5.1748, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.09% (5.1557 => 4.8933, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.50% (2.8773 => 2.7478, std.dev.: 0.0410) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.33% (4.7449 => 4.5394, std.dev.: 0.0397) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.85% (2.4490 => 2.3547, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.81% (3.9188 => 3.7694, std.dev.: 0.0573) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.79% (6.0224 => 5.7941, std.dev.: 0.0209) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.04% (28.5821 => 27.7139, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash2: -2.29% (3.4237 => 3.3453, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.03% (11.5316 => 11.2974, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.60% (4.9994 => 4.9196, std.dev.: 0.0202) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.49% (2.3487 => 2.3137, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.18% (5.6343 => 5.5677, std.dev.: 0.0053) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 3.31% (16.4461 => 16.9903, std.dev.: 0.3325) MultiSource/Applications/obsequi/Obsequi: 4.86% (1.0262 => 1.0761, std.dev.: 0.0204) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6979.60% (0.3123 => 22.1096, std.dev.: 0.7702) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.74% (0.2463 => 0.3688, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/bigfib: 1.93% (0.6010 => 0.6126, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.91% (0.3266 => 0.3361, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/strcat: 2.29% (0.1969 => 0.2014, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 79.67% (0.0123 => 0.0221, std.dev.: 0.0077) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.64% (0.0408 => 0.0431, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.50% (0.0254 => 0.0334, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.32% (0.0302 => 0.0298, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.46% (0.0384 => 0.0428, std.dev.: 0.0134) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0062) SingleSource/UnitTests/Vector/Altivec/test1: 22.22% (0.0180 => 0.0220, std.dev.: 0.0074) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 4.24% (0.1438 => 0.1499, std.dev.: 0.0083) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.19% (1.1329 => 1.1351, std.dev.: 0.3643) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.69% (0.4164 => 0.4276, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.30% (0.1369 => 0.1510, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.99% (0.0641 => 0.0609, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.59% (0.0195 => 0.0202, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.33% (0.0578 => 0.0553, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.79% (1.1437 => 1.1870, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1800.00% (0.0001 => 0.0019, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.53% (0.0627 => 0.0561, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 37.78% (0.0180 => 0.0248, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.95% (0.8017 => 0.7861, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -12.90% (0.0062 => 0.0054, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 21:51:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 16 Nov 2012 23:51:14 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121117055114.0CE1C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5960?compare_to=5958&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5960, Order: 168249, Start Time: 2012-11-17 04:18:53, End Time: 2012-11-17 05:51:33 To: 5958, Order: 168240, Start Time: 2012-11-17 02:23:07, End Time: 2012-11-17 03:56:09 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (174 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1043 (863 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.35% (77.7379 => 81.8969, std.dev.: 0.3790) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.73% (79.7170 => 81.8969, std.dev.: 0.3790) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1012, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: 2.37% (7.4937 => 7.6712, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/hash2: 2.24% (3.1932 => 3.2647, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.60% (0.1431 => 0.1308, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.30% (0.3821 => 0.3504, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.75% (0.3142 => 0.2930, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -6.67% (0.3357 => 0.3133, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.67% (2.4924 => 2.3261, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.67% (0.2428 => 0.2266, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.48% (0.9542 => 0.8924, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -6.20% (0.2160 => 0.2026, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -6.13% (9.2283 => 8.6623, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.12% (0.1796 => 0.1686, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -6.08% (16.1920 => 15.2072, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.01% (0.6484 => 0.6094, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.00% (0.9852 => 0.9261, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -5.97% (7.0961 => 6.6728, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.95% (0.7198 => 0.6770, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: -5.93% (0.9179 => 0.8635, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.91% (1.0544 => 0.9921, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.86% (0.2355 => 0.2217, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.82% (0.3658 => 0.3445, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.74% (0.1761 => 0.1660, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.74% (1.3722 => 1.2935, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -5.68% (4.3330 => 4.0869, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.68% (0.2695 => 0.2542, std.dev.: 0.0044) MultiSource/Applications/lemon/lemon: -5.67% (1.1450 => 1.0801, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.65% (3.5339 => 3.3343, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.64% (1.6364 => 1.5441, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.63% (4.0323 => 3.8054, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.61% (1.2300 => 1.1610, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.58% (0.3406 => 0.3216, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.58% (6.7716 => 6.3940, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.56% (1.4642 => 1.3828, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.54% (4.8161 => 4.5491, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.50% (4.5069 => 4.2592, std.dev.: 0.0107) MultiSource/Applications/Burg/burg: -5.48% (1.2515 => 1.1829, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.46% (4.8802 => 4.6135, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.45% (0.6736 => 0.6369, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -5.45% (17.1032 => 16.1714, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.44% (0.7919 => 0.7488, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: -5.43% (1.1530 => 1.0904, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.41% (14.2083 => 13.4394, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.41% (0.6230 => 0.5893, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.40% (0.8521 => 0.8061, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -5.39% (0.2985 => 0.2824, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.39% (0.5805 => 0.5492, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.39% (1.2784 => 1.2095, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.39% (0.6681 => 0.6321, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.39% (0.6293 => 0.5954, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: -5.33% (1.3864 => 1.3125, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.31% (0.5591 => 0.5294, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.29% (0.5478 => 0.5188, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.29% (0.5802 => 0.5495, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.27% (0.6395 => 0.6058, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.26% (0.2548 => 0.2414, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.26% (0.5859 => 0.5551, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.26% (0.6260 => 0.5931, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.25% (0.6052 => 0.5734, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.24% (0.5575 => 0.5283, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.22% (0.5705 => 0.5407, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: -5.22% (0.3581 => 0.3394, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.21% (0.7339 => 0.6957, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (0.5857 => 0.5553, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.19% (0.2659 => 0.2521, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.19% (0.5863 => 0.5559, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.18% (0.6676 => 0.6330, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.18% (0.5925 => 0.5618, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.15% (0.5688 => 0.5395, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.15% (0.5999 => 0.5690, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.14% (0.3483 => 0.3304, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: -5.14% (0.4515 => 0.4283, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.13% (0.5456 => 0.5176, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.13% (0.6667 => 0.6325, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.13% (0.5849 => 0.5549, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.11% (1.2221 => 1.1596, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.10% (0.7524 => 0.7140, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.10% (0.2999 => 0.2846, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.09% (1.2210 => 1.1589, std.dev.: 0.0030) MultiSource/Applications/d/make_dparser: -5.07% (3.5154 => 3.3370, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.07% (0.5581 => 0.5298, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.07% (0.6395 => 0.6071, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.03% (0.5569 => 0.5289, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.01% (0.6446 => 0.6123, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.00% (0.2278 => 0.2164, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.99% (8.0126 => 7.6126, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.99% (0.5570 => 0.5292, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.98% (0.4916 => 0.4671, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.97% (0.6033 => 0.5733, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.97% (0.5941 => 0.5646, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.90% (0.5567 => 0.5294, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -4.90% (15.2527 => 14.5053, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.90% (1.6474 => 1.5667, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.89% (0.6440 => 0.6125, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -4.89% (15.5079 => 14.7495, std.dev.: 0.0077) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.88% (0.3319 => 0.3157, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: -4.86% (0.7447 => 0.7085, std.dev.: 0.0014) MultiSource/Applications/lua/lua: -4.85% (4.0594 => 3.8625, std.dev.: 0.0020) MultiSource/Applications/siod/siod: -4.79% (2.4021 => 2.2871, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/trivial-interface: -4.77% (0.3812 => 0.3630, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.74% (0.4033 => 0.3842, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.70% (0.2385 => 0.2273, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: -4.66% (2.1401 => 2.0403, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.64% (0.5168 => 0.4928, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.62% (22.4056 => 21.3697, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: -4.62% (0.4176 => 0.3983, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.59% (0.3896 => 0.3717, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.58% (0.3884 => 0.3706, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.57% (0.3831 => 0.3656, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.54% (0.3880 => 0.3704, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.52% (0.3891 => 0.3715, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.52% (0.3848 => 0.3674, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.50% (0.5329 => 0.5089, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.49% (0.7021 => 0.6706, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.47% (0.6194 => 0.5917, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -4.43% (0.7982 => 0.7628, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: -4.43% (5.0226 => 4.7999, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -4.38% (0.4199 => 0.4015, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.35% (0.6304 => 0.6030, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.30% (0.6297 => 0.6026, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.28% (0.6189 => 0.5924, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -4.28% (0.3271 => 0.3131, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.24% (2.2587 => 2.1629, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: -4.24% (0.8418 => 0.8061, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.23% (0.4280 => 0.4099, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -4.23% (1.3148 => 1.2592, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.10% (0.4151 => 0.3981, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.08% (0.9077 => 0.8707, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -4.07% (34.0927 => 32.7063, std.dev.: 0.0060) MultiSource/Applications/kimwitu++/kc: -3.97% (18.2933 => 17.5669, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/matrix: -3.93% (0.3255 => 0.3127, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.82% (0.9557 => 0.9192, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.78% (0.3016 => 0.2902, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -3.77% (0.4248 => 0.4088, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.76% (0.3931 => 0.3783, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.75% (0.3837 => 0.3693, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: -3.69% (0.3194 => 0.3076, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -3.67% (0.3026 => 0.2915, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.66% (0.3849 => 0.3708, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -3.64% (0.3025 => 0.2915, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.63% (0.3252 => 0.3134, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: -3.54% (0.3867 => 0.3730, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -3.52% (0.4861 => 0.4690, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.51% (0.4813 => 0.4644, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.49% (0.3491 => 0.3369, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.49% (2.1713 => 2.0956, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: -3.43% (0.3059 => 0.2954, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -3.41% (0.2989 => 0.2887, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.38% (0.4321 => 0.4175, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: -3.36% (0.3394 => 0.3280, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.34% (0.3057 => 0.2955) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.32% (0.4427 => 0.4280, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.29% (1.5610 => 1.5097, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.28% (5.4682 => 5.2887, std.dev.: 0.0165) SingleSource/Benchmarks/Misc-C++/bigfib: -3.27% (0.6750 => 0.6529, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: -3.25% (0.3446 => 0.3334, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -3.23% (0.3621 => 0.3504, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -3.22% (0.3481 => 0.3369, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.18% (0.4083 => 0.3953, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -3.18% (0.3205 => 0.3103, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -3.12% (0.6441 => 0.6240, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: -3.12% (0.6347 => 0.6149, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -2.85% (0.7779 => 0.7557, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash: -2.67% (0.4524 => 0.4403, std.dev.: 0.0047) SingleSource/UnitTests/Vector/constpool: -2.59% (20.7746 => 20.2374, std.dev.: 0.0207) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7516, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7067, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.80% (2.2633 => 2.1774, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.24% (1.3096 => 1.2802, std.dev.: 0.0078) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.49% (6.5735 => 6.4757, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Report Time: 2.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 22:22:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 00:22:37 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121117062237.0D7B02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5961?compare_to=5956&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5961, Order: 168245, Start Time: 2012-11-17 04:02:42, End Time: 2012-11-17 06:22:56 To: 5956, Order: 168223, Start Time: 2012-11-17 00:51:36, End Time: 2012-11-17 03:11:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 62 (148 on baseline) Performance Improvements: 27 (38 on baseline) Added Tests: 0 (136 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 951 (701 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 16.75% (0.6866 => 0.8016, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 16.68% (0.6206 => 0.7241, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 16.33% (0.6204 => 0.7217, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.31% (0.1171 => 0.1362, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 16.14% (0.7200 => 0.8362, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 16.03% (0.6862 => 0.7962, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 15.96% (0.6267 => 0.7267, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.74% (0.5904 => 0.6833, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.66% (0.6154 => 0.7118, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 15.42% (0.5773 => 0.6663, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 15.41% (0.6210 => 0.7167, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.29% (0.6587 => 0.7594, std.dev.: 0.0204) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 15.25% (0.7165 => 0.8258, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 15.24% (0.6705 => 0.7727, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 15.19% (0.6142 => 0.7075, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout/lists: 14.38% (0.0730 => 0.0835, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.29% (0.4184 => 0.4782, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/except: 13.80% (0.3145 => 0.3579, std.dev.: 0.0099) SingleSource/UnitTests/ObjC/BoolLiteralTest: 13.21% (0.4080 => 0.4619, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: 13.02% (0.0891 => 0.1007, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 12.44% (0.2967 => 0.3336, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 12.32% (0.0828 => 0.0930, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 11.78% (0.3142 => 0.3512, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.76% (0.4193 => 0.4686, std.dev.: 0.0120) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.66% (0.1913 => 0.2136, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/lists: 11.54% (0.3804 => 0.4243, std.dev.: 0.0088) MultiSource/Applications/minisat/minisat: 11.43% (0.8166 => 0.9099, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/ReedSolomon: 11.41% (0.2191 => 0.2441, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.29% (0.4340 => 0.4830, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.24% (0.5634 => 0.6267, std.dev.: 0.0177) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.85% (0.1907 => 0.2114, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/fibo: 10.71% (0.2989 => 0.3309, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.54% (1.5878 => 1.7552, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/mst/mst: 10.27% (0.1353 => 0.1492, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.05% (0.7162 => 0.7882, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.67% (0.2099 => 0.2302, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.93% (1.5636 => 1.7033, std.dev.: 0.0390) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.75% (0.3338 => 0.3630, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.66% (0.2402 => 0.2610, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.56% (0.4053 => 0.4400, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.53% (0.5792 => 0.6286, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.52% (0.8588 => 0.9234, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-2: 6.99% (0.3977 => 0.4255, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.69% (4.7335 => 5.0504, std.dev.: 0.0122) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.04% (0.9703 => 1.0289, std.dev.: 0.0085) SingleSource/UnitTests/Vector/constpool: 5.76% (53.1043 => 56.1613, std.dev.: 0.8993) SingleSource/UnitTests/ObjC/exceptions-3: 5.69% (0.4005 => 0.4233, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.43% (5.6813 => 5.9899, std.dev.: 0.0868) MultiSource/Applications/lua/lua: 3.81% (4.7323 => 4.9127, std.dev.: 0.0348) MultiSource/Applications/SPASS/SPASS: 1.42% (18.2670 => 18.5265, std.dev.: 0.0604) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 28.38% (3.8472 => 4.9391, std.dev.: 0.0768) MultiSource/Benchmarks/VersaBench/dbms/dbms: 28.21% (1.5565 => 1.9956, std.dev.: 0.0277) SingleSource/Benchmarks/Shootout-C++/ary3: 28.04% (3.8311 => 4.9055, std.dev.: 0.0660) MultiSource/Benchmarks/Olden/mst/mst: 13.59% (0.1317 => 0.1496, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.15% (1.7392 => 1.9505, std.dev.: 0.0321) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.12% (3.1344 => 3.3261, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.94% (6.2737 => 6.5834, std.dev.: 0.0281) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.51% (4.3247 => 4.4764, std.dev.: 0.0269) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.17% (4.2381 => 4.3725, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.57% (5.3915 => 5.4759, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.42% (3.0210 => 3.0639, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.33% (2.1351 => 2.1636, std.dev.: 0.0080) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -13.17% (0.6855 => 0.5952, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -12.46% (0.7117 => 0.6230, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -12.23% (0.7628 => 0.6695, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -11.39% (0.7837 => 0.6944, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: -11.34% (1.5111 => 1.3398, std.dev.: 0.0395) MultiSource/Benchmarks/Olden/bh/bh: -10.65% (0.3755 => 0.3355, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -10.63% (0.5794 => 0.5178, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -10.28% (1.9541 => 1.7532, std.dev.: 0.0207) SingleSource/Benchmarks/Stanford/Puzzle: -7.67% (0.1525 => 0.1408, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.52% (0.2315 => 0.2141, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: -7.32% (0.2146 => 0.1989, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: -6.83% (0.4188 => 0.3902, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -5.51% (0.7075 => 0.6685, std.dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.88% (8.6067 => 8.2727, std.dev.: 0.0851) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.24% (21.4469 => 21.1820, std.dev.: 0.0337) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -7.59% (9.8824 => 9.1327, std.dev.: 0.1354) SingleSource/Benchmarks/Shootout/hash: -7.30% (5.3157 => 4.9279, std.dev.: 0.1370) SingleSource/Benchmarks/Misc/ffbench: -7.26% (1.0715 => 0.9937, std.dev.: 0.0301) MultiSource/Benchmarks/Olden/bh/bh: -6.99% (2.1030 => 1.9559, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/hash: -5.66% (0.8054 => 0.7598, std.dev.: 0.0109) MultiSource/Benchmarks/NPB-serial/is/is: -4.63% (8.9954 => 8.5793, std.dev.: 0.1556) MultiSource/Applications/lua/lua: -3.84% (27.9754 => 26.9012, std.dev.: 0.0484) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -3.48% (4.8596 => 4.6907, std.dev.: 0.0652) SingleSource/Benchmarks/Shootout-C++/ackermann: -2.84% (1.8015 => 1.7503, std.dev.: 0.0153) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -2.09% (1.6059 => 1.5723, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.00% (6.7597 => 6.6919, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.00% (4.4305 => 4.3861, std.dev.: 0.0098) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1338 => 0.1338, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -11.76% (0.0476 => 0.0420, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0651 => 0.0652, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 0.02% (494.1733 => 494.2689, std.dev.: 0.0591) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/power/power: 43729.82% (1.1277 => 494.2689, std.dev.: 0.0591) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 196.37% (0.5229 => 1.5497, std.dev.: 0.0946) MultiSource/Applications/SPASS/SPASS: 23.60% (14.9895 => 18.5265, std.dev.: 0.0604) MultiSource/Applications/kimwitu++/kc: 53.46% (14.1553 => 21.7228, std.dev.: 0.1331) MultiSource/Benchmarks/MallocBench/gs/gs: 22.93% (4.1105 => 5.0529, std.dev.: 0.0940) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.42% (1.1048 => 1.5182, std.dev.: 0.0881) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 439.19% (7.1582 => 38.5966, std.dev.: 0.1851) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.27% (3.4629 => 6.3811, std.dev.: 0.1592) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.49% (0.6222 => 1.0359, std.dev.: 0.0380) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11034.17% (0.0720 => 8.0166, std.dev.: 0.1396) MultiSource/Applications/SIBsim4/SIBsim4: 3925000.00% (0.0001 => 3.9251, std.dev.: 0.0165) MultiSource/Applications/SPASS/SPASS: 14443100.00% (0.0001 => 14.4432, std.dev.: 0.2958) MultiSource/Applications/kimwitu++/kc: 53500.00% (0.0001 => 0.0536, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 581800.00% (0.0001 => 0.5819, std.dev.: 0.0194) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10094400.00% (0.0001 => 10.0945, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5683600.00% (0.0001 => 5.6837, std.dev.: 0.9242) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1792.26% (1.1194 => 21.1820, std.dev.: 0.0337) MultiSource/Applications/ClamAV/clamscan: 69.90% (22.1758 => 37.6772, std.dev.: 0.0910) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 59.70% (7.0540 => 11.2655, std.dev.: 0.1384) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.86% (2.9384 => 4.6387, std.dev.: 0.2933) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 52.28% (8.1363 => 12.3903, std.dev.: 0.0439) MultiSource/Applications/JM/lencod/lencod: 48.61% (21.9371 => 32.6018, std.dev.: 0.0805) MultiSource/Benchmarks/FreeBench/distray/distray: 46.02% (0.1056 => 0.1542, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/flops: 38.90% (0.1432 => 0.1989, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 38.77% (0.0730 => 0.1013, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/dot-syntax-1: 35.91% (0.0479 => 0.0651, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 34.99% (0.1566 => 0.2114, std.dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 34.85% (0.1584 => 0.2136, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/lists: 33.39% (0.0626 => 0.0835, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 32.38% (0.2554 => 0.3381, std.dev.: 0.0122) SingleSource/UnitTests/vla: 30.70% (0.0355 => 0.0464, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 30.46% (0.1044 => 0.1362, std.dev.: 0.0057) MultiSource/Benchmarks/BitBench/five11/five11: 30.34% (0.0567 => 0.0739, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/dot-syntax: 29.58% (0.0355 => 0.0460, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/mst/mst: 28.29% (0.1163 => 0.1492, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 27.91% (0.4615 => 0.5903, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 27.88% (0.7115 => 0.9099, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.74% (0.0793 => 0.1013, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/tsp/tsp: 27.66% (0.1175 => 0.1500, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.40% (0.0730 => 0.0930, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 26.92% (0.0442 => 0.0561, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 26.87% (3.8723 => 4.9127, std.dev.: 0.0348) MultiSource/Applications/lambda-0_1_3/lambda: 26.58% (0.7433 => 0.9409, std.dev.: 0.0298) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 26.41% (0.0886 => 0.1120, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 26.39% (0.2065 => 0.2610, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.91% (0.8172 => 1.0289, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.60% (0.0746 => 0.0937, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 24.99% (0.3826 => 0.4782, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 24.97% (0.3865 => 0.4830, std.dev.: 0.0127) MultiSource/Benchmarks/Olden/bisort/bisort: 24.92% (0.0614 => 0.0767, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/functionobjects: 24.84% (0.5020 => 0.6267, std.dev.: 0.0177) SingleSource/Benchmarks/Stanford/Oscar: 24.69% (0.0636 => 0.0793, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/except: 24.66% (0.2871 => 0.3579, std.dev.: 0.0099) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.10% (0.0834 => 0.1035, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 23.99% (0.3422 => 0.4243, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 23.14% (14.3668 => 17.6908, std.dev.: 0.0478) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 23.13% (0.5105 => 0.6286, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/hello: 22.92% (0.2714 => 0.3336, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.60% (0.1062 => 0.1302, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 22.07% (0.2877 => 0.3512, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-2: 21.68% (0.3497 => 0.4255, std.dev.: 0.0107) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 21.67% (0.1892 => 0.2302, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sieve: 21.54% (0.3603 => 0.4379, std.dev.: 0.0169) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 21.45% (0.0648 => 0.0787, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/fibo: 21.43% (0.2725 => 0.3309, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/exceptions-3: 20.39% (0.3516 => 0.4233, std.dev.: 0.0040) MultiSource/Applications/oggenc/oggenc: 20.08% (5.7591 => 6.9157, std.dev.: 0.1848) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 20.07% (1.4186 => 1.7033, std.dev.: 0.0390) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.78% (0.2700 => 0.3234, std.dev.: 0.0188) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.75% (5.0018 => 5.9899, std.dev.: 0.0868) MultiSource/Benchmarks/MallocBench/espresso/espresso: 19.61% (4.2646 => 5.1009, std.dev.: 0.0973) MultiSource/Benchmarks/Ptrdist/bc/bc: 19.32% (1.1861 => 1.4153, std.dev.: 0.0481) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.20% (0.1125 => 0.1341, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/exceptions: 19.15% (0.3828 => 0.4561, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/ReedSolomon: 19.13% (0.2049 => 0.2441, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.09% (0.3935 => 0.4686, std.dev.: 0.0120) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.65% (0.0842 => 0.0999, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: 18.11% (17.1811 => 20.2927, std.dev.: 0.0375) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 17.94% (0.8101 => 0.9554, std.dev.: 0.0229) MultiSource/Benchmarks/mafft/pairlocalalign: 17.57% (9.4845 => 11.1507, std.dev.: 0.2815) MultiSource/Applications/treecc/treecc: 17.47% (2.0273 => 2.3814, std.dev.: 0.0941) MultiSource/Applications/Burg/burg: 17.09% (1.1642 => 1.3632, std.dev.: 0.0733) SingleSource/UnitTests/ObjC/exceptions-4: 16.91% (0.3543 => 0.4142, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 16.67% (0.0672 => 0.0784, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 16.64% (0.1268 => 0.1479, std.dev.: 0.0075) MultiSource/Applications/spiff/spiff: 16.34% (0.7835 => 0.9115, std.dev.: 0.0431) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.03% (0.1029 => 0.1194, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.96% (0.3121 => 0.3619, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.84% (0.0770 => 0.0892, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.76% (0.1117 => 0.1293, std.dev.: 0.0054) MultiSource/Benchmarks/NPB-serial/is/is: 15.44% (0.0719 => 0.0830, std.dev.: 0.0036) MultiSource/Applications/hbd/hbd: 15.39% (1.5603 => 1.8005, std.dev.: 0.0762) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.37% (0.2758 => 0.3182, std.dev.: 0.0151) SingleSource/UnitTests/ObjC/block-byref-aggr: 15.27% (0.3817 => 0.4400, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.19% (0.2107 => 0.2427, std.dev.: 0.0101) MultiSource/Benchmarks/Bullet/bullet: 14.84% (63.2438 => 72.6306, std.dev.: 0.3344) MultiSource/Benchmarks/PAQ8p/paq8p: 14.79% (10.3673 => 11.9004, std.dev.: 0.1431) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.61% (0.3307 => 0.3790, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.33% (0.5981 => 0.6838, std.dev.: 0.0247) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 14.26% (0.3177 => 0.3630, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.09% (4.9449 => 5.6418, std.dev.: 0.1819) MultiSource/Benchmarks/McCat/18-imp/imp: 13.99% (0.3423 => 0.3902, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.99% (0.1337 => 0.1524, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.73% (1.5415 => 1.7532, std.dev.: 0.0207) SingleSource/UnitTests/ObjC/trivial-interface: 13.56% (0.3473 => 0.3944, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/property: 13.54% (0.3886 => 0.4412, std.dev.: 0.0199) SingleSource/UnitTests/ObjC/synchronized: 13.45% (0.3561 => 0.4040, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.40% (0.0933 => 0.1058, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 13.16% (1.1840 => 1.3398, std.dev.: 0.0395) SingleSource/Benchmarks/Misc/oourafft: 13.01% (0.3282 => 0.3709, std.dev.: 0.0081) SingleSource/UnitTests/ObjC/for-in: 12.99% (0.3694 => 0.4174, std.dev.: 0.0182) MultiSource/Benchmarks/McCat/09-vor/vor: 12.67% (0.3180 => 0.3583, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/hash: 12.43% (0.4289 => 0.4822, std.dev.: 0.0206) MultiSource/Benchmarks/McCat/05-eks/eks: 12.42% (0.4299 => 0.4833, std.dev.: 0.0138) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.33% (0.1906 => 0.2141, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 12.08% (0.4620 => 0.5178, std.dev.: 0.0130) MultiSource/Benchmarks/Olden/power/power: 11.88% (0.1440 => 0.1611, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.36% (2.2022 => 2.4524, std.dev.: 0.0536) SingleSource/Benchmarks/Stanford/Puzzle: 11.04% (0.1268 => 0.1408, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.00% (0.4636 => 0.5146, std.dev.: 0.0185) SingleSource/UnitTests/ObjC++/property-reference-object: 10.86% (0.6030 => 0.6685, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.77% (0.3650 => 0.4043, std.dev.: 0.0096) SingleSource/UnitTests/ObjC++/Hello: 10.72% (0.5925 => 0.6560, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/bh/bh: 8.51% (0.3092 => 0.3355, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.91% (7.9617 => 8.2727, std.dev.: 0.0851) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.49% (4.3953 => 11.0098, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/methcall: 147.73% (5.3999 => 13.3773, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/ary3: 33.51% (3.6994 => 4.9391, std.dev.: 0.0768) MultiSource/Benchmarks/VersaBench/dbms/dbms: 32.28% (1.5086 => 1.9956, std.dev.: 0.0277) SingleSource/Benchmarks/Shootout-C++/ary3: 31.79% (3.7221 => 4.9055, std.dev.: 0.0660) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 28.80% (13.4384 => 17.3080, std.dev.: 0.6017) SingleSource/Benchmarks/Misc/oourafft: 17.46% (6.6465 => 7.8070, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.83% (1.1145 => 1.3021, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/mst/mst: 16.42% (0.1285 => 0.1496, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 14.08% (9.1159 => 10.3997, std.dev.: 0.1564) MultiSource/Applications/JM/ldecod/ldecod: 13.64% (0.1298 => 0.1475, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.04% (0.2944 => 0.3328, std.dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.65% (2.8904 => 3.2271, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.89% (3.8532 => 4.2729, std.dev.: 0.1490) SingleSource/Benchmarks/Misc/richards_benchmark: 10.28% (1.1396 => 1.2568, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: 10.28% (1.0785 => 1.1894, std.dev.: 0.0426) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.35% (1.7254 => 1.8867, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones/fhourstones: 6.42% (1.8329 => 1.9505, std.dev.: 0.0321) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.15% (3.1334 => 3.3261, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.96% (0.9540 => 1.0109, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.90% (4.2280 => 4.4775, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 5.21% (8.6802 => 9.1327, std.dev.: 0.1354) SingleSource/Regression/C/uint64_to_float: 5.10% (0.5413 => 0.5689, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.6436 => 12.1313, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.34% (0.4162 => 0.4301, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 3.10% (26.0924 => 26.9012, std.dev.: 0.0484) MultiSource/Benchmarks/Olden/em3d/em3d: 2.92% (3.1023 => 3.1928, std.dev.: 0.0290) SingleSource/Benchmarks/Dhrystone/dry: 2.66% (2.4116 => 2.4757, std.dev.: 0.0140) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.61% (2.1424 => 2.1983, std.dev.: 0.0172) MultiSource/Benchmarks/PAQ8p/paq8p: 2.27% (85.0658 => 86.9976, std.dev.: 0.1190) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.16% (1.3677 => 1.3972, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 2.07% (3.1595 => 3.2250, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 1.47% (27.8444 => 28.2537, std.dev.: 0.0477) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.31% (6.5088 => 6.5942, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/sieve: 1.29% (5.2139 => 5.2811, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0313 => 1.0441, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 1.19% (5.9798 => 6.0507, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1681, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.73% (5.2763 => 1.2277, std.dev.: 0.0481) SingleSource/Benchmarks/Misc/salsa20: -74.41% (0.8651 => 0.2214, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: -37.92% (0.1622 => 0.1007, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.26% (5.3855 => 4.7251, std.dev.: 0.1418) MultiSource/Applications/JM/ldecod/ldecod: -8.47% (10.4361 => 9.5521, std.dev.: 0.2165) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.65% (5.3526 => 5.0504, std.dev.: 0.0122) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.92% (0.0506 => 0.0304, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.90% (0.3987 => 0.2396, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.32% (4.5009 => 2.7762, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -28.67% (10.7105 => 7.6402, std.dev.: 0.6848) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.15% (2.6546 => 2.0134, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/mason/mason: -19.11% (0.2161 => 0.1748, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.64% (1.6925 => 1.4278, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2840, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.69% (32.5116 => 29.0363, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/mandel-2: -10.62% (1.5373 => 1.3741, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -10.29% (9.5636 => 8.5793, std.dev.: 0.1556) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4244, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.59% (2.7294 => 2.5769, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.48% (3.2416 => 3.0639, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -4.94% (1.5835 => 1.5052, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: -4.20% (6.2999 => 6.0352, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: -3.09% (5.0483 => 4.8921, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.38% (19.9488 => 19.4748, std.dev.: 0.1478) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.31% (0.4808 => 0.4697, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.85% (8.1563 => 8.0053, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6774, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.49% (10.2830 => 10.1294, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0013) Report Time: 2.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 22:36:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 00:36:12 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121117063612.2B3132A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5962?compare_to=5955&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5962, Order: 168241, Start Time: 2012-11-17 03:17:03, End Time: 2012-11-17 06:36:29 To: 5955, Order: 168208, Start Time: 2012-11-16 23:09:48, End Time: 2012-11-17 02:29:00 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (173 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (136 on baseline) Unchanged Tests: 1042 (717 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 25.72% (0.4187 => 0.5264, std.dev.: 0.0253) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.42% (2.7821 => 2.8217, std.dev.: 0.0091) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 38.72% (0.0625 => 0.0867, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.23% (0.1063 => 0.1395, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.22% (0.4253 => 0.5368, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.70% (0.2969 => 0.3732, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.50% (0.1106 => 0.1388, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.35% (0.0714 => 0.0895, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.81% (0.4139 => 0.5166, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 24.56% (0.0452 => 0.0563, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.92% (0.5900 => 0.7311, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 23.86% (1.5932 => 1.9733, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.59% (0.4994 => 0.6172, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.95% (0.0584 => 0.0718, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.86% (0.5000 => 0.6143, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.74% (0.0475 => 0.0583, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.49% (0.0547 => 0.0670, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.10% (0.1620 => 0.1978, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.94% (0.1021 => 0.1245, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.63% (0.0897 => 0.1091, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.50% (0.1107 => 0.1345, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 20.57% (0.0948 => 0.1143, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.56% (0.0642 => 0.0774, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.55% (0.3903 => 0.4705, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.31% (0.1103 => 0.1327, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.26% (0.1604 => 0.1929, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.21% (0.0584 => 0.0702, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 20.10% (0.0821 => 0.0986, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.07% (0.0822 => 0.0987, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.94% (0.1003 => 0.1203, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 19.77% (0.1619 => 0.1939, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.69% (0.1549 => 0.1854, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 19.54% (0.0604 => 0.0722) MultiSource/Benchmarks/Olden/mst/mst: 19.20% (0.0698 => 0.0832, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 18.94% (0.0808 => 0.0961, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 18.80% (0.0947 => 0.1125, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.74% (0.1462 => 0.1736, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.60% (0.2736 => 0.3245, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.35% (0.3890 => 0.4604, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.22% (0.2014 => 0.2381, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 18.17% (0.4029 => 0.4761, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: 18.14% (0.1218 => 0.1439, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.91% (1.3152 => 1.5507, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.90% (0.2866 => 0.3379, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.52% (0.0605 => 0.0711, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 17.51% (0.5826 => 0.6846, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.46% (0.1088 => 0.1278, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 17.34% (0.1505 => 0.1766, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: 17.29% (0.1284 => 0.1506, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.24% (0.3271 => 0.3835, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 17.24% (0.5889 => 0.6904, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 17.13% (0.5546 => 0.6496, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.11% (3.5627 => 4.1722, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.07% (0.4658 => 0.5453, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.85% (1.6211 => 1.8942, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 16.82% (1.8794 => 2.1955, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.62% (0.1968 => 0.2295, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.36% (0.3930 => 0.4573, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.34% (0.5026 => 0.5847, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.31% (0.2875 => 0.3344, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.29% (0.1160 => 0.1349, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 16.19% (0.1421 => 0.1651, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 16.16% (0.9697 => 1.1264, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.13% (4.4195 => 5.1324, std.dev.: 0.0061) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.05% (2.7292 => 3.1672, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.03% (0.4361 => 0.5060, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 15.93% (1.0781 => 1.2498, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 15.86% (0.7171 => 0.8308, std.dev.: 0.0068) MultiSource/Applications/ClamAV/clamscan: 15.59% (4.2109 => 4.8674, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/strcat: 15.45% (0.2750 => 0.3175, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 15.40% (0.2780 => 0.3208, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 15.30% (0.2823 => 0.3255, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 15.29% (0.2714 => 0.3129, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 15.25% (0.3004 => 0.3462, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.23% (0.2738 => 0.3155, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.21% (0.2729 => 0.3144) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.19% (0.3488 => 0.4018, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 15.19% (0.2725 => 0.3139, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 15.19% (0.2811 => 0.3238, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 15.16% (0.2803 => 0.3228, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.15% (0.2911 => 0.3352, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.09% (0.3195 => 0.3677, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 15.08% (0.2075 => 0.2388, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.08% (1.9694 => 2.2663, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.04% (0.2792 => 0.3212, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 14.93% (0.2813 => 0.3233, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.78% (1.9966 => 2.2917, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.78% (2.0673 => 2.3728, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.77% (0.1090 => 0.1251, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 14.74% (0.9909 => 1.1370, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 14.71% (23.5202 => 26.9809, std.dev.: 0.0208) SingleSource/Benchmarks/Shootout-C++/wc: 14.70% (0.3096 => 0.3551, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/for-in: 14.62% (0.3496 => 0.4007, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: 14.57% (0.3446 => 0.3948, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 14.55% (0.3465 => 0.3969, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.54% (0.3460 => 0.3963, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.49% (0.3362 => 0.3849, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.47% (0.3469 => 0.3971, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 14.44% (0.3442 => 0.3939, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 14.38% (0.2566 => 0.2935, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 14.36% (0.3267 => 0.3736, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 14.27% (0.3258 => 0.3723, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 14.16% (0.2691 => 0.3072, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 14.12% (1.4269 => 1.6284, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 14.08% (0.3650 => 0.4164, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 14.08% (0.3317 => 0.3784, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 14.03% (0.3643 => 0.4154, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.95% (0.3060 => 0.3487, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/moments: 13.87% (0.3678 => 0.4188, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.86% (0.3282 => 0.3737, std.dev.: 0.0054) MultiSource/Applications/treecc/treecc: 13.79% (0.7875 => 0.8961, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: 13.77% (0.4146 => 0.4717, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.76% (0.3124 => 0.3554, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 13.75% (0.3724 => 0.4236, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 13.72% (0.0758 => 0.0862, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 13.63% (0.3477 => 0.3951, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 13.53% (0.3348 => 0.3801, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 13.36% (2.1653 => 2.4546, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/sieve: 13.31% (0.3726 => 0.4222, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.24% (0.3625 => 0.4105, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 13.19% (4.6177 => 5.2267, std.dev.: 0.0132) MultiSource/Benchmarks/mafft/pairlocalalign: 13.17% (2.1013 => 2.3781, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.06% (0.3690 => 0.4172, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.94% (0.2040 => 0.2304, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 12.91% (0.4251 => 0.4800, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.86% (0.3981 => 0.4493, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.80% (0.1383 => 0.1560, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.80% (0.3845 => 0.4337, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 12.19% (0.5012 => 0.5623, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 11.76% (5.5417 => 6.1933, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.11% (0.6435 => 0.7150, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 10.95% (0.3498 => 0.3881, std.dev.: 0.0019) MultiSource/Applications/siod/siod: 10.67% (0.6634 => 0.7342, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.51% (0.1028 => 0.1136, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 10.48% (0.4847 => 0.5355, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.25% (0.2068 => 0.2280, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.12% (0.2737 => 0.3014, std.dev.: 0.0093) MultiSource/Applications/sqlite3/sqlite3: 9.89% (2.0346 => 2.2359, std.dev.: 0.0044) MultiSource/Applications/lemon/lemon: 9.70% (0.2391 => 0.2623, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.63% (0.3084 => 0.3381, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 9.62% (0.3336 => 0.3657, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.22% (0.2103 => 0.2297, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.15% (0.5361 => 0.5798, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.12% (4.6926 => 5.0738, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.83% (11.6398 => 12.5511, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.63% (0.5584 => 0.6010, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.30% (0.7426 => 0.7968, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 6.22% (11.9555 => 12.6997, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.04% (0.3792 => 0.3983, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.26% (0.0734 => 0.0868, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 9.39% (0.2802 => 0.3065, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6094, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 5.66% (0.2122 => 0.2242, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.42% (0.3693 => 0.3893, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6727, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1706, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-2: 4.66% (1.8057 => 1.8899, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6384, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1975, std.dev.: 0.0074) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2221, std.dev.: 0.0037) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3020, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2874, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5140, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5871, std.dev.: 0.0185) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.03% (2.4764 => 2.4510, std.dev.: 0.0083) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.78% (25.4195 => 16.5791, std.dev.: 0.0065) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9775, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8014, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary2: -7.41% (0.2402 => 0.2224, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/tsp/tsp: -7.20% (2.1113 => 1.9592, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8020, std.dev.: 0.0131) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.78% (0.6293 => 0.6118, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/fldry: -2.36% (17.2379 => 16.8311, std.dev.: 0.0632) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8642, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5698, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4980, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.18% (105.3826 => 104.1424, std.dev.: 0.0919) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0470, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 3.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 23:13:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 01:13:55 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121117071355.12E122A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5963?compare_to=5959&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5963, Order: 168253, Start Time: 2012-11-17 05:43:23, End Time: 2012-11-17 07:14:15 To: 5959, Order: 168245, Start Time: 2012-11-17 03:53:56, End Time: 2012-11-17 05:25:03 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 5 (91 on baseline) Performance Improvements: 2 (25 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 987 (858 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/spiff/spiff: 1.69% (0.8409 => 0.8551, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: 41.02% (38.9409 => 54.9146, std.dev.: 0.2647) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.34% (1.4978 => 1.8774, std.dev.: 0.0119) MultiSource/Applications/sgefa/sgefa: 3.71% (0.3479 => 0.3608, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.17% (8.4034 => 8.5014, std.dev.: 0.0164) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sqlite3/sqlite3: -1.92% (15.6088 => 15.3086, std.dev.: 0.1062) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.35% (1.2782 => 1.2610, std.dev.: 0.0012) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.04% (16.9903 => 16.9833, std.dev.: 0.1464) MultiSource/Applications/obsequi/Obsequi: -1.61% (1.0761 => 1.0588, std.dev.: 0.0337) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.29% (22.1096 => 22.1728, std.dev.: 1.4308) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.22% (0.3688 => 0.3696, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 0.18% (0.6126 => 0.6137, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.3361 => 0.3361, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 0.79% (0.2014 => 0.2030, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.90% (0.0221 => 0.0219, std.dev.: 0.0083) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.70% (0.0431 => 0.0428, std.dev.: 0.0157) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.90% (0.0334 => 0.0331, std.dev.: 0.0095) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.70% (0.0298 => 0.0315, std.dev.: 0.0104) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.47% (0.0428 => 0.0426, std.dev.: 0.0127) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0205 => 0.0205, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/test1: -11.82% (0.0220 => 0.0194, std.dev.: 0.0037) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.67% (0.1499 => 0.1489, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.53% (1.1351 => 1.1291, std.dev.: 0.0214) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.06% (0.4276 => 0.4188, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.91% (0.1510 => 0.1451, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.76% (0.0609 => 0.0638, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 35.64% (0.0202 => 0.0274, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.36% (0.0553 => 0.0551, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.60% (1.1870 => 1.1941, std.dev.: 0.0301) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 63.16% (0.0019 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 15.15% (0.0561 => 0.0646, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.24% (0.0248 => 0.0173, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.28% (0.7861 => 0.7839, std.dev.: 0.1370) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 124.07% (0.0054 => 0.0121, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2317.66% (0.6332 => 15.3086, std.dev.: 0.1062) MultiSource/Benchmarks/McCat/08-main/main: 50.74% (0.1831 => 0.2760, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.39% (0.1559 => 0.1475, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1536.30% (0.3344 => 5.4718, std.dev.: 0.4019) SingleSource/Benchmarks/Misc-C++/Large/ray: 40.06% (0.2364 => 0.3311, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/mandel: 4.43% (0.0429 => 0.0448, std.dev.: 0.0011) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.70% (0.0224 => 0.0239, std.dev.: 0.0030) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 11.97% (0.1462 => 0.1637, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4599, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0706, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4848, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3145, std.dev.: 0.3682) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1259, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4072, std.dev.: 0.0023) SingleSource/Regression/C/uint64_to_float: -24.15% (2.1832 => 1.6560, std.dev.: 0.0041) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.41% (0.0810 => 0.0951, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.97% (0.0773 => 0.0881, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 12.05% (0.1112 => 0.1246, std.dev.: 0.0022) MultiSource/Applications/viterbi/viterbi: 8.12% (0.1577 => 0.1705, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.89% (0.2180 => 0.2352, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 7.56% (0.7950 => 0.8551, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.46% (0.2279 => 0.2449, std.dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.11% (0.3137 => 0.3360, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.04% (0.7473 => 0.7999, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.99% (0.2519 => 0.2695, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 6.95% (1.2222 => 1.3072, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.12% (1.1606 => 1.2316, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.09% (0.6010 => 0.6376, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.93% (0.1905 => 0.2018, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.82% (0.6287 => 0.6653, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.62% (0.1885 => 0.1991, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.41% (0.4847 => 0.5109, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.28% (0.5961 => 0.6276, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.25% (0.3295 => 0.3468, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.24% (0.1983 => 0.2087, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 5.12% (1.9948 => 2.0970, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.04% (0.2240 => 0.2353, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.96% (0.8148 => 0.8552, std.dev.: 0.0124) MultiSource/Applications/hbd/hbd: 4.87% (1.4269 => 1.4964, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.79% (1.1685 => 1.2245, std.dev.: 0.0071) MultiSource/Applications/sgefa/sgefa: 4.47% (0.2999 => 0.3133, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.30% (0.3717 => 0.3877, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.00% (0.2998 => 0.3118, std.dev.: 0.0034) MultiSource/Applications/minisat/minisat: 3.85% (0.6834 => 0.7097, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.75% (0.9435 => 0.9789, std.dev.: 0.0102) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.73% (6.6074 => 6.8538, std.dev.: 0.0232) MultiSource/Applications/d/make_dparser: 3.68% (3.2366 => 3.3558, std.dev.: 0.0050) MultiSource/Applications/SIBsim4/SIBsim4: 3.60% (1.2568 => 1.3021, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.59% (0.4127 => 0.4275, std.dev.: 0.0029) MultiSource/Applications/siod/siod: 3.53% (2.2184 => 2.2968, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.50% (0.3115 => 0.3224, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.47% (0.5817 => 0.6019, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.3279 => 1.3738, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.41% (4.1763 => 4.3189, std.dev.: 0.0191) MultiSource/Applications/lua/lua: 3.39% (3.8189 => 3.9485, std.dev.: 0.0407) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.38% (1.2526 => 1.2949, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.08% (13.1811 => 13.5865, std.dev.: 0.1308) MultiSource/Applications/hexxagon/hexxagon: 3.01% (0.9810 => 1.0105, std.dev.: 0.0068) MultiSource/Benchmarks/nbench/nbench: 2.97% (1.1271 => 1.1606, std.dev.: 0.0085) MultiSource/Applications/ClamAV/clamscan: 2.96% (14.7684 => 15.2056, std.dev.: 0.1268) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.94% (0.8611 => 0.8864, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.82% (15.3280 => 15.7604, std.dev.: 0.0450) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.76% (0.8457 => 0.8690, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.75% (8.6476 => 8.8850, std.dev.: 0.0360) MultiSource/Applications/JM/ldecod/ldecod: 2.61% (6.7320 => 6.9079, std.dev.: 0.0559) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.56% (0.8048 => 0.8254, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.44% (0.9039 => 0.9260, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.40% (1.2602 => 1.2905, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.35% (0.8597 => 0.8799, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.33% (4.4880 => 4.5927, std.dev.: 0.0285) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.33% (0.8066 => 0.8254, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.28% (0.8359 => 0.8550, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.27% (0.8805 => 0.9005, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.16% (0.8177 => 0.8354, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.13% (0.8316 => 0.8493, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.97% (0.8885 => 0.9060, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.94% (0.8261 => 0.8421, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 1.92% (0.8768 => 0.8936, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.91% (0.8338 => 0.8497, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.79% (0.8007 => 0.8150, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.51% (1.2423 => 1.2610, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 57.61% (1.5795 => 2.4894, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.60% (2.9753 => 3.4691, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.70% (2.7995 => 3.2110, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.58% (5.0261 => 5.6082, std.dev.: 0.0076) SingleSource/Benchmarks/McGill/queens: 7.27% (1.7056 => 1.8296, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.67% (4.7794 => 5.0981, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: 6.39% (1.3037 => 1.3870, std.dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 6.00% (3.1873 => 3.3784, std.dev.: 0.0221) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.88% (4.5327 => 4.7994, std.dev.: 0.0309) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.88% (4.9686 => 5.2608, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.73% (6.2275 => 6.5222, std.dev.: 0.0360) MultiSource/Applications/lambda-0_1_3/lambda: 4.63% (7.4933 => 7.8405, std.dev.: 0.0356) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.49% (3.3761 => 3.5278, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.18% (4.9453 => 5.1518, std.dev.: 0.0238) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.13% (4.9469 => 5.1512, std.dev.: 0.0192) MultiSource/Applications/hexxagon/hexxagon: 3.85% (14.0064 => 14.5458, std.dev.: 0.0269) MultiSource/Applications/siod/siod: 3.05% (3.6643 => 3.7761, std.dev.: 0.0110) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.93% (1.2337 => 1.2698, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.79% (11.5690 => 11.8923, std.dev.: 0.0458) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.69% (8.2783 => 8.5014, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.29% (4.8660 => 4.9773, std.dev.: 0.0298) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.23% (1.1365 => 1.1619, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: 2.21% (7.3375 => 7.4994, std.dev.: 0.0289) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.16% (2.4647 => 2.4933, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/power/power: 1.08% (1.2061 => 1.2191, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.75% (5.4641 => 4.3302, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.18% (7.2130 => 6.3342, std.dev.: 0.2702) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.91% (1.0512 => 0.9365, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: -10.50% (1.1216 => 1.0038, std.dev.: 0.0222) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.09% (14.6451 => 13.3142, std.dev.: 0.2348) MultiSource/Benchmarks/mafft/pairlocalalign: -8.53% (63.1822 => 57.7914, std.dev.: 0.1740) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.89% (4.7482 => 4.4209, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.55% (0.3269 => 0.3055, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.08% (3.7148 => 3.4890, std.dev.: 0.0561) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.81% (5.4972 => 5.1776, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/recursive: -5.08% (2.4490 => 2.3246, std.dev.: 0.0299) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.06% (5.1557 => 4.8950, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.40% (4.7449 => 4.5363, std.dev.: 0.0319) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.72% (6.0224 => 5.7982, std.dev.: 0.0193) MultiSource/Applications/lua/lua: -3.28% (29.8330 => 28.8549, std.dev.: 0.1143) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.22% (0.5807 => 0.5620, std.dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (28.5821 => 27.6763, std.dev.: 0.0268) MultiSource/Benchmarks/Olden/bisort/bisort: -2.68% (0.6636 => 0.6458, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.61% (9.9065 => 9.6477, std.dev.: 0.0440) MultiSource/Applications/aha/aha: -2.56% (3.3398 => 3.2544, std.dev.: 0.0216) SingleSource/Benchmarks/Shootout-C++/hash2: -2.27% (3.4237 => 3.3461, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.03% (11.5316 => 11.2971, std.dev.: 0.0406) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.55% (4.9994 => 4.9221, std.dev.: 0.0177) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.3487 => 2.3203, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.16% (5.6343 => 5.5690, std.dev.: 0.0063) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 3.27% (16.4461 => 16.9833, std.dev.: 0.1464) MultiSource/Applications/obsequi/Obsequi: 3.18% (1.0262 => 1.0588, std.dev.: 0.0337) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6999.84% (0.3123 => 22.1728, std.dev.: 1.4308) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.06% (0.2463 => 0.3696, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 2.11% (0.6010 => 0.6137, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.91% (0.3266 => 0.3361, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 3.10% (0.1969 => 0.2030, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0083) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0157) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0095) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0104) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.94% (0.0384 => 0.0426, std.dev.: 0.0127) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/test1: 7.78% (0.0180 => 0.0194, std.dev.: 0.0037) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 3.55% (0.1438 => 0.1489, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.34% (1.1329 => 1.1291, std.dev.: 0.0214) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.58% (0.4164 => 0.4188, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.99% (0.1369 => 0.1451, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.47% (0.0641 => 0.0638, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 40.51% (0.0195 => 0.0274, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.67% (0.0578 => 0.0551, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.41% (1.1437 => 1.1941, std.dev.: 0.0301) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.03% (0.0627 => 0.0646, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.89% (0.0180 => 0.0173, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.22% (0.8017 => 0.7839, std.dev.: 0.1370) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 95.16% (0.0062 => 0.0121, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 16 23:46:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 01:46:54 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121117074654.7E7CE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5964?compare_to=5960&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5964, Order: 168253, Start Time: 2012-11-17 06:14:26, End Time: 2012-11-17 07:47:15 To: 5960, Order: 168249, Start Time: 2012-11-17 04:18:53, End Time: 2012-11-17 05:51:33 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 1 (173 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1043 (865 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.28% (81.8969 => 79.2147, std.dev.: 0.4103) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.89% (2.0478 => 2.1069, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/salsa20: 2.19% (7.4937 => 7.6577, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/hash2: 2.17% (3.1932 => 3.2624, std.dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.60% (0.1431 => 0.1308, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.98% (0.3821 => 0.3516, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.84% (0.3142 => 0.2927, std.dev.: 0.0046) MultiSource/Applications/sgefa/sgefa: -6.73% (0.3357 => 0.3131, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -6.68% (2.4924 => 2.3260, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.55% (0.2428 => 0.2269, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.48% (0.9542 => 0.8924, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -6.25% (0.2160 => 0.2025, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.18% (0.1796 => 0.1685, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.15% (0.6484 => 0.6085, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -6.05% (9.2283 => 8.6699, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.04% (0.9852 => 0.9257, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -6.03% (16.1920 => 15.2159, std.dev.: 0.0153) MultiSource/Applications/JM/ldecod/ldecod: -5.98% (7.0961 => 6.6714, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/football/football: -5.92% (0.9179 => 0.8636, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.89% (0.7198 => 0.6774, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.86% (0.2355 => 0.2217, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -5.85% (0.1879 => 0.1769, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.83% (0.1716 => 0.1616, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.77% (0.3658 => 0.3447, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.76% (1.3722 => 1.2931, std.dev.: 0.0089) SingleSource/Benchmarks/McGill/chomp: -5.74% (0.1761 => 0.1660, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.71% (1.0544 => 0.9942, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -5.70% (1.1450 => 1.0797, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.68% (0.2695 => 0.2542, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.62% (1.2300 => 1.1609, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.61% (4.0323 => 3.8060, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.61% (1.6364 => 1.5446, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.61% (0.3406 => 0.3215, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.59% (3.5339 => 3.3362, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.59% (6.7716 => 6.3931, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: -5.57% (4.3330 => 4.0915, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.53% (1.4642 => 1.3833, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.48% (4.8161 => 4.5523, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.46% (4.8802 => 4.6139, std.dev.: 0.0078) MultiSource/Benchmarks/nbench/nbench: -5.46% (1.1530 => 1.0901, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.45% (4.5069 => 4.2612, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.44% (1.2784 => 1.2089, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.43% (0.6736 => 0.6370, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.43% (0.6230 => 0.5892, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.42% (14.2083 => 13.4382, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.41% (0.5859 => 0.5542, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.40% (0.6293 => 0.5953, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.38% (0.7919 => 0.7493, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.37% (0.6052 => 0.5727, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (0.5857 => 0.5543, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -5.35% (1.2515 => 1.1845, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.33% (0.5591 => 0.5293, std.dev.: 0.0085) MultiSource/Applications/sqlite3/sqlite3: -5.31% (17.1032 => 16.1952, std.dev.: 0.0113) MultiSource/Applications/SIBsim4/SIBsim4: -5.31% (1.3864 => 1.3128, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.30% (0.6660 => 0.6307, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.30% (0.6681 => 0.6327, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -5.29% (0.2985 => 0.2827, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.28% (0.8521 => 0.8071, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.27% (0.5802 => 0.5496, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.27% (0.6260 => 0.5930, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.24% (0.5805 => 0.5501, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.23% (0.3483 => 0.3301, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.22% (0.7524 => 0.7131, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.22% (0.5575 => 0.5284, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.22% (0.5863 => 0.5557, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.21% (0.7339 => 0.6957, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.19% (0.6667 => 0.6321, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.19% (0.5688 => 0.5393, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/18-imp/imp: -5.17% (0.3581 => 0.3396, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -5.16% (0.4515 => 0.4282, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.15% (0.5999 => 0.5690, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.15% (0.5456 => 0.5175, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.14% (0.6395 => 0.6066, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.11% (1.2221 => 1.1596, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.10% (0.2548 => 0.2418, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.09% (1.2210 => 1.1588, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.09% (0.5478 => 0.5199, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.09% (0.6676 => 0.6336, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.09% (0.2278 => 0.2162, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.08% (0.5705 => 0.5415, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -5.08% (0.2659 => 0.2524, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.07% (0.6446 => 0.6119, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.03% (0.5941 => 0.5642, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.03% (0.5925 => 0.5627, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.01% (0.5570 => 0.5291, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.99% (0.5567 => 0.5289, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -4.98% (3.5154 => 3.3403, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.97% (8.0126 => 7.6140, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.97% (0.6395 => 0.6077, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.97% (0.2999 => 0.2850, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -4.95% (15.2527 => 14.4979, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.92% (0.6033 => 0.5736, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.92% (0.6440 => 0.6123, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.91% (0.5849 => 0.5562, std.dev.: 0.0054) MultiSource/Applications/SPASS/SPASS: -4.91% (15.5079 => 14.7472, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.90% (0.4916 => 0.4675, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -4.90% (0.7447 => 0.7082, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.89% (0.5581 => 0.5308, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.87% (1.6474 => 1.5672, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.87% (0.5569 => 0.5298, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.85% (0.3319 => 0.3158, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -4.84% (4.0594 => 3.8630, std.dev.: 0.0124) SingleSource/UnitTests/ObjC/trivial-interface: -4.75% (0.3812 => 0.3631, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.70% (0.5168 => 0.4925, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.70% (0.2385 => 0.2273, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -4.66% (2.4021 => 2.2902, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/exceptions: -4.62% (0.4176 => 0.3983, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.61% (0.4033 => 0.3847, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: -4.61% (2.1401 => 2.0414, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.60% (0.3891 => 0.3712, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.59% (0.3831 => 0.3655, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.59% (0.3880 => 0.3702, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.58% (0.3884 => 0.3706, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (0.7021 => 0.6703, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -4.52% (0.3848 => 0.3674, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.52% (0.3896 => 0.3720, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.52% (22.4056 => 21.3935, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.47% (0.5329 => 0.5091, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -4.46% (5.0226 => 4.7985, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.46% (0.6194 => 0.5918, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -4.41% (0.4199 => 0.4014, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.38% (0.6189 => 0.5918, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -4.37% (0.7982 => 0.7633, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.35% (0.6304 => 0.6030, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.34% (0.3271 => 0.3129, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.34% (2.2587 => 2.1607, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: -4.28% (0.4280 => 0.4097, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.19% (0.6297 => 0.6033, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -4.17% (34.0927 => 32.6726, std.dev.: 0.0104) MultiSource/Applications/hexxagon/hexxagon: -4.15% (1.3148 => 1.2602, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.01% (0.9077 => 0.8713, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.00% (0.4151 => 0.3985, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -3.96% (18.2933 => 17.5683, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: -3.90% (0.8418 => 0.8090, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -3.87% (0.3255 => 0.3129, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.86% (0.9557 => 0.9188, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.71% (0.3016 => 0.2904, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.69% (0.3931 => 0.3786, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -3.67% (0.3025 => 0.2914, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.66% (0.3849 => 0.3708, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: -3.66% (0.4861 => 0.4683, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -3.63% (0.3194 => 0.3078, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -3.60% (0.3026 => 0.2917, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -3.60% (0.4248 => 0.4095, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.52% (0.3837 => 0.3702, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.50% (2.1713 => 2.0954, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists1: -3.49% (0.3867 => 0.3732, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.49% (0.4813 => 0.4645, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.47% (0.3491 => 0.3370, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -3.47% (0.3059 => 0.2953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -3.45% (0.3446 => 0.3327, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -3.45% (0.3394 => 0.3277, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.41% (0.4427 => 0.4276, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.40% (0.3057 => 0.2953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -3.38% (0.2989 => 0.2888, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -3.31% (1.5610 => 1.5094, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.26% (5.4682 => 5.2899, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: -3.20% (0.6750 => 0.6534, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: -3.19% (0.3481 => 0.3370, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.18% (0.4083 => 0.3953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -3.15% (0.3205 => 0.3104, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -3.14% (0.6347 => 0.6148, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.01% (0.3323 => 0.3223, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -3.00% (0.6441 => 0.6248, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -2.90% (0.3788 => 0.3678, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -2.89% (0.7779 => 0.7554, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash: -2.63% (0.4524 => 0.4405, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.53% (20.7746 => 20.2498, std.dev.: 0.0213) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7528, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1732, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: -4.04% (2.2633 => 2.1719, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4720, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 01:00:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 03:00:33 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121117090033.CEEC02A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5965?compare_to=5963&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5965, Order: 168256, Start Time: 2012-11-17 07:31:52, End Time: 2012-11-17 09:00:55 To: 5963, Order: 168253, Start Time: 2012-11-17 05:43:23, End Time: 2012-11-17 07:14:15 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 8 (129 on baseline) Performance Improvements: 3 (26 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 983 (819 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.04% (0.3069 => 0.3193, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.45% (1.6732 => 1.6975, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.45% (0.9095 => 0.9227, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.27% (0.3299 => 0.3440, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.92% (1.0149 => 1.0445, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.85% (58.6636 => 60.3350, std.dev.: 0.5149) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 1.65% (0.8836 => 0.8982, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 1.43% (1.9993 => 2.0278, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.56% (0.8613 => 0.8479, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.35% (3.3116 => 3.2670, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.96% (4.6814 => 4.5428, std.dev.: 0.0190) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.55% (16.9833 => 17.0770, std.dev.: 0.0609) MultiSource/Applications/obsequi/Obsequi: 0.34% (1.0588 => 1.0624, std.dev.: 0.0072) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.19% (22.1728 => 22.2139, std.dev.: 0.0664) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.16% (0.3696 => 0.3702, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 0.42% (0.6137 => 0.6163, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.68% (0.3361 => 0.3384, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -0.69% (0.2030 => 0.2016, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -30.59% (0.0219 => 0.0152, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0428 => 0.0430, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.50% (0.0331 => 0.0283, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0315 => 0.0314, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0426 => 0.0428, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: -11.71% (0.0205 => 0.0181, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/test1: -26.80% (0.0194 => 0.0142, std.dev.: 0.0038) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -87.50% (0.0008 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -1.14% (0.1489 => 0.1472, std.dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 4.25% (1.1291 => 1.1771, std.dev.: 0.0127) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.36% (0.4188 => 0.4131, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.90% (0.1451 => 0.1438, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.91% (0.0638 => 0.0562, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -21.90% (0.0274 => 0.0214, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 11.25% (0.0551 => 0.0613, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.18% (1.1941 => 1.1920, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -22.22% (0.0027 => 0.0021, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.35% (0.0646 => 0.0605, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.76% (0.0173 => 0.0202, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.29% (0.7839 => 0.7816, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -47.11% (0.0121 => 0.0064, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2321.97% (0.6332 => 15.3359, std.dev.: 0.0899) MultiSource/Benchmarks/McCat/08-main/main: 50.03% (0.1831 => 0.2747, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.13% (0.1559 => 0.1479, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1525.63% (0.3344 => 5.4361, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.27% (0.2364 => 0.3245, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: 3.03% (0.0429 => 0.0442, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.34% (0.0224 => 0.0227, std.dev.: 0.0087) SingleSource/UnitTests/byval-alignment: -30.87% (0.0230 => 0.0159, std.dev.: 0.0011) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 7.52% (0.1462 => 0.1572, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4600, std.dev.: 0.0157) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0683, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4890, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3170, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1335, std.dev.: 0.0180) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4008, std.dev.: 0.0011) SingleSource/Regression/C/uint64_to_float: -24.07% (2.1832 => 1.6578, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0004, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.80% (0.0810 => 0.0938, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.33% (0.0848 => 0.0961, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.77% (0.0830 => 0.0936, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 10.61% (0.1112 => 0.1230, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.72% (0.2180 => 0.2370, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.47% (0.6010 => 0.6459, std.dev.: 0.0092) MultiSource/Applications/viterbi/viterbi: 7.29% (0.1577 => 0.1692, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.95% (0.7473 => 0.7992, std.dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.87% (0.4847 => 0.5180, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.49% (0.8148 => 0.8677, std.dev.: 0.0186) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.40% (0.1905 => 0.2027, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.33% (0.3003 => 0.3193, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/em3d/em3d: 5.93% (0.1721 => 0.1823, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.54% (1.1685 => 1.2332, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.49% (0.2133 => 0.2250, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.36% (0.1885 => 0.1986, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.32% (0.3137 => 0.3304, std.dev.: 0.0031) MultiSource/Applications/spiff/spiff: 5.26% (0.7950 => 0.8368, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.23% (1.1606 => 1.2213, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.16% (0.2519 => 0.2649, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.97% (0.4127 => 0.4332, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.73% (0.3295 => 0.3451, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: 4.66% (1.2222 => 1.2792, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.66% (0.6287 => 0.6580, std.dev.: 0.0069) MultiSource/Applications/hbd/hbd: 4.48% (1.4269 => 1.4908, std.dev.: 0.0178) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.47% (6.6074 => 6.9029, std.dev.: 0.0450) MultiSource/Benchmarks/MallocBench/gs/gs: 4.38% (4.1305 => 4.3115, std.dev.: 0.0652) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.30% (4.4873 => 4.6801, std.dev.: 0.0420) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.13% (0.3657 => 0.3808, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.09% (0.9435 => 0.9821, std.dev.: 0.0125) MultiSource/Applications/minisat/minisat: 4.05% (0.6834 => 0.7111, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 3.94% (2.2184 => 2.3059, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.93% (1.3279 => 1.3801, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.87% (0.3124 => 0.3245, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 3.71% (14.2605 => 14.7891, std.dev.: 0.0425) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.68% (2.1401 => 2.2188, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 3.67% (3.8189 => 3.9589, std.dev.: 0.0218) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.63% (0.3115 => 0.3228, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.59% (1.6386 => 1.6975, std.dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: 3.54% (1.1271 => 1.1670, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.52% (4.4880 => 4.6458, std.dev.: 0.0281) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.47% (8.6476 => 8.9473, std.dev.: 0.0260) MultiSource/Applications/hexxagon/hexxagon: 3.43% (0.9810 => 1.0146, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.31% (0.3717 => 0.3840, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.26% (0.6227 => 0.6430, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.24% (1.1170 => 1.1532, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/hash: 3.24% (0.3800 => 0.3923, std.dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 3.24% (14.7684 => 15.2464, std.dev.: 0.0826) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (0.8340 => 0.8607, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.17% (13.1811 => 13.5995, std.dev.: 0.0405) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.17% (4.1763 => 4.3087, std.dev.: 0.0460) MultiSource/Applications/d/make_dparser: 3.15% (3.2366 => 3.3386, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.10% (0.9074 => 0.9355, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.07% (0.4783 => 0.4930, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 3.02% (1.2568 => 1.2948, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.94% (1.5315 => 1.5766, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 2.90% (31.8598 => 32.7822, std.dev.: 0.0649) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.87% (0.8805 => 0.9058, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 2.86% (0.8768 => 0.9019, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.85% (0.8007 => 0.8235, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: 2.84% (2.3764 => 2.4440, std.dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.76% (1.4479 => 1.4878, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.68% (1.2602 => 1.2940, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.66% (0.5191 => 0.5329, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.65% (4.5702 => 4.6914, std.dev.: 0.0440) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.63% (3.1832 => 3.2670, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 2.60% (15.3280 => 15.7264, std.dev.: 0.0914) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.58% (0.8995 => 0.9227, std.dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: 2.54% (8.6247 => 8.8440, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.48% (0.8317 => 0.8523, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.44% (0.8611 => 0.8821, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.42% (0.8518 => 0.8724, std.dev.: 0.0059) MultiSource/Applications/JM/ldecod/ldecod: 2.41% (6.7320 => 6.8942, std.dev.: 0.0399) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.40% (0.8261 => 0.8459, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.36% (0.8597 => 0.8800, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.36% (0.8656 => 0.8860, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.36% (0.8359 => 0.8556, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.34% (0.9688 => 0.9915, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.33% (0.8286 => 0.8479, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 2.29% (1.0945 => 1.1196, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.26% (0.8316 => 0.8504, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.24% (0.8855 => 0.9053, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.17% (0.9039 => 0.9235, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.16% (0.7966 => 0.8138, std.dev.: 0.0040) MultiSource/Applications/oggenc/oggenc: 2.16% (4.9628 => 5.0698, std.dev.: 0.0231) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.13% (0.8420 => 0.8599, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.12% (0.8712 => 0.8897, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.12% (1.2423 => 1.2686, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.00% (0.9056 => 0.9237, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.99% (0.8338 => 0.8504, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.97% (0.8885 => 0.9060, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.94% (0.8177 => 0.8336, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.94% (0.7932 => 0.8086, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 115.08% (0.0199 => 0.0428, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/pi: 58.81% (1.5795 => 2.5084, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 18.23% (0.7597 => 0.8982, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.47% (2.9753 => 3.4654, std.dev.: 0.0235) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.45% (2.7995 => 3.2039, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.62% (5.0261 => 5.6101, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.00% (6.3772 => 7.0151, std.dev.: 0.2144) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.19% (1.1857 => 1.2828, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.97% (0.3186 => 0.3440, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 7.01% (1.7056 => 1.8251, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.73% (4.7794 => 5.1012, std.dev.: 0.0061) MultiSource/Applications/SIBsim4/SIBsim4: 6.29% (3.1873 => 3.3878, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.88% (4.9686 => 5.2608, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.87% (4.5327 => 4.7989, std.dev.: 0.0221) SingleSource/Benchmarks/Misc/richards_benchmark: 5.45% (1.3037 => 1.3748, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.70% (6.2275 => 6.5200, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.67% (3.3761 => 3.5339, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 4.36% (7.4933 => 7.8201, std.dev.: 0.0468) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.02% (4.9453 => 5.1442, std.dev.: 0.0327) MultiSource/Applications/hexxagon/hexxagon: 3.98% (14.0064 => 14.5634, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.85% (4.9469 => 5.1375, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.12% (0.3587 => 0.3699, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 3.08% (3.6643 => 3.7772, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.84% (11.5690 => 11.8981, std.dev.: 0.0242) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.79% (8.2783 => 8.5096, std.dev.: 0.0220) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.77% (1.2337 => 1.2679, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.45% (4.8362 => 4.9546, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout/lists: 2.24% (7.3375 => 7.5020, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.22% (4.8660 => 4.9741, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.15% (1.1365 => 1.1609, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.72% (2.4647 => 2.5072, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary3: 1.40% (1.9999 => 2.0278, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/neural/neural: 1.25% (1.0841 => 1.0977, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: 1.24% (8.5322 => 8.6377, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.23% (3.5679 => 3.6119, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.07% (4.4340 => 4.4814, std.dev.: 0.0126) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.64% (5.4641 => 4.3364, std.dev.: 0.0268) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.13% (7.2130 => 6.1936, std.dev.: 0.1068) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.09% (1.0512 => 0.9346, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/chomp: -10.69% (1.1216 => 1.0017, std.dev.: 0.0329) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.56% (14.6451 => 13.3908, std.dev.: 0.1344) MultiSource/Benchmarks/mafft/pairlocalalign: -8.51% (63.1822 => 57.8031, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.88% (4.7482 => 4.4217, std.dev.: 0.0198) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.18% (0.3269 => 0.3067, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.91% (3.7148 => 3.4954, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.66% (5.4972 => 5.1863, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.09% (5.1557 => 4.8931, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.41% (4.7449 => 4.5355, std.dev.: 0.0355) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.75% (6.0224 => 5.7964, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.26% (2.4490 => 2.3691, std.dev.: 0.0184) MultiSource/Applications/lua/lua: -3.19% (29.8330 => 28.8815, std.dev.: 0.0955) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.19% (0.5807 => 0.5622, std.dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.05% (28.5821 => 27.7108, std.dev.: 0.0300) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.98% (2.8773 => 2.7916, std.dev.: 0.0294) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.95% (2.6356 => 2.5579, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/bisort/bisort: -2.29% (0.6636 => 0.6484, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: -2.21% (3.4237 => 3.3481, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.15% (9.9065 => 9.6931, std.dev.: 0.0555) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.00% (11.5316 => 11.3004, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.56% (4.9994 => 4.9214, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.44% (2.3487 => 2.3148, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.20% (5.6343 => 5.5665, std.dev.: 0.0054) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 3.84% (16.4461 => 17.0770, std.dev.: 0.0609) MultiSource/Applications/obsequi/Obsequi: 3.53% (1.0262 => 1.0624, std.dev.: 0.0072) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7013.00% (0.3123 => 22.2139, std.dev.: 0.0664) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.30% (0.2463 => 0.3702, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 2.55% (0.6010 => 0.6163, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.61% (0.3266 => 0.3384, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 2.39% (0.1969 => 0.2016, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 23.58% (0.0123 => 0.0152, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.39% (0.0408 => 0.0430, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 11.42% (0.0254 => 0.0283, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.46% (0.0384 => 0.0428, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: -4.74% (0.0190 => 0.0181, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/test1: -21.11% (0.0180 => 0.0142, std.dev.: 0.0038) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.36% (0.1438 => 0.1472, std.dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 3.90% (1.1329 => 1.1771, std.dev.: 0.0127) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.79% (0.4164 => 0.4131, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.04% (0.1369 => 0.1438, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -12.32% (0.0641 => 0.0562, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 9.74% (0.0195 => 0.0214, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.06% (0.0578 => 0.0613, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.22% (1.1437 => 1.1920, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0014 => 0.0021, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.51% (0.0627 => 0.0605, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 12.22% (0.0180 => 0.0202, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.51% (0.8017 => 0.7816, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 3.23% (0.0062 => 0.0064, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 01:37:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 03:37:50 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121117093750.6B4272A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5966?compare_to=5961&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5966, Order: 168253, Start Time: 2012-11-17 07:14:26, End Time: 2012-11-17 09:38:10 To: 5961, Order: 168245, Start Time: 2012-11-17 04:02:42, End Time: 2012-11-17 06:22:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 64 (163 on baseline) Performance Improvements: 25 (37 on baseline) Added Tests: 0 (136 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 951 (687 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 16.82% (0.1659 => 0.1938, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 16.64% (0.1172 => 0.1367, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.89% (0.5971 => 0.6860, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 14.75% (0.6230 => 0.7149, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.39% (0.7254 => 0.8298, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 14.07% (0.6695 => 0.7637, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 14.02% (0.8161 => 0.9305, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 13.79% (0.5952 => 0.6773, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.58% (4.3818 => 4.9770, std.dev.: 0.0236) MultiSource/Applications/hexxagon/hexxagon: 13.48% (1.3971 => 1.5854, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.39% (0.7615 => 0.8635, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 13.04% (0.3029 => 0.3424, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.78% (0.9053 => 1.0210, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.60% (0.7277 => 0.8194, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/hash: 12.28% (0.4822 => 0.5414, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/wc: 12.12% (0.3350 => 0.3756, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 12.11% (0.5178 => 0.5805, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/sumcol: 12.00% (0.3184 => 0.3566, std.dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: 11.96% (1.3398 => 1.5000, std.dev.: 0.0200) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.94% (0.3182 => 0.3562, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.61% (0.2902 => 0.3239, std.dev.: 0.0099) SingleSource/Benchmarks/Linpack/linpack-pc: 10.28% (0.2899 => 0.3197, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.24% (0.3790 => 0.4178, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.17% (0.2674 => 0.2946, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.05% (1.0359 => 1.1400, std.dev.: 0.0141) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.75% (0.1179 => 0.1294, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.73% (1.7532 => 1.9238, std.dev.: 0.0259) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.45% (0.3408 => 0.3730, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/09-vor/vor: 9.29% (0.3583 => 0.3916, std.dev.: 0.0082) MultiSource/Applications/viterbi/viterbi: 9.27% (0.1802 => 0.1969, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/05-eks/eks: 8.92% (0.4833 => 0.5264, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/lists1: 8.68% (0.4091 => 0.4446, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: 8.23% (0.7319 => 0.7921, std.dev.: 0.0223) SingleSource/Benchmarks/Misc/flops: 8.04% (0.1989 => 0.2149, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: 7.82% (0.1625 => 0.1752, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.47% (0.2141 => 0.2301, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.31% (6.3811 => 6.8478, std.dev.: 0.1277) SingleSource/UnitTests/ObjC/property: 7.25% (0.4412 => 0.4732, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/18-imp/imp: 7.25% (0.3902 => 0.4185, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.19% (0.3157 => 0.3384, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/moments: 6.88% (0.4505 => 0.4815, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/ary: 6.85% (0.3563 => 0.3807, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ary2: 6.57% (0.3727 => 0.3972, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.43% (1.5182 => 1.6007, std.dev.: 0.0318) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.89% (8.2727 => 8.5943, std.dev.: 0.0106) MultiSource/Benchmarks/PAQ8p/paq8p: 1.59% (11.9004 => 12.0892, std.dev.: 0.0347) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: 114.79% (0.1048 => 0.2251, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 37.84% (0.3449 => 0.4754, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/09-vor/vor: 28.04% (0.1191 => 0.1525, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 17.36% (0.0841 => 0.0987, std.dev.: 0.0054) SingleSource/Benchmarks/McGill/chomp: 9.12% (1.2119 => 1.3224, std.dev.: 0.0287) SingleSource/Benchmarks/Shootout-C++/hash2: 7.76% (3.3686 => 3.6300, std.dev.: 0.0147) MultiSource/Applications/siod/siod: 6.71% (3.1758 => 3.3889, std.dev.: 0.0187) SingleSource/Benchmarks/Shootout-C++/hash: 6.61% (0.7598 => 0.8100, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/ffbench: 6.52% (0.9937 => 1.0585, std.dev.: 0.0089) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 6.40% (9.1327 => 9.7169, std.dev.: 0.1811) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.66% (3.7214 => 3.8577, std.dev.: 0.0176) MultiSource/Benchmarks/NPB-serial/is/is: 3.66% (8.5793 => 8.8935, std.dev.: 0.0809) SingleSource/Benchmarks/Shootout-C++/lists1: 3.10% (0.6166 => 0.6357, std.dev.: 0.0072) MultiSource/Applications/sqlite3/sqlite3: 2.86% (4.5891 => 4.7203, std.dev.: 0.0343) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.76% (88.0645 => 89.6142, std.dev.: 0.4184) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.15% (5.4290 => 5.4915, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.10% (1.8982 => 1.9191, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.02% (4.3861 => 4.4310, std.dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -13.70% (0.7241 => 0.6249, std.dev.: 0.0317) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -13.39% (0.7217 => 0.6251, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -12.67% (0.7167 => 0.6259, std.dev.: 0.0348) SingleSource/UnitTests/ObjC/BoolLiteralTest: -12.25% (0.4619 => 0.4053, std.dev.: 0.0216) SingleSource/Benchmarks/Shootout-C++/except: -11.93% (0.3579 => 0.3152, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/hello: -11.72% (0.3336 => 0.2945, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/richards_benchmark: -11.32% (0.1007 => 0.0893, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.71% (0.4686 => 0.4184, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/methcall: -10.71% (0.3512 => 0.3136, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/reversefile: -10.43% (0.4830 => 0.4326, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/fibo: -10.37% (0.3309 => 0.2966, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/lists: -10.32% (0.4243 => 0.3805, std.dev.: 0.0163) SingleSource/Benchmarks/Misc/ReedSolomon: -9.87% (0.2441 => 0.2200, std.dev.: 0.0087) MultiSource/Applications/lambda-0_1_3/lambda: -9.25% (0.9409 => 0.8539, std.dev.: 0.0316) MultiSource/Applications/lua/lua: -8.95% (4.9127 => 4.4730, std.dev.: 0.1283) SingleSource/UnitTests/ObjC/block-byref-aggr: -8.86% (0.4400 => 0.4010, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/sieve: -8.50% (0.4379 => 0.4007, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -8.24% (0.2610 => 0.2395, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.66% (5.0504 => 4.7142, std.dev.: 0.0914) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.42% (0.5903 => 0.5524, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/salsa20: -5.56% (0.2214 => 0.2091, std.dev.: 0.0037) MultiSource/Applications/kimwitu++/kc: -1.40% (21.7228 => 21.4180, std.dev.: 0.0391) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -21.91% (1.9956 => 1.5584, std.dev.: 0.1345) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -8.75% (9.4040 => 8.5814, std.dev.: 0.2107) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.99% (17.3080 => 16.2710, std.dev.: 0.1726) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 2.62% (0.1338 => 0.1373, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0420 => 0.0419, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0652 => 0.0653, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -0.03% (494.2689 => 494.1019, std.dev.: 0.0656) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0419, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/power/power: 43715.01% (1.1277 => 494.1019, std.dev.: 0.0656) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 195.03% (0.5229 => 1.5427, std.dev.: 0.1128) MultiSource/Applications/SPASS/SPASS: 23.49% (14.9895 => 18.5103, std.dev.: 0.0398) MultiSource/Applications/kimwitu++/kc: 51.31% (14.1553 => 21.4180, std.dev.: 0.0391) MultiSource/Benchmarks/MallocBench/gs/gs: 23.14% (4.1105 => 5.0616, std.dev.: 0.1523) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 44.89% (1.1048 => 1.6007, std.dev.: 0.0318) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 440.42% (7.1582 => 38.6842, std.dev.: 0.0839) SingleSource/Benchmarks/Misc-C++-EH/spirit: 97.75% (3.4629 => 6.8478, std.dev.: 0.1277) SingleSource/Benchmarks/Misc-C++/stepanov_container: 83.22% (0.6222 => 1.1400, std.dev.: 0.0141) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10860.69% (0.0720 => 7.8917, std.dev.: 0.2147) MultiSource/Applications/SIBsim4/SIBsim4: 3871300.00% (0.0001 => 3.8714, std.dev.: 0.0241) MultiSource/Applications/SPASS/SPASS: 13967000.00% (0.0001 => 13.9671, std.dev.: 0.7343) MultiSource/Applications/kimwitu++/kc: 51500.00% (0.0001 => 0.0516, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14500.00% (0.0001 => 0.0146, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 577100.00% (0.0001 => 0.5772, std.dev.: 0.0428) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10080600.00% (0.0001 => 10.0807, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5974500.00% (0.0001 => 5.9746, std.dev.: 0.6097) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1803.43% (1.1194 => 21.3070, std.dev.: 0.0158) MultiSource/Applications/ClamAV/clamscan: 70.23% (22.1758 => 37.7508, std.dev.: 0.0422) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.26% (7.0540 => 11.0929, std.dev.: 0.1087) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.04% (2.9384 => 4.6145, std.dev.: 0.3246) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 52.52% (8.1363 => 12.4093, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/flops: 50.07% (0.1432 => 0.2149, std.dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 48.18% (21.9371 => 32.5060, std.dev.: 0.1147) SingleSource/Benchmarks/CoyoteBench/almabench: 47.67% (0.0730 => 0.1078, std.dev.: 0.0010) SingleSource/UnitTests/vla: 46.48% (0.0355 => 0.0520, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/distray/distray: 45.27% (0.1056 => 0.1534, std.dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/n-body: 35.12% (0.0746 => 0.1008, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 34.55% (0.0793 => 0.1067, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Oscar: 32.86% (0.0636 => 0.0845, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/17-bintr/bintr: 31.56% (0.0675 => 0.0888, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/15-trie/trie: 30.93% (0.0527 => 0.0690, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 30.17% (0.0842 => 0.1096, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.36% (0.6675 => 0.8635, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 29.15% (0.2758 => 0.3562, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 27.87% (3.8922 => 4.9770, std.dev.: 0.0236) SingleSource/Benchmarks/Stanford/FloatMM: 27.43% (0.0401 => 0.0511, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/IntMM: 27.41% (0.0394 => 0.0502, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/exptree: 27.40% (0.0814 => 0.1037, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 26.69% (1.1840 => 1.5000, std.dev.: 0.0200) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 26.64% (0.0443 => 0.0561, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 26.62% (0.1555 => 0.1969, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 26.57% (0.8067 => 1.0210, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/wordfreq: 26.34% (0.3307 => 0.4178, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash: 26.23% (0.4289 => 0.5414, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/08-main/main: 26.19% (0.2554 => 0.3223, std.dev.: 0.0150) SingleSource/Benchmarks/McGill/chomp: 25.80% (0.1655 => 0.2082, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/hash2: 25.65% (0.4620 => 0.5805, std.dev.: 0.0067) SingleSource/Benchmarks/Stanford/Towers: 25.48% (0.0471 => 0.0591, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Treesort: 25.30% (0.0411 => 0.0515, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 25.21% (0.0730 => 0.0914, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Queens: 25.12% (0.0414 => 0.0518, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 24.85% (0.0491 => 0.0613, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 24.80% (1.5415 => 1.9238, std.dev.: 0.0259) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 24.76% (0.1236 => 0.1542, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 24.43% (0.2603 => 0.3239, std.dev.: 0.0099) MultiSource/Applications/oggenc/oggenc: 24.30% (5.7591 => 7.1586, std.dev.: 0.0968) SingleSource/Benchmarks/Shootout-C++/ackermann: 24.24% (0.2756 => 0.3424, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 23.85% (0.0457 => 0.0566, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 23.45% (1.2842 => 1.5854, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/sumcol: 23.35% (0.2891 => 0.3566, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/perlin: 23.32% (0.0536 => 0.0661, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: 23.14% (0.3180 => 0.3916, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/wc: 23.07% (0.3052 => 0.3756, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.89% (0.1044 => 0.1283, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 22.71% (0.1114 => 0.1367, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/bigfib: 22.69% (0.6456 => 0.7921, std.dev.: 0.0223) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.60% (0.0770 => 0.0944, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 22.45% (0.4299 => 0.5264, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 22.40% (14.3668 => 17.5844, std.dev.: 0.0842) SingleSource/Benchmarks/Misc/fbench: 22.30% (0.0592 => 0.0724, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 22.26% (0.3423 => 0.4185, std.dev.: 0.0065) SingleSource/UnitTests/ObjC/property: 21.77% (0.3886 => 0.4732, std.dev.: 0.0078) SingleSource/Benchmarks/McGill/misr: 21.48% (0.0633 => 0.0769, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.39% (0.1566 => 0.1901, std.dev.: 0.0103) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.23% (0.2430 => 0.2946, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/whetstone: 21.21% (0.0660 => 0.0800, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 20.72% (0.1906 => 0.2301, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 20.68% (0.3684 => 0.4446, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/tsp/tsp: 20.51% (0.1175 => 0.1416, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 20.34% (0.1337 => 0.1609, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 20.31% (0.3826 => 0.4603, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.85% (0.5860 => 0.7023, std.dev.: 0.0240) MultiSource/Benchmarks/FreeBench/neural/neural: 19.75% (0.1463 => 0.1752, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.70% (0.4615 => 0.5524, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 19.26% (0.1625 => 0.1938, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.08% (0.2107 => 0.2509, std.dev.: 0.0108) SingleSource/UnitTests/ObjC/synchronized: 19.01% (0.3561 => 0.4238, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/moments: 18.95% (0.4048 => 0.4815, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C++/office/office: 18.94% (0.3136 => 0.3730, std.dev.: 0.0055) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.67% (0.1125 => 0.1335, std.dev.: 0.0056) SingleSource/Benchmarks/Stanford/Puzzle: 18.53% (0.1268 => 0.1503, std.dev.: 0.0031) MultiSource/Applications/d/make_dparser: 17.96% (3.3354 => 3.9343, std.dev.: 0.1707) SingleSource/Benchmarks/Shootout/lists: 17.89% (0.0626 => 0.0738, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.83% (0.2872 => 0.3384, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ary: 17.79% (0.3232 => 0.3807, std.dev.: 0.0075) MultiSource/Applications/sqlite3/sqlite3: 17.79% (17.1811 => 20.2374, std.dev.: 0.0499) SingleSource/Benchmarks/Shootout-C++/ary2: 17.55% (0.3379 => 0.3972, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/matrix: 17.46% (0.3098 => 0.3639, std.dev.: 0.0093) MultiSource/Applications/hbd/hbd: 17.34% (1.5603 => 1.8309, std.dev.: 0.0380) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.34% (0.0871 => 0.1022, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/trivial-interface: 17.13% (0.3473 => 0.4068, std.dev.: 0.0139) MultiSource/Benchmarks/mafft/pairlocalalign: 17.04% (9.4845 => 11.1010, std.dev.: 0.2435) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.81% (0.8172 => 0.9546, std.dev.: 0.0380) MultiSource/Benchmarks/PAQ8p/paq8p: 16.61% (10.3673 => 12.0892, std.dev.: 0.0347) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.40% (0.2793 => 0.3251, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.18% (4.9449 => 5.7451, std.dev.: 0.1934) SingleSource/Benchmarks/Shootout/matrix: 16.14% (0.0818 => 0.0950, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.98% (0.2065 => 0.2395, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/ffbench: 15.89% (0.0705 => 0.0817, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.59% (0.0648 => 0.0749, std.dev.: 0.0033) MultiSource/Applications/lua/lua: 15.51% (3.8723 => 4.4730, std.dev.: 0.1283) MultiSource/Benchmarks/Olden/health/health: 15.30% (0.1268 => 0.1462, std.dev.: 0.0070) SingleSource/UnitTests/ObjC++/Hello: 15.14% (0.5925 => 0.6822, std.dev.: 0.0266) MultiSource/Applications/aha/aha: 15.12% (0.1151 => 0.1325, std.dev.: 0.0050) MultiSource/Applications/lambda-0_1_3/lambda: 14.88% (0.7433 => 0.8539, std.dev.: 0.0316) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.64% (5.0018 => 5.7341, std.dev.: 0.1157) MultiSource/Benchmarks/Bullet/bullet: 14.57% (63.2438 => 72.4604, std.dev.: 0.2502) SingleSource/UnitTests/ObjC/for-in: 14.19% (0.3694 => 0.4218, std.dev.: 0.0203) MultiSource/Applications/spiff/spiff: 14.13% (0.7835 => 0.8942, std.dev.: 0.0429) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.01% (0.5981 => 0.6819, std.dev.: 0.0238) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.90% (0.1029 => 0.1172, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.84% (0.1062 => 0.1209, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.81% (0.5569 => 0.6338, std.dev.: 0.0244) SingleSource/UnitTests/ObjC++/property-reference-object: 13.23% (0.6030 => 0.6828, std.dev.: 0.0206) SingleSource/UnitTests/ObjC/exceptions: 13.14% (0.3828 => 0.4331, std.dev.: 0.0184) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.93% (1.5859 => 1.7909, std.dev.: 0.0466) SingleSource/Benchmarks/Misc-C++/Large/ray: 12.62% (0.4064 => 0.4577, std.dev.: 0.0182) SingleSource/UnitTests/ObjC/exceptions-4: 12.59% (0.3543 => 0.3989, std.dev.: 0.0165) SingleSource/UnitTests/ObjC/exceptions-2: 12.53% (0.3497 => 0.3935, std.dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.21% (0.1695 => 0.1902, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.93% (0.3865 => 0.4326, std.dev.: 0.0044) SingleSource/UnitTests/ObjC++/property-reference: 11.92% (0.7326 => 0.8199, std.dev.: 0.0251) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.29% (0.1143 => 0.1272, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/sieve: 11.21% (0.3603 => 0.4007, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/fibo: 8.84% (0.2725 => 0.2966, std.dev.: 0.0092) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.95% (7.9617 => 8.5943, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.52% (0.4879 => 0.5246, std.dev.: 0.0110) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.99% (4.3953 => 11.0316, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/methcall: 147.64% (5.3999 => 13.3721, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/17-bintr/bintr: 115.82% (0.1043 => 0.2251, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 46.01% (0.3256 => 0.4754, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/09-vor/vor: 32.15% (0.1154 => 0.1525, std.dev.: 0.0086) MultiSource/Applications/minisat/minisat: 21.79% (9.1159 => 11.1024, std.dev.: 0.7708) SingleSource/Benchmarks/CoyoteBench/fftbench: 21.13% (2.0360 => 2.4662, std.dev.: 0.1433) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.08% (13.4384 => 16.2710, std.dev.: 0.1726) MultiSource/Benchmarks/Olden/perimeter/perimeter: 18.24% (0.2944 => 0.3481, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/oourafft: 17.72% (6.6465 => 7.8241, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.70% (1.1145 => 1.3006, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/moments: 16.31% (0.1159 => 0.1348, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hash2: 14.95% (3.1578 => 3.6300, std.dev.: 0.0147) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.94% (8.6802 => 9.7169, std.dev.: 0.1811) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.79% (2.8904 => 3.2312, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 11.36% (0.9505 => 1.0585, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/richards_benchmark: 10.26% (1.1396 => 1.2565, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.48% (1.7254 => 1.8889, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 8.65% (0.7455 => 0.8100, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/chomp: 6.88% (1.2373 => 1.3224, std.dev.: 0.0287) SingleSource/Benchmarks/Shootout/strcat: 6.06% (0.1899 => 0.2014, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.00% (3.6395 => 3.8577, std.dev.: 0.0176) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.66% (4.2280 => 4.4674, std.dev.: 0.0095) SingleSource/Regression/C/uint64_to_float: 5.02% (0.5413 => 0.5685, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.79% (0.3463 => 0.3629, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.6436 => 12.1216, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.53% (0.3540 => 0.3665, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 3.24% (3.2827 => 3.3889, std.dev.: 0.0187) SingleSource/Benchmarks/Dhrystone/dry: 2.62% (2.4116 => 2.4749, std.dev.: 0.0075) MultiSource/Benchmarks/PAQ8p/paq8p: 2.31% (85.0658 => 87.0347, std.dev.: 0.0701) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.16% (1.3677 => 1.3972, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 2.05% (3.1595 => 3.2244, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 1.58% (27.8444 => 28.2854, std.dev.: 0.0405) SingleSource/Benchmarks/Dhrystone/fldry: 1.54% (1.9577 => 1.9879, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout/sieve: 1.51% (5.2139 => 5.2924, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.34% (6.5088 => 6.5960, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.33% (1.0313 => 1.0450, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: 1.19% (5.9798 => 6.0509, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: 1.18% (12.5348 => 12.6824, std.dev.: 0.0558) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1671, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.72% (5.2763 => 1.2284, std.dev.: 0.0594) SingleSource/Benchmarks/Misc/salsa20: -75.83% (0.8651 => 0.2091, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: -44.94% (0.1622 => 0.0893, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.93% (5.3526 => 4.7142, std.dev.: 0.0914) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.21% (5.3855 => 4.7818, std.dev.: 0.1268) MultiSource/Applications/JM/ldecod/ldecod: -9.20% (10.4361 => 9.4762, std.dev.: 0.1607) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.93% (0.3987 => 0.2395, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.53% (0.0506 => 0.0306, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.38% (4.5009 => 2.7733, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: -33.52% (1.1492 => 0.7640, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -28.07% (10.7105 => 7.7043, std.dev.: 0.6571) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.09% (2.6546 => 2.0152, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -19.34% (0.2161 => 0.1743, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4237, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.72% (2.6778 => 2.2837, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.73% (32.5116 => 29.0224, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.73% (1.5660 => 1.4293, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470) MultiSource/Benchmarks/NPB-serial/is/is: -7.01% (9.5636 => 8.8935, std.dev.: 0.0809) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.94% (4.8142 => 4.4800, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.2416 => 3.0210, std.dev.: 0.0283) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7497, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.54% (2.7294 => 2.5781, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -5.10% (1.5835 => 1.5028, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: -4.23% (6.2999 => 6.0337, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.45% (0.9957 => 0.9613, std.dev.: 0.0079) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8914, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.27% (0.4808 => 0.4699, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.61% (8.1563 => 8.0249, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -1.43% (10.2830 => 10.1358, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -7.54% (0.1485 => 0.1373, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.14% (0.2116 => 0.0653, std.dev.: 0.0012) Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 01:46:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 03:46:54 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121117094654.BB92C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5967?compare_to=5964&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5967, Order: 168257, Start Time: 2012-11-17 08:14:23, End Time: 2012-11-17 09:47:15 To: 5964, Order: 168253, Start Time: 2012-11-17 06:14:26, End Time: 2012-11-17 07:47:15 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (170 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1044 (868 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1006, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/salsa20: 2.43% (7.4937 => 7.6760, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/hash2: 2.32% (3.1932 => 3.2674, std.dev.: 0.0088) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.53% (0.1431 => 0.1309, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.19% (0.3821 => 0.3508, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.81% (0.3142 => 0.2928, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: -6.65% (2.4924 => 2.3267, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.56% (0.9542 => 0.8916, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.55% (0.2428 => 0.2269, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.46% (0.3357 => 0.3140, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: -6.10% (9.2283 => 8.6652, std.dev.: 0.0066) MultiSource/Applications/JM/lencod/lencod: -6.09% (16.1920 => 15.2058, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/oourafft: -6.02% (0.2160 => 0.2030, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.01% (0.1796 => 0.1688, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.98% (0.6484 => 0.6096, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.95% (0.9852 => 0.9266, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: -5.92% (0.9179 => 0.8636, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.89% (0.7198 => 0.6774, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.86% (1.0544 => 0.9926, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.80% (0.3658 => 0.3446, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -5.76% (7.0961 => 6.6875, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.76% (1.3722 => 1.2932, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.69% (0.2355 => 0.2221, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.68% (4.0323 => 3.8032, std.dev.: 0.0084) SingleSource/Benchmarks/McGill/chomp: -5.68% (0.1761 => 0.1661, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.67% (1.6364 => 1.5436, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/gs/gs: -5.65% (4.3330 => 4.0882, std.dev.: 0.0159) MultiSource/Applications/lemon/lemon: -5.64% (1.1450 => 1.0804, std.dev.: 0.0023) MultiSource/Benchmarks/sim/sim: -5.61% (0.3406 => 0.3215, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.58% (1.4642 => 1.3825, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.57% (4.8161 => 4.5477, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.57% (3.5339 => 3.3370, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.57% (0.6736 => 0.6361, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.57% (0.2695 => 0.2545, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.56% (6.7716 => 6.3951, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.52% (4.8802 => 4.6110, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.48% (1.2784 => 1.2084, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.47% (1.2300 => 1.1627, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.45% (4.5069 => 4.2611, std.dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: -5.45% (1.1530 => 1.0902, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.43% (0.6293 => 0.5951, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: -5.43% (17.1032 => 16.1745, std.dev.: 0.0202) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.38% (0.7919 => 0.7493, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.37% (0.5805 => 0.5493, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.36% (0.8521 => 0.8064, std.dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: -5.36% (1.3864 => 1.3121, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.32% (0.6660 => 0.6306, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.31% (14.2083 => 13.4538, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.30% (0.6230 => 0.5900, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.28% (0.3483 => 0.3299, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -5.27% (1.2515 => 1.1856, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.26% (0.5859 => 0.5551, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.26% (0.5802 => 0.5497, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.24% (1.2221 => 1.1581, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.24% (0.5863 => 0.5556, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -5.23% (0.2985 => 0.2829, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.22% (0.5591 => 0.5299, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.22% (0.6052 => 0.5736, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.22% (0.2548 => 0.2415, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.18% (0.4515 => 0.4281, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/trivial-interface: -5.17% (0.3812 => 0.3615, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.17% (0.5999 => 0.5689, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/18-imp/imp: -5.17% (0.3581 => 0.3396, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.16% (0.6681 => 0.6336, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.16% (0.7524 => 0.7136, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.14% (0.6260 => 0.5938, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.14% (0.2278 => 0.2161, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.14% (0.2999 => 0.2845, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.13% (1.2210 => 1.1584, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.12% (0.5688 => 0.5397, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: -5.11% (0.2659 => 0.2523, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.11% (0.5857 => 0.5558, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -5.08% (3.5154 => 3.3367, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.07% (0.5478 => 0.5200, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.07% (0.6395 => 0.6071, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -5.06% (0.4033 => 0.3829, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.05% (0.6667 => 0.6330, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.04% (0.4916 => 0.4668, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.04% (0.5575 => 0.5294, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -5.03% (15.5079 => 14.7274, std.dev.: 0.0224) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.03% (0.7339 => 0.6970, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -5.01% (0.3831 => 0.3639, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.01% (0.5849 => 0.5556, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.00% (0.5925 => 0.5629, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.99% (0.3848 => 0.3656, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.99% (0.6676 => 0.6343, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.99% (0.5456 => 0.5184, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.98% (0.4176 => 0.3968, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.96% (0.5705 => 0.5422, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.96% (0.3891 => 0.3698, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.95% (8.0126 => 7.6157, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.95% (0.5941 => 0.5647, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.94% (0.3884 => 0.3692, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -4.91% (15.2527 => 14.5041, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.89% (0.6033 => 0.5738, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.88% (0.5569 => 0.5297, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.86% (0.2385 => 0.2269, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/synchronized: -4.85% (0.3896 => 0.3707, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -4.85% (0.7447 => 0.7086, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.83% (0.6395 => 0.6086, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.83% (0.5570 => 0.5301, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.82% (0.3880 => 0.3693, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.81% (0.5567 => 0.5299, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -4.81% (4.0594 => 3.8641, std.dev.: 0.0137) SingleSource/UnitTests/ObjC/property: -4.81% (0.4199 => 0.3997, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.76% (0.3319 => 0.3161, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.75% (0.6440 => 0.6134, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.75% (1.6474 => 1.5692, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.72% (0.6446 => 0.6142, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.66% (0.5168 => 0.4927, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.58% (22.4056 => 21.3785, std.dev.: 0.0110) MultiSource/Applications/treecc/treecc: -4.58% (2.1401 => 2.0421, std.dev.: 0.0049) MultiSource/Applications/oggenc/oggenc: -4.58% (5.0226 => 4.7928, std.dev.: 0.0061) MultiSource/Applications/siod/siod: -4.57% (2.4021 => 2.2924, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: -4.46% (0.4280 => 0.4089, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -4.43% (0.3271 => 0.3126, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.35% (0.5329 => 0.5097, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.30% (0.7021 => 0.6719, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.25% (0.6304 => 0.6036, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.25% (0.6194 => 0.5931, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.23% (0.6189 => 0.5927, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -4.23% (34.0927 => 32.6507, std.dev.: 0.0441) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.22% (0.6297 => 0.6031, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.17% (2.2587 => 2.1644, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -4.16% (0.7982 => 0.7650, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.15% (0.9077 => 0.8700, std.dev.: 0.0041) MultiSource/Applications/spiff/spiff: -4.09% (0.8418 => 0.8074, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: -4.05% (1.3148 => 1.2615, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.93% (0.4151 => 0.3988, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -3.92% (0.7779 => 0.7474, std.dev.: 0.0036) MultiSource/Applications/kimwitu++/kc: -3.83% (18.2933 => 17.5927, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.76% (0.4813 => 0.4632, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.68% (0.9557 => 0.9205, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: -3.63% (0.3255 => 0.3137, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -3.60% (0.4861 => 0.4686, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.60% (0.3837 => 0.3699, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.51% (0.3016 => 0.2910, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.51% (0.3931 => 0.3793, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.51% (0.3849 => 0.3714, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.48% (0.6441 => 0.6217, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.47% (0.6347 => 0.6127, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.46% (0.3323 => 0.3208, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: -3.46% (0.4248 => 0.4101, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.41% (0.3252 => 0.3141, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -3.38% (0.3194 => 0.3086, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.38% (0.3491 => 0.3373, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.38% (0.4321 => 0.4175, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: -3.37% (0.3025 => 0.2923, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.34% (2.1713 => 2.0987, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/except: -3.34% (0.3026 => 0.2925, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -3.28% (0.3867 => 0.3740, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.22% (5.4682 => 5.2920, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: -3.20% (0.6750 => 0.6534, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -3.19% (0.3446 => 0.3336, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -3.18% (0.3394 => 0.3286, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.16% (0.4427 => 0.4287, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -3.12% (0.3621 => 0.3508, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary2: -3.05% (0.3481 => 0.3375, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.04% (0.4083 => 0.3959, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -3.03% (0.4524 => 0.4387, std.dev.: 0.0029) SingleSource/UnitTests/Vector/constpool: -2.74% (20.7746 => 20.2048, std.dev.: 0.0311) SingleSource/Benchmarks/Shootout-C++/sieve: -2.69% (0.3788 => 0.3686, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -2.57% (1.5610 => 1.5209, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7534, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: -8.70% (1.2842 => 1.1725, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7070, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.63% (2.2633 => 2.1812, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4682, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 02:46:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 04:46:43 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121117104643.414A22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5968?compare_to=5965&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5968, Order: 168257, Start Time: 2012-11-17 09:17:47, End Time: 2012-11-17 10:47:05 To: 5965, Order: 168256, Start Time: 2012-11-17 07:31:52, End Time: 2012-11-17 09:00:55 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 9 (102 on baseline) Performance Improvements: 2 (27 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 983 (845 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.54% (0.3013 => 0.3210, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: 4.84% (0.2274 => 0.2384, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.81% (0.8656 => 0.9072, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.61% (0.8579 => 0.8717, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.10% (1.0136 => 1.0247, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 9.72% (0.1595 => 0.1750, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/distray/distray: 5.70% (0.2298 => 0.2429, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.05% (44.4800 => 45.3925, std.dev.: 0.1900) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.18% (1.2679 => 1.2828, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.15% (6.9029 => 6.8232, std.dev.: 0.0223) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.09% (4.6914 => 4.6402, std.dev.: 0.0164) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.71% (17.0770 => 16.9554, std.dev.: 0.1014) MultiSource/Applications/obsequi/Obsequi: -1.08% (1.0624 => 1.0509, std.dev.: 0.0130) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.36% (22.2139 => 22.1338, std.dev.: 0.1947) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.32% (0.3702 => 0.3714, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/bigfib: -0.24% (0.6163 => 0.6148, std.dev.: 0.0342) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.21% (0.3384 => 0.3391, std.dev.: 0.0246) SingleSource/Benchmarks/Shootout-C++/strcat: -0.05% (0.2016 => 0.2015, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -11.18% (0.0152 => 0.0135, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -11.16% (0.0430 => 0.0382, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 16.25% (0.0283 => 0.0329, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -8.28% (0.0314 => 0.0288, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -16.59% (0.0428 => 0.0357, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/casts: 13.26% (0.0181 => 0.0205, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 26.06% (0.0142 => 0.0179, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1472 => 0.1471, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -4.44% (1.1771 => 1.1248, std.dev.: 0.0183) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.40% (0.4131 => 0.4354, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.21% (0.1438 => 0.1441, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 14.41% (0.0562 => 0.0643, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.80% (0.0214 => 0.0220, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.30% (0.0613 => 0.0556, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.33% (1.1920 => 1.1959, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -95.24% (0.0021 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.65% (0.0605 => 0.0615, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 28.71% (0.0202 => 0.0260, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.01% (0.7816 => 0.7817, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -39.06% (0.0064 => 0.0039, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2308.70% (0.6332 => 15.2519, std.dev.: 0.1431) MultiSource/Benchmarks/McCat/08-main/main: 48.17% (0.1831 => 0.2713, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.15% (0.1559 => 0.1432, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1523.80% (0.3344 => 5.4300, std.dev.: 0.2689) SingleSource/Benchmarks/Misc-C++/Large/ray: 39.00% (0.2364 => 0.3286, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/mandel: 3.50% (0.0429 => 0.0444, std.dev.: 0.0129) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.04% (0.0224 => 0.0242, std.dev.: 0.0011) SingleSource/UnitTests/byval-alignment: -29.13% (0.0230 => 0.0163, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 5.95% (0.1462 => 0.1549, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4648, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0753, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4952, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3173, std.dev.: 0.0245) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1325, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4045, std.dev.: 0.0316) SingleSource/Regression/C/uint64_to_float: -23.81% (2.1832 => 1.6634, std.dev.: 0.0016) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.88% (0.0810 => 0.0971, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 16.28% (0.1112 => 0.1293, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.29% (0.0830 => 0.0932, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.08% (0.2180 => 0.2378, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.03% (0.8321 => 0.9072, std.dev.: 0.0150) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.35% (0.1905 => 0.2064, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.65% (0.1425 => 0.1534, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.57% (0.1466 => 0.1577, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.30% (0.2519 => 0.2703, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.07% (0.2998 => 0.3210, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.61% (0.2240 => 0.2388, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.54% (0.7473 => 0.7962, std.dev.: 0.0166) MultiSource/Applications/spiff/spiff: 6.00% (0.7950 => 0.8427, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.97% (1.1606 => 1.2183, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.85% (1.1685 => 1.2252, std.dev.: 0.0165) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.74% (0.2133 => 0.2234, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.46% (0.5961 => 0.6227, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.19% (0.4127 => 0.4300, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: 4.09% (1.4269 => 1.4853, std.dev.: 0.0143) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.08% (0.6227 => 0.6481, std.dev.: 0.0074) MultiSource/Applications/lua/lua: 4.00% (3.8189 => 3.9717, std.dev.: 0.0284) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.81% (1.1170 => 1.1596, std.dev.: 0.0071) MultiSource/Benchmarks/Bullet/bullet: 3.79% (31.8598 => 33.0679, std.dev.: 0.0534) MultiSource/Benchmarks/MallocBench/gs/gs: 3.67% (4.1305 => 4.2819, std.dev.: 0.0492) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.66% (0.4559 => 0.4726, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.42% (0.9908 => 1.0247, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.37% (0.4783 => 0.4944, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.34% (4.1763 => 4.3157, std.dev.: 0.0273) MultiSource/Benchmarks/nbench/nbench: 3.28% (1.1271 => 1.1641, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.27% (6.6074 => 6.8232, std.dev.: 0.0223) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.22% (1.4479 => 1.4945, std.dev.: 0.0070) MultiSource/Applications/hexxagon/hexxagon: 3.19% (0.9810 => 1.0123, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 3.16% (14.7684 => 15.2356, std.dev.: 0.0711) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.15% (0.3717 => 0.3834, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.14% (0.9069 => 0.9354, std.dev.: 0.0044) MultiSource/Applications/SIBsim4/SIBsim4: 3.12% (1.2568 => 1.2960, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.10% (0.9074 => 0.9355, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.07% (0.8457 => 0.8717, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.94% (2.1401 => 2.2031, std.dev.: 0.0196) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.93% (1.2526 => 1.2893, std.dev.: 0.0102) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.91% (4.4880 => 4.6187, std.dev.: 0.0441) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.89% (0.8317 => 0.8557, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.88% (1.6386 => 1.6858, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.86% (13.1811 => 13.5576, std.dev.: 0.0922) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.81% (0.9688 => 0.9960, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.69% (4.4873 => 4.6078, std.dev.: 0.0422) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.68% (0.8611 => 0.8842, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.68% (0.8331 => 0.8554, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.62% (0.8597 => 0.8822, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.57% (0.8066 => 0.8273, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.54% (0.8518 => 0.8734, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.52% (0.8716 => 0.8936, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.52% (0.8177 => 0.8383, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.49% (0.6586 => 0.6750, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.46% (0.8286 => 0.8490, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.43% (0.9039 => 0.9259, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.42% (0.8338 => 0.8540, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 2.42% (8.6247 => 8.8330, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.41% (0.8805 => 0.9017, std.dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: 2.41% (15.3280 => 15.6969, std.dev.: 0.1340) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.36% (0.8995 => 0.9207, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.35% (0.8712 => 0.8917, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.34% (0.9056 => 0.9268, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.32% (0.8885 => 0.9091, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.31% (0.8359 => 0.8552, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.24% (0.8050 => 0.8230, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.23% (0.8656 => 0.8849, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.22% (0.8204 => 0.8386, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.19% (0.8261 => 0.8442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.18% (0.8316 => 0.8497, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 2.17% (0.7557 => 0.7721, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: 2.13% (0.8768 => 0.8955, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.06% (0.8048 => 0.8214, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.03% (0.7966 => 0.8128, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.00% (0.8007 => 0.8167, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.80% (0.7932 => 0.8075, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.53% (4.5702 => 4.6402, std.dev.: 0.0164) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 112.56% (0.0199 => 0.0423, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/pi: 57.59% (1.5795 => 2.4891, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.82% (0.7597 => 0.8951, std.dev.: 0.0265) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.34% (2.9753 => 3.4615, std.dev.: 0.0288) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.57% (2.7995 => 3.2074, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.51% (5.0261 => 5.6046, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/queens: 7.27% (1.7056 => 1.8296, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/richards_benchmark: 6.86% (1.3037 => 1.3931, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.75% (4.7794 => 5.1018, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 6.05% (3.1873 => 3.3801, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.88% (4.9686 => 5.2610, std.dev.: 0.0661) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.87% (4.5327 => 4.7989, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: 4.98% (7.4933 => 7.8666, std.dev.: 0.0358) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.71% (3.3761 => 3.5350, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.14% (4.9453 => 5.1502, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.00% (4.9469 => 5.1450, std.dev.: 0.0179) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.98% (1.2337 => 1.2828, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.81% (14.0064 => 14.5396, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.80% (11.5690 => 11.8928, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.78% (8.2783 => 8.5087, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/lists: 2.56% (7.3375 => 7.5250, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.29% (4.8660 => 4.9775, std.dev.: 0.0330) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.15% (4.8362 => 4.9402, std.dev.: 0.0255) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.87% (44.5605 => 45.3925, std.dev.: 0.1900) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.66% (1.1365 => 1.1554, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -37.28% (0.0338 => 0.0212, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/em3d/em3d: -20.90% (5.4641 => 4.3222, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.46% (7.2130 => 6.2420, std.dev.: 0.3457) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.03% (1.0512 => 0.9353, std.dev.: 0.0055) SingleSource/Benchmarks/McGill/chomp: -10.93% (1.1216 => 0.9990, std.dev.: 0.0327) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.65% (14.6451 => 13.2324, std.dev.: 0.1422) MultiSource/Benchmarks/mafft/pairlocalalign: -8.53% (63.1822 => 57.7945, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -7.01% (4.7482 => 4.4154, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.21% (3.7148 => 3.4841, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.15% (0.3269 => 0.3068, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.94% (5.4972 => 5.1706, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.21% (5.1557 => 4.8869, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.43% (4.7449 => 4.5345, std.dev.: 0.0235) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.76% (6.0224 => 5.7959, std.dev.: 0.0087) MultiSource/Applications/lua/lua: -3.37% (29.8330 => 28.8266, std.dev.: 0.1385) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (28.5821 => 27.6727, std.dev.: 0.1203) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.94% (0.5807 => 0.5636, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.75% (2.6356 => 2.5631, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.60% (9.9065 => 9.6488, std.dev.: 0.0301) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -2.57% (0.3937 => 0.3836, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bisort/bisort: -2.41% (0.6636 => 0.6476, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash2: -2.38% (3.4237 => 3.3423, std.dev.: 0.0253) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (11.5316 => 11.2991, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.79% (3.2169 => 3.1594, std.dev.: 0.0067) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.62% (2.3487 => 2.3107, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.60% (4.9994 => 4.9192, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.15% (5.6343 => 5.5695, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 3.10% (16.4461 => 16.9554, std.dev.: 0.1014) MultiSource/Applications/obsequi/Obsequi: 2.41% (1.0262 => 1.0509, std.dev.: 0.0130) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6987.35% (0.3123 => 22.1338, std.dev.: 0.1947) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.79% (0.2463 => 0.3714, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/bigfib: 2.30% (0.6010 => 0.6148, std.dev.: 0.0342) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.83% (0.3266 => 0.3391, std.dev.: 0.0246) SingleSource/Benchmarks/Shootout-C++/strcat: 2.34% (0.1969 => 0.2015, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 9.76% (0.0123 => 0.0135, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -6.37% (0.0408 => 0.0382, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.53% (0.0254 => 0.0329, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -4.64% (0.0302 => 0.0288, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.03% (0.0384 => 0.0357, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -0.56% (0.0180 => 0.0179, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.29% (0.1438 => 0.1471, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.71% (1.1329 => 1.1248, std.dev.: 0.0183) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.56% (0.4164 => 0.4354, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.26% (0.1369 => 0.1441, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.31% (0.0641 => 0.0643, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.82% (0.0195 => 0.0220, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.81% (0.0578 => 0.0556, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.56% (1.1437 => 1.1959, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.91% (0.0627 => 0.0615, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 44.44% (0.0180 => 0.0260, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.49% (0.8017 => 0.7817, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -37.10% (0.0062 => 0.0039, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 02:48:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 04:48:28 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121117104828.95AEF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5969?compare_to=5962&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5969, Order: 168254, Start Time: 2012-11-17 07:24:23, End Time: 2012-11-17 10:48:48 To: 5962, Order: 168241, Start Time: 2012-11-17 03:17:03, End Time: 2012-11-17 06:36:29 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (167 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (136 on baseline) Unchanged Tests: 1042 (724 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.68% (126.0759 => 129.4568, std.dev.: 0.7513) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.51% (54.0156 => 54.8313, std.dev.: 0.0504) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.20% (0.0625 => 0.0870, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.33% (0.1063 => 0.1396, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.26% (0.4253 => 0.5370, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.20% (0.2969 => 0.3747, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.14% (0.0547 => 0.0690, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.77% (0.1106 => 0.1391, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.35% (0.0714 => 0.0895, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.81% (0.4139 => 0.5166, std.dev.: 0.0251) MultiSource/Applications/oggenc/oggenc: 24.59% (1.5932 => 1.9850, std.dev.: 0.0309) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.24% (0.5900 => 0.7330, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.97% (0.0584 => 0.0724, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.82% (0.5000 => 0.6191, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.81% (0.4994 => 0.6183, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.63% (0.0584 => 0.0722, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.58% (0.0475 => 0.0587, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.65% (0.1620 => 0.1987, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.53% (0.1021 => 0.1251, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.31% (0.1107 => 0.1354, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.21% (0.1103 => 0.1348, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/tsp/tsp: 22.20% (0.0599 => 0.0732, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.19% (0.0897 => 0.1096, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.43% (0.1549 => 0.1881, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.33% (0.0633 => 0.0768, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/em3d/em3d: 21.10% (0.0948 => 0.1148, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.03% (0.0642 => 0.0777, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.64% (0.1003 => 0.1210, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.56% (0.0822 => 0.0991, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.47% (0.3903 => 0.4702, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/health/health: 20.46% (0.0821 => 0.0989, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.40% (0.0495 => 0.0596, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/05-eks/eks: 20.38% (0.1619 => 0.1949, std.dev.: 0.0124) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.07% (0.1604 => 0.1926, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724, std.dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: 19.31% (0.0808 => 0.0964, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/09-vor/vor: 19.27% (0.1505 => 0.1795, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.08% (0.1462 => 0.1741, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.97% (0.1160 => 0.1380, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/08-main/main: 18.72% (0.1218 => 0.1446, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.72% (0.2014 => 0.2391, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.61% (0.3890 => 0.4614, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.39% (0.2866 => 0.3393, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.37% (1.3152 => 1.5568, std.dev.: 0.0052) MultiSource/Applications/spiff/spiff: 18.27% (0.4029 => 0.4765, std.dev.: 0.0178) MultiSource/Benchmarks/Olden/mst/mst: 18.19% (0.0698 => 0.0825, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.17% (0.2736 => 0.3233, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 18.04% (0.5826 => 0.6877, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.83% (0.0572 => 0.0674, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.83% (0.1088 => 0.1282, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.73% (3.5627 => 4.1945, std.dev.: 0.0953) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.69% (0.0605 => 0.0712, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 17.63% (0.5889 => 0.6927, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 17.58% (0.5546 => 0.6521, std.dev.: 0.0185) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.48% (0.3930 => 0.4617, std.dev.: 0.0193) MultiSource/Benchmarks/MallocBench/gs/gs: 17.46% (1.8794 => 2.2076, std.dev.: 0.0994) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.37% (1.6211 => 1.9027, std.dev.: 0.0652) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.07% (0.1968 => 0.2304, std.dev.: 0.0111) MultiSource/Applications/d/make_dparser: 16.97% (1.0781 => 1.2610, std.dev.: 0.0348) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.94% (0.4658 => 0.5447, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: 16.82% (0.1284 => 0.1500, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.81% (0.3271 => 0.3821, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.77% (0.2875 => 0.3357, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 16.71% (0.9697 => 1.1317, std.dev.: 0.0366) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.59% (2.7292 => 3.1821, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.44% (0.4361 => 0.5078, std.dev.: 0.0135) MultiSource/Applications/ClamAV/clamscan: 16.33% (4.2109 => 4.8986, std.dev.: 0.1551) SingleSource/UnitTests/ObjC++/property-reference: 16.27% (0.7171 => 0.8338, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.26% (4.4195 => 5.1383, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.16% (0.5026 => 0.5838, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/strcat: 16.00% (0.2750 => 0.3190, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 16.00% (0.9909 => 1.1494, std.dev.: 0.0405) SingleSource/Benchmarks/Shootout-C++/matrix: 15.90% (0.2780 => 0.3222, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.87% (0.2729 => 0.3162, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 15.85% (0.2725 => 0.3157, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 15.81% (0.2714 => 0.3143, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.78% (0.2738 => 0.3170, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.75% (1.9694 => 2.2796, std.dev.: 0.0036) SingleSource/Regression/C++/ofstream_ctor: 15.75% (0.3004 => 0.3477, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 15.73% (0.2823 => 0.3267, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 15.71% (0.2566 => 0.2969, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 15.66% (0.2803 => 0.3242, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 15.65% (0.2811 => 0.3251, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.62% (0.3488 => 0.4033, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.58% (1.9966 => 2.3076, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.54% (0.2792 => 0.3226, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 15.48% (23.5202 => 27.1610, std.dev.: 0.0397) SingleSource/Benchmarks/Shootout-C++/methcall: 15.46% (0.2813 => 0.3248, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 15.46% (0.2691 => 0.3107, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.41% (2.0673 => 2.3858, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.32% (0.2911 => 0.3357, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.31% (0.3195 => 0.3684, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 15.28% (0.3096 => 0.3569, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 15.19% (0.3469 => 0.3996, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 15.16% (0.3496 => 0.4026, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 15.15% (0.3446 => 0.3968, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 15.12% (0.3460 => 0.3983, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 15.06% (0.3465 => 0.3987, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.05% (0.1090 => 0.1254, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/trivial-interface: 14.99% (0.3442 => 0.3958, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 14.89% (0.2075 => 0.2384, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary3: 14.88% (0.3267 => 0.3753, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 14.86% (0.3258 => 0.3742, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 14.82% (0.3650 => 0.4191, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.63% (0.3362 => 0.3854, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 14.59% (0.3317 => 0.3801, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 14.55% (0.3643 => 0.4173, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 14.54% (1.4269 => 1.6343, std.dev.: 0.0641) SingleSource/Benchmarks/Shootout-C++/moments: 14.52% (0.3678 => 0.4212, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.51% (0.3060 => 0.3504, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 14.47% (0.3724 => 0.4263, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.37% (0.3124 => 0.3573, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 14.32% (0.3477 => 0.3975, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.17% (0.3282 => 0.3747, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/hash: 14.16% (0.4146 => 0.4733, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 13.95% (0.3348 => 0.3815, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 13.94% (0.7875 => 0.8973, std.dev.: 0.0330) MultiSource/Applications/JM/ldecod/ldecod: 13.85% (2.1653 => 2.4653, std.dev.: 0.0820) MultiSource/Applications/JM/lencod/lencod: 13.82% (4.6177 => 5.2560, std.dev.: 0.1621) SingleSource/Benchmarks/Shootout-C++/sieve: 13.77% (0.3726 => 0.4239, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.71% (0.3625 => 0.4122, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.39% (0.3690 => 0.4184, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.36% (0.3981 => 0.4513, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 13.34% (2.1013 => 2.3817, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: 13.29% (0.4251 => 0.4816, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.24% (0.3845 => 0.4354, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.14% (0.2040 => 0.2308, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/bigfib: 12.61% (0.5012 => 0.5644, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 12.28% (5.5417 => 6.2220, std.dev.: 0.1292) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.67% (0.6435 => 0.7186, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.57% (0.1383 => 0.1543, std.dev.: 0.0019) MultiSource/Applications/siod/siod: 11.17% (0.6634 => 0.7375, std.dev.: 0.0194) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.93% (0.2068 => 0.2294, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.70% (0.1028 => 0.1138, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.63% (0.2737 => 0.3028, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 10.56% (0.4847 => 0.5359, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 10.13% (2.0346 => 2.2408, std.dev.: 0.0412) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.05% (0.3084 => 0.3394, std.dev.: 0.0110) MultiSource/Applications/lemon/lemon: 10.04% (0.2391 => 0.2631, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.42% (0.2103 => 0.2301, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.38% (0.5361 => 0.5810, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.37% (4.6926 => 5.0855, std.dev.: 0.0124) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.27% (11.6398 => 12.6023, std.dev.: 0.0251) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.79% (0.5584 => 0.6019, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.54% (0.7426 => 0.7986, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 6.58% (11.9555 => 12.7417, std.dev.: 0.2542) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.62% (0.3792 => 0.4005, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.29% (0.2162 => 0.3552, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.96% (0.2802 => 0.3081, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: 7.07% (0.2122 => 0.2272, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.58% (3.3903 => 3.6135, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.12% (0.3693 => 0.3919, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6719, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/flops: 4.65% (15.4430 => 16.1615, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-2: 4.33% (1.8057 => 1.8838, std.dev.: 0.0058) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6418, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1967, std.dev.: 0.0048) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.64% (3.1722 => 3.2242, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.48% (7.1849 => 7.2913, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3000, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.05% (2.4764 => 2.4504, std.dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.74% (25.4195 => 16.5894, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary2: -10.07% (0.2402 => 0.2160, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9763, std.dev.: 0.0368) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7941, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/tsp/tsp: -7.18% (2.1113 => 1.9597, std.dev.: 0.0169) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0017) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8048, std.dev.: 0.0055) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std.dev.: 0.0242) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -2.82% (17.2379 => 16.7518, std.dev.: 0.0718) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8581, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5745, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.72% (0.6293 => 0.6185, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.2071, std.dev.: 0.0694) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.03% (16.2163 => 16.0486, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 03:44:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 05:44:39 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121117114439.2146A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5970?compare_to=5967&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5970, Order: 168258, Start Time: 2012-11-17 10:10:23, End Time: 2012-11-17 11:44:58 To: 5967, Order: 168257, Start Time: 2012-11-17 08:14:23, End Time: 2012-11-17 09:47:15 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (167 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1043 (869 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.60% (54.5657 => 56.5291, std.dev.: 0.3376) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.58% (54.5751 => 56.5291, std.dev.: 0.3376) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.89% (2.0478 => 2.1069, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.4937 => 7.6865, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/hash2: 2.30% (3.1932 => 3.2668, std.dev.: 0.0172) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.01% (1.5103 => 1.5256, std.dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.46% (0.1431 => 0.1310, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.96% (0.3821 => 0.3517, std.dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: -6.67% (2.4924 => 2.3261, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -6.49% (0.3357 => 0.3139, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.43% (0.2428 => 0.2272, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.36% (0.9542 => 0.8935, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: -6.06% (9.2283 => 8.6695, std.dev.: 0.0060) MultiSource/Applications/JM/lencod/lencod: -6.03% (16.1920 => 15.2159, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/ReedSolomon: -6.01% (0.1879 => 0.1766, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.01% (0.1796 => 0.1688, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.91% (0.9852 => 0.9270, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -5.88% (7.0961 => 6.6790, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.88% (0.6484 => 0.6103, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.85% (0.7198 => 0.6777, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.83% (1.0544 => 0.9929, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.83% (0.1716 => 0.1616, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -5.82% (0.3812 => 0.3590, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.77% (1.3722 => 1.2930, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.77% (0.3658 => 0.3447, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: -5.75% (0.4033 => 0.3801, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -5.72% (0.3880 => 0.3658, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.70% (0.3896 => 0.3674, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.68% (0.3891 => 0.3670, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -5.68% (0.4176 => 0.3939, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.67% (0.3406 => 0.3213, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -5.67% (0.3848 => 0.3630, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: -5.66% (0.3831 => 0.3614, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.64% (0.3884 => 0.3665, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.63% (4.0323 => 3.8052, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.62% (3.5339 => 3.3352, std.dev.: 0.0589) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.62% (4.8161 => 4.5455, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.60% (0.2695 => 0.2544, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -5.59% (1.1450 => 1.0810, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: -5.59% (0.9179 => 0.8666, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.56% (0.2355 => 0.2224, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.52% (6.7716 => 6.3980, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.51% (0.6736 => 0.6365, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.50% (0.5805 => 0.5486, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.48% (1.6364 => 1.5468, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: -5.47% (4.3330 => 4.0962, std.dev.: 0.0142) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.46% (4.8802 => 4.6137, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.44% (1.2784 => 1.2088, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.44% (1.4642 => 1.3845, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.44% (4.5069 => 4.2619, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.43% (0.7919 => 0.7489, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/property: -5.43% (0.4199 => 0.3971, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.42% (0.6681 => 0.6319, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.41% (0.6660 => 0.6300, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -5.40% (17.1032 => 16.1804, std.dev.: 0.0251) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.39% (0.5863 => 0.5547, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.37% (0.6293 => 0.5955, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: -5.37% (1.1530 => 1.0911, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.36% (0.5802 => 0.5491, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.31% (0.5591 => 0.5294, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.30% (14.2083 => 13.4559, std.dev.: 0.0163) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.29% (0.8521 => 0.8070, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.25% (0.6395 => 0.6059, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: -5.25% (0.4515 => 0.4278, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.24% (0.6676 => 0.6326, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.24% (0.5478 => 0.5191, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.23% (0.5999 => 0.5685, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: -5.23% (0.2659 => 0.2520, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -5.23% (0.2985 => 0.2829, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.22% (0.2548 => 0.2415, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: -5.21% (1.3864 => 1.3141, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.21% (0.5849 => 0.5544, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: -5.21% (1.2515 => 1.1863, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.21% (0.5857 => 0.5552, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.20% (1.2300 => 1.1660, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.20% (0.3483 => 0.3302, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.19% (8.0126 => 7.5966, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.18% (0.6230 => 0.5907, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.18% (0.2278 => 0.2160, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.18% (0.6260 => 0.5936, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.17% (0.5705 => 0.5410, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: -5.17% (0.3581 => 0.3396, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.16% (0.6052 => 0.5740, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.15% (0.5688 => 0.5395, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: -5.14% (0.4280 => 0.4060, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.13% (0.5575 => 0.5289, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.12% (0.5859 => 0.5559, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.12% (0.7524 => 0.7139, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.05% (1.2210 => 1.1593, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.04% (0.2999 => 0.2848, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.03% (0.5581 => 0.5300, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: -5.02% (15.5079 => 14.7287, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.02% (0.6395 => 0.6074, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.00% (0.4916 => 0.4670, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.99% (0.5569 => 0.5291, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.99% (1.2221 => 1.1611, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.92% (0.6667 => 0.6339, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.92% (0.7339 => 0.6978, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.91% (0.5456 => 0.5188, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -4.90% (3.5154 => 3.3433, std.dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: -4.90% (15.2527 => 14.5060, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.83% (0.5567 => 0.5298, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.83% (0.5941 => 0.5654, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.82% (0.6033 => 0.5742, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -4.82% (4.0594 => 3.8639, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.78% (0.6446 => 0.6138, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.77% (0.6440 => 0.6133, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.71% (1.6474 => 1.5698, std.dev.: 0.0122) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.70% (0.2385 => 0.2273, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.69% (0.5570 => 0.5309, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.63% (22.4056 => 21.3672, std.dev.: 0.0094) MultiSource/Applications/minisat/minisat: -4.61% (0.7447 => 0.7104, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/09-vor/vor: -4.59% (0.3271 => 0.3121, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -4.49% (1.3148 => 1.2557, std.dev.: 0.0197) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.43% (0.3319 => 0.3172, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.43% (0.5329 => 0.5093, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.34% (0.6297 => 0.6024, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -4.33% (2.4021 => 2.2981, std.dev.: 0.0032) MultiSource/Applications/treecc/treecc: -4.32% (2.1401 => 2.0476, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -4.30% (0.7982 => 0.7639, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.29% (0.6194 => 0.5928, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.27% (0.6189 => 0.5925, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.25% (0.6304 => 0.6036, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -4.23% (0.8418 => 0.8062, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: -4.21% (0.3255 => 0.3118, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.12% (0.3837 => 0.3679, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -4.11% (0.4861 => 0.4661, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.11% (0.3016 => 0.2892, std.dev.: 0.0045) MultiSource/Benchmarks/Bullet/bullet: -4.05% (34.0927 => 32.7115, std.dev.: 0.0828) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.03% (0.3252 => 0.3121, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.02% (0.3931 => 0.3773, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.00% (0.9557 => 0.9175, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/ary3: -3.98% (0.3446 => 0.3309, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -3.97% (0.6347 => 0.6095, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: -3.97% (0.3026 => 0.2906, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: -3.94% (0.3194 => 0.3068, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.93% (2.1713 => 2.0859, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.93% (0.9077 => 0.8720, std.dev.: 0.0047) SingleSource/Regression/C++/ofstream_ctor: -3.89% (0.3059 => 0.2940, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -3.89% (0.3394 => 0.3262, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: -3.87% (0.6441 => 0.6192, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.86% (0.4813 => 0.4627, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.82% (0.3323 => 0.3196, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: -3.82% (18.2933 => 17.5942, std.dev.: 0.0193) MultiSource/Applications/oggenc/oggenc: -3.80% (5.0226 => 4.8318, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/lists1: -3.78% (0.3867 => 0.3721, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.72% (0.2933 => 0.2824, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.70% (0.3057 => 0.2944, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/strcat: -3.68% (0.2989 => 0.2879, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.68% (0.4321 => 0.4162, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/random: -3.67% (0.2939 => 0.2831, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.67% (0.3491 => 0.3363, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/fibo: -3.62% (0.2871 => 0.2767, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.59% (0.4427 => 0.4268, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary2: -3.59% (0.3481 => 0.3356, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -3.59% (0.3621 => 0.3491, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.55% (0.2903 => 0.2800, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -3.55% (0.7779 => 0.7503, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: -3.46% (0.3205 => 0.3094, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.43% (0.4083 => 0.3943, std.dev.: 0.0032) MultiSource/Applications/hbd/hbd: -3.32% (1.5610 => 1.5091, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: -3.27% (0.3788 => 0.3664, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash: -2.76% (0.4524 => 0.4399, std.dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -2.34% (20.7746 => 20.2893, std.dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.51% (7.5137 => 5.7476, std.dev.: 0.0170) SingleSource/Benchmarks/Misc/richards_benchmark: -8.75% (1.2842 => 1.1718, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.67% (2.2633 => 2.1803, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0074) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.49% (6.5735 => 6.4758, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 04:37:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 06:37:08 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121117123708.4ED992A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5971?compare_to=5968&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5971, Order: 168258, Start Time: 2012-11-17 11:08:45, End Time: 2012-11-17 12:37:30 To: 5968, Order: 168257, Start Time: 2012-11-17 09:17:47, End Time: 2012-11-17 10:47:05 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 5 (126 on baseline) Performance Improvements: 2 (28 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 987 (820 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.38% (0.5923 => 0.6064, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.10% (5.4300 => 5.5441, std.dev.: 0.0063) MultiSource/Applications/hbd/hbd: 1.26% (1.4853 => 1.5040, std.dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 9.38% (1.7221 => 1.8837, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.26% (21.0761 => 21.9736, std.dev.: 0.2552) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.62% (0.6481 => 0.6311, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.27% (1.0247 => 1.0117, std.dev.: 0.0041) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.16% (16.9554 => 16.9284, std.dev.: 0.0136) MultiSource/Applications/obsequi/Obsequi: 0.55% (1.0509 => 1.0567, std.dev.: 0.0128) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.36% (22.1338 => 22.0534, std.dev.: 0.2620) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.13% (0.3714 => 0.3635, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: -0.60% (0.6148 => 0.6111, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.56% (0.3391 => 0.3372, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 0.74% (0.2015 => 0.2030, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 25.93% (0.0135 => 0.0170, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 12.04% (0.0382 => 0.0428, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.91% (0.0329 => 0.0326, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 9.72% (0.0288 => 0.0316, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 20.17% (0.0357 => 0.0429, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0205 => 0.0206, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -3.35% (0.0179 => 0.0173, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.88% (0.1471 => 0.1484, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.09% (1.1248 => 1.1125, std.dev.: 0.0489) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.23% (0.4354 => 0.4170, std.dev.: 0.0248) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.85% (0.1441 => 0.1400, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.98% (0.0643 => 0.0566, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.82% (0.0220 => 0.0194, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.50% (0.0556 => 0.0581, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.34% (1.1959 => 1.1918, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1400.00% (0.0001 => 0.0015, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.88% (0.0615 => 0.0585, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.15% (0.0260 => 0.0231, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.7817 => 0.7817, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 105.13% (0.0039 => 0.0080, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2308.01% (0.6332 => 15.2475, std.dev.: 0.0599) MultiSource/Benchmarks/McCat/08-main/main: 51.23% (0.1831 => 0.2769, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.41% (0.1559 => 0.1459, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1557.92% (0.3344 => 5.5441, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.82% (0.2364 => 0.3258, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -0.70% (0.0429 => 0.0426, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -5.36% (0.0224 => 0.0212, std.dev.: 0.0015) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 8.48% (0.1462 => 0.1586, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4692, std.dev.: 0.0178) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0670, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4884, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3171, std.dev.: 0.0539) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1321, std.dev.: 0.0329) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4060, std.dev.: 0.0019) SingleSource/Regression/C/uint64_to_float: -24.23% (2.1832 => 1.6542, std.dev.: 0.0058) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.41% (0.0810 => 0.0951, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.06% (0.0830 => 0.0955, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 10.97% (0.1112 => 0.1234, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.59% (0.1137 => 0.1246, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.40% (0.8321 => 0.9020, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.16% (0.2279 => 0.2465, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.31% (0.1983 => 0.2128, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.86% (0.7473 => 0.7986, std.dev.: 0.0053) MultiSource/Applications/viterbi/viterbi: 6.53% (0.1577 => 0.1680, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.31% (0.2519 => 0.2678, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/em3d/em3d: 6.16% (0.1721 => 0.1827, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.67% (0.2998 => 0.3168, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.64% (0.3295 => 0.3481, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.49% (0.2240 => 0.2363, std.dev.: 0.0022) MultiSource/Applications/Burg/burg: 5.43% (1.2222 => 1.2886, std.dev.: 0.0157) MultiSource/Applications/hbd/hbd: 5.40% (1.4269 => 1.5040, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.02% (0.2133 => 0.2240, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.58% (0.8148 => 0.8521, std.dev.: 0.0130) MultiSource/Applications/lua/lua: 4.39% (3.8189 => 3.9866, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.37% (1.1606 => 1.2113, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/gs/gs: 4.28% (4.1305 => 4.3074, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.25% (0.5817 => 0.6064, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.14% (1.1685 => 1.2169, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.07% (0.4127 => 0.4295, std.dev.: 0.0030) MultiSource/Applications/treecc/treecc: 3.96% (1.9948 => 2.0737, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.91% (0.6287 => 0.6533, std.dev.: 0.0085) MultiSource/Applications/sgefa/sgefa: 3.90% (0.2999 => 0.3116, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.89% (1.2526 => 1.3013, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.78% (0.4783 => 0.4964, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.54% (0.5961 => 0.6172, std.dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 3.48% (1.1271 => 1.1663, std.dev.: 0.0049) MultiSource/Applications/SPASS/SPASS: 3.36% (14.2605 => 14.7403, std.dev.: 0.0613) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.25% (2.1401 => 2.2096, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.24% (8.6476 => 8.9275, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.21% (1.4479 => 1.4944, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/football/football: 3.19% (0.8768 => 0.9048, std.dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.15% (6.6074 => 6.8158, std.dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.03% (0.4559 => 0.4697, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 3.02% (0.4397 => 0.4530, std.dev.: 0.0036) MultiSource/Applications/ClamAV/clamscan: 2.99% (14.7684 => 15.2098, std.dev.: 0.0397) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.96% (0.8340 => 0.8587, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 2.91% (0.9810 => 1.0095, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.89% (0.8697 => 0.8948, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.83% (0.8457 => 0.8696, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.80% (0.3717 => 0.3821, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 2.74% (2.3764 => 2.4414, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.73% (4.1763 => 4.2904, std.dev.: 0.0228) MultiSource/Applications/siod/siod: 2.73% (2.2184 => 2.2789, std.dev.: 0.0107) MultiSource/Applications/d/make_dparser: 2.71% (3.2366 => 3.3242, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.69% (0.8611 => 0.8843, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 2.67% (0.7557 => 0.7759, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.61% (0.8007 => 0.8216, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 2.60% (1.2568 => 1.2895, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.54% (0.5191 => 0.5323, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.53% (0.9069 => 0.9298, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.50% (0.9039 => 0.9265, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 2.47% (0.6834 => 0.7003, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.47% (13.1811 => 13.5067, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.39% (0.8331 => 0.8530, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.38% (1.6386 => 1.6776, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.37% (0.9688 => 0.9918, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.35% (0.7966 => 0.8153, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.33% (0.8712 => 0.8915, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.32% (4.4873 => 4.5916, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.30% (0.8420 => 0.8614, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.30% (0.8597 => 0.8795, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.30% (0.8885 => 0.9089, std.dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: 2.29% (31.8598 => 32.5897, std.dev.: 0.2507) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.27% (0.8317 => 0.8506, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.27% (0.8286 => 0.8474, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.19% (0.8050 => 0.8226, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 2.18% (15.3280 => 15.6623, std.dev.: 0.0612) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.17% (0.8927 => 0.9121, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.17% (4.4880 => 4.5853, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.16% (0.8086 => 0.8261, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.16% (0.8066 => 0.8240, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.13% (0.8855 => 0.9044, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.13% (0.8656 => 0.8840, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.11% (0.9908 => 1.0117, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.09% (0.8716 => 0.8898, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.06% (0.8805 => 0.8986, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.04% (1.2602 => 1.2859, std.dev.: 0.0052) MultiSource/Applications/JM/ldecod/ldecod: 2.02% (6.7320 => 6.8682, std.dev.: 0.0443) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.01% (0.8048 => 0.8210, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.92% (0.8177 => 0.8334, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.90% (0.8204 => 0.8360, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.84% (0.8316 => 0.8469, std.dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: 1.83% (8.6247 => 8.7826, std.dev.: 0.0473) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.83% (0.8261 => 0.8412, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.77% (0.8359 => 0.8507, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.76% (0.6586 => 0.6702, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.75% (0.8338 => 0.8484, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.73% (1.0945 => 1.1134, std.dev.: 0.0070) MultiSource/Applications/oggenc/oggenc: 1.64% (4.9628 => 5.0442, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 111.56% (0.0199 => 0.0421, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/pi: 57.85% (1.5795 => 2.4933, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.52% (0.7597 => 0.8852, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.30% (2.9753 => 3.4604, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.70% (2.7995 => 3.2109, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.45% (5.0261 => 5.6017, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.46% (1.1857 => 1.2741, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/queens: 7.18% (1.7056 => 1.8280, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/nestedloop: 7.12% (0.2023 => 0.2167, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.71% (4.7794 => 5.1000, std.dev.: 0.0048) MultiSource/Applications/SIBsim4/SIBsim4: 6.28% (3.1873 => 3.3876, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.01% (4.9686 => 5.2670, std.dev.: 0.0178) SingleSource/Benchmarks/Misc/richards_benchmark: 5.85% (1.3037 => 1.3800, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.77% (4.5327 => 4.7942, std.dev.: 0.0072) MultiSource/Applications/lambda-0_1_3/lambda: 5.24% (7.4933 => 7.8862, std.dev.: 0.0385) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.65% (6.2275 => 6.5172, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.38% (3.3761 => 3.5239, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.19% (4.9453 => 5.1527, std.dev.: 0.0122) MultiSource/Applications/hexxagon/hexxagon: 3.93% (14.0064 => 14.5564, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.84% (4.9469 => 5.1369, std.dev.: 0.0059) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.53% (0.2887 => 0.2989, std.dev.: 0.0032) MultiSource/Applications/siod/siod: 3.09% (3.6643 => 3.7774, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.77% (1.2337 => 1.2679, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.77% (11.5690 => 11.8892, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.70% (8.2783 => 8.5015, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout/lists: 2.29% (7.3375 => 7.5055, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.25% (4.8660 => 4.9755, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/ReedSolomon: 1.31% (8.5322 => 8.6442, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/power/power: 1.26% (1.2061 => 1.2213, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.21% (3.5679 => 3.6109, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.14% (2.4647 => 2.4927, std.dev.: 0.0100) MultiSource/Benchmarks/FreeBench/neural/neural: 1.12% (1.0841 => 1.0962, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -35.21% (0.0338 => 0.0219, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: -20.89% (5.4641 => 4.3225, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.27% (7.2130 => 6.2560, std.dev.: 0.1777) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.89% (1.0512 => 0.9367, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.24% (14.6451 => 13.2912, std.dev.: 0.1194) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.81% (0.3269 => 0.2981, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: -8.45% (63.1822 => 57.8435, std.dev.: 0.2090) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -7.03% (4.7482 => 4.4144, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.97% (3.7148 => 3.4932, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.90% (5.4972 => 5.1728, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.09% (5.1557 => 4.8931, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.39% (4.7449 => 4.5366, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.83% (6.0224 => 5.7918, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.51% (0.5807 => 0.5603, std.dev.: 0.0027) MultiSource/Applications/lua/lua: -3.38% (29.8330 => 28.8261, std.dev.: 0.0229) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (28.5821 => 27.6961, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.96% (2.6356 => 2.5575, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.88% (9.9065 => 9.6212, std.dev.: 0.0209) MultiSource/Applications/aha/aha: -2.46% (3.3398 => 3.2575, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/hash2: -2.34% (3.4237 => 3.3436, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bisort/bisort: -2.02% (0.6636 => 0.6502, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.00% (11.5316 => 11.3011, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/mason/mason: -1.96% (0.5415 => 0.5309, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.88% (1.2822 => 1.2581, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.84% (2.3487 => 2.3055, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.59% (4.9994 => 4.9197, std.dev.: 0.0225) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.40% (3.2169 => 3.1718, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.14% (5.6343 => 5.5703, std.dev.: 0.0062) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.93% (16.4461 => 16.9284, std.dev.: 0.0136) MultiSource/Applications/obsequi/Obsequi: 2.97% (1.0262 => 1.0567, std.dev.: 0.0128) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6961.61% (0.3123 => 22.0534, std.dev.: 0.2620) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.58% (0.2463 => 0.3635, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 1.68% (0.6010 => 0.6111, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.25% (0.3266 => 0.3372, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 3.10% (0.1969 => 0.2030, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 38.21% (0.0123 => 0.0170, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 28.35% (0.0254 => 0.0326, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.72% (0.0384 => 0.0429, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: 8.42% (0.0190 => 0.0206, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -3.89% (0.0180 => 0.0173, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 3.20% (0.1438 => 0.1484, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.80% (1.1329 => 1.1125, std.dev.: 0.0489) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.14% (0.4164 => 0.4170, std.dev.: 0.0248) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.26% (0.1369 => 0.1400, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.70% (0.0641 => 0.0566, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.51% (0.0195 => 0.0194, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.52% (0.0578 => 0.0581, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.21% (1.1437 => 1.1918, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1400.00% (0.0001 => 0.0015, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.70% (0.0627 => 0.0585, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 28.33% (0.0180 => 0.0231, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.49% (0.8017 => 0.7817, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 29.03% (0.0062 => 0.0080, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 04:50:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 06:50:49 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121117125049.D1EA12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5972?compare_to=5966&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5972, Order: 168258, Start Time: 2012-11-17 10:30:30, End Time: 2012-11-17 12:51:10 To: 5966, Order: 168253, Start Time: 2012-11-17 07:14:26, End Time: 2012-11-17 09:38:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 33 (134 on baseline) Performance Improvements: 7 (40 on baseline) Added Tests: 0 (136 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1000 (713 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 15.86% (4.6145 => 5.3464, std.dev.: 0.0477) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 15.38% (0.6932 => 0.7998, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 13.44% (0.5952 => 0.6752, std.dev.: 0.0123) MultiSource/Applications/treecc/treecc: 12.67% (2.2854 => 2.5749, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.64% (0.4326 => 0.4873, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/except: 12.56% (0.3152 => 0.3548, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 11.54% (0.8189 => 0.9134, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/sieve: 11.06% (0.4007 => 0.4450, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 10.79% (2.6942 => 2.9848, std.dev.: 0.0473) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.37% (0.9070 => 1.0011, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/fibo: 10.25% (0.2966 => 0.3270, std.dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 10.20% (0.3530 => 0.3890, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.68% (0.1209 => 0.1326, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 8.33% (0.1416 => 0.1534, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 8.00% (0.1462 => 0.1579, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.91% (0.2212 => 0.2387, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.55% (1.4743 => 1.5856, std.dev.: 0.0319) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.45% (0.7507 => 0.8066, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/lists: 6.57% (0.3805 => 0.4055, std.dev.: 0.0090) MultiSource/Applications/hbd/hbd: 4.95% (1.8309 => 1.9216, std.dev.: 0.0085) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 79.09% (4.4553 => 7.9790, std.dev.: 0.4738) SingleSource/Benchmarks/Misc/flops: 28.55% (6.7497 => 8.6766, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 21.93% (0.1213 => 0.1479, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/tsp/tsp: 14.68% (1.1026 => 1.2645, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 9.63% (0.4133 => 0.4531, std.dev.: 0.0139) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 8.47% (0.3434 => 0.3725, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 6.55% (0.2289 => 0.2439, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 4.68% (7.8917 => 8.2614, std.dev.: 0.0596) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.53% (9.7169 => 9.9625, std.dev.: 0.0941) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.40% (4.2404 => 4.3421, std.dev.: 0.0155) MultiSource/Applications/sgefa/sgefa: 1.79% (0.6308 => 0.6421, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.44% (61.5844 => 62.4682, std.dev.: 0.1636) MultiSource/Applications/SIBsim4/SIBsim4: 1.37% (3.8714 => 3.9245, std.dev.: 0.0143) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/sumcol: -12.06% (0.3566 => 0.3136, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/hash2: -11.70% (0.5805 => 0.5126, std.dev.: 0.0224) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.96% (0.2946 => 0.2682, std.dev.: 0.0101) MultiSource/Applications/viterbi/viterbi: -8.89% (0.1969 => 0.1794, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.40% (0.3424 => 0.3205, std.dev.: 0.0082) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/siod/siod: -5.51% (3.3889 => 3.2023, std.dev.: 0.0628) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -5.09% (1.6119 => 1.5298, std.dev.: 0.0242) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -2.62% (0.1373 => 0.1337, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0419 => 0.0420, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.37% (0.0653 => 0.0675, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 0.04% (494.1019 => 494.3033, std.dev.: 0.0872) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: 43732.87% (1.1277 => 494.3033, std.dev.: 0.0872) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 195.14% (0.5229 => 1.5433, std.dev.: 0.0382) MultiSource/Applications/SPASS/SPASS: 23.28% (14.9895 => 18.4790, std.dev.: 0.0572) MultiSource/Applications/kimwitu++/kc: 50.68% (14.1553 => 21.3288, std.dev.: 0.2377) MultiSource/Benchmarks/MallocBench/gs/gs: 20.46% (4.1105 => 4.9514, std.dev.: 0.2014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.99% (1.1048 => 1.5135, std.dev.: 0.0826) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 436.25% (7.1582 => 38.3862, std.dev.: 0.2280) SingleSource/Benchmarks/Misc-C++-EH/spirit: 82.18% (3.4629 => 6.3087, std.dev.: 0.3313) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.25% (0.6222 => 1.0282, std.dev.: 0.0718) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11374.17% (0.0720 => 8.2614, std.dev.: 0.0596) MultiSource/Applications/SIBsim4/SIBsim4: 3924400.00% (0.0001 => 3.9245, std.dev.: 0.0143) MultiSource/Applications/SPASS/SPASS: 14177600.00% (0.0001 => 14.1777, std.dev.: 0.2747) MultiSource/Applications/kimwitu++/kc: 52100.00% (0.0001 => 0.0522, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 64900.00% (0.0001 => 0.0650, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576700.00% (0.0001 => 0.5768, std.dev.: 0.0163) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10086500.00% (0.0001 => 10.0866, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5751500.00% (0.0001 => 5.7516, std.dev.: 0.7664) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1813.36% (1.1194 => 21.4181, std.dev.: 0.0737) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 81.95% (2.9384 => 5.3464, std.dev.: 0.0477) MultiSource/Applications/ClamAV/clamscan: 69.97% (22.1758 => 37.6916, std.dev.: 0.0213) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.10% (7.0540 => 11.0818, std.dev.: 0.1820) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.57% (8.1363 => 12.2507, std.dev.: 0.0991) MultiSource/Applications/JM/lencod/lencod: 48.04% (21.9371 => 32.4749, std.dev.: 0.0759) MultiSource/Benchmarks/FreeBench/distray/distray: 44.98% (0.1056 => 0.1531, std.dev.: 0.0060) SingleSource/UnitTests/vla: 39.44% (0.0355 => 0.0495, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 38.49% (0.0730 => 0.1011, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: 38.34% (0.1432 => 0.1981, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 35.28% (0.0326 => 0.0441, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 34.42% (0.2554 => 0.3433, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 31.42% (0.1044 => 0.1372, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 30.68% (0.0730 => 0.0954, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 30.55% (0.1175 => 0.1534, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 29.95% (2.2969 => 2.9848, std.dev.: 0.0473) MultiSource/Benchmarks/Olden/bisort/bisort: 29.48% (0.0614 => 0.0795, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 28.38% (0.7115 => 0.9134, std.dev.: 0.0068) MultiSource/Benchmarks/NPB-serial/is/is: 28.23% (0.0719 => 0.0922, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 27.31% (0.0886 => 0.1128, std.dev.: 0.0042) MultiSource/Applications/treecc/treecc: 27.01% (2.0273 => 2.5749, std.dev.: 0.0182) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.73% (0.0793 => 0.1005, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: 26.08% (0.3865 => 0.4873, std.dev.: 0.0156) MultiSource/Applications/sgefa/sgefa: 25.12% (0.3109 => 0.3890, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.89% (0.1125 => 0.1405, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/04-bisect/bisect: 24.86% (0.1062 => 0.1326, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.80% (0.0746 => 0.0931, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/health/health: 24.53% (0.1268 => 0.1579, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 24.26% (0.0437 => 0.0543, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 23.79% (3.8922 => 4.8183, std.dev.: 0.0697) MultiSource/Benchmarks/Olden/perimeter/perimeter: 23.77% (0.0770 => 0.0953, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 23.58% (0.2871 => 0.3548, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 23.58% (0.8101 => 1.0011, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/sieve: 23.51% (0.3603 => 0.4450, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 23.48% (0.2700 => 0.3334, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 23.31% (0.3826 => 0.4718, std.dev.: 0.0088) MultiSource/Applications/hbd/hbd: 23.16% (1.5603 => 1.9216, std.dev.: 0.0085) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.65% (0.3121 => 0.3828, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 22.37% (14.3668 => 17.5808, std.dev.: 0.0320) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 22.19% (0.6675 => 0.8156, std.dev.: 0.0235) MultiSource/Applications/oggenc/oggenc: 21.83% (5.7591 => 7.0165, std.dev.: 0.1671) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.83% (0.1906 => 0.2322, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/office/office: 21.81% (0.3136 => 0.3820, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.52% (0.1566 => 0.1903, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.50% (1.3050 => 1.5856, std.dev.: 0.0319) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.90% (0.1584 => 0.1915, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/fibo: 20.00% (0.2725 => 0.3270, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.39% (4.9449 => 5.9038, std.dev.: 0.1022) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 19.20% (0.1625 => 0.1937, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.96% (0.0770 => 0.0916, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists: 18.50% (0.3422 => 0.4055, std.dev.: 0.0090) MultiSource/Applications/lua/lua: 18.06% (3.8723 => 4.5717, std.dev.: 0.1990) MultiSource/Applications/sqlite3/sqlite3: 17.76% (17.1811 => 20.2332, std.dev.: 0.0577) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.70% (0.0842 => 0.0991, std.dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: 17.43% (9.4845 => 11.1372, std.dev.: 0.1146) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.34% (0.0871 => 0.1022, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/trivial-interface: 17.13% (0.3473 => 0.4068, std.dev.: 0.0138) SingleSource/UnitTests/ObjC/messages-2: 16.92% (0.0662 => 0.0774, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.72% (0.4636 => 0.5411, std.dev.: 0.0212) MultiSource/Benchmarks/Olden/em3d/em3d: 16.64% (0.1695 => 0.1977, std.dev.: 0.0106) SingleSource/UnitTests/ObjC/synchronized: 16.62% (0.3561 => 0.4153, std.dev.: 0.0062) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.58% (0.0953 => 0.1111, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.53% (0.8172 => 0.9523, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.29% (0.2756 => 0.3205, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/matrix: 16.14% (0.0818 => 0.0950, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.05% (0.0648 => 0.0752, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.64% (1.5415 => 1.7826, std.dev.: 0.0883) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.59% (0.0834 => 0.0964, std.dev.: 0.0036) MultiSource/Applications/viterbi/viterbi: 15.37% (0.1555 => 0.1794, std.dev.: 0.0064) MultiSource/Benchmarks/PAQ8p/paq8p: 15.26% (10.3673 => 11.9496, std.dev.: 0.0878) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.10% (0.1940 => 0.2233, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.09% (4.2646 => 4.9080, std.dev.: 0.1794) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.95% (0.1117 => 0.1284, std.dev.: 0.0054) MultiSource/Benchmarks/Bullet/bullet: 14.28% (63.2438 => 72.2765, std.dev.: 0.2932) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.21% (0.1337 => 0.1527, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.19% (0.1029 => 0.1175, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.99% (0.5981 => 0.6818, std.dev.: 0.0241) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.85% (5.0018 => 5.6946, std.dev.: 0.2347) SingleSource/UnitTests/ObjC/parameter-passing: 13.37% (0.3927 => 0.4452, std.dev.: 0.0087) MultiSource/Applications/d/make_dparser: 13.21% (3.3354 => 3.7761, std.dev.: 0.1508) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.03% (0.0798 => 0.0902, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/property: 12.97% (0.3886 => 0.4390, std.dev.: 0.0161) SingleSource/UnitTests/SignlessTypes/rem: 12.76% (0.1144 => 0.1290, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.76% (0.3543 => 0.3995, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/exceptions-2: 12.70% (0.3497 => 0.3941, std.dev.: 0.0079) SingleSource/UnitTests/ObjC/exceptions-4: 12.67% (0.3543 => 0.3992, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/exceptions: 12.54% (0.3828 => 0.4308, std.dev.: 0.0078) SingleSource/UnitTests/ObjC/exceptions-3: 12.51% (0.3516 => 0.3956, std.dev.: 0.0070) SingleSource/UnitTests/ObjC++/Hello: 12.32% (0.5925 => 0.6655, std.dev.: 0.0196) SingleSource/UnitTests/ObjC/for-in: 12.26% (0.3694 => 0.4147, std.dev.: 0.0073) MultiSource/Applications/lemon/lemon: 12.15% (1.0722 => 1.2025, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference-object: 11.19% (0.6030 => 0.6705, std.dev.: 0.0201) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.86% (2.2022 => 2.4194, std.dev.: 0.0525) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.29% (0.3650 => 0.3989, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.67% (0.3162 => 0.3436, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.36% (0.3817 => 0.4098, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.34% (0.2266 => 0.2387, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.74% (4.3953 => 11.0207, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/methcall: 147.72% (5.3999 => 13.3764, std.dev.: 0.0067) MultiSource/Benchmarks/llubenchmark/llu: 111.19% (3.7781 => 7.9790, std.dev.: 0.4738) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.45% (13.4384 => 16.1859, std.dev.: 0.2894) MultiSource/Benchmarks/Olden/health/health: 19.08% (0.4445 => 0.5293, std.dev.: 0.0268) MultiSource/Benchmarks/Olden/bisort/bisort: 18.11% (0.8333 => 0.9842, std.dev.: 0.0529) SingleSource/Benchmarks/Misc/oourafft: 17.62% (6.6465 => 7.8179, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: 17.25% (1.0785 => 1.2645, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.64% (1.1145 => 1.2999, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.77% (8.6802 => 9.9625, std.dev.: 0.0941) SingleSource/Benchmarks/CoyoteBench/lpbench: 14.64% (10.3460 => 11.8605, std.dev.: 0.4684) MultiSource/Applications/JM/ldecod/ldecod: 13.94% (0.1298 => 0.1479, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.35% (0.2944 => 0.3337, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.31% (0.0864 => 0.0979, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.65% (2.8904 => 3.2270, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 10.61% (3.1578 => 3.4930, std.dev.: 0.0752) SingleSource/Benchmarks/Misc/richards_benchmark: 10.28% (1.1396 => 1.2568, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.30% (1.7254 => 1.8859, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.76% (4.2280 => 4.4714, std.dev.: 0.0061) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.6436 => 12.1320, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.90% (0.3540 => 0.3678, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.18% (0.6223 => 0.6421, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/dry: 2.64% (2.4116 => 2.4752, std.dev.: 0.0076) MultiSource/Benchmarks/PAQ8p/paq8p: 2.35% (85.0658 => 87.0685, std.dev.: 0.0542) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.15% (1.3677 => 1.3971, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 2.07% (3.1595 => 3.2248, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 1.63% (27.8444 => 28.2990, std.dev.: 0.0279) SingleSource/Benchmarks/Dhrystone/fldry: 1.52% (1.9577 => 1.9874, std.dev.: 0.0115) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.34% (6.5088 => 6.5962, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout/sieve: 1.32% (5.2139 => 5.2825, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0500, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1674, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.82% (5.2763 => 1.2232, std.dev.: 0.0734) SingleSource/Benchmarks/Misc/salsa20: -75.46% (0.8651 => 0.2123, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/richards_benchmark: -44.82% (0.1622 => 0.0895, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.95% (5.3855 => 4.6882, std.dev.: 0.1548) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.41% (5.3526 => 4.6885, std.dev.: 0.1627) MultiSource/Applications/JM/ldecod/ldecod: -9.28% (10.4361 => 9.4672, std.dev.: 0.1954) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.98% (0.3987 => 0.2393, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.31% (4.5009 => 2.7766, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7636, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.17% (2.6546 => 2.0129, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -21.50% (10.7105 => 8.4073, std.dev.: 0.3304) MultiSource/Benchmarks/FreeBench/mason/mason: -19.34% (0.2161 => 0.1743, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4262, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2840, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.74% (32.5116 => 29.0195, std.dev.: 0.0244) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -9.57% (9.5636 => 8.6488, std.dev.: 0.1847) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.96% (1.5660 => 1.4257, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4789, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.79% (3.2416 => 3.0214, std.dev.: 0.0280) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5759, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -5.44% (19.9488 => 18.8638, std.dev.: 0.2931) SingleSource/Benchmarks/Misc/flops-5: -4.78% (1.5835 => 1.5078, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.73% (0.2497 => 0.2379, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -4.22% (6.2999 => 6.0338, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.39% (0.9957 => 0.9619, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.15% (1.6805 => 1.6275, std.dev.: 0.0206) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8920, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.27% (0.4808 => 0.4699, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.76% (8.1563 => 8.0130, std.dev.: 0.0146) SingleSource/Benchmarks/Misc/salsa20: -1.45% (10.2830 => 10.1341, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.97% (0.1485 => 0.1337, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.10% (0.2116 => 0.0675, std.dev.: 0.0006) Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 06:58:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 08:58:38 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121117145838.6C58A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5973?compare_to=5969&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5973, Order: 168258, Start Time: 2012-11-17 11:39:07, End Time: 2012-11-17 14:58:59 To: 5969, Order: 168254, Start Time: 2012-11-17 07:24:23, End Time: 2012-11-17 10:48:48 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (176 on baseline) Performance Improvements: 2 (17 on baseline) Added Tests: 0 (136 on baseline) Unchanged Tests: 1042 (715 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -1.59% (54.8313 => 53.9590, std.dev.: 0.0890) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.26% (2.3064 => 2.2773, std.dev.: 0.0079) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.00% (0.0625 => 0.0875, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.98% (0.1063 => 0.1403, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.41% (0.2969 => 0.3753, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.04% (0.1106 => 0.1394, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.83% (0.4139 => 0.5208, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.63% (0.0714 => 0.0897, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.28% (0.4253 => 0.5328, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.11% (0.4994 => 0.6248, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.59% (0.5900 => 0.7351, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 24.56% (0.0452 => 0.0563, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.30% (0.0897 => 0.1115, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.00% (0.0475 => 0.0589, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 23.85% (1.5932 => 1.9731, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.80% (0.5000 => 0.6190, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.63% (0.0584 => 0.0722, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.58% (0.0547 => 0.0676, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.02% (0.1021 => 0.1256, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.84% (0.1620 => 0.1990, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 22.70% (0.0599 => 0.0735, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.39% (0.1103 => 0.1350, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.22% (0.1107 => 0.1353, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 22.18% (0.0947 => 0.1157, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.12% (0.0642 => 0.0784, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.64% (0.0633 => 0.0770, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.51% (0.1604 => 0.1949, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.23% (0.0584 => 0.0708, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 21.20% (0.0948 => 0.1149, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.07% (0.0541 => 0.0655, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.94% (0.1003 => 0.1213, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 20.83% (0.0821 => 0.0992, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.78% (0.3903 => 0.4714, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.68% (0.0822 => 0.0992, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.61% (0.0495 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.53% (0.1549 => 0.1867, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/05-eks/eks: 20.44% (0.1619 => 0.1950, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 19.55% (0.0808 => 0.0966, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.49% (0.1462 => 0.1747, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.48% (0.2736 => 0.3269, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.15% (0.3890 => 0.4635, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 19.13% (0.1218 => 0.1451, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.02% (0.2014 => 0.2397, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.98% (1.3152 => 1.5648, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.97% (0.1160 => 0.1380, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 18.52% (0.4029 => 0.4775, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/mst/mst: 18.48% (0.0698 => 0.0827, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 18.34% (0.1505 => 0.1781, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.28% (0.2866 => 0.3390, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 18.19% (0.5546 => 0.6555, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.11% (0.1088 => 0.1285, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.99% (0.5026 => 0.5930, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.82% (3.5627 => 4.1976, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.80% (0.0573 => 0.0675, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 17.77% (1.8794 => 2.2134, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.66% (1.6211 => 1.9074, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.66% (0.0572 => 0.0673, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 17.58% (0.5826 => 0.6850, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.52% (0.0605 => 0.0711, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.48% (0.4658 => 0.5472, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference-object: 17.32% (0.5889 => 0.6909, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.23% (0.1968 => 0.2307, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.18% (0.3271 => 0.3833, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.13% (0.4361 => 0.5108, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 17.02% (1.0781 => 1.2616, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/18-imp/imp: 16.96% (0.1421 => 0.1662, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.90% (0.3930 => 0.4594, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.87% (2.7292 => 3.1897, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.60% (4.4195 => 5.1531, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.56% (0.2875 => 0.3351, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 16.48% (0.9697 => 1.1295, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 16.37% (0.7171 => 0.8345, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 16.36% (0.1284 => 0.1494, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 16.32% (4.2109 => 4.8980, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.08% (1.9694 => 2.2861, std.dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 15.94% (0.2566 => 0.2975, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.77% (1.9966 => 2.3115, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 15.76% (0.2780 => 0.3218, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.74% (0.2738 => 0.3169, std.dev.: 0.0074) MultiSource/Benchmarks/Bullet/bullet: 15.70% (23.5202 => 27.2123, std.dev.: 0.0231) SingleSource/Benchmarks/Shootout-C++/strcat: 15.56% (0.2750 => 0.3178, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 15.52% (0.2823 => 0.3261, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.50% (0.1090 => 0.1259, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 15.50% (0.2813 => 0.3249, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 15.48% (0.2714 => 0.3134, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 15.47% (0.2811 => 0.3246, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.46% (0.2729 => 0.3151, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 15.45% (0.2725 => 0.3146, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 15.45% (0.2803 => 0.3236, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.40% (0.3195 => 0.3687, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 15.38% (0.3004 => 0.3466, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.18% (0.2911 => 0.3353, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 15.08% (0.2075 => 0.2388, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 15.08% (0.3096 => 0.3563, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 15.06% (0.9909 => 1.1401, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.02% (0.3488 => 0.4012, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.97% (0.2792 => 0.3210, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.95% (2.0673 => 2.3763, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 14.85% (1.4269 => 1.6388, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 14.83% (0.2691 => 0.3090, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 14.66% (0.3267 => 0.3746, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 14.59% (0.3496 => 0.4006, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-4: 14.57% (0.3465 => 0.3970, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 14.55% (0.7875 => 0.9021, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-2: 14.54% (0.3446 => 0.3947, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 14.46% (0.3258 => 0.3729, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 14.45% (0.3460 => 0.3960, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 14.44% (0.3678 => 0.4209, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 14.41% (0.3469 => 0.3969, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 14.41% (0.3317 => 0.3795, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 14.41% (0.3442 => 0.3938, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 14.36% (2.1653 => 2.4762, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.10% (0.3362 => 0.3836, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 14.08% (0.3650 => 0.4164, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.07% (0.3845 => 0.4386, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.05% (0.3060 => 0.3490, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 14.00% (0.3643 => 0.4153, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 13.98% (0.3348 => 0.3816, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/lists1: 13.89% (0.3477 => 0.3960, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 13.87% (2.1013 => 2.3927, std.dev.: 0.0077) MultiSource/Benchmarks/sim/sim: 13.85% (0.0758 => 0.0863, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.83% (0.3124 => 0.3556, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.80% (0.3282 => 0.3735, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.78% (0.3724 => 0.4237, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 13.74% (4.6177 => 5.2521, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.54% (0.3625 => 0.4116, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 13.53% (0.3726 => 0.4230, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 13.41% (0.4146 => 0.4702, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.30% (0.1383 => 0.1567, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 13.29% (0.4251 => 0.4816, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.25% (0.3690 => 0.4179, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.16% (0.3981 => 0.4505, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.04% (0.2040 => 0.2306, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 12.83% (0.5012 => 0.5655, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 12.52% (5.5417 => 6.2353, std.dev.: 0.0057) MultiSource/Applications/lambda-0_1_3/lambda: 12.38% (0.3498 => 0.3931, std.dev.: 0.0126) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.73% (0.6435 => 0.7190, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 11.59% (0.6634 => 0.7403, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.28% (0.1028 => 0.1144, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.07% (0.2068 => 0.2297, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 11.00% (0.3336 => 0.3703, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 10.93% (0.4847 => 0.5377, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.73% (0.3084 => 0.3415, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.63% (0.2737 => 0.3028, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 10.37% (0.2391 => 0.2639, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 10.19% (2.0346 => 2.2419, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.94% (0.2103 => 0.2312, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.88% (4.6926 => 5.1094, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.73% (0.5361 => 0.5829, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.71% (11.6398 => 12.6540, std.dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.27% (0.5584 => 0.6046, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.03% (0.7426 => 0.8022, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 6.82% (11.9555 => 12.7707, std.dev.: 0.0078) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.06% (0.3792 => 0.3984, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.26% (0.0734 => 0.0868, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 9.71% (0.2802 => 0.3074, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary: 8.25% (0.2122 => 0.2297, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6092, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6684, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/flops-2: 5.00% (1.8057 => 1.8960, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1715, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.55% (0.3693 => 0.3861, std.dev.: 0.0053) SingleSource/Benchmarks/Dhrystone/dry: 4.13% (14.0481 => 14.6277, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1939, std.dev.: 0.0088) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2219, std.dev.: 0.0044) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3089, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2893, std.dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5126, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5974, std.dev.: 0.0246) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5667, std.dev.: 0.0161) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9750, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7865, std.dev.: 0.0137) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -6.62% (0.2402 => 0.2243, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8046, std.dev.: 0.0133) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0029) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7742, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.61% (17.2379 => 16.7874, std.dev.: 0.0252) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.26% (41.7953 => 40.8512, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5724, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4957, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.32% (5.7935 => 5.7168, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.20% (105.3826 => 104.1179, std.dev.: 0.0952) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0463, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 07:47:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 09:47:44 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121117154744.A9C6A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5974?compare_to=5971&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5974, Order: 168259, Start Time: 2012-11-17 14:19:28, End Time: 2012-11-17 15:48:06 To: 5971, Order: 168258, Start Time: 2012-11-17 11:08:45, End Time: 2012-11-17 12:37:30 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (18 on baseline) Performance Regressions: 8 (93 on baseline) Performance Improvements: 7 (25 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 50 (50 on baseline) Unchanged Tests: 979 (856 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.81% (0.8507 => 0.8661, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.64% (0.9079 => 0.9228, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.42% (6.5891 => 6.9465, std.dev.: 0.1184) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.53% (4.3664 => 4.4767, std.dev.: 0.0292) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.47% (21.9736 => 22.2973, std.dev.: 0.0989) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.14% (1.2679 => 1.2823, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.09% (2.7609 => 2.7909, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/whetstone: 1.03% (2.1165 => 2.1384, std.dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -5.16% (0.9020 => 0.8555, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/football/football: -2.29% (0.9048 => 0.8841, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.05% (5.5441 => 5.4302, std.dev.: 0.0265) MultiSource/Benchmarks/MallocBench/gs/gs: -1.85% (4.3074 => 4.2277, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.50% (8.9275 => 8.7932, std.dev.: 0.0490) MultiSource/Applications/treecc/treecc: -1.35% (2.0737 => 2.0458, std.dev.: 0.0103) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: -8.31% (0.2167 => 0.1987, std.dev.: 0.0037) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.38% (16.9284 => 16.8644, std.dev.: 0.1009) MultiSource/Applications/obsequi/Obsequi: 1.14% (1.0567 => 1.0687, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.07% (22.0534 => 22.0694, std.dev.: 0.1347) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.74% (0.3635 => 0.3662, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 0.07% (0.6111 => 0.6115, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.80% (0.3372 => 0.3345, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: -0.59% (0.2030 => 0.2018, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -22.35% (0.0170 => 0.0132, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -16.59% (0.0428 => 0.0357, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.80% (0.0326 => 0.0281, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -9.18% (0.0316 => 0.0287, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -14.22% (0.0429 => 0.0368, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/casts: -22.33% (0.0206 => 0.0160, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/test1: -17.92% (0.0173 => 0.0142, std.dev.: 0.0038) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.54% (0.1484 => 0.1476, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: -1.93% (1.1125 => 1.0910, std.dev.: 0.0282) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.58% (0.4170 => 0.4146, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.07% (0.1400 => 0.1429, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.90% (0.0566 => 0.0639, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.75% (0.0194 => 0.0275, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.16% (0.0581 => 0.0551, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.13% (1.1918 => 1.1903, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 106.67% (0.0015 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -85.19% (0.0027 => 0.0004, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.56% (0.0585 => 0.0570, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.78% (0.0231 => 0.0183, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.41% (0.7817 => 0.7785, std.dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -26.25% (0.0080 => 0.0059, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2322.25% (0.6332 => 15.3377, std.dev.: 0.0839) MultiSource/Benchmarks/McCat/08-main/main: 49.59% (0.1831 => 0.2739, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.16% (0.1559 => 0.1463, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1523.86% (0.3344 => 5.4302, std.dev.: 0.0265) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.16% (0.2364 => 0.3266, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: 2.80% (0.0429 => 0.0441, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.68% (0.0224 => 0.0230, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -29.13% (0.0230 => 0.0163, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/oggenc/oggenc: 8.62% (0.1462 => 0.1588, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4652, std.dev.: 0.0160) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0728, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4946, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3196, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1283, std.dev.: 0.0387) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4086, std.dev.: 0.0011) SingleSource/Regression/C/uint64_to_float: -24.09% (2.1832 => 1.6572, std.dev.: 0.0054) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0008) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.90% (0.0810 => 0.0955, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 11.51% (0.1112 => 0.1240, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.74% (0.2180 => 0.2327, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.05% (0.1983 => 0.2103, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.52% (0.1885 => 0.1989, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 5.11% (1.2222 => 1.2847, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.80% (0.2103 => 0.2204, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.24% (4.1763 => 4.3535, std.dev.: 0.0475) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.97% (0.3124 => 0.3248, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.83% (0.4127 => 0.4285, std.dev.: 0.0029) MultiSource/Applications/spiff/spiff: 3.66% (0.7950 => 0.8241, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.61% (0.8359 => 0.8661, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.55% (0.4559 => 0.4721, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.40% (0.8286 => 0.8568, std.dev.: 0.0103) MultiSource/Applications/hbd/hbd: 3.36% (1.4269 => 1.4749, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.25% (0.8697 => 0.8980, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.23% (1.6386 => 1.6915, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.18% (1.1685 => 1.2056, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.16% (2.1401 => 2.2078, std.dev.: 0.0131) MultiSource/Applications/SIBsim4/SIBsim4: 3.10% (1.2568 => 1.2957, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.09% (0.8050 => 0.8299, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.04% (0.9069 => 0.9345, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.96% (0.8611 => 0.8866, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.94% (14.2605 => 14.6802, std.dev.: 0.0386) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.92% (0.8805 => 0.9062, std.dev.: 0.0037) MultiSource/Applications/lua/lua: 2.91% (3.8189 => 3.9300, std.dev.: 0.0240) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.88% (0.8204 => 0.8440, std.dev.: 0.0048) MultiSource/Applications/siod/siod: 2.82% (2.2184 => 2.2809, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.81% (1.5315 => 1.5746, std.dev.: 0.0049) MultiSource/Applications/ClamAV/clamscan: 2.76% (14.7684 => 15.1762, std.dev.: 0.0449) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (0.9908 => 1.0171, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.59% (0.8995 => 0.9228, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.58% (0.8086 => 0.8295, std.dev.: 0.0036) MultiSource/Applications/treecc/treecc: 2.56% (1.9948 => 2.0458, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.54% (0.8331 => 0.8543, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.53% (0.8340 => 0.8551, std.dev.: 0.0033) MultiSource/Applications/d/make_dparser: 2.44% (3.2366 => 3.3157, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.44% (0.9074 => 0.9295, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.43% (0.8656 => 0.8866, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.42% (0.8066 => 0.8261, std.dev.: 0.0055) MultiSource/Applications/JM/lencod/lencod: 2.37% (15.3280 => 15.6911, std.dev.: 0.0598) MultiSource/Benchmarks/MallocBench/gs/gs: 2.35% (4.1305 => 4.2277, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.32% (0.9056 => 0.9266, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.31% (0.8597 => 0.8796, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 2.27% (6.7320 => 6.8846, std.dev.: 0.0376) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.18% (0.5191 => 0.5304, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.15% (0.8317 => 0.8496, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.15% (0.7966 => 0.8137, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.12% (0.8518 => 0.8699, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.12% (0.8716 => 0.8901, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.11% (0.9039 => 0.9230, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.05% (0.6586 => 0.6721, std.dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: 1.98% (31.8598 => 32.4910, std.dev.: 0.1423) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.96% (0.6227 => 0.6349, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.90% (0.8885 => 0.9054, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 1.72% (0.9810 => 0.9979, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.68% (8.6476 => 8.7932, std.dev.: 0.0490) MultiSource/Applications/lambda-0_1_3/lambda: 1.61% (0.7557 => 0.7679, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.59% (0.8316 => 0.8448, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 1.44% (8.6247 => 8.7492, std.dev.: 0.0416) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 108.54% (0.0199 => 0.0415, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/pi: 58.71% (1.5795 => 2.5068, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.22% (2.9753 => 3.4579, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.71% (2.7995 => 3.2113, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.50% (5.0261 => 5.6043, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.93% (6.3772 => 6.9465, std.dev.: 0.1184) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.05% (1.1857 => 1.2811, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/queens: 7.00% (1.7056 => 1.8250, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.76% (4.7794 => 5.1026, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/richards_benchmark: 6.42% (1.3037 => 1.3874, std.dev.: 0.0062) MultiSource/Applications/SIBsim4/SIBsim4: 6.27% (3.1873 => 3.3870, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.96% (0.3186 => 0.3376, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.87% (4.5327 => 4.7989, std.dev.: 0.0413) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.86% (4.9686 => 5.2599, std.dev.: 0.0213) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.70% (6.2275 => 6.5201, std.dev.: 0.0043) MultiSource/Applications/lambda-0_1_3/lambda: 4.64% (7.4933 => 7.8409, std.dev.: 0.0281) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.50% (3.3761 => 3.5280, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.17% (4.9453 => 5.1513, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.00% (4.9469 => 5.1446, std.dev.: 0.0411) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.94% (1.2337 => 1.2823, std.dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: 3.89% (14.0064 => 14.5516, std.dev.: 0.0288) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.29% (0.3587 => 0.3705, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 3.02% (3.6643 => 3.7751, std.dev.: 0.0346) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.80% (11.5690 => 11.8932, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.79% (4.3552 => 4.4767, std.dev.: 0.0292) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.76% (8.2783 => 8.5065, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout/lists: 2.45% (7.3375 => 7.5174, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.35% (4.8362 => 4.9497, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.31% (4.8660 => 4.9784, std.dev.: 0.0189) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.94% (1.1365 => 1.1585, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.2061 => 1.2238, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.28% (2.4647 => 2.4962, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.06% (3.5679 => 3.6056, std.dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -36.69% (0.0338 => 0.0214, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/em3d/em3d: -21.08% (5.4641 => 4.3122, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.94% (7.2130 => 6.2072, std.dev.: 0.2069) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.79% (1.0512 => 0.9273, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/chomp: -10.54% (1.1216 => 1.0034, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.66% (0.3269 => 0.2986, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: -8.50% (63.1822 => 57.8097, std.dev.: 0.2384) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.59% (14.6451 => 13.5333, std.dev.: 0.1686) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.88% (4.7482 => 4.4215, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.06% (5.4972 => 5.1639, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.92% (3.7148 => 3.4950, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.07% (5.1557 => 4.8942, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.39% (4.7449 => 4.5366, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.67% (6.0224 => 5.8011, std.dev.: 0.0450) MultiSource/Applications/lua/lua: -3.39% (29.8330 => 28.8207, std.dev.: 0.1170) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.00% (2.8773 => 2.7909, std.dev.: 0.0084) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.93% (28.5821 => 27.7448, std.dev.: 0.0566) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.87% (1.2822 => 1.2454, std.dev.: 0.0127) MultiSource/Applications/aha/aha: -2.66% (3.3398 => 3.2510, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.57% (2.6356 => 2.5678, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/hash2: -2.34% (3.4237 => 3.3436, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bisort/bisort: -2.22% (0.6636 => 0.6489, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.04% (11.5316 => 11.2959, std.dev.: 0.0096) MultiSource/Benchmarks/FreeBench/mason/mason: -1.99% (0.5415 => 0.5307, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.34% (2.3487 => 2.3172, std.dev.: 0.0108) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.54% (16.4461 => 16.8644, std.dev.: 0.1009) MultiSource/Applications/obsequi/Obsequi: 4.14% (1.0262 => 1.0687, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6966.73% (0.3123 => 22.0694, std.dev.: 0.1347) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.68% (0.2463 => 0.3662, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 1.75% (0.6010 => 0.6115, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.42% (0.3266 => 0.3345, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: 2.49% (0.1969 => 0.2018, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 7.32% (0.0123 => 0.0132, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -12.50% (0.0408 => 0.0357, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 10.63% (0.0254 => 0.0281, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -4.97% (0.0302 => 0.0287, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.17% (0.0384 => 0.0368, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/casts: -15.79% (0.0190 => 0.0160, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/test1: -21.11% (0.0180 => 0.0142, std.dev.: 0.0038) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.64% (0.1438 => 0.1476, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: -3.70% (1.1329 => 1.0910, std.dev.: 0.0282) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.43% (0.4164 => 0.4146, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.38% (0.1369 => 0.1429, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.31% (0.0641 => 0.0639, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.03% (0.0195 => 0.0275, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.67% (0.0578 => 0.0551, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.07% (1.1437 => 1.1903, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -71.43% (0.0014 => 0.0004, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.09% (0.0627 => 0.0570, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.67% (0.0180 => 0.0183, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.89% (0.8017 => 0.7785, std.dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -4.84% (0.0062 => 0.0059, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 07:56:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 09:56:14 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121117155614.41A6C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5975?compare_to=5970&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5975, Order: 168259, Start Time: 2012-11-17 14:23:41, End Time: 2012-11-17 15:56:35 To: 5970, Order: 168258, Start Time: 2012-11-17 10:10:23, End Time: 2012-11-17 11:44:58 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (181 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1043 (855 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.63% (78.9522 => 81.0259, std.dev.: 0.2519) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.98% (2.0478 => 2.1088, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.4937 => 7.6781, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/hash2: 2.26% (3.1932 => 3.2653, std.dev.: 0.0010) MultiSource/Benchmarks/llubenchmark/llu: 1.96% (3.7435 => 3.8170, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.64% (79.7170 => 81.0259, std.dev.: 0.2519) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.53% (0.1431 => 0.1309, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.09% (0.3821 => 0.3512, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.75% (0.3142 => 0.2930, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -6.59% (2.4924 => 2.3281, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.51% (0.2428 => 0.2270, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.49% (0.3357 => 0.3139, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.43% (0.9542 => 0.8928, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/trivial-interface: -6.43% (0.3812 => 0.3567, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.31% (0.3884 => 0.3639, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: -6.26% (0.3831 => 0.3591, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -6.26% (0.3880 => 0.3637, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -6.25% (0.4033 => 0.3781, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -6.20% (9.2283 => 8.6563, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/synchronized: -6.19% (0.3896 => 0.3655, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.16% (0.3848 => 0.3611, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -6.15% (0.4176 => 0.3919, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -6.13% (16.1920 => 15.1998, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.12% (0.6484 => 0.6087, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.12% (0.3891 => 0.3653, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -6.06% (7.0961 => 6.6659, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.01% (0.1796 => 0.1688, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.96% (0.9852 => 0.9265, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.96% (1.0544 => 0.9916, std.dev.: 0.0034) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: -5.92% (0.9179 => 0.8636, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.89% (0.7198 => 0.6774, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.85% (0.3658 => 0.3444, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.82% (1.3722 => 1.2924, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/property: -5.81% (0.4199 => 0.3955, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.76% (6.7716 => 6.3816, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.71% (4.0323 => 3.8019, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.71% (1.6364 => 1.5429, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.70% (1.4642 => 1.3808, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -5.70% (0.3406 => 0.3212, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.68% (0.2695 => 0.2542, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.64% (4.5069 => 4.2525, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.63% (1.2300 => 1.1608, std.dev.: 0.0025) MultiSource/Applications/lemon/lemon: -5.62% (1.1450 => 1.0806, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.61% (3.5339 => 3.3357, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.59% (4.8802 => 4.6072, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -5.58% (0.4280 => 0.4041, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -5.58% (4.3330 => 4.0914, std.dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.55% (0.6736 => 0.6362, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.49% (4.8161 => 4.5515, std.dev.: 0.0053) MultiSource/Applications/Burg/burg: -5.49% (1.2515 => 1.1828, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: -5.46% (1.1530 => 1.0900, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.46% (0.7919 => 0.7487, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.45% (0.6681 => 0.6317, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.43% (0.6293 => 0.5951, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: -5.43% (17.1032 => 16.1747, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.43% (1.2784 => 1.2090, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: -5.43% (0.2985 => 0.2823, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.41% (14.2083 => 13.4402, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.39% (0.2355 => 0.2228, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: -5.38% (0.4515 => 0.4272, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.33% (0.5999 => 0.5679, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.33% (0.5859 => 0.5547, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.31% (0.6230 => 0.5899, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.30% (0.6052 => 0.5731, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.30% (0.2548 => 0.2413, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.25% (0.5805 => 0.5500, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.25% (8.0126 => 7.5920, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.24% (0.5591 => 0.5298, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.23% (0.4916 => 0.4659, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/08-main/main: -5.23% (0.2659 => 0.2520, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.22% (0.5857 => 0.5551, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.21% (0.6260 => 0.5934, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: -5.19% (0.3581 => 0.3395, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.18% (0.6676 => 0.6330, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.18% (0.6660 => 0.6315, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.17% (0.2999 => 0.2844, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.17% (0.5863 => 0.5560, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.17% (0.3483 => 0.3303, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -5.14% (1.3864 => 1.3151, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.14% (0.2278 => 0.2161, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.13% (1.2221 => 1.1594, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.13% (0.7524 => 0.7138, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.09% (0.5849 => 0.5551, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.09% (1.2210 => 1.1588, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.09% (0.5478 => 0.5199, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.07% (0.5802 => 0.5508, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.06% (0.5688 => 0.5400, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.04% (0.6667 => 0.6331, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.04% (0.6395 => 0.6073, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.04% (0.6395 => 0.6073, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.02% (0.5575 => 0.5295, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.01% (0.7339 => 0.6971, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -5.00% (15.2527 => 14.4897, std.dev.: 0.0125) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.97% (0.3319 => 0.3154, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.97% (0.5456 => 0.5185, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.96% (0.5581 => 0.5304, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.96% (0.5925 => 0.5631, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.96% (0.5705 => 0.5422, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: -4.95% (3.5154 => 3.3413, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.95% (0.5941 => 0.5647, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -4.94% (15.5079 => 14.7424, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.93% (0.6446 => 0.6128, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.92% (0.6033 => 0.5736, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0009) MultiSource/Applications/lua/lua: -4.86% (4.0594 => 3.8621, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.85% (0.5570 => 0.5300, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.84% (0.6440 => 0.6128, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.83% (0.5567 => 0.5298, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.83% (1.6474 => 1.5679, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -4.81% (1.3148 => 1.2515, std.dev.: 0.0093) MultiSource/Applications/minisat/minisat: -4.79% (0.7447 => 0.7090, std.dev.: 0.0024) MultiSource/Applications/treecc/treecc: -4.70% (2.1401 => 2.0396, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.68% (0.5168 => 0.4926, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.68% (0.8521 => 0.8122, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.67% (0.4813 => 0.4588, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.65% (0.5569 => 0.5310, std.dev.: 0.0022) MultiSource/Applications/siod/siod: -4.64% (2.4021 => 2.2906, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: -4.63% (0.7779 => 0.7419, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.63% (0.4151 => 0.3959, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -4.58% (0.3255 => 0.3106, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.58% (22.4056 => 21.3802, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/09-vor/vor: -4.56% (0.3271 => 0.3122, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.54% (0.3016 => 0.2879, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -4.51% (0.3194 => 0.3050, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.50% (0.5329 => 0.5089, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -4.50% (0.3025 => 0.2889, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.49% (0.7021 => 0.6706, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.48% (0.3323 => 0.3174, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: -4.46% (0.6347 => 0.6064, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.46% (0.3837 => 0.3666, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -4.43% (0.3026 => 0.2892, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -4.42% (0.7982 => 0.7629, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.40% (0.3252 => 0.3109, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.39% (2.1713 => 2.0760, std.dev.: 0.0027) MultiSource/Applications/spiff/spiff: -4.38% (0.8418 => 0.8049, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: -4.38% (0.4248 => 0.4062, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.38% (0.3931 => 0.3759, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -4.34% (0.4861 => 0.4650, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.34% (0.3849 => 0.3682, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -4.33% (0.6441 => 0.6162, std.dev.: 0.0035) SingleSource/Regression/C++/ofstream_ctor: -4.32% (0.3059 => 0.2927, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.31% (0.6194 => 0.5927, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -4.29% (0.3446 => 0.3298, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.28% (0.6304 => 0.6034, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -4.28% (0.2989 => 0.2861, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.26% (0.9077 => 0.8690, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.23% (2.2587 => 2.1631, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.22% (0.6189 => 0.5928, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: -4.21% (0.3394 => 0.3251, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.18% (0.6297 => 0.6034, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.16% (0.2933 => 0.2811, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.12% (0.9557 => 0.9163, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -4.11% (0.2871 => 0.2753, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -4.06% (0.3867 => 0.3710, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -4.05% (0.3481 => 0.3340, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.05% (0.4321 => 0.4146, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/random: -4.05% (0.2939 => 0.2820, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hello: -4.00% (0.2849 => 0.2735, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -3.97% (34.0927 => 32.7383, std.dev.: 0.0435) SingleSource/Benchmarks/Shootout-C++/wc: -3.96% (0.3205 => 0.3078) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.96% (0.2903 => 0.2788, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -3.95% (0.3621 => 0.3478, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: -3.91% (18.2933 => 17.5787, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.86% (0.4427 => 0.4256, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.85% (0.4083 => 0.3926, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: -3.82% (5.0226 => 4.8309, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: -3.80% (0.4524 => 0.4352, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -3.64% (0.6750 => 0.6504, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.61% (0.3491 => 0.3365, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: -3.59% (0.3788 => 0.3652, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -3.49% (1.5610 => 1.5065, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.83% (5.4682 => 5.3135, std.dev.: 0.0199) SingleSource/UnitTests/Vector/constpool: -2.75% (20.7746 => 20.2040, std.dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7538, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -8.63% (1.2842 => 1.1734, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.97% (2.2633 => 2.1735, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.84% (1.7753 => 1.7071, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.24% (1.3096 => 1.2803, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4707, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.06% (1.6086 => 1.5915, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 09:14:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 11:14:46 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121117171446.673C82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5976?compare_to=5972&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5976, Order: 168259, Start Time: 2012-11-17 14:55:06, End Time: 2012-11-17 17:15:07 To: 5972, Order: 168258, Start Time: 2012-11-17 10:30:30, End Time: 2012-11-17 12:51:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 43 (126 on baseline) Performance Improvements: 4 (41 on baseline) Added Tests: 0 (136 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 993 (720 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 15.87% (0.6744 => 0.7814, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 15.43% (0.7920 => 0.9142, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/hello: 13.01% (0.2936 => 0.3318, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/bh/bh: 12.96% (0.3334 => 0.3766, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/methcall: 12.62% (0.3121 => 0.3515, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/18-imp/imp: 11.88% (0.3897 => 0.4360, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.75% (0.6206 => 0.6935, std.dev.: 0.0120) MultiSource/Applications/lemon/lemon: 11.35% (1.2025 => 1.3390, std.dev.: 0.0254) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.20% (0.5241 => 0.5828, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.10% (0.1180 => 0.1311, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.97% (0.6675 => 0.7407, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.50% (1.1114 => 1.2281, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.86% (0.6783 => 0.7452, std.dev.: 0.0247) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 9.81% (0.1499 => 0.1646, std.dev.: 0.0052) SingleSource/Benchmarks/Linpack/linpack-pc: 9.54% (0.2894 => 0.3170, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.03% (1.2232 => 1.3337, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/oourafft: 8.87% (0.3585 => 0.3903, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.58% (0.1527 => 0.1658, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 8.31% (0.1794 => 0.1943, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.29% (4.6882 => 5.0770, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/bigfib: 7.66% (0.7432 => 0.8001, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 7.11% (0.1674 => 0.1793, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.08% (0.9523 => 1.0197, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.94% (0.5104 => 0.5458, std.dev.: 0.0055) SingleSource/UnitTests/Vector/constpool: 5.75% (52.8317 => 55.8673, std.dev.: 0.9293) SingleSource/Benchmarks/Shootout-C++/lists: 4.61% (0.4055 => 0.4242, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.08% (2.4194 => 2.5182, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.44% (0.8229 => 0.8512, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.33% (12.2507 => 12.4136, std.dev.: 0.0171) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/minisat/minisat: 12.24% (10.3682 => 11.6369, std.dev.: 0.4649) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 9.30% (0.5346 => 0.5843, std.dev.: 0.0142) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 8.40% (1.5298 => 1.6583, std.dev.: 0.0347) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.91% (0.5768 => 0.6224, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/bh/bh: 6.43% (1.9725 => 2.0993, std.dev.: 0.0122) MultiSource/Applications/siod/siod: 6.02% (3.2023 => 3.3951, std.dev.: 0.0147) MultiSource/Benchmarks/FreeBench/neural/neural: 5.06% (0.2234 => 0.2347, std.dev.: 0.0036) MultiSource/Applications/lua/lua: 4.50% (26.7028 => 27.9031, std.dev.: 0.1261) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.89% (6.1447 => 6.3840, std.dev.: 0.0480) MultiSource/Applications/sqlite3/sqlite3: 3.86% (4.6121 => 4.7899, std.dev.: 0.0110) MultiSource/Benchmarks/NPB-serial/is/is: 3.42% (8.6488 => 8.9444, std.dev.: 0.0410) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.65% (32.1331 => 32.6631, std.dev.: 0.0883) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.42% (3.0214 => 3.0644, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.14% (7.2796 => 7.3625, std.dev.: 0.0253) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.67% (5.3464 => 4.6156, std.dev.: 0.2756) SingleSource/UnitTests/ObjC/BoolLiteralTest: -10.20% (0.4873 => 0.4376, std.dev.: 0.0190) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -6.27% (0.2439 => 0.2286, std.dev.: 0.0059) MultiSource/Applications/SIBsim4/SIBsim4: -1.65% (3.9245 => 3.8596, std.dev.: 0.0232) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 1.12% (0.1337 => 0.1352, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.48% (0.0420 => 0.0485, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.41% (0.0675 => 0.0652, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -0.03% (494.3033 => 494.1653, std.dev.: 0.1381) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.89% (4.3882 => 0.0485, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 43720.63% (1.1277 => 494.1653, std.dev.: 0.1381) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 195.26% (0.5229 => 1.5439, std.dev.: 0.0988) MultiSource/Applications/SPASS/SPASS: 22.66% (14.9895 => 18.3855, std.dev.: 0.0709) MultiSource/Applications/kimwitu++/kc: 50.36% (14.1553 => 21.2845, std.dev.: 0.0967) MultiSource/Benchmarks/MallocBench/gs/gs: 25.27% (4.1105 => 5.1491, std.dev.: 0.1409) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.07% (1.1048 => 1.5143, std.dev.: 0.0742) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 435.43% (7.1582 => 38.3273, std.dev.: 0.2222) SingleSource/Benchmarks/Misc-C++-EH/spirit: 77.15% (3.4629 => 6.1347, std.dev.: 0.4339) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.43% (0.6222 => 1.0293, std.dev.: 0.0755) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10663.19% (0.0720 => 7.7495, std.dev.: 0.2293) MultiSource/Applications/SIBsim4/SIBsim4: 3859500.00% (0.0001 => 3.8596, std.dev.: 0.0232) MultiSource/Applications/SPASS/SPASS: 14092800.00% (0.0001 => 14.0929, std.dev.: 0.8574) MultiSource/Applications/kimwitu++/kc: 52100.00% (0.0001 => 0.0522, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 64800.00% (0.0001 => 0.0649, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 622300.00% (0.0001 => 0.6224, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10083000.00% (0.0001 => 10.0831, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6271200.00% (0.0001 => 6.2713, std.dev.: 0.2317) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1807.96% (1.1194 => 21.3577, std.dev.: 0.0832) MultiSource/Applications/ClamAV/clamscan: 71.07% (22.1758 => 37.9361, std.dev.: 0.1004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.76% (7.0540 => 11.1282, std.dev.: 0.1418) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.08% (2.9384 => 4.6156, std.dev.: 0.2756) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 52.57% (8.1363 => 12.4136, std.dev.: 0.0171) MultiSource/Applications/JM/lencod/lencod: 47.81% (21.9371 => 32.4262, std.dev.: 0.1140) MultiSource/Benchmarks/FreeBench/distray/distray: 45.08% (0.1056 => 0.1532, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/almabench: 38.36% (0.0730 => 0.1010, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 38.34% (0.1432 => 0.1981, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/tsp/tsp: 31.66% (0.1175 => 0.1547, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bisort/bisort: 30.94% (0.0614 => 0.0804, std.dev.: 0.0021) SingleSource/UnitTests/vla: 30.42% (0.0355 => 0.0463, std.dev.: 0.0023) MultiSource/Benchmarks/BitBench/five11/five11: 29.28% (0.0567 => 0.0733, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 27.37% (0.3423 => 0.4360, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 26.40% (0.5860 => 0.7407, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 26.28% (0.4615 => 0.5828, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 26.04% (0.0457 => 0.0576, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 25.77% (0.9765 => 1.2281, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/health/health: 25.55% (0.1268 => 0.1592, std.dev.: 0.0024) MultiSource/Applications/viterbi/viterbi: 24.95% (0.1555 => 0.1943, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: 24.88% (1.0722 => 1.3390, std.dev.: 0.0254) SingleSource/Benchmarks/Shootout-C++/reversefile: 24.79% (0.3865 => 0.4823, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.78% (0.8172 => 1.0197, std.dev.: 0.0109) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.66% (0.0746 => 0.0930, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 24.32% (1.3050 => 1.6224, std.dev.: 0.0201) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.24% (0.8101 => 1.0065, std.dev.: 0.0053) SingleSource/Benchmarks/Stanford/Oscar: 24.21% (0.0636 => 0.0790, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.01% (0.1337 => 0.1658, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 23.96% (0.3422 => 0.4242, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/bigfib: 23.93% (0.6456 => 0.8001, std.dev.: 0.0141) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.77% (0.3121 => 0.3863, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 23.53% (0.0442 => 0.0546, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.42% (0.1029 => 0.1270, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 23.07% (5.7591 => 7.0876, std.dev.: 0.1469) SingleSource/Benchmarks/Shootout-C++/except: 22.92% (0.2871 => 0.3529, std.dev.: 0.0129) MultiSource/Benchmarks/McCat/08-main/main: 22.75% (0.2554 => 0.3135, std.dev.: 0.0203) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 22.61% (14.3668 => 17.6152, std.dev.: 0.0548) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 22.32% (0.0838 => 0.1025, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hello: 22.25% (0.2714 => 0.3318, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/methcall: 22.18% (0.2877 => 0.3515, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: 21.80% (0.3092 => 0.3766, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/sieve: 21.70% (0.3603 => 0.4385, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/bmm/bmm: 21.61% (0.0759 => 0.0923, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 21.56% (0.0770 => 0.0936, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 21.47% (0.6675 => 0.8108, std.dev.: 0.0201) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 21.42% (3.8922 => 4.7258, std.dev.: 0.1174) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.17% (0.0770 => 0.0933, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 21.02% (0.1584 => 0.1917, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/fibo: 20.95% (0.2725 => 0.3296, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.86% (0.1117 => 0.1350, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 20.06% (9.4845 => 11.3873, std.dev.: 0.1291) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.92% (0.0793 => 0.0951, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.54% (0.0834 => 0.0997, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.19% (0.2700 => 0.3218, std.dev.: 0.0176) MultiSource/Benchmarks/nbench/nbench: 19.07% (1.1840 => 1.4098, std.dev.: 0.0526) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.99% (1.5415 => 1.8343, std.dev.: 0.0534) SingleSource/Benchmarks/Misc/oourafft: 18.92% (0.3282 => 0.3903, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 18.88% (0.1695 => 0.2015, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.77% (0.5105 => 0.6063, std.dev.: 0.0225) MultiSource/Applications/sqlite3/sqlite3: 18.48% (17.1811 => 20.3569, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.40% (0.8067 => 0.9551, std.dev.: 0.0330) MultiSource/Applications/lua/lua: 16.52% (3.8723 => 4.5120, std.dev.: 0.1617) MultiSource/Applications/d/make_dparser: 16.48% (3.3354 => 3.8850, std.dev.: 0.1947) MultiSource/Benchmarks/PAQ8p/paq8p: 16.30% (10.3673 => 12.0571, std.dev.: 0.1189) SingleSource/Benchmarks/Shootout/matrix: 16.26% (0.0818 => 0.0951, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.05% (0.0648 => 0.0752, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 15.99% (0.1163 => 0.1349, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/synchronized: 15.50% (0.3561 => 0.4113, std.dev.: 0.0111) MultiSource/Applications/aha/aha: 15.38% (0.1151 => 0.1328, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/neural/neural: 15.24% (0.1463 => 0.1686, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.05% (0.1940 => 0.2232, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 14.96% (63.2438 => 72.7041, std.dev.: 0.0791) MultiSource/Benchmarks/NPB-serial/is/is: 14.88% (0.0719 => 0.0826, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.70% (4.9449 => 5.6718, std.dev.: 0.1255) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.62% (0.2107 => 0.2415, std.dev.: 0.0117) MultiSource/Applications/hexxagon/hexxagon: 14.36% (1.2842 => 1.4686, std.dev.: 0.0422) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.35% (2.2022 => 2.5182, std.dev.: 0.0127) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.12% (4.2646 => 4.8669, std.dev.: 0.1376) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.93% (0.5981 => 0.6814, std.dev.: 0.0259) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.34% (0.3441 => 0.3900, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.11% (5.0018 => 5.6577, std.dev.: 0.1254) SingleSource/UnitTests/ObjC/trivial-interface: 12.93% (0.3473 => 0.3922, std.dev.: 0.0172) SingleSource/UnitTests/ObjC/exceptions-4: 12.62% (0.3543 => 0.3990, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.87% (0.4879 => 0.5458, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/football/football: 10.79% (0.8921 => 0.9884, std.dev.: 0.0297) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.73% (0.3427 => 0.3692, std.dev.: 0.0083) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.50% (7.9617 => 8.4796, std.dev.: 0.1279) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.49% (4.3953 => 11.0096, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/methcall: 147.74% (5.3999 => 13.3777, std.dev.: 0.0053) MultiSource/Benchmarks/llubenchmark/llu: 107.82% (3.7781 => 7.8517, std.dev.: 0.5645) MultiSource/Applications/minisat/minisat: 27.65% (9.1159 => 11.6369, std.dev.: 0.4649) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 24.17% (13.4384 => 16.6861, std.dev.: 0.4639) MultiSource/Benchmarks/Olden/bisort/bisort: 22.91% (0.8333 => 1.0242, std.dev.: 0.0463) SingleSource/Benchmarks/Shootout-C++/ary3: 19.66% (3.7221 => 4.4539, std.dev.: 0.2048) SingleSource/Benchmarks/Misc/oourafft: 17.50% (6.6465 => 7.8094, std.dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.63% (1.1145 => 1.2998, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/tsp/tsp: 16.39% (1.0785 => 1.2553, std.dev.: 0.0186) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.38% (0.2944 => 0.3338, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.67% (2.8904 => 3.2277, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: 10.22% (1.1396 => 1.2561, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.28% (1.7254 => 1.8856, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/bh/bh: 8.18% (1.9405 => 2.0993, std.dev.: 0.0122) MultiSource/Applications/lua/lua: 6.94% (26.0924 => 27.9031, std.dev.: 0.1261) SingleSource/Benchmarks/Misc/ffbench: 6.86% (0.9505 => 1.0157, std.dev.: 0.0101) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.94% (0.9540 => 1.0107, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.39% (4.2280 => 4.4560, std.dev.: 0.0169) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 5.11% (0.2233 => 0.2347, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.12% (11.6436 => 12.1234, std.dev.: 0.0075) MultiSource/Applications/siod/siod: 3.42% (3.2827 => 3.3951, std.dev.: 0.0147) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.36% (0.4162 => 0.4302, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 3.14% (4.6441 => 4.7899, std.dev.: 0.0110) MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.08% (2.1424 => 2.2084, std.dev.: 0.0141) SingleSource/Benchmarks/Dhrystone/dry: 2.63% (2.4116 => 2.4751, std.dev.: 0.0127) MultiSource/Benchmarks/PAQ8p/paq8p: 2.20% (85.0658 => 86.9398, std.dev.: 0.1038) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.19% (1.7133 => 1.7508, std.dev.: 0.0141) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 2.07% (3.1595 => 3.2248, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/fldry: 1.98% (1.9577 => 1.9964, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 1.44% (27.8444 => 28.2445, std.dev.: 0.0303) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.40% (6.5088 => 6.6000, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout/sieve: 1.38% (5.2139 => 5.2858, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0499, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.32% (6.6874 => 0.1793, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -74.72% (5.2763 => 1.3337, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/salsa20: -74.42% (0.8651 => 0.2213, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -44.76% (0.1622 => 0.0896, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.77% (5.3526 => 4.7224, std.dev.: 0.1240) MultiSource/Applications/JM/ldecod/ldecod: -9.75% (10.4361 => 9.4186, std.dev.: 0.2182) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -9.47% (1.7609 => 1.5941, std.dev.: 0.0512) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.73% (5.3855 => 5.0770, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.04% (0.0628 => 0.0364, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.06% (0.3987 => 0.2390, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.53% (0.0506 => 0.0306, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.32% (4.5009 => 2.7763, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: -33.54% (1.1492 => 0.7638, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -25.12% (10.7105 => 8.0196, std.dev.: 0.3403) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.13% (2.6546 => 2.0141, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: -19.25% (0.2161 => 0.1745, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.62% (1.6925 => 1.4281, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.68% (2.6778 => 2.2847, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.75% (32.5116 => 29.0169, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.50% (1.5660 => 1.4329, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.93% (4.8142 => 4.4805, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -6.47% (9.5636 => 8.9444, std.dev.: 0.0410) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.47% (3.2416 => 3.0644, std.dev.: 0.0108) SingleSource/Benchmarks/CoyoteBench/huffbench: -5.25% (19.9488 => 18.9013, std.dev.: 0.2196) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: -4.80% (1.5835 => 1.5075, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.61% (1.6805 => 1.6030, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout/lists: -4.19% (6.2999 => 6.0358, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: -3.08% (5.0483 => 4.8928, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.63% (0.9957 => 0.9695, std.dev.: 0.0052) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.29% (0.4808 => 0.4698, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6767, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.66% (8.1563 => 8.0213, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/salsa20: -1.52% (10.2830 => 10.1269, std.dev.: 0.0043) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.96% (0.1485 => 0.1352, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0012) Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 11:05:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 13:05:52 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121117190552.6DC782A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5977?compare_to=5973&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5977, Order: 168259, Start Time: 2012-11-17 15:46:44, End Time: 2012-11-17 19:06:13 To: 5973, Order: 168258, Start Time: 2012-11-17 11:39:07, End Time: 2012-11-17 14:58:59 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (175 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (136 on baseline) Unchanged Tests: 1044 (716 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.68% (0.0625 => 0.0873, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.51% (0.1063 => 0.1398, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.54% (0.2969 => 0.3757, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.13% (0.1106 => 0.1395, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.77% (0.0714 => 0.0898, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.16% (0.4253 => 0.5323, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.10% (0.4139 => 0.5178, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.49% (0.5900 => 0.7345, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.09% (0.4994 => 0.6197, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.79% (0.0475 => 0.0588, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 23.59% (1.5932 => 1.9690, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.52% (0.0897 => 0.1108, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.46% (0.5000 => 0.6173, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.46% (0.0584 => 0.0721, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.90% (0.1620 => 0.1991, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: 22.70% (0.0599 => 0.0735, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.62% (0.1021 => 0.1252, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.22% (0.1107 => 0.1353, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 21.75% (0.0947 => 0.1153, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.67% (0.1103 => 0.1342, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.34% (0.0642 => 0.0779, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.33% (0.0633 => 0.0768, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.23% (0.0584 => 0.0708, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 21.10% (0.0948 => 0.1148, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.07% (0.0541 => 0.0655, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.73% (0.3903 => 0.4712, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 20.71% (0.0821 => 0.0991, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.64% (0.1003 => 0.1210, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.64% (0.1604 => 0.1935, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.56% (0.0822 => 0.0991, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 20.51% (0.1619 => 0.1951, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.40% (0.0495 => 0.0596, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.34% (0.1549 => 0.1864, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 19.43% (0.0808 => 0.0965, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.29% (0.1462 => 0.1744, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.07% (0.2014 => 0.2398, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.05% (0.3890 => 0.4631, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.93% (0.2736 => 0.3254, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.83% (1.3152 => 1.5628, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 18.72% (0.1218 => 0.1446, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.60% (0.2866 => 0.3399, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 18.39% (0.4029 => 0.4770, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 18.34% (0.0698 => 0.0826, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.01% (0.1088 => 0.1284, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 18.01% (0.1505 => 0.1776, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.95% (0.3271 => 0.3858, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/Hello: 17.87% (0.5826 => 0.6867, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.87% (0.5026 => 0.5924, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 17.81% (0.5546 => 0.6534, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.69% (0.0605 => 0.0712, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.68% (3.5627 => 4.1925, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.66% (0.0572 => 0.0673, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 17.60% (1.8794 => 2.2102, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 17.58% (0.5889 => 0.6924, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.45% (0.0573 => 0.0673, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.40% (1.6211 => 1.9031, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.23% (0.1968 => 0.2307, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 17.13% (1.0781 => 1.2628, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.07% (0.4658 => 0.5453, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.90% (0.1160 => 0.1356, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 16.75% (0.1421 => 0.1659, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 16.71% (0.7171 => 0.8369, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.63% (0.2875 => 0.3353, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.62% (0.3930 => 0.4583, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.58% (2.7292 => 3.1816, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: 16.54% (0.9697 => 1.1301, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.44% (0.4361 => 0.5078, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 16.33% (0.2566 => 0.2985, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.27% (4.4195 => 5.1386, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/bh/bh: 16.12% (0.1284 => 0.1491, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.11% (0.2738 => 0.3179, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 16.11% (4.2109 => 4.8891, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/matrix: 15.86% (0.2780 => 0.3221, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 15.83% (0.2811 => 0.3256, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 15.82% (0.2750 => 0.3185, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 15.77% (0.2714 => 0.3142, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.77% (1.9694 => 2.2799, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 15.74% (0.2725 => 0.3154, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 15.66% (0.2803 => 0.3242, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 15.62% (0.2823 => 0.3264, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.59% (0.3195 => 0.3693, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.54% (0.2729 => 0.3153, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 15.48% (0.3004 => 0.3469, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.46% (1.9966 => 2.3053, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.46% (0.2911 => 0.3361, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 15.36% (0.2813 => 0.3245, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 15.31% (0.3096 => 0.3570, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 15.30% (0.9909 => 1.1425, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.26% (0.2792 => 0.3218) MultiSource/Benchmarks/Bullet/bullet: 15.16% (23.5202 => 27.0853, std.dev.: 0.0220) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.10% (2.0673 => 2.3795, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.05% (0.1090 => 0.1254, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 14.84% (0.2075 => 0.2383, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.79% (0.3488 => 0.4004, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 14.78% (0.3267 => 0.3750, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 14.65% (0.3317 => 0.3803, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 14.62% (1.4269 => 1.6355, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 14.58% (0.3258 => 0.3733, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 14.57% (0.3678 => 0.4214, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 14.48% (0.3446 => 0.3945, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.44% (0.3469 => 0.3970, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 14.36% (0.3496 => 0.3998, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 14.34% (0.3348 => 0.3828, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 14.31% (0.3465 => 0.3961, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.31% (0.3060 => 0.3498, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.31% (0.3362 => 0.3843, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 14.25% (0.3460 => 0.3953, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.18% (0.3442 => 0.3930, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 14.10% (0.7875 => 0.8985, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.08% (0.3124 => 0.3564, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 14.08% (0.2691 => 0.3070, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 14.06% (0.3477 => 0.3966, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/exceptions: 13.97% (0.3643 => 0.4152, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 13.90% (0.3726 => 0.4244, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.89% (0.3282 => 0.3738, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 13.85% (0.0758 => 0.0863, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 13.85% (2.1653 => 2.4651, std.dev.: 0.0065) SingleSource/UnitTests/ObjC/property: 13.84% (0.3650 => 0.4155, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 13.72% (4.6177 => 5.2511, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.68% (0.3625 => 0.4121, std.dev.: 0.0096) SingleSource/UnitTests/ObjC/parameter-passing: 13.61% (0.3724 => 0.4231, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 13.60% (0.4146 => 0.4710, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.44% (0.3690 => 0.4186, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.44% (0.3981 => 0.4516, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 13.43% (2.1013 => 2.3834, std.dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.42% (0.3845 => 0.4361, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 13.27% (0.4251 => 0.4815, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.19% (0.2040 => 0.2309, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.09% (0.1383 => 0.1564, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 12.65% (0.5012 => 0.5646, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 12.21% (5.5417 => 6.2185, std.dev.: 0.0152) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.73% (0.6435 => 0.7190, std.dev.: 0.0131) MultiSource/Applications/siod/siod: 11.43% (0.6634 => 0.7392, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.28% (0.1028 => 0.1144, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.27% (0.2068 => 0.2301, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.06% (0.3498 => 0.3885, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 10.91% (0.4847 => 0.5376, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.91% (0.3336 => 0.3700, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.78% (0.2737 => 0.3032, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.64% (0.3084 => 0.3412, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 9.88% (2.0346 => 2.2357, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.84% (0.2103 => 0.2310, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 9.74% (0.2391 => 0.2624, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.82% (4.6926 => 5.1065, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.66% (0.5361 => 0.5825, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.53% (11.6398 => 12.6323, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.17% (0.5584 => 0.6040, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.04% (0.7426 => 0.8023, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 6.80% (11.9555 => 12.7682, std.dev.: 0.0074) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.93% (0.3792 => 0.3979, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.26% (0.0734 => 0.0868, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 9.74% (0.2802 => 0.3075, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.69% (0.2122 => 0.2264, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6087, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.66% (0.3693 => 0.3902, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.23% (12.0509 => 12.6815, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-2: 4.96% (1.8057 => 1.8952, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1648, std.dev.: 0.0118) SingleSource/Benchmarks/Dhrystone/dry: 4.27% (14.0481 => 14.6476, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1950, std.dev.: 0.0437) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2220, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3115, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2864, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5129, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5881, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5691, std.dev.: 0.0102) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9750, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7956, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -6.29% (0.2402 => 0.2251, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8034, std.dev.: 0.0016) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.99% (0.6293 => 0.6105, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.59% (17.2379 => 16.7914, std.dev.: 0.0647) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8664, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5722, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4953, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1860, std.dev.: 0.0810) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0423, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 11:29:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 13:29:08 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121117192908.F18562A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5978?compare_to=5974&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5978, Order: 168260, Start Time: 2012-11-17 17:56:49, End Time: 2012-11-17 19:29:30 To: 5974, Order: 168259, Start Time: 2012-11-17 14:19:28, End Time: 2012-11-17 15:48:06 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 12 (30 on baseline) Performance Regressions: 11 (55 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 983 (905 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat MultiSource/Applications/kimwitu++/kc: 3.81% (16.8644 => 17.5077, std.dev.: 0.2865) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.15% (22.0694 => 22.3235, std.dev.: 1.0356) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.14% (0.3662 => 0.3657, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/bigfib: 2.39% (0.6115 => 0.6261, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.94% (0.3345 => 0.3410, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: 1.83% (0.2018 => 0.2055, std.dev.: 0.0062) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat MultiSource/Applications/kimwitu++/kc: 51700.00% (0.0001 => 0.0518, std.dev.: 0.0081) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5123, std.dev.: 0.0204) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.6505, std.dev.: 0.4281) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3627, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0882, std.dev.: 0.0226) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.02% (0.0681 => 0.0865, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/mst/mst: 9.88% (0.1144 => 0.1257, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.22% (0.2277 => 0.2487, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.88% (1.3371 => 1.4023, std.dev.: 0.0152) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.24% (1.2774 => 1.3316, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.02% (0.8841 => 0.9020, std.dev.: 0.0048) MultiSource/Benchmarks/nbench/nbench: 1.46% (1.1617 => 1.1787, std.dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.04% (1.3501 => 1.4316, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.99% (2.7909 => 2.8463, std.dev.: 0.0194) MultiSource/Benchmarks/BitBench/five11/five11: 1.52% (5.6334 => 5.7193, std.dev.: 0.0137) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.08% (0.9273 => 0.9373, std.dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.06% (1.0687 => 1.0693, std.dev.: 0.0467) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 67.42% (0.0132 => 0.0221, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 19.89% (0.0357 => 0.0428, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 18.51% (0.0281 => 0.0333, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 9.06% (0.0287 => 0.0313, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 15.22% (0.0368 => 0.0424, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: 27.50% (0.0160 => 0.0204, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 53.52% (0.0142 => 0.0218, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 1.56% (0.1476 => 0.1499, std.dev.: 0.0254) MultiSource/Applications/lemon/lemon: 9.95% (1.0910 => 1.1996, std.dev.: 0.4058) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.11% (0.4146 => 0.4100, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.73% (0.1429 => 0.1390, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.31% (0.0639 => 0.0637, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.09% (0.0275 => 0.0261, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.09% (0.0551 => 0.0568, std.dev.: 0.0142) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.29% (1.1903 => 1.1938, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 100.00% (0.0004 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.81% (0.0570 => 0.0643, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 45.36% (0.0183 => 0.0266, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.82% (0.7785 => 0.7849, std.dev.: 0.0026) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0007) SingleSource/UnitTests/SignlessTypes/Large/cast: -11.86% (0.0059 => 0.0052, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 6.46% (16.4461 => 17.5077, std.dev.: 0.2865) MultiSource/Applications/sqlite3/sqlite3: 2330.50% (0.6332 => 15.3899, std.dev.: 0.7207) MultiSource/Benchmarks/McCat/08-main/main: 49.48% (0.1831 => 0.2737, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.62% (0.1559 => 0.1487, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7048.09% (0.3123 => 22.3235, std.dev.: 1.0356) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.48% (0.2463 => 0.3657, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1517.97% (0.3344 => 5.4105, std.dev.: 0.2701) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.44% (0.2364 => 0.3249, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/bigfib: 4.18% (0.6010 => 0.6261, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/mandel: 2.80% (0.0429 => 0.0441, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.41% (0.3266 => 0.3410, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: 4.37% (0.1969 => 0.2055, std.dev.: 0.0062) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.79% (0.0224 => 0.0228, std.dev.: 0.0025) SingleSource/UnitTests/byval-alignment: -31.30% (0.0230 => 0.0158, std.dev.: 0.0063) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0518, std.dev.: 0.0081) MultiSource/Applications/oggenc/oggenc: 9.17% (0.1462 => 0.1596, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4688, std.dev.: 0.0556) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0694, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4959, std.dev.: 0.0068) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5123, std.dev.: 0.0204) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.6505, std.dev.: 0.4281) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3216, std.dev.: 0.0179) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1382, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3627, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4077, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0882, std.dev.: 0.0226) SingleSource/Regression/C/uint64_to_float: -23.95% (2.1832 => 1.6603, std.dev.: 0.0249) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.65% (0.0830 => 0.0935, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.13% (0.2279 => 0.2487, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.58% (0.2180 => 0.2367, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.49% (0.1425 => 0.1546, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.45% (0.1905 => 0.2066, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.83% (0.3295 => 0.3520, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.44% (0.5961 => 0.6345, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.31% (1.2526 => 1.3316, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.76% (1.1606 => 1.2274, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.60% (1.3279 => 1.4023, std.dev.: 0.0152) MultiSource/Benchmarks/MallocBench/gs/gs: 5.03% (4.1305 => 4.3384, std.dev.: 0.0759) MultiSource/Benchmarks/Olden/bh/bh: 4.92% (0.2985 => 0.3132, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.83% (0.4783 => 0.5014, std.dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 4.58% (1.1271 => 1.1787, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.66% (8.6476 => 8.9643, std.dev.: 0.0672) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.59% (0.4127 => 0.4275, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.52% (1.4479 => 1.4988, std.dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.40% (0.6227 => 0.6439, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.36% (0.8286 => 0.8564, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.12% (0.8331 => 0.8591, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/football/football: 2.87% (0.8768 => 0.9020, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.51% (0.8317 => 0.8526, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.37% (0.8927 => 0.9139, std.dev.: 0.0079) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 103.52% (0.0199 => 0.0405, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/pi: 58.44% (1.5795 => 2.5025, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.42% (2.9753 => 3.4639, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.41% (0.7597 => 0.8844, std.dev.: 0.0350) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.42% (2.7995 => 3.2032, std.dev.: 0.0423) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.48% (5.0261 => 5.6032, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.11% (1.1857 => 1.2819, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 7.28% (1.7056 => 1.8297, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.13% (6.3772 => 6.8322, std.dev.: 0.1071) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.62% (4.7794 => 5.0958, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.26% (4.5327 => 4.8163, std.dev.: 0.0303) SingleSource/Benchmarks/Misc/richards_benchmark: 6.24% (1.3037 => 1.3851, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.00% (4.9686 => 5.2669, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 5.02% (4.9469 => 5.1954, std.dev.: 0.0121) MultiSource/Applications/lambda-0_1_3/lambda: 4.92% (7.4933 => 7.8617, std.dev.: 0.0368) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.78% (3.3761 => 3.5374, std.dev.: 0.0218) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.73% (6.2275 => 6.5219, std.dev.: 0.0790) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.17% (4.9453 => 5.1514, std.dev.: 0.0158) MultiSource/Applications/hexxagon/hexxagon: 3.97% (14.0064 => 14.5621, std.dev.: 0.0540) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.13% (1.3882 => 1.4316, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.85% (11.5690 => 11.8987, std.dev.: 0.0516) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.49% (8.2783 => 8.4843, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.24% (4.8660 => 4.9748, std.dev.: 0.0417) MultiSource/Benchmarks/BitBench/five11/five11: 2.08% (5.6030 => 5.7193, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.07% (4.8362 => 4.9364, std.dev.: 0.0340) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.59% (1.1365 => 1.1546, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/power/power: 1.49% (1.2061 => 1.2241, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/FloatMM: 1.46% (0.8807 => 0.8936, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/neural/neural: 1.31% (1.0841 => 1.0983, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 1.31% (8.5322 => 8.6437, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/bh/bh: 1.22% (2.3560 => 2.3847, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.08% (3.5679 => 3.6065, std.dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.21% (5.4641 => 4.3053, std.dev.: 0.0130) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.84% (1.0512 => 0.9373, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: -8.54% (63.1822 => 57.7840, std.dev.: 0.1522) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.79% (14.6451 => 13.5036, std.dev.: 0.0552) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.87% (4.7482 => 4.4218, std.dev.: 0.0302) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.89% (5.4972 => 5.1735, std.dev.: 0.0285) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.06% (5.1557 => 4.8947, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.34% (4.7449 => 4.5389, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.68% (6.0224 => 5.8006, std.dev.: 0.0074) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.01% (28.5821 => 27.7219, std.dev.: 0.0406) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.31% (9.9065 => 9.6772, std.dev.: 0.0472) SingleSource/Benchmarks/Shootout-C++/hash2: -2.19% (3.4237 => 3.3487, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.99% (11.5316 => 11.3022, std.dev.: 0.0406) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.43% (4.9994 => 4.9279, std.dev.: 0.0155) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.20% (1.0262 => 1.0693, std.dev.: 0.0467) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 79.67% (0.0123 => 0.0221, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 4.24% (0.1438 => 0.1499, std.dev.: 0.0254) MultiSource/Applications/lemon/lemon: 5.89% (1.1329 => 1.1996, std.dev.: 0.4058) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.54% (0.4164 => 0.4100, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.53% (0.1369 => 0.1390, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.62% (0.0641 => 0.0637, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 33.85% (0.0195 => 0.0261, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.73% (0.0578 => 0.0568, std.dev.: 0.0142) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.38% (1.1437 => 1.1938, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -42.86% (0.0014 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.55% (0.0627 => 0.0643, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.10% (0.8017 => 0.7849, std.dev.: 0.0026) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0007) SingleSource/UnitTests/SignlessTypes/Large/cast: -16.13% (0.0062 => 0.0052, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 11:32:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 13:32:42 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121117193242.1E24A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5979?compare_to=5975&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5979, Order: 168260, Start Time: 2012-11-17 18:00:36, End Time: 2012-11-17 19:33:04 To: 5975, Order: 168259, Start Time: 2012-11-17 14:23:41, End Time: 2012-11-17 15:56:35 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (181 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1044 (857 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.74% (2.0478 => 2.1040, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/salsa20: 2.48% (7.4937 => 7.6793, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 2.22% (3.1932 => 3.2640, std.dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.60% (0.1431 => 0.1308, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.11% (0.3821 => 0.3511, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: -6.79% (0.3812 => 0.3553, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.72% (2.4924 => 2.3250, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.68% (0.3142 => 0.2932, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.64% (0.3884 => 0.3626, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.62% (0.3880 => 0.3623, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -6.62% (0.3896 => 0.3638, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.62% (0.4033 => 0.3766, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.60% (0.3831 => 0.3578, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.58% (0.3357 => 0.3136, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.58% (0.3891 => 0.3635, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.56% (0.4176 => 0.3902, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.55% (0.3848 => 0.3596, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.47% (0.2428 => 0.2271, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.47% (0.9542 => 0.8925, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: -6.31% (0.4199 => 0.3934, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.22% (0.7198 => 0.6750, std.dev.: 0.0079) MultiSource/Benchmarks/mafft/pairlocalalign: -6.21% (9.2283 => 8.6552, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/oourafft: -6.20% (0.2160 => 0.2026) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.20% (0.6484 => 0.6082, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.18% (0.1796 => 0.1685, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -6.17% (16.1920 => 15.1925, std.dev.: 0.0125) MultiSource/Applications/JM/ldecod/ldecod: -6.13% (7.0961 => 6.6611, std.dev.: 0.0127) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.06% (0.1716 => 0.1612, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -6.00% (0.4280 => 0.4023, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.96% (0.9852 => 0.9265, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.93% (1.0544 => 0.9919, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -5.90% (0.9179 => 0.8637, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.90% (1.3722 => 1.2912, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.88% (0.3658 => 0.3443, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.83% (6.7716 => 6.3767, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.82% (0.2355 => 0.2218, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.81% (4.8161 => 4.5364, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.81% (4.8802 => 4.5969, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.79% (0.2695 => 0.2539, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.77% (1.4642 => 1.3797, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.75% (4.5069 => 4.2477, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.74% (4.0323 => 3.8009, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.68% (1.6364 => 1.5435, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.64% (1.2300 => 1.1606, std.dev.: 0.0036) MultiSource/Applications/lemon/lemon: -5.64% (1.1450 => 1.0804, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/gs/gs: -5.63% (4.3330 => 4.0891, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.60% (3.5339 => 3.3359, std.dev.: 0.0179) MultiSource/Benchmarks/sim/sim: -5.58% (0.3406 => 0.3216, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.58% (0.6293 => 0.5942, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -5.58% (1.2515 => 1.1817, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.55% (0.6681 => 0.6310, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.55% (0.5805 => 0.5483, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: -5.54% (0.4515 => 0.4265, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: -5.52% (1.1530 => 1.0893, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.51% (0.6736 => 0.6365, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.49% (0.7919 => 0.7484, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -5.49% (0.2659 => 0.2513, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.49% (0.6230 => 0.5888, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.49% (14.2083 => 13.4284, std.dev.: 0.0215) MultiSource/Applications/SIBsim4/SIBsim4: -5.49% (1.3864 => 1.3103, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.47% (0.6660 => 0.6296, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -5.45% (0.3581 => 0.3386, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.44% (1.2784 => 1.2089, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -5.43% (0.2985 => 0.2823, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.42% (0.6052 => 0.5724, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.40% (8.0126 => 7.5803, std.dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: -5.38% (17.1032 => 16.1824, std.dev.: 0.0118) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.36% (0.8521 => 0.8064, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.36% (0.5859 => 0.5545, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.36% (0.5863 => 0.5549, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.35% (0.5591 => 0.5292, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.34% (0.3483 => 0.3297, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.34% (0.2548 => 0.2412, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.34% (0.2999 => 0.2839, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.33% (0.6676 => 0.6320, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.31% (0.5478 => 0.5187, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.31% (0.2278 => 0.2157, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.28% (0.5857 => 0.5548, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.26% (0.6667 => 0.6316, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.26% (0.7524 => 0.7128, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.23% (0.4916 => 0.4659, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.22% (0.5925 => 0.5616, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.21% (0.6395 => 0.6062, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.20% (0.5688 => 0.5392, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.19% (0.6260 => 0.5935, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.19% (0.5705 => 0.5409, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.18% (1.2210 => 1.1577, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: -5.18% (15.5079 => 14.7041, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.16% (0.5849 => 0.5547, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.16% (0.6395 => 0.6065, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.15% (0.5802 => 0.5503, std.dev.: 0.0094) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.15% (0.3319 => 0.3148, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.11% (0.5456 => 0.5177, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.10% (0.5569 => 0.5285, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.09% (0.5581 => 0.5297, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.08% (0.7339 => 0.6966, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.07% (0.5941 => 0.5640, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: -5.04% (3.5154 => 3.3383, std.dev.: 0.0161) MultiSource/Applications/ClamAV/clamscan: -5.04% (15.2527 => 14.4847, std.dev.: 0.0161) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.03% (0.2385 => 0.2265, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.02% (0.5575 => 0.5295, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.02% (0.5999 => 0.5698, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.01% (0.6446 => 0.6123, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.99% (0.6033 => 0.5732, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.95% (0.6440 => 0.6121, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.94% (1.2221 => 1.1617, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -4.92% (4.0594 => 3.8595, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.87% (0.5570 => 0.5299, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: -4.85% (1.3148 => 1.2510, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.84% (1.6474 => 1.5676, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.84% (0.5168 => 0.4918, std.dev.: 0.0019) MultiSource/Applications/siod/siod: -4.83% (2.4021 => 2.2860, std.dev.: 0.0042) MultiSource/Applications/treecc/treecc: -4.77% (2.1401 => 2.0380, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: -4.77% (0.3271 => 0.3115, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.75% (0.2106 => 0.2006, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -4.73% (0.7447 => 0.7095, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.72% (0.5567 => 0.5304, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.70% (0.4151 => 0.3956, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -4.69% (0.7779 => 0.7414, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.65% (0.4813 => 0.4589, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.56% (22.4056 => 21.3829, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (0.7021 => 0.6702, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.52% (0.6194 => 0.5914, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -4.49% (0.8418 => 0.8040, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.48% (0.3016 => 0.2881, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.47% (0.6347 => 0.6063, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.46% (0.6297 => 0.6016, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.46% (0.3252 => 0.3107, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.45% (0.3323 => 0.3175, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.45% (0.9077 => 0.8673, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: -4.43% (0.3025 => 0.2891, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: -4.43% (0.3026 => 0.2892, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: -4.42% (0.3255 => 0.3111, std.dev.: 0.0043) SingleSource/UnitTests/ObjC++/property-reference-object: -4.41% (0.6441 => 0.6157, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -4.40% (0.4248 => 0.4061, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.39% (0.6189 => 0.5917, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.38% (0.3837 => 0.3669, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.38% (0.3931 => 0.3759, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.35% (2.1713 => 2.0768, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: -4.34% (0.4861 => 0.4650, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.33% (0.5329 => 0.5098, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -4.33% (0.7982 => 0.7636, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -4.32% (0.3059 => 0.2927, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -4.30% (0.3394 => 0.3248, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -4.30% (34.0927 => 32.6264, std.dev.: 0.0211) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.26% (2.2587 => 2.1625, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.25% (0.6304 => 0.6036, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -4.24% (0.3446 => 0.3300, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.23% (0.3849 => 0.3686, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -4.22% (0.2989 => 0.2863, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.20% (0.9557 => 0.9156, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: -4.18% (0.2871 => 0.2751, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.17% (0.4321 => 0.4141, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -4.16% (0.3194 => 0.3061, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.16% (0.2933 => 0.2811, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.15% (0.3057 => 0.2930, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -4.12% (0.2939 => 0.2818, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -4.11% (0.3867 => 0.3708, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.10% (0.2903 => 0.2784, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: -4.07% (18.2933 => 17.5496, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ary2: -4.05% (0.3481 => 0.3340, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -4.02% (0.3205 => 0.3076, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.00% (0.2849 => 0.2735, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -3.92% (0.3621 => 0.3479, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.89% (0.4427 => 0.4255, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: -3.74% (5.0226 => 4.8348, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.72% (0.3491 => 0.3361, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: -3.64% (0.3788 => 0.3650, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.62% (0.4083 => 0.3935, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -3.59% (0.6750 => 0.6508, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: -3.57% (1.5610 => 1.5053, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.20% (5.4682 => 5.2934, std.dev.: 0.0046) SingleSource/UnitTests/Vector/constpool: -2.58% (20.7746 => 20.2377, std.dev.: 0.0261) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7521, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: -8.62% (1.2842 => 1.1735, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.67% (2.2633 => 2.1802, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.21% (1.0557 => 1.0218, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.66% (6.5735 => 6.4646, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.64% (1.3096 => 1.2881, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 12:50:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 14:50:48 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121117205048.8FA4A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5980?compare_to=5976&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5980, Order: 168260, Start Time: 2012-11-17 18:31:34, End Time: 2012-11-17 20:51:08 To: 5976, Order: 168259, Start Time: 2012-11-17 14:55:06, End Time: 2012-11-17 17:15:07 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 53 (164 on baseline) Performance Improvements: 7 (41 on baseline) Added Tests: 0 (136 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 980 (682 on baseline) Total Tests: 1044 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 18.04% (2.4886 => 2.9376, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/messages-2: 17.08% (0.0773 => 0.0905, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 16.87% (0.1411 => 0.1649, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 15.93% (6.1347 => 7.1122, std.dev.: 0.0196) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.39% (0.1716 => 0.1963, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.20% (1.0293 => 1.1755, std.dev.: 0.0232) SingleSource/Benchmarks/Shootout-C++/nestedloop: 14.10% (0.3007 => 0.3431, std.dev.: 0.0060) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.17% (0.1906 => 0.2157, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 13.10% (0.6237 => 0.7054, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/ackermann: 13.02% (0.2981 => 0.3369, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/objinst: 12.96% (0.3319 => 0.3749, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.84% (0.5100 => 0.5755, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/matrix: 12.84% (0.3365 => 0.3797, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/ary: 12.73% (0.3497 => 0.3942, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/heapsort: 12.67% (0.3102 => 0.3495, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/ary2: 12.52% (0.3674 => 0.4134, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary3: 11.76% (0.3563 => 0.3982, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/random: 11.49% (0.3020 => 0.3367, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.25% (0.2898 => 0.3224, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 11.16% (0.6210 => 0.6903, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/ReedSolomon: 10.65% (0.2207 => 0.2442, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/mst/mst: 10.45% (0.1349 => 0.1490, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 10.24% (0.4444 => 0.4899, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/for-in: 10.07% (0.4143 => 0.4560, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/power/power: 9.95% (0.1457 => 0.1602, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/property: 9.80% (0.4400 => 0.4831, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.18% (0.3988 => 0.4354, std.dev.: 0.0050) MultiSource/Applications/spiff/spiff: 9.15% (0.8947 => 0.9766, std.dev.: 0.0124) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.02% (0.1917 => 0.2090, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.70% (0.2415 => 0.2625, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: 8.41% (1.3360 => 1.4483, std.dev.: 0.0310) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.99% (0.8108 => 0.8675, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.73% (0.7174 => 0.7657, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.35% (1.5941 => 1.6954, std.dev.: 0.0222) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.29% (1.7967 => 1.9098, std.dev.: 0.0189) SingleSource/UnitTests/ObjC/synchronized: 6.20% (0.4113 => 0.4368, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.18% (4.7258 => 5.0177, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench: 28.24% (2.1053 => 2.6999, std.dev.: 0.0374) SingleSource/Benchmarks/CoyoteBench/lpbench: 19.34% (10.8226 => 12.9152, std.dev.: 0.1307) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 18.93% (1.3840 => 1.6460, std.dev.: 0.0627) SingleSource/Benchmarks/Shootout/heapsort: 13.83% (3.9354 => 4.4796, std.dev.: 0.0819) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.59% (4.0088 => 4.3933, std.dev.: 0.0859) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.73% (1.7400 => 1.8919, std.dev.: 0.0391) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 7.88% (5.2581 => 5.6725, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/puzzle: 7.02% (0.6947 => 0.7435, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/strcat: 5.63% (0.1935 => 0.2044, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/hash: 5.54% (5.0738 => 5.3550, std.dev.: 0.1054) MultiSource/Applications/lemon/lemon: 4.95% (1.4661 => 1.5386, std.dev.: 0.0204) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.51% (3.7335 => 3.8647, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/lists1: 3.21% (0.6169 => 0.6367, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.70% (4.2426 => 4.3571, std.dev.: 0.0112) MultiSource/Benchmarks/Olden/em3d/em3d: 2.25% (3.1134 => 3.1834, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.61% (5.3825 => 5.4690, std.dev.: 0.0093) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/18-imp/imp: -10.92% (0.4360 => 0.3884, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -8.16% (0.8512 => 0.7817, std.dev.: 0.0250) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.95% (1.0065 => 0.9365, std.dev.: 0.0228) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.07% (0.6063 => 0.5816, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -7.15% (1.6583 => 1.5397, std.dev.: 0.0236) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -3.87% (6.3840 => 6.1372, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/ffbench: -2.22% (1.0157 => 0.9932, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.96% (0.1352 => 0.1339, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -13.20% (0.0485 => 0.0421, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0652 => 0.0653, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: -0.02% (494.1653 => 494.0685, std.dev.: 0.1134) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0421, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/power/power: 43712.05% (1.1277 => 494.0685, std.dev.: 0.1134) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 195.22% (0.5229 => 1.5437, std.dev.: 0.0888) MultiSource/Applications/SPASS/SPASS: 23.10% (14.9895 => 18.4527, std.dev.: 0.0406) MultiSource/Applications/kimwitu++/kc: 51.79% (14.1553 => 21.4857, std.dev.: 0.1388) MultiSource/Benchmarks/MallocBench/gs/gs: 27.66% (4.1105 => 5.2475, std.dev.: 0.0714) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.94% (1.1048 => 1.5129, std.dev.: 0.0712) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 433.79% (7.1582 => 38.2095, std.dev.: 0.3034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 105.38% (3.4629 => 7.1122, std.dev.: 0.0196) SingleSource/Benchmarks/Misc-C++/stepanov_container: 88.93% (0.6222 => 1.1755, std.dev.: 0.0232) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10479.31% (0.0720 => 7.6171, std.dev.: 0.3217) MultiSource/Applications/SIBsim4/SIBsim4: 3863200.00% (0.0001 => 3.8633, std.dev.: 0.0308) MultiSource/Applications/SPASS/SPASS: 13837200.00% (0.0001 => 13.8373, std.dev.: 0.9357) MultiSource/Applications/kimwitu++/kc: 53400.00% (0.0001 => 0.0535, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 64700.00% (0.0001 => 0.0648, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576400.00% (0.0001 => 0.5765, std.dev.: 0.0262) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10078500.00% (0.0001 => 10.0786, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6287500.00% (0.0001 => 6.2876, std.dev.: 0.1986) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1802.75% (1.1194 => 21.2994, std.dev.: 0.1709) MultiSource/Applications/ClamAV/clamscan: 70.43% (22.1758 => 37.7951, std.dev.: 0.2181) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 58.69% (2.9384 => 4.6629, std.dev.: 0.3194) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.00% (7.0540 => 11.0041, std.dev.: 0.2145) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 52.96% (8.1363 => 12.4449, std.dev.: 0.0323) MultiSource/Applications/JM/lencod/lencod: 47.81% (21.9371 => 32.4251, std.dev.: 0.0991) SingleSource/Benchmarks/CoyoteBench/almabench: 45.34% (0.0730 => 0.1061, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/distray/distray: 45.27% (0.1056 => 0.1534, std.dev.: 0.0084) SingleSource/UnitTests/vla: 43.66% (0.0355 => 0.0510, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 38.27% (0.1432 => 0.1980, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones/fhourstones: 37.74% (0.1566 => 0.2157, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/messages-2: 36.71% (0.0662 => 0.0905, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 35.92% (0.0746 => 0.1014, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 33.41% (0.1236 => 0.1649, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 33.38% (2.2024 => 2.9376, std.dev.: 0.0061) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 31.94% (0.1584 => 0.2090, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/lists: 30.51% (0.0626 => 0.0817, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/ks/ks: 30.00% (0.1510 => 0.1963, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.96% (0.6675 => 0.8675, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 28.92% (3.8922 => 5.0177, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/mst/mst: 28.12% (0.1163 => 0.1490, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 28.11% (0.2700 => 0.3459, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/bigfib: 27.18% (0.6456 => 0.8211, std.dev.: 0.0108) MultiSource/Applications/lemon/lemon: 26.69% (1.0722 => 1.3584, std.dev.: 0.0295) MultiSource/Benchmarks/BitBench/five11/five11: 25.75% (0.0567 => 0.0713, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/fldry: 25.36% (0.0481 => 0.0603, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 25.28% (0.3865 => 0.4842, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 25.24% (0.9765 => 1.2230, std.dev.: 0.0144) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.16% (0.0457 => 0.0572, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 24.75% (0.3927 => 0.4899, std.dev.: 0.0077) MultiSource/Applications/spiff/spiff: 24.65% (0.7835 => 0.9766, std.dev.: 0.0124) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.61% (0.3121 => 0.3889, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 24.58% (0.2107 => 0.2625, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: 24.40% (1.1642 => 1.4483, std.dev.: 0.0310) SingleSource/UnitTests/ObjC/property: 24.32% (0.3886 => 0.4831, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/lists: 24.28% (0.3422 => 0.4253, std.dev.: 0.0144) SingleSource/Benchmarks/CoyoteBench/fftbench: 24.14% (0.4636 => 0.5755, std.dev.: 0.0068) SingleSource/Benchmarks/Stanford/Oscar: 23.90% (0.0636 => 0.0788, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 23.86% (0.2603 => 0.3224, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 23.59% (0.3603 => 0.4453, std.dev.: 0.0114) SingleSource/UnitTests/ObjC/for-in: 23.44% (0.3694 => 0.4560, std.dev.: 0.0107) SingleSource/UnitTests/ObjC/instance-method-metadata: 22.89% (0.3543 => 0.4354, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/nestedloop: 22.84% (0.2793 => 0.3431, std.dev.: 0.0060) MultiSource/Applications/oggenc/oggenc: 22.78% (5.7591 => 7.0710, std.dev.: 0.1447) MultiSource/Benchmarks/McCat/08-main/main: 22.67% (0.2554 => 0.3133, std.dev.: 0.0186) SingleSource/UnitTests/ObjC/synchronized: 22.66% (0.3561 => 0.4368, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 22.63% (0.2877 => 0.3528, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 22.56% (0.3098 => 0.3797, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/ary2: 22.34% (0.3379 => 0.4134, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ackermann: 22.24% (0.2756 => 0.3369, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 22.09% (14.3668 => 17.5404, std.dev.: 0.0380) SingleSource/Benchmarks/Shootout-C++/ary: 21.97% (0.3232 => 0.3942, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/heapsort: 21.69% (0.2872 => 0.3495, std.dev.: 0.0085) MultiSource/Applications/viterbi/viterbi: 21.61% (0.1555 => 0.1891, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/neural/neural: 21.33% (0.1463 => 0.1775, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 21.29% (0.3283 => 0.3982, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/tsp/tsp: 20.85% (0.1175 => 0.1420, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/trivial-interface: 20.85% (0.3473 => 0.4197, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.43% (1.3050 => 1.5716, std.dev.: 0.0334) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 20.42% (1.5859 => 1.9098, std.dev.: 0.0189) SingleSource/Benchmarks/Shootout-C++/random: 20.16% (0.2802 => 0.3367, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 19.74% (0.3131 => 0.3749, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.20% (0.2271 => 0.2707, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/ReedSolomon: 19.18% (0.2049 => 0.2442, std.dev.: 0.0032) MultiSource/Applications/lua/lua: 19.17% (3.8723 => 4.6148, std.dev.: 0.1813) MultiSource/Applications/siod/siod: 18.99% (2.2969 => 2.7331, std.dev.: 0.1269) SingleSource/Benchmarks/Shootout-C++/except: 18.81% (0.2871 => 0.3411, std.dev.: 0.0069) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.76% (0.1125 => 0.1336, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.71% (0.6450 => 0.7657, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/hello: 18.64% (0.2714 => 0.3220, std.dev.: 0.0104) MultiSource/Applications/sqlite3/sqlite3: 18.15% (17.1811 => 20.2994, std.dev.: 0.0414) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.81% (0.0842 => 0.0992, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.57% (0.0871 => 0.1024, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/oourafft: 17.40% (0.3282 => 0.3853, std.dev.: 0.0105) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.10% (4.2646 => 4.9939, std.dev.: 0.0596) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.70% (0.8172 => 0.9537, std.dev.: 0.0446) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 16.67% (0.0672 => 0.0784, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 16.41% (9.4845 => 11.0405, std.dev.: 0.2094) SingleSource/Benchmarks/Shootout/matrix: 16.26% (0.0818 => 0.0951, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.16% (0.0953 => 0.1107, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.05% (0.0648 => 0.0752, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.03% (0.0886 => 0.1028, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/fibo: 15.96% (0.2725 => 0.3160, std.dev.: 0.0142) MultiSource/Benchmarks/Olden/health/health: 15.93% (0.1268 => 0.1470, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.88% (0.2065 => 0.2393, std.dev.: 0.0122) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.71% (0.0834 => 0.0965, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.60% (0.8101 => 0.9365, std.dev.: 0.0228) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.49% (0.1117 => 0.1290, std.dev.: 0.0060) MultiSource/Applications/minisat/minisat: 15.29% (0.7115 => 0.8203, std.dev.: 0.0397) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.27% (2.2022 => 2.5385, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.19% (0.0770 => 0.0887, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: 15.11% (10.3673 => 11.9343, std.dev.: 0.2511) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.06% (0.0770 => 0.0886, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.82% (4.9449 => 5.6777, std.dev.: 0.2083) SingleSource/UnitTests/ObjC++/Hello: 14.82% (0.5925 => 0.6803, std.dev.: 0.0231) SingleSource/UnitTests/ObjC++/property-reference-object: 14.74% (0.6030 => 0.6919, std.dev.: 0.0134) MultiSource/Applications/sgefa/sgefa: 14.51% (0.3109 => 0.3560, std.dev.: 0.0164) MultiSource/Benchmarks/Bullet/bullet: 14.50% (63.2438 => 72.4156, std.dev.: 0.2412) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.24% (5.0018 => 5.7141, std.dev.: 0.2092) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.18% (0.5981 => 0.6829, std.dev.: 0.0232) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.17% (0.5569 => 0.6358, std.dev.: 0.0291) SingleSource/Benchmarks/McGill/chomp: 14.08% (0.1655 => 0.1888, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.93% (0.5105 => 0.5816, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.84% (0.1337 => 0.1522, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.82% (0.3307 => 0.3764, std.dev.: 0.0130) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.74% (0.1143 => 0.1300, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/18-imp/imp: 13.47% (0.3423 => 0.3884, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.46% (0.3441 => 0.3904, std.dev.: 0.0112) SingleSource/UnitTests/ObjC/exceptions-3: 13.28% (0.3516 => 0.3983, std.dev.: 0.0177) SingleSource/UnitTests/ObjC/exceptions-4: 13.21% (0.3543 => 0.4011, std.dev.: 0.0154) MultiSource/Benchmarks/McCat/09-vor/vor: 12.52% (0.3180 => 0.3578, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/05-eks/eks: 12.12% (0.4299 => 0.4820, std.dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.07% (0.5020 => 0.5626, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.98% (0.1695 => 0.1898, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 11.25% (0.1440 => 0.1602, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: 11.09% (1.5603 => 1.7334, std.dev.: 0.0641) SingleSource/Benchmarks/Shootout-C++/hash: 10.98% (0.4289 => 0.4760, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 10.49% (0.1268 => 0.1401, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 10.19% (0.3387 => 0.3732, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.23% (0.4064 => 0.4439, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 8.39% (0.3052 => 0.3308, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.97% (4.3953 => 11.0309, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/methcall: 147.69% (5.3999 => 13.3752, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 32.61% (2.0360 => 2.6999, std.dev.: 0.0374) SingleSource/Benchmarks/Shootout-C++/ary3: 28.74% (3.7221 => 4.7918, std.dev.: 0.1921) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 26.18% (1.3045 => 1.6460, std.dev.: 0.0627) SingleSource/Benchmarks/CoyoteBench/lpbench: 24.83% (10.3460 => 12.9152, std.dev.: 0.1307) SingleSource/Benchmarks/Misc/oourafft: 17.73% (6.6465 => 7.8249, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.67% (1.1145 => 1.3003, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/heapsort: 16.27% (3.8526 => 4.4796, std.dev.: 0.0819) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.02% (3.8532 => 4.3933, std.dev.: 0.0859) SingleSource/Benchmarks/Shootout-C++/ary: 13.76% (0.0756 => 0.0860, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.87% (0.2944 => 0.3323, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 11.80% (3.1578 => 3.5305, std.dev.: 0.0664) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.77% (2.8904 => 3.2306, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 10.33% (1.1396 => 1.2573, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.44% (1.7254 => 1.8883, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: 9.09% (4.9088 => 5.3550, std.dev.: 0.1054) SingleSource/Benchmarks/Shootout/strcat: 7.64% (0.1899 => 0.2044, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/puzzle: 6.79% (0.6962 => 0.7435, std.dev.: 0.0067) MultiSource/Applications/lemon/lemon: 6.40% (1.4460 => 1.5386, std.dev.: 0.0204) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.19% (3.6395 => 3.8647, std.dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.46% (4.2280 => 4.4588, std.dev.: 0.0047) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 4.49% (0.9505 => 0.9932, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 4.09% (11.6436 => 12.1203, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.50% (1.7133 => 1.7732, std.dev.: 0.0137) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.32% (0.4162 => 0.4300, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.18% (0.6171 => 0.6367, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/dry: 2.89% (2.4116 => 2.4812, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/em3d/em3d: 2.61% (3.1023 => 3.1834, std.dev.: 0.0137) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.16% (1.3677 => 1.3973, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 2.11% (85.0658 => 86.8639, std.dev.: 0.1033) MultiSource/Applications/aha/aha: 2.05% (3.1595 => 3.2244, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.94% (2.1424 => 2.1840, std.dev.: 0.0122) SingleSource/Benchmarks/Dhrystone/fldry: 1.71% (1.9577 => 1.9912, std.dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (27.8444 => 28.2713, std.dev.: 0.0297) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.38% (6.5088 => 6.5986, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/sieve: 1.33% (5.2139 => 5.2834, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0500, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1679, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.80% (5.2763 => 1.2239, std.dev.: 0.0648) SingleSource/Benchmarks/Misc/salsa20: -74.35% (0.8651 => 0.2219, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: -44.70% (0.1622 => 0.0897, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.77% (5.3855 => 4.6977, std.dev.: 0.1906) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.70% (5.3526 => 4.7266, std.dev.: 0.1507) MultiSource/Applications/JM/ldecod/ldecod: -9.91% (10.4361 => 9.4018, std.dev.: 0.2300) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.72% (1.7609 => 1.6954, std.dev.: 0.0222) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.98% (0.3987 => 0.2393, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.92% (0.0506 => 0.0304, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.30% (4.5009 => 2.7770, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -27.11% (10.7105 => 7.8069, std.dev.: 0.6002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.13% (2.6546 => 2.0140, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: -19.44% (0.2161 => 0.1741, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -15.93% (1.6925 => 1.4229, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2838, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.79% (32.5116 => 29.0033, std.dev.: 0.0307) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -10.51% (9.5636 => 8.5583, std.dev.: 0.2459) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4244, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.94% (4.8142 => 4.4802, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.54% (2.7294 => 2.5782, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.14% (3.2416 => 3.0750, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-5: -4.95% (1.5835 => 1.5051, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.25% (1.6805 => 1.6090, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout/lists: -4.22% (6.2999 => 6.0339, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.42% (0.9957 => 0.9616, std.dev.: 0.0103) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8920, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.98% (19.9488 => 19.3539, std.dev.: 0.2172) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.31% (0.4808 => 0.4697, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.71% (8.1563 => 8.0168, std.dev.: 0.0160) SingleSource/Benchmarks/Misc/salsa20: -1.48% (10.2830 => 10.1303, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.14% (0.2116 => 0.0653, std.dev.: 0.0021) Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 13:19:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 15:19:49 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121117211949.E70692A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5981?compare_to=5978&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5981, Order: 168268, Start Time: 2012-11-17 19:47:31, End Time: 2012-11-17 21:20:12 To: 5978, Order: 168260, Start Time: 2012-11-17 17:56:49, End Time: 2012-11-17 19:29:30 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 4 (48 on baseline) Performance Improvements: 3 (19 on baseline) Added Tests: 48 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 999 (907 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 5.10% (3.0547 => 3.2105, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/except: 3.40% (0.4858 => 0.5023, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 1.15% (16.7224 => 16.9154, std.dev.: 0.0321) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.04% (3.9139 => 3.9547, std.dev.: 0.0113) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Olden/bh/bh: -4.73% (0.3132 => 0.2984, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/08-main/main: -3.84% (0.2737 => 0.2632, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash: -1.67% (0.6354 => 0.6248, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.82% (1.0693 => 1.0605, std.dev.: 0.3611) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.81% (0.0221 => 0.0217, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0428 => 0.0430, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.71% (0.0333 => 0.0284, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -9.90% (0.0313 => 0.0282, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.71% (0.0424 => 0.0427, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -27.94% (0.0204 => 0.0147, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/test1: -7.80% (0.0218 => 0.0201, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.93% (0.1499 => 0.1485, std.dev.: 0.0203) MultiSource/Applications/lemon/lemon: -2.61% (1.1996 => 1.1683, std.dev.: 0.3068) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.49% (0.4100 => 0.4161, std.dev.: 0.0247) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.72% (0.1390 => 0.1400, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0637 => 0.0637, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -8.81% (0.0261 => 0.0238, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.23% (0.0568 => 0.0575, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.03% (1.1938 => 1.1935, std.dev.: 0.0206) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -64.52% (0.0031 => 0.0011, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -87.50% (0.0008 => 0.0001, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.71% (0.0643 => 0.0654, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -15.41% (0.0266 => 0.0225, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.56% (0.7849 => 0.7805, std.dev.: 0.0044) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/SignlessTypes/Large/cast: 11.54% (0.0052 => 0.0058, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 6.77% (16.4461 => 17.5589, std.dev.: 0.3280) MultiSource/Applications/sqlite3/sqlite3: 2322.49% (0.6332 => 15.3392, std.dev.: 0.6886) MultiSource/Benchmarks/McCat/08-main/main: 43.75% (0.1831 => 0.2632, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.49% (0.1559 => 0.1489, std.dev.: 0.0095) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7192.64% (0.3123 => 22.7749, std.dev.: 1.0343) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.99% (0.2463 => 0.3719, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1523.03% (0.3344 => 5.4274, std.dev.: 0.0738) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.19% (0.2364 => 0.3196, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: 4.94% (0.6010 => 0.6307, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: 3.96% (0.0429 => 0.0446, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.08% (0.3266 => 0.3432, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 3.56% (0.1969 => 0.2039, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.45% (0.0224 => 0.0225, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0438, std.dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: 7.52% (0.1462 => 0.1572, std.dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4732, std.dev.: 0.0645) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0720, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4960, std.dev.: 0.1030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5284, std.dev.: 0.0278) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5543, std.dev.: 0.0747) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3155, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1314, std.dev.: 0.0153) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3629, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4001, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0878, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: -23.67% (2.1832 => 1.6665, std.dev.: 0.0027) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.95% (0.0810 => 0.0923, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.94% (0.2180 => 0.2375, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.07% (0.6010 => 0.6435, std.dev.: 0.0160) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.67% (0.2240 => 0.2367, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.90% (0.8359 => 0.8685, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.85% (0.4127 => 0.4286, std.dev.: 0.0044) MultiSource/Applications/hbd/hbd: 3.78% (1.4269 => 1.4809, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.78% (0.7966 => 0.8267, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 3.22% (0.6834 => 0.7054, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.18% (0.4559 => 0.4704, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.17% (2.1401 => 2.2079, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.93% (0.3717 => 0.3826, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.85% (0.8805 => 0.9056, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/football/football: 2.81% (0.8768 => 0.9014, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.61% (1.5315 => 1.5715, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.58% (0.8340 => 0.8555, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.50% (0.5191 => 0.5321, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 2.43% (0.4397 => 0.4504, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.39% (3.1832 => 3.2593, std.dev.: 0.0194) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.19% (0.6586 => 0.6730, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 50.03% (1.5795 => 2.3698, std.dev.: 0.0672) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.35% (2.9753 => 3.4619, std.dev.: 0.0391) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.82% (0.7597 => 0.8799, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.49% (2.7995 => 3.2051, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6089, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.05% (1.1857 => 1.2811, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 7.47% (1.7056 => 1.8330, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/richards_benchmark: 6.56% (1.3037 => 1.3892, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.12% (4.9686 => 5.2725, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.21% (3.0515 => 3.2105, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.72% (6.2275 => 6.5214, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.43% (3.3761 => 3.5257, std.dev.: 0.0074) MultiSource/Applications/lambda-0_1_3/lambda: 4.25% (7.4933 => 7.8118, std.dev.: 0.0418) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.98% (4.9469 => 5.1437, std.dev.: 0.0237) MultiSource/Applications/hexxagon/hexxagon: 3.94% (14.0064 => 14.5579, std.dev.: 0.0575) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.68% (1.2337 => 1.2791, std.dev.: 0.0022) MultiSource/Applications/siod/siod: 3.35% (3.6643 => 3.7870, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.52% (11.5690 => 11.8600, std.dev.: 0.0418) SingleSource/Benchmarks/Shootout/lists: 2.49% (7.3375 => 7.5201, std.dev.: 0.0090) MultiSource/Benchmarks/BitBench/five11/five11: 2.32% (5.6030 => 5.7331, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.13% (4.8362 => 4.9393, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/except: 2.07% (0.4921 => 0.5023, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.05% (8.2783 => 8.4482, std.dev.: 0.0332) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.39% (3.9006 => 3.9547, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/ReedSolomon: 1.33% (8.5322 => 8.6454, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.22% (3.5679 => 3.6116, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: 1.10% (1.0841 => 1.0960, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: 1.04% (1.2061 => 1.2187, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.91% (5.4641 => 4.3218, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.46% (7.2130 => 6.1700, std.dev.: 0.1151) SingleSource/Benchmarks/McGill/chomp: -10.79% (1.1216 => 1.0006, std.dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.67% (1.0512 => 0.9390, std.dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.77% (14.6451 => 13.3607, std.dev.: 0.2487) MultiSource/Benchmarks/mafft/pairlocalalign: -8.29% (63.1822 => 57.9427, std.dev.: 0.1601) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.89% (4.7482 => 4.4210, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.79% (3.7148 => 3.4996, std.dev.: 0.0766) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.78% (5.4972 => 5.1793, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.07% (5.1557 => 4.8944, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.38% (4.7449 => 4.5373, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.63% (6.0224 => 5.8036, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.43% (0.5807 => 0.5608, std.dev.: 0.0015) MultiSource/Applications/lua/lua: -3.29% (29.8330 => 28.8502, std.dev.: 0.3198) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (28.5821 => 27.6993, std.dev.: 0.0264) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.47% (2.4490 => 2.3885, std.dev.: 0.0196) MultiSource/Applications/aha/aha: -2.42% (3.3398 => 3.2591, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash2: -2.20% (3.4237 => 3.3483, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.05% (11.5316 => 11.2957, std.dev.: 0.0440) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.34% (1.0262 => 1.0605, std.dev.: 0.3611) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.39% (0.0408 => 0.0430, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 11.81% (0.0254 => 0.0284, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -6.62% (0.0302 => 0.0282, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.20% (0.0384 => 0.0427, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -22.63% (0.0190 => 0.0147, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/test1: 11.67% (0.0180 => 0.0201, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 3.27% (0.1438 => 0.1485, std.dev.: 0.0203) MultiSource/Applications/lemon/lemon: 3.12% (1.1329 => 1.1683, std.dev.: 0.3068) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.07% (0.4164 => 0.4161, std.dev.: 0.0247) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.26% (0.1369 => 0.1400, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.62% (0.0641 => 0.0637, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.05% (0.0195 => 0.0238, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.52% (0.0578 => 0.0575, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.35% (1.1437 => 1.1935, std.dev.: 0.0206) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1000.00% (0.0001 => 0.0011, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.31% (0.0627 => 0.0654, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.00% (0.0180 => 0.0225, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.64% (0.8017 => 0.7805, std.dev.: 0.0044) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/SignlessTypes/Large/cast: -6.45% (0.0062 => 0.0058, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 13:28:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 15:28:24 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121117212824.D86832A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5982?compare_to=5979&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5982, Order: 168268, Start Time: 2012-11-17 19:56:01, End Time: 2012-11-17 21:28:46 To: 5979, Order: 168260, Start Time: 2012-11-17 18:00:36, End Time: 2012-11-17 19:33:04 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== New Failures: 48 (48 on baseline) Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (181 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1043 (856 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 New Failures - Execution Time ----------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.07% (55.2375 => 56.3804, std.dev.: 0.1180) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 New Failures - Execution Time ----------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.31% (54.5751 => 56.3804, std.dev.: 0.1180) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.72% (2.0478 => 2.1036, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: 2.53% (7.4937 => 7.6831, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/hash2: 2.15% (3.1932 => 3.2618, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.30% (0.3821 => 0.3504, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -6.95% (2.4924 => 2.3192, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.58% (0.3357 => 0.3136, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.56% (0.9542 => 0.8916, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.45% (0.7198 => 0.6734, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -6.39% (0.2160 => 0.2022, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.25% (9.2283 => 8.6511, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.22% (0.2428 => 0.2277, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.18% (0.1796 => 0.1685, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.12% (0.9852 => 0.9249, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.07% (0.2355 => 0.2212, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -6.06% (16.1920 => 15.2104, std.dev.: 0.0094) MultiSource/Applications/JM/ldecod/ldecod: -5.98% (7.0961 => 6.6717, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.91% (0.6484 => 0.6101, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.88% (1.3722 => 1.2915, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -5.80% (0.3812 => 0.3591, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -5.80% (0.9179 => 0.8647, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.79% (1.0544 => 0.9934, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.75% (4.0323 => 3.8004, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.70% (0.6681 => 0.6300, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.70% (4.8161 => 4.5418, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions-4: -5.67% (0.3880 => 0.3660, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -5.66% (0.3831 => 0.3614, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.66% (1.6364 => 1.5438, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.65% (0.5805 => 0.5477, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -5.65% (0.3896 => 0.3676, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.64% (0.3884 => 0.3665, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/exceptions-3: -5.61% (0.3848 => 0.3632, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.61% (0.5863 => 0.5534, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.61% (1.2300 => 1.1610, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.61% (0.3406 => 0.3215, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.61% (6.7716 => 6.3920, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.60% (0.3658 => 0.3453, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.60% (4.8802 => 4.6068, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.60% (4.5069 => 4.2545, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.60% (0.5859 => 0.5531, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.59% (3.5339 => 3.3365, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.59% (0.6660 => 0.6288, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.58% (1.4642 => 1.3825, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/for-in: -5.58% (0.4033 => 0.3808, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.57% (0.2695 => 0.2545, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.56% (0.4176 => 0.3944, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -5.55% (1.1450 => 1.0815, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.53% (0.5591 => 0.5282, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.52% (0.6736 => 0.6364, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.52% (0.6230 => 0.5886, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.49% (1.2784 => 1.2082, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: -5.49% (1.1530 => 1.0897, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.48% (0.5857 => 0.5536, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: -5.48% (4.3330 => 4.0957, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.48% (0.5478 => 0.5178, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: -5.47% (0.4515 => 0.4268, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.47% (0.6052 => 0.5721, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.46% (0.5802 => 0.5485, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.45% (0.5705 => 0.5394, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.44% (0.6395 => 0.6047, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.42% (0.3891 => 0.3680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.40% (0.5925 => 0.5605, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -5.39% (1.2515 => 1.1841, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -5.36% (0.4199 => 0.3974, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.35% (0.6676 => 0.6319, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.34% (14.2083 => 13.4494, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.34% (0.6293 => 0.5957, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.33% (0.7524 => 0.7123, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.33% (0.7919 => 0.7497, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.33% (0.5575 => 0.5278, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.32% (0.5849 => 0.5538, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.31% (0.7339 => 0.6949, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: -5.31% (1.3864 => 1.3128, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.30% (0.6260 => 0.5928, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.27% (0.5688 => 0.5388, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.27% (0.5581 => 0.5287, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.27% (0.2278 => 0.2158, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.26% (0.2985 => 0.2828, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.26% (17.1032 => 16.2039, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.25% (0.6395 => 0.6059, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: -5.25% (0.3581 => 0.3393, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.24% (0.5456 => 0.5170, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.23% (0.5999 => 0.5685, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.22% (0.5570 => 0.5279, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.22% (8.0126 => 7.5943, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.22% (0.5941 => 0.5631, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.21% (0.6446 => 0.6110, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.21% (0.5569 => 0.5279, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.20% (1.2221 => 1.1586, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.17% (0.3483 => 0.3303, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.16% (0.6667 => 0.6323, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.15% (0.4916 => 0.4663, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.14% (0.2548 => 0.2417, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.14% (0.2999 => 0.2845, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.13% (0.8521 => 0.8084, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -5.13% (1.3148 => 1.2474, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.12% (0.5567 => 0.5282, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.11% (0.4151 => 0.3939, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.09% (1.2210 => 1.1589, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.08% (0.6440 => 0.6113, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/08-main/main: -5.04% (0.2659 => 0.2525, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: -5.04% (0.3255 => 0.3091, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/BoolLiteralTest: -5.01% (0.3834 => 0.3642, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.01% (0.3016 => 0.2865, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.01% (0.6033 => 0.5731, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.00% (0.3319 => 0.3153, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.99% (0.2385 => 0.2266, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -4.98% (0.4280 => 0.4067, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.97% (0.5168 => 0.4911, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -4.94% (0.7779 => 0.7395, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.92% (0.4813 => 0.4576, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: -4.92% (3.5154 => 3.3423, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.88% (0.3323 => 0.3161, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -4.87% (15.5079 => 14.7529, std.dev.: 0.0207) SingleSource/Benchmarks/Shootout-C++/objinst: -4.85% (0.3194 => 0.3039, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -4.85% (15.2527 => 14.5135, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/methcall: -4.83% (0.3025 => 0.2879, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -4.82% (0.3026 => 0.2880, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.81% (1.6474 => 1.5682, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -4.81% (0.7447 => 0.7089, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -4.80% (4.0594 => 3.8645, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: -4.78% (0.2989 => 0.2846, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.78% (2.1713 => 2.0675, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.73% (0.3849 => 0.3667, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.71% (0.3057 => 0.2913, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.71% (0.3931 => 0.3746, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.70% (0.3252 => 0.3099, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.69% (0.3837 => 0.3657, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.68% (0.6304 => 0.6009, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: -4.67% (0.3059 => 0.2916, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.67% (0.5329 => 0.5080, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: -4.67% (0.3446 => 0.3285, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: -4.67% (0.2871 => 0.2737, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -4.66% (0.4248 => 0.4050, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.66% (0.7021 => 0.6694, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -4.66% (0.3394 => 0.3236, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.65% (0.6297 => 0.6004, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.65% (0.6194 => 0.5906, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: -4.65% (0.4861 => 0.4635, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.64% (0.2933 => 0.2797, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.62% (0.2903 => 0.2769, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.60% (0.6347 => 0.6055, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -4.59% (0.2939 => 0.2804, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.57% (22.4056 => 21.3827, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: -4.55% (0.6441 => 0.6148, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.54% (0.6189 => 0.5908, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/hello: -4.53% (0.2849 => 0.2720, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -4.47% (2.4021 => 2.2947, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.47% (0.9557 => 0.9130, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -4.46% (0.3271 => 0.3125, std.dev.: 0.0022) MultiSource/Applications/treecc/treecc: -4.46% (2.1401 => 2.0447, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/ary2: -4.45% (0.3481 => 0.3326, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.44% (0.4321 => 0.4129, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -4.43% (34.0927 => 32.5812, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/wc: -4.43% (0.3205 => 0.3063, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.42% (0.8418 => 0.8046, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: -4.36% (0.3621 => 0.3463, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -4.36% (0.7982 => 0.7634, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -4.34% (0.3867 => 0.3699, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.34% (2.2587 => 2.1606, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.29% (0.4427 => 0.4237, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.22% (0.9077 => 0.8694, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.21% (0.4083 => 0.3911, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: -4.16% (18.2933 => 17.5325, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash: -4.13% (0.4524 => 0.4337, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: -4.02% (5.0226 => 4.8209, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/sieve: -4.01% (0.3788 => 0.3636, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/bigfib: -4.00% (0.6750 => 0.6480, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.84% (0.3491 => 0.3357, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.61% (1.5610 => 1.5046, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.38% (5.4682 => 5.2834, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -2.37% (20.7746 => 20.2817, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7579, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1729, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.91% (2.2633 => 2.1747, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4715, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.48% (1.3096 => 1.2902, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 15:11:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 17:11:41 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121117231141.1B5D82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5983?compare_to=5981&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5983, Order: 168271, Start Time: 2012-11-17 21:38:26, End Time: 2012-11-17 23:12:03 To: 5981, Order: 168268, Start Time: 2012-11-17 19:47:31, End Time: 2012-11-17 21:20:12 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 5 (52 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1049 (900 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.13% (0.8785 => 0.9148, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.83% (1.2055 => 1.2396, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 5.14% (2.3698 => 2.4915, std.dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/lpbench: 2.95% (3.9547 => 4.0712, std.dev.: 0.0413) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.97% (1.2413 => 1.2657, std.dev.: 0.0043) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.76% (1.0605 => 1.0792, std.dev.: 0.0593) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.76% (0.0217 => 0.0223, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.47% (0.0430 => 0.0428, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 17.25% (0.0284 => 0.0333, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 12.06% (0.0282 => 0.0316, std.dev.: 0.0066) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -9.37% (0.0427 => 0.0387, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/casts: 38.10% (0.0147 => 0.0203, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/test1: -6.97% (0.0201 => 0.0187, std.dev.: 0.0038) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.54% (0.1485 => 0.1493, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 0.59% (1.1683 => 1.1752, std.dev.: 0.3859) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.56% (0.4161 => 0.4096, std.dev.: 0.0845) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.14% (0.1400 => 0.1402, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.78% (0.0637 => 0.0642, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.87% (0.0238 => 0.0205, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.09% (0.0575 => 0.0610, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.36% (1.1935 => 1.1978, std.dev.: 0.1215) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 118.18% (0.0011 => 0.0024, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 900.00% (0.0001 => 0.0010, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.61% (0.0654 => 0.0650, std.dev.: 0.0150) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.22% (0.0225 => 0.0266, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.92% (0.7805 => 0.7877, std.dev.: 0.0250) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/SignlessTypes/Large/cast: 22.41% (0.0058 => 0.0071, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 6.93% (16.4461 => 17.5865, std.dev.: 1.3116) MultiSource/Applications/sqlite3/sqlite3: 2354.90% (0.6332 => 15.5444, std.dev.: 0.3025) MultiSource/Benchmarks/McCat/08-main/main: 47.35% (0.1831 => 0.2698, std.dev.: 0.0773) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.99% (0.1559 => 0.1450, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7034.65% (0.3123 => 22.2815, std.dev.: 0.6745) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.87% (0.2463 => 0.3716, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1532.42% (0.3344 => 5.4588, std.dev.: 0.2964) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.35% (0.2364 => 0.3247, std.dev.: 0.0207) SingleSource/Benchmarks/Misc-C++/bigfib: 4.73% (0.6010 => 0.6294, std.dev.: 0.0529) SingleSource/Benchmarks/Misc/mandel: 4.66% (0.0429 => 0.0449, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.09% (0.3266 => 0.3465, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 3.81% (0.1969 => 0.2044, std.dev.: 0.0025) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.70% (0.0224 => 0.0239, std.dev.: 0.0013) SingleSource/UnitTests/byval-alignment: -25.22% (0.0230 => 0.0172, std.dev.: 0.0041) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0528, std.dev.: 0.0070) MultiSource/Applications/oggenc/oggenc: 11.97% (0.1462 => 0.1637, std.dev.: 0.0212) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4533, std.dev.: 0.0985) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0682, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4942, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5143, std.dev.: 0.0162) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5552, std.dev.: 0.2287) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3212, std.dev.: 0.0546) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1421, std.dev.: 0.0244) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3629, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4011, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0885, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: -23.70% (2.1832 => 1.6657, std.dev.: 0.0101) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.94% (0.8321 => 0.9148, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.13% (0.2180 => 0.2379, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.64% (0.1157 => 0.1257, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.45% (0.1905 => 0.2066, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.21% (0.1425 => 0.1542, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.20% (0.7473 => 0.8086, std.dev.: 0.0185) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.65% (0.8148 => 0.8771, std.dev.: 0.0187) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.23% (0.1466 => 0.1572, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.08% (1.1685 => 1.2396, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: 4.93% (1.2222 => 1.2824, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/ary: 4.69% (0.2390 => 0.2502, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 4.68% (0.2755 => 0.2884, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/gs/gs: 4.48% (4.1305 => 4.3157, std.dev.: 0.0509) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.02% (1.2526 => 1.3029, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.53% (1.6386 => 1.6965, std.dev.: 0.0151) MultiSource/Benchmarks/nbench/nbench: 3.52% (1.1271 => 1.1668, std.dev.: 0.0143) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.21% (0.6227 => 0.6427, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.21% (0.3115 => 0.3215, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.19% (0.8066 => 0.8323, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.60% (0.6586 => 0.6757, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.35% (0.7966 => 0.8153, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 97.99% (0.0199 => 0.0394, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/pi: 57.74% (1.5795 => 2.4915, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.74% (0.7597 => 0.8869, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.06% (2.9753 => 3.4530, std.dev.: 0.1252) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.41% (2.7995 => 3.2029, std.dev.: 0.0516) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6086, std.dev.: 0.0287) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.00% (1.1857 => 1.2806, std.dev.: 0.0111) SingleSource/Benchmarks/McGill/queens: 7.52% (1.7056 => 1.8338, std.dev.: 0.0412) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.76% (4.7794 => 5.1024, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.40% (0.3186 => 0.3390, std.dev.: 0.0058) MultiSource/Applications/SIBsim4/SIBsim4: 6.03% (3.1873 => 3.3794, std.dev.: 0.0594) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.91% (4.9686 => 5.2620, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.69% (3.3761 => 3.5344, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.43% (6.2275 => 6.5033, std.dev.: 0.0109) SingleSource/Benchmarks/CoyoteBench/lpbench: 4.37% (3.9006 => 4.0712, std.dev.: 0.0413) MultiSource/Applications/lambda-0_1_3/lambda: 4.36% (7.4933 => 7.8197, std.dev.: 0.0611) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.21% (4.9453 => 5.1535, std.dev.: 0.0406) MultiSource/Applications/hexxagon/hexxagon: 4.00% (14.0064 => 14.5671, std.dev.: 0.0729) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.98% (4.9469 => 5.1436, std.dev.: 0.0326) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.90% (8.2783 => 8.5183, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.84% (11.5690 => 11.8971, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/lists: 2.47% (7.3375 => 7.5184, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.27% (4.8660 => 4.9766, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.26% (4.8362 => 4.9456, std.dev.: 0.0217) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.12% (1.1365 => 1.1606, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.47% (1.2474 => 1.2657, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ReedSolomon: 1.41% (8.5322 => 8.6529, std.dev.: 0.0094) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.33% (2.4647 => 2.4975, std.dev.: 0.0093) MultiSource/Benchmarks/llubenchmark/llu: 1.31% (1.9967 => 2.0228, std.dev.: 0.0087) MultiSource/Benchmarks/FreeBench/neural/neural: 1.26% (1.0841 => 1.0978, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.22% (3.5679 => 3.6114, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.19% (5.4641 => 4.3060, std.dev.: 0.0324) SingleSource/Benchmarks/McGill/chomp: -10.70% (1.1216 => 1.0016, std.dev.: 0.0352) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.69% (1.0512 => 0.9388, std.dev.: 0.0302) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -9.92% (7.2130 => 6.4977, std.dev.: 0.1645) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.86% (14.6451 => 13.2016, std.dev.: 0.2736) MultiSource/Benchmarks/mafft/pairlocalalign: -8.49% (63.1822 => 57.8174, std.dev.: 0.0898) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -7.08% (4.7482 => 4.4118, std.dev.: 0.0232) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.55% (0.3269 => 0.3055, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.98% (3.7148 => 3.4927, std.dev.: 0.0277) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.80% (5.4972 => 5.1786, std.dev.: 0.0591) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.06% (5.1557 => 4.8946, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.37% (4.7449 => 4.5376, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.75% (6.0224 => 5.7968, std.dev.: 0.0096) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (28.5821 => 27.6954, std.dev.: 0.0824) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.00% (0.5807 => 0.5633, std.dev.: 0.0021) MultiSource/Applications/aha/aha: -2.90% (3.3398 => 3.2428, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.88% (9.9065 => 9.6216, std.dev.: 0.0727) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.75% (2.6356 => 2.5630, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/hash2: -2.18% (3.4237 => 3.3489, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.93% (11.5316 => 11.3085, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.66% (2.3487 => 2.3096, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.65% (4.9994 => 4.9168, std.dev.: 0.0224) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 5.16% (1.0262 => 1.0792, std.dev.: 0.0593) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 81.30% (0.0123 => 0.0223, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0066) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.78% (0.0384 => 0.0387, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/test1: 3.89% (0.0180 => 0.0187, std.dev.: 0.0038) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 3.82% (0.1438 => 0.1493, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 3.73% (1.1329 => 1.1752, std.dev.: 0.3859) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.63% (0.4164 => 0.4096, std.dev.: 0.0845) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.41% (0.1369 => 0.1402, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.16% (0.0641 => 0.0642, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.13% (0.0195 => 0.0205, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.54% (0.0578 => 0.0610, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.73% (1.1437 => 1.1978, std.dev.: 0.1215) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2300.00% (0.0001 => 0.0024, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -28.57% (0.0014 => 0.0010, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.67% (0.0627 => 0.0650, std.dev.: 0.0150) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.75% (0.8017 => 0.7877, std.dev.: 0.0250) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/SignlessTypes/Large/cast: 14.52% (0.0062 => 0.0071, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 15:13:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 17:13:37 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121117231337.A20362A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5984?compare_to=5977&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5984, Order: 168263, Start Time: 2012-11-17 19:54:01, End Time: 2012-11-17 23:13:58 To: 5977, Order: 168259, Start Time: 2012-11-17 15:46:44, End Time: 2012-11-17 19:06:13 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (178 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (136 on baseline) Unchanged Tests: 1090 (761 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 29.23% (57.9921 => 74.9438, std.dev.: 0.0152) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.41% (2.0493 => 2.1192, std.dev.: 0.0067) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.44% (0.0625 => 0.0884, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.74% (0.1063 => 0.1411) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.88% (0.2969 => 0.3767, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.13% (0.1106 => 0.1395, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.32% (0.4139 => 0.5187, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.93% (0.0714 => 0.0892, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.88% (0.4253 => 0.5311, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.36% (0.5900 => 0.7337, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.34% (0.0415 => 0.0516, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.15% (0.4994 => 0.6200, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.00% (0.0475 => 0.0589, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.80% (0.0584 => 0.0723, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.77% (0.0547 => 0.0677) MultiSource/Applications/oggenc/oggenc: 23.72% (1.5932 => 1.9711, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.30% (0.5000 => 0.6165, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.09% (0.1620 => 0.1994, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.92% (0.1021 => 0.1255, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 22.54% (0.0599 => 0.0734, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 22.45% (0.0481 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.40% (0.1107 => 0.1355, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.30% (0.0897 => 0.1097, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 22.28% (0.0947 => 0.1158, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 22.15% (0.0808 => 0.0987, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.64% (0.0633 => 0.0770, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 21.62% (0.0948 => 0.1153, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.58% (0.0584 => 0.0710, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.31% (0.1103 => 0.1338, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.18% (0.0642 => 0.0778, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.07% (0.0541 => 0.0655, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 21.07% (0.0821 => 0.0994, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.05% (0.0822 => 0.0995, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.04% (0.1003 => 0.1214, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.98% (0.1549 => 0.1874, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.83% (0.3903 => 0.4716, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.81% (0.0495 => 0.0598, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.70% (0.1604 => 0.1936, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 20.69% (0.1619 => 0.1954, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.70% (0.1462 => 0.1750, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.59% (0.2736 => 0.3272, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.27% (0.2014 => 0.2402, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.95% (0.3890 => 0.4627, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: 18.88% (0.1218 => 0.1448, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 18.64% (0.4029 => 0.4780, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 18.62% (0.0698 => 0.0828, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 18.60% (0.1505 => 0.1785, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.54% (1.3152 => 1.5591, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.20% (0.1088 => 0.1286, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.18% (0.2866 => 0.3387, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.15% (0.5026 => 0.5938, std.dev.: 0.0062) MultiSource/Applications/Burg/burg: 17.90% (0.5546 => 0.6539, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 17.88% (1.8794 => 2.2154, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.83% (0.0572 => 0.0674, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.80% (0.0573 => 0.0675) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.72% (3.5627 => 4.1940, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 17.63% (0.5826 => 0.6853, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.54% (0.4658 => 0.5475, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.40% (1.6211 => 1.9031, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.36% (0.3271 => 0.3839, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 17.34% (0.5889 => 0.6910, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 17.31% (0.1421 => 0.1667, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.28% (0.1968 => 0.2308, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.19% (0.0605 => 0.0709, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.01% (0.4361 => 0.5103, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.90% (0.1160 => 0.1356, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.90% (0.3930 => 0.4594, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.80% (0.2875 => 0.3358, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 16.79% (0.9697 => 1.1325, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 16.59% (1.0781 => 1.2570, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: 16.51% (0.1284 => 0.1496, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.47% (0.2738 => 0.3189, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 16.40% (0.7171 => 0.8347, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.40% (2.7292 => 3.1767, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/objinst: 16.19% (0.2823 => 0.3280, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 16.18% (4.2109 => 4.8924, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/strcat: 16.15% (0.2750 => 0.3194, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 16.00% (0.2725 => 0.3161, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 15.94% (0.2780 => 0.3223, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 15.92% (0.2714 => 0.3146, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 15.87% (0.2811 => 0.3257, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.86% (4.4195 => 5.1206, std.dev.: 0.0108) MultiSource/Benchmarks/nbench/nbench: 15.86% (0.2566 => 0.2973, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 15.85% (0.3004 => 0.3480, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.81% (1.9694 => 2.2807, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.79% (0.2729 => 0.3160, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 15.77% (0.2803 => 0.3245, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 15.73% (0.9909 => 1.1468, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.68% (0.3195 => 0.3696, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.65% (0.2792 => 0.3229, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: 15.54% (0.2813 => 0.3250, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.53% (1.9966 => 2.3067, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.49% (0.2911 => 0.3362, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.45% (2.0673 => 2.3866, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wc: 15.44% (0.3096 => 0.3574, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.23% (0.1090 => 0.1256, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.14% (0.3362 => 0.3871, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 15.13% (1.4269 => 1.6428, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary3: 15.12% (0.3267 => 0.3761, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 14.98% (0.3258 => 0.3746, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 14.86% (0.3317 => 0.3810, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/football/football: 14.84% (0.2075 => 0.2383, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 14.84% (23.5202 => 27.0103, std.dev.: 0.0219) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.84% (0.3060 => 0.3514, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 14.74% (0.3678 => 0.4220, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.54% (0.3488 => 0.3995, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.53% (0.3124 => 0.3578, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.43% (0.3625 => 0.4148, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 14.40% (0.3348 => 0.3830, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 14.36% (0.7875 => 0.9006, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists1: 14.32% (0.3477 => 0.3975, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 14.19% (0.3446 => 0.3935, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.17% (0.3282 => 0.3747, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 14.14% (0.3465 => 0.3955, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.13% (0.3496 => 0.3990, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 14.05% (0.2691 => 0.3069, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/synchronized: 14.04% (0.3469 => 0.3956, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.02% (0.3460 => 0.3945, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.97% (0.3442 => 0.3923, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 13.97% (0.4146 => 0.4725, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 13.96% (0.3726 => 0.4246, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 13.85% (2.1653 => 2.4651, std.dev.: 0.0091) SingleSource/UnitTests/ObjC/property: 13.78% (0.3650 => 0.4153, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 13.70% (0.3643 => 0.4142, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 13.64% (0.4251 => 0.4831, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.59% (0.3981 => 0.4522, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 13.59% (0.0758 => 0.0861, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.52% (0.3690 => 0.4189, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 13.46% (2.1013 => 2.3842, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/parameter-passing: 13.45% (0.3724 => 0.4225, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.45% (0.3845 => 0.4362, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 13.44% (4.6177 => 5.2385, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 13.11% (0.5012 => 0.5669, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.73% (0.1383 => 0.1559, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.70% (0.2040 => 0.2299, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 12.47% (5.5417 => 6.2325, std.dev.: 0.0073) MultiSource/Applications/lambda-0_1_3/lambda: 12.12% (0.3498 => 0.3922, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.06% (0.6435 => 0.7211, std.dev.: 0.0140) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.87% (0.1028 => 0.1150, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 11.68% (0.6634 => 0.7409, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.17% (0.2068 => 0.2299, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 11.09% (0.3336 => 0.3706, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.96% (0.2737 => 0.3037, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.89% (0.3084 => 0.3420, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 10.85% (0.4847 => 0.5373, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.37% (0.2103 => 0.2321, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 10.00% (0.2391 => 0.2630, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 9.98% (2.0346 => 2.2376, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.16% (0.5361 => 0.5852, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.12% (4.6926 => 5.1207, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.91% (11.6398 => 12.6773, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.45% (0.5584 => 0.6056, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.43% (0.7426 => 0.8052, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 6.91% (11.9555 => 12.7820, std.dev.: 0.0161) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.61% (0.3792 => 0.3967, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.53% (0.0734 => 0.0870, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 9.96% (0.2802 => 0.3081, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6113, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6762, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 5.04% (0.2122 => 0.2229, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.98% (0.3693 => 0.3877, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-2: 4.90% (1.8057 => 1.8942, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1658, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: 4.28% (14.0481 => 14.6491, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2056, std.dev.: 0.0407) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.79% (2.0820 => 2.1192, std.dev.: 0.0067) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.69% (3.1722 => 3.2259, std.dev.: 0.0032) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3036, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2877, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5972, std.dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.74% (25.4195 => 16.5896, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: -9.45% (0.2402 => 0.2175, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9752, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8060, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.55% (11.2080 => 10.8105, std.dev.: 0.0056) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.67% (17.2379 => 16.7784, std.dev.: 0.0845) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.26% (41.7953 => 40.8515, std.dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5703, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.73% (0.6293 => 0.6184, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4952, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1790, std.dev.: 0.0687) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0473, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 15:23:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 17:23:51 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121117232351.433CB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5985?compare_to=5982&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5985, Order: 168271, Start Time: 2012-11-17 21:51:28, End Time: 2012-11-17 23:24:13 To: 5982, Order: 168268, Start Time: 2012-11-17 19:56:01, End Time: 2012-11-17 21:28:46 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== New Failures: 0 (48 on baseline) Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (180 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 48 (0 on baseline) Unchanged Tests: 1044 (857 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/LivermoreLoops/kernel01: -0.57% (0.0175 => 0.0174, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel02: -0.57% (0.0175 => 0.0174, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel03: - (0.0174 => 0.0174) SingleSource/Benchmarks/LivermoreLoops/kernel04: - (0.0175 => 0.0175) SingleSource/Benchmarks/LivermoreLoops/kernel05: - (0.0174 => 0.0174, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel06: - (0.0174 => 0.0174) SingleSource/Benchmarks/LivermoreLoops/kernel07: - (0.0175 => 0.0175) SingleSource/Benchmarks/LivermoreLoops/kernel08: - (0.0179 => 0.0179) SingleSource/Benchmarks/LivermoreLoops/kernel09: - (0.0175 => 0.0175) SingleSource/Benchmarks/LivermoreLoops/kernel10: -0.56% (0.0177 => 0.0176) SingleSource/Benchmarks/LivermoreLoops/kernel11: - (0.0174 => 0.0174) SingleSource/Benchmarks/LivermoreLoops/kernel12: - (0.0174 => 0.0174) SingleSource/Benchmarks/LivermoreLoops/kernel13: - (0.0177 => 0.0177, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel14: - (0.0178 => 0.0178, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel15: - (0.0182 => 0.0182) SingleSource/Benchmarks/LivermoreLoops/kernel16: - (0.0179 => 0.0179) SingleSource/Benchmarks/LivermoreLoops/kernel17: -0.56% (0.0177 => 0.0176, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel18: - (0.0182 => 0.0182) SingleSource/Benchmarks/LivermoreLoops/kernel19: - (0.0175 => 0.0175) SingleSource/Benchmarks/LivermoreLoops/kernel20: - (0.0176 => 0.0176) SingleSource/Benchmarks/LivermoreLoops/kernel21: -0.57% (0.0175 => 0.0174, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel22: - (0.0175 => 0.0175) SingleSource/Benchmarks/LivermoreLoops/kernel23: -0.57% (0.0176 => 0.0175, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel24: - (0.0174 => 0.0174) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/LivermoreLoops/kernel01: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel02: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel03: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel04: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel05: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel06: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel07: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel08: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel09: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel10: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel11: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel12: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel13: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel14: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel15: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel16: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel17: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel18: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel19: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel20: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel21: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel22: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel23: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel24: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 New Failures - Execution Time ----------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.76% (2.0478 => 2.1043, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/salsa20: 2.42% (7.4937 => 7.6752, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.24% (54.5751 => 55.7958, std.dev.: 0.4129) SingleSource/Benchmarks/Shootout-C++/hash2: 2.19% (3.1932 => 3.2632, std.dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.15% (0.1431 => 0.1300, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.37% (0.3821 => 0.3501, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -6.86% (2.4924 => 2.3214, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.75% (0.3142 => 0.2930, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -6.61% (0.3357 => 0.3135, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.46% (0.7198 => 0.6733, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.42% (0.9542 => 0.8929, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -6.39% (0.2160 => 0.2022, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.34% (0.2428 => 0.2274, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -6.24% (9.2283 => 8.6524, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.18% (0.1796 => 0.1685, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -6.12% (0.4033 => 0.3786, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.11% (0.2355 => 0.2211, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.11% (0.3812 => 0.3579, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.09% (0.9852 => 0.9252, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: -6.09% (16.1920 => 15.2063, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/exceptions-3: -6.08% (0.3848 => 0.3614, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.03% (0.3880 => 0.3646, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -6.03% (0.3831 => 0.3600, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.02% (0.3884 => 0.3650, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -6.01% (0.1879 => 0.1766, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -6.01% (0.3896 => 0.3662, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.99% (0.3891 => 0.3658, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.97% (0.6484 => 0.6097, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -5.94% (0.4176 => 0.3928, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -5.90% (0.9179 => 0.8637, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.90% (1.3722 => 1.2913, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: -5.88% (7.0961 => 6.6792, std.dev.: 0.0121) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.84% (6.7716 => 6.3763, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.83% (0.1716 => 0.1616, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.83% (4.8161 => 4.5355, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.75% (0.2695 => 0.2540, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.75% (4.0323 => 3.8004, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.74% (0.3658 => 0.3448, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.74% (1.0544 => 0.9939, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.73% (4.8802 => 4.6005, std.dev.: 0.0092) MultiSource/Benchmarks/sim/sim: -5.73% (0.3406 => 0.3211, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.69% (0.4199 => 0.3960, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.68% (0.1761 => 0.1661, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.67% (1.6364 => 1.5436, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.67% (3.5339 => 3.3335, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.64% (1.2300 => 1.1606, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.63% (4.5069 => 4.2532, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.62% (1.4642 => 1.3819, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.51% (0.5805 => 0.5485, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.51% (0.5591 => 0.5283, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.49% (0.6052 => 0.5720, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.48% (0.6681 => 0.6315, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/BoolLiteralTest: -5.48% (0.3834 => 0.3624, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: -5.48% (4.3330 => 4.0957, std.dev.: 0.0121) SingleSource/UnitTests/ObjC/parameter-passing: -5.47% (0.4280 => 0.4046, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.46% (0.6736 => 0.6368, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.45% (1.3148 => 1.2431, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: -5.45% (0.4515 => 0.4269, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -5.44% (1.1450 => 1.0827, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.44% (0.6660 => 0.6298, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.43% (0.5859 => 0.5541, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.43% (0.6230 => 0.5892, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: -5.42% (1.1530 => 1.0905, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.42% (0.6293 => 0.5952, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.41% (0.5802 => 0.5488, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.41% (1.2784 => 1.2093, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.38% (1.2221 => 1.1563, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.38% (0.6260 => 0.5923, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.38% (0.5857 => 0.5542, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.37% (0.8521 => 0.8063, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.37% (0.5925 => 0.5607, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.35% (0.6395 => 0.6053, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.35% (0.6676 => 0.6319, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.31% (14.2083 => 13.4534, std.dev.: 0.0153) MultiSource/Applications/SIBsim4/SIBsim4: -5.31% (1.3864 => 1.3128, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.29% (0.5705 => 0.5403, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -5.29% (0.2985 => 0.2827, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.29% (0.3025 => 0.2865, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.29% (0.5863 => 0.5553, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.28% (1.2210 => 1.1565, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: -5.28% (0.3581 => 0.3392, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.28% (8.0126 => 7.5898, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.27% (0.5575 => 0.5281, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.26% (0.5456 => 0.5169, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.25% (0.7919 => 0.7503, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.25% (0.5581 => 0.5288, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -5.25% (1.2515 => 1.1858, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.25% (0.5849 => 0.5542, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.25% (0.4916 => 0.4658, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.25% (0.7339 => 0.6954, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -5.25% (17.1032 => 16.2061, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.24% (0.3016 => 0.2858, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.23% (0.6667 => 0.6318, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.23% (0.5999 => 0.5685, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.23% (0.4151 => 0.3934, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.22% (0.2278 => 0.2159, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.22% (0.7524 => 0.7131, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -5.22% (0.3255 => 0.3085, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.21% (0.6395 => 0.6062, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.20% (0.2385 => 0.2261, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.20% (0.3483 => 0.3302, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.19% (0.4813 => 0.4563, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.19% (0.5688 => 0.5393, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.18% (0.6446 => 0.6112, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.18% (0.2548 => 0.2416, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.18% (0.3323 => 0.3151, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.17% (0.5941 => 0.5634, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/except: -5.16% (0.3026 => 0.2870, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.13% (0.5570 => 0.5284, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -5.13% (0.3059 => 0.2902, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.12% (0.6033 => 0.5724, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.11% (2.1713 => 2.0603, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -5.10% (0.7779 => 0.7382, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -5.10% (0.3194 => 0.3031, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.10% (0.2999 => 0.2846, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.09% (0.3319 => 0.3150, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: -5.09% (0.2989 => 0.2837, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -5.08% (0.3446 => 0.3271, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.07% (0.5168 => 0.4906, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: -5.07% (0.3394 => 0.3222, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.07% (0.5567 => 0.5285, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.05% (0.2871 => 0.2726, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -5.04% (0.4248 => 0.4034, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.04% (0.3057 => 0.2903, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -5.03% (3.5154 => 3.3385, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.01% (0.3849 => 0.3656, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: -5.00% (0.2659 => 0.2526, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.00% (0.6440 => 0.6118, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.99% (0.5569 => 0.5291, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.98% (0.3252 => 0.3090, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.98% (0.3837 => 0.3646, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.98% (0.2933 => 0.2787, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -4.97% (0.2939 => 0.2793, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.96% (0.2903 => 0.2759, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -4.94% (15.5079 => 14.7417, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash2: -4.94% (0.4861 => 0.4621, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: -4.90% (0.7447 => 0.7082, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.88% (0.3931 => 0.3739, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.84% (1.6474 => 1.5676, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: -4.84% (0.3205 => 0.3050, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -4.83% (15.2527 => 14.5162, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/ary2: -4.83% (0.3481 => 0.3313, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -4.82% (0.6347 => 0.6041, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.81% (0.7021 => 0.6683, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -4.78% (4.0594 => 3.8655, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/hello: -4.77% (0.2849 => 0.2713) SingleSource/UnitTests/ObjC++/property-reference-object: -4.75% (0.6441 => 0.6135, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -4.69% (0.3621 => 0.3451, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: -4.68% (0.3867 => 0.3686, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.64% (0.5329 => 0.5082, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.62% (0.9557 => 0.9115, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: -4.62% (34.0927 => 32.5161, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.61% (0.4321 => 0.4122, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.59% (0.6194 => 0.5910, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -4.57% (2.1401 => 2.0422, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.57% (0.6304 => 0.6016, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -4.50% (2.4021 => 2.2940, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: -4.50% (0.7982 => 0.7623, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.48% (0.4083 => 0.3900, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.48% (0.6189 => 0.5912, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.47% (0.9077 => 0.8671, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -4.47% (0.4524 => 0.4322, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.46% (22.4056 => 21.4064, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.43% (0.4427 => 0.4231, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -4.40% (0.3271 => 0.3127, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.38% (0.6297 => 0.6021, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.32% (2.2587 => 2.1611, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: -4.31% (0.8418 => 0.8055, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: -4.28% (0.3788 => 0.3626, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -4.21% (0.6750 => 0.6466, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -4.20% (5.0226 => 4.8115, std.dev.: 0.0140) MultiSource/Applications/kimwitu++/kc: -4.20% (18.2933 => 17.5247, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.95% (0.3491 => 0.3353, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: -3.75% (1.5610 => 1.5024, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.47% (5.4682 => 5.2783, std.dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: -2.21% (20.7746 => 20.3153, std.dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7527, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1729, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.91% (1.7753 => 1.7058, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.89% (2.2633 => 2.1752, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4721, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 15:58:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 17:58:58 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121117235858.03AD72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5986?compare_to=5980&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5986, Order: 168269, Start Time: 2012-11-17 21:40:51, End Time: 2012-11-17 23:59:17 To: 5980, Order: 168260, Start Time: 2012-11-17 18:31:34, End Time: 2012-11-17 20:51:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 48 (50 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 44 (145 on baseline) Performance Improvements: 9 (39 on baseline) Added Tests: 0 (136 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 987 (703 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 New Failures - Execution Time ----------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/objects/objects: 18.66% (0.1168 => 0.1386, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.36% (0.1667 => 0.1923, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 15.02% (0.6933 => 0.7974, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 14.93% (0.7916 => 0.9098, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.10% (0.7243 => 0.8264, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 13.86% (0.0837 => 0.0953, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.83% (0.5964 => 0.6789, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.37% (0.4667 => 0.5291, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C++/office/office: 13.32% (0.3364 => 0.3812, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.31% (0.4439 => 0.5030, std.dev.: 0.0134) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 12.44% (0.0868 => 0.0976, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.31% (1.3204 => 1.4830, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.90% (0.1176 => 0.1316, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.77% (0.5626 => 0.6288, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.76% (0.4175 => 0.4666, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.69% (0.3140 => 0.3507, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.51% (0.1182 => 0.1318, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.16% (0.5816 => 0.6465, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.06% (0.1898 => 0.2108, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/strcat: 10.84% (0.3089 => 0.3424, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.63% (0.5248 => 0.5806, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.36% (1.7470 => 1.9280, std.dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.59% (0.6671 => 0.7311, std.dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.48% (0.2236 => 0.2448, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/distray/distray: 9.39% (0.1534 => 0.1678, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.06% (0.3764 => 0.4105, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/em3d/em3d: 9.01% (0.1975 => 0.2153, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wc: 8.95% (0.3308 => 0.3604, std.dev.: 0.0075) MultiSource/Applications/hbd/hbd: 8.34% (1.7334 => 1.8779, std.dev.: 0.0146) MultiSource/Applications/d/make_dparser: 7.83% (3.7783 => 4.0743, std.dev.: 0.0843) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.56% (0.7619 => 0.8195, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 5.48% (0.6718 => 0.7086, std.dev.: 0.0051) MultiSource/Applications/JM/ldecod/ldecod: 5.01% (9.4018 => 9.8732, std.dev.: 0.0155) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.65% (0.2707 => 0.2833, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 25.61% (1.3175 => 1.6549, std.dev.: 0.0364) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 19.62% (0.0846 => 0.1012, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.57% (0.5765 => 0.6259, std.dev.: 0.0046) MultiSource/Applications/SPASS/SPASS: 8.49% (13.8373 => 15.0115, std.dev.: 0.2627) MultiSource/Benchmarks/Olden/bh/bh: 8.07% (1.9557 => 2.1135, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 6.84% (6.1372 => 6.5567, std.dev.: 0.0052) MultiSource/Benchmarks/NPB-serial/is/is: 5.22% (8.5583 => 9.0051, std.dev.: 0.0365) SingleSource/Benchmarks/Misc/ffbench: 3.76% (0.9932 => 1.0305, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.28% (4.4135 => 4.5143, std.dev.: 0.0125) MultiSource/Applications/SIBsim4/SIBsim4: 1.54% (3.8633 => 3.9228, std.dev.: 0.0099) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit: -13.61% (7.1122 => 6.1443, std.dev.: 0.3589) SingleSource/Benchmarks/Shootout-C++/nestedloop: -12.24% (0.3431 => 0.3011, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/bigfib: -11.72% (0.8211 => 0.7249, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout-C++/objinst: -11.39% (0.3749 => 0.3322, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/ks/ks: -10.95% (0.1963 => 0.1748, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/ReedSolomon: -9.95% (0.2442 => 0.2199, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: -7.01% (0.3853 => 0.3583, std.dev.: 0.0100) MultiSource/Benchmarks/PAQ8p/paq8p: -2.81% (11.9343 => 11.5989, std.dev.: 0.0514) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/lists1: -3.11% (0.6367 => 0.6169, std.dev.: 0.0058) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.07% (0.1339 => 0.1338, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0421 => 0.0420, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0653 => 0.0652, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: -0.01% (494.0685 => 494.0197, std.dev.: 0.3739) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/power/power: 43707.72% (1.1277 => 494.0197, std.dev.: 0.3739) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.53% (0.5229 => 1.5401, std.dev.: 0.0979) MultiSource/Applications/SPASS/SPASS: 22.56% (14.9895 => 18.3716, std.dev.: 0.0300) MultiSource/Applications/kimwitu++/kc: 50.97% (14.1553 => 21.3709, std.dev.: 0.0247) MultiSource/Benchmarks/MallocBench/gs/gs: 28.21% (4.1105 => 5.2702, std.dev.: 0.0616) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.70% (1.1048 => 1.5103, std.dev.: 0.0721) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 433.77% (7.1582 => 38.2086, std.dev.: 0.1435) SingleSource/Benchmarks/Misc-C++-EH/spirit: 77.43% (3.4629 => 6.1443, std.dev.: 0.3589) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.17% (0.6222 => 1.0277, std.dev.: 0.0704) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10447.08% (0.0720 => 7.5939, std.dev.: 0.3686) MultiSource/Applications/SIBsim4/SIBsim4: 3922700.00% (0.0001 => 3.9228, std.dev.: 0.0099) MultiSource/Applications/SPASS/SPASS: 15011400.00% (0.0001 => 15.0115, std.dev.: 0.2627) MultiSource/Applications/kimwitu++/kc: 51900.00% (0.0001 => 0.0520, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 63800.00% (0.0001 => 0.0639, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 625800.00% (0.0001 => 0.6259, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10092000.00% (0.0001 => 10.0921, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6978100.00% (0.0001 => 6.9782, std.dev.: 0.3872) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1802.47% (1.1194 => 21.2963, std.dev.: 0.1176) MultiSource/Applications/ClamAV/clamscan: 69.71% (22.1758 => 37.6335, std.dev.: 0.3141) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 61.89% (2.9384 => 4.7570, std.dev.: 0.2686) MultiSource/Benchmarks/FreeBench/distray/distray: 58.90% (0.1056 => 0.1678, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.84% (7.0540 => 11.0638, std.dev.: 0.1345) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 52.40% (8.1363 => 12.3998, std.dev.: 0.0446) MultiSource/Applications/JM/lencod/lencod: 49.23% (21.9371 => 32.7373, std.dev.: 0.0970) SingleSource/Benchmarks/Misc/flops: 46.44% (0.1432 => 0.2097, std.dev.: 0.0060) SingleSource/UnitTests/vla: 39.15% (0.0355 => 0.0494, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/almabench: 38.22% (0.0730 => 0.1009, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/lists: 34.03% (0.0626 => 0.0839, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 31.29% (0.0326 => 0.0428, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 30.55% (0.0730 => 0.0953, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 27.02% (0.1695 => 0.2153, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.64% (0.5105 => 0.6465, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 26.25% (0.1044 => 0.1318, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: 26.19% (0.1940 => 0.2448, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/spellcheck: 25.89% (0.4203 => 0.5291, std.dev.: 0.0105) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 25.81% (0.4615 => 0.5806, std.dev.: 0.0043) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 25.60% (0.0953 => 0.1197, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 25.42% (0.9765 => 1.2247, std.dev.: 0.0102) MultiSource/Benchmarks/SciMark2-C/scimark2: 25.34% (0.3121 => 0.3912, std.dev.: 0.0121) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 25.34% (0.2107 => 0.2641, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/functionobjects: 25.26% (0.5020 => 0.6288, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 25.07% (1.5415 => 1.9280, std.dev.: 0.0178) MultiSource/Benchmarks/Ptrdist/bc/bc: 25.03% (1.1861 => 1.4830, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 24.76% (0.5860 => 0.7311, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 24.75% (0.2271 => 0.2833, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 24.43% (0.0479 => 0.0596, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 24.42% (0.1114 => 0.1386, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 24.37% (0.1695 => 0.2108, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/wordfreq: 24.13% (0.3307 => 0.4105, std.dev.: 0.0121) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.99% (0.0746 => 0.0925, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: 23.77% (0.4064 => 0.5030, std.dev.: 0.0134) MultiSource/Applications/viterbi/viterbi: 23.41% (0.1555 => 0.1919, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/except: 23.27% (0.2871 => 0.3539, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/parameter-passing: 23.12% (0.3927 => 0.4835, std.dev.: 0.0082) SingleSource/Benchmarks/Stanford/Oscar: 23.11% (0.0636 => 0.0783, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/perlin: 22.95% (0.0536 => 0.0659, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 22.57% (0.2725 => 0.3340, std.dev.: 0.0118) MultiSource/Benchmarks/BitBench/five11/five11: 22.40% (0.0567 => 0.0694, std.dev.: 0.0020) MultiSource/Applications/d/make_dparser: 22.15% (3.3354 => 4.0743, std.dev.: 0.0843) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 22.12% (14.3668 => 17.5444, std.dev.: 0.0689) SingleSource/Benchmarks/Misc/whetstone: 21.97% (0.0660 => 0.0805, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 21.96% (0.3826 => 0.4666, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C++/office/office: 21.56% (0.3136 => 0.3812, std.dev.: 0.0042) MultiSource/Applications/oggenc/oggenc: 21.47% (5.7591 => 6.9955, std.dev.: 0.0877) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 21.40% (0.2603 => 0.3160, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/sumcol: 21.31% (0.2891 => 0.3507, std.dev.: 0.0135) MultiSource/Benchmarks/FreeBench/neural/neural: 21.26% (0.1463 => 0.1774, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/bmm/bmm: 21.21% (0.0759 => 0.0920, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.14% (0.1566 => 0.1897, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/fbench: 21.11% (0.0592 => 0.0717, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 20.95% (0.2831 => 0.3424, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.86% (0.8172 => 0.9877, std.dev.: 0.0295) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 20.44% (0.2065 => 0.2487, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/tsp/tsp: 20.43% (0.1175 => 0.1415, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.39% (0.1584 => 0.1907, std.dev.: 0.0080) MultiSource/Applications/hbd/hbd: 20.36% (1.5603 => 1.8779, std.dev.: 0.0146) SingleSource/UnitTests/ObjC/property: 20.07% (0.3886 => 0.4666, std.dev.: 0.0092) MultiSource/Applications/treecc/treecc: 19.81% (2.0273 => 2.4289, std.dev.: 0.0672) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 18.94% (1.3050 => 1.5522, std.dev.: 0.0395) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 18.34% (0.1625 => 0.1923, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/wc: 18.09% (0.3052 => 0.3604, std.dev.: 0.0075) MultiSource/Applications/lua/lua: 18.07% (3.8723 => 4.5722, std.dev.: 0.1101) MultiSource/Applications/sqlite3/sqlite3: 18.03% (17.1811 => 20.2786, std.dev.: 0.0388) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.34% (0.0871 => 0.1022, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 17.30% (0.0838 => 0.0983, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 16.98% (9.4845 => 11.0953, std.dev.: 0.2521) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.81% (4.9449 => 5.7760, std.dev.: 0.1448) SingleSource/UnitTests/ObjC/synchronized: 16.62% (0.3561 => 0.4153, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.38% (0.1337 => 0.1556, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.92% (0.0672 => 0.0779, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 15.91% (0.1163 => 0.1348, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/matrix: 15.77% (0.0818 => 0.0947, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.76% (0.1510 => 0.1748, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.43% (0.0648 => 0.0748, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.94% (0.2758 => 0.3170, std.dev.: 0.0158) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.87% (0.0834 => 0.0958, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.81% (0.0770 => 0.0884, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.77% (0.1117 => 0.1282, std.dev.: 0.0049) MultiSource/Benchmarks/NPB-serial/is/is: 14.19% (0.0719 => 0.0821, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 14.01% (63.2438 => 72.1048, std.dev.: 0.4307) SingleSource/UnitTests/ObjC/trivial-interface: 13.96% (0.3473 => 0.3958, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.93% (0.5981 => 0.6814, std.dev.: 0.0273) SingleSource/Benchmarks/McGill/exptree: 13.88% (0.0814 => 0.0927, std.dev.: 0.0043) MultiSource/Applications/sgefa/sgefa: 13.64% (0.3109 => 0.3533, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.61% (0.1029 => 0.1169, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.19% (0.3441 => 0.3895, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.02% (4.2646 => 4.8197, std.dev.: 0.1755) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.72% (5.0018 => 5.6378, std.dev.: 0.2361) SingleSource/Benchmarks/Misc-C++/bigfib: 12.28% (0.6456 => 0.7249, std.dev.: 0.0184) SingleSource/UnitTests/ObjC/exceptions-4: 12.22% (0.3543 => 0.3976, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.11% (0.0933 => 0.1046, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.10% (0.3497 => 0.3920, std.dev.: 0.0160) MultiSource/Benchmarks/PAQ8p/paq8p: 11.88% (10.3673 => 11.5989, std.dev.: 0.0514) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.92% (2.2022 => 2.4427, std.dev.: 0.0606) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.62% (0.1892 => 0.2093, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.53% (0.4103 => 0.4535, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 10.25% (0.4048 => 0.4463, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/lists1: 10.07% (0.3684 => 0.4055, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/oourafft: 9.17% (0.3282 => 0.3583, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.12% (0.3650 => 0.3983, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.67% (0.3162 => 0.3436, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.65% (0.3427 => 0.3689, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/ReedSolomon: 7.32% (0.2049 => 0.2199, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 6.10% (0.3131 => 0.3322, std.dev.: 0.0066) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.97% (0.3177 => 0.3335, std.dev.: 0.0061) SingleSource/UnitTests/Vector/constpool: 4.64% (54.1659 => 56.6795, std.dev.: 0.3934) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.37% (4.3953 => 11.0044, std.dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/methcall: 147.73% (5.3999 => 13.3773, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ft/ft: 28.91% (1.2838 => 1.6549, std.dev.: 0.0364) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 24.95% (13.4384 => 16.7914, std.dev.: 0.5076) SingleSource/Benchmarks/Misc/oourafft: 17.53% (6.6465 => 7.8113, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 17.13% (0.0864 => 0.1012, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.60% (1.1145 => 1.2995, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.91% (0.2944 => 0.3324, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.62% (2.8904 => 3.2264, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 10.14% (1.1396 => 1.2552, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 10.06% (0.1421 => 0.1564, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.30% (1.7254 => 1.8859, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 8.92% (1.9405 => 2.1135, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/ffbench: 8.42% (0.9505 => 1.0305, std.dev.: 0.0128) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.04% (8.6802 => 9.2914, std.dev.: 0.1801) SingleSource/Benchmarks/Shootout-C++/hash2: 7.02% (3.1578 => 3.3796, std.dev.: 0.0623) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.80% (4.2280 => 4.4732, std.dev.: 0.0055) SingleSource/Regression/C/uint64_to_float: 5.10% (0.5413 => 0.5689, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.61% (26.0924 => 27.2954, std.dev.: 0.3307) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.15% (0.3540 => 0.3687, std.dev.: 0.0052) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.6436 => 12.1221, std.dev.: 0.0129) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.32% (0.4162 => 0.4300, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.95% (2.1424 => 2.2055, std.dev.: 0.0089) MultiSource/Applications/sgefa/sgefa: 2.57% (0.6223 => 0.6383, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/dry: 2.51% (2.4116 => 2.4721, std.dev.: 0.0099) MultiSource/Benchmarks/PAQ8p/paq8p: 2.17% (85.0658 => 86.9077, std.dev.: 0.0608) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 2.06% (3.1595 => 3.2247, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 1.46% (27.8444 => 28.2519, std.dev.: 0.0394) SingleSource/Benchmarks/Shootout-C++/sieve: 1.38% (2.4858 => 2.5202, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.34% (6.5088 => 6.5959, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout/sieve: 1.32% (5.2139 => 5.2825, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0313 => 1.0440, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0503, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1671, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.81% (5.2763 => 1.2235, std.dev.: 0.0572) SingleSource/Benchmarks/Misc/salsa20: -75.51% (0.8651 => 0.2119, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/richards_benchmark: -44.76% (0.1622 => 0.0896, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.81% (5.3526 => 4.7205, std.dev.: 0.0736) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -9.90% (5.3855 => 4.8524, std.dev.: 0.1160) MultiSource/Applications/JM/ldecod/ldecod: -5.39% (10.4361 => 9.8732, std.dev.: 0.0155) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.52% (0.0628 => 0.0361, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.01% (0.3987 => 0.2392, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.72% (0.0506 => 0.0305, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.40% (4.5009 => 2.7726, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -24.71% (10.7105 => 8.0644, std.dev.: 0.3720) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.07% (2.6546 => 2.0156, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -19.25% (0.2161 => 0.1745, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.62% (1.6925 => 1.4281, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2842, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.79% (32.5116 => 29.0025, std.dev.: 0.0229) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.41% (1.5660 => 1.4343, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.2416 => 3.0211, std.dev.: 0.0297) MultiSource/Benchmarks/NPB-serial/is/is: -5.84% (9.5636 => 9.0051, std.dev.: 0.0365) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5760, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7497, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.36% (1.6805 => 1.5905, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5080, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -4.26% (6.2999 => 6.0315, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.13% (19.9488 => 19.1242, std.dev.: 0.1076) MultiSource/Benchmarks/sim/sim: -3.05% (5.0483 => 4.8944, std.dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.35% (0.4808 => 0.4695, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.79% (8.1563 => 8.0102, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6771, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -1.49% (10.2830 => 10.1297, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0018) Report Time: 2.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 17:05:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 19:05:19 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121118010519.133852A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5987?compare_to=5983&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5987, Order: 168274, Start Time: 2012-11-17 23:28:44, End Time: 2012-11-18 01:05:39 To: 5983, Order: 168271, Start Time: 2012-11-17 21:38:26, End Time: 2012-11-17 23:12:03 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 9 (58 on baseline) Performance Improvements: 3 (20 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1042 (896 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel23: 15.02% (0.1165 => 0.1340, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.49% (0.9263 => 0.9401, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 14.62% (44.8796 => 51.4431, std.dev.: 0.4943) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.82% (2.2472 => 2.4005, std.dev.: 0.0410) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.70% (21.6188 => 23.0674, std.dev.: 0.3158) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.17% (60.0266 => 61.9320, std.dev.: 0.5911) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.86% (3.5409 => 3.6067, std.dev.: 0.0199) SingleSource/Benchmarks/Misc/flops-7: 1.20% (1.7080 => 1.7285, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 1.13% (0.8869 => 0.8969, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/random: -13.99% (0.2273 => 0.1955, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.45% (0.8936 => 0.8806, std.dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.98% (6.4977 => 6.3040, std.dev.: 0.0422) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.84% (1.0792 => 1.0701, std.dev.: 0.1932) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.24% (0.0223 => 0.0218, std.dev.: 0.0068) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0428 => 0.0427, std.dev.: 0.0119) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0333 => 0.0334, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.95% (0.0316 => 0.0313, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.82% (0.0387 => 0.0425, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0203 => 0.0202, std.dev.: 0.0066) SingleSource/UnitTests/Vector/Altivec/test1: 15.51% (0.0187 => 0.0216, std.dev.: 0.0062) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.40% (0.1493 => 0.1487, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 5.38% (1.1752 => 1.2384, std.dev.: 0.1685) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.42% (0.4096 => 0.4195, std.dev.: 0.1206) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.36% (0.1402 => 0.1421, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.52% (0.0642 => 0.0613, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 35.12% (0.0205 => 0.0277, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.64% (0.0610 => 0.0600, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.01% (1.1978 => 1.1979, std.dev.: 0.0263) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -4.17% (0.0024 => 0.0023, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -30.00% (0.0010 => 0.0007, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.15% (0.0650 => 0.0651, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.50% (0.0266 => 0.0262, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.81% (0.7877 => 0.7813, std.dev.: 0.0030) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 42.25% (0.0071 => 0.0101, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.13% (16.4461 => 17.6194, std.dev.: 0.7870) MultiSource/Applications/sqlite3/sqlite3: 2359.84% (0.6332 => 15.5757, std.dev.: 0.3702) MultiSource/Benchmarks/McCat/08-main/main: 49.86% (0.1831 => 0.2744, std.dev.: 0.0819) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.09% (0.1559 => 0.1464, std.dev.: 0.0294) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7158.21% (0.3123 => 22.6674, std.dev.: 0.6619) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.24% (0.2463 => 0.3725, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1523.89% (0.3344 => 5.4303, std.dev.: 0.2704) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.32% (0.2364 => 0.3199, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 4.86% (0.6010 => 0.6302, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel: 3.50% (0.0429 => 0.0444, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.36% (0.3266 => 0.3441, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/strcat: 4.22% (0.1969 => 0.2052, std.dev.: 0.0082) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.93% (0.0224 => 0.0244, std.dev.: 0.0078) SingleSource/UnitTests/byval-alignment: -28.70% (0.0230 => 0.0164, std.dev.: 0.0060) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0529, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 12.18% (0.1462 => 0.1640, std.dev.: 0.0115) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.5054, std.dev.: 0.0334) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0678, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4945, std.dev.: 0.0210) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5148, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5312, std.dev.: 0.2776) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3133, std.dev.: 0.0159) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1242, std.dev.: 0.0460) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3635, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4087, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0855, std.dev.: 0.0013) SingleSource/Regression/C/uint64_to_float: -24.08% (2.1832 => 1.6575, std.dev.: 0.0069) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 21.26% (0.0635 => 0.0770, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.51% (0.0810 => 0.0968, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.44% (0.0848 => 0.0962, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.82% (0.1905 => 0.2035, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.38% (1.1170 => 1.1659, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.81% (0.9056 => 0.9401, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.66% (0.4783 => 0.4958, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.39% (0.8050 => 0.8323, std.dev.: 0.0047) MultiSource/Applications/lambda-0_1_3/lambda: 3.37% (0.7557 => 0.7812, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.34% (0.3115 => 0.3219, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.31% (0.3657 => 0.3778, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.02% (0.8697 => 0.8960, std.dev.: 0.0041) MultiSource/Benchmarks/Bullet/bullet: 2.81% (31.8598 => 32.7541, std.dev.: 0.2994) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.78% (0.8611 => 0.8850, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.72% (0.8359 => 0.8586, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.66% (0.8716 => 0.8948, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.58% (0.8331 => 0.8546, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.51% (0.9074 => 0.9302, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.48% (1.4479 => 1.4838, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.43% (0.8597 => 0.8806, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.37% (0.8086 => 0.8278, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.36% (0.7932 => 0.8119, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.32% (0.8261 => 0.8453, std.dev.: 0.0040) MultiSource/Benchmarks/PAQ8p/paq8p: 2.26% (2.3764 => 2.4300, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.24% (0.9908 => 1.0130, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.18% (0.8927 => 0.9122, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.18% (0.8177 => 0.8355, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.15% (0.8885 => 0.9076, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.91% (0.8048 => 0.8202, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 102.01% (0.0199 => 0.0402, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/pi: 58.29% (1.5795 => 2.5002, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 18.06% (0.7597 => 0.8969, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.32% (2.9753 => 3.4609, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.45% (44.5605 => 51.4431, std.dev.: 0.4943) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.43% (2.7995 => 3.2036, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6087, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.72% (6.3772 => 6.9972, std.dev.: 0.2217) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.10% (1.1857 => 1.2817, std.dev.: 0.0100) SingleSource/Benchmarks/McGill/queens: 7.30% (1.7056 => 1.8301, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.76% (2.2485 => 2.4005, std.dev.: 0.0410) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.56% (4.7794 => 5.0931, std.dev.: 0.0258) SingleSource/Benchmarks/Misc/richards_benchmark: 6.46% (1.3037 => 1.3879, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.07% (4.5327 => 4.8077, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.90% (4.9686 => 5.2619, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.81% (6.2275 => 6.5268, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.64% (3.3761 => 3.5327, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.50% (59.2638 => 61.9320, std.dev.: 0.5911) MultiSource/Applications/lambda-0_1_3/lambda: 4.45% (7.4933 => 7.8268, std.dev.: 0.0668) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.14% (4.9453 => 5.1502, std.dev.: 0.0274) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.08% (4.9469 => 5.1487, std.dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: 3.97% (14.0064 => 14.5620, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.69% (11.5690 => 11.8801, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.61% (8.2783 => 8.4945, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout/lists: 2.42% (7.3375 => 7.5153, std.dev.: 0.0232) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.17% (4.8660 => 4.9718, std.dev.: 0.0172) SingleSource/Benchmarks/Stanford/FloatMM: 1.52% (0.8807 => 0.8941, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 1.35% (8.5322 => 8.6472, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/neural/neural: 1.32% (1.0841 => 1.0984, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.12% (5.4641 => 4.3103, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.60% (7.2130 => 6.3040, std.dev.: 0.0422) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.93% (1.0512 => 0.9363, std.dev.: 0.0303) SingleSource/Benchmarks/McGill/chomp: -10.87% (1.1216 => 0.9997, std.dev.: 0.0182) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.28% (14.6451 => 13.4330, std.dev.: 0.1202) MultiSource/Benchmarks/mafft/pairlocalalign: -8.25% (63.1822 => 57.9705, std.dev.: 0.6852) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.90% (4.7482 => 4.4208, std.dev.: 0.0222) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.30% (0.3269 => 0.3063, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.00% (3.7148 => 3.4919, std.dev.: 0.0257) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.86% (5.4972 => 5.1750, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.11% (5.1557 => 4.8920, std.dev.: 0.0235) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.50% (4.7449 => 4.5316, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.91% (6.0224 => 5.7867, std.dev.: 0.0157) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.06% (28.5821 => 27.7072, std.dev.: 0.1336) MultiSource/Benchmarks/Prolangs-C++/life/life: -3.03% (2.6356 => 2.5557, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.83% (2.4490 => 2.3797, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.61% (9.9065 => 9.6479, std.dev.: 0.0846) SingleSource/Benchmarks/Shootout-C++/hash2: -2.30% (3.4237 => 3.3451, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.97% (11.5316 => 11.3045, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.15% (5.6343 => 5.5697, std.dev.: 0.0085) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.28% (1.0262 => 1.0701, std.dev.: 0.1932) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0068) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0119) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.50% (0.0254 => 0.0334, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0066) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0062) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 3.41% (0.1438 => 0.1487, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 9.31% (1.1329 => 1.2384, std.dev.: 0.1685) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.74% (0.4164 => 0.4195, std.dev.: 0.1206) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.80% (0.1369 => 0.1421, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.37% (0.0641 => 0.0613, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.81% (0.0578 => 0.0600, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.74% (1.1437 => 1.1979, std.dev.: 0.0263) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2200.00% (0.0001 => 0.0023, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0014 => 0.0007, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.83% (0.0627 => 0.0651, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 45.56% (0.0180 => 0.0262, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.54% (0.8017 => 0.7813, std.dev.: 0.0030) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 62.90% (0.0062 => 0.0101, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 17:19:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 19:19:24 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121118011924.E59A72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5988?compare_to=5985&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5988, Order: 168274, Start Time: 2012-11-17 23:46:58, End Time: 2012-11-18 01:19:43 To: 5985, Order: 168271, Start Time: 2012-11-17 21:51:28, End Time: 2012-11-17 23:24:13 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== New Failures: 0 (48 on baseline) Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (178 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 48 (0 on baseline) Unchanged Tests: 1043 (860 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.09% (78.1989 => 80.6114, std.dev.: 0.3573) Existing Failures - Compile Time -------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/LivermoreLoops/kernel01: 1.15% (0.0174 => 0.0176, std.dev.: 0.0010) SingleSource/Benchmarks/LivermoreLoops/kernel02: 0.57% (0.0174 => 0.0175, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel03: 0.57% (0.0174 => 0.0175) SingleSource/Benchmarks/LivermoreLoops/kernel04: 0.57% (0.0175 => 0.0176) SingleSource/Benchmarks/LivermoreLoops/kernel05: 0.57% (0.0174 => 0.0175, std.dev.: 0.0002) SingleSource/Benchmarks/LivermoreLoops/kernel06: 0.57% (0.0174 => 0.0175, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel07: 0.57% (0.0175 => 0.0176, std.dev.: 0.0010) SingleSource/Benchmarks/LivermoreLoops/kernel08: 0.56% (0.0179 => 0.0180) SingleSource/Benchmarks/LivermoreLoops/kernel09: 0.57% (0.0175 => 0.0176) SingleSource/Benchmarks/LivermoreLoops/kernel10: 0.57% (0.0176 => 0.0177) SingleSource/Benchmarks/LivermoreLoops/kernel11: 0.57% (0.0174 => 0.0175) SingleSource/Benchmarks/LivermoreLoops/kernel12: 0.57% (0.0174 => 0.0175) SingleSource/Benchmarks/LivermoreLoops/kernel13: 0.56% (0.0177 => 0.0178, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel14: 0.56% (0.0178 => 0.0179) SingleSource/Benchmarks/LivermoreLoops/kernel15: 0.55% (0.0182 => 0.0183, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel16: 0.56% (0.0179 => 0.0180) SingleSource/Benchmarks/LivermoreLoops/kernel17: 0.57% (0.0176 => 0.0177, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel18: - (0.0182 => 0.0182, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel19: 0.57% (0.0175 => 0.0176, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel20: 0.57% (0.0176 => 0.0177) SingleSource/Benchmarks/LivermoreLoops/kernel21: 0.57% (0.0174 => 0.0175, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel22: 0.57% (0.0175 => 0.0176) SingleSource/Benchmarks/LivermoreLoops/kernel23: 0.57% (0.0175 => 0.0176, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel24: 0.57% (0.0174 => 0.0175) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/LivermoreLoops/kernel01: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel02: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel03: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel04: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel05: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel06: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel07: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel08: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel09: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel10: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel11: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel12: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel13: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel14: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel15: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel16: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel17: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel18: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel19: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel20: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel21: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel22: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel23: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel24: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 New Failures - Execution Time ----------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.66% (2.0478 => 2.1023, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.4937 => 7.6745, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/hash2: 2.21% (3.1932 => 3.2637, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.30% (0.3821 => 0.3504, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -6.92% (2.4924 => 2.3200, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.68% (0.3142 => 0.2932, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.58% (0.3357 => 0.3136, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.51% (0.9542 => 0.8921, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.40% (0.7198 => 0.6737, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -6.30% (0.2160 => 0.2024, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -6.19% (9.2283 => 8.6575, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.18% (0.1796 => 0.1685, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.16% (0.9852 => 0.9245, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.05% (0.2428 => 0.2281, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: -6.05% (16.1920 => 15.2126, std.dev.: 0.0087) MultiSource/Applications/JM/ldecod/ldecod: -5.96% (7.0961 => 6.6731, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -5.85% (0.9179 => 0.8642, std.dev.: 0.0046) SingleSource/Benchmarks/McGill/chomp: -5.85% (0.1761 => 0.1658, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.81% (1.3722 => 1.2925, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.77% (0.2355 => 0.2219, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.77% (3.5339 => 3.3300, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.72% (0.6484 => 0.6113, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.68% (0.2695 => 0.2542, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.67% (0.6681 => 0.6302, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.66% (1.0544 => 0.9947, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.65% (4.0323 => 3.8043, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.62% (4.8161 => 4.5455, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.60% (0.6052 => 0.5713, std.dev.: 0.0066) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.60% (6.7716 => 6.3924, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.60% (0.5859 => 0.5531, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -5.59% (1.1450 => 1.0810, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.58% (0.5591 => 0.5279, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.58% (0.3658 => 0.3454, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -5.56% (0.3812 => 0.3600, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.54% (1.6364 => 1.5457, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.53% (0.5805 => 0.5484, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/for-in: -5.53% (0.4033 => 0.3810, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.52% (0.6230 => 0.5886, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.52% (4.8802 => 4.6110, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.50% (1.2300 => 1.1624, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.49% (0.5863 => 0.5541, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.49% (0.3406 => 0.3219, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.48% (0.5857 => 0.5536, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.48% (0.7524 => 0.7112, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.46% (1.4642 => 1.3843, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.45% (0.6260 => 0.5919, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.44% (4.5069 => 4.2615, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.44% (0.6676 => 0.6313, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.43% (0.3884 => 0.3673, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.43% (0.3831 => 0.3623, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.42% (0.3896 => 0.3685, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -5.41% (4.3330 => 4.0984, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions-4: -5.41% (0.3880 => 0.3670, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -5.41% (1.1530 => 1.0906, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.39% (0.6736 => 0.6373, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: -5.39% (0.4176 => 0.3951, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.39% (0.5478 => 0.5183, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.38% (0.5802 => 0.5490, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.37% (0.6667 => 0.6309, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.36% (0.6660 => 0.6303, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/05-eks/eks: -5.36% (0.4515 => 0.4273, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.35% (0.7339 => 0.6946, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/exceptions-3: -5.35% (0.3848 => 0.3642, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.35% (0.5575 => 0.5277, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.33% (0.5925 => 0.5609, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.33% (0.6395 => 0.6054, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -5.33% (17.1032 => 16.1919, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.31% (0.5705 => 0.5402, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -5.31% (1.2515 => 1.1851, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.30% (0.5581 => 0.5285, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.30% (0.5456 => 0.5167, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.29% (0.6395 => 0.6057, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.28% (0.3483 => 0.3299, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.27% (0.5849 => 0.5541, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.26% (0.6293 => 0.5962, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.26% (0.5688 => 0.5389, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.26% (1.2784 => 1.2112, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.25% (14.2083 => 13.4619, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.25% (0.5941 => 0.5629, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.24% (0.3891 => 0.3687, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.24% (0.7919 => 0.7504, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.23% (0.6446 => 0.6109, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -5.23% (0.2985 => 0.2829, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: -5.19% (0.3581 => 0.3395, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.19% (0.5567 => 0.5278, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.18% (0.2548 => 0.2416, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: -5.18% (1.3864 => 1.3146, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.17% (1.2221 => 1.1589, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.13% (0.8521 => 0.8084, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.10% (0.5570 => 0.5286, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -5.10% (0.4199 => 0.3985, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.09% (0.6033 => 0.5726, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.08% (1.2210 => 1.1590, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.08% (0.6440 => 0.6113, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.03% (0.5569 => 0.5289, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.02% (0.5999 => 0.5698, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.00% (0.2659 => 0.2526, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.98% (0.4916 => 0.4671, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: -4.97% (3.5154 => 3.3407, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.96% (8.0126 => 7.6154, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.93% (0.5168 => 0.4913, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.89% (1.6474 => 1.5668, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.87% (0.2278 => 0.2167, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: -4.84% (1.3148 => 1.2511, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.79% (0.3319 => 0.3160, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.78% (0.7447 => 0.7091, std.dev.: 0.0049) MultiSource/Applications/ClamAV/clamscan: -4.77% (15.2527 => 14.5251, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.77% (0.4151 => 0.3953, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -4.75% (4.0594 => 3.8666, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.74% (0.2385 => 0.2272, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.73% (0.2999 => 0.2857, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/parameter-passing: -4.72% (0.4280 => 0.4078, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -4.71% (15.5079 => 14.7770, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.67% (0.6194 => 0.5905, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.62% (0.5329 => 0.5083, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.61% (0.3016 => 0.2877, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -4.61% (0.3255 => 0.3105, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.60% (0.7021 => 0.6698, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.58% (0.6304 => 0.6015, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -4.58% (2.4021 => 2.2920, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.57% (0.6189 => 0.5906, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.55% (22.4056 => 21.3862, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.51% (0.6297 => 0.6013, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -4.46% (0.3025 => 0.2890, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -4.46% (0.3026 => 0.2891, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -4.46% (2.1401 => 2.0447, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.40% (0.3837 => 0.3668, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -4.40% (0.7779 => 0.7437, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.39% (0.3323 => 0.3177, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -4.38% (0.3194 => 0.3054, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -4.38% (0.4861 => 0.4648, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.34% (0.3849 => 0.3682, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.34% (2.2587 => 2.1607, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: -4.33% (5.0226 => 4.8049, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.32% (0.3057 => 0.2925, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.32% (2.1713 => 2.0776, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -4.28% (0.4248 => 0.4066, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.27% (0.3252 => 0.3113, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.26% (0.9557 => 0.9150, std.dev.: 0.0027) SingleSource/Regression/C++/ofstream_ctor: -4.25% (0.3059 => 0.2929, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.25% (0.3271 => 0.3132, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -4.25% (34.0927 => 32.6452, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/ary3: -4.24% (0.3446 => 0.3300, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -4.22% (0.2989 => 0.2863, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -4.21% (0.3394 => 0.3251, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: -4.18% (0.2871 => 0.2751, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.12% (0.4321 => 0.4143, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.10% (0.2903 => 0.2784, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.10% (0.8418 => 0.8073, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.09% (0.2933 => 0.2813, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -4.05% (18.2933 => 17.5517, std.dev.: 0.0117) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.05% (0.4813 => 0.4618, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -4.03% (0.3621 => 0.3475, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -4.01% (0.2939 => 0.2821, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -4.01% (0.3867 => 0.3712, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -4.00% (0.2849 => 0.2735, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -3.97% (0.6347 => 0.6095, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.96% (0.6441 => 0.6186, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -3.93% (0.3205 => 0.3079, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.89% (0.4083 => 0.3924, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -3.88% (0.3481 => 0.3346, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.81% (0.3491 => 0.3358, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.79% (0.9077 => 0.8733, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: -3.74% (0.4524 => 0.4355, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -3.73% (0.6750 => 0.6498, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -3.51% (0.3788 => 0.3655, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.33% (1.5610 => 1.5090, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.30% (5.4682 => 5.2875, std.dev.: 0.0048) SingleSource/UnitTests/Vector/constpool: -2.36% (20.7746 => 20.2838, std.dev.: 0.0164) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7537, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: -8.68% (1.2842 => 1.1727, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -4.09% (2.2633 => 2.1708, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.83% (1.7753 => 1.7073, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.85% (1.3096 => 1.2723, std.dev.: 0.0133) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.64% (6.5735 => 6.4658, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Report Time: 4.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 19:09:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 21:09:53 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121118030953.69BB32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5989?compare_to=5986&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5989, Order: 168276, Start Time: 2012-11-18 00:49:40, End Time: 2012-11-18 03:10:13 To: 5986, Order: 168269, Start Time: 2012-11-17 21:40:51, End Time: 2012-11-17 23:59:17 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (50 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 71 (195 on baseline) Performance Improvements: 9 (41 on baseline) Added Tests: 0 (136 on baseline) Existing Failures: 52 (2 on baseline) Unchanged Tests: 960 (651 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/messages-2: 17.75% (0.0772 => 0.0909, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 16.72% (0.3972 => 0.4636, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hello: 15.06% (0.2928 => 0.3369, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 15.04% (0.6210 => 0.7144, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/bh/bh: 14.43% (0.3334 => 0.3815, std.dev.: 0.0061) MultiSource/Applications/minisat/minisat: 14.23% (0.8172 => 0.9335, std.dev.: 0.0178) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.98% (0.0987 => 0.1125, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.75% (0.4299 => 0.4890, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 13.59% (0.6893 => 0.7830, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/ary3: 13.36% (0.3564 => 0.4040, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/methcall: 13.35% (0.3115 => 0.3531, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ary2: 13.22% (0.3683 => 0.4170, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary: 12.80% (0.3509 => 0.3958, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists: 12.75% (0.3780 => 0.4262, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 12.52% (0.5911 => 0.6651, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 12.24% (1.5643 => 1.7557, std.dev.: 0.0125) MultiSource/Benchmarks/McCat/09-vor/vor: 12.22% (0.3569 => 0.4005, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.18% (0.5105 => 0.5727, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.18% (0.6328 => 0.7099, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.05% (0.5919 => 0.6632, std.dev.: 0.0239) MultiSource/Benchmarks/McCat/18-imp/imp: 11.75% (0.3899 => 0.4357, std.dev.: 0.0008) SingleSource/Benchmarks/Linpack/linpack-pc: 11.59% (0.2882 => 0.3216, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.25% (0.6622 => 0.7367, std.dev.: 0.0283) SingleSource/UnitTests/ObjC/exceptions-2: 10.15% (0.3920 => 0.4318, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.98% (1.5103 => 1.6610, std.dev.: 0.0107) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.95% (0.3968 => 0.4363, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions: 9.87% (0.4287 => 0.4710, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 9.81% (0.1489 => 0.1635, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/tsp/tsp: 9.61% (0.1415 => 0.1551, std.dev.: 0.0048) MultiSource/Applications/SIBsim4/SIBsim4: 9.49% (1.5401 => 1.6862, std.dev.: 0.0444) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.44% (0.9082 => 0.9939, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.32% (2.2413 => 2.4502, std.dev.: 0.0607) MultiSource/Benchmarks/McCat/05-eks/eks: 9.11% (0.4798 => 0.5235, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/for-in: 8.99% (0.4140 => 0.4512, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.87% (0.6720 => 0.7316, std.dev.: 0.0223) SingleSource/UnitTests/ObjC/exceptions-3: 8.52% (0.3942 => 0.4278, std.dev.: 0.0054) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.32% (0.1274 => 0.1380, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 8.05% (0.3976 => 0.4296, std.dev.: 0.0070) MultiSource/Applications/spiff/spiff: 8.03% (0.8936 => 0.9654, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.62% (1.2235 => 1.3167, std.dev.: 0.0326) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.52% (0.3895 => 0.4188, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.21% (0.4163 => 0.4463, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.16% (0.8621 => 0.9238, std.dev.: 0.0110) MultiSource/Benchmarks/nbench/nbench: 7.13% (1.3293 => 1.4241, std.dev.: 0.0314) SingleSource/UnitTests/ObjC/trivial-interface: 6.39% (0.3958 => 0.4211, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.48% (0.9877 => 1.0418, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference-object: 4.60% (0.6593 => 0.6896, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.38% (0.5253 => 0.5483, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.76% (1.5522 => 1.6106, std.dev.: 0.0153) SingleSource/UnitTests/ObjC/property: 3.62% (0.4666 => 0.4835, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.99% (0.6288 => 0.6413, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 72.07% (4.6573 => 8.0140, std.dev.: 0.4723) MultiSource/Benchmarks/McCat/09-vor/vor: 31.46% (0.1192 => 0.1567, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ary: 22.48% (0.0765 => 0.0937, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 21.71% (0.0760 => 0.0925, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/fftbench: 21.45% (2.1073 => 2.5593, std.dev.: 0.1514) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.68% (1.5551 => 1.8300, std.dev.: 0.0952) SingleSource/Benchmarks/CoyoteBench/lpbench: 16.31% (10.9138 => 12.6934, std.dev.: 0.2321) SingleSource/Benchmarks/Shootout-C++/ary3: 14.56% (4.1587 => 4.7644, std.dev.: 0.1521) MultiSource/Benchmarks/Olden/tsp/tsp: 11.88% (1.1052 => 1.2365, std.dev.: 0.0225) MultiSource/Benchmarks/Olden/bisort/bisort: 11.13% (0.8650 => 0.9613, std.dev.: 0.0203) MultiSource/Benchmarks/Olden/health/health: 9.78% (0.4610 => 0.5061, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.54% (3.9532 => 4.3303, std.dev.: 0.0822) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.41% (6.9782 => 7.5651, std.dev.: 0.0596) SingleSource/Benchmarks/BenchmarkGame/puzzle: 7.64% (0.6947 => 0.7478, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout/heapsort: 7.28% (4.0660 => 4.3621, std.dev.: 0.0943) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.39% (59.7701 => 61.7943, std.dev.: 0.0555) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.56% (3.7331 => 3.8285, std.dev.: 0.0250) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.70% (2.3082 => 2.3475, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.27% (3.6063 => 3.6520, std.dev.: 0.0167) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.19% (19.1242 => 19.3510, std.dev.: 0.0743) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/office/office: -11.49% (0.3812 => 0.3374, std.dev.: 0.0155) MultiSource/Benchmarks/Ptrdist/bc/bc: -11.09% (1.4830 => 1.3185, std.dev.: 0.0436) MultiSource/Benchmarks/Ptrdist/ft/ft: -8.50% (0.2448 => 0.2240, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: -8.34% (0.1678 => 0.1538, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -8.15% (0.7311 => 0.6715, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/ObjC/synchronized: -40.67% (0.1957 => 0.1161, std.dev.: 0.0255) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -16.90% (0.1012 => 0.0841, std.dev.: 0.0063) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.86% (0.6259 => 0.5767, std.dev.: 0.0187) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -2.12% (1.5905 => 1.5568, std.dev.: 0.0055) Existing Failures - Compile Time -------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/LivermoreLoops/kernel01: -1.03% (0.0195 => 0.0193, std.dev.: 0.0007) SingleSource/Benchmarks/LivermoreLoops/kernel02: -1.02% (0.0196 => 0.0194, std.dev.: 0.0007) SingleSource/Benchmarks/LivermoreLoops/kernel03: -4.95% (0.0202 => 0.0192, std.dev.: 0.0009) SingleSource/Benchmarks/LivermoreLoops/kernel04: - (0.0194 => 0.0194, std.dev.: 0.0007) SingleSource/Benchmarks/LivermoreLoops/kernel05: -3.50% (0.0200 => 0.0193, std.dev.: 0.0010) SingleSource/Benchmarks/LivermoreLoops/kernel06: -3.50% (0.0200 => 0.0193, std.dev.: 0.0012) SingleSource/Benchmarks/LivermoreLoops/kernel07: -3.96% (0.0202 => 0.0194, std.dev.: 0.0011) SingleSource/Benchmarks/LivermoreLoops/kernel08: -3.86% (0.0207 => 0.0199, std.dev.: 0.0007) SingleSource/Benchmarks/LivermoreLoops/kernel09: 0.52% (0.0193 => 0.0194, std.dev.: 0.0009) SingleSource/Benchmarks/LivermoreLoops/kernel10: 1.03% (0.0194 => 0.0196, std.dev.: 0.0008) SingleSource/Benchmarks/LivermoreLoops/kernel11: 1.05% (0.0191 => 0.0193, std.dev.: 0.0009) SingleSource/Benchmarks/LivermoreLoops/kernel12: 0.52% (0.0192 => 0.0193, std.dev.: 0.0007) SingleSource/Benchmarks/LivermoreLoops/kernel13: 0.51% (0.0195 => 0.0196, std.dev.: 0.0008) SingleSource/Benchmarks/LivermoreLoops/kernel14: 0.51% (0.0197 => 0.0198, std.dev.: 0.0009) SingleSource/Benchmarks/LivermoreLoops/kernel15: 0.50% (0.0201 => 0.0202, std.dev.: 0.0008) SingleSource/Benchmarks/LivermoreLoops/kernel16: 0.51% (0.0198 => 0.0199, std.dev.: 0.0010) SingleSource/Benchmarks/LivermoreLoops/kernel17: 0.51% (0.0195 => 0.0196, std.dev.: 0.0012) SingleSource/Benchmarks/LivermoreLoops/kernel18: 0.50% (0.0201 => 0.0202, std.dev.: 0.0013) SingleSource/Benchmarks/LivermoreLoops/kernel19: 0.52% (0.0193 => 0.0194, std.dev.: 0.0011) SingleSource/Benchmarks/LivermoreLoops/kernel20: 0.50% (0.0199 => 0.0200, std.dev.: 0.0011) SingleSource/Benchmarks/LivermoreLoops/kernel21: 8.29% (0.0193 => 0.0209, std.dev.: 0.0003) SingleSource/Benchmarks/LivermoreLoops/kernel22: 7.25% (0.0193 => 0.0207, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel23: 6.19% (0.0194 => 0.0206, std.dev.: 0.0010) SingleSource/Benchmarks/LivermoreLoops/kernel24: 6.77% (0.0192 => 0.0205, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 MultiSource/Applications/oggenc/oggenc: 1.64% (0.1338 => 0.1360, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0420 => 0.0420, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0652 => 0.0652, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: 0.00% (494.0197 => 494.0385, std.dev.: 0.1095) SingleSource/Benchmarks/LivermoreLoops/kernel01: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel02: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel03: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel04: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel05: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel06: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel07: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel08: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel09: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel10: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel11: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel12: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel13: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel14: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel15: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel16: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel17: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel18: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel19: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel20: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel21: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel22: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel23: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel24: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 43709.39% (1.1277 => 494.0385, std.dev.: 0.1095) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 222.47% (0.5229 => 1.6862, std.dev.: 0.0444) MultiSource/Applications/SPASS/SPASS: 21.49% (14.9895 => 18.2112, std.dev.: 0.1242) MultiSource/Applications/kimwitu++/kc: 50.94% (14.1553 => 21.3664, std.dev.: 0.0946) MultiSource/Benchmarks/MallocBench/gs/gs: 19.94% (4.1105 => 4.9300, std.dev.: 0.1762) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 50.34% (1.1048 => 1.6610, std.dev.: 0.0107) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 437.89% (7.1582 => 38.5035, std.dev.: 0.2609) SingleSource/Benchmarks/Misc-C++-EH/spirit: 75.53% (3.4629 => 6.0784, std.dev.: 0.2518) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.01% (0.6222 => 1.0329, std.dev.: 0.0728) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10772.78% (0.0720 => 7.8284, std.dev.: 0.1568) MultiSource/Applications/SIBsim4/SIBsim4: 3885800.00% (0.0001 => 3.8859, std.dev.: 0.0303) MultiSource/Applications/SPASS/SPASS: 13900100.00% (0.0001 => 13.9002, std.dev.: 1.1875) MultiSource/Applications/kimwitu++/kc: 51900.00% (0.0001 => 0.0520, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 65200.00% (0.0001 => 0.0653, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14400.00% (0.0001 => 0.0145, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576600.00% (0.0001 => 0.5767, std.dev.: 0.0187) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10098400.00% (0.0001 => 10.0985, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7565000.00% (0.0001 => 7.5651, std.dev.: 0.0596) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1815.11% (1.1194 => 21.4377, std.dev.: 0.0272) MultiSource/Applications/ClamAV/clamscan: 69.81% (22.1758 => 37.6561, std.dev.: 0.3618) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.88% (2.9384 => 4.6392, std.dev.: 0.3290) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.62% (7.0540 => 11.0479, std.dev.: 0.1292) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 51.25% (8.1363 => 12.3058, std.dev.: 0.0596) SingleSource/Benchmarks/Misc/flops: 49.44% (0.1432 => 0.2140, std.dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 48.05% (21.9371 => 32.4776, std.dev.: 0.1355) SingleSource/Benchmarks/CoyoteBench/almabench: 47.67% (0.0730 => 0.1078, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/distray/distray: 45.64% (0.1056 => 0.1538, std.dev.: 0.0002) SingleSource/UnitTests/vla: 44.51% (0.0355 => 0.0513, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/messages-2: 37.31% (0.0662 => 0.0909, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/dot-syntax-1: 34.24% (0.0479 => 0.0643, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 33.61% (0.0842 => 0.1125, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/15-trie/trie: 33.59% (0.0527 => 0.0704, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Oscar: 33.02% (0.0636 => 0.0846, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/tsp/tsp: 32.00% (0.1175 => 0.1551, std.dev.: 0.0048) MultiSource/Applications/minisat/minisat: 31.20% (0.7115 => 0.9335, std.dev.: 0.0178) SingleSource/UnitTests/ObjC/messages: 30.89% (0.0327 => 0.0428, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bisort/bisort: 29.48% (0.0614 => 0.0795, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 29.32% (0.5105 => 0.6602, std.dev.: 0.0118) SingleSource/UnitTests/ObjC/dot-syntax: 29.30% (0.0355 => 0.0459, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 28.67% (0.3603 => 0.4636, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/em3d/em3d: 28.02% (0.1695 => 0.2170, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 27.75% (0.5020 => 0.6413, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.48% (0.8172 => 1.0418, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 27.47% (0.5569 => 0.7099, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/18-imp/imp: 27.29% (0.3423 => 0.4357, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: 27.16% (0.0626 => 0.0796, std.dev.: 0.0020) SingleSource/Benchmarks/Stanford/FloatMM: 26.68% (0.0401 => 0.0508, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 26.52% (0.3865 => 0.4890, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 26.19% (0.1695 => 0.2139, std.dev.: 0.0062) MultiSource/Benchmarks/llubenchmark/llu: 26.19% (0.0462 => 0.0583, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 25.94% (0.3180 => 0.4005, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.45% (0.0770 => 0.0966, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 25.38% (0.0394 => 0.0494, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 25.01% (0.4203 => 0.5254, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 24.84% (0.0479 => 0.0598, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 24.67% (0.3307 => 0.4123, std.dev.: 0.0065) SingleSource/Benchmarks/Stanford/Towers: 24.63% (0.0471 => 0.0587, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 24.55% (0.3422 => 0.4262, std.dev.: 0.0094) SingleSource/UnitTests/ObjC/property: 24.42% (0.3886 => 0.4835, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.40% (0.0746 => 0.0928, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 24.32% (0.0481 => 0.0598, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 24.31% (0.4064 => 0.5052, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/hello: 24.13% (0.2714 => 0.3369, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.76% (1.4186 => 1.7557, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.56% (0.1337 => 0.1652, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 23.53% (0.4636 => 0.5727, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/exceptions-2: 23.48% (0.3497 => 0.4318, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 23.42% (1.3050 => 1.6106, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/ary2: 23.41% (0.3379 => 0.4170, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/bh/bh: 23.38% (0.3092 => 0.3815, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/parameter-passing: 23.38% (0.3927 => 0.4845, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/sumcol: 23.35% (0.2891 => 0.3566, std.dev.: 0.0077) MultiSource/Applications/spiff/spiff: 23.22% (0.7835 => 0.9654, std.dev.: 0.0100) SingleSource/UnitTests/ObjC/instance-method-metadata: 23.14% (0.3543 => 0.4363, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: 23.07% (0.2831 => 0.3484, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 23.06% (0.3283 => 0.4040, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/exceptions: 23.04% (0.3828 => 0.4710, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wc: 23.03% (0.3052 => 0.3755, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/except: 22.95% (0.2871 => 0.3530, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/health/health: 22.95% (0.1268 => 0.1559, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: 22.73% (0.2877 => 0.3531, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 22.69% (0.8101 => 0.9939, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/perlin: 22.57% (0.0536 => 0.0657, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 22.47% (0.0592 => 0.0725, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 22.46% (0.3232 => 0.3958, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/fibo: 22.42% (0.2725 => 0.3336, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 22.42% (14.3668 => 17.5880, std.dev.: 0.1012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 22.27% (1.5859 => 1.9391, std.dev.: 0.0742) SingleSource/UnitTests/ObjC/for-in: 22.14% (0.3694 => 0.4512, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/synchronized: 21.82% (0.3561 => 0.4338, std.dev.: 0.0087) MultiSource/Benchmarks/McCat/05-eks/eks: 21.77% (0.4299 => 0.5235, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.71% (0.3441 => 0.4188, std.dev.: 0.0099) SingleSource/UnitTests/ObjC/exceptions-3: 21.67% (0.3516 => 0.4278, std.dev.: 0.0054) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.58% (0.1566 => 0.1904, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions-4: 21.25% (0.3543 => 0.4296, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/trivial-interface: 21.25% (0.3473 => 0.4211, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 21.22% (0.0834 => 0.1011, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.91% (0.0770 => 0.0931, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.77% (0.1584 => 0.1913, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 20.73% (0.1143 => 0.1380, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 20.63% (1.1642 => 1.4044, std.dev.: 0.0497) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.31% (0.1029 => 0.1238, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.30% (0.0793 => 0.0954, std.dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: 20.28% (1.1840 => 1.4241, std.dev.: 0.0314) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.45% (4.9449 => 5.9065, std.dev.: 0.1248) MultiSource/Applications/oggenc/oggenc: 18.84% (5.7591 => 6.8440, std.dev.: 0.2423) MultiSource/Benchmarks/Prolangs-C++/city/city: 18.57% (2.0665 => 2.4502, std.dev.: 0.0607) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.49% (0.1125 => 0.1333, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: 18.33% (0.0660 => 0.0781, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.26% (1.5415 => 1.8230, std.dev.: 0.0612) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 18.02% (0.0838 => 0.0989, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.65% (0.6675 => 0.7853, std.dev.: 0.0253) MultiSource/Benchmarks/mafft/pairlocalalign: 17.52% (9.4845 => 11.1459, std.dev.: 0.2378) MultiSource/Applications/hbd/hbd: 17.48% (1.5603 => 1.8330, std.dev.: 0.0407) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.45% (0.0871 => 0.1023, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 17.36% (17.1811 => 20.1640, std.dev.: 0.1613) MultiSource/Benchmarks/Olden/mst/mst: 17.02% (0.1163 => 0.1361, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.73% (5.0018 => 5.8385, std.dev.: 0.1910) MultiSource/Applications/lua/lua: 16.48% (3.8723 => 4.5104, std.dev.: 0.1771) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.16% (0.0953 => 0.1107, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 15.89% (0.0818 => 0.0948, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.88% (0.2065 => 0.2393, std.dev.: 0.0086) MultiSource/Applications/viterbi/viterbi: 15.63% (0.1555 => 0.1798, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/ffbench: 15.60% (0.0705 => 0.0815, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.60% (4.2646 => 4.9297, std.dev.: 0.2021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.58% (0.1117 => 0.1291, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.46% (0.1940 => 0.2240, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 14.94% (3.8922 => 4.4738, std.dev.: 0.1600) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.94% (0.2758 => 0.3170, std.dev.: 0.0080) MultiSource/Benchmarks/Bullet/bullet: 14.82% (63.2438 => 72.6152, std.dev.: 0.1261) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.59% (0.5860 => 0.6715, std.dev.: 0.0072) SingleSource/UnitTests/ObjC++/Hello: 14.43% (0.5925 => 0.6780, std.dev.: 0.0286) SingleSource/UnitTests/ObjC++/property-reference-object: 14.36% (0.6030 => 0.6896, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.36% (0.3427 => 0.3919, std.dev.: 0.0112) SingleSource/Benchmarks/McGill/exptree: 14.25% (0.0814 => 0.0930, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.22% (0.1062 => 0.1213, std.dev.: 0.0056) MultiSource/Applications/sgefa/sgefa: 14.06% (0.3109 => 0.3546, std.dev.: 0.0154) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.00% (0.1236 => 0.1409, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.86% (0.5981 => 0.6810, std.dev.: 0.0183) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.42% (0.3935 => 0.4463, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 12.99% (2.2024 => 2.4885, std.dev.: 0.0624) MultiSource/Benchmarks/PAQ8p/paq8p: 12.75% (10.3673 => 11.6889, std.dev.: 0.1666) SingleSource/Benchmarks/Misc-C++/bigfib: 12.50% (0.6456 => 0.7263, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.38% (0.4879 => 0.5483, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.81% (0.8067 => 0.9020, std.dev.: 0.0104) SingleSource/Benchmarks/Stanford/Puzzle: 11.44% (0.1268 => 0.1413, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash: 11.42% (0.4289 => 0.4779, std.dev.: 0.0171) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.16% (1.1861 => 1.3185, std.dev.: 0.0436) SingleSource/Benchmarks/Shootout-C++/hash2: 10.95% (0.4620 => 0.5126, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.87% (2.2022 => 2.4415, std.dev.: 0.0484) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.78% (0.1892 => 0.2096, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/moments: 10.67% (0.4048 => 0.4480, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 10.34% (0.3684 => 0.4065, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 10.31% (0.1144 => 0.1262, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.32% (0.7326 => 0.8009, std.dev.: 0.0265) SingleSource/Benchmarks/Misc/oourafft: 9.08% (0.3282 => 0.3580, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 8.78% (0.3098 => 0.3370, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.44% (0.3177 => 0.3445, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/random: 8.32% (0.2802 => 0.3035, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.20% (0.2793 => 0.3022, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 7.66% (0.2049 => 0.2206, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 6.48% (0.3131 => 0.3334, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.39% (7.9617 => 8.4706, std.dev.: 0.1699) SingleSource/UnitTests/Vector/constpool: 5.82% (54.1659 => 57.3169, std.dev.: 0.3150) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.71% (4.3953 => 11.0196, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/methcall: 147.83% (5.3999 => 13.3826, std.dev.: 0.0030) MultiSource/Benchmarks/llubenchmark/llu: 112.12% (3.7781 => 8.0140, std.dev.: 0.4723) MultiSource/Benchmarks/McCat/09-vor/vor: 35.79% (0.1154 => 0.1567, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ary3: 28.00% (3.7221 => 4.7644, std.dev.: 0.1521) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 27.61% (13.4384 => 17.1486, std.dev.: 0.5416) SingleSource/Benchmarks/CoyoteBench/fftbench: 25.70% (2.0360 => 2.5593, std.dev.: 0.1514) SingleSource/Benchmarks/Shootout-C++/ary: 23.94% (0.0756 => 0.0937, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 22.79% (3.6994 => 4.5426, std.dev.: 0.2877) SingleSource/Benchmarks/CoyoteBench/lpbench: 22.69% (10.3460 => 12.6934, std.dev.: 0.2321) SingleSource/Benchmarks/Shootout-C++/ary2: 22.19% (0.0757 => 0.0925, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/dbms/dbms: 21.30% (1.5086 => 1.8300, std.dev.: 0.0952) SingleSource/Benchmarks/Misc/oourafft: 17.58% (6.6465 => 7.8150, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.65% (1.1145 => 1.3001, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/bisort/bisort: 15.36% (0.8333 => 0.9613, std.dev.: 0.0203) MultiSource/Benchmarks/Olden/tsp/tsp: 14.65% (1.0785 => 1.2365, std.dev.: 0.0225) MultiSource/Benchmarks/Olden/health/health: 13.86% (0.4445 => 0.5061, std.dev.: 0.0118) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.55% (0.2944 => 0.3343, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/heapsort: 13.22% (3.8526 => 4.3621, std.dev.: 0.0943) SingleSource/Benchmarks/Shootout-C++/heapsort: 12.38% (3.8532 => 4.3303, std.dev.: 0.0822) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.64% (2.8904 => 3.2267, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 10.82% (0.9505 => 1.0533, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/richards_benchmark: 10.22% (1.1396 => 1.2561, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.29% (1.7254 => 1.8857, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 7.96% (1.9405 => 2.0950, std.dev.: 0.0116) SingleSource/Benchmarks/BenchmarkGame/puzzle: 7.41% (0.6962 => 0.7478, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3688, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.02% (4.2280 => 4.4824, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.94% (0.9540 => 1.0107, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.19% (3.6395 => 3.8285, std.dev.: 0.0250) SingleSource/Regression/C/uint64_to_float: 5.10% (0.5413 => 0.5689, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.07% (11.6436 => 12.1175, std.dev.: 0.0048) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.36% (0.4162 => 0.4302, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: 3.20% (2.4116 => 2.4887, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 2.10% (85.0658 => 86.8563, std.dev.: 0.0603) MultiSource/Applications/aha/aha: 2.07% (3.1595 => 3.2249, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 2.07% (0.7455 => 0.7609, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.47% (2.3135 => 2.3475, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 1.44% (27.8444 => 28.2443, std.dev.: 0.0409) SingleSource/Benchmarks/Shootout-C++/lists: 1.41% (12.5348 => 12.7120, std.dev.: 0.0326) SingleSource/Benchmarks/Shootout-C++/sieve: 1.34% (2.4858 => 2.5192, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.33% (6.5088 => 6.5956, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/sieve: 1.30% (5.2139 => 5.2818, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 1.30% (2.2771 => 2.3066, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 1.19% (5.9798 => 6.0507, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.35% (6.6874 => 0.1771, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/salsa20: -75.49% (0.8651 => 0.2120, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.05% (5.2763 => 1.3167, std.dev.: 0.0326) SingleSource/Benchmarks/Misc/richards_benchmark: -44.76% (0.1622 => 0.0896, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.83% (5.3855 => 4.6945, std.dev.: 0.0867) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.18% (5.3526 => 4.7007, std.dev.: 0.1547) MultiSource/Applications/JM/ldecod/ldecod: -9.77% (10.4361 => 9.4166, std.dev.: 0.3031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.06% (0.3987 => 0.2390, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.27% (4.5009 => 2.7783, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -33.52% (1.1492 => 0.7640, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -27.86% (10.7105 => 7.7262, std.dev.: 0.5966) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.14% (2.6546 => 2.0139, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: -19.20% (0.2161 => 0.1746, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4235, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.69% (2.6778 => 2.2843, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.65% (32.5116 => 29.0502, std.dev.: 0.0165) MultiSource/Benchmarks/NPB-serial/is/is: -10.53% (9.5636 => 8.5566, std.dev.: 0.2273) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4244, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.94% (4.8142 => 4.4803, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.67% (3.2416 => 3.0254, std.dev.: 0.0179) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7497, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.22% (1.8329 => 1.7373, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.85% (1.5835 => 1.5067, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.65% (1.6805 => 1.6023, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout/lists: -4.27% (6.2999 => 6.0310, std.dev.: 0.0051) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8911, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.00% (19.9488 => 19.3510, std.dev.: 0.0743) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.85% (0.9957 => 0.9673, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.31% (0.4808 => 0.4697) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.79% (8.1563 => 8.0104, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6770, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -1.45% (10.2830 => 10.1340, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.42% (0.1485 => 0.1360, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0021) Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 19:14:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 21:14:45 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121118031445.CBEE72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5990?compare_to=5987&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5990, Order: 168277, Start Time: 2012-11-18 01:41:35, End Time: 2012-11-18 03:15:06 To: 5987, Order: 168274, Start Time: 2012-11-17 23:28:44, End Time: 2012-11-18 01:05:39 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 1 (80 on baseline) Performance Improvements: 31 (25 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1022 (869 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 9.96% (19.7297 => 21.6938, std.dev.: 0.7197) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -16.10% (0.0770 => 0.0646, std.dev.: 0.0008) SingleSource/Benchmarks/LivermoreLoops/kernel23: -10.30% (0.1340 => 0.1202, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -9.67% (0.1210 => 0.1093, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -8.98% (0.2518 => 0.2292, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.94% (0.8800 => 0.8277, std.dev.: 0.0185) MultiSource/Applications/spiff/spiff: -4.47% (0.8685 => 0.8297, std.dev.: 0.0046) MultiSource/Applications/Burg/burg: -2.55% (1.3084 => 1.2750, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.14% (1.1659 => 1.1409, std.dev.: 0.0067) MultiSource/Applications/SIBsim4/SIBsim4: -2.09% (1.3231 => 1.2955, std.dev.: 0.0092) MultiSource/Applications/SPASS/SPASS: -1.97% (14.9849 => 14.6901, std.dev.: 0.0920) MultiSource/Applications/d/make_dparser: -1.83% (3.3788 => 3.3170, std.dev.: 0.0025) MultiSource/Applications/siod/siod: -1.57% (2.3169 => 2.2806, std.dev.: 0.0044) MultiSource/Applications/lemon/lemon: -1.52% (1.1303 => 1.1131, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.42% (4.6846 => 4.6182, std.dev.: 0.0255) MultiSource/Applications/oggenc/oggenc: -1.31% (5.1307 => 5.0633, std.dev.: 0.0105) MultiSource/Applications/JM/ldecod/ldecod: -1.24% (6.9565 => 6.8699, std.dev.: 0.0320) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.21% (0.9401 => 0.9287, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -13.51% (51.4431 => 44.4948, std.dev.: 1.1154) MultiSource/Applications/SPASS/SPASS: -6.29% (8.9960 => 8.4300, std.dev.: 0.0588) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.89% (23.0674 => 21.7086, std.dev.: 0.5124) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.69% (2.5759 => 2.4293, std.dev.: 0.0271) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.74% (40.7059 => 39.1833, std.dev.: 0.1462) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.34% (42.4624 => 41.0450, std.dev.: 0.2465) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -3.16% (4.1405 => 4.0096, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -2.64% (1.2824 => 1.2486, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/mason/mason: -2.59% (0.5401 => 0.5261, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.42% (2.6892 => 2.6241, std.dev.: 0.0184) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.21% (3.2139 => 3.1428, std.dev.: 0.0180) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -2.06% (5.0442 => 4.9402, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.98% (2.9757 => 2.9169, std.dev.: 0.0157) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.40% (61.9320 => 61.0654, std.dev.: 0.1776) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -2.09% (1.0701 => 1.0477, std.dev.: 0.0112) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0218 => 0.0218, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -13.82% (0.0427 => 0.0368, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.60% (0.0334 => 0.0332, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.64% (0.0313 => 0.0315, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.41% (0.0425 => 0.0419, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: -8.91% (0.0202 => 0.0184, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/test1: -3.70% (0.0216 => 0.0208, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -84.62% (0.0013 => 0.0002, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -0.81% (0.1487 => 0.1475, std.dev.: 0.0032) MultiSource/Applications/lemon/lemon: -7.21% (1.2384 => 1.1491, std.dev.: 0.0405) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.67% (0.4195 => 0.4223, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.48% (0.1421 => 0.1400, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.18% (0.0613 => 0.0657, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.17% (0.0277 => 0.0271, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.17% (0.0600 => 0.0563, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.04% (1.1979 => 1.1855, std.dev.: 0.0157) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -95.65% (0.0023 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 200.00% (0.0007 => 0.0021, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.91% (0.0651 => 0.0593, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.03% (0.0262 => 0.0220, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.20% (0.7813 => 0.7797, std.dev.: 0.0365) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -38.61% (0.0101 => 0.0062, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.36% (16.4461 => 17.6558, std.dev.: 0.0849) MultiSource/Applications/sqlite3/sqlite3: 2311.94% (0.6332 => 15.2724, std.dev.: 0.1386) MultiSource/Benchmarks/McCat/08-main/main: 47.02% (0.1831 => 0.2692, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.41% (0.1559 => 0.1459, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7094.94% (0.3123 => 22.4698, std.dev.: 0.9923) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.89% (0.2463 => 0.3741, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1522.91% (0.3344 => 5.4270, std.dev.: 0.2664) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.87% (0.2364 => 0.3283, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/bigfib: 4.26% (0.6010 => 0.6266, std.dev.: 0.0517) SingleSource/Benchmarks/Misc/mandel: -0.70% (0.0429 => 0.0426, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.3266 => 0.3426, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 3.40% (0.1969 => 0.2036, std.dev.: 0.0044) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.34% (0.0224 => 0.0227, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0453, std.dev.: 0.0030) MultiSource/Applications/oggenc/oggenc: 5.95% (0.1462 => 0.1549, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4630, std.dev.: 0.0207) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0693, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4954, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5062, std.dev.: 0.0207) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5617, std.dev.: 0.2492) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3156, std.dev.: 0.0365) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1423, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3632, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4030, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0880, std.dev.: 0.0124) SingleSource/Regression/C/uint64_to_float: -24.34% (2.1832 => 1.6518, std.dev.: 0.0103) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 12.47% (0.0810 => 0.0911, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.26% (0.0848 => 0.0952, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 11.69% (0.1112 => 0.1242, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.92% (0.1301 => 0.1417, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.73% (0.2279 => 0.2478, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.24% (0.2998 => 0.3185, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.84% (0.1885 => 0.1995, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.14% (0.2180 => 0.2292, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.04% (0.1983 => 0.2083, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: 4.36% (0.7950 => 0.8297, std.dev.: 0.0046) MultiSource/Applications/Burg/burg: 4.32% (1.2222 => 1.2750, std.dev.: 0.0103) MultiSource/Applications/sgefa/sgefa: 3.97% (0.2999 => 0.3118, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.64% (0.3657 => 0.3790, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.56% (0.4127 => 0.4274, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.44% (0.9908 => 1.0249, std.dev.: 0.0077) MultiSource/Applications/lua/lua: 3.40% (3.8189 => 3.9489, std.dev.: 0.0172) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.35% (1.6386 => 1.6935, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 3.08% (1.2568 => 1.2955, std.dev.: 0.0092) MultiSource/Applications/SPASS/SPASS: 3.01% (14.2605 => 14.6901, std.dev.: 0.0920) MultiSource/Benchmarks/nbench/nbench: 2.92% (1.1271 => 1.1600, std.dev.: 0.0064) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.92% (6.6074 => 6.8002, std.dev.: 0.0330) MultiSource/Applications/treecc/treecc: 2.90% (1.9948 => 2.0527, std.dev.: 0.0144) MultiSource/Applications/siod/siod: 2.80% (2.2184 => 2.2806, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.80% (0.8007 => 0.8231, std.dev.: 0.0061) MultiSource/Applications/minisat/minisat: 2.79% (0.6834 => 0.7025, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.77% (0.3717 => 0.3820, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.75% (4.1763 => 4.2910, std.dev.: 0.0287) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.72% (0.9074 => 0.9321, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.66% (4.4873 => 4.6066, std.dev.: 0.0231) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.55% (0.9056 => 0.9287, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.50% (0.9810 => 1.0055, std.dev.: 0.0083) MultiSource/Applications/d/make_dparser: 2.48% (3.2366 => 3.3170, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.43% (0.8611 => 0.8820, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.35% (0.8457 => 0.8656, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.34% (0.8716 => 0.8920, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.23% (0.9688 => 0.9904, std.dev.: 0.0037) MultiSource/Applications/ClamAV/clamscan: 2.19% (14.7684 => 15.0917, std.dev.: 0.1104) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.14% (1.1170 => 1.1409, std.dev.: 0.0067) MultiSource/Applications/JM/ldecod/ldecod: 2.05% (6.7320 => 6.8699, std.dev.: 0.0320) MultiSource/Applications/oggenc/oggenc: 2.03% (4.9628 => 5.0633, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.97% (0.8066 => 0.8225, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.90% (0.8316 => 0.8474, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 1.89% (15.3280 => 15.6182, std.dev.: 0.0926) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.74% (0.8338 => 0.8483, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.70% (1.0945 => 1.1131, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.23% (0.8995 => 0.9106, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 110.05% (0.0199 => 0.0418, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/pi: 58.99% (1.5795 => 2.5113, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.35% (0.7597 => 0.8915, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.47% (2.9753 => 3.4653, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.71% (2.7995 => 3.2114, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.80% (5.0261 => 5.6194, std.dev.: 0.0200) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.73% (0.3186 => 0.3496, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.09% (1.1857 => 1.2816, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 7.50% (1.7056 => 1.8336, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.77% (4.7794 => 5.1029, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.92% (4.9686 => 5.2628, std.dev.: 0.0776) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.82% (4.5327 => 4.7965, std.dev.: 0.0058) MultiSource/Applications/SIBsim4/SIBsim4: 5.62% (3.1873 => 3.3664, std.dev.: 0.0284) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.83% (6.2275 => 6.5282, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.70% (3.3761 => 3.5348, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.28% (4.9469 => 5.1586, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.19% (4.9453 => 5.1525, std.dev.: 0.0053) MultiSource/Applications/lambda-0_1_3/lambda: 4.19% (7.4933 => 7.8070, std.dev.: 0.1024) MultiSource/Applications/hexxagon/hexxagon: 3.92% (14.0064 => 14.5550, std.dev.: 0.0097) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.55% (1.2337 => 1.2775, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.04% (59.2638 => 61.0654, std.dev.: 0.1776) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.91% (11.5690 => 11.9058, std.dev.: 0.0079) MultiSource/Applications/siod/siod: 2.85% (3.6643 => 3.7689, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.51% (4.8660 => 4.9879, std.dev.: 0.0369) SingleSource/Benchmarks/Shootout/lists: 2.48% (7.3375 => 7.5198, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.18% (1.1365 => 1.1613, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.15% (4.8362 => 4.9402, std.dev.: 0.0108) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.86% (2.5763 => 2.6241, std.dev.: 0.0184) MultiSource/Benchmarks/Olden/power/power: 1.49% (1.2061 => 1.2241, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.22% (3.5679 => 3.6115, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/ReedSolomon: 1.17% (8.5322 => 8.6320, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.07% (1.5941 => 1.6111, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/neural/neural: 1.04% (1.0841 => 1.0954, std.dev.: 0.0015) MultiSource/Benchmarks/llubenchmark/llu: 1.04% (1.9967 => 2.0175, std.dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.19% (5.4641 => 4.3063, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.62% (7.2130 => 6.3029, std.dev.: 0.2256) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.87% (1.0512 => 0.9369, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.19% (14.6451 => 13.2999, std.dev.: 0.1725) MultiSource/Benchmarks/mafft/pairlocalalign: -8.29% (63.1822 => 57.9439, std.dev.: 0.7564) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.05% (0.3269 => 0.3006, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -7.07% (4.7482 => 4.4127, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.63% (5.4972 => 5.1879, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.40% (3.7148 => 3.5142, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.97% (5.1557 => 4.8995, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.68% (6.0224 => 5.8010, std.dev.: 0.0718) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.29% (2.8773 => 2.7826, std.dev.: 0.0326) MultiSource/Applications/lua/lua: -3.23% (29.8330 => 28.8695, std.dev.: 0.0525) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (28.5821 => 27.7019, std.dev.: 0.0290) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.00% (0.5807 => 0.5633, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/mason/mason: -2.84% (0.5415 => 0.5261, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.64% (2.6356 => 2.5660, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/bisort/bisort: -2.59% (0.6636 => 0.6464, std.dev.: 0.0032) MultiSource/Applications/aha/aha: -2.50% (3.3398 => 3.2564, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.30% (3.2169 => 3.1428, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.28% (9.9065 => 9.6803, std.dev.: 0.0285) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.25% (1.2822 => 1.2534, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hash2: -2.17% (3.4237 => 3.3493, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.01% (11.5316 => 11.3002, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.45% (4.9994 => 4.9268, std.dev.: 0.0082) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.10% (1.0262 => 1.0477, std.dev.: 0.0112) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.80% (0.0408 => 0.0368, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.11% (0.0384 => 0.0419, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: -3.16% (0.0190 => 0.0184, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/test1: 15.56% (0.0180 => 0.0208, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -71.43% (0.0007 => 0.0002, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 2.57% (0.1438 => 0.1475, std.dev.: 0.0032) MultiSource/Applications/lemon/lemon: 1.43% (1.1329 => 1.1491, std.dev.: 0.0405) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.42% (0.4164 => 0.4223, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.26% (0.1369 => 0.1400, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.50% (0.0641 => 0.0657, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 38.97% (0.0195 => 0.0271, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.60% (0.0578 => 0.0563, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.65% (1.1437 => 1.1855, std.dev.: 0.0157) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0014 => 0.0021, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.42% (0.0627 => 0.0593, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.22% (0.0180 => 0.0220, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.74% (0.8017 => 0.7797, std.dev.: 0.0365) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0062 => 0.0062, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 19:14:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 21:14:53 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121118031453.E2F942A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5991?compare_to=5988&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5991, Order: 168277, Start Time: 2012-11-18 01:42:27, End Time: 2012-11-18 03:15:10 To: 5988, Order: 168274, Start Time: 2012-11-17 23:46:58, End Time: 2012-11-18 01:19:43 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== New Failures: 0 (48 on baseline) Performance Regressions: 2 (5 on baseline) Performance Improvements: 2 (177 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 48 (0 on baseline) Unchanged Tests: 1040 (860 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 9.85% (0.3716 => 0.4082, std.dev.: 0.0133) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.81% (54.5546 => 56.6324, std.dev.: 0.2997) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.71% (80.6114 => 78.4291, std.dev.: 0.7727) MultiSource/Benchmarks/llubenchmark/llu: -1.51% (3.8138 => 3.7562, std.dev.: 0.0196) Existing Failures - Compile Time -------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/LivermoreLoops/kernel01: - (0.0176 => 0.0176, std.dev.: 0.0009) SingleSource/Benchmarks/LivermoreLoops/kernel02: 0.57% (0.0175 => 0.0176) SingleSource/Benchmarks/LivermoreLoops/kernel03: - (0.0175 => 0.0175) SingleSource/Benchmarks/LivermoreLoops/kernel04: - (0.0176 => 0.0176) SingleSource/Benchmarks/LivermoreLoops/kernel05: - (0.0175 => 0.0175) SingleSource/Benchmarks/LivermoreLoops/kernel06: - (0.0175 => 0.0175, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel07: - (0.0176 => 0.0176, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel08: - (0.0180 => 0.0180, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel09: - (0.0176 => 0.0176, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel10: - (0.0177 => 0.0177, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel11: - (0.0175 => 0.0175, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel12: - (0.0175 => 0.0175, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel13: - (0.0178 => 0.0178) SingleSource/Benchmarks/LivermoreLoops/kernel14: - (0.0179 => 0.0179, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel15: - (0.0183 => 0.0183, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel16: - (0.0180 => 0.0180, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel17: 0.56% (0.0177 => 0.0178) SingleSource/Benchmarks/LivermoreLoops/kernel18: 0.55% (0.0182 => 0.0183) SingleSource/Benchmarks/LivermoreLoops/kernel19: - (0.0176 => 0.0176, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel20: - (0.0177 => 0.0177) SingleSource/Benchmarks/LivermoreLoops/kernel21: 0.57% (0.0175 => 0.0176, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel22: - (0.0176 => 0.0176, std.dev.: 0.0004) SingleSource/Benchmarks/LivermoreLoops/kernel23: 0.57% (0.0176 => 0.0177, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel24: - (0.0175 => 0.0175, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/LivermoreLoops/kernel01: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel02: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel03: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel04: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel05: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel06: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel07: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel08: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel09: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel10: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel11: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel12: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel13: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel14: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel15: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel16: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel17: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel18: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel19: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel20: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel21: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel22: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel23: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel24: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 New Failures - Execution Time ----------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.77% (54.5751 => 56.6324, std.dev.: 0.2997) SingleSource/Benchmarks/Misc/salsa20: 2.59% (7.4937 => 7.6875, std.dev.: 0.0155) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.57% (2.0478 => 2.1005, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/hash2: 2.20% (3.1932 => 3.2633, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.22% (0.3821 => 0.3507, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -6.82% (2.4924 => 2.3225, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.59% (0.3142 => 0.2935, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -6.55% (0.3357 => 0.3137, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.50% (0.9542 => 0.8922, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -6.30% (0.2160 => 0.2024, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.18% (0.2428 => 0.2278, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.14% (0.9852 => 0.9247, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -6.13% (9.2283 => 8.6629, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.11% (0.7198 => 0.6758, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.07% (0.1796 => 0.1687, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -6.01% (16.1920 => 15.2189, std.dev.: 0.0157) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: -5.90% (7.0961 => 6.6775, std.dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.85% (0.6484 => 0.6105, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: -5.81% (0.9179 => 0.8646, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.73% (1.0544 => 0.9940, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.71% (1.3722 => 1.2938, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.68% (0.2695 => 0.2542, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.64% (3.5339 => 3.3346, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.63% (0.3658 => 0.3452, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.61% (0.2355 => 0.2223, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.58% (4.0323 => 3.8071, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.57% (0.6681 => 0.6309, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -5.55% (1.1450 => 1.0814, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.55% (4.8161 => 4.5489, std.dev.: 0.0046) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.54% (6.7716 => 6.3966, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.53% (4.8802 => 4.6102, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.52% (0.6736 => 0.6364, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.51% (1.2300 => 1.1622, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.50% (1.4642 => 1.3837, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: -5.49% (0.3406 => 0.3219, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.47% (0.5591 => 0.5285, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.46% (0.6230 => 0.5890, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.45% (0.6052 => 0.5722, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -5.45% (4.3330 => 4.0970, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.44% (0.5805 => 0.5489, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.44% (0.5863 => 0.5544, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.44% (4.5069 => 4.2618, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.40% (0.5857 => 0.5541, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.38% (0.5802 => 0.5490, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.38% (0.5859 => 0.5544, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.37% (0.6260 => 0.5924, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.35% (1.6364 => 1.5488, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.35% (0.6660 => 0.6304, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.33% (0.5478 => 0.5186, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: -5.33% (1.1530 => 1.0916, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.30% (0.7524 => 0.7125, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.29% (0.6667 => 0.6314, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: -5.29% (0.4515 => 0.4276, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.29% (0.5575 => 0.5280, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.28% (1.3864 => 1.3132, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.26% (0.5705 => 0.5405, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.25% (0.7919 => 0.7503, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.25% (1.2784 => 1.2113, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.24% (0.6676 => 0.6326, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.24% (0.6395 => 0.6060, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.23% (0.5925 => 0.5615, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.23% (0.3483 => 0.3301, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.20% (0.5688 => 0.5392, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.20% (0.5849 => 0.5545, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.15% (0.5941 => 0.5635, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.15% (0.6293 => 0.5969, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.15% (1.2221 => 1.1592, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.14% (0.7339 => 0.6962, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -5.12% (17.1032 => 16.2267, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.12% (0.5569 => 0.5284, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -5.11% (1.2515 => 1.1875, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.11% (0.5456 => 0.5177, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.11% (1.2210 => 1.1586, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.10% (0.2548 => 0.2418, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.09% (0.8521 => 0.8087, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.09% (0.5581 => 0.5297, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.08% (0.6395 => 0.6070, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.04% (0.4916 => 0.4668, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.04% (0.6446 => 0.6121, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.03% (0.5567 => 0.5287, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: -5.00% (0.2659 => 0.2526, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.99% (14.2083 => 13.4996, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.98% (0.6440 => 0.6119, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.97% (0.5999 => 0.5701, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.94% (0.6033 => 0.5735, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.92% (0.5570 => 0.5296, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.92% (8.0126 => 7.6185, std.dev.: 0.0052) MultiSource/Applications/d/make_dparser: -4.89% (3.5154 => 3.3434, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.89% (1.6474 => 1.5668, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.87% (0.2999 => 0.2853, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.85% (0.3319 => 0.3158, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.83% (0.3812 => 0.3628, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.80% (0.5168 => 0.4920, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -4.79% (0.7447 => 0.7090, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -4.76% (15.5079 => 14.7700, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions: -4.74% (0.4176 => 0.3978, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -4.72% (4.0594 => 3.8676, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/for-in: -4.71% (0.4033 => 0.3843, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.70% (0.2385 => 0.2273, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.68% (0.3848 => 0.3668, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.65% (0.3896 => 0.3715, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.64% (0.3880 => 0.3700, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -4.61% (0.3581 => 0.3416, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.60% (0.6194 => 0.5909, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.60% (0.3891 => 0.3712, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -4.59% (15.2527 => 14.5519, std.dev.: 0.0081) SingleSource/UnitTests/ObjC/exceptions-2: -4.57% (0.3831 => 0.3656, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.56% (0.5329 => 0.5086, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -4.56% (0.2985 => 0.2849, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -4.53% (2.4021 => 2.2933, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.51% (0.6297 => 0.6013, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.50% (0.7021 => 0.6705, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -4.47% (2.1401 => 2.0445, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: -4.45% (0.4199 => 0.4012, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.43% (22.4056 => 21.4132, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.43% (0.6304 => 0.6025, std.dev.: 0.0066) MultiSource/Applications/oggenc/oggenc: -4.38% (5.0226 => 4.8028, std.dev.: 0.0139) MultiSource/Applications/lambda-0_1_3/lambda: -4.37% (0.7982 => 0.7633, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.35% (0.6189 => 0.5920, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.33% (2.2587 => 2.1608, std.dev.: 0.0074) MultiSource/Applications/hexxagon/hexxagon: -4.32% (1.3148 => 1.2580, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: -4.31% (0.3271 => 0.3130, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -4.27% (34.0927 => 32.6373, std.dev.: 0.0095) SingleSource/UnitTests/ObjC/parameter-passing: -4.18% (0.4280 => 0.4101, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.17% (0.3884 => 0.3722, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.12% (0.4151 => 0.3980, std.dev.: 0.0044) MultiSource/Applications/spiff/spiff: -4.11% (0.8418 => 0.8072, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: -4.08% (18.2933 => 17.5466, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.04% (0.9077 => 0.8710, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.96% (0.3837 => 0.3685, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.93% (0.9557 => 0.9181, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -3.93% (0.3025 => 0.2906, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -3.89% (0.4861 => 0.4672, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -3.87% (0.3255 => 0.3129, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.87% (0.3931 => 0.3779, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -3.84% (0.4248 => 0.4085, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.82% (0.3323 => 0.3196, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.74% (0.3849 => 0.3705, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -3.73% (0.3059 => 0.2945, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -3.72% (0.3867 => 0.3723, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.72% (0.3252 => 0.3131, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.70% (2.1713 => 2.0909, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.70% (0.4321 => 0.4161, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -3.70% (0.3026 => 0.2914, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.68% (0.3016 => 0.2905, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: -3.66% (0.3194 => 0.3077, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.60% (0.3057 => 0.2947, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.57% (0.4813 => 0.4641, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -3.56% (0.6347 => 0.6121, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -3.55% (0.2989 => 0.2883, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.55% (0.2933 => 0.2829, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -3.51% (0.3446 => 0.3325, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -3.51% (0.3621 => 0.3494, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.48% (0.2903 => 0.2802, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -3.48% (0.6441 => 0.6217, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -3.47% (0.2939 => 0.2837, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.47% (0.3491 => 0.3370, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.43% (0.4427 => 0.4275, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -3.42% (0.3481 => 0.3362) SingleSource/Benchmarks/Shootout-C++/ary: -3.39% (0.3394 => 0.3279, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -3.34% (0.7779 => 0.7519, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.28% (0.4083 => 0.3949, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -3.21% (0.6750 => 0.6533, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -3.21% (0.3205 => 0.3102, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -3.17% (0.3788 => 0.3668, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.15% (5.4682 => 5.2958, std.dev.: 0.0108) MultiSource/Applications/hbd/hbd: -3.13% (1.5610 => 1.5122, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -2.90% (0.4524 => 0.4393, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.44% (20.7746 => 20.2678, std.dev.: 0.0110) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7511, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fbench: -4.06% (2.2633 => 2.1713, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.07% (1.3096 => 1.2694, std.dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.48% (6.5735 => 6.4759, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Report Time: 3.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 19:21:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 21:21:23 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121118032123.3B6442A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5992?compare_to=5984&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5992, Order: 168274, Start Time: 2012-11-18 00:01:45, End Time: 2012-11-18 03:21:44 To: 5984, Order: 168263, Start Time: 2012-11-17 19:54:01, End Time: 2012-11-17 23:13:58 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 48 (48 on baseline) Performance Regressions: 0 (170 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (136 on baseline) Unchanged Tests: 1044 (720 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 New Failures - Execution Time ----------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 New Failures - Execution Time ----------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.36% (0.0625 => 0.0871, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.33% (0.1063 => 0.1396, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.47% (0.0714 => 0.0903, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.80% (0.2969 => 0.3735, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.32% (0.1106 => 0.1386, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.69% (0.4139 => 0.5161, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.41% (0.4253 => 0.5291, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.86% (0.5900 => 0.7308, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.29% (0.0584 => 0.0720, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.23% (0.4994 => 0.6154, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.21% (0.1620 => 0.1996, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 23.09% (1.5932 => 1.9611, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.72% (0.5000 => 0.6136, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.30% (0.0897 => 0.1097, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 22.04% (0.0599 => 0.0731, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.94% (0.1021 => 0.1245, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.14% (0.1107 => 0.1341, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 20.99% (0.0948 => 0.1147, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.72% (0.0584 => 0.0705, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.58% (0.1103 => 0.1330) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.38% (0.0633 => 0.0762, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.25% (0.0642 => 0.0772, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.24% (0.1003 => 0.1206, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.16% (0.3903 => 0.4690, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724) MultiSource/Benchmarks/Olden/health/health: 19.85% (0.0821 => 0.0984, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.83% (0.0822 => 0.0985, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.83% (0.1604 => 0.1922, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.75% (0.1549 => 0.1855, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 19.52% (0.1619 => 0.1935, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 19.06% (0.0808 => 0.0962, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.02% (0.1462 => 0.1740, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 18.90% (0.0947 => 0.1126, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 18.52% (0.4029 => 0.4775, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.51% (0.3890 => 0.4610, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.22% (0.2014 => 0.2381, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 18.14% (0.1218 => 0.1439, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.02% (0.2736 => 0.3229, std.dev.: 0.0051) MultiSource/Applications/Burg/burg: 18.01% (0.5546 => 0.6545, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/mst/mst: 17.91% (0.0698 => 0.0823, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 17.74% (0.1505 => 0.1772, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.73% (0.5026 => 0.5917, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.69% (0.2866 => 0.3373, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.65% (0.1088 => 0.1280, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.60% (1.3152 => 1.5467, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: 17.52% (0.5826 => 0.6847, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.23% (0.1968 => 0.2307, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 17.22% (0.5889 => 0.6903, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 17.21% (1.8794 => 2.2029, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.02% (0.4658 => 0.5451, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.79% (3.5627 => 4.1609, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.64% (1.6211 => 1.8908, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.63% (0.3271 => 0.3815, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.63% (0.2875 => 0.3353, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.47% (0.1160 => 0.1351, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 16.37% (0.7171 => 0.8345, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.29% (0.2738 => 0.3184) MultiSource/Applications/hbd/hbd: 16.24% (0.9697 => 1.1272, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 16.19% (0.1421 => 0.1651, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.03% (0.3930 => 0.4560, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: 15.97% (0.1284 => 0.1489, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.94% (0.4361 => 0.5056, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 15.85% (0.2750 => 0.3186, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 15.79% (0.2780 => 0.3219, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 15.74% (1.0781 => 1.2478, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: 15.66% (0.2714 => 0.3139, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.65% (0.2729 => 0.3156, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.65% (4.4195 => 5.1110, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/fibo: 15.63% (0.2725 => 0.3151, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 15.60% (4.2109 => 4.8680, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.56% (0.3195 => 0.3692, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 15.55% (0.2803 => 0.3239, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 15.52% (0.2823 => 0.3261, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 15.47% (0.2811 => 0.3246, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.47% (2.7292 => 3.1514, std.dev.: 0.0020) SingleSource/Regression/C++/ofstream_ctor: 15.41% (0.3004 => 0.3467, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.37% (0.2792 => 0.3221, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 15.29% (0.2813 => 0.3243, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 15.15% (0.9909 => 1.1410, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.15% (1.9694 => 2.2677, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.12% (1.9966 => 2.2985, std.dev.: 0.0069) MultiSource/Benchmarks/Bullet/bullet: 15.12% (23.5202 => 27.0753, std.dev.: 0.0201) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.12% (0.2911 => 0.3351, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 15.08% (0.3096 => 0.3563, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.01% (2.0673 => 2.3775, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: 14.97% (0.3267 => 0.3756, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.95% (0.1090 => 0.1253, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 14.95% (0.3317 => 0.3813, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 14.76% (0.3258 => 0.3739, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 14.73% (0.2566 => 0.2944, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 14.49% (0.2691 => 0.3081, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.42% (0.3488 => 0.3991, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 14.39% (1.4269 => 1.6323, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 14.34% (0.3348 => 0.3828, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: 14.27% (0.3678 => 0.4203, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 14.22% (0.2075 => 0.2370, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.22% (0.3060 => 0.3495, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.19% (0.3362 => 0.3839, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.12% (0.3124 => 0.3565, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/exceptions-2: 14.10% (0.3446 => 0.3932, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 14.04% (0.7875 => 0.8981, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 13.98% (0.3477 => 0.3963, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.94% (0.3465 => 0.3948, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.93% (0.3460 => 0.3942, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 13.93% (0.3726 => 0.4245, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 13.90% (0.3496 => 0.3982, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 13.87% (0.3469 => 0.3950, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.86% (0.3282 => 0.3737, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 13.77% (0.3442 => 0.3916, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.71% (0.3625 => 0.4122, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 13.60% (0.4146 => 0.4710, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: 13.48% (0.3643 => 0.4134, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.46% (0.3981 => 0.4517, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 13.45% (0.3650 => 0.4141, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.39% (0.3690 => 0.4184, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 13.39% (0.4251 => 0.4820, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.32% (0.3845 => 0.4357, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 13.24% (2.1653 => 2.4520, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 13.21% (0.3724 => 0.4216, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 12.91% (2.1013 => 2.3725, std.dev.: 0.0053) MultiSource/Applications/JM/lencod/lencod: 12.85% (4.6177 => 5.2109, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++/bigfib: 12.71% (0.5012 => 0.5649, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 12.44% (5.5417 => 6.2313, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.16% (0.2040 => 0.2288, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.08% (0.1383 => 0.1550, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 12.01% (0.3498 => 0.3918, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.77% (0.1028 => 0.1149, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.62% (0.6435 => 0.7183, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 11.49% (0.6634 => 0.7396, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.29% (0.2737 => 0.3046, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.22% (0.2068 => 0.2300, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 11.18% (0.4847 => 0.5389, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.96% (0.3084 => 0.3422, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.61% (0.3336 => 0.3690, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.41% (0.2103 => 0.2322, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 10.23% (2.0346 => 2.2427, std.dev.: 0.0086) MultiSource/Applications/lemon/lemon: 9.87% (0.2391 => 0.2627, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.08% (4.6926 => 5.1185, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.01% (0.5361 => 0.5844, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.82% (11.6398 => 12.6670, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.52% (0.5584 => 0.6060, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.40% (0.7426 => 0.8050, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 6.93% (11.9555 => 12.7843, std.dev.: 0.0116) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.48% (0.3792 => 0.3962, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.94% (0.0734 => 0.0873, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0294, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 9.35% (0.2802 => 0.3064, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6109, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.04% (0.3693 => 0.3916, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.24% (12.0509 => 12.6821, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 4.76% (0.2122 => 0.2223, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 4.76% (15.4430 => 16.1776, std.dev.: 0.0269) SingleSource/Benchmarks/Misc/flops-2: 4.74% (1.8057 => 1.8912, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/dry: 4.28% (14.0481 => 14.6499, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1949, std.dev.: 0.0073) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2246, std.dev.: 0.0020) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3050, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2877, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5140, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5949, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.61% (2.4764 => 2.4366, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.89% (25.4195 => 16.5516, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/ary2: -10.03% (0.2402 => 0.2161, std.dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9781, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7932, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9571, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8049, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0056) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5184, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -2.33% (17.2379 => 16.8361, std.dev.: 0.0388) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8651, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.67% (10.7630 => 10.5829, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4960, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1606, std.dev.: 0.0273) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0452, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 21:01:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 23:01:46 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121118050146.1C41F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5993?compare_to=5990&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5993, Order: 168278, Start Time: 2012-11-18 03:31:53, End Time: 2012-11-18 05:02:08 To: 5990, Order: 168277, Start Time: 2012-11-18 01:41:35, End Time: 2012-11-18 03:15:06 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 19 (130 on baseline) Performance Improvements: 2 (27 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1033 (817 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.29% (0.2156 => 0.2270, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.03% (0.8277 => 0.8693, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.83% (0.4951 => 0.5190, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.47% (0.6173 => 0.6449, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.83% (1.1918 => 1.2255, std.dev.: 0.0081) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.58% (0.8801 => 0.9028, std.dev.: 0.0044) MultiSource/Applications/hbd/hbd: 2.50% (1.4654 => 1.5020, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.23% (0.7889 => 0.8065, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/gs/gs: 2.13% (4.1873 => 4.2763, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.74% (0.6334 => 0.6444, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: 1.71% (1.2750 => 1.2968, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.35% (0.9703 => 0.9834, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.30% (8.7517 => 8.8651, std.dev.: 0.0215) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.17% (4.6182 => 4.6722, std.dev.: 0.0102) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.09% (4.5345 => 4.5838, std.dev.: 0.0072) MultiSource/Applications/lua/lua: 1.07% (3.9489 => 3.9911, std.dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: 1.01% (15.0917 => 15.2447, std.dev.: 0.0274) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel24: 50.92% (0.3305 => 0.4988, std.dev.: 0.0480) SingleSource/Benchmarks/Shootout/nestedloop: 9.44% (0.1981 => 0.2168, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.87% (61.0654 => 59.9248, std.dev.: 0.1961) MultiSource/Benchmarks/llubenchmark/llu: -1.25% (2.0175 => 1.9922, std.dev.: 0.0029) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.03% (1.0477 => 1.0690, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -16.51% (0.0218 => 0.0182, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 12.50% (0.0368 => 0.0414, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0332 => 0.0332, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -10.16% (0.0315 => 0.0283, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -14.32% (0.0419 => 0.0359, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/casts: 9.78% (0.0184 => 0.0202, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 3.85% (0.0208 => 0.0216, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 50.00% (0.0002 => 0.0003, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1475 => 0.1477, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.14% (1.1491 => 1.1622, std.dev.: 0.0327) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.42% (0.4223 => 0.4283, std.dev.: 0.0370) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.86% (0.1400 => 0.1374, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.91% (0.0657 => 0.0605, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.17% (0.0271 => 0.0257, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.82% (0.0563 => 0.0607, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.76% (1.1855 => 1.1945, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 700.00% (0.0001 => 0.0008, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -85.71% (0.0021 => 0.0003, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.41% (0.0593 => 0.0631, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.36% (0.0220 => 0.0234, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.19% (0.7797 => 0.7812, std.dev.: 0.0028) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 70.97% (0.0062 => 0.0106, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.35% (16.4461 => 17.6548, std.dev.: 0.0879) MultiSource/Applications/sqlite3/sqlite3: 2314.70% (0.6332 => 15.2899, std.dev.: 0.1620) MultiSource/Benchmarks/McCat/08-main/main: 48.39% (0.1831 => 0.2717, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.79% (0.1559 => 0.1422, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7029.94% (0.3123 => 22.2668, std.dev.: 0.5413) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.91% (0.2463 => 0.3717, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1518.90% (0.3344 => 5.4136, std.dev.: 0.0631) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.07% (0.2364 => 0.3264, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 4.78% (0.6010 => 0.6297, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.42% (0.3266 => 0.3443, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/strcat: 4.62% (0.1969 => 0.2060, std.dev.: 0.0022) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.68% (0.0224 => 0.0230, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0463, std.dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: 11.70% (0.1462 => 0.1633, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4622, std.dev.: 0.0142) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0667, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4874, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5139, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5561, std.dev.: 0.0833) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3122, std.dev.: 0.0233) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1270, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3628, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4012, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0842, std.dev.: 0.0024) SingleSource/Regression/C/uint64_to_float: -24.10% (2.1832 => 1.6571, std.dev.: 0.0030) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.91% (0.0810 => 0.0947, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 13.85% (0.1112 => 0.1266, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.07% (0.0773 => 0.0874, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.85% (0.0848 => 0.0957, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.17% (0.0830 => 0.0931, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.50% (0.8321 => 0.9028, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.92% (0.7473 => 0.8065, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/health/health: 7.87% (0.1347 => 0.1453, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.51% (0.1425 => 0.1532, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.30% (0.6010 => 0.6449, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.30% (0.2519 => 0.2703, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.30% (0.3137 => 0.3366, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.08% (0.4847 => 0.5190, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.79% (0.2180 => 0.2328, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.69% (0.8148 => 0.8693, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.42% (0.2133 => 0.2270, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.40% (0.2998 => 0.3190, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.27% (0.2279 => 0.2422, std.dev.: 0.0038) MultiSource/Applications/Burg/burg: 6.10% (1.2222 => 1.2968, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.67% (0.1905 => 0.2013, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.59% (1.1606 => 1.2255, std.dev.: 0.0081) MultiSource/Applications/hbd/hbd: 5.26% (1.4269 => 1.5020, std.dev.: 0.0043) MultiSource/Applications/spiff/spiff: 5.03% (0.7950 => 0.8350, std.dev.: 0.0110) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.00% (0.2240 => 0.2352, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.98% (0.3295 => 0.3459, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.89% (1.1685 => 1.2256, std.dev.: 0.0056) MultiSource/Applications/sgefa/sgefa: 4.87% (0.2999 => 0.3145, std.dev.: 0.0036) MultiSource/Applications/lua/lua: 4.51% (3.8189 => 3.9911, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.50% (0.6287 => 0.6570, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.43% (0.3003 => 0.3136, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.23% (0.9435 => 0.9834, std.dev.: 0.0040) MultiSource/Applications/treecc/treecc: 4.20% (1.9948 => 2.0786, std.dev.: 0.0319) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.08% (0.4783 => 0.4978, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.80% (0.4127 => 0.4284, std.dev.: 0.0042) MultiSource/Applications/siod/siod: 3.65% (2.2184 => 2.2993, std.dev.: 0.0216) MultiSource/Benchmarks/MallocBench/gs/gs: 3.53% (4.1305 => 4.2763, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.48% (0.6227 => 0.6444, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/moments: 3.46% (0.3645 => 0.3771, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 3.42% (0.6834 => 0.7068, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 3.42% (14.2605 => 14.7480, std.dev.: 0.0840) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.37% (4.1763 => 4.3171, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.37% (0.3115 => 0.3220, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.36% (0.4559 => 0.4712, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: 3.23% (14.7684 => 15.2447, std.dev.: 0.0274) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.18% (6.6074 => 6.8176, std.dev.: 0.0190) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.15% (2.1401 => 2.2076, std.dev.: 0.0169) MultiSource/Applications/SIBsim4/SIBsim4: 3.14% (1.2568 => 1.2963, std.dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 3.11% (1.1271 => 1.1621, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.09% (0.3717 => 0.3832, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.06% (1.4479 => 1.4922, std.dev.: 0.0152) MultiSource/Applications/d/make_dparser: 3.03% (3.2366 => 3.3348, std.dev.: 0.0247) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.99% (0.5817 => 0.5991, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.98% (0.8007 => 0.8246, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.94% (1.3279 => 1.3670, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.83% (0.8697 => 0.8943, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 2.79% (0.9810 => 1.0084, std.dev.: 0.0087) MultiSource/Benchmarks/McCat/05-eks/eks: 2.77% (0.4397 => 0.4519, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.65% (0.8611 => 0.8839, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.61% (13.1811 => 13.5248, std.dev.: 0.1014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.58% (0.8340 => 0.8555, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.52% (8.6476 => 8.8651, std.dev.: 0.0215) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.50% (4.4873 => 4.5993, std.dev.: 0.0348) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.47% (0.8597 => 0.8809, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.46% (0.8317 => 0.8522, std.dev.: 0.0053) MultiSource/Applications/JM/ldecod/ldecod: 2.44% (6.7320 => 6.8961, std.dev.: 0.0330) MultiSource/Benchmarks/Bullet/bullet: 2.42% (31.8598 => 32.6311, std.dev.: 0.2641) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.41% (0.9908 => 1.0147, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.36% (0.9039 => 0.9252, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.33% (1.1170 => 1.1430, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.32% (0.8805 => 0.9009, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.30% (0.8656 => 0.8855, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.30% (0.8316 => 0.8507, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.28% (0.8518 => 0.8712, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.27% (0.9688 => 0.9908, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.24% (0.8204 => 0.8388, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.23% (4.5702 => 4.6722, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.22% (0.8069 => 0.8248, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.19% (0.9056 => 0.9254, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.18% (0.8885 => 0.9079, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.16% (0.8086 => 0.8261, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.13% (4.4880 => 4.5838, std.dev.: 0.0072) MultiSource/Benchmarks/PAQ8p/paq8p: 2.13% (2.3764 => 2.4269, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.12% (0.7932 => 0.8100, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.09% (0.8048 => 0.8216, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 2.08% (15.3280 => 15.6464, std.dev.: 0.0719) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.96% (0.8855 => 0.9029, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.92% (0.8066 => 0.8221, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.86% (0.8927 => 0.9093, std.dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 1.72% (8.6247 => 8.7728, std.dev.: 0.0278) MultiSource/Applications/lambda-0_1_3/lambda: 1.71% (0.7557 => 0.7686, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.70% (0.8338 => 0.8480, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.61% (0.8286 => 0.8419, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.51% (0.8995 => 0.9131, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.39% (1.2602 => 1.2777, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.05% (1.2423 => 1.2553, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 136.18% (0.0199 => 0.0470, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/pi: 57.35% (1.5795 => 2.4854, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.53% (0.7597 => 0.8853, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.26% (2.9753 => 3.4590, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.43% (2.7995 => 3.2034, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6084, std.dev.: 0.0450) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.61% (6.3772 => 7.0536, std.dev.: 0.1723) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.58% (1.1857 => 1.2756, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/queens: 7.53% (1.7056 => 1.8340, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/nestedloop: 7.17% (0.2023 => 0.2168, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.74% (4.7794 => 5.1017, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/richards_benchmark: 6.14% (1.3037 => 1.3838, std.dev.: 0.0140) MultiSource/Applications/SIBsim4/SIBsim4: 5.96% (3.1873 => 3.3772, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.86% (4.5327 => 4.7983, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.85% (4.9686 => 5.2595, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/treeadd/treeadd: 5.44% (0.3587 => 0.3782, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.66% (6.2275 => 6.5178, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.40% (3.3761 => 3.5248, std.dev.: 0.0058) MultiSource/Applications/lambda-0_1_3/lambda: 4.37% (7.4933 => 7.8206, std.dev.: 0.0361) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.20% (4.9453 => 5.1532, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 4.09% (0.2887 => 0.3005, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.96% (4.9469 => 5.1430, std.dev.: 0.0089) MultiSource/Applications/hexxagon/hexxagon: 3.89% (14.0064 => 14.5514, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.19% (1.2337 => 1.2731, std.dev.: 0.0091) MultiSource/Applications/siod/siod: 3.04% (3.6643 => 3.7756, std.dev.: 0.0239) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.78% (11.5690 => 11.8905, std.dev.: 0.0204) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.49% (4.8362 => 4.9568, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.37% (4.8660 => 4.9811, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: 2.31% (7.3375 => 7.5073, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.15% (8.2783 => 8.4565, std.dev.: 0.0258) MultiSource/Benchmarks/Olden/power/power: 1.54% (1.2061 => 1.2247, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.21% (2.4647 => 2.4944, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.12% (59.2638 => 59.9248, std.dev.: 0.1961) SingleSource/Benchmarks/Misc/ReedSolomon: 1.09% (8.5322 => 8.6252, std.dev.: 0.0122) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3560 => 2.3802, std.dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.02% (5.4641 => 4.3154, std.dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.62% (1.0512 => 0.9290, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.17% (7.2130 => 6.4076, std.dev.: 0.1209) SingleSource/Benchmarks/McGill/chomp: -10.22% (1.1216 => 1.0070, std.dev.: 0.0139) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.55% (14.6451 => 13.2460, std.dev.: 0.2870) MultiSource/Benchmarks/mafft/pairlocalalign: -8.55% (63.1822 => 57.7826, std.dev.: 0.1126) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.87% (4.7482 => 4.4218, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.42% (0.3269 => 0.3059, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.90% (3.7148 => 3.4955, std.dev.: 0.0580) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.89% (5.4972 => 5.1735, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.07% (5.1557 => 4.8943, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.41% (2.4490 => 2.3409, std.dev.: 0.0293) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.34% (4.7449 => 4.5388, std.dev.: 0.0074) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.05% (2.8773 => 2.7608, std.dev.: 0.0401) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.89% (6.0224 => 5.7881, std.dev.: 0.0114) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (28.5821 => 27.6791, std.dev.: 0.0767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.98% (0.5807 => 0.5634, std.dev.: 0.0009) MultiSource/Applications/lua/lua: -2.92% (29.8330 => 28.9616, std.dev.: 0.2172) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.81% (9.9065 => 9.6278, std.dev.: 0.0562) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.61% (2.6356 => 2.5668, std.dev.: 0.0024) MultiSource/Applications/aha/aha: -2.54% (3.3398 => 3.2551, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/hash2: -2.26% (3.4237 => 3.3463, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.03% (11.5316 => 11.2970, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.63% (3.2169 => 3.1644, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.57% (4.9994 => 4.9209, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.55% (2.3487 => 2.3123, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.23% (5.6343 => 5.5651, std.dev.: 0.0078) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.17% (1.0262 => 1.0690, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 47.97% (0.0123 => 0.0182, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.47% (0.0408 => 0.0414, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -6.29% (0.0302 => 0.0283, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -6.51% (0.0384 => 0.0359, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -57.14% (0.0007 => 0.0003, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 2.71% (0.1438 => 0.1477, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 2.59% (1.1329 => 1.1622, std.dev.: 0.0327) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.86% (0.4164 => 0.4283, std.dev.: 0.0370) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.37% (0.1369 => 0.1374, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.62% (0.0641 => 0.0605, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 31.79% (0.0195 => 0.0257, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.02% (0.0578 => 0.0607, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.44% (1.1437 => 1.1945, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 700.00% (0.0001 => 0.0008, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -78.57% (0.0014 => 0.0003, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.64% (0.0627 => 0.0631, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 30.00% (0.0180 => 0.0234, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.56% (0.8017 => 0.7812, std.dev.: 0.0028) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 70.97% (0.0062 => 0.0106, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 21:10:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 17 Nov 2012 23:10:24 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121118051024.BD4002A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5994?compare_to=5991&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5994, Order: 168278, Start Time: 2012-11-18 03:38:00, End Time: 2012-11-18 05:10:46 To: 5991, Order: 168277, Start Time: 2012-11-18 01:42:27, End Time: 2012-11-18 03:15:10 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== New Failures: 0 (48 on baseline) Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (174 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 48 (0 on baseline) Unchanged Tests: 1044 (864 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/LivermoreLoops/kernel01: - (0.0176 => 0.0176) SingleSource/Benchmarks/LivermoreLoops/kernel02: - (0.0176 => 0.0176) SingleSource/Benchmarks/LivermoreLoops/kernel03: - (0.0175 => 0.0175) SingleSource/Benchmarks/LivermoreLoops/kernel04: - (0.0176 => 0.0176) SingleSource/Benchmarks/LivermoreLoops/kernel05: - (0.0175 => 0.0175) SingleSource/Benchmarks/LivermoreLoops/kernel06: - (0.0175 => 0.0175, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel07: - (0.0176 => 0.0176, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel08: - (0.0180 => 0.0180) SingleSource/Benchmarks/LivermoreLoops/kernel09: - (0.0176 => 0.0176) SingleSource/Benchmarks/LivermoreLoops/kernel10: - (0.0177 => 0.0177, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel11: - (0.0175 => 0.0175) SingleSource/Benchmarks/LivermoreLoops/kernel12: - (0.0175 => 0.0175) SingleSource/Benchmarks/LivermoreLoops/kernel13: - (0.0178 => 0.0178, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel14: - (0.0179 => 0.0179, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel15: - (0.0183 => 0.0183) SingleSource/Benchmarks/LivermoreLoops/kernel16: - (0.0180 => 0.0180, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel17: -0.56% (0.0178 => 0.0177, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel18: - (0.0183 => 0.0183) SingleSource/Benchmarks/LivermoreLoops/kernel19: - (0.0176 => 0.0176) SingleSource/Benchmarks/LivermoreLoops/kernel20: - (0.0177 => 0.0177) SingleSource/Benchmarks/LivermoreLoops/kernel21: - (0.0176 => 0.0176) SingleSource/Benchmarks/LivermoreLoops/kernel22: - (0.0176 => 0.0176) SingleSource/Benchmarks/LivermoreLoops/kernel23: - (0.0177 => 0.0177) SingleSource/Benchmarks/LivermoreLoops/kernel24: - (0.0175 => 0.0175, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/LivermoreLoops/kernel01: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel02: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel03: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel04: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel05: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel06: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel07: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel08: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel09: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel10: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel11: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel12: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel13: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel14: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel15: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel16: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel17: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel18: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel19: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel20: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel21: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel22: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel23: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel24: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 New Failures - Execution Time ----------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.68% (2.0478 => 2.1026, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.4937 => 7.6783, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hash2: 2.15% (3.1932 => 3.2620, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.27% (0.3821 => 0.3505, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.80% (2.4924 => 2.3228, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -6.64% (0.3357 => 0.3134, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.59% (0.3142 => 0.2935, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.51% (0.9542 => 0.8921, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.22% (0.2428 => 0.2277, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -6.20% (0.2160 => 0.2026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.12% (0.1796 => 0.1686, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -6.10% (9.2283 => 8.6654, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.07% (0.7198 => 0.6761, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.04% (0.9852 => 0.9257, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -5.97% (16.1920 => 15.2257, std.dev.: 0.0154) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: -5.88% (7.0961 => 6.6786, std.dev.: 0.0102) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.86% (0.2355 => 0.2217, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: -5.84% (0.9179 => 0.8643, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.83% (0.6484 => 0.6106, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.83% (0.1716 => 0.1616, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.77% (1.3722 => 1.2930, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -5.74% (0.1761 => 0.1660, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.70% (1.0544 => 0.9943, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.68% (3.5339 => 3.3332, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.62% (4.0323 => 3.8057, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.60% (0.3658 => 0.3453, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.58% (4.8161 => 4.5472, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -5.56% (1.1450 => 1.0813, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: -5.55% (0.3406 => 0.3217, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.54% (0.6681 => 0.6311, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.53% (0.2695 => 0.2546, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.51% (6.7716 => 6.3983, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.50% (1.4642 => 1.3836, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.48% (1.2300 => 1.1626, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.47% (0.6230 => 0.5889, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -5.46% (4.3330 => 4.0964, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.45% (4.8802 => 4.6141, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.43% (0.6736 => 0.6370, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.43% (4.5069 => 4.2621, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.43% (0.5857 => 0.5539, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.43% (1.6364 => 1.5476, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.42% (0.5591 => 0.5288, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.41% (0.5863 => 0.5546, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.39% (0.5802 => 0.5489, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.37% (0.5478 => 0.5184, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -5.36% (1.1530 => 1.0912, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.36% (0.5805 => 0.5494, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.34% (0.6052 => 0.5729, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.33% (0.6676 => 0.6320, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.33% (0.6660 => 0.6305, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.30% (0.6395 => 0.6056, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.30% (0.5925 => 0.5611, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -5.29% (0.4515 => 0.4276, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.29% (0.5859 => 0.5549, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.29% (1.2784 => 1.2108, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.24% (0.6293 => 0.5963, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -5.24% (17.1032 => 16.2065, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.24% (0.5456 => 0.5170, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.24% (0.5688 => 0.5390, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -5.23% (1.3864 => 1.3139, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.23% (14.2083 => 13.4655, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: -5.23% (0.2985 => 0.2829, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -5.23% (1.2515 => 1.1861, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.21% (0.5705 => 0.5408, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.20% (0.7524 => 0.7133, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -5.19% (0.3581 => 0.3395, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.18% (0.2548 => 0.2416, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.18% (0.7919 => 0.7509, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.18% (0.6395 => 0.6064, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.16% (0.5581 => 0.5293, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.16% (0.6667 => 0.6323, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.16% (1.2221 => 1.1591, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.14% (0.3483 => 0.3304, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.14% (0.5569 => 0.5283, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.12% (0.6446 => 0.6116, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.10% (1.2210 => 1.1587, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.10% (0.5941 => 0.5638, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.09% (0.5849 => 0.5551, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.09% (0.5575 => 0.5291, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.07% (0.5999 => 0.5695, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.06% (0.5570 => 0.5288, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.06% (0.7339 => 0.6968, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.03% (0.8521 => 0.8092, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.00% (0.4916 => 0.4670, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.00% (0.2999 => 0.2849, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.98% (0.6440 => 0.6119, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.96% (8.0126 => 7.6148, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: -4.96% (0.2659 => 0.2527, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.96% (0.2278 => 0.2165, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -4.92% (3.5154 => 3.3423, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.90% (1.6474 => 1.5667, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.89% (0.5567 => 0.5295, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.85% (0.3319 => 0.3158, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.78% (0.2385 => 0.2271, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -4.77% (0.3812 => 0.3630, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -4.76% (4.0594 => 3.8662, std.dev.: 0.0081) MultiSource/Applications/minisat/minisat: -4.74% (0.7447 => 0.7094, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.72% (0.5168 => 0.4924, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -4.69% (15.5079 => 14.7807, std.dev.: 0.0115) MultiSource/Applications/ClamAV/clamscan: -4.68% (15.2527 => 14.5395, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions: -4.67% (0.4176 => 0.3981, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.66% (0.3884 => 0.3703, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.64% (0.3880 => 0.3700, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.59% (0.3896 => 0.3717, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.59% (0.4033 => 0.3848, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.57% (0.3831 => 0.3656, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.55% (0.3891 => 0.3714, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-3: -4.55% (0.3848 => 0.3673, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -4.55% (2.4021 => 2.2929, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.54% (0.6297 => 0.6011, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.52% (0.7021 => 0.6704, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.50% (0.6194 => 0.5915, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.50% (22.4056 => 21.3971, std.dev.: 0.0106) SingleSource/UnitTests/ObjC/property: -4.45% (0.4199 => 0.4012, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.45% (0.5329 => 0.5092, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -4.43% (0.7982 => 0.7628, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.38% (0.6304 => 0.6028, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -4.38% (5.0226 => 4.8028, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: -4.37% (0.3271 => 0.3128, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: -4.36% (2.1401 => 2.0468, std.dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: -4.32% (1.3148 => 1.2580, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -4.21% (34.0927 => 32.6559, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.17% (2.2587 => 2.1644, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/parameter-passing: -4.16% (0.4280 => 0.4102, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.12% (0.4151 => 0.3980, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: -4.09% (0.8418 => 0.8074, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: -4.09% (0.3255 => 0.3122, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -4.04% (18.2933 => 17.5541, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.97% (0.3931 => 0.3775, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.96% (0.9557 => 0.9179, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.94% (0.9077 => 0.8719, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.91% (0.3016 => 0.2898, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -3.90% (0.3025 => 0.2907, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.86% (0.3837 => 0.3689, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.85% (0.3323 => 0.3195, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -3.83% (0.4861 => 0.4675, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -3.81% (0.4248 => 0.4086, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.81% (0.3252 => 0.3128, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: -3.77% (0.3026 => 0.2912, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.71% (2.1713 => 2.0908, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/lists1: -3.70% (0.3867 => 0.3724, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.66% (0.3849 => 0.3708, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -3.66% (0.3059 => 0.2947, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.66% (0.4321 => 0.4163, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.62% (0.4813 => 0.4639, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -3.61% (0.2989 => 0.2881, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -3.56% (0.3481 => 0.3357, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.55% (0.4427 => 0.4270, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -3.54% (0.3446 => 0.3324, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.53% (0.3057 => 0.2949, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.51% (0.2933 => 0.2830, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -3.51% (0.3394 => 0.3275, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -3.50% (0.6347 => 0.6125, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -3.48% (0.2871 => 0.2771, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -3.45% (0.3621 => 0.3496, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -3.45% (0.7779 => 0.7511, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.41% (0.3491 => 0.3372, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -3.37% (0.6441 => 0.6224, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.36% (0.4083 => 0.3946, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -3.35% (0.6750 => 0.6524, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: -3.21% (0.3205 => 0.3102, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.17% (5.4682 => 5.2951, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: -3.14% (0.3788 => 0.3669, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -3.04% (1.5610 => 1.5135, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: -2.94% (0.4524 => 0.4391, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -2.30% (20.7746 => 20.2977, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7518, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/richards_benchmark: -8.62% (1.2842 => 1.1735, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.72% (2.2633 => 2.1792, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.86% (1.3096 => 1.2721, std.dev.: 0.0114) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4693, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 22:20:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 00:20:37 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121118062037.2062B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5995?compare_to=5989&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5995, Order: 168278, Start Time: 2012-11-18 04:00:48, End Time: 2012-11-18 06:20:58 To: 5989, Order: 168276, Start Time: 2012-11-18 00:49:40, End Time: 2012-11-18 03:10:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (50 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 12 (120 on baseline) Performance Improvements: 16 (40 on baseline) Added Tests: 0 (136 on baseline) Existing Failures: 52 (2 on baseline) Unchanged Tests: 1012 (727 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/aha/aha: 12.97% (0.1334 => 0.1507, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/distray/distray: 8.78% (0.1538 => 0.1673, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.68% (0.6715 => 0.7298, std.dev.: 0.0125) MultiSource/Applications/viterbi/viterbi: 8.51% (0.1798 => 0.1951, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.23% (1.5933 => 1.7245, std.dev.: 0.0174) MultiSource/Applications/treecc/treecc: 8.01% (2.2940 => 2.4778, std.dev.: 0.0602) MultiSource/Applications/sgefa/sgefa: 7.73% (0.3546 => 0.3820, std.dev.: 0.0097) MultiSource/Applications/oggenc/oggenc: 6.53% (6.8440 => 7.2906, std.dev.: 0.0407) SingleSource/UnitTests/ObjC++/Hello: 3.24% (0.6780 => 0.7000, std.dev.: 0.0048) MultiSource/Applications/SPASS/SPASS: 1.15% (18.2112 => 18.4213, std.dev.: 0.0216) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lemon/lemon: 6.90% (1.4367 => 1.5359, std.dev.: 0.0226) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.13% (88.2297 => 89.2246, std.dev.: 0.2895) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/messages-2: -15.07% (0.0909 => 0.0772, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: -12.27% (0.3815 => 0.3347, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/sieve: -12.17% (0.4636 => 0.4072, std.dev.: 0.0216) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -10.87% (1.7557 => 1.5648, std.dev.: 0.0673) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -8.85% (1.6610 => 1.5140, std.dev.: 0.0557) SingleSource/UnitTests/ObjC/exceptions-2: -8.15% (0.4318 => 0.3966, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/instance-method-metadata: -8.02% (0.4363 => 0.4013, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/exceptions: -8.00% (0.4710 => 0.4333, std.dev.: 0.0079) SingleSource/UnitTests/ObjC/parameter-passing: -7.80% (0.4845 => 0.4467, std.dev.: 0.0097) SingleSource/UnitTests/ObjC/for-in: -7.42% (0.4512 => 0.4177, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/exceptions-3: -6.94% (0.4278 => 0.3981, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/exceptions-4: -6.52% (0.4296 => 0.4016, std.dev.: 0.0076) SingleSource/UnitTests/Vector/constpool: -5.45% (57.3169 => 54.1925, std.dev.: 0.7559) SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.57% (0.6413 => 0.6312, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.09% (21.4377 => 21.2031, std.dev.: 0.0817) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -39.47% (8.0140 => 4.8510, std.dev.: 0.9237) Existing Failures - Compile Time -------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/LivermoreLoops/kernel01: - (0.0193 => 0.0193, std.dev.: 0.0009) SingleSource/Benchmarks/LivermoreLoops/kernel02: - (0.0194 => 0.0194, std.dev.: 0.0009) SingleSource/Benchmarks/LivermoreLoops/kernel03: - (0.0192 => 0.0192, std.dev.: 0.0005) SingleSource/Benchmarks/LivermoreLoops/kernel04: - (0.0194 => 0.0194, std.dev.: 0.0007) SingleSource/Benchmarks/LivermoreLoops/kernel05: - (0.0193 => 0.0193, std.dev.: 0.0006) SingleSource/Benchmarks/LivermoreLoops/kernel06: - (0.0193 => 0.0193, std.dev.: 0.0009) SingleSource/Benchmarks/LivermoreLoops/kernel07: - (0.0194 => 0.0194, std.dev.: 0.0008) SingleSource/Benchmarks/LivermoreLoops/kernel08: -0.50% (0.0199 => 0.0198, std.dev.: 0.0010) SingleSource/Benchmarks/LivermoreLoops/kernel09: - (0.0194 => 0.0194, std.dev.: 0.0009) SingleSource/Benchmarks/LivermoreLoops/kernel10: -0.51% (0.0196 => 0.0195, std.dev.: 0.0014) SingleSource/Benchmarks/LivermoreLoops/kernel11: - (0.0193 => 0.0193, std.dev.: 0.0004) SingleSource/Benchmarks/LivermoreLoops/kernel12: -0.52% (0.0193 => 0.0192, std.dev.: 0.0009) SingleSource/Benchmarks/LivermoreLoops/kernel13: - (0.0196 => 0.0196, std.dev.: 0.0008) SingleSource/Benchmarks/LivermoreLoops/kernel14: -0.51% (0.0198 => 0.0197, std.dev.: 0.0008) SingleSource/Benchmarks/LivermoreLoops/kernel15: - (0.0202 => 0.0202, std.dev.: 0.0008) SingleSource/Benchmarks/LivermoreLoops/kernel16: - (0.0199 => 0.0199, std.dev.: 0.0009) SingleSource/Benchmarks/LivermoreLoops/kernel17: - (0.0196 => 0.0196, std.dev.: 0.0005) SingleSource/Benchmarks/LivermoreLoops/kernel18: -0.50% (0.0202 => 0.0201, std.dev.: 0.0009) SingleSource/Benchmarks/LivermoreLoops/kernel19: 0.52% (0.0194 => 0.0195, std.dev.: 0.0007) SingleSource/Benchmarks/LivermoreLoops/kernel20: -2.50% (0.0200 => 0.0195, std.dev.: 0.0007) SingleSource/Benchmarks/LivermoreLoops/kernel21: -7.66% (0.0209 => 0.0193, std.dev.: 0.0010) SingleSource/Benchmarks/LivermoreLoops/kernel22: -6.28% (0.0207 => 0.0194, std.dev.: 0.0008) SingleSource/Benchmarks/LivermoreLoops/kernel23: -5.83% (0.0206 => 0.0194, std.dev.: 0.0013) SingleSource/Benchmarks/LivermoreLoops/kernel24: -5.85% (0.0205 => 0.0193, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 MultiSource/Applications/oggenc/oggenc: -0.44% (0.1360 => 0.1354, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0420 => 0.0420, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0652 => 0.0652, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -0.04% (494.0385 => 493.8550, std.dev.: 0.1451) SingleSource/Benchmarks/LivermoreLoops/kernel01: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel02: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel03: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel04: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel05: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel06: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel07: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel08: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel09: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel10: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel11: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel12: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel13: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel14: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel15: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel16: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel17: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel18: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel19: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel20: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel21: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel22: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel23: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel24: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: 43693.12% (1.1277 => 493.8550, std.dev.: 0.1451) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.34% (0.5229 => 1.5391, std.dev.: 0.0961) MultiSource/Applications/SPASS/SPASS: 22.89% (14.9895 => 18.4213, std.dev.: 0.0216) MultiSource/Applications/kimwitu++/kc: 51.66% (14.1553 => 21.4683, std.dev.: 0.0718) MultiSource/Benchmarks/MallocBench/gs/gs: 19.29% (4.1105 => 4.9036, std.dev.: 0.2091) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.04% (1.1048 => 1.5140, std.dev.: 0.0557) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 437.27% (7.1582 => 38.4587, std.dev.: 0.2424) SingleSource/Benchmarks/Misc-C++-EH/spirit: 78.32% (3.4629 => 6.1752, std.dev.: 0.3257) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.56% (0.6222 => 1.0301, std.dev.: 0.0631) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10613.61% (0.0720 => 7.7138, std.dev.: 0.2722) MultiSource/Applications/SIBsim4/SIBsim4: 3859900.00% (0.0001 => 3.8600, std.dev.: 0.0379) MultiSource/Applications/SPASS/SPASS: 13881700.00% (0.0001 => 13.8818, std.dev.: 0.1600) MultiSource/Applications/kimwitu++/kc: 52100.00% (0.0001 => 0.0522, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576100.00% (0.0001 => 0.5762, std.dev.: 0.0372) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10098600.00% (0.0001 => 10.0987, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6920600.00% (0.0001 => 6.9207, std.dev.: 0.3961) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1794.15% (1.1194 => 21.2031, std.dev.: 0.0817) MultiSource/Applications/ClamAV/clamscan: 70.11% (22.1758 => 37.7228, std.dev.: 0.2356) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 60.87% (2.9384 => 4.7270, std.dev.: 0.2854) MultiSource/Benchmarks/FreeBench/distray/distray: 58.43% (0.1056 => 0.1673, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.79% (7.0540 => 11.0603, std.dev.: 0.2322) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 52.30% (8.1363 => 12.3919, std.dev.: 0.0418) MultiSource/Applications/JM/lencod/lencod: 48.03% (21.9371 => 32.4739, std.dev.: 0.1840) SingleSource/Benchmarks/Misc/flops: 47.14% (0.1432 => 0.2107, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/almabench: 39.45% (0.0730 => 0.1018, std.dev.: 0.0032) MultiSource/Applications/aha/aha: 30.93% (0.1151 => 0.1507, std.dev.: 0.0022) SingleSource/UnitTests/vla: 29.86% (0.0355 => 0.0461, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.99% (0.5105 => 0.6534, std.dev.: 0.0110) MultiSource/Applications/oggenc/oggenc: 26.59% (5.7591 => 7.2906, std.dev.: 0.0407) SingleSource/Benchmarks/Shootout-C++/lists: 26.48% (0.3422 => 0.4328, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/08-main/main: 26.16% (0.2554 => 0.3222, std.dev.: 0.0140) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.89% (0.0479 => 0.0603, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 25.74% (0.5020 => 0.6312, std.dev.: 0.0026) MultiSource/Applications/viterbi/viterbi: 25.47% (0.1555 => 0.1951, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.39% (0.8172 => 1.0247, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 24.72% (0.1695 => 0.2114, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 24.54% (0.5860 => 0.7298, std.dev.: 0.0125) MultiSource/Benchmarks/Olden/bisort/bisort: 24.43% (0.0614 => 0.0764, std.dev.: 0.0055) SingleSource/Benchmarks/Stanford/Oscar: 24.06% (0.0636 => 0.0789, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.99% (0.0746 => 0.0925, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/whetstone: 23.48% (0.0660 => 0.0815, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 22.98% (0.0953 => 0.1172, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: 22.87% (0.3109 => 0.3820, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/spellcheck: 22.77% (0.4203 => 0.5160, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/perlin: 22.76% (0.0536 => 0.0658, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.58% (0.1940 => 0.2378, std.dev.: 0.0107) MultiSource/Applications/treecc/treecc: 22.22% (2.0273 => 2.4778, std.dev.: 0.0602) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 21.96% (0.0838 => 0.1022, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.56% (14.3668 => 17.4638, std.dev.: 0.0841) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.46% (0.1566 => 0.1902, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/Large/ray: 21.36% (0.4064 => 0.4932, std.dev.: 0.0152) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.28% (0.1062 => 0.1288, std.dev.: 0.0033) MultiSource/Applications/lemon/lemon: 21.16% (1.0722 => 1.2991, std.dev.: 0.0487) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.03% (0.2107 => 0.2550, std.dev.: 0.0093) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 20.89% (0.1125 => 0.1360, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/tsp/tsp: 20.68% (0.1175 => 0.1418, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/fbench: 20.44% (0.0592 => 0.0713, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 20.33% (3.8723 => 4.6594, std.dev.: 0.1372) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.05% (0.0793 => 0.0952, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.42% (0.2271 => 0.2712, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.30% (0.2700 => 0.3221, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/strcat: 19.25% (0.2831 => 0.3376, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/city/city: 19.12% (2.0665 => 2.4617, std.dev.: 0.0440) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.89% (0.0704 => 0.0837, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.78% (1.1861 => 1.4088, std.dev.: 0.0482) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 18.62% (0.1337 => 0.1586, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/lists: 18.37% (0.0626 => 0.0741, std.dev.: 0.0044) SingleSource/UnitTests/ObjC++/Hello: 18.14% (0.5925 => 0.7000, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.88% (0.2891 => 0.3408, std.dev.: 0.0089) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.87% (0.0834 => 0.0983, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.79% (0.9765 => 1.1502, std.dev.: 0.0437) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.70% (0.0842 => 0.0991, std.dev.: 0.0055) SingleSource/UnitTests/SignlessTypes/rem: 17.66% (0.1144 => 0.1346, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.45% (0.0871 => 0.1023, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: 17.28% (17.1811 => 20.1492, std.dev.: 0.1337) MultiSource/Benchmarks/mafft/pairlocalalign: 17.09% (9.4845 => 11.1051, std.dev.: 0.2954) SingleSource/Benchmarks/Shootout-C++/fibo: 16.70% (0.2725 => 0.3180, std.dev.: 0.0082) SingleSource/UnitTests/ObjC/messages-2: 16.62% (0.0662 => 0.0772, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/wc: 16.48% (0.3052 => 0.3555, std.dev.: 0.0187) MultiSource/Benchmarks/Olden/mst/mst: 16.34% (0.1163 => 0.1353, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.90% (0.0648 => 0.0751, std.dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference-object: 15.80% (0.6030 => 0.6983, std.dev.: 0.0218) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.40% (0.1117 => 0.1289, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.05% (0.2758 => 0.3173, std.dev.: 0.0161) SingleSource/UnitTests/ObjC++/property-reference: 15.00% (0.7326 => 0.8425, std.dev.: 0.0189) MultiSource/Applications/d/make_dparser: 14.97% (3.3354 => 3.8347, std.dev.: 0.1459) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.94% (0.0770 => 0.0885, std.dev.: 0.0045) MultiSource/Benchmarks/Bullet/bullet: 14.66% (63.2438 => 72.5168, std.dev.: 0.0664) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.13% (0.5981 => 0.6826, std.dev.: 0.0285) SingleSource/UnitTests/ObjC/parameter-passing: 13.75% (0.3927 => 0.4467, std.dev.: 0.0097) SingleSource/UnitTests/ObjC/trivial-interface: 13.62% (0.3473 => 0.3946, std.dev.: 0.0160) SingleSource/UnitTests/ObjC/exceptions-2: 13.41% (0.3497 => 0.3966, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/synchronized: 13.40% (0.3561 => 0.4038, std.dev.: 0.0161) SingleSource/UnitTests/ObjC/exceptions-4: 13.35% (0.3543 => 0.4016, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.32% (5.0018 => 5.6681, std.dev.: 0.2422) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.27% (0.3543 => 0.4013, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/exceptions-3: 13.23% (0.3516 => 0.3981, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.20% (4.9449 => 5.5977, std.dev.: 0.2306) SingleSource/UnitTests/ObjC/exceptions: 13.19% (0.3828 => 0.4333, std.dev.: 0.0079) SingleSource/UnitTests/ObjC/for-in: 13.08% (0.3694 => 0.4177, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/bigfib: 12.38% (0.6456 => 0.7255, std.dev.: 0.0208) MultiSource/Benchmarks/PAQ8p/paq8p: 11.69% (10.3673 => 11.5797, std.dev.: 0.1454) MultiSource/Applications/hbd/hbd: 11.08% (1.5603 => 1.7332, std.dev.: 0.0670) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.87% (0.4879 => 0.5312, std.dev.: 0.0112) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.46% (4.3953 => 11.0085, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/methcall: 147.72% (5.3999 => 13.3768, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary3: 23.04% (3.7221 => 4.5795, std.dev.: 0.1669) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 22.31% (13.4384 => 16.4367, std.dev.: 0.5834) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.36% (1.5086 => 1.8158, std.dev.: 0.0942) SingleSource/Benchmarks/Misc/oourafft: 17.52% (6.6465 => 7.8112, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.72% (1.1145 => 1.3008, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.04% (0.2944 => 0.3328, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.62% (2.8904 => 3.2262, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 11.06% (1.0785 => 1.1978, std.dev.: 0.0276) SingleSource/Benchmarks/Misc/richards_benchmark: 10.18% (1.1396 => 1.2556, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.30% (1.7254 => 1.8859, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 6.22% (1.4460 => 1.5359, std.dev.: 0.0226) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.97% (4.2280 => 4.4805, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.94% (0.9540 => 1.0107, std.dev.: 0.0005) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.10% (11.6436 => 12.1213, std.dev.: 0.0131) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.34% (0.4162 => 0.4301, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: 2.64% (2.4116 => 2.4753, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.53% (1.7133 => 1.7567, std.dev.: 0.0166) MultiSource/Applications/sgefa/sgefa: 2.52% (0.6223 => 0.6380, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 2.13% (3.1595 => 3.2267, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 2.10% (85.0658 => 86.8518, std.dev.: 0.0493) SingleSource/Benchmarks/Shootout-C++/sieve: 1.65% (2.4858 => 2.5269, std.dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: 1.40% (27.8444 => 28.2338, std.dev.: 0.0522) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.38% (6.5088 => 6.5985, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout/sieve: 1.35% (5.2139 => 5.2843, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0313 => 1.0440, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0505, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1676, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.89% (5.2763 => 1.2722, std.dev.: 0.0368) SingleSource/Benchmarks/Misc/salsa20: -75.76% (0.8651 => 0.2097, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/richards_benchmark: -44.82% (0.1622 => 0.0895, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.92% (5.3526 => 4.7144, std.dev.: 0.1565) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.44% (5.3855 => 4.7696, std.dev.: 0.1469) MultiSource/Applications/JM/ldecod/ldecod: -9.18% (10.4361 => 9.4783, std.dev.: 0.0408) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.95% (0.3987 => 0.2394, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.72% (0.0506 => 0.0305) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.29% (4.5009 => 2.7773, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7636, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -27.84% (10.7105 => 7.7287, std.dev.: 0.6553) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.14% (2.6546 => 2.0137, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: -19.71% (0.2161 => 0.1735, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.60% (1.6925 => 1.4285, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2838, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.76% (32.5116 => 29.0137, std.dev.: 0.0192) SingleSource/Benchmarks/Misc/mandel-2: -10.67% (1.5373 => 1.3733, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -10.33% (9.5636 => 8.5757, std.dev.: 0.2193) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.05% (1.5660 => 1.4243, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.94% (4.8142 => 4.4799, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.2416 => 3.0212, std.dev.: 0.0256) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5760, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.17% (0.2497 => 0.2368, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5068, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.65% (1.6805 => 1.6024, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout/lists: -4.20% (6.2999 => 6.0353, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.60% (19.9488 => 19.2310, std.dev.: 0.2565) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.28% (0.9957 => 0.9630, std.dev.: 0.0050) MultiSource/Benchmarks/sim/sim: -3.07% (5.0483 => 4.8931, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.29% (0.4808 => 0.4698, std.dev.: 0.0013) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6773, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.55% (8.1563 => 8.0300, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/salsa20: -1.53% (10.2830 => 10.1261, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.82% (0.1485 => 0.1354, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0015) Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 23:29:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 01:29:07 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121118072907.C2BD32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5996?compare_to=5992&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5996, Order: 168278, Start Time: 2012-11-18 04:09:36, End Time: 2012-11-18 07:29:29 To: 5992, Order: 168274, Start Time: 2012-11-18 00:01:45, End Time: 2012-11-18 03:21:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (48 on baseline) Performance Regressions: 3 (170 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (136 on baseline) Existing Failures: 48 (0 on baseline) Unchanged Tests: 1041 (721 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.34% (127.5562 => 130.5423, std.dev.: 0.5083) MultiSource/Benchmarks/Olden/treeadd/treeadd: 1.47% (10.7699 => 10.9283, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.15% (54.1532 => 54.7784, std.dev.: 0.0744) Existing Failures - Compile Time -------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/LivermoreLoops/kernel01: - (0.0201 => 0.0201, std.dev.: 0.0009) SingleSource/Benchmarks/LivermoreLoops/kernel02: - (0.0201 => 0.0201, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel03: - (0.0200 => 0.0200, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel04: - (0.0201 => 0.0201, std.dev.: 0.0002) SingleSource/Benchmarks/LivermoreLoops/kernel05: - (0.0200 => 0.0200) SingleSource/Benchmarks/LivermoreLoops/kernel06: 0.50% (0.0200 => 0.0201) SingleSource/Benchmarks/LivermoreLoops/kernel07: 0.50% (0.0201 => 0.0202) SingleSource/Benchmarks/LivermoreLoops/kernel08: - (0.0207 => 0.0207) SingleSource/Benchmarks/LivermoreLoops/kernel09: - (0.0201 => 0.0201, std.dev.: 0.0002) SingleSource/Benchmarks/LivermoreLoops/kernel10: - (0.0203 => 0.0203) SingleSource/Benchmarks/LivermoreLoops/kernel11: - (0.0200 => 0.0200, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel12: - (0.0200 => 0.0200) SingleSource/Benchmarks/LivermoreLoops/kernel13: - (0.0204 => 0.0204) SingleSource/Benchmarks/LivermoreLoops/kernel14: -0.49% (0.0206 => 0.0205, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel15: - (0.0210 => 0.0210) SingleSource/Benchmarks/LivermoreLoops/kernel16: - (0.0206 => 0.0206, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel17: - (0.0203 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel18: - (0.0210 => 0.0210) SingleSource/Benchmarks/LivermoreLoops/kernel19: - (0.0202 => 0.0202, std.dev.: 0.0002) SingleSource/Benchmarks/LivermoreLoops/kernel20: - (0.0203 => 0.0203) SingleSource/Benchmarks/LivermoreLoops/kernel21: - (0.0201 => 0.0201) SingleSource/Benchmarks/LivermoreLoops/kernel22: - (0.0201 => 0.0201, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel23: - (0.0202 => 0.0202, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel24: - (0.0200 => 0.0200, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/LivermoreLoops/kernel01: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel02: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel03: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel04: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel05: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel06: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel07: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel08: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel09: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel10: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel11: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel12: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel13: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel14: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel15: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel16: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel17: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel18: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel19: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel20: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel21: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel22: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel23: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel24: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 New Failures - Execution Time ----------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.48% (0.0625 => 0.0878) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.51% (0.1063 => 0.1398, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.67% (0.2969 => 0.3731, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.95% (0.1106 => 0.1382, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.23% (0.4139 => 0.5142, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.22% (0.4253 => 0.5283, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.75% (0.4994 => 0.6180, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 23.44% (1.5932 => 1.9666, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.22% (0.5900 => 0.7270, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.11% (0.0714 => 0.0879, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.95% (0.0584 => 0.0718, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.67% (0.0547 => 0.0671, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.38% (0.5000 => 0.6119, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.26% (0.0822 => 0.1005, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.85% (0.1620 => 0.1974, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.84% (0.1021 => 0.1244, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.52% (0.0897 => 0.1090, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.23% (0.1107 => 0.1342) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.40% (0.0642 => 0.0773) MultiSource/Benchmarks/Olden/em3d/em3d: 20.36% (0.0948 => 0.1141, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.31% (0.1103 => 0.1327, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.21% (0.0584 => 0.0702, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.04% (0.1003 => 0.1204, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.96% (0.0541 => 0.0649, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.81% (0.3903 => 0.4676, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 19.73% (0.0821 => 0.0983, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 19.64% (0.1619 => 0.1937, std.dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.64% (0.1604 => 0.1919, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.63% (0.1549 => 0.1853, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 19.37% (0.0604 => 0.0721, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.74% (0.1462 => 0.1736, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 18.48% (0.0947 => 0.1122, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.42% (0.2736 => 0.3240, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.20% (0.3890 => 0.4598, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 18.17% (0.4029 => 0.4761, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.02% (0.2014 => 0.2377, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.94% (1.3152 => 1.5511, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: 17.90% (0.1218 => 0.1436, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 17.80% (0.5826 => 0.6863, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 17.77% (0.0698 => 0.0822, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 17.56% (0.5889 => 0.6923, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.28% (0.1088 => 0.1276, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 17.28% (0.1505 => 0.1765, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.27% (0.2866 => 0.3361, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.15% (0.5026 => 0.5888, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 16.97% (0.5546 => 0.6487, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 16.74% (1.8794 => 2.1941, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.72% (3.5627 => 4.1585, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.62% (0.1968 => 0.2295, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 16.57% (0.7171 => 0.8359, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.49% (0.4658 => 0.5426, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.45% (0.2875 => 0.3348, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.38% (1.6211 => 1.8866, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.29% (0.3271 => 0.3804, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.25% (0.2738 => 0.3183, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.03% (0.1160 => 0.1346, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.98% (0.3930 => 0.4558, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 15.90% (0.1421 => 0.1647, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 15.89% (0.2813 => 0.3260, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.87% (2.7292 => 3.1622, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 15.78% (0.2750 => 0.3184, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 15.77% (0.2714 => 0.3142, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 15.76% (0.2823 => 0.3268, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 15.76% (0.9697 => 1.1225, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 15.68% (0.2780 => 0.3216, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.68% (0.3195 => 0.3696, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 15.56% (0.2725 => 0.3149, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 15.56% (1.0781 => 1.2458, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.55% (0.4361 => 0.5039, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 15.52% (0.2803 => 0.3238, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 15.51% (0.2811 => 0.3247, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.50% (0.2729 => 0.3152, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 15.50% (0.1284 => 0.1483, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.40% (0.2792 => 0.3222, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 15.38% (0.3004 => 0.3466, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.36% (0.2911 => 0.3358, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.34% (4.4195 => 5.0973, std.dev.: 0.0133) MultiSource/Applications/hexxagon/hexxagon: 15.33% (0.9909 => 1.1428, std.dev.: 0.0099) MultiSource/Applications/ClamAV/clamscan: 15.21% (4.2109 => 4.8513, std.dev.: 0.0103) MultiSource/Benchmarks/nbench/nbench: 15.20% (0.2566 => 0.2956, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.14% (2.0673 => 2.3802, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/wc: 15.08% (0.3096 => 0.3563, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 15.07% (23.5202 => 27.0655, std.dev.: 0.0147) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.97% (0.3488 => 0.4010, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.96% (1.9694 => 2.2641, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.77% (0.1090 => 0.1251, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 14.67% (0.3258 => 0.3736, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 14.66% (0.3267 => 0.3746, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 14.65% (0.3317 => 0.3803, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.64% (0.3060 => 0.3508, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.57% (1.9966 => 2.2875, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/moments: 14.44% (0.3678 => 0.4209, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.37% (0.3465 => 0.3963, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 14.36% (0.3446 => 0.3941, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 14.36% (0.3496 => 0.3998, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.31% (0.3460 => 0.3955, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.27% (0.3469 => 0.3964, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 14.21% (0.3442 => 0.3931, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 14.13% (0.3348 => 0.3821, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.08% (0.3124 => 0.3564, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.07% (0.3362 => 0.3835, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 14.06% (1.4269 => 1.6275, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists1: 13.98% (0.3477 => 0.3963, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.95% (0.3282 => 0.3740, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 13.92% (0.3650 => 0.4158, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 13.88% (0.3726 => 0.4243, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.81% (0.3643 => 0.4146, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 13.78% (0.2075 => 0.2361, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.74% (0.3625 => 0.4123, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.69% (0.3724 => 0.4234, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.46% (0.3981 => 0.4517, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 13.42% (0.7875 => 0.8932, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 13.41% (0.4146 => 0.4702, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.39% (0.3845 => 0.4360, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.28% (0.3690 => 0.4180, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 13.27% (0.4251 => 0.4815, std.dev.: 0.0043) MultiSource/Applications/JM/ldecod/ldecod: 12.97% (2.1653 => 2.4462, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/bigfib: 12.87% (0.5012 => 0.5657, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 12.57% (4.6177 => 5.1982, std.dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: 12.47% (2.1013 => 2.3633, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 12.30% (0.2691 => 0.3022, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 12.07% (5.5417 => 6.2107, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.00% (0.1383 => 0.1549, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.81% (0.2040 => 0.2281, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.75% (0.2068 => 0.2311, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.69% (0.6435 => 0.7187, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.38% (0.1028 => 0.1145, std.dev.: 0.0042) MultiSource/Applications/siod/siod: 10.90% (0.6634 => 0.7357, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.85% (0.2737 => 0.3034, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 10.69% (0.3498 => 0.3872, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.67% (0.3084 => 0.3413, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 10.46% (0.4847 => 0.5354, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 10.22% (0.3336 => 0.3677, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.89% (0.2103 => 0.2311, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 9.53% (2.0346 => 2.2285, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 9.20% (0.2391 => 0.2611, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.99% (4.6926 => 5.1146, std.dev.: 0.0166) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.63% (11.6398 => 12.6444, std.dev.: 0.0218) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.62% (0.5361 => 0.5823, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.08% (0.5584 => 0.6035, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.84% (0.7426 => 0.8008, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 6.64% (11.9555 => 12.7497, std.dev.: 0.0141) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.91% (0.3792 => 0.3978, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.26% (0.0734 => 0.0868, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 9.74% (0.2802 => 0.3075, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.56% (3.3903 => 3.6128, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: 6.08% (0.2122 => 0.2251, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6714, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1716, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-2: 4.60% (1.8057 => 1.8887, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.22% (0.3693 => 0.3849, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/dry: 4.14% (14.0481 => 14.6301, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1977, std.dev.: 0.0453) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.56% (3.1722 => 3.2217, std.dev.: 0.0057) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3076, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.32% (7.1849 => 7.2800, std.dev.: 0.0054) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5126, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5810, std.dev.: 0.0110) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5639, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/ary2: -8.37% (0.2402 => 0.2201, std.dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9758, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7983, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9576, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.51% (11.2080 => 10.8149, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7729, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8601, std.dev.: 0.0081) SingleSource/Benchmarks/Dhrystone/fldry: -2.11% (17.2379 => 16.8739, std.dev.: 0.0339) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.07% (0.6293 => 0.6163, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5764, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4956, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1745, std.dev.: 0.1041) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.03% (16.2163 => 16.0491, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 23:43:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 01:43:36 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121118074336.A63A12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5997?compare_to=5993&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5997, Order: 168280, Start Time: 2012-11-18 06:10:16, End Time: 2012-11-18 07:43:58 To: 5993, Order: 168278, Start Time: 2012-11-18 03:31:53, End Time: 2012-11-18 05:02:08 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 6 (42 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1048 (913 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.80% (1.4983 => 1.8848, std.dev.: 0.0140) SingleSource/Benchmarks/LivermoreLoops/kernel24: 17.16% (0.4988 => 0.5844, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.49% (21.3496 => 22.7351, std.dev.: 0.3822) SingleSource/Benchmarks/Shootout-C++/ary3: 1.95% (1.9987 => 2.0377, std.dev.: 0.0049) MultiSource/Benchmarks/llubenchmark/llu: 1.18% (1.9922 => 2.0158, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.18% (0.9290 => 0.9400, std.dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -2.06% (1.0690 => 1.0470, std.dev.: 0.2137) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 21.43% (0.0182 => 0.0221, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.38% (0.0414 => 0.0428, std.dev.: 0.0048) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0332 => 0.0333, std.dev.: 0.0083) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 12.01% (0.0283 => 0.0317, std.dev.: 0.0092) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 19.22% (0.0359 => 0.0428, std.dev.: 0.0091) SingleSource/UnitTests/Vector/Altivec/casts: 1.49% (0.0202 => 0.0205, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 1.39% (0.0216 => 0.0219, std.dev.: 0.0055) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 333.33% (0.0003 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.54% (0.1477 => 0.1485, std.dev.: 0.0244) MultiSource/Applications/lemon/lemon: 1.44% (1.1622 => 1.1789, std.dev.: 0.2990) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.47% (0.4283 => 0.4177, std.dev.: 0.0616) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.97% (0.1374 => 0.1347, std.dev.: 0.0343) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.82% (0.0605 => 0.0616, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.72% (0.0257 => 0.0264, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.12% (0.0607 => 0.0582, std.dev.: 0.0143) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.27% (1.1945 => 1.1977, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -87.50% (0.0008 => 0.0001, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -66.67% (0.0003 => 0.0001, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.67% (0.0631 => 0.0570, std.dev.: 0.0172) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 10.26% (0.0234 => 0.0258, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.41% (0.7812 => 0.7780, std.dev.: 0.1249) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 0.94% (0.0106 => 0.0107, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.38% (16.4461 => 17.6599, std.dev.: 0.6075) MultiSource/Applications/sqlite3/sqlite3: 2320.81% (0.6332 => 15.3286, std.dev.: 0.7488) MultiSource/Benchmarks/McCat/08-main/main: 47.95% (0.1831 => 0.2709, std.dev.: 0.0867) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.77% (0.1559 => 0.1469, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7192.06% (0.3123 => 22.7731, std.dev.: 0.9525) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.95% (0.2463 => 0.3718, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1526.56% (0.3344 => 5.4392, std.dev.: 0.2803) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.66% (0.2364 => 0.3278, std.dev.: 0.0207) SingleSource/Benchmarks/Misc-C++/bigfib: 5.29% (0.6010 => 0.6328, std.dev.: 0.2220) SingleSource/Benchmarks/Misc/mandel: 0.47% (0.0429 => 0.0431, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.06% (0.3266 => 0.3464, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 4.67% (0.1969 => 0.2061, std.dev.: 0.0746) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.25% (0.0224 => 0.0238, std.dev.: 0.0030) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0058) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0518, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 7.11% (0.1462 => 0.1566, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4638, std.dev.: 0.0905) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0724, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4931, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5154, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.8106, std.dev.: 0.2150) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3223, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1369, std.dev.: 0.0204) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3670, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4085, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0887, std.dev.: 0.0134) SingleSource/Regression/C/uint64_to_float: -23.74% (2.1832 => 1.6648, std.dev.: 0.0130) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 13.22% (0.1112 => 0.1259, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.74% (0.0848 => 0.0956, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.53% (0.0830 => 0.0934, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.75% (0.2180 => 0.2349, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.88% (0.3115 => 0.3236, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists1: 3.64% (0.2969 => 0.3077, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.20% (0.3657 => 0.3774, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.22% (0.5191 => 0.5306, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.11% (0.8995 => 0.9185, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.07% (0.8066 => 0.8233, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 121.11% (0.0199 => 0.0440, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/pi: 34.43% (1.5795 => 2.1233, std.dev.: 0.1833) SingleSource/Benchmarks/Shootout-C++/heapsort: 23.31% (3.0515 => 3.7629, std.dev.: 0.2660) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.70% (2.9753 => 3.4721, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.39% (0.7597 => 0.8766, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.49% (2.7995 => 3.2052, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6090, std.dev.: 0.0684) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.00% (1.1857 => 1.2805, std.dev.: 0.0180) SingleSource/Benchmarks/McGill/queens: 7.49% (1.7056 => 1.8333, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.62% (4.7794 => 5.0960, std.dev.: 0.0912) SingleSource/Benchmarks/Misc/richards_benchmark: 6.32% (1.3037 => 1.3861, std.dev.: 0.0115) MultiSource/Applications/SIBsim4/SIBsim4: 6.23% (3.1873 => 3.3860, std.dev.: 0.0694) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.90% (4.9686 => 5.2615, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.79% (4.5327 => 4.7951, std.dev.: 0.0127) MultiSource/Applications/lambda-0_1_3/lambda: 4.98% (7.4933 => 7.8667, std.dev.: 0.0304) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.75% (6.2275 => 6.5233, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.46% (3.3761 => 3.5268, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.16% (4.9453 => 5.1512, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.83% (4.9469 => 5.1362, std.dev.: 0.0565) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.29% (0.3587 => 0.3705, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 2.99% (3.6643 => 3.7738, std.dev.: 0.0351) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.63% (11.5690 => 11.8735, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout/lists: 2.52% (7.3375 => 7.5225, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 2.37% (0.4353 => 0.4456, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.25% (8.2783 => 8.4648, std.dev.: 0.0285) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.09% (4.8362 => 4.9375, std.dev.: 0.0292) SingleSource/Benchmarks/Shootout-C++/ary3: 1.89% (1.9999 => 2.0377, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/neural/neural: 1.33% (1.0841 => 1.0985, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.20% (1.5941 => 1.6132, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.11% (3.5679 => 3.6076, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/whetstone: 1.06% (2.1224 => 2.1450, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/power/power: 1.01% (1.2061 => 1.2183, std.dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.17% (5.4641 => 4.3073, std.dev.: 0.0788) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.67% (7.2130 => 6.2267, std.dev.: 0.1413) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.58% (1.0512 => 0.9400, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -10.10% (14.6451 => 13.1659, std.dev.: 0.4895) MultiSource/Benchmarks/mafft/pairlocalalign: -8.25% (63.1822 => 57.9677, std.dev.: 0.0967) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.90% (4.7482 => 4.4207, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.02% (5.4972 => 5.1663, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.92% (3.7148 => 3.4947, std.dev.: 0.0340) MultiSource/Benchmarks/nbench/nbench: -5.71% (21.9654 => 20.7104, std.dev.: 0.4476) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.19% (5.1557 => 4.8883, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.38% (4.7449 => 4.5369, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.76% (6.0224 => 5.7959, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.38% (0.5807 => 0.5611, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (28.5821 => 27.6974, std.dev.: 0.0822) MultiSource/Applications/aha/aha: -2.60% (3.3398 => 3.2530, std.dev.: 0.0206) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.57% (3.2169 => 3.1343, std.dev.: 0.0284) SingleSource/Benchmarks/Shootout-C++/hash2: -2.30% (3.4237 => 3.3448, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.80% (4.9994 => 4.9094, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.05% (5.6343 => 5.5750, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.03% (1.0262 => 1.0470, std.dev.: 0.2137) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 79.67% (0.0123 => 0.0221, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0048) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0083) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.97% (0.0302 => 0.0317, std.dev.: 0.0092) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.46% (0.0384 => 0.0428, std.dev.: 0.0091) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0055) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 3.27% (0.1438 => 0.1485, std.dev.: 0.0244) MultiSource/Applications/lemon/lemon: 4.06% (1.1329 => 1.1789, std.dev.: 0.2990) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.31% (0.4164 => 0.4177, std.dev.: 0.0616) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.61% (0.1369 => 0.1347, std.dev.: 0.0343) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.90% (0.0641 => 0.0616, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 35.38% (0.0195 => 0.0264, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.69% (0.0578 => 0.0582, std.dev.: 0.0143) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.72% (1.1437 => 1.1977, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.09% (0.0627 => 0.0570, std.dev.: 0.0172) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 43.33% (0.0180 => 0.0258, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.96% (0.8017 => 0.7780, std.dev.: 0.1249) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.58% (0.0062 => 0.0107, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 17 23:45:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 01:45:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121118074531.893382A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5998?compare_to=5994&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5998, Order: 168280, Start Time: 2012-11-18 06:13:04, End Time: 2012-11-18 07:45:54 To: 5994, Order: 168278, Start Time: 2012-11-18 03:38:00, End Time: 2012-11-18 05:10:46 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== New Failures: 0 (48 on baseline) Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (177 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 48 (0 on baseline) Unchanged Tests: 1043 (860 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 8.48% (0.3926 => 0.4259, std.dev.: 0.0062) Existing Failures - Compile Time -------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/LivermoreLoops/kernel01: - (0.0176 => 0.0176, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel02: - (0.0176 => 0.0176) SingleSource/Benchmarks/LivermoreLoops/kernel03: - (0.0175 => 0.0175) SingleSource/Benchmarks/LivermoreLoops/kernel04: - (0.0176 => 0.0176) SingleSource/Benchmarks/LivermoreLoops/kernel05: - (0.0175 => 0.0175) SingleSource/Benchmarks/LivermoreLoops/kernel06: - (0.0175 => 0.0175) SingleSource/Benchmarks/LivermoreLoops/kernel07: - (0.0176 => 0.0176, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel08: - (0.0180 => 0.0180) SingleSource/Benchmarks/LivermoreLoops/kernel09: - (0.0176 => 0.0176) SingleSource/Benchmarks/LivermoreLoops/kernel10: - (0.0177 => 0.0177, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel11: - (0.0175 => 0.0175, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel12: - (0.0175 => 0.0175) SingleSource/Benchmarks/LivermoreLoops/kernel13: - (0.0178 => 0.0178, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel14: - (0.0179 => 0.0179) SingleSource/Benchmarks/LivermoreLoops/kernel15: - (0.0183 => 0.0183) SingleSource/Benchmarks/LivermoreLoops/kernel16: - (0.0180 => 0.0180, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel17: 0.56% (0.0177 => 0.0178) SingleSource/Benchmarks/LivermoreLoops/kernel18: - (0.0183 => 0.0183) SingleSource/Benchmarks/LivermoreLoops/kernel19: - (0.0176 => 0.0176, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel20: - (0.0177 => 0.0177, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel21: - (0.0176 => 0.0176) SingleSource/Benchmarks/LivermoreLoops/kernel22: - (0.0176 => 0.0176, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel23: -0.56% (0.0177 => 0.0176, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel24: - (0.0175 => 0.0175, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/LivermoreLoops/kernel01: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel02: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel03: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel04: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel05: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel06: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel07: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel08: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel09: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel10: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel11: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel12: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel13: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel14: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel15: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel16: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel17: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel18: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel19: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel20: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel21: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel22: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel23: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel24: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 New Failures - Execution Time ----------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 11.09% (0.3834 => 0.4259, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.79% (2.0478 => 2.1050, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/salsa20: 2.39% (7.4937 => 7.6728, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/hash2: 2.20% (3.1932 => 3.2634, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.22% (0.3821 => 0.3507, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -6.84% (2.4924 => 2.3218, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -6.58% (0.3357 => 0.3136, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.57% (0.9542 => 0.8915, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.56% (0.3142 => 0.2936, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.30% (0.2428 => 0.2275, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -6.25% (0.2160 => 0.2025, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.18% (0.1796 => 0.1685, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.15% (0.9852 => 0.9246, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -6.11% (9.2283 => 8.6646, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.90% (0.7198 => 0.6773, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.90% (0.2355 => 0.2216, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -5.87% (16.1920 => 15.2417, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/ReedSolomon: -5.85% (0.1879 => 0.1769, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -5.82% (7.0961 => 6.6828, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/football/football: -5.82% (0.9179 => 0.8645, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.78% (1.3722 => 1.2929, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.74% (1.0544 => 0.9939, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.68% (3.5339 => 3.3331, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.68% (0.6484 => 0.6116, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.64% (0.2695 => 0.2543, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.55% (4.0323 => 3.8085, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.53% (4.8161 => 4.5496, std.dev.: 0.0041) MultiSource/Benchmarks/sim/sim: -5.52% (0.3406 => 0.3218, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.51% (0.5859 => 0.5536, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.51% (0.5805 => 0.5485, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.50% (0.6660 => 0.6294, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.49% (0.5863 => 0.5541, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.48% (4.8802 => 4.6130, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.47% (0.5591 => 0.5285, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.47% (1.4642 => 1.3841, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.46% (0.5857 => 0.5537, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -5.46% (1.1450 => 1.0825, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.45% (6.7716 => 6.4025, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.45% (0.6736 => 0.6369, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.45% (0.6681 => 0.6317, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.44% (1.6364 => 1.5473, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.44% (0.6052 => 0.5723, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -5.43% (4.3330 => 4.0976, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.43% (0.6230 => 0.5892, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.40% (4.5069 => 4.2635, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.39% (0.5802 => 0.5489, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.39% (1.2300 => 1.1637, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.39% (0.3658 => 0.3461, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.39% (0.5478 => 0.5183, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.38% (0.5575 => 0.5275, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.38% (0.6395 => 0.6051, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: -5.36% (0.4515 => 0.4273, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: -5.33% (1.1530 => 1.0915, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.31% (0.5688 => 0.5386, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.30% (0.6260 => 0.5928, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: -5.30% (1.3864 => 1.3129, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.30% (0.5925 => 0.5611, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.29% (0.7524 => 0.7126, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.26% (1.2784 => 1.2111, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.26% (0.5705 => 0.5405, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.25% (0.6667 => 0.6317, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.23% (0.5849 => 0.5543, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.21% (0.6676 => 0.6328, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.21% (0.5456 => 0.5172, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.19% (0.6395 => 0.6063, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.18% (0.5941 => 0.5633, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.17% (17.1032 => 16.2191, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.15% (0.8521 => 0.8082, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: -5.14% (0.3581 => 0.3397, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.14% (0.5569 => 0.5283, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -5.13% (1.2515 => 1.1873, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.12% (0.5567 => 0.5282, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.12% (14.2083 => 13.4811, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.10% (0.7339 => 0.6965, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -5.09% (0.2985 => 0.2833, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.09% (0.5581 => 0.5297, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.04% (0.5570 => 0.5289, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.01% (1.2210 => 1.1598, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.01% (0.6033 => 0.5731, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.00% (0.3483 => 0.3309, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.00% (0.6446 => 0.6124, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.96% (0.2278 => 0.2165, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.94% (0.4916 => 0.4673, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.93% (0.5999 => 0.5703, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.92% (0.6440 => 0.6123, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.91% (8.0126 => 7.6192, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.91% (0.2548 => 0.2423, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.90% (0.2999 => 0.2852, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -4.89% (3.5154 => 3.3434, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.85% (1.2221 => 1.1628, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: -4.85% (0.2659 => 0.2530, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.84% (0.7919 => 0.7536, std.dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.82% (0.3319 => 0.3159, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.77% (1.6474 => 1.5689, std.dev.: 0.0056) MultiSource/Applications/minisat/minisat: -4.74% (0.7447 => 0.7094, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -4.69% (15.2527 => 14.5373, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.65% (0.2385 => 0.2274, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -4.65% (4.0594 => 3.8706, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.64% (0.5168 => 0.4928, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.60% (0.6304 => 0.6014, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -4.60% (15.5079 => 14.7947, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.59% (0.6293 => 0.6004, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/trivial-interface: -4.59% (0.3812 => 0.3637, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.56% (0.4033 => 0.3849, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -4.56% (0.3880 => 0.3703, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -4.55% (0.4176 => 0.3986, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -4.55% (1.3148 => 1.2550, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -4.50% (0.3848 => 0.3675, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.48% (0.6297 => 0.6015, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.47% (0.6194 => 0.5917, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.47% (0.5329 => 0.5091, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.46% (0.7021 => 0.6708, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.44% (22.4056 => 21.4108, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions-2: -4.44% (0.3831 => 0.3661, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.43% (0.3884 => 0.3712, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.41% (0.3896 => 0.3724, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -4.41% (2.4021 => 2.2962, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.41% (0.4151 => 0.3968, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.38% (0.6189 => 0.5918, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.37% (0.3891 => 0.3721, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -4.30% (2.1401 => 2.0480, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/matrix: -4.30% (0.3255 => 0.3115, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -4.29% (5.0226 => 4.8072, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: -4.29% (0.4199 => 0.4019, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -4.24% (0.4861 => 0.4655, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -4.22% (0.3271 => 0.3133, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.21% (0.3016 => 0.2889, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.20% (0.3931 => 0.3766, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.20% (0.3837 => 0.3676, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.18% (2.2587 => 2.1643, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -4.13% (0.3025 => 0.2900, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.12% (0.3252 => 0.3118, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.12% (0.2989 => 0.2866, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.11% (0.8418 => 0.8072, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.09% (0.9557 => 0.9166, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -4.08% (0.7982 => 0.7656, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.08% (0.3849 => 0.3692, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -4.06% (0.3026 => 0.2903, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -4.05% (34.0927 => 32.7108, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/parameter-passing: -4.04% (0.4280 => 0.4107, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -4.03% (0.3446 => 0.3307, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -4.03% (18.2933 => 17.5558, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/objinst: -3.98% (0.3194 => 0.3067, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.96% (2.1713 => 2.0854, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary: -3.95% (0.3394 => 0.3260, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -3.93% (0.3867 => 0.3715, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.92% (0.9077 => 0.8721, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.91% (0.4321 => 0.4152, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -3.89% (0.3059 => 0.2940, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: -3.87% (0.2871 => 0.2760, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.83% (0.3057 => 0.2940, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -3.79% (0.3481 => 0.3349, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -3.78% (0.2939 => 0.2828, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.75% (0.2933 => 0.2823, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.74% (0.4813 => 0.4633, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -3.73% (0.3621 => 0.3486, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.72% (0.2903 => 0.2795, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.68% (0.4427 => 0.4264, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -3.68% (0.3205 => 0.3087, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -3.65% (0.2849 => 0.2745, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.48% (0.4083 => 0.3941, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.47% (0.3491 => 0.3370, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -3.45% (0.7779 => 0.7511, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: -3.40% (0.6347 => 0.6131, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -3.39% (0.6750 => 0.6521, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: -3.38% (0.3788 => 0.3660, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -3.29% (0.6441 => 0.6229, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.14% (1.5610 => 1.5120, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.13% (5.4682 => 5.2970, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/hash: -3.12% (0.4524 => 0.4383, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.26% (20.7746 => 20.3044, std.dev.: 0.0556) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7576, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/richards_benchmark: -8.72% (1.2842 => 1.1722, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7060, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.77% (2.2633 => 2.1780, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.08% (1.3096 => 1.2692, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.71% (6.5735 => 6.4608, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 18 01:30:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 03:30:13 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121118093013.929472A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5999?compare_to=5997&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5999, Order: 168283, Start Time: 2012-11-18 08:00:48, End Time: 2012-11-18 09:30:34 To: 5997, Order: 168280, Start Time: 2012-11-18 06:10:16, End Time: 2012-11-18 07:43:58 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 10 (111 on baseline) Performance Improvements: 10 (26 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1034 (837 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.18% (0.8182 => 0.8360, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.12% (0.8716 => 0.8901, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 1.65% (1.4659 => 1.4901, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.52% (0.9298 => 0.9439, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.50% (0.8845 => 0.8978, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 1.38% (3.9281 => 3.9824, std.dev.: 0.0072) MultiSource/Applications/hexxagon/hexxagon: 1.13% (1.0028 => 1.0141, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 18.36% (2.1233 => 2.5131, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.52% (1.3661 => 1.4278, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 1.67% (0.8766 => 0.8912, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.57% (0.2475 => 0.2362, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.63% (22.7731 => 22.4011, std.dev.: 0.1291) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -19.71% (3.7629 => 3.0214, std.dev.: 0.0698) SingleSource/Benchmarks/CoyoteBench/fftbench: -17.56% (1.8106 => 1.4927, std.dev.: 0.0359) SingleSource/Benchmarks/Shootout/heapsort: -11.74% (3.5656 => 3.1469, std.dev.: 0.0581) SingleSource/Benchmarks/CoyoteBench/lpbench: -4.48% (4.0924 => 3.9092, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.64% (42.4679 => 40.9212, std.dev.: 0.3372) SingleSource/Benchmarks/Shootout-C++/ary3: -1.85% (2.0377 => 2.0000, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.83% (22.7351 => 22.3192, std.dev.: 0.1563) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.07% (0.9400 => 0.9299, std.dev.: 0.0037) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.96% (1.0470 => 1.0571, std.dev.: 0.0089) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -27.15% (0.0221 => 0.0161, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -10.98% (0.0428 => 0.0381, std.dev.: 0.0063) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.00% (0.0333 => 0.0323, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -25.55% (0.0317 => 0.0236, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.84% (0.0428 => 0.0403, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: -13.17% (0.0205 => 0.0178, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/test1: -20.55% (0.0219 => 0.0174, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -1.14% (0.1485 => 0.1468, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: -1.26% (1.1789 => 1.1640, std.dev.: 0.0097) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.52% (0.4177 => 0.4324, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.38% (0.1347 => 0.1406, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.28% (0.0616 => 0.0565, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -21.97% (0.0264 => 0.0206, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.01% (0.0582 => 0.0547, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.74% (1.1977 => 1.1888, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.79% (0.0570 => 0.0603, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.83% (0.0258 => 0.0212, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.7780 => 0.7780, std.dev.: 0.0062) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: -85.71% (0.0007 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -57.01% (0.0107 => 0.0046, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.35% (16.4461 => 17.6541, std.dev.: 0.0982) MultiSource/Applications/sqlite3/sqlite3: 2323.45% (0.6332 => 15.3453, std.dev.: 0.1994) MultiSource/Benchmarks/McCat/08-main/main: 48.01% (0.1831 => 0.2710, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.92% (0.1559 => 0.1420, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7072.94% (0.3123 => 22.4011, std.dev.: 0.1291) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.55% (0.2463 => 0.3708, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1527.36% (0.3344 => 5.4419, std.dev.: 0.0297) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.49% (0.2364 => 0.3274, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 5.49% (0.6010 => 0.6340, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel: 0.23% (0.0429 => 0.0430, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.21% (0.3266 => 0.3436, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 4.37% (0.1969 => 0.2055, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -11.16% (0.0224 => 0.0199, std.dev.: 0.0020) SingleSource/UnitTests/byval-alignment: -31.74% (0.0230 => 0.0157, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0450, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 7.18% (0.1462 => 0.1567, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4637, std.dev.: 0.0135) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0695, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4905, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5111, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.4927, std.dev.: 0.0359) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3155, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1271, std.dev.: 0.0441) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3640, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4097, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0876, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: -23.41% (2.1832 => 1.6722, std.dev.: 0.0023) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.44% (0.0810 => 0.0927, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.60% (0.1425 => 0.1576, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.11% (0.2180 => 0.2335, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.49% (0.8321 => 0.8778, std.dev.: 0.0119) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.39% (0.2133 => 0.2248, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.33% (0.7473 => 0.7871, std.dev.: 0.0148) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.26% (0.3137 => 0.3302, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.24% (1.1606 => 1.2214, std.dev.: 0.0125) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.19% (0.1983 => 0.2086, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.94% (4.1763 => 4.3825, std.dev.: 0.0433) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.88% (1.6386 => 1.7186, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.84% (0.2998 => 0.3143, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.53% (0.8331 => 0.8708, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.50% (0.8518 => 0.8901, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.45% (0.2519 => 0.2631, std.dev.: 0.0028) MultiSource/Applications/hbd/hbd: 4.43% (1.4269 => 1.4901, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.31% (0.9435 => 0.9842, std.dev.: 0.0068) MultiSource/Applications/lua/lua: 4.28% (3.8189 => 3.9824, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.17% (0.4559 => 0.4749, std.dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.08% (0.4783 => 0.4978, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.02% (0.9074 => 0.9439, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.01% (0.3295 => 0.3427, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: 3.97% (1.2222 => 1.2707, std.dev.: 0.0136) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.87% (1.2526 => 1.3011, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 3.86% (0.6834 => 0.7098, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.83% (0.9069 => 0.9416, std.dev.: 0.0055) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.82% (6.6074 => 6.8598, std.dev.: 0.0968) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.72% (0.8656 => 0.8978, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.67% (0.9908 => 1.0272, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 3.63% (0.8069 => 0.8362, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.58% (13.1811 => 13.6526, std.dev.: 0.1343) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.53% (0.8697 => 0.9004, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.53% (0.8340 => 0.8634, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/lists1: 3.50% (0.2969 => 0.3073, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.43% (2.1401 => 2.2135, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.42% (1.4479 => 1.4974, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.39% (0.8086 => 0.8360, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.37% (0.9039 => 0.9344, std.dev.: 0.0086) MultiSource/Applications/hexxagon/hexxagon: 3.37% (0.9810 => 1.0141, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 3.33% (0.8927 => 0.9224, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.32% (0.8805 => 0.9097, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.25% (0.7966 => 0.8225, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.21% (0.8855 => 0.9139, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.12% (0.8177 => 0.8432, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.96% (4.4873 => 4.6201, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.93% (0.8048 => 0.8284, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.91% (0.5191 => 0.5342, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.90% (3.1832 => 3.2756, std.dev.: 0.0080) MultiSource/Applications/ClamAV/clamscan: 2.85% (14.7684 => 15.1894, std.dev.: 0.0503) MultiSource/Applications/siod/siod: 2.85% (2.2184 => 2.2816, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.77% (0.8261 => 0.8490, std.dev.: 0.0038) MultiSource/Applications/SIBsim4/SIBsim4: 2.75% (1.2568 => 1.2913, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.71% (0.9688 => 0.9951, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.70% (1.5315 => 1.5728, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.66% (0.8007 => 0.8220, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.65% (0.8611 => 0.8839, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.63% (0.6586 => 0.6759, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.61% (0.8359 => 0.8577, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.60% (0.8885 => 0.9116, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 2.54% (0.7557 => 0.7749, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.47% (0.9056 => 0.9280, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.43% (0.8712 => 0.8924, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.33% (0.8204 => 0.8395, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.33% (0.8597 => 0.8797, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.30% (0.8420 => 0.8614, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/05-eks/eks: 2.27% (0.4397 => 0.4497, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: 2.26% (2.3764 => 2.4300, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.24% (0.8286 => 0.8472, std.dev.: 0.0068) MultiSource/Benchmarks/Bullet/bullet: 2.20% (31.8598 => 32.5616, std.dev.: 0.1012) MultiSource/Applications/JM/lencod/lencod: 2.14% (15.3280 => 15.6562, std.dev.: 0.0882) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.12% (0.8066 => 0.8237, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 2.09% (1.0945 => 1.1174, std.dev.: 0.0065) MultiSource/Applications/JM/ldecod/ldecod: 2.02% (6.7320 => 6.8682, std.dev.: 0.0449) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.95% (0.8338 => 0.8501, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 1.24% (8.6247 => 8.7314, std.dev.: 0.0379) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 92.96% (0.0199 => 0.0384, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/pi: 59.11% (1.5795 => 2.5131, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.31% (0.7597 => 0.8912, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.43% (2.9753 => 3.4641, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.67% (2.7995 => 3.2101, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.54% (5.0261 => 5.6062, std.dev.: 0.0104) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.14% (1.1857 => 1.2822, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 7.47% (1.7056 => 1.8330, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.63% (4.7794 => 5.0962, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/richards_benchmark: 6.52% (1.3037 => 1.3887, std.dev.: 0.0038) MultiSource/Applications/SIBsim4/SIBsim4: 6.09% (3.1873 => 3.3814, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.90% (0.3186 => 0.3374, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.84% (4.9686 => 5.2590, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.73% (4.5327 => 4.7924, std.dev.: 0.0218) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.20% (6.3772 => 6.7086, std.dev.: 0.1175) MultiSource/Applications/lambda-0_1_3/lambda: 4.82% (7.4933 => 7.8545, std.dev.: 0.0625) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.52% (6.2275 => 6.5090, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.51% (3.3761 => 3.5283, std.dev.: 0.0350) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.13% (4.9469 => 5.1510, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.07% (4.9453 => 5.1467, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 3.91% (14.0064 => 14.5546, std.dev.: 0.0116) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.67% (1.2337 => 1.2790, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.26% (0.3587 => 0.3704, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.85% (1.3882 => 1.4278, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.84% (11.5690 => 11.8973, std.dev.: 0.0017) MultiSource/Applications/siod/siod: 2.80% (3.6643 => 3.7669, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.69% (8.2783 => 8.5011, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/lists: 2.34% (7.3375 => 7.5091, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.30% (4.8660 => 4.9779, std.dev.: 0.0153) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.27% (4.8362 => 4.9462, std.dev.: 0.0386) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.01% (1.1365 => 1.1594, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.23% (3.5679 => 3.6117, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/power/power: 1.14% (1.2061 => 1.2199, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/neural/neural: 1.11% (1.0841 => 1.0961, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.00% (2.4647 => 2.4894, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/ReedSolomon: 1.00% (8.5322 => 8.6176, std.dev.: 0.0122) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.04% (5.4641 => 4.3143, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.10% (7.2130 => 6.1960, std.dev.: 0.2649) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.54% (1.0512 => 0.9299, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/chomp: -10.61% (1.1216 => 1.0026, std.dev.: 0.0396) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.95% (14.6451 => 13.3344, std.dev.: 0.2454) MultiSource/Benchmarks/mafft/pairlocalalign: -8.56% (63.1822 => 57.7708, std.dev.: 0.0408) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.08% (0.3269 => 0.3005, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.95% (4.7482 => 4.4184, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.83% (3.7148 => 3.4984, std.dev.: 0.0376) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.68% (5.4972 => 5.1851, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.06% (5.1557 => 4.8947, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.30% (4.7449 => 4.5407, std.dev.: 0.0221) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.84% (2.8773 => 2.7668, std.dev.: 0.0108) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.64% (2.4490 => 2.3599, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.47% (6.0224 => 5.8135, std.dev.: 0.0381) MultiSource/Applications/lua/lua: -3.29% (29.8330 => 28.8507, std.dev.: 0.0730) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.03% (28.5821 => 27.7169, std.dev.: 0.1567) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.97% (2.6356 => 2.5573, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.67% (0.5807 => 0.5652, std.dev.: 0.0006) MultiSource/Applications/aha/aha: -2.65% (3.3398 => 3.2512, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/mason/mason: -2.64% (0.5415 => 0.5272, std.dev.: 0.0030) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.42% (1.2822 => 1.2512, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/hash2: -2.41% (3.4237 => 3.3411, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.34% (9.9065 => 9.6745, std.dev.: 0.0336) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.98% (11.5316 => 11.3029, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.59% (2.3487 => 2.3113, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.01% (1.0262 => 1.0571, std.dev.: 0.0089) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 30.89% (0.0123 => 0.0161, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -6.62% (0.0408 => 0.0381, std.dev.: 0.0063) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 27.17% (0.0254 => 0.0323, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -21.85% (0.0302 => 0.0236, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 4.95% (0.0384 => 0.0403, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: -6.32% (0.0190 => 0.0178, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/test1: -3.33% (0.0180 => 0.0174, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.09% (0.1438 => 0.1468, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 2.75% (1.1329 => 1.1640, std.dev.: 0.0097) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.84% (0.4164 => 0.4324, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.70% (0.1369 => 0.1406, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.86% (0.0641 => 0.0565, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.64% (0.0195 => 0.0206, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.36% (0.0578 => 0.0547, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.94% (1.1437 => 1.1888, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.83% (0.0627 => 0.0603, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 17.78% (0.0180 => 0.0212, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.96% (0.8017 => 0.7780, std.dev.: 0.0062) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.81% (0.0062 => 0.0046, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 18 01:35:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 03:35:50 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121118093550.6CFBB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6000?compare_to=5995&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6000, Order: 168280, Start Time: 2012-11-18 07:12:32, End Time: 2012-11-18 09:36:12 To: 5995, Order: 168278, Start Time: 2012-11-18 04:00:48, End Time: 2012-11-18 06:20:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (50 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 39 (137 on baseline) Performance Improvements: 4 (39 on baseline) Added Tests: 0 (136 on baseline) Existing Failures: 52 (2 on baseline) Unchanged Tests: 997 (711 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 17.02% (2.4837 => 2.9065, std.dev.: 0.0215) MultiSource/Applications/SIBsim4/SIBsim4: 14.74% (1.5391 => 1.7660, std.dev.: 0.0080) MultiSource/Applications/minisat/minisat: 14.59% (0.8175 => 0.9368, std.dev.: 0.0191) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 14.51% (0.1172 => 0.1342, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 13.50% (0.3371 => 0.3826, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/random: 13.09% (0.3032 => 0.3429, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/objinst: 12.88% (0.3332 => 0.3761, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: 12.73% (0.3347 => 0.3773, std.dev.: 0.0096) MultiSource/Benchmarks/McCat/18-imp/imp: 12.69% (0.3894 => 0.4388, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.45% (0.6344 => 0.7134, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists1: 12.00% (0.4065 => 0.4553, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.84% (0.5919 => 0.6620, std.dev.: 0.0194) MultiSource/Applications/siod/siod: 10.50% (2.6440 => 2.9216, std.dev.: 0.0507) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.16% (0.3023 => 0.3330, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.61% (0.3123 => 0.3423, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.42% (0.9101 => 0.9958, std.dev.: 0.0093) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.07% (0.2105 => 0.2296, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.06% (0.7204 => 0.7857, std.dev.: 0.0216) SingleSource/Benchmarks/Shootout-C++/methcall: 8.80% (0.3126 => 0.3401, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.59% (1.5648 => 1.6992, std.dev.: 0.0340) SingleSource/Benchmarks/Misc-C++/bigfib: 8.31% (0.7255 => 0.7858, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.14% (0.4314 => 0.4665, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 7.46% (0.1676 => 0.1801, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: 7.38% (0.2196 => 0.2358, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.60% (1.5140 => 1.6139, std.dev.: 0.0250) MultiSource/Applications/hbd/hbd: 6.00% (1.7332 => 1.8372, std.dev.: 0.0332) MultiSource/Applications/treecc/treecc: 4.35% (2.4778 => 2.5856, std.dev.: 0.0142) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 20.70% (1.3391 => 1.6163, std.dev.: 0.0403) SingleSource/Benchmarks/Shootout-C++/moments: 17.21% (0.1220 => 0.1430, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/puzzle: 10.23% (0.6940 => 0.7650, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 10.11% (6.6186 => 7.2877, std.dev.: 0.0937) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 9.98% (0.3436 => 0.3779, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/hash: 9.00% (4.9382 => 5.3825, std.dev.: 0.0444) SingleSource/Benchmarks/Shootout/strcat: 8.38% (0.1933 => 0.2095, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 7.54% (5.2268 => 5.6208, std.dev.: 0.0393) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 7.34% (0.2289 => 0.2457, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 3.95% (2.0042 => 2.0833, std.dev.: 0.0128) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.14% (2.3075 => 2.3339, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.01% (4.1553 => 4.1974, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/lists: -10.65% (0.4328 => 0.3867, std.dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -9.53% (0.6534 => 0.5911, std.dev.: 0.0239) SingleSource/Benchmarks/Shootout-C++/sumcol: -7.57% (0.3408 => 0.3150, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/wc: -6.53% (0.3555 => 0.3323, std.dev.: 0.0030) Existing Failures - Compile Time -------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/LivermoreLoops/kernel01: - (0.0193 => 0.0193, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel02: - (0.0194 => 0.0194, std.dev.: 0.0006) SingleSource/Benchmarks/LivermoreLoops/kernel03: - (0.0192 => 0.0192, std.dev.: 0.0004) SingleSource/Benchmarks/LivermoreLoops/kernel04: - (0.0194 => 0.0194, std.dev.: 0.0004) SingleSource/Benchmarks/LivermoreLoops/kernel05: - (0.0193 => 0.0193, std.dev.: 0.0004) SingleSource/Benchmarks/LivermoreLoops/kernel06: - (0.0193 => 0.0193, std.dev.: 0.0004) SingleSource/Benchmarks/LivermoreLoops/kernel07: - (0.0194 => 0.0194, std.dev.: 0.0004) SingleSource/Benchmarks/LivermoreLoops/kernel08: 0.51% (0.0198 => 0.0199, std.dev.: 0.0004) SingleSource/Benchmarks/LivermoreLoops/kernel09: - (0.0194 => 0.0194, std.dev.: 0.0004) SingleSource/Benchmarks/LivermoreLoops/kernel10: - (0.0195 => 0.0195, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel11: - (0.0193 => 0.0193) SingleSource/Benchmarks/LivermoreLoops/kernel12: - (0.0192 => 0.0192, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel13: - (0.0196 => 0.0196, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel14: - (0.0197 => 0.0197, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel15: -0.50% (0.0202 => 0.0201, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel16: - (0.0199 => 0.0199, std.dev.: 0.0002) SingleSource/Benchmarks/LivermoreLoops/kernel17: - (0.0196 => 0.0196, std.dev.: 0.0008) SingleSource/Benchmarks/LivermoreLoops/kernel18: - (0.0201 => 0.0201, std.dev.: 0.0010) SingleSource/Benchmarks/LivermoreLoops/kernel19: -0.51% (0.0195 => 0.0194, std.dev.: 0.0007) SingleSource/Benchmarks/LivermoreLoops/kernel20: - (0.0195 => 0.0195, std.dev.: 0.0007) SingleSource/Benchmarks/LivermoreLoops/kernel21: - (0.0193 => 0.0193, std.dev.: 0.0006) SingleSource/Benchmarks/LivermoreLoops/kernel22: - (0.0194 => 0.0194, std.dev.: 0.0008) SingleSource/Benchmarks/LivermoreLoops/kernel23: - (0.0194 => 0.0194, std.dev.: 0.0008) SingleSource/Benchmarks/LivermoreLoops/kernel24: - (0.0193 => 0.0193, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 MultiSource/Applications/oggenc/oggenc: 0.81% (0.1354 => 0.1365, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0420 => 0.0421, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0652 => 0.0652, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -0.03% (493.8550 => 493.7054, std.dev.: 0.3055) SingleSource/Benchmarks/LivermoreLoops/kernel01: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel02: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel03: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel04: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel05: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel06: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel07: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel08: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel09: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel10: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel11: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel12: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel13: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel14: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel15: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel16: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel17: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel18: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel19: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel20: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel21: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel22: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel23: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel24: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0421, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/power/power: 43679.85% (1.1277 => 493.7054, std.dev.: 0.3055) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 237.73% (0.5229 => 1.7660, std.dev.: 0.0080) MultiSource/Applications/SPASS/SPASS: 22.83% (14.9895 => 18.4113, std.dev.: 0.0357) MultiSource/Applications/kimwitu++/kc: 50.79% (14.1553 => 21.3441, std.dev.: 0.1026) MultiSource/Benchmarks/MallocBench/gs/gs: 15.80% (4.1105 => 4.7598, std.dev.: 0.2899) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 46.08% (1.1048 => 1.6139, std.dev.: 0.0250) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 437.01% (7.1582 => 38.4400, std.dev.: 0.1211) SingleSource/Benchmarks/Misc-C++-EH/spirit: 87.71% (3.4629 => 6.5003, std.dev.: 0.2988) SingleSource/Benchmarks/Misc-C++/stepanov_container: 70.41% (0.6222 => 1.0603, std.dev.: 0.0520) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10558.06% (0.0720 => 7.6738, std.dev.: 0.1118) MultiSource/Applications/SIBsim4/SIBsim4: 3876400.00% (0.0001 => 3.8765, std.dev.: 0.0382) MultiSource/Applications/SPASS/SPASS: 13731400.00% (0.0001 => 13.7315, std.dev.: 0.6403) MultiSource/Applications/kimwitu++/kc: 51700.00% (0.0001 => 0.0518, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 65200.00% (0.0001 => 0.0653, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14400.00% (0.0001 => 0.0145, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576000.00% (0.0001 => 0.5761, std.dev.: 0.0253) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10076400.00% (0.0001 => 10.0765, std.dev.: 0.0236) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6718400.00% (0.0001 => 6.7185, std.dev.: 0.2881) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1785.15% (1.1194 => 21.1024, std.dev.: 0.1317) MultiSource/Applications/ClamAV/clamscan: 69.69% (22.1758 => 37.6295, std.dev.: 0.3771) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.93% (2.9384 => 4.6407, std.dev.: 0.2620) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.14% (7.0540 => 11.0847, std.dev.: 0.2702) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 52.01% (8.1363 => 12.3679, std.dev.: 0.0115) MultiSource/Applications/JM/lencod/lencod: 49.13% (21.9371 => 32.7158, std.dev.: 0.0563) MultiSource/Benchmarks/FreeBench/distray/distray: 45.55% (0.1056 => 0.1537, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/almabench: 38.49% (0.0730 => 0.1011, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: 38.34% (0.1432 => 0.1981, std.dev.: 0.0112) MultiSource/Benchmarks/McCat/15-trie/trie: 34.72% (0.0527 => 0.0710, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 31.97% (2.2024 => 2.9065, std.dev.: 0.0215) MultiSource/Applications/minisat/minisat: 31.67% (0.7115 => 0.9368, std.dev.: 0.0191) SingleSource/UnitTests/vla: 31.55% (0.0355 => 0.0467, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/n-body: 29.49% (0.0746 => 0.0966, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 28.54% (0.1044 => 0.1342, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 28.27% (0.0467 => 0.0599, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 28.19% (0.3423 => 0.4388, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 28.10% (0.5569 => 0.7134, std.dev.: 0.0049) MultiSource/Applications/treecc/treecc: 27.54% (2.0273 => 2.5856, std.dev.: 0.0142) MultiSource/Applications/siod/siod: 27.20% (2.2969 => 2.9216, std.dev.: 0.0507) MultiSource/Benchmarks/Olden/tsp/tsp: 26.55% (0.1175 => 0.1487, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.16% (0.0730 => 0.0921, std.dev.: 0.0061) MultiSource/Applications/sgefa/sgefa: 25.80% (0.3109 => 0.3911, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/em3d/em3d: 25.60% (0.1695 => 0.2129, std.dev.: 0.0099) MultiSource/Applications/oggenc/oggenc: 25.41% (5.7591 => 7.2226, std.dev.: 0.0827) SingleSource/Benchmarks/Stanford/Oscar: 24.06% (0.0636 => 0.0789, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 23.98% (0.0442 => 0.0548, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 23.59% (0.3684 => 0.4553, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: 23.50% (0.3098 => 0.3826, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 22.92% (0.8101 => 0.9958, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/08-main/main: 22.63% (0.2554 => 0.3132, std.dev.: 0.0198) MultiSource/Benchmarks/NPB-serial/is/is: 22.39% (0.0719 => 0.0880, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 22.38% (0.2802 => 0.3429, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/bh/bh: 22.02% (0.3092 => 0.3773, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.97% (14.3668 => 17.5234, std.dev.: 0.1295) SingleSource/Benchmarks/Misc-C++/bigfib: 21.72% (0.6456 => 0.7858, std.dev.: 0.0196) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.52% (0.1566 => 0.1903, std.dev.: 0.0075) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 21.35% (0.1892 => 0.2296, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.28% (0.1029 => 0.1248, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 20.70% (0.3865 => 0.4665, std.dev.: 0.0099) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.45% (0.1584 => 0.1908, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ackermann: 20.28% (0.2756 => 0.3315, std.dev.: 0.0123) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.18% (0.0793 => 0.0953, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/whetstone: 20.15% (0.0660 => 0.0793, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 20.12% (0.3131 => 0.3761, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.78% (1.4186 => 1.6992, std.dev.: 0.0340) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 19.70% (1.5859 => 1.8984, std.dev.: 0.0814) SingleSource/Benchmarks/Shootout-C++/nestedloop: 19.23% (0.2793 => 0.3330, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/heapsort: 19.19% (0.2872 => 0.3423, std.dev.: 0.0050) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.02% (0.1125 => 0.1339, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/sieve: 18.96% (0.3603 => 0.4286, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.40% (0.5860 => 0.6938, std.dev.: 0.0283) SingleSource/Benchmarks/Shootout-C++/methcall: 18.21% (0.2877 => 0.3401, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.91% (0.0871 => 0.1027, std.dev.: 0.0040) MultiSource/Applications/hbd/hbd: 17.75% (1.5603 => 1.8372, std.dev.: 0.0332) SingleSource/Benchmarks/Shootout/lists: 17.73% (0.0626 => 0.0737, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.70% (0.0842 => 0.0991, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary2: 17.37% (0.3379 => 0.3966, std.dev.: 0.0138) MultiSource/Applications/sqlite3/sqlite3: 17.20% (17.1811 => 20.1363, std.dev.: 0.1612) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.97% (0.8172 => 0.9559, std.dev.: 0.0409) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.74% (0.0675 => 0.0788, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 16.61% (9.4845 => 11.0600, std.dev.: 0.2341) MultiSource/Applications/lua/lua: 16.50% (3.8723 => 4.5111, std.dev.: 0.2093) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 16.42% (0.1906 => 0.2219, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.32% (0.2065 => 0.2402, std.dev.: 0.0099) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.05% (0.0648 => 0.0752, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary: 16.03% (0.3232 => 0.3750, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/health/health: 16.01% (0.1268 => 0.1471, std.dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference: 15.94% (0.7326 => 0.8494, std.dev.: 0.0169) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.80% (0.0886 => 0.1026, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 15.79% (0.5105 => 0.5911, std.dev.: 0.0239) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.64% (0.3121 => 0.3609, std.dev.: 0.0160) MultiSource/Applications/viterbi/viterbi: 15.31% (0.1555 => 0.1793, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.19% (0.0770 => 0.0887, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/ReedSolomon: 15.08% (0.2049 => 0.2358, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/moments: 14.97% (0.4048 => 0.4654, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.94% (0.0770 => 0.0885, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.87% (0.2758 => 0.3168, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.58% (0.1337 => 0.1532, std.dev.: 0.0069) SingleSource/UnitTests/SignlessTypes/rem: 14.25% (0.1144 => 0.1307, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.06% (0.3307 => 0.3772, std.dev.: 0.0098) MultiSource/Benchmarks/Bullet/bullet: 13.99% (63.2438 => 72.0899, std.dev.: 0.2208) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.93% (0.5981 => 0.6814, std.dev.: 0.0319) SingleSource/UnitTests/ObjC/trivial-interface: 13.82% (0.3473 => 0.3953, std.dev.: 0.0147) SingleSource/UnitTests/ObjC/property: 13.72% (0.3886 => 0.4419, std.dev.: 0.0182) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.52% (0.4615 => 0.5239, std.dev.: 0.0234) SingleSource/UnitTests/ObjC/exceptions-4: 13.52% (0.3543 => 0.4022, std.dev.: 0.0129) SingleSource/UnitTests/ObjC/for-in: 13.43% (0.3694 => 0.4190, std.dev.: 0.0156) MultiSource/Applications/d/make_dparser: 13.42% (3.3354 => 3.7831, std.dev.: 0.1246) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.36% (4.9449 => 5.6057, std.dev.: 0.2491) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.31% (5.0018 => 5.6673, std.dev.: 0.2375) SingleSource/UnitTests/ObjC/exceptions: 13.30% (0.3828 => 0.4337, std.dev.: 0.0172) SingleSource/UnitTests/ObjC++/property-reference-object: 13.25% (0.6030 => 0.6829, std.dev.: 0.0242) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.82% (0.8067 => 0.9101, std.dev.: 0.0329) SingleSource/UnitTests/ObjC++/Hello: 11.81% (0.5925 => 0.6625, std.dev.: 0.0176) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.46% (0.1143 => 0.1274, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 11.20% (0.1268 => 0.1410, std.dev.: 0.0054) MultiSource/Benchmarks/PAQ8p/paq8p: 9.17% (10.3673 => 11.3177, std.dev.: 0.2839) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.96% (0.2891 => 0.3150, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/wc: 8.88% (0.3052 => 0.3323, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.76% (0.1438 => 0.1564, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.46% (7.9617 => 8.3966, std.dev.: 0.1478) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 151.09% (4.3953 => 11.0363, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/methcall: 147.52% (5.3999 => 13.3661, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 23.90% (1.3045 => 1.6163, std.dev.: 0.0403) SingleSource/Benchmarks/Shootout-C++/moments: 23.38% (0.1159 => 0.1430, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/oourafft: 17.67% (6.6465 => 7.8208, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.63% (1.1145 => 1.2998, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.11% (0.2944 => 0.3330, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.76% (2.8904 => 3.2304, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 10.86% (3.1578 => 3.5007, std.dev.: 0.0769) SingleSource/Benchmarks/Shootout/strcat: 10.32% (0.1899 => 0.2095, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 10.28% (1.1396 => 1.2567, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/puzzle: 9.88% (0.6962 => 0.7650, std.dev.: 0.0113) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: 9.65% (4.9088 => 5.3825, std.dev.: 0.0444) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.49% (1.7254 => 1.8891, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: 7.36% (1.9405 => 2.0833, std.dev.: 0.0128) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.57% (4.2280 => 4.4633, std.dev.: 0.0196) SingleSource/Regression/C/uint64_to_float: 5.01% (0.5413 => 0.5684, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.76% (0.3463 => 0.3628, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.16% (11.6436 => 12.1279, std.dev.: 0.0078) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 3.05% (0.6223 => 0.6413, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.78% (1.7133 => 1.7609, std.dev.: 0.0181) SingleSource/Benchmarks/Dhrystone/dry: 2.44% (2.4116 => 2.4704, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.16% (1.3677 => 1.3973, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 2.09% (3.1595 => 3.2255, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 2.00% (85.0658 => 86.7661, std.dev.: 0.0685) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.57% (6.5088 => 6.6109, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 1.43% (27.8444 => 28.2416, std.dev.: 0.0506) SingleSource/Benchmarks/Shootout/sieve: 1.31% (5.2139 => 5.2824, std.dev.: 0.0115) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.26% (1.0313 => 1.0443, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.24% (1.9577 => 1.9819, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0497, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.5348 => 12.6671, std.dev.: 0.0325) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.31% (6.6874 => 0.1801, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.83% (5.2763 => 1.2225, std.dev.: 0.0573) SingleSource/Benchmarks/Misc/salsa20: -74.95% (0.8651 => 0.2167, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/richards_benchmark: -44.88% (0.1622 => 0.0894, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.68% (5.3526 => 4.7275, std.dev.: 0.1405) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.53% (5.3855 => 4.7648, std.dev.: 0.1163) MultiSource/Applications/JM/ldecod/ldecod: -9.96% (10.4361 => 9.3965, std.dev.: 0.2256) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.03% (0.3987 => 0.2391, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.72% (0.0506 => 0.0305, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.24% (4.5009 => 2.7796, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.53% (1.1492 => 0.7639, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -27.62% (10.7105 => 7.7519, std.dev.: 0.5942) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.19% (2.6546 => 2.0125, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: -22.73% (32.5116 => 25.1231, std.dev.: 1.8512) MultiSource/Benchmarks/FreeBench/mason/mason: -19.07% (0.2161 => 0.1749, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.66% (1.6925 => 1.4274, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2839, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -10.65% (1.5373 => 1.3736, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -10.54% (9.5636 => 8.5558, std.dev.: 0.1920) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4244, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.88% (19.9488 => 18.3762, std.dev.: 0.5954) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4789, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.43% (3.2416 => 3.0333, std.dev.: 0.0200) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.59% (2.7294 => 2.5768, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.00% (1.8329 => 1.7412, std.dev.: 0.0334) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5082, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.68% (1.6805 => 1.6019, std.dev.: 0.0200) SingleSource/Benchmarks/Shootout/lists: -4.19% (6.2999 => 6.0360, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8912, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.25% (0.4808 => 0.4700, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.73% (8.1563 => 8.0153, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/salsa20: -1.53% (10.2830 => 10.1257, std.dev.: 0.0041) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.08% (0.1485 => 0.1365, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0012) Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 18 01:46:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 03:46:22 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121118094622.B45BF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6001?compare_to=5998&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6001, Order: 168283, Start Time: 2012-11-18 08:13:21, End Time: 2012-11-18 09:46:44 To: 5998, Order: 168280, Start Time: 2012-11-18 06:13:04, End Time: 2012-11-18 07:45:54 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== New Failures: 0 (48 on baseline) Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (179 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 48 (0 on baseline) Unchanged Tests: 1044 (859 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/LivermoreLoops/kernel01: -0.57% (0.0176 => 0.0175, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel02: - (0.0176 => 0.0176) SingleSource/Benchmarks/LivermoreLoops/kernel03: - (0.0175 => 0.0175) SingleSource/Benchmarks/LivermoreLoops/kernel04: -0.57% (0.0176 => 0.0175, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel05: - (0.0175 => 0.0175) SingleSource/Benchmarks/LivermoreLoops/kernel06: - (0.0175 => 0.0175, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel07: - (0.0176 => 0.0176, std.dev.: 0.0010) SingleSource/Benchmarks/LivermoreLoops/kernel08: - (0.0180 => 0.0180, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel09: - (0.0176 => 0.0176) SingleSource/Benchmarks/LivermoreLoops/kernel10: - (0.0177 => 0.0177, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel11: - (0.0175 => 0.0175, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel12: - (0.0175 => 0.0175) SingleSource/Benchmarks/LivermoreLoops/kernel13: - (0.0178 => 0.0178, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel14: - (0.0179 => 0.0179, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel15: - (0.0183 => 0.0183) SingleSource/Benchmarks/LivermoreLoops/kernel16: - (0.0180 => 0.0180, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel17: -0.56% (0.0178 => 0.0177, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel18: - (0.0183 => 0.0183, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel19: - (0.0176 => 0.0176, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel20: - (0.0177 => 0.0177) SingleSource/Benchmarks/LivermoreLoops/kernel21: - (0.0176 => 0.0176) SingleSource/Benchmarks/LivermoreLoops/kernel22: - (0.0176 => 0.0176) SingleSource/Benchmarks/LivermoreLoops/kernel23: - (0.0176 => 0.0176, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel24: - (0.0175 => 0.0175) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/LivermoreLoops/kernel01: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel02: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel03: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel04: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel05: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel06: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel07: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel08: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel09: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel10: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel11: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel12: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel13: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel14: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel15: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel16: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel17: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel18: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel19: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel20: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel21: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel22: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel23: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel24: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 New Failures - Execution Time ----------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.65% (2.0478 => 2.1021, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/salsa20: 2.63% (7.4937 => 7.6911, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/hash2: 2.03% (3.1932 => 3.2579, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.09% (0.3821 => 0.3512, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -6.88% (2.4924 => 2.3208, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -6.67% (0.3357 => 0.3133, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.59% (0.3142 => 0.2935, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.51% (0.9542 => 0.8921, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: -6.25% (0.2160 => 0.2025, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.22% (0.2428 => 0.2277, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -6.12% (9.2283 => 8.6633, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.09% (0.9852 => 0.9252, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.07% (0.1796 => 0.1687, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.95% (0.7198 => 0.6770, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: -5.93% (16.1920 => 15.2320, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.92% (0.6484 => 0.6100, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: -5.86% (7.0961 => 6.6801, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/ReedSolomon: -5.85% (0.1879 => 0.1769, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: -5.84% (0.9179 => 0.8643, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.76% (1.3722 => 1.2932, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.73% (3.5339 => 3.3315, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.67% (1.0544 => 0.9946, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.64% (0.2695 => 0.2543, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.61% (0.2355 => 0.2223, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.58% (0.3658 => 0.3454, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.57% (4.0323 => 3.8077, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.56% (0.5805 => 0.5482, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.56% (4.8802 => 4.6089, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.55% (0.6681 => 0.6310, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.53% (6.7716 => 6.3970, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/gs/gs: -5.53% (4.3330 => 4.0935, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.52% (0.6052 => 0.5718, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.49% (1.6364 => 1.5466, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.48% (0.5857 => 0.5536, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.48% (0.6660 => 0.6295, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -5.48% (1.1450 => 1.0823, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.47% (0.6230 => 0.5889, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.47% (0.5591 => 0.5285, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.47% (1.4642 => 1.3841, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.46% (0.5859 => 0.5539, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.46% (0.3406 => 0.3220, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.44% (4.8161 => 4.5541, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: -5.43% (0.4515 => 0.4270, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.41% (1.2300 => 1.1634, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.39% (0.5802 => 0.5489, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.39% (4.5069 => 4.2642, std.dev.: 0.0065) MultiSource/Benchmarks/nbench/nbench: -5.36% (1.1530 => 1.0912, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.35% (0.6260 => 0.5925, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.33% (0.6736 => 0.6377, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.32% (0.5863 => 0.5551, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.32% (1.2784 => 1.2104, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.31% (0.5705 => 0.5402, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.30% (0.7524 => 0.7125, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.29% (0.5575 => 0.5280, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.29% (0.7919 => 0.7500, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.29% (0.6676 => 0.6323, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.29% (0.6395 => 0.6057, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -5.28% (1.3864 => 1.3132, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.24% (0.6293 => 0.5963, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.23% (0.5925 => 0.5615, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.23% (0.5849 => 0.5543, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -5.23% (0.2985 => 0.2829, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.22% (0.6395 => 0.6061, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.22% (0.5941 => 0.5631, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: -5.21% (1.2515 => 1.1863, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.21% (0.5456 => 0.5172, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.21% (0.7339 => 0.6957, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.18% (14.2083 => 13.4724, std.dev.: 0.0051) MultiSource/Applications/sqlite3/sqlite3: -5.18% (17.1032 => 16.2174, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.18% (0.8521 => 0.8080, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: -5.17% (0.3581 => 0.3396, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.17% (0.5478 => 0.5195, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.16% (0.6667 => 0.6323, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.14% (0.5581 => 0.5294, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.14% (1.2210 => 1.1583, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.13% (0.5570 => 0.5284, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.10% (0.6446 => 0.6117, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.08% (0.5999 => 0.5694, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.08% (0.5688 => 0.5399, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.06% (1.2221 => 1.1603, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.04% (0.2999 => 0.2848, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.02% (0.3483 => 0.3308, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.02% (0.6440 => 0.6117, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.01% (0.5569 => 0.5290, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.00% (8.0126 => 7.6122, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.99% (0.6033 => 0.5732, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.98% (0.5567 => 0.5290, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.95% (0.2548 => 0.2422, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.94% (0.4916 => 0.4673, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.94% (1.6474 => 1.5661, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.91% (0.3319 => 0.3156, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: -4.89% (0.2659 => 0.2529, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.77% (0.3812 => 0.3630, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: -4.77% (3.5154 => 3.3477, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: -4.74% (0.7447 => 0.7094, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.72% (0.5168 => 0.4924, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -4.71% (15.5079 => 14.7781, std.dev.: 0.0231) MultiSource/Applications/lua/lua: -4.70% (4.0594 => 3.8685, std.dev.: 0.0095) SingleSource/UnitTests/ObjC/exceptions: -4.67% (0.4176 => 0.3981, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.65% (0.2385 => 0.2274, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.65% (0.2278 => 0.2172, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -4.65% (15.2527 => 14.5438, std.dev.: 0.0232) SingleSource/UnitTests/ObjC/exceptions-2: -4.65% (0.3831 => 0.3653, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.63% (0.3884 => 0.3704, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.63% (0.6194 => 0.5907, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/exceptions-4: -4.61% (0.3880 => 0.3701, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.60% (0.3848 => 0.3671, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -4.59% (0.4033 => 0.3848, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -4.59% (1.3148 => 1.2545, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.55% (0.3891 => 0.3714, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (0.5329 => 0.5087, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.53% (0.4151 => 0.3963, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -4.52% (2.4021 => 2.2935, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.52% (0.7021 => 0.6704, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.47% (0.3896 => 0.3722, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -4.45% (0.4199 => 0.4012, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.44% (22.4056 => 21.4098, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.43% (0.6304 => 0.6025, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.36% (0.4813 => 0.4603, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: -4.36% (0.3255 => 0.3113, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -4.34% (2.1401 => 2.0473, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.33% (0.6189 => 0.5921, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.30% (0.6297 => 0.6026, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -4.30% (0.7982 => 0.7639, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: -4.29% (5.0226 => 4.8073, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/moments: -4.28% (0.4248 => 0.4066, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.28% (0.3016 => 0.2887, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.25% (2.2587 => 2.1627, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: -4.23% (0.4280 => 0.4099, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -4.20% (0.3025 => 0.2898, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -4.20% (0.3026 => 0.2899, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.20% (0.3837 => 0.3676, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.18% (0.3252 => 0.3116, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: -4.16% (0.4861 => 0.4659, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.15% (0.3931 => 0.3768, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -4.14% (34.0927 => 32.6811, std.dev.: 0.0360) SingleSource/Benchmarks/Shootout-C++/ary3: -4.12% (0.3446 => 0.3304, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.10% (0.8418 => 0.8073, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.09% (0.9557 => 0.9166, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.09% (2.1713 => 2.0825, std.dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: -4.09% (0.3059 => 0.2934, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: -4.08% (0.2989 => 0.2867, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.07% (0.3271 => 0.3138, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: -4.07% (0.3394 => 0.3256, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.06% (0.3323 => 0.3188, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: -4.04% (18.2933 => 17.5535, std.dev.: 0.0266) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.98% (0.9077 => 0.8716, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/lists1: -3.96% (0.3867 => 0.3714, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.93% (0.3057 => 0.2937, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.92% (0.3849 => 0.3698, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -3.91% (0.3194 => 0.3069, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -3.91% (0.3481 => 0.3345, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.89% (0.4321 => 0.4153, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.89% (0.2933 => 0.2819, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -3.87% (0.2871 => 0.2760, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.86% (0.2903 => 0.2791, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: -3.84% (0.2939 => 0.2826, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -3.79% (0.7779 => 0.7484, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists: -3.78% (0.3621 => 0.3484, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hello: -3.72% (0.2849 => 0.2743, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.66% (0.4427 => 0.4265, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -3.63% (0.6750 => 0.6505, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.58% (0.3491 => 0.3366, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash: -3.54% (0.4524 => 0.4364, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.53% (0.4083 => 0.3939, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -3.51% (0.3788 => 0.3655, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -3.43% (0.6347 => 0.6129, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: -3.34% (0.6441 => 0.6226, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.24% (1.5610 => 1.5105, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.06% (5.4682 => 5.3007, std.dev.: 0.0080) SingleSource/UnitTests/Vector/constpool: -2.23% (20.7746 => 20.3112, std.dev.: 0.0145) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.48% (7.5137 => 5.7497, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: -8.65% (1.2842 => 1.1731, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.98% (2.2633 => 2.1733, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.93% (1.7753 => 1.7055, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.99% (1.3096 => 1.2836, std.dev.: 0.0071) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.50% (6.5735 => 6.4747, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 18 03:42:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 05:42:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121118114231.7C0D32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6002?compare_to=5996&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6002, Order: 168283, Start Time: 2012-11-18 08:23:09, End Time: 2012-11-18 11:42:52 To: 5996, Order: 168278, Start Time: 2012-11-18 04:09:36, End Time: 2012-11-18 07:29:29 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (48 on baseline) Performance Regressions: 1 (171 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (136 on baseline) Existing Failures: 48 (0 on baseline) Unchanged Tests: 1043 (720 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.84% (2.0811 => 2.1194, std.dev.: 0.0068) Existing Failures - Compile Time -------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/LivermoreLoops/kernel01: - (0.0201 => 0.0201, std.dev.: 0.0011) SingleSource/Benchmarks/LivermoreLoops/kernel02: - (0.0201 => 0.0201, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel03: - (0.0200 => 0.0200, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel04: 0.50% (0.0201 => 0.0202) SingleSource/Benchmarks/LivermoreLoops/kernel05: 0.50% (0.0200 => 0.0201) SingleSource/Benchmarks/LivermoreLoops/kernel06: - (0.0201 => 0.0201) SingleSource/Benchmarks/LivermoreLoops/kernel07: - (0.0202 => 0.0202, std.dev.: 0.0002) SingleSource/Benchmarks/LivermoreLoops/kernel08: - (0.0207 => 0.0207) SingleSource/Benchmarks/LivermoreLoops/kernel09: 0.50% (0.0201 => 0.0202, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel10: - (0.0203 => 0.0203) SingleSource/Benchmarks/LivermoreLoops/kernel11: - (0.0200 => 0.0200, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel12: - (0.0200 => 0.0200, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel13: - (0.0204 => 0.0204, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel14: 0.49% (0.0205 => 0.0206) SingleSource/Benchmarks/LivermoreLoops/kernel15: - (0.0210 => 0.0210) SingleSource/Benchmarks/LivermoreLoops/kernel16: - (0.0206 => 0.0206, std.dev.: 0.0003) SingleSource/Benchmarks/LivermoreLoops/kernel17: 0.49% (0.0203 => 0.0204, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel18: - (0.0210 => 0.0210, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel19: - (0.0202 => 0.0202) SingleSource/Benchmarks/LivermoreLoops/kernel20: -0.49% (0.0203 => 0.0202, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel21: - (0.0201 => 0.0201) SingleSource/Benchmarks/LivermoreLoops/kernel22: 0.50% (0.0201 => 0.0202, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel23: - (0.0202 => 0.0202, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel24: - (0.0200 => 0.0200, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/LivermoreLoops/kernel01: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel02: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel03: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel04: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel05: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel06: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel07: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel08: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel09: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel10: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel11: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel12: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel13: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel14: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel15: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel16: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel17: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel18: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel19: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel20: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel21: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel22: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel23: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel24: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 New Failures - Execution Time ----------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.84% (0.0625 => 0.0874, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.51% (0.1063 => 0.1398, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.80% (0.2969 => 0.3735, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.86% (0.1106 => 0.1381, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.43% (0.4139 => 0.5150, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.63% (0.4253 => 0.5258, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 23.27% (1.5932 => 1.9640, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.11% (0.0714 => 0.0879, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.95% (0.0584 => 0.0718) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.88% (0.5900 => 0.7250, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.67% (0.4994 => 0.6126, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.36% (0.5000 => 0.6118, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.04% (0.1620 => 0.1977, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.94% (0.1021 => 0.1245, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.52% (0.0897 => 0.1090, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.23% (0.1107 => 0.1342, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 20.89% (0.0948 => 0.1146, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.67% (0.1103 => 0.1331, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0584 => 0.0704, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.40% (0.0642 => 0.0773, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.04% (0.1003 => 0.1204, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 19.98% (0.0821 => 0.0985, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.96% (0.0541 => 0.0649, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.91% (0.3903 => 0.4680, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.83% (0.0822 => 0.0985, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.76% (0.1604 => 0.1921, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 19.58% (0.1619 => 0.1936, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.56% (0.1549 => 0.1852, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/power/power: 19.54% (0.0604 => 0.0722, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.95% (0.1462 => 0.1739, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.69% (0.0947 => 0.1124, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.46% (0.3890 => 0.4608, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.07% (0.2014 => 0.2378, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 18.06% (0.1218 => 0.1438, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 18.01% (0.5826 => 0.6875, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 17.75% (0.4029 => 0.4744, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 17.62% (0.0698 => 0.0821, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.62% (0.2736 => 0.3218, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 17.61% (0.5889 => 0.6926, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 17.61% (0.1505 => 0.1770, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.56% (0.1088 => 0.1279, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.37% (1.3152 => 1.5437, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.17% (0.2866 => 0.3358, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 17.04% (0.5546 => 0.6491, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.86% (3.5627 => 4.1634, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.73% (0.2875 => 0.3356, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 16.69% (1.8794 => 2.1931, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.62% (0.1968 => 0.2295, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.47% (1.6211 => 1.8881, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.23% (0.4658 => 0.5414, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.20% (0.3271 => 0.3801, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.20% (0.5026 => 0.5840, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.18% (0.2738 => 0.3181, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.03% (0.1160 => 0.1346, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hello: 16.03% (0.2714 => 0.3149, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/matrix: 15.90% (0.2780 => 0.3222, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 15.89% (0.9697 => 1.1238, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 15.85% (0.2750 => 0.3186, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 15.83% (0.1421 => 0.1646, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 15.80% (0.2823 => 0.3269, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 15.77% (0.7171 => 0.8302, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/except: 15.72% (0.2811 => 0.3253, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.71% (0.3195 => 0.3697, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 15.67% (0.2725 => 0.3152, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 15.63% (0.2803 => 0.3241, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 15.58% (0.3004 => 0.3472, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 15.57% (1.0781 => 1.2460, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.57% (0.2729 => 0.3154, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.57% (0.3930 => 0.4542, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 15.57% (0.2813 => 0.3251, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.55% (2.7292 => 3.1536, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.55% (0.4361 => 0.5039, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.54% (0.2792 => 0.3226, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 15.50% (0.1284 => 0.1483, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 15.40% (0.9909 => 1.1435, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.36% (0.2911 => 0.3358, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 15.27% (4.2109 => 4.8541, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.25% (2.0673 => 2.3825, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wc: 15.25% (0.3096 => 0.3568, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.16% (4.4195 => 5.0894, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/ary3: 14.97% (0.3267 => 0.3756, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 14.94% (23.5202 => 27.0346, std.dev.: 0.0219) SingleSource/Benchmarks/Shootout-C++/ary2: 14.86% (0.3317 => 0.3810, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.84% (1.9694 => 2.2616, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: 14.76% (0.3258 => 0.3739, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.68% (0.1090 => 0.1250, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.66% (1.9966 => 2.2893, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/moments: 14.52% (0.3678 => 0.4212, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 14.49% (0.3465 => 0.3967, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 14.47% (0.3496 => 0.4002, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 14.46% (0.3348 => 0.3832, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-2: 14.45% (0.3446 => 0.3944, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 14.45% (0.3460 => 0.3960, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.38% (0.3469 => 0.3968, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.36% (0.3488 => 0.3989, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.31% (0.3060 => 0.3498, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.31% (0.3362 => 0.3843, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 14.21% (0.3442 => 0.3931, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.20% (0.3282 => 0.3748, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 14.14% (1.4269 => 1.6286, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.12% (0.3124 => 0.3565, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 14.11% (0.3650 => 0.4165, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 14.11% (0.2566 => 0.2928, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists1: 14.09% (0.3477 => 0.3967, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 14.06% (0.3726 => 0.4250, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 14.00% (0.3643 => 0.4153, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.85% (0.3625 => 0.4127, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 13.83% (0.2075 => 0.2362, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.72% (0.3981 => 0.4527, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 13.69% (0.3724 => 0.4234, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 13.63% (0.4146 => 0.4711, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.60% (0.3845 => 0.4368, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 13.46% (0.4251 => 0.4823, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.44% (0.3690 => 0.4186, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 13.41% (0.7875 => 0.8931, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 12.86% (2.1653 => 2.4438, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/bigfib: 12.79% (0.5012 => 0.5653, std.dev.: 0.0064) MultiSource/Applications/JM/lencod/lencod: 12.51% (4.6177 => 5.1952, std.dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: 12.48% (2.1013 => 2.3636, std.dev.: 0.0085) MultiSource/Applications/SPASS/SPASS: 12.03% (5.5417 => 6.2085, std.dev.: 0.0095) MultiSource/Applications/SIBsim4/SIBsim4: 11.93% (0.2691 => 0.3012, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.84% (0.6435 => 0.7197, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.81% (0.2040 => 0.2281, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.28% (0.1028 => 0.1144, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.12% (0.2068 => 0.2298, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.00% (0.2737 => 0.3038, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 10.78% (0.3498 => 0.3875, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.67% (0.3084 => 0.3413, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 10.58% (0.6634 => 0.7336, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.56% (0.1383 => 0.1529, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 10.44% (0.4847 => 0.5353, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 10.19% (0.3336 => 0.3676, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.84% (0.2103 => 0.2310, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 9.48% (2.0346 => 2.2274, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: 9.24% (0.2391 => 0.2612, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.84% (4.6926 => 5.1076, std.dev.: 0.0210) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.61% (11.6398 => 12.6418, std.dev.: 0.0199) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.49% (0.5361 => 0.5816, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.06% (0.5584 => 0.6034, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.92% (0.7426 => 0.8014, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 6.66% (11.9555 => 12.7518, std.dev.: 0.0203) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.98% (0.3792 => 0.3981, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 8.71% (0.2802 => 0.3046, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6099, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: 6.46% (0.2122 => 0.2259, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6703, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-2: 4.87% (1.8057 => 1.8936, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1698, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.33% (0.3693 => 0.3853, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6378, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2088, std.dev.: 0.0391) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.80% (2.0820 => 2.1194, std.dev.: 0.0068) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2252, std.dev.: 0.0024) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3075, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2891, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5129, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5899, std.dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.80% (25.4195 => 16.5726, std.dev.: 0.0110) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9745, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7962, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -6.54% (0.2402 => 0.2245, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7952, std.dev.: 0.0029) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7751, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.89% (0.6293 => 0.6111, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -2.89% (17.2379 => 16.7403, std.dev.: 0.0914) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8678, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5718, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4953, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1852, std.dev.: 0.0875) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0464, std.dev.: 0.0040) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 18 04:34:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 06:34:30 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121118123430.580D02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6003?compare_to=5999&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6003, Order: 168285, Start Time: 2012-11-18 11:04:13, End Time: 2012-11-18 12:34:53 To: 5999, Order: 168283, Start Time: 2012-11-18 08:00:48, End Time: 2012-11-18 09:30:34 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 13 (105 on baseline) Performance Improvements: 8 (26 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1033 (843 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.10% (0.1023 => 0.1157, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/09-vor/vor: 5.89% (0.3108 => 0.3291, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 5.80% (0.2933 => 0.3103, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.29% (0.6108 => 0.6309, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/gs/gs: 1.72% (4.1546 => 4.2262, std.dev.: 0.0269) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel14: 21.57% (4.4396 => 5.3974, std.dev.: 0.0004) SingleSource/Benchmarks/LivermoreLoops/kernel01: 13.22% (0.2270 => 0.2570, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.56% (0.3374 => 0.3494, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/methcall: 2.76% (8.0122 => 8.2331, std.dev.: 0.0288) SingleSource/Benchmarks/Misc/ffbench: 2.57% (1.3988 => 1.4347, std.dev.: 0.0103) SingleSource/Benchmarks/Linpack/linpack-pc: 1.79% (54.4357 => 55.4106, std.dev.: 0.0222) SingleSource/Benchmarks/LivermoreLoops/kernel15: 1.51% (1.9428 => 1.9721, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.44% (2.3599 => 2.3938, std.dev.: 0.0076) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -2.06% (0.6019 => 0.5895, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.98% (0.8901 => 0.8725, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.52% (0.9416 => 0.9273, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.46% (1.0272 => 1.0122, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.36% (0.9439 => 0.9311, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.12% (0.9224 => 0.9121, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel06: -4.07% (0.4326 => 0.4150, std.dev.: 0.0015) SingleSource/Regression/C/uint64_to_float: -1.09% (1.6722 => 1.6539, std.dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.83% (1.0571 => 1.0659, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 35.40% (0.0161 => 0.0218, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 12.07% (0.0381 => 0.0427, std.dev.: 0.0116) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -24.15% (0.0323 => 0.0245, std.dev.: 0.0045) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 33.05% (0.0236 => 0.0314, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 6.45% (0.0403 => 0.0429, std.dev.: 0.0087) SingleSource/UnitTests/Vector/Altivec/casts: -9.55% (0.0178 => 0.0161, std.dev.: 0.0079) SingleSource/UnitTests/Vector/Altivec/test1: 16.09% (0.0174 => 0.0202, std.dev.: 0.0084) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.54% (0.1468 => 0.1476, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.34% (1.1640 => 1.1796, std.dev.: 0.0280) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.78% (0.4324 => 0.4204, std.dev.: 0.0192) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.14% (0.1406 => 0.1404, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.57% (0.0565 => 0.0636, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.85% (0.0206 => 0.0196, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.18% (0.0547 => 0.0546, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.61% (1.1888 => 1.1961, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0001 => 0.0002, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2100.00% (0.0001 => 0.0022, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.14% (0.0603 => 0.0566, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.57% (0.0212 => 0.0245, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.48% (0.7780 => 0.7817, std.dev.: 0.0734) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 136.96% (0.0046 => 0.0109, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.28% (16.4461 => 17.6437, std.dev.: 0.0388) MultiSource/Applications/sqlite3/sqlite3: 2320.93% (0.6332 => 15.3293, std.dev.: 0.1330) MultiSource/Benchmarks/McCat/08-main/main: 51.83% (0.1831 => 0.2780, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -11.55% (0.1559 => 0.1379, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7087.74% (0.3123 => 22.4473, std.dev.: 0.1421) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.52% (0.2463 => 0.3732, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1536.78% (0.3344 => 5.4734, std.dev.: 0.1859) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.71% (0.2364 => 0.3279, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 4.88% (0.6010 => 0.6303, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel: 1.86% (0.0429 => 0.0437, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.73% (0.3266 => 0.3453, std.dev.: 0.0623) SingleSource/Benchmarks/Shootout-C++/strcat: 4.72% (0.1969 => 0.2062, std.dev.: 0.0039) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.59% (0.0224 => 0.0241, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0491, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 7.93% (0.1462 => 0.1578, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4692, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0752, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4939, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5055, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5799, std.dev.: 0.4621) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3186, std.dev.: 0.0504) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1446, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3631, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4122, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0879, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: -24.24% (2.1832 => 1.6539, std.dev.: 0.0052) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.68% (0.0810 => 0.0937, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.03% (0.0848 => 0.0950, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 11.51% (0.1112 => 0.1240, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.66% (0.2180 => 0.2347, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.42% (0.2279 => 0.2448, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.09% (0.1425 => 0.1526, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.26% (0.7473 => 0.7941, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/em3d/em3d: 5.87% (0.1721 => 0.1822, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.77% (0.1905 => 0.2015, std.dev.: 0.0038) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.58% (0.3137 => 0.3312, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.45% (0.2240 => 0.2362, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.20% (0.2133 => 0.2244, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.98% (0.6010 => 0.6309, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.87% (1.1606 => 1.2171, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.2998 => 0.3138, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.39% (0.4847 => 0.5060, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: 4.16% (1.2222 => 1.2730, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.85% (0.3295 => 0.3422, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.80% (0.4127 => 0.4284, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.77% (0.3657 => 0.3795, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.69% (0.3115 => 0.3230, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.66% (1.1685 => 1.2113, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.61% (0.3717 => 0.3851, std.dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.59% (6.6074 => 6.8448, std.dev.: 0.0407) MultiSource/Applications/minisat/minisat: 3.54% (0.6834 => 0.7076, std.dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 3.47% (0.2999 => 0.3103, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 3.41% (0.9810 => 1.0145, std.dev.: 0.0033) MultiSource/Applications/lua/lua: 3.13% (3.8189 => 3.9385, std.dev.: 0.0259) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.03% (0.4783 => 0.4928, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.99% (0.8340 => 0.8589, std.dev.: 0.0081) MultiSource/Applications/SPASS/SPASS: 2.98% (14.2605 => 14.6849, std.dev.: 0.0567) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.91% (0.8457 => 0.8703, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.90% (0.8697 => 0.8949, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 2.87% (2.2184 => 2.2820, std.dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: 2.83% (1.1271 => 1.1590, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.73% (13.1811 => 13.5407, std.dev.: 0.0924) MultiSource/Applications/ClamAV/clamscan: 2.72% (14.7684 => 15.1708, std.dev.: 0.0651) MultiSource/Applications/treecc/treecc: 2.68% (1.9948 => 2.0482, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.68% (0.8597 => 0.8827, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.61% (0.9074 => 0.9311, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.59% (0.8286 => 0.8501, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.58% (0.9056 => 0.9290, std.dev.: 0.0048) MultiSource/Applications/SIBsim4/SIBsim4: 2.56% (1.2568 => 1.2890, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.55% (0.8069 => 0.8275, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.55% (1.6386 => 1.6804, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.50% (0.9039 => 0.9265, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.47% (0.8611 => 0.8824, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.43% (0.8518 => 0.8725, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: 2.40% (2.3764 => 2.4335, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.37% (0.8716 => 0.8923, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/05-eks/eks: 2.37% (0.4397 => 0.4501, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: 2.33% (0.8768 => 0.8972, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/gs/gs: 2.32% (4.1305 => 4.2262, std.dev.: 0.0269) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.27% (0.8359 => 0.8549, std.dev.: 0.0060) MultiSource/Applications/JM/ldecod/ldecod: 2.26% (6.7320 => 6.8844, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.25% (0.9069 => 0.9273, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.25% (0.8855 => 0.9054, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.24% (1.3279 => 1.3577, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.24% (0.8712 => 0.8907, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.22% (0.8204 => 0.8386, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.17% (0.8927 => 0.9121, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.16% (0.9908 => 1.0122, std.dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 2.16% (15.3280 => 15.6586, std.dev.: 0.0835) MultiSource/Applications/d/make_dparser: 2.12% (3.2366 => 3.3053, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.07% (0.8066 => 0.8233, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.07% (1.1170 => 1.1401, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.00% (4.4880 => 4.5776, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.97% (0.8177 => 0.8338, std.dev.: 0.0062) MultiSource/Applications/lemon/lemon: 1.86% (1.0945 => 1.1149, std.dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: 1.74% (4.9628 => 5.0493, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (8.6247 => 8.7680, std.dev.: 0.0494) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.45% (1.2423 => 1.2603, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.17% (0.8995 => 0.9100, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 109.55% (0.0199 => 0.0417, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/pi: 54.69% (1.5795 => 2.4434, std.dev.: 0.0299) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.59% (0.7597 => 0.8933, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.59% (2.9753 => 3.4690, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.71% (2.7995 => 3.2112, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6085, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.67% (0.3186 => 0.3494, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.13% (1.1857 => 1.2821, std.dev.: 0.0063) SingleSource/Benchmarks/McGill/queens: 7.51% (1.7056 => 1.8337, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.71% (4.7794 => 5.1003, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/richards_benchmark: 6.50% (1.3037 => 1.3884, std.dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: 6.01% (3.1873 => 3.3787, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.79% (4.9686 => 5.2564, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.77% (4.5327 => 4.7942, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.76% (6.2275 => 6.5238, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.44% (3.3761 => 3.5259, std.dev.: 0.0111) MultiSource/Applications/lambda-0_1_3/lambda: 4.31% (7.4933 => 7.8163, std.dev.: 0.0309) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.21% (4.9453 => 5.1535, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.01% (4.9469 => 5.1453, std.dev.: 0.0405) MultiSource/Applications/hexxagon/hexxagon: 4.01% (14.0064 => 14.5674, std.dev.: 0.0119) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.35% (0.3587 => 0.3707, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.18% (1.3882 => 1.4324, std.dev.: 0.0122) MultiSource/Applications/siod/siod: 3.15% (3.6643 => 3.7797, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.85% (1.2337 => 1.2689, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.79% (11.5690 => 11.8916, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.66% (8.2783 => 8.4984, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.34% (4.8660 => 4.9801, std.dev.: 0.0212) SingleSource/Benchmarks/Dhrystone/dry: 2.11% (0.5081 => 0.5188, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.09% (4.8362 => 4.9375, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.96% (1.1365 => 1.1588, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: 1.08% (1.2061 => 1.2191, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.03% (3.5679 => 3.6048, std.dev.: 0.0109) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.05% (5.4641 => 4.3137, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.71% (7.2130 => 6.2962, std.dev.: 0.0798) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.61% (1.0512 => 0.9292, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: -8.52% (63.1822 => 57.8022, std.dev.: 0.0931) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.81% (14.6451 => 13.5007, std.dev.: 0.1477) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.91% (4.7482 => 4.4201, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.36% (0.3269 => 0.3061, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.94% (3.7148 => 3.4942, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.84% (5.4972 => 5.1762, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.08% (5.1557 => 4.8938, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.35% (4.7449 => 4.5386, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.50% (6.0224 => 5.8114, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.46% (2.8773 => 2.7778, std.dev.: 0.0221) MultiSource/Applications/lua/lua: -3.22% (29.8330 => 28.8727, std.dev.: 0.0973) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (28.5821 => 27.7018, std.dev.: 0.0176) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.88% (0.5807 => 0.5640, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.78% (1.2822 => 1.2466, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.69% (2.6356 => 2.5647, std.dev.: 0.0087) MultiSource/Benchmarks/FreeBench/mason/mason: -2.46% (0.5415 => 0.5282, std.dev.: 0.0034) MultiSource/Applications/aha/aha: -2.38% (3.3398 => 3.2602, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.25% (2.4490 => 2.3938, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.20% (9.9065 => 9.6884, std.dev.: 0.0556) SingleSource/Benchmarks/Shootout-C++/hash2: -2.18% (3.4237 => 3.3491, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.00% (11.5316 => 11.3005, std.dev.: 0.0287) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.51% (4.9994 => 4.9241, std.dev.: 0.0282) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.15% (5.6343 => 5.5693, std.dev.: 0.0095) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.87% (1.0262 => 1.0659, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0116) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.54% (0.0254 => 0.0245, std.dev.: 0.0045) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.72% (0.0384 => 0.0429, std.dev.: 0.0087) SingleSource/UnitTests/Vector/Altivec/casts: -15.26% (0.0190 => 0.0161, std.dev.: 0.0079) SingleSource/UnitTests/Vector/Altivec/test1: 12.22% (0.0180 => 0.0202, std.dev.: 0.0084) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.64% (0.1438 => 0.1476, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 4.12% (1.1329 => 1.1796, std.dev.: 0.0280) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.96% (0.4164 => 0.4204, std.dev.: 0.0192) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.56% (0.1369 => 0.1404, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.78% (0.0641 => 0.0636, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.51% (0.0195 => 0.0196, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.54% (0.0578 => 0.0546, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.58% (1.1437 => 1.1961, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0001 => 0.0002, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 57.14% (0.0014 => 0.0022, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.73% (0.0627 => 0.0566, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 36.11% (0.0180 => 0.0245, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.49% (0.8017 => 0.7817, std.dev.: 0.0734) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 75.81% (0.0062 => 0.0109, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 18 04:36:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 06:36:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121118123620.2175D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6004?compare_to=6001&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6004, Order: 168285, Start Time: 2012-11-18 11:03:06, End Time: 2012-11-18 12:36:40 To: 6001, Order: 168283, Start Time: 2012-11-18 08:13:21, End Time: 2012-11-18 09:46:44 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== New Passes: 48 (0 on baseline) Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (181 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1044 (857 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/LivermoreLoops/kernel01: 407.43% (0.0175 => 0.0888, std.dev.: 0.0020) SingleSource/Benchmarks/LivermoreLoops/kernel02: 423.30% (0.0176 => 0.0921, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel03: 397.71% (0.0175 => 0.0871, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel04: 430.86% (0.0175 => 0.0929, std.dev.: 0.0003) SingleSource/Benchmarks/LivermoreLoops/kernel05: 404.00% (0.0175 => 0.0882, std.dev.: 0.0002) SingleSource/Benchmarks/LivermoreLoops/kernel06: 423.43% (0.0175 => 0.0916) SingleSource/Benchmarks/LivermoreLoops/kernel07: 415.34% (0.0176 => 0.0907, std.dev.: 0.0003) SingleSource/Benchmarks/LivermoreLoops/kernel08: 467.78% (0.0180 => 0.1022, std.dev.: 0.0004) SingleSource/Benchmarks/LivermoreLoops/kernel09: 419.89% (0.0176 => 0.0915, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel10: 411.30% (0.0177 => 0.0905, std.dev.: 0.0002) SingleSource/Benchmarks/LivermoreLoops/kernel11: 408.57% (0.0175 => 0.0890, std.dev.: 0.0003) SingleSource/Benchmarks/LivermoreLoops/kernel12: 400.00% (0.0175 => 0.0875, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel13: 415.17% (0.0178 => 0.0917, std.dev.: 0.0002) SingleSource/Benchmarks/LivermoreLoops/kernel14: 430.17% (0.0179 => 0.0949, std.dev.: 0.0003) SingleSource/Benchmarks/LivermoreLoops/kernel15: 467.76% (0.0183 => 0.1039, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel16: 449.44% (0.0180 => 0.0989, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel17: 400.00% (0.0177 => 0.0885, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel18: 583.06% (0.0183 => 0.1250, std.dev.: 0.0004) SingleSource/Benchmarks/LivermoreLoops/kernel19: 416.48% (0.0176 => 0.0909) SingleSource/Benchmarks/LivermoreLoops/kernel20: 413.56% (0.0177 => 0.0909) SingleSource/Benchmarks/LivermoreLoops/kernel21: 440.34% (0.0176 => 0.0951, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel22: 405.11% (0.0176 => 0.0889, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel23: 453.41% (0.0176 => 0.0974, std.dev.: 0.0004) SingleSource/Benchmarks/LivermoreLoops/kernel24: 402.29% (0.0175 => 0.0879, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/LivermoreLoops/kernel01: 193600.00% (0.0001 => 0.1937, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel02: 27900.00% (0.0001 => 0.0280, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel03: 116500.00% (0.0001 => 0.1166) SingleSource/Benchmarks/LivermoreLoops/kernel04: 77000.00% (0.0001 => 0.0771) SingleSource/Benchmarks/LivermoreLoops/kernel05: 415500.00% (0.0001 => 0.4156) SingleSource/Benchmarks/LivermoreLoops/kernel06: 301500.00% (0.0001 => 0.3016, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel07: 579300.00% (0.0001 => 0.5794) SingleSource/Benchmarks/LivermoreLoops/kernel08: 251600.00% (0.0001 => 0.2517, std.dev.: 0.0003) SingleSource/Benchmarks/LivermoreLoops/kernel09: 70600.00% (0.0001 => 0.0707, std.dev.: 0.0004) SingleSource/Benchmarks/LivermoreLoops/kernel10: 66100.00% (0.0001 => 0.0662) SingleSource/Benchmarks/LivermoreLoops/kernel11: 114100.00% (0.0001 => 0.1142, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel12: 98000.00% (0.0001 => 0.0981) SingleSource/Benchmarks/LivermoreLoops/kernel13: 78100.00% (0.0001 => 0.0782) SingleSource/Benchmarks/LivermoreLoops/kernel14: 1553200.00% (0.0001 => 1.5533, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel15: 1586200.00% (0.0001 => 1.5863, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel16: 47600.00% (0.0001 => 0.0477) SingleSource/Benchmarks/LivermoreLoops/kernel17: 55300.00% (0.0001 => 0.0554, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel18: 1186200.00% (0.0001 => 1.1863, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel19: 86000.00% (0.0001 => 0.0861) SingleSource/Benchmarks/LivermoreLoops/kernel20: 2269400.00% (0.0001 => 2.2695, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel21: 919100.00% (0.0001 => 0.9192, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel22: 239900.00% (0.0001 => 0.2400) SingleSource/Benchmarks/LivermoreLoops/kernel23: 415900.00% (0.0001 => 0.4160, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel24: 136100.00% (0.0001 => 0.1362) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1009, std.dev.: 0.0121) SingleSource/Benchmarks/Misc/salsa20: 2.42% (7.4937 => 7.6754, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/hash2: 2.13% (3.1932 => 3.2613, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.98% (0.3821 => 0.3516, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -6.81% (2.4924 => 2.3227, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.65% (0.3142 => 0.2933, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.61% (0.3357 => 0.3135, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.51% (0.9542 => 0.8921, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.30% (0.2428 => 0.2275, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -6.25% (0.2160 => 0.2025, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.18% (0.1796 => 0.1685, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.11% (9.2283 => 8.6640, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.11% (0.9852 => 0.9250, std.dev.: 0.0051) MultiSource/Applications/JM/lencod/lencod: -5.96% (16.1920 => 15.2277, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.89% (0.7198 => 0.6774, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.85% (0.1761 => 0.1658, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.82% (0.2355 => 0.2218, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.81% (0.6484 => 0.6107, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -5.81% (7.0961 => 6.6839, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/football/football: -5.76% (0.9179 => 0.8650, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.72% (1.3722 => 1.2937, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.71% (3.5339 => 3.3322, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.63% (1.0544 => 0.9950, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.60% (0.2695 => 0.2544, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.60% (0.5805 => 0.5480, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.57% (4.0323 => 3.8077, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.55% (0.6681 => 0.6310, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.55% (4.8802 => 4.6093, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.51% (1.4642 => 1.3835, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.50% (6.7716 => 6.3995, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.49% (1.6364 => 1.5465, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.49% (0.5591 => 0.5284, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -5.46% (4.3330 => 4.0965, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -5.44% (1.1450 => 1.0827, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.44% (4.5069 => 4.2617, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.43% (0.6736 => 0.6370, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -5.43% (0.4515 => 0.4270, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.41% (0.3658 => 0.3460, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.41% (4.8161 => 4.5555, std.dev.: 0.0063) MultiSource/Benchmarks/sim/sim: -5.40% (0.3406 => 0.3222, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.39% (0.6230 => 0.5894, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.39% (1.2300 => 1.1637, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.39% (0.6052 => 0.5726, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.38% (0.5857 => 0.5542, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.38% (0.5859 => 0.5544, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.37% (0.5863 => 0.5548, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.37% (1.2784 => 1.2098, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.35% (0.5478 => 0.5185, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -5.33% (1.1530 => 1.0915, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.33% (0.6660 => 0.6305, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.31% (0.5802 => 0.5494, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.30% (0.6260 => 0.5928, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.27% (0.6676 => 0.6324, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.27% (0.7919 => 0.7502, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.26% (0.7339 => 0.6953, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.24% (0.6395 => 0.6060, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.23% (0.5581 => 0.5289, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.22% (0.5575 => 0.5284, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.22% (0.5941 => 0.5631, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.21% (0.6395 => 0.6062, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.21% (0.5456 => 0.5172, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.20% (0.6667 => 0.6320, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.20% (0.5688 => 0.5392, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -5.19% (0.3581 => 0.3395, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -5.18% (1.2515 => 1.1867, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -5.16% (0.2985 => 0.2831, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.15% (0.5705 => 0.5411, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.15% (0.6293 => 0.5969, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.15% (14.2083 => 13.4769, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.14% (0.7524 => 0.7137, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.13% (0.5849 => 0.5549, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.12% (1.2221 => 1.1595, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -5.10% (17.1032 => 16.2304, std.dev.: 0.0135) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.10% (1.2210 => 1.1587, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.10% (0.5570 => 0.5286, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: -5.09% (1.3864 => 1.3158, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.08% (0.5925 => 0.5624, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.06% (0.8521 => 0.8090, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.05% (0.6440 => 0.6115, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.04% (0.6446 => 0.6121, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.00% (0.2278 => 0.2164, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.99% (0.5569 => 0.5291, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.99% (0.6033 => 0.5732, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.97% (0.2999 => 0.2850, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.97% (0.3483 => 0.3310, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.96% (0.5567 => 0.5291, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.95% (0.5999 => 0.5702, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.95% (0.2548 => 0.2422, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.91% (8.0126 => 7.6188, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.90% (0.4916 => 0.4675, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -4.89% (0.2659 => 0.2529, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: -4.84% (3.5154 => 3.3451, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.82% (0.2385 => 0.2270, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.80% (1.6474 => 1.5684, std.dev.: 0.0220) SingleSource/UnitTests/ObjC/trivial-interface: -4.77% (0.3812 => 0.3630, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.76% (0.3319 => 0.3161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.76% (0.5168 => 0.4922, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -4.73% (0.7447 => 0.7095, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.72% (15.2527 => 14.5328, std.dev.: 0.0098) MultiSource/Applications/lua/lua: -4.66% (4.0594 => 3.8701, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/for-in: -4.66% (0.4033 => 0.3845, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -4.64% (15.5079 => 14.7891, std.dev.: 0.0117) MultiSource/Applications/hexxagon/hexxagon: -4.60% (1.3148 => 1.2543, std.dev.: 0.0101) SingleSource/UnitTests/ObjC/exceptions: -4.60% (0.4176 => 0.3984, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.57% (0.3848 => 0.3672, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.55% (0.6194 => 0.5912, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.55% (0.3891 => 0.3714, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.53% (0.3884 => 0.3708, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (0.7021 => 0.6703, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.52% (0.3896 => 0.3720, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -4.51% (2.4021 => 2.2937, std.dev.: 0.0073) SingleSource/UnitTests/ObjC/exceptions-4: -4.51% (0.3880 => 0.3705, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.49% (0.3831 => 0.3659, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.43% (0.4151 => 0.3967, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.43% (0.6304 => 0.6025, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.41% (22.4056 => 21.4174, std.dev.: 0.0029) MultiSource/Applications/treecc/treecc: -4.40% (2.1401 => 2.0459, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.38% (0.6297 => 0.6021, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.38% (0.6189 => 0.5918, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.36% (0.4199 => 0.4016, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.35% (0.5329 => 0.5097, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -4.31% (5.0226 => 4.8059, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: -4.30% (0.3255 => 0.3115, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.28% (0.3016 => 0.2887, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -4.27% (0.7982 => 0.7641, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -4.25% (0.3271 => 0.3132, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.25% (0.3837 => 0.3674, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.24% (0.3252 => 0.3114, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -4.24% (0.4248 => 0.4068, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.22% (0.4813 => 0.4610, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.20% (0.3931 => 0.3766, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -4.20% (0.3194 => 0.3060, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.18% (0.3323 => 0.3184, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -4.18% (0.8418 => 0.8066, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.17% (2.2587 => 2.1645, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -4.16% (0.4280 => 0.4102, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -4.16% (0.4861 => 0.4659, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -4.14% (34.0927 => 32.6802, std.dev.: 0.0211) SingleSource/Benchmarks/Shootout-C++/methcall: -4.13% (0.3025 => 0.2900, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -4.13% (0.3026 => 0.2901, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -4.12% (0.3394 => 0.3254, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.11% (2.1713 => 2.0821, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.10% (0.9557 => 0.9165, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: -4.09% (0.3446 => 0.3305, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -4.05% (0.3059 => 0.2935, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.05% (0.3849 => 0.3693, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -4.02% (18.2933 => 17.5580, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.00% (0.4321 => 0.4148, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -3.98% (0.2989 => 0.2870, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -3.93% (0.3867 => 0.3715, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.89% (0.3057 => 0.2938, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.89% (0.2903 => 0.2790, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.89% (0.2933 => 0.2819, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -3.87% (0.2871 => 0.2760, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -3.84% (0.2939 => 0.2826, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -3.82% (0.3481 => 0.3348, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -3.82% (0.7779 => 0.7482, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -3.78% (0.3621 => 0.3484, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.77% (0.9077 => 0.8735, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: -3.71% (0.4524 => 0.4356, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -3.71% (0.3205 => 0.3086, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.66% (0.4427 => 0.4265, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -3.65% (0.2849 => 0.2745, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.60% (0.4083 => 0.3936, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.55% (0.3491 => 0.3367, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -3.50% (0.6750 => 0.6514, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -3.48% (0.3788 => 0.3656, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.43% (0.6347 => 0.6129, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.38% (0.6441 => 0.6223, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.16% (5.4682 => 5.2956, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: -3.14% (1.5610 => 1.5120, std.dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -2.27% (20.7746 => 20.3036, std.dev.: 0.0619) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.54% (7.5137 => 5.7446, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/richards_benchmark: -8.72% (1.2842 => 1.1722, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.79% (2.2633 => 2.1775, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.00% (1.3096 => 1.2834, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.50% (6.5735 => 6.4750, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 3.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 18 04:45:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 06:45:55 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121118124555.DA5B72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6005?compare_to=6000&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6005, Order: 168283, Start Time: 2012-11-18 10:26:10, End Time: 2012-11-18 12:46:18 To: 6000, Order: 168280, Start Time: 2012-11-18 07:12:32, End Time: 2012-11-18 09:36:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (50 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 61 (173 on baseline) Performance Improvements: 8 (40 on baseline) Added Tests: 0 (136 on baseline) Existing Failures: 52 (2 on baseline) Unchanged Tests: 971 (674 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0894 => 0.1043, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 16.11% (0.6244 => 0.7250, std.dev.: 0.0082) MultiSource/Applications/lambda-0_1_3/lambda: 15.56% (0.8543 => 0.9872, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.11% (0.6190 => 0.7125, std.dev.: 0.0217) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 14.77% (0.5945 => 0.6823, std.dev.: 0.0074) SingleSource/Benchmarks/McGill/exptree: 13.76% (0.0930 => 0.1058, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.84% (0.2236 => 0.2523, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.58% (0.1431 => 0.1611, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: 12.54% (0.3581 => 0.4030, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 12.41% (0.1893 => 0.2128, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 11.84% (0.4780 => 0.5346, std.dev.: 0.0086) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.32% (0.2580 => 0.2872, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.19% (0.5926 => 0.6589, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.11% (1.4731 => 1.6367, std.dev.: 0.0216) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.62% (0.1714 => 0.1896, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/gs/gs: 10.23% (4.7598 => 5.2466, std.dev.: 0.0786) SingleSource/Benchmarks/Stanford/Puzzle: 10.07% (0.1410 => 0.1552, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.94% (0.2415 => 0.2655, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.86% (0.3609 => 0.3965, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.72% (0.5239 => 0.5748, std.dev.: 0.0090) MultiSource/Benchmarks/McCat/05-eks/eks: 9.60% (0.4793 => 0.5253, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.45% (2.2486 => 2.4611, std.dev.: 0.0494) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.35% (0.5046 => 0.5518, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.92% (6.5003 => 7.0801, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.90% (1.0603 => 1.1547, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.84% (0.7174 => 0.7808, std.dev.: 0.0134) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.76% (0.2899 => 0.3153, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.28% (0.6204 => 0.6718, std.dev.: 0.0166) MultiSource/Benchmarks/FreeBench/neural/neural: 8.01% (0.1611 => 0.1740, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: 7.36% (1.3375 => 1.4360, std.dev.: 0.0352) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.29% (0.3457 => 0.3709, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.27% (1.2225 => 1.3114, std.dev.: 0.0104) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.21% (2.3453 => 2.5144, std.dev.: 0.0331) SingleSource/UnitTests/ObjC/trivial-interface: 6.86% (0.3953 => 0.4224, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.77% (1.8984 => 2.0270, std.dev.: 0.0301) SingleSource/UnitTests/ObjC++/Hello: 5.96% (0.6625 => 0.7020, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.64% (5.6057 => 5.9218, std.dev.: 0.0937) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.60% (5.6673 => 5.9849, std.dev.: 0.0900) SingleSource/Benchmarks/Shootout-C++/moments: 5.24% (0.4654 => 0.4898, std.dev.: 0.0060) MultiSource/Benchmarks/PAQ8p/paq8p: 4.95% (11.3177 => 11.8780, std.dev.: 0.0629) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.15% (0.3418 => 0.3560, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: 3.92% (0.7858 => 0.8166, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: 89.77% (0.1046 => 0.1985, std.dev.: 0.0192) SingleSource/UnitTests/ObjC/synchronized: 54.17% (0.1102 => 0.1699, std.dev.: 0.0133) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 38.79% (0.3403 => 0.4723, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/ft/ft: 28.97% (1.3258 => 1.7099, std.dev.: 0.0139) MultiSource/Benchmarks/McCat/09-vor/vor: 28.64% (0.1257 => 0.1617, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 28.53% (6.7510 => 8.6772, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.71% (1.5576 => 1.9581, std.dev.: 0.0431) SingleSource/Benchmarks/Shootout/ary3: 25.70% (3.9096 => 4.9145, std.dev.: 0.1485) MultiSource/Applications/JM/ldecod/ldecod: 21.53% (0.1212 => 0.1473, std.dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.64% (25.1231 => 29.0516, std.dev.: 0.0167) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 14.01% (0.4104 => 0.4679, std.dev.: 0.0125) MultiSource/Benchmarks/Bullet/bullet: 10.08% (7.7519 => 8.5332, std.dev.: 0.2781) SingleSource/Benchmarks/McGill/chomp: 8.83% (1.2140 => 1.3212, std.dev.: 0.0140) MultiSource/Applications/lemon/lemon: 8.59% (1.4369 => 1.5603, std.dev.: 0.0089) SingleSource/Benchmarks/CoyoteBench/huffbench: 4.97% (18.3762 => 19.2903, std.dev.: 0.0552) MultiSource/Benchmarks/FreeBench/neural/neural: 4.47% (0.2238 => 0.2338, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.54% (61.0526 => 61.9948, std.dev.: 0.1871) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.54% (4.9686 => 5.0449, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.07% (3.0333 => 3.0657, std.dev.: 0.0091) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/reversefile: -7.63% (0.4665 => 0.4309, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/ary2: -6.93% (0.3966 => 0.3691, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -6.86% (0.4286 => 0.3992, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -5.85% (0.9368 => 0.8820, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.50% (0.7134 => 0.6956, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/hash: -7.71% (5.3825 => 4.9673, std.dev.: 0.0996) SingleSource/Benchmarks/Shootout/strcat: -7.68% (0.2095 => 0.1934, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.27% (4.1143 => 3.9388, std.dev.: 0.0543) Existing Failures - Compile Time -------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/LivermoreLoops/kernel01: 0.52% (0.0193 => 0.0194, std.dev.: 0.0006) SingleSource/Benchmarks/LivermoreLoops/kernel02: - (0.0194 => 0.0194, std.dev.: 0.0007) SingleSource/Benchmarks/LivermoreLoops/kernel03: 1.56% (0.0192 => 0.0195, std.dev.: 0.0006) SingleSource/Benchmarks/LivermoreLoops/kernel04: - (0.0194 => 0.0194, std.dev.: 0.0009) SingleSource/Benchmarks/LivermoreLoops/kernel05: - (0.0193 => 0.0193, std.dev.: 0.0009) SingleSource/Benchmarks/LivermoreLoops/kernel06: - (0.0193 => 0.0193, std.dev.: 0.0009) SingleSource/Benchmarks/LivermoreLoops/kernel07: - (0.0194 => 0.0194, std.dev.: 0.0011) SingleSource/Benchmarks/LivermoreLoops/kernel08: - (0.0199 => 0.0199, std.dev.: 0.0012) SingleSource/Benchmarks/LivermoreLoops/kernel09: - (0.0194 => 0.0194, std.dev.: 0.0012) SingleSource/Benchmarks/LivermoreLoops/kernel10: - (0.0195 => 0.0195, std.dev.: 0.0011) SingleSource/Benchmarks/LivermoreLoops/kernel11: - (0.0193 => 0.0193, std.dev.: 0.0012) SingleSource/Benchmarks/LivermoreLoops/kernel12: - (0.0192 => 0.0192, std.dev.: 0.0013) SingleSource/Benchmarks/LivermoreLoops/kernel13: - (0.0196 => 0.0196, std.dev.: 0.0014) SingleSource/Benchmarks/LivermoreLoops/kernel14: 0.51% (0.0197 => 0.0198, std.dev.: 0.0011) SingleSource/Benchmarks/LivermoreLoops/kernel15: 0.50% (0.0201 => 0.0202, std.dev.: 0.0011) SingleSource/Benchmarks/LivermoreLoops/kernel16: - (0.0199 => 0.0199, std.dev.: 0.0012) SingleSource/Benchmarks/LivermoreLoops/kernel17: 0.51% (0.0196 => 0.0197, std.dev.: 0.0011) SingleSource/Benchmarks/LivermoreLoops/kernel18: 0.50% (0.0201 => 0.0202, std.dev.: 0.0013) SingleSource/Benchmarks/LivermoreLoops/kernel19: - (0.0194 => 0.0194, std.dev.: 0.0013) SingleSource/Benchmarks/LivermoreLoops/kernel20: 0.51% (0.0195 => 0.0196, std.dev.: 0.0012) SingleSource/Benchmarks/LivermoreLoops/kernel21: 1.55% (0.0193 => 0.0196, std.dev.: 0.0006) SingleSource/Benchmarks/LivermoreLoops/kernel22: 0.52% (0.0194 => 0.0195, std.dev.: 0.0006) SingleSource/Benchmarks/LivermoreLoops/kernel23: 1.03% (0.0194 => 0.0196, std.dev.: 0.0006) SingleSource/Benchmarks/LivermoreLoops/kernel24: 0.52% (0.0193 => 0.0194, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 MultiSource/Applications/oggenc/oggenc: -1.98% (0.1365 => 0.1338, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.71% (0.0421 => 0.0418, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0652 => 0.0652, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: 0.11% (493.7054 => 494.2585, std.dev.: 0.0524) SingleSource/Benchmarks/LivermoreLoops/kernel01: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel02: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel03: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel04: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel05: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel06: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel07: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel08: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel09: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel10: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel11: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel12: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel13: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel14: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel15: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel16: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel17: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel18: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel19: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel20: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel21: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel22: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel23: - (0.0001 => 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel24: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: 43728.90% (1.1277 => 494.2585, std.dev.: 0.0524) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.45% (0.5229 => 1.5397, std.dev.: 0.1213) MultiSource/Applications/SPASS/SPASS: 22.71% (14.9895 => 18.3942, std.dev.: 0.0273) MultiSource/Applications/kimwitu++/kc: 51.10% (14.1553 => 21.3883, std.dev.: 0.1251) MultiSource/Benchmarks/MallocBench/gs/gs: 27.64% (4.1105 => 5.2466, std.dev.: 0.0786) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 41.08% (1.1048 => 1.5587, std.dev.: 0.0526) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 440.62% (7.1582 => 38.6989, std.dev.: 0.1199) SingleSource/Benchmarks/Misc-C++-EH/spirit: 104.46% (3.4629 => 7.0801, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++/stepanov_container: 85.58% (0.6222 => 1.1547, std.dev.: 0.0088) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10677.78% (0.0720 => 7.7600, std.dev.: 0.2893) MultiSource/Applications/SIBsim4/SIBsim4: 3859700.00% (0.0001 => 3.8598, std.dev.: 0.0315) MultiSource/Applications/SPASS/SPASS: 13809900.00% (0.0001 => 13.8100, std.dev.: 1.2782) MultiSource/Applications/kimwitu++/kc: 51500.00% (0.0001 => 0.0516, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 64800.00% (0.0001 => 0.0649, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 612500.00% (0.0001 => 0.6126, std.dev.: 0.0262) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10075500.00% (0.0001 => 10.0756, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5839900.00% (0.0001 => 5.8400, std.dev.: 0.5869) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1788.60% (1.1194 => 21.1410, std.dev.: 0.1134) MultiSource/Applications/ClamAV/clamscan: 68.72% (22.1758 => 37.4156, std.dev.: 0.3531) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 59.48% (2.9384 => 4.6863, std.dev.: 0.3086) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.25% (7.0540 => 11.0926, std.dev.: 0.0941) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 51.10% (8.1363 => 12.2942, std.dev.: 0.0292) SingleSource/Benchmarks/CoyoteBench/almabench: 50.00% (0.0730 => 0.1095, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/distray/distray: 48.01% (0.1056 => 0.1563, std.dev.: 0.0072) MultiSource/Applications/JM/lencod/lencod: 47.88% (21.9371 => 32.4399, std.dev.: 0.1643) SingleSource/Benchmarks/Stanford/Oscar: 38.84% (0.0636 => 0.0883, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 38.41% (0.1432 => 0.1982, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/15-trie/trie: 34.91% (0.0527 => 0.0711, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: 34.32% (0.0746 => 0.1002, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 32.81% (0.7433 => 0.9872, std.dev.: 0.0106) SingleSource/Benchmarks/Stanford/Towers: 30.57% (0.0471 => 0.0615, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.34% (0.1236 => 0.1611, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.18% (2.2024 => 2.8671, std.dev.: 0.0221) MultiSource/Benchmarks/Ptrdist/ft/ft: 30.05% (0.1940 => 0.2523, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/exptree: 29.98% (0.0814 => 0.1058, std.dev.: 0.0027) SingleSource/UnitTests/vla: 29.86% (0.0355 => 0.0461, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 29.10% (0.0842 => 0.1087, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/17-bintr/bintr: 28.59% (0.0675 => 0.0868, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: 28.58% (0.1655 => 0.2128, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Queens: 28.26% (0.0414 => 0.0531, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.87% (0.0793 => 0.1014, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.81% (1.5859 => 2.0270, std.dev.: 0.0301) MultiSource/Benchmarks/McCat/18-imp/imp: 27.81% (0.3423 => 0.4375, std.dev.: 0.0091) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.38% (0.1125 => 0.1433, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/RealMM: 27.27% (0.0396 => 0.0504, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.04% (0.3121 => 0.3965, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/09-vor/vor: 26.73% (0.3180 => 0.4030, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 26.49% (0.6456 => 0.8166, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 26.46% (0.2271 => 0.2872, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 26.01% (0.2107 => 0.2655, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 25.56% (0.1510 => 0.1896, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/matrix: 25.55% (0.0818 => 0.1027, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 25.50% (0.0953 => 0.1196, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 25.42% (1.3050 => 1.6367, std.dev.: 0.0216) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.25% (0.0408 => 0.0511, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/misr: 24.96% (0.0633 => 0.0791, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.94% (0.0770 => 0.0962, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 24.91% (0.5569 => 0.6956, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash: 24.64% (0.4289 => 0.5346, std.dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 24.55% (0.4615 => 0.5748, std.dev.: 0.0090) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.98% (0.0834 => 0.1034, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 23.96% (0.7115 => 0.8820, std.dev.: 0.0165) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 23.77% (0.0467 => 0.0578, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 23.72% (0.1695 => 0.2097, std.dev.: 0.0073) MultiSource/Applications/Burg/burg: 23.35% (1.1642 => 1.4360, std.dev.: 0.0352) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.59% (0.1337 => 0.1639, std.dev.: 0.0047) SingleSource/Benchmarks/Stanford/Puzzle: 22.40% (0.1268 => 0.1552, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/05-eks/eks: 22.19% (0.4299 => 0.5253, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 22.09% (14.3668 => 17.5404, std.dev.: 0.1312) SingleSource/UnitTests/ObjC/trivial-interface: 21.62% (0.3473 => 0.4224, std.dev.: 0.0077) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.39% (0.1566 => 0.1901, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 21.13% (0.2603 => 0.3153, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 21.05% (0.6450 => 0.7808, std.dev.: 0.0134) MultiSource/Applications/lua/lua: 21.04% (3.8723 => 4.6869, std.dev.: 0.1503) SingleSource/Benchmarks/Shootout-C++/moments: 21.00% (0.4048 => 0.4898, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 20.97% (0.8101 => 0.9800, std.dev.: 0.0172) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.96% (0.1584 => 0.1916, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/tsp/tsp: 20.60% (0.1175 => 0.1417, std.dev.: 0.0043) MultiSource/Applications/viterbi/viterbi: 20.45% (0.1555 => 0.1873, std.dev.: 0.0051) MultiSource/Applications/spiff/spiff: 19.95% (0.7835 => 0.9398, std.dev.: 0.0326) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.76% (4.9449 => 5.9218, std.dev.: 0.0937) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.65% (5.0018 => 5.9849, std.dev.: 0.0900) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.34% (0.1029 => 0.1228, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash2: 19.31% (0.4620 => 0.5512, std.dev.: 0.0122) MultiSource/Benchmarks/Olden/bh/bh: 19.28% (0.3092 => 0.3688, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 19.10% (2.0665 => 2.4611, std.dev.: 0.0494) MultiSource/Benchmarks/FreeBench/neural/neural: 18.93% (0.1463 => 0.1740, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.54% (0.9765 => 1.1575, std.dev.: 0.0363) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 18.50% (0.1892 => 0.2242, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/Hello: 18.48% (0.5925 => 0.7020, std.dev.: 0.0049) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.47% (0.0704 => 0.0834, std.dev.: 0.0017) SingleSource/UnitTests/SignlessTypes/Large/cast: 17.91% (0.0564 => 0.0665, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 17.75% (17.1811 => 20.2309, std.dev.: 0.0874) SingleSource/Benchmarks/Misc/oourafft: 17.70% (0.3282 => 0.3863, std.dev.: 0.0118) SingleSource/UnitTests/SignlessTypes/rem: 17.66% (0.1144 => 0.1346, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.34% (0.8172 => 0.9589, std.dev.: 0.0440) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.30% (0.3162 => 0.3709, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.22% (0.0871 => 0.1021, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference-object: 16.65% (0.6030 => 0.7034, std.dev.: 0.0125) MultiSource/Benchmarks/Olden/mst/mst: 16.25% (0.1163 => 0.1352, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.20% (0.0648 => 0.0753, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/random: 15.95% (0.2802 => 0.3249, std.dev.: 0.0118) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.91% (0.0886 => 0.1027, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/lists1: 15.64% (0.3684 => 0.4260, std.dev.: 0.0138) MultiSource/Benchmarks/mafft/pairlocalalign: 15.54% (9.4845 => 10.9584, std.dev.: 0.2189) MultiSource/Benchmarks/Olden/health/health: 15.46% (0.1268 => 0.1464, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 15.29% (0.7326 => 0.8446, std.dev.: 0.0159) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.19% (0.0770 => 0.0887, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 15.02% (0.0719 => 0.0827, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/ReedSolomon: 14.98% (0.2049 => 0.2356, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.86% (0.1117 => 0.1283, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.83% (0.2758 => 0.3167, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.69% (0.1062 => 0.1218, std.dev.: 0.0055) MultiSource/Benchmarks/PAQ8p/paq8p: 14.57% (10.3673 => 11.8780, std.dev.: 0.0629) SingleSource/Benchmarks/Shootout-C++/objinst: 14.56% (0.3131 => 0.3587, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.50% (1.4186 => 1.6243, std.dev.: 0.0782) MultiSource/Benchmarks/Bullet/bullet: 14.47% (63.2438 => 72.3957, std.dev.: 0.1857) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 14.29% (3.8922 => 4.4483, std.dev.: 0.1911) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.23% (4.2646 => 4.8715, std.dev.: 0.0338) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.18% (2.2022 => 2.5144, std.dev.: 0.0331) SingleSource/Benchmarks/Shootout-C++/nestedloop: 14.07% (0.2793 => 0.3186, std.dev.: 0.0103) SingleSource/UnitTests/ObjC/parameter-passing: 14.06% (0.3927 => 0.4479, std.dev.: 0.0212) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.01% (0.5981 => 0.6819, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.78% (0.3441 => 0.3915, std.dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.65% (0.5105 => 0.5802, std.dev.: 0.0205) SingleSource/UnitTests/ObjC/synchronized: 13.62% (0.3561 => 0.4046, std.dev.: 0.0167) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.52% (0.3543 => 0.4022, std.dev.: 0.0181) SingleSource/UnitTests/ObjC/exceptions-4: 13.46% (0.3543 => 0.4020, std.dev.: 0.0074) SingleSource/UnitTests/ObjC/exceptions-3: 13.42% (0.3516 => 0.3988, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/exceptions-2: 13.38% (0.3497 => 0.3965, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/exceptions: 13.22% (0.3828 => 0.4334, std.dev.: 0.0086) SingleSource/UnitTests/ObjC/for-in: 13.16% (0.3694 => 0.4180, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.10% (0.4879 => 0.5518, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.21% (0.5020 => 0.5633, std.dev.: 0.0227) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.06% (0.3177 => 0.3560, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.86% (0.1695 => 0.1896, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.49% (0.3865 => 0.4309, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/sieve: 10.80% (0.3603 => 0.3992, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 10.78% (0.8921 => 0.9883, std.dev.: 0.0264) MultiSource/Benchmarks/sim/sim: 9.95% (0.3387 => 0.3724, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.38% (0.4064 => 0.4445, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 9.23% (0.3379 => 0.3691, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 8.96% (0.3283 => 0.3577, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 8.33% (0.2714 => 0.2940, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.93% (1.2842 => 1.3861, std.dev.: 0.0369) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.53% (0.3136 => 0.3372, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.30% (0.1438 => 0.1543, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.69% (0.3817 => 0.4034, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.32% (4.3953 => 11.0023, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/methcall: 147.62% (5.3999 => 13.3713, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/17-bintr/bintr: 90.32% (0.1043 => 0.1985, std.dev.: 0.0192) SingleSource/UnitTests/ObjC/synchronized: 61.66% (0.1051 => 0.1699, std.dev.: 0.0133) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 45.06% (0.3256 => 0.4723, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/09-vor/vor: 40.12% (0.1154 => 0.1617, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ft/ft: 33.19% (1.2838 => 1.7099, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout/ary3: 32.85% (3.6994 => 4.9145, std.dev.: 0.1485) MultiSource/Benchmarks/VersaBench/dbms/dbms: 29.80% (1.5086 => 1.9581, std.dev.: 0.0431) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 21.39% (1.3045 => 1.5835, std.dev.: 0.0760) SingleSource/Benchmarks/Misc/oourafft: 17.51% (6.6465 => 7.8101, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.67% (1.1145 => 1.3003, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/moments: 15.44% (0.1159 => 0.1338, std.dev.: 0.0047) MultiSource/Applications/JM/ldecod/ldecod: 13.48% (0.1298 => 0.1473, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.08% (0.2944 => 0.3329, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.76% (2.8904 => 3.2303, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 10.28% (1.1396 => 1.2567, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.56% (1.7254 => 1.8904, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 9.08% (3.1578 => 3.4444, std.dev.: 0.0885) SingleSource/Benchmarks/BenchmarkGame/puzzle: 8.53% (0.6962 => 0.7556, std.dev.: 0.0155) MultiSource/Applications/lemon/lemon: 7.90% (1.4460 => 1.5603, std.dev.: 0.0089) SingleSource/Benchmarks/McGill/chomp: 6.78% (1.2373 => 1.3212, std.dev.: 0.0140) MultiSource/Benchmarks/Olden/bh/bh: 6.44% (1.9405 => 2.0655, std.dev.: 0.0135) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.94% (0.9540 => 1.0107, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.39% (4.2280 => 4.4561, std.dev.: 0.0087) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.76% (0.3463 => 0.3628, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 4.70% (0.2233 => 0.2338, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 4.14% (0.4445 => 0.4629, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.10% (11.6436 => 12.1215, std.dev.: 0.0074) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.36% (0.4162 => 0.4302, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: 2.63% (2.4116 => 2.4750, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.24% (1.7133 => 1.7517, std.dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: 2.17% (85.0658 => 86.9122, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.16% (1.3677 => 1.3972, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 2.08% (3.1595 => 3.2251, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (27.8444 => 28.3061, std.dev.: 0.0207) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.51% (6.5088 => 6.6069, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.2139 => 5.2758, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0499, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.34% (6.6874 => 0.1778, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.15% (5.2763 => 1.3114, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/salsa20: -74.82% (0.8651 => 0.2178, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: -35.70% (0.1622 => 0.1043, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.30% (5.3855 => 4.7229, std.dev.: 0.0791) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.20% (5.3526 => 4.6994, std.dev.: 0.1818) MultiSource/Applications/JM/ldecod/ldecod: -9.97% (10.4361 => 9.3955, std.dev.: 0.3607) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.20% (0.0628 => 0.0363, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.95% (0.3987 => 0.2394, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.92% (0.0506 => 0.0304, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.25% (4.5009 => 2.7793, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.12% (2.6546 => 2.0142, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -20.33% (10.7105 => 8.5332, std.dev.: 0.2781) MultiSource/Benchmarks/FreeBench/mason/mason: -19.25% (0.2161 => 0.1745, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.87% (1.6925 => 1.4239, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.72% (2.6778 => 2.2836, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.64% (32.5116 => 29.0516, std.dev.: 0.0167) SingleSource/Benchmarks/Misc/mandel-2: -10.63% (1.5373 => 1.3739, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4244, std.dev.: 0.0041) MultiSource/Benchmarks/NPB-serial/is/is: -9.04% (9.5636 => 8.6994, std.dev.: 0.1072) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5760, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.43% (3.2416 => 3.0657, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5081, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.45% (1.6805 => 1.6058, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout/lists: -4.28% (6.2999 => 6.0301, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.30% (19.9488 => 19.2903, std.dev.: 0.0552) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8918, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.68% (0.9957 => 0.9690, std.dev.: 0.0066) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.37% (0.4808 => 0.4694, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.00% (8.1563 => 7.9934, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6772, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -1.49% (10.2830 => 10.1295, std.dev.: 0.0038) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0026) Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 18 06:21:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 08:21:07 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121118142107.97F322A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6006?compare_to=6003&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6006, Order: 168286, Start Time: 2012-11-18 12:51:40, End Time: 2012-11-18 14:21:30 To: 6003, Order: 168285, Start Time: 2012-11-18 11:04:13, End Time: 2012-11-18 12:34:53 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 7 (114 on baseline) Performance Improvements: 3 (32 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1044 (828 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 3.23% (1.4479 => 1.4946, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.32% (0.6080 => 0.6221, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.00% (0.8370 => 0.8537, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.78% (2.4260 => 2.5906, std.dev.: 0.0305) SingleSource/Benchmarks/Misc/pi: 2.48% (2.4434 => 2.5041, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/lists: 2.30% (7.3650 => 7.5341, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.34% (4.4128 => 4.4720, std.dev.: 0.0126) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.58% (6.8448 => 6.7369, std.dev.: 0.0332) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel24: -28.02% (0.3433 => 0.2471, std.dev.: 0.0305) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -1.66% (45.6600 => 44.9008, std.dev.: 0.2078) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.04% (1.0659 => 1.0655, std.dev.: 0.0120) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -35.78% (0.0218 => 0.0140, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.75% (0.0427 => 0.0411, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.22% (0.0245 => 0.0248, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.59% (0.0314 => 0.0309, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.33% (0.0429 => 0.0419, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: 26.71% (0.0161 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -0.99% (0.0202 => 0.0200, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1476 => 0.1477, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -3.83% (1.1796 => 1.1344, std.dev.: 0.0303) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.52% (0.4204 => 0.4226, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.50% (0.1404 => 0.1425, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.63% (0.0636 => 0.0640, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.02% (0.0196 => 0.0194, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.65% (0.0546 => 0.0555, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.05% (1.1961 => 1.1955, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -50.00% (0.0002 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -72.73% (0.0022 => 0.0006, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.60% (0.0566 => 0.0609, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.41% (0.0245 => 0.0195, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.24% (0.7817 => 0.7798, std.dev.: 0.0033) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -59.63% (0.0109 => 0.0044, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.76% (16.4461 => 17.7216, std.dev.: 0.0443) MultiSource/Applications/sqlite3/sqlite3: 2317.91% (0.6332 => 15.3102, std.dev.: 0.1203) MultiSource/Benchmarks/McCat/08-main/main: 50.52% (0.1831 => 0.2756, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.16% (0.1559 => 0.1463, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7046.59% (0.3123 => 22.3188, std.dev.: 0.2282) SingleSource/Benchmarks/CoyoteBench/fftbench: 52.33% (0.2463 => 0.3752, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1530.59% (0.3344 => 5.4527, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.62% (0.2364 => 0.3277, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 4.79% (0.6010 => 0.6298, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: 3.96% (0.0429 => 0.0446, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.46% (0.3266 => 0.3477, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/strcat: 7.41% (0.1969 => 0.2115, std.dev.: 0.0034) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.12% (0.0224 => 0.0231, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -32.17% (0.0230 => 0.0156, std.dev.: 0.0008) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0483, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 5.61% (0.1462 => 0.1544, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4727, std.dev.: 0.0225) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0734, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4949, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5121, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5554, std.dev.: 0.0793) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3256, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1322, std.dev.: 0.0242) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3630, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4113, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0863, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: -23.79% (2.1832 => 1.6639, std.dev.: 0.0236) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.28% (0.0810 => 0.0950, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.07% (0.0773 => 0.0874, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.65% (0.1425 => 0.1534, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.61% (0.1905 => 0.2050, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.39% (0.2180 => 0.2341, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.19% (0.7473 => 0.8010, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.01% (0.2279 => 0.2416, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 5.49% (1.2222 => 1.2893, std.dev.: 0.0078) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.17% (0.8321 => 0.8751, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.10% (0.2998 => 0.3151, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.77% (0.8148 => 0.8537, std.dev.: 0.0058) MultiSource/Applications/hbd/hbd: 4.74% (1.4269 => 1.4946, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.36% (0.5961 => 0.6221, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.31% (1.1606 => 1.2106, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.02% (0.4127 => 0.4293, std.dev.: 0.0022) MultiSource/Applications/sgefa/sgefa: 3.87% (0.2999 => 0.3115, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 3.76% (3.8189 => 3.9623, std.dev.: 0.0076) MultiSource/Applications/siod/siod: 3.59% (2.2184 => 2.2980, std.dev.: 0.0081) MultiSource/Applications/minisat/minisat: 3.53% (0.6834 => 0.7075, std.dev.: 0.0038) MultiSource/Applications/SIBsim4/SIBsim4: 3.52% (1.2568 => 1.3011, std.dev.: 0.0051) MultiSource/Applications/treecc/treecc: 3.49% (1.9948 => 2.0645, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.33% (2.1401 => 2.2114, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/moments: 3.26% (0.3645 => 0.3764, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.26% (0.4783 => 0.4939, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.24% (14.2605 => 14.7225, std.dev.: 0.0226) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.20% (0.3657 => 0.3774, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.19% (0.9069 => 0.9358, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.18% (1.1685 => 1.2057, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.11% (0.8340 => 0.8599, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.06% (1.4479 => 1.4922, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.91% (4.1763 => 4.2979, std.dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.91% (1.5315 => 1.5760, std.dev.: 0.0117) MultiSource/Benchmarks/nbench/nbench: 2.87% (1.1271 => 1.1594, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.80% (0.8069 => 0.8295, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.76% (0.8611 => 0.8849, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 2.76% (14.7684 => 15.1764, std.dev.: 0.0778) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.74% (0.8697 => 0.8935, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.68% (0.8317 => 0.8540, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 2.65% (0.9810 => 1.0070, std.dev.: 0.0078) MultiSource/Benchmarks/Bullet/bullet: 2.61% (31.8598 => 32.6909, std.dev.: 0.0532) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.56% (0.9908 => 1.0162, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.54% (0.5191 => 0.5323, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.54% (0.8086 => 0.8291, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.52% (0.8457 => 0.8670, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.51% (0.8716 => 0.8935, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.50% (0.9688 => 0.9930, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.50% (3.1832 => 3.2627, std.dev.: 0.0235) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.44% (0.8597 => 0.8807, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.41% (0.8286 => 0.8486, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 2.40% (0.7557 => 0.7738, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.39% (0.4559 => 0.4668, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.39% (0.8007 => 0.8198, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.34% (0.8261 => 0.8454, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.32% (0.7932 => 0.8116, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.29% (0.8855 => 0.9058, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.27% (0.9074 => 0.9280, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.26% (0.8656 => 0.8852, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.26% (0.8927 => 0.9129, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.24% (0.8712 => 0.8907, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.23% (0.6586 => 0.6733, std.dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 2.21% (15.3280 => 15.6668, std.dev.: 0.0783) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.10% (0.9039 => 0.9229, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.07% (0.8885 => 0.9069, std.dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: 2.06% (8.6247 => 8.8025, std.dev.: 0.0392) MultiSource/Applications/oggenc/oggenc: 2.06% (4.9628 => 5.0650, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.04% (13.1811 => 13.4495, std.dev.: 0.0755) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.01% (0.8066 => 0.8228, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.00% (1.1170 => 1.1393, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.99% (0.8331 => 0.8497, std.dev.: 0.0050) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.96% (6.6074 => 6.7369, std.dev.: 0.0332) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.95% (4.4880 => 4.5754, std.dev.: 0.0267) MultiSource/Applications/JM/ldecod/ldecod: 1.89% (6.7320 => 6.8594, std.dev.: 0.0224) SingleSource/UnitTests/Vector/constpool: 1.88% (8.4179 => 8.5759, std.dev.: 0.0339) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.86% (0.8338 => 0.8493, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.73% (0.7966 => 0.8104, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/football/football: 1.72% (0.8768 => 0.8919, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.72% (0.8316 => 0.8459, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.55% (0.8995 => 0.9134, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.44% (4.4873 => 4.5518, std.dev.: 0.0236) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.07% (1.2423 => 1.2556, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 113.07% (0.0199 => 0.0424, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/pi: 58.54% (1.5795 => 2.5041, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.85% (0.7597 => 0.8877, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.48% (2.9753 => 3.4655, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.38% (2.7995 => 3.2022, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6087, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.22% (0.3186 => 0.3448, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.51% (1.1857 => 1.2748, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/queens: 7.46% (1.7056 => 1.8329, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 6.96% (1.3037 => 1.3944, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.67% (4.7794 => 5.0984, std.dev.: 0.0124) MultiSource/Applications/SIBsim4/SIBsim4: 6.31% (3.1873 => 3.3883, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.92% (4.9686 => 5.2625, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.81% (4.5327 => 4.7960, std.dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 5.04% (7.4933 => 7.8711, std.dev.: 0.0633) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.68% (6.2275 => 6.5188, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.49% (3.3761 => 3.5277, std.dev.: 0.0268) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.20% (4.9453 => 5.1530, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.99% (4.9469 => 5.1444, std.dev.: 0.0660) MultiSource/Applications/hexxagon/hexxagon: 3.81% (14.0064 => 14.5398, std.dev.: 0.0223) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.09% (0.3587 => 0.3698, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.08% (1.2337 => 1.2717, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.81% (11.5690 => 11.8939, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 2.73% (3.6643 => 3.7642, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout/lists: 2.68% (7.3375 => 7.5341, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.49% (8.2783 => 8.4843, std.dev.: 0.0150) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.21% (4.8362 => 4.9432, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.18% (4.8660 => 4.9719, std.dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.14% (1.1365 => 1.1608, std.dev.: 0.0029) MultiSource/Applications/spiff/spiff: 1.61% (2.8561 => 2.9020, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.29% (2.4647 => 2.4966, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 1.25% (8.5322 => 8.6389, std.dev.: 0.0194) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.22% (3.5679 => 3.6113, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/power/power: 1.15% (1.2061 => 1.2200, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -35.50% (0.0338 => 0.0218, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/em3d/em3d: -23.59% (5.4641 => 4.1750, std.dev.: 0.0818) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.53% (7.2130 => 6.3093, std.dev.: 0.1317) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -11.06% (14.6451 => 13.0253, std.dev.: 0.2396) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.88% (1.0512 => 0.9368, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: -10.07% (1.1216 => 1.0086, std.dev.: 0.0200) MultiSource/Benchmarks/mafft/pairlocalalign: -8.54% (63.1822 => 57.7842, std.dev.: 0.0668) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.92% (0.3269 => 0.3010, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.99% (4.7482 => 4.4161, std.dev.: 0.0425) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.95% (3.7148 => 3.4937, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.87% (5.4972 => 5.1743, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.05% (5.1557 => 4.8954, std.dev.: 0.0279) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.35% (4.7449 => 4.5383, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.76% (6.0224 => 5.7962, std.dev.: 0.0464) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.74% (2.8773 => 2.7697, std.dev.: 0.0286) MultiSource/Applications/lua/lua: -3.30% (29.8330 => 28.8473, std.dev.: 0.1129) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.25% (2.4490 => 2.3693, std.dev.: 0.0110) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (28.5821 => 27.6723, std.dev.: 0.0272) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.07% (0.5807 => 0.5629, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/mason/mason: -2.64% (0.5415 => 0.5272, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.58% (2.6356 => 2.5677, std.dev.: 0.0046) MultiSource/Applications/aha/aha: -2.43% (3.3398 => 3.2586, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/bisort/bisort: -2.43% (0.6636 => 0.6475, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.33% (9.9065 => 9.6756, std.dev.: 0.0431) SingleSource/Benchmarks/Shootout-C++/hash2: -2.26% (3.4237 => 3.3464, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.10% (3.2169 => 3.1492, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.01% (11.5316 => 11.2996, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.80% (1.2822 => 1.2591, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.58% (4.9994 => 4.9205, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.33% (2.3487 => 2.3175, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.19% (5.6343 => 5.5674, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.04% (4.2466 => 4.2025, std.dev.: 0.0129) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.83% (1.0262 => 1.0655, std.dev.: 0.0120) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 13.82% (0.0123 => 0.0140, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.74% (0.0408 => 0.0411, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.36% (0.0254 => 0.0248, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.32% (0.0302 => 0.0309, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.11% (0.0384 => 0.0419, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 11.11% (0.0180 => 0.0200, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.71% (0.1438 => 0.1477, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 0.13% (1.1329 => 1.1344, std.dev.: 0.0303) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.49% (0.4164 => 0.4226, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.09% (0.1369 => 0.1425, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.16% (0.0641 => 0.0640, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.51% (0.0195 => 0.0194, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.98% (0.0578 => 0.0555, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.53% (1.1437 => 1.1955, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -57.14% (0.0014 => 0.0006, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.87% (0.0627 => 0.0609, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.33% (0.0180 => 0.0195, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.73% (0.8017 => 0.7798, std.dev.: 0.0033) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -29.03% (0.0062 => 0.0044, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 18 06:32:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 08:32:33 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121118143233.544722A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6007?compare_to=6004&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6007, Order: 168286, Start Time: 2012-11-18 12:59:30, End Time: 2012-11-18 14:32:55 To: 6004, Order: 168285, Start Time: 2012-11-18 11:03:06, End Time: 2012-11-18 12:36:40 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (181 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (857 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/flops: 26.48% (7.2598 => 9.1820, std.dev.: 0.0028) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.75% (2.0478 => 2.1041, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.4937 => 7.6824, std.dev.: 0.0237) SingleSource/Benchmarks/Shootout-C++/hash2: 2.13% (3.1932 => 3.2611, std.dev.: 0.0102) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.14% (0.3821 => 0.3510) MultiSource/Benchmarks/PAQ8p/paq8p: -6.85% (2.4924 => 2.3217, std.dev.: 0.0069) MultiSource/Applications/sgefa/sgefa: -6.67% (0.3357 => 0.3133, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.53% (0.9542 => 0.8919, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.52% (0.3142 => 0.2937, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.30% (0.2428 => 0.2275, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.18% (0.1796 => 0.1685, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -6.16% (0.2160 => 0.2027, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.09% (9.2283 => 8.6667, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.06% (0.9852 => 0.9255, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.95% (0.7198 => 0.6770, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -5.91% (0.1761 => 0.1657, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: -5.89% (16.1920 => 15.2391, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: -5.87% (0.9179 => 0.8640, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -5.85% (7.0961 => 6.6810, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.83% (0.6484 => 0.6106, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.82% (0.2355 => 0.2218, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.76% (1.3722 => 1.2932, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.73% (3.5339 => 3.3313, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.67% (1.0544 => 0.9946, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.62% (0.5805 => 0.5479, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.61% (0.6681 => 0.6306, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.57% (4.0323 => 3.8079, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.55% (0.3658 => 0.3455, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -5.55% (0.3406 => 0.3217, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.55% (4.8161 => 4.5489, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.54% (0.6660 => 0.6291, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.53% (0.2695 => 0.2546, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.53% (0.5863 => 0.5539, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.51% (1.6364 => 1.5462, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.51% (1.4642 => 1.3835, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.49% (0.5591 => 0.5284, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.48% (6.7716 => 6.4003, std.dev.: 0.0099) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.48% (4.8802 => 4.6128, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.47% (0.6052 => 0.5721, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.46% (0.5859 => 0.5539, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.45% (1.2300 => 1.1630, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.43% (0.5802 => 0.5487, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.42% (0.6260 => 0.5921, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: -5.40% (0.4515 => 0.4271, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.40% (0.5478 => 0.5182, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -5.40% (1.1450 => 1.0832, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.40% (0.7524 => 0.7118, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.39% (0.6230 => 0.5894, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.38% (0.5575 => 0.5275, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.38% (0.5688 => 0.5382, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -5.38% (4.3330 => 4.0999, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.38% (0.5857 => 0.5542, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.36% (0.6676 => 0.6318, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.36% (4.5069 => 4.2655, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: -5.35% (1.1530 => 1.0913, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.33% (0.6395 => 0.6054, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.32% (0.7919 => 0.7498, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.31% (0.6293 => 0.5959, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.28% (0.5849 => 0.5540, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.28% (0.5705 => 0.5404, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.27% (0.5925 => 0.5613, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.26% (1.3864 => 1.3135, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.25% (0.6667 => 0.6317, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -5.25% (1.2515 => 1.1858, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.24% (1.2784 => 1.2114, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: -5.23% (17.1032 => 16.2092, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.21% (0.7339 => 0.6957, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -5.19% (0.2985 => 0.2830, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.19% (0.5570 => 0.5281, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.18% (0.5581 => 0.5292, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.18% (0.6395 => 0.6064, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.17% (0.5941 => 0.5634, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.15% (0.5569 => 0.5282, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.14% (14.2083 => 13.4773, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.14% (0.8521 => 0.8083, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.13% (1.2221 => 1.1594, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.09% (0.6736 => 0.6393, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.09% (1.2210 => 1.1589, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.08% (0.5567 => 0.5284, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.08% (0.5456 => 0.5179, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.07% (0.6446 => 0.6119, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.03% (0.6440 => 0.6116, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.01% (0.6033 => 0.5731, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.97% (0.3483 => 0.3310, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.94% (8.0126 => 7.6164, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.94% (0.4916 => 0.4673, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.93% (0.5999 => 0.5703, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: -4.91% (0.3581 => 0.3405, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.91% (0.2548 => 0.2423, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.90% (1.6474 => 1.5666, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.90% (0.2999 => 0.2852, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: -4.88% (3.5154 => 3.3440, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/08-main/main: -4.85% (0.2659 => 0.2530, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.82% (0.3319 => 0.3159, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: -4.80% (0.3812 => 0.3629, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.78% (0.2385 => 0.2271, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.76% (0.5168 => 0.4922, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: -4.70% (0.7447 => 0.7097, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -4.68% (4.0594 => 3.8694, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -4.65% (15.2527 => 14.5429, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.65% (0.2278 => 0.2172, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: -4.65% (0.3896 => 0.3715, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.64% (0.3880 => 0.3700, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.64% (0.4033 => 0.3846, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.63% (0.6304 => 0.6012, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.61% (0.3884 => 0.3705, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.57% (0.3891 => 0.3713, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.57% (0.4176 => 0.3985, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: -4.57% (1.3148 => 1.2547, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.57% (0.6194 => 0.5911, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.57% (0.3831 => 0.3656, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -4.55% (15.5079 => 14.8016, std.dev.: 0.0140) SingleSource/UnitTests/ObjC/exceptions-3: -4.55% (0.3848 => 0.3673, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.53% (0.6297 => 0.6012, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.49% (0.7021 => 0.6706, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.48% (0.6189 => 0.5912, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.43% (22.4056 => 21.4123, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.43% (0.4151 => 0.3967, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.43% (0.4199 => 0.4013, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -4.39% (2.4021 => 2.2966, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/matrix: -4.36% (0.3255 => 0.3113, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -4.35% (2.1401 => 2.0470, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.34% (0.3016 => 0.2885, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -4.32% (5.0226 => 4.8056, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.32% (0.5329 => 0.5099, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.25% (0.3837 => 0.3674, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -4.25% (0.7982 => 0.7643, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.24% (0.3323 => 0.3182, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: -4.24% (0.4248 => 0.4068, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -4.23% (0.3025 => 0.2897, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -4.23% (0.3026 => 0.2898, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -4.19% (0.3271 => 0.3134, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.18% (0.4280 => 0.4101, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.17% (0.3931 => 0.3767, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.17% (2.2587 => 2.1645, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: -4.16% (0.3194 => 0.3061, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -4.16% (0.4861 => 0.4659, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -4.15% (0.3446 => 0.3303, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.15% (2.1713 => 2.0812, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -4.12% (0.3394 => 0.3254, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.11% (0.8418 => 0.8072, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.10% (0.9557 => 0.9165, std.dev.: 0.0051) MultiSource/Benchmarks/Bullet/bullet: -4.10% (34.0927 => 32.6944, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.09% (0.3252 => 0.3119, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -4.09% (0.3059 => 0.2934, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.08% (0.3849 => 0.3692, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -4.05% (0.2989 => 0.2868, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.99% (0.3057 => 0.2935, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.99% (0.2933 => 0.2816, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -3.98% (0.3867 => 0.3713, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -3.98% (18.2933 => 17.5648, std.dev.: 0.0291) SingleSource/Benchmarks/Shootout-C++/ary2: -3.94% (0.3481 => 0.3344, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -3.91% (0.2939 => 0.2824, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.89% (0.2903 => 0.2790, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -3.87% (0.2871 => 0.2760, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -3.84% (0.3621 => 0.3482, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -3.82% (0.7779 => 0.7482, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: -3.76% (0.4524 => 0.4354, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.75% (0.4427 => 0.4261, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -3.74% (0.3205 => 0.3085, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.72% (0.9077 => 0.8739, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.70% (0.4813 => 0.4635, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: -3.69% (0.2849 => 0.2744, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.67% (0.4083 => 0.3933, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.61% (0.3491 => 0.3365, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -3.53% (0.6750 => 0.6512, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -3.51% (0.6347 => 0.6124, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -3.48% (0.3788 => 0.3656, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -3.32% (1.5610 => 1.5091, std.dev.: 0.0067) SingleSource/UnitTests/ObjC++/property-reference-object: -3.31% (0.6441 => 0.6228, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.17% (5.4682 => 5.2948, std.dev.: 0.0246) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.34% (0.4321 => 0.4220, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -2.25% (20.7746 => 20.3068, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7530, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7068, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.71% (2.2633 => 2.1794, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.73% (1.3096 => 1.2870, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4680, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 18 07:51:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 09:51:42 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121118155142.C69A52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6008?compare_to=6002&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6008, Order: 168286, Start Time: 2012-11-18 12:30:51, End Time: 2012-11-18 15:52:04 To: 6002, Order: 168283, Start Time: 2012-11-18 08:23:09, End Time: 2012-11-18 11:42:52 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Passes: 48 (0 on baseline) Performance Regressions: 1 (171 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1043 (719 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/LivermoreLoops/kernel01: 60.20% (0.0201 => 0.0322, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel02: 62.69% (0.0201 => 0.0327, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel03: 59.50% (0.0200 => 0.0319, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel04: 60.40% (0.0202 => 0.0324, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel05: 59.20% (0.0201 => 0.0320, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel06: 60.70% (0.0201 => 0.0323) SingleSource/Benchmarks/LivermoreLoops/kernel07: 60.40% (0.0202 => 0.0324, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel08: 66.67% (0.0207 => 0.0345, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel09: 61.88% (0.0202 => 0.0327) SingleSource/Benchmarks/LivermoreLoops/kernel10: 63.05% (0.0203 => 0.0331, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel11: 60.50% (0.0200 => 0.0321, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel12: 60.00% (0.0200 => 0.0320, std.dev.: 0.0003) SingleSource/Benchmarks/LivermoreLoops/kernel13: 63.73% (0.0204 => 0.0334, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel14: 62.62% (0.0206 => 0.0335, std.dev.: 0.0002) SingleSource/Benchmarks/LivermoreLoops/kernel15: 70.00% (0.0210 => 0.0357, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel16: 67.96% (0.0206 => 0.0346, std.dev.: 0.0003) SingleSource/Benchmarks/LivermoreLoops/kernel17: 62.25% (0.0204 => 0.0331) SingleSource/Benchmarks/LivermoreLoops/kernel18: 70.95% (0.0210 => 0.0359, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel19: 61.39% (0.0202 => 0.0326, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel20: 62.87% (0.0202 => 0.0329) SingleSource/Benchmarks/LivermoreLoops/kernel21: 61.69% (0.0201 => 0.0325) SingleSource/Benchmarks/LivermoreLoops/kernel22: 60.40% (0.0202 => 0.0324, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel23: 62.87% (0.0202 => 0.0329, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel24: 62.00% (0.0200 => 0.0324) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/LivermoreLoops/kernel01: 556400.00% (0.0001 => 0.5565, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel02: 68500.00% (0.0001 => 0.0686, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel03: 363600.00% (0.0001 => 0.3637, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel04: 257200.00% (0.0001 => 0.2573, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel05: 541700.00% (0.0001 => 0.5418, std.dev.: 0.0038) SingleSource/Benchmarks/LivermoreLoops/kernel06: 1023500.00% (0.0001 => 1.0236, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel07: 1455000.00% (0.0001 => 1.4551, std.dev.: 0.0004) SingleSource/Benchmarks/LivermoreLoops/kernel08: 1045100.00% (0.0001 => 1.0452, std.dev.: 0.0004) SingleSource/Benchmarks/LivermoreLoops/kernel09: 145900.00% (0.0001 => 0.1460, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel10: 326200.00% (0.0001 => 0.3263, std.dev.: 0.0006) SingleSource/Benchmarks/LivermoreLoops/kernel11: 358700.00% (0.0001 => 0.3588) SingleSource/Benchmarks/LivermoreLoops/kernel12: 353700.00% (0.0001 => 0.3538, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel13: 224000.00% (0.0001 => 0.2241, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel14: 3395700.00% (0.0001 => 3.3958, std.dev.: 0.0027) SingleSource/Benchmarks/LivermoreLoops/kernel15: 2828200.00% (0.0001 => 2.8283, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel16: 131200.00% (0.0001 => 0.1313) SingleSource/Benchmarks/LivermoreLoops/kernel17: 157100.00% (0.0001 => 0.1572, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel18: 3711500.00% (0.0001 => 3.7116, std.dev.: 0.0005) SingleSource/Benchmarks/LivermoreLoops/kernel19: 177700.00% (0.0001 => 0.1778, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel20: 4623700.00% (0.0001 => 4.6238, std.dev.: 0.0003) SingleSource/Benchmarks/LivermoreLoops/kernel21: 3596200.00% (0.0001 => 3.5963, std.dev.: 0.0005) SingleSource/Benchmarks/LivermoreLoops/kernel22: 312100.00% (0.0001 => 0.3122, std.dev.: 0.0002) SingleSource/Benchmarks/LivermoreLoops/kernel23: 851100.00% (0.0001 => 0.8512, std.dev.: 0.0006) SingleSource/Benchmarks/LivermoreLoops/kernel24: 321100.00% (0.0001 => 0.3212) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.13% (54.1959 => 54.8059, std.dev.: 0.0439) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.52% (0.0625 => 0.0872, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.42% (0.1063 => 0.1397, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.73% (0.2969 => 0.3733, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.86% (0.1106 => 0.1381, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.79% (0.4139 => 0.5165, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.65% (0.4253 => 0.5259, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.22% (0.5900 => 0.7270, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.21% (0.1620 => 0.1996, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 23.20% (1.5932 => 1.9628, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.05% (0.4994 => 0.6145, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.97% (0.0714 => 0.0878, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.95% (0.0584 => 0.0718, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.30% (0.0547 => 0.0669, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.20% (0.5000 => 0.6110, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.74% (0.1021 => 0.1243, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.52% (0.0897 => 0.1090, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 21.37% (0.0599 => 0.0727, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.14% (0.1107 => 0.1341, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 20.57% (0.0948 => 0.1143, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.40% (0.0642 => 0.0773, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 20.38% (0.1619 => 0.1949, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.21% (0.0584 => 0.0702, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.13% (0.1103 => 0.1325, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.78% (0.0541 => 0.0648, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.74% (0.1003 => 0.1201, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 19.73% (0.0821 => 0.0983, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.71% (0.0822 => 0.0984, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.63% (0.3903 => 0.4669, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.56% (0.1549 => 0.1852, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.45% (0.1604 => 0.1916, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 19.37% (0.0604 => 0.0721, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 19.22% (0.0947 => 0.1129, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.54% (0.1462 => 0.1733, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.23% (0.3890 => 0.4599, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.02% (0.1160 => 0.1369, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 17.98% (0.1218 => 0.1437, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.97% (0.2014 => 0.2376, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 17.87% (0.5826 => 0.6867, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 17.62% (0.0698 => 0.0821, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 17.54% (0.5889 => 0.6922, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 17.45% (0.4029 => 0.4732, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.43% (0.2736 => 0.3213, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.43% (0.1968 => 0.2311, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.37% (0.1088 => 0.1277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.34% (1.3152 => 1.5433, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/09-vor/vor: 17.34% (0.1505 => 0.1766, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.06% (0.2866 => 0.3355, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 16.99% (0.5546 => 0.6488, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.83% (3.5627 => 4.1622, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 16.77% (1.8794 => 2.1945, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.56% (0.2875 => 0.3351, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 16.51% (0.1284 => 0.1496, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.40% (1.6211 => 1.8869, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.32% (0.4658 => 0.5418, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.20% (0.3271 => 0.3801, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.10% (0.5026 => 0.5835, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.03% (0.2738 => 0.3177, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/objinst: 15.94% (0.2823 => 0.3273, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 15.90% (0.1421 => 0.1647, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 15.83% (0.2780 => 0.3220, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 15.80% (0.9697 => 1.1229, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 15.75% (0.2750 => 0.3183, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 15.70% (0.7171 => 0.8297, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.64% (2.7292 => 3.1561, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 15.62% (0.9909 => 1.1457, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/except: 15.62% (0.2811 => 0.3250, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 15.60% (0.2725 => 0.3150, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.59% (0.3195 => 0.3693, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 15.55% (0.2803 => 0.3239, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 15.55% (0.2714 => 0.3136, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.54% (0.2792 => 0.3226, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.54% (0.2729 => 0.3153, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 15.51% (0.3004 => 0.3470, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.50% (0.3930 => 0.4539, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 15.46% (0.2813 => 0.3248, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 15.45% (1.0781 => 1.2447, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.43% (0.4361 => 0.5034, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.32% (0.2911 => 0.3357, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 15.30% (4.2109 => 4.8550, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.29% (2.0673 => 2.3833, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.15% (4.4195 => 5.0892, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wc: 15.12% (0.3096 => 0.3564, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 14.91% (23.5202 => 27.0262, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.90% (1.9694 => 2.2628, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary3: 14.88% (0.3267 => 0.3753, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 14.83% (0.3317 => 0.3809, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 14.70% (0.3258 => 0.3737, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.59% (0.1090 => 0.1249, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.57% (1.9966 => 2.2876, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: 14.55% (0.3678 => 0.4213, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 14.49% (0.3348 => 0.3833, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 14.42% (0.3446 => 0.3943, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 14.40% (0.3465 => 0.3964, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 14.30% (0.3496 => 0.3996, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 14.30% (0.3469 => 0.3965, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.29% (0.3442 => 0.3934, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.28% (0.3460 => 0.3954, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.25% (0.3488 => 0.3985, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.25% (0.3060 => 0.3496, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.25% (0.3362 => 0.3841, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 14.12% (0.3477 => 0.3968, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.08% (0.3124 => 0.3564, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.08% (0.3282 => 0.3744, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 14.07% (0.2566 => 0.2927, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/property: 14.03% (0.3650 => 0.4162, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 14.01% (0.3726 => 0.4248, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.94% (0.3643 => 0.4151, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 13.82% (1.4269 => 1.6241, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/football/football: 13.78% (0.2075 => 0.2361, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.77% (0.3625 => 0.4124, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 13.69% (0.3724 => 0.4234, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 13.63% (0.4146 => 0.4711, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.60% (0.3845 => 0.4368, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 13.52% (0.7875 => 0.8940, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 13.50% (0.4251 => 0.4825, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.49% (0.3981 => 0.4518, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.31% (0.3690 => 0.4181, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 12.96% (2.1653 => 2.4459, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 12.63% (0.5012 => 0.5645, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 12.50% (2.1013 => 2.3640, std.dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 12.33% (4.6177 => 5.1870, std.dev.: 0.0061) MultiSource/Applications/SPASS/SPASS: 12.19% (5.5417 => 6.2172, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.99% (0.2068 => 0.2316, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.86% (0.2040 => 0.2282, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 11.82% (0.2691 => 0.3009, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.64% (0.6435 => 0.7184, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.19% (0.1028 => 0.1143, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.06% (0.3498 => 0.3885, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 10.88% (0.6634 => 0.7356, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.85% (0.2737 => 0.3034, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.57% (0.3084 => 0.3410, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.55% (0.3336 => 0.3688, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 10.44% (0.4847 => 0.5353, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.41% (0.1383 => 0.1527, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.75% (0.2103 => 0.2308, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 9.42% (2.0346 => 2.2262, std.dev.: 0.0047) MultiSource/Applications/lemon/lemon: 9.20% (0.2391 => 0.2611, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.77% (4.6926 => 5.1043, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.52% (11.6398 => 12.6316, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.41% (0.5361 => 0.5812, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.97% (0.7426 => 0.8018, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.95% (0.5584 => 0.6028, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 6.59% (11.9555 => 12.7433, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.01% (0.3792 => 0.3982, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 8.71% (0.2802 => 0.3046, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6111, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 6.13% (0.2122 => 0.2252, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6720, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-2: 4.82% (1.8057 => 1.8927, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1686, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.63% (0.3693 => 0.3864, std.dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6444, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1939, std.dev.: 0.0499) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.72% (2.0820 => 2.1179, std.dev.: 0.0048) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.69% (3.1722 => 3.2257, std.dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3055, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2854, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.25% (1.0927 => 1.1064, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5121, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5875, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.10% (2.4764 => 2.4491, std.dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.94% (25.4195 => 16.5369, std.dev.: 0.0194) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9754, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7962, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9576, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: -6.66% (0.2402 => 0.2242, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.7995, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7727, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.70% (17.2379 => 16.7727, std.dev.: 0.0458) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8690, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5784, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4955, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.23% (105.3826 => 104.0896, std.dev.: 0.1069) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0434, std.dev.: 0.0049) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 18 07:58:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 09:58:47 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121118155847.0A4B72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6009?compare_to=6005&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6009, Order: 168286, Start Time: 2012-11-18 13:38:53, End Time: 2012-11-18 15:59:08 To: 6005, Order: 168283, Start Time: 2012-11-18 10:26:10, End Time: 2012-11-18 12:46:18 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 48 (17 on baseline) Performance Regressions: 97 (220 on baseline) Performance Improvements: 35 (39 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 908 (628 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/LivermoreLoops/kernel01: 479.90% (0.0194 => 0.1125, std.dev.: 0.0006) SingleSource/Benchmarks/LivermoreLoops/kernel02: 504.64% (0.0194 => 0.1173, std.dev.: 0.0006) SingleSource/Benchmarks/LivermoreLoops/kernel03: 467.69% (0.0195 => 0.1107, std.dev.: 0.0015) SingleSource/Benchmarks/LivermoreLoops/kernel04: 485.57% (0.0194 => 0.1136, std.dev.: 0.0056) SingleSource/Benchmarks/LivermoreLoops/kernel05: 479.27% (0.0193 => 0.1118, std.dev.: 0.0030) SingleSource/Benchmarks/LivermoreLoops/kernel06: 468.39% (0.0193 => 0.1097, std.dev.: 0.0032) SingleSource/Benchmarks/LivermoreLoops/kernel07: 491.24% (0.0194 => 0.1147, std.dev.: 0.0009) SingleSource/Benchmarks/LivermoreLoops/kernel08: 585.43% (0.0199 => 0.1364, std.dev.: 0.0009) SingleSource/Benchmarks/LivermoreLoops/kernel09: 497.42% (0.0194 => 0.1159, std.dev.: 0.0032) SingleSource/Benchmarks/LivermoreLoops/kernel10: 475.38% (0.0195 => 0.1122, std.dev.: 0.0055) SingleSource/Benchmarks/LivermoreLoops/kernel11: 446.63% (0.0193 => 0.1055, std.dev.: 0.0034) SingleSource/Benchmarks/LivermoreLoops/kernel12: 455.21% (0.0192 => 0.1066, std.dev.: 0.0036) SingleSource/Benchmarks/LivermoreLoops/kernel13: 492.86% (0.0196 => 0.1162, std.dev.: 0.0042) SingleSource/Benchmarks/LivermoreLoops/kernel14: 488.38% (0.0198 => 0.1165, std.dev.: 0.0059) SingleSource/Benchmarks/LivermoreLoops/kernel15: 488.12% (0.0202 => 0.1188, std.dev.: 0.0058) SingleSource/Benchmarks/LivermoreLoops/kernel16: 470.85% (0.0199 => 0.1136, std.dev.: 0.0035) SingleSource/Benchmarks/LivermoreLoops/kernel17: 415.23% (0.0197 => 0.1015, std.dev.: 0.0031) SingleSource/Benchmarks/LivermoreLoops/kernel18: 639.11% (0.0202 => 0.1493, std.dev.: 0.0043) SingleSource/Benchmarks/LivermoreLoops/kernel19: 436.08% (0.0194 => 0.1040, std.dev.: 0.0003) SingleSource/Benchmarks/LivermoreLoops/kernel20: 432.65% (0.0196 => 0.1044) SingleSource/Benchmarks/LivermoreLoops/kernel21: 467.35% (0.0196 => 0.1112, std.dev.: 0.0101) SingleSource/Benchmarks/LivermoreLoops/kernel22: 422.56% (0.0195 => 0.1019, std.dev.: 0.0085) SingleSource/Benchmarks/LivermoreLoops/kernel23: 469.90% (0.0196 => 0.1117, std.dev.: 0.0049) SingleSource/Benchmarks/LivermoreLoops/kernel24: 419.07% (0.0194 => 0.1007, std.dev.: 0.0056) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/LivermoreLoops/kernel01: 193700.00% (0.0001 => 0.1938, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel02: 25500.00% (0.0001 => 0.0256) SingleSource/Benchmarks/LivermoreLoops/kernel03: 116600.00% (0.0001 => 0.1167, std.dev.: 0.0002) SingleSource/Benchmarks/LivermoreLoops/kernel04: 77100.00% (0.0001 => 0.0772, std.dev.: 0.0002) SingleSource/Benchmarks/LivermoreLoops/kernel05: 415600.00% (0.0001 => 0.4157, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel06: 303100.00% (0.0001 => 0.3032, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel07: 580300.00% (0.0001 => 0.5804, std.dev.: 0.0002) SingleSource/Benchmarks/LivermoreLoops/kernel08: 252600.00% (0.0001 => 0.2527, std.dev.: 0.0002) SingleSource/Benchmarks/LivermoreLoops/kernel09: 70900.00% (0.0001 => 0.0710, std.dev.: 0.0003) SingleSource/Benchmarks/LivermoreLoops/kernel10: 66900.00% (0.0001 => 0.0670, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel11: 114200.00% (0.0001 => 0.1143, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel12: 97200.00% (0.0001 => 0.0973, std.dev.: 0.0004) SingleSource/Benchmarks/LivermoreLoops/kernel13: 99500.00% (0.0001 => 0.0996, std.dev.: 0.0011) SingleSource/Benchmarks/LivermoreLoops/kernel14: 1561900.00% (0.0001 => 1.5620, std.dev.: 0.0061) SingleSource/Benchmarks/LivermoreLoops/kernel15: 1589000.00% (0.0001 => 1.5891, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel16: 48700.00% (0.0001 => 0.0488, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel17: 55400.00% (0.0001 => 0.0555) SingleSource/Benchmarks/LivermoreLoops/kernel18: 1186800.00% (0.0001 => 1.1869, std.dev.: 0.0002) SingleSource/Benchmarks/LivermoreLoops/kernel19: 86000.00% (0.0001 => 0.0861) SingleSource/Benchmarks/LivermoreLoops/kernel20: 2269700.00% (0.0001 => 2.2698, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel21: 920700.00% (0.0001 => 0.9208, std.dev.: 0.0006) SingleSource/Benchmarks/LivermoreLoops/kernel22: 230100.00% (0.0001 => 0.2302, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel23: 416000.00% (0.0001 => 0.4161, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel24: 136100.00% (0.0001 => 0.1362) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/messages-2: 16.41% (0.0774 => 0.0901, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 15.84% (0.6887 => 0.7978, std.dev.: 0.0237) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.54% (0.6338 => 0.7323, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.42% (0.1647 => 0.1901, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 15.36% (0.1165 => 0.1344, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 15.19% (0.5939 => 0.6841, std.dev.: 0.0166) MultiSource/Applications/SIBsim4/SIBsim4: 14.42% (1.5397 => 1.7617, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.19% (0.1050 => 0.1199, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 14.14% (4.6863 => 5.3489, std.dev.: 0.0533) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 14.12% (0.0779 => 0.0889, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.02% (0.4550 => 0.5188, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 13.95% (0.7219 => 0.8226, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 13.95% (0.5922 => 0.6748, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.54% (0.6240 => 0.7085, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.52% (0.3773 => 0.4283, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 13.32% (0.6735 => 0.7632, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.27% (0.5115 => 0.5794, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wc: 13.04% (0.3314 => 0.3746, std.dev.: 0.0038) MultiSource/Applications/aha/aha: 12.81% (0.1327 => 0.1497, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 12.79% (0.6183 => 0.6974, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 12.70% (0.6622 => 0.7463, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/football/football: 12.69% (0.9883 => 1.1137, std.dev.: 0.0066) MultiSource/Applications/treecc/treecc: 12.66% (2.2891 => 2.5789, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 12.45% (0.5813 => 0.6537, std.dev.: 0.0071) MultiSource/Applications/hexxagon/hexxagon: 12.34% (1.3861 => 1.5572, std.dev.: 0.0221) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.26% (0.9000 => 1.0103, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/fibo: 11.96% (0.2961 => 0.3315, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.91% (0.4006 => 0.4483, std.dev.: 0.0081) MultiSource/Applications/oggenc/oggenc: 11.70% (6.5878 => 7.3583, std.dev.: 0.0351) MultiSource/Benchmarks/Prolangs-C++/office/office: 11.63% (0.3372 => 0.3764, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/except: 11.55% (0.3194 => 0.3563, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.52% (0.2664 => 0.2971, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.27% (0.3160 => 0.3516, std.dev.: 0.0098) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.24% (4.8715 => 5.4189, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 11.18% (0.8521 => 0.9474, std.dev.: 0.0079) MultiSource/Benchmarks/sim/sim: 11.12% (0.3724 => 0.4138, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.04% (0.3224 => 0.3580, std.dev.: 0.0086) MultiSource/Applications/hbd/hbd: 10.28% (1.7327 => 1.9108, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/mst/mst: 10.21% (0.1352 => 0.1490, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.07% (0.3167 => 0.3486, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 9.70% (0.1464 => 0.1606, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.65% (0.1171 => 0.1284, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/for-in: 9.52% (0.4180 => 0.4578, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.52% (0.1901 => 0.2082, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.40% (1.5907 => 1.7402, std.dev.: 0.0232) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.35% (0.2397 => 0.2621, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.28% (0.6663 => 0.7281, std.dev.: 0.0161) MultiSource/Benchmarks/Olden/tsp/tsp: 9.17% (0.1417 => 0.1547, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.08% (0.1916 => 0.2090, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.88% (0.4022 => 0.4379, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/power/power: 8.72% (0.1456 => 0.1583, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.57% (0.1283 => 0.1393, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.46% (1.7456 => 1.8933, std.dev.: 0.0389) MultiSource/Applications/sgefa/sgefa: 8.40% (0.3537 => 0.3834, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.15% (0.3915 => 0.4234, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/parameter-passing: 8.13% (0.4479 => 0.4843, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/property: 8.09% (0.4425 => 0.4783, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.50% (4.7229 => 5.0770, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.47% (0.6717 => 0.7219, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.32% (0.6819 => 0.7318, std.dev.: 0.0060) SingleSource/UnitTests/Vector/constpool: 7.23% (53.5236 => 57.3933, std.dev.: 0.1639) SingleSource/UnitTests/ObjC/synchronized: 7.02% (0.4046 => 0.4330, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.84% (0.7528 => 0.8043, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.25% (0.4175 => 0.4436, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 5.73% (0.6718 => 0.7103, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.66% (0.3709 => 0.3919, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.39% (0.9589 => 1.0106, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.85% (0.7875 => 0.8257, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.91% (0.6589 => 0.6715, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.61% (12.2942 => 12.4923, std.dev.: 0.0310) MultiSource/Applications/JM/lencod/lencod: 1.24% (32.4399 => 32.8425, std.dev.: 0.0257) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench: 24.29% (2.1306 => 2.6482, std.dev.: 0.0979) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 23.15% (3.8306 => 4.7172, std.dev.: 0.0483) MultiSource/Applications/minisat/minisat: 23.09% (10.1299 => 12.4687, std.dev.: 0.2201) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 18.69% (0.0840 => 0.0997, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bisort/bisort: 16.20% (0.8673 => 1.0078, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/tsp/tsp: 15.32% (1.1031 => 1.2721, std.dev.: 0.0141) MultiSource/Benchmarks/Olden/mst/mst: 13.44% (0.1317 => 0.1494, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.03% (15.7471 => 17.7983, std.dev.: 0.4356) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 12.84% (8.6626 => 9.7745, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout/heapsort: 10.60% (3.9266 => 4.3428, std.dev.: 0.1040) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.32% (1.7384 => 1.9004, std.dev.: 0.0465) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 9.27% (9.5215 => 10.4037, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.20% (6.0290 => 6.5836, std.dev.: 0.0400) SingleSource/Benchmarks/Misc/ffbench: 7.51% (0.9939 => 1.0685, std.dev.: 0.0090) MultiSource/Applications/lua/lua: 4.21% (26.9178 => 28.0521, std.dev.: 0.0275) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.92% (1.5835 => 1.6456, std.dev.: 0.0210) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.75% (6.1993 => 6.3700, std.dev.: 0.0471) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.57% (48.9580 => 50.2144, std.dev.: 0.1961) MultiSource/Benchmarks/NPB-serial/is/is: 2.41% (8.6994 => 8.9089, std.dev.: 0.0799) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.24% (2.8217 => 2.8849, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.13% (7.2759 => 7.4307, std.dev.: 0.0058) MultiSource/Applications/SIBsim4/SIBsim4: 2.09% (3.8598 => 3.9403, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.66% (5.6751 => 5.7692, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.40% (3.6032 => 3.6535, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.16% (1.3364 => 1.3519, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.15% (6.1132 => 6.1835, std.dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/lambda-0_1_3/lambda: -13.55% (0.9872 => 0.8534, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -13.22% (0.7125 => 0.6183, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: -11.30% (0.2523 => 0.2238, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/09-vor/vor: -11.24% (0.4030 => 0.3577, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -11.15% (0.4375 => 0.3887, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -10.03% (0.2872 => 0.2584, std.dev.: 0.0100) MultiSource/Benchmarks/SciMark2-C/scimark2: -9.84% (0.3965 => 0.3575, std.dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/ks/ks: -9.60% (0.1896 => 0.1714, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -9.51% (1.6367 => 1.4811, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bh/bh: -9.27% (0.3688 => 0.3346, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -8.86% (0.6956 => 0.6340, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -8.68% (0.5253 => 0.4797, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -8.63% (0.5518 => 0.5042, std.dev.: 0.0157) MultiSource/Benchmarks/MallocBench/gs/gs: -8.39% (5.2466 => 4.8066, std.dev.: 0.1265) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.18% (0.7808 => 0.7169, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -7.84% (2.5144 => 2.3173, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/neural/neural: -7.41% (0.1740 => 0.1611, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -7.21% (0.9800 => 0.9093, std.dev.: 0.0218) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.74% (1.3114 => 1.2230, std.dev.: 0.0266) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.85% (0.1778 => 0.1674, std.dev.: 0.0037) MultiSource/Benchmarks/PAQ8p/paq8p: -4.50% (11.8780 => 11.3437, std.dev.: 0.0727) MultiSource/Applications/lua/lua: -4.24% (4.6869 => 4.4881, std.dev.: 0.0197) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -3.05% (1.5587 => 1.5111, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.32% (38.6989 => 38.1873, std.dev.: 0.1278) MultiSource/Applications/sqlite3/sqlite3: -1.18% (20.2309 => 19.9914, std.dev.: 0.0856) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: -47.30% (0.1985 => 0.1046, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -27.48% (0.4723 => 0.3425, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: -26.35% (0.1617 => 0.1191, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: -22.69% (1.7099 => 1.3220, std.dev.: 0.0971) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -12.37% (0.4679 => 0.4100, std.dev.: 0.0190) MultiSource/Applications/lemon/lemon: -7.87% (1.5603 => 1.4375, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.49% (0.2338 => 0.2233, std.dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: -1.67% (7.7600 => 7.6301, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.37% (5.0449 => 4.9756, std.dev.: 0.0228) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.26% (4.2916 => 4.2375, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 2.02% (0.1338 => 0.1365, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.46% (0.0418 => 0.0491, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.45% (0.0652 => 0.0681, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 0.00% (494.2585 => 494.2662, std.dev.: 0.0259) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.88% (4.3882 => 0.0491, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/power/power: 43729.58% (1.1277 => 494.2662, std.dev.: 0.0259) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 236.91% (0.5229 => 1.7617, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 22.84% (14.9895 => 18.4125, std.dev.: 0.0227) MultiSource/Applications/kimwitu++/kc: 50.74% (14.1553 => 21.3374, std.dev.: 0.0420) MultiSource/Benchmarks/MallocBench/gs/gs: 16.93% (4.1105 => 4.8066, std.dev.: 0.1265) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.78% (1.1048 => 1.5111, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 433.48% (7.1582 => 38.1873, std.dev.: 0.1278) SingleSource/Benchmarks/Misc-C++-EH/spirit: 105.16% (3.4629 => 7.1046, std.dev.: 0.0144) SingleSource/Benchmarks/Misc-C++/stepanov_container: 85.50% (0.6222 => 1.1542, std.dev.: 0.0198) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10497.36% (0.0720 => 7.6301, std.dev.: 0.0117) MultiSource/Applications/SIBsim4/SIBsim4: 3940200.00% (0.0001 => 3.9403, std.dev.: 0.0061) MultiSource/Applications/SPASS/SPASS: 13589600.00% (0.0001 => 13.5897, std.dev.: 0.2394) MultiSource/Applications/kimwitu++/kc: 53500.00% (0.0001 => 0.0536, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63800.00% (0.0001 => 0.0639, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576800.00% (0.0001 => 0.5769, std.dev.: 0.0260) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10072800.00% (0.0001 => 10.0729, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6141100.00% (0.0001 => 6.1412, std.dev.: 0.2267) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1785.59% (1.1194 => 21.1073, std.dev.: 0.1535) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 82.03% (2.9384 => 5.3489, std.dev.: 0.0533) MultiSource/Applications/ClamAV/clamscan: 68.81% (22.1758 => 37.4349, std.dev.: 0.3161) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 59.11% (7.0540 => 11.2238, std.dev.: 0.1275) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 53.54% (8.1363 => 12.4923, std.dev.: 0.0310) MultiSource/Benchmarks/FreeBench/distray/distray: 53.13% (0.1056 => 0.1617, std.dev.: 0.0059) MultiSource/Applications/JM/lencod/lencod: 49.71% (21.9371 => 32.8425, std.dev.: 0.0257) SingleSource/Benchmarks/CoyoteBench/almabench: 49.32% (0.0730 => 0.1090, std.dev.: 0.0005) SingleSource/UnitTests/vla: 45.92% (0.0355 => 0.0518, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 38.62% (0.1432 => 0.1985, std.dev.: 0.0090) SingleSource/Benchmarks/Stanford/Oscar: 38.36% (0.0636 => 0.0880, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/messages-2: 36.10% (0.0662 => 0.0901, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/n-body: 34.99% (0.0746 => 0.1007, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 34.63% (0.1236 => 0.1664, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones/fhourstones: 32.95% (0.1566 => 0.2082, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/voronoi/voronoi: 32.59% (0.2700 => 0.3580, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 32.29% (0.0672 => 0.0889, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 32.03% (1.5859 => 2.0939, std.dev.: 0.0282) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 31.94% (0.1584 => 0.2090, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: 31.66% (0.1175 => 0.1547, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Towers: 31.63% (0.0471 => 0.0620, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 31.06% (0.0528 => 0.0692, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 30.83% (0.0626 => 0.0819, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 30.06% (0.1151 => 0.1497, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/exptree: 29.73% (0.0814 => 0.1056, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 29.58% (2.2024 => 2.8538, std.dev.: 0.0251) SingleSource/Benchmarks/Shootout-C++/wordfreq: 29.51% (0.3307 => 0.4283, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/em3d/em3d: 29.09% (0.1695 => 0.2188, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/life/life: 28.51% (0.0933 => 0.1199, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/mst/mst: 28.12% (0.1163 => 0.1490, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/treeadd/treeadd: 27.88% (0.0416 => 0.0532, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 27.87% (0.0567 => 0.0725, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Queens: 27.78% (0.0414 => 0.0529, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 27.77% (5.7591 => 7.3583, std.dev.: 0.0351) SingleSource/Benchmarks/Stanford/Treesort: 27.74% (0.0411 => 0.0525, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 27.41% (0.0394 => 0.0502, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 27.21% (2.0273 => 2.5789, std.dev.: 0.0164) MultiSource/Applications/Burg/burg: 27.11% (1.1642 => 1.4798, std.dev.: 0.0172) MultiSource/Benchmarks/MallocBench/espresso/espresso: 27.07% (4.2646 => 5.4189, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 26.92% (0.2065 => 0.2621, std.dev.: 0.0046) SingleSource/Benchmarks/Stanford/RealMM: 26.77% (0.0396 => 0.0502, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/health/health: 26.66% (0.1268 => 0.1606, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 26.46% (0.4615 => 0.5836, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 26.44% (0.4103 => 0.5188, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/loader/loader: 26.40% (0.2758 => 0.3486, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 26.23% (0.0770 => 0.0972, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 26.22% (0.6456 => 0.8149, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/bisort/bisort: 26.22% (0.0614 => 0.0775, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 25.81% (0.0403 => 0.0507, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 25.80% (0.1655 => 0.2082, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.74% (0.0408 => 0.0513, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 25.24% (0.8067 => 1.0103, std.dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C++/family/family: 25.19% (0.0397 => 0.0497, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 24.98% (0.4636 => 0.5794, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: 24.84% (0.8921 => 1.1137, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 24.71% (0.1117 => 0.1393, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/misr: 24.64% (0.0633 => 0.0789, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 24.53% (0.7115 => 0.8860, std.dev.: 0.0209) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 24.52% (0.0730 => 0.0909, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 24.25% (0.5860 => 0.7281, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/hash: 24.15% (0.4289 => 0.5325, std.dev.: 0.0210) SingleSource/Benchmarks/Shootout-C++/except: 24.10% (0.2871 => 0.3563, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 23.94% (0.3162 => 0.3919, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (0.1032 => 0.1279, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/for-in: 23.93% (0.3694 => 0.4578, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.67% (0.8172 => 1.0106, std.dev.: 0.0183) SingleSource/UnitTests/ObjC/instance-method-metadata: 23.60% (0.3543 => 0.4379, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 23.57% (0.0437 => 0.0540, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 23.33% (0.3927 => 0.4843, std.dev.: 0.0080) MultiSource/Applications/sgefa/sgefa: 23.32% (0.3109 => 0.3834, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/property: 23.08% (0.3886 => 0.4783, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 23.05% (0.3441 => 0.4234, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 22.82% (1.5415 => 1.8933, std.dev.: 0.0389) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 22.82% (0.3650 => 0.4483, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/wc: 22.74% (0.3052 => 0.3746, std.dev.: 0.0038) MultiSource/Applications/hbd/hbd: 22.46% (1.5603 => 1.9108, std.dev.: 0.0104) MultiSource/Benchmarks/McCat/08-main/main: 22.36% (0.2554 => 0.3125, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 22.35% (0.5981 => 0.7318, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.26% (0.2430 => 0.2971, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 22.17% (0.3387 => 0.4138, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/fibo: 21.65% (0.2725 => 0.3315, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/sumcol: 21.62% (0.2891 => 0.3516, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.60% (14.3668 => 17.4696, std.dev.: 0.0258) SingleSource/UnitTests/ObjC/synchronized: 21.60% (0.3561 => 0.4330, std.dev.: 0.0069) MultiSource/Benchmarks/VersaBench/bmm/bmm: 21.48% (0.0759 => 0.0922, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 21.30% (2.2969 => 2.7861, std.dev.: 0.1094) MultiSource/Applications/hexxagon/hexxagon: 21.26% (1.2842 => 1.5572, std.dev.: 0.0221) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 20.65% (0.1114 => 0.1344, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 20.12% (0.1337 => 0.1606, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.05% (0.0793 => 0.0952, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 20.03% (0.3136 => 0.3764, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/moments: 19.81% (0.4048 => 0.4850, std.dev.: 0.0243) MultiSource/Benchmarks/Ptrdist/bc/bc: 19.74% (1.1861 => 1.4202, std.dev.: 0.0402) SingleSource/Benchmarks/Shootout-C++/hash2: 19.55% (0.4620 => 0.5523, std.dev.: 0.0099) SingleSource/UnitTests/ObjC/exceptions: 19.28% (0.3828 => 0.4566, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/oourafft: 19.26% (0.3282 => 0.3914, std.dev.: 0.0077) SingleSource/Benchmarks/Stanford/Puzzle: 19.24% (0.1268 => 0.1512, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/trivial-interface: 19.23% (0.3473 => 0.4141, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.00% (0.9765 => 1.1620, std.dev.: 0.0256) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.67% (0.1125 => 0.1335, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 18.59% (0.0640 => 0.0759, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 18.02% (0.0838 => 0.0989, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.92% (0.0798 => 0.0941, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.70% (0.0842 => 0.0991, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 17.44% (9.4845 => 11.1382, std.dev.: 0.2982) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.22% (0.0871 => 0.1021, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 16.98% (0.1625 => 0.1901, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.49% (4.9449 => 5.7604, std.dev.: 0.1114) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 16.45% (3.8922 => 4.5323, std.dev.: 0.0842) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.44% (0.0675 => 0.0786, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 16.36% (17.1811 => 19.9914, std.dev.: 0.0856) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.33% (0.2793 => 0.3249, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/ffbench: 16.31% (0.0705 => 0.0820, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.19% (0.1044 => 0.1213, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.15% (2.0665 => 2.4002, std.dev.: 0.0754) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.94% (0.3826 => 0.4436, std.dev.: 0.0092) MultiSource/Applications/lua/lua: 15.90% (3.8723 => 4.4881, std.dev.: 0.0197) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.90% (0.0648 => 0.0751, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.80% (0.0886 => 0.1026, std.dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 15.50% (0.1555 => 0.1796, std.dev.: 0.0069) SingleSource/UnitTests/ObjC++/Hello: 15.48% (0.5925 => 0.6842, std.dev.: 0.0194) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.36% (0.1940 => 0.2238, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.31% (5.0018 => 5.7676, std.dev.: 0.0963) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.23% (0.0834 => 0.0961, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.94% (0.0770 => 0.0885, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 14.88% (0.0719 => 0.0826, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 14.81% (0.7433 => 0.8534, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.57% (0.2107 => 0.2414, std.dev.: 0.0098) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.55% (0.3121 => 0.3575, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/objinst: 14.40% (0.3131 => 0.3582, std.dev.: 0.0061) MultiSource/Applications/spiff/spiff: 14.32% (0.7835 => 0.8957, std.dev.: 0.0395) MultiSource/Benchmarks/Bullet/bullet: 14.18% (63.2438 => 72.2142, std.dev.: 0.1878) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.09% (0.1029 => 0.1174, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.94% (0.1062 => 0.1210, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.84% (0.5569 => 0.6340, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.81% (0.5105 => 0.5810, std.dev.: 0.0227) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.78% (0.2271 => 0.2584, std.dev.: 0.0100) SingleSource/UnitTests/ObjC/exceptions-2: 13.61% (0.3497 => 0.3973, std.dev.: 0.0177) MultiSource/Benchmarks/McCat/18-imp/imp: 13.56% (0.3423 => 0.3887, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.53% (0.6675 => 0.7578, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.51% (0.1510 => 0.1714, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.51% (0.3516 => 0.3991, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.49% (1.3050 => 1.4811, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/exceptions-4: 13.46% (0.3543 => 0.4020, std.dev.: 0.0184) MultiSource/Applications/d/make_dparser: 13.36% (3.3354 => 3.7810, std.dev.: 0.0710) SingleSource/UnitTests/ObjC++/property-reference-object: 12.85% (0.6030 => 0.6805, std.dev.: 0.0257) MultiSource/Benchmarks/McCat/09-vor/vor: 12.48% (0.3180 => 0.3577, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.25% (0.8101 => 0.9093, std.dev.: 0.0218) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.17% (0.5020 => 0.5631, std.dev.: 0.0132) MultiSource/Applications/lemon/lemon: 12.16% (1.0722 => 1.2026, std.dev.: 0.0194) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.86% (0.1695 => 0.1896, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.72% (0.3865 => 0.4318, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.65% (0.1906 => 0.2128, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 11.58% (0.4299 => 0.4797, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.15% (0.6450 => 0.7169, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.73% (0.1892 => 0.2095, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/sieve: 10.63% (0.3603 => 0.3986, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 10.12% (0.1463 => 0.1611, std.dev.: 0.0014) SingleSource/UnitTests/SignlessTypes/rem: 10.05% (0.1144 => 0.1259, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 9.93% (0.1440 => 0.1583, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: 9.42% (10.3673 => 11.3437, std.dev.: 0.0727) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.23% (0.4064 => 0.4439, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 9.14% (0.3379 => 0.3688, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/methcall: 8.86% (0.2877 => 0.3132, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 8.79% (0.3232 => 0.3516, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.67% (0.2756 => 0.2995, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.67% (0.2872 => 0.3121, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 8.21% (0.3092 => 0.3346, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: 5.96% (54.1659 => 57.3933, std.dev.: 0.1639) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.23% (2.2022 => 2.3173, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.42% (4.3953 => 11.0068, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/methcall: 147.75% (5.3999 => 13.3780, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 36.78% (9.1159 => 12.4687, std.dev.: 0.2201) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.44% (13.4384 => 17.7983, std.dev.: 0.4356) SingleSource/Benchmarks/CoyoteBench/fftbench: 30.07% (2.0360 => 2.6482, std.dev.: 0.0979) SingleSource/Benchmarks/Shootout/ary3: 27.97% (3.6994 => 4.7340, std.dev.: 0.1867) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 26.15% (1.3045 => 1.6456, std.dev.: 0.0210) MultiSource/Benchmarks/Olden/bisort/bisort: 20.94% (0.8333 => 1.0078, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/moments: 20.79% (0.1159 => 0.1400, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/health/health: 19.96% (0.4445 => 0.5332, std.dev.: 0.0337) MultiSource/Benchmarks/Olden/tsp/tsp: 17.95% (1.0785 => 1.2721, std.dev.: 0.0141) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.63% (1.1145 => 1.3110, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/oourafft: 17.48% (6.6465 => 7.8084, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.32% (0.2944 => 0.3454, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/mst/mst: 16.26% (0.1285 => 0.1494, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.39% (0.0864 => 0.0997, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.75% (10.3460 => 11.6646, std.dev.: 0.5038) SingleSource/Benchmarks/Shootout/heapsort: 12.72% (3.8526 => 4.3428, std.dev.: 0.1040) SingleSource/Benchmarks/Misc/ffbench: 12.41% (0.9505 => 1.0685, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.77% (2.8904 => 3.2307, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 10.44% (1.1396 => 1.2586, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.51% (1.7254 => 1.8894, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 7.90% (3.1578 => 3.4074, std.dev.: 0.0685) MultiSource/Applications/lua/lua: 7.51% (26.0924 => 28.0521, std.dev.: 0.0275) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 5.78% (1.2373 => 1.3088, std.dev.: 0.0220) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.57% (4.2280 => 4.4634, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.19% (0.3256 => 0.3425, std.dev.: 0.0024) SingleSource/Regression/C/uint64_to_float: 5.04% (0.5413 => 0.5686, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.29% (11.6436 => 12.1433, std.dev.: 0.0025) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.32% (0.4162 => 0.4300, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.98% (2.1424 => 2.2063, std.dev.: 0.0234) MultiSource/Applications/sgefa/sgefa: 2.91% (0.6223 => 0.6404, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/dry: 2.62% (2.4116 => 2.4749, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/lists: 2.39% (12.5348 => 12.8340, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.29% (1.7133 => 1.7526, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.29% (3.6395 => 3.7227, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/heapsort: 2.23% (3.8532 => 3.9392, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.16% (1.3677 => 1.3972, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 2.14% (85.0658 => 86.8899, std.dev.: 0.0186) MultiSource/Applications/aha/aha: 2.11% (3.1595 => 3.2263, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.47% (6.5088 => 6.6047, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 1.41% (27.8444 => 28.2368, std.dev.: 0.0326) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.27% (1.0313 => 1.0444, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.24% (5.2139 => 5.2786, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0499, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.15% (1.9577 => 1.9803, std.dev.: 0.0081) MultiSource/Applications/spiff/spiff: 1.10% (2.9346 => 2.9669, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1674, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.82% (5.2763 => 1.2230, std.dev.: 0.0266) SingleSource/Benchmarks/Misc/salsa20: -74.60% (0.8651 => 0.2197, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -36.81% (0.1622 => 0.1025, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.19% (5.3526 => 4.7002, std.dev.: 0.0943) MultiSource/Applications/JM/ldecod/ldecod: -9.94% (10.4361 => 9.3984, std.dev.: 0.1243) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.73% (5.3855 => 5.0770, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.93% (0.3987 => 0.2395, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.72% (0.0506 => 0.0305, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.34% (4.5009 => 2.7752, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.52% (1.1492 => 0.7640, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -29.10% (10.7105 => 7.5940, std.dev.: 0.5445) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.19% (2.6546 => 2.0125, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/mason/mason: -19.39% (0.2161 => 0.1742, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.63% (1.6925 => 1.4280, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.69% (2.6778 => 2.2844, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.77% (32.5116 => 29.0093, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: -10.63% (1.5373 => 1.3739, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.56% (1.5660 => 1.4319, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -6.85% (9.5636 => 8.9089, std.dev.: 0.0799) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.43% (1.6805 => 1.5724, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.59% (2.7294 => 2.5767, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.86% (3.2416 => 3.0842, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.81% (0.2497 => 0.2377, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -4.65% (1.5835 => 1.5098, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -4.33% (6.2999 => 6.0268, std.dev.: 0.0065) MultiSource/Benchmarks/sim/sim: -2.99% (5.0483 => 4.8975, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.97% (0.9957 => 0.9661, std.dev.: 0.0075) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.33% (0.4808 => 0.4696, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.89% (8.1563 => 8.0024, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6773, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.49% (10.2830 => 10.1299, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.08% (0.1485 => 0.1365, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.82% (0.2116 => 0.0681, std.dev.: 0.0010) Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 18 12:29:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 14:29:45 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121118202945.937272A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6010?compare_to=6006&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6010, Order: 168288, Start Time: 2012-11-18 18:56:13, End Time: 2012-11-18 20:30:07 To: 6006, Order: 168286, Start Time: 2012-11-18 12:51:40, End Time: 2012-11-18 14:21:30 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 8 (64 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1046 (889 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.62% (0.6058 => 0.6459, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.58% (0.5034 => 0.5214, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.94% (1.3530 => 1.3792, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.04% (1.2730 => 1.2862, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel09: 24.23% (0.0784 => 0.0974, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/em3d/em3d: 3.78% (4.1750 => 4.3329, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.71% (58.1825 => 60.3401, std.dev.: 0.7655) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.20% (13.0253 => 13.4423, std.dev.: 0.1578) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.66% (1.0655 => 1.0832, std.dev.: 0.0123) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 56.43% (0.0140 => 0.0219, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.62% (0.0411 => 0.0430, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 34.27% (0.0248 => 0.0333, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.27% (0.0309 => 0.0316, std.dev.: 0.0085) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 3.34% (0.0419 => 0.0433, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0204 => 0.0205, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/test1: 10.50% (0.0200 => 0.0221, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 0.27% (0.1477 => 0.1481, std.dev.: 0.0305) MultiSource/Applications/lemon/lemon: 3.30% (1.1344 => 1.1718, std.dev.: 0.4276) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.97% (0.4226 => 0.4267, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.47% (0.1425 => 0.1404, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.56% (0.0640 => 0.0650, std.dev.: 0.0168) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 10.31% (0.0194 => 0.0214, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.86% (0.0555 => 0.0643, std.dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.38% (1.1955 => 1.1909, std.dev.: 0.0253) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 283.33% (0.0006 => 0.0023, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.42% (0.0609 => 0.0642, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 12.82% (0.0195 => 0.0220, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.01% (0.7798 => 0.7799, std.dev.: 0.0033) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 163.64% (0.0044 => 0.0116, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.22% (16.4461 => 17.6338, std.dev.: 0.4801) MultiSource/Applications/sqlite3/sqlite3: 2328.84% (0.6332 => 15.3794, std.dev.: 0.9941) MultiSource/Benchmarks/McCat/08-main/main: 47.84% (0.1831 => 0.2707, std.dev.: 0.0206) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.32% (0.1559 => 0.1476, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7062.73% (0.3123 => 22.3692, std.dev.: 0.5596) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.89% (0.2463 => 0.3741, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1558.10% (0.3344 => 5.5447, std.dev.: 0.1942) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.54% (0.2364 => 0.3275, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/bigfib: 5.17% (0.6010 => 0.6321, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/mandel: 3.50% (0.0429 => 0.0444, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.67% (0.3266 => 0.3484, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/strcat: 5.43% (0.1969 => 0.2076, std.dev.: 0.0391) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0224 => 0.0224, std.dev.: 0.0027) SingleSource/UnitTests/byval-alignment: -31.30% (0.0230 => 0.0158, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0436, std.dev.: 0.0090) MultiSource/Applications/oggenc/oggenc: 11.83% (0.1462 => 0.1635, std.dev.: 0.0225) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4595, std.dev.: 0.0535) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0688, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4945, std.dev.: 0.0099) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5108, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5872, std.dev.: 0.1366) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3311, std.dev.: 0.0339) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1493, std.dev.: 0.0266) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3626, std.dev.: 0.0260) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4029, std.dev.: 0.0310) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0843, std.dev.: 0.0020) SingleSource/Regression/C/uint64_to_float: -23.94% (2.1832 => 1.6605, std.dev.: 0.0048) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 11.51% (0.1112 => 0.1240, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.49% (0.1425 => 0.1546, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.57% (0.4847 => 0.5214, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.47% (0.6010 => 0.6459, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.35% (0.1905 => 0.2026, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.87% (0.3115 => 0.3298, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.40% (0.1983 => 0.2090, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.28% (0.5961 => 0.6276, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.86% (1.3279 => 1.3792, std.dev.: 0.0065) MultiSource/Applications/minisat/minisat: 3.86% (0.6834 => 0.7098, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.52% (1.4479 => 1.4988, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.50% (0.6287 => 0.6507, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.26% (0.3717 => 0.3838, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.06% (0.8697 => 0.8963, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 3.06% (4.1305 => 4.2568, std.dev.: 0.0257) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.88% (0.9069 => 0.9330, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.84% (0.8069 => 0.8298, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.67% (0.9074 => 0.9316, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.66% (0.8805 => 0.9039, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.59% (8.6476 => 8.8715, std.dev.: 0.0235) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.56% (0.8518 => 0.8736, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.53% (0.8331 => 0.8542, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.52% (0.8050 => 0.8253, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.50% (0.8007 => 0.8207, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.47% (0.8338 => 0.8544, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.44% (0.8927 => 0.9145, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: 2.44% (2.3764 => 2.4344, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.42% (0.8359 => 0.8561, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.37% (0.9039 => 0.9253, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.37% (0.8286 => 0.8482, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.33% (0.8086 => 0.8274, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.30% (0.8317 => 0.8508, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.20% (4.4880 => 4.5869, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.13% (0.7966 => 0.8136, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.13% (0.8420 => 0.8599, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.11% (0.8855 => 0.9042, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.06% (1.2602 => 1.2862, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.04% (0.8048 => 0.8212, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 136.68% (0.0199 => 0.0471, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/pi: 59.33% (1.5795 => 2.5166, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.39% (2.9753 => 3.4631, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.93% (0.7597 => 0.8807, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.70% (2.7995 => 3.2111, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.45% (5.0261 => 5.6017, std.dev.: 0.0433) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.15% (1.1857 => 1.2823, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.66% (4.7794 => 5.0979, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: 6.23% (1.3037 => 1.3849, std.dev.: 0.0113) MultiSource/Applications/SIBsim4/SIBsim4: 5.91% (3.1873 => 3.3758, std.dev.: 0.0562) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.87% (4.9686 => 5.2605, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.87% (4.5327 => 4.7989, std.dev.: 0.0047) MultiSource/Applications/lambda-0_1_3/lambda: 5.49% (7.4933 => 7.9048, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.68% (3.3761 => 3.5340, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.66% (6.2275 => 6.5174, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.08% (4.9453 => 5.1471, std.dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 3.91% (14.0064 => 14.5547, std.dev.: 0.1793) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.79% (0.3587 => 0.3723, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.94% (4.8362 => 4.9784, std.dev.: 0.0458) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.79% (11.5690 => 11.8915, std.dev.: 0.0219) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.62% (4.3552 => 4.4694, std.dev.: 0.0323) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.58% (8.2783 => 8.4919, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout/lists: 2.30% (7.3375 => 7.5060, std.dev.: 0.0272) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.04% (1.1365 => 1.1597, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.11% (3.5679 => 3.6075, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/bh/bh: 1.02% (2.3560 => 2.3800, std.dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.70% (5.4641 => 4.3329, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.46% (7.2130 => 6.1701, std.dev.: 0.0641) SingleSource/Benchmarks/McGill/chomp: -11.04% (1.1216 => 0.9978, std.dev.: 0.0480) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.47% (1.0512 => 0.9411, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: -8.51% (63.1822 => 57.8075, std.dev.: 0.2274) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.21% (14.6451 => 13.4423, std.dev.: 0.1578) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.88% (4.7482 => 4.4217, std.dev.: 0.0204) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.36% (0.3269 => 0.3061, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.95% (3.7148 => 3.4937, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.84% (5.4972 => 5.1760, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.07% (5.1557 => 4.8944, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.35% (4.7449 => 4.5386, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.64% (6.0224 => 5.8034, std.dev.: 0.0249) MultiSource/Applications/lua/lua: -3.32% (29.8330 => 28.8417, std.dev.: 0.3056) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (28.5821 => 27.7028, std.dev.: 0.1538) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.98% (0.5807 => 0.5634, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.74% (2.6356 => 2.5634, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.99% (11.5316 => 11.3026, std.dev.: 0.0124) MultiSource/Applications/aha/aha: -1.99% (3.3398 => 3.2735, std.dev.: 0.0254) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.50% (4.9994 => 4.9244, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.21% (5.6343 => 5.5659, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 5.55% (1.0262 => 1.0832, std.dev.: 0.0123) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.39% (0.0408 => 0.0430, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0085) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 12.76% (0.0384 => 0.0433, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/test1: 22.78% (0.0180 => 0.0221, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 2.99% (0.1438 => 0.1481, std.dev.: 0.0305) MultiSource/Applications/lemon/lemon: 3.43% (1.1329 => 1.1718, std.dev.: 0.4276) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.47% (0.4164 => 0.4267, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.56% (0.1369 => 0.1404, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.40% (0.0641 => 0.0650, std.dev.: 0.0168) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 9.74% (0.0195 => 0.0214, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 11.25% (0.0578 => 0.0643, std.dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.13% (1.1437 => 1.1909, std.dev.: 0.0253) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 64.29% (0.0014 => 0.0023, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.39% (0.0627 => 0.0642, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.22% (0.0180 => 0.0220, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.72% (0.8017 => 0.7799, std.dev.: 0.0033) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 87.10% (0.0062 => 0.0116, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 18 12:32:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 14:32:30 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121118203230.651B22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6011?compare_to=6007&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6011, Order: 168288, Start Time: 2012-11-18 18:59:08, End Time: 2012-11-18 20:32:51 To: 6007, Order: 168286, Start Time: 2012-11-18 12:59:30, End Time: 2012-11-18 14:32:55 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (178 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (859 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 12.64% (0.3908 => 0.4402, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 14.81% (0.3834 => 0.4402, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.66% (2.0478 => 2.1022, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/salsa20: 2.36% (7.4937 => 7.6703, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/hash2: 2.15% (3.1932 => 3.2617, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.09% (0.3821 => 0.3512, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.80% (2.4924 => 2.3230, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.64% (0.3357 => 0.3134, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.56% (0.3142 => 0.2936, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.48% (0.9542 => 0.8924, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: -6.30% (0.2160 => 0.2024, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.18% (0.2428 => 0.2278, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.12% (0.1796 => 0.1686, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.07% (0.9852 => 0.9254, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.05% (9.2283 => 8.6702, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.94% (0.2355 => 0.2215, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -5.93% (16.1920 => 15.2317, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.92% (0.7198 => 0.6772, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -5.85% (0.1879 => 0.1769, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: -5.85% (0.9179 => 0.8642, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.78% (0.6484 => 0.6109, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.74% (1.3722 => 1.2934, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -5.73% (7.0961 => 6.6897, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.69% (3.5339 => 3.3328, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.61% (1.0544 => 0.9952, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.58% (0.6681 => 0.6308, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.54% (4.8161 => 4.5491, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.50% (4.8802 => 4.6117, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.49% (0.6736 => 0.6366, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.49% (0.5591 => 0.5284, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.49% (0.6230 => 0.5888, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.47% (4.0323 => 3.8117, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.47% (0.3658 => 0.3458, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.47% (6.7716 => 6.4015, std.dev.: 0.0044) MultiSource/Benchmarks/sim/sim: -5.46% (0.3406 => 0.3220, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.46% (1.6364 => 1.5471, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.46% (1.2300 => 1.1629, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.45% (0.2695 => 0.2548, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -5.44% (1.1450 => 1.0827, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.44% (0.6052 => 0.5723, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: -5.43% (0.4515 => 0.4270, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.41% (0.5859 => 0.5542, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.39% (0.5805 => 0.5492, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.38% (0.6660 => 0.6302, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.37% (1.4642 => 1.3855, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.37% (0.5478 => 0.5184, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.36% (0.6676 => 0.6318, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.36% (0.5863 => 0.5549, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.35% (0.6260 => 0.5925, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.34% (0.5857 => 0.5544, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -5.34% (1.1530 => 1.0914, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.34% (4.5069 => 4.2664, std.dev.: 0.0080) MultiSource/Applications/SIBsim4/SIBsim4: -5.29% (1.3864 => 1.3130, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.29% (1.2784 => 1.2108, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -5.28% (4.3330 => 4.1041, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.27% (0.5581 => 0.5287, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.26% (0.5802 => 0.5497, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.25% (0.6667 => 0.6317, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.24% (0.5456 => 0.5170, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.24% (0.5575 => 0.5283, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.23% (0.6293 => 0.5964, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.22% (0.6395 => 0.6061, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.22% (0.7339 => 0.6956, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.22% (0.5941 => 0.5631, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.22% (0.5925 => 0.5616, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -5.20% (17.1032 => 16.2136, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.19% (0.6395 => 0.6063, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.16% (0.7919 => 0.7510, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.14% (0.7524 => 0.7137, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -5.14% (0.3581 => 0.3397, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.13% (0.5688 => 0.5396, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.12% (1.2221 => 1.1595, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.12% (0.5705 => 0.5413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.11% (0.5849 => 0.5550, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.11% (14.2083 => 13.4821, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.06% (0.6440 => 0.6114, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.06% (0.2985 => 0.2834, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.06% (0.6033 => 0.5728, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.05% (0.2278 => 0.2163, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.03% (1.2210 => 1.1596, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.99% (8.0126 => 7.6128, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.98% (0.6446 => 0.6125, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.97% (0.5569 => 0.5292, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.97% (0.3483 => 0.3310, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.95% (0.5999 => 0.5702, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: -4.95% (1.2515 => 1.1896, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.92% (0.5567 => 0.5293, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.92% (0.5570 => 0.5296, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.90% (0.2999 => 0.2852, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.88% (0.4916 => 0.4676, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.87% (0.2548 => 0.2424, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -4.82% (3.5154 => 3.3459, std.dev.: 0.0034) MultiSource/Applications/minisat/minisat: -4.82% (0.7447 => 0.7088, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.82% (1.6474 => 1.5680, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -4.81% (0.2659 => 0.2531, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.77% (0.3812 => 0.3630, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.74% (0.8521 => 0.8117, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.70% (0.5168 => 0.4925, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.65% (0.2385 => 0.2274, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.64% (0.3319 => 0.3165, std.dev.: 0.0013) MultiSource/Applications/lua/lua: -4.63% (4.0594 => 3.8716, std.dev.: 0.0139) SingleSource/UnitTests/ObjC/exceptions-4: -4.61% (0.3880 => 0.3701, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.61% (0.3884 => 0.3705, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.60% (0.6194 => 0.5909, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.60% (0.4176 => 0.3984, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -4.59% (15.2527 => 14.5524, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.59% (0.7021 => 0.6699, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -4.57% (15.5079 => 14.7987, std.dev.: 0.0124) SingleSource/UnitTests/ObjC/synchronized: -4.54% (0.3896 => 0.3719, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.52% (0.3848 => 0.3674, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.52% (0.3831 => 0.3658, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -4.50% (1.3148 => 1.2556, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.49% (0.6304 => 0.6021, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.47% (0.3891 => 0.3717, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.46% (0.4033 => 0.3853, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.45% (22.4056 => 21.4077, std.dev.: 0.0155) SingleSource/UnitTests/ObjC/property: -4.45% (0.4199 => 0.4012, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.45% (0.5329 => 0.5092, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.44% (0.6189 => 0.5914, std.dev.: 0.0069) MultiSource/Applications/siod/siod: -4.40% (2.4021 => 2.2965, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.38% (0.4151 => 0.3969, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: -4.33% (0.3255 => 0.3114, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.30% (0.6297 => 0.6026, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -4.30% (2.1401 => 2.0480, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -4.30% (0.7982 => 0.7639, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.24% (0.3323 => 0.3182, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -4.23% (5.0226 => 4.8103, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/moments: -4.21% (0.4248 => 0.4069, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.21% (0.3016 => 0.2889, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.20% (0.3837 => 0.3676, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -4.18% (0.4861 => 0.4658, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -4.16% (0.3026 => 0.2900, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.15% (0.3252 => 0.3117, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: -4.13% (0.3025 => 0.2900, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.12% (0.3931 => 0.3769, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.11% (0.4280 => 0.4104, std.dev.: 0.0031) MultiSource/Applications/spiff/spiff: -4.11% (0.8418 => 0.8072, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.10% (0.3849 => 0.3691, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.10% (2.2587 => 2.1660, std.dev.: 0.0173) MultiSource/Benchmarks/Bullet/bullet: -4.09% (34.0927 => 32.6989, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/strcat: -4.08% (0.2989 => 0.2867, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.07% (0.9557 => 0.9168, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -4.05% (0.3059 => 0.2935, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.05% (2.1713 => 2.0834, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: -4.04% (0.3194 => 0.3065, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -4.04% (0.3394 => 0.3257, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -4.03% (0.3446 => 0.3307, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.02% (0.9077 => 0.8712, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: -4.00% (18.2933 => 17.5610, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.91% (0.4321 => 0.4152, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.89% (0.3057 => 0.2938, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.89% (0.2933 => 0.2819, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -3.88% (0.3867 => 0.3717, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -3.87% (0.2871 => 0.2760, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -3.81% (0.3621 => 0.3483, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -3.78% (0.2939 => 0.2828, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -3.76% (0.3481 => 0.3350, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.76% (0.4813 => 0.4632, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.75% (0.2903 => 0.2794, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -3.72% (0.2849 => 0.2743, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.62% (0.4083 => 0.3935, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.59% (0.4427 => 0.4268, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/wc: -3.59% (0.3205 => 0.3090, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.55% (0.3491 => 0.3367, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -3.51% (0.4524 => 0.4365, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: -3.48% (0.3788 => 0.3656, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -3.45% (0.6750 => 0.6517, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -3.45% (0.6347 => 0.6128, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -3.35% (0.6441 => 0.6225, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -3.22% (1.5610 => 1.5107, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: -3.16% (0.7779 => 0.7533, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.16% (5.4682 => 5.2956, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -2.21% (20.7746 => 20.3151, std.dev.: 0.0321) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.49% (7.5137 => 5.7487, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1723, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.94% (2.2633 => 2.1741, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.18% (1.3096 => 1.2811, std.dev.: 0.0071) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.46% (6.5735 => 6.4775, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 18 13:47:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 15:47:19 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121118214719.6E5742A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6012?compare_to=6009&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6012, Order: 168288, Start Time: 2012-11-18 19:27:40, End Time: 2012-11-18 21:47:40 To: 6009, Order: 168286, Start Time: 2012-11-18 13:38:53, End Time: 2012-11-18 15:59:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 38 (181 on baseline) Performance Improvements: 22 (39 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1028 (667 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 12.82% (0.3696 => 0.4170, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 12.82% (0.6258 => 0.7060, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.78% (0.6297 => 0.7102, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.67% (0.5936 => 0.6688, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 12.56% (0.6448 => 0.7258, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 12.52% (0.7203 => 0.8105, std.dev.: 0.0136) SingleSource/Benchmarks/LivermoreLoops/kernel21: 12.50% (0.1112 => 0.1251, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 11.65% (0.3125 => 0.3489, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.58% (0.5810 => 0.6483, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.46% (0.5810 => 0.6476, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/random: 11.36% (0.3047 => 0.3393, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.31% (0.5941 => 0.6613, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.29% (0.5631 => 0.6267, std.dev.: 0.0187) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.44% (0.1274 => 0.1407, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 10.43% (0.4064 => 0.4488, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/ReedSolomon: 10.06% (0.2227 => 0.2451, std.dev.: 0.0065) SingleSource/Benchmarks/LivermoreLoops/kernel22: 10.01% (0.1019 => 0.1121, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 9.49% (0.8957 => 0.9807, std.dev.: 0.0118) SingleSource/Benchmarks/LivermoreLoops/kernel23: 9.31% (0.1117 => 0.1221, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 8.28% (0.4020 => 0.4353, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/04-bisect/bisect: 8.26% (0.1210 => 0.1310, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.19% (0.7091 => 0.7672, std.dev.: 0.0097) MultiSource/Applications/d/make_dparser: 7.90% (3.7810 => 4.0797, std.dev.: 0.0899) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.62% (0.5042 => 0.5275, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.60% (0.3249 => 0.3366, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 2.86% (0.4234 => 0.4355, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 53.49% (5.6892 => 8.7322, std.dev.: 0.1820) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 30.25% (0.3425 => 0.4461, std.dev.: 0.0226) SingleSource/Benchmarks/Misc-C++/stepanov_container: 20.37% (6.1412 => 7.3919, std.dev.: 0.1310) MultiSource/Benchmarks/VersaBench/dbms/dbms: 14.58% (1.6990 => 1.9467, std.dev.: 0.0587) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 12.00% (2.7532 => 3.0836, std.dev.: 0.0931) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 11.83% (5.3878 => 6.0250, std.dev.: 0.1863) SingleSource/Benchmarks/Shootout-C++/hash2: 3.73% (3.4074 => 3.5345, std.dev.: 0.0381) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.89% (6.3700 => 6.5541, std.dev.: 0.0324) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.34% (1.6456 => 1.6841, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 2.00% (4.6660 => 4.7594, std.dev.: 0.0206) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.96% (2.3072 => 2.3524, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.09% (0.9661 => 0.9766, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -14.41% (0.9474 => 0.8109, std.dev.: 0.0352) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -14.11% (0.8043 => 0.6908, std.dev.: 0.0425) MultiSource/Benchmarks/Prolangs-C++/life/life: -12.51% (0.1199 => 0.1049, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/garage/garage: -12.26% (0.0889 => 0.0780, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/wc: -11.61% (0.3746 => 0.3311, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/sumcol: -10.49% (0.3516 => 0.3147, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: -7.64% (0.3834 => 0.3541, std.dev.: 0.0113) MultiSource/Applications/siod/siod: -6.92% (2.7861 => 2.5933, std.dev.: 0.0542) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.35% (4.5323 => 4.3806, std.dev.: 0.0451) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.92% (2.0939 => 2.0538, std.dev.: 0.0138) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -9.31% (10.4037 => 9.4348, std.dev.: 0.3439) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -8.49% (0.5820 => 0.5326, std.dev.: 0.0180) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -7.97% (5.6770 => 5.2245, std.dev.: 0.0897) MultiSource/Applications/lua/lua: -4.01% (28.0521 => 26.9268, std.dev.: 0.4363) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.70% (50.2144 => 48.3560, std.dev.: 0.2889) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.52% (19.6973 => 19.0033, std.dev.: 0.1113) MultiSource/Benchmarks/Olden/em3d/em3d: -2.40% (3.1894 => 3.1127, std.dev.: 0.0216) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -2.30% (6.1835 => 6.0412, std.dev.: 0.0251) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.06% (3.0842 => 3.0207, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.76% (7.4307 => 7.2996, std.dev.: 0.0415) MultiSource/Applications/sgefa/sgefa: -1.56% (0.6404 => 0.6304, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.18% (3.5151 => 3.4735, std.dev.: 0.0130) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -1.98% (0.1365 => 0.1338, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -14.46% (0.0491 => 0.0420, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.47% (0.0681 => 0.0671, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -0.03% (494.2662 => 494.1255, std.dev.: 0.1803) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/power/power: 43717.11% (1.1277 => 494.1255, std.dev.: 0.1803) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.70% (0.5229 => 1.5410, std.dev.: 0.1043) MultiSource/Applications/SPASS/SPASS: 22.67% (14.9895 => 18.3883, std.dev.: 0.0310) MultiSource/Applications/kimwitu++/kc: 52.21% (14.1553 => 21.5460, std.dev.: 0.0544) MultiSource/Benchmarks/MallocBench/gs/gs: 16.41% (4.1105 => 4.7849, std.dev.: 0.0920) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.78% (1.1048 => 1.5112, std.dev.: 0.0050) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 432.23% (7.1582 => 38.0980, std.dev.: 0.4924) SingleSource/Benchmarks/Misc-C++-EH/spirit: 98.87% (3.4629 => 6.8865, std.dev.: 0.0997) SingleSource/Benchmarks/Misc-C++/stepanov_container: 86.85% (0.6222 => 1.1626, std.dev.: 0.0190) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10474.72% (0.0720 => 7.6138, std.dev.: 0.3463) MultiSource/Applications/SIBsim4/SIBsim4: 3897700.00% (0.0001 => 3.8978, std.dev.: 0.0293) MultiSource/Applications/SPASS/SPASS: 13499500.00% (0.0001 => 13.4996, std.dev.: 1.4717) MultiSource/Applications/kimwitu++/kc: 53600.00% (0.0001 => 0.0537, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 63800.00% (0.0001 => 0.0639, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 598000.00% (0.0001 => 0.5981, std.dev.: 0.0131) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10094000.00% (0.0001 => 10.0941, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7391800.00% (0.0001 => 7.3919, std.dev.: 0.1310) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1764.53% (1.1194 => 20.8715, std.dev.: 0.1540) MultiSource/Applications/ClamAV/clamscan: 68.51% (22.1758 => 37.3692, std.dev.: 0.1817) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.00% (2.9384 => 4.6134, std.dev.: 0.3658) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.07% (7.0540 => 11.0094, std.dev.: 0.2114) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 51.00% (8.1363 => 12.2857, std.dev.: 0.1057) SingleSource/Benchmarks/CoyoteBench/almabench: 49.45% (0.0730 => 0.1091, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 47.93% (21.9371 => 32.4523, std.dev.: 0.2166) MultiSource/Benchmarks/FreeBench/distray/distray: 45.36% (0.1056 => 0.1535, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Oscar: 39.94% (0.0636 => 0.0890, std.dev.: 0.0027) SingleSource/UnitTests/vla: 39.15% (0.0355 => 0.0494, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 38.62% (0.1432 => 0.1985, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 36.61% (0.2554 => 0.3489, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/lists: 32.27% (0.0626 => 0.0828, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.12% (0.1236 => 0.1633, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 30.81% (0.1175 => 0.1537, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Towers: 30.36% (0.0471 => 0.0614, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.50% (1.5859 => 2.0538, std.dev.: 0.0138) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 29.26% (0.0793 => 0.1025, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Treesort: 29.20% (0.0411 => 0.0531, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 29.06% (0.0437 => 0.0564, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 28.88% (0.1655 => 0.2133, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/bisort/bisort: 28.34% (0.0614 => 0.0788, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/messages-2: 28.25% (0.0662 => 0.0849, std.dev.: 0.0024) SingleSource/Benchmarks/Stanford/RealMM: 28.03% (0.0396 => 0.0507, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.94% (0.0408 => 0.0522, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.99% (0.5105 => 0.6483, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 26.56% (0.3441 => 0.4355, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/matrix: 26.53% (0.0818 => 0.1035, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 26.25% (0.2758 => 0.3482, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 26.02% (0.4289 => 0.5405, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 26.00% (0.2065 => 0.2602, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 25.95% (0.1268 => 0.1597, std.dev.: 0.0019) SingleSource/Benchmarks/Stanford/Queens: 25.85% (0.0414 => 0.0521, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.73% (0.8172 => 1.0275, std.dev.: 0.0090) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.73% (0.0886 => 0.1114, std.dev.: 0.0027) MultiSource/Applications/spiff/spiff: 25.17% (0.7835 => 0.9807, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/functionobjects: 24.84% (0.5020 => 0.6267, std.dev.: 0.0187) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.80% (0.0746 => 0.0931, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 24.62% (0.1117 => 0.1392, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 24.51% (0.4048 => 0.5040, std.dev.: 0.0153) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.47% (0.0842 => 0.1048, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 24.42% (1.5415 => 1.9179, std.dev.: 0.0231) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 24.38% (0.0447 => 0.0556, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/misr: 24.17% (0.0633 => 0.0786, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: 23.78% (1.1642 => 1.4410, std.dev.: 0.0317) SingleSource/Benchmarks/McGill/exptree: 23.59% (0.0814 => 0.1006, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.35% (0.1062 => 0.1310, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 23.28% (0.8921 => 1.0998, std.dev.: 0.0113) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.10% (0.1143 => 0.1407, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 23.05% (0.2725 => 0.3353, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/exceptions-4: 22.86% (0.3543 => 0.4353, std.dev.: 0.0039) MultiSource/Benchmarks/BitBench/drop3/drop3: 22.82% (0.0482 => 0.0592, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.81% (0.1337 => 0.1642, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: 22.66% (0.0481 => 0.0590, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 22.62% (0.4620 => 0.5665, std.dev.: 0.0164) MultiSource/Benchmarks/MallocBench/espresso/espresso: 22.49% (4.2646 => 5.2237, std.dev.: 0.1016) MultiSource/Applications/d/make_dparser: 22.32% (3.3354 => 4.0797, std.dev.: 0.0899) SingleSource/Benchmarks/CoyoteBench/fftbench: 22.26% (0.4636 => 0.5668, std.dev.: 0.0119) SingleSource/Benchmarks/Stanford/Puzzle: 22.16% (0.1268 => 0.1549, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 22.15% (0.5981 => 0.7306, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.08% (0.0770 => 0.0940, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/exceptions-3: 21.93% (0.3516 => 0.4287, std.dev.: 0.0115) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.90% (0.1566 => 0.1909, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.85% (0.2430 => 0.2961, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 21.82% (0.3684 => 0.4488, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 21.68% (0.3427 => 0.4170, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/exceptions: 21.50% (0.3828 => 0.4651, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.44% (0.2700 => 0.3279, std.dev.: 0.0182) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.39% (14.3668 => 17.4393, std.dev.: 0.0319) SingleSource/Benchmarks/Shootout-C++/random: 21.09% (0.2802 => 0.3393, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 20.80% (0.0798 => 0.0964, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 20.61% (0.8067 => 0.9730, std.dev.: 0.0264) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.52% (0.1584 => 0.1909, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/nestedloop: 20.52% (0.2793 => 0.3366, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/ReedSolomon: 19.62% (0.2049 => 0.2451, std.dev.: 0.0065) SingleSource/UnitTests/ObjC/for-in: 19.60% (0.3694 => 0.4418, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/instance-method-metadata: 18.88% (0.3543 => 0.4212, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.62% (0.5860 => 0.6951, std.dev.: 0.0284) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.49% (0.1125 => 0.1333, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/oourafft: 18.22% (0.3282 => 0.3880, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 17.92% (0.8101 => 0.9553, std.dev.: 0.0255) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.87% (0.0834 => 0.0983, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 17.81% (0.0640 => 0.0754, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 17.79% (0.3131 => 0.3688, std.dev.: 0.0110) MultiSource/Benchmarks/sim/sim: 17.71% (0.3387 => 0.3987, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.71% (4.9449 => 5.8208, std.dev.: 0.1522) MultiSource/Applications/lua/lua: 17.66% (3.8723 => 4.5563, std.dev.: 0.1973) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.56% (1.4186 => 1.6677, std.dev.: 0.0450) MultiSource/Benchmarks/mafft/pairlocalalign: 17.37% (9.4845 => 11.1319, std.dev.: 0.3067) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.22% (0.0871 => 0.1021, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/exceptions-2: 17.04% (0.3497 => 0.4093, std.dev.: 0.0107) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 16.59% (0.0838 => 0.0977, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/em3d/em3d: 16.28% (0.1695 => 0.1971, std.dev.: 0.0104) MultiSource/Applications/viterbi/viterbi: 16.27% (0.1555 => 0.1808, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/mst/mst: 16.25% (0.1163 => 0.1352, std.dev.: 0.0062) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.16% (0.0953 => 0.1107, std.dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: 16.10% (17.1811 => 19.9476, std.dev.: 0.1688) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.90% (0.0648 => 0.0751, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: 15.60% (1.0722 => 1.2395, std.dev.: 0.0544) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.21% (0.1940 => 0.2235, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 15.14% (0.7115 => 0.8192, std.dev.: 0.0365) MultiSource/Benchmarks/McCat/05-eks/eks: 14.96% (0.4299 => 0.4942, std.dev.: 0.0140) MultiSource/Benchmarks/NPB-serial/is/is: 14.74% (0.0719 => 0.0825, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.63% (0.0704 => 0.0807, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.62% (0.2107 => 0.2415, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.48% (0.3121 => 0.3573, std.dev.: 0.0087) MultiSource/Benchmarks/Bullet/bullet: 14.26% (63.2438 => 72.2597, std.dev.: 0.1791) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.19% (5.0018 => 5.7114, std.dev.: 0.1476) MultiSource/Applications/sgefa/sgefa: 13.90% (0.3109 => 0.3541, std.dev.: 0.0113) SingleSource/UnitTests/ObjC/trivial-interface: 13.76% (0.3473 => 0.3951, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.75% (0.9765 => 1.1108, std.dev.: 0.0391) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.69% (0.2271 => 0.2582, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.64% (0.1510 => 0.1716, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.42% (0.3561 => 0.4039, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.39% (0.6675 => 0.7569, std.dev.: 0.0339) SingleSource/Benchmarks/Shootout-C++/matrix: 13.23% (0.3098 => 0.3508, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.93% (1.3050 => 1.4737, std.dev.: 0.0370) MultiSource/Applications/siod/siod: 12.90% (2.2969 => 2.5933, std.dev.: 0.0542) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.55% (3.8922 => 4.3806, std.dev.: 0.0451) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.67% (0.3865 => 0.4316, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.52% (0.0929 => 0.1036, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.33% (0.4203 => 0.4679, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.15% (1.1861 => 1.3184, std.dev.: 0.0452) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.99% (0.2603 => 0.2889, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 10.66% (0.3603 => 0.3987, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.64% (0.3422 => 0.3786, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: 10.60% (10.3673 => 11.4659, std.dev.: 0.1970) SingleSource/Benchmarks/Shootout-C++/strcat: 9.29% (0.2831 => 0.3094, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 9.12% (0.3379 => 0.3687, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 8.89% (0.3283 => 0.3575, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.86% (0.2891 => 0.3147, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary: 8.76% (0.3232 => 0.3515, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 8.59% (0.2877 => 0.3124, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 8.29% (0.2714 => 0.2939, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.12% (0.4879 => 0.5275, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.92% (0.3935 => 0.4168, std.dev.: 0.0072) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.10% (7.9617 => 8.1292, std.dev.: 0.0508) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.30% (4.3953 => 11.0016, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/methcall: 147.63% (5.3999 => 13.3719, std.dev.: 0.0032) MultiSource/Benchmarks/llubenchmark/llu: 131.13% (3.7781 => 8.7322, std.dev.: 0.1820) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 37.01% (0.3256 => 0.4461, std.dev.: 0.0226) SingleSource/Benchmarks/Shootout/ary3: 34.39% (3.6994 => 4.9715, std.dev.: 0.1077) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 29.10% (1.3045 => 1.6841, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 29.04% (1.5086 => 1.9467, std.dev.: 0.0587) SingleSource/Benchmarks/CoyoteBench/fftbench: 28.74% (2.0360 => 2.6212, std.dev.: 0.0771) SingleSource/Benchmarks/Shootout-C++/moments: 26.49% (0.1159 => 0.1466, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/bisort/bisort: 20.41% (0.8333 => 1.0034, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/oourafft: 17.72% (6.6465 => 7.8245, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.22% (0.2944 => 0.3451, std.dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.65% (1.1145 => 1.3001, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/tsp/tsp: 15.76% (1.0785 => 1.2485, std.dev.: 0.0245) SingleSource/Benchmarks/BenchmarkGame/puzzle: 12.90% (0.6962 => 0.7860, std.dev.: 0.0291) SingleSource/Benchmarks/Shootout-C++/hash2: 11.93% (3.1578 => 3.5345, std.dev.: 0.0381) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.65% (2.8904 => 3.2271, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 10.17% (1.1396 => 1.2555, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 10.06% (0.1421 => 0.1564) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.29% (1.7254 => 1.8857, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 8.05% (0.7455 => 0.8055, std.dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.96% (0.9540 => 1.0109, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 5.84% (1.2373 => 1.3095, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.51% (4.2280 => 4.4610, std.dev.: 0.0070) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.29% (11.6436 => 12.1426, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.89% (3.6395 => 3.7809, std.dev.: 0.0378) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.36% (0.4162 => 0.4302, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: 2.70% (2.4116 => 2.4768, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.68% (1.2838 => 1.3182, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.48% (4.6441 => 4.7594, std.dev.: 0.0206) SingleSource/Benchmarks/Shootout-C++/heapsort: 2.29% (3.8532 => 3.9414, std.dev.: 0.0182) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.16% (1.3677 => 1.3973, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 2.11% (85.0658 => 86.8598, std.dev.: 0.0251) MultiSource/Applications/aha/aha: 2.08% (3.1595 => 3.2251, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 1.95% (1.7133 => 1.7467, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists: 1.85% (12.5348 => 12.7672, std.dev.: 0.0384) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.68% (2.3135 => 2.3524, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.64% (6.5088 => 6.6158, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 1.43% (27.8444 => 28.2427, std.dev.: 0.0383) SingleSource/Benchmarks/Shootout/sieve: 1.24% (5.2139 => 5.2788, std.dev.: 0.0105) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0313 => 1.0441, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0497, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1675, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.75% (5.2763 => 1.2270, std.dev.: 0.0422) SingleSource/Benchmarks/Misc/salsa20: -75.71% (0.8651 => 0.2101, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/richards_benchmark: -44.82% (0.1622 => 0.0895, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.20% (5.3526 => 4.6997, std.dev.: 0.0745) MultiSource/Applications/JM/ldecod/ldecod: -10.06% (10.4361 => 9.3863, std.dev.: 0.3476) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.72% (5.3855 => 5.0776, std.dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.52% (0.0628 => 0.0361, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.11% (0.3987 => 0.2388, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.72% (0.0506 => 0.0305) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.29% (4.5009 => 2.7774, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: -33.49% (1.1492 => 0.7643, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -29.09% (10.7105 => 7.5946, std.dev.: 0.6495) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.10% (2.6546 => 2.0149, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -19.25% (0.2161 => 0.1745, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.69% (1.6925 => 1.4269, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.66% (2.6778 => 2.2852, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.78% (32.5116 => 29.0066, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel-2: -10.65% (1.5373 => 1.3736, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -9.99% (9.5636 => 8.6078, std.dev.: 0.1500) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4244, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.95% (4.8142 => 4.4795, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.2416 => 3.0207, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5759, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.74% (19.9488 => 19.0033, std.dev.: 0.1113) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.65% (0.2497 => 0.2381, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -4.53% (1.5835 => 1.5118, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -4.29% (6.2999 => 6.0297, std.dev.: 0.0031) MultiSource/Benchmarks/sim/sim: -3.09% (5.0483 => 4.8921, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.27% (0.4808 => 0.4699, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.92% (0.9957 => 0.9766, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (8.1563 => 8.0202, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: -1.49% (10.2830 => 10.1296, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.29% (0.2116 => 0.0671, std.dev.: 0.0005) Report Time: 2.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 18 14:19:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 16:19:01 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121118221901.9349D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6013?compare_to=6010&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6013, Order: 168292, Start Time: 2012-11-18 20:49:20, End Time: 2012-11-18 22:19:21 To: 6010, Order: 168288, Start Time: 2012-11-18 18:56:13, End Time: 2012-11-18 20:30:07 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 3 (115 on baseline) Performance Improvements: 9 (28 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1042 (831 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/bc/bc: 1.40% (1.1284 => 1.1442, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 6.87% (0.1587 => 0.1696, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 4.89% (19.3714 => 20.3194, std.dev.: 0.2615) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -10.79% (0.3523 => 0.3143, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.95% (0.9129 => 0.8860, std.dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.45% (0.5021 => 0.4898, std.dev.: 0.0043) MultiSource/Applications/spiff/spiff: -1.23% (0.8584 => 0.8478, std.dev.: 0.0035) MultiSource/Applications/ClamAV/clamscan: -1.06% (15.3498 => 15.1877, std.dev.: 0.0552) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel09: -20.53% (0.0974 => 0.0774, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -1.94% (46.8957 => 45.9870, std.dev.: 0.2765) MultiSource/Benchmarks/llubenchmark/llu: -1.33% (2.0169 => 1.9901, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/pi: -1.28% (2.5166 => 2.4844, std.dev.: 0.0125) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -2.05% (1.0832 => 1.0610, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.46% (0.0219 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.93% (0.0430 => 0.0426, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -19.22% (0.0333 => 0.0269, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -6.96% (0.0316 => 0.0294, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.08% (0.0433 => 0.0424, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/casts: -0.98% (0.0205 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -1.36% (0.0221 => 0.0218, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1481 => 0.1480, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -2.10% (1.1718 => 1.1472, std.dev.: 0.0155) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.27% (0.4267 => 0.4170, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.99% (0.1404 => 0.1432, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.23% (0.0650 => 0.0629, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.35% (0.0214 => 0.0194, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -15.40% (0.0643 => 0.0544, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.12% (1.1909 => 1.1923, std.dev.: 0.0218) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -95.65% (0.0023 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.99% (0.0642 => 0.0565, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -15.91% (0.0220 => 0.0185, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.03% (0.7799 => 0.7797, std.dev.: 0.0116) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: -67.24% (0.0116 => 0.0038, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 6.59% (16.4461 => 17.5293, std.dev.: 0.1448) MultiSource/Applications/sqlite3/sqlite3: 2306.49% (0.6332 => 15.2379, std.dev.: 0.0849) MultiSource/Benchmarks/McCat/08-main/main: 48.50% (0.1831 => 0.2719, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.31% (0.1559 => 0.1445, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7028.40% (0.3123 => 22.2620, std.dev.: 0.0135) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.45% (0.2463 => 0.3681, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1520.28% (0.3344 => 5.4182, std.dev.: 0.0726) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.89% (0.2364 => 0.3236, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/bigfib: 4.58% (0.6010 => 0.6285, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: 0.70% (0.0429 => 0.0432, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.21% (0.3266 => 0.3436, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 2.95% (0.1969 => 0.2027, std.dev.: 0.0018) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.46% (0.0224 => 0.0234, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0000) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0448, std.dev.: 0.0037) MultiSource/Applications/oggenc/oggenc: 5.54% (0.1462 => 0.1543, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4530, std.dev.: 0.0101) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0688, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4941, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5114, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5145, std.dev.: 0.0546) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3297, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1308, std.dev.: 0.0265) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3626, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4109, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0879, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: -24.15% (2.1832 => 1.6559, std.dev.: 0.0032) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0008) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.32% (0.0810 => 0.0926, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.89% (0.1425 => 0.1566, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 9.80% (0.1112 => 0.1221, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.2279 => 0.2451, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.39% (0.2180 => 0.2341, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.73% (0.4847 => 0.5173, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.66% (0.6010 => 0.6410, std.dev.: 0.0096) MultiSource/Applications/spiff/spiff: 6.64% (0.7950 => 0.8478, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.48% (0.8321 => 0.8860, std.dev.: 0.0099) MultiSource/Applications/Burg/burg: 6.23% (1.2222 => 1.2984, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.06% (0.7473 => 0.7926, std.dev.: 0.0093) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.95% (0.1983 => 0.2101, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 4.80% (0.2999 => 0.3143, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.78% (0.2240 => 0.2347, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.73% (0.8148 => 0.8533, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.69% (1.1606 => 1.2150, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.21% (0.5961 => 0.6212, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.13% (0.5817 => 0.6057, std.dev.: 0.0043) MultiSource/Applications/hbd/hbd: 4.08% (1.4269 => 1.4851, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.95% (1.1685 => 1.2147, std.dev.: 0.0101) MultiSource/Benchmarks/MallocBench/gs/gs: 3.81% (4.1305 => 4.2880, std.dev.: 0.0281) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.80% (0.4127 => 0.4284, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.47% (1.5315 => 1.5846, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.34% (4.1763 => 4.3156, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.30% (2.1401 => 2.2107, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.25% (0.8697 => 0.8980, std.dev.: 0.0034) MultiSource/Applications/lua/lua: 3.22% (3.8189 => 3.9418, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.21% (1.2526 => 1.2928, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.13% (0.6287 => 0.6484, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.95% (0.6586 => 0.6780, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 2.87% (0.6834 => 0.7030, std.dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 2.86% (1.2568 => 1.2928, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.84% (0.3657 => 0.3761, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 2.84% (14.7684 => 15.1877, std.dev.: 0.0552) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.81% (0.5191 => 0.5337, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.78% (6.6074 => 6.7910, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.76% (0.7932 => 0.8151, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.71% (0.8331 => 0.8557, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.70% (0.8086 => 0.8304, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.69% (8.6476 => 8.8803, std.dev.: 0.0256) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.69% (0.3717 => 0.3817, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.67% (0.8340 => 0.8563, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: 2.67% (0.8768 => 0.9002, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.65% (1.6386 => 1.6820, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.63% (0.6227 => 0.6391, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.59% (0.8457 => 0.8676, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.57% (0.8007 => 0.8213, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.55% (0.8050 => 0.8255, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.54% (0.8611 => 0.8830, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.53% (13.1811 => 13.5145, std.dev.: 0.0160) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.52% (4.4880 => 4.6013, std.dev.: 0.0146) MultiSource/Benchmarks/Bullet/bullet: 2.50% (31.8598 => 32.6566, std.dev.: 0.0232) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.48% (0.8716 => 0.8932, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.44% (1.1170 => 1.1442, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.40% (0.4783 => 0.4898, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.39% (0.9074 => 0.9291, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.36% (0.8261 => 0.8456, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.35% (1.1271 => 1.1536, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.33% (0.9069 => 0.9280, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.32% (0.9688 => 0.9913, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.29% (0.8420 => 0.8613, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.26% (0.8048 => 0.8230, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.26% (0.9908 => 1.0132, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.26% (4.4873 => 4.5886, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.24% (0.8204 => 0.8388, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.24% (1.4479 => 1.4803, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.22% (0.8855 => 0.9052, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 2.20% (2.3764 => 2.4287, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.18% (0.8927 => 0.9122, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.17% (0.8286 => 0.8466, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.16% (0.7966 => 0.8138, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.14% (0.8885 => 0.9075, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.09% (1.3279 => 1.3556, std.dev.: 0.0103) MultiSource/Benchmarks/mafft/pairlocalalign: 2.05% (8.6247 => 8.8019, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.88% (0.8069 => 0.8221, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.83% (4.5702 => 4.6538, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.79% (0.8316 => 0.8465, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.76% (1.2602 => 1.2824, std.dev.: 0.0027) MultiSource/Applications/lemon/lemon: 1.63% (1.0945 => 1.1123, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.56% (0.8518 => 0.8651, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 130.65% (0.0199 => 0.0459, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/pi: 57.29% (1.5795 => 2.4844, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 18.34% (0.7597 => 0.8990, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.36% (2.9753 => 3.4621, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.70% (2.7995 => 3.2111, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.45% (5.0261 => 5.6014, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.16% (1.1857 => 1.2824, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 6.97% (1.7056 => 1.8245, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.71% (4.7794 => 5.1003, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 5.89% (3.1873 => 3.3750, std.dev.: 0.0336) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.84% (4.9686 => 5.2589, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.78% (4.5327 => 4.7946, std.dev.: 0.0826) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.69% (2.2485 => 2.3540, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.65% (6.2275 => 6.5170, std.dev.: 0.0228) MultiSource/Applications/lambda-0_1_3/lambda: 4.60% (7.4933 => 7.8383, std.dev.: 0.0453) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.50% (3.3761 => 3.5281, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.07% (4.9453 => 5.1467, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.95% (4.9469 => 5.1421, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 3.90% (14.0064 => 14.5525, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.62% (0.3587 => 0.3717, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.20% (44.5605 => 45.9870, std.dev.: 0.2765) MultiSource/Applications/siod/siod: 2.90% (3.6643 => 3.7706, std.dev.: 0.0101) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.85% (1.2337 => 1.2689, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.83% (11.5690 => 11.8965, std.dev.: 0.0270) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.80% (8.2783 => 8.5105, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.74% (4.3552 => 4.4745, std.dev.: 0.0353) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.44% (4.8362 => 4.9541, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.30% (4.8660 => 4.9778, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 2.27% (7.3375 => 7.5038, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.77% (1.1365 => 1.1566, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: 1.44% (1.2061 => 1.2235, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 1.33% (1.0841 => 1.0985, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.22% (1.5941 => 1.6136, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.10% (2.9096 => 2.9417, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.08% (3.5679 => 3.6066, std.dev.: 0.0112) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.08% (5.4641 => 4.3120, std.dev.: 0.0439) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.80% (1.0512 => 0.9377, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -9.39% (7.2130 => 6.5354, std.dev.: 0.2440) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.94% (14.6451 => 13.3359, std.dev.: 0.2570) MultiSource/Benchmarks/mafft/pairlocalalign: -8.53% (63.1822 => 57.7957, std.dev.: 0.0248) MultiSource/Benchmarks/nbench/nbench: -7.49% (21.9654 => 20.3194, std.dev.: 0.2615) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.91% (4.7482 => 4.4200, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.33% (0.3269 => 0.3062, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.96% (3.7148 => 3.4933, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.91% (5.4972 => 5.1725, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.06% (5.1557 => 4.8948, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.42% (4.7449 => 4.5350, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.79% (6.0224 => 5.7940, std.dev.: 0.0085) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.77% (2.8773 => 2.7687, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.47% (2.4490 => 2.3640, std.dev.: 0.0169) MultiSource/Applications/lua/lua: -3.27% (29.8330 => 28.8584, std.dev.: 0.0656) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.25% (0.5807 => 0.5618, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (28.5821 => 27.6689, std.dev.: 0.0323) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.83% (2.6356 => 2.5610, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.55% (9.9065 => 9.6535, std.dev.: 0.0732) SingleSource/Benchmarks/Shootout-C++/hash2: -2.29% (3.4237 => 3.3454, std.dev.: 0.0139) MultiSource/Applications/aha/aha: -2.05% (3.3398 => 3.2712, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.98% (11.5316 => 11.3036, std.dev.: 0.0209) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.89% (1.2822 => 1.2580, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.58% (4.9994 => 4.9204, std.dev.: 0.0239) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.51% (3.2169 => 3.1684, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.34% (2.3487 => 2.3173, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.21% (5.6343 => 5.5659, std.dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.39% (1.0262 => 1.0610, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 5.91% (0.0254 => 0.0269, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.65% (0.0302 => 0.0294, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.92% (0.1438 => 0.1480, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.26% (1.1329 => 1.1472, std.dev.: 0.0155) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.14% (0.4164 => 0.4170, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.60% (0.1369 => 0.1432, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.87% (0.0641 => 0.0629, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.51% (0.0195 => 0.0194, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.88% (0.0578 => 0.0544, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.25% (1.1437 => 1.1923, std.dev.: 0.0218) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.89% (0.0627 => 0.0565, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.78% (0.0180 => 0.0185, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.74% (0.8017 => 0.7797, std.dev.: 0.0116) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: -38.71% (0.0062 => 0.0038, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 4.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 18 14:29:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 16:29:03 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121118222903.938072A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6014?compare_to=6011&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6014, Order: 168292, Start Time: 2012-11-18 20:55:55, End Time: 2012-11-18 22:29:24 To: 6011, Order: 168288, Start Time: 2012-11-18 18:59:08, End Time: 2012-11-18 20:32:51 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (176 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (860 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.70% (54.6101 => 56.6280, std.dev.: 0.0680) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.57% (0.3834 => 0.4431, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.76% (54.5751 => 56.6280, std.dev.: 0.0680) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1010, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/salsa20: 2.45% (7.4937 => 7.6773, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash2: 2.20% (3.1932 => 3.2636, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.14% (0.3821 => 0.3510, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.97% (2.4924 => 2.3186, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.75% (0.3142 => 0.2930, std.dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: -6.67% (0.3357 => 0.3133, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.45% (0.9542 => 0.8927, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: -6.34% (0.2160 => 0.2023, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.24% (0.1796 => 0.1684, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.22% (0.2428 => 0.2277, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.20% (0.9852 => 0.9241, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.20% (0.7198 => 0.6752, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.14% (9.2283 => 8.6620, std.dev.: 0.0171) MultiSource/Applications/JM/lencod/lencod: -6.07% (16.1920 => 15.2085, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/ReedSolomon: -6.07% (0.1879 => 0.1765, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.03% (0.6484 => 0.6093, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -5.97% (7.0961 => 6.6724, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/football/football: -5.89% (0.9179 => 0.8638, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.89% (0.1716 => 0.1615, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.86% (0.2355 => 0.2217, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.84% (1.3722 => 1.2920, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.80% (0.3658 => 0.3446, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.78% (1.0544 => 0.9935, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.74% (3.5339 => 3.3312, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.70% (0.5805 => 0.5474, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.69% (4.0323 => 3.8028, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.68% (0.6052 => 0.5708, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.67% (0.6681 => 0.6302, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.66% (4.8161 => 4.5437, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.64% (0.2695 => 0.2543, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.63% (0.6660 => 0.6285, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.62% (0.6230 => 0.5880, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.62% (1.2300 => 1.1609, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.62% (6.7716 => 6.3912, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.62% (0.5857 => 0.5528, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.62% (1.6364 => 1.5445, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -5.61% (0.3406 => 0.3215, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.61% (1.4642 => 1.3821, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.60% (0.5802 => 0.5477, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.56% (0.5863 => 0.5537, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.54% (0.6260 => 0.5913, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.52% (4.8802 => 4.6106, std.dev.: 0.0074) MultiSource/Benchmarks/nbench/nbench: -5.51% (1.1530 => 1.0895, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: -5.50% (1.1450 => 1.0820, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.50% (0.6676 => 0.6309, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.49% (4.5069 => 4.2593, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.49% (0.6736 => 0.6366, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.49% (0.7524 => 0.7111, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.47% (0.6395 => 0.6045, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.47% (0.5575 => 0.5270, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.45% (0.6293 => 0.5950, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.44% (0.6667 => 0.6304, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.44% (0.5478 => 0.5180, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.44% (0.5591 => 0.5287, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.43% (0.5705 => 0.5395, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.43% (0.5688 => 0.5379, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: -5.43% (4.3330 => 4.0978, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: -5.43% (0.4515 => 0.4270, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.41% (0.7339 => 0.6942, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.40% (0.5925 => 0.5605, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.39% (0.5849 => 0.5534, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: -5.34% (1.3864 => 1.3124, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.30% (0.5941 => 0.5626, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.30% (0.5567 => 0.5272, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.30% (0.5456 => 0.5167, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.29% (0.7919 => 0.7500, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.26% (0.6446 => 0.6107, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.26% (1.2784 => 1.2112, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/18-imp/imp: -5.25% (0.3581 => 0.3393, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.24% (14.2083 => 13.4637, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.22% (0.5570 => 0.5279, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.21% (0.6395 => 0.6062, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.20% (0.3483 => 0.3302, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.20% (0.5581 => 0.5291, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.17% (0.5569 => 0.5281, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.16% (0.6440 => 0.6108, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.15% (0.6033 => 0.5722, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -5.15% (17.1032 => 16.2219, std.dev.: 0.0139) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.15% (0.8521 => 0.8082, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.15% (1.2221 => 1.1592, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.10% (0.2548 => 0.2418, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.05% (1.2210 => 1.1593, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.03% (0.5999 => 0.5697, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.03% (8.0126 => 7.6094, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.00% (0.2278 => 0.2164, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.00% (0.4916 => 0.4670, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.97% (0.2999 => 0.2850, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -4.96% (0.2659 => 0.2527, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: -4.95% (3.5154 => 3.3413, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.88% (0.3319 => 0.3157, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.85% (0.3812 => 0.3627, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.83% (1.6474 => 1.5679, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -4.81% (0.4033 => 0.3839, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.77% (15.2527 => 14.5252, std.dev.: 0.0097) SingleSource/UnitTests/ObjC/exceptions-4: -4.77% (0.3880 => 0.3695, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.74% (0.3884 => 0.3700, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -4.72% (0.4176 => 0.3979, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -4.71% (4.0594 => 3.8683, std.dev.: 0.0089) MultiSource/Applications/SPASS/SPASS: -4.70% (15.5079 => 14.7788, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.70% (0.6297 => 0.6001, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.70% (0.2385 => 0.2273, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.67% (0.3896 => 0.3714, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.66% (0.5168 => 0.4927, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -4.65% (0.3831 => 0.3653, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -4.63% (1.2515 => 1.1935, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.62% (0.6304 => 0.6013, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.60% (0.3891 => 0.3712, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.59% (0.6194 => 0.5910, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -4.57% (0.3848 => 0.3672, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: -4.57% (0.7447 => 0.7107, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -4.54% (2.1401 => 2.0429, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (0.7021 => 0.6703, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.51% (0.6189 => 0.5910, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: -4.51% (5.0226 => 4.7962, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.41% (22.4056 => 21.4176, std.dev.: 0.0094) MultiSource/Applications/siod/siod: -4.41% (2.4021 => 2.2962, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.35% (0.5329 => 0.5097, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -4.34% (0.3271 => 0.3129, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -4.34% (1.3148 => 1.2578, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/property: -4.33% (0.4199 => 0.4017, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.32% (0.4280 => 0.4095, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -4.30% (0.8418 => 0.8056, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -4.26% (0.7982 => 0.7642, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -4.22% (34.0927 => 32.6528, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/matrix: -4.18% (0.3255 => 0.3119, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.17% (0.4151 => 0.3978, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.14% (2.2587 => 2.1651, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.06% (0.3323 => 0.3188, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.05% (0.3016 => 0.2894, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.02% (0.9077 => 0.8712, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: -4.02% (18.2933 => 17.5583, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/methcall: -4.00% (0.3025 => 0.2904, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -3.95% (0.4248 => 0.4080, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -3.93% (0.3026 => 0.2907, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: -3.91% (0.3194 => 0.3069, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.91% (0.9557 => 0.9183, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.87% (0.3849 => 0.3700, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.79% (0.3931 => 0.3782, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -3.79% (0.4861 => 0.4677, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.78% (0.3837 => 0.3692, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.76% (2.1713 => 2.0897, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -3.73% (0.3059 => 0.2945, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.72% (0.3252 => 0.3131, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -3.71% (0.3446 => 0.3318, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -3.71% (0.2989 => 0.2878, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -3.68% (0.3394 => 0.3269, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.66% (0.3057 => 0.2945, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.65% (0.2903 => 0.2797, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.64% (0.4813 => 0.4638, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -3.62% (0.2871 => 0.2767, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -3.54% (0.3867 => 0.3730, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -3.51% (0.3621 => 0.3494, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -3.50% (0.3481 => 0.3359, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -3.50% (0.2939 => 0.2836, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -3.49% (0.3205 => 0.3093, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -3.47% (0.6347 => 0.6127, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.42% (0.6441 => 0.6221, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.41% (0.4427 => 0.4276, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.38% (0.3491 => 0.3373, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.36% (0.4083 => 0.3946, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: -3.30% (0.6750 => 0.6527, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: -3.25% (0.7779 => 0.7526, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -3.17% (0.3788 => 0.3668, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.08% (5.4682 => 5.2996, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: -3.00% (1.5610 => 1.5141, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash: -2.79% (0.4524 => 0.4398, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.19% (20.7746 => 20.3194, std.dev.: 0.0306) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.36% (7.5137 => 5.7582, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/richards_benchmark: -8.77% (1.2842 => 1.1716, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: -3.86% (2.2633 => 2.1759, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7070, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.24% (1.3096 => 1.2803, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.71% (6.5735 => 6.4611, std.dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 3.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 18 14:44:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 16:44:42 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121118224442.2670F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6015?compare_to=6008&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6015, Order: 168288, Start Time: 2012-11-18 19:24:06, End Time: 2012-11-18 22:45:02 To: 6008, Order: 168286, Start Time: 2012-11-18 12:30:51, End Time: 2012-11-18 15:52:04 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (169 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1091 (722 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 5.39% (0.4005 => 0.4221, std.dev.: 0.0053) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.84% (0.0625 => 0.0874, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.64% (0.1063 => 0.1410, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.56% (0.2969 => 0.3728, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.86% (0.1106 => 0.1381, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.67% (0.4139 => 0.5160, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.65% (0.4253 => 0.5259, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 23.29% (1.5932 => 1.9642, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.99% (0.4994 => 0.6142, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.97% (0.0714 => 0.0878, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.84% (0.5000 => 0.6142, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.80% (0.5900 => 0.7245, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.67% (0.0547 => 0.0671, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.60% (0.0584 => 0.0716, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.67% (0.1620 => 0.1971, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.65% (0.1021 => 0.1242, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.52% (0.0897 => 0.1090, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.05% (0.1107 => 0.1340, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.38% (0.0633 => 0.0762, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 20.25% (0.0948 => 0.1140, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.25% (0.0642 => 0.0772, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.21% (0.0584 => 0.0702, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.04% (0.1103 => 0.1324, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.84% (0.1003 => 0.1202, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.83% (0.0822 => 0.0985, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.78% (0.0541 => 0.0648, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 19.73% (0.0821 => 0.0983, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.70% (0.1604 => 0.1920, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.57% (0.3903 => 0.4667, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.43% (0.1549 => 0.1850, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: 19.37% (0.0604 => 0.0721, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 19.33% (0.1619 => 0.1932, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.81% (0.1462 => 0.1737, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.37% (0.0947 => 0.1121, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.35% (0.2736 => 0.3238, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.30% (0.3890 => 0.4602, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.17% (0.2014 => 0.2380, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 17.98% (0.1218 => 0.1437, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 17.82% (0.5826 => 0.6864, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 17.62% (0.0698 => 0.0821, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 17.57% (0.4029 => 0.4737, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.52% (1.3152 => 1.5456, std.dev.: 0.0054) SingleSource/UnitTests/ObjC++/property-reference-object: 17.51% (0.5889 => 0.6920, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.28% (0.1088 => 0.1276, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 17.28% (0.1505 => 0.1765, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 17.27% (0.5546 => 0.6504, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.96% (0.2866 => 0.3352, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.85% (0.3271 => 0.3822, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 16.65% (1.8794 => 2.1924, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.51% (1.6211 => 1.8887, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.49% (3.5627 => 4.1503, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.49% (0.2875 => 0.3349, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.41% (0.1968 => 0.2291, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 16.29% (0.7171 => 0.8339, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.23% (0.4658 => 0.5414, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 16.08% (0.2780 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.03% (0.1160 => 0.1346, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.00% (0.5026 => 0.5830, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/18-imp/imp: 15.90% (0.1421 => 0.1647, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 15.82% (0.2750 => 0.3185, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.81% (0.2738 => 0.3171, std.dev.: 0.0042) MultiSource/Applications/d/make_dparser: 15.81% (1.0781 => 1.2485, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 15.78% (0.9697 => 1.1227, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/objinst: 15.73% (0.2823 => 0.3267, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.70% (2.7292 => 3.1577, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/except: 15.69% (0.2811 => 0.3252, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.65% (0.3195 => 0.3695, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 15.61% (0.3004 => 0.3473, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 15.60% (0.2725 => 0.3150, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.59% (0.4361 => 0.5041, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 15.59% (0.2714 => 0.3137, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.56% (0.2911 => 0.3364, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 15.55% (0.2803 => 0.3239, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.54% (0.2792 => 0.3226, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 15.50% (0.1284 => 0.1483, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 15.46% (0.2813 => 0.3248, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.46% (0.2729 => 0.3151, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.45% (0.3930 => 0.4537, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 15.42% (0.9909 => 1.1437, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.31% (4.4195 => 5.0962, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.27% (2.0673 => 2.3829, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 15.15% (0.3096 => 0.3565, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 15.06% (4.2109 => 4.8449, std.dev.: 0.0137) MultiSource/Benchmarks/Bullet/bullet: 14.93% (23.5202 => 27.0324, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/moments: 14.87% (0.3678 => 0.4225, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/ary3: 14.85% (0.3267 => 0.3752, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 14.80% (0.3317 => 0.3808, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 14.73% (0.3258 => 0.3738, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.69% (1.9694 => 2.2587, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.55% (1.9966 => 2.2871, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.50% (0.1090 => 0.1248, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 14.36% (0.3446 => 0.3941, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 14.34% (0.3348 => 0.3828, std.dev.: 0.0090) SingleSource/UnitTests/ObjC/for-in: 14.33% (0.3496 => 0.3997, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.28% (0.3460 => 0.3954, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.26% (0.3465 => 0.3959, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.25% (0.3060 => 0.3496, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.25% (0.3362 => 0.3841, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.23% (0.3282 => 0.3749, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.19% (0.3488 => 0.3983, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 14.18% (0.3469 => 0.3961, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 14.18% (0.3442 => 0.3930, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 14.17% (0.2075 => 0.2369, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.12% (0.3124 => 0.3565, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 14.11% (0.2566 => 0.2928, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 14.09% (0.3477 => 0.3967, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 13.98% (0.3726 => 0.4247, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 13.86% (1.4269 => 1.6247, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/property: 13.84% (0.3650 => 0.4155, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.79% (0.3625 => 0.4125, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/exceptions: 13.78% (0.3643 => 0.4145, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 13.70% (0.4146 => 0.4714, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.59% (0.3981 => 0.4522, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.59% (0.3724 => 0.4230, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 13.43% (0.7875 => 0.8933, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.42% (0.3845 => 0.4361, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 13.39% (0.4251 => 0.4820, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.36% (0.3690 => 0.4183, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 13.02% (2.1653 => 2.4472, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/bigfib: 12.79% (0.5012 => 0.5653, std.dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: 12.43% (4.6177 => 5.1919, std.dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: 12.36% (2.1013 => 2.3611, std.dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 12.00% (0.2691 => 0.3014, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 12.00% (5.5417 => 6.2065, std.dev.: 0.0118) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.76% (0.2040 => 0.2280, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.61% (0.6435 => 0.7182, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.28% (0.1028 => 0.1144, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.03% (0.2068 => 0.2296, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.92% (0.2737 => 0.3036, std.dev.: 0.0088) MultiSource/Applications/lambda-0_1_3/lambda: 10.66% (0.3498 => 0.3871, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.64% (0.3084 => 0.3412, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 10.50% (0.4847 => 0.5356, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 10.49% (0.6634 => 0.7330, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.41% (0.1383 => 0.1527, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 10.28% (0.3336 => 0.3679, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.89% (0.2103 => 0.2311, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 9.50% (2.0346 => 2.2279, std.dev.: 0.0085) MultiSource/Applications/lemon/lemon: 9.37% (0.2391 => 0.2615, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.83% (4.6926 => 5.1071, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.64% (0.5361 => 0.5824, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.57% (11.6398 => 12.6372, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.02% (0.5584 => 0.6032, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.86% (0.7426 => 0.8010, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 6.51% (11.9555 => 12.7334, std.dev.: 0.0167) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.83% (0.3792 => 0.3975, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 9.71% (0.2802 => 0.3074, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6094, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6712, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-2: 4.87% (1.8057 => 1.8937, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1684, std.dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/dry: 4.29% (14.0481 => 14.6503, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.60% (0.3693 => 0.3826, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1926, std.dev.: 0.0424) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.76% (3.1722 => 3.2281, std.dev.: 0.0040) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.2995, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2884, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5407, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6014, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.88% (25.4195 => 16.5537, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/ary2: -10.03% (0.2402 => 0.2161, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9787, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8002, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/tsp/tsp: -7.21% (2.1113 => 1.9590, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.56% (11.2080 => 10.8090, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.05% (0.6293 => 0.6101, std.dev.: 0.0054) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: -2.93% (17.2379 => 16.7336, std.dev.: 0.0687) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8674, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5739, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4960, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1659, std.dev.: 0.0260) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0412, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 3.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 18 16:22:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 18:22:11 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121119002211.BA82C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6016?compare_to=6013&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6016, Order: 168293, Start Time: 2012-11-18 22:52:30, End Time: 2012-11-19 00:22:35 To: 6013, Order: 168292, Start Time: 2012-11-18 20:49:20, End Time: 2012-11-18 22:19:21 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 4 (113 on baseline) Performance Improvements: 4 (27 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1046 (834 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 1.46% (3.0007 => 3.0445, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout/hash: 1.43% (4.2519 => 4.3127, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: 1.32% (1.3755 => 1.3937, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.25% (3.5392 => 3.5834, std.dev.: 0.0068) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/Burg/burg: -3.13% (1.2984 => 1.2577, std.dev.: 0.0137) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel12: -8.36% (0.1268 => 0.1162, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.06% (6.5354 => 6.3354, std.dev.: 0.0513) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.40% (45.9870 => 44.8856, std.dev.: 0.3554) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.07% (1.0610 => 1.0603, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -14.22% (0.0218 => 0.0187, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.47% (0.0426 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -7.81% (0.0269 => 0.0248, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -9.86% (0.0294 => 0.0265, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.47% (0.0424 => 0.0422, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -38.92% (0.0203 => 0.0124, std.dev.: 0.0068) SingleSource/UnitTests/Vector/Altivec/test1: -0.92% (0.0218 => 0.0216, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.20% (0.1480 => 0.1477, std.dev.: 0.0147) MultiSource/Applications/lemon/lemon: 2.38% (1.1472 => 1.1745, std.dev.: 0.0378) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.11% (0.4170 => 0.4258, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.49% (0.1432 => 0.1439, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.97% (0.0629 => 0.0560, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 29.38% (0.0194 => 0.0251, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.23% (0.0544 => 0.0567, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.72% (1.1923 => 1.1837, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.19% (0.0565 => 0.0583, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.16% (0.0185 => 0.0226, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.87% (0.7797 => 0.7729, std.dev.: 0.0024) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 63.16% (0.0038 => 0.0062, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 6.81% (16.4461 => 17.5656, std.dev.: 0.0901) MultiSource/Applications/sqlite3/sqlite3: 2319.25% (0.6332 => 15.3187, std.dev.: 0.0545) MultiSource/Benchmarks/McCat/08-main/main: 48.66% (0.1831 => 0.2722, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.90% (0.1559 => 0.1467, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7111.14% (0.3123 => 22.5204, std.dev.: 0.2767) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.06% (0.2463 => 0.3696, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1520.51% (0.3344 => 5.4190, std.dev.: 0.0329) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.35% (0.2364 => 0.3247, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 4.39% (0.6010 => 0.6274, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: 0.47% (0.0429 => 0.0431, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.96% (0.3266 => 0.3428, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/strcat: 3.66% (0.1969 => 0.2041, std.dev.: 0.0040) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.34% (0.0224 => 0.0221, std.dev.: 0.0013) SingleSource/UnitTests/byval-alignment: -32.17% (0.0230 => 0.0156, std.dev.: 0.0009) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0493, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 9.58% (0.1462 => 0.1602, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4676, std.dev.: 0.0159) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0740, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4945, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5126, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5465, std.dev.: 0.0712) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3076, std.dev.: 0.0140) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1555, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3632, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4046, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0879, std.dev.: 0.0017) SingleSource/Regression/C/uint64_to_float: -23.90% (2.1832 => 1.6615, std.dev.: 0.0048) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.42% (0.0810 => 0.0943, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 13.67% (0.1112 => 0.1264, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.97% (0.0848 => 0.0958, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.61% (0.7473 => 0.8042, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.24% (0.1905 => 0.2043, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.42% (0.6010 => 0.6396, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.33% (0.8321 => 0.8848, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.89% (0.2240 => 0.2372, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.80% (0.1983 => 0.2098, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.39% (0.3137 => 0.3306, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.20% (0.2998 => 0.3154, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.97% (0.8148 => 0.8553, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.63% (0.4127 => 0.4318, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.36% (0.5961 => 0.6221, std.dev.: 0.0066) MultiSource/Applications/sgefa/sgefa: 4.00% (0.2999 => 0.3119, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.93% (1.3279 => 1.3801, std.dev.: 0.0163) MultiSource/Benchmarks/MallocBench/gs/gs: 3.88% (4.1305 => 4.2907, std.dev.: 0.0249) MultiSource/Applications/lua/lua: 3.49% (3.8189 => 3.9520, std.dev.: 0.0204) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.41% (2.1401 => 2.2131, std.dev.: 0.0091) MultiSource/Applications/hbd/hbd: 3.27% (1.4269 => 1.4736, std.dev.: 0.0100) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.12% (0.4783 => 0.4932, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.09% (1.1606 => 1.1965, std.dev.: 0.0123) MultiSource/Applications/siod/siod: 2.95% (2.2184 => 2.2839, std.dev.: 0.0154) MultiSource/Applications/Burg/burg: 2.90% (1.2222 => 1.2577, std.dev.: 0.0137) MultiSource/Applications/ClamAV/clamscan: 2.89% (14.7684 => 15.1948, std.dev.: 0.0857) MultiSource/Applications/SIBsim4/SIBsim4: 2.85% (1.2568 => 1.2926, std.dev.: 0.0136) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.82% (4.4880 => 4.6146, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.80% (0.9074 => 0.9328, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.79% (0.8716 => 0.8959, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.73% (1.5315 => 1.5733, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.71% (1.4479 => 1.4872, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.69% (0.9056 => 0.9300, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.68% (0.8697 => 0.8930, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.67% (0.8457 => 0.8683, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 2.66% (14.2605 => 14.6405, std.dev.: 0.0946) MultiSource/Benchmarks/nbench/nbench: 2.63% (1.1271 => 1.1567, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.60% (0.8340 => 0.8557, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.58% (0.8611 => 0.8833, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.57% (0.8597 => 0.8818, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.54% (1.1685 => 1.1982, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/05-eks/eks: 2.52% (0.4397 => 0.4508, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.50% (0.8007 => 0.8207, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: 2.48% (2.3764 => 2.4353, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.47% (0.8331 => 0.8537, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.46% (0.8855 => 0.9073, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.46% (0.4559 => 0.4671, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.43% (0.8656 => 0.8866, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.39% (0.9688 => 0.9920, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.39% (0.9908 => 1.0145, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.37% (0.8050 => 0.8241, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 2.36% (3.2366 => 3.3131, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.35% (13.1811 => 13.4912, std.dev.: 0.0241) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.34% (0.8069 => 0.8258, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.32% (0.8927 => 0.9134, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.31% (0.8317 => 0.8509, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.30% (0.9069 => 0.9278, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.30% (0.8518 => 0.8714, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.27% (0.7932 => 0.8112, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.26% (0.9039 => 0.9243, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.23% (4.1763 => 4.2696, std.dev.: 0.0263) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.22% (0.8261 => 0.8444, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 2.20% (0.9810 => 1.0026, std.dev.: 0.0048) MultiSource/Applications/JM/ldecod/ldecod: 2.16% (6.7320 => 6.8777, std.dev.: 0.0434) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.15% (0.8204 => 0.8380, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.14% (0.8086 => 0.8259, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.11% (1.6386 => 1.6732, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.06% (0.5191 => 0.5298, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.06% (0.8316 => 0.8487, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.98% (1.2526 => 1.2774, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.94% (0.8805 => 0.8976, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.93% (0.8338 => 0.8499, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.75% (0.6586 => 0.6701, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.69% (4.4873 => 4.5633, std.dev.: 0.0257) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.53% (0.8048 => 0.8171, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: 1.48% (0.7557 => 0.7669, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.42% (0.8995 => 0.9123, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.38% (0.8359 => 0.8474, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 127.14% (0.0199 => 0.0452, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/pi: 57.65% (1.5795 => 2.4901, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.88% (0.7597 => 0.8955, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.36% (2.9753 => 3.4622, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.54% (2.7995 => 3.2065, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6088, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.10% (0.3186 => 0.3444, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/queens: 7.52% (1.7056 => 1.8339, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.11% (1.1857 => 1.2700, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.06% (6.3772 => 6.8275, std.dev.: 0.1226) SingleSource/Benchmarks/Misc/richards_benchmark: 6.90% (1.3037 => 1.3937, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.56% (4.7794 => 5.0927, std.dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: 6.17% (3.1873 => 3.3841, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.92% (4.5327 => 4.8011, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.90% (4.9686 => 5.2616, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.58% (6.2275 => 6.5127, std.dev.: 0.0619) MultiSource/Benchmarks/Olden/treeadd/treeadd: 4.49% (0.3587 => 0.3748, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.44% (3.3761 => 3.5259, std.dev.: 0.0247) MultiSource/Applications/lambda-0_1_3/lambda: 4.35% (7.4933 => 7.8193, std.dev.: 0.0393) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.20% (4.9453 => 5.1529, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.97% (4.9469 => 5.1432, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 3.81% (14.0064 => 14.5395, std.dev.: 0.0200) MultiSource/Applications/siod/siod: 2.94% (3.6643 => 3.7721, std.dev.: 0.0163) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.87% (1.2337 => 1.2691, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.74% (8.2783 => 8.5050, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.74% (11.5690 => 11.8858, std.dev.: 0.0733) SingleSource/Benchmarks/Shootout/lists: 2.55% (7.3375 => 7.5245, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.25% (4.8660 => 4.9757, std.dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/dry: 2.03% (0.5081 => 0.5184, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.96% (1.1365 => 1.1588, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.50% (4.8362 => 4.9087, std.dev.: 0.0192) MultiSource/Applications/spiff/spiff: 1.47% (2.8561 => 2.8980, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.21% (3.5679 => 3.6111, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.18% (1.5941 => 1.6129, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/ReedSolomon: 1.08% (8.5322 => 8.6243, std.dev.: 0.0159) MultiSource/Benchmarks/Olden/power/power: 1.00% (1.2061 => 1.2182, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.09% (5.4641 => 4.3118, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.17% (7.2130 => 6.3354, std.dev.: 0.0513) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.93% (1.0512 => 0.9363, std.dev.: 0.0082) SingleSource/Benchmarks/McGill/chomp: -10.51% (1.1216 => 1.0037, std.dev.: 0.0081) MultiSource/Benchmarks/mafft/pairlocalalign: -8.55% (63.1822 => 57.7792, std.dev.: 0.0903) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.24% (14.6451 => 13.4382, std.dev.: 0.1879) SingleSource/Benchmarks/Shootout/heapsort: -7.54% (3.2926 => 3.0445, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.91% (4.7482 => 4.4201, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.70% (0.3269 => 0.3050, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.98% (3.7148 => 3.4928, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.88% (5.4972 => 5.1740, std.dev.: 0.0496) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.08% (5.1557 => 4.8936, std.dev.: 0.0089) MultiSource/Benchmarks/nbench/nbench: -4.73% (21.9654 => 20.9268, std.dev.: 0.3885) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.82% (6.0224 => 5.7924, std.dev.: 0.0385) MultiSource/Applications/lua/lua: -3.31% (29.8330 => 28.8466, std.dev.: 0.0647) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.24% (0.5807 => 0.5619, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (28.5821 => 27.6982, std.dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.85% (2.6356 => 2.5606, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/bisort/bisort: -2.52% (0.6636 => 0.6469, std.dev.: 0.0034) MultiSource/Applications/aha/aha: -2.34% (3.3398 => 3.2616, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.29% (9.9065 => 9.6793, std.dev.: 0.0322) SingleSource/Benchmarks/Shootout-C++/hash2: -2.21% (3.4237 => 3.3482, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.04% (11.5316 => 11.2962, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.78% (4.9994 => 4.9105, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.57% (3.2169 => 3.1664, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.35% (2.3487 => 2.3170, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.15% (5.6343 => 5.5697, std.dev.: 0.0079) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.32% (1.0262 => 1.0603, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 52.03% (0.0123 => 0.0187, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.36% (0.0254 => 0.0248, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -12.25% (0.0302 => 0.0265, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -34.74% (0.0190 => 0.0124, std.dev.: 0.0068) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.71% (0.1438 => 0.1477, std.dev.: 0.0147) MultiSource/Applications/lemon/lemon: 3.67% (1.1329 => 1.1745, std.dev.: 0.0378) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.26% (0.4164 => 0.4258, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.11% (0.1369 => 0.1439, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -12.64% (0.0641 => 0.0560, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 28.72% (0.0195 => 0.0251, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.90% (0.0578 => 0.0567, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.50% (1.1437 => 1.1837, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.02% (0.0627 => 0.0583, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.56% (0.0180 => 0.0226, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.59% (0.8017 => 0.7729, std.dev.: 0.0024) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0062 => 0.0062, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 18 16:29:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 18:29:52 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121119002952.C280A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6017?compare_to=6014&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6017, Order: 168293, Start Time: 2012-11-18 22:56:48, End Time: 2012-11-19 00:30:12 To: 6014, Order: 168292, Start Time: 2012-11-18 20:55:55, End Time: 2012-11-18 22:29:24 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (179 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (858 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.39% (0.3834 => 0.4424, std.dev.: 0.0122) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.29% (1.2783 => 1.3715, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1006, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/salsa20: 2.37% (7.4937 => 7.6716, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/hash2: 2.16% (3.1932 => 3.2623, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.98% (0.3821 => 0.3516, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -7.03% (2.4924 => 2.3171, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.76% (0.3357 => 0.3130, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.59% (0.3142 => 0.2935, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.46% (0.9542 => 0.8926, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.38% (0.2428 => 0.2273, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -6.34% (0.2160 => 0.2023, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.24% (0.9852 => 0.9237, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.18% (0.1796 => 0.1685, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.14% (0.7198 => 0.6756, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.10% (9.2283 => 8.6655, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/ReedSolomon: -6.07% (0.1879 => 0.1765, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -6.06% (7.0961 => 6.6658, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: -6.00% (0.9179 => 0.8628, std.dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: -5.99% (16.1920 => 15.2222, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.98% (0.6484 => 0.6096, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.90% (0.2355 => 0.2216, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.84% (1.0544 => 0.9928, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.83% (1.3722 => 1.2922, std.dev.: 0.0057) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.83% (0.1716 => 0.1616, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.82% (3.5339 => 3.3281, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.77% (0.3658 => 0.3447, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.75% (0.2695 => 0.2540, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.73% (0.6681 => 0.6298, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.71% (0.6230 => 0.5874, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.70% (0.5863 => 0.5529, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.69% (0.5591 => 0.5273, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.68% (0.6052 => 0.5708, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.68% (0.6660 => 0.6282, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.67% (0.5805 => 0.5476, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.65% (4.8161 => 4.5438, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.65% (0.5857 => 0.5526, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.64% (4.0323 => 3.8049, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.63% (6.7716 => 6.3903, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.61% (1.6364 => 1.5446, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: -5.61% (0.3406 => 0.3215, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.60% (0.5478 => 0.5171, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.60% (1.2300 => 1.1611, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.59% (4.8802 => 4.6072, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.58% (0.6395 => 0.6038, std.dev.: 0.0123) MultiSource/Benchmarks/McCat/05-eks/eks: -5.58% (0.4515 => 0.4263, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -5.57% (1.1450 => 1.0812, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.57% (1.4642 => 1.3827, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.52% (0.5575 => 0.5267, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.52% (0.5925 => 0.5598, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: -5.52% (4.3330 => 4.0940, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.49% (0.6736 => 0.6366, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -5.48% (1.1530 => 1.0898, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.48% (0.6260 => 0.5917, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.47% (0.6676 => 0.6311, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.46% (0.7524 => 0.7113, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.46% (0.5859 => 0.5539, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.46% (4.5069 => 4.2608, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.45% (0.5705 => 0.5394, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.45% (0.5688 => 0.5378, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.43% (0.6667 => 0.6305, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.43% (1.2784 => 1.2090, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.42% (0.7339 => 0.6941, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.41% (0.5802 => 0.5488, std.dev.: 0.0105) MultiSource/Applications/SIBsim4/SIBsim4: -5.40% (1.3864 => 1.3115, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.39% (0.6293 => 0.5954, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.39% (0.5849 => 0.5534, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.36% (0.5581 => 0.5282, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.35% (0.5456 => 0.5164, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.33% (0.6395 => 0.6054, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.33% (0.7919 => 0.7497, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.30% (0.5941 => 0.5626, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.30% (0.5569 => 0.5274, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -5.26% (0.2985 => 0.2828, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.26% (0.6446 => 0.6107, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.26% (14.2083 => 13.4616, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/18-imp/imp: -5.25% (0.3581 => 0.3393, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: -5.24% (1.2515 => 1.1859, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.23% (0.3483 => 0.3301, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.22% (0.6033 => 0.5718, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.21% (17.1032 => 16.2116, std.dev.: 0.0158) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.18% (0.2278 => 0.2160, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.17% (0.6440 => 0.6107, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.16% (1.2221 => 1.1590, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.15% (0.5570 => 0.5283, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -5.11% (0.2659 => 0.2523, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.07% (0.4916 => 0.4667, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.06% (0.2548 => 0.2419, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.05% (8.0126 => 7.6077, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.05% (1.2210 => 1.1593, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.01% (0.5567 => 0.5288, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -4.99% (3.5154 => 3.3399, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.98% (0.8521 => 0.8097, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.97% (0.5999 => 0.5701, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -4.83% (0.3812 => 0.3628, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -4.78% (4.0594 => 3.8652, std.dev.: 0.0032) MultiSource/Applications/ClamAV/clamscan: -4.77% (15.2527 => 14.5246, std.dev.: 0.0049) MultiSource/Applications/SPASS/SPASS: -4.77% (15.5079 => 14.7689, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/for-in: -4.76% (0.4033 => 0.3841, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.76% (1.6474 => 1.5690, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: -4.75% (0.3831 => 0.3649, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.75% (0.6194 => 0.5900, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.74% (0.2385 => 0.2272, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.70% (0.2999 => 0.2858, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.70% (0.3319 => 0.3163, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/exceptions: -4.69% (0.4176 => 0.3980, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.69% (0.3880 => 0.3698, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.69% (0.7447 => 0.7098, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.68% (0.5168 => 0.4926, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -4.68% (0.3848 => 0.3668, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.66% (0.3884 => 0.3703, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.65% (0.6297 => 0.6004, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.65% (0.3896 => 0.3715, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.63% (0.6304 => 0.6012, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.59% (0.6189 => 0.5905, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.57% (0.3891 => 0.3713, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -4.56% (2.1401 => 2.0426, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: -4.53% (5.0226 => 4.7949, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.46% (0.7021 => 0.6708, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.45% (0.5329 => 0.5092, std.dev.: 0.0087) MultiSource/Applications/siod/siod: -4.44% (2.4021 => 2.2954, std.dev.: 0.0128) MultiSource/Benchmarks/McCat/09-vor/vor: -4.43% (0.3271 => 0.3126, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.36% (22.4056 => 21.4287, std.dev.: 0.0080) MultiSource/Applications/hexxagon/hexxagon: -4.35% (1.3148 => 1.2576, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -4.33% (0.4199 => 0.4017, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.30% (0.8418 => 0.8056, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -4.28% (34.0927 => 32.6324, std.dev.: 0.0066) MultiSource/Applications/lambda-0_1_3/lambda: -4.26% (0.7982 => 0.7642, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -4.21% (0.4280 => 0.4100, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.19% (2.2587 => 2.1641, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.15% (0.9077 => 0.8700, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.14% (0.4151 => 0.3979, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -4.09% (0.3255 => 0.3122, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: -4.05% (18.2933 => 17.5533, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.01% (0.3016 => 0.2895, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.99% (0.3837 => 0.3684, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.97% (0.3931 => 0.3775, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -3.94% (0.3194 => 0.3068, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -3.93% (0.3025 => 0.2906, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -3.93% (0.3026 => 0.2907, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.90% (0.3849 => 0.3699, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -3.88% (0.4248 => 0.4083, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.88% (0.3323 => 0.3194, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.88% (0.9557 => 0.9186, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.87% (0.3252 => 0.3126, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: -3.79% (0.3059 => 0.2943, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.76% (2.1713 => 2.0897, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: -3.74% (0.3394 => 0.3267, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.73% (0.3057 => 0.2943) SingleSource/Benchmarks/Shootout-C++/hash2: -3.72% (0.4861 => 0.4680, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.70% (0.4813 => 0.4635, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: -3.62% (0.2871 => 0.2767, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.61% (0.2933 => 0.2827, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -3.60% (0.3446 => 0.3322, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -3.59% (0.3481 => 0.3356, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.58% (0.2903 => 0.2799, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -3.57% (0.2939 => 0.2834, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -3.52% (0.3867 => 0.3731, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -3.51% (0.3621 => 0.3494, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.50% (0.4427 => 0.4272, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/Hello: -3.45% (0.6347 => 0.6128, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.45% (0.6441 => 0.6219, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.44% (0.3491 => 0.3371, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.40% (0.4083 => 0.3944, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -3.40% (0.3205 => 0.3096, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -3.24% (0.7779 => 0.7527, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -3.14% (0.3788 => 0.3669, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.06% (5.4682 => 5.3009, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: -3.02% (1.5610 => 1.5139, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: -2.83% (0.4524 => 0.4396, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -2.27% (20.7746 => 20.3024, std.dev.: 0.0274) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7577, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -4.03% (2.2633 => 2.1722, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7067, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.57% (1.3096 => 1.2760, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.70% (6.5735 => 6.4618, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.58% (79.7170 => 78.4571, std.dev.: 0.3949) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.02% (3.2107 => 3.1781, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 4.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 18 17:01:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 19:01:16 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121119010116.36ECB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6018?compare_to=6012&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6018, Order: 168292, Start Time: 2012-11-18 22:41:35, End Time: 2012-11-19 01:01:37 To: 6012, Order: 168288, Start Time: 2012-11-18 19:27:40, End Time: 2012-11-18 21:47:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 34 (139 on baseline) Performance Improvements: 10 (41 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1044 (707 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 14.22% (2.4842 => 2.8375, std.dev.: 0.0377) MultiSource/Applications/SIBsim4/SIBsim4: 14.13% (1.5410 => 1.7588, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 12.16% (0.5807 => 0.6513, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/methcall: 11.97% (0.3124 => 0.3498, std.dev.: 0.0085) MultiSource/Applications/aha/aha: 11.90% (0.1328 => 0.1486, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 11.74% (0.3987 => 0.4455, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.89% (0.4168 => 0.4622, std.dev.: 0.0090) MultiSource/Applications/oggenc/oggenc: 10.15% (6.6219 => 7.2943, std.dev.: 0.0324) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.00% (0.3119 => 0.3431, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.89% (0.4316 => 0.4743, std.dev.: 0.0071) SingleSource/Benchmarks/Linpack/linpack-pc: 9.63% (0.2886 => 0.3164, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.42% (0.2994 => 0.3276, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.26% (0.7180 => 0.7845, std.dev.: 0.0123) SingleSource/UnitTests/ObjC/parameter-passing: 9.18% (0.4476 => 0.4887, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/property: 8.70% (0.4416 => 0.4800, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.52% (2.3184 => 2.5159, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/bigfib: 7.33% (0.7268 => 0.7801, std.dev.: 0.0160) SingleSource/UnitTests/ObjC/synchronized: 7.20% (0.4039 => 0.4330, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.00% (0.6346 => 0.6790, std.dev.: 0.0126) MultiSource/Benchmarks/McCat/18-imp/imp: 6.81% (0.3890 => 0.4155, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.09% (1.6677 => 1.7693, std.dev.: 0.0064) MultiSource/Applications/Burg/burg: 5.65% (1.4410 => 1.5224, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: 5.19% (0.3951 => 0.4156, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.15% (0.9553 => 1.0045, std.dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: 55.35% (0.1485 => 0.2307, std.dev.: 0.0119) MultiSource/Benchmarks/McCat/09-vor/vor: 20.61% (0.1189 => 0.1434, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 7.35% (6.0250 => 6.4677, std.dev.: 0.0327) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 6.48% (5.2245 => 5.5632, std.dev.: 0.0810) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5.12% (6.0303 => 6.3390, std.dev.: 0.0924) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.16% (87.0752 => 88.9523, std.dev.: 0.4227) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.57% (3.0207 => 3.0680, std.dev.: 0.0074) MultiSource/Applications/siod/siod: 1.27% (3.1783 => 3.2187, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.15% (7.2996 => 7.3832, std.dev.: 0.0078) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (3.8978 => 3.9385, std.dev.: 0.0080) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/fibo: -11.90% (0.3353 => 0.2954, std.dev.: 0.0121) SingleSource/Benchmarks/McGill/chomp: -11.81% (0.2133 => 0.1881, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/hash: -11.69% (0.5405 => 0.4773, std.dev.: 0.0239) SingleSource/Benchmarks/Adobe-C++/functionobjects: -10.00% (0.6267 => 0.5640, std.dev.: 0.0192) MultiSource/Benchmarks/Prolangs-C/football/football: -5.92% (1.0998 => 1.0347, std.dev.: 0.0241) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.04% (1.7560 => 1.6850, std.dev.: 0.0269) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -24.02% (4.9715 => 3.7773, std.dev.: 0.4507) SingleSource/Benchmarks/Misc-C++/stepanov_container: -20.33% (7.3919 => 5.8893, std.dev.: 0.3241) SingleSource/Benchmarks/McGill/chomp: -7.40% (1.3095 => 1.2126, std.dev.: 0.0331) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.56% (0.3451 => 0.3328, std.dev.: 0.0028) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 1.20% (0.1338 => 0.1354, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 18.57% (0.0420 => 0.0498, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.45% (0.0671 => 0.0674, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 0.04% (494.1255 => 494.3344, std.dev.: 0.1652) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.87% (4.3882 => 0.0498, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: 43735.63% (1.1277 => 494.3344, std.dev.: 0.1652) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 236.35% (0.5229 => 1.7588, std.dev.: 0.0143) MultiSource/Applications/SPASS/SPASS: 22.50% (14.9895 => 18.3621, std.dev.: 0.0490) MultiSource/Applications/kimwitu++/kc: 51.60% (14.1553 => 21.4589, std.dev.: 0.0879) MultiSource/Benchmarks/MallocBench/gs/gs: 16.65% (4.1105 => 4.7950, std.dev.: 0.2334) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.78% (1.1048 => 1.5112, std.dev.: 0.0800) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 432.14% (7.1582 => 38.0920, std.dev.: 0.4557) SingleSource/Benchmarks/Misc-C++-EH/spirit: 82.31% (3.4629 => 6.3132, std.dev.: 0.3726) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.49% (0.6222 => 1.0297, std.dev.: 0.0574) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10570.69% (0.0720 => 7.6829, std.dev.: 0.1302) MultiSource/Applications/SIBsim4/SIBsim4: 3938400.00% (0.0001 => 3.9385, std.dev.: 0.0080) MultiSource/Applications/SPASS/SPASS: 13635800.00% (0.0001 => 13.6359, std.dev.: 0.2264) MultiSource/Applications/kimwitu++/kc: 52000.00% (0.0001 => 0.0521, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 65100.00% (0.0001 => 0.0652, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576000.00% (0.0001 => 0.5761, std.dev.: 0.0199) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10077100.00% (0.0001 => 10.0772, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5889200.00% (0.0001 => 5.8893, std.dev.: 0.3241) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1788.83% (1.1194 => 21.1436, std.dev.: 0.1373) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 69.11% (2.9384 => 4.9691, std.dev.: 0.2380) MultiSource/Applications/ClamAV/clamscan: 66.14% (22.1758 => 36.8421, std.dev.: 0.3852) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 58.38% (7.0540 => 11.1721, std.dev.: 0.2310) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.00% (8.1363 => 12.2048, std.dev.: 0.0819) MultiSource/Applications/JM/lencod/lencod: 48.67% (21.9371 => 32.6141, std.dev.: 0.0753) SingleSource/Benchmarks/Misc/flops: 47.49% (0.1432 => 0.2112, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/distray/distray: 45.36% (0.1056 => 0.1535, std.dev.: 0.0087) SingleSource/UnitTests/vla: 45.07% (0.0355 => 0.0515, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 38.68% (0.2554 => 0.3542, std.dev.: 0.0110) SingleSource/Benchmarks/CoyoteBench/almabench: 38.49% (0.0730 => 0.1011, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/n-body: 33.11% (0.0746 => 0.0993, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 32.41% (0.0793 => 0.1050, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 30.77% (1.1642 => 1.5224, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 29.94% (0.0491 => 0.0638, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 29.81% (0.0842 => 0.1093, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 29.18% (0.0730 => 0.0943, std.dev.: 0.0051) MultiSource/Applications/aha/aha: 29.11% (0.1151 => 0.1486, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 28.84% (2.2024 => 2.8375, std.dev.: 0.0377) MultiSource/Benchmarks/McCat/17-bintr/bintr: 28.30% (0.0675 => 0.0866, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/15-trie/trie: 26.94% (0.0527 => 0.0669, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 26.66% (5.7591 => 7.2943, std.dev.: 0.0324) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.33% (0.2065 => 0.2588, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 25.06% (0.0443 => 0.0554, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.72% (1.4186 => 1.7693, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/parameter-passing: 24.45% (0.3927 => 0.4887, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.00% (0.8101 => 1.0045, std.dev.: 0.0094) MultiSource/Benchmarks/llubenchmark/llu: 23.81% (0.0462 => 0.0572, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 23.65% (0.3603 => 0.4455, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/property: 23.52% (0.3886 => 0.4800, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 23.28% (0.1117 => 0.1377, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.99% (0.1044 => 0.1284, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.94% (0.8172 => 1.0047, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/reversefile: 22.72% (0.3865 => 0.4743, std.dev.: 0.0071) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.09% (0.1566 => 0.1912, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.92% (0.5569 => 0.6790, std.dev.: 0.0126) MultiSource/Applications/lemon/lemon: 21.77% (1.0722 => 1.3056, std.dev.: 0.0308) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 21.63% (0.6450 => 0.7845, std.dev.: 0.0123) SingleSource/UnitTests/ObjC/synchronized: 21.60% (0.3561 => 0.4330, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/methcall: 21.58% (0.2877 => 0.3498, std.dev.: 0.0085) MultiSource/Benchmarks/McCat/18-imp/imp: 21.38% (0.3423 => 0.4155, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.28% (14.3668 => 17.4245, std.dev.: 0.0885) MultiSource/Applications/lua/lua: 21.07% (3.8723 => 4.6882, std.dev.: 0.1334) SingleSource/Benchmarks/Misc-C++/bigfib: 20.83% (0.6456 => 0.7801, std.dev.: 0.0160) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.83% (0.1584 => 0.1914, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/tsp/tsp: 20.60% (0.1175 => 0.1417, std.dev.: 0.0069) MultiSource/Applications/spiff/spiff: 20.55% (0.7835 => 0.9445, std.dev.: 0.0185) MultiSource/Applications/treecc/treecc: 20.19% (2.0273 => 2.4366, std.dev.: 0.0693) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 19.75% (0.2430 => 0.2910, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/trivial-interface: 19.67% (0.3473 => 0.4156, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/09-vor/vor: 19.62% (0.3180 => 0.3804, std.dev.: 0.0166) MultiSource/Benchmarks/McCat/05-eks/eks: 19.61% (0.4299 => 0.5142, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/heapsort: 19.46% (0.2872 => 0.3431, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.44% (0.3441 => 0.4110, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 19.40% (0.3427 => 0.4092, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.11% (0.2700 => 0.3216, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/fbench: 19.09% (0.0592 => 0.0705, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.87% (0.2756 => 0.3276, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 18.85% (1.5859 => 1.8849, std.dev.: 0.1014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 18.77% (0.3826 => 0.4544, std.dev.: 0.0144) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.03% (0.0871 => 0.1028, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.46% (0.3935 => 0.4622, std.dev.: 0.0090) MultiSource/Benchmarks/mafft/pairlocalalign: 17.22% (9.4845 => 11.1177, std.dev.: 0.2252) SingleSource/Benchmarks/Shootout-C++/spellcheck: 16.65% (0.4203 => 0.4903, std.dev.: 0.0160) MultiSource/Benchmarks/Olden/mst/mst: 16.51% (0.1163 => 0.1355, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.36% (0.0648 => 0.0754, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.14% (0.0886 => 0.1029, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.04% (1.5415 => 1.7887, std.dev.: 0.0581) MultiSource/Benchmarks/Prolangs-C/football/football: 15.98% (0.8921 => 1.0347, std.dev.: 0.0241) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.95% (0.0953 => 0.1105, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/matrix: 15.89% (0.0818 => 0.0948, std.dev.: 0.0046) MultiSource/Applications/sqlite3/sqlite3: 15.87% (17.1811 => 19.9083, std.dev.: 0.0478) MultiSource/Benchmarks/Olden/health/health: 15.77% (0.1268 => 0.1468, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.75% (0.0838 => 0.0970, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.54% (5.0018 => 5.7789, std.dev.: 0.0281) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.45% (0.0770 => 0.0889, std.dev.: 0.0034) MultiSource/Applications/viterbi/viterbi: 15.37% (0.1555 => 0.1794, std.dev.: 0.0067) SingleSource/UnitTests/ObjC++/Hello: 15.34% (0.5925 => 0.6834, std.dev.: 0.0218) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.23% (0.0834 => 0.0961, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.19% (0.0770 => 0.0887, std.dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: 15.16% (0.0719 => 0.0828, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.88% (4.2646 => 4.8992, std.dev.: 0.2074) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.85% (0.9765 => 1.1215, std.dev.: 0.0213) MultiSource/Applications/minisat/minisat: 14.84% (0.7115 => 0.8171, std.dev.: 0.0259) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.76% (0.2107 => 0.2418, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.58% (0.1337 => 0.1532, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.24% (2.2022 => 2.5159, std.dev.: 0.0086) MultiSource/Benchmarks/Bullet/bullet: 14.24% (63.2438 => 72.2492, std.dev.: 0.1812) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.23% (0.5981 => 0.6832, std.dev.: 0.0278) SingleSource/Benchmarks/McGill/exptree: 14.13% (0.0814 => 0.0929, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.09% (0.3136 => 0.3578, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.09% (0.1029 => 0.1174, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.86% (0.5860 => 0.6672, std.dev.: 0.0210) SingleSource/UnitTests/ObjC/exceptions-4: 13.52% (0.3543 => 0.4022, std.dev.: 0.0167) SingleSource/UnitTests/ObjC/exceptions-2: 13.50% (0.3497 => 0.3969, std.dev.: 0.0156) SingleSource/UnitTests/ObjC/exceptions: 13.43% (0.3828 => 0.4342, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.41% (0.0798 => 0.0905, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-3: 13.34% (0.3516 => 0.3985, std.dev.: 0.0154) SingleSource/UnitTests/ObjC++/property-reference-object: 12.79% (0.6030 => 0.6801, std.dev.: 0.0266) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.54% (4.9449 => 5.5648, std.dev.: 0.2112) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.35% (0.5020 => 0.5640, std.dev.: 0.0192) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.80% (0.1906 => 0.2131, std.dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.41% (0.0929 => 0.1035, std.dev.: 0.0040) MultiSource/Benchmarks/PAQ8p/paq8p: 9.93% (10.3673 => 11.3967, std.dev.: 0.1924) SingleSource/UnitTests/Vector/constpool: 3.55% (54.1659 => 56.0904, std.dev.: 0.7341) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.28% (4.3953 => 11.0007, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/methcall: 147.47% (5.3999 => 13.3629, std.dev.: 0.0081) MultiSource/Benchmarks/McCat/17-bintr/bintr: 121.19% (0.1043 => 0.2307, std.dev.: 0.0119) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 40.63% (0.3256 => 0.4579, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/09-vor/vor: 24.26% (0.1154 => 0.1434, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/oourafft: 17.44% (6.6465 => 7.8057, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.67% (1.1145 => 1.3003, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/hash2: 13.76% (3.1578 => 3.5922, std.dev.: 0.0340) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.04% (0.2944 => 0.3328, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.79% (2.8904 => 3.2313, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 10.09% (1.1396 => 1.2546, std.dev.: 0.0029) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.57% (1.7254 => 1.8905, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.82% (4.2280 => 4.4742, std.dev.: 0.0018) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.12% (11.6436 => 12.1235, std.dev.: 0.0101) MultiSource/Applications/lua/lua: 3.63% (26.0924 => 27.0396, std.dev.: 0.2640) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.34% (0.4162 => 0.4301, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.32% (2.1424 => 2.2135, std.dev.: 0.0221) MultiSource/Applications/sqlite3/sqlite3: 2.78% (4.6441 => 4.7734, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.72% (1.7133 => 1.7599, std.dev.: 0.0093) SingleSource/Benchmarks/Dhrystone/dry: 2.51% (2.4116 => 2.4722, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.16% (1.3677 => 1.3972, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 2.04% (3.1595 => 3.2239, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 2.00% (85.0658 => 86.7632, std.dev.: 0.0638) MultiSource/Applications/spiff/spiff: 1.64% (2.9346 => 2.9828, std.dev.: 0.0121) MultiSource/Benchmarks/mafft/pairlocalalign: 1.49% (27.8444 => 28.2591, std.dev.: 0.0355) SingleSource/Benchmarks/Shootout/sieve: 1.47% (5.2139 => 5.2906, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.28% (1.0313 => 1.0445, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.27% (6.5088 => 6.5916, std.dev.: 0.0107) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.18% (2.3135 => 2.3408, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0503, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1672, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.89% (5.2763 => 1.2191, std.dev.: 0.0521) SingleSource/Benchmarks/Misc/salsa20: -75.25% (0.8651 => 0.2141, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: -45.01% (0.1622 => 0.0892, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.52% (5.3526 => 4.7361, std.dev.: 0.1445) MultiSource/Applications/JM/ldecod/ldecod: -10.27% (10.4361 => 9.3645, std.dev.: 0.1965) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.26% (5.3855 => 4.8327, std.dev.: 0.1157) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.31% (1.7609 => 1.6850, std.dev.: 0.0269) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.01% (0.3987 => 0.2392, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.35% (4.5009 => 2.7748, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7636, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -24.88% (10.7105 => 8.0461, std.dev.: 0.4330) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.14% (2.6546 => 2.0139, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -19.71% (0.2161 => 0.1735, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4249, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2842, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.82% (32.5116 => 28.9927, std.dev.: 0.0353) SingleSource/Benchmarks/Misc/mandel-2: -10.65% (1.5373 => 1.3736, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -10.47% (9.5636 => 8.5627, std.dev.: 0.2458) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4244, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.36% (3.2416 => 3.0680, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.97% (0.2497 => 0.2373, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.68% (1.5835 => 1.5094, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.55% (19.9488 => 19.0407, std.dev.: 0.2182) SingleSource/Benchmarks/Shootout/lists: -4.28% (6.2999 => 6.0304, std.dev.: 0.0091) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8919, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.73% (0.9957 => 0.9685, std.dev.: 0.0031) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.31% (0.4808 => 0.4697, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -1.95% (3.2827 => 3.2187, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.79% (8.1563 => 8.0102, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6769, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -1.45% (10.2830 => 10.1342, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.82% (0.1485 => 0.1354, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.15% (0.2116 => 0.0674, std.dev.: 0.0015) Report Time: 2.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 18 18:13:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 20:13:40 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121119021340.6FB1F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6019?compare_to=6016&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6019, Order: 168294, Start Time: 2012-11-19 00:42:08, End Time: 2012-11-19 02:14:04 To: 6016, Order: 168293, Start Time: 2012-11-18 22:52:30, End Time: 2012-11-19 00:22:35 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 5 (58 on baseline) Performance Improvements: 3 (23 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1046 (893 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/Burg/burg: 3.05% (1.2577 => 1.2960, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.69% (0.8207 => 0.8346, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel24: 33.58% (0.3487 => 0.4658, std.dev.: 0.0401) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.83% (1.2691 => 1.3177, std.dev.: 0.0165) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.09% (2.4988 => 2.5260, std.dev.: 0.0097) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.52% (8.5350 => 8.3202, std.dev.: 0.0769) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.80% (1.0381 => 0.9987, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.15% (1.6129 => 1.5943, std.dev.: 0.0072) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.03% (1.0603 => 1.0600, std.dev.: 0.0158) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.21% (0.0187 => 0.0181, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0424 => 0.0426, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 33.06% (0.0248 => 0.0330, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 18.11% (0.0265 => 0.0313, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0422 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 64.52% (0.0124 => 0.0204, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -17.13% (0.0216 => 0.0179, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.34% (0.1477 => 0.1482, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -3.35% (1.1745 => 1.1352, std.dev.: 0.0594) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.89% (0.4258 => 0.4220, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.83% (0.1439 => 0.1451, std.dev.: 0.0276) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.14% (0.0560 => 0.0628, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -25.50% (0.0251 => 0.0187, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.35% (0.0567 => 0.0565, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.80% (1.1837 => 1.1932, std.dev.: 0.0134) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0013 => 0.0026, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.81% (0.0583 => 0.0646, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 17.70% (0.0226 => 0.0266, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.13% (0.7729 => 0.7816, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -8.06% (0.0062 => 0.0057, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.24% (16.4461 => 17.8007, std.dev.: 0.1705) MultiSource/Applications/sqlite3/sqlite3: 2310.99% (0.6332 => 15.2664, std.dev.: 0.2305) MultiSource/Benchmarks/McCat/08-main/main: 50.30% (0.1831 => 0.2752, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.99% (0.1559 => 0.1450, std.dev.: 0.0289) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7119.53% (0.3123 => 22.5466, std.dev.: 0.8167) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.99% (0.2463 => 0.3719, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1525.36% (0.3344 => 5.4352, std.dev.: 0.0369) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.29% (0.2364 => 0.3222, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 4.24% (0.6010 => 0.6265, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: 2.80% (0.0429 => 0.0441, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.14% (0.3266 => 0.3434, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 2.89% (0.1969 => 0.2026, std.dev.: 0.0015) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.36% (0.0224 => 0.0236, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -38.26% (0.0230 => 0.0142, std.dev.: 0.0014) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0521, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 11.90% (0.1462 => 0.1636, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4913, std.dev.: 0.0187) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0699, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4959, std.dev.: 0.0452) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5154, std.dev.: 0.0210) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5075, std.dev.: 0.0949) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3152, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1531, std.dev.: 0.0370) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3629, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4100, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0876, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -23.94% (2.1832 => 1.6606, std.dev.: 0.0044) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 17.54% (0.1112 => 0.1307, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.19% (0.0810 => 0.0933, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.13% (0.0830 => 0.0939, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.56% (0.1905 => 0.2068, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.39% (0.2519 => 0.2680, std.dev.: 0.0038) MultiSource/Applications/Burg/burg: 6.04% (1.2222 => 1.2960, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 4.23% (0.8007 => 0.8346, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.95% (0.6227 => 0.6473, std.dev.: 0.0054) MultiSource/Applications/treecc/treecc: 3.94% (1.9948 => 2.0733, std.dev.: 0.0292) MultiSource/Applications/lua/lua: 3.93% (3.8189 => 3.9690, std.dev.: 0.0327) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.74% (0.8177 => 0.8483, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.74% (0.8050 => 0.8351, std.dev.: 0.0110) MultiSource/Benchmarks/McCat/05-eks/eks: 3.55% (0.4397 => 0.4553, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: 3.53% (2.3764 => 2.4603, std.dev.: 0.0278) MultiSource/Benchmarks/Olden/bh/bh: 3.45% (0.2985 => 0.3088, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.42% (0.8712 => 0.9010, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.40% (2.1401 => 2.2129, std.dev.: 0.0125) MultiSource/Applications/SIBsim4/SIBsim4: 3.37% (1.2568 => 1.2992, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.37% (0.7932 => 0.8199, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 3.36% (14.2605 => 14.7399, std.dev.: 0.1730) MultiSource/Applications/ClamAV/clamscan: 3.19% (14.7684 => 15.2394, std.dev.: 0.0792) MultiSource/Applications/siod/siod: 3.13% (2.2184 => 2.2878, std.dev.: 0.0116) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.11% (1.1170 => 1.1517, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.85% (0.4559 => 0.4689, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.76% (1.5315 => 1.5738, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.69% (0.8340 => 0.8564, std.dev.: 0.0060) MultiSource/Applications/JM/lencod/lencod: 2.65% (15.3280 => 15.7348, std.dev.: 0.0785) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (6.7320 => 6.8993, std.dev.: 0.0247) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.43% (3.1832 => 3.2607, std.dev.: 0.0249) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.37% (0.5191 => 0.5314, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.18% (0.8316 => 0.8497, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.00% (0.6586 => 0.6718, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 109.55% (0.0199 => 0.0417, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/pi: 58.04% (1.5795 => 2.4962, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.80% (0.7597 => 0.8873, std.dev.: 0.0340) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.31% (2.9753 => 3.4607, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.71% (2.7995 => 3.2112, std.dev.: 0.0517) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.51% (5.0261 => 5.6047, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.07% (1.1857 => 1.2814, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 7.38% (1.7056 => 1.8314, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.81% (1.2337 => 1.3177, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.69% (4.7794 => 5.0993, std.dev.: 0.0226) SingleSource/Benchmarks/Misc/richards_benchmark: 6.15% (1.3037 => 1.3839, std.dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: 5.99% (3.1873 => 3.3783, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.80% (6.2275 => 6.5267, std.dev.: 0.0496) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.69% (3.3761 => 3.5343, std.dev.: 0.0305) MultiSource/Applications/lambda-0_1_3/lambda: 4.44% (7.4933 => 7.8260, std.dev.: 0.0521) MultiSource/Applications/hexxagon/hexxagon: 3.98% (14.0064 => 14.5633, std.dev.: 0.0228) MultiSource/Applications/siod/siod: 3.09% (3.6643 => 3.7777, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.94% (8.2783 => 8.5213, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.87% (11.5690 => 11.9007, std.dev.: 0.0151) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.49% (2.4647 => 2.5260, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout/lists: 2.34% (7.3375 => 7.5091, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.71% (1.1365 => 1.1559, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.68% (4.8362 => 4.9173, std.dev.: 0.0229) MultiSource/Benchmarks/FreeBench/neural/neural: 1.35% (1.0841 => 1.0987, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: 1.22% (2.3560 => 2.3847, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.02% (4.0473 => 4.0884, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.86% (5.4641 => 4.3241, std.dev.: 0.0633) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.95% (1.0512 => 0.9361, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: -10.50% (1.1216 => 1.0038, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.96% (0.3269 => 0.2976, std.dev.: 0.0077) MultiSource/Benchmarks/mafft/pairlocalalign: -8.46% (63.1822 => 57.8366, std.dev.: 0.0814) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.97% (14.6451 => 13.4785, std.dev.: 0.1639) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.91% (4.7482 => 4.4201, std.dev.: 0.0535) SingleSource/Benchmarks/Shootout/heapsort: -6.19% (3.2926 => 3.0887, std.dev.: 0.0411) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.94% (3.7148 => 3.4941, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.87% (5.4972 => 5.1745, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.00% (5.1557 => 4.8978, std.dev.: 0.0380) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.44% (4.7449 => 4.5340, std.dev.: 0.0107) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.38% (2.8773 => 2.7513, std.dev.: 0.0355) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.86% (1.0388 => 0.9987, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.78% (6.0224 => 5.7950, std.dev.: 0.0336) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.22% (0.5807 => 0.5620, std.dev.: 0.0012) MultiSource/Applications/lua/lua: -3.13% (29.8330 => 28.9006, std.dev.: 0.3200) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.04% (28.5821 => 27.7140, std.dev.: 0.0955) MultiSource/Applications/aha/aha: -2.44% (3.3398 => 3.2582, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.37% (3.2169 => 3.1407, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hash2: -2.27% (3.4237 => 3.3459, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.93% (11.5316 => 11.3090, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.57% (9.9065 => 9.7506, std.dev.: 0.0396) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.29% (1.0262 => 1.0600, std.dev.: 0.0158) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 47.15% (0.0123 => 0.0181, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -0.56% (0.0180 => 0.0179, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 3.06% (0.1438 => 0.1482, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 0.20% (1.1329 => 1.1352, std.dev.: 0.0594) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.34% (0.4164 => 0.4220, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.99% (0.1369 => 0.1451, std.dev.: 0.0276) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.03% (0.0641 => 0.0628, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.10% (0.0195 => 0.0187, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.25% (0.0578 => 0.0565, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.33% (1.1437 => 1.1932, std.dev.: 0.0134) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.03% (0.0627 => 0.0646, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.51% (0.8017 => 0.7816, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -8.06% (0.0062 => 0.0057, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 18 18:26:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 20:26:23 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121119022623.217B82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6020?compare_to=6017&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6020, Order: 168294, Start Time: 2012-11-19 00:53:06, End Time: 2012-11-19 02:26:45 To: 6017, Order: 168293, Start Time: 2012-11-18 22:56:48, End Time: 2012-11-19 00:30:12 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (178 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (859 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.02% (1.1490 => 1.1607, std.dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.65% (0.3834 => 0.4434, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1009, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/salsa20: 2.58% (7.4937 => 7.6871, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/hash2: 2.04% (3.1932 => 3.2583, std.dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.09% (0.3821 => 0.3512, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -7.03% (2.4924 => 2.3171, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.82% (0.3357 => 0.3128, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.56% (0.3142 => 0.2936, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.49% (0.9542 => 0.8923, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: -6.39% (0.2160 => 0.2022, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.34% (0.2428 => 0.2274, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.24% (0.1796 => 0.1684, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.23% (9.2283 => 8.6534, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.22% (0.9852 => 0.9239, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.17% (0.7198 => 0.6754, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: -6.06% (16.1920 => 15.2103, std.dev.: 0.0051) MultiSource/Applications/JM/ldecod/ldecod: -6.05% (7.0961 => 6.6670, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/football/football: -5.97% (0.9179 => 0.8631, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.97% (0.6484 => 0.6097, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.96% (0.1761 => 0.1656, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.90% (0.2355 => 0.2216, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.89% (1.3722 => 1.2914, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.88% (0.3658 => 0.3443, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.82% (1.0544 => 0.9930, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.79% (3.5339 => 3.3292, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.79% (0.5805 => 0.5469, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.76% (0.6681 => 0.6296, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.75% (0.2695 => 0.2540, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.74% (4.8161 => 4.5397, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.71% (0.5863 => 0.5528, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.70% (0.3406 => 0.3212, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.69% (4.0323 => 3.8028, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.68% (0.6660 => 0.6282, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.67% (0.5591 => 0.5274, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.66% (1.6364 => 1.5438, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.65% (6.7716 => 6.3893, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.62% (4.8802 => 4.6060, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.60% (0.6230 => 0.5881, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.60% (0.5859 => 0.5531, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: -5.59% (1.1530 => 1.0886, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.57% (0.6052 => 0.5715, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.57% (0.5802 => 0.5479, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.57% (0.6395 => 0.6039, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.57% (0.5857 => 0.5531, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -5.56% (1.1450 => 1.0813, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.56% (0.6676 => 0.6305, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.56% (0.7524 => 0.7106, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.54% (1.2300 => 1.1619, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.53% (0.6260 => 0.5914, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -5.51% (0.4515 => 0.4266, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -5.50% (4.3330 => 4.0945, std.dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.49% (0.6736 => 0.6366, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.49% (4.5069 => 4.2594, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.49% (0.5705 => 0.5392, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.49% (0.5688 => 0.5376, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.49% (0.5925 => 0.5600, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.47% (0.6667 => 0.6302, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.46% (0.5478 => 0.5179, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.45% (0.5575 => 0.5271, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.42% (0.5849 => 0.5532, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.42% (0.7919 => 0.7490, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.41% (0.6395 => 0.6049, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.41% (0.7339 => 0.6942, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -5.40% (1.3864 => 1.3115, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.38% (1.2784 => 1.2096, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.38% (0.5581 => 0.5281, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.35% (0.5941 => 0.5623, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -5.35% (1.2515 => 1.1846, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.34% (0.6293 => 0.5957, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.33% (0.5456 => 0.5165, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.33% (0.5569 => 0.5272, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.31% (0.6446 => 0.6104, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -5.29% (0.2985 => 0.2827, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.29% (1.4642 => 1.3867, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.29% (14.2083 => 13.4563, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.26% (0.5567 => 0.5274, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.26% (0.5570 => 0.5277, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.20% (0.3483 => 0.3302, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -5.19% (17.1032 => 16.2154, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.17% (0.6440 => 0.6107, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.15% (0.6033 => 0.5722, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: -5.15% (0.2659 => 0.2522, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.14% (0.8521 => 0.8083, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: -5.14% (0.3581 => 0.3397, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.11% (8.0126 => 7.6030, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.11% (1.2210 => 1.1586, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.11% (1.2221 => 1.1597, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.10% (0.2999 => 0.2846, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.10% (0.5999 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.09% (0.4916 => 0.4666, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.00% (0.2278 => 0.2164, std.dev.: 0.0024) MultiSource/Applications/d/make_dparser: -4.99% (3.5154 => 3.3400, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.98% (0.2548 => 0.2421, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.98% (1.6474 => 1.5654, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/trivial-interface: -4.85% (0.3812 => 0.3627, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -4.84% (4.0594 => 3.8628, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.78% (0.2385 => 0.2271, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -4.78% (0.3831 => 0.3648, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.77% (0.6304 => 0.6003, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.76% (0.3319 => 0.3161, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -4.75% (15.5079 => 14.7714, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/exceptions-4: -4.74% (0.3880 => 0.3696, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.74% (0.4176 => 0.3978, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -4.73% (15.2527 => 14.5308, std.dev.: 0.0194) SingleSource/UnitTests/ObjC/exceptions-3: -4.73% (0.3848 => 0.3666, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.72% (0.6297 => 0.6000, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.71% (0.6194 => 0.5902, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -4.71% (0.4033 => 0.3843, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.70% (0.3891 => 0.3708, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.70% (0.5168 => 0.4925, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: -4.70% (0.3896 => 0.3713, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -4.65% (2.4021 => 2.2905, std.dev.: 0.0074) MultiSource/Applications/minisat/minisat: -4.63% (0.7447 => 0.7102, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.63% (0.7021 => 0.6696, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.61% (0.3884 => 0.3705, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.56% (0.6189 => 0.5907, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: -4.54% (5.0226 => 4.7945, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: -4.54% (2.1401 => 2.0430, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: -4.52% (0.3271 => 0.3123, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.50% (0.5329 => 0.5089, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -4.50% (0.4199 => 0.4010, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.45% (22.4056 => 21.4083, std.dev.: 0.0165) MultiSource/Applications/lambda-0_1_3/lambda: -4.35% (0.7982 => 0.7635, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -4.30% (1.3148 => 1.2582, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -4.30% (0.4280 => 0.4096, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.27% (2.2587 => 2.1622, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -4.22% (34.0927 => 32.6544, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.14% (0.4151 => 0.3979, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.12% (0.9077 => 0.8703, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: -4.09% (0.3255 => 0.3122, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.03% (0.3323 => 0.3189, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -4.03% (0.8418 => 0.8079, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.94% (0.3931 => 0.3776, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -3.94% (18.2933 => 17.5730, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/methcall: -3.93% (0.3025 => 0.2906, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -3.91% (0.3194 => 0.3069, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.91% (0.3016 => 0.2898, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.88% (0.3837 => 0.3688, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.87% (0.9557 => 0.9187, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.87% (0.3849 => 0.3700, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -3.87% (0.3026 => 0.2909, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -3.86% (0.4248 => 0.4084, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -3.76% (0.4861 => 0.4678, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/strcat: -3.75% (0.2989 => 0.2877, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.74% (2.1713 => 2.0902, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: -3.73% (0.3059 => 0.2945, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -3.71% (0.3446 => 0.3318, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.66% (0.3252 => 0.3133, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -3.65% (0.3394 => 0.3270, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.64% (0.4813 => 0.4638, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.58% (0.2903 => 0.2799, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.58% (0.2933 => 0.2828, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -3.58% (0.6347 => 0.6120, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.57% (0.3057 => 0.2948, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -3.55% (0.2871 => 0.2769, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.52% (0.4427 => 0.4271, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -3.47% (0.2939 => 0.2837, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -3.47% (0.3867 => 0.3733, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.45% (0.4083 => 0.3942, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -3.45% (0.3481 => 0.3361, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -3.43% (0.3205 => 0.3095, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -3.40% (0.6441 => 0.6222, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -3.33% (0.6750 => 0.6525, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.29% (0.3491 => 0.3376, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -3.24% (0.7779 => 0.7527, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -3.23% (0.3621 => 0.3504, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.07% (5.4682 => 5.3002, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: -3.06% (0.3788 => 0.3672, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -3.03% (1.5610 => 1.5137, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/hash: -2.81% (0.4524 => 0.4397, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -2.17% (20.7746 => 20.3248, std.dev.: 0.0365) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7544, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: -8.68% (1.2842 => 1.1727, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.64% (2.2633 => 2.1810, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.16% (1.3096 => 1.2682, std.dev.: 0.0114) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4705, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 18 18:53:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 20:53:15 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121119025315.1854F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6021?compare_to=6015&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6021, Order: 168293, Start Time: 2012-11-18 23:32:45, End Time: 2012-11-19 02:53:37 To: 6015, Order: 168288, Start Time: 2012-11-18 19:24:06, End Time: 2012-11-18 22:45:02 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (173 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1089 (717 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.17% (1.9642 => 1.9872, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 9.35% (0.2096 => 0.2292, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.03% (2.0606 => 2.1230, std.dev.: 0.0052) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.12% (0.0625 => 0.0882, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.98% (0.1063 => 0.1403, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.31% (0.0714 => 0.0909, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.07% (0.2969 => 0.3743, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.86% (0.1106 => 0.1392, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.44% (0.4139 => 0.5192, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.04% (0.4253 => 0.5318, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 24.73% (1.5932 => 1.9872, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.71% (0.4994 => 0.6178, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.66% (0.5900 => 0.7296, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.58% (0.0475 => 0.0587, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.46% (0.0584 => 0.0721, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.22% (0.5000 => 0.6161, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 22.20% (0.0599 => 0.0732, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.04% (0.1620 => 0.1977, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.96% (0.0897 => 0.1094, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.94% (0.1021 => 0.1245, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.77% (0.1107 => 0.1348, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.03% (0.1103 => 0.1335, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.01% (0.0633 => 0.0766, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 20.78% (0.0948 => 0.1145, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.72% (0.0642 => 0.0775, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0584 => 0.0704, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.32% (0.3903 => 0.4696, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.24% (0.1003 => 0.1206, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/health/health: 20.22% (0.0821 => 0.0987, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 20.17% (0.0605 => 0.0727, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.07% (0.1604 => 0.1926, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.07% (0.0822 => 0.0987, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.01% (0.1549 => 0.1859, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 19.95% (0.1619 => 0.1942, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.56% (0.2014 => 0.2408, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 19.31% (0.0808 => 0.0964, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.29% (0.1462 => 0.1744, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.10% (0.3890 => 0.4633, std.dev.: 0.0035) MultiSource/Applications/viterbi/viterbi: 18.80% (0.0947 => 0.1125, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.62% (1.3152 => 1.5601, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/mst/mst: 18.48% (0.0698 => 0.0827, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 18.38% (0.5826 => 0.6897, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.36% (0.1160 => 0.1373, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 18.31% (0.1218 => 0.1441, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.18% (0.2866 => 0.3387, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.17% (0.2736 => 0.3233, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.11% (0.1088 => 0.1285, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 18.08% (0.5889 => 0.6954, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 17.97% (0.4029 => 0.4753, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 17.87% (0.1505 => 0.1774, std.dev.: 0.0027) MultiSource/Applications/Burg/burg: 17.76% (0.5546 => 0.6531, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.47% (0.5026 => 0.5904, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.45% (0.4658 => 0.5471, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.38% (3.5627 => 4.1819, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 17.35% (1.8794 => 2.2054, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.33% (0.3271 => 0.3838, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.07% (1.6211 => 1.8978, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.02% (0.1968 => 0.2303, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.83% (0.2875 => 0.3359, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 16.61% (0.9697 => 1.1308, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 16.46% (0.7171 => 0.8351, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 16.42% (1.0781 => 1.2551, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 16.40% (0.1421 => 0.1654, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 16.29% (0.2566 => 0.2984, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.26% (0.4361 => 0.5070, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.23% (0.3930 => 0.4568, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 16.19% (0.2823 => 0.3280, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 16.18% (0.2725 => 0.3166, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 16.12% (0.2811 => 0.3264, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 16.07% (0.2813 => 0.3265, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 16.04% (0.1284 => 0.1490, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 16.04% (0.2780 => 0.3226, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.03% (2.7292 => 3.1667, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hello: 16.03% (0.2714 => 0.3149, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.00% (0.2738 => 0.3176, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.99% (0.3195 => 0.3706, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 15.96% (0.2750 => 0.3189, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 15.94% (0.9909 => 1.1488, std.dev.: 0.0052) MultiSource/Applications/ClamAV/clamscan: 15.91% (4.2109 => 4.8810, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/random: 15.84% (0.2803 => 0.3247, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.80% (0.2792 => 0.3233, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.76% (4.4195 => 5.1160, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.76% (0.2729 => 0.3159, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.70% (0.2911 => 0.3368, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 15.68% (0.3004 => 0.3475, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.55% (2.0673 => 2.3888, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.50% (1.9694 => 2.2746, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wc: 15.37% (0.3096 => 0.3572, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 15.33% (0.2075 => 0.2393, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.32% (0.1090 => 0.1257, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 15.24% (0.3267 => 0.3765, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 15.10% (0.3317 => 0.3818, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.07% (1.9966 => 2.2974, std.dev.: 0.0079) MultiSource/Benchmarks/Bullet/bullet: 15.04% (23.5202 => 27.0578, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ary: 14.92% (0.3258 => 0.3744, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 14.79% (0.3678 => 0.4222, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.74% (0.3060 => 0.3511, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.60% (0.3362 => 0.3853, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.50% (0.3124 => 0.3577, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.48% (0.3488 => 0.3993, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 14.44% (0.3726 => 0.4264, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 14.43% (1.4269 => 1.6328, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 14.40% (0.3348 => 0.3830, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.32% (0.3282 => 0.3752, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 14.27% (0.3477 => 0.3973, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.15% (0.3625 => 0.4138, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 13.94% (0.4146 => 0.4724, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 13.92% (0.7875 => 0.8971, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/for-in: 13.90% (0.3496 => 0.3982, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.90% (0.3446 => 0.3925, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.88% (0.3465 => 0.3946, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.84% (0.3981 => 0.4532, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.84% (0.3469 => 0.3949, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.76% (0.3845 => 0.4374, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: 13.74% (0.3442 => 0.3915, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.73% (0.3460 => 0.3935, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 13.72% (0.0758 => 0.0862, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.69% (0.3690 => 0.4195, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 13.67% (0.4251 => 0.4832, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.45% (0.3643 => 0.4133, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.42% (0.3650 => 0.4140, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 13.36% (2.1653 => 2.4546, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/parameter-passing: 13.24% (0.3724 => 0.4217, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 13.18% (4.6177 => 5.2265, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 13.06% (2.1013 => 2.3758, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.94% (0.2040 => 0.2304, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 12.93% (0.5012 => 0.5660, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 12.86% (0.2691 => 0.3037, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 12.42% (5.5417 => 6.2300, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.14% (0.2068 => 0.2319, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.08% (0.1383 => 0.1550, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.92% (0.6435 => 0.7202, std.dev.: 0.0143) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.77% (0.1028 => 0.1149, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 11.58% (0.3498 => 0.3903, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 11.34% (0.6634 => 0.7386, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.22% (0.2737 => 0.3044, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 11.20% (0.4847 => 0.5390, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.06% (0.3084 => 0.3425, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 10.61% (0.3336 => 0.3690, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.32% (0.2103 => 0.2320, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 10.25% (0.2391 => 0.2636, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 10.20% (2.0346 => 2.2421, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.07% (4.6926 => 5.1181, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.07% (0.5361 => 0.5847, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.98% (11.6398 => 12.6851, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.76% (0.5584 => 0.6073, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.47% (0.7426 => 0.8055, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 7.10% (11.9555 => 12.8045, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.88% (0.3792 => 0.3977, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 10.67% (0.2802 => 0.3101, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 8.01% (0.2122 => 0.2292, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6096, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.24% (12.0509 => 12.6825, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1674, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-2: 4.69% (1.8057 => 1.8903, std.dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/dry: 4.17% (14.0481 => 14.6337, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.98% (0.3693 => 0.3840, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2007, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.97% (2.0820 => 2.1230, std.dev.: 0.0052) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2253, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.47% (7.1849 => 7.2904, std.dev.: 0.0023) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3039, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5861, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.17% (2.4764 => 2.4227, std.dev.: 0.0083) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.78% (25.4195 => 16.5790, std.dev.: 0.0141) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9764, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8048, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary2: -7.37% (0.2402 => 0.2225, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9576, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8052, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std.dev.: 0.0053) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.81% (17.2379 => 16.7532, std.dev.: 0.0547) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8635, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5756, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4952, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.2073, std.dev.: 0.0275) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0425, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 18 20:01:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 22:01:10 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121119040110.960D22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6022?compare_to=6019&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6022, Order: 168295, Start Time: 2012-11-19 02:31:02, End Time: 2012-11-19 04:01:33 To: 6019, Order: 168294, Start Time: 2012-11-19 00:42:08, End Time: 2012-11-19 02:14:04 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 13 (119 on baseline) Performance Improvements: 12 (25 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1029 (830 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.03% (0.2355 => 0.2497, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.34% (0.3258 => 0.3432, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.02% (0.6292 => 0.6608, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.64% (0.9645 => 0.9996, std.dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.92% (0.4860 => 0.5002, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 2.32% (0.8274 => 0.8466, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.51% (0.9309 => 0.9450, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: 1.35% (1.4816 => 1.5016, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.18% (1.0137 => 1.0257, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 7.46% (3.7153 => 3.9926, std.dev.: 0.0712) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.46% (5.0247 => 5.1484, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: 1.18% (2.8683 => 2.9022, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 1.07% (7.8260 => 7.9095, std.dev.: 0.0080) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -3.13% (0.8912 => 0.8633, std.dev.: 0.0106) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.48% (4.6828 => 4.6137, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.28% (0.8351 => 0.8244, std.dev.: 0.0035) MultiSource/Applications/kimwitu++/kc: -1.15% (17.8007 => 17.5955, std.dev.: 0.0454) MultiSource/Benchmarks/MallocBench/gs/gs: -1.09% (4.3431 => 4.2958, std.dev.: 0.0108) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: -6.05% (0.9089 => 0.8539, std.dev.: 0.0164) MultiSource/Benchmarks/FreeBench/distray/distray: -4.73% (0.2494 => 0.2376, std.dev.: 0.0030) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.12% (1.3177 => 1.2766, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.44% (2.6022 => 2.5647, std.dev.: 0.0067) MultiSource/Benchmarks/PAQ8p/paq8p: -1.42% (93.5536 => 92.2267, std.dev.: 0.2573) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.18% (9.7506 => 9.6357, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.06% (5.0351 => 4.9819, std.dev.: 0.0123) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.63% (1.0600 => 1.0667, std.dev.: 0.0090) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 20.44% (0.0181 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0426 => 0.0428, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.42% (0.0330 => 0.0322, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -15.65% (0.0313 => 0.0264, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.94% (0.0424 => 0.0420, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0204 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 21.23% (0.0179 => 0.0217, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.54% (0.1482 => 0.1474, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.30% (1.1352 => 1.1500, std.dev.: 0.0338) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.07% (0.4220 => 0.4175, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -7.37% (0.1451 => 0.1344, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.43% (0.0628 => 0.0619, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 18.72% (0.0187 => 0.0222, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.60% (0.0565 => 0.0591, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.32% (1.1932 => 1.1970, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.85% (0.0026 => 0.0025, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.76% (0.0646 => 0.0570, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.03% (0.0266 => 0.0234, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.33% (0.7816 => 0.7790, std.dev.: 0.0048) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 28.07% (0.0057 => 0.0073, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 6.99% (16.4461 => 17.5955, std.dev.: 0.0454) MultiSource/Applications/sqlite3/sqlite3: 2305.21% (0.6332 => 15.2298, std.dev.: 0.3541) MultiSource/Benchmarks/McCat/08-main/main: 48.66% (0.1831 => 0.2722, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.70% (0.1559 => 0.1439, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7015.27% (0.3123 => 22.2210, std.dev.: 0.5185) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.82% (0.2463 => 0.3690, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1518.42% (0.3344 => 5.4120, std.dev.: 0.1226) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.75% (0.2364 => 0.3280, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: 4.24% (0.6010 => 0.6265, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/mandel: 3.50% (0.0429 => 0.0444, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.72% (0.3266 => 0.3420, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/strcat: 3.25% (0.1969 => 0.2033, std.dev.: 0.0016) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.70% (0.0224 => 0.0239, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0489, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 7.59% (0.1462 => 0.1573, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4632, std.dev.: 0.0150) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0679, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4945, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5167, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.4851, std.dev.: 0.1256) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3151, std.dev.: 0.0393) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1454, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3630, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3995, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0849, std.dev.: 0.0026) SingleSource/Regression/C/uint64_to_float: -23.72% (2.1832 => 1.6653, std.dev.: 0.0030) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.17% (0.0810 => 0.0941, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.71% (0.0773 => 0.0879, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 10.88% (0.1112 => 0.1233, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.95% (0.6010 => 0.6608, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.40% (0.3137 => 0.3432, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.26% (0.1425 => 0.1557, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.17% (0.8321 => 0.9084, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.90% (0.1157 => 0.1260, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.94% (0.2279 => 0.2460, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.84% (0.2180 => 0.2351, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.80% (0.7473 => 0.8056, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.61% (0.1983 => 0.2134, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.43% (0.1885 => 0.2025, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.01% (0.3295 => 0.3526, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 6.74% (1.2222 => 1.3046, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.73% (0.4847 => 0.5173, std.dev.: 0.0081) MultiSource/Applications/spiff/spiff: 6.49% (0.7950 => 0.8466, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.40% (0.2998 => 0.3190, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.25% (0.1905 => 0.2024, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.95% (0.8148 => 0.8633, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.95% (0.9435 => 0.9996, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.32% (0.5961 => 0.6278, std.dev.: 0.0028) MultiSource/Applications/sgefa/sgefa: 5.27% (0.2999 => 0.3157, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 5.24% (1.4269 => 1.5016, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.00% (0.2378 => 0.2497, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.87% (1.1685 => 1.2254, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.87% (0.2240 => 0.2349, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.86% (0.3003 => 0.3149, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.68% (0.6287 => 0.6581, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.58% (0.4783 => 0.5002, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.41% (1.1606 => 1.2118, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.14% (0.9074 => 0.9450, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.06% (0.4559 => 0.4744, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/gs/gs: 4.00% (4.1305 => 4.2958, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.92% (1.2526 => 1.3017, std.dev.: 0.0049) MultiSource/Applications/lua/lua: 3.80% (3.8189 => 3.9641, std.dev.: 0.0258) MultiSource/Applications/treecc/treecc: 3.79% (1.9948 => 2.0704, std.dev.: 0.0155) MultiSource/Applications/minisat/minisat: 3.61% (0.6834 => 0.7081, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.52% (0.5817 => 0.6022, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.52% (0.9908 => 1.0257, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.41% (4.1763 => 4.3187, std.dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 3.34% (1.1271 => 1.1647, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.31% (0.3115 => 0.3218, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.30% (0.8338 => 0.8613, std.dev.: 0.0104) MultiSource/Applications/SPASS/SPASS: 3.27% (14.2605 => 14.7265, std.dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.26% (0.6227 => 0.6430, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.21% (1.3279 => 1.3705, std.dev.: 0.0161) MultiSource/Applications/SIBsim4/SIBsim4: 3.15% (1.2568 => 1.2964, std.dev.: 0.0040) MultiSource/Applications/ClamAV/clamscan: 3.13% (14.7684 => 15.2303, std.dev.: 0.0439) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.08% (1.6386 => 1.6890, std.dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.01% (0.3717 => 0.3829, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.01% (3.2366 => 3.3340, std.dev.: 0.0152) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.01% (6.6074 => 6.8060, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.98% (0.8656 => 0.8914, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.97% (0.8086 => 0.8326, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.95% (0.8518 => 0.8769, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.94% (4.4873 => 4.6191, std.dev.: 0.0097) MultiSource/Applications/hexxagon/hexxagon: 2.85% (0.9810 => 1.0090, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.81% (0.8697 => 0.8941, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.80% (4.4880 => 4.6137, std.dev.: 0.0190) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.79% (8.6476 => 8.8890, std.dev.: 0.0228) MultiSource/Applications/siod/siod: 2.73% (2.2184 => 2.2789, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.64% (0.7966 => 0.8176, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.64% (0.8611 => 0.8838, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.53% (0.8805 => 0.9028, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.53% (1.4479 => 1.4845, std.dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.52% (1.1170 => 1.1452, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.42% (0.8317 => 0.8518, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.41% (0.8050 => 0.8244, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.39% (0.8286 => 0.8484, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.38% (13.1811 => 13.4949, std.dev.: 0.0295) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.36% (0.8204 => 0.8398, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.33% (0.8331 => 0.8525, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.33% (0.9069 => 0.9280, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.32% (0.9688 => 0.9913, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.31% (0.8597 => 0.8796, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.29% (0.9039 => 0.9246, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.28% (0.8069 => 0.8253, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.24% (0.8261 => 0.8446, std.dev.: 0.0065) MultiSource/Applications/JM/lencod/lencod: 2.21% (15.3280 => 15.6673, std.dev.: 0.0720) MultiSource/Benchmarks/PAQ8p/paq8p: 2.20% (2.3764 => 2.4287, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.19% (0.8420 => 0.8604, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.18% (0.8712 => 0.8902, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.18% (0.8855 => 0.9048, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.15% (4.5702 => 4.6685, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.05% (0.8927 => 0.9110, std.dev.: 0.0034) MultiSource/Applications/JM/ldecod/ldecod: 1.98% (6.7320 => 6.8651, std.dev.: 0.0516) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.62% (1.2602 => 1.2806, std.dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 118.59% (0.0199 => 0.0435, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/pi: 56.73% (1.5795 => 2.4755, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.32% (2.9753 => 3.4610, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.57% (0.7597 => 0.8780, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.36% (2.7995 => 3.2016, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.58% (5.0261 => 5.6081, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.96% (1.1857 => 1.2801, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 7.51% (3.1873 => 3.4267, std.dev.: 0.0214) SingleSource/Benchmarks/McGill/queens: 7.14% (1.7056 => 1.8274, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.60% (4.7794 => 5.0949, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/richards_benchmark: 5.94% (1.3037 => 1.3812, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.88% (4.9686 => 5.2610, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.87% (4.5327 => 4.7988, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 5.55% (7.4933 => 7.9095, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.66% (3.3761 => 3.5335, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.61% (6.2275 => 6.5145, std.dev.: 0.0561) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.11% (4.9453 => 5.1484, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.98% (4.9469 => 5.1438, std.dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 3.91% (14.0064 => 14.5542, std.dev.: 0.0132) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.48% (1.2337 => 1.2766, std.dev.: 0.0042) MultiSource/Applications/siod/siod: 2.91% (3.6643 => 3.7708, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.90% (0.3587 => 0.3691, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.81% (11.5690 => 11.8941, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.78% (8.2783 => 8.5087, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.38% (4.8660 => 4.9819, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout/lists: 2.20% (7.3375 => 7.4991, std.dev.: 0.0112) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.89% (1.1365 => 1.1580, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.67% (4.8362 => 4.9171, std.dev.: 0.0164) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.2061 => 1.2238, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.40% (3.5679 => 3.6180, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: 1.30% (8.5322 => 8.6435, std.dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.07% (5.4641 => 4.3126, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.64% (7.2130 => 6.2292, std.dev.: 0.0572) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.98% (1.0512 => 0.9358, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -10.73% (1.1216 => 1.0013, std.dev.: 0.0260) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.04% (14.6451 => 13.3219, std.dev.: 0.1701) MultiSource/Benchmarks/mafft/pairlocalalign: -8.51% (63.1822 => 57.8030, std.dev.: 0.3549) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.74% (0.3269 => 0.3016, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.88% (4.7482 => 4.4215, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.07% (3.7148 => 3.4893, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.06% (5.4972 => 5.1639, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.09% (5.1557 => 4.8932, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.39% (4.7449 => 4.5364, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.80% (2.8773 => 2.7679, std.dev.: 0.0390) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.73% (6.0224 => 5.7980, std.dev.: 0.0131) MultiSource/Applications/lua/lua: -3.35% (29.8330 => 28.8344, std.dev.: 0.0616) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.22% (0.5807 => 0.5620, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (28.5821 => 27.6918, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.73% (9.9065 => 9.6357, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.69% (2.6356 => 2.5647, std.dev.: 0.0067) MultiSource/Applications/aha/aha: -2.52% (3.3398 => 3.2558, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash2: -2.22% (3.4237 => 3.3476, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (11.5316 => 11.2989, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.64% (3.2169 => 3.1640, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.62% (4.9994 => 4.9186, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.13% (5.6343 => 5.5704, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.95% (1.0262 => 1.0667, std.dev.: 0.0090) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 26.77% (0.0254 => 0.0322, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -12.58% (0.0302 => 0.0264, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.38% (0.0384 => 0.0420, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.50% (0.1438 => 0.1474, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.51% (1.1329 => 1.1500, std.dev.: 0.0338) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.26% (0.4164 => 0.4175, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.83% (0.1369 => 0.1344, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.43% (0.0641 => 0.0619, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 13.85% (0.0195 => 0.0222, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.25% (0.0578 => 0.0591, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.66% (1.1437 => 1.1970, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 78.57% (0.0014 => 0.0025, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.09% (0.0627 => 0.0570, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 30.00% (0.0180 => 0.0234, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.83% (0.8017 => 0.7790, std.dev.: 0.0048) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 17.74% (0.0062 => 0.0073, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 18 20:10:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 22:10:59 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121119041059.8C20A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6023?compare_to=6018&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6023, Order: 168295, Start Time: 2012-11-19 01:51:22, End Time: 2012-11-19 04:11:21 To: 6018, Order: 168292, Start Time: 2012-11-18 22:41:35, End Time: 2012-11-19 01:01:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 43 (173 on baseline) Performance Improvements: 4 (40 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1041 (674 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 17.09% (0.4003 => 0.4687, std.dev.: 0.0257) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.63% (0.1663 => 0.1923, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 13.92% (0.3369 => 0.3838, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.65% (0.4439 => 0.5045, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 13.53% (0.4773 => 0.5419, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/objinst: 13.40% (0.3329 => 0.3775, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 13.36% (0.6323 => 0.7168, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/nestedloop: 13.35% (0.3019 => 0.3422, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 13.15% (0.8531 => 0.9653, std.dev.: 0.0203) SingleSource/Benchmarks/Shootout-C++/random: 13.14% (0.3028 => 0.3426, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 12.97% (0.6722 => 0.7594, std.dev.: 0.0210) SingleSource/Benchmarks/Shootout-C++/moments: 12.94% (0.4459 => 0.5036, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 11.88% (0.1978 => 0.2213, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.65% (0.5108 => 0.5703, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/hash2: 11.62% (0.5128 => 0.5724, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/lists1: 11.46% (0.4058 => 0.4523, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/power/power: 10.91% (0.1458 => 0.1617, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.26% (4.4047 => 4.8567, std.dev.: 0.0601) SingleSource/Benchmarks/Misc/ReedSolomon: 9.67% (0.2203 => 0.2416, std.dev.: 0.0045) SingleSource/Benchmarks/LivermoreLoops/kernel21: 9.64% (0.1110 => 0.1217, std.dev.: 0.0013) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.23% (0.1278 => 0.1396, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.96% (0.2891 => 0.3150, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/mst/mst: 8.78% (0.1355 => 0.1474, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.56% (0.2418 => 0.2625, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/tsp/tsp: 8.40% (0.1417 => 0.1536, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 7.42% (0.8171 => 0.8777, std.dev.: 0.0233) MultiSource/Benchmarks/FreeBench/neural/neural: 6.58% (0.1611 => 0.1717, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.34% (0.3578 => 0.3769, std.dev.: 0.0033) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.25% (8.1333 => 8.4791, std.dev.: 0.0994) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.77% (1.0047 => 1.0325, std.dev.: 0.0105) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.96% (38.0920 => 38.8404, std.dev.: 0.0307) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 26.48% (3.7773 => 4.7776, std.dev.: 0.1066) SingleSource/Benchmarks/CoyoteBench/fftbench: 22.98% (2.1167 => 2.6031, std.dev.: 0.0564) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 16.17% (0.0841 => 0.0977, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/mst/mst: 12.99% (0.1316 => 0.1487, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.90% (1.3206 => 1.4777, std.dev.: 0.0546) MultiSource/Benchmarks/Olden/tsp/tsp: 11.80% (1.1039 => 1.2342, std.dev.: 0.0183) MultiSource/Benchmarks/Olden/bisort/bisort: 11.12% (0.8651 => 0.9613, std.dev.: 0.0293) SingleSource/Benchmarks/Shootout-C++/hash: 6.22% (0.7615 => 0.8089, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 3.01% (3.1100 => 3.2037, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.7197 => 3.8316, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/hash2: 1.36% (3.5922 => 3.6409, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.10% (1.8904 => 1.9111, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: -11.21% (0.3542 => 0.3145, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -9.13% (1.0045 => 0.9128, std.dev.: 0.0304) SingleSource/UnitTests/Vector/constpool: -6.58% (56.0904 => 52.4010, std.dev.: 1.4301) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -12.66% (6.4677 => 5.6492, std.dev.: 0.2920) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -1.18% (0.1354 => 0.1338, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -15.46% (0.0498 => 0.0421, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.45% (0.0674 => 0.0671, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -0.03% (494.3344 => 494.1967, std.dev.: 0.0819) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0421, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/power/power: 43723.42% (1.1277 => 494.1967, std.dev.: 0.0819) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 195.18% (0.5229 => 1.5435, std.dev.: 0.0988) MultiSource/Applications/SPASS/SPASS: 22.63% (14.9895 => 18.3813, std.dev.: 0.0621) MultiSource/Applications/kimwitu++/kc: 50.73% (14.1553 => 21.3358, std.dev.: 0.0963) MultiSource/Benchmarks/MallocBench/gs/gs: 23.97% (4.1105 => 5.0957, std.dev.: 0.1260) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 44.96% (1.1048 => 1.6015, std.dev.: 0.0388) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 442.60% (7.1582 => 38.8404, std.dev.: 0.0307) SingleSource/Benchmarks/Misc-C++-EH/spirit: 75.26% (3.4629 => 6.0691, std.dev.: 0.3807) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.17% (0.6222 => 1.0339, std.dev.: 0.0008) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10829.86% (0.0720 => 7.8695, std.dev.: 0.1883) MultiSource/Applications/SIBsim4/SIBsim4: 3867200.00% (0.0001 => 3.8673, std.dev.: 0.0300) MultiSource/Applications/SPASS/SPASS: 13625700.00% (0.0001 => 13.6258, std.dev.: 1.4039) MultiSource/Applications/kimwitu++/kc: 52300.00% (0.0001 => 0.0524, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576500.00% (0.0001 => 0.5766, std.dev.: 0.0189) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10078800.00% (0.0001 => 10.0789, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5675700.00% (0.0001 => 5.6758, std.dev.: 0.8379) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1812.69% (1.1194 => 21.4106, std.dev.: 0.1780) MultiSource/Applications/ClamAV/clamscan: 66.86% (22.1758 => 37.0021, std.dev.: 0.6700) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 58.83% (2.9384 => 4.6670, std.dev.: 0.3177) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.69% (7.0540 => 11.0530, std.dev.: 0.3196) SingleSource/Benchmarks/CoyoteBench/almabench: 50.68% (0.0730 => 0.1100, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.42% (8.1363 => 12.2387, std.dev.: 0.1393) MultiSource/Applications/JM/lencod/lencod: 47.17% (21.9371 => 32.2850, std.dev.: 0.1957) MultiSource/Benchmarks/FreeBench/distray/distray: 46.50% (0.1056 => 0.1547, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops: 46.02% (0.1432 => 0.2091, std.dev.: 0.0026) SingleSource/UnitTests/vla: 43.66% (0.0355 => 0.0510, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 30.72% (0.1175 => 0.1536, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/em3d/em3d: 30.56% (0.1695 => 0.2213, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 29.87% (0.7433 => 0.9653, std.dev.: 0.0203) SingleSource/Benchmarks/Shootout/lists: 28.43% (0.0626 => 0.0804, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bisort/bisort: 28.34% (0.0614 => 0.0788, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/matrix: 26.77% (0.0818 => 0.1037, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/mst/mst: 26.74% (0.1163 => 0.1474, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 26.54% (0.0437 => 0.0553, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 26.35% (0.4289 => 0.5419, std.dev.: 0.0094) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.35% (0.8172 => 1.0325, std.dev.: 0.0105) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.30% (0.0479 => 0.0605, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 25.96% (0.1044 => 0.1315, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.82% (0.0457 => 0.0575, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.07% (0.0746 => 0.0933, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.78% (3.8922 => 4.8567, std.dev.: 0.0601) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 24.66% (0.0730 => 0.0910, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 24.58% (0.2107 => 0.2625, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/moments: 24.41% (0.4048 => 0.5036, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Oscar: 24.21% (0.0636 => 0.0790, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 24.14% (0.4064 => 0.5045, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 24.06% (0.3865 => 0.4795, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/hash2: 23.90% (0.4620 => 0.5724, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/matrix: 23.89% (0.3098 => 0.3838, std.dev.: 0.0098) MultiSource/Applications/minisat/minisat: 23.36% (0.7115 => 0.8777, std.dev.: 0.0233) MultiSource/Benchmarks/McCat/08-main/main: 23.14% (0.2554 => 0.3145, std.dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/fftbench: 23.02% (0.4636 => 0.5703, std.dev.: 0.0084) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 22.91% (0.0467 => 0.0574, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 22.77% (0.3684 => 0.4523, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/nestedloop: 22.52% (0.2793 => 0.3422, std.dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: 22.41% (0.0482 => 0.0590, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/random: 22.27% (0.2802 => 0.3426, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 22.27% (0.3826 => 0.4678, std.dev.: 0.0121) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.13% (0.1143 => 0.1396, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 22.07% (0.7835 => 0.9564, std.dev.: 0.0312) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 22.04% (14.3668 => 17.5329, std.dev.: 0.0236) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 21.48% (1.5415 => 1.8726, std.dev.: 0.0410) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 21.36% (0.1114 => 0.1352, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/sieve: 21.18% (0.3603 => 0.4366, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.17% (0.0770 => 0.0933, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/perlin: 21.08% (0.0536 => 0.0649, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 21.01% (0.2603 => 0.3150, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.97% (1.3050 => 1.5787, std.dev.: 0.0482) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.90% (0.1584 => 0.1915, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.78% (0.0770 => 0.0930, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 20.57% (0.3131 => 0.3775, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/instance-method-metadata: 20.46% (0.3543 => 0.4268, std.dev.: 0.0113) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.30% (0.0793 => 0.0954, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 20.18% (0.3136 => 0.3769, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/parameter-passing: 20.04% (0.3927 => 0.4714, std.dev.: 0.0182) MultiSource/Benchmarks/MallocBench/espresso/espresso: 19.89% (4.2646 => 5.1130, std.dev.: 0.1407) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.78% (0.2700 => 0.3234, std.dev.: 0.0174) SingleSource/UnitTests/ObjC/synchronized: 19.74% (0.3561 => 0.4264, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/property: 19.69% (0.3886 => 0.4651, std.dev.: 0.0138) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.29% (0.1125 => 0.1342, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/exceptions: 19.28% (0.3828 => 0.4566, std.dev.: 0.0092) SingleSource/UnitTests/ObjC/trivial-interface: 18.95% (0.3473 => 0.4131, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/exceptions-2: 18.93% (0.3497 => 0.4159, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.91% (0.2872 => 0.3415, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: 18.84% (0.3694 => 0.4390, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 18.55% (0.0798 => 0.0946, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 18.52% (0.3543 => 0.4199, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 18.34% (0.1625 => 0.1923, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 18.10% (0.1337 => 0.1579, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-3: 17.97% (0.3516 => 0.4148, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/ReedSolomon: 17.91% (0.2049 => 0.2416, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 17.78% (0.0838 => 0.0987, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.57% (0.0871 => 0.1024, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: 17.36% (0.1463 => 0.1717, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.03% (0.0834 => 0.0976, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 16.70% (17.1811 => 20.0497, std.dev.: 0.1696) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.68% (0.0953 => 0.1112, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.65% (0.1117 => 0.1303, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.51% (0.0648 => 0.0755, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.44% (0.3935 => 0.4582, std.dev.: 0.0053) SingleSource/UnitTests/ObjC++/Hello: 16.25% (0.5925 => 0.6888, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.25% (0.0886 => 0.1030, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 16.08% (0.1555 => 0.1805, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.67% (0.1940 => 0.2244, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.44% (0.9765 => 1.1273, std.dev.: 0.0523) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 15.40% (0.5981 => 0.6902, std.dev.: 0.0204) MultiSource/Benchmarks/mafft/pairlocalalign: 15.21% (9.4845 => 10.9270, std.dev.: 0.2012) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.02% (0.2756 => 0.3170, std.dev.: 0.0104) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.97% (0.1062 => 0.1221, std.dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 14.83% (5.7591 => 6.6133, std.dev.: 0.3034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.67% (0.1029 => 0.1180, std.dev.: 0.0041) MultiSource/Benchmarks/Bullet/bullet: 14.62% (63.2438 => 72.4879, std.dev.: 0.1487) SingleSource/Benchmarks/Shootout-C++/methcall: 14.56% (0.2877 => 0.3296, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.49% (0.5569 => 0.6376, std.dev.: 0.0307) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.49% (0.0704 => 0.0806, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.45% (0.3307 => 0.3785, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 14.20% (0.1655 => 0.1890, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.11% (0.5860 => 0.6687, std.dev.: 0.0307) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.11% (0.1510 => 0.1723, std.dev.: 0.0078) SingleSource/UnitTests/ObjC++/property-reference-object: 13.93% (0.6030 => 0.6870, std.dev.: 0.0080) MultiSource/Applications/sgefa/sgefa: 13.80% (0.3109 => 0.3538, std.dev.: 0.0145) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.97% (5.0018 => 5.6507, std.dev.: 0.2425) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.68% (0.8101 => 0.9128, std.dev.: 0.0304) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.38% (0.1906 => 0.2142, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/power/power: 12.29% (0.1440 => 0.1617, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: 12.22% (10.3673 => 11.6343, std.dev.: 0.1179) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.06% (0.0929 => 0.1041, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/block-byref-aggr: 11.97% (0.3817 => 0.4274, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.92% (0.4203 => 0.4704, std.dev.: 0.0149) SingleSource/Benchmarks/Stanford/Puzzle: 11.67% (0.1268 => 0.1416, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.47% (0.1892 => 0.2109, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/lists: 11.40% (0.3422 => 0.3812, std.dev.: 0.0117) SingleSource/UnitTests/ObjC++/property-reference: 10.52% (0.7326 => 0.8097, std.dev.: 0.0264) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.17% (0.2891 => 0.3185, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/except: 10.03% (0.2871 => 0.3159, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 10.02% (0.3282 => 0.3611, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: 10.00% (0.2831 => 0.3114, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/ary: 9.81% (0.3232 => 0.3549, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/ary2: 9.80% (0.3379 => 0.3710, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/hello: 9.69% (0.2714 => 0.2977, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/fibo: 9.58% (0.2725 => 0.2986, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 9.56% (0.3283 => 0.3597, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 9.53% (0.3052 => 0.3343, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.00% (0.1438 => 0.1553, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.50% (7.9617 => 8.4791, std.dev.: 0.0994) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.25% (4.3953 => 10.9992, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 147.47% (5.3999 => 13.3629, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/ary3: 29.15% (3.6994 => 4.7776, std.dev.: 0.1066) SingleSource/Benchmarks/CoyoteBench/fftbench: 27.85% (2.0360 => 2.6031, std.dev.: 0.0564) MultiSource/Benchmarks/VersaBench/dbms/dbms: 21.35% (1.5086 => 1.8307, std.dev.: 0.0885) SingleSource/Benchmarks/Misc/oourafft: 17.55% (6.6465 => 7.8130, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.65% (1.1145 => 1.3001, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/mst/mst: 15.72% (0.1285 => 0.1487, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/bisort/bisort: 15.36% (0.8333 => 0.9613, std.dev.: 0.0293) SingleSource/Benchmarks/Shootout-C++/hash2: 15.30% (3.1578 => 3.6409, std.dev.: 0.0145) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.10% (1.2838 => 1.4777, std.dev.: 0.0546) MultiSource/Benchmarks/Olden/tsp/tsp: 14.44% (1.0785 => 1.2342, std.dev.: 0.0183) MultiSource/Benchmarks/Olden/health/health: 13.88% (0.4445 => 0.5062, std.dev.: 0.0187) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.49% (0.2944 => 0.3341, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.08% (0.0864 => 0.0977, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.61% (2.8904 => 3.2261, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 10.15% (1.1396 => 1.2553, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.36% (1.7254 => 1.8869, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash: 8.50% (0.7455 => 0.8089, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.09% (4.2280 => 4.4853, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.28% (3.6395 => 3.8316, std.dev.: 0.0121) SingleSource/Regression/C/uint64_to_float: 5.10% (0.5413 => 0.5689, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.78% (26.0924 => 27.3396, std.dev.: 0.3176) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 4.48% (0.9505 => 0.9931, std.dev.: 0.0054) MultiSource/Benchmarks/nbench/nbench: 4.12% (11.6436 => 12.1232, std.dev.: 0.0052) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.36% (0.4162 => 0.4302, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.33% (0.3540 => 0.3658, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 3.27% (3.1023 => 3.2037, std.dev.: 0.0065) SingleSource/Benchmarks/Dhrystone/dry: 2.63% (2.4116 => 2.4750, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: 2.08% (1.9577 => 1.9984, std.dev.: 0.0063) MultiSource/Applications/aha/aha: 2.04% (3.1595 => 3.2241, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: 2.02% (85.0658 => 86.7864, std.dev.: 0.0760) SingleSource/Benchmarks/Shootout-C++/ackermann: 1.91% (1.7133 => 1.7461, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/sieve: 1.62% (5.2139 => 5.2986, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 1.59% (27.8444 => 28.2858, std.dev.: 0.0232) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.55% (6.5088 => 6.6095, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 1.42% (3.7221 => 3.7749, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 1.19% (5.9798 => 6.0509, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.02% (12.5348 => 12.6626, std.dev.: 0.0275) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1693, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.66% (5.2763 => 1.2315, std.dev.: 0.0568) SingleSource/Benchmarks/Misc/salsa20: -75.71% (0.8651 => 0.2101, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/richards_benchmark: -44.51% (0.1622 => 0.0900, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.26% (5.3855 => 4.8332, std.dev.: 0.0964) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.79% (5.3526 => 4.8285, std.dev.: 0.0428) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.08% (1.7609 => 1.6714, std.dev.: 0.0323) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.52% (0.0628 => 0.0361, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.01% (0.3987 => 0.2392, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.72% (0.0506 => 0.0305) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.30% (4.5009 => 2.7772, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.08% (2.6546 => 2.0154, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -20.73% (10.7105 => 8.4898, std.dev.: 0.3082) MultiSource/Benchmarks/FreeBench/mason/mason: -19.16% (0.2161 => 0.1747, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -16.09% (1.6925 => 1.4202, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.69% (2.6778 => 2.2845, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.71% (32.5116 => 29.0282, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -10.35% (9.5636 => 8.5734, std.dev.: 0.2380) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4244, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.20% (3.2416 => 3.0405, std.dev.: 0.0207) SingleSource/Benchmarks/CoyoteBench/huffbench: -5.92% (19.9488 => 18.7682, std.dev.: 0.3241) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.56% (2.7294 => 2.5777, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7497, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.09% (0.2497 => 0.2370, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.83% (1.6805 => 1.5993, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5074, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -4.28% (6.2999 => 6.0302, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8920, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.35% (0.4808 => 0.4695, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.19% (0.9957 => 0.9739, std.dev.: 0.0075) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.80% (8.1563 => 8.0094, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/salsa20: -1.47% (10.2830 => 10.1319, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.05% (2.5528 => 2.5259, std.dev.: 0.0075) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.29% (0.2116 => 0.0671, std.dev.: 0.0006) Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 18 20:23:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 22:23:12 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121119042312.4DDAF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6024?compare_to=6020&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6024, Order: 168295, Start Time: 2012-11-19 02:49:52, End Time: 2012-11-19 04:23:35 To: 6020, Order: 168294, Start Time: 2012-11-19 00:53:06, End Time: 2012-11-19 02:26:45 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (180 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (857 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.55% (54.4843 => 56.4163, std.dev.: 0.1124) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.37% (54.5751 => 56.4163, std.dev.: 0.1124) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.72% (2.0478 => 2.1036, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/salsa20: 2.63% (7.4937 => 7.6911, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 2.28% (3.1932 => 3.2661, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.17% (0.3821 => 0.3509, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -7.03% (2.4924 => 2.3172, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.72% (0.3142 => 0.2931, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.50% (0.9542 => 0.8922, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -6.46% (0.3357 => 0.3140, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.34% (0.2428 => 0.2274, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -6.34% (0.2160 => 0.2023, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -6.21% (9.2283 => 8.6548, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.14% (0.9852 => 0.9247, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.12% (0.1796 => 0.1686, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.10% (0.7198 => 0.6759, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -6.05% (16.1920 => 15.2124, std.dev.: 0.0049) MultiSource/Applications/JM/ldecod/ldecod: -6.03% (7.0961 => 6.6680, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.00% (0.6484 => 0.6095, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -5.96% (0.1761 => 0.1656, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: -5.93% (0.9179 => 0.8635, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.87% (1.0544 => 0.9925, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.87% (1.3722 => 1.2917, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.83% (0.1716 => 0.1616, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.82% (0.2355 => 0.2218, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.80% (0.3658 => 0.3446, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.75% (0.2695 => 0.2540, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.74% (3.5339 => 3.3309, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.73% (0.6681 => 0.6298, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.71% (0.5863 => 0.5528, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.68% (0.5805 => 0.5475, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.65% (0.6052 => 0.5710, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.64% (1.4642 => 1.3816, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.64% (1.6364 => 1.5441, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.63% (4.8161 => 4.5451, std.dev.: 0.0060) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.62% (6.7716 => 6.3911, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.62% (0.5857 => 0.5528, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.61% (0.6395 => 0.6036, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.61% (4.0323 => 3.8060, std.dev.: 0.0089) MultiSource/Benchmarks/nbench/nbench: -5.61% (1.1530 => 1.0883, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.60% (0.6660 => 0.6287, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.60% (0.5859 => 0.5531, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.59% (1.2300 => 1.1612, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.58% (0.5802 => 0.5478, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.58% (0.6736 => 0.6360, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.58% (0.3406 => 0.3216, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.57% (4.8802 => 4.6083, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: -5.56% (4.3330 => 4.0922, std.dev.: 0.0089) MultiSource/Applications/lemon/lemon: -5.55% (1.1450 => 1.0814, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.53% (0.5478 => 0.5175, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.50% (0.5688 => 0.5375, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.50% (0.6260 => 0.5916, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.49% (0.5925 => 0.5600, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.48% (4.5069 => 4.2598, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.48% (0.7524 => 0.7112, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.47% (0.5591 => 0.5285, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.47% (0.5849 => 0.5529, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.47% (0.7919 => 0.7486, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.45% (0.5575 => 0.5271, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.45% (0.5705 => 0.5394, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.44% (0.6676 => 0.6313, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.43% (0.6293 => 0.5951, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.43% (0.6230 => 0.5892, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.41% (1.2784 => 1.2093, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: -5.40% (0.4515 => 0.4271, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.40% (0.6667 => 0.6307, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: -5.39% (1.3864 => 1.3117, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.37% (0.7339 => 0.6945, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.36% (0.5581 => 0.5282, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.33% (0.5456 => 0.5165, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -5.33% (0.2985 => 0.2826, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.32% (0.5569 => 0.5273, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -5.31% (0.3581 => 0.3391, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.29% (0.6446 => 0.6105, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.29% (14.2083 => 13.4569, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.29% (0.5941 => 0.5627, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.25% (0.3483 => 0.3300, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -5.25% (1.2515 => 1.1858, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.23% (0.5567 => 0.5276, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.22% (0.5570 => 0.5279, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.22% (0.6395 => 0.6061, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.22% (0.6440 => 0.6104, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -5.21% (17.1032 => 16.2117, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.14% (0.6033 => 0.5723, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.13% (0.8521 => 0.8084, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.12% (1.2221 => 1.1595, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.10% (0.2548 => 0.2418, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.10% (0.2999 => 0.2846, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.10% (0.5999 => 0.5693, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.09% (0.2278 => 0.2162, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.07% (0.4916 => 0.4667, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.06% (8.0126 => 7.6068, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/08-main/main: -5.04% (0.2659 => 0.2525, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.00% (1.2210 => 1.1599, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -4.98% (3.5154 => 3.3404, std.dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.85% (0.3319 => 0.3158, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.83% (0.3812 => 0.3628, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.82% (1.6474 => 1.5680, std.dev.: 0.0009) MultiSource/Applications/lua/lua: -4.81% (4.0594 => 3.8642, std.dev.: 0.0073) SingleSource/UnitTests/ObjC/for-in: -4.76% (0.4033 => 0.3841, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.70% (0.2385 => 0.2273, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -4.68% (15.2527 => 14.5385, std.dev.: 0.0096) MultiSource/Applications/SPASS/SPASS: -4.67% (15.5079 => 14.7832, std.dev.: 0.0081) MultiSource/Applications/minisat/minisat: -4.67% (0.7447 => 0.7099, std.dev.: 0.0130) SingleSource/UnitTests/ObjC/exceptions-2: -4.67% (0.3831 => 0.3652, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions: -4.67% (0.4176 => 0.3981, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.67% (0.6297 => 0.6003, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.65% (0.6194 => 0.5906, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.65% (0.6304 => 0.6011, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.64% (0.5168 => 0.4928, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -4.63% (2.4021 => 2.2908, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: -4.62% (0.3896 => 0.3716, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -4.58% (2.1401 => 2.0420, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.57% (0.3891 => 0.3713, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.57% (0.7021 => 0.6700, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -4.56% (5.0226 => 4.7937, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-3: -4.55% (0.3848 => 0.3673, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions-4: -4.54% (0.3880 => 0.3704, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.52% (0.6189 => 0.5909, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.49% (22.4056 => 21.4005, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.48% (0.5329 => 0.5090, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.45% (0.4199 => 0.4012, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -4.43% (0.3271 => 0.3126, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -4.28% (0.4280 => 0.4097, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -4.27% (0.7982 => 0.7641, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -4.23% (1.3148 => 1.2592, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.20% (2.2587 => 2.1638, std.dev.: 0.0201) MultiSource/Benchmarks/Bullet/bullet: -4.18% (34.0927 => 32.6661, std.dev.: 0.0170) MultiSource/Applications/spiff/spiff: -4.16% (0.8418 => 0.8068, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.13% (0.9077 => 0.8702, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.06% (0.3323 => 0.3188, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -4.06% (0.3255 => 0.3123, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.04% (0.3884 => 0.3727, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -4.01% (18.2933 => 17.5590, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.99% (0.3837 => 0.3684, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -3.97% (0.3025 => 0.2905, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.95% (0.4151 => 0.3987, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -3.93% (0.4248 => 0.4081, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.92% (0.3931 => 0.3777, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.90% (0.3849 => 0.3699, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.87% (0.9557 => 0.9187, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -3.85% (0.3194 => 0.3071, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -3.83% (0.3026 => 0.2910, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.81% (0.3016 => 0.2901, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -3.79% (0.4861 => 0.4677, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -3.74% (0.3394 => 0.3267, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.72% (0.3252 => 0.3131, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.70% (2.1713 => 2.0909, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary3: -3.69% (0.3446 => 0.3319, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.66% (0.3057 => 0.2945, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -3.66% (0.3059 => 0.2947, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -3.65% (0.2989 => 0.2880, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.61% (0.2933 => 0.2827, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -3.59% (0.2871 => 0.2768, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -3.56% (0.3481 => 0.3357, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.51% (0.4813 => 0.4644, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -3.51% (0.3621 => 0.3494, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/random: -3.50% (0.2939 => 0.2836, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: -3.50% (0.6347 => 0.6125, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.46% (0.4427 => 0.4274, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.44% (0.2903 => 0.2803, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -3.44% (0.3867 => 0.3734, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -3.43% (0.3205 => 0.3095, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -3.42% (0.6750 => 0.6519, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.38% (0.3491 => 0.3373, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -3.37% (0.6441 => 0.6224, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.36% (0.4083 => 0.3946, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: -3.16% (0.7779 => 0.7533, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.09% (5.4682 => 5.2990, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: -3.06% (0.3788 => 0.3672, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -2.96% (1.5610 => 1.5148, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: -2.74% (0.4524 => 0.4400, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.39% (20.7746 => 20.2787, std.dev.: 0.0304) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.53% (7.5137 => 5.7461, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/richards_benchmark: -8.69% (1.2842 => 1.1726, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.97% (2.2633 => 2.1735, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.42% (1.3096 => 1.2648, std.dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.73% (6.5735 => 6.4599, std.dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 18 21:49:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 18 Nov 2012 23:49:18 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121119054918.06FEE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6025?compare_to=6022&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6025, Order: 168297, Start Time: 2012-11-19 04:19:51, End Time: 2012-11-19 05:49:41 To: 6022, Order: 168295, Start Time: 2012-11-19 02:31:02, End Time: 2012-11-19 04:01:33 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 6 (113 on baseline) Performance Improvements: 8 (28 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1040 (833 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 5.26% (8.2306 => 8.6632, std.dev.: 0.0217) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 2.59% (0.8539 => 0.8760, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.81% (1.3940 => 1.4192, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 1.71% (0.8780 => 0.8930, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/five11/five11: 1.54% (5.6021 => 5.6883, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/pi: 1.35% (2.4755 => 2.5089, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.37% (0.2134 => 0.1998, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.60% (0.6608 => 0.6238, std.dev.: 0.0125) MultiSource/Benchmarks/VersaBench/dbms/dbms: -5.44% (0.9084 => 0.8590, std.dev.: 0.0109) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.98% (0.3432 => 0.3261, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -2.38% (0.5173 => 0.5050, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.62% (4.6191 => 4.5441, std.dev.: 0.0286) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -1.34% (0.8613 => 0.8498, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.88% (61.2714 => 60.1203, std.dev.: 0.2829) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.31% (1.0667 => 1.0634, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -11.47% (0.0218 => 0.0193, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0428 => 0.0429, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -17.70% (0.0322 => 0.0265, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 18.94% (0.0264 => 0.0314, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -12.14% (0.0420 => 0.0369, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/casts: -27.09% (0.0203 => 0.0148, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/test1: -38.25% (0.0217 => 0.0134, std.dev.: 0.0041) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -46.15% (0.0013 => 0.0007, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.41% (0.1474 => 0.1468, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 6.43% (1.1500 => 1.2240, std.dev.: 0.0299) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.48% (0.4175 => 0.4195, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.99% (0.1344 => 0.1411, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.48% (0.0619 => 0.0616, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -8.11% (0.0222 => 0.0204, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.60% (0.0591 => 0.0552, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.48% (1.1970 => 1.1912, std.dev.: 0.0090) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -72.00% (0.0025 => 0.0007, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.16% (0.0570 => 0.0588, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.10% (0.0234 => 0.0267, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.33% (0.7790 => 0.7816, std.dev.: 0.0105) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -50.68% (0.0073 => 0.0036, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 6.74% (16.4461 => 17.5538, std.dev.: 0.2217) MultiSource/Applications/sqlite3/sqlite3: 2317.56% (0.6332 => 15.3080, std.dev.: 0.1086) MultiSource/Benchmarks/McCat/08-main/main: 47.90% (0.1831 => 0.2708, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.67% (0.1559 => 0.1455, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7028.08% (0.3123 => 22.2610, std.dev.: 0.0196) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.26% (0.2463 => 0.3701, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1520.39% (0.3344 => 5.4186, std.dev.: 0.0569) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.46% (0.2364 => 0.3226, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 4.06% (0.6010 => 0.6254, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -0.23% (0.0429 => 0.0428, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.04% (0.3266 => 0.3398, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 2.95% (0.1969 => 0.2027, std.dev.: 0.0022) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.79% (0.0224 => 0.0228, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0438, std.dev.: 0.0035) MultiSource/Applications/oggenc/oggenc: 7.39% (0.1462 => 0.1570, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4809, std.dev.: 0.0184) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0722, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4887, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5109, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5374, std.dev.: 0.0516) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3115, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1400, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3630, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4058, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0002, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0860, std.dev.: 0.0022) SingleSource/Regression/C/uint64_to_float: -24.46% (2.1832 => 1.6492, std.dev.: 0.0158) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 13.13% (0.1112 => 0.1258, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 12.84% (0.0810 => 0.0914, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.67% (0.7473 => 0.8046, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.67% (0.1905 => 0.2032, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.56% (0.2180 => 0.2323, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.98% (0.3295 => 0.3492, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.76% (0.3003 => 0.3176, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.07% (0.9435 => 0.9913, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.05% (0.2279 => 0.2394, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.83% (0.5961 => 0.6249, std.dev.: 0.0099) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.79% (0.8148 => 0.8538, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.67% (1.1606 => 1.2148, std.dev.: 0.0054) MultiSource/Applications/Burg/burg: 4.40% (1.2222 => 1.2760, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.24% (0.2998 => 0.3125, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.19% (0.4847 => 0.5050, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 4.12% (3.8189 => 3.9761, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.05% (0.4127 => 0.4294, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 4.03% (0.2999 => 0.3120, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.95% (0.3137 => 0.3261, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.56% (0.5817 => 0.6024, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 3.48% (14.2605 => 14.7562, std.dev.: 0.0690) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.45% (0.6287 => 0.6504, std.dev.: 0.0074) MultiSource/Applications/minisat/minisat: 3.42% (0.6834 => 0.7068, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.37% (1.1685 => 1.2079, std.dev.: 0.0085) MultiSource/Applications/SIBsim4/SIBsim4: 3.22% (1.2568 => 1.2973, std.dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: 3.12% (14.7684 => 15.2287, std.dev.: 0.1112) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.10% (2.1401 => 2.2064, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.06% (1.3279 => 1.3685, std.dev.: 0.0060) MultiSource/Applications/siod/siod: 2.94% (2.2184 => 2.2837, std.dev.: 0.0096) MultiSource/Applications/hbd/hbd: 2.92% (1.4269 => 1.4686, std.dev.: 0.0145) MultiSource/Benchmarks/nbench/nbench: 2.92% (1.1271 => 1.1600, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: 2.91% (8.4179 => 8.6632, std.dev.: 0.0217) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.89% (1.5315 => 1.5757, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.84% (0.6227 => 0.6404, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.83% (0.8697 => 0.8943, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.82% (0.3717 => 0.3822, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.72% (0.8597 => 0.8831, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.68% (1.2526 => 1.2862, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.67% (0.8457 => 0.8683, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.60% (0.9688 => 0.9940, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.59% (0.9074 => 0.9309, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.56% (0.9908 => 1.0162, std.dev.: 0.0062) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.51% (6.6074 => 6.7733, std.dev.: 0.0268) MultiSource/Applications/JM/ldecod/ldecod: 2.50% (6.7320 => 6.9000, std.dev.: 0.0432) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.44% (0.9069 => 0.9290, std.dev.: 0.0079) MultiSource/Applications/lambda-0_1_3/lambda: 2.42% (0.7557 => 0.7740, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.42% (0.8359 => 0.8561, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.41% (0.9056 => 0.9274, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.38% (0.8656 => 0.8862, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (4.1763 => 4.2752, std.dev.: 0.0328) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.36% (0.8050 => 0.8240, std.dev.: 0.0073) MultiSource/Benchmarks/PAQ8p/paq8p: 2.35% (2.3764 => 2.4322, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.31% (0.8317 => 0.8509, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.30% (0.8086 => 0.8272, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.30% (0.7966 => 0.8149, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.28% (13.1811 => 13.4816, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.27% (0.8518 => 0.8711, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.26% (4.5702 => 4.6737, std.dev.: 0.0112) MultiSource/Applications/JM/lencod/lencod: 2.24% (15.3280 => 15.6713, std.dev.: 0.0612) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.20% (0.8855 => 0.9050, std.dev.: 0.0027) MultiSource/Applications/d/make_dparser: 2.18% (3.2366 => 3.3071, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.15% (0.8420 => 0.8601, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.13% (0.8204 => 0.8379, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.12% (0.8927 => 0.9116, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (3.1832 => 3.2502, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.98% (0.8286 => 0.8450, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.92% (0.8338 => 0.8498, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 1.88% (31.8598 => 32.4601, std.dev.: 0.0813) MultiSource/Applications/hexxagon/hexxagon: 1.86% (0.9810 => 0.9992, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.82% (4.4880 => 4.5696, std.dev.: 0.0295) MultiSource/Benchmarks/mafft/pairlocalalign: 1.81% (8.6247 => 8.7809, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.80% (0.8316 => 0.8466, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.74% (0.8066 => 0.8206, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.69% (0.8712 => 0.8859, std.dev.: 0.0057) MultiSource/Applications/oggenc/oggenc: 1.54% (4.9628 => 5.0393, std.dev.: 0.0277) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 91.46% (0.0199 => 0.0381, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/pi: 58.84% (1.5795 => 2.5089, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.55% (0.7597 => 0.8930, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.34% (2.9753 => 3.4616, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.44% (2.7995 => 3.2037, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.63% (5.0261 => 5.6105, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.03% (1.1857 => 1.2809, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 7.35% (1.7056 => 1.8309, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.87% (4.7794 => 5.1077, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.61% (6.3772 => 6.7986, std.dev.: 0.1602) MultiSource/Applications/SIBsim4/SIBsim4: 6.56% (3.1873 => 3.3963, std.dev.: 0.0250) SingleSource/Benchmarks/Misc/richards_benchmark: 6.55% (1.3037 => 1.3891, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.87% (4.9686 => 5.2604, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.82% (4.5327 => 4.7965, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.72% (6.2275 => 6.5212, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.66% (3.3761 => 3.5335, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.42% (7.4933 => 7.8244, std.dev.: 0.0638) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.21% (4.9453 => 5.1533, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 3.99% (14.0064 => 14.5655, std.dev.: 0.1133) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.99% (4.9469 => 5.1443, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.65% (0.3587 => 0.3718, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.55% (1.2337 => 1.2775, std.dev.: 0.0128) MultiSource/Applications/siod/siod: 3.23% (3.6643 => 3.7825, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.74% (11.5690 => 11.8861, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.71% (8.2783 => 8.5030, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.34% (4.8660 => 4.9800, std.dev.: 0.0365) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.34% (4.8362 => 4.9493, std.dev.: 0.0320) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.24% (44.5605 => 45.5574, std.dev.: 0.2763) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.23% (1.3882 => 1.4192, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/lists: 2.22% (7.3375 => 7.5001, std.dev.: 0.0149) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.99% (1.1365 => 1.1591, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/five11/five11: 1.52% (5.6030 => 5.6883, std.dev.: 0.0118) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.50% (2.4647 => 2.5016, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/power/power: 1.48% (1.2061 => 1.2239, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.45% (59.2638 => 60.1203, std.dev.: 0.2829) SingleSource/Benchmarks/Misc/ReedSolomon: 1.20% (8.5322 => 8.6347, std.dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.12% (3.5679 => 3.6078, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: 1.02% (1.0841 => 1.0952, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -32.25% (0.0338 => 0.0229, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: -21.15% (5.4641 => 4.3082, std.dev.: 0.0146) SingleSource/Benchmarks/McGill/chomp: -11.31% (1.1216 => 0.9948, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.13% (7.2130 => 6.4102, std.dev.: 0.2217) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.91% (1.0512 => 0.9365, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -8.61% (3.2926 => 3.0092, std.dev.: 0.0813) MultiSource/Benchmarks/mafft/pairlocalalign: -8.53% (63.1822 => 57.7904, std.dev.: 0.0391) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.48% (14.6451 => 13.4038, std.dev.: 0.1428) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.98% (4.7482 => 4.4166, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.36% (0.3269 => 0.3061, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.09% (3.7148 => 3.4885, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.94% (5.4972 => 5.1708, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.08% (5.1557 => 4.8938, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.34% (4.7449 => 4.5391, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.81% (6.0224 => 5.7927, std.dev.: 0.0174) MultiSource/Applications/lua/lua: -3.32% (29.8330 => 28.8438, std.dev.: 0.0457) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.03% (28.5821 => 27.7167, std.dev.: 0.0224) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.88% (2.8773 => 2.7944, std.dev.: 0.0250) MultiSource/Benchmarks/Olden/bisort/bisort: -2.73% (0.6636 => 0.6455, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.71% (2.6356 => 2.5641, std.dev.: 0.0022) MultiSource/Applications/aha/aha: -2.47% (3.3398 => 3.2574, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.42% (9.9065 => 9.6664, std.dev.: 0.0285) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.22% (3.2169 => 3.1454, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.03% (11.5316 => 11.2971, std.dev.: 0.0166) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.72% (0.6150 => 0.6044, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.58% (4.9994 => 4.9202, std.dev.: 0.0093) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.50% (2.3487 => 2.3134, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.27% (5.6343 => 5.5628, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.63% (1.0262 => 1.0634, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 56.91% (0.0123 => 0.0193, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.15% (0.0408 => 0.0429, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 4.33% (0.0254 => 0.0265, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.91% (0.0384 => 0.0369, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/casts: -22.11% (0.0190 => 0.0148, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/test1: -25.56% (0.0180 => 0.0134, std.dev.: 0.0041) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0007 => 0.0007, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.09% (0.1438 => 0.1468, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 8.04% (1.1329 => 1.2240, std.dev.: 0.0299) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.74% (0.4164 => 0.4195, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.07% (0.1369 => 0.1411, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.90% (0.0641 => 0.0616, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 4.62% (0.0195 => 0.0204, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.50% (0.0578 => 0.0552, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.15% (1.1437 => 1.1912, std.dev.: 0.0090) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0014 => 0.0007, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.22% (0.0627 => 0.0588, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.51% (0.8017 => 0.7816, std.dev.: 0.0105) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -41.94% (0.0062 => 0.0036, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 18 22:19:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 00:19:38 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121119061938.4E6892A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6026?compare_to=6024&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6026, Order: 168297, Start Time: 2012-11-19 04:46:25, End Time: 2012-11-19 06:20:01 To: 6024, Order: 168295, Start Time: 2012-11-19 02:49:52, End Time: 2012-11-19 04:23:35 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (178 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (858 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.53% (1.2648 => 1.2968, std.dev.: 0.0051) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 6.34% (0.3834 => 0.4077, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.36% (54.5751 => 56.4062, std.dev.: 0.1620) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1012, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: 2.39% (7.4937 => 7.6729, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/hash2: 2.15% (3.1932 => 3.2618, std.dev.: 0.0081) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.74% (0.1431 => 0.1306, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.88% (0.3821 => 0.3520, std.dev.: 0.0071) MultiSource/Benchmarks/PAQ8p/paq8p: -7.14% (2.4924 => 2.3145, std.dev.: 0.0113) MultiSource/Applications/sgefa/sgefa: -6.67% (0.3357 => 0.3133, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.59% (0.9542 => 0.8913, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.59% (0.3142 => 0.2935, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.20% (9.2283 => 8.6561, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.12% (0.1796 => 0.1686, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.10% (0.2428 => 0.2280, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -6.07% (0.1879 => 0.1765, std.dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: -6.06% (16.1920 => 15.2112, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.05% (0.6484 => 0.6092, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.04% (0.9852 => 0.9257, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/oourafft: -6.02% (0.2160 => 0.2030, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.02% (0.7198 => 0.6765, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -6.00% (0.9179 => 0.8628, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -6.00% (7.0961 => 6.6705, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.86% (0.2355 => 0.2217, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.85% (0.1761 => 0.1658, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.83% (1.0544 => 0.9929, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.77% (0.5805 => 0.5470, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.76% (1.3722 => 1.2931, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.74% (3.5339 => 3.3309, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.72% (0.5591 => 0.5271, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.72% (0.6052 => 0.5706, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.71% (0.5478 => 0.5165, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.70% (0.5863 => 0.5529, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.68% (0.6660 => 0.6282, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.67% (0.5857 => 0.5525, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.65% (4.0323 => 3.8044, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.65% (6.7716 => 6.3889, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.65% (0.5859 => 0.5528, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.65% (4.8161 => 4.5441, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.62% (0.6304 => 0.5950, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.61% (0.3406 => 0.3215, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.59% (0.5849 => 0.5522, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.59% (0.5925 => 0.5594, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.57% (1.6364 => 1.5453, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.56% (0.5705 => 0.5388, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.55% (0.6230 => 0.5884, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.55% (0.5456 => 0.5153, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.55% (0.3658 => 0.3455, std.dev.: 0.0069) MultiSource/Benchmarks/nbench/nbench: -5.54% (1.1530 => 1.0891, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.53% (0.5802 => 0.5481, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.53% (0.2695 => 0.2546) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.51% (0.6681 => 0.6313, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.49% (0.6297 => 0.5951, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.49% (0.6446 => 0.6092, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.49% (1.2300 => 1.1625, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.48% (4.8802 => 4.6128, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.47% (0.6194 => 0.5855, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.47% (1.4642 => 1.3841, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: -5.47% (1.1450 => 1.0824, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.46% (0.5570 => 0.5266, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: -5.45% (1.3864 => 1.3108, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.43% (0.6260 => 0.5920, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.42% (4.5069 => 4.2626, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.42% (0.6293 => 0.5952, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.40% (0.5941 => 0.5620, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.40% (0.5575 => 0.5274, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.40% (0.6189 => 0.5855, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.37% (0.6667 => 0.6309, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -5.36% (0.4515 => 0.4273, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.36% (0.6736 => 0.6375, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.36% (0.5581 => 0.5282, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.35% (0.3812 => 0.3608, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -5.34% (4.3330 => 4.1017, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.33% (1.2784 => 1.2102, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-3: -5.33% (0.3848 => 0.3643, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.32% (0.3831 => 0.3627, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -5.31% (0.3880 => 0.3674, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.30% (0.7919 => 0.7499, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.28% (0.3483 => 0.3299, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.27% (14.2083 => 13.4596, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -5.23% (0.4033 => 0.3822, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.22% (0.6033 => 0.5718, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: -5.22% (0.4176 => 0.3958, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.21% (0.6676 => 0.6328, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.21% (0.8521 => 0.8077, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -5.21% (0.3896 => 0.3693, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.20% (0.5688 => 0.5392, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -5.15% (17.1032 => 16.2223, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.14% (0.3891 => 0.3691, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.10% (8.0126 => 7.6037, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bh/bh: -5.06% (0.2985 => 0.2834, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: -5.06% (1.2515 => 1.1882, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: -5.06% (0.3025 => 0.2872, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.04% (0.3194 => 0.3033, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.04% (0.3255 => 0.3091, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.03% (0.5999 => 0.5697, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.01% (1.6474 => 1.5648, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.00% (0.2278 => 0.2164, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.00% (0.4916 => 0.4670, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.00% (1.2221 => 1.1610, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: -5.00% (0.3581 => 0.3402, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.95% (1.2210 => 1.1606, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.94% (0.3016 => 0.2867, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.93% (0.2999 => 0.2851, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -4.92% (1.3148 => 1.2501, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.91% (0.2548 => 0.2423, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -4.90% (3.5154 => 3.3432, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/except: -4.89% (0.3026 => 0.2878, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.84% (0.3884 => 0.3696, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -4.84% (15.5079 => 14.7574, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.81% (0.7339 => 0.6986, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.80% (0.5168 => 0.4920, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.79% (0.4151 => 0.3952, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -4.79% (0.3446 => 0.3281, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.78% (0.3931 => 0.3743, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -4.77% (15.2527 => 14.5254, std.dev.: 0.0128) SingleSource/UnitTests/ObjC/property: -4.76% (0.4199 => 0.3999, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: -4.75% (0.7447 => 0.7093, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.74% (2.1713 => 2.0683, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.74% (0.3837 => 0.3655, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -4.74% (0.2659 => 0.2533, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.74% (0.2385 => 0.2272, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.74% (0.3252 => 0.3098, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: -4.73% (0.4248 => 0.4047, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -4.73% (0.4861 => 0.4631, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -4.72% (0.2989 => 0.2848, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.69% (0.6395 => 0.6095, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.69% (0.6395 => 0.6095, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: -4.68% (0.3394 => 0.3235, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.67% (0.3319 => 0.3164, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -4.67% (0.2871 => 0.2737, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.67% (0.7524 => 0.7173, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.66% (0.7021 => 0.6694, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.63% (0.4280 => 0.4082, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -4.61% (0.3059 => 0.2918, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.60% (0.5329 => 0.5084, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.59% (22.4056 => 21.3774, std.dev.: 0.0092) MultiSource/Applications/lua/lua: -4.57% (4.0594 => 3.8737, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary2: -4.57% (0.3481 => 0.3322, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.55% (0.3057 => 0.2918, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.55% (0.3849 => 0.3674, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -4.52% (34.0927 => 32.5503, std.dev.: 0.0248) SingleSource/Benchmarks/Shootout-C++/wc: -4.49% (0.3205 => 0.3061, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.43% (0.2933 => 0.2803, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.42% (0.9557 => 0.9135, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.41% (0.2903 => 0.2775, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -4.39% (2.4021 => 2.2966, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -4.36% (5.0226 => 4.8034, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/random: -4.36% (0.2939 => 0.2811, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -4.35% (0.2849 => 0.2725, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -4.35% (2.1401 => 2.0471, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.26% (0.5567 => 0.5330, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.26% (0.5569 => 0.5332, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -4.25% (0.3621 => 0.3467, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: -4.23% (0.7779 => 0.7450, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: -4.19% (0.3867 => 0.3705, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.18% (0.4427 => 0.4242, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -4.17% (0.7982 => 0.7649, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.14% (2.2587 => 2.1653, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -4.12% (0.3788 => 0.3632, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.11% (0.6347 => 0.6086, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.09% (0.4813 => 0.4616, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.07% (0.4083 => 0.3917, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.06% (0.3323 => 0.3188, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.02% (0.9077 => 0.8712, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference-object: -4.01% (0.6441 => 0.6183, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -3.97% (0.3271 => 0.3141, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: -3.93% (0.6750 => 0.6485, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -3.85% (18.2933 => 17.5890, std.dev.: 0.0215) MultiSource/Applications/spiff/spiff: -3.85% (0.8418 => 0.8094, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.81% (0.3491 => 0.3358, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -3.69% (0.4524 => 0.4357, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -3.63% (1.5610 => 1.5043, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.31% (0.4321 => 0.4178, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.17% (5.4682 => 5.2950, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -2.49% (20.7746 => 20.2574, std.dev.: 0.0416) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7569, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1729, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.96% (1.7753 => 1.7050, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.87% (2.2633 => 2.1758, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4689, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 18 23:02:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 01:02:22 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121119070222.1E9672A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6027?compare_to=6021&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6027, Order: 168295, Start Time: 2012-11-19 03:41:27, End Time: 2012-11-19 07:02:45 To: 6021, Order: 168293, Start Time: 2012-11-18 23:32:45, End Time: 2012-11-19 02:53:37 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (173 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1090 (718 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.88% (124.4185 => 129.2444, std.dev.: 1.0713) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.60% (54.0463 => 54.9125, std.dev.: 0.0385) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.40% (0.0625 => 0.0890, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.49% (0.1063 => 0.1419, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.62% (0.4253 => 0.5385, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.61% (0.0714 => 0.0904, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.17% (0.2969 => 0.3746, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.13% (0.1106 => 0.1395, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 25.60% (1.5932 => 2.0011, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.30% (0.4139 => 0.5186, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.37% (0.5900 => 0.7338, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.07% (0.4994 => 0.6196, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.63% (0.0584 => 0.0722, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.37% (0.0475 => 0.0586, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.22% (0.5000 => 0.6161, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.85% (0.0547 => 0.0672, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.52% (0.0897 => 0.1099, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 22.37% (0.0599 => 0.0733, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.16% (0.1620 => 0.1979, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.14% (0.1021 => 0.1247, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.95% (0.1107 => 0.1350, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 21.83% (0.0481 => 0.0586, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.01% (0.0633 => 0.0766, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.76% (0.1103 => 0.1332, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.72% (0.0584 => 0.0705) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.70% (0.0541 => 0.0653, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.61% (0.0495 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 20.57% (0.0948 => 0.1143, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.56% (0.0642 => 0.0774, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.32% (0.3903 => 0.4696, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.24% (0.1003 => 0.1206, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 20.22% (0.0821 => 0.0987, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.20% (0.1604 => 0.1928, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.19% (0.0822 => 0.0988, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.14% (0.1549 => 0.1861, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 19.89% (0.1619 => 0.1941, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.49% (0.1462 => 0.1747, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 19.31% (0.0808 => 0.0964, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.18% (0.3890 => 0.4636, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 19.11% (0.0947 => 0.1128, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.67% (0.2014 => 0.2390, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.61% (1.3152 => 1.5599, std.dev.: 0.0029) MultiSource/Applications/spiff/spiff: 18.57% (0.4029 => 0.4777, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 18.47% (0.5826 => 0.6902, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.31% (0.2736 => 0.3237, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 18.31% (0.1218 => 0.1441, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 18.05% (0.0698 => 0.0824, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 18.00% (0.5889 => 0.6949, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 17.81% (0.1505 => 0.1773, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.67% (1.6211 => 1.9076, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 17.65% (0.5546 => 0.6525, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.65% (0.1088 => 0.1280, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.62% (0.2866 => 0.3371, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.52% (0.0605 => 0.0711) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.46% (3.5627 => 4.1849, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/gs/gs: 17.39% (1.8794 => 2.2062, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.33% (0.1968 => 0.2309, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 17.19% (0.9697 => 1.1364, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.08% (0.2875 => 0.3366, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 17.07% (1.0781 => 1.2621, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.97% (0.3271 => 0.3826, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.94% (0.4658 => 0.5447, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 16.75% (0.1421 => 0.1659, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.72% (0.1160 => 0.1354, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 16.62% (0.2780 => 0.3242, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 16.43% (0.1284 => 0.1495, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 16.40% (0.2811 => 0.3272, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.37% (0.5026 => 0.5849, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.37% (0.4361 => 0.5075, std.dev.: 0.0074) SingleSource/UnitTests/ObjC++/property-reference: 16.27% (0.7171 => 0.8338, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.26% (0.3930 => 0.4569, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.24% (4.4195 => 5.1371, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/random: 16.23% (0.2803 => 0.3258, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 16.22% (0.2725 => 0.3167, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 16.19% (0.2823 => 0.3280, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 16.18% (0.2750 => 0.3195, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.18% (0.2738 => 0.3181, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 16.18% (0.2714 => 0.3153, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 16.17% (4.2109 => 4.8917, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.06% (0.1090 => 0.1265, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 15.98% (0.3004 => 0.3484, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.98% (0.2729 => 0.3165, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.90% (0.2792 => 0.3236, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.89% (2.7292 => 3.1630, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/methcall: 15.89% (0.2813 => 0.3260, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 15.84% (0.9909 => 1.1479, std.dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 15.82% (0.2566 => 0.2972, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.68% (1.9694 => 2.2782, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wc: 15.67% (0.3096 => 0.3581, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.63% (0.2911 => 0.3366, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.48% (1.9966 => 2.3056, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.47% (2.0673 => 2.3872, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.43% (0.3195 => 0.3688, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 15.23% (0.2075 => 0.2391, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 15.12% (0.3267 => 0.3761, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 15.04% (0.3258 => 0.3748, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 14.95% (0.3317 => 0.3813, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 14.85% (0.3678 => 0.4224, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.78% (0.3362 => 0.3859, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.74% (0.3060 => 0.3511, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 14.57% (23.5202 => 26.9466, std.dev.: 0.0226) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.50% (0.3124 => 0.3577, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 14.42% (1.4269 => 1.6326, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/lists: 14.37% (0.3348 => 0.3829, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.29% (0.3282 => 0.3751, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 14.22% (0.3726 => 0.4256, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 14.22% (0.7875 => 0.8995, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 14.21% (0.3477 => 0.3971, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 14.14% (0.3465 => 0.3955, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 14.13% (0.4146 => 0.4732, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 14.12% (0.0758 => 0.0865, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 14.07% (0.3446 => 0.3931, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 14.07% (0.3496 => 0.3988, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 14.05% (0.3460 => 0.3946, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 14.01% (0.3469 => 0.3955, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.99% (0.3488 => 0.3976, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.99% (0.3625 => 0.4132) SingleSource/UnitTests/ObjC/trivial-interface: 13.92% (0.3442 => 0.3921, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 13.86% (2.1653 => 2.4655, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions: 13.83% (0.3643 => 0.4147, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.82% (0.3690 => 0.4200, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.79% (0.3981 => 0.4530, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.75% (0.3650 => 0.4152, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 13.67% (4.6177 => 5.2491, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 13.62% (0.4251 => 0.4830, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.58% (0.3845 => 0.4367, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/parameter-passing: 13.40% (0.3724 => 0.4223, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.28% (0.2040 => 0.2311, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 13.23% (0.2691 => 0.3047, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 13.14% (2.1013 => 2.3775, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 12.91% (0.5012 => 0.5659, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.36% (0.1383 => 0.1554, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 12.30% (5.5417 => 6.2235, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.11% (0.6435 => 0.7214, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 11.79% (0.6634 => 0.7416, std.dev.: 0.0065) MultiSource/Applications/lambda-0_1_3/lambda: 11.52% (0.3498 => 0.3901, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 11.49% (0.4847 => 0.5404, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.28% (0.1028 => 0.1144, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.93% (0.2068 => 0.2294, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.81% (0.2737 => 0.3033, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.77% (0.3084 => 0.3416, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 10.46% (0.2391 => 0.2641, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 10.44% (2.0346 => 2.2470, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: 10.25% (0.3336 => 0.3678, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.03% (0.2103 => 0.2314, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.86% (0.5361 => 0.5836, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.80% (4.6926 => 5.1056, std.dev.: 0.0052) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.45% (11.6398 => 12.6239, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.40% (0.5584 => 0.6053, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.27% (0.7426 => 0.8040, std.dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: 6.68% (11.9555 => 12.7540, std.dev.: 0.0188) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.64% (0.3792 => 0.3968, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 9.89% (0.2802 => 0.3079, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6106, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 5.47% (0.2122 => 0.2238, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6760, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-2: 4.97% (1.8057 => 1.8954, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1722, std.dev.: 0.1056) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6417, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1931, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.68% (3.1722 => 3.2255, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3059, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2881, std.dev.: 0.0050) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5825, std.dev.: 0.0375) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.75% (25.4195 => 16.5861, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary2: -9.83% (0.2402 => 0.2166, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9761, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8043, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8017, std.dev.: 0.0043) MultiSource/Applications/siod/siod: -3.04% (6.9842 => 6.7719, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.99% (0.6293 => 0.6105, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.26% (17.2379 => 16.8490, std.dev.: 0.0317) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8671, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5743, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4954, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.24% (105.3826 => 104.0790, std.dev.: 0.0426) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0458, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 18 23:22:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 01:22:04 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121119072204.BBF942A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6028?compare_to=6023&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6028, Order: 168297, Start Time: 2012-11-19 05:02:51, End Time: 2012-11-19 07:22:26 To: 6023, Order: 168295, Start Time: 2012-11-19 01:51:22, End Time: 2012-11-19 04:11:21 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 41 (141 on baseline) Performance Improvements: 12 (40 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1035 (706 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/aha/aha: 14.60% (0.1329 => 0.1523, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 14.18% (0.1890 => 0.2158, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/exptree: 13.73% (0.0932 => 0.1060, std.dev.: 0.0039) MultiSource/Applications/treecc/treecc: 13.15% (2.2933 => 2.5949, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/except: 12.92% (0.3159 => 0.3567, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/fibo: 12.56% (0.2986 => 0.3361, std.dev.: 0.0096) MultiSource/Applications/Burg/burg: 12.25% (1.3392 => 1.5033, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.17% (0.2244 => 0.2517, std.dev.: 0.0080) MultiSource/Applications/lemon/lemon: 12.11% (1.2046 => 1.3505, std.dev.: 0.0285) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.95% (0.5648 => 0.6323, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.04% (0.6376 => 0.7080, std.dev.: 0.0072) SingleSource/Benchmarks/LivermoreLoops/kernel24: 10.56% (0.1013 => 0.1120, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.50% (0.1723 => 0.1904, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 10.48% (1.3229 => 1.4616, std.dev.: 0.0121) SingleSource/Benchmarks/LivermoreLoops/kernel01: 10.17% (0.1023 => 0.1127, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.09% (1.5694 => 1.7278, std.dev.: 0.0164) SingleSource/Benchmarks/Linpack/linpack-pc: 9.94% (0.2897 => 0.3185, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.56% (0.2594 => 0.2842, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.98% (0.6462 => 0.7042, std.dev.: 0.0218) MultiSource/Benchmarks/nbench/nbench: 8.94% (1.3372 => 1.4568, std.dev.: 0.0377) MultiSource/Applications/oggenc/oggenc: 8.67% (6.6133 => 7.1866, std.dev.: 0.1045) SingleSource/Benchmarks/Stanford/Puzzle: 8.05% (0.1416 => 0.1530, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.01% (0.1910 => 0.2063, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/oourafft: 7.73% (0.3611 => 0.3890, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.64% (0.2225 => 0.2395, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.53% (2.3563 => 2.5337, std.dev.: 0.0072) MultiSource/Applications/sgefa/sgefa: 7.38% (0.3538 => 0.3799, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.22% (0.2673 => 0.2866, std.dev.: 0.0063) MultiSource/Applications/lua/lua: 7.01% (4.5035 => 4.8192, std.dev.: 0.0145) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.83% (0.9128 => 0.9751, std.dev.: 0.0215) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.53% (1.5787 => 1.6345, std.dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 1.02% (32.2850 => 32.6144, std.dev.: 0.0821) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: 30.70% (5.6758 => 7.4180, std.dev.: 0.1175) SingleSource/Benchmarks/Misc/flops: 28.58% (6.7489 => 8.6774, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.10% (1.4777 => 1.6713, std.dev.: 0.0360) SingleSource/Benchmarks/McGill/chomp: 8.41% (1.2109 => 1.3127, std.dev.: 0.0287) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 7.38% (5.6492 => 6.0659, std.dev.: 0.1246) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 3.81% (3.1350 => 3.2544, std.dev.: 0.0456) MultiSource/Applications/sqlite3/sqlite3: 2.96% (4.6006 => 4.7368, std.dev.: 0.0269) MultiSource/Applications/SIBsim4/SIBsim4: 1.87% (3.8673 => 3.9396, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.6626 => 12.7962, std.dev.: 0.0246) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: -11.70% (0.3838 => 0.3389, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/reversefile: -9.55% (0.4795 => 0.4337, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: -8.09% (0.4366 => 0.4013, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -8.02% (0.3415 => 0.3141, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/tsp/tsp: -7.55% (0.1536 => 0.1420, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: -4.83% (0.2091 => 0.1990, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -4.64% (0.3296 => 0.3143, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.03% (5.1130 => 4.9071, std.dev.: 0.0562) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: -10.58% (1.2342 => 1.1036, std.dev.: 0.0186) MultiSource/Benchmarks/Olden/bisort/bisort: -9.86% (0.9613 => 0.8665, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/hash2: -7.47% (3.6409 => 3.3690, std.dev.: 0.0898) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.11% (0.9739 => 0.9631, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 1.42% (0.1338 => 0.1357, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.30% (0.0421 => 0.0477, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.68% (0.0671 => 0.0653, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -0.00% (494.1967 => 494.1736, std.dev.: 0.1479) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.91% (4.3882 => 0.0477, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 43721.37% (1.1277 => 494.1736, std.dev.: 0.1479) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 196.77% (0.5229 => 1.5518, std.dev.: 0.0943) MultiSource/Applications/SPASS/SPASS: 22.71% (14.9895 => 18.3942, std.dev.: 0.0151) MultiSource/Applications/kimwitu++/kc: 51.04% (14.1553 => 21.3799, std.dev.: 0.1147) MultiSource/Benchmarks/MallocBench/gs/gs: 24.22% (4.1105 => 5.1060, std.dev.: 0.1398) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.36% (1.1048 => 1.5176, std.dev.: 0.0761) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 428.75% (7.1582 => 37.8493, std.dev.: 0.5086) SingleSource/Benchmarks/Misc-C++-EH/spirit: 75.69% (3.4629 => 6.0839, std.dev.: 0.4324) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.09% (0.6222 => 1.0334, std.dev.: 0.0697) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10478.61% (0.0720 => 7.6166, std.dev.: 0.2529) MultiSource/Applications/SIBsim4/SIBsim4: 3939500.00% (0.0001 => 3.9396, std.dev.: 0.0063) MultiSource/Applications/SPASS/SPASS: 13493400.00% (0.0001 => 13.4935, std.dev.: 0.6613) MultiSource/Applications/kimwitu++/kc: 52800.00% (0.0001 => 0.0529, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 65000.00% (0.0001 => 0.0651, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 606800.00% (0.0001 => 0.6069, std.dev.: 0.0141) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10094900.00% (0.0001 => 10.0950, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7417900.00% (0.0001 => 7.4180, std.dev.: 0.1175) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1765.43% (1.1194 => 20.8816, std.dev.: 0.3126) MultiSource/Applications/ClamAV/clamscan: 66.34% (22.1758 => 36.8874, std.dev.: 0.1856) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 65.43% (2.9384 => 4.8609, std.dev.: 0.2560) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.79% (7.0540 => 11.1302, std.dev.: 0.1545) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.35% (8.1363 => 12.2331, std.dev.: 0.0612) MultiSource/Applications/JM/lencod/lencod: 48.67% (21.9371 => 32.6144, std.dev.: 0.0821) MultiSource/Benchmarks/FreeBench/distray/distray: 45.93% (0.1056 => 0.1541, std.dev.: 0.0100) SingleSource/Benchmarks/Stanford/Oscar: 39.62% (0.0636 => 0.0888, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 39.32% (0.0730 => 0.1017, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: 38.97% (0.1432 => 0.1990, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 33.13% (0.0326 => 0.0434, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 32.32% (0.1151 => 0.1523, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/Towers: 31.85% (0.0471 => 0.0621, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: 31.74% (0.1566 => 0.2063, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 30.39% (0.1655 => 0.2158, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/exptree: 30.22% (0.0814 => 0.1060, std.dev.: 0.0039) SingleSource/UnitTests/vla: 30.14% (0.0355 => 0.0462, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ft/ft: 29.74% (0.1940 => 0.2517, std.dev.: 0.0080) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 29.36% (0.1584 => 0.2049, std.dev.: 0.0087) MultiSource/Applications/Burg/burg: 29.13% (1.1642 => 1.5033, std.dev.: 0.0080) SingleSource/Benchmarks/Stanford/RealMM: 29.04% (0.0396 => 0.0511, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 28.00% (2.0273 => 2.5949, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 27.87% (0.1044 => 0.1335, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Queens: 27.54% (0.0414 => 0.0528, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 27.13% (0.5569 => 0.7080, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/lists: 26.68% (0.0626 => 0.0793, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/queens: 26.55% (0.0403 => 0.0510, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.49% (0.0770 => 0.0974, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 26.48% (0.0491 => 0.0621, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 26.09% (0.1510 => 0.1904, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 25.96% (0.5020 => 0.6323, std.dev.: 0.0065) MultiSource/Applications/lemon/lemon: 25.96% (1.0722 => 1.3505, std.dev.: 0.0285) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 25.25% (1.3050 => 1.6345, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 25.15% (0.2107 => 0.2637, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 25.14% (0.2271 => 0.2842, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/dry: 25.00% (0.0456 => 0.0570, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.80% (0.0746 => 0.0931, std.dev.: 0.0037) MultiSource/Applications/oggenc/oggenc: 24.79% (5.7591 => 7.1866, std.dev.: 0.1045) MultiSource/Applications/lua/lua: 24.45% (3.8723 => 4.8192, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/except: 24.24% (0.2871 => 0.3567, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 23.93% (0.0443 => 0.0549, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 23.34% (0.2725 => 0.3361, std.dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/bc/bc: 23.23% (1.1861 => 1.4616, std.dev.: 0.0121) MultiSource/Benchmarks/McCat/08-main/main: 23.10% (0.2554 => 0.3144, std.dev.: 0.0206) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 23.05% (0.2603 => 0.3203, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 23.04% (1.1840 => 1.4568, std.dev.: 0.0377) MultiSource/Applications/sgefa/sgefa: 22.19% (0.3109 => 0.3799, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/neural/neural: 21.94% (0.1463 => 0.1784, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.85% (0.3441 => 0.4193, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 21.80% (1.4186 => 1.7278, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/whetstone: 21.06% (0.0660 => 0.0799, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 20.85% (0.1175 => 0.1420, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 20.78% (14.3668 => 17.3523, std.dev.: 0.1946) SingleSource/Benchmarks/Stanford/Puzzle: 20.66% (0.1268 => 0.1530, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 20.37% (0.8101 => 0.9751, std.dev.: 0.0215) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.71% (0.8172 => 0.9783, std.dev.: 0.0276) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.63% (0.2700 => 0.3230, std.dev.: 0.0186) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.56% (0.1125 => 0.1345, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.43% (0.1117 => 0.1334, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/moments: 19.15% (0.4048 => 0.4823, std.dev.: 0.0117) SingleSource/Benchmarks/McGill/misr: 19.12% (0.0633 => 0.0754, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/oourafft: 18.53% (0.3282 => 0.3890, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.41% (0.0842 => 0.0997, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.40% (0.2065 => 0.2445, std.dev.: 0.0133) SingleSource/UnitTests/ObjC/exceptions: 18.16% (0.3828 => 0.4523, std.dev.: 0.0127) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 17.94% (0.2430 => 0.2866, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.80% (0.0871 => 0.1026, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.19% (0.2793 => 0.3273, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/ReedSolomon: 17.13% (0.2049 => 0.2400, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 17.11% (17.1811 => 20.1210, std.dev.: 0.1479) MultiSource/Benchmarks/Olden/mst/mst: 16.85% (0.1163 => 0.1359, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/matrix: 16.38% (0.0818 => 0.0952, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.37% (0.0886 => 0.1031, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.13% (4.9449 => 5.7423, std.dev.: 0.1389) MultiSource/Applications/viterbi/viterbi: 15.82% (0.1555 => 0.1801, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.58% (0.0770 => 0.0890, std.dev.: 0.0040) MultiSource/Benchmarks/NPB-serial/is/is: 15.58% (0.0719 => 0.0831, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.45% (0.2758 => 0.3184, std.dev.: 0.0100) MultiSource/Benchmarks/mafft/pairlocalalign: 15.15% (9.4845 => 10.9218, std.dev.: 0.4293) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.07% (4.2646 => 4.9071, std.dev.: 0.0562) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.05% (2.2022 => 2.5337, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.99% (0.0834 => 0.0959, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.87% (0.1029 => 0.1182, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.82% (0.6450 => 0.7406, std.dev.: 0.0281) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.81% (0.1337 => 0.1535, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/trivial-interface: 14.68% (0.3473 => 0.3983, std.dev.: 0.0145) MultiSource/Benchmarks/Bullet/bullet: 14.54% (63.2438 => 72.4410, std.dev.: 0.0874) SingleSource/UnitTests/ObjC/property: 14.51% (0.3886 => 0.4450, std.dev.: 0.0195) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.51% (0.5981 => 0.6849, std.dev.: 0.0176) SingleSource/UnitTests/ObjC/exceptions-2: 14.50% (0.3497 => 0.4004, std.dev.: 0.0125) SingleSource/UnitTests/ObjC/exceptions-4: 14.48% (0.3543 => 0.4056, std.dev.: 0.0152) SingleSource/UnitTests/ObjC/exceptions-3: 14.33% (0.3516 => 0.4020, std.dev.: 0.0147) SingleSource/UnitTests/ObjC/synchronized: 14.24% (0.3561 => 0.4068, std.dev.: 0.0153) MultiSource/Benchmarks/McCat/18-imp/imp: 14.08% (0.3423 => 0.3905, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.08% (0.5860 => 0.6685, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 13.94% (3.3354 => 3.8004, std.dev.: 0.1174) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.21% (0.1143 => 0.1294, std.dev.: 0.0057) MultiSource/Applications/hbd/hbd: 12.88% (1.5603 => 1.7612, std.dev.: 0.0737) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.52% (5.0018 => 5.6279, std.dev.: 0.1632) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.28% (0.8067 => 0.9058, std.dev.: 0.0267) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.21% (0.3865 => 0.4337, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 12.19% (0.4299 => 0.4823, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/sieve: 11.38% (0.3603 => 0.4013, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 11.29% (10.3673 => 11.5374, std.dev.: 0.3049) MultiSource/Benchmarks/sim/sim: 10.22% (0.3387 => 0.3733, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.37% (0.2872 => 0.3141, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 9.25% (0.2877 => 0.3143, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.69% (0.2266 => 0.2395, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.52% (4.3953 => 11.0110, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout-C++/methcall: 147.65% (5.3999 => 13.3726, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/ft/ft: 30.18% (1.2838 => 1.6713, std.dev.: 0.0360) SingleSource/Benchmarks/Misc/oourafft: 17.72% (6.6465 => 7.8242, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.65% (1.1145 => 1.3001, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/lpbench: 15.72% (10.3460 => 11.9728, std.dev.: 0.3903) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.01% (0.2944 => 0.3327, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.60% (2.8904 => 3.2258, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 10.30% (1.1396 => 1.2570, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.30% (1.7254 => 1.8859, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 6.09% (1.2373 => 1.3127, std.dev.: 0.0287) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.94% (0.9540 => 1.0107, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.85% (4.2280 => 4.4752, std.dev.: 0.0065) MultiSource/Applications/lua/lua: 5.32% (26.0924 => 27.4808, std.dev.: 0.1856) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.76% (0.3463 => 0.3628, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.08% (11.6436 => 12.1185, std.dev.: 0.0143) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 3.86% (3.1334 => 3.2544, std.dev.: 0.0456) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.37% (3.6395 => 3.7621, std.dev.: 0.0452) SingleSource/Benchmarks/Dhrystone/dry: 2.42% (2.4116 => 2.4700, std.dev.: 0.0162) MultiSource/Applications/sgefa/sgefa: 2.33% (0.6223 => 0.6368, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 2.10% (3.1595 => 3.2257, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 2.09% (12.5348 => 12.7962, std.dev.: 0.0246) MultiSource/Benchmarks/PAQ8p/paq8p: 2.00% (85.0658 => 86.7711, std.dev.: 0.0702) MultiSource/Applications/sqlite3/sqlite3: 2.00% (4.6441 => 4.7368, std.dev.: 0.0269) MultiSource/Benchmarks/mafft/pairlocalalign: 1.48% (27.8444 => 28.2554, std.dev.: 0.0318) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.36% (6.5088 => 6.5972, std.dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0313 => 1.0440, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0498, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.15% (5.2139 => 5.2737, std.dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1682, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.69% (5.2763 => 1.2298, std.dev.: 0.0605) SingleSource/Benchmarks/Misc/salsa20: -75.58% (0.8651 => 0.2113, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/richards_benchmark: -44.64% (0.1622 => 0.0898, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.77% (5.3526 => 4.7226, std.dev.: 0.1605) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.73% (5.3855 => 4.7537, std.dev.: 0.1452) MultiSource/Applications/JM/ldecod/ldecod: -9.48% (10.4361 => 9.4470, std.dev.: 0.2403) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.98% (0.3987 => 0.2393, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.92% (0.0506 => 0.0304, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.28% (4.5009 => 2.7778, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: -33.53% (1.1492 => 0.7639, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -28.69% (10.7105 => 7.6374, std.dev.: 0.6858) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.13% (2.6546 => 2.0140, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -19.34% (0.2161 => 0.1743, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.78% (1.6925 => 1.4255, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2841, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.73% (32.5116 => 29.0233, std.dev.: 0.0242) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -10.52% (9.5636 => 8.5571, std.dev.: 0.1941) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4244, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.08% (1.6805 => 1.5616, std.dev.: 0.0377) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.93% (4.8142 => 4.4805, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.2416 => 3.0208, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5758, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496) SingleSource/Benchmarks/Misc/flops-5: -5.36% (1.5835 => 1.4986, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -4.28% (6.2999 => 6.0303, std.dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.47% (19.9488 => 19.2562, std.dev.: 0.2392) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.27% (0.9957 => 0.9631, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8920, std.dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.54% (0.4808 => 0.4686, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.94% (8.1563 => 7.9983, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6774, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -1.45% (10.2830 => 10.1339, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.62% (0.1485 => 0.1357, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.14% (0.2116 => 0.0653, std.dev.: 0.0014) Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 01:10:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 03:10:12 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121119091012.5772A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6029?compare_to=6026&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6029, Order: 168299, Start Time: 2012-11-19 07:33:08, End Time: 2012-11-19 09:10:30 To: 6026, Order: 168297, Start Time: 2012-11-19 04:46:25, End Time: 2012-11-19 06:20:01 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (6 on baseline) Performance Improvements: 0 (160 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1090 (876 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.87% (0.4077 => 0.4724, std.dev.: 0.0187) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.06% (8.3768 => 8.5494, std.dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 23.21% (0.3834 => 0.4724, std.dev.: 0.0187) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.31% (1.2783 => 1.3718, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.17% (2.0478 => 2.1127, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.55% (54.5751 => 55.9686, std.dev.: 0.4167) SingleSource/Benchmarks/Misc/salsa20: 2.33% (7.4937 => 7.6680, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/hash2: 2.18% (3.1932 => 3.2627, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.17% (0.3821 => 0.3547, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -7.15% (2.4924 => 2.3141, std.dev.: 0.0201) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.56% (0.9542 => 0.8916, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: -6.49% (0.3357 => 0.3139, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -6.17% (9.2283 => 8.6590, std.dev.: 0.1396) SingleSource/Benchmarks/Misc/oourafft: -6.16% (0.2160 => 0.2027, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.13% (0.9852 => 0.9248, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.12% (0.1796 => 0.1686, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.10% (0.2428 => 0.2280, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -6.02% (16.1920 => 15.2171, std.dev.: 0.0145) MultiSource/Applications/JM/ldecod/ldecod: -5.97% (7.0961 => 6.6725, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.86% (0.6484 => 0.6104, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.73% (1.0544 => 0.9940, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.72% (3.5339 => 3.3316, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.72% (0.5857 => 0.5522, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.72% (0.6052 => 0.5706, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.70% (1.3722 => 1.2940, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.69% (0.5591 => 0.5273, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.68% (0.5478 => 0.5167, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.64% (4.0323 => 3.8047, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/football/football: -5.64% (0.9179 => 0.8661, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.64% (0.7198 => 0.6792, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.64% (0.2695 => 0.2543, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -5.59% (0.1879 => 0.1774, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.58% (0.5859 => 0.5532, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.57% (6.7716 => 6.3941, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.55% (0.3658 => 0.3455, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -5.55% (0.3406 => 0.3217, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.54% (0.6230 => 0.5885, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.54% (0.6304 => 0.5955, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -5.52% (1.1530 => 1.0893, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.52% (0.6194 => 0.5852, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.52% (1.2300 => 1.1621, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.51% (0.5863 => 0.5540, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.50% (0.5705 => 0.5391, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.50% (0.5456 => 0.5156, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.50% (0.6260 => 0.5916, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.49% (4.8161 => 4.5517, std.dev.: 0.0098) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.45% (4.5069 => 4.2612, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.45% (0.5802 => 0.5486, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.44% (0.6667 => 0.6304, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.44% (1.6364 => 1.5474, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.42% (0.5941 => 0.5619, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.42% (0.5849 => 0.5532, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.42% (0.6297 => 0.5956, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -5.41% (1.1450 => 1.0830, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.41% (0.5581 => 0.5279, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.39% (0.5570 => 0.5270, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.38% (0.6446 => 0.6099, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.38% (0.5575 => 0.5275, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.37% (0.5925 => 0.5607, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.36% (4.8802 => 4.6184, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.36% (0.6189 => 0.5857, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/05-eks/eks: -5.34% (0.4515 => 0.4274, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -5.34% (0.3880 => 0.3673, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.30% (0.6676 => 0.6322, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: -5.30% (0.3848 => 0.3644, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/for-in: -5.28% (0.4033 => 0.3820, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.26% (0.6440 => 0.6101, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.26% (0.3896 => 0.3691, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/bh/bh: -5.23% (0.2985 => 0.2829, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: -5.22% (4.3330 => 4.1067, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.22% (1.4642 => 1.3878, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.21% (1.2784 => 1.2118, std.dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: -5.21% (17.1032 => 16.2129, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.20% (14.2083 => 13.4694, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/exceptions-2: -5.19% (0.3831 => 0.3632, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/trivial-interface: -5.19% (0.3812 => 0.3614, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.19% (0.3891 => 0.3689, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.11% (0.8521 => 0.8086, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.09% (0.6736 => 0.6393, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.05% (0.3483 => 0.3307, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.05% (0.2278 => 0.2163, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: -5.03% (1.2515 => 1.1885, std.dev.: 0.0096) SingleSource/UnitTests/ObjC/exceptions: -5.03% (0.4176 => 0.3966, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.01% (0.6681 => 0.6346, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -5.01% (0.3255 => 0.3092, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.01% (0.3016 => 0.2865, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.00% (1.3864 => 1.3171, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.00% (8.0126 => 7.6123, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: -4.98% (0.3194 => 0.3035, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.97% (0.6293 => 0.5980, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: -4.96% (1.3148 => 1.2496, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: -4.96% (0.3025 => 0.2875, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: -4.94% (0.3581 => 0.3404, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.94% (1.6474 => 1.5661, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.91% (0.2548 => 0.2423, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.91% (0.7339 => 0.6979, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.90% (0.4916 => 0.4675, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.89% (0.4151 => 0.3948, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.89% (1.2210 => 1.1613, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: -4.86% (0.4199 => 0.3995, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/except: -4.86% (0.3026 => 0.2879, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.83% (0.2999 => 0.2854, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: -4.83% (3.5154 => 3.3455, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.82% (0.7524 => 0.7161, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.82% (0.2385 => 0.2270, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: -4.82% (0.7447 => 0.7088, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.82% (0.5168 => 0.4919, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.81% (1.2221 => 1.1633, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: -4.80% (0.4248 => 0.4044, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.77% (0.3252 => 0.3097, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.75% (0.3323 => 0.3165, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.74% (0.3837 => 0.3655, std.dev.: 0.0065) MultiSource/Applications/SPASS/SPASS: -4.74% (15.5079 => 14.7732, std.dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.73% (0.3931 => 0.3745, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.71% (0.3884 => 0.3701, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.70% (0.5999 => 0.5717, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -4.67% (0.4861 => 0.4634, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.66% (0.7919 => 0.7550, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: -4.63% (0.2659 => 0.2536, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.61% (0.3057 => 0.2916, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: -4.60% (0.2871 => 0.2739, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.59% (0.7021 => 0.6699, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.56% (0.5329 => 0.5086, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.54% (0.2355 => 0.2248, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary2: -4.54% (0.3481 => 0.3323, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/parameter-passing: -4.53% (0.4280 => 0.4086, std.dev.: 0.0072) MultiSource/Applications/ClamAV/clamscan: -4.52% (15.2527 => 14.5631, std.dev.: 0.0081) MultiSource/Applications/lua/lua: -4.52% (4.0594 => 3.8760, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: -4.50% (0.3446 => 0.3291, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.47% (0.6395 => 0.6109, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.44% (0.2903 => 0.2774, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/wc: -4.43% (0.3205 => 0.3063, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.40% (0.2933 => 0.2804, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -4.33% (2.4021 => 2.2981, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hello: -4.32% (0.2849 => 0.2726, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -4.31% (0.3621 => 0.3465, std.dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: -4.29% (5.0226 => 4.8070, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.28% (0.9557 => 0.9148, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.27% (0.5569 => 0.5331, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -4.22% (0.3867 => 0.3704, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.17% (2.2587 => 2.1644, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.16% (0.3319 => 0.3181, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/random: -4.12% (0.2939 => 0.2818, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/sieve: -4.09% (0.3788 => 0.3633, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.07% (0.3271 => 0.3138, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.05% (0.8418 => 0.8077, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: -4.04% (2.1401 => 2.0537, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: -3.97% (0.6750 => 0.6482, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.94% (0.4083 => 0.3922, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: -3.88% (18.2933 => 17.5842, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/hash: -3.80% (0.4524 => 0.4352, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.78% (0.3491 => 0.3359, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.75% (0.9077 => 0.8737, std.dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: -3.67% (0.7982 => 0.7689, std.dev.: 0.0024) MultiSource/Applications/hbd/hbd: -3.47% (1.5610 => 1.5069, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.16% (5.4682 => 5.2952, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7572, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1729, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7070, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.76% (2.2633 => 2.1781, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.14% (1.3096 => 1.2685, std.dev.: 0.0145) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0245, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.64% (6.5735 => 6.4658, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 4.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 02:20:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 04:20:17 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121119102017.4CE7D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6030?compare_to=6025&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6030, Order: 168300, Start Time: 2012-11-19 08:48:16, End Time: 2012-11-19 10:20:41 To: 6025, Order: 168297, Start Time: 2012-11-19 04:19:51, End Time: 2012-11-19 05:49:41 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 2 (61 on baseline) Performance Improvements: 1 (23 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1051 (890 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.52% (5.4186 => 5.5009, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.45% (1.1313 => 1.1477, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.76% (1.4192 => 1.3801, std.dev.: 0.0121) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.38% (1.0634 => 1.0594, std.dev.: 0.0066) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -7.25% (0.0193 => 0.0179, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.47% (0.0429 => 0.0427, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 25.66% (0.0265 => 0.0333, std.dev.: 0.0090) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0314 => 0.0313, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 15.45% (0.0369 => 0.0426, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/casts: 37.84% (0.0148 => 0.0204, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/test1: 49.25% (0.0134 => 0.0200, std.dev.: 0.0073) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.36% (0.1468 => 0.1488, std.dev.: 0.0025) MultiSource/Applications/lemon/lemon: -6.83% (1.2240 => 1.1404, std.dev.: 0.0251) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.31% (0.4195 => 0.4182, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.64% (0.1411 => 0.1402, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 300.00% (0.0001 => 0.0004, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.32% (0.0616 => 0.0618, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 35.29% (0.0204 => 0.0276, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.98% (0.0552 => 0.0585, std.dev.: 0.0148) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.97% (1.1912 => 1.2028, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.35% (0.0031 => 0.0025, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -85.71% (0.0007 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.35% (0.0588 => 0.0643, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.49% (0.0267 => 0.0247, std.dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.27% (0.7816 => 0.7795, std.dev.: 0.0222) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 30.56% (0.0036 => 0.0047, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.03% (16.4461 => 17.6023, std.dev.: 0.0613) MultiSource/Applications/sqlite3/sqlite3: 2313.20% (0.6332 => 15.2804, std.dev.: 0.1532) MultiSource/Benchmarks/McCat/08-main/main: 45.93% (0.1831 => 0.2672, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.83% (0.1559 => 0.1437, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7109.32% (0.3123 => 22.5147, std.dev.: 0.5162) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.21% (0.2463 => 0.3675, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1545.01% (0.3344 => 5.5009, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.72% (0.2364 => 0.3232, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/bigfib: 4.26% (0.6010 => 0.6266, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: 0.70% (0.0429 => 0.0432, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.38% (0.3266 => 0.3409, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/strcat: 2.89% (0.1969 => 0.2026, std.dev.: 0.0536) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.36% (0.0224 => 0.0236, std.dev.: 0.0008) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0045) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0446, std.dev.: 0.0030) MultiSource/Applications/oggenc/oggenc: 6.77% (0.1462 => 0.1561, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4676, std.dev.: 0.0104) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0724, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4904, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5128, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5337, std.dev.: 0.2738) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3076, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1297, std.dev.: 0.0381) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3628, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4066, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0841, std.dev.: 0.0022) SingleSource/Regression/C/uint64_to_float: -23.81% (2.1832 => 1.6634, std.dev.: 0.0039) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0008, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.43% (0.0810 => 0.0935, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.74% (0.0848 => 0.0956, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.59% (0.1885 => 0.2047, std.dev.: 0.0055) MultiSource/Applications/Burg/burg: 5.78% (1.2222 => 1.2928, std.dev.: 0.0173) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.73% (0.2180 => 0.2305, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.57% (0.2279 => 0.2406, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 5.53% (0.7950 => 0.8390, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.25% (0.7473 => 0.7865, std.dev.: 0.0137) MultiSource/Applications/sgefa/sgefa: 4.80% (0.2999 => 0.3143, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.64% (0.6287 => 0.6579, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.05% (0.8148 => 0.8478, std.dev.: 0.0093) MultiSource/Applications/treecc/treecc: 3.97% (1.9948 => 2.0739, std.dev.: 0.0159) MultiSource/Applications/lua/lua: 3.84% (3.8189 => 3.9654, std.dev.: 0.0252) MultiSource/Applications/hbd/hbd: 3.52% (1.4269 => 1.4771, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.41% (2.1401 => 2.2130, std.dev.: 0.0165) MultiSource/Benchmarks/nbench/nbench: 3.38% (1.1271 => 1.1652, std.dev.: 0.0106) MultiSource/Applications/SPASS/SPASS: 3.27% (14.2605 => 14.7270, std.dev.: 0.0790) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.16% (0.4559 => 0.4703, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.08% (1.3279 => 1.3688, std.dev.: 0.0149) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.07% (6.6074 => 6.8100, std.dev.: 0.0291) MultiSource/Applications/siod/siod: 3.03% (2.2184 => 2.2857, std.dev.: 0.0157) MultiSource/Applications/SIBsim4/SIBsim4: 2.88% (1.2568 => 1.2930, std.dev.: 0.0073) MultiSource/Applications/ClamAV/clamscan: 2.83% (14.7684 => 15.1867, std.dev.: 0.0707) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.79% (0.6227 => 0.6401, std.dev.: 0.0041) MultiSource/Applications/minisat/minisat: 2.75% (0.6834 => 0.7022, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.75% (1.1170 => 1.1477, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.71% (1.5315 => 1.5730, std.dev.: 0.0055) MultiSource/Applications/d/make_dparser: 2.60% (3.2366 => 3.3207, std.dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.27% (0.5191 => 0.5309, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 2.26% (0.8768 => 0.8966, std.dev.: 0.0056) MultiSource/Applications/JM/lencod/lencod: 2.22% (15.3280 => 15.6681, std.dev.: 0.0378) MultiSource/Applications/JM/ldecod/ldecod: 2.22% (6.7320 => 6.8812, std.dev.: 0.0374) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.13% (0.6586 => 0.6726, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.77% (8.6476 => 8.8006, std.dev.: 0.0494) MultiSource/Applications/lemon/lemon: 1.76% (1.0945 => 1.1138, std.dev.: 0.0034) MultiSource/Applications/lambda-0_1_3/lambda: 1.55% (0.7557 => 0.7674, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.37% (0.8995 => 0.9118, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 136.68% (0.0199 => 0.0471, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/pi: 57.09% (1.5795 => 2.4812, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.31% (2.9753 => 3.4606, std.dev.: 0.0293) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.91% (0.7597 => 0.8806, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.51% (2.7995 => 3.2056, std.dev.: 0.1320) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.43% (5.0261 => 5.6006, std.dev.: 0.1717) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.76% (1.1857 => 1.2777, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/queens: 7.49% (1.7056 => 1.8333, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.59% (4.7794 => 5.0943, std.dev.: 0.0376) SingleSource/Benchmarks/Misc/richards_benchmark: 6.31% (1.3037 => 1.3859, std.dev.: 0.0035) MultiSource/Applications/SIBsim4/SIBsim4: 6.17% (3.1873 => 3.3838, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.82% (4.5327 => 4.7967, std.dev.: 0.0098) MultiSource/Applications/lambda-0_1_3/lambda: 4.52% (7.4933 => 7.8320, std.dev.: 0.0354) MultiSource/Applications/hexxagon/hexxagon: 3.80% (14.0064 => 14.5380, std.dev.: 0.0317) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.79% (0.3587 => 0.3723, std.dev.: 0.0041) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.68% (1.2337 => 1.2791, std.dev.: 0.0019) MultiSource/Applications/siod/siod: 2.96% (3.6643 => 3.7728, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.79% (11.5690 => 11.8916, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.50% (4.3552 => 4.4641, std.dev.: 0.0265) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.48% (8.2783 => 8.4838, std.dev.: 0.0180) SingleSource/Benchmarks/Misc/ReedSolomon: 1.36% (8.5322 => 8.6481, std.dev.: 0.0252) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.28% (2.4647 => 2.4962, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.08% (3.5679 => 3.6063, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/power/power: 1.00% (1.2061 => 1.2182, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.12% (5.4641 => 4.3100, std.dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.84% (1.0512 => 0.9372, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -10.39% (1.1216 => 1.0051, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.78% (14.6451 => 13.3596, std.dev.: 0.2099) MultiSource/Benchmarks/mafft/pairlocalalign: -8.52% (63.1822 => 57.8010, std.dev.: 0.5019) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.96% (4.7482 => 4.4176, std.dev.: 0.0320) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.76% (0.3269 => 0.3048, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.91% (3.7148 => 3.4951, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.88% (5.4972 => 5.1738, std.dev.: 0.0737) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.38% (4.7449 => 4.5373, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.84% (6.0224 => 5.7909, std.dev.: 0.0102) MultiSource/Applications/lua/lua: -3.39% (29.8330 => 28.8205, std.dev.: 0.0466) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.03% (0.5807 => 0.5631, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.98% (28.5821 => 27.7290, std.dev.: 0.0281) MultiSource/Applications/aha/aha: -2.66% (3.3398 => 3.2511, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: -2.58% (0.8789 => 0.8562, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/mason/mason: -2.55% (0.5415 => 0.5277, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash2: -2.29% (3.4237 => 3.3452, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.16% (2.4490 => 2.3962, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.09% (9.9065 => 9.6999, std.dev.: 0.0467) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.00% (11.5316 => 11.3005, std.dev.: 0.0438) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.76% (3.2169 => 3.1604, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.14% (5.6343 => 5.5701, std.dev.: 0.0111) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.24% (1.0262 => 1.0594, std.dev.: 0.0066) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 45.53% (0.0123 => 0.0179, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0090) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.94% (0.0384 => 0.0426, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/test1: 11.11% (0.0180 => 0.0200, std.dev.: 0.0073) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 3.48% (0.1438 => 0.1488, std.dev.: 0.0025) MultiSource/Applications/lemon/lemon: 0.66% (1.1329 => 1.1404, std.dev.: 0.0251) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.43% (0.4164 => 0.4182, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.41% (0.1369 => 0.1402, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -50.00% (0.0008 => 0.0004, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.59% (0.0641 => 0.0618, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.54% (0.0195 => 0.0276, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.21% (0.0578 => 0.0585, std.dev.: 0.0148) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.17% (1.1437 => 1.2028, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2400.00% (0.0001 => 0.0025, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.55% (0.0627 => 0.0643, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 37.22% (0.0180 => 0.0247, std.dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.77% (0.8017 => 0.7795, std.dev.: 0.0222) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -24.19% (0.0062 => 0.0047, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 02:49:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 04:49:39 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121119104939.822672A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6031?compare_to=6028&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6031, Order: 168300, Start Time: 2012-11-19 08:29:21, End Time: 2012-11-19 10:50:00 To: 6028, Order: 168297, Start Time: 2012-11-19 05:02:51, End Time: 2012-11-19 07:22:26 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 54 (188 on baseline) Performance Improvements: 3 (39 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1031 (660 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 16.29% (0.1418 => 0.1649, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.03% (0.5818 => 0.6576, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/sumcol: 12.62% (0.3178 => 0.3579, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.29% (1.0334 => 1.1604, std.dev.: 0.0187) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.28% (0.3021 => 0.3392, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.22% (0.5943 => 0.6669, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/lists: 12.21% (0.3807 => 0.4272, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: 12.10% (0.3710 => 0.4159, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/strcat: 12.03% (0.3117 => 0.3492, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.74% (0.5809 => 0.6491, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.66% (0.3783 => 0.4224, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 11.66% (0.3552 => 0.3966, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hello: 11.58% (0.2970 => 0.3314, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.42% (0.4712 => 0.5250, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/wc: 11.38% (0.3349 => 0.3730, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 11.27% (0.3194 => 0.3554, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.17% (1.7503 => 1.9458, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.05% (0.7584 => 0.8422, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary3: 10.94% (0.3601 => 0.3995, std.dev.: 0.0099) SingleSource/Benchmarks/LivermoreLoops/kernel17: 10.61% (0.1018 => 0.1126, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/football/football: 10.52% (0.9889 => 1.0929, std.dev.: 0.0266) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.46% (0.1042 => 0.1151, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.44% (1.6016 => 1.7528, std.dev.: 0.0270) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.36% (0.7885 => 0.8623, std.dev.: 0.0259) SingleSource/UnitTests/ObjC++/property-reference: 9.26% (0.8100 => 0.8850, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/property: 8.85% (0.4450 => 0.4844, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/synchronized: 8.58% (0.4068 => 0.4417, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.51% (0.2104 => 0.2283, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.14% (0.1535 => 0.1660, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/trivial-interface: 7.78% (0.3983 => 0.4293, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.76% (0.9058 => 0.9761, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.2445 => 0.2632, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference-object: 7.56% (0.6703 => 0.7210, std.dev.: 0.0052) SingleSource/Benchmarks/LivermoreLoops/kernel18: 7.50% (0.1493 => 0.1605, std.dev.: 0.0043) SingleSource/UnitTests/ObjC++/Hello: 7.29% (0.6588 => 0.7068, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.19% (0.3354 => 0.3595, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.03% (0.7406 => 0.7927, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.80% (4.7537 => 5.0770, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.54% (0.5948 => 0.6337, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.31% (0.6849 => 0.7281, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.16% (0.3893 => 0.4133, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.97% (0.5059 => 0.5361, std.dev.: 0.0065) MultiSource/Applications/hbd/hbd: 5.79% (1.7612 => 1.8632, std.dev.: 0.0388) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.99% (1.7278 => 1.7622, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.69% (0.9751 => 0.9916, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 68.84% (4.3580 => 7.3580, std.dev.: 0.6521) SingleSource/Benchmarks/Shootout-C++/ary: 19.66% (0.0763 => 0.0913, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 15.40% (4.1296 => 4.7654, std.dev.: 0.1760) SingleSource/Benchmarks/Shootout/hash: 12.35% (4.9317 => 5.5409, std.dev.: 0.0239) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.91% (3.9354 => 4.3255, std.dev.: 0.0638) SingleSource/Benchmarks/Misc/ffbench: 7.74% (0.9938 => 1.0707, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ackermann: 1.85% (1.7532 => 1.7857, std.dev.: 0.0089) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.66% (2.3117 => 2.3501, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.37% (19.2562 => 19.5198, std.dev.: 0.0778) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Ptrdist/bc/bc: -9.74% (1.4616 => 1.3192, std.dev.: 0.0406) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -9.43% (1.6345 => 1.4803, std.dev.: 0.0484) SingleSource/Benchmarks/Shootout-C++/moments: -7.07% (0.4823 => 0.4482, std.dev.: 0.0114) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -1.40% (0.1357 => 0.1338, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -9.85% (0.0477 => 0.0430, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.83% (0.0653 => 0.0678, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -0.10% (494.1736 => 493.6585, std.dev.: 0.3523) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.02% (4.3882 => 0.0430, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: 43675.69% (1.1277 => 493.6585, std.dev.: 0.3523) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.89% (0.5229 => 1.5420, std.dev.: 0.0845) MultiSource/Applications/SPASS/SPASS: 22.22% (14.9895 => 18.3205, std.dev.: 0.0734) MultiSource/Applications/kimwitu++/kc: 49.96% (14.1553 => 21.2267, std.dev.: 0.1758) MultiSource/Benchmarks/MallocBench/gs/gs: 17.24% (4.1105 => 4.8190, std.dev.: 0.1261) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.88% (1.1048 => 1.5123, std.dev.: 0.0187) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 425.84% (7.1582 => 37.6404, std.dev.: 0.6732) SingleSource/Benchmarks/Misc-C++-EH/spirit: 80.28% (3.4629 => 6.2428, std.dev.: 0.3371) SingleSource/Benchmarks/Misc-C++/stepanov_container: 86.50% (0.6222 => 1.1604, std.dev.: 0.0187) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10439.17% (0.0720 => 7.5882, std.dev.: 0.3460) MultiSource/Applications/SIBsim4/SIBsim4: 3859100.00% (0.0001 => 3.8592, std.dev.: 0.0365) MultiSource/Applications/SPASS/SPASS: 13809600.00% (0.0001 => 13.8097, std.dev.: 1.3244) MultiSource/Applications/kimwitu++/kc: 51900.00% (0.0001 => 0.0520, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 65200.00% (0.0001 => 0.0653, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 577100.00% (0.0001 => 0.5772, std.dev.: 0.0272) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10097400.00% (0.0001 => 10.0975, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7421000.00% (0.0001 => 7.4211, std.dev.: 0.1337) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1759.17% (1.1194 => 20.8115, std.dev.: 0.2085) MultiSource/Applications/ClamAV/clamscan: 69.60% (22.1758 => 37.6108, std.dev.: 0.4007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.09% (2.9384 => 4.6158, std.dev.: 0.3502) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.21% (7.0540 => 10.8777, std.dev.: 0.1919) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.22% (8.1363 => 12.2221, std.dev.: 0.0816) MultiSource/Applications/JM/lencod/lencod: 45.90% (21.9371 => 32.0069, std.dev.: 0.2443) MultiSource/Benchmarks/FreeBench/distray/distray: 45.64% (0.1056 => 0.1538, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 38.90% (0.0730 => 0.1014, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Oscar: 38.52% (0.0636 => 0.0881, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 38.20% (0.1432 => 0.1979, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 33.41% (0.1236 => 0.1649, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/Towers: 32.70% (0.0471 => 0.0625, std.dev.: 0.0012) SingleSource/UnitTests/vla: 30.14% (0.0355 => 0.0462, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 29.91% (0.1655 => 0.2150, std.dev.: 0.0077) SingleSource/Benchmarks/Stanford/Treesort: 29.44% (0.0411 => 0.0532, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.81% (0.5105 => 0.6576, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 27.92% (0.0437 => 0.0559, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 27.76% (0.0814 => 0.1040, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wordfreq: 27.73% (0.3307 => 0.4224, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 27.46% (0.2065 => 0.2632, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/hash: 27.42% (0.0485 => 0.0618, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/RealMM: 27.27% (0.0396 => 0.0504, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 27.07% (0.5020 => 0.6379, std.dev.: 0.0169) MultiSource/Benchmarks/Olden/tsp/tsp: 26.47% (0.1175 => 0.1486, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 26.23% (1.5415 => 1.9458, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 26.17% (0.6675 => 0.8422, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 26.16% (0.3441 => 0.4341, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 25.96% (0.0443 => 0.0558, std.dev.: 0.0002) MultiSource/Benchmarks/llubenchmark/llu: 25.76% (0.0462 => 0.0581, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 25.46% (0.0491 => 0.0616, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.05% (0.0479 => 0.0599, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 24.91% (0.4203 => 0.5250, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 24.89% (0.1117 => 0.1395, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 24.87% (0.2758 => 0.3444, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/lists: 24.84% (0.3422 => 0.4272, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/misr: 24.80% (0.0633 => 0.0790, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/property: 24.65% (0.3886 => 0.4844, std.dev.: 0.0028) MultiSource/Benchmarks/NPB-serial/is/is: 24.62% (0.0719 => 0.0896, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.53% (0.0746 => 0.0929, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.22% (1.4186 => 1.7622, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.16% (0.1337 => 0.1660, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/synchronized: 24.04% (0.3561 => 0.4417, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/lpbench: 23.90% (0.0929 => 0.1151, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.86% (0.0834 => 0.1033, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 23.80% (0.2891 => 0.3579, std.dev.: 0.0101) SingleSource/UnitTests/ObjC/trivial-interface: 23.61% (0.3473 => 0.4293, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/strcat: 23.35% (0.2831 => 0.3492, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary2: 23.08% (0.3379 => 0.4159, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/ackermann: 23.08% (0.2756 => 0.3392, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/08-main/main: 22.94% (0.2554 => 0.3140, std.dev.: 0.0187) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 22.90% (0.6450 => 0.7927, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ary: 22.71% (0.3232 => 0.3966, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: 22.51% (0.8921 => 1.0929, std.dev.: 0.0266) SingleSource/Benchmarks/Shootout-C++/except: 22.47% (0.2871 => 0.3516, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 22.40% (0.8101 => 0.9916, std.dev.: 0.0062) SingleSource/Regression/C++/ofstream_ctor: 22.34% (0.2905 => 0.3554, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/wc: 22.21% (0.3052 => 0.3730, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 22.11% (0.2714 => 0.3314, std.dev.: 0.0046) MultiSource/Applications/lemon/lemon: 22.10% (1.0722 => 1.3092, std.dev.: 0.0308) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.98% (0.2430 => 0.2964, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.93% (0.0871 => 0.1062, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 21.74% (0.5981 => 0.7281, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/ary3: 21.69% (0.3283 => 0.3995, std.dev.: 0.0099) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.65% (0.1566 => 0.1905, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout/lists: 21.57% (0.0626 => 0.0761, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 21.55% (0.0798 => 0.0970, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 21.00% (0.8067 => 0.9761, std.dev.: 0.0149) SingleSource/Benchmarks/Stanford/Puzzle: 20.90% (0.1268 => 0.1533, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.83% (0.1584 => 0.1914, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 20.83% (0.1695 => 0.2048, std.dev.: 0.0114) SingleSource/UnitTests/ObjC++/property-reference: 20.80% (0.7326 => 0.8850, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 20.71% (14.3668 => 17.3425, std.dev.: 0.0670) SingleSource/Benchmarks/Shootout-C++/fibo: 20.70% (0.2725 => 0.3289, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 20.67% (0.1892 => 0.2283, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.67% (0.0842 => 0.1016, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 20.60% (0.3427 => 0.4133, std.dev.: 0.0030) MultiSource/Applications/lua/lua: 20.58% (3.8723 => 4.6691, std.dev.: 0.0791) MultiSource/Applications/viterbi/viterbi: 20.19% (0.1555 => 0.1869, std.dev.: 0.0058) SingleSource/UnitTests/ObjC++/property-reference-object: 19.57% (0.6030 => 0.7210, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/oourafft: 19.50% (0.3282 => 0.3922, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 19.41% (1.5603 => 1.8632, std.dev.: 0.0388) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.33% (0.2700 => 0.3222, std.dev.: 0.0107) SingleSource/UnitTests/ObjC++/Hello: 19.29% (0.5925 => 0.7068, std.dev.: 0.0025) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.11% (0.1125 => 0.1340, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.35% (4.2646 => 5.0473, std.dev.: 0.1412) SingleSource/Benchmarks/Misc/whetstone: 18.18% (0.0660 => 0.0780, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 17.97% (0.0640 => 0.0755, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.58% (0.5569 => 0.6548, std.dev.: 0.0283) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.19% (0.8172 => 0.9577, std.dev.: 0.0297) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.16% (4.9449 => 5.7935, std.dev.: 0.1534) MultiSource/Benchmarks/Olden/mst/mst: 16.68% (0.1163 => 0.1357, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 16.67% (0.0672 => 0.0784, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 16.42% (0.5860 => 0.6822, std.dev.: 0.0142) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.26% (0.0953 => 0.1108, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.20% (0.0648 => 0.0753, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/health/health: 16.17% (0.1268 => 0.1473, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.14% (0.0886 => 0.1029, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/matrix: 16.01% (0.0818 => 0.0949, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 15.77% (17.1811 => 19.8899, std.dev.: 0.3269) SingleSource/Benchmarks/Misc/ffbench: 15.74% (0.0705 => 0.0816, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 15.47% (9.4845 => 10.9517, std.dev.: 0.1692) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.19% (0.0770 => 0.0887, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 15.12% (3.8922 => 4.4806, std.dev.: 0.2062) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.00% (0.3121 => 0.3589, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 14.79% (63.2438 => 72.5996, std.dev.: 0.0758) MultiSource/Applications/spiff/spiff: 14.65% (0.7835 => 0.8983, std.dev.: 0.0383) MultiSource/Applications/oggenc/oggenc: 14.65% (5.7591 => 6.6029, std.dev.: 0.3000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.58% (0.1029 => 0.1179, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.50% (0.1062 => 0.1216, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.39% (2.0665 => 2.3639, std.dev.: 0.0878) MultiSource/Benchmarks/nbench/nbench: 14.37% (1.1840 => 1.3541, std.dev.: 0.0655) SingleSource/UnitTests/ObjC/parameter-passing: 14.36% (0.3927 => 0.4491, std.dev.: 0.0214) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.15% (0.1032 => 0.1178, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 14.01% (0.2049 => 0.2336, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.97% (0.3543 => 0.4038, std.dev.: 0.0186) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.95% (2.2022 => 2.5094, std.dev.: 0.0186) SingleSource/UnitTests/ObjC/exceptions-2: 13.87% (0.3497 => 0.3982, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.86% (0.3543 => 0.4034, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.75% (0.9765 => 1.1108, std.dev.: 0.0129) SingleSource/UnitTests/ObjC/exceptions-3: 13.74% (0.3516 => 0.3999, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.68% (5.0018 => 5.6862, std.dev.: 0.1038) SingleSource/UnitTests/ObjC/for-in: 13.48% (0.3694 => 0.4192, std.dev.: 0.0188) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.43% (1.3050 => 1.4803, std.dev.: 0.0484) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.30% (0.1143 => 0.1295, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 13.16% (0.3177 => 0.3595, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/05-eks/eks: 12.98% (0.4299 => 0.4857, std.dev.: 0.0211) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 12.68% (2.2024 => 2.4817, std.dev.: 0.0223) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.54% (0.1906 => 0.2145, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.01% (0.3865 => 0.4329, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 11.66% (0.4289 => 0.4789, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 11.39% (0.4620 => 0.5146, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.22% (1.1861 => 1.3192, std.dev.: 0.0406) SingleSource/Benchmarks/Shootout-C++/sieve: 10.99% (0.3603 => 0.3999, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/moments: 10.72% (0.4048 => 0.4482, std.dev.: 0.0114) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.68% (0.4636 => 0.5131, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 10.45% (0.3684 => 0.4069, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 10.14% (0.1144 => 0.1260, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.88% (0.4879 => 0.5361, std.dev.: 0.0065) MultiSource/Benchmarks/PAQ8p/paq8p: 9.31% (10.3673 => 11.3326, std.dev.: 0.2848) SingleSource/Benchmarks/Shootout-C++/matrix: 9.30% (0.3098 => 0.3386, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 8.78% (0.2802 => 0.3048, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.61% (0.3935 => 0.4195, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.00% (0.3817 => 0.4046, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.01% (7.9617 => 8.1217, std.dev.: 0.0557) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 151.34% (4.3953 => 11.0471, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 147.97% (5.3999 => 13.3903, std.dev.: 0.0006) MultiSource/Benchmarks/llubenchmark/llu: 94.75% (3.7781 => 7.3580, std.dev.: 0.6521) SingleSource/Benchmarks/Shootout-C++/ary3: 28.03% (3.7221 => 4.7654, std.dev.: 0.1760) SingleSource/Benchmarks/Shootout-C++/ary: 20.77% (0.0756 => 0.0913, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 18.57% (9.1159 => 10.8088, std.dev.: 0.6211) SingleSource/Benchmarks/Misc/oourafft: 17.68% (6.6465 => 7.8214, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.65% (1.1145 => 1.3001, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.98% (13.4384 => 15.5860, std.dev.: 0.8334) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.01% (0.2944 => 0.3327, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/hash: 12.88% (4.9088 => 5.5409, std.dev.: 0.0239) SingleSource/Benchmarks/Misc/ffbench: 12.65% (0.9505 => 1.0707, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/heapsort: 12.26% (3.8532 => 4.3255, std.dev.: 0.0638) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.61% (2.8904 => 3.2260, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 10.24% (1.1396 => 1.2563, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.30% (1.7254 => 1.8858, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: 7.30% (3.8526 => 4.1339, std.dev.: 0.0791) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3690, std.dev.: 0.0229) SingleSource/Benchmarks/McGill/chomp: 6.26% (1.2373 => 1.3147, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout/strcat: 6.00% (0.1899 => 0.2013, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.96% (0.9540 => 1.0109, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.57% (4.2280 => 4.4636, std.dev.: 0.0087) SingleSource/Regression/C/uint64_to_float: 5.10% (0.5413 => 0.5689, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 4.75% (26.0924 => 27.3324, std.dev.: 0.3331) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.23% (1.7133 => 1.7857, std.dev.: 0.0089) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.6436 => 12.1345, std.dev.: 0.0082) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.61% (3.6395 => 3.7346, std.dev.: 0.0329) SingleSource/Benchmarks/Dhrystone/dry: 2.38% (2.4116 => 2.4691, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 2.04% (3.1595 => 3.2240, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: 1.99% (0.7455 => 0.7603, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 1.87% (85.0658 => 86.6594, std.dev.: 0.0696) SingleSource/Benchmarks/Shootout/ary3: 1.78% (3.6994 => 3.7653, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 1.72% (27.8444 => 28.3238, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists: 1.65% (12.5348 => 12.7419, std.dev.: 0.0275) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.58% (2.3135 => 2.3501, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.49% (6.5088 => 6.6056, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/sieve: 1.31% (5.2139 => 5.2820, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0313 => 1.0441, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0500, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.12% (1.9577 => 1.9797, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1678, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.56% (5.2763 => 1.2894, std.dev.: 0.0386) SingleSource/Benchmarks/Misc/salsa20: -75.46% (0.8651 => 0.2123, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/richards_benchmark: -44.64% (0.1622 => 0.0898, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.01% (5.3526 => 4.7096, std.dev.: 0.1285) MultiSource/Applications/JM/ldecod/ldecod: -10.22% (10.4361 => 9.3695, std.dev.: 0.3776) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.73% (5.3855 => 5.0770, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.06% (0.3987 => 0.2390, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.72% (0.0506 => 0.0305, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.25% (4.5009 => 2.7794, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: -33.54% (1.1492 => 0.7638, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.14% (2.6546 => 2.0139, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -22.83% (10.7105 => 8.2653, std.dev.: 0.3323) MultiSource/Benchmarks/FreeBench/mason/mason: -19.25% (0.2161 => 0.1745, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4219, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2842, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.77% (32.5116 => 29.0103, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -10.52% (9.5636 => 8.5576, std.dev.: 0.2030) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4245, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.94% (4.8142 => 4.4800, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.2416 => 3.0210, std.dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.60% (2.7294 => 2.5766, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.96% (1.5835 => 1.5049, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.77% (0.2497 => 0.2378, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -4.14% (6.2999 => 6.0392, std.dev.: 0.0062) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8915, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.71% (0.9957 => 0.9687, std.dev.: 0.0063) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.25% (0.4808 => 0.4700, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.15% (19.9488 => 19.5198, std.dev.: 0.0778) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.81% (8.1563 => 8.0085, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6775, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -1.47% (10.2830 => 10.1314, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.96% (0.2116 => 0.0678, std.dev.: 0.0002) Report Time: 3.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 03:07:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 05:07:27 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121119110727.5A8A42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6032?compare_to=6029&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6032, Order: 168302, Start Time: 2012-11-19 09:33:51, End Time: 2012-11-19 11:07:31 To: 6029, Order: 168299, Start Time: 2012-11-19 07:33:08, End Time: 2012-11-19 09:10:30 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (5 on baseline) Performance Improvements: 0 (181 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1090 (856 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.86% (79.5107 => 80.9868, std.dev.: 0.1932) SingleSource/Benchmarks/Shootout/lists: 1.01% (6.1601 => 6.2222, std.dev.: 0.0165) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.16% (2.0478 => 2.1125, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/salsa20: 2.59% (7.4937 => 7.6879, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 2.05% (3.1932 => 3.2587, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.59% (79.7170 => 80.9868, std.dev.: 0.1932) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.28% (0.3821 => 0.3543, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -6.98% (2.4924 => 2.3184, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: -6.52% (0.3357 => 0.3138, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.40% (0.3142 => 0.2941, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.38% (0.9542 => 0.8933, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: -6.30% (0.2160 => 0.2024, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.18% (0.1796 => 0.1685, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: -6.02% (16.1920 => 15.2175, std.dev.: 0.0168) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.01% (0.2428 => 0.2282, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.00% (0.6484 => 0.6095, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: -5.99% (0.9179 => 0.8629, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -5.92% (9.2283 => 8.6817, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.87% (3.5339 => 3.3264, std.dev.: 0.0151) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.85% (0.9852 => 0.9276, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.84% (1.3722 => 1.2921, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -5.76% (7.0961 => 6.6873, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.72% (1.0544 => 0.9941, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.68% (0.5478 => 0.5167, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.65% (6.7716 => 6.3888, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.65% (0.6052 => 0.5710, std.dev.: 0.0104) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.64% (0.2695 => 0.2543, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.63% (4.8161 => 4.5448, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.63% (0.5863 => 0.5533, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.62% (0.5591 => 0.5277, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.61% (1.6364 => 1.5446, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: -5.59% (0.1879 => 0.1774, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.54% (0.5925 => 0.5597, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.53% (1.4642 => 1.3832, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.52% (0.2355 => 0.2225, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: -5.52% (0.3406 => 0.3218, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -5.52% (1.1530 => 1.0894, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.52% (0.7198 => 0.6801, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.51% (0.5805 => 0.5485, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.51% (0.6230 => 0.5887, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.50% (0.5857 => 0.5535, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.48% (4.0323 => 3.8112, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.47% (0.6194 => 0.5855, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.47% (0.5705 => 0.5393, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -5.47% (1.1450 => 1.0824, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.46% (0.6681 => 0.6316, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.44% (0.5456 => 0.5159, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.44% (1.2300 => 1.1631, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: -5.43% (1.3864 => 1.3111, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.42% (4.5069 => 4.2627, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.41% (0.3658 => 0.3460, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.40% (0.6736 => 0.6372, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.40% (0.6297 => 0.5957, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.39% (0.5859 => 0.5543, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.38% (0.6260 => 0.5923, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.37% (0.3016 => 0.2854, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.37% (0.6667 => 0.6309, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.37% (0.5849 => 0.5535, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.36% (4.8802 => 4.6185, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/methcall: -5.36% (0.3025 => 0.2863, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.35% (0.4151 => 0.3929, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.34% (0.4515 => 0.4274, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.33% (0.6189 => 0.5859, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.33% (0.7919 => 0.7497, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.32% (1.2784 => 1.2104, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: -5.31% (0.3255 => 0.3082, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.29% (1.3148 => 1.2452, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.29% (0.5802 => 0.5495, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -5.29% (0.3026 => 0.2866, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.29% (0.6660 => 0.6308, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -5.28% (0.3880 => 0.3675, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.28% (0.6304 => 0.5971, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.28% (0.5570 => 0.5276, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -5.28% (4.3330 => 4.1043, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.27% (0.5581 => 0.5287, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -5.25% (0.3831 => 0.3630, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.24% (0.6293 => 0.5963, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.24% (0.4813 => 0.4561, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.23% (0.5941 => 0.5630, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.23% (0.3194 => 0.3027, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.22% (0.3848 => 0.3647, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -5.22% (0.3812 => 0.3613, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.21% (0.3837 => 0.3637, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.20% (0.3884 => 0.3682, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.20% (0.3483 => 0.3302, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -5.19% (0.3446 => 0.3267, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -5.19% (0.2985 => 0.2830, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: -5.19% (0.2989 => 0.2834, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -5.17% (0.4176 => 0.3960, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -5.17% (17.1032 => 16.2186, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.16% (2.1713 => 2.0593, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: -5.16% (0.4033 => 0.3825, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.15% (0.3323 => 0.3152, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: -5.14% (1.2515 => 1.1872, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.13% (0.6446 => 0.6115, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -5.13% (0.3896 => 0.3696, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -5.13% (0.3394 => 0.3220, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -5.12% (0.2871 => 0.2724, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.12% (0.3849 => 0.3652, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.12% (0.5999 => 0.5692, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.11% (0.8521 => 0.8086, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.10% (0.3057 => 0.2901, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: -5.10% (0.4861 => 0.4613, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: -5.10% (0.3059 => 0.2903, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.10% (14.2083 => 13.4843, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.09% (0.6676 => 0.6336, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.09% (0.6033 => 0.5726, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.09% (0.3891 => 0.3693, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.09% (1.6474 => 1.5636, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.09% (0.4916 => 0.4666, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.08% (0.6440 => 0.6113, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.07% (0.3252 => 0.3087, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.06% (0.3931 => 0.3732, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.04% (0.5575 => 0.5294, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -5.04% (0.4248 => 0.4034, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.03% (8.0126 => 7.6098, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.01% (0.2933 => 0.2786, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.99% (0.2903 => 0.2758, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.98% (1.2221 => 1.1613, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wc: -4.96% (0.3205 => 0.3046, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.93% (0.2999 => 0.2851, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -4.93% (0.2939 => 0.2794, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -4.93% (3.5154 => 3.3422, std.dev.: 0.0086) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.92% (0.2278 => 0.2166, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hello: -4.91% (0.2849 => 0.2709, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.91% (1.2210 => 1.1610, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary2: -4.91% (0.3481 => 0.3310, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.87% (0.2548 => 0.2424, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.86% (0.2385 => 0.2269, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.85% (0.5688 => 0.5412, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.84% (0.4321 => 0.4112, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -4.81% (0.3867 => 0.3681, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -4.81% (0.3621 => 0.3447, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -4.80% (15.5079 => 14.7629, std.dev.: 0.0139) MultiSource/Benchmarks/McCat/18-imp/imp: -4.80% (0.3581 => 0.3409, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -4.79% (0.7447 => 0.7090, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.77% (0.7339 => 0.6989, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -4.76% (0.4199 => 0.3999, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.76% (0.5168 => 0.4922, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.71% (0.7021 => 0.6690, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.70% (0.3319 => 0.3163, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.69% (0.5329 => 0.5079, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -4.68% (4.0594 => 3.8696, std.dev.: 0.0076) MultiSource/Applications/ClamAV/clamscan: -4.66% (15.2527 => 14.5423, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.63% (0.6395 => 0.6099, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -4.62% (0.4524 => 0.4315, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.61% (0.4427 => 0.4223, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.60% (22.4056 => 21.3745, std.dev.: 0.0146) MultiSource/Benchmarks/McCat/08-main/main: -4.59% (0.2659 => 0.2537, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.56% (0.4083 => 0.3897, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.53% (0.7524 => 0.7183, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.51% (0.9557 => 0.9126, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -4.49% (0.4280 => 0.4088, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.44% (0.6395 => 0.6111, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: -4.44% (0.3788 => 0.3620, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.44% (0.7779 => 0.7434, std.dev.: 0.0050) MultiSource/Benchmarks/Bullet/bullet: -4.36% (34.0927 => 32.6070, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.35% (0.5569 => 0.5327, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: -4.34% (2.1401 => 2.0472, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.30% (2.2587 => 2.1615, std.dev.: 0.0070) MultiSource/Applications/siod/siod: -4.28% (2.4021 => 2.2992, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -4.25% (0.6750 => 0.6463, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -4.22% (5.0226 => 4.8107, std.dev.: 0.0113) MultiSource/Applications/spiff/spiff: -4.15% (0.8418 => 0.8069, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -4.08% (0.7982 => 0.7656, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.01% (0.3491 => 0.3351, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.99% (0.6347 => 0.6094, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -3.93% (0.6441 => 0.6188, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.92% (0.9077 => 0.8721, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.92% (0.5567 => 0.5349, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -3.91% (0.3271 => 0.3143, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: -3.78% (18.2933 => 17.6023, std.dev.: 0.0063) MultiSource/Applications/hbd/hbd: -3.52% (1.5610 => 1.5061, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.30% (5.4682 => 5.2875, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -2.08% (20.7746 => 20.3425, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7524, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/richards_benchmark: -8.74% (1.2842 => 1.1719, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7060, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.84% (2.2633 => 2.1763, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.73% (1.3096 => 1.2739, std.dev.: 0.0086) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4716, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 3.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 03:14:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 05:14:01 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121119111401.246BB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6033?compare_to=6027&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6033, Order: 168297, Start Time: 2012-11-19 07:50:37, End Time: 2012-11-19 11:14:22 To: 6027, Order: 168295, Start Time: 2012-11-19 03:41:27, End Time: 2012-11-19 07:02:45 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (168 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1090 (724 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 20.66% (0.4206 => 0.5075, std.dev.: 0.0305) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.40% (0.3797 => 0.3926, std.dev.: 0.0024) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.04% (0.0625 => 0.0894, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.49% (0.1063 => 0.1419, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.22% (0.4253 => 0.5368, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 26.19% (1.5932 => 2.0105, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.14% (0.2969 => 0.3745, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.95% (0.1106 => 0.1393, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.63% (0.0714 => 0.0897, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.31% (0.4994 => 0.6258, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.86% (0.4139 => 0.5168, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.28% (0.5000 => 0.6214, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.73% (0.5900 => 0.7300, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.12% (0.0584 => 0.0719, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.52% (0.0897 => 0.1099, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.40% (0.1107 => 0.1355, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.74% (0.1021 => 0.1243, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.67% (0.1620 => 0.1971, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/em3d/em3d: 20.89% (0.0948 => 0.1146, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.53% (0.1549 => 0.1867, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.52% (0.0541 => 0.0652, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.38% (0.0584 => 0.0703, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.32% (0.3903 => 0.4696, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.31% (0.1103 => 0.1327, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.22% (0.0633 => 0.0761, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.14% (0.1003 => 0.1205, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.09% (0.0642 => 0.0771, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 20.03% (0.0604 => 0.0725, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 19.85% (0.0821 => 0.0984, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.70% (0.1604 => 0.1920, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.59% (0.0822 => 0.0983, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.56% (0.1462 => 0.1748, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 19.46% (0.1619 => 0.1934, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 19.18% (0.0808 => 0.0963, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.01% (0.2736 => 0.3256, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.84% (0.3890 => 0.4623, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.69% (0.0947 => 0.1124, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.17% (0.2014 => 0.2380, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 18.14% (0.1218 => 0.1439, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 18.07% (0.1505 => 0.1777, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.93% (1.3152 => 1.5510, std.dev.: 0.0091) MultiSource/Applications/Burg/burg: 17.92% (0.5546 => 0.6540, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.83% (0.1088 => 0.1282, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 17.82% (0.4029 => 0.4747, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 17.69% (1.0781 => 1.2688, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.63% (0.1968 => 0.2315, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 17.62% (0.0698 => 0.0821, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 17.61% (1.8794 => 2.2103, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.52% (0.0605 => 0.0711, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.39% (0.4658 => 0.5468, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 17.35% (0.5826 => 0.6837, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.34% (0.2866 => 0.3363, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.30% (0.3271 => 0.3837, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 16.95% (0.5889 => 0.6887, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 16.94% (0.9697 => 1.1340, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.74% (3.5627 => 4.1591, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.66% (1.6211 => 1.8911, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.56% (0.2875 => 0.3351, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.55% (0.1160 => 0.1352, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 16.54% (0.1421 => 0.1656, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.33% (0.2738 => 0.3185, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.20% (4.4195 => 5.1354, std.dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: 16.16% (0.9909 => 1.1510, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.13% (0.3930 => 0.4564, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.10% (0.4361 => 0.5063, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 16.04% (0.2780 => 0.3226, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.00% (0.5026 => 0.5830, std.dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: 15.90% (4.2109 => 4.8804, std.dev.: 0.0078) SingleSource/UnitTests/ObjC++/property-reference: 15.84% (0.7171 => 0.8307, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 15.81% (0.1284 => 0.1487, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: 15.77% (0.2714 => 0.3142, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 15.74% (0.2725 => 0.3154, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/except: 15.72% (0.2811 => 0.3253, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.69% (0.1090 => 0.1261, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.61% (0.2729 => 0.3155, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.53% (2.0673 => 2.3883, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/strcat: 15.49% (0.2750 => 0.3176, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/random: 15.48% (0.2803 => 0.3237, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 15.47% (0.2075 => 0.2396, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 15.44% (0.2823 => 0.3259, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.44% (0.2792 => 0.3223, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.43% (2.7292 => 3.1504, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 15.41% (0.3004 => 0.3467, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.40% (0.3195 => 0.3687, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/methcall: 15.36% (0.2813 => 0.3245, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 15.35% (0.2566 => 0.2960, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.25% (0.2911 => 0.3355, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 15.21% (0.3096 => 0.3567, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.06% (1.9694 => 2.2660, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.90% (1.9966 => 2.2941, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary: 14.76% (0.3258 => 0.3739, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 14.72% (0.3267 => 0.3748, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary2: 14.56% (0.3317 => 0.3800, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.49% (0.3362 => 0.3849, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.41% (0.3060 => 0.3501, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.34% (0.3124 => 0.3572, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 14.32% (23.5202 => 26.8877, std.dev.: 0.0172) MultiSource/Applications/lua/lua: 14.18% (1.4269 => 1.6292, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 14.12% (0.0758 => 0.0865, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.02% (0.3282 => 0.3742, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 14.01% (0.4146 => 0.4727, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 14.00% (0.3678 => 0.4193, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 13.89% (0.3348 => 0.3813, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 13.88% (0.3726 => 0.4243, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 13.83% (0.3477 => 0.3958, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 13.82% (4.6177 => 5.2560, std.dev.: 0.0041) MultiSource/Applications/JM/ldecod/ldecod: 13.76% (2.1653 => 2.4633, std.dev.: 0.0077) MultiSource/Applications/treecc/treecc: 13.69% (0.7875 => 0.8953, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.55% (0.3845 => 0.4366, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.49% (0.3981 => 0.4518, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.44% (0.3690 => 0.4186, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 13.29% (0.4251 => 0.4816, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 13.13% (2.1013 => 2.3772, std.dev.: 0.0086) MultiSource/Applications/SIBsim4/SIBsim4: 12.97% (0.2691 => 0.3040, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.84% (0.2040 => 0.2302, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 12.84% (0.3465 => 0.3910, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-2: 12.77% (0.3446 => 0.3886, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.73% (0.3488 => 0.3932, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 12.73% (0.3496 => 0.3941, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.66% (0.3460 => 0.3898, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.65% (0.3469 => 0.3908, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 12.61% (0.3442 => 0.3876, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.46% (0.3643 => 0.4097, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.41% (0.3650 => 0.4103, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 12.19% (5.5417 => 6.2175, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/parameter-passing: 12.14% (0.3724 => 0.4176, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.93% (0.1383 => 0.1548, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.72% (0.6435 => 0.7189, std.dev.: 0.0249) MultiSource/Applications/siod/siod: 11.71% (0.6634 => 0.7411, std.dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: 11.52% (0.3498 => 0.3901, std.dev.: 0.0023) MultiSource/Benchmarks/PAQ8p/paq8p: 11.39% (0.4847 => 0.5399, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.38% (0.1028 => 0.1145, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.71% (0.2737 => 0.3030, std.dev.: 0.0053) MultiSource/Applications/lemon/lemon: 10.58% (0.2391 => 0.2644, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.57% (0.3084 => 0.3410, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 10.43% (0.3336 => 0.3684, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 10.38% (2.0346 => 2.2458, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.89% (0.2103 => 0.2311, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.53% (0.5361 => 0.5872, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.78% (0.7426 => 0.8078, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.74% (4.6926 => 5.1029, std.dev.: 0.1387) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.64% (11.6398 => 12.6458, std.dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.15% (0.5584 => 0.6039, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 6.83% (11.9555 => 12.7715, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.43% (0.3792 => 0.3922, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6531, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.22% (0.5917 => 0.6699, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 10.56% (0.2802 => 0.3098, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6105, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.31% (0.3693 => 0.3926, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6730, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1716, std.dev.: 0.0232) SingleSource/Benchmarks/Misc/flops-2: 4.61% (1.8057 => 1.8889, std.dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6425, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2104, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.54% (3.1722 => 3.2212, std.dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3086, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2868, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5797, std.dev.: 0.0115) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.74% (25.4195 => 16.5877, std.dev.: 0.0136) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9764, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8006, std.dev.: 0.0953) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -6.29% (0.2402 => 0.2251, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: -3.72% (3.3665 => 3.2414, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8046, std.dev.: 0.0042) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7733, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0144) SingleSource/Benchmarks/Dhrystone/fldry: -2.76% (17.2379 => 16.7619, std.dev.: 0.0156) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.37% (0.6293 => 0.6144, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.25% (41.7953 => 40.8551, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5724, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/bh/bh: -1.55% (5.5810 => 5.4947, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.02% (105.3826 => 104.3035, std.dev.: 0.0080) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 04:09:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 06:09:28 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121119120928.5BFB42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6034?compare_to=6030&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6034, Order: 168304, Start Time: 2012-11-19 10:38:21, End Time: 2012-11-19 12:09:51 To: 6030, Order: 168300, Start Time: 2012-11-19 08:48:16, End Time: 2012-11-19 10:20:41 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 11 (77 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1043 (875 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 3.14% (0.3186 => 0.3286, std.dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 1.40% (6.8812 => 6.9773, std.dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.96% (1.3801 => 1.4347, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.63% (44.9262 => 46.1068, std.dev.: 0.1801) MultiSource/Applications/SPASS/SPASS: 1.95% (8.3397 => 8.5027, std.dev.: 0.0509) SingleSource/Benchmarks/Shootout/methcall: 1.70% (8.1393 => 8.2775, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.40% (4.9065 => 4.9751, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/pi: 1.31% (2.4812 => 2.5136, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.25% (2.7517 => 2.7862, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.13% (4.5335 => 4.5846, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.02% (1.5849 => 1.6010, std.dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.02% (1.0594 => 1.0702, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -15.64% (0.0179 => 0.0151, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.39% (0.0427 => 0.0404, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.51% (0.0333 => 0.0298, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -26.84% (0.0313 => 0.0229, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -16.20% (0.0426 => 0.0357, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/casts: -41.18% (0.0204 => 0.0120, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/test1: -24.50% (0.0200 => 0.0151, std.dev.: 0.0033) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.81% (0.1488 => 0.1476, std.dev.: 0.0065) MultiSource/Applications/lemon/lemon: -2.14% (1.1404 => 1.1160, std.dev.: 0.0514) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.07% (0.4182 => 0.4179, std.dev.: 0.0213) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.21% (0.1402 => 0.1419, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 100.00% (0.0004 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.50% (0.0618 => 0.0652, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.72% (0.0276 => 0.0278, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.15% (0.0585 => 0.0549, std.dev.: 0.0158) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.69% (1.2028 => 1.1945, std.dev.: 0.0142) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 24.00% (0.0025 => 0.0031, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.16% (0.0643 => 0.0644, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.81% (0.0247 => 0.0249, std.dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.74% (0.7795 => 0.7853, std.dev.: 0.0038) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 34.04% (0.0047 => 0.0063, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.07% (16.4461 => 17.6082, std.dev.: 0.3383) MultiSource/Applications/sqlite3/sqlite3: 2330.09% (0.6332 => 15.3873, std.dev.: 0.1257) MultiSource/Benchmarks/McCat/08-main/main: 47.62% (0.1831 => 0.2703, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.48% (0.1559 => 0.1458, std.dev.: 0.0411) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7110.44% (0.3123 => 22.5182, std.dev.: 0.9711) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.02% (0.2463 => 0.3695, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1528.65% (0.3344 => 5.4462, std.dev.: 0.0426) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.27% (0.2364 => 0.3245, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: 4.44% (0.6010 => 0.6277, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/mandel: 3.50% (0.0429 => 0.0444, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.3266 => 0.3426, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 2.89% (0.1969 => 0.2026, std.dev.: 0.0039) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.45% (0.0224 => 0.0225, std.dev.: 0.0040) SingleSource/UnitTests/byval-alignment: -28.70% (0.0230 => 0.0164, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0523, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 11.90% (0.1462 => 0.1636, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4670, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0738, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4927, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5109, std.dev.: 0.0265) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.4960, std.dev.: 0.5642) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3193, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1448, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3623, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4094, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0884, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: -24.43% (2.1832 => 1.6499, std.dev.: 0.0062) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.90% (0.0810 => 0.0955, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 13.58% (0.1112 => 0.1263, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.56% (0.0848 => 0.0963, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.13% (0.0830 => 0.0939, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.61% (0.1905 => 0.2050, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/health/health: 7.50% (0.1347 => 0.1448, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 6.64% (0.7950 => 0.8478, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.37% (0.1885 => 0.2005, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.11% (0.2519 => 0.2673, std.dev.: 0.0036) MultiSource/Applications/Burg/burg: 5.23% (1.2222 => 1.2861, std.dev.: 0.0075) MultiSource/Applications/treecc/treecc: 4.65% (1.9948 => 2.0876, std.dev.: 0.0114) MultiSource/Applications/hbd/hbd: 4.63% (1.4269 => 1.4930, std.dev.: 0.0173) MultiSource/Applications/lua/lua: 4.27% (3.8189 => 3.9818, std.dev.: 0.0203) MultiSource/Applications/SPASS/SPASS: 4.09% (14.2605 => 14.8444, std.dev.: 0.0199) MultiSource/Benchmarks/nbench/nbench: 3.96% (1.1271 => 1.1717, std.dev.: 0.0169) MultiSource/Applications/minisat/minisat: 3.89% (0.6834 => 0.7100, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.69% (0.3115 => 0.3230, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 3.64% (6.7320 => 6.9773, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.63% (1.1170 => 1.1576, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.58% (0.4559 => 0.4722, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.37% (2.1401 => 2.2123, std.dev.: 0.0139) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.27% (1.2526 => 1.2935, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.18% (0.8340 => 0.8605, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 3.15% (2.2184 => 2.2883, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.07% (0.8597 => 0.8861, std.dev.: 0.0048) MultiSource/Benchmarks/PAQ8p/paq8p: 2.95% (2.3764 => 2.4464, std.dev.: 0.0162) MultiSource/Applications/JM/lencod/lencod: 2.89% (15.3280 => 15.7716, std.dev.: 0.0502) MultiSource/Benchmarks/McCat/05-eks/eks: 2.84% (0.4397 => 0.4522, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.76% (0.4783 => 0.4915, std.dev.: 0.0051) MultiSource/Applications/d/make_dparser: 2.73% (3.2366 => 3.3249, std.dev.: 0.0093) MultiSource/Applications/ClamAV/clamscan: 2.71% (14.7684 => 15.1680, std.dev.: 0.1038) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.54% (1.5315 => 1.5704, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.44% (0.8716 => 0.8929, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.42% (0.8805 => 0.9018, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.40% (0.8885 => 0.9098, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.35% (0.5191 => 0.5313, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.32% (0.7932 => 0.8116, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.22% (3.1832 => 3.2540, std.dev.: 0.0214) MultiSource/Applications/lambda-0_1_3/lambda: 2.17% (0.7557 => 0.7721, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.11% (0.8066 => 0.8236, std.dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 1.95% (8.6247 => 8.7925, std.dev.: 0.0354) MultiSource/Applications/oggenc/oggenc: 1.62% (4.9628 => 5.0433, std.dev.: 0.0268) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 109.55% (0.0199 => 0.0417, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/pi: 59.14% (1.5795 => 2.5136, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.57% (2.9753 => 3.4684, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.30% (0.7597 => 0.8835, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.70% (2.7995 => 3.2110, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.49% (5.0261 => 5.6037, std.dev.: 0.0126) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.10% (1.1857 => 1.2817, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.57% (6.3772 => 6.8597, std.dev.: 0.0344) SingleSource/Benchmarks/McGill/queens: 7.15% (1.7056 => 1.8275, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.79% (4.7794 => 5.1037, std.dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 6.31% (3.1873 => 3.3884, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.89% (4.9686 => 5.2612, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.75% (4.5327 => 4.7932, std.dev.: 0.0369) SingleSource/Benchmarks/Misc/richards_benchmark: 5.62% (1.3037 => 1.3770, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.70% (3.3761 => 3.5348, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.68% (6.2275 => 6.5188, std.dev.: 0.0105) MultiSource/Applications/lambda-0_1_3/lambda: 4.41% (7.4933 => 7.8237, std.dev.: 0.0311) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.40% (4.9469 => 5.1648, std.dev.: 0.0579) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.00% (4.9453 => 5.1432, std.dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 3.92% (14.0064 => 14.5561, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.47% (44.5605 => 46.1068, std.dev.: 0.1801) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.35% (1.3882 => 1.4347, std.dev.: 0.0056) MultiSource/Applications/siod/siod: 2.90% (3.6643 => 3.7705, std.dev.: 0.0174) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.87% (4.8362 => 4.9751, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.86% (11.5690 => 11.8999, std.dev.: 0.0691) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.84% (0.3587 => 0.3689, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.75% (8.2783 => 8.5061, std.dev.: 0.0108) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.74% (1.2337 => 1.2675, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/lists: 2.33% (7.3375 => 7.5084, std.dev.: 0.0108) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (1.1365 => 1.1625, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 2.28% (5.6030 => 5.7310, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: 1.50% (1.2061 => 1.2242, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 1.31% (1.0841 => 1.0983, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.21% (3.5679 => 3.6109, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/ReedSolomon: 1.08% (8.5322 => 8.6242, std.dev.: 0.0261) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.18% (5.4641 => 4.3069, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.72% (7.2130 => 6.2235, std.dev.: 0.1792) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.84% (1.0512 => 0.9372, std.dev.: 0.0299) MultiSource/Benchmarks/mafft/pairlocalalign: -8.52% (63.1822 => 57.8002, std.dev.: 0.0420) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.06% (14.6451 => 13.4645, std.dev.: 0.0986) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.93% (4.7482 => 4.4192, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.36% (0.3269 => 0.3061, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.96% (3.7148 => 3.4935, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.69% (5.4972 => 5.1843, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.15% (5.1557 => 4.8902, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.78% (6.0224 => 5.7946, std.dev.: 0.0392) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.34% (2.4490 => 2.3671, std.dev.: 0.0232) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.32% (0.5807 => 0.5614, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.17% (2.8773 => 2.7862, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.69% (2.6356 => 2.5646, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.54% (9.9065 => 9.6547, std.dev.: 0.0654) MultiSource/Applications/aha/aha: -2.43% (3.3398 => 3.2586, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash2: -2.23% (3.4237 => 3.3472, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.06% (11.5316 => 11.2939, std.dev.: 0.0359) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.79% (3.2169 => 3.1594, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.56% (4.9994 => 4.9214, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.09% (5.6343 => 5.5731, std.dev.: 0.0054) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.29% (1.0262 => 1.0702, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 22.76% (0.0123 => 0.0151, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.98% (0.0408 => 0.0404, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 17.32% (0.0254 => 0.0298, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -24.17% (0.0302 => 0.0229, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.03% (0.0384 => 0.0357, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/casts: -36.84% (0.0190 => 0.0120, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/test1: -16.11% (0.0180 => 0.0151, std.dev.: 0.0033) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.64% (0.1438 => 0.1476, std.dev.: 0.0065) MultiSource/Applications/lemon/lemon: -1.49% (1.1329 => 1.1160, std.dev.: 0.0514) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.36% (0.4164 => 0.4179, std.dev.: 0.0213) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.65% (0.1369 => 0.1419, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.72% (0.0641 => 0.0652, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.56% (0.0195 => 0.0278, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.02% (0.0578 => 0.0549, std.dev.: 0.0158) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.44% (1.1437 => 1.1945, std.dev.: 0.0142) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.71% (0.0627 => 0.0644, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 38.33% (0.0180 => 0.0249, std.dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.05% (0.8017 => 0.7853, std.dev.: 0.0038) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 1.61% (0.0062 => 0.0063, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 05:04:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 07:04:40 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121119130440.40AD02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6035?compare_to=6032&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6035, Order: 168304, Start Time: 2012-11-19 11:31:13, End Time: 2012-11-19 13:05:00 To: 6032, Order: 168302, Start Time: 2012-11-19 09:33:51, End Time: 2012-11-19 11:07:31 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 1 (179 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1090 (858 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 12.50% (0.3631 => 0.4085, std.dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.94% (80.9868 => 78.6034, std.dev.: 0.8766) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 6.55% (0.3834 => 0.4085, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.97% (2.0478 => 2.1086, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.4937 => 7.6777, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/hash2: 1.96% (3.1932 => 3.2558, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.35% (0.3821 => 0.3540, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -6.95% (2.4924 => 2.3192, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -6.55% (0.3357 => 0.3137, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.38% (0.9542 => 0.8933, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.30% (0.3142 => 0.2944, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: -6.20% (0.2160 => 0.2026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.14% (0.2428 => 0.2279, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.08% (0.6484 => 0.6090, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: -5.99% (16.1920 => 15.2216, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/football/football: -5.98% (0.9179 => 0.8630, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.96% (0.9852 => 0.9265, std.dev.: 0.0136) MultiSource/Benchmarks/mafft/pairlocalalign: -5.91% (9.2283 => 8.6826, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.87% (3.5339 => 3.3265, std.dev.: 0.0050) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.79% (0.1796 => 0.1692, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.78% (1.3722 => 1.2929, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.77% (0.2355 => 0.2219, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -5.76% (7.0961 => 6.6875, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.72% (0.5857 => 0.5522, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.70% (0.5863 => 0.5529, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.69% (1.0544 => 0.9944, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.66% (0.3658 => 0.3451, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.65% (0.5591 => 0.5275, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.64% (6.7716 => 6.3894, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.64% (0.2695 => 0.2543, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.63% (0.5805 => 0.5478, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.62% (0.5478 => 0.5170, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.59% (4.8161 => 4.5468, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.58% (0.6052 => 0.5714, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.57% (0.7198 => 0.6797, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.55% (0.6230 => 0.5884, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.53% (0.5859 => 0.5535, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.52% (0.5705 => 0.5390, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: -5.50% (1.1530 => 1.0896, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: -5.49% (0.3406 => 0.3219, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.49% (1.2300 => 1.1625, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.48% (4.0323 => 3.8114, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.48% (0.6736 => 0.6367, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.47% (0.6194 => 0.5855, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.47% (1.6364 => 1.5469, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.44% (0.6304 => 0.5961, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.43% (0.5925 => 0.5603, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.43% (0.6667 => 0.6305, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.42% (0.6293 => 0.5952, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.42% (0.6297 => 0.5956, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.41% (1.4642 => 1.3850, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.39% (0.6660 => 0.6301, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.38% (0.6260 => 0.5923, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -5.38% (1.1450 => 1.0834, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.37% (0.5849 => 0.5535, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.37% (0.6446 => 0.6100, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -5.36% (4.3330 => 4.1009, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.35% (0.5456 => 0.5164, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.35% (4.5069 => 4.2659, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.34% (0.5802 => 0.5492, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.32% (1.2784 => 1.2104, std.dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: -5.32% (1.3864 => 1.3127, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.32% (0.6189 => 0.5860, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.31% (0.3255 => 0.3082, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.30% (0.5581 => 0.5285, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.30% (4.8802 => 4.6216, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.30% (0.6681 => 0.6327, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.30% (0.5570 => 0.5275, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -5.29% (0.4515 => 0.4276, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: -5.29% (0.3026 => 0.2866, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.27% (0.5575 => 0.5281, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -5.27% (0.3812 => 0.3611, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.27% (0.3016 => 0.2857, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -5.26% (0.3025 => 0.2866, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.23% (0.5941 => 0.5630, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.23% (0.4151 => 0.3934, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -5.21% (1.3148 => 1.2463, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: -5.21% (0.3880 => 0.3678, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.20% (0.7919 => 0.7507, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: -5.20% (1.2515 => 1.1864, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/objinst: -5.20% (0.3194 => 0.3028, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -5.19% (17.1032 => 16.2162, std.dev.: 0.0164) SingleSource/UnitTests/ObjC/exceptions-2: -5.17% (0.3831 => 0.3633, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.15% (0.6676 => 0.6332, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: -5.15% (0.4176 => 0.3961, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.14% (0.3849 => 0.3651, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.13% (14.2083 => 13.4789, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/for-in: -5.13% (0.4033 => 0.3826, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.13% (0.8521 => 0.8084, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -5.12% (0.3848 => 0.3651, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.12% (0.5999 => 0.5692, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.11% (0.3837 => 0.3641, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -5.10% (0.3059 => 0.2903, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -5.10% (0.3394 => 0.3221, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.09% (0.3323 => 0.3154, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -5.09% (0.2989 => 0.2837, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -5.08% (0.3896 => 0.3698, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.08% (0.3483 => 0.3306, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: -5.08% (0.3446 => 0.3271, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.07% (0.6033 => 0.5727, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.07% (0.4916 => 0.4667, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.06% (0.5688 => 0.5400, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.06% (0.6440 => 0.6114, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.05% (8.0126 => 7.6080, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.04% (1.6474 => 1.5643, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.04% (0.3252 => 0.3088, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: -5.03% (0.3581 => 0.3401, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: -5.02% (0.4861 => 0.4617, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.99% (0.3931 => 0.3735, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.98% (0.2871 => 0.2728, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.98% (1.2210 => 1.1602, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.98% (1.2221 => 1.1613, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.97% (0.3057 => 0.2905, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -4.97% (0.3481 => 0.3308, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.97% (0.2999 => 0.2850, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.96% (0.2278 => 0.2165, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -4.96% (0.2985 => 0.2837, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.93% (2.1713 => 2.0642, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.91% (0.2933 => 0.2789, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.88% (0.3891 => 0.3701, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: -4.87% (3.5154 => 3.3443, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.86% (0.2385 => 0.2269, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: -4.85% (0.4248 => 0.4042, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: -4.84% (0.2849 => 0.2711, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -4.84% (0.3205 => 0.3050, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -4.83% (0.2939 => 0.2797) SingleSource/Benchmarks/Shootout-C++/lists1: -4.81% (0.3867 => 0.3681, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -4.81% (0.7447 => 0.7089, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: -4.79% (15.5079 => 14.7646, std.dev.: 0.0099) MultiSource/Applications/ClamAV/clamscan: -4.78% (15.2527 => 14.5243, std.dev.: 0.0142) SingleSource/UnitTests/ObjC/property: -4.76% (0.4199 => 0.3999, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.76% (0.7021 => 0.6687, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -4.75% (0.3621 => 0.3449, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.75% (0.5329 => 0.5076, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.74% (0.4321 => 0.4116, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.74% (0.5168 => 0.4923, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: -4.70% (0.2659 => 0.2534, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.70% (0.4813 => 0.4587, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.67% (0.7339 => 0.6996, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.64% (0.7524 => 0.7175, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.62% (0.2903 => 0.2769, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.61% (0.3884 => 0.3705, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.60% (22.4056 => 21.3759, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/hash: -4.58% (0.4524 => 0.4317, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -4.57% (4.0594 => 3.8739, std.dev.: 0.0070) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.55% (0.3319 => 0.3168, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.52% (0.6395 => 0.6106, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.52% (0.6395 => 0.6106, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.51% (0.4083 => 0.3899, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.50% (0.4427 => 0.4228, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.45% (0.9557 => 0.9132, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: -4.42% (0.4280 => 0.4091, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -4.36% (0.3788 => 0.3623, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -4.35% (2.4021 => 2.2976, std.dev.: 0.0017) MultiSource/Applications/treecc/treecc: -4.34% (2.1401 => 2.0473, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.31% (0.5569 => 0.5329, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -4.30% (34.0927 => 32.6270, std.dev.: 0.0178) SingleSource/Benchmarks/Misc-C++/bigfib: -4.25% (0.6750 => 0.6463, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.23% (2.2587 => 2.1632, std.dev.: 0.0055) MultiSource/Applications/oggenc/oggenc: -4.22% (5.0226 => 4.8104, std.dev.: 0.0032) MultiSource/Applications/spiff/spiff: -4.19% (0.8418 => 0.8065, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: -4.15% (0.7779 => 0.7456, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -4.15% (0.7982 => 0.7651, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.13% (0.5567 => 0.5337, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.13% (0.3271 => 0.3136, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.07% (0.3491 => 0.3349, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.01% (0.9077 => 0.8713, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: -3.95% (0.6347 => 0.6096, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.85% (0.6441 => 0.6193, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -3.77% (18.2933 => 17.6038, std.dev.: 0.0143) MultiSource/Applications/hbd/hbd: -3.27% (1.5610 => 1.5100, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.24% (5.4682 => 5.2908, std.dev.: 0.0122) SingleSource/UnitTests/Vector/constpool: -2.36% (20.7746 => 20.2852, std.dev.: 0.0125) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.48% (7.5137 => 5.7492, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/richards_benchmark: -8.75% (1.2842 => 1.1718, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7060, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.71% (2.2633 => 2.1793, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.50% (1.3096 => 1.2638, std.dev.: 0.0135) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4706, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 4.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 05:58:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 07:58:25 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121119135825.BB1932A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6036?compare_to=6034&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6036, Order: 168310, Start Time: 2012-11-19 12:28:30, End Time: 2012-11-19 13:58:49 To: 6034, Order: 168304, Start Time: 2012-11-19 10:38:21, End Time: 2012-11-19 12:09:51 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 7 (105 on baseline) Performance Improvements: 6 (25 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1041 (844 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.28% (0.3631 => 0.3750, std.dev.: 0.0027) MultiSource/Applications/lemon/lemon: 1.53% (1.1047 => 1.1216, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.96% (40.9130 => 42.5334, std.dev.: 0.0516) SingleSource/Benchmarks/McGill/chomp: 3.43% (0.9987 => 1.0330, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.87% (4.3324 => 4.4567, std.dev.: 0.0383) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.19% (1.2450 => 1.2598, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 1.11% (8.9237 => 9.0224, std.dev.: 0.0223) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.82% (0.6600 => 0.6414, std.dev.: 0.0035) MultiSource/Applications/treecc/treecc: -1.29% (2.0876 => 2.0607, std.dev.: 0.0090) MultiSource/Applications/JM/ldecod/ldecod: -1.22% (6.9773 => 6.8923, std.dev.: 0.0266) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/five11/five11: -1.76% (5.7310 => 5.6304, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.14% (1.6010 => 1.5827, std.dev.: 0.0069) SingleSource/Benchmarks/Linpack/linpack-pc: -1.06% (55.0222 => 54.4369, std.dev.: 0.2205) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.38% (1.0702 => 1.0743, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 45.03% (0.0151 => 0.0219, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.50% (0.0404 => 0.0402, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 12.75% (0.0298 => 0.0336, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 28.38% (0.0229 => 0.0294, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 5.32% (0.0357 => 0.0376, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/casts: 70.83% (0.0120 => 0.0205, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 23.18% (0.0151 => 0.0186, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.54% (0.1476 => 0.1484, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 4.07% (1.1160 => 1.1614, std.dev.: 0.0143) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.06% (0.4179 => 0.4093, std.dev.: 0.0391) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.49% (0.1419 => 0.1412, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -12.58% (0.0652 => 0.0570, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -27.34% (0.0278 => 0.0202, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.10% (0.0549 => 0.0588, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.47% (1.1945 => 1.2001, std.dev.: 0.0561) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.63% (0.0644 => 0.0582, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.22% (0.0249 => 0.0262, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.55% (0.7853 => 0.7810, std.dev.: 0.0044) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -6.35% (0.0063 => 0.0059, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.23% (16.4461 => 17.6352, std.dev.: 0.1617) MultiSource/Applications/sqlite3/sqlite3: 2350.22% (0.6332 => 15.5148, std.dev.: 0.0102) MultiSource/Benchmarks/McCat/08-main/main: 47.30% (0.1831 => 0.2697, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.39% (0.1559 => 0.1475, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7060.90% (0.3123 => 22.3635, std.dev.: 0.5299) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.43% (0.2463 => 0.3705, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1525.75% (0.3344 => 5.4365, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/Large/ray: 34.52% (0.2364 => 0.3180, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: 4.93% (0.6010 => 0.6306, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: 1.86% (0.0429 => 0.0437, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.11% (0.3266 => 0.3433, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 3.61% (0.1969 => 0.2040, std.dev.: 0.0023) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.70% (0.0224 => 0.0239, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -32.17% (0.0230 => 0.0156, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0516, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 8.82% (0.1462 => 0.1591, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4599, std.dev.: 0.0172) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0676, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4886, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5134, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.4979, std.dev.: 0.0741) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3088, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1339, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3631, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4028, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0882, std.dev.: 0.0014) SingleSource/Regression/C/uint64_to_float: -24.13% (2.1832 => 1.6564, std.dev.: 0.0062) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.54% (0.0810 => 0.0944, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.25% (0.0830 => 0.0940, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.91% (0.0848 => 0.0949, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 11.60% (0.1112 => 0.1241, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.14% (0.1425 => 0.1541, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.98% (0.8321 => 0.8985, std.dev.: 0.0138) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.48% (0.2180 => 0.2343, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.29% (0.7473 => 0.8018, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.72% (0.6010 => 0.6414, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.58% (0.4847 => 0.5166, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.25% (0.6287 => 0.6680, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.58% (0.2133 => 0.2252, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.43% (0.3295 => 0.3474, std.dev.: 0.0065) MultiSource/Applications/Burg/burg: 5.03% (1.2222 => 1.2837, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.87% (0.2240 => 0.2349, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.80% (0.2519 => 0.2640, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 4.69% (1.4269 => 1.4938, std.dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 4.52% (1.1271 => 1.1781, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.50% (0.3003 => 0.3138, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.29% (0.9435 => 0.9840, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.25% (1.1685 => 1.2182, std.dev.: 0.0125) MultiSource/Applications/spiff/spiff: 4.14% (0.7950 => 0.8279, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.03% (1.2526 => 1.3031, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.90% (0.4127 => 0.4288, std.dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: 3.79% (14.2605 => 14.8008, std.dev.: 0.0281) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.60% (0.4783 => 0.4955, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 3.57% (0.2999 => 0.3106, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.48% (0.8340 => 0.8630, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.47% (0.2998 => 0.3102, std.dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.44% (6.6074 => 6.8345, std.dev.: 0.0580) MultiSource/Applications/lua/lua: 3.41% (3.8189 => 3.9492, std.dev.: 0.0175) MultiSource/Applications/treecc/treecc: 3.30% (1.9948 => 2.0607, std.dev.: 0.0090) MultiSource/Benchmarks/McCat/05-eks/eks: 3.23% (0.4397 => 0.4539, std.dev.: 0.0032) MultiSource/Applications/ClamAV/clamscan: 3.23% (14.7684 => 15.2451, std.dev.: 0.0560) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.16% (2.1401 => 2.2077, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.16% (0.4559 => 0.4703, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 3.09% (0.6834 => 0.7045, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.08% (0.9056 => 0.9335, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 3.07% (2.2184 => 2.2866, std.dev.: 0.0081) MultiSource/Applications/SIBsim4/SIBsim4: 3.05% (1.2568 => 1.2951, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.97% (0.5191 => 0.5345, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.94% (0.8697 => 0.8953, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.79% (1.1170 => 1.1482, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.65% (13.1811 => 13.5300, std.dev.: 0.1225) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.58% (0.9074 => 0.9308, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.57% (0.8007 => 0.8213, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.57% (1.5315 => 1.5709, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.55% (0.8457 => 0.8673, std.dev.: 0.0025) MultiSource/Applications/lemon/lemon: 2.48% (1.0945 => 1.1216, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.46% (0.9908 => 1.0152, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 2.46% (0.7557 => 0.7743, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 2.45% (15.3280 => 15.7037, std.dev.: 0.0516) MultiSource/Applications/d/make_dparser: 2.42% (3.2366 => 3.3148, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.41% (0.9688 => 0.9921, std.dev.: 0.0061) MultiSource/Applications/JM/ldecod/ldecod: 2.38% (6.7320 => 6.8923, std.dev.: 0.0266) MultiSource/Benchmarks/Prolangs-C/football/football: 2.37% (0.8768 => 0.8976, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.35% (0.8331 => 0.8527, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.34% (0.9069 => 0.9281, std.dev.: 0.0073) MultiSource/Applications/hexxagon/hexxagon: 2.28% (0.9810 => 1.0034, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (3.1832 => 3.2556, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.26% (0.8716 => 0.8913, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.17% (0.8518 => 0.8703, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.17% (0.6586 => 0.6729, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.14% (0.8286 => 0.8463, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.13% (0.8066 => 0.8238, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.12% (0.8855 => 0.9043, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.07% (0.7932 => 0.8096, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.07% (0.8805 => 0.8987, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.05% (0.8204 => 0.8372, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.79% (0.8048 => 0.8192, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.62% (0.8338 => 0.8473, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 109.05% (0.0199 => 0.0416, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/pi: 58.61% (1.5795 => 2.5053, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.28% (2.9753 => 3.4596, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 14.95% (0.7597 => 0.8733, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.55% (2.7995 => 3.2067, std.dev.: 0.0622) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.40% (5.0261 => 5.5993, std.dev.: 0.0103) SingleSource/Benchmarks/McGill/queens: 7.53% (1.7056 => 1.8341, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.50% (1.1857 => 1.2746, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.66% (4.7794 => 5.0979, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 6.39% (1.3037 => 1.3870, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 6.24% (3.1873 => 3.3861, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.15% (0.3186 => 0.3382, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.89% (4.5327 => 4.7997, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.86% (4.9686 => 5.2600, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 5.03% (7.4933 => 7.8701, std.dev.: 0.0453) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.79% (6.2275 => 6.5258, std.dev.: 0.0489) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.67% (3.3761 => 3.5336, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.20% (4.9453 => 5.1530, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.01% (4.9469 => 5.1451, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.92% (14.0064 => 14.5561, std.dev.: 0.0294) MultiSource/Applications/siod/siod: 2.91% (3.6643 => 3.7711, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.74% (11.5690 => 11.8863, std.dev.: 0.0181) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.68% (41.4238 => 42.5334, std.dev.: 0.0516) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.51% (8.2783 => 8.4863, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout/lists: 2.38% (7.3375 => 7.5119, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.33% (4.3552 => 4.4567, std.dev.: 0.0383) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.30% (4.8660 => 4.9781, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.24% (4.8362 => 4.9446, std.dev.: 0.0415) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.87% (1.1365 => 1.1577, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/FloatMM: 1.34% (0.8807 => 0.8925, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 1.29% (1.2061 => 1.2217, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.21% (3.5679 => 3.6112, std.dev.: 0.0034) MultiSource/Applications/spiff/spiff: 1.18% (2.8561 => 2.8899, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.17% (1.5941 => 1.6127, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.10% (5.4641 => 4.3113, std.dev.: 0.1082) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.19% (7.2130 => 6.3337, std.dev.: 0.2666) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.65% (1.0512 => 0.9392, std.dev.: 0.0298) MultiSource/Benchmarks/mafft/pairlocalalign: -8.46% (63.1822 => 57.8394, std.dev.: 0.1383) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.44% (14.6451 => 13.4090, std.dev.: 0.1356) SingleSource/Benchmarks/McGill/chomp: -7.90% (1.1216 => 1.0330, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.98% (4.7482 => 4.4166, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.70% (0.3269 => 0.3050, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.97% (3.7148 => 3.4930, std.dev.: 0.0227) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.90% (5.4972 => 5.1728, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.14% (5.1557 => 4.8907, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.44% (4.7449 => 4.5344, std.dev.: 0.0164) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.78% (2.8773 => 2.7685, std.dev.: 0.0417) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.73% (6.0224 => 5.7976, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.71% (2.4490 => 2.3582, std.dev.: 0.0312) MultiSource/Benchmarks/Prolangs-C++/life/life: -3.20% (2.6356 => 2.5513, std.dev.: 0.0288) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.06% (28.5821 => 27.7077, std.dev.: 0.0092) MultiSource/Applications/lua/lua: -3.00% (29.8330 => 28.9377, std.dev.: 0.1272) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.84% (0.5807 => 0.5642, std.dev.: 0.0011) MultiSource/Applications/aha/aha: -2.25% (3.3398 => 3.2646, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/hash2: -2.20% (3.4237 => 3.3483, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.09% (3.2169 => 3.1496, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.03% (11.5316 => 11.2978, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.62% (4.9994 => 4.9186, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.60% (2.3487 => 2.3111, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.69% (1.0262 => 1.0743, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.47% (0.0408 => 0.0402, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 32.28% (0.0254 => 0.0336, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.65% (0.0302 => 0.0294, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.08% (0.0384 => 0.0376, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 3.33% (0.0180 => 0.0186, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 3.20% (0.1438 => 0.1484, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 2.52% (1.1329 => 1.1614, std.dev.: 0.0143) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.71% (0.4164 => 0.4093, std.dev.: 0.0391) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.14% (0.1369 => 0.1412, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.08% (0.0641 => 0.0570, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.59% (0.0195 => 0.0202, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.73% (0.0578 => 0.0588, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.93% (1.1437 => 1.2001, std.dev.: 0.0561) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.18% (0.0627 => 0.0582, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 45.56% (0.0180 => 0.0262, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.58% (0.8017 => 0.7810, std.dev.: 0.0044) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -4.84% (0.0062 => 0.0059, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 06:01:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 08:01:23 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121119140123.488942A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6037?compare_to=6031&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6037, Order: 168304, Start Time: 2012-11-19 11:41:02, End Time: 2012-11-19 14:01:43 To: 6031, Order: 168300, Start Time: 2012-11-19 08:29:21, End Time: 2012-11-19 10:50:00 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 32 (144 on baseline) Performance Improvements: 9 (40 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1047 (703 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.23% (0.5923 => 0.6766, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.13% (0.6247 => 0.7130, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 13.69% (0.6173 => 0.7018, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 13.49% (0.6228 => 0.7068, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.48% (0.6244 => 0.7086, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 13.22% (0.5922 => 0.6705, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 13.16% (0.7195 => 0.8142, std.dev.: 0.0244) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.95% (0.6623 => 0.7481, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.89% (0.7205 => 0.8062, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.51% (0.4464 => 0.4978, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.80% (0.3037 => 0.3365, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/moments: 10.62% (0.4482 => 0.4958, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.63% (2.4817 => 2.7208, std.dev.: 0.0583) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.76% (0.5253 => 0.5713, std.dev.: 0.0085) SingleSource/Benchmarks/Linpack/linpack-pc: 7.95% (0.2894 => 0.3124, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.73% (4.4806 => 4.8271, std.dev.: 0.0732) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 7.51% (0.1678 => 0.1804, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists1: 7.45% (0.4069 => 0.4372, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.94% (0.2306 => 0.2420, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.32% (4.6158 => 4.8154, std.dev.: 0.0595) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.82% (0.6734 => 0.6991, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/moments: 19.52% (0.1214 => 0.1451, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.73% (11.3227 => 12.6509, std.dev.: 0.2710) SingleSource/Benchmarks/Shootout/heapsort: 9.74% (4.1339 => 4.5364, std.dev.: 0.0685) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 8.61% (5.2283 => 5.6787, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 6.08% (0.1990 => 0.2111, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 2.73% (3.2474 => 3.3359, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.51% (3.7346 => 3.8284, std.dev.: 0.0242) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.48% (4.2626 => 4.3683, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.65% (4.8119 => 4.8912, std.dev.: 0.0252) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.53% (5.6758 => 5.7625, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.47% (5.3879 => 5.4670, std.dev.: 0.0093) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -14.07% (0.1649 => 0.1417, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -11.69% (0.6576 => 0.5807, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ackermann: -11.29% (0.3392 => 0.3009, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -11.05% (1.1604 => 1.0322, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: -10.94% (0.3492 => 0.3110, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -10.57% (0.5250 => 0.4695, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -8.86% (4.3255 => 3.9421, std.dev.: 0.0386) SingleSource/Benchmarks/Misc/ffbench: -7.22% (1.0707 => 0.9934, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/ackermann: -1.82% (1.7857 => 1.7532, std.dev.: 0.0121) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.07% (0.1338 => 0.1339, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.33% (0.0430 => 0.0420, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.83% (0.0678 => 0.0652, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 0.07% (493.6585 => 493.9804, std.dev.: 0.2183) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: 43704.24% (1.1277 => 493.9804, std.dev.: 0.2183) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.63% (0.5229 => 1.5406, std.dev.: 0.0942) MultiSource/Applications/SPASS/SPASS: 21.93% (14.9895 => 18.2774, std.dev.: 0.1078) MultiSource/Applications/kimwitu++/kc: 50.61% (14.1553 => 21.3198, std.dev.: 0.1671) MultiSource/Benchmarks/MallocBench/gs/gs: 19.78% (4.1105 => 4.9236, std.dev.: 0.1513) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.89% (1.1048 => 1.5124, std.dev.: 0.0652) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 431.71% (7.1582 => 38.0608, std.dev.: 0.3163) SingleSource/Benchmarks/Misc-C++-EH/spirit: 75.39% (3.4629 => 6.0736, std.dev.: 0.3257) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.90% (0.6222 => 1.0322, std.dev.: 0.0008) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10621.94% (0.0720 => 7.7198, std.dev.: 0.2739) MultiSource/Applications/SIBsim4/SIBsim4: 3859800.00% (0.0001 => 3.8599, std.dev.: 0.0383) MultiSource/Applications/SPASS/SPASS: 14508100.00% (0.0001 => 14.5082, std.dev.: 1.1246) MultiSource/Applications/kimwitu++/kc: 52000.00% (0.0001 => 0.0521, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 63800.00% (0.0001 => 0.0639, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576900.00% (0.0001 => 0.5770, std.dev.: 0.0208) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10082500.00% (0.0001 => 10.0826, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5895500.00% (0.0001 => 5.8956, std.dev.: 0.7887) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1775.21% (1.1194 => 20.9911, std.dev.: 0.2382) MultiSource/Applications/ClamAV/clamscan: 69.83% (22.1758 => 37.6615, std.dev.: 0.4804) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 63.88% (2.9384 => 4.8154, std.dev.: 0.0595) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.69% (7.0540 => 10.9825, std.dev.: 0.0902) MultiSource/Benchmarks/FreeBench/distray/distray: 53.41% (0.1056 => 0.1620, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.47% (8.1363 => 12.1617, std.dev.: 0.1913) MultiSource/Applications/JM/lencod/lencod: 45.98% (21.9371 => 32.0235, std.dev.: 0.2022) SingleSource/Benchmarks/CoyoteBench/almabench: 38.90% (0.0730 => 0.1014, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 38.13% (0.1432 => 0.1978, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/lists: 32.91% (0.0626 => 0.0832, std.dev.: 0.0002) SingleSource/UnitTests/vla: 30.42% (0.0355 => 0.0463, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 29.48% (0.0814 => 0.1054, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 29.35% (0.0719 => 0.0930, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 29.31% (0.1655 => 0.2140, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 28.55% (0.0648 => 0.0833, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 28.24% (0.0871 => 0.1117, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 26.02% (0.1695 => 0.2136, std.dev.: 0.0063) SingleSource/Benchmarks/McGill/queens: 25.81% (0.0403 => 0.0507, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: 25.44% (0.0456 => 0.0572, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.16% (0.0457 => 0.0572, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.53% (0.0746 => 0.0929, std.dev.: 0.0051) SingleSource/Benchmarks/Stanford/Oscar: 24.37% (0.0636 => 0.0791, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.02% (3.8922 => 4.8271, std.dev.: 0.0732) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 23.79% (0.4615 => 0.5713, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 23.76% (0.0442 => 0.0547, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 23.54% (2.2024 => 2.7208, std.dev.: 0.0583) SingleSource/Benchmarks/Misc/whetstone: 23.03% (0.0660 => 0.0812, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/fibo: 22.90% (0.2725 => 0.3349, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/08-main/main: 22.87% (0.2554 => 0.3138, std.dev.: 0.0189) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.85% (0.2700 => 0.3317, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/except: 22.64% (0.2871 => 0.3521, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/lpbench: 22.50% (0.0929 => 0.1138, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 22.49% (0.4064 => 0.4978, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/moments: 22.48% (0.4048 => 0.4958, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 22.35% (0.0886 => 0.1084, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.23% (0.2758 => 0.3371, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/perlin: 22.01% (0.0536 => 0.0654, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 21.19% (0.0793 => 0.0961, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.15% (14.3668 => 17.4047, std.dev.: 0.2085) SingleSource/UnitTests/ObjC/dot-syntax-1: 21.09% (0.0479 => 0.0580, std.dev.: 0.0030) MultiSource/Applications/viterbi/viterbi: 21.03% (0.1555 => 0.1882, std.dev.: 0.0061) MultiSource/Applications/spiff/spiff: 20.93% (0.7835 => 0.9475, std.dev.: 0.0289) SingleSource/Benchmarks/McGill/misr: 20.70% (0.0633 => 0.0764, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: 20.60% (0.1175 => 0.1417, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.51% (0.1029 => 0.1240, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/nestedloop: 20.48% (0.2793 => 0.3365, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.37% (4.9449 => 5.9524, std.dev.: 0.0939) SingleSource/Benchmarks/Shootout-C++/hash: 20.14% (0.4289 => 0.5153, std.dev.: 0.0257) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.83% (0.8067 => 0.9667, std.dev.: 0.0280) SingleSource/UnitTests/SignlessTypes/Large/cast: 19.33% (0.0564 => 0.0673, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: 19.18% (1.5603 => 1.8595, std.dev.: 0.0392) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.02% (0.1125 => 0.1339, std.dev.: 0.0058) SingleSource/UnitTests/SignlessTypes/rem: 18.71% (0.1144 => 0.1358, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 18.68% (0.3684 => 0.4372, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.17% (0.0842 => 0.0995, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.06% (1.1861 => 1.4003, std.dev.: 0.0366) SingleSource/Benchmarks/Misc/ReedSolomon: 17.76% (0.2049 => 0.2413, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/messages-2: 17.37% (0.0662 => 0.0777, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.11% (0.8172 => 0.9570, std.dev.: 0.0370) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.81% (4.2646 => 4.9814, std.dev.: 0.2140) MultiSource/Applications/sgefa/sgefa: 16.79% (0.3109 => 0.3631, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.76% (0.2065 => 0.2411, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/objinst: 16.61% (0.3131 => 0.3651, std.dev.: 0.0168) MultiSource/Benchmarks/Olden/mst/mst: 16.60% (0.1163 => 0.1356, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 16.52% (0.0672 => 0.0783, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference: 16.41% (0.7326 => 0.8528, std.dev.: 0.0177) MultiSource/Applications/sqlite3/sqlite3: 16.30% (17.1811 => 19.9819, std.dev.: 0.2575) MultiSource/Benchmarks/mafft/pairlocalalign: 16.23% (9.4845 => 11.0239, std.dev.: 0.2987) MultiSource/Benchmarks/Olden/health/health: 16.09% (0.1268 => 0.1472, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout/matrix: 16.01% (0.0818 => 0.0949, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.58% (0.1117 => 0.1291, std.dev.: 0.0058) MultiSource/Applications/aha/aha: 15.55% (0.1151 => 0.1330, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.23% (0.0834 => 0.0961, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.19% (0.0770 => 0.0887, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.10% (2.0665 => 2.3785, std.dev.: 0.0690) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.09% (0.3121 => 0.3592, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/random: 15.06% (0.2802 => 0.3224, std.dev.: 0.0145) MultiSource/Benchmarks/nbench/nbench: 14.99% (1.1840 => 1.3615, std.dev.: 0.0595) MultiSource/Benchmarks/Bullet/bullet: 14.83% (63.2438 => 72.6232, std.dev.: 0.0697) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.64% (0.1236 => 0.1417, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.61% (5.0018 => 5.7326, std.dev.: 0.2388) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 14.45% (1.3050 => 1.4936, std.dev.: 0.0663) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.41% (0.1062 => 0.1215, std.dev.: 0.0049) MultiSource/Applications/oggenc/oggenc: 14.34% (5.7591 => 6.5847, std.dev.: 0.2926) SingleSource/UnitTests/ObjC/parameter-passing: 14.29% (0.3927 => 0.4488, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.25% (0.5981 => 0.6833, std.dev.: 0.0237) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.21% (0.3935 => 0.4494, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.20% (0.5569 => 0.6360, std.dev.: 0.0286) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.09% (0.2271 => 0.2591, std.dev.: 0.0104) SingleSource/UnitTests/ObjC/exceptions-2: 13.87% (0.3497 => 0.3982, std.dev.: 0.0078) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.77% (0.3543 => 0.4031, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.75% (0.5105 => 0.5807, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-4: 13.75% (0.3543 => 0.4030, std.dev.: 0.0089) SingleSource/UnitTests/ObjC/synchronized: 13.70% (0.3561 => 0.4049, std.dev.: 0.0171) SingleSource/UnitTests/ObjC/exceptions-3: 13.65% (0.3516 => 0.3996, std.dev.: 0.0095) SingleSource/UnitTests/ObjC/exceptions: 13.53% (0.3828 => 0.4346, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.39% (0.1143 => 0.1296, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/for-in: 13.37% (0.3694 => 0.4188, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 12.40% (10.3673 => 11.6529, std.dev.: 0.1636) MultiSource/Benchmarks/McCat/05-eks/eks: 12.28% (0.4299 => 0.4827, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.13% (0.3865 => 0.4334, std.dev.: 0.0125) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.01% (0.1906 => 0.2135, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.71% (0.4203 => 0.4695, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 11.02% (0.3603 => 0.4000, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/strcat: 9.86% (0.2831 => 0.3110, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 9.45% (0.2877 => 0.3149, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.18% (0.2756 => 0.3009, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.80% (0.2266 => 0.2420, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.63% (4.3953 => 11.0161, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/methcall: 147.64% (5.3999 => 13.3721, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: 25.19% (0.1159 => 0.1451, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 25.10% (9.1159 => 11.4036, std.dev.: 0.5022) SingleSource/Benchmarks/CoyoteBench/lpbench: 22.28% (10.3460 => 12.6509, std.dev.: 0.2710) SingleSource/Benchmarks/Shootout/heapsort: 17.75% (3.8526 => 4.5364, std.dev.: 0.0685) SingleSource/Benchmarks/Misc/oourafft: 17.68% (6.6465 => 7.8215, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.08% (1.1145 => 1.3049, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.98% (0.2944 => 0.3326, std.dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.60% (2.8904 => 3.2258, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.69% (8.6802 => 9.6081, std.dev.: 0.2440) SingleSource/Benchmarks/Misc/richards_benchmark: 10.18% (1.1396 => 1.2556, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.42% (1.7254 => 1.8880, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/hash: 6.96% (4.9088 => 5.2503, std.dev.: 0.1261) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.46% (3.1334 => 3.3359, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.89% (4.2280 => 4.4769, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.19% (3.6395 => 3.8284, std.dev.: 0.0242) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 4.79% (1.2373 => 1.2966, std.dev.: 0.0155) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.14% (11.6436 => 12.1253, std.dev.: 0.0128) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.33% (1.7133 => 1.7532, std.dev.: 0.0121) SingleSource/Benchmarks/Dhrystone/dry: 2.31% (2.4116 => 2.4673, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/lists: 2.22% (12.5348 => 12.8126, std.dev.: 0.0116) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.13% (1.3677 => 1.3969, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 2.06% (3.1595 => 3.2246, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.86% (2.1424 => 2.1823, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: 1.85% (85.0658 => 86.6374, std.dev.: 0.1150) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.49% (6.5088 => 6.6061, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 1.44% (27.8444 => 28.2448, std.dev.: 0.0356) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.33% (1.0313 => 1.0450, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0502, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.12% (5.2139 => 5.2724, std.dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.30% (6.6874 => 0.1804, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -75.47% (0.8651 => 0.2122, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.09% (5.2763 => 1.3145, std.dev.: 0.0199) SingleSource/Benchmarks/Misc/richards_benchmark: -44.70% (0.1622 => 0.0897, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.70% (5.3855 => 4.7014, std.dev.: 0.1574) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -11.28% (0.1330 => 0.1180, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.21% (5.3526 => 4.7524, std.dev.: 0.1619) MultiSource/Applications/JM/ldecod/ldecod: -9.48% (10.4361 => 9.4467, std.dev.: 0.3079) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.20% (0.0628 => 0.0363, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.75% (0.3987 => 0.2402, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.72% (0.0506 => 0.0305, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.28% (4.5009 => 2.7781, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: -33.52% (1.1492 => 0.7640, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -27.81% (10.7105 => 7.7318, std.dev.: 0.5724) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.13% (2.6546 => 2.0141, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -19.30% (0.2161 => 0.1744, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.59% (1.6925 => 1.4287, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2838, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.73% (32.5116 => 29.0234, std.dev.: 0.0234) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -9.96% (9.5636 => 8.6115, std.dev.: 0.2099) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.03% (1.5660 => 1.4246, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.45% (3.2416 => 3.0325, std.dev.: 0.0204) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.58% (2.7294 => 2.5772, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -4.71% (1.5835 => 1.5089, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -4.24% (6.2999 => 6.0330, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.41% (0.9957 => 0.9617, std.dev.: 0.0033) MultiSource/Benchmarks/sim/sim: -3.09% (5.0483 => 4.8921, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.05% (19.9488 => 19.3401, std.dev.: 0.1097) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.27% (0.4808 => 0.4699, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6771, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.77% (8.1563 => 8.0123, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/salsa20: -1.47% (10.2830 => 10.1320, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0016) Report Time: 2.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 07:01:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 09:01:33 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121119150133.0CABF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6038?compare_to=6035&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6038, Order: 168310, Start Time: 2012-11-19 13:28:03, End Time: 2012-11-19 15:01:56 To: 6035, Order: 168304, Start Time: 2012-11-19 11:31:13, End Time: 2012-11-19 13:05:00 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (5 on baseline) Performance Improvements: 0 (177 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1090 (860 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 8.00% (0.4085 => 0.4412, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.10% (78.6034 => 80.2506, std.dev.: 0.3980) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.08% (0.3834 => 0.4412, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.25% (1.2783 => 1.3710, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.68% (2.0478 => 2.1026, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/salsa20: 2.34% (7.4937 => 7.6694, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/hash2: 2.07% (3.1932 => 3.2592, std.dev.: 0.0077) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.51% (0.3821 => 0.3534, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -6.94% (2.4924 => 2.3195, std.dev.: 0.0152) MultiSource/Applications/sgefa/sgefa: -6.64% (0.3357 => 0.3134, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.37% (0.9542 => 0.8934, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.10% (0.2428 => 0.2280, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.06% (9.2283 => 8.6692, std.dev.: 0.0056) MultiSource/Applications/JM/lencod/lencod: -6.01% (16.1920 => 15.2192, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.00% (0.7198 => 0.6766, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: -5.97% (0.2160 => 0.2031, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/football/football: -5.97% (0.9179 => 0.8631, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.97% (0.6484 => 0.6097, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -5.90% (7.0961 => 6.6771, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -5.89% (0.3142 => 0.2957, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.82% (0.2355 => 0.2218, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.82% (0.9852 => 0.9279, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.80% (1.0544 => 0.9932, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.79% (1.3722 => 1.2927, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.78% (3.5339 => 3.3295, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.71% (0.3658 => 0.3449, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.70% (0.5478 => 0.5166, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.65% (0.5805 => 0.5477, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.64% (0.2695 => 0.2543, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.62% (6.7716 => 6.3907, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.61% (0.5863 => 0.5534, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.61% (1.6364 => 1.5446, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.60% (0.5802 => 0.5477, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.60% (0.6052 => 0.5713, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.60% (0.5591 => 0.5278, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (0.5857 => 0.5533, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: -5.53% (1.1450 => 1.0817, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: -5.52% (1.1530 => 1.0893, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.52% (0.6230 => 0.5886, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -5.52% (0.3880 => 0.3666, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.51% (0.5859 => 0.5536, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -5.51% (0.3848 => 0.3636, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.50% (0.5925 => 0.5599, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.48% (0.6660 => 0.6295, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.47% (0.6304 => 0.5959, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.47% (0.5705 => 0.5393, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.45% (1.2300 => 1.1630, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/synchronized: -5.44% (0.3896 => 0.3684, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.43% (0.6297 => 0.5955, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -5.43% (0.4033 => 0.3814, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.42% (0.5570 => 0.5268, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.42% (0.5849 => 0.5532, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.41% (0.4176 => 0.3950, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.41% (4.8802 => 4.6161, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.41% (1.4642 => 1.3850, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.41% (0.6194 => 0.5859, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.40% (0.6681 => 0.6320, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.40% (4.0323 => 3.8145, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.38% (4.8161 => 4.5568, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/05-eks/eks: -5.38% (0.4515 => 0.4272, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -5.38% (0.3812 => 0.3607, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.37% (0.6260 => 0.5924, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.37% (4.5069 => 4.2651, std.dev.: 0.0134) SingleSource/UnitTests/ObjC/exceptions-2: -5.35% (0.3831 => 0.3626, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.35% (0.3891 => 0.3683, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.34% (1.2784 => 1.2101, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.34% (0.6293 => 0.5957, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -5.32% (4.3330 => 4.1025, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.31% (0.6667 => 0.6313, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.30% (0.5581 => 0.5285, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.30% (0.7919 => 0.7499, std.dev.: 0.0037) MultiSource/Benchmarks/sim/sim: -5.28% (0.3406 => 0.3226, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.28% (0.6189 => 0.5862, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.26% (0.6446 => 0.6107, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -5.25% (0.3255 => 0.3084, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.24% (0.5456 => 0.5170, std.dev.: 0.0094) MultiSource/Applications/SIBsim4/SIBsim4: -5.23% (1.3864 => 1.3139, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.20% (0.8521 => 0.8078, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.20% (14.2083 => 13.4698, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.20% (0.3483 => 0.3302, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.18% (1.3148 => 1.2467, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -5.17% (0.3194 => 0.3029, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.17% (0.5575 => 0.5287, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -5.16% (0.3025 => 0.2869, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -5.14% (17.1032 => 16.2246, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/bh/bh: -5.13% (0.2985 => 0.2832, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.12% (8.0126 => 7.6020, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.12% (0.5999 => 0.5692, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.11% (1.2210 => 1.1586, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.10% (0.5941 => 0.5638, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.08% (0.6676 => 0.6337, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.07% (0.4199 => 0.3986, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.06% (0.5688 => 0.5400, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.06% (0.6736 => 0.6395, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.06% (0.4151 => 0.3941, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: -5.06% (0.3026 => 0.2873, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.06% (0.6033 => 0.5728, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.03% (0.3837 => 0.3644, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: -5.03% (0.3581 => 0.3401, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: -5.03% (1.2515 => 1.1886, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.02% (1.2221 => 1.1608, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.01% (0.3252 => 0.3089, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.00% (1.6474 => 1.5650, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.97% (0.3323 => 0.3158, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.96% (0.3849 => 0.3658, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.95% (0.6440 => 0.6121, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.94% (0.3884 => 0.3692, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.94% (0.3057 => 0.2906, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.94% (0.3931 => 0.3737, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.93% (0.2999 => 0.2851, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -4.93% (0.3446 => 0.3276, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.92% (0.4916 => 0.4674, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.92% (2.1713 => 2.0645, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/strcat: -4.92% (0.2989 => 0.2842, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.90% (0.4813 => 0.4577, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: -4.89% (0.3394 => 0.3228, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -4.88% (15.5079 => 14.7508, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.87% (0.3016 => 0.2869, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -4.87% (0.3059 => 0.2910, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.87% (0.2548 => 0.2424, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -4.83% (0.4248 => 0.4043, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.82% (0.2385 => 0.2270, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -4.80% (0.2939 => 0.2798, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -4.80% (0.3481 => 0.3314, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.78% (0.2278 => 0.2169, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -4.78% (3.5154 => 3.3475, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/fibo: -4.77% (0.2871 => 0.2734, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/parameter-passing: -4.77% (0.4280 => 0.4076, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -4.76% (4.0594 => 3.8662, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.74% (0.2933 => 0.2794, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -4.74% (0.2659 => 0.2533, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -4.73% (0.4861 => 0.4631, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.73% (0.7339 => 0.6992, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.72% (0.2903 => 0.2766, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: -4.70% (0.2849 => 0.2715, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.70% (0.3319 => 0.3163, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -4.69% (15.2527 => 14.5381, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/lists1: -4.68% (0.3867 => 0.3686, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: -4.66% (0.7447 => 0.7100, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.66% (0.7021 => 0.6694, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -4.65% (0.3205 => 0.3056, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.62% (0.5329 => 0.5083, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.61% (0.4321 => 0.4122, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.60% (0.6395 => 0.6101, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -4.58% (0.3621 => 0.3455, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.58% (0.6395 => 0.6102, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.58% (22.4056 => 21.3799, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.55% (0.7524 => 0.7182, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.53% (0.5168 => 0.4934, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -4.51% (5.0226 => 4.7959, std.dev.: 0.0036) MultiSource/Applications/siod/siod: -4.43% (2.4021 => 2.2957, std.dev.: 0.0026) MultiSource/Applications/treecc/treecc: -4.41% (2.1401 => 2.0458, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.40% (0.5569 => 0.5324, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.36% (0.4427 => 0.4234, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.34% (0.4083 => 0.3906, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.32% (0.9557 => 0.9144, std.dev.: 0.0053) MultiSource/Benchmarks/Bullet/bullet: -4.31% (34.0927 => 32.6239, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.30% (2.2587 => 2.1615, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: -4.30% (0.3788 => 0.3625, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -4.29% (0.7779 => 0.7445, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: -4.22% (0.6441 => 0.6169, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -4.22% (0.6347 => 0.6079, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -4.19% (0.3271 => 0.3134, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: -4.15% (0.8418 => 0.8069, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.13% (0.5567 => 0.5337, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -4.12% (0.6750 => 0.6472, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -3.98% (0.4524 => 0.4344, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.95% (0.3491 => 0.3353, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.94% (0.9077 => 0.8719, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -3.85% (0.7982 => 0.7675, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: -3.72% (1.5610 => 1.5029, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: -3.69% (18.2933 => 17.6190, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.28% (5.4682 => 5.2887, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -2.17% (20.7746 => 20.3238, std.dev.: 0.0381) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7549, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1723, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: -4.18% (2.2633 => 2.1687, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4701, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 07:23:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 09:23:25 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121119152325.AD58D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6039?compare_to=6033&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6039, Order: 168304, Start Time: 2012-11-19 12:02:32, End Time: 2012-11-19 15:23:48 To: 6033, Order: 168297, Start Time: 2012-11-19 07:50:37, End Time: 2012-11-19 11:14:22 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (171 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1090 (721 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 32.51% (56.5516 => 74.9378, std.dev.: 0.0207) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.41% (0.3926 => 0.3792, std.dev.: 0.0050) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.20% (0.0625 => 0.0895, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.68% (0.1063 => 0.1421, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.06% (0.4253 => 0.5404, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.61% (0.0714 => 0.0904, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.58% (0.1106 => 0.1400, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.31% (0.2969 => 0.3750, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 25.59% (1.5932 => 2.0009, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.56% (0.4139 => 0.5197, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.25% (0.4994 => 0.6205, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.79% (0.0475 => 0.0588, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.69% (0.5900 => 0.7298, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.62% (0.5000 => 0.6181, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.46% (0.0584 => 0.0721, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.30% (0.0897 => 0.1097, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 22.20% (0.0599 => 0.0732, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.95% (0.1107 => 0.1350, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.91% (0.1620 => 0.1975, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.84% (0.1021 => 0.1244, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.89% (0.0584 => 0.0706, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.70% (0.0633 => 0.0764, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.60% (0.3903 => 0.4707, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 20.57% (0.0948 => 0.1143, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.49% (0.1103 => 0.1329, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.25% (0.0642 => 0.0772, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.24% (0.1003 => 0.1206, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.21% (0.1549 => 0.1862, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 20.10% (0.0821 => 0.0986, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.83% (0.0822 => 0.0985, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 19.83% (0.1619 => 0.1940, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.76% (0.1604 => 0.1921, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.36% (0.1462 => 0.1745, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 19.18% (0.0808 => 0.0963, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 19.01% (0.0947 => 0.1127, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.97% (0.3890 => 0.4628, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.86% (0.2736 => 0.3252, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 18.52% (0.4029 => 0.4775, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.48% (1.3152 => 1.5582, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.37% (0.2014 => 0.2384, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 18.09% (0.5826 => 0.6880, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 18.06% (0.1218 => 0.1438, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 17.87% (0.1505 => 0.1774, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 17.78% (0.5889 => 0.6936, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 17.77% (0.0698 => 0.0822, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.74% (0.1088 => 0.1281, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.55% (0.2866 => 0.3369, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.52% (0.0605 => 0.0711, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 17.45% (1.8794 => 2.2074, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 17.44% (0.5546 => 0.6513, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.37% (0.4658 => 0.5467, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.30% (1.6211 => 1.9015, std.dev.: 0.0042) MultiSource/Applications/hbd/hbd: 17.06% (0.9697 => 1.1351, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.04% (3.5627 => 4.1698, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.02% (0.1968 => 0.2303, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 16.97% (1.0781 => 1.2610, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.90% (0.2875 => 0.3361, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.84% (0.2738 => 0.3199, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.81% (0.3271 => 0.3821, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.72% (0.1160 => 0.1354, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.42% (4.4195 => 5.1452, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/18-imp/imp: 16.40% (0.1421 => 0.1654, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.33% (0.4361 => 0.5073, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.32% (0.5026 => 0.5846, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hello: 16.25% (0.2714 => 0.3155, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 16.24% (4.2109 => 4.8948, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: 16.22% (0.2780 => 0.3231, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.16% (0.2729 => 0.3170, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.15% (0.2792 => 0.3243, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 16.15% (0.2811 => 0.3265, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.15% (0.1090 => 0.1266, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 16.15% (0.2725 => 0.3165, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 16.11% (0.3004 => 0.3488, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.06% (0.3930 => 0.4561, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: 16.04% (0.1284 => 0.1490, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 15.96% (0.2750 => 0.3189, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 15.94% (0.9909 => 1.1488, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/random: 15.91% (0.2803 => 0.3249, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 15.91% (0.2823 => 0.3272, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 15.83% (0.3096 => 0.3586, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.82% (2.7292 => 3.1609, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/methcall: 15.78% (0.2813 => 0.3257, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.77% (1.9694 => 2.2800, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 15.76% (0.7171 => 0.8301, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.70% (0.2911 => 0.3368, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.52% (2.0673 => 2.3881, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary3: 15.43% (0.3267 => 0.3771, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 15.37% (0.2075 => 0.2394, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.37% (0.3195 => 0.3686, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.29% (1.9966 => 2.3019, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary: 15.25% (0.3258 => 0.3755, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 15.07% (0.3317 => 0.3817, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.00% (0.3060 => 0.3519, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 14.65% (0.3726 => 0.4272, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 14.60% (23.5202 => 26.9533, std.dev.: 0.0138) MultiSource/Benchmarks/nbench/nbench: 14.58% (0.2566 => 0.2940, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/for-in: 14.56% (0.3496 => 0.4005, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 14.55% (0.3348 => 0.3835, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.54% (0.3362 => 0.3851, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 14.54% (0.3446 => 0.3947, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.50% (0.3469 => 0.3972, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 14.43% (0.3465 => 0.3965, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.34% (0.3124 => 0.3572, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.34% (0.3460 => 0.3956, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.33% (0.3488 => 0.3988, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/moments: 14.33% (0.3678 => 0.4205, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.29% (0.3282 => 0.3751, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 14.29% (1.4269 => 1.6308, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/trivial-interface: 14.26% (0.3442 => 0.3933, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 14.19% (0.3650 => 0.4168, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 14.12% (0.3477 => 0.3968, std.dev.: 0.0087) MultiSource/Applications/treecc/treecc: 14.11% (0.7875 => 0.8986, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.09% (0.3981 => 0.4542, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 14.06% (0.4146 => 0.4729, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.04% (0.3625 => 0.4134, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.94% (0.3643 => 0.4151, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 13.86% (2.1653 => 2.4654, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 13.86% (0.3724 => 0.4240, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: 13.85% (0.0758 => 0.0863, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.82% (0.3690 => 0.4200, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 13.78% (0.4251 => 0.4837, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 13.63% (4.6177 => 5.2470, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.45% (0.3845 => 0.4362, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.04% (0.2040 => 0.2306, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 12.99% (0.5012 => 0.5663, std.dev.: 0.0133) MultiSource/Benchmarks/mafft/pairlocalalign: 12.95% (2.1013 => 2.3735, std.dev.: 0.0036) MultiSource/Applications/SIBsim4/SIBsim4: 12.82% (0.2691 => 0.3036, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 12.11% (5.5417 => 6.2126, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.09% (0.6435 => 0.7213, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.93% (0.1383 => 0.1548, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 11.58% (0.6634 => 0.7402, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 11.46% (0.3498 => 0.3899, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.19% (0.1028 => 0.1143, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 11.06% (0.4847 => 0.5383, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.03% (0.2737 => 0.3039, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.03% (0.2068 => 0.2296, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.54% (0.3084 => 0.3409, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 10.53% (2.0346 => 2.2489, std.dev.: 0.0048) MultiSource/Applications/lemon/lemon: 10.46% (0.2391 => 0.2641, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 10.16% (0.3336 => 0.3675, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.70% (0.2103 => 0.2307, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.35% (0.5361 => 0.5862, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.73% (4.6926 => 5.1023, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.69% (0.7426 => 0.8071, std.dev.: 0.0124) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.54% (11.6398 => 12.6339, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.31% (0.5584 => 0.6048, std.dev.: 0.0056) MultiSource/Applications/kimwitu++/kc: 7.03% (11.9555 => 12.7960, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.93% (0.3792 => 0.3979, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.10% (0.2802 => 0.3057, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6091, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 5.75% (0.2122 => 0.2244, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6708, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-2: 4.74% (1.8057 => 1.8912, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1687, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6441, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary3: 2.00% (15.8721 => 16.1894, std.dev.: 0.0114) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.76% (3.1722 => 3.2280, std.dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3085, std.dev.: 0.0115) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2876, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5799, std.dev.: 0.0167) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5617, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/ary2: -9.74% (0.2402 => 0.2168, std.dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9769, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7989, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8020, std.dev.: 0.0111) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std.dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: -2.91% (17.2379 => 16.7371, std.dev.: 0.0522) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8712, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.81% (10.7630 => 10.5678, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4949, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1511, std.dev.: 0.0266) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0429, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 09:12:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 11:12:47 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121119171247.4D5E42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6040?compare_to=6037&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6040, Order: 168310, Start Time: 2012-11-19 14:54:04, End Time: 2012-11-19 17:13:09 To: 6037, Order: 168304, Start Time: 2012-11-19 11:41:02, End Time: 2012-11-19 14:01:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 49 (171 on baseline) Performance Improvements: 12 (41 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1027 (675 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 17.78% (0.1417 => 0.1669, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/heapsort: 13.53% (0.3126 => 0.3549, std.dev.: 0.0096) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.32% (0.5134 => 0.5818, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.53% (1.0322 => 1.1615, std.dev.: 0.0248) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.36% (0.5633 => 0.6329, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/sieve: 12.35% (0.4000 => 0.4494, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.14% (0.4695 => 0.5265, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.89% (1.1102 => 1.2422, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.51% (0.3170 => 0.3535, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/wc: 11.09% (0.3326 => 0.3695, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 11.08% (0.3149 => 0.3498, std.dev.: 0.0088) SingleSource/Benchmarks/LivermoreLoops/kernel06: 10.66% (0.1051 => 0.1163, std.dev.: 0.0028) SingleSource/Benchmarks/LivermoreLoops/kernel03: 10.59% (0.1001 => 0.1107, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 10.58% (0.3110 => 0.3439, std.dev.: 0.0108) SingleSource/Benchmarks/LivermoreLoops/kernel04: 10.49% (0.1068 => 0.1180, std.dev.: 0.0028) SingleSource/Benchmarks/LivermoreLoops/kernel07: 10.45% (0.1053 => 0.1163, std.dev.: 0.0034) MultiSource/Benchmarks/sim/sim: 10.40% (0.3722 => 0.4109, std.dev.: 0.0136) MultiSource/Applications/siod/siod: 10.28% (2.6466 => 2.9188, std.dev.: 0.0465) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.07% (0.6681 => 0.7354, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/health/health: 9.38% (0.1472 => 0.1610, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hello: 9.31% (0.2965 => 0.3241, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.30% (0.3775 => 0.4126, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.71% (4.9814 => 5.4154, std.dev.: 0.0269) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.33% (0.1296 => 0.1404, std.dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.27% (0.3592 => 0.3889, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.67% (0.4044 => 0.4354, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.29% (1.5124 => 1.6226, std.dev.: 0.0140) MultiSource/Applications/JM/ldecod/ldecod: 6.85% (9.4467 => 10.0937, std.dev.: 0.0591) SingleSource/Benchmarks/Shootout-C++/ary3: 6.40% (0.3593 => 0.3823, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/em3d/em3d: 6.06% (0.1980 => 0.2100, std.dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: 5.67% (51.9387 => 54.8816, std.dev.: 0.7762) MultiSource/Applications/sgefa/sgefa: 5.26% (0.3631 => 0.3822, std.dev.: 0.0055) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.85% (8.1699 => 8.5664, std.dev.: 0.1088) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.73% (0.9667 => 1.0124, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.04% (0.3317 => 0.3451, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.40% (12.1617 => 12.5752, std.dev.: 0.0319) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 50.34% (5.9948 => 9.0123, std.dev.: 0.0181) SingleSource/Benchmarks/CoyoteBench/fftbench: 28.73% (2.1035 => 2.7079, std.dev.: 0.0236) SingleSource/Benchmarks/Shootout/ary3: 25.11% (3.8427 => 4.8075, std.dev.: 0.1406) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 19.69% (3.7942 => 4.5413, std.dev.: 0.1242) MultiSource/Benchmarks/Bullet/bullet: 17.43% (7.7318 => 9.0795, std.dev.: 0.0262) MultiSource/Benchmarks/Olden/bisort/bisort: 15.62% (0.8673 => 1.0028, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/tsp/tsp: 11.64% (1.1031 => 1.2315, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hash2: 7.52% (3.3686 => 3.6219, std.dev.: 0.0202) MultiSource/Applications/JM/lencod/lencod: 6.56% (7.7198 => 8.2260, std.dev.: 0.0553) SingleSource/Benchmarks/Misc/ffbench: 6.00% (0.9934 => 1.0530, std.dev.: 0.0151) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.52% (0.3326 => 0.3443, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 2.11% (0.6304 => 0.6437, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.79% (2.3080 => 2.3493, std.dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/NPB-serial/is/is: -11.29% (0.0930 => 0.0825, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/fibo: -10.84% (0.3349 => 0.2986, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/moments: -9.36% (0.4958 => 0.4494, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/ReedSolomon: -8.83% (0.2413 => 0.2200, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/himenobmtxpa: -8.55% (0.2420 => 0.2213, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.87% (1.4003 => 1.3181, std.dev.: 0.0316) SingleSource/UnitTests/ObjC++/property-reference: -5.16% (0.8528 => 0.8088, std.dev.: 0.0152) MultiSource/Applications/spiff/spiff: -5.15% (0.9475 => 0.8987, std.dev.: 0.0106) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -13.54% (4.5364 => 3.9222, std.dev.: 0.1626) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.01% (3.3359 => 3.1353, std.dev.: 0.0695) SingleSource/Benchmarks/Misc/himenobmtxpa: -2.98% (3.8284 => 3.7142, std.dev.: 0.0279) SingleSource/Benchmarks/Shootout-C++/lists: -1.82% (12.8126 => 12.5797, std.dev.: 0.0393) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.15% (0.1339 => 0.1337, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0420 => 0.0421, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0652 => 0.0651, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 0.07% (493.9804 => 494.3331, std.dev.: 0.0107) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0421, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: 43735.51% (1.1277 => 494.3331, std.dev.: 0.0107) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.49% (0.5229 => 1.5399, std.dev.: 0.0667) MultiSource/Applications/SPASS/SPASS: 22.45% (14.9895 => 18.3542, std.dev.: 0.0033) MultiSource/Applications/kimwitu++/kc: 50.15% (14.1553 => 21.2540, std.dev.: 0.2239) MultiSource/Benchmarks/MallocBench/gs/gs: 17.34% (4.1105 => 4.8231, std.dev.: 0.1014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 46.87% (1.1048 => 1.6226, std.dev.: 0.0140) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 435.85% (7.1582 => 38.3572, std.dev.: 0.4586) SingleSource/Benchmarks/Misc-C++-EH/spirit: 77.90% (3.4629 => 6.1604, std.dev.: 0.4454) SingleSource/Benchmarks/Misc-C++/stepanov_container: 86.68% (0.6222 => 1.1615, std.dev.: 0.0248) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11325.00% (0.0720 => 8.2260, std.dev.: 0.0553) MultiSource/Applications/SIBsim4/SIBsim4: 3860300.00% (0.0001 => 3.8604, std.dev.: 0.0228) MultiSource/Applications/SPASS/SPASS: 15182900.00% (0.0001 => 15.1830, std.dev.: 1.0355) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 63800.00% (0.0001 => 0.0639, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14400.00% (0.0001 => 0.0145, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576600.00% (0.0001 => 0.5767, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10081300.00% (0.0001 => 10.0814, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6341500.00% (0.0001 => 6.3416, std.dev.: 0.5930) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1779.27% (1.1194 => 21.0365, std.dev.: 0.2670) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 70.72% (2.9384 => 5.0165, std.dev.: 0.2101) MultiSource/Applications/ClamAV/clamscan: 69.88% (22.1758 => 37.6733, std.dev.: 0.3880) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.12% (7.0540 => 11.0835, std.dev.: 0.2271) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 54.56% (8.1363 => 12.5752, std.dev.: 0.0319) SingleSource/Benchmarks/CoyoteBench/almabench: 48.36% (0.0730 => 0.1083, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 46.39% (21.9371 => 32.1143, std.dev.: 0.1696) MultiSource/Benchmarks/FreeBench/distray/distray: 45.55% (0.1056 => 0.1537, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 38.48% (0.1432 => 0.1983, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/dot-syntax-1: 35.28% (0.0479 => 0.0648, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 35.03% (0.1236 => 0.1669, std.dev.: 0.0026) SingleSource/Benchmarks/Stanford/Oscar: 33.49% (0.0636 => 0.0849, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 30.89% (0.1175 => 0.1538, std.dev.: 0.0058) SingleSource/UnitTests/vla: 30.70% (0.0355 => 0.0464, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bisort/bisort: 28.83% (0.0614 => 0.0791, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 27.81% (0.2700 => 0.3451, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 27.21% (0.9765 => 1.2422, std.dev.: 0.0078) MultiSource/Applications/siod/siod: 27.08% (2.2969 => 2.9188, std.dev.: 0.0465) MultiSource/Benchmarks/MallocBench/espresso/espresso: 26.98% (4.2646 => 5.4154, std.dev.: 0.0269) MultiSource/Benchmarks/Olden/health/health: 26.97% (0.1268 => 0.1610, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: 26.66% (0.2554 => 0.3235, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/functionobjects: 26.08% (0.5020 => 0.6329, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout/matrix: 26.04% (0.0818 => 0.1031, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 25.50% (0.8067 => 1.0124, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/fftbench: 25.50% (0.4636 => 0.5818, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 25.49% (0.5860 => 0.7354, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/spellcheck: 25.27% (0.4203 => 0.5265, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.26% (0.0479 => 0.0600, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 24.77% (0.3307 => 0.4126, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/sieve: 24.73% (0.3603 => 0.4494, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.66% (0.0746 => 0.0930, std.dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.61% (0.3121 => 0.3889, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.09% (0.0793 => 0.0984, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/treeadd/treeadd: 24.04% (0.0416 => 0.0516, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 23.89% (0.1695 => 0.2100, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/heapsort: 23.57% (0.2872 => 0.3549, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 23.18% (0.6675 => 0.8222, std.dev.: 0.0323) MultiSource/Applications/sgefa/sgefa: 22.93% (0.3109 => 0.3822, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.86% (0.0770 => 0.0946, std.dev.: 0.0049) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.83% (0.1143 => 0.1404, std.dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: 22.45% (0.0481 => 0.0589, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 22.28% (0.2891 => 0.3535, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 22.01% (14.3668 => 17.5290, std.dev.: 0.1700) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 22.01% (0.0886 => 0.1081, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fbench: 21.62% (0.0592 => 0.0720, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 21.58% (0.2877 => 0.3498, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/strcat: 21.48% (0.2831 => 0.3439, std.dev.: 0.0108) MultiSource/Benchmarks/sim/sim: 21.32% (0.3387 => 0.4109, std.dev.: 0.0136) MultiSource/Applications/viterbi/viterbi: 21.29% (0.1555 => 0.1886, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wc: 21.07% (0.3052 => 0.3695, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.90% (0.1584 => 0.1915, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.56% (0.2758 => 0.3325, std.dev.: 0.0135) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.43% (0.1062 => 0.1279, std.dev.: 0.0025) MultiSource/Applications/treecc/treecc: 20.31% (2.0273 => 2.4391, std.dev.: 0.0704) SingleSource/Benchmarks/Shootout-C++/ackermann: 20.25% (0.2756 => 0.3314, std.dev.: 0.0142) MultiSource/Applications/hbd/hbd: 20.21% (1.5603 => 1.8756, std.dev.: 0.0302) SingleSource/UnitTests/ObjC/exceptions-2: 19.79% (0.3497 => 0.4189, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.76% (5.0018 => 5.9901, std.dev.: 0.1177) MultiSource/Benchmarks/VersaBench/bmm/bmm: 19.63% (0.0759 => 0.0908, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 19.57% (0.3516 => 0.4204, std.dev.: 0.0171) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.43% (0.8172 => 0.9760, std.dev.: 0.0359) SingleSource/Benchmarks/Shootout-C++/hello: 19.42% (0.2714 => 0.3241, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.12% (0.0842 => 0.1003, std.dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.11% (0.1125 => 0.1340, std.dev.: 0.0049) MultiSource/Applications/lua/lua: 18.24% (3.8723 => 4.5787, std.dev.: 0.1653) SingleSource/Benchmarks/Shootout-C++/ary2: 18.08% (0.3379 => 0.3990, std.dev.: 0.0209) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 17.96% (2.2024 => 2.5979, std.dev.: 0.0993) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.34% (0.0871 => 0.1022, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 17.11% (0.0672 => 0.0787, std.dev.: 0.0043) SingleSource/Benchmarks/Stanford/Puzzle: 16.96% (0.1268 => 0.1483, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-4: 16.74% (0.3543 => 0.4136, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.71% (0.2065 => 0.2410, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/mst/mst: 16.60% (0.1163 => 0.1356, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.58% (2.0665 => 2.4092, std.dev.: 0.0916) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.51% (0.0648 => 0.0755, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.47% (0.1117 => 0.1301, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: 16.45% (0.3283 => 0.3823, std.dev.: 0.0085) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.26% (0.0953 => 0.1108, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists: 16.22% (0.3422 => 0.3977, std.dev.: 0.0140) MultiSource/Applications/sqlite3/sqlite3: 16.17% (17.1811 => 19.9587, std.dev.: 0.2614) MultiSource/Benchmarks/Ptrdist/ft/ft: 16.13% (0.1940 => 0.2253, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.19% (0.0770 => 0.0887, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: 15.19% (0.3232 => 0.3723, std.dev.: 0.0179) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.11% (0.0834 => 0.0960, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/ffbench: 15.04% (0.0705 => 0.0811, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 14.94% (63.2438 => 72.6918, std.dev.: 0.0927) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.76% (0.2107 => 0.2418, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 14.74% (0.0719 => 0.0825, std.dev.: 0.0032) MultiSource/Applications/spiff/spiff: 14.70% (0.7835 => 0.8987, std.dev.: 0.0106) MultiSource/Benchmarks/mafft/pairlocalalign: 14.64% (9.4845 => 10.8734, std.dev.: 0.0918) SingleSource/UnitTests/ObjC/trivial-interface: 14.63% (0.3473 => 0.3981, std.dev.: 0.0122) SingleSource/UnitTests/ObjC/parameter-passing: 14.62% (0.3927 => 0.4501, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.58% (0.1337 => 0.1532, std.dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.49% (0.0704 => 0.0806, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.48% (0.1029 => 0.1178, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/synchronized: 14.35% (0.3561 => 0.4072, std.dev.: 0.0135) SingleSource/UnitTests/ObjC/property: 14.33% (0.3886 => 0.4443, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.25% (0.5981 => 0.6833, std.dev.: 0.0267) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.22% (0.5569 => 0.6361, std.dev.: 0.0133) SingleSource/UnitTests/ObjC/exceptions: 14.18% (0.3828 => 0.4371, std.dev.: 0.0189) SingleSource/UnitTests/ObjC/for-in: 14.10% (0.3694 => 0.4215, std.dev.: 0.0165) SingleSource/UnitTests/ObjC/block-byref-aggr: 14.07% (0.3817 => 0.4354, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.00% (0.2271 => 0.2589, std.dev.: 0.0030) MultiSource/Applications/oggenc/oggenc: 13.99% (5.7591 => 6.5649, std.dev.: 0.2236) SingleSource/Benchmarks/Misc/oourafft: 13.83% (0.3282 => 0.3736, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.71% (0.1510 => 0.1717, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.58% (0.8101 => 0.9201, std.dev.: 0.0348) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.51% (0.3441 => 0.3906, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.28% (1.5415 => 1.7462, std.dev.: 0.0736) MultiSource/Applications/d/make_dparser: 13.26% (3.3354 => 3.7778, std.dev.: 0.1380) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.06% (1.3050 => 1.4754, std.dev.: 0.0473) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.97% (4.9449 => 5.5861, std.dev.: 0.2078) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.16% (0.0929 => 0.1042, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.13% (1.1861 => 1.3181, std.dev.: 0.0316) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.05% (0.1892 => 0.2101, std.dev.: 0.0072) SingleSource/UnitTests/ObjC++/property-reference-object: 11.04% (0.6030 => 0.6696, std.dev.: 0.0153) SingleSource/UnitTests/ObjC++/Hello: 11.04% (0.5925 => 0.6579, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/moments: 11.02% (0.4048 => 0.4494, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.99% (0.2603 => 0.2889, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 10.71% (0.2905 => 0.3216, std.dev.: 0.0099) SingleSource/UnitTests/ObjC++/property-reference: 10.40% (0.7326 => 0.8088, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.40% (1.4186 => 1.5661, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 10.25% (0.1463 => 0.1613, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.88% (0.2430 => 0.2670, std.dev.: 0.0060) MultiSource/Benchmarks/PAQ8p/paq8p: 9.74% (10.3673 => 11.3771, std.dev.: 0.2483) SingleSource/Benchmarks/Shootout-C++/fibo: 9.58% (0.2725 => 0.2986, std.dev.: 0.0101) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.60% (7.9617 => 8.5664, std.dev.: 0.1088) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.59% (0.3427 => 0.3687, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.82% (2.2022 => 2.3303, std.dev.: 0.0248) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.23% (4.3953 => 10.9984, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/methcall: 147.56% (5.3999 => 13.3681, std.dev.: 0.0068) MultiSource/Benchmarks/llubenchmark/llu: 138.54% (3.7781 => 9.0123, std.dev.: 0.0181) SingleSource/Benchmarks/CoyoteBench/fftbench: 33.00% (2.0360 => 2.7079, std.dev.: 0.0236) SingleSource/Benchmarks/Shootout/ary3: 29.95% (3.6994 => 4.8075, std.dev.: 0.1406) MultiSource/Applications/minisat/minisat: 22.60% (9.1159 => 11.1759, std.dev.: 0.6946) MultiSource/Benchmarks/Olden/bisort/bisort: 20.34% (0.8333 => 1.0028, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/oourafft: 17.42% (6.6465 => 7.8045, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.95% (0.2944 => 0.3443, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.66% (1.1145 => 1.3002, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 14.70% (3.1578 => 3.6219, std.dev.: 0.0202) MultiSource/Benchmarks/Olden/tsp/tsp: 14.19% (1.0785 => 1.2315, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/heapsort: 11.99% (3.8532 => 4.3152, std.dev.: 0.1660) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.60% (2.8904 => 3.2257, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/ffbench: 10.78% (0.9505 => 1.0530, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/richards_benchmark: 10.28% (1.1396 => 1.2568, std.dev.: 0.0014) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.30% (1.7254 => 1.8859, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/strcat: 7.16% (0.1899 => 0.2035, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.65% (4.2280 => 4.4667, std.dev.: 0.0107) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.02% (11.6436 => 12.1119, std.dev.: 0.0074) MultiSource/Applications/sgefa/sgefa: 3.44% (0.6223 => 0.6437, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.79% (1.7133 => 1.7611, std.dev.: 0.0079) SingleSource/Benchmarks/Dhrystone/dry: 2.75% (2.4116 => 2.4780, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.65% (1.2838 => 1.3178, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.49% (2.1424 => 2.1958, std.dev.: 0.0126) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.15% (1.3677 => 1.3971, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 2.13% (3.1595 => 3.2267, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.05% (3.6395 => 3.7142, std.dev.: 0.0279) MultiSource/Benchmarks/PAQ8p/paq8p: 1.83% (85.0658 => 86.6193, std.dev.: 0.0701) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2778, std.dev.: 0.0193) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.55% (2.3135 => 2.3493, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.54% (6.5088 => 6.6093, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout/sieve: 1.51% (5.2139 => 5.2924, std.dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/fldry: 1.49% (1.9577 => 1.9868, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/sieve: 1.32% (2.4858 => 2.5187, std.dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0501, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1677, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.62% (5.2763 => 1.2336, std.dev.: 0.0587) SingleSource/Benchmarks/Misc/salsa20: -75.45% (0.8651 => 0.2124, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/richards_benchmark: -44.39% (0.1622 => 0.0902, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.15% (5.3855 => 4.7313, std.dev.: 0.0565) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.94% (5.3526 => 4.7136, std.dev.: 0.1729) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.92% (1.7609 => 1.6038, std.dev.: 0.0410) MultiSource/Applications/JM/ldecod/ldecod: -3.28% (10.4361 => 10.0937, std.dev.: 0.0591) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.52% (0.0628 => 0.0361, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.92% (0.0506 => 0.0304, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.83% (0.3987 => 0.2399, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.33% (4.5009 => 2.7756, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: -33.47% (1.1492 => 0.7646, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.17% (2.6546 => 2.0129, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -19.20% (0.2161 => 0.1746, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.66% (1.6925 => 1.4274, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -15.23% (10.7105 => 9.0795, std.dev.: 0.0262) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2840, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.72% (32.5116 => 29.0251, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/mandel-2: -10.62% (1.5373 => 1.3741, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -10.50% (9.5636 => 8.5599, std.dev.: 0.1751) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.74% (1.5660 => 1.4291, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.94% (4.8142 => 4.4799, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.2416 => 3.0211, std.dev.: 0.0294) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.61% (2.7294 => 2.5762, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.29% (0.2497 => 0.2365, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.21% (1.6805 => 1.5929, std.dev.: 0.0326) SingleSource/Benchmarks/Misc/flops-5: -4.54% (1.5835 => 1.5116, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -4.30% (6.2999 => 6.0290, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.59% (19.9488 => 19.2330, std.dev.: 0.0939) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.40% (0.9957 => 0.9618, std.dev.: 0.0070) MultiSource/Benchmarks/sim/sim: -3.08% (5.0483 => 4.8926, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.31% (0.4808 => 0.4697, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.83% (8.1563 => 8.0073, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6773, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.47% (10.2830 => 10.1316, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.97% (0.1485 => 0.1337, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0010) Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 09:39:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 11:39:55 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121119173955.4CD902A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6041?compare_to=6036&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6041, Order: 168312, Start Time: 2012-11-19 16:10:16, End Time: 2012-11-19 17:40:19 To: 6036, Order: 168310, Start Time: 2012-11-19 12:28:30, End Time: 2012-11-19 13:58:49 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 5 (118 on baseline) Performance Improvements: 1 (26 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1048 (830 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.70% (4.5749 => 4.6525, std.dev.: 0.0104) MultiSource/Applications/lua/lua: 1.44% (3.9492 => 4.0060, std.dev.: 0.0152) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 9.90% (19.3293 => 21.2422, std.dev.: 0.3373) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.85% (1.2748 => 1.2984, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.58% (13.4090 => 13.6202, std.dev.: 0.0565) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -3.01% (1.0330 => 1.0019, std.dev.: 0.0044) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -2.30% (1.0743 => 1.0496, std.dev.: 0.0229) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.20% (0.0219 => 0.0212, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.97% (0.0402 => 0.0426, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -24.70% (0.0336 => 0.0253, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -6.46% (0.0294 => 0.0275, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -9.57% (0.0376 => 0.0340, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/casts: -0.98% (0.0205 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -16.13% (0.0186 => 0.0156, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.81% (0.1484 => 0.1472, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: -4.11% (1.1614 => 1.1137, std.dev.: 0.0482) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.94% (0.4093 => 0.4295, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.27% (0.1412 => 0.1444, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.23% (0.0570 => 0.0634, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 13.37% (0.0202 => 0.0229, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.59% (0.0588 => 0.0561, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.58% (1.2001 => 1.1931, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -84.62% (0.0026 => 0.0004, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.14% (0.0582 => 0.0641, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.21% (0.0262 => 0.0175, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.03% (0.7810 => 0.7808, std.dev.: 0.0050) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 6.78% (0.0059 => 0.0063, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.42% (16.4461 => 17.6658, std.dev.: 0.0339) MultiSource/Applications/sqlite3/sqlite3: 2313.93% (0.6332 => 15.2850, std.dev.: 0.1669) MultiSource/Benchmarks/McCat/08-main/main: 47.19% (0.1831 => 0.2695, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.50% (0.1559 => 0.1442, std.dev.: 0.0062) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7078.87% (0.3123 => 22.4196, std.dev.: 0.1493) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.18% (0.2463 => 0.3699, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1520.13% (0.3344 => 5.4177, std.dev.: 0.0377) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.65% (0.2364 => 0.3254, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 3.83% (0.6010 => 0.6240, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel: 0.93% (0.0429 => 0.0433, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.23% (0.3266 => 0.3404, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/strcat: 3.50% (0.1969 => 0.2038, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.02% (0.0224 => 0.0233, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0522, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 10.26% (0.1462 => 0.1612, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4626, std.dev.: 0.0253) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0723, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4887, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5119, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.4888, std.dev.: 0.0740) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3006, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1127, std.dev.: 0.0168) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3632, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4004, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0857, std.dev.: 0.0008) SingleSource/Regression/C/uint64_to_float: -23.53% (2.1832 => 1.6694, std.dev.: 0.0008) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.33% (0.0810 => 0.0918, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.25% (0.0830 => 0.0940, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: 13.04% (0.1112 => 0.1257, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.95% (0.7473 => 0.8067, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.84% (0.2180 => 0.2351, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.47% (0.6010 => 0.6459, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.14% (0.1905 => 0.2041, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.91% (0.4847 => 0.5182, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.58% (0.2133 => 0.2252, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.55% (0.1983 => 0.2093, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 5.26% (1.2222 => 1.2865, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.97% (0.5817 => 0.6106, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 4.90% (3.8189 => 4.0060, std.dev.: 0.0152) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.45% (1.1606 => 1.2122, std.dev.: 0.0134) MultiSource/Applications/hbd/hbd: 4.39% (1.4269 => 1.4896, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.35% (0.9435 => 0.9845, std.dev.: 0.0123) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.25% (0.2519 => 0.2626, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.01% (6.6074 => 6.8725, std.dev.: 0.0280) MultiSource/Applications/minisat/minisat: 4.01% (0.6834 => 0.7108, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.95% (0.4559 => 0.4739, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/gs/gs: 3.94% (4.1305 => 4.2932, std.dev.: 0.0350) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.79% (4.1763 => 4.3344, std.dev.: 0.0291) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.76% (0.4127 => 0.4282, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.67% (4.4880 => 4.6525, std.dev.: 0.0104) MultiSource/Applications/SPASS/SPASS: 3.64% (14.2605 => 14.7800, std.dev.: 0.0135) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.1271 => 1.1678, std.dev.: 0.0070) MultiSource/Applications/treecc/treecc: 3.54% (1.9948 => 2.0654, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.53% (0.3115 => 0.3225, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 3.40% (0.2999 => 0.3101, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.30% (0.8340 => 0.8615, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 3.25% (2.2184 => 2.2906, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.22% (0.8457 => 0.8729, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.15% (2.1401 => 2.2076, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.13% (13.1811 => 13.5936, std.dev.: 0.0391) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.00% (0.5961 => 0.6140, std.dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.97% (0.4783 => 0.4925, std.dev.: 0.0036) MultiSource/Applications/ClamAV/clamscan: 2.94% (14.7684 => 15.2032, std.dev.: 0.0374) MultiSource/Benchmarks/Prolangs-C/football/football: 2.92% (0.8768 => 0.9024, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.91% (0.5191 => 0.5342, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.90% (0.8611 => 0.8861, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.88% (0.8338 => 0.8578, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.85% (8.6476 => 8.8940, std.dev.: 0.0466) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.77% (0.3717 => 0.3820, std.dev.: 0.0031) MultiSource/Applications/d/make_dparser: 2.77% (3.2366 => 3.3261, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.76% (1.6386 => 1.6838, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.75% (0.8697 => 0.8936, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.67% (0.9069 => 0.9311, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.66% (0.9074 => 0.9315, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.65% (4.4873 => 4.6060, std.dev.: 0.0364) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.57% (0.6586 => 0.6755, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.56% (0.8007 => 0.8212, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.52% (0.8359 => 0.8570, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.52% (1.5315 => 1.5701, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 2.51% (0.7557 => 0.7747, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.51% (0.9908 => 1.0157, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.50% (0.7966 => 0.8165, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.48% (0.8066 => 0.8266, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.48% (0.8712 => 0.8928, std.dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: 2.44% (15.3280 => 15.7019, std.dev.: 0.0868) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.40% (0.8050 => 0.8243, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.36% (0.9810 => 1.0042, std.dev.: 0.0059) MultiSource/Applications/JM/ldecod/ldecod: 2.36% (6.7320 => 6.8911, std.dev.: 0.0605) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.34% (0.7932 => 0.8118, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.32% (0.8805 => 0.9009, std.dev.: 0.0052) MultiSource/Benchmarks/PAQ8p/paq8p: 2.31% (2.3764 => 2.4313, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.26% (0.8885 => 0.9086, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.25% (4.5702 => 4.6732, std.dev.: 0.0254) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.25% (0.8177 => 0.8361, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.21% (0.8048 => 0.8226, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.19% (3.1832 => 3.2529, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.18% (0.8286 => 0.8467, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.09% (0.8420 => 0.8596, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.06% (1.4479 => 1.4777, std.dev.: 0.0063) MultiSource/Benchmarks/Bullet/bullet: 2.04% (31.8598 => 32.5108, std.dev.: 0.1015) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.04% (0.8518 => 0.8692, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.88% (0.8927 => 0.9095, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.85% (0.8855 => 0.9019, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.83% (0.8204 => 0.8354, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 1.81% (8.6247 => 8.7805, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.80% (0.9039 => 0.9202, std.dev.: 0.0048) MultiSource/Applications/oggenc/oggenc: 1.63% (4.9628 => 5.0439, std.dev.: 0.0189) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 101.51% (0.0199 => 0.0401, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/pi: 57.38% (1.5795 => 2.4858, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.17% (2.9753 => 3.4563, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 14.78% (0.7597 => 0.8720, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.71% (2.7995 => 3.2113, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.43% (5.0261 => 5.6006, std.dev.: 0.0105) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.10% (1.1857 => 1.2818, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.04% (0.3186 => 0.3442, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/queens: 7.04% (1.7056 => 1.8256, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.64% (4.7794 => 5.0967, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.59% (6.3772 => 6.7974, std.dev.: 0.0546) MultiSource/Applications/SIBsim4/SIBsim4: 6.47% (3.1873 => 3.3935, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/richards_benchmark: 6.42% (1.3037 => 1.3874, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.91% (4.9686 => 5.2622, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.87% (4.5327 => 4.7987, std.dev.: 0.0112) MultiSource/Applications/lambda-0_1_3/lambda: 5.31% (7.4933 => 7.8910, std.dev.: 0.0164) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.24% (1.2337 => 1.2984, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/treeadd/treeadd: 4.66% (0.3587 => 0.3754, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.57% (6.2275 => 6.5118, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.51% (3.3761 => 3.5283, std.dev.: 0.0307) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.15% (4.9453 => 5.1504, std.dev.: 0.0246) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.09% (4.9469 => 5.1490, std.dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: 3.90% (14.0064 => 14.5525, std.dev.: 0.0110) MultiSource/Applications/siod/siod: 3.09% (3.6643 => 3.7774, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.80% (11.5690 => 11.8927, std.dev.: 0.0333) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.47% (8.2783 => 8.4830, std.dev.: 0.0152) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.37% (1.1365 => 1.1634, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.26% (4.8362 => 4.9457, std.dev.: 0.0352) SingleSource/Benchmarks/Shootout/lists: 2.25% (7.3375 => 7.5027, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.08% (4.8660 => 4.9672, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.80% (41.4238 => 42.1712, std.dev.: 0.1865) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.57% (1.5941 => 1.6192, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/power/power: 1.50% (1.2061 => 1.2242, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.49% (2.4647 => 2.5014, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/neural/neural: 1.34% (1.0841 => 1.0986, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.32% (3.5679 => 3.6149, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: 1.24% (8.5322 => 8.6383, std.dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.22% (5.4641 => 4.3044, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.30% (7.2130 => 6.2537, std.dev.: 0.0367) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.77% (1.0512 => 0.9380, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.67% (1.1216 => 1.0019, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.60% (0.3269 => 0.2988, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: -8.49% (63.1822 => 57.8178, std.dev.: 0.0826) SingleSource/Benchmarks/Shootout-C++/ackermann: -7.84% (3.9188 => 3.6114, std.dev.: 0.1057) SingleSource/Benchmarks/Shootout/heapsort: -7.53% (3.2926 => 3.0448, std.dev.: 0.0788) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.00% (14.6451 => 13.6202, std.dev.: 0.0565) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.83% (4.7482 => 4.4239, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.96% (3.7148 => 3.4934, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.81% (5.4972 => 5.1778, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.97% (5.1557 => 4.8997, std.dev.: 0.0292) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.50% (4.7449 => 4.5315, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.72% (6.0224 => 5.7985, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.25% (0.5807 => 0.5618, std.dev.: 0.0007) MultiSource/Applications/lua/lua: -3.13% (29.8330 => 28.9004, std.dev.: 0.1144) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.02% (28.5821 => 27.7179, std.dev.: 0.0325) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.87% (2.6356 => 2.5599, std.dev.: 0.0053) MultiSource/Applications/aha/aha: -2.47% (3.3398 => 3.2574, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: -2.39% (3.4237 => 3.3420, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.36% (9.9065 => 9.6725, std.dev.: 0.0202) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.11% (3.2169 => 3.1489, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.01% (11.5316 => 11.2998, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.59% (4.9994 => 4.9197, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.16% (5.6343 => 5.5692, std.dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.28% (1.0262 => 1.0496, std.dev.: 0.0229) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 72.36% (0.0123 => 0.0212, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.39% (0.0254 => 0.0253, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -8.94% (0.0302 => 0.0275, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -11.46% (0.0384 => 0.0340, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -13.33% (0.0180 => 0.0156, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.36% (0.1438 => 0.1472, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: -1.69% (1.1329 => 1.1137, std.dev.: 0.0482) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.15% (0.4164 => 0.4295, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.48% (0.1369 => 0.1444, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.09% (0.0641 => 0.0634, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 17.44% (0.0195 => 0.0229, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.94% (0.0578 => 0.0561, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.32% (1.1437 => 1.1931, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -71.43% (0.0014 => 0.0004, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.23% (0.0627 => 0.0641, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.78% (0.0180 => 0.0175, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.61% (0.8017 => 0.7808, std.dev.: 0.0050) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 1.61% (0.0062 => 0.0063, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 09:46:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 11:46:42 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121119174642.9476C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6042?compare_to=6038&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6042, Order: 168312, Start Time: 2012-11-19 16:13:26, End Time: 2012-11-19 17:47:05 To: 6038, Order: 168310, Start Time: 2012-11-19 13:28:03, End Time: 2012-11-19 15:01:56 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (178 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (858 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 2.36% (0.4412 => 0.4516, std.dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 17.79% (0.3834 => 0.4516, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1017, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/salsa20: 2.36% (7.4937 => 7.6708, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/hash2: 2.28% (3.1932 => 3.2660, std.dev.: 0.0072) MultiSource/Benchmarks/llubenchmark/llu: 2.27% (3.7435 => 3.8285, std.dev.: 0.0329) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.74% (0.1431 => 0.1306, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.56% (0.3821 => 0.3532, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -6.90% (2.4924 => 2.3205, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.56% (0.3142 => 0.2936, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.46% (0.3357 => 0.3140, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.36% (0.9542 => 0.8935, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -6.20% (0.2160 => 0.2026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.10% (0.2428 => 0.2280, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.07% (0.1796 => 0.1687, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.05% (0.6484 => 0.6092, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: -6.00% (16.1920 => 15.2204, std.dev.: 0.0121) MultiSource/Benchmarks/mafft/pairlocalalign: -5.99% (9.2283 => 8.6754, std.dev.: 0.0188) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.96% (0.7198 => 0.6769, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: -5.94% (7.0961 => 6.6747, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: -5.89% (0.9179 => 0.8638, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.85% (0.9852 => 0.9276, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.78% (3.5339 => 3.3297, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.77% (0.2355 => 0.2219, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.75% (1.3722 => 1.2933, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.70% (1.0544 => 0.9943, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.69% (0.5857 => 0.5524, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.68% (0.5863 => 0.5530, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.67% (0.6052 => 0.5709, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.66% (0.3658 => 0.3451, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.62% (0.5805 => 0.5479, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.60% (1.6364 => 1.5447, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.59% (4.8161 => 4.5468, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-4: -5.57% (0.3880 => 0.3664, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.55% (0.5802 => 0.5480, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.55% (6.7716 => 6.3960, std.dev.: 0.0033) MultiSource/Applications/lemon/lemon: -5.53% (1.1450 => 1.0817, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.51% (0.5859 => 0.5536, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.51% (1.2300 => 1.1622, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.50% (4.0323 => 3.8107, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.49% (0.5478 => 0.5177, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.49% (0.3406 => 0.3219, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.49% (0.6230 => 0.5888, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -5.48% (0.3831 => 0.3621, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.48% (0.6446 => 0.6093, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.47% (0.5591 => 0.5285, std.dev.: 0.0048) MultiSource/Benchmarks/nbench/nbench: -5.47% (1.1530 => 1.0899, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.47% (0.5705 => 0.5393, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.47% (0.3896 => 0.3683, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.46% (0.3848 => 0.3638, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.46% (0.6304 => 0.5960, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.45% (0.4033 => 0.3813, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.45% (0.5849 => 0.5530, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.45% (0.6660 => 0.6297, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.44% (1.4642 => 1.3845, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.44% (0.5570 => 0.5267, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.42% (4.8802 => 4.6155, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.42% (0.6297 => 0.5956, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.41% (4.5069 => 4.2629, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/trivial-interface: -5.40% (0.3812 => 0.3606, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions: -5.39% (0.4176 => 0.3951, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.38% (1.2784 => 1.2096, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.38% (0.7919 => 0.7493, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.37% (0.5456 => 0.5163, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.37% (0.5925 => 0.5607, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -5.36% (0.4515 => 0.4273, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.36% (0.6293 => 0.5956) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.34% (0.6194 => 0.5863, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: -5.32% (4.3330 => 4.1023, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.31% (0.6736 => 0.6378, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.29% (0.5941 => 0.5627, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.28% (0.6667 => 0.6315, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.27% (0.6260 => 0.5930, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.27% (0.6681 => 0.6329, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.27% (0.3891 => 0.3686, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.24% (0.3016 => 0.2858, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.24% (0.5575 => 0.5283, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -5.23% (17.1032 => 16.2087, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.22% (0.6189 => 0.5866, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.20% (0.3483 => 0.3302, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.18% (0.4151 => 0.3936, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.18% (0.8521 => 0.8080, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: -5.17% (1.3148 => 1.2468, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -5.16% (0.3255 => 0.3087, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -5.12% (0.3025 => 0.2870, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.12% (14.2083 => 13.4809, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.11% (8.0126 => 7.6028, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.11% (0.6033 => 0.5725, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.09% (0.6440 => 0.6112, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -5.09% (0.2985 => 0.2833, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.09% (1.6474 => 1.5636, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.08% (1.2221 => 1.1600, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/objinst: -5.07% (0.3194 => 0.3032, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -5.06% (0.3026 => 0.2873, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.05% (0.5999 => 0.5696, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.05% (1.3864 => 1.3164, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.05% (0.5688 => 0.5401, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.03% (0.5581 => 0.5300, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.03% (0.3837 => 0.3644, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.03% (1.2210 => 1.1596, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: -5.03% (0.3581 => 0.3401, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -5.01% (0.3394 => 0.3224, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.00% (0.4916 => 0.4670, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: -5.00% (0.4199 => 0.3989, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.99% (0.3849 => 0.3657, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.98% (0.3252 => 0.3090, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -4.97% (1.2515 => 1.1893, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: -4.96% (3.5154 => 3.3411, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.95% (0.2989 => 0.2841, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.94% (0.6676 => 0.6346, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.94% (0.3323 => 0.3159, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.93% (0.2999 => 0.2851, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.92% (0.3884 => 0.3693, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.90% (0.3059 => 0.2909, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -4.90% (0.4861 => 0.4623, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.88% (0.3931 => 0.3739, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.88% (2.1713 => 2.0653, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (0.2871 => 0.2731, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: -4.87% (0.7447 => 0.7084, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.87% (0.3057 => 0.2908, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.87% (0.2278 => 0.2167, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.85% (0.7339 => 0.6983, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: -4.83% (0.4248 => 0.4043, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.79% (0.2548 => 0.2426, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -4.78% (15.5079 => 14.7665, std.dev.: 0.0107) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.76% (0.3319 => 0.3161, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.74% (0.7021 => 0.6688, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: -4.73% (0.2939 => 0.2800, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.73% (0.5329 => 0.5077, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.72% (0.4321 => 0.4117, std.dev.: 0.0028) MultiSource/Applications/lua/lua: -4.72% (4.0594 => 3.8678, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists1: -4.71% (0.3867 => 0.3685, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.71% (0.2933 => 0.2795, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -4.70% (0.2659 => 0.2534, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.70% (15.2527 => 14.5361, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary2: -4.68% (0.3481 => 0.3318, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -4.68% (0.3205 => 0.3055, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.68% (0.7524 => 0.7172, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -4.67% (0.4280 => 0.4080, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.63% (0.2849 => 0.2717, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.60% (0.6395 => 0.6101, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.58% (0.2903 => 0.2770, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.57% (0.4813 => 0.4593, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.54% (22.4056 => 21.3887, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/lists: -4.53% (0.3621 => 0.3457, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.43% (0.5168 => 0.4939, std.dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: -4.43% (34.0927 => 32.5823, std.dev.: 0.0285) MultiSource/Applications/oggenc/oggenc: -4.42% (5.0226 => 4.8007, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.41% (0.9557 => 0.9136, std.dev.: 0.0009) MultiSource/Applications/siod/siod: -4.38% (2.4021 => 2.2969, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.36% (0.6395 => 0.6116, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: -4.35% (2.1401 => 2.0469, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.31% (0.4083 => 0.3907, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: -4.28% (0.3788 => 0.3626, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.27% (0.5569 => 0.5331, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.25% (0.4427 => 0.4239, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference-object: -4.19% (0.6441 => 0.6171, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.19% (0.7779 => 0.7453, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: -4.18% (0.6347 => 0.6082, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: -4.17% (0.8418 => 0.8067, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.17% (0.5567 => 0.5335, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.17% (2.2587 => 2.1646, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -4.10% (0.7982 => 0.7655, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: -4.06% (0.6750 => 0.6476, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -4.00% (0.3271 => 0.3140, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -3.98% (0.4524 => 0.4344, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.92% (0.3491 => 0.3354, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.92% (0.9077 => 0.8721, std.dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: -3.80% (18.2933 => 17.5990, std.dev.: 0.0303) MultiSource/Applications/hbd/hbd: -3.68% (1.5610 => 1.5036, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.27% (5.4682 => 5.2894, std.dev.: 0.0097) SingleSource/UnitTests/Vector/constpool: -2.41% (20.7746 => 20.2745, std.dev.: 0.0295) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7507, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/richards_benchmark: -8.63% (1.2842 => 1.1734, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.81% (2.2633 => 2.1770, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.14% (1.0557 => 1.0226, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.68% (6.5735 => 6.4631, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 11:32:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 13:32:10 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121119193210.151FD2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/6043?compare_to=6039&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6043, Order: 168310, Start Time: 2012-11-19 16:11:40, End Time: 2012-11-19 19:32:33 To: 6039, Order: 168304, Start Time: 2012-11-19 12:02:32, End Time: 2012-11-19 15:23:48 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (175 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1091 (716 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.41% (54.0679 => 54.8291, std.dev.: 0.0757) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.04% (0.0625 => 0.0894, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.58% (0.1063 => 0.1420, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.41% (0.2969 => 0.3753, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.31% (0.1106 => 0.1397, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.19% (0.0714 => 0.0901, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.84% (0.4253 => 0.5352, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 25.58% (1.5932 => 2.0007, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.20% (0.4139 => 0.5182, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.33% (0.4994 => 0.6209, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.88% (0.5000 => 0.6194, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.75% (0.5900 => 0.7301, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.58% (0.0475 => 0.0587, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.46% (0.0584 => 0.0721, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.41% (0.1620 => 0.1983, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.23% (0.1021 => 0.1248, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.22% (0.1107 => 0.1353, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 22.20% (0.0599 => 0.0732, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.19% (0.0897 => 0.1096, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.26% (0.0541 => 0.0656, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.06% (0.0584 => 0.0707, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.01% (0.0633 => 0.0766) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.86% (0.3903 => 0.4717, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.85% (0.1103 => 0.1333, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.72% (0.0642 => 0.0775, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 20.68% (0.0948 => 0.1144, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 20.58% (0.0821 => 0.0990, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.54% (0.1003 => 0.1209, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.46% (0.1549 => 0.1866, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.40% (0.0495 => 0.0596, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 20.36% (0.0604 => 0.0727, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.07% (0.1604 => 0.1926, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 20.07% (0.1619 => 0.1944, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.95% (0.0822 => 0.0986, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.49% (0.1462 => 0.1747, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 19.32% (0.0947 => 0.1130, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 19.31% (0.0808 => 0.0964, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.12% (0.2014 => 0.2399, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.97% (0.3890 => 0.4628, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.88% (1.3152 => 1.5635, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 18.84% (0.4029 => 0.4788, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 18.56% (0.1218 => 0.1444, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 18.50% (0.5826 => 0.6904, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.38% (0.2736 => 0.3239, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 18.19% (0.0698 => 0.0825, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.11% (0.1088 => 0.1285, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference-object: 18.08% (0.5889 => 0.6954, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 18.01% (0.1505 => 0.1776, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.00% (0.2866 => 0.3382, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 17.81% (0.5546 => 0.6534, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.80% (0.0573 => 0.0675, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.73% (0.4658 => 0.5484, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.66% (0.0572 => 0.0673, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 17.55% (1.8794 => 2.2092, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.52% (0.0605 => 0.0711, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.47% (3.5627 => 4.1851, std.dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.43% (0.1968 => 0.2311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.39% (0.5026 => 0.5900, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.22% (0.4361 => 0.5112, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.21% (1.6211 => 1.9001, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: 17.16% (1.0781 => 1.2631, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.90% (0.1160 => 0.1356, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.78% (0.3271 => 0.3820, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: 16.71% (0.9697 => 1.1317, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/18-imp/imp: 16.61% (0.1421 => 0.1657, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.56% (4.4195 => 5.1512, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.51% (0.3930 => 0.4579, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 16.40% (0.7171 => 0.8347, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.35% (0.2875 => 0.3345, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.29% (0.2738 => 0.3184, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.17% (2.7292 => 3.1706, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.15% (0.1090 => 0.1266, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 16.06% (4.2109 => 4.8873, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/bh/bh: 16.04% (0.1284 => 0.1490, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 15.86% (0.2780 => 0.3221, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.76% (1.9694 => 2.2798, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/objinst: 15.69% (0.2823 => 0.3266, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 15.68% (0.3004 => 0.3475, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 15.65% (0.2811 => 0.3251, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 15.63% (0.2725 => 0.3151, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.62% (1.9966 => 2.3084, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hello: 15.59% (0.2714 => 0.3137, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 15.53% (0.2750 => 0.3177, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.47% (0.2792 => 0.3224, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 15.47% (0.2075 => 0.2396, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.46% (0.2729 => 0.3151, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 15.43% (0.9909 => 1.1438, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: 15.43% (0.2813 => 0.3247, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 15.31% (0.2803 => 0.3232, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 15.25% (0.3096 => 0.3568, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.22% (0.2911 => 0.3354, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.07% (2.0673 => 2.3789, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.05% (0.3195 => 0.3676, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 14.85% (0.2566 => 0.2947, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 14.78% (0.3267 => 0.3750, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 14.65% (23.5202 => 26.9668, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/ary: 14.64% (0.3258 => 0.3735, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-2: 14.57% (0.3446 => 0.3948, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 14.56% (0.3317 => 0.3800, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 14.52% (0.3465 => 0.3968, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 14.50% (0.3469 => 0.3972, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.47% (0.3496 => 0.4002, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.45% (0.3460 => 0.3960, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 14.44% (1.4269 => 1.6329, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.42% (0.3488 => 0.3991, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.41% (0.3060 => 0.3501, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 14.35% (0.3442 => 0.3936, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 14.30% (0.7875 => 0.9001, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 14.16% (0.3650 => 0.4167, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.16% (0.3362 => 0.3838, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: 14.12% (0.0758 => 0.0865, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.08% (0.3124 => 0.3564, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 14.08% (0.3678 => 0.4196, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 14.08% (0.3643 => 0.4156, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 14.07% (2.1653 => 2.4700, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 14.01% (0.3726 => 0.4248, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 13.95% (0.3348 => 0.3815, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.89% (0.3282 => 0.3738, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 13.78% (0.3477 => 0.3956) SingleSource/UnitTests/ObjC/parameter-passing: 13.78% (0.3724 => 0.4237, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 13.72% (4.6177 => 5.2511, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.66% (0.3625 => 0.4120, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.49% (0.3981 => 0.4518, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.41% (0.3690 => 0.4185, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 13.39% (2.1013 => 2.3827, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 13.39% (0.4146 => 0.4701, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.38% (0.2040 => 0.2313, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 13.29% (0.4251 => 0.4816, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.13% (0.3845 => 0.4350, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 13.08% (0.2691 => 0.3043, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 12.71% (0.5012 => 0.5649, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 12.50% (5.5417 => 6.2343, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.08% (0.1383 => 0.1550, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.93% (0.6435 => 0.7203, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 11.58% (0.3498 => 0.3903, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 11.46% (0.6634 => 0.7394, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.38% (0.1028 => 0.1145, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 11.04% (0.4847 => 0.5382, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.98% (0.2068 => 0.2295, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 10.91% (2.0346 => 2.2566, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.89% (0.2737 => 0.3035, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.73% (0.3084 => 0.3415, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 10.66% (0.2391 => 0.2646, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.40% (0.3336 => 0.3683, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.94% (0.2103 => 0.2312, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.23% (0.5361 => 0.5856, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.81% (4.6926 => 5.1058, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.70% (0.7426 => 0.8072, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.54% (11.6398 => 12.6339, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.52% (0.5584 => 0.6060, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 7.04% (11.9555 => 12.7975, std.dev.: 0.0142) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.01% (0.3792 => 0.3982, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 9.06% (0.2802 => 0.3056, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6110, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary: 5.47% (0.2122 => 0.2238, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6769, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.96% (0.3693 => 0.3876, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1643, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-2: 4.64% (1.8057 => 1.8895, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/dry: 4.14% (14.0481 => 14.6299, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2063, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.55% (3.1722 => 3.2215, std.dev.: 0.0050) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3066, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2852, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5147, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5955, std.dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.80% (25.4195 => 16.5731, std.dev.: 0.0232) SingleSource/Benchmarks/Shootout-C++/ary2: -8.66% (0.2402 => 0.2194, std.dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9764, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7978, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8072, std.dev.: 0.0038) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.59% (0.6293 => 0.6130, std.dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/fldry: -2.33% (17.2379 => 16.8363, std.dev.: 0.0172) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8577, std.dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5804, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: -1.55% (5.5810 => 5.4946, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.25% (105.3826 => 104.0604, std.dev.: 0.0878) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0438, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 12:00:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 14:00:28 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121119200028.B4F482A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6044?compare_to=6041&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6044, Order: 168316, Start Time: 2012-11-19 18:26:45, End Time: 2012-11-19 20:00:52 To: 6041, Order: 168312, Start Time: 2012-11-19 16:10:16, End Time: 2012-11-19 17:40:19 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 10 (65 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1044 (888 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.96% (0.8358 => 0.8856, std.dev.: 0.0094) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.16% (0.8703 => 0.8978, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.87% (0.6861 => 0.6989, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.25% (1.1391 => 1.1533, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench: 9.34% (1.4888 => 1.6279, std.dev.: 0.0292) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.54% (21.7153 => 22.7003, std.dev.: 0.3666) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.69% (1.3742 => 1.4112, std.dev.: 0.0106) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.44% (2.7653 => 2.8327, std.dev.: 0.0131) MultiSource/Benchmarks/Bullet/bullet: 1.75% (7.1094 => 7.2339, std.dev.: 0.0464) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.09% (5.8585 => 5.9221, std.dev.: 0.0247) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.46% (1.0496 => 1.0544, std.dev.: 0.2203) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -12.74% (0.0212 => 0.0185, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.17% (0.0426 => 0.0431, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.62% (0.0253 => 0.0333, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 12.00% (0.0275 => 0.0308, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.29% (0.0340 => 0.0375, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: 0.99% (0.0203 => 0.0205, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 40.38% (0.0156 => 0.0219, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1300.00% (0.0001 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.48% (0.1472 => 0.1479, std.dev.: 0.0075) MultiSource/Applications/lemon/lemon: 8.67% (1.1137 => 1.2103, std.dev.: 0.4126) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.70% (0.4295 => 0.4136, std.dev.: 0.1677) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.76% (0.1444 => 0.1433, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.21% (0.0634 => 0.0648, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 16.16% (0.0229 => 0.0266, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.80% (0.0561 => 0.0616, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.01% (1.1931 => 1.1932, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 75.00% (0.0004 => 0.0007, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.78% (0.0641 => 0.0646, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 52.57% (0.0175 => 0.0267, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.79% (0.7808 => 0.7948, std.dev.: 0.0520) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -36.51% (0.0063 => 0.0040, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.02% (16.4461 => 17.6002, std.dev.: 0.9191) MultiSource/Applications/sqlite3/sqlite3: 2325.51% (0.6332 => 15.3583, std.dev.: 0.6972) MultiSource/Benchmarks/McCat/08-main/main: 49.92% (0.1831 => 0.2745, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.92% (0.1559 => 0.1420, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7035.03% (0.3123 => 22.2827, std.dev.: 0.8518) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.63% (0.2463 => 0.3710, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1522.52% (0.3344 => 5.4257, std.dev.: 0.2968) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.27% (0.2364 => 0.3245, std.dev.: 0.0251) SingleSource/Benchmarks/Misc-C++/bigfib: 4.81% (0.6010 => 0.6299, std.dev.: 0.0967) SingleSource/Benchmarks/Misc/mandel: 3.73% (0.0429 => 0.0445, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.72% (0.3266 => 0.3420, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/strcat: 3.96% (0.1969 => 0.2047, std.dev.: 0.0047) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.25% (0.0224 => 0.0238, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0518, std.dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: 12.24% (0.1462 => 0.1641, std.dev.: 0.0227) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.5092, std.dev.: 0.0980) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0723, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4953, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5150, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.6279, std.dev.: 0.0292) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3427, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1342, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3640, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3996, std.dev.: 0.0366) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0848, std.dev.: 0.0009) SingleSource/Regression/C/uint64_to_float: -23.70% (2.1832 => 1.6658, std.dev.: 0.0041) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 14.12% (0.1112 => 0.1269, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.26% (0.0848 => 0.0952, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.22% (0.2180 => 0.2381, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.91% (0.4847 => 0.5279, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.69% (0.8148 => 0.8856, std.dev.: 0.0094) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.90% (0.8321 => 0.8978, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.57% (0.6010 => 0.6465, std.dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.00% (0.5817 => 0.6224, std.dev.: 0.0101) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.68% (0.1885 => 0.2011, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.63% (0.2519 => 0.2686, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.28% (0.3295 => 0.3502, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.18% (1.1606 => 1.2323, std.dev.: 0.0182) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.90% (0.1983 => 0.2100, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.76% (0.6287 => 0.6649, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.50% (0.2998 => 0.3163, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.34% (0.2378 => 0.2505, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.74% (1.1685 => 1.2239, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.2526 => 1.3086, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.46% (0.2240 => 0.2340, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.20% (0.3003 => 0.3129, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.17% (0.4127 => 0.4299, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.67% (1.3279 => 1.3767, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.56% (4.1763 => 4.3249, std.dev.: 0.0206) MultiSource/Benchmarks/nbench/nbench: 3.34% (1.1271 => 1.1648, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.25% (1.1170 => 1.1533, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.19% (4.4880 => 4.6311, std.dev.: 0.0367) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.09% (0.3717 => 0.3832, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.06% (1.6386 => 1.6888, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.04% (0.8611 => 0.8873, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.48% (4.4873 => 4.5987, std.dev.: 0.0367) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.44% (13.1811 => 13.5025, std.dev.: 0.0732) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.70% (0.8995 => 0.9148, std.dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 118.59% (0.0199 => 0.0435, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/pi: 57.54% (1.5795 => 2.4883, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.93% (0.7597 => 0.8883, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.40% (2.9753 => 3.4633, std.dev.: 0.0716) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.66% (2.7995 => 3.2098, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6092, std.dev.: 0.0192) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.18% (1.1857 => 1.2827, std.dev.: 0.0211) SingleSource/Benchmarks/McGill/queens: 7.55% (1.7056 => 1.8344, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.79% (4.7794 => 5.1037, std.dev.: 0.0323) MultiSource/Applications/SIBsim4/SIBsim4: 6.68% (3.1873 => 3.4002, std.dev.: 0.0356) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.06% (6.3772 => 6.7637, std.dev.: 0.0925) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.99% (4.5327 => 4.8041, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.89% (4.9686 => 5.2614, std.dev.: 0.0528) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.78% (0.3186 => 0.3370, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.01% (6.2275 => 6.5397, std.dev.: 0.0235) MultiSource/Applications/lambda-0_1_3/lambda: 4.69% (7.4933 => 7.8451, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.67% (3.3761 => 3.5338, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.21% (4.9453 => 5.1536, std.dev.: 0.0163) MultiSource/Applications/hexxagon/hexxagon: 3.94% (14.0064 => 14.5588, std.dev.: 0.1391) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.55% (2.2485 => 2.3283, std.dev.: 0.0306) MultiSource/Applications/siod/siod: 3.13% (3.6643 => 3.7789, std.dev.: 0.0190) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.12% (0.3587 => 0.3699, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.81% (11.5690 => 11.8938, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.49% (8.2783 => 8.4848, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.38% (4.8660 => 4.9819, std.dev.: 0.0383) SingleSource/Benchmarks/Shootout/lists: 2.37% (7.3375 => 7.5113, std.dev.: 0.0341) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.18% (4.8362 => 4.9417, std.dev.: 0.0284) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.68% (1.1365 => 1.1556, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.37% (5.8421 => 5.9221, std.dev.: 0.0247) MultiSource/Benchmarks/FreeBench/neural/neural: 1.33% (1.0841 => 1.0985, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.32% (2.4647 => 2.4972, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/power/power: 1.06% (1.2061 => 1.2189, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.03% (3.5679 => 3.6045, std.dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.13% (5.4641 => 4.3098, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.52% (7.2130 => 6.3097, std.dev.: 0.1313) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.88% (1.0512 => 0.9368, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -10.40% (14.6451 => 13.1220, std.dev.: 0.2850) SingleSource/Benchmarks/McGill/chomp: -9.66% (1.1216 => 1.0132, std.dev.: 0.0238) MultiSource/Benchmarks/mafft/pairlocalalign: -8.51% (63.1822 => 57.8023, std.dev.: 0.3082) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.78% (4.7482 => 4.4263, std.dev.: 0.0327) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.52% (0.3269 => 0.3056, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.03% (3.7148 => 3.4909, std.dev.: 0.0690) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.66% (5.4972 => 5.1859, std.dev.: 0.0511) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.84% (6.0224 => 5.7912, std.dev.: 0.0303) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.32% (0.5807 => 0.5614, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/life/life: -3.01% (2.6356 => 2.5562, std.dev.: 0.0138) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.92% (28.5821 => 27.7461, std.dev.: 0.0367) MultiSource/Applications/aha/aha: -2.36% (3.3398 => 3.2611, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/hash2: -2.21% (3.4237 => 3.3479, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.96% (11.5316 => 11.3051, std.dev.: 0.0313) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.76% (9.9065 => 9.7323, std.dev.: 0.0604) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.57% (4.9994 => 4.9209, std.dev.: 0.0302) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.55% (2.8773 => 2.8327, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.18% (5.6343 => 5.5678, std.dev.: 0.0100) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.75% (1.0262 => 1.0544, std.dev.: 0.2203) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 50.41% (0.0123 => 0.0185, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.64% (0.0408 => 0.0431, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.99% (0.0302 => 0.0308, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.34% (0.0384 => 0.0375, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 100.00% (0.0007 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.85% (0.1438 => 0.1479, std.dev.: 0.0075) MultiSource/Applications/lemon/lemon: 6.83% (1.1329 => 1.2103, std.dev.: 0.4126) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.67% (0.4164 => 0.4136, std.dev.: 0.1677) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.67% (0.1369 => 0.1433, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.09% (0.0641 => 0.0648, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 36.41% (0.0195 => 0.0266, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.57% (0.0578 => 0.0616, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.33% (1.1437 => 1.1932, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0014 => 0.0007, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.03% (0.0627 => 0.0646, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.86% (0.8017 => 0.7948, std.dev.: 0.0520) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -35.48% (0.0062 => 0.0040, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 12:03:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 14:03:11 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121119200311.77EFA2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6045?compare_to=6042&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6045, Order: 168316, Start Time: 2012-11-19 18:29:43, End Time: 2012-11-19 20:03:33 To: 6042, Order: 168312, Start Time: 2012-11-19 16:13:26, End Time: 2012-11-19 17:47:05 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (7 on baseline) Performance Improvements: 0 (178 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (857 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.00% (54.3422 => 56.5163, std.dev.: 0.0501) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 17.32% (0.3834 => 0.4498, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.56% (54.5751 => 56.5163, std.dev.: 0.0501) SingleSource/Benchmarks/Misc/salsa20: 2.71% (7.4937 => 7.6966, std.dev.: 0.0069) MultiSource/Benchmarks/llubenchmark/llu: 2.65% (3.7435 => 3.8426, std.dev.: 0.0186) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1014, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/hash2: 2.16% (3.1932 => 3.2623, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.48% (0.3821 => 0.3535, std.dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: -6.91% (2.4924 => 2.3201, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.40% (0.9542 => 0.8931, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.37% (0.3142 => 0.2942, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.12% (0.1796 => 0.1686, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -6.03% (9.2283 => 8.6722, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.01% (0.2428 => 0.2282, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -5.93% (0.2160 => 0.2032, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.92% (0.7198 => 0.6772, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: -5.91% (16.1920 => 15.2343, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.89% (0.6484 => 0.6102, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -5.87% (0.3357 => 0.3160, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: -5.86% (0.9179 => 0.8641, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.86% (0.9852 => 0.9275, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: -5.80% (0.1879 => 0.1770, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.77% (0.2355 => 0.2219, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: -5.77% (7.0961 => 6.6869, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.76% (1.3722 => 1.2932, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.75% (1.0544 => 0.9938, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.72% (3.5339 => 3.3319, std.dev.: 0.0138) SingleSource/Benchmarks/McGill/chomp: -5.68% (0.1761 => 0.1661, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.67% (0.6052 => 0.5709, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.66% (0.5863 => 0.5531, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.64% (0.5478 => 0.5169, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.63% (0.5857 => 0.5527, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.63% (0.5805 => 0.5478, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.60% (6.7716 => 6.3925, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.60% (0.5591 => 0.5278, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.57% (0.5802 => 0.5479, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.57% (0.2695 => 0.2545, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.52% (0.5925 => 0.5598, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: -5.51% (0.3812 => 0.3602, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.50% (0.5859 => 0.5537, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.49% (0.3658 => 0.3457, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/exceptions-2: -5.48% (0.3831 => 0.3621, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.48% (4.0323 => 3.8114, std.dev.: 0.0090) SingleSource/UnitTests/ObjC/exceptions-4: -5.46% (0.3880 => 0.3668, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.46% (1.6364 => 1.5470, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.43% (0.5705 => 0.5395, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -5.43% (0.3406 => 0.3221, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: -5.43% (0.3848 => 0.3639, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.42% (1.2300 => 1.1633, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.42% (4.8161 => 4.5551, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.42% (0.6297 => 0.5956, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.41% (0.6446 => 0.6097, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.41% (0.6230 => 0.5893, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.41% (0.6304 => 0.5963, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.40% (0.5570 => 0.5269, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: -5.39% (0.3896 => 0.3686, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -5.39% (1.1450 => 1.0833, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.39% (0.4176 => 0.3951, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -5.39% (1.1530 => 1.0909, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/for-in: -5.38% (0.4033 => 0.3816, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.37% (0.6667 => 0.6309, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.36% (1.4642 => 1.3857, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.35% (0.5849 => 0.5536, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.35% (4.5069 => 4.2658, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.34% (1.2784 => 1.2101, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.34% (4.8802 => 4.6198, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.33% (0.5456 => 0.5165, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.33% (0.6194 => 0.5864, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.32% (0.3891 => 0.3684, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.31% (0.5575 => 0.5279, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.29% (0.6293 => 0.5960, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.29% (0.6660 => 0.6308, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.27% (0.6681 => 0.6329, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.25% (0.4515 => 0.4278, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: -5.25% (4.3330 => 4.1056, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.24% (0.6260 => 0.5932, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.24% (0.6189 => 0.5865, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.23% (0.5941 => 0.5630, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.23% (0.6736 => 0.6384, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.20% (0.4151 => 0.3935, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.18% (0.5581 => 0.5292, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.17% (0.3016 => 0.2860, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.16% (14.2083 => 13.4757, std.dev.: 0.0186) MultiSource/Applications/sqlite3/sqlite3: -5.16% (17.1032 => 16.2214, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/matrix: -5.13% (0.3255 => 0.3088, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -5.13% (1.3148 => 1.2474, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.11% (0.3483 => 0.3305, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -5.07% (1.2515 => 1.1880, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.07% (0.6033 => 0.5727, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -5.07% (0.3194 => 0.3032, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.07% (8.0126 => 7.6067, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: -5.06% (0.3025 => 0.2872, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -5.06% (0.3026 => 0.2873, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.05% (0.6440 => 0.6115, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.03% (0.2985 => 0.2835, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.02% (0.4916 => 0.4669, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.99% (0.3884 => 0.3690, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -4.99% (0.3446 => 0.3274, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.98% (0.5999 => 0.5700, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.98% (0.3837 => 0.3646, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -4.98% (1.3864 => 1.3174, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: -4.97% (0.3059 => 0.2907, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.96% (1.2210 => 1.1604, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.96% (1.6474 => 1.5657, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.96% (0.6676 => 0.6345, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -4.95% (0.2989 => 0.2841, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.93% (0.4199 => 0.3992, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.93% (1.2221 => 1.1619, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.92% (0.3252 => 0.3092, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.91% (0.3323 => 0.3160, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.89% (0.7919 => 0.7532, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.87% (0.3057 => 0.2908, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -4.86% (3.5154 => 3.3445, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/18-imp/imp: -4.86% (0.3581 => 0.3407, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.86% (0.8521 => 0.8107, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.85% (0.7339 => 0.6983, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.83% (0.3849 => 0.3663, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.83% (0.2278 => 0.2168, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: -4.81% (0.4861 => 0.4627, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.81% (0.2933 => 0.2792, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -4.81% (0.2871 => 0.2733, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -4.78% (15.5079 => 14.7664, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.78% (2.1713 => 2.0675, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.78% (0.2385 => 0.2271, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.77% (0.4280 => 0.4076, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.75% (0.2548 => 0.2427, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.73% (0.2999 => 0.2857, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: -4.71% (0.3394 => 0.3234, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -4.71% (0.3481 => 0.3317, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: -4.71% (0.4248 => 0.4048, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.70% (0.5168 => 0.4925, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: -4.70% (0.2939 => 0.2801, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -4.68% (0.3205 => 0.3055, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.67% (0.7021 => 0.6693, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -4.67% (0.2849 => 0.2716, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.66% (0.3931 => 0.3748, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.65% (0.5329 => 0.5081, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.65% (0.7524 => 0.7174, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.63% (0.4813 => 0.4590, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.63% (0.4321 => 0.4121, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -4.62% (0.7447 => 0.7103, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -4.60% (15.2527 => 14.5512, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.58% (0.3867 => 0.3690, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: -4.55% (0.2659 => 0.2538, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -4.54% (4.0594 => 3.8752, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.50% (0.6395 => 0.6107, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.50% (0.6395 => 0.6107, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.48% (22.4056 => 21.4008, std.dev.: 0.0136) MultiSource/Applications/oggenc/oggenc: -4.45% (5.0226 => 4.7993, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.44% (0.2903 => 0.2774, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.43% (0.3319 => 0.3172, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.37% (0.9557 => 0.9139, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.36% (0.4083 => 0.3905, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -4.35% (34.0927 => 32.6099, std.dev.: 0.0239) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.29% (0.4427 => 0.4237, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -4.25% (0.3621 => 0.3467, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.24% (0.5569 => 0.5333, std.dev.: 0.0076) MultiSource/Applications/siod/siod: -4.19% (2.4021 => 2.3015, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: -4.18% (0.6347 => 0.6082, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.17% (0.5567 => 0.5335, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -4.14% (0.3788 => 0.3631, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -4.13% (0.7982 => 0.7652, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.10% (2.2587 => 2.1660, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -4.08% (0.6441 => 0.6178, std.dev.: 0.0075) MultiSource/Applications/treecc/treecc: -4.06% (2.1401 => 2.0533, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -4.01% (0.6750 => 0.6479, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: -4.01% (0.7779 => 0.7467, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: -4.00% (0.8418 => 0.8081, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: -3.85% (0.3271 => 0.3145) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.72% (0.3491 => 0.3361, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.68% (0.9077 => 0.8743, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: -3.67% (0.4524 => 0.4358, std.dev.: 0.0036) MultiSource/Applications/hbd/hbd: -3.64% (1.5610 => 1.5042, std.dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: -3.61% (18.2933 => 17.6331, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.24% (5.4682 => 5.2910, std.dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: -2.30% (20.7746 => 20.2969, std.dev.: 0.0340) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7549, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1729, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.90% (2.2633 => 2.1750, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7061, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4668, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 3.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 12:24:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 14:24:21 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121119202421.569B62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6046?compare_to=6040&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6046, Order: 168312, Start Time: 2012-11-19 18:05:02, End Time: 2012-11-19 20:24:44 To: 6040, Order: 168310, Start Time: 2012-11-19 14:54:04, End Time: 2012-11-19 17:13:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 63 (146 on baseline) Performance Improvements: 21 (40 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1004 (701 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/objects/objects: 16.08% (0.1169 => 0.1357, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 15.72% (0.6290 => 0.7279, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.38% (0.5917 => 0.6827, std.dev.: 0.0117) MultiSource/Applications/lambda-0_1_3/lambda: 15.33% (0.8576 => 0.9891, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 15.26% (0.5917 => 0.6820, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 14.09% (0.6905 => 0.7878, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.90% (0.1655 => 0.1885, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.80% (0.6168 => 0.7019, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 13.56% (0.6895 => 0.7830, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 13.44% (0.7219 => 0.8189, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.24% (0.6684 => 0.7569, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.15% (0.3687 => 0.4172, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.89% (0.5793 => 0.6540, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 12.46% (0.6455 => 0.7259, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 12.34% (0.9876 => 1.1095, std.dev.: 0.0147) MultiSource/Applications/aha/aha: 12.32% (0.1347 => 0.1513, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 12.27% (0.6619 => 0.7431, std.dev.: 0.0048) MultiSource/Applications/minisat/minisat: 11.70% (0.8195 => 0.9154, std.dev.: 0.0158) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.54% (0.1915 => 0.2136, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.27% (0.5248 => 0.5787, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.17% (0.1042 => 0.1148, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: 9.75% (0.4494 => 0.4932, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.70% (0.3906 => 0.4285, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.67% (0.9201 => 1.0091, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.49% (0.1717 => 0.1880, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.35% (5.5861 => 6.1082, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.16% (0.6329 => 0.6909, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.98% (0.6917 => 0.7538, std.dev.: 0.0126) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.79% (0.7179 => 0.7810, std.dev.: 0.0235) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.59% (0.1909 => 0.2073, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.58% (0.4208 => 0.4569, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.50% (2.3303 => 2.5284, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/ReedSolomon: 8.09% (0.2200 => 0.2378, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.73% (0.4215 => 0.4541, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 7.57% (0.1677 => 0.1804, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/objinst: 7.25% (0.3364 => 0.3608, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.22% (1.2336 => 1.3227, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.85% (4.7313 => 5.0555, std.dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.39% (2.5979 => 2.7639, std.dev.: 0.0621) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.35% (0.6833 => 0.7267, std.dev.: 0.0102) MultiSource/Applications/treecc/treecc: 6.02% (2.4391 => 2.5859, std.dev.: 0.0135) MultiSource/Applications/hexxagon/hexxagon: 5.37% (1.4205 => 1.4968, std.dev.: 0.0237) MultiSource/Benchmarks/McCat/05-eks/eks: 4.84% (0.4832 => 0.5066, std.dev.: 0.0079) SingleSource/UnitTests/ObjC++/property-reference-object: 4.45% (0.6696 => 0.6994, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.70% (0.3325 => 0.3448, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 3.21% (19.9587 => 20.5991, std.dev.: 0.0208) MultiSource/Benchmarks/mafft/pairlocalalign: 3.19% (10.8734 => 11.2204, std.dev.: 0.0807) MultiSource/Applications/d/make_dparser: 2.78% (3.7778 => 3.8828, std.dev.: 0.0364) MultiSource/Applications/kimwitu++/kc: 1.14% (21.2540 => 21.4957, std.dev.: 0.0223) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: 74.71% (0.1048 => 0.1831, std.dev.: 0.0166) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 29.96% (0.3465 => 0.4503, std.dev.: 0.0085) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.61% (1.7382 => 1.9227, std.dev.: 0.0394) MultiSource/Applications/minisat/minisat: 6.71% (11.1759 => 11.9255, std.dev.: 0.2645) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.69% (0.5767 => 0.6095, std.dev.: 0.0096) MultiSource/Benchmarks/NPB-serial/is/is: 5.66% (8.5599 => 9.0444, std.dev.: 0.0213) MultiSource/Applications/lua/lua: 4.02% (26.8914 => 27.9723, std.dev.: 0.0323) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.37% (5.3366 => 5.5164, std.dev.: 0.0301) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.02% (9.9687 => 10.2696, std.dev.: 0.0897) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.25% (3.6049 => 3.6499, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.24% (87.1564 => 88.2372, std.dev.: 0.3080) SingleSource/Benchmarks/Misc/fbench: 1.09% (2.2929 => 2.3178, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.08% (3.0211 => 3.0537, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.07% (4.5092 => 4.5575, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -11.02% (0.3549 => 0.3158, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -10.60% (1.2422 => 1.1105, std.dev.: 0.0410) SingleSource/Benchmarks/Shootout-C++/spellcheck: -10.39% (0.5265 => 0.4718, std.dev.: 0.0203) MultiSource/Benchmarks/sim/sim: -9.39% (0.4109 => 0.3723, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/espresso/espresso: -9.02% (5.4154 => 4.9272, std.dev.: 0.1841) MultiSource/Benchmarks/Olden/health/health: -8.70% (0.1610 => 0.1470, std.dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: -7.69% (0.3889 => 0.3590, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/tsp/tsp: -7.61% (0.1538 => 0.1421, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.81% (1.6226 => 1.5121, std.dev.: 0.0270) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.78% (0.4354 => 0.4059, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/em3d/em3d: -5.90% (0.2100 => 0.1976, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.60% (8.5664 => 8.0863, std.dev.: 0.1852) SingleSource/UnitTests/ObjC/exceptions-3: -4.47% (0.4204 => 0.4016, std.dev.: 0.0056) MultiSource/Applications/lua/lua: -3.39% (4.5787 => 4.4233, std.dev.: 0.0377) MultiSource/Benchmarks/nbench/nbench: -2.42% (1.3634 => 1.3304, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.00% (11.0835 => 10.8618, std.dev.: 0.0819) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -51.11% (9.0123 => 4.4063, std.dev.: 1.6926) SingleSource/Benchmarks/CoyoteBench/fftbench: -22.21% (2.7079 => 2.1065, std.dev.: 0.2183) MultiSource/Benchmarks/Olden/bisort/bisort: -13.73% (1.0028 => 0.8651, std.dev.: 0.0332) MultiSource/Benchmarks/Bullet/bullet: -8.11% (9.0795 => 8.3436, std.dev.: 0.2469) MultiSource/Applications/sqlite3/sqlite3: -1.23% (4.6467 => 4.5895, std.dev.: 0.0031) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 2.02% (0.1337 => 0.1364, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0421 => 0.0420) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0651 => 0.0652, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -0.06% (494.3331 => 494.0157, std.dev.: 0.0693) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420) MultiSource/Benchmarks/Olden/power/power: 43707.37% (1.1277 => 494.0157, std.dev.: 0.0693) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.68% (0.5229 => 1.5409, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 21.89% (14.9895 => 18.2712, std.dev.: 0.0322) MultiSource/Applications/kimwitu++/kc: 51.86% (14.1553 => 21.4957, std.dev.: 0.0223) MultiSource/Benchmarks/MallocBench/gs/gs: 15.63% (4.1105 => 4.7530, std.dev.: 0.2011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.87% (1.1048 => 1.5121, std.dev.: 0.0270) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 426.85% (7.1582 => 37.7129, std.dev.: 0.6644) SingleSource/Benchmarks/Misc-C++-EH/spirit: 79.84% (3.4629 => 6.2276, std.dev.: 0.4299) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.28% (0.6222 => 1.0346, std.dev.: 0.0584) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11368.47% (0.0720 => 8.2573, std.dev.: 0.0465) MultiSource/Applications/SIBsim4/SIBsim4: 3859700.00% (0.0001 => 3.8598, std.dev.: 0.0365) MultiSource/Applications/SPASS/SPASS: 13850500.00% (0.0001 => 13.8506, std.dev.: 1.3069) MultiSource/Applications/kimwitu++/kc: 53500.00% (0.0001 => 0.0536, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 65000.00% (0.0001 => 0.0651, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 609400.00% (0.0001 => 0.6095, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10081000.00% (0.0001 => 10.0811, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6076700.00% (0.0001 => 6.0768, std.dev.: 0.6050) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1804.72% (1.1194 => 21.3214, std.dev.: 0.1301) MultiSource/Applications/ClamAV/clamscan: 70.17% (22.1758 => 37.7373, std.dev.: 0.3191) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.66% (2.9384 => 4.6032, std.dev.: 0.2302) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.98% (7.0540 => 10.8618, std.dev.: 0.0819) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.51% (8.1363 => 12.1649, std.dev.: 0.1627) MultiSource/Applications/JM/lencod/lencod: 47.36% (21.9371 => 32.3271, std.dev.: 0.1112) MultiSource/Benchmarks/FreeBench/distray/distray: 45.74% (0.1056 => 0.1539, std.dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/almabench: 39.04% (0.0730 => 0.1015, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops: 38.20% (0.1432 => 0.1979, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/08-main/main: 36.81% (0.2554 => 0.3494, std.dev.: 0.0147) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 34.85% (0.1584 => 0.2136, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/n-body: 33.78% (0.0746 => 0.0998, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 33.07% (0.7433 => 0.9891, std.dev.: 0.0080) MultiSource/Benchmarks/Fhourstones/fhourstones: 32.38% (0.1566 => 0.2073, std.dev.: 0.0025) MultiSource/Applications/aha/aha: 31.45% (0.1151 => 0.1513, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 31.40% (0.0793 => 0.1042, std.dev.: 0.0010) SingleSource/UnitTests/vla: 30.14% (0.0355 => 0.0462, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 28.66% (0.7115 => 0.9154, std.dev.: 0.0158) MultiSource/Applications/treecc/treecc: 27.55% (2.0273 => 2.5859, std.dev.: 0.0135) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 26.64% (0.0886 => 0.1122, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/five11/five11: 26.46% (0.0567 => 0.0717, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 25.49% (2.2024 => 2.7639, std.dev.: 0.0621) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 25.40% (0.4615 => 0.5787, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 25.30% (0.0842 => 0.1055, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 25.02% (0.2758 => 0.3448, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/04-bisect/bisect: 24.86% (0.1062 => 0.1326, std.dev.: 0.0016) SingleSource/Benchmarks/Stanford/Oscar: 24.69% (0.0636 => 0.0793, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 24.66% (0.0442 => 0.0551, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.56% (0.8101 => 1.0091, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 24.53% (0.3441 => 0.4285, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/ks/ks: 24.50% (0.1510 => 0.1880, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 24.37% (0.8921 => 1.1095, std.dev.: 0.0147) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.92% (0.0648 => 0.0803, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.91% (0.1029 => 0.1275, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 23.66% (0.6675 => 0.8254, std.dev.: 0.0173) SingleSource/Benchmarks/CoyoteBench/lpbench: 23.57% (0.0929 => 0.1148, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 23.53% (4.9449 => 6.1082, std.dev.: 0.0139) MultiSource/Applications/sgefa/sgefa: 23.48% (0.3109 => 0.3839, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 22.56% (1.5859 => 1.9437, std.dev.: 0.0742) SingleSource/Benchmarks/Shootout-C++/moments: 21.84% (0.4048 => 0.4932, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 21.81% (0.1114 => 0.1357, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 21.78% (1.5603 => 1.9002, std.dev.: 0.0256) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 21.74% (0.3427 => 0.4172, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 21.50% (0.5981 => 0.7267, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.37% (14.3668 => 17.4371, std.dev.: 0.2036) MultiSource/Applications/viterbi/viterbi: 21.16% (0.1555 => 0.1884, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 21.09% (0.6450 => 0.7810, std.dev.: 0.0235) MultiSource/Benchmarks/Olden/tsp/tsp: 20.94% (0.1175 => 0.1421, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 20.13% (0.8067 => 0.9691, std.dev.: 0.0347) MultiSource/Applications/sqlite3/sqlite3: 19.89% (17.1811 => 20.5991, std.dev.: 0.0208) MultiSource/Benchmarks/McCat/15-trie/trie: 19.73% (0.0527 => 0.0631, std.dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: 19.19% (0.0719 => 0.0857, std.dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.11% (0.1125 => 0.1340, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 19.06% (0.0640 => 0.0762, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 18.69% (0.3826 => 0.4541, std.dev.: 0.0089) MultiSource/Benchmarks/mafft/pairlocalalign: 18.30% (9.4845 => 11.2204, std.dev.: 0.0807) MultiSource/Applications/Burg/burg: 18.04% (1.1642 => 1.3742, std.dev.: 0.0525) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.99% (1.4186 => 1.6738, std.dev.: 0.0442) MultiSource/Benchmarks/McCat/05-eks/eks: 17.84% (0.4299 => 0.5066, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/17-bintr/bintr: 17.78% (0.0675 => 0.0795, std.dev.: 0.0043) MultiSource/Applications/oggenc/oggenc: 17.61% (5.7591 => 6.7733, std.dev.: 0.2514) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.49% (0.8172 => 0.9601, std.dev.: 0.0205) SingleSource/Benchmarks/Shootout-C++/random: 17.09% (0.2802 => 0.3281, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.80% (5.0018 => 5.8419, std.dev.: 0.1356) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.66% (0.2065 => 0.2409, std.dev.: 0.0132) MultiSource/Benchmarks/Olden/em3d/em3d: 16.58% (0.1695 => 0.1976, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 16.56% (1.2842 => 1.4968, std.dev.: 0.0237) MultiSource/Benchmarks/Olden/mst/mst: 16.51% (0.1163 => 0.1355, std.dev.: 0.0071) MultiSource/Applications/d/make_dparser: 16.41% (3.3354 => 3.8828, std.dev.: 0.0364) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.37% (0.0953 => 0.1109, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.11% (0.3935 => 0.4569, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/ReedSolomon: 16.06% (0.2049 => 0.2378, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/matrix: 16.01% (0.0818 => 0.0949, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 16.00% (0.1625 => 0.1885, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference-object: 15.99% (0.6030 => 0.6994, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/health/health: 15.93% (0.1268 => 0.1470, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.84% (0.0770 => 0.0892, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.76% (0.1117 => 0.1293, std.dev.: 0.0059) SingleSource/UnitTests/ObjC++/property-reference: 15.67% (0.7326 => 0.8474, std.dev.: 0.0194) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.54% (4.2646 => 4.9272, std.dev.: 0.1841) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.42% (0.2107 => 0.2432, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/objinst: 15.23% (0.3131 => 0.3608, std.dev.: 0.0089) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.23% (0.0834 => 0.0961, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/parameter-passing: 15.05% (0.3927 => 0.4518, std.dev.: 0.0209) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.03% (0.3121 => 0.3590, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.81% (2.2022 => 2.5284, std.dev.: 0.0087) MultiSource/Benchmarks/Bullet/bullet: 14.81% (63.2438 => 72.6082, std.dev.: 0.0452) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.65% (0.3543 => 0.4062, std.dev.: 0.0178) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.49% (0.0704 => 0.0806, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-2: 14.47% (0.3497 => 0.4003, std.dev.: 0.0078) SingleSource/UnitTests/ObjC/for-in: 14.40% (0.3694 => 0.4226, std.dev.: 0.0179) SingleSource/UnitTests/ObjC/trivial-interface: 14.40% (0.3473 => 0.3973, std.dev.: 0.0169) SingleSource/UnitTests/ObjC/property: 14.38% (0.3886 => 0.4445, std.dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.38% (0.3136 => 0.3587, std.dev.: 0.0148) SingleSource/UnitTests/ObjC/exceptions: 14.37% (0.3828 => 0.4378, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.36% (0.1337 => 0.1529, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.33% (0.5860 => 0.6700, std.dev.: 0.0263) MultiSource/Applications/lua/lua: 14.23% (3.8723 => 4.4233, std.dev.: 0.0377) SingleSource/UnitTests/ObjC/exceptions-3: 14.22% (0.3516 => 0.4016, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/synchronized: 14.21% (0.3561 => 0.4067, std.dev.: 0.0187) SingleSource/UnitTests/ObjC/exceptions-4: 14.14% (0.3543 => 0.4044, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.96% (0.2271 => 0.2588, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.72% (0.9765 => 1.1105, std.dev.: 0.0410) MultiSource/Benchmarks/McCat/18-imp/imp: 13.70% (0.3423 => 0.3892, std.dev.: 0.0125) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.21% (0.1143 => 0.1294, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/09-vor/vor: 12.74% (0.3180 => 0.3585, std.dev.: 0.0139) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.49% (0.1906 => 0.2144, std.dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 12.36% (1.1840 => 1.3304, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 10.97% (0.5925 => 0.6575, std.dev.: 0.0217) SingleSource/Benchmarks/Misc/oourafft: 10.57% (0.3282 => 0.3629, std.dev.: 0.0114) MultiSource/Benchmarks/sim/sim: 9.92% (0.3387 => 0.3723, std.dev.: 0.0121) MultiSource/Benchmarks/PAQ8p/paq8p: 9.27% (10.3673 => 11.3282, std.dev.: 0.0903) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.34% (0.3817 => 0.4059, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.30% (4.3953 => 11.0015, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/methcall: 147.46% (5.3999 => 13.3628, std.dev.: 0.0118) MultiSource/Benchmarks/McCat/17-bintr/bintr: 75.55% (0.1043 => 0.1831, std.dev.: 0.0166) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 38.30% (0.3256 => 0.4503, std.dev.: 0.0085) MultiSource/Applications/minisat/minisat: 30.82% (9.1159 => 11.9255, std.dev.: 0.2645) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 25.74% (13.4384 => 16.8975, std.dev.: 0.9949) SingleSource/Benchmarks/Misc/oourafft: 17.45% (6.6465 => 7.8060, std.dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.63% (1.1145 => 1.2998, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.94% (0.2944 => 0.3325, std.dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.67% (2.8904 => 3.2276, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: 10.18% (1.1396 => 1.2556, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.29% (1.7254 => 1.8857, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 7.20% (26.0924 => 27.9723, std.dev.: 0.0323) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.15% (4.2280 => 4.4880, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.6436 => 12.1302, std.dev.: 0.0061) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.32% (0.4162 => 0.4300, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 2.81% (0.6223 => 0.6398, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/dry: 2.30% (2.4116 => 2.4671, std.dev.: 0.0188) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.13% (1.3677 => 1.3969, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 2.12% (3.1595 => 3.2265, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 1.99% (85.0658 => 86.7551, std.dev.: 0.0638) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.84% (2.1424 => 2.1819, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/fbench: 1.79% (2.2771 => 2.3178, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.48% (6.5088 => 6.6049, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 1.47% (27.8444 => 28.2536, std.dev.: 0.0356) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.40% (2.3135 => 2.3460, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.24% (5.2139 => 5.2788, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0505, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.30% (6.6874 => 0.1804, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: -75.44% (0.8651 => 0.2125, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -74.93% (5.2763 => 1.3227, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/richards_benchmark: -44.76% (0.1622 => 0.0896, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.35% (5.3526 => 4.9056, std.dev.: 0.0857) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.13% (5.3855 => 5.0555, std.dev.: 0.0160) MultiSource/Applications/JM/ldecod/ldecod: -4.75% (10.4361 => 9.9401, std.dev.: 0.1402) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.20% (0.0628 => 0.0363, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.98% (0.3987 => 0.2393, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.72% (0.0506 => 0.0305, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.29% (4.5009 => 2.7774, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7636, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.15% (2.6546 => 2.0135, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -22.10% (10.7105 => 8.3436, std.dev.: 0.2469) MultiSource/Benchmarks/FreeBench/mason/mason: -19.34% (0.2161 => 0.1743, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4235, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2838, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.80% (32.5116 => 28.9993, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.96% (1.5660 => 1.4257, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.80% (3.2416 => 3.0537, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5761, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -5.43% (9.5636 => 9.0444, std.dev.: 0.0213) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: -5.04% (1.5835 => 1.5037, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.55% (19.9488 => 19.0414, std.dev.: 0.2342) SingleSource/Benchmarks/Shootout/lists: -4.17% (6.2999 => 6.0373, std.dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.43% (0.9957 => 0.9615, std.dev.: 0.0090) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8917, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.66% (0.4808 => 0.4680, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.83% (8.1563 => 8.0074, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6769, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -1.48% (10.2830 => 10.1307, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: -1.18% (4.6441 => 4.5895, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.15% (0.1485 => 0.1364, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0015) Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 13:51:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 15:51:55 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121119215155.311FB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6047?compare_to=6044&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6047, Order: 168321, Start Time: 2012-11-19 20:18:57, End Time: 2012-11-19 21:52:18 To: 6044, Order: 168316, Start Time: 2012-11-19 18:26:45, End Time: 2012-11-19 20:00:52 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 0 (49 on baseline) Performance Improvements: 2 (19 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1052 (906 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/05-eks/eks: -4.76% (0.4687 => 0.4464, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.31% (0.8542 => 0.8430, std.dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.01% (1.0544 => 1.0650, std.dev.: 0.0920) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 17.84% (0.0185 => 0.0218, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -11.83% (0.0431 => 0.0380, std.dev.: 0.0131) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -4.80% (0.0333 => 0.0317, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0308 => 0.0307, std.dev.: 0.0114) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.87% (0.0375 => 0.0412, std.dev.: 0.0110) SingleSource/UnitTests/Vector/Altivec/casts: -0.98% (0.0205 => 0.0203, std.dev.: 0.0066) SingleSource/UnitTests/Vector/Altivec/test1: -0.46% (0.0219 => 0.0218, std.dev.: 0.0061) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -64.29% (0.0014 => 0.0005, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.08% (0.1479 => 0.1495, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: -5.03% (1.2103 => 1.1494, std.dev.: 0.1375) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.55% (0.4136 => 0.4324, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.56% (0.1433 => 0.1425, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.85% (0.0648 => 0.0636, std.dev.: 0.0199) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -16.17% (0.0266 => 0.0223, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.44% (0.0616 => 0.0601, std.dev.: 0.0123) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.71% (1.1932 => 1.2017, std.dev.: 0.0601) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -38.71% (0.0031 => 0.0019, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -85.71% (0.0007 => 0.0001, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.40% (0.0646 => 0.0553, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -26.22% (0.0267 => 0.0197, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.53% (0.7948 => 0.7747, std.dev.: 0.0063) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0007 => 0.0007, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 45.00% (0.0040 => 0.0058, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 6.91% (16.4461 => 17.5818, std.dev.: 0.5911) MultiSource/Applications/sqlite3/sqlite3: 2354.80% (0.6332 => 15.5438, std.dev.: 0.3450) MultiSource/Benchmarks/McCat/08-main/main: 49.32% (0.1831 => 0.2734, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.22% (0.1559 => 0.1462, std.dev.: 0.0320) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7154.98% (0.3123 => 22.6573, std.dev.: 0.8014) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.48% (0.2463 => 0.3731, std.dev.: 0.0157) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1517.91% (0.3344 => 5.4103, std.dev.: 0.3225) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.89% (0.2364 => 0.3236, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/bigfib: 4.18% (0.6010 => 0.6261, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel: 3.03% (0.0429 => 0.0442, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.19% (0.3266 => 0.3403, std.dev.: 0.0604) SingleSource/Benchmarks/Shootout-C++/strcat: 2.95% (0.1969 => 0.2027, std.dev.: 0.0069) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.80% (0.0224 => 0.0237, std.dev.: 0.0081) SingleSource/UnitTests/byval-alignment: -30.87% (0.0230 => 0.0159, std.dev.: 0.0015) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0437, std.dev.: 0.0077) MultiSource/Applications/oggenc/oggenc: 9.17% (0.1462 => 0.1596, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4653, std.dev.: 0.0477) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0690, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4879, std.dev.: 0.0111) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5219, std.dev.: 0.0597) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.6299, std.dev.: 0.5227) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3238, std.dev.: 0.0347) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1283, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3627, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4080, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0792, std.dev.: 0.0127) SingleSource/Regression/C/uint64_to_float: -23.80% (2.1832 => 1.6637, std.dev.: 0.0265) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.64% (0.0810 => 0.0961, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/tsp/tsp: 13.40% (0.1112 => 0.1261, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.26% (0.0848 => 0.0952, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.68% (0.2180 => 0.2391, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.66% (0.1905 => 0.2051, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.16% (0.2519 => 0.2649, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.14% (0.4783 => 0.4981, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.99% (0.9039 => 0.9400, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.77% (0.8697 => 0.9025, std.dev.: 0.0041) MultiSource/Applications/hbd/hbd: 3.30% (1.4269 => 1.4740, std.dev.: 0.0118) MultiSource/Applications/lua/lua: 3.26% (3.8189 => 3.9435, std.dev.: 0.0380) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.73% (0.9074 => 0.9322, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.57% (0.8007 => 0.8213, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 2.34% (0.6834 => 0.6994, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.26% (0.8359 => 0.8548, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.25% (0.5191 => 0.5308, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 2.24% (0.7557 => 0.7726, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.21% (0.9056 => 0.9256, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.14% (0.8086 => 0.8259, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.05% (0.8261 => 0.8430, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 98.99% (0.0199 => 0.0396, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/pi: 42.79% (1.5795 => 2.2554, std.dev.: 0.1191) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.35% (2.9753 => 3.4618, std.dev.: 0.0190) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.48% (0.7597 => 0.8773, std.dev.: 0.0302) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.54% (2.7995 => 3.2066, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.54% (5.0261 => 5.6060, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.73% (1.1857 => 1.2773, std.dev.: 0.0059) SingleSource/Benchmarks/McGill/queens: 7.67% (1.7056 => 1.8365, std.dev.: 0.0424) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.73% (4.7794 => 5.1009, std.dev.: 0.0430) SingleSource/Benchmarks/Misc/richards_benchmark: 6.23% (1.3037 => 1.3849, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.88% (4.5327 => 4.7994, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.86% (4.9686 => 5.2598, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.82% (6.3772 => 6.7482, std.dev.: 0.1017) MultiSource/Applications/SIBsim4/SIBsim4: 5.73% (3.1873 => 3.3698, std.dev.: 0.0605) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.76% (6.2275 => 6.5237, std.dev.: 0.0060) MultiSource/Applications/lambda-0_1_3/lambda: 4.69% (7.4933 => 7.8445, std.dev.: 0.0756) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.15% (4.9453 => 5.1505, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.98% (4.9469 => 5.1439, std.dev.: 0.0155) MultiSource/Applications/hexxagon/hexxagon: 3.95% (14.0064 => 14.5600, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.78% (11.5690 => 11.8904, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.57% (8.2783 => 8.4912, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.37% (4.8660 => 4.9815, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout/lists: 2.30% (7.3375 => 7.5062, std.dev.: 0.0192) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.13% (1.1365 => 1.1607, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.80% (1.3882 => 1.4132, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/neural/neural: 1.33% (1.0841 => 1.0985, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.20% (2.4647 => 2.4943, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.18% (3.5679 => 3.6101, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/ReedSolomon: 1.17% (8.5322 => 8.6321, std.dev.: 0.0281) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.98% (5.4641 => 4.3179, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.01% (7.2130 => 6.2744, std.dev.: 0.2608) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.88% (1.0512 => 0.9368, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.48% (14.6451 => 13.4035, std.dev.: 0.1322) MultiSource/Benchmarks/mafft/pairlocalalign: -8.44% (63.1822 => 57.8466, std.dev.: 0.0991) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.92% (4.7482 => 4.4196, std.dev.: 0.0790) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.97% (5.4972 => 5.1689, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.97% (3.7148 => 3.4931, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.09% (5.1557 => 4.8934, std.dev.: 0.0500) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.41% (4.7449 => 4.5358, std.dev.: 0.0361) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.71% (6.0224 => 5.7989, std.dev.: 0.0694) MultiSource/Applications/lua/lua: -3.22% (29.8330 => 28.8728, std.dev.: 0.1596) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.06% (28.5821 => 27.7066, std.dev.: 0.2184) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.75% (9.9065 => 9.6337, std.dev.: 0.0739) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.01% (11.5316 => 11.2999, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.94% (3.2169 => 3.1546, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.59% (4.9994 => 4.9199, std.dev.: 0.0215) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.50% (2.3487 => 2.3134, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.17% (5.6343 => 5.5684, std.dev.: 0.0074) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.78% (1.0262 => 1.0650, std.dev.: 0.0920) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -6.86% (0.0408 => 0.0380, std.dev.: 0.0131) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 24.80% (0.0254 => 0.0317, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.66% (0.0302 => 0.0307, std.dev.: 0.0114) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 7.29% (0.0384 => 0.0412, std.dev.: 0.0110) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0066) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0061) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -28.57% (0.0007 => 0.0005, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 3.96% (0.1438 => 0.1495, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: 1.46% (1.1329 => 1.1494, std.dev.: 0.1375) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.84% (0.4164 => 0.4324, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.09% (0.1369 => 0.1425, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.78% (0.0641 => 0.0636, std.dev.: 0.0199) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 14.36% (0.0195 => 0.0223, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.98% (0.0578 => 0.0601, std.dev.: 0.0123) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.07% (1.1437 => 1.2017, std.dev.: 0.0601) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1800.00% (0.0001 => 0.0019, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.80% (0.0627 => 0.0553, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.44% (0.0180 => 0.0197, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.37% (0.8017 => 0.7747, std.dev.: 0.0063) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: -6.45% (0.0062 => 0.0058, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 14:00:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 16:00:09 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121119220009.AD3D42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6048?compare_to=6045&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6048, Order: 168321, Start Time: 2012-11-19 20:26:36, End Time: 2012-11-19 22:00:32 To: 6045, Order: 168316, Start Time: 2012-11-19 18:29:43, End Time: 2012-11-19 20:03:33 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (180 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (857 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 17.19% (0.3834 => 0.4493, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1006, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4937 => 7.6764, std.dev.: 0.0213) SingleSource/Benchmarks/Shootout-C++/hash2: 2.18% (3.1932 => 3.2629, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.77% (0.3821 => 0.3524, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.67% (0.9542 => 0.8906, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.58% (0.3357 => 0.3136, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.49% (0.3142 => 0.2938, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -6.44% (0.2160 => 0.2021, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -6.42% (2.4924 => 2.3324, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -6.24% (9.2283 => 8.6524, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.10% (0.2428 => 0.2280, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.07% (0.1796 => 0.1687, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.99% (0.2355 => 0.2214, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: -5.99% (16.1920 => 15.2229, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.97% (0.6484 => 0.6097, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -5.96% (0.1879 => 0.1767, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.95% (0.9852 => 0.9266, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/chomp: -5.91% (0.1761 => 0.1657, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: -5.88% (7.0961 => 6.6791, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/football/football: -5.87% (0.9179 => 0.8640, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.82% (1.3722 => 1.2923, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.79% (6.7716 => 6.3795, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.74% (3.5339 => 3.3311, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.71% (0.2695 => 0.2541) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.70% (4.0323 => 3.8026, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.69% (1.0544 => 0.9944, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.68% (0.5805 => 0.5475, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.67% (0.5857 => 0.5525, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.66% (0.5863 => 0.5531, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.66% (0.3658 => 0.3451, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.61% (0.3848 => 0.3632, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.60% (1.6364 => 1.5447, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.60% (0.7198 => 0.6795, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.60% (4.8161 => 4.5466, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.57% (0.6052 => 0.5715, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.56% (0.5591 => 0.5280, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -5.54% (0.3880 => 0.3665, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -5.53% (1.1530 => 1.0892, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.53% (0.5478 => 0.5175, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.52% (4.8802 => 4.6108, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: -5.51% (0.3812 => 0.3602, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.50% (1.4642 => 1.3836, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.50% (1.2300 => 1.1624, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: -5.49% (0.3896 => 0.3682, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.49% (0.3406 => 0.3219, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.48% (0.5859 => 0.5538, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.48% (0.6736 => 0.6367, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: -5.47% (1.1450 => 1.0824, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.46% (0.5802 => 0.5485, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -5.46% (0.4176 => 0.3948, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.45% (0.5705 => 0.5394, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.44% (0.5456 => 0.5159, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -5.43% (0.3831 => 0.3623, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.43% (0.6304 => 0.5962, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.42% (0.6660 => 0.6299, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.42% (0.5849 => 0.5532, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.42% (0.6293 => 0.5952, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.42% (0.5925 => 0.5604, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.40% (0.6446 => 0.6098, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.40% (0.8521 => 0.8061, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.40% (0.3891 => 0.3681, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.38% (0.6297 => 0.5958, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.38% (0.6260 => 0.5923, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -5.38% (0.4033 => 0.3816, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.38% (0.6189 => 0.5856, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.38% (4.5069 => 4.2645, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.38% (0.6230 => 0.5895, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.38% (0.6194 => 0.5861, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.36% (0.6681 => 0.6323, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.33% (1.2784 => 1.2102, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.32% (0.5581 => 0.5284, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -5.32% (0.4515 => 0.4275, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: -5.26% (4.3330 => 4.1049, std.dev.: 0.0046) MultiSource/Applications/sqlite3/sqlite3: -5.26% (17.1032 => 16.2032, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.26% (0.5570 => 0.5277, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -5.26% (0.2985 => 0.2828, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.26% (14.2083 => 13.4616, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.25% (0.5941 => 0.5629, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.19% (0.6667 => 0.6321, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.19% (0.4916 => 0.4661, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.18% (0.5575 => 0.5286, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.17% (0.5688 => 0.5394, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.17% (1.2210 => 1.1579, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.16% (0.7919 => 0.7510, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.16% (1.2221 => 1.1590, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: -5.15% (1.3864 => 1.3150, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.15% (1.6474 => 1.5626, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: -5.14% (0.3581 => 0.3397, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.12% (0.6440 => 0.6110, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.12% (0.6676 => 0.6334, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: -5.12% (0.4199 => 0.3984, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.12% (0.5999 => 0.5692, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.11% (8.0126 => 7.6033, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.11% (0.6033 => 0.5725, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.05% (0.3884 => 0.3688, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -5.03% (1.2515 => 1.1885, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.00% (0.2278 => 0.2164, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.00% (0.2999 => 0.2849, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -4.97% (3.5154 => 3.3406, std.dev.: 0.0081) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.95% (0.2548 => 0.2422, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.86% (0.2385 => 0.2269, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/parameter-passing: -4.86% (0.4280 => 0.4072, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: -4.85% (0.2659 => 0.2530, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -4.78% (15.5079 => 14.7662, std.dev.: 0.0219) MultiSource/Applications/ClamAV/clamscan: -4.78% (15.2527 => 14.5239, std.dev.: 0.0098) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.76% (0.3319 => 0.3161, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.76% (0.5168 => 0.4922, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.73% (0.7021 => 0.6689, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -4.73% (0.7447 => 0.7095, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -4.70% (1.3148 => 1.2530, std.dev.: 0.0013) MultiSource/Applications/lua/lua: -4.69% (4.0594 => 3.8689, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.68% (0.3483 => 0.3320, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.68% (0.7524 => 0.7172, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.63% (0.7339 => 0.6999, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.60% (0.5329 => 0.5084, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.58% (0.6395 => 0.6102, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.55% (0.4151 => 0.3962, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.54% (22.4056 => 21.3873, std.dev.: 0.0211) SingleSource/Benchmarks/Shootout-C++/matrix: -4.52% (0.3255 => 0.3108, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.50% (0.6395 => 0.6107, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.48% (0.3016 => 0.2881, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -4.46% (0.3025 => 0.2890, std.dev.: 0.0048) MultiSource/Benchmarks/Bullet/bullet: -4.42% (34.0927 => 32.5843, std.dev.: 0.0270) SingleSource/Benchmarks/Shootout-C++/objinst: -4.41% (0.3194 => 0.3053, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: -4.41% (5.0226 => 4.8012, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -4.40% (0.4861 => 0.4647, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.38% (0.3837 => 0.3669, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.37% (2.2587 => 2.1600, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.36% (0.4813 => 0.4603, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: -4.36% (0.3394 => 0.3246, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.35% (0.3931 => 0.3760, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -4.35% (2.4021 => 2.2977, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.34% (0.3849 => 0.3682, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.34% (0.3252 => 0.3111, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.33% (0.3323 => 0.3179, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.32% (0.2989 => 0.2860, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.30% (2.1713 => 2.0780, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.29% (0.3057 => 0.2926, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -4.28% (0.2871 => 0.2748, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -4.27% (0.3446 => 0.3299, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.26% (0.5567 => 0.5330, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: -4.24% (0.4248 => 0.4068, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -4.23% (0.3026 => 0.2898, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -4.22% (0.3481 => 0.3334, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.22% (0.5569 => 0.5334, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/09-vor/vor: -4.22% (0.3271 => 0.3133, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.20% (0.9077 => 0.8696, std.dev.: 0.0049) MultiSource/Applications/treecc/treecc: -4.19% (2.1401 => 2.0504, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.19% (0.9557 => 0.9157, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.17% (0.2903 => 0.2782, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -4.16% (0.8418 => 0.8068, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: -4.15% (0.2939 => 0.2817, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists1: -4.14% (0.3867 => 0.3707, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.13% (0.2933 => 0.2812, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.09% (0.3205 => 0.3074, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -4.09% (0.3059 => 0.2934, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.08% (0.6347 => 0.6088, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -4.07% (0.2849 => 0.2733, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -4.02% (0.7982 => 0.7661, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: -4.01% (0.6441 => 0.6183, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -3.98% (0.3621 => 0.3477, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.89% (0.4083 => 0.3924, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.89% (0.4321 => 0.4153, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.82% (0.4427 => 0.4258, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.67% (0.3491 => 0.3363, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: -3.64% (0.3788 => 0.3650, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -3.63% (0.6750 => 0.6505, std.dev.: 0.0042) MultiSource/Applications/hbd/hbd: -3.50% (1.5610 => 1.5064, std.dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: -3.45% (18.2933 => 17.6628, std.dev.: 0.0162) SingleSource/UnitTests/ObjC++/property-reference: -3.39% (0.7779 => 0.7515, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -3.34% (0.4524 => 0.4373, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.96% (5.4682 => 5.3061, std.dev.: 0.0146) SingleSource/UnitTests/Vector/constpool: -2.90% (20.7746 => 20.1718, std.dev.: 0.0147) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7549, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1729, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7060, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.73% (2.2633 => 2.1788, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.83% (1.3096 => 1.2726, std.dev.: 0.0086) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4687, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 15:39:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 17:39:50 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121119233950.D41A32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6049?compare_to=6046&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6049, Order: 168321, Start Time: 2012-11-19 21:20:58, End Time: 2012-11-19 23:40:13 To: 6046, Order: 168312, Start Time: 2012-11-19 18:05:02, End Time: 2012-11-19 20:24:44 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 41 (135 on baseline) Performance Improvements: 11 (41 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1036 (711 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.25% (0.1177 => 0.1380, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.26% (0.0839 => 0.0967, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 13.31% (0.5793 => 0.6564, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 12.01% (0.6705 => 0.7510, std.dev.: 0.0070) MultiSource/Benchmarks/nbench/nbench: 11.93% (1.3304 => 1.4891, std.dev.: 0.0197) SingleSource/Benchmarks/McGill/chomp: 11.41% (0.1893 => 0.2109, std.dev.: 0.0082) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.78% (0.3590 => 0.3977, std.dev.: 0.0038) MultiSource/Benchmarks/sim/sim: 10.50% (0.3723 => 0.4114, std.dev.: 0.0021) SingleSource/Benchmarks/Linpack/linpack-pc: 10.04% (0.2898 => 0.3189, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/health/health: 9.93% (0.1470 => 0.1616, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.88% (0.3724 => 0.4092, std.dev.: 0.0074) SingleSource/Benchmarks/LivermoreLoops/kernel18: 9.79% (0.1501 => 0.1648, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.40% (1.5121 => 1.6543, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/ary3: 9.04% (0.3605 => 0.3931, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.23% (0.5639 => 0.6103, std.dev.: 0.0176) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.04% (0.3346 => 0.3615, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.02% (0.8091 => 0.8740, std.dev.: 0.0204) MultiSource/Benchmarks/Olden/tsp/tsp: 7.95% (0.1421 => 0.1534, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.94% (1.0346 => 1.1167, std.dev.: 0.0316) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.78% (1.7456 => 1.8814, std.dev.: 0.0329) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.06% (0.2409 => 0.2579, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.37% (1.1105 => 1.1812, std.dev.: 0.0220) MultiSource/Applications/d/make_dparser: 6.11% (3.8828 => 4.1200, std.dev.: 0.0646) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.82% (0.6909 => 0.7311, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.37% (0.4541 => 0.4785, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.10% (0.3587 => 0.3734, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.09% (0.7538 => 0.7771, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.35% (0.7569 => 0.7747, std.dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 18.66% (0.0761 => 0.0903, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: 16.01% (0.0762 => 0.0884, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 15.76% (5.3773 => 6.2245, std.dev.: 0.0821) MultiSource/Benchmarks/Olden/tsp/tsp: 14.74% (1.1033 => 1.2659, std.dev.: 0.0304) MultiSource/Benchmarks/Olden/bisort/bisort: 14.35% (0.8651 => 0.9892, std.dev.: 0.0246) MultiSource/Benchmarks/Olden/health/health: 11.27% (0.4606 => 0.5125, std.dev.: 0.0083) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.36% (8.9573 => 9.6166, std.dev.: 0.2261) SingleSource/Benchmarks/McGill/chomp: 5.80% (1.2166 => 1.2872, std.dev.: 0.0219) MultiSource/Applications/lemon/lemon: 5.08% (1.4493 => 1.5229, std.dev.: 0.0255) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.51% (7.2827 => 7.3924, std.dev.: 0.0290) MultiSource/Applications/SIBsim4/SIBsim4: 1.45% (3.8598 => 3.9156, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.23% (4.9806 => 5.0418, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.04% (5.4215 => 5.4777, std.dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/aha/aha: -12.23% (0.1513 => 0.1328, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -11.63% (0.4172 => 0.3687, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/football/football: -11.09% (1.1095 => 0.9865, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -8.90% (6.1082 => 5.5644, std.dev.: 0.1450) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -8.84% (0.4285 => 0.3906, std.dev.: 0.0125) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.83% (0.1880 => 0.1714, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -7.78% (2.5284 => 2.3317, std.dev.: 0.0531) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.19% (5.0555 => 4.6921, std.dev.: 0.1128) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.37% (4.9056 => 4.6911, std.dev.: 0.0765) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.95% (21.3214 => 20.9052, std.dev.: 0.0647) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/NPB-serial/is/is: -5.33% (9.0444 => 8.5624, std.dev.: 0.1736) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -1.98% (0.1364 => 0.1337, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.76% (0.0420 => 0.0482, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.53% (0.0652 => 0.0675, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 0.04% (494.0157 => 494.2179, std.dev.: 0.1917) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.90% (4.3882 => 0.0482, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/power/power: 43725.30% (1.1277 => 494.2179, std.dev.: 0.1917) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.43% (0.5229 => 1.5396, std.dev.: 0.0988) MultiSource/Applications/SPASS/SPASS: 22.73% (14.9895 => 18.3963, std.dev.: 0.0754) MultiSource/Applications/kimwitu++/kc: 49.58% (14.1553 => 21.1732, std.dev.: 0.1452) MultiSource/Benchmarks/MallocBench/gs/gs: 18.87% (4.1105 => 4.8862, std.dev.: 0.2334) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 49.74% (1.1048 => 1.6543, std.dev.: 0.0110) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 425.12% (7.1582 => 37.5888, std.dev.: 0.0448) SingleSource/Benchmarks/Misc-C++-EH/spirit: 75.78% (3.4629 => 6.0872, std.dev.: 0.4077) SingleSource/Benchmarks/Misc-C++/stepanov_container: 79.48% (0.6222 => 1.1167, std.dev.: 0.0316) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10407.36% (0.0720 => 7.5653, std.dev.: 0.2996) MultiSource/Applications/SIBsim4/SIBsim4: 3915500.00% (0.0001 => 3.9156, std.dev.: 0.0193) MultiSource/Applications/SPASS/SPASS: 13275800.00% (0.0001 => 13.2759, std.dev.: 1.3319) MultiSource/Applications/kimwitu++/kc: 52200.00% (0.0001 => 0.0523, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14400.00% (0.0001 => 0.0145, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 592800.00% (0.0001 => 0.5929, std.dev.: 0.0193) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10077600.00% (0.0001 => 10.0777, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5678200.00% (0.0001 => 5.6783, std.dev.: 0.9336) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1767.54% (1.1194 => 20.9052, std.dev.: 0.0647) MultiSource/Applications/ClamAV/clamscan: 67.33% (22.1758 => 37.1064, std.dev.: 0.3788) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 58.10% (7.0540 => 11.1526, std.dev.: 0.2246) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.15% (2.9384 => 4.6177, std.dev.: 0.3252) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 51.00% (8.1363 => 12.2856, std.dev.: 0.1464) MultiSource/Applications/JM/lencod/lencod: 47.19% (21.9371 => 32.2888, std.dev.: 0.1315) MultiSource/Benchmarks/FreeBench/distray/distray: 45.17% (0.1056 => 0.1533, std.dev.: 0.0104) SingleSource/Benchmarks/CoyoteBench/almabench: 42.88% (0.0730 => 0.1043, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 38.34% (0.1432 => 0.1981, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 32.47% (0.0730 => 0.0967, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 32.18% (0.1044 => 0.1380, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Towers: 31.85% (0.0471 => 0.0621, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 31.60% (0.0326 => 0.0429, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 30.55% (0.1175 => 0.1534, std.dev.: 0.0008) SingleSource/UnitTests/vla: 30.14% (0.0355 => 0.0462, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bisort/bisort: 28.83% (0.0614 => 0.0791, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 27.52% (0.2700 => 0.3443, std.dev.: 0.0156) SingleSource/Benchmarks/Stanford/Treesort: 27.49% (0.0411 => 0.0524, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 27.44% (0.1268 => 0.1616, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 27.43% (0.1655 => 0.2109, std.dev.: 0.0082) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.43% (0.3121 => 0.3977, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 26.54% (0.0437 => 0.0553, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 26.21% (0.7433 => 0.9381, std.dev.: 0.0267) MultiSource/Benchmarks/nbench/nbench: 25.77% (1.1840 => 1.4891, std.dev.: 0.0197) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 25.07% (0.3826 => 0.4785, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.89% (0.2065 => 0.2579, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.26% (0.0746 => 0.0927, std.dev.: 0.0036) MultiSource/Applications/d/make_dparser: 23.52% (3.3354 => 4.1200, std.dev.: 0.0646) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 22.71% (0.1114 => 0.1367, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.65% (0.1117 => 0.1370, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 22.53% (0.0719 => 0.0881, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 22.05% (1.5415 => 1.8814, std.dev.: 0.0329) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.82% (0.0770 => 0.0938, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.78% (0.1566 => 0.1907, std.dev.: 0.0100) MultiSource/Applications/minisat/minisat: 21.63% (0.7115 => 0.8654, std.dev.: 0.0240) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 21.60% (0.0838 => 0.1019, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 21.57% (0.5020 => 0.6103, std.dev.: 0.0176) MultiSource/Benchmarks/sim/sim: 21.46% (0.3387 => 0.4114, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 21.15% (0.7835 => 0.9492, std.dev.: 0.0286) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 21.10% (0.0834 => 0.1010, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 21.10% (0.3379 => 0.4092, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.96% (0.9765 => 1.1812, std.dev.: 0.0220) MultiSource/Benchmarks/MallocBench/espresso/espresso: 20.80% (4.2646 => 5.1518, std.dev.: 0.1186) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 20.77% (0.0491 => 0.0593, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.64% (0.1584 => 0.1911, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/reversefile: 20.62% (0.3865 => 0.4662, std.dev.: 0.0168) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.55% (0.0793 => 0.0956, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 20.44% (14.3668 => 17.3038, std.dev.: 0.0881) SingleSource/Benchmarks/McGill/exptree: 20.27% (0.0814 => 0.0979, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.82% (0.1337 => 0.1602, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 19.81% (0.4620 => 0.5535, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/ary3: 19.74% (0.3283 => 0.3931, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/misr: 19.27% (0.0633 => 0.0755, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 19.07% (0.3136 => 0.3734, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 18.42% (0.0798 => 0.0945, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 18.28% (0.4064 => 0.4807, std.dev.: 0.0155) MultiSource/Applications/oggenc/oggenc: 18.21% (5.7591 => 6.8081, std.dev.: 0.2444) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.05% (0.0842 => 0.0994, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/trivial-interface: 17.59% (0.3473 => 0.4084, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout/lists: 17.57% (0.0626 => 0.0736, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.55% (1.3050 => 1.5340, std.dev.: 0.0648) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.22% (0.0871 => 0.1021, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 17.16% (9.4845 => 11.1119, std.dev.: 0.0856) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 16.98% (0.1625 => 0.1901, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.94% (0.8172 => 0.9556, std.dev.: 0.0325) MultiSource/Benchmarks/Olden/em3d/em3d: 16.46% (0.1695 => 0.1974, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 16.34% (0.2430 => 0.2827, std.dev.: 0.0128) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.20% (0.0648 => 0.0753, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/mst/mst: 16.17% (0.1163 => 0.1351, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.03% (0.0886 => 0.1028, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/matrix: 16.01% (0.0818 => 0.0949, std.dev.: 0.0043) MultiSource/Applications/viterbi/viterbi: 16.01% (0.1555 => 0.1804, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.52% (0.1940 => 0.2241, std.dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: 15.38% (17.1811 => 19.8241, std.dev.: 0.3786) MultiSource/Applications/aha/aha: 15.38% (0.1151 => 0.1328, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.19% (0.4636 => 0.5340, std.dev.: 0.0219) SingleSource/UnitTests/ObjC++/Hello: 15.12% (0.5925 => 0.6821, std.dev.: 0.0172) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.09% (0.2107 => 0.2425, std.dev.: 0.0098) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.63% (0.0704 => 0.0807, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 14.44% (63.2438 => 72.3742, std.dev.: 0.0568) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.41% (0.1062 => 0.1215, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.19% (0.1029 => 0.1175, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.10% (0.5569 => 0.6354, std.dev.: 0.0282) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.09% (0.5981 => 0.6824, std.dev.: 0.0211) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.91% (0.2271 => 0.2587, std.dev.: 0.0103) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 13.79% (0.3177 => 0.3615, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/18-imp/imp: 13.76% (0.3423 => 0.3894, std.dev.: 0.0180) MultiSource/Applications/sgefa/sgefa: 13.67% (0.3109 => 0.3534, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.51% (0.3441 => 0.3906, std.dev.: 0.0125) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.51% (0.1510 => 0.1714, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.40% (0.3561 => 0.4038, std.dev.: 0.0143) SingleSource/UnitTests/ObjC/property: 13.33% (0.3886 => 0.4404, std.dev.: 0.0181) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.21% (0.3543 => 0.4011, std.dev.: 0.0165) SingleSource/UnitTests/ObjC/exceptions-2: 13.04% (0.3497 => 0.3953, std.dev.: 0.0147) SingleSource/UnitTests/ObjC/for-in: 12.91% (0.3694 => 0.4171, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.53% (4.9449 => 5.5644, std.dev.: 0.1450) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.04% (5.0018 => 5.6038, std.dev.: 0.1958) MultiSource/Benchmarks/Prolangs-C/football/football: 10.58% (0.8921 => 0.9865, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 9.66% (10.3673 => 11.3683, std.dev.: 0.1560) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.51% (2.0665 => 2.2630, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.21% (4.3953 => 10.9975, std.dev.: 0.0220) SingleSource/Benchmarks/Shootout-C++/methcall: 147.65% (5.3999 => 13.3731, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary2: 19.29% (0.0757 => 0.0903, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bisort/bisort: 18.71% (0.8333 => 0.9892, std.dev.: 0.0246) SingleSource/Benchmarks/Misc/oourafft: 17.59% (6.6465 => 7.8156, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.59% (13.4384 => 15.8016, std.dev.: 0.4661) MultiSource/Benchmarks/Olden/tsp/tsp: 17.38% (1.0785 => 1.2659, std.dev.: 0.0304) SingleSource/Benchmarks/Shootout-C++/ary: 16.93% (0.0756 => 0.0884, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.60% (1.1145 => 1.2995, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/health/health: 15.30% (0.4445 => 0.5125, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.15% (0.2944 => 0.3390, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.58% (2.8904 => 3.2252, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.79% (8.6802 => 9.6166, std.dev.: 0.2261) SingleSource/Benchmarks/Misc/richards_benchmark: 10.15% (1.1396 => 1.2553, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.30% (1.7254 => 1.8859, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 9.10% (3.1578 => 3.4453, std.dev.: 0.1057) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.95% (0.9540 => 1.0108, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.72% (4.2280 => 4.4699, std.dev.: 0.0076) MultiSource/Applications/lemon/lemon: 5.32% (1.4460 => 1.5229, std.dev.: 0.0255) SingleSource/Regression/C/uint64_to_float: 5.08% (0.5413 => 0.5688, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 4.80% (26.0924 => 27.3453, std.dev.: 0.2556) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.03% (11.6436 => 12.1132, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.84% (0.3540 => 0.3676, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: 2.66% (2.4116 => 2.4757, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 2.04% (3.1595 => 3.2240, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 2.00% (85.0658 => 86.7641, std.dev.: 0.0898) MultiSource/Benchmarks/mafft/pairlocalalign: 1.61% (27.8444 => 28.2926, std.dev.: 0.0118) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.57% (6.5088 => 6.6112, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: 1.28% (5.2139 => 5.2808, std.dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0313 => 1.0441, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0501, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1678, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.54% (5.2763 => 1.2376, std.dev.: 0.0624) SingleSource/Benchmarks/Misc/salsa20: -75.79% (0.8651 => 0.2094, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/richards_benchmark: -44.64% (0.1622 => 0.0898, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.88% (5.3855 => 4.6921, std.dev.: 0.1128) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.36% (5.3526 => 4.6911, std.dev.: 0.0765) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -11.58% (0.1330 => 0.1176, std.dev.: 0.0060) MultiSource/Applications/JM/ldecod/ldecod: -10.05% (10.4361 => 9.3876, std.dev.: 0.2310) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.52% (0.0628 => 0.0361, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.03% (0.3987 => 0.2391, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.92% (0.0506 => 0.0304, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.25% (4.5009 => 2.7792, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.05% (2.6546 => 2.0161, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -20.46% (10.7105 => 8.5193, std.dev.: 0.2181) MultiSource/Benchmarks/FreeBench/mason/mason: -19.34% (0.2161 => 0.1743, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.68% (1.6925 => 1.4272, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.69% (2.6778 => 2.2843, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.61% (32.5116 => 29.0623, std.dev.: 0.0093) MultiSource/Benchmarks/NPB-serial/is/is: -10.47% (9.5636 => 8.5624, std.dev.: 0.1736) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.05% (1.5660 => 1.4243, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.92% (4.8142 => 4.4810, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.75% (1.6805 => 1.5671, std.dev.: 0.0230) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.73% (3.2416 => 3.0235, std.dev.: 0.0297) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5759, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.09% (0.2497 => 0.2370, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5065, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.37% (19.9488 => 19.0766, std.dev.: 0.2701) SingleSource/Benchmarks/Shootout/lists: -4.35% (6.2999 => 6.0261, std.dev.: 0.0038) MultiSource/Benchmarks/sim/sim: -3.09% (5.0483 => 4.8923, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.72% (0.9957 => 0.9686, std.dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.31% (0.4808 => 0.4697, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6777, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.74% (8.1563 => 8.0144, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/salsa20: -1.50% (10.2830 => 10.1290, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.97% (0.1485 => 0.1337, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.10% (0.2116 => 0.0675, std.dev.: 0.0004) Report Time: 2.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 15:40:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 17:40:59 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121119234059.E773B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6050?compare_to=6043&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6050, Order: 168318, Start Time: 2012-11-19 20:20:29, End Time: 2012-11-19 23:41:22 To: 6043, Order: 168310, Start Time: 2012-11-19 16:11:40, End Time: 2012-11-19 19:32:33 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (171 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1091 (720 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 7.97% (69.4035 => 74.9361, std.dev.: 0.0099) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 44.16% (0.0625 => 0.0901, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.15% (0.1063 => 0.1426, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.44% (0.2969 => 0.3754, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.31% (0.1106 => 0.1397, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.22% (0.4253 => 0.5368, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.19% (0.0714 => 0.0901, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 25.97% (1.5932 => 2.0070, std.dev.: 0.0109) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.18% (0.4139 => 0.5181, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.95% (0.4994 => 0.6240, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 23.89% (0.0452 => 0.0560, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.52% (0.5000 => 0.6176, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.37% (0.0475 => 0.0586, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.24% (0.5900 => 0.7271, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.12% (0.0584 => 0.0719, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 22.20% (0.0599 => 0.0732, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.19% (0.0897 => 0.1096, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.95% (0.1107 => 0.1350, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.85% (0.1620 => 0.1974, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.65% (0.1021 => 0.1242, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0584 => 0.0704, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.52% (0.0541 => 0.0652, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.40% (0.0642 => 0.0773, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.40% (0.1103 => 0.1328, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 20.36% (0.0948 => 0.1141, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.27% (0.3903 => 0.4694, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.08% (0.1549 => 0.1860, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.04% (0.1003 => 0.1204, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/health/health: 19.98% (0.0821 => 0.0985, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.95% (0.0822 => 0.0986, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.83% (0.1604 => 0.1922, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 19.64% (0.1619 => 0.1937, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.29% (0.1462 => 0.1744, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 19.06% (0.0808 => 0.0962, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 18.80% (0.0947 => 0.1125, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.74% (0.3890 => 0.4619, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.37% (0.2014 => 0.2384, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 18.33% (0.5826 => 0.6894, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 18.06% (0.1218 => 0.1438, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 18.02% (0.5889 => 0.6950, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.98% (0.2736 => 0.3228, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.84% (1.3152 => 1.5498, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/mst/mst: 17.77% (0.0698 => 0.0822, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 17.67% (0.4029 => 0.4741, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.65% (0.1088 => 0.1280, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 17.54% (0.1505 => 0.1769, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.48% (0.2866 => 0.3367, std.dev.: 0.0037) MultiSource/Applications/hbd/hbd: 17.41% (0.9697 => 1.1385, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.36% (0.0605 => 0.0710, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 17.31% (0.5546 => 0.6506, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.13% (0.5026 => 0.5887, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 17.12% (1.8794 => 2.2011, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.97% (0.1968 => 0.2302, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.94% (3.5627 => 4.1661, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.79% (0.4658 => 0.5440, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.68% (1.6211 => 1.8915, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 16.64% (1.0781 => 1.2575, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.45% (0.2875 => 0.3348, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.45% (0.3271 => 0.3809, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.38% (0.1160 => 0.1350, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.33% (0.2738 => 0.3185, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/18-imp/imp: 16.19% (0.1421 => 0.1651, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.17% (0.4361 => 0.5066, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.05% (4.4195 => 5.1288, std.dev.: 0.0094) SingleSource/UnitTests/ObjC++/property-reference: 15.99% (0.7171 => 0.8318, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: 15.97% (0.2780 => 0.3224, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.95% (0.3930 => 0.4557, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 15.80% (4.2109 => 4.8762, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 15.80% (0.2823 => 0.3269, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/bh/bh: 15.73% (0.1284 => 0.1486) SingleSource/Benchmarks/Shootout-C++/except: 15.72% (0.2811 => 0.3253, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.72% (2.7292 => 3.1582, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/fibo: 15.67% (0.2725 => 0.3152, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 15.66% (0.2714 => 0.3139, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 15.64% (0.2750 => 0.3180, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 15.58% (0.3004 => 0.3472, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 15.55% (0.9909 => 1.1450, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.54% (0.2729 => 0.3153, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 15.54% (0.2813 => 0.3250, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.51% (0.2792 => 0.3225, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.50% (0.1090 => 0.1259, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 15.48% (0.2803 => 0.3237, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.25% (0.2911 => 0.3355, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 15.25% (0.3096 => 0.3568, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.20% (2.0673 => 2.3816, std.dev.: 0.0138) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.19% (1.9966 => 2.2999, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.19% (1.9694 => 2.2685, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.09% (0.3195 => 0.3677, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 15.08% (0.2075 => 0.2388, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary3: 14.85% (0.3267 => 0.3752, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 14.73% (0.3258 => 0.3738, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.69% (0.3362 => 0.3856, std.dev.: 0.0091) MultiSource/Benchmarks/nbench/nbench: 14.58% (0.2566 => 0.2940, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 14.44% (0.3317 => 0.3796, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.38% (0.3060 => 0.3500, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 14.29% (23.5202 => 26.8820, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.21% (0.3124 => 0.3568, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 14.06% (0.3726 => 0.4250, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 14.06% (0.3678 => 0.4195, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 14.01% (1.4269 => 1.6268, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.95% (0.3282 => 0.3740, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 13.92% (0.3348 => 0.3814, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 13.70% (0.7875 => 0.8954, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 13.66% (0.3477 => 0.3952, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.66% (0.3625 => 0.4120, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 13.59% (0.0758 => 0.0861, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.55% (0.3690 => 0.4190, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.49% (0.3981 => 0.4518, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 13.38% (2.1653 => 2.4551, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/hash: 13.34% (0.4146 => 0.4699, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.33% (0.3496 => 0.3962, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.26% (0.3446 => 0.3903, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.25% (0.3465 => 0.3924, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 13.24% (0.4251 => 0.4814, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 13.23% (0.3469 => 0.3928, std.dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 13.22% (4.6177 => 5.2282, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions-3: 13.21% (0.3460 => 0.3917, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.19% (0.3845 => 0.4352, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: 13.13% (0.3442 => 0.3894, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.10% (0.3488 => 0.3945, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.04% (0.3650 => 0.4126, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/exceptions: 12.90% (0.3643 => 0.4113, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.89% (0.2040 => 0.2303, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 12.86% (2.1013 => 2.3716, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/bigfib: 12.69% (0.5012 => 0.5648, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.65% (0.3724 => 0.4195, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 12.52% (0.2691 => 0.3028, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 11.95% (5.5417 => 6.2041, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.73% (0.6435 => 0.7190, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.64% (0.1383 => 0.1544, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 11.23% (0.3498 => 0.3891, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 11.21% (0.6634 => 0.7378, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.09% (0.1028 => 0.1142, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 10.79% (0.4847 => 0.5370, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.59% (0.2068 => 0.2287, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.56% (0.2737 => 0.3026, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.28% (0.3084 => 0.3401, std.dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: 10.17% (2.0346 => 2.2415, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 9.89% (0.3336 => 0.3666, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.61% (0.2103 => 0.2305, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.07% (0.5361 => 0.5847, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.62% (0.7426 => 0.8066, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.62% (11.6398 => 12.6426, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.47% (4.6926 => 5.0901, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.18% (0.5584 => 0.6041, std.dev.: 0.0031) MultiSource/Applications/kimwitu++/kc: 6.68% (11.9555 => 12.7536, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.96% (0.3792 => 0.3942, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0294, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 9.10% (0.2802 => 0.3057, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.60% (3.3903 => 3.6140, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6677, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-2: 4.98% (1.8057 => 1.8957, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1676, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/dry: 4.14% (14.0481 => 14.6293, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.14% (0.3693 => 0.3809, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2005, std.dev.: 0.0067) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.61% (3.1722 => 3.2233, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.48% (7.1849 => 7.2913, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3058, std.dev.: 0.0038) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5926, std.dev.: 0.0261) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.73% (25.4195 => 16.5910, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary2: -10.53% (0.2402 => 0.2149, std.dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9740, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8058, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8016, std.dev.: 0.0032) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.27% (17.2379 => 16.8465, std.dev.: 0.0244) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.25% (41.7953 => 40.8567, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5727, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.76% (0.6293 => 0.6182, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4955, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.19% (105.3826 => 104.1331, std.dev.: 0.0912) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0465, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 15:42:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 17:42:58 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121119234258.5808C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6051?compare_to=6047&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6051, Order: 168329, Start Time: 2012-11-19 22:09:08, End Time: 2012-11-19 23:43:21 To: 6047, Order: 168321, Start Time: 2012-11-19 20:18:57, End Time: 2012-11-19 21:52:18 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 6 (39 on baseline) Performance Improvements: 4 (24 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1044 (911 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 10.22% (2.2554 => 2.4858, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.19% (0.3176 => 0.3468, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.05% (9.6337 => 9.8309, std.dev.: 0.0590) SingleSource/Benchmarks/Misc/ffbench: 1.61% (1.4060 => 1.4286, std.dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.59% (13.4035 => 13.6169, std.dev.: 0.0828) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.15% (1.5999 => 1.6183, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: -8.98% (0.2205 => 0.2007, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: -8.07% (1.6299 => 1.4983, std.dev.: 0.0386) SingleSource/Benchmarks/Stanford/Puzzle: -5.85% (0.1709 => 0.1609, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: -1.64% (9.0751 => 8.9267, std.dev.: 0.0482) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.99% (1.0650 => 1.0755, std.dev.: 0.2095) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.92% (0.0218 => 0.0220, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 12.89% (0.0380 => 0.0429, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 5.05% (0.0317 => 0.0333, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.61% (0.0307 => 0.0315, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 4.13% (0.0412 => 0.0429, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0203 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 0.46% (0.0218 => 0.0219, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 160.00% (0.0005 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -1.20% (0.1495 => 0.1477, std.dev.: 0.0210) MultiSource/Applications/lemon/lemon: 7.14% (1.1494 => 1.2315, std.dev.: 0.2473) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.50% (0.4324 => 0.4216, std.dev.: 0.0777) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.44% (0.1425 => 0.1474, std.dev.: 0.0414) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 600.00% (0.0001 => 0.0007, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.99% (0.0636 => 0.0655, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 25.11% (0.0223 => 0.0279, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.00% (0.0601 => 0.0595, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.29% (1.2017 => 1.1982, std.dev.: 0.0085) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 63.16% (0.0019 => 0.0031, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 17.18% (0.0553 => 0.0648, std.dev.: 0.0117) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.38% (0.0197 => 0.0247, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.15% (0.7747 => 0.7735, std.dev.: 0.0043) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 6.90% (0.0058 => 0.0062, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.18% (16.4461 => 17.7909, std.dev.: 1.2666) MultiSource/Applications/sqlite3/sqlite3: 2343.22% (0.6332 => 15.4705, std.dev.: 0.7272) MultiSource/Benchmarks/McCat/08-main/main: 51.17% (0.1831 => 0.2768, std.dev.: 0.0805) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.77% (0.1559 => 0.1469, std.dev.: 0.0236) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7134.45% (0.3123 => 22.5932, std.dev.: 1.0320) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.22% (0.2463 => 0.3700, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1514.59% (0.3344 => 5.3992, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.17% (0.2364 => 0.3219, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/bigfib: 3.84% (0.6010 => 0.6241, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel: - (0.0429 => 0.0429, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.92% (0.3266 => 0.3394, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 1.63% (0.1969 => 0.2001, std.dev.: 0.0024) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.36% (0.0224 => 0.0236, std.dev.: 0.0012) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0019) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0520, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 12.59% (0.1462 => 0.1646, std.dev.: 0.0085) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4941, std.dev.: 0.0860) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0770, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4909, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5138, std.dev.: 0.0143) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.4983, std.dev.: 0.0386) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3208, std.dev.: 0.1924) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1317, std.dev.: 0.0131) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3629, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4059, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0878, std.dev.: 0.0029) SingleSource/Regression/C/uint64_to_float: -24.03% (2.1832 => 1.6586, std.dev.: 0.0154) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0005, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.39% (0.6010 => 0.6514, std.dev.: 0.0194) MultiSource/Applications/lemon/lemon: 4.94% (1.0945 => 1.1486, std.dev.: 0.0195) MultiSource/Applications/sgefa/sgefa: 4.87% (0.2999 => 0.3145, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.41% (0.8066 => 0.8422, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.09% (2.1401 => 2.2063, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.74% (0.4559 => 0.4684, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.72% (0.5191 => 0.5332, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.61% (1.5315 => 1.5714, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.16% (3.1832 => 3.2521, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.03% (0.8340 => 0.8509, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.02% (0.6586 => 0.6719, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 98.99% (0.0199 => 0.0396, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/pi: 57.38% (1.5795 => 2.4858, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.40% (2.9753 => 3.4633, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.59% (2.7995 => 3.2079, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6087, std.dev.: 0.0217) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.85% (0.3186 => 0.3468, std.dev.: 0.0046) SingleSource/Benchmarks/McGill/queens: 7.52% (1.7056 => 1.8338, std.dev.: 0.0414) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.22% (1.1857 => 1.2713, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/richards_benchmark: 7.08% (1.3037 => 1.3960, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.69% (4.7794 => 5.0993, std.dev.: 0.0427) MultiSource/Applications/SIBsim4/SIBsim4: 6.19% (3.1873 => 3.3847, std.dev.: 0.0761) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.00% (4.5327 => 4.8045, std.dev.: 0.0683) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.90% (4.9686 => 5.2619, std.dev.: 0.0061) MultiSource/Applications/lambda-0_1_3/lambda: 4.75% (7.4933 => 7.8490, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.66% (3.3761 => 3.5334, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.60% (6.2275 => 6.5141, std.dev.: 0.0156) MultiSource/Applications/hexxagon/hexxagon: 4.03% (14.0064 => 14.5714, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.98% (4.9469 => 5.1436, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.86% (4.9453 => 5.1363, std.dev.: 0.0068) MultiSource/Applications/siod/siod: 3.71% (3.6643 => 3.8001, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.55% (11.5690 => 11.8635, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout/lists: 2.34% (7.3375 => 7.5095, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.32% (8.2783 => 8.4705, std.dev.: 0.0116) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.83% (1.1365 => 1.1573, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.52% (1.5941 => 1.6183, std.dev.: 0.0027) SingleSource/Benchmarks/Stanford/FloatMM: 1.49% (0.8807 => 0.8938, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: 1.36% (1.0841 => 1.0988, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/ReedSolomon: 1.24% (8.5322 => 8.6382, std.dev.: 0.0107) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.18% (5.4641 => 4.3070, std.dev.: 0.0654) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.10% (7.2130 => 6.2682, std.dev.: 0.0964) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.91% (1.0512 => 0.9365, std.dev.: 0.0336) SingleSource/Benchmarks/McGill/chomp: -9.95% (1.1216 => 1.0100, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout/heapsort: -8.44% (3.2926 => 3.0147, std.dev.: 0.0960) MultiSource/Benchmarks/mafft/pairlocalalign: -8.36% (63.1822 => 57.8982, std.dev.: 0.0632) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.02% (14.6451 => 13.6169, std.dev.: 0.0828) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.88% (4.7482 => 4.4213, std.dev.: 0.0495) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.99% (3.7148 => 3.4924, std.dev.: 0.0648) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.81% (5.4972 => 5.1779, std.dev.: 0.0295) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.09% (5.1557 => 4.8931, std.dev.: 0.0110) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.49% (2.8773 => 2.7480, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.41% (4.7449 => 4.5357, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.79% (6.0224 => 5.7942, std.dev.: 0.0367) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.36% (2.4490 => 2.3668, std.dev.: 0.0247) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.99% (28.5821 => 27.7273, std.dev.: 0.0283) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.65% (2.6356 => 2.5657, std.dev.: 0.0193) MultiSource/Applications/aha/aha: -2.19% (3.3398 => 3.2667, std.dev.: 0.0250) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.19% (3.2169 => 3.1466, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/hash2: -2.18% (3.4237 => 3.3492, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.00% (11.5316 => 11.3009, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.66% (4.9994 => 4.9165, std.dev.: 0.0102) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.64% (2.3487 => 2.3101, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.31% (4.2466 => 4.1908, std.dev.: 0.0113) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.80% (1.0262 => 1.0755, std.dev.: 0.2095) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.15% (0.0408 => 0.0429, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.72% (0.0384 => 0.0429, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 2.71% (0.1438 => 0.1477, std.dev.: 0.0210) MultiSource/Applications/lemon/lemon: 8.70% (1.1329 => 1.2315, std.dev.: 0.2473) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.25% (0.4164 => 0.4216, std.dev.: 0.0777) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.67% (0.1369 => 0.1474, std.dev.: 0.0414) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.18% (0.0641 => 0.0655, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 43.08% (0.0195 => 0.0279, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.94% (0.0578 => 0.0595, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.77% (1.1437 => 1.1982, std.dev.: 0.0085) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.35% (0.0627 => 0.0648, std.dev.: 0.0117) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 37.22% (0.0180 => 0.0247, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.52% (0.8017 => 0.7735, std.dev.: 0.0043) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0062 => 0.0062, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 15:57:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 17:57:09 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121119235709.565DE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6052?compare_to=6048&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6052, Order: 168329, Start Time: 2012-11-19 22:23:40, End Time: 2012-11-19 23:57:32 To: 6048, Order: 168321, Start Time: 2012-11-19 20:26:36, End Time: 2012-11-19 22:00:32 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (179 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (857 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.21% (54.7466 => 56.5028, std.dev.: 0.1467) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 17.50% (0.3834 => 0.4505, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.53% (54.5751 => 56.5028, std.dev.: 0.1467) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.78% (2.0478 => 2.1048, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.4937 => 7.6701, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/hash2: 2.16% (3.1932 => 3.2623, std.dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.01% (0.1431 => 0.1302, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.62% (0.3821 => 0.3530, std.dev.: 0.0073) MultiSource/Benchmarks/PAQ8p/paq8p: -6.77% (2.4924 => 2.3237, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.63% (0.9542 => 0.8909, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: -6.62% (0.2160 => 0.2017, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: -6.20% (9.2283 => 8.6559, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.14% (0.2428 => 0.2279, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.07% (0.9852 => 0.9254, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -6.01% (0.1879 => 0.1766, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: -6.00% (16.1920 => 15.2197, std.dev.: 0.0153) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.99% (0.2355 => 0.2214, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: -5.98% (0.9179 => 0.8630, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.97% (0.6484 => 0.6097, std.dev.: 0.0028) MultiSource/Applications/sgefa/sgefa: -5.96% (0.3357 => 0.3157, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.93% (0.7198 => 0.6771, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.89% (3.5339 => 3.3256, std.dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: -5.88% (7.0961 => 6.6787, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.83% (1.3722 => 1.2922, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.80% (6.7716 => 6.3789, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.76% (1.0544 => 0.9937, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.74% (0.1761 => 0.1660, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.73% (0.5478 => 0.5164, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.70% (0.5805 => 0.5474, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.70% (0.5863 => 0.5529, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.68% (4.0323 => 3.8034, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.67% (0.6052 => 0.5709, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.65% (0.5859 => 0.5528, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -5.64% (0.3812 => 0.3597, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.63% (0.3658 => 0.3452, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -5.61% (0.3848 => 0.3632, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.60% (0.5802 => 0.5477, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.60% (0.5857 => 0.5529, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.58% (0.6304 => 0.5952, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.57% (0.5849 => 0.5523, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.57% (0.6660 => 0.6289, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.57% (0.5925 => 0.5595, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.57% (0.1796 => 0.1696, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.57% (0.2695 => 0.2545, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -5.56% (1.1530 => 1.0889, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.55% (4.8161 => 4.5488, std.dev.: 0.0087) MultiSource/Benchmarks/sim/sim: -5.55% (0.3406 => 0.3217, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.54% (0.5591 => 0.5281, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.54% (1.6364 => 1.5457, std.dev.: 0.0129) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.54% (1.2300 => 1.1619, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.51% (0.6297 => 0.5950, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.51% (0.6230 => 0.5887, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -5.49% (1.1450 => 1.0821, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.49% (0.5705 => 0.5392, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.48% (0.4176 => 0.3947, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.48% (0.3831 => 0.3621, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.48% (0.6260 => 0.5917, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.46% (0.5570 => 0.5266, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.45% (0.3891 => 0.3679, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.44% (0.3880 => 0.3669, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.43% (0.5575 => 0.5272, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.41% (4.8802 => 4.6161, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.40% (0.6293 => 0.5953, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.40% (0.6189 => 0.5855, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -5.38% (0.4033 => 0.3816, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.38% (0.6194 => 0.5861, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.36% (0.4515 => 0.4273, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.35% (0.6446 => 0.6101, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.35% (0.5456 => 0.5164, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.34% (1.2784 => 1.2101, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -5.34% (0.3896 => 0.3688, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.34% (0.5941 => 0.5624, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.31% (4.5069 => 4.2676, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.30% (14.2083 => 13.4546, std.dev.: 0.0373) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.29% (1.4642 => 1.3868, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.29% (0.5581 => 0.5286, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.28% (0.6667 => 0.6315, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.27% (1.3864 => 1.3134, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.6736 => 0.6383, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.24% (0.5688 => 0.5390, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.23% (0.7919 => 0.7505, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.23% (0.3483 => 0.3301, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -5.20% (4.3330 => 4.1079, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.19% (0.6681 => 0.6334, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -5.18% (17.1032 => 16.2166, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.17% (0.6033 => 0.5721, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -5.15% (1.2515 => 1.1871, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.14% (0.6676 => 0.6333, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.14% (1.2210 => 1.1583, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.13% (8.0126 => 7.6019, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: -5.13% (0.2985 => 0.2832, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.11% (0.8521 => 0.8086, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.10% (0.3884 => 0.3686, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -5.07% (0.4199 => 0.3986, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.07% (0.5999 => 0.5695, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.03% (0.6440 => 0.6116, std.dev.: 0.0119) MultiSource/Benchmarks/McCat/18-imp/imp: -5.03% (0.3581 => 0.3401, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.02% (1.6474 => 1.5647, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.02% (1.2221 => 1.1608, std.dev.: 0.0136) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.00% (0.2278 => 0.2164, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.00% (0.4916 => 0.4670, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.95% (0.2385 => 0.2267, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.90% (0.2999 => 0.2852, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: -4.88% (15.5079 => 14.7505, std.dev.: 0.0127) SingleSource/UnitTests/ObjC/parameter-passing: -4.86% (0.4280 => 0.4072, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -4.86% (3.5154 => 3.3446, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.85% (0.7524 => 0.7159, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.80% (0.7339 => 0.6987, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -4.76% (15.2527 => 14.5265, std.dev.: 0.0089) MultiSource/Benchmarks/McCat/08-main/main: -4.74% (0.2659 => 0.2533, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.71% (0.7447 => 0.7096, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.61% (0.6395 => 0.6100, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.61% (0.3319 => 0.3166, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.59% (0.5168 => 0.4931, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.53% (0.6395 => 0.6105, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.53% (0.4151 => 0.3963, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.52% (0.5329 => 0.5088, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -4.50% (1.3148 => 1.2556, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.49% (0.5569 => 0.5319, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.49% (0.7021 => 0.6706, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.45% (5.0226 => 4.7991, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.40% (22.4056 => 21.4196, std.dev.: 0.0171) MultiSource/Applications/lua/lua: -4.37% (4.0594 => 3.8821, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.37% (0.5567 => 0.5324, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.35% (0.3837 => 0.3670, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.34% (0.3016 => 0.2885, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -4.33% (0.3255 => 0.3114, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -4.30% (0.3025 => 0.2895, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.29% (2.2587 => 2.1618, std.dev.: 0.0173) MultiSource/Applications/treecc/treecc: -4.28% (2.1401 => 2.0485, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/ary3: -4.27% (0.3446 => 0.3299, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -4.26% (0.4248 => 0.4067, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -4.26% (0.3194 => 0.3058, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.24% (0.3252 => 0.3114, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -4.20% (0.4861 => 0.4657, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.18% (0.3323 => 0.3184, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.18% (0.3849 => 0.3688, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -4.15% (2.4021 => 2.3023, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: -4.15% (0.2989 => 0.2865, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.14% (2.1713 => 2.0814, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/except: -4.13% (0.3026 => 0.2901, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.09% (0.4813 => 0.4616, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.04% (0.3931 => 0.3772, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.03% (0.9557 => 0.9172, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.02% (0.3057 => 0.2934, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -4.02% (0.3059 => 0.2936, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -4.01% (0.3867 => 0.3712, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.98% (0.4321 => 0.4149, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/fibo: -3.97% (0.2871 => 0.2757, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -3.92% (0.3621 => 0.3479, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.92% (0.2933 => 0.2818, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -3.90% (34.0927 => 32.7614, std.dev.: 0.0127) MultiSource/Applications/lambda-0_1_3/lambda: -3.90% (0.7982 => 0.7671, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -3.88% (0.8418 => 0.8091, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -3.88% (0.3271 => 0.3144, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: -3.88% (0.2939 => 0.2825, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.82% (0.2903 => 0.2792, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -3.82% (0.3481 => 0.3348, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -3.81% (0.3205 => 0.3083, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -3.79% (0.2849 => 0.2741, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.72% (0.4083 => 0.3931, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.70% (0.4427 => 0.4263, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -3.70% (0.6750 => 0.6500, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.70% (0.3491 => 0.3362, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -3.67% (0.6347 => 0.6114, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.56% (0.9077 => 0.8754, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sieve: -3.48% (0.3788 => 0.3656, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -3.45% (0.6441 => 0.6219, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -3.36% (18.2933 => 17.6788, std.dev.: 0.0205) MultiSource/Applications/hbd/hbd: -3.30% (1.5610 => 1.5095, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: -3.25% (0.7779 => 0.7526, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: -3.18% (0.4524 => 0.4380, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.03% (5.4682 => 5.3023, std.dev.: 0.0168) SingleSource/UnitTests/Vector/constpool: -2.42% (20.7746 => 20.2712, std.dev.: 0.0365) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7539, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -8.61% (1.2842 => 1.1736, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7070, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.83% (2.2633 => 2.1766, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.99% (1.3096 => 1.2836, std.dev.: 0.0091) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4712, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 17:35:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 19:35:58 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121120013558.B985C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6053?compare_to=6051&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6053, Order: 168341, Start Time: 2012-11-20 00:01:15, End Time: 2012-11-20 01:36:22 To: 6051, Order: 168329, Start Time: 2012-11-19 22:09:08, End Time: 2012-11-19 23:43:21 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 1 (43 on baseline) Performance Improvements: 1 (22 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1052 (909 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.18% (1.3752 => 1.4190, std.dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -5.20% (22.2095 => 21.0544, std.dev.: 0.2095) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.25% (1.0755 => 1.0728, std.dev.: 0.2484) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0220 => 0.0220, std.dev.: 0.0045) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0429 => 0.0429, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0333 => 0.0333, std.dev.: 0.0072) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0315 => 0.0314, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.70% (0.0429 => 0.0426, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0204 => 0.0204, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/test1: -0.46% (0.0219 => 0.0218, std.dev.: 0.0070) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.54% (0.1477 => 0.1485, std.dev.: 0.0237) MultiSource/Applications/lemon/lemon: -5.37% (1.2315 => 1.1654, std.dev.: 0.3006) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.17% (0.4216 => 0.4392, std.dev.: 0.0408) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.48% (0.1474 => 0.1408, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.29% (0.0007 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.75% (0.0655 => 0.0673, std.dev.: 0.0167) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.72% (0.0279 => 0.0277, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.50% (0.0595 => 0.0717, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.34% (1.1982 => 1.1941, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.23% (0.0648 => 0.0640, std.dev.: 0.0156) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.69% (0.0247 => 0.0266, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.98% (0.7735 => 0.7811, std.dev.: 0.0576) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -3.23% (0.0062 => 0.0060, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.35% (16.4461 => 17.6557, std.dev.: 0.7289) MultiSource/Applications/sqlite3/sqlite3: 2311.50% (0.6332 => 15.2696, std.dev.: 0.7395) MultiSource/Benchmarks/McCat/08-main/main: 48.83% (0.1831 => 0.2725, std.dev.: 0.0687) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.03% (0.1559 => 0.1465, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7147.36% (0.3123 => 22.6335, std.dev.: 0.9667) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.20% (0.2463 => 0.3724, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1541.87% (0.3344 => 5.4904, std.dev.: 0.4589) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.90% (0.2364 => 0.3260, std.dev.: 0.0148) SingleSource/Benchmarks/Misc-C++/bigfib: 3.89% (0.6010 => 0.6244, std.dev.: 0.0161) SingleSource/Benchmarks/Misc/mandel: 0.70% (0.0429 => 0.0432, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.24% (0.3266 => 0.3437, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 2.23% (0.1969 => 0.2013, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.59% (0.0224 => 0.0241, std.dev.: 0.0066) SingleSource/UnitTests/byval-alignment: -30.43% (0.0230 => 0.0160, std.dev.: 0.0061) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0513, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 12.04% (0.1462 => 0.1638, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4585, std.dev.: 0.0561) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0713, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4885, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5166, std.dev.: 0.0806) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5237, std.dev.: 0.3244) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3219, std.dev.: 0.0397) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1546, std.dev.: 0.0520) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3635, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4055, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0856, std.dev.: 0.0013) SingleSource/Regression/C/uint64_to_float: -23.73% (2.1832 => 1.6651, std.dev.: 0.0197) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.74% (0.0848 => 0.0956, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.32% (0.2279 => 0.2423, std.dev.: 0.0052) MultiSource/Applications/Burg/burg: 6.05% (1.2222 => 1.2961, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 5.96% (0.8069 => 0.8550, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 5.33% (0.9069 => 0.9552, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 5.17% (0.8855 => 0.9313, std.dev.: 0.0140) MultiSource/Applications/sgefa/sgefa: 4.57% (0.2999 => 0.3136, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.51% (0.7966 => 0.8325, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.06% (0.3657 => 0.3769, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 2.39% (6.7320 => 6.8926, std.dev.: 0.0554) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.70% (1.2423 => 1.2634, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 112.06% (0.0199 => 0.0422, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/pi: 58.83% (1.5795 => 2.5087, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.73% (0.7597 => 0.8944, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.92% (2.9753 => 3.4786, std.dev.: 0.0386) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.70% (2.7995 => 3.2111, std.dev.: 0.1352) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.79% (5.0261 => 5.6186, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.76% (1.1857 => 1.2777, std.dev.: 0.0188) SingleSource/Benchmarks/McGill/queens: 7.28% (1.7056 => 1.8298, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/richards_benchmark: 6.77% (1.3037 => 1.3919, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.59% (4.7794 => 5.0946, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.11% (4.9686 => 5.2722, std.dev.: 0.1034) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.98% (4.5327 => 4.8037, std.dev.: 0.0070) MultiSource/Applications/SIBsim4/SIBsim4: 5.91% (3.1873 => 3.3756, std.dev.: 0.0586) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.79% (6.2275 => 6.5257, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.67% (3.3761 => 3.5336, std.dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: 4.38% (7.4933 => 7.8216, std.dev.: 0.0454) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.08% (4.9469 => 5.1485, std.dev.: 0.0432) MultiSource/Applications/hexxagon/hexxagon: 4.01% (14.0064 => 14.5687, std.dev.: 0.0292) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.98% (4.9453 => 5.1421, std.dev.: 0.0195) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.07% (0.3587 => 0.3697, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 2.92% (3.6643 => 3.7712, std.dev.: 0.0296) SingleSource/Benchmarks/Shootout/lists: 2.66% (7.3375 => 7.5324, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.59% (11.5690 => 11.8690, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.51% (4.8660 => 4.9881, std.dev.: 0.0337) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.22% (1.3882 => 1.4190, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.07% (8.2783 => 8.4495, std.dev.: 0.0299) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.57% (4.4340 => 4.5035, std.dev.: 0.0178) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.48% (2.4647 => 2.5011, std.dev.: 0.0121) MultiSource/Benchmarks/FreeBench/neural/neural: 1.37% (1.0841 => 1.0990, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/ReedSolomon: 1.35% (8.5322 => 8.6472, std.dev.: 0.0434) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.21% (3.5679 => 3.6111, std.dev.: 0.0079) MultiSource/Applications/spiff/spiff: 1.18% (2.8561 => 2.8897, std.dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.34% (5.4641 => 4.2981, std.dev.: 0.0311) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.36% (7.2130 => 6.2491, std.dev.: 0.0492) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.82% (1.0512 => 0.9375, std.dev.: 0.0123) SingleSource/Benchmarks/McGill/chomp: -10.73% (1.1216 => 1.0013, std.dev.: 0.0081) MultiSource/Benchmarks/mafft/pairlocalalign: -8.45% (63.1822 => 57.8457, std.dev.: 0.1059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.87% (14.6451 => 13.4929, std.dev.: 0.1676) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.74% (4.7482 => 4.4283, std.dev.: 0.0324) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.45% (0.3269 => 0.3058, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.90% (3.7148 => 3.4955, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.82% (5.4972 => 5.1775, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.91% (5.1557 => 4.9026, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.33% (4.7449 => 4.5395, std.dev.: 0.0593) MultiSource/Benchmarks/nbench/nbench: -4.15% (21.9654 => 21.0544, std.dev.: 0.2095) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.61% (6.0224 => 5.8047, std.dev.: 0.0523) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.56% (0.5807 => 0.5600, std.dev.: 0.0060) MultiSource/Applications/lua/lua: -2.93% (29.8330 => 28.9579, std.dev.: 0.2708) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (28.5821 => 27.8609, std.dev.: 0.1161) MultiSource/Applications/aha/aha: -2.47% (3.3398 => 3.2574, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash2: -2.25% (3.4237 => 3.3468, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.95% (11.5316 => 11.3072, std.dev.: 0.0104) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.3487 => 2.3206, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.05% (5.6343 => 5.5754, std.dev.: 0.0143) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.54% (1.0262 => 1.0728, std.dev.: 0.2484) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0045) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.15% (0.0408 => 0.0429, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0072) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.94% (0.0384 => 0.0426, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0070) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 3.27% (0.1438 => 0.1485, std.dev.: 0.0237) MultiSource/Applications/lemon/lemon: 2.87% (1.1329 => 1.1654, std.dev.: 0.3006) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.48% (0.4164 => 0.4392, std.dev.: 0.0408) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.85% (0.1369 => 0.1408, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.99% (0.0641 => 0.0673, std.dev.: 0.0167) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.05% (0.0578 => 0.0717, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.41% (1.1437 => 1.1941, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.07% (0.0627 => 0.0640, std.dev.: 0.0156) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.57% (0.8017 => 0.7811, std.dev.: 0.0576) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -3.23% (0.0062 => 0.0060, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 17:53:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 19:53:53 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121120015353.170032A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6054?compare_to=6052&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6054, Order: 168341, Start Time: 2012-11-20 00:20:39, End Time: 2012-11-20 01:54:16 To: 6052, Order: 168329, Start Time: 2012-11-19 22:23:40, End Time: 2012-11-19 23:57:32 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (6 on baseline) Performance Improvements: 0 (177 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (859 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 17.29% (0.3834 => 0.4497, std.dev.: 0.0098) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.71% (54.5751 => 56.5991, std.dev.: 0.0681) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.95% (2.0478 => 2.1082, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/salsa20: 2.25% (7.4937 => 7.6623, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/hash2: 2.10% (3.1932 => 3.2604, std.dev.: 0.0081) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.09% (0.3821 => 0.3512, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -7.01% (2.4924 => 2.3178, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.84% (0.9542 => 0.8889, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: -6.53% (0.2160 => 0.2019, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -6.52% (0.3357 => 0.3138, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.49% (0.3142 => 0.2938, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.47% (0.2428 => 0.2271, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -6.37% (9.2283 => 8.6403, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.29% (0.7198 => 0.6745, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.29% (0.1796 => 0.1683, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: -6.24% (16.1920 => 15.1824, std.dev.: 0.0177) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.21% (0.9852 => 0.9240, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.20% (0.2355 => 0.2209, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.14% (0.6484 => 0.6086, std.dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: -6.06% (7.0961 => 6.6662, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -6.01% (0.1879 => 0.1766, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.98% (1.3722 => 1.2901, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: -5.97% (0.9179 => 0.8631, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.88% (6.7716 => 6.3732, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.87% (1.0544 => 0.9925, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.85% (3.5339 => 3.3270, std.dev.: 0.0143) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.83% (0.1716 => 0.1616, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.82% (0.3658 => 0.3445, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.77% (0.5805 => 0.5470, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.77% (0.5478 => 0.5162, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.76% (0.5863 => 0.5525, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.74% (4.8161 => 4.5397, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: -5.73% (0.3406 => 0.3211, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.72% (1.4642 => 1.3804, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.70% (1.6364 => 1.5431, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.70% (0.6052 => 0.5707, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.69% (0.5857 => 0.5524, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.68% (0.6304 => 0.5946, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.68% (0.2695 => 0.2542, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.67% (1.2300 => 1.1602, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.65% (0.5591 => 0.5275, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -5.64% (1.1450 => 1.0804, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.64% (0.5802 => 0.5475, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.63% (0.6230 => 0.5879, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.63% (0.5859 => 0.5529, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.61% (4.0323 => 3.8061, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.59% (0.5849 => 0.5522, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.59% (0.6297 => 0.5945, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.59% (0.5925 => 0.5594, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.57% (0.5456 => 0.5152, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.55% (0.6736 => 0.6362, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.54% (4.8802 => 4.6098, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.54% (0.5705 => 0.5389, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.54% (0.6194 => 0.5851, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.53% (0.6660 => 0.6292, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.52% (0.6446 => 0.6090, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: -5.52% (1.3864 => 1.3099, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-3: -5.51% (0.3848 => 0.3636, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -5.48% (0.3812 => 0.3603, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.48% (0.6189 => 0.5850, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.47% (0.6293 => 0.5949, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.46% (0.6260 => 0.5918, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -5.45% (0.4033 => 0.3813, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.45% (1.2784 => 1.2087, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.45% (0.5581 => 0.5277, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.44% (0.5570 => 0.5267, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: -5.44% (0.3880 => 0.3669, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: -5.44% (1.1530 => 1.0903, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/exceptions-2: -5.43% (0.3831 => 0.3623, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.42% (0.8521 => 0.8059, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.42% (14.2083 => 13.4386, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.41% (0.6667 => 0.6306, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.40% (0.5575 => 0.5274, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: -5.39% (0.3896 => 0.3686, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -5.36% (0.4176 => 0.3952, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.35% (0.5941 => 0.5623, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.33% (1.2210 => 1.1559, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: -5.33% (1.2515 => 1.1848, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -5.32% (17.1032 => 16.1933, std.dev.: 0.0162) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.30% (4.5069 => 4.2679, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.30% (0.6681 => 0.6327, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.29% (0.5688 => 0.5387, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.28% (0.3483 => 0.3299, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -5.28% (4.3330 => 4.1042, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.25% (8.0126 => 7.5917, std.dev.: 0.0087) MultiSource/Benchmarks/McCat/05-eks/eks: -5.25% (0.4515 => 0.4278, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.23% (0.6676 => 0.6327, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -5.23% (0.2985 => 0.2829, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.22% (1.2221 => 1.1583, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.19% (0.3891 => 0.3689, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.18% (0.5999 => 0.5688, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.18% (0.2278 => 0.2160, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.17% (0.6440 => 0.6107, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.17% (0.2999 => 0.2844, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.15% (0.4916 => 0.4663, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: -5.11% (0.3581 => 0.3398, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.11% (0.6033 => 0.5725, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.09% (1.6474 => 1.5635, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -5.07% (3.5154 => 3.3370, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/property: -5.07% (0.4199 => 0.3986, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -5.04% (15.5079 => 14.7261, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.98% (0.7919 => 0.7525, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: -4.85% (0.2659 => 0.2530, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -4.85% (15.2527 => 14.5128, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.82% (0.7339 => 0.6985, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.82% (0.2385 => 0.2270, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: -4.82% (0.7447 => 0.7088, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.82% (0.3319 => 0.3159, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.81% (0.3884 => 0.3697, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -4.79% (0.4280 => 0.4075, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.78% (0.7524 => 0.7164, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -4.77% (4.0594 => 3.8659, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.75% (0.5329 => 0.5076, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.72% (0.6395 => 0.6093, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.70% (0.7021 => 0.6691, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.69% (0.6395 => 0.6095, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -4.62% (1.3148 => 1.2541, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.56% (22.4056 => 21.3830, std.dev.: 0.0067) MultiSource/Applications/oggenc/oggenc: -4.55% (5.0226 => 4.7940, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.55% (0.5168 => 0.4933, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: -4.52% (0.3255 => 0.3108, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.47% (0.5569 => 0.5320, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.44% (0.3016 => 0.2882, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -4.43% (0.3025 => 0.2891, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.41% (2.2587 => 2.1590, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.40% (0.3837 => 0.3668, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.38% (0.4151 => 0.3969, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: -4.35% (2.1401 => 2.0469, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.35% (0.3931 => 0.3760, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -4.34% (0.4861 => 0.4650, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.33% (0.3323 => 0.3179, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -4.33% (0.3026 => 0.2895, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.33% (0.5567 => 0.5326, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: -4.32% (0.3194 => 0.3056, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.32% (0.3057 => 0.2925, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -4.30% (0.3394 => 0.3248, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.29% (0.3849 => 0.3684, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.28% (0.4813 => 0.4607, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.27% (0.3252 => 0.3113, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.27% (2.1713 => 2.0786, std.dev.: 0.0068) MultiSource/Applications/siod/siod: -4.27% (2.4021 => 2.2996, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/ary3: -4.27% (0.3446 => 0.3299, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.25% (0.9557 => 0.9151, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.24% (0.9077 => 0.8692, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: -4.24% (34.0927 => 32.6476, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/moments: -4.24% (0.4248 => 0.4068, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -4.22% (0.2989 => 0.2863, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.21% (0.2871 => 0.2750, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -4.19% (0.3271 => 0.3134, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -4.18% (0.7982 => 0.7648, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists1: -4.16% (0.3867 => 0.3706, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -4.15% (0.2939 => 0.2817, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.13% (0.2933 => 0.2812, std.dev.: 0.0035) MultiSource/Applications/spiff/spiff: -4.09% (0.8418 => 0.8074, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.07% (0.4321 => 0.4145, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -4.06% (0.3205 => 0.3075, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -3.99% (0.3059 => 0.2937, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -3.98% (0.3621 => 0.3477, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hello: -3.97% (0.2849 => 0.2736, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.89% (0.2903 => 0.2790, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -3.85% (0.6750 => 0.6490, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.79% (0.4427 => 0.4259, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.72% (0.3491 => 0.3361, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.72% (0.4083 => 0.3931, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: -3.69% (0.6347 => 0.6113, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.68% (0.6441 => 0.6204, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -3.68% (18.2933 => 17.6203, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/sieve: -3.62% (0.3788 => 0.3651, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.48% (1.5610 => 1.5066, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: -3.32% (0.4524 => 0.4374, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.30% (5.4682 => 5.2880, std.dev.: 0.0140) SingleSource/UnitTests/ObjC++/property-reference: -3.16% (0.7779 => 0.7533, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -2.89% (20.7746 => 20.1738, std.dev.: 0.0148) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7538, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -8.82% (1.2842 => 1.1709, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: -3.93% (2.2633 => 2.1743, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7067, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.04% (1.0557 => 1.0236, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4695, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 18:51:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 20:51:48 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121120025148.C50002A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6055?compare_to=6049&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6055, Order: 168341, Start Time: 2012-11-20 00:31:03, End Time: 2012-11-20 02:52:11 To: 6049, Order: 168321, Start Time: 2012-11-19 21:20:58, End Time: 2012-11-19 23:40:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 58 (142 on baseline) Performance Improvements: 7 (38 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1023 (707 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 17.65% (0.6732 => 0.7920, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 14.38% (0.7206 => 0.8242, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 13.77% (0.6653 => 0.7569, std.dev.: 0.0206) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.49% (0.6463 => 0.7335, std.dev.: 0.0108) MultiSource/Applications/aha/aha: 12.88% (0.1328 => 0.1499, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 12.87% (0.5937 => 0.6701, std.dev.: 0.0277) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.84% (0.1417 => 0.1599, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.51% (0.7171 => 0.8068, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/football/football: 12.36% (0.9865 => 1.1084, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 10.92% (0.1492 => 0.1655, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.84% (0.7585 => 0.8407, std.dev.: 0.0294) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.82% (0.7208 => 0.7988, std.dev.: 0.0105) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.80% (0.1176 => 0.1303, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 10.55% (0.3148 => 0.3480, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 9.93% (0.1339 => 0.1472, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.64% (0.9106 => 0.9984, std.dev.: 0.0132) SingleSource/Regression/C++/ofstream_ctor: 9.64% (0.3195 => 0.3503, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.59% (0.3170 => 0.3474, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.06% (0.5916 => 0.6452, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.90% (0.6200 => 0.6752, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.75% (0.9029 => 0.9819, std.dev.: 0.0135) MultiSource/Applications/hbd/hbd: 8.73% (1.7332 => 1.8845, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout-C++/sieve: 8.48% (0.4078 => 0.4424, std.dev.: 0.0132) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.85% (5.6038 => 6.0438, std.dev.: 0.0902) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.79% (4.6911 => 5.0564, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.72% (0.6824 => 0.7351, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 7.36% (0.3152 => 0.3384, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.36% (0.7881 => 0.8461, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.34% (0.3134 => 0.3364, std.dev.: 0.0063) MultiSource/Applications/treecc/treecc: 6.85% (2.2883 => 2.4450, std.dev.: 0.0555) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.84% (0.6243 => 0.6670, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.83% (0.4700 => 0.5021, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.64% (5.5644 => 5.9340, std.dev.: 0.1102) SingleSource/UnitTests/ObjC/synchronized: 6.29% (0.4038 => 0.4292, std.dev.: 0.0098) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.68% (0.9556 => 1.0099, std.dev.: 0.0078) MultiSource/Applications/JM/ldecod/ldecod: 5.63% (9.3876 => 9.9164, std.dev.: 0.1452) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 4.76% (0.7454 => 0.7809, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.91% (0.7262 => 0.7546, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/trivial-interface: 3.60% (0.4084 => 0.4231, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.27% (1.1167 => 1.1532, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.00% (17.3038 => 17.8234, std.dev.: 0.0613) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.49% (20.9052 => 21.4250, std.dev.: 0.1101) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest: 29.38% (0.3428 => 0.4435, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout/ary3: 18.55% (3.7669 => 4.4656, std.dev.: 0.2171) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.99% (15.8016 => 18.6449, std.dev.: 0.2235) MultiSource/Applications/minisat/minisat: 16.81% (9.9427 => 11.6136, std.dev.: 0.1906) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 10.85% (6.3440 => 7.0323, std.dev.: 0.1981) MultiSource/Applications/JM/lencod/lencod: 8.92% (7.5653 => 8.2404, std.dev.: 0.0123) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 7.09% (0.5349 => 0.5728, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.00% (6.0249 => 6.4466, std.dev.: 0.0822) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.70% (1.6808 => 1.7934, std.dev.: 0.0431) SingleSource/Benchmarks/Shootout/hash: 5.63% (4.9514 => 5.2300, std.dev.: 0.0759) SingleSource/Benchmarks/Shootout-C++/hash2: 3.99% (3.4453 => 3.5829, std.dev.: 0.0226) MultiSource/Benchmarks/NPB-serial/is/is: 3.83% (8.5624 => 8.8902, std.dev.: 0.0844) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.79% (4.3275 => 4.4050, std.dev.: 0.0167) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.59% (2.3079 => 2.3447, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.16% (4.1537 => 4.2019, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.15% (6.0551 => 6.1250, std.dev.: 0.0267) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/nbench/nbench: -10.54% (1.4891 => 1.3322, std.dev.: 0.0412) MultiSource/Benchmarks/SciMark2-C/scimark2: -9.86% (0.3977 => 0.3585, std.dev.: 0.0152) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -7.61% (0.3615 => 0.3340, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -7.28% (1.8814 => 1.7444, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -7.10% (0.2579 => 0.2396, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -6.34% (9.6166 => 9.0066, std.dev.: 0.0829) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.66% (3.1875 => 3.1347, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1337 => 0.1337, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -12.86% (0.0482 => 0.0420, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.41% (0.0675 => 0.0652, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -0.02% (494.2179 => 494.1429, std.dev.: 0.0233) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 43718.65% (1.1277 => 494.1429, std.dev.: 0.0233) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.53% (0.5229 => 1.5401, std.dev.: 0.0709) MultiSource/Applications/SPASS/SPASS: 17.90% (14.9895 => 17.6732, std.dev.: 0.2928) MultiSource/Applications/kimwitu++/kc: 51.62% (14.1553 => 21.4629, std.dev.: 0.1678) MultiSource/Benchmarks/MallocBench/gs/gs: 17.07% (4.1105 => 4.8120, std.dev.: 0.1654) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.78% (1.1048 => 1.5112, std.dev.: 0.0614) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 425.84% (7.1582 => 37.6405, std.dev.: 0.3285) SingleSource/Benchmarks/Misc-C++-EH/spirit: 76.07% (3.4629 => 6.0972, std.dev.: 0.4663) SingleSource/Benchmarks/Misc-C++/stepanov_container: 85.34% (0.6222 => 1.1532, std.dev.: 0.0126) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11345.00% (0.0720 => 8.2404, std.dev.: 0.0123) MultiSource/Applications/SIBsim4/SIBsim4: 3865400.00% (0.0001 => 3.8655, std.dev.: 0.0248) MultiSource/Applications/SPASS/SPASS: 13549000.00% (0.0001 => 13.5491, std.dev.: 1.6363) MultiSource/Applications/kimwitu++/kc: 51800.00% (0.0001 => 0.0519, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576700.00% (0.0001 => 0.5768, std.dev.: 0.0257) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10078400.00% (0.0001 => 10.0785, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6085100.00% (0.0001 => 6.0852, std.dev.: 0.6923) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1813.97% (1.1194 => 21.4250, std.dev.: 0.1101) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 70.79% (2.9384 => 5.0184, std.dev.: 0.1832) MultiSource/Applications/ClamAV/clamscan: 69.76% (22.1758 => 37.6449, std.dev.: 0.2904) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.56% (7.0540 => 10.8319, std.dev.: 0.1899) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.59% (8.1363 => 12.1708, std.dev.: 0.2158) MultiSource/Applications/JM/lencod/lencod: 46.02% (21.9371 => 32.0320, std.dev.: 0.2301) MultiSource/Benchmarks/FreeBench/distray/distray: 45.36% (0.1056 => 0.1535, std.dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/almabench: 38.36% (0.0730 => 0.1010, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 37.78% (0.1432 => 0.1973, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/08-main/main: 36.26% (0.2554 => 0.3480, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 32.41% (0.0793 => 0.1050, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 32.19% (0.0730 => 0.0965, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 31.03% (0.1044 => 0.1368, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 30.98% (0.0326 => 0.0427, std.dev.: 0.0013) SingleSource/UnitTests/vla: 30.42% (0.0355 => 0.0463, std.dev.: 0.0029) MultiSource/Applications/aha/aha: 30.23% (0.1151 => 0.1499, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 29.86% (0.0442 => 0.0574, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 29.37% (0.1236 => 0.1599, std.dev.: 0.0038) MultiSource/Benchmarks/BitBench/five11/five11: 28.40% (0.0567 => 0.0728, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.11% (0.0675 => 0.0858, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/loader/loader: 25.96% (0.2758 => 0.3474, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 25.95% (0.6675 => 0.8407, std.dev.: 0.0294) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 25.77% (0.0842 => 0.1059, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 25.09% (0.6450 => 0.8068, std.dev.: 0.0089) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 25.06% (0.0447 => 0.0559, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 24.50% (0.5020 => 0.6250, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/matrix: 24.45% (0.0818 => 0.1018, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.26% (0.0746 => 0.0927, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/football/football: 24.25% (0.8921 => 1.1084, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 24.06% (14.3668 => 17.8234, std.dev.: 0.0613) SingleSource/Benchmarks/Stanford/Oscar: 24.06% (0.0636 => 0.0789, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.58% (0.8172 => 1.0099, std.dev.: 0.0078) MultiSource/Benchmarks/llubenchmark/llu: 23.38% (0.0462 => 0.0570, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 23.24% (0.8101 => 0.9984, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 22.91% (0.5981 => 0.7351, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 22.79% (0.3603 => 0.4424, std.dev.: 0.0132) SingleSource/Benchmarks/Dhrystone/fldry: 22.45% (0.0481 => 0.0589, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 22.16% (0.3826 => 0.4674, std.dev.: 0.0079) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.16% (0.1566 => 0.1913, std.dev.: 0.0096) MultiSource/Benchmarks/BitBench/drop3/drop3: 21.99% (0.0482 => 0.0588, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 21.83% (0.3473 => 0.4231, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 21.72% (0.8067 => 0.9819, std.dev.: 0.0135) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 21.28% (0.1584 => 0.1921, std.dev.: 0.0116) MultiSource/Benchmarks/VersaBench/bmm/bmm: 21.21% (0.0759 => 0.0920, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.89% (0.1029 => 0.1244, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 20.83% (5.0018 => 6.0438, std.dev.: 0.0902) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.80% (0.5860 => 0.7079, std.dev.: 0.0140) MultiSource/Applications/hbd/hbd: 20.78% (1.5603 => 1.8845, std.dev.: 0.0184) MultiSource/Applications/viterbi/viterbi: 20.77% (0.1555 => 0.1878, std.dev.: 0.0038) MultiSource/Applications/treecc/treecc: 20.60% (2.0273 => 2.4450, std.dev.: 0.0555) SingleSource/Regression/C++/ofstream_ctor: 20.59% (0.2905 => 0.3503, std.dev.: 0.0084) SingleSource/UnitTests/ObjC/synchronized: 20.53% (0.3561 => 0.4292, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/tsp/tsp: 20.34% (0.1175 => 0.1414, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/fbench: 20.10% (0.0592 => 0.0711, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.00% (4.9449 => 5.9340, std.dev.: 0.1102) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.46% (0.4203 => 0.5021, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.19% (0.2700 => 0.3218, std.dev.: 0.0107) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.67% (0.1125 => 0.1335, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/methcall: 17.62% (0.2877 => 0.3384, std.dev.: 0.0063) MultiSource/Applications/lemon/lemon: 17.45% (1.0722 => 1.2593, std.dev.: 0.0377) SingleSource/UnitTests/ObjC++/Hello: 17.32% (0.5925 => 0.6951, std.dev.: 0.0112) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.22% (0.0871 => 0.1021, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/05-eks/eks: 17.14% (0.4299 => 0.5036, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.13% (0.2872 => 0.3364, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/mst/mst: 16.85% (0.1163 => 0.1359, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/lpbench: 16.68% (0.0929 => 0.1084, std.dev.: 0.0056) MultiSource/Applications/lua/lua: 16.43% (3.8723 => 4.5087, std.dev.: 0.2194) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.14% (0.0886 => 0.1029, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/fibo: 16.04% (0.2725 => 0.3162, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.03% (0.2065 => 0.2396, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: 15.93% (0.1268 => 0.1470, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.87% (4.2646 => 4.9415, std.dev.: 0.2248) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 15.74% (0.1906 => 0.2206, std.dev.: 0.0039) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.74% (0.0953 => 0.1103, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.47% (0.0834 => 0.0963, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 15.40% (17.1811 => 19.8274, std.dev.: 0.3894) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.31% (0.1117 => 0.1288, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.19% (0.0770 => 0.0887, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.19% (0.0770 => 0.0887, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 14.88% (1.2842 => 1.4753, std.dev.: 0.0500) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.87% (0.3121 => 0.3585, std.dev.: 0.0152) SingleSource/UnitTests/ObjC++/property-reference-object: 14.84% (0.6030 => 0.6925, std.dev.: 0.0181) MultiSource/Benchmarks/NPB-serial/is/is: 14.60% (0.0719 => 0.0824, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 14.56% (0.7835 => 0.8976, std.dev.: 0.0410) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.53% (0.1032 => 0.1182, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.52% (0.2107 => 0.2413, std.dev.: 0.0118) MultiSource/Benchmarks/mafft/pairlocalalign: 14.36% (9.4845 => 10.8463, std.dev.: 0.1596) MultiSource/Benchmarks/Bullet/bullet: 14.28% (63.2438 => 72.2737, std.dev.: 0.1093) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.12% (0.1062 => 0.1212, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.06% (0.1337 => 0.1525, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 13.94% (0.7326 => 0.8347, std.dev.: 0.0292) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.72% (0.4615 => 0.5248, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.16% (1.5415 => 1.7444, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.98% (1.3050 => 1.4744, std.dev.: 0.0377) SingleSource/UnitTests/ObjC/exceptions-3: 12.60% (0.3516 => 0.3959, std.dev.: 0.0159) SingleSource/UnitTests/ObjC/exceptions-2: 12.53% (0.3497 => 0.3935, std.dev.: 0.0157) MultiSource/Benchmarks/nbench/nbench: 12.52% (1.1840 => 1.3322, std.dev.: 0.0412) SingleSource/UnitTests/ObjC/exceptions-4: 12.42% (0.3543 => 0.3983, std.dev.: 0.0152) MultiSource/Benchmarks/PAQ8p/paq8p: 11.98% (10.3673 => 11.6092, std.dev.: 0.1687) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.05% (0.1892 => 0.2101, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.02% (0.4103 => 0.4555, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.56% (0.3650 => 0.3999, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.04% (0.3162 => 0.3448, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.03% (2.0665 => 2.2531, std.dev.: 0.0466) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.49% (4.3953 => 11.0097, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/methcall: 147.44% (5.3999 => 13.3616, std.dev.: 0.0119) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 38.74% (13.4384 => 18.6449, std.dev.: 0.2235) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 36.21% (0.3256 => 0.4435, std.dev.: 0.0149) MultiSource/Applications/minisat/minisat: 27.40% (9.1159 => 11.6136, std.dev.: 0.1906) SingleSource/Benchmarks/Shootout/ary3: 20.71% (3.6994 => 4.4656, std.dev.: 0.2171) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.88% (1.5086 => 1.7934, std.dev.: 0.0431) SingleSource/Benchmarks/Misc/oourafft: 17.45% (6.6465 => 7.8060, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.59% (1.1145 => 1.2994, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 13.46% (3.1578 => 3.5829, std.dev.: 0.0226) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.94% (0.2944 => 0.3325, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.60% (2.8904 => 3.2258, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 10.22% (1.1396 => 1.2561, std.dev.: 0.0026) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.30% (1.7254 => 1.8858, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 8.77% (0.9505 => 1.0339, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout/hash: 6.54% (4.9088 => 5.2300, std.dev.: 0.0759) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.63% (4.2280 => 4.4660, std.dev.: 0.0120) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.13% (11.6436 => 12.1250, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.76% (8.6802 => 9.0066, std.dev.: 0.0829) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.59% (0.3540 => 0.3667, std.dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.36% (0.4162 => 0.4302, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.15% (2.1424 => 2.2099, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.38% (1.7133 => 1.7540, std.dev.: 0.0085) SingleSource/Benchmarks/Dhrystone/dry: 2.34% (2.4116 => 2.4681, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.13% (1.3677 => 1.3969, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 2.07% (3.1595 => 3.2249, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 1.85% (85.0658 => 86.6434, std.dev.: 0.1237) MultiSource/Benchmarks/mafft/pairlocalalign: 1.68% (27.8444 => 28.3133, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.46% (6.5088 => 6.6036, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.35% (2.3135 => 2.3447, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0313 => 1.0441, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0499, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 1.14% (12.5348 => 12.6778, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout/sieve: 1.12% (5.2139 => 5.2722, std.dev.: 0.0121) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1671, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.79% (5.2763 => 1.2244, std.dev.: 0.0582) SingleSource/Benchmarks/Misc/salsa20: -75.66% (0.8651 => 0.2106, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/richards_benchmark: -44.76% (0.1622 => 0.0896, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.77% (5.3855 => 4.7516, std.dev.: 0.1238) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.53% (5.3526 => 5.0564, std.dev.: 0.0042) MultiSource/Applications/JM/ldecod/ldecod: -4.98% (10.4361 => 9.9164, std.dev.: 0.1452) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.92% (0.0506 => 0.0304, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -39.78% (0.3987 => 0.2401, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.26% (4.5009 => 2.7787, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.15% (2.6546 => 2.0135, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -19.46% (10.7105 => 8.6264, std.dev.: 0.2140) MultiSource/Benchmarks/FreeBench/mason/mason: -19.20% (0.2161 => 0.1746, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.79% (1.6925 => 1.4252, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2842, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.85% (32.5116 => 28.9841, std.dev.: 0.0268) SingleSource/Benchmarks/Misc/mandel-2: -10.63% (1.5373 => 1.3739, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.56% (1.5660 => 1.4319, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -7.04% (9.5636 => 8.8902, std.dev.: 0.0844) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.93% (4.8142 => 4.4804, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.2416 => 3.0212, std.dev.: 0.0266) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.60% (2.7294 => 2.5766, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.78% (1.5835 => 1.5078, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: -4.26% (6.2999 => 6.0315, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.46% (0.9957 => 0.9612, std.dev.: 0.0044) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8919, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.52% (0.4808 => 0.4687, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6773, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.73% (8.1563 => 8.0150, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: -1.46% (10.2830 => 10.1324, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.97% (0.1485 => 0.1337, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0002) Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 19:28:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 21:28:13 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121120032813.8344E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6056?compare_to=6053&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6056, Order: 168347, Start Time: 2012-11-20 01:56:20, End Time: 2012-11-20 03:28:37 To: 6053, Order: 168341, Start Time: 2012-11-20 00:01:15, End Time: 2012-11-20 01:36:22 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 2 (94 on baseline) Performance Improvements: 13 (23 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1039 (857 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/n-body: 1.36% (1.5043 => 1.5247, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.12% (1.4160 => 1.4319, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.36% (0.5287 => 0.4951, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.96% (0.8903 => 0.8461, std.dev.: 0.0134) MultiSource/Benchmarks/McCat/09-vor/vor: -4.02% (0.3355 => 0.3220, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.99% (1.0185 => 0.9880, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/football/football: -2.09% (0.9064 => 0.8875, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.84% (1.2315 => 1.2088, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.72% (0.6494 => 0.6382, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.56% (1.1571 => 1.1391, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.45% (1.3168 => 1.2977, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.14% (0.2706 => 0.2594, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.26% (1.2925 => 1.2504, std.dev.: 0.0095) MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.30% (2.6476 => 2.5868, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.47% (3.6155 => 3.5624, std.dev.: 0.0187) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.43% (1.0728 => 1.0682, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -19.09% (0.0220 => 0.0178, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0429 => 0.0429, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.01% (0.0333 => 0.0303, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.64% (0.0314 => 0.0316, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -10.80% (0.0426 => 0.0380, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0204 => 0.0204, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -33.49% (0.0218 => 0.0145, std.dev.: 0.0033) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.34% (0.1485 => 0.1490, std.dev.: 0.0098) MultiSource/Applications/lemon/lemon: -0.49% (1.1654 => 1.1597, std.dev.: 0.0243) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.81% (0.4392 => 0.4093, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.85% (0.1408 => 0.1396, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.71% (0.0673 => 0.0648, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -22.74% (0.0277 => 0.0214, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -16.88% (0.0717 => 0.0596, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.26% (1.1941 => 1.1972, std.dev.: 0.0091) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.69% (0.0640 => 0.0578, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.66% (0.0266 => 0.0227, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.01% (0.7811 => 0.7812, std.dev.: 0.0026) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 500.00% (0.0001 => 0.0006, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -26.67% (0.0060 => 0.0044, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 6.76% (16.4461 => 17.5571, std.dev.: 0.0348) MultiSource/Applications/sqlite3/sqlite3: 2311.84% (0.6332 => 15.2718, std.dev.: 0.0943) MultiSource/Benchmarks/McCat/08-main/main: 46.97% (0.1831 => 0.2691, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.12% (0.1559 => 0.1448, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7097.63% (0.3123 => 22.4782, std.dev.: 1.1149) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.26% (0.2463 => 0.3701, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1525.99% (0.3344 => 5.4373, std.dev.: 0.0774) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.01% (0.2364 => 0.3239, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 3.54% (0.6010 => 0.6223, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/mandel: 1.86% (0.0429 => 0.0437, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.65% (0.3266 => 0.3418, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/strcat: 2.18% (0.1969 => 0.2012, std.dev.: 0.0018) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.59% (0.0224 => 0.0241, std.dev.: 0.0011) SingleSource/UnitTests/byval-alignment: -28.26% (0.0230 => 0.0165, std.dev.: 0.0009) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0520, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 6.70% (0.1462 => 0.1560, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4560, std.dev.: 0.0109) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0726, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4944, std.dev.: 0.0121) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5125, std.dev.: 0.1149) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.6563, std.dev.: 0.0722) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3181, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1310, std.dev.: 0.0176) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3630, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4083, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0886, std.dev.: 0.0008) SingleSource/Regression/C/uint64_to_float: -24.23% (2.1832 => 1.6543, std.dev.: 0.0031) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.79% (0.0810 => 0.0946, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 11.51% (0.1112 => 0.1240, std.dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 7.61% (0.1577 => 0.1697, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.44% (0.1425 => 0.1531, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.93% (0.2180 => 0.2331, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.79% (0.3137 => 0.3350, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.26% (0.7473 => 0.7941, std.dev.: 0.0143) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.70% (0.8321 => 0.8795, std.dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.67% (0.1905 => 0.2013, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.46% (0.1885 => 0.1988, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: 5.14% (0.7950 => 0.8359, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.63% (1.1606 => 1.2143, std.dev.: 0.0098) MultiSource/Applications/Burg/burg: 4.43% (1.2222 => 1.2763, std.dev.: 0.0084) MultiSource/Applications/hbd/hbd: 4.30% (1.4269 => 1.4882, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.25% (0.3295 => 0.3435, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.06% (0.3003 => 0.3125, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.01% (0.2519 => 0.2620, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.69% (0.3115 => 0.3230, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.60% (1.2526 => 1.2977, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.59% (0.9435 => 0.9774, std.dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.51% (0.4783 => 0.4951, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.45% (1.1685 => 1.2088, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.34% (0.4127 => 0.4265, std.dev.: 0.0015) MultiSource/Applications/lua/lua: 3.19% (3.8189 => 3.9408, std.dev.: 0.0188) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.12% (2.1401 => 2.2068, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.07% (1.3279 => 1.3687, std.dev.: 0.0104) MultiSource/Applications/SPASS/SPASS: 3.03% (14.2605 => 14.6933, std.dev.: 0.0205) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.98% (0.4559 => 0.4695, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.98% (0.3657 => 0.3766, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 2.95% (1.9948 => 2.0537, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.93% (1.5315 => 1.5764, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 2.90% (1.2568 => 1.2932, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 2.88% (0.6834 => 0.7031, std.dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 2.68% (1.1271 => 1.1573, std.dev.: 0.0083) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.66% (6.6074 => 6.7833, std.dev.: 0.0386) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.59% (4.1763 => 4.2845, std.dev.: 0.0279) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.55% (3.1832 => 3.2644, std.dev.: 0.0035) MultiSource/Applications/ClamAV/clamscan: 2.51% (14.7684 => 15.1388, std.dev.: 0.0495) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.51% (0.6586 => 0.6751, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.49% (0.6227 => 0.6382, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.45% (0.9908 => 1.0151, std.dev.: 0.0094) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.45% (4.4880 => 4.5980, std.dev.: 0.0335) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.37% (1.6386 => 1.6774, std.dev.: 0.0099) MultiSource/Applications/siod/siod: 2.24% (2.2184 => 2.2682, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.20% (0.8716 => 0.8908, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.11% (4.5702 => 4.6666, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.08% (0.8611 => 0.8790, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.00% (13.1811 => 13.4453, std.dev.: 0.0483) MultiSource/Applications/JM/ldecod/ldecod: 1.99% (6.7320 => 6.8661, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.99% (0.8597 => 0.8768, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.98% (0.9688 => 0.9880, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.98% (1.1170 => 1.1391, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.96% (8.6476 => 8.8169, std.dev.: 0.0563) MultiSource/Applications/d/make_dparser: 1.87% (3.2366 => 3.2970, std.dev.: 0.0123) MultiSource/Applications/JM/lencod/lencod: 1.84% (15.3280 => 15.6101, std.dev.: 0.0461) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.81% (0.8066 => 0.8212, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.79% (0.9056 => 0.9218, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 1.71% (0.9810 => 0.9978, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (0.7557 => 0.7684, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.64% (0.8338 => 0.8475, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 1.53% (1.0945 => 1.1112, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.49% (0.8995 => 0.9129, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.05% (1.2423 => 1.2554, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 1.05% (4.9628 => 5.0151, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 108.54% (0.0199 => 0.0415, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/pi: 57.14% (1.5795 => 2.4820, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.42% (2.9753 => 3.4639, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.70% (2.7995 => 3.2111, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.58% (5.0261 => 5.6080, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.67% (6.3772 => 6.9300, std.dev.: 0.1291) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.98% (1.1857 => 1.2803, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 7.19% (1.7056 => 1.8283, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.53% (4.7794 => 5.0913, std.dev.: 0.0309) SingleSource/Benchmarks/Misc/richards_benchmark: 6.38% (1.3037 => 1.3869, std.dev.: 0.0092) MultiSource/Applications/SIBsim4/SIBsim4: 5.93% (3.1873 => 3.3762, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.89% (4.5327 => 4.7996, std.dev.: 0.0844) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.64% (3.3761 => 3.5326, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 4.21% (7.4933 => 7.8085, std.dev.: 0.0491) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.03% (4.9453 => 5.1444, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.89% (4.9469 => 5.1393, std.dev.: 0.0138) MultiSource/Applications/hexxagon/hexxagon: 3.87% (14.0064 => 14.5481, std.dev.: 0.0169) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.46% (0.3587 => 0.3711, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 3.12% (3.6643 => 3.7788, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.78% (8.2783 => 8.5087, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.57% (11.5690 => 11.8664, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.33% (4.8660 => 4.9794, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout/lists: 2.28% (7.3375 => 7.5051, std.dev.: 0.0164) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.26% (1.1365 => 1.1622, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.18% (4.8362 => 4.9416, std.dev.: 0.0162) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.79% (3.9006 => 3.9704, std.dev.: 0.0263) MultiSource/Benchmarks/Olden/power/power: 1.46% (1.2061 => 1.2237, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: 1.31% (8.5322 => 8.6440, std.dev.: 0.0214) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.20% (2.4647 => 2.4943, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/neural/neural: 1.16% (1.0841 => 1.0967, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -31.66% (0.0338 => 0.0231, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: -21.79% (5.4641 => 4.2737, std.dev.: 0.0282) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.00% (7.2130 => 6.2756, std.dev.: 0.0900) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.04% (1.0512 => 0.9351, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.01% (14.6451 => 13.3250, std.dev.: 0.2331) MultiSource/Benchmarks/mafft/pairlocalalign: -8.55% (63.1822 => 57.7793, std.dev.: 0.1133) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.88% (4.7482 => 4.4215, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.81% (5.4972 => 5.1776, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.06% (5.1557 => 4.8946, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.33% (4.7449 => 4.5395, std.dev.: 0.0594) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.96% (6.0224 => 5.7837, std.dev.: 0.0503) MultiSource/Applications/lua/lua: -3.29% (29.8330 => 28.8520, std.dev.: 0.0170) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.94% (28.5821 => 27.7408, std.dev.: 0.0250) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.81% (0.5807 => 0.5644, std.dev.: 0.0002) MultiSource/Applications/aha/aha: -2.67% (3.3398 => 3.2507, std.dev.: 0.0246) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.54% (9.9065 => 9.6549, std.dev.: 0.0974) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.48% (1.2822 => 1.2504, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/bisort/bisort: -2.44% (0.6636 => 0.6474, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: -2.27% (3.4237 => 3.3460, std.dev.: 0.0134) MultiSource/Benchmarks/FreeBench/mason/mason: -2.23% (0.5415 => 0.5294, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.99% (11.5316 => 11.3024, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.98% (3.2169 => 3.1532, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.60% (4.9994 => 4.9193, std.dev.: 0.0232) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.09% (1.0262 => 1.0682, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 44.72% (0.0123 => 0.0178, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.15% (0.0408 => 0.0429, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 19.29% (0.0254 => 0.0303, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.04% (0.0384 => 0.0380, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -19.44% (0.0180 => 0.0145, std.dev.: 0.0033) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 3.62% (0.1438 => 0.1490, std.dev.: 0.0098) MultiSource/Applications/lemon/lemon: 2.37% (1.1329 => 1.1597, std.dev.: 0.0243) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.71% (0.4164 => 0.4093, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.97% (0.1369 => 0.1396, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.09% (0.0641 => 0.0648, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 9.74% (0.0195 => 0.0214, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.11% (0.0578 => 0.0596, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.68% (1.1437 => 1.1972, std.dev.: 0.0091) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.81% (0.0627 => 0.0578, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.11% (0.0180 => 0.0227, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.56% (0.8017 => 0.7812, std.dev.: 0.0026) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 500.00% (0.0001 => 0.0006, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -29.03% (0.0062 => 0.0044, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 19:49:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 21:49:57 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121120034957.B42182A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6057?compare_to=6050&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6057, Order: 168341, Start Time: 2012-11-20 00:29:24, End Time: 2012-11-20 03:50:21 To: 6050, Order: 168318, Start Time: 2012-11-19 20:20:29, End Time: 2012-11-19 23:41:22 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (171 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1087 (719 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 9.37% (0.4076 => 0.4458, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 8.65% (0.2092 => 0.2273, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.47% (2.0564 => 2.1072, std.dev.: 0.0120) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.45% (54.0439 => 54.8269, std.dev.: 0.0812) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.16% (2.4627 => 2.4096, std.dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.20% (0.0625 => 0.0895, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.21% (0.1063 => 0.1416, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.29% (0.4253 => 0.5371, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.05% (0.0714 => 0.0900, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.00% (0.2969 => 0.3741, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.86% (0.1106 => 0.1392, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 25.24% (1.5932 => 1.9953, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.57% (0.4139 => 0.5156, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.89% (0.4994 => 0.6187, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.79% (0.0475 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.02% (0.5900 => 0.7258, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.85% (0.0547 => 0.0672, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.66% (0.5000 => 0.6133, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.60% (0.0584 => 0.0716, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.73% (0.1620 => 0.1972, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 21.70% (0.0599 => 0.0729, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.52% (0.0897 => 0.1090, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.45% (0.1021 => 0.1240, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.32% (0.1107 => 0.1343, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0584 => 0.0704, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.22% (0.0633 => 0.0761, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.22% (0.1103 => 0.1326, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 20.04% (0.0948 => 0.1138, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.96% (0.3903 => 0.4682, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.94% (0.0642 => 0.0770, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.75% (0.1549 => 0.1855, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 19.73% (0.0821 => 0.0983, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 19.70% (0.0604 => 0.0723, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.59% (0.0822 => 0.0983, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.54% (0.1003 => 0.1199, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 19.39% (0.1619 => 0.1933, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.39% (0.1604 => 0.1915, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.95% (0.1462 => 0.1739, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 18.59% (0.0947 => 0.1123, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 18.56% (0.0808 => 0.0958, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.23% (0.3890 => 0.4599, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.02% (0.2014 => 0.2377, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 17.89% (0.5826 => 0.6868, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.71% (1.3152 => 1.5481, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.69% (0.2736 => 0.3220, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 17.65% (0.1218 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 17.62% (0.0698 => 0.0821, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.56% (0.1088 => 0.1279, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 17.54% (0.5889 => 0.6922, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 17.45% (0.4029 => 0.4732, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 17.18% (0.5546 => 0.6499, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.10% (0.2866 => 0.3356, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 17.08% (0.1505 => 0.1762, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 16.78% (1.8794 => 2.1947, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.57% (0.5026 => 0.5859, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.55% (0.4658 => 0.5429, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.55% (3.5627 => 4.1524, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.41% (0.1968 => 0.2291, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 16.40% (0.9697 => 1.1287, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.38% (1.6211 => 1.8866, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.29% (0.3271 => 0.3804, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.29% (0.1160 => 0.1349, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.24% (0.2875 => 0.3342, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.15% (4.4195 => 5.1333, std.dev.: 0.0054) MultiSource/Applications/d/make_dparser: 15.99% (1.0781 => 1.2505, std.dev.: 0.0123) MultiSource/Benchmarks/McCat/18-imp/imp: 15.90% (0.1421 => 0.1647) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.89% (0.2738 => 0.3173, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.84% (0.4361 => 0.5052, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 15.72% (0.2780 => 0.3217, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 15.61% (0.3004 => 0.3473, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 15.59% (0.2714 => 0.3137, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.52% (0.3930 => 0.4540, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.50% (0.1090 => 0.1259, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 15.49% (0.2725 => 0.3147, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 15.47% (0.2811 => 0.3246, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 15.44% (0.7171 => 0.8278, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/bh/bh: 15.42% (0.1284 => 0.1482, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.39% (0.2729 => 0.3149, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 15.38% (0.2750 => 0.3173, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 15.37% (4.2109 => 4.8582, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.29% (0.2792 => 0.3219, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 15.23% (0.2803 => 0.3230, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 15.18% (0.2813 => 0.3240, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 15.17% (0.9909 => 1.1412, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 15.09% (0.2823 => 0.3249, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 15.08% (0.3096 => 0.3563, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.06% (1.9694 => 2.2660, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.93% (2.7292 => 3.1366, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.91% (0.2911 => 0.3345, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 14.90% (23.5202 => 27.0248, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.80% (0.3195 => 0.3668, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.73% (2.0673 => 2.3718, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.58% (1.9966 => 2.2877, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary3: 14.57% (0.3267 => 0.3743, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.44% (0.3060 => 0.3502, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 14.43% (0.3258 => 0.3728, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 14.36% (0.2075 => 0.2373, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary2: 14.29% (0.3317 => 0.3791, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 14.03% (0.2566 => 0.2926, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.86% (0.3362 => 0.3828, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.83% (0.3124 => 0.3556, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.77% (0.3282 => 0.3734, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 13.76% (0.3678 => 0.4184, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 13.74% (0.3726 => 0.4238, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.73% (0.3845 => 0.4373, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 13.68% (0.3348 => 0.3806, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 13.63% (1.4269 => 1.6214, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.63% (0.3625 => 0.4119, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists1: 13.52% (0.3477 => 0.3947, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.33% (0.3465 => 0.3927, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 13.32% (0.0758 => 0.0859, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 13.27% (0.4251 => 0.4815, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.26% (0.3446 => 0.3903, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.25% (0.3690 => 0.4179, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 13.24% (0.3460 => 0.3918, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.22% (0.3488 => 0.3949, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.22% (0.3496 => 0.3958, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.19% (0.3981 => 0.4506, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.17% (0.3469 => 0.3926, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.13% (0.3442 => 0.3894, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 13.12% (0.4146 => 0.4690, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 13.09% (0.7875 => 0.8906, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 12.90% (0.3643 => 0.4113, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 12.89% (2.1653 => 2.4445, std.dev.: 0.0078) SingleSource/UnitTests/ObjC/property: 12.88% (0.3650 => 0.4120, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.62% (0.3724 => 0.4194, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 12.57% (4.6177 => 5.1980, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++/bigfib: 12.53% (0.5012 => 0.5640, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 12.38% (2.1013 => 2.3615, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.08% (0.1383 => 0.1550, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 12.00% (0.2691 => 0.3014, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.91% (0.2040 => 0.2283, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11.74% (5.5417 => 6.1921, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.48% (0.6435 => 0.7174, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 11.09% (0.3498 => 0.3886, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.09% (0.1028 => 0.1142, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 10.84% (0.6634 => 0.7353, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 10.79% (0.4847 => 0.5370, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.44% (0.3084 => 0.3406, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.38% (0.2737 => 0.3021, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.30% (0.2068 => 0.2281, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 10.10% (0.3336 => 0.3673, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.65% (0.2103 => 0.2306, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 9.62% (2.0346 => 2.2304, std.dev.: 0.0043) MultiSource/Applications/lemon/lemon: 9.49% (0.2391 => 0.2618, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.86% (0.5361 => 0.5836, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.84% (4.6926 => 5.1074, std.dev.: 0.0059) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.37% (11.6398 => 12.6145, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.21% (0.7426 => 0.8036, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.95% (0.5584 => 0.6028, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 6.62% (11.9555 => 12.7470, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.90% (0.3792 => 0.3940, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 8.78% (0.2802 => 0.3048, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary: 7.12% (0.2122 => 0.2273, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6108, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.79% (0.3693 => 0.3907, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6701, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-2: 4.84% (1.8057 => 1.8931, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: 4.73% (15.4430 => 16.1732, std.dev.: 0.0248) SingleSource/Benchmarks/Dhrystone/dry: 4.17% (14.0481 => 14.6338, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2020, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.70% (3.1722 => 3.2260, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3042, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2884, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5127, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5841, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.70% (2.4764 => 2.4096, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.76% (25.4195 => 16.5832, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/ary2: -8.49% (0.2402 => 0.2198, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9746, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -7.66% (35.5013 => 32.7834, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -3.72% (11.2080 => 10.7911, std.dev.: 0.0108) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -3.24% (17.2379 => 16.6792, std.dev.: 0.1172) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7728, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.99% (0.6293 => 0.6105, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8590, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5738, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4959, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7166, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.23% (105.3826 => 104.0840, std.dev.: 0.0396) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0443, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 19:50:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 21:50:58 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121120035058.02CC32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6058?compare_to=6054&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6058, Order: 168347, Start Time: 2012-11-20 02:17:14, End Time: 2012-11-20 03:51:22 To: 6054, Order: 168341, Start Time: 2012-11-20 00:20:39, End Time: 2012-11-20 01:54:16 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (7 on baseline) Performance Improvements: 0 (177 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (858 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.82% (3.7542 => 3.8225, std.dev.: 0.0112) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 18.18% (0.3834 => 0.4531, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.29% (1.2783 => 1.3715, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.60% (54.5751 => 56.5417, std.dev.: 0.0370) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.21% (2.0478 => 2.1135, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.4937 => 7.6829, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 2.19% (3.1932 => 3.2631, std.dev.: 0.0011) MultiSource/Benchmarks/llubenchmark/llu: 2.11% (3.7435 => 3.8225, std.dev.: 0.0112) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.53% (0.1431 => 0.1309, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.98% (0.3821 => 0.3516, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.98% (2.4924 => 2.3184, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.60% (0.9542 => 0.8912, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -6.58% (0.3357 => 0.3136, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.40% (0.3142 => 0.2941, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: -6.15% (16.1920 => 15.1959, std.dev.: 0.0110) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.14% (0.2428 => 0.2279, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.05% (9.2283 => 8.6699, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.04% (0.7198 => 0.6763, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -5.99% (7.0961 => 6.6712, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.92% (0.9852 => 0.9269, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.91% (0.6484 => 0.6101, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.90% (0.2355 => 0.2216, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: -5.84% (0.9179 => 0.8643, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.83% (1.3722 => 1.2922, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.79% (6.7716 => 6.3796, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.69% (4.8161 => 4.5419, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/trivial-interface: -5.64% (0.3812 => 0.3597, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.60% (3.5339 => 3.3361, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.58% (0.3658 => 0.3454, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.58% (1.0544 => 0.9956, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.57% (1.6364 => 1.5452, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: -5.57% (0.3880 => 0.3664, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.57% (0.2695 => 0.2545, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.54% (0.3848 => 0.3635, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.52% (1.2300 => 1.1621, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: -5.52% (0.3406 => 0.3218, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -5.52% (0.3896 => 0.3681, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.50% (4.0323 => 3.8106, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.49% (0.6736 => 0.6366, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.49% (4.8802 => 4.6125, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.48% (0.3831 => 0.3621, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.45% (0.4033 => 0.3813, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.45% (0.5857 => 0.5538, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -5.41% (0.4176 => 0.3950, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.41% (14.2083 => 13.4397, std.dev.: 0.0043) MultiSource/Applications/SIBsim4/SIBsim4: -5.40% (1.3864 => 1.3115, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: -5.40% (4.3330 => 4.0990, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.40% (0.3891 => 0.3681, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.38% (1.2784 => 1.2096, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.38% (4.5069 => 4.2644, std.dev.: 0.0088) MultiSource/Benchmarks/nbench/nbench: -5.38% (1.1530 => 1.0910, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.37% (0.5478 => 0.5184, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.35% (0.6052 => 0.5728, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.35% (1.4642 => 1.3859, std.dev.: 0.0069) MultiSource/Applications/lemon/lemon: -5.34% (1.1450 => 1.0839, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.29% (0.4515 => 0.4276, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.29% (0.6293 => 0.5960, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.28% (0.6667 => 0.6315, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.26% (0.6230 => 0.5902, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.24% (0.5802 => 0.5498, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.23% (0.6304 => 0.5974, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.22% (0.5705 => 0.5407, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.22% (0.5591 => 0.5299, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -5.22% (1.2515 => 1.1862, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.20% (0.5805 => 0.5503, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.20% (0.5863 => 0.5558, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.17% (0.5859 => 0.5556, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.17% (8.0126 => 7.5984, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: -5.15% (17.1032 => 16.2223, std.dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.14% (0.3483 => 0.3304, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.14% (0.2278 => 0.2161, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.13% (0.6194 => 0.5876, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.13% (0.6297 => 0.5974, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.13% (0.8521 => 0.8084, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.12% (0.6446 => 0.6116, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.05% (0.4199 => 0.3987, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.04% (0.6681 => 0.6344, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.03% (0.5999 => 0.5697, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: -5.03% (0.2985 => 0.2835, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: -5.02% (3.5154 => 3.3389, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.02% (0.6660 => 0.6326, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.00% (0.5941 => 0.5644, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: -5.00% (0.3581 => 0.3402, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.00% (0.5925 => 0.5629, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.99% (0.6033 => 0.5732, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.99% (0.5575 => 0.5297, std.dev.: 0.0061) MultiSource/Applications/SPASS/SPASS: -4.98% (15.5079 => 14.7349, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.98% (0.6440 => 0.6119, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.98% (0.4916 => 0.4671, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.97% (0.2999 => 0.2850, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.97% (1.2221 => 1.1614, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.95% (0.2548 => 0.2422, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.94% (0.5688 => 0.5407, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.94% (1.2210 => 1.1607, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.93% (0.6189 => 0.5884, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.90% (0.6260 => 0.5953, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.89% (0.5581 => 0.5308, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -4.89% (0.7447 => 0.7083, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: -4.88% (0.4280 => 0.4071, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -4.88% (1.3148 => 1.2507, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.87% (0.3884 => 0.3695, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.86% (0.2385 => 0.2269, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.82% (0.7919 => 0.7537, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.82% (0.6676 => 0.6354, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.82% (0.5456 => 0.5193, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -4.79% (0.3025 => 0.2880, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -4.78% (15.2527 => 14.5231, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.78% (0.5570 => 0.5304, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -4.76% (0.3255 => 0.3100, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -4.76% (0.3194 => 0.3042, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -4.74% (0.2659 => 0.2533, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.73% (0.3931 => 0.3745, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.71% (0.3016 => 0.2874, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.70% (1.6474 => 1.5700, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.69% (0.3323 => 0.3167, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.67% (0.3252 => 0.3100, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -4.65% (4.0594 => 3.8705, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.61% (0.7021 => 0.6697, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.61% (0.3319 => 0.3166, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/fibo: -4.60% (0.2871 => 0.2739, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.56% (0.3837 => 0.3662, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -4.56% (0.2939 => 0.2805, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.54% (2.1713 => 2.0727, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.54% (0.7339 => 0.7006, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.53% (0.4151 => 0.3963, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.53% (0.5168 => 0.4934, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -4.52% (0.4248 => 0.4056, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.51% (0.3057 => 0.2919, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.48% (0.2903 => 0.2773, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.47% (0.3849 => 0.3677, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.46% (22.4056 => 21.4067, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.46% (0.6395 => 0.6110, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.44% (0.4321 => 0.4129, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.43% (0.5329 => 0.5093, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -4.40% (0.3481 => 0.3328, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.38% (5.0226 => 4.8024, std.dev.: 0.0021) MultiSource/Applications/treecc/treecc: -4.35% (2.1401 => 2.0471, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.34% (0.9557 => 0.9142, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.33% (0.2933 => 0.2806, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -4.33% (2.4021 => 2.2982, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: -4.32% (0.3446 => 0.3297, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.31% (0.7524 => 0.7200, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -4.26% (0.3026 => 0.2897, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -4.26% (0.4861 => 0.4654, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -4.24% (0.3205 => 0.3069, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: -4.21% (0.3394 => 0.3251, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -4.21% (34.0927 => 32.6591, std.dev.: 0.0293) MultiSource/Applications/lambda-0_1_3/lambda: -4.20% (0.7982 => 0.7647, std.dev.: 0.0019) SingleSource/Regression/C++/ofstream_ctor: -4.18% (0.3059 => 0.2931, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.16% (0.6395 => 0.6129, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.16% (0.4813 => 0.4613, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/hello: -4.14% (0.2849 => 0.2731, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -4.14% (0.3867 => 0.3707, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -4.11% (0.3621 => 0.3472, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.09% (0.5569 => 0.5341, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.07% (2.2587 => 2.1668, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.04% (0.4427 => 0.4248, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.02% (0.5567 => 0.5343, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.02% (0.4083 => 0.3919, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -4.02% (0.8418 => 0.8080, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: -4.00% (0.3271 => 0.3140, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -3.96% (0.6750 => 0.6483, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: -3.95% (0.2989 => 0.2871, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.90% (0.3491 => 0.3355, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -3.88% (0.3788 => 0.3641, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.84% (1.5610 => 1.5011, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.81% (0.9077 => 0.8731, std.dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: -3.71% (18.2933 => 17.6139, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/hash: -3.71% (0.4524 => 0.4356, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.56% (0.6347 => 0.6121, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.51% (0.6441 => 0.6215, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -3.34% (0.7779 => 0.7519, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.11% (5.4682 => 5.2981, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -2.29% (20.7746 => 20.2987, std.dev.: 0.0344) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.35% (7.5137 => 5.7596, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.98% (2.2633 => 2.1732, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.02% (1.3096 => 1.2700, std.dev.: 0.0132) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4701, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 21:18:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 23:18:41 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121120051841.C19B32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6059?compare_to=6056&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6059, Order: 168348, Start Time: 2012-11-20 03:46:37, End Time: 2012-11-20 05:19:05 To: 6056, Order: 168347, Start Time: 2012-11-20 01:56:20, End Time: 2012-11-20 03:28:37 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 4 (52 on baseline) Performance Improvements: 2 (19 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1048 (903 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/d/make_dparser: 1.01% (3.2970 => 3.3302, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.27% (4.5170 => 4.6194, std.dev.: 0.0259) MultiSource/Benchmarks/BitBench/five11/five11: 1.44% (5.6030 => 5.6835, std.dev.: 0.0144) MultiSource/Benchmarks/Olden/em3d/em3d: 1.42% (4.2737 => 4.3346, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.19% (1.0898 => 1.0332, std.dev.: 0.0176) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.56% (61.3172 => 59.1343, std.dev.: 0.2929) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.88% (1.0682 => 1.0588, std.dev.: 0.2770) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 23.03% (0.0178 => 0.0219, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.70% (0.0429 => 0.0426, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 9.90% (0.0303 => 0.0333, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0316 => 0.0315, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.84% (0.0380 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 0.98% (0.0204 => 0.0206, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 50.34% (0.0145 => 0.0218, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.74% (0.1490 => 0.1516, std.dev.: 0.0069) MultiSource/Applications/lemon/lemon: 0.71% (1.1597 => 1.1679, std.dev.: 0.0522) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.76% (0.4093 => 0.4206, std.dev.: 0.0621) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.65% (0.1396 => 0.1419, std.dev.: 0.0405) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.78% (0.0648 => 0.0630, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 28.50% (0.0214 => 0.0275, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.05% (0.0596 => 0.0548, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.94% (1.1972 => 1.1859, std.dev.: 0.0343) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -41.94% (0.0031 => 0.0018, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.90% (0.0578 => 0.0641, std.dev.: 0.0140) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.98% (0.0227 => 0.0261, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.12% (0.7812 => 0.7821, std.dev.: 0.0161) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -13.64% (0.0044 => 0.0038, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.25% (16.4461 => 17.6387, std.dev.: 1.5558) MultiSource/Applications/sqlite3/sqlite3: 2334.11% (0.6332 => 15.4128, std.dev.: 0.2502) MultiSource/Benchmarks/McCat/08-main/main: 46.97% (0.1831 => 0.2691, std.dev.: 0.0535) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.61% (0.1559 => 0.1456, std.dev.: 0.0331) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7148.58% (0.3123 => 22.6373, std.dev.: 0.4510) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.37% (0.2463 => 0.3679, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1518.27% (0.3344 => 5.4115, std.dev.: 0.0484) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.80% (0.2364 => 0.3234, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.53% (0.6010 => 0.6222, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: 0.70% (0.0429 => 0.0432, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.17% (0.3266 => 0.3435, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 3.35% (0.1969 => 0.2035, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.80% (0.0224 => 0.0237, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -31.74% (0.0230 => 0.0157, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0518, std.dev.: 0.0093) MultiSource/Applications/oggenc/oggenc: 10.74% (0.1462 => 0.1619, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4810, std.dev.: 0.0113) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0697, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4945, std.dev.: 0.0499) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5128, std.dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5735, std.dev.: 0.5417) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3143, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1346, std.dev.: 0.0265) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3630, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4035, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0856, std.dev.: 0.0014) SingleSource/Regression/C/uint64_to_float: -23.99% (2.1832 => 1.6595, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.13% (0.0830 => 0.0939, std.dev.: 0.0036) MultiSource/Applications/spiff/spiff: 6.10% (0.7950 => 0.8435, std.dev.: 0.0120) MultiSource/Applications/Burg/burg: 5.44% (1.2222 => 1.2887, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.97% (0.4127 => 0.4332, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.79% (0.2378 => 0.2492, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/gs/gs: 4.03% (4.1305 => 4.2971, std.dev.: 0.0360) MultiSource/Applications/ClamAV/clamscan: 3.76% (14.7684 => 15.3233, std.dev.: 0.1892) MultiSource/Applications/treecc/treecc: 3.47% (1.9948 => 2.0641, std.dev.: 0.0161) MultiSource/Applications/SPASS/SPASS: 3.39% (14.2605 => 14.7437, std.dev.: 0.0811) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.37% (0.8007 => 0.8277, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.01% (0.4559 => 0.4696, std.dev.: 0.0019) MultiSource/Applications/siod/siod: 2.91% (2.2184 => 2.2829, std.dev.: 0.0059) MultiSource/Applications/d/make_dparser: 2.89% (3.2366 => 3.3302, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.76% (2.1401 => 2.1992, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.72% (0.8340 => 0.8567, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.23% (3.1832 => 3.2542, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.04% (0.8069 => 0.8234, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.96% (0.9688 => 0.9878, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.91% (0.9069 => 0.9242, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 102.51% (0.0199 => 0.0403, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/pi: 58.57% (1.5795 => 2.5046, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.23% (0.7597 => 0.8906, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.35% (2.9753 => 3.4618, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.71% (2.7995 => 3.2113, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6088, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.06% (1.1857 => 1.2813, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 7.53% (1.7056 => 1.8341, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.76% (4.7794 => 5.1025, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/richards_benchmark: 6.55% (1.3037 => 1.3891, std.dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: 6.31% (3.1873 => 3.3883, std.dev.: 0.0479) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.94% (4.9686 => 5.2635, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.90% (4.5327 => 4.8001, std.dev.: 0.0484) MultiSource/Applications/lambda-0_1_3/lambda: 5.16% (7.4933 => 7.8802, std.dev.: 0.0297) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.83% (6.2275 => 6.5280, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.65% (3.3761 => 3.5331, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.09% (4.9453 => 5.1478, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.99% (4.9469 => 5.1444, std.dev.: 0.0234) MultiSource/Applications/hexxagon/hexxagon: 3.88% (14.0064 => 14.5501, std.dev.: 0.0540) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.74% (0.2887 => 0.2995, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/lpbench: 3.25% (3.9006 => 4.0273, std.dev.: 0.0255) MultiSource/Applications/siod/siod: 2.86% (3.6643 => 3.7692, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.73% (11.5690 => 11.8845, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.48% (4.8362 => 4.9561, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.46% (8.2783 => 8.4818, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout/lists: 2.43% (7.3375 => 7.5155, std.dev.: 0.0451) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.26% (4.8660 => 4.9762, std.dev.: 0.0115) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.71% (1.1365 => 1.1559, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.56% (2.4647 => 2.5032, std.dev.: 0.0041) MultiSource/Benchmarks/BitBench/five11/five11: 1.44% (5.6030 => 5.6835, std.dev.: 0.0144) MultiSource/Benchmarks/FreeBench/neural/neural: 1.34% (1.0841 => 1.0986, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.13% (3.5679 => 3.6082, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/ReedSolomon: 1.07% (8.5322 => 8.6235, std.dev.: 0.0182) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.67% (5.4641 => 4.3346, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.18% (7.2130 => 6.3343, std.dev.: 0.1051) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.86% (1.0512 => 0.9370, std.dev.: 0.0428) MultiSource/Benchmarks/mafft/pairlocalalign: -8.37% (63.1822 => 57.8933, std.dev.: 0.3676) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.89% (4.7482 => 4.4211, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.95% (3.7148 => 3.4937, std.dev.: 0.0321) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.82% (5.4972 => 5.1772, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.19% (5.1557 => 4.8880, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.39% (4.7449 => 4.5367, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.77% (6.0224 => 5.7952, std.dev.: 0.0206) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.12% (0.5807 => 0.5626, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.99% (28.5821 => 27.7264, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.59% (2.6356 => 2.5674, std.dev.: 0.0251) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.55% (9.9065 => 9.6536, std.dev.: 0.0613) MultiSource/Applications/aha/aha: -2.35% (3.3398 => 3.2614, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/hash2: -2.16% (3.4237 => 3.3499, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.72% (3.2169 => 3.1616, std.dev.: 0.0141) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.30% (2.3487 => 2.3182, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.14% (5.6343 => 5.5702, std.dev.: 0.0060) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.18% (1.0262 => 1.0588, std.dev.: 0.2770) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 8.42% (0.0190 => 0.0206, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 5.42% (0.1438 => 0.1516, std.dev.: 0.0069) MultiSource/Applications/lemon/lemon: 3.09% (1.1329 => 1.1679, std.dev.: 0.0522) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.01% (0.4164 => 0.4206, std.dev.: 0.0621) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.65% (0.1369 => 0.1419, std.dev.: 0.0405) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.72% (0.0641 => 0.0630, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.03% (0.0195 => 0.0275, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.19% (0.0578 => 0.0548, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.69% (1.1437 => 1.1859, std.dev.: 0.0343) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1700.00% (0.0001 => 0.0018, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.23% (0.0627 => 0.0641, std.dev.: 0.0140) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 45.00% (0.0180 => 0.0261, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.44% (0.8017 => 0.7821, std.dev.: 0.0161) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -38.71% (0.0062 => 0.0038, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 21:47:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 19 Nov 2012 23:47:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121120054741.797C02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6060?compare_to=6058&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6060, Order: 168348, Start Time: 2012-11-20 04:14:26, End Time: 2012-11-20 05:48:06 To: 6058, Order: 168347, Start Time: 2012-11-20 02:17:14, End Time: 2012-11-20 03:51:22 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 1 (177 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (860 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.44% (56.5417 => 54.5990, std.dev.: 0.5816) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 17.34% (0.3834 => 0.4499, std.dev.: 0.0099) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.65% (2.0478 => 2.1021, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: 2.50% (7.4937 => 7.6809, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/hash2: 2.23% (3.1932 => 3.2644, std.dev.: 0.0095) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.60% (0.1431 => 0.1308, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.03% (0.3821 => 0.3514, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -6.97% (2.4924 => 2.3186, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.65% (0.9542 => 0.8907, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.37% (0.3142 => 0.2942, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.18% (0.2428 => 0.2278, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -6.11% (16.1920 => 15.2024, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -6.07% (7.0961 => 6.6653, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: -6.07% (9.2283 => 8.6683, std.dev.: 0.0163) MultiSource/Applications/sgefa/sgefa: -6.02% (0.3357 => 0.3155, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.99% (0.7198 => 0.6767, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -5.96% (0.1879 => 0.1767, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: -5.92% (0.9179 => 0.8636, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.90% (0.9852 => 0.9271, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.88% (1.3722 => 1.2915, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.86% (0.6484 => 0.6104, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.85% (0.1796 => 0.1691, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.82% (0.2355 => 0.2218, std.dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.81% (6.7716 => 6.3785, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.73% (1.0544 => 0.9940, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -5.69% (0.3812 => 0.3595, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.69% (4.8161 => 4.5420, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.68% (3.5339 => 3.3330, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -5.68% (0.1761 => 0.1661, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.66% (0.3658 => 0.3451, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -5.64% (0.3831 => 0.3615, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.63% (1.6364 => 1.5443, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-4: -5.62% (0.3880 => 0.3662, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.57% (4.0323 => 3.8078, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.56% (4.8802 => 4.6087, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.55% (0.5478 => 0.5174, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -5.55% (0.3406 => 0.3217, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.54% (1.2300 => 1.1618, std.dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.54% (0.6736 => 0.6363, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.53% (0.2695 => 0.2546, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.53% (1.4642 => 1.3833, std.dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: -5.49% (1.1530 => 1.0897, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.47% (0.3891 => 0.3678, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -5.45% (0.4033 => 0.3813, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.44% (0.3896 => 0.3684, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.44% (0.5863 => 0.5544, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.44% (14.2083 => 13.4353, std.dev.: 0.0074) SingleSource/UnitTests/ObjC/exceptions-3: -5.43% (0.3848 => 0.3639, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.43% (0.5857 => 0.5539, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: -5.42% (1.3864 => 1.3113, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -5.41% (1.1450 => 1.0831, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.40% (0.6293 => 0.5953, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -5.40% (4.3330 => 4.0990, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/exceptions: -5.39% (0.4176 => 0.3951, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.39% (0.6052 => 0.5726, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: -5.36% (0.4515 => 0.4273, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.36% (1.2784 => 1.2099, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.35% (4.5069 => 4.2657, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.33% (0.8521 => 0.8067, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.32% (0.6667 => 0.6312, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.31% (0.6230 => 0.5899, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.31% (0.5591 => 0.5294, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.28% (0.5705 => 0.5404, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.25% (0.3483 => 0.3300, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -5.23% (17.1032 => 16.2092, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.22% (8.0126 => 7.5940, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.20% (0.6304 => 0.5976, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.20% (0.5925 => 0.5617, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.19% (0.5805 => 0.5504, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.18% (0.6681 => 0.6335, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.18% (0.6297 => 0.5971, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.17% (0.6194 => 0.5874, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.15% (0.6446 => 0.6114, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.15% (0.3884 => 0.3684, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.14% (0.5802 => 0.5504, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -5.11% (3.5154 => 3.3356, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: -5.11% (1.2515 => 1.1875, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.11% (0.6660 => 0.6320, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: -5.05% (0.3581 => 0.3400, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.05% (0.6260 => 0.5944, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.04% (1.2210 => 1.1595, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.03% (0.5999 => 0.5697, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.02% (0.6033 => 0.5730, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.00% (0.2278 => 0.2164, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.00% (0.4916 => 0.4670, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.00% (0.2999 => 0.2849, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.00% (0.4199 => 0.3989, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.00% (0.5581 => 0.5302, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -4.99% (15.5079 => 14.7336, std.dev.: 0.0173) MultiSource/Benchmarks/Olden/bh/bh: -4.99% (0.2985 => 0.2836, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.99% (0.5575 => 0.5297, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.96% (0.6189 => 0.5882, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.95% (0.6440 => 0.6121, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.95% (0.5941 => 0.5647, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.95% (0.2385 => 0.2267, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.91% (0.2548 => 0.2423, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.88% (1.2221 => 1.1625, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.87% (0.7919 => 0.7533, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: -4.86% (0.7447 => 0.7085, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.86% (0.5456 => 0.5191, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.86% (0.5849 => 0.5565, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.85% (0.5688 => 0.5412, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: -4.82% (0.3255 => 0.3098, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -4.81% (0.2659 => 0.2531, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.81% (0.4280 => 0.4074, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -4.76% (0.3025 => 0.2881, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.76% (0.5570 => 0.5305, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.76% (0.7021 => 0.6687, std.dev.: 0.0043) MultiSource/Applications/ClamAV/clamscan: -4.75% (15.2527 => 14.5279, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.74% (0.3016 => 0.2873, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.74% (0.5168 => 0.4923, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.73% (0.3931 => 0.3745, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.69% (0.5329 => 0.5079, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.67% (0.3319 => 0.3164, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -4.66% (0.3194 => 0.3045, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.64% (1.6474 => 1.5709, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.64% (0.3252 => 0.3101, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -4.62% (4.0594 => 3.8718, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.60% (0.3323 => 0.3170, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.60% (0.2871 => 0.2739, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.58% (0.4151 => 0.3961, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -4.57% (1.3148 => 1.2547, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.55% (0.7339 => 0.7005, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.54% (2.1713 => 2.0728, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/random: -4.53% (0.2939 => 0.2806, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.52% (22.4056 => 21.3932, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.51% (0.3837 => 0.3664, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -4.49% (0.3026 => 0.2890, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -4.48% (0.4861 => 0.4643, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.47% (0.3849 => 0.3677, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: -4.45% (0.4248 => 0.4059, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.45% (0.9557 => 0.9132, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.44% (0.2903 => 0.2774, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: -4.43% (0.3205 => 0.3063, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -4.42% (0.2849 => 0.2723, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.40% (0.2933 => 0.2804, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: -4.39% (5.0226 => 4.8022, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.37% (0.4321 => 0.4132, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.37% (0.7524 => 0.7195, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.36% (0.6395 => 0.6116, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -4.35% (2.4021 => 2.2977, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/ary2: -4.34% (0.3481 => 0.3330, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -4.30% (2.1401 => 2.0480, std.dev.: 0.0021) SingleSource/Regression/C++/ofstream_ctor: -4.25% (0.3059 => 0.2929, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -4.24% (0.3446 => 0.3300, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.22% (0.3867 => 0.3704, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.18% (0.4813 => 0.4612, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.18% (0.6395 => 0.6128, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: -4.17% (0.3621 => 0.3470, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: -4.16% (34.0927 => 32.6733, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/ary: -4.15% (0.3394 => 0.3253, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -4.15% (0.2989 => 0.2865, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.13% (0.5569 => 0.5339, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.11% (0.4083 => 0.3915, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.10% (0.5567 => 0.5339, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: -4.03% (0.8418 => 0.8079, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.01% (2.2587 => 2.1682, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.00% (0.4427 => 0.4250, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.90% (0.3491 => 0.3355, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -3.87% (0.6750 => 0.6489, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.82% (0.9077 => 0.8730, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/09-vor/vor: -3.82% (0.3271 => 0.3146, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: -3.80% (0.3788 => 0.3644, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.74% (1.5610 => 1.5026, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: -3.72% (18.2933 => 17.6120, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/hash: -3.65% (0.4524 => 0.4359, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -3.65% (0.7982 => 0.7691, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -3.58% (0.6347 => 0.6120, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.37% (0.6441 => 0.6224, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.12% (5.4682 => 5.2976, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: -3.03% (0.7779 => 0.7543, std.dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -2.34% (20.7746 => 20.2882, std.dev.: 0.0115) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7551, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: -8.72% (1.2842 => 1.1722, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1740, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.07% (1.0557 => 1.0233, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.67% (1.3096 => 1.2746, std.dev.: 0.0078) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4687, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 22:02:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 00:02:55 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121120060255.9F8732A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6061?compare_to=6055&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6061, Order: 168347, Start Time: 2012-11-20 03:43:30, End Time: 2012-11-20 06:03:19 To: 6055, Order: 168341, Start Time: 2012-11-20 00:31:03, End Time: 2012-11-20 02:52:11 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 29 (127 on baseline) Performance Improvements: 22 (41 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1037 (719 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.34% (0.4555 => 0.5208, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.07% (0.6610 => 0.7474, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 12.75% (0.3999 => 0.4509, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.61% (0.5933 => 0.6681, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.29% (0.5917 => 0.6644, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 12.12% (0.5915 => 0.6632, std.dev.: 0.0239) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.39% (0.6147 => 0.6847, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/life/life: 10.93% (0.1052 => 0.1167, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.85% (0.1170 => 0.1297, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.46% (0.1654 => 0.1827, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 9.97% (0.1103 => 0.1213, std.dev.: 0.0006) SingleSource/Benchmarks/LivermoreLoops/kernel21: 9.96% (0.1114 => 0.1225, std.dev.: 0.0007) SingleSource/Benchmarks/Linpack/linpack-pc: 9.58% (0.2891 => 0.3168, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.04% (5.0184 => 5.4723, std.dev.: 0.0054) SingleSource/UnitTests/Vector/constpool: 8.93% (51.6225 => 56.2323, std.dev.: 0.4518) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.68% (0.6220 => 0.6760, std.dev.: 0.0158) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.95% (0.3340 => 0.3572, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 6.45% (0.8976 => 0.9555, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.44% (0.8461 => 0.9006, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.24% (1.1162 => 1.1858, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.72% (10.8319 => 11.4518, std.dev.: 0.1292) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.64% (8.2811 => 8.6657, std.dev.: 0.0687) MultiSource/Applications/SPASS/SPASS: 2.94% (17.6732 => 18.1936, std.dev.: 0.1367) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.62% (1.0099 => 1.0364, std.dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.30% (1.7934 => 1.9602, std.dev.: 0.0354) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.70% (48.3162 => 49.1393, std.dev.: 0.2908) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.18% (5.0776 => 5.1376, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.07% (8.8765 => 8.9713, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.04% (5.4703 => 5.5271, std.dev.: 0.0087) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -15.49% (0.7920 => 0.6693, std.dev.: 0.0454) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -15.30% (0.6806 => 0.5765, std.dev.: 0.0396) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -14.22% (0.7785 => 0.6678, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -13.59% (0.6689 => 0.5780, std.dev.: 0.0341) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -12.74% (0.9245 => 0.8067, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -12.71% (0.7342 => 0.6409, std.dev.: 0.0276) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -12.70% (0.7546 => 0.6588, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -12.28% (0.7817 => 0.6857, std.dev.: 0.0244) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.00% (0.7809 => 0.6872, std.dev.: 0.0268) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.74% (5.9340 => 5.5338, std.dev.: 0.1541) MultiSource/Benchmarks/PAQ8p/paq8p: -3.38% (11.6092 => 11.2167, std.dev.: 0.1261) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -1.85% (0.7351 => 0.7215, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.32% (21.4250 => 21.1429, std.dev.: 0.1042) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.97% (18.6449 => 15.2936, std.dev.: 0.6384) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -8.40% (0.5728 => 0.5247, std.dev.: 0.0081) MultiSource/Benchmarks/NPB-serial/is/is: -3.73% (8.8902 => 8.5586, std.dev.: 0.0402) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.80% (5.0541 => 4.9631, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.79% (7.4032 => 7.2704, std.dev.: 0.0280) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.15% (6.1250 => 6.0545, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.10% (6.7590 => 6.6845, std.dev.: 0.0226) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.09% (1.3482 => 1.3335, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.09% (4.2019 => 4.1562, std.dev.: 0.0160) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 2.17% (0.1337 => 0.1366, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.29% (0.0420 => 0.0459, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.45% (0.0652 => 0.0668, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 0.07% (494.1429 => 494.5084, std.dev.: 0.0825) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.95% (4.3882 => 0.0459, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 43751.06% (1.1277 => 494.5084, std.dev.: 0.0825) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 205.57% (0.5229 => 1.5978, std.dev.: 0.0814) MultiSource/Applications/SPASS/SPASS: 21.38% (14.9895 => 18.1936, std.dev.: 0.1367) MultiSource/Applications/kimwitu++/kc: 49.82% (14.1553 => 21.2072, std.dev.: 0.2362) MultiSource/Benchmarks/MallocBench/gs/gs: 18.40% (4.1105 => 4.8667, std.dev.: 0.0381) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 45.03% (1.1048 => 1.6023, std.dev.: 0.0416) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 425.44% (7.1582 => 37.6120, std.dev.: 0.4906) SingleSource/Benchmarks/Misc-C++-EH/spirit: 76.20% (3.4629 => 6.1018, std.dev.: 0.4005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.59% (0.6222 => 1.0303, std.dev.: 0.0891) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10814.03% (0.0720 => 7.8581, std.dev.: 0.2282) MultiSource/Applications/SIBsim4/SIBsim4: 3860400.00% (0.0001 => 3.8605, std.dev.: 0.0418) MultiSource/Applications/SPASS/SPASS: 13357300.00% (0.0001 => 13.3574, std.dev.: 0.9197) MultiSource/Applications/kimwitu++/kc: 52000.00% (0.0001 => 0.0521, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14400.00% (0.0001 => 0.0145, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576000.00% (0.0001 => 0.5761, std.dev.: 0.0393) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10078600.00% (0.0001 => 10.0787, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6083100.00% (0.0001 => 6.0832, std.dev.: 0.6819) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1788.77% (1.1194 => 21.1429, std.dev.: 0.1042) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 86.23% (2.9384 => 5.4723, std.dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: 65.31% (22.1758 => 36.6593, std.dev.: 0.7429) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 62.34% (7.0540 => 11.4518, std.dev.: 0.1292) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 52.02% (8.1363 => 12.3687, std.dev.: 0.0833) MultiSource/Applications/JM/lencod/lencod: 47.19% (21.9371 => 32.2882, std.dev.: 0.2783) MultiSource/Benchmarks/FreeBench/distray/distray: 45.36% (0.1056 => 0.1535, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/almabench: 38.22% (0.0730 => 0.1009, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 38.20% (0.1432 => 0.1979, std.dev.: 0.0074) SingleSource/UnitTests/Vector/build2: 34.92% (0.0295 => 0.0398, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 31.60% (0.2554 => 0.3361, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 30.68% (0.0528 => 0.0690, std.dev.: 0.0008) SingleSource/UnitTests/vla: 30.14% (0.0355 => 0.0462, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 28.72% (0.0672 => 0.0865, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 27.29% (0.0447 => 0.0569, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 27.28% (0.0953 => 0.1213, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.24% (0.0793 => 0.1009, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/loader/loader: 27.19% (0.2758 => 0.3508, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 26.93% (0.4103 => 0.5208, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 26.86% (0.0886 => 0.1124, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.82% (0.8172 => 1.0364, std.dev.: 0.0078) SingleSource/UnitTests/Vector/SSE/sse_shift: 26.72% (0.0378 => 0.0479) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 25.67% (0.8067 => 1.0138, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C++/family/family: 25.44% (0.0397 => 0.0498, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/17-bintr/bintr: 25.33% (0.0675 => 0.0846, std.dev.: 0.0057) MultiSource/Benchmarks/llubenchmark/llu: 25.32% (0.0462 => 0.0579, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: 25.08% (0.0933 => 0.1167, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 24.07% (0.0482 => 0.0598, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 24.01% (0.5860 => 0.7267, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.99% (0.0746 => 0.0925, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/Oscar: 23.58% (0.0636 => 0.0786, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 23.53% (0.3650 => 0.4509, std.dev.: 0.0154) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.88% (0.1062 => 0.1305, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_isamax: 22.87% (0.0704 => 0.0865, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 21.95% (0.7835 => 0.9555, std.dev.: 0.0170) SingleSource/Benchmarks/CoyoteBench/lpbench: 21.85% (0.0929 => 0.1132, std.dev.: 0.0056) SingleSource/Regression/C++/ofstream_ctor: 21.82% (0.2905 => 0.3539, std.dev.: 0.0043) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.65% (0.1566 => 0.1905, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/tsp/tsp: 21.53% (0.1175 => 0.1428, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.50% (5.0018 => 6.0772, std.dev.: 0.0547) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.43% (0.9765 => 1.1858, std.dev.: 0.0150) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.67% (0.3121 => 0.3766, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 20.65% (14.3668 => 17.3331, std.dev.: 0.2027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 20.63% (0.5981 => 0.7215, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 20.45% (4.2646 => 5.1368, std.dev.: 0.1412) SingleSource/UnitTests/ObjC/trivial-interface: 20.33% (0.3473 => 0.4179, std.dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 20.25% (0.1906 => 0.2292, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 19.81% (0.0838 => 0.1004, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 19.52% (1.1642 => 1.3914, std.dev.: 0.0417) MultiSource/Applications/oggenc/oggenc: 19.46% (5.7591 => 6.8796, std.dev.: 0.2241) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.42% (0.0834 => 0.0996, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.29% (0.1125 => 0.1342, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.96% (0.2700 => 0.3212, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 18.58% (3.8922 => 4.6155, std.dev.: 0.1631) SingleSource/UnitTests/ObjC++/Hello: 18.58% (0.5925 => 0.7026, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.46% (0.0842 => 0.0989, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.34% (0.0871 => 0.1022, std.dev.: 0.0042) SingleSource/UnitTests/ObjC++/property-reference-object: 16.90% (0.6030 => 0.7049, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.88% (0.0770 => 0.0900, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 16.43% (0.1114 => 0.1297, std.dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 16.01% (1.1840 => 1.3736, std.dev.: 0.0431) MultiSource/Benchmarks/Olden/mst/mst: 15.99% (0.1163 => 0.1349, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 15.94% (17.1811 => 19.9204, std.dev.: 0.3160) MultiSource/Benchmarks/Olden/em3d/em3d: 15.87% (0.1695 => 0.1964, std.dev.: 0.0101) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.74% (0.0648 => 0.0750, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.54% (0.2065 => 0.2386, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/matrix: 15.53% (0.0818 => 0.0945, std.dev.: 0.0037) MultiSource/Applications/viterbi/viterbi: 15.18% (0.1555 => 0.1791, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.81% (0.0770 => 0.0884, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 14.73% (1.5603 => 1.7902, std.dev.: 0.0631) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.68% (0.1117 => 0.1281, std.dev.: 0.0037) MultiSource/Benchmarks/NPB-serial/is/is: 14.46% (0.0719 => 0.0823, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 14.35% (0.7326 => 0.8377, std.dev.: 0.0284) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.06% (0.1337 => 0.1525, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.04% (0.0798 => 0.0910, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.90% (0.5569 => 0.6343, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.86% (0.1032 => 0.1175, std.dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: 13.80% (9.4845 => 10.7931, std.dev.: 0.4293) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.70% (0.1029 => 0.1170, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.68% (0.3561 => 0.4048, std.dev.: 0.0139) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.56% (0.2271 => 0.2579, std.dev.: 0.0102) MultiSource/Benchmarks/Bullet/bullet: 13.55% (63.2438 => 71.8142, std.dev.: 0.1974) MultiSource/Applications/sgefa/sgefa: 13.35% (0.3109 => 0.3524, std.dev.: 0.0139) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.83% (0.8101 => 0.9140, std.dev.: 0.0328) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.80% (1.3050 => 1.4721, std.dev.: 0.0445) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.43% (0.3177 => 0.3572, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.43% (0.1625 => 0.1827, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.91% (4.9449 => 5.5338, std.dev.: 0.1541) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.62% (0.1892 => 0.2093, std.dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.15% (0.1438 => 0.1584, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.75% (0.2430 => 0.2667, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.84% (7.9617 => 8.6657, std.dev.: 0.0687) MultiSource/Benchmarks/PAQ8p/paq8p: 8.19% (10.3673 => 11.2167, std.dev.: 0.1261) SingleSource/UnitTests/Vector/constpool: 3.81% (54.1659 => 56.2323, std.dev.: 0.4518) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.24% (4.3953 => 10.9989, std.dev.: 0.0216) SingleSource/Benchmarks/Shootout-C++/methcall: 147.50% (5.3999 => 13.3647, std.dev.: 0.0049) MultiSource/Benchmarks/llubenchmark/llu: 94.40% (3.7781 => 7.3445, std.dev.: 0.7795) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 32.31% (0.3256 => 0.4308, std.dev.: 0.0253) MultiSource/Benchmarks/VersaBench/dbms/dbms: 29.94% (1.5086 => 1.9602, std.dev.: 0.0354) SingleSource/Benchmarks/Misc/oourafft: 17.44% (6.6465 => 7.8055, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.60% (1.1145 => 1.2995, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.81% (13.4384 => 15.2936, std.dev.: 0.6384) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.35% (0.2944 => 0.3337, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.60% (2.8904 => 3.2256, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 10.16% (1.1396 => 1.2554, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.84% (8.6802 => 9.5340, std.dev.: 0.2701) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.30% (1.7254 => 1.8859, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.97% (0.9540 => 1.0110, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.80% (4.2280 => 4.4733, std.dev.: 0.0061) SingleSource/Regression/C/uint64_to_float: 5.10% (0.5413 => 0.5689, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6436 => 12.1137, std.dev.: 0.0036) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.56% (2.1424 => 2.1972, std.dev.: 0.0165) SingleSource/Benchmarks/Dhrystone/dry: 2.50% (2.4116 => 2.4718, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 2.07% (3.1595 => 3.2248, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 1.98% (85.0658 => 86.7504, std.dev.: 0.0875) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.62% (2.3135 => 2.3510, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 1.57% (27.8444 => 28.2825, std.dev.: 0.0080) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.46% (6.5088 => 6.6038, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0496, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.12% (5.2139 => 5.2725, std.dev.: 0.0106) SingleSource/Benchmarks/Dhrystone/fldry: 1.10% (1.9577 => 1.9793, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/fbench: 1.04% (2.2771 => 2.3007, std.dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1671, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.69% (5.2763 => 1.2297, std.dev.: 0.0239) SingleSource/Benchmarks/Misc/salsa20: -75.75% (0.8651 => 0.2098, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/richards_benchmark: -44.76% (0.1622 => 0.0896, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.91% (5.3855 => 4.6900, std.dev.: 0.1163) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.19% (5.3526 => 4.7000, std.dev.: 0.1755) MultiSource/Applications/JM/ldecod/ldecod: -10.43% (10.4361 => 9.3481, std.dev.: 0.4113) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -9.64% (1.7609 => 1.5911, std.dev.: 0.0423) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.52% (0.0628 => 0.0361, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.33% (0.3987 => 0.2379, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.31% (4.5009 => 2.7767, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: -33.54% (1.1492 => 0.7638, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -29.14% (10.7105 => 7.5896, std.dev.: 0.6335) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.17% (2.6546 => 2.0129, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -19.39% (0.2161 => 0.1742, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.84% (1.6925 => 1.4244, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.68% (2.6778 => 2.2847, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.76% (32.5116 => 29.0126, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -10.51% (9.5636 => 8.5586, std.dev.: 0.0402) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.05% (1.5660 => 1.4243, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.2416 => 3.0212, std.dev.: 0.0272) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5758, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7497, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5069, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.65% (1.6805 => 1.6024, std.dev.: 0.0256) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.64% (19.9488 => 19.0234, std.dev.: 0.1831) SingleSource/Benchmarks/Shootout/lists: -4.47% (6.2999 => 6.0184, std.dev.: 0.0154) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8913, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.27% (0.4808 => 0.4699, std.dev.: 0.0013) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.91% (0.9957 => 0.9767, std.dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.84% (8.1563 => 8.0059, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6771, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -1.48% (10.2830 => 10.1308, std.dev.: 0.0015) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.01% (0.1485 => 0.1366, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.43% (0.2116 => 0.0668, std.dev.: 0.0016) Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 23:09:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 01:09:31 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121120070931.A8DB92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6062?compare_to=6059&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6062, Order: 168355, Start Time: 2012-11-20 05:38:46, End Time: 2012-11-20 07:09:54 To: 6059, Order: 168348, Start Time: 2012-11-20 03:46:37, End Time: 2012-11-20 05:19:05 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 6 (132 on baseline) Performance Improvements: 1 (26 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1047 (816 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.66% (0.7966 => 0.8098, std.dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.4295 => 2.4596, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.21% (4.5785 => 4.6340, std.dev.: 0.0176) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.11% (6.7860 => 6.8613, std.dev.: 0.0125) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 5.99% (22.0667 => 23.3880, std.dev.: 0.3469) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.50% (59.1343 => 60.6099, std.dev.: 0.5179) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -1.04% (4.3346 => 4.2897, std.dev.: 0.0101) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.78% (1.0588 => 1.0671, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0219 => 0.0219, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -15.02% (0.0426 => 0.0362, std.dev.: 0.0116) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.60% (0.0333 => 0.0331, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.27% (0.0315 => 0.0311, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -14.12% (0.0425 => 0.0365, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/casts: -1.46% (0.0206 => 0.0203, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: 0.46% (0.0218 => 0.0219, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -2.04% (0.1516 => 0.1485, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -4.46% (1.1679 => 1.1158, std.dev.: 0.0784) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.07% (0.4206 => 0.4209, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.85% (0.1419 => 0.1431, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.75% (0.0630 => 0.0619, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.45% (0.0275 => 0.0271, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.32% (0.0548 => 0.0621, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.72% (1.1859 => 1.1944, std.dev.: 0.0137) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -94.44% (0.0018 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -37.04% (0.0027 => 0.0017, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.09% (0.0641 => 0.0634, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.28% (0.0261 => 0.0242, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.12% (0.7821 => 0.7812, std.dev.: 0.0063) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 92.11% (0.0038 => 0.0073, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.52% (16.4461 => 17.6823, std.dev.: 0.1679) MultiSource/Applications/sqlite3/sqlite3: 2322.19% (0.6332 => 15.3373, std.dev.: 0.6760) MultiSource/Benchmarks/McCat/08-main/main: 50.14% (0.1831 => 0.2749, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.77% (0.1559 => 0.1469, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7065.23% (0.3123 => 22.3770, std.dev.: 0.4294) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.39% (0.2463 => 0.3704, std.dev.: 0.0364) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1525.42% (0.3344 => 5.4354, std.dev.: 0.1150) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.38% (0.2364 => 0.3224, std.dev.: 0.0186) SingleSource/Benchmarks/Misc-C++/bigfib: 5.61% (0.6010 => 0.6347, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/mandel: 1.86% (0.0429 => 0.0437, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.48% (0.3266 => 0.3347, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/strcat: 3.35% (0.1969 => 0.2035, std.dev.: 0.0008) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.59% (0.0224 => 0.0241, std.dev.: 0.0043) SingleSource/UnitTests/byval-alignment: -26.09% (0.0230 => 0.0170, std.dev.: 0.0046) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0440, std.dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: 10.47% (0.1462 => 0.1615, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4587, std.dev.: 0.0883) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0724, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4939, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5166, std.dev.: 0.0145) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5493, std.dev.: 0.2519) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3209, std.dev.: 0.0382) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1258, std.dev.: 0.0305) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3636, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4081, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0883, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -23.77% (2.1832 => 1.6643, std.dev.: 0.0195) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0007, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.52% (0.0810 => 0.0960, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.46% (0.0830 => 0.0950, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.10% (0.0773 => 0.0882, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 13.39% (0.0829 => 0.0940, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 12.77% (0.1112 => 0.1254, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.49% (0.8321 => 0.9111, std.dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.19% (0.1905 => 0.2080, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.36% (0.7473 => 0.8098, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/health/health: 7.57% (0.1347 => 0.1449, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 7.42% (0.1577 => 0.1694, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.41% (0.1983 => 0.2130, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.34% (0.4847 => 0.5203, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.05% (0.6010 => 0.6434, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.97% (0.2180 => 0.2332, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.90% (0.8148 => 0.8710, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.80% (0.2279 => 0.2434, std.dev.: 0.0053) MultiSource/Applications/spiff/spiff: 6.25% (0.7950 => 0.8447, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.19% (0.5961 => 0.6330, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.18% (0.3137 => 0.3331, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 5.51% (1.2222 => 1.2895, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.46% (0.6287 => 0.6630, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.40% (0.2519 => 0.2655, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.30% (1.1685 => 1.2304, std.dev.: 0.0203) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.04% (0.2240 => 0.2353, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.81% (0.9435 => 0.9889, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.70% (0.4127 => 0.4321, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.69% (1.1606 => 1.2150, std.dev.: 0.0120) MultiSource/Applications/treecc/treecc: 4.63% (1.9948 => 2.0872, std.dev.: 0.0145) MultiSource/Applications/lua/lua: 4.54% (3.8189 => 3.9923, std.dev.: 0.0570) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.41% (1.3279 => 1.3865, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/05-eks/eks: 4.21% (0.4397 => 0.4582, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.11% (0.3115 => 0.3243, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.84% (6.6074 => 6.8613, std.dev.: 0.0125) MultiSource/Benchmarks/nbench/nbench: 3.83% (1.1271 => 1.1703, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.82% (0.5817 => 0.6039, std.dev.: 0.0036) MultiSource/Applications/sgefa/sgefa: 3.73% (0.2999 => 0.3111, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.70% (14.2605 => 14.7888, std.dev.: 0.0788) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.64% (4.1763 => 4.3284, std.dev.: 0.0384) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.64% (0.4783 => 0.4957, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 3.50% (2.3764 => 2.4596, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.41% (1.6386 => 1.6944, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.39% (0.6227 => 0.6438, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 3.28% (2.2184 => 2.2912, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.25% (4.4880 => 4.6340, std.dev.: 0.0176) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.19% (1.2526 => 1.2926, std.dev.: 0.0042) MultiSource/Applications/d/make_dparser: 3.17% (3.2366 => 3.3392, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.15% (0.8611 => 0.8882, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.03% (8.6476 => 8.9097, std.dev.: 0.0347) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.98% (0.8007 => 0.8246, std.dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: 2.95% (31.8598 => 32.8005, std.dev.: 0.1030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.95% (0.5191 => 0.5344, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.93% (13.1811 => 13.5679, std.dev.: 0.0836) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.85% (0.9074 => 0.9333, std.dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.82% (0.3717 => 0.3822, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.81% (0.8050 => 0.8276, std.dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 2.81% (6.7320 => 6.9209, std.dev.: 0.0232) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.77% (0.9056 => 0.9307, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.76% (0.3657 => 0.3758, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.75% (0.8597 => 0.8833, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.73% (0.9039 => 0.9286, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.71% (0.8340 => 0.8566, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.67% (0.8317 => 0.8539, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.66% (0.8086 => 0.8301, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.65% (4.4873 => 4.6064, std.dev.: 0.0430) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.62% (0.7966 => 0.8175, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.62% (0.8805 => 0.9036, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.61% (1.1170 => 1.1462, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.60% (0.8069 => 0.8279, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.60% (0.8656 => 0.8881, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.59% (0.9069 => 0.9304, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.58% (0.8457 => 0.8675, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.54% (0.8716 => 0.8937, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.53% (0.8286 => 0.8496, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.50% (0.8518 => 0.8731, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.46% (0.9908 => 1.0152, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.43% (0.9688 => 0.9923, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.39% (0.8712 => 0.8920, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.39% (0.8885 => 0.9097, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.38% (0.8177 => 0.8372, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.38% (0.7932 => 0.8121, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.38% (0.8331 => 0.8529, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 2.32% (0.9810 => 1.0038, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.31% (4.5702 => 4.6757, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.30% (0.8359 => 0.8551, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.25% (3.1832 => 3.2547, std.dev.: 0.0265) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.23% (0.8420 => 0.8608, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.23% (0.8927 => 0.9126, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.22% (0.8048 => 0.8227, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 2.22% (8.6247 => 8.8163, std.dev.: 0.0267) MultiSource/Benchmarks/Prolangs-C/football/football: 2.20% (0.8768 => 0.8961, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.10% (1.2602 => 1.2867, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.10% (0.8995 => 0.9184, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.00% (0.8316 => 0.8482, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.86% (0.8204 => 0.8357, std.dev.: 0.0037) MultiSource/Applications/oggenc/oggenc: 1.82% (4.9628 => 5.0532, std.dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 127.14% (0.0199 => 0.0452, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/pi: 56.82% (1.5795 => 2.4770, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.45% (2.9753 => 3.4646, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.76% (0.7597 => 0.8794, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.55% (2.7995 => 3.2069, std.dev.: 0.0721) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6085, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.78% (6.3772 => 7.0011, std.dev.: 0.1204) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.17% (1.1857 => 1.2826, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 7.26% (1.7056 => 1.8295, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.76% (4.7794 => 5.1027, std.dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 6.48% (21.9654 => 23.3880, std.dev.: 0.3469) SingleSource/Benchmarks/Misc/richards_benchmark: 6.41% (1.3037 => 1.3873, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.85% (4.9686 => 5.2594, std.dev.: 0.0162) MultiSource/Applications/SIBsim4/SIBsim4: 5.81% (3.1873 => 3.3726, std.dev.: 0.0688) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.65% (4.5327 => 4.7887, std.dev.: 0.0053) MultiSource/Applications/lambda-0_1_3/lambda: 5.55% (7.4933 => 7.9090, std.dev.: 0.0571) MultiSource/Benchmarks/Olden/treeadd/treeadd: 5.30% (0.3587 => 0.3777, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.53% (3.3761 => 3.5292, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.38% (6.2275 => 6.5005, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.01% (4.9453 => 5.1437, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 3.91% (14.0064 => 14.5537, std.dev.: 0.0295) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.83% (4.9469 => 5.1366, std.dev.: 0.0039) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.50% (0.2887 => 0.2988, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.81% (11.5690 => 11.8942, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 2.57% (0.4353 => 0.4465, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: 2.48% (7.3375 => 7.5192, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.46% (8.2783 => 8.4817, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.30% (4.8660 => 4.9778, std.dev.: 0.0187) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.27% (59.2638 => 60.6099, std.dev.: 0.5179) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.18% (44.5605 => 45.5325, std.dev.: 0.2302) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.85% (1.1365 => 1.1575, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.54% (41.4238 => 42.0604, std.dev.: 0.2172) MultiSource/Benchmarks/Olden/power/power: 1.37% (1.2061 => 1.2226, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: 1.33% (1.0841 => 1.0985, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.32% (2.4647 => 2.4972, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/ReedSolomon: 1.13% (8.5322 => 8.6283, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.00% (3.5679 => 3.6036, std.dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.49% (5.4641 => 4.2897, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.28% (7.2130 => 6.3272, std.dev.: 0.2285) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.87% (1.0512 => 0.9369, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: -10.37% (1.1216 => 1.0053, std.dev.: 0.0202) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.65% (14.6451 => 13.2323, std.dev.: 0.1835) MultiSource/Benchmarks/mafft/pairlocalalign: -8.48% (63.1822 => 57.8272, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.16% (0.3269 => 0.3035, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.93% (4.7482 => 4.4190, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.04% (5.4972 => 5.1649, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.94% (3.7148 => 3.4940, std.dev.: 0.0549) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.10% (5.1557 => 4.8930, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.80% (2.4490 => 2.3315, std.dev.: 0.0298) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.45% (4.7449 => 4.5336, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.29% (0.5807 => 0.5616, std.dev.: 0.0011) MultiSource/Applications/lua/lua: -3.29% (29.8330 => 28.8525, std.dev.: 0.1278) MultiSource/Benchmarks/Prolangs-C++/life/life: -3.15% (2.6356 => 2.5527, std.dev.: 0.0160) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.04% (28.5821 => 27.7143, std.dev.: 0.0833) MultiSource/Benchmarks/FreeBench/mason/mason: -2.49% (0.5415 => 0.5280, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.42% (9.9065 => 9.6672, std.dev.: 0.0633) SingleSource/Benchmarks/Shootout-C++/hash2: -2.40% (3.4237 => 3.3415, std.dev.: 0.0141) MultiSource/Applications/aha/aha: -2.16% (3.3398 => 3.2678, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.05% (11.5316 => 11.2953, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.91% (3.2169 => 3.1553, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.59% (4.9994 => 4.9201, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: -1.39% (0.8789 => 0.8667, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.29% (5.6343 => 5.5618, std.dev.: 0.0156) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.99% (1.0262 => 1.0671, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -11.27% (0.0408 => 0.0362, std.dev.: 0.0116) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.98% (0.0302 => 0.0311, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.95% (0.0384 => 0.0365, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 3.27% (0.1438 => 0.1485, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -1.51% (1.1329 => 1.1158, std.dev.: 0.0784) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.08% (0.4164 => 0.4209, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.53% (0.1369 => 0.1431, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.43% (0.0641 => 0.0619, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 38.97% (0.0195 => 0.0271, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.44% (0.0578 => 0.0621, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.43% (1.1437 => 1.1944, std.dev.: 0.0137) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 21.43% (0.0014 => 0.0017, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.12% (0.0627 => 0.0634, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 34.44% (0.0180 => 0.0242, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.56% (0.8017 => 0.7812, std.dev.: 0.0063) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 17.74% (0.0062 => 0.0073, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 23:44:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 01:44:32 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121120074432.17D9A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6063?compare_to=6060&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6063, Order: 168355, Start Time: 2012-11-20 06:11:22, End Time: 2012-11-20 07:44:55 To: 6060, Order: 168348, Start Time: 2012-11-20 04:14:26, End Time: 2012-11-20 05:48:06 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 1 (177 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1090 (859 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.63% (54.5990 => 56.5804, std.dev.: 0.0367) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.33% (0.7543 => 0.7443, std.dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 17.14% (0.3834 => 0.4491, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.67% (54.5751 => 56.5804, std.dev.: 0.0367) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.65% (2.0478 => 2.1020, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: 2.36% (7.4937 => 7.6709, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/hash2: 2.19% (3.1932 => 3.2632, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.98% (0.3821 => 0.3516, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.84% (0.3142 => 0.2927, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.70% (0.9542 => 0.8903, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: -6.63% (0.3831 => 0.3577, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.58% (0.3812 => 0.3561, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: -6.57% (0.3896 => 0.3640, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -6.57% (2.4924 => 2.3287, std.dev.: 0.0148) SingleSource/UnitTests/ObjC/exceptions-4: -6.55% (0.3880 => 0.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -6.53% (0.2160 => 0.2019, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: -6.50% (0.4033 => 0.3771, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.47% (0.3848 => 0.3599, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.35% (0.9852 => 0.9226, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.34% (9.2283 => 8.6434, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.30% (0.3891 => 0.3646, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.27% (0.4176 => 0.3914, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.22% (0.2428 => 0.2277, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.20% (0.2355 => 0.2209, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -6.19% (16.1920 => 15.1901, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.18% (0.1796 => 0.1685, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -6.17% (0.3357 => 0.3150, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.09% (0.6484 => 0.6089, std.dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: -6.09% (7.0961 => 6.6643, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -6.03% (0.4199 => 0.3946, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.97% (0.3884 => 0.3652, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.97% (4.8161 => 4.5285, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/football/football: -5.97% (0.9179 => 0.8631, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.95% (1.3722 => 1.2906, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.92% (3.5339 => 3.3248, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.89% (6.7716 => 6.3729, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.88% (0.3658 => 0.3443, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -5.85% (0.1879 => 0.1769, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.84% (4.0323 => 3.7967, std.dev.: 0.0057) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.83% (0.1716 => 0.1616, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.79% (1.0544 => 0.9934, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: -5.77% (4.3330 => 4.0831, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.76% (0.5863 => 0.5525, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: -5.75% (1.1530 => 1.0867, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.74% (1.6364 => 1.5424, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.74% (4.8802 => 4.6002, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: -5.73% (0.3406 => 0.3211, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.70% (1.2300 => 1.1599, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.70% (1.4642 => 1.3808, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -5.68% (0.4280 => 0.4037, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.67% (0.7198 => 0.6790, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.66% (0.6736 => 0.6355, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.64% (0.5478 => 0.5169, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -5.63% (1.1450 => 1.0805, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.63% (0.6660 => 0.6285, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.60% (0.5591 => 0.5278, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.59% (0.6667 => 0.6294, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.58% (0.5857 => 0.5530, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.58% (4.5069 => 4.2555, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.56% (0.5805 => 0.5482, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.55% (0.6293 => 0.5944, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.54% (0.6189 => 0.5846, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.53% (0.7919 => 0.7481, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -5.53% (0.2985 => 0.2820, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.52% (0.6230 => 0.5886, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.52% (0.5705 => 0.5390, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.52% (0.5925 => 0.5598, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.52% (0.6052 => 0.5718, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: -5.51% (0.4515 => 0.4266, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.51% (0.6297 => 0.5950, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.49% (0.8521 => 0.8053, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: -5.49% (0.2659 => 0.2513, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -5.48% (1.2515 => 1.1829, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.47% (1.2784 => 1.2085, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.46% (0.6194 => 0.5856, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.46% (0.6304 => 0.5960, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.46% (0.2548 => 0.2409, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.45% (0.6260 => 0.5919, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.43% (0.3483 => 0.3294, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: -5.42% (1.3864 => 1.3113, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: -5.39% (0.3581 => 0.3388, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.39% (0.5570 => 0.5270, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.38% (0.5581 => 0.5281, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -5.34% (17.1032 => 16.1895, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.34% (0.5941 => 0.5624, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.34% (14.2083 => 13.4502, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.33% (0.5849 => 0.5537, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.33% (0.4916 => 0.4654, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.31% (0.2278 => 0.2157, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.31% (0.5802 => 0.5494, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.31% (0.5859 => 0.5548, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.31% (0.6446 => 0.6104, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.30% (0.5999 => 0.5681, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.30% (0.5456 => 0.5167, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.29% (0.5575 => 0.5280, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.27% (0.6676 => 0.6324, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.27% (8.0126 => 7.5903, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.24% (0.5688 => 0.5390, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.22% (1.2221 => 1.1583, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: -5.21% (3.5154 => 3.3321, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.20% (0.2999 => 0.2843, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -5.18% (15.5079 => 14.7044, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.17% (1.2210 => 1.1579, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.17% (1.6474 => 1.5623, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.13% (0.6681 => 0.6338, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.12% (0.6440 => 0.6110, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.12% (0.6033 => 0.5724, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.09% (0.3319 => 0.3150, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.06% (0.4151 => 0.3941, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -5.05% (4.0594 => 3.8546, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.03% (0.2385 => 0.2265, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: -5.00% (1.3148 => 1.2490, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.00% (0.3837 => 0.3645, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.97% (0.5168 => 0.4911, std.dev.: 0.0032) MultiSource/Applications/ClamAV/clamscan: -4.96% (15.2527 => 14.4967, std.dev.: 0.0072) MultiSource/Applications/minisat/minisat: -4.91% (0.7447 => 0.7081, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.91% (0.3931 => 0.3738, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.88% (22.4056 => 21.3125, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.88% (0.7339 => 0.6981, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.86% (0.4321 => 0.4111, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.84% (0.3057 => 0.2909, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -4.83% (0.3025 => 0.2879, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -4.82% (0.3255 => 0.3098, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -4.82% (34.0927 => 32.4500, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: -4.79% (0.3194 => 0.3041, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -4.79% (2.1401 => 2.0376, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.76% (0.7021 => 0.6687, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -4.75% (2.4021 => 2.2879, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.75% (2.1713 => 2.0681, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.71% (0.6395 => 0.6094, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.71% (0.2933 => 0.2795, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -4.66% (0.3026 => 0.2885, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.65% (0.5329 => 0.5081, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.62% (0.2903 => 0.2769, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.61% (0.3252 => 0.3102, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/fibo: -4.60% (0.2871 => 0.2739, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -4.60% (0.3394 => 0.3238, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -4.59% (0.3446 => 0.3288, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: -4.58% (0.2989 => 0.2852, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -4.57% (0.3481 => 0.3322, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: -4.56% (0.2849 => 0.2719, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -4.56% (0.7982 => 0.7618, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/random: -4.56% (0.2939 => 0.2805, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: -4.56% (18.2933 => 17.4593, std.dev.: 0.0203) SingleSource/UnitTests/ObjC++/property-reference-object: -4.52% (0.6441 => 0.6150, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -4.51% (0.8418 => 0.8038, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -4.51% (0.6347 => 0.6061) SingleSource/Benchmarks/Shootout-C++/wc: -4.49% (0.3205 => 0.3061, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: -4.48% (5.0226 => 4.7974, std.dev.: 0.0049) SingleSource/Regression/C++/ofstream_ctor: -4.48% (0.3059 => 0.2922, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -4.46% (0.4861 => 0.4644, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.45% (0.4813 => 0.4599, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.44% (0.6395 => 0.6111, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -4.43% (0.4248 => 0.4060, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.37% (2.2587 => 2.1599, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.36% (0.5569 => 0.5326, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -4.36% (0.3621 => 0.3463, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: -4.34% (0.3867 => 0.3699, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.33% (0.3323 => 0.3179, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.33% (0.9557 => 0.9143, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: -4.32% (0.7779 => 0.7443, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.31% (0.4083 => 0.3907, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.14% (0.9077 => 0.8701, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.12% (0.3491 => 0.3347, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -4.10% (0.3271 => 0.3137, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.08% (0.3849 => 0.3692, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.02% (0.4427 => 0.4249, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: -4.01% (0.6750 => 0.6479, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: -3.93% (0.3788 => 0.3639, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -3.63% (0.4524 => 0.4360, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.56% (5.4682 => 5.2735, std.dev.: 0.0046) MultiSource/Applications/hbd/hbd: -3.47% (1.5610 => 1.5068, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -1.82% (20.7746 => 20.3973, std.dev.: 0.0079) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7512, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -4.03% (2.2633 => 2.1720, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.91% (1.7753 => 1.7058, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.62% (1.3096 => 1.2753, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4714, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 19 23:58:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 01:58:55 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121120075855.54B532A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6064?compare_to=6057&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6064, Order: 168348, Start Time: 2012-11-20 04:38:21, End Time: 2012-11-20 07:59:18 To: 6057, Order: 168341, Start Time: 2012-11-20 00:29:24, End Time: 2012-11-20 03:50:21 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (170 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1092 (720 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.36% (0.0625 => 0.0896, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.40% (0.1063 => 0.1418, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.97% (0.2969 => 0.3740, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.50% (0.1106 => 0.1388, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.49% (0.4253 => 0.5337, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.35% (0.0714 => 0.0895, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.27% (0.4139 => 0.5185, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 25.09% (1.5932 => 1.9930, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.11% (0.4994 => 0.6198, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.36% (0.5900 => 0.7278, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.04% (0.5000 => 0.6152, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.95% (0.0584 => 0.0718, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.85% (0.1620 => 0.1974, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.74% (0.0897 => 0.1092, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.55% (0.1021 => 0.1241, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 21.54% (0.0599 => 0.0728, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.50% (0.1107 => 0.1345, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0584 => 0.0704, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.22% (0.0633 => 0.0761, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 20.15% (0.0948 => 0.1139, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.13% (0.1103 => 0.1325, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.09% (0.0642 => 0.0771, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.09% (0.3903 => 0.4687, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.96% (0.0541 => 0.0649, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.74% (0.1003 => 0.1201, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/health/health: 19.73% (0.0821 => 0.0983, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 19.70% (0.0604 => 0.0723) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.69% (0.1549 => 0.1854, std.dev.: 0.0038) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.51% (0.1604 => 0.1917, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 19.39% (0.1619 => 0.1933, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.34% (0.0822 => 0.0981, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.95% (0.1462 => 0.1739, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.53% (0.2736 => 0.3243, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 18.50% (0.5826 => 0.6904, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 18.37% (0.0947 => 0.1121, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.35% (0.3890 => 0.4604, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 18.24% (0.5889 => 0.6963, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 18.07% (0.0808 => 0.0954, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.92% (0.2014 => 0.2375, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.81% (1.3152 => 1.5495, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/08-main/main: 17.57% (0.1218 => 0.1432, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 17.52% (0.4029 => 0.4735, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.19% (0.1088 => 0.1275, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.13% (0.5026 => 0.5887, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.96% (0.2866 => 0.3352, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 16.88% (0.1505 => 0.1759, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 16.79% (0.5546 => 0.6477, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.77% (0.2875 => 0.3357, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.51% (0.2738 => 0.3190, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 16.50% (0.7171 => 0.8354, std.dev.: 0.0032) MultiSource/Applications/hbd/hbd: 16.46% (0.9697 => 1.1293, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.41% (3.5627 => 4.1472, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/gs/gs: 16.37% (1.8794 => 2.1871, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.36% (0.1968 => 0.2290, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.29% (0.3271 => 0.3804, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.29% (0.4658 => 0.5417, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.21% (0.1160 => 0.1348, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.16% (1.6211 => 1.8831, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 16.16% (1.0781 => 1.2523, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/matrix: 16.04% (0.2780 => 0.3226, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 15.92% (0.2714 => 0.3146, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 15.91% (0.3004 => 0.3482, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/except: 15.87% (0.2811 => 0.3257, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 15.85% (0.2725 => 0.3157, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.83% (0.2729 => 0.3161, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.72% (0.2792 => 0.3231, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 15.71% (0.2750 => 0.3182, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 15.69% (0.1421 => 0.1644, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 15.66% (0.2823 => 0.3265, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 15.63% (0.9909 => 1.1458, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 15.61% (0.2813 => 0.3252, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.60% (4.4195 => 5.1088, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.59% (0.4361 => 0.5041, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 15.59% (0.2803 => 0.3240, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.52% (0.3930 => 0.4540, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.39% (0.2911 => 0.3359, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 15.28% (0.3096 => 0.3569, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 15.26% (0.1284 => 0.1480, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.25% (2.0673 => 2.3825, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 15.15% (4.2109 => 4.8489, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.14% (0.1090 => 0.1255, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.02% (0.3195 => 0.3675, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.94% (1.9694 => 2.2636, std.dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.80% (2.7292 => 3.1330, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary3: 14.75% (0.3267 => 0.3749, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 14.73% (0.3258 => 0.3738, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 14.53% (0.3317 => 0.3799, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.49% (1.9966 => 2.2859, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.31% (0.3060 => 0.3498, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.19% (0.3362 => 0.3839, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists: 14.19% (0.3348 => 0.3823, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 14.12% (23.5202 => 26.8422, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.08% (0.3124 => 0.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 14.06% (0.3678 => 0.4195, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.05% (0.3282 => 0.3743, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 14.02% (0.2075 => 0.2366, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 13.98% (0.3726 => 0.4247, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 13.90% (0.3446 => 0.3925, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/trivial-interface: 13.89% (0.3442 => 0.3920, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.88% (0.3465 => 0.3946, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.87% (0.3460 => 0.3940, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 13.83% (0.2566 => 0.2921, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 13.82% (0.3496 => 0.3979, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.78% (0.3469 => 0.3947, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 13.75% (0.3477 => 0.3955, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.74% (0.3625 => 0.4123, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.70% (0.3488 => 0.3966, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 13.65% (0.4146 => 0.4712, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 13.54% (1.4269 => 1.6201, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.54% (0.3981 => 0.4520, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 13.42% (0.3650 => 0.4140, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.40% (0.3643 => 0.4131, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.39% (0.3690 => 0.4184, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 13.36% (0.4251 => 0.4819, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.21% (0.3845 => 0.4353, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/parameter-passing: 13.21% (0.3724 => 0.4216, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 13.13% (0.7875 => 0.8909, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 12.84% (2.1653 => 2.4434, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 12.53% (0.5012 => 0.5640, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 12.40% (4.6177 => 5.1905, std.dev.: 0.0122) MultiSource/Benchmarks/mafft/pairlocalalign: 12.18% (2.1013 => 2.3573, std.dev.: 0.0082) MultiSource/Applications/SIBsim4/SIBsim4: 11.67% (0.2691 => 0.3005, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 11.58% (5.5417 => 6.1832, std.dev.: 0.0071) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.47% (0.2040 => 0.2274, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.47% (0.6435 => 0.7173, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 10.95% (0.3498 => 0.3881, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.89% (0.1028 => 0.1140, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.88% (0.6634 => 0.7356, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.59% (0.2068 => 0.2287, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.49% (0.2737 => 0.3024, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 10.38% (0.4847 => 0.5350, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.21% (0.3084 => 0.3399, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.20% (0.1383 => 0.1524, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 9.80% (0.3336 => 0.3663, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.51% (0.2103 => 0.2303, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 9.29% (2.0346 => 2.2237, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 9.12% (0.2391 => 0.2609, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.60% (0.5361 => 0.5822, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.52% (4.6926 => 5.0926, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.26% (11.6398 => 12.6014, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.08% (0.7426 => 0.8026, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.58% (0.5584 => 0.6007, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 6.66% (11.9555 => 12.7518, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.35% (0.3792 => 0.3957, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6530, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.24% (0.2802 => 0.3061, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6102, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 5.33% (0.2122 => 0.2235, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6732, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-2: 4.77% (1.8057 => 1.8919, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 4.77% (15.4430 => 16.1794, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.55% (0.3693 => 0.3861, std.dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6415, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1978, std.dev.: 0.0075) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.73% (3.1722 => 3.2271, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3041, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2892, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5773, std.dev.: 0.0135) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.78% (2.4764 => 2.3828, std.dev.: 0.0125) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5630, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/ary2: -10.45% (0.2402 => 0.2151, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9736, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7956, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9573, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8046, std.dev.: 0.0074) MultiSource/Applications/siod/siod: -3.04% (6.9842 => 6.7721, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8647, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: -2.22% (17.2379 => 16.8545, std.dev.: 0.0747) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.84% (0.6293 => 0.6177, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5713, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4967, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.19% (105.3826 => 104.1248, std.dev.: 0.1091) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0472, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 01:22:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 03:22:55 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121120092255.C3E162A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6065?compare_to=6061&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6065, Order: 168355, Start Time: 2012-11-20 06:58:56, End Time: 2012-11-20 09:23:17 To: 6061, Order: 168347, Start Time: 2012-11-20 03:43:30, End Time: 2012-11-20 06:03:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 45 (155 on baseline) Performance Improvements: 10 (40 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1033 (692 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/siod/siod: 16.85% (2.5892 => 3.0255, std.dev.: 0.0189) SingleSource/UnitTests/ObjC/BoolLiteralTest: 14.84% (0.3956 => 0.4543, std.dev.: 0.0195) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 14.68% (1.8196 => 2.0868, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 14.40% (0.6693 => 0.7657, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 14.13% (0.6615 => 0.7550, std.dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/n-body: 10.92% (0.0925 => 0.1026, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.33% (0.4183 => 0.4615, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.16% (0.1171 => 0.1290, std.dev.: 0.0033) SingleSource/Benchmarks/LivermoreLoops/kernel13: 9.70% (0.1082 => 0.1187, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 9.53% (4.4293 => 4.8512, std.dev.: 0.0783) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.20% (2.2574 => 2.4650, std.dev.: 0.0563) SingleSource/Benchmarks/LivermoreLoops/kernel08: 8.91% (0.1234 => 0.1344, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.67% (6.1018 => 6.6311, std.dev.: 0.2049) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.48% (0.7174 => 0.7782, std.dev.: 0.0231) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.33% (0.1525 => 0.1652, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.09% (0.2386 => 0.2579, std.dev.: 0.0024) MultiSource/Applications/viterbi/viterbi: 7.98% (0.1791 => 0.1934, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 7.48% (0.7269 => 0.7813, std.dev.: 0.0176) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.16% (0.5782 => 0.6196, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/methcall: 7.03% (0.3144 => 0.3365, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.64% (0.5043 => 0.5378, std.dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 6.35% (0.1905 => 0.2026, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.30% (1.5911 => 1.6914, std.dev.: 0.0363) MultiSource/Applications/JM/ldecod/ldecod: 6.11% (9.3481 => 9.9197, std.dev.: 0.1544) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.78% (0.3999 => 0.4230, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/exceptions: 5.72% (0.4301 => 0.4547, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/ary: 5.32% (0.3533 => 0.3721, std.dev.: 0.0063) MultiSource/Applications/ClamAV/clamscan: 3.08% (36.6593 => 37.7884, std.dev.: 0.3378) MultiSource/Benchmarks/Bullet/bullet: 1.28% (71.8142 => 72.7352, std.dev.: 0.1012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/SPASS/SPASS: 23.88% (13.3574 => 16.5476, std.dev.: 0.2140) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 18.08% (1.3505 => 1.5947, std.dev.: 0.0175) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 11.51% (0.5247 => 0.5851, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 11.17% (6.6722 => 7.4173, std.dev.: 0.0348) SingleSource/Benchmarks/BenchmarkGame/puzzle: 8.91% (0.6960 => 0.7580, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/hash2: 5.19% (3.3750 => 3.5502, std.dev.: 0.0531) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.15% (6.0832 => 6.3962, std.dev.: 0.0556) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 5.14% (6.1787 => 6.4961, std.dev.: 0.0433) MultiSource/Benchmarks/Olden/bh/bh: 5.04% (1.9555 => 2.0541, std.dev.: 0.0276) SingleSource/Benchmarks/Misc/ffbench: 4.00% (0.9939 => 1.0337, std.dev.: 0.0149) MultiSource/Applications/sqlite3/sqlite3: 3.88% (4.5900 => 4.7680, std.dev.: 0.0201) MultiSource/Applications/siod/siod: 3.24% (3.1989 => 3.3026, std.dev.: 0.0372) MultiSource/Applications/sgefa/sgefa: 2.11% (0.6304 => 0.6437, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.87% (6.0545 => 6.1678, std.dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.49% (3.0212 => 3.0662, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.18% (1.3335 => 1.3493, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C++/ofstream_ctor: -9.92% (0.3539 => 0.3188, std.dev.: 0.0093) SingleSource/Benchmarks/LivermoreLoops/kernel21: -9.22% (0.1225 => 0.1112, std.dev.: 0.0043) SingleSource/Benchmarks/Linpack/linpack-pc: -8.84% (0.3168 => 0.2888, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/08-main/main: -6.37% (0.3361 => 0.3147, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: -5.69% (0.9555 => 0.9011, std.dev.: 0.0208) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.41% (6.0772 => 5.7483, std.dev.: 0.1120) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: -37.54% (0.1678 => 0.1048, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -19.34% (0.4308 => 0.3475, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -10.17% (5.9878 => 5.3786, std.dev.: 0.1628) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.19% (49.1393 => 48.0619, std.dev.: 0.2624) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -2.12% (0.1366 => 0.1337, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -8.28% (0.0459 => 0.0421, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.40% (0.0668 => 0.0652, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -2.59% (494.5084 => 481.6941, std.dev.: 5.9355) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0421, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: 42614.74% (1.1277 => 481.6941, std.dev.: 5.9355) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 203.04% (0.5229 => 1.5846, std.dev.: 0.0987) MultiSource/Applications/SPASS/SPASS: 21.40% (14.9895 => 18.1968, std.dev.: 0.1886) MultiSource/Applications/kimwitu++/kc: 50.45% (14.1553 => 21.2969, std.dev.: 0.1406) MultiSource/Benchmarks/MallocBench/gs/gs: 20.85% (4.1105 => 4.9677, std.dev.: 0.1420) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.46% (1.1048 => 1.5187, std.dev.: 0.0706) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 435.49% (7.1582 => 38.3317, std.dev.: 0.4546) SingleSource/Benchmarks/Misc-C++-EH/spirit: 91.49% (3.4629 => 6.6311, std.dev.: 0.2049) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.59% (0.6222 => 1.0303, std.dev.: 0.0613) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10828.06% (0.0720 => 7.8682, std.dev.: 0.2200) MultiSource/Applications/SIBsim4/SIBsim4: 3863700.00% (0.0001 => 3.8638, std.dev.: 0.0245) MultiSource/Applications/SPASS/SPASS: 16547500.00% (0.0001 => 16.5476, std.dev.: 0.2140) MultiSource/Applications/kimwitu++/kc: 52300.00% (0.0001 => 0.0524, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 64100.00% (0.0001 => 0.0642, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576300.00% (0.0001 => 0.5764, std.dev.: 0.0212) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10083500.00% (0.0001 => 10.0836, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6396100.00% (0.0001 => 6.3962, std.dev.: 0.0556) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1793.44% (1.1194 => 21.1952, std.dev.: 0.2783) MultiSource/Applications/ClamAV/clamscan: 70.40% (22.1758 => 37.7884, std.dev.: 0.3378) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 67.23% (2.9384 => 4.9139, std.dev.: 0.2338) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.58% (7.0540 => 10.9038, std.dev.: 0.3410) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.77% (8.1363 => 12.1854, std.dev.: 0.1769) MultiSource/Applications/JM/lencod/lencod: 47.34% (21.9371 => 32.3224, std.dev.: 0.1393) MultiSource/Benchmarks/FreeBench/distray/distray: 46.31% (0.1056 => 0.1545, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/almabench: 44.79% (0.0730 => 0.1057, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 39.66% (0.1432 => 0.2000, std.dev.: 0.0111) SingleSource/UnitTests/vla: 38.87% (0.0355 => 0.0493, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: 37.53% (0.0746 => 0.1026, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/dot-syntax-1: 35.07% (0.0479 => 0.0647, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 31.72% (2.2969 => 3.0255, std.dev.: 0.0189) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 31.58% (1.5859 => 2.0868, std.dev.: 0.0177) MultiSource/Benchmarks/Fhourstones/fhourstones: 29.37% (0.1566 => 0.2026, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.98% (0.0408 => 0.0514, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 25.28% (3.8723 => 4.8512, std.dev.: 0.0783) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.89% (0.2065 => 0.2579, std.dev.: 0.0024) MultiSource/Applications/viterbi/viterbi: 24.37% (0.1555 => 0.1934, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: 24.37% (0.2758 => 0.3430, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/Oscar: 24.21% (0.0636 => 0.0790, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.56% (0.1044 => 0.1290, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.56% (0.1337 => 0.1652, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 23.55% (0.0467 => 0.0577, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: 23.28% (0.0481 => 0.0593, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 23.25% (0.0443 => 0.0546, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 23.22% (0.2554 => 0.3147, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/hash: 23.09% (0.0485 => 0.0597, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 23.01% (0.0491 => 0.0604, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.96% (0.8172 => 1.0048, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout/matrix: 21.88% (0.0818 => 0.0997, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 21.88% (1.0722 => 1.3068, std.dev.: 0.0413) MultiSource/Benchmarks/BitBench/drop3/drop3: 21.78% (0.0482 => 0.0587, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.56% (0.0770 => 0.0936, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.37% (0.5105 => 0.6196, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 21.17% (0.0770 => 0.0933, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 21.15% (0.1584 => 0.1919, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.10% (14.3668 => 17.3984, std.dev.: 0.2263) SingleSource/Benchmarks/Misc-C++/bigfib: 21.02% (0.6456 => 0.7813, std.dev.: 0.0176) MultiSource/Benchmarks/VersaBench/bmm/bmm: 20.82% (0.0759 => 0.0917, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.81% (0.0793 => 0.0958, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 20.77% (0.1175 => 0.1419, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/em3d/em3d: 20.53% (0.1695 => 0.2043, std.dev.: 0.0079) SingleSource/UnitTests/2006-12-11-LoadConstants: 20.38% (0.1143 => 0.1376, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.29% (0.5569 => 0.6699, std.dev.: 0.0222) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.89% (0.2700 => 0.3237, std.dev.: 0.0178) MultiSource/Benchmarks/Olden/mst/mst: 19.86% (0.1163 => 0.1394, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.38% (0.8067 => 0.9630, std.dev.: 0.0321) MultiSource/Benchmarks/Prolangs-C++/city/city: 19.28% (2.0665 => 2.4650, std.dev.: 0.0563) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.02% (0.1125 => 0.1339, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/exceptions: 18.78% (0.3828 => 0.4547, std.dev.: 0.0095) SingleSource/UnitTests/ObjC/exceptions-2: 18.62% (0.3497 => 0.4148, std.dev.: 0.0131) SingleSource/UnitTests/ObjC/exceptions-3: 18.52% (0.3516 => 0.4167, std.dev.: 0.0089) SingleSource/Benchmarks/CoyoteBench/fftbench: 18.51% (0.4636 => 0.5494, std.dev.: 0.0287) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.41% (0.0842 => 0.0997, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 18.30% (0.4203 => 0.4972, std.dev.: 0.0195) SingleSource/UnitTests/ObjC/exceptions-4: 18.01% (0.3543 => 0.4181, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.84% (0.3162 => 0.3726, std.dev.: 0.0113) MultiSource/Benchmarks/mafft/pairlocalalign: 17.80% (9.4845 => 11.1731, std.dev.: 0.2127) SingleSource/Benchmarks/Shootout/lists: 17.57% (0.0626 => 0.0736, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/17-bintr/bintr: 17.48% (0.0675 => 0.0793, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.28% (0.3935 => 0.4615, std.dev.: 0.0112) SingleSource/UnitTests/ObjC/for-in: 17.24% (0.3694 => 0.4331, std.dev.: 0.0099) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.22% (0.0871 => 0.1021, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.13% (0.0648 => 0.0759, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 17.08% (0.2430 => 0.2845, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/methcall: 16.96% (0.2877 => 0.3365, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/bisort/bisort: 16.94% (0.0614 => 0.0718, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 16.66% (0.5860 => 0.6836, std.dev.: 0.0248) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 16.47% (0.1906 => 0.2220, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.40% (0.2756 => 0.3208, std.dev.: 0.0081) MultiSource/Applications/sgefa/sgefa: 16.34% (0.3109 => 0.3617, std.dev.: 0.0144) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.25% (0.0886 => 0.1030, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 16.21% (3.3354 => 3.8761, std.dev.: 0.1549) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.20% (0.1117 => 0.1298, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.07% (0.0834 => 0.0968, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.05% (0.0953 => 0.1106, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/oourafft: 15.90% (0.3282 => 0.3804, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.88% (0.2872 => 0.3328, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/bh/bh: 15.46% (0.3092 => 0.3570, std.dev.: 0.0113) MultiSource/Applications/sqlite3/sqlite3: 15.43% (17.1811 => 19.8320, std.dev.: 0.4101) SingleSource/Benchmarks/Shootout-C++/hello: 15.36% (0.2714 => 0.3131, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 15.33% (3.8922 => 4.4890, std.dev.: 0.1053) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.26% (1.5415 => 1.7768, std.dev.: 0.0888) MultiSource/Benchmarks/NPB-serial/is/is: 15.16% (0.0719 => 0.0828, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary: 15.13% (0.3232 => 0.3721, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.09% (0.2107 => 0.2425, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.07% (0.0730 => 0.0840, std.dev.: 0.0040) MultiSource/Applications/spiff/spiff: 15.01% (0.7835 => 0.9011, std.dev.: 0.0208) MultiSource/Benchmarks/Bullet/bullet: 15.01% (63.2438 => 72.7352, std.dev.: 0.1012) MultiSource/Applications/minisat/minisat: 14.98% (0.7115 => 0.8181, std.dev.: 0.0381) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.96% (0.3121 => 0.3588, std.dev.: 0.0158) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.94% (4.2646 => 4.9017, std.dev.: 0.2318) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.92% (5.0018 => 5.7483, std.dev.: 0.1120) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.81% (0.5981 => 0.6867, std.dev.: 0.0266) SingleSource/Benchmarks/McGill/exptree: 14.74% (0.0814 => 0.0934, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.69% (0.1062 => 0.1218, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.67% (0.1029 => 0.1180, std.dev.: 0.0047) MultiSource/Applications/oggenc/oggenc: 14.21% (5.7591 => 6.5774, std.dev.: 0.1413) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.04% (0.1510 => 0.1722, std.dev.: 0.0081) SingleSource/UnitTests/ObjC/trivial-interface: 13.88% (0.3473 => 0.3955, std.dev.: 0.0113) SingleSource/UnitTests/ObjC/property: 13.79% (0.3886 => 0.4422, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/lists: 13.76% (0.3422 => 0.3893, std.dev.: 0.0171) SingleSource/UnitTests/ObjC/synchronized: 13.76% (0.3561 => 0.4051, std.dev.: 0.0139) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.66% (0.3543 => 0.4027, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.80% (4.9449 => 5.5780, std.dev.: 0.2396) MultiSource/Benchmarks/PAQ8p/paq8p: 12.50% (10.3673 => 11.6630, std.dev.: 0.3315) MultiSource/Benchmarks/McCat/05-eks/eks: 11.75% (0.4299 => 0.4804, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.63% (0.0929 => 0.1037, std.dev.: 0.0041) SingleSource/UnitTests/SignlessTypes/rem: 11.28% (0.1144 => 0.1273, std.dev.: 0.0046) MultiSource/Applications/hbd/hbd: 11.08% (1.5603 => 1.7332, std.dev.: 0.0598) SingleSource/UnitTests/ObjC/block-byref-aggr: 10.82% (0.3817 => 0.4230, std.dev.: 0.0061) SingleSource/UnitTests/ObjC++/property-reference-object: 10.75% (0.6030 => 0.6678, std.dev.: 0.0170) SingleSource/Benchmarks/Misc/ReedSolomon: 10.74% (0.2049 => 0.2269, std.dev.: 0.0079) SingleSource/UnitTests/ObjC++/Hello: 10.53% (0.5925 => 0.6549, std.dev.: 0.0210) SingleSource/Benchmarks/Stanford/Puzzle: 10.49% (0.1268 => 0.1401, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.23% (0.4879 => 0.5378, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 10.17% (0.7326 => 0.8071, std.dev.: 0.0182) SingleSource/Regression/C++/ofstream_ctor: 9.74% (0.2905 => 0.3188, std.dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 149.56% (4.3953 => 10.9691, std.dev.: 0.0210) SingleSource/Benchmarks/Shootout-C++/methcall: 147.39% (5.3999 => 13.3588, std.dev.: 0.0129) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 22.25% (1.3045 => 1.5947, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/oourafft: 17.43% (6.6465 => 7.8051, std.dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.64% (1.1145 => 1.2999, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/bisort/bisort: 16.19% (0.8333 => 0.9682, std.dev.: 0.0443) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.35% (0.2944 => 0.3337, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 12.43% (3.1578 => 3.5502, std.dev.: 0.0531) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.65% (2.8904 => 3.2272, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 10.20% (1.1396 => 1.2558, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.31% (1.7254 => 1.8860, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/puzzle: 8.88% (0.6962 => 0.7580, std.dev.: 0.0121) SingleSource/Benchmarks/Misc/ffbench: 8.75% (0.9505 => 1.0337, std.dev.: 0.0149) SingleSource/Benchmarks/CoyoteBench/lpbench: 6.69% (10.3460 => 11.0377, std.dev.: 0.2319) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 5.85% (1.9405 => 2.0541, std.dev.: 0.0276) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.58% (4.2280 => 4.4638, std.dev.: 0.0076) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.02% (11.6436 => 12.1115, std.dev.: 0.0172) MultiSource/Applications/lua/lua: 3.92% (26.0924 => 27.1152, std.dev.: 0.2239) MultiSource/Applications/sgefa/sgefa: 3.44% (0.6223 => 0.6437, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.34% (0.4162 => 0.4301, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.78% (2.1424 => 2.2019, std.dev.: 0.0117) MultiSource/Applications/sqlite3/sqlite3: 2.67% (4.6441 => 4.7680, std.dev.: 0.0201) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.16% (1.3677 => 1.3973, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 2.08% (3.1595 => 3.2253, std.dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/dry: 1.97% (2.4116 => 2.4590, std.dev.: 0.0143) MultiSource/Benchmarks/PAQ8p/paq8p: 1.68% (85.0658 => 86.4916, std.dev.: 0.1795) MultiSource/Benchmarks/mafft/pairlocalalign: 1.50% (27.8444 => 28.2618, std.dev.: 0.0250) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.37% (6.5088 => 6.5981, std.dev.: 0.0115) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0313 => 1.0441, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0505, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.5348 => 12.6641, std.dev.: 0.0128) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1688, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.73% (5.2763 => 1.2808, std.dev.: 0.0256) SingleSource/Benchmarks/Misc/salsa20: -75.37% (0.8651 => 0.2131, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/richards_benchmark: -44.88% (0.1622 => 0.0894, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.19% (5.3855 => 4.7292, std.dev.: 0.1702) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.02% (5.3526 => 4.7093, std.dev.: 0.1841) MultiSource/Applications/JM/ldecod/ldecod: -4.95% (10.4361 => 9.9197, std.dev.: 0.1544) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.36% (0.3987 => 0.2378, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.31% (4.5009 => 2.7766, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: -33.54% (1.1492 => 0.7638, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -27.70% (10.7105 => 7.7436, std.dev.: 0.6027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.15% (2.6546 => 2.0135, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -19.11% (0.2161 => 0.1748, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4232, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.69% (2.6778 => 2.2843, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.78% (32.5116 => 29.0058, std.dev.: 0.0389) SingleSource/Benchmarks/Misc/mandel-2: -10.65% (1.5373 => 1.3736, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -10.54% (9.5636 => 8.5558, std.dev.: 0.2362) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.03% (1.5660 => 1.4246, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -5.88% (19.9488 => 18.7766, std.dev.: 0.1801) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.72% (1.6805 => 1.5844, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.41% (3.2416 => 3.0662, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5065, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.77% (0.2497 => 0.2378, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -4.42% (6.2999 => 6.0217, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.40% (0.9957 => 0.9618, std.dev.: 0.0065) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8920, std.dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.31% (0.4808 => 0.4697, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.87% (8.1563 => 8.0038, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6776, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.50% (10.2830 => 10.1290, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.97% (0.1485 => 0.1337, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0016) Report Time: 4.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 01:25:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 03:25:00 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121120092500.2B62C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6066?compare_to=6062&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6066, Order: 168357, Start Time: 2012-11-20 07:55:38, End Time: 2012-11-20 09:25:24 To: 6062, Order: 168355, Start Time: 2012-11-20 05:38:46, End Time: 2012-11-20 07:09:54 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 2 (111 on baseline) Performance Improvements: 5 (27 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1047 (836 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: 3.09% (4.3433 => 4.4774, std.dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.73% (2.3315 => 2.3951, std.dev.: 0.0195) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/05-eks/eks: -2.34% (0.4582 => 0.4475, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.74% (1.2304 => 1.2090, std.dev.: 0.0071) MultiSource/Benchmarks/PAQ8p/paq8p: -1.03% (2.4596 => 2.4342, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -13.96% (23.3880 => 20.1241, std.dev.: 1.2662) MultiSource/Benchmarks/Olden/treeadd/treeadd: -3.23% (0.3777 => 0.3655, std.dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.13% (1.0671 => 1.0550, std.dev.: 0.0155) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -20.09% (0.0219 => 0.0175, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 8.01% (0.0362 => 0.0391, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.93% (0.0331 => 0.0318, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -22.51% (0.0311 => 0.0241, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.40% (0.0365 => 0.0338, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0203 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -21.92% (0.0219 => 0.0171, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -1.01% (0.1485 => 0.1470, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 3.93% (1.1158 => 1.1597, std.dev.: 0.0306) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.87% (0.4209 => 0.4088, std.dev.: 0.0477) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.70% (0.1431 => 0.1378, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.91% (0.0619 => 0.0601, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -19.19% (0.0271 => 0.0219, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.54% (0.0621 => 0.0599, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.01% (1.1944 => 1.1945, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -94.12% (0.0017 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.89% (0.0634 => 0.0603, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.24% (0.0242 => 0.0245, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.22% (0.7812 => 0.7829, std.dev.: 0.0014) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -80.00% (0.0005 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -10.96% (0.0073 => 0.0065, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.34% (16.4461 => 17.6525, std.dev.: 0.0906) MultiSource/Applications/sqlite3/sqlite3: 2321.24% (0.6332 => 15.3313, std.dev.: 0.1216) MultiSource/Benchmarks/McCat/08-main/main: 46.81% (0.1831 => 0.2688, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -10.97% (0.1559 => 0.1388, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7071.28% (0.3123 => 22.3959, std.dev.: 0.0694) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.90% (0.2463 => 0.3692, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1522.13% (0.3344 => 5.4244, std.dev.: 0.0201) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.46% (0.2364 => 0.3226, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/bigfib: 4.16% (0.6010 => 0.6260, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: -9.79% (0.0429 => 0.0387, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.72% (0.3266 => 0.3420, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: 3.35% (0.1969 => 0.2035, std.dev.: 0.0030) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -10.71% (0.0224 => 0.0200, std.dev.: 0.0019) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0442, std.dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 8.00% (0.1462 => 0.1579, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4930, std.dev.: 0.0220) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0721, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4932, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5110, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5011, std.dev.: 0.2581) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3128, std.dev.: 0.0198) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1446, std.dev.: 0.0451) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3631, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4056, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0884, std.dev.: 0.0009) SingleSource/Regression/C/uint64_to_float: -24.14% (2.1832 => 1.6562, std.dev.: 0.0030) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.46% (0.0810 => 0.0919, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: 9.89% (0.1112 => 0.1222, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.60% (0.7473 => 0.8041, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.04% (0.3295 => 0.3527, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.03% (0.1905 => 0.2039, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.31% (0.5961 => 0.6337, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.64% (0.6010 => 0.6349, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.34% (0.2133 => 0.2247, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.28% (0.2519 => 0.2652, std.dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.3137 => 0.3291, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/gs/gs: 4.48% (4.1305 => 4.3157, std.dev.: 0.0292) MultiSource/Applications/Burg/burg: 4.40% (1.2222 => 1.2760, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.12% (0.4127 => 0.4297, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.96% (1.3279 => 1.3805, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.95% (2.1401 => 2.2246, std.dev.: 0.0114) MultiSource/Applications/lua/lua: 3.93% (3.8189 => 3.9689, std.dev.: 0.0418) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.74% (0.9435 => 0.9788, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.57% (1.1606 => 1.2020, std.dev.: 0.0152) MultiSource/Applications/treecc/treecc: 3.52% (1.9948 => 2.0650, std.dev.: 0.0223) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.52% (8.6476 => 8.9519, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.47% (1.1685 => 1.2090, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.39% (0.8697 => 0.8992, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.27% (0.4559 => 0.4708, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.15% (14.2605 => 14.7092, std.dev.: 0.1040) MultiSource/Applications/siod/siod: 3.09% (2.2184 => 2.2869, std.dev.: 0.0144) MultiSource/Applications/minisat/minisat: 3.06% (0.6834 => 0.7043, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.05% (0.9039 => 0.9315, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.95% (4.1763 => 4.2996, std.dev.: 0.0437) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.91% (0.9069 => 0.9333, std.dev.: 0.0059) MultiSource/Applications/d/make_dparser: 2.87% (3.2366 => 3.3295, std.dev.: 0.0188) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.75% (0.8340 => 0.8569, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.73% (0.9056 => 0.9303, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.70% (0.8359 => 0.8585, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.68% (0.5817 => 0.5973, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.67% (0.9074 => 0.9316, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.65% (0.8597 => 0.8825, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.65% (0.8611 => 0.8839, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.63% (0.8050 => 0.8262, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.62% (0.8086 => 0.8298, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.56% (0.5191 => 0.5324, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.56% (0.8007 => 0.8212, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.52% (1.4479 => 1.4844, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.49% (0.8805 => 0.9024, std.dev.: 0.0047) MultiSource/Applications/ClamAV/clamscan: 2.48% (14.7684 => 15.1340, std.dev.: 0.1226) MultiSource/Applications/JM/ldecod/ldecod: 2.46% (6.7320 => 6.8977, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.46% (0.7966 => 0.8162, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.44% (0.9908 => 1.0150, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.44% (1.6386 => 1.6786, std.dev.: 0.0148) MultiSource/Benchmarks/PAQ8p/paq8p: 2.43% (2.3764 => 2.4342, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.42% (0.8331 => 0.8533, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.41% (1.5315 => 1.5684, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.37% (4.4880 => 4.5944, std.dev.: 0.0337) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.36% (0.8716 => 0.8922, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.36% (0.8317 => 0.8513, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.34% (0.8885 => 0.9093, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.34% (0.6586 => 0.6740, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.33% (0.8286 => 0.8479, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.30% (0.8518 => 0.8714, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.28% (0.7932 => 0.8113, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.25% (0.8204 => 0.8389, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.24% (0.9688 => 0.9905, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.23% (4.4873 => 4.5873, std.dev.: 0.0348) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.20% (0.8048 => 0.8225, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.18% (0.8261 => 0.8441, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.18% (0.8177 => 0.8355, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.11% (0.8712 => 0.8896, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.07% (0.8927 => 0.9112, std.dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 2.07% (15.3280 => 15.6454, std.dev.: 0.0494) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.06% (0.8656 => 0.8834, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.05% (3.1832 => 3.2483, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.99% (0.8338 => 0.8504, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.98% (0.8855 => 0.9030, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.98% (0.6227 => 0.6350, std.dev.: 0.0045) MultiSource/Benchmarks/Bullet/bullet: 1.96% (31.8598 => 32.4831, std.dev.: 0.0737) MultiSource/Benchmarks/mafft/pairlocalalign: 1.94% (8.6247 => 8.7918, std.dev.: 0.0317) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.89% (0.8316 => 0.8473, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 1.85% (1.0945 => 1.1148, std.dev.: 0.0053) MultiSource/Applications/oggenc/oggenc: 1.81% (4.9628 => 5.0524, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.46% (1.2423 => 1.2604, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 85.43% (0.0199 => 0.0369, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/pi: 57.10% (1.5795 => 2.4814, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.60% (0.7597 => 0.8858, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.23% (2.9753 => 3.4581, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.66% (2.7995 => 3.2098, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.61% (5.0261 => 5.6094, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.95% (1.1857 => 1.2800, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 7.09% (1.7056 => 1.8266, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.66% (4.7794 => 5.0978, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 6.26% (3.1873 => 3.3867, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/richards_benchmark: 6.21% (1.3037 => 1.3846, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.88% (4.9686 => 5.2606, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.64% (4.5327 => 4.7884, std.dev.: 0.0213) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.56% (6.2275 => 6.5112, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.52% (3.3761 => 3.5286, std.dev.: 0.0043) MultiSource/Applications/lambda-0_1_3/lambda: 4.38% (7.4933 => 7.8216, std.dev.: 0.0512) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.15% (4.9453 => 5.1504, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.01% (4.9469 => 5.1452, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 3.92% (14.0064 => 14.5550, std.dev.: 0.0164) MultiSource/Applications/siod/siod: 3.04% (3.6643 => 3.7758, std.dev.: 0.0065) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.97% (1.2337 => 1.2704, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.83% (8.2783 => 8.5122, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.81% (4.3552 => 4.4774, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.80% (11.5690 => 11.8931, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout/lists: 2.34% (7.3375 => 7.5093, std.dev.: 0.0096) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.73% (1.1365 => 1.1562, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.65% (4.8362 => 4.9160, std.dev.: 0.0219) MultiSource/Benchmarks/Olden/power/power: 1.50% (1.2061 => 1.2242, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.49% (2.4647 => 2.5014, std.dev.: 0.0099) MultiSource/Benchmarks/FreeBench/neural/neural: 1.32% (1.0841 => 1.0984, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 1.21% (8.5322 => 8.6352, std.dev.: 0.0190) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.17% (3.5679 => 3.6095, std.dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.24% (5.4641 => 4.3036, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.77% (7.2130 => 6.1474, std.dev.: 0.1612) SingleSource/Benchmarks/McGill/chomp: -11.17% (1.1216 => 0.9963, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.15% (1.0512 => 0.9340, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.57% (14.6451 => 13.2433, std.dev.: 0.1007) MultiSource/Benchmarks/mafft/pairlocalalign: -8.53% (63.1822 => 57.7915, std.dev.: 0.0753) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.71% (0.3269 => 0.3017, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.88% (4.7482 => 4.4215, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.98% (3.7148 => 3.4926, std.dev.: 0.0391) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.88% (5.4972 => 5.1737, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.07% (5.1557 => 4.8943, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.40% (4.7449 => 4.5363, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.89% (6.0224 => 5.7879, std.dev.: 0.0116) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.75% (2.8773 => 2.7693, std.dev.: 0.0106) MultiSource/Applications/lua/lua: -3.27% (29.8330 => 28.8561, std.dev.: 0.1203) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (28.5821 => 27.6979, std.dev.: 0.0844) MultiSource/Benchmarks/Prolangs-C++/life/life: -3.09% (2.6356 => 2.5542, std.dev.: 0.0168) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.03% (0.5807 => 0.5631, std.dev.: 0.0003) MultiSource/Applications/aha/aha: -2.46% (3.3398 => 3.2577, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.27% (9.9065 => 9.6812, std.dev.: 0.0341) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.20% (2.4490 => 2.3951, std.dev.: 0.0195) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.16% (3.2169 => 3.1475, std.dev.: 0.0221) SingleSource/Benchmarks/Shootout-C++/hash2: -2.05% (3.4237 => 3.3535, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.03% (11.5316 => 11.2973, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.65% (4.9994 => 4.9171, std.dev.: 0.0131) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.36% (2.3487 => 2.3168, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.15% (5.6343 => 5.5694, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.81% (1.0262 => 1.0550, std.dev.: 0.0155) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 42.28% (0.0123 => 0.0175, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.17% (0.0408 => 0.0391, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 25.20% (0.0254 => 0.0318, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -20.20% (0.0302 => 0.0241, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -11.98% (0.0384 => 0.0338, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -5.00% (0.0180 => 0.0171, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.23% (0.1438 => 0.1470, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 2.37% (1.1329 => 1.1597, std.dev.: 0.0306) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.83% (0.4164 => 0.4088, std.dev.: 0.0477) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.66% (0.1369 => 0.1378, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.24% (0.0641 => 0.0601, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.31% (0.0195 => 0.0219, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.63% (0.0578 => 0.0599, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.44% (1.1437 => 1.1945, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.83% (0.0627 => 0.0603, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 36.11% (0.0180 => 0.0245, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.35% (0.8017 => 0.7829, std.dev.: 0.0014) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 4.84% (0.0062 => 0.0065, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 01:45:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 03:45:10 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121120094510.1CFD72A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6067?compare_to=6063&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6067, Order: 168357, Start Time: 2012-11-20 08:11:53, End Time: 2012-11-20 09:45:34 To: 6063, Order: 168355, Start Time: 2012-11-20 06:11:22, End Time: 2012-11-20 07:44:55 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 1 (177 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (861 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/sim/sim: -1.04% (4.9326 => 4.8813, std.dev.: 0.0013) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1009, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/salsa20: 2.28% (7.4937 => 7.6642, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/hash2: 2.15% (3.1932 => 3.2618, std.dev.: 0.0100) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.11% (0.3821 => 0.3511, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: -6.82% (0.3357 => 0.3128, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.72% (0.3142 => 0.2931, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.64% (0.9542 => 0.8908, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions-2: -6.60% (0.3831 => 0.3578, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.59% (0.3884 => 0.3628, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: -6.56% (0.3812 => 0.3562, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -6.55% (2.4924 => 2.3291, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: -6.55% (0.3880 => 0.3626, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -6.53% (0.2160 => 0.2019, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -6.52% (0.3848 => 0.3597, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.52% (0.3896 => 0.3642, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.45% (0.4033 => 0.3773, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.40% (0.3891 => 0.3642, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.37% (0.4176 => 0.3910, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.35% (0.9852 => 0.9226, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -6.33% (9.2283 => 8.6437, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.30% (0.2428 => 0.2275, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: -6.22% (16.1920 => 15.1853, std.dev.: 0.0135) MultiSource/Applications/JM/ldecod/ldecod: -6.13% (7.0961 => 6.6614, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.01% (0.1796 => 0.1688, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -5.98% (0.4199 => 0.3948, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -5.95% (0.9179 => 0.8633, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.93% (1.3722 => 1.2908, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.91% (3.5339 => 3.3249, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.91% (1.0544 => 0.9921, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.90% (0.2355 => 0.2216, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.90% (6.7716 => 6.3724, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.88% (4.8161 => 4.5329, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/parameter-passing: -5.86% (0.4280 => 0.4029, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.85% (0.1761 => 0.1658, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -5.80% (0.1879 => 0.1770, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.80% (0.5863 => 0.5523, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.80% (4.0323 => 3.7985, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.80% (0.3658 => 0.3446, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.73% (1.6364 => 1.5427, std.dev.: 0.0042) MultiSource/Benchmarks/sim/sim: -5.73% (0.3406 => 0.3211, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: -5.72% (1.1530 => 1.0871, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.71% (0.2695 => 0.2541, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/05-eks/eks: -5.71% (0.4515 => 0.4257, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.70% (4.8802 => 4.6022, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/gs/gs: -5.68% (4.3330 => 4.0867, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.68% (1.4642 => 1.3810, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.68% (0.7198 => 0.6789, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.68% (0.5478 => 0.5167, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.67% (1.2300 => 1.1602, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.66% (0.6484 => 0.6117, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.59% (0.5925 => 0.5594, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.58% (0.5857 => 0.5530, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -5.57% (1.1450 => 1.0812, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.57% (0.6660 => 0.6289, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.53% (0.6667 => 0.6298, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.53% (0.6293 => 0.5945, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.52% (0.6230 => 0.5886, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.52% (0.7919 => 0.7482, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.51% (0.5805 => 0.5485, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.51% (0.5591 => 0.5283, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.50% (4.5069 => 4.2588, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.49% (0.6736 => 0.6366, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.48% (0.5859 => 0.5538, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.47% (0.5849 => 0.5529, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -5.47% (1.2515 => 1.1831, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.46% (0.6189 => 0.5851, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.45% (0.6052 => 0.5722, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.45% (0.5581 => 0.5277, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.45% (0.6297 => 0.5954, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.42% (0.6194 => 0.5858, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.42% (0.6260 => 0.5921, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.39% (0.6304 => 0.5964, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.38% (0.5575 => 0.5275, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: -5.38% (0.2659 => 0.2516, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.38% (0.2548 => 0.2411, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.34% (0.3483 => 0.3297, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.34% (0.6446 => 0.6102, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.33% (0.4916 => 0.4654, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.33% (0.5705 => 0.5401, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.33% (1.2784 => 1.2103, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.33% (14.2083 => 13.4516, std.dev.: 0.0211) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.32% (0.8521 => 0.8068, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: -5.31% (0.3581 => 0.3391, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -5.30% (1.3864 => 1.3129, std.dev.: 0.0131) MultiSource/Applications/sqlite3/sqlite3: -5.29% (17.1032 => 16.1986, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.27% (0.5941 => 0.5628, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.26% (8.0126 => 7.5910, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.24% (0.5570 => 0.5278, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.24% (0.5802 => 0.5498, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.22% (0.5688 => 0.5391, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: -5.21% (15.5079 => 14.7004, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.21% (0.5456 => 0.5172, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.20% (0.6676 => 0.6329, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.18% (0.2278 => 0.2160, std.dev.: 0.0022) MultiSource/Applications/d/make_dparser: -5.18% (3.5154 => 3.3334, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.17% (0.5999 => 0.5689, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.15% (1.6474 => 1.5626, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.11% (1.2221 => 1.1597, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.10% (1.2210 => 1.1587, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.09% (0.6440 => 0.6112, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.08% (0.4151 => 0.3940, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.07% (0.6033 => 0.5727, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -5.03% (1.3148 => 1.2486, std.dev.: 0.0060) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.03% (0.3319 => 0.3152, std.dev.: 0.0020) MultiSource/Applications/lua/lua: -5.02% (4.0594 => 3.8557, std.dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.01% (0.5168 => 0.4909, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.99% (0.2385 => 0.2266, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.97% (0.2999 => 0.2850, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -4.96% (15.2527 => 14.4958, std.dev.: 0.0214) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.96% (0.3931 => 0.3736, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.95% (0.3837 => 0.3647, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: -4.94% (0.7447 => 0.7079, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: -4.91% (0.7779 => 0.7397, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: -4.88% (0.3255 => 0.3096, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.88% (22.4056 => 21.3114, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/methcall: -4.86% (0.3025 => 0.2878, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.84% (0.4813 => 0.4580, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.84% (0.7339 => 0.6984, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -4.83% (34.0927 => 32.4463, std.dev.: 0.0610) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.82% (0.7524 => 0.7161, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: -4.82% (0.3194 => 0.3040, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -4.82% (2.4021 => 2.2864, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.81% (0.3057 => 0.2910, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.81% (0.3016 => 0.2871, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.79% (0.4321 => 0.4114, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.76% (2.1713 => 2.0680, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: -4.75% (2.1401 => 2.0384, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.74% (0.7021 => 0.6688, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.71% (0.2933 => 0.2795, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -4.69% (0.3026 => 0.2884, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.67% (0.3252 => 0.3100, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.67% (0.2871 => 0.2737, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -4.66% (0.2939 => 0.2802, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -4.64% (0.3446 => 0.3286, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.60% (0.2849 => 0.2718, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/moments: -4.59% (0.4248 => 0.4053, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.58% (0.6347 => 0.6056, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.57% (0.6395 => 0.6103, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -4.56% (0.3271 => 0.3122, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -4.51% (0.3481 => 0.3324, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -4.51% (0.7982 => 0.7622, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.50% (0.5329 => 0.5089, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.49% (0.3205 => 0.3061, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.49% (0.5567 => 0.5317, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: -4.48% (0.3394 => 0.3242, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.48% (0.2903 => 0.2773, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.47% (0.6395 => 0.6109, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: -4.47% (0.8418 => 0.8042, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.45% (0.9557 => 0.9132, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -4.44% (0.6441 => 0.6155, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.44% (0.5569 => 0.5322, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: -4.43% (5.0226 => 4.8000, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: -4.42% (0.4861 => 0.4646, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.42% (0.3867 => 0.3696, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -4.42% (0.2989 => 0.2857, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -4.41% (0.3059 => 0.2924, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.39% (2.2587 => 2.1595, std.dev.: 0.0060) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.38% (0.9077 => 0.8679, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/lists: -4.36% (0.3621 => 0.3463, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.36% (0.4083 => 0.3905, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -4.33% (18.2933 => 17.5011, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.30% (0.3323 => 0.3180, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: -4.27% (0.4524 => 0.4331, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.25% (0.4427 => 0.4239, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.13% (0.3849 => 0.3690, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.07% (0.3491 => 0.3349, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -3.99% (0.3788 => 0.3637, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -3.93% (0.6750 => 0.6485, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.61% (5.4682 => 5.2708, std.dev.: 0.0047) MultiSource/Applications/hbd/hbd: -3.46% (1.5610 => 1.5070, std.dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -1.78% (20.7746 => 20.4043, std.dev.: 0.0108) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7571, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1723, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.96% (2.2633 => 2.1736, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.92% (1.7753 => 1.7057, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.61% (6.5735 => 6.4679, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 03:42:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 05:42:21 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121120114221.EA5EF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6068?compare_to=6066&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6068, Order: 168359, Start Time: 2012-11-20 10:06:22, End Time: 2012-11-20 11:42:47 To: 6066, Order: 168357, Start Time: 2012-11-20 07:55:38, End Time: 2012-11-20 09:25:24 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 15 (52 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1039 (902 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 71.11% (0.0270 => 0.0462, std.dev.: 0.0007) SingleSource/Regression/C++/global_ctor: 65.37% (0.0205 => 0.0339, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-2: 41.32% (0.0288 => 0.0407, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.47% (0.4857 => 0.5317, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.03% (0.8121 => 0.8692, std.dev.: 0.0090) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.59% (0.3291 => 0.3442, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.32% (0.6349 => 0.6623, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.39% (1.2020 => 1.2428, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/football/football: 2.68% (0.8944 => 0.9184, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.36% (1.2826 => 1.3129, std.dev.: 0.0103) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench: 34.05% (1.5011 => 2.0122, std.dev.: 0.0949) SingleSource/Benchmarks/Shootout-C++/ary3: 6.71% (2.0008 => 2.1351, std.dev.: 0.0361) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.51% (0.3987 => 0.4087, std.dev.: 0.0024) SingleSource/UnitTests/Vector/multiplies: 1.89% (0.5554 => 0.5659, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 1.27% (2.8716 => 2.9081, std.dev.: 0.0087) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.95% (1.0550 => 1.0450, std.dev.: 0.1432) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 30.29% (0.0175 => 0.0228, std.dev.: 0.0068) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 14.07% (0.0391 => 0.0446, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 8.18% (0.0318 => 0.0344, std.dev.: 0.0095) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 33.20% (0.0241 => 0.0321, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 33.73% (0.0338 => 0.0452, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: 2.46% (0.0203 => 0.0208, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: 7.02% (0.0171 => 0.0183, std.dev.: 0.0101) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 1.84% (0.1470 => 0.1497, std.dev.: 0.0048) MultiSource/Applications/lemon/lemon: 4.92% (1.1597 => 1.2168, std.dev.: 0.2162) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 10.91% (0.4088 => 0.4534, std.dev.: 0.0271) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.39% (0.1378 => 0.1411, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.49% (0.0601 => 0.0640, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 26.03% (0.0219 => 0.0276, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.17% (0.0599 => 0.0612, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.07% (1.1945 => 1.1953, std.dev.: 0.0287) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 19.23% (0.0026 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.80% (0.0603 => 0.0644, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.98% (0.0245 => 0.0267, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.69% (0.7829 => 0.7775, std.dev.: 0.0476) SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -7.69% (0.0065 => 0.0060, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.29% (16.4461 => 17.6451, std.dev.: 0.7923) MultiSource/Applications/sqlite3/sqlite3: 2332.50% (0.6332 => 15.4026, std.dev.: 0.7246) MultiSource/Benchmarks/McCat/08-main/main: 49.59% (0.1831 => 0.2739, std.dev.: 0.0756) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.87% (0.1559 => 0.1483, std.dev.: 0.0435) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7280.28% (0.3123 => 23.0486, std.dev.: 0.9518) SingleSource/Benchmarks/CoyoteBench/fftbench: 66.02% (0.2463 => 0.4089, std.dev.: 0.0343) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1533.61% (0.3344 => 5.4628, std.dev.: 0.2863) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.44% (0.2364 => 0.3249, std.dev.: 0.0310) SingleSource/Benchmarks/Misc-C++/bigfib: 8.05% (0.6010 => 0.6494, std.dev.: 0.1776) SingleSource/Benchmarks/Misc/mandel: 4.20% (0.0429 => 0.0447, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.52% (0.3266 => 0.3479, std.dev.: 0.1008) SingleSource/Benchmarks/Shootout-C++/strcat: 3.66% (0.1969 => 0.2041, std.dev.: 0.0042) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.14% (0.0224 => 0.0240, std.dev.: 0.0070) SingleSource/UnitTests/byval-alignment: -24.35% (0.0230 => 0.0174, std.dev.: 0.0050) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0521, std.dev.: 0.0038) MultiSource/Applications/oggenc/oggenc: 12.38% (0.1462 => 0.1643, std.dev.: 0.0307) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4847, std.dev.: 0.2961) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0722, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4937, std.dev.: 0.0794) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5103, std.dev.: 0.0893) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 2.0122, std.dev.: 0.0949) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3260, std.dev.: 0.0291) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1275, std.dev.: 0.0933) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3635, std.dev.: 0.0173) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4074, std.dev.: 0.0753) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0876, std.dev.: 0.0240) SingleSource/Regression/C/uint64_to_float: -24.24% (2.1832 => 1.6539, std.dev.: 0.0504) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-BitfieldHandling: 91.34% (0.0127 => 0.0243, std.dev.: 0.0017) SingleSource/Regression/C++/global_ctor: 83.24% (0.0185 => 0.0339, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/nestedloop: 73.68% (0.0266 => 0.0462, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-2: 48.00% (0.0275 => 0.0407, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.05% (0.0810 => 0.0940, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.01% (0.0773 => 0.0889, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.33% (0.0848 => 0.0961, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.20% (0.6010 => 0.6623, std.dev.: 0.0053) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.72% (0.3137 => 0.3442, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.70% (0.4847 => 0.5317, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/em3d/em3d: 8.72% (0.1721 => 0.1871, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.62% (0.2180 => 0.2368, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.76% (0.7473 => 0.8053, std.dev.: 0.0131) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.08% (1.1606 => 1.2428, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.68% (0.8148 => 0.8692, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.76% (0.6287 => 0.6649, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.70% (0.5961 => 0.6301, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.81% (1.2526 => 1.3129, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/football/football: 4.74% (0.8768 => 0.9184, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.24% (0.9435 => 0.9835, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.22% (0.4127 => 0.4301, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/gs/gs: 4.07% (4.1305 => 4.2985, std.dev.: 0.0332) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.71% (0.3124 => 0.3240, std.dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 3.63% (1.1271 => 1.1680, std.dev.: 0.0138) MultiSource/Benchmarks/PAQ8p/paq8p: 3.41% (2.3764 => 2.4574, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.37% (1.4479 => 1.4967, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 117.09% (0.0199 => 0.0432, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/pi: 57.62% (1.5795 => 2.4896, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.40% (0.7597 => 0.8919, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.19% (2.9753 => 3.4571, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.71% (2.7995 => 3.2113, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.65% (5.0261 => 5.6118, std.dev.: 0.0664) SingleSource/Benchmarks/McGill/queens: 7.13% (1.7056 => 1.8272, std.dev.: 0.0326) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (1.9999 => 2.1351, std.dev.: 0.0361) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.65% (4.7794 => 5.0973, std.dev.: 0.0274) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.61% (2.2485 => 2.3972, std.dev.: 0.0476) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.91% (4.5327 => 4.8005, std.dev.: 0.0346) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.88% (3.3761 => 3.5407, std.dev.: 0.0573) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.65% (6.2275 => 6.5172, std.dev.: 0.0480) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.16% (4.9453 => 5.1512, std.dev.: 0.0573) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.10% (4.9469 => 5.1499, std.dev.: 0.0564) MultiSource/Applications/hexxagon/hexxagon: 4.10% (14.0064 => 14.5802, std.dev.: 0.0515) MultiSource/Applications/siod/siod: 3.02% (3.6643 => 3.7748, std.dev.: 0.0427) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.78% (8.2783 => 8.5087, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.76% (11.5690 => 11.8880, std.dev.: 0.0420) SingleSource/Benchmarks/Shootout/lists: 2.63% (7.3375 => 7.5302, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.35% (1.1365 => 1.1632, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.93% (4.8362 => 4.9294, std.dev.: 0.0292) MultiSource/Applications/spiff/spiff: 1.82% (2.8561 => 2.9081, std.dev.: 0.0087) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.57% (2.4647 => 2.5034, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/neural/neural: 1.33% (1.0841 => 1.0985, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.27% (1.5941 => 1.6144, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.13% (5.4641 => 4.3096, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.60% (7.2130 => 6.2321, std.dev.: 0.0947) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.70% (1.0512 => 0.9387, std.dev.: 0.0225) SingleSource/Benchmarks/McGill/chomp: -10.18% (1.1216 => 1.0074, std.dev.: 0.0268) MultiSource/Benchmarks/mafft/pairlocalalign: -8.19% (63.1822 => 58.0101, std.dev.: 0.0680) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.09% (14.6451 => 13.6069, std.dev.: 0.2151) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.87% (4.7482 => 4.4221, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.15% (3.7148 => 3.4862, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.90% (5.4972 => 5.1731, std.dev.: 0.0677) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.05% (5.1557 => 4.8951, std.dev.: 0.0376) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.37% (4.7449 => 4.5376, std.dev.: 0.0158) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.37% (2.8773 => 2.7517, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.83% (6.0224 => 5.7919, std.dev.: 0.0197) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.17% (0.5807 => 0.5623, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.06% (28.5821 => 27.7088, std.dev.: 0.1133) MultiSource/Applications/aha/aha: -2.41% (3.3398 => 3.2592, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.37% (2.6356 => 2.5732, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.00% (11.5316 => 11.3014, std.dev.: 0.0101) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.62% (2.3487 => 2.3107, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.03% (5.6343 => 5.5760, std.dev.: 0.0186) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.83% (1.0262 => 1.0450, std.dev.: 0.1432) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 85.37% (0.0123 => 0.0228, std.dev.: 0.0068) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 9.31% (0.0408 => 0.0446, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 35.43% (0.0254 => 0.0344, std.dev.: 0.0095) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 6.29% (0.0302 => 0.0321, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 17.71% (0.0384 => 0.0452, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: 9.47% (0.0190 => 0.0208, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: 1.67% (0.0180 => 0.0183, std.dev.: 0.0101) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 4.10% (0.1438 => 0.1497, std.dev.: 0.0048) MultiSource/Applications/lemon/lemon: 7.41% (1.1329 => 1.2168, std.dev.: 0.2162) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 8.89% (0.4164 => 0.4534, std.dev.: 0.0271) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.07% (0.1369 => 0.1411, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.16% (0.0641 => 0.0640, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.54% (0.0195 => 0.0276, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.88% (0.0578 => 0.0612, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.51% (1.1437 => 1.1953, std.dev.: 0.0287) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.71% (0.0627 => 0.0644, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.02% (0.8017 => 0.7775, std.dev.: 0.0476) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -3.23% (0.0062 => 0.0060, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 03:42:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 05:42:52 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121120114252.73E622A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6069?compare_to=6067&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6069, Order: 168359, Start Time: 2012-11-20 10:09:34, End Time: 2012-11-20 11:43:16 To: 6067, Order: 168357, Start Time: 2012-11-20 08:11:53, End Time: 2012-11-20 09:45:34 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (6 on baseline) Performance Improvements: 0 (179 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1090 (857 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 5.53% (0.3582 => 0.3780, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.75% (54.4825 => 56.5259, std.dev.: 0.1197) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.57% (54.5751 => 56.5259, std.dev.: 0.1197) MultiSource/Benchmarks/llubenchmark/llu: 3.30% (3.7435 => 3.8671, std.dev.: 0.0426) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.00% (2.0478 => 2.1093, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4937 => 7.6766, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/hash2: 2.29% (3.1932 => 3.2662, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.77% (0.3821 => 0.3524, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.75% (0.9542 => 0.8898, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -6.68% (0.3831 => 0.3575, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.65% (0.3142 => 0.2933, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -6.65% (0.3896 => 0.3637, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.64% (0.3357 => 0.3134, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/trivial-interface: -6.64% (0.3812 => 0.3559, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-4: -6.62% (0.3880 => 0.3623, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.60% (0.3848 => 0.3594, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.59% (2.4924 => 2.3281, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: -6.52% (0.4033 => 0.3770, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.50% (0.3891 => 0.3638, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.49% (0.4176 => 0.3905, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -6.39% (0.2160 => 0.2022, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: -6.27% (9.2283 => 8.6500, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.24% (0.1796 => 0.1684, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.22% (0.9852 => 0.9239, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -6.19% (0.4199 => 0.3939, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.18% (0.3884 => 0.3644, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.16% (0.2355 => 0.2210, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: -6.16% (7.0961 => 6.6592, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.15% (0.6484 => 0.6085, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: -6.14% (16.1920 => 15.1975, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.01% (1.0544 => 0.9910, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.98% (6.7716 => 6.3669, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/football/football: -5.96% (0.9179 => 0.8632, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.90% (0.3658 => 0.3442, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.90% (1.3722 => 1.2913, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.89% (4.8161 => 4.5325, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/parameter-passing: -5.89% (0.4280 => 0.4028, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -5.85% (0.1879 => 0.1769, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.85% (0.1761 => 0.1658, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.84% (3.5339 => 3.3276, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -5.75% (0.3406 => 0.3210, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.75% (4.0323 => 3.8004, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/gs/gs: -5.74% (4.3330 => 4.0843, std.dev.: 0.0286) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.74% (1.6364 => 1.5425, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.73% (1.2300 => 1.1595, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.73% (4.8802 => 4.6007, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.71% (0.2695 => 0.2541, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.70% (0.7919 => 0.7468, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/bh/bh: -5.70% (0.2985 => 0.2815, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.69% (0.6736 => 0.6353, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.66% (0.6293 => 0.5937, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.65% (0.5857 => 0.5526, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.62% (4.5069 => 4.2536, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/05-eks/eks: -5.60% (0.4515 => 0.4262, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.60% (1.4642 => 1.3822, std.dev.: 0.0061) MultiSource/Applications/lemon/lemon: -5.60% (1.1450 => 1.0809, std.dev.: 0.0059) MultiSource/Applications/Burg/burg: -5.59% (1.2515 => 1.1815, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.57% (0.6052 => 0.5715, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.55% (0.5478 => 0.5174, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.54% (0.5863 => 0.5538, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.53% (0.6660 => 0.6292, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.52% (0.6667 => 0.6299, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.52% (0.5925 => 0.5598, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.52% (0.8521 => 0.8051, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.50% (0.5705 => 0.5391, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.50% (0.5859 => 0.5537, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.49% (0.6446 => 0.6092, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.49% (1.2784 => 1.2082, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.49% (0.5591 => 0.5284, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.49% (0.2659 => 0.2513, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.49% (0.6304 => 0.5958, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.48% (0.5805 => 0.5487, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.47% (0.5999 => 0.5671, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.46% (0.6297 => 0.5953, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.46% (0.6189 => 0.5851, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.46% (0.7198 => 0.6805, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.46% (0.2548 => 0.2409, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: -5.45% (1.1530 => 1.0902, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.44% (0.6230 => 0.5891, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.44% (0.5849 => 0.5531, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.43% (0.3483 => 0.3294, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.42% (0.6260 => 0.5921, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.39% (0.4916 => 0.4651, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.39% (14.2083 => 13.4429, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.38% (0.5802 => 0.5490, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.38% (0.6194 => 0.5861, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.35% (0.2428 => 0.2298, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.33% (0.5570 => 0.5273, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.33% (8.0126 => 7.5854, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.29% (0.5575 => 0.5280, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -5.29% (17.1032 => 16.1983, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.29% (0.5941 => 0.5627, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -5.28% (15.5079 => 14.6886, std.dev.: 0.0214) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.27% (0.2278 => 0.2158, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.26% (0.5456 => 0.5169, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: -5.26% (1.3864 => 1.3135, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.26% (0.5688 => 0.5389, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.24% (0.2999 => 0.2842, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.21% (0.3319 => 0.3146, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.15% (0.6676 => 0.6332, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: -5.14% (0.3581 => 0.3397, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: -5.14% (3.5154 => 3.3348, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.12% (1.6474 => 1.5631, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.07% (0.2385 => 0.2264, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.07% (0.5581 => 0.5298, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.06% (0.4151 => 0.3941, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -5.06% (4.0594 => 3.8541, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.05% (1.2210 => 1.1594, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.03% (1.2221 => 1.1606, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: -5.01% (1.3148 => 1.2489, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -4.97% (0.7447 => 0.7077, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.96% (0.3931 => 0.3736, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -4.96% (15.2527 => 14.4965, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.95% (0.5168 => 0.4912, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.95% (0.6440 => 0.6121, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.94% (0.3057 => 0.2906, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.93% (0.4321 => 0.4108, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (0.6681 => 0.6352, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: -4.91% (0.2871 => 0.2730, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.90% (22.4056 => 21.3085, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.89% (0.6033 => 0.5738, std.dev.: 0.0066) MultiSource/Applications/siod/siod: -4.88% (2.4021 => 2.2849, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -4.85% (2.1401 => 2.0362, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.85% (0.3837 => 0.3651, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.81% (0.7021 => 0.6683, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.81% (0.2933 => 0.2792, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.80% (0.6395 => 0.6088, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.80% (2.1713 => 2.0671, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: -4.79% (0.3025 => 0.2880, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -4.79% (0.3255 => 0.3099, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.78% (0.3323 => 0.3164, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.78% (0.7339 => 0.6988, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: -4.76% (0.2939 => 0.2799, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -4.76% (0.3194 => 0.3042, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -4.76% (0.3026 => 0.2882, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -4.76% (0.7779 => 0.7409, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.74% (0.7524 => 0.7167, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: -4.74% (0.3271 => 0.3116, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.72% (0.2903 => 0.2766, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.71% (0.3016 => 0.2874, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hello: -4.70% (0.2849 => 0.2715, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -4.68% (0.4248 => 0.4049, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -4.67% (0.4861 => 0.4634, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -4.67% (34.0927 => 32.5014, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/strcat: -4.65% (0.2989 => 0.2850, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -4.64% (0.3446 => 0.3286, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -4.63% (0.3481 => 0.3320, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.62% (0.3205 => 0.3057, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -4.57% (0.8418 => 0.8033, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary: -4.54% (0.3394 => 0.3240, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -4.53% (18.2933 => 17.4652, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.51% (0.4813 => 0.4596, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.51% (0.9077 => 0.8668, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists: -4.50% (0.3621 => 0.3458, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.48% (0.5329 => 0.5090, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.47% (0.5567 => 0.5318, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -4.47% (0.7982 => 0.7625, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.46% (0.9557 => 0.9131, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: -4.44% (0.6347 => 0.6065, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.43% (0.4083 => 0.3902, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.42% (0.3849 => 0.3679, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -4.42% (5.0226 => 4.8008, std.dev.: 0.0118) SingleSource/UnitTests/ObjC++/property-reference-object: -4.41% (0.6441 => 0.6157, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.40% (0.5569 => 0.5324, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.40% (0.3252 => 0.3109, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.33% (2.2587 => 2.1610, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: -4.32% (0.3867 => 0.3700, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.21% (0.6395 => 0.6126, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.20% (0.4427 => 0.4241, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.07% (0.3491 => 0.3349, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -3.99% (0.6750 => 0.6481, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: -3.96% (0.3788 => 0.3638, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -3.92% (0.3059 => 0.2939, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -3.76% (0.4524 => 0.4354, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: -3.50% (1.5610 => 1.5063, std.dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -2.11% (20.7746 => 20.3362, std.dev.: 0.0544) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7578, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: -8.66% (1.2842 => 1.1730, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.23% (1.3096 => 1.2542, std.dev.: 0.0214) SingleSource/Benchmarks/Misc/fbench: -3.90% (2.2633 => 2.1750, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.83% (1.7753 => 1.7073, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0245, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4683, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 04:14:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 06:14:42 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121120121442.61A912A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6070?compare_to=6064&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6070, Order: 168357, Start Time: 2012-11-20 08:54:33, End Time: 2012-11-20 12:15:06 To: 6064, Order: 168348, Start Time: 2012-11-20 04:38:21, End Time: 2012-11-20 07:59:18 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (170 on baseline) Performance Improvements: 2 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1089 (720 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.19% (2.3828 => 2.4111, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.44% (0.8354 => 0.8234, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.00% (2.3825 => 2.3586, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.56% (0.0625 => 0.0891, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.11% (0.1063 => 0.1415, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.34% (0.2969 => 0.3751, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.22% (0.1106 => 0.1396, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.63% (0.0714 => 0.0897, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 25.53% (1.5932 => 2.0000, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.18% (0.4253 => 0.5324, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.67% (0.4139 => 0.5160, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.37% (0.0475 => 0.0586, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.29% (0.0584 => 0.0720, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.25% (0.4994 => 0.6155, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.90% (0.5000 => 0.6145, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.85% (0.0547 => 0.0672, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.85% (0.5900 => 0.7248, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.19% (0.0897 => 0.1096, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 21.70% (0.0599 => 0.0729, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.45% (0.1021 => 0.1240, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.42% (0.1620 => 0.1967, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.32% (0.1107 => 0.1343, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.32% (0.3903 => 0.4696, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 20.25% (0.0948 => 0.1140, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.22% (0.1103 => 0.1326, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.09% (0.0642 => 0.0771, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.06% (0.0633 => 0.0760, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.03% (0.0584 => 0.0701, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 20.03% (0.0604 => 0.0725, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.88% (0.1549 => 0.1857, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 19.85% (0.0821 => 0.0984, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.74% (0.1003 => 0.1201, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.46% (0.0822 => 0.0982, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.45% (0.1604 => 0.1916, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 19.27% (0.1619 => 0.1931, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.22% (0.1462 => 0.1743, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 19.06% (0.0808 => 0.0962, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.82% (0.3890 => 0.4622, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 18.48% (0.0947 => 0.1122, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.07% (0.2014 => 0.2378, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.87% (0.2736 => 0.3225, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 17.82% (0.1218 => 0.1435, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.65% (0.1088 => 0.1280, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 17.62% (0.0698 => 0.0821, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.58% (1.3152 => 1.5464, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.38% (0.2866 => 0.3364, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 17.35% (0.4029 => 0.4728, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 17.34% (0.1505 => 0.1766, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.19% (0.0605 => 0.0709, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 17.16% (0.5826 => 0.6826, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 17.00% (0.5546 => 0.6489, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 16.91% (1.8794 => 2.1972, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.77% (0.1968 => 0.2298, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 16.76% (0.5889 => 0.6876, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.70% (0.4658 => 0.5436, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.57% (3.5627 => 4.1532, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.51% (0.3271 => 0.3811, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.41% (1.6211 => 1.8872, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.29% (0.1160 => 0.1349, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 16.09% (1.0781 => 1.2516, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/18-imp/imp: 16.05% (0.1421 => 0.1649, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.01% (0.4361 => 0.5059, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 15.82% (0.9697 => 1.1231, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.77% (4.4195 => 5.1163, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.73% (0.3930 => 0.4548, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: 15.65% (0.1284 => 0.1485, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.58% (0.5026 => 0.5809, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.55% (0.2875 => 0.3322, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.41% (0.1090 => 0.1258, std.dev.: 0.0043) MultiSource/Applications/ClamAV/clamscan: 15.39% (4.2109 => 4.8588, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/matrix: 15.11% (0.2780 => 0.3200, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.09% (2.7292 => 3.1409, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/except: 15.01% (0.2811 => 0.3233, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/football/football: 14.99% (0.2075 => 0.2386, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 14.94% (0.2738 => 0.3147, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.91% (1.9694 => 2.2630, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 14.85% (0.2714 => 0.3117, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 14.82% (0.7171 => 0.8234, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/fibo: 14.75% (0.2725 => 0.3127, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.69% (1.9966 => 2.2900, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/nestedloop: 14.66% (0.2729 => 0.3129, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 14.65% (0.2813 => 0.3225, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 14.61% (0.3004 => 0.3443, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 14.61% (0.9909 => 1.1357, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 14.58% (0.2750 => 0.3151, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.51% (0.2792 => 0.3197, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 14.50% (0.3096 => 0.3545, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 14.49% (0.2823 => 0.3232, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 14.48% (0.2803 => 0.3209, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 14.43% (23.5202 => 26.9138, std.dev.: 0.0139) MultiSource/Benchmarks/nbench/nbench: 14.42% (0.2566 => 0.2936, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.36% (0.2911 => 0.3329, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.18% (0.3195 => 0.3648, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.09% (2.0673 => 2.3586, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 13.93% (1.4269 => 1.6256, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 13.90% (0.3267 => 0.3721, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 13.78% (0.3258 => 0.3707, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.73% (0.3060 => 0.3480, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 13.72% (0.0758 => 0.0862) SingleSource/Benchmarks/Shootout-C++/ary2: 13.54% (0.3317 => 0.3766, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 13.51% (0.7875 => 0.8939, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.38% (0.3362 => 0.3812, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 13.30% (0.3678 => 0.4167, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 13.29% (0.3726 => 0.4221, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.28% (0.3124 => 0.3539, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 13.21% (2.1653 => 2.4514, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists: 13.17% (0.3348 => 0.3789, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.16% (0.3282 => 0.3714, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 13.10% (4.6177 => 5.2224, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.09% (0.2040 => 0.2307, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 13.00% (0.3477 => 0.3929, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.96% (0.3981 => 0.4497, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 12.83% (0.3625 => 0.4090, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.76% (0.3690 => 0.4161, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 12.69% (0.4146 => 0.4672, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 12.62% (2.1013 => 2.3664, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.59% (0.3845 => 0.4329, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 12.56% (0.4251 => 0.4785, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 12.52% (0.2691 => 0.3028, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/synchronized: 12.37% (0.3469 => 0.3898, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.33% (0.3446 => 0.3871, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.32% (0.3465 => 0.3892, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.30% (0.3496 => 0.3926, std.dev.: 0.0075) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.24% (0.3488 => 0.3915, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 12.20% (0.3460 => 0.3882, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.12% (0.3442 => 0.3859, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 12.05% (0.5012 => 0.5616, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.95% (0.3650 => 0.4086, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.89% (0.3643 => 0.4076, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 11.79% (0.3724 => 0.4163, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 11.77% (5.5417 => 6.1937, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.35% (0.1383 => 0.1540, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.28% (0.1028 => 0.1144, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 11.09% (0.3498 => 0.3886, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 10.98% (0.4847 => 0.5379, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.97% (0.6435 => 0.7141, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 10.64% (0.6634 => 0.7340, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.44% (0.2068 => 0.2284, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.31% (0.3084 => 0.3402, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.27% (0.2737 => 0.3018, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 10.19% (2.0346 => 2.2420, std.dev.: 0.0067) MultiSource/Applications/lemon/lemon: 10.00% (0.2391 => 0.2630, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.99% (0.2103 => 0.2313, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 9.86% (0.3336 => 0.3665, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.10% (0.5361 => 0.5849, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.79% (4.6926 => 5.1052, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.25% (0.7426 => 0.8039, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.24% (11.6398 => 12.5993, std.dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.18% (0.5584 => 0.6041, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 6.75% (11.9555 => 12.7623, std.dev.: 0.0176) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.06% (0.3792 => 0.3908, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 9.49% (0.2802 => 0.3068, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6104, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6723, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-2: 4.74% (1.8057 => 1.8913, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1674, std.dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6379, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1983, std.dev.: 0.0064) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2219, std.dev.: 0.0035) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3088, std.dev.: 0.0134) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2874, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5151, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581) MultiSource/Applications/lua/lua: 1.02% (50.0626 => 50.5757, std.dev.: 0.0147) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.64% (2.4764 => 2.4111, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.74% (25.4195 => 16.5893, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary2: -9.74% (0.2402 => 0.2168, std.dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9753, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7958, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9574, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.56% (11.2080 => 10.8092, std.dev.: 0.0037) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7730, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.62% (0.6293 => 0.6128, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: -2.59% (17.2379 => 16.7911, std.dev.: 0.0613) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.25% (41.7953 => 40.8529, std.dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5755, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4956, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.06% (105.3826 => 104.2657, std.dev.: 0.0182) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0458, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 04:36:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 06:36:21 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121120123621.8FCB62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6071?compare_to=6065&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6071, Order: 168357, Start Time: 2012-11-20 10:16:14, End Time: 2012-11-20 12:36:44 To: 6065, Order: 168355, Start Time: 2012-11-20 06:58:56, End Time: 2012-11-20 09:23:17 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 52 (132 on baseline) Performance Improvements: 6 (39 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1030 (716 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 15.61% (0.5921 => 0.6845, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 15.50% (0.5929 => 0.6848, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 15.46% (0.6889 => 0.7954, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.90% (0.6724 => 0.7726, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.83% (0.5805 => 0.6666, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 14.65% (0.6601 => 0.7568, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.64% (0.6885 => 0.7893, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 14.36% (0.7223 => 0.8260, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 14.18% (0.5798 => 0.6620, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 14.16% (0.8095 => 0.9241, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 13.96% (0.6439 => 0.7338, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.66% (0.6436 => 0.7315, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.38% (0.5918 => 0.6710, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 12.58% (0.7203 => 0.8109, std.dev.: 0.0219) MultiSource/Benchmarks/McCat/08-main/main: 12.04% (0.3147 => 0.3526, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.72% (0.1919 => 0.2144, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 11.53% (0.6218 => 0.6935, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 10.75% (0.0958 => 0.1061, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.65% (0.5251 => 0.5810, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 10.29% (0.1030 => 0.1136, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.59% (0.7386 => 0.8094, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 9.47% (0.1499 => 0.1641, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/04-bisect/bisect: 8.70% (0.1218 => 0.1324, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.61% (0.1336 => 0.1451, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.59% (0.6261 => 0.6736, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 7.29% (0.1688 => 0.1811, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 6.70% (0.4804 => 0.5126, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/09-vor/vor: 5.94% (0.3605 => 0.3819, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.48% (0.2207 => 0.2328, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.78% (0.7782 => 0.8154, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.85% (0.9630 => 1.0001, std.dev.: 0.0124) SingleSource/UnitTests/Vector/constpool: 3.63% (54.3093 => 56.2797, std.dev.: 0.5226) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.65% (8.2003 => 8.4173, std.dev.: 0.0557) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 1.97% (0.5378 => 0.5484, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: 1.75% (4.9677 => 5.0545, std.dev.: 0.0328) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: 114.89% (0.1048 => 0.2252, std.dev.: 0.0373) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 31.68% (0.3475 => 0.4576, std.dev.: 0.0140) MultiSource/Benchmarks/McCat/09-vor/vor: 20.99% (0.1191 => 0.1441, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.94% (15.3322 => 17.6232, std.dev.: 0.5841) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 13.15% (8.6941 => 9.8376, std.dev.: 0.0635) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.40% (1.7435 => 1.9248, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.28% (6.0817 => 6.5853, std.dev.: 0.0817) MultiSource/Benchmarks/NPB-serial/is/is: 5.75% (8.5558 => 9.0476, std.dev.: 0.0199) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.10% (1.5844 => 1.6335, std.dev.: 0.0186) MultiSource/Applications/lua/lua: 2.81% (27.1152 => 27.8768, std.dev.: 0.0745) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.43% (4.2425 => 4.3455, std.dev.: 0.0154) SingleSource/Benchmarks/CoyoteBench/huffbench: 2.32% (18.7766 => 19.2113, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.28% (4.8124 => 4.9220, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/fldry: 2.18% (1.9394 => 1.9816, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.82% (4.9626 => 5.0529, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.63% (7.2719 => 7.3905, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.46% (5.3917 => 5.4703, std.dev.: 0.0081) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -11.36% (0.4543 => 0.4027, std.dev.: 0.0165) MultiSource/Applications/lua/lua: -9.10% (4.8512 => 4.4098, std.dev.: 0.1087) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.11% (4.9139 => 4.6136, std.dev.: 0.1162) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.41% (0.7129 => 0.6886, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.49% (1.6293 => 1.5561, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: -1.01% (3.1413 => 3.1096, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.30% (0.1337 => 0.1341, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.71% (0.0421 => 0.0418, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0652 => 0.0652, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 2.54% (481.6941 => 493.9070, std.dev.: 0.3055) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/power/power: 43697.73% (1.1277 => 493.9070, std.dev.: 0.3055) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 219.83% (0.5229 => 1.6724, std.dev.: 0.0415) MultiSource/Applications/SPASS/SPASS: 21.47% (14.9895 => 18.2079, std.dev.: 0.1688) MultiSource/Applications/kimwitu++/kc: 51.24% (14.1553 => 21.4088, std.dev.: 0.0312) MultiSource/Benchmarks/MallocBench/gs/gs: 22.97% (4.1105 => 5.0545, std.dev.: 0.0328) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.55% (1.1048 => 1.5196, std.dev.: 0.0785) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 433.96% (7.1582 => 38.2217, std.dev.: 0.4237) SingleSource/Benchmarks/Misc-C++-EH/spirit: 75.53% (3.4629 => 6.0786, std.dev.: 0.4320) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.67% (0.6222 => 1.0308, std.dev.: 0.0669) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10493.06% (0.0720 => 7.6270, std.dev.: 0.3073) MultiSource/Applications/SIBsim4/SIBsim4: 3864200.00% (0.0001 => 3.8643, std.dev.: 0.0381) MultiSource/Applications/SPASS/SPASS: 14730600.00% (0.0001 => 14.7307, std.dev.: 0.8849) MultiSource/Applications/kimwitu++/kc: 53500.00% (0.0001 => 0.0536, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576400.00% (0.0001 => 0.5765, std.dev.: 0.0205) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10077100.00% (0.0001 => 10.0772, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5908000.00% (0.0001 => 5.9081, std.dev.: 0.7639) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1787.11% (1.1194 => 21.1243, std.dev.: 0.2805) MultiSource/Applications/ClamAV/clamscan: 66.37% (22.1758 => 36.8944, std.dev.: 0.7269) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.01% (2.9384 => 4.6136, std.dev.: 0.1162) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.12% (7.0540 => 10.9420, std.dev.: 0.2336) MultiSource/Benchmarks/FreeBench/distray/distray: 53.88% (0.1056 => 0.1625, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.84% (8.1363 => 12.2730, std.dev.: 0.1372) MultiSource/Applications/JM/lencod/lencod: 47.42% (21.9371 => 32.3398, std.dev.: 0.2505) SingleSource/Benchmarks/Misc/flops: 40.08% (0.1432 => 0.2006, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/almabench: 39.59% (0.0730 => 0.1019, std.dev.: 0.0034) SingleSource/UnitTests/vla: 39.15% (0.0355 => 0.0494, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 38.06% (0.2554 => 0.3526, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 35.35% (0.1584 => 0.2144, std.dev.: 0.0047) MultiSource/Benchmarks/Fhourstones/fhourstones: 34.99% (0.1566 => 0.2114, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 33.80% (0.0793 => 0.1061, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 30.93% (2.2969 => 3.0073, std.dev.: 0.0180) SingleSource/Benchmarks/BenchmarkGame/n-body: 30.83% (0.0746 => 0.0976, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/17-bintr/bintr: 30.37% (0.0675 => 0.0880, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 30.05% (0.0842 => 0.1095, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/messages-2: 29.31% (0.0662 => 0.0856, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 28.22% (0.0886 => 0.1136, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/15-trie/trie: 27.51% (0.0527 => 0.0672, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.95% (0.1337 => 0.1684, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 25.89% (0.4615 => 0.5810, std.dev.: 0.0091) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.31% (0.0648 => 0.0812, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/04-bisect/bisect: 24.67% (0.1062 => 0.1324, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 24.55% (0.7115 => 0.8862, std.dev.: 0.0338) SingleSource/Benchmarks/Stanford/Oscar: 24.37% (0.0636 => 0.0791, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 23.97% (0.8067 => 1.0001, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 23.82% (1.5859 => 1.9636, std.dev.: 0.0652) MultiSource/Benchmarks/BitBench/five11/five11: 23.63% (0.0567 => 0.0701, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 23.63% (0.2700 => 0.3338, std.dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.67% (0.1032 => 0.1266, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.28% (0.1029 => 0.1248, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.28% (0.5569 => 0.6754, std.dev.: 0.0194) MultiSource/Benchmarks/Olden/tsp/tsp: 20.85% (0.1175 => 0.1420, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 20.44% (14.3668 => 17.3033, std.dev.: 0.3176) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.20% (0.5860 => 0.7044, std.dev.: 0.0204) MultiSource/Benchmarks/McCat/09-vor/vor: 20.09% (0.3180 => 0.3819, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 19.84% (0.2430 => 0.2912, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/05-eks/eks: 19.24% (0.4299 => 0.5126, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-4: 18.91% (0.3543 => 0.4213, std.dev.: 0.0105) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.84% (0.1125 => 0.1337, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/perlin: 18.84% (0.0536 => 0.0637, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 18.47% (2.2024 => 2.6092, std.dev.: 0.1297) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.05% (0.0770 => 0.0909, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.95% (2.0665 => 2.4375, std.dev.: 0.0406) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.79% (4.2646 => 5.0234, std.dev.: 0.2072) MultiSource/Benchmarks/McCat/18-imp/imp: 17.79% (0.3423 => 0.4032, std.dev.: 0.0102) SingleSource/UnitTests/ObjC/exceptions: 17.35% (0.3828 => 0.4492, std.dev.: 0.0152) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.30% (0.8172 => 0.9586, std.dev.: 0.0201) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.14% (0.2065 => 0.2419, std.dev.: 0.0097) MultiSource/Applications/sqlite3/sqlite3: 16.85% (17.1811 => 20.0768, std.dev.: 0.2615) MultiSource/Benchmarks/Olden/em3d/em3d: 16.70% (0.1695 => 0.1978, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 16.60% (0.1163 => 0.1356, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 16.52% (0.0672 => 0.0783, std.dev.: 0.0029) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.26% (0.0953 => 0.1108, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/health/health: 16.25% (0.1268 => 0.1474, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.19% (0.0834 => 0.0969, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.76% (0.1117 => 0.1293, std.dev.: 0.0050) MultiSource/Applications/viterbi/viterbi: 15.69% (0.1555 => 0.1799, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.65% (4.9449 => 5.7189, std.dev.: 0.1945) SingleSource/Benchmarks/Shootout/matrix: 15.65% (0.0818 => 0.0946, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.58% (0.0770 => 0.0890, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.48% (0.2758 => 0.3185, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.37% (1.3050 => 1.5056, std.dev.: 0.0509) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.22% (0.9765 => 1.1251, std.dev.: 0.0553) MultiSource/Applications/spiff/spiff: 15.21% (0.7835 => 0.9027, std.dev.: 0.0359) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.20% (5.0018 => 5.7620, std.dev.: 0.1542) MultiSource/Benchmarks/NPB-serial/is/is: 15.16% (0.0719 => 0.0828, std.dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: 15.11% (10.3673 => 11.9342, std.dev.: 0.1424) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.00% (0.2107 => 0.2423, std.dev.: 0.0109) MultiSource/Benchmarks/Bullet/bullet: 14.97% (63.2438 => 72.7090, std.dev.: 0.0266) MultiSource/Applications/oggenc/oggenc: 14.93% (5.7591 => 6.6187, std.dev.: 0.2667) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.90% (0.3121 => 0.3586, std.dev.: 0.0164) SingleSource/UnitTests/ObjC/parameter-passing: 14.57% (0.3927 => 0.4499, std.dev.: 0.0212) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.45% (0.5981 => 0.6845, std.dev.: 0.0303) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.40% (0.2271 => 0.2598, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 14.04% (0.3441 => 0.3924, std.dev.: 0.0184) SingleSource/UnitTests/ObjC/trivial-interface: 13.99% (0.3473 => 0.3959, std.dev.: 0.0153) MultiSource/Applications/lua/lua: 13.88% (3.8723 => 4.4098, std.dev.: 0.1087) MultiSource/Benchmarks/mafft/pairlocalalign: 13.88% (9.4845 => 10.8010, std.dev.: 0.4186) SingleSource/UnitTests/ObjC/synchronized: 13.82% (0.3561 => 0.4053, std.dev.: 0.0189) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.69% (0.3543 => 0.4028, std.dev.: 0.0180) SingleSource/UnitTests/ObjC/exceptions-3: 13.65% (0.3516 => 0.3996, std.dev.: 0.0183) MultiSource/Applications/hbd/hbd: 13.57% (1.5603 => 1.7721, std.dev.: 0.0645) SingleSource/UnitTests/ObjC/exceptions-2: 13.53% (0.3497 => 0.3970, std.dev.: 0.0155) SingleSource/UnitTests/ObjC/for-in: 13.16% (0.3694 => 0.4180, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.54% (0.0933 => 0.1050, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.40% (0.4879 => 0.5484, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.01% (0.1906 => 0.2135, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.60% (0.4103 => 0.4579, std.dev.: 0.0178) SingleSource/UnitTests/ObjC++/Hello: 10.78% (0.5925 => 0.6564, std.dev.: 0.0227) SingleSource/UnitTests/SignlessTypes/rem: 10.75% (0.1144 => 0.1267, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.72% (7.9617 => 8.4173, std.dev.: 0.0557) SingleSource/UnitTests/Vector/constpool: 3.90% (54.1659 => 56.2797, std.dev.: 0.5226) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.39% (4.3953 => 11.0055, std.dev.: 0.0211) SingleSource/Benchmarks/Shootout-C++/methcall: 147.45% (5.3999 => 13.3622, std.dev.: 0.0114) MultiSource/Benchmarks/McCat/17-bintr/bintr: 115.92% (0.1043 => 0.2252, std.dev.: 0.0373) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 40.54% (0.3256 => 0.4576, std.dev.: 0.0140) SingleSource/UnitTests/ObjC/synchronized: 39.68% (0.1051 => 0.1468, std.dev.: 0.0150) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 31.14% (13.4384 => 17.6232, std.dev.: 0.5841) MultiSource/Benchmarks/McCat/09-vor/vor: 24.87% (0.1154 => 0.1441, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/oourafft: 17.50% (6.6465 => 7.8097, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.16% (1.1145 => 1.3058, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.84% (0.2944 => 0.3322, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.61% (2.8904 => 3.2261, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 11.56% (0.1298 => 0.1448, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 10.23% (1.1396 => 1.2562, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.29% (1.7254 => 1.8857, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 8.73% (3.1578 => 3.4336, std.dev.: 0.0966) MultiSource/Applications/lua/lua: 6.84% (26.0924 => 27.8768, std.dev.: 0.0745) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.94% (0.9540 => 1.0107, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.78% (4.2280 => 4.4725, std.dev.: 0.0108) SingleSource/Regression/C/uint64_to_float: 5.10% (0.5413 => 0.5689, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 5.01% (1.8329 => 1.9248, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.09% (11.6436 => 12.1202, std.dev.: 0.0151) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.32% (0.4162 => 0.4300, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.15% (1.5086 => 1.5561, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 2.96% (0.6223 => 0.6407, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/dry: 2.20% (2.4116 => 2.4646, std.dev.: 0.0106) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.16% (1.3677 => 1.3973, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 2.08% (3.1595 => 3.2252, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.91% (2.1424 => 2.1834, std.dev.: 0.0088) MultiSource/Benchmarks/PAQ8p/paq8p: 1.73% (85.0658 => 86.5340, std.dev.: 0.0736) MultiSource/Benchmarks/mafft/pairlocalalign: 1.59% (27.8444 => 28.2882, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.57% (6.5088 => 6.6109, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.33% (2.3135 => 2.3442, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/sieve: 1.32% (5.2139 => 5.2828, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0500, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.29% (6.6874 => 0.1811, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -75.41% (0.8651 => 0.2127, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.07% (5.2763 => 1.3155, std.dev.: 0.0366) SingleSource/Benchmarks/Misc/richards_benchmark: -44.76% (0.1622 => 0.0896, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.99% (5.3855 => 4.7937, std.dev.: 0.1275) MultiSource/Applications/JM/ldecod/ldecod: -10.87% (10.4361 => 9.3020, std.dev.: 0.4070) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.51% (5.3526 => 4.7900, std.dev.: 0.1305) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.20% (0.0628 => 0.0363) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.33% (0.3987 => 0.2379, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.36% (4.5009 => 2.7744, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -27.99% (10.7105 => 7.7126, std.dev.: 0.6579) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.17% (2.6546 => 2.0129, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -19.30% (0.2161 => 0.1744, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.70% (1.6925 => 1.4268, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.72% (2.6778 => 2.2837, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.82% (32.5116 => 28.9950, std.dev.: 0.0415) SingleSource/Benchmarks/Misc/mandel-2: -10.64% (1.5373 => 1.3737, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.00% (1.5660 => 1.4251, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.2416 => 3.0207, std.dev.: 0.0252) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7497) MultiSource/Benchmarks/NPB-serial/is/is: -5.40% (9.5636 => 9.0476, std.dev.: 0.0199) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5073, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -4.32% (6.2999 => 6.0279, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.70% (19.9488 => 19.2113, std.dev.: 0.0161) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.44% (0.9957 => 0.9614, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: -3.09% (5.0483 => 4.8921, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.33% (0.4808 => 0.4696, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.82% (8.1563 => 8.0080, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6772, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -1.49% (10.2830 => 10.1299, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.70% (0.1485 => 0.1341, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0013) Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 05:34:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 07:34:25 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121120133425.591562A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6072?compare_to=6068&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6072, Order: 168364, Start Time: 2012-11-20 11:59:42, End Time: 2012-11-20 13:34:49 To: 6068, Order: 168359, Start Time: 2012-11-20 10:06:22, End Time: 2012-11-20 11:42:47 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 5 (54 on baseline) Performance Improvements: 11 (21 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1038 (899 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/bc/bc: 2.90% (1.1431 => 1.1762, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.10% (0.9291 => 0.9486, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 21.27% (0.8689 => 1.0537, std.dev.: 0.0295) SingleSource/Benchmarks/Linpack/linpack-pc: 2.06% (53.7868 => 54.8951, std.dev.: 0.2091) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.66% (13.6069 => 13.8329, std.dev.: 0.0710) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: -39.18% (0.0462 => 0.0281, std.dev.: 0.0001) SingleSource/Regression/C++/global_ctor: -38.94% (0.0339 => 0.0207, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-2: -32.19% (0.0407 => 0.0276, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: -9.71% (0.4089 => 0.3692, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/ary3: -4.50% (0.2579 => 0.2463, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench: -25.57% (2.0122 => 1.4976, std.dev.: 0.1290) SingleSource/Benchmarks/Shootout-C++/heapsort: -18.36% (3.7630 => 3.0723, std.dev.: 0.2088) SingleSource/Benchmarks/Shootout/ary3: -7.39% (2.2612 => 2.0941, std.dev.: 0.0269) SingleSource/Benchmarks/Shootout-C++/ary3: -6.40% (2.1351 => 1.9984, std.dev.: 0.0430) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.26% (2.5890 => 2.5564, std.dev.: 0.0057) MultiSource/Applications/spiff/spiff: -1.19% (2.9081 => 2.8736, std.dev.: 0.0113) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.29% (1.0450 => 1.0898, std.dev.: 0.0073) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.95% (0.0228 => 0.0219, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.48% (0.0446 => 0.0426, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.78% (0.0344 => 0.0331, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.80% (0.0321 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.97% (0.0452 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -1.44% (0.0208 => 0.0205, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 19.67% (0.0183 => 0.0219, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -1.27% (0.1497 => 0.1478, std.dev.: 0.0154) MultiSource/Applications/lemon/lemon: -5.65% (1.2168 => 1.1481, std.dev.: 0.4317) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -7.50% (0.4534 => 0.4194, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.99% (0.1411 => 0.1397, std.dev.: 0.0431) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.91% (0.0640 => 0.0615, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.62% (0.0276 => 0.0266, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.21% (0.0612 => 0.0574, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.08% (1.1953 => 1.1963, std.dev.: 0.0085) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.62% (0.0644 => 0.0648, std.dev.: 0.0116) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.37% (0.0267 => 0.0266, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.44% (0.7775 => 0.7809, std.dev.: 0.0064) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -38.33% (0.0060 => 0.0037, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 9.25% (16.4461 => 17.9680, std.dev.: 0.7441) MultiSource/Applications/sqlite3/sqlite3: 2319.30% (0.6332 => 15.3190, std.dev.: 0.7508) MultiSource/Benchmarks/McCat/08-main/main: 49.65% (0.1831 => 0.2740, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.43% (0.1559 => 0.1490, std.dev.: 0.0473) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7109.06% (0.3123 => 22.5139, std.dev.: 0.9925) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.90% (0.2463 => 0.3692, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1524.01% (0.3344 => 5.4307, std.dev.: 0.0336) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.69% (0.2364 => 0.3255, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/bigfib: 4.08% (0.6010 => 0.6255, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/mandel: 2.56% (0.0429 => 0.0440, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.78% (0.3266 => 0.3422, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 2.89% (0.1969 => 0.2026, std.dev.: 0.0011) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.46% (0.0224 => 0.0234, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -27.83% (0.0230 => 0.0166, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0526, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 7.66% (0.1462 => 0.1574, std.dev.: 0.0290) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4698, std.dev.: 0.1099) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0691, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4953, std.dev.: 0.0937) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5150, std.dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.4976, std.dev.: 0.1290) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3220, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1399, std.dev.: 0.0503) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3623, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4018, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0796, std.dev.: 0.0045) SingleSource/Regression/C/uint64_to_float: -23.72% (2.1832 => 1.6653, std.dev.: 0.0324) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0008) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.09% (0.0848 => 0.0959, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 9.60% (0.1177 => 0.1290, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/em3d/em3d: 7.32% (0.1721 => 0.1847, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.24% (0.8359 => 0.8881, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.21% (0.5961 => 0.6331, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 5.60% (4.1305 => 4.3619, std.dev.: 0.0594) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.30% (1.1170 => 1.1762, std.dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.12% (0.6227 => 0.6546, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 4.95% (0.9039 => 0.9486, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.49% (8.6476 => 9.0355, std.dev.: 0.0756) MultiSource/Applications/lua/lua: 4.39% (3.8189 => 3.9864, std.dev.: 0.0529) MultiSource/Benchmarks/Prolangs-C/football/football: 3.99% (0.8768 => 0.9118, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.77% (0.8086 => 0.8391, std.dev.: 0.0102) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.66% (4.4880 => 4.6523, std.dev.: 0.0500) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.53% (0.3115 => 0.3225, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.43% (0.9069 => 0.9380, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.42% (0.4559 => 0.4715, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 3.36% (0.8069 => 0.8340, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.04% (0.8048 => 0.8293, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.01% (0.8317 => 0.8567, std.dev.: 0.0083) MultiSource/Applications/hexxagon/hexxagon: 2.91% (0.9810 => 1.0095, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.88% (0.8340 => 0.8580, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.68% (0.8518 => 0.8746, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 116.08% (0.0199 => 0.0430, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/pi: 58.84% (1.5795 => 2.5089, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.89% (0.8789 => 1.0537, std.dev.: 0.0295) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 19.47% (0.7597 => 0.9076, std.dev.: 0.0246) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.12% (2.9753 => 3.4548, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.70% (2.7995 => 3.2110, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.72% (5.0261 => 5.6151, std.dev.: 0.0206) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.09% (1.1857 => 1.2816, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.66% (6.3772 => 6.8659, std.dev.: 0.1839) SingleSource/Benchmarks/McGill/queens: 7.55% (1.7056 => 1.8343, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.69% (4.7794 => 5.0992, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 6.12% (3.1873 => 3.3825, std.dev.: 0.0390) SingleSource/Benchmarks/Misc/richards_benchmark: 5.89% (1.3037 => 1.3805, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.75% (4.9686 => 5.2542, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.17% (6.2275 => 6.5496, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.97% (3.3761 => 3.5439, std.dev.: 0.0575) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.16% (4.9469 => 5.1525, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.13% (4.9453 => 5.1493, std.dev.: 0.0205) MultiSource/Applications/hexxagon/hexxagon: 3.90% (14.0064 => 14.5524, std.dev.: 0.0351) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.52% (11.5690 => 11.8606, std.dev.: 0.0197) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.43% (1.1365 => 1.1641, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.38% (4.8660 => 4.9818, std.dev.: 0.0207) SingleSource/Benchmarks/Shootout/lists: 2.35% (7.3375 => 7.5099, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.10% (8.2783 => 8.4525, std.dev.: 0.0251) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.68% (2.4647 => 2.5062, std.dev.: 0.0130) SingleSource/Benchmarks/Stanford/FloatMM: 1.58% (0.8807 => 0.8946, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.49% (1.5941 => 1.6179, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: 1.33% (1.0841 => 1.0985, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 1.22% (1.2061 => 1.2208, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/ReedSolomon: 1.18% (8.5322 => 8.6327, std.dev.: 0.0258) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.05% (3.5679 => 3.6052, std.dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.91% (5.4641 => 4.3216, std.dev.: 0.0769) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.23% (7.2130 => 6.1864, std.dev.: 0.0884) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.81% (1.0512 => 0.9376, std.dev.: 0.0093) SingleSource/Benchmarks/McGill/chomp: -10.41% (1.1216 => 1.0048, std.dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: -8.51% (63.1822 => 57.8078, std.dev.: 0.1376) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.47% (4.7482 => 4.4412, std.dev.: 0.0301) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.82% (3.7148 => 3.4986, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.57% (5.4972 => 5.1909, std.dev.: 0.0278) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.55% (14.6451 => 13.8329, std.dev.: 0.0710) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.78% (5.1557 => 4.9095, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.35% (4.7449 => 4.5384, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.22% (2.8773 => 2.7560, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.74% (6.0224 => 5.7972, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.20% (0.5807 => 0.5621, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.01% (28.5821 => 27.7218, std.dev.: 0.0669) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.60% (2.6356 => 2.5671, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.25% (1.0388 => 1.0154, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash2: -2.23% (3.4237 => 3.3475, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.70% (11.5316 => 11.3355, std.dev.: 0.0370) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.57% (4.9994 => 4.9208, std.dev.: 0.0259) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.13% (5.6343 => 5.5706, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 6.20% (1.0262 => 1.0898, std.dev.: 0.0073) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 2.78% (0.1438 => 0.1478, std.dev.: 0.0154) MultiSource/Applications/lemon/lemon: 1.34% (1.1329 => 1.1481, std.dev.: 0.4317) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.72% (0.4164 => 0.4194, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.05% (0.1369 => 0.1397, std.dev.: 0.0431) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.06% (0.0641 => 0.0615, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 36.41% (0.0195 => 0.0266, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.69% (0.0578 => 0.0574, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.60% (1.1437 => 1.1963, std.dev.: 0.0085) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.35% (0.0627 => 0.0648, std.dev.: 0.0116) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.59% (0.8017 => 0.7809, std.dev.: 0.0064) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -40.32% (0.0062 => 0.0037, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 05:39:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 07:39:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121120133920.BCCE02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6073?compare_to=6069&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6073, Order: 168364, Start Time: 2012-11-20 12:06:11, End Time: 2012-11-20 13:39:45 To: 6069, Order: 168359, Start Time: 2012-11-20 10:09:34, End Time: 2012-11-20 11:43:16 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (6 on baseline) Performance Improvements: 1 (179 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1089 (857 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 5.32% (0.3780 => 0.3981, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.03% (78.1804 => 81.3348, std.dev.: 0.2597) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.09% (56.5259 => 54.7780, std.dev.: 0.3340) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 3.83% (0.3834 => 0.3981, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1007, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4937 => 7.6633, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hash2: 2.25% (3.1932 => 3.2651, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.03% (79.7170 => 81.3348, std.dev.: 0.2597) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.08% (0.1431 => 0.1301, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.24% (0.3821 => 0.3506, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.97% (0.9542 => 0.8877, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -6.92% (0.3831 => 0.3566, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.87% (0.3142 => 0.2926, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.87% (0.3812 => 0.3550, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -6.85% (0.3896 => 0.3629, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -6.85% (2.4924 => 2.3217, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -6.83% (0.3848 => 0.3585, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -6.83% (0.3880 => 0.3615) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.78% (0.3891 => 0.3627, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -6.77% (0.4033 => 0.3760, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -6.70% (0.4176 => 0.3896, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.54% (0.2355 => 0.2201, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -6.41% (0.4199 => 0.3930, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.38% (0.2428 => 0.2273, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -6.37% (9.2283 => 8.6404, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.36% (0.3884 => 0.3637, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.30% (6.7716 => 6.3449, std.dev.: 0.0085) MultiSource/Applications/JM/lencod/lencod: -6.30% (16.1920 => 15.1724, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.29% (0.1796 => 0.1683, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.26% (0.9852 => 0.9235, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.23% (0.3357 => 0.3148, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -6.19% (7.0961 => 6.6568, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.17% (0.6484 => 0.6084, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -6.14% (0.4280 => 0.4017, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.09% (1.3722 => 1.2886, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.09% (1.0544 => 0.9902, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -6.06% (0.9179 => 0.8623, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.02% (4.8161 => 4.5261, std.dev.: 0.0077) SingleSource/Benchmarks/McGill/chomp: -6.02% (0.1761 => 0.1655, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -6.01% (0.1879 => 0.1766, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.96% (3.5339 => 3.3232, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.96% (0.3658 => 0.3440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.95% (0.5863 => 0.5514, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.95% (0.5478 => 0.5152, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.94% (1.2300 => 1.1569, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -5.89% (4.3330 => 4.0777, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (4.0323 => 3.7948, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.87% (1.4642 => 1.3782, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.86% (1.6364 => 1.5405, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.86% (0.5805 => 0.5465, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.84% (4.8802 => 4.5951, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: -5.82% (1.2515 => 1.1787, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.81% (0.5925 => 0.5581, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -5.80% (0.4515 => 0.4253, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.80% (0.5705 => 0.5374, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.80% (0.6660 => 0.6274, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -5.79% (1.1450 => 1.0787, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.78% (0.5849 => 0.5511, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.78% (0.6230 => 0.5870, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.77% (0.7919 => 0.7462, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.77% (0.5857 => 0.5519, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.77% (0.6189 => 0.5832, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.76% (0.5802 => 0.5468, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.75% (0.2695 => 0.2540, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.74% (0.5591 => 0.5270, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.73% (0.5859 => 0.5523, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.73% (0.6667 => 0.6285, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.73% (0.8521 => 0.8033, std.dev.: 0.0058) MultiSource/Benchmarks/sim/sim: -5.73% (0.3406 => 0.3211, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: -5.72% (1.1530 => 1.0870, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.72% (0.6052 => 0.5706, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.70% (0.6293 => 0.5934, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.70% (0.6297 => 0.5938, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.70% (0.6736 => 0.6352, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.70% (0.5581 => 0.5263, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.69% (0.6260 => 0.5904, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.69% (0.5575 => 0.5258, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.64% (4.5069 => 4.2526, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.63% (0.6194 => 0.5845, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.62% (0.6304 => 0.5950, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.61% (1.2784 => 1.2067, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: -5.60% (0.2659 => 0.2510, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.60% (0.7198 => 0.6795, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.59% (0.5688 => 0.5370, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.57% (0.4916 => 0.4642, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.57% (0.6446 => 0.6087, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.57% (0.5570 => 0.5260, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.56% (0.2985 => 0.2819, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: -5.56% (0.2160 => 0.2040, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.55% (0.5456 => 0.5153, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.55% (0.5999 => 0.5666, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.53% (0.2548 => 0.2407, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.52% (14.2083 => 13.4235, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.49% (0.5941 => 0.5615, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.49% (0.2278 => 0.2153, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.48% (8.0126 => 7.5734, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/18-imp/imp: -5.47% (0.3581 => 0.3385, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.47% (0.2999 => 0.2835, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.45% (0.6676 => 0.6312, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.45% (1.2221 => 1.1555, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.43% (0.6681 => 0.6318, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.43% (0.3483 => 0.3294, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.42% (0.6440 => 0.6091, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -5.38% (17.1032 => 16.1829, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.36% (1.2210 => 1.1556, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: -5.35% (15.5079 => 14.6788, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.30% (0.6033 => 0.5713, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.29% (0.2871 => 0.2719, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -5.29% (3.5154 => 3.3295, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.27% (0.3057 => 0.2896, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.24% (0.2385 => 0.2260, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.24% (0.3837 => 0.3636, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.22% (2.1713 => 2.0580, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -5.21% (1.3864 => 1.3142, std.dev.: 0.0009) MultiSource/Applications/lua/lua: -5.20% (4.0594 => 3.8484, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.18% (0.3319 => 0.3147, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.17% (0.2903 => 0.2753, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -5.16% (1.3148 => 1.2470, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.14% (1.6474 => 1.5627, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: -5.14% (0.2939 => 0.2788, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.13% (0.3255 => 0.3088, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.11% (0.3016 => 0.2862, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.09% (0.3323 => 0.3154, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.07% (0.3194 => 0.3032, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: -5.06% (0.7447 => 0.7070, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.06% (0.7339 => 0.6968, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hello: -5.05% (0.2849 => 0.2705, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.05% (0.2933 => 0.2785, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -5.02% (0.3026 => 0.2874, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -5.02% (0.3446 => 0.3273, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.00% (0.4321 => 0.4105, std.dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.00% (0.2001 => 0.1901, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.00% (22.4056 => 21.2863, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.99% (0.5168 => 0.4910, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.99% (0.3205 => 0.3045, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -4.99% (0.3025 => 0.2874, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.98% (0.7524 => 0.7149, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -4.98% (2.4021 => 2.2824, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -4.97% (0.3481 => 0.3308, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -4.97% (0.4248 => 0.4037, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -4.96% (0.4861 => 0.4620, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -4.95% (0.2989 => 0.2841, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -4.92% (0.3394 => 0.3227, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.92% (0.3252 => 0.3092, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -4.91% (15.2527 => 14.5039, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.83% (0.6395 => 0.6086, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.83% (0.7021 => 0.6682, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.82% (0.4813 => 0.4581, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -4.81% (0.3621 => 0.3447, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.75% (0.4083 => 0.3889, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -4.74% (0.3271 => 0.3116, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.73% (0.3849 => 0.3667, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -4.72% (2.1401 => 2.0391, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.71% (0.6395 => 0.6094, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -4.68% (0.8418 => 0.8024, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.67% (0.5329 => 0.5080, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.67% (0.5567 => 0.5307, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.65% (0.5569 => 0.5310, std.dev.: 0.0100) MultiSource/Benchmarks/Bullet/bullet: -4.61% (34.0927 => 32.5218, std.dev.: 0.0106) MultiSource/Applications/oggenc/oggenc: -4.60% (5.0226 => 4.7914, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/lists1: -4.60% (0.3867 => 0.3689, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -4.55% (18.2933 => 17.4617, std.dev.: 0.0173) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.51% (0.9557 => 0.9126, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.48% (0.9077 => 0.8670, std.dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference: -4.46% (0.7779 => 0.7432, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.45% (0.4427 => 0.4230, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -4.40% (0.7982 => 0.7631, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -4.37% (0.6750 => 0.6455, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.37% (2.2587 => 2.1601, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: -4.36% (0.6441 => 0.6160, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.35% (0.6347 => 0.6071, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -4.25% (0.3059 => 0.2929, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -4.17% (0.3788 => 0.3630, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -4.10% (1.5610 => 1.4970, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.04% (0.3491 => 0.3350, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -4.02% (0.4524 => 0.4342, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.58% (5.4682 => 5.2726, std.dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -2.98% (20.7746 => 20.1556, std.dev.: 0.0174) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7565, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -8.76% (1.2842 => 1.1717, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: -4.10% (2.2633 => 2.1706, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4740, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 07:23:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 09:23:40 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121120152340.6BA692A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6074?compare_to=6072&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6074, Order: 168367, Start Time: 2012-11-20 13:52:31, End Time: 2012-11-20 15:24:05 To: 6072, Order: 168364, Start Time: 2012-11-20 11:59:42, End Time: 2012-11-20 13:34:49 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 1 (78 on baseline) Performance Improvements: 16 (24 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1037 (872 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.18% (4.0741 => 4.1223, std.dev.: 0.0144) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -3.61% (0.9241 => 0.8907, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.46% (0.8881 => 0.8574, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -2.53% (4.7809 => 4.6599, std.dev.: 0.0145) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.33% (1.2352 => 1.2064, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.20% (0.8683 => 0.8492, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.81% (0.9481 => 0.9309, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.76% (0.9193 => 0.9031, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.71% (0.9108 => 0.8952, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -1.71% (0.8265 => 0.8124, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -1.60% (0.8648 => 0.8510, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: -1.35% (1.1779 => 1.1620, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.31% (0.8391 => 0.8281, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.25% (1.2833 => 1.2672, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.22% (0.9017 => 0.8907, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: -1.77% (2.9219 => 2.8701, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout/hash: -1.19% (4.3180 => 4.2668, std.dev.: 0.0103) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.99% (1.0898 => 1.0681, std.dev.: 0.1662) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0219 => 0.0219, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.70% (0.0426 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -17.52% (0.0331 => 0.0273, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0312 => 0.0311, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.47% (0.0425 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0205 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -0.91% (0.0219 => 0.0217, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -0.47% (0.1478 => 0.1471, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 3.37% (1.1481 => 1.1868, std.dev.: 0.2247) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.29% (0.4194 => 0.4098, std.dev.: 0.0167) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.08% (0.1397 => 0.1426, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.76% (0.0615 => 0.0555, std.dev.: 0.0207) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.65% (0.0266 => 0.0235, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.74% (0.0574 => 0.0564, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.48% (1.1963 => 1.2021, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -51.61% (0.0031 => 0.0015, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -70.37% (0.0027 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.41% (0.0648 => 0.0587, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.38% (0.0266 => 0.0265, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.33% (0.7809 => 0.7783, std.dev.: 0.0045) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 37.84% (0.0037 => 0.0051, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.22% (16.4461 => 17.6330, std.dev.: 0.7002) MultiSource/Applications/sqlite3/sqlite3: 2329.77% (0.6332 => 15.3853, std.dev.: 0.8244) MultiSource/Benchmarks/McCat/08-main/main: 48.77% (0.1831 => 0.2724, std.dev.: 0.0841) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.54% (0.1559 => 0.1457, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7092.25% (0.3123 => 22.4614, std.dev.: 0.2175) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.67% (0.2463 => 0.3711, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1519.68% (0.3344 => 5.4162, std.dev.: 0.2722) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.49% (0.2364 => 0.3203, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/bigfib: 3.79% (0.6010 => 0.6238, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0429 => 0.0439, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.53% (0.3266 => 0.3414, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/strcat: 3.05% (0.1969 => 0.2029, std.dev.: 0.0011) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.91% (0.0224 => 0.0235, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0450, std.dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 10.33% (0.1462 => 0.1613, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4740, std.dev.: 0.0606) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0706, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4867, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5109, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.4832, std.dev.: 0.0718) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3164, std.dev.: 0.0454) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1367, std.dev.: 0.0165) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3634, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4100, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0857, std.dev.: 0.0011) SingleSource/Regression/C/uint64_to_float: -23.96% (2.1832 => 1.6600, std.dev.: 0.0008) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.64% (0.0810 => 0.0961, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.68% (0.0848 => 0.0964, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.97% (0.8321 => 0.8901, std.dev.: 0.0096) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.05% (0.1885 => 0.1999, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.85% (0.1983 => 0.2099, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 4.30% (1.9948 => 2.0805, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.97% (0.4783 => 0.4973, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.95% (1.1606 => 1.2064, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.87% (0.8317 => 0.8639, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.61% (0.8597 => 0.8907, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.47% (0.8204 => 0.8489, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.38% (0.8697 => 0.8991, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.36% (0.3717 => 0.3842, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.29% (0.8457 => 0.8735, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.21% (1.2526 => 1.2928, std.dev.: 0.0074) MultiSource/Benchmarks/nbench/nbench: 3.10% (1.1271 => 1.1620, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.05% (0.8007 => 0.8251, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.88% (0.9688 => 0.9967, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.84% (0.9908 => 1.0189, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.79% (0.8286 => 0.8517, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.78% (0.9069 => 0.9321, std.dev.: 0.0050) MultiSource/Benchmarks/Bullet/bullet: 2.77% (31.8598 => 32.7437, std.dev.: 0.1558) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.72% (0.8855 => 0.9096, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.71% (0.8716 => 0.8952, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.59% (0.9074 => 0.9309, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.57% (0.8359 => 0.8574, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.57% (0.8805 => 0.9031, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 2.53% (6.7320 => 6.9025, std.dev.: 0.0315) MultiSource/Benchmarks/PAQ8p/paq8p: 2.50% (2.3764 => 2.4358, std.dev.: 0.0185) MultiSource/Applications/JM/lencod/lencod: 2.49% (15.3280 => 15.7091, std.dev.: 0.1222) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.47% (0.8331 => 0.8537, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.45% (0.8927 => 0.9146, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.42% (0.7932 => 0.8124, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.41% (0.8656 => 0.8865, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.41% (4.4873 => 4.5956, std.dev.: 0.0313) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.41% (0.8086 => 0.8281, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.36% (0.7966 => 0.8154, std.dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: 2.32% (8.6247 => 8.8251, std.dev.: 0.0599) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.31% (0.8261 => 0.8452, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.30% (0.8420 => 0.8614, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.28% (0.8066 => 0.8250, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.24% (0.8712 => 0.8907, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.24% (0.8048 => 0.8228, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.18% (0.8518 => 0.8704, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.12% (0.8316 => 0.8492, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.06% (0.8338 => 0.8510, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.00% (1.2423 => 1.2672, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.96% (4.5702 => 4.6599, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.96% (1.4479 => 1.4763, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.65% (0.8885 => 0.9032, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 115.58% (0.0199 => 0.0429, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/pi: 57.56% (1.5795 => 2.4886, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.69% (0.7597 => 0.8941, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.56% (2.9753 => 3.4681, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.72% (2.7995 => 3.2115, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6091, std.dev.: 0.0116) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.10% (1.1857 => 1.2817, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 7.51% (1.7056 => 1.8337, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/richards_benchmark: 6.87% (1.3037 => 1.3932, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.80% (4.7794 => 5.1042, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.89% (4.9686 => 5.2613, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.85% (4.5327 => 4.7980, std.dev.: 0.0334) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.54% (6.2275 => 6.5102, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.50% (3.3761 => 3.5281, std.dev.: 0.0084) MultiSource/Applications/lambda-0_1_3/lambda: 4.30% (7.4933 => 7.8157, std.dev.: 0.0703) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.17% (4.9453 => 5.1514, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.99% (4.9469 => 5.1445, std.dev.: 0.0552) MultiSource/Applications/hexxagon/hexxagon: 3.87% (14.0064 => 14.5484, std.dev.: 0.0282) MultiSource/Applications/siod/siod: 2.90% (3.6643 => 3.7707, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.87% (11.5690 => 11.9011, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.69% (8.2783 => 8.5014, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.59% (4.8362 => 4.9616, std.dev.: 0.0304) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.40% (4.8660 => 4.9828, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.24% (1.5941 => 1.6298, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/lists: 2.15% (7.3375 => 7.4953, std.dev.: 0.0145) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.85% (4.0473 => 4.1223, std.dev.: 0.0144) MultiSource/Benchmarks/FreeBench/neural/neural: 1.33% (1.0841 => 1.0985, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.21% (2.4647 => 2.4946, std.dev.: 0.0082) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.10% (5.4641 => 4.3110, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.94% (7.2130 => 6.1351, std.dev.: 0.1150) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.84% (1.0512 => 0.9372, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/chomp: -10.48% (1.1216 => 1.0041, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: -8.48% (63.1822 => 57.8246, std.dev.: 0.0445) SingleSource/Benchmarks/Shootout/heapsort: -8.22% (3.2926 => 3.0219, std.dev.: 0.0803) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.26% (14.6451 => 13.5816, std.dev.: 0.1004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.96% (4.7482 => 4.4176, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.33% (0.3269 => 0.3062, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.85% (3.7148 => 3.4973, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.78% (5.4972 => 5.1792, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.06% (5.1557 => 4.8950, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.40% (4.7449 => 4.5361, std.dev.: 0.0142) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.23% (2.4490 => 2.3455, std.dev.: 0.0288) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.79% (6.0224 => 5.7939, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.49% (2.8773 => 2.7769, std.dev.: 0.0282) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.73% (2.6356 => 2.5637, std.dev.: 0.0078) MultiSource/Applications/aha/aha: -2.46% (3.3398 => 3.2578, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.33% (9.9065 => 9.6757, std.dev.: 0.0364) SingleSource/Benchmarks/Shootout-C++/hash2: -2.27% (3.4237 => 3.3459, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.00% (11.5316 => 11.3006, std.dev.: 0.0076) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.89% (2.3487 => 2.3044, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.76% (4.9994 => 4.9115, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.15% (5.6343 => 5.5696, std.dev.: 0.0204) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.08% (1.0262 => 1.0681, std.dev.: 0.1662) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.68% (0.0408 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 7.48% (0.0254 => 0.0273, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.98% (0.0302 => 0.0311, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 2.29% (0.1438 => 0.1471, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 4.76% (1.1329 => 1.1868, std.dev.: 0.2247) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.59% (0.4164 => 0.4098, std.dev.: 0.0167) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.16% (0.1369 => 0.1426, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -13.42% (0.0641 => 0.0555, std.dev.: 0.0207) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 20.51% (0.0195 => 0.0235, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.42% (0.0578 => 0.0564, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.11% (1.1437 => 1.2021, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1400.00% (0.0001 => 0.0015, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -42.86% (0.0014 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.38% (0.0627 => 0.0587, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.22% (0.0180 => 0.0265, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.92% (0.8017 => 0.7783, std.dev.: 0.0045) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -17.74% (0.0062 => 0.0051, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 07:35:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 09:35:44 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121120153544.860BF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6075?compare_to=6073&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6075, Order: 168367, Start Time: 2012-11-20 14:02:43, End Time: 2012-11-20 15:36:09 To: 6073, Order: 168364, Start Time: 2012-11-20 12:06:11, End Time: 2012-11-20 13:39:45 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 1 (181 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (857 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.92% (81.3348 => 78.9631, std.dev.: 0.8661) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.69% (7.4937 => 7.6950, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.67% (2.0478 => 2.1024, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash2: 2.10% (3.1932 => 3.2604, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.15% (0.1431 => 0.1300, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.24% (0.3821 => 0.3506, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.01% (0.9542 => 0.8873, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.94% (0.3831 => 0.3565, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -6.91% (0.3880 => 0.3612, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -6.89% (0.3848 => 0.3583, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.88% (0.3896 => 0.3628, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -6.85% (2.4924 => 2.3217, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.84% (0.3142 => 0.2927, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -6.79% (0.3812 => 0.3553, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -6.79% (0.4033 => 0.3759, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.73% (0.4176 => 0.3895, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.63% (0.3891 => 0.3633, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.45% (0.2355 => 0.2203, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/property: -6.45% (0.4199 => 0.3928, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -6.44% (0.2160 => 0.2021, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -6.43% (0.3357 => 0.3141, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.36% (0.3884 => 0.3637, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.34% (0.2428 => 0.2274, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -6.29% (16.1920 => 15.1731, std.dev.: 0.0157) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.29% (0.1796 => 0.1683, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.28% (0.6484 => 0.6077, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.25% (6.7716 => 6.3484, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -6.24% (9.2283 => 8.6520, std.dev.: 0.0080) MultiSource/Applications/JM/ldecod/ldecod: -6.20% (7.0961 => 6.6560, std.dev.: 0.0138) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.20% (0.9852 => 0.9241, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -6.17% (0.4280 => 0.4016, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.13% (1.0544 => 0.9898, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.06% (4.0323 => 3.7880, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/football/football: -6.04% (0.9179 => 0.8625, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: -6.01% (0.1879 => 0.1766, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.00% (0.1716 => 0.1613, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.00% (4.8161 => 4.5273, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.99% (0.5863 => 0.5512, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -5.96% (0.1761 => 0.1656, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.93% (3.5339 => 3.3244, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.91% (0.5805 => 0.5462, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.90% (0.3658 => 0.3442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.88% (0.5849 => 0.5505, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.87% (0.5859 => 0.5515, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.87% (1.3722 => 1.2917, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.86% (1.2300 => 1.1579, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.86% (0.5478 => 0.5157, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.85% (4.8802 => 4.5947, std.dev.: 0.0133) MultiSource/Benchmarks/MallocBench/gs/gs: -5.84% (4.3330 => 4.0801, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/05-eks/eks: -5.83% (0.4515 => 0.4252, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.82% (1.6364 => 1.5411, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.81% (0.5857 => 0.5517, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.78% (0.5705 => 0.5375, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.77% (0.7919 => 0.7462, std.dev.: 0.0091) MultiSource/Benchmarks/nbench/nbench: -5.77% (1.1530 => 1.0865, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -5.76% (1.2515 => 1.1794, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.74% (0.5925 => 0.5585, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.73% (1.4642 => 1.3803, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.72% (0.5575 => 0.5256, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -5.72% (1.1450 => 1.0795, std.dev.: 0.0116) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.70% (0.6736 => 0.6352, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.69% (0.5591 => 0.5273, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.69% (0.6297 => 0.5939, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.68% (0.7198 => 0.6789, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.68% (0.6304 => 0.5946, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.68% (0.2695 => 0.2542, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.68% (0.6660 => 0.6282, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.67% (0.6189 => 0.5838, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.65% (0.5802 => 0.5474, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.65% (0.6052 => 0.5710, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.65% (0.6230 => 0.5878, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.64% (0.5581 => 0.5266, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.64% (0.6667 => 0.6291, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.64% (0.5570 => 0.5256, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.63% (0.8521 => 0.8041, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.63% (0.6446 => 0.6083, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/bh/bh: -5.63% (0.2985 => 0.2817, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.61% (0.6293 => 0.5940, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.61% (4.5069 => 4.2541, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: -5.61% (0.3406 => 0.3215, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.61% (0.6260 => 0.5909, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.60% (0.6194 => 0.5847, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.57% (0.5941 => 0.5610, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.55% (1.2784 => 1.2074, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.55% (0.5456 => 0.5153, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.53% (0.2278 => 0.2152, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.50% (1.2210 => 1.1538, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.50% (0.5688 => 0.5375, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.50% (0.2999 => 0.2834, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.49% (0.2548 => 0.2408, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.47% (14.2083 => 13.4304, std.dev.: 0.0168) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.47% (1.2221 => 1.1552, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.45% (8.0126 => 7.5758, std.dev.: 0.0113) MultiSource/Benchmarks/McCat/18-imp/imp: -5.45% (0.3581 => 0.3386, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.40% (0.5999 => 0.5675, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.39% (0.4916 => 0.4651, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.37% (0.4151 => 0.3928, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: -5.36% (1.3864 => 1.3121, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.36% (0.6681 => 0.6323, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: -5.35% (15.5079 => 14.6786, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.35% (0.6676 => 0.6319, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.34% (0.3931 => 0.3721, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.34% (0.6440 => 0.6096, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.34% (0.3483 => 0.3297, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -5.32% (1.3148 => 1.2448, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.32% (0.3837 => 0.3633, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.30% (0.3319 => 0.3143, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -5.28% (3.5154 => 3.3298, std.dev.: 0.0120) MultiSource/Applications/sqlite3/sqlite3: -5.27% (17.1032 => 16.2012, std.dev.: 0.0112) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.24% (0.2385 => 0.2260, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.23% (0.3057 => 0.2897, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.23% (0.2659 => 0.2520, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.22% (0.2871 => 0.2721, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -5.22% (0.3025 => 0.2867, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.22% (0.4813 => 0.4562, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: -5.18% (0.7447 => 0.7061, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.17% (0.3016 => 0.2860, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.17% (2.1713 => 2.0591, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/objinst: -5.17% (0.3194 => 0.3029, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.13% (0.2903 => 0.2754, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.11% (0.2933 => 0.2783, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.10% (0.3255 => 0.3089, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: -5.09% (0.2849 => 0.2704, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.09% (0.6033 => 0.5726, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: -5.09% (0.3205 => 0.3042, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.09% (0.3323 => 0.3154, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.08% (1.6474 => 1.5637, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -5.07% (0.2939 => 0.2790, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary3: -5.05% (0.3446 => 0.3272, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -5.02% (0.2989 => 0.2839, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.01% (0.5168 => 0.4909, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.01% (0.7524 => 0.7147, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: -4.98% (0.3394 => 0.3225, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -4.97% (15.2527 => 14.4940, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/except: -4.96% (0.3026 => 0.2876, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.94% (0.6395 => 0.6079, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -4.94% (0.3481 => 0.3309, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -4.93% (2.4021 => 2.2836, std.dev.: 0.0011) MultiSource/Applications/lua/lua: -4.93% (4.0594 => 3.8592, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash2: -4.90% (0.4861 => 0.4623, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.89% (0.7339 => 0.6980, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.89% (0.2106 => 0.2003, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.88% (22.4056 => 21.3124, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/moments: -4.87% (0.4248 => 0.4041, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.85% (0.5567 => 0.5297, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.80% (0.7021 => 0.6684, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -4.80% (2.1401 => 2.0374, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.78% (0.4083 => 0.3888, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -4.75% (0.3621 => 0.3449, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -4.74% (0.7982 => 0.7604, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: -4.71% (0.3271 => 0.3117, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.67% (0.5569 => 0.5309, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.67% (0.9557 => 0.9111, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.64% (0.5329 => 0.5082, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.63% (0.6395 => 0.6099, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: -4.61% (5.0226 => 4.7913, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -4.60% (34.0927 => 32.5243, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.55% (0.3252 => 0.3104, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.53% (0.7779 => 0.7427, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -4.52% (18.2933 => 17.4667, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.47% (0.3849 => 0.3677, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.46% (0.9077 => 0.8672, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/Hello: -4.46% (0.6347 => 0.6064, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.45% (0.3867 => 0.3695, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -4.38% (0.8418 => 0.8049, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.38% (0.4427 => 0.4233, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -4.38% (0.6441 => 0.6159, std.dev.: 0.0057) SingleSource/Regression/C++/ofstream_ctor: -4.35% (0.3059 => 0.2926, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.30% (2.2587 => 2.1616, std.dev.: 0.0180) SingleSource/Benchmarks/Misc-C++/bigfib: -4.27% (0.6750 => 0.6462, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -4.17% (0.3788 => 0.3630, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.15% (0.3491 => 0.3346, std.dev.: 0.0048) MultiSource/Applications/hbd/hbd: -4.07% (1.5610 => 1.4975, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash: -3.93% (0.4524 => 0.4346, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.57% (5.4682 => 5.2730, std.dev.: 0.0167) SingleSource/UnitTests/Vector/constpool: -2.74% (20.7746 => 20.2052, std.dev.: 0.0196) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7548, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/richards_benchmark: -8.61% (1.2842 => 1.1736) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7069, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.75% (2.2633 => 2.1784, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.71% (1.3096 => 1.2741, std.dev.: 0.0087) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.63% (6.5735 => 6.4664, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 07:46:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 09:46:57 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121120154657.C7B8E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6076?compare_to=6071&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6076, Order: 168364, Start Time: 2012-11-20 13:26:58, End Time: 2012-11-20 15:47:21 To: 6071, Order: 168357, Start Time: 2012-11-20 10:16:14, End Time: 2012-11-20 12:36:44 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 44 (131 on baseline) Performance Improvements: 6 (39 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1038 (717 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 17.95% (0.6680 => 0.7879, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 16.71% (0.6302 => 0.7355, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 15.74% (0.7874 => 0.9113, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 15.33% (0.5918 => 0.6825, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 12.68% (0.6244 => 0.7036, std.dev.: 0.0159) MultiSource/Applications/lambda-0_1_3/lambda: 12.50% (0.8570 => 0.9641, std.dev.: 0.0251) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 12.14% (0.1293 => 0.1450, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 11.93% (1.3328 => 1.4918, std.dev.: 0.0248) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.03% (0.6889 => 0.7649, std.dev.: 0.0232) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.50% (0.1038 => 0.1147, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.10% (4.3734 => 4.8151, std.dev.: 0.0709) SingleSource/Benchmarks/Misc/ReedSolomon: 9.96% (0.2198 => 0.2417, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.86% (0.4197 => 0.4611, std.dev.: 0.0089) SingleSource/UnitTests/ObjC/parameter-passing: 9.85% (0.4499 => 0.4942, std.dev.: 0.0062) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.48% (0.3586 => 0.3926, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.31% (0.4028 => 0.4403, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 9.24% (0.3214 => 0.3511, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/for-in: 9.07% (0.4180 => 0.4559, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.85% (0.2419 => 0.2633, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.63% (0.4579 => 0.4974, std.dev.: 0.0128) SingleSource/UnitTests/ObjC/property: 8.41% (0.4436 => 0.4809, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.38% (0.2135 => 0.2314, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions-3: 8.28% (0.3996 => 0.4327, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-2: 8.16% (0.3970 => 0.4294, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/synchronized: 7.18% (0.4053 => 0.4344, std.dev.: 0.0091) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 6.99% (0.1474 => 0.1577, std.dev.: 0.0036) MultiSource/Applications/d/make_dparser: 6.96% (3.8088 => 4.0740, std.dev.: 0.0917) SingleSource/UnitTests/ObjC++/Hello: 6.69% (0.6564 => 0.7003, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.42% (0.4035 => 0.4294, std.dev.: 0.0088) SingleSource/UnitTests/ObjC/exceptions: 5.54% (0.4492 => 0.4741, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 5.50% (0.6694 => 0.7062, std.dev.: 0.0124) MultiSource/Applications/SIBsim4/SIBsim4: 3.83% (1.6724 => 1.7365, std.dev.: 0.0192) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.57% (21.1243 => 21.8777, std.dev.: 0.0328) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.98% (1.3155 => 1.3415, std.dev.: 0.0083) MultiSource/Applications/SPASS/SPASS: 1.81% (18.2079 => 18.5379, std.dev.: 0.0549) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 5.19% (5.2152 => 5.4861, std.dev.: 0.0664) MultiSource/Applications/siod/siod: 2.85% (3.3016 => 3.3956, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 2.68% (7.2998 => 7.4954, std.dev.: 0.0392) MultiSource/Applications/SIBsim4/SIBsim4: 2.21% (3.8643 => 3.9497, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.49% (2.1363 => 2.1681, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.19% (4.0878 => 4.1365, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.10% (61.4685 => 62.1436, std.dev.: 0.1202) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.05% (4.0945 => 4.1375, std.dev.: 0.0166) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.02% (2.1834 => 2.2056, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -13.83% (0.6845 => 0.5898, std.dev.: 0.0325) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -13.19% (0.7568 => 0.6570, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -13.08% (0.8260 => 0.7180, std.dev.: 0.0360) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -11.58% (0.8109 => 0.7170, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -10.82% (0.2144 => 0.1912, std.dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.85% (0.5810 => 0.5238, std.dev.: 0.0132) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.22% (0.1341 => 0.1338, std.dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0418 => 0.0418, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0652 => 0.0653, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 0.02% (493.9070 => 494.0280, std.dev.: 0.2137) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/power/power: 43708.46% (1.1277 => 494.0280, std.dev.: 0.2137) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 232.09% (0.5229 => 1.7365, std.dev.: 0.0192) MultiSource/Applications/SPASS/SPASS: 23.67% (14.9895 => 18.5379, std.dev.: 0.0549) MultiSource/Applications/kimwitu++/kc: 50.08% (14.1553 => 21.2438, std.dev.: 0.3517) MultiSource/Benchmarks/MallocBench/gs/gs: 17.23% (4.1105 => 4.8187, std.dev.: 0.2369) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.75% (1.1048 => 1.5219, std.dev.: 0.0741) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 426.39% (7.1582 => 37.6800, std.dev.: 0.4078) SingleSource/Benchmarks/Misc-C++-EH/spirit: 78.47% (3.4629 => 6.1801, std.dev.: 0.4290) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.38% (0.6222 => 1.0290, std.dev.: 0.0705) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10425.14% (0.0720 => 7.5781, std.dev.: 0.0965) MultiSource/Applications/SIBsim4/SIBsim4: 3949600.00% (0.0001 => 3.9497, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 14305900.00% (0.0001 => 14.3060, std.dev.: 1.0060) MultiSource/Applications/kimwitu++/kc: 52500.00% (0.0001 => 0.0526, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576300.00% (0.0001 => 0.5764, std.dev.: 0.0249) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10092400.00% (0.0001 => 10.0925, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6378400.00% (0.0001 => 6.3785, std.dev.: 0.4607) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1854.41% (1.1194 => 21.8777, std.dev.: 0.0328) MultiSource/Applications/ClamAV/clamscan: 66.18% (22.1758 => 36.8509, std.dev.: 0.3114) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.62% (2.9384 => 4.6314, std.dev.: 0.2385) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.57% (7.0540 => 10.9736, std.dev.: 0.2837) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 51.31% (8.1363 => 12.3109, std.dev.: 0.1822) MultiSource/Applications/JM/lencod/lencod: 49.08% (21.9371 => 32.7028, std.dev.: 0.1680) MultiSource/Benchmarks/FreeBench/distray/distray: 45.83% (0.1056 => 0.1540, std.dev.: 0.0066) SingleSource/UnitTests/vla: 44.51% (0.0355 => 0.0513, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 39.11% (0.1432 => 0.1992, std.dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/almabench: 38.63% (0.0730 => 0.1012, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/messages-2: 37.01% (0.0662 => 0.0907, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/dot-syntax: 31.27% (0.0355 => 0.0466, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 29.81% (0.1117 => 0.1450, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 29.71% (0.7433 => 0.9641, std.dev.: 0.0251) MultiSource/Benchmarks/BitBench/five11/five11: 28.04% (0.0567 => 0.0726, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 27.51% (0.2065 => 0.2633, std.dev.: 0.0030) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 27.41% (0.0467 => 0.0595, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/15-trie/trie: 26.94% (0.0527 => 0.0669, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 26.85% (0.0447 => 0.0567, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 26.47% (0.0442 => 0.0559, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.22% (0.1125 => 0.1420, std.dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 26.00% (1.1840 => 1.4918, std.dev.: 0.0248) SingleSource/UnitTests/ObjC/parameter-passing: 25.85% (0.3927 => 0.4942, std.dev.: 0.0062) MultiSource/Benchmarks/SciMark2-C/scimark2: 25.79% (0.3121 => 0.3926, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.68% (0.1029 => 0.1283, std.dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: 24.48% (0.0482 => 0.0600, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 24.27% (0.3543 => 0.4403, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.13% (0.0746 => 0.0926, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions: 23.85% (0.3828 => 0.4741, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 23.75% (0.3886 => 0.4809, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 23.71% (3.8922 => 4.8151, std.dev.: 0.0709) SingleSource/Benchmarks/CoyoteBench/lpbench: 23.47% (0.0929 => 0.1147, std.dev.: 0.0034) SingleSource/Benchmarks/Stanford/Oscar: 23.43% (0.0636 => 0.0785, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/for-in: 23.42% (0.3694 => 0.4559, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 23.08% (0.0871 => 0.1072, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/exceptions-3: 23.07% (0.3516 => 0.4327, std.dev.: 0.0034) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 22.88% (0.0953 => 0.1171, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 22.83% (0.2554 => 0.3137, std.dev.: 0.0180) SingleSource/UnitTests/ObjC/exceptions-2: 22.79% (0.3497 => 0.4294, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-4: 22.41% (0.3543 => 0.4337, std.dev.: 0.0095) MultiSource/Applications/d/make_dparser: 22.14% (3.3354 => 4.0740, std.dev.: 0.0917) MultiSource/Benchmarks/MallocBench/espresso/espresso: 22.12% (4.2646 => 5.2078, std.dev.: 0.1061) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 22.00% (0.0491 => 0.0599, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/synchronized: 21.99% (0.3561 => 0.4344, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 21.69% (0.0793 => 0.0965, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/trivial-interface: 21.60% (0.3473 => 0.4223, std.dev.: 0.0159) MultiSource/Benchmarks/VersaBench/dbms/dbms: 21.46% (0.8172 => 0.9926, std.dev.: 0.0297) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.41% (0.1906 => 0.2314, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/18-imp/imp: 21.27% (0.3423 => 0.4151, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 21.23% (0.4103 => 0.4974, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 20.97% (14.3668 => 17.3794, std.dev.: 0.2733) MultiSource/Applications/siod/siod: 20.97% (2.2969 => 2.7785, std.dev.: 0.1218) SingleSource/Regression/C++/ofstream_ctor: 20.86% (0.2905 => 0.3511, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/city/city: 20.81% (2.0665 => 2.4966, std.dev.: 0.0419) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.71% (0.1584 => 0.1912, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/tsp/tsp: 20.68% (0.1175 => 0.1418, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.38% (0.9765 => 1.1755, std.dev.: 0.0334) MultiSource/Benchmarks/VersaBench/bmm/bmm: 20.29% (0.0759 => 0.0913, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 20.06% (0.3180 => 0.3818, std.dev.: 0.0125) MultiSource/Applications/oggenc/oggenc: 19.28% (5.7591 => 6.8696, std.dev.: 0.2125) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.07% (0.2700 => 0.3215, std.dev.: 0.0185) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.75% (0.0704 => 0.0836, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 18.19% (0.5925 => 0.7003, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/ReedSolomon: 17.96% (0.2049 => 0.2417, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 17.64% (0.3650 => 0.4294, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.62% (0.3162 => 0.3719, std.dev.: 0.0183) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.18% (0.3935 => 0.4611, std.dev.: 0.0089) SingleSource/UnitTests/ObjC++/property-reference-object: 17.11% (0.6030 => 0.7062, std.dev.: 0.0124) MultiSource/Applications/sqlite3/sqlite3: 16.72% (17.1811 => 20.0530, std.dev.: 0.3844) MultiSource/Benchmarks/Olden/mst/mst: 16.42% (0.1163 => 0.1354, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.20% (0.0648 => 0.0753, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bh/bh: 16.04% (0.3092 => 0.3588, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.78% (0.1337 => 0.1548, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/matrix: 15.77% (0.0818 => 0.0947, std.dev.: 0.0040) MultiSource/Applications/lua/lua: 15.73% (3.8723 => 4.4814, std.dev.: 0.1602) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.62% (4.9449 => 5.7175, std.dev.: 0.2008) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.35% (0.0834 => 0.0962, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 15.31% (0.1555 => 0.1793, std.dev.: 0.0087) MultiSource/Benchmarks/mafft/pairlocalalign: 15.19% (9.4845 => 10.9248, std.dev.: 0.3004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.05% (0.2758 => 0.3173, std.dev.: 0.0159) SingleSource/UnitTests/ObjC++/property-reference: 14.95% (0.7326 => 0.8421, std.dev.: 0.0263) MultiSource/Benchmarks/Bullet/bullet: 14.71% (63.2438 => 72.5459, std.dev.: 0.2181) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.62% (0.2107 => 0.2415, std.dev.: 0.0119) MultiSource/Applications/Burg/burg: 14.61% (1.1642 => 1.3343, std.dev.: 0.0456) MultiSource/Benchmarks/NPB-serial/is/is: 14.60% (0.0719 => 0.0824, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.30% (0.5981 => 0.6836, std.dev.: 0.0275) MultiSource/Applications/hbd/hbd: 14.27% (1.5603 => 1.7829, std.dev.: 0.0604) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.97% (0.5569 => 0.6347, std.dev.: 0.0272) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.50% (0.4615 => 0.5238, std.dev.: 0.0132) MultiSource/Benchmarks/PAQ8p/paq8p: 13.00% (10.3673 => 11.7153, std.dev.: 0.1894) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.80% (0.2430 => 0.2741, std.dev.: 0.0104) MultiSource/Applications/treecc/treecc: 12.79% (2.0273 => 2.2865, std.dev.: 0.0649) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.77% (0.4879 => 0.5502, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.08% (5.0018 => 5.6059, std.dev.: 0.2062) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 12.07% (0.1044 => 0.1170, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 11.98% (0.4299 => 0.4814, std.dev.: 0.0194) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.05% (0.1892 => 0.2101, std.dev.: 0.0068) SingleSource/UnitTests/SignlessTypes/rem: 10.23% (0.1144 => 0.1261, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.67% (0.1438 => 0.1577, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.33% (0.3826 => 0.4183, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.53% (0.3427 => 0.3685, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.46% (0.3136 => 0.3370, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.27% (4.3953 => 11.0002, std.dev.: 0.0219) SingleSource/Benchmarks/Shootout-C++/methcall: 147.57% (5.3999 => 13.3686, std.dev.: 0.0091) MultiSource/Applications/minisat/minisat: 23.11% (9.1159 => 11.2225, std.dev.: 0.7506) SingleSource/Benchmarks/Misc/oourafft: 17.48% (6.6465 => 7.8082, std.dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.66% (1.1145 => 1.3002, std.dev.: 0.0062) MultiSource/Applications/JM/ldecod/ldecod: 13.41% (0.1298 => 0.1472, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.65% (2.8904 => 3.2271, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 10.16% (1.1396 => 1.2554, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.26% (1.7254 => 1.8851, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.95% (0.9540 => 1.0108, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.86% (4.2280 => 4.4758, std.dev.: 0.0085) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 4.55% (26.0924 => 27.2802, std.dev.: 0.3069) MultiSource/Benchmarks/nbench/nbench: 4.07% (11.6436 => 12.1177, std.dev.: 0.0154) MultiSource/Applications/siod/siod: 3.44% (3.2827 => 3.3956, std.dev.: 0.0121) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.95% (2.1424 => 2.2056, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/dry: 2.59% (2.4116 => 2.4740, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 2.33% (85.0658 => 87.0444, std.dev.: 0.0939) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 2.05% (3.1595 => 3.2244, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 1.71% (27.8444 => 28.3196, std.dev.: 0.0120) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.61% (6.5088 => 6.6135, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/sieve: 1.31% (5.2139 => 5.2820, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0504, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.12% (1.9577 => 1.9796, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.27% (6.6874 => 0.1828, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -75.46% (0.8651 => 0.2123, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -74.57% (5.2763 => 1.3415, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/richards_benchmark: -45.07% (0.1622 => 0.0891, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.41% (5.3855 => 4.7172, std.dev.: 0.1546) MultiSource/Applications/JM/ldecod/ldecod: -10.53% (10.4361 => 9.3373, std.dev.: 0.1369) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.52% (5.3526 => 4.9503, std.dev.: 0.0774) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.20% (0.0628 => 0.0363, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.33% (0.3987 => 0.2379, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.33% (4.5009 => 2.7756, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -33.54% (1.1492 => 0.7638, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -25.88% (10.7105 => 7.9383, std.dev.: 0.5490) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.18% (2.6546 => 2.0128, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -19.25% (0.2161 => 0.1745, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.79% (1.6925 => 1.4252, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2838, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.73% (32.5116 => 29.0234, std.dev.: 0.0252) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -10.33% (9.5636 => 8.5753, std.dev.: 0.2488) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.45% (1.5660 => 1.4336, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.91% (3.2416 => 3.0500, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.54% (2.7294 => 2.5781, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: -4.96% (1.5835 => 1.5050, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.73% (0.2497 => 0.2379, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.65% (1.6805 => 1.6023, std.dev.: 0.0214) SingleSource/Benchmarks/Shootout/lists: -4.26% (6.2999 => 6.0318, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.33% (0.9957 => 0.9625, std.dev.: 0.0041) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8912, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.48% (0.4808 => 0.4689, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.82% (8.1563 => 8.0075, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6772, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.51% (10.2830 => 10.1275, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.14% (0.2116 => 0.0653, std.dev.: 0.0013) Report Time: 2.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 08:23:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 10:23:53 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121120162353.90C872A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6077?compare_to=6070&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6077, Order: 168364, Start Time: 2012-11-20 13:03:37, End Time: 2012-11-20 16:24:17 To: 6070, Order: 168357, Start Time: 2012-11-20 08:54:33, End Time: 2012-11-20 12:15:06 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (170 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1089 (720 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 30.16% (57.5550 => 74.9148, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.98% (0.3762 => 0.3874, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.59% (2.0000 => 1.9683, std.dev.: 0.0091) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.48% (0.0625 => 0.0878) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.70% (0.1063 => 0.1400) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.07% (0.2969 => 0.3743, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.23% (0.1106 => 0.1385, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.21% (0.0714 => 0.0894, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.69% (0.4253 => 0.5303, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.55% (0.4139 => 0.5155, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 23.54% (1.5932 => 1.9683, std.dev.: 0.0091) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.01% (0.4994 => 0.6143, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.90% (0.5900 => 0.7251, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.77% (0.0584 => 0.0717, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.67% (0.0547 => 0.0671, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.58% (0.5000 => 0.6129, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.85% (0.0897 => 0.1093, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.74% (0.1021 => 0.1243, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.60% (0.1620 => 0.1970, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 21.54% (0.0599 => 0.0728, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.23% (0.1107 => 0.1342, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 20.36% (0.0948 => 0.1141, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.13% (0.1103 => 0.1325, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.09% (0.0642 => 0.0771, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.04% (0.3903 => 0.4685, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.03% (0.0584 => 0.0701, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 19.85% (0.0821 => 0.0984, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.75% (0.1549 => 0.1855, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.74% (0.1003 => 0.1201, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.59% (0.0822 => 0.0983, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.45% (0.1604 => 0.1916, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 19.33% (0.1619 => 0.1932, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.81% (0.1462 => 0.1737, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 18.69% (0.0947 => 0.1124, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.25% (0.3890 => 0.4600, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.17% (0.2736 => 0.3233, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.87% (0.2014 => 0.2374, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 17.65% (0.1218 => 0.1433, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 17.58% (0.5826 => 0.6850, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.57% (1.3152 => 1.5463, std.dev.: 0.0031) MultiSource/Applications/spiff/spiff: 17.50% (0.4029 => 0.4734, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.28% (0.1088 => 0.1276, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 17.20% (0.5889 => 0.6902, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 17.14% (0.1505 => 0.1763, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.03% (0.2866 => 0.3354, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 16.80% (0.5546 => 0.6478, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 16.64% (1.8794 => 2.1921, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.59% (3.5627 => 4.1536, std.dev.: 0.0050) MultiSource/Applications/hbd/hbd: 16.40% (0.9697 => 1.1287, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.36% (1.6211 => 1.8863, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.36% (0.4658 => 0.5420, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.26% (0.1968 => 0.2288, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.24% (0.2875 => 0.3342, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.20% (0.3271 => 0.3801, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.12% (0.1160 => 0.1347, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.10% (0.5026 => 0.5835, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/18-imp/imp: 15.90% (0.1421 => 0.1647, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 15.90% (0.2780 => 0.3222, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 15.76% (0.2811 => 0.3254, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.73% (0.4361 => 0.5047, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.70% (0.2738 => 0.3168, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 15.65% (0.3004 => 0.3474, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 15.62% (0.2823 => 0.3264, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 15.60% (0.2725 => 0.3150, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 15.59% (0.2714 => 0.3137, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 15.53% (0.2750 => 0.3177, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 15.50% (0.9909 => 1.1445, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 15.50% (0.2813 => 0.3249, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.47% (0.2792 => 0.3224, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 15.46% (1.0781 => 1.2448, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.43% (4.4195 => 5.1013, std.dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.42% (0.3930 => 0.4536, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.39% (0.2729 => 0.3149, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.36% (0.2911 => 0.3358, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 15.34% (0.1284 => 0.1481, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 15.31% (0.2803 => 0.3232, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 15.24% (0.7171 => 0.8264, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.17% (2.7292 => 3.1432, std.dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: 15.09% (4.2109 => 4.8462, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/wc: 15.08% (0.3096 => 0.3563, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.05% (2.0673 => 2.3785, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.96% (0.3195 => 0.3673, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 14.84% (0.2075 => 0.2383, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.74% (1.9694 => 2.2597, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary3: 14.72% (0.3267 => 0.3748, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.71% (0.3060 => 0.3510, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary: 14.67% (0.3258 => 0.3736, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.59% (0.1090 => 0.1249, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.51% (1.9966 => 2.2864, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 14.44% (0.3317 => 0.3796, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 14.13% (23.5202 => 26.8441, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.05% (0.3124 => 0.3563, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.98% (0.3362 => 0.3832, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 13.97% (0.3678 => 0.4192, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.92% (0.3282 => 0.3739, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 13.92% (0.3348 => 0.3814, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 13.87% (0.2566 => 0.2922, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 13.82% (0.3726 => 0.4241, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 13.75% (0.3477 => 0.3955, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.54% (0.3625 => 0.4116, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 13.44% (1.4269 => 1.6187, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.36% (0.3981 => 0.4513, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 13.36% (0.4146 => 0.4700, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.22% (0.3690 => 0.4178, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 13.17% (0.4251 => 0.4811, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 13.17% (0.7875 => 0.8912, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.08% (0.3845 => 0.4348, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 12.99% (2.1653 => 2.4466, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions-2: 12.68% (0.3446 => 0.3883, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.67% (0.3465 => 0.3904, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.59% (0.3496 => 0.3936, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.56% (0.3488 => 0.3926, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 12.54% (0.3460 => 0.3894, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/synchronized: 12.54% (0.3469 => 0.3904, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 12.51% (4.6177 => 5.1953, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/trivial-interface: 12.49% (0.3442 => 0.3872, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 12.49% (0.5012 => 0.5638, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 12.33% (0.3650 => 0.4100, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 12.33% (0.3643 => 0.4092, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 12.14% (2.1013 => 2.3565, std.dev.: 0.0100) SingleSource/UnitTests/ObjC/parameter-passing: 12.03% (0.3724 => 0.4172, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 11.85% (0.2691 => 0.3010, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.76% (0.2040 => 0.2280, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.47% (0.6435 => 0.7173, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11.26% (5.5417 => 6.1657, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 11.08% (0.6634 => 0.7369, std.dev.: 0.0091) MultiSource/Applications/lambda-0_1_3/lambda: 10.98% (0.3498 => 0.3882, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.80% (0.1028 => 0.1139, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.41% (0.1383 => 0.1527, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.34% (0.2737 => 0.3020, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 10.34% (0.4847 => 0.5348, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.25% (0.2068 => 0.2280, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.05% (0.3084 => 0.3394, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 9.62% (0.3336 => 0.3657, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 9.40% (2.0346 => 2.2258, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 9.37% (0.2391 => 0.2615, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.37% (0.2103 => 0.2300, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.49% (4.6926 => 5.0910, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.36% (0.5361 => 0.5809, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.97% (11.6398 => 12.5673, std.dev.: 0.0214) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.76% (0.7426 => 0.8002, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.43% (0.5584 => 0.5999, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 6.61% (11.9555 => 12.7460, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.40% (0.3792 => 0.3921, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 66.42% (0.2162 => 0.3598, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 8.14% (0.2802 => 0.3030, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6086, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 5.66% (0.2122 => 0.2242, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (12.0509 => 12.6633, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.90% (0.3693 => 0.3874, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1725, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-2: 4.39% (1.8057 => 1.8850, std.dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/dry: 4.16% (14.0481 => 14.6325, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1941, std.dev.: 0.0105) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.51% (3.1722 => 3.2200, std.dev.: 0.0035) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3095, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2878, std.dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5878, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.87% (2.4764 => 2.4054, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.78% (25.4195 => 16.5787, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/ary2: -8.20% (0.2402 => 0.2205, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9734, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7874, std.dev.: 0.0111) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.56% (11.2080 => 10.8086, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7756, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.78% (0.6293 => 0.6118, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.25% (41.7953 => 40.8545, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -2.21% (17.2379 => 16.8577, std.dev.: 0.0316) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5800, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4974, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.1995, std.dev.: 0.0519) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0460, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 09:10:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 11:10:19 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121120171019.796252A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6078?compare_to=6074&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6078, Order: 168368, Start Time: 2012-11-20 15:41:00, End Time: 2012-11-20 17:10:43 To: 6074, Order: 168367, Start Time: 2012-11-20 13:52:31, End Time: 2012-11-20 15:24:05 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 4 (120 on baseline) Performance Improvements: 1 (29 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1049 (825 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.18% (5.4162 => 5.4803, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench: 8.99% (1.4832 => 1.6165, std.dev.: 0.0174) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.73% (2.4118 => 2.5982, std.dev.: 0.0105) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.67% (3.8990 => 3.9640, std.dev.: 0.0130) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/treecc/treecc: -1.28% (2.0805 => 2.0538, std.dev.: 0.0013) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.03% (1.0681 => 1.0571, std.dev.: 0.0064) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -6.85% (0.0219 => 0.0204, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -18.91% (0.0423 => 0.0343, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 20.15% (0.0273 => 0.0328, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0311 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.24% (0.0423 => 0.0422, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -11.76% (0.0204 => 0.0180, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/test1: -20.74% (0.0217 => 0.0172, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1471 => 0.1472, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -3.82% (1.1868 => 1.1415, std.dev.: 0.0654) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.10% (0.4098 => 0.4225, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.82% (0.1426 => 0.1400, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.57% (0.0555 => 0.0597, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -20.85% (0.0235 => 0.0186, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.80% (0.0564 => 0.0608, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.83% (1.2021 => 1.1921, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -93.33% (0.0015 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -87.50% (0.0008 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.85% (0.0587 => 0.0582, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.75% (0.0265 => 0.0210, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.19% (0.7783 => 0.7798, std.dev.: 0.0014) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 19.61% (0.0051 => 0.0061, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.16% (16.4461 => 17.6238, std.dev.: 0.1033) MultiSource/Applications/sqlite3/sqlite3: 2334.84% (0.6332 => 15.4174, std.dev.: 0.0444) MultiSource/Benchmarks/McCat/08-main/main: 47.90% (0.1831 => 0.2708, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.09% (0.1559 => 0.1464, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7160.20% (0.3123 => 22.6736, std.dev.: 0.0308) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.34% (0.2463 => 0.3629, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1538.85% (0.3344 => 5.4803, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.27% (0.2364 => 0.3245, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.99% (0.6010 => 0.6250, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel: 2.56% (0.0429 => 0.0440, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.3266 => 0.3426, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 3.15% (0.1969 => 0.2031, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.12% (0.0224 => 0.0231, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -32.61% (0.0230 => 0.0155, std.dev.: 0.0007) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0445, std.dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: 7.25% (0.1462 => 0.1568, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4681, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0756, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4909, std.dev.: 0.0065) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5116, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.6165, std.dev.: 0.0174) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3183, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1512, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3631, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4023, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0865, std.dev.: 0.0008) SingleSource/Regression/C/uint64_to_float: -23.91% (2.1832 => 1.6613, std.dev.: 0.0013) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.43% (0.0810 => 0.0935, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 10.79% (0.1112 => 0.1232, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.17% (0.2180 => 0.2358, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.16% (0.1425 => 0.1527, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.09% (0.1905 => 0.2040, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.05% (0.1983 => 0.2103, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.64% (0.2998 => 0.3167, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.04% (0.7473 => 0.7850, std.dev.: 0.0143) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.01% (0.8148 => 0.8556, std.dev.: 0.0118) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.55% (0.8321 => 0.8700, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.49% (0.6287 => 0.6569, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.37% (1.1606 => 1.2113, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.24% (0.4127 => 0.4302, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.08% (0.4783 => 0.4978, std.dev.: 0.0044) MultiSource/Applications/Burg/burg: 4.02% (1.2222 => 1.2713, std.dev.: 0.0129) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.79% (0.2741 => 0.2845, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 3.76% (0.7950 => 0.8249, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.53% (0.3115 => 0.3225, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.51% (1.1685 => 1.2095, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.49% (0.9908 => 1.0254, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.45% (0.8611 => 0.8908, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 3.42% (1.1271 => 1.1657, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 3.32% (14.2605 => 14.7336, std.dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.29% (0.4559 => 0.4709, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.29% (4.1763 => 4.3137, std.dev.: 0.0217) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.28% (0.8656 => 0.8940, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.28% (0.8697 => 0.8982, std.dev.: 0.0074) MultiSource/Applications/siod/siod: 3.25% (2.2184 => 2.2904, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.22% (1.6386 => 1.6914, std.dev.: 0.0115) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.21% (1.2526 => 1.2928, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.15% (0.9056 => 0.9341, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.09% (0.8457 => 0.8718, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.07% (0.3717 => 0.3831, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.05% (0.8317 => 0.8571, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: 3.04% (0.6834 => 0.7042, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.02% (0.9039 => 0.9312, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.01% (0.8286 => 0.8535, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 2.99% (1.2568 => 1.2944, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.99% (0.8340 => 0.8589, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.98% (0.8712 => 0.8972, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.98% (13.1811 => 13.5744, std.dev.: 0.0995) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.98% (2.1401 => 2.2039, std.dev.: 0.0127) MultiSource/Applications/treecc/treecc: 2.96% (1.9948 => 2.0538, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.94% (0.8331 => 0.8576, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.92% (0.9074 => 0.9339, std.dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: 2.91% (31.8598 => 32.7870, std.dev.: 0.0692) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.90% (0.8048 => 0.8281, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.89% (0.9069 => 0.9331, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.89% (0.8204 => 0.8441, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.89% (0.8066 => 0.8299, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: 2.89% (1.4269 => 1.4681, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.86% (0.8420 => 0.8661, std.dev.: 0.0032) MultiSource/Applications/ClamAV/clamscan: 2.85% (14.7684 => 15.1887, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.85% (0.8716 => 0.8964, std.dev.: 0.0046) MultiSource/Applications/lua/lua: 2.84% (3.8189 => 3.9275, std.dev.: 0.0399) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.83% (0.8597 => 0.8840, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.80% (0.8007 => 0.8231, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: 2.79% (2.3764 => 2.4427, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.74% (0.8805 => 0.9046, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.73% (0.8177 => 0.8400, std.dev.: 0.0034) MultiSource/Applications/d/make_dparser: 2.73% (3.2366 => 3.3248, std.dev.: 0.0088) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.72% (6.6074 => 6.7873, std.dev.: 0.0591) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.70% (0.5191 => 0.5331, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.67% (1.5315 => 1.5724, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.65% (1.1170 => 1.1466, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.49% (0.8359 => 0.8567, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 2.42% (4.1305 => 4.2304, std.dev.: 0.0346) MultiSource/Applications/oggenc/oggenc: 2.41% (4.9628 => 5.0824, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.40% (0.6586 => 0.6744, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.38% (0.8261 => 0.8458, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.35% (0.8518 => 0.8718, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.34% (0.8316 => 0.8511, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.34% (0.8086 => 0.8275, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.32% (1.3279 => 1.3587, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.31% (0.6227 => 0.6371, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 2.31% (1.0945 => 1.1198, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.31% (0.7966 => 0.8150, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.16% (0.8927 => 0.9120, std.dev.: 0.0052) MultiSource/Applications/JM/lencod/lencod: 2.08% (15.3280 => 15.6462, std.dev.: 0.0118) MultiSource/Applications/JM/ldecod/ldecod: 2.06% (6.7320 => 6.8709, std.dev.: 0.0356) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.05% (0.8050 => 0.8215, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.96% (0.8995 => 0.9171, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.91% (3.1832 => 3.2440, std.dev.: 0.0076) MultiSource/Benchmarks/mafft/pairlocalalign: 1.88% (8.6247 => 8.7869, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.65% (1.2602 => 1.2810, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.57% (1.4479 => 1.4707, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.56% (8.6476 => 8.7827, std.dev.: 0.0387) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 116.08% (0.0199 => 0.0430, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/pi: 55.45% (1.5795 => 2.4553, std.dev.: 0.0285) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.59% (0.7597 => 0.8933, std.dev.: 0.0257) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.25% (2.9753 => 3.4589, std.dev.: 0.0304) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.69% (2.7995 => 3.2108, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6091, std.dev.: 0.0261) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.45% (0.3186 => 0.3487, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.92% (1.1857 => 1.2796, std.dev.: 0.0078) SingleSource/Benchmarks/McGill/queens: 7.21% (1.7056 => 1.8286, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.83% (4.7794 => 5.1060, std.dev.: 0.1094) SingleSource/Benchmarks/Misc/richards_benchmark: 6.56% (1.3037 => 1.3892, std.dev.: 0.0111) MultiSource/Applications/SIBsim4/SIBsim4: 5.97% (3.1873 => 3.3777, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.87% (4.9686 => 5.2605, std.dev.: 0.0262) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.83% (4.5327 => 4.7969, std.dev.: 0.0204) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.70% (3.3761 => 3.5348, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.64% (6.2275 => 6.5165, std.dev.: 0.0066) MultiSource/Applications/lambda-0_1_3/lambda: 4.53% (7.4933 => 7.8324, std.dev.: 0.0472) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.04% (4.9469 => 5.1469, std.dev.: 0.0250) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.01% (4.9453 => 5.1437, std.dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 3.91% (14.0064 => 14.5534, std.dev.: 0.0473) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.32% (0.3587 => 0.3706, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 3.16% (3.6643 => 3.7801, std.dev.: 0.0055) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.91% (1.2337 => 1.2696, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.87% (11.5690 => 11.9006, std.dev.: 0.0714) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.83% (8.2783 => 8.5129, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout/lists: 2.27% (7.3375 => 7.5041, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.26% (4.8660 => 4.9760, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.14% (4.8362 => 4.9399, std.dev.: 0.0114) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.63% (3.9006 => 3.9640, std.dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.25% (3.5679 => 3.6126, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.21% (4.0473 => 4.0963, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/neural/neural: 1.13% (1.0841 => 1.0963, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 1.11% (1.2061 => 1.2195, std.dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -35.21% (0.0338 => 0.0219, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/em3d/em3d: -21.12% (5.4641 => 4.3103, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.71% (7.2130 => 6.2239, std.dev.: 0.1687) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.96% (1.0512 => 0.9360, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: -10.87% (1.1216 => 0.9997, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.53% (14.6451 => 13.2492, std.dev.: 0.1758) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.57% (0.3269 => 0.2989, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: -8.55% (63.1822 => 57.7830, std.dev.: 0.0889) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.86% (4.7482 => 4.4225, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.94% (3.7148 => 3.4942, std.dev.: 0.0281) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.89% (5.4972 => 5.1735, std.dev.: 0.0327) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.14% (5.1557 => 4.8906, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.40% (4.7449 => 4.5359, std.dev.: 0.0089) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.07% (2.8773 => 2.7601, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.77% (6.0224 => 5.7952, std.dev.: 0.0094) MultiSource/Applications/lua/lua: -3.45% (29.8330 => 28.8048, std.dev.: 0.1819) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.38% (2.4490 => 2.3663, std.dev.: 0.0165) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.29% (0.5807 => 0.5616, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.96% (2.6356 => 2.5575, std.dev.: 0.0150) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.95% (28.5821 => 27.7401, std.dev.: 0.0305) MultiSource/Benchmarks/FreeBench/mason/mason: -2.83% (0.5415 => 0.5262, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/bisort/bisort: -2.62% (0.6636 => 0.6462, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.62% (1.0388 => 1.0116, std.dev.: 0.0068) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.45% (1.2822 => 1.2508, std.dev.: 0.0058) MultiSource/Applications/aha/aha: -2.29% (3.3398 => 3.2634, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/hash2: -2.23% (3.4237 => 3.3473, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.00% (11.5316 => 11.3013, std.dev.: 0.0532) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.64% (4.9994 => 4.9175, std.dev.: 0.0252) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.59% (3.2169 => 3.1657, std.dev.: 0.0078) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.01% (1.0262 => 1.0571, std.dev.: 0.0064) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 65.85% (0.0123 => 0.0204, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -15.93% (0.0408 => 0.0343, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.13% (0.0254 => 0.0328, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -5.26% (0.0190 => 0.0180, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/test1: -4.44% (0.0180 => 0.0172, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.36% (0.1438 => 0.1472, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.76% (1.1329 => 1.1415, std.dev.: 0.0654) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.46% (0.4164 => 0.4225, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.26% (0.1369 => 0.1400, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.86% (0.0641 => 0.0597, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.62% (0.0195 => 0.0186, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.19% (0.0578 => 0.0608, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.23% (1.1437 => 1.1921, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.18% (0.0627 => 0.0582, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.67% (0.0180 => 0.0210, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.73% (0.8017 => 0.7798, std.dev.: 0.0014) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -1.61% (0.0062 => 0.0061, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 09:32:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 11:32:09 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121120173209.8665D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6079?compare_to=6075&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6079, Order: 168368, Start Time: 2012-11-20 15:59:06, End Time: 2012-11-20 17:32:33 To: 6075, Order: 168367, Start Time: 2012-11-20 14:02:43, End Time: 2012-11-20 15:36:09 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 3 (7 on baseline) Performance Improvements: 0 (182 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1089 (853 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 3.69% (0.4016 => 0.4164, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.59% (54.5584 => 56.5150, std.dev.: 0.1025) MultiSource/Benchmarks/llubenchmark/llu: 1.10% (3.7573 => 3.7987, std.dev.: 0.0053) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 8.61% (0.3834 => 0.4164, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.55% (54.5751 => 56.5150, std.dev.: 0.1025) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.66% (2.0478 => 2.1022, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.4937 => 7.6658, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/hash2: 2.28% (3.1932 => 3.2661, std.dev.: 0.0077) MultiSource/Benchmarks/llubenchmark/llu: 1.47% (3.7435 => 3.7987, std.dev.: 0.0053) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.15% (0.1431 => 0.1300, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.22% (0.3821 => 0.3507, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.01% (0.9542 => 0.8873, std.dev.: 0.0114) SingleSource/UnitTests/ObjC/trivial-interface: -6.95% (0.3812 => 0.3547, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.88% (0.3357 => 0.3126, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.87% (0.3142 => 0.2926, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.83% (0.3848 => 0.3585, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.83% (2.4924 => 2.3222, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -6.81% (0.3831 => 0.3570, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.78% (0.3880 => 0.3617, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.78% (0.3896 => 0.3632, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -6.69% (0.4033 => 0.3763, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.68% (0.3891 => 0.3631, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -6.66% (0.4176 => 0.3898, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.50% (0.2355 => 0.2202, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/property: -6.41% (0.4199 => 0.3930, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -6.34% (0.2160 => 0.2023, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -6.33% (9.2283 => 8.6446, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.31% (0.3884 => 0.3639, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.27% (6.7716 => 6.3473, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: -6.26% (16.1920 => 15.1784, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.24% (0.1796 => 0.1684, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.23% (0.6484 => 0.6080, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.21% (0.9852 => 0.9240, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/parameter-passing: -6.17% (0.4280 => 0.4016, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -6.13% (7.0961 => 6.6610, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.10% (1.0544 => 0.9901, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: -6.00% (0.9179 => 0.8628, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.00% (0.1716 => 0.1613, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.99% (4.0323 => 3.7907, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.97% (1.3722 => 1.2903, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -5.96% (0.1761 => 0.1656, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -5.96% (0.1879 => 0.1767, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.94% (0.5863 => 0.5515, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.91% (3.5339 => 3.3252, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.90% (4.8161 => 4.5318, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.89% (1.2300 => 1.1575, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.86% (0.5478 => 0.5157, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.84% (4.8802 => 4.5952, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.82% (0.3658 => 0.3445, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.82% (0.5859 => 0.5518, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.79% (0.5805 => 0.5469, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.77% (0.5857 => 0.5519, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.77% (0.6660 => 0.6276, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: -5.76% (4.3330 => 4.0835, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.76% (0.5925 => 0.5584, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.75% (0.2695 => 0.2540, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.75% (0.5705 => 0.5377, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.74% (0.5849 => 0.5513, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -5.74% (1.1450 => 1.0793, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.72% (1.4642 => 1.3804, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.72% (0.6736 => 0.6351, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.71% (0.5591 => 0.5272, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.70% (0.6230 => 0.5875, std.dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: -5.70% (1.1530 => 1.0873, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.70% (1.6364 => 1.5432, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.67% (0.6667 => 0.6289, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.67% (0.6297 => 0.5940, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.67% (0.6052 => 0.5709, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.67% (0.3406 => 0.3213, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.66% (0.6189 => 0.5839, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.65% (0.6260 => 0.5906, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.65% (0.6194 => 0.5844, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.65% (0.6304 => 0.5948, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.64% (0.5802 => 0.5475, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.63% (0.5575 => 0.5261, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.63% (4.5069 => 4.2532, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.62% (0.7919 => 0.7474, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: -5.60% (0.2659 => 0.2510, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.60% (0.7198 => 0.6795, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.58% (0.6446 => 0.6086, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.58% (0.5570 => 0.5259, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.58% (0.2278 => 0.2151, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.57% (0.2548 => 0.2406, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.56% (0.8521 => 0.8047, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -5.56% (0.2985 => 0.2819, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.55% (1.2784 => 1.2074, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.54% (0.5941 => 0.5612, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.54% (0.2999 => 0.2833, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.53% (0.5999 => 0.5667, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.52% (0.5581 => 0.5273, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.51% (0.6293 => 0.5946, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: -5.51% (1.2515 => 1.1825, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.50% (0.5456 => 0.5156, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.45% (0.6676 => 0.6312, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.43% (14.2083 => 13.4364, std.dev.: 0.0121) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.43% (1.2210 => 1.1547, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: -5.42% (0.3581 => 0.3387, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.40% (0.5688 => 0.5381, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.37% (0.6440 => 0.6094, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.37% (8.0126 => 7.5826, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/05-eks/eks: -5.36% (0.4515 => 0.4273, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.34% (0.6681 => 0.6324, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.34% (0.3483 => 0.3297, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.32% (0.4151 => 0.3930, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.29% (0.3931 => 0.3723, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.29% (0.6033 => 0.5714, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.26% (17.1032 => 16.2032, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/fibo: -5.26% (0.2871 => 0.2720, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -5.25% (15.5079 => 14.6932, std.dev.: 0.0117) MultiSource/Applications/hexxagon/hexxagon: -5.22% (1.3148 => 1.2462, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.21% (0.3837 => 0.3637, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.20% (0.2385 => 0.2261, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: -5.19% (1.3864 => 1.3145, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.18% (1.2221 => 1.1588, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: -5.15% (3.5154 => 3.3343, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.14% (0.4321 => 0.4099, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.12% (0.3319 => 0.3149, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.11% (0.2933 => 0.2783, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.11% (1.6474 => 1.5633, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/random: -5.10% (0.2939 => 0.2789, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.10% (0.2903 => 0.2755, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.07% (0.3057 => 0.2902, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.05% (2.1713 => 2.0616, std.dev.: 0.0059) MultiSource/Applications/lua/lua: -5.05% (4.0594 => 3.8545, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: -5.04% (0.7447 => 0.7072, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.03% (0.5168 => 0.4908, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.03% (0.4813 => 0.4571, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: -5.02% (0.2849 => 0.2706, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -5.01% (0.3255 => 0.3092, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.00% (0.7339 => 0.6972, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: -4.99% (0.3205 => 0.3045, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -4.99% (0.3446 => 0.3274, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.98% (0.2989 => 0.2840, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.98% (0.7524 => 0.7149, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.97% (0.3016 => 0.2866, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.96% (0.6395 => 0.6078, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -4.95% (0.3394 => 0.3226, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -4.93% (15.2527 => 14.5010, std.dev.: 0.0110) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.93% (22.4056 => 21.3014, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/objinst: -4.88% (0.3194 => 0.3038, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.87% (0.7021 => 0.6679, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -4.86% (0.3025 => 0.2878, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.84% (0.2106 => 0.2004, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: -4.83% (0.4861 => 0.4626, std.dev.: 0.0047) MultiSource/Applications/siod/siod: -4.82% (2.4021 => 2.2864, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary2: -4.80% (0.3481 => 0.3314, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -4.73% (0.4248 => 0.4047, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.73% (0.4083 => 0.3890, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: -4.73% (0.3026 => 0.2883, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -4.71% (2.1401 => 2.0393, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.69% (0.5569 => 0.5308, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.68% (0.4916 => 0.4686, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: -4.68% (0.3271 => 0.3118, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.68% (0.9557 => 0.9110, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.67% (0.5567 => 0.5307, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -4.66% (0.7982 => 0.7610, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.64% (0.6395 => 0.6098, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: -4.63% (5.0226 => 4.7902, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: -4.61% (0.3621 => 0.3454, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.60% (0.5329 => 0.5084, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -4.60% (34.0927 => 32.5259, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.45% (0.3323 => 0.3175, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.44% (0.3849 => 0.3678, std.dev.: 0.0053) MultiSource/Applications/spiff/spiff: -4.43% (0.8418 => 0.8045, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -4.43% (0.6347 => 0.6066, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.39% (2.2587 => 2.1596, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.38% (0.9077 => 0.8679, std.dev.: 0.0025) SingleSource/Regression/C++/ofstream_ctor: -4.35% (0.3059 => 0.2926, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -4.35% (0.7779 => 0.7441, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: -4.34% (0.3867 => 0.3699, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference-object: -4.32% (0.6441 => 0.6163, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.31% (0.4427 => 0.4236, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -4.30% (18.2933 => 17.5069, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/bigfib: -4.28% (0.6750 => 0.6461, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.24% (0.3252 => 0.3114, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.21% (0.3491 => 0.3344, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -4.05% (1.5610 => 1.4978, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sieve: -4.01% (0.3788 => 0.3636, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -3.89% (0.4524 => 0.4348, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.55% (5.4682 => 5.2741, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -2.85% (20.7746 => 20.1815, std.dev.: 0.0208) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7515, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/richards_benchmark: -8.74% (1.2842 => 1.1719, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7068, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.81% (2.2633 => 2.1770, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3339, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.32% (1.0557 => 1.0206, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.12% (1.3096 => 1.2819, std.dev.: 0.0106) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4687, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 11:01:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 13:01:39 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121120190139.CE2672A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6080?compare_to=6076&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6080, Order: 168368, Start Time: 2012-11-20 16:41:32, End Time: 2012-11-20 19:02:03 To: 6076, Order: 168364, Start Time: 2012-11-20 13:26:58, End Time: 2012-11-20 15:47:21 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 57 (146 on baseline) Performance Improvements: 9 (39 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1022 (702 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/objects/objects: 19.57% (0.1160 => 0.1387, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 15.63% (0.7161 => 0.8280, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.46% (0.0828 => 0.0956, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 15.29% (0.6205 => 0.7154, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.09% (0.1643 => 0.1891, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.96% (0.6143 => 0.7062, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 14.86% (0.6399 => 0.7350, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 14.67% (0.7191 => 0.8246, std.dev.: 0.0226) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 14.56% (0.5898 => 0.6757, std.dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.36% (0.1177 => 0.1346, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.30% (0.1049 => 0.1199, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.30% (0.6302 => 0.7203, std.dev.: 0.0249) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.12% (0.5884 => 0.6715, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.09% (0.6190 => 0.7062, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.03% (0.4183 => 0.4770, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/football/football: 13.68% (0.9853 => 1.1201, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C++/office/office: 13.41% (0.3370 => 0.3822, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.02% (0.3902 => 0.4410, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.57% (0.3215 => 0.3619, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.48% (0.5907 => 0.6644, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 12.31% (0.1170 => 0.1314, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.29% (0.2888 => 0.3243, std.dev.: 0.0088) SingleSource/Benchmarks/LivermoreLoops/kernel03: 11.55% (0.0996 => 0.1111, std.dev.: 0.0007) SingleSource/Benchmarks/LivermoreLoops/kernel06: 11.09% (0.1046 => 0.1162, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.03% (0.3173 => 0.3523, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 10.90% (1.3224 => 1.4666, std.dev.: 0.0263) SingleSource/Benchmarks/LivermoreLoops/kernel04: 10.72% (0.1063 => 0.1177, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 10.72% (0.1418 => 0.1570, std.dev.: 0.0019) SingleSource/Benchmarks/LivermoreLoops/kernel02: 10.64% (0.1053 => 0.1165, std.dev.: 0.0009) SingleSource/Benchmarks/Linpack/linpack-pc: 10.54% (0.2875 => 0.3178, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.52% (0.2415 => 0.2669, std.dev.: 0.0039) SingleSource/Benchmarks/LivermoreLoops/kernel05: 10.04% (0.1006 => 0.1107, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.68% (0.7180 => 0.7875, std.dev.: 0.0210) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.06% (0.8995 => 0.9810, std.dev.: 0.0310) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.86% (0.4028 => 0.4385, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.55% (0.2584 => 0.2805, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/distray/distray: 8.31% (0.1540 => 0.1668, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/health/health: 8.31% (0.1468 => 0.1590, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.70% (2.3797 => 2.5630, std.dev.: 0.0313) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.59% (1.7435 => 1.8758, std.dev.: 0.0374) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.31% (0.6836 => 0.7336, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.23% (0.3346 => 0.3521, std.dev.: 0.0056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.74% (37.6800 => 39.4660, std.dev.: 0.0834) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 19.88% (0.0840 => 0.1007, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ft/ft: 17.50% (1.3173 => 1.5478, std.dev.: 0.0560) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.17% (1.5577 => 1.8252, std.dev.: 0.0986) MultiSource/Benchmarks/Olden/bisort/bisort: 17.09% (0.8673 => 1.0155, std.dev.: 0.0327) MultiSource/Benchmarks/Olden/health/health: 16.17% (0.4619 => 0.5366, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: 14.07% (1.1025 => 1.2576, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.52% (6.0305 => 6.6049, std.dev.: 0.0058) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.86% (0.5764 => 0.6217, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.20% (0.3147 => 0.3342, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/neural/neural: 5.15% (0.2234 => 0.2349, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.42% (0.3325 => 0.3472, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.60% (2.8201 => 2.8651, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.33% (3.5993 => 3.6472, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.20% (5.4694 => 5.5352, std.dev.: 0.0082) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -15.40% (0.7879 => 0.6666, std.dev.: 0.0224) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -13.22% (0.7914 => 0.6868, std.dev.: 0.0324) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -11.90% (0.6697 => 0.5900, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -7.24% (5.2078 => 4.8307, std.dev.: 0.1258) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -26.24% (5.6938 => 4.1995, std.dev.: 0.4292) MultiSource/Applications/JM/ldecod/ldecod: -17.60% (0.1472 => 0.1213, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.02% (5.4853 => 5.3745, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.70% (7.3942 => 7.2684, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.69% (2.1681 => 2.1315, std.dev.: 0.0107) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.07% (0.1338 => 0.1337, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.66% (0.0418 => 0.0450, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0653 => 0.0654, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: -0.01% (494.0280 => 493.9643, std.dev.: 0.0366) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.97% (4.3882 => 0.0450, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/power/power: 43702.81% (1.1277 => 493.9643, std.dev.: 0.0366) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.63% (0.5229 => 1.5406, std.dev.: 0.1007) MultiSource/Applications/SPASS/SPASS: 22.44% (14.9895 => 18.3534, std.dev.: 0.1293) MultiSource/Applications/kimwitu++/kc: 49.67% (14.1553 => 21.1861, std.dev.: 0.3189) MultiSource/Benchmarks/MallocBench/gs/gs: 20.20% (4.1105 => 4.9409, std.dev.: 0.1973) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 45.80% (1.1048 => 1.6108, std.dev.: 0.0395) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 451.34% (7.1582 => 39.4660, std.dev.: 0.0834) SingleSource/Benchmarks/Misc-C++-EH/spirit: 81.05% (3.4629 => 6.2695, std.dev.: 0.3820) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.57% (0.6222 => 1.0302, std.dev.: 0.0778) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10465.42% (0.0720 => 7.6071, std.dev.: 0.3557) MultiSource/Applications/SIBsim4/SIBsim4: 3859900.00% (0.0001 => 3.8600, std.dev.: 0.0477) MultiSource/Applications/SPASS/SPASS: 12960700.00% (0.0001 => 12.9608, std.dev.: 2.2354) MultiSource/Applications/kimwitu++/kc: 51700.00% (0.0001 => 0.0518, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/gs/gs: 65300.00% (0.0001 => 0.0654, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 621600.00% (0.0001 => 0.6217, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10075300.00% (0.0001 => 10.0754, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5884800.00% (0.0001 => 5.8849, std.dev.: 0.7821) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1798.04% (1.1194 => 21.2467, std.dev.: 0.4173) MultiSource/Applications/ClamAV/clamscan: 68.36% (22.1758 => 37.3351, std.dev.: 0.7646) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 61.69% (7.0540 => 11.4058, std.dev.: 0.2548) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 58.01% (2.9384 => 4.6429, std.dev.: 0.3501) MultiSource/Benchmarks/FreeBench/distray/distray: 57.95% (0.1056 => 0.1668, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 49.85% (21.9371 => 32.8731, std.dev.: 0.1647) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.39% (8.1363 => 12.1552, std.dev.: 0.2211) SingleSource/Benchmarks/Misc/flops: 44.13% (0.1432 => 0.2064, std.dev.: 0.0039) SingleSource/UnitTests/vla: 40.85% (0.0355 => 0.0500, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 38.90% (0.0730 => 0.1014, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/voronoi/voronoi: 34.04% (0.2700 => 0.3619, std.dev.: 0.0111) MultiSource/Benchmarks/Olden/tsp/tsp: 33.62% (0.1175 => 0.1570, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/dot-syntax-1: 32.78% (0.0479 => 0.0636, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 31.90% (0.0326 => 0.0430, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 30.96% (0.0730 => 0.0956, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bisort/bisort: 30.94% (0.0614 => 0.0804, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 30.51% (0.0672 => 0.0877, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 30.43% (0.1032 => 0.1346, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/family/family: 29.47% (0.0397 => 0.0514, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/messages-2: 28.70% (0.0662 => 0.0852, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/life/life: 28.51% (0.0933 => 0.1199, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/dot-syntax: 28.17% (0.0355 => 0.0455, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 28.16% (0.3441 => 0.4410, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 27.74% (0.2758 => 0.3523, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/treeadd/treeadd: 27.64% (0.0416 => 0.0531, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: 26.84% (0.0626 => 0.0794, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: 26.75% (0.0770 => 0.0976, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/puzzle: 26.72% (0.0408 => 0.0517, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 26.67% (0.2107 => 0.2669, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 25.86% (0.1044 => 0.1314, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/football/football: 25.56% (0.8921 => 1.1201, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/health/health: 25.39% (0.1268 => 0.1590, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 24.67% (0.3826 => 0.4770, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.66% (0.0746 => 0.0930, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 24.59% (0.2603 => 0.3243, std.dev.: 0.0088) SingleSource/UnitTests/ObjC/exceptions-2: 24.51% (0.3497 => 0.4354, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 24.51% (0.1114 => 0.1387, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: 24.43% (0.0929 => 0.1156, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Oscar: 24.06% (0.0636 => 0.0789, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.97% (0.1940 => 0.2405, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/bc/bc: 23.65% (1.1861 => 1.4666, std.dev.: 0.0263) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.51% (0.2271 => 0.2805, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/exceptions-3: 22.87% (0.3516 => 0.4320, std.dev.: 0.0110) MultiSource/Benchmarks/McCat/08-main/main: 22.87% (0.2554 => 0.3138, std.dev.: 0.0204) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 22.66% (0.5981 => 0.7336, std.dev.: 0.0057) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.09% (0.1566 => 0.1912, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.06% (0.1337 => 0.1632, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/office/office: 21.88% (0.3136 => 0.3822, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 21.69% (1.5415 => 1.8758, std.dev.: 0.0374) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 21.61% (0.8067 => 0.9810, std.dev.: 0.0310) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 21.59% (0.0528 => 0.0642, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 21.22% (2.2969 => 2.7844, std.dev.: 0.1304) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 21.19% (0.0793 => 0.0961, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions-4: 21.11% (0.3543 => 0.4291, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 20.86% (14.3668 => 17.3644, std.dev.: 0.1563) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.85% (0.5860 => 0.7082, std.dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 20.43% (0.6675 => 0.8039, std.dev.: 0.0346) SingleSource/UnitTests/ObjC/for-in: 19.52% (0.3694 => 0.4415, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 19.37% (0.8101 => 0.9670, std.dev.: 0.0250) SingleSource/UnitTests/ObjC/instance-method-metadata: 19.31% (0.3543 => 0.4227, std.dev.: 0.0072) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.13% (0.8172 => 0.9735, std.dev.: 0.0364) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.11% (0.1125 => 0.1340, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/exceptions: 19.10% (0.3828 => 0.4559, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.88% (0.0842 => 0.1001, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/moments: 18.87% (0.4048 => 0.4812, std.dev.: 0.0190) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 18.59% (0.0640 => 0.0759, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.58% (5.0018 => 5.9309, std.dev.: 0.1332) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.37% (0.0871 => 0.1031, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.92% (0.2065 => 0.2435, std.dev.: 0.0094) MultiSource/Benchmarks/McCat/17-bintr/bintr: 17.63% (0.0675 => 0.0794, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.38% (0.5105 => 0.5992, std.dev.: 0.0269) MultiSource/Benchmarks/FreeBench/neural/neural: 17.36% (0.1463 => 0.1717, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.85% (0.2872 => 0.3356, std.dev.: 0.0110) MultiSource/Applications/oggenc/oggenc: 16.58% (5.7591 => 6.7140, std.dev.: 0.3304) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.58% (0.0953 => 0.1111, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.51% (0.0648 => 0.0755, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/mst/mst: 16.51% (0.1163 => 0.1355, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.38% (2.2022 => 2.5630, std.dev.: 0.0313) SingleSource/Benchmarks/Shootout/matrix: 16.38% (0.0818 => 0.0952, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 16.37% (0.1625 => 0.1891, std.dev.: 0.0075) MultiSource/Applications/lua/lua: 16.07% (3.8723 => 4.4947, std.dev.: 0.2267) MultiSource/Applications/viterbi/viterbi: 16.01% (0.1555 => 0.1804, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.63% (0.1062 => 0.1228, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.59% (0.0834 => 0.0964, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.58% (0.0770 => 0.0890, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.48% (4.9449 => 5.7102, std.dev.: 0.1256) MultiSource/Benchmarks/Bullet/bullet: 15.15% (63.2438 => 72.8254, std.dev.: 0.1192) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.12% (0.3121 => 0.3593, std.dev.: 0.0155) MultiSource/Applications/hbd/hbd: 15.11% (1.5603 => 1.7960, std.dev.: 0.0537) MultiSource/Applications/sqlite3/sqlite3: 15.09% (17.1811 => 19.7733, std.dev.: 0.5617) SingleSource/UnitTests/ObjC/block-byref-aggr: 14.88% (0.3817 => 0.4385, std.dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: 14.60% (9.4845 => 10.8695, std.dev.: 0.2180) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.48% (0.1029 => 0.1178, std.dev.: 0.0054) MultiSource/Benchmarks/nbench/nbench: 14.34% (1.1840 => 1.3538, std.dev.: 0.0641) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.95% (0.3935 => 0.4484, std.dev.: 0.0159) MultiSource/Benchmarks/McCat/09-vor/vor: 13.87% (0.3180 => 0.3621, std.dev.: 0.0149) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.74% (0.4615 => 0.5249, std.dev.: 0.0246) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.64% (0.1510 => 0.1716, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.27% (4.2646 => 4.8307, std.dev.: 0.1258) MultiSource/Benchmarks/FreeBench/mason/mason: 12.45% (0.0811 => 0.0912, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 12.19% (0.4299 => 0.4823, std.dev.: 0.0180) MultiSource/Benchmarks/PAQ8p/paq8p: 11.37% (10.3673 => 11.5460, std.dev.: 0.1646) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.29% (0.6450 => 0.7178, std.dev.: 0.0224) SingleSource/UnitTests/ObjC++/property-reference-object: 10.95% (0.6030 => 0.6690, std.dev.: 0.0255) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.83% (0.3177 => 0.3521, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.12% (0.2430 => 0.2676, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.67% (0.4879 => 0.5302, std.dev.: 0.0097) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.53% (7.9617 => 8.4023, std.dev.: 0.1673) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.26% (4.3953 => 10.9998, std.dev.: 0.0236) SingleSource/Benchmarks/Shootout-C++/methcall: 147.45% (5.3999 => 13.3622, std.dev.: 0.0115) MultiSource/Benchmarks/Olden/bisort/bisort: 21.86% (0.8333 => 1.0155, std.dev.: 0.0327) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.99% (1.5086 => 1.8252, std.dev.: 0.0986) MultiSource/Benchmarks/Olden/health/health: 20.72% (0.4445 => 0.5366, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.56% (1.2838 => 1.5478, std.dev.: 0.0560) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.93% (0.2944 => 0.3472, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.83% (1.1145 => 1.3132, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 17.48% (6.6465 => 7.8086, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/tsp/tsp: 16.61% (1.0785 => 1.2576, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 16.55% (0.0864 => 0.1007, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/heapsort: 12.70% (3.8526 => 4.3420, std.dev.: 0.1109) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.65% (2.8904 => 3.2272, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.18% (8.6802 => 9.6505, std.dev.: 0.2059) SingleSource/Benchmarks/Misc/richards_benchmark: 10.24% (1.1396 => 1.2563, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.28% (1.7254 => 1.8856, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.86% (0.3070 => 0.3342, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.66% (4.2280 => 4.4674, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/neural/neural: 5.19% (0.2233 => 0.2349, std.dev.: 0.0011) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 4.34% (26.0924 => 27.2256, std.dev.: 0.2934) MultiSource/Benchmarks/nbench/nbench: 4.10% (11.6436 => 12.1214, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.64% (0.3540 => 0.3669, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.22% (1.7133 => 1.7514, std.dev.: 0.0111) SingleSource/Benchmarks/Dhrystone/dry: 2.16% (2.4116 => 2.4638, std.dev.: 0.0116) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 2.09% (85.0658 => 86.8437, std.dev.: 0.0675) MultiSource/Applications/aha/aha: 2.07% (3.1595 => 3.2248, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.81% (2.1424 => 2.1811, std.dev.: 0.0148) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (27.8444 => 28.3035, std.dev.: 0.0093) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.51% (6.5088 => 6.6070, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.26% (1.0313 => 1.0443, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.22% (5.2139 => 5.2776, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0500, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1699, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.62% (5.2763 => 1.2337, std.dev.: 0.0479) SingleSource/Benchmarks/Misc/salsa20: -75.34% (0.8651 => 0.2133, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/richards_benchmark: -44.88% (0.1622 => 0.0894, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.70% (5.3855 => 4.7556, std.dev.: 0.1792) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.36% (5.3526 => 4.7982, std.dev.: 0.1508) MultiSource/Applications/JM/ldecod/ldecod: -7.21% (10.4361 => 9.6839, std.dev.: 0.1704) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.26% (0.3987 => 0.2382, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.27% (4.5009 => 2.7784, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.15% (2.6546 => 2.0134, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -23.46% (10.7105 => 8.1978, std.dev.: 0.3877) MultiSource/Benchmarks/FreeBench/mason/mason: -18.88% (0.2161 => 0.1753, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.57% (1.6925 => 1.4289, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.72% (2.6778 => 2.2837, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.81% (32.5116 => 28.9986, std.dev.: 0.0347) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -10.44% (9.5636 => 8.5648, std.dev.: 0.1678) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.03% (1.5660 => 1.4246, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.93% (4.8142 => 4.4806, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.2416 => 3.0213, std.dev.: 0.0290) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5758, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.09% (0.2497 => 0.2370, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5095, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: -4.21% (6.2999 => 6.0345, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.34% (0.9957 => 0.9624, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.16% (19.9488 => 19.3191, std.dev.: 0.1487) MultiSource/Benchmarks/sim/sim: -3.02% (5.0483 => 4.8957, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.52% (0.4808 => 0.4687, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.94% (8.1563 => 7.9979, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6773, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -1.46% (10.2830 => 10.1330, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.97% (0.1485 => 0.1337, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.09% (0.2116 => 0.0654, std.dev.: 0.0017) Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 11:53:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 13:53:04 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121120195304.E2EAA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6081?compare_to=6078&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6081, Order: 168372, Start Time: 2012-11-20 18:19:36, End Time: 2012-11-20 19:53:28 To: 6078, Order: 168368, Start Time: 2012-11-20 15:41:00, End Time: 2012-11-20 17:10:43 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 10 (77 on baseline) Performance Improvements: 0 (23 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1044 (874 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.08% (0.0628 => 0.0729, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 6.62% (0.2872 => 0.3062, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.92% (0.9087 => 0.9352, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.50% (0.8215 => 0.8420, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.49% (0.8700 => 0.8917, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.63% (0.8718 => 0.8860, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.64% (6.5774 => 6.9482, std.dev.: 0.1342) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.97% (58.7154 => 61.6315, std.dev.: 0.7203) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 2.11% (1.8563 => 1.8954, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/pi: 1.50% (2.4553 => 2.4921, std.dev.: 0.0061) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.25% (1.0571 => 1.0597, std.dev.: 0.0238) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 6.86% (0.0204 => 0.0218, std.dev.: 0.0073) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 23.91% (0.0343 => 0.0425, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.91% (0.0328 => 0.0331, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0312 => 0.0313, std.dev.: 0.0095) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0422 => 0.0424, std.dev.: 0.0113) SingleSource/UnitTests/Vector/Altivec/casts: 13.33% (0.0180 => 0.0204, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/test1: 26.16% (0.0172 => 0.0217, std.dev.: 0.0074) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.27% (0.1472 => 0.1476, std.dev.: 0.0046) MultiSource/Applications/lemon/lemon: 4.99% (1.1415 => 1.1985, std.dev.: 0.0882) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.59% (0.4225 => 0.4158, std.dev.: 0.0267) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.93% (0.1400 => 0.1413, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.51% (0.0597 => 0.0612, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 48.92% (0.0186 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.74% (0.0608 => 0.0567, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.19% (1.1921 => 1.1944, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.34% (0.0582 => 0.0584, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 13.81% (0.0210 => 0.0239, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.91% (0.7798 => 0.7727, std.dev.: 0.1456) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 29.51% (0.0061 => 0.0079, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.77% (16.4461 => 17.7246, std.dev.: 0.4371) MultiSource/Applications/sqlite3/sqlite3: 2315.27% (0.6332 => 15.2935, std.dev.: 0.7836) MultiSource/Benchmarks/McCat/08-main/main: 48.44% (0.1831 => 0.2718, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.08% (0.1559 => 0.1433, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7121.71% (0.3123 => 22.5534, std.dev.: 1.0358) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.12% (0.2463 => 0.3722, std.dev.: 0.0218) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1519.98% (0.3344 => 5.4172, std.dev.: 0.2819) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.17% (0.2364 => 0.3219, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 4.16% (0.6010 => 0.6260, std.dev.: 0.0176) SingleSource/Benchmarks/Misc/mandel: -0.23% (0.0429 => 0.0428, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.08% (0.3266 => 0.3432, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/strcat: 2.59% (0.1969 => 0.2020, std.dev.: 0.0724) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.12% (0.0224 => 0.0231, std.dev.: 0.0079) SingleSource/UnitTests/byval-alignment: -26.09% (0.0230 => 0.0170, std.dev.: 0.0059) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0523, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 10.94% (0.1462 => 0.1622, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4549, std.dev.: 0.0532) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0674, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4869, std.dev.: 0.0102) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5238, std.dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5525, std.dev.: 0.3723) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3074, std.dev.: 0.0709) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1311, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3629, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4057, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0819, std.dev.: 0.0184) SingleSource/Regression/C/uint64_to_float: -24.08% (2.1832 => 1.6574, std.dev.: 0.0299) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.90% (0.0810 => 0.0955, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.26% (0.0848 => 0.0952, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 10.70% (0.1112 => 0.1231, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.16% (0.8321 => 0.8917, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.56% (0.1905 => 0.2030, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.04% (0.7473 => 0.7924, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.68% (0.2519 => 0.2662, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 5.61% (0.8855 => 0.9352, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.38% (0.4847 => 0.5108, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.31% (0.2279 => 0.2400, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.03% (0.6287 => 0.6603, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.63% (1.1685 => 1.2226, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.60% (0.8050 => 0.8420, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.47% (0.8069 => 0.8430, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.36% (0.4127 => 0.4307, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.34% (0.3295 => 0.3438, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.24% (0.9435 => 0.9835, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.16% (0.8420 => 0.8770, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 4.08% (0.9069 => 0.9439, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.03% (0.7966 => 0.8287, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.02% (0.8518 => 0.8860, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.92% (4.1763 => 4.3399, std.dev.: 0.0131) MultiSource/Applications/lua/lua: 3.55% (3.8189 => 3.9545, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.52% (0.8317 => 0.8610, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: 3.44% (4.1305 => 4.2726, std.dev.: 0.0318) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.37% (0.4783 => 0.4944, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.29% (6.6074 => 6.8246, std.dev.: 0.0261) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.21% (1.3279 => 1.3705, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.08% (0.8611 => 0.8876, std.dev.: 0.0077) MultiSource/Benchmarks/nbench/nbench: 3.04% (1.1271 => 1.1614, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.97% (4.4873 => 4.6207, std.dev.: 0.0403) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.95% (0.8007 => 0.8243, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.91% (13.1811 => 13.5649, std.dev.: 0.0749) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.81% (0.8457 => 0.8695, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.75% (1.2526 => 1.2870, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.56% (0.9688 => 0.9936, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.48% (0.8885 => 0.9105, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.47% (0.7932 => 0.8128, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.42% (0.8261 => 0.8461, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.21% (0.8048 => 0.8226, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.20% (0.8805 => 0.8999, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.15% (0.8316 => 0.8495, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.11% (0.8338 => 0.8514, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.08% (8.6476 => 8.8276, std.dev.: 0.0549) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.65% (4.5702 => 4.6455, std.dev.: 0.0251) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 130.65% (0.0199 => 0.0459, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/pi: 57.78% (1.5795 => 2.4921, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 19.96% (0.7597 => 0.9113, std.dev.: 0.0322) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.45% (2.9753 => 3.4648, std.dev.: 0.0476) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.49% (2.7995 => 3.2051, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6085, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.95% (6.3772 => 6.9482, std.dev.: 0.1342) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.78% (1.1857 => 1.2780, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/queens: 7.29% (1.7056 => 1.8299, std.dev.: 0.0373) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.63% (4.7794 => 5.0964, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/richards_benchmark: 6.12% (1.3037 => 1.3835, std.dev.: 0.0251) MultiSource/Applications/SIBsim4/SIBsim4: 6.06% (3.1873 => 3.3803, std.dev.: 0.0540) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.89% (4.9686 => 5.2613, std.dev.: 0.0300) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.75% (4.5327 => 4.7932, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.66% (3.3761 => 3.5333, std.dev.: 0.0118) MultiSource/Applications/lambda-0_1_3/lambda: 4.52% (7.4933 => 7.8319, std.dev.: 0.0458) MultiSource/Benchmarks/BitBench/drop3/drop3: 4.40% (0.2887 => 0.3014, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.22% (6.2275 => 6.4905, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.21% (4.9453 => 5.1534, std.dev.: 0.0232) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.06% (4.9469 => 5.1479, std.dev.: 0.0149) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.00% (59.2638 => 61.6315, std.dev.: 0.7203) MultiSource/Applications/hexxagon/hexxagon: 3.91% (14.0064 => 14.5540, std.dev.: 0.0392) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.39% (1.2337 => 1.2755, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.37% (0.3587 => 0.3708, std.dev.: 0.0034) MultiSource/Applications/siod/siod: 3.03% (3.6643 => 3.7752, std.dev.: 0.0287) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.87% (4.8362 => 4.9752, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.74% (8.2783 => 8.5048, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.57% (11.5690 => 11.8660, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout/lists: 2.37% (7.3375 => 7.5112, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.34% (4.8660 => 4.9801, std.dev.: 0.0422) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.83% (1.1365 => 1.1573, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/neural/neural: 1.24% (1.0841 => 1.0975, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.14% (5.4641 => 4.3092, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.96% (7.2130 => 6.2782, std.dev.: 0.3555) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.74% (1.0512 => 0.9383, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -10.12% (1.1216 => 1.0081, std.dev.: 0.0251) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.55% (14.6451 => 13.3931, std.dev.: 0.1113) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.50% (0.3269 => 0.2991, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: -8.33% (63.1822 => 57.9213, std.dev.: 0.3319) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.94% (4.7482 => 4.4189, std.dev.: 0.0578) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.81% (5.4972 => 5.1777, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.58% (3.7148 => 3.5074, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.15% (5.1557 => 4.8900, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.35% (4.7449 => 4.5384, std.dev.: 0.0250) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.19% (2.8773 => 2.7567, std.dev.: 0.0298) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.72% (6.0224 => 5.7983, std.dev.: 0.0083) MultiSource/Applications/lua/lua: -3.26% (29.8330 => 28.8609, std.dev.: 0.2096) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (28.5821 => 27.7011, std.dev.: 0.0990) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.59% (9.9065 => 9.6496, std.dev.: 0.0830) MultiSource/Applications/aha/aha: -2.52% (3.3398 => 3.2555, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.99% (11.5316 => 11.3021, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.57% (4.9994 => 4.9208, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.41% (3.2169 => 3.1716, std.dev.: 0.0122) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.35% (2.3487 => 2.3169, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.21% (5.6343 => 5.5663, std.dev.: 0.0162) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.26% (1.0262 => 1.0597, std.dev.: 0.0238) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0073) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0095) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0113) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0074) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 2.64% (0.1438 => 0.1476, std.dev.: 0.0046) MultiSource/Applications/lemon/lemon: 5.79% (1.1329 => 1.1985, std.dev.: 0.0882) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.14% (0.4164 => 0.4158, std.dev.: 0.0267) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.21% (0.1369 => 0.1413, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.52% (0.0641 => 0.0612, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.90% (0.0578 => 0.0567, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.43% (1.1437 => 1.1944, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.86% (0.0627 => 0.0584, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 32.78% (0.0180 => 0.0239, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.62% (0.8017 => 0.7727, std.dev.: 0.1456) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 27.42% (0.0062 => 0.0079, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 11:56:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 13:56:28 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121120195628.42A952A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6082?compare_to=6079&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6082, Order: 168372, Start Time: 2012-11-20 18:23:16, End Time: 2012-11-20 19:56:51 To: 6079, Order: 168368, Start Time: 2012-11-20 15:59:06, End Time: 2012-11-20 17:32:33 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (182 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (855 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 9.08% (0.3834 => 0.4182, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.29% (1.2783 => 1.3715, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.95% (2.0478 => 2.1082, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.4937 => 7.6863, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/hash2: 2.31% (3.1932 => 3.2671, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.08% (0.1431 => 0.1301, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.27% (0.3821 => 0.3505, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.05% (0.9542 => 0.8869, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -6.97% (0.3831 => 0.3564, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: -6.93% (0.3812 => 0.3548, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -6.90% (0.3896 => 0.3627, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.89% (0.3848 => 0.3583, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.86% (0.3880 => 0.3614, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.85% (0.3357 => 0.3127, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: -6.84% (0.4033 => 0.3757, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.84% (0.3142 => 0.2927, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.76% (0.3891 => 0.3628, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.75% (0.4176 => 0.3894, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.71% (2.4924 => 2.3252, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/oourafft: -6.53% (0.2160 => 0.2019, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.50% (0.2355 => 0.2202, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -6.45% (0.4199 => 0.3928, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.44% (0.3884 => 0.3634, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.34% (0.2428 => 0.2274, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -6.29% (16.1920 => 15.1741, std.dev.: 0.0176) MultiSource/Benchmarks/mafft/pairlocalalign: -6.27% (9.2283 => 8.6497, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.24% (0.1796 => 0.1684, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.23% (6.7716 => 6.3498, std.dev.: 0.0089) SingleSource/UnitTests/ObjC/parameter-passing: -6.21% (0.4280 => 0.4014, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.18% (0.9852 => 0.9243, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.15% (0.6484 => 0.6085, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: -6.07% (0.9179 => 0.8622, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.05% (1.0544 => 0.9906, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.02% (1.3722 => 1.2896, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: -6.01% (7.0961 => 6.6694, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.94% (4.0323 => 3.7928, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.93% (4.8161 => 4.5304, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -5.91% (0.1761 => 0.1657, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.90% (0.3658 => 0.3442, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.85% (3.5339 => 3.3271, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.84% (0.5478 => 0.5158, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.82% (0.5863 => 0.5522, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.80% (0.5859 => 0.5519, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.79% (0.5805 => 0.5469, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: -5.78% (0.4515 => 0.4254, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.78% (4.8802 => 4.5982, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.76% (0.5591 => 0.5269, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.76% (1.6364 => 1.5422, std.dev.: 0.0054) MultiSource/Applications/Burg/burg: -5.75% (1.2515 => 1.1795, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.75% (0.6660 => 0.6277, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.75% (0.6230 => 0.5872, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.74% (0.5857 => 0.5521, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.73% (0.5705 => 0.5378, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.73% (0.5849 => 0.5514, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.71% (0.2695 => 0.2541, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -5.70% (1.1450 => 1.0797, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: -5.70% (1.1530 => 1.0873, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/gs/gs: -5.70% (4.3330 => 4.0862, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.68% (0.6052 => 0.5708, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.68% (1.4642 => 1.3810, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.68% (0.7198 => 0.6789, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.67% (1.2300 => 1.1602, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.67% (0.5925 => 0.5589, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.67% (0.6667 => 0.6289, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.66% (0.6304 => 0.5947, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.64% (4.5069 => 4.2526, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.62% (0.6189 => 0.5841, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.62% (0.7919 => 0.7474, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: -5.60% (0.2659 => 0.2510, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.60% (0.6194 => 0.5847, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.59% (0.6297 => 0.5945, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.59% (0.5941 => 0.5609, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.58% (0.5802 => 0.5478, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.58% (0.5575 => 0.5264, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -5.58% (0.3406 => 0.3216, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.57% (0.5570 => 0.5260, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.55% (0.4916 => 0.4643, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.54% (0.6260 => 0.5913, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.54% (0.8521 => 0.8049, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.52% (0.6446 => 0.6090, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.49% (0.2548 => 0.2408, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.49% (0.5688 => 0.5376, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.48% (0.6293 => 0.5948, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.47% (0.5999 => 0.5671, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.44% (0.5456 => 0.5159, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.44% (0.2278 => 0.2154, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.44% (1.2210 => 1.1546, std.dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: -5.42% (1.3864 => 1.3113, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.41% (0.5581 => 0.5279, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.41% (1.2784 => 1.2093, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.40% (0.6033 => 0.5707, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.40% (14.2083 => 13.4417, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.38% (8.0126 => 7.5817, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.38% (0.6676 => 0.6317, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.36% (1.2221 => 1.1566, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.36% (0.6736 => 0.6375, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.34% (0.6440 => 0.6096, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: -5.33% (0.3581 => 0.3390, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.33% (0.3057 => 0.2894, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.30% (0.4151 => 0.3931, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.29% (0.3931 => 0.3723, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -5.27% (15.5079 => 14.6903, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/fibo: -5.26% (0.2871 => 0.2720, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.25% (0.2933 => 0.2779, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -5.25% (3.5154 => 3.3309, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/random: -5.24% (0.2939 => 0.2785, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -5.24% (17.1032 => 16.2071, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.24% (0.3837 => 0.3636, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -5.23% (1.3148 => 1.2461, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.20% (0.2903 => 0.2752, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.19% (0.6681 => 0.6334, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.18% (2.1713 => 2.0588, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.16% (0.4321 => 0.4098, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.09% (0.3319 => 0.3150, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: -5.09% (0.2849 => 0.2704, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.07% (0.3255 => 0.3090, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.05% (0.3483 => 0.3307, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.05% (0.4813 => 0.4570, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.05% (0.2001 => 0.1900, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.04% (0.3016 => 0.2864, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -5.02% (0.3446 => 0.3273, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/strcat: -5.02% (0.2989 => 0.2839, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.01% (1.6474 => 1.5649, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.98% (0.7524 => 0.7149, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: -4.98% (0.3394 => 0.3225, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.97% (0.5168 => 0.4911, std.dev.: 0.0014) MultiSource/Applications/lua/lua: -4.97% (4.0594 => 3.8577, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.96% (0.7339 => 0.6975, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.95% (0.2385 => 0.2267, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -4.94% (0.4248 => 0.4038, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -4.94% (0.4861 => 0.4621, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -4.93% (0.3025 => 0.2876, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -4.92% (0.3194 => 0.3037, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -4.91% (2.4021 => 2.2841, std.dev.: 0.0077) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.91% (22.4056 => 21.3064, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/bh/bh: -4.89% (0.2985 => 0.2839, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: -4.89% (0.3026 => 0.2878, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -4.89% (0.7447 => 0.7083, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.88% (0.6395 => 0.6083, std.dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: -4.87% (15.2527 => 14.5102, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/ary2: -4.85% (0.3481 => 0.3312, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -4.75% (0.3621 => 0.3449, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.74% (0.5567 => 0.5303, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.73% (0.4083 => 0.3890, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.71% (0.7021 => 0.6690, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.68% (0.9557 => 0.9110, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.65% (0.3849 => 0.3670, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.65% (0.3271 => 0.3119, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.64% (0.6395 => 0.6098, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: -4.64% (2.1401 => 2.0408, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: -4.64% (0.7982 => 0.7612, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.63% (0.2999 => 0.2860, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.60% (0.5329 => 0.5084, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.60% (0.5569 => 0.5313, std.dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: -4.57% (5.0226 => 4.7931, std.dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: -4.56% (34.0927 => 32.5369, std.dev.: 0.0082) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.55% (0.9077 => 0.8664, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: -4.53% (0.7779 => 0.7427, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: -4.50% (0.3867 => 0.3693, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.45% (0.3323 => 0.3175, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -4.42% (0.6441 => 0.6156, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -4.41% (18.2933 => 17.4872, std.dev.: 0.0244) MultiSource/Applications/spiff/spiff: -4.40% (0.8418 => 0.8048, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.38% (0.4427 => 0.4233, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.38% (0.6347 => 0.6069, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.34% (0.3252 => 0.3111, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.28% (0.3059 => 0.2928, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.26% (2.2587 => 2.1625, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.15% (0.3491 => 0.3346, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -4.12% (0.6750 => 0.6472, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sieve: -4.12% (0.3788 => 0.3632, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -3.91% (0.4524 => 0.4347, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -3.68% (1.5610 => 1.5035, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.53% (5.4682 => 5.2751, std.dev.: 0.0262) SingleSource/UnitTests/Vector/constpool: -2.94% (20.7746 => 20.1648, std.dev.: 0.0229) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7555, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1723, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: -3.86% (2.2633 => 2.1759, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.57% (1.3096 => 1.2628, std.dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4712, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 12:32:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 14:32:51 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121120203251.B744D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6083?compare_to=6077&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6083, Order: 168368, Start Time: 2012-11-20 17:12:23, End Time: 2012-11-20 20:33:15 To: 6077, Order: 168364, Start Time: 2012-11-20 13:03:37, End Time: 2012-11-20 16:24:17 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (170 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1092 (720 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.76% (0.0625 => 0.0886, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.46% (0.1063 => 0.1408, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.17% (0.2969 => 0.3746, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.05% (0.0714 => 0.0900, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.32% (0.1106 => 0.1386, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.02% (0.4253 => 0.5317, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.69% (0.4139 => 0.5161, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 23.90% (1.5932 => 1.9740, std.dev.: 0.0125) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.37% (0.0475 => 0.0586, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.14% (0.5900 => 0.7265, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.03% (0.4994 => 0.6144, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.85% (0.0547 => 0.0672, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.77% (0.0584 => 0.0717, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.46% (0.5000 => 0.6123, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.74% (0.1021 => 0.1243, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 21.70% (0.0599 => 0.0729, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.67% (0.1620 => 0.1971, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.63% (0.0897 => 0.1091, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.14% (0.1107 => 0.1341, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.70% (0.0541 => 0.0653, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 20.57% (0.0948 => 0.1143, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.38% (0.0633 => 0.0762, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.38% (0.0584 => 0.0703) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.16% (0.3903 => 0.4690, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.13% (0.1103 => 0.1325, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.09% (0.0642 => 0.0771, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/health/health: 19.85% (0.0821 => 0.0984, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.84% (0.1003 => 0.1202, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.71% (0.0822 => 0.0984, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.69% (0.1549 => 0.1854, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 19.54% (0.0604 => 0.0722, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.45% (0.1604 => 0.1916, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 19.27% (0.1619 => 0.1931, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.81% (0.1462 => 0.1737, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 18.56% (0.0808 => 0.0958, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 18.37% (0.0947 => 0.1121, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.23% (0.3890 => 0.4599, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.92% (0.2014 => 0.2375, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 17.73% (0.1218 => 0.1434, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 17.73% (0.5826 => 0.6859, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 17.62% (0.0698 => 0.0821) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.43% (0.2736 => 0.3213, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.34% (0.2866 => 0.3363, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: 17.34% (0.5889 => 0.6910, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 17.32% (0.4029 => 0.4727, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.28% (0.1088 => 0.1276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.25% (1.3152 => 1.5421, std.dev.: 0.0086) MultiSource/Benchmarks/McCat/09-vor/vor: 17.01% (0.1505 => 0.1761, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 16.91% (1.8794 => 2.1973, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: 16.91% (0.5546 => 0.6484, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 16.60% (0.9697 => 1.1307, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.54% (3.5627 => 4.1519, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.42% (0.4658 => 0.5423, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.29% (0.3271 => 0.3804, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.28% (1.6211 => 1.8850, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.28% (0.2875 => 0.3343, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.26% (0.1968 => 0.2288, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.21% (0.1160 => 0.1348, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.04% (0.5026 => 0.5832, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 15.90% (0.2780 => 0.3222, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 15.80% (0.2811 => 0.3255, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.73% (0.4361 => 0.5047, std.dev.: 0.0033) SingleSource/Regression/C++/ofstream_ctor: 15.71% (0.3004 => 0.3476, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.70% (0.2738 => 0.3168, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.70% (4.4195 => 5.1135, std.dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.62% (0.3930 => 0.4544, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/18-imp/imp: 15.62% (0.1421 => 0.1643, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 15.60% (0.2725 => 0.3150, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 15.59% (0.2823 => 0.3263, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 15.55% (0.2714 => 0.3136, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 15.53% (1.0781 => 1.2455, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 15.50% (0.2813 => 0.3249, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 15.49% (0.2750 => 0.3176, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.47% (0.2792 => 0.3224, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.43% (0.2729 => 0.3150, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 15.37% (0.9909 => 1.1432, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: 15.34% (0.1284 => 0.1481, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 15.31% (0.3096 => 0.3570, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 15.31% (0.2803 => 0.3232, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.29% (0.2911 => 0.3356, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 15.26% (4.2109 => 4.8534, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 15.24% (0.7171 => 0.8264, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.16% (2.0673 => 2.3807, std.dev.: 0.0071) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.02% (2.7292 => 3.1392, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.96% (0.3195 => 0.3673, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.78% (1.9694 => 2.2604, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.74% (0.3060 => 0.3511, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 14.69% (0.3267 => 0.3747, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.66% (1.9966 => 2.2893, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 14.61% (0.3258 => 0.3734, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.59% (0.1090 => 0.1249, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 14.49% (23.5202 => 26.9291, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary2: 14.41% (0.3317 => 0.3795, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 14.22% (0.2075 => 0.2370, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.08% (0.3124 => 0.3564, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 14.06% (0.3726 => 0.4250, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 13.99% (0.2566 => 0.2925, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.99% (0.3282 => 0.3741, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.98% (0.3362 => 0.3832, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 13.95% (0.3348 => 0.3815, std.dev.: 0.0015) MultiSource/Applications/lua/lua: 13.91% (1.4269 => 1.6254, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/moments: 13.89% (0.3678 => 0.4189, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 13.69% (0.3477 => 0.3953, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.54% (0.3625 => 0.4116, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.54% (0.3981 => 0.4520, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 13.33% (0.7875 => 0.8925, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.25% (0.3690 => 0.4179, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.24% (0.3845 => 0.4354, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 13.22% (0.4146 => 0.4694, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash2: 13.17% (0.4251 => 0.4811, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 13.12% (0.3446 => 0.3898, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.99% (0.3465 => 0.3915, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.97% (0.3469 => 0.3919, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.92% (0.3460 => 0.3907) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.90% (0.3488 => 0.3938, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 12.87% (0.3496 => 0.3946, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.79% (0.3650 => 0.4117, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 12.79% (2.1653 => 2.4422, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/trivial-interface: 12.78% (0.3442 => 0.3882, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/exceptions: 12.65% (0.3643 => 0.4104, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 12.61% (0.5012 => 0.5644, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 12.61% (4.6177 => 5.1999, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/parameter-passing: 12.46% (0.3724 => 0.4188, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 12.16% (2.1013 => 2.3568, std.dev.: 0.0079) MultiSource/Applications/SIBsim4/SIBsim4: 11.97% (0.2691 => 0.3013, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.81% (0.2040 => 0.2281, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.56% (0.6435 => 0.7179, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 11.27% (5.5417 => 6.1663, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.99% (0.1028 => 0.1141, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 10.95% (0.3498 => 0.3881, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 10.49% (0.6634 => 0.7330, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.38% (0.2737 => 0.3021, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.34% (0.1383 => 0.1526, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 10.25% (0.4847 => 0.5344, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.20% (0.2068 => 0.2279, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.12% (0.3084 => 0.3396, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 9.74% (0.3336 => 0.3661, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.42% (0.2103 => 0.2301, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 9.35% (2.0346 => 2.2249, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 9.33% (0.2391 => 0.2614, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.54% (4.6926 => 5.0934, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.47% (0.5361 => 0.5815, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.13% (11.6398 => 12.5864, std.dev.: 0.0183) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.81% (0.7426 => 0.8006, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.52% (0.5584 => 0.6004, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 6.72% (11.9555 => 12.7592, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.74% (0.3792 => 0.3934, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.46% (0.2802 => 0.3067, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.30% (0.2122 => 0.2277, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.62% (3.3903 => 3.6147, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6676, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-2: 4.91% (1.8057 => 1.8944, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1707, std.dev.: 0.1472) SingleSource/Benchmarks/Dhrystone/dry: 4.14% (14.0481 => 14.6302, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.03% (0.3693 => 0.3805, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1938, std.dev.: 0.0093) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.64% (3.1722 => 3.2243, std.dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3011, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2872, std.dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5896, std.dev.: 0.0205) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.67% (2.4764 => 2.4104, std.dev.: 0.0114) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.77% (25.4195 => 16.5813, std.dev.: 0.0172) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9784, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7966, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9574, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -6.83% (0.2402 => 0.2238, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7937, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0054) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7746, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.88% (17.2379 => 16.7409, std.dev.: 0.0736) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.25% (41.7953 => 40.8547, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5712, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4951, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.20% (105.3826 => 104.1204, std.dev.: 0.0720) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0444, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 13:43:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 15:43:31 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121120214331.EBEEA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6084?compare_to=6081&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6084, Order: 168380, Start Time: 2012-11-20 20:11:55, End Time: 2012-11-20 21:43:56 To: 6081, Order: 168372, Start Time: 2012-11-20 18:19:36, End Time: 2012-11-20 19:53:28 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 1 (88 on baseline) Performance Improvements: 12 (21 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1041 (865 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/SPASS/SPASS: 1.64% (8.4234 => 8.5615, std.dev.: 0.0382) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -3.12% (0.9352 => 0.9060, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.91% (0.8420 => 0.8175, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.26% (0.8556 => 0.8363, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -1.93% (0.8430 => 0.8267, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.84% (0.8770 => 0.8609, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.78% (0.9259 => 0.9094, std.dev.: 0.0029) SingleSource/UnitTests/Vector/constpool: -1.70% (8.5239 => 8.3791, std.dev.: 0.0412) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.47% (0.8321 => 0.8199, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.42% (0.8287 => 0.8169, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.85% (1.3836 => 1.3303, std.dev.: 0.0190) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.65% (0.5238 => 0.5047, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/primes/primes: -3.12% (0.9113 => 0.8829, std.dev.: 0.0061) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.27% (1.0597 => 1.0626, std.dev.: 0.1609) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -18.35% (0.0218 => 0.0178, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.47% (0.0425 => 0.0423, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0331 => 0.0332, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0313 => 0.0314, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -11.79% (0.0424 => 0.0374, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/casts: -29.90% (0.0204 => 0.0143, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/test1: 0.46% (0.0217 => 0.0218, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 700.00% (0.0001 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1476 => 0.1474, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -0.67% (1.1985 => 1.1905, std.dev.: 0.0246) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.34% (0.4158 => 0.4172, std.dev.: 0.0346) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.76% (0.1413 => 0.1452, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.29% (0.0007 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.33% (0.0612 => 0.0614, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.25% (0.0277 => 0.0268, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.23% (0.0567 => 0.0560, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.19% (1.1944 => 1.1967, std.dev.: 0.0134) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 1400.00% (0.0001 => 0.0015, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.45% (0.0584 => 0.0645, std.dev.: 0.0146) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.84% (0.0239 => 0.0237, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.49% (0.7727 => 0.7765, std.dev.: 0.0092) SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -40.51% (0.0079 => 0.0047, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.48% (16.4461 => 17.6768, std.dev.: 0.8525) MultiSource/Applications/sqlite3/sqlite3: 2331.48% (0.6332 => 15.3961, std.dev.: 0.6685) MultiSource/Benchmarks/McCat/08-main/main: 50.14% (0.1831 => 0.2749, std.dev.: 0.0421) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.87% (0.1559 => 0.1483, std.dev.: 0.0056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7112.87% (0.3123 => 22.5258, std.dev.: 0.2509) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.79% (0.2463 => 0.3714, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1527.39% (0.3344 => 5.4420, std.dev.: 0.1854) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.10% (0.2364 => 0.3241, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/bigfib: 4.18% (0.6010 => 0.6261, std.dev.: 0.0181) SingleSource/Benchmarks/Misc/mandel: 4.20% (0.0429 => 0.0447, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.62% (0.3266 => 0.3417, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 2.74% (0.1969 => 0.2023, std.dev.: 0.0010) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.23% (0.0224 => 0.0229, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -30.43% (0.0230 => 0.0160, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0520, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 12.04% (0.1462 => 0.1638, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4702, std.dev.: 0.0263) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0693, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4949, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5047, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5642, std.dev.: 0.0770) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3123, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1337, std.dev.: 0.0318) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3628, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4035, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0858, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: -23.78% (2.1832 => 1.6640, std.dev.: 0.0172) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.93% (0.0810 => 0.0939, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.97% (0.0848 => 0.0958, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/tsp/tsp: 12.05% (0.1112 => 0.1246, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.92% (0.1905 => 0.2094, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.90% (0.2279 => 0.2459, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.44% (0.1425 => 0.1531, std.dev.: 0.0020) MultiSource/Applications/viterbi/viterbi: 7.42% (0.1577 => 0.1694, std.dev.: 0.0038) MultiSource/Applications/Burg/burg: 5.61% (1.2222 => 1.2908, std.dev.: 0.0247) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.19% (0.1983 => 0.2086, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.10% (0.2998 => 0.3151, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.79% (1.1685 => 1.2128, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.73% (1.2526 => 1.2993, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.40% (4.1763 => 4.3185, std.dev.: 0.0481) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.40% (6.6074 => 6.8320, std.dev.: 0.0736) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.34% (1.4479 => 1.4963, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.24% (0.3115 => 0.3216, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 3.22% (2.2184 => 2.2899, std.dev.: 0.0229) MultiSource/Applications/JM/ldecod/ldecod: 3.11% (6.7320 => 6.9412, std.dev.: 0.0642) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.09% (1.6386 => 1.6893, std.dev.: 0.0109) MultiSource/Benchmarks/nbench/nbench: 3.03% (1.1271 => 1.1613, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.87% (0.8697 => 0.8947, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.85% (0.3717 => 0.3823, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: 2.78% (2.3764 => 2.4425, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.76% (0.8007 => 0.8228, std.dev.: 0.0080) MultiSource/Applications/oggenc/oggenc: 2.76% (4.9628 => 5.0997, std.dev.: 0.0401) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.72% (0.4783 => 0.4913, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.71% (0.8611 => 0.8844, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.63% (0.9074 => 0.9313, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.60% (0.8331 => 0.8548, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.55% (0.8457 => 0.8673, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.55% (0.7966 => 0.8169, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.49% (0.8597 => 0.8811, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 2.46% (0.7557 => 0.7743, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.46% (4.5702 => 4.6826, std.dev.: 0.0421) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.45% (0.8069 => 0.8267, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.36% (0.9056 => 0.9270, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.34% (0.8317 => 0.8512, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.32% (0.8855 => 0.9060, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.31% (0.8716 => 0.8917, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.29% (0.9908 => 1.0135, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.28% (0.9039 => 0.9245, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.24% (0.8420 => 0.8609, std.dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: 2.23% (31.8598 => 32.5712, std.dev.: 0.2310) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.17% (0.8261 => 0.8440, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.16% (0.7932 => 0.8103, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.13% (0.8712 => 0.8898, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.07% (0.8177 => 0.8346, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 2.00% (8.6247 => 8.7973, std.dev.: 0.0431) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.00% (0.8359 => 0.8526, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.98% (0.8066 => 0.8226, std.dev.: 0.0044) MultiSource/Applications/lemon/lemon: 1.96% (1.0945 => 1.1160, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.94% (0.8204 => 0.8363, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.93% (0.8338 => 0.8499, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.87% (0.8927 => 0.9094, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.78% (0.8048 => 0.8191, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.40% (0.8086 => 0.8199, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 104.02% (0.0199 => 0.0406, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/pi: 58.54% (1.5795 => 2.5042, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.36% (2.9753 => 3.4621, std.dev.: 0.0794) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.22% (0.7597 => 0.8829, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.72% (2.7995 => 3.2115, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6089, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.23% (0.3186 => 0.3480, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.04% (1.1857 => 1.2810, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 7.51% (1.7056 => 1.8337, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.75% (4.7794 => 5.1020, std.dev.: 0.0043) MultiSource/Applications/SIBsim4/SIBsim4: 6.11% (3.1873 => 3.3819, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/richards_benchmark: 6.09% (1.3037 => 1.3831, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.88% (4.9686 => 5.2609, std.dev.: 0.0303) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.84% (4.5327 => 4.7974, std.dev.: 0.0456) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.34% (6.3772 => 6.7175, std.dev.: 0.1181) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.70% (6.2275 => 6.5205, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.67% (3.3761 => 3.5336, std.dev.: 0.0136) MultiSource/Applications/lambda-0_1_3/lambda: 4.43% (7.4933 => 7.8251, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.09% (4.9453 => 5.1474, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.06% (4.9469 => 5.1478, std.dev.: 0.0291) MultiSource/Applications/hexxagon/hexxagon: 3.86% (14.0064 => 14.5468, std.dev.: 0.0490) MultiSource/Applications/siod/siod: 3.06% (3.6643 => 3.7763, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.79% (8.2783 => 8.5094, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.77% (11.5690 => 11.8900, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.30% (4.8362 => 4.9472, std.dev.: 0.0414) SingleSource/Benchmarks/Shootout/lists: 2.30% (7.3375 => 7.5059, std.dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.23% (1.1365 => 1.1618, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 1.53% (8.4326 => 8.5615, std.dev.: 0.0382) MultiSource/Benchmarks/Olden/power/power: 1.49% (1.2061 => 1.2241, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/neural/neural: 1.34% (1.0841 => 1.0986, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.28% (3.5679 => 3.6135, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/ReedSolomon: 1.24% (8.5322 => 8.6381, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.09% (5.4641 => 4.3117, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.81% (7.2130 => 6.2170, std.dev.: 0.2941) SingleSource/Benchmarks/McGill/chomp: -11.01% (1.1216 => 0.9981, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.55% (14.6451 => 13.3934, std.dev.: 0.1542) MultiSource/Benchmarks/mafft/pairlocalalign: -8.52% (63.1822 => 57.8015, std.dev.: 0.1163) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.90% (4.7482 => 4.4208, std.dev.: 0.0321) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.36% (0.3269 => 0.3061, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.94% (3.7148 => 3.4942, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.74% (5.4972 => 5.1817, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.07% (5.1557 => 4.8943, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.35% (4.7449 => 4.5385, std.dev.: 0.0127) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.23% (2.8773 => 2.7557, std.dev.: 0.0221) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.17% (1.3882 => 1.3303, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.71% (6.0224 => 5.7990, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.08% (0.5807 => 0.5628, std.dev.: 0.0055) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.06% (28.5821 => 27.7077, std.dev.: 0.0412) MultiSource/Applications/aha/aha: -2.65% (3.3398 => 3.2513, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.45% (9.9065 => 9.6635, std.dev.: 0.0405) SingleSource/Benchmarks/Shootout-C++/hash2: -2.24% (3.4237 => 3.3471, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.04% (11.5316 => 11.2965, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.68% (4.9994 => 4.9154, std.dev.: 0.0210) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.55% (1.0262 => 1.0626, std.dev.: 0.1609) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 44.72% (0.0123 => 0.0178, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.68% (0.0408 => 0.0423, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.60% (0.0384 => 0.0374, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/casts: -24.74% (0.0190 => 0.0143, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.50% (0.1438 => 0.1474, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 5.08% (1.1329 => 1.1905, std.dev.: 0.0246) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.19% (0.4164 => 0.4172, std.dev.: 0.0346) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.06% (0.1369 => 0.1452, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.21% (0.0641 => 0.0614, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 37.44% (0.0195 => 0.0268, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.11% (0.0578 => 0.0560, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.63% (1.1437 => 1.1967, std.dev.: 0.0134) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 7.14% (0.0014 => 0.0015, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.87% (0.0627 => 0.0645, std.dev.: 0.0146) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.67% (0.0180 => 0.0237, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.14% (0.8017 => 0.7765, std.dev.: 0.0092) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -24.19% (0.0062 => 0.0047, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 13:53:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 15:53:01 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121120215301.AF5642A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6085?compare_to=6082&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6085, Order: 168380, Start Time: 2012-11-20 20:19:59, End Time: 2012-11-20 21:53:25 To: 6082, Order: 168372, Start Time: 2012-11-20 18:23:16, End Time: 2012-11-20 19:56:51 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (181 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (857 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.80% (2.0478 => 2.1051, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/salsa20: 2.37% (7.4937 => 7.6711, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/hash2: 1.99% (3.1932 => 3.2566, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.08% (0.1431 => 0.1301) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.17% (0.3821 => 0.3509, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.97% (0.9542 => 0.8877, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -6.90% (0.3896 => 0.3627, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.90% (0.3812 => 0.3549, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -6.89% (0.3831 => 0.3567, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.86% (0.3880 => 0.3614, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.81% (0.3142 => 0.2928, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -6.81% (0.3848 => 0.3586, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -6.78% (2.4924 => 2.3234, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.72% (0.4033 => 0.3762, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.70% (0.3357 => 0.3132, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.68% (0.3891 => 0.3631, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -6.59% (0.4176 => 0.3901, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.54% (0.2355 => 0.2201, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -6.53% (0.2160 => 0.2019, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -6.36% (9.2283 => 8.6410, std.dev.: 0.0116) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.36% (0.3884 => 0.3637, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.35% (0.1796 => 0.1682, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -6.34% (16.1920 => 15.1649, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.34% (0.2428 => 0.2274, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -6.33% (0.4199 => 0.3933, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.27% (0.9852 => 0.9234, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.23% (6.7716 => 6.3498, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.20% (0.6484 => 0.6082, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -6.17% (0.4280 => 0.4016, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -6.10% (7.0961 => 6.6629, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.06% (1.0544 => 0.9905, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/ReedSolomon: -5.96% (0.1879 => 0.1767, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.93% (4.8161 => 4.5303, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.93% (1.3722 => 1.2908, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.92% (0.5863 => 0.5516, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -5.91% (0.1761 => 0.1657, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: -5.88% (0.9179 => 0.8639, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.88% (0.3658 => 0.3443, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.84% (0.5478 => 0.5158, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.84% (1.2300 => 1.1582, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.83% (3.5339 => 3.3277, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.83% (4.0323 => 3.7972, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: -5.83% (4.3330 => 4.0804, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.82% (0.5857 => 0.5516, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.80% (0.5591 => 0.5267, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: -5.79% (1.1530 => 1.0862, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.77% (1.6364 => 1.5419, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.77% (4.8802 => 4.5985, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.75% (0.7198 => 0.6784, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.74% (0.4515 => 0.4256, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.73% (0.7919 => 0.7465, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.72% (0.6736 => 0.6351, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.71% (0.6667 => 0.6286, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.71% (1.4642 => 1.3806, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.71% (4.5069 => 4.2497, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.70% (0.5859 => 0.5525, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.68% (0.5805 => 0.5475, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.68% (0.6052 => 0.5708, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.68% (0.5705 => 0.5381, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.68% (0.2695 => 0.2542, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.67% (0.5575 => 0.5259, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.67% (0.6230 => 0.5877, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -5.66% (1.2515 => 1.1807, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.66% (0.8521 => 0.8039, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.66% (0.6189 => 0.5839, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.65% (0.6194 => 0.5844, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -5.64% (1.1450 => 1.0804, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.64% (0.5925 => 0.5591, std.dev.: 0.0049) MultiSource/Benchmarks/sim/sim: -5.64% (0.3406 => 0.3214, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.63% (0.5581 => 0.5267, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.62% (0.6260 => 0.5908, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.62% (0.5570 => 0.5257, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.61% (0.5849 => 0.5521, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.60% (0.2659 => 0.2510, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.60% (0.6446 => 0.6085, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.59% (0.2985 => 0.2818, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.58% (0.2278 => 0.2151, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.57% (1.2784 => 1.2072, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.55% (0.6293 => 0.5944, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.54% (0.6660 => 0.6291, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.54% (0.5941 => 0.5612, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.54% (0.6304 => 0.5955, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.53% (0.2548 => 0.2407, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.52% (0.5999 => 0.5668, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.51% (0.6297 => 0.5950, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.50% (0.5802 => 0.5483, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.49% (0.4916 => 0.4646, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.47% (0.2999 => 0.2835, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.46% (0.5456 => 0.5158, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.42% (1.3864 => 1.3112, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.42% (0.6681 => 0.6319, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.39% (1.2210 => 1.1552, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.39% (0.6440 => 0.6093, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.38% (1.2221 => 1.1563, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.36% (0.6676 => 0.6318, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -5.36% (17.1032 => 16.1871, std.dev.: 0.0243) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.35% (8.0126 => 7.5838, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.34% (0.5688 => 0.5384, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -5.34% (15.5079 => 14.6797, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/18-imp/imp: -5.33% (0.3581 => 0.3390, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -5.32% (1.3148 => 1.2449, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.31% (0.3483 => 0.3298, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.31% (14.2083 => 13.4543, std.dev.: 0.0150) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.30% (0.3319 => 0.3143, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.30% (0.4151 => 0.3931, std.dev.: 0.0049) MultiSource/Applications/d/make_dparser: -5.29% (3.5154 => 3.3293, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.28% (0.4321 => 0.4093, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.27% (0.6033 => 0.5715, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.26% (0.2871 => 0.2720) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.21% (0.3931 => 0.3726, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: -5.21% (0.2939 => 0.2786, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.20% (0.2903 => 0.2752, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.20% (0.3057 => 0.2898, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.19% (0.3837 => 0.3638, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.16% (0.2385 => 0.2262, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.15% (0.2933 => 0.2782, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.14% (2.1713 => 2.0596, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -5.12% (4.0594 => 3.8517, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/wc: -5.05% (0.3205 => 0.3043, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.05% (0.4813 => 0.4570, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.03% (1.6474 => 1.5646, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary3: -5.02% (0.3446 => 0.3273, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -5.02% (0.2849 => 0.2706, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.98% (0.2989 => 0.2840, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.97% (0.3016 => 0.2866, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.97% (0.7524 => 0.7150, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -4.96% (2.4021 => 2.2829, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.95% (0.7339 => 0.6976, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/matrix: -4.92% (0.3255 => 0.3095, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -4.90% (0.7447 => 0.7082, std.dev.: 0.0045) MultiSource/Applications/ClamAV/clamscan: -4.89% (15.2527 => 14.5062, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/ary: -4.89% (0.3394 => 0.3228, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -4.88% (0.3481 => 0.3311, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.88% (22.4056 => 21.3116, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.88% (0.5168 => 0.4916, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -4.86% (0.3025 => 0.2878, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: -4.85% (0.4861 => 0.4625, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -4.85% (0.3194 => 0.3039, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.84% (0.2106 => 0.2004, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -4.82% (0.3026 => 0.2880, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.81% (0.7021 => 0.6683, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -4.80% (0.4248 => 0.4044, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -4.79% (2.1401 => 2.0375, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.75% (0.6395 => 0.6091, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.75% (0.4083 => 0.3889, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: -4.75% (0.3621 => 0.3449, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.72% (0.5567 => 0.5304, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -4.72% (0.7982 => 0.7605, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.70% (0.5569 => 0.5307, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: -4.70% (0.8418 => 0.8022, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.69% (0.5329 => 0.5079, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.67% (0.9557 => 0.9111, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -4.66% (34.0927 => 32.5034, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.61% (0.6395 => 0.6100, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.60% (0.3849 => 0.3672, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -4.59% (5.0226 => 4.7919, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/09-vor/vor: -4.56% (0.3271 => 0.3122, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: -4.54% (0.7779 => 0.7426, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: -4.48% (18.2933 => 17.4741, std.dev.: 0.0134) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.43% (0.9077 => 0.8675, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.42% (0.3323 => 0.3176, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -4.42% (0.3867 => 0.3696, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -4.40% (0.6347 => 0.6068, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.38% (0.4427 => 0.4233, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -4.38% (0.3059 => 0.2925, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.33% (2.2587 => 2.1608, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -4.31% (0.6750 => 0.6459, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -4.30% (0.6441 => 0.6164, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.27% (0.3252 => 0.3113, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.12% (0.3491 => 0.3347, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -4.07% (0.3788 => 0.3634, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -4.00% (1.5610 => 1.4985, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: -3.98% (0.4524 => 0.4344, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.53% (5.4682 => 5.2750, std.dev.: 0.0099) SingleSource/UnitTests/Vector/constpool: -2.68% (20.7746 => 20.2177, std.dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7538, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/richards_benchmark: -8.73% (1.2842 => 1.1721, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -4.02% (2.2633 => 2.1723, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.64% (6.5735 => 6.4660, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 14:12:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 16:12:46 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121120221246.540AB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6086?compare_to=6080&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6086, Order: 168374, Start Time: 2012-11-20 19:53:09, End Time: 2012-11-20 22:13:09 To: 6080, Order: 168368, Start Time: 2012-11-20 16:41:32, End Time: 2012-11-20 19:02:03 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 60 (143 on baseline) Performance Improvements: 19 (41 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1009 (703 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 16.06% (4.6429 => 5.3886, std.dev.: 0.0436) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.96% (0.6602 => 0.7656, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.93% (0.5787 => 0.6709, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 15.74% (0.6139 => 0.7105, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 15.36% (0.6882 => 0.7939, std.dev.: 0.0014) MultiSource/Applications/aha/aha: 14.69% (0.1327 => 0.1522, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 14.32% (0.5907 => 0.6753, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.31% (0.6868 => 0.7851, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.27% (0.6687 => 0.7641, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.25% (0.4567 => 0.5218, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.10% (0.6666 => 0.7606, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 13.94% (0.6600 => 0.7520, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hello: 13.52% (0.2967 => 0.3368, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 13.48% (0.6282 => 0.7129, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.61% (0.3006 => 0.3385, std.dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 12.23% (0.3197 => 0.3588, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/ary2: 12.21% (0.3703 => 0.4155, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/ary3: 11.62% (0.3590 => 0.4007, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 11.60% (0.3542 => 0.3953, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.60% (0.6060 => 0.6763, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.56% (0.6426 => 0.7169, std.dev.: 0.0100) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.19% (0.3593 => 0.3995, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: 10.78% (0.2198 => 0.2435, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.49% (0.7178 => 0.7931, std.dev.: 0.0063) MultiSource/Applications/sgefa/sgefa: 10.31% (0.3529 => 0.3893, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 10.16% (0.1496 => 0.1648, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.09% (4.8307 => 5.3181, std.dev.: 0.0535) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.82% (0.4471 => 0.4910, std.dev.: 0.0082) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.61% (0.2101 => 0.2303, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.28% (0.8071 => 0.8820, std.dev.: 0.0134) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.09% (0.5249 => 0.5726, std.dev.: 0.0129) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.81% (0.1918 => 0.2087, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/parameter-passing: 8.37% (0.4494 => 0.4870, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.99% (0.5992 => 0.6471, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 7.91% (0.1340 => 0.1446, std.dev.: 0.0037) MultiSource/Applications/Burg/burg: 7.77% (1.3388 => 1.4428, std.dev.: 0.0375) MultiSource/Benchmarks/mafft/pairlocalalign: 6.00% (10.8695 => 11.5212, std.dev.: 0.1536) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.88% (0.7875 => 0.8338, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.66% (0.3356 => 0.3546, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/exceptions: 4.41% (0.4559 => 0.4760, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.17% (0.3521 => 0.3668, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/for-in: 3.71% (0.4415 => 0.4579, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: 2.68% (11.5460 => 11.8560, std.dev.: 0.0254) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 20.00% (0.0760 => 0.0912, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 19.59% (3.8016 => 4.5462, std.dev.: 0.0422) SingleSource/Benchmarks/CoyoteBench/lpbench: 17.10% (11.0120 => 12.8952, std.dev.: 0.0555) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 16.42% (5.3819 => 6.2656, std.dev.: 0.0567) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 15.39% (1.3415 => 1.5479, std.dev.: 0.0611) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 10.83% (0.4108 => 0.4553, std.dev.: 0.0166) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.09% (1.8252 => 2.0094, std.dev.: 0.0203) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.97% (4.0106 => 4.4105, std.dev.: 0.0860) SingleSource/Benchmarks/Shootout/strcat: 6.11% (0.1932 => 0.2050, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 4.89% (3.1482 => 3.3020, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.23% (5.3263 => 5.5517, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.97% (7.2684 => 7.4117, std.dev.: 0.0131) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.90% (2.3105 => 2.3543, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.31% (8.8425 => 8.9580, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 1.25% (1.7514 => 1.7733, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.16% (4.5091 => 4.5612, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.05% (1.3345 => 1.3485, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -13.18% (0.8280 => 0.7189, std.dev.: 0.0302) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -12.97% (0.7154 => 0.6226, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -12.73% (0.6757 => 0.5897, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -12.65% (0.8246 => 0.7203, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -12.22% (0.7062 => 0.6199, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -11.95% (1.1201 => 0.9862, std.dev.: 0.0514) MultiSource/Benchmarks/Olden/tsp/tsp: -9.68% (0.1570 => 0.1418, std.dev.: 0.0058) SingleSource/Benchmarks/Linpack/linpack-pc: -9.44% (0.3178 => 0.2878, std.dev.: 0.0089) MultiSource/Benchmarks/FreeBench/distray/distray: -7.43% (0.1668 => 0.1544, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -7.42% (0.1590 => 0.1472, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.36% (0.5302 => 0.5071, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.67% (39.4660 => 38.4118, std.dev.: 0.3798) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -14.61% (1.0155 => 0.8671, std.dev.: 0.0333) MultiSource/Benchmarks/Olden/tsp/tsp: -12.27% (1.2576 => 1.1033, std.dev.: 0.0448) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -8.79% (6.6049 => 6.0246, std.dev.: 0.0080) MultiSource/Benchmarks/Bullet/bullet: -7.32% (8.1978 => 7.5976, std.dev.: 0.1569) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.21% (0.6217 => 0.5769, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -2.30% (4.7829 => 4.6727, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.48% (5.5352 => 5.4535, std.dev.: 0.0189) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1337 => 0.1337, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.67% (0.0450 => 0.0420, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.31% (0.0654 => 0.0652, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 0.02% (493.9643 => 494.0596, std.dev.: 0.2128) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/power/power: 43711.26% (1.1277 => 494.0596, std.dev.: 0.2128) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.38% (0.5229 => 1.5393, std.dev.: 0.1116) MultiSource/Applications/SPASS/SPASS: 21.15% (14.9895 => 18.1596, std.dev.: 0.3394) MultiSource/Applications/kimwitu++/kc: 48.52% (14.1553 => 21.0232, std.dev.: 0.2180) MultiSource/Benchmarks/MallocBench/gs/gs: 15.52% (4.1105 => 4.7484, std.dev.: 0.2109) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.83% (1.1048 => 1.5227, std.dev.: 0.0676) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 436.61% (7.1582 => 38.4118, std.dev.: 0.3798) SingleSource/Benchmarks/Misc-C++-EH/spirit: 75.76% (3.4629 => 6.0865, std.dev.: 0.4340) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.41% (0.6222 => 1.0292, std.dev.: 0.0650) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10400.28% (0.0720 => 7.5602, std.dev.: 0.3637) MultiSource/Applications/SIBsim4/SIBsim4: 3859500.00% (0.0001 => 3.8596, std.dev.: 0.0474) MultiSource/Applications/SPASS/SPASS: 14631900.00% (0.0001 => 14.6320, std.dev.: 1.4387) MultiSource/Applications/kimwitu++/kc: 52300.00% (0.0001 => 0.0524, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576800.00% (0.0001 => 0.5769, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10079500.00% (0.0001 => 10.0796, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5768700.00% (0.0001 => 5.7688, std.dev.: 0.8859) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1789.60% (1.1194 => 21.1522, std.dev.: 0.0463) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 83.39% (2.9384 => 5.3886, std.dev.: 0.0436) MultiSource/Applications/ClamAV/clamscan: 67.46% (22.1758 => 37.1353, std.dev.: 0.7215) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 60.26% (7.0540 => 11.3048, std.dev.: 0.3378) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 52.98% (8.1363 => 12.4470, std.dev.: 0.1706) MultiSource/Applications/JM/lencod/lencod: 50.14% (21.9371 => 32.9371, std.dev.: 0.2010) MultiSource/Benchmarks/FreeBench/distray/distray: 46.21% (0.1056 => 0.1544, std.dev.: 0.0002) SingleSource/UnitTests/vla: 44.51% (0.0355 => 0.0513, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 39.66% (0.1432 => 0.2000, std.dev.: 0.0114) SingleSource/Benchmarks/CoyoteBench/almabench: 38.90% (0.0730 => 0.1014, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/messages-2: 36.86% (0.0662 => 0.0906, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/n-body: 35.92% (0.0746 => 0.1014, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 32.23% (0.1151 => 0.1522, std.dev.: 0.0049) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 31.76% (0.1584 => 0.2087, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/family/family: 28.21% (0.0397 => 0.0509, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 28.12% (0.0672 => 0.0861, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/lists: 28.12% (0.0626 => 0.0802, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 28.00% (0.3121 => 0.3995, std.dev.: 0.0024) MultiSource/Benchmarks/NPB-serial/is/is: 27.40% (0.0719 => 0.0916, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: 27.32% (0.0871 => 0.1109, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 27.18% (0.4103 => 0.5218, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.76% (0.5105 => 0.6471, std.dev.: 0.0159) SingleSource/Benchmarks/McGill/exptree: 26.41% (0.0814 => 0.1029, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/matrix: 26.04% (0.0818 => 0.1031, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 25.78% (0.0834 => 0.1049, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 25.22% (0.3109 => 0.3893, std.dev.: 0.0025) MultiSource/Benchmarks/llubenchmark/llu: 25.11% (0.0462 => 0.0578, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 24.70% (4.2646 => 5.3181, std.dev.: 0.0535) SingleSource/UnitTests/ObjC/exceptions-3: 24.52% (0.3516 => 0.4378, std.dev.: 0.0099) SingleSource/UnitTests/ObjC/exceptions: 24.35% (0.3828 => 0.4760, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 24.24% (0.0528 => 0.0656, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: 24.10% (0.2714 => 0.3368, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 24.07% (0.4615 => 0.5726, std.dev.: 0.0129) SingleSource/Benchmarks/Stanford/Oscar: 24.06% (0.0636 => 0.0789, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/parameter-passing: 24.01% (0.3927 => 0.4870, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/for-in: 23.96% (0.3694 => 0.4579, std.dev.: 0.0033) MultiSource/Applications/Burg/burg: 23.93% (1.1642 => 1.4428, std.dev.: 0.0375) SingleSource/UnitTests/ObjC/exceptions-4: 23.85% (0.3543 => 0.4388, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/whetstone: 23.79% (0.0660 => 0.0817, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/misr: 23.70% (0.0633 => 0.0783, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 23.64% (2.2969 => 2.8399, std.dev.: 0.0848) SingleSource/Regression/C++/ofstream_ctor: 23.51% (0.2905 => 0.3588, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/heapsort: 23.47% (0.2872 => 0.3546, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary2: 22.97% (0.3379 => 0.4155, std.dev.: 0.0136) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 22.96% (0.6450 => 0.7931, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/instance-method-metadata: 22.92% (0.3543 => 0.4355, std.dev.: 0.0112) MultiSource/Benchmarks/McCat/08-main/main: 22.91% (0.2554 => 0.3139, std.dev.: 0.0197) SingleSource/Benchmarks/Shootout-C++/ackermann: 22.82% (0.2756 => 0.3385, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 22.50% (14.3668 => 17.6000, std.dev.: 0.2971) SingleSource/Benchmarks/Shootout-C++/ary: 22.31% (0.3232 => 0.3953, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 22.23% (0.0886 => 0.1083, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 22.20% (0.0838 => 0.1024, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 22.18% (0.3422 => 0.4181, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/ary3: 22.05% (0.3283 => 0.4007, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 22.00% (0.3886 => 0.4741, std.dev.: 0.0173) SingleSource/Benchmarks/CoyoteBench/lpbench: 21.85% (0.0929 => 0.1132, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 21.72% (0.1892 => 0.2303, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.65% (0.1566 => 0.1905, std.dev.: 0.0107) MultiSource/Benchmarks/mafft/pairlocalalign: 21.47% (9.4845 => 11.5212, std.dev.: 0.1536) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 21.45% (0.0648 => 0.0787, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 20.82% (0.4064 => 0.4910, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/tsp/tsp: 20.68% (0.1175 => 0.1418, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.53% (0.1062 => 0.1280, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.66% (0.9765 => 1.1685, std.dev.: 0.0394) SingleSource/UnitTests/ObjC/exceptions-2: 19.45% (0.3497 => 0.4177, std.dev.: 0.0156) SingleSource/UnitTests/ObjC/trivial-interface: 19.12% (0.3473 => 0.4137, std.dev.: 0.0081) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.02% (0.1125 => 0.1339, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/life/life: 18.86% (0.0933 => 0.1109, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/ReedSolomon: 18.84% (0.2049 => 0.2435, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 18.42% (0.3561 => 0.4217, std.dev.: 0.0091) MultiSource/Applications/spiff/spiff: 18.23% (0.7835 => 0.9263, std.dev.: 0.0169) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.17% (0.0842 => 0.0995, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.97% (0.2065 => 0.2436, std.dev.: 0.0097) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.60% (0.8172 => 0.9610, std.dev.: 0.0393) MultiSource/Benchmarks/Olden/mst/mst: 16.94% (0.1163 => 0.1360, std.dev.: 0.0056) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.58% (0.0953 => 0.1111, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/em3d/em3d: 16.58% (0.1695 => 0.1976, std.dev.: 0.0107) MultiSource/Applications/lua/lua: 16.41% (3.8723 => 4.5076, std.dev.: 0.2375) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.20% (0.1117 => 0.1298, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/health/health: 16.09% (0.1268 => 0.1472, std.dev.: 0.0040) MultiSource/Applications/viterbi/viterbi: 15.76% (0.1555 => 0.1800, std.dev.: 0.0074) MultiSource/Benchmarks/Bullet/bullet: 15.69% (63.2438 => 73.1651, std.dev.: 0.1236) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 15.45% (0.3177 => 0.3668, std.dev.: 0.0043) SingleSource/UnitTests/ObjC++/Hello: 15.43% (0.5925 => 0.6839, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.34% (0.2758 => 0.3181, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.19% (0.0770 => 0.0887, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.03% (0.1337 => 0.1538, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 14.93% (17.1811 => 19.7466, std.dev.: 0.5279) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.85% (4.9449 => 5.6794, std.dev.: 0.2323) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.40% (0.5981 => 0.6842, std.dev.: 0.0263) MultiSource/Benchmarks/PAQ8p/paq8p: 14.36% (10.3673 => 11.8560, std.dev.: 0.0254) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.35% (0.5569 => 0.6368, std.dev.: 0.0300) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.09% (0.1029 => 0.1174, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.74% (0.8101 => 0.9214, std.dev.: 0.0350) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.29% (1.5415 => 1.7464, std.dev.: 0.0655) SingleSource/UnitTests/ObjC++/property-reference-object: 13.28% (0.6030 => 0.6831, std.dev.: 0.0197) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.13% (0.3865 => 0.4334, std.dev.: 0.0137) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.01% (0.1906 => 0.2135, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/05-eks/eks: 11.72% (0.4299 => 0.4803, std.dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/lists1: 10.78% (0.3684 => 0.4081, std.dev.: 0.0129) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.42% (0.4636 => 0.5119, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.94% (0.4879 => 0.5071, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.17% (4.3953 => 10.9956, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: 147.77% (5.3999 => 13.3791, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 33.20% (1.5086 => 2.0094, std.dev.: 0.0203) SingleSource/Benchmarks/CoyoteBench/lpbench: 24.64% (10.3460 => 12.8952, std.dev.: 0.0555) MultiSource/Applications/minisat/minisat: 20.69% (9.1159 => 11.0020, std.dev.: 0.5980) SingleSource/Benchmarks/Shootout-C++/ary: 20.63% (0.0756 => 0.0912, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 18.66% (1.3045 => 1.5479, std.dev.: 0.0611) SingleSource/Benchmarks/Misc/oourafft: 17.50% (6.6465 => 7.8094, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.63% (1.1145 => 1.2998, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.46% (3.8532 => 4.4105, std.dev.: 0.0860) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.45% (0.2944 => 0.3340, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/heapsort: 13.42% (3.8526 => 4.3698, std.dev.: 0.0899) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.02% (8.6802 => 9.7236, std.dev.: 0.2095) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.68% (2.8904 => 3.2280, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: 10.18% (1.1396 => 1.2556, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.29% (1.7254 => 1.8857, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/strcat: 7.95% (0.1899 => 0.2050, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.95% (0.9540 => 1.0108, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.85% (4.2280 => 4.4752, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.38% (3.1334 => 3.3020, std.dev.: 0.0205) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 4.76% (26.0924 => 27.3341, std.dev.: 0.2194) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.14% (11.6436 => 12.1252, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.50% (1.7133 => 1.7733, std.dev.: 0.0064) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 2.83% (0.6223 => 0.6399, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: 2.51% (2.4116 => 2.4721, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 2.29% (85.0658 => 87.0124, std.dev.: 0.0117) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.15% (1.3677 => 1.3971, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 2.11% (3.1595 => 3.2262, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.83% (2.1424 => 2.1815, std.dev.: 0.0107) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.76% (2.3135 => 2.3543, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 1.69% (27.8444 => 28.3161, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/sieve: 1.63% (5.2139 => 5.2987, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.43% (6.5088 => 6.6019, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0313 => 1.0441, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0497, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: 1.12% (1.9577 => 1.9796, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/fbench: 1.02% (2.2771 => 2.3004, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1689, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.83% (5.2763 => 1.2223, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -75.42% (0.8651 => 0.2126, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/richards_benchmark: -44.82% (0.1622 => 0.0895, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -11.95% (0.1330 => 0.1171, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.31% (5.3855 => 4.8301, std.dev.: 0.1366) MultiSource/Applications/JM/ldecod/ldecod: -10.08% (10.4361 => 9.3843, std.dev.: 0.3670) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.28% (5.3526 => 4.9092, std.dev.: 0.1090) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.52% (0.0628 => 0.0361, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.11% (0.3987 => 0.2388, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.31% (4.5009 => 2.7767, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7636, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -29.06% (10.7105 => 7.5976, std.dev.: 0.1569) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.19% (2.6546 => 2.0125, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: -19.34% (0.2161 => 0.1743, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.75% (1.6925 => 1.4260, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.66% (2.6778 => 2.2852, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.69% (32.5116 => 29.0365, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/mandel-2: -10.64% (1.5373 => 1.3737, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -9.10% (9.5636 => 8.6937, std.dev.: 0.1501) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4244, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4791, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.2416 => 3.0212, std.dev.: 0.0279) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5758, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.53% (1.6805 => 1.5876, std.dev.: 0.0343) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -4.27% (6.2999 => 6.0306, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.77% (19.9488 => 19.1967, std.dev.: 0.1911) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8917, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.84% (0.9957 => 0.9674, std.dev.: 0.0078) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.31% (0.4808 => 0.4697, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.86% (8.1563 => 8.0047, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6775, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -1.50% (10.2830 => 10.1289, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.97% (0.1485 => 0.1337, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0013) Report Time: 2.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 15:35:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 17:35:30 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121120233530.9E7852A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6087?compare_to=6084&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6087, Order: 168384, Start Time: 2012-11-20 22:00:46, End Time: 2012-11-20 23:35:55 To: 6084, Order: 168380, Start Time: 2012-11-20 20:11:55, End Time: 2012-11-20 21:43:56 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 7 (35 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1047 (925 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.19% (0.8477 => 0.9002, std.dev.: 0.0184) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.99% (2.7557 => 2.8382, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/except: 2.40% (0.4925 => 0.5043, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.95% (5.8186 => 5.9319, std.dev.: 0.0261) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.68% (1.2454 => 1.2663, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 1.28% (8.8942 => 9.0084, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout/methcall: 1.19% (8.1585 => 8.2558, std.dev.: 0.0233) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.08% (1.0626 => 1.0847, std.dev.: 0.2087) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 22.47% (0.0178 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.24% (0.0423 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.30% (0.0332 => 0.0331, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0314 => 0.0313, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 12.57% (0.0374 => 0.0421, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: 42.66% (0.0143 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 0.46% (0.0218 => 0.0219, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 62.50% (0.0008 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.97% (0.1474 => 0.1503, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -4.45% (1.1905 => 1.1375, std.dev.: 0.1584) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.10% (0.4172 => 0.4176, std.dev.: 0.0320) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.93% (0.1452 => 0.1424, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.77% (0.0614 => 0.0631, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.84% (0.0268 => 0.0247, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.21% (0.0560 => 0.0606, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.13% (1.1967 => 1.1952, std.dev.: 0.0197) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.68% (0.0031 => 0.0028, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -66.67% (0.0015 => 0.0005, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0645 => 0.0645, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.84% (0.0237 => 0.0239, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.41% (0.7765 => 0.7797, std.dev.: 0.0299) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 48.94% (0.0047 => 0.0070, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.36% (16.4461 => 17.6559, std.dev.: 0.7607) MultiSource/Applications/sqlite3/sqlite3: 2366.79% (0.6332 => 15.6197, std.dev.: 0.1967) MultiSource/Benchmarks/McCat/08-main/main: 52.70% (0.1831 => 0.2796, std.dev.: 0.0286) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.02% (0.1559 => 0.1434, std.dev.: 0.0315) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7071.85% (0.3123 => 22.3977, std.dev.: 1.1646) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.35% (0.2463 => 0.3703, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1524.28% (0.3344 => 5.4316, std.dev.: 0.2936) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.23% (0.2364 => 0.3244, std.dev.: 0.0939) SingleSource/Benchmarks/Misc-C++/bigfib: 6.36% (0.6010 => 0.6392, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/mandel: 3.50% (0.0429 => 0.0444, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.62% (0.3266 => 0.3417, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/strcat: 2.89% (0.1969 => 0.2026, std.dev.: 0.0090) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.36% (0.0224 => 0.0236, std.dev.: 0.0067) SingleSource/UnitTests/byval-alignment: -31.30% (0.0230 => 0.0158, std.dev.: 0.0020) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0462, std.dev.: 0.0070) MultiSource/Applications/oggenc/oggenc: 10.19% (0.1462 => 0.1611, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4815, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0740, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4946, std.dev.: 0.0197) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5111, std.dev.: 0.0976) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.4828, std.dev.: 0.5353) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3248, std.dev.: 0.0442) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1371, std.dev.: 0.1754) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3628, std.dev.: 0.0167) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4079, std.dev.: 0.1089) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0888, std.dev.: 0.0137) SingleSource/Regression/C/uint64_to_float: -23.58% (2.1832 => 1.6685, std.dev.: 0.0194) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.49% (0.0830 => 0.0942, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.25% (0.8316 => 0.9002, std.dev.: 0.0184) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.83% (0.2133 => 0.2236, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4.28% (0.8317 => 0.8673, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.58% (0.8712 => 0.9024, std.dev.: 0.0092) MultiSource/Applications/lemon/lemon: 2.95% (1.0945 => 1.1268, std.dev.: 0.0098) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 129.15% (0.0199 => 0.0456, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 18.23% (0.7597 => 0.8982, std.dev.: 0.0263) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.61% (2.9753 => 3.4695, std.dev.: 0.1181) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.40% (2.7995 => 3.2027, std.dev.: 0.0830) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.79% (5.0261 => 5.6186, std.dev.: 0.0589) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.38% (0.3186 => 0.3485, std.dev.: 0.0106) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.06% (1.1857 => 1.2813, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/richards_benchmark: 7.07% (1.3037 => 1.3959, std.dev.: 0.0284) MultiSource/Applications/SIBsim4/SIBsim4: 6.82% (3.1873 => 3.4047, std.dev.: 0.0367) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.53% (4.7794 => 5.0914, std.dev.: 0.0268) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.93% (4.5327 => 4.8013, std.dev.: 0.0232) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.90% (4.9686 => 5.2615, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.72% (3.3761 => 3.5353, std.dev.: 0.0533) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.65% (6.2275 => 6.5173, std.dev.: 0.0236) MultiSource/Applications/lambda-0_1_3/lambda: 4.41% (7.4933 => 7.8235, std.dev.: 0.0265) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.18% (4.9453 => 5.1521, std.dev.: 0.0462) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.02% (4.9469 => 5.1458, std.dev.: 0.0279) MultiSource/Applications/hexxagon/hexxagon: 3.97% (14.0064 => 14.5629, std.dev.: 0.0194) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.11% (4.8362 => 4.9865, std.dev.: 0.0214) MultiSource/Applications/siod/siod: 3.08% (3.6643 => 3.7771, std.dev.: 0.0341) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.79% (11.5690 => 11.8920, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.72% (8.2783 => 8.5036, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/except: 2.48% (0.4921 => 0.5043, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 2.33% (7.3375 => 7.5086, std.dev.: 0.0527) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.54% (5.8421 => 5.9319, std.dev.: 0.0261) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.52% (1.2474 => 1.2663, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: 1.38% (1.2061 => 1.2228, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/neural/neural: 1.33% (1.0841 => 1.0985, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.13% (5.6030 => 5.6663, std.dev.: 0.0236) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.78% (5.4641 => 4.3286, std.dev.: 0.0503) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.82% (7.2130 => 6.2161, std.dev.: 0.3447) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.84% (1.0512 => 0.9372, std.dev.: 0.0213) SingleSource/Benchmarks/McGill/chomp: -10.01% (1.1216 => 1.0093, std.dev.: 0.0388) MultiSource/Benchmarks/mafft/pairlocalalign: -8.44% (63.1822 => 57.8519, std.dev.: 0.0646) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.43% (14.6451 => 13.5570, std.dev.: 0.1322) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.36% (0.3269 => 0.3061, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.94% (3.7148 => 3.4941, std.dev.: 0.0396) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.81% (5.4972 => 5.1780, std.dev.: 0.0286) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.68% (5.1557 => 4.9144, std.dev.: 0.0358) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.76% (6.0224 => 5.7957, std.dev.: 0.0265) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.99% (28.5821 => 27.7279, std.dev.: 0.1147) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.36% (2.8773 => 2.8382, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.10% (2.3487 => 2.3228, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 5.70% (1.0262 => 1.0847, std.dev.: 0.2087) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.64% (0.0384 => 0.0421, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 4.52% (0.1438 => 0.1503, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 0.41% (1.1329 => 1.1375, std.dev.: 0.1584) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.29% (0.4164 => 0.4176, std.dev.: 0.0320) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.02% (0.1369 => 0.1424, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.56% (0.0641 => 0.0631, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 26.67% (0.0195 => 0.0247, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.84% (0.0578 => 0.0606, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.50% (1.1437 => 1.1952, std.dev.: 0.0197) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2700.00% (0.0001 => 0.0028, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -64.29% (0.0014 => 0.0005, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.87% (0.0627 => 0.0645, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 32.78% (0.0180 => 0.0239, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.74% (0.8017 => 0.7797, std.dev.: 0.0299) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 12.90% (0.0062 => 0.0070, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 15:49:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 17:49:22 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121120234922.219292A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6088?compare_to=6085&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6088, Order: 168384, Start Time: 2012-11-20 22:16:18, End Time: 2012-11-20 23:49:46 To: 6085, Order: 168380, Start Time: 2012-11-20 20:19:59, End Time: 2012-11-20 21:53:25 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (180 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (857 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.36% (0.4017 => 0.4192, std.dev.: 0.0010) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 9.34% (0.3834 => 0.4192, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.25% (1.2783 => 1.3710, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.68% (2.0478 => 2.1027, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 2.39% (7.4937 => 7.6729, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash2: 2.14% (3.1932 => 3.2615, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.08% (0.1431 => 0.1301, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.22% (0.3821 => 0.3507, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.03% (0.9542 => 0.8871, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.83% (0.3896 => 0.3630, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: -6.81% (0.3848 => 0.3586, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -6.81% (2.4924 => 2.3227, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/exceptions-2: -6.79% (0.3831 => 0.3571, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.78% (0.3142 => 0.2929, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.75% (0.3880 => 0.3618, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: -6.74% (0.3812 => 0.3555, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.69% (0.4033 => 0.3763, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.66% (0.3891 => 0.3632, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.63% (0.4176 => 0.3899, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.58% (0.3357 => 0.3136, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: -6.53% (0.2160 => 0.2019, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.50% (0.2355 => 0.2202, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.44% (0.3884 => 0.3634, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -6.41% (0.4199 => 0.3930, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.31% (0.1584 => 0.1484, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.30% (0.2428 => 0.2275, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.29% (0.1796 => 0.1683, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -6.29% (9.2283 => 8.6481, std.dev.: 0.0192) MultiSource/Applications/JM/lencod/lencod: -6.24% (16.1920 => 15.1822, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.23% (0.6484 => 0.6080, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.18% (0.9852 => 0.9243, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -6.14% (7.0961 => 6.6601, std.dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.10% (6.7716 => 6.3588, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/parameter-passing: -6.05% (0.4280 => 0.4021, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.00% (1.3722 => 1.2899, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.99% (4.8161 => 4.5276, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: -5.96% (0.1761 => 0.1656, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -5.96% (0.1879 => 0.1767, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.93% (4.0323 => 3.7933, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/football/football: -5.89% (0.9179 => 0.8638, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.88% (0.5863 => 0.5518, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.85% (3.5339 => 3.3271, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.85% (0.3658 => 0.3444, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.82% (0.5805 => 0.5467, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.80% (0.5859 => 0.5519, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -5.80% (0.4515 => 0.4253, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.80% (1.2300 => 1.1587, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.75% (4.8802 => 4.5994, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: -5.75% (1.2515 => 1.1795, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.75% (0.2695 => 0.2540, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.75% (1.6364 => 1.5423, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.75% (0.5705 => 0.5377, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -5.73% (4.3330 => 4.0847, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.73% (1.0544 => 0.9940, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.73% (0.5849 => 0.5514, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.70% (0.5925 => 0.5587, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.70% (0.5857 => 0.5523, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.70% (1.4642 => 1.3808, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.69% (0.6660 => 0.6281, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.67% (0.7919 => 0.7470, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.67% (0.6667 => 0.6289, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.67% (0.6297 => 0.5940, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.67% (0.5575 => 0.5259, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: -5.66% (1.1530 => 1.0877, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.66% (0.6189 => 0.5839, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.65% (0.5802 => 0.5474, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.64% (0.7198 => 0.6792, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.63% (0.6052 => 0.5711, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.63% (0.6446 => 0.6083, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.63% (0.6304 => 0.5949, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.63% (4.5069 => 4.2532, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.62% (0.6260 => 0.5908, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.62% (0.6230 => 0.5880, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.62% (0.5591 => 0.5277, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.61% (0.6736 => 0.6358, std.dev.: 0.0055) MultiSource/Benchmarks/sim/sim: -5.58% (0.3406 => 0.3216, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.57% (0.8521 => 0.8046, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.57% (0.5999 => 0.5665, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.56% (1.2784 => 1.2073, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.55% (0.5570 => 0.5261, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.53% (0.2548 => 0.2407, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.53% (0.6293 => 0.5945, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -5.53% (0.2985 => 0.2820, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.52% (0.5581 => 0.5273, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: -5.49% (0.2659 => 0.2513, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.49% (0.2278 => 0.2153, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.48% (0.5456 => 0.5157, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.46% (0.6194 => 0.5856, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.45% (0.4916 => 0.4648, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.45% (0.5688 => 0.5378, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.44% (0.2999 => 0.2836, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.43% (8.0126 => 7.5777, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.40% (0.5941 => 0.5620, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.38% (1.2221 => 1.1563, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -5.37% (1.1450 => 1.0835, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.36% (14.2083 => 13.4462, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: -5.36% (1.3864 => 1.3121, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.36% (1.2210 => 1.1556, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.35% (0.6033 => 0.5710, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.34% (0.6681 => 0.6324, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.34% (17.1032 => 16.1894, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/18-imp/imp: -5.33% (0.3581 => 0.3390, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.31% (0.3483 => 0.3298, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.30% (0.6440 => 0.6099, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -5.27% (15.5079 => 14.6901, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.27% (0.3931 => 0.3724, std.dev.: 0.0043) MultiSource/Applications/d/make_dparser: -5.26% (3.5154 => 3.3304, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.23% (0.4321 => 0.4095, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.23% (0.6676 => 0.6327, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.20% (0.3057 => 0.2898, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.20% (0.2385 => 0.2261, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.19% (0.2871 => 0.2722, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.18% (0.3319 => 0.3147, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.18% (0.4151 => 0.3936, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.13% (0.2903 => 0.2754, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -5.12% (1.3148 => 1.2475, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.12% (0.3323 => 0.3153, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.11% (0.2933 => 0.2783, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.11% (0.3837 => 0.3641, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.08% (2.1713 => 2.0610, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: -5.07% (0.2939 => 0.2790, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.05% (1.6474 => 1.5642, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.04% (0.3252 => 0.3088, std.dev.: 0.0014) MultiSource/Applications/lua/lua: -5.02% (4.0594 => 3.8557, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.99% (0.7339 => 0.6973, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: -4.98% (0.2849 => 0.2707, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.97% (0.3016 => 0.2866, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.97% (0.7524 => 0.7150, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: -4.96% (0.3446 => 0.3275, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.95% (0.5168 => 0.4912, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: -4.95% (0.2989 => 0.2841) SingleSource/Benchmarks/Shootout-C++/ary: -4.95% (0.3394 => 0.3226, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: -4.95% (0.3255 => 0.3094, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -4.93% (0.7447 => 0.7080, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.90% (22.4056 => 21.3083, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/moments: -4.90% (0.4248 => 0.4040, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -4.89% (15.2527 => 14.5065, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/hash2: -4.88% (0.4861 => 0.4624, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.86% (0.6395 => 0.6084, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -4.86% (2.4021 => 2.2854, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: -4.85% (0.3481 => 0.3312, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.84% (0.7021 => 0.6681, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.80% (0.4083 => 0.3887, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.80% (0.2106 => 0.2005, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -4.76% (0.3194 => 0.3042, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -4.76% (0.3026 => 0.2882, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.72% (0.5567 => 0.5304, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: -4.69% (0.3025 => 0.2883, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -4.68% (0.3271 => 0.3118, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.68% (0.6395 => 0.6096, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.64% (0.5329 => 0.5082, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -4.61% (0.3621 => 0.3454, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.60% (0.5569 => 0.5313, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.59% (0.9557 => 0.9118, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -4.59% (34.0927 => 32.5278, std.dev.: 0.0502) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.57% (0.3849 => 0.3673, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.56% (0.8418 => 0.8034, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: -4.51% (5.0226 => 4.7959, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.47% (0.9077 => 0.8671, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.43% (0.4813 => 0.4600, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: -4.42% (0.7982 => 0.7629, std.dev.: 0.0050) SingleSource/UnitTests/ObjC++/property-reference: -4.42% (0.7779 => 0.7435, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: -4.41% (0.6347 => 0.6067, std.dev.: 0.0092) MultiSource/Applications/kimwitu++/kc: -4.40% (18.2933 => 17.4883, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/lists1: -4.40% (0.3867 => 0.3697, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.33% (2.2587 => 2.1609, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: -4.32% (0.3059 => 0.2927, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -4.30% (0.6750 => 0.6460, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -4.28% (2.1401 => 2.0484, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.27% (0.4427 => 0.4238, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -4.24% (0.6441 => 0.6168, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: -4.09% (0.3788 => 0.3633, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.04% (0.3491 => 0.3350, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: -4.00% (0.4524 => 0.4343, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -3.99% (1.5610 => 1.4987, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.47% (5.4682 => 5.2784, std.dev.: 0.0105) SingleSource/UnitTests/Vector/constpool: -2.86% (20.7746 => 20.1800, std.dev.: 0.0554) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7575, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1729, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.96% (2.2633 => 2.1736, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7069, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4672, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 16:41:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 18:41:53 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121121004153.B6DA32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6089?compare_to=6083&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6089, Order: 168380, Start Time: 2012-11-20 21:21:24, End Time: 2012-11-21 00:42:17 To: 6083, Order: 168368, Start Time: 2012-11-20 17:12:23, End Time: 2012-11-20 20:33:15 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (170 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1090 (720 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.23% (127.1607 => 131.2697, std.dev.: 0.2797) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -1.28% (54.7989 => 54.0966, std.dev.: 0.0430) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.76% (0.0625 => 0.0886, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.46% (0.1063 => 0.1408, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.17% (0.2969 => 0.3746, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.77% (0.0714 => 0.0898, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.41% (0.1106 => 0.1387, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.97% (0.4253 => 0.5315, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.81% (0.4139 => 0.5166, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 23.89% (1.5932 => 1.9738, std.dev.: 0.0120) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.25% (0.5900 => 0.7272, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.85% (0.0547 => 0.0672, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.81% (0.4994 => 0.6133, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.60% (0.0584 => 0.0716, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.52% (0.5000 => 0.6126, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.91% (0.1620 => 0.1975, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.85% (0.0897 => 0.1093, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.74% (0.1021 => 0.1243, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 21.54% (0.0599 => 0.0728, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.14% (0.1107 => 0.1341, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 20.46% (0.0948 => 0.1142, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.38% (0.0584 => 0.0703, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.22% (0.1103 => 0.1326, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.14% (0.3903 => 0.4689, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.94% (0.0642 => 0.0770, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.88% (0.1549 => 0.1857, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 19.73% (0.0821 => 0.0983, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.64% (0.1003 => 0.1200, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.46% (0.0822 => 0.0982, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 19.33% (0.1619 => 0.1932, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.33% (0.1604 => 0.1914, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.81% (0.1462 => 0.1737, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 18.56% (0.0808 => 0.0958, std.dev.: 0.0023) MultiSource/Applications/viterbi/viterbi: 18.48% (0.0947 => 0.1122, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.25% (0.3890 => 0.4600, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.17% (0.2014 => 0.2380, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 17.77% (0.5826 => 0.6861, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/08-main/main: 17.65% (0.1218 => 0.1433, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 17.62% (0.0698 => 0.0821, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.58% (0.2736 => 0.3217, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.56% (1.3152 => 1.5461, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.46% (0.1088 => 0.1278, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 17.40% (0.4029 => 0.4730, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 17.37% (0.5889 => 0.6912, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 17.28% (0.1505 => 0.1765, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.13% (0.2866 => 0.3357, std.dev.: 0.0040) MultiSource/Applications/Burg/burg: 16.97% (0.5546 => 0.6487, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 16.73% (1.8794 => 2.1938, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.61% (3.5627 => 4.1545, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.57% (0.3271 => 0.3813, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 16.42% (0.9697 => 1.1289, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.41% (0.1968 => 0.2291, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.38% (0.4658 => 0.5421, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.24% (0.2875 => 0.3342, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.21% (0.1160 => 0.1348, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.16% (1.6211 => 1.8831, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.02% (0.5026 => 0.5831, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: 15.86% (0.2780 => 0.3221, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 15.76% (0.1421 => 0.1645, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.73% (0.4361 => 0.5047, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 15.73% (0.2823 => 0.3267, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/except: 15.72% (0.2811 => 0.3253, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.67% (4.4195 => 5.1121, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/fibo: 15.63% (0.2725 => 0.3151, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.63% (0.2738 => 0.3166, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 15.61% (1.0781 => 1.2464, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 15.59% (0.2714 => 0.3137, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 15.58% (0.3004 => 0.3472, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 15.54% (0.2813 => 0.3250, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 15.53% (0.2750 => 0.3177, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 15.50% (0.1284 => 0.1483, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.43% (0.2729 => 0.3150, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.40% (0.2792 => 0.3222, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.39% (0.3930 => 0.4535, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 15.39% (0.9909 => 1.1434, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 15.38% (0.2803 => 0.3234, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 15.30% (0.7171 => 0.8268, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.18% (0.2911 => 0.3353, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.14% (2.7292 => 3.1423, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 15.04% (4.2109 => 4.8443, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.04% (2.0673 => 2.3782, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/wc: 15.02% (0.3096 => 0.3561, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.99% (0.3195 => 0.3674, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.93% (0.3060 => 0.3517, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.83% (1.9694 => 2.2614, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: 14.78% (0.3267 => 0.3750, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 14.70% (0.3258 => 0.3737, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.68% (0.1090 => 0.1250, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.60% (1.9966 => 2.2881, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 14.53% (23.5202 => 26.9368, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary2: 14.41% (0.3317 => 0.3795, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/football/football: 14.22% (0.2075 => 0.2370, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 14.15% (0.2566 => 0.2929, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.05% (0.3124 => 0.3563, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.04% (0.3362 => 0.3834, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.92% (0.3282 => 0.3739, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 13.92% (0.3678 => 0.4190, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 13.85% (0.3726 => 0.4242, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 13.83% (0.3348 => 0.3811, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 13.66% (0.3477 => 0.3952, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.49% (0.3625 => 0.4114, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 13.43% (1.4269 => 1.6185, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.36% (0.3981 => 0.4513, std.dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.24% (0.3845 => 0.4354, std.dev.: 0.0069) MultiSource/Applications/treecc/treecc: 13.23% (0.7875 => 0.8917, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.22% (0.3690 => 0.4178, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 13.22% (0.4146 => 0.4694, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 13.16% (0.3465 => 0.3921, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 13.13% (0.4251 => 0.4809, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.94% (0.3446 => 0.3892, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 12.92% (2.1653 => 2.4450, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/for-in: 12.90% (0.3496 => 0.3947, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.89% (0.3460 => 0.3906, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.89% (0.3469 => 0.3916, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.84% (0.3488 => 0.3936, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 12.81% (0.3442 => 0.3883, std.dev.: 0.0086) SingleSource/UnitTests/ObjC/property: 12.60% (0.3650 => 0.4110, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.60% (0.3643 => 0.4102, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 12.57% (4.6177 => 5.1983, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 12.53% (0.5012 => 0.5640, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 12.41% (0.3724 => 0.4186, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 12.23% (0.2691 => 0.3020, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 12.14% (2.1013 => 2.3563, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.91% (0.2040 => 0.2283, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.61% (0.6435 => 0.7182, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11.27% (5.5417 => 6.1660, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 11.01% (0.3498 => 0.3883, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.99% (0.1028 => 0.1141, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 10.54% (0.6634 => 0.7333, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.45% (0.2737 => 0.3023, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 10.38% (0.4847 => 0.5350, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.34% (0.1383 => 0.1526, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.25% (0.2068 => 0.2280, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.18% (0.3084 => 0.3398, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 9.77% (0.3336 => 0.3662, std.dev.: 0.0071) MultiSource/Applications/sqlite3/sqlite3: 9.49% (2.0346 => 2.2277, std.dev.: 0.0055) MultiSource/Applications/lemon/lemon: 9.41% (0.2391 => 0.2616, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.37% (0.2103 => 0.2300, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.64% (0.5361 => 0.5824, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.56% (4.6926 => 5.0945, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.15% (11.6398 => 12.5884, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.82% (0.7426 => 0.8007, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.70% (0.5584 => 0.6014, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 6.64% (11.9555 => 12.7492, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.64% (0.3792 => 0.3930, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.03% (0.2802 => 0.3055, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary: 7.59% (0.2122 => 0.2283, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.56% (3.3903 => 3.6128, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6774, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-2: 4.69% (1.8057 => 1.8904, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1672, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.33% (0.3693 => 0.3853, std.dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/dry: 4.16% (14.0481 => 14.6326, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1939, std.dev.: 0.0091) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2244, std.dev.: 0.0022) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3064, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2846, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6019, std.dev.: 0.0154) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.19% (2.4764 => 2.3973, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.80% (25.4195 => 16.5735, std.dev.: 0.0223) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9760, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary2: -7.58% (0.2402 => 0.2220, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8119, std.dev.: 0.0081) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8056, std.dev.: 0.0028) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8652, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.21% (0.6293 => 0.6154, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -2.13% (17.2379 => 16.8705, std.dev.: 0.0581) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5755, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4957, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1683, std.dev.: 0.0754) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0431, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 17:25:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 19:25:39 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121121012539.62D262A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6090?compare_to=6086&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6090, Order: 168384, Start Time: 2012-11-20 23:05:25, End Time: 2012-11-21 01:26:03 To: 6086, Order: 168374, Start Time: 2012-11-20 19:53:09, End Time: 2012-11-20 22:13:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 80 (170 on baseline) Performance Improvements: 15 (41 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 993 (676 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/lemon/lemon: 15.30% (1.2010 => 1.3847, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 15.13% (0.7178 => 0.8264, std.dev.: 0.0228) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 14.21% (0.6686 => 0.7636, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/richards_benchmark: 14.19% (0.0895 => 0.1022, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 14.01% (0.6195 => 0.7063, std.dev.: 0.0177) MultiSource/Applications/lambda-0_1_3/lambda: 14.01% (0.8544 => 0.9741, std.dev.: 0.0129) MultiSource/Applications/d/make_dparser: 13.83% (3.7772 => 4.2997, std.dev.: 0.0143) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 13.27% (0.0957 => 0.1084, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 13.12% (0.8161 => 0.9232, std.dev.: 0.0152) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.07% (0.2241 => 0.2534, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/BoolLiteralTest: 12.90% (0.4045 => 0.4567, std.dev.: 0.0160) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.78% (1.0292 => 1.1607, std.dev.: 0.0094) SingleSource/Benchmarks/LivermoreLoops/kernel06: 12.62% (0.1046 => 0.1178, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 12.50% (0.3344 => 0.3762, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 12.49% (0.3891 => 0.4377, std.dev.: 0.0089) SingleSource/Benchmarks/LivermoreLoops/kernel07: 12.44% (0.1045 => 0.1175, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.26% (0.0995 => 0.1117, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 12.07% (0.1881 => 0.2108, std.dev.: 0.0043) MultiSource/Applications/oggenc/oggenc: 11.87% (6.5804 => 7.3618, std.dev.: 0.0162) SingleSource/Benchmarks/LivermoreLoops/kernel05: 11.73% (0.1006 => 0.1124, std.dev.: 0.0005) SingleSource/Benchmarks/LivermoreLoops/kernel12: 11.60% (0.1000 => 0.1116, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: 11.50% (0.2878 => 0.3209, std.dev.: 0.0017) SingleSource/Benchmarks/LivermoreLoops/kernel11: 11.42% (0.1016 => 0.1132, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 11.37% (0.3587 => 0.3995, std.dev.: 0.0030) SingleSource/Benchmarks/LivermoreLoops/kernel09: 11.27% (0.1065 => 0.1185, std.dev.: 0.0002) SingleSource/Benchmarks/LivermoreLoops/kernel17: 11.24% (0.1014 => 0.1128, std.dev.: 0.0020) SingleSource/Benchmarks/LivermoreLoops/kernel10: 11.22% (0.1052 => 0.1170, std.dev.: 0.0006) SingleSource/Benchmarks/LivermoreLoops/kernel16: 11.19% (0.1135 => 0.1262, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.19% (0.1716 => 0.1908, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel20: 11.13% (0.1042 => 0.1158, std.dev.: 0.0002) SingleSource/Benchmarks/LivermoreLoops/kernel14: 11.10% (0.1090 => 0.1211, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.05% (0.6685 => 0.7424, std.dev.: 0.0062) SingleSource/Benchmarks/LivermoreLoops/kernel18: 10.88% (0.1489 => 0.1651, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.70% (2.4812 => 2.7468, std.dev.: 0.0679) SingleSource/Benchmarks/LivermoreLoops/kernel19: 10.69% (0.1048 => 0.1160, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 10.68% (0.1976 => 0.2187, std.dev.: 0.0022) SingleSource/Benchmarks/LivermoreLoops/kernel08: 10.39% (0.1241 => 0.1370, std.dev.: 0.0004) SingleSource/Benchmarks/LivermoreLoops/kernel15: 10.12% (0.1186 => 0.1306, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/05-eks/eks: 9.72% (0.4803 => 0.5270, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.46% (0.2684 => 0.2938, std.dev.: 0.0018) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.26% (0.1274 => 0.1392, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 8.67% (0.1800 => 0.1956, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.64% (0.9214 => 1.0010, std.dev.: 0.0052) MultiSource/Applications/SIBsim4/SIBsim4: 8.29% (1.5393 => 1.6669, std.dev.: 0.0330) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.23% (5.6794 => 6.1468, std.dev.: 0.0159) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.33% (2.3659 => 2.5393, std.dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.17% (0.3472 => 0.3721, std.dev.: 0.0087) MultiSource/Applications/spiff/spiff: 7.16% (0.9263 => 0.9926, std.dev.: 0.0192) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.07% (1.4771 => 1.5667, std.dev.: 0.0278) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.74% (1.1685 => 1.2239, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.71% (4.8301 => 5.0094, std.dev.: 0.0546) MultiSource/Applications/kimwitu++/kc: 3.47% (21.0232 => 21.7521, std.dev.: 0.1353) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.42% (17.6000 => 18.0265, std.dev.: 0.1497) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.84% (5.3181 => 5.4158, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.73% (12.4470 => 12.6623, std.dev.: 0.0667) MultiSource/Applications/SPASS/SPASS: 1.58% (18.1596 => 18.4468, std.dev.: 0.0823) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 206.20% (3.4078 => 10.4348, std.dev.: 0.0501) MultiSource/Benchmarks/McCat/17-bintr/bintr: 129.86% (0.1045 => 0.2402, std.dev.: 0.0092) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 38.04% (0.3425 => 0.4728, std.dev.: 0.0094) MultiSource/Benchmarks/McCat/09-vor/vor: 34.68% (0.1188 => 0.1600, std.dev.: 0.0011) MultiSource/Benchmarks/llubenchmark/llu: 30.83% (6.2411 => 8.1650, std.dev.: 0.2780) MultiSource/Benchmarks/Ptrdist/ft/ft: 30.67% (1.3182 => 1.7225, std.dev.: 0.0153) SingleSource/Benchmarks/Misc-C++/stepanov_container: 21.30% (5.7688 => 6.9976, std.dev.: 0.3228) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 16.70% (6.4890 => 7.5725, std.dev.: 0.0301) MultiSource/Applications/JM/lencod/lencod: 9.58% (7.5602 => 8.2842, std.dev.: 0.0499) MultiSource/Applications/lemon/lemon: 9.50% (1.4361 => 1.5726, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 8.82% (1.5281 => 1.6629, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: 7.30% (1.9547 => 2.0974, std.dev.: 0.0183) MultiSource/Applications/ClamAV/clamscan: 7.15% (0.1539 => 0.1649, std.dev.: 0.0017) MultiSource/Applications/siod/siod: 6.83% (3.1829 => 3.4003, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 6.14% (3.3910 => 3.5993, std.dev.: 0.0311) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 4.50% (6.1319 => 6.4080, std.dev.: 0.1034) SingleSource/Benchmarks/McGill/chomp: 3.97% (1.2680 => 1.3184, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 3.47% (4.6727 => 4.8350, std.dev.: 0.0570) MultiSource/Applications/sqlite3/sqlite3: 3.11% (4.5893 => 4.7321, std.dev.: 0.0344) MultiSource/Benchmarks/Olden/em3d/em3d: 2.95% (3.1099 => 3.2017, std.dev.: 0.0074) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (2.0094 => 2.0415, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.58% (5.3997 => 5.4850, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.28% (6.0626 => 6.1399, std.dev.: 0.0235) SingleSource/Benchmarks/LivermoreLoops/kernel14: 1.11% (1.5633 => 1.5806, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/aha/aha: -12.42% (0.1522 => 0.1333, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -9.27% (0.3893 => 0.3532, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -8.73% (0.4378 => 0.3996, std.dev.: 0.0146) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.29% (0.2087 => 0.1914, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -8.07% (0.4388 => 0.4034, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -7.40% (0.1446 => 0.1339, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -7.31% (1.4428 => 1.3374, std.dev.: 0.0263) SingleSource/Benchmarks/Shootout-C++/hello: -5.82% (0.3368 => 0.3172, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/heapsort: -2.85% (0.3546 => 0.3445, std.dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -16.39% (4.5462 => 3.8013, std.dev.: 0.1307) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -14.16% (6.2656 => 5.3787, std.dev.: 0.0910) MultiSource/Applications/SPASS/SPASS: -12.39% (14.6320 => 12.8190, std.dev.: 0.2470) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -9.95% (0.4553 => 0.4100, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/strcat: -5.80% (0.2050 => 0.1931, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.41% (1.8189 => 1.7386, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 2.24% (0.1337 => 0.1367, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.48% (0.0420 => 0.0418, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0652 => 0.0653, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -0.02% (494.0596 => 493.9789, std.dev.: 0.1820) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/power/power: 43704.11% (1.1277 => 493.9789, std.dev.: 0.1820) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 218.78% (0.5229 => 1.6669, std.dev.: 0.0330) MultiSource/Applications/SPASS/SPASS: 23.06% (14.9895 => 18.4468, std.dev.: 0.0823) MultiSource/Applications/kimwitu++/kc: 53.67% (14.1553 => 21.7521, std.dev.: 0.1353) MultiSource/Benchmarks/MallocBench/gs/gs: 16.69% (4.1105 => 4.7964, std.dev.: 0.0593) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.27% (1.1048 => 1.5166, std.dev.: 0.0738) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 427.25% (7.1582 => 37.7418, std.dev.: 0.4961) SingleSource/Benchmarks/Misc-C++-EH/spirit: 79.55% (3.4629 => 6.2178, std.dev.: 0.3336) SingleSource/Benchmarks/Misc-C++/stepanov_container: 86.55% (0.6222 => 1.1607, std.dev.: 0.0094) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11405.83% (0.0720 => 8.2842, std.dev.: 0.0499) MultiSource/Applications/SIBsim4/SIBsim4: 3862400.00% (0.0001 => 3.8625, std.dev.: 0.0183) MultiSource/Applications/SPASS/SPASS: 12818900.00% (0.0001 => 12.8190, std.dev.: 0.2470) MultiSource/Applications/kimwitu++/kc: 51900.00% (0.0001 => 0.0520) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 577400.00% (0.0001 => 0.5775, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10091700.00% (0.0001 => 10.0918, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6997500.00% (0.0001 => 6.9976, std.dev.: 0.3228) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1781.90% (1.1194 => 21.0660, std.dev.: 0.2489) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 79.01% (2.9384 => 5.2600, std.dev.: 0.0875) MultiSource/Applications/ClamAV/clamscan: 69.37% (22.1758 => 37.5593, std.dev.: 0.3767) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 59.16% (7.0540 => 11.2269, std.dev.: 0.1796) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 55.63% (8.1363 => 12.6623, std.dev.: 0.0667) SingleSource/Benchmarks/CoyoteBench/almabench: 50.68% (0.0730 => 0.1100, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 48.93% (21.9371 => 32.6707, std.dev.: 0.1961) MultiSource/Benchmarks/FreeBench/distray/distray: 46.12% (0.1056 => 0.1543, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 39.94% (0.1432 => 0.2004, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 36.70% (0.0793 => 0.1084, std.dev.: 0.0009) SingleSource/UnitTests/vla: 35.77% (0.0355 => 0.0482, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/15-trie/trie: 35.67% (0.0527 => 0.0715, std.dev.: 0.0014) SingleSource/Benchmarks/Stanford/Towers: 34.39% (0.0471 => 0.0633, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 32.66% (0.0842 => 0.1117, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/17-bintr/bintr: 31.85% (0.0675 => 0.0890, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 31.17% (0.2554 => 0.3350, std.dev.: 0.0110) MultiSource/Applications/lambda-0_1_3/lambda: 31.05% (0.7433 => 0.9741, std.dev.: 0.0129) MultiSource/Benchmarks/Ptrdist/ft/ft: 30.62% (0.1940 => 0.2534, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 29.75% (0.7115 => 0.9232, std.dev.: 0.0152) MultiSource/Applications/lemon/lemon: 29.15% (1.0722 => 1.3847, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 29.03% (0.1695 => 0.2187, std.dev.: 0.0022) MultiSource/Applications/d/make_dparser: 28.91% (3.3354 => 4.2997, std.dev.: 0.0143) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.97% (0.0479 => 0.0613, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/18-imp/imp: 27.87% (0.3423 => 0.4377, std.dev.: 0.0089) MultiSource/Applications/oggenc/oggenc: 27.83% (5.7591 => 7.3618, std.dev.: 0.0162) SingleSource/Benchmarks/Stanford/Treesort: 27.49% (0.0411 => 0.0524, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 27.37% (0.1655 => 0.2108, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/exptree: 27.03% (0.0814 => 0.1034, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 26.99% (4.2646 => 5.4158, std.dev.: 0.0102) MultiSource/Benchmarks/SciMark2-C/scimark2: 26.85% (0.3121 => 0.3959, std.dev.: 0.0067) MultiSource/Benchmarks/NPB-serial/is/is: 26.84% (0.0719 => 0.0912, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 26.69% (0.5860 => 0.7424, std.dev.: 0.0062) MultiSource/Applications/spiff/spiff: 26.69% (0.7835 => 0.9926, std.dev.: 0.0192) MultiSource/Benchmarks/Ptrdist/ks/ks: 26.36% (0.1510 => 0.1908, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 26.27% (0.0491 => 0.0620, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/RealMM: 26.26% (0.0396 => 0.0500, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: 26.04% (0.0626 => 0.0789, std.dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 25.79% (0.1555 => 0.1956, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 25.63% (0.3180 => 0.3995, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 25.47% (14.3668 => 18.0265, std.dev.: 0.1497) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 25.34% (0.9765 => 1.2239, std.dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 25.27% (0.4615 => 0.5781, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.80% (0.0746 => 0.0931, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 24.72% (2.2024 => 2.7468, std.dev.: 0.0679) MultiSource/Benchmarks/llubenchmark/llu: 24.68% (0.0462 => 0.0576, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/mst/mst: 24.59% (0.1163 => 0.1449, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 24.31% (4.9449 => 6.1468, std.dev.: 0.0159) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 24.09% (0.6450 => 0.8004, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/misr: 24.01% (0.0633 => 0.0785, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 23.56% (0.8101 => 1.0010, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/05-eks/eks: 22.59% (0.4299 => 0.5270, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 21.84% (0.0838 => 0.1021, std.dev.: 0.0022) SingleSource/UnitTests/2006-12-11-LoadConstants: 21.78% (0.1143 => 0.1392, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.71% (0.1566 => 0.1906, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 21.67% (0.3092 => 0.3762, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.91% (0.0770 => 0.0931, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 20.91% (0.2430 => 0.2938, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: 20.85% (0.1175 => 0.1420, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.83% (0.1584 => 0.1914, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 20.74% (3.8922 => 4.6996, std.dev.: 0.1380) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.05% (1.3050 => 1.5667, std.dev.: 0.0278) SingleSource/Benchmarks/Shootout-C++/heapsort: 19.95% (0.2872 => 0.3445, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.78% (0.0834 => 0.0999, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.56% (0.1125 => 0.1345, std.dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 19.48% (9.4845 => 11.3317, std.dev.: 0.1980) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.37% (0.2700 => 0.3223, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 19.27% (0.0929 => 0.1108, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.03% (0.8172 => 0.9727, std.dev.: 0.0318) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.68% (0.3162 => 0.3721, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.59% (2.0665 => 2.4300, std.dev.: 0.0828) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 17.23% (0.1892 => 0.2218, std.dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.22% (0.0871 => 0.1021, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hello: 16.88% (0.2714 => 0.3172, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.76% (0.2065 => 0.2411, std.dev.: 0.0112) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.67% (0.0648 => 0.0756, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists: 16.66% (0.3422 => 0.3992, std.dev.: 0.0121) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.47% (0.0953 => 0.1110, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.14% (0.0886 => 0.1029, std.dev.: 0.0054) MultiSource/Applications/aha/aha: 15.81% (0.1151 => 0.1333, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.76% (0.1117 => 0.1293, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/health/health: 15.69% (0.1268 => 0.1467, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 15.66% (63.2438 => 73.1482, std.dev.: 0.1054) MultiSource/Applications/lua/lua: 15.48% (3.8723 => 4.4718, std.dev.: 0.0174) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.45% (0.0770 => 0.0889, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.31% (2.2022 => 2.5393, std.dev.: 0.0180) MultiSource/Applications/sqlite3/sqlite3: 15.14% (17.1811 => 19.7825, std.dev.: 0.2257) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.03% (0.1337 => 0.1538, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 14.88% (1.1642 => 1.3374, std.dev.: 0.0263) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.76% (0.2107 => 0.2418, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 14.52% (2.0273 => 2.3217, std.dev.: 0.0438) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.50% (0.5981 => 0.6848, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.48% (0.1029 => 0.1178, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 14.48% (0.3177 => 0.3637, std.dev.: 0.0101) MultiSource/Benchmarks/PAQ8p/paq8p: 14.24% (10.3673 => 11.8439, std.dev.: 0.2075) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.20% (0.5569 => 0.6360, std.dev.: 0.0137) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.15% (0.1032 => 0.1178, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 14.13% (0.3927 => 0.4482, std.dev.: 0.0211) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.05% (0.2271 => 0.2590, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 13.91% (0.2049 => 0.2334, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/exceptions-4: 13.86% (0.3543 => 0.4034, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.83% (0.3441 => 0.3917, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.79% (0.3473 => 0.3952, std.dev.: 0.0144) SingleSource/UnitTests/ObjC/property: 13.77% (0.3886 => 0.4421, std.dev.: 0.0199) SingleSource/UnitTests/ObjC/exceptions-3: 13.65% (0.3516 => 0.3996, std.dev.: 0.0146) SingleSource/UnitTests/ObjC/exceptions-2: 13.64% (0.3497 => 0.3974, std.dev.: 0.0154) SingleSource/UnitTests/ObjC/synchronized: 13.62% (0.3561 => 0.4046, std.dev.: 0.0165) MultiSource/Applications/sgefa/sgefa: 13.61% (0.3109 => 0.3532, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 13.53% (0.3828 => 0.4346, std.dev.: 0.0181) SingleSource/UnitTests/ObjC/for-in: 13.40% (0.3694 => 0.4189, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.30% (1.5415 => 1.7465, std.dev.: 0.0353) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.26% (0.3650 => 0.4134, std.dev.: 0.0176) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.24% (5.0018 => 5.6138, std.dev.: 0.0614) SingleSource/UnitTests/ObjC++/property-reference: 12.09% (0.7326 => 0.8212, std.dev.: 0.0303) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 12.07% (0.1044 => 0.1170, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.96% (0.1906 => 0.2134, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.29% (0.2603 => 0.2897, std.dev.: 0.0112) MultiSource/Applications/hbd/hbd: 10.99% (1.5603 => 1.7318, std.dev.: 0.0566) SingleSource/UnitTests/ObjC++/property-reference-object: 10.70% (0.6030 => 0.6675, std.dev.: 0.0196) MultiSource/Benchmarks/Prolangs-C/football/football: 10.57% (0.8921 => 0.9864, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.47% (1.4186 => 1.5671, std.dev.: 0.0263) MultiSource/Benchmarks/sim/sim: 10.16% (0.3387 => 0.3731, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.67% (0.3826 => 0.4196, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 8.41% (1.2842 => 1.3922, std.dev.: 0.0375) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.97% (0.3136 => 0.3386, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.85% (0.3427 => 0.3696, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: 4.12% (54.1659 => 56.3994, std.dev.: 0.3902) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.00% (0.4879 => 0.5074, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.22% (4.3953 => 10.9981, std.dev.: 0.0216) SingleSource/Benchmarks/Shootout-C++/methcall: 147.65% (5.3999 => 13.3730, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/17-bintr/bintr: 130.30% (0.1043 => 0.2402, std.dev.: 0.0092) MultiSource/Benchmarks/llubenchmark/llu: 116.11% (3.7781 => 8.1650, std.dev.: 0.2780) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 45.21% (0.3256 => 0.4728, std.dev.: 0.0094) MultiSource/Benchmarks/McCat/09-vor/vor: 38.65% (0.1154 => 0.1600, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 35.32% (1.5086 => 2.0415, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/ft/ft: 34.17% (1.2838 => 1.7225, std.dev.: 0.0153) MultiSource/Applications/minisat/minisat: 25.88% (9.1159 => 11.4755, std.dev.: 0.4936) SingleSource/Benchmarks/Misc/oourafft: 17.46% (6.6465 => 7.8071, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.65% (1.1145 => 1.3001, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 13.98% (3.1578 => 3.5993, std.dev.: 0.0311) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.84% (0.2944 => 0.3322, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.36% (8.6802 => 9.7528, std.dev.: 0.2020) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.57% (2.8904 => 3.2249, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/richards_benchmark: 10.29% (1.1396 => 1.2569, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.45% (1.7254 => 1.8885, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/mst/mst: 9.34% (0.1285 => 0.1405, std.dev.: 0.0043) MultiSource/Applications/lemon/lemon: 8.76% (1.4460 => 1.5726, std.dev.: 0.0114) MultiSource/Benchmarks/Olden/bh/bh: 8.09% (1.9405 => 2.0974, std.dev.: 0.0183) SingleSource/Benchmarks/McGill/chomp: 6.55% (1.2373 => 1.3184, std.dev.: 0.0126) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.96% (0.9540 => 1.0109, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.67% (4.2280 => 4.4678, std.dev.: 0.0051) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 4.52% (26.0924 => 27.2705, std.dev.: 0.2066) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.6436 => 12.1298, std.dev.: 0.0145) MultiSource/Benchmarks/Olden/bisort/bisort: 4.01% (0.8333 => 0.8667, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 3.71% (0.4445 => 0.4610, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 3.58% (3.2827 => 3.4003, std.dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 3.20% (3.1023 => 3.2017, std.dev.: 0.0074) SingleSource/Benchmarks/Dhrystone/dry: 2.66% (2.4116 => 2.4757, std.dev.: 0.0075) MultiSource/Benchmarks/PAQ8p/paq8p: 2.30% (85.0658 => 87.0226, std.dev.: 0.0246) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 2.07% (3.1595 => 3.2250, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (27.8444 => 28.3074, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.56% (2.3135 => 2.3497, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.30% (6.5088 => 6.5936, std.dev.: 0.0131) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.29% (1.0313 => 1.0446, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0502, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.13% (5.2139 => 5.2729, std.dev.: 0.0085) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1690, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.83% (5.2763 => 1.2225, std.dev.: 0.0684) SingleSource/Benchmarks/Misc/salsa20: -74.32% (0.8651 => 0.2222, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: -36.99% (0.1622 => 0.1022, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.98% (5.3855 => 5.0094, std.dev.: 0.0546) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.50% (5.3526 => 5.0048, std.dev.: 0.0728) MultiSource/Applications/JM/ldecod/ldecod: -6.46% (10.4361 => 9.7615, std.dev.: 0.1853) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.11% (0.3987 => 0.2388, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.29% (4.5009 => 2.7773, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -26.31% (10.7105 => 7.8930, std.dev.: 0.1195) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.18% (2.6546 => 2.0128, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/mason/mason: -19.20% (0.2161 => 0.1746, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4263, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.69% (2.6778 => 2.2844, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.63% (32.5116 => 29.0564, std.dev.: 0.0086) MultiSource/Benchmarks/NPB-serial/is/is: -10.40% (9.5636 => 8.5693, std.dev.: 0.1721) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.05% (1.5660 => 1.4243, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.2416 => 3.0211, std.dev.: 0.0309) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.61% (2.7294 => 2.5764, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.14% (1.8329 => 1.7386, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -5.05% (1.5835 => 1.5036, std.dev.: 0.0051) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.72% (1.6805 => 1.6012, std.dev.: 0.0260) SingleSource/Benchmarks/Shootout/lists: -4.43% (6.2999 => 6.0208, std.dev.: 0.0114) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.33% (19.9488 => 19.2840, std.dev.: 0.0874) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8914, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.23% (0.4808 => 0.4701, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.08% (0.9957 => 0.9750, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.81% (8.1563 => 8.0090, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -1.51% (10.2830 => 10.1276, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -7.95% (0.1485 => 0.1367, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.14% (0.2116 => 0.0653, std.dev.: 0.0007) Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 17:34:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 19:34:00 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121121013400.26FB22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6091?compare_to=6087&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6091, Order: 168394, Start Time: 2012-11-20 23:55:52, End Time: 2012-11-21 01:34:25 To: 6087, Order: 168384, Start Time: 2012-11-20 22:00:46, End Time: 2012-11-20 23:35:55 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 47 (83 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1007 (872 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01: 68.22% (0.1032 => 0.1736, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 62.67% (0.0450 => 0.0732, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: 57.31% (0.0253 => 0.0398, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 54.96% (0.0464 => 0.0719, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/fp-convert: 54.61% (0.0271 => 0.0419, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel-2: 52.66% (0.0319 => 0.0487, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 49.19% (0.1923 => 0.2869, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 38.94% (0.3118 => 0.4332, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 35.01% (1.2261 => 1.6554, std.dev.: 0.0954) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 33.22% (0.1490 => 0.1985, std.dev.: 0.0170) MultiSource/Applications/spiff/spiff: 30.41% (0.8496 => 1.1080, std.dev.: 0.0889) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 27.36% (6.7621 => 8.6119, std.dev.: 0.2880) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 24.11% (1.3096 => 1.6253, std.dev.: 0.0829) MultiSource/Applications/treecc/treecc: 15.33% (2.0635 => 2.3799, std.dev.: 0.1175) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.70% (1.6796 => 1.9265, std.dev.: 0.0891) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.14% (13.6586 => 15.4530, std.dev.: 0.2684) SingleSource/Benchmarks/Misc-C++-EH/spirit: 11.35% (5.4316 => 6.0480, std.dev.: 0.0963) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.39% (1.5751 => 1.7230, std.dev.: 0.0170) MultiSource/Applications/siod/siod: 9.17% (2.3011 => 2.5122, std.dev.: 0.0409) MultiSource/Applications/oggenc/oggenc: 6.65% (5.0965 => 5.4354, std.dev.: 0.0129) MultiSource/Applications/minisat/minisat: 6.24% (0.7105 => 0.7548, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.38% (0.2101 => 0.2214, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.56% (0.8649 => 0.9043, std.dev.: 0.0112) MultiSource/Benchmarks/McCat/18-imp/imp: 4.00% (0.3553 => 0.3695, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 63.24% (0.0457 => 0.0746, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/Towers: 54.59% (0.0196 => 0.0303, std.dev.: 0.0034) SingleSource/Benchmarks/Stanford/Queens: 31.89% (0.0323 => 0.0426, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/pi: 28.38% (1.9192 => 2.4639, std.dev.: 0.0223) SingleSource/Benchmarks/CoyoteBench/fftbench: 28.35% (1.4828 => 1.9031, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/stepanov_container: 28.27% (4.5826 => 5.8781, std.dev.: 0.1259) SingleSource/Benchmarks/LivermoreLoops/kernel17: 28.25% (0.0669 => 0.0858, std.dev.: 0.0007) SingleSource/Benchmarks/LivermoreLoops/kernel13: 24.71% (0.1748 => 0.2180, std.dev.: 0.0096) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 23.67% (2.4444 => 3.0229, std.dev.: 0.0298) MultiSource/Applications/minisat/minisat: 22.37% (6.2577 => 7.6577, std.dev.: 0.1641) SingleSource/Benchmarks/LivermoreLoops/kernel01: 21.36% (0.2523 => 0.3062, std.dev.: 0.0195) SingleSource/Benchmarks/CoyoteBench/lpbench: 17.88% (3.9152 => 4.6153, std.dev.: 0.1749) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.01% (2.6014 => 3.0440, std.dev.: 0.1042) MultiSource/Applications/SPASS/SPASS: 13.83% (8.7995 => 10.0166, std.dev.: 0.1377) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.17% (3.8989 => 4.2953, std.dev.: 0.1362) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.20% (39.5157 => 40.7797, std.dev.: 0.0330) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.79% (13.5570 => 13.9353, std.dev.: 0.0702) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.79% (59.7308 => 61.3972, std.dev.: 0.2742) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.29% (1.5994 => 1.6361, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/flops-3: 2.07% (2.0685 => 2.1113, std.dev.: 0.0157) MultiSource/Applications/lua/lua: 1.97% (28.9382 => 29.5096, std.dev.: 0.1722) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.76% (9.6598 => 9.8295, std.dev.: 0.0443) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.58% (1.6698 => 1.6962, std.dev.: 0.0084) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.72% (1.0847 => 1.0660, std.dev.: 0.2793) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 13.30% (0.0218 => 0.0247, std.dev.: 0.0063) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.42% (0.0424 => 0.0447, std.dev.: 0.0122) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 4.53% (0.0331 => 0.0346, std.dev.: 0.0093) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.56% (0.0313 => 0.0321, std.dev.: 0.0095) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 3.09% (0.0421 => 0.0434, std.dev.: 0.0105) SingleSource/UnitTests/Vector/Altivec/casts: 3.92% (0.0204 => 0.0212, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/test1: 2.28% (0.0219 => 0.0224, std.dev.: 0.0060) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.59% (0.1503 => 0.1587, std.dev.: 0.0054) MultiSource/Applications/lemon/lemon: 15.41% (1.1375 => 1.3128, std.dev.: 0.3989) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.07% (0.4176 => 0.4304, std.dev.: 0.0255) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 27.46% (0.1424 => 0.1815, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.50% (0.0008 => 0.0009, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.89% (0.0631 => 0.0706, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.96% (0.0247 => 0.0279, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 25.25% (0.0606 => 0.0759, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.44% (1.1952 => 1.2005, std.dev.: 0.0091) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 53.57% (0.0028 => 0.0043, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 440.00% (0.0005 => 0.0027, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.77% (0.0645 => 0.0708, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 12.55% (0.0239 => 0.0269, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.65% (0.7797 => 0.7848, std.dev.: 0.0228) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: -50.00% (0.0002 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -22.86% (0.0070 => 0.0054, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 10.92% (16.4461 => 18.2421, std.dev.: 0.7479) MultiSource/Applications/sqlite3/sqlite3: 2478.06% (0.6332 => 16.3243, std.dev.: 0.3776) MultiSource/Benchmarks/McCat/08-main/main: 55.43% (0.1831 => 0.2846, std.dev.: 0.0351) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.32% (0.1559 => 0.1554, std.dev.: 0.0172) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7055.88% (0.3123 => 22.3478, std.dev.: 0.9681) SingleSource/Benchmarks/CoyoteBench/fftbench: 52.90% (0.2463 => 0.3766, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1708.61% (0.3344 => 6.0480, std.dev.: 0.0963) SingleSource/Benchmarks/Misc-C++/Large/ray: 44.63% (0.2364 => 0.3419, std.dev.: 0.1077) SingleSource/Benchmarks/Misc-C++/bigfib: 9.57% (0.6010 => 0.6585, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/mandel: 23.78% (0.0429 => 0.0531, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.99% (0.3266 => 0.3625, std.dev.: 0.0637) SingleSource/Benchmarks/Shootout-C++/strcat: 9.75% (0.1969 => 0.2161, std.dev.: 0.0602) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.04% (0.0224 => 0.0242, std.dev.: 0.0079) SingleSource/UnitTests/byval-alignment: -23.04% (0.0230 => 0.0177, std.dev.: 0.0048) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0526, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 13.27% (0.1462 => 0.1656, std.dev.: 0.0122) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.5084, std.dev.: 0.0347) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0712, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4966, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5162, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.9031, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3741, std.dev.: 0.0984) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1645, std.dev.: 0.0380) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3706, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4098, std.dev.: 0.0200) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0847, std.dev.: 0.0432) SingleSource/Regression/C/uint64_to_float: -24.10% (2.1832 => 1.6571, std.dev.: 0.0051) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 69.36% (0.0235 => 0.0398, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 67.12% (0.0438 => 0.0732, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: 66.93% (0.0251 => 0.0419, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel-2: 62.33% (0.0300 => 0.0487, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 58.37% (0.0454 => 0.0719, std.dev.: 0.0051) SingleSource/Benchmarks/Stanford/Quicksort: 52.41% (0.0353 => 0.0538, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 52.20% (0.1885 => 0.2869, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout/nestedloop: 50.75% (0.0266 => 0.0401, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 44.50% (0.2998 => 0.4332, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 41.67% (1.1685 => 1.6554, std.dev.: 0.0954) MultiSource/Applications/spiff/spiff: 39.37% (0.7950 => 1.1080, std.dev.: 0.0889) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 39.30% (0.1425 => 0.1985, std.dev.: 0.0170) SingleSource/Benchmarks/Misc/flops-6: 37.06% (0.0286 => 0.0392, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 30.34% (6.6074 => 8.6119, std.dev.: 0.2880) MultiSource/Applications/viterbi/viterbi: 30.18% (0.1577 => 0.2053, std.dev.: 0.0148) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 29.75% (1.2526 => 1.6253, std.dev.: 0.0829) MultiSource/Applications/treecc/treecc: 19.31% (1.9948 => 2.3799, std.dev.: 0.1175) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.67% (4.1763 => 4.9143, std.dev.: 0.2603) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.57% (1.6386 => 1.9265, std.dev.: 0.0891) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.24% (13.1811 => 15.4530, std.dev.: 0.2684) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.66% (0.0830 => 0.0960, std.dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 14.12% (14.2605 => 16.2742, std.dev.: 0.7588) MultiSource/Applications/siod/siod: 13.24% (2.2184 => 2.5122, std.dev.: 0.0409) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.50% (1.5315 => 1.7230, std.dev.: 0.0170) MultiSource/Applications/minisat/minisat: 10.45% (0.6834 => 0.7548, std.dev.: 0.0084) MultiSource/Applications/oggenc/oggenc: 9.52% (4.9628 => 5.4354, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.43% (0.8340 => 0.9043, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.69% (0.1778 => 0.1897, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.49% (0.9688 => 1.0317, std.dev.: 0.0176) MultiSource/Benchmarks/McCat/18-imp/imp: 5.48% (0.3503 => 0.3695, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.88% (0.2111 => 0.2214, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.85% (0.6227 => 0.6529, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.84% (0.8331 => 0.8734, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/lists: 4.78% (0.2513 => 0.2633, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/moments: 4.28% (0.3645 => 0.3801, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 4.08% (0.8261 => 0.8598, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.79% (0.9908 => 1.0284, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 3.43% (0.8069 => 0.8346, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.37% (0.8995 => 0.9298, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.18% (0.8656 => 0.8931, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.14% (0.8317 => 0.8578, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.84% (0.8712 => 0.8959, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 123.62% (0.0199 => 0.0445, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 83.74% (0.0406 => 0.0746, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/pi: 55.99% (1.5795 => 2.4639, std.dev.: 0.0223) SingleSource/Benchmarks/Stanford/Queens: 52.69% (0.0279 => 0.0426, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 29.44% (0.3186 => 0.4124, std.dev.: 0.0269) SingleSource/Benchmarks/Misc-C++/stepanov_container: 29.06% (4.5547 => 5.8781, std.dev.: 0.1259) MultiSource/Applications/minisat/minisat: 24.46% (6.1525 => 7.6577, std.dev.: 0.1641) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 24.23% (2.4333 => 3.0229, std.dev.: 0.0298) MultiSource/Applications/SPASS/SPASS: 18.78% (8.4326 => 10.0166, std.dev.: 0.1377) SingleSource/Benchmarks/CoyoteBench/lpbench: 18.32% (3.9006 => 4.6153, std.dev.: 0.1749) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.15% (2.5763 => 3.0440, std.dev.: 0.1042) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.15% (0.7597 => 0.8824, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.04% (2.9753 => 3.4525, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.92% (2.7995 => 3.2172, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/moments: 14.86% (0.0949 => 0.1090, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.91% (5.0261 => 5.6245, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.61% (3.9188 => 4.2953, std.dev.: 0.1362) MultiSource/Applications/SIBsim4/SIBsim4: 8.40% (3.1873 => 3.4551, std.dev.: 0.0483) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.89% (1.1857 => 1.2792, std.dev.: 0.0213) SingleSource/Benchmarks/McGill/queens: 7.65% (1.7056 => 1.8360, std.dev.: 0.0322) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.59% (4.7794 => 5.0944, std.dev.: 0.0343) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.58% (4.5327 => 4.8310, std.dev.: 0.0851) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.87% (4.9686 => 5.2602, std.dev.: 0.0437) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.94% (6.2275 => 6.5353, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.83% (3.3761 => 3.5392, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.20% (4.9469 => 5.1547, std.dev.: 0.0441) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.17% (4.9453 => 5.1517, std.dev.: 0.0580) MultiSource/Applications/hexxagon/hexxagon: 4.06% (14.0064 => 14.5750, std.dev.: 0.0193) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 4.01% (39.2082 => 40.7797, std.dev.: 0.0330) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.60% (59.2638 => 61.3972, std.dev.: 0.2742) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.46% (0.3587 => 0.3711, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: 3.16% (7.3375 => 7.5691, std.dev.: 0.0165) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.63% (1.5941 => 1.6361, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.48% (8.2783 => 8.4836, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/flops-3: 2.14% (2.0670 => 2.1113, std.dev.: 0.0157) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.06% (1.6619 => 1.6962, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.04% (11.5690 => 11.8053, std.dev.: 0.0404) MultiSource/Benchmarks/Olden/bh/bh: 1.59% (2.3560 => 2.3935, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.46% (22.2997 => 22.6263, std.dev.: 0.0872) MultiSource/Benchmarks/FreeBench/neural/neural: 1.45% (1.0841 => 1.0998, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.34% (3.5679 => 3.6158, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.54% (5.4641 => 4.3420, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.53% (7.2130 => 6.2372, std.dev.: 0.0824) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.68% (1.0512 => 0.9389, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: -8.42% (63.1822 => 57.8598, std.dev.: 0.5066) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.76% (4.7482 => 4.4270, std.dev.: 0.0598) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.53% (3.7148 => 3.5092, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.45% (5.4972 => 5.1978, std.dev.: 0.0686) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.02% (5.1557 => 4.8967, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.85% (14.6451 => 13.9353, std.dev.: 0.0702) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.33% (4.7449 => 4.5393, std.dev.: 0.0482) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.68% (6.0224 => 5.8007, std.dev.: 0.0538) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.31% (0.5807 => 0.5615, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.97% (28.5821 => 27.7330, std.dev.: 0.1118) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.84% (2.6356 => 2.5608, std.dev.: 0.0281) MultiSource/Applications/aha/aha: -2.19% (3.3398 => 3.2665, std.dev.: 0.0245) SingleSource/Benchmarks/Shootout-C++/hash2: -1.98% (3.4237 => 3.3560, std.dev.: 0.0235) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.92% (11.5316 => 11.3101, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.56% (4.9994 => 4.9216, std.dev.: 0.0226) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.13% (5.6343 => 5.5704, std.dev.: 0.0209) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.88% (1.0262 => 1.0660, std.dev.: 0.2793) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 100.81% (0.0123 => 0.0247, std.dev.: 0.0063) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 9.56% (0.0408 => 0.0447, std.dev.: 0.0122) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 36.22% (0.0254 => 0.0346, std.dev.: 0.0093) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 6.29% (0.0302 => 0.0321, std.dev.: 0.0095) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 13.02% (0.0384 => 0.0434, std.dev.: 0.0105) SingleSource/UnitTests/Vector/Altivec/casts: 11.58% (0.0190 => 0.0212, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/test1: 24.44% (0.0180 => 0.0224, std.dev.: 0.0060) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 100.00% (0.0007 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 10.36% (0.1438 => 0.1587, std.dev.: 0.0054) MultiSource/Applications/lemon/lemon: 15.88% (1.1329 => 1.3128, std.dev.: 0.3989) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.36% (0.4164 => 0.4304, std.dev.: 0.0255) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 32.58% (0.1369 => 0.1815, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.50% (0.0008 => 0.0009, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.14% (0.0641 => 0.0706, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 43.08% (0.0195 => 0.0279, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 31.31% (0.0578 => 0.0759, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.97% (1.1437 => 1.2005, std.dev.: 0.0091) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 4200.00% (0.0001 => 0.0043, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.92% (0.0627 => 0.0708, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 49.44% (0.0180 => 0.0269, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.11% (0.8017 => 0.7848, std.dev.: 0.0228) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -12.90% (0.0062 => 0.0054, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 17:46:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 19:46:52 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121121014652.68DE92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6092?compare_to=6088&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6092, Order: 168397, Start Time: 2012-11-21 00:13:33, End Time: 2012-11-21 01:47:16 To: 6088, Order: 168384, Start Time: 2012-11-20 22:16:18, End Time: 2012-11-20 23:49:46 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 1 (177 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (860 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.44% (3.8002 => 3.7456, std.dev.: 0.0062) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 9.42% (0.3834 => 0.4195, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1017, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/salsa20: 2.45% (7.4937 => 7.6774, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash2: 2.12% (3.1932 => 3.2609, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.03% (0.3821 => 0.3514, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.78% (0.9542 => 0.8895, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.58% (2.4924 => 2.3284, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: -6.49% (0.3357 => 0.3139, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.47% (0.3831 => 0.3583, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.42% (0.3848 => 0.3601, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.42% (0.3880 => 0.3631, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.42% (0.3896 => 0.3646, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.25% (0.4033 => 0.3781, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -6.24% (0.3812 => 0.3574, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.23% (0.3884 => 0.3642, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: -6.23% (0.4176 => 0.3916, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.22% (0.3891 => 0.3649, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.11% (9.2283 => 8.6649, std.dev.: 0.0042) MultiSource/Applications/JM/lencod/lencod: -6.05% (16.1920 => 15.2125, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.01% (0.1796 => 0.1688, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.01% (0.2428 => 0.2282, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -6.00% (0.4199 => 0.3947, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.94% (0.2355 => 0.2215, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.93% (0.7198 => 0.6771, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.92% (0.9852 => 0.9269, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -5.85% (0.1879 => 0.1769, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.85% (0.6484 => 0.6105, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: -5.83% (7.0961 => 6.6822, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.76% (1.3722 => 1.2932, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.75% (4.8161 => 4.5391, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.73% (3.5339 => 3.3313, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.72% (1.0544 => 0.9941, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: -5.68% (0.9179 => 0.8658, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.67% (6.7716 => 6.3879, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.66% (0.5478 => 0.5168, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.66% (0.3658 => 0.3451, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -5.65% (0.4280 => 0.4038, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.65% (0.5863 => 0.5532, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.64% (4.0323 => 3.8050, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.60% (1.6364 => 1.5447, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.57% (0.2695 => 0.2545, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.55% (4.8802 => 4.6093, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.53% (0.5591 => 0.5282, std.dev.: 0.0047) MultiSource/Applications/lemon/lemon: -5.50% (1.1450 => 1.0820, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.50% (1.2300 => 1.1624, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: -5.49% (0.3406 => 0.3219, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/gs/gs: -5.48% (4.3330 => 4.0955, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.48% (1.4642 => 1.3840, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.47% (0.6667 => 0.6302, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.46% (0.5859 => 0.5539, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.46% (0.5805 => 0.5488, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: -5.46% (1.1530 => 1.0901, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.45% (0.5857 => 0.5538, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.44% (0.6052 => 0.5723, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.43% (0.5705 => 0.5395, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.42% (0.3837 => 0.3629, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.42% (0.5925 => 0.5604, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.41% (0.6660 => 0.6300, std.dev.: 0.0079) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.41% (4.5069 => 4.2633, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/bh/bh: -5.39% (0.2985 => 0.2824, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.39% (0.3931 => 0.3719, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: -5.37% (1.2515 => 1.1843, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.37% (0.5849 => 0.5535, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.36% (0.6736 => 0.6375, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: -5.36% (0.3025 => 0.2863, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.36% (0.6293 => 0.5956, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.35% (0.6446 => 0.6101, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.35% (0.6230 => 0.5897, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: -5.33% (0.2871 => 0.2718, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.33% (0.6194 => 0.5864, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.32% (0.4151 => 0.3930, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -5.32% (17.1032 => 16.1935, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.30% (0.6297 => 0.5963, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.30% (0.6304 => 0.5970, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.29% (0.5575 => 0.5280, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: -5.28% (0.3255 => 0.3083, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.28% (0.6189 => 0.5862, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.28% (0.5570 => 0.5276, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.27% (0.5802 => 0.5496, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.27% (1.2784 => 1.2110, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.27% (0.3016 => 0.2857, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -5.27% (1.3148 => 1.2455, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.27% (0.8521 => 0.8072, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.27% (2.1713 => 2.0569, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.26% (0.3252 => 0.3081, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.24% (0.6260 => 0.5932, std.dev.: 0.0119) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.24% (0.4813 => 0.4561, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -5.23% (0.2160 => 0.2047, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.23% (0.4321 => 0.4095, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.20% (0.3057 => 0.2898, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.20% (0.5581 => 0.5291, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.18% (0.5999 => 0.5688, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.18% (0.2933 => 0.2781, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -5.17% (0.2939 => 0.2787, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: -5.17% (1.3864 => 1.3147, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: -5.16% (0.4515 => 0.4282, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: -5.16% (0.2849 => 0.2702, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.15% (0.7919 => 0.7511, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.15% (0.4916 => 0.4663, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.14% (0.2548 => 0.2417, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (0.5941 => 0.5636, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -5.13% (0.3394 => 0.3220, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -5.12% (0.3026 => 0.2871, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -5.12% (0.2989 => 0.2836, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -5.12% (0.3205 => 0.3041, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.11% (14.2083 => 13.4820, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.11% (0.3483 => 0.3305, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: -5.10% (15.5079 => 14.7164, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/ary3: -5.08% (0.3446 => 0.3271, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.06% (0.6676 => 0.6338, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.06% (0.5456 => 0.5180, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.06% (0.3323 => 0.3155, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.05% (0.2278 => 0.2163, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.03% (0.6681 => 0.6345, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.01% (8.0126 => 7.6108, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.01% (1.2210 => 1.1598, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/08-main/main: -5.00% (0.2659 => 0.2526, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.00% (0.2999 => 0.2849, std.dev.: 0.0043) MultiSource/Applications/minisat/minisat: -5.00% (0.7447 => 0.7075, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.99% (0.6033 => 0.5732, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.98% (1.2221 => 1.1613, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.97% (0.5168 => 0.4911, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.97% (1.6474 => 1.5655, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -4.94% (0.3581 => 0.3404, std.dev.: 0.0034) MultiSource/Applications/d/make_dparser: -4.94% (3.5154 => 3.3418, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: -4.92% (0.4248 => 0.4039, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -4.89% (0.3621 => 0.3444, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.86% (0.6440 => 0.6127, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: -4.84% (0.3059 => 0.2911, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -4.83% (0.3481 => 0.3313, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.82% (0.2385 => 0.2270, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.78% (15.2527 => 14.5229, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.78% (22.4056 => 21.3344, std.dev.: 0.0115) MultiSource/Applications/lua/lua: -4.78% (4.0594 => 3.8654, std.dev.: 0.0076) SingleSource/UnitTests/ObjC++/Hello: -4.77% (0.6347 => 0.6044, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.76% (0.3319 => 0.3161, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.75% (0.4083 => 0.3889, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -4.74% (2.4021 => 2.2883, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: -4.73% (0.7779 => 0.7411, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -4.72% (0.6441 => 0.6137, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -4.71% (0.3867 => 0.3685, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -4.69% (0.4861 => 0.4633, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.69% (0.7021 => 0.6692, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.68% (0.3849 => 0.3669, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.63% (0.4427 => 0.4222, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.60% (0.7524 => 0.7178, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -4.60% (0.7982 => 0.7615, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.59% (0.7339 => 0.7002, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.57% (0.6395 => 0.6103, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.50% (0.5329 => 0.5089, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -4.48% (34.0927 => 32.5669, std.dev.: 0.0035) MultiSource/Applications/treecc/treecc: -4.47% (2.1401 => 2.0445, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -4.45% (18.2933 => 17.4791, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.43% (0.9557 => 0.9134, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.42% (0.5567 => 0.5321, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: -4.34% (0.3271 => 0.3129, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.31% (0.5569 => 0.5329, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.30% (0.6395 => 0.6120, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -4.29% (0.8418 => 0.8057, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: -4.28% (0.3788 => 0.3626, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.26% (2.2587 => 2.1625, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.23% (0.9077 => 0.8693, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: -4.17% (5.0226 => 4.8130, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -4.13% (0.6750 => 0.6471, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.12% (0.3491 => 0.3347, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -4.07% (0.4524 => 0.4340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.56% (5.4682 => 5.2736, std.dev.: 0.0058) MultiSource/Applications/hbd/hbd: -3.45% (1.5610 => 1.5071, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -2.90% (20.7746 => 20.1721, std.dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7550, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: -8.73% (1.2842 => 1.1721, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.89% (2.2633 => 2.1752, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7068, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.73% (1.3096 => 1.2738, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4669, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 19:22:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 21:22:38 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121121032238.309E82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6093?compare_to=6091&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6093, Order: 168409, Start Time: 2012-11-21 01:51:29, End Time: 2012-11-21 03:23:03 To: 6091, Order: 168394, Start Time: 2012-11-20 23:55:52, End Time: 2012-11-21 01:34:25 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 2 (53 on baseline) Performance Improvements: 66 (22 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 986 (899 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 2.02% (1.8540 => 1.8915, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/methcall: 1.54% (8.8970 => 9.0341, std.dev.: 0.0295) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -44.22% (0.0398 => 0.0222, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -44.15% (0.0487 => 0.0272, std.dev.: 0.0025) SingleSource/Benchmarks/LivermoreLoops/kernel01: -39.92% (0.1736 => 0.1043, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: -39.86% (0.0419 => 0.0252, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Quicksort: -34.39% (0.0538 => 0.0353, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.94% (1.6554 => 1.2094, std.dev.: 0.1589) SingleSource/Benchmarks/LivermoreLoops/kernel23: -23.91% (0.1489 => 0.1133, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: -23.08% (0.4090 => 0.3146, std.dev.: 0.0321) SingleSource/Benchmarks/Misc/mandel: -21.85% (0.0531 => 0.0415, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.23% (1.5469 => 1.2185, std.dev.: 0.0163) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -21.15% (0.2747 => 0.2166, std.dev.: 0.0062) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -21.14% (8.6119 => 6.7915, std.dev.: 0.6071) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -20.46% (1.6253 => 1.2927, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ary3: -18.41% (0.3042 => 0.2482, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: -17.73% (0.2053 => 0.1689, std.dev.: 0.0027) SingleSource/UnitTests/SignlessTypes/rem: -17.06% (0.1319 => 0.1094, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -14.58% (0.1461 => 0.1248, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -14.05% (5.4377 => 4.6739, std.dev.: 0.0764) SingleSource/Benchmarks/Shootout/matrix: -13.19% (0.0819 => 0.0711, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: -10.65% (0.1812 => 0.1619, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: -9.95% (6.0480 => 5.4462, std.dev.: 0.1503) SingleSource/Benchmarks/Shootout-C++/wordfreq: -9.23% (0.3522 => 0.3197, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/mst/mst: -9.20% (0.1272 => 0.1155, std.dev.: 0.0044) MultiSource/Applications/siod/siod: -8.95% (2.5122 => 2.2874, std.dev.: 0.0680) SingleSource/Benchmarks/Shootout-C++/matrix: -8.03% (0.2441 => 0.2245, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -7.41% (9.0152 => 8.3472, std.dev.: 0.0283) MultiSource/Benchmarks/MallocBench/gs/gs: -7.34% (4.6048 => 4.2668, std.dev.: 0.1073) MultiSource/Benchmarks/McCat/08-main/main: -6.43% (0.2846 => 0.2663, std.dev.: 0.0059) MultiSource/Applications/minisat/minisat: -6.08% (0.7548 => 0.7089, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.01% (0.1897 => 0.1783, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/wc: -5.88% (0.2346 => 0.2208, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.60% (0.3625 => 0.3422, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: -5.09% (1.0519 => 0.9984, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.18% (0.9308 => 0.8919, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/lists1: -4.10% (0.3145 => 0.3016, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -3.74% (0.6824 => 0.6569, std.dev.: 0.0091) MultiSource/Applications/hbd/hbd: -2.80% (1.5480 => 1.5047, std.dev.: 0.0081) MultiSource/Applications/lua/lua: -2.54% (4.0928 => 3.9887, std.dev.: 0.0263) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.32% (0.8734 => 0.8531, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.32% (0.9298 => 0.9175, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: -42.55% (0.2430 => 0.1396, std.dev.: 0.0217) SingleSource/Benchmarks/Stanford/Queens: -38.73% (0.0426 => 0.0261, std.dev.: 0.0022) SingleSource/Benchmarks/LivermoreLoops/kernel17: -25.99% (0.0858 => 0.0635, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/heapsort: -23.29% (3.9019 => 2.9930, std.dev.: 0.2831) SingleSource/Benchmarks/CoyoteBench/fftbench: -21.70% (1.9031 => 1.4901, std.dev.: 0.0365) SingleSource/Benchmarks/LivermoreLoops/kernel13: -19.82% (0.2180 => 0.1748, std.dev.: 0.0144) MultiSource/Applications/minisat/minisat: -18.44% (7.6577 => 6.2459, std.dev.: 0.2347) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -15.79% (0.4124 => 0.3473, std.dev.: 0.0225) SingleSource/Benchmarks/CoyoteBench/lpbench: -15.24% (4.6153 => 3.9120, std.dev.: 0.0280) SingleSource/Benchmarks/Shootout/hash: -9.25% (4.7203 => 4.2838, std.dev.: 0.0466) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.23% (0.3304 => 0.2999, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary3: -8.44% (2.1831 => 1.9989, std.dev.: 0.0569) SingleSource/Benchmarks/McGill/chomp: -6.22% (1.0639 => 0.9977, std.dev.: 0.0086) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.63% (1.3470 => 1.2711, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -4.43% (3.2997 => 3.1535, std.dev.: 0.0237) SingleSource/Benchmarks/Shootout/matrix: -4.38% (1.6320 => 1.5605, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.93% (47.4139 => 45.5493, std.dev.: 0.4159) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.87% (40.7797 => 39.2020, std.dev.: 0.5744) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.70% (1.3172 => 1.2685, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/hash: -3.59% (0.6497 => 0.6264, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/flops-3: -2.04% (2.1113 => 2.0682, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.91% (1.6361 => 1.6048, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.66% (5.0653 => 4.9814, std.dev.: 0.0142) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.46% (4.9945 => 4.9217, std.dev.: 0.0276) SingleSource/Benchmarks/Stanford/FloatMM: -1.24% (0.9056 => 0.8944, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-4: -1.08% (1.6819 => 1.6638, std.dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.75% (1.0660 => 1.0580, std.dev.: 0.2758) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -22.67% (0.0247 => 0.0191, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.25% (0.0447 => 0.0428, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.89% (0.0346 => 0.0336, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.87% (0.0321 => 0.0315, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.15% (0.0434 => 0.0416, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: -22.17% (0.0212 => 0.0165, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/test1: -26.79% (0.0224 => 0.0164, std.dev.: 0.0043) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.86% (0.0014 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -6.36% (0.1587 => 0.1486, std.dev.: 0.0064) MultiSource/Applications/lemon/lemon: -13.11% (1.3128 => 1.1407, std.dev.: 0.3278) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.44% (0.4304 => 0.4366, std.dev.: 0.0371) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -23.31% (0.1815 => 0.1392, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.76% (0.0706 => 0.0630, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -30.82% (0.0279 => 0.0193, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -22.00% (0.0759 => 0.0592, std.dev.: 0.0146) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.45% (1.2005 => 1.1951, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -97.67% (0.0043 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -44.44% (0.0027 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.43% (0.0708 => 0.0620, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.10% (0.0269 => 0.0223, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.89% (0.7848 => 0.7778, std.dev.: 0.0016) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 5.56% (0.0054 => 0.0057, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.30% (16.4461 => 17.6465, std.dev.: 0.3989) MultiSource/Applications/sqlite3/sqlite3: 2320.83% (0.6332 => 15.3287, std.dev.: 0.6827) MultiSource/Benchmarks/McCat/08-main/main: 45.44% (0.1831 => 0.2663, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.48% (0.1559 => 0.1458, std.dev.: 0.0199) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7192.60% (0.3123 => 22.7748, std.dev.: 0.5330) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.28% (0.2463 => 0.3726, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1528.65% (0.3344 => 5.4462, std.dev.: 0.1503) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.87% (0.2364 => 0.3283, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/bigfib: 4.88% (0.6010 => 0.6303, std.dev.: 0.0602) SingleSource/Benchmarks/Misc/mandel: -3.26% (0.0429 => 0.0415, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.78% (0.3266 => 0.3422, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/strcat: 3.30% (0.1969 => 0.2034, std.dev.: 0.0098) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.45% (0.0224 => 0.0225, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: -33.04% (0.0230 => 0.0154, std.dev.: 0.0019) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0518, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 7.05% (0.1462 => 0.1565, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4626, std.dev.: 0.2234) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0693, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4911, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5103, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.4901, std.dev.: 0.0365) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3179, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1222, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3631, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4049, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0887, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -24.15% (2.1832 => 1.6559, std.dev.: 0.0195) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.42% (0.0810 => 0.0943, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.09% (0.4847 => 0.5239, std.dev.: 0.0090) MultiSource/Applications/viterbi/viterbi: 7.10% (0.1577 => 0.1689, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.95% (0.3137 => 0.3355, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.80% (0.7473 => 0.7981, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.56% (0.2240 => 0.2387, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 5.45% (1.4269 => 1.5047, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 5.20% (0.8007 => 0.8423, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.99% (1.1606 => 1.2185, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.80% (0.3003 => 0.3147, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.49% (0.6287 => 0.6569, std.dev.: 0.0091) MultiSource/Applications/lua/lua: 4.45% (3.8189 => 3.9887, std.dev.: 0.0263) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.88% (0.4559 => 0.4736, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.70% (0.5817 => 0.6032, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.59% (0.9435 => 0.9774, std.dev.: 0.0103) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.43% (4.4880 => 4.6418, std.dev.: 0.0232) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.34% (0.6227 => 0.6435, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.20% (1.2526 => 1.2927, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.01% (0.8086 => 0.8329, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.68% (0.8069 => 0.8285, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.40% (0.8331 => 0.8531, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.00% (0.8995 => 0.9175, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.87% (0.8177 => 0.8330, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 96.98% (0.0199 => 0.0392, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/pi: 57.61% (1.5795 => 2.4894, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.59% (0.7597 => 0.8857, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.42% (2.9753 => 3.4638, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.67% (2.7995 => 3.2102, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.70% (5.0261 => 5.6143, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.75% (6.3772 => 6.9992, std.dev.: 0.1504) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.09% (1.1857 => 1.2816, std.dev.: 0.0182) SingleSource/Benchmarks/McGill/queens: 6.92% (1.7056 => 1.8236, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.83% (4.7794 => 5.1056, std.dev.: 0.0367) MultiSource/Applications/SIBsim4/SIBsim4: 6.23% (3.1873 => 3.3860, std.dev.: 0.0494) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.95% (4.5327 => 4.8024, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.91% (4.9686 => 5.2622, std.dev.: 0.0286) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.73% (6.2275 => 6.5218, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.65% (3.3761 => 3.5332, std.dev.: 0.0536) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.17% (4.9453 => 5.1515, std.dev.: 0.0335) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.01% (4.9469 => 5.1455, std.dev.: 0.0280) MultiSource/Applications/hexxagon/hexxagon: 3.90% (14.0064 => 14.5532, std.dev.: 0.0836) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.82% (1.2337 => 1.2685, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.81% (8.2783 => 8.5111, std.dev.: 0.0110) MultiSource/Applications/siod/siod: 2.79% (3.6643 => 3.7665, std.dev.: 0.0215) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.78% (11.5690 => 11.8911, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout/lists: 2.40% (7.3375 => 7.5137, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.37% (4.8660 => 4.9814, std.dev.: 0.0142) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.77% (4.8362 => 4.9217, std.dev.: 0.0276) SingleSource/Benchmarks/Stanford/FloatMM: 1.56% (0.8807 => 0.8944, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.50% (2.4647 => 2.5016, std.dev.: 0.0105) MultiSource/Benchmarks/FreeBench/neural/neural: 1.33% (1.0841 => 1.0985, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 1.23% (1.2061 => 1.2209, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: 1.13% (2.3560 => 2.3826, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.11% (5.4641 => 4.3104, std.dev.: 0.0221) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.76% (7.2130 => 6.2923, std.dev.: 0.1544) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.33% (1.0512 => 0.9321, std.dev.: 0.0059) SingleSource/Benchmarks/McGill/chomp: -11.05% (1.1216 => 0.9977, std.dev.: 0.0086) MultiSource/Benchmarks/mafft/pairlocalalign: -8.47% (63.1822 => 57.8313, std.dev.: 0.1227) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.26% (0.3269 => 0.2999, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.97% (14.6451 => 13.6250, std.dev.: 0.1278) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.92% (4.7482 => 4.4197, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.08% (3.7148 => 3.4888, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.85% (5.4972 => 5.1758, std.dev.: 0.0477) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.07% (5.1557 => 4.8942, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.42% (6.0224 => 5.8162, std.dev.: 0.0407) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.36% (0.5807 => 0.5612, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (28.5821 => 27.6999, std.dev.: 0.0269) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.44% (2.6356 => 2.5712, std.dev.: 0.0139) MultiSource/Applications/aha/aha: -2.44% (3.3398 => 3.2582, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/hash2: -2.21% (3.4237 => 3.3482, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.08% (11.5316 => 11.2913, std.dev.: 0.0206) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.97% (3.2169 => 3.1535, std.dev.: 0.0237) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.70% (9.9065 => 9.7385, std.dev.: 0.0411) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.58% (4.9994 => 4.9204, std.dev.: 0.0230) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.17% (5.6343 => 5.5684, std.dev.: 0.0192) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.10% (1.0262 => 1.0580, std.dev.: 0.2758) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 55.28% (0.0123 => 0.0191, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 32.28% (0.0254 => 0.0336, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.33% (0.0384 => 0.0416, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: -13.16% (0.0190 => 0.0165, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/test1: -8.89% (0.0180 => 0.0164, std.dev.: 0.0043) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 3.34% (0.1438 => 0.1486, std.dev.: 0.0064) MultiSource/Applications/lemon/lemon: 0.69% (1.1329 => 1.1407, std.dev.: 0.3278) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.85% (0.4164 => 0.4366, std.dev.: 0.0371) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.68% (0.1369 => 0.1392, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.72% (0.0641 => 0.0630, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.03% (0.0195 => 0.0193, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.42% (0.0578 => 0.0592, std.dev.: 0.0146) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.49% (1.1437 => 1.1951, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 7.14% (0.0014 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.12% (0.0627 => 0.0620, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.89% (0.0180 => 0.0223, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.98% (0.8017 => 0.7778, std.dev.: 0.0016) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -8.06% (0.0062 => 0.0057, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 19:43:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 21:43:13 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121121034313.687CF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6094?compare_to=6092&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6094, Order: 168409, Start Time: 2012-11-21 02:10:10, End Time: 2012-11-21 03:43:38 To: 6092, Order: 168397, Start Time: 2012-11-21 00:13:33, End Time: 2012-11-21 01:47:16 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (178 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (859 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 9.83% (0.3834 => 0.4211, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.69% (2.0478 => 2.1028, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/salsa20: 2.38% (7.4937 => 7.6718, std.dev.: 0.0208) SingleSource/Benchmarks/Shootout-C++/hash2: 2.03% (3.1932 => 3.2580, std.dev.: 0.0053) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.11% (0.3821 => 0.3511, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.82% (0.9542 => 0.8891, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.78% (0.3142 => 0.2929, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -6.62% (2.4924 => 2.3274, std.dev.: 0.0052) MultiSource/Applications/sgefa/sgefa: -6.58% (0.3357 => 0.3136, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.45% (0.3831 => 0.3584, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.44% (0.3896 => 0.3645, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -6.42% (0.3848 => 0.3601, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.39% (0.3880 => 0.3632, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -6.37% (0.3812 => 0.3569, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.35% (0.4033 => 0.3777, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -6.30% (0.4176 => 0.3913, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.22% (0.3891 => 0.3649, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.18% (0.2428 => 0.2278, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -6.15% (9.2283 => 8.6604, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: -6.09% (16.1920 => 15.2052, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.07% (0.1796 => 0.1687, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: -6.06% (0.2160 => 0.2029, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: -6.05% (0.4199 => 0.3945, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -5.98% (7.0961 => 6.6714, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.95% (0.7198 => 0.6770, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.94% (0.9852 => 0.9267, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.90% (0.3884 => 0.3655, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.89% (0.6484 => 0.6102, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.86% (3.5339 => 3.3267, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -5.85% (0.1879 => 0.1769, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.82% (0.2355 => 0.2218, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.80% (0.3658 => 0.3446, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.77% (4.8161 => 4.5383, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.77% (1.0544 => 0.9936, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.76% (1.3722 => 1.2931, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -5.76% (0.9179 => 0.8650, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.72% (6.7716 => 6.3841, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/parameter-passing: -5.68% (0.4280 => 0.4037, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.64% (0.2695 => 0.2543, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.63% (4.0323 => 3.8052, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.61% (1.6364 => 1.5446, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -5.60% (1.1450 => 1.0809, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.58% (4.8802 => 4.6079, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.57% (1.2300 => 1.1615, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.53% (1.4642 => 1.3832, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.53% (0.5591 => 0.5282, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -5.52% (0.3406 => 0.3218, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.52% (0.6052 => 0.5718, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.51% (0.5863 => 0.5540, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -5.50% (1.1530 => 1.0896, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.49% (0.6230 => 0.5888, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.48% (0.5857 => 0.5536, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.47% (4.5069 => 4.2604, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.44% (0.6667 => 0.6304, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.43% (0.6293 => 0.5951, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.42% (0.6736 => 0.6371, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.41% (0.6446 => 0.6097, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.41% (0.5859 => 0.5542, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -5.41% (17.1032 => 16.1779, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.40% (0.5478 => 0.5182, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -5.40% (4.3330 => 4.0991, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.38% (0.4813 => 0.4554, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.37% (0.5570 => 0.5271, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.36% (0.5705 => 0.5399, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.36% (0.2985 => 0.2825, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.36% (1.2784 => 1.2099, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.36% (0.5581 => 0.5282, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.35% (0.5925 => 0.5608, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.35% (0.6660 => 0.6304, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.34% (0.6194 => 0.5863, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.34% (0.3837 => 0.3632, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.34% (0.3931 => 0.3721, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -5.33% (1.2515 => 1.1848, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.33% (0.5802 => 0.5493, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.32% (0.4151 => 0.3930, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -5.32% (0.3025 => 0.2864, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.32% (0.6189 => 0.5860, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.31% (0.5805 => 0.5497, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.30% (0.6297 => 0.5963, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.30% (0.5999 => 0.5681, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: -5.29% (0.2871 => 0.2719, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -5.29% (1.3148 => 1.2452, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.29% (0.3194 => 0.3025, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.29% (0.6260 => 0.5929, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.28% (0.6304 => 0.5971, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.28% (0.8521 => 0.8071, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: -5.28% (1.3864 => 1.3132, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.27% (0.3057 => 0.2896, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.27% (0.5849 => 0.5541, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.26% (14.2083 => 13.4609, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.26% (0.2548 => 0.2414, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.24% (0.3016 => 0.2858, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.23% (0.5941 => 0.5630, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: -5.23% (0.4515 => 0.4279, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.22% (2.1713 => 2.0579, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -5.21% (0.2939 => 0.2786, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.20% (0.5575 => 0.5285, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.20% (0.3252 => 0.3083, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -5.19% (0.3255 => 0.3086, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.19% (0.7919 => 0.7508, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.19% (0.5456 => 0.5173, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.18% (0.2278 => 0.2160, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -5.17% (0.3581 => 0.3396, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.15% (0.6681 => 0.6337, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.15% (0.2933 => 0.2782, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.12% (0.6676 => 0.6334, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.11% (0.3483 => 0.3305, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.11% (8.0126 => 7.6033, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.10% (0.2903 => 0.2755, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.09% (0.4321 => 0.4101, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: -5.09% (0.3026 => 0.2872, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.09% (0.6033 => 0.5726, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.07% (0.2385 => 0.2264, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -5.06% (15.5079 => 14.7231, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.06% (0.3323 => 0.3155, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -5.05% (0.3446 => 0.3272) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.05% (0.6440 => 0.6115, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.04% (0.4916 => 0.4668, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.04% (1.2221 => 1.1605, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: -5.04% (0.2659 => 0.2525, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -5.04% (0.3394 => 0.3223, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: -5.02% (0.3205 => 0.3044, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.02% (1.2210 => 1.1597, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -5.02% (0.2849 => 0.2706, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -5.02% (0.2989 => 0.2839, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -5.00% (0.3059 => 0.2906, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.99% (0.5168 => 0.4910, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -4.98% (3.5154 => 3.3403, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.96% (0.5688 => 0.5406, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -4.95% (4.0594 => 3.8586, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary2: -4.94% (0.3481 => 0.3309, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -4.93% (0.7447 => 0.7080, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.90% (1.6474 => 1.5666, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.90% (0.2999 => 0.2852, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.82% (22.4056 => 21.3246, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -4.80% (2.4021 => 2.2867, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: -4.80% (0.4248 => 0.4044, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.79% (0.3319 => 0.3160, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/Hello: -4.77% (0.6347 => 0.6044, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.76% (0.7339 => 0.6990, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -4.75% (0.4861 => 0.4630, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -4.75% (0.3621 => 0.3449, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.74% (0.7021 => 0.6688, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.73% (0.7524 => 0.7168, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: -4.72% (0.6441 => 0.6137, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.71% (15.2527 => 14.5337, std.dev.: 0.0055) SingleSource/UnitTests/ObjC++/property-reference: -4.70% (0.7779 => 0.7413, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.70% (0.4083 => 0.3891, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.68% (0.3849 => 0.3669, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -4.60% (0.7982 => 0.7615, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.58% (0.3867 => 0.3690, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.57% (0.6395 => 0.6103, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -4.53% (2.1401 => 2.0432, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.52% (0.5329 => 0.5088, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.52% (0.4427 => 0.4227, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -4.46% (18.2933 => 17.4782, std.dev.: 0.0092) MultiSource/Benchmarks/Bullet/bullet: -4.45% (34.0927 => 32.5762, std.dev.: 0.0154) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.45% (0.9557 => 0.9132, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.44% (0.5567 => 0.5320, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.39% (0.6395 => 0.6114, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: -4.37% (0.3271 => 0.3128, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -4.36% (0.8418 => 0.8051, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.27% (0.5569 => 0.5331, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.26% (5.0226 => 4.8086, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/sieve: -4.22% (0.3788 => 0.3628, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.22% (2.2587 => 2.1634, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -4.16% (0.6750 => 0.6469, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.11% (0.9077 => 0.8704, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: -4.07% (0.4524 => 0.4340, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.04% (0.3491 => 0.3350, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.56% (5.4682 => 5.2735, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.52% (1.5610 => 1.5060, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -2.98% (20.7746 => 20.1553, std.dev.: 0.0163) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7545, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/richards_benchmark: -8.68% (1.2842 => 1.1727, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.91% (1.7753 => 1.7058, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: -3.81% (2.2633 => 2.1770, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.08% (1.0557 => 1.0232, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4720, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 20:45:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 22:45:14 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121121044514.97C202A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6095?compare_to=6090&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6095, Order: 168409, Start Time: 2012-11-21 02:24:41, End Time: 2012-11-21 04:45:37 To: 6090, Order: 168384, Start Time: 2012-11-20 23:05:25, End Time: 2012-11-21 01:26:03 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 66 (178 on baseline) Performance Improvements: 21 (41 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1001 (668 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/messages-2: 17.12% (0.0771 => 0.0903, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.94% (0.6183 => 0.7107, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.72% (0.4557 => 0.5228, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 14.43% (0.6222 => 0.7120, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 14.31% (0.5906 => 0.6751, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 14.15% (0.6289 => 0.7179, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 13.80% (0.7841 => 0.8923, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 13.20% (0.3008 => 0.3405, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 12.93% (0.4478 => 0.5057, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.72% (0.5803 => 0.6541, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary2: 12.46% (0.3699 => 0.4160, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 12.23% (0.3181 => 0.3570, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary3: 11.95% (0.3590 => 0.4019, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary: 11.59% (0.3529 => 0.3938, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: 11.47% (0.3035 => 0.3383, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/Hello: 9.86% (0.6552 => 0.7198, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (0.7177 => 0.7860, std.dev.: 0.0182) SingleSource/UnitTests/ObjC/parameter-passing: 9.50% (0.4482 => 0.4908, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.16% (0.6865 => 0.7494, std.dev.: 0.0142) SingleSource/UnitTests/ObjC/trivial-interface: 9.08% (0.3952 => 0.4311, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/for-in: 9.07% (0.4189 => 0.4569, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/synchronized: 8.87% (0.4046 => 0.4405, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.65% (0.6360 => 0.6910, std.dev.: 0.0206) SingleSource/UnitTests/ObjC++/property-reference-object: 8.43% (0.6675 => 0.7238, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.25% (0.4025 => 0.4357, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.22% (0.6894 => 0.7461, std.dev.: 0.0171) SingleSource/UnitTests/ObjC/property: 8.08% (0.4421 => 0.4778, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.06% (0.4134 => 0.4467, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 7.81% (2.6985 => 2.9093, std.dev.: 0.0685) SingleSource/Benchmarks/Shootout-C++/except: 7.78% (0.3148 => 0.3393, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/oourafft: 7.72% (0.3625 => 0.3905, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.11% (1.7465 => 1.8706, std.dev.: 0.0243) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.99% (0.6680 => 0.7147, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.59% (1.5671 => 1.6703, std.dev.: 0.0305) SingleSource/UnitTests/ObjC++/property-reference: 6.51% (0.8212 => 0.8747, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 6.44% (0.2004 => 0.2133, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.26% (2.4300 => 2.5821, std.dev.: 0.0125) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.18% (0.2218 => 0.2333, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.13% (0.3721 => 0.3912, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 5.11% (0.7276 => 0.7648, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.90% (0.6996 => 0.7339, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.17% (8.0650 => 8.4011, std.dev.: 0.1150) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.11% (1.5667 => 1.6311, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.81% (0.6619 => 0.6871, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 2.74% (0.5074 => 0.5213, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.46% (11.2269 => 11.5028, std.dev.: 0.0770) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.98% (5.2600 => 5.3644, std.dev.: 0.0360) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.85% (5.0094 => 5.1022, std.dev.: 0.0092) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 30.94% (3.7841 => 4.9549, std.dev.: 0.1312) SingleSource/Benchmarks/Shootout-C++/ary3: 23.17% (3.7548 => 4.6248, std.dev.: 0.2526) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 22.19% (15.7243 => 19.2135, std.dev.: 0.0795) SingleSource/Benchmarks/Shootout-C++/ary2: 20.53% (0.0760 => 0.0916, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 18.58% (1.3235 => 1.5694, std.dev.: 0.0532) SingleSource/Benchmarks/Shootout-C++/ary: 17.43% (0.0763 => 0.0896, std.dev.: 0.0015) MultiSource/Benchmarks/llubenchmark/llu: 8.85% (8.1650 => 8.8872, std.dev.: 0.0617) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 8.41% (0.4100 => 0.4445, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout/strcat: 7.04% (0.1931 => 0.2067, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.03% (3.1824 => 3.3425, std.dev.: 0.0067) MultiSource/Benchmarks/NPB-serial/is/is: 3.99% (8.5693 => 8.9113, std.dev.: 0.0622) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.98% (4.3290 => 4.5014, std.dev.: 0.0291) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.89% (4.2353 => 4.3578, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.67% (4.8062 => 4.8867, std.dev.: 0.0311) SingleSource/Benchmarks/Shootout-C++/lists: 1.49% (12.5665 => 12.7537, std.dev.: 0.0647) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.41% (4.9635 => 5.0337, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.28% (4.0961 => 4.1487, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.14% (5.5009 => 5.5638, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -13.43% (0.8309 => 0.7193, std.dev.: 0.0005) SingleSource/Benchmarks/LivermoreLoops/kernel07: -11.06% (0.1175 => 0.1045, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ks/ks: -10.12% (0.1908 => 0.1715, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -10.02% (0.7424 => 0.6680, std.dev.: 0.0095) SingleSource/UnitTests/ObjC/BoolLiteralTest: -9.88% (0.4567 => 0.4116, std.dev.: 0.0128) SingleSource/Benchmarks/LivermoreLoops/kernel18: -9.87% (0.1651 => 0.1488, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/pifft/pifft: -8.12% (2.5393 => 2.3332, std.dev.: 0.0616) SingleSource/UnitTests/2006-12-11-LoadConstants: -7.47% (0.1392 => 0.1288, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.65% (5.0048 => 4.7222, std.dev.: 0.0462) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -4.63% (6.1468 => 5.8621, std.dev.: 0.1073) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.63% (1.6510 => 1.5910, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -2.69% (12.6623 => 12.3213, std.dev.: 0.1161) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.62% (18.0265 => 17.5537, std.dev.: 0.1311) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.51% (0.9727 => 0.9580, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -23.73% (2.0415 => 1.5571, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -11.25% (7.5725 => 6.7207, std.dev.: 0.2580) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -7.30% (1.6629 => 1.5415, std.dev.: 0.0419) SingleSource/Benchmarks/Shootout/heapsort: -7.26% (4.2332 => 3.9260, std.dev.: 0.0333) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -6.46% (9.7528 => 9.1223, std.dev.: 0.0243) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -6.17% (10.4348 => 9.7906, std.dev.: 0.1952) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -2.13% (4.8350 => 4.7321, std.dev.: 0.0385) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -2.05% (0.1367 => 0.1339, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0418 => 0.0419, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.37% (0.0653 => 0.0675, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 0.04% (493.9789 => 494.1568, std.dev.: 0.1518) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0419, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 43719.88% (1.1277 => 494.1568, std.dev.: 0.1518) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 212.89% (0.5229 => 1.6361, std.dev.: 0.0533) MultiSource/Applications/SPASS/SPASS: 21.16% (14.9895 => 18.1607, std.dev.: 0.2337) MultiSource/Applications/kimwitu++/kc: 50.29% (14.1553 => 21.2744, std.dev.: 0.3640) MultiSource/Benchmarks/MallocBench/gs/gs: 21.07% (4.1105 => 4.9765, std.dev.: 0.1804) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.11% (1.1048 => 1.5148, std.dev.: 0.0132) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 434.87% (7.1582 => 38.2869, std.dev.: 0.4472) SingleSource/Benchmarks/Misc-C++-EH/spirit: 75.86% (3.4629 => 6.0900, std.dev.: 0.4678) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.28% (0.6222 => 1.0284, std.dev.: 0.0665) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10803.61% (0.0720 => 7.8506, std.dev.: 0.2463) MultiSource/Applications/SIBsim4/SIBsim4: 3864600.00% (0.0001 => 3.8647, std.dev.: 0.0402) MultiSource/Applications/SPASS/SPASS: 12904000.00% (0.0001 => 12.9041, std.dev.: 2.2318) MultiSource/Applications/kimwitu++/kc: 51800.00% (0.0001 => 0.0519, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 64000.00% (0.0001 => 0.0641, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 577200.00% (0.0001 => 0.5773, std.dev.: 0.0207) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10072300.00% (0.0001 => 10.0724, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5678200.00% (0.0001 => 5.6783, std.dev.: 0.8619) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1779.57% (1.1194 => 21.0399, std.dev.: 0.1008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 82.56% (2.9384 => 5.3644, std.dev.: 0.0360) MultiSource/Applications/ClamAV/clamscan: 70.99% (22.1758 => 37.9184, std.dev.: 0.3086) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 63.07% (7.0540 => 11.5028, std.dev.: 0.0770) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 51.44% (8.1363 => 12.3213, std.dev.: 0.1161) SingleSource/Benchmarks/Misc/flops: 48.95% (0.1432 => 0.2133, std.dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 47.43% (21.9371 => 32.3417, std.dev.: 0.2012) MultiSource/Benchmarks/FreeBench/distray/distray: 45.64% (0.1056 => 0.1538, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/almabench: 38.49% (0.0730 => 0.1011, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/messages-2: 36.40% (0.0662 => 0.0903, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 34.45% (0.0746 => 0.1003, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 34.17% (0.0793 => 0.1064, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/17-bintr/bintr: 33.48% (0.0675 => 0.0901, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/15-trie/trie: 31.31% (0.0527 => 0.0692, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 30.52% (0.0842 => 0.1099, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/dry: 30.26% (0.0456 => 0.0594, std.dev.: 0.0019) SingleSource/UnitTests/vla: 29.86% (0.0355 => 0.0461, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 29.76% (0.0672 => 0.0872, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 28.60% (0.0528 => 0.0679, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/family/family: 28.46% (0.0397 => 0.0510, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.13% (0.5105 => 0.6541, std.dev.: 0.0024) MultiSource/Benchmarks/NPB-serial/is/is: 27.82% (0.0719 => 0.0919, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 27.46% (0.0834 => 0.1063, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 27.42% (0.4103 => 0.5228, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 27.32% (4.2646 => 5.4295, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.75% (0.0770 => 0.0976, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.70% (0.0648 => 0.0821, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 26.68% (0.0491 => 0.0622, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 26.66% (2.2969 => 2.9093, std.dev.: 0.0685) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 26.64% (0.0443 => 0.0561, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 26.30% (0.1175 => 0.1484, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 26.15% (0.4615 => 0.5822, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/09-vor/vor: 25.91% (0.3180 => 0.4004, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 25.86% (0.0437 => 0.0550, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 25.45% (0.3423 => 0.4294, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/huffbench: 25.14% (0.0871 => 0.1090, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 24.99% (1.3050 => 1.6311, std.dev.: 0.0202) SingleSource/UnitTests/ObjC/parameter-passing: 24.98% (0.3927 => 0.4908, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 24.95% (2.0665 => 2.5821, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/moments: 24.93% (0.4048 => 0.5057, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/matrix: 24.69% (0.0818 => 0.1020, std.dev.: 0.0012) MultiSource/Benchmarks/llubenchmark/llu: 24.68% (0.0462 => 0.0576, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/trivial-interface: 24.13% (0.3473 => 0.4311, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 24.08% (0.5569 => 0.6910, std.dev.: 0.0206) MultiSource/Benchmarks/Olden/bisort/bisort: 23.94% (0.0614 => 0.0761, std.dev.: 0.0021) SingleSource/Benchmarks/Stanford/Oscar: 23.90% (0.0636 => 0.0788, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/em3d/em3d: 23.83% (0.1695 => 0.2099, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 23.72% (0.3162 => 0.3912, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 23.70% (0.3561 => 0.4405, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 23.69% (0.3694 => 0.4569, std.dev.: 0.0066) MultiSource/Applications/minisat/minisat: 23.65% (0.7115 => 0.8798, std.dev.: 0.0293) SingleSource/Benchmarks/Shootout-C++/ackermann: 23.55% (0.2756 => 0.3405, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 23.31% (0.1892 => 0.2333, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 23.11% (0.3379 => 0.4160, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 22.97% (0.3543 => 0.4357, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/property: 22.95% (0.3886 => 0.4778, std.dev.: 0.0037) SingleSource/Regression/C++/ofstream_ctor: 22.89% (0.2905 => 0.3570, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/05-eks/eks: 22.63% (0.4299 => 0.5272, std.dev.: 0.0038) MultiSource/Benchmarks/BitBench/five11/five11: 22.57% (0.0567 => 0.0695, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/hash: 22.47% (0.0485 => 0.0594, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 22.42% (0.3283 => 0.4019, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 22.38% (0.3650 => 0.4467, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/life/life: 22.29% (0.0933 => 0.1141, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 22.18% (14.3668 => 17.5537, std.dev.: 0.1311) SingleSource/Benchmarks/Dhrystone/fldry: 22.04% (0.0481 => 0.0587, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.90% (0.1566 => 0.1909, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/ary: 21.84% (0.3232 => 0.3938, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.77% (0.2430 => 0.2959, std.dev.: 0.0048) MultiSource/Applications/lemon/lemon: 21.62% (1.0722 => 1.3040, std.dev.: 0.0405) SingleSource/UnitTests/ObjC++/Hello: 21.49% (0.5925 => 0.7198, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 21.35% (1.5415 => 1.8706, std.dev.: 0.0243) SingleSource/Benchmarks/Shootout-C++/nestedloop: 21.12% (0.2793 => 0.3383, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.96% (0.1584 => 0.1916, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/whetstone: 20.91% (0.0660 => 0.0798, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 20.19% (0.1337 => 0.1607, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 20.17% (0.0838 => 0.1007, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 20.03% (0.6030 => 0.7238, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 19.40% (0.7326 => 0.8747, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.11% (0.2700 => 0.3216, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/oourafft: 18.98% (0.3282 => 0.3905, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.76% (0.1125 => 0.1336, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 18.55% (4.9449 => 5.8621, std.dev.: 0.1073) SingleSource/Benchmarks/Shootout-C++/except: 18.18% (0.2871 => 0.3393, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.74% (1.4186 => 1.6703, std.dev.: 0.0305) MultiSource/Benchmarks/sim/sim: 17.42% (0.3387 => 0.3977, std.dev.: 0.0149) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.36% (5.0018 => 5.8703, std.dev.: 0.1041) MultiSource/Applications/oggenc/oggenc: 17.31% (5.7591 => 6.7559, std.dev.: 0.3155) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.23% (0.8172 => 0.9580, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 17.11% (0.1163 => 0.1362, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.92% (0.0798 => 0.0933, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: 16.70% (0.2725 => 0.3180, std.dev.: 0.0081) MultiSource/Applications/lua/lua: 16.56% (3.8723 => 4.5136, std.dev.: 0.2463) SingleSource/Benchmarks/Shootout-C++/random: 16.31% (0.2802 => 0.3259, std.dev.: 0.0094) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.16% (0.0953 => 0.1107, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.88% (0.2065 => 0.2393, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 15.84% (0.1906 => 0.2208, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 15.69% (0.1268 => 0.1467, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.50% (0.4064 => 0.4694, std.dev.: 0.0186) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.45% (0.0770 => 0.0889, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.38% (0.3121 => 0.3601, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/objinst: 15.27% (0.3131 => 0.3609, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 15.21% (3.8922 => 4.4843, std.dev.: 0.1364) MultiSource/Applications/viterbi/viterbi: 15.18% (0.1555 => 0.1791, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/bh/bh: 15.07% (0.3092 => 0.3558, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.95% (0.1117 => 0.1284, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 14.94% (63.2438 => 72.6925, std.dev.: 0.2633) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.94% (0.2758 => 0.3170, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.90% (0.2107 => 0.2421, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 14.90% (17.1811 => 19.7409, std.dev.: 0.2189) MultiSource/Benchmarks/mafft/pairlocalalign: 14.87% (9.4845 => 10.8953, std.dev.: 0.4042) MultiSource/Applications/spiff/spiff: 14.54% (0.7835 => 0.8974, std.dev.: 0.0425) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.52% (0.0730 => 0.0836, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.13% (0.5981 => 0.6826, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.05% (0.1032 => 0.1177, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 14.04% (0.3441 => 0.3924, std.dev.: 0.0176) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.99% (0.1029 => 0.1173, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.99% (0.5860 => 0.6680, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.61% (0.2271 => 0.2580, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.58% (0.1510 => 0.1715, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/exceptions-4: 13.41% (0.3543 => 0.4018, std.dev.: 0.0176) SingleSource/UnitTests/ObjC/exceptions-3: 13.14% (0.3516 => 0.3978, std.dev.: 0.0171) MultiSource/Applications/hbd/hbd: 13.13% (1.5603 => 1.7652, std.dev.: 0.0667) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.69% (0.1143 => 0.1288, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 12.30% (1.1840 => 1.3296, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.68% (0.8067 => 0.9009, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 11.23% (0.4620 => 0.5139, std.dev.: 0.0174) MultiSource/Benchmarks/Ptrdist/bc/bc: 10.95% (1.1861 => 1.3160, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.80% (0.2603 => 0.2884, std.dev.: 0.0091) MultiSource/Benchmarks/PAQ8p/paq8p: 10.67% (10.3673 => 11.4734, std.dev.: 0.2064) MultiSource/Benchmarks/Prolangs-C/football/football: 10.49% (0.8921 => 0.9857, std.dev.: 0.0296) MultiSource/Benchmarks/FreeBench/neural/neural: 9.98% (0.1463 => 0.1609) SingleSource/Benchmarks/Shootout-C++/methcall: 8.93% (0.2877 => 0.3134, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.85% (0.4879 => 0.5213, std.dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.52% (7.9617 => 8.4011, std.dev.: 0.1150) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.31% (4.3953 => 11.0018, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/methcall: 147.48% (5.3999 => 13.3638, std.dev.: 0.0112) MultiSource/Benchmarks/llubenchmark/llu: 135.23% (3.7781 => 8.8872, std.dev.: 0.0617) MultiSource/Benchmarks/McCat/17-bintr/bintr: 111.03% (0.1043 => 0.2201, std.dev.: 0.0137) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 44.81% (0.3256 => 0.4715, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 42.97% (13.4384 => 19.2135, std.dev.: 0.0795) MultiSource/Benchmarks/McCat/09-vor/vor: 38.56% (0.1154 => 0.1599, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/ary3: 33.94% (3.6994 => 4.9549, std.dev.: 0.1312) SingleSource/Benchmarks/Shootout-C++/ary3: 24.25% (3.7221 => 4.6248, std.dev.: 0.2526) SingleSource/Benchmarks/Shootout-C++/ary2: 21.00% (0.0757 => 0.0916, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 20.31% (1.3045 => 1.5694, std.dev.: 0.0532) SingleSource/Benchmarks/Shootout-C++/ary: 18.52% (0.0756 => 0.0896, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 17.47% (6.6465 => 7.8077, std.dev.: 0.0111) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.61% (1.1145 => 1.2996, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.01% (0.2944 => 0.3327, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.65% (2.8904 => 3.2270, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/richards_benchmark: 10.21% (1.1396 => 1.2559, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.31% (1.7254 => 1.8860, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/strcat: 8.85% (0.1899 => 0.2067, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.67% (3.1334 => 3.3425, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 6.00% (0.9540 => 1.0112, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.84% (4.2280 => 4.4748, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/bh/bh: 5.35% (1.9405 => 2.0443, std.dev.: 0.0399) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 5.09% (8.6802 => 9.1223, std.dev.: 0.0243) MultiSource/Applications/lua/lua: 4.75% (26.0924 => 27.3308, std.dev.: 0.2266) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.6436 => 12.1318, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.68% (1.7133 => 1.7764, std.dev.: 0.0154) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.36% (0.4162 => 0.4302, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.21% (1.5086 => 1.5571, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 2.30% (85.0658 => 87.0242, std.dev.: 0.0363) SingleSource/Benchmarks/Dhrystone/dry: 2.28% (2.4116 => 2.4665, std.dev.: 0.0062) MultiSource/Applications/sqlite3/sqlite3: 2.20% (4.6441 => 4.7462, std.dev.: 0.0248) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.16% (1.3677 => 1.3972, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 2.08% (3.1595 => 3.2252, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.83% (2.1424 => 2.1817, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.75% (12.5348 => 12.7537, std.dev.: 0.0647) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.68% (6.5088 => 6.6184, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (27.8444 => 28.3042, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/sieve: 1.32% (5.2139 => 5.2825, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0499, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1690, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.73% (5.2763 => 1.2279, std.dev.: 0.0205) SingleSource/Benchmarks/Misc/salsa20: -75.42% (0.8651 => 0.2126, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/richards_benchmark: -44.76% (0.1622 => 0.0896, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -11.95% (0.1330 => 0.1171, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.78% (5.3526 => 4.7222, std.dev.: 0.0462) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -9.65% (1.7609 => 1.5910, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -8.34% (10.4361 => 9.5655, std.dev.: 0.2240) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.26% (5.3855 => 5.1022, std.dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.52% (0.0628 => 0.0361, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.33% (0.3987 => 0.2379, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.33% (4.5009 => 2.7757, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -29.27% (10.7105 => 7.5757, std.dev.: 0.6334) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.13% (2.6546 => 2.0141, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -19.11% (0.2161 => 0.1748, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.69% (2.6778 => 2.2845, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.83% (32.5116 => 28.9900, std.dev.: 0.0269) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.03% (1.5660 => 1.4246, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.94% (4.8142 => 4.4803, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -6.82% (9.5636 => 8.9113, std.dev.: 0.0622) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.2416 => 3.0210, std.dev.: 0.0280) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5758, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -4.65% (1.5835 => 1.5099, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.55% (1.6805 => 1.6041, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout/lists: -4.21% (6.2999 => 6.0348, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.20% (19.9488 => 19.1111, std.dev.: 0.3016) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8915, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.70% (0.9957 => 0.9688, std.dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.56% (0.4808 => 0.4685, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.77% (8.1563 => 8.0119, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: -1.46% (10.2830 => 10.1326, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.10% (0.2116 => 0.0675, std.dev.: 0.0002) Report Time: 2.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 20:50:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 22:50:55 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121121045055.A0A8B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6096?compare_to=6089&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6096, Order: 168400, Start Time: 2012-11-21 01:30:31, End Time: 2012-11-21 04:51:18 To: 6089, Order: 168380, Start Time: 2012-11-20 21:21:24, End Time: 2012-11-21 00:42:17 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 11 (174 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1081 (716 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.68% (0.8268 => 0.8407, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.35% (3.1423 => 3.1847, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.29% (2.3782 => 2.4089, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 1.23% (2.3563 => 2.3854, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: 1.15% (1.1289 => 1.1419, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.09% (1.8831 => 1.9037, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 1.06% (1.1434 => 1.1555, std.dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 1.04% (5.1983 => 5.2525, std.dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: 1.02% (4.8443 => 4.8935, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.01% (4.1545 => 4.1963, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.72% (116.4222 => 118.4244, std.dev.: 0.0501) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.60% (0.0625 => 0.0885, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.74% (0.1063 => 0.1411, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.88% (0.2969 => 0.3767, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.05% (0.0714 => 0.0900, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.04% (0.1106 => 0.1394, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.32% (0.4139 => 0.5187, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 24.69% (1.5932 => 1.9865, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.66% (0.4253 => 0.5302, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.07% (0.5900 => 0.7320, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.00% (0.0475 => 0.0589, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.79% (0.4994 => 0.6182, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.63% (0.0584 => 0.0722, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.40% (0.0547 => 0.0675, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.40% (0.5000 => 0.6170, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.96% (0.1620 => 0.1992, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.72% (0.1021 => 0.1253, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.49% (0.1107 => 0.1356, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 22.37% (0.0599 => 0.0733, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.30% (0.0897 => 0.1097, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.40% (0.0584 => 0.0709, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.33% (0.0633 => 0.0768, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.26% (0.0541 => 0.0656, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 21.20% (0.0948 => 0.1149, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.18% (0.0642 => 0.0778, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 21.07% (0.0821 => 0.0994, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.03% (0.1103 => 0.1335, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.92% (0.1549 => 0.1873, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.86% (0.3903 => 0.4717, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.80% (0.0822 => 0.0993, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 20.75% (0.1619 => 0.1955, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 20.66% (0.0605 => 0.0730, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.64% (0.1003 => 0.1210, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.61% (0.0495 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.26% (0.1604 => 0.1929, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 20.03% (0.0604 => 0.0725, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.63% (0.1462 => 0.1749, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 19.54% (0.0947 => 0.1132, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 19.43% (0.0808 => 0.0965, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.41% (0.2736 => 0.3267, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.31% (0.3890 => 0.4641, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.12% (0.2014 => 0.2399, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 19.02% (0.5826 => 0.6934, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 18.80% (0.1218 => 0.1447, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 18.68% (0.5889 => 0.6989, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 18.57% (0.4029 => 0.4777, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.44% (1.3152 => 1.5577, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/mst/mst: 18.34% (0.0698 => 0.0826, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 18.21% (0.1505 => 0.1779, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.20% (0.1088 => 0.1286, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.18% (0.0572 => 0.0676) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.07% (0.2866 => 0.3384, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.84% (0.2875 => 0.3388, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 17.81% (0.5546 => 0.6534, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.78% (3.5627 => 4.1963, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: 17.76% (0.9697 => 1.1419, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.63% (0.1968 => 0.2315, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.63% (0.0573 => 0.0674, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.61% (0.3271 => 0.3847, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 17.56% (0.2750 => 0.3233, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.48% (0.4658 => 0.5472, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.43% (1.6211 => 1.9037, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 17.43% (0.2714 => 0.3187, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 17.38% (1.8794 => 2.2061, std.dev.: 0.0053) SingleSource/UnitTests/ObjC++/property-reference: 17.24% (0.7171 => 0.8407, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.21% (0.5026 => 0.5891, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.13% (0.2738 => 0.3207, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 17.10% (0.2725 => 0.3191, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 17.09% (0.2780 => 0.3255, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 17.01% (0.3004 => 0.3515, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 17.00% (0.2823 => 0.3303, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.00% (0.2729 => 0.3193, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.98% (0.1160 => 0.1357, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 16.93% (0.2811 => 0.3287, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.91% (0.2792 => 0.3264, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 16.85% (0.2813 => 0.3287, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 16.82% (0.1421 => 0.1660, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.81% (0.4361 => 0.5094, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: 16.80% (0.3267 => 0.3816, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 16.80% (0.2803 => 0.3274, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.69% (2.7292 => 3.1847, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.68% (0.3195 => 0.3728, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 16.67% (0.3096 => 0.3612, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.66% (0.2911 => 0.3396, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 16.61% (0.9909 => 1.1555, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: 16.58% (1.0781 => 1.2568, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary: 16.54% (0.3258 => 0.3797, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.52% (2.0673 => 2.4089, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.41% (0.3930 => 0.4575, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.22% (4.4195 => 5.1365, std.dev.: 0.0048) MultiSource/Applications/ClamAV/clamscan: 16.21% (4.2109 => 4.8935, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bh/bh: 16.20% (0.1284 => 0.1492, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 16.10% (0.3317 => 0.3851, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.75% (0.3060 => 0.3542, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.74% (1.9694 => 2.2794, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.68% (0.3362 => 0.3889, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.58% (1.9966 => 2.3077, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: 15.58% (0.3678 => 0.4251, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.52% (0.3124 => 0.3609, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.50% (0.1090 => 0.1259, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 15.38% (0.3348 => 0.3863, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 15.37% (0.2075 => 0.2394, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 15.31% (23.5202 => 27.1212, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.27% (0.3282 => 0.3783, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 15.13% (0.3477 => 0.4003, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.09% (0.3625 => 0.4172, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 15.03% (0.3726 => 0.4286, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 14.89% (0.2566 => 0.2948, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 14.80% (0.3446 => 0.3956, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 14.64% (0.3469 => 0.3977, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.63% (0.3465 => 0.3972, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 14.59% (0.4146 => 0.4751, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.57% (0.3981 => 0.4561, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 14.56% (0.3496 => 0.4005, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.54% (0.3845 => 0.4404, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.54% (0.3488 => 0.3995, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 14.51% (0.4251 => 0.4868, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.51% (0.3460 => 0.3962, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 14.50% (1.4269 => 1.6338, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: 14.50% (0.3442 => 0.3941, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.47% (0.3690 => 0.4224, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 14.33% (0.3650 => 0.4173, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 14.26% (0.7875 => 0.8998, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 14.12% (0.0758 => 0.0865, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 14.11% (0.3643 => 0.4157, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 14.01% (2.1653 => 2.4687, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/bigfib: 13.89% (0.5012 => 0.5708, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 13.83% (0.3724 => 0.4239, std.dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 13.75% (4.6177 => 5.2525, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 13.52% (2.1013 => 2.3854, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 12.97% (0.2691 => 0.3040, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.79% (0.2040 => 0.2301, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.34% (0.6435 => 0.7229, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 12.18% (5.5417 => 6.2167, std.dev.: 0.0057) MultiSource/Applications/siod/siod: 11.92% (0.6634 => 0.7425, std.dev.: 0.0139) MultiSource/Applications/lambda-0_1_3/lambda: 11.78% (0.3498 => 0.3910, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.75% (0.2068 => 0.2311, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.50% (0.1383 => 0.1542, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.38% (0.1028 => 0.1145, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.33% (0.2737 => 0.3047, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 11.08% (0.4847 => 0.5384, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.96% (0.3084 => 0.3422, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 10.37% (0.2391 => 0.2639, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 10.31% (0.3336 => 0.3680, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 10.28% (2.0346 => 2.2437, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.89% (0.2103 => 0.2311, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.97% (0.5361 => 0.5842, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.83% (4.6926 => 5.1070, std.dev.: 0.0047) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.68% (11.6398 => 12.6500, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.17% (0.5584 => 0.6040, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.13% (0.7426 => 0.8030, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 7.23% (11.9555 => 12.8193, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.14% (0.3792 => 0.3987, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 9.03% (0.2802 => 0.3055, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6088, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 5.66% (0.2122 => 0.2242, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (12.0509 => 12.6667, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-2: 4.79% (1.8057 => 1.8922, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1637, std.dev.: 0.0171) SingleSource/Benchmarks/Dhrystone/dry: 4.09% (14.0481 => 14.6228, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1966, std.dev.: 0.0087) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2237, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3084, std.dev.: 0.0122) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2891, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5129, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5861, std.dev.: 0.0214) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.60% (2.4764 => 2.4120, std.dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.80% (25.4195 => 16.5736, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/ary2: -8.37% (0.2402 => 0.2201, std.dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9775, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8049, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8002, std.dev.: 0.0045) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.28% (41.7953 => 40.8440, std.dev.: 0.0075) SingleSource/Benchmarks/Dhrystone/fldry: -2.17% (17.2379 => 16.8635, std.dev.: 0.0341) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.68% (10.7630 => 10.5819, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.67% (0.6293 => 0.6188, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4955, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1454, std.dev.: 0.0816) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0438, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 21:10:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 23:10:20 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121121051020.EA5A62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6097?compare_to=6093&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6097, Order: 168411, Start Time: 2012-11-21 03:40:19, End Time: 2012-11-21 05:10:46 To: 6093, Order: 168409, Start Time: 2012-11-21 01:51:29, End Time: 2012-11-21 03:23:03 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 3 (103 on baseline) Performance Improvements: 5 (28 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1046 (843 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.07% (1.2094 => 1.2344, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel24: 79.15% (0.2849 => 0.5104, std.dev.: 0.0329) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.82% (4.3521 => 4.4747, std.dev.: 0.0356) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -2.81% (0.8423 => 0.8186, std.dev.: 0.0088) MultiSource/Applications/hbd/hbd: -1.63% (1.5047 => 1.4802, std.dev.: 0.0059) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.14% (22.7748 => 22.5149, std.dev.: 0.0499) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.66% (1.5094 => 1.4541, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/ft/ft: -3.51% (0.9128 => 0.8808, std.dev.: 0.0103) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.05% (1.0580 => 1.0585, std.dev.: 0.0123) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.76% (0.0191 => 0.0180, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.87% (0.0428 => 0.0420, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.89% (0.0336 => 0.0333, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0315 => 0.0315, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -8.17% (0.0416 => 0.0382, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/casts: 23.64% (0.0165 => 0.0204, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 11.59% (0.0164 => 0.0183, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.87% (0.1486 => 0.1499, std.dev.: 0.0070) MultiSource/Applications/lemon/lemon: 1.59% (1.1407 => 1.1588, std.dev.: 0.0162) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.74% (0.4366 => 0.4159, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.08% (0.1392 => 0.1421, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.33% (0.0630 => 0.0651, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 39.90% (0.0193 => 0.0270, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.90% (0.0592 => 0.0563, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.70% (1.1951 => 1.2035, std.dev.: 0.0302) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2800.00% (0.0001 => 0.0029, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 80.00% (0.0015 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.19% (0.0620 => 0.0646, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.83% (0.0223 => 0.0236, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.05% (0.7778 => 0.7782, std.dev.: 0.0009) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 19.30% (0.0057 => 0.0068, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 6.75% (16.4461 => 17.5569, std.dev.: 0.1190) MultiSource/Applications/sqlite3/sqlite3: 2312.02% (0.6332 => 15.2729, std.dev.: 0.1769) MultiSource/Benchmarks/McCat/08-main/main: 50.68% (0.1831 => 0.2759, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.03% (0.1559 => 0.1465, std.dev.: 0.0073) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7109.38% (0.3123 => 22.5149, std.dev.: 0.0499) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.14% (0.2463 => 0.3698, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1526.08% (0.3344 => 5.4376, std.dev.: 0.0739) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.44% (0.2364 => 0.3249, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 4.26% (0.6010 => 0.6266, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: 2.56% (0.0429 => 0.0440, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.23% (0.3266 => 0.3404, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/strcat: 4.06% (0.1969 => 0.2049, std.dev.: 0.0019) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -7.59% (0.0224 => 0.0207, std.dev.: 0.0016) SingleSource/UnitTests/byval-alignment: -48.26% (0.0230 => 0.0119, std.dev.: 0.0022) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0525, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 12.18% (0.1462 => 0.1640, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4769, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0713, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4872, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5138, std.dev.: 0.0112) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.4797, std.dev.: 0.0677) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3242, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1178, std.dev.: 0.0206) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3642, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4108, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0826, std.dev.: 0.0032) SingleSource/Regression/C/uint64_to_float: -24.16% (2.1832 => 1.6557, std.dev.: 0.0056) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.53% (0.0810 => 0.0952, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.44% (0.0848 => 0.0962, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: 13.31% (0.1112 => 0.1260, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.94% (0.2180 => 0.2353, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.98% (0.2279 => 0.2438, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.69% (0.8321 => 0.8878, std.dev.: 0.0209) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.15% (0.3137 => 0.3330, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.11% (0.6010 => 0.6377, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.98% (0.1905 => 0.2019, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.82% (0.7473 => 0.7908, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.64% (1.1685 => 1.2344, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.55% (0.1983 => 0.2093, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.40% (0.2998 => 0.3160, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: 5.26% (1.2222 => 1.2865, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.22% (0.2240 => 0.2357, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.83% (0.3003 => 0.3148, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: 4.47% (0.2999 => 0.3133, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.41% (2.1401 => 2.2345, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.28% (0.6287 => 0.6556, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 4.23% (0.7950 => 0.8286, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.05% (0.2519 => 0.2621, std.dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: 3.99% (1.2568 => 1.3069, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.78% (0.4127 => 0.4283, std.dev.: 0.0033) MultiSource/Applications/hbd/hbd: 3.74% (1.4269 => 1.4802, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.61% (0.3295 => 0.3414, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.40% (4.1763 => 4.3183, std.dev.: 0.0236) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.39% (0.4783 => 0.4945, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.38% (6.6074 => 6.8306, std.dev.: 0.0534) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.31% (0.4559 => 0.4710, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 3.28% (3.8189 => 3.9442, std.dev.: 0.0243) MultiSource/Benchmarks/nbench/nbench: 3.18% (1.1271 => 1.1629, std.dev.: 0.0085) MultiSource/Applications/minisat/minisat: 3.09% (0.6834 => 0.7045, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 2.99% (14.2605 => 14.6866, std.dev.: 0.1125) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.96% (1.5315 => 1.5769, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.86% (13.1811 => 13.5584, std.dev.: 0.0326) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.85% (0.8340 => 0.8578, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.79% (0.5191 => 0.5336, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 2.78% (1.9948 => 2.0502, std.dev.: 0.0142) MultiSource/Applications/siod/siod: 2.70% (2.2184 => 2.2782, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.69% (1.6386 => 1.6827, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.68% (4.4873 => 4.6077, std.dev.: 0.0342) MultiSource/Applications/ClamAV/clamscan: 2.60% (14.7684 => 15.1519, std.dev.: 0.0839) MultiSource/Applications/JM/lencod/lencod: 2.52% (15.3280 => 15.7147, std.dev.: 0.0309) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.47% (0.6227 => 0.6381, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.45% (3.1832 => 3.2612, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.45% (0.8697 => 0.8910, std.dev.: 0.0064) MultiSource/Applications/d/make_dparser: 2.38% (3.2366 => 3.3135, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.35% (0.9688 => 0.9916, std.dev.: 0.0043) MultiSource/Benchmarks/PAQ8p/paq8p: 2.26% (2.3764 => 2.4301, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.20% (0.9074 => 0.9274, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.20% (0.8331 => 0.8514, std.dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: 2.16% (31.8598 => 32.5475, std.dev.: 0.1298) MultiSource/Applications/JM/ldecod/ldecod: 2.15% (6.7320 => 6.8767, std.dev.: 0.0333) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.11% (0.8069 => 0.8239, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.09% (0.8177 => 0.8348, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.06% (0.8656 => 0.8834, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.05% (0.8518 => 0.8693, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.98% (0.8086 => 0.8246, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.93% (0.9908 => 1.0099, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.92% (0.8286 => 0.8445, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.91% (0.8712 => 0.8878, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.85% (0.8317 => 0.8471, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.78% (0.8855 => 0.9013, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.77% (0.8805 => 0.8961, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.64% (0.8316 => 0.8452, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 1.50% (0.7557 => 0.7670, std.dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: 1.47% (4.9628 => 5.0360, std.dev.: 0.0255) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.46% (0.8204 => 0.8324, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 141.71% (0.0199 => 0.0481, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/pi: 58.62% (1.5795 => 2.5054, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 22.35% (0.0528 => 0.0646, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.60% (0.7597 => 0.8858, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.32% (2.9753 => 3.4610, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.73% (2.7995 => 3.2118, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6086, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.95% (0.3186 => 0.3503, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.81% (1.1857 => 1.2783, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: 7.23% (1.3037 => 1.3979, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 6.97% (1.7056 => 1.8245, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.59% (4.7794 => 5.0945, std.dev.: 0.0110) MultiSource/Applications/SIBsim4/SIBsim4: 6.47% (3.1873 => 3.3934, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.01% (4.5327 => 4.8051, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.79% (4.9686 => 5.2561, std.dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 5.22% (7.4933 => 7.8845, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.84% (6.2275 => 6.5290, std.dev.: 0.0808) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.67% (3.3761 => 3.5339, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.21% (4.9453 => 5.1534, std.dev.: 0.0363) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.04% (4.9469 => 5.1470, std.dev.: 0.0104) MultiSource/Applications/hexxagon/hexxagon: 3.93% (14.0064 => 14.5571, std.dev.: 0.0224) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.23% (1.2337 => 1.2736, std.dev.: 0.0098) MultiSource/Applications/siod/siod: 2.82% (3.6643 => 3.7678, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.79% (11.5690 => 11.8921, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.74% (4.3552 => 4.4747, std.dev.: 0.0356) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 2.46% (0.4353 => 0.4460, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.45% (4.8362 => 4.9548, std.dev.: 0.0112) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.33% (1.1365 => 1.1630, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.31% (4.8660 => 4.9783, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout/lists: 2.22% (7.3375 => 7.5002, std.dev.: 0.0505) MultiSource/Applications/minisat/minisat: 1.61% (6.1525 => 6.2514, std.dev.: 0.0329) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.31% (4.4340 => 4.4919, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/neural/neural: 1.29% (1.0841 => 1.0981, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 1.20% (1.2061 => 1.2206, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/ReedSolomon: 1.15% (8.5322 => 8.6303, std.dev.: 0.0116) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.15% (5.4641 => 4.3084, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.02% (7.2130 => 6.2015, std.dev.: 0.0729) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.02% (1.0512 => 0.9354, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -10.80% (1.1216 => 1.0005, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: -8.51% (63.1822 => 57.8043, std.dev.: 0.2721) SingleSource/Benchmarks/Shootout/heapsort: -8.34% (3.2926 => 3.0180, std.dev.: 0.0961) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.05% (0.3269 => 0.3006, std.dev.: 0.0079) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.01% (14.6451 => 13.4725, std.dev.: 0.2427) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.87% (4.7482 => 4.4221, std.dev.: 0.0357) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.96% (3.7148 => 3.4935, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.80% (5.4972 => 5.1785, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.16% (5.1557 => 4.8897, std.dev.: 0.0455) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.40% (4.7449 => 4.5363, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.98% (2.8773 => 2.7628, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.74% (6.0224 => 5.7971, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.32% (0.5807 => 0.5614, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/life/life: -3.18% (2.6356 => 2.5518, std.dev.: 0.0137) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.10% (2.4490 => 2.3730, std.dev.: 0.0208) MultiSource/Applications/lua/lua: -3.06% (29.8330 => 28.9188, std.dev.: 0.0805) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.92% (28.5821 => 27.7477, std.dev.: 0.0477) MultiSource/Applications/aha/aha: -2.73% (3.3398 => 3.2485, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.53% (9.9065 => 9.6558, std.dev.: 0.0751) SingleSource/Benchmarks/Shootout-C++/hash2: -2.37% (3.4237 => 3.3426, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.97% (11.5316 => 11.3050, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.92% (3.2169 => 3.1552, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.60% (4.9994 => 4.9195, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.3487 => 2.3147, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.15% (5.6343 => 5.5696, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.15% (1.0262 => 1.0585, std.dev.: 0.0123) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 46.34% (0.0123 => 0.0180, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.94% (0.0408 => 0.0420, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.52% (0.0384 => 0.0382, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 1.67% (0.0180 => 0.0183, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 4.24% (0.1438 => 0.1499, std.dev.: 0.0070) MultiSource/Applications/lemon/lemon: 2.29% (1.1329 => 1.1588, std.dev.: 0.0162) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.12% (0.4164 => 0.4159, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.80% (0.1369 => 0.1421, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.56% (0.0641 => 0.0651, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 38.46% (0.0195 => 0.0270, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.60% (0.0578 => 0.0563, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.23% (1.1437 => 1.2035, std.dev.: 0.0302) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2800.00% (0.0001 => 0.0029, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.03% (0.0627 => 0.0646, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.11% (0.0180 => 0.0236, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.93% (0.8017 => 0.7782, std.dev.: 0.0009) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 9.68% (0.0062 => 0.0068, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 21:39:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 20 Nov 2012 23:39:58 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121121053958.759122A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6098?compare_to=6094&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6098, Order: 168411, Start Time: 2012-11-21 04:06:49, End Time: 2012-11-21 05:40:23 To: 6094, Order: 168409, Start Time: 2012-11-21 02:10:10, End Time: 2012-11-21 03:43:38 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (6 on baseline) Performance Improvements: 0 (178 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (858 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 14.76% (0.3834 => 0.4400, std.dev.: 0.0127) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.07% (2.0478 => 2.1106, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/salsa20: 2.51% (7.4937 => 7.6819, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/hash2: 2.25% (3.1932 => 3.2651, std.dev.: 0.0028) MultiSource/Benchmarks/llubenchmark/llu: 2.08% (3.7435 => 3.8215, std.dev.: 0.0120) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.01% (0.1431 => 0.1302, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.27% (0.3821 => 0.3505, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -7.13% (0.3831 => 0.3558, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/trivial-interface: -7.11% (0.3812 => 0.3541, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.08% (0.3884 => 0.3609, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -7.07% (0.3848 => 0.3576, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -7.06% (0.3896 => 0.3621, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -7.04% (0.3880 => 0.3607, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.93% (0.9542 => 0.8881, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.91% (0.3891 => 0.3622, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.89% (0.4033 => 0.3755, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.87% (0.4176 => 0.3889, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.81% (0.3142 => 0.2928, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.64% (2.4924 => 2.3270, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -6.62% (0.4199 => 0.3921, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.37% (0.3357 => 0.3143, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.30% (0.2428 => 0.2275, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -6.30% (0.2160 => 0.2024, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -6.26% (0.4280 => 0.4012, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.18% (0.7198 => 0.6753, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: -6.16% (9.2283 => 8.6599, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.16% (0.2355 => 0.2210, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.12% (0.1796 => 0.1686, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: -6.11% (16.1920 => 15.2027, std.dev.: 0.0134) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.05% (0.9852 => 0.9256, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.00% (0.6484 => 0.6095, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -5.97% (7.0961 => 6.6725, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/ReedSolomon: -5.96% (0.1879 => 0.1767, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.88% (1.0544 => 0.9924, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.87% (6.7716 => 6.3738, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.85% (1.3722 => 1.2919, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -5.83% (0.9179 => 0.8644, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.83% (4.8161 => 4.5355, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.80% (3.5339 => 3.3290, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.75% (4.0323 => 3.8003, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.70% (0.5863 => 0.5529, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.68% (4.8802 => 4.6030, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.68% (0.2695 => 0.2542, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.67% (1.6364 => 1.5436, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.66% (0.3658 => 0.3451, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.65% (1.4642 => 1.3814, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.63% (1.2300 => 1.1608, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: -5.62% (4.3330 => 4.0895, std.dev.: 0.0132) MultiSource/Benchmarks/sim/sim: -5.61% (0.3406 => 0.3215, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.59% (0.5705 => 0.5386, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.56% (0.6293 => 0.5943, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.53% (0.5478 => 0.5175, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.53% (0.3837 => 0.3625, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.52% (4.5069 => 4.2579, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.51% (0.5859 => 0.5536, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.51% (0.6736 => 0.6365, std.dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: -5.51% (1.1530 => 1.0895, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.50% (0.3057 => 0.2889, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.49% (0.3931 => 0.3715, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.49% (0.5849 => 0.5528, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -5.49% (0.3025 => 0.2859, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.49% (0.6052 => 0.5720, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -5.48% (1.1450 => 1.0822, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.48% (0.7919 => 0.7485, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.47% (0.3016 => 0.2851, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: -5.47% (0.4515 => 0.4268, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -5.47% (0.3255 => 0.3077, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.47% (0.2871 => 0.2714, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.47% (0.5925 => 0.5601, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.46% (0.6297 => 0.5953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.45% (0.3194 => 0.3020, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.45% (0.5802 => 0.5486, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.44% (0.4151 => 0.3925, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -5.43% (1.3148 => 1.2434, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.43% (0.6446 => 0.6096, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.43% (1.2784 => 1.2090, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.42% (0.5570 => 0.5268, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.42% (0.5999 => 0.5674, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.39% (2.1713 => 2.0543, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.38% (0.6304 => 0.5965, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.35% (0.2933 => 0.2776, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.35% (0.3252 => 0.3078, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.34% (0.2939 => 0.2782, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.34% (0.5805 => 0.5495, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.34% (0.2903 => 0.2748, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.32% (0.6667 => 0.6312, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.32% (0.4321 => 0.4091, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.31% (0.2278 => 0.2157, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.31% (0.5575 => 0.5279, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.30% (0.5581 => 0.5285, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -5.30% (17.1032 => 16.1964, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.30% (0.2548 => 0.2413, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.29% (1.3864 => 1.3130, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.29% (14.2083 => 13.4570, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/strcat: -5.29% (0.2989 => 0.2831, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.28% (0.5591 => 0.5296, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -5.27% (0.3394 => 0.3215, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.27% (0.6660 => 0.6309, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.27% (0.4916 => 0.4657, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.27% (0.5941 => 0.5628, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.27% (0.3323 => 0.3148, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -5.26% (0.2985 => 0.2828, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.26% (0.8521 => 0.8073, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: -5.25% (0.3446 => 0.3265, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.25% (0.6189 => 0.5864, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -5.24% (0.3205 => 0.3037, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.24% (0.2999 => 0.2842, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.23% (0.6194 => 0.5870, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -5.23% (0.3059 => 0.2899, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -5.23% (0.2849 => 0.2700, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.23% (0.2659 => 0.2520, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.23% (0.3483 => 0.3301, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -5.19% (0.3581 => 0.3395, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.19% (0.5688 => 0.5393, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.17% (0.4813 => 0.4564, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.16% (0.6260 => 0.5937, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.16% (1.2210 => 1.1580, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: -5.16% (0.3026 => 0.2870, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.15% (0.5456 => 0.5175, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: -5.14% (15.5079 => 14.7102, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.12% (8.0126 => 7.6022, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.11% (1.2221 => 1.1596, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: -5.09% (1.2515 => 1.1878, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/moments: -5.08% (0.4248 => 0.4032, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -5.08% (0.3481 => 0.3304, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.08% (0.6676 => 0.6337, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.04% (0.6681 => 0.6344, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -5.02% (3.5154 => 3.3390, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.00% (0.6440 => 0.6118, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.97% (0.6033 => 0.5733, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.97% (0.3319 => 0.3154, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.97% (0.3867 => 0.3675, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.95% (1.6474 => 1.5659, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -4.94% (0.3621 => 0.3442, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.93% (0.5168 => 0.4913, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.92% (0.4083 => 0.3882, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.88% (22.4056 => 21.3120, std.dev.: 0.0114) SingleSource/UnitTests/ObjC++/property-reference: -4.86% (0.7779 => 0.7401, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -4.83% (2.4021 => 2.2861, std.dev.: 0.0065) MultiSource/Applications/minisat/minisat: -4.82% (0.7447 => 0.7088, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.81% (0.7524 => 0.7162, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -4.81% (0.6347 => 0.6042, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -4.78% (15.2527 => 14.5229, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.78% (0.3849 => 0.3665, std.dev.: 0.0033) MultiSource/Applications/lua/lua: -4.77% (4.0594 => 3.8656, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash2: -4.75% (0.4861 => 0.4630, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.74% (0.4427 => 0.4217, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.74% (0.6395 => 0.6092, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.73% (0.7021 => 0.6689, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.67% (0.7339 => 0.6996, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -4.67% (0.6441 => 0.6140, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.59% (0.9557 => 0.9118, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: -4.58% (2.1401 => 2.0420, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: -4.56% (0.3271 => 0.3122, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: -4.54% (0.3788 => 0.3616, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.47% (0.5329 => 0.5091, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.45% (0.5567 => 0.5319, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -4.42% (18.2933 => 17.4849, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.42% (0.5569 => 0.5323, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.38% (0.3491 => 0.3338, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: -4.37% (5.0226 => 4.8032, std.dev.: 0.0125) MultiSource/Applications/lambda-0_1_3/lambda: -4.35% (0.7982 => 0.7635, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: -4.31% (0.4524 => 0.4329, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.28% (0.6395 => 0.6121, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -4.28% (0.6750 => 0.6461) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.27% (2.2587 => 2.1622, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.26% (0.9077 => 0.8690, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -4.22% (34.0927 => 32.6553, std.dev.: 0.0098) MultiSource/Applications/spiff/spiff: -4.13% (0.8418 => 0.8070, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.71% (5.4682 => 5.2652, std.dev.: 0.0030) MultiSource/Applications/hbd/hbd: -3.09% (1.5610 => 1.5127, std.dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -2.95% (20.7746 => 20.1610, std.dev.: 0.0211) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7519, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1732, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.87% (2.2633 => 2.1756, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.82% (1.7753 => 1.7075, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.00% (1.3096 => 1.2834, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.65% (6.5735 => 6.4649, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 23:35:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 01:35:26 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121121073526.781412A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6099?compare_to=6097&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6099, Order: 168413, Start Time: 2012-11-21 06:05:29, End Time: 2012-11-21 07:35:51 To: 6097, Order: 168411, Start Time: 2012-11-21 03:40:19, End Time: 2012-11-21 05:10:46 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 5 (133 on baseline) Performance Improvements: 1 (26 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1048 (815 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (0.8878 => 0.9021, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.50% (1.4716 => 1.4937, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.42% (4.3183 => 4.3796, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.98% (8.3439 => 8.5088, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.98% (1.5742 => 1.6053, std.dev.: 0.0101) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: -2.11% (1.3069 => 1.2793, std.dev.: 0.0086) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.24% (1.0585 => 1.0610, std.dev.: 0.0189) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.56% (0.0180 => 0.0170, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.14% (0.0420 => 0.0429, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -4.80% (0.0333 => 0.0317, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.63% (0.0315 => 0.0313, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.52% (0.0382 => 0.0384, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/casts: -26.47% (0.0204 => 0.0150, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/test1: 18.03% (0.0183 => 0.0216, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.80% (0.1499 => 0.1487, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: -0.42% (1.1588 => 1.1539, std.dev.: 0.0304) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.43% (0.4159 => 0.4141, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.13% (0.1421 => 0.1405, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.60% (0.0651 => 0.0595, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.37% (0.0270 => 0.0242, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.18% (0.0563 => 0.0562, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.56% (1.2035 => 1.1968, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -41.38% (0.0029 => 0.0017, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.31% (0.0646 => 0.0644, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.42% (0.0236 => 0.0237, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.50% (0.7782 => 0.7821, std.dev.: 0.0029) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -26.47% (0.0068 => 0.0050, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 6.94% (16.4461 => 17.5867, std.dev.: 0.0263) MultiSource/Applications/sqlite3/sqlite3: 2318.26% (0.6332 => 15.3124, std.dev.: 0.0632) MultiSource/Benchmarks/McCat/08-main/main: 47.90% (0.1831 => 0.2708, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.90% (0.1559 => 0.1467, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7042.91% (0.3123 => 22.3073, std.dev.: 0.0683) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.41% (0.2463 => 0.3680, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1518.60% (0.3344 => 5.4126, std.dev.: 0.0542) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.65% (0.2364 => 0.3254, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: 4.54% (0.6010 => 0.6283, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/mandel: 2.80% (0.0429 => 0.0441, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.24% (0.3266 => 0.3437, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 3.76% (0.1969 => 0.2043, std.dev.: 0.0018) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.34% (0.0224 => 0.0227, std.dev.: 0.0008) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0455, std.dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: 11.29% (0.1462 => 0.1627, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4638, std.dev.: 0.0190) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0697, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4914, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5114, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5675, std.dev.: 0.6874) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3163, std.dev.: 0.0161) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1520, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3627, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4071, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0824, std.dev.: 0.0026) SingleSource/Regression/C/uint64_to_float: -24.02% (2.1832 => 1.6589, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.17% (0.0810 => 0.0941, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 13.94% (0.1112 => 0.1267, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.42% (0.1157 => 0.1266, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.72% (0.2180 => 0.2370, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.41% (0.8321 => 0.9021, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.03% (0.2279 => 0.2462, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.92% (0.6010 => 0.6486, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.53% (0.1885 => 0.2008, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 6.32% (1.2222 => 1.2994, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.22% (0.7473 => 0.7938, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.16% (0.3295 => 0.3498, std.dev.: 0.0032) MultiSource/Applications/spiff/spiff: 6.05% (0.7950 => 0.8431, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.76% (0.2240 => 0.2369, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.72% (0.1905 => 0.2014, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.67% (0.2998 => 0.3168, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.51% (0.4847 => 0.5114, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.28% (0.6287 => 0.6619, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.17% (0.5961 => 0.6269, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.01% (0.8148 => 0.8556, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.87% (4.1763 => 4.3796, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.41% (0.2519 => 0.2630, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.30% (0.9435 => 0.9841, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.20% (0.3003 => 0.3129, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.08% (0.4783 => 0.4978, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.90% (6.6074 => 6.8652, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.82% (1.1685 => 1.2131, std.dev.: 0.0113) MultiSource/Applications/lua/lua: 3.75% (3.8189 => 3.9622, std.dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 3.59% (1.1271 => 1.1676, std.dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 3.47% (0.2999 => 0.3103, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.40% (0.3115 => 0.3221, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 3.35% (4.1305 => 4.2688, std.dev.: 0.0293) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.30% (0.8340 => 0.8615, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: 3.25% (1.4269 => 1.4733, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.18% (1.6386 => 1.6907, std.dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: 3.17% (14.7684 => 15.2363, std.dev.: 0.0213) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.16% (1.4479 => 1.4937, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.16% (14.2605 => 14.7113, std.dev.: 0.0409) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.16% (0.5191 => 0.5355, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.14% (4.4873 => 4.6282, std.dev.: 0.0250) MultiSource/Applications/treecc/treecc: 3.11% (1.9948 => 2.0569, std.dev.: 0.0182) MultiSource/Applications/minisat/minisat: 3.10% (0.6834 => 0.7046, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.08% (0.4127 => 0.4254, std.dev.: 0.0029) MultiSource/Applications/siod/siod: 2.98% (2.2184 => 2.2844, std.dev.: 0.0136) MultiSource/Applications/d/make_dparser: 2.97% (3.2366 => 3.3328, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.96% (2.1401 => 2.2035, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.83% (1.3279 => 1.3655, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.83% (13.1811 => 13.5538, std.dev.: 0.0391) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.79% (8.6476 => 8.8888, std.dev.: 0.0253) MultiSource/Benchmarks/Bullet/bullet: 2.64% (31.8598 => 32.7022, std.dev.: 0.0228) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.63% (0.8286 => 0.8504, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.60% (0.6227 => 0.6389, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.52% (1.1170 => 1.1451, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/football/football: 2.50% (0.8768 => 0.8987, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 2.36% (0.7557 => 0.7735, std.dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (6.7320 => 6.8864, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.29% (0.8611 => 0.8808, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.25% (0.9688 => 0.9906, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.24% (0.8597 => 0.8790, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.22% (4.4880 => 4.5877, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.22% (0.9069 => 0.9270, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 2.21% (15.3280 => 15.6664, std.dev.: 0.0430) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.17% (0.9074 => 0.9271, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.16% (0.8420 => 0.8602, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.16% (0.8050 => 0.8224, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 2.14% (2.3764 => 2.4272, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.12% (0.9056 => 0.9248, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.09% (0.8697 => 0.8879, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.09% (0.8855 => 0.9040, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.04% (0.8518 => 0.8692, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.04% (0.9039 => 0.9223, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.03% (0.9908 => 1.0109, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.02% (3.1832 => 3.2475, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.01% (0.8457 => 0.8627, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.94% (0.8048 => 0.8204, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.93% (0.8712 => 0.8880, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 1.93% (0.9810 => 0.9999, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.88% (0.8716 => 0.8880, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 1.86% (8.6247 => 8.7852, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.85% (0.8359 => 0.8514, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.85% (0.7932 => 0.8079, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.84% (0.8007 => 0.8154, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.83% (0.7966 => 0.8112, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.82% (0.8066 => 0.8213, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.80% (0.8177 => 0.8324, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.80% (0.8069 => 0.8214, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 1.79% (1.2568 => 1.2793, std.dev.: 0.0086) MultiSource/Applications/oggenc/oggenc: 1.77% (4.9628 => 5.0506, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.77% (0.8317 => 0.8464, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.77% (0.8261 => 0.8407, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.74% (0.8656 => 0.8807, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.71% (0.8885 => 0.9037, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.66% (0.8316 => 0.8454, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.63% (1.0945 => 1.1123, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.50% (0.8927 => 0.9061, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.50% (1.2602 => 1.2791, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.28% (1.2423 => 1.2582, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.13% (0.8995 => 0.9097, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 125.63% (0.0199 => 0.0449, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/pi: 57.54% (1.5795 => 2.4883, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.86% (0.7597 => 0.8878, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.05% (2.9753 => 3.4529, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.41% (2.7995 => 3.2030, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6091, std.dev.: 0.0594) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.76% (0.3186 => 0.3497, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.88% (1.1857 => 1.2791, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/queens: 7.45% (1.7056 => 1.8326, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/richards_benchmark: 6.99% (1.3037 => 1.3948, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.59% (4.7794 => 5.0942, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.92% (4.5327 => 4.8010, std.dev.: 0.0118) MultiSource/Applications/SIBsim4/SIBsim4: 5.88% (3.1873 => 3.3747, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.79% (4.9686 => 5.2561, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.76% (6.2275 => 6.5239, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.36% (3.3761 => 3.5234, std.dev.: 0.0089) MultiSource/Applications/lambda-0_1_3/lambda: 4.33% (7.4933 => 7.8174, std.dev.: 0.0411) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.23% (4.9453 => 5.1543, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.00% (4.9469 => 5.1449, std.dev.: 0.0086) MultiSource/Applications/hexxagon/hexxagon: 3.82% (14.0064 => 14.5418, std.dev.: 0.0096) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.66% (1.2337 => 1.2788, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.37% (0.3587 => 0.3708, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 2.89% (3.6643 => 3.7703, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.78% (8.2783 => 8.5088, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.78% (11.5690 => 11.8901, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.62% (4.8362 => 4.9628, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/lists: 2.52% (7.3375 => 7.5224, std.dev.: 0.0213) MultiSource/Benchmarks/llubenchmark/llu: 2.04% (1.9967 => 2.0375, std.dev.: 0.0148) SingleSource/Benchmarks/Stanford/FloatMM: 1.50% (0.8807 => 0.8939, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.37% (2.4647 => 2.4985, std.dev.: 0.0121) SingleSource/Benchmarks/Misc/ReedSolomon: 1.34% (8.5322 => 8.6466, std.dev.: 0.0210) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.32% (1.1365 => 1.1515, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/neural/neural: 1.19% (1.0841 => 1.0970, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.17% (1.4205 => 1.4371, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.12% (3.5679 => 3.6080, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/power/power: 1.07% (1.2061 => 1.2190, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -32.25% (0.0338 => 0.0229, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/em3d/em3d: -21.06% (5.4641 => 4.3134, std.dev.: 0.0232) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.18% (7.2130 => 6.2623, std.dev.: 0.1854) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.95% (1.0512 => 0.9361, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.21% (0.3269 => 0.2968, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: -8.50% (63.1822 => 57.8104, std.dev.: 0.0707) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.10% (14.6451 => 13.4586, std.dev.: 0.0654) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.88% (4.7482 => 4.4215, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.88% (5.4972 => 5.1739, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.08% (5.1557 => 4.8937, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.39% (4.7449 => 4.5365, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.81% (6.0224 => 5.7930, std.dev.: 0.0108) MultiSource/Applications/lua/lua: -3.32% (29.8330 => 28.8413, std.dev.: 0.0918) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.20% (2.8773 => 2.7853, std.dev.: 0.0184) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (28.5821 => 27.7022, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C++/life/life: -3.03% (2.6356 => 2.5558, std.dev.: 0.0164) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.98% (0.5807 => 0.5634, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: -2.68% (0.5415 => 0.5270, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.66% (9.9065 => 9.6434, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/hash2: -2.29% (3.4237 => 3.3454, std.dev.: 0.0071) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.07% (1.2822 => 1.2556, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.01% (11.5316 => 11.2997, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bisort/bisort: -1.79% (0.6636 => 0.6517, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.70% (2.3487 => 2.3088, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.59% (4.9994 => 4.9201, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.14% (5.6343 => 5.5699, std.dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.39% (1.0262 => 1.0610, std.dev.: 0.0189) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 38.21% (0.0123 => 0.0170, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.15% (0.0408 => 0.0429, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 24.80% (0.0254 => 0.0317, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0384 => 0.0384, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/casts: -21.05% (0.0190 => 0.0150, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 3.41% (0.1438 => 0.1487, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: 1.85% (1.1329 => 1.1539, std.dev.: 0.0304) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.55% (0.4164 => 0.4141, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.63% (0.1369 => 0.1405, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.18% (0.0641 => 0.0595, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 24.10% (0.0195 => 0.0242, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.77% (0.0578 => 0.0562, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.64% (1.1437 => 1.1968, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1600.00% (0.0001 => 0.0017, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.71% (0.0627 => 0.0644, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.67% (0.0180 => 0.0237, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.44% (0.8017 => 0.7821, std.dev.: 0.0029) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -19.35% (0.0062 => 0.0050, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 20 23:41:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 01:41:27 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121121074127.9A9D72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6100?compare_to=6098&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6100, Order: 168413, Start Time: 2012-11-21 06:08:21, End Time: 2012-11-21 07:41:51 To: 6098, Order: 168411, Start Time: 2012-11-21 04:06:49, End Time: 2012-11-21 05:40:23 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (179 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (858 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.96% (0.3834 => 0.4446, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.72% (2.0478 => 2.1035, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/salsa20: 2.33% (7.4937 => 7.6682, std.dev.: 0.0200) SingleSource/Benchmarks/Shootout-C++/hash2: 1.89% (3.1932 => 3.2537, std.dev.: 0.0068) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.24% (0.3821 => 0.3506, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.08% (0.3884 => 0.3609, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -7.07% (0.3831 => 0.3560, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -7.07% (0.3848 => 0.3576, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -7.06% (0.3880 => 0.3606, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -7.06% (0.3896 => 0.3621, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -7.06% (0.3812 => 0.3543, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.89% (0.3891 => 0.3623, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -6.87% (0.4176 => 0.3889, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: -6.79% (0.4033 => 0.3759, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.75% (0.3142 => 0.2930, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.61% (2.4924 => 2.3276, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: -6.57% (0.4199 => 0.3923, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.57% (0.9542 => 0.8915, std.dev.: 0.0054) MultiSource/Applications/sgefa/sgefa: -6.52% (0.3357 => 0.3138, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: -6.30% (0.2160 => 0.2024, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.26% (0.2428 => 0.2276, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -6.21% (0.4280 => 0.4014, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.18% (0.1796 => 0.1685, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -6.16% (9.2283 => 8.6596, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.16% (0.2355 => 0.2210, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -6.13% (16.1920 => 15.1989, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.04% (0.7198 => 0.6763, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.01% (0.9852 => 0.9260, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.94% (0.6484 => 0.6099, std.dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: -5.91% (7.0961 => 6.6770, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.87% (1.3722 => 1.2917, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.84% (4.8161 => 4.5349, std.dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.83% (6.7716 => 6.3768, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.83% (0.1716 => 0.1616, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -5.81% (0.9179 => 0.8646, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.76% (3.5339 => 3.3302, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.74% (0.3658 => 0.3448, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.72% (4.0323 => 3.8017, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/ReedSolomon: -5.69% (0.1879 => 0.1772, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.66% (1.0544 => 0.9947, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.64% (0.5478 => 0.5169, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.63% (0.5863 => 0.5533, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.63% (1.6364 => 1.5443, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.60% (0.2695 => 0.2544, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.59% (4.8802 => 4.6072, std.dev.: 0.0040) MultiSource/Benchmarks/sim/sim: -5.58% (0.3406 => 0.3216, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.55% (1.4642 => 1.3829, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/gs/gs: -5.54% (4.3330 => 4.0930, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/fibo: -5.54% (0.2871 => 0.2712, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: -5.54% (1.1450 => 1.0816, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.53% (0.5591 => 0.5282, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -5.52% (0.3025 => 0.2858, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.50% (1.2300 => 1.1623, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.50% (0.3057 => 0.2889, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.50% (0.5805 => 0.5486, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.49% (0.3931 => 0.3715, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.49% (0.5925 => 0.5600, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: -5.48% (0.3194 => 0.3019, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.47% (0.3837 => 0.3627, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.46% (0.2985 => 0.2822, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: -5.45% (1.1530 => 1.0902, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.44% (0.6667 => 0.6304, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.43% (0.6293 => 0.5951, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.43% (0.5705 => 0.5395, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.43% (0.6230 => 0.5892, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.42% (0.4151 => 0.3926, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.42% (0.6052 => 0.5724, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.42% (0.7919 => 0.7490, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.41% (0.5857 => 0.5540, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.40% (0.3016 => 0.2853, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.40% (4.5069 => 4.2634, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.39% (2.1713 => 2.0542, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: -5.38% (1.3148 => 1.2441, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/matrix: -5.38% (0.3255 => 0.3080, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.37% (0.2903 => 0.2747, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.37% (0.6297 => 0.5959, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.37% (1.2784 => 1.2098, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: -5.35% (0.2989 => 0.2829, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -5.34% (0.2939 => 0.2782, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.34% (0.4515 => 0.4274, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.33% (0.6194 => 0.5864, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -5.33% (17.1032 => 16.1922, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.32% (0.3252 => 0.3079, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.31% (0.6304 => 0.5969, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -5.30% (0.3205 => 0.3035, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.30% (0.6189 => 0.5861, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: -5.29% (1.3864 => 1.3130, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.29% (0.5859 => 0.5549, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.29% (14.2083 => 13.4572, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.29% (0.6736 => 0.6380, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: -5.27% (0.3394 => 0.3215, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.27% (0.5999 => 0.5683, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.26% (0.2548 => 0.2414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.26% (0.5575 => 0.5282, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.26% (0.6660 => 0.6310, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -5.25% (0.3026 => 0.2867, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.25% (0.5581 => 0.5288, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.24% (0.6446 => 0.6108, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -5.24% (1.2515 => 1.1859, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.24% (0.6260 => 0.5932, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.23% (0.5941 => 0.5630, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: -5.22% (0.3446 => 0.3266, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.22% (0.8521 => 0.8076, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.21% (0.4321 => 0.4096, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -5.19% (0.2849 => 0.2701, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.19% (0.5802 => 0.5501, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.19% (0.4916 => 0.4661, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.18% (0.2933 => 0.2781, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.18% (0.5849 => 0.5546, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.18% (0.6681 => 0.6335, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.17% (0.5570 => 0.5282, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -5.15% (15.5079 => 14.7098, std.dev.: 0.0117) SingleSource/Regression/C++/ofstream_ctor: -5.13% (0.3059 => 0.2902, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -5.11% (0.2659 => 0.2523, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.11% (0.5456 => 0.5177, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -5.11% (0.3481 => 0.3303, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -5.11% (3.5154 => 3.3359, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/moments: -5.08% (0.4248 => 0.4032, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.08% (0.3483 => 0.3306, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.08% (8.0126 => 7.6056, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.08% (0.6676 => 0.6337, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.07% (0.2999 => 0.2847, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.06% (1.2210 => 1.1592, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.06% (1.2221 => 1.1603, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.05% (0.6440 => 0.6115, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.01% (0.5688 => 0.5403, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.99% (0.3867 => 0.3674, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -4.97% (0.3621 => 0.3441, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -4.94% (0.3581 => 0.3404, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.94% (0.6033 => 0.5735, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.92% (0.4083 => 0.3882, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.92% (1.6474 => 1.5664, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: -4.90% (0.7447 => 0.7082, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -4.90% (0.4861 => 0.4623, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -4.87% (4.0594 => 3.8616, std.dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: -4.86% (15.2527 => 14.5116, std.dev.: 0.0075) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.85% (0.3319 => 0.3158, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.85% (22.4056 => 21.3196, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.83% (0.3849 => 0.3663, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.82% (0.4813 => 0.4581, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.82% (0.5168 => 0.4919, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.81% (0.7021 => 0.6683, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.81% (0.6347 => 0.6042, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -4.77% (2.4021 => 2.2875, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -4.74% (0.6441 => 0.6136, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.72% (0.4427 => 0.4218, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.65% (0.7524 => 0.7174, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.62% (0.7339 => 0.7000, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.57% (0.9557 => 0.9120, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: -4.54% (2.1401 => 2.0430, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.52% (0.5329 => 0.5088, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -4.51% (0.7982 => 0.7622, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: -4.49% (0.3788 => 0.3618, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.46% (0.6395 => 0.6110, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.42% (0.5569 => 0.5323, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.36% (0.6395 => 0.6116, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: -4.35% (0.8418 => 0.8052, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: -4.34% (0.3271 => 0.3129, std.dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: -4.32% (5.0226 => 4.8055, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.31% (0.5567 => 0.5327, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.27% (0.3491 => 0.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -4.27% (0.6750 => 0.6462, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -4.27% (0.4524 => 0.4331, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.24% (0.9077 => 0.8692, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: -4.21% (18.2933 => 17.5231, std.dev.: 0.0052) SingleSource/UnitTests/ObjC++/property-reference: -4.19% (0.7779 => 0.7453, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.16% (2.2587 => 2.1648, std.dev.: 0.0041) MultiSource/Benchmarks/Bullet/bullet: -4.07% (34.0927 => 32.7036, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.57% (5.4682 => 5.2731, std.dev.: 0.0030) MultiSource/Applications/hbd/hbd: -3.16% (1.5610 => 1.5117, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -2.88% (20.7746 => 20.1770, std.dev.: 0.0157) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.50% (7.5137 => 5.7482, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1723, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.89% (2.2633 => 2.1753, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7069, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.69% (79.7170 => 78.3681, std.dev.: 0.5092) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.61% (6.5735 => 6.4679, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 00:00:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 02:00:50 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121121080050.A85032A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6101?compare_to=6095&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6101, Order: 168411, Start Time: 2012-11-21 05:40:37, End Time: 2012-11-21 08:01:14 To: 6095, Order: 168409, Start Time: 2012-11-21 02:24:41, End Time: 2012-11-21 04:45:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 18 (127 on baseline) Performance Improvements: 5 (40 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1065 (720 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 14.82% (0.7193 => 0.8259, std.dev.: 0.0073) MultiSource/Applications/lambda-0_1_3/lambda: 14.80% (0.8548 => 0.9813, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 14.13% (2.4743 => 2.8238, std.dev.: 0.0336) SingleSource/Benchmarks/Misc/ReedSolomon: 10.31% (0.2202 => 0.2429, std.dev.: 0.0014) SingleSource/Benchmarks/LivermoreLoops/kernel15: 10.19% (0.1187 => 0.1308, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.14% (0.6863 => 0.7490, std.dev.: 0.0222) MultiSource/Applications/viterbi/viterbi: 9.10% (0.1791 => 0.1954, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.89% (0.3601 => 0.3921, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.88% (1.1105 => 1.1980, std.dev.: 0.0137) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.23% (0.1715 => 0.1839, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.78% (0.1916 => 0.2046, std.dev.: 0.0050) MultiSource/Applications/spiff/spiff: 6.73% (0.8974 => 0.9578, std.dev.: 0.0184) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.29% (0.3355 => 0.3566, std.dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/flops: 28.57% (6.7486 => 8.6768, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.59% (5.6783 => 6.7909, std.dev.: 0.4148) MultiSource/Benchmarks/Olden/health/health: 9.29% (0.4637 => 0.5068, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 5.78% (6.1471 => 6.5021, std.dev.: 0.0477) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.66% (2.3083 => 2.3466, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -9.43% (0.2333 => 0.2113, std.dev.: 0.0080) SingleSource/UnitTests/ObjC++/Hello: -5.68% (0.7198 => 0.6789, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/moments: -5.52% (0.5057 => 0.4778, std.dev.: 0.0081) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -15.07% (4.9549 => 4.2083, std.dev.: 0.2851) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.10% (5.5638 => 5.3358, std.dev.: 0.0806) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 1.34% (0.1339 => 0.1357, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.48% (0.0419 => 0.0421, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.41% (0.0675 => 0.0652, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -0.10% (494.1568 => 493.6537, std.dev.: 0.2724) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0421, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/power/power: 43675.27% (1.1277 => 493.6537, std.dev.: 0.2724) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 205.79% (0.5229 => 1.5990, std.dev.: 0.0662) MultiSource/Applications/SPASS/SPASS: 21.02% (14.9895 => 18.1404, std.dev.: 0.3182) MultiSource/Applications/kimwitu++/kc: 50.74% (14.1553 => 21.3379, std.dev.: 0.1626) MultiSource/Benchmarks/MallocBench/gs/gs: 15.50% (4.1105 => 4.7478, std.dev.: 0.1847) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.22% (1.1048 => 1.5160, std.dev.: 0.0725) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.54% (7.1582 => 37.5477, std.dev.: 0.6717) SingleSource/Benchmarks/Misc-C++-EH/spirit: 79.38% (3.4629 => 6.2119, std.dev.: 0.2565) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.27% (0.6222 => 1.0283, std.dev.: 0.0637) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10473.61% (0.0720 => 7.6130, std.dev.: 0.3758) MultiSource/Applications/SIBsim4/SIBsim4: 3859900.00% (0.0001 => 3.8600, std.dev.: 0.0499) MultiSource/Applications/SPASS/SPASS: 13193400.00% (0.0001 => 13.1935, std.dev.: 1.5678) MultiSource/Applications/kimwitu++/kc: 51900.00% (0.0001 => 0.0520, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575900.00% (0.0001 => 0.5760, std.dev.: 0.0260) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10077900.00% (0.0001 => 10.0780, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6790800.00% (0.0001 => 6.7909, std.dev.: 0.4148) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1805.32% (1.1194 => 21.3282, std.dev.: 0.4274) MultiSource/Applications/ClamAV/clamscan: 66.79% (22.1758 => 36.9867, std.dev.: 0.8186) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 64.05% (2.9384 => 4.8204, std.dev.: 0.2719) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.21% (7.0540 => 10.8077, std.dev.: 0.2738) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 52.55% (8.1363 => 12.4122, std.dev.: 0.1934) MultiSource/Applications/JM/lencod/lencod: 47.27% (21.9371 => 32.3062, std.dev.: 0.1746) MultiSource/Benchmarks/FreeBench/distray/distray: 46.31% (0.1056 => 0.1545, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/flops: 44.97% (0.1432 => 0.2076, std.dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/almabench: 38.22% (0.0730 => 0.1009, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 32.02% (0.7433 => 0.9813, std.dev.: 0.0087) SingleSource/UnitTests/vla: 29.86% (0.0355 => 0.0461, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 29.17% (0.1584 => 0.2046, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/messages-2: 28.55% (0.0662 => 0.0851, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 28.21% (2.2024 => 2.8238, std.dev.: 0.0336) MultiSource/Benchmarks/Olden/em3d/em3d: 28.08% (0.1695 => 0.2171, std.dev.: 0.0026) MultiSource/Applications/viterbi/viterbi: 25.66% (0.1555 => 0.1954, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 25.63% (0.3121 => 0.3921, std.dev.: 0.0061) SingleSource/Benchmarks/Stanford/Oscar: 24.69% (0.0636 => 0.0793, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.26% (0.0746 => 0.0927, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/huffbench: 24.00% (0.0871 => 0.1080, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 23.63% (0.0457 => 0.0565, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 23.20% (1.5859 => 1.9538, std.dev.: 0.0682) MultiSource/Benchmarks/McCat/08-main/main: 22.91% (0.2554 => 0.3139, std.dev.: 0.0194) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.68% (0.9765 => 1.1980, std.dev.: 0.0137) MultiSource/Benchmarks/Olden/health/health: 22.63% (0.1268 => 0.1555, std.dev.: 0.0053) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 22.35% (0.0953 => 0.1166, std.dev.: 0.0024) MultiSource/Applications/spiff/spiff: 22.25% (0.7835 => 0.9578, std.dev.: 0.0184) MultiSource/Benchmarks/Ptrdist/ks/ks: 21.79% (0.1510 => 0.1839, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.78% (0.1566 => 0.1907, std.dev.: 0.0109) MultiSource/Applications/d/make_dparser: 21.33% (3.3354 => 4.0469, std.dev.: 0.1139) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.25% (14.3668 => 17.4193, std.dev.: 0.3106) MultiSource/Benchmarks/Olden/tsp/tsp: 20.68% (0.1175 => 0.1418, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 20.57% (0.0491 => 0.0592, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/matrix: 20.42% (0.0818 => 0.0985, std.dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 20.39% (0.3109 => 0.3743, std.dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.33% (0.4615 => 0.5553, std.dev.: 0.0168) MultiSource/Benchmarks/Olden/perimeter/perimeter: 19.48% (0.0770 => 0.0920, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/parameter-passing: 19.30% (0.3927 => 0.4685, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.11% (0.2700 => 0.3216, std.dev.: 0.0199) SingleSource/UnitTests/ObjC/property: 18.61% (0.3886 => 0.4609, std.dev.: 0.0144) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.58% (0.1125 => 0.1334, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/ReedSolomon: 18.55% (0.2049 => 0.2429, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 18.46% (4.9449 => 5.8578, std.dev.: 0.1273) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 18.41% (0.1695 => 0.2007, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/lists: 18.38% (0.3422 => 0.4051, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/moments: 18.03% (0.4048 => 0.4778, std.dev.: 0.0081) SingleSource/UnitTests/ObjC/synchronized: 18.03% (0.3561 => 0.4203, std.dev.: 0.0087) SingleSource/UnitTests/ObjC/instance-method-metadata: 17.92% (0.3543 => 0.4178, std.dev.: 0.0091) SingleSource/UnitTests/ObjC/exceptions-2: 17.90% (0.3497 => 0.4123, std.dev.: 0.0097) SingleSource/UnitTests/ObjC/exceptions-4: 17.87% (0.3543 => 0.4176, std.dev.: 0.0187) SingleSource/UnitTests/ObjC/exceptions-3: 17.86% (0.3516 => 0.4144, std.dev.: 0.0149) SingleSource/UnitTests/ObjC/exceptions: 17.79% (0.3828 => 0.4509, std.dev.: 0.0111) SingleSource/UnitTests/ObjC/for-in: 17.76% (0.3694 => 0.4350, std.dev.: 0.0106) SingleSource/UnitTests/ObjC/trivial-interface: 17.68% (0.3473 => 0.4087, std.dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 17.06% (0.0838 => 0.0981, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 17.02% (0.3232 => 0.3782, std.dev.: 0.0085) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.91% (0.8172 => 0.9554, std.dev.: 0.0397) SingleSource/Regression/C++/ofstream_ctor: 16.83% (0.2905 => 0.3394, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/except: 16.79% (0.2871 => 0.3353, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ary2: 16.78% (0.3379 => 0.3946, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout/lists: 16.77% (0.0626 => 0.0731, std.dev.: 0.0038) MultiSource/Applications/lua/lua: 16.65% (3.8723 => 4.5171, std.dev.: 0.1826) SingleSource/Benchmarks/Shootout-C++/ary3: 16.60% (0.3283 => 0.3828, std.dev.: 0.0107) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.43% (0.0834 => 0.0971, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.40% (0.2756 => 0.3208, std.dev.: 0.0115) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.36% (0.0648 => 0.0754, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/mst/mst: 16.25% (0.1163 => 0.1352, std.dev.: 0.0071) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.18% (4.2646 => 4.9546, std.dev.: 0.2130) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.07% (0.8101 => 0.9403, std.dev.: 0.0262) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.86% (0.2793 => 0.3236, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/hello: 15.81% (0.2714 => 0.3143, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/random: 15.67% (0.2802 => 0.3241, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.48% (0.1337 => 0.1544, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.40% (0.1117 => 0.1289, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.06% (0.0770 => 0.0886, std.dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference-object: 15.01% (0.6030 => 0.6935, std.dev.: 0.0158) MultiSource/Applications/sqlite3/sqlite3: 14.73% (17.1811 => 19.7122, std.dev.: 0.6313) MultiSource/Benchmarks/Bullet/bullet: 14.62% (63.2438 => 72.4870, std.dev.: 0.3412) SingleSource/UnitTests/ObjC++/Hello: 14.58% (0.5925 => 0.6789, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 14.41% (0.3441 => 0.3937, std.dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.23% (0.5981 => 0.6832, std.dev.: 0.0269) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.22% (0.1062 => 0.1213, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.06% (0.5569 => 0.6352, std.dev.: 0.0303) SingleSource/Benchmarks/Shootout-C++/objinst: 13.83% (0.3131 => 0.3564, std.dev.: 0.0101) MultiSource/Benchmarks/PAQ8p/paq8p: 13.70% (10.3673 => 11.7879, std.dev.: 0.2412) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.59% (0.4636 => 0.5266, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.58% (0.3307 => 0.3756, std.dev.: 0.0129) MultiSource/Benchmarks/mafft/pairlocalalign: 13.14% (9.4845 => 10.7303, std.dev.: 0.4173) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.99% (5.0018 => 5.6517, std.dev.: 0.1809) SingleSource/Benchmarks/Shootout-C++/fibo: 12.66% (0.2725 => 0.3070, std.dev.: 0.0114) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.24% (0.3177 => 0.3566, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.68% (0.1892 => 0.2113, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/hash2: 11.23% (0.4620 => 0.5139, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.11% (0.4203 => 0.4670, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/hash: 11.07% (0.4289 => 0.4764, std.dev.: 0.0176) SingleSource/Benchmarks/Shootout-C++/lists1: 10.10% (0.3684 => 0.4056, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/strcat: 9.33% (0.2831 => 0.3095, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.92% (0.2891 => 0.3149, std.dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 149.55% (4.3953 => 10.9685, std.dev.: 0.0276) SingleSource/Benchmarks/Shootout-C++/methcall: 147.21% (5.3999 => 13.3493, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/oourafft: 17.46% (6.6465 => 7.8068, std.dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.64% (1.1145 => 1.2999, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/health/health: 14.02% (0.4445 => 0.5068, std.dev.: 0.0128) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.01% (0.2944 => 0.3327, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.58% (2.8904 => 3.2252, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: 10.29% (1.1396 => 1.2569, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.98% (8.6802 => 9.5462, std.dev.: 0.2686) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.42% (1.7254 => 1.8879, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.94% (0.9540 => 1.0107, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.56% (4.2280 => 4.4631, std.dev.: 0.0137) SingleSource/Regression/C/uint64_to_float: 5.10% (0.5413 => 0.5689, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.10% (26.0924 => 27.1611, std.dev.: 0.3396) MultiSource/Benchmarks/nbench/nbench: 4.06% (11.6436 => 12.1167, std.dev.: 0.0132) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 2.38% (0.6223 => 0.6371, std.dev.: 0.0040) MultiSource/Benchmarks/PAQ8p/paq8p: 2.19% (85.0658 => 86.9304, std.dev.: 0.0599) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.13% (1.3677 => 1.3968, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 2.05% (3.1595 => 3.2244, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: 1.98% (2.4116 => 2.4594, std.dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: 1.63% (27.8444 => 28.2973, std.dev.: 0.0250) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.43% (2.3135 => 2.3466, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.37% (6.5088 => 6.5980, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.33% (1.0313 => 1.0450, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 1.18% (2.2771 => 2.3040, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0502, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1688, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.76% (5.2763 => 1.2262, std.dev.: 0.0427) SingleSource/Benchmarks/Misc/salsa20: -75.44% (0.8651 => 0.2125, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/richards_benchmark: -44.57% (0.1622 => 0.0899, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.84% (5.3855 => 4.6938, std.dev.: 0.1641) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.76% (5.3526 => 4.7769, std.dev.: 0.1406) MultiSource/Applications/JM/ldecod/ldecod: -7.45% (10.4361 => 9.6582, std.dev.: 0.2920) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.13% (0.3987 => 0.2387, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.25% (4.5009 => 2.7791, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: -33.54% (1.1492 => 0.7638, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -27.90% (10.7105 => 7.7228, std.dev.: 0.6406) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.15% (2.6546 => 2.0136, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -19.16% (0.2161 => 0.1747, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.66% (1.6925 => 1.4274, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.69% (2.6778 => 2.2845, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.69% (32.5116 => 29.0350, std.dev.: 0.0255) SingleSource/Benchmarks/Misc/mandel-2: -10.63% (1.5373 => 1.3739, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -10.50% (9.5636 => 8.5597, std.dev.: 0.2597) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.05% (1.5660 => 1.4243, std.dev.: 0.0049) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.88% (1.6805 => 1.5480, std.dev.: 0.0485) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.59% (3.2416 => 3.0281, std.dev.: 0.0233) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5760, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -5.57% (19.9488 => 18.8375, std.dev.: 0.1601) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.98% (1.5835 => 1.5047, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: -4.30% (6.2999 => 6.0292, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.38% (0.9957 => 0.9620, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: -3.09% (5.0483 => 4.8922, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.56% (0.4808 => 0.4685, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.79% (8.1563 => 8.0104, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -1.49% (10.2830 => 10.1300, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.62% (0.1485 => 0.1357, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0012) Report Time: 2.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 01:02:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 03:02:49 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121121090249.F06382A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6102?compare_to=6096&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6102, Order: 168411, Start Time: 2012-11-21 05:39:22, End Time: 2012-11-21 09:03:13 To: 6096, Order: 168400, Start Time: 2012-11-21 01:30:31, End Time: 2012-11-21 04:51:18 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (169 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1091 (722 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.41% (1.9865 => 2.0145, std.dev.: 0.0023) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.92% (0.0625 => 0.0887, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.02% (0.1063 => 0.1414, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.76% (0.1106 => 0.1402, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.64% (0.2969 => 0.3760, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 26.44% (1.5932 => 2.0145, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.33% (0.0714 => 0.0902, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.49% (0.4139 => 0.5194, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.34% (0.4253 => 0.5288, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.05% (0.4994 => 0.6195, std.dev.: 0.0050) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.97% (0.0584 => 0.0724, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.94% (0.5000 => 0.6197, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.58% (0.0475 => 0.0587, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.44% (0.5900 => 0.7283, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.85% (0.0897 => 0.1102, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 22.37% (0.0599 => 0.0733, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.23% (0.1021 => 0.1248, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.16% (0.1620 => 0.1979, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.13% (0.1107 => 0.1352, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.92% (0.0584 => 0.0712, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.07% (0.0541 => 0.0655, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.01% (0.0633 => 0.0766, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.83% (0.3903 => 0.4716, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 20.78% (0.0948 => 0.1145, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.76% (0.1103 => 0.1332, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.61% (0.0495 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 20.58% (0.0821 => 0.0990, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.56% (0.0642 => 0.0774, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.39% (0.1604 => 0.1931, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.34% (0.1549 => 0.1864, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.24% (0.1003 => 0.1206, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.95% (0.0822 => 0.0986, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 19.95% (0.1619 => 0.1942, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.84% (0.1462 => 0.1752) SingleSource/UnitTests/ObjC++/Hello: 19.70% (0.5826 => 0.6974, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 19.68% (0.0808 => 0.0967, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 19.44% (0.5889 => 0.7034, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 19.43% (0.0947 => 0.1131, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.33% (0.3890 => 0.4642, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.02% (0.2014 => 0.2397, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.61% (1.3152 => 1.5600, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.51% (0.0605 => 0.0717, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 18.47% (0.1218 => 0.1443, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.35% (0.2736 => 0.3238, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 18.09% (0.4029 => 0.4758, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 18.05% (0.0698 => 0.0824, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.01% (0.1088 => 0.1284, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 18.01% (0.1505 => 0.1776, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.79% (0.2866 => 0.3376, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 17.67% (0.5546 => 0.6526, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.66% (0.0572 => 0.0673, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.63% (0.0573 => 0.0674, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.61% (3.5627 => 4.1901, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.58% (0.4658 => 0.5477, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.58% (0.1968 => 0.2314, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.57% (0.5026 => 0.5909, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 17.37% (0.9697 => 1.1381, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.35% (1.6211 => 1.9023, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.32% (0.2875 => 0.3373, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/gs/gs: 17.28% (1.8794 => 2.2042, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/strcat: 17.16% (0.2750 => 0.3222, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.09% (0.3271 => 0.3830, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 17.07% (0.7171 => 0.8395, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.98% (0.1160 => 0.1357, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 16.82% (0.1421 => 0.1660, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.81% (0.4361 => 0.5094, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: 16.73% (1.0781 => 1.2585, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.57% (4.4195 => 5.1520, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/matrix: 16.51% (0.2780 => 0.3239, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.44% (0.3930 => 0.4576, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/fibo: 16.40% (0.2725 => 0.3172, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.40% (0.2738 => 0.3187, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 16.35% (0.2813 => 0.3273, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 16.34% (0.9909 => 1.1528, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.31% (0.2729 => 0.3174, std.dev.: 0.0161) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.28% (0.3195 => 0.3715, std.dev.: 0.0094) MultiSource/Applications/ClamAV/clamscan: 16.27% (4.2109 => 4.8962, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.26% (0.2792 => 0.3246, std.dev.: 0.0071) SingleSource/Regression/C++/ofstream_ctor: 16.25% (0.3004 => 0.3492, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 16.22% (0.2811 => 0.3267, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.21% (2.7292 => 3.1715, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: 16.20% (0.1284 => 0.1492, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 16.15% (0.2823 => 0.3279, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.15% (0.2911 => 0.3381, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.06% (0.1090 => 0.1265, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.04% (2.0673 => 2.3989, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/ary3: 16.04% (0.3267 => 0.3791, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 15.95% (0.2075 => 0.2406, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 15.92% (23.5202 => 27.2655, std.dev.: 0.0258) SingleSource/Benchmarks/Shootout-C++/ary: 15.90% (0.3258 => 0.3776, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 15.89% (0.3096 => 0.3588, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.71% (1.9694 => 2.2788, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.39% (1.9966 => 2.3038, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary2: 15.38% (0.3317 => 0.3827, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.23% (0.3362 => 0.3874, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 15.16% (0.2566 => 0.2955, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.13% (0.3060 => 0.3523, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 15.08% (0.3348 => 0.3853, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.93% (0.3282 => 0.3772, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.85% (0.3124 => 0.3588, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.81% (0.3465 => 0.3978, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 14.71% (0.4146 => 0.4756, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/exceptions-2: 14.71% (0.3446 => 0.3953, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-3: 14.71% (0.3460 => 0.3969, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.71% (0.3488 => 0.4001, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 14.70% (0.3496 => 0.4010, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.64% (0.3442 => 0.3946, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/synchronized: 14.62% (0.3469 => 0.3976, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 14.51% (0.0758 => 0.0868, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 14.51% (1.4269 => 1.6339, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sieve: 14.47% (0.3726 => 0.4265, std.dev.: 0.0082) SingleSource/UnitTests/ObjC/property: 14.36% (0.3650 => 0.4174, std.dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 14.28% (2.1653 => 2.4745, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.25% (0.3845 => 0.4393, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions: 14.22% (0.3643 => 0.4161, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 14.20% (0.7875 => 0.8993, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 14.11% (0.4251 => 0.4851, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/parameter-passing: 14.10% (0.3724 => 0.4249, std.dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 14.08% (0.2691 => 0.3070, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.07% (0.2040 => 0.2327, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.02% (0.3981 => 0.4539, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.01% (0.3690 => 0.4207, std.dev.: 0.0097) MultiSource/Applications/JM/lencod/lencod: 13.94% (4.6177 => 5.2615, std.dev.: 0.0157) MultiSource/Benchmarks/mafft/pairlocalalign: 13.61% (2.1013 => 2.3872, std.dev.: 0.0147) MultiSource/Applications/lambda-0_1_3/lambda: 12.75% (0.3498 => 0.3944, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.58% (0.1383 => 0.1557, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 12.19% (5.5417 => 6.2175, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.11% (0.6435 => 0.7214, std.dev.: 0.0150) MultiSource/Benchmarks/PAQ8p/paq8p: 11.72% (0.4847 => 0.5415, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.67% (0.1028 => 0.1148, std.dev.: 0.0039) MultiSource/Applications/siod/siod: 11.65% (0.6634 => 0.7407, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.41% (0.2068 => 0.2304, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.33% (0.2737 => 0.3047, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 11.15% (2.0346 => 2.2615, std.dev.: 0.0071) MultiSource/Applications/lemon/lemon: 11.04% (0.2391 => 0.2655, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.96% (0.3084 => 0.3422, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 10.94% (0.3336 => 0.3701, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.27% (0.2103 => 0.2319, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.61% (0.5361 => 0.5876, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.07% (4.6926 => 5.1184, std.dev.: 0.0355) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.99% (11.6398 => 12.6862, std.dev.: 0.0679) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.73% (0.7426 => 0.8074, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.67% (0.5584 => 0.6068, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 7.51% (11.9555 => 12.8530, std.dev.: 0.0122) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.14% (0.3792 => 0.3987, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 7.53% (0.2802 => 0.3013, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary: 6.64% (0.2122 => 0.2263, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6099, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.12% (0.3693 => 0.3882, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/objinst: 5.10% (12.0509 => 12.6659, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: 4.73% (15.4430 => 16.1738, std.dev.: 0.0274) SingleSource/Benchmarks/Misc/flops-2: 4.71% (1.8057 => 1.8908, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: 4.08% (14.0481 => 14.6212, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/ary3: 2.00% (15.8721 => 16.1893, std.dev.: 0.0101) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.72% (3.1722 => 3.2267, std.dev.: 0.0019) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3070, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2848, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5129, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5869, std.dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.50% (2.4764 => 2.4144, std.dev.: 0.0205) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -36.17% (25.4195 => 16.2258, std.dev.: 0.1631) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9773, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8072, std.dev.: 0.0927) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: -6.70% (0.2402 => 0.2241, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7961, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0035) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: -2.99% (17.2379 => 16.7228, std.dev.: 0.0916) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0114) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8585, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5751, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4964, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1716, std.dev.: 0.0898) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 02:07:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 04:07:17 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121121100717.26C1A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6103?compare_to=6099&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6103, Order: 168417, Start Time: 2012-11-21 08:36:23, End Time: 2012-11-21 10:07:42 To: 6099, Order: 168413, Start Time: 2012-11-21 06:05:29, End Time: 2012-11-21 07:35:51 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 3 (82 on baseline) Performance Improvements: 7 (24 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1044 (868 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.63% (1.0244 => 1.0513, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.84% (0.8645 => 0.8804, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.10% (1.6047 => 1.6223, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -9.26% (0.1177 => 0.1068, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.06% (0.9021 => 0.8745, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.81% (4.3796 => 4.2565, std.dev.: 0.0204) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.59% (6.8652 => 6.7559, std.dev.: 0.0342) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.46% (1.6907 => 1.6660, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.14% (4.6282 => 4.5756, std.dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel24: -46.22% (0.5422 => 0.2916, std.dev.: 0.0470) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.71% (1.0610 => 1.0535, std.dev.: 0.0105) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 30.00% (0.0170 => 0.0221, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.47% (0.0429 => 0.0427, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 2.52% (0.0317 => 0.0325, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0313 => 0.0313, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.20% (0.0384 => 0.0427, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/casts: 36.00% (0.0150 => 0.0204, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/test1: -36.57% (0.0216 => 0.0137, std.dev.: 0.0049) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -0.47% (0.1487 => 0.1480, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -1.83% (1.1539 => 1.1328, std.dev.: 0.1190) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.41% (0.4141 => 0.4158, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.28% (0.1405 => 0.1409, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.02% (0.0595 => 0.0583, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -23.97% (0.0242 => 0.0184, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.14% (0.0562 => 0.0574, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.04% (1.1968 => 1.1844, std.dev.: 0.0648) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -94.12% (0.0017 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.89% (0.0644 => 0.0561, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.17% (0.0237 => 0.0220, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.20% (0.7821 => 0.7805, std.dev.: 0.0334) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -18.00% (0.0050 => 0.0041, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 6.87% (16.4461 => 17.5760, std.dev.: 0.0740) MultiSource/Applications/sqlite3/sqlite3: 2321.68% (0.6332 => 15.3341, std.dev.: 0.3076) MultiSource/Benchmarks/McCat/08-main/main: 43.42% (0.1831 => 0.2626, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.99% (0.1559 => 0.1450, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7122.38% (0.3123 => 22.5555, std.dev.: 0.1668) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.60% (0.2463 => 0.3734, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1529.49% (0.3344 => 5.4490, std.dev.: 0.2646) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.24% (0.2364 => 0.3268, std.dev.: 0.0201) SingleSource/Benchmarks/Misc-C++/bigfib: 4.83% (0.6010 => 0.6300, std.dev.: 0.0317) SingleSource/Benchmarks/Misc/mandel: 3.73% (0.0429 => 0.0445, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.73% (0.3266 => 0.3453, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/strcat: 3.86% (0.1969 => 0.2045, std.dev.: 0.0088) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.14% (0.0224 => 0.0240, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -28.26% (0.0230 => 0.0165, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0512, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 11.63% (0.1462 => 0.1632, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4657, std.dev.: 0.0492) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0713, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4869, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5120, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5099, std.dev.: 0.1460) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3121, std.dev.: 0.0421) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1257, std.dev.: 0.0188) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3668, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4103, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0857, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: -23.58% (2.1832 => 1.6685, std.dev.: 0.0225) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.70% (0.0810 => 0.0921, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.44% (0.0848 => 0.0962, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 11.96% (0.1112 => 0.1245, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.89% (0.2180 => 0.2352, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.10% (0.8321 => 0.8745, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2998 => 0.3129, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.91% (0.3657 => 0.3800, std.dev.: 0.0034) MultiSource/Applications/hbd/hbd: 3.78% (1.4269 => 1.4808, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.10% (0.3295 => 0.3397, std.dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 3.01% (1.1271 => 1.1610, std.dev.: 0.0044) MultiSource/Applications/ClamAV/clamscan: 2.81% (14.7684 => 15.1834, std.dev.: 0.0715) MultiSource/Applications/minisat/minisat: 2.77% (0.6834 => 0.7023, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.63% (1.2526 => 1.2856, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.40% (0.8007 => 0.8199, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.33% (13.1811 => 13.4883, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.33% (0.8457 => 0.8654, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.25% (6.6074 => 6.7559, std.dev.: 0.0342) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.19% (0.9074 => 0.9273, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.19% (0.9056 => 0.9254, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.18% (0.9039 => 0.9236, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.18% (0.8597 => 0.8784, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.15% (0.8050 => 0.8223, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.13% (0.8316 => 0.8493, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: 2.11% (2.3764 => 2.4265, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.05% (0.7932 => 0.8095, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.99% (0.5817 => 0.5933, std.dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: 1.97% (31.8598 => 32.4870, std.dev.: 0.1748) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.97% (4.4873 => 4.5756, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.96% (0.8286 => 0.8448, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (0.9908 => 1.0101, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.95% (0.8317 => 0.8479, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.94% (0.8805 => 0.8976, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.92% (4.1763 => 4.2565, std.dev.: 0.0204) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.85% (0.8855 => 0.9019, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.83% (0.8069 => 0.8217, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.81% (0.8177 => 0.8325, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.80% (0.8204 => 0.8352, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.78% (0.8359 => 0.8508, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.78% (0.8716 => 0.8871, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.70% (8.6247 => 8.7717, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.68% (0.8712 => 0.8858, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.67% (1.6386 => 1.6660, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.64% (0.8066 => 0.8198, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.60% (0.8420 => 0.8555, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.59% (0.7966 => 0.8093, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.57% (0.8656 => 0.8792, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.45% (0.8048 => 0.8165, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.08% (4.5702 => 4.6194, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.03% (1.2423 => 1.2551, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 100.50% (0.0199 => 0.0399, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/pi: 58.36% (1.5795 => 2.5013, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 18.23% (0.7597 => 0.8982, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.34% (2.9753 => 3.4615, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.70% (2.7995 => 3.2110, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.41% (5.0261 => 5.5995, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.51% (0.3186 => 0.3489, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.06% (1.1857 => 1.2813, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/queens: 7.53% (1.7056 => 1.8340, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/richards_benchmark: 7.25% (1.3037 => 1.3982, std.dev.: 0.0286) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.72% (4.7794 => 5.1008, std.dev.: 0.0180) MultiSource/Applications/SIBsim4/SIBsim4: 6.18% (3.1873 => 3.3844, std.dev.: 0.0389) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.91% (4.9686 => 5.2620, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.90% (4.5327 => 4.8003, std.dev.: 0.0228) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.74% (6.2275 => 6.5229, std.dev.: 0.0201) MultiSource/Applications/lambda-0_1_3/lambda: 4.67% (7.4933 => 7.8431, std.dev.: 0.0335) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.44% (3.3761 => 3.5260, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.11% (4.9453 => 5.1484, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.02% (4.9469 => 5.1456, std.dev.: 0.0540) MultiSource/Applications/hexxagon/hexxagon: 3.92% (14.0064 => 14.5548, std.dev.: 0.0041) MultiSource/Applications/siod/siod: 3.24% (3.6643 => 3.7832, std.dev.: 0.0292) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.75% (11.5690 => 11.8875, std.dev.: 0.0098) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.70% (1.2337 => 1.2670, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.69% (8.2783 => 8.5007, std.dev.: 0.0218) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.31% (4.8660 => 4.9785, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout/lists: 2.29% (7.3375 => 7.5053, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.24% (1.1365 => 1.1620, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.77% (1.5941 => 1.6223, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: 1.56% (8.5322 => 8.6654, std.dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.31% (3.5679 => 3.6148, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: 1.17% (1.2061 => 1.2202, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/neural/neural: 1.05% (1.0841 => 1.0955, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.02% (2.5763 => 2.6027, std.dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.25% (5.4641 => 4.3032, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.24% (7.2130 => 6.1858, std.dev.: 0.1280) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.84% (1.0512 => 0.9372, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: -10.65% (1.1216 => 1.0022, std.dev.: 0.0370) MultiSource/Benchmarks/mafft/pairlocalalign: -8.53% (63.1822 => 57.7921, std.dev.: 0.1785) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.35% (14.6451 => 13.4216, std.dev.: 0.2522) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.95% (0.3269 => 0.3009, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.84% (4.7482 => 4.4234, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.93% (3.7148 => 3.4945, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.88% (5.4972 => 5.1740, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.10% (5.1557 => 4.8927, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.80% (6.0224 => 5.7935, std.dev.: 0.0145) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.48% (2.8773 => 2.7772, std.dev.: 0.0067) MultiSource/Applications/lua/lua: -3.10% (29.8330 => 28.9085, std.dev.: 0.0481) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.02% (28.5821 => 27.7192, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.94% (0.5807 => 0.5636, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: -2.50% (0.6636 => 0.6470, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.43% (2.6356 => 2.5715, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.22% (9.9065 => 9.6867, std.dev.: 0.0738) SingleSource/Benchmarks/Shootout-C++/hash2: -2.10% (3.4237 => 3.3519, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.98% (11.5316 => 11.3036, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/mason/mason: -1.88% (0.5415 => 0.5313, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.30% (2.3487 => 2.3182, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.13% (5.6343 => 5.5709, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.66% (1.0262 => 1.0535, std.dev.: 0.0105) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 79.67% (0.0123 => 0.0221, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 27.95% (0.0254 => 0.0325, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.20% (0.0384 => 0.0427, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/test1: -23.89% (0.0180 => 0.0137, std.dev.: 0.0049) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 2.92% (0.1438 => 0.1480, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -0.01% (1.1329 => 1.1328, std.dev.: 0.1190) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.14% (0.4164 => 0.4158, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.92% (0.1369 => 0.1409, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.05% (0.0641 => 0.0583, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.64% (0.0195 => 0.0184, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.69% (0.0578 => 0.0574, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.56% (1.1437 => 1.1844, std.dev.: 0.0648) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.53% (0.0627 => 0.0561, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.22% (0.0180 => 0.0220, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.64% (0.8017 => 0.7805, std.dev.: 0.0334) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -33.87% (0.0062 => 0.0041, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 02:12:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 04:12:03 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121121101203.0DF512A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6104?compare_to=6100&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6104, Order: 168417, Start Time: 2012-11-21 08:38:55, End Time: 2012-11-21 10:12:28 To: 6100, Order: 168413, Start Time: 2012-11-21 06:08:21, End Time: 2012-11-21 07:41:51 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (177 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (861 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.78% (2.0478 => 2.1048, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.4937 => 7.6782, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/hash2: 2.19% (3.1932 => 3.2632, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.98% (0.3821 => 0.3516, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: -7.10% (0.3831 => 0.3559, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -7.09% (0.3880 => 0.3605, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -7.06% (0.3896 => 0.3621, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -7.06% (0.3812 => 0.3543, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.95% (0.3884 => 0.3614, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: -6.94% (0.4033 => 0.3753, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.89% (0.3891 => 0.3623, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.89% (0.3848 => 0.3583, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.84% (0.9542 => 0.8889, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.81% (0.3142 => 0.2928, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -6.80% (0.4176 => 0.3892, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.64% (0.3357 => 0.3134, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: -6.60% (2.4924 => 2.3278, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: -6.45% (0.4199 => 0.3928, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -6.25% (0.2160 => 0.2025, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.22% (0.2428 => 0.2277, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: -6.21% (0.4280 => 0.4014, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.16% (9.2283 => 8.6594, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.11% (0.7198 => 0.6758, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: -6.08% (16.1920 => 15.2083, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.01% (0.1796 => 0.1688, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: -6.00% (7.0961 => 6.6704, std.dev.: 0.0083) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.99% (0.9852 => 0.9262, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.94% (0.6484 => 0.6099, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.90% (3.5339 => 3.3253, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.87% (6.7716 => 6.3744, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.86% (0.2355 => 0.2217, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/ReedSolomon: -5.85% (0.1879 => 0.1769, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.81% (1.0544 => 0.9931, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.80% (1.3722 => 1.2926, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: -5.78% (0.9179 => 0.8648, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.74% (0.3658 => 0.3448, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -5.74% (0.1761 => 0.1660, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.68% (0.5863 => 0.5530, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.67% (4.0323 => 3.8037, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.62% (4.8802 => 4.6059, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.61% (4.8161 => 4.5457, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.60% (0.5478 => 0.5171, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.58% (0.3406 => 0.3216, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.54% (0.5591 => 0.5281, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.54% (1.4642 => 1.3831, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -5.54% (1.1450 => 1.0816, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -5.53% (1.1530 => 1.0892, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.53% (0.2695 => 0.2546, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.52% (0.6230 => 0.5886, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.52% (1.6364 => 1.5461, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.49% (0.5705 => 0.5392, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.47% (0.6667 => 0.6302, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.47% (0.5925 => 0.5601, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.46% (1.2300 => 1.1628, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.46% (0.5859 => 0.5539, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.45% (0.6052 => 0.5722, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: -5.45% (0.3194 => 0.3020, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.45% (0.3837 => 0.3628, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.45% (0.5857 => 0.5538, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.44% (0.4151 => 0.3925, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.43% (0.6297 => 0.5955, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.42% (0.6194 => 0.5858, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.42% (0.3931 => 0.3718, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.42% (0.7919 => 0.7490, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: -5.40% (0.4515 => 0.4271, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.40% (0.6293 => 0.5953, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: -5.40% (0.2871 => 0.2716, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.38% (4.5069 => 4.2643, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.38% (0.5575 => 0.5275, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.38% (0.6304 => 0.5965, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.37% (0.3016 => 0.2854, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.37% (0.6446 => 0.6100, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.36% (0.3057 => 0.2893, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.36% (0.5581 => 0.5282, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -5.36% (0.3025 => 0.2863, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.35% (0.2933 => 0.2776, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -5.35% (0.3255 => 0.3081, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.34% (0.5802 => 0.5492, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.34% (0.6260 => 0.5926, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.33% (1.2784 => 1.2102, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.33% (0.5849 => 0.5537, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -5.32% (1.3148 => 1.2448, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.32% (0.4813 => 0.4557, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.31% (0.5805 => 0.5497, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.30% (0.5941 => 0.5626, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -5.30% (4.3330 => 4.1035, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/bh/bh: -5.29% (0.2985 => 0.2827, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: -5.29% (1.2515 => 1.1853, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/except: -5.29% (0.3026 => 0.2866, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -5.29% (0.2989 => 0.2831, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.29% (0.6660 => 0.6308, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.28% (0.6189 => 0.5862, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -5.28% (0.3446 => 0.3264, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.27% (2.1713 => 2.0568, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: -5.25% (17.1032 => 16.2052, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.25% (14.2083 => 13.4624, std.dev.: 0.0278) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.24% (0.5570 => 0.5278, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.24% (0.2903 => 0.2751, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -5.23% (0.2849 => 0.2700, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -5.22% (0.3394 => 0.3217, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: -5.21% (1.3864 => 1.3141, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.20% (0.2999 => 0.2843, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: -5.18% (0.7779 => 0.7376, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/random: -5.17% (0.2939 => 0.2787, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.16% (0.6681 => 0.6336, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.15% (0.5456 => 0.5175, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: -5.13% (15.5079 => 14.7122, std.dev.: 0.0138) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.12% (1.2210 => 1.1585, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: -5.12% (0.3205 => 0.3041, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.11% (0.6676 => 0.6335, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.10% (0.2548 => 0.2418, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.10% (8.0126 => 7.6038, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.10% (0.5688 => 0.5398, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.09% (0.6440 => 0.6112, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.08% (1.2221 => 1.1600, std.dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: -5.07% (0.3059 => 0.2904, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.05% (0.3483 => 0.3307, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.04% (0.6033 => 0.5729, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.00% (0.6736 => 0.6399, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: -4.99% (3.5154 => 3.3399, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.99% (0.8521 => 0.8096, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.98% (0.4916 => 0.4671, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.94% (1.6474 => 1.5660, std.dev.: 0.0179) MultiSource/Applications/lua/lua: -4.93% (4.0594 => 3.8591, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/lists1: -4.86% (0.3867 => 0.3679, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.85% (22.4056 => 21.3184, std.dev.: 0.0155) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.85% (0.3319 => 0.3158, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.85% (0.4083 => 0.3885, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: -4.83% (0.4861 => 0.4626, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.83% (0.3252 => 0.3095, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -4.82% (0.7447 => 0.7088, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.81% (0.7021 => 0.6683, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -4.80% (0.4248 => 0.4044, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -4.80% (0.3481 => 0.3314, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: -4.80% (0.4524 => 0.4307, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: -4.75% (0.3581 => 0.3411, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: -4.74% (0.2659 => 0.2533, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.73% (0.3849 => 0.3667, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.73% (0.7339 => 0.6992, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.72% (0.6395 => 0.6093, std.dev.: 0.0049) MultiSource/Applications/ClamAV/clamscan: -4.71% (15.2527 => 14.5336, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.70% (0.7524 => 0.7170, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -4.68% (0.6347 => 0.6050, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -4.64% (0.6441 => 0.6142, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -4.64% (2.4021 => 2.2906, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.59% (0.4427 => 0.4224, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -4.56% (0.7982 => 0.7618, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.55% (0.9557 => 0.9122, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (0.5329 => 0.5087, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.48% (0.5999 => 0.5730, std.dev.: 0.0021) MultiSource/Applications/treecc/treecc: -4.46% (2.1401 => 2.0447, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.45% (0.5567 => 0.5319, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.44% (0.5569 => 0.5322, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.39% (0.3323 => 0.3177, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.35% (0.6395 => 0.6117, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -4.33% (5.0226 => 4.8053, std.dev.: 0.0116) MultiSource/Benchmarks/McCat/09-vor/vor: -4.31% (0.3271 => 0.3130, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: -4.30% (0.3788 => 0.3625, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.24% (2.2587 => 2.1630, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.21% (0.3491 => 0.3344, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.21% (0.9077 => 0.8695, std.dev.: 0.0046) MultiSource/Applications/kimwitu++/kc: -4.20% (18.2933 => 17.5241, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/bigfib: -4.13% (0.6750 => 0.6471, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -4.12% (0.8418 => 0.8071, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -4.08% (34.0927 => 32.7031, std.dev.: 0.0291) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.98% (0.4321 => 0.4149, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.64% (5.4682 => 5.2694, std.dev.: 0.0050) MultiSource/Applications/hbd/hbd: -3.26% (1.5610 => 1.5101, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -2.96% (20.7746 => 20.1597, std.dev.: 0.0328) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7557, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1723, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.96% (2.2633 => 2.1737, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.28% (1.3096 => 1.2666, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.95% (1.0557 => 1.0246, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4698, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 03:20:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 05:20:05 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121121112005.BA69D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6105?compare_to=6101&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6105, Order: 168413, Start Time: 2012-11-21 09:00:35, End Time: 2012-11-21 11:20:30 To: 6101, Order: 168411, Start Time: 2012-11-21 05:40:37, End Time: 2012-11-21 08:01:14 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 52 (137 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1035 (710 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.90% (0.9009 => 1.0171, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 12.46% (0.6229 => 0.7005, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/power/power: 12.28% (0.1458 => 0.1637, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.91% (0.3216 => 0.3599, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/bigfib: 11.76% (0.7255 => 0.8108, std.dev.: 0.0141) SingleSource/Benchmarks/LivermoreLoops/kernel06: 11.55% (0.1048 => 0.1169, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.50% (0.2896 => 0.3229, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.41% (0.4312 => 0.4804, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sieve: 11.39% (0.3976 => 0.4429, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/lists1: 11.27% (0.4056 => 0.4513, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.16% (0.5807 => 0.6455, std.dev.: 0.0150) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.88% (0.1176 => 0.1304, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/mst/mst: 10.36% (0.1352 => 0.1492, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.28% (0.1411 => 0.1556, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.14% (0.3167 => 0.3488, std.dev.: 0.0022) SingleSource/Benchmarks/LivermoreLoops/kernel07: 10.11% (0.1048 => 0.1154, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.01% (0.6683 => 0.7352, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.57% (4.3711 => 4.7895, std.dev.: 0.0855) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.36% (0.6861 => 0.7503, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.06% (0.5895 => 0.6429, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.05% (0.6322 => 0.6894, std.dev.: 0.0171) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.03% (0.2579 => 0.2812, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.99% (0.6595 => 0.7188, std.dev.: 0.0222) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.97% (0.2420 => 0.2637, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.71% (0.6695 => 0.7278, std.dev.: 0.0212) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.55% (0.2200 => 0.2388, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.24% (2.3252 => 2.5168, std.dev.: 0.0357) MultiSource/Benchmarks/nbench/nbench: 7.94% (1.3302 => 1.4358, std.dev.: 0.0261) SingleSource/Benchmarks/Shootout-C++/fibo: 7.79% (0.3070 => 0.3309, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.48% (1.5904 => 1.7093, std.dev.: 0.0277) SingleSource/UnitTests/ObjC++/property-reference: 7.28% (0.8094 => 0.8683, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.26% (0.4670 => 0.5009, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/wc: 7.19% (0.3309 => 0.3547, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/strcat: 7.14% (0.3095 => 0.3316, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.08% (0.3149 => 0.3372, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.97% (2.2555 => 2.4128, std.dev.: 0.0600) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.96% (1.3172 => 1.4089, std.dev.: 0.0290) MultiSource/Benchmarks/FreeBench/neural/neural: 6.55% (0.1604 => 0.1709, std.dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: 4.98% (53.6044 => 56.2759, std.dev.: 0.4884) SingleSource/UnitTests/ObjC++/Hello: 4.02% (0.6789 => 0.7062, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference-object: 3.35% (0.6935 => 0.7167, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.96% (10.8077 => 11.1272, std.dev.: 0.0892) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 14.30% (0.1315 => 0.1503, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 8.27% (2.8850 => 3.1237, std.dev.: 0.0455) MultiSource/Benchmarks/Olden/bisort/bisort: 7.83% (0.9359 => 1.0092, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.39% (6.0228 => 6.4680, std.dev.: 0.0452) SingleSource/Benchmarks/Misc/ffbench: 7.19% (0.9935 => 1.0649, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/neural/neural: 4.66% (0.2234 => 0.2338, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.03% (0.3327 => 0.3461, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.56% (1.5480 => 1.6031, std.dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/huffbench: 2.15% (18.8375 => 19.2428, std.dev.: 0.1138) SingleSource/Benchmarks/Dhrystone/fldry: 1.52% (1.9457 => 1.9753, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/ReedSolomon: -9.63% (0.2429 => 0.2195, std.dev.: 0.0068) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.22% (0.1357 => 0.1354, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.48% (0.0421 => 0.0419, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.30% (0.0652 => 0.0667, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 0.09% (493.6537 => 494.1007, std.dev.: 0.2221) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0419, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/power/power: 43714.91% (1.1277 => 494.1007, std.dev.: 0.2221) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 203.08% (0.5229 => 1.5848, std.dev.: 0.0742) MultiSource/Applications/SPASS/SPASS: 21.58% (14.9895 => 18.2242, std.dev.: 0.2138) MultiSource/Applications/kimwitu++/kc: 49.45% (14.1553 => 21.1550, std.dev.: 0.5022) MultiSource/Benchmarks/MallocBench/gs/gs: 15.27% (4.1105 => 4.7382, std.dev.: 0.2697) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.98% (1.1048 => 1.5134, std.dev.: 0.0754) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 429.27% (7.1582 => 37.8860, std.dev.: 0.5251) SingleSource/Benchmarks/Misc-C++-EH/spirit: 74.90% (3.4629 => 6.0565, std.dev.: 0.4780) SingleSource/Benchmarks/Misc-C++/stepanov_container: 71.33% (0.6222 => 1.0660, std.dev.: 0.0490) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10542.78% (0.0720 => 7.6628, std.dev.: 0.3083) MultiSource/Applications/SIBsim4/SIBsim4: 3860100.00% (0.0001 => 3.8602, std.dev.: 0.0424) MultiSource/Applications/SPASS/SPASS: 13001000.00% (0.0001 => 13.0011, std.dev.: 1.0233) MultiSource/Applications/kimwitu++/kc: 52000.00% (0.0001 => 0.0521, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 63800.00% (0.0001 => 0.0639, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576000.00% (0.0001 => 0.5761, std.dev.: 0.0250) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10091400.00% (0.0001 => 10.0915, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5682400.00% (0.0001 => 5.6825, std.dev.: 0.9024) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1799.20% (1.1194 => 21.2596, std.dev.: 0.5425) MultiSource/Applications/ClamAV/clamscan: 67.78% (22.1758 => 37.2061, std.dev.: 0.6190) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 62.17% (2.9384 => 4.7651, std.dev.: 0.3015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.74% (7.0540 => 11.1272, std.dev.: 0.0892) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.73% (8.1363 => 12.2636, std.dev.: 0.2297) MultiSource/Applications/JM/lencod/lencod: 46.69% (21.9371 => 32.1802, std.dev.: 0.3250) MultiSource/Benchmarks/FreeBench/distray/distray: 45.45% (0.1056 => 0.1536, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/flops: 38.62% (0.1432 => 0.1985, std.dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/almabench: 38.36% (0.0730 => 0.1010, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 33.44% (0.0326 => 0.0435, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 33.30% (0.2700 => 0.3599, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.53% (0.0416 => 0.0543, std.dev.: 0.0017) SingleSource/UnitTests/vla: 29.58% (0.0355 => 0.0460, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/mst/mst: 28.29% (0.1163 => 0.1492, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 26.47% (0.2758 => 0.3488, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 26.36% (0.1032 => 0.1304, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 26.08% (0.8067 => 1.0171, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 25.89% (0.1236 => 0.1556, std.dev.: 0.0053) SingleSource/Benchmarks/Dhrystone/dry: 25.66% (0.0456 => 0.0573, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 25.59% (0.6456 => 0.8108, std.dev.: 0.0141) SingleSource/Benchmarks/Stanford/Oscar: 25.47% (0.0636 => 0.0798, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 25.46% (0.5860 => 0.7352, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/health/health: 25.39% (0.1268 => 0.1590, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 25.15% (0.2107 => 0.2637, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/reversefile: 24.29% (0.3865 => 0.4804, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.26% (0.0746 => 0.0927, std.dev.: 0.0040) MultiSource/Applications/viterbi/viterbi: 24.24% (0.1555 => 0.1932, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 24.05% (0.2603 => 0.3229, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.82% (0.2271 => 0.2812, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.81% (0.1940 => 0.2402, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 23.05% (3.8922 => 4.7895, std.dev.: 0.0855) SingleSource/Benchmarks/Shootout-C++/sieve: 22.93% (0.3603 => 0.4429, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/lists1: 22.50% (0.3684 => 0.4513, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout/hash: 22.47% (0.0485 => 0.0594, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 22.44% (0.2554 => 0.3127, std.dev.: 0.0117) MultiSource/Benchmarks/NPB-serial/is/is: 21.84% (0.0719 => 0.0876, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/fldry: 21.83% (0.0481 => 0.0586, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.58% (0.1566 => 0.1904, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/fibo: 21.43% (0.2725 => 0.3309, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.29% (0.9765 => 1.1844, std.dev.: 0.0251) MultiSource/Benchmarks/nbench/nbench: 21.27% (1.1840 => 1.4358, std.dev.: 0.0261) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.17% (0.0770 => 0.0933, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.05% (0.3121 => 0.3778, std.dev.: 0.0178) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.81% (0.0793 => 0.0958, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.71% (0.1584 => 0.1912, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/tsp/tsp: 20.60% (0.1175 => 0.1417, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 20.12% (14.3668 => 17.2571, std.dev.: 0.3596) MultiSource/Applications/oggenc/oggenc: 19.77% (5.7591 => 6.8975, std.dev.: 0.2230) MultiSource/Applications/d/make_dparser: 19.74% (3.3354 => 3.9939, std.dev.: 0.1444) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.22% (0.4615 => 0.5502, std.dev.: 0.0138) SingleSource/UnitTests/ObjC++/Hello: 19.19% (0.5925 => 0.7062, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.18% (0.4203 => 0.5009, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 19.08% (1.5415 => 1.8356, std.dev.: 0.0538) SingleSource/UnitTests/ObjC++/property-reference-object: 18.86% (0.6030 => 0.7167, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.78% (1.1861 => 1.4089, std.dev.: 0.0290) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.58% (0.1125 => 0.1334, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 18.55% (0.8101 => 0.9604, std.dev.: 0.0152) SingleSource/UnitTests/ObjC++/property-reference: 18.52% (0.7326 => 0.8683, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/whetstone: 18.03% (0.0660 => 0.0779, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.81% (0.0842 => 0.0992, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 17.42% (0.0838 => 0.0984, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 17.37% (9.4845 => 11.1323, std.dev.: 0.2590) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.15% (0.3307 => 0.3874, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.14% (0.3162 => 0.3704, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/strcat: 17.13% (0.2831 => 0.3316, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/bisort/bisort: 17.10% (0.0614 => 0.0719, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.00% (0.8172 => 0.9561, std.dev.: 0.0469) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.91% (0.0834 => 0.0975, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: 16.81% (0.1463 => 0.1709, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.76% (2.0665 => 2.4128, std.dev.: 0.0600) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.64% (0.2891 => 0.3372, std.dev.: 0.0086) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.59% (0.0675 => 0.0787, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/trivial-interface: 16.59% (0.3473 => 0.4049, std.dev.: 0.0145) MultiSource/Applications/treecc/treecc: 16.36% (2.0273 => 2.3590, std.dev.: 0.0821) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.36% (0.0648 => 0.0754, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.27% (0.2065 => 0.2401, std.dev.: 0.0097) SingleSource/UnitTests/SignlessTypes/rem: 16.26% (0.1144 => 0.1330, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wc: 16.22% (0.3052 => 0.3547, std.dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 16.16% (0.1906 => 0.2214, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.91% (0.0886 => 0.1027, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/matrix: 15.89% (0.0818 => 0.0948, std.dev.: 0.0040) MultiSource/Applications/Burg/burg: 15.84% (1.1642 => 1.3486, std.dev.: 0.0661) MultiSource/Applications/hbd/hbd: 15.77% (1.5603 => 1.8063, std.dev.: 0.0462) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.72% (4.9449 => 5.7223, std.dev.: 0.2132) SingleSource/Benchmarks/Misc/oourafft: 15.54% (0.3282 => 0.3792, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.19% (0.0770 => 0.0887, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.13% (0.1117 => 0.1286, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 14.44% (17.1811 => 19.6627, std.dev.: 0.5615) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.30% (0.5981 => 0.6836, std.dev.: 0.0285) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.29% (2.2022 => 2.5168, std.dev.: 0.0357) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.03% (0.1062 => 0.1211, std.dev.: 0.0054) MultiSource/Benchmarks/Bullet/bullet: 13.93% (63.2438 => 72.0518, std.dev.: 0.5515) MultiSource/Benchmarks/Olden/power/power: 13.68% (0.1440 => 0.1637, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 13.57% (0.3109 => 0.3531, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.16% (0.0798 => 0.0903, std.dev.: 0.0025) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.12% (0.1143 => 0.1293, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.02% (4.2646 => 4.8199, std.dev.: 0.1990) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.87% (0.3543 => 0.3999, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.84% (1.3050 => 1.4725, std.dev.: 0.0433) MultiSource/Benchmarks/FreeBench/mason/mason: 12.82% (0.0811 => 0.0915, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-4: 12.73% (0.3543 => 0.3994, std.dev.: 0.0172) MultiSource/Benchmarks/McCat/05-eks/eks: 11.35% (0.4299 => 0.4787, std.dev.: 0.0069) MultiSource/Benchmarks/PAQ8p/paq8p: 10.70% (10.3673 => 11.4763, std.dev.: 0.3492) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.38% (0.2266 => 0.2388, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: 3.90% (54.1659 => 56.2759, std.dev.: 0.4884) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.92% (4.3953 => 11.0286, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: 147.44% (5.3999 => 13.3616, std.dev.: 0.0051) MultiSource/Applications/minisat/minisat: 30.57% (9.1159 => 11.9024, std.dev.: 0.4540) MultiSource/Benchmarks/Olden/bisort/bisort: 21.11% (0.8333 => 1.0092, std.dev.: 0.0165) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.77% (1.1145 => 1.3125, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.56% (0.2944 => 0.3461, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 17.45% (6.6465 => 7.8063, std.dev.: 0.0124) MultiSource/Benchmarks/Olden/mst/mst: 16.96% (0.1285 => 0.1503, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/ffbench: 12.04% (0.9505 => 1.0649, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.64% (2.8904 => 3.2268, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 10.15% (1.1396 => 1.2553, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.23% (1.7254 => 1.8846, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.48% (4.2280 => 4.4598, std.dev.: 0.0128) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 4.70% (0.2233 => 0.2338, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 4.47% (26.0924 => 27.2599, std.dev.: 0.1475) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6436 => 12.1155, std.dev.: 0.0130) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 2.21% (85.0658 => 86.9443, std.dev.: 0.0289) SingleSource/Benchmarks/Dhrystone/dry: 2.18% (2.4116 => 2.4642, std.dev.: 0.0147) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 2.06% (3.1595 => 3.2246, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.83% (2.1424 => 2.1815, std.dev.: 0.0137) MultiSource/Benchmarks/mafft/pairlocalalign: 1.60% (27.8444 => 28.2913, std.dev.: 0.0189) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.40% (6.5088 => 6.5999, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: 1.19% (5.9798 => 6.0508, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 1.18% (2.4858 => 2.5152, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout/sieve: 1.08% (5.2139 => 5.2703, std.dev.: 0.0091) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1682, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.77% (5.2763 => 1.2255, std.dev.: 0.0514) SingleSource/Benchmarks/Misc/salsa20: -75.44% (0.8651 => 0.2125, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: -45.07% (0.1622 => 0.0891, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.53% (5.3855 => 4.7107, std.dev.: 0.1327) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -12.03% (0.1330 => 0.1170, std.dev.: 0.0060) MultiSource/Applications/JM/ldecod/ldecod: -11.10% (10.4361 => 9.2778, std.dev.: 0.4382) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.63% (5.3526 => 4.8372, std.dev.: 0.0920) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.52% (0.0628 => 0.0361, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.21% (0.3987 => 0.2384, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.28% (4.5009 => 2.7778, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: -33.54% (1.1492 => 0.7638, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -28.98% (10.7105 => 7.6070, std.dev.: 0.6932) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.16% (2.6546 => 2.0132, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -19.25% (0.2161 => 0.1745, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4221, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2841, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.65% (32.5116 => 29.0487, std.dev.: 0.0134) MultiSource/Benchmarks/NPB-serial/is/is: -10.44% (9.5636 => 8.5653, std.dev.: 0.2566) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.05% (1.5660 => 1.4243, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4788, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.69% (3.2416 => 3.0246, std.dev.: 0.0282) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5759, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.94% (1.5835 => 1.5052, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.61% (1.6805 => 1.6031, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout/lists: -4.35% (6.2999 => 6.0257, std.dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.54% (19.9488 => 19.2428, std.dev.: 0.1138) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8920, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.95% (0.9957 => 0.9663, std.dev.: 0.0059) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.35% (0.4808 => 0.4695, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.74% (8.1563 => 8.0144, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/salsa20: -1.49% (10.2830 => 10.1300, std.dev.: 0.0038) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.82% (0.1485 => 0.1354, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.48% (0.2116 => 0.0667, std.dev.: 0.0006) Report Time: 2.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 03:55:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 05:55:20 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121121115520.17FA32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6106?compare_to=6103&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6106, Order: 168418, Start Time: 2012-11-21 10:24:34, End Time: 2012-11-21 11:55:46 To: 6103, Order: 168417, Start Time: 2012-11-21 08:36:23, End Time: 2012-11-21 10:07:42 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 19 (76 on baseline) Performance Improvements: 2 (21 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1033 (877 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.18% (0.5913 => 0.6219, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.97% (0.4906 => 0.5150, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.38% (0.6274 => 0.6549, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.22% (0.6047 => 0.6302, std.dev.: 0.0095) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.14% (0.3211 => 0.3344, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.68% (0.3397 => 0.3522, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.25% (0.9494 => 0.9803, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.72% (1.6660 => 1.7113, std.dev.: 0.0168) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.42% (4.5756 => 4.6865, std.dev.: 0.0213) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.00% (1.4725 => 1.5019, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.98% (0.8792 => 0.8966, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.43% (0.9247 => 0.9379, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.41% (0.9273 => 0.9404, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.38% (0.8508 => 0.8625, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.37% (0.8479 => 0.8595, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.35% (0.9087 => 0.9210, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: 4.84% (0.6470 => 0.6783, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.38% (2.7772 => 2.8432, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.24% (21.9206 => 22.4127, std.dev.: 0.0346) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -5.85% (61.0794 => 57.5073, std.dev.: 1.0020) MultiSource/Benchmarks/Prolangs-C++/primes/primes: -1.21% (0.8982 => 0.8873, std.dev.: 0.0029) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.74% (1.0535 => 1.0613, std.dev.: 0.1469) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -38.01% (0.0221 => 0.0137, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0427 => 0.0426, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -21.85% (0.0325 => 0.0254, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.51% (0.0313 => 0.0302, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -17.80% (0.0427 => 0.0351, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/casts: -8.82% (0.0204 => 0.0186, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: 59.12% (0.0137 => 0.0218, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.88% (0.1480 => 0.1493, std.dev.: 0.0156) MultiSource/Applications/lemon/lemon: 3.12% (1.1328 => 1.1681, std.dev.: 0.3434) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.04% (0.4158 => 0.4243, std.dev.: 0.0427) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.42% (0.1409 => 0.1429, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.63% (0.0583 => 0.0610, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 20.11% (0.0184 => 0.0221, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.97% (0.0574 => 0.0614, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.38% (1.1844 => 1.2008, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.18% (0.0561 => 0.0560, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.18% (0.0220 => 0.0180, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.38% (0.7805 => 0.7775, std.dev.: 0.0056) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 51.22% (0.0041 => 0.0062, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.40% (16.4461 => 17.6631, std.dev.: 0.3274) MultiSource/Applications/sqlite3/sqlite3: 2366.06% (0.6332 => 15.6151, std.dev.: 0.5588) MultiSource/Benchmarks/McCat/08-main/main: 46.59% (0.1831 => 0.2684, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.75% (0.1559 => 0.1485, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7030.13% (0.3123 => 22.2674, std.dev.: 0.1826) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.67% (0.2463 => 0.3711, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1537.80% (0.3344 => 5.4768, std.dev.: 0.0246) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.49% (0.2364 => 0.3274, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 6.34% (0.6010 => 0.6391, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: 2.56% (0.0429 => 0.0440, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.11% (0.3266 => 0.3433, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 4.22% (0.1969 => 0.2052, std.dev.: 0.0021) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.70% (0.0224 => 0.0239, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -26.09% (0.0230 => 0.0170, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0479, std.dev.: 0.0026) MultiSource/Applications/oggenc/oggenc: 12.79% (0.1462 => 0.1649, std.dev.: 0.0131) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4807, std.dev.: 0.0372) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0720, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4952, std.dev.: 0.0072) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5146, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5800, std.dev.: 0.0391) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3126, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1384, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3628, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4024, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0808, std.dev.: 0.0034) SingleSource/Regression/C/uint64_to_float: -23.61% (2.1832 => 1.6678, std.dev.: 0.0024) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.05% (0.0810 => 0.0940, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: 12.86% (0.1112 => 0.1255, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.89% (0.3295 => 0.3522, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.79% (0.2180 => 0.2328, std.dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.60% (0.3137 => 0.3344, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.2279 => 0.2428, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.25% (0.4847 => 0.5150, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.12% (0.2519 => 0.2648, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.86% (0.6010 => 0.6302, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.44% (4.4873 => 4.6865, std.dev.: 0.0213) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.44% (1.6386 => 1.7113, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.33% (0.5961 => 0.6219, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.17% (0.6287 => 0.6549, std.dev.: 0.0093) MultiSource/Benchmarks/nbench/nbench: 4.07% (1.1271 => 1.1730, std.dev.: 0.0095) MultiSource/Benchmarks/sim/sim: 3.97% (0.3226 => 0.3354, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.90% (0.9435 => 0.9803, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.89% (2.1401 => 2.2234, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.86% (0.3003 => 0.3119, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.83% (0.5817 => 0.6040, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.82% (0.4559 => 0.4733, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.75% (0.9908 => 1.0280, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.73% (1.4479 => 1.5019, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.64% (0.9074 => 0.9404, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.62% (1.1606 => 1.2026, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.58% (0.8656 => 0.8966, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.58% (0.8697 => 0.9008, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.44% (0.8340 => 0.8627, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.42% (0.9069 => 0.9379, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.34% (0.8317 => 0.8595, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 3.30% (1.2568 => 1.2983, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.24% (0.5191 => 0.5359, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.18% (0.8359 => 0.8625, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.11% (3.1832 => 3.2822, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.96% (1.5315 => 1.5768, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.76% (0.3657 => 0.3758, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.74% (8.6476 => 8.8844, std.dev.: 0.0908) MultiSource/Benchmarks/Bullet/bullet: 2.67% (31.8598 => 32.7118, std.dev.: 0.0618) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.67% (0.8855 => 0.9091, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.39% (0.8995 => 0.9210, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.27% (0.8927 => 0.9130, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.11% (0.6586 => 0.6725, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.08% (0.8286 => 0.8458, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.00% (0.8050 => 0.8211, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 1.64% (8.6247 => 8.7658, std.dev.: 0.0419) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 83.42% (0.0199 => 0.0365, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/pi: 57.09% (1.5795 => 2.4812, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.80% (0.7597 => 0.8873, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.32% (2.9753 => 3.4609, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.73% (2.7995 => 3.2118, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6092, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.08% (0.3186 => 0.3507, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.05% (1.1857 => 1.2811, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 7.50% (1.7056 => 1.8336, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.69% (4.7794 => 5.0992, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/richards_benchmark: 6.38% (1.3037 => 1.3869, std.dev.: 0.0050) MultiSource/Applications/SIBsim4/SIBsim4: 6.25% (3.1873 => 3.3866, std.dev.: 0.0496) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.02% (4.5327 => 4.8055, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.01% (4.9686 => 5.2672, std.dev.: 0.0152) MultiSource/Applications/lambda-0_1_3/lambda: 4.77% (7.4933 => 7.8509, std.dev.: 0.0830) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.67% (3.3761 => 3.5337, std.dev.: 0.0474) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.57% (6.2275 => 6.5120, std.dev.: 0.0158) MultiSource/Applications/hexxagon/hexxagon: 4.22% (14.0064 => 14.5979, std.dev.: 0.0581) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.21% (4.9453 => 5.1535, std.dev.: 0.0291) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.18% (4.9469 => 5.1537, std.dev.: 0.0196) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.26% (1.2337 => 1.2739, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.87% (4.8362 => 4.9750, std.dev.: 0.0348) MultiSource/Applications/siod/siod: 2.85% (3.6643 => 3.7688, std.dev.: 0.0405) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.50% (11.5690 => 11.8579, std.dev.: 0.0237) SingleSource/Benchmarks/Shootout/lists: 2.47% (7.3375 => 7.5187, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.35% (4.8660 => 4.9805, std.dev.: 0.0169) MultiSource/Benchmarks/Olden/bisort/bisort: 2.22% (0.6636 => 0.6783, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: 1.54% (1.2061 => 1.2247, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 1.30% (1.0841 => 1.0982, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 1.23% (8.5322 => 8.6369, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/bh/bh: 1.12% (2.3560 => 2.3825, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.10% (3.5679 => 3.6070, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.05% (5.4641 => 4.3139, std.dev.: 0.0311) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.39% (7.2130 => 6.2470, std.dev.: 0.0705) SingleSource/Benchmarks/McGill/chomp: -10.86% (1.1216 => 0.9998, std.dev.: 0.0171) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.76% (1.0512 => 0.9381, std.dev.: 0.0310) MultiSource/Benchmarks/mafft/pairlocalalign: -8.52% (63.1822 => 57.8007, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.01% (14.6451 => 13.4713, std.dev.: 0.0984) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.99% (4.7482 => 4.4164, std.dev.: 0.0272) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.3269 => 0.3070, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.94% (3.7148 => 3.4940, std.dev.: 0.0314) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.84% (5.4972 => 5.1764, std.dev.: 0.0232) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.03% (5.1557 => 4.8963, std.dev.: 0.0358) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.83% (4.7449 => 4.5634, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.67% (6.0224 => 5.8011, std.dev.: 0.0318) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.03% (28.5821 => 27.7150, std.dev.: 0.0163) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.03% (0.5807 => 0.5631, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: -2.17% (3.4237 => 3.3494, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.07% (9.9065 => 9.7013, std.dev.: 0.0378) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.04% (11.5316 => 11.2959, std.dev.: 0.0126) MultiSource/Applications/aha/aha: -2.04% (3.3398 => 3.2717, std.dev.: 0.0161) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.19% (2.8773 => 2.8432, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.16% (5.6343 => 5.5692, std.dev.: 0.0055) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.42% (1.0262 => 1.0613, std.dev.: 0.1469) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 11.38% (0.0123 => 0.0137, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0254 => 0.0254, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0302 => 0.0302, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -8.59% (0.0384 => 0.0351, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/casts: -2.11% (0.0190 => 0.0186, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 3.82% (0.1438 => 0.1493, std.dev.: 0.0156) MultiSource/Applications/lemon/lemon: 3.11% (1.1329 => 1.1681, std.dev.: 0.3434) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.90% (0.4164 => 0.4243, std.dev.: 0.0427) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.38% (0.1369 => 0.1429, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.84% (0.0641 => 0.0610, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 13.33% (0.0195 => 0.0221, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.23% (0.0578 => 0.0614, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.99% (1.1437 => 1.2008, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.69% (0.0627 => 0.0560, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0180 => 0.0180, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.02% (0.8017 => 0.7775, std.dev.: 0.0056) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0062 => 0.0062, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 04:09:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 06:09:00 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121121120900.16EB32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6107?compare_to=6104&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6107, Order: 168418, Start Time: 2012-11-21 10:35:40, End Time: 2012-11-21 12:09:25 To: 6104, Order: 168417, Start Time: 2012-11-21 08:38:55, End Time: 2012-11-21 10:12:28 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (4 on baseline) Performance Improvements: 0 (178 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1090 (860 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 13.20% (0.3636 => 0.4116, std.dev.: 0.0153) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.08% (77.9244 => 80.3273, std.dev.: 0.2646) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1008, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/salsa20: 2.53% (7.4937 => 7.6830, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/hash2: 2.20% (3.1932 => 3.2634, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.01% (0.1431 => 0.1302, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.35% (0.3821 => 0.3502, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -7.00% (0.3831 => 0.3563, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.98% (0.3880 => 0.3609, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.97% (0.3357 => 0.3123, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.96% (0.3896 => 0.3625, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.95% (0.3884 => 0.3614, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.91% (0.9542 => 0.8883, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/for-in: -6.89% (0.4033 => 0.3755, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.89% (0.3848 => 0.3583, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -6.85% (0.3812 => 0.3551, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.81% (0.3891 => 0.3626, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.78% (0.4176 => 0.3893, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.75% (0.3142 => 0.2930, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -6.54% (2.4924 => 2.3294, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -6.53% (0.2160 => 0.2019, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -6.53% (0.4199 => 0.3925, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.38% (9.2283 => 8.6393, std.dev.: 0.0160) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.30% (0.2428 => 0.2275, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.22% (0.9852 => 0.9239, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/parameter-passing: -6.19% (0.4280 => 0.4015, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.15% (0.6484 => 0.6085, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.12% (0.5863 => 0.5504, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.11% (0.7198 => 0.6758, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.10% (0.5478 => 0.5144, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.09% (1.0544 => 0.9902, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.08% (3.5339 => 3.3189, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: -6.08% (0.1761 => 0.1654, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -6.08% (16.1920 => 15.2082, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/football/football: -6.04% (0.9179 => 0.8625, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.03% (0.2355 => 0.2213, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -6.02% (7.0961 => 6.6688, std.dev.: 0.0056) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.00% (0.1716 => 0.1613, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.98% (0.5705 => 0.5364, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.96% (1.3722 => 1.2904, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.96% (0.3658 => 0.3440, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.94% (0.5925 => 0.5573, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.92% (6.7716 => 6.3710, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.90% (0.5849 => 0.5504, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (4.0323 => 3.7946, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.89% (0.5802 => 0.5460, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.88% (0.6667 => 0.6275, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.87% (0.5805 => 0.5464, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.87% (0.5859 => 0.5515, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.87% (0.5591 => 0.5263, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.86% (0.6230 => 0.5865, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.83% (0.6660 => 0.6272, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.82% (0.5857 => 0.5516, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.82% (1.2300 => 1.1584, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.81% (0.6297 => 0.5931, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -5.80% (1.1450 => 1.0786, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.80% (0.5570 => 0.5247, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.80% (4.8161 => 4.5370, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.79% (0.2695 => 0.2539, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.78% (0.6052 => 0.5702, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.77% (0.6189 => 0.5832, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.76% (0.6194 => 0.5837, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.74% (0.6304 => 0.5942, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.72% (1.6364 => 1.5428, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.72% (0.5581 => 0.5262, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -5.70% (4.3330 => 4.0860, std.dev.: 0.0093) MultiSource/Benchmarks/sim/sim: -5.70% (0.3406 => 0.3212, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.69% (0.5575 => 0.5258, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.68% (4.8802 => 4.6028, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.68% (0.6446 => 0.6080, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.66% (0.5456 => 0.5147, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.66% (0.6293 => 0.5937, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.63% (0.7919 => 0.7473, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.62% (0.6260 => 0.5908, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.60% (1.4642 => 1.3822, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.60% (0.6736 => 0.6359, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.57% (0.6681 => 0.6309, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -5.56% (0.2985 => 0.2819, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.56% (0.5688 => 0.5372, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.55% (0.5941 => 0.5611, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -5.55% (1.3864 => 1.3095, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/05-eks/eks: -5.51% (0.4515 => 0.4266, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.50% (0.8521 => 0.8052, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.48% (1.2784 => 1.2083, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.48% (4.5069 => 4.2601, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.46% (0.2548 => 0.2409, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.45% (0.6676 => 0.6312, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.40% (0.6440 => 0.6092, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.40% (0.3483 => 0.3295, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -5.39% (1.1530 => 1.0908, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: -5.38% (17.1032 => 16.1828, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.34% (0.6033 => 0.5711, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -5.33% (1.2515 => 1.1848, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.33% (0.4916 => 0.4654, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -5.32% (15.5079 => 14.6828, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.31% (0.2278 => 0.2157, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: -5.31% (0.3581 => 0.3391, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.27% (1.6474 => 1.5605, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.27% (14.2083 => 13.4589, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.27% (0.5999 => 0.5683, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/08-main/main: -5.27% (0.2659 => 0.2519, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.25% (1.2210 => 1.1569, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.24% (0.5168 => 0.4897, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.20% (0.4151 => 0.3935, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.20% (0.2999 => 0.2843, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.18% (1.2221 => 1.1588, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.15% (8.0126 => 7.6002, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference: -5.12% (0.7779 => 0.7381, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -5.11% (1.3148 => 1.2476, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.11% (0.7339 => 0.6964, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -5.11% (3.5154 => 3.3358, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.07% (0.6395 => 0.6071, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.02% (0.2871 => 0.2727, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -5.00% (4.0594 => 3.8563, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: -5.00% (0.7447 => 0.7075, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.99% (0.2385 => 0.2266, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.99% (0.3931 => 0.3735, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -4.98% (0.2989 => 0.2840, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.98% (22.4056 => 21.2891, std.dev.: 0.0189) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.97% (0.3057 => 0.2905, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -4.96% (0.3025 => 0.2875, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.96% (0.7021 => 0.6673, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -4.95% (0.3194 => 0.3036, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.93% (0.2903 => 0.2760, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.92% (0.3252 => 0.3092, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.88% (0.7524 => 0.7157, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.88% (0.2933 => 0.2790, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.85% (0.5567 => 0.5297, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -4.85% (0.3446 => 0.3279, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.84% (15.2527 => 14.5143, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary2: -4.83% (0.3481 => 0.3313, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -4.82% (2.4021 => 2.2862, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.81% (0.5569 => 0.5301, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -4.81% (0.2849 => 0.2712, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: -4.80% (0.3205 => 0.3051, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: -4.80% (0.2939 => 0.2798, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: -4.79% (0.3255 => 0.3099, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.77% (0.3016 => 0.2872, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -4.77% (0.3394 => 0.3232, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.75% (0.5329 => 0.5076, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.73% (2.1713 => 2.0687, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: -4.72% (0.3621 => 0.3450, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.70% (0.4083 => 0.3891, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.70% (0.3319 => 0.3163, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.69% (0.3837 => 0.3657, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.69% (0.6395 => 0.6095, std.dev.: 0.0091) SingleSource/UnitTests/ObjC++/property-reference-object: -4.69% (0.6441 => 0.6139, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -4.68% (0.4248 => 0.4049, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: -4.68% (0.6347 => 0.6050, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -4.65% (0.4861 => 0.4635, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.57% (0.4813 => 0.4593, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -4.56% (0.3026 => 0.2888, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -4.56% (0.3271 => 0.3122, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.52% (0.3849 => 0.3675, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: -4.50% (0.3867 => 0.3693, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.46% (0.9557 => 0.9131, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: -4.44% (0.4524 => 0.4323, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: -4.44% (18.2933 => 17.4808, std.dev.: 0.0076) MultiSource/Applications/oggenc/oggenc: -4.43% (5.0226 => 4.8003, std.dev.: 0.0039) MultiSource/Applications/treecc/treecc: -4.42% (2.1401 => 2.0455, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -4.38% (0.7982 => 0.7632, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.33% (2.2587 => 2.1610, std.dev.: 0.0057) SingleSource/Regression/C++/ofstream_ctor: -4.25% (0.3059 => 0.2929, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -4.23% (34.0927 => 32.6492, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.21% (0.3491 => 0.3344, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -4.19% (0.8418 => 0.8065, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/bigfib: -4.19% (0.6750 => 0.6467, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.18% (0.3323 => 0.3184, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.11% (0.9077 => 0.8704, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.02% (0.4427 => 0.4249, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: -3.78% (0.3788 => 0.3645, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.53% (5.4682 => 5.2751, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.43% (0.4321 => 0.4173, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: -3.25% (1.5610 => 1.5102, std.dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -2.22% (20.7746 => 20.3126, std.dev.: 0.0597) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7555, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: -8.66% (1.2842 => 1.1730, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: -3.92% (2.2633 => 2.1746, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7070, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4692, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 05:12:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 07:12:05 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121121131205.A06912A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6108?compare_to=6102&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6108, Order: 168418, Start Time: 2012-11-21 09:51:28, End Time: 2012-11-21 13:12:30 To: 6102, Order: 168411, Start Time: 2012-11-21 05:39:22, End Time: 2012-11-21 09:03:13 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (175 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1089 (716 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.62% (124.6205 => 131.6198, std.dev.: 0.2238) SingleSource/Benchmarks/Shootout-C++/methcall: 2.17% (16.2258 => 16.5773, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.07% (54.1708 => 54.7531, std.dev.: 0.0626) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 44.48% (0.0625 => 0.0903, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.52% (0.1063 => 0.1430, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.89% (0.0714 => 0.0906, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.76% (0.1106 => 0.1402, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.47% (0.2969 => 0.3755, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 25.97% (1.5932 => 2.0069, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.51% (0.4139 => 0.5195, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.05% (0.4994 => 0.6195, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.96% (0.4253 => 0.5272, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.60% (0.5000 => 0.6180, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.58% (0.0547 => 0.0676, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.58% (0.0475 => 0.0587, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.47% (0.5900 => 0.7285, std.dev.: 0.0034) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.46% (0.0584 => 0.0721, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.62% (0.1021 => 0.1252, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.49% (0.1107 => 0.1356, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.47% (0.1620 => 0.1984, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.41% (0.0897 => 0.1098, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 22.20% (0.0599 => 0.0732, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.07% (0.0541 => 0.0655, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.06% (0.0584 => 0.0707, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.01% (0.0633 => 0.0766, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 20.99% (0.0948 => 0.1147, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.87% (0.0642 => 0.0776, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.85% (0.1103 => 0.1333, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.70% (0.3903 => 0.4711, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.61% (0.0495 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 20.58% (0.0821 => 0.0990, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.34% (0.1003 => 0.1207, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.27% (0.1549 => 0.1863, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.19% (0.0822 => 0.0988, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.07% (0.1604 => 0.1926, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 20.07% (0.1619 => 0.1944, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 20.03% (0.0604 => 0.0725, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 19.54% (0.0947 => 0.1132, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: 19.43% (0.0808 => 0.0965, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.22% (0.1462 => 0.1743, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.10% (0.3890 => 0.4633, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.97% (0.2014 => 0.2396, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 18.64% (0.5826 => 0.6912, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 18.64% (0.1218 => 0.1445, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.35% (0.2736 => 0.3238, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 18.34% (0.0698 => 0.0826, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 18.24% (0.5889 => 0.6963, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 18.14% (0.4029 => 0.4760, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.14% (1.3152 => 1.5538, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.11% (0.1088 => 0.1285, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 18.01% (0.1505 => 0.1776, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.69% (0.2866 => 0.3373, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.69% (0.0605 => 0.0712, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.66% (0.0572 => 0.0673, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 17.57% (1.8794 => 2.2097, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 17.56% (0.5546 => 0.6520, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.45% (0.0573 => 0.0673) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.28% (0.1968 => 0.2308, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.27% (3.5627 => 4.1779, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.14% (1.6211 => 1.8989, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.05% (0.4658 => 0.5452, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.04% (0.2875 => 0.3365, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 16.93% (1.0781 => 1.2606, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 16.86% (0.9697 => 1.1332, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.85% (0.3271 => 0.3822, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.81% (0.1160 => 0.1355, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: 16.62% (0.2780 => 0.3242, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 16.54% (0.1421 => 0.1656, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 16.47% (0.2811 => 0.3274, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.40% (0.4361 => 0.5076, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 16.36% (0.2750 => 0.3200, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.34% (0.3930 => 0.4572, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.34% (0.5026 => 0.5847, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/fibo: 16.29% (0.2725 => 0.3169, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.29% (0.2738 => 0.3184, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 16.29% (0.2714 => 0.3156, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 16.28% (4.2109 => 4.8963, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/methcall: 16.25% (0.2813 => 0.3270, std.dev.: 0.0051) SingleSource/Regression/C++/ofstream_ctor: 16.25% (0.3004 => 0.3492, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.22% (0.2792 => 0.3245, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 16.22% (0.2823 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.20% (0.2729 => 0.3171, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.20% (2.7292 => 3.1712, std.dev.: 0.0100) SingleSource/UnitTests/ObjC++/property-reference: 16.15% (0.7171 => 0.8329, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 16.14% (0.9909 => 1.1508, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.11% (0.2911 => 0.3380, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.09% (0.3195 => 0.3709, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.06% (0.1090 => 0.1265, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 16.04% (0.1284 => 0.1490, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.99% (4.4195 => 5.1263, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/random: 15.98% (0.2803 => 0.3251, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.72% (2.0673 => 2.3923, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 15.70% (0.3096 => 0.3582, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.60% (1.9694 => 2.2766, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.43% (1.9966 => 2.3047, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary3: 15.43% (0.3267 => 0.3771, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 15.41% (0.3258 => 0.3760, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.33% (0.3060 => 0.3529, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 15.15% (23.5202 => 27.0830, std.dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C/football/football: 15.08% (0.2075 => 0.2388, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 15.08% (0.2566 => 0.2953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 15.07% (0.3317 => 0.3817, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 14.83% (0.3446 => 0.3957, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 14.82% (0.3496 => 0.4014, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.81% (0.3362 => 0.3860, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 14.78% (0.3465 => 0.3977, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.76% (0.3124 => 0.3585, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 14.74% (0.3678 => 0.4220, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.74% (0.3488 => 0.4002, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 14.70% (0.3469 => 0.3979, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.70% (0.3442 => 0.3948, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.68% (0.3460 => 0.3968, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.63% (0.3282 => 0.3762, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 14.49% (0.3348 => 0.3833, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 14.44% (1.4269 => 1.6330, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/sieve: 14.44% (0.3726 => 0.4264, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 14.36% (0.3650 => 0.4174, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.34% (0.3625 => 0.4145, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 14.29% (0.3477 => 0.3974, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 14.27% (0.3643 => 0.4163, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 14.17% (0.7875 => 0.8991, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 14.07% (0.3724 => 0.4248, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 14.04% (0.4146 => 0.4728, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.97% (0.3981 => 0.4537, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 13.88% (0.4251 => 0.4841, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.88% (0.3690 => 0.4202, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.73% (0.3845 => 0.4373, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 13.72% (0.0758 => 0.0862, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 13.69% (2.1653 => 2.4617, std.dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 13.56% (4.6177 => 5.2440, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: 13.29% (0.5012 => 0.5678, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 13.24% (2.1013 => 2.3795, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.19% (0.2040 => 0.2309, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 12.82% (0.2691 => 0.3036, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.35% (0.6435 => 0.7230, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 12.28% (5.5417 => 6.2223, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.86% (0.1383 => 0.1547, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.67% (0.1028 => 0.1148, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 11.58% (0.3498 => 0.3903, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.36% (0.2737 => 0.3048, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 11.35% (0.4847 => 0.5397, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.32% (0.2068 => 0.2302, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.93% (0.3084 => 0.3421, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.84% (0.6634 => 0.7353, std.dev.: 0.0043) MultiSource/Applications/minisat/minisat: 10.58% (0.3336 => 0.3689, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 10.35% (2.0346 => 2.2451, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.18% (0.2103 => 0.2317, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 10.16% (0.2391 => 0.2634, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.31% (0.5361 => 0.5860, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.01% (4.6926 => 5.1152, std.dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.75% (11.6398 => 12.6588, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.65% (0.7426 => 0.8068, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.43% (0.5584 => 0.6055, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 7.32% (11.9555 => 12.8303, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.46% (0.3792 => 0.3999, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0294, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 9.21% (0.2802 => 0.3060, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6116, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6731, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-2: 4.75% (1.8057 => 1.8914, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: 4.71% (0.2122 => 0.2222, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1695, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.41% (0.3693 => 0.3856, std.dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6364, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1930, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2229, std.dev.: 0.0041) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3029, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.34% (7.1849 => 7.2813, std.dev.: 0.0075) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5766, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5773, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/ary2: -9.45% (0.2402 => 0.2175, std.dev.: 0.0055) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9771, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7991, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8059, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0057) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8611, std.dev.: 0.0053) SingleSource/Benchmarks/Dhrystone/fldry: -2.13% (17.2379 => 16.8713, std.dev.: 0.0412) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5751, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4961, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.07% (105.3826 => 104.2567, std.dev.: 0.0492) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0452, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 05:42:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 07:42:06 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121121134206.E8D122A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6109?compare_to=6106&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6109, Order: 168420, Start Time: 2012-11-21 12:12:31, End Time: 2012-11-21 13:42:32 To: 6106, Order: 168418, Start Time: 2012-11-21 10:24:34, End Time: 2012-11-21 11:55:46 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 7 (95 on baseline) Performance Improvements: 17 (27 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1030 (852 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 4.18% (0.3113 => 0.3243, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 11.66% (0.7734 => 0.8636, std.dev.: 0.0115) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.98% (1.3444 => 1.4114, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.20% (4.3180 => 4.4995, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: 1.53% (53.6186 => 54.4368, std.dev.: 0.3047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.49% (1.4073 => 1.4283, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.12% (8.3593 => 8.4531, std.dev.: 0.0291) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.72% (0.3221 => 0.3069, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.29% (0.3522 => 0.3371, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.80% (0.9025 => 0.8682, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.49% (4.6865 => 4.5699, std.dev.: 0.0310) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.06% (13.8311 => 13.5455, std.dev.: 0.0432) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.86% (0.9172 => 0.9001, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.69% (0.8367 => 0.8226, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.61% (0.9210 => 0.9062, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.53% (1.5019 => 1.4789, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.47% (4.3591 => 4.2950, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.43% (1.7113 => 1.6869, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.20% (0.9379 => 0.9266, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.20% (1.2755 => 1.2602, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -11.40% (23.1541 => 20.5134, std.dev.: 0.7366) MultiSource/Benchmarks/Olden/bisort/bisort: -4.94% (0.6783 => 0.6448, std.dev.: 0.0031) SingleSource/Benchmarks/LivermoreLoops/kernel08: -3.53% (0.3007 => 0.2901, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.99% (2.4826 => 2.4332, std.dev.: 0.0101) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.73% (1.0613 => 1.0536, std.dev.: 0.0109) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 38.69% (0.0137 => 0.0190, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.52% (0.0426 => 0.0411, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.94% (0.0254 => 0.0244, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -15.23% (0.0302 => 0.0256, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 21.08% (0.0351 => 0.0425) SingleSource/UnitTests/Vector/Altivec/casts: 9.14% (0.0186 => 0.0203, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -6.88% (0.0218 => 0.0203, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -1.54% (0.1493 => 0.1470, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -0.41% (1.1681 => 1.1633, std.dev.: 0.0133) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.91% (0.4243 => 0.4162, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.98% (0.1429 => 0.1415, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.25% (0.0610 => 0.0642, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.84% (0.0221 => 0.0186, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.10% (0.0614 => 0.0552, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.76% (1.2008 => 1.1917, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 400.00% (0.0001 => 0.0005, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 400.00% (0.0001 => 0.0005, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.71% (0.0560 => 0.0556, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.11% (0.0180 => 0.0227, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.51% (0.7775 => 0.7735, std.dev.: 0.0087) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -29.03% (0.0062 => 0.0044, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 6.90% (16.4461 => 17.5808, std.dev.: 0.0479) MultiSource/Applications/sqlite3/sqlite3: 2311.20% (0.6332 => 15.2677, std.dev.: 0.1672) MultiSource/Benchmarks/McCat/08-main/main: 48.28% (0.1831 => 0.2715, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.12% (0.1559 => 0.1448, std.dev.: 0.0058) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7067.82% (0.3123 => 22.3851, std.dev.: 0.2659) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.99% (0.2463 => 0.3719, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1521.14% (0.3344 => 5.4211, std.dev.: 0.1042) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.69% (0.2364 => 0.3255, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 4.61% (0.6010 => 0.6287, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.21% (0.3266 => 0.3436, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 3.71% (0.1969 => 0.2042, std.dev.: 0.0022) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -18.75% (0.0224 => 0.0182, std.dev.: 0.0027) SingleSource/UnitTests/byval-alignment: -38.26% (0.0230 => 0.0142, std.dev.: 0.0012) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0444, std.dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: 9.30% (0.1462 => 0.1598, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4614, std.dev.: 0.0198) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0712, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4943, std.dev.: 0.0052) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5118, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5196, std.dev.: 0.0625) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3274, std.dev.: 0.0383) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1261, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3626, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4024, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0873, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -23.86% (2.1832 => 1.6622, std.dev.: 0.0062) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.19% (0.0810 => 0.0933, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.82% (0.3137 => 0.3351, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.19% (0.1983 => 0.2086, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.70% (0.7473 => 0.7824, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.64% (0.2240 => 0.2344, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.56% (0.2279 => 0.2383, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.44% (0.6010 => 0.6277, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.34% (0.8321 => 0.8682, std.dev.: 0.0124) MultiSource/Applications/hbd/hbd: 4.14% (1.4269 => 1.4860, std.dev.: 0.0125) MultiSource/Applications/minisat/minisat: 3.78% (0.6834 => 0.7092, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.77% (1.1606 => 1.2044, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.71% (0.5961 => 0.6182, std.dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: 3.70% (0.2999 => 0.3110, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.67% (0.6287 => 0.6518, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.30% (0.4127 => 0.4263, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.27% (0.4559 => 0.4708, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.13% (1.1271 => 1.1624, std.dev.: 0.0040) MultiSource/Applications/lua/lua: 2.97% (3.8189 => 3.9322, std.dev.: 0.0266) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.95% (1.6386 => 1.6869, std.dev.: 0.0055) MultiSource/Applications/SIBsim4/SIBsim4: 2.89% (1.2568 => 1.2931, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.84% (4.1763 => 4.2950, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.78% (0.9074 => 0.9326, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.76% (13.1811 => 13.5455, std.dev.: 0.0432) MultiSource/Applications/hexxagon/hexxagon: 2.73% (0.9810 => 1.0078, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 2.73% (14.2605 => 14.6497, std.dev.: 0.1303) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.72% (1.1685 => 1.2003, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.70% (0.5817 => 0.5974, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.56% (0.5191 => 0.5324, std.dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.54% (6.6074 => 6.7749, std.dev.: 0.0294) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.51% (0.8597 => 0.8813, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.50% (0.9908 => 1.0156, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.44% (0.8204 => 0.8404, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 2.41% (0.8768 => 0.8979, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.39% (0.8331 => 0.8530, std.dev.: 0.0071) MultiSource/Applications/JM/lencod/lencod: 2.38% (15.3280 => 15.6935, std.dev.: 0.0792) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.28% (0.8359 => 0.8550, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.26% (0.8317 => 0.8505, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 2.25% (3.2366 => 3.3094, std.dev.: 0.0245) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.23% (0.8805 => 0.9001, std.dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: 2.22% (2.3764 => 2.4291, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.20% (0.8286 => 0.8468, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.17% (0.9069 => 0.9266, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.17% (0.6586 => 0.6729, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.15% (1.1170 => 1.1410, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.15% (1.3279 => 1.3564, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.14% (1.4479 => 1.4789, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.13% (0.9056 => 0.9249, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.09% (0.8656 => 0.8837, std.dev.: 0.0054) MultiSource/Benchmarks/Bullet/bullet: 2.06% (31.8598 => 32.5146, std.dev.: 0.0869) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.05% (0.8518 => 0.8693, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.03% (0.8855 => 0.9035, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.00% (0.8712 => 0.8886, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.98% (1.2526 => 1.2774, std.dev.: 0.0091) MultiSource/Applications/JM/ldecod/ldecod: 1.93% (6.7320 => 6.8618, std.dev.: 0.0397) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.92% (0.8007 => 0.8161, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.91% (8.6476 => 8.8125, std.dev.: 0.0365) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.90% (0.8066 => 0.8219, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.86% (0.8177 => 0.8329, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.85% (3.1832 => 3.2421, std.dev.: 0.0226) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.84% (4.4873 => 4.5699, std.dev.: 0.0310) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.73% (0.8086 => 0.8226, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.70% (0.8338 => 0.8480, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 1.62% (8.6247 => 8.7642, std.dev.: 0.0178) MultiSource/Applications/lemon/lemon: 1.58% (1.0945 => 1.1118, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.44% (1.2423 => 1.2602, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 105.53% (0.0199 => 0.0409, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/pi: 57.13% (1.5795 => 2.4818, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.72% (0.7597 => 0.8867, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.17% (2.9753 => 3.4564, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.70% (2.7995 => 3.2111, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.48% (5.0261 => 5.6029, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.76% (0.3186 => 0.3465, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.10% (1.1857 => 1.2817, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 7.48% (1.7056 => 1.8332, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.59% (4.7794 => 5.0943, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/richards_benchmark: 6.35% (1.3037 => 1.3865, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 6.27% (3.1873 => 3.3871, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.88% (4.9686 => 5.2610, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.73% (4.5327 => 4.7923, std.dev.: 0.0104) MultiSource/Applications/lambda-0_1_3/lambda: 4.86% (7.4933 => 7.8571, std.dev.: 0.0338) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.84% (6.2275 => 6.5287, std.dev.: 0.0398) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.23% (4.9453 => 5.1543, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.99% (4.9469 => 5.1442, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.54% (0.3587 => 0.3714, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.31% (4.3552 => 4.4995, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 2.90% (3.6643 => 3.7704, std.dev.: 0.0201) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.76% (1.2337 => 1.2678, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.25% (4.8660 => 4.9753, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.11% (8.2783 => 8.4531, std.dev.: 0.0291) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.75% (1.1365 => 1.1564, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.64% (4.8362 => 4.9155, std.dev.: 0.0235) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.38% (2.4647 => 2.4987, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.28% (4.0473 => 4.0992, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.28% (3.5679 => 3.6136, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: 1.11% (8.5322 => 8.6271, std.dev.: 0.0150) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.95% (5.4641 => 4.3196, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.82% (7.2130 => 6.2884, std.dev.: 0.1235) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.32% (1.0512 => 0.9322, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: -10.67% (1.1216 => 1.0019, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.06% (14.6451 => 13.3184, std.dev.: 0.1985) MultiSource/Benchmarks/mafft/pairlocalalign: -8.51% (63.1822 => 57.8048, std.dev.: 0.0487) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.80% (0.3269 => 0.3014, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.88% (4.7482 => 4.4213, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.09% (3.7148 => 3.4887, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.88% (5.4972 => 5.1738, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.16% (5.1557 => 4.8899, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.53% (4.7449 => 4.5299, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.86% (6.0224 => 5.7902, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.36% (2.8773 => 2.7807, std.dev.: 0.0293) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.35% (1.2822 => 1.2392, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.08% (0.5807 => 0.5628, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.04% (28.5821 => 27.7120, std.dev.: 0.0880) MultiSource/Benchmarks/Olden/bisort/bisort: -2.83% (0.6636 => 0.6448, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.72% (2.6356 => 2.5640, std.dev.: 0.0143) MultiSource/Benchmarks/FreeBench/mason/mason: -2.64% (0.5415 => 0.5272, std.dev.: 0.0030) MultiSource/Applications/aha/aha: -2.46% (3.3398 => 3.2578, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash2: -2.10% (3.4237 => 3.3517, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.94% (11.5316 => 11.3078, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.68% (3.2169 => 3.1628, std.dev.: 0.0086) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.66% (2.3487 => 2.3097, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.58% (4.9994 => 4.9206, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.13% (5.6343 => 5.5709, std.dev.: 0.0046) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.67% (1.0262 => 1.0536, std.dev.: 0.0109) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 54.47% (0.0123 => 0.0190, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.74% (0.0408 => 0.0411, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.94% (0.0254 => 0.0244, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -15.23% (0.0302 => 0.0256, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 12.78% (0.0180 => 0.0203, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.23% (0.1438 => 0.1470, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 2.68% (1.1329 => 1.1633, std.dev.: 0.0133) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.05% (0.4164 => 0.4162, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.36% (0.1369 => 0.1415, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.16% (0.0641 => 0.0642, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.62% (0.0195 => 0.0186, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.50% (0.0578 => 0.0552, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.20% (1.1437 => 1.1917, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 400.00% (0.0001 => 0.0005, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -64.29% (0.0014 => 0.0005, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.32% (0.0627 => 0.0556, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.11% (0.0180 => 0.0227, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.52% (0.8017 => 0.7735, std.dev.: 0.0087) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -29.03% (0.0062 => 0.0044, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 06:05:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 08:05:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121121140531.09F072A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6110?compare_to=6107&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6110, Order: 168420, Start Time: 2012-11-21 12:32:21, End Time: 2012-11-21 14:05:56 To: 6107, Order: 168418, Start Time: 2012-11-21 10:35:40, End Time: 2012-11-21 12:09:25 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (183 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (855 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.29% (1.2671 => 1.2835, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.17% (2.0478 => 2.1127, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/salsa20: 2.59% (7.4937 => 7.6875, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash2: 2.20% (3.1932 => 3.2634, std.dev.: 0.0077) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.08% (0.1431 => 0.1301, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.24% (0.3821 => 0.3506, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -7.00% (0.3357 => 0.3122, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.95% (0.3884 => 0.3614, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.95% (0.9542 => 0.8879, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.92% (0.3831 => 0.3566, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.91% (0.3142 => 0.2925, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -6.85% (0.3812 => 0.3551, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.83% (0.3848 => 0.3585, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.80% (0.3880 => 0.3616, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.75% (0.4176 => 0.3894, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.73% (0.3891 => 0.3629, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/synchronized: -6.72% (0.3896 => 0.3634, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.62% (0.4033 => 0.3766, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -6.62% (0.2160 => 0.2017, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -6.60% (2.4924 => 2.3278, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.51% (0.2428 => 0.2270, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.46% (0.1796 => 0.1680, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.44% (0.1584 => 0.1482, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -6.44% (9.2283 => 8.6341, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.39% (0.9852 => 0.9222, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -6.38% (0.4199 => 0.3931, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.32% (0.6484 => 0.6074, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.24% (0.2355 => 0.2208, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.19% (1.0544 => 0.9891, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: -6.18% (16.1920 => 15.1908, std.dev.: 0.0081) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.18% (0.1716 => 0.1610, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.17% (0.5478 => 0.5140, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -6.17% (0.4280 => 0.4016, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.16% (0.5863 => 0.5502, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.15% (0.3658 => 0.3433, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: -6.09% (0.9179 => 0.8620, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.09% (3.5339 => 3.3188, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -6.08% (0.1761 => 0.1654, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.05% (1.3722 => 1.2892, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: -6.05% (7.0961 => 6.6669, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.04% (4.0323 => 3.7888, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.03% (0.5705 => 0.5361, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -6.02% (0.5849 => 0.5497, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: -6.01% (0.1879 => 0.1766, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.01% (0.5805 => 0.5456, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.01% (0.5857 => 0.5505, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.00% (4.8161 => 4.5270, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.99% (0.5591 => 0.5256, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.97% (0.7198 => 0.6768, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.97% (0.5859 => 0.5509, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.96% (0.6297 => 0.5922, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.93% (1.2300 => 1.1571, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.92% (0.5925 => 0.5574, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.91% (0.6667 => 0.6273, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.90% (0.2695 => 0.2536) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.89% (6.7716 => 6.3729, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.89% (0.6660 => 0.6268, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.87% (0.6230 => 0.5864, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -5.84% (1.1450 => 1.0781, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.83% (0.5570 => 0.5245, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -5.83% (4.3330 => 4.0804, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.82% (0.6304 => 0.5937, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.81% (0.6194 => 0.5834, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.81% (0.5802 => 0.5465, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.81% (4.8802 => 4.5968, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.80% (0.6189 => 0.5830, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.80% (0.6052 => 0.5701, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.80% (0.6260 => 0.5897, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.80% (0.7919 => 0.7460, std.dev.: 0.0118) MultiSource/Benchmarks/nbench/nbench: -5.79% (1.1530 => 1.0862, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.79% (1.6364 => 1.5416, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.79% (1.4642 => 1.3794, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.78% (0.5575 => 0.5253, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.77% (0.6446 => 0.6074, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.77% (0.5581 => 0.5259, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -5.73% (0.3406 => 0.3211, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.70% (0.6736 => 0.6352, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: -5.67% (0.4515 => 0.4259, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -5.66% (0.2985 => 0.2816, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.65% (0.5456 => 0.5148, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.63% (0.8521 => 0.8041, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.62% (1.2784 => 1.2065, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.61% (0.5688 => 0.5369, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.61% (0.5941 => 0.5608, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.60% (0.6681 => 0.6307, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.58% (4.5069 => 4.2553, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.57% (0.2548 => 0.2406, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -5.56% (1.2515 => 1.1819, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.54% (0.3483 => 0.3290, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.53% (0.6676 => 0.6307, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.50% (0.6293 => 0.5947, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: -5.49% (0.7779 => 0.7352, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.47% (0.4916 => 0.4647, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.47% (0.6440 => 0.6088, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.45% (0.2659 => 0.2514, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.45% (1.2210 => 1.1545, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: -5.43% (17.1032 => 16.1745, std.dev.: 0.0109) MultiSource/Applications/SPASS/SPASS: -5.38% (15.5079 => 14.6730, std.dev.: 0.0195) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.37% (0.2999 => 0.2838, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.35% (8.0126 => 7.5838, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.34% (0.5168 => 0.4892, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.34% (0.6033 => 0.5711, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.31% (1.6474 => 1.5599, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.30% (14.2083 => 13.4552, std.dev.: 0.0050) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.27% (0.3319 => 0.3144, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.27% (0.2278 => 0.2158, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: -5.26% (0.6347 => 0.6013, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -5.26% (1.3864 => 1.3135, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: -5.22% (0.2871 => 0.2721, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.21% (1.2221 => 1.1584, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -5.20% (3.5154 => 3.3326, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.18% (0.4151 => 0.3936, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: -5.17% (0.3581 => 0.3396, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.16% (0.6395 => 0.6065, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -5.16% (1.3148 => 1.2470, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/methcall: -5.12% (0.3025 => 0.2870, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.12% (0.2385 => 0.2263, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: -5.11% (0.6441 => 0.6112, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.10% (0.3057 => 0.2901, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.09% (0.3931 => 0.3731, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.08% (0.2933 => 0.2784, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -5.08% (0.3446 => 0.3271, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.07% (0.7339 => 0.6967, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -5.06% (4.0594 => 3.8538, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.05% (0.7524 => 0.7144, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.04% (0.7021 => 0.6667, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.04% (0.2939 => 0.2791, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -5.04% (0.7447 => 0.7072, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.03% (0.5999 => 0.5697, std.dev.: 0.0056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.01% (22.4056 => 21.2820, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/objinst: -5.01% (0.3194 => 0.3034, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.99% (0.2903 => 0.2758, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -4.98% (0.2849 => 0.2707, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -4.98% (0.3394 => 0.3225, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -4.96% (2.4021 => 2.2830, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: -4.95% (0.2989 => 0.2841, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -4.95% (15.2527 => 14.4982, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.92% (0.5569 => 0.5295, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.89% (0.5567 => 0.5295, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: -4.88% (0.4861 => 0.4624, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.88% (0.3323 => 0.3161, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.86% (0.4321 => 0.4111, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.86% (0.3252 => 0.3094, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -4.85% (0.3255 => 0.3097, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.85% (5.0226 => 4.7788, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.84% (0.2106 => 0.2004, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.84% (0.3205 => 0.3050, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.82% (0.5329 => 0.5072, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.81% (0.3016 => 0.2871, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.80% (0.6395 => 0.6088, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.80% (0.3837 => 0.3653, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.78% (0.4083 => 0.3888, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.74% (2.1713 => 2.0683, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.70% (0.3849 => 0.3668, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -4.69% (0.3621 => 0.3451, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: -4.69% (0.3026 => 0.2884, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -4.68% (0.4248 => 0.4049, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -4.60% (18.2933 => 17.4509, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.56% (2.2587 => 2.1558, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -4.54% (0.7982 => 0.7620, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.51% (0.9557 => 0.9126, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -4.51% (34.0927 => 32.5559, std.dev.: 0.0165) MultiSource/Applications/treecc/treecc: -4.50% (2.1401 => 2.0438, std.dev.: 0.0026) SingleSource/Regression/C++/ofstream_ctor: -4.45% (0.3059 => 0.2923, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.38% (0.4813 => 0.4602, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.37% (0.8418 => 0.8050, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: -4.37% (0.3867 => 0.3698, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: -4.34% (0.3271 => 0.3129, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: -4.33% (0.4524 => 0.4328, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.30% (0.3491 => 0.3341, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.22% (0.4427 => 0.4240, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -4.15% (0.6750 => 0.6470, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.11% (0.9077 => 0.8704, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -3.93% (0.3788 => 0.3639, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.58% (5.4682 => 5.2723, std.dev.: 0.0075) MultiSource/Applications/hbd/hbd: -3.16% (1.5610 => 1.5117, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -2.36% (20.7746 => 20.2847, std.dev.: 0.0190) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.35% (7.5137 => 5.7594, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: -8.75% (1.2842 => 1.1718, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: -3.89% (2.2633 => 2.1752, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.99% (1.3096 => 1.2835, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4668, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 06:31:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 08:31:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121121143131.2D24D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6111?compare_to=6105&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6111, Order: 168420, Start Time: 2012-11-21 12:11:27, End Time: 2012-11-21 14:31:55 To: 6105, Order: 168413, Start Time: 2012-11-21 09:00:35, End Time: 2012-11-21 11:20:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 2 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 42 (143 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1044 (703 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -2.74% (72.0518 => 70.0793, std.dev.: 0.2819) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.6070 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.45% (0.1179 => 0.1373, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 15.66% (0.6148 => 0.7111, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 14.22% (2.4739 => 2.8258, std.dev.: 0.0174) SingleSource/Benchmarks/Misc/richards_benchmark: 14.03% (0.0891 => 0.1016, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 13.68% (0.8153 => 0.9268, std.dev.: 0.0079) MultiSource/Applications/lemon/lemon: 13.14% (1.1997 => 1.3573, std.dev.: 0.0361) MultiSource/Applications/lambda-0_1_3/lambda: 12.96% (0.8548 => 0.9656, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 12.10% (0.8003 => 0.8971, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/em3d/em3d: 11.63% (0.1977 => 0.2207, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 11.37% (0.8080 => 0.8999, std.dev.: 0.0172) MultiSource/Applications/aha/aha: 11.14% (0.1329 => 0.1477, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 10.29% (0.1331 => 0.1468, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.07% (0.2115 => 0.2328, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.64% (0.2675 => 0.2933, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.45% (1.0660 => 1.1667, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary3: 8.03% (0.3574 => 0.3861, std.dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.25% (0.5116 => 0.5436, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.66% (0.2402 => 0.2538, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.07% (0.9604 => 1.0091, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.62% (4.7107 => 4.9282, std.dev.: 0.0704) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.86% (0.6894 => 0.7160, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 3.73% (0.6429 => 0.6669, std.dev.: 0.0083) MultiSource/Applications/kimwitu++/kc: 3.70% (21.1550 => 21.9374, std.dev.: 0.1078) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.62% (4.7895 => 4.9627, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.34% (0.7005 => 0.7169, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 1.68% (32.1802 => 32.7222, std.dev.: 0.1458) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/flops: 28.57% (6.7486 => 8.6768, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 20.64% (3.7935 => 4.5765, std.dev.: 0.1060) SingleSource/Benchmarks/Misc-C++/stepanov_container: 20.49% (5.6825 => 6.8471, std.dev.: 0.3957) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.09% (1.3979 => 1.6647, std.dev.: 0.0239) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 15.94% (5.3732 => 6.2298, std.dev.: 0.1122) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.16% (2.1055 => 2.2983, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 8.74% (1.4410 => 1.5670, std.dev.: 0.0104) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.77% (3.1348 => 3.3470, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: 6.25% (1.9737 => 2.0970, std.dev.: 0.0097) MultiSource/Benchmarks/NPB-serial/is/is: 5.49% (8.5653 => 9.0357, std.dev.: 0.0395) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 5.16% (6.1491 => 6.4661, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/hash2: 4.00% (3.3688 => 3.5037, std.dev.: 0.0207) MultiSource/Benchmarks/Olden/em3d/em3d: 2.96% (3.1205 => 3.2129, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.55% (2.8433 => 2.8875, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.3231 => 2.3483, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.01% (6.4680 => 6.5333, std.dev.: 0.0247) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -1.18% (0.1354 => 0.1338, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0419 => 0.0419, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.45% (0.0667 => 0.0670, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 0.04% (494.1007 => 494.3087, std.dev.: 0.1962) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 10.81% (63.2438 => 70.0793, std.dev.: 0.2819) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0419, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43733.35% (1.1277 => 494.3087, std.dev.: 0.1962) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.00% (0.5229 => 1.5373, std.dev.: 0.1020) MultiSource/Applications/SPASS/SPASS: 17.81% (14.9895 => 17.6585, std.dev.: 0.4883) MultiSource/Applications/kimwitu++/kc: 54.98% (14.1553 => 21.9374, std.dev.: 0.1078) MultiSource/Benchmarks/MallocBench/gs/gs: 17.10% (4.1105 => 4.8132, std.dev.: 0.1159) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.81% (1.1048 => 1.5115, std.dev.: 0.0755) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 426.09% (7.1582 => 37.6587, std.dev.: 0.2301) SingleSource/Benchmarks/Misc-C++-EH/spirit: 74.93% (3.4629 => 6.0576, std.dev.: 0.4258) SingleSource/Benchmarks/Misc-C++/stepanov_container: 87.51% (0.6222 => 1.1667, std.dev.: 0.0036) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10418.47% (0.0720 => 7.5733, std.dev.: 0.3549) MultiSource/Applications/SIBsim4/SIBsim4: 3860200.00% (0.0001 => 3.8603, std.dev.: 0.0457) MultiSource/Applications/SPASS/SPASS: 12989300.00% (0.0001 => 12.9894, std.dev.: 1.8128) MultiSource/Applications/kimwitu++/kc: 51700.00% (0.0001 => 0.0518, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576600.00% (0.0001 => 0.5767, std.dev.: 0.0215) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10103500.00% (0.0001 => 10.1036, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6847000.00% (0.0001 => 6.8471, std.dev.: 0.3957) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1777.34% (1.1194 => 21.0149, std.dev.: 0.2900) MultiSource/Applications/ClamAV/clamscan: 65.78% (22.1758 => 36.7623, std.dev.: 0.8452) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 60.88% (2.9384 => 4.7273, std.dev.: 0.2918) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.87% (7.0540 => 11.0655, std.dev.: 0.2623) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 52.89% (8.1363 => 12.4392, std.dev.: 0.1291) MultiSource/Applications/JM/lencod/lencod: 49.16% (21.9371 => 32.7222, std.dev.: 0.1458) MultiSource/Benchmarks/FreeBench/distray/distray: 44.98% (0.1056 => 0.1531, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/almabench: 38.90% (0.0730 => 0.1014, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 38.55% (0.1432 => 0.1984, std.dev.: 0.0055) SingleSource/Benchmarks/Stanford/Oscar: 37.74% (0.0636 => 0.0876, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 36.50% (0.0326 => 0.0445, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 33.01% (0.1236 => 0.1644, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 31.51% (0.1044 => 0.1373, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 30.82% (0.1940 => 0.2538, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 30.26% (0.7115 => 0.9268, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/em3d/em3d: 30.21% (0.1695 => 0.2207, std.dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: 29.91% (0.7433 => 0.9656, std.dev.: 0.0101) SingleSource/UnitTests/ObjC/messages-2: 29.61% (0.0662 => 0.0858, std.dev.: 0.0056) SingleSource/UnitTests/vla: 29.58% (0.0355 => 0.0460, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 28.36% (0.3121 => 0.4006, std.dev.: 0.0096) MultiSource/Applications/aha/aha: 28.32% (0.1151 => 0.1477, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 28.31% (2.2024 => 2.8258, std.dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 27.50% (3.8922 => 4.9627, std.dev.: 0.0220) MultiSource/Benchmarks/Olden/mst/mst: 27.43% (0.1163 => 0.1482, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 27.09% (0.0443 => 0.0563, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 26.59% (1.0722 => 1.3573, std.dev.: 0.0361) SingleSource/Benchmarks/Misc-C++/bigfib: 25.29% (0.6456 => 0.8089, std.dev.: 0.0118) SingleSource/Benchmarks/Stanford/Towers: 24.63% (0.0471 => 0.0587, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.56% (0.8101 => 1.0091, std.dev.: 0.0071) SingleSource/Benchmarks/Dhrystone/dry: 24.12% (0.0456 => 0.0566, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.86% (0.0746 => 0.0924, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 23.42% (0.0491 => 0.0606, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 23.20% (0.1655 => 0.2039, std.dev.: 0.0118) SingleSource/Benchmarks/CoyoteBench/huffbench: 23.08% (0.0871 => 0.1072, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 23.04% (0.1892 => 0.2328, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.99% (0.0648 => 0.0797, std.dev.: 0.0021) MultiSource/Benchmarks/BitBench/five11/five11: 22.40% (0.0567 => 0.0694, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: 22.20% (0.2554 => 0.3121, std.dev.: 0.0207) SingleSource/Benchmarks/Shootout/matrix: 21.76% (0.0818 => 0.0996, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: 21.41% (0.0481 => 0.0584, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.33% (0.1566 => 0.1900, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 20.70% (0.2430 => 0.2933, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.55% (0.0793 => 0.0956, std.dev.: 0.0047) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.52% (0.1584 => 0.1909, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 20.26% (0.1555 => 0.1870, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/tsp/tsp: 20.26% (0.1175 => 0.1413, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 19.96% (14.3668 => 17.2342, std.dev.: 0.3519) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 19.60% (1.5859 => 1.8967, std.dev.: 0.0662) MultiSource/Applications/oggenc/oggenc: 19.16% (5.7591 => 6.8623, std.dev.: 0.1937) MultiSource/Benchmarks/MallocBench/espresso/espresso: 19.05% (4.2646 => 5.0768, std.dev.: 0.1711) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.89% (0.2700 => 0.3210, std.dev.: 0.0195) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.58% (0.1125 => 0.1334, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 18.47% (0.1906 => 0.2258, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/parameter-passing: 18.13% (0.3927 => 0.4639, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.08% (0.9765 => 1.1531, std.dev.: 0.0329) SingleSource/UnitTests/ObjC/property: 17.99% (0.3886 => 0.4585, std.dev.: 0.0105) SingleSource/Regression/C++/ofstream_ctor: 17.97% (0.2905 => 0.3427, std.dev.: 0.0118) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.95% (0.1510 => 0.1781, std.dev.: 0.0099) SingleSource/UnitTests/ObjC/exceptions: 17.95% (0.3828 => 0.4515, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/ary3: 17.61% (0.3283 => 0.3861, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.46% (0.0842 => 0.0989, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary2: 17.43% (0.3379 => 0.3968, std.dev.: 0.0198) SingleSource/Benchmarks/Shootout-C++/except: 17.35% (0.2871 => 0.3369, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ary: 17.33% (0.3232 => 0.3792, std.dev.: 0.0123) SingleSource/Benchmarks/CoyoteBench/fftbench: 17.26% (0.4636 => 0.5436, std.dev.: 0.0019) SingleSource/Benchmarks/Stanford/Puzzle: 17.19% (0.1268 => 0.1486, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-4: 17.08% (0.3543 => 0.4148, std.dev.: 0.0079) SingleSource/UnitTests/ObjC/trivial-interface: 17.07% (0.3473 => 0.4066, std.dev.: 0.0088) SingleSource/UnitTests/ObjC/synchronized: 17.05% (0.3561 => 0.4168, std.dev.: 0.0158) SingleSource/UnitTests/ObjC/for-in: 17.00% (0.3694 => 0.4322, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.93% (0.3543 => 0.4143, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.73% (4.9449 => 5.7721, std.dev.: 0.1757) SingleSource/Benchmarks/Shootout-C++/fibo: 16.66% (0.2725 => 0.3179, std.dev.: 0.0082) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.65% (0.8172 => 0.9533, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout/lists: 16.61% (0.0626 => 0.0730, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.19% (1.5415 => 1.7911, std.dev.: 0.0767) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.19% (0.0834 => 0.0969, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: 15.92% (0.7326 => 0.8492, std.dev.: 0.0252) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.74% (0.0953 => 0.1103, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.71% (0.0770 => 0.0891, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.58% (0.0886 => 0.1024) MultiSource/Applications/lua/lua: 15.31% (3.8723 => 4.4650, std.dev.: 0.0691) MultiSource/Benchmarks/Olden/health/health: 15.30% (0.1268 => 0.1462, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.19% (0.0770 => 0.0887, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/Hello: 14.78% (0.5925 => 0.6801, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.58% (0.1337 => 0.1532, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.50% (0.1117 => 0.1279, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 14.49% (0.6030 => 0.6904, std.dev.: 0.0153) MultiSource/Applications/sqlite3/sqlite3: 14.39% (17.1811 => 19.6529, std.dev.: 0.5059) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.29% (0.0798 => 0.0912, std.dev.: 0.0024) MultiSource/Applications/spiff/spiff: 14.12% (0.7835 => 0.8941, std.dev.: 0.0403) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.11% (0.5981 => 0.6825, std.dev.: 0.0262) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.83% (0.5569 => 0.6339, std.dev.: 0.0260) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.75% (0.3441 => 0.3914, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.61% (0.1029 => 0.1169, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.39% (0.2271 => 0.2575, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.30% (0.5105 => 0.5784, std.dev.: 0.0206) MultiSource/Benchmarks/mafft/pairlocalalign: 13.03% (9.4845 => 10.7207, std.dev.: 0.2227) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.60% (0.1143 => 0.1287, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.55% (5.0018 => 5.5796, std.dev.: 0.2006) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.30% (0.0929 => 0.1034, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: 10.50% (10.3673 => 11.4563, std.dev.: 0.1891) MultiSource/Benchmarks/Olden/power/power: 10.49% (0.1440 => 0.1591, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/rem: 10.23% (0.1144 => 0.1261, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.47% (0.4064 => 0.4449, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.14% (2.0665 => 2.2553, std.dev.: 0.0704) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 149.62% (4.3953 => 10.9716, std.dev.: 0.0241) SingleSource/Benchmarks/Shootout-C++/methcall: 147.43% (5.3999 => 13.3611, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/ft/ft: 29.67% (1.2838 => 1.6647, std.dev.: 0.0239) MultiSource/Applications/minisat/minisat: 27.94% (9.1159 => 11.6630, std.dev.: 0.5534) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 22.49% (13.4384 => 16.4605, std.dev.: 1.1382) SingleSource/Benchmarks/Misc/oourafft: 17.45% (6.6465 => 7.8060, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.65% (1.1145 => 1.3001, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/mst/mst: 15.56% (0.1285 => 0.1485, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.94% (0.2944 => 0.3325, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.88% (2.0360 => 2.2983, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.64% (2.8904 => 3.2269, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 10.95% (3.1578 => 3.5037, std.dev.: 0.0207) SingleSource/Benchmarks/Misc/richards_benchmark: 10.31% (1.1396 => 1.2571, std.dev.: 0.0014) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.49% (1.7254 => 1.8891, std.dev.: 0.0034) MultiSource/Applications/lemon/lemon: 8.37% (1.4460 => 1.5670, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/bh/bh: 8.06% (1.9405 => 2.0970, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.82% (3.1334 => 3.3470, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.51% (4.2280 => 4.4609, std.dev.: 0.0115) SingleSource/Regression/C/uint64_to_float: 5.10% (0.5413 => 0.5689, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.57% (26.0924 => 27.2844, std.dev.: 0.0244) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.41% (3.6395 => 3.7999, std.dev.: 0.0462) MultiSource/Benchmarks/nbench/nbench: 4.25% (11.6436 => 12.1381, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/em3d/em3d: 3.57% (3.1023 => 3.2129, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 2.26% (85.0658 => 86.9846, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 2.09% (3.1595 => 3.2254, std.dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/dry: 2.00% (2.4116 => 2.4599, std.dev.: 0.0072) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.83% (2.1424 => 2.1816, std.dev.: 0.0102) MultiSource/Benchmarks/mafft/pairlocalalign: 1.61% (27.8444 => 28.2940, std.dev.: 0.0214) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.50% (2.3135 => 2.3483, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.39% (6.5088 => 6.5994, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.30% (1.0313 => 1.0447, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0505, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1676, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.74% (5.2763 => 1.2272, std.dev.: 0.0388) SingleSource/Benchmarks/Misc/salsa20: -74.80% (0.8651 => 0.2180, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: -37.36% (0.1622 => 0.1016, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.19% (5.3526 => 4.7000, std.dev.: 0.1072) MultiSource/Applications/JM/ldecod/ldecod: -11.07% (10.4361 => 9.2810, std.dev.: 0.3326) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.49% (5.3855 => 4.9282, std.dev.: 0.0704) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.33% (0.3987 => 0.2379, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.36% (4.5009 => 2.7745, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7636, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.13% (2.6546 => 2.0141, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -19.57% (0.2161 => 0.1738, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -15.80% (1.6925 => 1.4251, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2839, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.74% (32.5116 => 29.0195, std.dev.: 0.0314) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4245, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.36% (3.2416 => 3.0355, std.dev.: 0.0236) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -5.52% (9.5636 => 9.0357, std.dev.: 0.0395) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.72% (1.6805 => 1.6011, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-5: -4.60% (1.5835 => 1.5106, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.55% (19.9488 => 19.0418, std.dev.: 0.2601) SingleSource/Benchmarks/Shootout/lists: -4.51% (6.2999 => 6.0155, std.dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.34% (0.9957 => 0.9624, std.dev.: 0.0102) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8914, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.54% (0.4808 => 0.4686, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.79% (8.1563 => 8.0105, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -1.47% (10.2830 => 10.1322, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.34% (0.2116 => 0.0670, std.dev.: 0.0007) Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 08:19:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 10:19:11 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121121161911.2A32A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6112?compare_to=6109&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6112, Order: 168428, Start Time: 2012-11-21 14:46:01, End Time: 2012-11-21 16:19:37 To: 6109, Order: 168420, Start Time: 2012-11-21 12:12:31, End Time: 2012-11-21 13:42:32 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 14 (54 on baseline) Performance Improvements: 0 (23 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1040 (897 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 21.84% (0.1030 => 0.1255, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.34% (0.8837 => 0.9044, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.74% (0.8226 => 0.8369, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.23% (2.2020 => 2.2290, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/d/make_dparser: 37.53% (0.0381 => 0.0524, std.dev.: 0.0041) MultiSource/Applications/lua/lua: 3.09% (28.8714 => 29.7624, std.dev.: 0.1651) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.85% (13.3184 => 13.6983, std.dev.: 0.0616) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.77% (11.5504 => 11.8704, std.dev.: 0.0925) MultiSource/Applications/sqlite3/sqlite3: 2.20% (4.4614 => 4.5595, std.dev.: 0.0269) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.01% (2.6973 => 2.7515, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.27% (9.6765 => 9.7996, std.dev.: 0.0455) SingleSource/Benchmarks/Shootout/lists: 1.14% (7.4258 => 7.5107, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/methcall: 1.05% (8.9621 => 9.0558, std.dev.: 0.0169) SingleSource/Benchmarks/Misc/pi: 1.00% (2.4818 => 2.5067, std.dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.08% (1.0536 => 1.0650, std.dev.: 0.1926) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 13.68% (0.0190 => 0.0216, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.24% (0.0411 => 0.0412, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 34.43% (0.0244 => 0.0328, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 21.09% (0.0256 => 0.0310, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -16.00% (0.0425 => 0.0357, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0203 => 0.0203, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/test1: 5.91% (0.0203 => 0.0215, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.34% (0.1470 => 0.1475, std.dev.: 0.0279) MultiSource/Applications/lemon/lemon: 0.96% (1.1633 => 1.1745, std.dev.: 0.2430) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.96% (0.4162 => 0.4122, std.dev.: 0.0286) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.61% (0.1415 => 0.1378, std.dev.: 0.0259) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.71% (0.0642 => 0.0631, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 19.89% (0.0186 => 0.0223, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.14% (0.0552 => 0.0608, std.dev.: 0.0123) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.61% (1.1917 => 1.1990, std.dev.: 0.0093) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 60.00% (0.0005 => 0.0008, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -80.00% (0.0005 => 0.0001, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.72% (0.0556 => 0.0560, std.dev.: 0.0149) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.88% (0.0227 => 0.0229, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.71% (0.7735 => 0.7790, std.dev.: 0.0012) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 11.36% (0.0044 => 0.0049, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 6.98% (16.4461 => 17.5943, std.dev.: 1.4141) MultiSource/Applications/sqlite3/sqlite3: 2309.71% (0.6332 => 15.2583, std.dev.: 0.9302) MultiSource/Benchmarks/McCat/08-main/main: 48.66% (0.1831 => 0.2722, std.dev.: 0.0234) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -10.52% (0.1559 => 0.1395, std.dev.: 0.0373) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7043.58% (0.3123 => 22.3094, std.dev.: 0.3603) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.51% (0.2463 => 0.3707, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1540.58% (0.3344 => 5.4861, std.dev.: 0.0513) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.31% (0.2364 => 0.3246, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/bigfib: 4.61% (0.6010 => 0.6287, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/mandel: - (0.0429 => 0.0429, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.81% (0.3266 => 0.3423, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 3.61% (0.1969 => 0.2040, std.dev.: 0.0023) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.45% (0.0224 => 0.0223, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0012) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0479, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 12.38% (0.1462 => 0.1643, std.dev.: 0.0309) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.5595, std.dev.: 0.0269) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0726, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4912, std.dev.: 0.0302) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5111, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5402, std.dev.: 0.3106) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3269, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1356, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3627, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4079, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0872, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: -23.88% (2.1832 => 1.6619, std.dev.: 0.0034) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.91% (0.6010 => 0.6305, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.78% (0.2240 => 0.2347, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 4.19% (0.8927 => 0.9301, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.15% (2.1401 => 2.2290, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.99% (0.8697 => 0.9044, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.50% (0.8086 => 0.8369, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.43% (0.8317 => 0.8602, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.21% (0.9074 => 0.9365, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.18% (0.8340 => 0.8605, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.04% (0.3657 => 0.3768, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.99% (1.5315 => 1.5773, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.93% (0.5191 => 0.5343, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.82% (1.4479 => 1.4888, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.69% (0.6586 => 0.6763, std.dev.: 0.0050) MultiSource/Benchmarks/Bullet/bullet: 2.64% (31.8598 => 32.7008, std.dev.: 0.1924) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.62% (3.1832 => 3.2665, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.54% (0.8518 => 0.8734, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.46% (0.9908 => 1.0152, std.dev.: 0.0066) MultiSource/Benchmarks/PAQ8p/paq8p: 2.41% (2.3764 => 2.4337, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.39% (0.9069 => 0.9286, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.24% (0.8420 => 0.8609, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.12% (0.8069 => 0.8240, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.10% (0.8286 => 0.8460, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.91% (0.7966 => 0.8118, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.78% (0.8855 => 0.9013, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 112.06% (0.0199 => 0.0422, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/pi: 58.70% (1.5795 => 2.5067, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: 36.46% (0.0384 => 0.0524, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 18.11% (0.7597 => 0.8973, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.35% (2.9753 => 3.4619, std.dev.: 0.1245) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.76% (2.7995 => 3.2128, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.64% (5.0261 => 5.6112, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.94% (1.1857 => 1.2798, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/queens: 6.96% (1.7056 => 1.8243, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.63% (4.5327 => 4.8330, std.dev.: 0.0335) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.62% (4.7794 => 5.0960, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.16% (6.3772 => 6.7698, std.dev.: 0.1006) SingleSource/Benchmarks/Misc/richards_benchmark: 6.03% (1.3037 => 1.3823, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.91% (4.9686 => 5.2621, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.14% (3.3761 => 3.5495, std.dev.: 0.0195) MultiSource/Applications/lambda-0_1_3/lambda: 4.73% (7.4933 => 7.8480, std.dev.: 0.0292) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.67% (6.2275 => 6.5183, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.19% (4.9469 => 5.1541, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.12% (4.9453 => 5.1490, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.61% (11.5690 => 11.8704, std.dev.: 0.0925) SingleSource/Benchmarks/Shootout/lists: 2.36% (7.3375 => 7.5107, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.27% (4.8660 => 4.9766, std.dev.: 0.0333) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.24% (8.2783 => 8.4635, std.dev.: 0.0242) SingleSource/Benchmarks/Dhrystone/dry: 2.20% (0.5081 => 0.5193, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.20% (1.1365 => 1.1615, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.19% (4.8362 => 4.9422, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.29% (3.5679 => 3.6141, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.24% (2.4647 => 2.4952, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/power/power: 1.08% (1.2061 => 1.2191, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -30.47% (0.0338 => 0.0235, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/em3d/em3d: -20.73% (5.4641 => 4.3315, std.dev.: 0.3782) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.38% (7.2130 => 6.2481, std.dev.: 0.0376) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.93% (1.0512 => 0.9363, std.dev.: 0.0117) SingleSource/Benchmarks/McGill/chomp: -10.92% (1.1216 => 0.9991, std.dev.: 0.0424) MultiSource/Benchmarks/mafft/pairlocalalign: -8.51% (63.1822 => 57.8076, std.dev.: 0.1097) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.46% (14.6451 => 13.6983, std.dev.: 0.0616) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.46% (4.7482 => 4.4414, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.89% (3.7148 => 3.4960, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.58% (5.4972 => 5.1902, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.60% (5.1557 => 4.9183, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.23% (4.7449 => 4.5442, std.dev.: 0.0421) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.71% (6.0224 => 5.7987, std.dev.: 0.0548) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.63% (2.8773 => 2.7728, std.dev.: 0.0188) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.29% (0.5807 => 0.5616, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (28.5821 => 27.6990, std.dev.: 0.0180) MultiSource/Benchmarks/FreeBench/mason/mason: -2.94% (0.5415 => 0.5256, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.83% (2.6356 => 2.5609, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/hash2: -2.37% (3.4237 => 3.3426, std.dev.: 0.0068) MultiSource/Applications/aha/aha: -2.01% (3.3398 => 3.2728, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.89% (11.5316 => 11.3142, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.40% (4.9994 => 4.9296, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.14% (5.6343 => 5.5701, std.dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.78% (1.0262 => 1.0650, std.dev.: 0.1926) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 75.61% (0.0123 => 0.0216, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.98% (0.0408 => 0.0412, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.13% (0.0254 => 0.0328, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.65% (0.0302 => 0.0310, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.03% (0.0384 => 0.0357, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/test1: 19.44% (0.0180 => 0.0215, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.57% (0.1438 => 0.1475, std.dev.: 0.0279) MultiSource/Applications/lemon/lemon: 3.67% (1.1329 => 1.1745, std.dev.: 0.2430) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.01% (0.4164 => 0.4122, std.dev.: 0.0286) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.66% (0.1369 => 0.1378, std.dev.: 0.0259) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.56% (0.0641 => 0.0631, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 14.36% (0.0195 => 0.0223, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.19% (0.0578 => 0.0608, std.dev.: 0.0123) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.84% (1.1437 => 1.1990, std.dev.: 0.0093) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 700.00% (0.0001 => 0.0008, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.69% (0.0627 => 0.0560, std.dev.: 0.0149) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 27.22% (0.0180 => 0.0229, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.83% (0.8017 => 0.7790, std.dev.: 0.0012) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -20.97% (0.0062 => 0.0049, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 08:22:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 10:22:32 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121121162232.B714E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6113?compare_to=6110&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6113, Order: 168428, Start Time: 2012-11-21 14:49:15, End Time: 2012-11-21 16:22:58 To: 6110, Order: 168420, Start Time: 2012-11-21 12:32:21, End Time: 2012-11-21 14:05:56 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (180 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (858 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.82% (2.0478 => 2.1056, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: 2.48% (7.4937 => 7.6793, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/hash2: 1.89% (3.1932 => 3.2537, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.32% (0.3821 => 0.3503, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -7.03% (0.3357 => 0.3121, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.99% (0.9542 => 0.8875, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.81% (0.3142 => 0.2928, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/oourafft: -6.62% (0.2160 => 0.2017, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -6.59% (2.4924 => 2.3281, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.51% (0.2428 => 0.2270, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.49% (0.9852 => 0.9213, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.37% (0.3880 => 0.3633, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -6.37% (0.3896 => 0.3648, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -6.36% (9.2283 => 8.6417, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/trivial-interface: -6.35% (0.3812 => 0.3570, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.34% (0.3831 => 0.3588, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.34% (0.3848 => 0.3604, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -6.30% (0.4033 => 0.3779, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.28% (0.6484 => 0.6077, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.27% (0.7198 => 0.6747, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: -6.20% (0.4176 => 0.3917, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.17% (0.3891 => 0.3651, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -6.17% (16.1920 => 15.1937, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.16% (0.5863 => 0.5502, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.13% (1.0544 => 0.9898, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -6.08% (0.9179 => 0.8621, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.08% (3.5339 => 3.3191, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -6.08% (0.1761 => 0.1654, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -6.07% (7.0961 => 6.6652, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.04% (0.3658 => 0.3437, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.03% (0.2355 => 0.2213, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.02% (0.5478 => 0.5148, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.01% (0.5805 => 0.5456, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.01% (0.5857 => 0.5505, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.00% (1.3722 => 1.2898, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -6.00% (0.5849 => 0.5498, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.96% (0.5705 => 0.5365, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -5.95% (0.4199 => 0.3949, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.95% (0.6052 => 0.5692, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.95% (0.6660 => 0.6264, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.94% (0.5591 => 0.5259, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.92% (0.6667 => 0.6272, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.92% (0.5859 => 0.5512, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.91% (0.6297 => 0.5925, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.91% (0.5925 => 0.5575, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.90% (0.2695 => 0.2536, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.89% (0.6230 => 0.5863, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -5.88% (1.1450 => 1.0777, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.87% (1.2300 => 1.1578, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.87% (4.8161 => 4.5336, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.86% (0.5581 => 0.5254, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.86% (4.0323 => 3.7962, std.dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.85% (6.7716 => 6.3752, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.85% (0.5575 => 0.5249, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.84% (0.3884 => 0.3657, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.82% (0.6189 => 0.5829, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: -5.81% (4.3330 => 4.0811, std.dev.: 0.0054) MultiSource/Benchmarks/sim/sim: -5.81% (0.3406 => 0.3208, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.81% (0.5802 => 0.5465, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.80% (0.6194 => 0.5835, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: -5.78% (1.1530 => 1.0863, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.77% (0.5456 => 0.5141, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.77% (1.4642 => 1.3797, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.77% (0.6260 => 0.5899, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.76% (0.6304 => 0.5941, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.76% (0.6446 => 0.6075, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.75% (0.7919 => 0.7464, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.75% (0.5570 => 0.5250, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.72% (0.5941 => 0.5601, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.72% (0.6293 => 0.5933, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.72% (0.6736 => 0.6351, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -5.71% (0.4515 => 0.4257, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -5.70% (0.4280 => 0.4036, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -5.65% (1.2515 => 1.1808, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.63% (0.5688 => 0.5368, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.59% (4.8802 => 4.6074, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.59% (4.5069 => 4.2551, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.57% (0.6681 => 0.6309, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.57% (1.6364 => 1.5453, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.56% (1.2784 => 1.2073, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.56% (0.6676 => 0.6305, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -5.53% (0.2985 => 0.2820, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.51% (0.6440 => 0.6085, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.50% (0.6033 => 0.5701, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.49% (0.2548 => 0.2408, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.46% (0.3483 => 0.3293, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -5.45% (0.2659 => 0.2514, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -5.44% (17.1032 => 16.1735, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.43% (0.8521 => 0.8058, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.40% (0.2278 => 0.2155, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.35% (0.5999 => 0.5678, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -5.34% (15.5079 => 14.6801, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.34% (0.2999 => 0.2839, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: -5.33% (0.3581 => 0.3390, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.33% (1.6474 => 1.5596, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.33% (0.4916 => 0.4654, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: -5.31% (1.3864 => 1.3128, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.29% (14.2083 => 13.4561, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.22% (0.7339 => 0.6956, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.22% (1.2210 => 1.1573, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.21% (0.3319 => 0.3146, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.19% (0.5168 => 0.4900, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -5.17% (3.5154 => 3.3336, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.16% (1.2221 => 1.1590, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.15% (8.0126 => 7.6003, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.14% (0.6395 => 0.6066, std.dev.: 0.0048) MultiSource/Applications/lua/lua: -5.10% (4.0594 => 3.8524, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: -5.02% (0.7447 => 0.7073, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.01% (0.7524 => 0.7147, std.dev.: 0.0069) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.00% (22.4056 => 21.2864, std.dev.: 0.0152) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.99% (0.2385 => 0.2266, std.dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: -4.98% (15.2527 => 14.4928, std.dev.: 0.0190) MultiSource/Applications/siod/siod: -4.97% (2.4021 => 2.2827, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: -4.97% (1.3148 => 1.2495, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.96% (0.5567 => 0.5291, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/fibo: -4.95% (0.2871 => 0.2729, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.94% (0.3057 => 0.2906, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.91% (0.3323 => 0.3160, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.89% (0.6395 => 0.6082, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.89% (0.4151 => 0.3948, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.89% (0.7021 => 0.6678, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.86% (0.4321 => 0.4111, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.84% (0.5329 => 0.5071, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -4.83% (0.3025 => 0.2879, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -4.82% (0.2989 => 0.2845, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.81% (0.3931 => 0.3742, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary: -4.80% (0.3394 => 0.3231, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -4.80% (0.2939 => 0.2798, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.79% (0.2903 => 0.2764, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.78% (0.5569 => 0.5303, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.77% (0.2933 => 0.2793, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -4.76% (0.3194 => 0.3042, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -4.70% (0.3446 => 0.3284, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -4.68% (0.4248 => 0.4049, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -4.67% (0.3255 => 0.3103, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -4.65% (0.3481 => 0.3319, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -4.64% (2.1401 => 2.0407, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.64% (0.3252 => 0.3101, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -4.63% (0.2849 => 0.2717, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.59% (0.4813 => 0.4592, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.59% (2.2587 => 2.1550, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: -4.59% (0.3271 => 0.3121, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.58% (0.3016 => 0.2878, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -4.57% (0.7982 => 0.7617, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.56% (0.3837 => 0.3662, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -4.56% (0.3621 => 0.3456, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.54% (2.1713 => 2.0727, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: -4.53% (0.4861 => 0.4641, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -4.52% (5.0226 => 4.7957, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: -4.51% (0.6347 => 0.6061, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.49% (0.3849 => 0.3676, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: -4.49% (0.6441 => 0.6152, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -4.47% (18.2933 => 17.4765, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/wc: -4.46% (0.3205 => 0.3062, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.41% (0.9557 => 0.9136, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: -4.40% (0.3867 => 0.3697, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -4.36% (0.3026 => 0.2894, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.35% (0.9077 => 0.8682, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.31% (0.4083 => 0.3907, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.30% (0.8418 => 0.8056, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: -4.28% (0.7779 => 0.7446, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -4.27% (34.0927 => 32.6377, std.dev.: 0.0221) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.15% (0.3491 => 0.3346, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.11% (0.4427 => 0.4245, std.dev.: 0.0022) SingleSource/Regression/C++/ofstream_ctor: -3.99% (0.3059 => 0.2937, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -3.85% (0.6750 => 0.6490, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: -3.80% (0.4524 => 0.4352, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -3.80% (0.3788 => 0.3644, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.51% (5.4682 => 5.2763, std.dev.: 0.0048) MultiSource/Applications/hbd/hbd: -3.43% (1.5610 => 1.5074, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -2.27% (20.7746 => 20.3030, std.dev.: 0.0291) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7551, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -8.74% (1.2842 => 1.1719, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1740, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7067, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4714, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.38% (1.3096 => 1.2915, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 09:20:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 11:20:42 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121121172042.46F982A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6114?compare_to=6108&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6114, Order: 168420, Start Time: 2012-11-21 14:00:32, End Time: 2012-11-21 17:21:07 To: 6108, Order: 168418, Start Time: 2012-11-21 09:51:28, End Time: 2012-11-21 13:12:30 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (171 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1092 (719 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 45.44% (0.0625 => 0.0909, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.81% (0.1063 => 0.1433, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.03% (0.0714 => 0.0907) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.40% (0.1106 => 0.1398, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.24% (0.2969 => 0.3748, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 26.22% (1.5932 => 2.0110, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.44% (0.4139 => 0.5192, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.27% (0.4253 => 0.5285, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.05% (0.4994 => 0.6195, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.92% (0.5000 => 0.6196, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.58% (0.0475 => 0.0587, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.40% (0.0547 => 0.0675, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.32% (0.5900 => 0.7276, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.29% (0.0584 => 0.0720, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.49% (0.1107 => 0.1356, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.35% (0.1620 => 0.1982, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.33% (0.1021 => 0.1249, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 22.20% (0.0599 => 0.0732, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.19% (0.0897 => 0.1096, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.17% (0.0633 => 0.0767, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.06% (0.0584 => 0.0707, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.94% (0.1103 => 0.1334, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 20.89% (0.0948 => 0.1146, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.72% (0.0642 => 0.0775, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.70% (0.3903 => 0.4711, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/health/health: 20.58% (0.0821 => 0.0990, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.44% (0.1003 => 0.1208, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.44% (0.0822 => 0.0990, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.40% (0.0495 => 0.0596, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.27% (0.1549 => 0.1863, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 20.20% (0.1619 => 0.1946, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.07% (0.1604 => 0.1926, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 20.03% (0.0604 => 0.0725, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 19.43% (0.0947 => 0.1131, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.36% (0.1462 => 0.1745, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 19.18% (0.0808 => 0.0963, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.07% (0.3890 => 0.4632, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.82% (0.2014 => 0.2393, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 18.64% (0.1218 => 0.1445, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.57% (1.3152 => 1.5594, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.24% (0.2736 => 0.3235, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.20% (0.1088 => 0.1286, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 18.19% (0.4029 => 0.4762, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 18.13% (0.5826 => 0.6882, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 18.01% (0.1505 => 0.1776) MultiSource/Benchmarks/Olden/mst/mst: 17.91% (0.0698 => 0.0823, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 17.85% (0.5889 => 0.6940, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.69% (0.0605 => 0.0712, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.62% (0.2866 => 0.3371, std.dev.: 0.0039) MultiSource/Applications/Burg/burg: 17.62% (0.5546 => 0.6523, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.51% (3.5627 => 4.1867, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.28% (0.1968 => 0.2308, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.20% (1.6211 => 1.8999, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 17.14% (1.8794 => 2.2015, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.13% (0.4658 => 0.5456, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 16.99% (1.0781 => 1.2613, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.90% (0.2875 => 0.3361, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.90% (0.1160 => 0.1356, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.85% (0.3271 => 0.3822, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 16.54% (0.1421 => 0.1656, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.51% (0.4361 => 0.5081, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 16.44% (0.2780 => 0.3237, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.34% (0.3930 => 0.4572, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 16.32% (0.9697 => 1.1280, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.29% (2.7292 => 3.1738, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 16.28% (0.3004 => 0.3493, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.28% (0.5026 => 0.5844, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 16.26% (0.2811 => 0.3268, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 16.22% (0.2750 => 0.3196, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.22% (0.2738 => 0.3182, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 16.19% (0.2823 => 0.3280, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 16.18% (0.2725 => 0.3166, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 16.18% (0.2714 => 0.3153, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 16.11% (0.9909 => 1.1505, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.09% (0.2729 => 0.3168, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.08% (0.2792 => 0.3241, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 16.07% (0.2813 => 0.3265, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.06% (4.4195 => 5.1293, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.06% (0.1090 => 0.1265, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 16.04% (0.1284 => 0.1490, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 15.97% (4.2109 => 4.8832, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.91% (0.2911 => 0.3374, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 15.84% (0.2803 => 0.3247, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.77% (0.3195 => 0.3699, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 15.77% (0.7171 => 0.8302, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.70% (1.9966 => 2.3100, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.67% (2.0673 => 2.3913, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/wc: 15.67% (0.3096 => 0.3581, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.60% (1.9694 => 2.2766, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 15.49% (0.3267 => 0.3773, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 15.33% (0.2075 => 0.2393, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 15.25% (0.3258 => 0.3755, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.13% (0.3060 => 0.3523, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 15.04% (0.3465 => 0.3986, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 15.03% (0.3446 => 0.3964, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 14.98% (0.3317 => 0.3814, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 14.98% (23.5202 => 27.0427, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/exceptions-3: 14.91% (0.3460 => 0.3976, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.91% (0.3488 => 0.4008, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 14.90% (0.3496 => 0.4017, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 14.89% (0.2566 => 0.2948, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 14.87% (0.3469 => 0.3985, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.85% (0.3442 => 0.3953, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.82% (0.3124 => 0.3587, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 14.81% (0.3348 => 0.3844, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.72% (0.3362 => 0.3857, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 14.58% (1.4269 => 1.6349, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions: 14.58% (0.3643 => 0.4174, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/moments: 14.57% (0.3678 => 0.4214, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 14.55% (0.3650 => 0.4181, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.50% (0.3282 => 0.3758, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 14.38% (0.3477 => 0.3977, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sieve: 14.33% (0.3726 => 0.4260, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 14.23% (0.3724 => 0.4254, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.18% (0.3625 => 0.4139, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/hash: 13.99% (0.4146 => 0.4726, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 13.98% (0.7875 => 0.8976, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.89% (0.3981 => 0.4534, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 13.86% (0.4251 => 0.4840, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.85% (0.3690 => 0.4201, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 13.84% (2.1653 => 2.4650, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 13.83% (4.6177 => 5.2564, std.dev.: 0.0121) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.73% (0.3845 => 0.4373, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 13.72% (0.0758 => 0.0862, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 13.43% (2.1013 => 2.3835, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.28% (0.2040 => 0.2311, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 13.13% (0.5012 => 0.5670, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 12.93% (0.2691 => 0.3039, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 12.37% (5.5417 => 6.2270, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.28% (0.6435 => 0.7225, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.86% (0.1383 => 0.1547, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.58% (0.1028 => 0.1147, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.46% (0.2068 => 0.2305, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 11.35% (0.3498 => 0.3895, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.33% (0.2737 => 0.3047, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 11.14% (0.4847 => 0.5387, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.93% (0.6634 => 0.7359, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.93% (0.3084 => 0.3421, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.46% (0.3336 => 0.3685, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 10.45% (2.0346 => 2.2472, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.37% (0.2103 => 0.2321, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 10.25% (0.2391 => 0.2636, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.59% (0.5361 => 0.5875, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.13% (4.6926 => 5.1208, std.dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.73% (11.6398 => 12.6555, std.dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.67% (0.7426 => 0.8070, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.51% (0.5584 => 0.6059, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 7.17% (11.9555 => 12.8124, std.dev.: 0.0112) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 8.78% (0.2802 => 0.3048, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6086, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.23% (12.0509 => 12.6816, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-2: 4.80% (1.8057 => 1.8924, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1680, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: 4.27% (14.0481 => 14.6474, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.38% (0.3693 => 0.3818, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2047, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.61% (3.1722 => 3.2233, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2895, std.dev.: 0.0029) MultiSource/Applications/viterbi/viterbi: 1.44% (46.6247 => 47.2973, std.dev.: 0.0052) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5149, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5853, std.dev.: 0.0180) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.27% (2.4764 => 2.3954, std.dev.: 0.0233) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.72% (25.4195 => 16.5940, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9770, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7977, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ary2: -7.49% (0.2402 => 0.2222, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.54% (11.2080 => 10.8112, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0055) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7742, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8613, std.dev.: 0.0109) SingleSource/Benchmarks/Dhrystone/fldry: -2.06% (17.2379 => 16.8834, std.dev.: 0.0297) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.69% (10.7630 => 10.5810, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4964, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.10% (105.3826 => 104.2239, std.dev.: 0.0519) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0433, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 09:44:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 11:44:01 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121121174401.D5FFD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6115?compare_to=6111&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6115, Order: 168428, Start Time: 2012-11-21 15:24:12, End Time: 2012-11-21 17:44:27 To: 6111, Order: 168420, Start Time: 2012-11-21 12:11:27, End Time: 2012-11-21 14:31:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 10 (105 on baseline) Performance Improvements: 3 (40 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1073 (740 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/life/life: 11.34% (0.1049 => 0.1168, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.84% (0.6412 => 0.7043, std.dev.: 0.0165) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.63% (6.0576 => 6.6407, std.dev.: 0.1788) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.11% (0.6682 => 0.7291, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.01% (0.6171 => 0.6727, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.81% (0.6686 => 0.7275, std.dev.: 0.0211) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.70% (0.4191 => 0.4472, std.dev.: 0.0106) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/JM/lencod/lencod: 5.76% (7.5733 => 8.0098, std.dev.: 0.1584) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.97% (4.2365 => 4.3198, std.dev.: 0.0241) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.91% (19.0418 => 19.4046, std.dev.: 0.0806) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: -5.67% (0.2538 => 0.2394, std.dev.: 0.0049) MultiSource/Applications/kimwitu++/kc: -2.84% (21.9374 => 21.3138, std.dev.: 0.1622) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/NPB-serial/is/is: -3.17% (9.0357 => 8.7492, std.dev.: 0.0909) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -1.09% (70.0793 => 69.3122, std.dev.: 0.4450) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1338 => 0.1338, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0419 => 0.0419, std.dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.69% (0.0670 => 0.0652, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 0.02% (494.3087 => 494.3964, std.dev.: 0.0724) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.60% (63.2438 => 69.3122, std.dev.: 0.4450) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0419, std.dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43741.13% (1.1277 => 494.3964, std.dev.: 0.0724) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 193.46% (0.5229 => 1.5345, std.dev.: 0.0946) MultiSource/Applications/SPASS/SPASS: 18.49% (14.9895 => 17.7604, std.dev.: 0.4473) MultiSource/Applications/kimwitu++/kc: 50.57% (14.1553 => 21.3138, std.dev.: 0.1622) MultiSource/Benchmarks/MallocBench/gs/gs: 18.06% (4.1105 => 4.8528, std.dev.: 0.1642) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 39.51% (1.1048 => 1.5413, std.dev.: 0.0586) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 423.46% (7.1582 => 37.4701, std.dev.: 0.6909) SingleSource/Benchmarks/Misc-C++-EH/spirit: 91.77% (3.4629 => 6.6407, std.dev.: 0.1788) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.54% (0.6222 => 1.0300, std.dev.: 0.0789) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11024.72% (0.0720 => 8.0098, std.dev.: 0.1584) MultiSource/Applications/SIBsim4/SIBsim4: 3860100.00% (0.0001 => 3.8602, std.dev.: 0.0315) MultiSource/Applications/SPASS/SPASS: 13157200.00% (0.0001 => 13.1573, std.dev.: 1.9439) MultiSource/Applications/kimwitu++/kc: 51900.00% (0.0001 => 0.0520, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576500.00% (0.0001 => 0.5766, std.dev.: 0.0213) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10077800.00% (0.0001 => 10.0779, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6179600.00% (0.0001 => 6.1797, std.dev.: 0.6095) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1747.83% (1.1194 => 20.6846, std.dev.: 0.5019) MultiSource/Applications/ClamAV/clamscan: 67.12% (22.1758 => 37.0594, std.dev.: 0.8073) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.71% (2.9384 => 4.6047, std.dev.: 0.3499) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.98% (7.0540 => 10.9320, std.dev.: 0.3437) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 51.60% (8.1363 => 12.3348, std.dev.: 0.1697) MultiSource/Applications/JM/lencod/lencod: 48.64% (21.9371 => 32.6063, std.dev.: 0.1851) MultiSource/Benchmarks/FreeBench/distray/distray: 44.98% (0.1056 => 0.1531, std.dev.: 0.0093) SingleSource/Benchmarks/CoyoteBench/almabench: 37.95% (0.0730 => 0.1007, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 37.71% (0.1432 => 0.1972, std.dev.: 0.0100) SingleSource/UnitTests/vla: 29.30% (0.0355 => 0.0459, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 28.72% (0.0672 => 0.0865, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: 28.66% (0.7115 => 0.9154, std.dev.: 0.0114) MultiSource/Applications/lemon/lemon: 26.92% (1.0722 => 1.3608, std.dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 26.70% (0.0528 => 0.0669, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 26.53% (0.3121 => 0.3949, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/tsp/tsp: 25.87% (0.1175 => 0.1479, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/family/family: 25.44% (0.0397 => 0.0498, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/life/life: 25.19% (0.0933 => 0.1168, std.dev.: 0.0017) MultiSource/Applications/aha/aha: 24.33% (0.1151 => 0.1431, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.86% (0.0746 => 0.0924, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 23.70% (0.0443 => 0.0548, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.40% (0.1940 => 0.2394, std.dev.: 0.0049) SingleSource/Benchmarks/Stanford/Oscar: 23.27% (0.0636 => 0.0784, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 23.05% (2.2024 => 2.7100, std.dev.: 0.0646) MultiSource/Applications/lambda-0_1_3/lambda: 22.80% (0.7433 => 0.9128, std.dev.: 0.0363) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 22.61% (0.0491 => 0.0602, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/hash: 22.47% (0.0485 => 0.0594, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/mst/mst: 22.18% (0.1163 => 0.1421, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 22.16% (0.8101 => 0.9896, std.dev.: 0.0147) MultiSource/Benchmarks/McCat/08-main/main: 21.93% (0.2554 => 0.3114, std.dev.: 0.0184) MultiSource/Benchmarks/BitBench/five11/five11: 21.87% (0.0567 => 0.0691, std.dev.: 0.0042) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.39% (0.1566 => 0.1901, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.33% (0.0886 => 0.1075, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 20.83% (0.0648 => 0.0783, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 20.32% (0.5020 => 0.6040, std.dev.: 0.0237) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.20% (0.1584 => 0.1904, std.dev.: 0.0117) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.18% (0.0793 => 0.0953, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.07% (0.4615 => 0.5541, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/hash: 19.42% (0.4289 => 0.5122, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 19.14% (14.3668 => 17.1169, std.dev.: 0.4052) MultiSource/Applications/Burg/burg: 18.97% (1.1642 => 1.3851, std.dev.: 0.0538) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.93% (0.2700 => 0.3211, std.dev.: 0.0186) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.58% (0.1125 => 0.1334, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.21% (0.2065 => 0.2441, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/bisort/bisort: 18.08% (0.0614 => 0.0725, std.dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: 18.00% (5.7591 => 6.7955, std.dev.: 0.2300) SingleSource/Benchmarks/CoyoteBench/lpbench: 17.01% (0.0929 => 0.1087, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.99% (0.9765 => 1.1424, std.dev.: 0.0366) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.91% (0.0834 => 0.0975, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary2: 16.75% (0.3379 => 0.3945, std.dev.: 0.0092) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.65% (0.8172 => 0.9533, std.dev.: 0.0378) SingleSource/Benchmarks/Shootout-C++/ary3: 16.63% (0.3283 => 0.3829, std.dev.: 0.0116) MultiSource/Applications/lua/lua: 16.44% (3.8723 => 4.5090, std.dev.: 0.1228) MultiSource/Benchmarks/Olden/em3d/em3d: 15.99% (0.1695 => 0.1966, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 15.88% (0.2430 => 0.2816, std.dev.: 0.0064) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.84% (0.0953 => 0.1104, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/matrix: 15.77% (0.0818 => 0.0947, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.94% (0.0770 => 0.0885, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.92% (4.9449 => 5.6828, std.dev.: 0.2101) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.90% (0.2758 => 0.3169, std.dev.: 0.0135) MultiSource/Applications/viterbi/viterbi: 14.79% (0.1555 => 0.1785, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.68% (0.1117 => 0.1281, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 14.53% (9.4845 => 10.8629, std.dev.: 0.3582) SingleSource/UnitTests/ObjC++/property-reference: 14.50% (0.7326 => 0.8388, std.dev.: 0.0231) MultiSource/Applications/sqlite3/sqlite3: 14.25% (17.1811 => 19.6295, std.dev.: 0.4336) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.09% (0.1029 => 0.1174, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.91% (0.5981 => 0.6813, std.dev.: 0.0279) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.90% (0.5569 => 0.6343, std.dev.: 0.0280) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.65% (0.3935 => 0.4472, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.46% (0.3441 => 0.3904, std.dev.: 0.0176) SingleSource/UnitTests/ObjC/trivial-interface: 11.72% (0.3473 => 0.3880, std.dev.: 0.0153) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.59% (5.0018 => 5.5815, std.dev.: 0.2042) SingleSource/UnitTests/ObjC/exceptions-3: 11.52% (0.3516 => 0.3921, std.dev.: 0.0153) SingleSource/UnitTests/ObjC++/property-reference-object: 10.12% (0.6030 => 0.6640, std.dev.: 0.0236) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.16% (2.2022 => 2.3818, std.dev.: 0.0658) MultiSource/Benchmarks/Olden/power/power: 7.43% (0.1440 => 0.1547, std.dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: 7.09% (10.3673 => 11.1025, std.dev.: 0.2245) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.47% (4.3953 => 11.0090, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/methcall: 147.43% (5.3999 => 13.3612, std.dev.: 0.0126) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.76% (1.2838 => 1.5247, std.dev.: 0.0850) SingleSource/Benchmarks/Misc/oourafft: 17.52% (6.6465 => 7.8112, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.69% (1.1145 => 1.3005, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.18% (0.2944 => 0.3332, std.dev.: 0.0132) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.58% (2.8904 => 3.2251, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: 10.21% (1.1396 => 1.2559, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.30% (1.7254 => 1.8859, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.77% (4.2280 => 4.4718, std.dev.: 0.0039) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 4.79% (26.0924 => 27.3428, std.dev.: 0.2545) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.6436 => 12.1315, std.dev.: 0.0127) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.34% (0.4162 => 0.4301, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 2.46% (3.1023 => 3.1787, std.dev.: 0.0182) SingleSource/Benchmarks/Dhrystone/dry: 2.28% (2.4116 => 2.4665, std.dev.: 0.0089) MultiSource/Benchmarks/PAQ8p/paq8p: 2.23% (85.0658 => 86.9612, std.dev.: 0.0148) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 2.08% (3.1595 => 3.2253, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.85% (2.1424 => 2.1821, std.dev.: 0.0151) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (27.8444 => 28.3052, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.49% (6.5088 => 6.6059, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/sieve: 1.31% (5.2139 => 5.2824, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.26% (1.0313 => 1.0443, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0502, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1674, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.83% (5.2763 => 1.2224, std.dev.: 0.0535) SingleSource/Benchmarks/Misc/salsa20: -75.12% (0.8651 => 0.2152, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: -45.01% (0.1622 => 0.0892, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -11.95% (0.1330 => 0.1171, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.76% (5.3855 => 4.7522, std.dev.: 0.1294) MultiSource/Applications/JM/ldecod/ldecod: -11.50% (10.4361 => 9.2359, std.dev.: 0.2736) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.66% (5.3526 => 4.8357, std.dev.: 0.1065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.20% (0.0628 => 0.0363, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.36% (0.3987 => 0.2378, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.37% (4.5009 => 2.7740, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.12% (2.6546 => 2.0143, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -19.30% (0.2161 => 0.1744, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -16.02% (1.6925 => 1.4214, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2840, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.75% (32.5116 => 29.0152, std.dev.: 0.0292) SingleSource/Benchmarks/Misc/mandel-2: -10.65% (1.5373 => 1.3736, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4245, std.dev.: 0.0048) MultiSource/Benchmarks/NPB-serial/is/is: -8.52% (9.5636 => 8.7492, std.dev.: 0.0909) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.13% (1.6805 => 1.5438, std.dev.: 0.0525) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.45% (3.2416 => 3.0326, std.dev.: 0.0246) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.60% (2.7294 => 2.5766, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5079, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/lists: -4.41% (6.2999 => 6.0218, std.dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.33% (0.9957 => 0.9625, std.dev.: 0.0088) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8919, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.73% (19.9488 => 19.4046, std.dev.: 0.0806) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.31% (0.4808 => 0.4697, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6769, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.76% (8.1563 => 8.0129, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/salsa20: -1.51% (10.2830 => 10.1282, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0015) Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 10:12:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 12:12:37 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121121181237.D22D62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6116?compare_to=6112&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6116, Order: 168431, Start Time: 2012-11-21 16:36:46, End Time: 2012-11-21 18:13:02 To: 6112, Order: 168428, Start Time: 2012-11-21 14:46:01, End Time: 2012-11-21 16:19:37 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 28 (73 on baseline) Performance Improvements: 3 (21 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1023 (880 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/flops-2: 77.26% (0.0277 => 0.0491, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 66.37% (0.0446 => 0.0742, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/Oscar: 64.95% (0.0622 => 0.1026, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/heapsort: 55.25% (0.0400 => 0.0621, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 17.59% (0.1944 => 0.2286, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.58% (0.1797 => 0.2023, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.98% (2.2290 => 2.3178, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 3.21% (15.2583 => 15.7487, std.dev.: 0.1251) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.98% (0.8881 => 0.9057, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.91% (0.6763 => 0.6892, std.dev.: 0.0040) MultiSource/Applications/lua/lua: 1.75% (3.9296 => 3.9982, std.dev.: 0.0254) MultiSource/Applications/hexxagon/hexxagon: 1.61% (0.9981 => 1.0142, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 97.95% (0.0195 => 0.0386, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/heapsort: 57.72% (3.0497 => 4.8099, std.dev.: 0.1363) SingleSource/Benchmarks/Shootout-C++/heapsort: 55.82% (3.1476 => 4.9047, std.dev.: 0.0390) SingleSource/Benchmarks/Shootout-C++/moments: 23.61% (0.1004 => 0.1241, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 19.36% (3.5540 => 4.2421, std.dev.: 0.1588) SingleSource/Benchmarks/CoyoteBench/lpbench: 17.50% (3.9618 => 4.6550, std.dev.: 0.2435) SingleSource/Benchmarks/Shootout/strcat: 17.00% (0.1582 => 0.1851, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.52% (0.0723 => 0.0828, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/ary3: 9.05% (2.0918 => 2.2812, std.dev.: 0.0602) SingleSource/Benchmarks/Shootout-C++/ary3: 7.23% (2.0024 => 2.1471, std.dev.: 0.0269) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 7.20% (2.3031 => 2.4690, std.dev.: 0.0248) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.45% (0.5946 => 0.6151, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 3.29% (1.8243 => 1.8844, std.dev.: 0.0122) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.62% (0.3970 => 0.4074, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.84% (0.6043 => 0.6154, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.19% (5.8411 => 5.9109, std.dev.: 0.0162) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/d/make_dparser: -25.19% (0.0524 => 0.0392, std.dev.: 0.0047) MultiSource/Applications/lua/lua: -2.51% (29.7624 => 29.0139, std.dev.: 0.0556) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.38% (1.2906 => 1.2728, std.dev.: 0.0044) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.25% (1.0650 => 1.0623, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.85% (0.0216 => 0.0220, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.61% (0.0412 => 0.0431, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 2.44% (0.0328 => 0.0336, std.dev.: 0.0086) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.58% (0.0310 => 0.0318, std.dev.: 0.0093) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 24.65% (0.0357 => 0.0445, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0203 => 0.0204, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/test1: 6.98% (0.0215 => 0.0230, std.dev.: 0.0057) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.75% (0.1475 => 0.1486, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 5.59% (1.1745 => 1.2402, std.dev.: 0.0326) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.99% (0.4122 => 0.4204, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.47% (0.1378 => 0.1412, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.81% (0.0631 => 0.0674, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 19.73% (0.0223 => 0.0267, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.05% (0.0608 => 0.0553, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.15% (1.1990 => 1.1972, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 137.50% (0.0008 => 0.0019, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.71% (0.0560 => 0.0592, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.37% (0.0229 => 0.0239, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.27% (0.7790 => 0.7811, std.dev.: 0.2028) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 79.59% (0.0049 => 0.0088, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 6.97% (16.4461 => 17.5922, std.dev.: 0.6277) MultiSource/Applications/sqlite3/sqlite3: 2387.16% (0.6332 => 15.7487, std.dev.: 0.1251) MultiSource/Benchmarks/McCat/08-main/main: 47.90% (0.1831 => 0.2708, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.74% (0.1559 => 0.1454, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7188.22% (0.3123 => 22.7611, std.dev.: 1.0109) SingleSource/Benchmarks/CoyoteBench/fftbench: 53.19% (0.2463 => 0.3773, std.dev.: 0.1150) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1546.80% (0.3344 => 5.5069, std.dev.: 0.2695) SingleSource/Benchmarks/Misc-C++/Large/ray: 44.42% (0.2364 => 0.3414, std.dev.: 0.0891) SingleSource/Benchmarks/Misc-C++/bigfib: 6.61% (0.6010 => 0.6407, std.dev.: 0.1123) SingleSource/Benchmarks/Misc/mandel: 12.82% (0.0429 => 0.0484, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.51% (0.3266 => 0.3544, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/strcat: 11.17% (0.1969 => 0.2189, std.dev.: 0.0306) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 9.82% (0.0224 => 0.0246, std.dev.: 0.0065) SingleSource/UnitTests/byval-alignment: -23.48% (0.0230 => 0.0176, std.dev.: 0.0019) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0521, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 12.04% (0.1462 => 0.1638, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4872, std.dev.: 0.0386) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0733, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4952, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5118, std.dev.: 0.0180) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.8323, std.dev.: 0.2132) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3310, std.dev.: 0.0281) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1361, std.dev.: 0.0487) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3665, std.dev.: 0.0186) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4072, std.dev.: 0.0630) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0909, std.dev.: 0.0267) SingleSource/Regression/C/uint64_to_float: -24.05% (2.1832 => 1.6582, std.dev.: 0.0332) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0008, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/flops-2: 78.55% (0.0275 => 0.0491, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 69.41% (0.0438 => 0.0742, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/Oscar: 66.83% (0.0615 => 0.1026, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/heapsort: 56.42% (0.0397 => 0.0621, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.79% (0.0810 => 0.0946, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 15.11% (0.1112 => 0.1280, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.82% (0.0830 => 0.0953, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.30% (2.1401 => 2.3178, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.17% (0.2180 => 0.2358, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.32% (0.1885 => 0.2023, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.17% (0.2133 => 0.2286, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/em3d/em3d: 7.15% (0.1721 => 0.1844, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.93% (0.2279 => 0.2437, std.dev.: 0.0058) MultiSource/Applications/sgefa/sgefa: 6.77% (0.2999 => 0.3202, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.14% (3.1832 => 3.3788, std.dev.: 0.0654) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.18% (0.8611 => 0.9057, std.dev.: 0.0031) MultiSource/Applications/lua/lua: 4.70% (3.8189 => 3.9982, std.dev.: 0.0254) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.65% (0.6586 => 0.6892, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.45% (0.4783 => 0.4996, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.93% (0.3717 => 0.3863, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.78% (0.8338 => 0.8653, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 3.76% (8.6247 => 8.9489, std.dev.: 0.1194) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 3.75% (0.8885 => 0.9218, std.dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: 3.38% (0.9810 => 1.0142, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.25% (0.8457 => 0.8732, std.dev.: 0.0082) MultiSource/Applications/lemon/lemon: 3.24% (1.0945 => 1.1300, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.19% (0.9056 => 0.9345, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.08% (0.8007 => 0.8254, std.dev.: 0.0072) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.89% (6.6074 => 6.7982, std.dev.: 0.0394) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.42% (1.2423 => 1.2600, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 113.57% (0.0199 => 0.0425, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary: 76.26% (0.0219 => 0.0386, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: 60.73% (3.0515 => 4.9047, std.dev.: 0.0390) SingleSource/Benchmarks/Misc/pi: 57.76% (1.5795 => 2.4918, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout/heapsort: 46.08% (3.2926 => 4.8099, std.dev.: 0.1363) SingleSource/Benchmarks/Shootout-C++/moments: 30.77% (0.0949 => 0.1241, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/strcat: 20.35% (0.1538 => 0.1851, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 20.08% (0.0528 => 0.0634, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: 19.34% (3.9006 => 4.6550, std.dev.: 0.2435) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.32% (2.9753 => 3.4610, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.72% (2.7995 => 3.2117, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.48% (5.0261 => 5.6029, std.dev.: 0.0083) SingleSource/Benchmarks/McGill/queens: 10.48% (1.7056 => 1.8844, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 9.81% (2.2485 => 2.4690, std.dev.: 0.0248) SingleSource/Benchmarks/Shootout/ary3: 8.89% (2.0949 => 2.2812, std.dev.: 0.0602) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.29% (1.1857 => 1.2840, std.dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/ary3: 7.36% (1.9999 => 2.1471, std.dev.: 0.0269) SingleSource/Benchmarks/Misc/richards_benchmark: 6.93% (1.3037 => 1.3940, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.77% (4.7794 => 5.1030, std.dev.: 0.0539) MultiSource/Applications/SIBsim4/SIBsim4: 6.11% (3.1873 => 3.3821, std.dev.: 0.0607) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.91% (4.9686 => 5.2621, std.dev.: 0.0643) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.78% (4.5327 => 4.7947, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 4.87% (2.9096 => 3.0514, std.dev.: 0.0462) MultiSource/Applications/lambda-0_1_3/lambda: 4.83% (7.4933 => 7.8551, std.dev.: 0.0492) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.68% (3.3761 => 3.5342, std.dev.: 0.0539) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.55% (6.2275 => 6.5109, std.dev.: 0.0361) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 4.45% (0.5889 => 0.6151, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.90% (14.0064 => 14.5522, std.dev.: 0.0058) MultiSource/Applications/siod/siod: 3.58% (3.6643 => 3.7955, std.dev.: 0.0456) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.50% (0.2887 => 0.2988, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.17% (1.2337 => 1.2728, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.09% (0.3587 => 0.3698, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.03% (4.8362 => 4.9825, std.dev.: 0.0377) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.88% (8.2783 => 8.5170, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.84% (11.5690 => 11.8976, std.dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.31% (1.1365 => 1.1627, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.70% (1.5941 => 1.6212, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.2061 => 1.2236, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 1.32% (1.0841 => 1.0984, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.31% (4.4340 => 4.4919, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/sieve: 1.30% (3.4476 => 3.4923, std.dev.: 0.0122) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.22% (2.4647 => 2.4947, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.18% (5.8421 => 5.9109, std.dev.: 0.0162) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.11% (5.4641 => 4.3105, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.00% (7.2130 => 6.3471, std.dev.: 0.1907) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.80% (1.0512 => 0.9377, std.dev.: 0.0307) MultiSource/Benchmarks/mafft/pairlocalalign: -8.44% (63.1822 => 57.8514, std.dev.: 0.0653) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.22% (14.6451 => 13.5875, std.dev.: 0.0244) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.91% (4.7482 => 4.4199, std.dev.: 0.0380) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.42% (0.3269 => 0.3059, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.92% (3.7148 => 3.4947, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.89% (5.4972 => 5.1733, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.11% (5.1557 => 4.8920, std.dev.: 0.0265) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.53% (4.7449 => 4.5300, std.dev.: 0.0252) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (28.5821 => 27.6719, std.dev.: 0.1117) MultiSource/Applications/lua/lua: -2.75% (29.8330 => 29.0139, std.dev.: 0.0556) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.72% (2.6356 => 2.5638, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -2.69% (0.3937 => 0.3831, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.54% (2.8773 => 2.8042, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.39% (9.9065 => 9.6696, std.dev.: 0.0890) MultiSource/Applications/aha/aha: -2.29% (3.3398 => 3.2633, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.86% (11.5316 => 11.3173, std.dev.: 0.0378) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.64% (2.3487 => 2.3101, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.59% (4.9994 => 4.9197, std.dev.: 0.0066) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.52% (1.0262 => 1.0623, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.64% (0.0408 => 0.0431, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 32.28% (0.0254 => 0.0336, std.dev.: 0.0086) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.30% (0.0302 => 0.0318, std.dev.: 0.0093) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 15.89% (0.0384 => 0.0445, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/test1: 27.78% (0.0180 => 0.0230, std.dev.: 0.0057) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 3.34% (0.1438 => 0.1486, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 9.47% (1.1329 => 1.2402, std.dev.: 0.0326) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.96% (0.4164 => 0.4204, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.14% (0.1369 => 0.1412, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.15% (0.0641 => 0.0674, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 36.92% (0.0195 => 0.0267, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.33% (0.0578 => 0.0553, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.68% (1.1437 => 1.1972, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1800.00% (0.0001 => 0.0019, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.58% (0.0627 => 0.0592, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 32.78% (0.0180 => 0.0239, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.57% (0.8017 => 0.7811, std.dev.: 0.2028) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 41.94% (0.0062 => 0.0088, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 10:19:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 12:19:13 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121121181913.CCF032A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6117?compare_to=6113&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6117, Order: 168431, Start Time: 2012-11-21 16:46:02, End Time: 2012-11-21 18:19:39 To: 6113, Order: 168428, Start Time: 2012-11-21 14:49:15, End Time: 2012-11-21 16:22:58 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 1 (182 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1090 (855 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.05% (0.9555 => 0.9655, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.94% (1.2915 => 1.2664, std.dev.: 0.0092) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.65% (2.0478 => 2.1020, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/salsa20: 2.64% (7.4937 => 7.6917, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/hash2: 2.33% (3.1932 => 3.2676, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.30% (0.9531 => 0.9655, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.30% (0.3821 => 0.3504, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.90% (0.9542 => 0.8884, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -6.85% (0.3357 => 0.3127, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.72% (0.3142 => 0.2931, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -6.59% (2.4924 => 2.3282, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -6.53% (0.2160 => 0.2019, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.51% (0.2428 => 0.2270, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.40% (0.1796 => 0.1681, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -6.40% (9.2283 => 8.6377, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.39% (0.9852 => 0.9222, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: -6.37% (0.3880 => 0.3633, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -6.32% (0.3812 => 0.3571, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.32% (0.3831 => 0.3589, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.31% (0.3848 => 0.3605, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.31% (0.3896 => 0.3650, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -6.25% (0.4176 => 0.3915, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.25% (0.6484 => 0.6079, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.22% (0.7198 => 0.6750, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: -6.22% (0.4033 => 0.3782, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.19% (0.3891 => 0.3650, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -6.16% (16.1920 => 15.1939, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: -6.14% (7.0961 => 6.6604, std.dev.: 0.0104) SingleSource/Benchmarks/McGill/chomp: -6.13% (0.1761 => 0.1653, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.12% (0.5863 => 0.5504, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.12% (0.5478 => 0.5143, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/football/football: -6.11% (0.9179 => 0.8618, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.11% (1.0544 => 0.9900, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.10% (0.5857 => 0.5500, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.07% (0.2355 => 0.2212, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.06% (3.5339 => 3.3199, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.03% (1.3722 => 1.2895, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.96% (0.5805 => 0.5459, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.96% (0.5859 => 0.5510, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -5.95% (0.4199 => 0.3949, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.95% (0.5849 => 0.5501, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.94% (0.5925 => 0.5573, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.93% (0.3658 => 0.3441, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.92% (0.5705 => 0.5367, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.92% (0.6660 => 0.6266, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: -5.90% (4.3330 => 4.0772, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.88% (0.5591 => 0.5262, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.88% (0.5802 => 0.5461, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.87% (6.7716 => 6.3739, std.dev.: 0.0106) MultiSource/Applications/lemon/lemon: -5.87% (1.1450 => 1.0778, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.87% (0.6052 => 0.5697, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.86% (0.2695 => 0.2537, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.86% (4.0323 => 3.7960, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.86% (4.8161 => 4.5341, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.85% (0.5570 => 0.5244, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.84% (0.3884 => 0.3657, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.84% (0.3406 => 0.3207, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.84% (1.2300 => 1.1582, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.83% (0.6667 => 0.6278, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.83% (0.6297 => 0.5930, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.83% (0.1716 => 0.1616, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.82% (0.5581 => 0.5256, std.dev.: 0.0050) MultiSource/Benchmarks/nbench/nbench: -5.82% (1.1530 => 1.0859, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.80% (0.6194 => 0.5835, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.79% (0.6230 => 0.5869, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.78% (0.6189 => 0.5831, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.77% (0.6736 => 0.6347, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.77% (0.6446 => 0.6074, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.76% (1.6364 => 1.5421, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.75% (0.6293 => 0.5931, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.75% (0.6260 => 0.5900, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.75% (1.4642 => 1.3800, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: -5.71% (0.4515 => 0.4257, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.70% (0.5456 => 0.5145, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.69% (4.8802 => 4.6026, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.69% (0.5575 => 0.5258, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.63% (0.7919 => 0.7473, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -5.63% (0.4280 => 0.4039, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -5.61% (1.2515 => 1.1813, std.dev.: 0.0071) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.60% (0.8521 => 0.8044, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.58% (0.6681 => 0.6308, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.57% (0.2548 => 0.2406, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.57% (0.5941 => 0.5610, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.56% (0.5688 => 0.5372, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.51% (1.2784 => 1.2080, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.48% (4.5069 => 4.2597, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.48% (0.6676 => 0.6310, std.dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: -5.46% (1.3864 => 1.3107, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: -5.44% (17.1032 => 16.1735, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.42% (0.5999 => 0.5674, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -5.42% (0.2659 => 0.2515, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.40% (0.2278 => 0.2155, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.35% (0.6033 => 0.5710, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.35% (0.4916 => 0.4653, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.34% (0.6440 => 0.6096, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.34% (0.3483 => 0.3297, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -5.33% (0.2985 => 0.2826, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.33% (14.2083 => 13.4516, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.30% (0.2999 => 0.2840, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.26% (0.5168 => 0.4896, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.25% (1.6474 => 1.5609, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: -5.25% (0.3581 => 0.3393, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.24% (1.2210 => 1.1570, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.24% (8.0126 => 7.5927, std.dev.: 0.0079) MultiSource/Applications/d/make_dparser: -5.17% (3.5154 => 3.3335, std.dev.: 0.0062) MultiSource/Applications/SPASS/SPASS: -5.17% (15.5079 => 14.7057, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.16% (1.2221 => 1.1590, std.dev.: 0.0022) MultiSource/Applications/lua/lua: -5.13% (4.0594 => 3.8511, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: -5.07% (1.3148 => 1.2481, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.07% (0.6395 => 0.6071, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.06% (0.4151 => 0.3941, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.06% (0.7339 => 0.6968, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.03% (0.2385 => 0.2265, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.03% (22.4056 => 21.2796, std.dev.: 0.0108) MultiSource/Applications/ClamAV/clamscan: -4.99% (15.2527 => 14.4914, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/fibo: -4.98% (0.2871 => 0.2728, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.97% (0.3057 => 0.2905, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.97% (0.7524 => 0.7150, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.94% (0.3319 => 0.3155, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.92% (0.5567 => 0.5293, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -4.92% (2.4021 => 2.2839, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.90% (0.5569 => 0.5296, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.90% (0.7021 => 0.6677, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.88% (0.3931 => 0.3739, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.88% (0.3323 => 0.3161, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -4.87% (0.7447 => 0.7084, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: -4.86% (0.3025 => 0.2878, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.84% (0.4813 => 0.4580, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: -4.83% (0.3394 => 0.3230, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.83% (0.6395 => 0.6086, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.83% (0.3252 => 0.3095, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -4.82% (0.3446 => 0.3280, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -4.81% (0.2849 => 0.2712, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.81% (0.2933 => 0.2792, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -4.80% (0.2939 => 0.2798, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.80% (0.2106 => 0.2005, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.79% (0.2903 => 0.2764, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -4.77% (0.3205 => 0.3052, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.77% (0.4321 => 0.4115, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.75% (0.2989 => 0.2847, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.75% (0.5329 => 0.5076, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -4.73% (0.4248 => 0.4047, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/objinst: -4.73% (0.3194 => 0.3043, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -4.71% (2.1401 => 2.0394, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: -4.69% (0.7982 => 0.7608, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.67% (0.3837 => 0.3658, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary2: -4.65% (0.3481 => 0.3319, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -4.65% (0.3271 => 0.3119, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -4.61% (0.3255 => 0.3105, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.60% (2.1713 => 2.0715, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/lists: -4.58% (0.3621 => 0.3455, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.58% (0.3016 => 0.2878, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.56% (2.2587 => 2.1556, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: -4.55% (5.0226 => 4.7942, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: -4.55% (0.4861 => 0.4640, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -4.49% (0.3026 => 0.2890, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.49% (0.6347 => 0.6062, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: -4.49% (0.6441 => 0.6152, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -4.48% (18.2933 => 17.4735, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/lists1: -4.45% (0.3867 => 0.3695, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -4.43% (0.8418 => 0.8045, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: -4.42% (0.7779 => 0.7435, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.42% (0.9557 => 0.9135, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.41% (0.4083 => 0.3903, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.36% (0.3849 => 0.3681, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.24% (0.3491 => 0.3343, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -4.22% (34.0927 => 32.6525, std.dev.: 0.0115) SingleSource/Benchmarks/Misc-C++/bigfib: -4.21% (0.6750 => 0.6466, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: -4.18% (0.3059 => 0.2931, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.14% (0.9077 => 0.8701, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.09% (0.4427 => 0.4246, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: -3.82% (0.4524 => 0.4351, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: -3.75% (0.3788 => 0.3646, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.58% (5.4682 => 5.2727, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: -3.50% (1.5610 => 1.5063, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -2.44% (20.7746 => 20.2669, std.dev.: 0.0393) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7501, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/richards_benchmark: -8.76% (1.2842 => 1.1717, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -4.10% (2.2633 => 2.1704, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.30% (1.3096 => 1.2664, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.05% (1.0557 => 1.0235, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4741, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 12:00:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 14:00:49 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121121200049.DDEDC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6118?compare_to=6116&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6118, Order: 168441, Start Time: 2012-11-21 18:29:44, End Time: 2012-11-21 20:01:16 To: 6116, Order: 168431, Start Time: 2012-11-21 16:36:46, End Time: 2012-11-21 18:13:02 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 3 (78 on baseline) Performance Improvements: 50 (24 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1001 (872 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: 3.30% (4.3531 => 4.4969, std.dev.: 0.0542) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.23% (0.3342 => 0.3450, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.20% (5.0919 => 5.1529, std.dev.: 0.0111) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/flops-2: -41.14% (0.0491 => 0.0289, std.dev.: 0.0022) SingleSource/Benchmarks/Stanford/Oscar: -39.67% (0.1026 => 0.0619, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/queens: -37.60% (0.0742 => 0.0463, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -33.17% (0.0621 => 0.0415, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/methcall: -27.04% (0.0429 => 0.0313, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/IntMM: -24.23% (0.0520 => 0.0394, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/perlin: -21.61% (0.0722 => 0.0566, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -14.03% (0.2174 => 0.1869, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/moments: -11.96% (0.4197 => 0.3695, std.dev.: 0.0104) SingleSource/Benchmarks/McGill/exptree: -11.70% (0.0880 => 0.0777, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -10.63% (9.1988 => 8.2207, std.dev.: 0.0419) SingleSource/Benchmarks/Shootout-C++/spellcheck: -8.55% (0.4115 => 0.3763, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary3: -8.50% (0.2694 => 0.2465, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/heapsort: -8.33% (0.2329 => 0.2135, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -8.31% (0.1768 => 0.1621, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/sumcol: -8.03% (0.2317 => 0.2131, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/lists1: -7.66% (0.3301 => 0.3048, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: -7.29% (0.9150 => 0.8483, std.dev.: 0.0234) SingleSource/Benchmarks/Shootout-C++/hash2: -7.25% (0.4455 => 0.4132, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/except: -7.12% (0.2288 => 0.2125, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: -6.97% (0.2196 => 0.2043, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.78% (0.3452 => 0.3218, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: -6.53% (0.2189 => 0.2046, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.08% (0.2286 => 0.2147, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary2: -5.39% (0.2707 => 0.2561, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.27% (0.2032 => 0.1925, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: -4.95% (0.2241 => 0.2130, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: -4.72% (0.3007 => 0.2865, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: -4.05% (0.2543 => 0.2440, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.98% (0.3414 => 0.3278, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.60% (1.2263 => 1.1822, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.61% (0.9057 => 0.8821, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.31% (0.6287 => 0.6142, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: -2.26% (8.9489 => 8.7466, std.dev.: 0.0388) MultiSource/Benchmarks/Bullet/bullet: -2.02% (33.1486 => 32.4799, std.dev.: 0.1144) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.72% (1.7017 => 1.6725, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.54% (4.6953 => 4.6230, std.dev.: 0.0250) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: -48.70% (0.0386 => 0.0198, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Towers: -35.86% (0.0290 => 0.0186, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/heapsort: -34.31% (4.8099 => 3.1596, std.dev.: 0.2450) SingleSource/Benchmarks/Shootout-C++/heapsort: -33.09% (4.9047 => 3.2818, std.dev.: 0.3008) SingleSource/Benchmarks/Shootout-C++/moments: -18.69% (0.1241 => 0.1009, std.dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/lpbench: -15.31% (4.6550 => 3.9423, std.dev.: 0.0449) SingleSource/Benchmarks/CoyoteBench/fftbench: -13.82% (1.8323 => 1.5790, std.dev.: 0.0296) SingleSource/Benchmarks/Shootout/strcat: -13.29% (0.1851 => 0.1605, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -9.60% (0.6893 => 0.6231, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout/hash: -9.54% (4.7670 => 4.3121, std.dev.: 0.0465) SingleSource/Benchmarks/Shootout/ary3: -8.34% (2.2812 => 2.0909, std.dev.: 0.0565) SingleSource/Benchmarks/Shootout-C++/hash: -4.98% (0.6629 => 0.6299, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -4.41% (0.6151 => 0.5880, std.dev.: 0.0059) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.12% (1.0623 => 1.0636, std.dev.: 0.1375) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -33.18% (0.0220 => 0.0147, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -8.82% (0.0431 => 0.0393, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -19.35% (0.0336 => 0.0271, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -5.97% (0.0318 => 0.0299, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.72% (0.0445 => 0.0424, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0204 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -43.04% (0.0230 => 0.0131, std.dev.: 0.0041) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 62.50% (0.0008 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.40% (0.1486 => 0.1480, std.dev.: 0.0146) MultiSource/Applications/lemon/lemon: -7.60% (1.2402 => 1.1459, std.dev.: 0.1235) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.78% (0.4204 => 0.4171, std.dev.: 0.0277) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.41% (0.1412 => 0.1378, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -14.69% (0.0674 => 0.0575, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -14.61% (0.0267 => 0.0228, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.89% (0.0553 => 0.0569, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.83% (1.1972 => 1.1873, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -94.74% (0.0019 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -74.07% (0.0027 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.26% (0.0592 => 0.0635, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -22.59% (0.0239 => 0.0185, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.10% (0.7811 => 0.7819, std.dev.: 0.0066) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -13.64% (0.0088 => 0.0076, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.23% (16.4461 => 17.6345, std.dev.: 0.5356) MultiSource/Applications/sqlite3/sqlite3: 2323.80% (0.6332 => 15.3475, std.dev.: 0.7140) MultiSource/Benchmarks/McCat/08-main/main: 50.19% (0.1831 => 0.2750, std.dev.: 0.0235) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.25% (0.1559 => 0.1446, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7045.79% (0.3123 => 22.3163, std.dev.: 0.2355) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.68% (0.2463 => 0.3662, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1533.25% (0.3344 => 5.4616, std.dev.: 0.2652) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.66% (0.2364 => 0.3278, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: 4.51% (0.6010 => 0.6281, std.dev.: 0.1137) SingleSource/Benchmarks/Misc/mandel: 2.80% (0.0429 => 0.0441, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.27% (0.3266 => 0.3438, std.dev.: 0.0648) SingleSource/Benchmarks/Shootout-C++/strcat: 3.91% (0.1969 => 0.2046, std.dev.: 0.0022) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.70% (0.0224 => 0.0239, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -28.70% (0.0230 => 0.0164, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0523, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 12.52% (0.1462 => 0.1645, std.dev.: 0.0176) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4748, std.dev.: 0.0798) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0701, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4957, std.dev.: 0.0074) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5113, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5790, std.dev.: 0.0296) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3384, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1580, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3643, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4097, std.dev.: 0.0456) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0839, std.dev.: 0.0067) SingleSource/Regression/C/uint64_to_float: -23.92% (2.1832 => 1.6610, std.dev.: 0.0025) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.38% (0.0810 => 0.0967, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.37% (0.0830 => 0.0941, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: 12.86% (0.1112 => 0.1255, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.74% (0.0848 => 0.0956, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.26% (0.2180 => 0.2360, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.2279 => 0.2435, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.82% (0.1905 => 0.2035, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/em3d/em3d: 5.93% (0.1721 => 0.1823, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.45% (0.1983 => 0.2091, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.32% (0.2519 => 0.2653, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 3.99% (0.2755 => 0.2865, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.31% (0.3115 => 0.3218, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 3.25% (0.4397 => 0.4540, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.21% (4.1763 => 4.3104, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.04% (0.5961 => 0.6142, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.97% (0.6227 => 0.6412, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.95% (0.5191 => 0.5344, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.90% (0.3657 => 0.3763, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.88% (0.8286 => 0.8525, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.83% (0.8805 => 0.9054, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.76% (0.4783 => 0.4915, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.59% (0.7966 => 0.8172, std.dev.: 0.0051) MultiSource/Benchmarks/PAQ8p/paq8p: 2.58% (2.3764 => 2.4377, std.dev.: 0.0170) MultiSource/Benchmarks/nbench/nbench: 2.54% (1.1271 => 1.1557, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.46% (13.1811 => 13.5056, std.dev.: 0.0709) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.44% (0.8611 => 0.8821, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.42% (1.2526 => 1.2829, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.42% (0.8518 => 0.8724, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.41% (0.9056 => 0.9274, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.40% (0.9908 => 1.0146, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.38% (0.8697 => 0.8904, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.33% (0.9039 => 0.9250, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.25% (1.4479 => 1.4805, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.22% (0.9069 => 0.9270, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.11% (0.8712 => 0.8896, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.08% (0.8316 => 0.8489, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.07% (0.8261 => 0.8432, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.07% (1.6386 => 1.6725, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.06% (0.8927 => 0.9111, std.dev.: 0.0060) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.06% (6.6074 => 6.7433, std.dev.: 0.0422) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.03% (0.8338 => 0.8507, std.dev.: 0.0057) MultiSource/Benchmarks/Bullet/bullet: 1.95% (31.8598 => 32.4799, std.dev.: 0.1144) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.91% (0.8204 => 0.8361, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.86% (4.4873 => 4.5706, std.dev.: 0.0203) MultiSource/Benchmarks/mafft/pairlocalalign: 1.41% (8.6247 => 8.7466, std.dev.: 0.0388) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.06% (1.2423 => 1.2555, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 110.55% (0.0199 => 0.0419, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/pi: 58.32% (1.5795 => 2.5007, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.22% (0.7597 => 0.8905, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.31% (2.9753 => 3.4607, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.51% (2.7995 => 3.2058, std.dev.: 0.1384) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6086, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.29% (0.3186 => 0.3450, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.13% (1.1857 => 1.2821, std.dev.: 0.0187) SingleSource/Benchmarks/McGill/queens: 7.56% (1.7056 => 1.8346, std.dev.: 0.0436) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.74% (4.7794 => 5.1016, std.dev.: 0.0192) MultiSource/Applications/SIBsim4/SIBsim4: 6.03% (3.1873 => 3.3796, std.dev.: 0.0355) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.86% (4.5327 => 4.7985, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.76% (4.9686 => 5.2546, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.67% (3.3761 => 3.5338, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.44% (6.2275 => 6.5037, std.dev.: 0.0104) MultiSource/Applications/lambda-0_1_3/lambda: 4.22% (7.4933 => 7.8095, std.dev.: 0.0641) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.20% (4.9453 => 5.1529, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.03% (4.9469 => 5.1464, std.dev.: 0.0074) MultiSource/Applications/hexxagon/hexxagon: 3.90% (14.0064 => 14.5521, std.dev.: 0.1015) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.37% (0.3587 => 0.3708, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.25% (4.3552 => 4.4969, std.dev.: 0.0542) MultiSource/Applications/siod/siod: 3.14% (3.6643 => 3.7795, std.dev.: 0.0360) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.79% (11.5690 => 11.8920, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.67% (8.2783 => 8.4992, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/lists: 2.43% (7.3375 => 7.5158, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.36% (4.8362 => 4.9505, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.24% (4.8660 => 4.9752, std.dev.: 0.0109) MultiSource/Benchmarks/llubenchmark/llu: 1.68% (1.9967 => 2.0303, std.dev.: 0.0106) SingleSource/Benchmarks/Stanford/FloatMM: 1.52% (0.8807 => 0.8941, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (1.1365 => 1.1529, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.30% (2.4647 => 2.4967, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/ReedSolomon: 1.20% (8.5322 => 8.6346, std.dev.: 0.0385) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.34% (8.4179 => 8.2207, std.dev.: 0.0419) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.08% (5.4641 => 4.3121, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.21% (7.2130 => 6.3322, std.dev.: 0.0989) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.09% (1.0512 => 0.9346, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -10.38% (1.1216 => 1.0052, std.dev.: 0.0225) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.06% (14.6451 => 13.3186, std.dev.: 0.1601) MultiSource/Benchmarks/mafft/pairlocalalign: -8.45% (63.1822 => 57.8432, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.34% (0.3269 => 0.3029, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -7.03% (4.7482 => 4.4143, std.dev.: 0.0241) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.95% (3.7148 => 3.4937, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.87% (5.4972 => 5.1743, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.08% (5.1557 => 4.8938, std.dev.: 0.0403) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.31% (4.7449 => 4.5405, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.57% (6.0224 => 5.8072, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.17% (0.5807 => 0.5623, std.dev.: 0.0049) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (28.5821 => 27.7030, std.dev.: 0.0403) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.83% (2.6356 => 2.5610, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.53% (2.8773 => 2.8046, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash2: -2.28% (3.4237 => 3.3458, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.22% (9.9065 => 9.6870, std.dev.: 0.0316) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.04% (11.5316 => 11.2966, std.dev.: 0.0127) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.56% (2.3487 => 2.3121, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.54% (4.9994 => 4.9222, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.12% (5.6343 => 5.5710, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.64% (1.0262 => 1.0636, std.dev.: 0.1375) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 19.51% (0.0123 => 0.0147, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.68% (0.0408 => 0.0393, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 6.69% (0.0254 => 0.0271, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.99% (0.0302 => 0.0299, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -27.22% (0.0180 => 0.0131, std.dev.: 0.0041) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.92% (0.1438 => 0.1480, std.dev.: 0.0146) MultiSource/Applications/lemon/lemon: 1.15% (1.1329 => 1.1459, std.dev.: 0.1235) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.17% (0.4164 => 0.4171, std.dev.: 0.0277) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.66% (0.1369 => 0.1378, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.30% (0.0641 => 0.0575, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 16.92% (0.0195 => 0.0228, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.56% (0.0578 => 0.0569, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.81% (1.1437 => 1.1873, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0014 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.28% (0.0627 => 0.0635, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.78% (0.0180 => 0.0185, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.47% (0.8017 => 0.7819, std.dev.: 0.0066) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 22.58% (0.0062 => 0.0076, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 12:15:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 14:15:47 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121121201547.ADC1B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6119?compare_to=6117&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6119, Order: 168441, Start Time: 2012-11-21 18:42:52, End Time: 2012-11-21 20:16:12 To: 6117, Order: 168431, Start Time: 2012-11-21 16:46:02, End Time: 2012-11-21 18:19:39 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (5 on baseline) Performance Improvements: 1 (181 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1089 (856 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.56% (1.2664 => 1.2862, std.dev.: 0.0034) MultiSource/Benchmarks/llubenchmark/llu: 1.10% (3.7557 => 3.7971, std.dev.: 0.0157) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.85% (81.1347 => 78.0116, std.dev.: 0.7760) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1015, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/salsa20: 2.51% (7.4937 => 7.6816, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/hash2: 2.17% (3.1932 => 3.2625, std.dev.: 0.0014) MultiSource/Benchmarks/llubenchmark/llu: 1.43% (3.7435 => 3.7971, std.dev.: 0.0157) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.01% (0.1431 => 0.1302, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.30% (0.3821 => 0.3504, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.08% (0.9542 => 0.8866, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.00% (0.3142 => 0.2922, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: -6.97% (0.3357 => 0.3123, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -6.76% (0.2160 => 0.2014, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.64% (2.4924 => 2.3268, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.55% (0.2428 => 0.2269, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.44% (0.1584 => 0.1482, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.44% (0.9852 => 0.9218, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -6.37% (9.2283 => 8.6402, std.dev.: 0.0093) MultiSource/Applications/JM/lencod/lencod: -6.32% (16.1920 => 15.1688, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.27% (0.7198 => 0.6747, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.22% (0.6484 => 0.6081, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.15% (0.3658 => 0.3433, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -6.14% (0.9179 => 0.8615, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.13% (1.3722 => 1.2881, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.13% (3.5339 => 3.3174, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.12% (0.5863 => 0.5504, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.12% (0.5478 => 0.5143, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -6.11% (7.0961 => 6.6628, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.09% (1.0544 => 0.9902, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.05% (0.5591 => 0.5253, std.dev.: 0.0078) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.04% (6.7716 => 6.3626, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.03% (0.2355 => 0.2213, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -6.02% (0.1761 => 0.1655, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.01% (0.5857 => 0.5505, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.00% (0.1716 => 0.1613, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.00% (4.0323 => 3.7903, std.dev.: 0.0038) MultiSource/Applications/lemon/lemon: -5.97% (1.1450 => 1.0767, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.96% (0.5705 => 0.5365, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.96% (0.6297 => 0.5922, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.94% (0.2695 => 0.2535, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.93% (0.5805 => 0.5461, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.91% (0.6667 => 0.6273, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.91% (0.5925 => 0.5575, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.90% (0.5849 => 0.5504, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.89% (0.5859 => 0.5514, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.88% (4.8161 => 4.5327, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.88% (1.2300 => 1.1577, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: -5.87% (4.3330 => 4.0785, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.87% (0.6052 => 0.5697, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.86% (0.6230 => 0.5865, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.86% (0.6660 => 0.6270, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.84% (0.6194 => 0.5832, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: -5.83% (0.3896 => 0.3669, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.81% (0.7919 => 0.7459, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.80% (0.6189 => 0.5830, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.80% (1.4642 => 1.3793, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.79% (0.5575 => 0.5252, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: -5.79% (1.1530 => 1.0862, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.79% (0.5802 => 0.5466, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.79% (0.6304 => 0.5939, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -5.77% (0.3848 => 0.3626, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.77% (1.6364 => 1.5420, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.75% (0.6293 => 0.5931, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.75% (0.5581 => 0.5260, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.75% (0.6260 => 0.5900, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -5.75% (0.3880 => 0.3657, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: -5.74% (0.4515 => 0.4256, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -5.73% (0.2985 => 0.2814, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: -5.73% (0.4033 => 0.3802, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -5.73% (0.3406 => 0.3211, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.72% (0.4176 => 0.3937, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -5.72% (1.2515 => 1.1799, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -5.72% (0.3812 => 0.3594, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.71% (4.5069 => 4.2494, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.71% (0.5941 => 0.5602, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.68% (0.5456 => 0.5146, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.67% (4.8802 => 4.6036, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/exceptions-2: -5.66% (0.3831 => 0.3614, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.66% (0.6446 => 0.6081, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.66% (0.5688 => 0.5366, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.66% (0.8521 => 0.8039, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.66% (0.3483 => 0.3286, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.66% (0.5570 => 0.5255, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.64% (0.6736 => 0.6356, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.64% (1.2784 => 1.2063, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -5.61% (1.3864 => 1.3086, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: -5.61% (1.3148 => 1.2411, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.60% (0.3016 => 0.2847, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.57% (0.2871 => 0.2711, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.56% (0.6676 => 0.6305, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.55% (0.3891 => 0.3675, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.54% (0.4151 => 0.3921, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.54% (0.6681 => 0.6311, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.54% (0.6033 => 0.5699, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.53% (0.2548 => 0.2407, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.53% (0.3057 => 0.2888, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.51% (0.3323 => 0.3140, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.50% (0.5999 => 0.5669, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: -5.50% (0.3255 => 0.3076, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -5.49% (0.2659 => 0.2513, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.48% (0.2903 => 0.2744, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.47% (0.6440 => 0.6088, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.46% (0.2933 => 0.2773, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -5.45% (0.4199 => 0.3970, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.44% (0.2939 => 0.2779, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -5.42% (0.3025 => 0.2861, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -5.42% (0.3026 => 0.2862, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.42% (0.3931 => 0.3718, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -5.39% (17.1032 => 16.1808, std.dev.: 0.0121) MultiSource/Benchmarks/McCat/18-imp/imp: -5.39% (0.3581 => 0.3388, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: -5.37% (0.2849 => 0.2696, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.37% (0.4916 => 0.4652, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.37% (0.3837 => 0.3631, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.36% (0.2278 => 0.2156, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.34% (1.6474 => 1.5595, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.33% (14.2083 => 13.4504, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/ary: -5.33% (0.3394 => 0.3213, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.33% (0.3884 => 0.3677, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.32% (0.3194 => 0.3024, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: -5.32% (15.5079 => 14.6826, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.31% (1.2210 => 1.1562, std.dev.: 0.0024) MultiSource/Applications/d/make_dparser: -5.31% (3.5154 => 3.3289, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/wc: -5.27% (0.3205 => 0.3036, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.26% (0.5168 => 0.4896, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -5.26% (0.3481 => 0.3298, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.23% (0.3252 => 0.3082, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -5.22% (0.3446 => 0.3266, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -5.20% (0.4861 => 0.4608, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.19% (0.4813 => 0.4563, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: -5.19% (0.2989 => 0.2834, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.19% (8.0126 => 7.5971, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.17% (2.1713 => 2.0590, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/parameter-passing: -5.16% (0.4280 => 0.4059, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.16% (0.6395 => 0.6065, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.16% (1.2221 => 1.1591, std.dev.: 0.0009) MultiSource/Applications/lua/lua: -5.10% (4.0594 => 3.8525, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: -5.06% (0.4248 => 0.4033, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.06% (0.7339 => 0.6968, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.05% (0.7524 => 0.7144, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.04% (0.3849 => 0.3655, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -5.03% (2.4021 => 2.2812, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.03% (0.2385 => 0.2265, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: -5.02% (0.7447 => 0.7073, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.01% (0.7021 => 0.6669, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -5.00% (15.2527 => 14.4895, std.dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.00% (0.3319 => 0.3153, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: -5.00% (0.3621 => 0.3440, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -4.97% (0.3867 => 0.3675, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.96% (0.5567 => 0.5291, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.94% (22.4056 => 21.2993, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.88% (0.5569 => 0.5297, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -4.87% (0.7982 => 0.7593, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.85% (0.4083 => 0.3885, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: -4.84% (0.3059 => 0.2911, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -4.84% (5.0226 => 4.7796, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.83% (0.6395 => 0.6086, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: -4.80% (2.1401 => 2.0373, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.77% (0.4321 => 0.4115, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.74% (0.4427 => 0.4217, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.73% (0.5329 => 0.5077, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.71% (0.6347 => 0.6048, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.70% (0.2999 => 0.2858, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: -4.68% (0.7779 => 0.7415, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: -4.68% (18.2933 => 17.4376, std.dev.: 0.0061) SingleSource/UnitTests/ObjC++/property-reference-object: -4.64% (0.6441 => 0.6142, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -4.63% (34.0927 => 32.5132, std.dev.: 0.0198) SingleSource/Benchmarks/Misc-C++/bigfib: -4.62% (0.6750 => 0.6438, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.60% (0.9557 => 0.9117, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -4.57% (0.3788 => 0.3615, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -4.56% (0.3271 => 0.3122, std.dev.: 0.0020) MultiSource/Applications/spiff/spiff: -4.50% (0.8418 => 0.8039, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.49% (2.2587 => 2.1573, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: -4.35% (0.4524 => 0.4327, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.07% (0.3491 => 0.3349, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: -3.91% (1.5610 => 1.5000, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.86% (0.9077 => 0.8727, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.71% (5.4682 => 5.2652, std.dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: -2.32% (20.7746 => 20.2930, std.dev.: 0.0792) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7562, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/richards_benchmark: -8.65% (1.2842 => 1.1731, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -4.11% (2.2633 => 2.1703, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.79% (1.3096 => 1.2862, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.48% (6.5735 => 6.4759, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 12:58:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 14:58:12 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121121205812.993FA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6120?compare_to=6115&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6120, Order: 168440, Start Time: 2012-11-21 18:37:53, End Time: 2012-11-21 20:58:36 To: 6115, Order: 168428, Start Time: 2012-11-21 15:24:12, End Time: 2012-11-21 17:44:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 50 (136 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1036 (710 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 16.37% (0.6856 => 0.7978, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 16.21% (0.5902 => 0.6859, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 15.95% (0.5901 => 0.6842, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 15.87% (0.6862 => 0.7951, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.84% (0.5776 => 0.6691, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 15.82% (0.7201 => 0.8340, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 15.29% (0.6201 => 0.7149, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 14.74% (0.6416 => 0.7362, std.dev.: 0.0202) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.24% (0.1171 => 0.1326, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 13.19% (0.5915 => 0.6695, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.60% (0.7151 => 0.8052, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.49% (4.8418 => 5.4467, std.dev.: 0.0063) SingleSource/Benchmarks/LivermoreLoops/kernel07: 12.37% (0.1043 => 0.1172, std.dev.: 0.0006) SingleSource/Benchmarks/LivermoreLoops/kernel14: 12.33% (0.1087 => 0.1221, std.dev.: 0.0002) SingleSource/Benchmarks/LivermoreLoops/kernel09: 11.42% (0.1060 => 0.1181, std.dev.: 0.0033) SingleSource/Benchmarks/LivermoreLoops/kernel11: 11.34% (0.1014 => 0.1129, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.26% (1.7398 => 1.9357, std.dev.: 0.0146) SingleSource/Benchmarks/LivermoreLoops/kernel12: 11.22% (0.0998 => 0.1110, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 11.12% (3.8208 => 4.2457, std.dev.: 0.0341) SingleSource/Benchmarks/LivermoreLoops/kernel13: 11.09% (0.1091 => 0.1212, std.dev.: 0.0006) SingleSource/Benchmarks/LivermoreLoops/kernel10: 11.08% (0.1056 => 0.1173, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.99% (1.4705 => 1.6321, std.dev.: 0.0098) MultiSource/Applications/SIBsim4/SIBsim4: 10.85% (1.5345 => 1.7010, std.dev.: 0.0352) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 10.76% (0.1487 => 0.1647, std.dev.: 0.0051) MultiSource/Applications/viterbi/viterbi: 10.25% (0.1785 => 0.1968, std.dev.: 0.0045) SingleSource/Benchmarks/LivermoreLoops/kernel15: 10.24% (0.1182 => 0.1303, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.10% (1.7871 => 1.9676, std.dev.: 0.0614) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 9.95% (0.2121 => 0.2332, std.dev.: 0.0053) SingleSource/Benchmarks/McGill/chomp: 9.66% (0.1874 => 0.2055, std.dev.: 0.0057) MultiSource/Applications/oggenc/oggenc: 8.72% (6.7955 => 7.3884, std.dev.: 0.0242) SingleSource/Benchmarks/LivermoreLoops/kernel18: 7.89% (0.1483 => 0.1600, std.dev.: 0.0029) MultiSource/Benchmarks/sim/sim: 7.64% (0.3719 => 0.4003, std.dev.: 0.0072) MultiSource/Applications/lambda-0_1_3/lambda: 7.58% (0.9128 => 0.9820, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.37% (0.1533 => 0.1646, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.17% (0.6343 => 0.6798, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.84% (10.9320 => 11.5700, std.dev.: 0.0770) MultiSource/Applications/JM/ldecod/ldecod: 5.81% (9.2359 => 9.7729, std.dev.: 0.1924) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.75% (8.0870 => 8.5524, std.dev.: 0.1381) SingleSource/UnitTests/ObjC/trivial-interface: 5.36% (0.3880 => 0.4088, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.30% (4.7522 => 5.0039, std.dev.: 0.0372) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.17% (0.5047 => 0.5308, std.dev.: 0.0086) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 96.08% (4.2299 => 8.2939, std.dev.: 0.3324) MultiSource/Applications/minisat/minisat: 16.07% (10.0799 => 11.6999, std.dev.: 0.4933) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 9.60% (2.7644 => 3.0299, std.dev.: 0.0763) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.73% (1.5587 => 1.5856, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.25% (5.3749 => 5.4420, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.24% (3.5968 => 3.6414, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.14% (5.0783 => 5.1360, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.12% (5.6650 => 5.7284, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.02% (4.3855 => 4.4304, std.dev.: 0.0017) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.08% (69.3122 => 69.3654, std.dev.: 0.4411) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 2.24% (0.1338 => 0.1368, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0419 => 0.0419, std.dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.99% (0.0652 => 0.0678, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -0.03% (494.3964 => 494.2451, std.dev.: 0.1009) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.68% (63.2438 => 69.3654, std.dev.: 0.4411) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0419, std.dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43727.71% (1.1277 => 494.2451, std.dev.: 0.1009) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 225.30% (0.5229 => 1.7010, std.dev.: 0.0352) MultiSource/Applications/SPASS/SPASS: 21.79% (14.9895 => 18.2550, std.dev.: 0.2878) MultiSource/Applications/kimwitu++/kc: 50.12% (14.1553 => 21.2505, std.dev.: 0.3850) MultiSource/Benchmarks/MallocBench/gs/gs: 19.52% (4.1105 => 4.9129, std.dev.: 0.2254) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.67% (1.1048 => 1.5210, std.dev.: 0.0659) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 436.80% (7.1582 => 38.4254, std.dev.: 0.4771) SingleSource/Benchmarks/Misc-C++-EH/spirit: 74.98% (3.4629 => 6.0593, std.dev.: 0.4478) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.35% (0.6222 => 1.0350, std.dev.: 0.0638) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11163.61% (0.0720 => 8.1098, std.dev.: 0.1102) MultiSource/Applications/SIBsim4/SIBsim4: 3864200.00% (0.0001 => 3.8643, std.dev.: 0.0313) MultiSource/Applications/SPASS/SPASS: 13051400.00% (0.0001 => 13.0515, std.dev.: 0.0870) MultiSource/Applications/kimwitu++/kc: 52000.00% (0.0001 => 0.0521, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576800.00% (0.0001 => 0.5769, std.dev.: 0.0220) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10071600.00% (0.0001 => 10.0717, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6473100.00% (0.0001 => 6.4732, std.dev.: 0.5384) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1775.31% (1.1194 => 20.9922, std.dev.: 0.4618) MultiSource/Applications/ClamAV/clamscan: 65.20% (22.1758 => 36.6351, std.dev.: 0.6820) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 64.02% (7.0540 => 11.5700, std.dev.: 0.0770) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.50% (2.9384 => 4.6281, std.dev.: 0.3070) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.39% (8.1363 => 12.2361, std.dev.: 0.1985) MultiSource/Applications/JM/lencod/lencod: 47.91% (21.9371 => 32.4476, std.dev.: 0.1582) MultiSource/Benchmarks/FreeBench/distray/distray: 45.93% (0.1056 => 0.1541, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 38.41% (0.1432 => 0.1982, std.dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/almabench: 38.36% (0.0730 => 0.1010, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 32.11% (0.7433 => 0.9820, std.dev.: 0.0104) SingleSource/UnitTests/vla: 30.70% (0.0355 => 0.0464, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 29.06% (0.0437 => 0.0564, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 28.29% (5.7591 => 7.3884, std.dev.: 0.0242) MultiSource/Benchmarks/MallocBench/espresso/espresso: 27.72% (4.2646 => 5.4467, std.dev.: 0.0063) MultiSource/Applications/d/make_dparser: 27.29% (3.3354 => 4.2457, std.dev.: 0.0341) MultiSource/Applications/viterbi/viterbi: 26.56% (0.1555 => 0.1968, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 25.57% (1.5415 => 1.9357, std.dev.: 0.0146) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.47% (0.0746 => 0.0936, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 25.07% (1.3050 => 1.6321, std.dev.: 0.0098) SingleSource/Benchmarks/Stanford/Towers: 25.05% (0.0471 => 0.0589, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 24.84% (0.6450 => 0.8052, std.dev.: 0.0047) SingleSource/Benchmarks/Stanford/Oscar: 24.69% (0.0636 => 0.0793, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.68% (0.0770 => 0.0960, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 24.17% (0.1655 => 0.2055, std.dev.: 0.0057) SingleSource/Benchmarks/Dhrystone/dry: 24.12% (0.0456 => 0.0566, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 24.07% (1.5859 => 1.9676, std.dev.: 0.0614) MultiSource/Benchmarks/BitBench/drop3/drop3: 23.24% (0.0482 => 0.0594, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 23.20% (0.4289 => 0.5284, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/mst/mst: 23.13% (0.1163 => 0.1432, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.11% (0.1337 => 0.1646, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 22.59% (0.2554 => 0.3131, std.dev.: 0.0181) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.35% (0.1906 => 0.2332, std.dev.: 0.0053) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 22.27% (0.0467 => 0.0571, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.09% (0.1566 => 0.1912, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 22.07% (0.5569 => 0.6798, std.dev.: 0.0121) SingleSource/Benchmarks/Dhrystone/fldry: 21.83% (0.0481 => 0.0586, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 21.78% (0.1584 => 0.1929, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout/hash: 21.65% (0.0485 => 0.0590, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 21.65% (0.7835 => 0.9531, std.dev.: 0.0288) MultiSource/Benchmarks/Olden/tsp/tsp: 20.68% (0.1175 => 0.1418, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/life/life: 20.47% (0.0933 => 0.1124, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 19.47% (14.3668 => 17.1638, std.dev.: 0.2351) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.20% (0.1125 => 0.1341, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash2: 19.11% (0.4620 => 0.5503, std.dev.: 0.0149) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.07% (0.2700 => 0.3215, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 18.67% (0.0798 => 0.0947, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.58% (5.0018 => 5.9311, std.dev.: 0.1444) MultiSource/Benchmarks/sim/sim: 18.19% (0.3387 => 0.4003, std.dev.: 0.0072) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.09% (0.8172 => 0.9650, std.dev.: 0.0365) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.81% (0.0842 => 0.0992, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/trivial-interface: 17.71% (0.3473 => 0.4088, std.dev.: 0.0076) MultiSource/Benchmarks/VersaBench/bmm/bmm: 17.65% (0.0759 => 0.0893, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/property: 17.52% (0.3886 => 0.4567, std.dev.: 0.0206) SingleSource/UnitTests/ObjC/synchronized: 17.50% (0.3561 => 0.4184, std.dev.: 0.0124) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.45% (0.0871 => 0.1023, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/lists: 17.09% (0.0626 => 0.0733, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.02% (1.4186 => 1.6601, std.dev.: 0.0611) MultiSource/Applications/lua/lua: 16.97% (3.8723 => 4.5293, std.dev.: 0.1912) MultiSource/Benchmarks/Olden/em3d/em3d: 16.70% (0.1695 => 0.1978, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 16.50% (3.8922 => 4.5343, std.dev.: 0.2084) MultiSource/Applications/sqlite3/sqlite3: 16.47% (17.1811 => 20.0107, std.dev.: 0.5034) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.46% (0.2065 => 0.2405, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.37% (0.0886 => 0.1031, std.dev.: 0.0047) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.16% (0.0953 => 0.1107, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.05% (0.0648 => 0.0752, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/matrix: 16.01% (0.0818 => 0.0949, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 15.94% (9.4845 => 10.9959, std.dev.: 0.3908) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.83% (0.0834 => 0.0966, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/health/health: 15.69% (0.1268 => 0.1467, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.58% (0.0770 => 0.0890, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 15.36% (0.7326 => 0.8451, std.dev.: 0.0163) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.23% (0.2107 => 0.2428, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.23% (0.2758 => 0.3178, std.dev.: 0.0082) MultiSource/Benchmarks/NPB-serial/is/is: 15.16% (0.0719 => 0.0828, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.04% (0.1117 => 0.1285, std.dev.: 0.0049) MultiSource/Applications/Burg/burg: 15.01% (1.1642 => 1.3390, std.dev.: 0.0447) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.67% (0.1029 => 0.1180, std.dev.: 0.0044) SingleSource/UnitTests/ObjC++/Hello: 14.63% (0.5925 => 0.6792, std.dev.: 0.0179) SingleSource/UnitTests/ObjC++/property-reference-object: 14.59% (0.6030 => 0.6910, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.40% (0.5981 => 0.6842, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.38% (2.0665 => 2.3637, std.dev.: 0.1009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.34% (0.1032 => 0.1180, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.27% (0.2271 => 0.2595, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.13% (0.4615 => 0.5267, std.dev.: 0.0138) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.12% (0.1062 => 0.1212, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.04% (0.5860 => 0.6683, std.dev.: 0.0291) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.08% (0.8101 => 0.9161, std.dev.: 0.0389) MultiSource/Benchmarks/nbench/nbench: 13.07% (1.1840 => 1.3387, std.dev.: 0.0453) MultiSource/Applications/treecc/treecc: 13.04% (2.0273 => 2.2916, std.dev.: 0.0474) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.80% (4.9449 => 5.5778, std.dev.: 0.2416) SingleSource/UnitTests/ObjC/exceptions: 12.59% (0.3828 => 0.4310, std.dev.: 0.0160) SingleSource/UnitTests/ObjC/exceptions-3: 12.51% (0.3516 => 0.3956, std.dev.: 0.0131) SingleSource/UnitTests/ObjC/exceptions-4: 12.48% (0.3543 => 0.3985, std.dev.: 0.0149) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.42% (0.1143 => 0.1285, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.42% (0.3543 => 0.3983, std.dev.: 0.0120) SingleSource/UnitTests/ObjC/for-in: 12.29% (0.3694 => 0.4148, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.06% (0.8067 => 0.9040, std.dev.: 0.0187) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.95% (0.0929 => 0.1040, std.dev.: 0.0035) MultiSource/Benchmarks/PAQ8p/paq8p: 11.49% (10.3673 => 11.5583, std.dev.: 0.2798) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.37% (0.2603 => 0.2899, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 10.49% (0.1144 => 0.1264, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: 10.39% (0.1463 => 0.1615, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.79% (0.4879 => 0.5308, std.dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.34% (0.1438 => 0.1558, std.dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.42% (7.9617 => 8.5524, std.dev.: 0.1381) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 149.07% (4.3953 => 10.9474, std.dev.: 0.0408) SingleSource/Benchmarks/Shootout-C++/methcall: 147.47% (5.3999 => 13.3630, std.dev.: 0.0074) MultiSource/Benchmarks/llubenchmark/llu: 119.53% (3.7781 => 8.2939, std.dev.: 0.3324) MultiSource/Applications/minisat/minisat: 28.35% (9.1159 => 11.6999, std.dev.: 0.4933) SingleSource/Benchmarks/Misc/oourafft: 17.43% (6.6465 => 7.8052, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.63% (1.1145 => 1.2998, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.98% (0.2944 => 0.3326, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.63% (2.8904 => 3.2266, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: 10.24% (1.1396 => 1.2563, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.36% (1.7254 => 1.8869, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash2: 9.35% (3.1578 => 3.4532, std.dev.: 0.0986) MultiSource/Applications/lemon/lemon: 7.86% (1.4460 => 1.5597, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/hash: 7.07% (0.7455 => 0.7982, std.dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.57% (4.2280 => 4.4633, std.dev.: 0.0120) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.96% (26.0924 => 27.3853, std.dev.: 0.1573) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.12% (11.6436 => 12.1237, std.dev.: 0.0070) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.36% (1.7133 => 1.7537, std.dev.: 0.0134) MultiSource/Benchmarks/PAQ8p/paq8p: 2.17% (85.0658 => 86.9078, std.dev.: 0.0302) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 2.10% (3.1023 => 3.1675, std.dev.: 0.0224) MultiSource/Applications/aha/aha: 2.08% (3.1595 => 3.2251, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: 1.83% (2.4116 => 2.4558, std.dev.: 0.0081) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (27.8444 => 28.3030, std.dev.: 0.0137) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.36% (6.5088 => 6.5971, std.dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.30% (1.0313 => 1.0447, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0500, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1680, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/salsa20: -75.75% (0.8651 => 0.2098, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.60% (5.2763 => 1.2873, std.dev.: 0.0402) SingleSource/Benchmarks/Misc/richards_benchmark: -44.76% (0.1622 => 0.0896, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.30% (5.3526 => 4.6940, std.dev.: 0.1337) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.98% (1.7609 => 1.6028, std.dev.: 0.0438) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.09% (5.3855 => 5.0039, std.dev.: 0.0372) MultiSource/Applications/JM/ldecod/ldecod: -6.35% (10.4361 => 9.7729, std.dev.: 0.1924) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.33% (0.3987 => 0.2379, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.33% (4.5009 => 2.7755, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: -33.54% (1.1492 => 0.7638, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.08% (2.6546 => 2.0153, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.34% (0.2161 => 0.1743, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.75% (1.6925 => 1.4259, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2841, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.79% (32.5116 => 29.0050, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -10.51% (9.5636 => 8.5581, std.dev.: 0.2184) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.53% (1.5660 => 1.4324, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.2416 => 3.0211, std.dev.: 0.0260) SingleSource/Benchmarks/CoyoteBench/huffbench: -5.77% (19.9488 => 18.7970, std.dev.: 0.3213) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.61% (2.7294 => 2.5762, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -4.75% (1.5835 => 1.5083, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/lists: -4.27% (6.2999 => 6.0307, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.33% (0.9957 => 0.9625, std.dev.: 0.0035) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8913, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.31% (0.4808 => 0.4697, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.77% (8.1563 => 8.0119, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/salsa20: -1.49% (10.2830 => 10.1301, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -7.88% (0.1485 => 0.1368, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.96% (0.2116 => 0.0678, std.dev.: 0.0002) Report Time: 2.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 13:29:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 15:29:28 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121121212928.A70E62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6121?compare_to=6114&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6121, Order: 168437, Start Time: 2012-11-21 18:09:15, End Time: 2012-11-21 21:29:53 To: 6114, Order: 168420, Start Time: 2012-11-21 14:00:32, End Time: 2012-11-21 17:21:07 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (171 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1092 (719 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.04% (0.0625 => 0.0894, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.68% (0.1063 => 0.1421, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.17% (0.0714 => 0.0908, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 26.29% (1.5932 => 2.0121, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.13% (0.1106 => 0.1395, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.97% (0.2969 => 0.3740, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.37% (0.4139 => 0.5189, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.99% (0.4253 => 0.5316, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.15% (0.4994 => 0.6200, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.62% (0.5000 => 0.6181, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.25% (0.5900 => 0.7272, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.12% (0.0584 => 0.0719, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.07% (0.0897 => 0.1095, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.04% (0.1107 => 0.1351, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 22.04% (0.0599 => 0.0731, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.79% (0.1620 => 0.1973, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.65% (0.1021 => 0.1242, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 20.68% (0.0948 => 0.1144, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0584 => 0.0704, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.49% (0.1103 => 0.1329, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.45% (0.3903 => 0.4701, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 20.34% (0.0821 => 0.0988, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.09% (0.0642 => 0.0771, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.95% (0.1549 => 0.1858, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.94% (0.1003 => 0.1203, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.71% (0.0822 => 0.0984, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 19.58% (0.1619 => 0.1936, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.39% (0.1604 => 0.1915, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.08% (0.1462 => 0.1741, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 19.06% (0.0808 => 0.0962, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.89% (0.3890 => 0.4625, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 18.80% (0.0947 => 0.1125, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.32% (0.2014 => 0.2383, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: 18.06% (0.1218 => 0.1438, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.91% (0.2736 => 0.3226, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.88% (1.3152 => 1.5504, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.85% (0.0605 => 0.0713) MultiSource/Benchmarks/McCat/09-vor/vor: 17.74% (0.1505 => 0.1772, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.74% (0.1088 => 0.1281, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 17.74% (0.9697 => 1.1417, std.dev.: 0.0060) MultiSource/Applications/spiff/spiff: 17.72% (0.4029 => 0.4743, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 17.62% (0.0698 => 0.0821, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 17.47% (0.5826 => 0.6844, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.45% (0.2866 => 0.3366, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 17.35% (0.5546 => 0.6508, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 17.19% (1.8794 => 2.2024, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference-object: 17.15% (0.5889 => 0.6899, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.97% (0.1968 => 0.2302, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.92% (3.5627 => 4.1656, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.90% (0.2875 => 0.3361, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.83% (1.6211 => 1.8939, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.79% (0.4658 => 0.5440, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.55% (0.1160 => 0.1352, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 16.55% (0.2780 => 0.3240, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 16.52% (1.0781 => 1.2562, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: 16.47% (0.2750 => 0.3203, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.42% (0.3271 => 0.3808, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 16.40% (0.2811 => 0.3272, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 16.33% (0.2725 => 0.3170, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.29% (0.2738 => 0.3184, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.26% (0.2792 => 0.3246, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.26% (0.4361 => 0.5070, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 16.26% (0.1421 => 0.1652, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 16.21% (0.2813 => 0.3269, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 16.20% (0.2803 => 0.3257, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/objinst: 16.19% (0.2823 => 0.3280, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 16.19% (0.9909 => 1.1513, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 16.18% (0.2714 => 0.3153, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 16.15% (0.3004 => 0.3489, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.12% (0.2729 => 0.3169, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.11% (0.3930 => 0.4563, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.06% (0.1090 => 0.1265) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.04% (0.2911 => 0.3378, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.98% (0.5026 => 0.5829, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.85% (4.4195 => 5.1198, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/ary3: 15.79% (0.3267 => 0.3783, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 15.76% (0.3096 => 0.3584, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.74% (0.3195 => 0.3698, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 15.73% (0.1284 => 0.1486, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 15.68% (4.2109 => 4.8710, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.67% (2.0673 => 2.3912, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.65% (2.7292 => 3.1562, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 15.59% (0.3258 => 0.3766, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 15.28% (0.3317 => 0.3824, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 15.26% (0.7171 => 0.8265, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.23% (0.3060 => 0.3526, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 15.13% (0.2075 => 0.2389, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.07% (1.9694 => 2.2662, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.91% (1.9966 => 2.2942, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.84% (0.3362 => 0.3861, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.82% (0.3124 => 0.3587, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 14.77% (0.2566 => 0.2945, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 14.74% (0.3678 => 0.4220, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 14.63% (23.5202 => 26.9607, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.63% (0.3282 => 0.3762, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 14.58% (0.3348 => 0.3836, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 14.47% (0.3726 => 0.4265, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 14.44% (0.3477 => 0.3979, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 14.24% (1.4269 => 1.6301, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.23% (0.3625 => 0.4141, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 14.18% (0.4146 => 0.4734, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.02% (0.3981 => 0.4539, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.96% (0.3690 => 0.4205, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/hash2: 13.88% (0.4251 => 0.4841, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 13.82% (0.3465 => 0.3944, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.78% (0.3446 => 0.3921, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.76% (0.3845 => 0.4374, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 13.67% (0.3496 => 0.3974, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 13.64% (0.7875 => 0.8949, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.62% (0.3488 => 0.3963, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 13.61% (0.3460 => 0.3931, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.61% (0.3469 => 0.3941, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.60% (0.3442 => 0.3910, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 13.59% (0.0758 => 0.0861, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 13.45% (2.1653 => 2.4566, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/property: 13.37% (0.3650 => 0.4138, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 13.37% (0.3643 => 0.4130, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 13.29% (4.6177 => 5.2315, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/bigfib: 13.21% (0.5012 => 0.5674, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.05% (0.3724 => 0.4210, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 12.93% (2.1013 => 2.3730, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.89% (0.2040 => 0.2303, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 12.78% (0.2691 => 0.3035, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.15% (0.6435 => 0.7217, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 12.05% (5.5417 => 6.2092, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.90% (0.2068 => 0.2314, std.dev.: 0.0079) MultiSource/Applications/lambda-0_1_3/lambda: 11.66% (0.3498 => 0.3906, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.58% (0.1028 => 0.1147, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.57% (0.1383 => 0.1543, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 11.18% (0.4847 => 0.5389, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.03% (0.2737 => 0.3039, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 11.02% (0.6634 => 0.7365, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.96% (0.3084 => 0.3422, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.34% (0.3336 => 0.3681, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 10.31% (2.0346 => 2.2443, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.18% (0.2103 => 0.2317, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 10.04% (0.2391 => 0.2631, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.10% (0.5361 => 0.5849, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.01% (4.6926 => 5.1156, std.dev.: 0.0142) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.79% (11.6398 => 12.6632, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.56% (0.7426 => 0.8062, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.33% (0.5584 => 0.6049, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 6.84% (11.9555 => 12.7738, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.43% (0.3792 => 0.3960, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 9.85% (0.2802 => 0.3078, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6102, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.90% (0.3693 => 0.3911, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6771, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-2: 4.94% (1.8057 => 1.8949, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1694, std.dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/dry: 4.27% (14.0481 => 14.6479, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2018, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.72% (3.1722 => 3.2267, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.49% (7.1849 => 7.2921, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.2993, std.dev.: 0.0182) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5151, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5841, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.29% (2.4764 => 2.4198, std.dev.: 0.0122) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.77% (25.4195 => 16.5821, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/ary2: -10.74% (0.2402 => 0.2144, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9767, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7991, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9576, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8025, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.05% (0.6293 => 0.6101, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7757, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.90% (17.2379 => 16.7386, std.dev.: 0.0344) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.20% (41.7953 => 40.8739, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5773, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4997, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.22% (105.3826 => 104.0939, std.dev.: 0.0885) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.02% (16.2163 => 16.0514, std.dev.: 0.0015) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 13:57:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 15:57:41 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121121215741.B48322A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6122?compare_to=6118&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6122, Order: 168449, Start Time: 2012-11-21 20:22:15, End Time: 2012-11-21 21:58:07 To: 6118, Order: 168441, Start Time: 2012-11-21 18:29:44, End Time: 2012-11-21 20:01:16 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 3 (30 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1051 (928 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench: 2.87% (0.3662 => 0.3767, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.33% (2.2590 => 2.3794, std.dev.: 0.0247) MultiSource/Applications/SIBsim4/SIBsim4: 2.35% (3.3796 => 3.4590, std.dev.: 0.0289) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.71% (1.0636 => 1.0924, std.dev.: 0.2236) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 48.98% (0.0147 => 0.0219, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 8.65% (0.0393 => 0.0427, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 22.14% (0.0271 => 0.0331, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.68% (0.0299 => 0.0313, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.65% (0.0424 => 0.0431, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0203 => 0.0204, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: 65.65% (0.0131 => 0.0217, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 4.80% (0.1480 => 0.1551, std.dev.: 0.0119) MultiSource/Applications/lemon/lemon: -0.44% (1.1459 => 1.1409, std.dev.: 0.3281) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.27% (0.4171 => 0.4349, std.dev.: 0.0201) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.14% (0.1378 => 0.1435, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.35% (0.0575 => 0.0646, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.46% (0.0228 => 0.0211, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.76% (0.0569 => 0.0559, std.dev.: 0.0134) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.21% (1.1873 => 1.1898, std.dev.: 0.0351) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3100.00% (0.0001 => 0.0032, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -85.71% (0.0007 => 0.0001, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.09% (0.0635 => 0.0609, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.41% (0.0185 => 0.0195, std.dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.96% (0.7819 => 0.7894, std.dev.: 0.0348) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -46.05% (0.0076 => 0.0041, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.95% (16.4461 => 17.7540, std.dev.: 1.5796) MultiSource/Applications/sqlite3/sqlite3: 2374.97% (0.6332 => 15.6715, std.dev.: 0.7259) MultiSource/Benchmarks/McCat/08-main/main: 49.48% (0.1831 => 0.2737, std.dev.: 0.0675) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.36% (0.1559 => 0.1491, std.dev.: 0.0346) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7175.25% (0.3123 => 22.7206, std.dev.: 0.9762) SingleSource/Benchmarks/CoyoteBench/fftbench: 52.94% (0.2463 => 0.3767, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1560.74% (0.3344 => 5.5535, std.dev.: 0.2208) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.32% (0.2364 => 0.3270, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/bigfib: 5.64% (0.6010 => 0.6349, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/mandel: 1.40% (0.0429 => 0.0435, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.42% (0.3266 => 0.3443, std.dev.: 0.1033) SingleSource/Benchmarks/Shootout-C++/strcat: 4.06% (0.1969 => 0.2049, std.dev.: 0.0542) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 9.38% (0.0224 => 0.0245, std.dev.: 0.0085) SingleSource/UnitTests/byval-alignment: -24.35% (0.0230 => 0.0174, std.dev.: 0.0057) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0455, std.dev.: 0.0153) MultiSource/Applications/oggenc/oggenc: 11.42% (0.1462 => 0.1629, std.dev.: 0.0265) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4859, std.dev.: 0.0735) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0765, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4938, std.dev.: 0.0110) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5139, std.dev.: 0.0124) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5430, std.dev.: 0.1511) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3126, std.dev.: 0.0157) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1342, std.dev.: 0.0595) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3653, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4042, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0899, std.dev.: 0.0369) SingleSource/Regression/C/uint64_to_float: -24.13% (2.1832 => 1.6564, std.dev.: 0.0264) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/spiff/spiff: 7.02% (0.7950 => 0.8508, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.66% (1.6386 => 1.6986, std.dev.: 0.0233) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.99% (1.4479 => 1.4912, std.dev.: 0.0114) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 107.54% (0.0199 => 0.0413, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/pi: 58.58% (1.5795 => 2.5048, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.60% (0.7597 => 0.8858, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.35% (2.9753 => 3.4619, std.dev.: 0.0325) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.70% (2.7995 => 3.2111, std.dev.: 0.0332) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.48% (5.0261 => 5.6032, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.82% (0.3186 => 0.3499, std.dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: 8.52% (3.1873 => 3.4590, std.dev.: 0.0289) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.12% (1.1857 => 1.2820, std.dev.: 0.0204) SingleSource/Benchmarks/Misc/richards_benchmark: 6.97% (1.3037 => 1.3946, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.96% (4.9686 => 5.2647, std.dev.: 0.0593) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.82% (2.2485 => 2.3794, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.66% (3.3761 => 3.5335, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 4.66% (7.4933 => 7.8426, std.dev.: 0.0340) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.51% (6.2275 => 6.5083, std.dev.: 0.0266) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.08% (4.9469 => 5.1487, std.dev.: 0.0150) MultiSource/Applications/hexxagon/hexxagon: 4.02% (14.0064 => 14.5693, std.dev.: 0.1114) MultiSource/Applications/siod/siod: 3.31% (3.6643 => 3.7856, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.86% (11.5690 => 11.8994, std.dev.: 0.1150) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.83% (4.8362 => 4.9730, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.59% (8.2783 => 8.4928, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout/lists: 2.53% (7.3375 => 7.5229, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.32% (4.8660 => 4.9790, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.08% (4.4340 => 4.5263, std.dev.: 0.0351) SingleSource/Benchmarks/Misc/ReedSolomon: 1.52% (8.5322 => 8.6616, std.dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.36% (3.5679 => 3.6165, std.dev.: 0.0116) MultiSource/Benchmarks/FreeBench/neural/neural: 1.36% (1.0841 => 1.0988, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.83% (5.4641 => 4.3259, std.dev.: 0.0883) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.58% (7.2130 => 6.1614, std.dev.: 0.1074) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.87% (1.0512 => 0.9369, std.dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: -8.50% (63.1822 => 57.8113, std.dev.: 0.1086) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.92% (14.6451 => 13.6314, std.dev.: 0.1687) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.83% (4.7482 => 4.4241, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.21% (0.3269 => 0.3066, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.91% (3.7148 => 3.4951, std.dev.: 0.0265) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.81% (5.4972 => 5.1780, std.dev.: 0.0850) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.12% (5.1557 => 4.8918, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.74% (6.0224 => 5.7973, std.dev.: 0.0084) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.50% (2.8773 => 2.7766, std.dev.: 0.0092) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.89% (28.5821 => 27.7557, std.dev.: 0.1155) SingleSource/Benchmarks/Shootout-C++/hash2: -2.04% (3.4237 => 3.3540, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.96% (11.5316 => 11.3057, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.16% (5.6343 => 5.5690, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 6.45% (1.0262 => 1.0924, std.dev.: 0.2236) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 12.24% (0.0384 => 0.0431, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 7.86% (0.1438 => 0.1551, std.dev.: 0.0119) MultiSource/Applications/lemon/lemon: 0.71% (1.1329 => 1.1409, std.dev.: 0.3281) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.44% (0.4164 => 0.4349, std.dev.: 0.0201) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.82% (0.1369 => 0.1435, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.78% (0.0641 => 0.0646, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.21% (0.0195 => 0.0211, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.29% (0.0578 => 0.0559, std.dev.: 0.0134) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.03% (1.1437 => 1.1898, std.dev.: 0.0351) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3100.00% (0.0001 => 0.0032, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.87% (0.0627 => 0.0609, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.33% (0.0180 => 0.0195, std.dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.53% (0.8017 => 0.7894, std.dev.: 0.0348) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -33.87% (0.0062 => 0.0041, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 14:12:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 16:12:44 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121121221244.3F0032A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6123?compare_to=6119&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6123, Order: 168451, Start Time: 2012-11-21 20:39:17, End Time: 2012-11-21 22:13:08 To: 6119, Order: 168441, Start Time: 2012-11-21 18:42:52, End Time: 2012-11-21 20:16:12 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (179 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (858 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 7.77% (0.3834 => 0.4132, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.69% (2.0478 => 2.1029, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/salsa20: 2.47% (7.4937 => 7.6790, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 2.20% (3.1932 => 3.2636, std.dev.: 0.0087) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.01% (0.1431 => 0.1302, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.24% (0.3821 => 0.3506, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: -7.09% (0.3357 => 0.3119, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.89% (0.9542 => 0.8885, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.78% (0.3142 => 0.2929, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: -6.64% (2.4924 => 2.3269, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/oourafft: -6.57% (0.2160 => 0.2018, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.51% (0.2428 => 0.2270, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.41% (9.2283 => 8.6370, std.dev.: 0.0150) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.29% (0.9852 => 0.9232, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -6.26% (16.1920 => 15.1776, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.26% (0.5863 => 0.5496, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.19% (1.0544 => 0.9891, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.17% (0.5478 => 0.5140, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.16% (0.2355 => 0.2210, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -6.13% (0.9179 => 0.8616, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.10% (0.7198 => 0.6759, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.09% (3.5339 => 3.3186, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.08% (0.6484 => 0.6090, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: -6.05% (7.0961 => 6.6665, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.00% (1.3722 => 1.2898, std.dev.: 0.0081) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.00% (0.1716 => 0.1613, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.99% (0.5705 => 0.5363, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.97% (0.5591 => 0.5257, std.dev.: 0.0098) SingleSource/Benchmarks/McGill/chomp: -5.96% (0.1761 => 0.1656, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.96% (0.5805 => 0.5459, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.94% (0.5857 => 0.5509, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.94% (0.5925 => 0.5573, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.93% (0.3658 => 0.3441, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.92% (6.7716 => 6.3706, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.91% (0.5802 => 0.5459, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.90% (0.6660 => 0.6267, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.90% (0.5849 => 0.5504, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -5.89% (1.1450 => 1.0776, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.88% (4.8161 => 4.5328, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.87% (0.5575 => 0.5248, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.86% (0.6194 => 0.5831, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.86% (0.6230 => 0.5865, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.85% (0.6667 => 0.6277, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.84% (0.6297 => 0.5929, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.84% (1.4642 => 1.3787, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.83% (0.6052 => 0.5699, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.82% (1.6364 => 1.5411, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.82% (4.0323 => 3.7975, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: -5.81% (4.3330 => 4.0811, std.dev.: 0.0098) MultiSource/Benchmarks/sim/sim: -5.81% (0.3406 => 0.3208, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -5.80% (0.3880 => 0.3655, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.79% (0.5581 => 0.5258, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.79% (0.6446 => 0.6073, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.78% (1.2300 => 1.1589, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.75% (0.6189 => 0.5833, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.75% (0.5859 => 0.5522, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.75% (0.2695 => 0.2540, std.dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: -5.75% (1.1530 => 1.0867, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.75% (0.3896 => 0.3672, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.74% (0.6304 => 0.5942, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.74% (0.6293 => 0.5932, std.dev.: 0.0079) SingleSource/UnitTests/ObjC/trivial-interface: -5.72% (0.3812 => 0.3594, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -5.72% (0.3848 => 0.3628, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.71% (0.5570 => 0.5252, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.71% (0.7919 => 0.7467, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -5.69% (0.3831 => 0.3613, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.67% (4.5069 => 4.2512, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.66% (4.8802 => 4.6039, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.66% (0.5941 => 0.5605, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: -5.65% (0.4033 => 0.3805, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.63% (0.4176 => 0.3941, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.63% (0.3483 => 0.3287, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.61% (0.5688 => 0.5369, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.60% (1.2784 => 1.2068, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.59% (0.5456 => 0.5151, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.58% (0.3891 => 0.3674, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.57% (1.3864 => 1.3092, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.57% (0.5999 => 0.5665, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.56% (0.8521 => 0.8047, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: -5.56% (0.2985 => 0.2819, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/05-eks/eks: -5.56% (0.4515 => 0.4264, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.54% (0.6736 => 0.6363, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.53% (0.2548 => 0.2407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.53% (0.6260 => 0.5914, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.50% (0.2871 => 0.2713, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -5.47% (0.3255 => 0.3077, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.47% (0.6676 => 0.6311, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.46% (0.6681 => 0.6316, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.46% (0.3057 => 0.2890, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -5.45% (1.2515 => 1.1833, std.dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: -5.44% (17.1032 => 16.1721, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.44% (0.3931 => 0.3717, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.44% (0.3016 => 0.2852, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.44% (0.6033 => 0.5705, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -5.43% (1.3148 => 1.2434, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.42% (0.6440 => 0.6091, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.41% (0.4199 => 0.3972, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.39% (0.4916 => 0.4651, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -5.39% (0.3026 => 0.2863, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: -5.36% (0.3581 => 0.3389, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.34% (14.2083 => 13.4494, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/random: -5.31% (0.2939 => 0.2783, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -5.30% (3.5154 => 3.3290, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.30% (0.2999 => 0.2840, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.30% (1.2210 => 1.1563, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.28% (0.2933 => 0.2778, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -5.27% (0.3205 => 0.3036, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: -5.27% (15.5079 => 14.6903, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.27% (0.3323 => 0.3148, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: -5.27% (0.2659 => 0.2519, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: -5.27% (0.2849 => 0.2699, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.26% (0.4813 => 0.4560, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -5.22% (0.3446 => 0.3266, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.22% (0.3025 => 0.2867, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.22% (2.1713 => 2.0579, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.21% (1.6474 => 1.5616, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.20% (0.4151 => 0.3935, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.20% (0.3884 => 0.3682, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.19% (8.0126 => 7.5964, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.19% (0.6395 => 0.6063, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: -5.19% (0.2989 => 0.2834, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: -5.16% (0.3394 => 0.3219, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.15% (0.7339 => 0.6961, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -5.08% (0.3481 => 0.3304, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -5.07% (0.4280 => 0.4063, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.07% (0.5168 => 0.4906, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.07% (1.2221 => 1.1602, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: -5.04% (0.4861 => 0.4616, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/moments: -5.04% (0.4248 => 0.4034, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.03% (0.3319 => 0.3152, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -5.02% (0.7447 => 0.7073, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.01% (0.3252 => 0.3089, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -5.01% (4.0594 => 3.8562, std.dev.: 0.0145) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.00% (0.2278 => 0.2164, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -5.00% (15.2527 => 14.4907, std.dev.: 0.0077) MultiSource/Applications/siod/siod: -4.97% (2.4021 => 2.2826, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.95% (0.2385 => 0.2267, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: -4.93% (2.1401 => 2.0346, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.90% (0.7524 => 0.7155, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.88% (22.4056 => 21.3114, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.87% (0.4083 => 0.3884, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.84% (0.7021 => 0.6681, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -4.84% (0.3867 => 0.3680, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.83% (0.3849 => 0.3663, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.83% (0.5569 => 0.5300, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: -4.81% (0.3621 => 0.3447, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.77% (5.0226 => 4.7828, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -4.77% (0.7982 => 0.7601, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -4.77% (0.3059 => 0.2913, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.76% (0.5567 => 0.5302, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.75% (0.6395 => 0.6091, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.71% (0.5329 => 0.5078, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.65% (0.4427 => 0.4221, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.62% (0.2903 => 0.2769, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.56% (0.4321 => 0.4124, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -4.54% (18.2933 => 17.4621, std.dev.: 0.0298) MultiSource/Benchmarks/McCat/09-vor/vor: -4.52% (0.3271 => 0.3123, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: -4.51% (0.3788 => 0.3617, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.51% (0.6347 => 0.6061, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.50% (2.2587 => 2.1571, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.48% (0.9557 => 0.9129, std.dev.: 0.0045) SingleSource/UnitTests/ObjC++/property-reference: -4.47% (0.7779 => 0.7431, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.47% (0.8418 => 0.8042, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -4.41% (34.0927 => 32.5883, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/bigfib: -4.39% (0.6750 => 0.6454, std.dev.: 0.0098) SingleSource/UnitTests/ObjC++/property-reference-object: -4.30% (0.6441 => 0.6164, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.24% (0.9077 => 0.8692, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: -4.18% (0.4524 => 0.4335, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.15% (0.3491 => 0.3346, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -3.82% (1.5610 => 1.5014, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.49% (5.4682 => 5.2771, std.dev.: 0.0061) SingleSource/UnitTests/Vector/constpool: -2.28% (20.7746 => 20.3002, std.dev.: 0.0846) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7512, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/richards_benchmark: -8.77% (1.2842 => 1.1716, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.82% (2.2633 => 2.1768, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.93% (1.3096 => 1.2712, std.dev.: 0.0106) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.67% (6.5735 => 6.4640, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 15:46:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 17:46:55 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121121234655.8AF062A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6124?compare_to=6122&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6124, Order: 168460, Start Time: 2012-11-21 22:15:15, End Time: 2012-11-21 23:47:21 To: 6122, Order: 168449, Start Time: 2012-11-21 20:22:15, End Time: 2012-11-21 21:58:07 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 4 (63 on baseline) Performance Improvements: 8 (26 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1042 (885 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 9.19% (0.1153 => 0.1259, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 11.09% (19.6392 => 21.8163, std.dev.: 0.7743) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.23% (6.1614 => 6.6068, std.dev.: 0.0466) SingleSource/Benchmarks/Shootout-C++/methcall: 1.36% (8.8658 => 8.9867, std.dev.: 0.0331) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -15.02% (0.0912 => 0.0775, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -13.66% (0.1003 => 0.0866, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.91% (1.1817 => 1.1473, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.62% (0.4844 => 0.4717, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.11% (5.5535 => 5.4362, std.dev.: 0.0241) MultiSource/Applications/SIBsim4/SIBsim4: -1.85% (1.3219 => 1.2975, std.dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: -2.50% (3.4590 => 3.3725, std.dev.: 0.0306) SingleSource/Benchmarks/LivermoreLoops/kernel18: -1.13% (1.3013 => 1.2866, std.dev.: 0.0027) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.28% (1.0924 => 1.0784, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -6.39% (0.0219 => 0.0205, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0427 => 0.0429, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.21% (0.0331 => 0.0327, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -12.78% (0.0313 => 0.0273, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.10% (0.0431 => 0.0409, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0204 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -19.82% (0.0217 => 0.0174, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.13% (0.1551 => 0.1487, std.dev.: 0.0027) MultiSource/Applications/lemon/lemon: -1.16% (1.1409 => 1.1277, std.dev.: 0.0720) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.62% (0.4349 => 0.4148, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.39% (0.1435 => 0.1372, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.95% (0.0646 => 0.0614, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.90% (0.0211 => 0.0215, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.22% (0.0559 => 0.0577, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.02% (1.1898 => 1.1900, std.dev.: 0.0154) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -34.38% (0.0032 => 0.0021, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.57% (0.0609 => 0.0569, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 28.72% (0.0195 => 0.0251, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.08% (0.7894 => 0.7809, std.dev.: 0.0129) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 146.34% (0.0041 => 0.0101, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.01% (16.4461 => 17.5996, std.dev.: 0.3225) MultiSource/Applications/sqlite3/sqlite3: 2312.70% (0.6332 => 15.2772, std.dev.: 0.4098) MultiSource/Benchmarks/McCat/08-main/main: 48.66% (0.1831 => 0.2722, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.41% (0.1559 => 0.1459, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7042.52% (0.3123 => 22.3061, std.dev.: 0.6747) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.99% (0.2463 => 0.3719, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1525.66% (0.3344 => 5.4362, std.dev.: 0.0241) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.73% (0.2364 => 0.3256, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 4.69% (0.6010 => 0.6292, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel: 1.86% (0.0429 => 0.0437, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.93% (0.3266 => 0.3427, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/strcat: 3.35% (0.1969 => 0.2035, std.dev.: 0.0022) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.34% (0.0224 => 0.0227, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -30.87% (0.0230 => 0.0159, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0483, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 12.11% (0.1462 => 0.1639, std.dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4703, std.dev.: 0.0416) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0726, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4941, std.dev.: 0.0127) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5165, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.6612, std.dev.: 0.1070) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3177, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1425, std.dev.: 0.0308) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3628, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4090, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0857, std.dev.: 0.0011) SingleSource/Regression/C/uint64_to_float: -23.87% (2.1832 => 1.6620, std.dev.: 0.0262) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.79% (0.0810 => 0.0946, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.80% (0.0848 => 0.0965, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.37% (0.0830 => 0.0941, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: 13.22% (0.1112 => 0.1259, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.14% (0.1905 => 0.2041, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 4.53% (1.4269 => 1.4916, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.2526 => 1.3086, std.dev.: 0.0049) MultiSource/Applications/lua/lua: 4.08% (3.8189 => 3.9749, std.dev.: 0.0232) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.70% (0.4783 => 0.4960, std.dev.: 0.0050) MultiSource/Applications/minisat/minisat: 3.66% (0.6834 => 0.7084, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/05-eks/eks: 3.50% (0.4397 => 0.4551, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.47% (0.4559 => 0.4717, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.37% (0.6227 => 0.6437, std.dev.: 0.0036) MultiSource/Applications/SIBsim4/SIBsim4: 3.24% (1.2568 => 1.2975, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.13% (2.1401 => 2.2070, std.dev.: 0.0250) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.05% (0.8340 => 0.8594, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.75% (0.8086 => 0.8308, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.71% (1.1170 => 1.1473, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.61% (0.8007 => 0.8216, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.59% (1.4479 => 1.4854, std.dev.: 0.0082) SingleSource/UnitTests/Vector/constpool: 2.56% (8.4179 => 8.6334, std.dev.: 0.0612) MultiSource/Benchmarks/Bullet/bullet: 2.54% (31.8598 => 32.6688, std.dev.: 0.2724) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.49% (0.8611 => 0.8825, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.48% (0.8697 => 0.8913, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.48% (0.8069 => 0.8269, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.42% (0.8457 => 0.8662, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.41% (0.5191 => 0.5316, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 2.35% (0.9810 => 1.0041, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.29% (0.8050 => 0.8234, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: 2.28% (2.3764 => 2.4305, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.18% (0.8204 => 0.8383, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.14% (0.6586 => 0.6727, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.13% (0.7932 => 0.8101, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.09% (0.8317 => 0.8491, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.08% (0.9908 => 1.0114, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.00% (0.8518 => 0.8688, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.96% (0.8286 => 0.8448, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.90% (0.8855 => 0.9023, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.83% (0.8927 => 0.9090, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.79% (0.8885 => 0.9044, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 90.95% (0.0199 => 0.0380, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/pi: 36.33% (1.5795 => 2.1533, std.dev.: 0.1658) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.15% (0.7597 => 0.8824, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.44% (2.7995 => 3.2037, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.58% (5.0261 => 5.6081, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.75% (6.3772 => 7.0627, std.dev.: 0.1149) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.11% (1.1857 => 1.2819, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 7.28% (1.7056 => 1.8297, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.44% (4.7794 => 5.0871, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/richards_benchmark: 5.90% (1.3037 => 1.3806, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.86% (4.9686 => 5.2598, std.dev.: 0.0096) MultiSource/Applications/SIBsim4/SIBsim4: 5.81% (3.1873 => 3.3725, std.dev.: 0.0306) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.80% (4.5327 => 4.7958, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.64% (6.2275 => 6.5164, std.dev.: 0.0602) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.64% (3.3761 => 3.5327, std.dev.: 0.0068) MultiSource/Applications/lambda-0_1_3/lambda: 4.36% (7.4933 => 7.8203, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.07% (4.9469 => 5.1483, std.dev.: 0.0191) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.46% (0.2887 => 0.2987, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.82% (11.5690 => 11.8948, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.66% (8.2783 => 8.4986, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/lists: 2.39% (7.3375 => 7.5131, std.dev.: 0.0296) SingleSource/Benchmarks/Misc/ReedSolomon: 1.17% (8.5322 => 8.6320, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.12% (4.0473 => 4.0928, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.25% (5.4641 => 4.3032, std.dev.: 0.1450) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.78% (1.0512 => 0.9379, std.dev.: 0.0281) SingleSource/Benchmarks/McGill/chomp: -10.67% (1.1216 => 1.0019, std.dev.: 0.0114) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.20% (14.6451 => 13.2977, std.dev.: 0.1322) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -8.40% (7.2130 => 6.6068, std.dev.: 0.0466) MultiSource/Benchmarks/mafft/pairlocalalign: -8.39% (63.1822 => 57.8782, std.dev.: 0.2082) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.93% (4.7482 => 4.4190, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.42% (0.3269 => 0.3059, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.98% (3.7148 => 3.4926, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.91% (5.4972 => 5.1725, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.10% (5.1557 => 4.8926, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.42% (2.8773 => 2.7500, std.dev.: 0.0305) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.38% (4.7449 => 4.5370, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.19% (2.4490 => 2.3465, std.dev.: 0.0325) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.74% (6.0224 => 5.7971, std.dev.: 0.0010) MultiSource/Applications/lua/lua: -3.30% (29.8330 => 28.8487, std.dev.: 0.3735) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.24% (0.5807 => 0.5619, std.dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (28.5821 => 27.7017, std.dev.: 0.0732) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.77% (9.9065 => 9.6319, std.dev.: 0.0935) MultiSource/Benchmarks/FreeBench/mason/mason: -2.75% (0.5415 => 0.5266, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.73% (2.6356 => 2.5637, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/hash2: -2.09% (3.4237 => 3.3522, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (11.5316 => 11.2991, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.67% (4.9994 => 4.9159, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.55% (2.3487 => 2.3124, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.16% (5.6343 => 5.5691, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 5.09% (1.0262 => 1.0784, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 66.67% (0.0123 => 0.0205, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.15% (0.0408 => 0.0429, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 28.74% (0.0254 => 0.0327, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -9.60% (0.0302 => 0.0273, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 6.51% (0.0384 => 0.0409, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -3.33% (0.0180 => 0.0174, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 3.41% (0.1438 => 0.1487, std.dev.: 0.0027) MultiSource/Applications/lemon/lemon: -0.46% (1.1329 => 1.1277, std.dev.: 0.0720) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.38% (0.4164 => 0.4148, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.22% (0.1369 => 0.1372, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.21% (0.0641 => 0.0614, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 10.26% (0.0195 => 0.0215, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.17% (0.0578 => 0.0577, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.05% (1.1437 => 1.1900, std.dev.: 0.0154) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2000.00% (0.0001 => 0.0021, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.25% (0.0627 => 0.0569, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.44% (0.0180 => 0.0251, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.59% (0.8017 => 0.7809, std.dev.: 0.0129) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 62.90% (0.0062 => 0.0101, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 16:09:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 18:09:30 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121122000930.78AAF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6125?compare_to=6123&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6125, Order: 168460, Start Time: 2012-11-21 22:36:09, End Time: 2012-11-22 00:09:56 To: 6123, Order: 168451, Start Time: 2012-11-21 20:39:17, End Time: 2012-11-21 22:13:08 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (181 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (856 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.30% (3.7630 => 3.8119, std.dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.67% (2.0478 => 2.1024, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.4937 => 7.6864, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash2: 2.15% (3.1932 => 3.2617, std.dev.: 0.0026) MultiSource/Benchmarks/llubenchmark/llu: 1.83% (3.7435 => 3.8119, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.15% (0.1431 => 0.1300, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.03% (0.3821 => 0.3514, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -7.35% (0.3848 => 0.3565, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-2: -7.33% (0.3831 => 0.3550, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -7.29% (0.3812 => 0.3534, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -7.19% (0.3896 => 0.3616, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-4: -7.16% (0.3880 => 0.3602, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.14% (0.3891 => 0.3613, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -7.09% (0.4176 => 0.3880, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -7.04% (0.4033 => 0.3749, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -7.03% (0.3357 => 0.3121, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.00% (0.9542 => 0.8874, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -6.98% (2.4924 => 2.3185, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.77% (0.3884 => 0.3621, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -6.76% (0.4199 => 0.3915, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.75% (0.3142 => 0.2930, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.67% (0.7198 => 0.6718, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.57% (0.1584 => 0.1480, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.51% (0.2428 => 0.2270, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -6.50% (0.4280 => 0.4002, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -6.44% (0.2160 => 0.2021, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.40% (0.6484 => 0.6069, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.32% (0.9852 => 0.9229, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -6.32% (9.2283 => 8.6453, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.28% (0.5863 => 0.5495, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.24% (0.2355 => 0.2208, std.dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: -6.23% (7.0961 => 6.6537, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: -6.22% (16.1920 => 15.1855, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/football/football: -6.21% (0.9179 => 0.8609, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.18% (1.3722 => 1.2874, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.16% (1.0544 => 0.9895, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.15% (0.5591 => 0.5247, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.13% (0.5705 => 0.5355, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.12% (0.5478 => 0.5143, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.11% (0.5925 => 0.5563, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.11% (6.7716 => 6.3580, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.09% (0.6667 => 0.6261, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.08% (3.5339 => 3.3191, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.06% (0.6052 => 0.5685, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.06% (0.5805 => 0.5453, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.05% (0.6297 => 0.5916, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.05% (0.5802 => 0.5451, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.04% (0.3658 => 0.3437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.99% (0.6230 => 0.5857, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.99% (4.8161 => 4.5278, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.96% (0.6194 => 0.5825, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.94% (4.0323 => 3.7926, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.92% (0.5570 => 0.5240, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.91% (0.6293 => 0.5921, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -5.91% (0.1761 => 0.1657, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.90% (1.6364 => 1.5398, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.90% (0.2695 => 0.2536, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.89% (1.2300 => 1.1576, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: -5.87% (0.3406 => 0.3206, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.86% (0.6260 => 0.5893, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.86% (4.8802 => 4.5944, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.85% (0.5849 => 0.5507, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.84% (0.5581 => 0.5255, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.84% (0.6660 => 0.6271, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: -5.83% (1.1450 => 1.0783, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -5.82% (4.3330 => 4.0807, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.81% (0.5857 => 0.5517, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -5.80% (1.1530 => 1.0861, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.79% (1.4642 => 1.3794, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.79% (0.6446 => 0.6073, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -5.78% (0.4515 => 0.4254, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.75% (0.5859 => 0.5522, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.75% (0.7919 => 0.7464, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.74% (4.5069 => 4.2480, std.dev.: 0.0157) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.74% (0.8521 => 0.8032, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.73% (0.6304 => 0.5943, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.73% (1.2784 => 1.2052, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.72% (0.5575 => 0.5256, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -5.70% (0.2985 => 0.2815, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.67% (0.6736 => 0.6354, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.66% (0.5941 => 0.5605, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.66% (0.6189 => 0.5839, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.60% (1.3864 => 1.3087, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: -5.58% (1.2515 => 1.1817, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.57% (0.6440 => 0.6081, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.57% (0.5688 => 0.5371, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.57% (0.6681 => 0.6309, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.57% (0.1796 => 0.1696, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -5.56% (17.1032 => 16.1531, std.dev.: 0.0154) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.55% (0.4916 => 0.4643, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.54% (0.6676 => 0.6306, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.50% (14.2083 => 13.4267, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.49% (0.2278 => 0.2153, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.48% (0.3483 => 0.3292, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.48% (8.0126 => 7.5739, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.46% (0.2548 => 0.2409, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -5.45% (0.3581 => 0.3386, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -5.44% (1.3148 => 1.2433, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.44% (0.6033 => 0.5705, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.43% (0.2871 => 0.2715, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.43% (0.3057 => 0.2891, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.42% (0.2659 => 0.2515, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.40% (0.2999 => 0.2837, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: -5.38% (0.2939 => 0.2781, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.37% (0.5999 => 0.5677, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.34% (1.2221 => 1.1568, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.34% (1.2210 => 1.1558, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.32% (0.2933 => 0.2777, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -5.32% (15.5079 => 14.6833, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.27% (0.7339 => 0.6952, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: -5.25% (0.3255 => 0.3084, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.25% (0.4151 => 0.3933, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.24% (0.3931 => 0.3725, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: -5.23% (3.5154 => 3.3314, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/methcall: -5.22% (0.3025 => 0.2867, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.21% (0.3016 => 0.2859, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.20% (0.2385 => 0.2261, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: -5.20% (0.3194 => 0.3028, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: -5.19% (0.2849 => 0.2701, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.18% (0.3319 => 0.3147, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wc: -5.18% (0.3205 => 0.3039, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -5.17% (4.0594 => 3.8494, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.17% (0.2903 => 0.2753, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.17% (0.5168 => 0.4901, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: -5.17% (0.3446 => 0.3268, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -5.16% (0.3394 => 0.3219, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.11% (2.1713 => 2.0604, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.11% (1.6474 => 1.5633, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: -5.10% (0.6347 => 0.6023, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -5.10% (15.2527 => 14.4746, std.dev.: 0.0235) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.10% (0.6395 => 0.6069, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.09% (22.4056 => 21.2643, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/strcat: -5.09% (0.2989 => 0.2837, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.07% (0.4813 => 0.4569, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.06% (0.3837 => 0.3643, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.06% (0.3323 => 0.3155, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.05% (0.5569 => 0.5288, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -5.04% (0.4248 => 0.4034, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -5.02% (0.3026 => 0.2874, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -5.00% (0.3481 => 0.3307, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.00% (0.2001 => 0.1901, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.99% (0.3849 => 0.3657, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.97% (0.7524 => 0.7150, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.96% (0.7021 => 0.6673, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -4.96% (0.7447 => 0.7078, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.95% (0.3252 => 0.3091, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: -4.94% (0.4861 => 0.4621, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.92% (0.4083 => 0.3882, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -4.92% (0.6441 => 0.6124, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -4.92% (0.3621 => 0.3443, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -4.89% (2.4021 => 2.2846, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: -4.89% (0.3867 => 0.3678, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.86% (0.7779 => 0.7401, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: -4.83% (2.1401 => 2.0368, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.82% (0.5329 => 0.5072, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.80% (0.5567 => 0.5300, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.75% (0.2106 => 0.2006, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.71% (0.6395 => 0.6094, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -4.54% (0.3059 => 0.2920, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.54% (2.2587 => 2.1561, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.54% (0.9557 => 0.9123, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -4.54% (0.7982 => 0.7620, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: -4.52% (5.0226 => 4.7958, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: -4.49% (34.0927 => 32.5627, std.dev.: 0.0537) SingleSource/Benchmarks/Misc-C++/bigfib: -4.46% (0.6750 => 0.6449, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: -4.40% (18.2933 => 17.4881, std.dev.: 0.0123) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.40% (0.9077 => 0.8678, std.dev.: 0.0027) MultiSource/Applications/spiff/spiff: -4.40% (0.8418 => 0.8048, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.38% (0.3491 => 0.3338, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.30% (0.4321 => 0.4135, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/sieve: -4.30% (0.3788 => 0.3625, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -4.25% (0.3271 => 0.3132, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -4.18% (0.4524 => 0.4335, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: -3.75% (1.5610 => 1.5024, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.53% (5.4682 => 5.2752, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -2.24% (20.7746 => 20.3101, std.dev.: 0.0131) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7542, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: -8.73% (1.2842 => 1.1721, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -4.00% (2.2633 => 2.1728, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7061, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.57% (1.3096 => 1.2759, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4730, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 16:12:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 18:12:53 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121122001253.51BE32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6126?compare_to=6120&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6126, Order: 168460, Start Time: 2012-11-21 21:54:06, End Time: 2012-11-22 00:13:18 To: 6120, Order: 168440, Start Time: 2012-11-21 18:37:53, End Time: 2012-11-21 20:58:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 70 (164 on baseline) Performance Improvements: 8 (39 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1008 (682 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/messages-2: 14.90% (0.0772 => 0.0887, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 14.86% (2.5979 => 2.9840, std.dev.: 0.0285) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.26% (0.4559 => 0.5209, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 12.85% (0.3448 => 0.3891, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 12.73% (0.6495 => 0.7322, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 12.62% (0.1181 => 0.1330, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 12.59% (0.6784 => 0.7638, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.12% (0.6247 => 0.7004, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.94% (0.6684 => 0.7482, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.84% (0.3698 => 0.4136, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/matrix: 11.60% (0.3380 => 0.3772, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.54% (0.6228 => 0.6947, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.98% (0.6792 => 0.7538, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.41% (0.3160 => 0.3489, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.26% (0.3919 => 0.4321, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: 10.22% (0.9920 => 1.0934, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 10.21% (0.3106 => 0.3423, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.97% (6.0593 => 6.6633, std.dev.: 0.1835) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.66% (0.3997 => 0.4383, std.dev.: 0.0131) MultiSource/Applications/hbd/hbd: 8.97% (1.7321 => 1.8874, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/gs/gs: 8.91% (4.9129 => 5.3506, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/exceptions: 8.54% (0.4310 => 0.4678, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.33% (0.1680 => 0.1820, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.30% (1.5210 => 1.6473, std.dev.: 0.0239) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.15% (0.3348 => 0.3621, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.97% (0.5267 => 0.5687, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 7.89% (0.4436 => 0.4786, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.74% (0.3373 => 0.3634, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.73% (0.2405 => 0.2591, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.73% (0.4178 => 0.4501, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.54% (0.7292 => 0.7842, std.dev.: 0.0177) MultiSource/Applications/sgefa/sgefa: 7.44% (0.3560 => 0.3825, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.42% (0.7060 => 0.7584, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.27% (0.5638 => 0.6048, std.dev.: 0.0134) MultiSource/Benchmarks/Olden/tsp/tsp: 7.19% (0.1418 => 0.1520, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 7.11% (0.3332 => 0.3569, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.11% (4.6940 => 5.0276, std.dev.: 0.0230) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.11% (0.3983 => 0.4266, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.07% (0.3760 => 0.4026, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.07% (0.3027 => 0.3241, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/for-in: 6.99% (0.4148 => 0.4438, std.dev.: 0.0094) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.97% (0.9650 => 1.0323, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.91% (0.4185 => 0.4474, std.dev.: 0.0110) MultiSource/Benchmarks/nbench/nbench: 6.58% (1.3387 => 1.4268, std.dev.: 0.0192) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.89% (1.6601 => 1.7412, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/salsa20: 4.81% (0.2098 => 0.2199, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.13% (5.9311 => 6.1761, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.71% (0.6842 => 0.7096, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.30% (0.6798 => 0.7022, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.84% (1.2873 => 1.3238, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/synchronized: 2.56% (0.4184 => 0.4291, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 2.51% (0.5308 => 0.5441, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 2.41% (0.4567 => 0.4677, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 1.60% (18.2550 => 18.5473, std.dev.: 0.0835) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.43% (1.5554 => 1.9820, std.dev.: 0.0298) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.85% (0.0839 => 0.0972, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/health/health: 9.59% (0.4608 => 0.5050, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.52% (9.1521 => 10.0237, std.dev.: 0.0558) MultiSource/Benchmarks/Olden/tsp/tsp: 8.93% (1.1025 => 1.2010, std.dev.: 0.0219) MultiSource/Benchmarks/Olden/mst/mst: 8.28% (0.1389 => 0.1504, std.dev.: 0.0013) MultiSource/Benchmarks/llubenchmark/llu: 6.98% (8.2939 => 8.8730, std.dev.: 0.0878) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.97% (0.5769 => 0.6171, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.80% (5.3301 => 5.5324, std.dev.: 0.0338) SingleSource/Benchmarks/CoyoteBench/huffbench: 2.82% (18.7970 => 19.3263, std.dev.: 0.1944) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.80% (4.2385 => 4.3572, std.dev.: 0.0088) MultiSource/Applications/sgefa/sgefa: 2.28% (0.6304 => 0.6448, std.dev.: 0.0040) MultiSource/Applications/siod/siod: 2.22% (3.2433 => 3.3153, std.dev.: 0.0184) SingleSource/Benchmarks/Dhrystone/fldry: 2.13% (1.9355 => 1.9768, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.26% (4.8173 => 4.8779, std.dev.: 0.0231) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.16% (7.2978 => 7.3821, std.dev.: 0.0242) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel14: -10.81% (0.1221 => 0.1089, std.dev.: 0.0048) SingleSource/Benchmarks/LivermoreLoops/kernel13: -10.64% (0.1212 => 0.1083, std.dev.: 0.0047) SingleSource/Benchmarks/LivermoreLoops/kernel12: -10.36% (0.1110 => 0.0995, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -9.35% (0.2332 => 0.2114, std.dev.: 0.0082) SingleSource/Benchmarks/LivermoreLoops/kernel18: -7.75% (0.1600 => 0.1476, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.54% (5.4467 => 5.3086, std.dev.: 0.0440) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.22% (5.1360 => 5.0735, std.dev.: 0.0227) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.01% (4.4304 => 4.3857, std.dev.: 0.0145) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.09% (69.3654 => 69.4300, std.dev.: 0.4894) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.51% (0.1368 => 0.1361, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.73% (0.0419 => 0.0443, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.13% (0.0678 => 0.0650, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: -0.08% (494.2451 => 493.8623, std.dev.: 0.2700) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.78% (63.2438 => 69.4300, std.dev.: 0.4894) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.99% (4.3882 => 0.0443, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43693.77% (1.1277 => 493.8623, std.dev.: 0.2700) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 216.31% (0.5229 => 1.6540, std.dev.: 0.0667) MultiSource/Applications/SPASS/SPASS: 23.74% (14.9895 => 18.5473, std.dev.: 0.0835) MultiSource/Applications/kimwitu++/kc: 48.59% (14.1553 => 21.0327, std.dev.: 0.3190) MultiSource/Benchmarks/MallocBench/gs/gs: 30.17% (4.1105 => 5.3506, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 49.10% (1.1048 => 1.6473, std.dev.: 0.0239) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.53% (7.1582 => 37.5467, std.dev.: 0.8117) SingleSource/Benchmarks/Misc-C++-EH/spirit: 92.42% (3.4629 => 6.6633, std.dev.: 0.1835) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.03% (0.6222 => 1.0268, std.dev.: 0.0818) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11067.64% (0.0720 => 8.0407, std.dev.: 0.1608) MultiSource/Applications/SIBsim4/SIBsim4: 3860500.00% (0.0001 => 3.8606, std.dev.: 0.0322) MultiSource/Applications/SPASS/SPASS: 12919500.00% (0.0001 => 12.9196, std.dev.: 1.0099) MultiSource/Applications/kimwitu++/kc: 53400.00% (0.0001 => 0.0535, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 64200.00% (0.0001 => 0.0643, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14500.00% (0.0001 => 0.0146) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 617000.00% (0.0001 => 0.6171, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10076400.00% (0.0001 => 10.0765, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6386600.00% (0.0001 => 6.3867, std.dev.: 0.5114) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1828.10% (1.1194 => 21.5831, std.dev.: 0.3746) MultiSource/Applications/ClamAV/clamscan: 65.24% (22.1758 => 36.6426, std.dev.: 0.6718) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 60.52% (2.9384 => 4.7166, std.dev.: 0.2536) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.41% (7.0540 => 11.0329, std.dev.: 0.2465) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.29% (8.1363 => 12.1467, std.dev.: 0.0380) MultiSource/Applications/JM/lencod/lencod: 47.24% (21.9371 => 32.2994, std.dev.: 0.2798) MultiSource/Benchmarks/FreeBench/distray/distray: 46.40% (0.1056 => 0.1546, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops: 38.34% (0.1432 => 0.1981, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/almabench: 37.95% (0.0730 => 0.1007, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/messages-2: 33.99% (0.0662 => 0.0887, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/Oscar: 31.92% (0.0636 => 0.0839, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 31.48% (0.1566 => 0.2059, std.dev.: 0.0094) MultiSource/Applications/lambda-0_1_3/lambda: 30.96% (0.7433 => 0.9734, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 30.21% (0.0672 => 0.0875, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 29.92% (0.0528 => 0.0686, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 29.91% (2.2969 => 2.9840, std.dev.: 0.0285) SingleSource/UnitTests/vla: 29.58% (0.0355 => 0.0460, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: 29.36% (0.1175 => 0.1520, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 28.98% (0.1584 => 0.2043, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/life/life: 27.65% (0.0933 => 0.1191, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/mst/mst: 27.43% (0.1163 => 0.1482, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 27.17% (5.7591 => 7.3239, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 26.96% (0.4103 => 0.5209, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 26.47% (0.0442 => 0.0559, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.32% (0.8172 => 1.0323, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 26.09% (0.5569 => 0.7022, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 25.57% (0.3441 => 0.4321, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.47% (0.2065 => 0.2591, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/family/family: 25.19% (0.0397 => 0.0497, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 24.94% (1.3050 => 1.6305, std.dev.: 0.0108) MultiSource/Benchmarks/MallocBench/espresso/espresso: 24.48% (4.2646 => 5.3086, std.dev.: 0.0440) MultiSource/Benchmarks/llubenchmark/llu: 24.46% (0.0462 => 0.0575, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bisort/bisort: 23.94% (0.0614 => 0.0761, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 23.92% (0.1555 => 0.1927, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.59% (0.0746 => 0.0922, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.56% (0.0730 => 0.0902, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.51% (0.0770 => 0.0951, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 23.48% (5.0018 => 6.1761, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.32% (0.1029 => 0.1269, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 23.28% (0.1117 => 0.1377, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 23.23% (0.4615 => 0.5687, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 23.06% (0.3162 => 0.3891, std.dev.: 0.0084) MultiSource/Applications/sgefa/sgefa: 23.03% (0.3109 => 0.3825, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 22.74% (1.4186 => 1.7412, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/football/football: 22.56% (0.8921 => 1.0934, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 22.20% (0.3828 => 0.4678, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/08-main/main: 22.00% (0.2554 => 0.3116, std.dev.: 0.0147) SingleSource/UnitTests/ObjC/parameter-passing: 21.87% (0.3927 => 0.4786, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: 21.76% (0.3098 => 0.3772, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/wordfreq: 21.74% (0.3307 => 0.4026, std.dev.: 0.0096) MultiSource/Benchmarks/sim/sim: 21.73% (0.3387 => 0.4123, std.dev.: 0.0101) MultiSource/Benchmarks/NPB-serial/is/is: 21.14% (0.0719 => 0.0871, std.dev.: 0.0036) MultiSource/Applications/hbd/hbd: 20.96% (1.5603 => 1.8874, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/strcat: 20.91% (0.2831 => 0.3423, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.70% (0.2758 => 0.3329, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 20.69% (0.3427 => 0.4136, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/sumcol: 20.68% (0.2891 => 0.3489, std.dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 20.51% (1.1840 => 1.4268, std.dev.: 0.0192) SingleSource/UnitTests/ObjC/synchronized: 20.50% (0.3561 => 0.4291, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 20.48% (0.5020 => 0.6048, std.dev.: 0.0134) SingleSource/UnitTests/ObjC/instance-method-metadata: 20.41% (0.3543 => 0.4266, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/property: 20.36% (0.3886 => 0.4677, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/for-in: 20.14% (0.3694 => 0.4438, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 20.08% (0.3650 => 0.4383, std.dev.: 0.0131) MultiSource/Applications/lua/lua: 19.95% (3.8723 => 4.6447, std.dev.: 0.1601) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.55% (0.0793 => 0.0948, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 19.39% (0.1114 => 0.1330, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: 19.26% (0.3473 => 0.4142, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 19.22% (14.3668 => 17.1286, std.dev.: 0.2749) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.93% (0.2700 => 0.3211, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 18.64% (0.5981 => 0.7096, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/moments: 18.21% (0.4048 => 0.4785, std.dev.: 0.0190) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.64% (0.3826 => 0.4501, std.dev.: 0.0082) SingleSource/UnitTests/ObjC/exceptions-4: 17.47% (0.3543 => 0.4162, std.dev.: 0.0140) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 17.06% (0.0838 => 0.0981, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.98% (0.0842 => 0.0985, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 16.65% (1.5859 => 1.8499, std.dev.: 0.0983) MultiSource/Benchmarks/Olden/health/health: 16.48% (0.1268 => 0.1477, std.dev.: 0.0052) MultiSource/Applications/d/make_dparser: 16.23% (3.3354 => 3.8766, std.dev.: 0.1737) MultiSource/Applications/sqlite3/sqlite3: 16.22% (17.1811 => 19.9684, std.dev.: 0.5066) SingleSource/UnitTests/ObjC++/Hello: 16.05% (0.5925 => 0.6876, std.dev.: 0.0202) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.04% (0.2793 => 0.3241, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout/matrix: 16.01% (0.0818 => 0.0949, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.00% (0.0675 => 0.0783, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 15.90% (2.2024 => 2.5526, std.dev.: 0.1276) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.88% (0.3136 => 0.3634, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.83% (0.0834 => 0.0966, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.53% (0.0953 => 0.1101, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.41% (0.8067 => 0.9310, std.dev.: 0.0197) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.27% (0.6450 => 0.7435, std.dev.: 0.0277) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.24% (0.0886 => 0.1021, std.dev.: 0.0047) SingleSource/UnitTests/ObjC++/property-reference-object: 14.74% (0.6030 => 0.6919, std.dev.: 0.0134) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.66% (0.2271 => 0.2604, std.dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 14.66% (1.2842 => 1.4724, std.dev.: 0.0652) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.59% (0.1940 => 0.2223, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.55% (0.0770 => 0.0882, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference: 14.51% (0.7326 => 0.8389, std.dev.: 0.0126) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.48% (0.2107 => 0.2412, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.29% (0.1337 => 0.1528, std.dev.: 0.0064) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.07% (0.3121 => 0.3560, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 13.99% (0.3131 => 0.3569, std.dev.: 0.0085) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 13.98% (0.3177 => 0.3621, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 13.82% (9.4845 => 10.7951, std.dev.: 0.4043) MultiSource/Benchmarks/Prolangs-C++/city/city: 13.71% (2.0665 => 2.3498, std.dev.: 0.0926) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.70% (0.3935 => 0.4474, std.dev.: 0.0110) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.56% (0.1062 => 0.1206, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.40% (0.5860 => 0.6645, std.dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.31% (0.9765 => 1.1065, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.18% (0.1032 => 0.1168, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/wc: 13.07% (0.3052 => 0.3451, std.dev.: 0.0139) MultiSource/Benchmarks/McCat/18-imp/imp: 13.06% (0.3423 => 0.3870, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.40% (4.9449 => 5.5582, std.dev.: 0.1597) SingleSource/Benchmarks/Shootout-C++/methcall: 12.37% (0.2877 => 0.3233, std.dev.: 0.0132) MultiSource/Benchmarks/Olden/power/power: 12.29% (0.1440 => 0.1617, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.88% (0.8101 => 0.9063, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 11.79% (0.3180 => 0.3555, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.52% (0.4879 => 0.5441, std.dev.: 0.0011) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.85% (0.1143 => 0.1267, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/05-eks/eks: 10.79% (0.4299 => 0.4763, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.68% (0.2603 => 0.2881, std.dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/bc/bc: 10.42% (1.1861 => 1.3097, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 9.43% (0.1463 => 0.1601, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.42% (0.2430 => 0.2659, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.84% (7.9617 => 8.5856, std.dev.: 0.0986) MultiSource/Benchmarks/Olden/bh/bh: 7.54% (0.3092 => 0.3325, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 7.09% (10.3673 => 11.1028, std.dev.: 0.2080) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.64% (2.2022 => 2.3265, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.48% (4.3953 => 11.0092, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/methcall: 147.43% (5.3999 => 13.3612, std.dev.: 0.0104) MultiSource/Benchmarks/llubenchmark/llu: 134.85% (3.7781 => 8.8730, std.dev.: 0.0878) MultiSource/Applications/minisat/minisat: 31.47% (9.1159 => 11.9844, std.dev.: 0.4083) MultiSource/Benchmarks/VersaBench/dbms/dbms: 31.38% (1.5086 => 1.9820, std.dev.: 0.0298) SingleSource/Benchmarks/Misc/oourafft: 17.51% (6.6465 => 7.8100, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/mst/mst: 17.04% (0.1285 => 0.1504, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.67% (1.1145 => 1.3003, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 15.48% (8.6802 => 10.0237, std.dev.: 0.0558) MultiSource/Benchmarks/Olden/health/health: 13.61% (0.4445 => 0.5050, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.94% (0.2944 => 0.3325, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bisort/bisort: 12.53% (0.8333 => 0.9377, std.dev.: 0.0310) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.50% (0.0864 => 0.0972, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.59% (2.8904 => 3.2253, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: 11.36% (1.0785 => 1.2010, std.dev.: 0.0219) SingleSource/Benchmarks/Misc/richards_benchmark: 10.24% (1.1396 => 1.2563, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.31% (1.7254 => 1.8860, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.94% (4.2280 => 4.4792, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 5.11% (26.0924 => 27.4253, std.dev.: 0.0827) SingleSource/Regression/C/uint64_to_float: 5.04% (0.5413 => 0.5686, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.03% (11.6436 => 12.1127, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: 3.62% (0.6223 => 0.6448, std.dev.: 0.0040) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.11% (2.1424 => 2.2090, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.73% (1.2838 => 1.3188, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: 2.59% (2.4116 => 2.4741, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 2.14% (85.0658 => 86.8847, std.dev.: 0.0598) MultiSource/Applications/aha/aha: 2.10% (3.1595 => 3.2259, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.62% (27.8444 => 28.2947, std.dev.: 0.0128) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.49% (6.5088 => 6.6055, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.29% (1.0313 => 1.0446, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.22% (5.2139 => 5.2773, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0500, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.28% (6.6874 => 0.1820, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -74.91% (5.2763 => 1.3238, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/salsa20: -74.58% (0.8651 => 0.2199, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -45.01% (0.1622 => 0.0892, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.62% (5.3855 => 4.7596, std.dev.: 0.1095) MultiSource/Applications/JM/ldecod/ldecod: -11.33% (10.4361 => 9.2541, std.dev.: 0.3753) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.07% (5.3526 => 5.0276, std.dev.: 0.0230) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.20% (0.0628 => 0.0363) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.23% (0.3987 => 0.2383, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.26% (4.5009 => 2.7787, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: -33.52% (1.1492 => 0.7640, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.18% (2.6546 => 2.0126, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/mason/mason: -19.30% (0.2161 => 0.1744, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.65% (1.6925 => 1.4276, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2839, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.78% (32.5116 => 29.0061, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -10.54% (9.5636 => 8.5552, std.dev.: 0.1178) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4244, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.48% (3.2416 => 3.0317, std.dev.: 0.0246) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.47% (1.6805 => 1.5718, std.dev.: 0.0231) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.78% (1.5835 => 1.5078, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.69% (0.2497 => 0.2380, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -4.24% (6.2999 => 6.0328, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.40% (0.9957 => 0.9618, std.dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.12% (19.9488 => 19.3263, std.dev.: 0.1944) MultiSource/Benchmarks/sim/sim: -3.04% (5.0483 => 4.8946, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.29% (0.4808 => 0.4698, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.03% (8.1563 => 7.9907, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6771, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -1.48% (10.2830 => 10.1307, std.dev.: 0.0056) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.35% (0.1485 => 0.1361, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.28% (0.2116 => 0.0650, std.dev.: 0.0018) Report Time: 2.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 17:38:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 19:38:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121122013820.4031E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6127?compare_to=6121&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6127, Order: 168460, Start Time: 2012-11-21 22:18:05, End Time: 2012-11-22 01:38:46 To: 6121, Order: 168437, Start Time: 2012-11-21 18:09:15, End Time: 2012-11-21 21:29:53 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (170 on baseline) Performance Improvements: 2 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1088 (720 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.04% (2.0625 => 2.1045, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.43% (54.0303 => 54.8051, std.dev.: 0.0281) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.38% (1.1417 => 1.1259, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.76% (0.3911 => 0.3803, std.dev.: 0.0035) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.52% (0.0625 => 0.0897, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.58% (0.1063 => 0.1420, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 26.17% (1.5932 => 2.0102, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.14% (0.2969 => 0.3745, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.77% (0.1106 => 0.1391, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.14% (0.4253 => 0.5322, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.93% (0.4139 => 0.5171, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.51% (0.0714 => 0.0889, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.95% (0.0547 => 0.0678, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.58% (0.0475 => 0.0587, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.41% (0.4994 => 0.6163, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.12% (0.5000 => 0.6156, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.10% (0.5900 => 0.7263, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.77% (0.0584 => 0.0717, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 22.04% (0.0599 => 0.0731) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.94% (0.1021 => 0.1245, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.85% (0.1620 => 0.1974, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.68% (0.1107 => 0.1347, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.63% (0.0897 => 0.1091, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.70% (0.0633 => 0.0764, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 20.57% (0.0948 => 0.1143, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.56% (0.0642 => 0.0774, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0584 => 0.0704, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.52% (0.0541 => 0.0652, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.40% (0.1103 => 0.1328) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.11% (0.3903 => 0.4688, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: 20.10% (0.0821 => 0.0986, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.04% (0.1003 => 0.1204, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 19.89% (0.1619 => 0.1941, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.89% (0.1604 => 0.1923, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.88% (0.1549 => 0.1857, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.71% (0.0822 => 0.0984, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: 19.70% (0.0604 => 0.0723, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 18.90% (0.0947 => 0.1126, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.88% (0.1462 => 0.1738, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 18.81% (0.0808 => 0.0960, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.53% (0.3890 => 0.4611, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.12% (0.2014 => 0.2379, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: 17.98% (0.1218 => 0.1437, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.78% (1.3152 => 1.5490, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/mst/mst: 17.77% (0.0698 => 0.0822, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.74% (0.1088 => 0.1281, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.73% (0.2736 => 0.3221, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 17.55% (0.4029 => 0.4736, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 17.47% (0.5826 => 0.6844, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 17.41% (0.1505 => 0.1767, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.20% (0.2866 => 0.3359, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 17.20% (0.5546 => 0.6500, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 17.08% (0.5889 => 0.6895, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.74% (3.5627 => 4.1592, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 16.64% (1.8794 => 2.1921, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.62% (0.1968 => 0.2295, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.51% (0.4658 => 0.5427, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.49% (1.6211 => 1.8885, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.42% (0.3271 => 0.3808, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.38% (0.1160 => 0.1350, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.17% (0.2875 => 0.3340, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 16.11% (0.9697 => 1.1259, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 16.08% (1.0781 => 1.2515, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.03% (0.4361 => 0.5060, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 15.90% (0.1421 => 0.1647, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.70% (0.5026 => 0.5815, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 15.68% (0.2780 => 0.3216, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.60% (2.7292 => 3.1550, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.60% (0.3930 => 0.4543, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 15.58% (0.1284 => 0.1484, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.57% (4.4195 => 5.1077, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.52% (0.2738 => 0.3163, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 15.51% (0.2811 => 0.3247, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 15.41% (0.2725 => 0.3145, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 15.38% (0.3004 => 0.3466, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.33% (0.2792 => 0.3220, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 15.33% (0.2714 => 0.3130, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.32% (0.1090 => 0.1257, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 15.29% (4.2109 => 4.8548, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/objinst: 15.27% (0.2823 => 0.3254, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.24% (0.2729 => 0.3145, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 15.24% (0.2750 => 0.3169, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 15.23% (0.9909 => 1.1418, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 15.22% (0.2813 => 0.3241, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 15.12% (0.3096 => 0.3564, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 15.09% (0.7171 => 0.8253, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 15.06% (0.2803 => 0.3225, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.93% (0.3195 => 0.3672, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.91% (1.9694 => 2.2631, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.87% (0.2911 => 0.3344, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.80% (1.9966 => 2.2921, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.72% (2.0673 => 2.3717, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 14.60% (0.2075 => 0.2378, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: 14.45% (0.3267 => 0.3739, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 14.44% (23.5202 => 26.9172, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/ary: 14.33% (0.3258 => 0.3725, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.15% (0.3060 => 0.3493, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 14.15% (0.2566 => 0.2929, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 14.14% (0.3317 => 0.3786, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.95% (0.3362 => 0.3831, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 13.93% (0.3446 => 0.3926, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.91% (0.3465 => 0.3947, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 13.87% (0.3678 => 0.4188, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.86% (0.3124 => 0.3557, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 13.82% (0.3496 => 0.3979, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 13.80% (1.4269 => 1.6238, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/synchronized: 13.78% (0.3469 => 0.3947, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.76% (0.3488 => 0.3968, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.76% (0.3460 => 0.3936, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.71% (0.3442 => 0.3914, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 13.68% (0.3348 => 0.3806, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.65% (0.3282 => 0.3730, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 13.61% (0.3726 => 0.4233, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.54% (0.3625 => 0.4116, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.46% (0.3981 => 0.4517, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 13.46% (0.3477 => 0.3945, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 13.42% (0.3650 => 0.4140, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 13.31% (0.3643 => 0.4128, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 13.31% (0.7875 => 0.8923, std.dev.: 0.0061) MultiSource/Applications/JM/ldecod/ldecod: 13.14% (2.1653 => 2.4499, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.09% (0.3690 => 0.4173, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 13.08% (0.3724 => 0.4211, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash: 13.05% (0.4146 => 0.4687, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 12.89% (0.4251 => 0.4799, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 12.80% (4.6177 => 5.2089, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.74% (0.3845 => 0.4335, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 12.56% (2.1013 => 2.3652, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 12.33% (0.5012 => 0.5630, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 12.11% (0.2691 => 0.3017, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.06% (0.2040 => 0.2286, std.dev.: 0.0084) MultiSource/Applications/SPASS/SPASS: 11.55% (5.5417 => 6.1816, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.44% (0.6435 => 0.7171, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 11.15% (0.3498 => 0.3888, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.89% (0.1028 => 0.1140, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.77% (0.1383 => 0.1532, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 10.56% (0.4847 => 0.5359, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.54% (0.2068 => 0.2286, std.dev.: 0.0049) MultiSource/Applications/siod/siod: 10.39% (0.6634 => 0.7323, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.34% (0.2737 => 0.3020, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.15% (0.3084 => 0.3397, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 9.92% (0.3336 => 0.3667, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 9.57% (2.0346 => 2.2293, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.37% (0.2103 => 0.2300, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 9.33% (0.2391 => 0.2614, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.80% (0.5361 => 0.5833, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.53% (4.6926 => 5.0931, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.12% (11.6398 => 12.5846, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.89% (0.7426 => 0.8012, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.65% (0.5584 => 0.6011, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 6.54% (11.9555 => 12.7377, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.43% (0.3792 => 0.3960, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 9.39% (0.2802 => 0.3065, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6097, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 5.84% (0.2122 => 0.2246, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (12.0509 => 12.6629, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-2: 4.87% (1.8057 => 1.8936, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1671, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6417, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.98% (0.3693 => 0.3803, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2084, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2239, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3021, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2870, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5869, std.dev.: 0.0230) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.71% (2.4764 => 2.4092, std.dev.: 0.0182) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5750, std.dev.: 0.0081) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9776, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8041, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary2: -7.04% (0.2402 => 0.2233, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8048, std.dev.: 0.0133) SingleSource/Benchmarks/Dhrystone/fldry: -3.17% (17.2379 => 16.6914, std.dev.: 0.0706) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0039) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7733, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.20% (41.7953 => 40.8778, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.81% (10.7630 => 10.5680, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4949, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.1982, std.dev.: 0.0706) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0433, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 17:42:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 19:42:16 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121122014216.3AB302A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6128?compare_to=6124&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6128, Order: 168471, Start Time: 2012-11-22 00:07:14, End Time: 2012-11-22 01:42:43 To: 6124, Order: 168460, Start Time: 2012-11-21 22:15:15, End Time: 2012-11-21 23:47:21 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 26 (65 on baseline) Performance Improvements: 2 (21 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1026 (888 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/McGill/queens: 51.41% (0.0461 => 0.0698, std.dev.: 0.0029) SingleSource/Benchmarks/Stanford/FloatMM: 45.70% (0.0407 => 0.0593, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.55% (0.2117 => 0.2298, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.21% (0.4172 => 0.4473, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/sieve: 6.76% (0.2810 => 0.3000, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary: 6.23% (0.2423 => 0.2574, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.95% (5.4362 => 5.7598, std.dev.: 0.1212) SingleSource/Benchmarks/Linpack/linpack-pc: 5.85% (0.2357 => 0.2495, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 5.78% (0.2006 => 0.2122, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.85% (0.3217 => 0.3341, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Queens: 77.13% (0.0258 => 0.0457, std.dev.: 0.0024) SingleSource/Benchmarks/LivermoreLoops/kernel24: 51.13% (0.2478 => 0.3745, std.dev.: 0.0326) SingleSource/Benchmarks/Shootout-C++/heapsort: 50.56% (3.0757 => 4.6307, std.dev.: 0.0762) SingleSource/Benchmarks/CoyoteBench/fftbench: 31.72% (1.6612 => 2.1882, std.dev.: 0.1022) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.63% (1.5022 => 1.8872, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/pi: 15.52% (2.1533 => 2.4874, std.dev.: 0.0113) MultiSource/Benchmarks/McCat/09-vor/vor: 9.13% (0.1292 => 0.1410, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.96% (0.3305 => 0.3535, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 4.39% (3.1714 => 3.3106, std.dev.: 0.0432) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 3.69% (1.2391 => 1.2848, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/lists: 3.53% (16.7435 => 17.3347, std.dev.: 0.0457) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.92% (60.0874 => 61.8400, std.dev.: 0.6698) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.53% (5.0246 => 5.1515, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.98% (1.5847 => 1.6160, std.dev.: 0.0071) MultiSource/Applications/lua/lua: 1.53% (28.8487 => 29.2914, std.dev.: 0.0633) SingleSource/Benchmarks/Misc/flops-8: 1.19% (2.5643 => 2.5949, std.dev.: 0.0116) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.88% (7.0627 => 6.7179, std.dev.: 0.0990) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.89% (6.6068 => 6.3497, std.dev.: 0.0689) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.09% (1.0784 => 1.0902, std.dev.: 0.0148) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 7.32% (0.0205 => 0.0220, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.70% (0.0429 => 0.0426, std.dev.: 0.0111) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.67% (0.0327 => 0.0339, std.dev.: 0.0079) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 15.02% (0.0273 => 0.0314, std.dev.: 0.0077) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 4.40% (0.0409 => 0.0427, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0203 => 0.0203, std.dev.: 0.0059) SingleSource/UnitTests/Vector/Altivec/test1: 28.16% (0.0174 => 0.0223, std.dev.: 0.0066) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.96% (0.1487 => 0.1531, std.dev.: 0.0072) MultiSource/Applications/lemon/lemon: 3.99% (1.1277 => 1.1727, std.dev.: 0.2514) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.10% (0.4148 => 0.4318, std.dev.: 0.0262) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.19% (0.1372 => 0.1402, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.37% (0.0614 => 0.0647, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 26.98% (0.0215 => 0.0273, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.81% (0.0577 => 0.0555, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 2.54% (1.1900 => 1.2202, std.dev.: 0.0334) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 47.62% (0.0021 => 0.0031, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.75% (0.0569 => 0.0596, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.37% (0.0251 => 0.0267, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.23% (0.7809 => 0.7791, std.dev.: 0.1364) SingleSource/Regression/C/2003-05-21-UnionBitfields: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 21.78% (0.0101 => 0.0123, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.83% (16.4461 => 17.8977, std.dev.: 0.3668) MultiSource/Applications/sqlite3/sqlite3: 2378.06% (0.6332 => 15.6911, std.dev.: 0.5328) MultiSource/Benchmarks/McCat/08-main/main: 51.12% (0.1831 => 0.2767, std.dev.: 0.0203) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.94% (0.1559 => 0.1482, std.dev.: 0.0512) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7127.06% (0.3123 => 22.5701, std.dev.: 0.4822) SingleSource/Benchmarks/CoyoteBench/fftbench: 59.32% (0.2463 => 0.3924, std.dev.: 0.0688) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1622.43% (0.3344 => 5.7598, std.dev.: 0.1212) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.54% (0.2364 => 0.3275, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/bigfib: 5.22% (0.6010 => 0.6324, std.dev.: 0.0249) SingleSource/Benchmarks/Misc/mandel: 3.50% (0.0429 => 0.0444, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.07% (0.3266 => 0.3595, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/strcat: 10.36% (0.1969 => 0.2173, std.dev.: 0.0625) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.59% (0.0224 => 0.0241, std.dev.: 0.0079) SingleSource/UnitTests/byval-alignment: -25.65% (0.0230 => 0.0171, std.dev.: 0.0050) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0524, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 11.97% (0.1462 => 0.1637, std.dev.: 0.0129) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4857, std.dev.: 0.0621) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0730, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4936, std.dev.: 0.0503) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5148, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 2.1882, std.dev.: 0.1022) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3249, std.dev.: 0.0269) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1391, std.dev.: 0.0423) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3634, std.dev.: 0.0410) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4100, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0849, std.dev.: 0.0264) SingleSource/Regression/C/uint64_to_float: -23.92% (2.1832 => 1.6609, std.dev.: 0.1476) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/McGill/queens: 59.36% (0.0438 => 0.0698, std.dev.: 0.0029) SingleSource/Benchmarks/Stanford/FloatMM: 50.51% (0.0394 => 0.0593, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/ary3: 42.55% (0.0235 => 0.0335, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 18.51% (0.0848 => 0.1005, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.75% (0.8321 => 0.9132, std.dev.: 0.0208) SingleSource/Benchmarks/Shootout-C++/sieve: 8.89% (0.2755 => 0.3000, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.86% (0.2111 => 0.2298, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.85% (0.2180 => 0.2373, std.dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.54% (0.1885 => 0.2046, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 8.44% (0.4125 => 0.4473, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/ary: 7.70% (0.2390 => 0.2574, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.26% (0.3115 => 0.3341, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/random: 6.42% (0.1994 => 0.2122, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.37% (0.2998 => 0.3189, std.dev.: 0.0052) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (0.3137 => 0.3326, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.34% (0.2060 => 0.2170, std.dev.: 0.0034) MultiSource/Applications/lua/lua: 5.12% (3.8189 => 4.0143, std.dev.: 0.0206) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.67% (0.2378 => 0.2489, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: 4.66% (0.2985 => 0.3124, std.dev.: 0.0052) MultiSource/Applications/minisat/minisat: 4.23% (0.6834 => 0.7123, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.22% (0.5191 => 0.5410, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.98% (0.6227 => 0.6475, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.36% (0.8597 => 0.8886, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.28% (0.3717 => 0.3839, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 2.91% (0.9810 => 1.0095, std.dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 109.55% (0.0199 => 0.0417, std.dev.: 0.0017) SingleSource/Benchmarks/Stanford/Queens: 63.80% (0.0279 => 0.0457, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/pi: 57.48% (1.5795 => 2.4874, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/heapsort: 51.75% (3.0515 => 4.6307, std.dev.: 0.0762) SingleSource/Benchmarks/Shootout-C++/moments: 22.76% (0.0949 => 0.1165, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.72% (0.7597 => 0.8867, std.dev.: 0.0334) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.34% (2.9753 => 3.4616, std.dev.: 0.0304) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.86% (2.7995 => 3.2154, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 11.82% (0.1261 => 0.1410, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.76% (5.0261 => 5.6173, std.dev.: 0.0652) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.95% (0.3186 => 0.3535, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.19% (1.1857 => 1.2828, std.dev.: 0.0211) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 7.56% (2.2485 => 2.4185, std.dev.: 0.0137) MultiSource/Applications/SIBsim4/SIBsim4: 7.00% (3.1873 => 3.4103, std.dev.: 0.0391) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.76% (4.7794 => 5.1027, std.dev.: 0.0406) SingleSource/Benchmarks/Misc/richards_benchmark: 6.76% (1.3037 => 1.3918, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.89% (4.5327 => 4.7997, std.dev.: 0.0390) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.88% (4.9686 => 5.2606, std.dev.: 0.0369) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.34% (6.3772 => 6.7179, std.dev.: 0.0990) MultiSource/Applications/lambda-0_1_3/lambda: 4.86% (7.4933 => 7.8574, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.73% (6.2275 => 6.5222, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.71% (3.3761 => 3.5350, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/FloatMM: 4.35% (0.8807 => 0.9190, std.dev.: 0.0140) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.35% (59.2638 => 61.8400, std.dev.: 0.6698) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 4.25% (0.5889 => 0.6139, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.17% (4.9453 => 5.1515, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.10% (4.9469 => 5.1496, std.dev.: 0.0215) MultiSource/Applications/hexxagon/hexxagon: 4.07% (14.0064 => 14.5767, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/lists: 3.22% (16.7941 => 17.3347, std.dev.: 0.0457) MultiSource/Applications/siod/siod: 3.09% (3.6643 => 3.7774, std.dev.: 0.0224) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 3.00% (1.2474 => 1.2848, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout/lists: 2.70% (7.3375 => 7.5356, std.dev.: 0.0463) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.65% (8.2783 => 8.4976, std.dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/dry: 2.52% (0.5081 => 0.5209, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.28% (4.8660 => 4.9770, std.dev.: 0.0199) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.85% (1.5866 => 1.6160, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/flops-8: 1.33% (2.5609 => 2.5949, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/ReedSolomon: 1.31% (8.5322 => 8.6443, std.dev.: 0.0150) MultiSource/Benchmarks/FreeBench/neural/neural: 1.30% (1.0841 => 1.0982, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 1.05% (1.2061 => 1.2188, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.63% (5.4641 => 4.3371, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.97% (7.2130 => 6.3497, std.dev.: 0.0689) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.04% (1.0512 => 0.9352, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: -8.54% (63.1822 => 57.7850, std.dev.: 0.1498) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.01% (14.6451 => 13.4715, std.dev.: 0.3083) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.72% (4.7482 => 4.4289, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.18% (0.3269 => 0.3067, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.95% (3.7148 => 3.4939, std.dev.: 0.0625) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.06% (5.1557 => 4.8947, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.44% (4.7449 => 4.5343, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.66% (6.0224 => 5.8021, std.dev.: 0.0128) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.88% (28.5821 => 27.7583, std.dev.: 0.0078) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.72% (2.8773 => 2.7989, std.dev.: 0.0294) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -2.69% (0.3937 => 0.3831, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.60% (0.5807 => 0.5656, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.38% (9.9065 => 9.6706, std.dev.: 0.0680) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.32% (2.6356 => 2.5744, std.dev.: 0.0234) MultiSource/Applications/aha/aha: -2.29% (3.3398 => 3.2633, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.01% (11.5316 => 11.3003, std.dev.: 0.0102) MultiSource/Applications/lua/lua: -1.82% (29.8330 => 29.2914, std.dev.: 0.0633) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.3487 => 2.3192, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 6.24% (1.0262 => 1.0902, std.dev.: 0.0148) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0111) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 33.46% (0.0254 => 0.0339, std.dev.: 0.0079) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0077) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.20% (0.0384 => 0.0427, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0059) SingleSource/UnitTests/Vector/Altivec/test1: 23.89% (0.0180 => 0.0223, std.dev.: 0.0066) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 100.00% (0.0007 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 6.47% (0.1438 => 0.1531, std.dev.: 0.0072) MultiSource/Applications/lemon/lemon: 3.51% (1.1329 => 1.1727, std.dev.: 0.2514) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.70% (0.4164 => 0.4318, std.dev.: 0.0262) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.41% (0.1369 => 0.1402, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.94% (0.0641 => 0.0647, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 40.00% (0.0195 => 0.0273, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.98% (0.0578 => 0.0555, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.69% (1.1437 => 1.2202, std.dev.: 0.0334) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.94% (0.0627 => 0.0596, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.82% (0.8017 => 0.7791, std.dev.: 0.1364) SingleSource/Regression/C/2003-05-21-UnionBitfields: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 98.39% (0.0062 => 0.0123, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 18:06:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 20:06:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121122020620.DD98C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6129?compare_to=6125&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6129, Order: 168474, Start Time: 2012-11-22 00:33:03, End Time: 2012-11-22 02:06:46 To: 6125, Order: 168460, Start Time: 2012-11-21 22:36:09, End Time: 2012-11-22 00:09:56 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (7 on baseline) Performance Improvements: 0 (177 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (858 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.88% (55.4803 => 56.5247, std.dev.: 0.0880) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 7.93% (0.3834 => 0.4138, std.dev.: 0.0117) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.57% (54.5751 => 56.5247, std.dev.: 0.0880) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.13% (2.0478 => 2.1118, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.4937 => 7.6866, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 2.18% (3.1932 => 3.2628, std.dev.: 0.0010) MultiSource/Benchmarks/llubenchmark/llu: 1.67% (3.7435 => 3.8062, std.dev.: 0.0112) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.14% (0.3821 => 0.3510, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.87% (0.3142 => 0.2926, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.58% (2.4924 => 2.3283, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: -6.55% (0.3831 => 0.3580, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.55% (0.3848 => 0.3596, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.54% (0.9542 => 0.8918, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -6.53% (0.3812 => 0.3563, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.49% (0.3880 => 0.3628, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.44% (0.3896 => 0.3645, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.40% (0.4033 => 0.3775, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.35% (0.4176 => 0.3911, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.32% (0.3891 => 0.3645, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.18% (0.6484 => 0.6083, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.10% (0.2428 => 0.2280, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: -6.06% (9.2283 => 8.6687, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.00% (0.3884 => 0.3651, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.96% (0.1796 => 0.1689, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.94% (0.2355 => 0.2215, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: -5.93% (16.1920 => 15.2324, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -5.90% (0.3357 => 0.3159, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -5.88% (0.4199 => 0.3952, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.86% (0.9852 => 0.9275, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.85% (1.0544 => 0.9927, std.dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: -5.83% (7.0961 => 6.6827, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/football/football: -5.78% (0.9179 => 0.8648, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.78% (0.5591 => 0.5268, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.70% (4.0323 => 3.8024, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.69% (1.3722 => 1.2941, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.67% (0.7198 => 0.6790, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.63% (4.8161 => 4.5449, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.63% (0.5863 => 0.5533, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.63% (0.5705 => 0.5384, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.60% (1.2300 => 1.1611, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.59% (0.6667 => 0.6294, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.59% (0.5478 => 0.5172, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.59% (0.6230 => 0.5882, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.58% (0.6052 => 0.5714, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -5.58% (0.4280 => 0.4041, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.57% (0.5925 => 0.5595, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.55% (0.6194 => 0.5850, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.55% (0.3658 => 0.3455, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.54% (3.5339 => 3.3380, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.53% (0.5859 => 0.5535, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.53% (0.5570 => 0.5262, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.53% (6.7716 => 6.3973, std.dev.: 0.0051) MultiSource/Benchmarks/sim/sim: -5.52% (0.3406 => 0.3218, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.49% (0.2695 => 0.2547, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.47% (0.5849 => 0.5529, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.47% (0.6293 => 0.5949, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.46% (0.6446 => 0.6094, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.45% (1.6364 => 1.5472, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.45% (0.6260 => 0.5919, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.45% (0.5802 => 0.5486, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.44% (4.8802 => 4.6148, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.43% (0.5575 => 0.5272, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.43% (0.5456 => 0.5160, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.42% (0.6297 => 0.5956, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.41% (0.5581 => 0.5279, std.dev.: 0.0066) MultiSource/Benchmarks/nbench/nbench: -5.39% (1.1530 => 1.0908, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.39% (0.5805 => 0.5492, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.38% (0.6304 => 0.5965, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.37% (1.4642 => 1.3855, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.37% (0.5941 => 0.5622, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -5.35% (1.1450 => 1.0837, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: -5.34% (0.4515 => 0.4274, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.33% (0.7919 => 0.7497, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: -5.30% (17.1032 => 16.1962, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.28% (0.6189 => 0.5862, std.dev.: 0.0065) MultiSource/Applications/Burg/burg: -5.28% (1.2515 => 1.1854, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.27% (4.5069 => 4.2695, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/gs/gs: -5.26% (4.3330 => 4.1051, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.26% (1.2784 => 1.2112, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.23% (0.6440 => 0.6103, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -5.23% (0.2985 => 0.2829, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.23% (0.6660 => 0.6312, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.20% (0.3483 => 0.3302, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.20% (0.6736 => 0.6386, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.16% (14.2083 => 13.4751, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.15% (0.6676 => 0.6332, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.14% (0.6033 => 0.5723, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.13% (8.0126 => 7.6012, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.13% (0.6681 => 0.6338, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.12% (0.5999 => 0.5692, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.10% (1.2221 => 1.1598, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.06% (1.2210 => 1.1592, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.06% (0.8521 => 0.8090, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -5.04% (15.5079 => 14.7257, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/08-main/main: -5.04% (0.2659 => 0.2525, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.03% (0.5688 => 0.5402, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.02% (0.4916 => 0.4669, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.00% (0.2278 => 0.2164, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: -4.98% (1.3864 => 1.3173, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -4.97% (0.3581 => 0.3403, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.95% (0.2548 => 0.2422, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -4.91% (3.5154 => 3.3428, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.88% (0.7339 => 0.6981, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.81% (22.4056 => 21.3280, std.dev.: 0.0168) MultiSource/Applications/minisat/minisat: -4.81% (0.7447 => 0.7089, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.80% (0.5168 => 0.4920, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.78% (0.2385 => 0.2271, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.77% (0.7524 => 0.7165, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.76% (0.3319 => 0.3161, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.74% (0.3057 => 0.2912, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/fibo: -4.74% (0.2871 => 0.2735, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -4.72% (1.3148 => 1.2528, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.71% (0.6395 => 0.6094, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.70% (0.2999 => 0.2858, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.69% (0.7021 => 0.6692, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -4.68% (15.2527 => 14.5384, std.dev.: 0.0150) MultiSource/Applications/lua/lua: -4.67% (4.0594 => 3.8700, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/random: -4.66% (0.2939 => 0.2802, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.64% (1.6474 => 1.5709, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.64% (0.2933 => 0.2797, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.63% (0.4151 => 0.3959, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.62% (0.5329 => 0.5083, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.60% (0.3323 => 0.3170, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.58% (0.3252 => 0.3103, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/matrix: -4.58% (0.3255 => 0.3106, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.56% (0.2849 => 0.2719, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -4.55% (5.0226 => 4.7943, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.54% (0.5567 => 0.5314, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: -4.53% (0.3446 => 0.3290, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -4.51% (0.4861 => 0.4642, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -4.48% (2.4021 => 2.2944, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -4.48% (0.3394 => 0.3242, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.48% (0.3016 => 0.2881, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: -4.47% (0.4248 => 0.4058, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.45% (0.5569 => 0.5321, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -4.45% (0.3481 => 0.3326, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.43% (2.1713 => 2.0751, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: -4.43% (0.3025 => 0.2891, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -4.42% (0.2989 => 0.2857, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.41% (0.6395 => 0.6113, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -4.38% (34.0927 => 32.5982, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/objinst: -4.38% (0.3194 => 0.3054, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: -4.37% (0.3205 => 0.3065, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: -4.36% (0.3026 => 0.2894, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -4.34% (0.3867 => 0.3699, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.33% (0.3837 => 0.3671, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.31% (0.4083 => 0.3907, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -4.31% (0.3621 => 0.3465, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.24% (0.2903 => 0.2780, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.22% (0.3931 => 0.3765, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.21% (0.9557 => 0.9155, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: -4.19% (0.3271 => 0.3134, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.11% (0.9077 => 0.8704, std.dev.: 0.0045) SingleSource/UnitTests/ObjC++/Hello: -4.10% (0.6347 => 0.6087, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.03% (2.2587 => 2.1676, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.01% (0.4813 => 0.4620, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: -3.99% (0.6441 => 0.6184, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: -3.99% (2.1401 => 2.0548, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.98% (0.4427 => 0.4251, std.dev.: 0.0035) MultiSource/Applications/kimwitu++/kc: -3.95% (18.2933 => 17.5702, std.dev.: 0.0105) MultiSource/Applications/spiff/spiff: -3.93% (0.8418 => 0.8087, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -3.91% (0.6750 => 0.6486, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.90% (0.3491 => 0.3355, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: -3.86% (0.3059 => 0.2941, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: -3.75% (0.3788 => 0.3646, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.66% (0.4321 => 0.4163, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: -3.63% (0.7779 => 0.7497, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -3.54% (0.4524 => 0.4364, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -3.53% (0.7982 => 0.7700, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.48% (5.4682 => 5.2780, std.dev.: 0.0042) MultiSource/Applications/hbd/hbd: -3.24% (1.5610 => 1.5105, std.dev.: 0.0020) SingleSource/UnitTests/Vector/constpool: -2.69% (20.7746 => 20.2163, std.dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7534, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: -8.72% (1.2842 => 1.1722, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.89% (2.2633 => 2.1752, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.39% (1.3096 => 1.2652, std.dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.44% (6.5735 => 6.4786, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 19:24:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 21:24:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121122032431.484C72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6130?compare_to=6126&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6130, Order: 168474, Start Time: 2012-11-22 01:04:43, End Time: 2012-11-22 03:24:57 To: 6126, Order: 168460, Start Time: 2012-11-21 21:54:06, End Time: 2012-11-22 00:13:18 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 62 (143 on baseline) Performance Improvements: 12 (39 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1012 (703 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 16.56% (0.1407 => 0.1640, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 15.57% (0.6855 => 0.7922, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 14.79% (0.7830 => 0.8988, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.45% (0.5902 => 0.6755, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.16% (0.6201 => 0.7079, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 14.14% (0.5769 => 0.6585, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.82% (0.6209 => 0.7067, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.44% (0.1168 => 0.1325, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/richards_benchmark: 13.00% (0.0892 => 0.1008, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.99% (0.1016 => 0.1148, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 12.87% (0.0948 => 0.1070, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 12.87% (0.3116 => 0.3517, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 12.60% (0.3134 => 0.3529, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.95% (1.0268 => 1.1495, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/lists1: 11.91% (0.4056 => 0.4539, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sieve: 11.78% (0.3990 => 0.4460, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.54% (0.6861 => 0.7653, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.48% (0.4311 => 0.4806, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.25% (0.4667 => 0.5192, std.dev.: 0.0129) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 11.11% (0.1485 => 0.1650, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/fibo: 11.05% (0.2967 => 0.3295, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.77% (2.5526 => 2.8274, std.dev.: 0.0480) SingleSource/Benchmarks/LivermoreLoops/kernel16: 10.45% (0.1129 => 0.1247, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 10.43% (0.8906 => 0.9835, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.16% (1.1065 => 1.2189, std.dev.: 0.0119) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.16% (0.2097 => 0.2310) SingleSource/Regression/C++/ofstream_ctor: 10.01% (0.3168 => 0.3485, std.dev.: 0.0027) SingleSource/Benchmarks/LivermoreLoops/kernel15: 9.83% (0.1180 => 0.1296, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.54% (0.1206 => 0.1321, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.40% (0.6848 => 0.7492, std.dev.: 0.0159) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.02% (0.3560 => 0.3881, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.88% (0.2195 => 0.2390, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.54% (2.3265 => 2.5251, std.dev.: 0.0211) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.47% (5.5582 => 6.0289, std.dev.: 0.0485) MultiSource/Benchmarks/FreeBench/neural/neural: 7.93% (0.1601 => 0.1728, std.dev.: 0.0047) SingleSource/Benchmarks/LivermoreLoops/kernel18: 7.93% (0.1476 => 0.1593, std.dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 7.67% (9.2541 => 9.9638, std.dev.: 0.0945) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.41% (1.3097 => 1.4068, std.dev.: 0.0326) MultiSource/Benchmarks/PAQ8p/paq8p: 7.21% (11.1028 => 11.9033, std.dev.: 0.1208) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.03% (0.9063 => 0.9700, std.dev.: 0.0148) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.05% (0.2659 => 0.2820, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/05-eks/eks: 6.05% (0.4763 => 0.5051, std.dev.: 0.0092) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: 96.55% (0.1044 => 0.2052, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout/ary3: 31.05% (3.7444 => 4.9070, std.dev.: 0.1213) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 30.25% (0.3421 => 0.4456, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/ary3: 22.94% (3.7993 => 4.6708, std.dev.: 0.1973) MultiSource/Applications/JM/ldecod/ldecod: 14.53% (0.1211 => 0.1387, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 13.48% (2.7486 => 3.1190, std.dev.: 0.0944) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 11.57% (0.4105 => 0.4580, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.17% (6.0292 => 6.4617, std.dev.: 0.0950) SingleSource/Benchmarks/Misc/ffbench: 6.96% (0.9934 => 1.0625, std.dev.: 0.0092) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.15% (3.1349 => 3.3278, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 5.79% (6.1279 => 6.4826, std.dev.: 0.0440) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.60% (0.3143 => 0.3319, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/neural/neural: 4.70% (0.2234 => 0.2339, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 3.64% (8.5552 => 8.8664, std.dev.: 0.0679) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.97% (3.7205 => 3.8310, std.dev.: 0.0217) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.55% (1.5535 => 1.5931, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/lists1: 2.38% (0.6179 => 0.6326, std.dev.: 0.0036) MultiSource/Applications/SIBsim4/SIBsim4: 1.97% (3.8606 => 3.9365, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.24% (4.0955 => 4.1464, std.dev.: 0.0161) SingleSource/Benchmarks/LivermoreLoops/kernel14: 1.04% (1.5611 => 1.5774, std.dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/employ/employ: -12.75% (0.5209 => 0.4545, std.dev.: 0.0256) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -9.66% (0.7022 => 0.6344, std.dev.: 0.0182) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -9.65% (6.1761 => 5.5799, std.dev.: 0.1606) MultiSource/Benchmarks/MallocBench/gs/gs: -9.31% (5.3506 => 4.8527, std.dev.: 0.1925) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.76% (1.3238 => 1.2211, std.dev.: 0.0278) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.35% (8.5856 => 8.0404, std.dev.: 0.1516) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -3.45% (21.5831 => 20.8390, std.dev.: 0.2083) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -52.22% (8.8730 => 4.2394, std.dev.: 1.5805) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -11.02% (10.0237 => 8.9190, std.dev.: 0.4015) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -3.51% (5.5324 => 5.3381, std.dev.: 0.0249) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.76% (4.3572 => 4.2370, std.dev.: 0.0355) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.24% (2.2090 => 2.1817, std.dev.: 0.0094) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.13% (69.4300 => 69.5227, std.dev.: 0.4682) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -1.69% (0.1361 => 0.1338, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.42% (0.0443 => 0.0419, std.dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0650 => 0.0651, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: 0.12% (493.8623 => 494.4445, std.dev.: 0.0828) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.93% (63.2438 => 69.5227, std.dev.: 0.4682) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0419, std.dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43745.39% (1.1277 => 494.4445, std.dev.: 0.0828) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 202.03% (0.5229 => 1.5793, std.dev.: 0.0998) MultiSource/Applications/SPASS/SPASS: 20.24% (14.9895 => 18.0233, std.dev.: 0.2454) MultiSource/Applications/kimwitu++/kc: 48.29% (14.1553 => 20.9913, std.dev.: 0.3962) MultiSource/Benchmarks/MallocBench/gs/gs: 18.06% (4.1105 => 4.8527, std.dev.: 0.1925) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.88% (1.1048 => 1.5122, std.dev.: 0.0753) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.14% (7.1582 => 37.5193, std.dev.: 0.6441) SingleSource/Benchmarks/Misc-C++-EH/spirit: 75.33% (3.4629 => 6.0716, std.dev.: 0.4088) SingleSource/Benchmarks/Misc-C++/stepanov_container: 84.75% (0.6222 => 1.1495, std.dev.: 0.0104) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10889.86% (0.0720 => 7.9127, std.dev.: 0.0607) MultiSource/Applications/SIBsim4/SIBsim4: 3936400.00% (0.0001 => 3.9365, std.dev.: 0.0061) MultiSource/Applications/SPASS/SPASS: 12902100.00% (0.0001 => 12.9022, std.dev.: 2.1982) MultiSource/Applications/kimwitu++/kc: 52300.00% (0.0001 => 0.0524, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576800.00% (0.0001 => 0.5769, std.dev.: 0.0214) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10100300.00% (0.0001 => 10.1004, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6582500.00% (0.0001 => 6.5826, std.dev.: 0.5322) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1761.62% (1.1194 => 20.8390, std.dev.: 0.2083) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 72.87% (2.9384 => 5.0795, std.dev.: 0.1603) MultiSource/Applications/ClamAV/clamscan: 65.05% (22.1758 => 36.6011, std.dev.: 1.0105) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.88% (7.0540 => 10.9250, std.dev.: 0.3024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.91% (8.1363 => 12.2783, std.dev.: 0.1790) MultiSource/Applications/JM/lencod/lencod: 47.38% (21.9371 => 32.3304, std.dev.: 0.1854) MultiSource/Benchmarks/FreeBench/distray/distray: 45.83% (0.1056 => 0.1540, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/flops: 38.90% (0.1432 => 0.1989, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/almabench: 38.08% (0.0730 => 0.1008, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: 37.71% (0.2554 => 0.3517, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 34.93% (0.0793 => 0.1070, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.69% (0.1236 => 0.1640, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Oscar: 32.39% (0.0636 => 0.0842, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: 31.80% (0.0871 => 0.1148, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/messages-2: 30.51% (0.0662 => 0.0864, std.dev.: 0.0014) SingleSource/UnitTests/vla: 29.58% (0.0355 => 0.0460, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/17-bintr/bintr: 28.89% (0.0675 => 0.0870, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 28.39% (0.1032 => 0.1325, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 28.38% (2.2024 => 2.8274, std.dev.: 0.0480) MultiSource/Benchmarks/McCat/15-trie/trie: 27.32% (0.0527 => 0.0671, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 25.53% (0.7835 => 0.9835, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.40% (0.0886 => 0.1111, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 24.82% (0.9765 => 1.2189, std.dev.: 0.0119) MultiSource/Benchmarks/McCat/04-bisect/bisect: 24.39% (0.1062 => 0.1321, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.35% (0.3121 => 0.3881, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.35% (0.0842 => 0.1047, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 24.35% (0.3865 => 0.4806, std.dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.99% (0.0746 => 0.0925, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.98% (0.0834 => 0.1034, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 23.79% (0.3603 => 0.4460, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 23.53% (0.4203 => 0.5192, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/lists1: 23.21% (0.3684 => 0.4539, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/except: 22.92% (0.2871 => 0.3529, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.76% (0.0457 => 0.0561, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 22.67% (0.0953 => 0.1169, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/hash: 22.47% (0.0485 => 0.0594, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 22.37% (1.5859 => 1.9407, std.dev.: 0.0572) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 22.09% (0.1892 => 0.2310) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 21.92% (4.9449 => 6.0289, std.dev.: 0.0485) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.78% (0.1566 => 0.1907, std.dev.: 0.0109) MultiSource/Benchmarks/BitBench/five11/five11: 21.69% (0.0567 => 0.0690, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/wordfreq: 21.62% (0.3307 => 0.4022, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.39% (14.3668 => 17.4400, std.dev.: 0.3123) SingleSource/Benchmarks/Shootout-C++/strcat: 21.30% (0.2831 => 0.3434, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/fibo: 20.92% (0.2725 => 0.3295, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.77% (0.1584 => 0.1913, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/matrix: 20.72% (0.3098 => 0.3740, std.dev.: 0.0134) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 20.57% (0.0491 => 0.0592, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.36% (0.1940 => 0.2335, std.dev.: 0.0140) MultiSource/Benchmarks/Olden/tsp/tsp: 20.17% (0.1175 => 0.1412, std.dev.: 0.0065) SingleSource/Regression/C++/ofstream_ctor: 19.97% (0.2905 => 0.3485, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/09-vor/vor: 19.94% (0.3180 => 0.3814, std.dev.: 0.0172) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 19.91% (0.0648 => 0.0777, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 19.74% (0.8101 => 0.9700, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/sumcol: 19.47% (0.2891 => 0.3454, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 19.27% (3.8922 => 4.6423, std.dev.: 0.1624) SingleSource/UnitTests/ObjC/exceptions: 18.89% (0.3828 => 0.4551, std.dev.: 0.0134) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.61% (1.1861 => 1.4068, std.dev.: 0.0326) SingleSource/UnitTests/ObjC/exceptions-4: 18.60% (0.3543 => 0.4202, std.dev.: 0.0124) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.49% (0.1125 => 0.1333, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash: 18.42% (0.4289 => 0.5079, std.dev.: 0.0184) MultiSource/Benchmarks/FreeBench/neural/neural: 18.11% (0.1463 => 0.1728, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/property: 17.68% (0.3886 => 0.4573, std.dev.: 0.0135) MultiSource/Benchmarks/McCat/05-eks/eks: 17.49% (0.4299 => 0.5051, std.dev.: 0.0092) SingleSource/UnitTests/ObjC/trivial-interface: 17.39% (0.3473 => 0.4077, std.dev.: 0.0086) SingleSource/UnitTests/ObjC/for-in: 17.11% (0.3694 => 0.4326, std.dev.: 0.0103) SingleSource/UnitTests/ObjC/parameter-passing: 17.04% (0.3927 => 0.4596, std.dev.: 0.0146) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.77% (0.3543 => 0.4137, std.dev.: 0.0156) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.68% (0.8172 => 0.9535, std.dev.: 0.0344) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 16.55% (0.5860 => 0.6830, std.dev.: 0.0249) MultiSource/Applications/d/make_dparser: 16.32% (3.3354 => 3.8797, std.dev.: 0.1949) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.27% (0.2065 => 0.2401, std.dev.: 0.0111) MultiSource/Applications/lua/lua: 16.24% (3.8723 => 4.5011, std.dev.: 0.2295) MultiSource/Benchmarks/Olden/mst/mst: 16.08% (0.1163 => 0.1350, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/synchronized: 16.06% (0.3561 => 0.4133, std.dev.: 0.0165) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 16.05% (0.2430 => 0.2820, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 16.00% (0.1906 => 0.2211, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/matrix: 15.89% (0.0818 => 0.0948, std.dev.: 0.0046) SingleSource/UnitTests/ObjC++/Hello: 15.49% (0.5925 => 0.6843, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/health/health: 15.46% (0.1268 => 0.1464, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.06% (0.0770 => 0.0886, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wc: 15.04% (0.3052 => 0.3511, std.dev.: 0.0099) MultiSource/Applications/sgefa/sgefa: 15.02% (0.3109 => 0.3576, std.dev.: 0.0154) SingleSource/UnitTests/ObjC++/property-reference: 14.99% (0.7326 => 0.8424, std.dev.: 0.0160) MultiSource/Benchmarks/PAQ8p/paq8p: 14.82% (10.3673 => 11.9033, std.dev.: 0.1208) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.81% (0.0770 => 0.0884, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.66% (2.2022 => 2.5251, std.dev.: 0.0211) MultiSource/Applications/sqlite3/sqlite3: 14.54% (17.1811 => 19.6794, std.dev.: 0.6353) MultiSource/Benchmarks/NPB-serial/is/is: 14.46% (0.0719 => 0.0823, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.44% (0.1337 => 0.1530, std.dev.: 0.0072) SingleSource/UnitTests/ObjC++/property-reference-object: 14.38% (0.6030 => 0.6897, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.29% (0.1029 => 0.1176, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.92% (0.5569 => 0.6344, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.86% (0.5981 => 0.6810, std.dev.: 0.0269) MultiSource/Benchmarks/mafft/pairlocalalign: 13.62% (9.4845 => 10.7767, std.dev.: 0.4186) SingleSource/UnitTests/ObjC/exceptions-2: 13.55% (0.3497 => 0.3971, std.dev.: 0.0151) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.31% (0.1510 => 0.1711, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.14% (0.6675 => 0.7552, std.dev.: 0.0272) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.01% (1.5415 => 1.7420, std.dev.: 0.0737) SingleSource/Benchmarks/Shootout-C++/methcall: 12.23% (0.2877 => 0.3229, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.56% (5.0018 => 5.5799, std.dev.: 0.1606) SingleSource/UnitTests/SignlessTypes/rem: 10.75% (0.1144 => 0.1267, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.47% (0.2266 => 0.2390, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.69% (4.3953 => 11.0187, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/methcall: 147.43% (5.3999 => 13.3611, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/17-bintr/bintr: 96.74% (0.1043 => 0.2052, std.dev.: 0.0151) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 36.86% (0.3256 => 0.4456, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout/ary3: 32.64% (3.6994 => 4.9070, std.dev.: 0.1213) SingleSource/Benchmarks/Shootout-C++/ary3: 25.49% (3.7221 => 4.6708, std.dev.: 0.1973) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.77% (1.1145 => 1.3125, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 17.52% (9.1159 => 10.7132, std.dev.: 0.5704) SingleSource/Benchmarks/Misc/oourafft: 17.46% (6.6465 => 7.8072, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.01% (0.2944 => 0.3327, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/ffbench: 11.78% (0.9505 => 1.0625, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.63% (2.8904 => 3.2265, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/richards_benchmark: 10.17% (1.1396 => 1.2555, std.dev.: 0.0024) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.55% (1.7254 => 1.8901, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.11% (0.3070 => 0.3319, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.20% (3.1334 => 3.3278, std.dev.: 0.0130) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 5.81% (26.0924 => 27.6088, std.dev.: 0.0197) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.50% (4.2280 => 4.4607, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.26% (3.6395 => 3.8310, std.dev.: 0.0217) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 4.75% (0.2233 => 0.2339, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627) MultiSource/Benchmarks/nbench/nbench: 4.13% (11.6436 => 12.1243, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/bigfib: 3.44% (0.3316 => 0.3430, std.dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.34% (0.4162 => 0.4301, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 2.51% (0.6171 => 0.6326, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/dry: 2.48% (2.4116 => 2.4715, std.dev.: 0.0166) MultiSource/Applications/sgefa/sgefa: 2.31% (0.6223 => 0.6367, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.13% (1.3677 => 1.3969, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 2.12% (85.0658 => 86.8653, std.dev.: 0.0379) MultiSource/Applications/aha/aha: 2.05% (3.1595 => 3.2242, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.83% (2.1424 => 2.1817, std.dev.: 0.0094) MultiSource/Benchmarks/mafft/pairlocalalign: 1.68% (27.8444 => 28.3127, std.dev.: 0.0176) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.41% (6.5088 => 6.6005, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/sieve: 1.37% (2.4858 => 2.5199, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.30% (1.0313 => 1.0447, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0504, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.2139 => 5.2748, std.dev.: 0.0067) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1674, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.86% (5.2763 => 1.2211, std.dev.: 0.0278) SingleSource/Benchmarks/Misc/salsa20: -74.64% (0.8651 => 0.2194, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: -37.85% (0.1622 => 0.1008, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -12.26% (0.1330 => 0.1167, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.15% (5.3855 => 4.7313, std.dev.: 0.1503) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.02% (5.3526 => 4.7090, std.dev.: 0.1646) MultiSource/Applications/JM/ldecod/ldecod: -4.53% (10.4361 => 9.9638, std.dev.: 0.0945) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.36% (0.3987 => 0.2378, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.33% (4.5009 => 2.7757, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.09% (2.6546 => 2.0150, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -19.20% (0.2161 => 0.1746, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4233, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2838, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.67% (32.5116 => 29.0415, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4244, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -7.29% (9.5636 => 8.8664, std.dev.: 0.0679) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.2416 => 3.0208, std.dev.: 0.0290) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -4.65% (1.5835 => 1.5099, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: -4.19% (6.2999 => 6.0360, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.18% (19.9488 => 19.1153, std.dev.: 0.2343) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.37% (0.9957 => 0.9621, std.dev.: 0.0051) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8917, std.dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.54% (0.4808 => 0.4686, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.00% (8.1563 => 7.9933, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -1.46% (10.2830 => 10.1326, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0021) Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 19:29:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 21:29:32 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121122032932.D72EE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6131?compare_to=6128&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6131, Order: 168481, Start Time: 2012-11-22 01:59:44, End Time: 2012-11-22 03:29:59 To: 6128, Order: 168471, Start Time: 2012-11-22 00:07:14, End Time: 2012-11-22 01:42:43 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 2 (108 on baseline) Performance Improvements: 89 (27 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 963 (839 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 11.63% (19.3688 => 21.6223, std.dev.: 0.5312) MultiSource/Benchmarks/llubenchmark/llu: 1.35% (2.0089 => 2.0361, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/McGill/queens: -34.10% (0.0698 => 0.0460, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/FloatMM: -30.35% (0.0593 => 0.0413, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -25.54% (0.0415 => 0.0309, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -20.10% (0.0776 => 0.0620, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/moments: -18.10% (0.4474 => 0.3664, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/nestedloop: -15.87% (0.2300 => 0.1935, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -13.10% (0.0931 => 0.0809, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/objinst: -11.98% (0.2353 => 0.2071, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/strcat: -9.66% (0.2173 => 0.1963, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.29% (0.1120 => 0.1016, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: -9.00% (0.2110 => 0.1920, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -8.96% (0.2298 => 0.2092, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.78% (0.1538 => 0.1403, std.dev.: 0.0047) SingleSource/Benchmarks/Linpack/linpack-pc: -8.34% (0.2495 => 0.2287, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hello: -8.19% (0.1977 => 0.1815, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: -8.01% (0.4143 => 0.3811, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: -7.99% (0.2766 => 0.2545, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: -7.91% (0.4473 => 0.4119, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: -7.64% (0.2671 => 0.2467, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -7.60% (0.5419 => 0.5007, std.dev.: 0.0141) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.58% (0.2046 => 0.1891, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/lists1: -7.42% (0.3262 => 0.3020, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sieve: -6.50% (0.3000 => 0.2805, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -6.37% (0.2730 => 0.2556, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: -6.31% (0.1996 => 0.1870, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -6.22% (0.2122 => 0.1990, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: -6.04% (0.2384 => 0.2240, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.99% (0.3924 => 0.3689, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/chomp: -5.95% (0.1681 => 0.1581, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: -5.83% (0.2574 => 0.2424, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.73% (0.3595 => 0.3389, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/except: -5.62% (0.2190 => 0.2067, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.51% (0.3936 => 0.3719, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.44% (5.7598 => 5.4467, std.dev.: 0.0363) SingleSource/Benchmarks/Shootout-C++/methcall: -5.41% (0.2146 => 0.2030, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: -4.17% (15.3428 => 14.7034, std.dev.: 0.0170) MultiSource/Benchmarks/McCat/05-eks/eks: -3.75% (0.4608 => 0.4435, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.65% (0.3341 => 0.3219, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -3.27% (0.8628 => 0.8346, std.dev.: 0.0042) MultiSource/Applications/Burg/burg: -3.21% (1.3181 => 1.2758, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.07% (2.2693 => 2.1996, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.97% (3.3499 => 3.2505, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.94% (1.2382 => 1.2018, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -2.77% (1.6187 => 1.5738, std.dev.: 0.0074) MultiSource/Applications/spiff/spiff: -2.57% (0.8352 => 0.8137, std.dev.: 0.0073) MultiSource/Applications/sqlite3/sqlite3: -2.41% (15.6911 => 15.3128, std.dev.: 0.1187) MultiSource/Applications/oggenc/oggenc: -2.15% (5.1532 => 5.0424, std.dev.: 0.0195) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.14% (0.6872 => 0.6725, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -2.00% (7.0267 => 6.8859, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.81% (0.8334 => 0.8183, std.dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: -1.45% (15.9004 => 15.6704, std.dev.: 0.0799) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.36% (0.9160 => 0.9035, std.dev.: 0.0020) MultiSource/Applications/treecc/treecc: -1.35% (2.0739 => 2.0459, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.33% (0.8720 => 0.8604, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.10% (0.9398 => 0.9295, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: -1.00% (3.3419 => 3.3084, std.dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Stanford/Queens: -41.14% (0.0457 => 0.0269, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: -33.85% (4.6307 => 3.0630, std.dev.: 0.1288) SingleSource/Benchmarks/CoyoteBench/fftbench: -25.00% (2.1882 => 1.6411, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout/heapsort: -22.25% (3.8639 => 3.0040, std.dev.: 0.0924) SingleSource/Benchmarks/Shootout-C++/moments: -16.65% (0.1165 => 0.0971, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/17-bintr/bintr: -11.35% (0.0916 => 0.0812, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists1: -11.20% (0.6823 => 0.6059, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/09-vor/vor: -10.35% (0.1410 => 0.1264, std.dev.: 0.0027) SingleSource/Benchmarks/Stanford/Puzzle: -9.56% (0.1821 => 0.1647, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: -9.24% (0.1558 => 0.1414, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: -8.78% (4.2993 => 3.9217, std.dev.: 0.0520) SingleSource/Benchmarks/Shootout/ary3: -7.72% (2.2665 => 2.0916, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -7.19% (2.1576 => 2.0025, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -6.08% (47.7855 => 44.8806, std.dev.: 0.3900) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -6.03% (2.4185 => 2.2727, std.dev.: 0.0361) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.86% (0.2116 => 0.1992, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: -5.36% (1.0588 => 1.0021, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -4.91% (3.3106 => 3.1481, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.89% (0.9079 => 0.8635, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -3.74% (1.2848 => 1.2367, std.dev.: 0.0132) SingleSource/Benchmarks/Stanford/FloatMM: -3.65% (0.9190 => 0.8855, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/health/health: -3.57% (0.3611 => 0.3482, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -3.56% (17.3347 => 16.7173, std.dev.: 0.1073) SingleSource/Benchmarks/Misc/himenobmtxpa: -3.41% (4.4899 => 4.3370, std.dev.: 0.0395) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -3.37% (0.6139 => 0.5932, std.dev.: 0.0057) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.33% (1.3222 => 1.2782, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash: -2.92% (0.6397 => 0.6210, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.90% (61.8400 => 60.0436, std.dev.: 0.6585) MultiSource/Benchmarks/Olden/bisort/bisort: -2.69% (0.6654 => 0.6475, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/hash: -2.27% (4.3604 => 4.2614, std.dev.: 0.0119) MultiSource/Applications/lua/lua: -1.55% (29.2914 => 28.8377, std.dev.: 0.1550) SingleSource/Benchmarks/McGill/queens: -1.17% (1.8544 => 1.8327, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/matrix: -1.08% (1.5785 => 1.5615, std.dev.: 0.0061) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.94% (1.0902 => 1.0690, std.dev.: 0.0202) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.36% (0.0220 => 0.0217, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.94% (0.0426 => 0.0430, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -26.25% (0.0339 => 0.0250, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -11.46% (0.0314 => 0.0278, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.94% (0.0427 => 0.0423, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/casts: -17.24% (0.0203 => 0.0168, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/test1: -5.83% (0.0223 => 0.0210, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.86% (0.0014 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -3.85% (0.1531 => 0.1472, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 2.45% (1.1727 => 1.2014, std.dev.: 0.0323) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.80% (0.4318 => 0.4197, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.00% (0.1402 => 0.1416, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -62.50% (0.0008 => 0.0003, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.24% (0.0647 => 0.0639, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -26.01% (0.0273 => 0.0202, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.24% (0.0555 => 0.0573, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.78% (1.2202 => 1.1985, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -74.19% (0.0031 => 0.0008, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.01% (0.0596 => 0.0590, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.21% (0.0267 => 0.0189, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.87% (0.7791 => 0.7723, std.dev.: 0.0039) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 300.00% (0.0001 => 0.0004, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -55.28% (0.0123 => 0.0055, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.04% (16.4461 => 17.6042, std.dev.: 0.1199) MultiSource/Applications/sqlite3/sqlite3: 2318.32% (0.6332 => 15.3128, std.dev.: 0.1187) MultiSource/Benchmarks/McCat/08-main/main: 45.93% (0.1831 => 0.2672, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -10.90% (0.1559 => 0.1389, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7146.17% (0.3123 => 22.6298, std.dev.: 0.5302) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.78% (0.2463 => 0.3689, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1528.80% (0.3344 => 5.4467, std.dev.: 0.0363) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.04% (0.2364 => 0.3216, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 4.23% (0.6010 => 0.6264, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: -0.47% (0.0429 => 0.0427, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.77% (0.3266 => 0.3389, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: -0.30% (0.1969 => 0.1963, std.dev.: 0.0034) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.45% (0.0224 => 0.0225, std.dev.: 0.0022) SingleSource/UnitTests/byval-alignment: -30.87% (0.0230 => 0.0159, std.dev.: 0.0016) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0452, std.dev.: 0.0042) MultiSource/Applications/oggenc/oggenc: 8.76% (0.1462 => 0.1590, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4646, std.dev.: 0.0238) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0731, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4930, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5113, std.dev.: 0.0091) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.6411, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3291, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1282, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3630, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4101, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0875, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: -23.64% (2.1832 => 1.6672, std.dev.: 0.0038) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.04% (0.0810 => 0.0948, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.50% (0.0848 => 0.0954, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 10.88% (0.1112 => 0.1233, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.89% (0.2180 => 0.2352, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.00% (0.8148 => 0.8637, std.dev.: 0.0136) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.93% (0.1905 => 0.2018, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.26% (0.3137 => 0.3302, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.01% (0.6010 => 0.6311, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.40% (0.9435 => 0.9850, std.dev.: 0.0071) MultiSource/Applications/Burg/burg: 4.39% (1.2222 => 1.2758, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 3.76% (4.1305 => 4.2860, std.dev.: 0.0487) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.61% (0.4127 => 0.4276, std.dev.: 0.0029) MultiSource/Applications/minisat/minisat: 3.35% (0.6834 => 0.7063, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.34% (0.3115 => 0.3219, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.17% (0.8340 => 0.8604, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.15% (0.5817 => 0.6000, std.dev.: 0.0058) MultiSource/Applications/SPASS/SPASS: 3.11% (14.2605 => 14.7034, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.09% (0.4559 => 0.4700, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 2.99% (1.2568 => 1.2944, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.95% (0.8611 => 0.8865, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.85% (1.1685 => 1.2018, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.78% (2.1401 => 2.1996, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.76% (1.5315 => 1.5738, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.74% (0.8007 => 0.8226, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.73% (0.8597 => 0.8832, std.dev.: 0.0048) MultiSource/Applications/siod/siod: 2.72% (2.2184 => 2.2788, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.70% (4.1763 => 4.2891, std.dev.: 0.0397) MultiSource/Benchmarks/nbench/nbench: 2.66% (1.1271 => 1.1571, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.66% (0.8697 => 0.8928, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.62% (8.6476 => 8.8739, std.dev.: 0.0588) MultiSource/Applications/ClamAV/clamscan: 2.61% (14.7684 => 15.1534, std.dev.: 0.1112) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.57% (0.8204 => 0.8415, std.dev.: 0.0021) MultiSource/Applications/treecc/treecc: 2.56% (1.9948 => 2.0459, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.47% (0.8331 => 0.8537, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.47% (0.8420 => 0.8628, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.44% (0.9074 => 0.9295, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.43% (0.9069 => 0.9289, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.41% (0.5191 => 0.5316, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.40% (0.8086 => 0.8280, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.37% (0.8050 => 0.8241, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.36% (4.4873 => 4.5934, std.dev.: 0.0327) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.35% (0.8069 => 0.8259, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.35% (0.9688 => 0.9916, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.34% (0.8316 => 0.8511, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.29% (0.9908 => 1.0135, std.dev.: 0.0080) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (6.7320 => 6.8859, std.dev.: 0.0260) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.26% (4.4880 => 4.5894, std.dev.: 0.0291) MultiSource/Applications/JM/lencod/lencod: 2.23% (15.3280 => 15.6704, std.dev.: 0.0799) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.22% (0.7966 => 0.8143, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: 2.22% (3.2366 => 3.3084, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.19% (0.9039 => 0.9237, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.17% (0.8286 => 0.8466, std.dev.: 0.0046) MultiSource/Applications/lemon/lemon: 2.14% (1.0945 => 1.1179, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.11% (3.1832 => 3.2505, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.11% (0.6586 => 0.6725, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.10% (0.8712 => 0.8895, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.08% (0.8805 => 0.8988, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.08% (0.8716 => 0.8897, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.07% (0.8177 => 0.8346, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.06% (0.8048 => 0.8214, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.06% (0.8317 => 0.8488, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.03% (0.8855 => 0.9035, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.01% (0.8457 => 0.8627, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.97% (0.8338 => 0.8502, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.91% (0.8885 => 0.9055, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.83% (0.8927 => 0.9090, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.65% (1.2423 => 1.2628, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 1.60% (4.9628 => 5.0424, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.45% (0.8066 => 0.8183, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 102.01% (0.0199 => 0.0402, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/pi: 58.40% (1.5795 => 2.5020, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.34% (2.9753 => 3.4615, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.80% (0.7597 => 0.8797, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.71% (2.7995 => 3.2113, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.69% (5.0261 => 5.6135, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.48% (0.3186 => 0.3488, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.56% (1.1857 => 1.2753, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/queens: 7.45% (1.7056 => 1.8327, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 7.10% (1.3037 => 1.3962, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.77% (4.7794 => 5.1028, std.dev.: 0.0329) MultiSource/Applications/SIBsim4/SIBsim4: 6.04% (3.1873 => 3.3797, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.91% (4.9686 => 5.2624, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.89% (4.5327 => 4.7998, std.dev.: 0.0075) MultiSource/Applications/lambda-0_1_3/lambda: 5.08% (7.4933 => 7.8742, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.69% (6.2275 => 6.5196, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.58% (3.3761 => 3.5307, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.25% (4.9453 => 5.1557, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.01% (4.9469 => 5.1455, std.dev.: 0.0475) MultiSource/Applications/hexxagon/hexxagon: 3.93% (14.0064 => 14.5562, std.dev.: 0.0222) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.61% (1.2337 => 1.2782, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.40% (0.3587 => 0.3709, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 3.04% (3.6643 => 3.7758, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.94% (11.5690 => 11.9092, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.82% (8.2783 => 8.5114, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 2.66% (0.4353 => 0.4469, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: 2.47% (7.3375 => 7.5191, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.38% (1.1365 => 1.1636, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.32% (4.8660 => 4.9787, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.13% (4.8362 => 4.9392, std.dev.: 0.0164) MultiSource/Benchmarks/llubenchmark/llu: 1.97% (1.9967 => 2.0361, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.74% (22.2997 => 22.6874, std.dev.: 0.0305) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.45% (4.4340 => 4.4985, std.dev.: 0.0193) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.34% (2.4647 => 2.4977, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/neural/neural: 1.32% (1.0841 => 1.0984, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.30% (3.5679 => 3.6142, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 1.25% (8.5322 => 8.6386, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.19% (1.5941 => 1.6130, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/whetstone: 1.04% (2.1224 => 2.1444, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -33.73% (0.0338 => 0.0224, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: -21.01% (5.4641 => 4.3162, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.97% (7.2130 => 6.2056, std.dev.: 0.0839) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.07% (1.0512 => 0.9348, std.dev.: 0.0083) SingleSource/Benchmarks/McGill/chomp: -10.65% (1.1216 => 1.0021, std.dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.01% (14.6451 => 13.3261, std.dev.: 0.0894) SingleSource/Benchmarks/Shootout/heapsort: -8.77% (3.2926 => 3.0040, std.dev.: 0.0924) MultiSource/Benchmarks/mafft/pairlocalalign: -8.50% (63.1822 => 57.8142, std.dev.: 0.2332) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.13% (0.3269 => 0.3036, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.87% (4.7482 => 4.4218, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.81% (5.4972 => 5.1778, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.71% (3.7148 => 3.5028, std.dev.: 0.0487) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.07% (5.1557 => 4.8944, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.77% (0.5807 => 0.5588, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.75% (6.0224 => 5.7965, std.dev.: 0.0141) MultiSource/Applications/lua/lua: -3.34% (29.8330 => 28.8377, std.dev.: 0.1550) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (28.5821 => 27.6982, std.dev.: 0.0308) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.86% (2.4490 => 2.3789, std.dev.: 0.0158) MultiSource/Applications/aha/aha: -2.32% (3.3398 => 3.2624, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.28% (2.6356 => 2.5756, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/hash2: -2.16% (3.4237 => 3.3498, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.14% (3.2169 => 3.1481, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.96% (11.5316 => 11.3054, std.dev.: 0.0080) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.73% (2.3487 => 2.3081, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.59% (4.9994 => 4.9198, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.17% (5.6343 => 5.5683, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout/hash: -1.10% (4.3087 => 4.2614, std.dev.: 0.0119) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.17% (1.0262 => 1.0690, std.dev.: 0.0202) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.39% (0.0408 => 0.0430, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.57% (0.0254 => 0.0250, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -7.95% (0.0302 => 0.0278, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/casts: -11.58% (0.0190 => 0.0168, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/test1: 16.67% (0.0180 => 0.0210, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.36% (0.1438 => 0.1472, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 6.05% (1.1329 => 1.2014, std.dev.: 0.0323) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.79% (0.4164 => 0.4197, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.43% (0.1369 => 0.1416, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -62.50% (0.0008 => 0.0003, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.31% (0.0641 => 0.0639, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.59% (0.0195 => 0.0202, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.87% (0.0578 => 0.0573, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.79% (1.1437 => 1.1985, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 700.00% (0.0001 => 0.0008, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.90% (0.0627 => 0.0590, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.00% (0.0180 => 0.0189, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.67% (0.8017 => 0.7723, std.dev.: 0.0039) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 300.00% (0.0001 => 0.0004, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -11.29% (0.0062 => 0.0055, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 20:02:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 22:02:47 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121122040247.DF7552A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6132?compare_to=6129&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6132, Order: 168481, Start Time: 2012-11-22 02:29:46, End Time: 2012-11-22 04:03:14 To: 6129, Order: 168474, Start Time: 2012-11-22 00:33:03, End Time: 2012-11-22 02:06:46 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (5 on baseline) Performance Improvements: 0 (178 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1090 (859 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 8.80% (0.4138 => 0.4502, std.dev.: 0.0104) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.42% (5.7572 => 5.9543, std.dev.: 0.0008) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 17.42% (0.3834 => 0.4502, std.dev.: 0.0104) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.57% (2.0478 => 2.1005, std.dev.: 0.0154) SingleSource/Benchmarks/Misc/salsa20: 2.37% (7.4937 => 7.6715, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/hash2: 2.28% (3.1932 => 3.2659, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.08% (0.1431 => 0.1301, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.37% (0.3821 => 0.3501, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.08% (0.9542 => 0.8866, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -6.97% (2.4924 => 2.3187, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.94% (0.3142 => 0.2924, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -6.52% (0.3357 => 0.3138, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: -6.39% (0.2160 => 0.2022, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -6.27% (9.2283 => 8.6496, std.dev.: 0.0137) SingleSource/UnitTests/ObjC/exceptions-2: -6.26% (0.3831 => 0.3591, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.22% (0.2428 => 0.2277, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.19% (0.3812 => 0.3576, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.19% (0.3880 => 0.3640, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions-3: -6.19% (0.3848 => 0.3610, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -6.14% (7.0961 => 6.6604, std.dev.: 0.0090) MultiSource/Applications/JM/lencod/lencod: -6.13% (16.1920 => 15.1990, std.dev.: 0.0103) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.11% (0.2355 => 0.2211, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -6.11% (0.3896 => 0.3658, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.09% (0.6484 => 0.6089, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.05% (0.4033 => 0.3789, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.05% (0.9852 => 0.9256, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: -6.04% (0.9179 => 0.8625, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -6.03% (0.4176 => 0.3924, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.99% (0.3891 => 0.3658, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.96% (0.5591 => 0.5258, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.95% (1.0544 => 0.9917, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.93% (1.3722 => 1.2908, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.92% (0.5863 => 0.5516, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.86% (0.5478 => 0.5157, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.84% (0.5705 => 0.5372, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.82% (0.3658 => 0.3445, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.81% (3.5339 => 3.3287, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.79% (0.5805 => 0.5469, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.77% (0.5925 => 0.5583, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.77% (4.0323 => 3.7998, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.76% (0.6194 => 0.5837, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.76% (0.6230 => 0.5871, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.76% (0.5849 => 0.5512, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.75% (1.6364 => 1.5423, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.73% (0.6052 => 0.5705, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.72% (4.8161 => 4.5405, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.72% (0.3884 => 0.3662, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.71% (0.5570 => 0.5252, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.70% (0.6667 => 0.6287, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.69% (0.6304 => 0.5945, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: -5.69% (1.1530 => 1.0874, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.68% (0.2695 => 0.2542, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.65% (0.5575 => 0.5260, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.65% (0.5859 => 0.5528, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.64% (6.7716 => 6.3898, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.64% (0.6297 => 0.5942, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.64% (0.3406 => 0.3214, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.63% (0.5857 => 0.5527, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.62% (0.6446 => 0.6084, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.59% (0.5581 => 0.5269, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.59% (0.5456 => 0.5151, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.58% (4.8802 => 4.6078, std.dev.: 0.0053) MultiSource/Applications/lemon/lemon: -5.58% (1.1450 => 1.0811, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.58% (1.2300 => 1.1614, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.56% (0.6260 => 0.5912, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.55% (0.5802 => 0.5480, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/property: -5.55% (0.4199 => 0.3966, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.55% (1.4642 => 1.3830, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.50% (0.6660 => 0.6294, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.48% (0.6189 => 0.5850, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: -5.47% (17.1032 => 16.1671, std.dev.: 0.0194) MultiSource/Applications/SIBsim4/SIBsim4: -5.47% (1.3864 => 1.3106, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.47% (0.6293 => 0.5949, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.46% (1.2784 => 1.2086, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.43% (0.7198 => 0.6807, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.43% (4.5069 => 4.2624, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.42% (0.5941 => 0.5619, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.42% (0.7919 => 0.7490, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -5.37% (0.4280 => 0.4050, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -5.34% (4.3330 => 4.1017, std.dev.: 0.0085) MultiSource/Benchmarks/McCat/05-eks/eks: -5.34% (0.4515 => 0.4274, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.32% (14.2083 => 13.4527, std.dev.: 0.0064) MultiSource/Applications/Burg/burg: -5.31% (1.2515 => 1.1850, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.30% (0.6736 => 0.6379, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.30% (0.6440 => 0.6099, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.29% (0.6033 => 0.5714, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.28% (0.6681 => 0.6328, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.27% (0.5688 => 0.5388, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.27% (0.6676 => 0.6324, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.25% (0.5999 => 0.5684, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.23% (0.3483 => 0.3301, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -5.22% (15.5079 => 14.6986, std.dev.: 0.0096) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.21% (0.8521 => 0.8077, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.14% (8.0126 => 7.6008, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.05% (0.2278 => 0.2163, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -5.03% (15.2527 => 14.4849, std.dev.: 0.0115) MultiSource/Applications/d/make_dparser: -5.02% (3.5154 => 3.3389, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.97% (0.7339 => 0.6974, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.97% (0.2999 => 0.2850, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.95% (1.2221 => 1.1616, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.95% (0.2548 => 0.2422, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.94% (1.2210 => 1.1607, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: -4.90% (0.7447 => 0.7082, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.90% (0.5168 => 0.4915, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.89% (0.7524 => 0.7156, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.86% (0.4916 => 0.4677, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.80% (0.5567 => 0.5300, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -4.78% (4.0594 => 3.8654, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: -4.78% (0.2659 => 0.2532, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.72% (0.6395 => 0.6093, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.72% (1.6474 => 1.5697, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.70% (0.7021 => 0.6691, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.69% (22.4056 => 21.3544, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/bh/bh: -4.69% (0.2985 => 0.2845, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.69% (0.5569 => 0.5308, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.65% (0.5329 => 0.5081, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.58% (0.6395 => 0.6102, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -4.58% (0.3581 => 0.3417, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: -4.52% (2.1401 => 2.0434, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -4.50% (2.4021 => 2.2941, std.dev.: 0.0071) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.37% (0.3319 => 0.3174, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -4.27% (1.3148 => 1.2587, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.24% (0.9077 => 0.8692, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.24% (2.2587 => 2.1630, std.dev.: 0.0056) MultiSource/Applications/spiff/spiff: -4.22% (0.8418 => 0.8063, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/09-vor/vor: -4.19% (0.3271 => 0.3134, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.17% (0.4151 => 0.3978, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.12% (0.3057 => 0.2931, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.12% (0.3931 => 0.3769, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -4.10% (0.4248 => 0.4074, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.09% (0.3837 => 0.3680, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -4.05% (0.4861 => 0.4664, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.05% (0.9557 => 0.9170, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: -4.04% (0.2871 => 0.2755, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.03% (0.3323 => 0.3189, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.02% (0.2933 => 0.2815, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -4.00% (0.3446 => 0.3308, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.00% (5.0226 => 4.8216, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/random: -3.98% (0.2939 => 0.2822, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -3.95% (0.2989 => 0.2871, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.93% (0.4321 => 0.4151, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -3.93% (0.3255 => 0.3127, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.93% (0.2903 => 0.2789, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: -3.91% (0.3194 => 0.3069, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -3.91% (34.0927 => 32.7587, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary2: -3.91% (0.3481 => 0.3345, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -3.90% (0.3025 => 0.2907, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -3.90% (0.3205 => 0.3080, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -3.86% (0.2849 => 0.2739, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.86% (2.1713 => 2.0875, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: -3.85% (0.7982 => 0.7675, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.85% (0.3016 => 0.2900, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -3.83% (0.3394 => 0.3264, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.82% (0.4083 => 0.3927, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -3.80% (0.3026 => 0.2911, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -3.75% (0.3867 => 0.3722, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -3.73% (0.3621 => 0.3486, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: -3.73% (18.2933 => 17.6118, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.72% (0.3849 => 0.3706, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.68% (0.4813 => 0.4636, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -3.63% (0.6750 => 0.6505, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.50% (0.4427 => 0.4272, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.47% (0.3252 => 0.3139, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.41% (0.3491 => 0.3372, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -3.36% (0.6347 => 0.6134, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -3.33% (0.3059 => 0.2957, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.29% (5.4682 => 5.2882, std.dev.: 0.0027) MultiSource/Applications/hbd/hbd: -3.24% (1.5610 => 1.5104, std.dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference-object: -3.23% (0.6441 => 0.6233, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: -3.14% (0.4524 => 0.4382, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -3.04% (0.3788 => 0.3673, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: -3.01% (0.7779 => 0.7545, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -2.28% (20.7746 => 20.3002, std.dev.: 0.0383) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7510, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/richards_benchmark: -8.70% (1.2842 => 1.1725, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.83% (2.2633 => 2.1767, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3339, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.96% (1.3096 => 1.2839, std.dev.: 0.0099) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4724, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 21:20:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 23:20:47 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121122052047.27AA62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6133?compare_to=6131&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6133, Order: 168484, Start Time: 2012-11-22 03:50:05, End Time: 2012-11-22 05:21:13 To: 6131, Order: 168481, Start Time: 2012-11-22 01:59:44, End Time: 2012-11-22 03:29:59 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 12 (121 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1042 (829 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.74% (0.0756 => 0.0943, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.25% (0.5007 => 0.5220, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.81% (0.3068 => 0.3185, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.49% (0.4780 => 0.4947, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.32% (0.7769 => 0.8027, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.03% (0.3302 => 0.3402, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.76% (0.8849 => 0.9093, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.05% (1.2895 => 1.3030, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 1.03% (0.9903 => 1.0005, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/ffbench: 4.92% (1.3650 => 1.4322, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/except: 2.08% (0.4896 => 0.4998, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.88% (4.3370 => 4.4187, std.dev.: 0.0255) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.28% (1.0690 => 1.0660, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0217 => 0.0217, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.93% (0.0430 => 0.0426, std.dev.: 0.0112) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 23.20% (0.0250 => 0.0308, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 12.59% (0.0278 => 0.0313, std.dev.: 0.0097) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.24% (0.0423 => 0.0424, std.dev.: 0.0150) SingleSource/UnitTests/Vector/Altivec/casts: 20.83% (0.0168 => 0.0203, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/test1: 4.29% (0.0210 => 0.0219, std.dev.: 0.0069) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 900.00% (0.0001 => 0.0010, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.75% (0.1472 => 0.1483, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -4.71% (1.2014 => 1.1448, std.dev.: 0.0157) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.48% (0.4197 => 0.4177, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.74% (0.1416 => 0.1363, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -66.67% (0.0003 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.67% (0.0639 => 0.0590, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.89% (0.0202 => 0.0180, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.27% (0.0573 => 0.0560, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.94% (1.1985 => 1.1872, std.dev.: 0.0173) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 287.50% (0.0008 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2100.00% (0.0001 => 0.0022, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.42% (0.0590 => 0.0558, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 40.74% (0.0189 => 0.0266, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.79% (0.7723 => 0.7861, std.dev.: 0.0062) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/SignlessTypes/Large/cast: 34.55% (0.0055 => 0.0074, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 6.80% (16.4461 => 17.5649, std.dev.: 0.1794) MultiSource/Applications/sqlite3/sqlite3: 2308.29% (0.6332 => 15.2493, std.dev.: 0.1475) MultiSource/Benchmarks/McCat/08-main/main: 48.66% (0.1831 => 0.2722, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.80% (0.1559 => 0.1453, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7027.03% (0.3123 => 22.2577, std.dev.: 0.3590) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.63% (0.2463 => 0.3710, std.dev.: 0.1344) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1519.20% (0.3344 => 5.4146, std.dev.: 0.1018) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.48% (0.2364 => 0.3250, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 3.89% (0.6010 => 0.6244, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/mandel: 3.03% (0.0429 => 0.0442, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.65% (0.3266 => 0.3418, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/strcat: 2.95% (0.1969 => 0.2027, std.dev.: 0.0013) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.91% (0.0224 => 0.0235, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -31.74% (0.0230 => 0.0157, std.dev.: 0.0057) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0476, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 6.29% (0.1462 => 0.1554, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4566, std.dev.: 0.0289) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0723, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4932, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5154, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.4907, std.dev.: 0.3363) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3158, std.dev.: 0.0140) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1366, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3638, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4027, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0815, std.dev.: 0.0009) SingleSource/Regression/C/uint64_to_float: -23.97% (2.1832 => 1.6599, std.dev.: 0.0288) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.88% (0.0810 => 0.0971, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.75% (0.0773 => 0.0887, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.61% (0.0830 => 0.0943, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 11.87% (0.1112 => 0.1244, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.28% (0.8321 => 0.9093, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.70% (0.1425 => 0.1549, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.45% (0.3137 => 0.3402, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.75% (0.2180 => 0.2349, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.70% (0.4847 => 0.5220, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.41% (0.7473 => 0.8027, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.24% (0.6010 => 0.6445, std.dev.: 0.0112) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.21% (0.1983 => 0.2126, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.24% (0.2998 => 0.3185, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.57% (0.6287 => 0.6637, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.42% (0.5961 => 0.6284, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.28% (0.8148 => 0.8578, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.15% (0.9435 => 0.9921, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 4.93% (1.2222 => 1.2824, std.dev.: 0.0134) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.89% (1.1606 => 1.2174, std.dev.: 0.0086) MultiSource/Applications/sgefa/sgefa: 4.80% (0.2999 => 0.3143, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.78% (0.2240 => 0.2347, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.68% (0.2519 => 0.2637, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.46% (0.2378 => 0.2484, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.42% (1.1685 => 1.2202, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.33% (0.3003 => 0.3133, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 4.28% (0.7950 => 0.8290, std.dev.: 0.0128) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.02% (1.2526 => 1.3030, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.83% (0.4127 => 0.4285, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 3.76% (4.1305 => 4.2857, std.dev.: 0.0397) MultiSource/Applications/hbd/hbd: 3.65% (1.4269 => 1.4790, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.61% (0.5817 => 0.6027, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.53% (0.3115 => 0.3225, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.50% (0.8597 => 0.8898, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 3.45% (1.1271 => 1.1660, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.43% (0.4783 => 0.4947, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.41% (0.8697 => 0.8994, std.dev.: 0.0063) MultiSource/Applications/lua/lua: 3.35% (3.8189 => 3.9467, std.dev.: 0.0313) MultiSource/Applications/treecc/treecc: 3.30% (1.9948 => 2.0607, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.30% (1.3279 => 1.3717, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.28% (1.6386 => 1.6924, std.dev.: 0.0136) MultiSource/Applications/SIBsim4/SIBsim4: 3.25% (1.2568 => 1.2976, std.dev.: 0.0042) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.17% (6.6074 => 6.8169, std.dev.: 0.0308) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.14% (4.1763 => 4.3075, std.dev.: 0.0267) MultiSource/Applications/SPASS/SPASS: 3.11% (14.2605 => 14.7036, std.dev.: 0.0538) MultiSource/Benchmarks/McCat/05-eks/eks: 3.00% (0.4397 => 0.4529, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.99% (0.8050 => 0.8291, std.dev.: 0.0043) MultiSource/Applications/minisat/minisat: 2.96% (0.6834 => 0.7036, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.88% (8.6476 => 8.8965, std.dev.: 0.0245) MultiSource/Applications/siod/siod: 2.88% (2.2184 => 2.2822, std.dev.: 0.0140) MultiSource/Applications/d/make_dparser: 2.85% (3.2366 => 3.3289, std.dev.: 0.0264) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.84% (0.8712 => 0.8959, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.79% (0.8340 => 0.8573, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.77% (0.9074 => 0.9325, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.76% (0.8331 => 0.8561, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.74% (0.8611 => 0.8847, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.71% (0.9069 => 0.9315, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.71% (0.8261 => 0.8485, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.66% (0.8007 => 0.8220, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.64% (0.8457 => 0.8680, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.60% (4.5702 => 4.6888, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.56% (0.9688 => 0.9936, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.56% (0.8716 => 0.8939, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.52% (0.8317 => 0.8527, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.52% (4.4880 => 4.6012, std.dev.: 0.0339) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.49% (4.4873 => 4.5989, std.dev.: 0.0373) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.49% (0.8086 => 0.8287, std.dev.: 0.0043) MultiSource/Applications/ClamAV/clamscan: 2.49% (14.7684 => 15.1355, std.dev.: 0.0484) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.48% (0.8855 => 0.9075, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 2.47% (31.8598 => 32.6464, std.dev.: 0.0926) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.44% (13.1811 => 13.5022, std.dev.: 0.0801) MultiSource/Benchmarks/Prolangs-C/football/football: 2.43% (0.8768 => 0.8981, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.42% (1.1170 => 1.1440, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.40% (0.8420 => 0.8622, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.40% (0.9056 => 0.9273, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.39% (0.5191 => 0.5315, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.33% (0.7966 => 0.8152, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 2.21% (15.3280 => 15.6667, std.dev.: 0.0690) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.15% (0.8177 => 0.8353, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.14% (0.7932 => 0.8102, std.dev.: 0.0047) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (6.7320 => 6.8761, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.10% (0.8066 => 0.8235, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.07% (0.8927 => 0.9112, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.99% (0.8286 => 0.8451, std.dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: 1.99% (0.9810 => 1.0005, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.93% (0.8069 => 0.8225, std.dev.: 0.0034) MultiSource/Applications/lambda-0_1_3/lambda: 1.71% (0.7557 => 0.7686, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 1.70% (8.6247 => 8.7714, std.dev.: 0.0207) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.68% (1.2602 => 1.2814, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 116.08% (0.0199 => 0.0430, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.14% (2.9753 => 3.4555, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.09% (0.7597 => 0.8819, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.42% (2.7995 => 3.2033, std.dev.: 0.0690) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.58% (5.0261 => 5.6080, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.82% (1.1857 => 1.2784, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 7.11% (1.7056 => 1.8268, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.68% (4.7794 => 5.0986, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/richards_benchmark: 6.25% (1.3037 => 1.3852, std.dev.: 0.0150) MultiSource/Applications/SIBsim4/SIBsim4: 6.04% (3.1873 => 3.3799, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.96% (4.5327 => 4.8028, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.89% (4.9686 => 5.2614, std.dev.: 0.0144) MultiSource/Benchmarks/Olden/treeadd/treeadd: 5.52% (0.3587 => 0.3785, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.43% (3.3761 => 3.5257, std.dev.: 0.0252) MultiSource/Applications/lambda-0_1_3/lambda: 4.38% (7.4933 => 7.8218, std.dev.: 0.0789) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.36% (6.2275 => 6.4990, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.19% (4.9453 => 5.1524, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.08% (4.9469 => 5.1489, std.dev.: 0.0055) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.03% (1.2337 => 1.2834, std.dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: 3.91% (14.0064 => 14.5535, std.dev.: 0.0338) MultiSource/Applications/siod/siod: 2.91% (3.6643 => 3.7711, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.80% (8.2783 => 8.5103, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.80% (11.5690 => 11.8929, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout/lists: 2.32% (7.3375 => 7.5076, std.dev.: 0.0189) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (1.1365 => 1.1623, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.25% (4.8660 => 4.9754, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.42% (1.5941 => 1.6168, std.dev.: 0.0067) MultiSource/Benchmarks/llubenchmark/llu: 1.41% (1.9967 => 2.0248, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/ReedSolomon: 1.33% (8.5322 => 8.6460, std.dev.: 0.0061) SingleSource/Benchmarks/Stanford/FloatMM: 1.31% (0.8807 => 0.8922, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.23% (2.4647 => 2.4949, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.19% (3.5679 => 3.6105, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: 1.14% (1.2061 => 1.2198, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.19% (5.4641 => 4.3060, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.24% (7.2130 => 6.2582, std.dev.: 0.2377) SingleSource/Benchmarks/McGill/chomp: -11.11% (1.1216 => 0.9970, std.dev.: 0.0132) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.90% (1.0512 => 0.9366, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.75% (0.3269 => 0.2983, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.72% (14.6451 => 13.3684, std.dev.: 0.1573) MultiSource/Benchmarks/mafft/pairlocalalign: -8.56% (63.1822 => 57.7759, std.dev.: 0.0354) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.86% (4.7482 => 4.4224, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.05% (3.7148 => 3.4899, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.85% (5.4972 => 5.1757, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.13% (5.1557 => 4.8911, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.39% (4.7449 => 4.5368, std.dev.: 0.0115) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.79% (2.4490 => 2.3562, std.dev.: 0.0318) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.74% (6.0224 => 5.7972, std.dev.: 0.0334) MultiSource/Applications/lua/lua: -3.36% (29.8330 => 28.8305, std.dev.: 0.1345) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.24% (28.5821 => 27.6553, std.dev.: 0.0354) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.05% (0.5807 => 0.5630, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.53% (9.9065 => 9.6555, std.dev.: 0.0922) MultiSource/Applications/aha/aha: -2.37% (3.3398 => 3.2607, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: -2.28% (3.4237 => 3.3457, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.01% (11.5316 => 11.3002, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.65% (4.9994 => 4.9171, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.50% (2.3487 => 2.3135, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.24% (5.6343 => 5.5646, std.dev.: 0.0089) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.88% (1.0262 => 1.0660, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0112) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 21.26% (0.0254 => 0.0308, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0097) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0150) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0069) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 42.86% (0.0007 => 0.0010, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 3.13% (0.1438 => 0.1483, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.05% (1.1329 => 1.1448, std.dev.: 0.0157) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.31% (0.4164 => 0.4177, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.44% (0.1369 => 0.1363, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.96% (0.0641 => 0.0590, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.69% (0.0195 => 0.0180, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.11% (0.0578 => 0.0560, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.80% (1.1437 => 1.1872, std.dev.: 0.0173) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 57.14% (0.0014 => 0.0022, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.00% (0.0627 => 0.0558, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.95% (0.8017 => 0.7861, std.dev.: 0.0062) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/SignlessTypes/Large/cast: 19.35% (0.0062 => 0.0074, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 21:47:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 23:47:21 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121122054721.2E5D42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6134?compare_to=6127&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6134, Order: 168481, Start Time: 2012-11-22 02:26:57, End Time: 2012-11-22 05:47:46 To: 6127, Order: 168460, Start Time: 2012-11-21 22:18:05, End Time: 2012-11-22 01:38:46 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (172 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1090 (718 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.05% (117.2684 => 118.4983, std.dev.: 0.0570) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.18% (2.0102 => 1.9864, std.dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.56% (0.0625 => 0.0891, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.02% (0.1063 => 0.1414, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.24% (0.2969 => 0.3748, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.03% (0.4253 => 0.5360, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.95% (0.1106 => 0.1393, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.91% (0.0714 => 0.0899, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.03% (0.4139 => 0.5175, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 24.68% (1.5932 => 1.9864, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.58% (0.0475 => 0.0587, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.56% (0.5900 => 0.7290, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.49% (0.4994 => 0.6167, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.95% (0.0584 => 0.0718, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.84% (0.5000 => 0.6142, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.16% (0.1620 => 0.1979, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 22.04% (0.0599 => 0.0731, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.96% (0.0897 => 0.1094, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.94% (0.1021 => 0.1245, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.86% (0.1107 => 0.1349, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.72% (0.0584 => 0.0705, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.70% (0.0541 => 0.0653) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.70% (0.0633 => 0.0764) MultiSource/Benchmarks/Olden/em3d/em3d: 20.68% (0.0948 => 0.1144, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.40% (0.1103 => 0.1328, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.39% (0.3903 => 0.4699, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.25% (0.0642 => 0.0772, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 20.22% (0.0821 => 0.0987) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.14% (0.1549 => 0.1861, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.14% (0.1604 => 0.1927, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.04% (0.1003 => 0.1204, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.71% (0.0822 => 0.0984, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 19.70% (0.0604 => 0.0723, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 19.64% (0.1619 => 0.1937, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 19.11% (0.0947 => 0.1128, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.88% (0.1462 => 0.1738, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 18.81% (0.0808 => 0.0960, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.71% (0.3890 => 0.4618, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.27% (0.2014 => 0.2382, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.98% (0.2736 => 0.3228, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 17.98% (0.1218 => 0.1437, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.72% (1.3152 => 1.5482, std.dev.: 0.0045) SingleSource/UnitTests/ObjC++/Hello: 17.68% (0.5826 => 0.6856, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.65% (0.1088 => 0.1280, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 17.65% (0.4029 => 0.4740, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.45% (0.2866 => 0.3366, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 17.35% (0.5889 => 0.6911, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 17.34% (0.1505 => 0.1766, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.19% (0.0605 => 0.0709, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 17.18% (0.5546 => 0.6499, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.97% (3.5627 => 4.1672, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 16.93% (1.8794 => 2.1975, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.92% (0.1968 => 0.2301, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.81% (0.4658 => 0.5441, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.65% (1.6211 => 1.8910, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.63% (0.5026 => 0.5862, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.48% (0.3271 => 0.3810, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 16.47% (0.9697 => 1.1294, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.47% (0.1160 => 0.1351, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 16.43% (1.0781 => 1.2552, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.12% (0.4361 => 0.5064, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.00% (0.2875 => 0.3335, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 15.97% (0.1421 => 0.1648, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.73% (0.3930 => 0.4548, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.72% (4.4195 => 5.1144, std.dev.: 0.0035) MultiSource/Applications/ClamAV/clamscan: 15.70% (4.2109 => 4.8722, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: 15.65% (0.1284 => 0.1485, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.65% (2.7292 => 3.1562, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.41% (0.1090 => 0.1258, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 15.37% (0.7171 => 0.8273, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 15.30% (0.2725 => 0.3142, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 15.27% (0.2750 => 0.3170, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 15.25% (0.2714 => 0.3128, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.23% (0.2738 => 0.3155, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.21% (1.9694 => 2.2689, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.18% (0.2911 => 0.3353, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 15.16% (0.2823 => 0.3251, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 15.15% (0.2811 => 0.3237, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 15.14% (0.2780 => 0.3201, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.13% (0.2729 => 0.3142, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.11% (0.2792 => 0.3214, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: 15.07% (0.2813 => 0.3237, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 15.06% (0.9909 => 1.1401, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/random: 15.06% (0.2803 => 0.3225, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 15.05% (0.3004 => 0.3456, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.03% (1.9966 => 2.2967, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 14.84% (0.2075 => 0.2383, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.80% (0.3195 => 0.3668, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 14.76% (0.3096 => 0.3553, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.74% (2.0673 => 2.3720, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: 14.60% (0.3267 => 0.3744, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 14.49% (0.3258 => 0.3730, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 14.35% (0.3317 => 0.3793, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.31% (0.3124 => 0.3571, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 14.26% (0.2566 => 0.2932, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.08% (0.3060 => 0.3491, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 14.03% (1.4269 => 1.6271, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 14.03% (23.5202 => 26.8195, std.dev.: 0.0082) SingleSource/UnitTests/ObjC/for-in: 13.93% (0.3496 => 0.3983, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.93% (0.3446 => 0.3926, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.92% (0.3362 => 0.3830, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.91% (0.3465 => 0.3947, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.90% (0.3488 => 0.3973, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 13.89% (0.3348 => 0.3813, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 13.87% (0.3469 => 0.3950, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 13.85% (0.7875 => 0.8966, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 13.84% (0.3460 => 0.3939, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/trivial-interface: 13.83% (0.3442 => 0.3918, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.74% (0.3282 => 0.3733, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 13.73% (0.3678 => 0.4183, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.68% (0.3625 => 0.4121, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 13.59% (0.3650 => 0.4146, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 13.59% (0.0758 => 0.0861) SingleSource/Benchmarks/Shootout-C++/sieve: 13.55% (0.3726 => 0.4231, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 13.43% (0.3477 => 0.3944, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.42% (0.3643 => 0.4132, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 13.34% (2.1653 => 2.4542, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/parameter-passing: 13.24% (0.3724 => 0.4217, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.24% (0.3981 => 0.4508, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 13.22% (0.4146 => 0.4694, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 13.18% (4.6177 => 5.2265, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/hash2: 13.13% (0.4251 => 0.4809, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.09% (0.3690 => 0.4173, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.98% (0.3845 => 0.4344, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 12.75% (2.1013 => 2.3693, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.75% (0.2040 => 0.2300, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 12.49% (0.2691 => 0.3027, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 12.47% (0.5012 => 0.5637, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.66% (0.6435 => 0.7185, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11.59% (5.5417 => 6.1839, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.38% (0.1028 => 0.1145, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.28% (0.1383 => 0.1539, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 10.83% (0.3498 => 0.3877, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 10.71% (0.4847 => 0.5366, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.59% (0.2068 => 0.2287, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.52% (0.2737 => 0.3025, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 10.49% (0.6634 => 0.7330, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.31% (0.3084 => 0.3402, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 9.92% (2.0346 => 2.2364, std.dev.: 0.0048) MultiSource/Applications/minisat/minisat: 9.89% (0.3336 => 0.3666, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 9.74% (0.2391 => 0.2624, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.70% (0.2103 => 0.2307, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.90% (0.5361 => 0.5838, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.85% (4.6926 => 5.1078, std.dev.: 0.0159) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.40% (11.6398 => 12.6180, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.21% (0.7426 => 0.8036, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.09% (0.5584 => 0.6036, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 6.98% (11.9555 => 12.7902, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.48% (0.3792 => 0.3962, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 8.64% (0.2802 => 0.3044, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6114, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 5.98% (0.2122 => 0.2249, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.24% (12.0509 => 12.6826, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 4.75% (15.4430 => 16.1760, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/flops-2: 4.75% (1.8057 => 1.8914, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6413, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1991, std.dev.: 0.0058) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.53% (3.1722 => 3.2207, std.dev.: 0.0031) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3012, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2854, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.26% (2.0820 => 2.1082, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5926, std.dev.: 0.0148) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.94% (2.4764 => 2.4035, std.dev.: 0.0102) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.88% (25.4195 => 16.5520, std.dev.: 0.0121) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9753, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7994, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary2: -7.49% (0.2402 => 0.2222, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7994, std.dev.: 0.0136) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.13% (0.6293 => 0.6096, std.dev.: 0.0069) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7727, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.81% (17.2379 => 16.7534, std.dev.: 0.0762) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8664, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5759, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4957, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.22% (105.3826 => 104.0976, std.dev.: 0.1232) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0464, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 21:59:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 21 Nov 2012 23:59:26 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121122055926.5BC652A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6135?compare_to=6132&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6135, Order: 168485, Start Time: 2012-11-22 04:26:12, End Time: 2012-11-22 05:59:51 To: 6132, Order: 168481, Start Time: 2012-11-22 02:29:46, End Time: 2012-11-22 04:03:14 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 1 (182 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (855 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.28% (2.0875 => 2.0607, std.dev.: 0.0086) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.81% (0.3834 => 0.4440, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.14% (2.0478 => 2.1120, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/salsa20: 2.43% (7.4937 => 7.6758, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/hash2: 2.23% (3.1932 => 3.2645, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.22% (0.1431 => 0.1299, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.37% (0.3821 => 0.3501, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -7.01% (2.4924 => 2.3176, std.dev.: 0.0140) SingleSource/UnitTests/ObjC/exceptions-2: -7.00% (0.3831 => 0.3563, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.97% (0.3142 => 0.2923, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.96% (0.3880 => 0.3610, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.94% (0.3848 => 0.3581, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.93% (0.3896 => 0.3626, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -6.93% (0.3812 => 0.3548, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.84% (0.4033 => 0.3757, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.82% (0.9542 => 0.8891, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.81% (0.3891 => 0.3626, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.78% (0.4176 => 0.3893, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -6.48% (0.4199 => 0.3927, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.47% (0.2428 => 0.2271, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.46% (0.3884 => 0.3633, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.44% (0.1584 => 0.1482, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.37% (0.2355 => 0.2205, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -6.34% (0.2160 => 0.2023, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.32% (9.2283 => 8.6454, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: -6.29% (16.1920 => 15.1730, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.29% (0.1796 => 0.1683, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.28% (0.6484 => 0.6077, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -6.22% (7.0961 => 6.6547, std.dev.: 0.0087) MultiSource/Applications/sgefa/sgefa: -6.20% (0.3357 => 0.3149, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: -6.19% (0.4280 => 0.4015, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.17% (1.0544 => 0.9893, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -6.16% (0.9179 => 0.8614, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.15% (0.9852 => 0.9246, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.15% (0.3658 => 0.3433, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.13% (1.3722 => 1.2881, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.06% (0.1716 => 0.1612, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.98% (4.8161 => 4.5282, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.96% (0.5591 => 0.5258, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.93% (4.0323 => 3.7931, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.92% (0.5863 => 0.5516, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -5.91% (0.1761 => 0.1657, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.90% (3.5339 => 3.3255, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.86% (6.7716 => 6.3745, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.84% (0.5805 => 0.5466, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.83% (0.6293 => 0.5926, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.83% (1.6364 => 1.5410, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.81% (4.8802 => 4.5969, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -5.79% (1.1450 => 1.0787, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.79% (0.5478 => 0.5161, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.77% (0.5925 => 0.5583, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.76% (1.4642 => 1.3798, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: -5.76% (4.3330 => 4.0834, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.76% (0.6667 => 0.6283, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: -5.76% (1.1530 => 1.0866, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.75% (0.2695 => 0.2540, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.75% (0.5705 => 0.5377, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.74% (0.5849 => 0.5513, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.73% (0.6297 => 0.5936, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -5.73% (0.2985 => 0.2814, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.72% (4.5069 => 4.2493, std.dev.: 0.0115) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.70% (1.2300 => 1.1599, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.68% (0.6230 => 0.5876, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.67% (1.2784 => 1.2059, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.66% (0.7919 => 0.7471, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.65% (0.5802 => 0.5474, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.65% (0.6194 => 0.5844, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.65% (0.5456 => 0.5148, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.64% (0.6260 => 0.5907, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.62% (0.6052 => 0.5712, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.61% (0.2548 => 0.2405, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.61% (0.6736 => 0.6358, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.61% (0.5581 => 0.5268, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.61% (0.3406 => 0.3215, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.60% (0.6660 => 0.6287, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.58% (0.5857 => 0.5530, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -5.58% (17.1032 => 16.1491, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/08-main/main: -5.53% (0.2659 => 0.2512, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.51% (0.5570 => 0.5263, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.51% (0.6681 => 0.6313, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.51% (0.6446 => 0.6091, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.51% (0.5575 => 0.5268, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.50% (0.2999 => 0.2834, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.50% (0.5859 => 0.5537, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -5.49% (0.4515 => 0.4267, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: -5.47% (1.3864 => 1.3105, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.46% (0.6189 => 0.5851, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.44% (0.6304 => 0.5961, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -5.42% (0.3025 => 0.2861, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.42% (0.5941 => 0.5619, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.41% (0.6676 => 0.6315, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.41% (14.2083 => 13.4403, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.40% (8.0126 => 7.5803, std.dev.: 0.0036) MultiSource/Applications/Burg/burg: -5.39% (1.2515 => 1.1840, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.37% (0.6440 => 0.6094, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.37% (0.4151 => 0.3928, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.37% (0.4916 => 0.4652, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.37% (0.3483 => 0.3296, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.36% (0.5688 => 0.5383, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.33% (0.8521 => 0.8067, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: -5.33% (15.5079 => 14.6821, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/random: -5.31% (0.2939 => 0.2783, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.31% (0.7198 => 0.6816, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.30% (0.4813 => 0.4558, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: -5.29% (0.2871 => 0.2719, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.29% (0.3931 => 0.3723, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: -5.29% (0.3194 => 0.3025, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.29% (0.6033 => 0.5714, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -5.28% (0.3581 => 0.3392, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.27% (0.2278 => 0.2158, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.27% (0.5999 => 0.5683, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.27% (0.3057 => 0.2896, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.26% (0.3837 => 0.3635, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -5.25% (0.3255 => 0.3084, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.24% (0.2385 => 0.2260, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.22% (0.2933 => 0.2780, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.21% (0.3016 => 0.2859, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.20% (1.2221 => 1.1585, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: -5.19% (1.3148 => 1.2465, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.19% (0.5168 => 0.4900, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wc: -5.18% (0.3205 => 0.3039, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.18% (1.6474 => 1.5621, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.15% (0.3319 => 0.3148, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: -5.12% (0.4861 => 0.4612, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -5.12% (0.3026 => 0.2871, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.09% (2.1713 => 2.0607, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.09% (0.4321 => 0.4101, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -5.09% (4.0594 => 3.8528, std.dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: -5.06% (15.2527 => 14.4810, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/hello: -5.05% (0.2849 => 0.2705, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.05% (1.2210 => 1.1593, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: -5.05% (0.7447 => 0.7071, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.04% (0.3849 => 0.3655, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -5.01% (3.5154 => 3.3392, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.00% (0.3323 => 0.3157, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.94% (22.4056 => 21.2987, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.91% (0.7339 => 0.6979, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.90% (0.3059 => 0.2909, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.89% (0.2903 => 0.2761, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -4.88% (0.2989 => 0.2843, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -4.88% (0.3481 => 0.3311, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary3: -4.88% (0.3446 => 0.3278, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.86% (0.7021 => 0.6680, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -4.83% (0.3394 => 0.3230, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -4.82% (2.4021 => 2.2864, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.82% (0.6395 => 0.6087, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -4.80% (0.4248 => 0.4044, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.80% (0.4083 => 0.3887, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.79% (0.9557 => 0.9099, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.78% (0.7524 => 0.7164, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -4.78% (0.3867 => 0.3682, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -4.72% (0.3621 => 0.3450, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: -4.70% (2.1401 => 2.0396, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.69% (0.5569 => 0.5308, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.65% (0.5567 => 0.5308, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.63% (0.6395 => 0.6099, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -4.59% (0.7982 => 0.7616, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.58% (0.9077 => 0.8661, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.58% (0.5329 => 0.5085, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: -4.57% (18.2933 => 17.4567, std.dev.: 0.0184) MultiSource/Applications/spiff/spiff: -4.49% (0.8418 => 0.8040, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.45% (0.4427 => 0.4230, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.44% (2.2587 => 2.1585, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -4.43% (0.6750 => 0.6451, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -4.40% (0.3271 => 0.3127, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: -4.40% (34.0927 => 32.5936, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/sieve: -4.38% (0.3788 => 0.3622, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.30% (0.3491 => 0.3341, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.22% (0.6347 => 0.6079, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.08% (0.6441 => 0.6178, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.06% (0.3252 => 0.3120, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.86% (5.0226 => 4.8287, std.dev.: 0.0043) SingleSource/UnitTests/ObjC++/property-reference: -3.86% (0.7779 => 0.7479, std.dev.: 0.0037) MultiSource/Applications/hbd/hbd: -3.75% (1.5610 => 1.5024, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.50% (5.4682 => 5.2766, std.dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -2.39% (20.7746 => 20.2780, std.dev.: 0.0376) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.34% (7.5137 => 5.7599, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -8.65% (1.2842 => 1.1731, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.78% (2.2633 => 2.1778, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.73% (1.3096 => 1.2739, std.dev.: 0.0090) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.63% (6.5735 => 6.4664, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 22:43:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 22 Nov 2012 00:43:14 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121122064314.AD6992A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6136?compare_to=6130&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6136, Order: 168484, Start Time: 2012-11-22 04:23:54, End Time: 2012-11-22 06:43:40 To: 6130, Order: 168474, Start Time: 2012-11-22 01:04:43, End Time: 2012-11-22 03:24:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 55 (133 on baseline) Performance Improvements: 9 (39 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1022 (713 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/objects/objects: 17.16% (0.1160 => 0.1359, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 16.68% (0.7184 => 0.8382, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 16.08% (0.1648 => 0.1913, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 14.71% (0.1169 => 0.1341, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.60% (0.6665 => 0.7638, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.16% (0.7184 => 0.8201, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 14.10% (0.7191 => 0.8205, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 13.37% (0.6718 => 0.7616, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 13.12% (0.0831 => 0.0940, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.01% (0.6370 => 0.7199, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 12.83% (0.6140 => 0.6928, std.dev.: 0.0088) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.77% (0.1167 => 0.1316, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.48% (1.7420 => 1.9594, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C++/office/office: 12.46% (0.3379 => 0.3800, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 12.21% (0.6136 => 0.6885, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.64% (0.6434 => 0.7183, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.61% (0.6701 => 0.7479, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.53% (0.4179 => 0.4661, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/heapsort: 11.01% (0.3114 => 0.3457, std.dev.: 0.0050) MultiSource/Applications/siod/siod: 10.67% (2.6384 => 2.9199, std.dev.: 0.0542) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.30% (0.5118 => 0.5645, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.94% (0.1711 => 0.1881, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.91% (0.8073 => 0.8792, std.dev.: 0.0270) MultiSource/Applications/sgefa/sgefa: 8.56% (0.3576 => 0.3882, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.39% (4.8154 => 5.2196, std.dev.: 0.0844) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.39% (0.1907 => 0.2067, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.24% (0.1530 => 0.1656, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.49% (1.2211 => 1.3125, std.dev.: 0.0207) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.48% (0.5042 => 0.5419, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: 7.46% (0.2936 => 0.3155, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/oourafft: 7.41% (0.3616 => 0.3884, std.dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: 7.28% (6.6163 => 7.0977, std.dev.: 0.0770) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.26% (0.9535 => 1.0227, std.dev.: 0.0066) MultiSource/Applications/viterbi/viterbi: 7.04% (0.1789 => 0.1915, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.93% (0.1674 => 0.1790, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 6.91% (0.3789 => 0.4051, std.dev.: 0.0090) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.64% (0.1913 => 0.2040, std.dev.: 0.0038) MultiSource/Applications/hbd/hbd: 6.55% (1.7316 => 1.8450, std.dev.: 0.0389) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.47% (0.7157 => 0.7620, std.dev.: 0.0176) SingleSource/UnitTests/Vector/constpool: 5.72% (53.4972 => 56.5583, std.dev.: 0.2844) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.49% (8.0404 => 8.4818, std.dev.: 0.1271) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.79% (4.7313 => 4.9578, std.dev.: 0.0479) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 4.39% (20.8390 => 21.7542, std.dev.: 0.0433) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.63% (10.9250 => 11.3220, std.dev.: 0.1443) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 22.13% (1.3192 => 1.6111, std.dev.: 0.0531) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0841 => 0.1018, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 20.54% (2.1027 => 2.5346, std.dev.: 0.0864) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.82% (1.5571 => 1.8501, std.dev.: 0.0674) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.54% (8.9190 => 9.8589, std.dev.: 0.0956) SingleSource/Benchmarks/Shootout/hash: 7.26% (4.9288 => 5.2868, std.dev.: 0.1004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.73% (9.3229 => 9.9505, std.dev.: 0.2191) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.48% (5.3381 => 5.5236, std.dev.: 0.0315) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.68% (4.8016 => 4.9301, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: 2.28% (19.1153 => 19.5514, std.dev.: 0.0689) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.22% (2.1817 => 2.2084, std.dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -12.73% (0.8988 => 0.7844, std.dev.: 0.0338) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -12.21% (0.6585 => 0.5781, std.dev.: 0.0282) SingleSource/Benchmarks/CoyoteBench/huffbench: -11.50% (0.1148 => 0.1016, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -9.05% (0.2310 => 0.2101, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.14% (6.0289 => 5.6587, std.dev.: 0.1064) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.66% (17.4400 => 17.1511, std.dev.: 0.0684) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -4.93% (3.3278 => 3.1637, std.dev.: 0.0522) MultiSource/Benchmarks/FreeBench/neural/neural: -4.49% (0.2339 => 0.2234, std.dev.: 0.0038) MultiSource/Benchmarks/NPB-serial/is/is: -2.97% (8.8664 => 8.6032, std.dev.: 0.0660) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.27% (69.5227 => 69.7117, std.dev.: 0.1796) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 1.20% (0.1338 => 0.1354, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0419 => 0.0419, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0651 => 0.0652, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -0.11% (494.4445 => 493.9185, std.dev.: 0.1970) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 10.23% (63.2438 => 69.7117, std.dev.: 0.1796) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0419, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43698.75% (1.1277 => 493.9185, std.dev.: 0.1970) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 193.12% (0.5229 => 1.5327, std.dev.: 0.0971) MultiSource/Applications/SPASS/SPASS: 22.06% (14.9895 => 18.2961, std.dev.: 0.1121) MultiSource/Applications/kimwitu++/kc: 48.92% (14.1553 => 21.0796, std.dev.: 0.3681) MultiSource/Benchmarks/MallocBench/gs/gs: 14.51% (4.1105 => 4.7068, std.dev.: 0.2497) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.60% (1.1048 => 1.5092, std.dev.: 0.0613) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 426.29% (7.1582 => 37.6730, std.dev.: 0.1544) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.42% (3.4629 => 6.4210, std.dev.: 0.2233) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.08% (0.6222 => 1.0271, std.dev.: 0.0651) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10648.75% (0.0720 => 7.7391, std.dev.: 0.2588) MultiSource/Applications/SIBsim4/SIBsim4: 3859300.00% (0.0001 => 3.8594, std.dev.: 0.0437) MultiSource/Applications/SPASS/SPASS: 13208700.00% (0.0001 => 13.2088, std.dev.: 1.7045) MultiSource/Applications/kimwitu++/kc: 53600.00% (0.0001 => 0.0537, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63800.00% (0.0001 => 0.0639, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576700.00% (0.0001 => 0.5768, std.dev.: 0.0240) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10073200.00% (0.0001 => 10.0733, std.dev.: 0.0173) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6692900.00% (0.0001 => 6.6930, std.dev.: 0.4089) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1843.38% (1.1194 => 21.7542, std.dev.: 0.0433) MultiSource/Applications/ClamAV/clamscan: 66.01% (22.1758 => 36.8142, std.dev.: 0.6883) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 60.50% (7.0540 => 11.3220, std.dev.: 0.1443) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.75% (2.9384 => 4.6058, std.dev.: 0.1957) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.12% (8.1363 => 12.2142, std.dev.: 0.2234) MultiSource/Applications/JM/lencod/lencod: 47.33% (21.9371 => 32.3198, std.dev.: 0.2689) MultiSource/Benchmarks/FreeBench/distray/distray: 44.98% (0.1056 => 0.1531, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/almabench: 44.38% (0.0730 => 0.1054, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 38.13% (0.1432 => 0.1978, std.dev.: 0.0070) MultiSource/Benchmarks/Fhourstones/fhourstones: 31.99% (0.1566 => 0.2067, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 29.98% (0.0447 => 0.0581, std.dev.: 0.0011) SingleSource/UnitTests/vla: 29.58% (0.0355 => 0.0460, std.dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/fldry: 29.11% (0.0481 => 0.0621, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 28.79% (0.1584 => 0.2040, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 28.77% (0.0730 => 0.0940, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 28.45% (0.1044 => 0.1341, std.dev.: 0.0043) MultiSource/Applications/siod/siod: 27.12% (2.2969 => 2.9199, std.dev.: 0.0542) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 27.11% (1.5415 => 1.9594, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout/lists: 25.56% (0.0626 => 0.0786, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.15% (0.8172 => 1.0227, std.dev.: 0.0066) MultiSource/Applications/sgefa/sgefa: 24.86% (0.3109 => 0.3882, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 24.57% (0.1510 => 0.1881, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 24.41% (0.0467 => 0.0581, std.dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.36% (0.1125 => 0.1399, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.99% (0.0746 => 0.0925, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.86% (0.1337 => 0.1656, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 23.48% (0.1695 => 0.2093, std.dev.: 0.0060) MultiSource/Applications/oggenc/oggenc: 23.24% (5.7591 => 7.0977, std.dev.: 0.0770) MultiSource/Applications/viterbi/viterbi: 23.15% (0.1555 => 0.1915, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: 22.82% (0.0482 => 0.0592, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 22.39% (4.2646 => 5.2196, std.dev.: 0.0844) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 21.99% (0.1114 => 0.1359, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 21.82% (0.3826 => 0.4661, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/08-main/main: 21.81% (0.2554 => 0.3111, std.dev.: 0.0197) SingleSource/Benchmarks/Shootout-C++/wordfreq: 21.80% (0.3307 => 0.4028, std.dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/fftbench: 21.76% (0.4636 => 0.5645, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/office/office: 21.17% (0.3136 => 0.3800, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 20.52% (0.5020 => 0.6050, std.dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/heapsort: 20.37% (0.2872 => 0.3457, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/tsp/tsp: 20.17% (0.1175 => 0.1412, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.13% (0.0770 => 0.0925, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.96% (0.4615 => 0.5536, std.dev.: 0.0213) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 19.47% (1.5859 => 1.8947, std.dev.: 0.0670) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 19.38% (14.3668 => 17.1511, std.dev.: 0.0684) MultiSource/Benchmarks/VersaBench/bmm/bmm: 19.37% (0.0759 => 0.0906, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/fibo: 19.23% (0.2725 => 0.3249, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 19.17% (1.3050 => 1.5552, std.dev.: 0.0334) SingleSource/Benchmarks/CoyoteBench/lpbench: 18.84% (0.0929 => 0.1104, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.52% (0.2700 => 0.3200, std.dev.: 0.0185) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.47% (0.0704 => 0.0834, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 18.38% (0.3422 => 0.4051, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/oourafft: 18.34% (0.3282 => 0.3884, std.dev.: 0.0032) MultiSource/Applications/hbd/hbd: 18.25% (1.5603 => 1.8450, std.dev.: 0.0389) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.14% (0.6450 => 0.7620, std.dev.: 0.0176) SingleSource/Benchmarks/Shootout-C++/lists1: 18.13% (0.3684 => 0.4352, std.dev.: 0.0151) MultiSource/Applications/lua/lua: 17.98% (3.8723 => 4.5684, std.dev.: 0.2062) SingleSource/Benchmarks/Shootout-C++/spellcheck: 17.84% (0.4203 => 0.4953, std.dev.: 0.0193) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 17.72% (0.1625 => 0.1913, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.46% (0.0842 => 0.0989, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/matrix: 17.24% (0.3098 => 0.3632, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/strcat: 16.99% (0.2831 => 0.3312, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.88% (0.2891 => 0.3379, std.dev.: 0.0134) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.82% (0.0648 => 0.0757, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.65% (0.0871 => 0.1016, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.59% (0.0675 => 0.0787, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/wc: 16.42% (0.3052 => 0.3553, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hello: 16.25% (0.2714 => 0.3155, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.07% (0.0834 => 0.0968, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.92% (5.0018 => 5.7982, std.dev.: 0.1641) MultiSource/Benchmarks/Olden/mst/mst: 15.74% (0.1163 => 0.1346, std.dev.: 0.0062) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.63% (0.0953 => 0.1102, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.45% (0.2065 => 0.2384, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout/matrix: 15.40% (0.0818 => 0.0944, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.97% (0.1029 => 0.1183, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.95% (0.1117 => 0.1284, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.94% (0.0770 => 0.0885, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.65% (0.2758 => 0.3162, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.44% (4.9449 => 5.6587, std.dev.: 0.1064) MultiSource/Applications/spiff/spiff: 14.41% (0.7835 => 0.8964, std.dev.: 0.0414) MultiSource/Applications/sqlite3/sqlite3: 14.30% (17.1811 => 19.6380, std.dev.: 0.5488) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.12% (0.1062 => 0.1212, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.89% (0.5981 => 0.6812, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.63% (0.3441 => 0.3910, std.dev.: 0.0177) MultiSource/Benchmarks/mafft/pairlocalalign: 13.40% (9.4845 => 10.7556, std.dev.: 0.2765) MultiSource/Applications/hexxagon/hexxagon: 13.23% (1.2842 => 1.4541, std.dev.: 0.0555) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.21% (0.2271 => 0.2571, std.dev.: 0.0111) SingleSource/UnitTests/ObjC/exceptions-4: 12.19% (0.3543 => 0.3975, std.dev.: 0.0089) SingleSource/UnitTests/ObjC/exceptions-3: 12.17% (0.3516 => 0.3944, std.dev.: 0.0086) SingleSource/UnitTests/ObjC/exceptions-2: 12.15% (0.3497 => 0.3922, std.dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.49% (0.1906 => 0.2125, std.dev.: 0.0073) SingleSource/UnitTests/ObjC++/property-reference-object: 11.24% (0.6030 => 0.6708, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.07% (0.4879 => 0.5419, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.05% (0.1892 => 0.2101, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.01% (0.1438 => 0.1582, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.01% (0.3177 => 0.3495, std.dev.: 0.0100) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.53% (7.9617 => 8.4818, std.dev.: 0.1271) SingleSource/UnitTests/Vector/constpool: 4.42% (54.1659 => 56.5583, std.dev.: 0.2844) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.15% (4.3953 => 10.9947, std.dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/methcall: 147.63% (5.3999 => 13.3718, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ft/ft: 25.49% (1.2838 => 1.6111, std.dev.: 0.0531) SingleSource/Benchmarks/CoyoteBench/fftbench: 24.49% (2.0360 => 2.5346, std.dev.: 0.0864) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.64% (1.5086 => 1.8501, std.dev.: 0.0674) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 17.82% (0.0864 => 0.1018, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 17.46% (6.6465 => 7.8070, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.97% (1.1145 => 1.3036, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.58% (8.6802 => 9.8589, std.dev.: 0.0956) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.15% (0.2944 => 0.3331, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.59% (2.8904 => 3.2255, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: 10.23% (1.1396 => 1.2562, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.30% (1.7254 => 1.8858, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/hash: 7.70% (4.9088 => 5.2868, std.dev.: 0.1004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.99% (4.2280 => 4.4812, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.92% (0.9540 => 1.0105, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 4.90% (26.0924 => 27.3715, std.dev.: 0.2579) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.6436 => 12.1030, std.dev.: 0.0171) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.44% (0.4162 => 0.4305, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 3.41% (0.6223 => 0.6435, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.25% (0.3540 => 0.3655, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.08% (2.1424 => 2.2084, std.dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: 2.93% (2.4116 => 2.4823, std.dev.: 0.0117) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 2.13% (85.0658 => 86.8768, std.dev.: 0.0837) MultiSource/Applications/aha/aha: 2.10% (3.1595 => 3.2258, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 1.59% (27.8444 => 28.2876, std.dev.: 0.0196) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.49% (2.3135 => 2.3480, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.43% (6.5088 => 6.6022, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.29% (1.0313 => 1.0446, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0500, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.16% (1.9577 => 1.9804, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout/sieve: 1.09% (5.2139 => 5.2707, std.dev.: 0.0099) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.32% (6.6874 => 0.1790, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -75.68% (0.8651 => 0.2104, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.12% (5.2763 => 1.3125, std.dev.: 0.0207) SingleSource/Benchmarks/Misc/richards_benchmark: -44.94% (0.1622 => 0.0893, std.dev.: 0.0061) MultiSource/Applications/JM/ldecod/ldecod: -11.47% (10.4361 => 9.2389, std.dev.: 0.4264) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.25% (5.3526 => 4.7502, std.dev.: 0.1385) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -9.87% (1.7609 => 1.5871, std.dev.: 0.0671) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.94% (5.3855 => 4.9578, std.dev.: 0.0479) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.20% (0.0628 => 0.0363) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.36% (0.3987 => 0.2378, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.27% (4.5009 => 2.7782, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.13% (2.6546 => 2.0141, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -19.16% (0.2161 => 0.1747, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.59% (1.6925 => 1.4287, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2838, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.81% (32.5116 => 28.9971, std.dev.: 0.0226) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -10.04% (9.5636 => 8.6032, std.dev.: 0.0660) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.42% (1.5660 => 1.4342, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.99% (1.6805 => 1.5630, std.dev.: 0.0319) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.2416 => 3.0212, std.dev.: 0.0250) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5760, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7497) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.09% (0.2497 => 0.2370, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5085, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: -4.28% (6.2999 => 6.0300, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.34% (0.9957 => 0.9624, std.dev.: 0.0116) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8919, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.56% (0.4808 => 0.4685, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.99% (19.9488 => 19.5514, std.dev.: 0.0689) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.87% (8.1563 => 8.0034, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/salsa20: -1.46% (10.2830 => 10.1331, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.82% (0.1485 => 0.1354, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0014) Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 21 23:07:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 22 Nov 2012 01:07:31 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121122070731.8CD1F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6137?compare_to=6133&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6137, Order: 168485, Start Time: 2012-11-22 05:37:56, End Time: 2012-11-22 07:07:59 To: 6133, Order: 168484, Start Time: 2012-11-22 03:50:05, End Time: 2012-11-22 05:21:13 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 4 (108 on baseline) Performance Improvements: 13 (24 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1037 (842 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.57% (2.2023 => 2.2369, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 30.16% (1.9029 => 2.4768, std.dev.: 0.0173) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.67% (1.4907 => 1.6199, std.dev.: 0.0247) MultiSource/Benchmarks/nbench/nbench: 7.59% (20.4488 => 22.0001, std.dev.: 0.4477) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/office/office: -6.19% (0.2196 => 0.2060, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -5.33% (0.5220 => 0.4942, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.70% (0.3185 => 0.3067, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.16% (0.6284 => 0.6148, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.83% (0.8931 => 0.8768, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.75% (0.9093 => 0.8934, std.dev.: 0.0059) MultiSource/Applications/hbd/hbd: -1.34% (1.4790 => 1.4592, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.29% (0.8291 => 0.8184, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.26% (0.9070 => 0.8956, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.24% (0.8898 => 0.8788, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -1.23% (0.8532 => 0.8427, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.07% (0.9921 => 0.9815, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.54% (39.6979 => 39.0848, std.dev.: 0.1366) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.22% (1.0660 => 1.0530, std.dev.: 0.0073) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0217 => 0.0217, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.47% (0.0426 => 0.0424, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -17.21% (0.0308 => 0.0255, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.64% (0.0313 => 0.0311, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -14.15% (0.0424 => 0.0364, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/casts: -16.26% (0.0203 => 0.0170, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: -26.48% (0.0219 => 0.0161, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -30.00% (0.0010 => 0.0007, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.61% (0.1483 => 0.1474, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -0.76% (1.1448 => 1.1361, std.dev.: 0.0262) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.79% (0.4177 => 0.4419, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.29% (0.1363 => 0.1367, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.17% (0.0590 => 0.0589, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.89% (0.0180 => 0.0196, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.79% (0.0560 => 0.0550, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.61% (1.1872 => 1.1945, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 22.73% (0.0022 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.12% (0.0558 => 0.0581, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.20% (0.0266 => 0.0183, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.09% (0.7861 => 0.7775, std.dev.: 0.0036) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -24.32% (0.0074 => 0.0056, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 6.96% (16.4461 => 17.5910, std.dev.: 0.1051) MultiSource/Applications/sqlite3/sqlite3: 2323.83% (0.6332 => 15.3477, std.dev.: 0.0231) MultiSource/Benchmarks/McCat/08-main/main: 47.41% (0.1831 => 0.2699, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -11.10% (0.1559 => 0.1386, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7094.17% (0.3123 => 22.4674, std.dev.: 0.2488) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.26% (0.2463 => 0.3701, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1532.21% (0.3344 => 5.4581, std.dev.: 0.0799) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.72% (0.2364 => 0.3232, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 4.34% (0.6010 => 0.6271, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel: 1.86% (0.0429 => 0.0437, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.37% (0.3266 => 0.3376, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 2.79% (0.1969 => 0.2024, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.25% (0.0224 => 0.0238, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -28.26% (0.0230 => 0.0165, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0440, std.dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: 8.28% (0.1462 => 0.1583, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4627, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0679, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4947, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5112, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.6199, std.dev.: 0.0247) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3178, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1372, std.dev.: 0.0597) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3628, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4013, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0867, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: -24.20% (2.1832 => 1.6549, std.dev.: 0.0061) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.74% (0.0848 => 0.0956, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.65% (0.0830 => 0.0935, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.77% (0.2279 => 0.2456, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.44% (0.1425 => 0.1531, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.37% (0.8321 => 0.8934, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.89% (0.7473 => 0.7988, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.51% (0.1905 => 0.2029, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.10% (0.2180 => 0.2313, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.94% (0.6010 => 0.6367, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.68% (0.1885 => 0.1992, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.40% (0.1983 => 0.2090, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.01% (0.3295 => 0.3460, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: 4.97% (1.2222 => 1.2829, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.83% (0.2133 => 0.2236, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.52% (2.1401 => 2.2369, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.29% (1.1606 => 1.2104, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.19% (1.1685 => 1.2175, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.03% (0.9435 => 0.9815, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.93% (0.4127 => 0.4289, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 3.58% (14.2605 => 14.7716, std.dev.: 0.0507) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.43% (0.3003 => 0.3106, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.41% (1.2526 => 1.2953, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.24% (1.5315 => 1.5811, std.dev.: 0.0109) MultiSource/Applications/minisat/minisat: 3.23% (0.6834 => 0.7055, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.20% (0.4559 => 0.4705, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.14% (0.5961 => 0.6148, std.dev.: 0.0043) MultiSource/Applications/lua/lua: 3.06% (3.8189 => 3.9357, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.99% (4.1763 => 4.3013, std.dev.: 0.0101) MultiSource/Applications/d/make_dparser: 2.97% (3.2366 => 3.3328, std.dev.: 0.0156) MultiSource/Benchmarks/nbench/nbench: 2.95% (1.1271 => 1.1603, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.90% (3.1832 => 3.2754, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.87% (0.8331 => 0.8570, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 2.82% (1.2568 => 1.2923, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 2.81% (14.7684 => 15.1833, std.dev.: 0.0406) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.71% (0.8340 => 0.8566, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.66% (0.6586 => 0.6761, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.62% (0.6227 => 0.6390, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.58% (6.6074 => 6.7777, std.dev.: 0.0322) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.54% (0.5191 => 0.5323, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.51% (1.6386 => 1.6798, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.51% (4.4873 => 4.6001, std.dev.: 0.0173) MultiSource/Benchmarks/Bullet/bullet: 2.42% (31.8598 => 32.6300, std.dev.: 0.0592) MultiSource/Benchmarks/PAQ8p/paq8p: 2.38% (2.3764 => 2.4330, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 2.33% (15.3280 => 15.6858, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.32% (0.8697 => 0.8899, std.dev.: 0.0030) MultiSource/Applications/hbd/hbd: 2.26% (1.4269 => 1.4592, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.22% (0.8597 => 0.8788, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.20% (13.1811 => 13.4707, std.dev.: 0.0272) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.10% (4.5702 => 4.6662, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.07% (0.9074 => 0.9262, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 2.07% (6.7320 => 6.8711, std.dev.: 0.0375) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.05% (0.8204 => 0.8372, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.04% (0.8317 => 0.8487, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.00% (0.9056 => 0.9237, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.96% (0.9069 => 0.9247, std.dev.: 0.0044) MultiSource/Applications/oggenc/oggenc: 1.89% (4.9628 => 5.0568, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.88% (0.8927 => 0.9095, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 1.88% (0.8768 => 0.8933, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.87% (0.8086 => 0.8237, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.85% (0.8716 => 0.8877, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.75% (0.8855 => 0.9010, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.74% (0.8712 => 0.8864, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.74% (0.8261 => 0.8405, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 1.73% (0.9810 => 0.9980, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.72% (0.8420 => 0.8565, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.71% (0.8805 => 0.8956, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.70% (0.8048 => 0.8185, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.69% (0.8995 => 0.9147, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.66% (0.8050 => 0.8184, std.dev.: 0.0036) MultiSource/Applications/lemon/lemon: 1.61% (1.0945 => 1.1121, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.50% (0.8316 => 0.8441, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.46% (1.2602 => 1.2786, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.43% (0.8518 => 0.8640, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.37% (0.8885 => 0.9007, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.29% (0.8656 => 0.8768, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 116.08% (0.0199 => 0.0430, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/pi: 56.81% (1.5795 => 2.4768, std.dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.64% (0.7597 => 0.8861, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.35% (2.9753 => 3.4618, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.70% (2.7995 => 3.2109, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.48% (5.0261 => 5.6031, std.dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.74% (1.1857 => 1.2775, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/queens: 7.28% (1.7056 => 1.8297, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.71% (4.7794 => 5.1000, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/richards_benchmark: 6.37% (1.3037 => 1.3867, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.31% (0.3186 => 0.3387, std.dev.: 0.0059) MultiSource/Applications/SIBsim4/SIBsim4: 6.27% (3.1873 => 3.3872, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.87% (4.9686 => 5.2602, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.87% (4.5327 => 4.7986, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.78% (6.2275 => 6.5252, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.67% (3.3761 => 3.5338, std.dev.: 0.0093) MultiSource/Applications/lambda-0_1_3/lambda: 4.41% (7.4933 => 7.8234, std.dev.: 0.0658) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.20% (4.9453 => 5.1530, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.97% (4.9469 => 5.1435, std.dev.: 0.0075) MultiSource/Applications/hexxagon/hexxagon: 3.87% (14.0064 => 14.5479, std.dev.: 0.0152) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.21% (0.3587 => 0.3702, std.dev.: 0.0037) MultiSource/Applications/siod/siod: 3.10% (3.6643 => 3.7779, std.dev.: 0.0229) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.85% (1.2337 => 1.2688, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.70% (11.5690 => 11.8813, std.dev.: 0.0223) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.51% (8.2783 => 8.4864, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout/lists: 2.42% (7.3375 => 7.5153, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.33% (4.8362 => 4.9487, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.31% (4.8660 => 4.9786, std.dev.: 0.0257) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.59% (1.1365 => 1.1546, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: 1.31% (1.0841 => 1.0983, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.28% (3.5679 => 3.6134, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: 1.15% (8.5322 => 8.6305, std.dev.: 0.0078) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.04% (2.5763 => 2.6030, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.96% (5.4641 => 4.3186, std.dev.: 0.0235) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.03% (7.2130 => 6.2729, std.dev.: 0.1539) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.87% (1.0512 => 0.9369, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -10.25% (1.1216 => 1.0066, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -10.12% (14.6451 => 13.1634, std.dev.: 0.2916) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.84% (0.3269 => 0.2980, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: -8.52% (63.1822 => 57.8012, std.dev.: 0.0919) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.89% (4.7482 => 4.4209, std.dev.: 0.0293) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.95% (3.7148 => 3.4937, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.88% (5.4972 => 5.1739, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.10% (5.1557 => 4.8926, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.39% (4.7449 => 4.5366, std.dev.: 0.0448) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.78% (6.0224 => 5.7949, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.38% (0.5807 => 0.5611, std.dev.: 0.0013) MultiSource/Applications/lua/lua: -3.31% (29.8330 => 28.8466, std.dev.: 0.0562) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (28.5821 => 27.6959, std.dev.: 0.0234) MultiSource/Applications/aha/aha: -2.48% (3.3398 => 3.2570, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.32% (9.9065 => 9.6763, std.dev.: 0.0701) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.32% (2.6356 => 2.5744, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/hash2: -2.29% (3.4237 => 3.3454, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.24% (3.2169 => 3.1448, std.dev.: 0.0223) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.06% (11.5316 => 11.2935, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.30% (2.3487 => 2.3182, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.29% (5.6343 => 5.5618, std.dev.: 0.0139) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.61% (1.0262 => 1.0530, std.dev.: 0.0073) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.39% (0.0254 => 0.0255, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.98% (0.0302 => 0.0311, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.21% (0.0384 => 0.0364, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/casts: -10.53% (0.0190 => 0.0170, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: -10.56% (0.0180 => 0.0161, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0007 => 0.0007, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.50% (0.1438 => 0.1474, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 0.28% (1.1329 => 1.1361, std.dev.: 0.0262) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.12% (0.4164 => 0.4419, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.15% (0.1369 => 0.1367, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.11% (0.0641 => 0.0589, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.51% (0.0195 => 0.0196, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.84% (0.0578 => 0.0550, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.44% (1.1437 => 1.1945, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.34% (0.0627 => 0.0581, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.67% (0.0180 => 0.0183, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.02% (0.8017 => 0.7775, std.dev.: 0.0036) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -9.68% (0.0062 => 0.0056, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 22 01:45:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 22 Nov 2012 03:45:41 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121122094541.113822A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6138?compare_to=6137&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6138, Order: 168490, Start Time: 2012-11-22 08:15:30, End Time: 2012-11-22 09:46:07 To: 6137, Order: 168485, Start Time: 2012-11-22 05:37:56, End Time: 2012-11-22 07:07:59 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 13 (102 on baseline) Performance Improvements: 2 (25 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1039 (847 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest: 15.35% (0.0782 => 0.0902, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.55% (0.2705 => 0.2828, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.87% (0.3228 => 0.3353, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.50% (0.8390 => 0.8600, std.dev.: 0.0038) MultiSource/Applications/hbd/hbd: 1.71% (1.4592 => 1.4841, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.48% (4.5415 => 4.6087, std.dev.: 0.0102) MultiSource/Applications/SIBsim4/SIBsim4: 1.23% (1.2923 => 1.3082, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.09% (6.5736 => 6.9082, std.dev.: 0.1003) MultiSource/Applications/SPASS/SPASS: 3.20% (8.4560 => 8.7268, std.dev.: 0.0660) SingleSource/Benchmarks/Misc/whetstone: 2.66% (2.0835 => 2.1389, std.dev.: 0.0109) SingleSource/Benchmarks/CoyoteBench/lpbench: 2.41% (3.8940 => 3.9880, std.dev.: 0.0283) SingleSource/Benchmarks/Misc/pi: 1.34% (2.4768 => 2.5099, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/hash: 1.03% (4.2887 => 4.3330, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: -1.89% (4.4219 => 4.3382, std.dev.: 0.0174) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.82% (2.8111 => 2.7598, std.dev.: 0.0190) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.09% (1.0530 => 1.0645, std.dev.: 0.0222) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.76% (0.0217 => 0.0211, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -18.40% (0.0424 => 0.0346, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 5.10% (0.0255 => 0.0268, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -9.97% (0.0311 => 0.0280, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.85% (0.0364 => 0.0350, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/casts: 18.82% (0.0170 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 23.60% (0.0161 => 0.0199, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.02% (0.1474 => 0.1489, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 2.83% (1.1361 => 1.1683, std.dev.: 0.0306) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.20% (0.4419 => 0.4366, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.61% (0.1367 => 0.1430, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.56% (0.0589 => 0.0663, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.33% (0.0196 => 0.0277, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.18% (0.0550 => 0.0549, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.32% (1.1945 => 1.1983, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -74.07% (0.0027 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.84% (0.0581 => 0.0644, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 43.17% (0.0183 => 0.0262, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.50% (0.7775 => 0.7814, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: -66.67% (0.0003 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -28.57% (0.0056 => 0.0040, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.62% (16.4461 => 17.7001, std.dev.: 0.0845) MultiSource/Applications/sqlite3/sqlite3: 2350.32% (0.6332 => 15.5154, std.dev.: 0.1162) MultiSource/Benchmarks/McCat/08-main/main: 48.99% (0.1831 => 0.2728, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.71% (0.1559 => 0.1470, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7096.99% (0.3123 => 22.4762, std.dev.: 0.1423) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.25% (0.2463 => 0.3676, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1536.42% (0.3344 => 5.4722, std.dev.: 0.1153) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.48% (0.2364 => 0.3250, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 4.04% (0.6010 => 0.6253, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel: 3.50% (0.0429 => 0.0444, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.99% (0.3266 => 0.3429, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.88% (0.1969 => 0.2065, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.34% (0.0224 => 0.0227, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -31.74% (0.0230 => 0.0157, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0451, std.dev.: 0.0035) MultiSource/Applications/oggenc/oggenc: 12.31% (0.1462 => 0.1642, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4848, std.dev.: 0.0136) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0699, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4899, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5113, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5351, std.dev.: 0.3559) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3077, std.dev.: 0.0286) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1321, std.dev.: 0.0243) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3630, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4019, std.dev.: 0.0314) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0829, std.dev.: 0.0026) SingleSource/Regression/C/uint64_to_float: -23.75% (2.1832 => 1.6646, std.dev.: 0.0017) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.05% (0.0810 => 0.0940, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/tsp/tsp: 12.41% (0.1112 => 0.1250, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.38% (0.0848 => 0.0953, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.08% (0.1905 => 0.2059, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.20% (0.2180 => 0.2337, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.89% (0.3137 => 0.3353, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.41% (0.2279 => 0.2425, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.7473 => 0.7930, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.96% (0.6010 => 0.6368, std.dev.: 0.0126) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.85% (0.8321 => 0.8808, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.76% (0.2519 => 0.2664, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.55% (0.8148 => 0.8600, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.67% (0.3295 => 0.3449, std.dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 4.35% (14.2605 => 14.8809, std.dev.: 0.1634) MultiSource/Applications/Burg/burg: 4.21% (1.2222 => 1.2737, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.10% (0.2998 => 0.3121, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 4.09% (1.2568 => 1.3082, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 4.01% (1.4269 => 1.4841, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.77% (1.3279 => 1.3780, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.72% (1.1685 => 1.2120, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.64% (2.1401 => 2.2180, std.dev.: 0.0189) MultiSource/Applications/treecc/treecc: 3.63% (1.9948 => 2.0673, std.dev.: 0.0159) MultiSource/Applications/lua/lua: 3.51% (3.8189 => 3.9530, std.dev.: 0.0353) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.39% (1.6386 => 1.6941, std.dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 3.37% (14.7684 => 15.2662, std.dev.: 0.0588) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.29% (4.1763 => 4.3136, std.dev.: 0.0452) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.12% (0.8340 => 0.8600, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.09% (0.4559 => 0.4700, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.04% (6.6074 => 6.8085, std.dev.: 0.0698) MultiSource/Applications/oggenc/oggenc: 2.93% (4.9628 => 5.1083, std.dev.: 0.0321) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.88% (0.3717 => 0.3824, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.78% (0.9908 => 1.0183, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.77% (1.5315 => 1.5739, std.dev.: 0.0103) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.69% (4.4880 => 4.6087, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.61% (0.8697 => 0.8924, std.dev.: 0.0054) MultiSource/Applications/JM/lencod/lencod: 2.58% (15.3280 => 15.7233, std.dev.: 0.0702) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.57% (0.4127 => 0.4233, std.dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: 2.54% (31.8598 => 32.6697, std.dev.: 0.1085) MultiSource/Benchmarks/Prolangs-C/football/football: 2.52% (0.8768 => 0.8989, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.47% (0.8597 => 0.8809, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: 2.47% (2.3764 => 2.4350, std.dev.: 0.0201) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.38% (13.1811 => 13.4954, std.dev.: 0.1086) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.36% (0.9074 => 0.9288, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.32% (0.8261 => 0.8453, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.26% (0.8611 => 0.8806, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.26% (0.6586 => 0.6735, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.25% (0.8007 => 0.8187, std.dev.: 0.0060) MultiSource/Applications/hexxagon/hexxagon: 2.14% (0.9810 => 1.0020, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.11% (0.9039 => 0.9230, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.05% (0.8712 => 0.8891, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.01% (0.8805 => 0.8982, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.98% (0.7966 => 0.8124, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.96% (0.8457 => 0.8623, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 1.88% (8.6247 => 8.7869, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.85% (0.8716 => 0.8877, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.84% (0.8204 => 0.8355, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.79% (0.8359 => 0.8509, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.76% (0.8885 => 0.9041, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.59% (0.9056 => 0.9200, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.58% (0.9688 => 0.9841, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.48% (0.8338 => 0.8461, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.41% (1.2423 => 1.2598, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 126.63% (0.0199 => 0.0451, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/pi: 58.90% (1.5795 => 2.5099, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 21.21% (0.0528 => 0.0640, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.35% (2.9753 => 3.4619, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.06% (0.7597 => 0.8817, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.70% (2.7995 => 3.2109, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.62% (5.0261 => 5.6101, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.67% (0.3186 => 0.3494, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.33% (6.3772 => 6.9082, std.dev.: 0.1003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.01% (1.1857 => 1.2807, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 7.59% (0.1370 => 0.1474, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 7.49% (1.7056 => 1.8333, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.70% (4.7794 => 5.0994, std.dev.: 0.0067) MultiSource/Applications/SIBsim4/SIBsim4: 6.38% (3.1873 => 3.3906, std.dev.: 0.0250) SingleSource/Benchmarks/Misc/richards_benchmark: 6.16% (1.3037 => 1.3840, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.89% (4.9686 => 5.2612, std.dev.: 0.1110) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.75% (4.5327 => 4.7932, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.53% (6.2275 => 6.5095, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.50% (3.3761 => 3.5280, std.dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: 4.38% (7.4933 => 7.8216, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.09% (4.9469 => 5.1491, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.03% (4.9453 => 5.1444, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/treeadd/treeadd: 4.01% (0.3587 => 0.3731, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 3.89% (14.0064 => 14.5517, std.dev.: 0.0183) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.53% (0.2887 => 0.2989, std.dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 3.49% (8.4326 => 8.7268, std.dev.: 0.0660) MultiSource/Applications/siod/siod: 3.35% (3.6643 => 3.7869, std.dev.: 0.0191) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.21% (1.2337 => 1.2733, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.82% (11.5690 => 11.8950, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.71% (8.2783 => 8.5028, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout/lists: 2.46% (7.3375 => 7.5177, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.32% (4.8660 => 4.9791, std.dev.: 0.0168) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.28% (4.8362 => 4.9467, std.dev.: 0.0268) SingleSource/Benchmarks/CoyoteBench/lpbench: 2.24% (3.9006 => 3.9880, std.dev.: 0.0283) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.82% (1.1365 => 1.1572, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash: 1.66% (0.6205 => 0.6308, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.37% (2.4647 => 2.4984, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/neural/neural: 1.33% (1.0841 => 1.0985, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.12% (4.0473 => 4.0928, std.dev.: 0.0146) MultiSource/Benchmarks/Olden/bh/bh: 1.07% (2.3560 => 2.3811, std.dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.65% (5.4641 => 4.3355, std.dev.: 0.0337) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.81% (7.2130 => 6.3609, std.dev.: 0.0579) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.92% (1.0512 => 0.9364, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: -10.36% (1.1216 => 1.0054, std.dev.: 0.0176) MultiSource/Benchmarks/mafft/pairlocalalign: -8.50% (63.1822 => 57.8138, std.dev.: 0.1062) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.75% (14.6451 => 13.5097, std.dev.: 0.1668) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.86% (4.7482 => 4.4223, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.18% (0.3269 => 0.3067, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.03% (3.7148 => 3.4909, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.88% (5.4972 => 5.1737, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.06% (5.1557 => 4.8946, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.38% (4.7449 => 4.5370, std.dev.: 0.0160) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.08% (2.8773 => 2.7598, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.76% (6.0224 => 5.7962, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.18% (2.4490 => 2.3711, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.17% (0.5807 => 0.5623, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: -3.15% (2.6356 => 2.5527, std.dev.: 0.0109) MultiSource/Applications/lua/lua: -3.05% (29.8330 => 28.9222, std.dev.: 0.1054) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.93% (28.5821 => 27.7437, std.dev.: 0.1061) SingleSource/Benchmarks/Shootout-C++/hash2: -2.24% (3.4237 => 3.3469, std.dev.: 0.0275) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.23% (9.9065 => 9.6855, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.05% (11.5316 => 11.2956, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.04% (3.2169 => 3.1514, std.dev.: 0.0090) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.57% (2.3487 => 2.3119, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.05% (5.6343 => 5.5750, std.dev.: 0.0117) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.73% (1.0262 => 1.0645, std.dev.: 0.0222) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 71.54% (0.0123 => 0.0211, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -15.20% (0.0408 => 0.0346, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 5.51% (0.0254 => 0.0268, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -7.28% (0.0302 => 0.0280, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -8.85% (0.0384 => 0.0350, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 10.56% (0.0180 => 0.0199, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 3.55% (0.1438 => 0.1489, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 3.12% (1.1329 => 1.1683, std.dev.: 0.0306) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.85% (0.4164 => 0.4366, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.46% (0.1369 => 0.1430, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.43% (0.0641 => 0.0663, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.02% (0.0578 => 0.0549, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.77% (1.1437 => 1.1983, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0014 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.71% (0.0627 => 0.0644, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 45.56% (0.0180 => 0.0262, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.53% (0.8017 => 0.7814, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -35.48% (0.0062 => 0.0040, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 22 01:56:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 22 Nov 2012 03:56:00 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121122095600.60F362A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6139?compare_to=6135&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6139, Order: 168490, Start Time: 2012-11-22 08:22:53, End Time: 2012-11-22 09:56:27 To: 6135, Order: 168485, Start Time: 2012-11-22 04:26:12, End Time: 2012-11-22 05:59:51 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (181 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (857 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1017, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.4937 => 7.6746, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/hash2: 2.21% (3.1932 => 3.2639, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.15% (0.1431 => 0.1300, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.35% (0.3821 => 0.3502, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: -7.01% (0.3880 => 0.3608, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -6.98% (0.3896 => 0.3624, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -6.96% (0.3848 => 0.3580, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -6.96% (2.4924 => 2.3189, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: -6.94% (0.3831 => 0.3565, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.94% (0.3142 => 0.2924, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.93% (0.3884 => 0.3615, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: -6.90% (0.3812 => 0.3549, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.87% (0.4033 => 0.3756, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -6.85% (0.3357 => 0.3127, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.84% (0.9542 => 0.8889, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions: -6.82% (0.4176 => 0.3891, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.81% (0.3891 => 0.3626, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -6.45% (0.4199 => 0.3928) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.44% (0.1584 => 0.1482, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -6.39% (9.2283 => 8.6382, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/oourafft: -6.34% (0.2160 => 0.2023, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.33% (0.2355 => 0.2206, std.dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: -6.28% (16.1920 => 15.1749, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.25% (0.6484 => 0.6079, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: -6.23% (7.0961 => 6.6541, std.dev.: 0.0145) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.22% (0.2428 => 0.2277, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -6.21% (0.4280 => 0.4014, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.15% (0.9852 => 0.9246, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.12% (0.1796 => 0.1686, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.10% (0.3658 => 0.3435, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.09% (1.0544 => 0.9902, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -6.08% (0.9179 => 0.8621, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.06% (1.3722 => 1.2890, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.95% (4.8161 => 4.5295, std.dev.: 0.0084) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.95% (6.7716 => 6.3688, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.92% (0.5863 => 0.5516, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -5.91% (0.1761 => 0.1657, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.90% (3.5339 => 3.3253, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.90% (0.5591 => 0.5261, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.88% (4.0323 => 3.7952, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.85% (1.2300 => 1.1581, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.84% (1.6364 => 1.5409, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.83% (0.6293 => 0.5926, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.83% (0.1716 => 0.1616, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.81% (0.5925 => 0.5581, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.81% (0.5805 => 0.5468, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.80% (0.5705 => 0.5374, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -5.79% (4.3330 => 4.0820, std.dev.: 0.0143) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.79% (4.8802 => 4.5978, std.dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: -5.77% (1.1530 => 1.0865, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.75% (1.4642 => 1.3800, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.73% (0.6052 => 0.5705, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.73% (0.5478 => 0.5164, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.71% (0.6667 => 0.6286, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.71% (0.6446 => 0.6078, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.70% (0.6297 => 0.5938, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.70% (0.6230 => 0.5875, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -5.69% (1.1450 => 1.0798, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.69% (0.5802 => 0.5472, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.68% (0.2695 => 0.2542, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.68% (0.5849 => 0.5517, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -5.66% (0.2985 => 0.2816, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.66% (0.6736 => 0.6355, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.63% (0.5857 => 0.5527, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.63% (1.2784 => 1.2064, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: -5.61% (0.3406 => 0.3215, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.61% (0.7919 => 0.7475, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.58% (0.6304 => 0.5952, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.58% (0.5570 => 0.5259, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.58% (0.5859 => 0.5532, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.58% (0.5575 => 0.5264, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.58% (0.6260 => 0.5911, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.57% (0.5581 => 0.5270, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.57% (0.5456 => 0.5152, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.57% (0.6660 => 0.6289) MultiSource/Applications/sqlite3/sqlite3: -5.55% (17.1032 => 16.1535, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/08-main/main: -5.53% (0.2659 => 0.2512, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.52% (0.6194 => 0.5852, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.52% (0.5999 => 0.5668, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/05-eks/eks: -5.51% (0.4515 => 0.4266, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: -5.50% (15.5079 => 14.6555, std.dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.48% (8.0126 => 7.5732, std.dev.: 0.0070) MultiSource/Applications/SIBsim4/SIBsim4: -5.48% (1.3864 => 1.3104, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: -5.48% (1.2515 => 1.1829, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.46% (0.6189 => 0.5851, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.45% (0.6676 => 0.6312, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.44% (4.5069 => 4.2615, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.44% (0.2278 => 0.2154, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.43% (0.6681 => 0.6318, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.40% (0.8521 => 0.8061, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.39% (0.6440 => 0.6093, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.37% (14.2083 => 13.4449, std.dev.: 0.0134) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.37% (0.4916 => 0.4652, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.37% (0.5941 => 0.5622, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.36% (0.5688 => 0.5383, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: -5.36% (0.3581 => 0.3389, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: -5.36% (0.3025 => 0.2863, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.34% (0.2548 => 0.2412, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.34% (0.6033 => 0.5711, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.33% (0.3057 => 0.2894, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.30% (0.2999 => 0.2840, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.30% (0.4151 => 0.3931, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.29% (0.2871 => 0.2719, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.29% (0.3931 => 0.3723, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -5.29% (0.3194 => 0.3025, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.29% (0.3837 => 0.3634, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -5.29% (1.3148 => 1.2453, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.28% (0.7198 => 0.6818, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.27% (0.3016 => 0.2857, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.26% (0.4813 => 0.4560, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.24% (1.2210 => 1.1570, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.23% (0.3483 => 0.3301, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.22% (0.3255 => 0.3085, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.21% (1.2221 => 1.1584, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/random: -5.17% (0.2939 => 0.2787, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.17% (0.2903 => 0.2753, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.17% (0.5168 => 0.4901, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.16% (2.1713 => 2.0593, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.15% (0.2933 => 0.2782, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.12% (0.3319 => 0.3149, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -5.12% (0.3205 => 0.3041, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.12% (0.2385 => 0.2263, std.dev.: 0.0009) MultiSource/Applications/lua/lua: -5.11% (4.0594 => 3.8518, std.dev.: 0.0139) MultiSource/Applications/minisat/minisat: -5.10% (0.7447 => 0.7067, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: -5.09% (0.3026 => 0.2872, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -5.08% (3.5154 => 3.3369, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.07% (1.6474 => 1.5639, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.07% (0.3849 => 0.3654, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -5.05% (0.2849 => 0.2705, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -5.02% (0.4861 => 0.4617, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -5.00% (15.2527 => 14.4897, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.00% (0.4321 => 0.4105, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary2: -4.97% (0.3481 => 0.3308, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.97% (0.3059 => 0.2907, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.95% (0.7339 => 0.6976, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.94% (0.3323 => 0.3159, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.92% (22.4056 => 21.3033, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/ary3: -4.90% (0.3446 => 0.3277, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -4.90% (2.4021 => 2.2845, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.89% (0.6395 => 0.6082, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.88% (0.2989 => 0.2843, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -4.88% (2.1401 => 2.0356, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.86% (0.7021 => 0.6680, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -4.83% (0.3394 => 0.3230, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.82% (0.7524 => 0.7161, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -4.81% (0.3621 => 0.3447, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.80% (0.5329 => 0.5073, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.80% (0.3252 => 0.3096, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -4.78% (0.3867 => 0.3682, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.76% (0.9557 => 0.9102, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -4.76% (0.4248 => 0.4046, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.74% (0.5567 => 0.5303, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.74% (0.6395 => 0.6092, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.70% (0.4083 => 0.3891, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.69% (0.5569 => 0.5308, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: -4.68% (0.3271 => 0.3118, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -4.63% (0.8418 => 0.8028, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: -4.61% (0.7982 => 0.7614, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.61% (0.9077 => 0.8659, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/hash: -4.55% (0.4524 => 0.4318, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.54% (0.4427 => 0.4226, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.53% (0.7779 => 0.7427, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sieve: -4.44% (0.3788 => 0.3620, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.41% (2.2587 => 2.1591, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: -4.39% (0.6750 => 0.6454, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -4.37% (34.0927 => 32.6012, std.dev.: 0.0328) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.35% (0.3491 => 0.3339, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -4.32% (18.2933 => 17.5027, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference-object: -4.10% (0.6441 => 0.6177, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: -4.10% (0.6347 => 0.6087, std.dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: -3.82% (5.0226 => 4.8309, std.dev.: 0.0024) MultiSource/Applications/hbd/hbd: -3.73% (1.5610 => 1.5027, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.59% (5.4682 => 5.2719, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -2.50% (20.7746 => 20.2555, std.dev.: 0.0119) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7558, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/richards_benchmark: -8.63% (1.2842 => 1.1734, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.67% (2.2633 => 2.1802, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4668, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 22 01:57:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 22 Nov 2012 03:57:55 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121122095755.883732A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6140?compare_to=6136&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6140, Order: 168485, Start Time: 2012-11-22 07:36:36, End Time: 2012-11-22 09:58:20 To: 6136, Order: 168484, Start Time: 2012-11-22 04:23:54, End Time: 2012-11-22 06:43:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 47 (171 on baseline) Performance Improvements: 2 (40 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1037 (674 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.50% (0.6585 => 0.7606, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 14.76% (0.5914 => 0.6787, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.10% (0.4547 => 0.5188, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 14.04% (0.6181 => 0.7049, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.82% (0.1045 => 0.1179, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 12.25% (0.4464 => 0.5011, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.84% (0.4171 => 0.4665, std.dev.: 0.0088) SingleSource/Benchmarks/LivermoreLoops/kernel22: 11.26% (0.1012 => 0.1126, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.14% (0.2998 => 0.3332, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.88% (4.3516 => 4.8251, std.dev.: 0.0564) MultiSource/Benchmarks/Olden/power/power: 10.66% (0.1454 => 0.1609, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.59% (0.3030 => 0.3351, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 10.34% (0.3327 => 0.3671, std.dev.: 0.0118) MultiSource/Benchmarks/Olden/mst/mst: 9.81% (0.1346 => 0.1478, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.52% (0.3573 => 0.3913, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/random: 9.48% (0.3039 => 0.3327, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.43% (0.2237 => 0.2448, std.dev.: 0.0030) SingleSource/Benchmarks/LivermoreLoops/kernel21: 9.21% (0.1107 => 0.1209, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.04% (0.6218 => 0.6780, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 8.85% (0.5910 => 0.6433, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.50% (1.1117 => 1.2062, std.dev.: 0.0094) MultiSource/Applications/lambda-0_1_3/lambda: 8.34% (0.8499 => 0.9208, std.dev.: 0.0259) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.32% (0.9083 => 0.9839, std.dev.: 0.0119) MultiSource/Applications/treecc/treecc: 7.69% (2.2810 => 2.4563, std.dev.: 0.0633) MultiSource/Applications/minisat/minisat: 7.40% (0.8140 => 0.8742, std.dev.: 0.0233) SingleSource/Benchmarks/Shootout-C++/ary3: 6.99% (0.3578 => 0.3828, std.dev.: 0.0095) MultiSource/Applications/Burg/burg: 6.85% (1.3320 => 1.4232, std.dev.: 0.0340) SingleSource/Benchmarks/Shootout-C++/ary2: 6.66% (0.3692 => 0.3938, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.11% (2.3262 => 2.4450, std.dev.: 0.0444) SingleSource/Benchmarks/Shootout-C++/hello: 4.63% (0.3155 => 0.3301, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 4.43% (0.7073 => 0.7386, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.52% (11.3220 => 11.7201, std.dev.: 0.0564) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.69% (0.7620 => 0.7825, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.79% (8.4818 => 8.6333, std.dev.: 0.0442) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.50% (0.6928 => 0.7032, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/flops: 28.58% (6.7488 => 8.6773, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 18.69% (13.2088 => 15.6774, std.dev.: 0.5342) MultiSource/Benchmarks/Olden/mst/mst: 12.63% (0.1314 => 0.1480, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/moments: 11.80% (0.1212 => 0.1355, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 11.13% (2.7613 => 3.0687, std.dev.: 0.0614) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 11.12% (0.4108 => 0.4565, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: 6.40% (4.1461 => 4.4113, std.dev.: 0.0966) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 4.98% (0.2291 => 0.2405, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.75% (1.6111 => 1.6877, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.99% (4.2626 => 4.3473, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.81% (3.0212 => 3.0758, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.21% (7.2805 => 7.3683, std.dev.: 0.0287) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -3.46% (0.7199 => 0.6950, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.35% (0.8382 => 0.8269, std.dev.: 0.0009) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.50% (69.7117 => 70.0602, std.dev.: 0.1222) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.07% (0.1354 => 0.1355, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.97% (0.0419 => 0.0444, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.53% (0.0652 => 0.0675, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -21.15% (493.9185 => 389.4492, std.dev.: 49.3006) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 10.78% (63.2438 => 70.0602, std.dev.: 0.1222) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.99% (4.3882 => 0.0444, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 34434.82% (1.1277 => 389.4492, std.dev.: 49.3006) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 193.33% (0.5229 => 1.5338, std.dev.: 0.0576) MultiSource/Applications/SPASS/SPASS: 21.19% (14.9895 => 18.1656, std.dev.: 0.1204) MultiSource/Applications/kimwitu++/kc: 49.50% (14.1553 => 21.1623, std.dev.: 0.2010) MultiSource/Benchmarks/MallocBench/gs/gs: 16.16% (4.1105 => 4.7748, std.dev.: 0.1214) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.59% (1.1048 => 1.5090, std.dev.: 0.0312) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 425.70% (7.1582 => 37.6307, std.dev.: 0.1006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 89.08% (3.4629 => 6.5476, std.dev.: 0.2100) SingleSource/Benchmarks/Misc-C++/stepanov_container: 64.82% (0.6222 => 1.0255, std.dev.: 0.0773) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10953.19% (0.0720 => 7.9583, std.dev.: 0.1875) MultiSource/Applications/SIBsim4/SIBsim4: 3859500.00% (0.0001 => 3.8596, std.dev.: 0.0120) MultiSource/Applications/SPASS/SPASS: 15677300.00% (0.0001 => 15.6774, std.dev.: 0.5342) MultiSource/Applications/kimwitu++/kc: 53200.00% (0.0001 => 0.0533, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576900.00% (0.0001 => 0.5770, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10088100.00% (0.0001 => 10.0882, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5694300.00% (0.0001 => 5.6944, std.dev.: 0.7079) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1848.18% (1.1194 => 21.8079, std.dev.: 0.1579) MultiSource/Applications/ClamAV/clamscan: 67.19% (22.1758 => 37.0757, std.dev.: 0.5305) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 66.15% (7.0540 => 11.7201, std.dev.: 0.0564) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.85% (2.9384 => 4.6089, std.dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 52.78% (8.1363 => 12.4310, std.dev.: 0.1074) SingleSource/Benchmarks/CoyoteBench/almabench: 49.32% (0.0730 => 0.1090, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 46.62% (21.9371 => 32.1648, std.dev.: 0.2966) MultiSource/Benchmarks/FreeBench/distray/distray: 44.89% (0.1056 => 0.1530, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 38.27% (0.1432 => 0.1980, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout/lists: 31.95% (0.0626 => 0.0826, std.dev.: 0.0031) MultiSource/Benchmarks/Fhourstones/fhourstones: 31.10% (0.1566 => 0.2053, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 30.41% (0.0730 => 0.0952, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 30.05% (0.1584 => 0.2060, std.dev.: 0.0023) SingleSource/UnitTests/vla: 29.58% (0.0355 => 0.0460, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/family/family: 29.22% (0.0397 => 0.0513, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 29.17% (0.0672 => 0.0868, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 29.02% (0.1044 => 0.1347, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 28.98% (0.0528 => 0.0681, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.47% (0.1125 => 0.1434, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 27.09% (0.1163 => 0.1478, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 26.77% (0.0467 => 0.0592, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 26.44% (0.4103 => 0.5188, std.dev.: 0.0027) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 26.40% (0.0447 => 0.0565, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/life/life: 26.37% (0.0933 => 0.1179, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 26.19% (0.1940 => 0.2448, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 26.13% (0.0953 => 0.1202, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.45% (0.8172 => 1.0252, std.dev.: 0.0137) MultiSource/Benchmarks/SciMark2-C/scimark2: 25.38% (0.3121 => 0.3913, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 25.17% (0.0437 => 0.0547, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 24.97% (0.1510 => 0.1887, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 24.73% (1.5415 => 1.9227, std.dev.: 0.0212) MultiSource/Benchmarks/MallocBench/espresso/espresso: 24.07% (4.2646 => 5.2913, std.dev.: 0.0502) SingleSource/Benchmarks/CoyoteBench/lpbench: 24.00% (0.0929 => 0.1152, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 23.97% (3.8922 => 4.8251, std.dev.: 0.0564) MultiSource/Applications/lambda-0_1_3/lambda: 23.88% (0.7433 => 0.9208, std.dev.: 0.0259) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.86% (0.0746 => 0.0924, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/moments: 23.79% (0.4048 => 0.5011, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 23.64% (0.4636 => 0.5732, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.56% (0.1337 => 0.1652, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 23.52% (0.9765 => 1.2062, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/lists: 23.50% (0.3422 => 0.4226, std.dev.: 0.0092) MultiSource/Applications/aha/aha: 23.46% (0.1151 => 0.1421, std.dev.: 0.0042) SingleSource/Benchmarks/Stanford/Oscar: 23.27% (0.0636 => 0.0784, std.dev.: 0.0029) MultiSource/Applications/minisat/minisat: 22.87% (0.7115 => 0.8742, std.dev.: 0.0233) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 22.53% (0.1114 => 0.1365, std.dev.: 0.0040) MultiSource/Applications/Burg/burg: 22.25% (1.1642 => 1.4232, std.dev.: 0.0340) MultiSource/Benchmarks/McCat/08-main/main: 22.00% (0.2554 => 0.3116, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/fbench: 21.79% (0.0592 => 0.0721, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 21.63% (0.2714 => 0.3301, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 21.45% (0.8101 => 0.9839, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout/matrix: 21.39% (0.0818 => 0.0993, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 21.32% (0.6450 => 0.7825, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 21.20% (0.3826 => 0.4637, std.dev.: 0.0040) MultiSource/Applications/treecc/treecc: 21.16% (2.0273 => 2.4563, std.dev.: 0.0633) MultiSource/Benchmarks/Olden/tsp/tsp: 21.02% (0.1175 => 0.1422, std.dev.: 0.0055) MultiSource/Applications/oggenc/oggenc: 20.90% (5.7591 => 6.9628, std.dev.: 0.1294) SingleSource/Benchmarks/Shootout-C++/ackermann: 20.90% (0.2756 => 0.3332, std.dev.: 0.0077) SingleSource/UnitTests/Vector/SSE/sse_isamax: 20.88% (0.0704 => 0.0851, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.70% (0.2700 => 0.3259, std.dev.: 0.0160) MultiSource/Benchmarks/VersaBench/bmm/bmm: 20.55% (0.0759 => 0.0915, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.41% (0.1029 => 0.1239, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 20.37% (1.0722 => 1.2906, std.dev.: 0.0467) MultiSource/Benchmarks/Prolangs-C++/office/office: 20.03% (0.3136 => 0.3764, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/nestedloop: 19.98% (0.2793 => 0.3351, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 19.92% (0.0798 => 0.0957, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.92% (0.0793 => 0.0951, std.dev.: 0.0025) MultiSource/Applications/lua/lua: 19.84% (3.8723 => 4.6404, std.dev.: 0.0554) MultiSource/Applications/viterbi/viterbi: 19.61% (0.1555 => 0.1860, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/bigfib: 18.85% (0.6456 => 0.7673, std.dev.: 0.0237) SingleSource/Benchmarks/Shootout-C++/random: 18.74% (0.2802 => 0.3327, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.62% (14.3668 => 17.0419, std.dev.: 0.0803) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 18.55% (0.3935 => 0.4665, std.dev.: 0.0088) SingleSource/UnitTests/2006-12-11-LoadConstants: 18.46% (0.1143 => 0.1354, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.42% (0.4615 => 0.5465, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 18.34% (0.1625 => 0.1923, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 18.28% (1.3050 => 1.5435, std.dev.: 0.0318) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.95% (0.0886 => 0.1045, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.79% (0.0770 => 0.0907, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.58% (0.0842 => 0.0990, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.54% (0.1032 => 0.1213, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.27% (0.0770 => 0.0903, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 17.25% (0.3131 => 0.3671, std.dev.: 0.0118) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.65% (0.0871 => 0.1016, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary3: 16.60% (0.3283 => 0.3828, std.dev.: 0.0095) MultiSource/Applications/hbd/hbd: 16.56% (1.5603 => 1.8187, std.dev.: 0.0305) SingleSource/Benchmarks/Shootout-C++/ary2: 16.54% (0.3379 => 0.3938, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ary: 16.49% (0.3232 => 0.3765, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.19% (0.0834 => 0.0969, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.15% (0.0675 => 0.0784, std.dev.: 0.0024) SingleSource/UnitTests/SignlessTypes/rem: 16.00% (0.1144 => 0.1327, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/messages-2: 15.86% (0.0662 => 0.0767, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.82% (0.1062 => 0.1230, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/em3d/em3d: 15.81% (0.1695 => 0.1963, std.dev.: 0.0098) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.74% (0.0648 => 0.0750, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 15.68% (0.2430 => 0.2811, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.59% (0.2065 => 0.2387, std.dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: 15.44% (1.2842 => 1.4825, std.dev.: 0.0242) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.31% (0.1117 => 0.1288, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/health/health: 15.30% (0.1268 => 0.1462, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 15.26% (0.5569 => 0.6419, std.dev.: 0.0216) MultiSource/Applications/sqlite3/sqlite3: 15.10% (17.1811 => 19.7754, std.dev.: 0.1748) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.62% (0.2107 => 0.2415, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.58% (0.2758 => 0.3160, std.dev.: 0.0145) MultiSource/Benchmarks/NPB-serial/is/is: 14.19% (0.0719 => 0.0821, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.74% (0.5981 => 0.6803, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.18% (0.5105 => 0.5778, std.dev.: 0.0217) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.16% (0.3441 => 0.3894, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/18-imp/imp: 13.15% (0.3423 => 0.3873, std.dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: 12.55% (9.4845 => 10.6749, std.dev.: 0.1459) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.44% (4.9449 => 5.5598, std.dev.: 0.1452) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.43% (5.0018 => 5.6235, std.dev.: 0.2049) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.25% (0.3543 => 0.3977, std.dev.: 0.0087) SingleSource/UnitTests/ObjC/exceptions-2: 12.24% (0.3497 => 0.3925, std.dev.: 0.0152) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.21% (0.1695 => 0.1902, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/exceptions-3: 12.20% (0.3516 => 0.3945, std.dev.: 0.0143) MultiSource/Benchmarks/McCat/09-vor/vor: 12.17% (0.3180 => 0.3567, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/exceptions-4: 12.16% (0.3543 => 0.3974, std.dev.: 0.0116) SingleSource/UnitTests/ObjC/exceptions: 12.02% (0.3828 => 0.4288, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 12.01% (1.4186 => 1.5890, std.dev.: 0.0387) MultiSource/Benchmarks/nbench/nbench: 11.94% (1.1840 => 1.3254, std.dev.: 0.0130) SingleSource/UnitTests/ObjC/for-in: 11.80% (0.3694 => 0.4130, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/power/power: 11.74% (0.1440 => 0.1609, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.39% (0.1906 => 0.2123, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/05-eks/eks: 11.19% (0.4299 => 0.4780, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.13% (0.4879 => 0.5422, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.05% (0.1892 => 0.2101, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.03% (2.2022 => 2.4450, std.dev.: 0.0444) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.39% (0.3177 => 0.3507, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.53% (0.1438 => 0.1575, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 8.72% (10.3673 => 11.2715, std.dev.: 0.2116) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.44% (7.9617 => 8.6333, std.dev.: 0.0442) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.19% (4.3953 => 10.9967, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/methcall: 147.51% (5.3999 => 13.3652, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/ft/ft: 31.46% (1.2838 => 1.6877, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.08% (1.5086 => 1.9171, std.dev.: 0.0271) SingleSource/Benchmarks/CoyoteBench/fftbench: 25.44% (2.0360 => 2.5539, std.dev.: 0.0708) MultiSource/Applications/minisat/minisat: 23.32% (9.1159 => 11.2418, std.dev.: 0.7744) SingleSource/Benchmarks/Misc/oourafft: 17.63% (6.6465 => 7.8182, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.91% (1.1145 => 1.3030, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/moments: 16.91% (0.1159 => 0.1355, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 15.22% (8.6802 => 10.0016, std.dev.: 0.0575) MultiSource/Benchmarks/Olden/mst/mst: 15.18% (0.1285 => 0.1480, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/heapsort: 14.50% (3.8526 => 4.4113, std.dev.: 0.0966) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.76% (0.2944 => 0.3349, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.62% (2.8904 => 3.2263, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.97% (13.4384 => 14.9132, std.dev.: 0.4026) SingleSource/Benchmarks/Misc/richards_benchmark: 10.25% (1.1396 => 1.2564, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.24% (1.7254 => 1.8849, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/ffbench: 8.03% (0.9505 => 1.0268, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout/strcat: 6.74% (0.1899 => 0.2027, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.88% (4.2280 => 4.4766, std.dev.: 0.0065) SingleSource/Regression/C/uint64_to_float: 5.10% (0.5413 => 0.5689, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 4.84% (26.0924 => 27.3559, std.dev.: 0.0572) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.76% (0.3463 => 0.3628, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.14% (11.6436 => 12.1253, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.47% (0.3540 => 0.3663, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.17% (2.1424 => 2.2103, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: 2.62% (2.4116 => 2.4749, std.dev.: 0.0046) MultiSource/Benchmarks/PAQ8p/paq8p: 2.20% (85.0658 => 86.9339, std.dev.: 0.0587) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.13% (1.3677 => 1.3968, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 2.08% (3.1595 => 3.2251, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 1.80% (27.8444 => 28.3457, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.56% (2.3135 => 2.3497, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout/sieve: 1.49% (5.2139 => 5.2918, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.43% (6.5088 => 6.6016, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/fbench: 1.35% (2.2771 => 2.3079, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.27% (1.0313 => 1.0444, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0506, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.35% (6.6874 => 0.1772, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -75.66% (0.8651 => 0.2106, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.03% (5.2763 => 1.3174, std.dev.: 0.0228) SingleSource/Benchmarks/Misc/richards_benchmark: -45.13% (0.1622 => 0.0890, std.dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: -11.54% (10.4361 => 9.2322, std.dev.: 0.2160) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.73% (5.3526 => 4.7783, std.dev.: 0.0930) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -9.86% (1.7609 => 1.5872, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.73% (5.3855 => 4.9156, std.dev.: 0.0773) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.20% (0.0628 => 0.0363, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.36% (0.3987 => 0.2378, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.27% (4.5009 => 2.7783, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7636, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.15% (2.6546 => 2.0135, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -19.30% (0.2161 => 0.1744, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4237, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2839, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.79% (32.5116 => 29.0039, std.dev.: 0.0491) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -10.51% (9.5636 => 8.5582, std.dev.: 0.0470) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.48% (1.5660 => 1.4332, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.21% (1.6805 => 1.5425, std.dev.: 0.0382) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5759, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.11% (3.2416 => 3.0758, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-5: -4.91% (1.5835 => 1.5057, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.89% (0.2497 => 0.2375, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -4.33% (6.2999 => 6.0270, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.30% (0.9957 => 0.9628, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8915, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.82% (19.9488 => 19.3854, std.dev.: 0.1705) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.37% (0.4808 => 0.4694, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.91% (8.1563 => 8.0002, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6773, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -1.53% (10.2830 => 10.1261, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.75% (0.1485 => 0.1355, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.10% (0.2116 => 0.0675, std.dev.: 0.0012) Report Time: 2.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 22 01:58:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 22 Nov 2012 03:58:02 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121122095802.D60DB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6141?compare_to=6134&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6141, Order: 168485, Start Time: 2012-11-22 06:35:40, End Time: 2012-11-22 09:58:28 To: 6134, Order: 168481, Start Time: 2012-11-22 02:26:57, End Time: 2012-11-22 05:47:46 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (166 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1089 (726 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.94% (1.9864 => 2.0249, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.29% (124.1260 => 128.2148, std.dev.: 1.0815) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.19% (0.3757 => 0.3877, std.dev.: 0.0029) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 46.56% (0.0625 => 0.0916, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.71% (0.1063 => 0.1432, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 27.10% (1.5932 => 2.0249, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.43% (0.4253 => 0.5377, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.90% (0.2969 => 0.3738, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.86% (0.1106 => 0.1392, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.21% (0.0714 => 0.0894, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.79% (0.4139 => 0.5165, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.29% (0.4994 => 0.6207, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.63% (0.0584 => 0.0722, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.60% (0.5000 => 0.6180, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.07% (0.5900 => 0.7261, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.13% (0.1107 => 0.1352, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.85% (0.1620 => 0.1974, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.85% (0.0897 => 0.1093, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.55% (0.1021 => 0.1241, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 21.54% (0.0599 => 0.0728, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.40% (0.0642 => 0.0773, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 20.25% (0.0948 => 0.1140, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.21% (0.0584 => 0.0702, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.20% (0.1604 => 0.1928, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.09% (0.3903 => 0.4687, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.04% (0.1103 => 0.1324, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.94% (0.1003 => 0.1203, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 19.73% (0.0821 => 0.0983, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.69% (0.1549 => 0.1854, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.59% (0.0822 => 0.0983, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 19.52% (0.1619 => 0.1935, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: 19.37% (0.0604 => 0.0721) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.81% (0.1462 => 0.1737, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.80% (0.0947 => 0.1125, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.33% (0.3890 => 0.4603, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.07% (0.2014 => 0.2378, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.98% (1.3152 => 1.5517, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 17.57% (0.4029 => 0.4737, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 17.57% (0.1218 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.47% (0.2736 => 0.3214, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.46% (0.1088 => 0.1278, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 17.39% (0.5826 => 0.6839, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 17.34% (0.1505 => 0.1766, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.31% (0.2866 => 0.3362, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 17.27% (0.5889 => 0.6906, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 17.24% (0.5546 => 0.6502, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 16.73% (1.8794 => 2.1938, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.60% (3.5627 => 4.1541, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.60% (0.4658 => 0.5431, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 16.58% (0.9697 => 1.1305, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.57% (0.1968 => 0.2294, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.45% (0.3271 => 0.3809, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.32% (1.6211 => 1.8856, std.dev.: 0.0035) MultiSource/Applications/d/make_dparser: 16.15% (1.0781 => 1.2522, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.12% (0.1160 => 0.1347, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.90% (0.2875 => 0.3332, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 15.83% (0.1421 => 0.1646, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.65% (0.3930 => 0.4545, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.60% (0.1090 => 0.1260, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.59% (0.4361 => 0.5041, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.47% (2.7292 => 3.1515, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.43% (0.2729 => 0.3150, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.42% (0.5026 => 0.5801, std.dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference: 15.37% (0.7171 => 0.8273, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: 15.34% (0.1284 => 0.1481, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 15.33% (0.2714 => 0.3130, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.32% (4.4195 => 5.0967, std.dev.: 0.0170) MultiSource/Applications/ClamAV/clamscan: 15.31% (4.2109 => 4.8557, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.27% (0.2738 => 0.3156, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 15.22% (0.9909 => 1.1417, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/matrix: 15.22% (0.2780 => 0.3203, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 15.20% (0.2750 => 0.3168, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 15.19% (0.2725 => 0.3139, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.08% (0.2792 => 0.3213, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 15.05% (0.2823 => 0.3248, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 15.01% (0.3004 => 0.3455, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.98% (0.2911 => 0.3347, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 14.98% (0.2811 => 0.3232, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 14.97% (0.2813 => 0.3234, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 14.89% (0.3096 => 0.3557, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 14.88% (0.2803 => 0.3220, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.87% (0.3195 => 0.3670, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.77% (2.0673 => 2.3726, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.66% (1.9694 => 2.2582, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/football/football: 14.60% (0.2075 => 0.2378, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.56% (1.9966 => 2.2874, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary3: 14.54% (0.3267 => 0.3742, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 14.49% (0.3258 => 0.3730, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 14.26% (0.3317 => 0.3790, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 14.26% (23.5202 => 26.8737, std.dev.: 0.0314) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.18% (0.3124 => 0.3567, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.02% (0.3060 => 0.3489, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 13.99% (0.2566 => 0.2925, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.86% (0.3362 => 0.3828, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 13.74% (1.4269 => 1.6230, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 13.73% (0.3678 => 0.4183, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 13.71% (0.3348 => 0.3807, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.65% (0.3282 => 0.3730, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 13.52% (0.3477 => 0.3947, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.49% (0.3625 => 0.4114, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 13.43% (0.3469 => 0.3935, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 13.42% (0.3726 => 0.4226, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.42% (0.3496 => 0.3965, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 13.41% (0.4146 => 0.4702, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-4: 13.39% (0.3465 => 0.3929, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 13.38% (0.3446 => 0.3907, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.36% (0.3488 => 0.3954, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 13.34% (0.3442 => 0.3901, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.29% (0.3460 => 0.3920, std.dev.: 0.0031) MultiSource/Applications/treecc/treecc: 13.27% (0.7875 => 0.8920, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 13.12% (0.2691 => 0.3044, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/property: 13.10% (0.3650 => 0.4128, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.06% (0.3845 => 0.4347, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.04% (0.3981 => 0.4500, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 13.03% (0.4251 => 0.4805, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 12.98% (2.1653 => 2.4463, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.95% (0.3690 => 0.4168, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 12.93% (0.3643 => 0.4114, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.84% (0.3724 => 0.4202, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 12.68% (4.6177 => 5.2032, std.dev.: 0.0198) MultiSource/Benchmarks/mafft/pairlocalalign: 12.39% (2.1013 => 2.3616, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.30% (0.2040 => 0.2291, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 12.25% (0.5012 => 0.5626, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 11.54% (5.5417 => 6.1813, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.52% (0.6435 => 0.7176, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.09% (0.1028 => 0.1142, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 11.06% (0.6634 => 0.7368, std.dev.: 0.0053) MultiSource/Applications/lambda-0_1_3/lambda: 10.86% (0.3498 => 0.3878, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.70% (0.1383 => 0.1531, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 10.46% (0.4847 => 0.5354, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.23% (0.2737 => 0.3017, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 9.62% (0.3336 => 0.3657, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 9.57% (2.0346 => 2.2293, std.dev.: 0.0055) MultiSource/Applications/lemon/lemon: 9.24% (0.2391 => 0.2612, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.66% (4.6926 => 5.0992, std.dev.: 0.1238) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.19% (11.6398 => 12.5927, std.dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.92% (0.5584 => 0.6026, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.85% (0.7426 => 0.8009, std.dev.: 0.0224) MultiSource/Applications/kimwitu++/kc: 6.87% (11.9555 => 12.7767, std.dev.: 0.0175) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.03% (0.3792 => 0.3945, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 65.45% (0.2162 => 0.3577, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 9.74% (0.2802 => 0.3075, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6093, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary: 5.37% (0.2122 => 0.2236, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6722, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.98% (0.3693 => 0.3877, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1706, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-2: 4.50% (1.8057 => 1.8870, std.dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/dry: 4.32% (14.0481 => 14.6556, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2061, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.56% (3.1722 => 3.2218, std.dev.: 0.0047) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3017, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2873, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5143, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5767, std.dev.: 0.0264) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.77% (2.4764 => 2.4079, std.dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5610, std.dev.: 0.0216) SingleSource/Benchmarks/Shootout-C++/ary2: -7.95% (0.2402 => 0.2211, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9776, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8014, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/tsp/tsp: -7.34% (2.1113 => 1.9563, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7986, std.dev.: 0.0133) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -2.46% (17.2379 => 16.8133, std.dev.: 0.0582) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8632, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5767, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4958, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0445, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 22 05:11:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 22 Nov 2012 07:11:48 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121122131148.95FFD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6142?compare_to=6140&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6142, Order: 168490, Start Time: 2012-11-22 10:52:11, End Time: 2012-11-22 13:12:13 To: 6140, Order: 168485, Start Time: 2012-11-22 07:36:36, End Time: 2012-11-22 09:58:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 48 (168 on baseline) Performance Improvements: 7 (38 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1031 (679 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 16.46% (0.1397 => 0.1627, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 16.32% (2.5804 => 3.0015, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 15.15% (2.4746 => 2.8496, std.dev.: 0.0230) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 14.27% (1.7807 => 2.0348, std.dev.: 0.0428) SingleSource/Benchmarks/Misc/richards_benchmark: 13.37% (0.0890 => 0.1009, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.96% (1.0255 => 1.1584, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 12.51% (0.6851 => 0.7708, std.dev.: 0.0066) MultiSource/Applications/SIBsim4/SIBsim4: 12.19% (1.5338 => 1.7208, std.dev.: 0.0286) MultiSource/Benchmarks/McCat/08-main/main: 11.71% (0.3116 => 0.3481, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 11.43% (0.0892 => 0.0994, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.39% (0.4302 => 0.4792, std.dev.: 0.0010) SingleSource/Benchmarks/LivermoreLoops/kernel01: 11.17% (0.1012 => 0.1125, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 10.66% (0.3977 => 0.4401, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/except: 8.99% (0.3125 => 0.3406, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.98% (0.6605 => 0.7198, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.98% (0.6863 => 0.7479, std.dev.: 0.0157) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.88% (0.2195 => 0.2390, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.84% (0.6189 => 0.6736, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/wc: 7.36% (0.3302 => 0.3545, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.12% (0.3148 => 0.3372, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.10% (0.1902 => 0.2037, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.99% (0.6497 => 0.6951, std.dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: 6.74% (10.6749 => 11.3940, std.dev.: 0.1469) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.41% (0.8690 => 0.9247, std.dev.: 0.0170) SingleSource/Benchmarks/Misc-C++/bigfib: 5.07% (0.7673 => 0.8062, std.dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.87% (0.5465 => 0.5731, std.dev.: 0.0035) MultiSource/Benchmarks/PAQ8p/paq8p: 4.65% (11.2715 => 11.7956, std.dev.: 0.0527) SingleSource/Benchmarks/Shootout-C++/ary: 4.62% (0.3765 => 0.3939, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.15% (0.6433 => 0.6700, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 4.01% (1.4825 => 1.5420, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.72% (0.6780 => 0.7032, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: 3.66% (0.3828 => 0.3968, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.83% (0.3475 => 0.4442, std.dev.: 0.0148) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.46% (5.6944 => 7.0875, std.dev.: 0.2828) SingleSource/Benchmarks/Shootout-C++/ary3: 23.54% (3.8038 => 4.6991, std.dev.: 0.1161) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 13.90% (6.3294 => 7.2093, std.dev.: 0.1414) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 11.85% (9.2942 => 10.3954, std.dev.: 0.0168) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.02% (11.2266 => 12.3520, std.dev.: 0.2684) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.84% (6.1100 => 6.4057, std.dev.: 0.0570) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.58% (9.5642 => 10.0021, std.dev.: 0.0487) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.09% (1.5425 => 1.6056, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/ffbench: 3.99% (1.0268 => 1.0678, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.60% (59.1898 => 61.3198, std.dev.: 0.1621) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.36% (6.3338 => 6.5464, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.96% (3.7123 => 3.8221, std.dev.: 0.0240) MultiSource/Applications/siod/siod: 2.20% (3.2750 => 3.3472, std.dev.: 0.0231) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.37% (10.0016 => 10.1387, std.dev.: 0.0301) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.6460 => 12.7823, std.dev.: 0.0411) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/employ/employ: -12.49% (0.5188 => 0.4540, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: -9.75% (0.1887 => 0.1703, std.dev.: 0.0063) SingleSource/Benchmarks/LivermoreLoops/kernel21: -8.44% (0.1209 => 0.1107, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -8.44% (0.1624 => 0.1487, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/SPASS/SPASS: -11.64% (15.6774 => 13.8526, std.dev.: 0.3636) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -2.61% (1.5995 => 1.5578, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.06% (3.5143 => 3.4769, std.dev.: 0.0086) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.71% (70.0602 => 69.5645, std.dev.: 0.0438) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.66% (0.1355 => 0.1364, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.18% (0.0444 => 0.0421, std.dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.52% (0.0675 => 0.0658, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 26.86% (389.4492 => 494.0533, std.dev.: 0.2340) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.99% (63.2438 => 69.5645, std.dev.: 0.0438) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0421, std.dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43710.70% (1.1277 => 494.0533, std.dev.: 0.2340) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 229.09% (0.5229 => 1.7208, std.dev.: 0.0286) MultiSource/Applications/SPASS/SPASS: 21.86% (14.9895 => 18.2666, std.dev.: 0.1784) MultiSource/Applications/kimwitu++/kc: 48.56% (14.1553 => 21.0289, std.dev.: 0.3435) MultiSource/Benchmarks/MallocBench/gs/gs: 14.61% (4.1105 => 4.7112, std.dev.: 0.2678) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.52% (1.1048 => 1.5083, std.dev.: 0.0600) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 430.79% (7.1582 => 37.9948, std.dev.: 0.1828) SingleSource/Benchmarks/Misc-C++-EH/spirit: 74.36% (3.4629 => 6.0380, std.dev.: 0.3590) SingleSource/Benchmarks/Misc-C++/stepanov_container: 86.18% (0.6222 => 1.1584, std.dev.: 0.0216) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10427.78% (0.0720 => 7.5800, std.dev.: 0.3554) MultiSource/Applications/SIBsim4/SIBsim4: 3866900.00% (0.0001 => 3.8670, std.dev.: 0.0354) MultiSource/Applications/SPASS/SPASS: 13852500.00% (0.0001 => 13.8526, std.dev.: 0.3636) MultiSource/Applications/kimwitu++/kc: 52100.00% (0.0001 => 0.0522, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576500.00% (0.0001 => 0.5766, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10095900.00% (0.0001 => 10.0960, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7087400.00% (0.0001 => 7.0875, std.dev.: 0.2828) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1858.97% (1.1194 => 21.9287, std.dev.: 0.1065) MultiSource/Applications/ClamAV/clamscan: 68.88% (22.1758 => 37.4494, std.dev.: 0.1980) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 63.56% (7.0540 => 11.5372, std.dev.: 0.1093) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.40% (2.9384 => 4.6250, std.dev.: 0.1434) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.59% (8.1363 => 12.1711, std.dev.: 0.2636) MultiSource/Applications/JM/lencod/lencod: 46.97% (21.9371 => 32.2409, std.dev.: 0.1555) MultiSource/Benchmarks/FreeBench/distray/distray: 45.36% (0.1056 => 0.1535, std.dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/almabench: 38.49% (0.0730 => 0.1011, std.dev.: 0.0038) SingleSource/UnitTests/vla: 38.31% (0.0355 => 0.0491, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 38.13% (0.1432 => 0.1978, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: 36.30% (0.2554 => 0.3481, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 32.21% (0.0326 => 0.0431, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 31.63% (0.1236 => 0.1627, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 30.68% (2.2969 => 3.0015, std.dev.: 0.0172) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 30.43% (0.0437 => 0.0570, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 29.73% (0.0730 => 0.0947, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 29.50% (0.1044 => 0.1352, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 29.39% (2.2024 => 2.8496, std.dev.: 0.0230) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 29.00% (0.0793 => 0.1023, std.dev.: 0.0032) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 28.64% (0.0447 => 0.0575, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.31% (1.5859 => 2.0348, std.dev.: 0.0428) SingleSource/Benchmarks/Shootout/matrix: 25.79% (0.0818 => 0.1029, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.76% (0.8172 => 1.0277, std.dev.: 0.0036) MultiSource/Benchmarks/BitBench/drop3/drop3: 25.73% (0.0482 => 0.0606, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 25.65% (1.5415 => 1.9369, std.dev.: 0.0067) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 25.05% (0.0467 => 0.0584, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/04-bisect/bisect: 24.95% (0.1062 => 0.1327, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 24.88% (0.6456 => 0.8062, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 24.66% (0.0442 => 0.0551, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.47% (0.0842 => 0.1048, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 24.18% (0.4615 => 0.5731, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: 23.98% (0.3865 => 0.4792, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Oscar: 23.90% (0.0636 => 0.0788, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.86% (0.0746 => 0.0924, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.56% (0.1337 => 0.1652, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 23.19% (0.0457 => 0.0563, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 23.16% (0.1114 => 0.1372, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 22.35% (0.3826 => 0.4681, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary2: 22.31% (0.3379 => 0.4133, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/sieve: 22.15% (0.3603 => 0.4401, std.dev.: 0.0035) MultiSource/Applications/lemon/lemon: 22.09% (1.0722 => 1.3090, std.dev.: 0.0418) SingleSource/Benchmarks/Shootout-C++/ackermann: 21.99% (0.2756 => 0.3362, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ary: 21.87% (0.3232 => 0.3939, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 21.58% (4.2646 => 5.1849, std.dev.: 0.1050) SingleSource/Benchmarks/Misc/perlin: 21.46% (0.0536 => 0.0651, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 21.28% (0.0719 => 0.0872, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/random: 21.16% (0.2802 => 0.3395, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.09% (0.1029 => 0.1246, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary3: 20.87% (0.3283 => 0.3968, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.78% (0.0770 => 0.0930, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 20.73% (5.7591 => 6.9532, std.dev.: 0.1539) SingleSource/Benchmarks/Misc/fbench: 20.44% (0.0592 => 0.0713, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: 20.42% (0.0759 => 0.0914, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.39% (0.1584 => 0.1907, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/tsp/tsp: 20.34% (0.1175 => 0.1414, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/nestedloop: 20.34% (0.2793 => 0.3361, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 20.18% (0.1695 => 0.2037, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.15% (0.0675 => 0.0811, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 20.13% (9.4845 => 11.3940, std.dev.: 0.1469) MultiSource/Applications/hexxagon/hexxagon: 20.07% (1.2842 => 1.5420, std.dev.: 0.0176) SingleSource/UnitTests/2006-12-11-LoadConstants: 20.03% (0.1143 => 0.1372, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 19.87% (0.3136 => 0.3759, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 19.62% (1.3050 => 1.5610, std.dev.: 0.0410) MultiSource/Benchmarks/McCat/09-vor/vor: 19.59% (0.3180 => 0.3803, std.dev.: 0.0135) MultiSource/Applications/lua/lua: 19.51% (3.8723 => 4.6277, std.dev.: 0.1153) SingleSource/Benchmarks/Shootout-C++/wordfreq: 19.38% (0.3307 => 0.3948, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/objinst: 18.75% (0.3131 => 0.3718, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.74% (14.3668 => 17.0598, std.dev.: 0.0512) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.73% (1.1861 => 1.4082, std.dev.: 0.0305) SingleSource/Benchmarks/Shootout-C++/except: 18.63% (0.2871 => 0.3406, std.dev.: 0.0050) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.31% (0.1125 => 0.1331, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 18.17% (0.0798 => 0.0943, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 17.99% (3.3354 => 3.9356, std.dev.: 0.1687) SingleSource/Benchmarks/Shootout-C++/spellcheck: 17.27% (0.4203 => 0.4929, std.dev.: 0.0189) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.26% (5.0018 => 5.8652, std.dev.: 0.1455) SingleSource/Benchmarks/Shootout-C++/strcat: 16.99% (0.2831 => 0.3312, std.dev.: 0.0145) MultiSource/Benchmarks/McCat/05-eks/eks: 16.98% (0.4299 => 0.5029, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 16.97% (3.8922 => 4.5528, std.dev.: 0.1636) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.76% (0.0871 => 0.1017, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.64% (0.2891 => 0.3372, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/matrix: 16.56% (0.3098 => 0.3611, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 16.49% (0.1625 => 0.1893, std.dev.: 0.0063) MultiSource/Applications/sqlite3/sqlite3: 16.46% (17.1811 => 20.0093, std.dev.: 0.2486) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.37% (0.0886 => 0.1031, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.31% (0.0834 => 0.0970, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wc: 16.15% (0.3052 => 0.3545, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/mst/mst: 15.82% (0.1163 => 0.1347, std.dev.: 0.0061) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.63% (0.0953 => 0.1102, std.dev.: 0.0048) MultiSource/Applications/sgefa/sgefa: 15.63% (0.3109 => 0.3595, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/lists1: 15.50% (0.3684 => 0.4255, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.45% (0.2065 => 0.2384, std.dev.: 0.0092) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.43% (0.0648 => 0.0748, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 14.92% (2.0273 => 2.3298, std.dev.: 0.0508) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.86% (0.1117 => 0.1283, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.81% (0.0770 => 0.0884, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference-object: 14.76% (0.6030 => 0.6920, std.dev.: 0.0151) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 14.48% (0.3177 => 0.3637, std.dev.: 0.0093) SingleSource/UnitTests/ObjC++/property-reference: 14.46% (0.7326 => 0.8385, std.dev.: 0.0181) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.33% (0.2107 => 0.2409, std.dev.: 0.0104) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.26% (0.3121 => 0.3566, std.dev.: 0.0170) SingleSource/UnitTests/ObjC++/Hello: 14.01% (0.5925 => 0.6755, std.dev.: 0.0154) MultiSource/Benchmarks/PAQ8p/paq8p: 13.78% (10.3673 => 11.7956, std.dev.: 0.0527) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.56% (0.2271 => 0.2579, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.51% (0.5981 => 0.6789, std.dev.: 0.0104) SingleSource/Benchmarks/McGill/exptree: 12.90% (0.0814 => 0.0919, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.78% (0.1510 => 0.1703, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.69% (0.6675 => 0.7522, std.dev.: 0.0285) SingleSource/UnitTests/ObjC/trivial-interface: 12.27% (0.3473 => 0.3899, std.dev.: 0.0139) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.14% (0.3543 => 0.3973, std.dev.: 0.0163) MultiSource/Benchmarks/nbench/nbench: 11.92% (1.1840 => 1.3251, std.dev.: 0.0534) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.87% (4.9449 => 5.5318, std.dev.: 0.1115) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.19% (0.4879 => 0.5425, std.dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.12% (0.1906 => 0.2118, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.94% (0.1892 => 0.2099, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.65% (0.4103 => 0.4540, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 9.41% (0.3282 => 0.3591, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.23% (0.3650 => 0.3987, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.11% (0.1438 => 0.1569, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.98% (0.3162 => 0.3446, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.88% (0.4064 => 0.4425, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.60% (2.0665 => 2.2442, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.14% (7.9617 => 8.6099, std.dev.: 0.0844) SingleSource/Benchmarks/Misc/ReedSolomon: 7.03% (0.2049 => 0.2193, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.47% (0.2266 => 0.2390, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.17% (4.3953 => 10.9959, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/methcall: 147.43% (5.3999 => 13.3612, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 36.43% (0.3256 => 0.4442, std.dev.: 0.0148) MultiSource/Benchmarks/VersaBench/dbms/dbms: 30.88% (1.5086 => 1.9745, std.dev.: 0.0504) SingleSource/Benchmarks/Shootout-C++/ary3: 26.25% (3.7221 => 4.6991, std.dev.: 0.1161) MultiSource/Benchmarks/McCat/09-vor/vor: 25.56% (0.1154 => 0.1449, std.dev.: 0.0107) SingleSource/Benchmarks/CoyoteBench/lpbench: 19.39% (10.3460 => 12.3520, std.dev.: 0.2684) SingleSource/Benchmarks/Misc/oourafft: 17.45% (6.6465 => 7.8060, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.86% (1.1145 => 1.3024, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 16.80% (8.6802 => 10.1387, std.dev.: 0.0301) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.86% (0.0864 => 0.1001, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.80% (13.4384 => 15.4271, std.dev.: 0.5556) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.01% (0.2944 => 0.3327, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/ffbench: 12.34% (0.9505 => 1.0678, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.56% (2.8904 => 3.2246, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: 10.31% (1.1396 => 1.2571, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.53% (1.7254 => 1.8898, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/strcat: 8.43% (0.1899 => 0.2059, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3691, std.dev.: 0.0647) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.51% (4.2280 => 4.4609, std.dev.: 0.0091) MultiSource/Applications/lua/lua: 5.19% (26.0924 => 27.4478, std.dev.: 0.1499) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.02% (3.6395 => 3.8221, std.dev.: 0.0240) MultiSource/Applications/lemon/lemon: 4.94% (1.4460 => 1.5175, std.dev.: 0.0262) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/bmm/bmm: 4.19% (2.1424 => 2.2321, std.dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 4.00% (11.6436 => 12.1095, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.64% (1.7133 => 1.7756, std.dev.: 0.0152) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.28% (0.3540 => 0.3656, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: 2.45% (2.4116 => 2.4706, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 2.09% (85.0658 => 86.8479, std.dev.: 0.0231) MultiSource/Applications/aha/aha: 2.05% (3.1595 => 3.2244, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 1.97% (12.5348 => 12.7823, std.dev.: 0.0411) MultiSource/Applications/siod/siod: 1.96% (3.2827 => 3.3472, std.dev.: 0.0231) MultiSource/Benchmarks/mafft/pairlocalalign: 1.63% (27.8444 => 28.2975, std.dev.: 0.0190) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.50% (6.5088 => 6.6062, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/sieve: 1.36% (5.2139 => 5.2847, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 1.21% (2.4858 => 2.5160, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/perlin: 1.19% (5.9798 => 6.0508, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.30% (6.6874 => 0.1807, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.06% (5.2763 => 1.3161, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: -74.57% (0.8651 => 0.2200, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -37.79% (0.1622 => 0.1009, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -9.81% (1.7609 => 1.5881, std.dev.: 0.0627) MultiSource/Applications/JM/ldecod/ldecod: -9.42% (10.4361 => 9.4531, std.dev.: 0.3621) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.83% (5.3526 => 4.8798, std.dev.: 0.0862) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.17% (5.3855 => 4.9991, std.dev.: 0.0381) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.31% (0.3987 => 0.2380, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.27% (4.5009 => 2.7782, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7636, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.19% (2.6546 => 2.0125, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: -19.25% (0.2161 => 0.1745, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4250, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2838, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.81% (32.5116 => 28.9971, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -10.46% (9.5636 => 8.5637, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.50% (1.5660 => 1.4329, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.2416 => 3.0208, std.dev.: 0.0300) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -5.02% (1.5835 => 1.5040, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.73% (0.2497 => 0.2379, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.46% (1.6805 => 1.6056, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout/lists: -4.21% (6.2999 => 6.0349, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.74% (19.9488 => 19.2021, std.dev.: 0.2065) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8915, std.dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.23% (0.4808 => 0.4701, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (8.1563 => 8.0202, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -1.53% (10.2830 => 10.1256, std.dev.: 0.0045) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.15% (0.1485 => 0.1364, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.90% (0.2116 => 0.0658, std.dev.: 0.0012) Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 22 05:17:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 22 Nov 2012 07:17:07 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121122131707.8D7092A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6143?compare_to=6138&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6143, Order: 168492, Start Time: 2012-11-22 11:45:35, End Time: 2012-11-22 13:17:35 To: 6138, Order: 168490, Start Time: 2012-11-22 08:15:30, End Time: 2012-11-22 09:46:07 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 3 (83 on baseline) Performance Improvements: 1 (24 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1050 (867 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.15% (0.9639 => 0.9846, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: 1.63% (0.6253 => 0.6355, std.dev.: 0.0024) MultiSource/Applications/spiff/spiff: 1.31% (0.8231 => 0.8339, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.77% (0.6159 => 0.6050, std.dev.: 0.0039) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.73% (1.0645 => 1.0461, std.dev.: 0.0125) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 3.79% (0.0211 => 0.0219, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 9.54% (0.0346 => 0.0379, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.24% (0.0268 => 0.0262, std.dev.: 0.0114) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 7.86% (0.0280 => 0.0302, std.dev.: 0.0076) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.57% (0.0350 => 0.0380, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/casts: 8.91% (0.0202 => 0.0220, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/test1: -36.68% (0.0199 => 0.0126, std.dev.: 0.0046) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -1.01% (0.1489 => 0.1474, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: -3.49% (1.1683 => 1.1275, std.dev.: 0.0718) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.34% (0.4366 => 0.4220, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.14% (0.1430 => 0.1428, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.84% (0.0663 => 0.0611, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -24.19% (0.0277 => 0.0210, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.55% (0.0549 => 0.0563, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.17% (1.1983 => 1.1963, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -74.19% (0.0031 => 0.0008, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 128.57% (0.0007 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.83% (0.0644 => 0.0600, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -9.54% (0.0262 => 0.0237, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.07% (0.7814 => 0.7730, std.dev.: 0.0045) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 87.50% (0.0040 => 0.0075, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.33% (16.4461 => 17.6519, std.dev.: 0.0494) MultiSource/Applications/sqlite3/sqlite3: 2321.35% (0.6332 => 15.3320, std.dev.: 0.0855) MultiSource/Benchmarks/McCat/08-main/main: 46.20% (0.1831 => 0.2677, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.67% (0.1559 => 0.1455, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7112.36% (0.3123 => 22.5242, std.dev.: 0.7709) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.71% (0.2463 => 0.3712, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1531.34% (0.3344 => 5.4552, std.dev.: 0.2675) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.45% (0.2364 => 0.3273, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 5.74% (0.6010 => 0.6355, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0429 => 0.0439, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.88% (0.3266 => 0.3360, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/strcat: 1.88% (0.1969 => 0.2006, std.dev.: 0.0037) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -25.00% (0.0224 => 0.0168, std.dev.: 0.0092) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0479, std.dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 7.32% (0.1462 => 0.1569, std.dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4607, std.dev.: 0.0174) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0705, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4961, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5143, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.4845, std.dev.: 0.6972) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3158, std.dev.: 0.0224) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1611, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3625, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4063, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0840, std.dev.: 0.0088) SingleSource/Regression/C/uint64_to_float: -23.83% (2.1832 => 1.6629, std.dev.: 0.0033) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 12.68% (0.1112 => 0.1253, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.41% (0.0830 => 0.0933, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.61% (0.2180 => 0.2346, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.23% (0.1425 => 0.1528, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.92% (0.3137 => 0.3354, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.49% (0.3295 => 0.3509, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.36% (0.6010 => 0.6332, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.08% (0.7473 => 0.7853, std.dev.: 0.0086) MultiSource/Applications/spiff/spiff: 4.89% (0.7950 => 0.8339, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.88% (0.8148 => 0.8546, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.81% (0.4847 => 0.5080, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.39% (1.1606 => 1.2116, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.36% (0.9435 => 0.9846, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.22% (0.4127 => 0.4301, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.06% (0.3003 => 0.3125, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.01% (0.2519 => 0.2620, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.83% (4.1763 => 4.3361, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.61% (1.6386 => 1.6978, std.dev.: 0.0076) MultiSource/Applications/SPASS/SPASS: 3.53% (14.2605 => 14.7645, std.dev.: 0.0738) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.43% (2.1401 => 2.2136, std.dev.: 0.0066) MultiSource/Applications/lua/lua: 3.35% (3.8189 => 3.9467, std.dev.: 0.0137) MultiSource/Applications/treecc/treecc: 3.31% (1.9948 => 2.0609, std.dev.: 0.0189) MultiSource/Applications/SIBsim4/SIBsim4: 3.31% (1.2568 => 1.2984, std.dev.: 0.0047) MultiSource/Applications/siod/siod: 3.31% (2.2184 => 2.2918, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.22% (0.4559 => 0.4706, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.22% (1.5315 => 1.5808, std.dev.: 0.0124) MultiSource/Applications/ClamAV/clamscan: 2.97% (14.7684 => 15.2063, std.dev.: 0.0871) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.91% (0.8340 => 0.8583, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.88% (1.3279 => 1.3661, std.dev.: 0.0054) MultiSource/Applications/minisat/minisat: 2.82% (0.6834 => 0.7027, std.dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.80% (6.6074 => 6.7922, std.dev.: 0.0165) MultiSource/Benchmarks/nbench/nbench: 2.75% (1.1271 => 1.1581, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.68% (0.9074 => 0.9317, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.68% (3.1832 => 3.2684, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.61% (4.4880 => 4.6053, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.60% (1.2526 => 1.2852, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.57% (4.4873 => 4.6028, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.55% (13.1811 => 13.5167, std.dev.: 0.1269) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.54% (0.5191 => 0.5323, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 2.53% (3.2366 => 3.3184, std.dev.: 0.0104) MultiSource/Applications/JM/lencod/lencod: 2.44% (15.3280 => 15.7022, std.dev.: 0.0132) MultiSource/Benchmarks/McCat/05-eks/eks: 2.39% (0.4397 => 0.4502, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.38% (0.6227 => 0.6375, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 2.30% (0.8768 => 0.8970, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.28% (0.8656 => 0.8853, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.14% (1.1170 => 1.1409, std.dev.: 0.0064) MultiSource/Applications/lemon/lemon: 2.06% (1.0945 => 1.1170, std.dev.: 0.0054) MultiSource/Applications/oggenc/oggenc: 2.04% (4.9628 => 5.0642, std.dev.: 0.0050) MultiSource/Applications/JM/ldecod/ldecod: 2.00% (6.7320 => 6.8669, std.dev.: 0.0341) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.50% (0.8995 => 0.9130, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.49% (4.5702 => 4.6384, std.dev.: 0.0174) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 94.47% (0.0199 => 0.0387, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/pi: 57.33% (1.5795 => 2.4851, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.33% (2.9753 => 3.4613, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.07% (0.7597 => 0.8818, std.dev.: 0.0291) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.58% (5.0261 => 5.6079, std.dev.: 0.0972) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.51% (0.3186 => 0.3521, std.dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.99% (1.1857 => 1.2804, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 7.54% (1.7056 => 1.8342, std.dev.: 0.0326) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.67% (4.7794 => 5.0983, std.dev.: 0.0224) MultiSource/Applications/SIBsim4/SIBsim4: 6.40% (3.1873 => 3.3912, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/richards_benchmark: 6.37% (1.3037 => 1.3867, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.89% (4.9686 => 5.2613, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.89% (4.5327 => 4.7996, std.dev.: 0.0102) MultiSource/Applications/lambda-0_1_3/lambda: 4.72% (7.4933 => 7.8473, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.66% (6.2275 => 6.5180, std.dev.: 0.0231) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.53% (3.3761 => 3.5291, std.dev.: 0.0476) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.19% (4.9453 => 5.1523, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.05% (4.9469 => 5.1472, std.dev.: 0.0073) MultiSource/Applications/hexxagon/hexxagon: 3.92% (14.0064 => 14.5552, std.dev.: 0.0199) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.57% (0.3587 => 0.3715, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.20% (1.2337 => 1.2732, std.dev.: 0.0047) MultiSource/Applications/siod/siod: 2.77% (3.6643 => 3.7658, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.76% (11.5690 => 11.8887, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.76% (4.8362 => 4.9695, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout/lists: 2.40% (7.3375 => 7.5134, std.dev.: 0.0277) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.35% (8.2783 => 8.4731, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.34% (4.8660 => 4.9798, std.dev.: 0.0245) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.37% (2.4647 => 2.4985, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 1.21% (8.5322 => 8.6354, std.dev.: 0.0155) MultiSource/Benchmarks/FreeBench/neural/neural: 1.16% (1.0841 => 1.0967, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.01% (3.5679 => 3.6041, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/power/power: 1.00% (1.2061 => 1.2182, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.13% (5.4641 => 4.3096, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.13% (7.2130 => 6.1938, std.dev.: 0.2674) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.69% (1.0512 => 0.9388, std.dev.: 0.0095) MultiSource/Benchmarks/mafft/pairlocalalign: -8.42% (63.1822 => 57.8609, std.dev.: 0.0731) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.88% (4.7482 => 4.4215, std.dev.: 0.0382) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.93% (3.7148 => 3.4946, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.89% (5.4972 => 5.1736, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.08% (5.1557 => 4.8939, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.75% (2.4490 => 2.3571, std.dev.: 0.0244) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.65% (6.0224 => 5.8028, std.dev.: 0.0130) MultiSource/Applications/lua/lua: -3.36% (29.8330 => 28.8320, std.dev.: 0.0723) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.06% (28.5821 => 27.7087, std.dev.: 0.1093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.01% (0.5807 => 0.5632, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.89% (2.8773 => 2.7942, std.dev.: 0.0322) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.75% (2.6356 => 2.5631, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/mason/mason: -2.51% (0.5415 => 0.5279, std.dev.: 0.0038) MultiSource/Applications/aha/aha: -2.37% (3.3398 => 3.2605, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: -2.23% (3.4237 => 3.3473, std.dev.: 0.0295) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.07% (9.9065 => 9.7015, std.dev.: 0.0626) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.01% (11.5316 => 11.3001, std.dev.: 0.0898) MultiSource/Benchmarks/Ptrdist/ft/ft: -1.72% (0.8789 => 0.8638, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.61% (2.3487 => 2.3108, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.59% (3.2169 => 3.1657, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.08% (5.6343 => 5.5733, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.94% (1.0262 => 1.0461, std.dev.: 0.0125) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -7.11% (0.0408 => 0.0379, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.15% (0.0254 => 0.0262, std.dev.: 0.0114) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0302 => 0.0302, std.dev.: 0.0076) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.04% (0.0384 => 0.0380, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/casts: 15.79% (0.0190 => 0.0220, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/test1: -30.00% (0.0180 => 0.0126, std.dev.: 0.0046) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.50% (0.1438 => 0.1474, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: -0.48% (1.1329 => 1.1275, std.dev.: 0.0718) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.34% (0.4164 => 0.4220, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.31% (0.1369 => 0.1428, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.68% (0.0641 => 0.0611, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 7.69% (0.0195 => 0.0210, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.60% (0.0578 => 0.0563, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.60% (1.1437 => 1.1963, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 700.00% (0.0001 => 0.0008, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 14.29% (0.0014 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.31% (0.0627 => 0.0600, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.67% (0.0180 => 0.0237, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.58% (0.8017 => 0.7730, std.dev.: 0.0045) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 20.97% (0.0062 => 0.0075, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 22 05:21:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 22 Nov 2012 07:21:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121122132141.E0AAF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6144?compare_to=6139&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6144, Order: 168492, Start Time: 2012-11-22 11:48:38, End Time: 2012-11-22 13:22:07 To: 6139, Order: 168490, Start Time: 2012-11-22 08:22:53, End Time: 2012-11-22 09:56:27 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (179 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (859 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 6.38% (0.3572 => 0.3800, std.dev.: 0.0088) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.74% (2.0478 => 2.1039, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/salsa20: 2.40% (7.4937 => 7.6736, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 2.30% (3.1932 => 3.2668, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.22% (0.1431 => 0.1299, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.37% (0.3821 => 0.3501, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/synchronized: -7.03% (0.3896 => 0.3622, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: -7.02% (0.3831 => 0.3562, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.02% (2.4924 => 2.3175, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: -7.00% (0.3812 => 0.3545, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.00% (0.3142 => 0.2922, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: -6.98% (0.3880 => 0.3609, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.85% (0.9542 => 0.8888, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.84% (0.4033 => 0.3757, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.84% (0.3891 => 0.3625, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -6.81% (0.3848 => 0.3586, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: -6.80% (0.4176 => 0.3892, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.79% (0.3357 => 0.3129, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.57% (0.3884 => 0.3629, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.51% (0.2428 => 0.2270, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.50% (0.1584 => 0.1481, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: -6.39% (0.2160 => 0.2022, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -6.37% (9.2283 => 8.6409, std.dev.: 0.0113) SingleSource/UnitTests/ObjC/property: -6.36% (0.4199 => 0.3932, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -6.34% (16.1920 => 15.1660, std.dev.: 0.0146) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.33% (0.2355 => 0.2206, std.dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: -6.31% (7.0961 => 6.6481, std.dev.: 0.0178) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.29% (0.1796 => 0.1683, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.28% (0.6484 => 0.6077, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.26% (0.3658 => 0.3429, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.25% (0.9852 => 0.9236, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -6.19% (0.4280 => 0.4015, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.17% (1.3722 => 1.2875, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: -6.13% (0.9179 => 0.8616, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.08% (1.0544 => 0.9903, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.06% (0.1716 => 0.1612, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.03% (4.8161 => 4.5255, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.98% (6.7716 => 6.3669, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.97% (3.5339 => 3.3231, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.94% (1.2300 => 1.1569, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.93% (4.0323 => 3.7933, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.92% (1.6364 => 1.5395, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.92% (0.5863 => 0.5516, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -5.91% (0.1761 => 0.1657, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: -5.89% (1.1530 => 1.0851, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.88% (0.5591 => 0.5262, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -5.88% (4.3330 => 4.0783, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.84% (0.5705 => 0.5372, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.83% (0.6293 => 0.5926, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.83% (0.2695 => 0.2538, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.82% (0.6052 => 0.5700, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -5.81% (1.1450 => 1.0785, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.80% (0.2985 => 0.2812, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.79% (1.4642 => 1.3794, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.78% (0.7919 => 0.7461, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.78% (0.6297 => 0.5933, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.77% (0.6667 => 0.6282, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.76% (0.6230 => 0.5871, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.76% (4.8802 => 4.5993, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.74% (4.5069 => 4.2482, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.70% (0.5575 => 0.5257, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.69% (0.6304 => 0.5945, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.68% (0.6194 => 0.5842, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.68% (0.5849 => 0.5517, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -5.67% (1.2515 => 1.1806, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.66% (0.5456 => 0.5147, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.66% (1.2784 => 1.2061, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.66% (0.5570 => 0.5255, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.65% (0.5857 => 0.5526, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -5.64% (0.2659 => 0.2509, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.64% (0.5478 => 0.5169, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.64% (0.3406 => 0.3214, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.63% (0.5999 => 0.5661, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.63% (0.5859 => 0.5529, std.dev.: 0.0122) MultiSource/Benchmarks/McCat/05-eks/eks: -5.63% (0.4515 => 0.4261, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.62% (0.6446 => 0.6084, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.60% (0.5802 => 0.5477, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.60% (0.6660 => 0.6287, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.58% (0.6736 => 0.6360, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.56% (0.6260 => 0.5912, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -5.52% (15.5079 => 14.6522, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.50% (0.5925 => 0.5599, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.49% (0.6189 => 0.5849, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.49% (1.3864 => 1.3103, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.48% (0.5581 => 0.5275, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.47% (0.6440 => 0.6088, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.45% (14.2083 => 13.4345, std.dev.: 0.0146) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.44% (0.2278 => 0.2154, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.44% (0.5941 => 0.5618, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.41% (8.0126 => 7.5789, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.40% (0.6033 => 0.5707, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: -5.39% (17.1032 => 16.1812, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.37% (0.8521 => 0.8063, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.37% (0.4151 => 0.3928, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.37% (0.2999 => 0.2838, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: -5.35% (0.3194 => 0.3023, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.34% (0.3931 => 0.3721, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.34% (0.3483 => 0.3297, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.33% (0.4916 => 0.4654, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.33% (0.5688 => 0.5385, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -5.32% (1.3148 => 1.2448, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.32% (0.7198 => 0.6815, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.31% (0.3016 => 0.2856, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.30% (0.3057 => 0.2895, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -5.29% (0.2871 => 0.2719, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.28% (0.2933 => 0.2778, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.27% (1.2221 => 1.1577, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.26% (0.3837 => 0.3635, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -5.25% (0.3581 => 0.3393, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.25% (1.2210 => 1.1569, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.24% (0.5168 => 0.4897, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.24% (0.6676 => 0.6326, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.24% (0.2939 => 0.2785, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.20% (2.1713 => 2.0584, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.20% (0.2385 => 0.2261, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -5.20% (0.7447 => 0.7060, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: -5.19% (0.3026 => 0.2869, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.18% (0.4321 => 0.4097, std.dev.: 0.0059) MultiSource/Applications/d/make_dparser: -5.17% (3.5154 => 3.3337, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.15% (0.3319 => 0.3148, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: -5.15% (0.3205 => 0.3040, std.dev.: 0.0043) MultiSource/Applications/lua/lua: -5.14% (4.0594 => 3.8506, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.13% (0.2903 => 0.2754, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.13% (0.4813 => 0.4566, std.dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: -5.13% (15.2527 => 14.4709, std.dev.: 0.0309) SingleSource/Benchmarks/Shootout-C++/hello: -5.12% (0.2849 => 0.2703, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.12% (1.6474 => 1.5630, std.dev.: 0.0187) SingleSource/Benchmarks/Shootout-C++/hash2: -5.12% (0.4861 => 0.4612, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.12% (0.3323 => 0.3153, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: -5.10% (0.3255 => 0.3089, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -5.10% (2.4021 => 2.2797, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.06% (0.6681 => 0.6343, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.05% (0.7524 => 0.7144, std.dev.: 0.0054) SingleSource/Regression/C++/ofstream_ctor: -5.03% (0.3059 => 0.2905, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -5.00% (0.3481 => 0.3307, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.97% (0.6395 => 0.6077, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.96% (0.7021 => 0.6673, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -4.94% (2.1401 => 2.0344, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary3: -4.93% (0.3446 => 0.3276, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.92% (0.5329 => 0.5067, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -4.87% (0.7982 => 0.7593, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.86% (0.3849 => 0.3662, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: -4.85% (0.2989 => 0.2844, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.85% (0.4083 => 0.3885, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: -4.84% (0.3867 => 0.3680, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -4.83% (0.3621 => 0.3446, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.82% (0.7339 => 0.6985, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.82% (22.4056 => 21.3265, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.80% (0.9557 => 0.9098, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.80% (0.5567 => 0.5300, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary: -4.77% (0.3394 => 0.3232, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -4.76% (0.4248 => 0.4046, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.75% (0.2106 => 0.2006, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -4.69% (0.8418 => 0.8023, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.69% (0.5569 => 0.5308, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: -4.68% (0.3271 => 0.3118, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.64% (0.9077 => 0.8656, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.61% (0.3252 => 0.3102, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -4.57% (18.2933 => 17.4572, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.55% (0.6395 => 0.6104, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.54% (0.4427 => 0.4226, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.49% (2.2587 => 2.1573, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -4.49% (34.0927 => 32.5631, std.dev.: 0.0285) SingleSource/Benchmarks/Shootout-C++/sieve: -4.44% (0.3788 => 0.3620, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: -4.41% (0.6750 => 0.6452, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -4.21% (0.6347 => 0.6080, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: -4.16% (0.6441 => 0.6173, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -4.05% (0.4524 => 0.4341, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -4.00% (0.7779 => 0.7468, std.dev.: 0.0035) MultiSource/Applications/oggenc/oggenc: -3.91% (5.0226 => 4.8262, std.dev.: 0.0054) MultiSource/Applications/hbd/hbd: -3.75% (1.5610 => 1.5024, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.61% (5.4682 => 5.2709, std.dev.: 0.0196) SingleSource/UnitTests/Vector/constpool: -2.35% (20.7746 => 20.2854, std.dev.: 0.0341) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7527, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: -8.73% (1.2842 => 1.1721, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -4.00% (2.2633 => 2.1728, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.91% (1.7753 => 1.7059, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4687, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 22 06:07:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 22 Nov 2012 08:07:00 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121122140700.3C9DE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6145?compare_to=6141&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6145, Order: 168490, Start Time: 2012-11-22 10:46:41, End Time: 2012-11-22 14:07:25 To: 6141, Order: 168485, Start Time: 2012-11-22 06:35:40, End Time: 2012-11-22 09:58:28 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (169 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1092 (721 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 45.60% (0.0625 => 0.0910, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.71% (0.1063 => 0.1432, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 27.05% (1.5932 => 2.0241, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.31% (0.4253 => 0.5372, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.00% (0.2969 => 0.3741, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.77% (0.1106 => 0.1391, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.07% (0.0714 => 0.0893, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.81% (0.4139 => 0.5166, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.63% (0.4994 => 0.6174, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.37% (0.0475 => 0.0586, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.20% (0.5000 => 0.6160, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.95% (0.0584 => 0.0718, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.85% (0.0547 => 0.0672, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.83% (0.5900 => 0.7247, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: 21.70% (0.0599 => 0.0729) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.68% (0.1107 => 0.1347, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.65% (0.1021 => 0.1242, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.60% (0.1620 => 0.1970, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.52% (0.0897 => 0.1090, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.38% (0.0633 => 0.0762) MultiSource/Benchmarks/Olden/em3d/em3d: 20.36% (0.0948 => 0.1141, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.22% (0.1103 => 0.1326, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.21% (0.0584 => 0.0702, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.09% (0.0642 => 0.0771, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.93% (0.3903 => 0.4681, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.75% (0.1549 => 0.1855, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 19.73% (0.0821 => 0.0983, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.64% (0.1003 => 0.1200, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.59% (0.0822 => 0.0983, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.51% (0.1604 => 0.1917, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 19.37% (0.0604 => 0.0721) MultiSource/Benchmarks/McCat/05-eks/eks: 19.15% (0.1619 => 0.1929, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.95% (0.1462 => 0.1739, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 18.37% (0.0947 => 0.1121, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.35% (0.3890 => 0.4604, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.27% (0.2736 => 0.3236, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 18.19% (0.0808 => 0.0955, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.92% (0.2014 => 0.2375, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 17.65% (0.1218 => 0.1433, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 17.62% (0.0698 => 0.0821) MultiSource/Applications/spiff/spiff: 17.50% (0.4029 => 0.4734, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.47% (1.3152 => 1.5450, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 17.44% (0.5826 => 0.6842, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.37% (0.1088 => 0.1277, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 17.17% (0.5889 => 0.6900, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 17.14% (0.1505 => 0.1763, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.03% (0.2866 => 0.3354, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 16.99% (0.5546 => 0.6488, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.98% (0.4658 => 0.5449, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 16.57% (1.8794 => 2.1908, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.49% (3.5627 => 4.1503, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.46% (0.1968 => 0.2292, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 16.46% (0.9697 => 1.1293, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.17% (0.3271 => 0.3800, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.16% (0.5026 => 0.5838, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.12% (0.1160 => 0.1347, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.11% (1.6211 => 1.8823, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: 16.01% (1.0781 => 1.2507, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.00% (0.2875 => 0.3335, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 15.83% (0.1421 => 0.1646, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.71% (0.4361 => 0.5046, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.60% (0.2738 => 0.3165, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.50% (0.3930 => 0.4539, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 15.47% (0.2780 => 0.3210, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.41% (4.4195 => 5.1004, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 15.38% (0.2750 => 0.3173, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 15.34% (0.1284 => 0.1481, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.32% (2.7292 => 3.1473, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.23% (0.1090 => 0.1256, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 15.19% (0.2725 => 0.3139, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 15.18% (0.2714 => 0.3126, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.17% (0.2729 => 0.3143, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 15.13% (4.2109 => 4.8478, std.dev.: 0.0071) SingleSource/Regression/C++/ofstream_ctor: 15.08% (0.3004 => 0.3457, std.dev.: 0.0066) MultiSource/Applications/hexxagon/hexxagon: 15.06% (0.9909 => 1.1401, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.04% (0.2792 => 0.3212, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 15.04% (0.2813 => 0.3236, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.02% (0.3195 => 0.3675, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 15.02% (0.7171 => 0.8248, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/except: 14.98% (0.2811 => 0.3232, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 14.95% (0.2823 => 0.3245, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/random: 14.95% (0.2803 => 0.3222, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.87% (0.2911 => 0.3344, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 14.76% (0.3096 => 0.3553, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.72% (2.0673 => 2.3717, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.69% (1.9694 => 2.2588, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 14.54% (0.3267 => 0.3742, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 14.46% (0.2075 => 0.2375, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 14.43% (0.3258 => 0.3728, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 14.38% (0.3317 => 0.3794, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.37% (1.9966 => 2.2835, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.28% (0.3124 => 0.3570, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 14.26% (23.5202 => 26.8744, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.08% (0.3060 => 0.3491, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 14.07% (0.2566 => 0.2927, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 13.95% (0.3678 => 0.4191, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.92% (0.3362 => 0.3830, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 13.71% (0.3348 => 0.3807, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.68% (0.3625 => 0.4121, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.65% (0.3282 => 0.3730, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 13.63% (1.4269 => 1.6214, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists1: 13.49% (0.3477 => 0.3946, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.47% (0.3460 => 0.3926, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 13.45% (0.3726 => 0.4227, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.41% (0.3446 => 0.3908, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.39% (0.3442 => 0.3903, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.39% (0.3496 => 0.3964, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 13.39% (0.4146 => 0.4701, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.36% (0.3465 => 0.3928, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.32% (0.3469 => 0.3931, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.27% (0.3488 => 0.3951, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 13.17% (0.7875 => 0.8912, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 13.06% (0.4251 => 0.4806, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.04% (0.3650 => 0.4126, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.01% (0.3981 => 0.4499, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.95% (0.3690 => 0.4168, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 12.92% (2.1653 => 2.4451, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.90% (0.3845 => 0.4341, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions: 12.87% (0.3643 => 0.4112, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.81% (0.3724 => 0.4201, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 12.66% (4.6177 => 5.2023, std.dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 12.34% (2.1013 => 2.3607, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 12.21% (0.5012 => 0.5624, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.01% (0.2040 => 0.2285, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 11.93% (0.2691 => 0.3012, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.53% (0.6435 => 0.7177, std.dev.: 0.0046) MultiSource/Applications/SPASS/SPASS: 11.42% (5.5417 => 6.1745, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.09% (0.1028 => 0.1142, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 10.72% (0.3498 => 0.3873, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.56% (0.1383 => 0.1529, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.35% (0.2068 => 0.2282, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 10.32% (0.4847 => 0.5347, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.30% (0.2737 => 0.3019, std.dev.: 0.0105) MultiSource/Applications/siod/siod: 10.27% (0.6634 => 0.7315, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.15% (0.3084 => 0.3397, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 9.68% (0.3336 => 0.3659, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 9.47% (2.0346 => 2.2272, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.37% (0.2103 => 0.2300, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 9.28% (0.2391 => 0.2613, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.66% (0.5361 => 0.5825, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.65% (4.6926 => 5.0983, std.dev.: 0.0065) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.15% (11.6398 => 12.5882, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.88% (0.7426 => 0.8011, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.68% (0.5584 => 0.6013, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 6.79% (11.9555 => 12.7672, std.dev.: 0.0079) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.01% (0.3792 => 0.3944, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 9.24% (0.2802 => 0.3061, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6093, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6780, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary: 5.04% (0.2122 => 0.2229, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1675, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-2: 4.63% (1.8057 => 1.8893, std.dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/dry: 4.26% (14.0481 => 14.6467, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2060, std.dev.: 0.0039) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2219, std.dev.: 0.0071) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3022, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2854, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5124, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5400, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5843, std.dev.: 0.0157) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.36% (2.4764 => 2.4179, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5638, std.dev.: 0.0117) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9784, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7975, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary2: -7.58% (0.2402 => 0.2220, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: -7.17% (2.1113 => 1.9599, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.40% (11.2080 => 10.8270, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0033) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7727, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -2.70% (17.2379 => 16.7722, std.dev.: 0.0447) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.25% (41.7953 => 40.8550, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5689, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4954, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.30% (5.7935 => 5.7182, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.2036, std.dev.: 0.0626) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0442, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 22 07:10:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 22 Nov 2012 09:10:34 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121122151034.99F492A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6146?compare_to=6143&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6146, Order: 168493, Start Time: 2012-11-22 13:36:29, End Time: 2012-11-22 15:11:02 To: 6143, Order: 168492, Start Time: 2012-11-22 11:45:35, End Time: 2012-11-22 13:17:35 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 5 (37 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1048 (921 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 6.22% (0.1977 => 0.2100, std.dev.: 0.0030) MultiSource/Applications/hbd/hbd: 2.41% (1.4676 => 1.5029, std.dev.: 0.0133) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/ffbench: 3.21% (1.4097 => 1.4549, std.dev.: 0.0121) SingleSource/Benchmarks/CoyoteBench/lpbench: 2.41% (3.8932 => 3.9870, std.dev.: 0.0358) MultiSource/Benchmarks/BitBench/five11/five11: 1.50% (5.6463 => 5.7309, std.dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -5.80% (21.7077 => 20.4485, std.dev.: 0.2142) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.05% (1.0461 => 1.0885, std.dev.: 0.0515) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -15.98% (0.0219 => 0.0184, std.dev.: 0.0086) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 8.44% (0.0379 => 0.0411, std.dev.: 0.0122) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 26.72% (0.0262 => 0.0332, std.dev.: 0.0105) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0081) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.32% (0.0380 => 0.0423, std.dev.: 0.0110) SingleSource/UnitTests/Vector/Altivec/casts: -7.73% (0.0220 => 0.0203, std.dev.: 0.0066) SingleSource/UnitTests/Vector/Altivec/test1: 72.22% (0.0126 => 0.0217, std.dev.: 0.0063) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 0.20% (0.1474 => 0.1477, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 0.93% (1.1275 => 1.1380, std.dev.: 0.0419) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.11% (0.4220 => 0.4309, std.dev.: 0.0526) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.28% (0.1428 => 0.1424, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.16% (0.0611 => 0.0612, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 29.52% (0.0210 => 0.0272, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.78% (0.0563 => 0.0553, std.dev.: 0.0249) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.24% (1.1963 => 1.2111, std.dev.: 0.1308) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 287.50% (0.0008 => 0.0031, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0016 => 0.0024, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.83% (0.0600 => 0.0647, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0237 => 0.0237, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.18% (0.7730 => 0.7821, std.dev.: 0.0218) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -26.67% (0.0075 => 0.0055, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.51% (16.4461 => 17.6811, std.dev.: 0.2225) MultiSource/Applications/sqlite3/sqlite3: 2316.50% (0.6332 => 15.3013, std.dev.: 0.3886) MultiSource/Benchmarks/McCat/08-main/main: 50.41% (0.1831 => 0.2754, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.99% (0.1559 => 0.1450, std.dev.: 0.0346) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7035.06% (0.3123 => 22.2828, std.dev.: 1.0149) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.67% (0.2463 => 0.3711, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1528.35% (0.3344 => 5.4452, std.dev.: 0.3246) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.32% (0.2364 => 0.3270, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/bigfib: 4.89% (0.6010 => 0.6304, std.dev.: 0.1364) SingleSource/Benchmarks/Misc/mandel: -0.70% (0.0429 => 0.0426, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.44% (0.3266 => 0.3411, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/strcat: 4.57% (0.1969 => 0.2059, std.dev.: 0.0520) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.48% (0.0224 => 0.0243, std.dev.: 0.0051) SingleSource/UnitTests/byval-alignment: -26.09% (0.0230 => 0.0170, std.dev.: 0.0039) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0520, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 8.14% (0.1462 => 0.1581, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4673, std.dev.: 0.0198) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0707, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4962, std.dev.: 0.0131) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5115, std.dev.: 0.0975) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.6539, std.dev.: 0.3037) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3133, std.dev.: 0.0246) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1376, std.dev.: 0.0339) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3637, std.dev.: 0.0180) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4104, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0003, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0878, std.dev.: 0.0176) SingleSource/Regression/C/uint64_to_float: -23.83% (2.1832 => 1.6630, std.dev.: 0.0193) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.79% (0.0810 => 0.0946, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/tsp/tsp: 12.14% (0.1112 => 0.1247, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/health/health: 8.39% (0.1347 => 0.1460, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.33% (1.4269 => 1.5029, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.61% (0.4559 => 0.4769, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.56% (0.8359 => 0.8573, std.dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 2.55% (0.9810 => 1.0060, std.dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 138.69% (0.0199 => 0.0475, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/pi: 53.52% (1.5795 => 2.4249, std.dev.: 0.0349) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.57% (0.7597 => 0.8856, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.36% (2.9753 => 3.4622, std.dev.: 0.0275) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.73% (2.7995 => 3.2118, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.51% (5.0261 => 5.6045, std.dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.19% (1.1857 => 1.2828, std.dev.: 0.0247) SingleSource/Benchmarks/Misc/richards_benchmark: 7.71% (1.3037 => 1.4042, std.dev.: 0.0176) SingleSource/Benchmarks/McGill/queens: 7.59% (1.7056 => 1.8350, std.dev.: 0.0331) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.39% (6.3772 => 6.8485, std.dev.: 0.1298) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.45% (4.7794 => 5.0875, std.dev.: 0.0518) MultiSource/Applications/SIBsim4/SIBsim4: 6.11% (3.1873 => 3.3819, std.dev.: 0.0398) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.93% (4.5327 => 4.8013, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.86% (4.9686 => 5.2600, std.dev.: 0.0296) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.71% (6.2275 => 6.5206, std.dev.: 0.0341) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.66% (3.3761 => 3.5333, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: 4.60% (7.4933 => 7.8381, std.dev.: 0.0317) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.94% (4.9469 => 5.1417, std.dev.: 0.0226) MultiSource/Applications/hexxagon/hexxagon: 3.91% (14.0064 => 14.5546, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.66% (4.9453 => 5.1265, std.dev.: 0.0111) MultiSource/Applications/siod/siod: 2.96% (3.6643 => 3.7726, std.dev.: 0.0262) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.85% (8.2783 => 8.5140, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.80% (11.5690 => 11.8935, std.dev.: 0.0641) SingleSource/Benchmarks/Shootout/lists: 2.64% (7.3375 => 7.5309, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.39% (4.8660 => 4.9825, std.dev.: 0.0433) MultiSource/Benchmarks/BitBench/five11/five11: 2.28% (5.6030 => 5.7309, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/ReedSolomon: 1.52% (8.5322 => 8.6619, std.dev.: 0.0236) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.47% (4.4340 => 4.4991, std.dev.: 0.0103) MultiSource/Benchmarks/FreeBench/neural/neural: 1.31% (1.0841 => 1.0983, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: 1.08% (1.2061 => 1.2191, std.dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.84% (5.4641 => 4.3253, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.65% (7.2130 => 6.1564, std.dev.: 0.1545) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.90% (1.0512 => 0.9366, std.dev.: 0.0077) MultiSource/Benchmarks/mafft/pairlocalalign: -8.36% (63.1822 => 57.8999, std.dev.: 0.0732) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.06% (14.6451 => 13.6109, std.dev.: 0.0784) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.97% (4.7482 => 4.4174, std.dev.: 0.0053) MultiSource/Benchmarks/nbench/nbench: -6.91% (21.9654 => 20.4485, std.dev.: 0.2142) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.97% (3.7148 => 3.4932, std.dev.: 0.0349) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.89% (5.4972 => 5.1733, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.04% (5.1557 => 4.8961, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.43% (6.0224 => 5.8156, std.dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (28.5821 => 27.6908, std.dev.: 0.0461) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.03% (0.5807 => 0.5631, std.dev.: 0.0013) MultiSource/Applications/aha/aha: -2.40% (3.3398 => 3.2595, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.30% (2.6356 => 2.5750, std.dev.: 0.0208) SingleSource/Benchmarks/Shootout-C++/hash2: -2.04% (3.4237 => 3.3539, std.dev.: 0.0073) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 6.07% (1.0262 => 1.0885, std.dev.: 0.0515) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 49.59% (0.0123 => 0.0184, std.dev.: 0.0086) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.74% (0.0408 => 0.0411, std.dev.: 0.0122) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0105) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0081) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0110) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0066) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0063) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 2.71% (0.1438 => 0.1477, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 0.45% (1.1329 => 1.1380, std.dev.: 0.0419) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.48% (0.4164 => 0.4309, std.dev.: 0.0526) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.02% (0.1369 => 0.1424, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.52% (0.0641 => 0.0612, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 39.49% (0.0195 => 0.0272, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.33% (0.0578 => 0.0553, std.dev.: 0.0249) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.89% (1.1437 => 1.2111, std.dev.: 0.1308) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 71.43% (0.0014 => 0.0024, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.19% (0.0627 => 0.0647, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.67% (0.0180 => 0.0237, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.44% (0.8017 => 0.7821, std.dev.: 0.0218) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -11.29% (0.0062 => 0.0055, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 22 07:21:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 22 Nov 2012 09:21:07 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121122152107.86CC32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6147?compare_to=6144&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6147, Order: 168495, Start Time: 2012-11-22 13:48:12, End Time: 2012-11-22 15:21:33 To: 6144, Order: 168492, Start Time: 2012-11-22 11:48:38, End Time: 2012-11-22 13:22:07 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (183 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (855 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 2.77% (7.4937 => 7.7010, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1015, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/hash2: 2.36% (3.1932 => 3.2687, std.dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.22% (0.1431 => 0.1299, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.37% (0.3821 => 0.3501, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -7.07% (0.3831 => 0.3560, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -7.04% (0.3880 => 0.3607, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -7.03% (0.3896 => 0.3622, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -7.03% (0.3812 => 0.3544, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -7.02% (0.3848 => 0.3578, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: -6.99% (2.4924 => 2.3182, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.93% (0.3884 => 0.3615, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.89% (0.9542 => 0.8885, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.87% (0.3142 => 0.2926, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: -6.87% (0.4033 => 0.3756, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -6.82% (0.3357 => 0.3128, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.81% (0.3891 => 0.3626, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.75% (0.4176 => 0.3894, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.57% (0.1584 => 0.1480, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.55% (0.2428 => 0.2269, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: -6.43% (0.4199 => 0.3929, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.41% (9.2283 => 8.6372, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/oourafft: -6.39% (0.2160 => 0.2022, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.37% (0.2355 => 0.2205, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -6.30% (16.1920 => 15.1712, std.dev.: 0.0100) MultiSource/Applications/JM/ldecod/ldecod: -6.27% (7.0961 => 6.6510, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.25% (0.6484 => 0.6079, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.24% (0.1796 => 0.1684, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: -6.21% (0.4280 => 0.4014, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.18% (0.3658 => 0.3432, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.17% (0.9852 => 0.9244, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/football/football: -6.12% (0.9179 => 0.8617, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.11% (1.0544 => 0.9900, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.11% (1.3722 => 1.2884, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.00% (3.5339 => 3.3219, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.96% (4.8161 => 4.5289, std.dev.: 0.0100) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.96% (6.7716 => 6.3678, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/chomp: -5.91% (0.1761 => 0.1657, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.90% (1.2300 => 1.1574, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.90% (0.5591 => 0.5261, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.89% (0.1716 => 0.1615, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.88% (0.5863 => 0.5518, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.88% (1.6364 => 1.5402, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.84% (4.0323 => 3.7970, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.83% (1.4642 => 1.3789, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.83% (0.2695 => 0.2538, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.82% (0.6293 => 0.5927, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.79% (0.6230 => 0.5869, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.79% (0.5478 => 0.5161, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.77% (0.6667 => 0.6282, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.77% (0.7919 => 0.7462, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.76% (4.5069 => 4.2474, std.dev.: 0.0177) MultiSource/Applications/lemon/lemon: -5.76% (1.1450 => 1.0791, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.75% (0.5805 => 0.5471, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: -5.75% (4.3330 => 4.0838, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.74% (4.8802 => 4.6000, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: -5.72% (1.1530 => 1.0870, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.71% (0.5705 => 0.5379, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.70% (0.6052 => 0.5707, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.69% (1.2784 => 1.2056, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.68% (0.5581 => 0.5264, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -5.67% (0.4515 => 0.4259, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: -5.67% (1.2515 => 1.1806, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.64% (0.6736 => 0.6356, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.64% (0.6260 => 0.5907, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.64% (0.6297 => 0.5942, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.64% (0.5925 => 0.5591, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.64% (0.3406 => 0.3214, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.62% (0.5849 => 0.5520, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.62% (0.6194 => 0.5846, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.61% (0.5456 => 0.5150, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.59% (0.2985 => 0.2818, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.58% (0.5802 => 0.5478, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.58% (0.5857 => 0.5530, std.dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: -5.56% (17.1032 => 16.1524, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.56% (0.6189 => 0.5845, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.55% (0.5941 => 0.5611, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.53% (0.5999 => 0.5667, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.52% (0.6446 => 0.6090, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.51% (0.5859 => 0.5536, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.51% (0.5570 => 0.5263, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.49% (0.2548 => 0.2408, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.49% (0.5575 => 0.5269, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.47% (0.6304 => 0.5959, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.47% (0.2999 => 0.2835, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: -5.47% (1.3864 => 1.3106, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.47% (0.6660 => 0.6296, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.45% (14.2083 => 13.4335, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.45% (0.6676 => 0.6312, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.44% (8.0126 => 7.5764, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.44% (0.2278 => 0.2154, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.40% (0.6440 => 0.6092, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.40% (0.2871 => 0.2716, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.40% (0.3483 => 0.3295, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: -5.38% (0.2659 => 0.2516, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -5.38% (15.5079 => 14.6739, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.37% (0.4916 => 0.4652, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.36% (0.4813 => 0.4555, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: -5.36% (0.3025 => 0.2863, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.35% (0.8521 => 0.8065, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.34% (0.3931 => 0.3721, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: -5.33% (1.3148 => 1.2447, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/objinst: -5.32% (0.3194 => 0.3024, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.32% (0.6033 => 0.5712, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.31% (0.7198 => 0.6816, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.31% (0.3016 => 0.2856, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.27% (0.3057 => 0.2896, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.26% (0.3837 => 0.3635, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.25% (1.2221 => 1.1579, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.25% (0.2933 => 0.2779, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.25% (2.1713 => 2.0573, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: -5.25% (0.3581 => 0.3393, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.24% (0.2385 => 0.2260, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.24% (0.2903 => 0.2751, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: -5.21% (0.3205 => 0.3038, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -5.21% (0.2939 => 0.2786, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.20% (0.4151 => 0.3935, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -5.19% (0.3255 => 0.3086, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.19% (0.5688 => 0.5393, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.17% (1.2210 => 1.1579, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.15% (0.6681 => 0.6337, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.14% (0.3849 => 0.3651, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -5.13% (4.0594 => 3.8510, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.13% (1.6474 => 1.5629, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -5.12% (15.2527 => 14.4713, std.dev.: 0.0208) SingleSource/Benchmarks/Shootout-C++/except: -5.12% (0.3026 => 0.2871, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -5.12% (3.5154 => 3.3354, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hello: -5.09% (0.2849 => 0.2704, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.09% (0.5168 => 0.4905, std.dev.: 0.0009) MultiSource/Applications/siod/siod: -5.07% (2.4021 => 2.2803, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.06% (0.3323 => 0.3155, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: -5.05% (0.7447 => 0.7071, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.00% (0.7339 => 0.6972, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -4.98% (0.3394 => 0.3225, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.98% (0.4321 => 0.4106, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary2: -4.97% (0.3481 => 0.3308, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -4.97% (0.3059 => 0.2907, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -4.96% (0.4861 => 0.4620, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.95% (22.4056 => 21.2970, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/lists: -4.92% (0.3621 => 0.3443, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.91% (0.3867 => 0.3677, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.91% (0.3319 => 0.3156, std.dev.: 0.0022) MultiSource/Applications/treecc/treecc: -4.88% (2.1401 => 2.0357, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.86% (0.7524 => 0.7158, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.86% (0.7021 => 0.6680, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.85% (0.6395 => 0.6085, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -4.83% (0.4248 => 0.4043, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.80% (0.2106 => 0.2005, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.79% (0.9557 => 0.9099, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.75% (0.4083 => 0.3889, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.74% (0.3252 => 0.3098, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.73% (0.5329 => 0.5077, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -4.70% (0.8418 => 0.8022, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.68% (0.2989 => 0.2849, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -4.66% (0.7982 => 0.7610, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.66% (0.6395 => 0.6097, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -4.64% (0.3446 => 0.3286, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.61% (0.4427 => 0.4223, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.60% (0.5567 => 0.5311, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.58% (0.5569 => 0.5314, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.52% (0.9077 => 0.8667, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: -4.51% (0.3788 => 0.3617, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: -4.50% (0.6750 => 0.6446, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.49% (0.3271 => 0.3124, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.44% (2.2587 => 2.1584, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -4.38% (18.2933 => 17.4921, std.dev.: 0.0124) MultiSource/Benchmarks/Bullet/bullet: -4.36% (34.0927 => 32.6052, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.30% (0.3491 => 0.3341, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.24% (0.6347 => 0.6078, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -4.20% (0.7779 => 0.7452, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: -4.11% (0.6441 => 0.6176, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -4.07% (0.4524 => 0.4340, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.84% (5.0226 => 4.8298, std.dev.: 0.0047) MultiSource/Applications/hbd/hbd: -3.78% (1.5610 => 1.5020, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.65% (5.4682 => 5.2687, std.dev.: 0.0102) SingleSource/UnitTests/Vector/constpool: -2.45% (20.7746 => 20.2655, std.dev.: 0.0224) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7535, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: -8.75% (1.2842 => 1.1718, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7067, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.84% (2.2633 => 2.1765, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.39% (1.0557 => 1.0199, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.28% (1.3096 => 1.2667, std.dev.: 0.0143) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4699, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 22 08:28:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 22 Nov 2012 10:28:12 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121122162812.55F342A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6148?compare_to=6142&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6148, Order: 168493, Start Time: 2012-11-22 14:09:16, End Time: 2012-11-22 16:28:38 To: 6142, Order: 168490, Start Time: 2012-11-22 10:52:11, End Time: 2012-11-22 13:12:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 49 (144 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1037 (701 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel13: 12.13% (0.1080 => 0.1211, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 11.75% (0.8137 => 0.9093, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.34% (0.5804 => 0.6462, std.dev.: 0.0116) SingleSource/Benchmarks/LivermoreLoops/kernel14: 11.29% (0.1089 => 0.1212, std.dev.: 0.0032) SingleSource/Benchmarks/LivermoreLoops/kernel15: 11.10% (0.1180 => 0.1311, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.61% (0.2225 => 0.2461, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: 10.60% (0.1453 => 0.1607, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 10.30% (0.8913 => 0.9831, std.dev.: 0.0097) SingleSource/Benchmarks/LivermoreLoops/kernel16: 10.01% (0.1129 => 0.1242, std.dev.: 0.0009) SingleSource/Benchmarks/LivermoreLoops/kernel17: 9.99% (0.1011 => 0.1112, std.dev.: 0.0009) SingleSource/Benchmarks/LivermoreLoops/kernel19: 9.84% (0.1037 => 0.1139, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 9.53% (0.1102 => 0.1207, std.dev.: 0.0040) SingleSource/UnitTests/SignlessTypes/rem: 9.37% (0.1260 => 0.1378, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 9.34% (0.1327 => 0.1451, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 9.21% (0.1347 => 0.1471, std.dev.: 0.0008) SingleSource/Benchmarks/LivermoreLoops/kernel18: 8.85% (0.1480 => 0.1611, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.83% (0.4540 => 0.4941, std.dev.: 0.0138) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.76% (0.9079 => 0.9874, std.dev.: 0.0131) SingleSource/Regression/C++/ofstream_ctor: 8.75% (0.3164 => 0.3441, std.dev.: 0.0049) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.56% (0.1331 => 0.1445, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.15% (0.3121 => 0.3344, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.75% (0.1703 => 0.1818, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists1: 6.04% (0.4255 => 0.4512, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.54% (0.3990 => 0.4211, std.dev.: 0.0052) MultiSource/Applications/d/make_dparser: 5.36% (3.9356 => 4.1465, std.dev.: 0.0670) MultiSource/Applications/JM/ldecod/ldecod: 5.17% (9.4531 => 9.9421, std.dev.: 0.1377) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.91% (0.3948 => 0.4142, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-4: 4.89% (0.3971 => 0.4165, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/matrix: 4.65% (0.3611 => 0.3779, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.27% (0.3372 => 0.3516, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: 4.11% (0.3312 => 0.3448, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.10% (0.4929 => 0.5131, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/wc: 3.55% (0.3545 => 0.3671, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.33% (1.4082 => 1.4551, std.dev.: 0.0139) MultiSource/Applications/hbd/hbd: 2.82% (1.7280 => 1.7768, std.dev.: 0.0107) MultiSource/Applications/kimwitu++/kc: 2.72% (21.0289 => 21.6015, std.dev.: 0.0710) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/flops: 28.56% (6.7490 => 8.6768, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 21.35% (0.1213 => 0.1472, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 15.38% (5.3698 => 6.1958, std.dev.: 0.1133) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.52% (3.8002 => 4.3141, std.dev.: 0.1159) MultiSource/Benchmarks/Olden/mst/mst: 12.54% (0.1316 => 0.1481, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: 10.85% (4.1592 => 4.6106, std.dev.: 0.1225) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 10.58% (1.3438 => 1.4860, std.dev.: 0.0494) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.19% (7.0875 => 7.6680, std.dev.: 0.0130) MultiSource/Applications/sqlite3/sqlite3: 3.78% (4.5888 => 4.7622, std.dev.: 0.0148) MultiSource/Benchmarks/Olden/em3d/em3d: 2.85% (3.1108 => 3.1996, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.57% (2.3123 => 2.3486, std.dev.: 0.0035) MultiSource/Applications/SIBsim4/SIBsim4: 1.37% (3.8670 => 3.9201, std.dev.: 0.0113) SingleSource/Benchmarks/LivermoreLoops/kernel14: 1.03% (1.5634 => 1.5795, std.dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.70% (69.5645 => 69.0787, std.dev.: 0.5297) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -1.83% (0.1364 => 0.1339, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0421 => 0.0421, std.dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.91% (0.0658 => 0.0652, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -0.06% (494.0533 => 493.7508, std.dev.: 0.2990) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.23% (63.2438 => 69.0787, std.dev.: 0.5297) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0421, std.dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43683.88% (1.1277 => 493.7508, std.dev.: 0.2990) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 193.33% (0.5229 => 1.5338, std.dev.: 0.1117) MultiSource/Applications/SPASS/SPASS: 19.57% (14.9895 => 17.9227, std.dev.: 0.1737) MultiSource/Applications/kimwitu++/kc: 52.60% (14.1553 => 21.6015, std.dev.: 0.0710) MultiSource/Benchmarks/MallocBench/gs/gs: 14.41% (4.1105 => 4.7029, std.dev.: 0.1767) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.45% (1.1048 => 1.5075, std.dev.: 0.0662) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.08% (7.1582 => 37.5144, std.dev.: 0.6821) SingleSource/Benchmarks/Misc-C++-EH/spirit: 74.50% (3.4629 => 6.0429, std.dev.: 0.2721) SingleSource/Benchmarks/Misc-C++/stepanov_container: 64.91% (0.6222 => 1.0261, std.dev.: 0.0609) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10406.94% (0.0720 => 7.5650, std.dev.: 0.2565) MultiSource/Applications/SIBsim4/SIBsim4: 3920000.00% (0.0001 => 3.9201, std.dev.: 0.0113) MultiSource/Applications/SPASS/SPASS: 14235700.00% (0.0001 => 14.2358, std.dev.: 1.6106) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 577000.00% (0.0001 => 0.5771, std.dev.: 0.0283) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10076100.00% (0.0001 => 10.0762, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7667900.00% (0.0001 => 7.6680, std.dev.: 0.0130) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1787.72% (1.1194 => 21.1311, std.dev.: 0.4564) MultiSource/Applications/ClamAV/clamscan: 69.43% (22.1758 => 37.5721, std.dev.: 0.5163) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 60.89% (7.0540 => 11.3494, std.dev.: 0.2011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.30% (2.9384 => 4.6222, std.dev.: 0.3278) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.94% (8.1363 => 12.2807, std.dev.: 0.2191) MultiSource/Applications/JM/lencod/lencod: 47.02% (21.9371 => 32.2529, std.dev.: 0.1078) MultiSource/Benchmarks/FreeBench/distray/distray: 45.55% (0.1056 => 0.1537, std.dev.: 0.0093) SingleSource/UnitTests/vla: 41.97% (0.0355 => 0.0504, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 38.20% (0.1432 => 0.1979, std.dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/almabench: 37.95% (0.0730 => 0.1007, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/n-body: 33.65% (0.0746 => 0.0997, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Oscar: 31.76% (0.0636 => 0.0838, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.47% (1.5859 => 2.0533, std.dev.: 0.0157) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 28.44% (0.1125 => 0.1445, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/dot-syntax-1: 28.39% (0.0479 => 0.0615, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 27.80% (0.7115 => 0.9093, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: 27.32% (0.0871 => 0.1109, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 26.86% (0.1940 => 0.2461, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 26.65% (0.0953 => 0.1207, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.58% (0.5105 => 0.6462, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/mst/mst: 26.48% (0.1163 => 0.1471, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/matrix: 25.92% (0.0818 => 0.1030, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 25.48% (0.7835 => 0.9831, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/reversefile: 25.43% (0.3865 => 0.4848, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/wordfreq: 25.25% (0.3307 => 0.4142, std.dev.: 0.0029) MultiSource/Applications/d/make_dparser: 24.32% (3.3354 => 4.1465, std.dev.: 0.0670) SingleSource/Benchmarks/Stanford/Towers: 23.99% (0.0471 => 0.0584, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_isamax: 23.72% (0.0704 => 0.0871, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 23.67% (0.0528 => 0.0653, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary3: 22.75% (0.3283 => 0.4030, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/bc/bc: 22.68% (1.1861 => 1.4551, std.dev.: 0.0139) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.54% (0.0457 => 0.0560, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 22.48% (0.3684 => 0.4512, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/except: 22.33% (0.2871 => 0.3512, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/08-main/main: 22.24% (0.2554 => 0.3122, std.dev.: 0.0209) SingleSource/Benchmarks/Shootout-C++/spellcheck: 22.08% (0.4203 => 0.5131, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary2: 21.99% (0.3379 => 0.4122, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/matrix: 21.98% (0.3098 => 0.3779, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/fibo: 21.98% (0.2725 => 0.3324, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 21.89% (0.8101 => 0.9874, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/strcat: 21.79% (0.2831 => 0.3448, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sumcol: 21.62% (0.2891 => 0.3516, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/life/life: 21.44% (0.0933 => 0.1133, std.dev.: 0.0030) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.33% (0.1566 => 0.1900, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.30% (0.1695 => 0.2056, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sieve: 21.12% (0.3603 => 0.4364, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.99% (0.0886 => 0.1072, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.68% (0.0793 => 0.0957, std.dev.: 0.0050) SingleSource/UnitTests/SignlessTypes/rem: 20.45% (0.1144 => 0.1378, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 20.42% (0.4103 => 0.4941, std.dev.: 0.0138) MultiSource/Benchmarks/Ptrdist/ks/ks: 20.40% (0.1510 => 0.1818, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wc: 20.28% (0.3052 => 0.3671, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.27% (0.1584 => 0.1905, std.dev.: 0.0066) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.18% (0.8172 => 0.9821, std.dev.: 0.0224) MultiSource/Applications/lemon/lemon: 20.12% (1.0722 => 1.2879, std.dev.: 0.0332) MultiSource/Benchmarks/Olden/tsp/tsp: 20.09% (0.1175 => 0.1411, std.dev.: 0.0064) SingleSource/UnitTests/SignlessTypes/Large/cast: 19.33% (0.0564 => 0.0673, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.22% (0.1337 => 0.1594, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 19.00% (14.3668 => 17.0960, std.dev.: 0.3174) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.78% (0.2700 => 0.3207, std.dev.: 0.0176) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.67% (0.0648 => 0.0769, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.57% (1.5415 => 1.8277, std.dev.: 0.0618) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.55% (4.2646 => 5.0558, std.dev.: 0.1384) SingleSource/Regression/C++/ofstream_ctor: 18.45% (0.2905 => 0.3441, std.dev.: 0.0049) MultiSource/Applications/treecc/treecc: 17.80% (2.0273 => 2.3881, std.dev.: 0.0955) SingleSource/UnitTests/ObjC/exceptions-4: 17.56% (0.3543 => 0.4165, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions-2: 17.53% (0.3497 => 0.4110, std.dev.: 0.0075) SingleSource/Benchmarks/Stanford/Puzzle: 17.35% (0.1268 => 0.1488, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-3: 17.29% (0.3516 => 0.4124, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.10% (0.0842 => 0.0986, std.dev.: 0.0051) MultiSource/Applications/lua/lua: 16.65% (3.8723 => 4.5171, std.dev.: 0.0885) MultiSource/Benchmarks/Olden/health/health: 16.32% (0.1268 => 0.1475, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/methcall: 16.23% (0.2877 => 0.3344, std.dev.: 0.0084) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.71% (0.0834 => 0.0965, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.59% (0.2065 => 0.2387, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.32% (0.0770 => 0.0888, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.20% (4.9449 => 5.6964, std.dev.: 0.1895) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.94% (0.0770 => 0.0885, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.86% (0.1117 => 0.1283, std.dev.: 0.0047) MultiSource/Applications/viterbi/viterbi: 14.73% (0.1555 => 0.1784, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 14.60% (0.1151 => 0.1319, std.dev.: 0.0065) MultiSource/Applications/oggenc/oggenc: 14.34% (5.7591 => 6.5848, std.dev.: 0.1923) MultiSource/Applications/hbd/hbd: 13.88% (1.5603 => 1.7768, std.dev.: 0.0107) MultiSource/Applications/sqlite3/sqlite3: 13.74% (17.1811 => 19.5415, std.dev.: 0.3269) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.73% (0.5981 => 0.6802, std.dev.: 0.0281) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.70% (0.1029 => 0.1170, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 13.46% (9.4845 => 10.7607, std.dev.: 0.3548) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.29% (5.0018 => 5.6667, std.dev.: 0.2057) MultiSource/Applications/sgefa/sgefa: 13.09% (0.3109 => 0.3516, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.99% (0.3441 => 0.3888, std.dev.: 0.0166) SingleSource/UnitTests/ObjC/parameter-passing: 12.78% (0.3927 => 0.4429, std.dev.: 0.0176) SingleSource/UnitTests/ObjC/trivial-interface: 12.24% (0.3473 => 0.3898, std.dev.: 0.0146) SingleSource/UnitTests/ObjC/synchronized: 12.16% (0.3561 => 0.3994, std.dev.: 0.0157) MultiSource/Benchmarks/nbench/nbench: 11.84% (1.1840 => 1.3242, std.dev.: 0.0496) MultiSource/Benchmarks/Olden/power/power: 11.60% (0.1440 => 0.1607, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.18% (0.1906 => 0.2119, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/block-byref-aggr: 10.32% (0.3817 => 0.4211, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/football/football: 10.07% (0.8921 => 0.9819, std.dev.: 0.0267) MultiSource/Benchmarks/sim/sim: 9.86% (0.3387 => 0.3721, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.60% (0.2872 => 0.3119, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.52% (2.2022 => 2.3899, std.dev.: 0.0726) MultiSource/Benchmarks/PAQ8p/paq8p: 8.12% (10.3673 => 11.2094, std.dev.: 0.2567) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.71% (0.4879 => 0.5255, std.dev.: 0.0126) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.31% (4.3953 => 11.0017, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/methcall: 147.43% (5.3999 => 13.3609, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary3: 26.79% (3.7221 => 4.7191, std.dev.: 0.2124) SingleSource/Benchmarks/Shootout/ary3: 24.63% (3.6994 => 4.6106, std.dev.: 0.1225) SingleSource/Benchmarks/Shootout-C++/ary2: 21.40% (0.0757 => 0.0919, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.42% (1.2838 => 1.5331, std.dev.: 0.0852) SingleSource/Benchmarks/Shootout-C++/ary: 18.25% (0.0756 => 0.0894, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 17.48% (6.6465 => 7.8080, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.85% (1.1145 => 1.3023, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/lpbench: 16.33% (10.3460 => 12.0356, std.dev.: 0.4011) MultiSource/Benchmarks/Olden/mst/mst: 15.25% (0.1285 => 0.1481, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 13.91% (1.3045 => 1.4860, std.dev.: 0.0494) MultiSource/Applications/JM/ldecod/ldecod: 13.41% (0.1298 => 0.1472, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.08% (0.2944 => 0.3329, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.65% (2.8904 => 3.2271, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 10.30% (1.1396 => 1.2570, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.85% (8.6802 => 9.5354, std.dev.: 0.2445) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.30% (1.7254 => 1.8859, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.53% (4.2280 => 4.4620, std.dev.: 0.0167) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 5.11% (26.0924 => 27.4269, std.dev.: 0.1857) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.62% (3.6395 => 3.8077, std.dev.: 0.0382) MultiSource/Benchmarks/nbench/nbench: 4.00% (11.6436 => 12.1097, std.dev.: 0.0180) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 3.14% (3.1023 => 3.1996, std.dev.: 0.0077) MultiSource/Applications/sqlite3/sqlite3: 2.54% (4.6441 => 4.7622, std.dev.: 0.0148) SingleSource/Benchmarks/Dhrystone/dry: 2.21% (2.4116 => 2.4650, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.15% (1.3677 => 1.3971) MultiSource/Applications/aha/aha: 2.05% (3.1595 => 3.2242, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 2.02% (85.0658 => 86.7846, std.dev.: 0.1302) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2797, std.dev.: 0.0313) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.52% (2.3135 => 2.3486, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.46% (6.5088 => 6.6036, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sieve: 1.42% (2.4858 => 2.5210, std.dev.: 0.0104) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.32% (5.2139 => 5.2825, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/perlin: 1.19% (5.9798 => 6.0509, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 1.02% (2.9346 => 2.9644, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1676, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.68% (5.2763 => 1.2305, std.dev.: 0.0413) SingleSource/Benchmarks/Misc/salsa20: -74.58% (0.8651 => 0.2199, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -38.22% (0.1622 => 0.1002, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.28% (5.3526 => 4.6952, std.dev.: 0.1605) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -9.86% (1.7609 => 1.5872, std.dev.: 0.0612) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.71% (5.3855 => 5.0240, std.dev.: 0.0274) MultiSource/Applications/JM/ldecod/ldecod: -4.73% (10.4361 => 9.9421, std.dev.: 0.1377) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.33% (0.3987 => 0.2379, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.34% (4.5009 => 2.7754, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.11% (2.6546 => 2.0145, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -19.76% (0.2161 => 0.1734, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.75% (1.6925 => 1.4259, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2839, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.78% (32.5116 => 29.0073, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/mandel-2: -10.65% (1.5373 => 1.3736, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -10.51% (9.5636 => 8.5585, std.dev.: 0.2176) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.02% (1.5660 => 1.4248, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.95% (1.6805 => 1.5469, std.dev.: 0.0323) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.95% (4.8142 => 4.4798, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.77% (3.2416 => 3.0221, std.dev.: 0.0260) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.75% (19.9488 => 19.0016, std.dev.: 0.1780) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5096, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -4.35% (6.2999 => 6.0261, std.dev.: 0.0111) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8914, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.93% (0.9957 => 0.9665, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.31% (0.4808 => 0.4697, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.80% (8.1563 => 8.0093, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -1.47% (10.2830 => 10.1315, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0013) Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 22 09:02:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 22 Nov 2012 11:02:03 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121122170203.9D1F22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6149?compare_to=6146&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6149, Order: 168500, Start Time: 2012-11-22 15:29:43, End Time: 2012-11-22 17:02:31 To: 6146, Order: 168493, Start Time: 2012-11-22 13:36:29, End Time: 2012-11-22 15:11:02 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 7 (60 on baseline) Performance Improvements: 2 (20 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1045 (894 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 4.39% (0.3189 => 0.3329, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.29% (0.8537 => 0.8818, std.dev.: 0.0097) MultiSource/Applications/spiff/spiff: 1.32% (0.8309 => 0.8419, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 9.76% (1.2720 => 1.3962, std.dev.: 0.0171) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.54% (1.3583 => 1.4064, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/pi: 2.47% (2.4249 => 2.4847, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.35% (9.6729 => 9.8037, std.dev.: 0.0435) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/lists1: -5.26% (0.3215 => 0.3046, std.dev.: 0.0036) MultiSource/Applications/hbd/hbd: -1.65% (1.5029 => 1.4781, std.dev.: 0.0067) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.18% (1.0885 => 1.0757, std.dev.: 0.2072) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -15.76% (0.0184 => 0.0155, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -14.60% (0.0411 => 0.0351, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.64% (0.0332 => 0.0300, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.64% (0.0312 => 0.0314, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0423 => 0.0425) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0203 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0217 => 0.0217, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.15% (0.1477 => 0.1494, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: -0.20% (1.1380 => 1.1357, std.dev.: 0.0477) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.78% (0.4309 => 0.4189, std.dev.: 0.0280) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.21% (0.1424 => 0.1421, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.48% (0.0612 => 0.0554, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.84% (0.0272 => 0.0277, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.20% (0.0553 => 0.0626, std.dev.: 0.0153) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.27% (1.2111 => 1.1957, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -83.33% (0.0024 => 0.0004, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.45% (0.0647 => 0.0560, std.dev.: 0.0144) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.86% (0.0237 => 0.0216, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.54% (0.7821 => 0.7779, std.dev.: 0.0048) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 25.45% (0.0055 => 0.0069, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 6.71% (16.4461 => 17.5489, std.dev.: 0.5747) MultiSource/Applications/sqlite3/sqlite3: 2308.51% (0.6332 => 15.2507, std.dev.: 0.2170) MultiSource/Benchmarks/McCat/08-main/main: 46.81% (0.1831 => 0.2688, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.26% (0.1559 => 0.1477, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7051.97% (0.3123 => 22.3356, std.dev.: 0.9340) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.49% (0.2463 => 0.3682, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1523.12% (0.3344 => 5.4277, std.dev.: 0.0793) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.29% (0.2364 => 0.3222, std.dev.: 0.0237) SingleSource/Benchmarks/Misc-C++/bigfib: 4.08% (0.6010 => 0.6255, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.38% (0.3266 => 0.3409, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/strcat: 3.10% (0.1969 => 0.2030, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.80% (0.0224 => 0.0237, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -30.43% (0.0230 => 0.0160, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0484, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 10.12% (0.1462 => 0.1610, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4647, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0721, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4933, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5153, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.4807, std.dev.: 0.3248) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3150, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1316, std.dev.: 0.0181) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3621, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4074, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0809, std.dev.: 0.0042) SingleSource/Regression/C/uint64_to_float: -23.85% (2.1832 => 1.6624, std.dev.: 0.0059) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0007, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.42% (0.0810 => 0.0943, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.01% (0.0773 => 0.0889, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: 14.48% (0.1112 => 0.1273, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.10% (0.0830 => 0.0947, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.97% (0.0848 => 0.0958, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.22% (0.8148 => 0.8818, std.dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.77% (0.1905 => 0.2053, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.77% (0.2240 => 0.2414, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.37% (0.2279 => 0.2447, std.dev.: 0.0020) MultiSource/Applications/viterbi/viterbi: 6.98% (0.1577 => 0.1687, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 6.51% (0.1721 => 0.1833, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: 5.90% (0.7950 => 0.8419, std.dev.: 0.0037) MultiSource/Applications/Burg/burg: 5.65% (1.2222 => 1.2913, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.25% (0.2519 => 0.2626, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.08% (0.3115 => 0.3242, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.03% (0.6227 => 0.6478, std.dev.: 0.0084) MultiSource/Applications/lua/lua: 3.98% (3.8189 => 3.9710, std.dev.: 0.0306) MultiSource/Applications/sgefa/sgefa: 3.83% (0.2999 => 0.3114, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 3.59% (1.4269 => 1.4781, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.29% (0.8597 => 0.8880, std.dev.: 0.0051) MultiSource/Applications/SPASS/SPASS: 3.23% (14.2605 => 14.7212, std.dev.: 0.0898) MultiSource/Benchmarks/McCat/05-eks/eks: 3.21% (0.4397 => 0.4538, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.18% (0.4559 => 0.4704, std.dev.: 0.0043) MultiSource/Applications/ClamAV/clamscan: 3.08% (14.7684 => 15.2231, std.dev.: 0.1151) MultiSource/Applications/SIBsim4/SIBsim4: 2.90% (1.2568 => 1.2932, std.dev.: 0.0130) MultiSource/Applications/siod/siod: 2.76% (2.2184 => 2.2796, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 2.74% (0.6834 => 0.7021, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 2.72% (6.7320 => 6.9151, std.dev.: 0.0635) MultiSource/Applications/d/make_dparser: 2.54% (3.2366 => 3.3189, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.47% (1.1170 => 1.1446, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.27% (0.5191 => 0.5309, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 1.67% (1.0945 => 1.1128, std.dev.: 0.0071) MultiSource/Applications/hexxagon/hexxagon: 1.59% (0.9810 => 0.9966, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 118.59% (0.0199 => 0.0435, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/pi: 57.31% (1.5795 => 2.4847, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.44% (0.7597 => 0.8922, std.dev.: 0.0222) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.35% (2.9753 => 3.4617, std.dev.: 0.0254) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.67% (2.7995 => 3.2103, std.dev.: 0.0680) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.58% (5.0261 => 5.6082, std.dev.: 0.0039) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.89% (1.2822 => 1.3962, std.dev.: 0.0171) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.97% (1.1857 => 1.2802, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 7.38% (1.7056 => 1.8314, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.75% (4.7794 => 5.1021, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/richards_benchmark: 6.70% (1.3037 => 1.3911, std.dev.: 0.0052) MultiSource/Applications/SIBsim4/SIBsim4: 5.92% (3.1873 => 3.3761, std.dev.: 0.0298) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.82% (6.2275 => 6.5277, std.dev.: 0.0076) MultiSource/Applications/lambda-0_1_3/lambda: 4.17% (7.4933 => 7.8061, std.dev.: 0.0473) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.07% (4.9453 => 5.1465, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.05% (4.9469 => 5.1471, std.dev.: 0.0256) MultiSource/Applications/hexxagon/hexxagon: 3.89% (14.0064 => 14.5512, std.dev.: 0.0982) MultiSource/Applications/siod/siod: 2.86% (3.6643 => 3.7692, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.68% (8.2783 => 8.5003, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/lists: 2.51% (7.3375 => 7.5219, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.31% (4.8660 => 4.9786, std.dev.: 0.0143) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.31% (1.1365 => 1.1627, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/FloatMM: 1.44% (0.8807 => 0.8934, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/power/power: 1.43% (1.2061 => 1.2234, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 1.39% (8.5322 => 8.6505, std.dev.: 0.0104) MultiSource/Benchmarks/FreeBench/neural/neural: 1.32% (1.0841 => 1.0984, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.14% (3.5679 => 3.6086, std.dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.03% (5.4641 => 4.3150, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.38% (7.2130 => 6.2478, std.dev.: 0.3614) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.50% (1.0512 => 0.9303, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: -10.55% (1.1216 => 1.0033, std.dev.: 0.0381) MultiSource/Benchmarks/mafft/pairlocalalign: -8.56% (63.1822 => 57.7742, std.dev.: 0.1080) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.48% (14.6451 => 13.5502, std.dev.: 0.2346) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.85% (4.7482 => 4.4230, std.dev.: 0.0598) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.88% (3.7148 => 3.4962, std.dev.: 0.0237) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.82% (5.4972 => 5.1770, std.dev.: 0.0244) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.11% (5.1557 => 4.8923, std.dev.: 0.0410) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.32% (4.7449 => 4.5397, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.72% (6.0224 => 5.7983, std.dev.: 0.0103) MultiSource/Applications/lua/lua: -3.26% (29.8330 => 28.8604, std.dev.: 0.3097) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.96% (0.5807 => 0.5635, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.91% (28.5821 => 27.7496, std.dev.: 0.0553) MultiSource/Benchmarks/FreeBench/mason/mason: -2.81% (0.5415 => 0.5263, std.dev.: 0.0044) MultiSource/Applications/aha/aha: -2.46% (3.3398 => 3.2578, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -2.28% (3.4237 => 3.3455, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.00% (11.5316 => 11.3012, std.dev.: 0.0263) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.13% (5.6343 => 5.5705, std.dev.: 0.0171) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.82% (1.0262 => 1.0757, std.dev.: 0.2072) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 26.02% (0.0123 => 0.0155, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -13.97% (0.0408 => 0.0351, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 18.11% (0.0254 => 0.0300, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 3.89% (0.1438 => 0.1494, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 0.25% (1.1329 => 1.1357, std.dev.: 0.0477) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.60% (0.4164 => 0.4189, std.dev.: 0.0280) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.80% (0.1369 => 0.1421, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -13.57% (0.0641 => 0.0554, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.30% (0.0578 => 0.0626, std.dev.: 0.0153) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.55% (1.1437 => 1.1957, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -71.43% (0.0014 => 0.0004, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.69% (0.0627 => 0.0560, std.dev.: 0.0144) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 20.00% (0.0180 => 0.0216, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.97% (0.8017 => 0.7779, std.dev.: 0.0048) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 11.29% (0.0062 => 0.0069, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 22 09:17:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 22 Nov 2012 11:17:45 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121122171745.512312A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6150?compare_to=6147&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6150, Order: 168500, Start Time: 2012-11-22 15:44:37, End Time: 2012-11-22 17:18:12 To: 6147, Order: 168495, Start Time: 2012-11-22 13:48:12, End Time: 2012-11-22 15:21:33 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (180 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (858 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.96% (2.0478 => 2.1084, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: 2.58% (7.4937 => 7.6874, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/hash2: 2.28% (3.1932 => 3.2661, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.22% (0.1431 => 0.1299, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.24% (0.3821 => 0.3506, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -7.01% (2.4924 => 2.3176, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.00% (0.3142 => 0.2922, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -6.92% (0.3831 => 0.3566, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.89% (0.9542 => 0.8885, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.88% (0.3357 => 0.3126, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.86% (0.3848 => 0.3584, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: -6.86% (0.3880 => 0.3614, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: -6.85% (0.3896 => 0.3629, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: -6.72% (0.4033 => 0.3762, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: -6.72% (0.3812 => 0.3556, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.58% (0.3891 => 0.3635, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.55% (0.2428 => 0.2269, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.51% (0.4176 => 0.3904, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.45% (0.2355 => 0.2203, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.44% (0.1584 => 0.1482, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: -6.44% (0.2160 => 0.2021, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.37% (9.2283 => 8.6405, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.34% (0.6484 => 0.6073, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -6.33% (0.4199 => 0.3933, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: -6.30% (7.0961 => 6.6489, std.dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: -6.29% (16.1920 => 15.1742, std.dev.: 0.0121) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.23% (0.3884 => 0.3642, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.22% (1.3722 => 1.2868, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/football/football: -6.20% (0.9179 => 0.8610, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.18% (0.9852 => 0.9243, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.18% (0.1796 => 0.1685, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -6.17% (0.1879 => 0.1763, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.15% (0.3658 => 0.3433, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.12% (1.0544 => 0.9899, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.06% (0.1716 => 0.1612, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.03% (6.7716 => 6.3631, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.02% (4.8161 => 4.5262, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: -6.00% (0.4280 => 0.4023, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.99% (4.0323 => 3.7908, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.99% (1.6364 => 1.5384, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.97% (0.5863 => 0.5513, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.95% (3.5339 => 3.3236, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.93% (1.2300 => 1.1570, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.90% (0.5591 => 0.5261, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.89% (1.4642 => 1.3779, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -5.85% (0.1761 => 0.1658, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.84% (0.5705 => 0.5372, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: -5.84% (4.3330 => 4.0801, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.83% (0.6293 => 0.5926, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.82% (0.5805 => 0.5467, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.81% (4.8802 => 4.5965, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.81% (0.5478 => 0.5160, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: -5.79% (1.1530 => 1.0862, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.78% (0.6052 => 0.5702, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -5.75% (1.2515 => 1.1796, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.75% (0.5570 => 0.5250, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -5.74% (1.1450 => 1.0793, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.73% (0.6230 => 0.5873, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/bh/bh: -5.73% (0.2985 => 0.2814, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.73% (0.5849 => 0.5514, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.72% (0.6446 => 0.6077, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.72% (0.5857 => 0.5522, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.72% (0.5859 => 0.5524, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.71% (0.6667 => 0.6286, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.71% (0.6660 => 0.6280, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.70% (0.7919 => 0.7468, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.69% (0.5575 => 0.5258, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.68% (1.2784 => 1.2058, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.68% (0.2695 => 0.2542, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.67% (0.5802 => 0.5473, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -5.67% (0.4515 => 0.4259, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.67% (0.6194 => 0.5843, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.67% (0.3406 => 0.3213, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.65% (0.5925 => 0.5590, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.64% (0.6736 => 0.6356, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.63% (4.5069 => 4.2532, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.63% (0.5456 => 0.5149, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.63% (0.5581 => 0.5267, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.62% (0.6304 => 0.5950, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -5.59% (0.3025 => 0.2856, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -5.58% (17.1032 => 16.1494, std.dev.: 0.0143) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.57% (0.2548 => 0.2406, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.57% (0.7198 => 0.6797, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.57% (0.5999 => 0.5665, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.56% (0.3057 => 0.2887, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.56% (0.6260 => 0.5912, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.54% (0.6189 => 0.5846, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.53% (0.3837 => 0.3625, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -5.52% (15.5079 => 14.6513, std.dev.: 0.0151) MultiSource/Applications/SIBsim4/SIBsim4: -5.52% (1.3864 => 1.3099, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.51% (0.2903 => 0.2743, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.51% (0.6681 => 0.6313, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: -5.50% (0.2871 => 0.2713, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.50% (8.0126 => 7.5722, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.48% (14.2083 => 13.4295, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/random: -5.48% (0.2939 => 0.2778, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: -5.47% (0.3581 => 0.3385, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: -5.47% (1.3148 => 1.2429, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.46% (0.4813 => 0.4550, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.45% (0.3194 => 0.3020, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.44% (0.3931 => 0.3717, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -5.44% (0.3255 => 0.3078, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.44% (0.3016 => 0.2852, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.44% (0.5941 => 0.5618, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.44% (0.2999 => 0.2836, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.43% (2.1713 => 2.0534, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.41% (0.6676 => 0.6315, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.39% (0.6440 => 0.6093, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.39% (0.8521 => 0.8062, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.37% (0.3483 => 0.3296, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.36% (0.2278 => 0.2156, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: -5.35% (0.3026 => 0.2864, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.34% (0.5688 => 0.5384, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hello: -5.34% (0.2849 => 0.2697, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.33% (0.4916 => 0.4654, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.32% (0.2933 => 0.2777, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -5.30% (0.3205 => 0.3035, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.30% (0.6033 => 0.5713, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.30% (0.3849 => 0.3645, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.30% (0.4151 => 0.3931, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.29% (1.2210 => 1.1564, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.25% (1.6474 => 1.5609, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.24% (0.2385 => 0.2260, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: -5.22% (3.5154 => 3.3319, std.dev.: 0.0020) MultiSource/Applications/lua/lua: -5.18% (4.0594 => 3.8491, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.17% (0.5168 => 0.4901, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: -5.12% (0.2989 => 0.2836, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -5.10% (0.4861 => 0.4613, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -5.10% (0.3394 => 0.3221, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -5.09% (0.7447 => 0.7068, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -5.07% (15.2527 => 14.4789, std.dev.: 0.0085) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.06% (0.3319 => 0.3151, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.06% (1.2221 => 1.1603, std.dev.: 0.0025) MultiSource/Applications/siod/siod: -5.05% (2.4021 => 2.2807, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.02% (22.4056 => 21.2812, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/moments: -5.01% (0.4248 => 0.4035, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.00% (0.6395 => 0.6075, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.00% (0.7021 => 0.6670, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -5.00% (0.3621 => 0.3440, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.00% (0.2001 => 0.1901, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.96% (0.7524 => 0.7151, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.95% (0.4083 => 0.3881, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.95% (0.7339 => 0.6976, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -4.94% (2.1401 => 2.0343, std.dev.: 0.0029) SingleSource/Regression/C++/ofstream_ctor: -4.94% (0.3059 => 0.2908, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.92% (0.9557 => 0.9087, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: -4.88% (0.3446 => 0.3278, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.86% (0.5329 => 0.5070, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.83% (0.5567 => 0.5298, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: -4.80% (0.3271 => 0.3114, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.80% (0.2106 => 0.2005, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.79% (0.4427 => 0.4215, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.77% (0.3252 => 0.3097, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -4.72% (0.7982 => 0.7605, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.70% (0.5569 => 0.5307, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.67% (0.4321 => 0.4119, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: -4.62% (0.8418 => 0.8029, std.dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: -4.60% (34.0927 => 32.5231, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/sieve: -4.59% (0.3788 => 0.3614, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -4.56% (18.2933 => 17.4596, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.56% (2.2587 => 2.1558, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.53% (0.3491 => 0.3333, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.49% (0.6395 => 0.6108, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/bigfib: -4.47% (0.6750 => 0.6448, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.46% (0.6441 => 0.6154, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: -4.43% (0.6347 => 0.6066, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.25% (0.9077 => 0.8691, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -4.22% (0.7779 => 0.7451, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -4.20% (0.4524 => 0.4334, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -3.93% (1.5610 => 1.4996, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: -3.87% (5.0226 => 4.8284, std.dev.: 0.0115) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.81% (5.4682 => 5.2601, std.dev.: 0.0097) SingleSource/UnitTests/Vector/constpool: -2.39% (20.7746 => 20.2772, std.dev.: 0.0175) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7519, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: -8.74% (1.2842 => 1.1719, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fbench: -3.84% (2.2633 => 2.1763, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.58% (1.3096 => 1.2758, std.dev.: 0.0074) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4682, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 22 10:16:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 22 Nov 2012 12:16:07 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121122181607.937502A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6151?compare_to=6145&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6151, Order: 168495, Start Time: 2012-11-22 14:55:30, End Time: 2012-11-22 18:16:33 To: 6145, Order: 168490, Start Time: 2012-11-22 10:46:41, End Time: 2012-11-22 14:07:25 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (170 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1092 (721 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 45.44% (0.0625 => 0.0909, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.81% (0.1063 => 0.1433, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 27.02% (1.5932 => 2.0237, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.43% (0.4253 => 0.5377, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.41% (0.2969 => 0.3753, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.86% (0.1106 => 0.1392, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.07% (0.0714 => 0.0893, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.69% (0.4139 => 0.5161, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.85% (0.4994 => 0.6185, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.83% (0.5900 => 0.7306, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.37% (0.0475 => 0.0586, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.06% (0.5000 => 0.6153, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.77% (0.0584 => 0.0717, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.67% (0.0547 => 0.0671, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.91% (0.1620 => 0.1975, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.85% (0.0897 => 0.1093, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.84% (0.1021 => 0.1244, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.68% (0.1107 => 0.1347, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.38% (0.0633 => 0.0762, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 20.36% (0.0948 => 0.1141, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.22% (0.1103 => 0.1326, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.21% (0.0584 => 0.0702, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.11% (0.3903 => 0.4688, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.09% (0.0642 => 0.0771, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 19.73% (0.0821 => 0.0983, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.69% (0.1549 => 0.1854, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.64% (0.1003 => 0.1200, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.64% (0.1604 => 0.1919, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.46% (0.0822 => 0.0982, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 19.46% (0.1619 => 0.1934, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 19.37% (0.0604 => 0.0721, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.81% (0.1462 => 0.1737, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 18.59% (0.0947 => 0.1123, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.35% (0.3890 => 0.4604, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 18.32% (0.0808 => 0.0956, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.97% (0.2014 => 0.2376, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 17.73% (0.1218 => 0.1434, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.54% (0.2736 => 0.3216, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.43% (0.1968 => 0.2311, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.43% (1.3152 => 1.5444, std.dev.: 0.0063) MultiSource/Applications/spiff/spiff: 17.42% (0.4029 => 0.4731, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 17.39% (0.5826 => 0.6839, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 17.34% (0.0698 => 0.0819, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 17.29% (0.5889 => 0.6907, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.28% (0.1088 => 0.1276, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 17.21% (0.1505 => 0.1764, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.03% (0.2866 => 0.3354, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.97% (0.3271 => 0.3826, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 16.82% (0.5546 => 0.6479, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 16.69% (0.0605 => 0.0706) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.57% (0.5026 => 0.5859, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 16.49% (1.8794 => 2.1893, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.39% (3.5627 => 4.1468, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.34% (0.4658 => 0.5419, std.dev.: 0.0025) MultiSource/Applications/hbd/hbd: 16.33% (0.9697 => 1.1281, std.dev.: 0.0079) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.20% (1.6211 => 1.8837, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.12% (0.1160 => 0.1347, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 16.04% (1.0781 => 1.2510, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.00% (0.2875 => 0.3335, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 15.83% (0.1421 => 0.1646, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.64% (0.4361 => 0.5043, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.61% (2.7292 => 3.1551, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.60% (0.3930 => 0.4543, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.46% (4.4195 => 5.1029, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.41% (0.1090 => 0.1258) SingleSource/Benchmarks/Shootout-C++/strcat: 15.38% (0.2750 => 0.3173, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 15.36% (0.9909 => 1.1431, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: 15.34% (0.1284 => 0.1481, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.30% (0.2738 => 0.3157, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/fibo: 15.30% (0.2725 => 0.3142, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 15.25% (0.2714 => 0.3128, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 15.25% (0.3004 => 0.3462, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 15.24% (4.2109 => 4.8528, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.24% (0.2729 => 0.3145, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 15.22% (0.2780 => 0.3203, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/except: 15.08% (0.2811 => 0.3235, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.08% (0.2792 => 0.3213, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 15.06% (0.7171 => 0.8251, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/random: 15.06% (0.2803 => 0.3225, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 15.02% (0.2823 => 0.3247, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.01% (0.2911 => 0.3348, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 15.00% (0.2813 => 0.3235, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.96% (0.3195 => 0.3673, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.90% (2.0673 => 2.3754, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.88% (1.9694 => 2.2625, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 14.80% (0.2075 => 0.2382, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wc: 14.79% (0.3096 => 0.3554, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary3: 14.57% (0.3267 => 0.3743, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.53% (1.9966 => 2.2868, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 14.49% (0.3258 => 0.3730, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 14.41% (0.3317 => 0.3795, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.34% (0.3124 => 0.3572, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 14.29% (23.5202 => 26.8813, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.11% (0.3488 => 0.3980, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.08% (0.3060 => 0.3491, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 14.04% (0.4146 => 0.4728, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 13.99% (0.2566 => 0.2925, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.92% (0.3362 => 0.3830, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 13.89% (0.3678 => 0.4189, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/lists: 13.74% (0.3348 => 0.3808, std.dev.: 0.0088) MultiSource/Applications/lua/lua: 13.64% (1.4269 => 1.6215, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.62% (0.3282 => 0.3729, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 13.58% (0.3726 => 0.4232, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.54% (0.3625 => 0.4116, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 13.52% (0.3446 => 0.3912, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 13.46% (0.3477 => 0.3945, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.45% (0.3465 => 0.3931, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.39% (0.3496 => 0.3964, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.31% (0.3690 => 0.4181, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 13.29% (0.3460 => 0.3920, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.29% (0.3469 => 0.3930, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 13.28% (0.7875 => 0.8921, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 13.25% (0.3442 => 0.3898, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 13.17% (0.4251 => 0.4811, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.11% (0.3981 => 0.4503, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.07% (0.3650 => 0.4127, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.00% (0.3845 => 0.4345, std.dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 12.98% (2.1653 => 2.4463, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions: 12.93% (0.3643 => 0.4114, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.84% (0.3724 => 0.4202, std.dev.: 0.0039) MultiSource/Applications/JM/lencod/lencod: 12.64% (4.6177 => 5.2014, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 12.36% (2.1013 => 2.3611, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 12.27% (0.5012 => 0.5627, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.01% (0.2040 => 0.2285, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 11.82% (0.2691 => 0.3009, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.42% (0.6435 => 0.7170, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 11.35% (5.5417 => 6.1707, std.dev.: 0.0144) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.09% (0.1028 => 0.1142, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 10.89% (0.3498 => 0.3879, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.73% (0.6634 => 0.7346, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.70% (0.1383 => 0.1531, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.56% (0.2737 => 0.3026, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.44% (0.2068 => 0.2284, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 10.42% (0.4847 => 0.5352, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.18% (0.3084 => 0.3398, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 9.80% (0.3336 => 0.3663, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 9.55% (2.0346 => 2.2290, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.46% (0.2103 => 0.2302, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 9.41% (0.2391 => 0.2616, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.75% (0.5361 => 0.5830, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.65% (4.6926 => 5.0985, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.16% (11.6398 => 12.5892, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.89% (0.7426 => 0.8012, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.79% (0.5584 => 0.6019, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 6.85% (11.9555 => 12.7745, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.03% (0.3792 => 0.3945, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.78% (0.2802 => 0.3076, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6119, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.89% (0.2122 => 0.2247, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6726, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8939, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1714, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/dry: 4.29% (14.0481 => 14.6512, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1950, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2244, std.dev.: 0.0029) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3037, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2862, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5129, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6019, std.dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5655, std.dev.: 0.0215) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9758, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7923, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary2: -6.58% (0.2402 => 0.2244, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8066, std.dev.: 0.0124) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.02% (0.6293 => 0.6103, std.dev.: 0.0054) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7734, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -2.34% (17.2379 => 16.8346, std.dev.: 0.0352) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8675, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5776, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4963, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.21% (105.3826 => 104.1033, std.dev.: 0.1040) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0416, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 22 10:49:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 22 Nov 2012 12:49:36 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121122184936.9C5A42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6152?compare_to=6149&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6152, Order: 168502, Start Time: 2012-11-22 17:20:11, End Time: 2012-11-22 18:50:04 To: 6149, Order: 168500, Start Time: 2012-11-22 15:29:43, End Time: 2012-11-22 17:02:31 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 4 (111 on baseline) Performance Improvements: 18 (27 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1032 (836 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.99% (58.7297 => 59.8994, std.dev.: 0.4530) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.80% (44.8024 => 45.6096, std.dev.: 0.2090) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.74% (3.9016 => 3.9694, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/pi: 1.01% (2.4847 => 2.5097, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.48% (0.8818 => 0.8335, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.87% (0.6367 => 0.6057, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.35% (0.2414 => 0.2309, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.33% (0.6570 => 0.6351, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -3.00% (0.6661 => 0.6461, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/gs/gs: -3.00% (4.3308 => 4.2009, std.dev.: 0.0312) MultiSource/Applications/spiff/spiff: -2.71% (0.8419 => 0.8191, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.45% (0.9048 => 0.8826, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -2.45% (0.5308 => 0.5178, std.dev.: 0.0044) MultiSource/Applications/Burg/burg: -1.97% (1.2913 => 1.2658, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.75% (4.6270 => 4.5459, std.dev.: 0.0292) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.72% (8.9284 => 8.7752, std.dev.: 0.0402) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: -11.31% (1.3962 => 1.2383, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout/heapsort: -11.31% (3.4171 => 3.0307, std.dev.: 0.0875) SingleSource/Benchmarks/LivermoreLoops/kernel12: -8.67% (0.1199 => 0.1095, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ft/ft: -1.48% (0.8829 => 0.8698, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.39% (9.8037 => 9.6677, std.dev.: 0.0300) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.17% (1.4328 => 1.4161, std.dev.: 0.0047) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -2.81% (1.0757 => 1.0455, std.dev.: 0.0106) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 5.81% (0.0155 => 0.0164, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 21.65% (0.0351 => 0.0427, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -5.00% (0.0300 => 0.0285, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.64% (0.0314 => 0.0316, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.88% (0.0425 => 0.0400, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0204 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -28.11% (0.0217 => 0.0156, std.dev.: 0.0028) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -1.00% (0.1494 => 0.1479, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 4.72% (1.1357 => 1.1893, std.dev.: 0.0139) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.24% (0.4189 => 0.4137, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.03% (0.1421 => 0.1378, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 14.26% (0.0554 => 0.0633, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.64% (0.0277 => 0.0242, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.54% (0.0626 => 0.0560, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.74% (1.1957 => 1.1868, std.dev.: 0.0242) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -12.90% (0.0031 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -75.00% (0.0004 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.89% (0.0560 => 0.0565, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.94% (0.0216 => 0.0201, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.26% (0.7779 => 0.7799, std.dev.: 0.0040) SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 15.94% (0.0069 => 0.0080, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 6.85% (16.4461 => 17.5720, std.dev.: 0.1535) MultiSource/Applications/sqlite3/sqlite3: 2322.24% (0.6332 => 15.3376, std.dev.: 0.0479) MultiSource/Benchmarks/McCat/08-main/main: 48.72% (0.1831 => 0.2723, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.12% (0.1559 => 0.1448, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7078.58% (0.3123 => 22.4187, std.dev.: 0.1823) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.96% (0.2463 => 0.3669, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1530.23% (0.3344 => 5.4515, std.dev.: 0.0371) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.54% (0.2364 => 0.3275, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/bigfib: 4.06% (0.6010 => 0.6254, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: 2.10% (0.0429 => 0.0438, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.38% (0.3266 => 0.3409, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/strcat: 4.62% (0.1969 => 0.2060, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.79% (0.0224 => 0.0228, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -30.43% (0.0230 => 0.0160, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0515, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 9.23% (0.1462 => 0.1597, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4602, std.dev.: 0.0105) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0706, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4950, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5108, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.4811, std.dev.: 0.0205) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3222, std.dev.: 0.0328) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1312, std.dev.: 0.1170) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3631, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4015, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0893, std.dev.: 0.0070) SingleSource/Regression/C/uint64_to_float: -23.80% (2.1832 => 1.6637, std.dev.: 0.0049) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 11.51% (0.1112 => 0.1240, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.60% (0.2279 => 0.2475, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.03% (0.2180 => 0.2355, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.12% (0.7473 => 0.8005, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.83% (0.4847 => 0.5178, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.88% (0.1905 => 0.2017, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.67% (0.6010 => 0.6351, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.50% (0.2998 => 0.3163, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.39% (0.3137 => 0.3306, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.46% (1.1685 => 1.2206, std.dev.: 0.0194) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.29% (0.4783 => 0.4988, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.17% (0.4127 => 0.4299, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.00% (0.3003 => 0.3123, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.92% (0.8321 => 0.8647, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.85% (0.9435 => 0.9798, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.68% (2.1401 => 2.2188, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 3.57% (1.2222 => 1.2658, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.33% (1.1606 => 1.1993, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.19% (1.6386 => 1.6908, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.18% (0.6227 => 0.6425, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.17% (0.8177 => 0.8436, std.dev.: 0.0020) MultiSource/Applications/spiff/spiff: 3.03% (0.7950 => 0.8191, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.01% (0.3717 => 0.3829, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.01% (0.8697 => 0.8959, std.dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.94% (6.6074 => 6.8014, std.dev.: 0.0157) MultiSource/Applications/SIBsim4/SIBsim4: 2.78% (1.2568 => 1.2918, std.dev.: 0.0055) MultiSource/Applications/SPASS/SPASS: 2.72% (14.2605 => 14.6477, std.dev.: 0.0678) MultiSource/Applications/lua/lua: 2.71% (3.8189 => 3.9225, std.dev.: 0.0352) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.69% (1.5315 => 1.5727, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.69% (0.8340 => 0.8564, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.66% (4.4873 => 4.6066, std.dev.: 0.0216) MultiSource/Benchmarks/nbench/nbench: 2.65% (1.1271 => 1.1570, std.dev.: 0.0082) MultiSource/Applications/minisat/minisat: 2.63% (0.6834 => 0.7014, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.59% (0.8007 => 0.8214, std.dev.: 0.0044) MultiSource/Applications/ClamAV/clamscan: 2.58% (14.7684 => 15.1499, std.dev.: 0.0522) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.58% (13.1811 => 13.5214, std.dev.: 0.0786) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.57% (1.1170 => 1.1457, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.53% (3.1832 => 3.2636, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.52% (0.5191 => 0.5322, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.50% (0.8611 => 0.8826, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.49% (0.9908 => 1.0155, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.42% (0.8048 => 0.8243, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.42% (0.9688 => 0.9922, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.41% (0.9074 => 0.9293, std.dev.: 0.0030) MultiSource/Applications/d/make_dparser: 2.40% (3.2366 => 3.3144, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.40% (0.7966 => 0.8157, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.39% (0.9039 => 0.9255, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.35% (0.8086 => 0.8276, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 2.34% (8.6247 => 8.8264, std.dev.: 0.0537) MultiSource/Benchmarks/Bullet/bullet: 2.32% (31.8598 => 32.5977, std.dev.: 0.1337) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.29% (0.8069 => 0.8254, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.28% (0.8855 => 0.9057, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.26% (0.8420 => 0.8610, std.dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 2.22% (15.3280 => 15.6688, std.dev.: 0.0283) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.22% (0.8597 => 0.8788, std.dev.: 0.0071) MultiSource/Applications/siod/siod: 2.20% (2.2184 => 2.2672, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.13% (0.8066 => 0.8238, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.10% (0.8716 => 0.8899, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.09% (0.7932 => 0.8098, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.08% (0.9056 => 0.9244, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.07% (0.8712 => 0.8892, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.04% (0.8656 => 0.8833, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.04% (0.8317 => 0.8487, std.dev.: 0.0057) MultiSource/Benchmarks/PAQ8p/paq8p: 2.04% (2.3764 => 2.4248, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.02% (0.8261 => 0.8428, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.02% (0.6586 => 0.6719, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.89% (1.0945 => 1.1152, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.85% (0.8338 => 0.8492, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.67% (0.8885 => 0.9033, std.dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 1.67% (6.7320 => 6.8441, std.dev.: 0.0428) MultiSource/Applications/oggenc/oggenc: 1.64% (4.9628 => 5.0442, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.58% (0.8316 => 0.8447, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.48% (8.6476 => 8.7752, std.dev.: 0.0402) MultiSource/Applications/hexxagon/hexxagon: 1.47% (0.9810 => 0.9954, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 146.23% (0.0199 => 0.0490, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/pi: 58.89% (1.5795 => 2.5097, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.61% (0.7597 => 0.8859, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.36% (2.9753 => 3.4620, std.dev.: 0.0243) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.42% (2.7995 => 3.2031, std.dev.: 0.0232) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.50% (5.0261 => 5.6041, std.dev.: 0.0114) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.04% (1.1857 => 1.2810, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/queens: 7.42% (1.7056 => 1.8322, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/richards_benchmark: 6.88% (1.3037 => 1.3934, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.71% (4.7794 => 5.1002, std.dev.: 0.0296) MultiSource/Applications/SIBsim4/SIBsim4: 6.08% (3.1873 => 3.3810, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.91% (4.9686 => 5.2624, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.89% (4.5327 => 4.7998, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.77% (6.2275 => 6.5243, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.69% (3.3761 => 3.5344, std.dev.: 0.0211) MultiSource/Applications/lambda-0_1_3/lambda: 4.52% (7.4933 => 7.8317, std.dev.: 0.0524) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.19% (4.9453 => 5.1524, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.11% (4.9469 => 5.1504, std.dev.: 0.0238) MultiSource/Applications/hexxagon/hexxagon: 3.88% (14.0064 => 14.5499, std.dev.: 0.0329) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.58% (1.2337 => 1.2779, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.93% (0.3587 => 0.3692, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.80% (11.5690 => 11.8930, std.dev.: 0.0056) MultiSource/Applications/siod/siod: 2.79% (3.6643 => 3.7666, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.41% (4.8362 => 4.9527, std.dev.: 0.0315) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.37% (8.2783 => 8.4749, std.dev.: 0.0236) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.35% (44.5605 => 45.6096, std.dev.: 0.2090) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.30% (4.8660 => 4.9780, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: 2.16% (7.3375 => 7.4962, std.dev.: 0.0326) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.09% (1.1365 => 1.1602, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.79% (41.4238 => 42.1643, std.dev.: 0.1885) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.76% (3.9006 => 3.9694, std.dev.: 0.0060) MultiSource/Benchmarks/llubenchmark/llu: 1.59% (1.9967 => 2.0284, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/ReedSolomon: 1.20% (8.5322 => 8.6346, std.dev.: 0.0358) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.10% (1.2474 => 1.2611, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/power/power: 1.06% (1.2061 => 1.2189, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.04% (3.5679 => 3.6049, std.dev.: 0.0114) MultiSource/Applications/spiff/spiff: 1.02% (2.8561 => 2.8851, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.07% (5.4641 => 4.3128, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.69% (7.2130 => 6.1536, std.dev.: 0.0921) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.72% (1.0512 => 0.9385, std.dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: -8.51% (63.1822 => 57.8082, std.dev.: 0.0316) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.21% (14.6451 => 13.4433, std.dev.: 0.0454) SingleSource/Benchmarks/Shootout/heapsort: -7.95% (3.2926 => 3.0307, std.dev.: 0.0875) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.88% (4.7482 => 4.4213, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.36% (0.3269 => 0.3061, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.16% (3.7148 => 3.4859, std.dev.: 0.0320) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.88% (5.4972 => 5.1737, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.04% (5.1557 => 4.8956, std.dev.: 0.0066) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.61% (2.8773 => 2.7446, std.dev.: 0.0354) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.37% (4.7449 => 4.5375, std.dev.: 0.0226) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.72% (6.0224 => 5.7983, std.dev.: 0.0247) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.20% (0.5807 => 0.5621, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.05% (28.5821 => 27.7115, std.dev.: 0.0616) MultiSource/Applications/lua/lua: -2.95% (29.8330 => 28.9515, std.dev.: 0.0353) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.93% (2.6356 => 2.5584, std.dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.83% (2.4490 => 2.3796, std.dev.: 0.0200) MultiSource/Applications/aha/aha: -2.44% (3.3398 => 3.2583, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.41% (9.9065 => 9.6677, std.dev.: 0.0300) SingleSource/Benchmarks/Shootout-C++/hash2: -2.33% (3.4237 => 3.3438, std.dev.: 0.0234) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.05% (11.5316 => 11.2947, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.63% (3.2169 => 3.1646, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.57% (4.9994 => 4.9211, std.dev.: 0.0144) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.3487 => 2.3197, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.06% (3.5968 => 3.5587, std.dev.: 0.0135) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.88% (1.0262 => 1.0455, std.dev.: 0.0106) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 33.33% (0.0123 => 0.0164, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 12.20% (0.0254 => 0.0285, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 4.17% (0.0384 => 0.0400, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -13.33% (0.0180 => 0.0156, std.dev.: 0.0028) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.85% (0.1438 => 0.1479, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 4.98% (1.1329 => 1.1893, std.dev.: 0.0139) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.65% (0.4164 => 0.4137, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.66% (0.1369 => 0.1378, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.25% (0.0641 => 0.0633, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 24.10% (0.0195 => 0.0242, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.11% (0.0578 => 0.0560, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.77% (1.1437 => 1.1868, std.dev.: 0.0242) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.89% (0.0627 => 0.0565, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 11.67% (0.0180 => 0.0201, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.72% (0.8017 => 0.7799, std.dev.: 0.0040) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 29.03% (0.0062 => 0.0080, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 22 11:14:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 22 Nov 2012 13:14:50 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121122191450.D80A62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6153?compare_to=6150&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6153, Order: 168502, Start Time: 2012-11-22 17:41:23, End Time: 2012-11-22 19:15:17 To: 6150, Order: 168500, Start Time: 2012-11-22 15:44:37, End Time: 2012-11-22 17:18:12 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (178 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (859 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.36% (54.5789 => 55.8666, std.dev.: 0.3354) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.39% (1.2783 => 1.3728, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1013, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/salsa20: 2.48% (7.4937 => 7.6798, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.37% (54.5751 => 55.8666, std.dev.: 0.3354) SingleSource/Benchmarks/Shootout-C++/hash2: 2.14% (3.1932 => 3.2615, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.72% (0.3821 => 0.3526, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.87% (0.3831 => 0.3568, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -6.85% (0.3812 => 0.3551, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.81% (0.3848 => 0.3586, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: -6.80% (0.3880 => 0.3616, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.66% (0.3891 => 0.3632, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.62% (0.3896 => 0.3638, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: -6.57% (0.4033 => 0.3768, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -6.56% (0.4176 => 0.3902, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.55% (2.4924 => 2.3291, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.46% (0.3357 => 0.3140, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -6.31% (0.4199 => 0.3934, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.28% (0.3884 => 0.3640, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.21% (0.9542 => 0.8949, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.18% (0.2428 => 0.2278, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.10% (9.2283 => 8.6657, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.09% (0.6484 => 0.6089, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -6.05% (7.0961 => 6.6666, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/parameter-passing: -6.05% (0.4280 => 0.4021, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -5.96% (16.1920 => 15.2266, std.dev.: 0.0137) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.94% (0.2355 => 0.2215, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.91% (0.9852 => 0.9270, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.82% (1.0544 => 0.9930, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.82% (0.3658 => 0.3445) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.78% (1.3722 => 1.2929, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/football/football: -5.77% (0.9179 => 0.8649, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.75% (4.8161 => 4.5390, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.75% (6.7716 => 6.3825, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.61% (4.0323 => 3.8062, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.60% (4.8802 => 4.6071, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/gs/gs: -5.59% (4.3330 => 4.0910, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.58% (1.4642 => 1.3825, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.55% (3.5339 => 3.3377, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.55% (1.6364 => 1.5456, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/methcall: -5.52% (0.3025 => 0.2858, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.49% (0.3406 => 0.3219, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.48% (0.6293 => 0.5948, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.47% (0.2871 => 0.2714, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.46% (1.2300 => 1.1629, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.45% (0.2695 => 0.2548, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.45% (4.5069 => 4.2611, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.43% (0.7919 => 0.7489, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: -5.40% (1.1530 => 1.0907, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.40% (0.3057 => 0.2892, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.39% (0.3837 => 0.3630, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.39% (0.5863 => 0.5547, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -5.39% (1.1450 => 1.0833, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -5.39% (0.3194 => 0.3022, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.38% (0.7198 => 0.6811, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.38% (0.2939 => 0.2781, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -5.36% (0.2985 => 0.2825, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.35% (0.2933 => 0.2776, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.35% (0.5591 => 0.5292, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -5.34% (1.3148 => 1.2446, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.30% (0.2903 => 0.2749, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -5.30% (0.2849 => 0.2698, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.29% (0.6667 => 0.6314, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.29% (0.3931 => 0.3723, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.28% (1.2784 => 1.2109, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.28% (2.1713 => 2.0567, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.27% (0.2999 => 0.2841, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.26% (0.5478 => 0.5190, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.25% (0.6052 => 0.5734, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: -5.25% (0.3026 => 0.2867, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -5.25% (0.3255 => 0.3084, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.24% (8.0126 => 7.5925, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/wc: -5.24% (0.3205 => 0.3037, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -5.24% (17.1032 => 16.2069, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.24% (0.5802 => 0.5498, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.24% (0.4813 => 0.4561, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.23% (0.5925 => 0.5615, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.23% (0.6736 => 0.6384, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.22% (0.5857 => 0.5551, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.22% (0.2548 => 0.2415, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.22% (0.5805 => 0.5502, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: -5.22% (1.2515 => 1.1862, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.22% (0.5999 => 0.5686, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.22% (0.6230 => 0.5905, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.21% (0.6446 => 0.6110, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.21% (0.5570 => 0.5280, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.21% (0.3323 => 0.3150, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.21% (14.2083 => 13.4686, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.21% (0.5705 => 0.5408, std.dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.19% (0.4916 => 0.4661, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: -5.18% (0.4515 => 0.4281, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.18% (0.6194 => 0.5873, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.18% (0.6297 => 0.5971, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: -5.18% (15.5079 => 14.7052, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.16% (0.5849 => 0.5547, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.16% (0.6260 => 0.5937, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.15% (0.5575 => 0.5288, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.14% (0.3849 => 0.3651, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.14% (0.5859 => 0.5558, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.11% (0.2659 => 0.2523, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.11% (0.4321 => 0.4100, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.11% (0.5456 => 0.5177, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -5.11% (0.3581 => 0.3398, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.11% (0.4151 => 0.3939, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.11% (0.3016 => 0.2862, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: -5.09% (1.3864 => 1.3158, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.09% (0.2278 => 0.2162, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.09% (0.6304 => 0.5983, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.05% (0.6660 => 0.6324, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -5.03% (0.3059 => 0.2905, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.02% (0.3483 => 0.3308, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.02% (0.5941 => 0.5643, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.00% (0.5581 => 0.5302, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -4.97% (0.3481 => 0.3308, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -4.97% (0.3867 => 0.3675, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -4.96% (4.0594 => 3.8579, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.96% (0.6189 => 0.5882, std.dev.: 0.0071) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.94% (0.3319 => 0.3155, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.94% (0.6681 => 0.6351, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/strcat: -4.92% (0.2989 => 0.2842, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.91% (1.2210 => 1.1610, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.90% (1.2221 => 1.1622, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: -4.90% (0.4248 => 0.4040, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -4.90% (0.4861 => 0.4623, std.dev.: 0.0079) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.89% (0.8521 => 0.8104, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: -4.89% (0.3394 => 0.3228, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.89% (0.3252 => 0.3093, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.88% (0.6676 => 0.6350, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.87% (0.5688 => 0.5411, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.86% (0.6440 => 0.6127, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -4.82% (0.3446 => 0.3280, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.81% (0.6033 => 0.5743, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/lists: -4.81% (0.3621 => 0.3447, std.dev.: 0.0035) MultiSource/Applications/d/make_dparser: -4.80% (3.5154 => 3.3465, std.dev.: 0.0111) MultiSource/Applications/minisat/minisat: -4.79% (0.7447 => 0.7090, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.76% (22.4056 => 21.3398, std.dev.: 0.0142) MultiSource/Applications/siod/siod: -4.73% (2.4021 => 2.2886, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.70% (0.4083 => 0.3891) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.70% (0.5168 => 0.4925, std.dev.: 0.0059) MultiSource/Applications/ClamAV/clamscan: -4.68% (15.2527 => 14.5383, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.66% (0.9557 => 0.9112, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.60% (1.6474 => 1.5716, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/09-vor/vor: -4.59% (0.3271 => 0.3121, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.59% (0.4427 => 0.4224, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.57% (0.2385 => 0.2276, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.56% (0.7339 => 0.7004, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -4.55% (0.7982 => 0.7619, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.52% (0.7021 => 0.6704, std.dev.: 0.0042) MultiSource/Applications/treecc/treecc: -4.50% (2.1401 => 2.0437, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sieve: -4.49% (0.3788 => 0.3618, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.47% (0.6395 => 0.6109, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.43% (0.7524 => 0.7191, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.41% (0.5329 => 0.5094, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -4.38% (0.6347 => 0.6069, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -4.35% (34.0927 => 32.6080, std.dev.: 0.0103) MultiSource/Applications/kimwitu++/kc: -4.35% (18.2933 => 17.4972, std.dev.: 0.0131) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.35% (0.9077 => 0.8682, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: -4.24% (0.4524 => 0.4332, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -4.24% (0.6441 => 0.6168, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.22% (0.5567 => 0.5332, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -4.19% (0.8418 => 0.8065, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.18% (0.3491 => 0.3345, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -4.18% (0.6750 => 0.6468, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.08% (0.6395 => 0.6134, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.07% (2.2587 => 2.1667, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: -4.05% (0.7779 => 0.7464, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.00% (0.5569 => 0.5346, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.63% (1.5610 => 1.5044, std.dev.: 0.0128) MultiSource/Applications/oggenc/oggenc: -3.49% (5.0226 => 4.8472, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.36% (5.4682 => 5.2847, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.14% (20.7746 => 20.3304, std.dev.: 0.0331) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7533, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1729, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.94% (2.2633 => 2.1742, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7069, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.85% (1.3096 => 1.2723, std.dev.: 0.0091) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.49% (6.5735 => 6.4755, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 22 11:36:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 22 Nov 2012 13:36:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121122193620.7174A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6154?compare_to=6148&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6154, Order: 168501, Start Time: 2012-11-22 17:18:22, End Time: 2012-11-22 19:36:46 To: 6148, Order: 168493, Start Time: 2012-11-22 14:09:16, End Time: 2012-11-22 16:28:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 24 (129 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1062 (716 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 14.29% (0.8048 => 0.9198, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 13.19% (0.5889 => 0.6666, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.92% (0.6575 => 0.7359, std.dev.: 0.0076) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.80% (0.3561 => 0.3910, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.16% (0.2664 => 0.2908, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.10% (0.6212 => 0.6777, std.dev.: 0.0127) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.89% (0.1170 => 0.1274, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.85% (0.6856 => 0.7463, std.dev.: 0.0160) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.83% (0.2876 => 0.3130, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.78% (0.5889 => 0.6406, std.dev.: 0.0169) MultiSource/Benchmarks/Olden/health/health: 8.47% (0.1475 => 0.1600, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/neural/neural: 8.06% (0.1600 => 0.1729, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.68% (0.2410 => 0.2595, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.17% (0.6301 => 0.6753, std.dev.: 0.0149) MultiSource/Benchmarks/McCat/18-imp/imp: 6.79% (0.3873 => 0.4136, std.dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.99% (0.5211 => 0.5523, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 4.02% (0.6818 => 0.7092, std.dev.: 0.0098) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: 103.62% (0.1049 => 0.2136, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/09-vor/vor: 21.79% (0.1193 => 0.1453, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.22% (1.5584 => 1.8424, std.dev.: 0.0693) MultiSource/Benchmarks/Olden/bisort/bisort: 16.15% (0.8663 => 1.0062, std.dev.: 0.0113) MultiSource/Benchmarks/Olden/health/health: 12.75% (0.4613 => 0.5201, std.dev.: 0.0136) MultiSource/Benchmarks/Olden/tsp/tsp: 12.48% (1.1049 => 1.2428, std.dev.: 0.0190) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.60% (1.5469 => 1.6026, std.dev.: 0.0118) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.75% (69.0787 => 69.6002, std.dev.: 0.0195) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1339 => 0.1339, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0421 => 0.0420, std.dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.46% (0.0652 => 0.0649, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: 0.05% (493.7508 => 493.9895, std.dev.: 0.1501) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 10.05% (63.2438 => 69.6002, std.dev.: 0.0195) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43705.05% (1.1277 => 493.9895, std.dev.: 0.1501) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 192.94% (0.5229 => 1.5318, std.dev.: 0.1036) MultiSource/Applications/SPASS/SPASS: 19.12% (14.9895 => 17.8562, std.dev.: 0.4512) MultiSource/Applications/kimwitu++/kc: 47.67% (14.1553 => 20.9032, std.dev.: 0.4874) MultiSource/Benchmarks/MallocBench/gs/gs: 15.76% (4.1105 => 4.7584, std.dev.: 0.2884) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.34% (1.1048 => 1.5063, std.dev.: 0.0739) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 433.66% (7.1582 => 38.2001, std.dev.: 0.3302) SingleSource/Benchmarks/Misc-C++-EH/spirit: 77.02% (3.4629 => 6.1300, std.dev.: 0.4011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.45% (0.6222 => 1.0294, std.dev.: 0.0646) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10465.69% (0.0720 => 7.6073, std.dev.: 0.2932) MultiSource/Applications/SIBsim4/SIBsim4: 3859600.00% (0.0001 => 3.8597, std.dev.: 0.0411) MultiSource/Applications/SPASS/SPASS: 12793800.00% (0.0001 => 12.7939, std.dev.: 2.0595) MultiSource/Applications/kimwitu++/kc: 51600.00% (0.0001 => 0.0517, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 64000.00% (0.0001 => 0.0641, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 577400.00% (0.0001 => 0.5775, std.dev.: 0.0197) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10082000.00% (0.0001 => 10.0821, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5702500.00% (0.0001 => 5.7026, std.dev.: 0.9162) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1799.73% (1.1194 => 21.2656, std.dev.: 0.3907) MultiSource/Applications/ClamAV/clamscan: 67.35% (22.1758 => 37.1117, std.dev.: 0.5413) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 59.54% (7.0540 => 11.2543, std.dev.: 0.2012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.66% (2.9384 => 4.6034, std.dev.: 0.2676) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 48.22% (8.1363 => 12.0594, std.dev.: 0.2716) MultiSource/Applications/JM/lencod/lencod: 46.89% (21.9371 => 32.2232, std.dev.: 0.1750) MultiSource/Benchmarks/FreeBench/distray/distray: 44.89% (0.1056 => 0.1530, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/almabench: 43.97% (0.0730 => 0.1051, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 37.99% (0.1432 => 0.1976, std.dev.: 0.0065) SingleSource/Benchmarks/Stanford/Oscar: 32.08% (0.0636 => 0.0840, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/17-bintr/bintr: 30.96% (0.0675 => 0.0884, std.dev.: 0.0023) SingleSource/UnitTests/vla: 29.01% (0.0355 => 0.0458, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/dot-syntax-1: 28.60% (0.0479 => 0.0616, std.dev.: 0.0047) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.64% (0.1125 => 0.1436, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 26.85% (0.2700 => 0.3425, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/bisort/bisort: 26.55% (0.0614 => 0.0777, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 26.46% (0.3307 => 0.4182, std.dev.: 0.0097) MultiSource/Applications/minisat/minisat: 26.25% (0.7115 => 0.8983, std.dev.: 0.0155) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 26.23% (0.0953 => 0.1203, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/15-trie/trie: 26.19% (0.0527 => 0.0665, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/health/health: 26.18% (0.1268 => 0.1600, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 25.57% (0.1236 => 0.1552, std.dev.: 0.0059) MultiSource/Benchmarks/SciMark2-C/scimark2: 25.28% (0.3121 => 0.3910, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 25.06% (0.0842 => 0.1053, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 24.60% (0.0443 => 0.0552, std.dev.: 0.0019) SingleSource/Benchmarks/Stanford/Towers: 23.78% (0.0471 => 0.0583, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.46% (0.0746 => 0.0921, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.45% (0.1032 => 0.1274, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.16% (0.2107 => 0.2595, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: 22.62% (0.0871 => 0.1068, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.48% (0.8172 => 1.0009, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 22.34% (0.0770 => 0.0942, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/life/life: 22.29% (0.0933 => 0.1141, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 22.18% (0.1655 => 0.2022, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/matrix: 22.05% (0.3098 => 0.3781, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/08-main/main: 21.93% (0.2554 => 0.3114, std.dev.: 0.0178) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 21.39% (0.1337 => 0.1623, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.30% (0.0770 => 0.0934, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.14% (0.1566 => 0.1897, std.dev.: 0.0115) MultiSource/Applications/lemon/lemon: 20.90% (1.0722 => 1.2963, std.dev.: 0.0301) MultiSource/Benchmarks/McCat/18-imp/imp: 20.83% (0.3423 => 0.4136, std.dev.: 0.0093) SingleSource/UnitTests/Vector/SSE/sse_isamax: 20.74% (0.0704 => 0.0850, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 20.25% (0.2603 => 0.3130, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.24% (0.5569 => 0.6696, std.dev.: 0.0150) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.14% (0.1584 => 0.1903, std.dev.: 0.0110) MultiSource/Benchmarks/Olden/tsp/tsp: 20.09% (0.1175 => 0.1411, std.dev.: 0.0069) SingleSource/UnitTests/SignlessTypes/rem: 19.93% (0.1144 => 0.1372, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.76% (2.2024 => 2.6377, std.dev.: 0.0893) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.67% (0.4615 => 0.5523, std.dev.: 0.0119) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 19.67% (0.2430 => 0.2908, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.42% (0.0793 => 0.0947, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/09-vor/vor: 19.25% (0.3180 => 0.3792, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 19.04% (14.3668 => 17.1017, std.dev.: 0.2428) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.53% (0.6675 => 0.7912, std.dev.: 0.0356) SingleSource/UnitTests/ObjC/exceptions-2: 18.24% (0.3497 => 0.4135, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/neural/neural: 18.18% (0.1463 => 0.1729, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.06% (4.2646 => 5.0346, std.dev.: 0.1495) SingleSource/Benchmarks/Stanford/Puzzle: 17.59% (0.1268 => 0.1491, std.dev.: 0.0051) MultiSource/Applications/oggenc/oggenc: 17.45% (5.7591 => 6.7640, std.dev.: 0.2339) MultiSource/Benchmarks/McCat/05-eks/eks: 16.82% (0.4299 => 0.5022, std.dev.: 0.0142) MultiSource/Applications/d/make_dparser: 16.56% (3.3354 => 3.8878, std.dev.: 0.1514) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.52% (0.1029 => 0.1199, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 16.44% (0.2877 => 0.3350, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/wc: 16.02% (0.3052 => 0.3541, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/mst/mst: 15.74% (0.1163 => 0.1346, std.dev.: 0.0065) MultiSource/Applications/lua/lua: 15.47% (3.8723 => 4.4712, std.dev.: 0.1528) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.43% (0.0648 => 0.0748, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: 15.36% (0.3092 => 0.3567, std.dev.: 0.0123) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.24% (0.0886 => 0.1021, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.11% (0.2065 => 0.2377, std.dev.: 0.0085) MultiSource/Applications/sqlite3/sqlite3: 15.04% (17.1811 => 19.7655, std.dev.: 0.2875) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.97% (0.2271 => 0.2611, std.dev.: 0.0090) MultiSource/Benchmarks/mafft/pairlocalalign: 14.69% (9.4845 => 10.8777, std.dev.: 0.3867) MultiSource/Applications/viterbi/viterbi: 14.66% (0.1555 => 0.1783, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.51% (0.0834 => 0.0955, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.50% (0.2758 => 0.3158, std.dev.: 0.0147) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.45% (4.9449 => 5.6596, std.dev.: 0.2047) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.23% (0.1117 => 0.1276, std.dev.: 0.0039) MultiSource/Benchmarks/NPB-serial/is/is: 14.05% (0.0719 => 0.0820, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.76% (0.5981 => 0.6804, std.dev.: 0.0228) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.55% (1.5415 => 1.7504, std.dev.: 0.0807) MultiSource/Applications/sgefa/sgefa: 13.48% (0.3109 => 0.3528, std.dev.: 0.0137) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.28% (0.1062 => 0.1203, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.38% (5.0018 => 5.6209, std.dev.: 0.2232) SingleSource/UnitTests/ObjC/trivial-interface: 12.18% (0.3473 => 0.3896, std.dev.: 0.0157) SingleSource/UnitTests/ObjC/exceptions-3: 12.12% (0.3516 => 0.3942, std.dev.: 0.0143) SingleSource/UnitTests/ObjC/exceptions-4: 12.00% (0.3543 => 0.3968, std.dev.: 0.0145) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.85% (0.3543 => 0.3963, std.dev.: 0.0152) SingleSource/UnitTests/ObjC/for-in: 11.83% (0.3694 => 0.4131, std.dev.: 0.0130) SingleSource/UnitTests/ObjC/exceptions: 11.73% (0.3828 => 0.4277, std.dev.: 0.0168) MultiSource/Benchmarks/PAQ8p/paq8p: 10.68% (10.3673 => 11.4746, std.dev.: 0.1526) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.82% (0.3177 => 0.3489, std.dev.: 0.0087) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.57% (2.2022 => 2.4129, std.dev.: 0.0570) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.46% (0.3817 => 0.4178, std.dev.: 0.0100) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.28% (4.3953 => 11.0005, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/methcall: 147.43% (5.3999 => 13.3611, std.dev.: 0.0109) MultiSource/Benchmarks/McCat/17-bintr/bintr: 104.79% (0.1043 => 0.2136, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/09-vor/vor: 25.91% (0.1154 => 0.1453, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.13% (1.5086 => 1.8424, std.dev.: 0.0693) MultiSource/Benchmarks/Olden/bisort/bisort: 20.75% (0.8333 => 1.0062, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/oourafft: 17.44% (6.6465 => 7.8056, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.03% (1.1145 => 1.3043, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/health/health: 17.01% (0.4445 => 0.5201, std.dev.: 0.0136) MultiSource/Benchmarks/Olden/tsp/tsp: 15.23% (1.0785 => 1.2428, std.dev.: 0.0190) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.45% (0.2944 => 0.3340, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.64% (2.8904 => 3.2268, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 10.28% (1.1396 => 1.2568, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.08% (8.6802 => 9.5554, std.dev.: 0.2401) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.30% (1.7254 => 1.8858, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.42% (4.2280 => 4.4573, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.31% (0.3070 => 0.3233, std.dev.: 0.0053) SingleSource/Regression/C/uint64_to_float: 5.10% (0.5413 => 0.5689, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.60% (26.0924 => 27.2929, std.dev.: 0.1545) MultiSource/Benchmarks/nbench/nbench: 4.13% (11.6436 => 12.1250, std.dev.: 0.0051) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: 2.61% (2.4116 => 2.4745, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.50% (1.7133 => 1.7562, std.dev.: 0.0152) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 2.05% (3.1595 => 3.2242, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 1.98% (85.0658 => 86.7460, std.dev.: 0.0646) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.86% (2.1424 => 2.1823, std.dev.: 0.0122) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.59% (6.5088 => 6.6121, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2795, std.dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0502, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.07% (5.2139 => 5.2698, std.dev.: 0.0121) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.38% (6.6874 => 0.1754, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.91% (5.2763 => 1.2711, std.dev.: 0.0286) SingleSource/Benchmarks/Misc/salsa20: -75.66% (0.8651 => 0.2106, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/richards_benchmark: -44.94% (0.1622 => 0.0893, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.46% (5.3526 => 4.6858, std.dev.: 0.1597) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -12.41% (0.1330 => 0.1165, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.52% (5.3855 => 4.8188, std.dev.: 0.1204) MultiSource/Applications/JM/ldecod/ldecod: -9.65% (10.4361 => 9.4285, std.dev.: 0.3315) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.38% (0.3987 => 0.2377, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.29% (4.5009 => 2.7776, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7636, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.15% (2.6546 => 2.0136, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -19.07% (0.2161 => 0.1749, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.67% (1.6925 => 1.4273, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2841, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.79% (32.5116 => 29.0033, std.dev.: 0.0238) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -10.54% (9.5636 => 8.5552, std.dev.: 0.1388) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4244, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.93% (4.8142 => 4.4804, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.2416 => 3.0212, std.dev.: 0.0279) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.61% (2.7294 => 2.5764, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5073, std.dev.: 0.0030) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.64% (1.6805 => 1.6026, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout/lists: -4.26% (6.2999 => 6.0313, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.33% (0.9957 => 0.9625, std.dev.: 0.0089) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.20% (19.9488 => 19.3110, std.dev.: 0.2404) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8914, std.dev.: 0.0048) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.29% (0.4808 => 0.4698, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.81% (8.1563 => 8.0089, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -1.51% (10.2830 => 10.1282, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0014) Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 22 14:25:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 22 Nov 2012 16:25:01 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121122222501.2DD342A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6155?compare_to=6151&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6155, Order: 168502, Start Time: 2012-11-22 19:04:37, End Time: 2012-11-22 22:25:26 To: 6151, Order: 168495, Start Time: 2012-11-22 14:55:30, End Time: 2012-11-22 18:16:33 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (170 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1091 (722 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.70% (125.8093 => 129.2023, std.dev.: 0.7120) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 45.28% (0.0625 => 0.0908, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.81% (0.1063 => 0.1433, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 26.42% (1.5932 => 2.0141, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.33% (0.4253 => 0.5373, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.24% (0.2969 => 0.3748, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.86% (0.1106 => 0.1392, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.49% (0.0714 => 0.0896, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.79% (0.4139 => 0.5165, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.69% (0.4994 => 0.6177, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.54% (0.5900 => 0.7289, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.12% (0.0584 => 0.0719, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.08% (0.0897 => 0.1104, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.92% (0.5000 => 0.6146, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.85% (0.0547 => 0.0672, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.98% (0.1620 => 0.1976, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.68% (0.1107 => 0.1347, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.65% (0.1021 => 0.1242, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 21.37% (0.0599 => 0.0727, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 20.46% (0.0948 => 0.1142, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.38% (0.0633 => 0.0762, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.38% (0.0584 => 0.0703, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.22% (0.1103 => 0.1326, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.16% (0.3903 => 0.4690, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.09% (0.0642 => 0.0771, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.95% (0.1549 => 0.1858, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 19.85% (0.0821 => 0.0984, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.64% (0.1003 => 0.1200, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.64% (0.1604 => 0.1919, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.59% (0.0822 => 0.0983, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 19.39% (0.1619 => 0.1933, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 19.37% (0.0604 => 0.0721, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.02% (0.1462 => 0.1740, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 18.56% (0.0808 => 0.0958) MultiSource/Applications/viterbi/viterbi: 18.48% (0.0947 => 0.1122, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.46% (0.3890 => 0.4608, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.12% (0.2014 => 0.2379, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 17.65% (0.1218 => 0.1433, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.64% (1.3152 => 1.5472, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/mst/mst: 17.62% (0.0698 => 0.0821, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.58% (0.2736 => 0.3217, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 17.46% (0.5826 => 0.6843, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 17.42% (0.4029 => 0.4731, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.28% (0.1088 => 0.1276, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 17.28% (0.1505 => 0.1765, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.17% (0.2866 => 0.3358, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 17.05% (0.5889 => 0.6893, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 16.93% (0.5546 => 0.6485, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 16.73% (1.8794 => 2.1939, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.53% (0.4658 => 0.5428, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.48% (3.5627 => 4.1499, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.41% (0.1968 => 0.2291, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.36% (0.3271 => 0.3806, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.34% (0.5026 => 0.5847, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.23% (1.6211 => 1.8842, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.21% (0.1160 => 0.1348, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 16.09% (1.0781 => 1.2516, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 15.83% (0.1421 => 0.1646, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.68% (0.4361 => 0.5045, std.dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: 15.60% (4.2109 => 4.8676, std.dev.: 0.0026) MultiSource/Applications/hbd/hbd: 15.54% (0.9697 => 1.1204, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.50% (0.1090 => 0.1259, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.50% (0.3930 => 0.4539, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.44% (4.4195 => 5.1019, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: 15.42% (0.1284 => 0.1482, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.37% (0.2875 => 0.3317, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.27% (2.7292 => 3.1460, std.dev.: 0.0062) SingleSource/UnitTests/ObjC++/property-reference: 15.10% (0.7171 => 0.8254, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.83% (1.9694 => 2.2614, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 14.78% (0.2714 => 0.3115, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 14.76% (0.2738 => 0.3142, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 14.68% (0.2725 => 0.3125, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 14.62% (0.2750 => 0.3152, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 14.60% (0.2075 => 0.2378, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 14.55% (0.3004 => 0.3441, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 14.53% (0.2780 => 0.3184, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 14.51% (0.2729 => 0.3125, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.46% (1.9966 => 2.2853, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/methcall: 14.43% (0.2813 => 0.3219, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 14.42% (0.2823 => 0.3230, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 14.41% (0.2803 => 0.3207, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 14.41% (0.9909 => 1.1337, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 14.41% (0.2811 => 0.3216, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.40% (0.2792 => 0.3194, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.29% (0.2911 => 0.3327, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.21% (0.3195 => 0.3649, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 14.18% (0.3096 => 0.3535, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.08% (2.0673 => 2.3584, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/ary3: 14.02% (0.3267 => 0.3725, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 13.99% (0.2566 => 0.2925, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 13.90% (23.5202 => 26.7892, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary: 13.78% (0.3258 => 0.3707, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 13.78% (0.3317 => 0.3774, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 13.60% (1.4269 => 1.6209, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/exceptions-4: 13.48% (0.3465 => 0.3932, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.46% (0.3060 => 0.3472, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.33% (0.3488 => 0.3953, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.33% (0.3362 => 0.3810, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.28% (0.3124 => 0.3539, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 13.28% (0.7875 => 0.8921, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 13.28% (0.3442 => 0.3899, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.27% (0.3460 => 0.3919, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.23% (0.3446 => 0.3902, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 13.21% (0.3678 => 0.4164, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 13.20% (0.3348 => 0.3790, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.19% (0.3282 => 0.3715) SingleSource/UnitTests/ObjC/for-in: 13.19% (0.3496 => 0.3957, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.14% (0.3469 => 0.3925, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 13.06% (0.3477 => 0.3931, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 12.99% (0.3625 => 0.4096, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 12.98% (0.4146 => 0.4684, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 12.96% (0.3726 => 0.4209, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 12.93% (0.3650 => 0.4122, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 12.86% (2.1653 => 2.4438, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions: 12.76% (0.3643 => 0.4108, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 12.66% (0.4251 => 0.4789, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 12.65% (0.3724 => 0.4195, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 12.53% (4.6177 => 5.1962, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.48% (0.3981 => 0.4478, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.47% (0.3690 => 0.4150, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 12.41% (2.1013 => 2.3621, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.33% (0.3845 => 0.4319, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 11.99% (0.5012 => 0.5613, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 11.89% (0.2691 => 0.3011, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.81% (0.2040 => 0.2281, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 11.20% (5.5417 => 6.1626, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.00% (0.6435 => 0.7143, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.89% (0.1028 => 0.1140, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 10.49% (0.3498 => 0.3865, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 10.49% (0.6634 => 0.7330, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.41% (0.1383 => 0.1527, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 10.23% (0.4847 => 0.5343, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.11% (0.2068 => 0.2277, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.05% (0.2737 => 0.3012, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.95% (0.3084 => 0.3391, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 9.53% (0.3336 => 0.3654, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 9.42% (2.0346 => 2.2263, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.27% (0.2103 => 0.2298, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 9.16% (0.2391 => 0.2610, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.58% (0.7426 => 0.8063, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.51% (0.5361 => 0.5817, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.37% (4.6926 => 5.0854, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.88% (11.6398 => 12.5571, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.66% (0.5584 => 0.6012, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 6.32% (11.9555 => 12.7116, std.dev.: 0.0235) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.93% (0.3792 => 0.3941, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 8.89% (0.2802 => 0.3051, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6093, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 6.03% (0.2122 => 0.2250, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6716, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1701, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-2: 4.40% (1.8057 => 1.8852, std.dev.: 0.0064) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6408, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.84% (0.3693 => 0.3798, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1932, std.dev.: 0.0073) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.64% (3.1722 => 3.2241, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2901, std.dev.: 0.0030) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3068, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5796, std.dev.: 0.0242) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5751, std.dev.: 0.0098) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9762, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7988, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -7.12% (0.2402 => 0.2231, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418) SingleSource/UnitTests/Vector/build2: -3.56% (11.2080 => 10.8087, std.dev.: 0.0022) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.29% (17.2379 => 16.8439, std.dev.: 0.0312) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8707, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5716, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4958, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1522, std.dev.: 0.0902) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0422, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 22 14:46:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 22 Nov 2012 16:46:25 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121122224625.F19AE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6156?compare_to=6154&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6156, Order: 168502, Start Time: 2012-11-22 20:26:51, End Time: 2012-11-22 22:46:52 To: 6154, Order: 168501, Start Time: 2012-11-22 17:18:22, End Time: 2012-11-22 19:36:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 80 (143 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1006 (701 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: 16.98% (0.1955 => 0.2287, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 14.37% (0.7169 => 0.8199, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 14.08% (0.6597 => 0.7526, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.05% (0.6847 => 0.7809, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.71% (0.6179 => 0.7026, std.dev.: 0.0299) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 13.25% (0.5900 => 0.6682, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 13.23% (0.5754 => 0.6515, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 13.20% (0.7818 => 0.8850, std.dev.: 0.0066) MultiSource/Applications/SIBsim4/SIBsim4: 13.10% (1.5318 => 1.7325, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.39% (0.6845 => 0.7693, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.15% (0.5747 => 0.6445, std.dev.: 0.0258) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.07% (0.2221 => 0.2489, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.84% (2.2408 => 2.5060, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.76% (1.3083 => 1.4622, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/hello: 11.74% (0.2930 => 0.3274, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.72% (0.5092 => 0.5689, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.46% (0.5881 => 0.6555, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/power/power: 11.35% (0.1454 => 0.1619, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 11.31% (0.7226 => 0.8043, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/lists: 11.24% (0.3781 => 0.4206, std.dev.: 0.0079) SingleSource/Benchmarks/LivermoreLoops/kernel03: 10.48% (0.0992 => 0.1096, std.dev.: 0.0012) SingleSource/Benchmarks/LivermoreLoops/kernel04: 10.22% (0.1057 => 0.1165, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.21% (0.7128 => 0.7856, std.dev.: 0.0016) SingleSource/Benchmarks/LivermoreLoops/kernel06: 10.19% (0.1040 => 0.1146, std.dev.: 0.0018) SingleSource/Benchmarks/LivermoreLoops/kernel02: 10.19% (0.1050 => 0.1157, std.dev.: 0.0007) SingleSource/Benchmarks/LivermoreLoops/kernel05: 10.06% (0.1004 => 0.1105, std.dev.: 0.0008) SingleSource/Benchmarks/LivermoreLoops/kernel08: 10.05% (0.1234 => 0.1358, std.dev.: 0.0007) SingleSource/Benchmarks/LivermoreLoops/kernel01: 9.98% (0.1012 => 0.1113, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.89% (1.4706 => 1.6160, std.dev.: 0.0256) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.40% (0.1703 => 0.1863, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.37% (0.7159 => 0.7830, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/moments: 9.35% (0.4460 => 0.4877, std.dev.: 0.0153) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.17% (8.0074 => 8.7419, std.dev.: 0.0133) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.12% (0.9056 => 0.9882, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.05% (0.3436 => 0.3747, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.91% (0.5882 => 0.6406, std.dev.: 0.0125) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.09% (5.6209 => 6.0758, std.dev.: 0.0442) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.26% (4.6858 => 5.0261, std.dev.: 0.0255) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.21% (0.2984 => 0.3199, std.dev.: 0.0063) MultiSource/Applications/d/make_dparser: 7.19% (3.8878 => 4.1675, std.dev.: 0.0535) MultiSource/Applications/JM/ldecod/ldecod: 6.90% (9.4285 => 10.0795, std.dev.: 0.0552) SingleSource/Benchmarks/Shootout-C++/random: 6.52% (0.3037 => 0.3235, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.13% (5.0346 => 5.3433, std.dev.: 0.0247) MultiSource/Applications/spiff/spiff: 5.71% (0.8933 => 0.9443, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 5.53% (0.6406 => 0.6760, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 5.07% (0.3567 => 0.3748, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.86% (0.6753 => 0.7081, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 4.66% (0.7463 => 0.7811, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.07% (0.6777 => 0.7053, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.05% (1.2711 => 1.3226, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/18-imp/imp: 3.97% (0.4136 => 0.4300, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.89% (0.5523 => 0.5738, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.82% (0.5241 => 0.5441, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.68% (4.8188 => 4.9960, std.dev.: 0.0270) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.37% (1.0009 => 1.0246, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.19% (0.7359 => 0.7520, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.00% (0.6666 => 0.6799, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.71% (0.7092 => 0.7213, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.69% (38.2001 => 38.8457, std.dev.: 0.0729) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 27.65% (1.3206 => 1.6857, std.dev.: 0.0238) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.19% (14.8503 => 17.7001, std.dev.: 0.4671) MultiSource/Applications/JM/ldecod/ldecod: 14.88% (0.1210 => 0.1390, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/mst/mst: 10.41% (0.1316 => 0.1453, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/09-vor/vor: 9.57% (0.1453 => 0.1592, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.03% (1.8424 => 2.0088, std.dev.: 0.0180) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.41% (0.5775 => 0.6203, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: 7.39% (1.9557 => 2.1003, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 5.64% (1.5292 => 1.6155, std.dev.: 0.0235) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5.01% (6.2503 => 6.5633, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.90% (9.6217 => 10.0930, std.dev.: 0.1687) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.68% (6.2067 => 6.4353, std.dev.: 0.0829) MultiSource/Benchmarks/Olden/em3d/em3d: 2.70% (3.1103 => 3.1943, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.69% (4.3716 => 4.4890, std.dev.: 0.0210) MultiSource/Applications/SIBsim4/SIBsim4: 2.04% (3.8597 => 3.9385, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.01% (2.3075 => 2.3539, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.87% (5.3728 => 5.4735, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.57% (3.0212 => 3.0685, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.27% (4.1468 => 4.1996, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.13% (8.8711 => 8.9713, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.01% (6.6910 => 6.7584, std.dev.: 0.0046) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.64% (69.6002 => 69.1573, std.dev.: 0.2072) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 2.17% (0.1339 => 0.1368, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.38% (0.0420 => 0.0472, std.dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.46% (0.0649 => 0.0652, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -0.03% (493.9895 => 493.8308, std.dev.: 0.3489) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.35% (63.2438 => 69.1573, std.dev.: 0.2072) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.92% (4.3882 => 0.0472, std.dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43690.97% (1.1277 => 493.8308, std.dev.: 0.3489) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 231.33% (0.5229 => 1.7325, std.dev.: 0.0159) MultiSource/Applications/SPASS/SPASS: 19.25% (14.9895 => 17.8754, std.dev.: 0.3810) MultiSource/Applications/kimwitu++/kc: 52.64% (14.1553 => 21.6066, std.dev.: 0.2753) MultiSource/Benchmarks/MallocBench/gs/gs: 16.58% (4.1105 => 4.7919, std.dev.: 0.1529) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 42.28% (1.1048 => 1.5719, std.dev.: 0.0355) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 442.67% (7.1582 => 38.8457, std.dev.: 0.0729) SingleSource/Benchmarks/Misc-C++-EH/spirit: 74.57% (3.4629 => 6.0452, std.dev.: 0.4304) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.84% (0.6222 => 1.0381, std.dev.: 0.0586) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10476.67% (0.0720 => 7.6152, std.dev.: 0.0997) MultiSource/Applications/SIBsim4/SIBsim4: 3938400.00% (0.0001 => 3.9385, std.dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 12550700.00% (0.0001 => 12.5508, std.dev.: 1.0262) MultiSource/Applications/kimwitu++/kc: 51500.00% (0.0001 => 0.0516, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 620200.00% (0.0001 => 0.6203, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10086700.00% (0.0001 => 10.0868, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5677200.00% (0.0001 => 5.6773, std.dev.: 0.8267) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1802.62% (1.1194 => 21.2979, std.dev.: 0.2963) MultiSource/Applications/ClamAV/clamscan: 67.12% (22.1758 => 37.0605, std.dev.: 0.5891) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 63.81% (2.9384 => 4.8134, std.dev.: 0.1938) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 59.62% (7.0540 => 11.2599, std.dev.: 0.2222) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 51.14% (8.1363 => 12.2973, std.dev.: 0.1486) MultiSource/Applications/JM/lencod/lencod: 46.96% (21.9371 => 32.2392, std.dev.: 0.0571) MultiSource/Benchmarks/FreeBench/distray/distray: 44.89% (0.1056 => 0.1530, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 44.25% (0.0730 => 0.1053, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 38.06% (0.1432 => 0.1977, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/em3d/em3d: 34.93% (0.1695 => 0.2287, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/15-trie/trie: 33.21% (0.0527 => 0.0702, std.dev.: 0.0009) SingleSource/UnitTests/vla: 29.01% (0.0355 => 0.0458, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: 28.30% (0.1940 => 0.2489, std.dev.: 0.0033) MultiSource/Benchmarks/NPB-serial/is/is: 25.87% (0.0719 => 0.0905, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 25.62% (0.3423 => 0.4300, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.38% (0.8172 => 1.0246, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: 25.29% (4.2646 => 5.3433, std.dev.: 0.0247) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 25.24% (0.1236 => 0.1548, std.dev.: 0.0039) MultiSource/Applications/d/make_dparser: 24.95% (3.3354 => 4.1675, std.dev.: 0.0535) SingleSource/Benchmarks/Misc-C++/bigfib: 24.58% (0.6456 => 0.8043, std.dev.: 0.0121) SingleSource/Benchmarks/Dhrystone/fldry: 24.53% (0.0481 => 0.0599, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 24.33% (0.4615 => 0.5738, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 24.11% (0.0672 => 0.0834, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 23.83% (1.3050 => 1.6160, std.dev.: 0.0256) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.59% (0.0746 => 0.0922, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ks/ks: 23.38% (0.1510 => 0.1863, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.32% (0.1029 => 0.1269, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 23.28% (1.1861 => 1.4622, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 22.92% (0.0528 => 0.0649, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 22.91% (0.3422 => 0.4206, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.86% (2.2024 => 2.7058, std.dev.: 0.0953) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.74% (0.1337 => 0.1641, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 22.71% (0.4636 => 0.5689, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/mst/mst: 22.61% (0.1163 => 0.1426, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 22.47% (0.0770 => 0.0943, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 22.35% (0.7115 => 0.8705, std.dev.: 0.0201) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 21.98% (0.8101 => 0.9882, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 21.80% (0.6450 => 0.7856, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 21.57% (0.3180 => 0.3866, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.49% (0.1117 => 0.1357, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.47% (5.0018 => 6.0758, std.dev.: 0.0442) MultiSource/Benchmarks/Prolangs-C++/city/city: 21.27% (2.0665 => 2.5060, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: 21.22% (0.3092 => 0.3748, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.19% (0.5569 => 0.6749, std.dev.: 0.0116) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.07% (0.1566 => 0.1896, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 20.63% (0.2714 => 0.3274, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 20.63% (0.2065 => 0.2491, std.dev.: 0.0051) MultiSource/Applications/spiff/spiff: 20.52% (0.7835 => 0.9443, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/moments: 20.48% (0.4048 => 0.4877, std.dev.: 0.0153) MultiSource/Benchmarks/Olden/tsp/tsp: 20.00% (0.1175 => 0.1410, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 19.95% (0.1584 => 0.1900, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 19.69% (0.0838 => 0.1003, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.42% (0.0834 => 0.0996, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 19.20% (3.8922 => 4.6394, std.dev.: 0.1357) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.17% (0.0793 => 0.0945, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.63% (14.3668 => 17.0429, std.dev.: 0.2187) SingleSource/Benchmarks/CoyoteBench/lpbench: 18.51% (0.0929 => 0.1101, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 18.50% (0.3162 => 0.3747, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 18.11% (0.4103 => 0.4846, std.dev.: 0.0139) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.04% (0.1125 => 0.1328, std.dev.: 0.0044) MultiSource/Applications/lemon/lemon: 17.93% (1.0722 => 1.2644, std.dev.: 0.0435) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.98% (0.0842 => 0.0985, std.dev.: 0.0050) MultiSource/Applications/oggenc/oggenc: 16.77% (5.7591 => 6.7251, std.dev.: 0.2461) SingleSource/Benchmarks/Shootout/lists: 16.77% (0.0626 => 0.0731, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.64% (1.4186 => 1.6546, std.dev.: 0.0351) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.29% (0.2793 => 0.3248, std.dev.: 0.0097) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.19% (0.0871 => 0.1012, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.07% (0.2756 => 0.3199, std.dev.: 0.0063) MultiSource/Benchmarks/mafft/pairlocalalign: 15.79% (9.4845 => 10.9821, std.dev.: 0.2923) SingleSource/Benchmarks/Shootout/matrix: 15.65% (0.0818 => 0.0946, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/random: 15.45% (0.2802 => 0.3235, std.dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.42% (0.0953 => 0.1100, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.34% (0.3650 => 0.4210, std.dev.: 0.0116) MultiSource/Applications/viterbi/viterbi: 14.86% (0.1555 => 0.1786, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/health/health: 14.75% (0.1268 => 0.1455, std.dev.: 0.0062) MultiSource/Applications/lua/lua: 14.69% (3.8723 => 4.4412, std.dev.: 0.1530) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.55% (0.0770 => 0.0882, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.32% (1.5415 => 1.7622, std.dev.: 0.0739) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.30% (0.5981 => 0.6836, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.29% (0.2758 => 0.3152, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 14.05% (1.1642 => 1.3278, std.dev.: 0.0478) MultiSource/Applications/lambda-0_1_3/lambda: 14.03% (0.7433 => 0.8476, std.dev.: 0.0363) MultiSource/Applications/sqlite3/sqlite3: 13.94% (17.1811 => 19.5767, std.dev.: 0.4513) SingleSource/UnitTests/ObjC++/property-reference: 13.85% (0.7326 => 0.8341, std.dev.: 0.0178) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.75% (0.1062 => 0.1208, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/objinst: 13.67% (0.3131 => 0.3559, std.dev.: 0.0113) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 13.41% (0.3177 => 0.3603, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.24% (0.5860 => 0.6636, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/power/power: 12.43% (0.1440 => 0.1619, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 12.23% (2.0273 => 2.2753, std.dev.: 0.0707) SingleSource/UnitTests/ObjC/exceptions-4: 12.02% (0.3543 => 0.3969, std.dev.: 0.0146) SingleSource/UnitTests/ObjC/trivial-interface: 12.01% (0.3473 => 0.3890, std.dev.: 0.0158) SingleSource/UnitTests/ObjC/exceptions-2: 11.95% (0.3497 => 0.3915, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.52% (0.4879 => 0.5441, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.46% (4.9449 => 5.5114, std.dev.: 0.0871) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1143 => 0.1270, std.dev.: 0.0045) MultiSource/Benchmarks/PAQ8p/paq8p: 11.08% (10.3673 => 11.5163, std.dev.: 0.1873) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.06% (0.8067 => 0.8959, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.97% (0.1906 => 0.2115, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/football/football: 9.98% (0.8921 => 0.9811, std.dev.: 0.0297) MultiSource/Benchmarks/sim/sim: 9.80% (0.3387 => 0.3719, std.dev.: 0.0116) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.80% (7.9617 => 8.7419, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.55% (0.3826 => 0.4153, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.05% (0.3136 => 0.3357, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: 4.38% (54.1659 => 56.5399, std.dev.: 0.4622) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.30% (4.3953 => 11.0013, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/methcall: 147.50% (5.3999 => 13.3649, std.dev.: 0.0090) MultiSource/Benchmarks/McCat/09-vor/vor: 37.95% (0.1154 => 0.1592, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 33.16% (1.5086 => 2.0088, std.dev.: 0.0180) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 31.71% (13.4384 => 17.7001, std.dev.: 0.4671) MultiSource/Benchmarks/Ptrdist/ft/ft: 31.31% (1.2838 => 1.6857, std.dev.: 0.0238) SingleSource/Benchmarks/CoyoteBench/fftbench: 18.95% (2.0360 => 2.4218, std.dev.: 0.1343) SingleSource/Benchmarks/Misc/oourafft: 17.54% (6.6465 => 7.8120, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.70% (1.1145 => 1.3006, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.15% (0.2944 => 0.3331, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/mst/mst: 13.07% (0.1285 => 0.1453, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.54% (8.6802 => 9.7690, std.dev.: 0.1239) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.57% (2.8904 => 3.2249, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 10.23% (1.1396 => 1.2562, std.dev.: 0.0025) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.47% (1.7254 => 1.8888, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: 8.23% (1.9405 => 2.1003, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.95% (0.9540 => 1.0108, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.66% (4.2280 => 4.4675, std.dev.: 0.0103) SingleSource/Regression/C/uint64_to_float: 5.08% (0.5413 => 0.5688, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.34% (26.0924 => 27.2237, std.dev.: 0.2674) MultiSource/Benchmarks/nbench/nbench: 3.97% (11.6436 => 12.1064, std.dev.: 0.0068) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.34% (1.7133 => 1.7705, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 2.97% (3.1023 => 3.1943, std.dev.: 0.0100) SingleSource/Benchmarks/Dhrystone/dry: 2.71% (2.4116 => 2.4769, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.31% (2.1424 => 2.1918, std.dev.: 0.0191) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 2.06% (3.1595 => 3.2245, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 1.96% (85.0658 => 86.7305, std.dev.: 0.0103) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.75% (2.3135 => 2.3539, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 1.55% (27.8444 => 28.2770, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.21% (6.5088 => 6.5874, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.2139 => 5.2754, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0502, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 1.05% (2.2771 => 2.3011, std.dev.: 0.0088) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.30% (6.6874 => 0.1805, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/salsa20: -75.70% (0.8651 => 0.2102, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -74.93% (5.2763 => 1.3226, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/richards_benchmark: -45.07% (0.1622 => 0.0891, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.23% (5.3855 => 4.9960, std.dev.: 0.0270) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.10% (5.3526 => 5.0261, std.dev.: 0.0255) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.93% (1.7609 => 1.6565, std.dev.: 0.0368) MultiSource/Applications/JM/ldecod/ldecod: -3.42% (10.4361 => 10.0795, std.dev.: 0.0552) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.20% (0.0628 => 0.0363) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.21% (0.3987 => 0.2384, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.92% (0.0506 => 0.0304) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.25% (4.5009 => 2.7795, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.15% (2.6546 => 2.0134, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -19.20% (0.2161 => 0.1746, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4248, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2841, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.78% (32.5116 => 29.0083, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: -10.67% (1.5373 => 1.3733, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -10.23% (9.5636 => 8.5853, std.dev.: 0.1192) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4244, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5760, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.34% (3.2416 => 3.0685, std.dev.: 0.0060) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.20% (1.8329 => 1.7376, std.dev.: 0.0135) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.90% (19.9488 => 18.9722, std.dev.: 0.1720) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5081, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.68% (1.6805 => 1.6018, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.65% (0.2497 => 0.2381, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -4.48% (6.2999 => 6.0179, std.dev.: 0.0067) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8914, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.04% (0.9957 => 0.9654, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.29% (0.4808 => 0.4698, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.91% (8.1563 => 8.0003, std.dev.: 0.0184) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6773, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -1.49% (10.2830 => 10.1298, std.dev.: 0.0034) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -7.88% (0.1485 => 0.1368, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0014) Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 22 16:14:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 22 Nov 2012 18:14:29 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121123001429.874B02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6157?compare_to=6152&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6157, Order: 168504, Start Time: 2012-11-22 22:44:58, End Time: 2012-11-23 00:14:56 To: 6152, Order: 168502, Start Time: 2012-11-22 17:20:11, End Time: 2012-11-22 18:50:04 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 7 (104 on baseline) Performance Improvements: 2 (29 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1045 (841 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.28% (1.1993 => 1.2267, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.25% (1.5041 => 1.8839, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.82% (0.3187 => 0.3500, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.72% (6.6810 => 7.0631, std.dev.: 0.1103) MultiSource/Benchmarks/Olden/bisort/bisort: 1.76% (0.6474 => 0.6588, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.73% (1.0180 => 1.0356, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.26% (1.6003 => 1.6205, std.dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.38% (42.1643 => 41.5809, std.dev.: 0.2169) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -1.13% (45.6096 => 45.0930, std.dev.: 0.1786) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.33% (1.0455 => 1.0699, std.dev.: 0.0148) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 27.44% (0.0164 => 0.0209, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0427 => 0.0427, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -11.93% (0.0285 => 0.0251, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.27% (0.0316 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -6.75% (0.0400 => 0.0373, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0203 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 13.46% (0.0156 => 0.0177, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: - (0.1479 => 0.1479, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -3.57% (1.1893 => 1.1468, std.dev.: 0.0631) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.95% (0.4137 => 0.4259, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.63% (0.1378 => 0.1428, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.79% (0.0633 => 0.0609, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 4.55% (0.0242 => 0.0253, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.25% (0.0560 => 0.0553, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.82% (1.1868 => 1.1965, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -74.07% (0.0027 => 0.0007, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.73% (0.0565 => 0.0620, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 32.34% (0.0201 => 0.0266, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.03% (0.7799 => 0.7719, std.dev.: 0.0072) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -55.00% (0.0080 => 0.0036, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 6.74% (16.4461 => 17.5542, std.dev.: 0.1233) MultiSource/Applications/sqlite3/sqlite3: 2329.55% (0.6332 => 15.3839, std.dev.: 0.1677) MultiSource/Benchmarks/McCat/08-main/main: 47.90% (0.1831 => 0.2708, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.50% (0.1559 => 0.1442, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7071.53% (0.3123 => 22.3967, std.dev.: 0.1901) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.10% (0.2463 => 0.3697, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1524.61% (0.3344 => 5.4327, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.89% (0.2364 => 0.3236, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 4.43% (0.6010 => 0.6276, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: 2.80% (0.0429 => 0.0441, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.44% (0.3266 => 0.3411, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/strcat: 3.10% (0.1969 => 0.2030, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.36% (0.0224 => 0.0236, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -30.87% (0.0230 => 0.0159, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0520, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 7.52% (0.1462 => 0.1572, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4805, std.dev.: 0.0154) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0706, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4884, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5126, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.4883, std.dev.: 0.4201) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3284, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1387, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3634, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4054, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0877, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: -24.07% (2.1832 => 1.6576, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 11.24% (0.1112 => 0.1237, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.61% (0.2180 => 0.2324, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.14% (0.2279 => 0.2419, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.70% (1.1606 => 1.2267, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.46% (0.1905 => 0.2009, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.04% (0.2519 => 0.2646, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.90% (0.2998 => 0.3145, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 4.84% (1.2222 => 1.2813, std.dev.: 0.0071) MultiSource/Applications/spiff/spiff: 4.58% (0.7950 => 0.8314, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.31% (0.3295 => 0.3437, std.dev.: 0.0022) MultiSource/Applications/treecc/treecc: 4.19% (1.9948 => 2.0784, std.dev.: 0.0219) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.04% (1.1685 => 1.2157, std.dev.: 0.0066) MultiSource/Applications/minisat/minisat: 3.79% (0.6834 => 0.7093, std.dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 3.77% (0.2999 => 0.3112, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.73% (0.4127 => 0.4281, std.dev.: 0.0036) MultiSource/Applications/lua/lua: 3.66% (3.8189 => 3.9588, std.dev.: 0.0350) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.64% (2.1401 => 2.2181, std.dev.: 0.0092) MultiSource/Applications/SIBsim4/SIBsim4: 3.61% (1.2568 => 1.3022, std.dev.: 0.0093) MultiSource/Applications/SPASS/SPASS: 3.50% (14.2605 => 14.7598, std.dev.: 0.0562) MultiSource/Benchmarks/Olden/bh/bh: 3.42% (0.2985 => 0.3087, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 3.25% (1.1271 => 1.1637, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.24% (0.8261 => 0.8529, std.dev.: 0.0044) MultiSource/Applications/ClamAV/clamscan: 3.15% (14.7684 => 15.2338, std.dev.: 0.1220) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.11% (4.1763 => 4.3061, std.dev.: 0.0289) MultiSource/Applications/siod/siod: 3.10% (2.2184 => 2.2871, std.dev.: 0.0129) MultiSource/Applications/d/make_dparser: 2.99% (3.2366 => 3.3335, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.75% (4.4873 => 4.6109, std.dev.: 0.0169) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.75% (6.6074 => 6.7891, std.dev.: 0.0461) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.66% (0.8611 => 0.8840, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.64% (1.1170 => 1.1465, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.61% (1.5315 => 1.5714, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.60% (0.5191 => 0.5326, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.60% (0.8317 => 0.8533, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/05-eks/eks: 2.59% (0.4397 => 0.4511, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.58% (0.8340 => 0.8555, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.57% (0.9074 => 0.9307, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.57% (13.1811 => 13.5193, std.dev.: 0.1102) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.54% (0.8007 => 0.8210, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.54% (0.8086 => 0.8291, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.50% (0.8712 => 0.8930, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.50% (0.8518 => 0.8731, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.47% (0.7932 => 0.8128, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.46% (0.8359 => 0.8565, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.44% (0.9056 => 0.9277, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.43% (0.9069 => 0.9289, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.41% (0.8177 => 0.8374, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.40% (0.9039 => 0.9256, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.37% (0.8656 => 0.8861, std.dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 2.36% (6.7320 => 6.8908, std.dev.: 0.0326) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.36% (3.1832 => 3.2582, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.35% (0.8338 => 0.8534, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.33% (0.8316 => 0.8510, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.33% (0.8716 => 0.8919, std.dev.: 0.0046) MultiSource/Benchmarks/PAQ8p/paq8p: 2.33% (2.3764 => 2.4317, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.32% (0.8331 => 0.8524, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.31% (0.8050 => 0.8236, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.30% (0.8855 => 0.9059, std.dev.: 0.0057) MultiSource/Applications/lemon/lemon: 2.30% (1.0945 => 1.1197, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.29% (0.8597 => 0.8794, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.27% (0.8066 => 0.8249, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 2.26% (31.8598 => 32.5814, std.dev.: 0.1596) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.26% (0.7966 => 0.8146, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.22% (0.8697 => 0.8890, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.20% (0.8805 => 0.8999, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.10% (0.8048 => 0.8217, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.09% (0.8885 => 0.9071, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.08% (0.6586 => 0.6723, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.03% (0.8420 => 0.8591, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 1.62% (8.6247 => 8.7641, std.dev.: 0.0364) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.53% (0.8995 => 0.9133, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 112.06% (0.0199 => 0.0422, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/pi: 58.53% (1.5795 => 2.5040, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.32% (2.9753 => 3.4609, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 14.91% (0.7597 => 0.8730, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.72% (2.7995 => 3.2116, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.55% (5.0261 => 5.6068, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.76% (6.3772 => 7.0631, std.dev.: 0.1103) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.86% (0.3186 => 0.3500, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.08% (1.1857 => 1.2815, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/queens: 7.46% (1.7056 => 1.8328, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.79% (4.7794 => 5.1040, std.dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: 6.49% (3.1873 => 3.3941, std.dev.: 0.0194) SingleSource/Benchmarks/Misc/richards_benchmark: 6.01% (1.3037 => 1.3821, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.90% (4.9686 => 5.2615, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.78% (4.5327 => 4.7947, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.63% (6.2275 => 6.5160, std.dev.: 0.0456) MultiSource/Applications/lambda-0_1_3/lambda: 4.42% (7.4933 => 7.8247, std.dev.: 0.0512) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.21% (4.9453 => 5.1537, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.97% (4.9469 => 5.1434, std.dev.: 0.0298) MultiSource/Applications/hexxagon/hexxagon: 3.95% (14.0064 => 14.5590, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.26% (0.3587 => 0.3704, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 3.06% (3.6643 => 3.7766, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.85% (11.5690 => 11.8992, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.57% (8.2783 => 8.4911, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/lists: 2.51% (7.3375 => 7.5214, std.dev.: 0.0142) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.11% (4.8362 => 4.9384, std.dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.87% (1.1365 => 1.1577, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.66% (1.5941 => 1.6205, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/power/power: 1.49% (1.2061 => 1.2241) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.33% (2.4647 => 2.4974, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/neural/neural: 1.32% (1.0841 => 1.0984) SingleSource/Benchmarks/Misc/ReedSolomon: 1.32% (8.5322 => 8.6446, std.dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.28% (3.5679 => 3.6136, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.20% (44.5605 => 45.0930, std.dev.: 0.1786) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.71% (8.4179 => 8.1901, std.dev.: 0.0545) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.05% (5.4641 => 4.3141, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.40% (7.2130 => 6.1745, std.dev.: 0.0567) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.75% (1.0512 => 0.9382, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.10% (14.6451 => 13.3127, std.dev.: 0.1509) MultiSource/Benchmarks/mafft/pairlocalalign: -8.52% (63.1822 => 57.7979, std.dev.: 0.2927) SingleSource/Benchmarks/Shootout/heapsort: -8.35% (3.2926 => 3.0178, std.dev.: 0.0811) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.84% (4.7482 => 4.4236, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.24% (0.3269 => 0.3065, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.92% (3.7148 => 3.4950, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.90% (5.4972 => 5.1726, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.06% (5.1557 => 4.8947, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.40% (4.7449 => 4.5359, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.84% (6.0224 => 5.7910, std.dev.: 0.0115) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.73% (2.8773 => 2.7701, std.dev.: 0.0378) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.19% (0.5807 => 0.5622, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.13% (2.4490 => 2.3724, std.dev.: 0.0252) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.06% (1.2822 => 1.2430, std.dev.: 0.0133) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.04% (28.5821 => 27.7137, std.dev.: 0.0373) MultiSource/Applications/lua/lua: -3.02% (29.8330 => 28.9333, std.dev.: 0.2214) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.82% (2.6356 => 2.5612, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/hash2: -2.35% (3.4237 => 3.3432, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.25% (9.9065 => 9.6837, std.dev.: 0.0426) MultiSource/Applications/aha/aha: -2.23% (3.3398 => 3.2653, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/mason/mason: -2.22% (0.5415 => 0.5295, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.99% (11.5316 => 11.3026, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.62% (3.2169 => 3.1647, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.53% (4.9994 => 4.9227, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.24% (5.6343 => 5.5645, std.dev.: 0.0125) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.26% (1.0262 => 1.0699, std.dev.: 0.0148) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 69.92% (0.0123 => 0.0209, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.18% (0.0254 => 0.0251, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.86% (0.0384 => 0.0373, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -1.67% (0.0180 => 0.0177, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.85% (0.1438 => 0.1479, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.23% (1.1329 => 1.1468, std.dev.: 0.0631) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.28% (0.4164 => 0.4259, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.31% (0.1369 => 0.1428, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.99% (0.0641 => 0.0609, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 29.74% (0.0195 => 0.0253, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.33% (0.0578 => 0.0553, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.62% (1.1437 => 1.1965, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 600.00% (0.0001 => 0.0007, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.12% (0.0627 => 0.0620, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.72% (0.8017 => 0.7719, std.dev.: 0.0072) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -41.94% (0.0062 => 0.0036, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 22 16:21:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 22 Nov 2012 18:21:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121123002131.E01162A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6158?compare_to=6153&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6158, Order: 168504, Start Time: 2012-11-22 22:48:19, End Time: 2012-11-23 00:21:59 To: 6153, Order: 168502, Start Time: 2012-11-22 17:41:23, End Time: 2012-11-22 19:15:17 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (178 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (858 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.44% (55.8666 => 56.6735, std.dev.: 0.0344) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.25% (1.2783 => 1.3710, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.84% (54.5751 => 56.6735, std.dev.: 0.0344) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1013, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/salsa20: 2.42% (7.4937 => 7.6752, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/hash2: 2.34% (3.1932 => 3.2680, std.dev.: 0.0107) MultiSource/Benchmarks/llubenchmark/llu: 1.53% (3.7435 => 3.8007, std.dev.: 0.0119) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.60% (0.1431 => 0.1308, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.72% (0.3821 => 0.3526, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.81% (0.3848 => 0.3586, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -6.79% (0.3812 => 0.3553, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.78% (0.3896 => 0.3632, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.73% (0.3831 => 0.3573, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.70% (0.3880 => 0.3620, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.66% (0.3891 => 0.3632, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -6.65% (0.4033 => 0.3765, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.61% (0.4176 => 0.3900, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -6.58% (2.4924 => 2.3283, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -6.31% (0.4199 => 0.3934, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.31% (0.3884 => 0.3639, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.25% (0.9542 => 0.8946, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.22% (0.2428 => 0.2277, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.05% (0.6484 => 0.6092, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -6.03% (9.2283 => 8.6716, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/oourafft: -6.02% (0.2160 => 0.2030, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -5.98% (0.4280 => 0.4024, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -5.95% (7.0961 => 6.6736, std.dev.: 0.0063) MultiSource/Applications/JM/lencod/lencod: -5.95% (16.1920 => 15.2285, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.93% (0.3658 => 0.3441, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.90% (0.2355 => 0.2216, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.85% (0.9852 => 0.9276, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.82% (1.3722 => 1.2924, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.79% (1.0544 => 0.9934, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.77% (6.7716 => 6.3811, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.69% (4.8161 => 4.5423, std.dev.: 0.0040) MultiSource/Applications/sgefa/sgefa: -5.66% (0.3357 => 0.3167, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.62% (4.0323 => 3.8056, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/gs/gs: -5.61% (4.3330 => 4.0898, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.60% (4.8802 => 4.6068, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.60% (1.2300 => 1.1611, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.58% (3.5339 => 3.3366, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.57% (1.6364 => 1.5452, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.55% (1.4642 => 1.3829, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/football/football: -5.52% (0.9179 => 0.8672, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.49% (0.7919 => 0.7484, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -5.49% (0.3406 => 0.3219, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -5.45% (0.3025 => 0.2860, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.45% (0.2695 => 0.2548, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.43% (0.6293 => 0.5951, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -5.40% (0.2871 => 0.2716, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.39% (0.3837 => 0.3630, std.dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: -5.39% (1.1530 => 1.0908, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.39% (0.5863 => 0.5547, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.37% (0.3016 => 0.2854, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -5.35% (1.1450 => 1.0837, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.35% (0.2933 => 0.2776, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.34% (0.2548 => 0.2412, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.33% (0.5478 => 0.5186, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.33% (0.5591 => 0.5293, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.33% (4.5069 => 4.2667, std.dev.: 0.0043) MultiSource/Applications/Burg/burg: -5.33% (1.2515 => 1.1848, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.33% (0.5705 => 0.5401, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: -5.32% (0.3194 => 0.3024, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.32% (0.4813 => 0.4557, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.32% (0.3931 => 0.3722, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: -5.32% (0.4515 => 0.4275, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: -5.31% (0.3255 => 0.3082, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -5.31% (0.2939 => 0.2783, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.30% (2.1713 => 2.0562, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.29% (1.2784 => 1.2108, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/except: -5.29% (0.3026 => 0.2866, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.28% (0.5925 => 0.5612, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: -5.27% (0.2659 => 0.2519, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.25% (0.5805 => 0.5500, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.25% (0.7198 => 0.6820, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.24% (8.0126 => 7.5929, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.24% (14.2083 => 13.4643, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hello: -5.23% (0.2849 => 0.2700, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -5.23% (1.3148 => 1.2461, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/wc: -5.21% (0.3205 => 0.3038, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.21% (0.5857 => 0.5552, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.20% (0.5849 => 0.5545, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.19% (0.2985 => 0.2830, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.19% (0.6052 => 0.5738, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -5.18% (17.1032 => 16.2166, std.dev.: 0.0108) MultiSource/Applications/SPASS/SPASS: -5.18% (15.5079 => 14.7040, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.17% (0.3057 => 0.2899, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.17% (0.6446 => 0.6113, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.16% (0.6297 => 0.5972, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -5.14% (0.3581 => 0.3397, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.14% (0.5802 => 0.5504, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.14% (0.2999 => 0.2845, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.13% (0.5570 => 0.5284, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.11% (0.5575 => 0.5290, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.11% (0.4916 => 0.4665, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.10% (0.6230 => 0.5912, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.09% (0.3849 => 0.3653, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.09% (0.6660 => 0.6321, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.09% (0.6194 => 0.5879, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.08% (0.5999 => 0.5694, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.08% (0.6304 => 0.5984, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.07% (0.6667 => 0.6329, std.dev.: 0.0116) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.06% (0.8521 => 0.8090, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.05% (0.5859 => 0.5563, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -5.04% (0.4861 => 0.4616, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.02% (1.2210 => 1.1597, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.00% (0.6736 => 0.6399, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.00% (0.5581 => 0.5302, std.dev.: 0.0065) MultiSource/Applications/lua/lua: -5.00% (4.0594 => 3.8565, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.00% (0.3483 => 0.3309, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: -4.98% (1.3864 => 1.3174, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.97% (0.6260 => 0.5949, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.96% (0.2278 => 0.2165, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.93% (0.5456 => 0.5187, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: -4.93% (0.7447 => 0.7080, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (0.6681 => 0.6352, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.89% (0.2903 => 0.2761, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: -4.89% (0.3394 => 0.3228, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.88% (0.4321 => 0.4110, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.88% (0.3319 => 0.3157, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.88% (0.6189 => 0.5887, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -4.88% (0.3446 => 0.3278, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.88% (0.3323 => 0.3161, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.87% (0.4083 => 0.3884, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.87% (0.4151 => 0.3949, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.86% (0.2385 => 0.2269, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: -4.85% (0.3481 => 0.3312, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -4.85% (0.2989 => 0.2844, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.85% (0.5941 => 0.5653, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.84% (0.5168 => 0.4918, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.80% (0.5688 => 0.5415, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.80% (0.3252 => 0.3096, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.79% (0.6676 => 0.6356, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.78% (1.6474 => 1.5687, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.76% (22.4056 => 21.3394, std.dev.: 0.1300) MultiSource/Applications/ClamAV/clamscan: -4.74% (15.2527 => 14.5297, std.dev.: 0.0050) SingleSource/Regression/C++/ofstream_ctor: -4.74% (0.3059 => 0.2914, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.72% (0.6440 => 0.6136, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/lists1: -4.71% (0.3867 => 0.3685, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -4.68% (2.4021 => 2.2897, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/moments: -4.66% (0.4248 => 0.4050, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.66% (0.9557 => 0.9112, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.61% (0.6033 => 0.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.59% (0.7021 => 0.6699, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.56% (1.2221 => 1.1664, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -4.56% (0.3621 => 0.3456, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -4.54% (0.7982 => 0.7620, std.dev.: 0.0025) MultiSource/Applications/d/make_dparser: -4.50% (3.5154 => 3.3573, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.44% (0.6395 => 0.6111, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: -4.43% (0.3271 => 0.3126, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.40% (0.4427 => 0.4232, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -4.40% (18.2933 => 17.4876, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.40% (0.7524 => 0.7193, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.39% (0.7339 => 0.7017, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: -4.38% (0.6347 => 0.6069, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.37% (0.5329 => 0.5096, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.36% (0.6441 => 0.6160, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -4.33% (2.1401 => 2.0474, std.dev.: 0.0071) MultiSource/Benchmarks/Bullet/bullet: -4.32% (34.0927 => 32.6210, std.dev.: 0.0117) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.25% (0.9077 => 0.8691, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sieve: -4.22% (0.3788 => 0.3628, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.22% (0.5569 => 0.5334, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.19% (2.2587 => 2.1640, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.17% (0.5567 => 0.5335, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -4.11% (0.7779 => 0.7459, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.10% (0.8418 => 0.8073, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -4.07% (0.6750 => 0.6475, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.07% (0.3491 => 0.3349, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash: -4.05% (0.4524 => 0.4341, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.02% (0.6395 => 0.6138, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.62% (1.5610 => 1.5045, std.dev.: 0.0026) MultiSource/Applications/oggenc/oggenc: -3.52% (5.0226 => 4.8460, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.44% (5.4682 => 5.2802, std.dev.: 0.0122) SingleSource/UnitTests/Vector/constpool: -2.15% (20.7746 => 20.3289, std.dev.: 0.0130) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.48% (7.5137 => 5.7497, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.93% (2.2633 => 2.1744, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.06% (1.0557 => 1.0234, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.04% (1.3096 => 1.2698, std.dev.: 0.0086) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4705, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 22 17:59:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 22 Nov 2012 19:59:13 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121123015913.EB5712A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6159?compare_to=6156&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6159, Order: 168504, Start Time: 2012-11-22 23:40:09, End Time: 2012-11-23 01:59:38 To: 6156, Order: 168502, Start Time: 2012-11-22 20:26:51, End Time: 2012-11-22 22:46:52 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 88 (194 on baseline) Performance Improvements: 31 (40 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 967 (651 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 16.48% (1.7839 => 2.0778, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/richards_benchmark: 15.49% (0.0891 => 0.1029, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.06% (0.7533 => 0.8517, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/except: 12.99% (0.3125 => 0.3531, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.72% (0.4654 => 0.5246, std.dev.: 0.0079) MultiSource/Applications/Burg/burg: 12.63% (1.3278 => 1.4955, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/sieve: 12.50% (0.3968 => 0.4464, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: 12.48% (0.3085 => 0.3470, std.dev.: 0.0113) MultiSource/Applications/treecc/treecc: 12.44% (2.2753 => 2.5583, std.dev.: 0.0155) MultiSource/Applications/aha/aha: 12.43% (0.1327 => 0.1492, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 12.36% (0.3511 => 0.3945, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/methcall: 12.24% (0.3112 => 0.3493, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 12.23% (0.4054 => 0.4550, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/fibo: 12.12% (0.2955 => 0.3313, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.94% (0.4297 => 0.4810, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/wc: 11.70% (0.3300 => 0.3686, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary2: 11.60% (0.3673 => 0.4099, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.50% (0.5782 => 0.6447, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/chomp: 11.45% (0.1878 => 0.2093, std.dev.: 0.0012) SingleSource/Benchmarks/LivermoreLoops/kernel23: 11.19% (0.1108 => 0.1232, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/exptree: 11.05% (0.0923 => 0.1025, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 11.00% (0.3363 => 0.3733, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.96% (0.3138 => 0.3482, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: 10.96% (0.3576 => 0.3968, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.79% (0.1900 => 0.2105, std.dev.: 0.0016) SingleSource/Benchmarks/LivermoreLoops/kernel24: 10.50% (0.1000 => 0.1105, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: 10.18% (0.1601 => 0.1764, std.dev.: 0.0003) SingleSource/Benchmarks/LivermoreLoops/kernel22: 10.09% (0.1011 => 0.1113, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.07% (0.1896 => 0.2087, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2400 => 0.2640, std.dev.: 0.0022) SingleSource/Benchmarks/LivermoreLoops/kernel20: 9.95% (0.1045 => 0.1149, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.77% (0.3748 => 0.4114, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 9.73% (0.1326 => 0.1455, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 9.71% (0.3162 => 0.3469, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.64% (0.2562 => 0.2809, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.63% (0.2876 => 0.3153, std.dev.: 0.0063) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.56% (0.3556 => 0.3896, std.dev.: 0.0071) MultiSource/Applications/siod/siod: 9.52% (2.5769 => 2.8223, std.dev.: 0.0608) SingleSource/UnitTests/SignlessTypes/rem: 9.45% (0.1259 => 0.1378, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.40% (1.1053 => 1.2092, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/health/health: 9.35% (0.1455 => 0.1591, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.25% (0.3211 => 0.3508, std.dev.: 0.0074) MultiSource/Applications/sgefa/sgefa: 9.10% (0.3516 => 0.3836, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: 8.95% (1.7249 => 1.8793, std.dev.: 0.0274) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.66% (0.1328 => 0.1443, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-2: 8.51% (0.3915 => 0.4248, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/distray/distray: 8.50% (0.1530 => 0.1660, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.11% (0.1270 => 0.1373, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 8.03% (0.3933 => 0.4249, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.97% (0.5595 => 0.6041, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/tsp/tsp: 7.94% (0.1410 => 0.1522, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.74% (0.4420 => 0.4762, std.dev.: 0.0092) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.56% (0.3982 => 0.4283, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: 7.33% (0.4763 => 0.5112, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/hash2: 7.28% (0.5113 => 0.5485, std.dev.: 0.0118) MultiSource/Applications/lua/lua: 6.70% (4.4412 => 4.7389, std.dev.: 0.1038) MultiSource/Applications/viterbi/viterbi: 6.61% (0.1786 => 0.1904, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/oourafft: 5.27% (0.3588 => 0.3777, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: 5.04% (0.2102 => 0.2208, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.74% (0.3967 => 0.4155, std.dev.: 0.0064) MultiSource/Applications/JM/lencod/lencod: 1.12% (32.2392 => 32.5989, std.dev.: 0.1002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: 35.24% (5.6773 => 7.6782, std.dev.: 0.0229) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.53% (0.3419 => 0.4326, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/ary3: 26.26% (3.7668 => 4.7559, std.dev.: 0.1288) SingleSource/Benchmarks/Shootout/ary3: 26.20% (3.7734 => 4.7622, std.dev.: 0.2172) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 24.57% (3.8081 => 4.7438, std.dev.: 0.0265) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 20.53% (1.3354 => 1.6096, std.dev.: 0.0322) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 19.30% (5.3834 => 6.4226, std.dev.: 0.0399) SingleSource/Benchmarks/CoyoteBench/lpbench: 18.91% (10.3777 => 12.3401, std.dev.: 0.3356) SingleSource/Benchmarks/Shootout-C++/ary: 16.97% (0.0760 => 0.0889, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bisort/bisort: 15.71% (0.8652 => 1.0011, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary2: 15.33% (0.0763 => 0.0880, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 13.02% (1.1024 => 1.2459, std.dev.: 0.0224) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 11.83% (2.7558 => 3.0817, std.dev.: 0.0176) SingleSource/Benchmarks/BenchmarkGame/puzzle: 11.82% (0.6945 => 0.7766, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.46% (1.7376 => 1.9367, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 9.29% (7.6152 => 8.3229, std.dev.: 0.0288) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 7.52% (0.4109 => 0.4418, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/chomp: 6.92% (1.2129 => 1.2968, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/neural/neural: 4.97% (0.2234 => 0.2345, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 4.22% (0.6165 => 0.6425, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.93% (3.7163 => 3.8623, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.27% (5.2175 => 5.3883, std.dev.: 0.0380) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.44% (61.0203 => 62.5121, std.dev.: 0.1305) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.97% (18.9722 => 19.3455, std.dev.: 0.1240) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.84% (1.5605 => 1.5892, std.dev.: 0.0054) MultiSource/Applications/sgefa/sgefa: 1.74% (0.6304 => 0.6414, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.19% (1.3330 => 1.3488, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -14.30% (0.2287 => 0.1960, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/hello: -10.48% (0.3274 => 0.2931, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -10.41% (0.4206 => 0.3768, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -10.32% (0.1619 => 0.1452, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/bigfib: -10.24% (0.8043 => 0.7219, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -10.04% (4.1675 => 3.7492, std.dev.: 0.0189) SingleSource/Benchmarks/LivermoreLoops/kernel03: -9.49% (0.1096 => 0.0992, std.dev.: 0.0029) SingleSource/Benchmarks/LivermoreLoops/kernel08: -9.43% (0.1358 => 0.1230, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel04: -9.36% (0.1165 => 0.1056, std.dev.: 0.0031) SingleSource/Benchmarks/LivermoreLoops/kernel05: -9.32% (0.1105 => 0.1002, std.dev.: 0.0021) SingleSource/Benchmarks/LivermoreLoops/kernel10: -9.27% (0.1154 => 0.1047, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.25% (0.7856 => 0.7129, std.dev.: 0.0192) SingleSource/Benchmarks/LivermoreLoops/kernel06: -9.25% (0.1146 => 0.1040, std.dev.: 0.0000) SingleSource/Benchmarks/LivermoreLoops/kernel02: -9.25% (0.1157 => 0.1050, std.dev.: 0.0032) SingleSource/Benchmarks/LivermoreLoops/kernel01: -9.16% (0.1113 => 0.1011, std.dev.: 0.0032) SingleSource/Benchmarks/LivermoreLoops/kernel09: -8.96% (0.1161 => 0.1057, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: -8.91% (10.0795 => 9.1818, std.dev.: 0.1076) SingleSource/Benchmarks/Shootout-C++/moments: -8.84% (0.4877 => 0.4446, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.12% (4.6394 => 4.3556, std.dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: -3.46% (21.6066 => 20.8580, std.dev.: 0.1024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.53% (0.6749 => 0.6646, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: -9.43% (0.1453 => 0.1316, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -8.50% (10.0930 => 9.2353, std.dev.: 0.0266) SingleSource/Benchmarks/Shootout/heapsort: -8.40% (4.2906 => 3.9302, std.dev.: 0.0444) SingleSource/Benchmarks/Shootout-C++/moments: -8.11% (0.1320 => 0.1213, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: -6.88% (2.1003 => 1.9557, std.dev.: 0.0553) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -6.47% (6.7703 => 6.3323, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -4.77% (6.4353 => 6.1285, std.dev.: 0.0100) MultiSource/Benchmarks/Olden/em3d/em3d: -2.64% (3.1943 => 3.1100, std.dev.: 0.0277) MultiSource/Applications/SIBsim4/SIBsim4: -1.98% (3.9385 => 3.8605, std.dev.: 0.0173) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.55% (3.0685 => 3.0208, std.dev.: 0.0009) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.17% (69.1573 => 69.0397, std.dev.: 0.3717) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -2.12% (0.1368 => 0.1339, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -11.23% (0.0472 => 0.0419, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.45% (0.0652 => 0.0681, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -0.07% (493.8308 => 493.4897, std.dev.: 0.3707) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.16% (63.2438 => 69.0397, std.dev.: 0.3717) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0419, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43660.73% (1.1277 => 493.4897, std.dev.: 0.3707) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 192.89% (0.5229 => 1.5315, std.dev.: 0.0837) MultiSource/Applications/SPASS/SPASS: 19.97% (14.9895 => 17.9827, std.dev.: 0.2411) MultiSource/Applications/kimwitu++/kc: 47.35% (14.1553 => 20.8580, std.dev.: 0.1024) MultiSource/Benchmarks/MallocBench/gs/gs: 14.53% (4.1105 => 4.7076, std.dev.: 0.2981) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 38.79% (1.1048 => 1.5333, std.dev.: 0.0546) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 430.48% (7.1582 => 37.9729, std.dev.: 0.4450) SingleSource/Benchmarks/Misc-C++-EH/spirit: 79.42% (3.4629 => 6.2130, std.dev.: 0.1511) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.00% (0.6222 => 1.0266, std.dev.: 0.0718) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11459.58% (0.0720 => 8.3229, std.dev.: 0.0288) MultiSource/Applications/SIBsim4/SIBsim4: 3860400.00% (0.0001 => 3.8605, std.dev.: 0.0173) MultiSource/Applications/SPASS/SPASS: 15090700.00% (0.0001 => 15.0908, std.dev.: 1.1875) MultiSource/Applications/kimwitu++/kc: 53500.00% (0.0001 => 0.0536, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63800.00% (0.0001 => 0.0639, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576200.00% (0.0001 => 0.5763, std.dev.: 0.0223) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10075500.00% (0.0001 => 10.0756, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7678100.00% (0.0001 => 7.6782, std.dev.: 0.0229) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1770.46% (1.1194 => 20.9379, std.dev.: 0.5227) MultiSource/Applications/ClamAV/clamscan: 65.12% (22.1758 => 36.6157, std.dev.: 0.7005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.42% (7.0540 => 11.1041, std.dev.: 0.2909) MultiSource/Benchmarks/FreeBench/distray/distray: 57.20% (0.1056 => 0.1660, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.03% (2.9384 => 4.6142, std.dev.: 0.3261) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.72% (8.1363 => 12.1819, std.dev.: 0.2399) MultiSource/Applications/JM/lencod/lencod: 48.60% (21.9371 => 32.5989, std.dev.: 0.1002) SingleSource/Benchmarks/Misc/flops: 44.13% (0.1432 => 0.2064, std.dev.: 0.0005) SingleSource/UnitTests/vla: 42.25% (0.0355 => 0.0505, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 37.95% (0.0730 => 0.1007, std.dev.: 0.0042) SingleSource/Benchmarks/Stanford/Oscar: 37.11% (0.0636 => 0.0872, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: 34.85% (0.0746 => 0.1006, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 33.27% (0.1566 => 0.2087, std.dev.: 0.0046) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 32.89% (0.1584 => 0.2105, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 31.02% (1.5859 => 2.0778, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/voronoi/voronoi: 29.93% (0.2700 => 0.3508, std.dev.: 0.0074) MultiSource/Applications/aha/aha: 29.63% (0.1151 => 0.1492, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 29.53% (0.1175 => 0.1522, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/dot-syntax: 29.01% (0.0355 => 0.0458, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 28.46% (1.1642 => 1.4955, std.dev.: 0.0167) SingleSource/Benchmarks/Stanford/Towers: 28.45% (0.0471 => 0.0605, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 28.27% (0.1125 => 0.1443, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.97% (0.0479 => 0.0613, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.60% (0.6675 => 0.8517, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/08-main/main: 27.53% (0.2554 => 0.3257, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/bisort/bisort: 27.36% (0.0614 => 0.0782, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/messages-2: 27.19% (0.0662 => 0.0842, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/treeadd/treeadd: 27.16% (0.0416 => 0.0529, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.11% (0.0793 => 0.1008, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: 26.47% (0.1655 => 0.2093, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.29% (0.5105 => 0.6447, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 26.27% (0.0491 => 0.0620, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 26.19% (2.0273 => 2.5583, std.dev.: 0.0155) SingleSource/Benchmarks/McGill/exptree: 25.92% (0.0814 => 0.1025, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/matrix: 25.92% (0.0818 => 0.1030, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.85% (0.0886 => 0.1115, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 25.63% (0.0437 => 0.0549, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: 25.47% (0.1268 => 0.1591, std.dev.: 0.0020) SingleSource/Benchmarks/Stanford/IntMM: 25.38% (0.0394 => 0.0494, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 25.30% (0.2107 => 0.2640, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/perimeter/perimeter: 25.06% (0.0770 => 0.0963, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0408 => 0.0510, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 24.95% (0.0457 => 0.0571, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/17-bintr/bintr: 24.89% (0.0675 => 0.0843, std.dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.83% (0.3121 => 0.3896, std.dev.: 0.0071) SingleSource/Benchmarks/Stanford/Treesort: 24.82% (0.0411 => 0.0513, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 24.82% (0.4203 => 0.5246, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/reversefile: 24.45% (0.3865 => 0.4810, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/wordfreq: 24.40% (0.3307 => 0.4114, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/sieve: 23.90% (0.3603 => 0.4464, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 23.83% (0.9765 => 1.2092, std.dev.: 0.0102) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.75% (0.0842 => 0.1042, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.69% (0.2271 => 0.2809, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 23.51% (0.3684 => 0.4550, std.dev.: 0.0159) MultiSource/Applications/sgefa/sgefa: 23.38% (0.3109 => 0.3836, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.35% (0.1032 => 0.1273, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/except: 22.99% (0.2871 => 0.3531, std.dev.: 0.0041) MultiSource/Applications/siod/siod: 22.87% (2.2969 => 2.8223, std.dev.: 0.0608) SingleSource/Benchmarks/CoyoteBench/huffbench: 22.62% (0.0871 => 0.1068, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 22.57% (0.0443 => 0.0543, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 22.57% (0.2831 => 0.3470, std.dev.: 0.0113) MultiSource/Applications/viterbi/viterbi: 22.44% (0.1555 => 0.1904, std.dev.: 0.0026) MultiSource/Applications/lua/lua: 22.38% (3.8723 => 4.7389, std.dev.: 0.1038) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 22.35% (0.0953 => 0.1166, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary: 22.06% (0.3232 => 0.3945, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/fibo: 21.58% (0.2725 => 0.3313, std.dev.: 0.0113) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.56% (0.1062 => 0.1291, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/exceptions-2: 21.48% (0.3497 => 0.4248, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 21.41% (0.2877 => 0.3493, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 21.31% (0.3379 => 0.4099, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 21.13% (0.2603 => 0.3153, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/whetstone: 21.06% (0.0660 => 0.0799, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 20.90% (0.1268 => 0.1533, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary3: 20.87% (0.3283 => 0.3968, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-3: 20.85% (0.3516 => 0.4249, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/wc: 20.77% (0.3052 => 0.3686, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/neural/neural: 20.57% (0.1463 => 0.1764, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 20.50% (0.3098 => 0.3733, std.dev.: 0.0043) SingleSource/UnitTests/SignlessTypes/rem: 20.45% (0.1144 => 0.1378, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 20.44% (1.5603 => 1.8793, std.dev.: 0.0274) SingleSource/Benchmarks/Shootout-C++/sumcol: 20.44% (0.2891 => 0.3482, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 20.35% (0.1695 => 0.2040, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/functionobjects: 20.34% (0.5020 => 0.6041, std.dev.: 0.0095) SingleSource/UnitTests/Vector/SSE/sse_isamax: 20.17% (0.0704 => 0.0846, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/bmm/bmm: 20.16% (0.0759 => 0.0912, std.dev.: 0.0053) SingleSource/UnitTests/2006-12-11-LoadConstants: 20.12% (0.1143 => 0.1373, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 20.00% (0.2065 => 0.2478, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 19.80% (1.5415 => 1.8467, std.dev.: 0.0389) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.55% (0.8172 => 0.9770, std.dev.: 0.0287) SingleSource/Regression/C++/ofstream_ctor: 19.41% (0.2905 => 0.3469, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.34% (0.5569 => 0.6646, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: 19.19% (0.4289 => 0.5112, std.dev.: 0.0099) SingleSource/UnitTests/SignlessTypes/Large/cast: 19.15% (0.0564 => 0.0672, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-4: 18.91% (0.3543 => 0.4213, std.dev.: 0.0157) MultiSource/Applications/oggenc/oggenc: 18.84% (5.7591 => 6.8444, std.dev.: 0.1942) SingleSource/Benchmarks/Shootout-C++/hash2: 18.72% (0.4620 => 0.5485, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 18.62% (0.1337 => 0.1586, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.52% (14.3668 => 17.0279, std.dev.: 0.4460) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 18.11% (0.2430 => 0.2870, std.dev.: 0.0110) SingleSource/UnitTests/ObjC/parameter-passing: 18.05% (0.3927 => 0.4636, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.54% (0.0798 => 0.0938, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.46% (0.1117 => 0.1312, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/instance-method-metadata: 17.27% (0.3543 => 0.4155, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/Large/ray: 17.18% (0.4064 => 0.4762, std.dev.: 0.0092) SingleSource/UnitTests/ObjC/for-in: 16.84% (0.3694 => 0.4316, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.70% (0.3162 => 0.3690, std.dev.: 0.0151) SingleSource/UnitTests/ObjC/exceptions: 16.67% (0.3828 => 0.4466, std.dev.: 0.0096) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.55% (0.8101 => 0.9442, std.dev.: 0.0305) MultiSource/Benchmarks/Olden/mst/mst: 15.74% (0.1163 => 0.1346, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/05-eks/eks: 15.68% (0.4299 => 0.4973, std.dev.: 0.0223) MultiSource/Benchmarks/Olden/em3d/em3d: 15.63% (0.1695 => 0.1960, std.dev.: 0.0083) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.35% (0.0834 => 0.0962, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/oourafft: 15.08% (0.3282 => 0.3777, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.06% (0.0770 => 0.0886, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: 14.84% (17.1811 => 19.7305, std.dev.: 0.5673) MultiSource/Applications/hexxagon/hexxagon: 14.41% (1.2842 => 1.4693, std.dev.: 0.0465) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.94% (1.1861 => 1.3514, std.dev.: 0.0632) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.81% (5.0018 => 5.6924, std.dev.: 0.1841) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.76% (0.5981 => 0.6804, std.dev.: 0.0226) MultiSource/Applications/spiff/spiff: 13.57% (0.7835 => 0.8898, std.dev.: 0.0387) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.41% (0.1029 => 0.1167, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/city/city: 13.23% (2.0665 => 2.3400, std.dev.: 0.0727) MultiSource/Benchmarks/mafft/pairlocalalign: 13.10% (9.4845 => 10.7274, std.dev.: 0.3789) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.61% (1.3050 => 1.4696, std.dev.: 0.0604) MultiSource/Applications/d/make_dparser: 12.41% (3.3354 => 3.7492, std.dev.: 0.0189) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.22% (0.1906 => 0.2139, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/block-byref-aggr: 12.21% (0.3817 => 0.4283, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/property: 12.09% (0.3886 => 0.4356, std.dev.: 0.0148) SingleSource/UnitTests/ObjC/trivial-interface: 12.01% (0.3473 => 0.3890, std.dev.: 0.0125) SingleSource/UnitTests/ObjC/synchronized: 11.99% (0.3561 => 0.3988, std.dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.91% (3.8922 => 4.3556, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 11.82% (0.6456 => 0.7219, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.35% (2.2022 => 2.4522, std.dev.: 0.0334) MultiSource/Benchmarks/PAQ8p/paq8p: 10.53% (10.3673 => 11.4592, std.dev.: 0.2175) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.53% (0.6450 => 0.7129, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout-C++/lists: 10.11% (0.3422 => 0.3768, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 9.83% (0.4048 => 0.4446, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 9.25% (0.6030 => 0.6588, std.dev.: 0.0132) SingleSource/UnitTests/ObjC++/Hello: 8.96% (0.5925 => 0.6456, std.dev.: 0.0179) SingleSource/UnitTests/ObjC++/property-reference: 8.63% (0.7326 => 0.7958, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/hello: 8.00% (0.2714 => 0.2931, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.67% (0.3935 => 0.4158, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.40% (4.3953 => 11.0060, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/methcall: 147.42% (5.3999 => 13.3602, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 32.86% (0.3256 => 0.4326, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout/ary3: 28.73% (3.6994 => 4.7622, std.dev.: 0.2172) SingleSource/Benchmarks/Shootout-C++/ary3: 27.77% (3.7221 => 4.7559, std.dev.: 0.1288) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 23.39% (1.3045 => 1.6096, std.dev.: 0.0322) MultiSource/Applications/minisat/minisat: 22.03% (9.1159 => 11.1237, std.dev.: 0.7110) MultiSource/Benchmarks/Olden/bisort/bisort: 20.14% (0.8333 => 1.0011, std.dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/lpbench: 19.27% (10.3460 => 12.3401, std.dev.: 0.3356) SingleSource/Benchmarks/Shootout-C++/ary: 17.59% (0.0756 => 0.0889, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/oourafft: 17.43% (6.6465 => 7.8053, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.33% (1.1145 => 1.3076, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary2: 16.25% (0.0757 => 0.0880, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 15.52% (1.0785 => 1.2459, std.dev.: 0.0224) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.79% (0.2944 => 0.3350, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.69% (2.8904 => 3.2284, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 11.55% (0.6962 => 0.7766, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.60% (8.6802 => 9.6007, std.dev.: 0.2710) SingleSource/Benchmarks/Misc/richards_benchmark: 10.28% (1.1396 => 1.2568, std.dev.: 0.0014) SingleSource/Benchmarks/Stanford/Puzzle: 10.06% (0.1421 => 0.1564, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.28% (1.7254 => 1.8856, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 8.93% (3.1578 => 3.4398, std.dev.: 0.0644) SingleSource/Benchmarks/Misc/ffbench: 7.50% (0.9505 => 1.0218, std.dev.: 0.0241) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.12% (3.6395 => 3.8623, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.94% (0.9540 => 1.0107, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.67% (4.2280 => 4.4678, std.dev.: 0.0110) MultiSource/Benchmarks/Fhourstones/fhourstones: 5.66% (1.8329 => 1.9367, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 5.12% (26.0924 => 27.4279, std.dev.: 0.1674) SingleSource/Regression/C/uint64_to_float: 5.08% (0.5413 => 0.5688, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 5.02% (0.2233 => 0.2345, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 4.81% (1.2373 => 1.2968, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 4.69% (0.7455 => 0.7805, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.24% (1.7133 => 1.7860, std.dev.: 0.0129) MultiSource/Benchmarks/nbench/nbench: 4.13% (11.6436 => 12.1245, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists1: 4.12% (0.6171 => 0.6425, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 3.07% (0.6223 => 0.6414, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.39% (2.1424 => 2.1937, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/heapsort: 2.16% (3.8532 => 3.9366, std.dev.: 0.0216) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.15% (1.3677 => 1.3971, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 2.10% (3.1595 => 3.2259, std.dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: 2.05% (2.4116 => 2.4611, std.dev.: 0.0067) MultiSource/Benchmarks/PAQ8p/paq8p: 1.89% (85.0658 => 86.6726, std.dev.: 0.1182) MultiSource/Benchmarks/mafft/pairlocalalign: 1.62% (27.8444 => 28.2949, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/sieve: 1.48% (2.4858 => 2.5225, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/lists: 1.41% (12.5348 => 12.7116, std.dev.: 0.0508) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.33% (1.0313 => 1.0450, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.30% (5.2139 => 5.2819, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.27% (6.5088 => 6.5916, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0501, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: 1.13% (1.9577 => 1.9798, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1672, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.86% (5.2763 => 1.2208, std.dev.: 0.0608) SingleSource/Benchmarks/Misc/salsa20: -74.48% (0.8651 => 0.2208, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -36.56% (0.1622 => 0.1029, std.dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: -12.02% (10.4361 => 9.1818, std.dev.: 0.1076) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.48% (5.3526 => 4.7383, std.dev.: 0.1304) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.77% (5.3855 => 4.8057, std.dev.: 0.1204) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.57% (1.7609 => 1.6276, std.dev.: 0.0488) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.26% (0.3987 => 0.2382, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.30% (4.5009 => 2.7769, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -33.53% (1.1492 => 0.7639, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.12% (2.6546 => 2.0142, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/mason/mason: -19.30% (0.2161 => 0.1744, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.53% (1.6925 => 1.4297, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2838, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.80% (32.5116 => 29.0014, std.dev.: 0.0215) SingleSource/Benchmarks/Misc/mandel-2: -10.62% (1.5373 => 1.3740, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -10.54% (9.5636 => 8.5558, std.dev.: 0.1926) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.56% (1.5660 => 1.4319, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.92% (4.8142 => 4.4812, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.2416 => 3.0208, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7497) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5784, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -4.91% (1.5835 => 1.5057, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: -4.24% (6.2999 => 6.0325, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.54% (1.6805 => 1.6210, std.dev.: 0.0227) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.39% (0.9957 => 0.9619, std.dev.: 0.0098) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8918, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.02% (19.9488 => 19.3455, std.dev.: 0.1240) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.25% (0.4808 => 0.4700, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.87% (8.1563 => 8.0037, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -1.45% (10.2830 => 10.1336, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.82% (0.2116 => 0.0681, std.dev.: 0.0012) Report Time: 2.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 22 18:34:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 22 Nov 2012 20:34:24 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121123023424.E75602A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6160?compare_to=6155&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6160, Order: 168504, Start Time: 2012-11-22 23:13:48, End Time: 2012-11-23 02:34:51 To: 6155, Order: 168502, Start Time: 2012-11-22 19:04:37, End Time: 2012-11-22 22:25:26 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (170 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1090 (720 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.68% (2.0689 => 2.1244, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.59% (54.0334 => 54.8932, std.dev.: 0.0073) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 45.28% (0.0625 => 0.0908, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.71% (0.1063 => 0.1432, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 26.42% (1.5932 => 2.0141, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.29% (0.4253 => 0.5371, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.17% (0.2969 => 0.3746, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.77% (0.1106 => 0.1391, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.21% (0.0714 => 0.0894) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.86% (0.4139 => 0.5168, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.07% (0.4994 => 0.6196, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.44% (0.5000 => 0.6172, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.41% (0.5900 => 0.7281, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.77% (0.0584 => 0.0717, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.49% (0.0547 => 0.0670, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.94% (0.1021 => 0.1245, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.91% (0.1620 => 0.1975, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.86% (0.1107 => 0.1349, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.74% (0.0897 => 0.1092, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 21.54% (0.0599 => 0.0728, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.38% (0.0633 => 0.0762, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.22% (0.1103 => 0.1326, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.22% (0.3903 => 0.4692, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.21% (0.0584 => 0.0702, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.09% (0.0642 => 0.0771, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 20.04% (0.0948 => 0.1138, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.94% (0.1003 => 0.1203, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.82% (0.1549 => 0.1856, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 19.73% (0.0821 => 0.0983, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.46% (0.0822 => 0.0982, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.33% (0.1604 => 0.1914, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 19.21% (0.0604 => 0.0720, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 19.15% (0.1619 => 0.1929, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.81% (0.1462 => 0.1737, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.48% (0.0947 => 0.1122, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 18.32% (0.0808 => 0.0956, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.30% (0.3890 => 0.4602, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.92% (0.2014 => 0.2375, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.69% (1.3152 => 1.5478, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.58% (0.2736 => 0.3217, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 17.56% (0.5826 => 0.6849, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 17.49% (0.1218 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 17.32% (0.4029 => 0.4727, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.28% (0.1088 => 0.1276, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 17.10% (0.5889 => 0.6896, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 17.08% (0.1505 => 0.1762, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.06% (0.2866 => 0.3355, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 16.82% (0.5546 => 0.6479, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 16.60% (1.8794 => 2.1914, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.52% (3.5627 => 4.1511, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 16.43% (0.9697 => 1.1290, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.36% (0.1968 => 0.2290, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.34% (0.4658 => 0.5419, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 16.31% (1.0781 => 1.2539, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.26% (1.6211 => 1.8847, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.23% (0.3271 => 0.3802, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.21% (0.1160 => 0.1348, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.12% (0.5026 => 0.5836, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 15.98% (0.7171 => 0.8317, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 15.83% (0.1421 => 0.1646, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.78% (0.4361 => 0.5049, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.65% (0.2875 => 0.3325, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.60% (0.3930 => 0.4543, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.41% (0.1090 => 0.1258, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.38% (4.4195 => 5.0993, std.dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.32% (2.7292 => 3.1473, std.dev.: 0.0048) SingleSource/Regression/C++/ofstream_ctor: 15.28% (0.3004 => 0.3463, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 15.26% (0.1284 => 0.1480, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 15.18% (4.2109 => 4.8502, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.87% (1.9694 => 2.2622, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 14.72% (0.2738 => 0.3141, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 14.70% (0.2714 => 0.3113, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 14.69% (0.2750 => 0.3154, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 14.68% (0.2725 => 0.3125, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 14.55% (0.2075 => 0.2377, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.54% (0.2792 => 0.3198, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 14.53% (0.2780 => 0.3184, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 14.51% (0.2729 => 0.3125, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 14.50% (0.2813 => 0.3221, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.45% (1.9966 => 2.2852, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/random: 14.45% (0.2803 => 0.3208, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 14.41% (0.9909 => 1.1337, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/objinst: 14.38% (0.2823 => 0.3229, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 14.37% (0.2811 => 0.3215, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.27% (0.3195 => 0.3651, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.26% (0.2911 => 0.3326, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 14.21% (0.3096 => 0.3536, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 14.19% (0.2566 => 0.2930, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.14% (2.0673 => 2.3596, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary3: 13.96% (0.3267 => 0.3723, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 13.95% (23.5202 => 26.8015, std.dev.: 0.0198) SingleSource/Benchmarks/Shootout-C++/ary2: 13.87% (0.3317 => 0.3777, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 13.81% (0.3258 => 0.3708, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 13.53% (1.4269 => 1.6199, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.47% (0.3362 => 0.3815, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.46% (0.3060 => 0.3472, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 13.44% (0.3496 => 0.3966, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.41% (0.3124 => 0.3543, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.34% (0.3442 => 0.3901, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.33% (0.3488 => 0.3953, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.28% (0.3465 => 0.3925, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 13.27% (0.7875 => 0.8920, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 13.27% (0.3678 => 0.4166, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.27% (0.3460 => 0.3919, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.26% (0.3446 => 0.3903, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 13.23% (0.3469 => 0.3928, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.22% (0.3282 => 0.3716, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 13.20% (0.3348 => 0.3790, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.08% (0.3625 => 0.4099, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 13.06% (0.3477 => 0.3931, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 12.91% (0.3726 => 0.4207, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.88% (0.3650 => 0.4120, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 12.81% (0.4146 => 0.4677, std.dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 12.79% (2.1653 => 2.4423, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions: 12.76% (0.3643 => 0.4108, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 12.68% (0.4251 => 0.4790, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.67% (0.3724 => 0.4196, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.61% (0.3845 => 0.4330, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.53% (0.3981 => 0.4480, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.52% (0.3690 => 0.4152, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 12.51% (4.6177 => 5.1956, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 12.45% (2.1013 => 2.3630, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 11.97% (0.5012 => 0.5612, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 11.93% (0.2691 => 0.3012, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.76% (0.2040 => 0.2280, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 11.57% (5.5417 => 6.1826, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.06% (0.6435 => 0.7147, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.80% (0.1028 => 0.1139, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 10.69% (0.6634 => 0.7343, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 10.63% (0.3498 => 0.3870, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.48% (0.1383 => 0.1528, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.25% (0.3084 => 0.3400, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 10.17% (0.4847 => 0.5340, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.15% (0.2068 => 0.2278, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.12% (0.2737 => 0.3014, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 9.62% (0.3336 => 0.3657, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 9.28% (2.0346 => 2.2234, std.dev.: 0.0052) MultiSource/Applications/lemon/lemon: 9.24% (0.2391 => 0.2612) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.22% (0.2103 => 0.2297, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.77% (0.5361 => 0.5831, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.62% (0.7426 => 0.8066, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.51% (4.6926 => 5.0920, std.dev.: 0.0130) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.01% (11.6398 => 12.5727, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.66% (0.5584 => 0.6012, std.dev.: 0.0031) MultiSource/Applications/kimwitu++/kc: 6.38% (11.9555 => 12.7178, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.90% (0.3792 => 0.3940, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.89% (0.2802 => 0.3079, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6116, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6724, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-2: 4.81% (1.8057 => 1.8925, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1721, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.49% (0.3693 => 0.3859, std.dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6438, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ary3: 2.14% (15.8721 => 16.2115, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.04% (2.0820 => 2.1244, std.dev.: 0.0047) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.69% (3.1722 => 3.2258, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3019, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2853, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5123, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5869, std.dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.03% (2.4764 => 2.4014, std.dev.: 0.0256) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.89% (25.4195 => 16.5508, std.dev.: 0.0208) SingleSource/Benchmarks/Shootout-C++/ary2: -10.66% (0.2402 => 0.2146, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9805, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7867, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8002, std.dev.: 0.0071) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7734, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.00% (0.6293 => 0.6104, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.48% (17.2379 => 16.8106, std.dev.: 0.0474) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8678, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5742, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4953, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0431, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.02% (105.3826 => 104.3048, std.dev.: 0.0118) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 00:11:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 02:11:59 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121123081159.8B9172A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6161?compare_to=6157&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6161, Order: 168505, Start Time: 2012-11-23 06:42:10, End Time: 2012-11-23 08:12:27 To: 6157, Order: 168504, Start Time: 2012-11-22 22:44:58, End Time: 2012-11-23 00:14:56 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 17 (125 on baseline) Performance Improvements: 1 (27 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1036 (822 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: 8.21% (0.1681 => 0.1819, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.96% (0.2181 => 0.2311, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.51% (0.2419 => 0.2528, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.79% (0.8687 => 0.9016, std.dev.: 0.0096) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.37% (0.8387 => 0.8670, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.19% (0.7746 => 0.7993, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.08% (0.9705 => 1.0004, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 2.94% (0.3437 => 0.3538, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.57% (0.5917 => 0.6069, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/gs/gs: 2.32% (4.2068 => 4.3042, std.dev.: 0.0288) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.78% (1.6780 => 1.7079, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.76% (8.7390 => 8.8932, std.dev.: 0.0596) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.59% (2.2181 => 2.2533, std.dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 1.12% (1.1637 => 1.1767, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.00% (1.2545 => 1.2671, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: 4.15% (4.3226 => 4.5020, std.dev.: 0.0195) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.58% (3.5745 => 3.6309, std.dev.: 0.0115) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -5.56% (3.8556 => 3.6413, std.dev.: 0.0676) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.18% (1.0699 => 1.0718, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -35.41% (0.0209 => 0.0135, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0427 => 0.0428, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 32.67% (0.0251 => 0.0333, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.96% (0.0312 => 0.0315, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 13.67% (0.0373 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0203 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 22.03% (0.0177 => 0.0216, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -87.50% (0.0008 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.41% (0.1479 => 0.1473, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -2.12% (1.1468 => 1.1225, std.dev.: 0.0420) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.93% (0.4259 => 0.4177, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.80% (0.1428 => 0.1388, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.63% (0.0609 => 0.0625, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.70% (0.0253 => 0.0275, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.36% (0.0553 => 0.0551, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.10% (1.1965 => 1.1977, std.dev.: 0.0233) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 171.43% (0.0007 => 0.0019, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.52% (0.0620 => 0.0648, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0266 => 0.0266, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.23% (0.7719 => 0.7737, std.dev.: 0.0304) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 16.67% (0.0036 => 0.0042, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.64% (16.4461 => 17.7027, std.dev.: 0.2415) MultiSource/Applications/sqlite3/sqlite3: 2321.57% (0.6332 => 15.3334, std.dev.: 0.1412) MultiSource/Benchmarks/McCat/08-main/main: 49.43% (0.1831 => 0.2736, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.98% (0.1559 => 0.1497, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7079.60% (0.3123 => 22.4219, std.dev.: 0.3751) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.30% (0.2463 => 0.3702, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1530.74% (0.3344 => 5.4532, std.dev.: 0.0269) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.76% (0.2364 => 0.3233, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 5.26% (0.6010 => 0.6326, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0429 => 0.0439, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.41% (0.3266 => 0.3410, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/strcat: 3.45% (0.1969 => 0.2037, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -4.02% (0.0224 => 0.0215, std.dev.: 0.0017) SingleSource/UnitTests/byval-alignment: -32.61% (0.0230 => 0.0155, std.dev.: 0.0007) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0518, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 10.19% (0.1462 => 0.1611, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4722, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0711, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4950, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5105, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.4963, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3184, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1340, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3629, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4070, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0881, std.dev.: 0.0005) SingleSource/Regression/C/uint64_to_float: -24.00% (2.1832 => 1.6593, std.dev.: 0.0035) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.17% (0.0810 => 0.0941, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/tsp/tsp: 11.51% (0.1112 => 0.1240, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.93% (0.2279 => 0.2528, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.35% (0.8321 => 0.9016, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.35% (0.2133 => 0.2311, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.75% (0.6010 => 0.6476, std.dev.: 0.0100) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.52% (0.3137 => 0.3373, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.37% (0.3295 => 0.3538, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.16% (0.1983 => 0.2125, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.96% (0.7473 => 0.7993, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.77% (0.2998 => 0.3201, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.41% (0.8148 => 0.8670, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.03% (0.2519 => 0.2671, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.03% (0.9435 => 1.0004, std.dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.62% (0.1905 => 0.2012, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.61% (0.4847 => 0.5119, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.49% (0.2240 => 0.2363, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.35% (1.1606 => 1.2227, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.33% (1.1685 => 1.2308, std.dev.: 0.0163) MultiSource/Applications/Burg/burg: 5.30% (1.2222 => 1.2870, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.29% (2.1401 => 2.2533, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.28% (0.6287 => 0.6619, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.11% (0.4127 => 0.4338, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.63% (0.4559 => 0.4770, std.dev.: 0.0053) MultiSource/Applications/sgefa/sgefa: 4.53% (0.2999 => 0.3135, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.46% (0.3003 => 0.3137, std.dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 4.40% (1.1271 => 1.1767, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.33% (0.5817 => 0.6069, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.23% (1.6386 => 1.7079, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/gs/gs: 4.21% (4.1305 => 4.3042, std.dev.: 0.0288) MultiSource/Applications/lua/lua: 4.08% (3.8189 => 3.9748, std.dev.: 0.0219) MultiSource/Applications/hbd/hbd: 3.88% (1.4269 => 1.4822, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.72% (1.3279 => 1.3773, std.dev.: 0.0166) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.62% (4.1763 => 4.3273, std.dev.: 0.0235) MultiSource/Applications/SIBsim4/SIBsim4: 3.61% (1.2568 => 1.3022, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.59% (4.4873 => 4.6484, std.dev.: 0.0294) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.55% (6.6074 => 6.8418, std.dev.: 0.0404) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.45% (0.8697 => 0.8997, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.44% (1.5315 => 1.5842, std.dev.: 0.0149) MultiSource/Applications/SPASS/SPASS: 3.35% (14.2605 => 14.7385, std.dev.: 0.0841) MultiSource/Benchmarks/McCat/18-imp/imp: 3.34% (0.3503 => 0.3620, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.31% (0.8340 => 0.8616, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.29% (13.1811 => 13.6141, std.dev.: 0.0339) MultiSource/Applications/ClamAV/clamscan: 3.26% (14.7684 => 15.2501, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.19% (0.6586 => 0.6796, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.16% (0.6227 => 0.6424, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.14% (0.3657 => 0.3772, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.12% (0.8359 => 0.8620, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.10% (0.5191 => 0.5352, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.09% (4.5702 => 4.7116, std.dev.: 0.0537) MultiSource/Applications/siod/siod: 3.06% (2.2184 => 2.2862, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.03% (0.8050 => 0.8294, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 3.00% (1.9948 => 2.0547, std.dev.: 0.0204) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.00% (0.8611 => 0.8869, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.93% (0.9039 => 0.9304, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.93% (4.4880 => 4.6193, std.dev.: 0.0375) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.91% (0.8716 => 0.8970, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.91% (0.8007 => 0.8240, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.84% (8.6476 => 8.8932, std.dev.: 0.0596) MultiSource/Applications/d/make_dparser: 2.84% (3.2366 => 3.3285, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.83% (0.9688 => 0.9962, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.82% (1.1170 => 1.1485, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.80% (0.8597 => 0.8838, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.79% (0.8086 => 0.8312, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.74% (0.8331 => 0.8559, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.71% (0.8317 => 0.8542, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.63% (0.9908 => 1.0169, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.63% (0.9074 => 0.9313, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.63% (0.8066 => 0.8278, std.dev.: 0.0044) MultiSource/Benchmarks/Bullet/bullet: 2.62% (31.8598 => 32.6952, std.dev.: 0.1425) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.61% (0.8261 => 0.8477, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.61% (0.7966 => 0.8174, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.58% (0.8518 => 0.8738, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.58% (3.1832 => 3.2654, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.56% (0.8048 => 0.8254, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.55% (0.8712 => 0.8934, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.50% (0.8286 => 0.8493, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.50% (0.8656 => 0.8872, std.dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: 2.46% (2.3764 => 2.4348, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.44% (1.4479 => 1.4832, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.44% (0.9069 => 0.9290, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.41% (0.8420 => 0.8623, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.37% (0.8316 => 0.8513, std.dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: 2.35% (15.3280 => 15.6888, std.dev.: 0.0673) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.35% (0.8204 => 0.8397, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.34% (0.8927 => 0.9136, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.26% (0.7932 => 0.8111, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.25% (0.8855 => 0.9054, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 2.24% (6.7320 => 6.8827, std.dev.: 0.0384) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.24% (1.2602 => 1.2884, std.dev.: 0.0072) MultiSource/Applications/lemon/lemon: 2.17% (1.0945 => 1.1183, std.dev.: 0.0038) MultiSource/Applications/oggenc/oggenc: 2.17% (4.9628 => 5.0703, std.dev.: 0.0366) MultiSource/Applications/hexxagon/hexxagon: 2.11% (0.9810 => 1.0017, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.00% (1.2423 => 1.2671, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 1.61% (0.7557 => 0.7679, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 87.94% (0.0199 => 0.0374, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/pi: 56.95% (1.5795 => 2.4791, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.88% (0.7597 => 0.8955, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.35% (2.9753 => 3.4619, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.69% (2.7995 => 3.2107, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.48% (5.0261 => 5.6030, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.29% (0.3186 => 0.3482, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/queens: 7.48% (1.7056 => 1.8331, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.19% (1.1857 => 1.2710, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.72% (4.7794 => 5.1007, std.dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 6.61% (3.1873 => 3.3981, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/richards_benchmark: 6.12% (1.3037 => 1.3835, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.85% (4.5327 => 4.7980, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.83% (4.9686 => 5.2584, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 5.39% (7.4933 => 7.8975, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.66% (6.2275 => 6.5177, std.dev.: 0.0282) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.57% (3.3761 => 3.5303, std.dev.: 0.0427) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.99% (4.9469 => 5.1442, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.98% (4.9453 => 5.1421, std.dev.: 0.0195) MultiSource/Applications/hexxagon/hexxagon: 3.89% (14.0064 => 14.5514, std.dev.: 0.0615) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.37% (4.3552 => 4.5020, std.dev.: 0.0195) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.23% (0.3587 => 0.3703, std.dev.: 0.0017) MultiSource/Applications/siod/siod: 2.95% (3.6643 => 3.7725, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.87% (11.5690 => 11.9009, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout/lists: 2.41% (7.3375 => 7.5143, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.29% (4.8660 => 4.9775, std.dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.05% (1.1365 => 1.1598, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.05% (8.2783 => 8.4479, std.dev.: 0.0255) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.02% (2.4647 => 2.5145, std.dev.: 0.0100) MultiSource/Benchmarks/FreeBench/neural/neural: 1.34% (1.0841 => 1.0986, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.96% (5.4641 => 4.3189, std.dev.: 0.0438) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.52% (7.2130 => 6.3099, std.dev.: 0.2013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.94% (1.0512 => 0.9362, std.dev.: 0.0099) SingleSource/Benchmarks/McGill/chomp: -10.80% (1.1216 => 1.0005, std.dev.: 0.0149) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.08% (14.6451 => 13.3156, std.dev.: 0.2427) MultiSource/Benchmarks/mafft/pairlocalalign: -8.56% (63.1822 => 57.7755, std.dev.: 0.1960) SingleSource/Benchmarks/Shootout-C++/ackermann: -7.08% (3.9188 => 3.6413, std.dev.: 0.0676) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.87% (4.7482 => 4.4219, std.dev.: 0.0334) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.45% (0.3269 => 0.3058, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.88% (5.4972 => 5.1740, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.87% (3.7148 => 3.4967, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.05% (5.1557 => 4.8954, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.45% (4.7449 => 4.5338, std.dev.: 0.0136) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.89% (2.8773 => 2.7653, std.dev.: 0.0328) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.76% (6.0224 => 5.7960, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.67% (0.5807 => 0.5594, std.dev.: 0.0065) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.96% (28.5821 => 27.7363, std.dev.: 0.0271) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.80% (2.6356 => 2.5619, std.dev.: 0.0029) MultiSource/Applications/aha/aha: -2.67% (3.3398 => 3.2506, std.dev.: 0.0058) MultiSource/Applications/lua/lua: -2.46% (29.8330 => 29.0996, std.dev.: 0.1922) SingleSource/Benchmarks/Shootout-C++/hash2: -2.46% (3.4237 => 3.3396, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.04% (11.5316 => 11.2965, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.89% (9.9065 => 9.7194, std.dev.: 0.0367) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.63% (3.2169 => 3.1646, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.53% (4.9994 => 4.9230, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.27% (5.6343 => 5.5629, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.3487 => 2.3194, std.dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.44% (1.0262 => 1.0718, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 9.76% (0.0123 => 0.0135, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.43% (0.1438 => 0.1473, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -0.92% (1.1329 => 1.1225, std.dev.: 0.0420) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.31% (0.4164 => 0.4177, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.39% (0.1369 => 0.1388, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.50% (0.0641 => 0.0625, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.03% (0.0195 => 0.0275, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.67% (0.0578 => 0.0551, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.72% (1.1437 => 1.1977, std.dev.: 0.0233) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1800.00% (0.0001 => 0.0019, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.35% (0.0627 => 0.0648, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.49% (0.8017 => 0.7737, std.dev.: 0.0304) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -32.26% (0.0062 => 0.0042, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 00:21:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 02:21:39 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121123082139.4654A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6162?compare_to=6158&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6162, Order: 168505, Start Time: 2012-11-23 06:46:14, End Time: 2012-11-23 08:22:06 To: 6158, Order: 168504, Start Time: 2012-11-22 22:48:19, End Time: 2012-11-23 00:21:59 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (161 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (876 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.51% (54.5751 => 56.4918, std.dev.: 0.1077) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.65% (2.0478 => 2.1020, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4937 => 7.6768, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash2: 2.27% (3.1932 => 3.2656, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.90% (0.3821 => 0.3519, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.68% (0.3142 => 0.2932, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -6.68% (2.4924 => 2.3260, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.20% (0.7198 => 0.6752, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.16% (0.9542 => 0.8954, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.10% (0.2428 => 0.2280, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: -5.92% (9.2283 => 8.6820, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/oourafft: -5.83% (0.2160 => 0.2034, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.82% (0.9852 => 0.9279, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -5.80% (0.9179 => 0.8647, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: -5.79% (16.1920 => 15.2550, std.dev.: 0.3575) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.77% (0.2355 => 0.2219, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.77% (0.6484 => 0.6110, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -5.69% (0.1879 => 0.1772, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.68% (0.1796 => 0.1694, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.65% (1.3722 => 1.2947, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.63% (0.3658 => 0.3452, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -5.62% (0.3896 => 0.3677, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -5.61% (0.3848 => 0.3632, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.60% (1.0544 => 0.9954, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -5.55% (0.4033 => 0.3809, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.54% (3.5339 => 3.3380, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: -5.54% (0.3812 => 0.3601, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.53% (0.3891 => 0.3676, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -5.49% (0.3880 => 0.3667, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -5.48% (0.3831 => 0.3621, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.48% (0.5863 => 0.5542, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -5.46% (0.4176 => 0.3948, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.45% (4.0323 => 3.8125, std.dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: -5.45% (1.1530 => 1.0902, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.43% (0.5705 => 0.5395, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.43% (0.3406 => 0.3221, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.42% (0.6052 => 0.5724, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.42% (0.2695 => 0.2549, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.40% (0.5925 => 0.5605, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.40% (4.8161 => 4.5562, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.39% (0.6230 => 0.5894, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -5.38% (1.1450 => 1.0834, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.37% (0.5805 => 0.5493, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.36% (1.2300 => 1.1641, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.35% (0.6446 => 0.6101, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.33% (1.6364 => 1.5491, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.32% (0.6297 => 0.5962, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.31% (0.5478 => 0.5187, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.31% (0.5802 => 0.5494, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.30% (14.2083 => 13.4551, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.30% (0.5570 => 0.5275, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.29% (0.6667 => 0.6314, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.29% (0.5857 => 0.5547, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.29% (4.8802 => 4.6220, std.dev.: 0.0088) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.28% (6.7716 => 6.4139, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.28% (0.5591 => 0.5296, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.28% (0.6293 => 0.5961, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.27% (0.5849 => 0.5541, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.26% (0.5859 => 0.5551, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.25% (1.4642 => 1.3873, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.22% (0.6304 => 0.5975, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.20% (0.3884 => 0.3682, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -5.20% (4.3330 => 4.1077, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.19% (4.5069 => 4.2729, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.17% (1.2784 => 1.2123, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.17% (0.6660 => 0.6316, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.14% (0.4199 => 0.3983, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.11% (0.5575 => 0.5290, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.11% (0.3483 => 0.3305, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.10% (0.2548 => 0.2418, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.10% (0.6194 => 0.5878, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.10% (0.5941 => 0.5638, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.07% (0.5999 => 0.5695, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.06% (0.7919 => 0.7518, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.03% (0.6736 => 0.6397, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.03% (0.6260 => 0.5945, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.03% (0.4515 => 0.4288, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: -5.03% (0.3581 => 0.3401, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -5.03% (0.2985 => 0.2835, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.00% (0.5456 => 0.5183, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.00% (0.8521 => 0.8095, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.00% (0.5581 => 0.5302, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.97% (0.2999 => 0.2850, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.96% (0.2278 => 0.2165, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.96% (0.6189 => 0.5882, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.94% (0.5688 => 0.5407, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.85% (8.0126 => 7.6236, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/parameter-passing: -4.84% (0.4280 => 0.4073, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.83% (22.4056 => 21.3224, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.82% (0.6676 => 0.6354, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -4.81% (0.2659 => 0.2531, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.78% (1.2210 => 1.1626, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.77% (0.6440 => 0.6133, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -4.77% (0.7447 => 0.7092, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.76% (1.2221 => 1.1639, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.76% (0.6033 => 0.5746, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.67% (0.3319 => 0.3164, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.65% (0.6681 => 0.6370, std.dev.: 0.0049) MultiSource/Applications/lua/lua: -4.64% (4.0594 => 3.8710, std.dev.: 0.0250) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.62% (0.5168 => 0.4929, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.62% (0.4916 => 0.4689, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.61% (0.2385 => 0.2275, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.60% (0.3931 => 0.3750, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.59% (1.6474 => 1.5718, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/matrix: -4.58% (0.3255 => 0.3106, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.58% (0.4151 => 0.3961, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.56% (0.7339 => 0.7004, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.55% (0.7524 => 0.7182, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -4.53% (0.2871 => 0.2741, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.51% (0.3057 => 0.2919, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.50% (0.6395 => 0.6107, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.46% (0.7021 => 0.6708, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.46% (0.3837 => 0.3666, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.42% (0.3849 => 0.3679, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -4.38% (0.3194 => 0.3054, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.38% (0.3016 => 0.2884, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.37% (0.2903 => 0.2776, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -4.37% (0.3271 => 0.3128, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.37% (2.1713 => 2.0765, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.36% (0.3323 => 0.3178, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: -4.36% (0.3394 => 0.3246, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -4.36% (0.2939 => 0.2811, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -4.35% (0.3446 => 0.3296, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.34% (0.3205 => 0.3066, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.33% (0.5329 => 0.5098, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.33% (0.2933 => 0.2806, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -4.33% (0.3026 => 0.2895, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.33% (0.4321 => 0.4134, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: -4.32% (0.2989 => 0.2860, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.31% (0.5567 => 0.5327) SingleSource/Benchmarks/Shootout-C++/moments: -4.31% (0.4248 => 0.4065, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.28% (0.2849 => 0.2727, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: -4.28% (0.4861 => 0.4653, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -4.26% (0.3025 => 0.2896, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.26% (0.9557 => 0.9150, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.24% (0.3252 => 0.3114, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -4.24% (0.3867 => 0.3703, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.24% (0.4813 => 0.4609, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.20% (0.5569 => 0.5335, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.19% (0.4083 => 0.3912, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -4.11% (0.3621 => 0.3472, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -4.07% (34.0927 => 32.7046, std.dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.06% (2.2587 => 2.1670, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.05% (0.6395 => 0.6136, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.00% (0.4427 => 0.4250, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -3.93% (0.6750 => 0.6485, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.90% (0.3491 => 0.3355, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: -3.78% (0.3788 => 0.3645, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.76% (0.9077 => 0.8736, std.dev.: 0.0060) SingleSource/Regression/C++/ofstream_ctor: -3.69% (0.3059 => 0.2946, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: -3.66% (18.2933 => 17.6230, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/Hello: -3.66% (0.6347 => 0.6115, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -3.65% (0.7779 => 0.7495, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: -3.59% (0.6441 => 0.6210, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.32% (5.4682 => 5.2865, std.dev.: 0.0187) SingleSource/UnitTests/Vector/constpool: -2.13% (20.7746 => 20.3320, std.dev.: 0.0239) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7568, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -8.74% (1.2842 => 1.1719, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.61% (2.2633 => 2.1817, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.50% (6.5735 => 6.4750, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 01:38:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 03:38:51 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121123093851.E02542A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6163?compare_to=6159&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6163, Order: 168505, Start Time: 2012-11-23 07:15:16, End Time: 2012-11-23 09:39:17 To: 6159, Order: 168504, Start Time: 2012-11-22 23:40:09, End Time: 2012-11-23 01:59:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 58 (169 on baseline) Performance Improvements: 7 (39 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1021 (677 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/minisat/minisat: 15.18% (0.8128 => 0.9362, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 13.93% (0.6194 => 0.7057, std.dev.: 0.0040) MultiSource/Applications/lemon/lemon: 13.91% (1.1953 => 1.3616, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.64% (0.6833 => 0.7765, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 13.48% (0.6845 => 0.7768, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 12.63% (0.5757 => 0.6484, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.24% (0.5988 => 0.6721, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 11.92% (0.6190 => 0.6928, std.dev.: 0.0104) SingleSource/Benchmarks/LivermoreLoops/kernel14: 11.72% (0.1084 => 0.1211, std.dev.: 0.0008) SingleSource/Benchmarks/LivermoreLoops/kernel10: 11.27% (0.1047 => 0.1165, std.dev.: 0.0040) SingleSource/Benchmarks/LivermoreLoops/kernel15: 11.11% (0.1179 => 0.1310, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 10.92% (0.8612 => 0.9552, std.dev.: 0.0061) MultiSource/Applications/spiff/spiff: 10.33% (0.8898 => 0.9817, std.dev.: 0.0091) SingleSource/Benchmarks/LivermoreLoops/kernel13: 10.27% (0.1081 => 0.1192, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.23% (0.1036 => 0.1142, std.dev.: 0.0009) SingleSource/Benchmarks/LivermoreLoops/kernel09: 10.22% (0.1057 => 0.1165, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.95% (6.2130 => 6.8315, std.dev.: 0.0931) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.48% (0.5200 => 0.5693, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.04% (0.6604 => 0.7201, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.86% (0.5769 => 0.6280, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.07% (0.1672 => 0.1807, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.79% (0.4158 => 0.4482, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/ReedSolomon: 7.71% (0.2193 => 0.2362, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.58% (0.3324 => 0.3576, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.51% (1.2208 => 1.3125, std.dev.: 0.0193) SingleSource/Benchmarks/LivermoreLoops/kernel18: 7.18% (0.1477 => 0.1583, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.75% (0.3110 => 0.3320, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.27% (0.5103 => 0.5423, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.83% (7.9497 => 8.4130, std.dev.: 0.1293) SingleSource/UnitTests/ObjC/trivial-interface: 5.24% (0.3890 => 0.4094, std.dev.: 0.0067) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.02% (0.9770 => 1.0260, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/hash: 5.01% (0.5112 => 0.5368, std.dev.: 0.0066) MultiSource/Applications/ClamAV/clamscan: 4.83% (36.6157 => 38.3838, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.70% (0.6041 => 0.6325, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.61% (0.7274 => 0.7609, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/hash2: 4.54% (0.5485 => 0.5734, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.36% (1.8467 => 1.9272, std.dev.: 0.0158) SingleSource/UnitTests/ObjC/exceptions: 4.23% (0.4466 => 0.4655, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/for-in: 4.22% (0.4316 => 0.4498, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.20% (0.9442 => 0.9839, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.05% (0.4762 => 0.4955, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.86% (4.8057 => 4.9912, std.dev.: 0.0274) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.59% (0.4155 => 0.4304, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.21% (11.1041 => 11.4610, std.dev.: 0.0512) SingleSource/Benchmarks/Misc/oourafft: 3.18% (0.3777 => 0.3897, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.75% (12.1819 => 12.5172, std.dev.: 0.0576) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.35% (1.5546 => 1.9798, std.dev.: 0.0330) MultiSource/Applications/JM/ldecod/ldecod: 19.22% (0.1212 => 0.1445, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 9.04% (9.2353 => 10.0699, std.dev.: 0.1791) MultiSource/Applications/lemon/lemon: 8.78% (1.4355 => 1.5616, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.86% (6.0901 => 6.5076, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/hash2: 3.83% (3.4398 => 3.5715, std.dev.: 0.0259) MultiSource/Applications/sqlite3/sqlite3: 3.67% (4.5877 => 4.7561, std.dev.: 0.0233) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.37% (5.3883 => 5.5698, std.dev.: 0.0415) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.19% (4.3223 => 4.4603, std.dev.: 0.0288) SingleSource/Benchmarks/Shootout-C++/hash: 2.87% (0.7805 => 0.8029, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.58% (87.1683 => 88.5444, std.dev.: 0.2452) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.13% (5.3826 => 5.4436, std.dev.: 0.0216) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -13.90% (2.0778 => 1.7889, std.dev.: 0.0932) MultiSource/Applications/viterbi/viterbi: -6.09% (0.1904 => 0.1788, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: -22.16% (7.6782 => 5.9768, std.dev.: 0.5833) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -19.74% (4.7438 => 3.8073, std.dev.: 0.3530) SingleSource/Benchmarks/Shootout-C++/lists1: -3.80% (0.6425 => 0.6181, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/himenobmtxpa: -3.66% (3.8623 => 3.7211, std.dev.: 0.0509) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.39% (1.5892 => 1.5671, std.dev.: 0.0060) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.65% (69.0397 => 69.4887, std.dev.: 0.3125) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.07% (0.1339 => 0.1338, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.48% (0.0419 => 0.0421, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.41% (0.0681 => 0.0651, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: 0.05% (493.4897 => 493.7186, std.dev.: 0.2301) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.87% (63.2438 => 69.4887, std.dev.: 0.3125) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0421, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43681.02% (1.1277 => 493.7186, std.dev.: 0.2301) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 193.23% (0.5229 => 1.5333, std.dev.: 0.1042) MultiSource/Applications/SPASS/SPASS: 18.97% (14.9895 => 17.8323, std.dev.: 0.2433) MultiSource/Applications/kimwitu++/kc: 47.91% (14.1553 => 20.9375, std.dev.: 0.5839) MultiSource/Benchmarks/MallocBench/gs/gs: 16.97% (4.1105 => 4.8079, std.dev.: 0.1322) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.51% (1.1048 => 1.5082, std.dev.: 0.0433) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.38% (7.1582 => 37.5364, std.dev.: 0.6856) SingleSource/Benchmarks/Misc-C++-EH/spirit: 97.28% (3.4629 => 6.8315, std.dev.: 0.0931) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.38% (0.6222 => 1.0290, std.dev.: 0.0492) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10519.03% (0.0720 => 7.6457, std.dev.: 0.3085) MultiSource/Applications/SIBsim4/SIBsim4: 3860200.00% (0.0001 => 3.8603, std.dev.: 0.0403) MultiSource/Applications/SPASS/SPASS: 14289300.00% (0.0001 => 14.2894, std.dev.: 1.7484) MultiSource/Applications/kimwitu++/kc: 52600.00% (0.0001 => 0.0527, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 577400.00% (0.0001 => 0.5775, std.dev.: 0.0288) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10075100.00% (0.0001 => 10.0752, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5976700.00% (0.0001 => 5.9768, std.dev.: 0.5833) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1820.46% (1.1194 => 21.4976, std.dev.: 0.3315) MultiSource/Applications/ClamAV/clamscan: 73.09% (22.1758 => 38.3838, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 62.48% (7.0540 => 11.4610, std.dev.: 0.0512) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.39% (2.9384 => 4.5954, std.dev.: 0.2283) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 53.84% (8.1363 => 12.5172, std.dev.: 0.0576) MultiSource/Applications/JM/lencod/lencod: 47.32% (21.9371 => 32.3188, std.dev.: 0.0758) SingleSource/Benchmarks/Misc/flops: 47.14% (0.1432 => 0.2107, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/distray/distray: 44.98% (0.1056 => 0.1531, std.dev.: 0.0064) SingleSource/UnitTests/vla: 40.00% (0.0355 => 0.0497, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 37.67% (0.0730 => 0.1005, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/dot-syntax-1: 33.61% (0.0479 => 0.0640, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 32.26% (0.1175 => 0.1554, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: 31.58% (0.7115 => 0.9362, std.dev.: 0.0156) MultiSource/Benchmarks/Olden/voronoi/voronoi: 31.11% (0.2700 => 0.3540, std.dev.: 0.0031) MultiSource/Benchmarks/Fhourstones/fhourstones: 28.80% (0.1566 => 0.2017, std.dev.: 0.0097) MultiSource/Applications/lambda-0_1_3/lambda: 28.51% (0.7433 => 0.9552, std.dev.: 0.0061) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 28.35% (0.1584 => 0.2033, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/treeadd/treeadd: 28.13% (0.0416 => 0.0533, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 28.01% (0.0614 => 0.0786, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 28.01% (0.0814 => 0.1042, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 27.99% (0.0443 => 0.0567, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.97% (0.3121 => 0.3994, std.dev.: 0.0073) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 27.81% (0.0953 => 0.1218, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 27.33% (0.1032 => 0.1314, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 27.07% (0.1655 => 0.2103, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 26.99% (1.0722 => 1.3616, std.dev.: 0.0189) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 26.68% (0.0491 => 0.0622, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/Oscar: 26.42% (0.0636 => 0.0804, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/health/health: 26.26% (0.1268 => 0.1601, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 26.01% (0.2107 => 0.2655, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/functionobjects: 26.00% (0.5020 => 0.6325, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.55% (0.8172 => 1.0260, std.dev.: 0.0092) MultiSource/Applications/spiff/spiff: 25.30% (0.7835 => 0.9817, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/hash: 25.16% (0.4289 => 0.5368, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 25.02% (1.5415 => 1.9272, std.dev.: 0.0158) SingleSource/UnitTests/ObjC/messages-2: 24.92% (0.0662 => 0.0827, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 24.92% (0.2271 => 0.2837, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 24.55% (0.0770 => 0.0959, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Treesort: 24.33% (0.0411 => 0.0511, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 24.11% (0.4620 => 0.5734, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/matrix: 24.08% (0.0818 => 0.1015, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Towers: 23.78% (0.0471 => 0.0583, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.46% (0.0746 => 0.0921, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 23.36% (0.4615 => 0.5693, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/lpbench: 22.93% (0.0929 => 0.1142, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.44% (0.1337 => 0.1637, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 22.08% (0.3497 => 0.4269, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/Large/ray: 21.92% (0.4064 => 0.4955, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/hash: 21.86% (0.0485 => 0.0591, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 21.78% (0.2603 => 0.3170, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/for-in: 21.77% (0.3694 => 0.4498, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_isamax: 21.73% (0.0704 => 0.0857, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 21.60% (0.3828 => 0.4655, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-3: 21.59% (0.3516 => 0.4275, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 21.50% (0.2554 => 0.3103, std.dev.: 0.0189) SingleSource/UnitTests/ObjC/instance-method-metadata: 21.48% (0.3543 => 0.4304, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 21.45% (0.8101 => 0.9839, std.dev.: 0.0026) SingleSource/UnitTests/2006-12-11-LoadConstants: 21.17% (0.1143 => 0.1385, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 20.92% (0.1463 => 0.1769, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 20.86% (0.2430 => 0.2937, std.dev.: 0.0095) SingleSource/UnitTests/ObjC/exceptions-4: 20.86% (0.3543 => 0.4282, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/whetstone: 20.76% (0.0660 => 0.0797, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 20.44% (0.1125 => 0.1355, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.52% (0.0871 => 0.1041, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.17% (0.0793 => 0.0945, std.dev.: 0.0056) SingleSource/Benchmarks/McGill/misr: 19.12% (0.0633 => 0.0754, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.05% (0.1029 => 0.1225, std.dev.: 0.0026) SingleSource/Regression/C++/ofstream_ctor: 19.04% (0.2905 => 0.3458, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 18.89% (3.8922 => 4.6275, std.dev.: 0.1374) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.82% (14.3668 => 17.0712, std.dev.: 0.0672) SingleSource/Benchmarks/Misc/oourafft: 18.74% (0.3282 => 0.3897, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 18.56% (3.3354 => 3.9544, std.dev.: 0.1574) SingleSource/UnitTests/ObjC/property: 18.32% (0.3886 => 0.4598, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.22% (0.9765 => 1.1544, std.dev.: 0.0341) SingleSource/Benchmarks/Shootout-C++/ary3: 18.15% (0.3283 => 0.3879, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ary2: 17.93% (0.3379 => 0.3985, std.dev.: 0.0115) SingleSource/UnitTests/ObjC/trivial-interface: 17.88% (0.3473 => 0.4094, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/synchronized: 17.83% (0.3561 => 0.4196, std.dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.82% (1.1861 => 1.3975, std.dev.: 0.0539) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.81% (0.3307 => 0.3896, std.dev.: 0.0182) SingleSource/UnitTests/ObjC/parameter-passing: 17.27% (0.3927 => 0.4605, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.98% (0.0842 => 0.0985, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary: 16.46% (0.3232 => 0.3764, std.dev.: 0.0103) MultiSource/Applications/treecc/treecc: 16.35% (2.0273 => 2.3588, std.dev.: 0.1144) MultiSource/Applications/oggenc/oggenc: 16.16% (5.7591 => 6.6895, std.dev.: 0.1066) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.85% (0.0675 => 0.0782, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.84% (2.0665 => 2.3939, std.dev.: 0.0687) MultiSource/Benchmarks/mafft/pairlocalalign: 15.76% (9.4845 => 10.9793, std.dev.: 0.3700) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.66% (0.4203 => 0.4861, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.60% (0.2872 => 0.3320, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.50% (0.2065 => 0.2385, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/ReedSolomon: 15.28% (0.2049 => 0.2362, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.24% (0.0886 => 0.1021, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.23% (0.0834 => 0.0961, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.22% (0.1117 => 0.1287, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.21% (0.1940 => 0.2235, std.dev.: 0.0108) MultiSource/Applications/viterbi/viterbi: 14.98% (0.1555 => 0.1788, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.81% (0.0770 => 0.0884, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists1: 14.79% (0.3684 => 0.4229, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.43% (0.2758 => 0.3156, std.dev.: 0.0154) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.10% (4.2646 => 4.8659, std.dev.: 0.2172) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.90% (0.3935 => 0.4482, std.dev.: 0.0071) MultiSource/Applications/sqlite3/sqlite3: 13.90% (17.1811 => 19.5687, std.dev.: 0.1315) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.88% (0.5981 => 0.6811, std.dev.: 0.0289) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.86% (5.0018 => 5.6952, std.dev.: 0.2144) SingleSource/UnitTests/ObjC/block-byref-aggr: 13.81% (0.3817 => 0.4344, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/fibo: 13.76% (0.2725 => 0.3100, std.dev.: 0.0118) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.65% (0.1062 => 0.1207, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.59% (0.1236 => 0.1404, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.52% (0.5569 => 0.6322, std.dev.: 0.0274) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.47% (2.2022 => 2.4989, std.dev.: 0.0212) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.19% (0.3441 => 0.3895, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 13.03% (0.3423 => 0.3869, std.dev.: 0.0122) SingleSource/UnitTests/SignlessTypes/rem: 12.67% (0.1144 => 0.1289, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.56% (0.3177 => 0.3576, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 12.48% (0.2877 => 0.3236, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.29% (4.9449 => 5.5524, std.dev.: 0.2003) MultiSource/Benchmarks/nbench/nbench: 12.00% (1.1840 => 1.3261, std.dev.: 0.0396) MultiSource/Benchmarks/McCat/09-vor/vor: 11.67% (0.3180 => 0.3551, std.dev.: 0.0113) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.65% (0.1906 => 0.2128, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/05-eks/eks: 11.21% (0.4299 => 0.4781, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.15% (0.4879 => 0.5423, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 10.89% (0.5925 => 0.6570, std.dev.: 0.0212) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.62% (0.1892 => 0.2093, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.89% (1.4186 => 1.5589, std.dev.: 0.0508) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.51% (0.3826 => 0.4190, std.dev.: 0.0110) MultiSource/Benchmarks/Olden/bh/bh: 7.47% (0.3092 => 0.3323, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.67% (7.9617 => 8.4130, std.dev.: 0.1293) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.96% (4.3953 => 11.0306, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/methcall: 147.41% (5.3999 => 13.3601, std.dev.: 0.0118) MultiSource/Benchmarks/VersaBench/dbms/dbms: 31.23% (1.5086 => 1.9798, std.dev.: 0.0330) MultiSource/Applications/minisat/minisat: 29.32% (9.1159 => 11.7886, std.dev.: 0.4840) MultiSource/Benchmarks/llubenchmark/llu: 27.27% (3.7781 => 4.8083, std.dev.: 0.3246) MultiSource/Benchmarks/Olden/bisort/bisort: 20.38% (0.8333 => 1.0031, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/health/health: 19.55% (0.4445 => 0.5314, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.57% (1.1145 => 1.3103, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 17.47% (1.0785 => 1.2669, std.dev.: 0.0484) SingleSource/Benchmarks/Misc/oourafft: 17.45% (6.6465 => 7.8062, std.dev.: 0.0146) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.46% (0.2944 => 0.3399, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/hash2: 13.10% (3.1578 => 3.5715, std.dev.: 0.0259) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.54% (8.6802 => 9.7684, std.dev.: 0.1631) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.62% (2.8904 => 3.2263, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 11.33% (0.1298 => 0.1445, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 10.14% (1.1396 => 1.2552, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.31% (1.7254 => 1.8861, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.57% (0.3070 => 0.3333, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 7.99% (1.4460 => 1.5616, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash: 7.70% (0.7455 => 0.8029, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: 7.02% (1.2373 => 1.3242, std.dev.: 0.0160) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.02% (4.2280 => 4.4825, std.dev.: 0.0283) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 5.01% (0.5413 => 0.5684, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.76% (0.3463 => 0.3628, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 4.76% (26.0924 => 27.3342, std.dev.: 0.0590) MultiSource/Benchmarks/nbench/nbench: 4.12% (11.6436 => 12.1238, std.dev.: 0.0132) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.07% (2.1424 => 2.2082, std.dev.: 0.0255) SingleSource/Benchmarks/Dhrystone/dry: 2.66% (2.4116 => 2.4757, std.dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: 2.41% (4.6441 => 4.7561, std.dev.: 0.0233) MultiSource/Applications/sgefa/sgefa: 2.36% (0.6223 => 0.6370, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 2.05% (3.1595 => 3.2243, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 1.84% (85.0658 => 86.6296, std.dev.: 0.2391) MultiSource/Benchmarks/mafft/pairlocalalign: 1.55% (27.8444 => 28.2757, std.dev.: 0.0325) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.51% (6.5088 => 6.6072, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout/sieve: 1.31% (5.2139 => 5.2823, std.dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.26% (1.0313 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0497, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.30% (6.6874 => 0.1807, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -75.70% (0.8651 => 0.2102, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.12% (5.2763 => 1.3125, std.dev.: 0.0193) SingleSource/Benchmarks/Misc/richards_benchmark: -45.19% (0.1622 => 0.0889, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -12.33% (0.1330 => 0.1166, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.46% (5.3526 => 4.7390, std.dev.: 0.1204) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -10.05% (1.7609 => 1.5839, std.dev.: 0.0465) MultiSource/Applications/JM/ldecod/ldecod: -7.60% (10.4361 => 9.6425, std.dev.: 0.2608) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.32% (5.3855 => 4.9912, std.dev.: 0.0274) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.20% (0.0628 => 0.0363) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.28% (0.3987 => 0.2381, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.25% (4.5009 => 2.7793, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.21% (2.6546 => 2.0120, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/mason/mason: -19.16% (0.2161 => 0.1747, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.50% (1.6925 => 1.4301, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2839, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.80% (32.5116 => 29.0006, std.dev.: 0.0310) SingleSource/Benchmarks/Misc/mandel-2: -10.61% (1.5373 => 1.3742, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -10.53% (9.5636 => 8.5565, std.dev.: 0.1407) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.03% (1.5660 => 1.4246, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.32% (3.2416 => 3.0367, std.dev.: 0.0209) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7497, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.97% (0.2497 => 0.2373, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5091, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.70% (1.6805 => 1.6016, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout/lists: -4.41% (6.2999 => 6.0221, std.dev.: 0.0094) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.39% (0.9957 => 0.9619, std.dev.: 0.0037) MultiSource/Benchmarks/sim/sim: -3.12% (5.0483 => 4.8910, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.23% (0.4808 => 0.4701, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.13% (1.3861 => 1.3566, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.81% (8.1563 => 8.0084, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/salsa20: -1.51% (10.2830 => 10.1278, std.dev.: 0.0043) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0014) Report Time: 2.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 02:34:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 04:34:54 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121123103454.2EE892A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6164?compare_to=6160&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6164, Order: 168505, Start Time: 2012-11-23 07:11:11, End Time: 2012-11-23 10:35:20 To: 6160, Order: 168504, Start Time: 2012-11-22 23:13:48, End Time: 2012-11-23 02:34:51 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 8 (172 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1084 (718 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 30.22% (0.4037 => 0.5257, std.dev.: 0.0324) MultiSource/Applications/hexxagon/hexxagon: 1.46% (1.1337 => 1.1503, std.dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.39% (12.5727 => 12.7479, std.dev.: 0.0092) MultiSource/Benchmarks/Bullet/bullet: 1.29% (26.8015 => 27.1474, std.dev.: 0.0071) SingleSource/UnitTests/ObjC++/property-reference: 1.26% (0.8317 => 0.8422, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 1.23% (12.7178 => 12.8747, std.dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.68% (0.2096 => 0.2236, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary2: 5.73% (0.2146 => 0.2269, std.dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.20% (0.0625 => 0.0895, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.77% (0.1063 => 0.1422, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.44% (0.2969 => 0.3754, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.13% (0.1106 => 0.1395, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 25.35% (1.5932 => 1.9970, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.18% (0.4253 => 0.5324, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.08% (0.4139 => 0.5177, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.79% (0.0714 => 0.0891, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.37% (0.4994 => 0.6211, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.31% (0.5900 => 0.7334, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.00% (0.0475 => 0.0589, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.77% (0.0547 => 0.0677, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.72% (0.5000 => 0.6186, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.63% (0.0584 => 0.0722, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.52% (0.0897 => 0.1099, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.47% (0.1620 => 0.1984, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.40% (0.1107 => 0.1355, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 22.37% (0.0599 => 0.0733, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.26% (0.0541 => 0.0656, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.17% (0.0633 => 0.0767, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 21.10% (0.0948 => 0.1148, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.03% (0.0642 => 0.0777) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.94% (0.1103 => 0.1334, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.89% (0.0584 => 0.0706, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.84% (0.1003 => 0.1212, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.68% (0.3903 => 0.4710, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.61% (0.0495 => 0.0597, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 20.58% (0.0821 => 0.0990, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.45% (0.1604 => 0.1932, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.44% (0.0822 => 0.0990, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.34% (0.1549 => 0.1864, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 20.32% (0.1619 => 0.1948, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.56% (0.1462 => 0.1748, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.33% (0.3890 => 0.4642, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 19.31% (0.0808 => 0.0964, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 19.22% (0.0947 => 0.1129, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.87% (0.2014 => 0.2394, std.dev.: 0.0072) SingleSource/UnitTests/ObjC++/property-reference-object: 18.71% (0.5889 => 0.6991, std.dev.: 0.0074) SingleSource/UnitTests/ObjC++/Hello: 18.66% (0.5826 => 0.6913, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 18.64% (0.1218 => 0.1445, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.37% (1.3152 => 1.5568, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.35% (0.2736 => 0.3238, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/mst/mst: 18.19% (0.0698 => 0.0825, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.11% (0.1088 => 0.1285, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 18.09% (0.4029 => 0.4758, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 17.87% (0.1505 => 0.1774, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.85% (0.0605 => 0.0713, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.62% (0.2866 => 0.3371, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 17.60% (0.5546 => 0.6522, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 17.45% (0.7171 => 0.8422, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.32% (0.2875 => 0.3373, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.30% (0.3271 => 0.3837, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.30% (0.4658 => 0.5464, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.28% (3.5627 => 4.1785, std.dev.: 0.0071) MultiSource/Applications/hbd/hbd: 17.25% (0.9697 => 1.1370, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.23% (0.1968 => 0.2307, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 17.20% (1.8794 => 2.2027, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.13% (0.5026 => 0.5887, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.12% (1.6211 => 1.8987, std.dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 16.94% (0.3004 => 0.3513, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 16.84% (0.2750 => 0.3213, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 16.80% (0.2714 => 0.3170, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 16.73% (0.2725 => 0.3181, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.73% (0.2738 => 0.3196, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.72% (0.1160 => 0.1354, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.60% (0.2729 => 0.3182, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 16.56% (1.0781 => 1.2566, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.44% (0.3930 => 0.4576, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 16.44% (0.2823 => 0.3287, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 16.44% (0.2811 => 0.3273, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 16.42% (0.2813 => 0.3275, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 16.41% (0.2803 => 0.3263, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.40% (0.2792 => 0.3250, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 16.40% (0.1421 => 0.1654, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: 16.37% (0.2780 => 0.3235, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 16.36% (0.1284 => 0.1494, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.30% (0.4361 => 0.5072, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.28% (0.2911 => 0.3385, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/wc: 16.18% (0.3096 => 0.3597, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.18% (2.7292 => 3.1708, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.18% (2.0673 => 2.4018, std.dev.: 0.0265) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.12% (0.3195 => 0.3710, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 16.09% (0.9909 => 1.1503, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.04% (4.4195 => 5.1285, std.dev.: 0.0109) MultiSource/Applications/ClamAV/clamscan: 16.04% (4.2109 => 4.8862, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.00% (0.3362 => 0.3900, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary3: 15.89% (0.3267 => 0.3786, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 15.78% (0.3258 => 0.3772, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.73% (1.9694 => 2.2792, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.56% (0.3060 => 0.3536, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.50% (0.1090 => 0.1259, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.47% (1.9966 => 2.3055, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary2: 15.47% (0.3317 => 0.3830, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 15.42% (23.5202 => 27.1474, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/moments: 15.33% (0.3678 => 0.4242, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 15.33% (0.2075 => 0.2393, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.17% (0.3282 => 0.3780, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.14% (0.3124 => 0.3597, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash: 15.03% (0.4146 => 0.4769, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 14.96% (0.2566 => 0.2950, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 14.87% (0.3348 => 0.3846, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.81% (0.3625 => 0.4162, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.80% (0.3845 => 0.4414, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 14.76% (0.3726 => 0.4276, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 14.70% (0.3477 => 0.3988, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.39% (0.3981 => 0.4554, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.36% (0.3690 => 0.4220, std.dev.: 0.0023) MultiSource/Applications/lua/lua: 14.31% (1.4269 => 1.6311, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 14.28% (0.4251 => 0.4858, std.dev.: 0.0109) MultiSource/Applications/treecc/treecc: 13.93% (0.7875 => 0.8972, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 13.90% (0.3446 => 0.3925, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 13.86% (2.1653 => 2.4654, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/exceptions-4: 13.82% (0.3465 => 0.3944, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.82% (0.3496 => 0.3979, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.82% (0.3460 => 0.3938, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 13.81% (0.3469 => 0.3948, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.68% (0.3488 => 0.3965, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 13.63% (0.3442 => 0.3911, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 13.49% (0.5012 => 0.5688, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/property: 13.48% (0.3650 => 0.4142, std.dev.: 0.0082) MultiSource/Benchmarks/sim/sim: 13.46% (0.0758 => 0.0860, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 13.37% (2.1013 => 2.3823, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions: 13.37% (0.3643 => 0.4130, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 13.30% (4.6177 => 5.2319, std.dev.: 0.0189) SingleSource/UnitTests/ObjC/parameter-passing: 13.24% (0.3724 => 0.4217, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 13.01% (0.2691 => 0.3041, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.94% (0.2040 => 0.2304, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.56% (0.6435 => 0.7243, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 12.29% (5.5417 => 6.2229, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.16% (0.1028 => 0.1153, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.95% (0.2737 => 0.3064, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.71% (0.1383 => 0.1545, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.67% (0.3084 => 0.3444, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 11.66% (0.3498 => 0.3906, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.36% (0.2068 => 0.2303, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 11.33% (0.4847 => 0.5396, std.dev.: 0.0092) MultiSource/Applications/siod/siod: 11.15% (0.6634 => 0.7374, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 10.73% (0.3336 => 0.3694, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.56% (0.2103 => 0.2325, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 10.11% (2.0346 => 2.2403, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 10.08% (0.2391 => 0.2632, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.55% (0.5361 => 0.5873, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.53% (4.6926 => 5.1397, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.52% (11.6398 => 12.7479, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.86% (0.7426 => 0.8084, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.83% (0.5584 => 0.6077, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 7.69% (11.9555 => 12.8747, std.dev.: 0.0094) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.43% (0.3792 => 0.3960, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.26% (0.0734 => 0.0868, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 7.82% (0.2802 => 0.3021, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6096, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.42% (0.3693 => 0.3893, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary: 5.37% (0.2122 => 0.2236, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6716, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-2: 4.96% (1.8057 => 1.8953, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1702, std.dev.: 0.1083) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6406, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2066, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2224, std.dev.: 0.0047) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3050, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2855, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.21% (1.0142 => 1.0265, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5127, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5389, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5814, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.21% (2.4764 => 2.3969, std.dev.: 0.0180) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.74% (25.4195 => 16.5884, std.dev.: 0.0216) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9765, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7922, std.dev.: 0.0160) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: -5.54% (0.2402 => 0.2269, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8026, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.13% (0.6293 => 0.6096, std.dev.: 0.0049) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7745, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.25% (41.7953 => 40.8560, std.dev.: 0.0076) SingleSource/Benchmarks/Dhrystone/fldry: -2.24% (17.2379 => 16.8511, std.dev.: 0.0118) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5733, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4954, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.31% (105.3826 => 104.0051, std.dev.: 0.1035) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0427, std.dev.: 0.0059) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 02:35:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 04:35:00 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121123103500.53C432A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6165?compare_to=6161&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6165, Order: 168507, Start Time: 2012-11-23 09:05:22, End Time: 2012-11-23 10:35:28 To: 6161, Order: 168505, Start Time: 2012-11-23 06:42:10, End Time: 2012-11-23 08:12:27 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 3 (115 on baseline) Performance Improvements: 8 (28 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1043 (831 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.61% (21.9878 => 22.5626, std.dev.: 0.1093) SingleSource/Benchmarks/Misc/ffbench: 1.65% (1.4131 => 1.4364, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.36% (4.9044 => 4.9710, std.dev.: 0.0088) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -7.32% (0.2528 => 0.2343, std.dev.: 0.0070) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.87% (0.9016 => 0.8847, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.72% (1.3773 => 1.3536, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.46% (2.2533 => 2.2205, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/football/football: -1.44% (0.9044 => 0.8914, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.80% (3.6309 => 3.5656, std.dev.: 0.0179) MultiSource/Applications/minisat/minisat: -1.39% (6.2507 => 6.1636, std.dev.: 0.0337) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.15% (2.3927 => 2.3653, std.dev.: 0.0104) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.94% (1.0718 => 1.0617, std.dev.: 0.0116) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 61.48% (0.0135 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0428 => 0.0430, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0333 => 0.0333, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.63% (0.0315 => 0.0313, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0424 => 0.0426, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -42.65% (0.0204 => 0.0117, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/test1: -30.09% (0.0216 => 0.0151, std.dev.: 0.0032) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.20% (0.1473 => 0.1470, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 5.88% (1.1225 => 1.1885, std.dev.: 0.0519) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.56% (0.4177 => 0.4112, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.38% (0.1388 => 0.1421, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.72% (0.0625 => 0.0642, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -28.36% (0.0275 => 0.0197, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.09% (0.0551 => 0.0568, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.26% (1.1977 => 1.1946, std.dev.: 0.0596) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -52.63% (0.0019 => 0.0009, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.33% (0.0648 => 0.0607, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.08% (0.0266 => 0.0178, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.41% (0.7737 => 0.7705, std.dev.: 0.0081) SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 97.62% (0.0042 => 0.0083, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.50% (16.4461 => 17.6792, std.dev.: 0.0279) MultiSource/Applications/sqlite3/sqlite3: 2325.99% (0.6332 => 15.3614, std.dev.: 0.0675) MultiSource/Benchmarks/McCat/08-main/main: 45.28% (0.1831 => 0.2660, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -10.13% (0.1559 => 0.1401, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7074.83% (0.3123 => 22.4070, std.dev.: 0.3537) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.91% (0.2463 => 0.3717, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1530.41% (0.3344 => 5.4521, std.dev.: 0.0606) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.51% (0.2364 => 0.3227, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 4.71% (0.6010 => 0.6293, std.dev.: 0.0182) SingleSource/Benchmarks/Misc/mandel: 0.47% (0.0429 => 0.0431, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.33% (0.3266 => 0.3440, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/strcat: 3.56% (0.1969 => 0.2039, std.dev.: 0.0023) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.59% (0.0224 => 0.0241) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0433, std.dev.: 0.0044) MultiSource/Applications/oggenc/oggenc: 9.03% (0.1462 => 0.1594, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4674, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0698, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4874, std.dev.: 0.0115) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5111, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.4848, std.dev.: 0.4964) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3172, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1294, std.dev.: 0.0680) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3628, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4045, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0809, std.dev.: 0.0064) SingleSource/Regression/C/uint64_to_float: -24.07% (2.1832 => 1.6577, std.dev.: 0.0263) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 11.06% (0.1112 => 0.1235, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.70% (0.2180 => 0.2326, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.56% (0.1983 => 0.2113, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.32% (0.8321 => 0.8847, std.dev.: 0.0046) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.06% (0.3137 => 0.3327, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.35% (0.1905 => 0.2007, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.98% (0.7473 => 0.7845, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.18% (1.1685 => 1.2173, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.17% (0.2519 => 0.2624, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (1.5315 => 1.5921, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.81% (14.2605 => 14.8032, std.dev.: 0.0184) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.76% (2.1401 => 2.2205, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.73% (0.4559 => 0.4729, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 3.66% (3.8189 => 3.9585, std.dev.: 0.0311) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.62% (0.8007 => 0.8297, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.56% (6.6074 => 6.8423, std.dev.: 0.0431) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.53% (1.2526 => 1.2968, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.50% (0.9074 => 0.9392, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.47% (0.3115 => 0.3223, std.dev.: 0.0029) MultiSource/Applications/minisat/minisat: 3.42% (0.6834 => 0.7068, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.42% (4.1763 => 4.3191, std.dev.: 0.0158) MultiSource/Benchmarks/PAQ8p/paq8p: 3.39% (2.3764 => 2.4570, std.dev.: 0.0139) MultiSource/Applications/siod/siod: 3.39% (2.2184 => 2.2935, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.37% (0.8716 => 0.9010, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.37% (1.1271 => 1.1651, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.33% (1.6386 => 1.6932, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.31% (0.8697 => 0.8985, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.22% (0.8518 => 0.8792, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.16% (13.1811 => 13.5970, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.14% (0.9908 => 1.0219, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.14% (0.8611 => 0.8881, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.13% (0.6227 => 0.6422, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: 3.13% (3.2366 => 3.3379, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.08% (0.9688 => 0.9986, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.03% (0.4783 => 0.4928, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.02% (0.8597 => 0.8857, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.00% (0.8340 => 0.8590, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 2.98% (1.2568 => 1.2943, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.94% (0.8331 => 0.8576, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 2.88% (14.7684 => 15.1935, std.dev.: 0.0582) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.86% (0.8050 => 0.8280, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.85% (0.9039 => 0.9297, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.83% (0.8317 => 0.8552, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.81% (0.8712 => 0.8957, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.79% (0.8457 => 0.8693, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.74% (0.8656 => 0.8893, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.70% (0.9069 => 0.9314, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.70% (0.5191 => 0.5331, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.65% (0.8086 => 0.8300, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 2.63% (31.8598 => 32.6989, std.dev.: 0.2430) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.59% (0.8805 => 0.9033, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.59% (3.1832 => 3.2656, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.57% (0.9056 => 0.9289, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.57% (0.8177 => 0.8387, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.53% (4.4873 => 4.6009, std.dev.: 0.0317) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.52% (0.8261 => 0.8469, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.51% (0.8359 => 0.8569, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.51% (0.8048 => 0.8250, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.51% (0.7932 => 0.8131, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.51% (0.8338 => 0.8547, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.49% (0.8204 => 0.8408, std.dev.: 0.0035) MultiSource/Applications/oggenc/oggenc: 2.48% (4.9628 => 5.0858, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.44% (0.8069 => 0.8266, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.42% (0.7966 => 0.8159, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.40% (0.8420 => 0.8622, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.38% (0.6586 => 0.6743, std.dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: 2.33% (15.3280 => 15.6846, std.dev.: 0.0313) MultiSource/Applications/lambda-0_1_3/lambda: 2.32% (0.7557 => 0.7732, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.28% (0.8885 => 0.9088, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 2.26% (0.9810 => 1.0032, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.25% (0.8927 => 0.9128, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.25% (0.8316 => 0.8503, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.24% (1.4479 => 1.4803, std.dev.: 0.0071) MultiSource/Applications/JM/ldecod/ldecod: 2.24% (6.7320 => 6.8826, std.dev.: 0.0286) MultiSource/Applications/lemon/lemon: 2.20% (1.0945 => 1.1186, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.19% (0.8995 => 0.9192, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 2.17% (8.6247 => 8.8115, std.dev.: 0.0606) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.16% (0.8855 => 0.9046, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.04% (8.6476 => 8.8241, std.dev.: 0.0462) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.94% (1.3279 => 1.3536, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.82% (0.8066 => 0.8213, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/football/football: 1.67% (0.8768 => 0.8914, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 108.54% (0.0199 => 0.0415, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/pi: 56.19% (1.5795 => 2.4670, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.34% (2.9753 => 3.4614, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.24% (0.7597 => 0.8831, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.51% (2.7995 => 3.2056, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.58% (5.0261 => 5.6079, std.dev.: 0.0444) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.09% (1.1857 => 1.2816, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/queens: 7.43% (1.7056 => 1.8324, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.75% (4.7794 => 5.1018, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: 6.68% (1.3037 => 1.3908, std.dev.: 0.0232) MultiSource/Applications/SIBsim4/SIBsim4: 5.99% (3.1873 => 3.3783, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.88% (4.9686 => 5.2608, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.79% (4.5327 => 4.7951, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.49% (0.3186 => 0.3361, std.dev.: 0.0067) MultiSource/Applications/lambda-0_1_3/lambda: 4.81% (7.4933 => 7.8539, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.66% (3.3761 => 3.5335, std.dev.: 0.0246) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.64% (6.2275 => 6.5167, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.11% (4.9453 => 5.1485, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 4.00% (14.0064 => 14.5672, std.dev.: 0.1036) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.99% (4.9469 => 5.1441, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.09% (0.3587 => 0.3698, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 3.04% (3.6643 => 3.7758, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.79% (4.8362 => 4.9710, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.78% (11.5690 => 11.8908, std.dev.: 0.0053) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.71% (1.2337 => 1.2671, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.68% (8.2783 => 8.5001, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout/lists: 2.46% (7.3375 => 7.5177, std.dev.: 0.0268) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 1.83% (0.5889 => 0.5997, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.62% (1.1365 => 1.1549, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/power/power: 1.48% (1.2061 => 1.2240, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 1.45% (8.5322 => 8.6555, std.dev.: 0.0249) SingleSource/Benchmarks/Stanford/FloatMM: 1.17% (0.8807 => 0.8910, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.03% (3.5679 => 3.6045, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.00% (5.4641 => 4.3167, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.47% (7.2130 => 6.3133, std.dev.: 0.1164) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.01% (1.0512 => 0.9355, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -8.97% (1.1216 => 1.0210, std.dev.: 0.0342) MultiSource/Benchmarks/mafft/pairlocalalign: -8.54% (63.1822 => 57.7844, std.dev.: 0.1578) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.32% (14.6451 => 13.4268, std.dev.: 0.1429) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.65% (0.3269 => 0.3019, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.89% (4.7482 => 4.4210, std.dev.: 0.0671) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.11% (3.7148 => 3.4878, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.87% (5.4972 => 5.1747, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.07% (5.1557 => 4.8942, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.43% (2.8773 => 2.7497, std.dev.: 0.0481) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.39% (4.7449 => 4.5366, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.82% (6.0224 => 5.7924, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.42% (2.4490 => 2.3653, std.dev.: 0.0104) MultiSource/Applications/lua/lua: -3.38% (29.8330 => 28.8251, std.dev.: 0.0813) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.32% (0.5807 => 0.5614, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (28.5821 => 27.7008, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/mason/mason: -3.05% (0.5415 => 0.5250, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/bisort/bisort: -2.79% (0.6636 => 0.6451, std.dev.: 0.0051) MultiSource/Applications/aha/aha: -2.67% (3.3398 => 3.2506, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.56% (9.9065 => 9.6529, std.dev.: 0.0966) SingleSource/Benchmarks/Shootout-C++/hash2: -2.23% (3.4237 => 3.3475, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.99% (11.5316 => 11.3024, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.67% (2.3487 => 2.3094, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.60% (4.9994 => 4.9194, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.35% (3.2169 => 3.1736, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.17% (5.6343 => 5.5682, std.dev.: 0.0067) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.46% (1.0262 => 1.0617, std.dev.: 0.0116) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.39% (0.0408 => 0.0430, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.94% (0.0384 => 0.0426, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -38.42% (0.0190 => 0.0117, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/test1: -16.11% (0.0180 => 0.0151, std.dev.: 0.0032) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.23% (0.1438 => 0.1470, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 4.91% (1.1329 => 1.1885, std.dev.: 0.0519) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.25% (0.4164 => 0.4112, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.80% (0.1369 => 0.1421, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.16% (0.0641 => 0.0642, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.03% (0.0195 => 0.0197, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.73% (0.0578 => 0.0568, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.45% (1.1437 => 1.1946, std.dev.: 0.0596) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 800.00% (0.0001 => 0.0009, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.19% (0.0627 => 0.0607, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.11% (0.0180 => 0.0178, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.89% (0.8017 => 0.7705, std.dev.: 0.0081) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 33.87% (0.0062 => 0.0083, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 02:42:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 04:42:14 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121123104214.17B0B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6166?compare_to=6162&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6166, Order: 168507, Start Time: 2012-11-23 09:09:01, End Time: 2012-11-23 10:42:41 To: 6162, Order: 168505, Start Time: 2012-11-23 06:46:14, End Time: 2012-11-23 08:22:06 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 1 (179 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (859 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: -1.19% (1.3288 => 1.3130, std.dev.: 0.0022) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.04% (2.0478 => 2.1101, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: 2.51% (7.4937 => 7.6815, std.dev.: 0.0231) SingleSource/Benchmarks/Shootout-C++/hash2: 2.18% (3.1932 => 3.2629, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.11% (0.3821 => 0.3511, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.00% (0.3142 => 0.2922, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -6.95% (2.4924 => 2.3193, std.dev.: 0.0049) MultiSource/Applications/sgefa/sgefa: -6.61% (0.3357 => 0.3135, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.61% (0.9542 => 0.8911, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.30% (0.2428 => 0.2275, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -6.27% (9.2283 => 8.6493, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/oourafft: -6.25% (0.2160 => 0.2025, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -6.18% (16.1920 => 15.1920, std.dev.: 0.0102) SingleSource/UnitTests/ObjC/exceptions-2: -6.16% (0.3831 => 0.3595, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -6.16% (0.3896 => 0.3656, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -6.16% (0.3848 => 0.3611, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.15% (0.6484 => 0.6085, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.13% (0.3884 => 0.3646, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.11% (0.7198 => 0.6758, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: -6.11% (0.3880 => 0.3643, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.07% (0.2355 => 0.2212, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/trivial-interface: -6.06% (0.3812 => 0.3581, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.04% (0.9852 => 0.9257, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.03% (0.4033 => 0.3790, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.01% (0.1796 => 0.1688, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: -6.01% (7.0961 => 6.6694, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/football/football: -5.98% (0.9179 => 0.8630, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.93% (0.3658 => 0.3441, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.92% (1.3722 => 1.2910, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: -5.91% (0.4176 => 0.3929, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.87% (3.5339 => 3.3263, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.87% (4.8161 => 4.5333, std.dev.: 0.0084) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.83% (0.3891 => 0.3664, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.80% (1.6364 => 1.5415, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.75% (4.0323 => 3.8004, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.73% (1.2300 => 1.1595, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.73% (6.7716 => 6.3839, std.dev.: 0.0075) MultiSource/Applications/lemon/lemon: -5.72% (1.1450 => 1.0795, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.72% (1.0544 => 0.9941, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.71% (0.5591 => 0.5272, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.68% (1.4642 => 1.3810, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: -5.68% (0.1761 => 0.1661, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -5.66% (1.1530 => 1.0877, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.65% (0.5863 => 0.5532, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.57% (4.8802 => 4.6083, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.57% (0.5478 => 0.5173, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.56% (0.5705 => 0.5388, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.55% (0.6230 => 0.5884, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.55% (0.3406 => 0.3217, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: -5.55% (0.4199 => 0.3966, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.55% (0.6293 => 0.5944, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.54% (4.5069 => 4.2571, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.54% (14.2083 => 13.4208, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.53% (1.2784 => 1.2077, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.53% (0.5805 => 0.5484, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.53% (0.2695 => 0.2546, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.52% (0.6736 => 0.6364, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.49% (0.6052 => 0.5720, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.49% (0.5925 => 0.5600, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.48% (0.6260 => 0.5917, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.46% (0.6667 => 0.6303, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.45% (0.6297 => 0.5954, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.45% (0.5802 => 0.5486, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.44% (0.6304 => 0.5961, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.44% (0.5849 => 0.5531, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.42% (0.5575 => 0.5273, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.41% (0.5857 => 0.5540, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -5.41% (4.3330 => 4.0986, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.40% (0.7919 => 0.7491, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: -5.40% (17.1032 => 16.1792, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.39% (0.5570 => 0.5270, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.38% (0.6446 => 0.6099, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -5.38% (0.4515 => 0.4272, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.37% (0.5456 => 0.5163, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.36% (0.5859 => 0.5545, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -5.35% (0.4280 => 0.4051, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.35% (0.6660 => 0.6304, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.33% (0.8521 => 0.8067, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.30% (0.6189 => 0.5861, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: -5.29% (1.3864 => 1.3130, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: -5.29% (0.2985 => 0.2827, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.29% (0.5581 => 0.5286, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.27% (0.5999 => 0.5683, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.25% (0.3483 => 0.3300, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.23% (0.5941 => 0.5630, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.23% (1.2221 => 1.1582, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: -5.23% (1.2515 => 1.1861, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.22% (0.6681 => 0.6332, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: -5.22% (0.3581 => 0.3394, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.22% (1.2210 => 1.1573, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.21% (0.6676 => 0.6328, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.20% (8.0126 => 7.5956, std.dev.: 0.0261) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.18% (0.2548 => 0.2416, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.17% (0.2999 => 0.2844, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: -5.17% (3.5154 => 3.3338, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.11% (0.6440 => 0.6111, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.10% (0.5688 => 0.5398, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -5.08% (15.2527 => 14.4779, std.dev.: 0.0288) MultiSource/Benchmarks/McCat/08-main/main: -5.08% (0.2659 => 0.2524, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -5.06% (15.5079 => 14.7234, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: -5.05% (0.7447 => 0.7071, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.04% (0.4916 => 0.4668, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: -5.02% (0.2871 => 0.2727, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.00% (0.3057 => 0.2904, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.99% (0.5168 => 0.4910, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.99% (0.4151 => 0.3944, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.97% (1.6474 => 1.5655, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -4.93% (0.2939 => 0.2794, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.92% (0.6033 => 0.5736, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/matrix: -4.92% (0.3255 => 0.3095, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -4.91% (1.3148 => 1.2502, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.91% (0.3319 => 0.3156, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.91% (22.4056 => 21.3058, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.91% (0.3016 => 0.2868, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.88% (0.2933 => 0.2790, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.87% (0.3205 => 0.3049, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: -4.84% (0.2849 => 0.2711, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.83% (0.2278 => 0.2168, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: -4.83% (0.3025 => 0.2879, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: -4.82% (0.3194 => 0.3040, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -4.79% (0.3446 => 0.3281, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.79% (0.2903 => 0.2764, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.79% (0.7021 => 0.6685, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.78% (0.2989 => 0.2846, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.76% (2.1713 => 2.0679, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/except: -4.76% (0.3026 => 0.2882, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.75% (0.3323 => 0.3165, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.75% (0.3849 => 0.3666, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.75% (0.6395 => 0.6091, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: -4.75% (2.1401 => 2.0384, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.74% (0.4813 => 0.4585, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: -4.73% (0.4861 => 0.4631, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.72% (0.7524 => 0.7169, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -4.71% (0.3394 => 0.3234, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -4.71% (0.3481 => 0.3317, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.71% (0.3931 => 0.3746, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -4.68% (0.4248 => 0.4049, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.68% (0.4083 => 0.3892, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -4.67% (2.4021 => 2.2899, std.dev.: 0.0018) MultiSource/Applications/lua/lua: -4.67% (4.0594 => 3.8700, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.64% (0.5329 => 0.5082, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.63% (0.7339 => 0.6999, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.61% (0.9557 => 0.9116, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: -4.60% (0.3867 => 0.3689, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -4.59% (0.7779 => 0.7422, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.49% (0.5567 => 0.5317, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -4.45% (0.3059 => 0.2923, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -4.44% (5.0226 => 4.7998, std.dev.: 0.0038) MultiSource/Applications/spiff/spiff: -4.43% (0.8418 => 0.8045, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: -4.42% (0.3621 => 0.3461, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.41% (2.2587 => 2.1590, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/09-vor/vor: -4.40% (0.3271 => 0.3127, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.38% (0.5569 => 0.5325, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.36% (0.6395 => 0.6116, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -4.34% (34.0927 => 32.6128, std.dev.: 0.0377) MultiSource/Applications/lambda-0_1_3/lambda: -4.32% (0.7982 => 0.7637, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.31% (0.4427 => 0.4236, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.31% (0.9077 => 0.8686, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.27% (0.3491 => 0.3342, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -4.18% (0.6347 => 0.6082, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -4.13% (0.6750 => 0.6471, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -4.12% (0.3788 => 0.3632, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -4.06% (18.2933 => 17.5506, std.dev.: 0.0239) SingleSource/Benchmarks/Shootout-C++/hash: -4.05% (0.4524 => 0.4341, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: -4.04% (0.6441 => 0.6181, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.99% (0.3837 => 0.3684, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -3.57% (1.5610 => 1.5052, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.54% (0.4321 => 0.4168, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.47% (5.4682 => 5.2783, std.dev.: 0.0119) SingleSource/UnitTests/Vector/constpool: -2.53% (20.7746 => 20.2486, std.dev.: 0.0198) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7499, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: -8.72% (1.2842 => 1.1722, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: -4.05% (2.2633 => 2.1716, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7069, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.43% (1.3096 => 1.2647, std.dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.64% (6.5735 => 6.4657, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 04:42:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 06:42:05 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121123124205.3512B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6167?compare_to=6165&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6167, Order: 168510, Start Time: 2012-11-23 11:09:20, End Time: 2012-11-23 12:42:33 To: 6165, Order: 168507, Start Time: 2012-11-23 09:05:22, End Time: 2012-11-23 10:35:28 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 2 (49 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1052 (905 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.24% (0.3361 => 0.3470, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.42% (60.0490 => 61.5026, std.dev.: 0.3159) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.27% (1.0617 => 1.0588, std.dev.: 0.0127) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -7.80% (0.0218 => 0.0201, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0430 => 0.0429, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.90% (0.0333 => 0.0336, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.64% (0.0313 => 0.0315, std.dev.: 0.0088) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.41% (0.0426 => 0.0432, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/casts: 76.07% (0.0117 => 0.0206, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 50.33% (0.0151 => 0.0227, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.54% (0.1470 => 0.1478, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -2.89% (1.1885 => 1.1541, std.dev.: 0.2225) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.31% (0.4112 => 0.4207, std.dev.: 0.0172) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.31% (0.1421 => 0.1468, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.58% (0.0642 => 0.0619, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0197 => 0.0197, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.94% (0.0568 => 0.0579, std.dev.: 0.0140) MultiSource/Benchmarks/Ptrdist/anagram/anagram: - (1.1946 => 1.1946, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 222.22% (0.0009 => 0.0029, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0607 => 0.0607, std.dev.: 0.0140) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 38.76% (0.0178 => 0.0247, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.49% (0.7705 => 0.7743, std.dev.: 0.0179) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -22.89% (0.0083 => 0.0064, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.47% (16.4461 => 17.6753, std.dev.: 0.3337) MultiSource/Applications/sqlite3/sqlite3: 2317.94% (0.6332 => 15.3104, std.dev.: 0.2486) MultiSource/Benchmarks/McCat/08-main/main: 49.81% (0.1831 => 0.2743, std.dev.: 0.0717) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.54% (0.1559 => 0.1457, std.dev.: 0.0281) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7099.65% (0.3123 => 22.4845, std.dev.: 1.0056) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.85% (0.2463 => 0.3740, std.dev.: 0.0624) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1539.11% (0.3344 => 5.4812, std.dev.: 0.2678) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.55% (0.2364 => 0.3228, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/bigfib: 4.61% (0.6010 => 0.6287, std.dev.: 0.0198) SingleSource/Benchmarks/Misc/mandel: 2.80% (0.0429 => 0.0441, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.08% (0.3266 => 0.3432, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/strcat: 4.42% (0.1969 => 0.2056, std.dev.: 0.0395) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.12% (0.0224 => 0.0231, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -26.09% (0.0230 => 0.0170, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0478, std.dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 9.23% (0.1462 => 0.1597, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4685, std.dev.: 0.0438) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0710, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4922, std.dev.: 0.0252) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5122, std.dev.: 0.0158) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5122, std.dev.: 0.2581) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3217, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1360, std.dev.: 0.1181) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3631, std.dev.: 0.0276) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4041, std.dev.: 0.0441) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0875, std.dev.: 0.0116) SingleSource/Regression/C/uint64_to_float: -23.81% (2.1832 => 1.6634, std.dev.: 0.0054) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 13.04% (0.1112 => 0.1257, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.97% (0.0848 => 0.0958, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.26% (0.2180 => 0.2360, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.82% (0.1905 => 0.2035, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.68% (0.2519 => 0.2662, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.23% (0.8148 => 0.8493, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.97% (0.4559 => 0.4740, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.25% (4.4873 => 4.6332, std.dev.: 0.0331) MultiSource/Applications/minisat/minisat: 3.06% (0.6834 => 0.7043, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.91% (0.3717 => 0.3825, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.73% (0.8597 => 0.8832, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.64% (0.9688 => 0.9944, std.dev.: 0.0088) MultiSource/Applications/ClamAV/clamscan: 2.56% (14.7684 => 15.1465, std.dev.: 0.0838) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.15% (0.8338 => 0.8517, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.73% (0.8995 => 0.9151, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 119.10% (0.0199 => 0.0436, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/pi: 55.85% (1.5795 => 2.4617, std.dev.: 0.0199) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.32% (0.7597 => 0.8913, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.44% (2.9753 => 3.4644, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.71% (2.7995 => 3.2112, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/moments: 14.33% (0.0949 => 0.1085, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.48% (5.0261 => 5.6029, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.91% (0.3186 => 0.3470, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/queens: 7.80% (1.7056 => 1.8387, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.47% (1.1857 => 1.2743, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/richards_benchmark: 7.46% (1.3037 => 1.4010, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.72% (4.7794 => 5.1007, std.dev.: 0.0196) MultiSource/Applications/SIBsim4/SIBsim4: 6.13% (3.1873 => 3.3828, std.dev.: 0.0490) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.91% (4.5327 => 4.8008, std.dev.: 0.0384) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.89% (4.9686 => 5.2612, std.dev.: 0.0142) MultiSource/Applications/lambda-0_1_3/lambda: 5.44% (7.4933 => 7.9009, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.67% (6.2275 => 6.5186, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.66% (3.3761 => 3.5335, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.20% (4.9453 => 5.1529, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.04% (4.9469 => 5.1469, std.dev.: 0.0219) MultiSource/Applications/hexxagon/hexxagon: 3.91% (14.0064 => 14.5543, std.dev.: 0.0192) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.78% (59.2638 => 61.5026, std.dev.: 0.3159) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.15% (0.3587 => 0.3700, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.69% (11.5690 => 11.8802, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.65% (8.2783 => 8.4978, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout/lists: 2.50% (7.3375 => 7.5209, std.dev.: 0.0471) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.40% (4.8660 => 4.9828, std.dev.: 0.0197) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.31% (1.1365 => 1.1627, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.77% (2.4647 => 2.5083, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: 1.58% (8.5322 => 8.6667, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.48% (3.5679 => 3.6206, std.dev.: 0.0154) MultiSource/Benchmarks/FreeBench/neural/neural: 1.33% (1.0841 => 1.0985, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: 1.08% (2.1224 => 2.1453, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.02% (4.0473 => 4.0885, std.dev.: 0.0100) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.21% (5.4641 => 4.3054, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.74% (7.2130 => 6.2938, std.dev.: 0.1519) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.88% (1.0512 => 0.9368, std.dev.: 0.0071) SingleSource/Benchmarks/McGill/chomp: -10.23% (1.1216 => 1.0069, std.dev.: 0.0323) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.85% (14.6451 => 13.3488, std.dev.: 0.2417) MultiSource/Benchmarks/mafft/pairlocalalign: -8.30% (63.1822 => 57.9401, std.dev.: 0.1034) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.88% (4.7482 => 4.4215, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.22% (3.7148 => 3.4838, std.dev.: 0.0206) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.80% (5.4972 => 5.1783, std.dev.: 0.0261) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.06% (5.1557 => 4.8946, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.39% (4.7449 => 4.5367, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.80% (6.0224 => 5.7934, std.dev.: 0.0139) MultiSource/Applications/lua/lua: -3.14% (29.8330 => 28.8972, std.dev.: 0.1325) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.07% (28.5821 => 27.7060, std.dev.: 0.0720) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.74% (0.5807 => 0.5648, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.33% (9.9065 => 9.6759, std.dev.: 0.0613) SingleSource/Benchmarks/Shootout-C++/hash2: -2.20% (3.4237 => 3.3484, std.dev.: 0.0263) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.95% (11.5316 => 11.3066, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.88% (2.6356 => 2.5861, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.33% (2.3487 => 2.3175, std.dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.18% (1.0262 => 1.0588, std.dev.: 0.0127) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 63.41% (0.0123 => 0.0201, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.15% (0.0408 => 0.0429, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 32.28% (0.0254 => 0.0336, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0088) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 12.50% (0.0384 => 0.0432, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/casts: 8.42% (0.0190 => 0.0206, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 26.11% (0.0180 => 0.0227, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.78% (0.1438 => 0.1478, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.87% (1.1329 => 1.1541, std.dev.: 0.2225) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.03% (0.4164 => 0.4207, std.dev.: 0.0172) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.23% (0.1369 => 0.1468, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.43% (0.0641 => 0.0619, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.03% (0.0195 => 0.0197, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.17% (0.0578 => 0.0579, std.dev.: 0.0140) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.45% (1.1437 => 1.1946, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2800.00% (0.0001 => 0.0029, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.19% (0.0627 => 0.0607, std.dev.: 0.0140) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 37.22% (0.0180 => 0.0247, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.42% (0.8017 => 0.7743, std.dev.: 0.0179) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 3.23% (0.0062 => 0.0064, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 04:44:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 06:44:59 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121123124459.1AB0E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6168?compare_to=6166&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6168, Order: 168510, Start Time: 2012-11-23 11:11:57, End Time: 2012-11-23 12:45:26 To: 6166, Order: 168507, Start Time: 2012-11-23 09:09:01, End Time: 2012-11-23 10:42:41 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 1 (181 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (857 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.33% (3.8123 => 3.7615, std.dev.: 0.0190) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.88% (2.0478 => 2.1068, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/salsa20: 2.38% (7.4937 => 7.6720, std.dev.: 0.0252) SingleSource/Benchmarks/Shootout-C++/hash2: 2.31% (3.1932 => 3.2671, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.24% (0.3821 => 0.3506, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -7.01% (2.4924 => 2.3177, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.00% (0.3142 => 0.2922, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.79% (0.3357 => 0.3129, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.74% (0.9542 => 0.8899, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.34% (0.2428 => 0.2274, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: -6.33% (9.2283 => 8.6443, std.dev.: 0.0030) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.31% (0.1584 => 0.1484, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.29% (0.3658 => 0.3428, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: -6.23% (0.9179 => 0.8607, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -6.22% (7.0961 => 6.6549, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.19% (0.9852 => 0.9242, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.18% (0.1796 => 0.1685, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -6.18% (16.1920 => 15.1921, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -6.16% (0.2160 => 0.2027, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.13% (0.1761 => 0.1653, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.12% (0.6484 => 0.6087, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.10% (1.0544 => 0.9901, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.06% (1.3722 => 1.2891, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.02% (3.5339 => 3.3210, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.00% (0.1716 => 0.1613, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.99% (0.2355 => 0.2214, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -5.96% (0.1879 => 0.1767, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -5.92% (4.3330 => 4.0764, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: -5.89% (1.1450 => 1.0776, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.86% (0.7198 => 0.6776, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.86% (0.2695 => 0.2537, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.84% (6.7716 => 6.3758, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.84% (1.6364 => 1.5409, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.83% (1.2300 => 1.1583, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.83% (4.8161 => 4.5354, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.83% (1.4642 => 1.3789, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.82% (4.0323 => 3.7976, std.dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.80% (0.6736 => 0.6345, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.80% (0.5863 => 0.5523, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.76% (0.5591 => 0.5269, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -5.75% (1.1530 => 1.0867, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.75% (4.8802 => 4.5996, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -5.72% (0.3831 => 0.3612, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.71% (0.5478 => 0.5165, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.70% (0.6293 => 0.5934, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.70% (0.3406 => 0.3212, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.70% (0.7919 => 0.7468, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: -5.69% (0.3812 => 0.3595, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.69% (0.3848 => 0.3629, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.68% (0.6667 => 0.6288, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: -5.67% (0.3896 => 0.3675, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.67% (0.3880 => 0.3660, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.66% (0.5705 => 0.5382, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -5.66% (0.2985 => 0.2816, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -5.63% (0.4033 => 0.3806, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.63% (0.3891 => 0.3672, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -5.63% (1.2515 => 1.1811, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.62% (0.5849 => 0.5520, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.62% (0.6260 => 0.5908, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.62% (0.6230 => 0.5880, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.62% (0.6052 => 0.5712, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.61% (0.2548 => 0.2405, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.60% (0.6446 => 0.6085, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.60% (0.5857 => 0.5529, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.60% (0.5805 => 0.5480, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.58% (14.2083 => 13.4149, std.dev.: 0.0120) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.57% (4.5069 => 4.2557, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.57% (0.5802 => 0.5479, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.56% (0.6297 => 0.5947, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.55% (0.6194 => 0.5850, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -5.54% (17.1032 => 16.1554, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.54% (0.3483 => 0.3290, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.54% (0.3884 => 0.3669, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.54% (0.5456 => 0.5154, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: -5.53% (0.4176 => 0.3945, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -5.53% (0.2659 => 0.2512, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -5.52% (15.5079 => 14.6518, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.52% (0.6304 => 0.5956, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.51% (0.5859 => 0.5536, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.51% (0.5570 => 0.5263, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.51% (1.2784 => 1.2080, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.49% (0.5575 => 0.5269, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -5.47% (0.4515 => 0.4268, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.47% (0.5999 => 0.5671, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.45% (0.6189 => 0.5852, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.43% (0.5925 => 0.5603, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.41% (0.6660 => 0.6300, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.40% (0.5941 => 0.5620, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -5.40% (1.3864 => 1.3116, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.37% (0.2999 => 0.2838, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.35% (0.4916 => 0.4653, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.35% (1.2210 => 1.1557, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/property: -5.33% (0.4199 => 0.3975, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.33% (8.0126 => 7.5857, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.33% (0.6440 => 0.6097, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.32% (1.6474 => 1.5597, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.31% (0.6681 => 0.6326, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.31% (0.2278 => 0.2157, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.29% (0.6033 => 0.5714, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: -5.28% (0.3581 => 0.3392, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.27% (0.6676 => 0.6324, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -5.23% (3.5154 => 3.3317, std.dev.: 0.0016) MultiSource/Applications/lua/lua: -5.22% (4.0594 => 3.8473, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: -5.18% (0.7447 => 0.7061, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.18% (22.4056 => 21.2450, std.dev.: 0.0086) MultiSource/Applications/siod/siod: -5.18% (2.4021 => 2.2777, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.13% (0.8521 => 0.8084, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.12% (0.3319 => 0.3149, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.10% (0.5688 => 0.5398) SingleSource/UnitTests/ObjC/parameter-passing: -5.09% (0.4280 => 0.4062, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.07% (0.2385 => 0.2264, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.05% (0.5168 => 0.4907, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.01% (0.7339 => 0.6971, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -4.96% (0.7982 => 0.7586, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -4.96% (15.2527 => 14.4968, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.94% (0.6395 => 0.6079, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: -4.93% (2.1401 => 2.0345, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -4.92% (1.3148 => 1.2501, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.92% (1.2221 => 1.1620, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.91% (0.4151 => 0.3947, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.89% (0.2106 => 0.2003, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.88% (0.7524 => 0.7157, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.83% (0.3931 => 0.3741, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.80% (0.7021 => 0.6684, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -4.76% (0.3255 => 0.3100, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -4.74% (0.3271 => 0.3116, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.73% (0.5329 => 0.5077, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.71% (0.3057 => 0.2913, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.69% (0.3323 => 0.3167, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.64% (0.3016 => 0.2876, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.63% (0.5567 => 0.5309, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.63% (0.4813 => 0.4590, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -4.61% (18.2933 => 17.4499, std.dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/ary3: -4.59% (0.3446 => 0.3288, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.58% (0.9557 => 0.9119, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.58% (0.6395 => 0.6102, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.58% (0.2903 => 0.2770, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.57% (0.2933 => 0.2799, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -4.57% (0.4248 => 0.4054, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -4.56% (0.2871 => 0.2740, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -4.56% (0.3026 => 0.2888, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.55% (2.2587 => 2.1559, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.55% (0.3252 => 0.3104, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -4.55% (0.8418 => 0.8035, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.55% (0.3849 => 0.3674, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -4.51% (0.3194 => 0.3050, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.49% (2.1713 => 2.0738, std.dev.: 0.0040) MultiSource/Applications/oggenc/oggenc: -4.49% (5.0226 => 4.7971, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: -4.46% (0.3205 => 0.3062, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -4.46% (0.2939 => 0.2808, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -4.45% (0.3481 => 0.3326, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -4.45% (0.2989 => 0.2856, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -4.43% (34.0927 => 32.5809, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/hello: -4.42% (0.2849 => 0.2723, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -4.42% (0.3867 => 0.3696, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -4.42% (0.3394 => 0.3244, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -4.40% (0.4861 => 0.4647, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -4.40% (0.3025 => 0.2892, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -4.36% (0.3621 => 0.3463, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.36% (0.4083 => 0.3905, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.25% (0.4427 => 0.4239, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -4.18% (0.3059 => 0.2931, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -4.18% (0.6750 => 0.6468, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.14% (0.9077 => 0.8701, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.12% (0.3491 => 0.3347, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: -4.10% (0.7779 => 0.7460, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.91% (0.3837 => 0.3687, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: -3.91% (0.3788 => 0.3640, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.83% (5.4682 => 5.2586, std.dev.: 0.0702) SingleSource/Benchmarks/Shootout-C++/hash: -3.63% (0.4524 => 0.4360, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: -3.58% (1.5610 => 1.5051, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.56% (0.4321 => 0.4167, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: -3.49% (0.6441 => 0.6216, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.47% (0.6347 => 0.6127, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.65% (20.7746 => 20.2233, std.dev.: 0.0683) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7575, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: -8.68% (1.2842 => 1.1727, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7068, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.75% (2.2633 => 2.1784, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0245, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4741, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 04:49:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 06:49:37 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121123124937.A6CE22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6169?compare_to=6163&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6169, Order: 168507, Start Time: 2012-11-23 10:30:22, End Time: 2012-11-23 12:50:04 To: 6163, Order: 168505, Start Time: 2012-11-23 07:15:16, End Time: 2012-11-23 09:39:17 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 56 (184 on baseline) Performance Improvements: 18 (37 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1012 (664 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: 14.17% (0.0889 => 0.1015, std.dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 13.37% (1.5333 => 1.7383, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.95% (0.3011 => 0.3401, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.77% (0.5788 => 0.6527, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.73% (0.5128 => 0.5781, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.67% (0.7553 => 0.8510, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.17% (0.4339 => 0.4867, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/sieve: 12.10% (0.3993 => 0.4476, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: 11.01% (0.2879 => 0.3196, std.dev.: 0.0090) SingleSource/Benchmarks/LivermoreLoops/kernel01: 10.94% (0.1015 => 0.1126, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.80% (0.3149 => 0.3489, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.75% (0.3218 => 0.3564, std.dev.: 0.0065) SingleSource/Benchmarks/LivermoreLoops/kernel02: 10.46% (0.1052 => 0.1162, std.dev.: 0.0010) SingleSource/Benchmarks/LivermoreLoops/kernel07: 10.17% (0.1042 => 0.1148, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 10.16% (0.3415 => 0.3762, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.15% (0.3468 => 0.3820, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.01% (0.1929 => 0.2122, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 9.84% (0.1453 => 0.1596, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 9.73% (0.1347 => 0.1478, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/random: 9.67% (0.3051 => 0.3346, std.dev.: 0.0086) SingleSource/Benchmarks/LivermoreLoops/kernel04: 9.62% (0.1060 => 0.1162, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.93% (0.7189 => 0.7831, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 8.89% (0.5882 => 0.6405, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/except: 8.72% (0.3247 => 0.3530, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: 8.67% (0.3483 => 0.3785, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 8.25% (0.3236 => 0.3503, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.19% (0.3896 => 0.4215, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/lists1: 8.04% (0.4229 => 0.4569, std.dev.: 0.0102) SingleSource/Benchmarks/Stanford/Puzzle: 7.38% (0.1423 => 0.1528, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.73% (0.7321 => 0.7814, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.81% (2.3939 => 2.5331, std.dev.: 0.0263) MultiSource/Benchmarks/PAQ8p/paq8p: 5.09% (11.0622 => 11.6253, std.dev.: 0.1029) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.93% (0.7201 => 0.7556, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: 4.36% (0.3879 => 0.4048, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 3.99% (0.3985 => 0.4144, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: 2.88% (54.8881 => 56.4668, std.dev.: 0.2456) MultiSource/Applications/SPASS/SPASS: 2.72% (17.8323 => 18.3177, std.dev.: 0.0463) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench: 23.16% (2.1028 => 2.5899, std.dev.: 0.0111) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 20.70% (1.3413 => 1.6190, std.dev.: 0.0336) SingleSource/Benchmarks/Misc-C++/stepanov_container: 20.01% (5.9768 => 7.1726, std.dev.: 0.2263) SingleSource/Benchmarks/Shootout-C++/ary3: 18.68% (3.9761 => 4.7189, std.dev.: 0.2003) SingleSource/Benchmarks/Shootout/ary3: 17.69% (3.8915 => 4.5799, std.dev.: 0.0766) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 13.40% (2.7650 => 3.1356, std.dev.: 0.0576) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.93% (11.4713 => 12.8399, std.dev.: 0.0876) MultiSource/Benchmarks/Olden/mst/mst: 11.72% (0.1323 => 0.1478, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 7.56% (0.5359 => 0.5764, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/ffbench: 7.37% (0.9937 => 1.0669, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/strcat: 7.24% (0.1934 => 0.2074, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 3.61% (18.4675 => 19.1339, std.dev.: 0.2231) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.00% (3.7211 => 3.8328, std.dev.: 0.0140) MultiSource/Benchmarks/Olden/em3d/em3d: 2.65% (3.1102 => 3.1927, std.dev.: 0.0276) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.08% (60.8101 => 62.0753, std.dev.: 0.2529) SingleSource/Benchmarks/Shootout-C++/ackermann: 1.62% (1.7516 => 1.7800, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.62% (6.0408 => 6.1386, std.dev.: 0.0285) SingleSource/Benchmarks/Shootout-C++/lists: 1.51% (12.6052 => 12.7951, std.dev.: 0.0370) SingleSource/Benchmarks/Dhrystone/fldry: 1.12% (1.9794 => 2.0016, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/for-in: -7.76% (0.4498 => 0.4149, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.71% (0.4344 => 0.4009, std.dev.: 0.0128) SingleSource/UnitTests/ObjC/exceptions-2: -7.59% (0.4269 => 0.3945, std.dev.: 0.0078) SingleSource/UnitTests/ObjC/exceptions: -7.37% (0.4655 => 0.4312, std.dev.: 0.0096) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.30% (0.4304 => 0.3990, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -7.25% (0.4275 => 0.3965, std.dev.: 0.0087) SingleSource/UnitTests/ObjC/exceptions-4: -6.80% (0.4282 => 0.3991, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/flops: -6.26% (0.2107 => 0.1975, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.57% (0.3320 => 0.3135, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -4.74% (0.4598 => 0.4380, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: -4.34% (0.4196 => 0.4014, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.30% (0.4094 => 0.3918, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -4.26% (0.3897 => 0.3731, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/parameter-passing: -3.60% (0.4605 => 0.4439, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -3.59% (0.5734 => 0.5528, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash2: -5.68% (3.5715 => 3.3685, std.dev.: 0.0572) SingleSource/Benchmarks/Shootout-C++/hash: -3.19% (0.8029 => 0.7773, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout/hash: -2.14% (5.0423 => 4.9342, std.dev.: 0.0106) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.18% (69.4887 => 69.6156, std.dev.: 0.2578) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 1.87% (0.1338 => 0.1363, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0421 => 0.0420, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0651 => 0.0650, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: 0.07% (493.7186 => 494.0724, std.dev.: 0.0707) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 10.07% (63.2438 => 69.6156, std.dev.: 0.2578) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43712.40% (1.1277 => 494.0724, std.dev.: 0.0707) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 232.43% (0.5229 => 1.7383, std.dev.: 0.0141) MultiSource/Applications/SPASS/SPASS: 22.20% (14.9895 => 18.3177, std.dev.: 0.0463) MultiSource/Applications/kimwitu++/kc: 50.39% (14.1553 => 21.2880, std.dev.: 0.3661) MultiSource/Benchmarks/MallocBench/gs/gs: 15.89% (4.1105 => 4.7637, std.dev.: 0.2719) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.84% (1.1048 => 1.5118, std.dev.: 0.0660) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 427.84% (7.1582 => 37.7838, std.dev.: 0.4206) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.91% (3.4629 => 6.4378, std.dev.: 0.1841) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.91% (0.6222 => 1.0323, std.dev.: 0.0683) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10481.67% (0.0720 => 7.6188, std.dev.: 0.3139) MultiSource/Applications/SIBsim4/SIBsim4: 3901900.00% (0.0001 => 3.9020, std.dev.: 0.0220) MultiSource/Applications/SPASS/SPASS: 14067000.00% (0.0001 => 14.0671, std.dev.: 0.7147) MultiSource/Applications/kimwitu++/kc: 52100.00% (0.0001 => 0.0522, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 63800.00% (0.0001 => 0.0639, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576700.00% (0.0001 => 0.5768, std.dev.: 0.0214) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10070900.00% (0.0001 => 10.0710, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7172500.00% (0.0001 => 7.1726, std.dev.: 0.2263) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1764.66% (1.1194 => 20.8730, std.dev.: 0.6219) MultiSource/Applications/ClamAV/clamscan: 64.94% (22.1758 => 36.5758, std.dev.: 0.9244) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 58.50% (7.0540 => 11.1806, std.dev.: 0.1919) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.33% (2.9384 => 4.5936, std.dev.: 0.2942) MultiSource/Benchmarks/FreeBench/distray/distray: 55.21% (0.1056 => 0.1639, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/almabench: 49.73% (0.0730 => 0.1093, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 47.56% (21.9371 => 32.3712, std.dev.: 0.1653) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.35% (8.1363 => 11.9888, std.dev.: 0.3314) SingleSource/UnitTests/vla: 38.31% (0.0355 => 0.0491, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 37.92% (0.1432 => 0.1975, std.dev.: 0.0042) SingleSource/Benchmarks/Stanford/Oscar: 37.58% (0.0636 => 0.0875, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 33.11% (0.0746 => 0.0993, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 30.72% (0.1175 => 0.1536, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: 28.91% (0.0626 => 0.0807, std.dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 28.00% (0.1125 => 0.1440, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.86% (0.5105 => 0.6527, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Towers: 27.60% (0.0471 => 0.0601, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.49% (0.6675 => 0.8510, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: 27.46% (0.3307 => 0.4215, std.dev.: 0.0075) SingleSource/Benchmarks/McGill/chomp: 27.37% (0.1655 => 0.2108, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 27.09% (0.1163 => 0.1478, std.dev.: 0.0026) SingleSource/Benchmarks/Stanford/Queens: 26.57% (0.0414 => 0.0524, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 26.16% (0.0818 => 0.1032, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.98% (0.0408 => 0.0514, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 25.92% (0.3865 => 0.4867, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 25.79% (0.0442 => 0.0556, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 25.19% (0.1695 => 0.2122, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 24.70% (0.4636 => 0.5781, std.dev.: 0.0064) SingleSource/Benchmarks/Stanford/Treesort: 24.33% (0.0411 => 0.0511, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 24.27% (0.4615 => 0.5735, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 24.26% (0.0672 => 0.0835, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sieve: 24.23% (0.3603 => 0.4476, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists1: 24.02% (0.3684 => 0.4569, std.dev.: 0.0102) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 23.92% (0.0953 => 0.1181, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 23.86% (0.3232 => 0.4003, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/functionobjects: 23.84% (0.5020 => 0.6217, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/lpbench: 23.79% (0.0929 => 0.1150, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ackermann: 23.40% (0.2756 => 0.3401, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: 23.31% (0.0871 => 0.1074, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary3: 23.30% (0.3283 => 0.4048, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 23.30% (0.0528 => 0.0651, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 23.28% (0.2891 => 0.3564, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/wc: 23.26% (0.3052 => 0.3762, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/strcat: 23.24% (0.2831 => 0.3489, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.17% (0.0479 => 0.0590, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bisort/bisort: 23.13% (0.0614 => 0.0756, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/except: 22.95% (0.2871 => 0.3530, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.64% (0.1029 => 0.1262, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 22.64% (0.3379 => 0.4144, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/exptree: 22.60% (0.0814 => 0.0998, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: 22.58% (2.0665 => 2.5331, std.dev.: 0.0263) SingleSource/Benchmarks/Shootout-C++/fibo: 22.57% (0.2725 => 0.3340, std.dev.: 0.0093) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.49% (0.3121 => 0.3823, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/matrix: 22.18% (0.3098 => 0.3785, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 22.00% (0.1268 => 0.1547, std.dev.: 0.0052) MultiSource/Applications/siod/siod: 21.93% (2.2969 => 2.8007, std.dev.: 0.0943) MultiSource/Benchmarks/Prolangs-C++/life/life: 21.86% (0.0933 => 0.1137, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 21.82% (0.0660 => 0.0804, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 21.81% (0.0564 => 0.0687, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 21.76% (0.2877 => 0.3503, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 21.67% (0.4203 => 0.5114, std.dev.: 0.0113) MultiSource/Benchmarks/McCat/08-main/main: 21.65% (0.2554 => 0.3107, std.dev.: 0.0193) SingleSource/UnitTests/Vector/SSE/sse_isamax: 21.59% (0.0704 => 0.0856, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 21.53% (0.1584 => 0.1925, std.dev.: 0.0114) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.46% (0.1566 => 0.1902, std.dev.: 0.0087) MultiSource/Benchmarks/NPB-serial/is/is: 21.42% (0.0719 => 0.0873, std.dev.: 0.0042) SingleSource/UnitTests/SignlessTypes/rem: 21.15% (0.1144 => 0.1386, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 21.11% (0.4103 => 0.4969, std.dev.: 0.0212) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 20.81% (0.3162 => 0.3820, std.dev.: 0.0049) SingleSource/Benchmarks/Stanford/Puzzle: 20.50% (0.1268 => 0.1528, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.50% (0.2107 => 0.2539, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.39% (0.0770 => 0.0927, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 20.24% (0.4289 => 0.5157, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/hash2: 19.65% (0.4620 => 0.5528, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 19.41% (0.2802 => 0.3346, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 19.39% (14.3668 => 17.1519, std.dev.: 0.2267) MultiSource/Applications/oggenc/oggenc: 18.80% (5.7591 => 6.8420, std.dev.: 0.1850) SingleSource/Benchmarks/McGill/misr: 18.64% (0.0633 => 0.0751, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.52% (0.2700 => 0.3200, std.dev.: 0.0190) SingleSource/Benchmarks/Misc-C++/Large/ray: 18.45% (0.4064 => 0.4814, std.dev.: 0.0095) SingleSource/UnitTests/2006-12-11-LoadConstants: 18.37% (0.1143 => 0.1353, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 18.36% (0.2603 => 0.3081, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 17.83% (0.2271 => 0.2676, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 17.74% (0.2430 => 0.2861, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.57% (4.2646 => 5.0141, std.dev.: 0.1182) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.34% (0.0842 => 0.0988, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 17.04% (0.3650 => 0.4272, std.dev.: 0.0127) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.92% (0.8172 => 0.9555, std.dev.: 0.0422) MultiSource/Benchmarks/FreeBench/neural/neural: 16.47% (0.1463 => 0.1704, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.35% (0.9765 => 1.1362, std.dev.: 0.0397) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.98% (1.3050 => 1.5136, std.dev.: 0.0425) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.91% (0.0886 => 0.1027, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/em3d/em3d: 15.87% (0.1695 => 0.1964, std.dev.: 0.0101) SingleSource/UnitTests/ObjC/messages-2: 15.86% (0.0662 => 0.0767) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.84% (0.2065 => 0.2392, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.77% (4.9449 => 5.7249, std.dev.: 0.1222) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.59% (0.0648 => 0.0749, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.49% (0.1117 => 0.1290, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.06% (0.0770 => 0.0886, std.dev.: 0.0041) MultiSource/Applications/viterbi/viterbi: 15.05% (0.1555 => 0.1789, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.79% (0.1940 => 0.2227, std.dev.: 0.0101) MultiSource/Applications/treecc/treecc: 14.69% (2.0273 => 2.3252, std.dev.: 0.1141) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.58% (0.1337 => 0.1532, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.51% (0.0834 => 0.0955, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.28% (0.5981 => 0.6835, std.dev.: 0.0243) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.26% (0.5569 => 0.6363, std.dev.: 0.0302) MultiSource/Benchmarks/mafft/pairlocalalign: 14.17% (9.4845 => 10.8286, std.dev.: 0.4184) MultiSource/Applications/sqlite3/sqlite3: 14.13% (17.1811 => 19.6093, std.dev.: 0.7335) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.75% (0.1062 => 0.1208, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/oourafft: 13.68% (0.3282 => 0.3731, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 13.09% (0.3177 => 0.3593, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: 13.04% (0.3927 => 0.4439, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.81% (0.3473 => 0.3918, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.81% (0.3497 => 0.3945, std.dev.: 0.0078) SingleSource/UnitTests/ObjC/exceptions-3: 12.77% (0.3516 => 0.3965, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/bigfib: 12.73% (0.6456 => 0.7278, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.73% (5.0018 => 5.6386, std.dev.: 0.2232) SingleSource/UnitTests/ObjC/synchronized: 12.72% (0.3561 => 0.4014, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.71% (0.3886 => 0.4380, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 12.64% (0.3543 => 0.3991, std.dev.: 0.0091) SingleSource/UnitTests/ObjC/exceptions: 12.64% (0.3828 => 0.4312, std.dev.: 0.0096) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.62% (0.3543 => 0.3990, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 12.42% (2.2024 => 2.4760, std.dev.: 0.0150) SingleSource/UnitTests/ObjC/for-in: 12.32% (0.3694 => 0.4149, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 12.23% (1.1840 => 1.3288, std.dev.: 0.0401) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.15% (0.8101 => 0.9085, std.dev.: 0.0379) MultiSource/Benchmarks/PAQ8p/paq8p: 12.13% (10.3673 => 11.6253, std.dev.: 0.1029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.09% (3.8922 => 4.3627, std.dev.: 0.1135) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.59% (0.1906 => 0.2127, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/lists: 11.28% (0.3422 => 0.3808, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.17% (0.4879 => 0.5424, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: 10.83% (0.1440 => 0.1596, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 10.12% (0.2905 => 0.3199, std.dev.: 0.0108) SingleSource/UnitTests/ObjC++/Hello: 9.81% (0.5925 => 0.6506, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 9.47% (0.2714 => 0.2971, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.16% (0.2872 => 0.3135, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: 4.25% (54.1659 => 56.4668, std.dev.: 0.2456) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.28% (4.3953 => 11.0004, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 147.42% (5.3999 => 13.3604, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 30.28% (1.5086 => 1.9654, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/fftbench: 27.21% (2.0360 => 2.5899, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/ary3: 26.78% (3.7221 => 4.7189, std.dev.: 0.2003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 24.11% (1.3045 => 1.6190, std.dev.: 0.0336) SingleSource/Benchmarks/CoyoteBench/lpbench: 24.10% (10.3460 => 12.8399, std.dev.: 0.0876) SingleSource/Benchmarks/Shootout/ary3: 23.80% (3.6994 => 4.5799, std.dev.: 0.0766) SingleSource/Benchmarks/Shootout-C++/ary2: 18.36% (0.0757 => 0.0896, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 17.44% (6.6465 => 7.8055, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.63% (1.1145 => 1.2998, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/mst/mst: 15.02% (0.1285 => 0.1478, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/health/health: 14.20% (0.4445 => 0.5076, std.dev.: 0.0125) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.35% (0.2944 => 0.3337, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/ffbench: 12.25% (0.9505 => 1.0669, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: 12.09% (1.0785 => 1.2089, std.dev.: 0.0252) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.74% (2.8904 => 3.2298, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 10.29% (1.1396 => 1.2569, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 10.06% (0.1421 => 0.1564, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.30% (1.7254 => 1.8858, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/strcat: 9.22% (0.1899 => 0.2074, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3685, std.dev.: 0.0572) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.71% (4.2280 => 4.4695, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.31% (3.6395 => 3.8328, std.dev.: 0.0140) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 4.50% (26.0924 => 27.2674, std.dev.: 0.2840) SingleSource/Benchmarks/Shootout-C++/hash: 4.27% (0.7455 => 0.7773, std.dev.: 0.0073) MultiSource/Benchmarks/nbench/nbench: 4.03% (11.6436 => 12.1132, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.89% (1.7133 => 1.7800, std.dev.: 0.0088) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 2.91% (3.1023 => 3.1927, std.dev.: 0.0276) SingleSource/Benchmarks/Dhrystone/dry: 2.63% (2.4116 => 2.4750, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/heapsort: 2.29% (3.8532 => 3.9416, std.dev.: 0.0100) SingleSource/Benchmarks/Dhrystone/fldry: 2.24% (1.9577 => 2.0016, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.16% (1.3677 => 1.3972, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 2.08% (12.5348 => 12.7951, std.dev.: 0.0370) MultiSource/Applications/aha/aha: 2.05% (3.1595 => 3.2242, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 1.96% (85.0658 => 86.7300, std.dev.: 0.1127) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.81% (2.1424 => 2.1812, std.dev.: 0.0145) MultiSource/Benchmarks/mafft/pairlocalalign: 1.60% (27.8444 => 28.2900, std.dev.: 0.0309) SingleSource/Benchmarks/Shootout-C++/sieve: 1.49% (2.4858 => 2.5229, std.dev.: 0.0079) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.42% (6.5088 => 6.6012, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/sieve: 1.39% (5.2139 => 5.2863, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0501, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.33% (6.6874 => 0.1783, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -74.98% (5.2763 => 1.3203, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/salsa20: -74.57% (0.8651 => 0.2200, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: -37.42% (0.1622 => 0.1015, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.96% (5.3526 => 4.8194, std.dev.: 0.1060) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.03% (5.3855 => 4.9532, std.dev.: 0.0479) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.38% (0.3987 => 0.2377, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.30% (4.5009 => 2.7770, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.11% (2.6546 => 2.0145, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -22.80% (32.5116 => 25.0998, std.dev.: 1.8519) MultiSource/Benchmarks/FreeBench/mason/mason: -19.30% (0.2161 => 0.1744, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.69% (1.6925 => 1.4270, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.69% (2.6778 => 2.2844, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -10.63% (1.5373 => 1.3739, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -10.53% (9.5636 => 8.5568, std.dev.: 0.2460) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.05% (1.5660 => 1.4243, std.dev.: 0.0042) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.28% (1.6805 => 1.5414, std.dev.: 0.0414) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.92% (4.8142 => 4.4811, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.2416 => 3.0210, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (2.7294 => 2.5788, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.01% (0.2497 => 0.2372, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.92% (1.5835 => 1.5056, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: -4.27% (6.2999 => 6.0309, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.08% (19.9488 => 19.1339, std.dev.: 0.2231) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.41% (0.9957 => 0.9617, std.dev.: 0.0033) MultiSource/Benchmarks/sim/sim: -3.09% (5.0483 => 4.8921, std.dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.33% (0.4808 => 0.4696, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.74% (8.1563 => 8.0142, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: -1.48% (10.2830 => 10.1307, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.22% (0.1485 => 0.1363, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.28% (0.2116 => 0.0650, std.dev.: 0.0014) Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 06:30:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 08:30:11 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121123143011.CBF912A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6170?compare_to=6167&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6170, Order: 168512, Start Time: 2012-11-23 12:59:38, End Time: 2012-11-23 14:30:39 To: 6167, Order: 168510, Start Time: 2012-11-23 11:09:20, End Time: 2012-11-23 12:42:33 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 13 (103 on baseline) Performance Improvements: 0 (23 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1041 (848 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.67% (0.8851 => 0.9176, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.18% (1.3585 => 1.3881, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.17% (0.8976 => 0.9171, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.99% (0.9595 => 0.9786, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.62% (0.6354 => 0.6457, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.42% (0.8444 => 0.8564, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 1.28% (0.8958 => 0.9073, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.26% (0.8641 => 0.8750, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 14.42% (0.7643 => 0.8745, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.46% (6.2938 => 6.7631, std.dev.: 0.0380) MultiSource/Benchmarks/llubenchmark/llu: 1.89% (1.9902 => 2.0278, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/pi: 1.88% (2.4617 => 2.5079, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.42% (1.5821 => 1.6046, std.dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.24% (1.0588 => 1.0613, std.dev.: 0.1124) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.98% (0.0201 => 0.0191, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0429 => 0.0428, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -20.54% (0.0336 => 0.0267, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0315 => 0.0314, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.69% (0.0432 => 0.0429) SingleSource/UnitTests/Vector/Altivec/casts: -19.42% (0.0206 => 0.0166, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/test1: -40.53% (0.0227 => 0.0135, std.dev.: 0.0041) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.20% (0.1478 => 0.1475, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: 1.82% (1.1541 => 1.1751, std.dev.: 0.2227) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.02% (0.4207 => 0.4208, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.56% (0.1468 => 0.1401, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.91% (0.0619 => 0.0637, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 32.49% (0.0197 => 0.0261, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.52% (0.0579 => 0.0582, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.69% (1.1946 => 1.1863, std.dev.: 0.0125) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -31.03% (0.0029 => 0.0020, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -85.19% (0.0027 => 0.0004, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.39% (0.0607 => 0.0550, std.dev.: 0.0130) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.46% (0.0247 => 0.0194, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.84% (0.7743 => 0.7808, std.dev.: 0.0080) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -32.81% (0.0064 => 0.0043, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.98% (16.4461 => 17.9235, std.dev.: 0.5882) MultiSource/Applications/sqlite3/sqlite3: 2338.99% (0.6332 => 15.4437, std.dev.: 0.6713) MultiSource/Benchmarks/McCat/08-main/main: 47.13% (0.1831 => 0.2694, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.31% (0.1559 => 0.1445, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7152.19% (0.3123 => 22.6486, std.dev.: 0.0552) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.44% (0.2463 => 0.3730, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1536.45% (0.3344 => 5.4723, std.dev.: 0.2557) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.39% (0.2364 => 0.3248, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/bigfib: 4.81% (0.6010 => 0.6299, std.dev.: 0.0211) SingleSource/Benchmarks/Misc/mandel: 3.73% (0.0429 => 0.0445, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.82% (0.3266 => 0.3456, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/strcat: 4.22% (0.1969 => 0.2052, std.dev.: 0.0053) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.89% (0.0224 => 0.0226, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0000) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0523, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 7.52% (0.1462 => 0.1572, std.dev.: 0.0098) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4715, std.dev.: 0.0806) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0716, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4905, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5127, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.4878, std.dev.: 0.0877) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3262, std.dev.: 0.0652) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1301, std.dev.: 0.0182) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3655, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4062, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0798, std.dev.: 0.0070) SingleSource/Regression/C/uint64_to_float: -23.86% (2.1832 => 1.6623, std.dev.: 0.0286) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.05% (0.0810 => 0.0940, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.46% (0.0830 => 0.0950, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.68% (0.0848 => 0.0964, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.28% (0.8321 => 0.9176, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/tsp/tsp: 9.80% (0.1112 => 0.1221, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.22% (0.2180 => 0.2381, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.04% (0.2279 => 0.2485, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.42% (0.1425 => 0.1545, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.15% (0.4847 => 0.5242, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.56% (0.1983 => 0.2133, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.96% (0.2240 => 0.2396, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.57% (0.7473 => 0.7964, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.49% (0.6010 => 0.6400, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.46% (0.1905 => 0.2028, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.44% (0.3137 => 0.3339, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.15% (0.8148 => 0.8649, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.87% (0.2998 => 0.3174, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.72% (0.2519 => 0.2663, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.52% (0.4127 => 0.4355, std.dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.46% (0.1885 => 0.1988, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 5.09% (4.1305 => 4.3408, std.dev.: 0.0536) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.96% (0.6287 => 0.6599, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.95% (0.2103 => 0.2207, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.79% (1.1685 => 1.2245, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.63% (0.3003 => 0.3142, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.53% (1.3279 => 1.3881, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.27% (0.7966 => 0.8306, std.dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.20% (0.4783 => 0.4984, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 4.16% (0.8805 => 0.9171, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.12% (1.4479 => 1.5076, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.09% (1.2526 => 1.3038, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.92% (0.8420 => 0.8750, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.75% (0.8286 => 0.8597, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.72% (0.2794 => 0.2898, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.72% (0.9435 => 0.9786, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.69% (0.6227 => 0.6457, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.67% (0.8261 => 0.8564, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.65% (4.1763 => 4.3288, std.dev.: 0.0252) MultiSource/Benchmarks/PAQ8p/paq8p: 3.60% (2.3764 => 2.4620, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.51% (0.5817 => 0.6021, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/football/football: 3.48% (0.8768 => 0.9073, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.44% (1.6386 => 1.6950, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.37% (0.3115 => 0.3220, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.22% (6.6074 => 6.8202, std.dev.: 0.0382) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.19% (0.8048 => 0.8305, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.13% (8.6476 => 8.9186, std.dev.: 0.0634) MultiSource/Benchmarks/nbench/nbench: 3.13% (1.1271 => 1.1624, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.08% (0.8697 => 0.8965, std.dev.: 0.0103) MultiSource/Benchmarks/Bullet/bullet: 3.05% (31.8598 => 32.8316, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.89% (4.4873 => 4.6170, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.86% (0.8007 => 0.8236, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.70% (1.1170 => 1.1472, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.67% (13.1811 => 13.5336, std.dev.: 0.0366) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.67% (0.9074 => 0.9316, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.66% (0.8359 => 0.8581, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.65% (0.8855 => 0.9090, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.61% (0.8086 => 0.8297, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.60% (0.8066 => 0.8276, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.48% (0.8457 => 0.8667, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.40% (0.9056 => 0.9273, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.38% (0.8317 => 0.8515, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.33% (4.5702 => 4.6768, std.dev.: 0.0307) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.32% (0.9688 => 0.9913, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.31% (0.8885 => 0.9090, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.27% (0.8177 => 0.8363, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.21% (0.8597 => 0.8787, std.dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: 1.78% (8.6247 => 8.7785, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 88.94% (0.0199 => 0.0376, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/pi: 58.78% (1.5795 => 2.5079, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.95% (0.7597 => 0.8961, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.36% (2.9753 => 3.4621, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.70% (2.7995 => 3.2111, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.24% (6.3772 => 7.1577, std.dev.: 0.1994) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6086, std.dev.: 0.0322) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.09% (1.1857 => 1.2816, std.dev.: 0.0081) SingleSource/Benchmarks/McGill/queens: 7.51% (1.7056 => 1.8337, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.76% (4.7794 => 5.1024, std.dev.: 0.0149) MultiSource/Applications/SIBsim4/SIBsim4: 6.26% (3.1873 => 3.3868, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/richards_benchmark: 6.21% (1.3037 => 1.3846, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.95% (4.9686 => 5.2643, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.79% (4.5327 => 4.7953, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.78% (0.3186 => 0.3370, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.69% (6.2275 => 6.5195, std.dev.: 0.0072) MultiSource/Applications/lambda-0_1_3/lambda: 4.49% (7.4933 => 7.8297, std.dev.: 0.0349) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.44% (3.3761 => 3.5259, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.15% (4.9453 => 5.1503, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.89% (14.0064 => 14.5511, std.dev.: 0.0498) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.66% (44.5605 => 46.1922, std.dev.: 0.5228) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.57% (0.2887 => 0.2990, std.dev.: 0.0019) MultiSource/Applications/siod/siod: 3.16% (3.6643 => 3.7800, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.85% (11.5690 => 11.8982, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.83% (8.2783 => 8.5125, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.82% (0.3587 => 0.3688, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.45% (4.8660 => 4.9850, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout/lists: 2.15% (7.3375 => 7.4956, std.dev.: 0.0522) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.05% (4.8362 => 4.9355, std.dev.: 0.0330) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.03% (1.1365 => 1.1596, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 1.63% (1.2061 => 1.2258, std.dev.: 0.0032) MultiSource/Benchmarks/llubenchmark/llu: 1.56% (1.9967 => 2.0278, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.53% (2.4647 => 2.5024, std.dev.: 0.0133) MultiSource/Benchmarks/FreeBench/neural/neural: 1.35% (1.0841 => 1.0987, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 1.31% (8.5322 => 8.6439, std.dev.: 0.0266) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.13% (1.5866 => 1.6046, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.76% (5.4641 => 4.3300, std.dev.: 0.0284) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.82% (1.0512 => 0.9375, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.06% (1.1216 => 1.0088, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.51% (14.6451 => 13.3985, std.dev.: 0.1734) MultiSource/Benchmarks/mafft/pairlocalalign: -8.51% (63.1822 => 57.8084, std.dev.: 0.0347) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.11% (0.3269 => 0.3004, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.92% (4.7482 => 4.4198, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -6.24% (7.2130 => 6.7631, std.dev.: 0.0380) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.94% (3.7148 => 3.4941, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.90% (5.4972 => 5.1729, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.06% (5.1557 => 4.8950, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.44% (4.7449 => 4.5344, std.dev.: 0.0111) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.16% (2.8773 => 2.7576, std.dev.: 0.0392) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.47% (6.0224 => 5.8137, std.dev.: 0.0132) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.40% (2.4490 => 2.3657, std.dev.: 0.0305) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.05% (28.5821 => 27.7090, std.dev.: 0.0296) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.89% (0.5807 => 0.5639, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.56% (9.9065 => 9.6532, std.dev.: 0.0642) SingleSource/Benchmarks/Shootout-C++/hash2: -2.34% (3.4237 => 3.3437, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.01% (11.5316 => 11.2993, std.dev.: 0.0120) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.62% (2.3487 => 2.3107, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.57% (4.9994 => 4.9211, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.13% (5.6343 => 5.5705, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.42% (1.0262 => 1.0613, std.dev.: 0.1124) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 55.28% (0.0123 => 0.0191, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 5.12% (0.0254 => 0.0267, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.72% (0.0384 => 0.0429) SingleSource/UnitTests/Vector/Altivec/casts: -12.63% (0.0190 => 0.0166, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/test1: -25.00% (0.0180 => 0.0135, std.dev.: 0.0041) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.57% (0.1438 => 0.1475, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: 3.72% (1.1329 => 1.1751, std.dev.: 0.2227) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.06% (0.4164 => 0.4208, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.34% (0.1369 => 0.1401, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.62% (0.0641 => 0.0637, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 33.85% (0.0195 => 0.0261, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.69% (0.0578 => 0.0582, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.72% (1.1437 => 1.1863, std.dev.: 0.0125) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1900.00% (0.0001 => 0.0020, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -71.43% (0.0014 => 0.0004, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.28% (0.0627 => 0.0550, std.dev.: 0.0130) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.78% (0.0180 => 0.0194, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.61% (0.8017 => 0.7808, std.dev.: 0.0080) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -30.65% (0.0062 => 0.0043, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 06:41:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 08:41:34 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121123144134.B35DB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6171?compare_to=6168&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6171, Order: 168512, Start Time: 2012-11-23 13:08:28, End Time: 2012-11-23 14:42:02 To: 6168, Order: 168510, Start Time: 2012-11-23 11:11:57, End Time: 2012-11-23 12:45:26 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (182 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (855 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.43% (54.5997 => 56.4727, std.dev.: 0.1164) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.48% (54.5751 => 56.4727, std.dev.: 0.1164) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.77% (2.0478 => 2.1045, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/salsa20: 2.49% (7.4937 => 7.6806, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 2.23% (3.1932 => 3.2644, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.09% (0.3821 => 0.3512, std.dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: -7.01% (2.4924 => 2.3177, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.97% (0.3142 => 0.2923, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.76% (0.3357 => 0.3130, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.53% (0.9542 => 0.8919, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.51% (0.2428 => 0.2270, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.34% (0.6484 => 0.6073, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -6.32% (9.2283 => 8.6454, std.dev.: 0.0111) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.31% (0.1584 => 0.1484, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: -6.30% (0.2160 => 0.2024, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.19% (0.9852 => 0.9242, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.15% (0.3658 => 0.3433, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.13% (1.0544 => 0.9898, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: -6.09% (0.9179 => 0.8620, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: -6.08% (16.1920 => 15.2074, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.07% (0.2355 => 0.2212, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.07% (0.1796 => 0.1687, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.06% (1.3722 => 1.2891, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -6.05% (7.0961 => 6.6670, std.dev.: 0.0091) MultiSource/Benchmarks/MallocBench/gs/gs: -5.97% (4.3330 => 4.0744, std.dev.: 0.0053) SingleSource/Benchmarks/McGill/chomp: -5.96% (0.1761 => 0.1656, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.95% (4.8161 => 4.5297, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.94% (0.5863 => 0.5515, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.91% (3.5339 => 3.3251, std.dev.: 0.0050) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.89% (0.1716 => 0.1615, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.88% (1.6364 => 1.5402, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.86% (0.7198 => 0.6776, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -5.85% (0.1879 => 0.1769, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -5.84% (1.1450 => 1.0781, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.83% (1.4642 => 1.3788, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.83% (0.2695 => 0.2538, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.82% (0.6736 => 0.6344, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.81% (1.2300 => 1.1585, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.80% (0.5705 => 0.5374, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.80% (0.7919 => 0.7460, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.78% (4.0323 => 3.7993, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.77% (6.7716 => 6.3809, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.72% (0.5925 => 0.5586, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -5.72% (1.1530 => 1.0871, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.71% (0.5591 => 0.5272, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.70% (0.6293 => 0.5934, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.70% (4.8802 => 4.6021, std.dev.: 0.0091) SingleSource/UnitTests/ObjC/synchronized: -5.70% (0.3896 => 0.3674, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: -5.70% (0.3880 => 0.3659, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.69% (0.5849 => 0.5516, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: -5.69% (0.3812 => 0.3595, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.69% (0.2548 => 0.2403, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: -5.69% (0.3831 => 0.3613, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.69% (4.5069 => 4.2506, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.66% (0.6446 => 0.6081, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.66% (0.5570 => 0.5255, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.65% (0.6667 => 0.6290, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -5.64% (1.2515 => 1.1809, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.64% (0.5802 => 0.5475, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.62% (0.6297 => 0.5943, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.62% (0.6230 => 0.5880, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.62% (0.5857 => 0.5528, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.62% (0.5805 => 0.5479, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.60% (0.6304 => 0.5951, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.60% (0.5575 => 0.5263, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.59% (0.5478 => 0.5172, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.58% (0.5859 => 0.5532, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.58% (0.3891 => 0.3674, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.57% (0.3483 => 0.3289, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.57% (0.6194 => 0.5849, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -5.57% (0.2659 => 0.2511, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.55% (0.4033 => 0.3809, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.55% (0.8521 => 0.8048, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.55% (14.2083 => 13.4201, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.53% (0.5999 => 0.5667, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.52% (0.5581 => 0.5273, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -5.51% (0.4515 => 0.4266, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.51% (1.2784 => 1.2079, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-3: -5.51% (0.3848 => 0.3636, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -5.49% (0.2985 => 0.2821, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -5.49% (0.3406 => 0.3219, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.48% (0.5456 => 0.5157, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -5.46% (17.1032 => 16.1687, std.dev.: 0.0191) MultiSource/Applications/SIBsim4/SIBsim4: -5.45% (1.3864 => 1.3109, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/18-imp/imp: -5.45% (0.3581 => 0.3386, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.44% (0.2999 => 0.2836, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.43% (0.6260 => 0.5920, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.41% (0.6660 => 0.6300, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.40% (0.6681 => 0.6320, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: -5.39% (15.5079 => 14.6723, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.35% (0.6189 => 0.5858, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.34% (0.6440 => 0.6096, std.dev.: 0.0119) SingleSource/UnitTests/ObjC/exceptions: -5.34% (0.4176 => 0.3953, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.31% (1.2210 => 1.1562, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.29% (0.5688 => 0.5387, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.29% (0.5941 => 0.5627, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.27% (0.3319 => 0.3144, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.27% (0.2278 => 0.2158, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -5.26% (0.4199 => 0.3978, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.23% (1.6474 => 1.5613, std.dev.: 0.0012) MultiSource/Applications/lua/lua: -5.22% (4.0594 => 3.8477, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.21% (0.6676 => 0.6328, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.20% (0.3884 => 0.3682, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.19% (0.6033 => 0.5720, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.19% (0.4916 => 0.4661, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: -5.19% (0.4280 => 0.4058, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.17% (8.0126 => 7.5983, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.16% (1.2221 => 1.1590, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: -5.16% (3.5154 => 3.3341, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -5.14% (2.4021 => 2.2787, std.dev.: 0.0069) MultiSource/Applications/ClamAV/clamscan: -5.10% (15.2527 => 14.4750, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.09% (0.5168 => 0.4905, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.06% (22.4056 => 21.2715, std.dev.: 0.0104) MultiSource/Applications/minisat/minisat: -5.05% (0.7447 => 0.7071, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.94% (0.6395 => 0.6079, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.94% (0.2106 => 0.2002, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.91% (0.7339 => 0.6979, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: -4.89% (0.3271 => 0.3111, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.89% (0.4151 => 0.3948, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -4.87% (1.3148 => 1.2508, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.85% (0.7524 => 0.7159, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -4.84% (0.7982 => 0.7596, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.80% (0.7021 => 0.6684, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -4.79% (2.1401 => 2.0376, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.78% (0.3057 => 0.2911, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -4.74% (0.2871 => 0.2735, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.73% (0.3931 => 0.3745, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.69% (0.3323 => 0.3167, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.69% (0.5567 => 0.5306, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.67% (0.2933 => 0.2796, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.65% (0.5329 => 0.5081, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.65% (0.5569 => 0.5310, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: -4.64% (0.3255 => 0.3104, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -4.63% (0.2939 => 0.2803, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -4.61% (0.4248 => 0.4052, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.61% (0.4813 => 0.4591, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -4.60% (0.3194 => 0.3047, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -4.60% (0.3394 => 0.3238, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -4.60% (0.3025 => 0.2886, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -4.59% (0.3026 => 0.2887, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.58% (0.3252 => 0.3103, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.58% (0.2903 => 0.2770, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: -4.58% (18.2933 => 17.4556, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.58% (0.3016 => 0.2878, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -4.57% (0.4861 => 0.4639, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.54% (0.9557 => 0.9123, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -4.54% (0.3481 => 0.3323, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.54% (2.2587 => 2.1562, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.53% (0.4083 => 0.3898, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: -4.53% (0.2849 => 0.2720, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -4.52% (0.3205 => 0.3060, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.49% (0.9077 => 0.8669, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.49% (0.6395 => 0.6108, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -4.49% (5.0226 => 4.7972, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/strcat: -4.48% (0.2989 => 0.2855, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -4.47% (0.3621 => 0.3459, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -4.47% (34.0927 => 32.5702, std.dev.: 0.0237) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.46% (2.1713 => 2.0744, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.42% (0.3849 => 0.3679, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -4.34% (0.3867 => 0.3699, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -4.32% (0.3446 => 0.3297, std.dev.: 0.0043) MultiSource/Applications/spiff/spiff: -4.25% (0.8418 => 0.8060, std.dev.: 0.0046) SingleSource/Regression/C++/ofstream_ctor: -4.25% (0.3059 => 0.2929, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: -4.22% (0.6750 => 0.6465, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.20% (0.4427 => 0.4241, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.12% (0.3491 => 0.3347, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.00% (0.7779 => 0.7468, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.99% (0.3837 => 0.3684, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.77% (5.4682 => 5.2623, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/hash: -3.60% (0.4524 => 0.4361, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.59% (0.4321 => 0.4166, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: -3.46% (1.5610 => 1.5070, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: -3.40% (0.6441 => 0.6222, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.39% (0.6347 => 0.6132, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.41% (20.7746 => 20.2734, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7538, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1732, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7069, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.79% (2.2633 => 2.1775, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.98% (1.3096 => 1.2706, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4727, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 06:44:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 08:44:38 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121123144438.5CAB82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6172?compare_to=6164&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6172, Order: 168507, Start Time: 2012-11-23 11:23:48, End Time: 2012-11-23 14:45:05 To: 6164, Order: 168505, Start Time: 2012-11-23 07:11:11, End Time: 2012-11-23 10:35:20 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (172 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1092 (718 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.24% (0.0625 => 0.0889, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.93% (0.1063 => 0.1413, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.57% (0.2969 => 0.3758, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.95% (0.1106 => 0.1393, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.44% (0.4253 => 0.5335, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.13% (0.4139 => 0.5179, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 24.91% (1.5932 => 1.9900, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.15% (0.5900 => 0.7325, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.09% (0.0714 => 0.0886) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.01% (0.4994 => 0.6193, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.00% (0.0475 => 0.0589, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.64% (0.1620 => 0.2003, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.63% (0.0584 => 0.0722, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.54% (0.5000 => 0.6177, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.40% (0.0547 => 0.0675, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.23% (0.1021 => 0.1248, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 22.20% (0.0599 => 0.0732, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.07% (0.0897 => 0.1095, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.77% (0.1107 => 0.1348, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.85% (0.0633 => 0.0765, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.72% (0.0584 => 0.0705, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.70% (0.0541 => 0.0653, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 20.68% (0.0948 => 0.1144, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.67% (0.1103 => 0.1331, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.65% (0.3903 => 0.4709, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.61% (0.0495 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.56% (0.0642 => 0.0774, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.54% (0.1003 => 0.1209, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 20.34% (0.0821 => 0.0988, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.27% (0.1549 => 0.1863, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.20% (0.1604 => 0.1928) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.07% (0.0822 => 0.0987, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 20.03% (0.0604 => 0.0725, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 20.01% (0.1619 => 0.1943, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.43% (0.1462 => 0.1746, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 19.11% (0.0947 => 0.1128, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.97% (0.2736 => 0.3255, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 18.94% (0.0808 => 0.0961, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.87% (0.3890 => 0.4624, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 18.78% (0.5826 => 0.6920, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.62% (0.2014 => 0.2389, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 18.44% (0.5889 => 0.6975, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.44% (1.3152 => 1.5577, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: 18.31% (0.1218 => 0.1441, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 18.05% (0.0698 => 0.0824, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 18.02% (0.4029 => 0.4755, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.01% (0.1088 => 0.1284, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 17.87% (0.1505 => 0.1774, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.59% (0.2866 => 0.3370, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.52% (0.0605 => 0.0711, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 17.49% (0.5546 => 0.6516, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 17.28% (1.8794 => 2.2041, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.23% (0.1968 => 0.2307, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.22% (0.4658 => 0.5460, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 17.18% (0.7171 => 0.8403, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.16% (1.6211 => 1.8992, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.10% (3.5627 => 4.1720, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.91% (0.3271 => 0.3824, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.77% (0.5026 => 0.5869, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.77% (0.2875 => 0.3357, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 16.74% (0.9697 => 1.1320, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.72% (0.1160 => 0.1354, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 16.33% (0.1421 => 0.1653, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.26% (0.4361 => 0.5070, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.13% (4.4195 => 5.1322, std.dev.: 0.0032) MultiSource/Applications/d/make_dparser: 16.12% (1.0781 => 1.2519, std.dev.: 0.0089) MultiSource/Applications/hexxagon/hexxagon: 16.06% (0.9909 => 1.1500, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.03% (0.2738 => 0.3177, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.03% (0.3930 => 0.4560, std.dev.: 0.0020) SingleSource/Regression/C++/ofstream_ctor: 16.01% (0.3004 => 0.3485, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: 16.00% (0.2725 => 0.3161, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 15.99% (0.2714 => 0.3148, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 15.96% (0.2750 => 0.3189, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.94% (0.2729 => 0.3164, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.89% (2.7292 => 3.1630, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: 15.81% (0.1284 => 0.1487, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 15.72% (0.2780 => 0.3217, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 15.69% (0.2823 => 0.3266, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.69% (0.2792 => 0.3230, std.dev.: 0.0043) MultiSource/Applications/ClamAV/clamscan: 15.69% (4.2109 => 4.8714, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.66% (0.2911 => 0.3367, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 15.66% (0.2803 => 0.3242, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 15.64% (0.2813 => 0.3253, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 15.62% (0.2811 => 0.3250, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.56% (1.9694 => 2.2759, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wc: 15.54% (0.3096 => 0.3577, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.50% (0.1090 => 0.1259, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.40% (0.3195 => 0.3687, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.35% (1.9966 => 2.3031, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.31% (2.0673 => 2.3839, std.dev.: 0.0093) MultiSource/Benchmarks/Bullet/bullet: 15.13% (23.5202 => 27.0781, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/ary3: 15.12% (0.3267 => 0.3761, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.08% (0.3362 => 0.3869, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 15.01% (0.3258 => 0.3747, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 14.89% (0.3317 => 0.3811, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 14.89% (0.2075 => 0.2384, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 14.82% (0.3678 => 0.4223, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 14.65% (0.2566 => 0.2942, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.64% (0.3060 => 0.3508, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.44% (0.3124 => 0.3575, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.35% (0.3282 => 0.3753, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 14.31% (0.3348 => 0.3827, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 14.25% (1.4269 => 1.6303, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sieve: 14.25% (0.3726 => 0.4257, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/lists1: 14.09% (0.3477 => 0.3967, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.07% (0.3625 => 0.4135, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 14.06% (0.4146 => 0.4729, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.99% (0.3845 => 0.4383, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.85% (0.3690 => 0.4201, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 13.84% (0.7875 => 0.8965, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.82% (0.3981 => 0.4531, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 13.76% (0.4251 => 0.4836, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.64% (0.3496 => 0.3973, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.52% (0.3446 => 0.3912, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.51% (0.3465 => 0.3933, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.47% (0.3488 => 0.3958, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 13.41% (0.3460 => 0.3924, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 13.41% (2.1653 => 2.4556, std.dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 13.40% (4.6177 => 5.2367, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/synchronized: 13.40% (0.3469 => 0.3934, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.39% (0.3442 => 0.3903, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 13.32% (0.0758 => 0.0859, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 13.23% (0.3650 => 0.4133, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 13.17% (2.1013 => 2.3781, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/bigfib: 13.11% (0.5012 => 0.5669, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 13.02% (0.3724 => 0.4209, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 13.01% (0.3643 => 0.4117, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.87% (0.1383 => 0.1561, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.79% (0.2040 => 0.2301, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 12.63% (0.2691 => 0.3031, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 12.19% (5.5417 => 6.2174, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.98% (0.6435 => 0.7206, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.96% (0.1028 => 0.1151, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 11.55% (0.3498 => 0.3902, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.47% (0.2737 => 0.3051, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.41% (0.3084 => 0.3436, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 11.38% (0.6634 => 0.7389, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.12% (0.2068 => 0.2298, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 11.04% (0.4847 => 0.5382, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 10.61% (0.3336 => 0.3690, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.37% (0.2103 => 0.2321, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 10.07% (2.0346 => 2.2394, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 10.04% (0.2391 => 0.2631, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.45% (4.6926 => 5.1361, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.35% (0.5361 => 0.5862, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.28% (11.6398 => 12.7201, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.69% (0.5584 => 0.6069, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.59% (0.7426 => 0.8064, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 7.54% (11.9555 => 12.8566, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.14% (0.3792 => 0.3949, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 9.49% (0.2802 => 0.3068, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6104, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.55% (0.3693 => 0.3898, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6776, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-2: 4.73% (1.8057 => 1.8911, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1694, std.dev.: 0.0194) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6418, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2016, std.dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.66% (3.1722 => 3.2248, std.dev.: 0.0027) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3054, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2857, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5882, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.31% (2.4764 => 2.3944, std.dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.77% (25.4195 => 16.5799, std.dev.: 0.0082) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9769, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7967, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -6.74% (0.2402 => 0.2240, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8058, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0064) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -2.64% (17.2379 => 16.7823, std.dev.: 0.0497) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8623, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5764, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4962, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1539, std.dev.: 0.1116) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.03% (16.2163 => 16.0498, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 07:59:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 09:59:50 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121123155950.AAEB72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6173?compare_to=6169&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6173, Order: 168512, Start Time: 2012-11-23 13:41:01, End Time: 2012-11-23 16:00:17 To: 6169, Order: 168507, Start Time: 2012-11-23 10:30:22, End Time: 2012-11-23 12:50:04 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 63 (162 on baseline) Performance Improvements: 8 (40 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1015 (683 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/objects/objects: 17.62% (0.1152 => 0.1355, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 16.65% (0.1399 => 0.1632, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.33% (0.1644 => 0.1896, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 14.41% (0.6677 => 0.7639, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 14.35% (0.6614 => 0.7563, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 14.07% (0.6875 => 0.7842, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 13.84% (0.5904 => 0.6721, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 13.50% (1.7916 => 2.0335, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 13.36% (0.5845 => 0.6626, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.30% (0.6156 => 0.6975, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 12.96% (0.6279 => 0.7093, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 11.68% (0.2971 => 0.3318, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 11.61% (0.5891 => 0.6575, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.23% (1.0323 => 1.1482, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/lists: 10.69% (0.3808 => 0.4215, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.47% (1.7444 => 1.9270, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.13% (0.6861 => 0.7556, std.dev.: 0.0252) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.11% (0.3394 => 0.3737, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.28% (0.1164 => 0.1272, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 9.12% (0.4486 => 0.4895, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 9.00% (0.1489 => 0.1623, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.81% (0.1532 => 0.1667, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.73% (0.6413 => 0.6973, std.dev.: 0.0150) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.70% (0.1173 => 0.1275, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.50% (0.3200 => 0.3472, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.05% (1.1362 => 1.2277, std.dev.: 0.0112) MultiSource/Benchmarks/Olden/em3d/em3d: 7.99% (0.1964 => 0.2121, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.84% (0.7273 => 0.7843, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.82% (0.4272 => 0.4606, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.55% (0.8226 => 0.8847, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.45% (0.9555 => 1.0267, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.38% (2.3275 => 2.4993, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 7.30% (0.6591 => 0.7072, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/objinst: 6.78% (0.3361 => 0.3589, std.dev.: 0.0081) MultiSource/Applications/minisat/minisat: 6.29% (0.8236 => 0.8754, std.dev.: 0.0179) SingleSource/UnitTests/ObjC++/property-reference-object: 6.13% (0.6623 => 0.7029, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.68% (0.4191 => 0.4429, std.dev.: 0.0084) MultiSource/Applications/siod/siod: 5.44% (2.8007 => 2.9530, std.dev.: 0.0365) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.24% (0.9085 => 0.9561, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.80% (0.6441 => 0.6750, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 4.77% (10.8286 => 11.3452, std.dev.: 0.0687) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.42% (0.7831 => 0.8177, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 4.06% (20.8730 => 21.7198, std.dev.: 0.2053) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.99% (0.3081 => 0.3204, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.79% (11.1806 => 11.6048, std.dev.: 0.0199) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.69% (11.9888 => 12.4312, std.dev.: 0.0986) MultiSource/Applications/kimwitu++/kc: 2.43% (21.2880 => 21.8061, std.dev.: 0.1158) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 15.59% (25.0998 => 29.0121, std.dev.: 0.0323) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.27% (0.0841 => 0.0961, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.80% (9.0316 => 10.0976, std.dev.: 0.0145) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.48% (15.7882 => 17.2850, std.dev.: 0.4403) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.25% (6.0281 => 6.5253, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.03% (4.3299 => 4.5044, std.dev.: 0.0144) MultiSource/Applications/SPASS/SPASS: 3.94% (14.0671 => 14.6208, std.dev.: 0.0552) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.75% (0.3145 => 0.3263, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.00% (0.3337 => 0.3437, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 2.99% (1.2089 => 1.2450, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.42% (4.2340 => 4.3364, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.81% (7.2765 => 7.4083, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.70% (5.3820 => 5.4733, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.38% (2.1812 => 2.2112, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.21% (5.0979 => 5.1597, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.02% (5.6639 => 5.7214, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/wc: -11.59% (0.3762 => 0.3326, std.dev.: 0.0167) SingleSource/Benchmarks/CoyoteBench/lpbench: -10.17% (0.1150 => 0.1033, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.64% (0.6511 => 0.6144, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -3.29% (11.6253 => 11.2432, std.dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/lpbench: -17.47% (12.8399 => 10.5968, std.dev.: 0.6938) SingleSource/Benchmarks/Shootout/strcat: -6.75% (0.2074 => 0.1934, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.62% (9.0293 => 8.4316, std.dev.: 0.0193) SingleSource/Benchmarks/Dhrystone/fldry: -2.82% (2.0016 => 1.9451, std.dev.: 0.0170) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.55% (69.6156 => 69.9953, std.dev.: 0.0478) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.22% (0.1363 => 0.1366, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0420 => 0.0421, std.dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.46% (0.0650 => 0.0679, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -0.03% (494.0724 => 493.9346, std.dev.: 0.1102) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 10.68% (63.2438 => 69.9953, std.dev.: 0.0478) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0421, std.dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43700.18% (1.1277 => 493.9346, std.dev.: 0.1102) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 231.90% (0.5229 => 1.7355, std.dev.: 0.0166) MultiSource/Applications/SPASS/SPASS: 21.68% (14.9895 => 18.2390, std.dev.: 0.1856) MultiSource/Applications/kimwitu++/kc: 54.05% (14.1553 => 21.8061, std.dev.: 0.1158) MultiSource/Benchmarks/MallocBench/gs/gs: 15.89% (4.1105 => 4.7636, std.dev.: 0.2109) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.75% (1.1048 => 1.5108, std.dev.: 0.0371) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.22% (7.1582 => 37.5248, std.dev.: 0.0409) SingleSource/Benchmarks/Misc-C++-EH/spirit: 80.97% (3.4629 => 6.2667, std.dev.: 0.3256) SingleSource/Benchmarks/Misc-C++/stepanov_container: 84.54% (0.6222 => 1.1482, std.dev.: 0.0158) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10627.08% (0.0720 => 7.7235, std.dev.: 0.2446) MultiSource/Applications/SIBsim4/SIBsim4: 3928200.00% (0.0001 => 3.9283, std.dev.: 0.0095) MultiSource/Applications/SPASS/SPASS: 14620700.00% (0.0001 => 14.6208, std.dev.: 0.0552) MultiSource/Applications/kimwitu++/kc: 52100.00% (0.0001 => 0.0522, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576300.00% (0.0001 => 0.5764, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10077400.00% (0.0001 => 10.0775, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6309100.00% (0.0001 => 6.3092, std.dev.: 0.5439) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1840.31% (1.1194 => 21.7198, std.dev.: 0.2053) MultiSource/Applications/ClamAV/clamscan: 65.93% (22.1758 => 36.7956, std.dev.: 0.8496) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 64.51% (7.0540 => 11.6048, std.dev.: 0.0199) MultiSource/Benchmarks/FreeBench/distray/distray: 58.33% (0.1056 => 0.1672, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.52% (2.9384 => 4.5992, std.dev.: 0.1381) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 52.79% (8.1363 => 12.4312, std.dev.: 0.0986) MultiSource/Applications/JM/lencod/lencod: 47.75% (21.9371 => 32.4119, std.dev.: 0.0421) SingleSource/Benchmarks/Misc/flops: 37.92% (0.1432 => 0.1975, std.dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/almabench: 37.81% (0.0730 => 0.1006, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.04% (0.1236 => 0.1632, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/tsp/tsp: 30.30% (0.1175 => 0.1531, std.dev.: 0.0011) SingleSource/UnitTests/vla: 29.30% (0.0355 => 0.0459, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bisort/bisort: 28.83% (0.0614 => 0.0791, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 28.72% (0.0672 => 0.0865, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 28.59% (0.2700 => 0.3472, std.dev.: 0.0056) MultiSource/Applications/siod/siod: 28.56% (2.2969 => 2.9530, std.dev.: 0.0365) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.22% (1.5859 => 2.0335, std.dev.: 0.0174) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.91% (0.1125 => 0.1439, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 27.60% (0.0442 => 0.0564, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/family/family: 27.46% (0.0397 => 0.0506, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/treeadd/treeadd: 27.40% (0.0416 => 0.0530, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 27.03% (0.4103 => 0.5212, std.dev.: 0.0203) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 27.00% (0.0437 => 0.0555, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 26.74% (0.1268 => 0.1607, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 26.52% (0.0528 => 0.0668, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 26.48% (0.0491 => 0.0621, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/mst/mst: 26.40% (0.1163 => 0.1470, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 26.34% (0.0953 => 0.1204, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 26.19% (0.3650 => 0.4606, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C++/life/life: 25.94% (0.0933 => 0.1175, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 25.72% (0.9765 => 1.2277, std.dev.: 0.0112) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 25.68% (0.4615 => 0.5800, std.dev.: 0.0079) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.64% (0.8172 => 1.0267, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/perimeter/perimeter: 25.58% (0.0770 => 0.0967, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 25.57% (0.3121 => 0.3919, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 25.28% (0.0443 => 0.0555, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 25.13% (0.1695 => 0.2121, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 25.06% (0.2107 => 0.2635, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 25.01% (1.5415 => 1.9270, std.dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/dry: 25.00% (0.0456 => 0.0570, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 24.76% (0.0719 => 0.0897, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.68% (0.1337 => 0.1667, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 23.81% (0.3162 => 0.3915, std.dev.: 0.0084) SingleSource/Benchmarks/Stanford/Towers: 23.78% (0.0471 => 0.0583, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.59% (0.0746 => 0.0922, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.55% (0.1032 => 0.1275, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.52% (0.1029 => 0.1271, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.34% (0.2271 => 0.2801, std.dev.: 0.0095) SingleSource/Benchmarks/McGill/chomp: 23.20% (0.1655 => 0.2039, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/lists: 23.17% (0.3422 => 0.4215, std.dev.: 0.0092) SingleSource/Benchmarks/Stanford/Oscar: 23.11% (0.0636 => 0.0783, std.dev.: 0.0050) SingleSource/Benchmarks/McGill/exptree: 23.10% (0.0814 => 0.1002, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 23.09% (0.2603 => 0.3204, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 23.04% (0.7115 => 0.8754, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C++/city/city: 23.01% (2.0665 => 2.5420, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.54% (0.0457 => 0.0560, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 22.25% (0.2714 => 0.3318, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/08-main/main: 22.12% (0.2554 => 0.3119, std.dev.: 0.0198) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.84% (0.1044 => 0.1272, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 21.63% (0.1114 => 0.1355, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_isamax: 21.59% (0.0704 => 0.0856, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: 21.45% (0.0592 => 0.0719, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.39% (0.1566 => 0.1901, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/neural/neural: 21.05% (0.1463 => 0.1771, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 20.92% (0.4048 => 0.4895, std.dev.: 0.0091) SingleSource/Benchmarks/Dhrystone/fldry: 20.79% (0.0481 => 0.0581, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 20.43% (2.0273 => 2.4415, std.dev.: 0.0687) MultiSource/Benchmarks/VersaBench/bmm/bmm: 20.42% (0.0759 => 0.0914, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.35% (0.5105 => 0.6144, std.dev.: 0.0172) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.14% (0.1584 => 0.1903, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.67% (0.0793 => 0.0949, std.dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: 19.62% (9.4845 => 11.3452, std.dev.: 0.0687) MultiSource/Benchmarks/Prolangs-C++/office/office: 19.16% (0.3136 => 0.3737, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 18.85% (0.2430 => 0.2888, std.dev.: 0.0090) SingleSource/Benchmarks/McGill/misr: 18.80% (0.0633 => 0.0752, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.73% (14.3668 => 17.0575, std.dev.: 0.0071) MultiSource/Applications/oggenc/oggenc: 18.39% (5.7591 => 6.8181, std.dev.: 0.2359) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 18.17% (0.0798 => 0.0943, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 18.02% (0.8101 => 0.9561, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/methcall: 17.24% (0.2877 => 0.3373, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 16.95% (0.0838 => 0.0980, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 16.68% (0.1625 => 0.1896, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 16.57% (0.6030 => 0.7029, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/random: 16.52% (0.2802 => 0.3265, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.90% (1.1861 => 1.3747, std.dev.: 0.0332) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.90% (0.0648 => 0.0751, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 15.77% (0.0818 => 0.0947, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.76% (0.3826 => 0.4429, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.69% (0.0886 => 0.1025, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.59% (0.2065 => 0.2387, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.49% (0.1117 => 0.1290, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 15.32% (0.5860 => 0.6758, std.dev.: 0.0290) MultiSource/Applications/viterbi/viterbi: 14.98% (0.1555 => 0.1788, std.dev.: 0.0074) SingleSource/UnitTests/ObjC++/property-reference: 14.95% (0.7326 => 0.8421, std.dev.: 0.0191) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.94% (0.0770 => 0.0885, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 14.63% (0.3131 => 0.3589, std.dev.: 0.0081) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.51% (0.0834 => 0.0955, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/nestedloop: 14.18% (0.2793 => 0.3189, std.dev.: 0.0102) MultiSource/Applications/lua/lua: 14.05% (3.8723 => 4.4162, std.dev.: 0.1671) MultiSource/Applications/sqlite3/sqlite3: 13.97% (17.1811 => 19.5814, std.dev.: 0.5922) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.88% (0.5981 => 0.6811, std.dev.: 0.0256) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.86% (5.0018 => 5.6950, std.dev.: 0.2015) MultiSource/Applications/sgefa/sgefa: 13.83% (0.3109 => 0.3539, std.dev.: 0.0162) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.75% (0.1062 => 0.1208, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.66% (0.5569 => 0.6330, std.dev.: 0.0149) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.49% (2.2022 => 2.4993, std.dev.: 0.0138) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 13.38% (0.3177 => 0.3602, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/trivial-interface: 13.01% (0.3473 => 0.3925, std.dev.: 0.0145) SingleSource/UnitTests/ObjC/exceptions-3: 12.83% (0.3516 => 0.3967, std.dev.: 0.0144) SingleSource/UnitTests/ObjC/synchronized: 12.78% (0.3561 => 0.4016, std.dev.: 0.0161) SingleSource/UnitTests/ObjC/exceptions-4: 12.59% (0.3543 => 0.3989, std.dev.: 0.0172) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.42% (0.3543 => 0.3983, std.dev.: 0.0156) SingleSource/Benchmarks/Misc-C++/Large/ray: 12.33% (0.4064 => 0.4565, std.dev.: 0.0193) MultiSource/Benchmarks/nbench/nbench: 12.09% (1.1840 => 1.3271, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/power/power: 11.81% (0.1440 => 0.1610, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.64% (4.9449 => 5.5207, std.dev.: 0.1472) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.49% (0.1906 => 0.2125, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.19% (0.0929 => 0.1033, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.87% (0.6450 => 0.7151, std.dev.: 0.0223) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.31% (0.1892 => 0.2087, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.04% (0.4879 => 0.5369, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.04% (1.4186 => 1.5610, std.dev.: 0.0402) MultiSource/Benchmarks/PAQ8p/paq8p: 8.45% (10.3673 => 11.2432, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.59% (0.3427 => 0.3687, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.37% (7.9617 => 8.4692, std.dev.: 0.1256) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.22% (4.3953 => 10.9981, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/methcall: 147.48% (5.3999 => 13.3639, std.dev.: 0.0113) MultiSource/Benchmarks/VersaBench/dbms/dbms: 32.48% (1.5086 => 1.9986, std.dev.: 0.0398) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 28.62% (13.4384 => 17.2850, std.dev.: 0.4403) MultiSource/Benchmarks/Olden/bisort/bisort: 20.28% (0.8333 => 1.0023, std.dev.: 0.0331) SingleSource/Benchmarks/Misc/oourafft: 17.43% (6.6465 => 7.8053, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/health/health: 17.41% (0.4445 => 0.5219, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.29% (1.1145 => 1.3072, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.75% (0.2944 => 0.3437, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 16.33% (8.6802 => 10.0976, std.dev.: 0.0145) MultiSource/Benchmarks/Olden/tsp/tsp: 15.44% (1.0785 => 1.2450, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/mst/mst: 14.86% (0.1285 => 0.1476, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.60% (2.8904 => 3.2257, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 10.20% (1.1396 => 1.2558, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.31% (1.7254 => 1.8861, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/ffbench: 8.51% (0.9505 => 1.0314, std.dev.: 0.0154) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.29% (0.3070 => 0.3263, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.94% (0.9540 => 1.0107, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: 5.85% (4.9088 => 5.1958, std.dev.: 0.1082) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.84% (4.2280 => 4.4749, std.dev.: 0.0067) SingleSource/Regression/C/uint64_to_float: 5.08% (0.5413 => 0.5688, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.97% (26.0924 => 27.3885, std.dev.: 0.1694) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.20% (11.6436 => 12.1329, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/em3d/em3d: 3.62% (3.1023 => 3.2147, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.21% (2.1424 => 2.2112, std.dev.: 0.0104) MultiSource/Benchmarks/PAQ8p/paq8p: 2.43% (85.0658 => 87.1288, std.dev.: 0.0161) SingleSource/Benchmarks/Dhrystone/dry: 2.34% (2.4116 => 2.4680, std.dev.: 0.0114) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.13% (1.3677 => 1.3968, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 2.05% (3.1595 => 3.2242, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 1.72% (27.8444 => 28.3232, std.dev.: 0.0075) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.39% (6.5088 => 6.5991, std.dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.27% (1.0313 => 1.0444, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0505, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.05% (5.2139 => 5.2688, std.dev.: 0.0132) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.32% (6.6874 => 0.1791, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -75.69% (0.8651 => 0.2103, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.04% (5.2763 => 1.3168, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: -40.69% (0.1622 => 0.0962, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -10.09% (1.7609 => 1.5832, std.dev.: 0.0442) MultiSource/Applications/JM/ldecod/ldecod: -8.18% (10.4361 => 9.5827, std.dev.: 0.3125) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.08% (5.3526 => 4.9203, std.dev.: 0.0424) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.33% (5.3855 => 4.9908, std.dev.: 0.0185) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.20% (0.0628 => 0.0363, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.23% (0.3987 => 0.2383, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.27% (4.5009 => 2.7782, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.13% (2.6546 => 2.0141, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -19.25% (0.2161 => 0.1745, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4233, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.69% (2.6778 => 2.2844, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.76% (32.5116 => 29.0121, std.dev.: 0.0323) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -10.31% (9.5636 => 8.5776, std.dev.: 0.0761) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.65% (1.5660 => 1.4305, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.33% (1.6805 => 1.5405, std.dev.: 0.0302) MultiSource/Benchmarks/FreeBench/distray/distray: -7.60% (0.1592 => 0.1471) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.2416 => 3.0212, std.dev.: 0.0311) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.03% (1.8329 => 1.7407, std.dev.: 0.0330) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.89% (0.2497 => 0.2375, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.85% (1.5835 => 1.5067, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: -4.28% (6.2999 => 6.0303, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.30% (19.9488 => 19.2907, std.dev.: 0.0772) MultiSource/Benchmarks/sim/sim: -3.09% (5.0483 => 4.8921, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.49% (0.9957 => 0.9709, std.dev.: 0.0074) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.48% (0.4808 => 0.4689, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.00% (8.1563 => 7.9934, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/salsa20: -1.48% (10.2830 => 10.1305, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.01% (0.1485 => 0.1366, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.91% (0.2116 => 0.0679, std.dev.: 0.0005) Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 08:20:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 10:20:21 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121123162021.D135C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6174?compare_to=6170&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6174, Order: 168514, Start Time: 2012-11-23 14:48:48, End Time: 2012-11-23 16:20:50 To: 6170, Order: 168512, Start Time: 2012-11-23 12:59:38, End Time: 2012-11-23 14:30:39 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 4 (48 on baseline) Performance Improvements: 6 (22 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1044 (904 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel09: 10.40% (0.0971 => 0.1072, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 16.20% (1.6239 => 1.8870, std.dev.: 0.0068) MultiSource/Benchmarks/nbench/nbench: 13.52% (19.1712 => 21.7623, std.dev.: 0.6443) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.00% (21.6171 => 22.4819, std.dev.: 0.1247) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.48% (0.8750 => 0.8533, std.dev.: 0.0083) MultiSource/Benchmarks/PAQ8p/paq8p: -1.46% (2.4620 => 2.4260, std.dev.: 0.0129) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -7.81% (7.1577 => 6.5989, std.dev.: 0.0919) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -7.12% (6.7631 => 6.2816, std.dev.: 0.0921) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.38% (46.1922 => 44.6288, std.dev.: 0.0804) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.59% (1.6046 => 1.5791, std.dev.: 0.0043) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.41% (1.0613 => 1.0463, std.dev.: 0.1075) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 7.33% (0.0191 => 0.0205, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -17.29% (0.0428 => 0.0354, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 25.09% (0.0267 => 0.0334, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.96% (0.0314 => 0.0311, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.63% (0.0429 => 0.0422, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 23.49% (0.0166 => 0.0205, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 54.07% (0.0135 => 0.0208, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.27% (0.1475 => 0.1479, std.dev.: 0.0251) MultiSource/Applications/lemon/lemon: -2.51% (1.1751 => 1.1456, std.dev.: 0.3991) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.45% (0.4208 => 0.4147, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.57% (0.1401 => 0.1409, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.16% (0.0637 => 0.0636, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.96% (0.0261 => 0.0235, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.09% (0.0582 => 0.0564, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.57% (1.1863 => 1.1931, std.dev.: 0.2617) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -95.00% (0.0020 => 0.0001, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -75.00% (0.0004 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.55% (0.0550 => 0.0553, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.22% (0.0194 => 0.0208, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.01% (0.7808 => 0.7809, std.dev.: 0.0139) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 158.14% (0.0043 => 0.0111, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.52% (16.4461 => 17.6824, std.dev.: 1.4780) MultiSource/Applications/sqlite3/sqlite3: 2325.35% (0.6332 => 15.3573, std.dev.: 0.8785) MultiSource/Benchmarks/McCat/08-main/main: 49.37% (0.1831 => 0.2735, std.dev.: 0.0945) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.11% (0.1559 => 0.1495, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7059.62% (0.3123 => 22.3595, std.dev.: 0.2060) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.40% (0.2463 => 0.3729, std.dev.: 0.0271) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1525.42% (0.3344 => 5.4354, std.dev.: 0.1350) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.99% (0.2364 => 0.3262, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 4.44% (0.6010 => 0.6277, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/mandel: 1.40% (0.0429 => 0.0435, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.84% (0.3266 => 0.3424, std.dev.: 0.0308) SingleSource/Benchmarks/Shootout-C++/strcat: 4.82% (0.1969 => 0.2064, std.dev.: 0.0076) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -16.96% (0.0224 => 0.0186, std.dev.: 0.0023) SingleSource/UnitTests/byval-alignment: -31.30% (0.0230 => 0.0158, std.dev.: 0.0009) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0518, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 9.99% (0.1462 => 0.1608, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4515, std.dev.: 0.0817) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0699, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4945, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5120, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5515, std.dev.: 0.2731) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3096, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1199, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3627, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3996, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0851, std.dev.: 0.0019) SingleSource/Regression/C/uint64_to_float: -24.08% (2.1832 => 1.6575, std.dev.: 0.0195) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.00% (0.2279 => 0.2507, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.73% (0.1157 => 0.1258, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 6.66% (1.2222 => 1.3036, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.70% (0.2998 => 0.3169, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.77% (1.1606 => 1.2160, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.90% (1.6386 => 1.7025, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.79% (0.3115 => 0.3233, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.58% (2.1401 => 2.2168, std.dev.: 0.0178) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.57% (0.8340 => 0.8638, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.54% (4.5702 => 4.7320, std.dev.: 0.0411) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.17% (1.5315 => 1.5801, std.dev.: 0.0101) MultiSource/Applications/SIBsim4/SIBsim4: 2.71% (1.2568 => 1.2908, std.dev.: 0.0122) MultiSource/Benchmarks/Bullet/bullet: 2.69% (31.8598 => 32.7181, std.dev.: 0.1589) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.43% (0.5191 => 0.5317, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.31% (0.8286 => 0.8477, std.dev.: 0.0060) MultiSource/Benchmarks/PAQ8p/paq8p: 2.09% (2.3764 => 2.4260, std.dev.: 0.0129) MultiSource/Benchmarks/mafft/pairlocalalign: 2.00% (8.6247 => 8.7968, std.dev.: 0.0133) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 106.53% (0.0199 => 0.0411, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/pi: 57.90% (1.5795 => 2.4941, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.33% (2.9753 => 3.4613, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.52% (0.7597 => 0.8776, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.42% (2.7995 => 3.2031, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6088, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.60% (0.3186 => 0.3460, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.73% (1.1857 => 1.2774, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/queens: 7.41% (1.7056 => 1.8320, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.73% (4.7794 => 5.1012, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/richards_benchmark: 6.57% (1.3037 => 1.3894, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.86% (4.9686 => 5.2599, std.dev.: 0.0666) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.80% (4.5327 => 4.7956, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.65% (3.3761 => 3.5331, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.51% (6.2275 => 6.5083, std.dev.: 0.0097) MultiSource/Applications/lambda-0_1_3/lambda: 4.33% (7.4933 => 7.8180, std.dev.: 0.0623) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.14% (4.9453 => 5.1501, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.11% (4.9469 => 5.1503, std.dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 3.87% (14.0064 => 14.5489, std.dev.: 0.0736) MultiSource/Applications/siod/siod: 3.24% (3.6643 => 3.7830, std.dev.: 0.0345) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.92% (11.5690 => 11.9066, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.81% (8.2783 => 8.5110, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.51% (2.2485 => 2.3049, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/lists: 2.39% (7.3375 => 7.5125, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.33% (4.8660 => 4.9793, std.dev.: 0.0115) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.05% (1.1365 => 1.1598, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.01% (4.8362 => 4.9333, std.dev.: 0.0096) MultiSource/Benchmarks/FreeBench/neural/neural: 1.33% (1.0841 => 1.0985, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.26% (3.5679 => 3.6129, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/ReedSolomon: 1.18% (8.5322 => 8.6331, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.10% (4.0473 => 4.0920, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.86% (5.4641 => 4.3244, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.91% (7.2130 => 6.2816, std.dev.: 0.0921) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.89% (1.0512 => 0.9367, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: -10.87% (1.1216 => 0.9997, std.dev.: 0.0362) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.36% (14.6451 => 13.2745, std.dev.: 0.1116) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.57% (0.3269 => 0.2989, std.dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: -8.54% (63.1822 => 57.7837, std.dev.: 0.0724) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.84% (4.7482 => 4.4235, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.94% (3.7148 => 3.4941, std.dev.: 0.0321) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.73% (5.4972 => 5.1823, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.15% (5.1557 => 4.8902, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.45% (4.7449 => 4.5337, std.dev.: 0.0367) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.79% (2.8773 => 2.7683, std.dev.: 0.0339) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.52% (6.0224 => 5.8107, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.22% (0.5807 => 0.5620, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.06% (28.5821 => 27.7081, std.dev.: 0.0500) MultiSource/Applications/aha/aha: -2.33% (3.3398 => 3.2620, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.01% (11.5316 => 11.2995, std.dev.: 0.0161) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.92% (3.2169 => 3.1551, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.87% (9.9065 => 9.7209, std.dev.: 0.0419) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.77% (4.9994 => 4.9107, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.11% (5.6343 => 5.5717, std.dev.: 0.0243) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.96% (1.0262 => 1.0463, std.dev.: 0.1075) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 66.67% (0.0123 => 0.0205, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -13.24% (0.0408 => 0.0354, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.50% (0.0254 => 0.0334, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.98% (0.0302 => 0.0311, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 15.56% (0.0180 => 0.0208, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.85% (0.1438 => 0.1479, std.dev.: 0.0251) MultiSource/Applications/lemon/lemon: 1.12% (1.1329 => 1.1456, std.dev.: 0.3991) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.41% (0.4164 => 0.4147, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.92% (0.1369 => 0.1409, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.78% (0.0641 => 0.0636, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 20.51% (0.0195 => 0.0235, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.42% (0.0578 => 0.0564, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.32% (1.1437 => 1.1931, std.dev.: 0.2617) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.80% (0.0627 => 0.0553, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.56% (0.0180 => 0.0208, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.59% (0.8017 => 0.7809, std.dev.: 0.0139) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 79.03% (0.0062 => 0.0111, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 08:38:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 10:38:01 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121123163801.C85CB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6175?compare_to=6171&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6175, Order: 168515, Start Time: 2012-11-23 15:04:57, End Time: 2012-11-23 16:38:28 To: 6171, Order: 168512, Start Time: 2012-11-23 13:08:28, End Time: 2012-11-23 14:42:02 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (186 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (850 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.99% (0.3845 => 0.4460, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 16.33% (0.3834 => 0.4460, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.48% (54.5751 => 56.4719, std.dev.: 0.1181) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.86% (2.0478 => 2.1063, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/salsa20: 2.53% (7.4937 => 7.6832, std.dev.: 0.0187) SingleSource/Benchmarks/Shootout-C++/hash2: 2.34% (3.1932 => 3.2679, std.dev.: 0.0081) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.27% (0.3821 => 0.3505, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.03% (0.3142 => 0.2921, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.03% (2.4924 => 2.3173, std.dev.: 0.0058) MultiSource/Applications/sgefa/sgefa: -6.91% (0.3357 => 0.3125, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.70% (0.9542 => 0.8903, std.dev.: 0.0117) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.47% (0.2428 => 0.2271, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.44% (0.1584 => 0.1482, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.39% (9.2283 => 8.6386, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.38% (0.6484 => 0.6070, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.37% (0.3658 => 0.3425, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.37% (0.2355 => 0.2205, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -6.28% (16.1920 => 15.1751, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: -6.25% (0.2160 => 0.2025, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -6.24% (7.0961 => 6.6534, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.24% (0.7198 => 0.6749, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.24% (0.1796 => 0.1684, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.23% (0.9852 => 0.9238, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -6.19% (0.1761 => 0.1652, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -6.14% (0.9179 => 0.8615, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: -6.13% (0.3831 => 0.3596, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -6.11% (0.3812 => 0.3579, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.11% (0.3848 => 0.3613, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.11% (1.3722 => 1.2884, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.08% (1.0544 => 0.9903, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.07% (4.8161 => 4.5236, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.06% (3.5339 => 3.3197, std.dev.: 0.0053) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.06% (0.1716 => 0.1612, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: -6.06% (0.4176 => 0.3923, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.01% (6.7716 => 6.3644, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.99% (1.2300 => 1.1563, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -5.98% (0.3880 => 0.3648, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -5.98% (4.3330 => 4.0741, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.96% (0.3891 => 0.3659, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.96% (1.6364 => 1.5389, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.95% (0.6736 => 0.6335, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.91% (4.0323 => 3.7940, std.dev.: 0.0099) MultiSource/Applications/lemon/lemon: -5.89% (1.1450 => 1.0776, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.88% (0.5863 => 0.5518, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: -5.88% (0.3896 => 0.3667, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.88% (0.4033 => 0.3796, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.86% (1.4642 => 1.3784, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.85% (4.8802 => 4.5946, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.85% (0.2548 => 0.2399, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.82% (0.7919 => 0.7458, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.81% (4.5069 => 4.2451, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/bh/bh: -5.80% (0.2985 => 0.2812, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.77% (0.5705 => 0.5376, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.76% (0.5591 => 0.5269, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.75% (0.2659 => 0.2506, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: -5.75% (1.1530 => 1.0867, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.74% (0.3483 => 0.3283, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.74% (0.6293 => 0.5932, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.71% (0.2695 => 0.2541, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -5.71% (0.4515 => 0.4257, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.71% (0.5478 => 0.5165, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -5.70% (0.3406 => 0.3212, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/property: -5.69% (0.4199 => 0.3960, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.69% (0.6297 => 0.5939, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -5.67% (1.2515 => 1.1805, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.67% (0.5925 => 0.5589, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.67% (0.6052 => 0.5709, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.67% (0.6230 => 0.5877, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.66% (0.3884 => 0.3664, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.65% (0.6667 => 0.6290, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.65% (0.5857 => 0.5526, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.63% (0.5805 => 0.5478, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.62% (0.2278 => 0.2150, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.62% (0.5802 => 0.5476, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.62% (1.2784 => 1.2066, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.62% (0.6446 => 0.6084, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.61% (0.8521 => 0.8043, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.60% (0.5999 => 0.5663, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.60% (0.5859 => 0.5531, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.59% (0.5849 => 0.5522, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.58% (0.5570 => 0.5259, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.57% (0.6304 => 0.5953, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.54% (0.5456 => 0.5154, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -5.53% (0.1879 => 0.1775, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: -5.53% (0.3581 => 0.3383, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.53% (0.6260 => 0.5914, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.52% (14.2083 => 13.4235, std.dev.: 0.0075) SingleSource/UnitTests/ObjC/parameter-passing: -5.51% (0.4280 => 0.4044, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -5.51% (17.1032 => 16.1611, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.51% (0.5575 => 0.5268, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.50% (0.2999 => 0.2834, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.49% (0.4916 => 0.4646, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.49% (0.6194 => 0.5854, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.48% (0.6660 => 0.6295, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: -5.48% (15.5079 => 14.6588, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.47% (0.5941 => 0.5616, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.46% (8.0126 => 7.5755, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.45% (0.5581 => 0.5277, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.41% (0.6189 => 0.5854, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.40% (1.2221 => 1.1561, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.40% (1.2210 => 1.1551, std.dev.: 0.0055) MultiSource/Applications/SIBsim4/SIBsim4: -5.39% (1.3864 => 1.3117, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.37% (0.6440 => 0.6094, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.33% (0.6681 => 0.6325, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.32% (0.6676 => 0.6321, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -5.31% (3.5154 => 3.3288, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.28% (0.2385 => 0.2259, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.27% (0.3319 => 0.3144, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -5.27% (4.0594 => 3.8455, std.dev.: 0.0132) MultiSource/Applications/siod/siod: -5.24% (2.4021 => 2.2763, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: -5.24% (0.7447 => 0.7057, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.19% (0.5168 => 0.4900, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.17% (0.6033 => 0.5721, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.17% (0.5688 => 0.5394, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.14% (0.4321 => 0.4099, std.dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: -5.13% (15.2527 => 14.4695, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.12% (1.6474 => 1.5630, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.11% (0.4151 => 0.3939, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.10% (0.3057 => 0.2901, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -5.06% (1.3148 => 1.2483, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.06% (0.3323 => 0.3155, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.04% (22.4056 => 21.2756, std.dev.: 0.0191) MultiSource/Applications/treecc/treecc: -5.01% (2.1401 => 2.0329, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.00% (0.2001 => 0.1901, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.98% (0.2933 => 0.2787, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -4.97% (0.7982 => 0.7585, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.97% (0.7339 => 0.6974, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -4.97% (0.2939 => 0.2793, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.96% (0.3931 => 0.3736, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.95% (0.3837 => 0.3647, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: -4.95% (0.2871 => 0.2729, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -4.92% (0.3026 => 0.2877, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.90% (0.5329 => 0.5068, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.89% (0.2903 => 0.2761, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -4.89% (0.3271 => 0.3111, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.89% (0.7021 => 0.6678, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.88% (0.6395 => 0.6083, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.87% (0.3016 => 0.2869, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -4.87% (0.4248 => 0.4041, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: -4.87% (0.3205 => 0.3049, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -4.84% (0.2849 => 0.2711, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.83% (0.3252 => 0.3095, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -4.82% (0.3446 => 0.3280, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.81% (0.7524 => 0.7162, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.80% (0.4813 => 0.4582, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.80% (0.2106 => 0.2005, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: -4.79% (0.3025 => 0.2880, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.79% (2.1713 => 2.0673, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: -4.78% (5.0226 => 4.7826, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: -4.76% (0.3255 => 0.3100, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -4.75% (0.8418 => 0.8018, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.75% (0.4083 => 0.3889, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: -4.75% (0.2989 => 0.2847, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: -4.73% (0.4861 => 0.4631, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -4.73% (0.3194 => 0.3043, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -4.71% (0.3481 => 0.3317, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.70% (0.9077 => 0.8650, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.70% (0.3849 => 0.3668, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.65% (0.5567 => 0.5308, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -4.65% (18.2933 => 17.4430, std.dev.: 0.0167) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.65% (0.9557 => 0.9113, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.61% (0.5569 => 0.5312, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.58% (0.6395 => 0.6102, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: -4.54% (0.3394 => 0.3240, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists: -4.53% (0.3621 => 0.3457, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: -4.50% (0.3867 => 0.3693, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.48% (0.3059 => 0.2922, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -4.45% (34.0927 => 32.5753, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.44% (2.2587 => 2.1585, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.39% (0.2277 => 0.2177, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -4.27% (0.6750 => 0.6462, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.25% (0.6347 => 0.6077, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.21% (0.3491 => 0.3344, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.18% (0.4427 => 0.4242, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.15% (0.6441 => 0.6174, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -4.14% (0.3788 => 0.3631, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: -4.00% (0.7779 => 0.7468, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -3.85% (1.5610 => 1.5009, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: -3.71% (0.4524 => 0.4356, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.66% (5.4682 => 5.2678, std.dev.: 0.0026) SingleSource/UnitTests/Vector/constpool: -2.65% (20.7746 => 20.2231, std.dev.: 0.0524) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7547, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: -8.66% (1.2842 => 1.1730, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -4.17% (2.2633 => 2.1689, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.15% (1.3096 => 1.2684, std.dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.14% (1.0557 => 1.0225, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.61% (6.5735 => 6.4674, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 10:12:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 12:12:42 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121123181242.D55932A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6176?compare_to=6174&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6176, Order: 168516, Start Time: 2012-11-23 16:38:11, End Time: 2012-11-23 18:13:10 To: 6174, Order: 168514, Start Time: 2012-11-23 14:48:48, End Time: 2012-11-23 16:20:50 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 12 (61 on baseline) Performance Improvements: 1 (23 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1041 (890 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/McGill/chomp: 8.02% (0.1558 => 0.1683, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.88% (0.8347 => 0.9005, std.dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.36% (0.6715 => 0.7008, std.dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: 32.67% (4.5198 => 5.9962, std.dev.: 0.0776) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.29% (3.0593 => 3.5884, std.dev.: 0.1625) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.65% (3.7753 => 4.1017, std.dev.: 0.0590) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.75% (41.3287 => 43.7060, std.dev.: 0.6409) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.32% (60.0669 => 63.2635, std.dev.: 0.8149) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.01% (1.3235 => 1.3898, std.dev.: 0.0110) SingleSource/Benchmarks/McGill/chomp: 3.92% (0.9997 => 1.0389, std.dev.: 0.0120) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.79% (2.3049 => 2.3923, std.dev.: 0.0282) MultiSource/Applications/sqlite3/sqlite3: 1.52% (4.4515 => 4.5192, std.dev.: 0.0143) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -10.06% (21.7623 => 19.5734, std.dev.: 0.5742) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.50% (1.0463 => 1.0829, std.dev.: 0.2193) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 7.80% (0.0205 => 0.0221, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.37% (0.0354 => 0.0373, std.dev.: 0.0224) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0334 => 0.0334, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -10.61% (0.0311 => 0.0278, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.95% (0.0422 => 0.0418, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0205 => 0.0204, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 5.29% (0.0208 => 0.0219, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -30.77% (0.0013 => 0.0009, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.20% (0.1479 => 0.1482, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: 4.15% (1.1456 => 1.1931, std.dev.: 0.2177) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.84% (0.4147 => 0.4182, std.dev.: 0.0704) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.99% (0.1409 => 0.1423, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.89% (0.0636 => 0.0648, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 15.32% (0.0235 => 0.0271, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.08% (0.0564 => 0.0587, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.34% (1.1931 => 1.1972, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 700.00% (0.0001 => 0.0008, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 700.00% (0.0001 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 14.65% (0.0553 => 0.0634, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.56% (0.0208 => 0.0257, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.87% (0.7809 => 0.7877, std.dev.: 0.0327) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -33.33% (0.0111 => 0.0074, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.21% (16.4461 => 17.7958, std.dev.: 0.7789) MultiSource/Applications/sqlite3/sqlite3: 2357.08% (0.6332 => 15.5582, std.dev.: 0.4213) MultiSource/Benchmarks/McCat/08-main/main: 50.79% (0.1831 => 0.2761, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.44% (0.1559 => 0.1443, std.dev.: 0.0059) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7078.35% (0.3123 => 22.4180, std.dev.: 0.6560) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.81% (0.2463 => 0.3739, std.dev.: 0.0141) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1602.06% (0.3344 => 5.6917, std.dev.: 0.3430) SingleSource/Benchmarks/Misc-C++/Large/ray: 45.35% (0.2364 => 0.3436, std.dev.: 0.0236) SingleSource/Benchmarks/Misc-C++/bigfib: 6.67% (0.6010 => 0.6411, std.dev.: 0.1212) SingleSource/Benchmarks/Misc/mandel: 6.99% (0.0429 => 0.0459, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.49% (0.3266 => 0.3478, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/strcat: 5.03% (0.1969 => 0.2068, std.dev.: 0.0094) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.59% (0.0224 => 0.0241, std.dev.: 0.0037) SingleSource/UnitTests/byval-alignment: -42.17% (0.0230 => 0.0133, std.dev.: 0.0023) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0483, std.dev.: 0.0066) MultiSource/Applications/oggenc/oggenc: 6.77% (0.1462 => 0.1561, std.dev.: 0.0260) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.5192, std.dev.: 0.0143) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0700, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4957, std.dev.: 0.0168) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5038, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5984, std.dev.: 0.4000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3626, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1497, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3660, std.dev.: 0.0385) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4138, std.dev.: 0.0238) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0874, std.dev.: 0.0104) SingleSource/Regression/C/uint64_to_float: -23.47% (2.1832 => 1.6708, std.dev.: 0.0024) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/shr: 61.26% (0.0191 => 0.0308, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.40% (0.0437 => 0.0548, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.49% (0.0810 => 0.0976, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.80% (0.0848 => 0.0965, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.40% (0.1905 => 0.2065, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.22% (0.8321 => 0.9005, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.67% (0.9435 => 1.0159, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.65% (0.1425 => 0.1534, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 7.54% (0.1565 => 0.1683, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.61% (0.1983 => 0.2114, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.41% (0.6586 => 0.7008, std.dev.: 0.0064) MultiSource/Applications/Burg/burg: 6.10% (1.2222 => 1.2968, std.dev.: 0.0213) SingleSource/Benchmarks/Shootout-C++/lists1: 5.89% (0.2969 => 0.3144, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.67% (0.2998 => 0.3168, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.63% (0.6287 => 0.6641, std.dev.: 0.0119) MultiSource/Applications/SIBsim4/SIBsim4: 5.35% (1.2568 => 1.3240, std.dev.: 0.0202) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.68% (0.4127 => 0.4320, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.69% (1.4479 => 1.5013, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.99% (1.6386 => 1.6876, std.dev.: 0.0147) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.79% (6.6074 => 6.7916, std.dev.: 0.0352) MultiSource/Benchmarks/PAQ8p/paq8p: 2.60% (2.3764 => 2.4381, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.44% (0.8286 => 0.8488, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.20% (0.8420 => 0.8605, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.07% (0.8204 => 0.8374, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.97% (0.8069 => 0.8228, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 104.52% (0.0199 => 0.0407, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/pi: 55.88% (1.5795 => 2.4622, std.dev.: 0.0199) SingleSource/Benchmarks/Misc-C++/stepanov_container: 31.65% (4.5547 => 5.9962, std.dev.: 0.0776) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.73% (0.7597 => 0.8944, std.dev.: 0.0247) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.59% (3.0515 => 3.5884, std.dev.: 0.1625) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.30% (2.9753 => 3.4604, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.67% (2.7995 => 3.2103, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.49% (5.0261 => 5.6038, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.70% (0.3186 => 0.3495, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.78% (1.1857 => 1.2779, std.dev.: 0.0115) MultiSource/Applications/SIBsim4/SIBsim4: 7.16% (3.1873 => 3.4156, std.dev.: 0.0354) SingleSource/Benchmarks/McGill/queens: 7.11% (1.7056 => 1.8268, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.75% (59.2638 => 63.2635, std.dev.: 0.8149) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.73% (4.7794 => 5.1011, std.dev.: 0.0145) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.40% (2.2485 => 2.3923, std.dev.: 0.0282) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.99% (4.5327 => 4.8042, std.dev.: 0.0541) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.77% (4.9686 => 5.2555, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.51% (41.4238 => 43.7060, std.dev.: 0.6409) MultiSource/Applications/lambda-0_1_3/lambda: 4.76% (7.4933 => 7.8502, std.dev.: 0.0283) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.72% (3.3761 => 3.5356, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.67% (3.9188 => 4.1017, std.dev.: 0.0590) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.37% (6.2275 => 6.4998, std.dev.: 0.0206) MultiSource/Applications/hexxagon/hexxagon: 4.07% (14.0064 => 14.5767, std.dev.: 0.0285) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.03% (4.9453 => 5.1447, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.90% (4.9469 => 5.1398, std.dev.: 0.0171) MultiSource/Applications/siod/siod: 3.08% (3.6643 => 3.7773, std.dev.: 0.0353) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.87% (11.5690 => 11.9014, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout/lists: 2.73% (7.3375 => 7.5378, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.43% (8.2783 => 8.4796, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.32% (4.8660 => 4.9789, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.24% (1.1365 => 1.1620, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.63% (5.6030 => 5.6945, std.dev.: 0.0220) MultiSource/Benchmarks/FreeBench/neural/neural: 1.30% (1.0841 => 1.0982, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: 1.14% (1.2061 => 1.2199, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.14% (3.5679 => 3.6085, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/whetstone: 1.14% (2.1224 => 2.1465, std.dev.: 0.0075) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.87% (5.4641 => 4.3239, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.34% (7.2130 => 6.1789, std.dev.: 0.1190) MultiSource/Benchmarks/nbench/nbench: -10.89% (21.9654 => 19.5734, std.dev.: 0.5742) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.85% (1.0512 => 0.9371, std.dev.: 0.0336) MultiSource/Benchmarks/mafft/pairlocalalign: -8.48% (63.1822 => 57.8271, std.dev.: 0.2762) SingleSource/Benchmarks/McGill/chomp: -7.37% (1.1216 => 1.0389, std.dev.: 0.0120) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.22% (14.6451 => 13.5871, std.dev.: 0.1359) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.94% (4.7482 => 4.4189, std.dev.: 0.0179) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.03% (0.3269 => 0.3072, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.95% (3.7148 => 3.4937, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.89% (5.4972 => 5.1735, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.98% (5.1557 => 4.8987, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.39% (4.7449 => 4.5366, std.dev.: 0.0422) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.85% (6.0224 => 5.7903, std.dev.: 0.0290) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (28.5821 => 27.7017, std.dev.: 0.0396) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.69% (2.6356 => 2.5647, std.dev.: 0.0136) MultiSource/Benchmarks/FreeBench/mason/mason: -2.46% (0.5415 => 0.5282, std.dev.: 0.0046) MultiSource/Applications/aha/aha: -2.15% (3.3398 => 3.2680, std.dev.: 0.0236) SingleSource/Benchmarks/Shootout-C++/hash2: -2.10% (3.4237 => 3.3517, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.95% (11.5316 => 11.3062, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.59% (4.9994 => 4.9200, std.dev.: 0.0235) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.32% (2.3487 => 2.3176, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.26% (5.6343 => 5.5633, std.dev.: 0.0214) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 5.53% (1.0262 => 1.0829, std.dev.: 0.2193) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 79.67% (0.0123 => 0.0221, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -8.58% (0.0408 => 0.0373, std.dev.: 0.0224) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.50% (0.0254 => 0.0334, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -7.95% (0.0302 => 0.0278, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.85% (0.0384 => 0.0418, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 28.57% (0.0007 => 0.0009, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 3.06% (0.1438 => 0.1482, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: 5.31% (1.1329 => 1.1931, std.dev.: 0.2177) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.43% (0.4164 => 0.4182, std.dev.: 0.0704) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.94% (0.1369 => 0.1423, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.09% (0.0641 => 0.0648, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 38.97% (0.0195 => 0.0271, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.56% (0.0578 => 0.0587, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.68% (1.1437 => 1.1972, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 700.00% (0.0001 => 0.0008, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -42.86% (0.0014 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.12% (0.0627 => 0.0634, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 42.78% (0.0180 => 0.0257, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.75% (0.8017 => 0.7877, std.dev.: 0.0327) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 19.35% (0.0062 => 0.0074, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 10:34:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 12:34:35 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121123183435.62F0E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6177?compare_to=6175&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6177, Order: 168519, Start Time: 2012-11-23 17:01:29, End Time: 2012-11-23 18:35:02 To: 6175, Order: 168515, Start Time: 2012-11-23 15:04:57, End Time: 2012-11-23 16:38:28 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (182 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (854 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.17% (1.2684 => 1.2959, std.dev.: 0.0039) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 16.51% (0.3834 => 0.4467, std.dev.: 0.0138) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.03% (54.5751 => 56.2306, std.dev.: 0.1137) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1012, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/salsa20: 2.23% (7.4937 => 7.6608, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/hash2: 1.99% (3.1932 => 3.2567, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.01% (0.1431 => 0.1302, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.24% (0.3821 => 0.3506, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -7.17% (2.4924 => 2.3137, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.78% (0.3142 => 0.2929, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.76% (0.3357 => 0.3130, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.63% (0.9542 => 0.8909, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.46% (0.7198 => 0.6733, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.40% (9.2283 => 8.6381, std.dev.: 0.0129) SingleSource/UnitTests/ObjC/trivial-interface: -6.37% (0.3812 => 0.3569, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.37% (0.2355 => 0.2205, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -6.37% (0.3896 => 0.3648, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -6.34% (0.3831 => 0.3588, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.34% (0.2428 => 0.2274, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.34% (0.3848 => 0.3604, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.34% (0.3880 => 0.3634, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.32% (0.9852 => 0.9229, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -6.26% (7.0961 => 6.6519, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.21% (0.3658 => 0.3431, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: -6.20% (0.4033 => 0.3783, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.19% (0.3891 => 0.3650, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/exceptions: -6.15% (0.4176 => 0.3919, std.dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.13% (6.7716 => 6.3568, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.12% (0.1796 => 0.1686, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.12% (0.6484 => 0.6087, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -6.12% (0.9179 => 0.8617, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: -6.12% (16.1920 => 15.2011, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.11% (1.0544 => 0.9900, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/gs/gs: -6.08% (4.3330 => 4.0695, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/oourafft: -6.06% (0.2160 => 0.2029, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.06% (1.3722 => 1.2890, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.06% (0.1716 => 0.1612, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -6.02% (0.1761 => 0.1655, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.98% (3.5339 => 3.3224, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.97% (4.8161 => 4.5285, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.93% (4.0323 => 3.7930, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.93% (1.4642 => 1.3774, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/property: -5.88% (0.4199 => 0.3952, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.87% (0.7919 => 0.7454, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.85% (1.6364 => 1.5406, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.85% (0.5591 => 0.5264, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.84% (0.3884 => 0.3657, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -5.83% (0.2659 => 0.2504, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.83% (0.2695 => 0.2538, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -5.80% (0.2985 => 0.2812, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -5.79% (1.1450 => 1.0787, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.78% (0.5705 => 0.5375, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -5.78% (0.4515 => 0.4254, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: -5.75% (1.1530 => 1.0867, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: -5.75% (0.4280 => 0.4034, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.74% (0.6293 => 0.5932, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -5.73% (0.3406 => 0.3211, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.72% (1.2300 => 1.1596, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.72% (4.8802 => 4.6012, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.71% (0.5478 => 0.5165, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.70% (0.5925 => 0.5587, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.70% (0.6736 => 0.6352, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.70% (0.5863 => 0.5529, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.69% (0.2548 => 0.2403, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -5.69% (1.2515 => 1.1803, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.67% (0.6052 => 0.5709, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.65% (0.5857 => 0.5526, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.63% (0.5859 => 0.5529, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.63% (0.6446 => 0.6083, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.62% (0.5849 => 0.5520, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.62% (0.6297 => 0.5943, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.60% (0.5999 => 0.5663, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.60% (0.6304 => 0.5951, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.58% (0.5805 => 0.5481, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.58% (0.2278 => 0.2151, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: -5.57% (15.5079 => 14.6443, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.57% (0.5802 => 0.5479, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.56% (4.5069 => 4.2561, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.56% (0.5575 => 0.5265, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.55% (0.5581 => 0.5271, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.55% (0.6230 => 0.5884, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.55% (0.6667 => 0.6297, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.55% (0.5570 => 0.5261, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.55% (14.2083 => 13.4204, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.54% (0.6260 => 0.5913, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.54% (0.8521 => 0.8049, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.52% (0.6194 => 0.5852, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.51% (0.4916 => 0.4645, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.50% (0.5456 => 0.5156, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.49% (1.2784 => 1.2082, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.48% (0.3483 => 0.3292, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.45% (8.0126 => 7.5756, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.44% (0.2999 => 0.2836, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.43% (0.6440 => 0.6090, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -5.43% (0.1879 => 0.1777, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.41% (0.6189 => 0.5854, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.41% (0.6660 => 0.6300) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.39% (1.2221 => 1.1562, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.38% (0.6676 => 0.6317, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.37% (1.2210 => 1.1554, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: -5.33% (0.3581 => 0.3390, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.31% (0.6681 => 0.6326, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: -5.29% (1.3864 => 1.3131, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.27% (0.6033 => 0.5715, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -5.26% (4.0594 => 3.8458, std.dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: -5.25% (17.1032 => 16.2051, std.dev.: 0.0109) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.21% (0.3319 => 0.3146, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.21% (0.4321 => 0.4096, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.21% (0.3323 => 0.3150, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.20% (0.4151 => 0.3935, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.19% (1.6474 => 1.5619, std.dev.: 0.0191) MultiSource/Applications/hexxagon/hexxagon: -5.17% (1.3148 => 1.2468, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.17% (0.3057 => 0.2899, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: -5.14% (0.7447 => 0.7064, std.dev.: 0.0017) MultiSource/Applications/siod/siod: -5.14% (2.4021 => 2.2786, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.14% (0.3931 => 0.3729, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.14% (0.2939 => 0.2788, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.13% (0.3837 => 0.3640, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -5.13% (3.5154 => 3.3350, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/matrix: -5.13% (0.3255 => 0.3088, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: -5.12% (0.2871 => 0.2724, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.11% (0.2933 => 0.2783, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -5.09% (0.2849 => 0.2704, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.09% (0.5168 => 0.4905, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.07% (0.3016 => 0.2863, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.06% (0.2903 => 0.2756, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -5.05% (0.7982 => 0.7579, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.05% (0.5688 => 0.5401, std.dev.: 0.0043) MultiSource/Applications/ClamAV/clamscan: -5.03% (15.2527 => 14.4851, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/strcat: -5.02% (0.2989 => 0.2839, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.00% (22.4056 => 21.2858, std.dev.: 0.0200) SingleSource/Benchmarks/Shootout-C++/ary3: -4.99% (0.3446 => 0.3274, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.99% (0.2106 => 0.2001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -4.98% (0.3271 => 0.3108, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: -4.97% (2.1401 => 2.0338, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/wc: -4.96% (0.3205 => 0.3046, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -4.96% (0.3026 => 0.2876, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.94% (0.4813 => 0.4575, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.92% (0.7339 => 0.6978, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.92% (0.7524 => 0.7154, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.89% (0.6395 => 0.6082, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: -4.89% (0.3025 => 0.2877, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.87% (2.1713 => 2.0656, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary: -4.86% (0.3394 => 0.3229, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -4.85% (0.3194 => 0.3039, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -4.85% (0.4248 => 0.4042, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.79% (0.7021 => 0.6685, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.78% (0.3849 => 0.3665, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -4.77% (0.4861 => 0.4629, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -4.77% (18.2933 => 17.4209, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary2: -4.77% (0.3481 => 0.3315, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.74% (0.3252 => 0.3098, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.70% (0.4083 => 0.3891, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.70% (0.2385 => 0.2273, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: -4.69% (0.3621 => 0.3451, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.67% (0.9557 => 0.9111, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: -4.65% (0.3867 => 0.3687, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.64% (0.5329 => 0.5082, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.62% (0.5567 => 0.5310, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -4.61% (0.7779 => 0.7420, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: -4.58% (0.6347 => 0.6056, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.58% (0.6395 => 0.6102, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.56% (2.2587 => 2.1557, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.54% (0.5569 => 0.5316, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.53% (0.9077 => 0.8666, std.dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference-object: -4.52% (0.6441 => 0.6150, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -4.48% (34.0927 => 32.5659, std.dev.: 0.0289) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.45% (0.4427 => 0.4230, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -4.44% (0.8418 => 0.8044, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: -4.42% (5.0226 => 4.8005, std.dev.: 0.0041) SingleSource/Regression/C++/ofstream_ctor: -4.35% (0.3059 => 0.2926, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.27% (0.3491 => 0.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -4.17% (0.3788 => 0.3630, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -4.16% (0.6750 => 0.6469, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -3.98% (0.4524 => 0.4344, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: -3.77% (1.5610 => 1.5022, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.64% (5.4682 => 5.2690, std.dev.: 0.0128) SingleSource/UnitTests/Vector/constpool: -2.59% (20.7746 => 20.2367, std.dev.: 0.0105) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7554, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/richards_benchmark: -8.72% (1.2842 => 1.1722, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7069, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.71% (2.2633 => 2.1794, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4738, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/ary3: -1.17% (3.7241 => 3.6807, std.dev.: 0.0133) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.05% (1.3096 => 1.2959, std.dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 10:53:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 12:53:44 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121123185344.2996F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6178?compare_to=6172&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6178, Order: 168515, Start Time: 2012-11-23 15:33:12, End Time: 2012-11-23 18:54:11 To: 6172, Order: 168507, Start Time: 2012-11-23 11:23:48, End Time: 2012-11-23 14:45:05 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (171 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1092 (719 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.64% (0.0625 => 0.0879, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.80% (0.1063 => 0.1401, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.31% (0.2969 => 0.3750, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.41% (0.1106 => 0.1387, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.96% (0.4139 => 0.5172, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.86% (0.5900 => 0.7308, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 23.85% (1.5932 => 1.9731, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.79% (0.0475 => 0.0588, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.70% (0.4253 => 0.5261, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.67% (0.0714 => 0.0883, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.53% (0.4994 => 0.6169, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.33% (0.1620 => 0.1998, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.12% (0.0584 => 0.0719, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.50% (0.5000 => 0.6125, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.07% (0.0897 => 0.1095, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.74% (0.1021 => 0.1243, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 21.70% (0.0599 => 0.0729, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.33% (0.0633 => 0.0768, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.32% (0.1107 => 0.1343, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.58% (0.1103 => 0.1330, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 20.57% (0.0948 => 0.1143, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0584 => 0.0704, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.52% (0.0541 => 0.0652, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.34% (0.3903 => 0.4697, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.25% (0.0642 => 0.0772, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.08% (0.1549 => 0.1860, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: 19.98% (0.0821 => 0.0985, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.83% (0.1604 => 0.1922, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.64% (0.1003 => 0.1200, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 19.54% (0.0604 => 0.0722, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.46% (0.0822 => 0.0982, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 19.33% (0.1619 => 0.1932, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.95% (0.1462 => 0.1739, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 18.94% (0.0808 => 0.0961, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.82% (0.2736 => 0.3251, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.80% (0.0947 => 0.1125, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.51% (0.3890 => 0.4610, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.22% (0.2014 => 0.2381, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 18.04% (0.4029 => 0.4756, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 17.82% (0.1218 => 0.1435, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.81% (1.3152 => 1.5495, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/mst/mst: 17.77% (0.0698 => 0.0822, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.65% (0.1088 => 0.1280) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.48% (0.2866 => 0.3367, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 17.40% (0.5826 => 0.6840, std.dev.: 0.0086) MultiSource/Benchmarks/McCat/09-vor/vor: 17.34% (0.1505 => 0.1766, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 17.08% (0.5889 => 0.6895, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 17.06% (1.8794 => 2.2000, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 17.06% (0.5546 => 0.6492, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.92% (0.1968 => 0.2301, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 16.86% (0.0605 => 0.0707, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.85% (0.4658 => 0.5443, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.76% (1.6211 => 1.8928, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.66% (0.3271 => 0.3816, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.65% (3.5627 => 4.1558, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.64% (0.1160 => 0.1353, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.56% (0.2875 => 0.3351, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.39% (0.5026 => 0.5850, std.dev.: 0.0026) MultiSource/Applications/hbd/hbd: 16.31% (0.9697 => 1.1279, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference: 16.08% (0.7171 => 0.8324, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.05% (0.4361 => 0.5061, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 15.97% (0.1421 => 0.1648, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 15.85% (0.2725 => 0.3157, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.74% (0.2738 => 0.3169, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 15.73% (0.2714 => 0.3141, std.dev.: 0.0035) MultiSource/Applications/d/make_dparser: 15.69% (1.0781 => 1.2472, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.67% (0.3930 => 0.4546, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 15.65% (0.1284 => 0.1485, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.65% (0.2729 => 0.3156, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 15.64% (0.2750 => 0.3180, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 15.57% (0.9909 => 1.1452, std.dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 15.55% (0.3004 => 0.3471, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.54% (0.2792 => 0.3226, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 15.54% (0.2780 => 0.3212, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 15.52% (0.2803 => 0.3238, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 15.50% (0.2813 => 0.3249, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.47% (4.4195 => 5.1030, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/objinst: 15.44% (0.2823 => 0.3259, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 15.44% (0.2811 => 0.3245, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 15.42% (4.2109 => 4.8601, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.36% (2.0673 => 2.3848, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/wc: 15.31% (0.3096 => 0.3570, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.29% (0.2911 => 0.3356, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.21% (0.3195 => 0.3681, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.13% (2.7292 => 3.1421, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 15.03% (0.3267 => 0.3758, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 14.95% (0.3258 => 0.3745, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.92% (1.9966 => 2.2944, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.89% (1.9694 => 2.2626, std.dev.: 0.0052) MultiSource/Benchmarks/Bullet/bullet: 14.82% (23.5202 => 27.0058, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.77% (0.1090 => 0.1251, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 14.68% (0.3317 => 0.3804, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.52% (0.3362 => 0.3850, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.51% (0.3060 => 0.3504, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 14.41% (0.2075 => 0.2374, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 14.38% (0.2566 => 0.2935, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.25% (0.3845 => 0.4393, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 14.25% (0.3678 => 0.4202, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.24% (0.3124 => 0.3569, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 14.12% (0.3726 => 0.4252, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.08% (0.3282 => 0.3744, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/lists: 14.04% (0.3348 => 0.3818, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 13.96% (1.4269 => 1.6261, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: 13.95% (0.3477 => 0.3962, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 13.94% (0.4146 => 0.4724, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.85% (0.3625 => 0.4127, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 13.57% (0.4251 => 0.4828, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 13.52% (0.7875 => 0.8940, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.49% (0.3981 => 0.4518, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.47% (0.3690 => 0.4187, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 13.11% (2.1653 => 2.4491, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/bigfib: 12.95% (0.5012 => 0.5661, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 12.81% (4.6177 => 5.2092, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-2: 12.80% (0.3446 => 0.3887, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.64% (0.3465 => 0.3903, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 12.63% (0.2691 => 0.3031, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.59% (0.3488 => 0.3927, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 12.59% (0.3496 => 0.3936, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.57% (0.3460 => 0.3895, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.54% (0.3469 => 0.3904, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/trivial-interface: 12.49% (0.3442 => 0.3872, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 12.49% (2.1013 => 2.3638, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.40% (0.2040 => 0.2293, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 12.36% (0.3650 => 0.4101, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 12.22% (0.3643 => 0.4088, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.03% (0.3724 => 0.4172, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.87% (0.6435 => 0.7199, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 11.78% (5.5417 => 6.1944, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.77% (0.1028 => 0.1149) MultiSource/Applications/lambda-0_1_3/lambda: 11.18% (0.3498 => 0.3889, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 11.09% (0.6634 => 0.7370, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.02% (0.3084 => 0.3424, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.99% (0.1383 => 0.1535, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.85% (0.2737 => 0.3034, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.83% (0.2068 => 0.2292, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 10.63% (0.4847 => 0.5362, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 10.13% (0.3336 => 0.3674, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.08% (0.2103 => 0.2315, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 9.83% (2.0346 => 2.2347, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 9.74% (0.2391 => 0.2624, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.02% (4.6926 => 5.1160, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.95% (0.5361 => 0.5841, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.95% (11.6398 => 12.6819, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.45% (0.5584 => 0.6056, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.24% (0.7426 => 0.8038, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 6.83% (11.9555 => 12.7718, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.40% (0.3792 => 0.3921, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.89% (0.2802 => 0.3079, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.56% (3.3903 => 3.6126, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.44% (0.3693 => 0.3894, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 5.18% (0.2122 => 0.2232, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6728, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-2: 4.72% (1.8057 => 1.8910, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1672, std.dev.: 0.0105) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6372, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2099, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2251, std.dev.: 0.0041) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3037, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.28% (7.1849 => 7.2768, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.26% (1.0927 => 1.1065, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.14% (8.4155 => 8.5116, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5779, std.dev.: 0.0171) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.59% (2.4764 => 2.3876, std.dev.: 0.0170) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.70% (25.4195 => 16.5987, std.dev.: 0.0063) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9750, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7985, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: -6.91% (0.2402 => 0.2236, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7980, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -2.94% (6.9842 => 6.7792, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.91% (0.6293 => 0.6110, std.dev.: 0.0060) SingleSource/Benchmarks/Dhrystone/fldry: -2.40% (17.2379 => 16.8249, std.dev.: 0.0531) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.25% (41.7953 => 40.8563, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5778, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4961, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.27% (105.3826 => 104.0390, std.dev.: 0.0754) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0468, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 11:12:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 13:12:52 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121123191252.76C3C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6179?compare_to=6173&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6179, Order: 168516, Start Time: 2012-11-23 16:54:24, End Time: 2012-11-23 19:13:19 To: 6173, Order: 168512, Start Time: 2012-11-23 13:41:01, End Time: 2012-11-23 16:00:17 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 58 (142 on baseline) Performance Improvements: 31 (40 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 997 (703 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.45% (4.5992 => 5.4017, std.dev.: 0.0351) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.26% (0.0817 => 0.0958, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.93% (0.7166 => 0.8236, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 14.67% (0.5902 => 0.6768, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 14.34% (0.6191 => 0.7079, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 14.20% (0.7161 => 0.8178, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.03% (0.6302 => 0.7186, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 13.93% (0.6167 => 0.7026, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.93% (0.6649 => 0.7575, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 13.88% (0.6692 => 0.7621, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.86% (0.6132 => 0.6982, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.03% (0.4681 => 0.5291, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.49% (0.2226 => 0.2504, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.94% (0.3175 => 0.3554, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.70% (0.6568 => 0.7271, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/wc: 10.43% (0.3326 => 0.3673, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/ary3: 10.43% (0.3585 => 0.3959, std.dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 10.41% (1.3271 => 1.4652, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 10.35% (0.4077 => 0.4499, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.33% (1.4688 => 1.6205, std.dev.: 0.0204) SingleSource/Benchmarks/Shootout-C++/except: 10.29% (0.3139 => 0.3462, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.02% (0.6330 => 0.6964, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 9.65% (0.3100 => 0.3399, std.dev.: 0.0102) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.62% (4.8147 => 5.2777, std.dev.: 0.0650) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.39% (1.5832 => 1.7319, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.27% (1.5108 => 1.6508, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 8.88% (0.5902 => 0.6426, std.dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.78% (0.4429 => 0.4818, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.76% (5.6950 => 6.1936, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.63% (0.6144 => 0.6674, std.dev.: 0.0135) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.02% (0.1708 => 0.1845, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.76% (0.2125 => 0.2290, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.3379 => 0.3639, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.68% (0.3687 => 0.3970, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.05% (1.5610 => 1.6711, std.dev.: 0.0308) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.78% (5.5207 => 5.8949, std.dev.: 0.0269) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 6.73% (0.7072 => 0.7548, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.59% (0.3898 => 0.4155, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.54% (1.3747 => 1.4646, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.53% (17.0575 => 18.0009, std.dev.: 0.0541) MultiSource/Applications/hbd/hbd: 5.40% (1.7287 => 1.8220, std.dev.: 0.0307) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.02% (0.6973 => 0.7323, std.dev.: 0.0063) MultiSource/Benchmarks/PAQ8p/paq8p: 4.34% (11.2432 => 11.7313, std.dev.: 0.1734) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.65% (0.9561 => 0.9910, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.48% (0.6575 => 0.6804, std.dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: 2.86% (54.9619 => 56.5338, std.dev.: 0.4917) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.59% (4.9203 => 5.0477, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.83% (0.8847 => 0.9009, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 27.53% (1.3187 => 1.6817, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary3: 22.39% (3.7853 => 4.6330, std.dev.: 0.1654) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.10% (8.4316 => 9.3673, std.dev.: 0.2975) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.38% (3.1353 => 3.3352, std.dev.: 0.0082) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.15% (1.5405 => 1.6045, std.dev.: 0.0080) MultiSource/Benchmarks/NPB-serial/is/is: 4.13% (8.5776 => 8.9315, std.dev.: 0.0711) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.00% (5.3275 => 5.5407, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.41% (4.7973 => 4.9127, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.53% (5.4626 => 5.5464, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.21% (2.3220 => 2.3502, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.95% (0.6626 => 0.5768, std.dev.: 0.0241) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -12.79% (0.7563 => 0.6596, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -12.53% (0.7639 => 0.6682, std.dev.: 0.0251) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -12.48% (0.7842 => 0.6863, std.dev.: 0.0293) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -12.45% (0.7093 => 0.6210, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -12.44% (0.6721 => 0.5885, std.dev.: 0.0253) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -11.45% (0.7019 => 0.6215, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -10.47% (2.5420 => 2.2759, std.dev.: 0.0532) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -10.22% (0.5800 => 0.5207, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -9.81% (1.2277 => 1.1073, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -9.71% (1.9270 => 1.7398, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -9.19% (0.3919 => 0.3559, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -8.58% (0.1667 => 0.1524, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.07% (0.2888 => 0.2655, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -7.80% (0.3602 => 0.3321, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -7.42% (1.0267 => 0.9505, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.21% (1.3168 => 1.2218, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.75% (11.6048 => 10.8213, std.dev.: 0.0363) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.11% (0.5369 => 0.5041, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.70% (21.7198 => 20.6994, std.dev.: 0.0571) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -1.63% (0.6758 => 0.6648, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -22.07% (1.9986 => 1.5575, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -11.04% (10.0976 => 8.9824, std.dev.: 0.1386) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -7.58% (6.5253 => 6.0305, std.dev.: 0.1216) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -3.96% (4.5044 => 4.3261, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.88% (5.4733 => 5.3702, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.40% (5.1597 => 5.0874, std.dev.: 0.0174) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.32% (2.2112 => 2.1820, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.13% (8.9722 => 8.8709, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.07% (4.2007 => 4.1559, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.05% (6.7577 => 6.6868, std.dev.: 0.0204) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -1.37% (69.9953 => 69.0391, std.dev.: 0.2383) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -1.98% (0.1366 => 0.1339, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.78% (0.0421 => 0.0479, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.42% (0.0679 => 0.0649, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 0.02% (493.9346 => 494.0124, std.dev.: 0.2185) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.16% (63.2438 => 69.0391, std.dev.: 0.2383) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.91% (4.3882 => 0.0479, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43707.08% (1.1277 => 494.0124, std.dev.: 0.2185) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 195.87% (0.5229 => 1.5471, std.dev.: 0.0799) MultiSource/Applications/SPASS/SPASS: 19.41% (14.9895 => 17.8995, std.dev.: 0.2767) MultiSource/Applications/kimwitu++/kc: 47.81% (14.1553 => 20.9229, std.dev.: 0.5347) MultiSource/Benchmarks/MallocBench/gs/gs: 15.90% (4.1105 => 4.7641, std.dev.: 0.1573) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 49.42% (1.1048 => 1.6508, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 435.28% (7.1582 => 38.3167, std.dev.: 0.3255) SingleSource/Benchmarks/Misc-C++-EH/spirit: 75.94% (3.4629 => 6.0927, std.dev.: 0.4307) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.69% (0.6222 => 1.0309, std.dev.: 0.0673) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10735.97% (0.0720 => 7.8019, std.dev.: 0.2075) MultiSource/Applications/SIBsim4/SIBsim4: 3859700.00% (0.0001 => 3.8598, std.dev.: 0.0373) MultiSource/Applications/SPASS/SPASS: 14590800.00% (0.0001 => 14.5909, std.dev.: 1.4914) MultiSource/Applications/kimwitu++/kc: 52000.00% (0.0001 => 0.0521, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14400.00% (0.0001 => 0.0145, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 597200.00% (0.0001 => 0.5973, std.dev.: 0.0293) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10078200.00% (0.0001 => 10.0783, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5689300.00% (0.0001 => 5.6894, std.dev.: 0.8469) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1749.15% (1.1194 => 20.6994, std.dev.: 0.0571) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 83.83% (2.9384 => 5.4017, std.dev.: 0.0351) MultiSource/Applications/ClamAV/clamscan: 66.91% (22.1758 => 37.0127, std.dev.: 0.7142) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.41% (7.0540 => 10.8213, std.dev.: 0.0363) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 51.31% (8.1363 => 12.3114, std.dev.: 0.1446) MultiSource/Applications/JM/lencod/lencod: 47.51% (21.9371 => 32.3584, std.dev.: 0.1045) MultiSource/Benchmarks/FreeBench/distray/distray: 44.70% (0.1056 => 0.1528, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/almabench: 37.95% (0.0730 => 0.1007, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 37.78% (0.1432 => 0.1973, std.dev.: 0.0102) SingleSource/Benchmarks/Stanford/Oscar: 32.08% (0.0636 => 0.0840, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.23% (0.0730 => 0.0958, std.dev.: 0.0036) SingleSource/UnitTests/vla: 30.14% (0.0355 => 0.0462, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 29.94% (0.1032 => 0.1341, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/five11/five11: 29.28% (0.0567 => 0.0733, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 29.07% (0.1940 => 0.2504, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 27.30% (0.1044 => 0.1329, std.dev.: 0.0041) MultiSource/Applications/minisat/minisat: 27.21% (0.7115 => 0.9051, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 25.93% (0.3826 => 0.4818, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/spellcheck: 25.89% (0.4203 => 0.5291, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/matrix: 25.79% (0.0818 => 0.1029, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 25.30% (14.3668 => 18.0009, std.dev.: 0.0541) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 25.05% (0.5569 => 0.6964, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.85% (0.0648 => 0.0809, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.29% (0.0770 => 0.0957, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.26% (0.2065 => 0.2566, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 24.18% (1.3050 => 1.6205, std.dev.: 0.0204) SingleSource/Benchmarks/Stanford/Towers: 23.99% (0.0471 => 0.0584, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 23.83% (5.0018 => 6.1936, std.dev.: 0.0124) MultiSource/Benchmarks/MallocBench/espresso/espresso: 23.76% (4.2646 => 5.2777, std.dev.: 0.0650) MultiSource/Benchmarks/nbench/nbench: 23.75% (1.1840 => 1.4652, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 23.48% (1.1861 => 1.4646, std.dev.: 0.0118) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.46% (0.0746 => 0.0921, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sumcol: 22.93% (0.2891 => 0.3554, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.74% (0.1117 => 0.1371, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 22.33% (0.8101 => 0.9910, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ks/ks: 22.19% (0.1510 => 0.1845, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.18% (0.0834 => 0.1019, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 22.12% (0.3684 => 0.4499, std.dev.: 0.0118) MultiSource/Benchmarks/McCat/08-main/main: 21.93% (0.2554 => 0.3114, std.dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 21.72% (0.0838 => 0.1020, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.95% (0.1566 => 0.1894, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/functionobjects: 20.90% (0.5020 => 0.6069, std.dev.: 0.0211) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.75% (0.3441 => 0.4155, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ary3: 20.59% (0.3283 => 0.3959, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/except: 20.59% (0.2871 => 0.3462, std.dev.: 0.0052) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.52% (0.1584 => 0.1909, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/wc: 20.35% (0.3052 => 0.3673, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/tsp/tsp: 20.17% (0.1175 => 0.1412, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 20.15% (0.1906 => 0.2290, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/strcat: 20.06% (0.2831 => 0.3399, std.dev.: 0.0102) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 19.61% (0.1892 => 0.2263, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/office/office: 19.36% (0.3136 => 0.3743, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.21% (4.9449 => 5.8949, std.dev.: 0.0269) MultiSource/Applications/lua/lua: 19.21% (3.8723 => 4.6161, std.dev.: 0.1073) SingleSource/Benchmarks/Shootout-C++/wordfreq: 19.05% (0.3307 => 0.3937, std.dev.: 0.0226) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 18.92% (0.0793 => 0.0943, std.dev.: 0.0045) MultiSource/Applications/lemon/lemon: 18.55% (1.0722 => 1.2711, std.dev.: 0.0475) SingleSource/Benchmarks/Shootout-C++/fibo: 18.39% (0.2725 => 0.3226, std.dev.: 0.0113) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.13% (0.1125 => 0.1329, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.80% (1.4186 => 1.6711, std.dev.: 0.0308) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.58% (0.6450 => 0.7584, std.dev.: 0.0278) SingleSource/Benchmarks/Misc/whetstone: 17.58% (0.0660 => 0.0776, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: 17.46% (0.3098 => 0.3639, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.10% (0.0842 => 0.0986, std.dev.: 0.0036) MultiSource/Applications/hbd/hbd: 16.77% (1.5603 => 1.8220, std.dev.: 0.0307) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.31% (0.8172 => 0.9505, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 15.86% (5.7591 => 6.6725, std.dev.: 0.2767) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.84% (0.3427 => 0.3970, std.dev.: 0.0078) MultiSource/Applications/treecc/treecc: 15.83% (2.0273 => 2.3482, std.dev.: 0.1205) MultiSource/Benchmarks/Olden/mst/mst: 15.82% (0.1163 => 0.1347, std.dev.: 0.0067) SingleSource/Benchmarks/Stanford/Puzzle: 15.77% (0.1268 => 0.1468, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.70% (0.0675 => 0.0781, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.69% (0.0886 => 0.1025, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.42% (0.0953 => 0.1100, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/health/health: 14.91% (0.1268 => 0.1457, std.dev.: 0.0069) MultiSource/Applications/viterbi/viterbi: 14.86% (0.1555 => 0.1786, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.55% (0.0770 => 0.0882, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.33% (0.2107 => 0.2409, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.32% (0.2758 => 0.3153, std.dev.: 0.0079) MultiSource/Benchmarks/mafft/pairlocalalign: 14.14% (9.4845 => 10.8252, std.dev.: 0.3879) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.03% (0.3121 => 0.3559, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.03% (0.5981 => 0.6820, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.99% (0.1337 => 0.1524, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.75% (0.1062 => 0.1208, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.61% (0.1029 => 0.1169, std.dev.: 0.0051) MultiSource/Applications/sqlite3/sqlite3: 13.51% (17.1811 => 19.5024, std.dev.: 0.5195) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.45% (0.5860 => 0.6648, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.39% (0.9765 => 1.1073, std.dev.: 0.0007) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.39% (0.1143 => 0.1296, std.dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: 13.16% (10.3673 => 11.7313, std.dev.: 0.1734) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.86% (1.5415 => 1.7398, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.83% (0.4615 => 0.5207, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 12.78% (0.2872 => 0.3239, std.dev.: 0.0112) SingleSource/UnitTests/ObjC/exceptions-3: 12.09% (0.3516 => 0.3941, std.dev.: 0.0087) SingleSource/UnitTests/ObjC/exceptions-4: 11.97% (0.3543 => 0.3967, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/exceptions-2: 11.92% (0.3497 => 0.3914, std.dev.: 0.0082) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.83% (0.3543 => 0.3962, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.06% (0.8067 => 0.8959, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 10.98% (0.4299 => 0.4771, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/football/football: 10.28% (0.8921 => 0.9838, std.dev.: 0.0341) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.13% (2.0665 => 2.2759, std.dev.: 0.0532) MultiSource/Benchmarks/sim/sim: 10.01% (0.3387 => 0.3726, std.dev.: 0.0120) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.50% (2.2022 => 2.4115, std.dev.: 0.0567) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.26% (0.2430 => 0.2655, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.15% (7.9617 => 8.5312, std.dev.: 0.0774) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.53% (0.3177 => 0.3321, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: 4.37% (54.1659 => 56.5338, std.dev.: 0.4917) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.32% (0.4879 => 0.5041, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.22% (4.3953 => 10.9980, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/methcall: 147.42% (5.3999 => 13.3603, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/ft/ft: 30.99% (1.2838 => 1.6817, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary3: 24.47% (3.7221 => 4.6330, std.dev.: 0.1654) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.38% (13.4384 => 16.3109, std.dev.: 1.1048) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.70% (1.1145 => 1.3118, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 17.50% (6.6465 => 7.8098, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.11% (0.2944 => 0.3330, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.66% (2.8904 => 3.2273, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/richards_benchmark: 10.27% (1.1396 => 1.2566, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.27% (1.7254 => 1.8853, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.44% (3.1334 => 3.3352, std.dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.95% (0.9540 => 1.0108, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.59% (4.2280 => 4.4644, std.dev.: 0.0049) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.67% (26.0924 => 27.3114, std.dev.: 0.1722) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.6436 => 12.1027, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.93% (0.3540 => 0.3679, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.34% (0.4162 => 0.4301, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.24% (1.5086 => 1.5575, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: 2.65% (2.4116 => 2.4756, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.23% (1.7133 => 1.7515, std.dev.: 0.0148) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 2.02% (3.1595 => 3.2234, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.85% (2.1424 => 2.1820, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 1.82% (85.0658 => 86.6136, std.dev.: 0.1361) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.59% (2.3135 => 2.3502, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 1.50% (27.8444 => 28.2623, std.dev.: 0.0166) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.48% (6.5088 => 6.6052, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/sieve: 1.32% (5.2139 => 5.2829, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0498, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.51% (6.6874 => 0.1668, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.84% (5.2763 => 1.2218, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/salsa20: -75.41% (0.8651 => 0.2127, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/richards_benchmark: -45.31% (0.1622 => 0.0887, std.dev.: 0.0068) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -12.33% (0.1330 => 0.1166, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.48% (5.3855 => 4.8212, std.dev.: 0.0836) MultiSource/Applications/JM/ldecod/ldecod: -8.33% (10.4361 => 9.5666, std.dev.: 0.2819) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.70% (5.3526 => 5.0477, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.65% (1.7609 => 1.7319, std.dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.52% (0.0628 => 0.0361, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.13% (0.3987 => 0.2387, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.30% (4.5009 => 2.7772, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.15% (2.6546 => 2.0135, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -19.30% (0.2161 => 0.1744, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.87% (1.6925 => 1.4239, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.67% (2.6778 => 2.2849, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.81% (32.5116 => 28.9961, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/mandel-2: -10.64% (1.5373 => 1.3738, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.05% (1.5660 => 1.4243, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.2416 => 3.0209, std.dev.: 0.0239) MultiSource/Benchmarks/NPB-serial/is/is: -6.61% (9.5636 => 8.9315, std.dev.: 0.0711) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.59% (2.7294 => 2.5768, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7497, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -5.03% (1.5835 => 1.5038, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.81% (0.2497 => 0.2377, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.52% (1.6805 => 1.6045, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/lists: -4.30% (6.2999 => 6.0293, std.dev.: 0.0084) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8916, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.80% (19.9488 => 19.3911, std.dev.: 0.0338) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.69% (0.9957 => 0.9689, std.dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.31% (0.4808 => 0.4697, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (8.1563 => 8.0201, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/salsa20: -1.52% (10.2830 => 10.1271, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0002) Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 12:04:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 14:04:16 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121123200416.45BF02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6180?compare_to=6176&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6180, Order: 168522, Start Time: 2012-11-23 18:30:08, End Time: 2012-11-23 20:04:41 To: 6176, Order: 168516, Start Time: 2012-11-23 16:38:11, End Time: 2012-11-23 18:13:10 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 4 (54 on baseline) Performance Improvements: 14 (17 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1036 (903 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 12.76% (19.5734 => 22.0701, std.dev.: 0.7258) MultiSource/Benchmarks/llubenchmark/llu: 2.07% (1.9940 => 2.0352, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/pi: 1.82% (2.4622 => 2.5071, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.06% (1.2478 => 1.2610, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -9.65% (0.3243 => 0.2930, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -9.36% (3.5953 => 3.2589, std.dev.: 0.1240) SingleSource/Benchmarks/Misc-C++/stepanov_container: -7.39% (0.9292 => 0.8605, std.dev.: 0.0256) MultiSource/Benchmarks/McCat/09-vor/vor: -4.37% (0.3429 => 0.3279, std.dev.: 0.0042) MultiSource/Applications/SIBsim4/SIBsim4: -1.93% (1.3240 => 1.2984, std.dev.: 0.0067) MultiSource/Applications/ClamAV/clamscan: -1.82% (15.5488 => 15.2659, std.dev.: 0.0647) MultiSource/Applications/lemon/lemon: -1.42% (1.1310 => 1.1149, std.dev.: 0.0051) MultiSource/Applications/siod/siod: -1.05% (2.3155 => 2.2911, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: -23.31% (5.9962 => 4.5987, std.dev.: 0.5219) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -4.77% (43.7060 => 41.6216, std.dev.: 0.7483) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -4.25% (63.2635 => 60.5730, std.dev.: 0.3929) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -3.30% (2.3923 => 2.3134, std.dev.: 0.0297) MultiSource/Applications/sqlite3/sqlite3: -1.16% (4.5192 => 4.4669, std.dev.: 0.0063) MultiSource/Applications/SIBsim4/SIBsim4: -1.09% (3.4156 => 3.3784, std.dev.: 0.0049) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.80% (1.0829 => 1.0634, std.dev.: 0.0139) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.45% (0.0221 => 0.0220, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 14.75% (0.0373 => 0.0428, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.80% (0.0334 => 0.0340, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 14.39% (0.0278 => 0.0318, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.15% (0.0418 => 0.0427, std.dev.: 0.0104) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0204 => 0.0205, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/test1: 0.46% (0.0219 => 0.0220, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -11.11% (0.0009 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.20% (0.1482 => 0.1485, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -1.93% (1.1931 => 1.1701, std.dev.: 0.0061) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.32% (0.4182 => 0.4127, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.03% (0.1423 => 0.1523, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.23% (0.0648 => 0.0656, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.58% (0.0271 => 0.0278, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.81% (0.0587 => 0.0627, std.dev.: 0.0133) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.03% (1.1972 => 1.1976, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 287.50% (0.0008 => 0.0031, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 225.00% (0.0008 => 0.0026, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.74% (0.0634 => 0.0645, std.dev.: 0.0121) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.50% (0.0257 => 0.0266, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.98% (0.7877 => 0.7800, std.dev.: 0.0221) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 4.05% (0.0074 => 0.0077, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.00% (16.4461 => 17.5977, std.dev.: 0.3163) MultiSource/Applications/sqlite3/sqlite3: 2312.76% (0.6332 => 15.2776, std.dev.: 0.1095) MultiSource/Benchmarks/McCat/08-main/main: 47.24% (0.1831 => 0.2696, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.35% (0.1559 => 0.1460, std.dev.: 0.0279) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7039.83% (0.3123 => 22.2977, std.dev.: 1.2140) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.44% (0.2463 => 0.3730, std.dev.: 0.0539) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1537.44% (0.3344 => 5.4756, std.dev.: 0.3178) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.24% (0.2364 => 0.3268, std.dev.: 0.0799) SingleSource/Benchmarks/Misc-C++/bigfib: 5.74% (0.6010 => 0.6355, std.dev.: 0.0163) SingleSource/Benchmarks/Misc/mandel: 2.10% (0.0429 => 0.0438, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.56% (0.3266 => 0.3513, std.dev.: 0.0931) SingleSource/Benchmarks/Shootout-C++/strcat: 4.67% (0.1969 => 0.2061, std.dev.: 0.0031) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.25% (0.0224 => 0.0238, std.dev.: 0.0010) SingleSource/UnitTests/byval-alignment: -31.30% (0.0230 => 0.0158, std.dev.: 0.0019) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0515, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 12.18% (0.1462 => 0.1640, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4669, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0703, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4948, std.dev.: 0.0081) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5169, std.dev.: 0.0496) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.7177, std.dev.: 0.2178) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3516, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1374, std.dev.: 0.0737) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3628, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4100, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0871, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: -23.89% (2.1832 => 1.6616, std.dev.: 0.0026) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.33% (0.0810 => 0.0918, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.85% (0.0848 => 0.0957, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: 12.68% (0.1112 => 0.1253, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.17% (0.0830 => 0.0931, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.43% (0.2180 => 0.2342, std.dev.: 0.0054) MultiSource/Applications/spiff/spiff: 6.05% (0.7950 => 0.8431, std.dev.: 0.0059) MultiSource/Applications/Burg/burg: 5.86% (1.2222 => 1.2938, std.dev.: 0.0082) MultiSource/Applications/sgefa/sgefa: 4.67% (0.2999 => 0.3139, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 4.30% (1.4269 => 1.4883, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/bh/bh: 4.22% (0.2985 => 0.3111, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 4.18% (0.8261 => 0.8606, std.dev.: 0.0109) MultiSource/Applications/treecc/treecc: 4.17% (1.9948 => 2.0779, std.dev.: 0.0111) MultiSource/Applications/SPASS/SPASS: 3.74% (14.2605 => 14.7936, std.dev.: 0.1370) MultiSource/Applications/ClamAV/clamscan: 3.37% (14.7684 => 15.2659, std.dev.: 0.0647) MultiSource/Applications/SIBsim4/SIBsim4: 3.31% (1.2568 => 1.2984, std.dev.: 0.0067) MultiSource/Applications/siod/siod: 3.28% (2.2184 => 2.2911, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.14% (0.8338 => 0.8600, std.dev.: 0.0055) MultiSource/Applications/minisat/minisat: 2.91% (0.6834 => 0.7033, std.dev.: 0.0075) MultiSource/Applications/d/make_dparser: 2.73% (3.2366 => 3.3250, std.dev.: 0.0235) MultiSource/Applications/hexxagon/hexxagon: 2.34% (0.9810 => 1.0040, std.dev.: 0.0086) MultiSource/Applications/lemon/lemon: 1.86% (1.0945 => 1.1149, std.dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (0.7557 => 0.7690, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 117.09% (0.0199 => 0.0432, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/pi: 58.73% (1.5795 => 2.5071, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.75% (2.9753 => 3.4738, std.dev.: 0.0243) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.70% (2.7995 => 3.2110, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.58% (5.0261 => 5.6081, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.40% (6.3772 => 7.1042, std.dev.: 0.2244) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.86% (0.3186 => 0.3500, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.20% (1.1857 => 1.2829, std.dev.: 0.0218) SingleSource/Benchmarks/McGill/queens: 7.39% (1.7056 => 1.8316, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/richards_benchmark: 7.36% (1.3037 => 1.3997, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.57% (4.7794 => 5.0932, std.dev.: 0.0283) MultiSource/Applications/SIBsim4/SIBsim4: 6.00% (3.1873 => 3.3784, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.86% (4.5327 => 4.7984, std.dev.: 0.0473) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.75% (6.2275 => 6.5231, std.dev.: 0.0150) MultiSource/Applications/lambda-0_1_3/lambda: 4.75% (7.4933 => 7.8489, std.dev.: 0.0290) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.48% (3.3761 => 3.5272, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.36% (4.9469 => 5.1627, std.dev.: 0.0668) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.32% (4.8660 => 5.0763, std.dev.: 0.0610) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.22% (4.9453 => 5.1538, std.dev.: 0.0677) MultiSource/Applications/hexxagon/hexxagon: 3.95% (14.0064 => 14.5596, std.dev.: 0.0535) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.12% (0.3587 => 0.3699, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 2.97% (3.6643 => 3.7733, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.64% (8.2783 => 8.4968, std.dev.: 0.0273) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.53% (11.5690 => 11.8617, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout/lists: 2.40% (7.3375 => 7.5133, std.dev.: 0.0303) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.21% (59.2638 => 60.5730, std.dev.: 0.3929) MultiSource/Benchmarks/llubenchmark/llu: 1.93% (1.9967 => 2.0352, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/power/power: 1.51% (1.2061 => 1.2243, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/ReedSolomon: 1.32% (8.5322 => 8.6448, std.dev.: 0.0419) SingleSource/Benchmarks/Stanford/FloatMM: 1.32% (0.8807 => 0.8923, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.16% (3.5679 => 3.6092, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.09% (1.2474 => 1.2610, std.dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.06% (5.4641 => 4.3135, std.dev.: 0.0375) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.54% (7.2130 => 6.2360, std.dev.: 0.0741) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.10% (1.0512 => 0.9345, std.dev.: 0.0122) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -10.05% (14.6451 => 13.1732, std.dev.: 0.3939) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.84% (0.3269 => 0.2980, std.dev.: 0.0071) MultiSource/Benchmarks/mafft/pairlocalalign: -8.55% (63.1822 => 57.7798, std.dev.: 0.1772) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.92% (4.7482 => 4.4197, std.dev.: 0.0762) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.96% (3.7148 => 3.4935, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.90% (5.4972 => 5.1727, std.dev.: 0.0327) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.04% (5.1557 => 4.8961, std.dev.: 0.0411) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.35% (4.7449 => 4.5385, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.73% (6.0224 => 5.7979, std.dev.: 0.0358) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.31% (0.5807 => 0.5615, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (28.5821 => 27.6963, std.dev.: 0.1160) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.64% (2.8773 => 2.8014, std.dev.: 0.0224) MultiSource/Applications/aha/aha: -2.41% (3.3398 => 3.2592, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.01% (11.5316 => 11.2999, std.dev.: 0.0346) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.63% (1.0262 => 1.0634, std.dev.: 0.0139) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 33.86% (0.0254 => 0.0340, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.30% (0.0302 => 0.0318, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.20% (0.0384 => 0.0427, std.dev.: 0.0104) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/test1: 22.22% (0.0180 => 0.0220, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 3.27% (0.1438 => 0.1485, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 3.28% (1.1329 => 1.1701, std.dev.: 0.0061) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.89% (0.4164 => 0.4127, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.25% (0.1369 => 0.1523, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.34% (0.0641 => 0.0656, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.56% (0.0195 => 0.0278, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.48% (0.0578 => 0.0627, std.dev.: 0.0133) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.71% (1.1437 => 1.1976, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.87% (0.0627 => 0.0645, std.dev.: 0.0121) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.71% (0.8017 => 0.7800, std.dev.: 0.0221) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 24.19% (0.0062 => 0.0077, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 4.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 12:31:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 14:31:48 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121123203148.F2CA02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6181?compare_to=6177&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6181, Order: 168522, Start Time: 2012-11-23 18:58:23, End Time: 2012-11-23 20:32:16 To: 6177, Order: 168519, Start Time: 2012-11-23 17:01:29, End Time: 2012-11-23 18:35:02 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (179 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (857 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 1.05% (3.6807 => 3.7194, std.dev.: 0.0033) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 18.99% (0.3834 => 0.4562, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.15% (2.0478 => 2.1124, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/salsa20: 2.60% (7.4937 => 7.6886, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.22% (54.5751 => 55.7865, std.dev.: 0.3668) SingleSource/Benchmarks/Shootout-C++/hash2: 2.21% (3.1932 => 3.2639, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.80% (0.3821 => 0.3523, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.81% (2.4924 => 2.3227, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.76% (0.9542 => 0.8897, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.70% (0.3357 => 0.3132, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.65% (0.3142 => 0.2933, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.31% (0.7198 => 0.6744, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -6.30% (0.2160 => 0.2024, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.18% (0.2428 => 0.2278, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.12% (0.9852 => 0.9249, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -6.04% (9.2283 => 8.6705, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.98% (0.6484 => 0.6096, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.90% (0.3658 => 0.3442, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.90% (1.3722 => 1.2913, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -5.87% (7.0961 => 6.6799, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.83% (1.0544 => 0.9929, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: -5.82% (0.9179 => 0.8645, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -5.81% (16.1920 => 15.2505, std.dev.: 0.0074) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.77% (0.2355 => 0.2219, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.73% (4.8161 => 4.5399, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.71% (0.5863 => 0.5528, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.69% (3.5339 => 3.3328, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.69% (0.3884 => 0.3663, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.69% (0.5591 => 0.5273, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.67% (0.3848 => 0.3630, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.66% (0.3831 => 0.3614, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.66% (4.0323 => 3.8042, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/trivial-interface: -5.64% (0.3812 => 0.3597, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -5.62% (0.3896 => 0.3677, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.60% (0.2695 => 0.2544, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.60% (0.6052 => 0.5713, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: -5.59% (4.3330 => 4.0909, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/for-in: -5.58% (0.4033 => 0.3808, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.58% (1.2300 => 1.1614, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.57% (0.5925 => 0.5595, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.57% (0.5478 => 0.5173, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.57% (1.6364 => 1.5453, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.57% (0.5570 => 0.5260, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.56% (0.6667 => 0.6296, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.55% (0.3891 => 0.3675, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -5.54% (0.3880 => 0.3665, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -5.53% (0.4176 => 0.3945, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.53% (4.8802 => 4.6104, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.51% (0.5857 => 0.5534, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: -5.51% (1.1530 => 1.0895, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.51% (0.6230 => 0.5887, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.51% (0.6194 => 0.5853, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.50% (1.4642 => 1.3836, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.50% (0.5805 => 0.5486, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.49% (0.5705 => 0.5392, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.46% (0.6736 => 0.6368, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.46% (0.5859 => 0.5539, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -5.45% (1.1450 => 1.0826, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.44% (4.5069 => 4.2618, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.43% (0.6293 => 0.5951, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.43% (6.7716 => 6.4037, std.dev.: 0.0121) MultiSource/Benchmarks/sim/sim: -5.43% (0.3406 => 0.3221, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -5.43% (0.2985 => 0.2823, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.42% (0.6260 => 0.5921, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.41% (0.5802 => 0.5488, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.40% (0.7919 => 0.7491, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: -5.40% (0.4515 => 0.4271, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.38% (0.6297 => 0.5958, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.38% (0.5575 => 0.5275, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.37% (0.5456 => 0.5163, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.37% (0.6446 => 0.6100, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.36% (0.6304 => 0.5966, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.35% (0.5849 => 0.5536, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.34% (0.8521 => 0.8066, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.34% (0.5941 => 0.5624, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -5.33% (0.4199 => 0.3975, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.33% (0.6660 => 0.6305, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.32% (0.5581 => 0.5284, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.32% (0.6189 => 0.5860, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.30% (0.5999 => 0.5681, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.30% (1.2784 => 1.2107, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.27% (0.6676 => 0.6324, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -5.27% (17.1032 => 16.2022, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.24% (0.6681 => 0.6331, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.23% (0.6440 => 0.6103, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.23% (14.2083 => 13.4654, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/08-main/main: -5.19% (0.2659 => 0.2521, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.19% (0.6033 => 0.5720, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.18% (0.2548 => 0.2416, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.17% (0.2999 => 0.2844, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.16% (1.3864 => 1.3148, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.15% (1.2210 => 1.1581, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -5.14% (0.3581 => 0.3397, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.14% (0.2278 => 0.2161, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -5.13% (1.2515 => 1.1873, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: -5.12% (15.5079 => 14.7134, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.06% (8.0126 => 7.6068, std.dev.: 0.0081) SingleSource/UnitTests/ObjC/parameter-passing: -5.02% (0.4280 => 0.4065, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.00% (0.3319 => 0.3153, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.99% (0.5688 => 0.5404, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.98% (1.2221 => 1.1613, std.dev.: 0.0050) MultiSource/Applications/lua/lua: -4.97% (4.0594 => 3.8577, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.97% (0.3483 => 0.3310, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.96% (0.4916 => 0.4672, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.89% (0.7339 => 0.6980, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.86% (0.2385 => 0.2269, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: -4.86% (0.7447 => 0.7085, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.84% (0.7524 => 0.7160, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: -4.80% (3.5154 => 3.3466, std.dev.: 0.0051) MultiSource/Applications/siod/siod: -4.75% (2.4021 => 2.2879, std.dev.: 0.0053) MultiSource/Applications/ClamAV/clamscan: -4.75% (15.2527 => 14.5277, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.74% (1.6474 => 1.5693, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.70% (22.4056 => 21.3533, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.68% (0.6395 => 0.6096, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.64% (0.5168 => 0.4928, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -4.59% (1.3148 => 1.2545, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.55% (0.3931 => 0.3752, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.55% (0.4151 => 0.3962, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: -4.46% (0.3271 => 0.3125, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -4.46% (0.2871 => 0.2743, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -4.46% (5.0226 => 4.7987, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/matrix: -4.45% (0.3255 => 0.3110, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.44% (0.7021 => 0.6709, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -4.42% (0.7982 => 0.7629, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.42% (0.5567 => 0.5321, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.42% (0.3057 => 0.2922, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.41% (0.6395 => 0.6113, std.dev.: 0.0034) MultiSource/Applications/treecc/treecc: -4.38% (2.1401 => 2.0463, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.38% (0.5569 => 0.5325, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.37% (0.4321 => 0.4132, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.37% (0.5329 => 0.5096, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/methcall: -4.33% (0.3025 => 0.2894, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.33% (0.2933 => 0.2806, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.32% (0.4813 => 0.4605, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/random: -4.32% (0.2939 => 0.2812, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.31% (0.3016 => 0.2886, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.27% (0.3252 => 0.3113, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.27% (0.3323 => 0.3181, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.27% (0.2903 => 0.2779, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.25% (0.3837 => 0.3674, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -4.24% (0.3446 => 0.3300, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.23% (0.9077 => 0.8693, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -4.23% (0.3026 => 0.2898, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -4.22% (0.2989 => 0.2863, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -4.21% (0.3205 => 0.3070, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -4.18% (0.3394 => 0.3252, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.18% (0.2849 => 0.2730, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.17% (2.1713 => 2.0807, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/objinst: -4.16% (0.3194 => 0.3061, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -4.16% (34.0927 => 32.6736, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hash2: -4.16% (0.4861 => 0.4659, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.12% (2.2587 => 2.1656, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.11% (0.9557 => 0.9164, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -4.11% (18.2933 => 17.5411, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/ary2: -4.11% (0.3481 => 0.3338, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.10% (0.3849 => 0.3691, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.09% (0.3867 => 0.3709, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.07% (0.4083 => 0.3917, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -4.03% (0.3621 => 0.3475, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/moments: -4.00% (0.4248 => 0.4078, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -3.96% (0.8418 => 0.8085, std.dev.: 0.0044) SingleSource/UnitTests/ObjC++/Hello: -3.88% (0.6347 => 0.6101, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -3.82% (0.3059 => 0.2942, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.76% (0.6441 => 0.6199, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -3.75% (0.6750 => 0.6497, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.68% (0.4427 => 0.4264, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -3.61% (0.7779 => 0.7498, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.61% (0.3491 => 0.3365, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: -3.27% (0.3788 => 0.3664, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.27% (5.4682 => 5.2894, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: -3.16% (0.4524 => 0.4381, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.05% (1.5610 => 1.5134, std.dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -2.26% (20.7746 => 20.3061, std.dev.: 0.0243) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7571, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: -8.70% (1.2842 => 1.1725, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.87% (2.2633 => 2.1756, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.80% (1.3096 => 1.2729, std.dev.: 0.0116) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.64% (6.5735 => 6.4659, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 13:51:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 15:51:16 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121123215116.AE3BF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6182?compare_to=6180&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6182, Order: 168525, Start Time: 2012-11-23 20:21:45, End Time: 2012-11-23 21:51:45 To: 6180, Order: 168522, Start Time: 2012-11-23 18:30:08, End Time: 2012-11-23 20:04:41 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 4 (114 on baseline) Performance Improvements: 11 (27 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1039 (833 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 8.69% (3.6277 => 3.9428, std.dev.: 0.0459) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.27% (1.0049 => 1.0378, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.67% (13.1732 => 13.3928, std.dev.: 0.0840) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.05% (60.5730 => 61.2062, std.dev.: 0.1158) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -7.72% (0.2201 => 0.2031, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -3.07% (0.9155 => 0.8874, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: -3.01% (0.3954 => 0.3835, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.05% (0.9502 => 0.9307, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.52% (0.8687 => 0.8555, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -1.28% (0.8600 => 0.8490, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel24: -34.60% (0.3497 => 0.2287, std.dev.: 0.0266) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.74% (7.1042 => 6.6967, std.dev.: 0.1196) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.40% (1.3053 => 1.2479, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.99% (5.0763 => 4.9754, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: -1.83% (0.6326 => 0.6210, std.dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.01% (1.0634 => 1.0635, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.45% (0.0220 => 0.0219) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -21.73% (0.0428 => 0.0335, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.35% (0.0340 => 0.0332, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -14.78% (0.0318 => 0.0271, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.94% (0.0427 => 0.0423, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0205 => 0.0204) SingleSource/UnitTests/Vector/Altivec/test1: -3.18% (0.0220 => 0.0213, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 62.50% (0.0008 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.20% (0.1485 => 0.1482, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -3.30% (1.1701 => 1.1315, std.dev.: 0.0356) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.43% (0.4127 => 0.4068, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.71% (0.1523 => 0.1436, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -13.11% (0.0656 => 0.0570, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -33.45% (0.0278 => 0.0185, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.28% (0.0627 => 0.0550, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.48% (1.1976 => 1.1919, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -83.87% (0.0031 => 0.0005, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.25% (0.0645 => 0.0566, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -25.56% (0.0266 => 0.0198, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.94% (0.7800 => 0.7873, std.dev.: 0.0025) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -53.25% (0.0077 => 0.0036, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.44% (16.4461 => 17.6695, std.dev.: 0.0449) MultiSource/Applications/sqlite3/sqlite3: 2314.70% (0.6332 => 15.2899, std.dev.: 0.1206) MultiSource/Benchmarks/McCat/08-main/main: 47.84% (0.1831 => 0.2707, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.61% (0.1559 => 0.1456, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7061.00% (0.3123 => 22.3638, std.dev.: 0.1623) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.87% (0.2463 => 0.3716, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1551.38% (0.3344 => 5.5222, std.dev.: 0.0207) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.31% (0.2364 => 0.3246, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/bigfib: 4.78% (0.6010 => 0.6297, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: 2.80% (0.0429 => 0.0441, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.68% (0.3266 => 0.3419, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/strcat: 3.71% (0.1969 => 0.2042, std.dev.: 0.0010) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.91% (0.0224 => 0.0235, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -27.83% (0.0230 => 0.0166, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0456, std.dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: 7.52% (0.1462 => 0.1572, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4625, std.dev.: 0.0107) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0688, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4899, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5141, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.4756, std.dev.: 0.1072) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3218, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1349, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3630, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4011, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0800, std.dev.: 0.0038) SingleSource/Regression/C/uint64_to_float: -23.91% (2.1832 => 1.6612, std.dev.: 0.0017) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.43% (0.0810 => 0.0935, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: 13.22% (0.1112 => 0.1259, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.21% (0.0848 => 0.0960, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.89% (0.0830 => 0.0937, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.26% (0.2180 => 0.2360, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.85% (0.8321 => 0.8974, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.77% (0.7473 => 0.7979, std.dev.: 0.0103) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.45% (0.8148 => 0.8592, std.dev.: 0.0056) MultiSource/Applications/Burg/burg: 5.35% (1.2222 => 1.2876, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.92% (0.2519 => 0.2643, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.60% (0.2240 => 0.2343, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.57% (0.2998 => 0.3135, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.49% (0.3295 => 0.3443, std.dev.: 0.0047) MultiSource/Applications/spiff/spiff: 4.49% (0.7950 => 0.8307, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.44% (1.1606 => 1.2121, std.dev.: 0.0109) MultiSource/Applications/treecc/treecc: 4.19% (1.9948 => 2.0784, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.61% (2.1401 => 2.2174, std.dev.: 0.0127) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.58% (0.4783 => 0.4954, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 3.50% (0.6834 => 0.7073, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.47% (1.1685 => 1.2090, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.40% (0.4559 => 0.4714, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.34% (14.2605 => 14.7375, std.dev.: 0.0564) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.30% (1.2526 => 1.2939, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.21% (0.3115 => 0.3215, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.20% (0.5817 => 0.6003, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.20% (0.8697 => 0.8975, std.dev.: 0.0078) MultiSource/Applications/siod/siod: 3.19% (2.2184 => 2.2892, std.dev.: 0.0141) MultiSource/Applications/hbd/hbd: 3.10% (1.4269 => 1.4712, std.dev.: 0.0074) MultiSource/Applications/d/make_dparser: 3.10% (3.2366 => 3.3368, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.10% (1.3279 => 1.3690, std.dev.: 0.0081) MultiSource/Applications/lua/lua: 3.04% (3.8189 => 3.9350, std.dev.: 0.0167) MultiSource/Applications/ClamAV/clamscan: 3.01% (14.7684 => 15.2130, std.dev.: 0.0638) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.94% (1.5315 => 1.5766, std.dev.: 0.0152) MultiSource/Applications/SIBsim4/SIBsim4: 2.94% (1.2568 => 1.2938, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.90% (1.6386 => 1.6862, std.dev.: 0.0072) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.87% (6.6074 => 6.7973, std.dev.: 0.0251) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.84% (0.8340 => 0.8577, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 2.67% (31.8598 => 32.7096, std.dev.: 0.0913) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.61% (0.8611 => 0.8836, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (4.1763 => 4.2851, std.dev.: 0.0331) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.60% (0.8457 => 0.8677, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/gs/gs: 2.57% (4.1305 => 4.2367, std.dev.: 0.0312) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.57% (0.9074 => 0.9307, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.55% (13.1811 => 13.5175, std.dev.: 0.0809) MultiSource/Benchmarks/McCat/05-eks/eks: 2.52% (0.4397 => 0.4508, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.52% (0.8656 => 0.8874, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 2.51% (15.3280 => 15.7121, std.dev.: 0.0488) MultiSource/Applications/hexxagon/hexxagon: 2.48% (0.9810 => 1.0053, std.dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 2.45% (1.1271 => 1.1547, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.40% (1.4479 => 1.4827, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.39% (0.8317 => 0.8516, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.37% (0.8069 => 0.8260, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.34% (0.8359 => 0.8555, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.31% (0.8050 => 0.8236, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.30% (0.9069 => 0.9278, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 2.29% (0.8768 => 0.8969, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.27% (0.8286 => 0.8474, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.27% (0.8597 => 0.8792, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.26% (1.1170 => 1.1423, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.25% (0.7966 => 0.8145, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.24% (0.8086 => 0.8267, std.dev.: 0.0060) MultiSource/Benchmarks/PAQ8p/paq8p: 2.22% (2.3764 => 2.4291, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.21% (0.9908 => 1.0127, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.18% (0.8204 => 0.8383, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.16% (0.8007 => 0.8180, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.15% (0.8885 => 0.9076, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.15% (4.4880 => 4.5844, std.dev.: 0.0183) MultiSource/Applications/JM/ldecod/ldecod: 2.13% (6.7320 => 6.8752, std.dev.: 0.0357) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.11% (0.8420 => 0.8598, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.10% (0.5191 => 0.5300, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.07% (0.8805 => 0.8987, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.05% (0.8177 => 0.8345, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.00% (0.7932 => 0.8091, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 2.00% (1.0945 => 1.1164, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.96% (0.8712 => 0.8883, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.96% (0.8316 => 0.8479, std.dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: 1.96% (0.7557 => 0.7705, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 1.92% (8.6247 => 8.7905, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.82% (0.8338 => 0.8490, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.75% (0.8066 => 0.8207, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 1.69% (4.9628 => 5.0467, std.dev.: 0.0164) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.56% (0.8995 => 0.9135, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 108.54% (0.0199 => 0.0415, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.47% (0.7597 => 0.8924, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.00% (2.9753 => 3.4513, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.67% (2.7995 => 3.2103, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.53% (5.0261 => 5.6057, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.10% (1.1857 => 1.2817, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 7.83% (1.3037 => 1.4058, std.dev.: 0.0240) SingleSource/Benchmarks/McGill/queens: 7.16% (1.7056 => 1.8278, std.dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: 6.92% (3.1873 => 3.4078, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.89% (4.5327 => 4.7997, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.86% (4.9686 => 5.2597, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.01% (6.3772 => 6.6967, std.dev.: 0.1196) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.72% (6.2275 => 6.5212, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.57% (3.3761 => 3.5305, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 4.49% (7.4933 => 7.8299, std.dev.: 0.0305) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.21% (4.9453 => 5.1533, std.dev.: 0.0070) MultiSource/Applications/hexxagon/hexxagon: 4.02% (14.0064 => 14.5701, std.dev.: 0.1098) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.97% (4.9469 => 5.1434, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.28% (59.2638 => 61.2062, std.dev.: 0.1158) MultiSource/Applications/siod/siod: 3.00% (3.6643 => 3.7741, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.86% (11.5690 => 11.8995, std.dev.: 0.0185) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.83% (1.2337 => 1.2686, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.25% (4.8660 => 4.9754, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.19% (8.2783 => 8.4594, std.dev.: 0.0331) SingleSource/Benchmarks/Shootout/lists: 2.18% (7.3375 => 7.4975, std.dev.: 0.0192) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.87% (4.8362 => 4.9268, std.dev.: 0.0236) MultiSource/Benchmarks/Olden/power/power: 1.48% (1.2061 => 1.2240, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.44% (3.5679 => 3.6191, std.dev.: 0.0141) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.41% (1.1365 => 1.1525, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.36% (2.4647 => 2.4981, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.16% (2.5763 => 2.6062, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/ReedSolomon: 1.06% (8.5322 => 8.6226, std.dev.: 0.0168) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.04% (5.4641 => 4.3145, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.71% (7.2130 => 6.1520, std.dev.: 0.0363) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.62% (1.0512 => 0.9290, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/chomp: -10.77% (1.1216 => 1.0008, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.55% (14.6451 => 13.3928, std.dev.: 0.0840) MultiSource/Benchmarks/mafft/pairlocalalign: -8.54% (63.1822 => 57.7894, std.dev.: 0.8508) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.95% (0.3269 => 0.3009, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.88% (4.7482 => 4.4215, std.dev.: 0.0228) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.88% (5.4972 => 5.1742, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.81% (3.7148 => 3.4988, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.23% (5.1557 => 4.8863, std.dev.: 0.0944) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.43% (4.7449 => 4.5349, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.05% (2.8773 => 2.7609, std.dev.: 0.0242) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.64% (6.0224 => 5.8032, std.dev.: 0.0115) MultiSource/Applications/lua/lua: -3.43% (29.8330 => 28.8086, std.dev.: 0.0454) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.07% (0.5807 => 0.5629, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.05% (28.5821 => 27.7100, std.dev.: 0.0461) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.97% (2.6356 => 2.5573, std.dev.: 0.0092) MultiSource/Applications/aha/aha: -2.74% (3.3398 => 3.2484, std.dev.: 0.0100) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.68% (1.2822 => 1.2479, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.40% (9.9065 => 9.6686, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/hash2: -2.40% (3.4237 => 3.3416, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.34% (2.4490 => 2.3916, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (11.5316 => 11.2992, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.59% (4.9994 => 4.9199, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.39% (2.3487 => 2.3160, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.16% (5.6343 => 5.5690, std.dev.: 0.0128) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.63% (1.0262 => 1.0635, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -17.89% (0.0408 => 0.0335, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -10.26% (0.0302 => 0.0271, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204) SingleSource/UnitTests/Vector/Altivec/test1: 18.33% (0.0180 => 0.0213, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 3.06% (0.1438 => 0.1482, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -0.12% (1.1329 => 1.1315, std.dev.: 0.0356) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.31% (0.4164 => 0.4068, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.89% (0.1369 => 0.1436, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.08% (0.0641 => 0.0570, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.13% (0.0195 => 0.0185, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.84% (0.0578 => 0.0550, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.21% (1.1437 => 1.1919, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 400.00% (0.0001 => 0.0005, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.73% (0.0627 => 0.0566, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 10.00% (0.0180 => 0.0198, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.80% (0.8017 => 0.7873, std.dev.: 0.0025) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -41.94% (0.0062 => 0.0036, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 14:25:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 16:25:50 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121123222550.087ED2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6183?compare_to=6179&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6183, Order: 168524, Start Time: 2012-11-23 20:06:27, End Time: 2012-11-23 22:26:17 To: 6179, Order: 168516, Start Time: 2012-11-23 16:54:24, End Time: 2012-11-23 19:13:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 45 (154 on baseline) Performance Improvements: 3 (38 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1038 (693 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 13.65% (0.6877 => 0.7816, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 12.49% (0.1874 => 0.2108, std.dev.: 0.0071) MultiSource/Applications/hexxagon/hexxagon: 12.00% (1.3912 => 1.5581, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.62% (0.4466 => 0.4985, std.dev.: 0.0160) MultiSource/Benchmarks/McCat/18-imp/imp: 11.54% (0.3875 => 0.4322, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.49% (0.3472 => 0.3871, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/bh/bh: 11.33% (0.3328 => 0.3705, std.dev.: 0.0008) SingleSource/Benchmarks/LivermoreLoops/kernel21: 11.11% (0.1107 => 0.1230, std.dev.: 0.0004) SingleSource/Benchmarks/LivermoreLoops/kernel20: 10.51% (0.1037 => 0.1146, std.dev.: 0.0040) SingleSource/Benchmarks/LivermoreLoops/kernel23: 10.28% (0.1109 => 0.1223, std.dev.: 0.0002) SingleSource/Benchmarks/LivermoreLoops/kernel24: 10.12% (0.1008 => 0.1110, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.08% (6.0927 => 6.7066, std.dev.: 0.1444) MultiSource/Applications/treecc/treecc: 9.60% (2.3482 => 2.5737, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.44% (0.5889 => 0.6445, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.30% (0.4031 => 0.4406, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.30% (0.4558 => 0.4982, std.dev.: 0.0138) MultiSource/Benchmarks/Olden/tsp/tsp: 8.85% (0.1412 => 0.1537, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.70% (1.3397 => 1.4562, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/methcall: 8.09% (0.3214 => 0.3474, std.dev.: 0.0028) MultiSource/Applications/viterbi/viterbi: 7.45% (0.1786 => 0.1919, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/em3d/em3d: 7.41% (0.1958 => 0.2103, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists: 6.17% (0.3811 => 0.4046, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.05% (0.3937 => 0.4175, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.60% (0.2572 => 0.2716, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.52% (0.2409 => 0.2542, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.50% (0.2655 => 0.2801, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops: 5.17% (0.1973 => 0.2075, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: 5.08% (0.3583 => 0.3765, std.dev.: 0.0070) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.06% (0.3321 => 0.3489, std.dev.: 0.0048) SingleSource/UnitTests/ObjC++/Hello: 4.96% (0.6498 => 0.6820, std.dev.: 0.0105) MultiSource/Applications/sqlite3/sqlite3: 4.86% (19.5024 => 20.4495, std.dev.: 0.1866) SingleSource/UnitTests/ObjC/synchronized: 4.84% (0.3990 => 0.4183, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.53% (0.6069 => 0.6283, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/fibo: 3.22% (0.3226 => 0.3330, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/flops: 28.58% (6.7485 => 8.6773) MultiSource/Benchmarks/McCat/09-vor/vor: 24.27% (0.1195 => 0.1485, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 12.88% (6.3278 => 7.1431, std.dev.: 0.1650) MultiSource/Benchmarks/Olden/tsp/tsp: 11.86% (1.1041 => 1.2351, std.dev.: 0.0175) MultiSource/Benchmarks/Olden/bh/bh: 6.75% (1.9563 => 2.0884, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 4.93% (5.3102 => 5.5722, std.dev.: 0.0323) SingleSource/Benchmarks/Shootout/hash: 4.41% (4.9540 => 5.1726, std.dev.: 0.0427) MultiSource/Applications/JM/lencod/lencod: 3.65% (7.8019 => 8.0863, std.dev.: 0.0987) SingleSource/Benchmarks/Shootout-C++/lists1: 2.12% (0.6237 => 0.6369, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.43% (87.3221 => 88.5684, std.dev.: 0.3783) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.40% (4.0950 => 4.1525, std.dev.: 0.0077) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -14.49% (5.4017 => 4.6188, std.dev.: 0.3039) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -13.16% (0.4818 => 0.4184, std.dev.: 0.0242) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.37% (18.0009 => 17.0345, std.dev.: 0.3383) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.31% (69.0391 => 69.2500, std.dev.: 0.3710) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.07% (0.1339 => 0.1338, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -12.11% (0.0479 => 0.0421, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.31% (0.0649 => 0.0651, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 0.03% (494.0124 => 494.1484, std.dev.: 0.0760) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.50% (63.2438 => 69.2500, std.dev.: 0.3710) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0421, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43719.14% (1.1277 => 494.1484, std.dev.: 0.0760) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 195.58% (0.5229 => 1.5456, std.dev.: 0.0993) MultiSource/Applications/SPASS/SPASS: 18.81% (14.9895 => 17.8086, std.dev.: 0.3738) MultiSource/Applications/kimwitu++/kc: 47.67% (14.1553 => 20.9036, std.dev.: 0.5637) MultiSource/Benchmarks/MallocBench/gs/gs: 17.18% (4.1105 => 4.8167, std.dev.: 0.2481) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.26% (1.1048 => 1.5164, std.dev.: 0.0643) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 429.25% (7.1582 => 37.8845, std.dev.: 0.2673) SingleSource/Benchmarks/Misc-C++-EH/spirit: 93.67% (3.4629 => 6.7066, std.dev.: 0.1444) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.62% (0.6222 => 1.0305, std.dev.: 0.0367) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11130.97% (0.0720 => 8.0863, std.dev.: 0.0987) MultiSource/Applications/SIBsim4/SIBsim4: 3859900.00% (0.0001 => 3.8600, std.dev.: 0.0323) MultiSource/Applications/SPASS/SPASS: 14393900.00% (0.0001 => 14.3940, std.dev.: 1.6428) MultiSource/Applications/kimwitu++/kc: 51700.00% (0.0001 => 0.0518, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14400.00% (0.0001 => 0.0145, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576700.00% (0.0001 => 0.5768, std.dev.: 0.0249) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10070000.00% (0.0001 => 10.0701, std.dev.: 0.0150) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5770900.00% (0.0001 => 5.7710, std.dev.: 0.8841) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1746.04% (1.1194 => 20.6646, std.dev.: 0.6414) MultiSource/Applications/ClamAV/clamscan: 65.69% (22.1758 => 36.7428, std.dev.: 0.4666) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.94% (7.0540 => 11.1409, std.dev.: 0.2145) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.19% (2.9384 => 4.6188, std.dev.: 0.3039) MultiSource/Applications/JM/lencod/lencod: 48.01% (21.9371 => 32.4692, std.dev.: 0.0739) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.72% (8.1363 => 11.9373, std.dev.: 0.2535) SingleSource/Benchmarks/Misc/flops: 44.90% (0.1432 => 0.2075, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/distray/distray: 44.89% (0.1056 => 0.1530, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/almabench: 38.08% (0.0730 => 0.1008, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/Oscar: 34.75% (0.0636 => 0.0857, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/15-trie/trie: 31.69% (0.0527 => 0.0694, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 30.81% (0.1175 => 0.1537, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/FloatMM: 29.43% (0.0401 => 0.0519, std.dev.: 0.0003) SingleSource/UnitTests/vla: 29.30% (0.0355 => 0.0459, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: 27.37% (0.1655 => 0.2108, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/matrix: 27.02% (0.0818 => 0.1039, std.dev.: 0.0034) SingleSource/Benchmarks/Stanford/Treesort: 27.01% (0.0411 => 0.0522, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/family/family: 26.95% (0.0397 => 0.0504, std.dev.: 0.0025) MultiSource/Applications/treecc/treecc: 26.95% (2.0273 => 2.5737, std.dev.: 0.0138) SingleSource/Benchmarks/Stanford/Towers: 26.33% (0.0471 => 0.0595, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 26.30% (0.0479 => 0.0605, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 26.26% (0.3423 => 0.4322, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/wordfreq: 26.25% (0.3307 => 0.4175, std.dev.: 0.0025) SingleSource/Benchmarks/Stanford/IntMM: 26.14% (0.0394 => 0.0497, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 25.16% (0.5020 => 0.6283, std.dev.: 0.0048) MultiSource/Applications/Burg/burg: 25.08% (1.1642 => 1.4562, std.dev.: 0.0181) MultiSource/Benchmarks/Olden/bisort/bisort: 25.08% (0.0614 => 0.0768, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 24.40% (0.0672 => 0.0836, std.dev.: 0.0026) SingleSource/Benchmarks/Stanford/Queens: 24.15% (0.0414 => 0.0514, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 24.07% (0.1695 => 0.2103, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists1: 23.83% (0.3684 => 0.4562, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.46% (0.0746 => 0.0921, std.dev.: 0.0037) MultiSource/Applications/viterbi/viterbi: 23.41% (0.1555 => 0.1919, std.dev.: 0.0028) MultiSource/Applications/aha/aha: 23.02% (0.1151 => 0.1416, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/matrix: 22.95% (0.3098 => 0.3809, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 22.92% (0.0528 => 0.0649, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 22.88% (0.2871 => 0.3528, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/wc: 22.71% (0.3052 => 0.3745, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/Large/ray: 22.66% (0.4064 => 0.4985, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/sumcol: 22.52% (0.2891 => 0.3542, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 22.42% (0.3162 => 0.3871, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/exptree: 22.36% (0.0814 => 0.0996, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/fibo: 22.20% (0.2725 => 0.3330, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 21.63% (0.0467 => 0.0568, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/health/health: 21.61% (0.1268 => 0.1542, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 21.42% (0.4103 => 0.4982, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C++/life/life: 21.33% (0.0933 => 0.1132, std.dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 21.33% (1.2842 => 1.5581, std.dev.: 0.0136) SingleSource/Benchmarks/Misc/whetstone: 21.21% (0.0660 => 0.0800, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.20% (0.1566 => 0.1898, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/methcall: 20.75% (0.2877 => 0.3474, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 20.71% (0.3650 => 0.4406, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.69% (0.3441 => 0.4153, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.65% (0.2107 => 0.2542, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.39% (0.0770 => 0.0927, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.20% (0.1584 => 0.1904, std.dev.: 0.0113) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.19% (0.3121 => 0.3751, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/bh/bh: 19.83% (0.3092 => 0.3705, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 19.72% (0.4289 => 0.5135, std.dev.: 0.0218) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.59% (0.2271 => 0.2716, std.dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 19.55% (1.1840 => 1.4155, std.dev.: 0.0357) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.44% (0.4615 => 0.5512, std.dev.: 0.0173) MultiSource/Applications/sqlite3/sqlite3: 19.02% (17.1811 => 20.4495, std.dev.: 0.1866) SingleSource/Benchmarks/McGill/misr: 18.80% (0.0633 => 0.0752, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.57% (14.3668 => 17.0345, std.dev.: 0.3383) SingleSource/Benchmarks/Shootout-C++/moments: 18.40% (0.4048 => 0.4793, std.dev.: 0.0155) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.37% (0.2700 => 0.3196, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/lists: 18.23% (0.3422 => 0.4046, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.22% (0.1125 => 0.1330, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 18.06% (0.2603 => 0.3073, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.90% (1.4186 => 1.6725, std.dev.: 0.0429) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 17.66% (3.8922 => 4.5794, std.dev.: 0.1871) SingleSource/UnitTests/ObjC/property: 17.50% (0.3886 => 0.4566, std.dev.: 0.0120) SingleSource/UnitTests/ObjC/synchronized: 17.47% (0.3561 => 0.4183, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.46% (0.0842 => 0.0989, std.dev.: 0.0051) MultiSource/Applications/oggenc/oggenc: 17.20% (5.7591 => 6.7494, std.dev.: 0.2637) SingleSource/Benchmarks/Misc/fbench: 17.06% (0.0592 => 0.0693, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/trivial-interface: 16.87% (0.3473 => 0.4059, std.dev.: 0.0148) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.52% (0.8172 => 0.9522, std.dev.: 0.0391) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.40% (0.2793 => 0.3251, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/mst/mst: 16.34% (0.1163 => 0.1353, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/neural/neural: 16.20% (0.1463 => 0.1700, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: 16.13% (0.0626 => 0.0727, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.88% (4.9449 => 5.7303, std.dev.: 0.1669) MultiSource/Applications/lua/lua: 15.82% (3.8723 => 4.4850, std.dev.: 0.1997) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.70% (0.3427 => 0.3965, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.50% (0.2065 => 0.2385, std.dev.: 0.0114) MultiSource/Benchmarks/NPB-serial/is/is: 15.44% (0.0719 => 0.0830, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.43% (0.0648 => 0.0748, std.dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.42% (0.0953 => 0.1100, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.33% (4.2646 => 4.9182, std.dev.: 0.1690) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.32% (0.0770 => 0.0888, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 15.27% (0.2430 => 0.2801, std.dev.: 0.0055) SingleSource/UnitTests/ObjC++/Hello: 15.11% (0.5925 => 0.6820, std.dev.: 0.0105) SingleSource/UnitTests/ObjC/parameter-passing: 15.05% (0.3927 => 0.4518, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/oourafft: 14.72% (0.3282 => 0.3765, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.41% (0.1117 => 0.1278, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Puzzle: 14.35% (0.1268 => 0.1450, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.32% (0.2758 => 0.3153, std.dev.: 0.0147) MultiSource/Benchmarks/McCat/09-vor/vor: 14.12% (0.3180 => 0.3629, std.dev.: 0.0162) MultiSource/Benchmarks/mafft/pairlocalalign: 14.10% (9.4845 => 10.8215, std.dev.: 0.4090) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.86% (0.5981 => 0.6810, std.dev.: 0.0278) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.84% (0.1337 => 0.1522, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.61% (0.1029 => 0.1169, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.47% (0.1062 => 0.1205, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.36% (0.9765 => 1.1070, std.dev.: 0.0444) MultiSource/Applications/hbd/hbd: 13.33% (1.5603 => 1.7683, std.dev.: 0.0742) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.18% (0.1510 => 0.1709, std.dev.: 0.0075) SingleSource/UnitTests/ObjC/exceptions-4: 12.25% (0.3543 => 0.3977, std.dev.: 0.0152) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.25% (0.3543 => 0.3977, std.dev.: 0.0149) SingleSource/UnitTests/ObjC/exceptions-2: 12.21% (0.3497 => 0.3924, std.dev.: 0.0156) SingleSource/UnitTests/ObjC/exceptions-3: 12.06% (0.3516 => 0.3940, std.dev.: 0.0159) SingleSource/UnitTests/ObjC/exceptions: 11.91% (0.3828 => 0.4284, std.dev.: 0.0176) MultiSource/Benchmarks/PAQ8p/paq8p: 11.70% (10.3673 => 11.5798, std.dev.: 0.1838) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.28% (0.1906 => 0.2121, std.dev.: 0.0075) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.82% (0.3177 => 0.3489, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hello: 9.17% (0.2714 => 0.2963, std.dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.21% (4.3953 => 10.9973, std.dev.: 0.0232) SingleSource/Benchmarks/Shootout-C++/methcall: 147.44% (5.3999 => 13.3615, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/09-vor/vor: 28.68% (0.1154 => 0.1485, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary3: 23.62% (3.7221 => 4.6013, std.dev.: 0.2180) SingleSource/Benchmarks/Misc/oourafft: 17.43% (6.6465 => 7.8052, std.dev.: 0.0093) SingleSource/Benchmarks/CoyoteBench/lpbench: 17.38% (10.3460 => 12.1438, std.dev.: 0.2462) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.66% (1.1145 => 1.3002, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/tsp/tsp: 14.52% (1.0785 => 1.2351, std.dev.: 0.0175) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.32% (0.2944 => 0.3336, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/bisort/bisort: 12.12% (0.8333 => 0.9343, std.dev.: 0.0362) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.64% (2.8904 => 3.2267, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: 10.27% (1.1396 => 1.2566, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 10.06% (0.1421 => 0.1564, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.42% (1.7254 => 1.8879, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 7.62% (1.9405 => 2.0884, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.99% (4.2280 => 4.4813, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: 5.37% (4.9088 => 5.1726, std.dev.: 0.0427) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.41% (26.0924 => 27.2443, std.dev.: 0.2389) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6436 => 12.1152, std.dev.: 0.0192) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.32% (0.4162 => 0.4300, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.21% (0.6171 => 0.6369, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: 2.17% (2.4116 => 2.4640, std.dev.: 0.0121) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 2.04% (3.1595 => 3.2240, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: 2.03% (85.0658 => 86.7901, std.dev.: 0.1177) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.83% (2.1424 => 2.1815, std.dev.: 0.0131) MultiSource/Benchmarks/Olden/em3d/em3d: 1.81% (3.1023 => 3.1584, std.dev.: 0.0207) SingleSource/Benchmarks/Misc/fbench: 1.61% (2.2771 => 2.3137, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 1.48% (27.8444 => 28.2559, std.dev.: 0.0442) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.30% (1.0313 => 1.0447, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.29% (6.5088 => 6.5930, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout/sieve: 1.29% (5.2139 => 5.2811, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0500, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: 1.13% (1.9577 => 1.9799, std.dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1671, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.94% (5.2763 => 1.2694, std.dev.: 0.0311) SingleSource/Benchmarks/Misc/salsa20: -75.70% (0.8651 => 0.2102, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/richards_benchmark: -45.13% (0.1622 => 0.0890, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.53% (5.3526 => 4.6819, std.dev.: 0.1502) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.82% (5.3855 => 4.7489, std.dev.: 0.1296) MultiSource/Applications/JM/ldecod/ldecod: -8.79% (10.4361 => 9.5192, std.dev.: 0.0643) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.20% (0.0628 => 0.0363, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.33% (0.3987 => 0.2379, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.26% (4.5009 => 2.7790, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: -33.53% (1.1492 => 0.7639, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.16% (2.6546 => 2.0133, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/mason/mason: -19.20% (0.2161 => 0.1746, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.52% (1.6925 => 1.4298, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.72% (2.6778 => 2.2837, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.83% (32.5116 => 28.9914, std.dev.: 0.0390) SingleSource/Benchmarks/Misc/mandel-2: -10.62% (1.5373 => 1.3741, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -10.32% (9.5636 => 8.5765, std.dev.: 0.2531) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4245, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.2416 => 3.0210, std.dev.: 0.0278) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5758, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -5.06% (1.5835 => 1.5034, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.62% (1.6805 => 1.6028, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout/lists: -4.25% (6.2999 => 6.0320, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.36% (0.9957 => 0.9622, std.dev.: 0.0058) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8917, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.25% (0.4808 => 0.4700, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.84% (8.1563 => 8.0065, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6773) SingleSource/Benchmarks/Misc/salsa20: -1.47% (10.2830 => 10.1323, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0016) Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 14:28:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 16:28:17 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121123222817.6CF412A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6184?compare_to=6181&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6184, Order: 168525, Start Time: 2012-11-23 20:55:19, End Time: 2012-11-23 22:28:46 To: 6181, Order: 168522, Start Time: 2012-11-23 18:58:23, End Time: 2012-11-23 20:32:16 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (177 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (860 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.10% (0.3834 => 0.4413, std.dev.: 0.0107) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.76% (7.4937 => 7.7002, std.dev.: 0.0129) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.64% (2.0478 => 2.1018, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 2.27% (3.1932 => 3.2656, std.dev.: 0.0094) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.60% (0.1431 => 0.1308, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.85% (0.3821 => 0.3521, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.68% (0.3142 => 0.2932, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: -6.55% (0.3357 => 0.3137, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.40% (0.9542 => 0.8931, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -6.35% (2.4924 => 2.3341, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.11% (0.6484 => 0.6088, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.10% (0.2428 => 0.2280, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.06% (0.7198 => 0.6762, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -6.04% (9.2283 => 8.6710, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-2: -5.95% (0.3831 => 0.3603, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.95% (0.3884 => 0.3653, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.94% (0.9852 => 0.9267, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -5.93% (0.3812 => 0.3586, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.93% (0.3880 => 0.3650, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -5.93% (0.3848 => 0.3620, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -5.90% (0.3896 => 0.3666, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -5.90% (7.0961 => 6.6776, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.88% (0.3658 => 0.3443, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -5.84% (16.1920 => 15.2468, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.83% (1.0544 => 0.9929, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.83% (0.5591 => 0.5265, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.83% (1.3722 => 1.2922, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.82% (0.5863 => 0.5522, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: -5.80% (0.4033 => 0.3799, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.79% (0.1796 => 0.1692, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -5.75% (0.1879 => 0.1771, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: -5.75% (0.4176 => 0.3936, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -5.74% (0.9179 => 0.8652, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.74% (0.5805 => 0.5472, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.73% (0.2355 => 0.2220, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.71% (0.5705 => 0.5379, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.71% (0.5478 => 0.5165, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.71% (4.0323 => 3.8020, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.71% (0.5849 => 0.5515, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.71% (0.3891 => 0.3669, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.70% (4.8161 => 4.5414, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.65% (1.6364 => 1.5439, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.65% (0.6230 => 0.5878, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.64% (0.5925 => 0.5591, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.63% (0.5857 => 0.5527, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.62% (0.6297 => 0.5943, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.62% (0.5802 => 0.5476, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.61% (0.6667 => 0.6293, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.61% (3.5339 => 3.3358, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.59% (1.2300 => 1.1612, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.58% (0.6304 => 0.5952, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.58% (0.5570 => 0.5259, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.57% (0.2695 => 0.2545, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.55% (0.6194 => 0.5850, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.55% (0.5456 => 0.5153, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -5.55% (4.3330 => 4.0924, std.dev.: 0.0078) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.53% (6.7716 => 6.3968, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.53% (4.8802 => 4.6102, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.53% (0.7919 => 0.7481, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.53% (0.5859 => 0.5535, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.53% (0.6260 => 0.5914, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.52% (0.6052 => 0.5718, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.51% (0.6446 => 0.6091, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.51% (0.5575 => 0.5268, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -5.49% (1.1450 => 1.0821, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.48% (0.5581 => 0.5275, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/property: -5.43% (0.4199 => 0.3971, std.dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: -5.43% (1.1530 => 1.0904, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.42% (1.4642 => 1.3848, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.42% (0.6660 => 0.6299, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.42% (4.5069 => 4.2628, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.41% (0.6189 => 0.5854, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.40% (0.6681 => 0.6320, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.37% (0.6736 => 0.6374, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.36% (0.3057 => 0.2893, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: -5.36% (0.2871 => 0.2717, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -5.36% (0.4515 => 0.4273, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.35% (1.2784 => 1.2100, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.34% (0.5941 => 0.5624, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -5.33% (0.2985 => 0.2826, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.31% (0.3016 => 0.2856, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.30% (0.5999 => 0.5681, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.28% (0.6440 => 0.6100, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.27% (0.8521 => 0.8072, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.25% (0.6033 => 0.5716, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.25% (0.3255 => 0.3084, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.24% (0.6676 => 0.6326, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.24% (0.3323 => 0.3149, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -5.23% (17.1032 => 16.2084, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.23% (0.6293 => 0.5964, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.20% (0.4151 => 0.3935, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -5.20% (1.2515 => 1.1864, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.20% (0.2903 => 0.2752, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -5.20% (0.3406 => 0.3229, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -5.19% (0.4280 => 0.4058, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.19% (0.5688 => 0.5393, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.19% (0.3837 => 0.3638, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -5.19% (0.2989 => 0.2834, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.18% (0.2548 => 0.2416, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.18% (0.2278 => 0.2160, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.17% (1.2210 => 1.1579, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.16% (14.2083 => 13.4753, std.dev.: 0.0069) MultiSource/Applications/SIBsim4/SIBsim4: -5.16% (1.3864 => 1.3149, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.15% (0.4916 => 0.4663, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.14% (0.3483 => 0.3304, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: -5.14% (0.3581 => 0.3397, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.14% (0.2999 => 0.2845, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.13% (8.0126 => 7.6017, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/except: -5.12% (0.3026 => 0.2871, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -5.12% (0.3205 => 0.3041, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.11% (0.2659 => 0.2523, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.11% (2.1713 => 2.0603, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: -5.11% (0.3446 => 0.3270, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.07% (0.3849 => 0.3654, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.07% (1.3148 => 1.2482, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.07% (1.2221 => 1.1602, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: -5.06% (15.5079 => 14.7227, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/objinst: -5.04% (0.3194 => 0.3033, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.01% (0.2933 => 0.2786, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -5.01% (0.3394 => 0.3224, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.00% (0.2939 => 0.2792, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.00% (0.4321 => 0.4105, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -4.97% (4.0594 => 3.8575, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/moments: -4.97% (0.4248 => 0.4037, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.96% (0.3931 => 0.3736, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -4.91% (0.3481 => 0.3310, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.91% (0.7339 => 0.6979, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -4.89% (0.3025 => 0.2877, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: -4.88% (3.5154 => 3.3437, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: -4.88% (0.2849 => 0.2710, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.86% (0.7524 => 0.7158, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.85% (0.6395 => 0.6085, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.84% (0.5168 => 0.4918, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -4.83% (15.2527 => 14.5155, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists: -4.83% (0.3621 => 0.3446, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.82% (0.2385 => 0.2270, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.80% (0.3252 => 0.3096, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -4.79% (0.4861 => 0.4628, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.79% (0.3319 => 0.3160, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/lists1: -4.78% (0.3867 => 0.3682, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.78% (22.4056 => 21.3347, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.78% (0.4083 => 0.3888, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.77% (0.3059 => 0.2913, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.77% (1.6474 => 1.5689, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -4.75% (0.7447 => 0.7093, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -4.70% (2.4021 => 2.2891, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.65% (0.5567 => 0.5308, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.63% (0.4427 => 0.4222, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.61% (0.4813 => 0.4591, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -4.61% (0.7982 => 0.7614, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.60% (0.5569 => 0.5313, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -4.56% (2.1401 => 2.0425, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.53% (0.9557 => 0.9124, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -4.52% (0.6347 => 0.6060, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.52% (0.6395 => 0.6106, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: -4.51% (0.7779 => 0.7428, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.47% (0.7021 => 0.6707, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -4.46% (0.3271 => 0.3125, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.42% (0.6441 => 0.6156, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -4.41% (34.0927 => 32.5906, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/sieve: -4.38% (0.3788 => 0.3622, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -4.37% (0.8418 => 0.8050, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: -4.37% (5.0226 => 4.8033, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.35% (0.5329 => 0.5097, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: -4.32% (18.2933 => 17.5023, std.dev.: 0.0232) SingleSource/Benchmarks/Misc-C++/bigfib: -4.30% (0.6750 => 0.6460, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -4.13% (0.4524 => 0.4337, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.13% (0.9077 => 0.8702, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.10% (2.2587 => 2.1660, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: -3.82% (1.5610 => 1.5014, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.38% (5.4682 => 5.2836, std.dev.: 0.0148) SingleSource/UnitTests/Vector/constpool: -2.30% (20.7746 => 20.2972, std.dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7567, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: -8.76% (1.2842 => 1.1717, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.74% (2.2633 => 2.1787, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.28% (1.0557 => 1.0211, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4707, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 15:02:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 17:02:57 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121123230257.F1D3A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6185?compare_to=6178&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6185, Order: 168524, Start Time: 2012-11-23 19:42:13, End Time: 2012-11-23 23:03:23 To: 6178, Order: 168515, Start Time: 2012-11-23 15:33:12, End Time: 2012-11-23 18:54:11 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (173 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1091 (717 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.13% (54.0598 => 54.6710, std.dev.: 0.1248) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.40% (0.0625 => 0.0890, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.83% (0.1063 => 0.1412, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.61% (0.2969 => 0.3759, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.77% (0.1106 => 0.1391, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.18% (0.4253 => 0.5324, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 25.04% (1.5932 => 1.9922, std.dev.: 0.0138) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.93% (0.4139 => 0.5171, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.79% (0.0475 => 0.0588, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.73% (0.4994 => 0.6179, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.72% (0.5000 => 0.6186, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.63% (0.5900 => 0.7294, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.58% (0.0547 => 0.0676, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.46% (0.0584 => 0.0721, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.15% (0.1620 => 0.1995, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.97% (0.0714 => 0.0878, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.43% (0.1021 => 0.1250, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.19% (0.0897 => 0.1096, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.13% (0.1107 => 0.1352, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 22.04% (0.0599 => 0.0731, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.69% (0.1549 => 0.1885, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.34% (0.0642 => 0.0779, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.17% (0.0633 => 0.0767) MultiSource/Benchmarks/Olden/em3d/em3d: 20.99% (0.0948 => 0.1147, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.89% (0.0584 => 0.0706, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.76% (0.1103 => 0.1332, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.61% (0.0495 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 20.46% (0.0821 => 0.0989, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.45% (0.3903 => 0.4701, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.24% (0.1003 => 0.1206, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.19% (0.0822 => 0.0988, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 19.95% (0.1619 => 0.1942, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.95% (0.1604 => 0.1924, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 19.22% (0.0947 => 0.1129, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.15% (0.1462 => 0.1742, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.92% (0.3890 => 0.4626, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 18.81% (0.0808 => 0.0960, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.62% (0.2014 => 0.2389, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 18.31% (0.1218 => 0.1441, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.27% (0.2736 => 0.3236, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 18.14% (0.5826 => 0.6883, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 18.05% (0.0698 => 0.0824, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 18.04% (0.4029 => 0.4756, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: 17.93% (0.5889 => 0.6945, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.92% (0.1088 => 0.1283, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.85% (1.3152 => 1.5500, std.dev.: 0.0120) MultiSource/Benchmarks/McCat/09-vor/vor: 17.81% (0.1505 => 0.1773, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.66% (0.0572 => 0.0673, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.59% (0.2866 => 0.3370, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: 17.38% (0.5546 => 0.6510, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.23% (0.5026 => 0.5892, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 17.22% (1.8794 => 2.2031, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.19% (3.5627 => 4.1750, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.17% (0.1968 => 0.2306, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.05% (0.4658 => 0.5452, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.02% (1.6211 => 1.8970, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.88% (0.3271 => 0.3823, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.72% (0.1160 => 0.1354, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 16.69% (0.0605 => 0.0706, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.59% (0.2875 => 0.3352, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.41% (0.3930 => 0.4575, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 16.36% (1.0781 => 1.2545, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.35% (0.4361 => 0.5074, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 16.27% (0.7171 => 0.8338, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 16.26% (0.1421 => 0.1652, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.20% (2.7292 => 3.1713, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 16.14% (4.2109 => 4.8904, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.13% (4.4195 => 5.1324, std.dev.: 0.0036) MultiSource/Applications/hbd/hbd: 16.13% (0.9697 => 1.1261, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 16.12% (0.2823 => 0.3278, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 16.10% (0.2813 => 0.3266, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 16.07% (0.2750 => 0.3192, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 15.98% (0.9909 => 1.1492, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.96% (0.3195 => 0.3705, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 15.88% (0.2714 => 0.3145, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.85% (0.2738 => 0.3172, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.84% (0.2911 => 0.3372, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 15.83% (0.2780 => 0.3220, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 15.82% (0.2725 => 0.3156, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.81% (1.9966 => 2.3123, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: 15.81% (0.1284 => 0.1487, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 15.76% (0.2811 => 0.3254, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.76% (0.2729 => 0.3159, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/random: 15.66% (0.2803 => 0.3242, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.63% (1.9694 => 2.2773, std.dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: 15.61% (0.3004 => 0.3473, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.59% (0.3060 => 0.3537, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.58% (0.2792 => 0.3227, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.41% (2.0673 => 2.3858, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: 15.40% (0.3267 => 0.3770, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 15.37% (0.3096 => 0.3572, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 15.20% (23.5202 => 27.0964, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/ary2: 15.19% (0.3317 => 0.3821, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 15.16% (0.3258 => 0.3752, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.14% (0.1090 => 0.1255, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.08% (0.3488 => 0.4014, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.81% (0.3362 => 0.3860, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 14.70% (0.2075 => 0.2380, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 14.55% (0.3678 => 0.4213, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 14.54% (0.3446 => 0.3947, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.52% (0.3465 => 0.3968, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 14.49% (0.3348 => 0.3833, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 14.46% (0.2566 => 0.2937, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 14.45% (0.3496 => 0.4001, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.42% (0.3460 => 0.3959, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.34% (0.3124 => 0.3572, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 14.33% (0.3469 => 0.3966, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 14.30% (0.4146 => 0.4739, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 14.29% (0.3442 => 0.3934, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 14.29% (1.4269 => 1.6308, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.23% (0.3282 => 0.3749, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.21% (0.3625 => 0.4140, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 14.12% (0.3477 => 0.3968, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 14.04% (0.3726 => 0.4249, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 13.97% (0.3650 => 0.4160, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions: 13.94% (0.3643 => 0.4151, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 13.80% (0.7875 => 0.8962, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.77% (0.3690 => 0.4198, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/parameter-passing: 13.69% (0.3724 => 0.4234, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 13.62% (0.4251 => 0.4830, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.54% (0.3981 => 0.4520, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 13.46% (0.0758 => 0.0860, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.42% (0.3845 => 0.4361, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 13.30% (2.1653 => 2.4533, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 13.14% (4.6177 => 5.2243, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: 13.09% (0.5012 => 0.5668, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 13.05% (2.1013 => 2.3755, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 12.52% (0.2691 => 0.3028, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.26% (0.6435 => 0.7224, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.22% (0.1383 => 0.1552, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.11% (0.2040 => 0.2287, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 12.10% (5.5417 => 6.2121, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.67% (0.1028 => 0.1148, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.12% (0.2068 => 0.2298, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.09% (0.3498 => 0.3886, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.06% (0.3084 => 0.3425, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.03% (0.2737 => 0.3039, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.99% (0.6634 => 0.7363, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 10.87% (0.4847 => 0.5374, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 10.40% (0.3336 => 0.3683, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.22% (0.2103 => 0.2318, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 9.95% (2.0346 => 2.2370, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 9.79% (0.2391 => 0.2625, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.12% (4.6926 => 5.1204, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.93% (0.5361 => 0.5840, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.73% (11.6398 => 12.6559, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.42% (0.5584 => 0.6054, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.20% (0.7426 => 0.8035, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 7.15% (11.9555 => 12.8108, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.96% (0.3792 => 0.3980, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 8.89% (0.2802 => 0.3051, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6123, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6693, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-2: 4.76% (1.8057 => 1.8916, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.74% (0.3693 => 0.3868, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1661, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: 4.10% (14.0481 => 14.6238, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1980, std.dev.: 0.0052) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.70% (3.1722 => 3.2262, std.dev.: 0.0020) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3054, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2891, std.dev.: 0.0035) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5152, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5829, std.dev.: 0.0136) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.69% (2.4764 => 2.3849, std.dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.75% (25.4195 => 16.5868, std.dev.: 0.0101) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9748, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7991, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/tsp/tsp: -7.20% (2.1113 => 1.9592, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -5.66% (0.2402 => 0.2266, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.67% (11.2080 => 10.7965, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std.dev.: 0.0019) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7724, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: -2.55% (17.2379 => 16.7990, std.dev.: 0.0348) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.27% (41.7953 => 40.8476, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.68% (10.7630 => 10.5822, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4953, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0471, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.02% (105.3826 => 104.3076, std.dev.: 0.0123) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 17:36:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 19:36:50 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121124013650.197022A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6186?compare_to=6183&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6186, Order: 168525, Start Time: 2012-11-23 23:16:57, End Time: 2012-11-24 01:37:16 To: 6183, Order: 168524, Start Time: 2012-11-23 20:06:27, End Time: 2012-11-23 22:26:17 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 86 (189 on baseline) Performance Improvements: 3 (39 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 997 (657 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/objects/objects: 16.35% (0.1156 => 0.1345, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 16.14% (0.1636 => 0.1900, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/17-bintr/bintr: 14.45% (0.0782 => 0.0895, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 14.03% (0.6852 => 0.7813, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 13.93% (0.0890 => 0.1014, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.52% (0.6405 => 0.7271, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 13.28% (0.6207 => 0.7031, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.27% (0.6150 => 0.6966, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.18% (0.5787 => 0.6550, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 12.70% (0.0945 => 0.1065, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 12.65% (0.1162 => 0.1309, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.60% (0.7542 => 0.8492, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/random: 12.46% (0.3049 => 0.3429, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 12.42% (0.7832 => 0.8805, std.dev.: 0.0192) MultiSource/Benchmarks/Prolangs-C++/office/office: 12.38% (0.3392 => 0.3812, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.06% (0.1891 => 0.2119, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 11.88% (0.5883 => 0.6582, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.69% (0.4184 => 0.4673, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.46% (0.5141 => 0.5730, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.02% (0.4327 => 0.4804, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.88% (0.3015 => 0.3343, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.76% (0.3196 => 0.3540, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sieve: 10.73% (0.3998 => 0.4427, std.dev.: 0.0022) SingleSource/Benchmarks/LivermoreLoops/kernel18: 10.48% (0.1479 => 0.1634, std.dev.: 0.0034) SingleSource/Benchmarks/LivermoreLoops/kernel13: 10.33% (0.1084 => 0.1196, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 10.07% (0.8910 => 0.9807, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.05% (0.1522 => 0.1675, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 9.99% (0.3352 => 0.3687, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/distray/distray: 9.48% (0.1530 => 0.1675, std.dev.: 0.0020) SingleSource/Benchmarks/LivermoreLoops/kernel15: 9.40% (0.1181 => 0.1292, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/05-eks/eks: 9.35% (0.4769 => 0.5215, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/ary: 9.24% (0.3539 => 0.3866, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.86% (0.6589 => 0.7173, std.dev.: 0.0169) MultiSource/Applications/hbd/hbd: 8.79% (1.7683 => 1.9238, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/09-vor/vor: 8.65% (0.3629 => 0.3943, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.60% (1.1070 => 1.2022, std.dev.: 0.0204) SingleSource/UnitTests/ObjC++/property-reference: 8.20% (0.8040 => 0.8699, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.08% (0.1671 => 0.1806, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 7.85% (10.8215 => 11.6710, std.dev.: 0.0655) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.78% (2.3200 => 2.5006, std.dev.: 0.0225) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.64% (0.5027 => 0.5411, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.51% (0.2198 => 0.2363, std.dev.: 0.0021) MultiSource/Applications/SIBsim4/SIBsim4: 7.38% (1.5456 => 1.6596, std.dev.: 0.0355) SingleSource/Benchmarks/Shootout-C++/ary3: 7.01% (0.3596 => 0.3848, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.99% (0.4690 => 0.5018, std.dev.: 0.0112) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.97% (0.9067 => 0.9699, std.dev.: 0.0079) SingleSource/UnitTests/ObjC++/property-reference-object: 6.85% (0.6654 => 0.7110, std.dev.: 0.0147) MultiSource/Applications/lua/lua: 6.46% (4.4850 => 4.7749, std.dev.: 0.0943) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.42% (1.3093 => 1.3933, std.dev.: 0.0294) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.06% (7.9424 => 8.4234, std.dev.: 0.1328) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.28% (4.7489 => 4.9996, std.dev.: 0.0253) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.00% (0.6417 => 0.6738, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.88% (0.6273 => 0.6579, std.dev.: 0.0040) MultiSource/Applications/oggenc/oggenc: 4.85% (6.7494 => 7.0767, std.dev.: 0.0920) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.75% (0.7196 => 0.7538, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.44% (4.6819 => 4.8900, std.dev.: 0.0654) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.37% (0.3751 => 0.3915, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.34% (0.5512 => 0.5751, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/trivial-interface: 4.31% (0.4059 => 0.4234, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.31% (11.9373 => 12.4513, std.dev.: 0.0851) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.04% (0.3073 => 0.3197, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.39% (1.2694 => 1.3124, std.dev.: 0.0165) SingleSource/UnitTests/Vector/constpool: 2.84% (55.2267 => 56.7974, std.dev.: 0.3362) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.52% (0.4406 => 0.4517, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: 120.06% (0.1047 => 0.2304, std.dev.: 0.0208) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.94% (0.3425 => 0.4382, std.dev.: 0.0210) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.67% (1.5568 => 1.9720, std.dev.: 0.0256) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 19.83% (0.0842 => 0.1009, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.63% (5.7710 => 6.9038, std.dev.: 0.3976) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 18.09% (1.3471 => 1.5908, std.dev.: 0.0562) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.32% (2.1031 => 2.4464, std.dev.: 0.0450) SingleSource/Benchmarks/BenchmarkGame/puzzle: 11.79% (0.6944 => 0.7763, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/heapsort: 11.40% (3.9281 => 4.3759, std.dev.: 0.1001) SingleSource/Benchmarks/Misc/ffbench: 8.03% (0.9936 => 1.0734, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 7.30% (0.4107 => 0.4407, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.06% (0.3142 => 0.3301, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.96% (0.3336 => 0.3468, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 3.64% (0.5028 => 0.5211, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.7122 => 3.8286, std.dev.: 0.0264) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.92% (4.2297 => 4.3532, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/lists: 2.26% (12.5438 => 12.8273, std.dev.: 0.0173) MultiSource/Applications/JM/lencod/lencod: 2.17% (8.0863 => 8.2620, std.dev.: 0.0387) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.91% (7.2817 => 7.4211, std.dev.: 0.0053) MultiSource/Applications/lua/lua: 1.67% (27.2443 => 27.6990, std.dev.: 0.0872) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.39% (61.1350 => 61.9861, std.dev.: 0.2732) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.01% (5.6710 => 5.7285, std.dev.: 0.0193) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: -11.37% (0.3809 => 0.3376, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/except: -7.68% (0.3528 => 0.3257, std.dev.: 0.0100) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/lists1: -2.73% (0.6369 => 0.6195, std.dev.: 0.0051) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.14% (69.2500 => 69.1515, std.dev.: 0.2342) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 1.12% (0.1338 => 0.1353, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0421 => 0.0422, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.31% (0.0651 => 0.0653, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 0.00% (494.1484 => 494.1514, std.dev.: 0.0707) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.34% (63.2438 => 69.1515, std.dev.: 0.2342) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0422, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43719.40% (1.1277 => 494.1514, std.dev.: 0.0707) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 217.38% (0.5229 => 1.6596, std.dev.: 0.0355) MultiSource/Applications/SPASS/SPASS: 15.32% (14.9895 => 17.2854, std.dev.: 0.3438) MultiSource/Applications/kimwitu++/kc: 47.14% (14.1553 => 20.8285, std.dev.: 0.4210) MultiSource/Benchmarks/MallocBench/gs/gs: 15.63% (4.1105 => 4.7531, std.dev.: 0.1739) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.58% (1.1048 => 1.5089, std.dev.: 0.0485) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 426.65% (7.1582 => 37.6984, std.dev.: 0.2923) SingleSource/Benchmarks/Misc-C++-EH/spirit: 74.97% (3.4629 => 6.0592, std.dev.: 0.3718) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.35% (0.6222 => 1.0288, std.dev.: 0.0693) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11375.00% (0.0720 => 8.2620, std.dev.: 0.0387) MultiSource/Applications/SIBsim4/SIBsim4: 3862600.00% (0.0001 => 3.8627, std.dev.: 0.0286) MultiSource/Applications/SPASS/SPASS: 12362500.00% (0.0001 => 12.3626, std.dev.: 2.0593) MultiSource/Applications/kimwitu++/kc: 51500.00% (0.0001 => 0.0516, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576400.00% (0.0001 => 0.5765, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10078500.00% (0.0001 => 10.0786, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6903700.00% (0.0001 => 6.9038, std.dev.: 0.3976) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1791.55% (1.1194 => 21.1740, std.dev.: 0.4787) MultiSource/Applications/ClamAV/clamscan: 65.77% (22.1758 => 36.7610, std.dev.: 0.3048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 59.60% (7.0540 => 11.2579, std.dev.: 0.1822) MultiSource/Benchmarks/FreeBench/distray/distray: 58.62% (0.1056 => 0.1675, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.67% (2.9384 => 4.6037, std.dev.: 0.2707) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 53.03% (8.1363 => 12.4513, std.dev.: 0.0851) MultiSource/Applications/JM/lencod/lencod: 48.29% (21.9371 => 32.5295, std.dev.: 0.1419) SingleSource/Benchmarks/CoyoteBench/almabench: 40.27% (0.0730 => 0.1024, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 38.27% (0.1432 => 0.1980, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 34.30% (0.0793 => 0.1065, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 33.51% (0.0746 => 0.0996, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/17-bintr/bintr: 32.59% (0.0675 => 0.0895, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 31.85% (0.0672 => 0.0886, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 31.82% (0.0528 => 0.0696, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/voronoi/voronoi: 31.11% (0.2700 => 0.3540, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/tsp/tsp: 30.04% (0.1175 => 0.1528, std.dev.: 0.0008) SingleSource/UnitTests/vla: 29.30% (0.0355 => 0.0459, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: 29.23% (0.0626 => 0.0809, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/15-trie/trie: 29.03% (0.0527 => 0.0680, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 28.34% (0.0614 => 0.0788, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.31% (0.5105 => 0.6550, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/dry: 28.07% (0.0456 => 0.0584, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 27.69% (0.4103 => 0.5239, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 27.67% (0.0842 => 0.1075, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/em3d/em3d: 27.49% (0.1695 => 0.2161, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/life/life: 27.33% (0.0933 => 0.1188, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.22% (0.6675 => 0.8492, std.dev.: 0.0092) MultiSource/Benchmarks/Olden/health/health: 27.05% (0.1268 => 0.1611, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 26.27% (0.0491 => 0.0620, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: 26.20% (0.0481 => 0.0607, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.03% (0.0730 => 0.0920, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.97% (0.1032 => 0.1300, std.dev.: 0.0052) MultiSource/Benchmarks/NPB-serial/is/is: 25.73% (0.0719 => 0.0904, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 25.65% (0.3423 => 0.4301, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: 25.44% (0.3121 => 0.3915, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 25.38% (0.1044 => 0.1309, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.28% (0.1337 => 0.1675, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/treeadd/treeadd: 25.24% (0.0416 => 0.0521, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/family/family: 25.19% (0.0397 => 0.0497, std.dev.: 0.0029) MultiSource/Applications/spiff/spiff: 25.17% (0.7835 => 0.9807, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 25.01% (0.1695 => 0.2119, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 24.96% (0.2107 => 0.2633, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/perimeter/perimeter: 24.94% (0.0770 => 0.0962, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 24.62% (0.4615 => 0.5751, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/reversefile: 24.29% (0.3865 => 0.4804, std.dev.: 0.0106) MultiSource/Applications/viterbi/viterbi: 24.24% (0.1555 => 0.1932, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/09-vor/vor: 23.99% (0.3180 => 0.3943, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 23.75% (0.3650 => 0.4517, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 23.60% (0.4636 => 0.5730, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 23.53% (0.0442 => 0.0546, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 23.31% (3.8723 => 4.7749, std.dev.: 0.0943) MultiSource/Applications/hbd/hbd: 23.30% (1.5603 => 1.9238, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 23.25% (0.0443 => 0.0546, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Oscar: 23.11% (0.0636 => 0.0783, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 23.11% (0.9765 => 1.2022, std.dev.: 0.0204) MultiSource/Benchmarks/mafft/pairlocalalign: 23.05% (9.4845 => 11.6710, std.dev.: 0.0655) MultiSource/Applications/oggenc/oggenc: 22.88% (5.7591 => 7.0767, std.dev.: 0.0920) SingleSource/Benchmarks/Shootout-C++/sieve: 22.87% (0.3603 => 0.4427, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 22.82% (0.2603 => 0.3197, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.77% (0.2271 => 0.2788, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.55% (0.1029 => 0.1261, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/random: 22.38% (0.2802 => 0.3429, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 22.14% (0.3826 => 0.4673, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/trivial-interface: 21.91% (0.3473 => 0.4234, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/mst/mst: 21.58% (0.1163 => 0.1414, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/office/office: 21.56% (0.3136 => 0.3812, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 21.50% (0.2554 => 0.3103, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout/matrix: 21.39% (0.0818 => 0.0993, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/05-eks/eks: 21.31% (0.4299 => 0.5215, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/ackermann: 21.30% (0.2756 => 0.3343, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 21.16% (17.1811 => 20.8162, std.dev.: 0.1515) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.14% (0.1566 => 0.1897, std.dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/functionobjects: 20.82% (0.5020 => 0.6065, std.dev.: 0.0118) MultiSource/Benchmarks/Olden/bh/bh: 20.80% (0.3092 => 0.3735, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: 20.78% (0.1463 => 0.1767, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 20.74% (0.1114 => 0.1345, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 20.55% (1.2842 => 1.5481, std.dev.: 0.0245) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.14% (0.1584 => 0.1903, std.dev.: 0.0120) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 19.73% (0.8101 => 0.9699, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ary: 19.62% (0.3232 => 0.3866, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.39% (0.4203 => 0.5018, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 19.29% (0.3162 => 0.3772, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/wordfreq: 19.17% (0.3307 => 0.3941, std.dev.: 0.0113) SingleSource/Benchmarks/CoyoteBench/lpbench: 19.16% (0.0929 => 0.1107, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 18.74% (0.7326 => 0.8699, std.dev.: 0.0074) SingleSource/UnitTests/ObjC++/Hello: 18.67% (0.5925 => 0.7031, std.dev.: 0.0170) MultiSource/Applications/Burg/burg: 18.19% (1.1642 => 1.3760, std.dev.: 0.0433) SingleSource/Benchmarks/Shootout-C++/lists1: 18.16% (0.3684 => 0.4353, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 18.15% (0.2430 => 0.2871, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.98% (14.3668 => 16.9504, std.dev.: 0.2790) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 17.96% (0.1125 => 0.1327, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference-object: 17.91% (0.6030 => 0.7110, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/objinst: 17.76% (0.3131 => 0.3687, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.47% (1.1861 => 1.3933, std.dev.: 0.0294) SingleSource/Benchmarks/Shootout-C++/strcat: 17.41% (0.2831 => 0.3324, std.dev.: 0.0083) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.40% (0.8172 => 0.9594, std.dev.: 0.0389) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.23% (0.2891 => 0.3389, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/ary3: 17.21% (0.3283 => 0.3848, std.dev.: 0.0090) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 17.06% (0.0838 => 0.0981, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 16.92% (0.1625 => 0.1900, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/mason/mason: 16.89% (0.0811 => 0.0948, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wc: 16.74% (0.3052 => 0.3563, std.dev.: 0.0189) MultiSource/Applications/treecc/treecc: 16.64% (2.0273 => 2.3647, std.dev.: 0.0831) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.53% (0.0871 => 0.1015, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.11% (0.0953 => 0.1097, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.01% (0.2065 => 0.2375, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/ffbench: 14.89% (0.0705 => 0.0810, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.68% (0.0770 => 0.0883, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.63% (0.0834 => 0.0956, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.50% (0.1117 => 0.1279, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.37% (2.0665 => 2.3634, std.dev.: 0.0960) SingleSource/Benchmarks/Shootout-C++/ary2: 14.32% (0.3379 => 0.3863, std.dev.: 0.0125) MultiSource/Applications/minisat/minisat: 14.27% (0.7115 => 0.8130, std.dev.: 0.0280) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.01% (4.9449 => 5.6375, std.dev.: 0.1063) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.84% (0.5981 => 0.6809, std.dev.: 0.0257) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.55% (2.2022 => 2.5006, std.dev.: 0.0225) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.47% (5.0018 => 5.6757, std.dev.: 0.2003) SingleSource/Benchmarks/Shootout-C++/except: 13.44% (0.2871 => 0.3257, std.dev.: 0.0100) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 13.38% (0.3177 => 0.3602, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.27% (0.5569 => 0.6308, std.dev.: 0.0257) MultiSource/Applications/sgefa/sgefa: 13.25% (0.3109 => 0.3521, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.85% (0.1510 => 0.1704, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.80% (4.2646 => 4.8106, std.dev.: 0.2076) MultiSource/Applications/siod/siod: 12.00% (2.2969 => 2.5726, std.dev.: 0.0638) MultiSource/Benchmarks/nbench/nbench: 11.94% (1.1840 => 1.3254, std.dev.: 0.0433) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.91% (0.1906 => 0.2133, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hash: 11.66% (0.4289 => 0.4789, std.dev.: 0.0153) SingleSource/UnitTests/ObjC/exceptions-4: 11.66% (0.3543 => 0.3956, std.dev.: 0.0160) MultiSource/Applications/lemon/lemon: 11.62% (1.0722 => 1.1968, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/synchronized: 11.51% (0.3561 => 0.3971, std.dev.: 0.0154) SingleSource/UnitTests/ObjC/exceptions-2: 11.50% (0.3497 => 0.3899, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/hash2: 11.36% (0.4620 => 0.5145, std.dev.: 0.0174) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.90% (0.4879 => 0.5411, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.59% (0.6450 => 0.7133, std.dev.: 0.0232) SingleSource/UnitTests/SignlessTypes/rem: 10.49% (0.1144 => 0.1264, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.81% (1.4186 => 1.5577, std.dev.: 0.0507) MultiSource/Benchmarks/PAQ8p/paq8p: 9.24% (10.3673 => 11.3250, std.dev.: 0.2153) MultiSource/Benchmarks/Olden/power/power: 6.94% (0.1440 => 0.1540, std.dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.80% (7.9617 => 8.4234, std.dev.: 0.1328) SingleSource/UnitTests/Vector/constpool: 4.86% (54.1659 => 56.7974, std.dev.: 0.3362) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.29% (4.3953 => 11.0008, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/methcall: 147.43% (5.3999 => 13.3612, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/17-bintr/bintr: 120.90% (0.1043 => 0.2304, std.dev.: 0.0208) MultiSource/Benchmarks/McCat/09-vor/vor: 36.66% (0.1154 => 0.1577, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 34.58% (0.3256 => 0.4382, std.dev.: 0.0210) MultiSource/Benchmarks/VersaBench/dbms/dbms: 30.72% (1.5086 => 1.9720, std.dev.: 0.0256) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 26.49% (13.4384 => 16.9987, std.dev.: 0.8816) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 21.95% (1.3045 => 1.5908, std.dev.: 0.0562) MultiSource/Benchmarks/Olden/bisort/bisort: 20.58% (0.8333 => 1.0048, std.dev.: 0.0510) SingleSource/Benchmarks/CoyoteBench/fftbench: 20.16% (2.0360 => 2.4464, std.dev.: 0.0450) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.80% (0.2944 => 0.3468, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 17.44% (6.6465 => 7.8057, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.29% (1.1145 => 1.3072, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/health/health: 17.23% (0.4445 => 0.5211, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 16.78% (0.0864 => 0.1009, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 14.93% (1.0785 => 1.2395, std.dev.: 0.0283) SingleSource/Benchmarks/Shootout/heapsort: 13.58% (3.8526 => 4.3759, std.dev.: 0.1001) SingleSource/Benchmarks/Misc/ffbench: 12.93% (0.9505 => 1.0734, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.74% (2.8904 => 3.2298, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/puzzle: 11.51% (0.6962 => 0.7763, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/richards_benchmark: 10.26% (1.1396 => 1.2565, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.24% (1.7254 => 1.8849, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 7.80% (1.9405 => 2.0919, std.dev.: 0.0164) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.52% (0.3070 => 0.3301, std.dev.: 0.0028) MultiSource/Applications/lua/lua: 6.16% (26.0924 => 27.6990, std.dev.: 0.0872) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/strcat: 5.69% (0.1899 => 0.2007, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.45% (4.2280 => 4.4584, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.20% (3.6395 => 3.8286, std.dev.: 0.0264) SingleSource/Regression/C/uint64_to_float: 5.06% (0.5413 => 0.5687, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.6436 => 12.1222, std.dev.: 0.0119) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.30% (1.7133 => 1.7698, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.19% (0.3540 => 0.3653, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: 2.72% (2.4116 => 2.4772, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/lists: 2.33% (12.5348 => 12.8273, std.dev.: 0.0173) MultiSource/Benchmarks/Olden/em3d/em3d: 2.27% (3.1023 => 3.1726, std.dev.: 0.0163) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.15% (1.3677 => 1.3971, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 2.12% (85.0658 => 86.8711, std.dev.: 0.1223) MultiSource/Applications/aha/aha: 2.05% (3.1595 => 3.2244, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.84% (2.1424 => 2.1819, std.dev.: 0.0138) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.51% (6.5088 => 6.6073, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 1.49% (27.8444 => 28.2595, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout/sieve: 1.46% (5.2139 => 5.2902, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0313 => 1.0440, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 1.19% (2.4858 => 2.5153, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0502, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.30% (6.6874 => 0.1806, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.13% (5.2763 => 1.3124, std.dev.: 0.0165) SingleSource/Benchmarks/Misc/salsa20: -74.59% (0.8651 => 0.2198, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: -37.48% (0.1622 => 0.1014, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: -11.94% (10.4361 => 9.1902, std.dev.: 0.1775) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -9.66% (1.7609 => 1.5908, std.dev.: 0.0639) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.64% (5.3526 => 4.8900, std.dev.: 0.0654) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.17% (5.3855 => 4.9996, std.dev.: 0.0253) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.33% (0.3987 => 0.2379, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.31% (4.5009 => 2.7765, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7636, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.16% (2.6546 => 2.0132, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: -19.16% (0.2161 => 0.1747, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: -16.17% (1.6925 => 1.4189, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.68% (2.6778 => 2.2846, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.81% (32.5116 => 28.9974, std.dev.: 0.0382) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -10.41% (9.5636 => 8.5678, std.dev.: 0.2107) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4244, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.93% (4.8142 => 4.4805, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.2416 => 3.0211, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.56% (2.7294 => 2.5777, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.05% (0.2497 => 0.2371, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5080, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: -4.55% (6.2999 => 6.0135, std.dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.23% (19.9488 => 19.1051, std.dev.: 0.0852) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.36% (0.9957 => 0.9622, std.dev.: 0.0080) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8918, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.50% (0.4808 => 0.4688, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.93% (8.1563 => 7.9992, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6770, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -1.48% (10.2830 => 10.1305, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.89% (0.1485 => 0.1353, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.14% (0.2116 => 0.0653, std.dev.: 0.0013) Report Time: 2.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 19:11:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 21:11:45 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121124031145.5FC392A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6187?compare_to=6185&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6187, Order: 168525, Start Time: 2012-11-23 23:51:19, End Time: 2012-11-24 03:12:12 To: 6185, Order: 168524, Start Time: 2012-11-23 19:42:13, End Time: 2012-11-23 23:03:23 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (173 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1092 (717 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.08% (0.0625 => 0.0888, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.55% (0.1063 => 0.1409, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.27% (0.2969 => 0.3749, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.05% (0.0714 => 0.0900, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.59% (0.1106 => 0.1389, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.46% (0.4253 => 0.5336, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.98% (0.4139 => 0.5173, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 24.81% (1.5932 => 1.9884, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.79% (0.0475 => 0.0588) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.51% (0.4994 => 0.6168, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.29% (0.0584 => 0.0720, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.22% (0.5900 => 0.7270, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.02% (0.5000 => 0.6151, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.47% (0.1620 => 0.1984, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 22.20% (0.0599 => 0.0732, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.19% (0.0897 => 0.1096, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.14% (0.1021 => 0.1247, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.77% (0.1107 => 0.1348) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.58% (0.0584 => 0.0710, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.04% (0.1003 => 0.1214, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.85% (0.0633 => 0.0765) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.80% (0.0572 => 0.0691, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 20.78% (0.0948 => 0.1145) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.67% (0.1103 => 0.1331, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.56% (0.0642 => 0.0774, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.52% (0.0541 => 0.0652, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.40% (0.0495 => 0.0596, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.37% (0.3903 => 0.4698, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.21% (0.1549 => 0.1862, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 20.10% (0.0821 => 0.0986, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.95% (0.0822 => 0.0986, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.89% (0.1604 => 0.1923, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 19.77% (0.1619 => 0.1939, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 19.70% (0.0604 => 0.0723, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.15% (0.1462 => 0.1742, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 18.90% (0.0947 => 0.1126, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 18.81% (0.0808 => 0.0960, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.74% (0.3890 => 0.4619, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.36% (0.1160 => 0.1373, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.32% (0.2014 => 0.2383, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.07% (0.2866 => 0.3384, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 18.06% (0.1218 => 0.1438, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 18.05% (0.0698 => 0.0824, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 17.95% (0.5826 => 0.6872, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.87% (0.2736 => 0.3225, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 17.85% (0.4029 => 0.4748, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.83% (0.1088 => 0.1282, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.78% (1.3152 => 1.5490, std.dev.: 0.0064) SingleSource/UnitTests/ObjC++/property-reference-object: 17.61% (0.5889 => 0.6926, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 17.54% (0.1505 => 0.1769, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.33% (0.4658 => 0.5465, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 17.18% (0.5546 => 0.6499, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.05% (0.5026 => 0.5883, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.03% (3.5627 => 4.1693, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/gs/gs: 17.01% (1.8794 => 2.1990, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.92% (0.1968 => 0.2301, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.63% (0.3271 => 0.3815, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.62% (1.6211 => 1.8906, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.35% (0.2875 => 0.3345, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.07% (0.4361 => 0.5062, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 15.97% (0.1421 => 0.1648, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 15.95% (0.7171 => 0.8315, std.dev.: 0.0025) MultiSource/Applications/d/make_dparser: 15.93% (1.0781 => 1.2498, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 15.85% (0.9697 => 1.1234, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 15.80% (0.2823 => 0.3269, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 15.79% (0.2780 => 0.3219, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 15.78% (0.2813 => 0.3257, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.77% (4.4195 => 5.1164, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.73% (0.3930 => 0.4548, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/strcat: 15.71% (0.2750 => 0.3182, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.68% (2.7292 => 3.1571, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 15.65% (0.9909 => 1.1460, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.63% (0.2911 => 0.3366, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 15.62% (0.2714 => 0.3138, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.62% (0.3195 => 0.3694, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.60% (0.2738 => 0.3165, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 15.58% (0.1284 => 0.1484, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 15.56% (4.2109 => 4.8663, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/fibo: 15.56% (0.2725 => 0.3149, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.54% (0.2729 => 0.3153, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.44% (1.9694 => 2.2735, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/except: 15.40% (0.2811 => 0.3244, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/random: 15.38% (0.2803 => 0.3234, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.29% (0.2792 => 0.3219, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 15.25% (0.3004 => 0.3462, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 15.15% (0.3096 => 0.3565, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 15.09% (0.3267 => 0.3760, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.06% (2.0673 => 2.3787, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.99% (1.9966 => 2.2959, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ary2: 14.92% (0.3317 => 0.3812, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.86% (0.1090 => 0.1252, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 14.86% (0.3258 => 0.3742, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.71% (0.3060 => 0.3510, std.dev.: 0.0050) MultiSource/Benchmarks/Bullet/bullet: 14.66% (23.5202 => 26.9688, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/football/football: 14.60% (0.2075 => 0.2378, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.54% (0.3488 => 0.3995, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 14.43% (0.3348 => 0.3831, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 14.34% (0.2566 => 0.2934, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.31% (0.3362 => 0.3843, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 14.27% (0.3678 => 0.4203, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 14.17% (0.3465 => 0.3956, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 14.10% (0.3446 => 0.3932, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.02% (0.3460 => 0.3945, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 14.02% (0.3496 => 0.3986, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 14.01% (0.3469 => 0.3955, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 14.00% (0.3442 => 0.3924, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 14.00% (1.4269 => 1.6266, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.99% (0.3124 => 0.3561, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.89% (0.3282 => 0.3738, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.88% (0.3625 => 0.4128, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 13.82% (0.3726 => 0.4241, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 13.75% (0.3477 => 0.3955, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.70% (0.3650 => 0.4150, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 13.63% (0.4146 => 0.4711, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 13.53% (0.3643 => 0.4136, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 13.46% (0.0758 => 0.0860, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 13.43% (0.7875 => 0.8933, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 13.39% (0.4251 => 0.4820, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.37% (0.3724 => 0.4222, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.37% (0.3845 => 0.4359, std.dev.: 0.0062) MultiSource/Applications/SIBsim4/SIBsim4: 13.30% (0.2691 => 0.3049, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.25% (0.3690 => 0.4179, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.24% (0.3981 => 0.4508, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 12.99% (2.1653 => 2.4465, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 12.74% (4.6177 => 5.2062, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 12.65% (0.5012 => 0.5646, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 12.61% (2.1013 => 2.3663, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.95% (0.6435 => 0.7204, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.76% (0.2040 => 0.2280, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 11.65% (5.5417 => 6.1872, std.dev.: 0.0053) MultiSource/Applications/lambda-0_1_3/lambda: 11.61% (0.3498 => 0.3904, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.28% (0.1028 => 0.1144, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 11.08% (0.6634 => 0.7369, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.80% (0.3084 => 0.3417, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.78% (0.2068 => 0.2291, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.63% (0.2737 => 0.3028, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.41% (0.1383 => 0.1527, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 10.36% (0.4847 => 0.5349, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 10.10% (0.3336 => 0.3673, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.84% (0.2103 => 0.2310, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 9.77% (2.0346 => 2.2334, std.dev.: 0.0114) MultiSource/Applications/lemon/lemon: 9.54% (0.2391 => 0.2619, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.88% (4.6926 => 5.1093, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.73% (0.5361 => 0.5829, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.45% (11.6398 => 12.6234, std.dev.: 0.0214) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.12% (0.7426 => 0.8029, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.08% (0.5584 => 0.6035, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 6.80% (11.9555 => 12.7680, std.dev.: 0.0158) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.64% (0.3792 => 0.3968, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.30% (0.5917 => 0.6704, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 9.81% (0.2802 => 0.3077, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.21% (0.2122 => 0.2275, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6100, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6740, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.96% (0.3693 => 0.3876, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1648, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-2: 4.51% (1.8057 => 1.8871, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6418, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1962, std.dev.: 0.0598) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2235, std.dev.: 0.0023) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3053, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2841, std.dev.: 0.0041) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5126, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5863, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.85% (2.4764 => 2.3811, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5750, std.dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9751, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7936, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9574, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: -6.24% (0.2402 => 0.2252, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8048, std.dev.: 0.0031) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.91% (17.2379 => 16.7358, std.dev.: 0.0728) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8590, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.05% (0.6293 => 0.6164, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5761, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4969, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.33% (105.3826 => 103.9796, std.dev.: 0.1176) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0455, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 20:04:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 22:04:55 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121124040455.43E252A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6188?compare_to=6182&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6188, Order: 168532, Start Time: 2012-11-24 02:31:25, End Time: 2012-11-24 04:05:24 To: 6182, Order: 168525, Start Time: 2012-11-23 20:21:45, End Time: 2012-11-23 21:51:45 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 8 (39 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1046 (915 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel24: 52.08% (0.2287 => 0.3478, std.dev.: 0.0459) SingleSource/Benchmarks/Misc/pi: 25.48% (1.9742 => 2.4773, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout/nestedloop: 14.86% (0.2012 => 0.2311, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/nestedloop: 14.69% (0.1967 => 0.2256, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/strcat: 13.38% (0.0800 => 0.0907, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.95% (3.9428 => 4.3745, std.dev.: 0.0881) SingleSource/Benchmarks/McGill/chomp: 8.24% (1.0008 => 1.0833, std.dev.: 0.0287) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.91% (3.5586 => 3.6267, std.dev.: 0.0088) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.84% (1.0635 => 1.0724, std.dev.: 0.1882) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.91% (0.0219 => 0.0217, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 27.76% (0.0335 => 0.0428, std.dev.: 0.0070) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0332 => 0.0332, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 15.50% (0.0271 => 0.0313, std.dev.: 0.0087) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.18% (0.0423 => 0.0428, std.dev.: 0.0115) SingleSource/UnitTests/Vector/Altivec/casts: 1.47% (0.0204 => 0.0207, std.dev.: 0.0068) SingleSource/UnitTests/Vector/Altivec/test1: 2.82% (0.0213 => 0.0219, std.dev.: 0.0061) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1482 => 0.1483, std.dev.: 0.0048) MultiSource/Applications/lemon/lemon: 7.50% (1.1315 => 1.2164, std.dev.: 0.2694) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.70% (0.4068 => 0.4137, std.dev.: 0.1362) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.67% (0.1436 => 0.1412, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.63% (0.0570 => 0.0642, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 50.27% (0.0185 => 0.0278, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.36% (0.0550 => 0.0585, std.dev.: 0.0198) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.13% (1.1919 => 1.2054, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -80.00% (0.0005 => 0.0001, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.00% (0.0566 => 0.0583, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.70% (0.0198 => 0.0237, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.89% (0.7873 => 0.7803, std.dev.: 0.0038) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 144.44% (0.0036 => 0.0088, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.26% (16.4461 => 17.6409, std.dev.: 0.6874) MultiSource/Applications/sqlite3/sqlite3: 2314.88% (0.6332 => 15.2910, std.dev.: 0.4853) MultiSource/Benchmarks/McCat/08-main/main: 47.08% (0.1831 => 0.2693, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.56% (0.1559 => 0.1410, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7158.53% (0.3123 => 22.6684, std.dev.: 0.4301) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.87% (0.2463 => 0.3716, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1529.43% (0.3344 => 5.4488, std.dev.: 0.2904) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.89% (0.2364 => 0.3236, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/bigfib: 4.88% (0.6010 => 0.6303, std.dev.: 0.0121) SingleSource/Benchmarks/Misc/mandel: 2.56% (0.0429 => 0.0440, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.30% (0.3266 => 0.3439, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/strcat: 4.27% (0.1969 => 0.2053, std.dev.: 0.0045) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 10.27% (0.0224 => 0.0247, std.dev.: 0.0073) SingleSource/UnitTests/byval-alignment: -32.17% (0.0230 => 0.0156, std.dev.: 0.0015) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0523, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 10.47% (0.1462 => 0.1615, std.dev.: 0.0148) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4619, std.dev.: 0.0295) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0701, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4958, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5141, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.6480, std.dev.: 0.2141) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3150, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1635, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3630, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4090, std.dev.: 0.0411) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0907, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: -23.83% (2.1832 => 1.6629, std.dev.: 0.0777) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0003, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.33% (0.0848 => 0.0961, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.05% (0.1425 => 0.1554, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.06% (0.2279 => 0.2440, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 5.82% (0.6834 => 0.7232, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.64% (0.2998 => 0.3167, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.97% (0.4127 => 0.4291, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.88% (0.4559 => 0.4736, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.69% (0.3717 => 0.3854, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.23% (0.8177 => 0.8441, std.dev.: 0.0054) MultiSource/Benchmarks/nbench/nbench: 2.92% (1.1271 => 1.1600, std.dev.: 0.0074) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.78% (6.6074 => 6.7912, std.dev.: 0.0415) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 130.65% (0.0199 => 0.0459, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/pi: 56.84% (1.5795 => 2.4773, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 19.70% (0.0528 => 0.0632, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.64% (2.9753 => 3.4705, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.72% (2.7995 => 3.2115, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/nestedloop: 14.24% (0.2023 => 0.2311, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.63% (3.9188 => 4.3745, std.dev.: 0.0881) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.53% (5.0261 => 5.6057, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.98% (1.1857 => 1.2803, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 7.62% (1.7056 => 1.8355, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 6.61% (3.1873 => 3.3981, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.98% (4.9686 => 5.2658, std.dev.: 0.0050) MultiSource/Applications/lambda-0_1_3/lambda: 4.85% (7.4933 => 7.8566, std.dev.: 0.0280) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.71% (6.2275 => 6.5208, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.19% (4.9453 => 5.1526, std.dev.: 0.0408) MultiSource/Applications/hexxagon/hexxagon: 4.17% (14.0064 => 14.5905, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.08% (4.9469 => 5.1486, std.dev.: 0.0364) MultiSource/Applications/siod/siod: 2.98% (3.6643 => 3.7736, std.dev.: 0.0261) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.88% (11.5690 => 11.9025, std.dev.: 0.0390) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.84% (8.2783 => 8.5131, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout/lists: 2.58% (7.3375 => 7.5267, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.40% (4.8660 => 4.9827, std.dev.: 0.0383) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.91% (1.1365 => 1.1582, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.44% (1.5941 => 1.6171, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/power/power: 1.44% (1.2061 => 1.2235, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: 1.32% (1.0841 => 1.0984, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.13% (2.4647 => 2.4925, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/ReedSolomon: 1.02% (8.5322 => 8.6194, std.dev.: 0.0207) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.98% (5.4641 => 4.3177, std.dev.: 0.0754) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -15.10% (7.2130 => 6.1240, std.dev.: 0.1001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.83% (1.0512 => 0.9374, std.dev.: 0.0195) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.59% (14.6451 => 13.3871, std.dev.: 0.2030) MultiSource/Benchmarks/mafft/pairlocalalign: -8.35% (63.1822 => 57.9071, std.dev.: 0.0213) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.53% (0.3269 => 0.3023, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.80% (4.7482 => 4.4254, std.dev.: 0.0325) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.88% (5.4972 => 5.1742, std.dev.: 0.0762) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.06% (5.1557 => 4.8947, std.dev.: 0.0538) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.36% (4.7449 => 4.5380, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.76% (6.0224 => 5.7962, std.dev.: 0.0561) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.01% (0.5807 => 0.5632, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.98% (28.5821 => 27.7294, std.dev.: 0.0315) MultiSource/Applications/aha/aha: -2.23% (3.3398 => 3.2654, std.dev.: 0.0193) MultiSource/Benchmarks/FreeBench/mason/mason: -2.22% (0.5415 => 0.5295, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: -1.73% (3.4237 => 3.3644, std.dev.: 0.0227) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.58% (9.9065 => 9.7497, std.dev.: 0.0543) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.46% (2.3487 => 2.3144, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.15% (4.9994 => 4.9417, std.dev.: 0.0206) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.13% (5.6343 => 5.5704, std.dev.: 0.0222) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.50% (1.0262 => 1.0724, std.dev.: 0.1882) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0070) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0087) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.46% (0.0384 => 0.0428, std.dev.: 0.0115) SingleSource/UnitTests/Vector/Altivec/casts: 8.95% (0.0190 => 0.0207, std.dev.: 0.0068) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0061) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 3.13% (0.1438 => 0.1483, std.dev.: 0.0048) MultiSource/Applications/lemon/lemon: 7.37% (1.1329 => 1.2164, std.dev.: 0.2694) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.65% (0.4164 => 0.4137, std.dev.: 0.1362) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.14% (0.1369 => 0.1412, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.16% (0.0641 => 0.0642, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.56% (0.0195 => 0.0278, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.21% (0.0578 => 0.0585, std.dev.: 0.0198) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.39% (1.1437 => 1.2054, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.02% (0.0627 => 0.0583, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.67% (0.0180 => 0.0237, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.67% (0.8017 => 0.7803, std.dev.: 0.0038) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 41.94% (0.0062 => 0.0088, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 20:07:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 22:07:30 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121124040730.785BB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6189?compare_to=6184&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6189, Order: 168532, Start Time: 2012-11-24 02:34:30, End Time: 2012-11-24 04:07:59 To: 6184, Order: 168525, Start Time: 2012-11-23 20:55:19, End Time: 2012-11-23 22:28:46 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (177 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (860 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.15% (0.3834 => 0.4415, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.69% (2.0478 => 2.1029, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/salsa20: 2.47% (7.4937 => 7.6789, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hash2: 2.14% (3.1932 => 3.2616, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.74% (0.1431 => 0.1306, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.80% (0.3821 => 0.3523, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.64% (0.3357 => 0.3134, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.46% (0.9542 => 0.8926, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -6.43% (0.3812 => 0.3567, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -6.42% (0.3880 => 0.3631, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.40% (0.3831 => 0.3586, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.39% (0.3896 => 0.3647, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.34% (0.3848 => 0.3604, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -6.32% (2.4924 => 2.3350, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -6.30% (0.2160 => 0.2024, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.26% (0.3884 => 0.3641, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.25% (0.3891 => 0.3648, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -6.20% (0.4176 => 0.3917, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.20% (0.4033 => 0.3783, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.18% (0.2428 => 0.2278, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.15% (9.2283 => 8.6610, std.dev.: 0.0130) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.12% (0.9852 => 0.9249, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.05% (0.6484 => 0.6092, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.99% (0.2355 => 0.2214, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -5.94% (7.0961 => 6.6746, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.93% (0.3658 => 0.3441, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.92% (0.7198 => 0.6772, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.89% (1.3722 => 1.2914, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.87% (1.0544 => 0.9925, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.87% (0.5863 => 0.5519, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -5.86% (0.4199 => 0.3953, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.86% (4.8161 => 4.5340, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/chomp: -5.85% (0.1761 => 0.1658, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.83% (0.5591 => 0.5265, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -5.83% (16.1920 => 15.2479, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/football/football: -5.80% (0.9179 => 0.8647, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.76% (0.5925 => 0.5584, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: -5.75% (0.1879 => 0.1771, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.73% (0.1796 => 0.1693, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.73% (3.5339 => 3.3313, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.73% (0.5705 => 0.5378, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.70% (4.8802 => 4.6020, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.70% (0.5478 => 0.5166, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.69% (0.6297 => 0.5939, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.68% (1.2300 => 1.1601, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.68% (4.0323 => 3.8032, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.67% (0.6230 => 0.5877, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.66% (0.5849 => 0.5518, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.65% (0.6052 => 0.5710, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.64% (0.6667 => 0.6291, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.63% (0.5805 => 0.5478, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -5.61% (0.4280 => 0.4040, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.60% (0.2695 => 0.2544, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.60% (0.6194 => 0.5847, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.60% (0.5857 => 0.5529, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.59% (6.7716 => 6.3933, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.58% (0.5802 => 0.5478, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.57% (1.6364 => 1.5452, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.57% (0.6304 => 0.5953, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.55% (1.4642 => 1.3829, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: -5.55% (4.3330 => 4.0927, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.53% (0.6660 => 0.6292, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.52% (0.5581 => 0.5273, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.51% (0.6293 => 0.5946, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.51% (0.7919 => 0.7483, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.50% (0.5456 => 0.5156, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.49% (0.3406 => 0.3219, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -5.49% (1.1530 => 1.0897, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.49% (0.5575 => 0.5269, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -5.48% (1.1450 => 1.0822, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.48% (0.6736 => 0.6367, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.45% (0.6446 => 0.6095, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.44% (0.5570 => 0.5267, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.44% (4.5069 => 4.2618, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.43% (0.6189 => 0.5853, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: -5.43% (0.4515 => 0.4270, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.40% (0.5941 => 0.5620, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.38% (0.6260 => 0.5923, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/08-main/main: -5.38% (0.2659 => 0.2516, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.36% (0.6440 => 0.6095, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.32% (0.5999 => 0.5680, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.31% (0.6681 => 0.6326, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.29% (0.8521 => 0.8070, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.27% (0.6676 => 0.6324, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.27% (1.2784 => 1.2110, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.27% (0.6033 => 0.5715, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.26% (8.0126 => 7.5910, std.dev.: 0.0078) MultiSource/Applications/SIBsim4/SIBsim4: -5.25% (1.3864 => 1.3136, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.22% (0.2548 => 0.2415, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -5.22% (1.2515 => 1.1862, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.20% (0.5688 => 0.5392, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -5.19% (0.3581 => 0.3395, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -5.19% (0.2985 => 0.2830, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -5.18% (17.1032 => 16.2164, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.18% (14.2083 => 13.4724, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.17% (0.2999 => 0.2844, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.17% (0.4916 => 0.4662, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.14% (0.3483 => 0.3304, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.14% (1.2210 => 1.1583, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -5.13% (0.3255 => 0.3088, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.11% (0.3016 => 0.2862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.09% (0.2278 => 0.2162, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.09% (0.3319 => 0.3150, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: -5.09% (15.5079 => 14.7184, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.09% (0.3323 => 0.3154, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.08% (0.4151 => 0.3940, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -5.07% (0.2939 => 0.2790, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.06% (0.3025 => 0.2872, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.04% (0.3931 => 0.3733, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: -5.03% (1.3148 => 1.2486, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -5.02% (0.3026 => 0.2874, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -5.02% (0.2989 => 0.2839, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -4.99% (0.3446 => 0.3274, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.98% (0.2933 => 0.2787, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.98% (0.4321 => 0.4106, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -4.97% (0.7447 => 0.7077, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -4.96% (4.0594 => 3.8579, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: -4.96% (0.3205 => 0.3046, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.96% (0.2903 => 0.2759, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -4.95% (0.3394 => 0.3226, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.95% (0.2385 => 0.2267, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.94% (0.3057 => 0.2906, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.93% (1.2221 => 1.1619, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: -4.91% (0.2849 => 0.2709, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.91% (0.7339 => 0.6979, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.89% (2.1713 => 2.0651, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -4.88% (0.3194 => 0.3038, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.85% (0.7524 => 0.7159, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.85% (0.6395 => 0.6085, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: -4.85% (3.5154 => 3.3450, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.82% (0.5168 => 0.4919, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.77% (1.6474 => 1.5688, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.77% (0.3837 => 0.3654, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -4.77% (0.3481 => 0.3315, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.75% (0.3849 => 0.3666, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.74% (15.2527 => 14.5296, std.dev.: 0.0049) MultiSource/Applications/siod/siod: -4.73% (2.4021 => 2.2884, std.dev.: 0.0157) MultiSource/Applications/lambda-0_1_3/lambda: -4.71% (0.7982 => 0.7606, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -4.71% (0.4248 => 0.4048, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.71% (22.4056 => 21.3508, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/hash2: -4.65% (0.4861 => 0.4635, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -4.65% (0.3271 => 0.3119, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.64% (0.7021 => 0.6695, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.63% (0.5567 => 0.5309, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -4.62% (2.1401 => 2.0412, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.61% (0.5569 => 0.5312, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -4.61% (0.3621 => 0.3454, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.60% (0.4083 => 0.3895, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.51% (0.9557 => 0.9126, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.47% (0.5329 => 0.5091, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.46% (0.6395 => 0.6110, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -4.45% (0.3059 => 0.2923, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -4.43% (5.0226 => 4.8001, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.43% (0.3252 => 0.3108, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.42% (0.3867 => 0.3696, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.38% (0.4813 => 0.4602, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: -4.28% (0.3788 => 0.3626, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -4.27% (18.2933 => 17.5125, std.dev.: 0.0055) MultiSource/Applications/spiff/spiff: -4.25% (0.8418 => 0.8060, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -4.21% (34.0927 => 32.6567, std.dev.: 0.0178) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.21% (0.9077 => 0.8695, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.18% (2.2587 => 2.1643, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/bigfib: -4.16% (0.6750 => 0.6469, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.07% (0.3491 => 0.3349, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -4.03% (0.6347 => 0.6091, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: -4.01% (0.6441 => 0.6183, std.dev.: 0.0077) SingleSource/UnitTests/ObjC++/property-reference: -3.92% (0.7779 => 0.7474, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: -3.75% (1.5610 => 1.5025, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: -3.60% (0.4524 => 0.4361, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.48% (5.4682 => 5.2779, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -2.38% (20.7746 => 20.2805, std.dev.: 0.0430) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7570, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: -8.74% (1.2842 => 1.1720, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: -3.98% (2.2633 => 2.1733, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.35% (1.3096 => 1.2657, std.dev.: 0.0114) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4694, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 21:23:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 23:23:56 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121124052357.0287F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6190?compare_to=6186&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6190, Order: 168532, Start Time: 2012-11-24 03:04:09, End Time: 2012-11-24 05:24:22 To: 6186, Order: 168525, Start Time: 2012-11-23 23:16:57, End Time: 2012-11-24 01:37:16 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 49 (170 on baseline) Performance Improvements: 13 (38 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1024 (677 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit: 15.80% (6.0592 => 7.0164, std.dev.: 0.0487) MultiSource/Applications/aha/aha: 13.46% (0.1315 => 0.1492, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: 13.06% (0.1869 => 0.2113, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/fibo: 11.91% (0.2973 => 0.3327, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 11.88% (0.3376 => 0.3777, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/exptree: 11.39% (0.0922 => 0.1027, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 11.35% (2.5726 => 2.8646, std.dev.: 0.0819) SingleSource/Benchmarks/Shootout-C++/methcall: 11.26% (0.3145 => 0.3499, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.67% (4.3531 => 4.8174, std.dev.: 0.0788) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.24% (0.6308 => 0.6954, std.dev.: 0.0068) SingleSource/Benchmarks/Stanford/Puzzle: 9.52% (0.1397 => 0.1530, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.39% (0.4450 => 0.4868, std.dev.: 0.0077) MultiSource/Applications/Burg/burg: 9.21% (1.3760 => 1.5027, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.89% (1.5089 => 1.6431, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/oourafft: 8.82% (0.3571 => 0.3886, std.dev.: 0.0120) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.51% (0.1328 => 0.1441, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.25% (4.8106 => 5.2075, std.dev.: 0.0585) MultiSource/Applications/sgefa/sgefa: 8.24% (0.3521 => 0.3811, std.dev.: 0.0036) MultiSource/Applications/minisat/minisat: 8.19% (0.8130 => 0.8796, std.dev.: 0.0184) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.97% (0.3678 => 0.3971, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/except: 7.95% (0.3257 => 0.3516, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.56% (1.5577 => 1.6754, std.dev.: 0.0406) SingleSource/Benchmarks/Shootout-C++/hash: 7.52% (0.4789 => 0.5149, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/hash2: 7.19% (0.5145 => 0.5515, std.dev.: 0.0121) MultiSource/Benchmarks/nbench/nbench: 7.12% (1.3254 => 1.4198, std.dev.: 0.0290) SingleSource/Benchmarks/Shootout-C++/ary2: 6.55% (0.3863 => 0.4116, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 6.52% (0.1980 => 0.2109, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 6.28% (17.2854 => 18.3705, std.dev.: 0.2391) SingleSource/Benchmarks/Misc/ReedSolomon: 6.11% (0.2194 => 0.2328, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary3: 4.70% (0.3848 => 0.4029, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 4.28% (1.6596 => 1.7306, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/strcat: 3.85% (0.3324 => 0.3452, std.dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 3.07% (7.0767 => 7.2943, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/ary: 2.77% (0.3866 => 0.3973, std.dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: 2.44% (20.8285 => 21.3374, std.dev.: 0.1635) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.33% (0.4804 => 0.4916, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 18.80% (3.7494 => 4.4544, std.dev.: 0.1457) SingleSource/Benchmarks/Shootout-C++/ary3: 18.59% (4.2252 => 5.0105, std.dev.: 0.0603) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 17.81% (3.8082 => 4.4865, std.dev.: 0.1711) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 15.84% (5.3815 => 6.2337, std.dev.: 0.0690) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 11.65% (6.6497 => 7.4242, std.dev.: 0.0385) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 8.73% (30.1820 => 32.8178, std.dev.: 0.0950) SingleSource/Benchmarks/McGill/chomp: 7.95% (1.2137 => 1.3102, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 5.06% (5.3680 => 5.6397, std.dev.: 0.0266) MultiSource/Applications/sqlite3/sqlite3: 2.90% (4.5857 => 4.7186, std.dev.: 0.0451) MultiSource/Applications/sgefa/sgefa: 2.28% (0.6307 => 0.6451, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 1.45% (3.8627 => 3.9189, std.dev.: 0.0143) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.29% (3.0211 => 3.0600, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ackermann: 1.07% (1.7698 => 1.7888, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.33% (0.1014 => 0.0889, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -11.62% (0.6550 => 0.5789, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -11.11% (0.3429 => 0.3048, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/objinst: -9.41% (0.3687 => 0.3340, std.dev.: 0.0004) SingleSource/Benchmarks/LivermoreLoops/kernel13: -9.36% (0.1196 => 0.1084, std.dev.: 0.0033) MultiSource/Applications/spiff/spiff: -9.02% (0.9807 => 0.8922, std.dev.: 0.0224) MultiSource/Benchmarks/FreeBench/distray/distray: -8.54% (0.1675 => 0.1532, std.dev.: 0.0034) SingleSource/Benchmarks/LivermoreLoops/kernel15: -8.51% (0.1292 => 0.1182, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: -7.15% (0.2363 => 0.2194, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: -17.80% (6.9038 => 5.6750, std.dev.: 0.3254) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -6.81% (0.4407 => 0.4107, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -3.15% (4.8091 => 4.6574, std.dev.: 0.0128) SingleSource/Benchmarks/LivermoreLoops/kernel14: -1.12% (1.5787 => 1.5610, std.dev.: 0.0018) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.15% (69.1515 => 69.0483, std.dev.: 0.3832) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.67% (0.1353 => 0.1362, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.47% (0.0422 => 0.0420, std.dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.31% (0.0653 => 0.0651, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -0.09% (494.1514 => 493.7154, std.dev.: 0.2993) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.18% (63.2438 => 69.0483, std.dev.: 0.3832) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43680.74% (1.1277 => 493.7154, std.dev.: 0.2993) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 230.96% (0.5229 => 1.7306, std.dev.: 0.0137) MultiSource/Applications/SPASS/SPASS: 22.56% (14.9895 => 18.3705, std.dev.: 0.2391) MultiSource/Applications/kimwitu++/kc: 50.74% (14.1553 => 21.3374, std.dev.: 0.1635) MultiSource/Benchmarks/MallocBench/gs/gs: 16.76% (4.1105 => 4.7995, std.dev.: 0.2615) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 48.72% (1.1048 => 1.6431, std.dev.: 0.0110) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 427.13% (7.1582 => 37.7327, std.dev.: 0.5884) SingleSource/Benchmarks/Misc-C++-EH/spirit: 102.62% (3.4629 => 7.0164, std.dev.: 0.0487) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.56% (0.6222 => 1.0301, std.dev.: 0.0259) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10423.75% (0.0720 => 7.5771, std.dev.: 0.3593) MultiSource/Applications/SIBsim4/SIBsim4: 3918800.00% (0.0001 => 3.9189, std.dev.: 0.0143) MultiSource/Applications/SPASS/SPASS: 12422900.00% (0.0001 => 12.4230, std.dev.: 1.4021) MultiSource/Applications/kimwitu++/kc: 51500.00% (0.0001 => 0.0516, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 64000.00% (0.0001 => 0.0641, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 577700.00% (0.0001 => 0.5778, std.dev.: 0.0169) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10081000.00% (0.0001 => 10.0811, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5674900.00% (0.0001 => 5.6750, std.dev.: 0.3254) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1745.00% (1.1194 => 20.6529, std.dev.: 0.6314) MultiSource/Applications/ClamAV/clamscan: 65.15% (22.1758 => 36.6242, std.dev.: 0.7875) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 58.56% (7.0540 => 11.1848, std.dev.: 0.1614) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.72% (2.9384 => 4.6052, std.dev.: 0.2659) MultiSource/Applications/JM/lencod/lencod: 47.38% (21.9371 => 32.3315, std.dev.: 0.1352) SingleSource/Benchmarks/Misc/flops: 47.28% (0.1432 => 0.2109, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.21% (8.1363 => 11.8961, std.dev.: 0.3062) MultiSource/Benchmarks/FreeBench/distray/distray: 45.08% (0.1056 => 0.1532, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/almabench: 43.70% (0.0730 => 0.1049, std.dev.: 0.0031) SingleSource/UnitTests/vla: 34.08% (0.0355 => 0.0476, std.dev.: 0.0020) SingleSource/Benchmarks/Stanford/Towers: 33.33% (0.0471 => 0.0628, std.dev.: 0.0020) SingleSource/Benchmarks/Stanford/Oscar: 32.55% (0.0636 => 0.0843, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 31.13% (0.2554 => 0.3349, std.dev.: 0.0098) MultiSource/Applications/aha/aha: 29.63% (0.1151 => 0.1492, std.dev.: 0.0040) MultiSource/Applications/Burg/burg: 29.08% (1.1642 => 1.5027, std.dev.: 0.0075) SingleSource/Benchmarks/McGill/chomp: 27.67% (0.1655 => 0.2113, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/functionobjects: 27.23% (0.5020 => 0.6387, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/reversefile: 27.19% (0.3865 => 0.4916, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wordfreq: 27.03% (0.3307 => 0.4201, std.dev.: 0.0156) SingleSource/Benchmarks/Stanford/Treesort: 27.01% (0.0411 => 0.0522, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.73% (0.0793 => 0.1005, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 26.66% (5.7591 => 7.2943, std.dev.: 0.0174) SingleSource/Benchmarks/McGill/exptree: 26.17% (0.0814 => 0.1027, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/matrix: 25.79% (0.0818 => 0.1029, std.dev.: 0.0023) SingleSource/Benchmarks/Stanford/FloatMM: 25.69% (0.0401 => 0.0504, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 25.65% (0.4203 => 0.5281, std.dev.: 0.0133) MultiSource/Benchmarks/Olden/tsp/tsp: 25.53% (0.1175 => 0.1475, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 24.87% (0.5569 => 0.6954, std.dev.: 0.0068) MultiSource/Applications/siod/siod: 24.72% (2.2969 => 2.8646, std.dev.: 0.0819) SingleSource/Benchmarks/Stanford/Queens: 24.15% (0.0414 => 0.0514, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 24.12% (0.3603 => 0.4472, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 23.77% (3.8922 => 4.8174, std.dev.: 0.0788) SingleSource/Benchmarks/Shootout-C++/ackermann: 23.66% (0.2756 => 0.3408, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 23.63% (0.7115 => 0.8796, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout-C++/lists1: 23.62% (0.3684 => 0.4554, std.dev.: 0.0161) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.59% (0.0746 => 0.0922, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.56% (0.0730 => 0.0902, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.51% (0.0770 => 0.0951, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bisort/bisort: 23.13% (0.0614 => 0.0756, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sumcol: 22.93% (0.2891 => 0.3554, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary: 22.93% (0.3232 => 0.3973, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary3: 22.72% (0.3283 => 0.4029, std.dev.: 0.0023) MultiSource/Applications/sgefa/sgefa: 22.58% (0.3109 => 0.3811, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: 22.50% (0.0871 => 0.1067, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/except: 22.47% (0.2871 => 0.3516, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 22.28% (0.3052 => 0.3732, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.13% (0.1044 => 0.1275, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/espresso/espresso: 22.11% (4.2646 => 5.2075, std.dev.: 0.0585) SingleSource/Benchmarks/Shootout-C++/fibo: 22.09% (0.2725 => 0.3327, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 21.94% (0.2831 => 0.3452, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: 21.92% (0.3098 => 0.3777, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 21.81% (0.3379 => 0.4116, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/misr: 21.64% (0.0633 => 0.0770, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 21.63% (0.0467 => 0.0568, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: 21.62% (0.2877 => 0.3499, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.52% (0.1566 => 0.1903, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/whetstone: 21.36% (0.0660 => 0.0801, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 20.66% (0.1268 => 0.1530, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.52% (0.1584 => 0.1909, std.dev.: 0.0107) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.51% (0.3121 => 0.3761, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 20.47% (0.1114 => 0.1342, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.12% (0.2107 => 0.2531, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash: 20.05% (0.4289 => 0.5149, std.dev.: 0.0094) MultiSource/Benchmarks/nbench/nbench: 19.92% (1.1840 => 1.4198, std.dev.: 0.0290) SingleSource/Benchmarks/Misc-C++/Large/ray: 19.78% (0.4064 => 0.4868, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 19.73% (14.3668 => 17.2014, std.dev.: 0.2617) SingleSource/Benchmarks/Shootout-C++/hash2: 19.37% (0.4620 => 0.5515, std.dev.: 0.0121) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.33% (0.2271 => 0.2710, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 19.17% (1.3050 => 1.5552, std.dev.: 0.0379) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.08% (0.9765 => 1.1628, std.dev.: 0.0234) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.70% (0.2700 => 0.3205, std.dev.: 0.0194) SingleSource/Benchmarks/CoyoteBench/lpbench: 18.51% (0.0929 => 0.1101, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.45% (0.3441 => 0.4076, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/oourafft: 18.40% (0.3282 => 0.3886, std.dev.: 0.0120) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.13% (0.1125 => 0.1329, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: 18.12% (0.4636 => 0.5476, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.10% (1.4186 => 1.6754, std.dev.: 0.0406) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.96% (0.3826 => 0.4513, std.dev.: 0.0108) MultiSource/Benchmarks/mafft/pairlocalalign: 17.77% (9.4845 => 11.1702, std.dev.: 0.2681) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.75% (0.1510 => 0.1778, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.46% (0.0842 => 0.0989, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/health/health: 17.43% (0.1268 => 0.1489, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.24% (0.6450 => 0.7562, std.dev.: 0.0207) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.95% (0.1062 => 0.1242, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.67% (0.0648 => 0.0756, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.36% (0.8172 => 0.9509, std.dev.: 0.0402) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.04% (0.3136 => 0.3639, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.87% (0.3427 => 0.3971, std.dev.: 0.0096) MultiSource/Applications/lua/lua: 15.87% (3.8723 => 4.4868, std.dev.: 0.1728) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 15.84% (0.2430 => 0.2815, std.dev.: 0.0092) MultiSource/Benchmarks/Olden/mst/mst: 15.82% (0.1163 => 0.1347, std.dev.: 0.0069) SingleSource/UnitTests/SignlessTypes/rem: 15.73% (0.1144 => 0.1324, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/messages-2: 15.71% (0.0662 => 0.0766, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.50% (0.2065 => 0.2385, std.dev.: 0.0120) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.24% (0.0886 => 0.1021, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.11% (0.0953 => 0.1097, std.dev.: 0.0024) MultiSource/Applications/viterbi/viterbi: 14.79% (0.1555 => 0.1785, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.68% (0.0770 => 0.0883, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.64% (4.9449 => 5.6690, std.dev.: 0.2086) MultiSource/Benchmarks/NPB-serial/is/is: 14.60% (0.0719 => 0.0824, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.44% (0.1337 => 0.1530, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.43% (0.2758 => 0.3156, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.41% (0.1117 => 0.1278, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.04% (0.5981 => 0.6821, std.dev.: 0.0325) MultiSource/Applications/spiff/spiff: 13.87% (0.7835 => 0.8922, std.dev.: 0.0224) SingleSource/Benchmarks/Misc/ReedSolomon: 13.62% (0.2049 => 0.2328, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.51% (0.1029 => 0.1168, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.45% (0.5860 => 0.6648, std.dev.: 0.0300) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.40% (0.5105 => 0.5789, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 13.29% (17.1811 => 19.4637, std.dev.: 0.7118) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.21% (0.1143 => 0.1294, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.76% (0.3935 => 0.4437, std.dev.: 0.0113) SingleSource/UnitTests/ObjC/parameter-passing: 12.40% (0.3927 => 0.4414, std.dev.: 0.0103) SingleSource/UnitTests/ObjC/trivial-interface: 12.06% (0.3473 => 0.3892, std.dev.: 0.0134) SingleSource/UnitTests/ObjC/exceptions-4: 12.02% (0.3543 => 0.3969, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/property: 11.99% (0.3886 => 0.4352, std.dev.: 0.0104) SingleSource/UnitTests/ObjC/exceptions-2: 11.90% (0.3497 => 0.3913, std.dev.: 0.0085) SingleSource/UnitTests/ObjC/exceptions-3: 11.86% (0.3516 => 0.3933, std.dev.: 0.0081) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.77% (0.3543 => 0.3960, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/exceptions: 11.73% (0.3828 => 0.4277, std.dev.: 0.0093) SingleSource/UnitTests/ObjC/for-in: 11.59% (0.3694 => 0.4122, std.dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.33% (0.1906 => 0.2122, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/lists: 10.93% (0.3422 => 0.3796, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 10.42% (0.1440 => 0.1590, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/moments: 10.38% (0.4048 => 0.4468, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 10.33% (10.3673 => 11.4386, std.dev.: 0.3274) SingleSource/UnitTests/ObjC++/property-reference-object: 9.47% (0.6030 => 0.6601, std.dev.: 0.0221) SingleSource/Benchmarks/Shootout-C++/hello: 8.88% (0.2714 => 0.2955, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.63% (0.2793 => 0.3034, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.34% (0.4879 => 0.5237, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/objinst: 6.68% (0.3131 => 0.3340, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.30% (4.3953 => 11.0014, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/methcall: 147.39% (5.3999 => 13.3590, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 34.61% (3.7221 => 5.0105, std.dev.: 0.0603) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 31.97% (0.3256 => 0.4297, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout/ary3: 20.41% (3.6994 => 4.4544, std.dev.: 0.1457) SingleSource/Benchmarks/Shootout-C++/ary: 19.71% (0.0756 => 0.0905, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 17.46% (6.6465 => 7.8072, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary2: 16.91% (0.0757 => 0.0885, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.65% (1.1145 => 1.3001, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.31% (0.0864 => 0.0979, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.94% (0.2944 => 0.3325, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.65% (2.8904 => 3.2270, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 10.19% (1.1396 => 1.2557, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.26% (1.7254 => 1.8851, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 8.09% (3.1578 => 3.4134, std.dev.: 0.0750) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 5.89% (1.2373 => 1.3102, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.78% (4.2280 => 4.4724, std.dev.: 0.0079) MultiSource/Applications/lua/lua: 5.12% (26.0924 => 27.4290, std.dev.: 0.1672) SingleSource/Regression/C/uint64_to_float: 5.10% (0.5413 => 0.5689, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.41% (1.7133 => 1.7888, std.dev.: 0.0052) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6436 => 12.1147, std.dev.: 0.0173) MultiSource/Applications/sgefa/sgefa: 3.66% (0.6223 => 0.6451, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.34% (0.4162 => 0.4301, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 2.33% (3.8532 => 3.9429, std.dev.: 0.0210) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 2.10% (3.1595 => 3.2258, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 1.86% (85.0658 => 86.6485, std.dev.: 0.1908) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.83% (2.1424 => 2.1816, std.dev.: 0.0129) SingleSource/Benchmarks/Dhrystone/dry: 1.79% (2.4116 => 2.4547, std.dev.: 0.0128) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.56% (6.5088 => 6.6102, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 1.48% (27.8444 => 28.2568, std.dev.: 0.0248) SingleSource/Benchmarks/Shootout-C++/sieve: 1.44% (2.4858 => 2.5216, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/sieve: 1.33% (5.2139 => 5.2831, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists: 1.27% (12.5348 => 12.6943, std.dev.: 0.0594) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0500, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.38% (6.6874 => 0.1749, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.88% (5.2763 => 1.2726, std.dev.: 0.0271) SingleSource/Benchmarks/Misc/salsa20: -75.70% (0.8651 => 0.2102, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/richards_benchmark: -45.19% (0.1622 => 0.0889, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.59% (5.3526 => 4.6788, std.dev.: 0.1576) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.02% (5.3855 => 4.7379, std.dev.: 0.1380) MultiSource/Applications/JM/ldecod/ldecod: -10.37% (10.4361 => 9.3537, std.dev.: 0.3850) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.36% (0.3987 => 0.2378, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.24% (4.5009 => 2.7797, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.14% (2.6546 => 2.0139, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: -19.44% (0.2161 => 0.1741, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4221, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.72% (2.6778 => 2.2836, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.79% (32.5116 => 29.0043, std.dev.: 0.0232) SingleSource/Benchmarks/Misc/mandel-2: -10.62% (1.5373 => 1.3740, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -10.53% (9.5636 => 8.5569, std.dev.: 0.2429) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4244, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.18% (19.9488 => 18.5169, std.dev.: 0.4745) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.60% (3.2416 => 3.0600, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.59% (2.7294 => 2.5769, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7497, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.45% (1.6805 => 1.5889, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -4.87% (1.5835 => 1.5064, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/lists: -4.27% (6.2999 => 6.0310, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.34% (0.9957 => 0.9624, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8915, std.dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.37% (0.4808 => 0.4694, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.78% (8.1563 => 8.0112, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/salsa20: -1.48% (10.2830 => 10.1313, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.28% (0.1485 => 0.1362, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0013) Report Time: 3.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 21:53:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 23 Nov 2012 23:53:31 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121124055331.0CEFE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6191?compare_to=6188&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6191, Order: 168535, Start Time: 2012-11-24 04:22:28, End Time: 2012-11-24 05:53:58 To: 6188, Order: 168532, Start Time: 2012-11-24 02:31:25, End Time: 2012-11-24 04:05:24 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 8 (90 on baseline) Performance Improvements: 11 (22 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1035 (862 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.01% (0.6157 => 0.6404, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.40% (1.1737 => 1.2136, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.43% (0.5055 => 0.5178, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.37% (0.9576 => 0.9803, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.01% (0.6453 => 0.6583, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.72% (0.6147 => 0.6253, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.41% (1.6910 => 1.7148, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 8.71% (1.7200 => 1.8698, std.dev.: 0.0097) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.47% (0.2684 => 0.2564, std.dev.: 0.0041) MultiSource/Applications/minisat/minisat: -2.53% (0.7232 => 0.7049, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.26% (1.2417 => 1.2260, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.22% (2.2375 => 2.2103, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Stanford/Perm: -23.75% (0.0421 => 0.0321, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: -7.57% (1.0833 => 1.0013, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -7.39% (0.3530 => 0.3269, std.dev.: 0.0088) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.90% (1.2810 => 1.2439, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.54% (22.8115 => 22.2326, std.dev.: 0.1550) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.01% (3.6267 => 3.5539, std.dev.: 0.0194) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.12% (1.4296 => 1.4136, std.dev.: 0.0061) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.21% (1.0724 => 1.0747, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -21.66% (0.0217 => 0.0170, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0428 => 0.0429, std.dev.: 0.0137) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.55% (0.0332 => 0.0287, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.92% (0.0313 => 0.0319, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.91% (0.0428 => 0.0407, std.dev.: 0.0112) SingleSource/UnitTests/Vector/Altivec/casts: -16.43% (0.0207 => 0.0173, std.dev.: 0.0077) SingleSource/UnitTests/Vector/Altivec/test1: 2.28% (0.0219 => 0.0224, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.40% (0.1483 => 0.1477, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -1.93% (1.2164 => 1.1929, std.dev.: 0.0083) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.27% (0.4137 => 0.4355, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.42% (0.1412 => 0.1432, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.65% (0.0642 => 0.0659, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -23.38% (0.0278 => 0.0213, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.44% (0.0585 => 0.0559, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.02% (1.2054 => 1.1931, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.17% (0.0583 => 0.0584, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 12.24% (0.0237 => 0.0266, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.19% (0.7803 => 0.7788, std.dev.: 0.0010) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -18.18% (0.0088 => 0.0072, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.21% (16.4461 => 17.6314, std.dev.: 0.0803) MultiSource/Applications/sqlite3/sqlite3: 2316.38% (0.6332 => 15.3005, std.dev.: 0.1354) MultiSource/Benchmarks/McCat/08-main/main: 48.44% (0.1831 => 0.2718, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.61% (0.1559 => 0.1456, std.dev.: 0.0249) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7074.99% (0.3123 => 22.4075, std.dev.: 0.7018) SingleSource/Benchmarks/CoyoteBench/fftbench: 52.05% (0.2463 => 0.3745, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1522.67% (0.3344 => 5.4262, std.dev.: 0.0287) SingleSource/Benchmarks/Misc-C++/Large/ray: 39.59% (0.2364 => 0.3300, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/bigfib: 4.79% (0.6010 => 0.6298, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: 2.80% (0.0429 => 0.0441, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.56% (0.3266 => 0.3415, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/strcat: 3.91% (0.1969 => 0.2046, std.dev.: 0.0052) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -4.02% (0.0224 => 0.0215, std.dev.: 0.0071) SingleSource/UnitTests/byval-alignment: -27.83% (0.0230 => 0.0166, std.dev.: 0.0051) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0434, std.dev.: 0.0042) MultiSource/Applications/oggenc/oggenc: 11.90% (0.1462 => 0.1636, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4677, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0729, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4881, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5123, std.dev.: 0.0298) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.6625, std.dev.: 0.2406) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3221, std.dev.: 0.0295) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1452, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3630, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4100, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0833, std.dev.: 0.0020) SingleSource/Regression/C/uint64_to_float: -23.66% (2.1832 => 1.6667, std.dev.: 0.0290) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0006) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.05% (0.0810 => 0.0940, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.02% (0.0830 => 0.0963, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.85% (0.0848 => 0.0957, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 12.14% (0.1112 => 0.1247, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.32% (0.1425 => 0.1572, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.39% (0.8321 => 0.8936, std.dev.: 0.0219) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.89% (0.7473 => 0.7988, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.83% (0.4847 => 0.5178, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.79% (0.2180 => 0.2328, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.56% (0.6010 => 0.6404, std.dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.38% (0.4783 => 0.5088, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.65% (0.1983 => 0.2095, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 5.43% (1.2222 => 1.2886, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.42% (0.3137 => 0.3307, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.92% (1.1685 => 1.2260, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.90% (0.5961 => 0.6253, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.87% (0.2998 => 0.3144, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.71% (0.6287 => 0.6583, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.69% (0.2240 => 0.2345, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.65% (1.6386 => 1.7148, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.57% (1.1606 => 1.2136, std.dev.: 0.0081) MultiSource/Applications/sgefa/sgefa: 4.37% (0.2999 => 0.3130, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.26% (0.8148 => 0.8495, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.24% (0.9056 => 0.9440, std.dev.: 0.0082) MultiSource/Applications/spiff/spiff: 4.10% (0.7950 => 0.8276, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.90% (0.9435 => 0.9803, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.82% (0.3295 => 0.3421, std.dev.: 0.0036) MultiSource/Applications/treecc/treecc: 3.79% (1.9948 => 2.0705, std.dev.: 0.0060) MultiSource/Applications/SPASS/SPASS: 3.53% (14.2605 => 14.7646, std.dev.: 0.0088) MultiSource/Applications/hbd/hbd: 3.50% (1.4269 => 1.4769, std.dev.: 0.0128) MultiSource/Applications/lua/lua: 3.38% (3.8189 => 3.9481, std.dev.: 0.0234) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.29% (1.3279 => 1.3716, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.28% (2.1401 => 2.2103, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 3.22% (4.1305 => 4.2633, std.dev.: 0.0320) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.21% (1.2526 => 1.2928, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.16% (0.5817 => 0.6001, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 3.15% (0.6834 => 0.7049, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.10% (0.6227 => 0.6420, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 3.10% (2.2184 => 2.2871, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.07% (0.8340 => 0.8596, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.91% (1.5315 => 1.5761, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.91% (0.4127 => 0.4247, std.dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 2.80% (1.1271 => 1.1587, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.69% (1.1170 => 1.1471, std.dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.69% (0.3717 => 0.3817, std.dev.: 0.0036) MultiSource/Applications/SIBsim4/SIBsim4: 2.67% (1.2568 => 1.2904, std.dev.: 0.0092) MultiSource/Applications/d/make_dparser: 2.62% (3.2366 => 3.3215, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/05-eks/eks: 2.50% (0.4397 => 0.4507, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.40% (4.4880 => 4.5958, std.dev.: 0.0249) MultiSource/Applications/JM/ldecod/ldecod: 2.37% (6.7320 => 6.8918, std.dev.: 0.0477) MultiSource/Applications/ClamAV/clamscan: 2.36% (14.7684 => 15.1174, std.dev.: 0.1133) MultiSource/Applications/JM/lencod/lencod: 2.35% (15.3280 => 15.6882, std.dev.: 0.0577) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.31% (8.6476 => 8.8474, std.dev.: 0.0147) MultiSource/Applications/hexxagon/hexxagon: 2.29% (0.9810 => 1.0035, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.10% (0.6586 => 0.6724, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.08% (3.1832 => 3.2494, std.dev.: 0.0123) MultiSource/Applications/lemon/lemon: 1.95% (1.0945 => 1.1158, std.dev.: 0.0057) MultiSource/Applications/oggenc/oggenc: 1.73% (4.9628 => 5.0487, std.dev.: 0.0207) MultiSource/Applications/lambda-0_1_3/lambda: 1.71% (0.7557 => 0.7686, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.26% (1.2602 => 1.2761, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 112.06% (0.0199 => 0.0422, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/pi: 58.32% (1.5795 => 2.5006, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 20.27% (0.0528 => 0.0635, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.86% (0.7597 => 0.8954, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.36% (2.9753 => 3.4621, std.dev.: 0.0637) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.54% (2.7995 => 3.2066, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6086, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.62% (1.1857 => 1.2760, std.dev.: 0.0064) SingleSource/Benchmarks/McGill/queens: 7.41% (1.7056 => 1.8320, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.78% (4.7794 => 5.1035, std.dev.: 0.0430) SingleSource/Benchmarks/Misc/richards_benchmark: 6.13% (1.3037 => 1.3836, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.95% (4.5327 => 4.8023, std.dev.: 0.0111) MultiSource/Applications/SIBsim4/SIBsim4: 5.93% (3.1873 => 3.3764, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.75% (6.2275 => 6.5230, std.dev.: 0.0114) MultiSource/Applications/lambda-0_1_3/lambda: 4.70% (7.4933 => 7.8454, std.dev.: 0.0261) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.45% (3.3761 => 3.5263, std.dev.: 0.0272) MultiSource/Applications/hexxagon/hexxagon: 3.91% (14.0064 => 14.5547, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.29% (0.3587 => 0.3705, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: 3.19% (7.3375 => 7.5712, std.dev.: 0.0318) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.15% (1.2337 => 1.2726, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 3.08% (3.6643 => 3.7771, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.81% (11.5690 => 11.8936, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.77% (8.2783 => 8.5074, std.dev.: 0.0128) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.21% (1.1365 => 1.1616, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: 1.48% (1.2061 => 1.2240, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/whetstone: 1.43% (2.1224 => 2.1527, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: 1.28% (1.0841 => 1.0980, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.22% (2.4647 => 2.4947, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/ReedSolomon: 1.21% (8.5322 => 8.6355, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.08% (3.5679 => 3.6066, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.05% (5.4641 => 4.3137, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.62% (7.2130 => 6.3024, std.dev.: 0.2125) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.17% (1.0512 => 0.9338, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -10.73% (1.1216 => 1.0013, std.dev.: 0.0150) MultiSource/Benchmarks/mafft/pairlocalalign: -8.52% (63.1822 => 57.8001, std.dev.: 0.1776) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.34% (14.6451 => 13.4244, std.dev.: 0.1717) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.85% (4.7482 => 4.4230, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.90% (0.3269 => 0.3076, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.22% (5.1557 => 4.8866, std.dev.: 0.0502) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.41% (4.7449 => 4.5358, std.dev.: 0.0280) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.88% (2.4490 => 2.3539, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.79% (6.0224 => 5.7942, std.dev.: 0.0826) MultiSource/Applications/lua/lua: -3.10% (29.8330 => 28.9071, std.dev.: 0.0691) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.05% (0.5807 => 0.5630, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.05% (28.5821 => 27.7112, std.dev.: 0.0698) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.99% (1.2822 => 1.2439, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.50% (9.9065 => 9.6588, std.dev.: 0.0823) MultiSource/Applications/aha/aha: -2.45% (3.3398 => 3.2580, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bisort/bisort: -2.38% (0.6636 => 0.6478, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.84% (3.2169 => 3.1576, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash2: -1.35% (3.4237 => 3.3775, std.dev.: 0.0111) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.09% (2.3487 => 2.3232, std.dev.: 0.0062) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.73% (1.0262 => 1.0747, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 38.21% (0.0123 => 0.0170, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.15% (0.0408 => 0.0429, std.dev.: 0.0137) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 12.99% (0.0254 => 0.0287, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.63% (0.0302 => 0.0319, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 5.99% (0.0384 => 0.0407, std.dev.: 0.0112) SingleSource/UnitTests/Vector/Altivec/casts: -8.95% (0.0190 => 0.0173, std.dev.: 0.0077) SingleSource/UnitTests/Vector/Altivec/test1: 24.44% (0.0180 => 0.0224, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.71% (0.1438 => 0.1477, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 5.30% (1.1329 => 1.1929, std.dev.: 0.0083) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.59% (0.4164 => 0.4355, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.60% (0.1369 => 0.1432, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.81% (0.0641 => 0.0659, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 9.23% (0.0195 => 0.0213, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.29% (0.0578 => 0.0559, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.32% (1.1437 => 1.1931, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.86% (0.0627 => 0.0584, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.86% (0.8017 => 0.7788, std.dev.: 0.0010) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 16.13% (0.0062 => 0.0072, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 22:03:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 00:03:54 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121124060354.776562A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6192?compare_to=6189&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6192, Order: 168535, Start Time: 2012-11-24 04:30:54, End Time: 2012-11-24 06:04:21 To: 6189, Order: 168532, Start Time: 2012-11-24 02:34:30, End Time: 2012-11-24 04:07:59 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (7 on baseline) Performance Improvements: 0 (180 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1090 (855 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.82% (54.4554 => 56.5365, std.dev.: 0.1196) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.77% (79.5563 => 80.9640, std.dev.: 0.3895) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 10.93% (0.3834 => 0.4253, std.dev.: 0.0092) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.59% (54.5751 => 56.5365, std.dev.: 0.1196) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1008, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: 2.38% (7.4937 => 7.6721, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 2.17% (3.1932 => 3.2624, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.56% (79.7170 => 80.9640, std.dev.: 0.3895) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.11% (0.3821 => 0.3511, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.76% (0.9542 => 0.8897, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.75% (0.3142 => 0.2930, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -6.74% (2.4924 => 2.3244, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -6.52% (0.3357 => 0.3138, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.43% (0.2428 => 0.2272, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/oourafft: -6.39% (0.2160 => 0.2022, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -6.35% (9.2283 => 8.6424, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.31% (0.9852 => 0.9230, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: -6.24% (0.3812 => 0.3574, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.24% (0.3880 => 0.3638, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -6.22% (16.1920 => 15.1855, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/synchronized: -6.19% (0.3896 => 0.3655, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -6.17% (7.0961 => 6.6584, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.14% (0.6484 => 0.6086, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.11% (0.7198 => 0.6758, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -6.11% (0.3848 => 0.3613) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.09% (0.3891 => 0.3654, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.08% (0.4176 => 0.3922, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-2: -6.08% (0.3831 => 0.3598, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.07% (0.1796 => 0.1687, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: -6.03% (0.4033 => 0.3790, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.02% (1.3722 => 1.2896, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: -6.00% (0.9179 => 0.8628, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.96% (0.3658 => 0.3440, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.96% (4.8161 => 4.5293, std.dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.95% (6.7716 => 6.3688, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.94% (0.2355 => 0.2215, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.93% (1.0544 => 0.9919, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.88% (3.5339 => 3.3262, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.87% (0.5863 => 0.5519, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.85% (4.0323 => 3.7963, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.81% (0.5591 => 0.5266, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.80% (1.2300 => 1.1586, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -5.79% (4.3330 => 4.0820, std.dev.: 0.0082) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.79% (0.2695 => 0.2539, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.75% (0.5478 => 0.5163, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.74% (4.8802 => 4.6000, std.dev.: 0.0066) MultiSource/Benchmarks/sim/sim: -5.73% (0.3406 => 0.3211, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.72% (0.3884 => 0.3662, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -5.72% (0.4199 => 0.3959) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.71% (0.5705 => 0.5379, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.69% (1.4642 => 1.3809, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.68% (0.6667 => 0.6288, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.68% (0.6052 => 0.5708, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.67% (1.6364 => 1.5436, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.66% (0.6293 => 0.5937, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.64% (0.6736 => 0.6356, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.64% (0.5570 => 0.5256, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.63% (0.6230 => 0.5879, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -5.62% (1.1450 => 1.0807, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/05-eks/eks: -5.60% (0.4515 => 0.4262, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -5.60% (1.1530 => 1.0884, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.60% (0.6194 => 0.5847, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.59% (0.5941 => 0.5609, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -5.58% (0.4280 => 0.4041, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.58% (0.5859 => 0.5532, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.57% (0.5849 => 0.5523, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.56% (0.6260 => 0.5912, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.56% (0.7919 => 0.7479, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.55% (0.5857 => 0.5532, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -5.55% (1.2515 => 1.1821, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.54% (0.5581 => 0.5272, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.53% (0.6297 => 0.5949, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.52% (1.2784 => 1.2078, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.51% (4.5069 => 4.2587, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.50% (0.5925 => 0.5599, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.50% (0.5456 => 0.5156, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.50% (0.5805 => 0.5486, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.49% (0.2548 => 0.2408, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.49% (0.6189 => 0.5849, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -5.46% (0.2985 => 0.2822, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.45% (0.6446 => 0.6095, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.41% (0.5802 => 0.5488, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.41% (0.6660 => 0.6300, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.40% (0.5999 => 0.5675, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.39% (0.4916 => 0.4651, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: -5.38% (0.2659 => 0.2516, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.37% (0.6440 => 0.6094, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.37% (14.2083 => 13.4455, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.36% (0.6676 => 0.6318, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -5.36% (0.3581 => 0.3389, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.36% (0.6681 => 0.6323, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.35% (1.3864 => 1.3122, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -5.34% (17.1032 => 16.1904, std.dev.: 0.0194) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.33% (0.8521 => 0.8067, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: -5.33% (15.5079 => 14.6819, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.32% (1.2221 => 1.1571, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.30% (0.2999 => 0.2840, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.30% (0.6304 => 0.5970, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.29% (8.0126 => 7.5887, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.27% (1.2210 => 1.1566, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.27% (0.2278 => 0.2158, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.25% (0.6033 => 0.5716, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.23% (0.3483 => 0.3301, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.20% (0.2385 => 0.2261, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -5.16% (0.7447 => 0.7063, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.14% (0.3931 => 0.3729, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.13% (0.4151 => 0.3938, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.13% (0.5575 => 0.5289, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.12% (0.5688 => 0.5397, std.dev.: 0.0063) MultiSource/Applications/lua/lua: -5.11% (4.0594 => 3.8521, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/fibo: -5.09% (0.2871 => 0.2725, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -5.07% (2.4021 => 2.2803, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.06% (0.3319 => 0.3151, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.05% (0.4321 => 0.4103, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: -5.03% (3.5154 => 3.3386, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: -5.01% (1.3148 => 1.2489, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.01% (0.2933 => 0.2786, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.00% (1.6474 => 1.5651, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.97% (0.5168 => 0.4911, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.97% (0.3057 => 0.2905, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -4.97% (0.2939 => 0.2793, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.95% (0.7339 => 0.6976, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.94% (22.4056 => 21.2997, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.94% (0.3323 => 0.3159, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: -4.93% (0.3446 => 0.3276, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.92% (0.2989 => 0.2842, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -4.92% (0.3255 => 0.3095, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.91% (0.3016 => 0.2868, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.89% (0.2903 => 0.2761, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.89% (0.7524 => 0.7156, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.89% (0.2106 => 0.2003, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -4.86% (0.3394 => 0.3229, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -4.85% (0.4248 => 0.4042, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.85% (0.3837 => 0.3651, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -4.84% (15.2527 => 14.5143, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/wc: -4.84% (0.3205 => 0.3050, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.84% (2.1713 => 2.0663, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: -4.83% (0.3271 => 0.3113, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -4.77% (0.2849 => 0.2713, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.77% (0.3252 => 0.3097, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -4.76% (0.3025 => 0.2881, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -4.76% (0.3026 => 0.2882, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: -4.75% (0.7982 => 0.7603, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.74% (0.7021 => 0.6688, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -4.73% (2.1401 => 2.0388, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.70% (0.3849 => 0.3668, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.69% (0.5329 => 0.5079, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: -4.69% (0.4861 => 0.4633, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -4.68% (0.3481 => 0.3318, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.68% (0.4083 => 0.3892, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.64% (0.6395 => 0.6098) MultiSource/Applications/spiff/spiff: -4.63% (0.8418 => 0.8028, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.62% (0.9557 => 0.9115, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.62% (0.5567 => 0.5310, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: -4.60% (0.3194 => 0.3047, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.58% (0.3059 => 0.2919, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.55% (0.3867 => 0.3691, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.55% (0.6395 => 0.6104, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.53% (0.9077 => 0.8666, std.dev.: 0.0042) MultiSource/Applications/kimwitu++/kc: -4.51% (18.2933 => 17.4688, std.dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.48% (2.2587 => 2.1576, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.45% (0.5569 => 0.5321, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -4.45% (0.3621 => 0.3460, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.38% (0.3491 => 0.3338, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -4.37% (5.0226 => 4.8029, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.36% (0.4427 => 0.4234, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -4.31% (34.0927 => 32.6233, std.dev.: 0.0053) SingleSource/UnitTests/ObjC++/Hello: -4.30% (0.6347 => 0.6074, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.30% (0.4813 => 0.4606, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.22% (0.7779 => 0.7451, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: -4.21% (0.6750 => 0.6466, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.13% (0.6441 => 0.6175, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -4.12% (0.3788 => 0.3632, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: -3.96% (0.4524 => 0.4345, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.63% (5.4682 => 5.2698, std.dev.: 0.0051) MultiSource/Applications/hbd/hbd: -3.61% (1.5610 => 1.5047, std.dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -2.13% (20.7746 => 20.3316, std.dev.: 0.0221) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7541, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1729, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.61% (2.2633 => 2.1816, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0245, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4683, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 23:20:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 01:20:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121124072041.0CBDF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6193?compare_to=6187&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6193, Order: 168533, Start Time: 2012-11-24 04:00:17, End Time: 2012-11-24 07:21:08 To: 6187, Order: 168525, Start Time: 2012-11-23 23:51:19, End Time: 2012-11-24 03:12:12 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (171 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1088 (719 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 8.85% (108.8626 => 118.4964, std.dev.: 0.1153) SingleSource/Benchmarks/Misc/whetstone: 1.08% (2.7880 => 2.8180, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.07% (54.1046 => 54.6822, std.dev.: 0.1491) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.84% (129.3150 => 124.3438, std.dev.: 1.6566) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.40% (0.0625 => 0.0890, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.83% (0.1063 => 0.1412, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.32% (0.0475 => 0.0600, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.27% (0.2969 => 0.3749, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.59% (0.1106 => 0.1389, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.37% (0.4139 => 0.5189, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.90% (0.4253 => 0.5312, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.79% (0.0714 => 0.0891, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 23.89% (1.5932 => 1.9738, std.dev.: 0.0116) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.56% (0.5900 => 0.7290, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.35% (0.4994 => 0.6160, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.29% (0.0584 => 0.0720, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.68% (0.5000 => 0.6134, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.04% (0.1620 => 0.1977, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.96% (0.0897 => 0.1094, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.94% (0.1021 => 0.1245, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.68% (0.1107 => 0.1347, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.85% (0.0633 => 0.0765) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.72% (0.0584 => 0.0705, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.58% (0.1103 => 0.1330, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 20.57% (0.0948 => 0.1143, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.55% (0.3903 => 0.4705, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.40% (0.0642 => 0.0773, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.40% (0.0495 => 0.0596, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 20.22% (0.0821 => 0.0987, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.04% (0.1003 => 0.1204, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.01% (0.1549 => 0.1859, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.83% (0.1604 => 0.1922, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.71% (0.0822 => 0.0984, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 19.70% (0.1619 => 0.1938, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.02% (0.1462 => 0.1740, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.80% (0.0947 => 0.1125, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.64% (0.2736 => 0.3246, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.46% (0.3890 => 0.4608, std.dev.: 0.0023) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.27% (0.2014 => 0.2382, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.21% (0.2866 => 0.3388, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: 18.14% (0.1218 => 0.1439, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 17.91% (0.0698 => 0.0823, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 17.90% (0.5826 => 0.6869, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.89% (1.3152 => 1.5505, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.89% (0.1968 => 0.2320, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 17.67% (0.4029 => 0.4741, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 17.64% (0.5889 => 0.6928, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 17.48% (0.1505 => 0.1768, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.46% (0.1088 => 0.1278, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.24% (0.4658 => 0.5461, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 17.06% (0.5546 => 0.6492, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/gs/gs: 16.97% (1.8794 => 2.1984, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.79% (3.5627 => 4.1607, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.75% (0.5026 => 0.5868, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.67% (0.3930 => 0.4585, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.47% (0.1160 => 0.1351, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.45% (0.3271 => 0.3809, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.37% (1.6211 => 1.8864, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.05% (0.4361 => 0.5061, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/18-imp/imp: 15.97% (0.1421 => 0.1648, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 15.94% (1.0781 => 1.2499, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 15.84% (0.9697 => 1.1233, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.72% (0.2875 => 0.3327, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.66% (4.4195 => 5.1117, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 15.49% (4.2109 => 4.8631, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: 15.42% (0.1284 => 0.1482, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 15.40% (0.7171 => 0.8275, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.38% (0.2738 => 0.3159, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.30% (2.7292 => 3.1468, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: 15.00% (0.2714 => 0.3121, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 14.98% (0.2750 => 0.3162, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 14.98% (0.3004 => 0.3454, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 14.94% (0.2725 => 0.3132, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 14.93% (0.2780 => 0.3195, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.92% (1.9694 => 2.2632, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 14.92% (0.9909 => 1.1387, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/nestedloop: 14.88% (0.2729 => 0.3135, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.86% (0.1090 => 0.1252, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.84% (0.3195 => 0.3669, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 14.81% (0.2803 => 0.3218, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 14.76% (0.2811 => 0.3226, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 14.74% (0.2823 => 0.3239, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.72% (0.2792 => 0.3203, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 14.72% (0.2813 => 0.3227, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.70% (1.9966 => 2.2902, std.dev.: 0.0050) MultiSource/Benchmarks/Bullet/bullet: 14.65% (23.5202 => 26.9659, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.63% (0.2911 => 0.3337, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 14.57% (0.3096 => 0.3547, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.54% (2.0673 => 2.3678, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/football/football: 14.51% (0.2075 => 0.2376, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 14.29% (0.3267 => 0.3734, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary: 14.15% (0.3258 => 0.3719, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 14.07% (0.2566 => 0.2927, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 14.02% (1.4269 => 1.6270, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 13.96% (0.3317 => 0.3780, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.92% (0.3362 => 0.3830, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.85% (0.3488 => 0.3971, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 13.77% (0.4146 => 0.4717, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.76% (0.3060 => 0.3481, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 13.65% (0.3678 => 0.4180, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.57% (0.3124 => 0.3548, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 13.56% (0.3348 => 0.3802, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.47% (0.3282 => 0.3724, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 13.45% (0.7875 => 0.8934, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: 13.44% (0.3446 => 0.3909, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 13.43% (0.3477 => 0.3944, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.42% (0.3465 => 0.3930, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.39% (0.3496 => 0.3964, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.32% (0.3469 => 0.3931, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 13.29% (0.3726 => 0.4221, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.28% (0.3442 => 0.3899, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.27% (0.3460 => 0.3919, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.19% (0.3625 => 0.4103, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 13.17% (0.4251 => 0.4811, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.08% (0.3845 => 0.4348, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions: 12.98% (0.3643 => 0.4116, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.96% (0.3650 => 0.4123, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.90% (0.3690 => 0.4166, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 12.89% (2.1653 => 2.4443, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.81% (0.3981 => 0.4491, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 12.70% (4.6177 => 5.2040, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/parameter-passing: 12.67% (0.3724 => 0.4196, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 12.53% (0.5012 => 0.5640, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 12.47% (2.1013 => 2.3634, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 12.11% (0.2691 => 0.3017, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 11.98% (5.5417 => 6.2058, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.81% (0.2040 => 0.2281, std.dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: 11.49% (0.3498 => 0.3900, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.48% (0.1028 => 0.1146, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.42% (0.6435 => 0.7170, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 11.06% (0.6634 => 0.7368, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.77% (0.1383 => 0.1532, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.67% (0.2737 => 0.3029, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.67% (0.3084 => 0.3413, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 10.67% (0.4847 => 0.5364, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.64% (0.2068 => 0.2288, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 10.22% (0.3336 => 0.3677, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.94% (0.2103 => 0.2312, std.dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: 9.66% (2.0346 => 2.2311, std.dev.: 0.0176) MultiSource/Applications/lemon/lemon: 9.58% (0.2391 => 0.2620, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.97% (0.5361 => 0.5842, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.85% (4.6926 => 5.1081, std.dev.: 0.0057) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.66% (11.6398 => 12.6481, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.12% (0.7426 => 0.8029, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.08% (0.5584 => 0.6035, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 6.81% (11.9555 => 12.7701, std.dev.: 0.0142) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.01% (0.3792 => 0.3944, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.27% (0.5917 => 0.6702, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 9.60% (0.2802 => 0.3071, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6103, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.50% (0.3693 => 0.3896, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary: 5.42% (0.2122 => 0.2237, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6713, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-2: 4.76% (1.8057 => 1.8917, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1725, std.dev.: 0.0231) SingleSource/Benchmarks/Dhrystone/dry: 4.17% (14.0481 => 14.6339, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1954, std.dev.: 0.0086) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2230, std.dev.: 0.0030) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3060, std.dev.: 0.0130) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2858, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5147, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.09% (50.0626 => 50.6061, std.dev.: 0.0283) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.32% (2.4764 => 2.3942, std.dev.: 0.0216) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.74% (25.4195 => 16.5876, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ary2: -9.41% (0.2402 => 0.2176, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9768, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8035, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8055, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0046) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -2.57% (17.2379 => 16.7954, std.dev.: 0.0805) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8597, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.67% (10.7630 => 10.5832, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4953, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.11% (105.3826 => 104.2118, std.dev.: 0.0152) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0410, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 23 23:40:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 01:40:41 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121124074041.B59342A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6194?compare_to=6191&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6194, Order: 168536, Start Time: 2012-11-24 06:11:05, End Time: 2012-11-24 07:41:11 To: 6191, Order: 168535, Start Time: 2012-11-24 04:22:28, End Time: 2012-11-24 05:53:58 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 10 (117 on baseline) Performance Improvements: 5 (26 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1039 (831 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 5.32% (0.1936 => 0.2039, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.65% (0.2344 => 0.2453, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.46% (0.9803 => 0.9946, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 1.20% (1.1158 => 1.1292, std.dev.: 0.0052) MultiSource/Applications/hbd/hbd: 1.05% (1.4769 => 1.4924, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.78% (2.6696 => 2.7704, std.dev.: 0.0079) MultiSource/Applications/SPASS/SPASS: 2.60% (8.3894 => 8.6077, std.dev.: 0.0545) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.29% (1.8698 => 1.8940, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: 1.23% (1.0013 => 1.0136, std.dev.: 0.0041) MultiSource/Benchmarks/BitBench/five11/five11: 1.21% (5.5969 => 5.6644, std.dev.: 0.0098) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: -5.70% (0.2542 => 0.2397, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.79% (0.5088 => 0.4895, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.11% (0.8645 => 0.8463, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.50% (0.8975 => 0.8840, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash2: -1.06% (3.3775 => 3.3418, std.dev.: 0.0046) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.94% (1.0747 => 1.0538, std.dev.: 0.0155) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 8.24% (0.0170 => 0.0184, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.93% (0.0429 => 0.0425, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 15.68% (0.0287 => 0.0332, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.57% (0.0319 => 0.0314, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.86% (0.0407 => 0.0375, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/casts: 17.92% (0.0173 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -17.86% (0.0224 => 0.0184, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -0.34% (0.1477 => 0.1472, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -4.77% (1.1929 => 1.1360, std.dev.: 0.0471) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.18% (0.4355 => 0.4363, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.44% (0.1432 => 0.1467, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -13.51% (0.0659 => 0.0570, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.96% (0.0213 => 0.0179, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.30% (0.0559 => 0.0611, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.03% (1.1931 => 1.1928, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.34% (0.0584 => 0.0582, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.27% (0.0266 => 0.0244, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.56% (0.7788 => 0.7832, std.dev.: 0.0052) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 29.17% (0.0072 => 0.0093, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.07% (16.4461 => 17.6091, std.dev.: 0.3247) MultiSource/Applications/sqlite3/sqlite3: 2312.21% (0.6332 => 15.2741, std.dev.: 0.2984) MultiSource/Benchmarks/McCat/08-main/main: 48.33% (0.1831 => 0.2716, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.74% (0.1559 => 0.1454, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7029.72% (0.3123 => 22.2661, std.dev.: 0.4944) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.04% (0.2463 => 0.3720, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1524.67% (0.3344 => 5.4329, std.dev.: 0.0643) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.51% (0.2364 => 0.3227, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 4.84% (0.6010 => 0.6301, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0429 => 0.0439, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.78% (0.3266 => 0.3422, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/strcat: 3.71% (0.1969 => 0.2042, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.14% (0.0224 => 0.0240, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0460, std.dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: 5.81% (0.1462 => 0.1547, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4577, std.dev.: 0.0454) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0699, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4945, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5149, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.6033, std.dev.: 0.2937) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3164, std.dev.: 0.0200) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1308, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3635, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4062, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0828, std.dev.: 0.0021) SingleSource/Regression/C/uint64_to_float: -24.02% (2.1832 => 1.6589, std.dev.: 0.0055) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.28% (0.0810 => 0.0950, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.61% (0.0830 => 0.0943, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 10.79% (0.1112 => 0.1232, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.73% (0.4847 => 0.5270, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.57% (0.8321 => 0.9034, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.63% (0.2279 => 0.2453, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.36% (0.7473 => 0.8023, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.03% (0.1905 => 0.2039, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.86% (0.6010 => 0.6422, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.32% (0.5961 => 0.6338, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.90% (0.1983 => 0.2100, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.83% (0.8148 => 0.8623, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.71% (0.2240 => 0.2368, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.42% (0.9435 => 0.9946, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.36% (0.6287 => 0.6624, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.30% (1.1606 => 1.2221, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.28% (0.2519 => 0.2652, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.09% (0.3003 => 0.3156, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.98% (0.3295 => 0.3459, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 4.88% (1.2222 => 1.2819, std.dev.: 0.0128) MultiSource/Applications/hbd/hbd: 4.59% (1.4269 => 1.4924, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.56% (0.5817 => 0.6082, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.26% (0.4127 => 0.4303, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.22% (4.1305 => 4.3048, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.17% (0.2998 => 0.3123, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 4.02% (2.2184 => 2.3075, std.dev.: 0.0169) MultiSource/Applications/minisat/minisat: 3.80% (0.6834 => 0.7094, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.64% (0.8697 => 0.9014, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.44% (1.6386 => 1.6949, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.43% (1.3279 => 1.3734, std.dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 3.41% (14.2605 => 14.7461, std.dev.: 0.1711) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.26% (1.2526 => 1.2934, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.22% (4.1763 => 4.3107, std.dev.: 0.0105) MultiSource/Applications/lemon/lemon: 3.17% (1.0945 => 1.1292, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.06% (0.8007 => 0.8252, std.dev.: 0.0038) MultiSource/Applications/treecc/treecc: 2.92% (1.9948 => 2.0530, std.dev.: 0.0208) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.91% (0.6227 => 0.6408, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.89% (0.8340 => 0.8581, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.85% (8.6476 => 8.8939, std.dev.: 0.0070) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.85% (6.6074 => 6.7955, std.dev.: 0.0050) MultiSource/Applications/d/make_dparser: 2.77% (3.2366 => 3.3263, std.dev.: 0.0340) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.76% (1.4479 => 1.4879, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.73% (0.8927 => 0.9171, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.72% (0.9074 => 0.9321, std.dev.: 0.0056) MultiSource/Benchmarks/nbench/nbench: 2.71% (1.1271 => 1.1577, std.dev.: 0.0060) MultiSource/Applications/ClamAV/clamscan: 2.67% (14.7684 => 15.1626, std.dev.: 0.0348) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.64% (1.1170 => 1.1465, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.61% (13.1811 => 13.5251, std.dev.: 0.0785) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.54% (0.8317 => 0.8528, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.51% (0.9069 => 0.9297, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.48% (0.8457 => 0.8667, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.47% (4.4873 => 4.5982, std.dev.: 0.0129) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.45% (4.4880 => 4.5979, std.dev.: 0.0096) MultiSource/Benchmarks/Bullet/bullet: 2.40% (31.8598 => 32.6255, std.dev.: 0.1003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.39% (0.8050 => 0.8242, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.36% (0.8359 => 0.8556, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.34% (0.4783 => 0.4895, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.34% (0.8086 => 0.8275, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.34% (0.8518 => 0.8717, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.33% (0.7966 => 0.8152, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.33% (0.5191 => 0.5312, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 2.32% (1.2568 => 1.2860, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.32% (0.9039 => 0.9249, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.27% (0.8712 => 0.8910, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.27% (0.7932 => 0.8112, std.dev.: 0.0051) MultiSource/Applications/JM/lencod/lencod: 2.27% (15.3280 => 15.6753, std.dev.: 0.1277) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.21% (0.8805 => 0.9000, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.21% (0.8855 => 0.9051, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/football/football: 2.21% (0.8768 => 0.8962, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.20% (0.8716 => 0.8908, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.19% (0.8177 => 0.8356, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.13% (0.8204 => 0.8379, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.13% (0.8656 => 0.8840, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.10% (4.5702 => 4.6661, std.dev.: 0.0065) MultiSource/Benchmarks/PAQ8p/paq8p: 2.08% (2.3764 => 2.4259, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.06% (0.8048 => 0.8214, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.98% (0.8885 => 0.9061, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 1.91% (8.6247 => 8.7897, std.dev.: 0.0375) MultiSource/Applications/oggenc/oggenc: 1.89% (4.9628 => 5.0568, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.86% (0.8420 => 0.8577, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.85% (0.8338 => 0.8492, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.77% (0.8316 => 0.8463, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.60% (1.2602 => 1.2804, std.dev.: 0.0066) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 97.49% (0.0199 => 0.0393, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/pi: 36.52% (1.5795 => 2.1563, std.dev.: 0.1604) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.19% (0.7597 => 0.8903, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.25% (2.9753 => 3.4589, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.69% (2.7995 => 3.2107, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.43% (5.0261 => 5.6008, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.03% (1.1857 => 1.2809, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 7.05% (1.7056 => 1.8258, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.49% (4.7794 => 5.0897, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/richards_benchmark: 6.31% (1.3037 => 1.3859, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.97% (4.5327 => 4.8032, std.dev.: 0.0151) MultiSource/Applications/SIBsim4/SIBsim4: 5.93% (3.1873 => 3.3764, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.87% (4.9686 => 5.2605, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.69% (3.3761 => 3.5344, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.50% (6.2275 => 6.5080, std.dev.: 0.0111) MultiSource/Applications/lambda-0_1_3/lambda: 4.38% (7.4933 => 7.8217, std.dev.: 0.0729) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.15% (4.9453 => 5.1503, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.94% (4.9469 => 5.1417, std.dev.: 0.0080) MultiSource/Applications/hexxagon/hexxagon: 3.90% (14.0064 => 14.5520, std.dev.: 0.0608) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.21% (0.3587 => 0.3702, std.dev.: 0.0042) MultiSource/Applications/siod/siod: 3.09% (3.6643 => 3.7777, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.81% (8.2783 => 8.5111, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.81% (11.5690 => 11.8943, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.37% (4.8660 => 4.9811, std.dev.: 0.0273) SingleSource/Benchmarks/Shootout/lists: 2.34% (7.3375 => 7.5095, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.26% (4.8362 => 4.9454, std.dev.: 0.0264) MultiSource/Applications/SPASS/SPASS: 2.08% (8.4326 => 8.6077, std.dev.: 0.0545) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.57% (1.1365 => 1.1543, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.45% (2.4647 => 2.5004, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/FloatMM: 1.40% (0.8807 => 0.8930, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: 1.32% (1.0841 => 1.0984, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 1.23% (8.5322 => 8.6368, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.12% (1.5941 => 1.6120, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/five11/five11: 1.10% (5.6030 => 5.6644, std.dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -36.39% (0.0338 => 0.0215, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/em3d/em3d: -21.11% (5.4641 => 4.3109, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -15.00% (7.2130 => 6.1312, std.dev.: 0.2989) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.87% (1.0512 => 0.9369, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.63% (1.1216 => 1.0136, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.10% (14.6451 => 13.3130, std.dev.: 0.2847) MultiSource/Benchmarks/mafft/pairlocalalign: -8.54% (63.1822 => 57.7876, std.dev.: 0.1006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.44% (0.3269 => 0.2993, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -7.08% (4.7482 => 4.4122, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.10% (3.7148 => 3.4883, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.76% (5.4972 => 5.1803, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.08% (5.1557 => 4.8939, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.44% (4.7449 => 4.5344, std.dev.: 0.0144) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.07% (2.4490 => 2.3493, std.dev.: 0.0253) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.81% (6.0224 => 5.7932, std.dev.: 0.0062) MultiSource/Applications/lua/lua: -3.36% (29.8330 => 28.8315, std.dev.: 0.2940) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.22% (0.5807 => 0.5620, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.02% (28.5821 => 27.7184, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.73% (9.9065 => 9.6359, std.dev.: 0.0488) MultiSource/Benchmarks/FreeBench/mason/mason: -2.70% (0.5415 => 0.5269, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash2: -2.39% (3.4237 => 3.3418, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.98% (11.5316 => 11.3035, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.56% (2.3487 => 2.3120, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.51% (3.2169 => 3.1682, std.dev.: 0.0180) SingleSource/Benchmarks/Misc/ffbench: -1.32% (1.4296 => 1.4107, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.16% (5.6343 => 5.5689, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.69% (1.0262 => 1.0538, std.dev.: 0.0155) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 49.59% (0.0123 => 0.0184, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.34% (0.0384 => 0.0375, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 2.22% (0.0180 => 0.0184, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 2.36% (0.1438 => 0.1472, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 0.27% (1.1329 => 1.1360, std.dev.: 0.0471) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.78% (0.4164 => 0.4363, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.16% (0.1369 => 0.1467, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.08% (0.0641 => 0.0570, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -8.21% (0.0195 => 0.0179, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.71% (0.0578 => 0.0611, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.29% (1.1437 => 1.1928, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.18% (0.0627 => 0.0582, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 35.56% (0.0180 => 0.0244, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.31% (0.8017 => 0.7832, std.dev.: 0.0052) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 50.00% (0.0062 => 0.0093, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 24 00:01:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 02:01:11 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121124080111.4F73D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6195?compare_to=6192&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6195, Order: 168536, Start Time: 2012-11-24 06:27:30, End Time: 2012-11-24 08:01:39 To: 6192, Order: 168535, Start Time: 2012-11-24 04:30:54, End Time: 2012-11-24 06:04:21 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 1 (182 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1090 (854 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.04% (0.4253 => 0.4425, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.56% (1.2847 => 1.2646, std.dev.: 0.0053) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.41% (0.3834 => 0.4425, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.21% (54.5751 => 56.3276, std.dev.: 0.2129) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1015, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: 2.48% (7.4937 => 7.6798, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash2: 2.13% (3.1932 => 3.2611, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.17% (0.3821 => 0.3509, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.91% (0.3142 => 0.2925, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.77% (0.9542 => 0.8896, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -6.76% (2.4924 => 2.3238, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -6.57% (0.2160 => 0.2018, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.55% (0.2428 => 0.2269, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.52% (0.3357 => 0.3138, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.39% (0.9852 => 0.9222, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.35% (0.6484 => 0.6072, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.18% (0.3658 => 0.3432, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -6.15% (16.1920 => 15.1970, std.dev.: 0.0148) SingleSource/Benchmarks/McGill/chomp: -6.13% (0.1761 => 0.1653, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.12% (0.1796 => 0.1686, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -6.12% (7.0961 => 6.6621, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/football/football: -6.11% (0.9179 => 0.8618, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.09% (1.3722 => 1.2886, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: -6.09% (9.2283 => 8.6661, std.dev.: 0.1443) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.08% (1.0544 => 0.9903, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.03% (0.2355 => 0.2213, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.02% (4.8161 => 4.5264, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/ReedSolomon: -6.01% (0.1879 => 0.1766, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.95% (3.5339 => 3.3236, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.94% (0.5570 => 0.5239, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.92% (0.5705 => 0.5367, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.92% (0.5863 => 0.5516, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.92% (0.7198 => 0.6772, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.91% (0.5478 => 0.5154, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.91% (0.6446 => 0.6065, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -5.90% (0.3831 => 0.3605, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.89% (0.5805 => 0.5463, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.89% (0.5925 => 0.5576, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.89% (0.1716 => 0.1615, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -5.88% (0.3896 => 0.3667, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.88% (0.3812 => 0.3588, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.87% (0.3848 => 0.3622, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.86% (4.0323 => 3.7960, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.86% (0.5857 => 0.5514, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.85% (0.6304 => 0.5935, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: -5.85% (0.4033 => 0.3797, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.85% (0.6052 => 0.5698, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: -5.84% (4.3330 => 4.0798, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.83% (0.5802 => 0.5464, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.82% (1.2300 => 1.1584, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -5.82% (0.4176 => 0.3933, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.82% (1.4642 => 1.3790, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.81% (0.5849 => 0.5509, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.79% (1.6364 => 1.5416, std.dev.: 0.0099) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.78% (4.8802 => 4.5982, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions-4: -5.77% (0.3880 => 0.3656, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.77% (0.6660 => 0.6276, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.76% (0.5591 => 0.5269, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.76% (0.3891 => 0.3667, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.75% (0.2695 => 0.2540, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.75% (0.6230 => 0.5872, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.74% (0.6667 => 0.6284, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.74% (0.5575 => 0.5255, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.74% (0.6293 => 0.5932, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.73% (0.5859 => 0.5523, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.72% (0.6736 => 0.6351, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -5.72% (1.1530 => 1.0871, std.dev.: 0.0034) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.71% (6.7716 => 6.3847, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: -5.70% (1.1450 => 1.0797, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.70% (0.5581 => 0.5263, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.69% (0.6260 => 0.5904, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.68% (0.7919 => 0.7469, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: -5.67% (0.4515 => 0.4259, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.65% (4.5069 => 4.2523, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.65% (0.5456 => 0.5148, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.63% (0.6194 => 0.5845, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/bh/bh: -5.63% (0.2985 => 0.2817, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.58% (0.3406 => 0.3216, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.54% (0.6189 => 0.5846, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.54% (0.5688 => 0.5373, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.53% (0.5999 => 0.5667, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.53% (1.2784 => 1.2077, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.51% (0.6440 => 0.6085, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.51% (0.6681 => 0.6313, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.48% (0.3884 => 0.3671, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -5.45% (0.4199 => 0.3970, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.43% (0.4916 => 0.4649, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.42% (0.2548 => 0.2410, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: -5.42% (0.2659 => 0.2515, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.39% (14.2083 => 13.4427, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.37% (0.5941 => 0.5622, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.37% (0.2999 => 0.2838, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: -5.36% (0.3581 => 0.3389, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.36% (0.2278 => 0.2156, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.34% (0.6033 => 0.5711, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -5.33% (1.3864 => 1.3125, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -5.33% (15.5079 => 14.6820, std.dev.: 0.0120) MultiSource/Applications/Burg/burg: -5.32% (1.2515 => 1.1849, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.32% (0.8521 => 0.8068, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.31% (0.3483 => 0.3298, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -5.30% (0.4280 => 0.4053, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -5.30% (17.1032 => 16.1969, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.27% (0.6676 => 0.6324, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.27% (1.2210 => 1.1567, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.24% (1.2221 => 1.1581, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.13% (8.0126 => 7.6019, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.12% (0.3319 => 0.3149, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.12% (0.2385 => 0.2263, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -5.11% (2.4021 => 2.2793, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.11% (0.7339 => 0.6964, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: -5.10% (0.7447 => 0.7067, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -5.08% (3.5154 => 3.3369, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.07% (0.6395 => 0.6071, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.03% (0.4151 => 0.3942, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.03% (22.4056 => 21.2791, std.dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.01% (1.6474 => 1.5648, std.dev.: 0.0066) MultiSource/Applications/lambda-0_1_3/lambda: -5.01% (0.7982 => 0.7582, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.01% (0.7524 => 0.7147, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -5.01% (15.2527 => 14.4891, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/matrix: -4.98% (0.3255 => 0.3093, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.98% (0.4321 => 0.4106, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.97% (0.5168 => 0.4911, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -4.95% (1.3148 => 1.2497, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.94% (0.3016 => 0.2867, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.94% (0.3057 => 0.2906, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.94% (0.2106 => 0.2002, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: -4.90% (2.1401 => 2.0352, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -4.89% (4.0594 => 3.8607, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (0.2871 => 0.2731, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -4.88% (0.3446 => 0.3278, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.86% (0.4813 => 0.4579, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.86% (0.3931 => 0.3740, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.86% (0.2903 => 0.2762, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.85% (0.3323 => 0.3162, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: -4.83% (0.2939 => 0.2797, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -4.82% (0.3026 => 0.2880, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.82% (0.2989 => 0.2845, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.81% (0.2933 => 0.2792, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.80% (0.5567 => 0.5300, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.79% (0.5569 => 0.5302, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -4.78% (0.4248 => 0.4045, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.77% (0.3205 => 0.3052, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.77% (0.7021 => 0.6686, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -4.76% (0.3194 => 0.3042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.75% (0.5329 => 0.5076, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: -4.74% (0.3394 => 0.3233, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.74% (0.3837 => 0.3655, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -4.74% (0.3481 => 0.3316, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.74% (0.2849 => 0.2714, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.73% (2.1713 => 2.0685, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -4.69% (0.4861 => 0.4633, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.68% (0.3271 => 0.3118, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.68% (0.3849 => 0.3669, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -4.66% (0.3025 => 0.2884, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.64% (0.6395 => 0.6098, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/lists: -4.61% (0.3621 => 0.3454, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -4.61% (0.8418 => 0.8030, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.58% (0.3252 => 0.3103, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.56% (0.9557 => 0.9121, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.56% (0.4083 => 0.3897, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.53% (0.9077 => 0.8666, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: -4.50% (0.3867 => 0.3693, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -4.48% (18.2933 => 17.4730, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.45% (0.4427 => 0.4230, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.41% (2.2587 => 2.1590, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -4.41% (0.3059 => 0.2924, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -4.41% (5.0226 => 4.8010, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -4.32% (34.0927 => 32.6205, std.dev.: 0.3716) SingleSource/Benchmarks/Misc-C++/bigfib: -4.21% (0.6750 => 0.6466, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.18% (0.3491 => 0.3345, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -4.17% (0.7779 => 0.7455, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: -4.13% (0.6347 => 0.6085, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -4.12% (0.3788 => 0.3632, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.02% (0.6441 => 0.6182, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -3.82% (0.4524 => 0.4351, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.74% (5.4682 => 5.2639, std.dev.: 0.0028) MultiSource/Applications/hbd/hbd: -3.73% (1.5610 => 1.5028, std.dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: -2.10% (20.7746 => 20.3386, std.dev.: 0.0276) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.49% (7.5137 => 5.7490, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/richards_benchmark: -8.73% (1.2842 => 1.1721, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: -3.92% (2.2633 => 2.1745, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.44% (1.3096 => 1.2646, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.76% (6.5735 => 6.4575, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 24 00:38:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 02:38:27 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121124083827.57A492A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6196?compare_to=6190&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6196, Order: 168536, Start Time: 2012-11-24 06:15:48, End Time: 2012-11-24 08:38:55 To: 6190, Order: 168532, Start Time: 2012-11-24 03:04:09, End Time: 2012-11-24 05:24:22 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 34 (126 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1051 (720 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 13.71% (0.7847 => 0.8923, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.47% (0.6132 => 0.6958, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.27% (0.6592 => 0.7467, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 12.17% (0.5768 => 0.6470, std.dev.: 0.0151) SingleSource/Benchmarks/LivermoreLoops/kernel01: 10.86% (0.1013 => 0.1123, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 10.10% (0.8481 => 0.9338, std.dev.: 0.0211) SingleSource/Benchmarks/LivermoreLoops/kernel04: 9.93% (0.1067 => 0.1173, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: 9.88% (3.7580 => 4.1294, std.dev.: 0.0611) MultiSource/Benchmarks/Olden/mst/mst: 9.43% (0.1347 => 0.1474, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.36% (0.6689 => 0.7315, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.13% (0.6860 => 0.7486, std.dev.: 0.0242) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.11% (0.5893 => 0.6430, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.94% (0.6309 => 0.6873, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.84% (0.6201 => 0.6749, std.dev.: 0.0179) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.28% (0.1909 => 0.2048, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/football/football: 6.96% (0.9839 => 1.0524, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.67% (0.7657 => 0.8168, std.dev.: 0.0100) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.58% (0.2888 => 0.3078, std.dev.: 0.0064) SingleSource/Benchmarks/Linpack/linpack-pc: 6.57% (0.2876 => 0.3065, std.dev.: 0.0059) MultiSource/Benchmarks/Fhourstones/fhourstones: 6.41% (0.1903 => 0.2025, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/BoolLiteralTest: 5.85% (0.4157 => 0.4400, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.66% (5.6690 => 5.9901, std.dev.: 0.0639) MultiSource/Benchmarks/nbench/nbench: 3.65% (1.4198 => 1.4716, std.dev.: 0.0070) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.87% (37.7327 => 38.4375, std.dev.: 0.0550) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.84% (4.7379 => 4.8252, std.dev.: 0.0302) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/flops: 28.57% (6.7489 => 8.6769, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 17.25% (9.6824 => 11.3530, std.dev.: 0.5028) MultiSource/Applications/JM/ldecod/ldecod: 13.19% (0.1213 => 0.1373, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.50% (15.4544 => 16.7681, std.dev.: 0.1618) MultiSource/Applications/lemon/lemon: 5.69% (1.4360 => 1.5177, std.dev.: 0.0269) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 3.11% (1.5681 => 1.6169, std.dev.: 0.0112) MultiSource/Benchmarks/Olden/em3d/em3d: 2.78% (3.1100 => 3.1966, std.dev.: 0.0075) SingleSource/Benchmarks/Dhrystone/fldry: 2.60% (1.9304 => 1.9805, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.45% (4.8072 => 4.8769, std.dev.: 0.0102) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -6.32% (5.0105 => 4.6937, std.dev.: 0.0353) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.30% (69.0483 => 69.2573, std.dev.: 0.4298) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -1.76% (0.1362 => 0.1338, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0420 => 0.0420, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.31% (0.0651 => 0.0653, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: 0.03% (493.7154 => 493.8527, std.dev.: 0.2486) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.51% (63.2438 => 69.2573, std.dev.: 0.4298) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43692.91% (1.1277 => 493.8527, std.dev.: 0.2486) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 195.43% (0.5229 => 1.5448, std.dev.: 0.1132) MultiSource/Applications/SPASS/SPASS: 19.19% (14.9895 => 17.8662, std.dev.: 0.4441) MultiSource/Applications/kimwitu++/kc: 49.46% (14.1553 => 21.1564, std.dev.: 0.4790) MultiSource/Benchmarks/MallocBench/gs/gs: 18.84% (4.1105 => 4.8851, std.dev.: 0.2384) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 49.75% (1.1048 => 1.6544, std.dev.: 0.0102) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 436.97% (7.1582 => 38.4375, std.dev.: 0.0550) SingleSource/Benchmarks/Misc-C++-EH/spirit: 94.71% (3.4629 => 6.7425, std.dev.: 0.1379) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.35% (0.6222 => 1.0288, std.dev.: 0.0641) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10451.81% (0.0720 => 7.5973, std.dev.: 0.2964) MultiSource/Applications/SIBsim4/SIBsim4: 3859800.00% (0.0001 => 3.8599, std.dev.: 0.0358) MultiSource/Applications/SPASS/SPASS: 12560700.00% (0.0001 => 12.5608, std.dev.: 2.1621) MultiSource/Applications/kimwitu++/kc: 52000.00% (0.0001 => 0.0521, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14500.00% (0.0001 => 0.0146) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 597200.00% (0.0001 => 0.5973, std.dev.: 0.0147) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10074900.00% (0.0001 => 10.0750, std.dev.: 0.0143) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5675600.00% (0.0001 => 5.6757, std.dev.: 0.5828) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1742.19% (1.1194 => 20.6215, std.dev.: 0.7364) MultiSource/Applications/ClamAV/clamscan: 69.00% (22.1758 => 37.4779, std.dev.: 0.3484) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.11% (2.9384 => 4.6165, std.dev.: 0.3932) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 51.78% (7.0540 => 10.7065, std.dev.: 0.3498) SingleSource/Benchmarks/CoyoteBench/almabench: 48.63% (0.0730 => 0.1085, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 48.17% (21.9371 => 32.5035, std.dev.: 0.0947) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.80% (8.1363 => 11.9438, std.dev.: 0.2550) MultiSource/Benchmarks/FreeBench/distray/distray: 45.08% (0.1056 => 0.1532, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 44.48% (0.1432 => 0.2069, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/Oscar: 35.69% (0.0636 => 0.0863, std.dev.: 0.0019) SingleSource/Benchmarks/Stanford/Towers: 31.63% (0.0471 => 0.0620, std.dev.: 0.0023) SingleSource/UnitTests/vla: 30.14% (0.0355 => 0.0462, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones/fhourstones: 29.31% (0.1566 => 0.2025, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 29.29% (0.1584 => 0.2048, std.dev.: 0.0051) SingleSource/Benchmarks/Stanford/Quicksort: 27.93% (0.0358 => 0.0458, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 27.49% (0.1655 => 0.2110, std.dev.: 0.0016) SingleSource/Benchmarks/Stanford/RealMM: 27.27% (0.0396 => 0.0504, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/mst/mst: 26.74% (0.1163 => 0.1474, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 26.40% (0.0447 => 0.0565, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 26.21% (0.1175 => 0.1483, std.dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: 26.01% (0.0719 => 0.0906, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Treesort: 25.79% (0.0411 => 0.0517, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 25.63% (0.7433 => 0.9338, std.dev.: 0.0211) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 25.27% (0.0467 => 0.0585, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.19% (0.0770 => 0.0964, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 25.16% (0.5569 => 0.6970, std.dev.: 0.0065) SingleSource/Benchmarks/Stanford/Queens: 25.12% (0.0414 => 0.0518, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 24.29% (1.1840 => 1.4716, std.dev.: 0.0070) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.18% (0.1125 => 0.1397, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 24.16% (0.3684 => 0.4574, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.11% (3.8922 => 4.8306, std.dev.: 0.0732) MultiSource/Applications/d/make_dparser: 23.81% (3.3354 => 4.1294, std.dev.: 0.0611) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.73% (0.0746 => 0.0923, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bisort/bisort: 23.62% (0.0614 => 0.0759, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/exptree: 23.10% (0.0814 => 0.1002, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/matrix: 22.98% (0.0818 => 0.1006, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 22.66% (0.4064 => 0.4985, std.dev.: 0.0097) SingleSource/Benchmarks/CoyoteBench/lpbench: 22.50% (0.0929 => 0.1138, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 22.25% (0.0953 => 0.1165, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: 22.00% (0.2554 => 0.3116, std.dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 21.85% (1.4186 => 1.7286, std.dev.: 0.0227) SingleSource/Benchmarks/Shootout-C++/except: 21.66% (0.2871 => 0.3493, std.dev.: 0.0064) MultiSource/Benchmarks/BitBench/drop3/drop3: 21.37% (0.0482 => 0.0585, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 21.14% (4.9449 => 5.9901, std.dev.: 0.0639) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.13% (0.3441 => 0.4168, std.dev.: 0.0100) MultiSource/Benchmarks/MallocBench/espresso/espresso: 21.06% (4.2646 => 5.1627, std.dev.: 0.0834) MultiSource/Applications/spiff/spiff: 20.77% (0.7835 => 0.9462, std.dev.: 0.0225) SingleSource/Benchmarks/Stanford/Puzzle: 20.74% (0.1268 => 0.1531, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.65% (0.2107 => 0.2542, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 20.55% (14.3668 => 17.3194, std.dev.: 0.4236) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.18% (0.0793 => 0.0953, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.73% (0.1029 => 0.1232, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.73% (0.2271 => 0.2719, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/misr: 19.43% (0.0633 => 0.0756, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/matrix: 18.98% (0.3098 => 0.3686, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.70% (0.2700 => 0.3205, std.dev.: 0.0173) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.47% (0.0704 => 0.0834, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 18.41% (1.3050 => 1.5453, std.dev.: 0.0356) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 18.25% (0.2603 => 0.3078, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.14% (0.6450 => 0.7620, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/fibo: 18.13% (0.2725 => 0.3219, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/football/football: 17.97% (0.8921 => 1.0524, std.dev.: 0.0199) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.46% (0.0842 => 0.0989, std.dev.: 0.0046) MultiSource/Applications/Burg/burg: 17.44% (1.1642 => 1.3672, std.dev.: 0.0563) SingleSource/Benchmarks/Misc/oourafft: 17.28% (0.3282 => 0.3849, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.14% (2.0665 => 2.4206, std.dev.: 0.0651) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.99% (0.0871 => 0.1019, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: 16.93% (0.2877 => 0.3364, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout/lists: 16.77% (0.0626 => 0.0731, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.57% (0.8172 => 0.9526, std.dev.: 0.0459) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.48% (0.0886 => 0.1032, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/bmm/bmm: 16.21% (0.0759 => 0.0882, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.90% (0.0648 => 0.0751, std.dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 15.62% (5.7591 => 6.6585, std.dev.: 0.2978) MultiSource/Benchmarks/mafft/pairlocalalign: 15.55% (9.4845 => 10.9592, std.dev.: 0.3667) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.31% (0.1117 => 0.1288, std.dev.: 0.0047) MultiSource/Applications/viterbi/viterbi: 15.11% (0.1555 => 0.1790, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.94% (0.0770 => 0.0885, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.61% (0.2758 => 0.3161, std.dev.: 0.0149) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.48% (0.3121 => 0.3573, std.dev.: 0.0089) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.27% (0.0834 => 0.0953, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.75% (0.5860 => 0.6666, std.dev.: 0.0310) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.72% (0.3935 => 0.4475, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.63% (0.9765 => 1.1096, std.dev.: 0.0486) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.51% (0.3427 => 0.3890, std.dev.: 0.0132) MultiSource/Applications/sqlite3/sqlite3: 13.33% (17.1811 => 19.4719, std.dev.: 0.5183) SingleSource/UnitTests/ObjC/parameter-passing: 13.27% (0.3927 => 0.4448, std.dev.: 0.0168) SingleSource/UnitTests/ObjC/exceptions-2: 12.55% (0.3497 => 0.3936, std.dev.: 0.0151) SingleSource/UnitTests/ObjC/exceptions-3: 12.43% (0.3516 => 0.3953, std.dev.: 0.0167) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.39% (0.1906 => 0.2123, std.dev.: 0.0082) MultiSource/Benchmarks/PAQ8p/paq8p: 10.65% (10.3673 => 11.4711, std.dev.: 0.2417) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.20% (0.1892 => 0.2085, std.dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.65% (0.1438 => 0.1548, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.14% (4.3953 => 10.9945, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/methcall: 147.40% (5.3999 => 13.3594, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ary3: 26.10% (3.7221 => 4.6937, std.dev.: 0.0353) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 24.78% (13.4384 => 16.7681, std.dev.: 0.1618) MultiSource/Applications/minisat/minisat: 24.54% (9.1159 => 11.3530, std.dev.: 0.5028) SingleSource/Benchmarks/Misc/oourafft: 17.45% (6.6465 => 7.8061, std.dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.66% (1.1145 => 1.3002, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.87% (0.2944 => 0.3323, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.62% (2.8904 => 3.2262, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 10.07% (1.1396 => 1.2544, std.dev.: 0.0018) SingleSource/Benchmarks/Stanford/Puzzle: 10.06% (0.1421 => 0.1564, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.23% (1.7254 => 1.8847, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.89% (4.2280 => 4.4770, std.dev.: 0.0078) SingleSource/Regression/C/uint64_to_float: 5.10% (0.5413 => 0.5689, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 4.96% (1.4460 => 1.5177, std.dev.: 0.0269) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627) MultiSource/Applications/lua/lua: 4.50% (26.0924 => 27.2666, std.dev.: 0.2241) MultiSource/Benchmarks/nbench/nbench: 4.08% (11.6436 => 12.1188, std.dev.: 0.0082) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 3.04% (3.1023 => 3.1966, std.dev.: 0.0075) SingleSource/Benchmarks/Dhrystone/dry: 2.65% (2.4116 => 2.4754, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/lists1: 2.41% (0.6171 => 0.6320, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.12% (1.3677 => 1.3967, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 2.06% (3.1595 => 3.2247, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.86% (2.1424 => 2.1823, std.dev.: 0.0133) MultiSource/Benchmarks/PAQ8p/paq8p: 1.73% (85.0658 => 86.5396, std.dev.: 0.1847) MultiSource/Benchmarks/mafft/pairlocalalign: 1.43% (27.8444 => 28.2424, std.dev.: 0.0591) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.42% (6.5088 => 6.6012, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/sieve: 1.28% (5.2139 => 5.2804, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0313 => 1.0441, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0501, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: 1.16% (1.9577 => 1.9805, std.dev.: 0.0077) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.51% (6.6874 => 0.1667, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.80% (5.2763 => 1.2241, std.dev.: 0.0468) SingleSource/Benchmarks/Misc/salsa20: -75.68% (0.8651 => 0.2104, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: -44.76% (0.1622 => 0.0896, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.98% (5.3526 => 4.7647, std.dev.: 0.1336) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.40% (5.3855 => 4.8252, std.dev.: 0.0302) MultiSource/Applications/JM/ldecod/ldecod: -7.43% (10.4361 => 9.6602, std.dev.: 0.2338) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.20% (0.0628 => 0.0363, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.36% (0.3987 => 0.2378, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.34% (4.5009 => 2.7752, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.17% (2.6546 => 2.0129, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: -19.48% (0.2161 => 0.1740, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.79% (1.6925 => 1.4253, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2841, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.81% (32.5116 => 28.9979, std.dev.: 0.0308) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -10.52% (9.5636 => 8.5572, std.dev.: 0.2192) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.71% (1.5660 => 1.4296, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.13% (3.2416 => 3.0428, std.dev.: 0.0161) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.71% (1.6805 => 1.5845, std.dev.: 0.0313) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5758, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7497, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -5.07% (19.9488 => 18.9373, std.dev.: 0.3533) SingleSource/Benchmarks/Misc/flops-5: -4.88% (1.5835 => 1.5062, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -4.28% (6.2999 => 6.0301, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.25% (0.9957 => 0.9633, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8911, std.dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.48% (0.4808 => 0.4689, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.86% (8.1563 => 8.0048, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6769, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -1.49% (10.2830 => 10.1301, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.14% (0.2116 => 0.0653, std.dev.: 0.0021) Report Time: 2.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 24 02:21:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 04:21:29 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121124102129.456732A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6197?compare_to=6194&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6197, Order: 168538, Start Time: 2012-11-24 08:51:43, End Time: 2012-11-24 10:21:58 To: 6194, Order: 168536, Start Time: 2012-11-24 06:11:05, End Time: 2012-11-24 07:41:11 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 5 (110 on baseline) Performance Improvements: 4 (26 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1045 (838 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01: 11.11% (0.0936 => 0.1040, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.28% (0.3202 => 0.3339, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 15.55% (2.1563 => 2.4916, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.11% (4.3382 => 4.4733, std.dev.: 0.0243) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.13% (22.3375 => 22.5897, std.dev.: 0.0666) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/lemon/lemon: -1.65% (1.1292 => 1.1106, std.dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/minisat/minisat: -3.01% (6.3699 => 6.1782, std.dev.: 0.0500) MultiSource/Applications/SPASS/SPASS: -2.96% (8.6077 => 8.3529, std.dev.: 0.0922) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.11% (1.4290 => 1.4132, std.dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.16% (1.0538 => 1.0660, std.dev.: 0.0240) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 19.02% (0.0184 => 0.0219, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.24% (0.0425 => 0.0426, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0332 => 0.0332, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0314 => 0.0313, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 13.07% (0.0375 => 0.0424, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: -35.29% (0.0204 => 0.0132, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/test1: 2.17% (0.0184 => 0.0188, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1472 => 0.1473, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: -3.01% (1.1360 => 1.1018, std.dev.: 0.0325) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.21% (0.4363 => 0.4223, std.dev.: 0.0313) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.29% (0.1467 => 0.1404, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.28% (0.0570 => 0.0583, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 43.58% (0.0179 => 0.0257, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.17% (0.0611 => 0.0555, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.04% (1.1928 => 1.1923, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.30% (0.0582 => 0.0557, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.64% (0.0244 => 0.0248, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.49% (0.7832 => 0.7794, std.dev.: 0.0089) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -45.16% (0.0093 => 0.0051, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.38% (16.4461 => 17.6603, std.dev.: 0.0825) MultiSource/Applications/sqlite3/sqlite3: 2323.12% (0.6332 => 15.3432, std.dev.: 0.0516) MultiSource/Benchmarks/McCat/08-main/main: 45.49% (0.1831 => 0.2664, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.86% (0.1559 => 0.1452, std.dev.: 0.0065) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7064.07% (0.3123 => 22.3734, std.dev.: 0.2746) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.63% (0.2463 => 0.3710, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1524.10% (0.3344 => 5.4310, std.dev.: 0.0529) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.55% (0.2364 => 0.3228, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 4.61% (0.6010 => 0.6287, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.05% (0.3266 => 0.3431, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 3.20% (0.1969 => 0.2032, std.dev.: 0.0011) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.91% (0.0224 => 0.0235, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -31.74% (0.0230 => 0.0157, std.dev.: 0.0032) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0505, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 10.88% (0.1462 => 0.1621, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4677, std.dev.: 0.0127) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0677, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4897, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5121, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5229, std.dev.: 0.0523) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3048, std.dev.: 0.0291) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1468, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3628, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4086, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0834, std.dev.: 0.0019) SingleSource/Regression/C/uint64_to_float: -24.07% (2.1832 => 1.6577, std.dev.: 0.0050) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.69% (0.0810 => 0.0929, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.77% (0.0830 => 0.0936, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.38% (0.0848 => 0.0953, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: 11.78% (0.1112 => 0.1243, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.64% (0.1157 => 0.1257, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.21% (0.2180 => 0.2359, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.39% (0.7473 => 0.8025, std.dev.: 0.0070) MultiSource/Applications/viterbi/viterbi: 6.59% (0.1577 => 0.1681, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.46% (0.1905 => 0.2028, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.44% (0.3137 => 0.3339, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.36% (0.6010 => 0.6392, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.67% (0.2240 => 0.2367, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.36% (0.2519 => 0.2654, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.08% (0.4847 => 0.5093, std.dev.: 0.0095) MultiSource/Applications/minisat/minisat: 4.39% (0.6834 => 0.7134, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.17% (0.4127 => 0.4299, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.91% (1.1685 => 1.2142, std.dev.: 0.0120) MultiSource/Applications/treecc/treecc: 3.84% (1.9948 => 2.0715, std.dev.: 0.0192) MultiSource/Applications/lua/lua: 3.77% (3.8189 => 3.9628, std.dev.: 0.0377) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.74% (0.6287 => 0.6522, std.dev.: 0.0088) MultiSource/Applications/SPASS/SPASS: 3.56% (14.2605 => 14.7675, std.dev.: 0.0886) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.48% (1.6386 => 1.6956, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.22% (2.1401 => 2.2091, std.dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 3.11% (1.1271 => 1.1622, std.dev.: 0.0049) MultiSource/Applications/SIBsim4/SIBsim4: 3.01% (1.2568 => 1.2946, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.98% (6.6074 => 6.8041, std.dev.: 0.0534) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.96% (0.8457 => 0.8707, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 2.88% (14.7684 => 15.1933, std.dev.: 0.0914) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.87% (0.8597 => 0.8844, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.85% (0.9688 => 0.9964, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.84% (13.1811 => 13.5556, std.dev.: 0.0835) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.84% (1.4479 => 1.4890, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.83% (0.9074 => 0.9331, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.78% (0.8697 => 0.8939, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 2.78% (2.2184 => 2.2801, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.77% (0.9056 => 0.9307, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.76% (1.5315 => 1.5738, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.76% (1.1170 => 1.1478, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.71% (0.8261 => 0.8485, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.70% (0.9039 => 0.9283, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.66% (0.8204 => 0.8422, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.63% (0.8048 => 0.8260, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.60% (0.8050 => 0.8259, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.59% (0.8611 => 0.8834, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.58% (0.8331 => 0.8546, std.dev.: 0.0037) MultiSource/Applications/JM/ldecod/ldecod: 2.56% (6.7320 => 6.9045, std.dev.: 0.0344) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.47% (0.8656 => 0.8870, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 2.43% (0.4397 => 0.4504, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: 2.42% (2.3764 => 2.4339, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.35% (0.8885 => 0.9094, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (3.1832 => 3.2578, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.32% (0.7932 => 0.8116, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.30% (0.4783 => 0.4893, std.dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: 2.28% (15.3280 => 15.6768, std.dev.: 0.1267) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.25% (0.8712 => 0.8908, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.22% (0.8317 => 0.8502, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.21% (0.8316 => 0.8500, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.21% (0.8518 => 0.8706, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.20% (0.8716 => 0.8908, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.20% (0.8359 => 0.8543, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.14% (0.9908 => 1.0120, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 2.13% (0.7557 => 0.7718, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.11% (0.8086 => 0.8257, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.11% (0.8805 => 0.8991, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.11% (0.9069 => 0.9260, std.dev.: 0.0045) MultiSource/Benchmarks/Bullet/bullet: 2.06% (31.8598 => 32.5172, std.dev.: 0.1903) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.05% (0.8338 => 0.8509, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.04% (0.8855 => 0.9036, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/football/football: 1.95% (0.8768 => 0.8939, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.94% (0.8177 => 0.8336, std.dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: 1.89% (8.6247 => 8.7876, std.dev.: 0.0596) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.89% (0.8420 => 0.8579, std.dev.: 0.0049) MultiSource/Applications/oggenc/oggenc: 1.86% (4.9628 => 5.0550, std.dev.: 0.0050) MultiSource/Applications/d/make_dparser: 1.79% (3.2366 => 3.2945, std.dev.: 0.0221) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.69% (0.6586 => 0.6697, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 118.59% (0.0199 => 0.0435, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/pi: 57.75% (1.5795 => 2.4916, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.34% (2.9753 => 3.4616, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.77% (0.7597 => 0.8795, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.73% (2.7995 => 3.2119, std.dev.: 0.0931) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.54% (5.0261 => 5.6063, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.03% (1.1857 => 1.2809, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 7.46% (1.7056 => 1.8328, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 7.23% (1.3037 => 1.3980, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.84% (4.7794 => 5.1061, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 5.96% (3.1873 => 3.3774, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.90% (4.9686 => 5.2615, std.dev.: 0.0456) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.67% (3.3761 => 3.5338, std.dev.: 0.0286) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.29% (6.2275 => 6.4945, std.dev.: 0.0334) MultiSource/Applications/lambda-0_1_3/lambda: 4.25% (7.4933 => 7.8117, std.dev.: 0.0400) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.00% (4.9469 => 5.1447, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 3.88% (14.0064 => 14.5501, std.dev.: 0.1304) MultiSource/Applications/siod/siod: 3.11% (3.6643 => 3.7782, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.09% (0.3587 => 0.3698, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.88% (11.5690 => 11.9024, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.82% (1.2337 => 1.2685, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.71% (4.3552 => 4.4733, std.dev.: 0.0243) SingleSource/Benchmarks/Shootout/lists: 2.39% (7.3375 => 7.5130, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.37% (8.2783 => 8.4749, std.dev.: 0.0201) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.32% (1.1365 => 1.1629, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.30% (4.8660 => 4.9781, std.dev.: 0.0108) SingleSource/Benchmarks/Dhrystone/dry: 2.13% (0.5081 => 0.5189, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.06% (4.8362 => 4.9358, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.64% (1.5941 => 1.6202, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.38% (2.4647 => 2.4988, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/power/power: 1.37% (1.2061 => 1.2226, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: 1.30% (1.0841 => 1.0982, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.30% (22.2997 => 22.5897, std.dev.: 0.0666) SingleSource/Benchmarks/Misc/ReedSolomon: 1.22% (8.5322 => 8.6364, std.dev.: 0.0246) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.04% (4.0473 => 4.0892, std.dev.: 0.0129) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -36.98% (0.0338 => 0.0213, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/em3d/em3d: -21.49% (5.4641 => 4.2899, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.30% (7.2130 => 6.2540, std.dev.: 0.1170) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.33% (1.0512 => 0.9321, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: -10.14% (1.1216 => 1.0079, std.dev.: 0.0172) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.99% (14.6451 => 13.1820, std.dev.: 0.2124) MultiSource/Benchmarks/mafft/pairlocalalign: -8.59% (63.1822 => 57.7532, std.dev.: 0.0941) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.84% (4.7482 => 4.4234, std.dev.: 0.0654) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.39% (0.3269 => 0.3060, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.98% (5.4972 => 5.1684, std.dev.: 0.0816) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.96% (3.7148 => 3.4935, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.19% (5.1557 => 4.8882, std.dev.: 0.0418) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.35% (4.7449 => 4.5387, std.dev.: 0.0398) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.97% (6.0224 => 5.7836, std.dev.: 0.0211) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.51% (2.8773 => 2.7763, std.dev.: 0.0181) MultiSource/Applications/lua/lua: -3.16% (29.8330 => 28.8889, std.dev.: 0.0373) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.07% (28.5821 => 27.7055, std.dev.: 0.0766) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.94% (0.5807 => 0.5636, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.74% (2.6356 => 2.5635, std.dev.: 0.0254) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.46% (3.2169 => 3.1377, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.34% (9.9065 => 9.6743, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/bisort/bisort: -2.26% (0.6636 => 0.6486, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: -2.21% (3.4237 => 3.3479, std.dev.: 0.0141) MultiSource/Applications/aha/aha: -2.19% (3.3398 => 3.2668, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.3487 => 2.3146, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.22% (5.6343 => 5.5657, std.dev.: 0.0150) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.88% (1.0262 => 1.0660, std.dev.: 0.0240) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: -30.53% (0.0190 => 0.0132, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/test1: 4.44% (0.0180 => 0.0188, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.43% (0.1438 => 0.1473, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: -2.75% (1.1329 => 1.1018, std.dev.: 0.0325) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.42% (0.4164 => 0.4223, std.dev.: 0.0313) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.56% (0.1369 => 0.1404, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.05% (0.0641 => 0.0583, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 31.79% (0.0195 => 0.0257, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.98% (0.0578 => 0.0555, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.25% (1.1437 => 1.1923, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.16% (0.0627 => 0.0557, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 37.78% (0.0180 => 0.0248, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.78% (0.8017 => 0.7794, std.dev.: 0.0089) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -17.74% (0.0062 => 0.0051, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 24 02:29:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 04:29:02 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121124102902.455E42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6198?compare_to=6195&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6198, Order: 168538, Start Time: 2012-11-24 08:55:21, End Time: 2012-11-24 10:29:30 To: 6195, Order: 168536, Start Time: 2012-11-24 06:27:30, End Time: 2012-11-24 08:01:39 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (182 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (855 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.22% (78.4643 => 80.2091, std.dev.: 0.5192) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.37% (54.5751 => 56.4159, std.dev.: 0.1494) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.81% (2.0478 => 2.1053, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/salsa20: 2.76% (7.4937 => 7.7009, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash2: 2.19% (3.1932 => 3.2631, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.06% (0.3821 => 0.3513, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.94% (0.3142 => 0.2924, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.70% (0.9542 => 0.8903, std.dev.: 0.0064) MultiSource/Benchmarks/PAQ8p/paq8p: -6.68% (2.4924 => 2.3259, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -6.48% (0.2160 => 0.2020, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.34% (0.2428 => 0.2274, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.26% (0.9852 => 0.9235, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.26% (0.6484 => 0.6078, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: -6.18% (9.2283 => 8.6578, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.18% (0.3658 => 0.3432, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.15% (0.7198 => 0.6755, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.12% (0.1796 => 0.1686, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: -6.10% (7.0961 => 6.6630, std.dev.: 0.0184) MultiSource/Applications/JM/lencod/lencod: -6.10% (16.1920 => 15.2046, std.dev.: 0.0119) MultiSource/Applications/sgefa/sgefa: -6.05% (0.3357 => 0.3154, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.04% (1.0544 => 0.9907, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.03% (0.2355 => 0.2213, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: -6.02% (0.9179 => 0.8626, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.98% (1.3722 => 1.2902, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.97% (0.5591 => 0.5257, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: -5.91% (0.1761 => 0.1657, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.89% (1.2300 => 1.1575, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.89% (0.5705 => 0.5369, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.88% (4.8161 => 4.5329, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/gs/gs: -5.88% (4.3330 => 4.0784, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.86% (0.5478 => 0.5157, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.86% (0.5805 => 0.5465, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.85% (0.5570 => 0.5244, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -5.85% (0.3896 => 0.3668, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.85% (0.6667 => 0.6277, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.85% (0.7919 => 0.7456, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.84% (0.3884 => 0.3657, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.84% (0.6230 => 0.5866, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.82% (0.5863 => 0.5522, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.81% (6.7716 => 6.3782, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.81% (3.5339 => 3.3287, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.81% (0.5857 => 0.5517, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -5.80% (0.1879 => 0.1770, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.80% (0.6052 => 0.5701, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -5.80% (0.3848 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.79% (4.0323 => 3.7989, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.76% (0.6194 => 0.5837, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.76% (0.6446 => 0.6075, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.75% (0.6660 => 0.6277, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: -5.75% (0.3880 => 0.3657, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -5.75% (0.3812 => 0.3593, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.73% (0.5859 => 0.5523, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -5.73% (1.1450 => 1.0794, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.73% (0.4033 => 0.3802, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.73% (0.5849 => 0.5514, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.73% (0.6304 => 0.5943, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -5.72% (0.4176 => 0.3937, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.72% (0.5575 => 0.5256, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.72% (0.6260 => 0.5902, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.70% (0.5925 => 0.5587, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.69% (0.3831 => 0.3613, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.68% (0.5581 => 0.5264, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.68% (0.2695 => 0.2542) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.67% (0.5941 => 0.5604, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.67% (0.6189 => 0.5838, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.66% (0.5456 => 0.5147, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.64% (0.6297 => 0.5942, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -5.64% (1.1530 => 1.0880, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.63% (1.4642 => 1.3817, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.63% (0.3891 => 0.3672, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.63% (0.2985 => 0.2817, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.63% (0.6293 => 0.5939, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: -5.62% (0.3255 => 0.3072, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.62% (1.6364 => 1.5444, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/fibo: -5.61% (0.2871 => 0.2710, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.59% (0.3057 => 0.2886, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.59% (4.5069 => 4.2551, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.58% (0.5802 => 0.5478, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.57% (0.6736 => 0.6361, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.57% (4.8802 => 4.6086, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.54% (0.5688 => 0.5373, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.54% (0.3323 => 0.3139, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.54% (0.3016 => 0.2849, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.54% (0.4515 => 0.4265, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.53% (0.6440 => 0.6084, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: -5.52% (0.3026 => 0.2859, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.52% (0.4151 => 0.3922, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.51% (0.3483 => 0.3291, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.51% (1.2784 => 1.2080, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.49% (0.2933 => 0.2772, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -5.49% (0.3025 => 0.2859, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.48% (1.3148 => 1.2428, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.47% (0.6033 => 0.5703, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.47% (0.8521 => 0.8055, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.46% (0.2548 => 0.2409, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -5.45% (0.2659 => 0.2514, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.44% (0.2939 => 0.2779, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -5.43% (0.3205 => 0.3031, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -5.43% (0.3446 => 0.3259, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -5.42% (0.2989 => 0.2827, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: -5.40% (15.5079 => 14.6701, std.dev.: 0.0233) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.38% (0.5999 => 0.5676, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.38% (14.2083 => 13.4440, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.38% (0.6676 => 0.6317, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.37% (0.6681 => 0.6322, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.37% (0.4321 => 0.4089, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.37% (0.3931 => 0.3720, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -5.36% (0.3394 => 0.3212, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -5.36% (0.3581 => 0.3389, std.dev.: 0.0045) MultiSource/Applications/Burg/burg: -5.35% (1.2515 => 1.1845, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.35% (0.3252 => 0.3078, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.34% (0.3406 => 0.3224, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.34% (0.2903 => 0.2748, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.32% (0.3194 => 0.3024, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -5.32% (0.4248 => 0.4022, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.32% (2.1713 => 2.0558, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.32% (0.3837 => 0.3633, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.31% (0.2278 => 0.2157, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/property: -5.31% (0.4199 => 0.3976, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.31% (1.2210 => 1.1562, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary2: -5.29% (0.3481 => 0.3297, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.27% (0.3849 => 0.3646, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -5.27% (0.2849 => 0.2699, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -5.26% (17.1032 => 16.2033, std.dev.: 0.0160) SingleSource/UnitTests/ObjC/parameter-passing: -5.23% (0.4280 => 0.4056, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.20% (8.0126 => 7.5958, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/lists: -5.14% (0.3621 => 0.3435, std.dev.: 0.0016) MultiSource/Applications/lua/lua: -5.13% (4.0594 => 3.8513, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/hash2: -5.12% (0.4861 => 0.4612, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.12% (1.2221 => 1.1595, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: -5.12% (1.3864 => 1.3154, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: -5.11% (3.5154 => 3.3357, std.dev.: 0.0019) SingleSource/Regression/C++/ofstream_ctor: -5.10% (0.3059 => 0.2903, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.08% (0.7339 => 0.6966, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -5.06% (0.7447 => 0.7070, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.06% (0.3319 => 0.3151, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.03% (0.2385 => 0.2265, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.03% (0.4813 => 0.4571, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.02% (0.4083 => 0.3878, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.98% (22.4056 => 21.2906, std.dev.: 0.0149) MultiSource/Applications/siod/siod: -4.97% (2.4021 => 2.2826, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.97% (1.6474 => 1.5655, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.97% (0.7524 => 0.7150, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/lists1: -4.97% (0.3867 => 0.3675, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.96% (0.4916 => 0.4672, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -4.96% (15.2527 => 14.4962, std.dev.: 0.0199) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.95% (0.5168 => 0.4912, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.89% (0.2106 => 0.2003, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.88% (0.6395 => 0.6083, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -4.84% (0.7982 => 0.7596, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.81% (0.9557 => 0.9097, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.81% (0.4427 => 0.4214, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.80% (0.2999 => 0.2855, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.78% (0.5567 => 0.5301, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.77% (0.7021 => 0.6686, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -4.75% (0.4524 => 0.4309, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.74% (0.6395 => 0.6092, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -4.72% (2.1401 => 2.0390, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: -4.71% (0.3271 => 0.3117, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: -4.70% (0.3788 => 0.3610, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -4.66% (5.0226 => 4.7886, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.63% (0.5569 => 0.5311, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -4.62% (18.2933 => 17.4488, std.dev.: 0.0194) MultiSource/Benchmarks/Bullet/bullet: -4.61% (34.0927 => 32.5216, std.dev.: 0.0389) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.60% (0.5329 => 0.5084, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -4.55% (0.6347 => 0.6058, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -4.52% (0.6750 => 0.6445, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -4.36% (0.6441 => 0.6160, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.36% (2.2587 => 2.1602, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.35% (0.3491 => 0.3339, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -4.32% (0.8418 => 0.8054, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: -4.22% (0.7779 => 0.7451, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -3.89% (1.5610 => 1.5002, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.84% (0.9077 => 0.8728, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.58% (5.4682 => 5.2723, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -2.16% (20.7746 => 20.3265, std.dev.: 0.0369) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7522, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/richards_benchmark: -8.73% (1.2842 => 1.1721, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: -3.88% (2.2633 => 2.1755, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.87% (1.3096 => 1.2720, std.dev.: 0.0118) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4728, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 24 03:39:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 05:39:35 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121124113935.0D3D02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6199?compare_to=6193&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6199, Order: 168536, Start Time: 2012-11-24 08:17:38, End Time: 2012-11-24 11:40:02 To: 6193, Order: 168533, Start Time: 2012-11-24 04:00:17, End Time: 2012-11-24 07:21:08 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (168 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1091 (724 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.91% (2.1364 => 2.0528, std.dev.: 0.0260) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.20% (0.0625 => 0.0895, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.77% (0.1063 => 0.1422, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.68% (0.2969 => 0.3761, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.04% (0.1106 => 0.1394, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.68% (0.4253 => 0.5345, std.dev.: 0.0070) MultiSource/Applications/oggenc/oggenc: 25.05% (1.5932 => 1.9923, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.93% (0.0714 => 0.0892, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.81% (0.4139 => 0.5166, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.81% (0.4994 => 0.6183, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.64% (0.5900 => 0.7295, std.dev.: 0.0067) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.58% (0.0475 => 0.0587, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.46% (0.0584 => 0.0721, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.20% (0.5000 => 0.6160, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.53% (0.1620 => 0.1985, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.22% (0.1107 => 0.1353, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: 22.20% (0.0599 => 0.0732, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.19% (0.0897 => 0.1096, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.23% (0.0584 => 0.0708, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 21.10% (0.0948 => 0.1148, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.01% (0.0633 => 0.0766, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.85% (0.1103 => 0.1333, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.64% (0.1003 => 0.1210, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.61% (0.0495 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.57% (0.3903 => 0.4706, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.56% (0.0642 => 0.0774, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 20.46% (0.0821 => 0.0989, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.40% (0.1549 => 0.1865, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.26% (0.1604 => 0.1929, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.07% (0.0822 => 0.0987, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/05-eks/eks: 19.89% (0.1619 => 0.1941, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.43% (0.1462 => 0.1746, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 19.32% (0.0947 => 0.1130, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 18.81% (0.0808 => 0.0960, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.74% (0.3890 => 0.4619, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.57% (0.2014 => 0.2388, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/08-main/main: 18.31% (0.1218 => 0.1441, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 18.19% (0.0698 => 0.0825, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 18.17% (0.4029 => 0.4761, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.17% (0.2736 => 0.3233, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 18.07% (0.5826 => 0.6879, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.01% (0.1088 => 0.1284, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.98% (1.3152 => 1.5517, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/09-vor/vor: 17.81% (0.1505 => 0.1773, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 17.69% (0.5889 => 0.6931, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.55% (0.2866 => 0.3369, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.50% (0.1160 => 0.1363, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.45% (0.0573 => 0.0673) MultiSource/Applications/Burg/burg: 17.40% (0.5546 => 0.6511, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.29% (3.5627 => 4.1786, std.dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.02% (0.0605 => 0.0708, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 16.98% (1.8794 => 2.1985, std.dev.: 0.0284) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.97% (0.1968 => 0.2302, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.92% (0.4658 => 0.5446, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.85% (0.3271 => 0.3822, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.83% (1.6211 => 1.8939, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.66% (0.2875 => 0.3354, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.49% (0.4361 => 0.5080, std.dev.: 0.0038) MultiSource/Applications/d/make_dparser: 16.38% (1.0781 => 1.2547, std.dev.: 0.0031) MultiSource/Applications/hbd/hbd: 16.36% (0.9697 => 1.1283, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.28% (0.3930 => 0.4570, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.28% (0.5026 => 0.5844, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/18-imp/imp: 16.05% (0.1421 => 0.1649, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.04% (4.4195 => 5.1283, std.dev.: 0.0421) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.99% (2.7292 => 3.1657, std.dev.: 0.0342) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.96% (0.2738 => 0.3175, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 15.89% (0.2725 => 0.3158, std.dev.: 0.0042) SingleSource/Regression/C++/ofstream_ctor: 15.88% (0.3004 => 0.3481, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hello: 15.84% (0.2714 => 0.3144, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 15.82% (0.2750 => 0.3185, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.79% (0.2729 => 0.3160, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 15.73% (0.1284 => 0.1486, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 15.73% (0.2823 => 0.3267, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 15.69% (4.2109 => 4.8717, std.dev.: 0.0052) SingleSource/UnitTests/ObjC++/property-reference: 15.67% (0.7171 => 0.8295, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/matrix: 15.65% (0.2780 => 0.3215, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.63% (0.2911 => 0.3366, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.62% (0.3195 => 0.3694, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 15.61% (0.2813 => 0.3252, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 15.58% (0.2811 => 0.3249, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.58% (0.2792 => 0.3227, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 15.54% (0.9909 => 1.1449, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 15.52% (0.2803 => 0.3238, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 15.49% (0.3267 => 0.3773, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.48% (1.9694 => 2.2742, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.46% (2.0673 => 2.3870, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/wc: 15.44% (0.3096 => 0.3574, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.32% (0.1090 => 0.1257, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 15.29% (0.3258 => 0.3756, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 15.23% (23.5202 => 27.1031, std.dev.: 0.0387) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.20% (1.9966 => 2.3000, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/ary2: 15.01% (0.3317 => 0.3815, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.90% (0.3060 => 0.3516, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 14.75% (0.2075 => 0.2381, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/moments: 14.68% (0.3678 => 0.4218, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.49% (0.3362 => 0.3849, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 14.46% (0.2566 => 0.2937, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.37% (0.3124 => 0.3573, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.35% (0.3282 => 0.3753, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.26% (0.3465 => 0.3959, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 14.25% (0.3348 => 0.3825, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-2: 14.19% (0.3446 => 0.3935, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 14.15% (0.3477 => 0.3969, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 14.14% (0.3726 => 0.4253, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 14.10% (0.3460 => 0.3948, std.dev.: 0.0031) MultiSource/Applications/lua/lua: 14.08% (1.4269 => 1.6278, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/for-in: 14.07% (0.3496 => 0.3988, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.07% (0.3625 => 0.4135, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 14.07% (0.3469 => 0.3957, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.05% (0.3488 => 0.3978, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 14.00% (0.3442 => 0.3924, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 13.99% (0.4146 => 0.4726, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 13.81% (0.4251 => 0.4838, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 13.80% (0.7875 => 0.8962, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 13.73% (0.3650 => 0.4151, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 13.67% (0.3643 => 0.4141, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.66% (0.3690 => 0.4194, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.64% (0.3981 => 0.4524, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.55% (0.3845 => 0.4366, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/parameter-passing: 13.37% (0.3724 => 0.4222, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 13.28% (2.1653 => 2.4528, std.dev.: 0.0176) SingleSource/Benchmarks/Misc-C++/bigfib: 13.23% (0.5012 => 0.5675, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 13.18% (2.1013 => 2.3783, std.dev.: 0.0112) MultiSource/Applications/JM/lencod/lencod: 13.00% (4.6177 => 5.2180, std.dev.: 0.0053) MultiSource/Applications/SIBsim4/SIBsim4: 12.63% (0.2691 => 0.3031, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.60% (0.2040 => 0.2297, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 12.37% (5.5417 => 6.2274, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.92% (0.6435 => 0.7202, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.58% (0.1028 => 0.1147, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.15% (0.3498 => 0.3888, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.11% (0.2737 => 0.3041, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.03% (0.2068 => 0.2296, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.99% (0.1383 => 0.1535, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.86% (0.3084 => 0.3419, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 10.85% (0.4847 => 0.5373, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 10.52% (0.6634 => 0.7332, std.dev.: 0.0038) MultiSource/Applications/minisat/minisat: 10.40% (0.3336 => 0.3683, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.03% (0.2103 => 0.2314, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 9.90% (2.0346 => 2.2360, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 9.79% (0.2391 => 0.2625, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.17% (4.6926 => 5.1231, std.dev.: 0.0101) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.05% (11.6398 => 12.6932, std.dev.: 0.0240) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.86% (0.5361 => 0.5836, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.26% (0.5584 => 0.6045, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.08% (0.7426 => 0.8026, std.dev.: 0.0044) MultiSource/Applications/kimwitu++/kc: 6.84% (11.9555 => 12.7731, std.dev.: 0.0096) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.67% (0.3792 => 0.3969, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 66.74% (0.2162 => 0.3605, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0075) MultiSource/Applications/ClamAV/clamscan: 9.39% (0.2802 => 0.3065, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6107, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6788, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-2: 4.91% (1.8057 => 1.8944, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1723, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6368, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1931, std.dev.: 0.0087) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.69% (3.1722 => 3.2257, std.dev.: 0.0034) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3072, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5888, std.dev.: 0.0152) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.38% (2.4764 => 2.3926, std.dev.: 0.0239) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.89% (25.4195 => 16.5515, std.dev.: 0.0138) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9750, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7970, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/ary2: -7.04% (0.2402 => 0.2233, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.57% (11.2080 => 10.8079, std.dev.: 0.0104) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.44% (17.2379 => 16.8172, std.dev.: 0.0465) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.25% (41.7953 => 40.8569, std.dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5712, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4951, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1504, std.dev.: 0.0724) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0420, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 24 03:46:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 05:46:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121124114631.9FC8C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6200?compare_to=6196&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6200, Order: 168538, Start Time: 2012-11-24 09:28:41, End Time: 2012-11-24 11:46:59 To: 6196, Order: 168536, Start Time: 2012-11-24 06:15:48, End Time: 2012-11-24 08:38:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 30 (127 on baseline) Performance Improvements: 2 (40 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1054 (718 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/lemon/lemon: 13.59% (1.1983 => 1.3611, std.dev.: 0.0200) MultiSource/Applications/minisat/minisat: 12.38% (0.8168 => 0.9179, std.dev.: 0.0051) MultiSource/Applications/aha/aha: 11.80% (0.1330 => 0.1487, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 9.72% (0.1461 => 0.1603, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 9.65% (0.3525 => 0.3865, std.dev.: 0.0023) MultiSource/Applications/siod/siod: 9.61% (2.5890 => 2.8379, std.dev.: 0.0710) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 9.24% (0.1331 => 0.1454, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.12% (1.7951 => 1.9589, std.dev.: 0.0563) SingleSource/UnitTests/ObjC/exceptions-3: 8.42% (0.3953 => 0.4286, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.22% (0.4003 => 0.4332, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: 7.96% (0.1608 => 0.1736, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: 7.72% (0.3936 => 0.4240, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-4: 7.70% (0.3988 => 0.4295, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 7.51% (0.3116 => 0.3350, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.41% (0.4318 => 0.4638, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/sieve: 7.07% (0.4000 => 0.4283, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.99% (0.3017 => 0.3228, std.dev.: 0.0082) SingleSource/UnitTests/ObjC/exceptions: 6.64% (0.4305 => 0.4591, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.78% (2.3115 => 2.4450, std.dev.: 0.0363) MultiSource/Applications/SPASS/SPASS: 3.14% (17.8662 => 18.4268, std.dev.: 0.2115) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.31% (0.3430 => 0.4298, std.dev.: 0.0175) MultiSource/Benchmarks/Olden/health/health: 12.59% (0.4621 => 0.5203, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/bisort/bisort: 10.58% (0.8999 => 0.9951, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/puzzle: 8.45% (0.6950 => 0.7537, std.dev.: 0.0139) MultiSource/Benchmarks/Olden/tsp/tsp: 6.57% (1.1702 => 1.2471, std.dev.: 0.0215) MultiSource/Benchmarks/Fhourstones/fhourstones: 5.81% (1.8186 => 1.9243, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/neural/neural: 4.66% (0.2234 => 0.2338, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 4.30% (4.5901 => 4.7873, std.dev.: 0.0043) MultiSource/Applications/SIBsim4/SIBsim4: 1.78% (3.8599 => 3.9287, std.dev.: 0.0203) MultiSource/Applications/sgefa/sgefa: 1.73% (0.6305 => 0.6414, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: -8.62% (0.1474 => 0.1347, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -2.70% (3.1966 => 3.1102, std.dev.: 0.0112) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.38% (69.2573 => 68.9971, std.dev.: 0.3807) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 2.17% (0.1338 => 0.1367, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.05% (0.0420 => 0.0458, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.77% (0.0653 => 0.0648, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: 0.01% (493.8527 => 493.8823, std.dev.: 0.2224) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.10% (63.2438 => 68.9971, std.dev.: 0.3807) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.96% (4.3882 => 0.0458, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43695.54% (1.1277 => 493.8823, std.dev.: 0.2224) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 192.94% (0.5229 => 1.5318, std.dev.: 0.1205) MultiSource/Applications/SPASS/SPASS: 22.93% (14.9895 => 18.4268, std.dev.: 0.2115) MultiSource/Applications/kimwitu++/kc: 47.44% (14.1553 => 20.8709, std.dev.: 0.3047) MultiSource/Benchmarks/MallocBench/gs/gs: 18.00% (4.1105 => 4.8502, std.dev.: 0.2210) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.65% (1.1048 => 1.5097, std.dev.: 0.0746) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 428.82% (7.1582 => 37.8541, std.dev.: 0.4416) SingleSource/Benchmarks/Misc-C++-EH/spirit: 74.87% (3.4629 => 6.0555, std.dev.: 0.4093) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.41% (0.6222 => 1.0292, std.dev.: 0.0710) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10432.36% (0.0720 => 7.5833, std.dev.: 0.1641) MultiSource/Applications/SIBsim4/SIBsim4: 3928600.00% (0.0001 => 3.9287, std.dev.: 0.0203) MultiSource/Applications/SPASS/SPASS: 12892700.00% (0.0001 => 12.8928, std.dev.: 0.8552) MultiSource/Applications/kimwitu++/kc: 53600.00% (0.0001 => 0.0537, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 63800.00% (0.0001 => 0.0639, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576500.00% (0.0001 => 0.5766, std.dev.: 0.0210) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10078700.00% (0.0001 => 10.0788, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5676200.00% (0.0001 => 5.6763, std.dev.: 0.9232) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1740.27% (1.1194 => 20.6000, std.dev.: 0.5947) MultiSource/Applications/ClamAV/clamscan: 68.83% (22.1758 => 37.4396, std.dev.: 0.4300) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 59.45% (2.9384 => 4.6853, std.dev.: 0.3438) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 51.33% (7.0540 => 10.6745, std.dev.: 0.3696) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 51.28% (8.1363 => 12.3090, std.dev.: 0.1443) MultiSource/Applications/JM/lencod/lencod: 46.75% (21.9371 => 32.1919, std.dev.: 0.0681) MultiSource/Benchmarks/FreeBench/distray/distray: 44.51% (0.1056 => 0.1526, std.dev.: 0.0091) SingleSource/Benchmarks/CoyoteBench/almabench: 37.67% (0.0730 => 0.1005, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 37.36% (0.1432 => 0.1967, std.dev.: 0.0069) MultiSource/Benchmarks/Fhourstones/fhourstones: 33.65% (0.1566 => 0.2093, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/dot-syntax-1: 33.61% (0.0479 => 0.0640, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 33.21% (0.1584 => 0.2110, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 31.17% (0.2554 => 0.3350, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/tsp/tsp: 30.47% (0.1175 => 0.1533, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 29.19% (0.1151 => 0.1487, std.dev.: 0.0011) SingleSource/UnitTests/vla: 29.01% (0.0355 => 0.0458, std.dev.: 0.0029) MultiSource/Applications/minisat/minisat: 29.01% (0.7115 => 0.9179, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/messages-2: 27.49% (0.0662 => 0.0844, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.11% (0.0793 => 0.1008, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bisort/bisort: 27.04% (0.0614 => 0.0780, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.02% (0.1125 => 0.1429, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 26.94% (1.0722 => 1.3611, std.dev.: 0.0200) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 26.44% (0.0953 => 0.1205, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 26.42% (0.1268 => 0.1603, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: 26.20% (0.0626 => 0.0790, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/17-bintr/bintr: 25.04% (0.0675 => 0.0844, std.dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 24.75% (0.7433 => 0.9273, std.dev.: 0.0206) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 24.63% (0.2107 => 0.2626, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 24.32% (0.3109 => 0.3865, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/perimeter/perimeter: 24.29% (0.0770 => 0.0957, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/treeadd/treeadd: 24.04% (0.0416 => 0.0516, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.95% (0.2271 => 0.2815, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/dry: 23.90% (0.0456 => 0.0565, std.dev.: 0.0019) MultiSource/Applications/siod/siod: 23.55% (2.2969 => 2.8379, std.dev.: 0.0710) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 23.52% (1.5859 => 1.9589, std.dev.: 0.0563) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.28% (0.0842 => 0.1038, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 23.25% (0.0886 => 0.1092, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.19% (0.0746 => 0.0919, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.16% (0.1032 => 0.1271, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.81% (0.2700 => 0.3316, std.dev.: 0.0128) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 22.32% (0.2603 => 0.3184, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/exceptions-3: 21.90% (0.3516 => 0.4286, std.dev.: 0.0029) MultiSource/Benchmarks/BitBench/five11/five11: 21.34% (0.0567 => 0.0688, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-2: 21.25% (0.3497 => 0.4240, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-4: 21.22% (0.3543 => 0.4295, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_isamax: 20.45% (0.0704 => 0.0848, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 20.00% (0.3865 => 0.4638, std.dev.: 0.0124) SingleSource/UnitTests/ObjC/exceptions: 19.93% (0.3828 => 0.4591, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.90% (0.0834 => 0.1000, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/parameter-passing: 19.20% (0.3927 => 0.4681, std.dev.: 0.0182) MultiSource/Applications/oggenc/oggenc: 19.14% (5.7591 => 6.8615, std.dev.: 0.1987) SingleSource/Benchmarks/Shootout-C++/sieve: 18.87% (0.3603 => 0.4283, std.dev.: 0.0087) MultiSource/Benchmarks/McCat/04-bisect/bisect: 18.83% (0.1062 => 0.1262, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/neural/neural: 18.66% (0.1463 => 0.1736, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/property: 18.43% (0.3886 => 0.4602, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 18.27% (0.3650 => 0.4317, std.dev.: 0.0167) MultiSource/Applications/Burg/burg: 18.03% (1.1642 => 1.3741, std.dev.: 0.0724) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.98% (14.3668 => 16.9502, std.dev.: 0.5306) MultiSource/Benchmarks/mafft/pairlocalalign: 17.53% (9.4845 => 11.1476, std.dev.: 0.2936) SingleSource/UnitTests/ObjC/synchronized: 17.44% (0.3561 => 0.4182, std.dev.: 0.0081) SingleSource/UnitTests/ObjC/instance-method-metadata: 17.41% (0.3543 => 0.4160, std.dev.: 0.0101) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 17.16% (0.8101 => 0.9491, std.dev.: 0.0176) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.13% (0.2756 => 0.3228, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.82% (0.4103 => 0.4793, std.dev.: 0.0237) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.65% (0.0871 => 0.1016, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.53% (0.8172 => 0.9523, std.dev.: 0.0358) SingleSource/UnitTests/ObjC/for-in: 16.19% (0.3694 => 0.4292, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.03% (0.5981 => 0.6940, std.dev.: 0.0235) MultiSource/Benchmarks/Olden/mst/mst: 15.82% (0.1163 => 0.1347, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 15.81% (0.1695 => 0.1963, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.79% (0.2065 => 0.2391, std.dev.: 0.0101) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.74% (0.0648 => 0.0750, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.04% (0.1117 => 0.1285, std.dev.: 0.0046) MultiSource/Applications/viterbi/viterbi: 14.98% (0.1555 => 0.1788, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.94% (0.0770 => 0.0885, std.dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.32% (0.3121 => 0.3568, std.dev.: 0.0164) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.19% (5.0018 => 5.7115, std.dev.: 0.1935) MultiSource/Applications/spiff/spiff: 13.90% (0.7835 => 0.8924, std.dev.: 0.0371) MultiSource/Applications/sqlite3/sqlite3: 13.70% (17.1811 => 19.5342, std.dev.: 0.1781) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.61% (0.1029 => 0.1169, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/block-byref-aggr: 13.49% (0.3817 => 0.4332, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.46% (0.1337 => 0.1517, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.39% (4.9449 => 5.6071, std.dev.: 0.1866) SingleSource/UnitTests/ObjC/trivial-interface: 12.53% (0.3473 => 0.3908, std.dev.: 0.0159) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.23% (0.1906 => 0.2120, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.03% (2.2022 => 2.4450, std.dev.: 0.0363) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.62% (0.6450 => 0.7135, std.dev.: 0.0220) SingleSource/UnitTests/Vector/constpool: 2.41% (54.1659 => 55.4733, std.dev.: 0.4215) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.29% (4.3953 => 11.0008, std.dev.: 0.0207) SingleSource/Benchmarks/Shootout-C++/methcall: 147.41% (5.3999 => 13.3600, std.dev.: 0.0123) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 32.00% (0.3256 => 0.4298, std.dev.: 0.0175) MultiSource/Applications/minisat/minisat: 30.28% (9.1159 => 11.8758, std.dev.: 0.4367) MultiSource/Benchmarks/Olden/bisort/bisort: 19.42% (0.8333 => 0.9951, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.45% (1.1145 => 1.3090, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 17.45% (6.6465 => 7.8064, std.dev.: 0.0081) MultiSource/Benchmarks/Olden/health/health: 17.05% (0.4445 => 0.5203, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/tsp/tsp: 15.63% (1.0785 => 1.2471, std.dev.: 0.0215) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.62% (0.2944 => 0.3404, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.65% (2.8904 => 3.2272, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 10.49% (3.1578 => 3.4891, std.dev.: 0.0730) SingleSource/Benchmarks/Misc/richards_benchmark: 10.24% (1.1396 => 1.2563, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.30% (1.7254 => 1.8859, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/puzzle: 8.26% (0.6962 => 0.7537, std.dev.: 0.0139) MultiSource/Applications/lemon/lemon: 7.19% (1.4460 => 1.5499, std.dev.: 0.0128) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.62% (4.2280 => 4.4656, std.dev.: 0.0083) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691) MultiSource/Benchmarks/Fhourstones/fhourstones: 4.99% (1.8329 => 1.9243, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 4.70% (0.2233 => 0.2338, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 4.64% (26.0924 => 27.3040, std.dev.: 0.1267) MultiSource/Benchmarks/nbench/nbench: 4.08% (11.6436 => 12.1186, std.dev.: 0.0106) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 3.08% (4.6441 => 4.7873, std.dev.: 0.0043) MultiSource/Applications/sgefa/sgefa: 3.07% (0.6223 => 0.6414, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 2.07% (3.1595 => 3.2249, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: 2.06% (2.4116 => 2.4612, std.dev.: 0.0129) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.86% (2.1424 => 2.1822, std.dev.: 0.0123) MultiSource/Benchmarks/PAQ8p/paq8p: 1.84% (85.0658 => 86.6316, std.dev.: 0.2262) MultiSource/Benchmarks/mafft/pairlocalalign: 1.45% (27.8444 => 28.2494, std.dev.: 0.0459) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.36% (6.5088 => 6.5973, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.26% (1.0313 => 1.0443, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0501, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.09% (5.2139 => 5.2709, std.dev.: 0.0122) SingleSource/Benchmarks/Dhrystone/fldry: 1.02% (1.9577 => 1.9776, std.dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.51% (6.6874 => 0.1666, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.91% (5.2763 => 1.2182, std.dev.: 0.0632) SingleSource/Benchmarks/Misc/salsa20: -75.70% (0.8651 => 0.2102, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/richards_benchmark: -44.94% (0.1622 => 0.0893, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.17% (5.3526 => 4.7011, std.dev.: 0.1448) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.31% (5.3855 => 4.7765, std.dev.: 0.1231) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -9.86% (1.7609 => 1.5873, std.dev.: 0.0632) MultiSource/Applications/JM/ldecod/ldecod: -7.91% (10.4361 => 9.6108, std.dev.: 0.2522) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.28% (0.3987 => 0.2381, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.31% (4.5009 => 2.7765, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.16% (2.6546 => 2.0132, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -19.20% (0.2161 => 0.1746, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4224, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.72% (2.6778 => 2.2836, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.76% (32.5116 => 29.0145, std.dev.: 0.0170) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -9.56% (9.5636 => 8.6492, std.dev.: 0.1264) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.88% (1.5660 => 1.4269, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.2416 => 3.0213, std.dev.: 0.0277) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.61% (2.7294 => 2.5764, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.10% (1.6805 => 1.5948, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/flops-5: -4.78% (1.5835 => 1.5078, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: -4.42% (6.2999 => 6.0214, std.dev.: 0.0142) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.29% (19.9488 => 19.0922, std.dev.: 0.2012) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8918, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.05% (0.9957 => 0.9653, std.dev.: 0.0031) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.23% (0.4808 => 0.4701, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6771, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.69% (8.1563 => 8.0185, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -1.50% (10.2830 => 10.1291, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -7.95% (0.1485 => 0.1367, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0025) Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 24 07:16:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 09:16:11 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121124151611.E103D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6201?compare_to=6197&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6201, Order: 168541, Start Time: 2012-11-24 13:45:16, End Time: 2012-11-24 15:16:40 To: 6197, Order: 168538, Start Time: 2012-11-24 08:51:43, End Time: 2012-11-24 10:21:58 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 8 (100 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1046 (850 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/gs/gs: 2.04% (4.2266 => 4.3130, std.dev.: 0.0260) MultiSource/Applications/hbd/hbd: 1.18% (1.4766 => 1.4940, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel24: 83.53% (0.2331 => 0.4278, std.dev.: 0.0616) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.03% (0.3318 => 0.3485, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.62% (5.0212 => 5.1530, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 1.94% (0.8795 => 0.8966, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.33% (4.4424 => 4.5015, std.dev.: 0.0213) SingleSource/Benchmarks/Shootout/methcall: 1.03% (8.2076 => 8.2923, std.dev.: 0.0234) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.15% (1.0660 => 1.0676, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -40.18% (0.0219 => 0.0131, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.47% (0.0426 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.05% (0.0332 => 0.0292, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.24% (0.0313 => 0.0306, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.83% (0.0424 => 0.0412, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: 54.55% (0.0132 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -12.77% (0.0188 => 0.0164, std.dev.: 0.0073) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.27% (0.1473 => 0.1477, std.dev.: 0.0203) MultiSource/Applications/lemon/lemon: 6.90% (1.1018 => 1.1778, std.dev.: 0.0855) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.83% (0.4223 => 0.4188, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.71% (0.1404 => 0.1414, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.06% (0.0583 => 0.0630, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 4.67% (0.0257 => 0.0269, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.31% (0.0555 => 0.0590, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.13% (1.1923 => 1.1939, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 900.00% (0.0001 => 0.0010, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 600.00% (0.0001 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.85% (0.0557 => 0.0623, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.42% (0.0248 => 0.0180, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.10% (0.7794 => 0.7786, std.dev.: 0.0461) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 13.73% (0.0051 => 0.0058, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.68% (16.4461 => 17.7098, std.dev.: 0.1433) MultiSource/Applications/sqlite3/sqlite3: 2324.56% (0.6332 => 15.3523, std.dev.: 0.8019) MultiSource/Benchmarks/McCat/08-main/main: 48.61% (0.1831 => 0.2721, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.03% (0.1559 => 0.1465, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7050.98% (0.3123 => 22.3325, std.dev.: 0.2165) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.71% (0.2463 => 0.3712, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1524.82% (0.3344 => 5.4334, std.dev.: 0.7538) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.38% (0.2364 => 0.3224, std.dev.: 0.0225) SingleSource/Benchmarks/Misc-C++/bigfib: 4.06% (0.6010 => 0.6254, std.dev.: 0.0160) SingleSource/Benchmarks/Misc/mandel: 1.63% (0.0429 => 0.0436, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.70% (0.3266 => 0.3387, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/strcat: 3.25% (0.1969 => 0.2033, std.dev.: 0.0065) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.25% (0.0224 => 0.0238, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -30.87% (0.0230 => 0.0159, std.dev.: 0.0007) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0441, std.dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: 10.53% (0.1462 => 0.1616, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4860, std.dev.: 0.0709) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0718, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4947, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5114, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.6158, std.dev.: 0.0832) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3144, std.dev.: 0.0176) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1350, std.dev.: 0.0469) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3632, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4078, std.dev.: 0.0333) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0882, std.dev.: 0.0220) SingleSource/Regression/C/uint64_to_float: -23.52% (2.1832 => 1.6697, std.dev.: 0.0023) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.78% (0.0810 => 0.0954, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 14.21% (0.1112 => 0.1270, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 8.97% (0.1137 => 0.1239, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.28% (0.2279 => 0.2445, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.10% (0.6010 => 0.6437, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.19% (0.2519 => 0.2675, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.7473 => 0.7930, std.dev.: 0.0094) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.95% (0.8321 => 0.8816, std.dev.: 0.0131) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.68% (0.1885 => 0.1992, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.25% (0.3295 => 0.3468, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.12% (0.4847 => 0.5095, std.dev.: 0.0059) MultiSource/Applications/hbd/hbd: 4.70% (1.4269 => 1.4940, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/gs/gs: 4.42% (4.1305 => 4.3130, std.dev.: 0.0260) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.40% (0.2998 => 0.3130, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.28% (0.6287 => 0.6556, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.22% (0.4127 => 0.4301, std.dev.: 0.0028) MultiSource/Applications/lua/lua: 4.14% (3.8189 => 3.9771, std.dev.: 0.0332) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.14% (0.4783 => 0.4981, std.dev.: 0.0033) MultiSource/Applications/treecc/treecc: 4.13% (1.9948 => 2.0771, std.dev.: 0.0245) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.06% (1.1606 => 1.2077, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.78% (0.5817 => 0.6037, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 3.78% (0.6834 => 0.7092, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.59% (0.8611 => 0.8920, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.33% (1.3279 => 1.3721, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.27% (1.2526 => 1.2936, std.dev.: 0.0148) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.20% (6.6074 => 6.8186, std.dev.: 0.0413) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.14% (0.8697 => 0.8970, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.00% (4.1763 => 4.3014, std.dev.: 0.0405) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.97% (0.9056 => 0.9325, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.90% (0.8805 => 0.9060, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.86% (0.6227 => 0.6405, std.dev.: 0.0053) MultiSource/Applications/lambda-0_1_3/lambda: 2.86% (0.7557 => 0.7773, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.86% (1.1170 => 1.1489, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.85% (0.9435 => 0.9704, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.83% (0.8317 => 0.8552, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.75% (0.8597 => 0.8833, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.67% (0.9908 => 1.0173, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.67% (0.9688 => 0.9947, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.67% (0.8457 => 0.8683, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 2.65% (31.8598 => 32.7038, std.dev.: 0.2145) MultiSource/Benchmarks/PAQ8p/paq8p: 2.58% (2.3764 => 2.4376, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.50% (0.8331 => 0.8539, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.48% (0.9039 => 0.9263, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 2.47% (0.9810 => 1.0052, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.43% (0.8050 => 0.8246, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.43% (0.8286 => 0.8487, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.42% (1.4479 => 1.4830, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.40% (0.8359 => 0.8560, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.40% (0.8007 => 0.8199, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.34% (0.8066 => 0.8255, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.32% (0.8069 => 0.8256, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.31% (0.8518 => 0.8715, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.30% (13.1811 => 13.4844, std.dev.: 0.0913) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.29% (0.8420 => 0.8613, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.24% (0.8885 => 0.9084, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.19% (0.8177 => 0.8356, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.15% (0.8261 => 0.8439, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.14% (0.9069 => 0.9263, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.13% (0.8204 => 0.8379, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.08% (0.7932 => 0.8097, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/football/football: 2.08% (0.8768 => 0.8950, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.05% (0.8048 => 0.8213, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 1.98% (8.6247 => 8.7955, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.96% (0.8855 => 0.9029, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.76% (0.8995 => 0.9153, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.74% (0.8927 => 0.9082, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.72% (0.8338 => 0.8481, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 101.51% (0.0199 => 0.0401, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/pi: 55.94% (1.5795 => 2.4631, std.dev.: 0.0235) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 18.02% (0.7597 => 0.8966, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.33% (2.9753 => 3.4611, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.57% (2.7995 => 3.2074, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.45% (5.0261 => 5.6018, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.38% (0.3186 => 0.3485, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/queens: 7.27% (1.7056 => 1.8296, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.88% (6.3772 => 6.8159, std.dev.: 0.1539) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.75% (4.7794 => 5.1018, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.85% (4.5327 => 4.7978, std.dev.: 0.0271) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.77% (4.9686 => 5.2555, std.dev.: 0.0186) MultiSource/Applications/SIBsim4/SIBsim4: 5.70% (3.1873 => 3.3689, std.dev.: 0.0518) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.76% (6.2275 => 6.5240, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.68% (3.3761 => 3.5341, std.dev.: 0.0109) MultiSource/Applications/lambda-0_1_3/lambda: 4.29% (7.4933 => 7.8147, std.dev.: 0.0265) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.20% (4.9453 => 5.1530, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.12% (4.9469 => 5.1506, std.dev.: 0.0361) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.04% (4.3552 => 4.5313, std.dev.: 0.0430) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.94% (1.2337 => 1.2700, std.dev.: 0.0063) MultiSource/Applications/siod/siod: 2.92% (3.6643 => 3.7714, std.dev.: 0.0345) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.90% (0.3587 => 0.3691, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.64% (11.5690 => 11.8740, std.dev.: 0.0268) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.47% (8.2783 => 8.4827, std.dev.: 0.0271) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.32% (4.8660 => 4.9787, std.dev.: 0.0296) SingleSource/Benchmarks/Shootout/lists: 2.30% (7.3375 => 7.5066, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.16% (1.5941 => 1.6285, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.52% (4.4340 => 4.5015, std.dev.: 0.0213) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (1.1365 => 1.1527, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/neural/neural: 1.32% (1.0841 => 1.0984, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 1.28% (8.5322 => 8.6412, std.dev.: 0.0158) MultiSource/Benchmarks/Olden/power/power: 1.23% (1.2061 => 1.2209, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.10% (3.5679 => 3.6070, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -36.98% (0.0338 => 0.0213, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/em3d/em3d: -20.74% (5.4641 => 4.3306, std.dev.: 0.0217) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.07% (7.2130 => 6.1984, std.dev.: 0.0406) SingleSource/Benchmarks/McGill/chomp: -11.03% (1.1216 => 0.9979, std.dev.: 0.0333) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.75% (1.0512 => 0.9382, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -8.51% (63.1822 => 57.8059, std.dev.: 0.0426) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.98% (14.6451 => 13.4768, std.dev.: 0.1537) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.91% (4.7482 => 4.4200, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.96% (3.7148 => 3.4935, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.48% (5.4972 => 5.1960, std.dev.: 0.0576) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.05% (5.1557 => 4.8951, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.36% (4.7449 => 4.5380, std.dev.: 0.0113) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.03% (2.8773 => 2.7613, std.dev.: 0.0325) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.90% (6.0224 => 5.7878, std.dev.: 0.0186) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.24% (0.5807 => 0.5619, std.dev.: 0.0020) MultiSource/Applications/lua/lua: -3.16% (29.8330 => 28.8907, std.dev.: 0.1685) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.06% (28.5821 => 27.7078, std.dev.: 0.0649) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.86% (2.6356 => 2.5601, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/hash2: -2.20% (3.4237 => 3.3485, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.09% (9.9065 => 9.6994, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (11.5316 => 11.2986, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.64% (2.3487 => 2.3102, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.56% (4.9994 => 4.9213, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.14% (5.6343 => 5.5701, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.03% (1.0262 => 1.0676, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 6.50% (0.0123 => 0.0131, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 14.96% (0.0254 => 0.0292, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.32% (0.0302 => 0.0306, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 7.29% (0.0384 => 0.0412, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -8.89% (0.0180 => 0.0164, std.dev.: 0.0073) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.71% (0.1438 => 0.1477, std.dev.: 0.0203) MultiSource/Applications/lemon/lemon: 3.96% (1.1329 => 1.1778, std.dev.: 0.0855) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.58% (0.4164 => 0.4188, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.29% (0.1369 => 0.1414, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.72% (0.0641 => 0.0630, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 37.95% (0.0195 => 0.0269, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.08% (0.0578 => 0.0590, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.39% (1.1437 => 1.1939, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 900.00% (0.0001 => 0.0010, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0014 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.64% (0.0627 => 0.0623, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0180 => 0.0180, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.88% (0.8017 => 0.7786, std.dev.: 0.0461) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -6.45% (0.0062 => 0.0058, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 24 07:22:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 09:22:39 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121124152239.A9EC22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6202?compare_to=6198&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6202, Order: 168541, Start Time: 2012-11-24 13:49:23, End Time: 2012-11-24 15:23:09 To: 6198, Order: 168538, Start Time: 2012-11-24 08:55:21, End Time: 2012-11-24 10:29:30 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 1 (178 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1090 (859 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.38% (3.7616 => 3.8134, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.30% (56.4159 => 54.5527, std.dev.: 0.0286) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.81% (2.0478 => 2.1053, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: 2.61% (7.4937 => 7.6896, std.dev.: 0.0203) SingleSource/Benchmarks/Shootout-C++/hash2: 2.35% (3.1932 => 3.2681, std.dev.: 0.0035) MultiSource/Benchmarks/llubenchmark/llu: 1.87% (3.7435 => 3.8134, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.60% (0.1431 => 0.1308, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.03% (0.3821 => 0.3514, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.65% (0.3142 => 0.2933, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.64% (0.3357 => 0.3134, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.56% (0.9542 => 0.8916, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: -6.55% (2.4924 => 2.3292, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.26% (0.2428 => 0.2276, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -6.20% (0.2160 => 0.2026, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.12% (0.9852 => 0.9249, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -6.12% (9.2283 => 8.6636, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.09% (0.7198 => 0.6760, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-3: -6.06% (0.3848 => 0.3615, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-2: -6.00% (0.3831 => 0.3601, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.98% (0.3896 => 0.3663, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -5.95% (0.4033 => 0.3793, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.95% (0.3884 => 0.3653, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: -5.94% (16.1920 => 15.2310, std.dev.: 0.0107) SingleSource/UnitTests/ObjC/trivial-interface: -5.93% (0.3812 => 0.3586, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -5.91% (0.4176 => 0.3929, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.90% (0.2355 => 0.2216, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-4: -5.90% (0.3880 => 0.3651, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.89% (0.6484 => 0.6102, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.89% (0.3891 => 0.3662, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.88% (1.3722 => 1.2915, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -5.87% (0.9179 => 0.8640, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -5.85% (0.1879 => 0.1769, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/chomp: -5.85% (0.1761 => 0.1658, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.85% (0.1796 => 0.1691, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.82% (1.0544 => 0.9930, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.82% (3.5339 => 3.3284, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/gs/gs: -5.75% (4.3330 => 4.0839, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.74% (0.3658 => 0.3448, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.74% (4.8161 => 4.5397, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.71% (0.5863 => 0.5528, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.66% (4.0323 => 3.8039, std.dev.: 0.0042) MultiSource/Applications/JM/ldecod/ldecod: -5.66% (7.0961 => 6.6946, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.64% (0.7919 => 0.7472, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.64% (0.5478 => 0.5169, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.63% (1.6364 => 1.5442, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/property: -5.62% (0.4199 => 0.3963, std.dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.61% (6.7716 => 6.3917, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.61% (0.5705 => 0.5385, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.60% (0.2695 => 0.2544, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.60% (0.5591 => 0.5278, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.59% (0.6667 => 0.6294, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.59% (1.4642 => 1.3824, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: -5.58% (1.1450 => 1.0811, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.56% (1.2300 => 1.1616, std.dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: -5.52% (1.1530 => 1.0894, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.51% (0.5570 => 0.5263, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.49% (0.6297 => 0.5951, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.49% (0.6304 => 0.5958, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.49% (0.5925 => 0.5600, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.48% (0.6736 => 0.6367, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.45% (4.8802 => 4.6140, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.45% (0.5849 => 0.5530, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.44% (0.6230 => 0.5891, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -5.43% (0.3406 => 0.3221, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.43% (0.5805 => 0.5490, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -5.42% (0.4280 => 0.4048, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.42% (0.5575 => 0.5273, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.41% (0.6446 => 0.6097, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.41% (0.5581 => 0.5279, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.41% (0.6660 => 0.6300, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.39% (0.5802 => 0.5489, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/bh/bh: -5.39% (0.2985 => 0.2824, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.38% (0.6260 => 0.5923, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.38% (4.5069 => 4.2646, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.38% (0.6194 => 0.5861, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.37% (0.6293 => 0.5955, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.35% (0.6052 => 0.5728, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.34% (0.5941 => 0.5624, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: -5.33% (1.2515 => 1.1848, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.32% (0.4151 => 0.3930, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.32% (0.4515 => 0.4275, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.31% (0.5859 => 0.5548, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.30% (1.2784 => 1.2106, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -5.30% (0.2659 => 0.2518, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.30% (0.2548 => 0.2413, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -5.30% (17.1032 => 16.1973, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/methcall: -5.29% (0.3025 => 0.2865, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.28% (0.6440 => 0.6100, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.27% (0.5999 => 0.5683, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/fibo: -5.26% (0.2871 => 0.2720, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -5.26% (15.5079 => 14.6928, std.dev.: 0.0359) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.24% (0.5857 => 0.5550, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.22% (0.2278 => 0.2159, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.22% (0.4813 => 0.4562, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: -5.21% (1.3864 => 1.3142, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.20% (0.8521 => 0.8078, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hello: -5.19% (0.2849 => 0.2701, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.19% (0.5688 => 0.5393, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -5.17% (0.2939 => 0.2787, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.17% (0.5456 => 0.5174, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: -5.17% (0.3581 => 0.3396, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -5.17% (0.3194 => 0.3029, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.15% (0.6681 => 0.6337, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.15% (0.2933 => 0.2782, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.14% (0.3931 => 0.3729, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.14% (2.1713 => 2.0598, std.dev.: 0.0123) MultiSource/Applications/hexxagon/hexxagon: -5.13% (1.3148 => 1.2473, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.13% (0.4916 => 0.4664, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: -5.12% (0.3205 => 0.3041, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.12% (0.3323 => 0.3153, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.11% (14.2083 => 13.4820, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.11% (0.3483 => 0.3305, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.11% (0.6676 => 0.6335, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: -5.10% (0.3255 => 0.3089, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.10% (0.2903 => 0.2755, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.07% (0.3016 => 0.2863, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -5.06% (2.4021 => 2.2805, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/except: -5.06% (0.3026 => 0.2873, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.06% (0.3837 => 0.3643, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.05% (0.5168 => 0.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.04% (0.3057 => 0.2903, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.02% (0.4321 => 0.4104, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.01% (0.6189 => 0.5879, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.00% (1.6474 => 1.5650, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.00% (0.2999 => 0.2849, std.dev.: 0.0014) MultiSource/Applications/lua/lua: -5.00% (4.0594 => 3.8565, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.00% (1.2210 => 1.1600, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: -4.98% (0.4861 => 0.4619, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.97% (0.6033 => 0.5733, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.97% (8.0126 => 7.6146, std.dev.: 0.0064) MultiSource/Applications/d/make_dparser: -4.94% (3.5154 => 3.3419, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: -4.93% (0.7447 => 0.7080, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.92% (1.2221 => 1.1620, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.91% (22.4056 => 21.3049, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary3: -4.90% (0.3446 => 0.3277, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -4.88% (0.2989 => 0.2843, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.86% (0.2385 => 0.2269, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: -4.85% (0.4248 => 0.4042, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -4.84% (0.3059 => 0.2911, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -4.83% (0.3394 => 0.3230, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -4.83% (0.3481 => 0.3313, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.80% (0.4083 => 0.3887, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.80% (0.3252 => 0.3096, std.dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.79% (0.3319 => 0.3160, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.78% (0.6395 => 0.6089, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -4.77% (15.2527 => 14.5245, std.dev.: 0.0169) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.75% (0.2106 => 0.2006, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.73% (0.7524 => 0.7168, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.71% (0.7339 => 0.6993, std.dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: -4.71% (0.7982 => 0.7606, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.70% (0.7021 => 0.6691, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -4.66% (2.1401 => 2.0403, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.62% (0.9557 => 0.9115, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -4.62% (18.2933 => 17.4483, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.60% (0.5329 => 0.5084, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -4.58% (0.3621 => 0.3455, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: -4.55% (0.4524 => 0.4318, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.54% (0.5567 => 0.5314, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -4.50% (34.0927 => 32.5571, std.dev.: 0.0409) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.49% (0.5569 => 0.5319, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: -4.46% (0.3271 => 0.3125, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.46% (0.6395 => 0.6110, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.45% (0.4427 => 0.4230, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.38% (2.2587 => 2.1597, std.dev.: 0.0196) SingleSource/UnitTests/ObjC++/property-reference: -4.27% (0.7779 => 0.7447, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/bigfib: -4.25% (0.6750 => 0.6463, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.24% (0.8418 => 0.8061, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sieve: -4.20% (0.3788 => 0.3629, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -4.18% (5.0226 => 4.8125, std.dev.: 0.0066) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.12% (0.9077 => 0.8703, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.04% (0.3491 => 0.3350, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -3.92% (0.6347 => 0.6098, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -3.79% (0.6441 => 0.6197, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -3.78% (1.5610 => 1.5020, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.61% (5.4682 => 5.2706, std.dev.: 0.0026) SingleSource/UnitTests/Vector/constpool: -2.20% (20.7746 => 20.3179, std.dev.: 0.0394) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7552, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: -8.62% (1.2842 => 1.1735, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.90% (2.2633 => 2.1750, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7061, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4667, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 24 07:48:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 09:48:47 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121124154847.683792A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6203?compare_to=6199&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6203, Order: 168538, Start Time: 2012-11-24 12:28:22, End Time: 2012-11-24 15:49:16 To: 6199, Order: 168536, Start Time: 2012-11-24 08:17:38, End Time: 2012-11-24 11:40:02 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (169 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1090 (721 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 27.88% (0.3935 => 0.5032, std.dev.: 0.0350) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.75% (0.3761 => 0.3902, std.dev.: 0.0017) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.24% (0.0625 => 0.0889, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.74% (0.1063 => 0.1411, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.61% (0.0714 => 0.0904, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.17% (0.2969 => 0.3746, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.68% (0.1106 => 0.1390, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.37% (0.4253 => 0.5332, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.76% (0.4139 => 0.5164, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 24.22% (1.5932 => 1.9790, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.90% (0.5900 => 0.7310, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.37% (0.0475 => 0.0586, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.35% (0.4994 => 0.6160, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.29% (0.0584 => 0.0720, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.76% (0.5000 => 0.6138, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.35% (0.1620 => 0.1982, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.96% (0.0897 => 0.1094, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.84% (0.1021 => 0.1244, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 21.70% (0.0599 => 0.0729, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.50% (0.1107 => 0.1345, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/em3d/em3d: 20.68% (0.0948 => 0.1144, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0584 => 0.0704, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.42% (0.3903 => 0.4700, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.40% (0.1103 => 0.1328, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.38% (0.0633 => 0.0762, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.34% (0.1003 => 0.1207, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.32% (0.0822 => 0.0989, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.25% (0.0642 => 0.0772, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.01% (0.1549 => 0.1859, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.89% (0.1604 => 0.1923, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 19.85% (0.0821 => 0.0984, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 19.70% (0.0604 => 0.0723, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 19.58% (0.1619 => 0.1936, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 18.81% (0.0808 => 0.0960, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.81% (0.1462 => 0.1737, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 18.59% (0.0947 => 0.1123, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.51% (0.3890 => 0.4610, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.27% (0.2014 => 0.2382, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 17.90% (0.1218 => 0.1436) SingleSource/UnitTests/ObjC++/Hello: 17.83% (0.5826 => 0.6865, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.80% (0.2736 => 0.3223, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 17.77% (0.0698 => 0.0822, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 17.72% (0.4029 => 0.4743, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.72% (1.3152 => 1.5482, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.65% (0.1088 => 0.1280, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference-object: 17.61% (0.5889 => 0.6926, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 17.48% (0.1505 => 0.1768, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.34% (0.2866 => 0.3363, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 17.11% (0.5546 => 0.6495, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/gs/gs: 17.10% (1.8794 => 2.2008, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.87% (0.4658 => 0.5444, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.80% (3.5627 => 4.1614, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.65% (0.5026 => 0.5863, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.57% (0.1968 => 0.2294, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.48% (0.3271 => 0.3810, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.46% (1.6211 => 1.8879, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.38% (0.1160 => 0.1350, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.90% (0.2875 => 0.3332, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 15.89% (0.9697 => 1.1238, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 15.77% (1.0781 => 1.2481, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 15.76% (0.1421 => 0.1645, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.75% (0.4361 => 0.5048, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.60% (4.4195 => 5.1088, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.57% (0.3930 => 0.4542, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: 15.50% (0.1284 => 0.1483, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 15.45% (4.2109 => 4.8614, std.dev.: 0.0065) SingleSource/UnitTests/ObjC++/property-reference: 15.40% (0.7171 => 0.8275, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.34% (0.2738 => 0.3158, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 15.32% (0.9909 => 1.1427, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.26% (2.7292 => 3.1456, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/matrix: 15.22% (0.2780 => 0.3203, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 15.21% (0.3004 => 0.3461, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 15.18% (0.2714 => 0.3126) SingleSource/Benchmarks/Shootout-C++/strcat: 15.13% (0.2750 => 0.3166, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 15.08% (0.2725 => 0.3136, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.06% (0.2729 => 0.3140, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 15.04% (0.2813 => 0.3236, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.97% (1.9694 => 2.2642, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.93% (1.9966 => 2.2947, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.93% (0.3195 => 0.3672, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 14.91% (0.2803 => 0.3221, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.90% (0.2792 => 0.3208, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 14.84% (0.2823 => 0.3242, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.84% (2.0673 => 2.3740, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/except: 14.83% (0.2811 => 0.3228, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 14.80% (23.5202 => 27.0011, std.dev.: 0.0232) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.77% (0.2911 => 0.3341, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/ary3: 14.72% (0.3267 => 0.3748, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 14.70% (0.2075 => 0.2380, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 14.66% (0.3096 => 0.3550, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.59% (0.1090 => 0.1249, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 14.52% (0.3258 => 0.3731, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.49% (0.3362 => 0.3849, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 14.35% (0.3317 => 0.3793, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 14.11% (0.2566 => 0.2928, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.08% (0.3060 => 0.3491, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 14.00% (0.3678 => 0.4193, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.90% (0.3488 => 0.3973, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 13.89% (0.4146 => 0.4722, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.83% (0.3124 => 0.3556, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.82% (0.3465 => 0.3944, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.82% (0.3460 => 0.3938, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 13.78% (1.4269 => 1.6235, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/synchronized: 13.75% (0.3469 => 0.3946, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.74% (0.3442 => 0.3915, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 13.71% (0.3348 => 0.3807, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.70% (0.3496 => 0.3975, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 13.70% (0.3446 => 0.3918, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.63% (0.3625 => 0.4119, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.62% (0.3282 => 0.3729, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 13.54% (0.7875 => 0.8941, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 13.50% (0.3726 => 0.4229, std.dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.50% (0.3845 => 0.4364, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 13.49% (0.3477 => 0.3946, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 13.37% (0.3650 => 0.4138, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 13.31% (0.4251 => 0.4817, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.23% (0.3643 => 0.4125, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 13.10% (0.3724 => 0.4212, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.04% (0.3690 => 0.4171, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.01% (0.3981 => 0.4499, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 12.90% (2.1653 => 2.4447, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 12.71% (0.5012 => 0.5649, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 12.60% (4.6177 => 5.1996, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 12.14% (2.1013 => 2.3565, std.dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: 11.97% (0.2691 => 0.3013, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.66% (0.6435 => 0.7185, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 11.61% (0.3498 => 0.3904, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.58% (0.1028 => 0.1147, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11.54% (5.5417 => 6.1813, std.dev.: 0.0111) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.47% (0.2040 => 0.2274, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.28% (0.1383 => 0.1539, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.81% (0.2737 => 0.3033, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 10.69% (0.4847 => 0.5365, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 10.67% (0.6634 => 0.7342, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.54% (0.3084 => 0.3409, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.49% (0.2068 => 0.2285, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 10.07% (0.3336 => 0.3672, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.99% (0.2103 => 0.2313, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 9.41% (2.0346 => 2.2261, std.dev.: 0.0179) MultiSource/Applications/lemon/lemon: 9.24% (0.2391 => 0.2612, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.14% (4.6926 => 5.1216, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.05% (0.5361 => 0.5846, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.88% (11.6398 => 12.6739, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.08% (0.7426 => 0.8026, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.02% (0.5584 => 0.6032, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 6.83% (11.9555 => 12.7724, std.dev.: 0.0140) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 9.10% (0.2802 => 0.3057, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 6.60% (0.2122 => 0.2262, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6107, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.66% (0.3693 => 0.3902, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6676, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1687, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/flops-2: 4.22% (1.8057 => 1.8819, std.dev.: 0.0061) SingleSource/Benchmarks/Dhrystone/dry: 4.14% (14.0481 => 14.6293, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2016, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.49% (3.1722 => 3.2195, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.48% (7.1849 => 7.2913, std.dev.: 0.0029) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3037, std.dev.: 0.0048) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5141, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5804, std.dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.88% (2.4764 => 2.3803, std.dev.: 0.0192) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.75% (25.4195 => 16.5859, std.dev.: 0.0126) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9793, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8072, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -7.20% (0.2402 => 0.2229, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.56% (11.2080 => 10.8094, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0042) MultiSource/Applications/siod/siod: -3.04% (6.9842 => 6.7721, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.94% (17.2379 => 16.7310, std.dev.: 0.0832) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8588, std.dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5750, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4961, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1558, std.dev.: 0.0521) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0461, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 24 08:38:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 10:38:22 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121124163822.1721B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6204?compare_to=6200&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6204, Order: 168541, Start Time: 2012-11-24 14:20:30, End Time: 2012-11-24 16:38:49 To: 6200, Order: 168538, Start Time: 2012-11-24 09:28:41, End Time: 2012-11-24 11:46:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 65 (175 on baseline) Performance Improvements: 7 (38 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1014 (672 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 15.49% (0.6255 => 0.7224, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 14.79% (4.6853 => 5.3783, std.dev.: 0.0222) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.74% (0.1045 => 0.1199, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.60% (0.6178 => 0.7080, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 14.42% (0.7162 => 0.8195, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 14.36% (0.6857 => 0.7842, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 14.19% (0.6666 => 0.7612, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 14.04% (0.5875 => 0.6700, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/exptree: 12.32% (0.0925 => 0.1039, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.96% (0.3471 => 0.3886, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.93% (0.5926 => 0.6633, std.dev.: 0.0232) SingleSource/Benchmarks/Shootout-C++/methcall: 11.72% (0.3158 => 0.3528, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 11.65% (0.1159 => 0.1294, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.48% (0.6045 => 0.6739, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.40% (1.3116 => 1.4611, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.40% (2.2692 => 2.5278, std.dev.: 0.0191) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.26% (0.1643 => 0.1828, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.91% (0.2227 => 0.2470, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.89% (0.4186 => 0.4642, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.79% (0.7537 => 0.8350, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.63% (0.7030 => 0.7777, std.dev.: 0.0053) MultiSource/Benchmarks/nbench/nbench: 10.62% (1.3257 => 1.4665, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.58% (1.4691 => 1.6246, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.68% (1.5097 => 1.6559, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.65% (0.6332 => 0.6943, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.51% (1.5873 => 1.7383, std.dev.: 0.0296) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.33% (4.8071 => 5.2555, std.dev.: 0.0409) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.33% (0.2391 => 0.2614, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.30% (0.7161 => 0.7827, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.04% (0.6571 => 0.7165, std.dev.: 0.0162) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.1893 => 0.2062, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.85% (0.6155 => 0.6700, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 8.81% (0.5891 => 0.6410, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.69% (0.5764 => 0.6265, std.dev.: 0.0152) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.40% (0.2107 => 0.2284, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.32% (0.4793 => 0.5192, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.93% (5.7115 => 6.1643, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.64% (0.3389 => 0.3648, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.31% (1.5587 => 1.6727, std.dev.: 0.0231) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.24% (16.9502 => 18.1781, std.dev.: 0.0683) SingleSource/Benchmarks/Misc-C++/bigfib: 7.18% (0.7266 => 0.7788, std.dev.: 0.0176) SingleSource/Benchmarks/Shootout-C++/hash: 7.16% (0.4793 => 0.5136, std.dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.92% (0.1706 => 0.1824, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.71% (0.3906 => 0.4168, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 6.51% (0.1967 => 0.2095, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.97% (5.6071 => 5.9420, std.dev.: 0.0567) SingleSource/Benchmarks/Misc/ReedSolomon: 5.88% (0.2194 => 0.2323, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.46% (0.3684 => 0.3885, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/05-eks/eks: 4.91% (0.4762 => 0.4996, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.26% (0.4317 => 0.4501, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.98% (0.9491 => 0.9869, std.dev.: 0.0117) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.06% (2.4450 => 2.5198, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.82% (12.3090 => 12.5330, std.dev.: 0.0425) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 17.85% (1.3184 => 1.5538, std.dev.: 0.0577) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.00% (10.7363 => 12.1317, std.dev.: 0.3573) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 10.87% (6.3828 => 7.0769, std.dev.: 0.1057) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.77% (6.0335 => 6.5627, std.dev.: 0.0233) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.52% (3.1349 => 3.3393, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/hash: 4.60% (4.9707 => 5.1992, std.dev.: 0.0575) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.75% (0.3225 => 0.3346, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.82% (4.3267 => 4.4485, std.dev.: 0.0417) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.69% (2.3080 => 2.3470, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.39% (3.0213 => 3.0634, std.dev.: 0.0097) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.31% (19.0922 => 19.3422, std.dev.: 0.0484) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.01% (6.6831 => 6.7509, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/SSE/sse_stepfft: -8.71% (0.1205 => 0.1100, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-3: -7.72% (0.4286 => 0.3955, std.dev.: 0.0086) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.55% (0.4332 => 0.4005, std.dev.: 0.0102) SingleSource/UnitTests/ObjC/exceptions-2: -7.22% (0.4240 => 0.3934, std.dev.: 0.0085) SingleSource/UnitTests/ObjC/exceptions-4: -7.08% (0.4295 => 0.3991, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -1.84% (0.6940 => 0.6812, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/ObjC/synchronized: -12.39% (0.1259 => 0.1103, std.dev.: 0.0006) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.45% (68.9971 => 69.3081, std.dev.: 0.1563) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.29% (0.1367 => 0.1363, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.73% (0.0458 => 0.0498, std.dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.62% (0.0648 => 0.0652, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 0.03% (493.8823 => 494.0174, std.dev.: 0.1094) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.59% (63.2438 => 69.3081, std.dev.: 0.1563) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.87% (4.3882 => 0.0498, std.dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43707.52% (1.1277 => 494.0174, std.dev.: 0.1094) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 193.52% (0.5229 => 1.5348, std.dev.: 0.1142) MultiSource/Applications/SPASS/SPASS: 22.00% (14.9895 => 18.2874, std.dev.: 0.2495) MultiSource/Applications/kimwitu++/kc: 47.41% (14.1553 => 20.8664, std.dev.: 0.2214) MultiSource/Benchmarks/MallocBench/gs/gs: 15.54% (4.1105 => 4.7492, std.dev.: 0.0480) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 49.88% (1.1048 => 1.6559, std.dev.: 0.0097) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 427.31% (7.1582 => 37.7462, std.dev.: 0.3006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 74.79% (3.4629 => 6.0529, std.dev.: 0.4233) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.35% (0.6222 => 1.0288, std.dev.: 0.0635) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10407.78% (0.0720 => 7.5656, std.dev.: 0.2036) MultiSource/Applications/SIBsim4/SIBsim4: 3926100.00% (0.0001 => 3.9262, std.dev.: 0.0119) MultiSource/Applications/SPASS/SPASS: 12905800.00% (0.0001 => 12.9059, std.dev.: 0.9222) MultiSource/Applications/kimwitu++/kc: 53500.00% (0.0001 => 0.0536, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63800.00% (0.0001 => 0.0639, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14500.00% (0.0001 => 0.0146) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 577100.00% (0.0001 => 0.5772, std.dev.: 0.0164) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10085000.00% (0.0001 => 10.0851, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5791400.00% (0.0001 => 5.7915, std.dev.: 0.8224) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1721.08% (1.1194 => 20.3852, std.dev.: 0.3764) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 83.03% (2.9384 => 5.3783, std.dev.: 0.0222) MultiSource/Applications/ClamAV/clamscan: 68.83% (22.1758 => 37.4396, std.dev.: 0.4375) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 54.04% (8.1363 => 12.5330, std.dev.: 0.0425) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 51.35% (7.0540 => 10.6759, std.dev.: 0.0568) MultiSource/Applications/JM/lencod/lencod: 46.31% (21.9371 => 32.0969, std.dev.: 0.0430) SingleSource/Benchmarks/Misc/flops: 46.30% (0.1432 => 0.2095, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/distray/distray: 44.79% (0.1056 => 0.1529, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/almabench: 37.95% (0.0730 => 0.1007, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones/fhourstones: 34.36% (0.1566 => 0.2104, std.dev.: 0.0062) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 33.02% (0.1584 => 0.2107, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 31.57% (0.1175 => 0.1546, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/voronoi/voronoi: 31.22% (0.2700 => 0.3543, std.dev.: 0.0142) SingleSource/UnitTests/vla: 30.99% (0.0355 => 0.0465, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 30.36% (0.0672 => 0.0876, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 29.65% (0.1032 => 0.1338, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: 29.37% (0.2554 => 0.3304, std.dev.: 0.0097) MultiSource/Applications/minisat/minisat: 29.32% (0.7115 => 0.9201, std.dev.: 0.0178) MultiSource/Benchmarks/BitBench/five11/five11: 28.75% (0.0567 => 0.0730, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: 28.51% (0.0933 => 0.1199, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.87% (0.0793 => 0.1014, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/family/family: 27.71% (0.0397 => 0.0507, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/treeadd/treeadd: 27.64% (0.0416 => 0.0531, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 27.64% (0.0814 => 0.1039, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: 27.32% (0.1940 => 0.2470, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bisort/bisort: 26.87% (0.0614 => 0.0779, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/health/health: 26.74% (0.1268 => 0.1607, std.dev.: 0.0049) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 26.62% (0.0447 => 0.0566, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 26.59% (0.2065 => 0.2614, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.54% (0.0648 => 0.0820, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 26.54% (0.4103 => 0.5192, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 26.53% (14.3668 => 18.1781, std.dev.: 0.0683) MultiSource/Applications/lemon/lemon: 26.48% (1.0722 => 1.3561, std.dev.: 0.0163) MultiSource/Applications/siod/siod: 25.63% (2.2969 => 2.8857, std.dev.: 0.0644) MultiSource/Benchmarks/McCat/17-bintr/bintr: 25.19% (0.0675 => 0.0845, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 25.09% (0.6675 => 0.8350, std.dev.: 0.0143) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 24.92% (0.2107 => 0.2632, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: 24.81% (0.0770 => 0.0961, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 24.67% (0.5569 => 0.6943, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 24.57% (0.2271 => 0.2829, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 24.49% (1.3050 => 1.6246, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 24.43% (0.0528 => 0.0657, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.35% (0.0842 => 0.1047, std.dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 24.27% (0.7433 => 0.9237, std.dev.: 0.0276) MultiSource/Applications/sgefa/sgefa: 24.22% (0.3109 => 0.3862, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 23.86% (1.1840 => 1.4665, std.dev.: 0.0030) MultiSource/Benchmarks/BitBench/drop3/drop3: 23.65% (0.0482 => 0.0596, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Oscar: 23.58% (0.0636 => 0.0786, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/misr: 23.54% (0.0633 => 0.0782, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.51% (0.0770 => 0.0951, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.46% (0.0746 => 0.0921, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 23.37% (0.1117 => 0.1378, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 23.32% (0.3650 => 0.4501, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.26% (0.1062 => 0.1309, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 23.24% (5.0018 => 6.1643, std.dev.: 0.0129) MultiSource/Benchmarks/MallocBench/espresso/espresso: 23.24% (4.2646 => 5.2555, std.dev.: 0.0409) MultiSource/Benchmarks/Ptrdist/bc/bc: 23.19% (1.1861 => 1.4611, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 22.91% (0.0886 => 0.1089, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 22.90% (0.3162 => 0.3886, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.89% (2.2024 => 2.7065, std.dev.: 0.0936) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 22.70% (0.0467 => 0.0573, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: 22.63% (0.2877 => 0.3528, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 22.44% (0.2603 => 0.3187, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C++/city/city: 22.32% (2.0665 => 2.5278, std.dev.: 0.0191) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 21.82% (0.8101 => 0.9869, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.65% (0.1695 => 0.2062, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.13% (0.3441 => 0.4168, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 20.79% (0.1510 => 0.1824, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 20.72% (0.1892 => 0.2284, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 20.63% (0.6456 => 0.7788, std.dev.: 0.0176) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.16% (4.9449 => 5.9420, std.dev.: 0.0567) SingleSource/UnitTests/2006-12-11-LoadConstants: 20.12% (0.1143 => 0.1373, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: 19.75% (0.4289 => 0.5136, std.dev.: 0.0107) MultiSource/Benchmarks/mafft/pairlocalalign: 19.06% (9.4845 => 11.2924, std.dev.: 0.1943) MultiSource/Benchmarks/FreeBench/neural/neural: 18.87% (0.1463 => 0.1739, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 18.77% (0.4620 => 0.5487, std.dev.: 0.0258) MultiSource/Applications/treecc/treecc: 18.30% (2.0273 => 2.3983, std.dev.: 0.0814) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.97% (0.3935 => 0.4642, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.96% (0.8172 => 0.9640, std.dev.: 0.0238) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.91% (1.4186 => 1.6727, std.dev.: 0.0231) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 17.87% (0.1125 => 0.1326, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.76% (0.0871 => 0.1017, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/random: 16.35% (0.2802 => 0.3260, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.33% (0.3136 => 0.3648, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/05-eks/eks: 16.21% (0.4299 => 0.4996, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 16.16% (0.1114 => 0.1294, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.14% (0.4615 => 0.5360, std.dev.: 0.0182) MultiSource/Benchmarks/Olden/mst/mst: 15.91% (0.1163 => 0.1348, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 15.87% (0.1695 => 0.1964, std.dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.42% (0.0953 => 0.1100, std.dev.: 0.0031) MultiSource/Applications/viterbi/viterbi: 14.86% (0.1555 => 0.1786, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.72% (0.2758 => 0.3164, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 14.68% (0.7835 => 0.8985, std.dev.: 0.0412) SingleSource/Benchmarks/Shootout-C++/objinst: 14.50% (0.3131 => 0.3585, std.dev.: 0.0092) MultiSource/Benchmarks/NPB-serial/is/is: 14.46% (0.0719 => 0.0823, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.42% (2.2022 => 2.5198, std.dev.: 0.0059) MultiSource/Applications/lua/lua: 14.40% (3.8723 => 4.4299, std.dev.: 0.1893) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.39% (0.0834 => 0.0954, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.32% (0.3121 => 0.3568, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.89% (0.5981 => 0.6812, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.77% (0.5860 => 0.6667, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.61% (0.1029 => 0.1169, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.59% (0.9765 => 1.1092, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.39% (0.1337 => 0.1516, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: 13.37% (0.2049 => 0.2323, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.36% (0.3427 => 0.3885, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: 13.34% (17.1811 => 19.4737, std.dev.: 0.1525) MultiSource/Benchmarks/McCat/09-vor/vor: 13.30% (0.3180 => 0.3603, std.dev.: 0.0163) SingleSource/UnitTests/ObjC/parameter-passing: 13.14% (0.3927 => 0.4443, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.99% (1.5415 => 1.7417, std.dev.: 0.0465) SingleSource/UnitTests/ObjC/exceptions-4: 12.64% (0.3543 => 0.3991, std.dev.: 0.0097) SingleSource/UnitTests/ObjC/exceptions-2: 12.50% (0.3497 => 0.3934, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.49% (0.1625 => 0.1828, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/exceptions: 12.49% (0.3828 => 0.4306, std.dev.: 0.0185) SingleSource/UnitTests/ObjC/exceptions-3: 12.49% (0.3516 => 0.3955, std.dev.: 0.0086) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.39% (0.3543 => 0.3982, std.dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.55% (0.8067 => 0.8999, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.18% (0.1906 => 0.2119, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.02% (0.6450 => 0.7161, std.dev.: 0.0224) MultiSource/Benchmarks/Prolangs-C/football/football: 10.36% (0.8921 => 0.9845, std.dev.: 0.0281) MultiSource/Benchmarks/sim/sim: 9.98% (0.3387 => 0.3725, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.67% (0.2430 => 0.2665, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.62% (0.1438 => 0.1562, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 7.61% (10.3673 => 11.1564, std.dev.: 0.0578) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.55% (7.9617 => 8.3237, std.dev.: 0.0826) SingleSource/UnitTests/Vector/constpool: 4.28% (54.1659 => 56.4827, std.dev.: 0.5026) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.12% (0.4879 => 0.5031, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.21% (4.3953 => 10.9975, std.dev.: 0.0245) SingleSource/Benchmarks/Shootout-C++/methcall: 147.42% (5.3999 => 13.3602, std.dev.: 0.0130) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 32.49% (0.3256 => 0.4314, std.dev.: 0.0149) MultiSource/Applications/minisat/minisat: 32.47% (9.1159 => 12.0756, std.dev.: 0.3644) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.03% (1.2838 => 1.5538, std.dev.: 0.0577) MultiSource/Benchmarks/Olden/bisort/bisort: 20.56% (0.8333 => 1.0046, std.dev.: 0.0158) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.86% (1.1145 => 1.3136, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 17.48% (6.6465 => 7.8085, std.dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/lpbench: 17.26% (10.3460 => 12.1317, std.dev.: 0.3573) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.26% (0.2944 => 0.3452, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 16.33% (1.0785 => 1.2546, std.dev.: 0.0052) MultiSource/Benchmarks/llubenchmark/llu: 12.15% (3.7781 => 4.2372, std.dev.: 0.0847) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.64% (2.8904 => 3.2268, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.30% (13.4384 => 14.9567, std.dev.: 0.2143) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.79% (8.6802 => 9.6172, std.dev.: 0.2369) SingleSource/Benchmarks/Misc/richards_benchmark: 10.28% (1.1396 => 1.2567, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.41% (1.7254 => 1.8878, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.99% (0.3070 => 0.3346, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 8.54% (0.9505 => 1.0317, std.dev.: 0.0216) MultiSource/Applications/lemon/lemon: 8.08% (1.4460 => 1.5629, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.57% (3.1334 => 3.3393, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/puzzle: 6.42% (0.6962 => 0.7409, std.dev.: 0.0160) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: 5.92% (4.9088 => 5.1992, std.dev.: 0.0575) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.73% (4.2280 => 4.4704, std.dev.: 0.0095) MultiSource/Applications/lua/lua: 5.57% (26.0924 => 27.5456, std.dev.: 0.0838) MultiSource/Benchmarks/Fhourstones/fhourstones: 5.38% (1.8329 => 1.9315, std.dev.: 0.0128) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 4.61% (0.2233 => 0.2336, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.97% (11.6436 => 12.1061, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.58% (3.6395 => 3.7697, std.dev.: 0.0291) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 3.18% (0.6223 => 0.6421, std.dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/dry: 2.64% (2.4116 => 2.4752, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.34% (4.6441 => 4.7526, std.dev.: 0.0293) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.33% (1.7133 => 1.7533, std.dev.: 0.0078) MultiSource/Benchmarks/PAQ8p/paq8p: 2.22% (85.0658 => 86.9535, std.dev.: 0.0450) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 2.09% (3.1595 => 3.2256, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.06% (2.1424 => 2.1865, std.dev.: 0.0091) MultiSource/Benchmarks/mafft/pairlocalalign: 1.47% (27.8444 => 28.2544, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.45% (2.3135 => 2.3470, std.dev.: 0.0070) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.43% (6.5088 => 6.6020, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0313 => 1.0441, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0499, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.02% (5.2139 => 5.2669, std.dev.: 0.0129) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1670, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.96% (5.2763 => 1.2155, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -74.82% (0.8651 => 0.2178, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: -45.07% (0.1622 => 0.0891, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.65% (5.3526 => 4.6756, std.dev.: 0.1714) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.12% (5.3855 => 4.7868, std.dev.: 0.0683) MultiSource/Applications/JM/ldecod/ldecod: -7.13% (10.4361 => 9.6919, std.dev.: 0.2235) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.52% (0.0628 => 0.0361, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.26% (0.3987 => 0.2382, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.31% (4.5009 => 2.7764, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: -33.54% (1.1492 => 0.7638, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.17% (2.6546 => 2.0129, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: -19.16% (0.2161 => 0.1747, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4236, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2841, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.80% (32.5116 => 28.9994, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -10.38% (9.5636 => 8.5708, std.dev.: 0.2382) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.58% (1.5660 => 1.4316, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.95% (4.8142 => 4.4795, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.55% (2.7294 => 2.5778, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.50% (3.2416 => 3.0634, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.92% (1.5835 => 1.5056, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/lists: -4.14% (6.2999 => 6.0393, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.41% (0.9957 => 0.9617, std.dev.: 0.0078) MultiSource/Benchmarks/sim/sim: -3.08% (5.0483 => 4.8926, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.04% (19.9488 => 19.3422, std.dev.: 0.0484) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.27% (0.4808 => 0.4699, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (8.1563 => 8.0197, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/salsa20: -1.54% (10.2830 => 10.1250, std.dev.: 0.0041) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.22% (0.1485 => 0.1363, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0007) Report Time: 2.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 24 09:04:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 11:04:47 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121124170447.707572A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6205?compare_to=6201&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6205, Order: 168542, Start Time: 2012-11-24 15:33:47, End Time: 2012-11-24 17:05:17 To: 6201, Order: 168541, Start Time: 2012-11-24 13:45:16, End Time: 2012-11-24 15:16:40 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 3 (105 on baseline) Performance Improvements: 11 (24 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1040 (845 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 3.56% (20.6684 => 21.4034, std.dev.: 0.2652) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.51% (0.2880 => 0.2981, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/pi: 1.81% (2.4631 => 2.5077, std.dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: -5.62% (0.3311 => 0.3125, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/bh/bh: -5.44% (0.3200 => 0.3026, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/05-eks/eks: -3.13% (0.4562 => 0.4419, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: -1.98% (0.7773 => 0.7619, std.dev.: 0.0038) MultiSource/Applications/hbd/hbd: -1.79% (1.4940 => 1.4673, std.dev.: 0.0072) MultiSource/Applications/SIBsim4/SIBsim4: -1.17% (1.3110 => 1.2956, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.14% (1.4830 => 1.4661, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -1.93% (0.6580 => 0.6453, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/primes/primes: -1.74% (0.8966 => 0.8810, std.dev.: 0.0048) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.63% (1.2787 => 1.2578, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.13% (1.6285 => 1.6101, std.dev.: 0.0047) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.64% (1.0676 => 1.0608, std.dev.: 0.0135) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 50.38% (0.0131 => 0.0197, std.dev.: 0.0079) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.89% (0.0424 => 0.0432, std.dev.: 0.0134) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 4.45% (0.0292 => 0.0305, std.dev.: 0.0072) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.59% (0.0306 => 0.0317, std.dev.: 0.0098) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.91% (0.0412 => 0.0424, std.dev.: 0.0108) SingleSource/UnitTests/Vector/Altivec/casts: 10.29% (0.0204 => 0.0225, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/test1: 34.15% (0.0164 => 0.0220, std.dev.: 0.0074) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.61% (0.1477 => 0.1468, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -0.96% (1.1778 => 1.1665, std.dev.: 0.0109) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.55% (0.4188 => 0.4165, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.03% (0.1414 => 0.1471, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.59% (0.0630 => 0.0620, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.12% (0.0269 => 0.0272, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.17% (0.0590 => 0.0591, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.11% (1.1939 => 1.1926, std.dev.: 0.0138) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -90.00% (0.0010 => 0.0001, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -85.71% (0.0007 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.89% (0.0623 => 0.0605, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.44% (0.0180 => 0.0197, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.42% (0.7786 => 0.7819, std.dev.: 0.0098) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 22.41% (0.0058 => 0.0071, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.21% (16.4461 => 17.6312, std.dev.: 0.0353) MultiSource/Applications/sqlite3/sqlite3: 2316.60% (0.6332 => 15.3019, std.dev.: 0.1621) MultiSource/Benchmarks/McCat/08-main/main: 48.28% (0.1831 => 0.2715, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.60% (0.1559 => 0.1425, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7138.94% (0.3123 => 22.6072, std.dev.: 0.1281) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.83% (0.2463 => 0.3715, std.dev.: 0.0903) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1533.37% (0.3344 => 5.4620, std.dev.: 0.0978) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.62% (0.2364 => 0.3277, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 4.81% (0.6010 => 0.6299, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.05% (0.3266 => 0.3431, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/strcat: 3.35% (0.1969 => 0.2035, std.dev.: 0.0409) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.48% (0.0224 => 0.0243, std.dev.: 0.0078) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0054) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0436, std.dev.: 0.0038) MultiSource/Applications/oggenc/oggenc: 8.89% (0.1462 => 0.1592, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4662, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0736, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4933, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5146, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.6593, std.dev.: 0.3177) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3172, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1381, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3636, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4102, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0897, std.dev.: 0.0102) SingleSource/Regression/C/uint64_to_float: -23.84% (2.1832 => 1.6628, std.dev.: 0.0193) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.42% (0.0810 => 0.0943, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.17% (0.0830 => 0.0931, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 11.60% (0.1112 => 0.1241, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.64% (0.1157 => 0.1257, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.29% (0.2180 => 0.2339, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.03% (0.1905 => 0.2039, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 6.53% (0.1577 => 0.1680, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 5.98% (1.2222 => 1.2953, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.88% (0.2279 => 0.2413, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.57% (0.7473 => 0.7889, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.44% (0.2998 => 0.3161, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.04% (1.1606 => 1.2191, std.dev.: 0.0060) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.50% (0.2378 => 0.2485, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.02% (1.1685 => 1.2155, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.59% (0.4127 => 0.4275, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.57% (2.1401 => 2.2165, std.dev.: 0.0192) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.56% (1.6386 => 1.6970, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.22% (0.8697 => 0.8977, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 3.19% (3.8189 => 3.9409, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.14% (0.4559 => 0.4702, std.dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: 3.09% (1.2568 => 1.2956, std.dev.: 0.0060) MultiSource/Benchmarks/nbench/nbench: 3.04% (1.1271 => 1.1614, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.00% (0.8611 => 0.8869, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.93% (0.8007 => 0.8242, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/gs/gs: 2.89% (4.1305 => 4.2497, std.dev.: 0.0455) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.84% (0.5817 => 0.5982, std.dev.: 0.0053) MultiSource/Applications/hbd/hbd: 2.83% (1.4269 => 1.4673, std.dev.: 0.0072) MultiSource/Applications/siod/siod: 2.79% (2.2184 => 2.2803, std.dev.: 0.0239) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.78% (0.8340 => 0.8572, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.72% (0.3717 => 0.3818, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.72% (0.5191 => 0.5332, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.64% (0.8518 => 0.8743, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.61% (0.9069 => 0.9306, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.58% (0.8457 => 0.8675, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.55% (4.1763 => 4.2830, std.dev.: 0.0300) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.55% (0.9908 => 1.0161, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.55% (0.9074 => 0.9305, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.54% (0.8331 => 0.8543, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.50% (0.9688 => 0.9930, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.47% (0.8261 => 0.8465, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 2.47% (14.7684 => 15.1327, std.dev.: 0.1068) MultiSource/Applications/minisat/minisat: 2.44% (0.6834 => 0.7001, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.42% (13.1811 => 13.5005, std.dev.: 0.0982) MultiSource/Benchmarks/PAQ8p/paq8p: 2.41% (2.3764 => 2.4337, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.39% (0.8316 => 0.8515, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.37% (1.1170 => 1.1435, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.37% (6.6074 => 6.7641, std.dev.: 0.0225) MultiSource/Applications/d/make_dparser: 2.37% (3.2366 => 3.3132, std.dev.: 0.0261) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.36% (0.9039 => 0.9252, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.35% (0.8597 => 0.8799, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.35% (0.8050 => 0.8239, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.32% (0.8927 => 0.9134, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.31% (0.8286 => 0.8477, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.29% (0.8805 => 0.9007, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.27% (0.8712 => 0.8910, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.20% (0.7966 => 0.8141, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.16% (0.8204 => 0.8381, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.11% (4.4873 => 4.5818, std.dev.: 0.0280) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.10% (0.8885 => 0.9072, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 2.06% (1.0945 => 1.1171, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.05% (0.8420 => 0.8593, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.02% (0.8359 => 0.8528, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.98% (0.8716 => 0.8889, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.94% (0.8048 => 0.8204, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.83% (0.8177 => 0.8327, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 1.83% (8.6247 => 8.7827, std.dev.: 0.0491) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.74% (0.8066 => 0.8206, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 1.70% (0.9810 => 0.9977, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.70% (0.7932 => 0.8067, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.62% (0.8338 => 0.8473, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.57% (0.8995 => 0.9136, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.26% (1.4479 => 1.4661, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 103.52% (0.0199 => 0.0405, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/pi: 58.77% (1.5795 => 2.5077, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.36% (2.9753 => 3.4622, std.dev.: 0.0489) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.97% (0.7597 => 0.8810, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.71% (2.7995 => 3.2114, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.55% (5.0261 => 5.6066, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.79% (0.3186 => 0.3498, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.05% (1.1857 => 1.2812, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 6.93% (1.3037 => 1.3940, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.80% (4.7794 => 5.1045, std.dev.: 0.0239) MultiSource/Applications/SIBsim4/SIBsim4: 5.93% (3.1873 => 3.3763, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.84% (4.9686 => 5.2589, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.73% (4.5327 => 4.7924, std.dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: 4.88% (7.4933 => 7.8591, std.dev.: 0.0467) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.78% (6.2275 => 6.5253, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.68% (3.3761 => 3.5340, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.19% (4.9453 => 5.1525, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.08% (4.9469 => 5.1489, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.91% (14.0064 => 14.5535, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.21% (0.3587 => 0.3702, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.03% (1.2337 => 1.2711, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.80% (11.5690 => 11.8933, std.dev.: 0.0278) MultiSource/Applications/siod/siod: 2.76% (3.6643 => 3.7656, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/lists: 2.65% (7.3375 => 7.5320, std.dev.: 0.0589) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.56% (8.2783 => 8.4905, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.09% (4.8362 => 4.9375, std.dev.: 0.0227) SingleSource/Benchmarks/Stanford/FloatMM: 1.87% (0.8807 => 0.8972, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.67% (1.1365 => 1.1555, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: 1.31% (1.0841 => 1.0983, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 1.14% (1.2061 => 1.2199, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.4647 => 2.4914, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-4: 1.00% (1.6531 => 1.6697, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.00% (1.5941 => 1.6101, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -23.11% (5.4641 => 4.2011, std.dev.: 0.0644) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.62% (7.2130 => 6.1586, std.dev.: 0.1079) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.88% (1.0512 => 0.9368, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: -10.09% (1.1216 => 1.0084, std.dev.: 0.0362) MultiSource/Benchmarks/mafft/pairlocalalign: -8.18% (63.1822 => 58.0126, std.dev.: 0.1440) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.18% (14.6451 => 13.5942, std.dev.: 0.0927) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.98% (4.7482 => 4.4170, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.00% (3.7148 => 3.4919, std.dev.: 0.0434) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.89% (5.4972 => 5.1735, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.94% (5.1557 => 4.9010, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.59% (4.7449 => 4.5269, std.dev.: 0.0072) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.38% (2.8773 => 2.7513, std.dev.: 0.0419) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.68% (6.0224 => 5.8008, std.dev.: 0.0127) MultiSource/Applications/lua/lua: -3.32% (29.8330 => 28.8432, std.dev.: 0.0716) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.03% (28.5821 => 27.7168, std.dev.: 0.0304) MultiSource/Benchmarks/Olden/bisort/bisort: -2.76% (0.6636 => 0.6453, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.70% (2.6356 => 2.5644, std.dev.: 0.0043) MultiSource/Applications/aha/aha: -2.46% (3.3398 => 3.2576, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.26% (9.9065 => 9.6825, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.01% (11.5316 => 11.3002, std.dev.: 0.0053) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.90% (1.2822 => 1.2578, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.67% (4.9994 => 4.9159, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: -1.34% (3.4237 => 3.3779, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.15% (5.6343 => 5.5695, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.37% (1.0262 => 1.0608, std.dev.: 0.0135) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 60.16% (0.0123 => 0.0197, std.dev.: 0.0079) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.88% (0.0408 => 0.0432, std.dev.: 0.0134) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 20.08% (0.0254 => 0.0305, std.dev.: 0.0072) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.97% (0.0302 => 0.0317, std.dev.: 0.0098) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0108) SingleSource/UnitTests/Vector/Altivec/casts: 18.42% (0.0190 => 0.0225, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/test1: 22.22% (0.0180 => 0.0220, std.dev.: 0.0074) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.09% (0.1438 => 0.1468, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 2.97% (1.1329 => 1.1665, std.dev.: 0.0109) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.02% (0.4164 => 0.4165, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.45% (0.1369 => 0.1471, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.28% (0.0641 => 0.0620, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 39.49% (0.0195 => 0.0272, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.25% (0.0578 => 0.0591, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.28% (1.1437 => 1.1926, std.dev.: 0.0138) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.51% (0.0627 => 0.0605, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.44% (0.0180 => 0.0197, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.47% (0.8017 => 0.7819, std.dev.: 0.0098) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 14.52% (0.0062 => 0.0071, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 24 09:19:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 11:19:12 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121124171912.5EC3E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6206?compare_to=6202&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6206, Order: 168542, Start Time: 2012-11-24 15:46:15, End Time: 2012-11-24 17:19:40 To: 6202, Order: 168541, Start Time: 2012-11-24 13:49:23, End Time: 2012-11-24 15:23:09 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (180 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (858 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.04% (2.0478 => 2.1100, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/salsa20: 2.55% (7.4937 => 7.6851, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/hash2: 2.23% (3.1932 => 3.2644, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.06% (0.3821 => 0.3513, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.65% (0.3142 => 0.2933, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.55% (2.4924 => 2.3292, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.51% (0.9542 => 0.8921, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.34% (0.3357 => 0.3144, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.22% (0.2428 => 0.2277, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -6.16% (0.2160 => 0.2027, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -6.10% (9.2283 => 8.6654, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.06% (0.9852 => 0.9255, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.05% (0.3884 => 0.3649, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.03% (0.7198 => 0.6764, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -6.01% (0.3812 => 0.3583, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -6.01% (0.3896 => 0.3662, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: -6.01% (0.3880 => 0.3647, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -6.00% (0.3848 => 0.3617, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.00% (0.4033 => 0.3791, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/BoolLiteralTest: -6.00% (0.3834 => 0.3604, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-2: -5.98% (0.3831 => 0.3602, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: -5.89% (0.4176 => 0.3930, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.89% (0.3891 => 0.3662, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.88% (0.3658 => 0.3443) MultiSource/Applications/JM/ldecod/ldecod: -5.87% (7.0961 => 6.6795, std.dev.: 0.0055) MultiSource/Applications/JM/lencod/lencod: -5.87% (16.1920 => 15.2414, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/football/football: -5.82% (0.9179 => 0.8645, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.82% (0.2355 => 0.2218, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -5.80% (0.1879 => 0.1770, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.80% (0.6484 => 0.6108, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.76% (1.3722 => 1.2932, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.74% (1.0544 => 0.9939, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.73% (3.5339 => 3.3315, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.67% (4.8161 => 4.5432, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.64% (0.2695 => 0.2543, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.63% (4.0323 => 3.8052, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.63% (0.5705 => 0.5384, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.62% (6.7716 => 6.3910, std.dev.: 0.0100) SingleSource/UnitTests/ObjC/property: -5.62% (0.4199 => 0.3963, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: -5.62% (4.3330 => 4.0896, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.61% (0.5863 => 0.5534, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.60% (0.5478 => 0.5171, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.60% (0.5805 => 0.5480, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.59% (1.2300 => 1.1613, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.57% (1.6364 => 1.5453, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.56% (0.6667 => 0.6296, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.51% (0.5570 => 0.5263, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.51% (1.4642 => 1.3835, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.51% (0.5591 => 0.5283, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.51% (0.6446 => 0.6091, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.50% (0.6052 => 0.5719, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.50% (0.6293 => 0.5947, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.49% (0.7919 => 0.7484, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.49% (0.5849 => 0.5528, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: -5.48% (1.1530 => 1.0898, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.48% (0.5857 => 0.5536, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.47% (0.5925 => 0.5601, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -5.46% (1.1450 => 1.0825, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.46% (0.6230 => 0.5890, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.45% (4.8802 => 4.6143, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.45% (0.5802 => 0.5486, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.44% (0.6304 => 0.5961, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.43% (0.6736 => 0.6370, std.dev.: 0.0078) MultiSource/Applications/Burg/burg: -5.42% (1.2515 => 1.1837, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.42% (0.6297 => 0.5956, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.41% (0.5859 => 0.5542, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -5.39% (0.3025 => 0.2862, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.37% (4.5069 => 4.2649, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.36% (0.3057 => 0.2893, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.36% (0.6660 => 0.6303, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.36% (0.4515 => 0.4273, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -5.35% (0.4280 => 0.4051, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.35% (0.4151 => 0.3929, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.35% (0.5575 => 0.5277, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.34% (0.6260 => 0.5926, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.33% (1.2784 => 1.2102, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.33% (0.5456 => 0.5165, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.33% (0.6194 => 0.5864, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.32% (0.5941 => 0.5625, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -5.30% (17.1032 => 16.1970, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.30% (0.2548 => 0.2413, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -5.29% (0.2985 => 0.2827, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: -5.28% (0.3406 => 0.3226, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.28% (0.8521 => 0.8071, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.28% (0.4813 => 0.4559, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.28% (0.4321 => 0.4093, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.27% (0.5581 => 0.5287, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.27% (0.3323 => 0.3148, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -5.27% (0.2659 => 0.2519, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.24% (0.3931 => 0.3725, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.24% (0.2903 => 0.2751, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.22% (0.2278 => 0.2159, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.22% (14.2083 => 13.4661, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.21% (2.1713 => 2.0581, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.20% (1.3148 => 1.2464, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: -5.20% (0.3194 => 0.3028, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -5.19% (0.2849 => 0.2701, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -5.19% (0.3581 => 0.3395, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.19% (0.5688 => 0.5393, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.17% (0.2999 => 0.2844, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.16% (0.3837 => 0.3639, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.14% (0.2939 => 0.2788, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -5.13% (0.3255 => 0.3088, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.12% (0.5999 => 0.5692, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.11% (0.2933 => 0.2783, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.11% (0.3483 => 0.3305, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.11% (0.6440 => 0.6111, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -5.09% (15.5079 => 14.7181, std.dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: -5.09% (1.3864 => 1.3158, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.09% (0.4916 => 0.4666, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.06% (0.6676 => 0.6338, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.06% (0.6681 => 0.6343, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.06% (0.6189 => 0.5876, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.05% (1.2210 => 1.1594, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.03% (1.2221 => 1.1606, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: -5.02% (0.3026 => 0.2874, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.02% (0.6033 => 0.5730, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: -5.02% (0.2871 => 0.2727, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -5.01% (2.4021 => 2.2817, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.01% (22.4056 => 21.2838, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.01% (0.3016 => 0.2865, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -5.00% (4.0594 => 3.8565, std.dev.: 0.0038) MultiSource/Applications/minisat/minisat: -4.98% (0.7447 => 0.7076, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.97% (0.5168 => 0.4911, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.97% (8.0126 => 7.6147, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.96% (0.3849 => 0.3658, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.96% (0.3205 => 0.3046, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -4.94% (0.4248 => 0.4038, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -4.94% (0.3059 => 0.2908, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -4.91% (0.3481 => 0.3310, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -4.90% (0.3446 => 0.3277, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -4.90% (0.4861 => 0.4623, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.89% (0.3252 => 0.3093, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -4.88% (3.5154 => 3.3437, std.dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: -4.87% (0.7982 => 0.7593, std.dev.: 0.0149) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.85% (0.3319 => 0.3158, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.84% (1.6474 => 1.5676, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: -4.84% (0.3867 => 0.3680, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.78% (0.6395 => 0.6089, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -4.78% (0.3621 => 0.3448, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.78% (0.4083 => 0.3888, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.77% (0.7339 => 0.6989, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.76% (15.2527 => 14.5270, std.dev.: 0.0232) SingleSource/Benchmarks/Shootout-C++/ary: -4.71% (0.3394 => 0.3234, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -4.68% (0.2989 => 0.2849, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.65% (0.9557 => 0.9113, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -4.64% (0.4524 => 0.4314, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.64% (0.7524 => 0.7175, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.63% (0.7021 => 0.6696, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -4.62% (18.2933 => 17.4487, std.dev.: 0.0184) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (0.5329 => 0.5087, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -4.52% (0.3271 => 0.3123, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.49% (0.5567 => 0.5317, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -4.48% (2.1401 => 2.0443, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.47% (0.6395 => 0.6109, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.47% (0.5569 => 0.5320, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.44% (0.2385 => 0.2279, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -4.44% (34.0927 => 32.5778, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.43% (0.4427 => 0.4231, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -4.35% (0.8418 => 0.8052, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: -4.30% (0.3788 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.27% (2.2587 => 2.1623, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: -4.27% (0.7779 => 0.7447, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -4.19% (0.6750 => 0.6467, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.16% (0.9077 => 0.8699, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.15% (0.3491 => 0.3346, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -4.13% (5.0226 => 4.8154, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/Hello: -3.89% (0.6347 => 0.6100, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -3.73% (1.5610 => 1.5028, std.dev.: 0.0054) SingleSource/UnitTests/ObjC++/property-reference-object: -3.71% (0.6441 => 0.6202, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.61% (5.4682 => 5.2709, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -2.14% (20.7746 => 20.3292, std.dev.: 0.0134) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7557, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1729, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.77% (2.2633 => 2.1779, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4713, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 24 10:55:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 12:55:56 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121124185556.235472A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6207?compare_to=6205&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6207, Order: 168545, Start Time: 2012-11-24 17:25:44, End Time: 2012-11-24 18:56:24 To: 6205, Order: 168542, Start Time: 2012-11-24 15:33:47, End Time: 2012-11-24 17:05:17 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 16 (112 on baseline) Performance Improvements: 3 (25 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1035 (837 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.28% (0.1121 => 0.1225, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.12% (0.1698 => 0.1802, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.64% (0.6154 => 0.6501, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.89% (0.8317 => 0.8724, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.69% (0.3347 => 0.3504, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 4.67% (0.3125 => 0.3271, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.13% (0.8578 => 0.8932, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.66% (0.3029 => 0.3140, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.77% (0.5047 => 0.5187, std.dev.: 0.0047) SingleSource/UnitTests/Vector/constpool: 2.00% (8.3159 => 8.4825, std.dev.: 0.0259) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.90% (1.2787 => 1.3030, std.dev.: 0.0093) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.73% (4.6040 => 4.6835, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.66% (1.3501 => 1.3725, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/ffbench: 2.72% (1.3926 => 1.4305, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/em3d/em3d: 2.55% (4.2011 => 4.3083, std.dev.: 0.0235) SingleSource/Benchmarks/Shootout-C++/methcall: 1.66% (8.8286 => 8.9752, std.dev.: 0.0219) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash2: -2.52% (0.4245 => 0.4138, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Stanford/FloatMM: -1.26% (0.8972 => 0.8859, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: -1.01% (3.3779 => 3.3437, std.dev.: 0.0019) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.13% (1.0608 => 1.0728, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 11.17% (0.0197 => 0.0219, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.62% (0.0432 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 8.85% (0.0305 => 0.0332, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.95% (0.0317 => 0.0314, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.24% (0.0424 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -8.89% (0.0225 => 0.0205, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -14.09% (0.0220 => 0.0189, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.63% (0.1468 => 0.1492, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -3.96% (1.1665 => 1.1203, std.dev.: 0.0209) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.34% (0.4165 => 0.4221, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.53% (0.1471 => 0.1375, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.94% (0.0620 => 0.0663, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -20.59% (0.0272 => 0.0216, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.08% (0.0591 => 0.0561, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.39% (1.1926 => 1.1973, std.dev.: 0.0111) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.30% (0.0605 => 0.0631, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.09% (0.0197 => 0.0209, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.01% (0.7819 => 0.7818, std.dev.: 0.0035) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -39.44% (0.0071 => 0.0043, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.00% (16.4461 => 17.5973, std.dev.: 0.2709) MultiSource/Applications/sqlite3/sqlite3: 2314.66% (0.6332 => 15.2896, std.dev.: 0.1118) MultiSource/Benchmarks/McCat/08-main/main: 47.46% (0.1831 => 0.2700, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.07% (0.1559 => 0.1480, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7038.36% (0.3123 => 22.2931, std.dev.: 0.5613) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.78% (0.2463 => 0.3689, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1520.90% (0.3344 => 5.4203, std.dev.: 0.1450) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.38% (0.2364 => 0.3224, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 5.62% (0.6010 => 0.6348, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel: 3.96% (0.0429 => 0.0446, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.19% (0.3266 => 0.3403, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/strcat: 3.56% (0.1969 => 0.2039, std.dev.: 0.0037) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.70% (0.0224 => 0.0239, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0450, std.dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 8.21% (0.1462 => 0.1582, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4704, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0695, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4926, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5087, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.6113, std.dev.: 0.5237) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3141, std.dev.: 0.0355) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1261, std.dev.: 0.0358) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3621, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3991, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0839, std.dev.: 0.0041) SingleSource/Regression/C/uint64_to_float: -23.84% (2.1832 => 1.6628, std.dev.: 0.0234) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.56% (0.0810 => 0.0936, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 13.22% (0.1112 => 0.1259, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.85% (0.0848 => 0.0957, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.80% (0.3137 => 0.3413, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.17% (0.6010 => 0.6501, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.99% (0.2279 => 0.2461, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.79% (0.1425 => 0.1536, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.34% (0.8321 => 0.8932, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.07% (0.8148 => 0.8724, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.01% (0.4847 => 0.5187, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.34% (0.3295 => 0.3504, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 6.33% (0.1721 => 0.1830, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.25% (0.7473 => 0.7940, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.53% (1.1606 => 1.2248, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.50% (0.2998 => 0.3163, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.40% (0.2240 => 0.2361, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: 5.33% (0.7950 => 0.8374, std.dev.: 0.0078) MultiSource/Applications/Burg/burg: 4.96% (1.2222 => 1.2828, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.93% (1.1685 => 1.2261, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.56% (0.3003 => 0.3140, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.55% (0.5961 => 0.6232, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.40% (0.9435 => 0.9850, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.39% (0.6287 => 0.6563, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.26% (0.5817 => 0.6065, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 4.05% (3.8189 => 3.9735, std.dev.: 0.0303) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.02% (1.2526 => 1.3030, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/gs/gs: 3.97% (4.1305 => 4.2943, std.dev.: 0.0299) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.71% (0.4127 => 0.4280, std.dev.: 0.0027) MultiSource/Applications/treecc/treecc: 3.65% (1.9948 => 2.0676, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.55% (1.6386 => 1.6968, std.dev.: 0.0067) MultiSource/Benchmarks/nbench/nbench: 3.49% (1.1271 => 1.1664, std.dev.: 0.0104) MultiSource/Applications/SPASS/SPASS: 3.48% (14.2605 => 14.7563, std.dev.: 0.0404) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.36% (1.3279 => 1.3725, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.36% (4.1763 => 4.3165, std.dev.: 0.0158) MultiSource/Applications/ClamAV/clamscan: 3.28% (14.7684 => 15.2525, std.dev.: 0.0458) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.14% (6.6074 => 6.8151, std.dev.: 0.0326) MultiSource/Applications/SIBsim4/SIBsim4: 3.14% (1.2568 => 1.2963, std.dev.: 0.0065) MultiSource/Applications/hbd/hbd: 3.03% (1.4269 => 1.4701, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.97% (0.8697 => 0.8955, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.96% (0.8611 => 0.8866, std.dev.: 0.0079) MultiSource/Applications/minisat/minisat: 2.96% (0.6834 => 0.7036, std.dev.: 0.0067) MultiSource/Applications/d/make_dparser: 2.92% (3.2366 => 3.3310, std.dev.: 0.0251) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.90% (1.1170 => 1.1494, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.87% (4.4873 => 4.6162, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.87% (8.6476 => 8.8960, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.73% (13.1811 => 13.5411, std.dev.: 0.0393) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.70% (0.8359 => 0.8585, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.67% (0.8340 => 0.8563, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.66% (0.8656 => 0.8886, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.65% (0.8597 => 0.8825, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.61% (4.4880 => 4.6050, std.dev.: 0.0249) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.58% (0.9074 => 0.9308, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.55% (0.9908 => 1.0161, std.dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 2.49% (15.3280 => 15.7094, std.dev.: 0.0381) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.48% (4.5702 => 4.6835, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.44% (0.8805 => 0.9020, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.44% (0.8317 => 0.8520, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.39% (0.9039 => 0.9255, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.38% (0.9069 => 0.9285, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.29% (0.7932 => 0.8114, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.29% (0.8261 => 0.8450, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 2.28% (6.7320 => 6.8854, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.26% (0.8086 => 0.8269, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: 2.26% (2.3764 => 2.4301, std.dev.: 0.0123) MultiSource/Benchmarks/mafft/pairlocalalign: 2.26% (8.6247 => 8.8194, std.dev.: 0.0667) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.22% (0.8286 => 0.8470, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.21% (0.8069 => 0.8247, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.20% (0.8518 => 0.8705, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.19% (0.8712 => 0.8903, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.18% (0.8885 => 0.9079, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.15% (0.8420 => 0.8601, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.15% (0.8716 => 0.8903, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 2.14% (0.9810 => 1.0020, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.10% (0.8204 => 0.8376, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.03% (0.7966 => 0.8128, std.dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: 2.01% (0.7557 => 0.7709, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.78% (1.0945 => 1.1140, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.48% (0.8995 => 0.9128, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 107.04% (0.0199 => 0.0412, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/pi: 56.67% (1.5795 => 2.4746, std.dev.: 0.0187) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 20.64% (0.0528 => 0.0637, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.32% (2.9753 => 3.4610, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.28% (0.7597 => 0.8834, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.53% (2.7995 => 3.2062, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.49% (5.0261 => 5.6035, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.00% (1.1857 => 1.2805, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/queens: 7.21% (1.7056 => 1.8286, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.79% (4.7794 => 5.1041, std.dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 6.13% (3.1873 => 3.3828, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.99% (4.5327 => 4.8041, std.dev.: 0.0351) SingleSource/Benchmarks/Misc/richards_benchmark: 5.98% (1.3037 => 1.3816, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.90% (4.9686 => 5.2618, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 5.02% (7.4933 => 7.8695, std.dev.: 0.0322) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.64% (6.2275 => 6.5167, std.dev.: 0.0774) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.48% (3.3761 => 3.5274, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.15% (4.9453 => 5.1504, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.06% (4.9469 => 5.1477, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 3.87% (14.0064 => 14.5487, std.dev.: 0.0735) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.59% (1.2337 => 1.2780, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 3.02% (3.6643 => 3.7748, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.75% (11.5690 => 11.8875, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.51% (4.8362 => 4.9578, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.35% (4.8660 => 4.9805, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/lists: 2.18% (7.3375 => 7.4972, std.dev.: 0.0093) SingleSource/Benchmarks/CoyoteBench/lpbench: 2.09% (3.9006 => 3.9820, std.dev.: 0.0208) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.99% (1.1365 => 1.1591, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.94% (8.2783 => 8.4393, std.dev.: 0.0345) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.52% (59.2638 => 60.1658, std.dev.: 0.3492) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.30% (2.4647 => 2.4968, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.28% (41.4238 => 41.9549, std.dev.: 0.1927) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.27% (3.5679 => 3.6132, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/ReedSolomon: 1.13% (8.5322 => 8.6289, std.dev.: 0.0140) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.15% (5.4641 => 4.3083, std.dev.: 0.0235) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.62% (1.0512 => 0.9291, std.dev.: 0.0170) SingleSource/Benchmarks/McGill/chomp: -11.02% (1.1216 => 0.9980, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.00% (7.2130 => 6.4194, std.dev.: 0.2636) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.41% (14.6451 => 13.2669, std.dev.: 0.1959) MultiSource/Benchmarks/mafft/pairlocalalign: -8.55% (63.1822 => 57.7828, std.dev.: 0.1579) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.90% (4.7482 => 4.4206, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.76% (0.3269 => 0.3048, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.97% (3.7148 => 3.4930, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.93% (5.4972 => 5.1714, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.07% (5.1557 => 4.8945, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.11% (4.7449 => 4.5497, std.dev.: 0.0070) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.78% (2.8773 => 2.7684, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.74% (6.0224 => 5.7971, std.dev.: 0.0104) MultiSource/Applications/lua/lua: -3.36% (29.8330 => 28.8317, std.dev.: 0.3737) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.14% (28.5821 => 27.6858, std.dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.86% (2.6356 => 2.5602, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.81% (9.9065 => 9.6286, std.dev.: 0.0693) MultiSource/Applications/aha/aha: -2.53% (3.3398 => 3.2552, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/hash2: -2.34% (3.4237 => 3.3437, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.01% (11.5316 => 11.2994, std.dev.: 0.0306) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.85% (2.4490 => 2.4037, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.56% (4.9994 => 4.9212, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.34% (2.3487 => 2.3173, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.16% (5.6343 => 5.5692, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.54% (1.0262 => 1.0728, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 5.00% (0.0180 => 0.0189, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 3.76% (0.1438 => 0.1492, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -1.11% (1.1329 => 1.1203, std.dev.: 0.0209) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.37% (0.4164 => 0.4221, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.44% (0.1369 => 0.1375, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.43% (0.0641 => 0.0663, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 10.77% (0.0195 => 0.0216, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.94% (0.0578 => 0.0561, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.69% (1.1437 => 1.1973, std.dev.: 0.0111) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.64% (0.0627 => 0.0631, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.11% (0.0180 => 0.0209, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.48% (0.8017 => 0.7818, std.dev.: 0.0035) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -30.65% (0.0062 => 0.0043, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 24 11:15:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 13:15:10 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121124191510.F19402A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6208?compare_to=6206&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6208, Order: 168545, Start Time: 2012-11-24 17:42:25, End Time: 2012-11-24 19:15:38 To: 6206, Order: 168542, Start Time: 2012-11-24 15:46:15, End Time: 2012-11-24 17:19:40 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (178 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (860 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.64% (2.0478 => 2.1019, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/salsa20: 2.40% (7.4937 => 7.6737, std.dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/hash2: 2.34% (3.1932 => 3.2678, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.93% (0.3821 => 0.3518, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.72% (0.3142 => 0.2931, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: -6.52% (0.3357 => 0.3138, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.47% (0.9542 => 0.8925, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.44% (2.4924 => 2.3318, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/BoolLiteralTest: -6.42% (0.3834 => 0.3588, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/trivial-interface: -6.40% (0.3812 => 0.3568, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -6.37% (0.3831 => 0.3587, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.37% (0.3880 => 0.3633, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.36% (0.3884 => 0.3637, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.34% (0.3896 => 0.3649, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.31% (0.3848 => 0.3605, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.25% (0.4033 => 0.3781, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.20% (0.4176 => 0.3917, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.20% (0.7198 => 0.6752, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.19% (0.3891 => 0.3650, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -6.18% (9.2283 => 8.6580, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/oourafft: -6.16% (0.2160 => 0.2027, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.14% (0.2428 => 0.2279, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.06% (0.6484 => 0.6091, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.01% (0.9852 => 0.9260, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.99% (0.3658 => 0.3439, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -5.94% (16.1920 => 15.2299, std.dev.: 0.0037) MultiSource/Applications/JM/ldecod/ldecod: -5.94% (7.0961 => 6.6746, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.90% (0.2355 => 0.2216, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.90% (0.1796 => 0.1690, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: -5.86% (0.4199 => 0.3953, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.85% (1.3722 => 1.2919, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.85% (1.0544 => 0.9927, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: -5.80% (0.9179 => 0.8647, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.76% (4.8161 => 4.5386, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/ReedSolomon: -5.75% (0.1879 => 0.1771, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.70% (4.0323 => 3.8026, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.68% (1.2300 => 1.1601, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.68% (0.2695 => 0.2542, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.67% (3.5339 => 3.3337, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -5.65% (0.4280 => 0.4038, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.65% (0.5591 => 0.5275, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.65% (6.7716 => 6.3892, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.64% (1.6364 => 1.5441, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.64% (0.5570 => 0.5256, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.63% (0.6230 => 0.5879, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.62% (0.5478 => 0.5170, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.62% (0.5857 => 0.5528, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -5.62% (4.3330 => 4.0897, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.60% (0.5805 => 0.5480, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.59% (0.6667 => 0.6294, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.59% (0.5705 => 0.5386, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.58% (0.5863 => 0.5536, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.57% (0.6446 => 0.6087, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.57% (0.5802 => 0.5479, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.54% (0.5849 => 0.5525, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.54% (1.4642 => 1.3831, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.53% (0.5859 => 0.5535, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.53% (0.6293 => 0.5945, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.52% (0.6194 => 0.5852, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.52% (0.6304 => 0.5956, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -5.52% (1.1450 => 1.0818, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: -5.52% (1.1530 => 1.0894, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.51% (0.6736 => 0.6365, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.49% (0.5941 => 0.5615, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.49% (4.8802 => 4.6125, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.49% (0.5925 => 0.5600, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.48% (0.5581 => 0.5275, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -5.47% (0.4515 => 0.4268, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -5.46% (1.2515 => 1.1832, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.46% (0.7919 => 0.7487, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.44% (0.6660 => 0.6298, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.43% (0.5575 => 0.5272, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.41% (0.5456 => 0.5161, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.38% (4.5069 => 4.2646, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.37% (0.3837 => 0.3631, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.37% (0.3931 => 0.3720, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.37% (0.6260 => 0.5924, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.35% (0.6297 => 0.5960, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.35% (0.5999 => 0.5678, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -5.34% (0.3406 => 0.3224, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.32% (0.4151 => 0.3930, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.32% (0.4813 => 0.4557, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -5.31% (17.1032 => 16.1955, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.30% (0.6189 => 0.5861, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.30% (0.6440 => 0.6099, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -5.29% (0.2985 => 0.2827, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.28% (14.2083 => 13.4578, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.28% (1.2784 => 1.2109, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.27% (0.5688 => 0.5388, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: -5.26% (0.3025 => 0.2866, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.24% (0.3016 => 0.2858, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -5.22% (0.3255 => 0.3085, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.22% (0.2548 => 0.2415, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: -5.21% (1.3864 => 1.3141, std.dev.: 0.0177) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.21% (0.8521 => 0.8077, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.21% (0.3323 => 0.3150, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.20% (0.3057 => 0.2898, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.20% (0.3483 => 0.3302, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: -5.19% (1.3148 => 1.2466, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.17% (2.1713 => 2.0591, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -5.17% (0.3581 => 0.3396, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.16% (0.4321 => 0.4098, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: -5.15% (0.2871 => 0.2723, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -5.15% (0.2659 => 0.2522, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.15% (0.4916 => 0.4663, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.14% (0.2278 => 0.2161, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.14% (0.2999 => 0.2845, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.13% (0.3194 => 0.3030, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.13% (8.0126 => 7.6012, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.13% (0.6681 => 0.6338, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.11% (0.6033 => 0.5725, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -5.10% (0.2939 => 0.2789, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.10% (0.2903 => 0.2755, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -5.09% (0.3026 => 0.2872, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -5.09% (0.3205 => 0.3042, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -5.09% (0.2989 => 0.2837, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.07% (0.3849 => 0.3654, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -5.06% (15.5079 => 14.7239, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary3: -5.05% (0.3446 => 0.3272, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.05% (1.2221 => 1.1604, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.05% (0.6676 => 0.6339, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.05% (1.2210 => 1.1594, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: -5.04% (0.3394 => 0.3223, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -5.00% (0.3059 => 0.2906, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.00% (22.4056 => 21.2854, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.99% (0.2385 => 0.2266, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.98% (0.2933 => 0.2787, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -4.97% (0.4248 => 0.4037, std.dev.: 0.0038) MultiSource/Applications/lua/lua: -4.96% (4.0594 => 3.8580, std.dev.: 0.0054) MultiSource/Applications/minisat/minisat: -4.96% (0.7447 => 0.7078, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: -4.95% (3.5154 => 3.3413, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.92% (0.3252 => 0.3092, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.90% (0.5168 => 0.4915, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -4.89% (15.2527 => 14.5062, std.dev.: 0.0063) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.88% (0.3319 => 0.3157, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: -4.86% (0.3867 => 0.3679, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -4.85% (0.4861 => 0.4625, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.85% (0.7339 => 0.6983, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.83% (1.6474 => 1.5678, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.81% (0.7524 => 0.7162, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.80% (0.6395 => 0.6088, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: -4.77% (0.2849 => 0.2713, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -4.76% (2.4021 => 2.2877, std.dev.: 0.0058) SingleSource/UnitTests/ObjC++/property-reference: -4.70% (0.7779 => 0.7413, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.70% (0.4083 => 0.3891, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: -4.70% (0.7982 => 0.7607, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/ary2: -4.68% (0.3481 => 0.3318, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.66% (0.9557 => 0.9112, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.64% (0.7021 => 0.6695, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.61% (0.4427 => 0.4223, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -4.58% (0.3621 => 0.3455, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -4.58% (2.1401 => 2.0421, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: -4.58% (0.4524 => 0.4317, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -4.56% (34.0927 => 32.5396, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.52% (0.5329 => 0.5088, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -4.49% (0.3271 => 0.3124, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.45% (0.5569 => 0.5321, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.41% (0.6395 => 0.6113, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -4.37% (18.2933 => 17.4934, std.dev.: 0.0201) MultiSource/Applications/spiff/spiff: -4.37% (0.8418 => 0.8050, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: -4.36% (0.3788 => 0.3623, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -4.32% (0.6347 => 0.6073, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.27% (0.3491 => 0.3342, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.24% (0.9077 => 0.8692, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.20% (2.2587 => 2.1639, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: -4.19% (0.6750 => 0.6467, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -4.16% (0.6441 => 0.6173, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -4.15% (5.0226 => 4.8140, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: -3.82% (1.5610 => 1.5013, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.47% (5.4682 => 5.2784, std.dev.: 0.0089) SingleSource/UnitTests/Vector/constpool: -2.25% (20.7746 => 20.3072, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7515, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1733, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.91% (2.2633 => 2.1749, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7068, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.12% (1.3096 => 1.2688, std.dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4670, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 24 11:49:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 13:49:34 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121124194934.4C9852A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6209?compare_to=6204&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6209, Order: 168543, Start Time: 2012-11-24 17:29:52, End Time: 2012-11-24 19:49:52 To: 6204, Order: 168541, Start Time: 2012-11-24 14:20:30, End Time: 2012-11-24 16:38:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 54 (203 on baseline) Performance Improvements: 3 (41 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1029 (641 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 16.61% (0.1409 => 0.1643, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 14.72% (1.7934 => 2.0573, std.dev.: 0.0302) SingleSource/Benchmarks/McGill/chomp: 13.34% (0.1882 => 0.2133, std.dev.: 0.0061) MultiSource/Applications/SIBsim4/SIBsim4: 12.97% (1.5348 => 1.7339, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/except: 12.43% (0.3137 => 0.3527, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/BoolLiteralTest: 12.32% (0.4059 => 0.4559, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.07% (1.0288 => 1.1530, std.dev.: 0.0048) MultiSource/Applications/aha/aha: 11.61% (0.1326 => 0.1480, std.dev.: 0.0009) SingleSource/Benchmarks/LivermoreLoops/kernel17: 11.51% (0.1008 => 0.1124, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 11.48% (0.3379 => 0.3767, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.44% (0.5804 => 0.6468, std.dev.: 0.0026) MultiSource/Applications/Burg/burg: 11.38% (1.3360 => 1.4881, std.dev.: 0.0163) SingleSource/Benchmarks/LivermoreLoops/kernel22: 11.36% (0.1012 => 0.1127, std.dev.: 0.0037) SingleSource/Benchmarks/Linpack/linpack-pc: 10.99% (0.2876 => 0.3192, std.dev.: 0.0011) SingleSource/Benchmarks/LivermoreLoops/kernel16: 10.96% (0.1131 => 0.1255, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.77% (0.2665 => 0.2952, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 10.42% (0.2974 => 0.3284, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/oourafft: 10.08% (0.3590 => 0.3952, std.dev.: 0.0063) SingleSource/Benchmarks/LivermoreLoops/kernel18: 10.07% (0.1479 => 0.1628, std.dev.: 0.0044) MultiSource/Applications/oggenc/oggenc: 10.06% (6.5456 => 7.2040, std.dev.: 0.0412) SingleSource/Benchmarks/LivermoreLoops/kernel21: 9.89% (0.1112 => 0.1222, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.43% (0.1389 => 0.1520, std.dev.: 0.0036) SingleSource/UnitTests/SignlessTypes/rem: 9.08% (0.1267 => 0.1382, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/distray/distray: 9.03% (0.1529 => 0.1667, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.99% (0.6183 => 0.6739, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.82% (0.6654 => 0.7241, std.dev.: 0.0220) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.73% (0.3117 => 0.3389, std.dev.: 0.0054) MultiSource/Applications/viterbi/viterbi: 8.51% (0.1786 => 0.1938, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.24% (0.3568 => 0.3862, std.dev.: 0.0086) MultiSource/Applications/treecc/treecc: 7.86% (2.3983 => 2.5869, std.dev.: 0.0063) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 7.62% (0.1326 => 0.1427, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 7.11% (0.4471 => 0.4789, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/lists: 7.06% (0.3796 => 0.4064, std.dev.: 0.0039) SingleSource/Regression/C++/ofstream_ctor: 6.75% (0.3185 => 0.3400, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/hello: 6.70% (0.2957 => 0.3155, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.70% (0.3032 => 0.3235, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.02% (2.7065 => 2.8694, std.dev.: 0.0185) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.90% (0.2206 => 0.2314, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-3: 4.60% (0.3955 => 0.4137, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash: 4.52% (0.5136 => 0.5368, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.43% (5.7915 => 6.8590, std.dev.: 0.1964) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 13.35% (2.7677 => 3.1371, std.dev.: 0.0363) SingleSource/Benchmarks/Shootout/ary3: 12.66% (4.2000 => 4.7317, std.dev.: 0.1773) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 9.11% (9.4013 => 10.2580, std.dev.: 0.0990) SingleSource/Benchmarks/Shootout-C++/hash2: 8.01% (3.3692 => 3.6391, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 4.79% (0.5327 => 0.5582, std.dev.: 0.0069) SingleSource/Benchmarks/McGill/chomp: 4.56% (1.2643 => 1.3219, std.dev.: 0.0125) SingleSource/Benchmarks/CoyoteBench/lpbench: 4.39% (12.1317 => 12.6645, std.dev.: 0.0831) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 4.08% (6.1317 => 6.3820, std.dev.: 0.0907) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 3.68% (4.6574 => 4.8290, std.dev.: 0.0338) SingleSource/Benchmarks/Shootout-C++/hash: 3.18% (0.7788 => 0.8036, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.65% (19.3422 => 19.6621, std.dev.: 0.0472) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.59% (5.3260 => 5.4108, std.dev.: 0.0279) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.52% (61.1004 => 62.0312, std.dev.: 0.2095) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.01% (18.1781 => 17.0852, std.dev.: 0.3770) MultiSource/Applications/sgefa/sgefa: -2.98% (0.3862 => 0.3747, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/health/health: -9.38% (0.5362 => 0.4859, std.dev.: 0.0195) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.11% (69.3081 => 69.2309, std.dev.: 0.2173) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -1.17% (0.1363 => 0.1347, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -15.66% (0.0498 => 0.0420, std.dev.: 0.0064) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0652 => 0.0652, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -0.01% (494.0174 => 493.9774, std.dev.: 0.1983) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.47% (63.2438 => 69.2309, std.dev.: 0.2173) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0064) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43703.97% (1.1277 => 493.9774, std.dev.: 0.1983) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 231.59% (0.5229 => 1.7339, std.dev.: 0.0049) MultiSource/Applications/SPASS/SPASS: 21.30% (14.9895 => 18.1816, std.dev.: 0.1638) MultiSource/Applications/kimwitu++/kc: 50.93% (14.1553 => 21.3642, std.dev.: 0.4304) MultiSource/Benchmarks/MallocBench/gs/gs: 14.74% (4.1105 => 4.7162, std.dev.: 0.3004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 43.77% (1.1048 => 1.5884, std.dev.: 0.0282) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 429.62% (7.1582 => 37.9116, std.dev.: 0.3788) SingleSource/Benchmarks/Misc-C++-EH/spirit: 79.86% (3.4629 => 6.2284, std.dev.: 0.2296) SingleSource/Benchmarks/Misc-C++/stepanov_container: 85.31% (0.6222 => 1.1530, std.dev.: 0.0048) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10811.11% (0.0720 => 7.8560, std.dev.: 0.1970) MultiSource/Applications/SIBsim4/SIBsim4: 3905800.00% (0.0001 => 3.9059, std.dev.: 0.0170) MultiSource/Applications/SPASS/SPASS: 14194200.00% (0.0001 => 14.1943, std.dev.: 0.9094) MultiSource/Applications/kimwitu++/kc: 52900.00% (0.0001 => 0.0530, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14400.00% (0.0001 => 0.0145, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 577000.00% (0.0001 => 0.5771, std.dev.: 0.0205) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10105200.00% (0.0001 => 10.1053, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6858900.00% (0.0001 => 6.8590, std.dev.: 0.1964) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1741.81% (1.1194 => 20.6172, std.dev.: 0.7045) MultiSource/Applications/ClamAV/clamscan: 65.99% (22.1758 => 36.8088, std.dev.: 0.3120) MultiSource/Benchmarks/FreeBench/distray/distray: 57.86% (0.1056 => 0.1667, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.52% (2.9384 => 4.5992, std.dev.: 0.3690) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.79% (7.0540 => 10.9191, std.dev.: 0.2452) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 48.01% (8.1363 => 12.0428, std.dev.: 0.3412) SingleSource/Benchmarks/Misc/flops: 47.63% (0.1432 => 0.2114, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 46.84% (21.9371 => 32.2120, std.dev.: 0.0926) SingleSource/UnitTests/vla: 44.51% (0.0355 => 0.0513, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 39.32% (0.0730 => 0.1017, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.93% (0.1236 => 0.1643, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 32.20% (0.0528 => 0.0698, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 31.66% (0.1175 => 0.1547, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.29% (2.2024 => 2.8694, std.dev.: 0.0185) MultiSource/Benchmarks/Olden/bisort/bisort: 30.13% (0.0614 => 0.0799, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.72% (1.5859 => 2.0573, std.dev.: 0.0302) MultiSource/Benchmarks/Fhourstones/fhourstones: 29.25% (0.1566 => 0.2024, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/family/family: 28.97% (0.0397 => 0.0512, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 28.88% (0.1655 => 0.2133, std.dev.: 0.0061) SingleSource/Benchmarks/Stanford/Towers: 28.66% (0.0471 => 0.0606, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/dot-syntax-1: 28.60% (0.0479 => 0.0616, std.dev.: 0.0017) MultiSource/Applications/aha/aha: 28.58% (0.1151 => 0.1480, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 28.39% (0.7115 => 0.9135, std.dev.: 0.0022) SingleSource/Benchmarks/Stanford/Quicksort: 28.21% (0.0358 => 0.0459, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Treesort: 27.98% (0.0411 => 0.0526, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 27.82% (1.1642 => 1.4881, std.dev.: 0.0163) MultiSource/Applications/treecc/treecc: 27.60% (2.0273 => 2.5869, std.dev.: 0.0063) SingleSource/Benchmarks/McGill/exptree: 27.52% (0.0814 => 0.1038, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 27.25% (0.4103 => 0.5221, std.dev.: 0.0039) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 27.19% (0.0467 => 0.0594, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 27.15% (0.2700 => 0.3433, std.dev.: 0.0071) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.84% (0.1125 => 0.1427, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.70% (0.5105 => 0.6468, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 26.47% (0.0442 => 0.0559, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 26.06% (0.0871 => 0.1098, std.dev.: 0.0030) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.98% (0.1143 => 0.1440, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/health/health: 25.79% (0.1268 => 0.1595, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/RealMM: 25.51% (0.0396 => 0.0497, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 25.30% (0.0672 => 0.0842, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 25.16% (0.4289 => 0.5368, std.dev.: 0.0075) SingleSource/Benchmarks/Stanford/Queens: 25.12% (0.0414 => 0.0518, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 25.09% (5.7591 => 7.2040, std.dev.: 0.0412) SingleSource/Benchmarks/Misc-C++/bigfib: 25.02% (0.6456 => 0.8071, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout/matrix: 24.82% (0.0818 => 0.1021, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.80% (0.0746 => 0.0931, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 24.76% (0.4620 => 0.5764, std.dev.: 0.0124) MultiSource/Applications/viterbi/viterbi: 24.63% (0.1555 => 0.1938, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 24.48% (0.0482 => 0.0600, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 23.94% (0.0447 => 0.0554, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.84% (0.1032 => 0.1278, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.74% (0.3121 => 0.3862, std.dev.: 0.0086) SingleSource/Benchmarks/Stanford/Oscar: 23.43% (0.0636 => 0.0785, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 22.93% (0.3650 => 0.4487, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/except: 22.85% (0.2871 => 0.3527, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/life/life: 22.51% (0.0933 => 0.1143, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.45% (0.1029 => 0.1260, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 22.31% (0.2877 => 0.3519, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/hash: 22.27% (0.0485 => 0.0593, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.21% (0.0770 => 0.0941, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.19% (0.2271 => 0.2775, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 22.14% (0.0953 => 0.1164, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 22.11% (0.3162 => 0.3861, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 21.88% (0.0457 => 0.0557, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 21.69% (0.2554 => 0.3108, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/matrix: 21.59% (0.3098 => 0.3767, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.48% (0.2430 => 0.2952, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 21.17% (0.0770 => 0.0933, std.dev.: 0.0019) SingleSource/UnitTests/SignlessTypes/rem: 20.80% (0.1144 => 0.1382, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.55% (0.0793 => 0.0956, std.dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: 20.52% (0.3109 => 0.3747, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/fibo: 20.51% (0.2725 => 0.3284, std.dev.: 0.0071) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.50% (0.2107 => 0.2539, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/oourafft: 20.41% (0.3282 => 0.3952, std.dev.: 0.0063) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.39% (0.1584 => 0.1907, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/perlin: 20.34% (0.0536 => 0.0645, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 19.87% (0.1268 => 0.1520, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 19.73% (2.2969 => 2.7500, std.dev.: 0.0568) MultiSource/Applications/lemon/lemon: 19.53% (1.0722 => 1.2816, std.dev.: 0.0348) SingleSource/UnitTests/SignlessTypes/Large/cast: 19.50% (0.0564 => 0.0674, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.30% (0.9765 => 1.1650, std.dev.: 0.0261) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.92% (14.3668 => 17.0852, std.dev.: 0.3770) SingleSource/Benchmarks/Shootout-C++/lists: 18.76% (0.3422 => 0.4064, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 18.52% (0.2603 => 0.3085, std.dev.: 0.0126) MultiSource/Benchmarks/Olden/mst/mst: 18.40% (0.1163 => 0.1377, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/moments: 18.31% (0.4048 => 0.4789, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.00% (0.2872 => 0.3389, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.88% (4.2646 => 5.0273, std.dev.: 0.0947) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 17.84% (3.8922 => 4.5867, std.dev.: 0.1735) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.69% (0.5569 => 0.6554, std.dev.: 0.0265) SingleSource/UnitTests/ObjC/exceptions-2: 17.67% (0.3497 => 0.4115, std.dev.: 0.0074) SingleSource/UnitTests/ObjC/exceptions-3: 17.66% (0.3516 => 0.4137, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.58% (0.0842 => 0.0990, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.46% (0.3935 => 0.4622, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/fbench: 17.40% (0.0592 => 0.0695, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/misr: 17.38% (0.0633 => 0.0743, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_isamax: 17.19% (0.0704 => 0.0825, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 17.18% (0.0838 => 0.0982, std.dev.: 0.0022) SingleSource/Regression/C++/ofstream_ctor: 17.04% (0.2905 => 0.3400, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/17-bintr/bintr: 17.04% (0.0675 => 0.0790, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/ReedSolomon: 16.94% (0.2049 => 0.2396, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.87% (0.6675 => 0.7801, std.dev.: 0.0222) MultiSource/Benchmarks/nbench/nbench: 16.80% (1.1840 => 1.3829, std.dev.: 0.0459) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 16.70% (0.1114 => 0.1300, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.64% (0.8172 => 0.9532, std.dev.: 0.0428) SingleSource/UnitTests/ObjC/messages-2: 16.62% (0.0662 => 0.0772, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/neural/neural: 16.61% (0.1463 => 0.1706, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/bmm/bmm: 16.47% (0.0759 => 0.0884, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.46% (0.2065 => 0.2405, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout/lists: 16.29% (0.0626 => 0.0728, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 16.25% (0.2714 => 0.3155, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.20% (0.1117 => 0.1298, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.90% (0.0648 => 0.0751, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/em3d/em3d: 15.87% (0.1695 => 0.1964, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.83% (0.2793 => 0.3235, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.58% (0.0886 => 0.1024, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.31% (0.1940 => 0.2237, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 15.14% (0.5860 => 0.6747, std.dev.: 0.0310) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.51% (0.0834 => 0.0955, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.20% (4.9449 => 5.6470, std.dev.: 0.1728) MultiSource/Applications/spiff/spiff: 14.12% (0.7835 => 0.8941, std.dev.: 0.0226) MultiSource/Applications/sqlite3/sqlite3: 14.00% (17.1811 => 19.5869, std.dev.: 0.4917) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.93% (0.5981 => 0.6814, std.dev.: 0.0273) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.91% (0.1337 => 0.1523, std.dev.: 0.0063) MultiSource/Benchmarks/mafft/pairlocalalign: 13.81% (9.4845 => 10.7940, std.dev.: 0.3866) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.56% (0.1062 => 0.1206, std.dev.: 0.0044) MultiSource/Applications/lua/lua: 13.44% (3.8723 => 4.3929, std.dev.: 0.0637) MultiSource/Benchmarks/McCat/18-imp/imp: 13.41% (0.3423 => 0.3882, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 13.29% (0.3927 => 0.4449, std.dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.25% (0.1510 => 0.1710, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/exceptions-4: 13.07% (0.3543 => 0.4006, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.80% (1.3050 => 1.4720, std.dev.: 0.0619) MultiSource/Applications/d/make_dparser: 12.66% (3.3354 => 3.7578, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/property: 12.64% (0.3886 => 0.4377, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.57% (0.1695 => 0.1908, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/trivial-interface: 12.53% (0.3473 => 0.3908, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.42% (0.3543 => 0.3983, std.dev.: 0.0089) SingleSource/UnitTests/ObjC/synchronized: 12.41% (0.3561 => 0.4003, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/exceptions: 12.41% (0.3828 => 0.4303, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.25% (0.1625 => 0.1824, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/for-in: 12.13% (0.3694 => 0.4142, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.05% (0.5020 => 0.5625, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 12.01% (0.3180 => 0.3562, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.77% (0.3865 => 0.4320, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.21% (0.4203 => 0.4674, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.12% (0.1906 => 0.2118, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.82% (0.6450 => 0.7148, std.dev.: 0.0119) MultiSource/Benchmarks/McCat/05-eks/eks: 10.79% (0.4299 => 0.4763, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/sieve: 10.60% (0.3603 => 0.3985, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 10.55% (1.5603 => 1.7249, std.dev.: 0.0601) SingleSource/UnitTests/ObjC++/property-reference-object: 10.13% (0.6030 => 0.6641, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.11% (0.5925 => 0.6524, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.77% (0.3817 => 0.4190, std.dev.: 0.0083) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.60% (0.1438 => 0.1576, std.dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference: 9.49% (0.7326 => 0.8021, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 9.47% (0.2831 => 0.3099, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.93% (0.2756 => 0.3002, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 8.63% (10.3673 => 11.2622, std.dev.: 0.1991) SingleSource/Benchmarks/Shootout-C++/random: 8.42% (0.2802 => 0.3038, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/objinst: 8.37% (0.3131 => 0.3393, std.dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.95% (4.3953 => 11.0301, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/methcall: 147.75% (5.3999 => 13.3781, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/ary3: 27.90% (3.6994 => 4.7317, std.dev.: 0.1773) SingleSource/Benchmarks/CoyoteBench/lpbench: 22.41% (10.3460 => 12.6645, std.dev.: 0.0831) MultiSource/Benchmarks/Olden/bisort/bisort: 19.91% (0.8333 => 0.9992, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.95% (13.4384 => 15.8510, std.dev.: 0.9289) SingleSource/Benchmarks/Misc/oourafft: 17.74% (6.6465 => 7.8257, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.46% (0.2944 => 0.3458, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.26% (1.1145 => 1.3069, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 15.24% (3.1578 => 3.6391, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 14.71% (1.0785 => 1.2372, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/moments: 11.99% (0.1159 => 0.1298, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.60% (2.8904 => 3.2258, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 10.17% (1.1396 => 1.2555, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 10.06% (0.1421 => 0.1564, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.48% (1.7254 => 1.8889, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.84% (8.6802 => 9.4478, std.dev.: 0.2954) SingleSource/Benchmarks/Shootout-C++/hash: 7.79% (0.7455 => 0.8036, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/chomp: 6.84% (1.2373 => 1.3219, std.dev.: 0.0125) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.94% (0.9540 => 1.0107, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.86% (4.2280 => 4.4758, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.34% (0.3070 => 0.3234, std.dev.: 0.0054) SingleSource/Regression/C/uint64_to_float: 5.10% (0.5413 => 0.5689, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 4.97% (0.9505 => 0.9977, std.dev.: 0.0162) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.32% (26.0924 => 27.2188, std.dev.: 0.1979) MultiSource/Benchmarks/nbench/nbench: 4.01% (11.6436 => 12.1102, std.dev.: 0.0162) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: 2.63% (2.4116 => 2.4750, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 2.35% (0.6223 => 0.6369, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.30% (3.6395 => 3.7232, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.19% (1.7133 => 1.7509, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.13% (1.3677 => 1.3968, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 2.08% (3.1595 => 3.2252, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 1.84% (85.0658 => 86.6316, std.dev.: 0.1802) MultiSource/Applications/sqlite3/sqlite3: 1.76% (4.6441 => 4.7260, std.dev.: 0.0280) SingleSource/Benchmarks/Shootout/heapsort: 1.73% (3.8526 => 3.9191, std.dev.: 0.0163) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.49% (6.5088 => 6.6056, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 1.46% (27.8444 => 28.2502, std.dev.: 0.0251) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0502, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.14% (1.9577 => 1.9800, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/sieve: 1.12% (5.2139 => 5.2722, std.dev.: 0.0049) MultiSource/Applications/spiff/spiff: 1.00% (2.9346 => 2.9640, std.dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1669, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.95% (5.2763 => 1.2161, std.dev.: 0.0481) SingleSource/Benchmarks/Misc/salsa20: -75.01% (0.8651 => 0.2162, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -40.32% (0.1622 => 0.0968, std.dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: -11.41% (10.4361 => 9.2450, std.dev.: 0.1997) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -10.07% (1.7609 => 1.5835, std.dev.: 0.0651) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.51% (5.3526 => 4.8434, std.dev.: 0.0931) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -9.35% (5.3855 => 4.8820, std.dev.: 0.0823) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.31% (0.3987 => 0.2380, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.38% (4.5009 => 2.7734, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel: -33.53% (1.1492 => 0.7639, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.09% (2.6546 => 2.0151, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/mason/mason: -19.20% (0.2161 => 0.1746, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.60% (1.6925 => 1.4284, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.69% (2.6778 => 2.2843, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.83% (32.5116 => 28.9904, std.dev.: 0.0301) SingleSource/Benchmarks/Misc/mandel-2: -10.65% (1.5373 => 1.3736, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -10.34% (9.5636 => 8.5747, std.dev.: 0.2066) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.70% (1.5660 => 1.4298, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.24% (1.6805 => 1.5421, std.dev.: 0.0331) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.94% (4.8142 => 4.4803, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5760, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.02% (3.2416 => 3.0790, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.01% (0.2497 => 0.2372, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -4.24% (6.2999 => 6.0328, std.dev.: 0.0090) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.37% (0.9957 => 0.9621, std.dev.: 0.0090) MultiSource/Applications/siod/siod: -3.08% (3.2827 => 3.1817, std.dev.: 0.0380) MultiSource/Benchmarks/sim/sim: -3.03% (5.0483 => 4.8951, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.60% (0.4808 => 0.4683, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.97% (8.1563 => 7.9960, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6775, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -1.45% (10.2830 => 10.1334, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.44% (19.9488 => 19.6621, std.dev.: 0.0472) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.29% (0.1485 => 0.1347, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0014) Report Time: 4.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 24 11:58:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 13:58:43 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121124195843.D16112A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6210?compare_to=6203&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6210, Order: 168543, Start Time: 2012-11-24 16:37:24, End Time: 2012-11-24 19:59:00 To: 6203, Order: 168538, Start Time: 2012-11-24 12:28:22, End Time: 2012-11-24 15:49:16 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (171 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1089 (719 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 16.26% (101.9006 => 118.4723, std.dev.: 0.0817) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.39% (54.1103 => 54.8637, std.dev.: 0.0403) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.12% (2.2786 => 2.2531, std.dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.36% (0.0625 => 0.0896, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.21% (0.1063 => 0.1416, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.14% (0.2969 => 0.3745, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.68% (0.1106 => 0.1390, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.28% (0.4253 => 0.5328, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.25% (0.4139 => 0.5184, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 25.19% (1.5932 => 1.9945, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.37% (0.0714 => 0.0888, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 24.34% (0.0452 => 0.0562, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.11% (0.4994 => 0.6198, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.00% (0.5900 => 0.7316, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.79% (0.0475 => 0.0588, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.28% (0.5000 => 0.6164, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.21% (0.0642 => 0.0791, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.12% (0.0584 => 0.0719, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.16% (0.1620 => 0.1979, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.96% (0.0897 => 0.1094, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.94% (0.1021 => 0.1245, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.85% (0.1103 => 0.1344, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 21.70% (0.0599 => 0.0729, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.68% (0.1107 => 0.1347, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.86% (0.3903 => 0.4717, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.70% (0.0633 => 0.0764, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 20.68% (0.0948 => 0.1144, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0584 => 0.0704, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 20.22% (0.0821 => 0.0987, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.07% (0.0822 => 0.0987, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.04% (0.1003 => 0.1204, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.95% (0.1549 => 0.1858, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.64% (0.1604 => 0.1919, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 19.52% (0.1619 => 0.1935, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.81% (0.1462 => 0.1737, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 18.59% (0.0947 => 0.1123, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.57% (0.2736 => 0.3244, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.41% (0.3890 => 0.4606, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.10% (0.1160 => 0.1370, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.07% (0.2014 => 0.2378, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 17.98% (0.1218 => 0.1437) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.94% (1.3152 => 1.5512, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/mst/mst: 17.91% (0.0698 => 0.0823, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 17.82% (0.4029 => 0.4747, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.79% (0.2866 => 0.3376, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.74% (0.1088 => 0.1281, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 17.63% (0.5826 => 0.6853, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/09-vor/vor: 17.34% (0.1505 => 0.1766, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 17.34% (0.5889 => 0.6910, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.17% (0.5026 => 0.5889, std.dev.: 0.0033) MultiSource/Applications/Burg/burg: 17.06% (0.5546 => 0.6492, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.78% (3.5627 => 4.1605, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: 16.78% (1.8794 => 2.1947, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.69% (1.6211 => 1.8916, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.55% (0.4658 => 0.5429, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.51% (0.1968 => 0.2293, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.45% (0.3271 => 0.3809, std.dev.: 0.0017) MultiSource/Applications/hbd/hbd: 16.40% (0.9697 => 1.1287, std.dev.: 0.0020) MultiSource/Applications/d/make_dparser: 16.35% (1.0781 => 1.2544, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 16.33% (0.7171 => 0.8342, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.26% (0.3930 => 0.4569, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.03% (0.4361 => 0.5060, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 15.90% (0.1421 => 0.1647, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.83% (0.2875 => 0.3330, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.62% (4.4195 => 5.1098, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/bh/bh: 15.58% (0.1284 => 0.1484, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.56% (2.7292 => 3.1539, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.42% (0.3060 => 0.3532, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.41% (0.2738 => 0.3160, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 15.40% (0.9909 => 1.1435, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 15.30% (0.2823 => 0.3255, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 15.29% (4.2109 => 4.8546, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/methcall: 15.25% (0.2813 => 0.3242, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 15.20% (0.2750 => 0.3168, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.19% (1.9694 => 2.2685, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.18% (0.3195 => 0.3680, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.15% (0.2911 => 0.3352, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 15.07% (0.2780 => 0.3199, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.06% (0.2729 => 0.3140, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 15.00% (0.2714 => 0.3121, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 14.97% (0.2725 => 0.3133, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 14.91% (0.3004 => 0.3452, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.90% (1.9966 => 2.2941, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 14.90% (23.5202 => 27.0245, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/except: 14.83% (0.2811 => 0.3228, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 14.81% (0.2566 => 0.2946, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/random: 14.81% (0.2803 => 0.3218, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.79% (0.2792 => 0.3205, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.77% (0.1090 => 0.1251, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.76% (0.3488 => 0.4003, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.65% (2.0673 => 2.3702, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wc: 14.57% (0.3096 => 0.3547, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 14.48% (0.3267 => 0.3740, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 14.43% (0.3258 => 0.3728, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.43% (0.3362 => 0.3847, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 14.41% (0.3317 => 0.3795, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 14.20% (0.3465 => 0.3957, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 14.16% (0.3446 => 0.3934, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 14.12% (0.2075 => 0.2368, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.08% (0.3460 => 0.3947, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.07% (0.3496 => 0.3988, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 14.07% (0.3469 => 0.3957, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 14.00% (0.3442 => 0.3924, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 13.92% (0.3348 => 0.3814, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 13.90% (1.4269 => 1.6252, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: 13.84% (0.3678 => 0.4187, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 13.82% (0.4146 => 0.4719, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.76% (0.3845 => 0.4374, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.73% (0.3124 => 0.3553, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions: 13.67% (0.3643 => 0.4141, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.64% (0.3650 => 0.4148, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 13.60% (0.3477 => 0.3950, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.52% (0.3625 => 0.4115, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/parameter-passing: 13.48% (0.3724 => 0.4226, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.47% (0.3282 => 0.3724, std.dev.: 0.0048) MultiSource/Applications/treecc/treecc: 13.38% (0.7875 => 0.8929, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/sieve: 13.31% (0.3726 => 0.4222, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 13.27% (0.2691 => 0.3048, std.dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 12.99% (2.1653 => 2.4466, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.93% (0.3690 => 0.4167, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 12.91% (0.4251 => 0.4800, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.91% (0.3981 => 0.4495, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 12.61% (4.6177 => 5.1999, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/bigfib: 12.39% (0.5012 => 0.5633, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 12.35% (2.1013 => 2.3609, std.dev.: 0.0064) MultiSource/Applications/SPASS/SPASS: 11.66% (5.5417 => 6.1880, std.dev.: 0.0144) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.50% (0.6435 => 0.7175, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.48% (0.1028 => 0.1146, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.47% (0.2040 => 0.2274, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 11.28% (0.6634 => 0.7382, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 10.92% (0.3498 => 0.3880, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 10.82% (0.3336 => 0.3697, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.64% (0.2068 => 0.2288, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.57% (0.3084 => 0.3410, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.45% (0.2737 => 0.3023, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 10.40% (0.4847 => 0.5351, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.12% (0.1383 => 0.1523, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.75% (0.2103 => 0.2308, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 9.73% (2.0346 => 2.2325, std.dev.: 0.0053) MultiSource/Applications/lemon/lemon: 9.49% (0.2391 => 0.2618, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.03% (0.5361 => 0.5845, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.70% (4.6926 => 5.1007, std.dev.: 0.0139) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.48% (11.6398 => 12.6273, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.95% (0.7426 => 0.8016, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.79% (0.5584 => 0.6019, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 6.72% (11.9555 => 12.7587, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.67% (0.3792 => 0.3969, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 8.53% (0.2802 => 0.3041, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary: 6.74% (0.2122 => 0.2265, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6106, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.90% (0.3693 => 0.3911, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6715, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1671, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-2: 4.39% (1.8057 => 1.8849, std.dev.: 0.0056) SingleSource/Benchmarks/Dhrystone/dry: 4.28% (14.0481 => 14.6487, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2074, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2227, std.dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3035, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2846, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5124, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5389, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5915, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.02% (2.4764 => 2.3768, std.dev.: 0.0114) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5693, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout-C++/ary2: -10.12% (0.2402 => 0.2159, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9740, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7892, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419) SingleSource/UnitTests/Vector/build2: -3.53% (11.2080 => 10.8118, std.dev.: 0.0017) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7751, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5191, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8661, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: -2.16% (17.2379 => 16.8658, std.dev.: 0.0651) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.76% (0.6293 => 0.6182, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5773, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4955, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1641, std.dev.: 0.0806) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0482, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 4.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 24 12:50:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 14:50:22 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121124205022.5EEAA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6211?compare_to=6207&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6211, Order: 168546, Start Time: 2012-11-24 19:21:05, End Time: 2012-11-24 20:50:51 To: 6207, Order: 168545, Start Time: 2012-11-24 17:25:44, End Time: 2012-11-24 18:56:24 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 4 (121 on baseline) Performance Improvements: 5 (27 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1045 (826 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.23% (0.3374 => 0.3483, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.81% (13.2669 => 13.5071, std.dev.: 0.0203) SingleSource/Benchmarks/Misc/pi: 1.49% (2.4746 => 2.5114, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.48% (1.5820 => 1.6054, std.dev.: 0.0068) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.55% (0.7026 => 0.6917, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.39% (1.2248 => 1.2078, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: -3.29% (1.2804 => 1.2383, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.21% (0.3213 => 0.3110, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.08% (4.6297 => 4.5336, std.dev.: 0.0334) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.49% (1.0728 => 1.0675, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.46% (0.0219 => 0.0220, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.65% (0.0425 => 0.0418, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.60% (0.0332 => 0.0334, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.64% (0.0314 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.24% (0.0423 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0205 => 0.0204, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/test1: 15.87% (0.0189 => 0.0219, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -1.01% (0.1492 => 0.1477, std.dev.: 0.0082) MultiSource/Applications/lemon/lemon: 6.87% (1.1203 => 1.1973, std.dev.: 0.0093) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.42% (0.4221 => 0.4161, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.47% (0.1375 => 0.1464, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -14.33% (0.0663 => 0.0568, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.26% (0.0216 => 0.0196, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.87% (0.0561 => 0.0622, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.38% (1.1973 => 1.1928, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.45% (0.0031 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.73% (0.0631 => 0.0557, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 10.05% (0.0209 => 0.0230, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.20% (0.7818 => 0.7834, std.dev.: 0.0251) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -4.65% (0.0043 => 0.0041, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.53% (16.4461 => 17.6841, std.dev.: 0.0172) MultiSource/Applications/sqlite3/sqlite3: 2312.57% (0.6332 => 15.2764, std.dev.: 0.3253) MultiSource/Benchmarks/McCat/08-main/main: 47.46% (0.1831 => 0.2700, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -14.88% (0.1559 => 0.1327, std.dev.: 0.0073) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7075.18% (0.3123 => 22.4081, std.dev.: 0.1143) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.36% (0.2463 => 0.3728, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1522.94% (0.3344 => 5.4271, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.07% (0.2364 => 0.3264, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 4.89% (0.6010 => 0.6304, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel: 3.50% (0.0429 => 0.0444, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.30% (0.3266 => 0.3439, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/strcat: 3.66% (0.1969 => 0.2041, std.dev.: 0.0021) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.80% (0.0224 => 0.0237, std.dev.: 0.0010) SingleSource/UnitTests/byval-alignment: -53.04% (0.0230 => 0.0108, std.dev.: 0.0025) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0471, std.dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 8.34% (0.1462 => 0.1584, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4707, std.dev.: 0.0135) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0693, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4863, std.dev.: 0.0047) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5123, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5662, std.dev.: 0.4792) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3148, std.dev.: 0.0131) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1404, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3630, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4054, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0865, std.dev.: 0.0010) SingleSource/Regression/C/uint64_to_float: -23.83% (2.1832 => 1.6630, std.dev.: 0.0054) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.04% (0.0810 => 0.0948, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.09% (0.0848 => 0.0959, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 11.78% (0.1112 => 0.1243, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.62% (0.2180 => 0.2368, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.35% (0.1905 => 0.2045, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.01% (0.7473 => 0.7922, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.98% (0.8148 => 0.8635, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.62% (0.1885 => 0.1991, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.54% (0.2240 => 0.2364, std.dev.: 0.0032) MultiSource/Applications/Burg/burg: 5.19% (1.2222 => 1.2856, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.66% (0.4847 => 0.5073, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.36% (0.6287 => 0.6561, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.29% (0.4127 => 0.4304, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.07% (1.1606 => 1.2078, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 3.99% (1.9948 => 2.0744, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.79% (0.3295 => 0.3420, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.64% (0.9435 => 0.9778, std.dev.: 0.0058) MultiSource/Applications/hbd/hbd: 3.60% (1.4269 => 1.4782, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.54% (1.1170 => 1.1565, std.dev.: 0.0039) MultiSource/Applications/siod/siod: 3.53% (2.2184 => 2.2968, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.47% (1.1685 => 1.2091, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.43% (2.1401 => 2.2134, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 3.41% (14.2605 => 14.7464, std.dev.: 0.0440) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.36% (0.5961 => 0.6161, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 3.23% (3.2366 => 3.3413, std.dev.: 0.0256) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.21% (4.1763 => 4.3102, std.dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 3.16% (1.1271 => 1.1627, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.07% (0.8086 => 0.8334, std.dev.: 0.0029) MultiSource/Applications/lua/lua: 3.06% (3.8189 => 3.9358, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.06% (1.4479 => 1.4922, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.05% (0.8457 => 0.8715, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.01% (0.9039 => 0.9311, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.96% (0.8697 => 0.8954, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.91% (1.5315 => 1.5760, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.90% (1.3279 => 1.3664, std.dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: 2.88% (0.7557 => 0.7775, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.84% (0.4783 => 0.4919, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.83% (1.6386 => 1.6849, std.dev.: 0.0038) MultiSource/Applications/SIBsim4/SIBsim4: 2.82% (1.2568 => 1.2923, std.dev.: 0.0107) MultiSource/Applications/minisat/minisat: 2.82% (0.6834 => 0.7027, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.81% (0.8712 => 0.8957, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.81% (0.8656 => 0.8899, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.78% (0.8927 => 0.9175, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.77% (0.9069 => 0.9320, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.76% (0.8007 => 0.8228, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/gs/gs: 2.73% (4.1305 => 4.2432, std.dev.: 0.0253) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.70% (0.8331 => 0.8556, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.69% (4.4873 => 4.6079, std.dev.: 0.0103) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.67% (6.6074 => 6.7839, std.dev.: 0.0251) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.64% (0.8286 => 0.8505, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.60% (0.9074 => 0.9310, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.58% (0.8066 => 0.8274, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.53% (0.8805 => 0.9028, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.52% (0.9688 => 0.9932, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.51% (0.8716 => 0.8935, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.49% (0.8204 => 0.8408, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.48% (0.9056 => 0.9281, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.48% (0.8069 => 0.8269, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.47% (0.8050 => 0.8249, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.46% (0.8420 => 0.8627, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.45% (0.8317 => 0.8521, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.43% (0.8597 => 0.8806, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.42% (0.8359 => 0.8561, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.40% (0.7966 => 0.8157, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.39% (0.5191 => 0.5315, std.dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 2.36% (14.7684 => 15.1171, std.dev.: 0.0719) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.35% (0.9908 => 1.0141, std.dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: 2.34% (0.9810 => 1.0040, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.33% (13.1811 => 13.4879, std.dev.: 0.0571) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.28% (0.8885 => 0.9088, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.26% (0.8611 => 0.8806, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: 2.26% (1.0945 => 1.1192, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.22% (3.1832 => 3.2538, std.dev.: 0.0101) MultiSource/Benchmarks/Bullet/bullet: 2.22% (31.8598 => 32.5661, std.dev.: 0.2333) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.15% (0.8338 => 0.8517, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.14% (0.8261 => 0.8438, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.11% (0.8855 => 0.9042, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.09% (0.8518 => 0.8696, std.dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: 2.04% (6.7320 => 6.8696, std.dev.: 0.0138) MultiSource/Applications/JM/lencod/lencod: 2.04% (15.3280 => 15.6411, std.dev.: 0.0374) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.99% (4.4880 => 4.5772, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.93% (0.8177 => 0.8335, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.92% (0.8340 => 0.8500, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.87% (8.6476 => 8.8094, std.dev.: 0.0327) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.73% (0.6586 => 0.6700, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.57% (4.5702 => 4.6418, std.dev.: 0.0164) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 98.99% (0.0199 => 0.0396, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/pi: 59.00% (1.5795 => 2.5114, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.33% (2.9753 => 3.4613, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.57% (0.7597 => 0.8780, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.70% (2.7995 => 3.2111, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6092, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.32% (0.3186 => 0.3483, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.11% (1.1857 => 1.2819, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 7.22% (1.7056 => 1.8288, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: 6.98% (1.3037 => 1.3947, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.52% (4.7794 => 5.0911, std.dev.: 0.0058) MultiSource/Applications/SIBsim4/SIBsim4: 6.46% (3.1873 => 3.3932, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.88% (4.5327 => 4.7993, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.87% (4.9686 => 5.2602, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.76% (6.2275 => 6.5240, std.dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: 4.61% (7.4933 => 7.8390, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.50% (3.3761 => 3.5281, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.17% (4.9453 => 5.1516, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.90% (4.9469 => 5.1399, std.dev.: 0.0710) MultiSource/Applications/hexxagon/hexxagon: 3.81% (14.0064 => 14.5406, std.dev.: 0.0229) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.51% (0.3587 => 0.3713, std.dev.: 0.0029) MultiSource/Applications/siod/siod: 3.18% (3.6643 => 3.7809, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.82% (11.5690 => 11.8953, std.dev.: 0.0359) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.81% (1.2337 => 1.2684, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.73% (8.2783 => 8.5039, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout/lists: 2.26% (7.3375 => 7.5033, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.19% (4.8660 => 4.9727, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.68% (4.8362 => 4.9174, std.dev.: 0.0245) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.66% (1.1365 => 1.1554, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.38% (2.4647 => 2.4987, std.dev.: 0.0073) MultiSource/Applications/spiff/spiff: 1.37% (2.8561 => 2.8951, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/ReedSolomon: 1.26% (8.5322 => 8.6396, std.dev.: 0.0218) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.18% (1.5866 => 1.6054, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.10% (3.5679 => 3.6073, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/power/power: 1.09% (1.2061 => 1.2192, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -36.09% (0.0338 => 0.0216, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/em3d/em3d: -21.66% (5.4641 => 4.2804, std.dev.: 0.0267) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.57% (7.2130 => 6.2341, std.dev.: 0.2328) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.14% (1.0512 => 0.9341, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: -8.47% (63.1822 => 57.8297, std.dev.: 0.0960) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.77% (14.6451 => 13.5071, std.dev.: 0.0203) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.68% (0.3269 => 0.3018, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.95% (4.7482 => 4.4183, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.14% (3.7148 => 3.4867, std.dev.: 0.0226) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.82% (5.4972 => 5.1774, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.08% (5.1557 => 4.8939, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.42% (4.7449 => 4.5353, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.41% (2.8773 => 2.7505, std.dev.: 0.0156) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.42% (1.2822 => 1.2383, std.dev.: 0.0097) MultiSource/Applications/lua/lua: -3.33% (29.8330 => 28.8400, std.dev.: 0.0938) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.31% (0.5807 => 0.5615, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.98% (28.5821 => 27.7290, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.70% (2.6356 => 2.5644, std.dev.: 0.0106) MultiSource/Applications/aha/aha: -2.31% (3.3398 => 3.2627, std.dev.: 0.0147) MultiSource/Benchmarks/Olden/bisort/bisort: -2.29% (0.6636 => 0.6484, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.19% (9.9065 => 9.6899, std.dev.: 0.0604) SingleSource/Benchmarks/Shootout-C++/hash2: -2.18% (3.4237 => 3.3492, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.98% (11.5316 => 11.3028, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.73% (3.2169 => 3.1612, std.dev.: 0.0179) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.63% (2.3487 => 2.3104, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.56% (4.9994 => 4.9212, std.dev.: 0.0291) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.15% (5.6343 => 5.5697, std.dev.: 0.0089) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.02% (1.0262 => 1.0675, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.45% (0.0408 => 0.0418, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.50% (0.0254 => 0.0334, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.71% (0.1438 => 0.1477, std.dev.: 0.0082) MultiSource/Applications/lemon/lemon: 5.68% (1.1329 => 1.1973, std.dev.: 0.0093) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.07% (0.4164 => 0.4161, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.94% (0.1369 => 0.1464, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.39% (0.0641 => 0.0568, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.51% (0.0195 => 0.0196, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.61% (0.0578 => 0.0622, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.29% (1.1437 => 1.1928, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2800.00% (0.0001 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.16% (0.0627 => 0.0557, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 27.78% (0.0180 => 0.0230, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.28% (0.8017 => 0.7834, std.dev.: 0.0251) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -33.87% (0.0062 => 0.0041, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 24 13:11:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 15:11:36 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121124211136.165742A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6212?compare_to=6208&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6212, Order: 168546, Start Time: 2012-11-24 19:38:28, End Time: 2012-11-24 21:12:05 To: 6208, Order: 168545, Start Time: 2012-11-24 17:42:25, End Time: 2012-11-24 19:15:38 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (184 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (853 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.99% (54.3789 => 56.5497, std.dev.: 0.0751) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.62% (54.5751 => 56.5497, std.dev.: 0.0751) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1006, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/salsa20: 2.29% (7.4937 => 7.6650, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/hash2: 1.97% (3.1932 => 3.2560, std.dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.83% (0.3821 => 0.3522, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -7.21% (0.3812 => 0.3537, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.18% (0.3884 => 0.3605, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -7.16% (0.3896 => 0.3617, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -7.15% (0.3848 => 0.3573, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -7.13% (0.3831 => 0.3558, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -7.11% (0.3880 => 0.3604, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.99% (0.3891 => 0.3619, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.97% (0.4033 => 0.3752, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -6.90% (0.4176 => 0.3888, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.84% (0.3142 => 0.2927, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.67% (0.3357 => 0.3133, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -6.67% (0.4199 => 0.3919, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.55% (0.9542 => 0.8917, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -6.53% (2.4924 => 2.3297, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: -6.40% (0.4280 => 0.4006, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.33% (0.2355 => 0.2206, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.26% (0.2428 => 0.2276, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.25% (0.6484 => 0.6079, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -6.20% (0.2160 => 0.2026, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -6.15% (9.2283 => 8.6606, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.15% (0.3658 => 0.3433, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -6.11% (7.0961 => 6.6624, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.10% (0.7198 => 0.6759, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.07% (1.3722 => 1.2889, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.07% (0.9852 => 0.9254, std.dev.: 0.0049) MultiSource/Applications/JM/lencod/lencod: -6.04% (16.1920 => 15.2137, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.04% (1.0544 => 0.9907, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.03% (6.7716 => 6.3633, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -5.96% (0.1879 => 0.1767, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.95% (4.8161 => 4.5295, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -5.94% (0.9179 => 0.8634, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -5.90% (4.3330 => 4.0772, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.90% (0.1796 => 0.1690, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.90% (0.7919 => 0.7452, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.88% (1.2300 => 1.1577, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.83% (0.6293 => 0.5926, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.83% (4.8802 => 4.5959, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.82% (4.0323 => 3.7977, std.dev.: 0.0054) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.76% (1.6364 => 1.5422, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.75% (0.3931 => 0.3705, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.75% (4.5069 => 4.2479, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.74% (0.3016 => 0.2843, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.73% (3.5339 => 3.3313, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -5.73% (0.2985 => 0.2814, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.71% (1.4642 => 1.3806, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/05-eks/eks: -5.69% (0.4515 => 0.4258, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.69% (0.5591 => 0.5273, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.68% (0.5478 => 0.5167, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.68% (0.2695 => 0.2542) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.67% (0.5570 => 0.5254, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.67% (0.6736 => 0.6354, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.65% (0.3255 => 0.3071, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.65% (0.6052 => 0.5710, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.65% (0.5999 => 0.5660, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -5.64% (0.2659 => 0.2509, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.63% (0.6446 => 0.6083, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -5.62% (0.3025 => 0.2855, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.61% (0.5705 => 0.5385, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.60% (0.5925 => 0.5593, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.60% (0.3837 => 0.3622, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.60% (0.6230 => 0.5881, std.dev.: 0.0057) MultiSource/Applications/Burg/burg: -5.60% (1.2515 => 1.1814, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.60% (0.5857 => 0.5529, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.60% (0.3323 => 0.3137, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.59% (0.4916 => 0.4641, std.dev.: 0.0065) MultiSource/Applications/lemon/lemon: -5.59% (1.1450 => 1.0810, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.58% (0.6667 => 0.6295, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.57% (0.2871 => 0.2711, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.57% (0.4813 => 0.4545, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.57% (2.1713 => 2.0504, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.56% (0.4151 => 0.3920, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.56% (0.5863 => 0.5537, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -5.55% (0.3026 => 0.2858, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.55% (1.2784 => 1.2075, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/BoolLiteralTest: -5.53% (0.3834 => 0.3622, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.53% (0.3057 => 0.2888, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: -5.51% (0.3194 => 0.3018, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.51% (0.4321 => 0.4083, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.50% (0.8521 => 0.8052, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: -5.50% (1.1530 => 1.0896, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.49% (0.2548 => 0.2408, std.dev.: 0.0042) MultiSource/Benchmarks/sim/sim: -5.49% (0.3406 => 0.3219, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.49% (0.6194 => 0.5854, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.49% (0.2278 => 0.2153, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.48% (0.5802 => 0.5484, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.47% (0.6304 => 0.5959, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.47% (0.2999 => 0.2835, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.46% (0.5859 => 0.5539, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: -5.45% (1.3148 => 1.2431, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -5.45% (0.3581 => 0.3386, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.44% (0.2939 => 0.2779, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.44% (0.2903 => 0.2745, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.44% (1.2210 => 1.1546, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.44% (8.0126 => 7.5770, std.dev.: 0.0046) MultiSource/Applications/SPASS/SPASS: -5.43% (15.5079 => 14.6657, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.42% (0.2933 => 0.2774, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.42% (0.5575 => 0.5273, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.41% (0.5805 => 0.5491, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.41% (0.5456 => 0.5161, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -5.41% (0.2849 => 0.2695, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.39% (0.5849 => 0.5534, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.38% (0.5581 => 0.5281, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -5.37% (0.3481 => 0.3294, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.37% (0.5941 => 0.5622, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.37% (0.6297 => 0.5959, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.36% (0.3319 => 0.3141, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.35% (0.3252 => 0.3078, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.34% (14.2083 => 13.4502, std.dev.: 0.0228) SingleSource/Benchmarks/Shootout-C++/wc: -5.34% (0.3205 => 0.3034, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -5.32% (0.2989 => 0.2830, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.32% (0.6189 => 0.5860, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.30% (0.3849 => 0.3645, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -5.30% (0.3059 => 0.2897, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.29% (0.6260 => 0.5929, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.28% (0.3483 => 0.3299, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: -5.28% (1.3864 => 1.3132, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.27% (0.6681 => 0.6329, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.26% (1.2221 => 1.1578, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.26% (0.6660 => 0.6310, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -5.25% (0.3446 => 0.3265, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -5.23% (17.1032 => 16.2086, std.dev.: 0.0191) MultiSource/Applications/lua/lua: -5.21% (4.0594 => 3.8479, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.20% (0.6440 => 0.6105, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -5.19% (0.3394 => 0.3218, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -5.16% (0.3621 => 0.3434, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.16% (0.2385 => 0.2262, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -5.12% (0.3867 => 0.3669, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.12% (0.5688 => 0.5397, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.11% (0.6676 => 0.6335, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -5.09% (3.5154 => 3.3363, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/moments: -5.08% (0.4248 => 0.4032, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -5.07% (2.4021 => 2.2802, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.07% (0.5168 => 0.4906, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: -5.06% (0.4861 => 0.4615, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -5.04% (0.7447 => 0.7072, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.01% (0.6033 => 0.5731, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -4.97% (0.4524 => 0.4299, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -4.96% (15.2527 => 14.4955, std.dev.: 0.0095) MultiSource/Benchmarks/McCat/09-vor/vor: -4.95% (0.3271 => 0.3109, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.93% (0.7339 => 0.6977, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.90% (22.4056 => 21.3075, std.dev.: 0.0115) MultiSource/Applications/lambda-0_1_3/lambda: -4.90% (0.7982 => 0.7591, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.89% (0.2106 => 0.2003, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.87% (0.4083 => 0.3884, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.86% (0.4427 => 0.4212, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.86% (1.6474 => 1.5674, std.dev.: 0.0062) MultiSource/Applications/treecc/treecc: -4.77% (2.1401 => 2.0380, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.77% (0.9077 => 0.8644, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.76% (0.7524 => 0.7166, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: -4.75% (0.3788 => 0.3608, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.72% (0.6395 => 0.6093, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.72% (0.9557 => 0.9106, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: -4.70% (0.8418 => 0.8022, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: -4.68% (18.2933 => 17.4363, std.dev.: 0.0044) MultiSource/Applications/oggenc/oggenc: -4.66% (5.0226 => 4.7885, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.64% (0.7021 => 0.6695, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -4.56% (0.6441 => 0.6147, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.56% (0.5329 => 0.5086, std.dev.: 0.0062) SingleSource/UnitTests/ObjC++/property-reference: -4.55% (0.7779 => 0.7425, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -4.55% (34.0927 => 32.5428, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.51% (0.5567 => 0.5316, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.47% (0.6395 => 0.6109, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -4.43% (0.6347 => 0.6066, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.42% (0.5569 => 0.5323, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -4.41% (0.6750 => 0.6452, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.39% (0.2277 => 0.2177, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.37% (2.2587 => 2.1599, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.30% (0.3491 => 0.3341, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: -4.13% (1.5610 => 1.4965, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.65% (5.4682 => 5.2685, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -2.20% (20.7746 => 20.3174, std.dev.: 0.0312) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7535, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -8.68% (1.2842 => 1.1727, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.99% (2.2633 => 2.1731, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7060, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.47% (6.5735 => 6.4768, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 24 15:06:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 17:06:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121124230631.1AF1F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6213?compare_to=6209&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6213, Order: 168546, Start Time: 2012-11-24 20:46:48, End Time: 2012-11-24 23:06:57 To: 6209, Order: 168543, Start Time: 2012-11-24 17:29:52, End Time: 2012-11-24 19:49:52 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 78 (192 on baseline) Performance Improvements: 15 (39 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 993 (654 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 14.66% (0.1173 => 0.1345, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.43% (0.6404 => 0.7328, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 14.39% (0.7190 => 0.8225, std.dev.: 0.0314) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.32% (0.6154 => 0.7035, std.dev.: 0.0218) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.86% (0.6126 => 0.6975, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 13.82% (0.5759 => 0.6555, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 13.51% (0.6611 => 0.7504, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.32% (0.4182 => 0.4739, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C++/office/office: 12.87% (0.3379 => 0.3814, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 12.78% (0.7316 => 0.8251, std.dev.: 0.0174) MultiSource/Applications/lambda-0_1_3/lambda: 12.76% (0.8535 => 0.9624, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 12.04% (0.5880 => 0.6588, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.79% (0.6573 => 0.7348, std.dev.: 0.0083) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.58% (0.1183 => 0.1320, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.50% (0.3696 => 0.4121, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.27% (1.4720 => 1.6379, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 11.22% (1.5635 => 1.7390, std.dev.: 0.0205) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.04% (1.3126 => 1.4575, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 10.56% (4.5992 => 5.0851, std.dev.: 0.1268) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.17% (1.5835 => 1.7446, std.dev.: 0.0123) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.06% (0.1710 => 0.1882, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.79% (0.2237 => 0.2456, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.72% (0.5217 => 0.5724, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.36% (0.6851 => 0.7492, std.dev.: 0.0169) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.03% (0.9083 => 0.9903, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.95% (0.6692 => 0.7291, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.61% (0.2405 => 0.2612, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.60% (2.2562 => 2.4503, std.dev.: 0.0675) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.27% (0.7840 => 0.8488, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.06% (5.6470 => 6.1021, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.01% (0.3907 => 0.4220, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.67% (0.7161 => 0.7710, std.dev.: 0.0180) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.60% (0.1907 => 0.2052, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.48% (5.0273 => 5.4031, std.dev.: 0.0235) MultiSource/Applications/siod/siod: 7.34% (2.7500 => 2.9518, std.dev.: 0.0508) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.30% (0.9532 => 1.0228, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 7.14% (0.9840 => 1.0543, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.96% (0.6554 => 0.7010, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 6.75% (1.3829 => 1.4763, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.58% (1.7399 => 1.8543, std.dev.: 0.0237) MultiSource/Applications/lemon/lemon: 6.41% (1.2816 => 1.3637, std.dev.: 0.0096) MultiSource/Applications/JM/ldecod/ldecod: 6.38% (9.2450 => 9.8346, std.dev.: 0.1650) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 5.87% (0.1824 => 0.1931, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.73% (0.6438 => 0.6807, std.dev.: 0.0140) MultiSource/Benchmarks/McCat/05-eks/eks: 5.67% (0.4763 => 0.5033, std.dev.: 0.0083) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.14% (0.3327 => 0.3498, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.98% (17.0852 => 17.9360, std.dev.: 0.1015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.81% (0.3433 => 0.3598, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.79% (1.5884 => 1.6645, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.29% (0.5036 => 0.5252, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 3.53% (0.8071 => 0.8356, std.dev.: 0.0106) MultiSource/Applications/sgefa/sgefa: 3.28% (0.3747 => 0.3870, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.26% (20.6172 => 21.2884, std.dev.: 0.1255) MultiSource/Benchmarks/PAQ8p/paq8p: 3.18% (11.2622 => 11.6205, std.dev.: 0.0561) MultiSource/Applications/SPASS/SPASS: 2.76% (18.1816 => 18.6826, std.dev.: 0.1439) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.49% (0.6660 => 0.6826, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 27.46% (1.3180 => 1.6799, std.dev.: 0.0473) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.99% (0.3446 => 0.4307, std.dev.: 0.0162) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.66% (1.5566 => 1.9094, std.dev.: 0.0354) MultiSource/Applications/minisat/minisat: 20.52% (10.2437 => 12.3456, std.dev.: 0.2377) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.17% (1.7524 => 1.9307, std.dev.: 0.0661) MultiSource/Applications/lemon/lemon: 9.37% (1.4371 => 1.5718, std.dev.: 0.0081) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.08% (9.4478 => 10.1163, std.dev.: 0.0132) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.75% (1.5421 => 1.6154, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 3.66% (3.1817 => 3.2982, std.dev.: 0.0240) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.59% (0.3234 => 0.3350, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.75% (4.3898 => 4.5104, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.17% (4.2612 => 4.3536, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.92% (7.2776 => 7.4170, std.dev.: 0.0087) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.80% (2.3081 => 2.3496, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 1.56% (10.2580 => 10.4180, std.dev.: 0.0240) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.44% (48.2764 => 48.9698, std.dev.: 0.0350) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.42% (4.8112 => 4.8796, std.dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: 1.39% (4.7260 => 4.7916, std.dev.: 0.0089) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.10% (2.1836 => 2.2077, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 1.09% (27.2188 => 27.5145, std.dev.: 0.0675) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.07% (5.0810 => 5.1355, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.06% (5.6755 => 5.7356, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.89% (0.2952 => 0.2660, std.dev.: 0.0031) SingleSource/UnitTests/2006-12-11-LoadConstants: -8.75% (0.1440 => 0.1314, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -8.18% (0.7241 => 0.6649, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: -8.16% (0.1667 => 0.1531, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -7.82% (0.6739 => 0.6212, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -7.77% (0.3862 => 0.3562, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.00% (0.6214 => 0.5903, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -4.97% (1.1650 => 1.1071, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.19% (4.8820 => 4.6776, std.dev.: 0.0100) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.89% (8.2458 => 7.9251, std.dev.: 0.1106) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.40% (4.8434 => 4.6788, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/SPASS/SPASS: -13.92% (14.1943 => 12.2184, std.dev.: 0.7251) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.74% (8.9647 => 8.4501, std.dev.: 0.1064) MultiSource/Applications/JM/lencod/lencod: -3.30% (7.8560 => 7.5970, std.dev.: 0.0902) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5639 => 2.5246, std.dev.: 0.0150) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.02% (69.2309 => 69.2156, std.dev.: 0.0960) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 1.19% (0.1347 => 0.1363, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.48% (0.0420 => 0.0418, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.29% (0.0652 => 0.0680, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -0.03% (493.9774 => 493.8494, std.dev.: 0.2078) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.44% (63.2438 => 69.2156, std.dev.: 0.0960) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43692.62% (1.1277 => 493.8494, std.dev.: 0.2078) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 196.00% (0.5229 => 1.5478, std.dev.: 0.0966) MultiSource/Applications/SPASS/SPASS: 24.64% (14.9895 => 18.6826, std.dev.: 0.1439) MultiSource/Applications/kimwitu++/kc: 46.82% (14.1553 => 20.7832, std.dev.: 0.2314) MultiSource/Benchmarks/MallocBench/gs/gs: 19.58% (4.1105 => 4.9152, std.dev.: 0.1266) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 50.66% (1.1048 => 1.6645, std.dev.: 0.0139) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 433.96% (7.1582 => 38.2220, std.dev.: 0.2006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 75.53% (3.4629 => 6.0783, std.dev.: 0.3109) SingleSource/Benchmarks/Misc-C++/stepanov_container: 86.05% (0.6222 => 1.1576, std.dev.: 0.0054) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10451.39% (0.0720 => 7.5970, std.dev.: 0.0902) MultiSource/Applications/SIBsim4/SIBsim4: 3944800.00% (0.0001 => 3.9449, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 12218300.00% (0.0001 => 12.2184, std.dev.: 0.7251) MultiSource/Applications/kimwitu++/kc: 53600.00% (0.0001 => 0.0537, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 64000.00% (0.0001 => 0.0641, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14500.00% (0.0001 => 0.0146, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576700.00% (0.0001 => 0.5768, std.dev.: 0.0212) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10092900.00% (0.0001 => 10.0930, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6851300.00% (0.0001 => 6.8514, std.dev.: 0.3572) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1801.77% (1.1194 => 21.2884, std.dev.: 0.1255) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 73.06% (2.9384 => 5.0851, std.dev.: 0.1268) MultiSource/Applications/ClamAV/clamscan: 70.18% (22.1758 => 37.7386, std.dev.: 0.3626) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 52.97% (7.0540 => 10.7902, std.dev.: 0.0582) SingleSource/Benchmarks/Misc/flops: 49.37% (0.1432 => 0.2139, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 48.91% (8.1363 => 12.1161, std.dev.: 0.1245) MultiSource/Applications/JM/lencod/lencod: 46.84% (21.9371 => 32.2133, std.dev.: 0.0574) MultiSource/Benchmarks/FreeBench/distray/distray: 44.98% (0.1056 => 0.1531, std.dev.: 0.0000) SingleSource/UnitTests/vla: 39.15% (0.0355 => 0.0494, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/almabench: 38.63% (0.0730 => 0.1012, std.dev.: 0.0063) MultiSource/Benchmarks/Fhourstones/fhourstones: 33.46% (0.1566 => 0.2090, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 33.26% (0.2700 => 0.3598, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.04% (0.1236 => 0.1632, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/family/family: 30.23% (0.0397 => 0.0517, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.98% (1.5859 => 2.0614, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/n-body: 29.76% (0.0746 => 0.0968, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 29.55% (0.1584 => 0.2052, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 29.48% (0.7433 => 0.9624, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/bigfib: 29.43% (0.6456 => 0.8356, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 28.83% (0.1044 => 0.1345, std.dev.: 0.0037) MultiSource/Applications/Burg/burg: 28.55% (1.1642 => 1.4966, std.dev.: 0.0133) MultiSource/Applications/siod/siod: 28.51% (2.2969 => 2.9518, std.dev.: 0.0508) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 28.36% (0.0730 => 0.0937, std.dev.: 0.0054) MultiSource/Applications/minisat/minisat: 28.35% (0.7115 => 0.9132, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 27.98% (0.0672 => 0.0860, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.65% (0.0528 => 0.0674, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/life/life: 27.55% (0.0933 => 0.1190, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 27.45% (0.1151 => 0.1467, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 27.19% (1.0722 => 1.3637, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.93% (0.5105 => 0.6480, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 26.88% (0.4103 => 0.5206, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: 26.70% (4.2646 => 5.4031, std.dev.: 0.0235) MultiSource/Benchmarks/Ptrdist/ft/ft: 26.60% (0.1940 => 0.2456, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.51% (0.0479 => 0.0606, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 26.51% (0.2554 => 0.3231, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 26.49% (0.2065 => 0.2612, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.48% (0.0793 => 0.1003, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 25.88% (0.5569 => 0.7010, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/17-bintr/bintr: 25.63% (0.0675 => 0.0848, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.58% (0.1032 => 0.1296, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 25.51% (1.3050 => 1.6379, std.dev.: 0.0144) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.38% (0.0457 => 0.0573, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.28% (0.0886 => 0.1110, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 25.17% (0.0437 => 0.0547, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.16% (0.8172 => 1.0228, std.dev.: 0.0019) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 25.05% (0.0467 => 0.0584, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 24.84% (14.3668 => 17.9360, std.dev.: 0.1015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 24.74% (0.3650 => 0.4553, std.dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 24.69% (1.1840 => 1.4763, std.dev.: 0.0153) MultiSource/Benchmarks/Ptrdist/ks/ks: 24.64% (0.1510 => 0.1882, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 24.61% (0.0447 => 0.0557, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.54% (0.0648 => 0.0807, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 24.48% (0.3109 => 0.3870, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.47% (0.0842 => 0.1048, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 24.03% (0.4615 => 0.5724, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 23.86% (0.3826 => 0.4739, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 23.70% (0.1114 => 0.1378, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 23.47% (0.1125 => 0.1389, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: 23.42% (0.0871 => 0.1075, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 23.40% (4.9449 => 6.1021, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 23.28% (0.1117 => 0.1377, std.dev.: 0.0025) SingleSource/Benchmarks/Stanford/Oscar: 23.27% (0.0636 => 0.0784, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 22.88% (1.1861 => 1.4575, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 22.64% (0.3441 => 0.4220, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 22.59% (1.4186 => 1.7390, std.dev.: 0.0205) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 22.53% (0.6675 => 0.8179, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 22.33% (0.3162 => 0.3868, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/hash: 22.27% (0.0485 => 0.0593, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 22.26% (5.7591 => 7.0409, std.dev.: 0.1282) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 22.24% (0.8101 => 0.9903, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/office/office: 21.62% (0.3136 => 0.3814, std.dev.: 0.0098) MultiSource/Benchmarks/BitBench/drop3/drop3: 21.58% (0.0482 => 0.0586, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.00% (0.1062 => 0.1285, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/perlin: 20.90% (0.0536 => 0.0648, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 20.29% (1.5415 => 1.8543, std.dev.: 0.0237) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 20.25% (0.3427 => 0.4121, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 20.21% (0.4289 => 0.5156, std.dev.: 0.0134) MultiSource/Benchmarks/Olden/tsp/tsp: 20.17% (0.1175 => 0.1412, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.96% (2.2024 => 2.6421, std.dev.: 0.1038) MultiSource/Benchmarks/VersaBench/bmm/bmm: 19.76% (0.0759 => 0.0909, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 19.46% (0.4620 => 0.5519, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.37% (0.1337 => 0.1596, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.87% (0.6450 => 0.7667, std.dev.: 0.0220) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 18.83% (0.1625 => 0.1931, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 18.57% (2.0665 => 2.4503, std.dev.: 0.0675) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.57% (0.0770 => 0.0913, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/football/football: 18.18% (0.8921 => 1.0543, std.dev.: 0.0154) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0704 => 0.0832, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 18.11% (0.2905 => 0.3431, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/ReedSolomon: 18.11% (0.2049 => 0.2420, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.87% (5.0018 => 5.8958, std.dev.: 0.1291) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.81% (0.5981 => 0.7046, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 17.50% (0.0640 => 0.0752, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 17.40% (0.0592 => 0.0695, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 17.39% (0.3180 => 0.3733, std.dev.: 0.0099) SingleSource/UnitTests/SignlessTypes/rem: 17.31% (0.1144 => 0.1342, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hello: 17.24% (0.2714 => 0.3182, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.17% (0.0798 => 0.0935, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 17.07% (0.4299 => 0.5033, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/lists: 16.39% (0.3422 => 0.3983, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout/lists: 16.29% (0.0626 => 0.0728, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 16.20% (0.2877 => 0.3343, std.dev.: 0.0115) MultiSource/Benchmarks/Olden/mst/mst: 15.91% (0.1163 => 0.1348, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 15.69% (0.1695 => 0.1961, std.dev.: 0.0058) MultiSource/Applications/lua/lua: 15.60% (3.8723 => 4.4763, std.dev.: 0.1692) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.53% (0.0953 => 0.1101, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/messages-2: 15.41% (0.0662 => 0.0764, std.dev.: 0.0036) MultiSource/Applications/viterbi/viterbi: 15.05% (0.1555 => 0.1789, std.dev.: 0.0073) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.96% (0.1143 => 0.1314, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.94% (0.0770 => 0.0885, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.79% (0.2758 => 0.3166, std.dev.: 0.0106) MultiSource/Benchmarks/NPB-serial/is/is: 14.60% (0.0719 => 0.0824, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.51% (0.0834 => 0.0955, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 14.22% (0.7835 => 0.8949, std.dev.: 0.0245) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3121 => 0.3562, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.61% (0.1029 => 0.1169, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.53% (0.5860 => 0.6653, std.dev.: 0.0185) SingleSource/UnitTests/ObjC/parameter-passing: 13.45% (0.3927 => 0.4455, std.dev.: 0.0107) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.39% (0.2271 => 0.2575, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.37% (0.9765 => 1.1071, std.dev.: 0.0067) MultiSource/Benchmarks/mafft/pairlocalalign: 13.33% (9.4845 => 10.7490, std.dev.: 0.1970) SingleSource/UnitTests/ObjC/property: 13.30% (0.3886 => 0.4403, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/heapsort: 13.27% (0.2872 => 0.3253, std.dev.: 0.0074) SingleSource/UnitTests/ObjC/trivial-interface: 13.10% (0.3473 => 0.3928, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/exceptions-2: 13.07% (0.3497 => 0.3954, std.dev.: 0.0138) SingleSource/UnitTests/ObjC/exceptions-4: 13.07% (0.3543 => 0.4006, std.dev.: 0.0104) MultiSource/Applications/sqlite3/sqlite3: 13.06% (17.1811 => 19.4245, std.dev.: 0.0897) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.04% (0.3543 => 0.4005, std.dev.: 0.0086) SingleSource/UnitTests/ObjC/synchronized: 12.89% (0.3561 => 0.4020, std.dev.: 0.0090) SingleSource/UnitTests/ObjC/exceptions-3: 12.88% (0.3516 => 0.3969, std.dev.: 0.0144) SingleSource/UnitTests/ObjC/exceptions: 12.83% (0.3828 => 0.4319, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/moments: 12.77% (0.4048 => 0.4565, std.dev.: 0.0197) SingleSource/UnitTests/ObjC/for-in: 12.53% (0.3694 => 0.4157, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.39% (0.5020 => 0.5642, std.dev.: 0.0188) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.26% (0.3865 => 0.4339, std.dev.: 0.0142) MultiSource/Benchmarks/PAQ8p/paq8p: 12.09% (10.3673 => 11.6205, std.dev.: 0.0561) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.75% (0.8067 => 0.9015, std.dev.: 0.0240) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.33% (0.1906 => 0.2122, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 11.10% (0.3603 => 0.4003, std.dev.: 0.0132) MultiSource/Applications/hbd/hbd: 10.87% (1.5603 => 1.7299, std.dev.: 0.0658) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.62% (0.1892 => 0.2093, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 10.38% (0.6030 => 0.6656, std.dev.: 0.0137) SingleSource/UnitTests/ObjC++/Hello: 10.35% (0.5925 => 0.6538, std.dev.: 0.0135) SingleSource/UnitTests/ObjC/block-byref-aggr: 10.14% (0.3817 => 0.4204, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.10% (0.3177 => 0.3498, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference: 10.07% (0.7326 => 0.8064, std.dev.: 0.0163) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.94% (0.1438 => 0.1581, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 9.74% (0.3387 => 0.3717, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.65% (0.2756 => 0.3022, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.47% (0.2430 => 0.2660, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 8.92% (1.2842 => 1.3987, std.dev.: 0.0365) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.65% (0.4879 => 0.5252, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 149.59% (4.3953 => 10.9704, std.dev.: 0.0360) SingleSource/Benchmarks/Shootout-C++/methcall: 147.28% (5.3999 => 13.3527, std.dev.: 0.0158) MultiSource/Applications/minisat/minisat: 35.43% (9.1159 => 12.3456, std.dev.: 0.2377) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 32.28% (0.3256 => 0.4307, std.dev.: 0.0162) MultiSource/Benchmarks/Ptrdist/ft/ft: 30.85% (1.2838 => 1.6799, std.dev.: 0.0473) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.57% (1.5086 => 1.9094, std.dev.: 0.0354) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.94% (1.1145 => 1.3144, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.65% (13.4384 => 15.8099, std.dev.: 0.1504) SingleSource/Benchmarks/Misc/oourafft: 17.64% (6.6465 => 7.8192, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 16.54% (8.6802 => 10.1163, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 16.09% (0.0864 => 0.1003, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.94% (0.2944 => 0.3325, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash2: 12.77% (3.1578 => 3.5612, std.dev.: 0.0445) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.61% (2.8904 => 3.2261, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/richards_benchmark: 10.14% (1.1396 => 1.2552, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.36% (1.7254 => 1.8869, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.12% (0.3070 => 0.3350, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 8.70% (1.4460 => 1.5718, std.dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.84% (4.2280 => 4.4751, std.dev.: 0.0037) MultiSource/Applications/lua/lua: 5.45% (26.0924 => 27.5145, std.dev.: 0.0675) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.10% (0.3540 => 0.3685, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 4.07% (11.6436 => 12.1175, std.dev.: 0.0077) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 3.18% (4.6441 => 4.7916, std.dev.: 0.0089) MultiSource/Applications/sgefa/sgefa: 3.10% (0.6223 => 0.6416, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.05% (2.1424 => 2.2077, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/heapsort: 2.70% (3.8526 => 3.9566, std.dev.: 0.0380) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.13% (1.3677 => 1.3968, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 2.04% (3.1595 => 3.2240, std.dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/dry: 1.96% (2.4116 => 2.4589, std.dev.: 0.0077) MultiSource/Benchmarks/PAQ8p/paq8p: 1.89% (85.0658 => 86.6753, std.dev.: 0.0283) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.56% (2.3135 => 2.3496, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.47% (6.5088 => 6.6048, std.dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: 1.45% (27.8444 => 28.2487, std.dev.: 0.0354) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0505, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1673, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.85% (5.2763 => 1.2212, std.dev.: 0.0234) SingleSource/Benchmarks/Misc/salsa20: -75.44% (0.8651 => 0.2125, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/richards_benchmark: -40.44% (0.1622 => 0.0966, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.14% (5.3855 => 4.6776, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.59% (5.3526 => 4.6788, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: -5.76% (10.4361 => 9.8346, std.dev.: 0.1650) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.31% (0.3987 => 0.2380, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.20% (4.5009 => 2.7817, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: -33.53% (1.1492 => 0.7639, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.17% (2.6546 => 2.0131, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/mason/mason: -19.30% (0.2161 => 0.1744, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4258, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2838, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.81% (32.5116 => 28.9982, std.dev.: 0.0208) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -10.52% (9.5636 => 8.5572, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.31% (1.5660 => 1.4358, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.94% (4.8142 => 4.4802, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.52% (3.2416 => 3.0626, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -5.08% (19.9488 => 18.9350, std.dev.: 0.3611) SingleSource/Benchmarks/Misc/flops-5: -4.61% (1.5835 => 1.5105, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -4.42% (6.2999 => 6.0212, std.dev.: 0.0098) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.87% (1.6805 => 1.6154, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.43% (0.9957 => 0.9615, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8914, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.58% (0.4808 => 0.4684, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.86% (8.1563 => 8.0043, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6775, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -1.54% (10.2830 => 10.1243, std.dev.: 0.0058) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.22% (0.1485 => 0.1363, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.86% (0.2116 => 0.0680, std.dev.: 0.0001) Report Time: 2.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 24 16:07:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 18:07:47 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121125000747.3C8692A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6214?compare_to=6210&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6214, Order: 168546, Start Time: 2012-11-24 20:47:24, End Time: 2012-11-25 00:08:16 To: 6210, Order: 168543, Start Time: 2012-11-24 16:37:24, End Time: 2012-11-24 19:59:00 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (168 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1090 (722 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 4.72% (0.2159 => 0.2261, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -18.56% (0.5270 => 0.4292, std.dev.: 0.0062) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.20% (0.0625 => 0.0895, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.30% (0.1063 => 0.1417, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.73% (0.2969 => 0.3733, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.50% (0.1106 => 0.1388, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 25.36% (1.5932 => 1.9972, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.23% (0.4253 => 0.5326, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.43% (0.4139 => 0.5150, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.33% (0.4994 => 0.6209, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.81% (0.0714 => 0.0884, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.97% (0.5900 => 0.7255, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.92% (0.5000 => 0.6146, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.85% (0.0547 => 0.0672, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.60% (0.0584 => 0.0716, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.98% (0.1620 => 0.1976, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.74% (0.1021 => 0.1243, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.74% (0.0897 => 0.1092, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 21.54% (0.0599 => 0.0728, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.41% (0.1107 => 0.1344, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 20.46% (0.0948 => 0.1142, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.38% (0.0584 => 0.0703, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.22% (0.0633 => 0.0761, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.22% (0.1103 => 0.1326, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.08% (0.1549 => 0.1860, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.98% (0.3903 => 0.4683, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.94% (0.0642 => 0.0770, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.74% (0.1003 => 0.1201, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 19.73% (0.0821 => 0.0983, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.58% (0.1604 => 0.1918, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.46% (0.0822 => 0.0982, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 19.37% (0.0604 => 0.0721) MultiSource/Benchmarks/McCat/05-eks/eks: 19.27% (0.1619 => 0.1931, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.67% (0.1462 => 0.1735, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 18.37% (0.0947 => 0.1121, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.31% (0.2736 => 0.3237, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.20% (0.3890 => 0.4598, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.02% (0.2014 => 0.2377, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 17.90% (0.1218 => 0.1436, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.86% (1.3152 => 1.5501, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 17.52% (0.4029 => 0.4735, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.37% (0.1088 => 0.1277, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: 17.35% (0.5826 => 0.6837, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 17.22% (0.5889 => 0.6903, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 17.21% (0.1505 => 0.1764, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 17.19% (0.0698 => 0.0818, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.92% (0.2866 => 0.3351, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 16.82% (0.5546 => 0.6479, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 16.80% (1.8794 => 2.1951, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.51% (0.3271 => 0.3811, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.46% (0.1968 => 0.2292, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.42% (3.5627 => 4.1476, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.37% (1.6211 => 1.8864, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.34% (0.4658 => 0.5419, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 16.11% (1.0781 => 1.2518, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.10% (0.5026 => 0.5835, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.03% (0.1160 => 0.1346, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.73% (0.4361 => 0.5047, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 15.69% (0.1421 => 0.1644, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 15.67% (0.7171 => 0.8295, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 15.62% (0.9697 => 1.1212, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.62% (0.2875 => 0.3324, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.56% (4.4195 => 5.1071, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.55% (0.3930 => 0.4541, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 15.42% (0.1284 => 0.1482, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 15.40% (4.2109 => 4.8592, std.dev.: 0.0108) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.18% (2.7292 => 3.1434, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.08% (0.2738 => 0.3151, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 15.03% (0.9909 => 1.1398, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 15.01% (0.3004 => 0.3455, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.98% (1.9966 => 2.2957, std.dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 14.96% (0.2566 => 0.2950, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 14.93% (0.2780 => 0.3195, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 14.91% (0.2823 => 0.3244, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.86% (0.1090 => 0.1252, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 14.84% (0.2750 => 0.3158, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 14.82% (0.2813 => 0.3230, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.82% (1.9694 => 2.2613, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hello: 14.81% (0.2714 => 0.3116, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 14.79% (23.5202 => 26.9985, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/fibo: 14.75% (0.2725 => 0.3127, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 14.73% (0.2811 => 0.3225, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 14.69% (0.2729 => 0.3130, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 14.59% (0.2803 => 0.3212, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.58% (0.2792 => 0.3199, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.57% (0.2911 => 0.3335, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.54% (2.0673 => 2.3679, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wc: 14.50% (0.3096 => 0.3545, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.49% (0.3195 => 0.3658, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 14.49% (0.3258 => 0.3730, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 14.48% (0.3267 => 0.3740, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 14.41% (0.2075 => 0.2374, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.16% (0.3488 => 0.3982, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 13.99% (0.3317 => 0.3781, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.76% (0.3060 => 0.3481, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 13.72% (0.4146 => 0.4715, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 13.70% (1.4269 => 1.6224, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.62% (0.3362 => 0.3820, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.60% (0.3124 => 0.3549, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 13.56% (0.3348 => 0.3802, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 13.54% (0.3678 => 0.4176, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.50% (0.3460 => 0.3927, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.49% (0.3446 => 0.3911, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.48% (0.3442 => 0.3906, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.45% (0.3465 => 0.3931, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.43% (0.3469 => 0.3935, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.36% (0.3496 => 0.3963, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.35% (0.3282 => 0.3720, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 13.23% (0.3477 => 0.3937, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 13.18% (0.3726 => 0.4217, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 13.07% (0.3650 => 0.4127, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 13.07% (0.7875 => 0.8904, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.05% (0.3625 => 0.4098, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 12.90% (0.3643 => 0.4113, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 12.87% (0.4251 => 0.4798, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 12.83% (2.1653 => 2.4432, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.82% (0.3690 => 0.4163, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.81% (0.3724 => 0.4201, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.69% (0.3981 => 0.4486, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 12.61% (4.6177 => 5.1999, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.59% (0.3845 => 0.4329, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/bigfib: 12.39% (0.5012 => 0.5633, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 12.22% (2.1013 => 2.3580, std.dev.: 0.0069) MultiSource/Applications/SIBsim4/SIBsim4: 12.15% (0.2691 => 0.3018, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.96% (0.2040 => 0.2284, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 11.33% (5.5417 => 6.1698, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.30% (0.6435 => 0.7162, std.dev.: 0.0141) MultiSource/Applications/siod/siod: 10.70% (0.6634 => 0.7344, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 10.61% (0.3498 => 0.3869, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.57% (0.3084 => 0.3410, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.56% (0.1383 => 0.1529, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.54% (0.2068 => 0.2286, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.49% (0.2737 => 0.3024, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 10.34% (0.4847 => 0.5348, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 9.86% (0.3336 => 0.3665, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.75% (0.2103 => 0.2308, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 9.56% (2.0346 => 2.2292, std.dev.: 0.0092) MultiSource/Applications/lemon/lemon: 9.37% (0.2391 => 0.2615, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.78% (4.6926 => 5.1048, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.61% (11.6398 => 12.6417, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.51% (0.5361 => 0.5817, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.90% (0.7426 => 0.8013, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.86% (0.5584 => 0.6023, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 6.67% (11.9555 => 12.7524, std.dev.: 0.0114) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.03% (0.3792 => 0.3945, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 9.39% (0.2802 => 0.3065, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6098, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.14% (0.2122 => 0.2231, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6685, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-2: 4.86% (1.8057 => 1.8935, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1675, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: 4.25% (14.0481 => 14.6453, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1911, std.dev.: 0.0083) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2228, std.dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3006, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2855, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5142, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.01% (50.0626 => 50.5687, std.dev.: 0.0129) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.90% (2.4764 => 2.3799, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.73% (25.4195 => 16.5913, std.dev.: 0.0067) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9789, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7925, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary2: -5.87% (0.2402 => 0.2261, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7977, std.dev.: 0.0112) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.04% (0.6293 => 0.6102, std.dev.: 0.0057) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7728, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (17.2379 => 16.7842, std.dev.: 0.0262) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.25% (41.7953 => 40.8566, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5699, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4948, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1571, std.dev.: 0.0480) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0451, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 24 17:11:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 19:11:35 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121125011135.22DB22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6215?compare_to=6212&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6215, Order: 168548, Start Time: 2012-11-24 23:38:27, End Time: 2012-11-25 01:12:01 To: 6212, Order: 168546, Start Time: 2012-11-24 19:38:28, End Time: 2012-11-24 21:12:05 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (7 on baseline) Performance Improvements: 0 (184 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1090 (851 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.57% (1.2790 => 1.2991, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.36% (80.0582 => 81.1451, std.dev.: 0.3654) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.81% (54.5751 => 56.6548, std.dev.: 0.0656) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.80% (2.0478 => 2.1052, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/salsa20: 2.33% (7.4937 => 7.6681, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/hash2: 2.15% (3.1932 => 3.2617, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.79% (79.7170 => 81.1451, std.dev.: 0.3654) MultiSource/Benchmarks/llubenchmark/llu: 1.61% (3.7435 => 3.8036, std.dev.: 0.0171) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.09% (0.3821 => 0.3512, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.94% (0.3142 => 0.2924, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.85% (0.3884 => 0.3618, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -6.85% (0.3812 => 0.3551, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -6.84% (0.3831 => 0.3569, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -6.80% (0.3880 => 0.3616, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.76% (0.3357 => 0.3130, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -6.74% (0.4033 => 0.3761, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.70% (0.3848 => 0.3590, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.67% (0.3896 => 0.3636, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.65% (0.9542 => 0.8907, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -6.65% (2.4924 => 2.3267, std.dev.: 0.0125) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.63% (0.3891 => 0.3633, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.55% (0.2428 => 0.2269, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.47% (0.4176 => 0.3906, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -6.36% (0.4199 => 0.3932, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.34% (0.3658 => 0.3426, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.31% (0.6484 => 0.6075, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: -6.30% (0.2160 => 0.2024, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -6.28% (9.2283 => 8.6485, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.22% (0.9852 => 0.9239, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.20% (0.2355 => 0.2209, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: -6.17% (16.1920 => 15.1929, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.16% (1.0544 => 0.9895, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.14% (1.3722 => 1.2879, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.12% (0.1796 => 0.1686) MultiSource/Benchmarks/Prolangs-C/football/football: -6.10% (0.9179 => 0.8619, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: -6.09% (7.0961 => 6.6641, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/parameter-passing: -6.07% (0.4280 => 0.4020, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.04% (4.8161 => 4.5250, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -6.01% (0.1879 => 0.1766, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.01% (6.7716 => 6.3648, std.dev.: 0.0128) MultiSource/Benchmarks/MallocBench/gs/gs: -6.00% (4.3330 => 4.0730, std.dev.: 0.0094) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.94% (1.2300 => 1.1569, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.94% (1.6364 => 1.5392, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.90% (0.7198 => 0.6773, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.88% (4.0323 => 3.7954, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: -5.85% (0.1761 => 0.1658, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.85% (0.6293 => 0.5925, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: -5.83% (1.1530 => 1.0858, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.83% (4.8802 => 4.5959, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.81% (0.5591 => 0.5266, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.81% (3.5339 => 3.3285, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.81% (0.5478 => 0.5160, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.80% (0.5863 => 0.5523, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.75% (0.8521 => 0.8031, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: -5.75% (1.1450 => 1.0792, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.73% (0.7919 => 0.7465, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.73% (1.4642 => 1.3803, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.73% (0.6667 => 0.6285, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.73% (4.5069 => 4.2488, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.72% (0.3931 => 0.3706, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.72% (0.5857 => 0.5522, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.71% (0.2695 => 0.2541, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.70% (0.3016 => 0.2844, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -5.70% (1.2515 => 1.1802, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.70% (0.3406 => 0.3212, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.69% (0.3057 => 0.2883, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.69% (0.5570 => 0.5253, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.69% (0.2548 => 0.2403, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.69% (0.5925 => 0.5588, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.68% (0.6052 => 0.5708, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.68% (0.3837 => 0.3619, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: -5.68% (0.2659 => 0.2508, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/fibo: -5.68% (0.2871 => 0.2708, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.65% (0.5805 => 0.5477, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: -5.65% (0.4515 => 0.4260, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.65% (0.6446 => 0.6082, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.64% (0.5705 => 0.5383, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.63% (0.6736 => 0.6357, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.63% (0.5581 => 0.5267, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -5.62% (0.3255 => 0.3072, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -5.62% (0.3025 => 0.2855, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.62% (0.2278 => 0.2150, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.62% (0.6194 => 0.5846, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.62% (0.6230 => 0.5880, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.61% (0.6297 => 0.5944, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.60% (2.1713 => 2.0497, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -5.59% (0.2985 => 0.2818, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.59% (0.2933 => 0.2769, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.59% (0.5456 => 0.5151, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.59% (17.1032 => 16.1474, std.dev.: 0.0249) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.58% (0.2903 => 0.2741, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.58% (0.2939 => 0.2775, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.57% (0.3194 => 0.3016, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.57% (0.4813 => 0.4545, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wc: -5.55% (0.3205 => 0.3027, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.55% (1.2784 => 1.2074, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/except: -5.55% (0.3026 => 0.2858, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.53% (0.6260 => 0.5914, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.52% (0.6304 => 0.5956, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.51% (0.4916 => 0.4645, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.51% (14.2083 => 13.4251, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.51% (0.4321 => 0.4083, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.50% (0.5941 => 0.5614, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.50% (0.2999 => 0.2834, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.50% (0.5802 => 0.5483, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.49% (0.5849 => 0.5528, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.48% (0.5999 => 0.5670, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: -5.48% (0.2849 => 0.2693, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.47% (0.3252 => 0.3074, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.47% (0.5575 => 0.5270, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.47% (0.4151 => 0.3924, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -5.47% (1.3148 => 1.2429, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.46% (0.5859 => 0.5539, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.46% (0.6189 => 0.5851, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.45% (0.3323 => 0.3142, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -5.44% (15.5079 => 14.6637, std.dev.: 0.0177) MultiSource/Applications/SIBsim4/SIBsim4: -5.44% (1.3864 => 1.3110, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: -5.42% (0.2989 => 0.2827, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.42% (0.6681 => 0.6319, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.42% (8.0126 => 7.5785, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.40% (0.6440 => 0.6092, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -5.40% (0.3446 => 0.3260, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.39% (0.6660 => 0.6301, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.38% (0.3849 => 0.3642, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.37% (1.2210 => 1.1554, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.34% (0.5688 => 0.5384, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.33% (0.6676 => 0.6320, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -5.30% (0.3394 => 0.3214, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -5.30% (0.3059 => 0.2897, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.28% (0.2385 => 0.2259, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -5.25% (4.0594 => 3.8461, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.25% (0.3483 => 0.3300, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -5.25% (0.7447 => 0.7056, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.24% (0.3319 => 0.3145, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.24% (0.6033 => 0.5717, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.24% (1.2221 => 1.1581, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -5.22% (0.3581 => 0.3394, std.dev.: 0.0034) MultiSource/Applications/d/make_dparser: -5.19% (3.5154 => 3.3331, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/hash2: -5.18% (0.4861 => 0.4609, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -5.16% (2.4021 => 2.2781, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.09% (0.4083 => 0.3875, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.09% (0.5168 => 0.4905, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -5.08% (0.4248 => 0.4032, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -5.07% (15.2527 => 14.4798, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -5.06% (0.7982 => 0.7578, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.05% (22.4056 => 21.2733, std.dev.: 0.0209) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.05% (0.2001 => 0.1900, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -5.03% (0.3481 => 0.3306, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.99% (0.2106 => 0.2001, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.97% (0.7339 => 0.6974, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: -4.97% (0.3867 => 0.3675, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: -4.95% (0.3271 => 0.3109, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -4.95% (0.4524 => 0.4300, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -4.94% (0.3621 => 0.3442, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.93% (0.9557 => 0.9086, std.dev.: 0.0077) MultiSource/Applications/treecc/treecc: -4.87% (2.1401 => 2.0358, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.82% (1.6474 => 1.5680, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.81% (0.4427 => 0.4214, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.81% (0.6347 => 0.6042, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: -4.79% (18.2933 => 17.4171, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.78% (0.7524 => 0.7164, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.74% (0.8418 => 0.8019, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: -4.73% (0.3788 => 0.3609, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.71% (0.7021 => 0.6690, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.71% (0.6395 => 0.6094, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -4.70% (34.0927 => 32.4915, std.dev.: 0.0128) SingleSource/UnitTests/ObjC++/property-reference-object: -4.66% (0.6441 => 0.6141, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.64% (0.6395 => 0.6098, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.60% (0.5329 => 0.5084, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.58% (0.5567 => 0.5312, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: -4.58% (0.7779 => 0.7423, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.56% (0.5569 => 0.5315, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.51% (0.9077 => 0.8668, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -4.40% (0.6750 => 0.6453, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.39% (0.2277 => 0.2177, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -4.37% (1.5610 => 1.4928, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.33% (0.3491 => 0.3340, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.21% (5.0226 => 4.8110, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.20% (2.2587 => 2.1639, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.78% (5.4682 => 5.2614, std.dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -2.01% (20.7746 => 20.3572, std.dev.: 0.0325) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7538, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/richards_benchmark: -8.77% (1.2842 => 1.1716, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7067, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.68% (2.2633 => 2.1799, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4725, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 24 17:15:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 19:15:23 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121125011523.8121B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6216?compare_to=6211&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6216, Order: 168548, Start Time: 2012-11-24 23:35:31, End Time: 2012-11-25 01:15:51 To: 6211, Order: 168546, Start Time: 2012-11-24 19:21:05, End Time: 2012-11-24 20:50:51 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 11 (70 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1043 (884 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.76% (0.1327 => 0.1483, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 4.75% (0.3155 => 0.3305, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.21% (0.2706 => 0.2820, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.55% (0.5073 => 0.5253, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.91% (0.5946 => 0.6119, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.74% (5.4271 => 5.5216, std.dev.: 0.0216) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.71% (0.6308 => 0.6416, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 16.25% (0.7605 => 0.8841, std.dev.: 0.0288) SingleSource/Benchmarks/Misc/whetstone: 1.63% (2.1042 => 2.1384, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.26% (1.2684 => 1.2844, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.20% (4.3478 => 4.4000, std.dev.: 0.0072) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.11% (1.0675 => 1.0663, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.45% (0.0220 => 0.0221, std.dev.: 0.0076) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.15% (0.0418 => 0.0427, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.30% (0.0334 => 0.0333, std.dev.: 0.0066) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.96% (0.0312 => 0.0315, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.24% (0.0424 => 0.0425, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0204 => 0.0205, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: -15.98% (0.0219 => 0.0184, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.34% (0.1477 => 0.1482, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -6.25% (1.1973 => 1.1225, std.dev.: 0.0199) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.25% (0.4161 => 0.4109, std.dev.: 0.0346) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.05% (0.1464 => 0.1494, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 14.96% (0.0568 => 0.0653, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 36.73% (0.0196 => 0.0268, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.05% (0.0622 => 0.0641, std.dev.: 0.0132) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.53% (1.1928 => 1.1991, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -68.97% (0.0029 => 0.0009, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.10% (0.0557 => 0.0591, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.57% (0.0230 => 0.0252, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.26% (0.7834 => 0.7854, std.dev.: 0.0029) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: 500.00% (0.0001 => 0.0006, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 92.68% (0.0041 => 0.0079, std.dev.: 0.0048) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.33% (16.4461 => 17.6521, std.dev.: 0.1318) MultiSource/Applications/sqlite3/sqlite3: 2313.03% (0.6332 => 15.2793, std.dev.: 0.0991) MultiSource/Benchmarks/McCat/08-main/main: 43.26% (0.1831 => 0.2623, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.87% (0.1559 => 0.1483, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7210.47% (0.3123 => 22.8306, std.dev.: 0.4428) SingleSource/Benchmarks/CoyoteBench/fftbench: 52.17% (0.2463 => 0.3748, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1551.20% (0.3344 => 5.5216, std.dev.: 0.0216) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.52% (0.2364 => 0.3251, std.dev.: 0.0705) SingleSource/Benchmarks/Misc-C++/bigfib: 4.79% (0.6010 => 0.6298, std.dev.: 0.0193) SingleSource/Benchmarks/Misc/mandel: 0.93% (0.0429 => 0.0433, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.85% (0.3266 => 0.3457, std.dev.: 0.0970) SingleSource/Benchmarks/Shootout-C++/strcat: 3.66% (0.1969 => 0.2041, std.dev.: 0.0057) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.34% (0.0224 => 0.0227, std.dev.: 0.0020) SingleSource/UnitTests/byval-alignment: -25.22% (0.0230 => 0.0172, std.dev.: 0.0054) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0516, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 11.90% (0.1462 => 0.1636, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4602, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0694, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4944, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5136, std.dev.: 0.0125) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5229, std.dev.: 0.1182) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3157, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1375, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3626, std.dev.: 0.0425) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4103, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0883, std.dev.: 0.0075) SingleSource/Regression/C/uint64_to_float: -23.69% (2.1832 => 1.6660, std.dev.: 0.0033) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.91% (0.0810 => 0.0947, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.97% (0.0773 => 0.0881, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.61% (0.0830 => 0.0943, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 12.05% (0.1112 => 0.1246, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.91% (0.2279 => 0.2482, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.38% (0.4847 => 0.5253, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.34% (0.6010 => 0.6511, std.dev.: 0.0116) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.43% (0.2180 => 0.2342, std.dev.: 0.0020) MultiSource/Applications/viterbi/viterbi: 6.79% (0.1577 => 0.1684, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.47% (0.6287 => 0.6694, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.64% (0.3295 => 0.3481, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.62% (0.5961 => 0.6296, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.19% (0.5817 => 0.6119, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.87% (0.2240 => 0.2349, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.64% (0.2519 => 0.2636, std.dev.: 0.0027) MultiSource/Applications/treecc/treecc: 4.59% (1.9948 => 2.0864, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.48% (0.4127 => 0.4312, std.dev.: 0.0071) MultiSource/Applications/sgefa/sgefa: 4.43% (0.2999 => 0.3132, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.04% (2.1401 => 2.2266, std.dev.: 0.0278) MultiSource/Applications/SPASS/SPASS: 3.89% (14.2605 => 14.8151, std.dev.: 0.0318) MultiSource/Benchmarks/MallocBench/gs/gs: 3.76% (4.1305 => 4.2858, std.dev.: 0.0307) MultiSource/Applications/lua/lua: 3.75% (3.8189 => 3.9620, std.dev.: 0.0104) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.74% (0.3717 => 0.3856, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.48% (1.2526 => 1.2962, std.dev.: 0.0115) MultiSource/Benchmarks/McCat/18-imp/imp: 3.45% (0.3503 => 0.3624, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 3.40% (2.2184 => 2.2938, std.dev.: 0.0123) MultiSource/Applications/hbd/hbd: 3.36% (1.4269 => 1.4749, std.dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 3.33% (1.1271 => 1.1646, std.dev.: 0.0097) MultiSource/Applications/SIBsim4/SIBsim4: 3.17% (1.2568 => 1.2967, std.dev.: 0.0141) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.17% (1.1170 => 1.1524, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 3.16% (0.6834 => 0.7050, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.15% (4.4873 => 4.6286, std.dev.: 0.0162) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.04% (0.6227 => 0.6416, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.01% (1.5315 => 1.5776, std.dev.: 0.0171) MultiSource/Applications/d/make_dparser: 3.00% (3.2366 => 3.3337, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.74% (4.5702 => 4.6956, std.dev.: 0.0213) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.72% (8.6476 => 8.8825, std.dev.: 0.0842) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.37% (0.6586 => 0.6742, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.13% (4.4880 => 4.5837, std.dev.: 0.0275) MultiSource/Applications/lambda-0_1_3/lambda: 2.13% (0.7557 => 0.7718, std.dev.: 0.0046) MultiSource/Applications/lemon/lemon: 1.96% (1.0945 => 1.1159, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.60% (0.8995 => 0.9139, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 1.33% (4.9628 => 5.0286, std.dev.: 0.0227) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 121.61% (0.0199 => 0.0441, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/pi: 58.28% (1.5795 => 2.5001, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.56% (0.7597 => 0.8855, std.dev.: 0.0228) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.29% (2.9753 => 3.4599, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6089, std.dev.: 0.0334) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.04% (1.1857 => 1.2810, std.dev.: 0.0192) SingleSource/Benchmarks/Misc/richards_benchmark: 7.57% (1.3037 => 1.4024, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/queens: 7.46% (1.7056 => 1.8329, std.dev.: 0.0347) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.66% (4.7794 => 5.0977, std.dev.: 0.0148) MultiSource/Applications/SIBsim4/SIBsim4: 5.99% (3.1873 => 3.3781, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.78% (4.5327 => 4.7945, std.dev.: 0.0256) MultiSource/Applications/lambda-0_1_3/lambda: 5.23% (7.4933 => 7.8855, std.dev.: 0.0285) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.66% (6.2275 => 6.5177, std.dev.: 0.0330) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.22% (4.9453 => 5.1539, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.11% (1.2337 => 1.2844, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.06% (4.9469 => 5.1478, std.dev.: 0.0306) MultiSource/Applications/hexxagon/hexxagon: 3.83% (14.0064 => 14.5433, std.dev.: 0.0413) MultiSource/Applications/siod/siod: 3.08% (3.6643 => 3.7773, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.69% (8.2783 => 8.5006, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout/lists: 2.66% (7.3375 => 7.5325, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.31% (4.8660 => 4.9786, std.dev.: 0.0314) SingleSource/Benchmarks/Stanford/FloatMM: 1.54% (0.8807 => 0.8943, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 1.46% (1.2061 => 1.2237, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.39% (2.4647 => 2.4990, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ReedSolomon: 1.39% (8.5322 => 8.6509, std.dev.: 0.0457) MultiSource/Benchmarks/FreeBench/neural/neural: 1.32% (1.0841 => 1.0984, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.03% (4.3552 => 4.4000, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.30% (5.4641 => 4.3002, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.20% (7.2130 => 6.1885, std.dev.: 0.3369) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.69% (1.0512 => 0.9388, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.76% (14.6451 => 13.3624, std.dev.: 0.3171) MultiSource/Benchmarks/mafft/pairlocalalign: -8.46% (63.1822 => 57.8374, std.dev.: 0.1267) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.25% (0.3269 => 0.3032, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.87% (4.7482 => 4.4218, std.dev.: 0.0439) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.82% (5.4972 => 5.1771, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.05% (5.1557 => 4.8952, std.dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: -4.44% (21.9654 => 20.9906, std.dev.: 0.3693) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.40% (4.7449 => 4.5361, std.dev.: 0.0640) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.57% (2.8773 => 2.7747, std.dev.: 0.0295) MultiSource/Applications/lua/lua: -3.37% (29.8330 => 28.8276, std.dev.: 0.2319) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.19% (0.5807 => 0.5622, std.dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (28.5821 => 27.6923, std.dev.: 0.0630) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.66% (2.6356 => 2.5655, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/mason/mason: -2.42% (0.5415 => 0.5284, std.dev.: 0.0032) MultiSource/Applications/aha/aha: -2.37% (3.3398 => 3.2606, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (11.5316 => 11.2984, std.dev.: 0.0304) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.16% (5.6343 => 5.5690, std.dev.: 0.0107) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.91% (1.0262 => 1.0663, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 79.67% (0.0123 => 0.0221, std.dev.: 0.0076) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0066) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: 2.22% (0.0180 => 0.0184, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 3.06% (0.1438 => 0.1482, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -0.92% (1.1329 => 1.1225, std.dev.: 0.0199) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.32% (0.4164 => 0.4109, std.dev.: 0.0346) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.13% (0.1369 => 0.1494, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.87% (0.0641 => 0.0653, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 37.44% (0.0195 => 0.0268, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.90% (0.0578 => 0.0641, std.dev.: 0.0132) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.84% (1.1437 => 1.1991, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 800.00% (0.0001 => 0.0009, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.74% (0.0627 => 0.0591, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 40.00% (0.0180 => 0.0252, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.03% (0.8017 => 0.7854, std.dev.: 0.0029) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: 500.00% (0.0001 => 0.0006, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 27.42% (0.0062 => 0.0079, std.dev.: 0.0048) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 24 18:28:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 20:28:05 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121125022805.D93C72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6217?compare_to=6213&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6217, Order: 168548, Start Time: 2012-11-25 00:08:17, End Time: 2012-11-25 02:28:33 To: 6213, Order: 168546, Start Time: 2012-11-24 20:46:48, End Time: 2012-11-24 23:06:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 20 (137 on baseline) Performance Improvements: 9 (38 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1057 (710 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout-C++/random: 12.40% (0.3057 => 0.3436, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/objinst: 12.34% (0.3362 => 0.3777, std.dev.: 0.0045) SingleSource/Benchmarks/LivermoreLoops/kernel13: 11.27% (0.1083 => 0.1205, std.dev.: 0.0004) SingleSource/Benchmarks/LivermoreLoops/kernel14: 10.80% (0.1093 => 0.1211, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 9.26% (0.1101 => 0.1203, std.dev.: 0.0012) SingleSource/Benchmarks/LivermoreLoops/kernel15: 8.80% (0.1182 => 0.1286, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 8.41% (0.1487 => 0.1612, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.80% (0.5642 => 0.6082, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/sieve: 7.27% (0.4003 => 0.4294, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.14% (0.4339 => 0.4649, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.11% (0.3022 => 0.3237, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.88% (0.2093 => 0.2237, std.dev.: 0.0049) SingleSource/Benchmarks/Linpack/linpack-pc: 6.43% (0.2876 => 0.3061, std.dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/SPASS/SPASS: 24.43% (12.2184 => 15.2032, std.dev.: 0.8866) SingleSource/Benchmarks/Shootout/hash: 10.59% (4.9440 => 5.4678, std.dev.: 0.0306) SingleSource/Benchmarks/Misc/ffbench: 7.25% (0.9934 => 1.0654, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 5.36% (5.2223 => 5.5023, std.dev.: 0.0739) MultiSource/Applications/JM/lencod/lencod: 5.10% (7.5970 => 7.9841, std.dev.: 0.1046) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.47% (6.0824 => 6.2326, std.dev.: 0.0378) SingleSource/Benchmarks/Dhrystone/fldry: 1.92% (1.9404 => 1.9776, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/SPASS/SPASS: -3.70% (18.6826 => 17.9920, std.dev.: 0.1541) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -16.25% (0.1003 => 0.0840, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -11.09% (0.4624 => 0.4111, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -11.00% (10.4180 => 9.2718, std.dev.: 0.2962) MultiSource/Applications/minisat/minisat: -8.02% (12.3456 => 11.3552, std.dev.: 0.2786) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.15% (0.3350 => 0.3144, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -4.84% (0.2396 => 0.2280, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.66% (4.3536 => 4.2377, std.dev.: 0.0437) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.15% (2.2077 => 2.1823, std.dev.: 0.0098) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.12% (69.2156 => 69.2958, std.dev.: 0.3714) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -1.83% (0.1363 => 0.1338, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.42% (0.0418 => 0.0449, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0680 => 0.0681) MultiSource/Benchmarks/Olden/power/power: 0.03% (493.8494 => 494.0111, std.dev.: 0.2279) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.57% (63.2438 => 69.2958, std.dev.: 0.3714) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.98% (4.3882 => 0.0449, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43706.96% (1.1277 => 494.0111, std.dev.: 0.2279) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.11% (0.5229 => 1.5379, std.dev.: 0.1245) MultiSource/Applications/SPASS/SPASS: 20.03% (14.9895 => 17.9920, std.dev.: 0.1541) MultiSource/Applications/kimwitu++/kc: 47.01% (14.1553 => 20.8093, std.dev.: 0.3237) MultiSource/Benchmarks/MallocBench/gs/gs: 19.01% (4.1105 => 4.8918, std.dev.: 0.2351) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.90% (1.1048 => 1.5125, std.dev.: 0.0885) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 427.00% (7.1582 => 37.7239, std.dev.: 0.4819) SingleSource/Benchmarks/Misc-C++-EH/spirit: 78.04% (3.4629 => 6.1654, std.dev.: 0.3945) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.30% (0.6222 => 1.0347, std.dev.: 0.0763) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10989.03% (0.0720 => 7.9841, std.dev.: 0.1046) MultiSource/Applications/SIBsim4/SIBsim4: 3859400.00% (0.0001 => 3.8595, std.dev.: 0.0436) MultiSource/Applications/SPASS/SPASS: 15203100.00% (0.0001 => 15.2032, std.dev.: 0.8866) MultiSource/Applications/kimwitu++/kc: 52000.00% (0.0001 => 0.0521, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576400.00% (0.0001 => 0.5765, std.dev.: 0.0210) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10071600.00% (0.0001 => 10.0717, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5685300.00% (0.0001 => 5.6854, std.dev.: 0.9183) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1807.83% (1.1194 => 21.3563, std.dev.: 0.1651) MultiSource/Applications/ClamAV/clamscan: 69.19% (22.1758 => 37.5187, std.dev.: 0.4049) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 66.45% (2.9384 => 4.8909, std.dev.: 0.1738) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.20% (7.0540 => 10.8065, std.dev.: 0.3817) MultiSource/Applications/JM/lencod/lencod: 47.20% (21.9371 => 32.2905, std.dev.: 0.0805) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.83% (8.1363 => 11.9463, std.dev.: 0.2158) MultiSource/Benchmarks/FreeBench/distray/distray: 45.45% (0.1056 => 0.1536, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 38.06% (0.1432 => 0.1977, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/almabench: 37.95% (0.0730 => 0.1007, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 33.52% (0.1584 => 0.2115, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 31.52% (0.2554 => 0.3359, std.dev.: 0.0071) SingleSource/UnitTests/vla: 29.86% (0.0355 => 0.0461, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.73% (0.1125 => 0.1437, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/messages-2: 27.19% (0.0662 => 0.0842, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.14% (0.0479 => 0.0609, std.dev.: 0.0031) SingleSource/UnitTests/Vector/SSE/sse_shift: 26.98% (0.0378 => 0.0480, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.61% (0.0793 => 0.1004, std.dev.: 0.0055) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 26.23% (0.0953 => 0.1203, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 25.79% (0.1175 => 0.1478, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: 25.72% (0.0626 => 0.0787, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/17-bintr/bintr: 24.59% (0.0675 => 0.0841, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 24.53% (0.7433 => 0.9256, std.dev.: 0.0386) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 24.44% (0.4615 => 0.5743, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 24.43% (0.0479 => 0.0596, std.dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: 24.12% (0.0456 => 0.0566, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Oscar: 23.90% (0.0636 => 0.0788, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.73% (0.0746 => 0.0923, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.68% (0.8172 => 1.0107, std.dev.: 0.0120) MultiSource/Benchmarks/BitBench/five11/five11: 23.63% (0.0567 => 0.0701, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 23.17% (0.2905 => 0.3578, std.dev.: 0.0076) SingleSource/UnitTests/Vector/SSE/sse_isamax: 23.01% (0.0704 => 0.0866, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 22.63% (0.2802 => 0.3436, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 22.39% (1.4186 => 1.7362, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 22.18% (0.5569 => 0.6804, std.dev.: 0.0133) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.71% (0.1566 => 0.1906, std.dev.: 0.0115) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.67% (0.0886 => 0.1078, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/functionobjects: 21.16% (0.5020 => 0.6082, std.dev.: 0.0156) MultiSource/Applications/siod/siod: 21.12% (2.2969 => 2.7819, std.dev.: 0.1014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.66% (0.3441 => 0.4152, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/objinst: 20.63% (0.3131 => 0.3777, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 20.48% (4.2646 => 5.1379, std.dev.: 0.1084) SingleSource/Benchmarks/Shootout-C++/reversefile: 20.28% (0.3865 => 0.4649, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/mst/mst: 19.95% (0.1163 => 0.1395, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 19.89% (1.5415 => 1.8481, std.dev.: 0.0492) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.67% (0.1337 => 0.1600, std.dev.: 0.0034) MultiSource/Applications/viterbi/viterbi: 19.55% (0.1555 => 0.1859, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.42% (0.2271 => 0.2712, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.40% (0.1062 => 0.1268, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 19.35% (0.3427 => 0.4090, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sieve: 19.18% (0.3603 => 0.4294, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.67% (0.2700 => 0.3204, std.dev.: 0.0195) SingleSource/UnitTests/ObjC/exceptions: 18.65% (0.3828 => 0.4542, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/lists: 18.59% (0.3422 => 0.4058, std.dev.: 0.0103) MultiSource/Applications/treecc/treecc: 18.46% (2.0273 => 2.4016, std.dev.: 0.0812) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 18.23% (0.1892 => 0.2237, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.12% (0.6450 => 0.7619, std.dev.: 0.0232) MultiSource/Benchmarks/Prolangs-C/football/football: 17.88% (0.8921 => 1.0516, std.dev.: 0.0206) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.72% (14.3668 => 16.9129, std.dev.: 0.5664) SingleSource/UnitTests/ObjC/property: 17.58% (0.3886 => 0.4569, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.45% (0.2756 => 0.3237, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.34% (0.0842 => 0.0988, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/trivial-interface: 17.33% (0.3473 => 0.4075, std.dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.22% (0.0871 => 0.1021, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/parameter-passing: 16.93% (0.3927 => 0.4592, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.85% (0.5981 => 0.6989, std.dev.: 0.0230) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.85% (0.3543 => 0.4140, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/exceptions-2: 16.73% (0.3497 => 0.4082, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/exceptions-3: 16.52% (0.3516 => 0.4097, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/exceptions-4: 16.48% (0.3543 => 0.4127, std.dev.: 0.0093) SingleSource/UnitTests/ObjC/synchronized: 16.46% (0.3561 => 0.4147, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/em3d/em3d: 15.99% (0.1695 => 0.1966, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout/matrix: 15.77% (0.0818 => 0.0947, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.59% (0.2065 => 0.2387, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 15.41% (0.0798 => 0.0921, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/for-in: 15.40% (0.3694 => 0.4263, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.32% (0.0770 => 0.0888, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/health/health: 15.14% (0.1268 => 0.1460, std.dev.: 0.0064) MultiSource/Benchmarks/NPB-serial/is/is: 15.02% (0.0719 => 0.0827, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 14.92% (17.1811 => 19.7439, std.dev.: 0.3293) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.86% (0.1117 => 0.1283, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.82% (4.9449 => 5.6778, std.dev.: 0.1938) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.81% (0.0770 => 0.0884, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.75% (0.0834 => 0.0957, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.68% (0.2758 => 0.3163, std.dev.: 0.0144) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.48% (0.2107 => 0.2412, std.dev.: 0.0115) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.42% (0.3121 => 0.3571, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.19% (0.1029 => 0.1175, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/ffbench: 14.18% (0.0705 => 0.0805, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 14.12% (9.4845 => 10.8235, std.dev.: 0.3389) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.09% (0.3307 => 0.3773, std.dev.: 0.0177) MultiSource/Benchmarks/PAQ8p/paq8p: 13.83% (10.3673 => 11.8015, std.dev.: 0.1225) MultiSource/Applications/sgefa/sgefa: 13.61% (0.3109 => 0.3532, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.60% (0.5860 => 0.6657, std.dev.: 0.0292) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.15% (5.0018 => 5.6596, std.dev.: 0.2407) MultiSource/Benchmarks/Prolangs-C++/city/city: 13.13% (2.0665 => 2.3379, std.dev.: 0.0582) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.69% (0.2430 => 0.2714, std.dev.: 0.0110) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.49% (0.1906 => 0.2125, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.04% (0.3177 => 0.3496, std.dev.: 0.0096) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.12% (0.3817 => 0.4127, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.87% (0.4879 => 0.5214, std.dev.: 0.0112) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.11% (4.3953 => 10.9932, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/methcall: 147.43% (5.3999 => 13.3608, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/synchronized: 109.61% (0.1051 => 0.2203, std.dev.: 0.0409) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 32.31% (0.3256 => 0.4308, std.dev.: 0.0193) MultiSource/Applications/minisat/minisat: 24.56% (9.1159 => 11.3552, std.dev.: 0.2786) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.12% (1.5086 => 1.8423, std.dev.: 0.0913) SingleSource/Benchmarks/Misc/oourafft: 17.46% (6.6465 => 7.8068, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.64% (1.1145 => 1.2999, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.94% (0.2944 => 0.3325, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/ffbench: 12.09% (0.9505 => 1.0654, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.64% (2.8904 => 3.2268, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/hash: 11.39% (4.9088 => 5.4678, std.dev.: 0.0306) SingleSource/Benchmarks/Misc/richards_benchmark: 10.28% (1.1396 => 1.2568, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.20% (1.7254 => 1.8842, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 9.07% (1.4460 => 1.5771, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/mst/mst: 9.03% (0.1285 => 0.1401, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.81% (4.2280 => 4.4737, std.dev.: 0.0077) MultiSource/Applications/lua/lua: 5.11% (26.0924 => 27.4267, std.dev.: 0.1551) SingleSource/Regression/C/uint64_to_float: 5.08% (0.5413 => 0.5688, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 4.70% (3.1334 => 3.2807, std.dev.: 0.0284) MultiSource/Benchmarks/nbench/nbench: 4.07% (11.6436 => 12.1173, std.dev.: 0.0144) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: 2.48% (2.4116 => 2.4714, std.dev.: 0.0158) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 2.07% (3.1595 => 3.2249, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.86% (2.1424 => 2.1823, std.dev.: 0.0098) MultiSource/Benchmarks/PAQ8p/paq8p: 1.72% (85.0658 => 86.5269, std.dev.: 0.0889) MultiSource/Benchmarks/mafft/pairlocalalign: 1.60% (27.8444 => 28.2891, std.dev.: 0.0244) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.57% (6.5088 => 6.6108, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 1.55% (2.2771 => 2.3124, std.dev.: 0.0119) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0500, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.15% (5.2139 => 5.2739, std.dev.: 0.0085) SingleSource/Benchmarks/Dhrystone/fldry: 1.02% (1.9577 => 1.9776, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1675, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.86% (5.2763 => 1.2207, std.dev.: 0.0467) SingleSource/Benchmarks/Misc/salsa20: -75.62% (0.8651 => 0.2109, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/richards_benchmark: -44.76% (0.1622 => 0.0896, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.53% (5.3526 => 4.6818, std.dev.: 0.1623) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.14% (5.3855 => 4.7315, std.dev.: 0.1205) MultiSource/Applications/JM/ldecod/ldecod: -8.22% (10.4361 => 9.5781, std.dev.: 0.2807) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.31% (0.3987 => 0.2380, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.29% (4.5009 => 2.7776, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: -33.47% (1.1492 => 0.7646, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.15% (2.6546 => 2.0135, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -22.82% (32.5116 => 25.0940, std.dev.: 1.8599) MultiSource/Benchmarks/FreeBench/mason/mason: -19.25% (0.2161 => 0.1745, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4249, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2841, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -10.65% (1.5373 => 1.3736, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -9.45% (9.5636 => 8.6598, std.dev.: 0.1093) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4245, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.2416 => 3.0209, std.dev.: 0.0264) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.51% (19.9488 => 18.6500, std.dev.: 0.4434) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5791, std.dev.: 0.0331) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5758, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -4.58% (1.5835 => 1.5109, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -4.53% (6.2999 => 6.0147, std.dev.: 0.0128) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8914, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.10% (0.9957 => 0.9648, std.dev.: 0.0073) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.16% (0.4808 => 0.4704, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.76% (8.1563 => 8.0131, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: -1.53% (10.2830 => 10.1257, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.82% (0.2116 => 0.0681) Report Time: 2.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 24 19:07:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 21:07:53 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121125030753.C69842A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6218?compare_to=6215&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6218, Order: 168554, Start Time: 2012-11-25 01:35:02, End Time: 2012-11-25 03:08:22 To: 6215, Order: 168548, Start Time: 2012-11-24 23:38:27, End Time: 2012-11-25 01:12:01 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (185 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (852 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.47% (0.3690 => 0.3855, std.dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.16% (2.0478 => 2.1126, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/salsa20: 2.62% (7.4937 => 7.6903, std.dev.: 0.0176) SingleSource/Benchmarks/Shootout-C++/hash2: 2.06% (3.1932 => 3.2591, std.dev.: 0.0063) MultiSource/Benchmarks/llubenchmark/llu: 1.26% (3.7435 => 3.7906, std.dev.: 0.0153) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.39% (0.1431 => 0.1311, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.67% (0.3821 => 0.3528, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: -6.89% (0.3831 => 0.3567, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -6.85% (0.3896 => 0.3629, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -6.85% (0.3812 => 0.3551, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-3: -6.83% (0.3848 => 0.3585, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.82% (0.3884 => 0.3619, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.78% (0.3142 => 0.2929, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.78% (0.3880 => 0.3617, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -6.72% (0.4033 => 0.3762, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.63% (0.3891 => 0.3633, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -6.59% (0.4176 => 0.3901, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.57% (0.9542 => 0.8915, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.55% (0.3357 => 0.3137, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -6.48% (2.4924 => 2.3309, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -6.45% (0.4199 => 0.3928, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.43% (0.2428 => 0.2272, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: -6.25% (0.2160 => 0.2025, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.24% (0.2355 => 0.2208, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.15% (0.6484 => 0.6085, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: -6.12% (0.4280 => 0.4018, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.10% (9.2283 => 8.6653, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.07% (0.1796 => 0.1687, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.07% (0.3658 => 0.3436, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: -6.05% (16.1920 => 15.2117, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.05% (1.0544 => 0.9906, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.05% (4.8161 => 4.5249, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.03% (1.3722 => 1.2895, std.dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: -6.01% (7.0961 => 6.6693, std.dev.: 0.0133) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.00% (0.9852 => 0.9261, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -5.95% (0.9179 => 0.8633, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/chomp: -5.91% (0.1761 => 0.1657, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (4.0323 => 3.7947, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/ReedSolomon: -5.85% (0.1879 => 0.1769, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.85% (1.4642 => 1.3785, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: -5.85% (4.3330 => 4.0797, std.dev.: 0.0150) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.82% (1.2300 => 1.1584, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.82% (4.8802 => 4.5962, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.80% (1.6364 => 1.5415, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.80% (0.5863 => 0.5523, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.78% (0.5591 => 0.5268, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.77% (0.5478 => 0.5162, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.74% (6.7716 => 6.3831, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.74% (0.5805 => 0.5472, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.73% (0.6736 => 0.6350, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.71% (3.5339 => 3.3320, std.dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.70% (0.6293 => 0.5934, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.69% (0.5570 => 0.5253, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.68% (0.7919 => 0.7469, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -5.67% (0.4515 => 0.4259, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.67% (0.6052 => 0.5709, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.67% (4.5069 => 4.2515, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/bh/bh: -5.66% (0.2985 => 0.2816, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.65% (0.5925 => 0.5590, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.65% (0.6446 => 0.6082, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.64% (0.5705 => 0.5383, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.64% (0.5849 => 0.5519, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: -5.64% (0.2659 => 0.2509, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.64% (0.2695 => 0.2543, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.63% (0.4916 => 0.4639, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.62% (0.5857 => 0.5528, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.62% (0.6304 => 0.5950, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.60% (0.6230 => 0.5881, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -5.59% (1.1530 => 1.0885, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.59% (0.6194 => 0.5848, std.dev.: 0.0125) MultiSource/Applications/Burg/burg: -5.59% (1.2515 => 1.1816, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.58% (0.6667 => 0.6295, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.57% (0.8521 => 0.8046, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.56% (0.5575 => 0.5265, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.55% (0.5581 => 0.5271, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.55% (0.5859 => 0.5534, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.55% (0.3931 => 0.3713, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.53% (0.6660 => 0.6292, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.52% (0.5999 => 0.5668, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.51% (0.6260 => 0.5915, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -5.51% (1.1450 => 1.0819, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.51% (0.6189 => 0.5848, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.50% (0.5456 => 0.5156, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -5.49% (0.3025 => 0.2859, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.49% (0.5941 => 0.5615, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.47% (0.3837 => 0.3627, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -5.47% (0.3255 => 0.3077, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.47% (0.2871 => 0.2714, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.46% (0.5802 => 0.5485, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.45% (0.6297 => 0.5954, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.45% (0.7198 => 0.6806, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.44% (0.4813 => 0.4551, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.44% (0.3016 => 0.2852, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.44% (1.2784 => 1.2089, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.43% (0.6681 => 0.6318, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.43% (0.3057 => 0.2891, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.43% (2.1713 => 2.0534, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/18-imp/imp: -5.42% (0.3581 => 0.3387, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.42% (0.2548 => 0.2410, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.41% (0.2903 => 0.2746, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.41% (8.0126 => 7.5794, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.40% (0.2278 => 0.2155, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -5.39% (0.3026 => 0.2863, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: -5.39% (0.3194 => 0.3022, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -5.38% (1.3148 => 1.2441, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.37% (0.4151 => 0.3928, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.35% (0.2933 => 0.2776, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.34% (0.2939 => 0.2782, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.33% (17.1032 => 16.1912, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/strcat: -5.32% (0.2989 => 0.2830, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.31% (0.3406 => 0.3225, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.31% (0.3483 => 0.3298, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.31% (0.5688 => 0.5386, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -5.30% (15.5079 => 14.6853, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.30% (0.2999 => 0.2840, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: -5.30% (0.2849 => 0.2698, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.30% (0.3323 => 0.3147, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.28% (14.2083 => 13.4574, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/wc: -5.27% (0.3205 => 0.3036, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.25% (0.6033 => 0.5716, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.25% (0.6440 => 0.6102, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.21% (0.5168 => 0.4899, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.20% (0.2001 => 0.1897, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -5.19% (0.3446 => 0.3267, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.19% (1.2210 => 1.1576, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.19% (1.2221 => 1.1587, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: -5.18% (1.3864 => 1.3146, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.17% (0.6676 => 0.6331, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.17% (0.3252 => 0.3084, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: -5.16% (3.5154 => 3.3341, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.16% (0.2385 => 0.2262, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.13% (0.2106 => 0.1998, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.12% (0.3319 => 0.3149, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -5.12% (0.7447 => 0.7066, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -5.11% (4.0594 => 3.8521, std.dev.: 0.0022) SingleSource/Regression/C++/ofstream_ctor: -5.10% (0.3059 => 0.2903, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -5.10% (0.3394 => 0.3221, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.09% (0.3849 => 0.3653, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -5.06% (0.4861 => 0.4615, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -5.02% (0.3867 => 0.3673, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.00% (0.7339 => 0.6972, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: -5.00% (0.3481 => 0.3307, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -4.97% (0.4248 => 0.4037, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -4.97% (2.4021 => 2.2828, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.89% (22.4056 => 21.3091, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.89% (1.6474 => 1.5668, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -4.86% (0.3271 => 0.3112, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.85% (0.4083 => 0.3885, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -4.83% (2.1401 => 2.0367, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.80% (0.6395 => 0.6088, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -4.78% (0.3621 => 0.3448, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.77% (0.7524 => 0.7165, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -4.77% (15.2527 => 14.5253, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash: -4.75% (0.4524 => 0.4309, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: -4.75% (0.7982 => 0.7603, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.73% (0.7021 => 0.6689, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -4.72% (0.8418 => 0.8021, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.70% (0.9557 => 0.9108, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.68% (0.6347 => 0.6050, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.67% (0.5569 => 0.5309, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.65% (0.4427 => 0.4221, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.64% (0.6395 => 0.6098, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.62% (0.5329 => 0.5083, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.58% (0.5567 => 0.5312, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.56% (0.6441 => 0.6147, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.53% (5.0226 => 4.7950, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.53% (0.9077 => 0.8666, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -4.52% (18.2933 => 17.4657, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.48% (0.2277 => 0.2175, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: -4.44% (0.3788 => 0.3620, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.42% (0.7779 => 0.7435, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -4.30% (0.6750 => 0.6460, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.26% (2.2587 => 2.1624, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.24% (0.3491 => 0.3343, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: -4.23% (34.0927 => 32.6506, std.dev.: 0.0059) MultiSource/Applications/hbd/hbd: -3.88% (1.5610 => 1.5004, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.82% (0.4321 => 0.4156, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.60% (5.4682 => 5.2715, std.dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: -2.30% (20.7746 => 20.2965, std.dev.: 0.0271) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7555, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/richards_benchmark: -8.61% (1.2842 => 1.1736) SingleSource/Benchmarks/Misc/fbench: -3.89% (2.2633 => 2.1752, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.34% (1.3096 => 1.2789, std.dev.: 0.0106) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4725, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.40% (1.6086 => 1.5861, std.dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 24 19:28:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 21:28:11 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121125032811.E192F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6219?compare_to=6216&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6219, Order: 168554, Start Time: 2012-11-25 01:57:04, End Time: 2012-11-25 03:28:41 To: 6216, Order: 168548, Start Time: 2012-11-24 23:35:31, End Time: 2012-11-25 01:15:51 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 4 (76 on baseline) Performance Improvements: 17 (25 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1033 (873 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 8.25% (0.1902 => 0.2059, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 3.14% (8.7430 => 9.0177, std.dev.: 0.0225) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 2.75% (1.8241 => 1.8743, std.dev.: 0.0082) MultiSource/Benchmarks/llubenchmark/llu: 1.33% (1.9960 => 2.0225, std.dev.: 0.0076) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.84% (1.2375 => 1.1776, std.dev.: 0.0207) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.77% (0.9191 => 0.8753, std.dev.: 0.0140) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.32% (22.8306 => 22.2998, std.dev.: 0.1562) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.90% (0.9466 => 0.9286, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.83% (0.9227 => 0.9058, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.63% (0.8297 => 0.8162, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.43% (0.8515 => 0.8393, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.18% (0.8590 => 0.8489, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -17.21% (3.7038 => 3.0665, std.dev.: 0.1336) MultiSource/Benchmarks/nbench/nbench: -8.93% (20.9906 => 19.1161, std.dev.: 0.5833) MultiSource/Benchmarks/Ptrdist/ft/ft: -6.35% (0.8841 => 0.8280, std.dev.: 0.0215) SingleSource/Benchmarks/CoyoteBench/lpbench: -5.79% (4.1751 => 3.9334, std.dev.: 0.0456) SingleSource/Benchmarks/Shootout-C++/ary3: -3.92% (2.0842 => 2.0026, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: -1.91% (1.5945 => 1.5640, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -1.56% (1.0193 => 1.0034, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/hash: -1.43% (4.3602 => 4.2980, std.dev.: 0.0140) MultiSource/Benchmarks/Bullet/bullet: -1.14% (7.1701 => 7.0884, std.dev.: 0.0231) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -2.08% (1.0663 => 1.0441, std.dev.: 0.0515) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -27.60% (0.0221 => 0.0160, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0427 => 0.0429, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -18.62% (0.0333 => 0.0271, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.63% (0.0315 => 0.0313, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.24% (0.0425 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -0.98% (0.0205 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -23.91% (0.0184 => 0.0140, std.dev.: 0.0040) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.40% (0.1482 => 0.1488, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 4.20% (1.1225 => 1.1697, std.dev.: 0.0259) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 7.79% (0.4109 => 0.4429, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.55% (0.1494 => 0.1426, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.95% (0.0653 => 0.0588, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -22.01% (0.0268 => 0.0209, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.89% (0.0641 => 0.0584, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.30% (1.1991 => 1.1955, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -88.89% (0.0009 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 200.00% (0.0001 => 0.0003, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.58% (0.0591 => 0.0624, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.78% (0.0252 => 0.0259, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.48% (0.7854 => 0.7816, std.dev.: 0.0009) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -8.86% (0.0079 => 0.0072, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.12% (16.4461 => 17.6165, std.dev.: 0.7802) MultiSource/Applications/sqlite3/sqlite3: 2337.19% (0.6332 => 15.4323, std.dev.: 0.4153) MultiSource/Benchmarks/McCat/08-main/main: 43.69% (0.1831 => 0.2631, std.dev.: 0.0750) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.74% (0.1559 => 0.1454, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7040.51% (0.3123 => 22.2998, std.dev.: 0.1562) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.04% (0.2463 => 0.3720, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1522.34% (0.3344 => 5.4251, std.dev.: 0.1335) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.72% (0.2364 => 0.3232, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/bigfib: 4.16% (0.6010 => 0.6260, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel: 4.20% (0.0429 => 0.0447, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.96% (0.3266 => 0.3428, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 2.79% (0.1969 => 0.2024, std.dev.: 0.0021) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.45% (0.0224 => 0.0225, std.dev.: 0.0008) SingleSource/UnitTests/byval-alignment: -28.70% (0.0230 => 0.0164, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0459, std.dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: 11.49% (0.1462 => 0.1630, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4798, std.dev.: 0.0462) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0718, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4910, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5119, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5292, std.dev.: 0.0855) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3185, std.dev.: 0.0434) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1417, std.dev.: 0.0191) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3632, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4020, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0874, std.dev.: 0.0101) SingleSource/Regression/C/uint64_to_float: -24.34% (2.1832 => 1.6519, std.dev.: 0.0070) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0008) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.21% (0.0848 => 0.0960, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.12% (0.1885 => 0.2038, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.08% (0.1905 => 0.2059, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.02% (0.1425 => 0.1525, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.03% (0.2519 => 0.2671, std.dev.: 0.0022) MultiSource/Applications/Burg/burg: 5.64% (1.2222 => 1.2911, std.dev.: 0.0223) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.19% (0.8321 => 0.8753, std.dev.: 0.0140) MultiSource/Applications/hbd/hbd: 4.08% (1.4269 => 1.4851, std.dev.: 0.0171) MultiSource/Applications/SIBsim4/SIBsim4: 3.76% (1.2568 => 1.3040, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.61% (1.4479 => 1.5001, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.40% (0.3115 => 0.3221, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.09% (0.4559 => 0.4700, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.92% (0.8007 => 0.8241, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.89% (0.8177 => 0.8413, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.79% (0.8069 => 0.8294, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.66% (0.8805 => 0.9039, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.65% (0.9069 => 0.9309, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.56% (0.5191 => 0.5324, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.53% (0.9908 => 1.0159, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.51% (0.9039 => 0.9266, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.50% (0.8518 => 0.8731, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.46% (0.7966 => 0.8162, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.45% (0.8457 => 0.8664, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.41% (0.8050 => 0.8244, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.38% (0.9688 => 0.9919, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.38% (0.8611 => 0.8816, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.37% (0.9056 => 0.9271, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.34% (0.8597 => 0.8798, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.34% (0.9074 => 0.9286, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.30% (0.8204 => 0.8393, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.29% (0.8855 => 0.9058, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.20% (0.8420 => 0.8605, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.18% (0.8286 => 0.8467, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.15% (0.8359 => 0.8539, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: 2.14% (2.3764 => 2.4272, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.11% (0.8066 => 0.8236, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.08% (0.8316 => 0.8489, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.08% (0.6586 => 0.6723, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.03% (0.8048 => 0.8211, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.02% (0.8317 => 0.8485, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.01% (0.8261 => 0.8427, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.01% (0.8716 => 0.8891, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.99% (0.8927 => 0.9105, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.97% (0.8885 => 0.9060, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.63% (0.7932 => 0.8061, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 108.04% (0.0199 => 0.0414, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/pi: 57.51% (1.5795 => 2.4878, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.44% (0.7597 => 0.8846, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.34% (2.9753 => 3.4616, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.61% (2.7995 => 3.2084, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6089, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.19% (1.1857 => 1.2828, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.07% (0.3186 => 0.3443, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.10% (4.7794 => 5.1188, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/richards_benchmark: 6.56% (1.3037 => 1.3892, std.dev.: 0.0114) MultiSource/Applications/SIBsim4/SIBsim4: 6.26% (3.1873 => 3.3868, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.86% (4.9686 => 5.2598, std.dev.: 0.0360) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.82% (4.5327 => 4.7964, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.74% (6.2275 => 6.5225, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.70% (3.3761 => 3.5348, std.dev.: 0.0069) MultiSource/Applications/lambda-0_1_3/lambda: 4.60% (7.4933 => 7.8379, std.dev.: 0.0732) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.12% (4.9469 => 5.1505, std.dev.: 0.0453) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.08% (4.9453 => 5.1472, std.dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 3.99% (14.0064 => 14.5654, std.dev.: 0.0162) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.29% (0.3587 => 0.3705, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 3.13% (3.6643 => 3.7790, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.85% (11.5690 => 11.8985, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.82% (8.2783 => 8.5114, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.31% (4.8660 => 4.9782, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout/lists: 2.30% (7.3375 => 7.5061, std.dev.: 0.0167) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.16% (1.1365 => 1.1611, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.34% (2.4647 => 2.4977, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.30% (3.5679 => 3.6142, std.dev.: 0.0030) MultiSource/Benchmarks/llubenchmark/llu: 1.29% (1.9967 => 2.0225, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/neural/neural: 1.29% (1.0841 => 1.0981, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ReedSolomon: 1.01% (8.5322 => 8.6180, std.dev.: 0.0142) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.37% (5.4641 => 4.2964, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.77% (7.2130 => 6.1475, std.dev.: 0.0981) MultiSource/Benchmarks/nbench/nbench: -12.97% (21.9654 => 19.1161, std.dev.: 0.5833) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.84% (1.0512 => 0.9372, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.54% (1.1216 => 1.0034, std.dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: -8.52% (63.1822 => 57.8022, std.dev.: 0.0307) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.45% (14.6451 => 13.5541, std.dev.: 0.0896) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.89% (4.7482 => 4.4212, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.42% (0.3269 => 0.3059, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.88% (5.4972 => 5.1739, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.87% (3.7148 => 3.4968, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.06% (5.1557 => 4.8950, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.35% (4.7449 => 4.5385, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.82% (2.8773 => 2.7674, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.70% (2.4490 => 2.3583, std.dev.: 0.0283) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.64% (6.0224 => 5.8030, std.dev.: 0.0080) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.05% (28.5821 => 27.7094, std.dev.: 0.0738) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.98% (0.5807 => 0.5634, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: -2.19% (3.4237 => 3.3487, std.dev.: 0.0075) MultiSource/Applications/aha/aha: -2.08% (3.3398 => 3.2703, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.08% (9.9065 => 9.7009, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.98% (11.5316 => 11.3033, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.61% (4.9994 => 4.9188, std.dev.: 0.0131) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.53% (2.3487 => 2.3127, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.13% (5.6343 => 5.5706, std.dev.: 0.0046) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.74% (1.0262 => 1.0441, std.dev.: 0.0515) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 30.08% (0.0123 => 0.0160, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.15% (0.0408 => 0.0429, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 6.69% (0.0254 => 0.0271, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -22.22% (0.0180 => 0.0140, std.dev.: 0.0040) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 3.48% (0.1438 => 0.1488, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 3.25% (1.1329 => 1.1697, std.dev.: 0.0259) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.36% (0.4164 => 0.4429, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.16% (0.1369 => 0.1426, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.27% (0.0641 => 0.0588, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 7.18% (0.0195 => 0.0209, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.04% (0.0578 => 0.0584, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.53% (1.1437 => 1.1955, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -78.57% (0.0014 => 0.0003, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.48% (0.0627 => 0.0624, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 43.89% (0.0180 => 0.0259, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.51% (0.8017 => 0.7816, std.dev.: 0.0009) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 16.13% (0.0062 => 0.0072, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 24 20:16:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 22:16:44 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121125041644.6143A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6220?compare_to=6214&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6220, Order: 168549, Start Time: 2012-11-25 00:56:12, End Time: 2012-11-25 04:17:13 To: 6214, Order: 168546, Start Time: 2012-11-24 20:47:24, End Time: 2012-11-25 00:08:16 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (170 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1090 (720 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.75% (0.3788 => 0.3892, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.23% (54.1847 => 54.8537, std.dev.: 0.0324) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.52% (0.0625 => 0.0897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.58% (0.1063 => 0.1420, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.87% (0.2969 => 0.3737, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.77% (0.1106 => 0.1391, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 25.75% (1.5932 => 2.0035, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.97% (0.4253 => 0.5315, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.62% (0.4139 => 0.5158, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.67% (0.0714 => 0.0883, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.47% (0.5900 => 0.7285, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.37% (0.0475 => 0.0586, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.37% (0.4994 => 0.6161, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.30% (0.5000 => 0.6165, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.12% (0.0584 => 0.0719, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.85% (0.0547 => 0.0672, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.79% (0.1620 => 0.1973, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.63% (0.0897 => 0.1091, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 21.54% (0.0599 => 0.0728) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.35% (0.1021 => 0.1239, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.32% (0.1107 => 0.1343, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.38% (0.0633 => 0.0762, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.21% (0.0584 => 0.0702, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 20.15% (0.0948 => 0.1139, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.04% (0.1103 => 0.1324, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.98% (0.3903 => 0.4683, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.94% (0.0642 => 0.0770, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.88% (0.1549 => 0.1857, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 19.73% (0.0821 => 0.0983) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.54% (0.1003 => 0.1199, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.51% (0.1604 => 0.1917, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 19.37% (0.0604 => 0.0721, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.34% (0.0822 => 0.0981, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 19.21% (0.1619 => 0.1930, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.71% (0.1160 => 0.1377, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.67% (0.1462 => 0.1735, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 18.56% (0.0808 => 0.0958, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.48% (0.0947 => 0.1122, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.42% (0.2736 => 0.3240, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.15% (0.3890 => 0.4596, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.92% (0.2014 => 0.2375, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 17.82% (0.1218 => 0.1435, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 17.59% (0.5826 => 0.6851, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.49% (1.3152 => 1.5452, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 17.35% (0.5889 => 0.6911, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 17.30% (0.4029 => 0.4726, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.28% (0.1968 => 0.2308, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.19% (0.1088 => 0.1275, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 17.14% (0.1505 => 0.1763, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 17.01% (1.8794 => 2.1991, std.dev.: 0.0058) MultiSource/Applications/Burg/burg: 16.91% (0.5546 => 0.6484, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.85% (0.2866 => 0.3349, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.73% (3.5627 => 4.1586, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.72% (0.4658 => 0.5437, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.60% (0.3271 => 0.3814, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.43% (0.5026 => 0.5852, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: 16.36% (0.1284 => 0.1494, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.31% (1.6211 => 1.8855, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 16.30% (0.9697 => 1.1278, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 16.10% (1.0781 => 1.2517, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.86% (0.2875 => 0.3331, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.78% (0.4361 => 0.5049, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 15.69% (0.1421 => 0.1644, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 15.63% (0.7171 => 0.8292, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 15.30% (0.2725 => 0.3142, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.29% (0.3930 => 0.4531, std.dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 15.25% (0.3004 => 0.3462, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.19% (4.4195 => 5.0909, std.dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 15.19% (4.2109 => 4.8506, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/methcall: 15.18% (0.2813 => 0.3240, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 15.16% (0.2823 => 0.3251, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 15.16% (0.9909 => 1.1411, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.16% (0.2738 => 0.3153, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.10% (0.2729 => 0.3141, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.09% (2.7292 => 3.1411, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hello: 15.07% (0.2714 => 0.3123, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 15.05% (0.2750 => 0.3164, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.01% (0.2792 => 0.3211, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 15.00% (0.2566 => 0.2951, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 14.93% (0.2780 => 0.3195, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.91% (1.9966 => 2.2943, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/except: 14.91% (0.2811 => 0.3230, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 14.81% (0.2803 => 0.3218, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.77% (0.2911 => 0.3341, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.77% (0.1090 => 0.1251, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 14.75% (0.3267 => 0.3749, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.73% (2.0673 => 2.3719, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 14.70% (0.3096 => 0.3551, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.68% (0.3195 => 0.3664, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 14.65% (23.5202 => 26.9666, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.55% (1.9694 => 2.2560, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.38% (0.3060 => 0.3500, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 14.33% (0.3258 => 0.3725, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 14.31% (0.2075 => 0.2372, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 14.29% (0.3317 => 0.3791, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.16% (0.3488 => 0.3982, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.83% (0.3362 => 0.3827, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 13.77% (0.4146 => 0.4717, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 13.77% (0.3348 => 0.3809, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 13.68% (0.3678 => 0.4181, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.64% (0.3124 => 0.3550, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.62% (0.3282 => 0.3729) MultiSource/Applications/lua/lua: 13.60% (1.4269 => 1.6210, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-2: 13.58% (0.3446 => 0.3914, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.58% (0.3845 => 0.4367, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 13.56% (0.3465 => 0.3935, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.47% (0.3496 => 0.3967, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.44% (0.3460 => 0.3925, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/synchronized: 13.43% (0.3469 => 0.3935, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 13.42% (0.3726 => 0.4226, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.38% (0.3625 => 0.4110, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 13.34% (0.3477 => 0.3941, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 13.34% (0.3442 => 0.3901, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 13.15% (0.3650 => 0.4130, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 13.12% (0.7875 => 0.8908, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 13.10% (0.4251 => 0.4808, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.01% (0.3981 => 0.4499, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.98% (0.3643 => 0.4116, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.93% (0.3690 => 0.4167, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 12.89% (2.1653 => 2.4445, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/parameter-passing: 12.86% (0.3724 => 0.4203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 12.63% (0.5012 => 0.5645, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 12.45% (4.6177 => 5.1926, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.30% (0.2040 => 0.2291, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 12.26% (2.1013 => 2.3590, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 11.97% (0.2691 => 0.3013, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 11.61% (0.3498 => 0.3904, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 11.51% (5.5417 => 6.1798, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.38% (0.1028 => 0.1145, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.36% (0.6435 => 0.7166, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.99% (0.1383 => 0.1535, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.73% (0.3084 => 0.3415, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 10.69% (0.6634 => 0.7343, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.69% (0.2068 => 0.2289, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.56% (0.2737 => 0.3026, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 10.50% (0.4847 => 0.5356, std.dev.: 0.0073) MultiSource/Applications/minisat/minisat: 9.89% (0.3336 => 0.3666, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.84% (0.2103 => 0.2310, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 9.53% (2.0346 => 2.2285, std.dev.: 0.0068) MultiSource/Applications/lemon/lemon: 9.33% (0.2391 => 0.2614, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.02% (4.6926 => 5.1157, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.80% (11.6398 => 12.6646, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.58% (0.5361 => 0.5821, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.02% (0.5584 => 0.6032, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.97% (0.7426 => 0.8018, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 6.82% (11.9555 => 12.7705, std.dev.: 0.0107) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.11% (0.3792 => 0.3948, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.22% (0.5917 => 0.6699, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 7.30% (0.2122 => 0.2277, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.57% (3.3903 => 3.6130, std.dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 6.00% (0.2802 => 0.2970, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.39% (0.3693 => 0.3892, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6764, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops: 4.73% (15.4430 => 16.1729, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-2: 4.55% (1.8057 => 1.8878, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/dry: 4.14% (14.0481 => 14.6295, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1985, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2235, std.dev.: 0.0052) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3038, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2889, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.19% (8.4155 => 8.5156, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5849, std.dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.23% (2.4764 => 2.3964, std.dev.: 0.0173) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5764, std.dev.: 0.0134) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9771, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: -7.70% (0.2402 => 0.2217, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8056, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8020, std.dev.: 0.0053) SingleSource/Benchmarks/Dhrystone/fldry: -3.19% (17.2379 => 16.6877, std.dev.: 0.0638) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.04% (0.6293 => 0.6102, std.dev.: 0.0019) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7728, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8622, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5773, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4959, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1470, std.dev.: 0.0238) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0432, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 24 21:04:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 23:04:11 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121125050411.066B32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6221?compare_to=6218&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6221, Order: 168556, Start Time: 2012-11-25 03:31:08, End Time: 2012-11-25 05:04:35 To: 6218, Order: 168554, Start Time: 2012-11-25 01:35:02, End Time: 2012-11-25 03:08:22 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (185 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (852 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.65% (54.6543 => 56.1030, std.dev.: 0.1850) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.80% (54.5751 => 56.1030, std.dev.: 0.1850) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1006, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4937 => 7.6767, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/hash2: 2.11% (3.1932 => 3.2607, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.39% (0.1431 => 0.1311) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.64% (0.3821 => 0.3529, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.93% (0.3884 => 0.3615, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.92% (0.3831 => 0.3566, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.91% (0.3880 => 0.3612, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -6.90% (0.3812 => 0.3549, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.89% (0.3848 => 0.3583, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -6.83% (0.3896 => 0.3630, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.82% (0.4033 => 0.3758, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.78% (0.3142 => 0.2929, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.71% (0.3891 => 0.3630, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.66% (0.4176 => 0.3898, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -6.58% (0.3357 => 0.3136, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.57% (0.9542 => 0.8915, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -6.52% (2.4924 => 2.3298, std.dev.: 0.0125) SingleSource/UnitTests/ObjC/property: -6.43% (0.4199 => 0.3929, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.43% (0.2428 => 0.2272, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -6.25% (0.2160 => 0.2025, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.23% (0.6484 => 0.6080, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.16% (0.2355 => 0.2210, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -6.12% (9.2283 => 8.6633, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/parameter-passing: -6.12% (0.4280 => 0.4018, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.09% (0.9852 => 0.9252, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: -6.08% (16.1920 => 15.2076, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.08% (1.0544 => 0.9903, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.07% (0.1796 => 0.1687, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.07% (0.3658 => 0.3436, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.03% (1.3722 => 1.2895, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.02% (4.8161 => 4.5260, std.dev.: 0.0094) MultiSource/Applications/JM/ldecod/ldecod: -5.98% (7.0961 => 6.6715, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/chomp: -5.91% (0.1761 => 0.1657, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.89% (0.1716 => 0.1615, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -5.86% (0.9179 => 0.8641, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -5.85% (0.1879 => 0.1769, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.84% (0.5478 => 0.5158, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.84% (4.0323 => 3.7970, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.83% (1.2300 => 1.1583, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -5.83% (4.3330 => 4.0805, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.79% (3.5339 => 3.3293, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.78% (0.5863 => 0.5524, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.78% (4.8802 => 4.5982, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.78% (0.5591 => 0.5268, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.77% (0.5705 => 0.5376, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.76% (0.4515 => 0.4255, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.75% (0.5999 => 0.5654, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.74% (1.6364 => 1.5425, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.73% (0.7919 => 0.7465, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.71% (0.6667 => 0.6286, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.68% (4.5069 => 4.2509, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.67% (0.5570 => 0.5254, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.67% (0.6293 => 0.5936, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.67% (1.4642 => 1.3812, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.67% (0.5805 => 0.5476, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: -5.64% (0.2659 => 0.2509, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.62% (0.5925 => 0.5592, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.62% (6.7716 => 6.3913, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.61% (0.6736 => 0.6358, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.60% (0.2695 => 0.2544, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.60% (0.6230 => 0.5881, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.60% (0.2999 => 0.2831, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.59% (0.5456 => 0.5151, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.58% (0.6446 => 0.6086, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.57% (0.5849 => 0.5523, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.57% (0.5581 => 0.5270, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -5.57% (1.1530 => 1.0888, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.57% (0.6304 => 0.5953, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.56% (0.8521 => 0.8047, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -5.56% (0.2985 => 0.2819, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.56% (0.6297 => 0.5947, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.55% (0.6194 => 0.5850, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.55% (0.6052 => 0.5716, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.55% (0.5802 => 0.5480, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -5.52% (0.3025 => 0.2858, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.51% (0.5857 => 0.5534, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.51% (0.6660 => 0.6293, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.51% (0.5575 => 0.5268, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.50% (0.2871 => 0.2713, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.49% (0.3931 => 0.3715, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -5.49% (1.1450 => 1.0821, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.48% (1.2784 => 1.2083, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.48% (0.5859 => 0.5538, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -5.47% (0.3581 => 0.3385, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.47% (0.3837 => 0.3627, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.47% (0.3016 => 0.2851, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -5.47% (1.2515 => 1.1831, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.46% (0.6681 => 0.6316, std.dev.: 0.0049) MultiSource/Benchmarks/sim/sim: -5.46% (0.3406 => 0.3220, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.45% (0.4916 => 0.4648, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.45% (0.6260 => 0.5919, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.44% (8.0126 => 7.5770, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.42% (0.4151 => 0.3926, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.41% (2.1713 => 2.0538, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.40% (0.7198 => 0.6809, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.40% (0.3057 => 0.2892, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.38% (0.4813 => 0.4554, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.38% (0.6189 => 0.5856, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.38% (0.2548 => 0.2411, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.38% (0.3255 => 0.3080) SingleSource/Benchmarks/Shootout-C++/random: -5.38% (0.2939 => 0.2781, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.36% (0.3319 => 0.3141, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -5.35% (0.3026 => 0.2864, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.35% (0.5941 => 0.5623, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.33% (0.5688 => 0.5385, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.32% (0.3194 => 0.3024, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.32% (0.2933 => 0.2777) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.31% (0.2278 => 0.2157) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.30% (0.2903 => 0.2749, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.30% (1.3148 => 1.2451, std.dev.: 0.0083) MultiSource/Applications/sqlite3/sqlite3: -5.30% (17.1032 => 16.1968, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.30% (0.6440 => 0.6099, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.29% (1.2221 => 1.1575, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.28% (0.3483 => 0.3299, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.28% (14.2083 => 13.4578, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wc: -5.27% (0.3205 => 0.3036, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/strcat: -5.25% (0.2989 => 0.2832, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.24% (0.3323 => 0.3149, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.23% (1.2210 => 1.1571, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: -5.23% (0.2849 => 0.2700, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.18% (0.6676 => 0.6330, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -5.18% (1.3864 => 1.3146, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -5.17% (0.3446 => 0.3268, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.16% (0.2385 => 0.2262, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.15% (0.6033 => 0.5722, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -5.14% (15.5079 => 14.7112, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.13% (0.5168 => 0.4903, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -5.13% (3.5154 => 3.3352, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.11% (0.4321 => 0.4100, std.dev.: 0.0038) MultiSource/Applications/lua/lua: -5.09% (4.0594 => 3.8529, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary: -5.07% (0.3394 => 0.3222, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.05% (0.2001 => 0.1900, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.99% (0.2106 => 0.2001, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.97% (0.3059 => 0.2907, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -4.96% (0.4861 => 0.4620, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -4.95% (0.3271 => 0.3109, std.dev.: 0.0030) MultiSource/Applications/siod/siod: -4.95% (2.4021 => 2.2832, std.dev.: 0.0024) MultiSource/Applications/ClamAV/clamscan: -4.93% (15.2527 => 14.5012, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/moments: -4.92% (0.4248 => 0.4039, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.91% (22.4056 => 21.3061, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.89% (0.7339 => 0.6980, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.88% (0.6395 => 0.6083, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.87% (0.4083 => 0.3884, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -4.87% (0.7982 => 0.7593, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.87% (1.6474 => 1.5672, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -4.86% (0.3867 => 0.3679, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -4.86% (0.7447 => 0.7085, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: -4.85% (0.3481 => 0.3312, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.81% (0.9077 => 0.8640, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: -4.81% (2.1401 => 2.0372, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/Hello: -4.79% (0.6347 => 0.6043, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.78% (0.3849 => 0.3665, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -4.75% (0.3621 => 0.3449, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.74% (0.3252 => 0.3098, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -4.73% (0.8418 => 0.8020, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.65% (0.9557 => 0.9113, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: -4.64% (0.4524 => 0.4314, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.63% (0.5569 => 0.5311, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.63% (0.7524 => 0.7176, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.60% (0.5567 => 0.5311, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.57% (0.6395 => 0.6103, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.57% (5.0226 => 4.7933, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (0.7021 => 0.6702, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.54% (0.4427 => 0.4226, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.52% (0.2277 => 0.2174, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: -4.50% (0.6441 => 0.6151, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -4.44% (18.2933 => 17.4802, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/sieve: -4.44% (0.3788 => 0.3620, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.39% (0.5329 => 0.5095) SingleSource/UnitTests/ObjC++/property-reference: -4.29% (0.7779 => 0.7445, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -4.28% (0.6750 => 0.6461, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.23% (2.2587 => 2.1632, std.dev.: 0.0052) MultiSource/Benchmarks/Bullet/bullet: -4.19% (34.0927 => 32.6635, std.dev.: 0.0102) MultiSource/Applications/hbd/hbd: -4.14% (1.5610 => 1.4963, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.07% (0.3491 => 0.3349, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.57% (5.4682 => 5.2730, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -2.36% (20.7746 => 20.2840, std.dev.: 0.0237) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7554, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -8.66% (1.2842 => 1.1730, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -4.04% (2.2633 => 2.1718, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7061, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.72% (1.3096 => 1.2740, std.dev.: 0.0069) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.72% (6.5735 => 6.4604, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 5.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 24 21:14:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 23:14:53 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121125051453.ADFFC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6222?compare_to=6219&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6222, Order: 168556, Start Time: 2012-11-25 03:45:28, End Time: 2012-11-25 05:15:22 To: 6219, Order: 168554, Start Time: 2012-11-25 01:57:04, End Time: 2012-11-25 03:28:41 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 20 (123 on baseline) Performance Improvements: 2 (31 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1032 (820 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.31% (0.2363 => 0.2512, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.99% (0.3255 => 0.3385, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.56% (0.8753 => 0.9065, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.30% (0.6453 => 0.6666, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.64% (0.9619 => 0.9873, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 2.49% (0.4382 => 0.4491, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.40% (1.1776 => 1.2059, std.dev.: 0.0105) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.32% (0.8499 => 0.8696, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.21% (0.5105 => 0.5218, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.90% (8.7646 => 8.9313, std.dev.: 0.0270) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.62% (1.3648 => 1.3869, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: 1.57% (0.8890 => 0.9030, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.22% (22.2998 => 22.5724, std.dev.: 0.0634) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 16.75% (19.1161 => 22.3187, std.dev.: 0.4587) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.96% (1.2994 => 1.3769, std.dev.: 0.0251) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.73% (6.6465 => 7.0273, std.dev.: 0.0432) MultiSource/Applications/SPASS/SPASS: 4.91% (8.3218 => 8.7301, std.dev.: 0.0558) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.33% (3.7694 => 3.9325, std.dev.: 0.0469) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.30% (2.4896 => 2.5966, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.66% (2.3583 => 2.3974, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.33% (2.9465 => 2.9072, std.dev.: 0.0142) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.08% (0.9648 => 0.9544, std.dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.49% (1.0441 => 1.0597, std.dev.: 0.0106) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 27.50% (0.0160 => 0.0204, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0429 => 0.0428, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 19.93% (0.0271 => 0.0325, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0313 => 0.0313, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.47% (0.0424 => 0.0422, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -37.93% (0.0203 => 0.0126, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/test1: 37.86% (0.0140 => 0.0193, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.74% (0.1488 => 0.1477, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: -6.62% (1.1697 => 1.0923, std.dev.: 0.0450) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.76% (0.4429 => 0.4174, std.dev.: 0.0309) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.61% (0.1426 => 0.1449, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.70% (0.0588 => 0.0578, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 26.79% (0.0209 => 0.0265, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.97% (0.0584 => 0.0555, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.45% (1.1955 => 1.2009, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 400.00% (0.0001 => 0.0005, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -66.67% (0.0003 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.94% (0.0624 => 0.0562, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.97% (0.0259 => 0.0228, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.58% (0.7816 => 0.7771, std.dev.: 0.0024) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -71.43% (0.0007 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -44.44% (0.0072 => 0.0040, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.11% (16.4461 => 17.6157, std.dev.: 0.1138) MultiSource/Applications/sqlite3/sqlite3: 2328.63% (0.6332 => 15.3781, std.dev.: 0.0747) MultiSource/Benchmarks/McCat/08-main/main: 47.62% (0.1831 => 0.2703, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.78% (0.1559 => 0.1500, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7127.79% (0.3123 => 22.5724, std.dev.: 0.0634) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.95% (0.2463 => 0.3718, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1522.16% (0.3344 => 5.4245, std.dev.: 0.0563) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.17% (0.2364 => 0.3219, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 4.48% (0.6010 => 0.6279, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: - (0.0429 => 0.0429, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.27% (0.3266 => 0.3438, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 2.34% (0.1969 => 0.2015, std.dev.: 0.0015) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.89% (0.0224 => 0.0222, std.dev.: 0.0008) SingleSource/UnitTests/byval-alignment: -29.13% (0.0230 => 0.0163, std.dev.: 0.0011) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0522, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 7.39% (0.1462 => 0.1570, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4706, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0692, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4944, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5134, std.dev.: 0.0102) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5332, std.dev.: 0.1333) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3168, std.dev.: 0.0489) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1425, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3631, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4092, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0832, std.dev.: 0.0024) SingleSource/Regression/C/uint64_to_float: -23.81% (2.1832 => 1.6634, std.dev.: 0.0015) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 11.96% (0.1112 => 0.1245, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.22% (0.2279 => 0.2512, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.94% (0.8321 => 0.9065, std.dev.: 0.0104) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.35% (0.2180 => 0.2362, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.12% (0.6010 => 0.6498, std.dev.: 0.0157) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.91% (0.3137 => 0.3385, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.65% (0.4847 => 0.5218, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.73% (0.8148 => 0.8696, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.64% (0.7473 => 0.7969, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.03% (0.6287 => 0.6666, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.86% (0.3295 => 0.3488, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 5.31% (1.2222 => 1.2871, std.dev.: 0.0243) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.07% (0.2998 => 0.3150, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.92% (0.5817 => 0.6103, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.87% (0.2240 => 0.2349, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.64% (0.9435 => 0.9873, std.dev.: 0.0045) MultiSource/Applications/spiff/spiff: 4.58% (0.7950 => 0.8314, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.44% (1.3279 => 1.3869, std.dev.: 0.0026) MultiSource/Applications/treecc/treecc: 4.33% (1.9948 => 2.0811, std.dev.: 0.0207) MultiSource/Applications/SPASS/SPASS: 4.25% (14.2605 => 14.8671, std.dev.: 0.0773) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.10% (1.2526 => 1.3039, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.07% (0.4127 => 0.4295, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 3.90% (0.2999 => 0.3116, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.84% (1.1606 => 1.2052, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.61% (2.1401 => 2.2173, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.50% (0.3115 => 0.3224, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.28% (8.6476 => 8.9313, std.dev.: 0.0270) MultiSource/Applications/siod/siod: 3.27% (2.2184 => 2.2910, std.dev.: 0.0197) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.25% (0.4559 => 0.4707, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.22% (4.1763 => 4.3109, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.20% (1.1685 => 1.2059, std.dev.: 0.0105) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.12% (4.4880 => 4.6280, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.09% (1.4479 => 1.4927, std.dev.: 0.0033) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.08% (6.6074 => 6.8109, std.dev.: 0.0619) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.08% (1.6386 => 1.6890, std.dev.: 0.0096) MultiSource/Benchmarks/nbench/nbench: 3.04% (1.1271 => 1.1614, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/football/football: 2.99% (0.8768 => 0.9030, std.dev.: 0.0033) MultiSource/Applications/d/make_dparser: 2.98% (3.2366 => 3.3331, std.dev.: 0.0105) MultiSource/Applications/minisat/minisat: 2.96% (0.6834 => 0.7036, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.95% (4.4873 => 4.6195, std.dev.: 0.0276) MultiSource/Applications/lua/lua: 2.94% (3.8189 => 3.9312, std.dev.: 0.0418) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.89% (13.1811 => 13.5617, std.dev.: 0.0280) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.88% (1.5315 => 1.5756, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.76% (0.8697 => 0.8937, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.67% (0.8885 => 0.9122, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.62% (0.5191 => 0.5327, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.61% (0.8457 => 0.8678, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 2.59% (31.8598 => 32.6838, std.dev.: 0.0533) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.49% (0.8611 => 0.8825, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.46% (4.5702 => 4.6828, std.dev.: 0.0346) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.39% (0.9688 => 0.9920, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.37% (0.9069 => 0.9284, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.37% (0.9074 => 0.9289, std.dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 2.37% (6.7320 => 6.8914, std.dev.: 0.0322) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.36% (0.8007 => 0.8196, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.35% (0.8597 => 0.8799, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.34% (0.8716 => 0.8920, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.31% (0.6586 => 0.6738, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.30% (0.9056 => 0.9264, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.29% (1.2602 => 1.2891, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.28% (0.8805 => 0.9006, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.28% (0.7932 => 0.8113, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.26% (0.9908 => 1.0132, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.26% (0.8420 => 0.8610, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.26% (0.8069 => 0.8251, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 2.26% (2.3764 => 2.4300, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.25% (0.8712 => 0.8908, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.25% (0.9039 => 0.9242, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.20% (0.8518 => 0.8705, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.19% (0.8316 => 0.8498, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 2.18% (8.6247 => 8.8125, std.dev.: 0.0578) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.14% (0.8656 => 0.8841, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.13% (0.8066 => 0.8238, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.10% (0.8204 => 0.8376, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.08% (0.8177 => 0.8347, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.07% (0.8338 => 0.8511, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.07% (0.8050 => 0.8217, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.07% (0.8261 => 0.8432, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.06% (0.8359 => 0.8531, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.06% (0.8317 => 0.8488, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 2.05% (0.7557 => 0.7712, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.03% (0.8086 => 0.8250, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.02% (3.1832 => 3.2476, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.00% (0.8855 => 0.9032, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.98% (0.7966 => 0.8124, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.95% (0.8927 => 0.9101, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.75% (0.8286 => 0.8431, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.67% (0.8995 => 0.9145, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.60% (1.0945 => 1.1120, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 105.03% (0.0199 => 0.0408, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/pi: 56.27% (1.5795 => 2.4683, std.dev.: 0.0227) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.33% (2.9753 => 3.4613, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.22% (0.7597 => 0.8829, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.70% (2.7995 => 3.2111, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6087, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.19% (6.3772 => 7.0273, std.dev.: 0.0432) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.11% (1.1857 => 1.2819, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/queens: 7.26% (1.7056 => 1.8295, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.77% (4.7794 => 5.1031, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 6.13% (3.1873 => 3.3828, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.92% (4.9686 => 5.2626, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.86% (4.5327 => 4.7981, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/richards_benchmark: 5.60% (1.3037 => 1.3767, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.66% (6.2275 => 6.5177, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.46% (3.3761 => 3.5267, std.dev.: 0.0087) MultiSource/Applications/lambda-0_1_3/lambda: 4.35% (7.4933 => 7.8195, std.dev.: 0.0543) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.10% (4.9453 => 5.1479, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.00% (4.9469 => 5.1450, std.dev.: 0.0195) MultiSource/Applications/hexxagon/hexxagon: 3.91% (14.0064 => 14.5542, std.dev.: 0.0509) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.64% (0.2887 => 0.2992, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 3.53% (8.4326 => 8.7301, std.dev.: 0.0558) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.48% (0.3587 => 0.3712, std.dev.: 0.0017) MultiSource/Applications/siod/siod: 3.06% (3.6643 => 3.7766, std.dev.: 0.0046) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.99% (1.2337 => 1.2706, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.79% (8.2783 => 8.5096, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.78% (11.5690 => 11.8909, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout/lists: 2.32% (7.3375 => 7.5074, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.25% (4.8660 => 4.9753, std.dev.: 0.0167) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.15% (4.8362 => 4.9402, std.dev.: 0.0145) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.69% (1.1365 => 1.1557, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: 1.58% (1.2061 => 1.2251, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.28% (2.4647 => 2.4963, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.05% (3.5679 => 3.6055, std.dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.62% (8.4179 => 8.1132, std.dev.: 0.0803) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.06% (5.4641 => 4.3136, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.74% (7.2130 => 6.2220, std.dev.: 0.2428) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.89% (1.0512 => 0.9367, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: -10.74% (1.1216 => 1.0011, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.73% (14.6451 => 13.3663, std.dev.: 0.0965) MultiSource/Benchmarks/mafft/pairlocalalign: -8.51% (63.1822 => 57.8058, std.dev.: 0.0633) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.41% (0.3269 => 0.2994, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/heapsort: -7.25% (3.2926 => 3.0540, std.dev.: 0.0370) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.89% (4.7482 => 4.4209, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.00% (3.7148 => 3.4919, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.90% (5.4972 => 5.1731, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.11% (5.1557 => 4.8925, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.34% (4.7449 => 4.5388, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.80% (6.0224 => 5.7936, std.dev.: 0.0159) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.41% (2.8773 => 2.7792, std.dev.: 0.0178) MultiSource/Applications/lua/lua: -3.37% (29.8330 => 28.8279, std.dev.: 0.0991) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (28.5821 => 27.6679, std.dev.: 0.0302) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.19% (0.5807 => 0.5622, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.65% (9.9065 => 9.6439, std.dev.: 0.0261) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.58% (2.6356 => 2.5675, std.dev.: 0.0006) MultiSource/Applications/aha/aha: -2.52% (3.3398 => 3.2556, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: -2.19% (3.4237 => 3.3487, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.11% (2.4490 => 2.3974, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/mason/mason: -2.03% (0.5415 => 0.5305, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (11.5316 => 11.2992, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.83% (3.2169 => 3.1580, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.64% (2.3487 => 2.3101, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.57% (4.9994 => 4.9207, std.dev.: 0.0080) SingleSource/Benchmarks/Dhrystone/fldry: -1.46% (0.6910 => 0.6809, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.18% (5.6343 => 5.5679, std.dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.26% (1.0262 => 1.0597, std.dev.: 0.0106) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 65.85% (0.0123 => 0.0204, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 27.95% (0.0254 => 0.0325, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -33.68% (0.0190 => 0.0126, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/test1: 7.22% (0.0180 => 0.0193, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.71% (0.1438 => 0.1477, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: -3.58% (1.1329 => 1.0923, std.dev.: 0.0450) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.24% (0.4164 => 0.4174, std.dev.: 0.0309) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.84% (0.1369 => 0.1449, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.83% (0.0641 => 0.0578, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 35.90% (0.0195 => 0.0265, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.98% (0.0578 => 0.0555, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.00% (1.1437 => 1.2009, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 400.00% (0.0001 => 0.0005, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.37% (0.0627 => 0.0562, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.67% (0.0180 => 0.0228, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.07% (0.8017 => 0.7771, std.dev.: 0.0024) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -35.48% (0.0062 => 0.0040, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Nov 24 21:42:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 24 Nov 2012 23:42:03 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121125054203.77EEB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6223?compare_to=6217&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6223, Order: 168554, Start Time: 2012-11-25 03:23:02, End Time: 2012-11-25 05:42:29 To: 6217, Order: 168548, Start Time: 2012-11-25 00:08:17, End Time: 2012-11-25 02:28:33 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 39 (132 on baseline) Performance Improvements: 2 (39 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1045 (714 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.05% (0.1410 => 0.1594, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 11.17% (0.4825 => 0.5364, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: 9.11% (0.5159 => 0.5629, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.85% (0.6184 => 0.6731, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 8.65% (0.5918 => 0.6430, std.dev.: 0.0132) MultiSource/Applications/lua/lua: 8.54% (4.3758 => 4.7495, std.dev.: 0.0890) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.52% (0.6440 => 0.6989, std.dev.: 0.0182) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.41% (0.1332 => 0.1444, std.dev.: 0.0029) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.09% (0.1249 => 0.1350, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.87% (1.0347 => 1.1161, std.dev.: 0.0254) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.28% (0.4463 => 0.4788, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/ary2: 7.16% (0.3713 => 0.3979, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.90% (0.4694 => 0.5018, std.dev.: 0.0116) MultiSource/Benchmarks/McCat/09-vor/vor: 6.88% (0.3560 => 0.3805, std.dev.: 0.0083) MultiSource/Benchmarks/McCat/18-imp/imp: 6.59% (0.3887 => 0.4143, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/05-eks/eks: 5.07% (0.4793 => 0.5036, std.dev.: 0.0091) MultiSource/Applications/lambda-0_1_3/lambda: 5.05% (0.9256 => 0.9723, std.dev.: 0.0115) MultiSource/Applications/JM/ldecod/ldecod: 4.82% (9.5781 => 10.0402, std.dev.: 0.0474) SingleSource/UnitTests/ObjC++/property-reference-object: 4.82% (0.6619 => 0.6938, std.dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.64% (4.8909 => 5.1179, std.dev.: 0.0282) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.98% (0.6880 => 0.7154, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/08-main/main: 3.60% (0.3359 => 0.3480, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 3.53% (1.0516 => 1.0887, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 3.52% (0.7566 => 0.7832, std.dev.: 0.0090) SingleSource/UnitTests/ObjC/property: 3.26% (0.4569 => 0.4718, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.97% (0.6612 => 0.6742, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.57% (11.9463 => 12.1342, std.dev.: 0.0645) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 56.79% (5.0346 => 7.8939, std.dev.: 0.5102) SingleSource/Benchmarks/Misc/flops: 28.58% (6.7483 => 8.6771, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 21.80% (0.1197 => 0.1458, std.dev.: 0.0059) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.62% (25.0940 => 29.0143, std.dev.: 0.0276) MultiSource/Applications/JM/ldecod/ldecod: 15.04% (0.1217 => 0.1400, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/ary3: 12.87% (3.9080 => 4.4108, std.dev.: 0.1886) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 10.83% (6.4027 => 7.0959, std.dev.: 0.0777) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.41% (0.4308 => 0.4584, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/hash: 6.15% (0.7604 => 0.8072, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/hash2: 5.79% (3.3692 => 3.5642, std.dev.: 0.0423) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.44% (1.8423 => 1.9426, std.dev.: 0.0380) MultiSource/Applications/siod/siod: 4.32% (3.1772 => 3.3143, std.dev.: 0.0270) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.02% (11.8015 => 11.4452, std.dev.: 0.1171) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/ObjC/synchronized: -34.45% (0.2203 => 0.1444, std.dev.: 0.0219) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.65% (69.2958 => 69.7452, std.dev.: 0.1418) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1338 => 0.1338, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.34% (0.0449 => 0.0443, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.26% (0.0681 => 0.0652, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -0.01% (494.0111 => 493.9717, std.dev.: 0.1258) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 10.28% (63.2438 => 69.7452, std.dev.: 0.1418) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.99% (4.3882 => 0.0443, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43703.47% (1.1277 => 493.9717, std.dev.: 0.1258) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 193.08% (0.5229 => 1.5325, std.dev.: 0.1132) MultiSource/Applications/SPASS/SPASS: 19.85% (14.9895 => 17.9652, std.dev.: 0.4646) MultiSource/Applications/kimwitu++/kc: 46.45% (14.1553 => 20.7303, std.dev.: 0.2292) MultiSource/Benchmarks/MallocBench/gs/gs: 24.48% (4.1105 => 5.1168, std.dev.: 0.1221) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.62% (1.1048 => 1.5094, std.dev.: 0.0711) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 426.38% (7.1582 => 37.6794, std.dev.: 0.5120) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.12% (3.4629 => 6.4105, std.dev.: 0.2924) SingleSource/Benchmarks/Misc-C++/stepanov_container: 79.38% (0.6222 => 1.1161, std.dev.: 0.0254) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10484.86% (0.0720 => 7.6211, std.dev.: 0.2703) MultiSource/Applications/SIBsim4/SIBsim4: 3860400.00% (0.0001 => 3.8605, std.dev.: 0.0399) MultiSource/Applications/SPASS/SPASS: 12264500.00% (0.0001 => 12.2646, std.dev.: 2.0016) MultiSource/Applications/kimwitu++/kc: 52000.00% (0.0001 => 0.0521, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 577000.00% (0.0001 => 0.5771, std.dev.: 0.0235) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10075300.00% (0.0001 => 10.0754, std.dev.: 0.0153) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6111700.00% (0.0001 => 6.1118, std.dev.: 0.6446) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1823.83% (1.1194 => 21.5353, std.dev.: 0.1118) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 74.17% (2.9384 => 5.1179, std.dev.: 0.0282) MultiSource/Applications/ClamAV/clamscan: 72.09% (22.1758 => 38.1614, std.dev.: 0.2655) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.27% (7.0540 => 10.9527, std.dev.: 0.3287) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.14% (8.1363 => 12.1342, std.dev.: 0.0645) MultiSource/Applications/JM/lencod/lencod: 48.62% (21.9371 => 32.6037, std.dev.: 0.0277) MultiSource/Benchmarks/FreeBench/distray/distray: 44.41% (0.1056 => 0.1525, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/almabench: 37.81% (0.0730 => 0.1006, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 37.43% (0.1432 => 0.1968, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/08-main/main: 36.26% (0.2554 => 0.3480, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 35.48% (0.1584 => 0.2146, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 31.90% (0.0793 => 0.1046, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 30.81% (0.7433 => 0.9723, std.dev.: 0.0115) SingleSource/UnitTests/vla: 29.58% (0.0355 => 0.0460, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 28.96% (0.1236 => 0.1594, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.56% (0.0675 => 0.0861, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/dry: 27.41% (0.0456 => 0.0581, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/15-trie/trie: 26.38% (0.0527 => 0.0666, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.96% (0.0886 => 0.1116, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/lists: 25.88% (0.0626 => 0.0788, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 25.52% (0.3441 => 0.4319, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/hash: 25.06% (0.4289 => 0.5364, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/04-bisect/bisect: 24.01% (0.1062 => 0.1317, std.dev.: 0.0045) MultiSource/Benchmarks/llubenchmark/llu: 23.59% (0.0462 => 0.0571, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 23.41% (0.0457 => 0.0564, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Oscar: 23.27% (0.0636 => 0.0784, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.19% (0.0746 => 0.0919, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 22.71% (1.5415 => 1.8915, std.dev.: 0.0312) MultiSource/Applications/lua/lua: 22.65% (3.8723 => 4.7495, std.dev.: 0.0890) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.45% (0.0842 => 0.1031, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: 22.04% (0.8921 => 1.0887, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/hash2: 21.84% (0.4620 => 0.5629, std.dev.: 0.0074) MultiSource/Benchmarks/NPB-serial/is/is: 21.70% (0.0719 => 0.0875, std.dev.: 0.0041) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.46% (0.1566 => 0.1902, std.dev.: 0.0109) SingleSource/UnitTests/ObjC/property: 21.41% (0.3886 => 0.4718, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 21.29% (2.2969 => 2.7860, std.dev.: 0.0926) MultiSource/Benchmarks/Olden/health/health: 21.21% (0.1268 => 0.1537, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: 21.21% (0.0481 => 0.0583, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 21.03% (0.3423 => 0.4143, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/perlin: 20.90% (0.0536 => 0.0648, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.81% (0.2758 => 0.3332, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 20.46% (0.3427 => 0.4128, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.33% (0.5105 => 0.6143, std.dev.: 0.0173) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.26% (0.0770 => 0.0926, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/tsp/tsp: 20.17% (0.1175 => 0.1412, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/09-vor/vor: 19.65% (0.3180 => 0.3805, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.60% (0.1337 => 0.1599, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.39% (0.4615 => 0.5510, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.39% (0.4203 => 0.5018, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.54% (0.8067 => 0.9563, std.dev.: 0.0269) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.53% (0.1117 => 0.1324, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 18.26% (0.5981 => 0.7073, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 18.12% (0.0640 => 0.0756, std.dev.: 0.0007) SingleSource/UnitTests/2006-12-11-LoadConstants: 18.11% (0.1143 => 0.1350, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.92% (14.3668 => 16.9420, std.dev.: 0.4347) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 17.87% (0.1125 => 0.1326, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/ray: 17.81% (0.4064 => 0.4788, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/ary2: 17.76% (0.3379 => 0.3979, std.dev.: 0.0087) SingleSource/UnitTests/ObjC/synchronized: 17.69% (0.3561 => 0.4191, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/whetstone: 17.42% (0.0660 => 0.0775, std.dev.: 0.0022) MultiSource/Applications/d/make_dparser: 17.32% (3.3354 => 3.9131, std.dev.: 0.1463) SingleSource/Benchmarks/Shootout-C++/strcat: 17.31% (0.2831 => 0.3321, std.dev.: 0.0137) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.30% (0.8172 => 0.9586, std.dev.: 0.0300) MultiSource/Applications/hbd/hbd: 17.28% (1.5603 => 1.8299, std.dev.: 0.0466) MultiSource/Benchmarks/McCat/05-eks/eks: 17.14% (0.4299 => 0.5036, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/ary: 17.08% (0.3232 => 0.3784, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.87% (0.2756 => 0.3221, std.dev.: 0.0107) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.42% (0.0871 => 0.1014, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.36% (0.0648 => 0.0754, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 16.11% (3.8922 => 4.5192, std.dev.: 0.2111) MultiSource/Benchmarks/Olden/em3d/em3d: 15.69% (0.1695 => 0.1961, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.64% (0.2065 => 0.2388, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout/matrix: 15.53% (0.0818 => 0.0945, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/mst/mst: 15.48% (0.1163 => 0.1343, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/trivial-interface: 15.26% (0.3473 => 0.4003, std.dev.: 0.0108) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.22% (0.0953 => 0.1098, std.dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference-object: 15.06% (0.6030 => 0.6938, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.76% (5.0018 => 5.7403, std.dev.: 0.1373) SingleSource/UnitTests/ObjC++/Hello: 14.63% (0.5925 => 0.6792, std.dev.: 0.0151) MultiSource/Applications/viterbi/viterbi: 14.60% (0.1555 => 0.1782, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference: 14.58% (0.7326 => 0.8394, std.dev.: 0.0205) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.51% (0.0834 => 0.0955, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.14% (0.2107 => 0.2405, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.51% (0.1029 => 0.1168, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.30% (0.2271 => 0.2573, std.dev.: 0.0109) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 13.06% (0.3177 => 0.3592, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 12.80% (1.2842 => 1.4486, std.dev.: 0.0459) MultiSource/Applications/treecc/treecc: 12.49% (2.0273 => 2.2806, std.dev.: 0.0798) MultiSource/Benchmarks/Olden/bh/bh: 12.32% (0.3092 => 0.3473, std.dev.: 0.0100) MultiSource/Applications/sqlite3/sqlite3: 12.13% (17.1811 => 19.2650, std.dev.: 0.5810) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.63% (0.4103 => 0.4580, std.dev.: 0.0164) SingleSource/UnitTests/ObjC/exceptions: 11.15% (0.3828 => 0.4255, std.dev.: 0.0161) MultiSource/Benchmarks/PAQ8p/paq8p: 10.40% (10.3673 => 11.4452, std.dev.: 0.1171) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.14% (0.3650 => 0.4020, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.80% (0.3162 => 0.3472, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/neural/neural: 9.64% (0.1463 => 0.1604, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.89% (0.4879 => 0.5264, std.dev.: 0.0106) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.29% (4.3953 => 11.0011, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/methcall: 147.39% (5.3999 => 13.3590, std.dev.: 0.0080) MultiSource/Benchmarks/llubenchmark/llu: 108.94% (3.7781 => 7.8939, std.dev.: 0.5102) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 40.79% (0.3256 => 0.4584, std.dev.: 0.0067) MultiSource/Benchmarks/VersaBench/dbms/dbms: 28.77% (1.5086 => 1.9426, std.dev.: 0.0380) MultiSource/Benchmarks/McCat/09-vor/vor: 26.34% (0.1154 => 0.1458, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/ary3: 19.23% (3.6994 => 4.4108, std.dev.: 0.1886) SingleSource/Benchmarks/Misc/oourafft: 17.48% (6.6465 => 7.8085, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.69% (1.1145 => 1.3005, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/health/health: 14.22% (0.4445 => 0.5077, std.dev.: 0.0232) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.38% (0.2944 => 0.3338, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/hash2: 12.87% (3.1578 => 3.5642, std.dev.: 0.0423) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.57% (2.8904 => 3.2247, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: 10.23% (1.1396 => 1.2562, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.31% (1.7254 => 1.8861, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 8.28% (0.7455 => 0.8072, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/strcat: 7.74% (0.1899 => 0.2046, std.dev.: 0.0033) MultiSource/Applications/lemon/lemon: 7.38% (1.4460 => 1.5527, std.dev.: 0.0195) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.92% (0.9540 => 1.0105, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.46% (4.2280 => 4.4589, std.dev.: 0.0162) MultiSource/Applications/lua/lua: 5.38% (26.0924 => 27.4969, std.dev.: 0.1548) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.6436 => 12.1224, std.dev.: 0.0055) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.34% (0.4162 => 0.4301, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: 2.16% (2.4116 => 2.4638, std.dev.: 0.0125) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.13% (1.3677 => 1.3968, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 2.05% (3.1595 => 3.2242, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: 1.65% (85.0658 => 86.4715, std.dev.: 0.1794) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (27.8444 => 28.2703, std.dev.: 0.0449) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.42% (6.5088 => 6.6011, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.24% (5.2139 => 5.2785, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0503, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1678, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.88% (5.2763 => 1.2729, std.dev.: 0.0382) SingleSource/Benchmarks/Misc/salsa20: -75.40% (0.8651 => 0.2128, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/richards_benchmark: -45.07% (0.1622 => 0.0891, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.93% (5.3855 => 4.6892, std.dev.: 0.1604) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.45% (5.3526 => 4.6861, std.dev.: 0.1761) MultiSource/Applications/JM/ldecod/ldecod: -3.79% (10.4361 => 10.0402, std.dev.: 0.0474) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.26% (0.3987 => 0.2382, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.28% (4.5009 => 2.7781, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.16% (2.6546 => 2.0132, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -19.44% (0.2161 => 0.1741, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -16.03% (1.6925 => 1.4212, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2840, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.76% (32.5116 => 29.0143, std.dev.: 0.0276) SingleSource/Benchmarks/Misc/mandel-2: -10.67% (1.5373 => 1.3733, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -10.47% (9.5636 => 8.5626, std.dev.: 0.2284) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.05% (1.5660 => 1.4243, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4793, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.2416 => 3.0208, std.dev.: 0.0304) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -5.18% (19.9488 => 18.9158, std.dev.: 0.2328) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5055, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: -4.30% (6.2999 => 6.0292, std.dev.: 0.0042) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.25% (1.6805 => 1.6258, std.dev.: 0.0185) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8918, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.89% (0.9957 => 0.9669, std.dev.: 0.0108) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.31% (0.4808 => 0.4697, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.89% (8.1563 => 8.0022, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6771, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -1.48% (10.2830 => 10.1303, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0012) Report Time: 2.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 00:31:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 02:31:16 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121125083116.019902A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6224?compare_to=6220&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6224, Order: 168556, Start Time: 2012-11-25 05:05:06, End Time: 2012-11-25 08:31:44 To: 6220, Order: 168549, Start Time: 2012-11-25 00:56:12, End Time: 2012-11-25 04:17:13 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (167 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1092 (725 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.44% (0.0625 => 0.0884, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.36% (0.1063 => 0.1407, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.89% (0.0714 => 0.0906, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.20% (0.2969 => 0.3747, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.41% (0.1106 => 0.1387, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.71% (0.4253 => 0.5304, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.64% (0.4139 => 0.5159, std.dev.: 0.0184) MultiSource/Applications/oggenc/oggenc: 24.42% (1.5932 => 1.9822, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.01% (0.4994 => 0.6193, std.dev.: 0.0220) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.79% (0.0475 => 0.0588, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 23.67% (0.0452 => 0.0559, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.41% (0.5900 => 0.7281, std.dev.: 0.0416) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.02% (0.5000 => 0.6151, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.75% (0.0822 => 0.1009, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.41% (0.1620 => 0.1983, std.dev.: 0.0125) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.07% (0.0897 => 0.1095, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.84% (0.1021 => 0.1244, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.50% (0.1107 => 0.1345, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.76% (0.1103 => 0.1332, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.70% (0.0633 => 0.0764, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/em3d/em3d: 20.57% (0.0948 => 0.1143, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.40% (0.0642 => 0.0773, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.40% (0.0495 => 0.0596, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.38% (0.0584 => 0.0703, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.34% (0.1003 => 0.1207, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.22% (0.3903 => 0.4692, std.dev.: 0.0227) MultiSource/Benchmarks/Olden/health/health: 19.98% (0.0821 => 0.0985, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.95% (0.1549 => 0.1858, std.dev.: 0.0064) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.70% (0.1604 => 0.1920, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/power/power: 19.54% (0.0604 => 0.0722, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 19.39% (0.1619 => 0.1933, std.dev.: 0.0063) MultiSource/Applications/viterbi/viterbi: 18.80% (0.0947 => 0.1125, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.67% (0.1462 => 0.1735, std.dev.: 0.0066) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.43% (0.3890 => 0.4607, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.37% (1.3152 => 1.5568, std.dev.: 0.0641) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.22% (0.2014 => 0.2381, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/08-main/main: 17.98% (0.1218 => 0.1437, std.dev.: 0.0059) SingleSource/UnitTests/ObjC++/Hello: 17.89% (0.5826 => 0.6868, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/mst/mst: 17.62% (0.0698 => 0.0821, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.62% (0.2736 => 0.3218, std.dev.: 0.0120) SingleSource/UnitTests/ObjC++/property-reference-object: 17.56% (0.5889 => 0.6923, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 17.55% (0.4029 => 0.4736, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 17.41% (0.1505 => 0.1767, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.37% (0.1088 => 0.1277, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.24% (0.2866 => 0.3360, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.12% (0.1968 => 0.2305, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.94% (0.4658 => 0.5447, std.dev.: 0.0140) MultiSource/Applications/Burg/burg: 16.91% (0.5546 => 0.6484, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 16.86% (0.0605 => 0.0707, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.83% (3.5627 => 4.1624, std.dev.: 0.1057) MultiSource/Benchmarks/MallocBench/gs/gs: 16.82% (1.8794 => 2.1956, std.dev.: 0.0802) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.48% (1.6211 => 1.8883, std.dev.: 0.0645) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.47% (0.5026 => 0.5854, std.dev.: 0.0209) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.38% (0.1160 => 0.1350, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.28% (0.2875 => 0.3343, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.23% (0.3271 => 0.3802, std.dev.: 0.0113) MultiSource/Applications/hbd/hbd: 16.17% (0.9697 => 1.1265, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 15.95% (1.0781 => 1.2501, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/18-imp/imp: 15.90% (0.1421 => 0.1647, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.89% (0.4361 => 0.5054, std.dev.: 0.0204) SingleSource/Regression/C++/ofstream_ctor: 15.81% (0.3004 => 0.3479, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.78% (0.3930 => 0.4550, std.dev.: 0.0229) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.74% (0.2738 => 0.3169, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.68% (4.4195 => 5.1124, std.dev.: 0.1380) SingleSource/Benchmarks/Shootout-C++/strcat: 15.64% (0.2750 => 0.3180, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 15.58% (0.2780 => 0.3213, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 15.56% (0.2725 => 0.3149, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 15.51% (0.2714 => 0.3135, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.46% (0.2911 => 0.3361, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 15.45% (0.7171 => 0.8279, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 15.43% (0.2813 => 0.3247, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.43% (0.2729 => 0.3150, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 15.38% (0.2803 => 0.3234, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 15.37% (0.2823 => 0.3257, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 15.37% (0.9909 => 1.1432, std.dev.: 0.0035) MultiSource/Applications/ClamAV/clamscan: 15.36% (4.2109 => 4.8579, std.dev.: 0.0034) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.34% (2.7292 => 3.1478, std.dev.: 0.0915) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.33% (0.2792 => 0.3220, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 15.32% (0.2566 => 0.2959, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.31% (1.9694 => 2.2710, std.dev.: 0.0777) SingleSource/Benchmarks/Shootout-C++/except: 15.30% (0.2811 => 0.3241, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.28% (1.9966 => 2.3017, std.dev.: 0.0664) MultiSource/Benchmarks/Olden/bh/bh: 15.26% (0.1284 => 0.1480, std.dev.: 0.0041) MultiSource/Benchmarks/Bullet/bullet: 15.18% (23.5202 => 27.0915, std.dev.: 0.0241) SingleSource/Benchmarks/Shootout-C++/wc: 15.18% (0.3096 => 0.3566, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.09% (0.3195 => 0.3677, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.06% (2.0673 => 2.3786, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ary3: 14.94% (0.3267 => 0.3755, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.77% (0.1090 => 0.1251, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: 14.76% (0.3258 => 0.3739, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 14.56% (0.3317 => 0.3800, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.38% (0.3060 => 0.3500, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 14.31% (0.2075 => 0.2372, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.28% (0.3362 => 0.3842, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 14.19% (0.3678 => 0.4200, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 14.13% (0.3460 => 0.3949, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 14.13% (0.3496 => 0.3990, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 14.10% (0.3446 => 0.3932, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/exceptions-4: 14.08% (0.3465 => 0.3953, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.08% (0.3488 => 0.3979, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 14.07% (0.3469 => 0.3957, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 14.04% (0.4146 => 0.4728, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.02% (0.3124 => 0.3562, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.02% (0.3282 => 0.3742, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 14.00% (0.3442 => 0.3924, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.97% (0.3845 => 0.4382, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 13.90% (0.3726 => 0.4244, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 13.89% (0.3348 => 0.3813, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 13.86% (0.3477 => 0.3959, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 13.81% (1.4269 => 1.6240, std.dev.: 0.0683) SingleSource/UnitTests/ObjC/property: 13.78% (0.3650 => 0.4153, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 13.74% (0.4251 => 0.4835, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.71% (0.3625 => 0.4122, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.51% (0.3643 => 0.4135) SingleSource/UnitTests/ObjC/parameter-passing: 13.45% (0.3724 => 0.4225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.36% (0.3981 => 0.4513, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.33% (0.3690 => 0.4182, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 13.22% (0.7875 => 0.8916, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 13.00% (2.1653 => 2.4467, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 12.89% (0.2691 => 0.3038, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 12.81% (0.5012 => 0.5654, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 12.68% (4.6177 => 5.2034, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 12.47% (2.1013 => 2.3634, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.16% (0.2040 => 0.2288, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.53% (0.6435 => 0.7177, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 11.50% (5.5417 => 6.1789, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.28% (0.1028 => 0.1144, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.96% (0.3084 => 0.3422, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 10.92% (0.3498 => 0.3880, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.85% (0.2737 => 0.3034, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.77% (0.1383 => 0.1532, std.dev.: 0.0053) MultiSource/Applications/siod/siod: 10.52% (0.6634 => 0.7332, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.44% (0.2068 => 0.2284, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 10.38% (0.4847 => 0.5350, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 9.98% (0.3336 => 0.3669, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.84% (0.2103 => 0.2310, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 9.54% (0.2391 => 0.2619, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 9.44% (2.0346 => 2.2266, std.dev.: 0.0131) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.87% (11.6398 => 12.6718, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.85% (4.6926 => 5.1081, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.54% (0.5361 => 0.5819, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.84% (0.5584 => 0.6022, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.84% (0.7426 => 0.8008, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 6.78% (11.9555 => 12.7664, std.dev.: 0.2649) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.54% (0.3792 => 0.3964, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 66.51% (0.2162 => 0.3600, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.27% (0.5917 => 0.6702, std.dev.: 0.0078) MultiSource/Applications/ClamAV/clamscan: 9.17% (0.2802 => 0.3059, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6119, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6765, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-2: 4.94% (1.8057 => 1.8949, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1664, std.dev.: 0.0124) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6444, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2006, std.dev.: 0.0061) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.52% (3.1722 => 3.2204, std.dev.: 0.0039) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3107, std.dev.: 0.0137) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2879, std.dev.: 0.0309) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0037) MultiSource/Benchmarks/BitBench/five11/five11: 1.20% (8.4155 => 8.5166, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.72% (2.4764 => 2.3844, std.dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.78% (25.4195 => 16.5775, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary2: -10.57% (0.2402 => 0.2148, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9792, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.57% (35.5013 => 32.8122, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0029) SingleSource/UnitTests/Vector/build2: -3.56% (11.2080 => 10.8089, std.dev.: 0.0021) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -2.67% (17.2379 => 16.7772, std.dev.: 0.0889) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.26% (41.7953 => 40.8514, std.dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5786, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4957, std.dev.: 0.0222) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1744, std.dev.: 0.0698) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0424, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 01:00:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 03:00:51 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121125090051.829592A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6225?compare_to=6223&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6225, Order: 168556, Start Time: 2012-11-25 06:38:04, End Time: 2012-11-25 09:01:19 To: 6223, Order: 168554, Start Time: 2012-11-25 03:23:02, End Time: 2012-11-25 05:42:29 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 41 (157 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1045 (689 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.65% (0.5773 => 0.6503, std.dev.: 0.0067) MultiSource/Applications/aha/aha: 12.55% (0.1331 => 0.1498, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.98% (0.4324 => 0.4842, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/sieve: 11.88% (0.4022 => 0.4500, std.dev.: 0.0101) MultiSource/Applications/Burg/burg: 11.34% (1.3319 => 1.4829, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/ary3: 11.18% (0.3587 => 0.3988, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.03% (0.3763 => 0.4178, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists1: 10.91% (0.4089 => 0.4535, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wc: 10.46% (0.3338 => 0.3687, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.16% (6.4105 => 7.0617, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.89% (0.3224 => 0.3543, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.84% (0.6426 => 0.7058, std.dev.: 0.0158) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.52% (0.1902 => 0.2083, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.46% (2.4980 => 2.7344, std.dev.: 0.0842) SingleSource/Benchmarks/Stanford/Puzzle: 8.80% (0.1398 => 0.1521, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.67% (4.5192 => 4.9108, std.dev.: 0.0291) MultiSource/Applications/lemon/lemon: 8.49% (1.1993 => 1.3011, std.dev.: 0.0336) MultiSource/Applications/oggenc/oggenc: 8.24% (6.5209 => 7.0585, std.dev.: 0.1096) SingleSource/Benchmarks/Misc/oourafft: 8.15% (0.3585 => 0.3877, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 7.15% (0.3148 => 0.3373, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.12% (0.9586 => 1.0269, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/except: 6.86% (0.3147 => 0.3363, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/matrix: 6.58% (0.3388 => 0.3611, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/ary: 5.18% (0.3784 => 0.3980, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.63% (0.3221 => 0.3370, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.42% (0.5018 => 0.5240, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.18% (0.7272 => 0.7576, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary2: 3.59% (0.3979 => 0.4122, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.43% (0.5510 => 0.5699, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 15.22% (0.0762 => 0.0878, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 14.99% (3.7960 => 4.3651, std.dev.: 0.1840) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 4.77% (6.2122 => 6.5087, std.dev.: 0.0350) SingleSource/Benchmarks/McGill/chomp: 4.67% (1.2180 => 1.2749, std.dev.: 0.0204) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.85% (84.3032 => 87.5491, std.dev.: 0.6679) MultiSource/Applications/sqlite3/sqlite3: 3.18% (4.5928 => 4.7389, std.dev.: 0.0280) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.30% (1.9426 => 1.9872, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.00% (4.7021 => 4.7962, std.dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/ackermann: 1.60% (1.7425 => 1.7704, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.45% (3.0208 => 3.0646, std.dev.: 0.0075) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.35% (2.1823 => 2.2117, std.dev.: 0.0094) MultiSource/Applications/SIBsim4/SIBsim4: 1.34% (3.8605 => 3.9122, std.dev.: 0.0120) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.21% (69.7452 => 69.5959, std.dev.: 0.2139) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 1.12% (0.1338 => 0.1353, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.71% (0.0443 => 0.0431, std.dev.: 0.0060) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.14% (0.0652 => 0.0679, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -0.16% (493.9717 => 493.1632, std.dev.: 0.3538) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 10.04% (63.2438 => 69.5959, std.dev.: 0.2139) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.02% (4.3882 => 0.0431, std.dev.: 0.0060) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43631.77% (1.1277 => 493.1632, std.dev.: 0.3538) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 193.36% (0.5229 => 1.5340, std.dev.: 0.1000) MultiSource/Applications/SPASS/SPASS: 19.56% (14.9895 => 17.9208, std.dev.: 0.4524) MultiSource/Applications/kimwitu++/kc: 46.71% (14.1553 => 20.7670, std.dev.: 0.6958) MultiSource/Benchmarks/MallocBench/gs/gs: 21.72% (4.1105 => 5.0033, std.dev.: 0.1748) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.67% (1.1048 => 1.5099, std.dev.: 0.0706) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 427.32% (7.1582 => 37.7466, std.dev.: 0.4804) SingleSource/Benchmarks/Misc-C++-EH/spirit: 103.92% (3.4629 => 7.0617, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.57% (0.6222 => 1.0302, std.dev.: 0.0504) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10504.31% (0.0720 => 7.6351, std.dev.: 0.2871) MultiSource/Applications/SIBsim4/SIBsim4: 3912100.00% (0.0001 => 3.9122, std.dev.: 0.0120) MultiSource/Applications/SPASS/SPASS: 12049700.00% (0.0001 => 12.0498, std.dev.: 2.2379) MultiSource/Applications/kimwitu++/kc: 53500.00% (0.0001 => 0.0536, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 577400.00% (0.0001 => 0.5775, std.dev.: 0.0193) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10085800.00% (0.0001 => 10.0859, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5674000.00% (0.0001 => 5.6741, std.dev.: 0.2737) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1833.63% (1.1194 => 21.6451, std.dev.: 0.2808) MultiSource/Applications/ClamAV/clamscan: 66.93% (22.1758 => 37.0181, std.dev.: 0.7772) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 62.24% (2.9384 => 4.7673, std.dev.: 0.2065) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.21% (7.0540 => 10.8782, std.dev.: 0.3110) MultiSource/Applications/JM/lencod/lencod: 48.62% (21.9371 => 32.6039, std.dev.: 0.2017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.01% (8.1363 => 11.9615, std.dev.: 0.1884) MultiSource/Benchmarks/FreeBench/distray/distray: 44.22% (0.1056 => 0.1523, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/almabench: 44.11% (0.0730 => 0.1052, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 43.58% (0.1432 => 0.2056, std.dev.: 0.0029) SingleSource/Benchmarks/Stanford/Oscar: 37.74% (0.0636 => 0.0876, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 33.01% (0.1566 => 0.2083, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 30.15% (0.1151 => 0.1498, std.dev.: 0.0031) SingleSource/UnitTests/vla: 29.58% (0.0355 => 0.0460, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 29.10% (0.1584 => 0.2045, std.dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/dry: 27.41% (0.0456 => 0.0581, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 27.38% (1.1642 => 1.4829, std.dev.: 0.0131) SingleSource/Benchmarks/Stanford/Towers: 26.75% (0.0471 => 0.0597, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 26.34% (0.3307 => 0.4178, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.17% (3.8922 => 4.9108, std.dev.: 0.0291) SingleSource/Benchmarks/Stanford/IntMM: 26.14% (0.0394 => 0.0497, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 26.04% (0.1175 => 0.1481, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/lists: 26.04% (0.0626 => 0.0789, std.dev.: 0.0021) SingleSource/Benchmarks/Stanford/FloatMM: 25.69% (0.0401 => 0.0504, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.66% (0.8172 => 1.0269, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/reversefile: 25.28% (0.3865 => 0.4842, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/sieve: 24.90% (0.3603 => 0.4500, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/spellcheck: 24.67% (0.4203 => 0.5240, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 24.16% (2.2024 => 2.7344, std.dev.: 0.0842) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.09% (0.1125 => 0.1396, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 24.03% (0.0437 => 0.0542, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 23.49% (0.4615 => 0.5699, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.32% (0.0746 => 0.0920, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary: 23.14% (0.3232 => 0.3980, std.dev.: 0.0069) SingleSource/Benchmarks/McGill/chomp: 23.14% (0.1655 => 0.2038, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/lists1: 23.10% (0.3684 => 0.4535, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/exptree: 23.10% (0.0814 => 0.1002, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 22.96% (0.4064 => 0.4997, std.dev.: 0.0115) MultiSource/Applications/oggenc/oggenc: 22.56% (5.7591 => 7.0585, std.dev.: 0.1096) SingleSource/Benchmarks/Shootout-C++/sumcol: 22.55% (0.2891 => 0.3543, std.dev.: 0.0003) MultiSource/Benchmarks/llubenchmark/llu: 22.51% (0.0462 => 0.0566, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 22.41% (0.3441 => 0.4212, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/strcat: 22.36% (0.2831 => 0.3464, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/ackermann: 22.28% (0.2756 => 0.3370, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: 22.04% (0.2554 => 0.3117, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/ary2: 21.99% (0.3379 => 0.4122, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 21.93% (0.0953 => 0.1162, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.67% (0.0886 => 0.1078, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/matrix: 21.64% (0.0818 => 0.0995, std.dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: 21.56% (0.0719 => 0.0874, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary3: 21.47% (0.3283 => 0.3988, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 21.45% (1.5415 => 1.8722, std.dev.: 0.0258) SingleSource/Benchmarks/Dhrystone/fldry: 21.41% (0.0481 => 0.0584, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 21.35% (1.0722 => 1.3011, std.dev.: 0.0336) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.03% (0.2758 => 0.3338, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/wc: 20.81% (0.3052 => 0.3687, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Puzzle: 19.95% (0.1268 => 0.1521, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 19.94% (0.3109 => 0.3729, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 19.94% (0.0672 => 0.0806, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.92% (0.0793 => 0.0951, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.75% (0.1337 => 0.1601, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/whetstone: 19.55% (0.0660 => 0.0789, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/misr: 18.64% (0.0633 => 0.0751, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 18.54% (0.8921 => 1.0575, std.dev.: 0.0245) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 18.48% (1.5859 => 1.8790, std.dev.: 0.0753) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.44% (0.2700 => 0.3198, std.dev.: 0.0160) SingleSource/Benchmarks/Misc/oourafft: 18.13% (0.3282 => 0.3877, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/messages-2: 18.13% (0.0662 => 0.0782, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: 18.01% (0.4636 => 0.5471, std.dev.: 0.0247) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.94% (0.5981 => 0.7054, std.dev.: 0.0211) SingleSource/UnitTests/Vector/SSE/sse_isamax: 17.76% (0.0704 => 0.0829, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.73% (14.3668 => 16.9138, std.dev.: 0.4402) MultiSource/Applications/d/make_dparser: 17.50% (3.3354 => 3.9190, std.dev.: 0.0945) SingleSource/UnitTests/ObjC/parameter-passing: 17.37% (0.3927 => 0.4609, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/methcall: 17.24% (0.2877 => 0.3373, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/except: 17.14% (0.2871 => 0.3363, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.98% (0.0842 => 0.0985, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/fibo: 16.92% (0.2725 => 0.3186, std.dev.: 0.0136) SingleSource/UnitTests/ObjC/exceptions: 16.69% (0.3828 => 0.4467, std.dev.: 0.0120) SingleSource/UnitTests/ObjC/property: 16.68% (0.3886 => 0.4534, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/matrix: 16.56% (0.3098 => 0.3611, std.dev.: 0.0087) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.45% (0.3543 => 0.4126, std.dev.: 0.0177) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.42% (0.0871 => 0.1014, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.32% (0.2065 => 0.2402, std.dev.: 0.0123) MultiSource/Benchmarks/Olden/em3d/em3d: 16.22% (0.1695 => 0.1970, std.dev.: 0.0085) SingleSource/UnitTests/ObjC/synchronized: 16.03% (0.3561 => 0.4132, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 15.91% (0.0798 => 0.0925, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/trivial-interface: 15.87% (0.3473 => 0.4024, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/exceptions-4: 15.86% (0.3543 => 0.4105, std.dev.: 0.0099) MultiSource/Applications/lua/lua: 15.78% (3.8723 => 4.4835, std.dev.: 0.2037) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 15.78% (0.0640 => 0.0741, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/mst/mst: 15.74% (0.1163 => 0.1346, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/for-in: 15.65% (0.3694 => 0.4272, std.dev.: 0.0137) SingleSource/UnitTests/ObjC/exceptions-3: 15.61% (0.3516 => 0.4065, std.dev.: 0.0083) MultiSource/Applications/hexxagon/hexxagon: 15.57% (1.2842 => 1.4842, std.dev.: 0.0392) SingleSource/Benchmarks/Misc-C++/bigfib: 15.52% (0.6456 => 0.7458, std.dev.: 0.0285) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.43% (0.0648 => 0.0748, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.13% (0.1117 => 0.1286, std.dev.: 0.0044) SingleSource/UnitTests/ObjC++/property-reference-object: 14.68% (0.6030 => 0.6915, std.dev.: 0.0124) MultiSource/Benchmarks/Olden/health/health: 14.67% (0.1268 => 0.1454, std.dev.: 0.0060) MultiSource/Applications/viterbi/viterbi: 14.66% (0.1555 => 0.1783, std.dev.: 0.0064) SingleSource/UnitTests/ObjC++/Hello: 14.62% (0.5925 => 0.6791, std.dev.: 0.0112) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.55% (0.0770 => 0.0882, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/lpbench: 14.53% (0.0929 => 0.1064, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.51% (0.0834 => 0.0955, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 14.46% (0.7326 => 0.8385, std.dev.: 0.0170) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.39% (0.3121 => 0.3570, std.dev.: 0.0165) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.35% (0.1143 => 0.1307, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.05% (0.2107 => 0.2403, std.dev.: 0.0096) MultiSource/Applications/spiff/spiff: 13.96% (0.7835 => 0.8929, std.dev.: 0.0420) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.65% (0.3935 => 0.4472, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.31% (0.1029 => 0.1166, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.17% (0.2271 => 0.2570, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.03% (0.6675 => 0.7545, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.84% (0.3177 => 0.3585, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 12.41% (9.4845 => 10.6612, std.dev.: 0.4332) MultiSource/Applications/sqlite3/sqlite3: 12.12% (17.1811 => 19.2632, std.dev.: 0.5992) MultiSource/Applications/hbd/hbd: 11.90% (1.5603 => 1.7460, std.dev.: 0.0604) SingleSource/UnitTests/ObjC/exceptions-2: 10.98% (0.3497 => 0.3881, std.dev.: 0.0145) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.91% (0.1906 => 0.2114, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.15% (0.1892 => 0.2084, std.dev.: 0.0051) MultiSource/Benchmarks/PAQ8p/paq8p: 9.39% (10.3673 => 11.3407, std.dev.: 0.1796) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.98% (0.2872 => 0.3130, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.75% (0.4879 => 0.5257, std.dev.: 0.0095) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 149.33% (4.3953 => 10.9587, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/methcall: 147.39% (5.3999 => 13.3589, std.dev.: 0.0092) MultiSource/Benchmarks/VersaBench/dbms/dbms: 31.72% (1.5086 => 1.9872, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/oourafft: 17.48% (6.6465 => 7.8085, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/ary3: 17.28% (3.7221 => 4.3651, std.dev.: 0.1840) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.65% (1.1145 => 1.3001, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary2: 15.98% (0.0757 => 0.0878, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.21% (0.2944 => 0.3333, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.56% (2.8904 => 3.2245, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 10.28% (1.1396 => 1.2568, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.51% (1.7254 => 1.8894, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.11% (8.6802 => 9.4707, std.dev.: 0.2723) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.92% (4.2280 => 4.4782, std.dev.: 0.0038) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 4.68% (26.0924 => 27.3147, std.dev.: 0.1334) MultiSource/Benchmarks/nbench/nbench: 4.09% (11.6436 => 12.1198, std.dev.: 0.0100) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.33% (1.7133 => 1.7704, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.23% (2.1424 => 2.2117, std.dev.: 0.0094) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 2.15% (3.1334 => 3.2007, std.dev.: 0.0190) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970) MultiSource/Applications/aha/aha: 2.07% (3.1595 => 3.2249, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 2.04% (4.6441 => 4.7389, std.dev.: 0.0280) SingleSource/Benchmarks/Dhrystone/dry: 1.99% (2.4116 => 2.4595, std.dev.: 0.0075) MultiSource/Benchmarks/PAQ8p/paq8p: 1.64% (85.0658 => 86.4622, std.dev.: 0.3164) SingleSource/Benchmarks/Shootout-C++/lists: 1.59% (12.5348 => 12.7337, std.dev.: 0.0628) SingleSource/Benchmarks/Shootout-C++/sieve: 1.57% (2.4858 => 2.5248, std.dev.: 0.0082) MultiSource/Benchmarks/mafft/pairlocalalign: 1.55% (27.8444 => 28.2753, std.dev.: 0.0468) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.33% (6.5088 => 6.5952, std.dev.: 0.0180) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0313 => 1.0441, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0501, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.51% (6.6874 => 0.1668, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.25% (5.2763 => 1.2533, std.dev.: 0.0497) SingleSource/Benchmarks/Misc/salsa20: -75.39% (0.8651 => 0.2129, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/richards_benchmark: -44.88% (0.1622 => 0.0894, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.79% (5.3855 => 4.6966, std.dev.: 0.1543) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.40% (5.3526 => 4.6891, std.dev.: 0.1399) MultiSource/Applications/JM/ldecod/ldecod: -12.08% (10.4361 => 9.1758, std.dev.: 0.4700) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -9.30% (1.7609 => 1.5972, std.dev.: 0.0619) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.28% (0.3987 => 0.2381, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.32% (4.5009 => 2.7763, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.15% (2.6546 => 2.0136, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: -19.20% (0.2161 => 0.1746, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.75% (1.6925 => 1.4260, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2839, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.72% (32.5116 => 29.0279, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/mandel-2: -10.62% (1.5373 => 1.3740, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -10.51% (9.5636 => 8.5582, std.dev.: 0.1311) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.02% (1.5660 => 1.4247, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -5.96% (19.9488 => 18.7596, std.dev.: 0.2231) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7497, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.46% (3.2416 => 3.0646, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5074, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/lists: -4.43% (6.2999 => 6.0206, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.33% (0.9957 => 0.9625, std.dev.: 0.0099) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8915, std.dev.: 0.0042) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.64% (0.4808 => 0.4681, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.90% (8.1563 => 8.0017, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6769, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -1.45% (10.2830 => 10.1334, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.89% (0.1485 => 0.1353, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.91% (0.2116 => 0.0679, std.dev.: 0.0005) Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 02:09:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 04:09:10 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121125100910.4816E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6226?compare_to=6222&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6226, Order: 168557, Start Time: 2012-11-25 08:35:27, End Time: 2012-11-25 10:09:41 To: 6222, Order: 168556, Start Time: 2012-11-25 03:45:28, End Time: 2012-11-25 05:15:22 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 8 (52 on baseline) Performance Improvements: 1 (22 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1045 (900 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 5.15% (0.9006 => 0.9470, std.dev.: 0.0142) SingleSource/UnitTests/Vector/constpool: 4.13% (8.1132 => 8.4486, std.dev.: 0.0484) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel24: 69.33% (0.3081 => 0.5217, std.dev.: 0.0168) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.28% (1.5055 => 1.8861, std.dev.: 0.0274) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.88% (39.9923 => 41.1444, std.dev.: 0.4393) MultiSource/Benchmarks/BitBench/five11/five11: 2.76% (5.6494 => 5.8052, std.dev.: 0.0280) MultiSource/Applications/lua/lua: 1.40% (28.8279 => 29.2310, std.dev.: 0.1501) SingleSource/Benchmarks/Misc/pi: 1.30% (2.4683 => 2.5004, std.dev.: 0.0075) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/SPASS/SPASS: -4.98% (8.7301 => 8.2955, std.dev.: 0.1153) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.91% (1.0597 => 1.0693, std.dev.: 0.0220) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 6.86% (0.0204 => 0.0218, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.47% (0.0428 => 0.0426, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 2.46% (0.0325 => 0.0333, std.dev.: 0.0096) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0313 => 0.0312, std.dev.: 0.0097) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0422 => 0.0422, std.dev.: 0.0114) SingleSource/UnitTests/Vector/Altivec/casts: 62.70% (0.0126 => 0.0205, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/test1: 12.95% (0.0193 => 0.0218, std.dev.: 0.0039) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 700.00% (0.0001 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.41% (0.1477 => 0.1471, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 4.85% (1.0923 => 1.1453, std.dev.: 0.2291) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.33% (0.4174 => 0.4313, std.dev.: 0.0936) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.69% (0.1449 => 0.1459, std.dev.: 0.0340) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.80% (0.0578 => 0.0652, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.13% (0.0265 => 0.0268, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.08% (0.0555 => 0.0561, std.dev.: 0.0157) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.80% (1.2009 => 1.1913, std.dev.: 0.1629) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 500.00% (0.0005 => 0.0030, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 15.48% (0.0562 => 0.0649, std.dev.: 0.0154) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.67% (0.0228 => 0.0266, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.22% (0.7771 => 0.7866, std.dev.: 0.0010) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -50.00% (0.0002 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: -50.00% (0.0002 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 25.00% (0.0040 => 0.0050, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.62% (16.4461 => 17.8641, std.dev.: 0.5077) MultiSource/Applications/sqlite3/sqlite3: 2322.63% (0.6332 => 15.3401, std.dev.: 0.3266) MultiSource/Benchmarks/McCat/08-main/main: 50.63% (0.1831 => 0.2758, std.dev.: 0.0785) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.35% (0.1559 => 0.1460, std.dev.: 0.0205) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7070.41% (0.3123 => 22.3932, std.dev.: 0.9366) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.35% (0.2463 => 0.3703, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1530.74% (0.3344 => 5.4532, std.dev.: 0.0258) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.14% (0.2364 => 0.3242, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 3.84% (0.6010 => 0.6241, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.55% (0.3266 => 0.3382, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/strcat: 3.25% (0.1969 => 0.2033, std.dev.: 0.0103) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.45% (0.0224 => 0.0225, std.dev.: 0.0008) SingleSource/UnitTests/byval-alignment: -32.17% (0.0230 => 0.0156, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0521, std.dev.: 0.0133) MultiSource/Applications/oggenc/oggenc: 11.90% (0.1462 => 0.1636, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4771, std.dev.: 0.0261) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0709, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4884, std.dev.: 0.0185) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5110, std.dev.: 0.0154) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5912, std.dev.: 0.3125) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3262, std.dev.: 0.0283) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1256, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3626, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4011, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0846, std.dev.: 0.0019) SingleSource/Regression/C/uint64_to_float: -23.71% (2.1832 => 1.6656, std.dev.: 0.0020) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.55% (0.8805 => 0.9470, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 5.24% (0.8885 => 0.9351, std.dev.: 0.0107) MultiSource/Applications/spiff/spiff: 4.78% (0.7950 => 0.8330, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 4.29% (0.8712 => 0.9086, std.dev.: 0.0132) MultiSource/Applications/sgefa/sgefa: 3.97% (0.2999 => 0.3118, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.88% (2.1401 => 2.2232, std.dev.: 0.0083) MultiSource/Applications/Burg/burg: 3.50% (1.2222 => 1.2650, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.50% (0.3115 => 0.3224, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 3.36% (3.8189 => 3.9472, std.dev.: 0.0304) MultiSource/Applications/treecc/treecc: 3.32% (1.9948 => 2.0610, std.dev.: 0.0129) MultiSource/Applications/siod/siod: 3.32% (2.2184 => 2.2920, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.30% (0.8177 => 0.8447, std.dev.: 0.0078) MultiSource/Applications/SPASS/SPASS: 3.26% (14.2605 => 14.7257, std.dev.: 0.0420) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.98% (1.5315 => 1.5772, std.dev.: 0.0033) MultiSource/Applications/ClamAV/clamscan: 2.96% (14.7684 => 15.2054, std.dev.: 0.0333) MultiSource/Applications/SIBsim4/SIBsim4: 2.93% (1.2568 => 1.2936, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.83% (0.8340 => 0.8576, std.dev.: 0.0059) MultiSource/Applications/d/make_dparser: 2.50% (3.2366 => 3.3175, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.35% (0.8338 => 0.8534, std.dev.: 0.0075) MultiSource/Applications/JM/lencod/lencod: 2.27% (15.3280 => 15.6764, std.dev.: 0.0087) MultiSource/Applications/lemon/lemon: 2.21% (1.0945 => 1.1187, std.dev.: 0.0089) MultiSource/Applications/JM/ldecod/ldecod: 2.02% (6.7320 => 6.8680, std.dev.: 0.0230) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.94% (3.1832 => 3.2449, std.dev.: 0.0115) MultiSource/Applications/oggenc/oggenc: 1.39% (4.9628 => 5.0316, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 123.12% (0.0199 => 0.0444, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/pi: 58.30% (1.5795 => 2.5004, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.47% (2.9753 => 3.4652, std.dev.: 0.0480) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.81% (2.7995 => 3.2140, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 14.68% (0.7597 => 0.8712, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.67% (5.0261 => 5.6125, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.88% (6.3772 => 6.8797, std.dev.: 0.1564) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.81% (1.1857 => 1.2783, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 7.49% (1.7056 => 1.8334, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.11% (4.7794 => 5.1191, std.dev.: 0.1053) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.38% (4.5327 => 4.8221, std.dev.: 0.0611) SingleSource/Benchmarks/Misc/richards_benchmark: 6.23% (1.3037 => 1.3849, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.96% (4.9686 => 5.2648, std.dev.: 0.0320) MultiSource/Applications/SIBsim4/SIBsim4: 5.85% (3.1873 => 3.3738, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.32% (6.2275 => 6.5591, std.dev.: 0.1104) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.99% (3.3761 => 3.5446, std.dev.: 0.0176) MultiSource/Applications/lambda-0_1_3/lambda: 4.52% (7.4933 => 7.8320, std.dev.: 0.0286) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.92% (4.9453 => 5.1392, std.dev.: 0.0279) MultiSource/Applications/hexxagon/hexxagon: 3.81% (14.0064 => 14.5401, std.dev.: 0.1620) MultiSource/Benchmarks/BitBench/five11/five11: 3.61% (5.6030 => 5.8052, std.dev.: 0.0280) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.57% (0.3587 => 0.3715, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 2.89% (3.6643 => 3.7703, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.59% (11.5690 => 11.8686, std.dev.: 0.0302) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.50% (8.2783 => 8.4855, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (1.1365 => 1.1623, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: 2.22% (7.3375 => 7.5007, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.06% (4.8362 => 4.9359, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/ReedSolomon: 1.22% (8.5322 => 8.6359, std.dev.: 0.0150) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.58% (5.4641 => 4.3397, std.dev.: 0.0361) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.71% (7.2130 => 6.2961, std.dev.: 0.1062) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.92% (1.0512 => 0.9364, std.dev.: 0.0177) MultiSource/Benchmarks/mafft/pairlocalalign: -8.53% (63.1822 => 57.7930, std.dev.: 0.1117) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.66% (4.7482 => 4.4321, std.dev.: 0.0291) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.85% (14.6451 => 13.7890, std.dev.: 0.2624) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.73% (5.4972 => 5.1824, std.dev.: 0.0350) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.67% (3.7148 => 3.5043, std.dev.: 0.0282) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.97% (5.1557 => 4.8993, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.77% (4.7449 => 4.5662, std.dev.: 0.0230) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.72% (6.0224 => 5.7986, std.dev.: 0.0496) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.28% (1.3882 => 1.3427, std.dev.: 0.0149) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.06% (28.5821 => 27.7079, std.dev.: 0.1927) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.03% (0.5807 => 0.5631, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.59% (3.2169 => 3.1335, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/hash2: -2.39% (3.4237 => 3.3419, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.36% (2.6356 => 2.5734, std.dev.: 0.0095) MultiSource/Applications/aha/aha: -2.27% (3.3398 => 3.2640, std.dev.: 0.0012) MultiSource/Applications/lua/lua: -2.02% (29.8330 => 29.2310, std.dev.: 0.1501) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.93% (9.9065 => 9.7150, std.dev.: 0.0586) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.81% (11.5316 => 11.3227, std.dev.: 0.0587) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.35% (4.9994 => 4.9321, std.dev.: 0.0102) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.20% (1.0262 => 1.0693, std.dev.: 0.0220) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0096) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0097) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0114) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0039) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.29% (0.1438 => 0.1471, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.09% (1.1329 => 1.1453, std.dev.: 0.2291) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.58% (0.4164 => 0.4313, std.dev.: 0.0936) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.57% (0.1369 => 0.1459, std.dev.: 0.0340) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.72% (0.0641 => 0.0652, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 37.44% (0.0195 => 0.0268, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.94% (0.0578 => 0.0561, std.dev.: 0.0157) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.16% (1.1437 => 1.1913, std.dev.: 0.1629) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.51% (0.0627 => 0.0649, std.dev.: 0.0154) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.88% (0.8017 => 0.7866, std.dev.: 0.0010) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -19.35% (0.0062 => 0.0050, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 02:12:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 04:12:09 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121125101209.0C2A22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6227?compare_to=6221&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6227, Order: 168557, Start Time: 2012-11-25 08:38:50, End Time: 2012-11-25 10:12:39 To: 6221, Order: 168556, Start Time: 2012-11-25 03:31:08, End Time: 2012-11-25 05:04:35 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (177 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (861 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.18% (2.0538 => 2.0780, std.dev.: 0.0010) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.68% (2.0478 => 2.1027, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4937 => 7.6764, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/hash2: 2.38% (3.1932 => 3.2692, std.dev.: 0.0083) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.85% (0.3821 => 0.3521, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -6.46% (2.4924 => 2.3315, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.42% (0.9542 => 0.8929, std.dev.: 0.0023) MultiSource/Applications/sgefa/sgefa: -6.40% (0.3357 => 0.3142, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.18% (0.2428 => 0.2278, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -6.02% (0.2160 => 0.2030, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.94% (0.2355 => 0.2215, std.dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: -5.91% (16.1920 => 15.2348, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.91% (0.6484 => 0.6101, std.dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: -5.88% (7.0961 => 6.6785, std.dev.: 0.0132) MultiSource/Benchmarks/mafft/pairlocalalign: -5.87% (9.2283 => 8.6870, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.85% (0.7198 => 0.6777, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.85% (0.1796 => 0.1691, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.84% (0.9852 => 0.9277, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.75% (4.8161 => 4.5394, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/football/football: -5.74% (0.9179 => 0.8652, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.74% (0.3658 => 0.3448, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.71% (1.0544 => 0.9942, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/exceptions-4: -5.70% (0.3880 => 0.3659, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -5.69% (0.1879 => 0.1772, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -5.69% (0.3848 => 0.3629, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.67% (0.3812 => 0.3596, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.66% (0.3831 => 0.3614, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.66% (0.3884 => 0.3664, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.66% (1.3722 => 1.2945, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/synchronized: -5.65% (0.3896 => 0.3676, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.61% (3.5339 => 3.3357, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/for-in: -5.58% (0.4033 => 0.3808, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.56% (0.5863 => 0.5537, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: -5.56% (4.3330 => 4.0923, std.dev.: 0.0147) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.55% (6.7716 => 6.3957, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.54% (0.5705 => 0.5389, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (0.5857 => 0.5533, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: -5.53% (0.4176 => 0.3945, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.53% (0.3891 => 0.3676, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.50% (1.6364 => 1.5464, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.49% (0.5478 => 0.5177, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.49% (0.5570 => 0.5264, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.49% (4.8802 => 4.6124, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.49% (0.6052 => 0.5720, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -5.48% (1.1450 => 1.0822, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.48% (0.6446 => 0.6093, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.47% (4.0323 => 3.8118, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.46% (1.2300 => 1.1628, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.43% (0.5925 => 0.5603, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.42% (0.2695 => 0.2549, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.42% (0.6297 => 0.5956, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.41% (0.6667 => 0.6306, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.40% (0.6736 => 0.6372, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.39% (0.5802 => 0.5489, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -5.39% (0.2985 => 0.2824, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.39% (1.4642 => 1.3853, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.39% (0.6293 => 0.5954, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.38% (0.5591 => 0.5290, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.38% (0.6230 => 0.5895, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.37% (0.5805 => 0.5493, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.36% (0.6304 => 0.5966, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.34% (0.3406 => 0.3224, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.34% (0.7919 => 0.7496, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: -5.32% (0.4515 => 0.4275, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.31% (4.5069 => 4.2675, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.31% (14.2083 => 13.4538, std.dev.: 0.0253) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.31% (0.5575 => 0.5279, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.31% (0.5859 => 0.5548, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.30% (0.5849 => 0.5539, std.dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: -5.29% (1.1530 => 1.0920, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/property: -5.29% (0.4199 => 0.3977, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -5.27% (17.1032 => 16.2011, std.dev.: 0.0055) MultiSource/Applications/Burg/burg: -5.26% (1.2515 => 1.1857, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.25% (0.5581 => 0.5288, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.20% (1.2784 => 1.2119, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: -5.19% (0.3581 => 0.3395, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.18% (0.5941 => 0.5633, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.18% (0.2548 => 0.2416, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.15% (0.6660 => 0.6317, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.15% (0.6194 => 0.5875, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -5.11% (15.5079 => 14.7149, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.11% (1.2221 => 1.1597, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.09% (0.2278 => 0.2162, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.09% (0.6681 => 0.6341, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.08% (0.5999 => 0.5694, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.08% (0.5688 => 0.5399, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.08% (0.5456 => 0.5179, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.06% (8.0126 => 7.6070, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.05% (1.2210 => 1.1593, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.04% (0.2999 => 0.2848, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.03% (0.6189 => 0.5878, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.02% (0.3483 => 0.3308, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.98% (0.4916 => 0.4671, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: -4.95% (0.4280 => 0.4068, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: -4.95% (3.5154 => 3.3414, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.94% (0.6440 => 0.6122, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.93% (0.8521 => 0.8101, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.90% (0.6260 => 0.5953, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: -4.90% (1.3864 => 1.3185, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -4.89% (2.4021 => 2.2847, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.88% (0.3319 => 0.3157, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -4.88% (4.0594 => 3.8614, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.82% (0.2385 => 0.2270, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.81% (0.6676 => 0.6355, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -4.79% (0.7447 => 0.7090, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.75% (0.4151 => 0.3954, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.73% (0.7339 => 0.6992, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.73% (22.4056 => 21.3467, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.72% (0.5168 => 0.4924, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -4.70% (15.2527 => 14.5353, std.dev.: 0.0231) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.68% (0.6395 => 0.6096, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.64% (0.3837 => 0.3659, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.63% (1.6474 => 1.5711, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.63% (0.4321 => 0.4121, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: -4.60% (1.3148 => 1.2543, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.58% (0.3931 => 0.3751, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.57% (5.0226 => 4.7932, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/matrix: -4.55% (0.3255 => 0.3107, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.53% (0.7524 => 0.7183, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: -4.53% (0.3025 => 0.2888, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.52% (0.3271 => 0.3123, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -4.51% (2.1401 => 2.0436, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.48% (0.3323 => 0.3174, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: -4.48% (0.3194 => 0.3051, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.48% (0.3016 => 0.2881, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.44% (0.5569 => 0.5322, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -4.42% (0.7982 => 0.7629, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.41% (0.6395 => 0.6113, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.40% (0.4813 => 0.4601, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: -4.40% (0.3026 => 0.2893, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.38% (0.5567 => 0.5323, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.37% (0.7021 => 0.6714, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.35% (0.3057 => 0.2924, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.33% (0.5329 => 0.5098, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -4.32% (0.2871 => 0.2747, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.31% (0.3849 => 0.3683, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.31% (0.3252 => 0.3112, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.30% (2.1713 => 2.0780, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: -4.29% (0.8418 => 0.8057, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.26% (0.2933 => 0.2808, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -4.26% (0.4248 => 0.4067, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -4.25% (0.2939 => 0.2814, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: -4.22% (0.4861 => 0.4656, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.21% (0.9557 => 0.9155, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -4.19% (0.3481 => 0.3335, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -4.19% (0.3867 => 0.3705, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.17% (2.2587 => 2.1645, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.17% (0.2903 => 0.2782, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -4.12% (0.3059 => 0.2933, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: -4.11% (0.2849 => 0.2732, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -4.10% (0.7779 => 0.7460, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists: -4.06% (0.3621 => 0.3474, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: -4.06% (18.2933 => 17.5510, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/wc: -4.02% (0.3205 => 0.3076, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -4.01% (34.0927 => 32.7239, std.dev.: 0.0315) SingleSource/Benchmarks/Shootout-C++/hash: -4.00% (0.4524 => 0.4343, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: -3.98% (0.3394 => 0.3259, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -3.98% (0.3446 => 0.3309, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.98% (0.4427 => 0.4251, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.97% (0.9077 => 0.8717, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/strcat: -3.95% (0.2989 => 0.2871, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.92% (0.4083 => 0.3923, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: -3.90% (0.6441 => 0.6190, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.84% (0.3491 => 0.3357, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -3.67% (0.6750 => 0.6502, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.62% (0.6347 => 0.6117, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: -3.51% (0.3788 => 0.3655, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.31% (5.4682 => 5.2874, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: -3.20% (1.5610 => 1.5110, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -2.30% (20.7746 => 20.2976, std.dev.: 0.0608) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7517, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: -8.73% (1.2842 => 1.1721, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.82% (1.7753 => 1.7074, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.65% (2.2633 => 2.1807, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.29% (1.3096 => 1.2665, std.dev.: 0.0145) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4688, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 03:56:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 05:56:25 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121125115625.C79D42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6228?compare_to=6226&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6228, Order: 168560, Start Time: 2012-11-25 10:26:28, End Time: 2012-11-25 11:56:55 To: 6226, Order: 168557, Start Time: 2012-11-25 08:35:27, End Time: 2012-11-25 10:09:41 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 10 (122 on baseline) Performance Improvements: 12 (28 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1032 (824 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.02% (0.2033 => 0.2135, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.49% (0.9555 => 0.9984, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.65% (0.3095 => 0.3208, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.67% (0.8910 => 0.9148, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.46% (0.8565 => 0.8776, std.dev.: 0.0067) MultiSource/Applications/treecc/treecc: 2.19% (2.0610 => 2.1061, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.76% (0.8561 => 0.8712, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 1.62% (0.7650 => 0.7774, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.37% (1.1416 => 1.1572, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.39% (1.2371 => 1.2543, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/05-eks/eks: -4.75% (0.4696 => 0.4473, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.15% (0.9470 => 0.9077, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.41% (0.9181 => 0.8868, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -3.21% (0.9339 => 0.9039, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.46% (0.8572 => 0.8361, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.87% (0.9351 => 0.9176, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.67% (0.9086 => 0.8934, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.48% (0.8610 => 0.8483, std.dev.: 0.0040) MultiSource/Applications/kimwitu++/kc: -1.14% (17.8641 => 17.6596, std.dev.: 0.0579) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/five11/five11: -2.87% (5.8052 => 5.6385, std.dev.: 0.0468) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -1.89% (13.7890 => 13.5281, std.dev.: 0.0927) SingleSource/Benchmarks/Shootout/hash: -1.11% (4.3190 => 4.2712, std.dev.: 0.0092) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.50% (1.0693 => 1.0640, std.dev.: 0.0086) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0218 => 0.0218, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0426 => 0.0426, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.30% (0.0333 => 0.0332, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0312 => 0.0313, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -17.30% (0.0422 => 0.0349, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0205 => 0.0204, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -0.46% (0.0218 => 0.0217, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -87.50% (0.0008 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.95% (0.1471 => 0.1485, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 2.94% (1.1453 => 1.1790, std.dev.: 0.0222) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.69% (0.4313 => 0.4386, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.72% (0.1459 => 0.1361, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.44% (0.0652 => 0.0610, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.36% (0.0268 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.25% (0.0561 => 0.0554, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.22% (1.1913 => 1.1939, std.dev.: 0.0099) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -60.00% (0.0030 => 0.0012, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.79% (0.0649 => 0.0553, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0266 => 0.0266, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.40% (0.7866 => 0.7756, std.dev.: 0.0072) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 46.00% (0.0050 => 0.0073, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.38% (16.4461 => 17.6596, std.dev.: 0.0579) MultiSource/Applications/sqlite3/sqlite3: 2325.69% (0.6332 => 15.3595, std.dev.: 0.1248) MultiSource/Benchmarks/McCat/08-main/main: 51.01% (0.1831 => 0.2765, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.22% (0.1559 => 0.1462, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7052.80% (0.3123 => 22.3382, std.dev.: 0.6323) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.47% (0.2463 => 0.3706, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1523.00% (0.3344 => 5.4273, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.56% (0.2364 => 0.3252, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.06% (0.6010 => 0.6254, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0429 => 0.0439, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.84% (0.3266 => 0.3424, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 3.25% (0.1969 => 0.2033, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.46% (0.0224 => 0.0234, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -25.22% (0.0230 => 0.0172, std.dev.: 0.0008) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0450, std.dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: 9.03% (0.1462 => 0.1594, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4655, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0693, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4948, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5147, std.dev.: 0.0099) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5658, std.dev.: 0.0582) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3136, std.dev.: 0.0165) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1334, std.dev.: 0.2731) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3633, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4026, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0874, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: -23.88% (2.1832 => 1.6619, std.dev.: 0.0019) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.79% (0.0810 => 0.0946, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.44% (0.0848 => 0.0962, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 12.23% (0.1112 => 0.1248, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.94% (0.8321 => 0.9148, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.53% (0.1466 => 0.1591, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.30% (0.2180 => 0.2361, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.14% (0.1905 => 0.2060, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.71% (0.8148 => 0.8776, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.67% (0.1983 => 0.2135, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.65% (0.4847 => 0.5218, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.64% (0.7473 => 0.8044, std.dev.: 0.0116) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.62% (0.3137 => 0.3376, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.24% (0.2279 => 0.2444, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.05% (0.6010 => 0.6434, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.00% (0.2998 => 0.3208, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.74% (0.1885 => 0.2012, std.dev.: 0.0044) MultiSource/Applications/spiff/spiff: 6.69% (0.7950 => 0.8482, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/em3d/em3d: 6.57% (0.1721 => 0.1834, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.16% (0.3295 => 0.3498, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.07% (0.2240 => 0.2376, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.82% (0.9435 => 0.9984, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.67% (0.2133 => 0.2254, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 5.58% (1.9948 => 2.1061, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.25% (1.1685 => 1.2298, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.23% (0.6287 => 0.6616, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.00% (0.3003 => 0.3153, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.90% (1.1606 => 1.2175, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4.75% (0.8317 => 0.8712, std.dev.: 0.0028) MultiSource/Applications/hbd/hbd: 4.70% (1.4269 => 1.4940, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.54% (0.2378 => 0.2486, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.46% (1.2526 => 1.3085, std.dev.: 0.0196) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.22% (0.4127 => 0.4301, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.95% (0.4783 => 0.4972, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.93% (1.6386 => 1.7030, std.dev.: 0.0111) MultiSource/Applications/SPASS/SPASS: 3.79% (14.2605 => 14.8016, std.dev.: 0.1160) MultiSource/Applications/minisat/minisat: 3.78% (0.6834 => 0.7092, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.70% (0.8007 => 0.8303, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: 3.65% (0.2985 => 0.3094, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 3.63% (3.8189 => 3.9576, std.dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.60% (1.1170 => 1.1572, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.50% (2.1401 => 2.2150, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.47% (0.9039 => 0.9353, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 3.41% (2.2184 => 2.2940, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.38% (4.1763 => 4.3173, std.dev.: 0.0151) MultiSource/Applications/SIBsim4/SIBsim4: 3.37% (1.2568 => 1.2992, std.dev.: 0.0146) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.35% (6.6074 => 6.8285, std.dev.: 0.0579) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.33% (0.9074 => 0.9376, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 3.28% (0.8885 => 0.9176, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.22% (4.4873 => 4.6318, std.dev.: 0.0285) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.16% (4.4880 => 4.6296, std.dev.: 0.0411) MultiSource/Applications/ClamAV/clamscan: 3.13% (14.7684 => 15.2303, std.dev.: 0.0595) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.09% (0.8697 => 0.8966, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.09% (0.8805 => 0.9077, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.99% (0.8656 => 0.8915, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.98% (0.8611 => 0.8868, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.96% (0.8457 => 0.8707, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.90% (0.9056 => 0.9319, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.88% (0.8359 => 0.8600, std.dev.: 0.0092) MultiSource/Applications/JM/ldecod/ldecod: 2.87% (6.7320 => 6.9255, std.dev.: 0.0082) MultiSource/Applications/lambda-0_1_3/lambda: 2.87% (0.7557 => 0.7774, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.86% (13.1811 => 13.5586, std.dev.: 0.0905) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.85% (8.6476 => 8.8938, std.dev.: 0.0765) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.80% (0.8597 => 0.8838, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.68% (0.8177 => 0.8396, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.65% (0.8261 => 0.8480, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.63% (0.9688 => 0.9943, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.60% (0.5191 => 0.5326, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.59% (0.8716 => 0.8942, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.57% (0.9069 => 0.9302, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.56% (0.9908 => 1.0162, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.55% (0.8712 => 0.8934, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.53% (0.8340 => 0.8551, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.50% (0.8050 => 0.8251, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.45% (0.8048 => 0.8245, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.43% (0.8518 => 0.8725, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 2.43% (15.3280 => 15.6999, std.dev.: 0.0751) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.40% (1.4479 => 1.4827, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.39% (0.8069 => 0.8262, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.38% (0.8286 => 0.8483, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.36% (0.7932 => 0.8119, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 2.36% (1.0945 => 1.1203, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.28% (0.7966 => 0.8148, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.27% (0.8338 => 0.8527, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.11% (0.8420 => 0.8598, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 2.09% (4.9628 => 5.0667, std.dev.: 0.0397) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.08% (0.8855 => 0.9039, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.07% (0.8927 => 0.9112, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.06% (0.8316 => 0.8487, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/football/football: 1.95% (0.8768 => 0.8939, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.91% (0.8204 => 0.8361, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 112.56% (0.0199 => 0.0423, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/pi: 57.16% (1.5795 => 2.4823, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.66% (0.7597 => 0.8939, std.dev.: 0.0267) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.24% (2.9753 => 3.4586, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.65% (2.7995 => 3.2095, std.dev.: 0.0537) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.57% (5.0261 => 5.6076, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.16% (0.3186 => 0.3446, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.01% (1.1857 => 1.2807, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 7.49% (1.7056 => 1.8333, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.57% (4.7794 => 5.0936, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/strcat: 6.50% (0.1538 => 0.1638, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 6.46% (1.3037 => 1.3879, std.dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 6.26% (3.1873 => 3.3869, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.85% (4.5327 => 4.7980, std.dev.: 0.0669) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.77% (4.9686 => 5.2552, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.63% (6.2275 => 6.5160, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.48% (3.3761 => 3.5275, std.dev.: 0.0034) MultiSource/Applications/lambda-0_1_3/lambda: 4.24% (7.4933 => 7.8111, std.dev.: 0.0557) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.96% (4.9469 => 5.1426, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.95% (4.9453 => 5.1407, std.dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: 3.86% (14.0064 => 14.5468, std.dev.: 0.0052) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.42% (1.2337 => 1.2759, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.84% (11.5690 => 11.8979, std.dev.: 0.0628) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.52% (8.2783 => 8.4871, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.31% (4.8660 => 4.9785, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/lists: 2.24% (7.3375 => 7.5018, std.dev.: 0.0351) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.92% (1.1365 => 1.1583, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.32% (3.5679 => 3.6149, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.31% (2.4647 => 2.4971, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/power/power: 1.07% (1.2061 => 1.2190, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: 1.04% (1.0841 => 1.0954, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: 1.02% (8.5322 => 8.6191, std.dev.: 0.0132) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.12% (5.4641 => 4.3103, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.89% (7.2130 => 6.1388, std.dev.: 0.2453) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.69% (1.0512 => 0.9283, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/chomp: -10.56% (1.1216 => 1.0032, std.dev.: 0.0079) MultiSource/Benchmarks/mafft/pairlocalalign: -8.54% (63.1822 => 57.7848, std.dev.: 0.1351) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.63% (14.6451 => 13.5281, std.dev.: 0.0927) SingleSource/Benchmarks/Shootout/heapsort: -7.46% (3.2926 => 3.0469, std.dev.: 0.0804) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.89% (4.7482 => 4.4211, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.45% (0.3269 => 0.3058, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.97% (5.4972 => 5.1688, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.95% (3.7148 => 3.4937, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.17% (5.1557 => 4.8894, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.43% (4.7449 => 4.5346, std.dev.: 0.0126) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.07% (2.8773 => 2.7603, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.73% (6.0224 => 5.7975, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (28.5821 => 27.6663, std.dev.: 0.0808) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.16% (2.4490 => 2.3717, std.dev.: 0.0225) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.07% (0.5807 => 0.5629, std.dev.: 0.0023) MultiSource/Applications/lua/lua: -3.05% (29.8330 => 28.9240, std.dev.: 0.1812) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.93% (2.6356 => 2.5583, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/hash2: -2.61% (3.4237 => 3.3345, std.dev.: 0.0100) MultiSource/Applications/aha/aha: -2.47% (3.3398 => 3.2573, std.dev.: 0.0292) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.40% (9.9065 => 9.6689, std.dev.: 0.0658) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.03% (11.5316 => 11.2976, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.75% (2.3487 => 2.3075, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.70% (4.9994 => 4.9143, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.70% (3.2169 => 3.1622, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.19% (5.6343 => 5.5671, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.68% (1.0262 => 1.0640, std.dev.: 0.0086) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -9.11% (0.0384 => 0.0349, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 3.27% (0.1438 => 0.1485, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 4.07% (1.1329 => 1.1790, std.dev.: 0.0222) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.33% (0.4164 => 0.4386, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.58% (0.1369 => 0.1361, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.84% (0.0641 => 0.0610, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.15% (0.0578 => 0.0554, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.39% (1.1437 => 1.1939, std.dev.: 0.0099) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1100.00% (0.0001 => 0.0012, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.80% (0.0627 => 0.0553, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.26% (0.8017 => 0.7756, std.dev.: 0.0072) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 17.74% (0.0062 => 0.0073, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 04:09:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 06:09:17 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121125120917.1C00D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6229?compare_to=6227&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6229, Order: 168560, Start Time: 2012-11-25 10:36:01, End Time: 2012-11-25 12:09:47 To: 6227, Order: 168557, Start Time: 2012-11-25 08:38:50, End Time: 2012-11-25 10:12:39 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 3 (6 on baseline) Performance Improvements: 0 (179 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1089 (857 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 12.15% (0.3819 => 0.4283, std.dev.: 0.0098) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.99% (54.3563 => 56.5266, std.dev.: 0.0352) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.57% (5.2570 => 5.3397, std.dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 11.71% (0.3834 => 0.4283, std.dev.: 0.0098) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.58% (54.5751 => 56.5266, std.dev.: 0.0352) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.84% (2.0478 => 2.1059, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.4937 => 7.6827, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/hash2: 2.21% (3.1932 => 3.2639, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.60% (0.1431 => 0.1308, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.93% (0.3821 => 0.3518, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.56% (0.3142 => 0.2936, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -6.43% (2.4924 => 2.3321, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.37% (0.9542 => 0.8934, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: -6.19% (0.3880 => 0.3640, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.16% (0.3848 => 0.3611, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -6.11% (0.3896 => 0.3658, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -6.11% (0.3831 => 0.3597, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -6.09% (0.3812 => 0.3580, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.05% (0.2428 => 0.2281, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: -6.05% (0.4033 => 0.3789, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.02% (0.3884 => 0.3650, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: -5.99% (0.4176 => 0.3926, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.95% (0.7198 => 0.6770, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.94% (0.3891 => 0.3660, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -5.93% (0.2160 => 0.2032, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: -5.84% (16.1920 => 15.2468, std.dev.: 0.0101) MultiSource/Benchmarks/mafft/pairlocalalign: -5.80% (9.2283 => 8.6929, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.78% (0.6484 => 0.6109, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: -5.75% (0.1879 => 0.1771, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: -5.74% (0.4199 => 0.3958, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.74% (1.0544 => 0.9939, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.72% (0.9852 => 0.9288, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -5.72% (7.0961 => 6.6905, std.dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: -5.69% (0.3357 => 0.3166, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.67% (1.3722 => 1.2944, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: -5.64% (0.9179 => 0.8661, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.61% (0.2355 => 0.2223, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.60% (4.8161 => 4.5465, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.58% (0.3658 => 0.3454, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.57% (0.5478 => 0.5173, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.56% (0.5591 => 0.5280, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.50% (1.2300 => 1.1623, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.49% (0.5705 => 0.5392, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -5.48% (4.3330 => 4.0955, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.48% (0.6446 => 0.6093, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.48% (0.5570 => 0.5265, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.47% (4.0323 => 3.8116, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.47% (0.6052 => 0.5721, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.46% (1.6364 => 1.5470, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.46% (0.6230 => 0.5890, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.43% (0.5925 => 0.5603, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.43% (1.4642 => 1.3847, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.43% (0.5857 => 0.5539, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.42% (0.2695 => 0.2549, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.41% (0.6667 => 0.6306, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.41% (6.7716 => 6.4054, std.dev.: 0.0100) MultiSource/Applications/lemon/lemon: -5.41% (1.1450 => 1.0831, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.39% (0.6194 => 0.5860, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.38% (3.5339 => 3.3438, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/parameter-passing: -5.37% (0.4280 => 0.4050, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.37% (0.5863 => 0.5548, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.37% (0.6293 => 0.5955, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.36% (0.5805 => 0.5494, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.35% (0.7919 => 0.7495, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.33% (0.6736 => 0.6377, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.32% (4.8802 => 4.6204, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.32% (4.5069 => 4.2670, std.dev.: 0.0094) MultiSource/Benchmarks/sim/sim: -5.31% (0.3406 => 0.3225, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.27% (0.5581 => 0.5287, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.25% (0.4515 => 0.4278, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.23% (0.6304 => 0.5974, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -5.23% (17.1032 => 16.2082, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.22% (0.5456 => 0.5171, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.21% (0.5859 => 0.5554, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.20% (0.5999 => 0.5687, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.18% (0.5575 => 0.5286, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -5.18% (1.2515 => 1.1867, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.17% (0.5802 => 0.5502, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.17% (0.6189 => 0.5869, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -5.17% (1.1530 => 1.0934, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.17% (0.5941 => 0.5634, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.15% (0.5849 => 0.5548, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.14% (0.6260 => 0.5938, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.13% (0.6297 => 0.5974, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.13% (0.2985 => 0.2832, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.12% (1.2784 => 1.2130, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.11% (0.3931 => 0.3730, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.10% (0.2548 => 0.2418, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.09% (0.6660 => 0.6321, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.09% (0.2871 => 0.2725, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.08% (0.4151 => 0.3940, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.08% (0.2659 => 0.2524, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.06% (0.3025 => 0.2872, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.06% (0.3837 => 0.3643, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.05% (0.3483 => 0.3307, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.05% (14.2083 => 13.4908, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.05% (0.2278 => 0.2163, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.05% (0.4321 => 0.4103, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.04% (0.4916 => 0.4668, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: -5.04% (15.5079 => 14.7256, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.04% (0.3016 => 0.2864, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -5.04% (0.3255 => 0.3091, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.04% (0.3057 => 0.2903, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.04% (0.2999 => 0.2848, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.03% (0.8521 => 0.8092, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: -5.00% (0.2939 => 0.2792, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.00% (0.6440 => 0.6118, std.dev.: 0.0087) MultiSource/Benchmarks/McCat/18-imp/imp: -5.00% (0.3581 => 0.3402, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.99% (1.2210 => 1.1601, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.97% (8.0126 => 7.6145, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.96% (0.2903 => 0.2759, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: -4.96% (0.3026 => 0.2876, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.94% (0.2933 => 0.2788, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.94% (0.3323 => 0.3159, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.93% (2.1713 => 2.0643, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.93% (1.2221 => 1.1619, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: -4.92% (0.3194 => 0.3037, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.90% (0.6676 => 0.6349, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.89% (0.6033 => 0.5738, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.87% (0.5688 => 0.5411, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -4.85% (0.2989 => 0.2844, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.85% (0.6681 => 0.6357, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -4.84% (1.3148 => 1.2511, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -4.83% (3.5154 => 3.3455, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: -4.83% (1.3864 => 1.3194, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.83% (0.3849 => 0.3663, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: -4.81% (0.2849 => 0.2712, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.80% (22.4056 => 21.3303, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.78% (0.2385 => 0.2271, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: -4.78% (0.4248 => 0.4045, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -4.77% (0.3394 => 0.3232, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: -4.77% (0.7447 => 0.7092, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.74% (0.5168 => 0.4923, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.73% (0.3319 => 0.3162, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary3: -4.73% (0.3446 => 0.3283, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.73% (0.7339 => 0.6992, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -4.71% (4.0594 => 3.8680, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wc: -4.71% (0.3205 => 0.3054, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -4.71% (0.3059 => 0.2915, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -4.70% (15.2527 => 14.5351, std.dev.: 0.0203) SingleSource/Benchmarks/Shootout-C++/ary2: -4.68% (0.3481 => 0.3318, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.67% (0.3252 => 0.3100, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -4.65% (2.4021 => 2.2905, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: -4.64% (0.3621 => 0.3453, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.63% (1.6474 => 1.5711, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: -4.63% (0.3867 => 0.3688, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -4.63% (0.4861 => 0.4636, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.59% (0.4813 => 0.4592, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.58% (0.4083 => 0.3896, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.57% (0.6395 => 0.6103, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.51% (0.7524 => 0.7185, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.45% (0.5329 => 0.5092, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.43% (0.7021 => 0.6710, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: -4.41% (2.1401 => 2.0457, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: -4.40% (0.3271 => 0.3127, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.36% (0.4427 => 0.4234, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: -4.32% (18.2933 => 17.5023, std.dev.: 0.0269) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.32% (0.9557 => 0.9144, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.32% (0.6395 => 0.6119, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: -4.30% (5.0226 => 4.8066, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.26% (0.5567 => 0.5330, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -4.25% (0.6441 => 0.6167, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -4.25% (0.7982 => 0.7643, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.22% (0.5569 => 0.5334, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -4.22% (0.7779 => 0.7451, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: -4.20% (34.0927 => 32.6602, std.dev.: 0.0271) SingleSource/UnitTests/ObjC++/Hello: -4.14% (0.6347 => 0.6084, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -4.12% (0.6750 => 0.6472, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: -4.12% (0.3788 => 0.3632, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.10% (0.3491 => 0.3348, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.02% (2.2587 => 2.1679, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.01% (0.9077 => 0.8713, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: -3.93% (0.4524 => 0.4346, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -3.85% (0.8418 => 0.8094, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: -3.82% (1.5610 => 1.5013, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.42% (5.4682 => 5.2813, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -2.12% (20.7746 => 20.3344, std.dev.: 0.0225) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7564, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -8.62% (1.2842 => 1.1735, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.94% (1.7753 => 1.7054, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: -3.89% (2.2633 => 2.1752, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.56% (1.3096 => 1.2761, std.dev.: 0.0082) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.50% (6.5735 => 6.4751, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/ary3: -1.14% (3.7241 => 3.6815, std.dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 04:11:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 06:11:15 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121125121115.2EA762A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6230?compare_to=6225&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6230, Order: 168558, Start Time: 2012-11-25 09:51:54, End Time: 2012-11-25 12:11:43 To: 6225, Order: 168556, Start Time: 2012-11-25 06:38:04, End Time: 2012-11-25 09:01:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 65 (163 on baseline) Performance Improvements: 7 (40 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1014 (682 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 17.29% (0.3898 => 0.4572, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 17.18% (0.1164 => 0.1364, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 16.48% (0.6877 => 0.8010, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.99% (0.5896 => 0.6839, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.50% (0.1645 => 0.1900, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 15.38% (0.6872 => 0.7929, std.dev.: 0.0251) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 15.32% (0.7199 => 0.8302, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.78% (0.6211 => 0.7129, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 14.74% (0.1174 => 0.1347, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 14.09% (0.6698 => 0.7642, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.05% (0.0833 => 0.0950, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 13.99% (0.5911 => 0.6738, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 13.59% (0.6219 => 0.7064, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.51% (0.6165 => 0.6998, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 13.35% (0.6591 => 0.7471, std.dev.: 0.0276) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 13.26% (0.5906 => 0.6689, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/random: 13.16% (0.3047 => 0.3448, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/office/office: 13.15% (0.3385 => 0.3830, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 13.13% (0.3556 => 0.4023, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.52% (0.4193 => 0.4718, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.22% (0.2570 => 0.2884, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 12.20% (4.7673 => 5.3491, std.dev.: 0.0435) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.18% (0.1166 => 0.1308, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.14% (0.7209 => 0.8084, std.dev.: 0.0277) MultiSource/Benchmarks/Olden/bh/bh: 12.02% (0.3328 => 0.3728, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.95% (0.5623 => 0.6295, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 11.88% (0.3351 => 0.3749, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/18-imp/imp: 11.66% (0.3878 => 0.4330, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/em3d/em3d: 10.71% (0.1970 => 0.2181, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 10.68% (5.5727 => 6.1680, std.dev.: 0.0152) MultiSource/Benchmarks/Olden/health/health: 10.66% (0.1454 => 0.1609, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 10.50% (0.4764 => 0.5264, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.08% (0.2888 => 0.3179, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 9.88% (0.1346 => 0.1479, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: 9.50% (0.1610 => 0.1763, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.00% (1.5972 => 1.7410, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.74% (0.2402 => 0.2612, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.70% (2.3162 => 2.5177, std.dev.: 0.0122) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.50% (0.9061 => 0.9831, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.93% (0.1286 => 0.1388, std.dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 6.71% (1.3268 => 1.4158, std.dev.: 0.0278) MultiSource/Applications/spiff/spiff: 6.44% (0.8929 => 0.9504, std.dev.: 0.0201) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.37% (1.5099 => 1.6061, std.dev.: 0.0359) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.21% (16.9138 => 17.9643, std.dev.: 0.1305) MultiSource/Applications/d/make_dparser: 6.00% (3.9190 => 4.1540, std.dev.: 0.0648) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.82% (1.4769 => 1.5629, std.dev.: 0.0293) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.18% (11.9615 => 12.4609, std.dev.: 0.1346) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.90% (37.7466 => 38.4619, std.dev.: 0.1250) MultiSource/Benchmarks/mafft/pairlocalalign: 1.64% (10.6612 => 10.8361, std.dev.: 0.0591) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 23.52% (0.1186 => 0.1465, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/health/health: 15.50% (0.4627 => 0.5344, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bisort/bisort: 14.95% (0.8654 => 0.9948, std.dev.: 0.0073) MultiSource/Applications/JM/ldecod/ldecod: 14.09% (0.1214 => 0.1385, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.64% (0.0843 => 0.0958, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.00% (0.5775 => 0.6237, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 7.68% (1.1564 => 1.2452, std.dev.: 0.0341) MultiSource/Benchmarks/Olden/bh/bh: 6.82% (1.9575 => 2.0910, std.dev.: 0.0127) MultiSource/Benchmarks/FreeBench/neural/neural: 4.74% (0.2234 => 0.2340, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.25% (1.5396 => 1.6050, std.dev.: 0.0219) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 4.05% (9.4707 => 9.8540, std.dev.: 0.1216) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 3.37% (3.2007 => 3.3086, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.06% (4.3286 => 4.4609, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.98% (4.2370 => 4.3634, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/em3d/em3d: 2.42% (3.1300 => 3.2059, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.50% (7.2798 => 7.3888, std.dev.: 0.0183) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: -8.74% (0.2083 => 0.1901, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.33% (0.3338 => 0.3160, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (21.6451 => 20.5021, std.dev.: 0.4047) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.33% (0.7054 => 0.6819, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/gs/gs: -2.85% (5.0033 => 4.8606, std.dev.: 0.0439) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.51% (1.2533 => 1.2218, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -32.77% (6.3733 => 4.2845, std.dev.: 0.7535) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.27% (69.5959 => 69.4089, std.dev.: 0.2425) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -1.11% (0.1353 => 0.1338, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.76% (0.0431 => 0.0486, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.27% (0.0679 => 0.0650, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -0.32% (493.1632 => 491.5938, std.dev.: 1.0609) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.75% (63.2438 => 69.4089, std.dev.: 0.2425) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.89% (4.3882 => 0.0486, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43492.60% (1.1277 => 491.5938, std.dev.: 1.0609) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 193.56% (0.5229 => 1.5350, std.dev.: 0.0582) MultiSource/Applications/SPASS/SPASS: 18.69% (14.9895 => 17.7913, std.dev.: 0.3851) MultiSource/Applications/kimwitu++/kc: 48.62% (14.1553 => 21.0372, std.dev.: 0.4311) MultiSource/Benchmarks/MallocBench/gs/gs: 18.25% (4.1105 => 4.8606, std.dev.: 0.0439) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 45.37% (1.1048 => 1.6061, std.dev.: 0.0359) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 437.31% (7.1582 => 38.4619, std.dev.: 0.1250) SingleSource/Benchmarks/Misc-C++-EH/spirit: 86.14% (3.4629 => 6.4460, std.dev.: 0.2460) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.83% (0.6222 => 1.0318, std.dev.: 0.0609) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10921.25% (0.0720 => 7.9353, std.dev.: 0.1822) MultiSource/Applications/SIBsim4/SIBsim4: 3862900.00% (0.0001 => 3.8630, std.dev.: 0.0268) MultiSource/Applications/SPASS/SPASS: 13214000.00% (0.0001 => 13.2141, std.dev.: 1.5152) MultiSource/Applications/kimwitu++/kc: 51900.00% (0.0001 => 0.0520, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14400.00% (0.0001 => 0.0145, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 623600.00% (0.0001 => 0.6237, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10070200.00% (0.0001 => 10.0703, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5680800.00% (0.0001 => 5.6809, std.dev.: 0.9404) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1731.53% (1.1194 => 20.5021, std.dev.: 0.4047) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 82.04% (2.9384 => 5.3491, std.dev.: 0.0435) MultiSource/Applications/ClamAV/clamscan: 67.66% (22.1758 => 37.1790, std.dev.: 0.5910) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 53.15% (8.1363 => 12.4609, std.dev.: 0.1346) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 52.53% (7.0540 => 10.7596, std.dev.: 0.0923) MultiSource/Applications/JM/lencod/lencod: 47.55% (21.9371 => 32.3681, std.dev.: 0.1577) MultiSource/Benchmarks/FreeBench/distray/distray: 45.17% (0.1056 => 0.1533, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/almabench: 38.08% (0.0730 => 0.1008, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 37.78% (0.1432 => 0.1973, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/15-trie/trie: 32.64% (0.0527 => 0.0699, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 31.90% (0.0326 => 0.0430, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 31.23% (0.1175 => 0.1542, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/messages-2: 30.66% (0.0662 => 0.0865, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 30.14% (0.0730 => 0.0950, std.dev.: 0.0009) SingleSource/UnitTests/vla: 29.58% (0.0355 => 0.0460, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 29.02% (0.1044 => 0.1347, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: 28.75% (0.0626 => 0.0806, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 28.67% (0.1695 => 0.2181, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bisort/bisort: 28.50% (0.0614 => 0.0789, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 27.17% (0.1163 => 0.1479, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/treeadd/treeadd: 27.16% (0.0416 => 0.0529, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 26.99% (0.2271 => 0.2884, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/health/health: 26.89% (0.1268 => 0.1609, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 26.51% (0.3180 => 0.4023, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 26.50% (0.3423 => 0.4330, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 26.49% (0.2065 => 0.2612, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 26.17% (0.0447 => 0.0564, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/hash: 25.98% (0.0485 => 0.0611, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/functionobjects: 25.40% (0.5020 => 0.6295, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 25.27% (0.0467 => 0.0585, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 25.04% (14.3668 => 17.9643, std.dev.: 0.1305) MultiSource/Benchmarks/Olden/voronoi/voronoi: 25.00% (0.2700 => 0.3375, std.dev.: 0.0197) MultiSource/Applications/d/make_dparser: 24.54% (3.3354 => 4.1540, std.dev.: 0.0648) SingleSource/UnitTests/ObjC/dot-syntax-1: 24.43% (0.0479 => 0.0596, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/perimeter/perimeter: 24.42% (0.0770 => 0.0958, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.40% (0.0746 => 0.0928, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 24.26% (0.1117 => 0.1388, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: 24.17% (0.3865 => 0.4799, std.dev.: 0.0080) SingleSource/Benchmarks/Stanford/Oscar: 23.90% (0.0636 => 0.0788, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 23.32% (5.0018 => 6.1680, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 23.31% (0.3826 => 0.4718, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.06% (0.1032 => 0.1270, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/random: 23.05% (0.2802 => 0.3448, std.dev.: 0.0069) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.99% (0.0648 => 0.0797, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 22.85% (0.1151 => 0.1414, std.dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 22.58% (0.1125 => 0.1379, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/05-eks/eks: 22.45% (0.4299 => 0.5264, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 22.44% (0.1114 => 0.1364, std.dev.: 0.0045) MultiSource/Applications/Burg/burg: 22.37% (1.1642 => 1.4246, std.dev.: 0.0365) SingleSource/Benchmarks/Shootout-C++/sieve: 22.23% (0.3603 => 0.4404, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 22.14% (0.0953 => 0.1164, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/office/office: 22.13% (0.3136 => 0.3830, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 22.13% (0.2603 => 0.3179, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.93% (0.2107 => 0.2569, std.dev.: 0.0074) MultiSource/Applications/lua/lua: 21.73% (3.8723 => 4.7137, std.dev.: 0.1236) SingleSource/Benchmarks/Dhrystone/fldry: 21.62% (0.0481 => 0.0585, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 21.58% (0.0482 => 0.0586, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.39% (0.1566 => 0.1901, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 21.36% (0.8101 => 0.9831, std.dev.: 0.0043) MultiSource/Applications/spiff/spiff: 21.30% (0.7835 => 0.9504, std.dev.: 0.0201) MultiSource/Benchmarks/Olden/bh/bh: 20.57% (0.3092 => 0.3728, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/neural/neural: 20.51% (0.1463 => 0.1763, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_isamax: 20.45% (0.0704 => 0.0848, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.33% (0.1584 => 0.1906, std.dev.: 0.0105) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.33% (0.8172 => 0.9833, std.dev.: 0.0190) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.18% (0.0793 => 0.0953, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.13% (0.0770 => 0.0925, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.91% (0.4615 => 0.5534, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.84% (0.4203 => 0.5037, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 19.76% (1.3050 => 1.5629, std.dev.: 0.0293) SingleSource/Benchmarks/Shootout-C++/objinst: 19.74% (0.3131 => 0.3749, std.dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 19.58% (1.1840 => 1.4158, std.dev.: 0.0278) MultiSource/Benchmarks/VersaBench/bmm/bmm: 19.10% (0.0759 => 0.0904, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 18.91% (0.4289 => 0.5100, std.dev.: 0.0186) SingleSource/UnitTests/ObjC/parameter-passing: 18.82% (0.3927 => 0.4666, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/lists1: 18.68% (0.3684 => 0.4372, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/Large/ray: 18.50% (0.4064 => 0.4816, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C++/life/life: 18.44% (0.0933 => 0.1105, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary3: 18.25% (0.3283 => 0.3882, std.dev.: 0.0073) SingleSource/UnitTests/ObjC/property: 18.17% (0.3886 => 0.4592, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 18.06% (3.8922 => 4.5952, std.dev.: 0.1416) SingleSource/UnitTests/ObjC/trivial-interface: 17.82% (0.3473 => 0.4092, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary: 17.82% (0.3232 => 0.3808, std.dev.: 0.0178) SingleSource/Benchmarks/Misc/whetstone: 17.73% (0.0660 => 0.0777, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.70% (0.0842 => 0.0991, std.dev.: 0.0047) SingleSource/Regression/C++/ofstream_ctor: 17.66% (0.2905 => 0.3418, std.dev.: 0.0118) SingleSource/UnitTests/ObjC/synchronized: 17.38% (0.3561 => 0.4180, std.dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.38% (0.2756 => 0.3235, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/strcat: 17.38% (0.2831 => 0.3323, std.dev.: 0.0098) SingleSource/UnitTests/ObjC/exceptions-4: 17.36% (0.3543 => 0.4158, std.dev.: 0.0075) SingleSource/UnitTests/ObjC/exceptions-2: 17.24% (0.3497 => 0.4100, std.dev.: 0.0109) SingleSource/UnitTests/ObjC/exceptions-3: 17.24% (0.3516 => 0.4122, std.dev.: 0.0106) SingleSource/UnitTests/ObjC/exceptions: 17.22% (0.3828 => 0.4487, std.dev.: 0.0094) SingleSource/UnitTests/ObjC/instance-method-metadata: 17.19% (0.3543 => 0.4152, std.dev.: 0.0077) MultiSource/Applications/hbd/hbd: 17.15% (1.5603 => 1.8279, std.dev.: 0.0426) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 16.92% (0.1625 => 0.1900, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/for-in: 16.76% (0.3694 => 0.4313, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.72% (4.9449 => 5.7718, std.dev.: 0.1524) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.65% (0.0871 => 0.1016, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/matrix: 16.63% (0.0818 => 0.0954, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 16.60% (1.2842 => 1.4974, std.dev.: 0.0348) MultiSource/Applications/sqlite3/sqlite3: 15.92% (17.1811 => 19.9157, std.dev.: 0.5425) MultiSource/Applications/oggenc/oggenc: 15.62% (5.7591 => 6.6585, std.dev.: 0.1723) SingleSource/UnitTests/ObjC++/Hello: 15.49% (0.5925 => 0.6843, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.46% (0.0886 => 0.1023, std.dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference-object: 15.44% (0.6030 => 0.6961, std.dev.: 0.0120) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.38% (4.2646 => 4.9207, std.dev.: 0.2028) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.18% (1.1861 => 1.3662, std.dev.: 0.0459) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.99% (0.0834 => 0.0959, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference: 14.69% (0.7326 => 0.8402, std.dev.: 0.0172) MultiSource/Applications/viterbi/viterbi: 14.66% (0.1555 => 0.1783, std.dev.: 0.0063) MultiSource/Applications/minisat/minisat: 14.62% (0.7115 => 0.8155, std.dev.: 0.0290) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.58% (0.2758 => 0.3160, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 14.46% (0.0719 => 0.0823, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.33% (2.2022 => 2.5177, std.dev.: 0.0122) MultiSource/Benchmarks/mafft/pairlocalalign: 14.25% (9.4845 => 10.8361, std.dev.: 0.0591) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.12% (0.1062 => 0.1212, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.01% (0.5981 => 0.6819, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.61% (0.1337 => 0.1519, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.51% (0.1029 => 0.1168, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.34% (0.3441 => 0.3900, std.dev.: 0.0136) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.86% (0.1143 => 0.1290, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.75% (1.5415 => 1.7381, std.dev.: 0.0538) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.33% (0.8067 => 0.8981, std.dev.: 0.0265) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.90% (0.6450 => 0.7153, std.dev.: 0.0222) MultiSource/Benchmarks/Prolangs-C/football/football: 10.36% (0.8921 => 0.9845, std.dev.: 0.0315) SingleSource/Benchmarks/Shootout-C++/hello: 10.02% (0.2714 => 0.2986, std.dev.: 0.0104) MultiSource/Benchmarks/PAQ8p/paq8p: 9.66% (10.3673 => 11.3686, std.dev.: 0.2864) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.11% (0.1438 => 0.1569, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 149.61% (4.3953 => 10.9711, std.dev.: 0.0200) SingleSource/Benchmarks/Shootout-C++/methcall: 147.24% (5.3999 => 13.3506, std.dev.: 0.0089) MultiSource/Benchmarks/McCat/09-vor/vor: 26.95% (0.1154 => 0.1465, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/health/health: 20.22% (0.4445 => 0.5344, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bisort/bisort: 19.38% (0.8333 => 0.9948, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/oourafft: 17.44% (6.6465 => 7.8058, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.34% (1.1145 => 1.3078, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/tsp/tsp: 15.46% (1.0785 => 1.2452, std.dev.: 0.0341) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.52% (8.6802 => 9.8540, std.dev.: 0.1216) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.98% (0.2944 => 0.3326, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.64% (2.8904 => 3.2268, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: 10.29% (1.1396 => 1.2569, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.36% (1.7254 => 1.8869, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/bh/bh: 7.76% (1.9405 => 2.0910, std.dev.: 0.0127) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.59% (3.1334 => 3.3086, std.dev.: 0.0162) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.57% (4.2280 => 4.4635, std.dev.: 0.0095) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.99% (26.0924 => 27.3932, std.dev.: 0.1680) MultiSource/Benchmarks/FreeBench/neural/neural: 4.79% (0.2233 => 0.2340, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.76% (0.3463 => 0.3628, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.08% (11.6436 => 12.1185, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 3.34% (3.1023 => 3.2059, std.dev.: 0.0094) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.24% (2.1424 => 2.1904, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 2.04% (3.1595 => 3.2241, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: 1.94% (2.4116 => 2.4585, std.dev.: 0.0115) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (27.8444 => 28.3049, std.dev.: 0.0320) MultiSource/Benchmarks/PAQ8p/paq8p: 1.62% (85.0658 => 86.4454, std.dev.: 0.2147) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.51% (6.5088 => 6.6072, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0313 => 1.0441, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0502, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1670) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.84% (5.2763 => 1.2218, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -75.39% (0.8651 => 0.2129, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/richards_benchmark: -44.94% (0.1622 => 0.0893, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.27% (5.3526 => 4.6958, std.dev.: 0.1875) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.95% (5.3855 => 4.7418, std.dev.: 0.1422) MultiSource/Applications/JM/ldecod/ldecod: -7.20% (10.4361 => 9.6850, std.dev.: 0.2493) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.13% (1.7609 => 1.7410, std.dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.52% (0.0628 => 0.0361, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.28% (0.3987 => 0.2381, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.29% (4.5009 => 2.7775, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -33.47% (1.1492 => 0.7646, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.13% (2.6546 => 2.0140, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: -19.20% (0.2161 => 0.1746, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.77% (1.6925 => 1.4256, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.72% (2.6778 => 2.2837, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.77% (32.5116 => 29.0112, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -10.53% (9.5636 => 8.5564, std.dev.: 0.2075) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.51% (1.5660 => 1.4327, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4792, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.2416 => 3.0207, std.dev.: 0.0262) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.67% (19.9488 => 18.6185, std.dev.: 0.1802) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5759, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5091, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.49% (1.6805 => 1.6050, std.dev.: 0.0219) SingleSource/Benchmarks/Shootout/lists: -4.23% (6.2999 => 6.0331, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.36% (0.9957 => 0.9622, std.dev.: 0.0044) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8913, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.60% (0.4808 => 0.4683, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.65% (8.1563 => 8.0217, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/salsa20: -1.50% (10.2830 => 10.1289, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.28% (0.2116 => 0.0650, std.dev.: 0.0014) Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 04:41:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 06:41:24 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121125124124.308B02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6231?compare_to=6224&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6231, Order: 168557, Start Time: 2012-11-25 09:21:06, End Time: 2012-11-25 12:41:54 To: 6224, Order: 168556, Start Time: 2012-11-25 05:05:06, End Time: 2012-11-25 08:31:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (171 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1091 (719 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.19% (0.2099 => 0.2229, std.dev.: 0.0023) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.52% (0.0625 => 0.0897, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.40% (0.1063 => 0.1418, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.37% (0.2969 => 0.3752, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.86% (0.1106 => 0.1392, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 25.24% (1.5932 => 1.9954, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.84% (0.4139 => 0.5167, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.67% (0.0714 => 0.0883, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.63% (0.4253 => 0.5258, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.58% (0.0475 => 0.0587, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.31% (0.4994 => 0.6158, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.29% (0.0584 => 0.0720) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.14% (0.5900 => 0.7265, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.74% (0.5000 => 0.6137, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.22% (0.1620 => 0.1980, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.19% (0.0897 => 0.1096, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.04% (0.1021 => 0.1246, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.59% (0.1107 => 0.1346, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.89% (0.0584 => 0.0706, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 20.46% (0.0948 => 0.1142, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.25% (0.0642 => 0.0772, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.22% (0.1103 => 0.1326, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.06% (0.3903 => 0.4686, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: 19.85% (0.0821 => 0.0984, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.84% (0.1003 => 0.1202, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.83% (0.0822 => 0.0985, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.82% (0.1549 => 0.1856, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 19.70% (0.0604 => 0.0723) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.70% (0.1604 => 0.1920, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 19.46% (0.1619 => 0.1934, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.90% (0.0947 => 0.1126, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.67% (0.1462 => 0.1735, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 18.56% (0.0808 => 0.0958, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.28% (0.3890 => 0.4601, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 18.23% (0.1218 => 0.1440, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.12% (0.2014 => 0.2379, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 17.77% (0.0698 => 0.0822, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 17.70% (0.4029 => 0.4742, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 17.59% (0.5826 => 0.6851, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.51% (0.2736 => 0.3215, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.46% (0.1088 => 0.1278, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 17.46% (0.5889 => 0.6917, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.34% (1.3152 => 1.5433, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/09-vor/vor: 17.28% (0.1505 => 0.1765, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.17% (0.2866 => 0.3358, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 16.97% (0.5546 => 0.6487, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: 16.72% (0.9697 => 1.1318, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.71% (3.5627 => 4.1582, std.dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 16.69% (0.0605 => 0.0706) MultiSource/Benchmarks/MallocBench/gs/gs: 16.60% (1.8794 => 2.1913, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.56% (0.2875 => 0.3351, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.49% (0.4658 => 0.5426, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.46% (0.1968 => 0.2292, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.30% (1.6211 => 1.8854, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.29% (0.3271 => 0.3804, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.12% (0.1160 => 0.1347, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 15.85% (0.3004 => 0.3480, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 15.83% (1.0781 => 1.2488, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.70% (0.2738 => 0.3168, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 15.62% (0.1421 => 0.1643, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.62% (0.4361 => 0.5042, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/fibo: 15.60% (0.2725 => 0.3150, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 15.59% (0.2714 => 0.3137, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 15.54% (0.2813 => 0.3250, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 15.53% (0.2750 => 0.3177, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 15.50% (0.2780 => 0.3211, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.50% (0.2729 => 0.3152, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 15.50% (0.1284 => 0.1483, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 15.48% (0.2823 => 0.3260, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.44% (0.2792 => 0.3223, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.40% (0.5026 => 0.5800, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.37% (0.3930 => 0.4534, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.36% (0.2911 => 0.3358, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 15.34% (0.2803 => 0.3233, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 15.33% (0.2811 => 0.3242, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 15.32% (0.9909 => 1.1427, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 15.28% (0.7171 => 0.8267, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/wc: 15.15% (0.3096 => 0.3565, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 15.07% (4.2109 => 4.8455, std.dev.: 0.0086) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.06% (2.7292 => 3.1402, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.04% (2.0673 => 2.3782, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.03% (4.4195 => 5.0839, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.02% (0.3195 => 0.3675, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 14.91% (0.3267 => 0.3754, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 14.90% (23.5202 => 27.0258, std.dev.: 0.0268) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.84% (1.9694 => 2.2616, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary: 14.76% (0.3258 => 0.3739, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.62% (1.9966 => 2.2885, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary2: 14.56% (0.3317 => 0.3800, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.50% (0.1090 => 0.1248, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.37% (0.3362 => 0.3845, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.35% (0.3060 => 0.3499, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 14.22% (0.3678 => 0.4201, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.05% (0.3124 => 0.3563, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 14.02% (0.2075 => 0.2366, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.92% (0.3282 => 0.3739, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 13.91% (0.2566 => 0.2923, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 13.90% (0.3726 => 0.4244, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 13.86% (0.3348 => 0.3812, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/exceptions-2: 13.84% (0.3446 => 0.3923, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.82% (0.3625 => 0.4126, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 13.72% (0.3477 => 0.3954, std.dev.: 0.0084) SingleSource/UnitTests/ObjC/exceptions-4: 13.68% (0.3465 => 0.3939, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/for-in: 13.64% (0.3496 => 0.3973, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.64% (0.3469 => 0.3942, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.58% (0.3460 => 0.3930, std.dev.: 0.0023) MultiSource/Applications/lua/lua: 13.54% (1.4269 => 1.6201, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.53% (0.3488 => 0.3960, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/trivial-interface: 13.51% (0.3442 => 0.3907, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 13.41% (0.4251 => 0.4821, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 13.39% (0.4146 => 0.4701, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.31% (0.3981 => 0.4511, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.29% (0.3845 => 0.4356, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/property: 13.29% (0.3650 => 0.4135, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.28% (0.3690 => 0.4180, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 13.24% (0.7875 => 0.8918, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 13.09% (0.3643 => 0.4120, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.97% (0.3724 => 0.4207, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 12.71% (0.5012 => 0.5649, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 12.70% (2.1653 => 2.4403, std.dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 12.48% (4.6177 => 5.1941, std.dev.: 0.0087) MultiSource/Benchmarks/mafft/pairlocalalign: 12.14% (2.1013 => 2.3564, std.dev.: 0.0086) MultiSource/Applications/SIBsim4/SIBsim4: 11.78% (0.2691 => 0.3008, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.67% (0.6435 => 0.7186, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.67% (0.2040 => 0.2278, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.48% (0.1028 => 0.1146, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 11.40% (5.5417 => 6.1736, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.99% (0.3084 => 0.3423, std.dev.: 0.0095) MultiSource/Applications/lambda-0_1_3/lambda: 10.89% (0.3498 => 0.3879, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.60% (0.2737 => 0.3027, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.49% (0.2068 => 0.2285, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.34% (0.1383 => 0.1526, std.dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: 10.23% (0.4847 => 0.5343, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 9.96% (0.6634 => 0.7295, std.dev.: 0.0083) MultiSource/Applications/minisat/minisat: 9.95% (0.3336 => 0.3668, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.75% (0.2103 => 0.2308, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 9.23% (2.0346 => 2.2224, std.dev.: 0.0073) MultiSource/Applications/lemon/lemon: 8.99% (0.2391 => 0.2606, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.80% (4.6926 => 5.1057, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.60% (0.5361 => 0.5822, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.52% (11.6398 => 12.6311, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.90% (0.7426 => 0.8013, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.84% (0.5584 => 0.6022, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 6.63% (11.9555 => 12.7483, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.38% (0.3792 => 0.3958, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 8.89% (0.2802 => 0.3051, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6091, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6686, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary: 5.04% (0.2122 => 0.2229, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8939, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1713, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.71% (0.3693 => 0.3867, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/dry: 4.18% (14.0481 => 14.6354, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1926, std.dev.: 0.0089) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.56% (3.1722 => 3.2217, std.dev.: 0.0026) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3034, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2858, std.dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5121, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5879, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.91% (2.4764 => 2.3796, std.dev.: 0.0374) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.76% (25.4195 => 16.5845, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary2: -8.62% (0.2402 => 0.2195, std.dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9764, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7917, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/tsp/tsp: -7.32% (2.1113 => 1.9568, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.57% (11.2080 => 10.8077, std.dev.: 0.0019) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7727, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.86% (0.6293 => 0.6113, std.dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/fldry: -2.85% (17.2379 => 16.7463, std.dev.: 0.0391) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.26% (41.7953 => 40.8519, std.dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5728, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4955, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (105.3826 => 104.1906, std.dev.: 0.0799) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0419, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 05:50:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 07:50:54 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121125135054.C04182A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6232?compare_to=6228&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6232, Order: 168561, Start Time: 2012-11-25 12:21:40, End Time: 2012-11-25 13:51:25 To: 6228, Order: 168560, Start Time: 2012-11-25 10:26:28, End Time: 2012-11-25 11:56:55 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 6 (116 on baseline) Performance Improvements: 2 (30 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1046 (828 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel24: 45.20% (0.3330 => 0.4835, std.dev.: 0.0485) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.50% (0.8109 => 0.8717, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.30% (1.3289 => 1.3861, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 3.74% (1.8194 => 1.8875, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/tsp/tsp: 1.76% (1.4688 => 1.4946, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.15% (1.5956 => 1.6139, std.dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.53% (8.4663 => 8.1673, std.dev.: 0.0896) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.50% (1.0471 => 1.0209, std.dev.: 0.0048) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.81% (1.0640 => 1.0726, std.dev.: 0.0045) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -17.43% (0.0218 => 0.0180, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.70% (0.0426 => 0.0429, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.81% (0.0332 => 0.0338, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -23.64% (0.0313 => 0.0239, std.dev.: 0.0070) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 18.05% (0.0349 => 0.0412, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: 1.96% (0.0204 => 0.0208, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -10.60% (0.0217 => 0.0194, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.47% (0.1485 => 0.1478, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -1.30% (1.1790 => 1.1637, std.dev.: 0.0581) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.24% (0.4386 => 0.4200, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.17% (0.1361 => 0.1445, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.41% (0.0610 => 0.0577, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -20.58% (0.0277 => 0.0220, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.36% (0.0554 => 0.0552, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.26% (1.1939 => 1.1908, std.dev.: 0.0265) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 25.00% (0.0012 => 0.0015, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -66.67% (0.0027 => 0.0009, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.99% (0.0553 => 0.0564, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.58% (0.0266 => 0.0182, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.49% (0.7756 => 0.7794, std.dev.: 0.0030) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -46.58% (0.0073 => 0.0039, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.11% (16.4461 => 17.6148, std.dev.: 0.1522) MultiSource/Applications/sqlite3/sqlite3: 2313.49% (0.6332 => 15.2822, std.dev.: 0.1077) MultiSource/Benchmarks/McCat/08-main/main: 48.01% (0.1831 => 0.2710, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.89% (0.1559 => 0.1436, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7119.08% (0.3123 => 22.5452, std.dev.: 0.2674) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.16% (0.2463 => 0.3723, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1523.86% (0.3344 => 5.4302, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.94% (0.2364 => 0.3261, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/bigfib: 4.39% (0.6010 => 0.6274, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel: - (0.0429 => 0.0429, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.3266 => 0.3426, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/strcat: 3.30% (0.1969 => 0.2034, std.dev.: 0.0008) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.46% (0.0224 => 0.0234, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -31.30% (0.0230 => 0.0158, std.dev.: 0.0009) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0467, std.dev.: 0.0026) MultiSource/Applications/oggenc/oggenc: 6.22% (0.1462 => 0.1553, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4742, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0744, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4946, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5157, std.dev.: 0.0126) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.4919, std.dev.: 0.0716) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3136, std.dev.: 0.0371) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1240, std.dev.: 0.0208) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3632, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4022, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0816, std.dev.: 0.0034) SingleSource/Regression/C/uint64_to_float: -23.77% (2.1832 => 1.6643, std.dev.: 0.0027) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 15.92% (0.1112 => 0.1289, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.74% (0.0848 => 0.0956, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.53% (0.0830 => 0.0934, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.99% (0.2180 => 0.2376, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.82% (0.1905 => 0.2054, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.79% (0.1425 => 0.1536, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.77% (0.2998 => 0.3231, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.46% (0.8321 => 0.8942, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.30% (0.7473 => 0.7944, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.04% (0.6010 => 0.6373, std.dev.: 0.0135) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.99% (0.1885 => 0.1998, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.95% (1.1606 => 1.2296, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.36% (1.2526 => 1.3198, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.72% (0.2519 => 0.2638, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.42% (1.1685 => 1.2202, std.dev.: 0.0107) MultiSource/Applications/Burg/burg: 4.30% (1.2222 => 1.2747, std.dev.: 0.0202) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.91% (6.6074 => 6.8657, std.dev.: 0.0175) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.89% (0.4783 => 0.4969, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 3.76% (1.4269 => 1.4805, std.dev.: 0.0145) MultiSource/Applications/SIBsim4/SIBsim4: 3.75% (1.2568 => 1.3039, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.72% (0.6287 => 0.6521, std.dev.: 0.0074) MultiSource/Applications/lua/lua: 3.71% (3.8189 => 3.9606, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.70% (0.3295 => 0.3417, std.dev.: 0.0030) MultiSource/Applications/treecc/treecc: 3.62% (1.9948 => 2.0670, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.57% (4.1763 => 4.3254, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.51% (0.5961 => 0.6170, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 3.45% (1.1271 => 1.1660, std.dev.: 0.0058) MultiSource/Applications/SPASS/SPASS: 3.45% (14.2605 => 14.7523, std.dev.: 0.0240) MultiSource/Applications/minisat/minisat: 3.38% (0.6834 => 0.7065, std.dev.: 0.0022) MultiSource/Applications/siod/siod: 3.36% (2.2184 => 2.2930, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/gs/gs: 3.33% (4.1305 => 4.2680, std.dev.: 0.0255) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.31% (2.1401 => 2.2110, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.06% (0.8697 => 0.8963, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.05% (0.8007 => 0.8251, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.01% (4.4880 => 4.6230, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.92% (0.4559 => 0.4692, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.91% (14.7684 => 15.1979, std.dev.: 0.1048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.88% (4.5702 => 4.7020, std.dev.: 0.0347) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.87% (1.6386 => 1.6856, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.76% (8.6476 => 8.8866, std.dev.: 0.0253) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.76% (1.5315 => 1.5737, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.70% (4.4873 => 4.6086, std.dev.: 0.0242) MultiSource/Benchmarks/Prolangs-C/football/football: 2.70% (0.8768 => 0.9005, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.64% (0.8340 => 0.8560, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.62% (0.8518 => 0.8741, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.61% (1.1170 => 1.1461, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.53% (13.1811 => 13.5142, std.dev.: 0.0252) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.52% (1.4479 => 1.4844, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.46% (1.3279 => 1.3605, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.45% (0.9069 => 0.9291, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.45% (0.5191 => 0.5318, std.dev.: 0.0031) MultiSource/Applications/d/make_dparser: 2.44% (3.2366 => 3.3157, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.42% (0.9039 => 0.9258, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.42% (0.8611 => 0.8819, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.39% (0.8050 => 0.8242, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.37% (0.8805 => 0.9014, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 2.36% (15.3280 => 15.6905, std.dev.: 0.0521) MultiSource/Benchmarks/PAQ8p/paq8p: 2.34% (2.3764 => 2.4319, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.32% (0.9688 => 0.9913, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.31% (0.8359 => 0.8552, std.dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 2.31% (6.7320 => 6.8874, std.dev.: 0.0503) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.31% (0.8069 => 0.8255, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.30% (0.9074 => 0.9283, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.28% (0.9908 => 1.0134, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.24% (0.8712 => 0.8907, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.23% (0.8597 => 0.8789, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.22% (0.7932 => 0.8108, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.20% (0.8286 => 0.8468, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.19% (0.8855 => 0.9049, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.18% (0.9056 => 0.9253, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.15% (0.8885 => 0.9076, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.13% (0.8716 => 0.8902, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.13% (0.8177 => 0.8351, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.08% (0.8204 => 0.8375, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.08% (0.8927 => 0.9113, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 2.01% (0.7557 => 0.7709, std.dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: 1.93% (0.9810 => 0.9999, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.92% (0.8316 => 0.8476, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.91% (0.8656 => 0.8821, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.85% (0.8261 => 0.8414, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.64% (0.8048 => 0.8180, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.64% (3.1832 => 3.2353, std.dev.: 0.0158) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 116.58% (0.0199 => 0.0431, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/pi: 57.06% (1.5795 => 2.4808, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.13% (2.9753 => 3.4552, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.93% (0.7597 => 0.8807, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.61% (2.7995 => 3.2085, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.51% (5.0261 => 5.6047, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.14% (6.3772 => 6.9602, std.dev.: 0.0526) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.13% (0.3186 => 0.3445, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.05% (1.1857 => 1.2812, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 7.15% (1.7056 => 1.8276, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.79% (4.7794 => 5.1041, std.dev.: 0.0148) SingleSource/Benchmarks/Misc/richards_benchmark: 6.14% (1.3037 => 1.3838, std.dev.: 0.0048) MultiSource/Applications/SIBsim4/SIBsim4: 6.01% (3.1873 => 3.3790, std.dev.: 0.0444) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.88% (4.9686 => 5.2609, std.dev.: 0.0478) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.79% (4.5327 => 4.7952, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.81% (6.2275 => 6.5269, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.49% (3.3761 => 3.5278, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 4.35% (7.4933 => 7.8192, std.dev.: 0.0402) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.04% (4.9453 => 5.1449, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.99% (4.9469 => 5.1444, std.dev.: 0.0111) MultiSource/Applications/hexxagon/hexxagon: 3.91% (14.0064 => 14.5544, std.dev.: 0.0412) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.71% (0.3587 => 0.3720, std.dev.: 0.0019) MultiSource/Applications/siod/siod: 3.01% (3.6643 => 3.7746, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.82% (1.2337 => 1.2685, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.80% (11.5690 => 11.8926, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.44% (8.2783 => 8.4801, std.dev.: 0.0202) SingleSource/Benchmarks/Shootout/lists: 2.18% (7.3375 => 7.4972, std.dev.: 0.0402) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.99% (4.8362 => 4.9322, std.dev.: 0.0264) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.57% (4.4340 => 4.5037, std.dev.: 0.0189) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.25% (3.5679 => 3.6125, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.24% (1.5941 => 1.6139, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/power/power: 1.21% (1.2061 => 1.2207, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.17% (2.4647 => 2.4935, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ReedSolomon: 1.10% (8.5322 => 8.6260, std.dev.: 0.0150) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.98% (8.4179 => 8.1673, std.dev.: 0.0896) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.11% (5.4641 => 4.3104, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.61% (7.2130 => 6.3034, std.dev.: 0.2298) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.04% (1.0512 => 0.9352, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -10.81% (1.1216 => 1.0003, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/heapsort: -8.58% (3.2926 => 3.0100, std.dev.: 0.0569) MultiSource/Benchmarks/mafft/pairlocalalign: -8.46% (63.1822 => 57.8348, std.dev.: 0.1770) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.31% (14.6451 => 13.4285, std.dev.: 0.1223) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.90% (4.7482 => 4.4207, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.76% (0.3269 => 0.3048, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.04% (3.7148 => 3.4903, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.91% (5.4972 => 5.1724, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.06% (5.1557 => 4.8950, std.dev.: 0.0291) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.41% (4.7449 => 4.5358, std.dev.: 0.0229) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.18% (2.8773 => 2.7570, std.dev.: 0.0317) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.76% (2.4490 => 2.3570, std.dev.: 0.0310) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.74% (6.0224 => 5.7971, std.dev.: 0.0247) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.19% (0.5807 => 0.5622, std.dev.: 0.0027) MultiSource/Applications/lua/lua: -3.17% (29.8330 => 28.8873, std.dev.: 0.0541) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.06% (28.5821 => 27.7066, std.dev.: 0.0234) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.76% (2.6356 => 2.5628, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/mason/mason: -2.64% (0.5415 => 0.5272, std.dev.: 0.0049) MultiSource/Applications/aha/aha: -2.47% (3.3398 => 3.2572, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.39% (1.2822 => 1.2516, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/hash2: -2.23% (3.4237 => 3.3473, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.06% (9.9065 => 9.7022, std.dev.: 0.0434) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.03% (11.5316 => 11.2973, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.76% (3.2169 => 3.1602, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.72% (1.0388 => 1.0209, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.54% (2.3487 => 2.3126, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.52% (1.0262 => 1.0726, std.dev.: 0.0045) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 46.34% (0.0123 => 0.0180, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.15% (0.0408 => 0.0429, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 33.07% (0.0254 => 0.0338, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -20.86% (0.0302 => 0.0239, std.dev.: 0.0070) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 7.29% (0.0384 => 0.0412, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: 9.47% (0.0190 => 0.0208, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 7.78% (0.0180 => 0.0194, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.78% (0.1438 => 0.1478, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 2.72% (1.1329 => 1.1637, std.dev.: 0.0581) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.86% (0.4164 => 0.4200, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.55% (0.1369 => 0.1445, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.98% (0.0641 => 0.0577, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.82% (0.0195 => 0.0220, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.50% (0.0578 => 0.0552, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.12% (1.1437 => 1.1908, std.dev.: 0.0265) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1400.00% (0.0001 => 0.0015, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -35.71% (0.0014 => 0.0009, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.05% (0.0627 => 0.0564, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.11% (0.0180 => 0.0182, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.78% (0.8017 => 0.7794, std.dev.: 0.0030) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -37.10% (0.0062 => 0.0039, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 06:05:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 08:05:59 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121125140559.66EE92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6233?compare_to=6229&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6233, Order: 168561, Start Time: 2012-11-25 12:32:48, End Time: 2012-11-25 14:06:29 To: 6229, Order: 168560, Start Time: 2012-11-25 10:36:01, End Time: 2012-11-25 12:09:47 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (182 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (855 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.20% (0.4283 => 0.4463, std.dev.: 0.0042) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 16.41% (0.3834 => 0.4463, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.12% (2.0478 => 2.1116, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/salsa20: 2.47% (7.4937 => 7.6787, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/hash2: 2.44% (3.1932 => 3.2711, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.60% (0.1431 => 0.1308, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.96% (0.3821 => 0.3517, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.68% (0.3142 => 0.2932, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -6.47% (2.4924 => 2.3312, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.45% (0.9542 => 0.8927, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -6.34% (0.3357 => 0.3144, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -6.19% (0.3812 => 0.3576, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.16% (0.3831 => 0.3595, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.13% (0.3896 => 0.3657, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -6.13% (0.3880 => 0.3642, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.13% (0.3848 => 0.3612, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.01% (0.3891 => 0.3657, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.00% (0.7198 => 0.6766, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: -5.99% (0.4176 => 0.3926, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -5.98% (0.4033 => 0.3792, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -5.97% (0.2160 => 0.2031, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.93% (0.2428 => 0.2284, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.90% (0.2355 => 0.2216, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -5.85% (9.2283 => 8.6885, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: -5.84% (7.0961 => 6.6820, std.dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.80% (0.3658 => 0.3446, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.79% (0.9852 => 0.9282, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -5.79% (16.1920 => 15.2552, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.77% (0.6484 => 0.6110, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.74% (1.3722 => 1.2935, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.72% (0.4199 => 0.3959, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -5.69% (0.1879 => 0.1772, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.69% (1.0544 => 0.9944, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.69% (0.3884 => 0.3663, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -5.68% (0.1761 => 0.1661, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: -5.68% (0.9179 => 0.8658, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.61% (0.5863 => 0.5534, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.57% (0.1796 => 0.1696, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.56% (0.5705 => 0.5388, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.55% (1.2300 => 1.1617, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.55% (3.5339 => 3.3379, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.53% (0.5478 => 0.5175, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.53% (4.8161 => 4.5498, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.51% (0.5591 => 0.5283, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.50% (0.5925 => 0.5599, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.49% (4.0323 => 3.8108, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.47% (0.7919 => 0.7486, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -5.47% (0.4280 => 0.4046, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -5.47% (1.1450 => 1.0824, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: -5.47% (4.3330 => 4.0962, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.45% (0.2695 => 0.2548, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.44% (1.6364 => 1.5474, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.43% (0.5857 => 0.5539, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.41% (6.7716 => 6.4050, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.39% (0.5805 => 0.5492, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.38% (0.6297 => 0.5958, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.38% (0.6194 => 0.5861, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -5.37% (0.3406 => 0.3223, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.37% (0.6667 => 0.6309, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.37% (0.5849 => 0.5535, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.36% (0.5802 => 0.5491, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.35% (0.5570 => 0.5272, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.35% (4.5069 => 4.2658, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.34% (0.6736 => 0.6376, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.33% (4.8802 => 4.6201, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.31% (0.6293 => 0.5959, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.30% (0.6304 => 0.5970, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.29% (0.5575 => 0.5280, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.29% (0.5859 => 0.5549, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.29% (0.6446 => 0.6105, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.29% (0.5581 => 0.5286, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -5.27% (0.4515 => 0.4277, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.26% (0.6660 => 0.6310, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.24% (0.3931 => 0.3725, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: -5.24% (1.1530 => 1.0926, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.24% (0.6052 => 0.5735, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -5.23% (0.2985 => 0.2829, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -5.23% (1.2515 => 1.1861, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.22% (0.2548 => 0.2415, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.22% (0.6230 => 0.5905, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.21% (1.2784 => 1.2118, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.20% (0.4151 => 0.3935, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.20% (1.4642 => 1.3881, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: -5.19% (0.2659 => 0.2521, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.19% (0.5456 => 0.5173, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.19% (0.3837 => 0.3638, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.16% (0.8521 => 0.8081, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -5.16% (17.1032 => 16.2215, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.14% (0.3016 => 0.2861, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.14% (0.3057 => 0.2900, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -5.12% (0.3025 => 0.2870, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.12% (0.6681 => 0.6339, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.12% (14.2083 => 13.4813, std.dev.: 0.0148) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.11% (0.4813 => 0.4567, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.11% (0.4916 => 0.4665, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.10% (0.2999 => 0.2846, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.09% (0.2278 => 0.2162, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.09% (0.6189 => 0.5874, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: -5.09% (0.2871 => 0.2725, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.06% (0.6260 => 0.5943, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -5.05% (0.3581 => 0.3400, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.05% (0.3483 => 0.3307, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: -5.04% (0.3255 => 0.3091, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.03% (0.5999 => 0.5697, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.03% (0.5688 => 0.5402, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -5.02% (15.5079 => 14.7288, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: -5.02% (0.3026 => 0.2874, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -5.01% (1.3148 => 1.2489, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: -5.00% (0.2939 => 0.2792, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.00% (0.5941 => 0.5644, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.99% (0.2903 => 0.2758, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: -4.99% (1.3864 => 1.3172, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.99% (8.0126 => 7.6128, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.98% (1.2210 => 1.1602, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: -4.98% (0.3194 => 0.3035, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -4.95% (0.2849 => 0.2708, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.91% (0.2933 => 0.2789, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -4.91% (4.0594 => 3.8602, std.dev.: 0.0161) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.89% (22.4056 => 21.3102, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/ary: -4.86% (0.3394 => 0.3229, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -4.85% (0.2989 => 0.2844, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.84% (0.4321 => 0.4112, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.83% (0.3849 => 0.3663, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.83% (0.6440 => 0.6129, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.82% (0.6676 => 0.6354, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -4.82% (0.3446 => 0.3280, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.81% (0.3323 => 0.3163, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -4.81% (0.3059 => 0.2912, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -4.80% (0.4248 => 0.4044, std.dev.: 0.0043) MultiSource/Applications/siod/siod: -4.80% (2.4021 => 2.2868, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.80% (0.3252 => 0.3096, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -4.77% (0.3205 => 0.3052, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.74% (0.5168 => 0.4923, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.74% (0.6033 => 0.5747, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.74% (0.2385 => 0.2272, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.73% (1.6474 => 1.5694, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.71% (1.2221 => 1.1645, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: -4.71% (0.3481 => 0.3317, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.71% (0.6395 => 0.6094, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.70% (0.3319 => 0.3163, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: -4.70% (0.7447 => 0.7097, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.68% (2.1713 => 2.0696, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -4.65% (0.4861 => 0.4635, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -4.64% (0.7982 => 0.7612, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists1: -4.63% (0.3867 => 0.3688, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -4.61% (15.2527 => 14.5499, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.61% (0.7339 => 0.7001, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -4.61% (3.5154 => 3.3535, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: -4.56% (0.3621 => 0.3456, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.52% (0.7524 => 0.7184, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: -4.49% (0.3271 => 0.3124, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -4.49% (2.1401 => 2.0441, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.46% (0.7021 => 0.6708, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.46% (0.4083 => 0.3901, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.42% (0.5569 => 0.5323, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.39% (0.5329 => 0.5095, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.38% (0.5567 => 0.5323, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.38% (0.4427 => 0.4233, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.36% (0.9557 => 0.9140, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: -4.28% (0.8418 => 0.8058, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.27% (0.6395 => 0.6122, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -4.27% (5.0226 => 4.8082, std.dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: -4.24% (18.2933 => 17.5175, std.dev.: 0.0174) MultiSource/Benchmarks/Bullet/bullet: -4.22% (34.0927 => 32.6546, std.dev.: 0.0107) SingleSource/UnitTests/ObjC++/property-reference: -4.20% (0.7779 => 0.7452, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: -4.16% (0.6441 => 0.6173) SingleSource/UnitTests/ObjC++/Hello: -4.16% (0.6347 => 0.6083, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.15% (2.2587 => 2.1649, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: -4.14% (0.3788 => 0.3631, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -4.13% (0.6750 => 0.6471, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.07% (0.3491 => 0.3349, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -4.02% (0.4524 => 0.4342, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.84% (0.9077 => 0.8728, std.dev.: 0.0030) MultiSource/Applications/hbd/hbd: -3.82% (1.5610 => 1.5014, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.52% (5.4682 => 5.2755, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -2.33% (20.7746 => 20.2911, std.dev.: 0.0388) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7536, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1729, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7069, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.63% (1.3096 => 1.2621, std.dev.: 0.0166) SingleSource/Benchmarks/Misc/fbench: -3.60% (2.2633 => 2.1818, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.90% (1.0557 => 1.0251, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4691, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.13% (1.6086 => 1.5905, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 07:25:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 09:25:17 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121125152517.69F462A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6234?compare_to=6230&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6234, Order: 168561, Start Time: 2012-11-25 13:06:08, End Time: 2012-11-25 15:25:45 To: 6230, Order: 168558, Start Time: 2012-11-25 09:51:54, End Time: 2012-11-25 12:11:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 10 (113 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1075 (734 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.68% (0.1404 => 0.1554, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.16% (0.5781 => 0.6253, std.dev.: 0.0176) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.04% (1.0318 => 1.1148, std.dev.: 0.0320) SingleSource/UnitTests/ObjC/exceptions: 4.70% (0.4487 => 0.4698, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/for-in: 3.64% (0.4313 => 0.4470, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/exceptions-4: 2.55% (0.4158 => 0.4264, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.32% (0.3428 => 0.4296, std.dev.: 0.0286) SingleSource/Benchmarks/CoyoteBench/lpbench: 9.82% (10.4323 => 11.4569, std.dev.: 0.2929) SingleSource/Benchmarks/CoyoteBench/huffbench: 3.60% (18.6185 => 19.2890, std.dev.: 0.1702) SingleSource/Benchmarks/Dhrystone/fldry: 2.13% (1.9364 => 1.9776, std.dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -14.04% (0.6839 => 0.5879, std.dev.: 0.0368) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.02% (69.4089 => 69.3977, std.dev.: 0.3660) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1338 => 0.1338, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -13.79% (0.0486 => 0.0419, std.dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0650 => 0.0651, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: 0.49% (491.5938 => 494.0245, std.dev.: 0.0798) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.73% (63.2438 => 69.3977, std.dev.: 0.3660) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0419, std.dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43708.15% (1.1277 => 494.0245, std.dev.: 0.0798) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 193.56% (0.5229 => 1.5350, std.dev.: 0.0954) MultiSource/Applications/SPASS/SPASS: 19.13% (14.9895 => 17.8572, std.dev.: 0.3816) MultiSource/Applications/kimwitu++/kc: 47.14% (14.1553 => 20.8285, std.dev.: 0.4404) MultiSource/Benchmarks/MallocBench/gs/gs: 19.09% (4.1105 => 4.8952, std.dev.: 0.1858) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 44.33% (1.1048 => 1.5946, std.dev.: 0.0433) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 426.81% (7.1582 => 37.7100, std.dev.: 0.3477) SingleSource/Benchmarks/Misc-C++-EH/spirit: 79.77% (3.4629 => 6.2253, std.dev.: 0.3291) SingleSource/Benchmarks/Misc-C++/stepanov_container: 79.17% (0.6222 => 1.1148, std.dev.: 0.0320) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10796.67% (0.0720 => 7.8456, std.dev.: 0.2143) MultiSource/Applications/SIBsim4/SIBsim4: 3860000.00% (0.0001 => 3.8601, std.dev.: 0.0293) MultiSource/Applications/SPASS/SPASS: 13443100.00% (0.0001 => 13.4432, std.dev.: 1.8109) MultiSource/Applications/kimwitu++/kc: 52000.00% (0.0001 => 0.0521, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14500.00% (0.0001 => 0.0146) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575700.00% (0.0001 => 0.5758, std.dev.: 0.0265) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10071900.00% (0.0001 => 10.0720, std.dev.: 0.0161) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5690700.00% (0.0001 => 5.6908, std.dev.: 0.8344) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1745.03% (1.1194 => 20.6533, std.dev.: 0.6521) MultiSource/Applications/ClamAV/clamscan: 66.94% (22.1758 => 37.0211, std.dev.: 0.6349) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.91% (2.9384 => 4.6107, std.dev.: 0.3616) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.81% (7.0540 => 10.8500, std.dev.: 0.2841) MultiSource/Applications/JM/lencod/lencod: 47.83% (21.9371 => 32.4294, std.dev.: 0.2081) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.76% (8.1363 => 12.0219, std.dev.: 0.3082) MultiSource/Benchmarks/FreeBench/distray/distray: 44.89% (0.1056 => 0.1530, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/almabench: 38.22% (0.0730 => 0.1009, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 37.71% (0.1432 => 0.1972, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/messages-2: 34.89% (0.0662 => 0.0893, std.dev.: 0.0040) SingleSource/UnitTests/vla: 29.86% (0.0355 => 0.0461, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 28.00% (0.2554 => 0.3269, std.dev.: 0.0107) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.49% (0.0793 => 0.1011, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/lists: 26.36% (0.0626 => 0.0791, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 25.73% (0.1236 => 0.1554, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/17-bintr/bintr: 24.89% (0.0675 => 0.0843, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.13% (0.0746 => 0.0926, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/dry: 23.90% (0.0456 => 0.0565, std.dev.: 0.0020) SingleSource/Benchmarks/Stanford/Oscar: 23.90% (0.0636 => 0.0788, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions: 22.73% (0.3828 => 0.4698, std.dev.: 0.0034) MultiSource/Applications/d/make_dparser: 22.67% (3.3354 => 4.0917, std.dev.: 0.0697) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 22.49% (0.5105 => 0.6253, std.dev.: 0.0176) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.03% (0.1566 => 0.1911, std.dev.: 0.0090) SingleSource/UnitTests/ObjC/for-in: 21.01% (0.3694 => 0.4470, std.dev.: 0.0043) MultiSource/Applications/spiff/spiff: 20.98% (0.7835 => 0.9479, std.dev.: 0.0214) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.90% (0.1584 => 0.1915, std.dev.: 0.0103) SingleSource/UnitTests/ObjC/dot-syntax-1: 20.88% (0.0479 => 0.0579, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash: 20.59% (0.4289 => 0.5172, std.dev.: 0.0152) MultiSource/Benchmarks/Olden/tsp/tsp: 20.51% (0.1175 => 0.1416, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/exceptions-4: 20.35% (0.3543 => 0.4264, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.13% (0.0770 => 0.0925, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.96% (0.4203 => 0.5042, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 19.86% (1.3050 => 1.5642, std.dev.: 0.0334) SingleSource/UnitTests/ObjC/instance-method-metadata: 19.59% (0.3543 => 0.4237, std.dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: 19.24% (1.1840 => 1.4118, std.dev.: 0.0318) SingleSource/Benchmarks/Shootout-C++/strcat: 18.58% (0.2831 => 0.3357, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.54% (0.2756 => 0.3267, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.48% (14.3668 => 17.0211, std.dev.: 0.4540) SingleSource/UnitTests/ObjC/property: 18.45% (0.3886 => 0.4603, std.dev.: 0.0098) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.31% (0.1125 => 0.1331, std.dev.: 0.0058) MultiSource/Applications/lambda-0_1_3/lambda: 18.12% (0.7433 => 0.8780, std.dev.: 0.0509) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.02% (0.2891 => 0.3412, std.dev.: 0.0096) SingleSource/UnitTests/ObjC/parameter-passing: 17.62% (0.3927 => 0.4619, std.dev.: 0.0108) SingleSource/UnitTests/ObjC/trivial-interface: 17.56% (0.3473 => 0.4083, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/synchronized: 17.55% (0.3561 => 0.4186, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/hash2: 17.47% (0.4620 => 0.5427, std.dev.: 0.0171) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.44% (1.1861 => 1.3930, std.dev.: 0.0379) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.34% (0.0842 => 0.0988, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.99% (0.0871 => 0.1019, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.83% (0.4064 => 0.4748, std.dev.: 0.0133) MultiSource/Benchmarks/Olden/em3d/em3d: 16.52% (0.1695 => 0.1975, std.dev.: 0.0097) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.41% (0.8172 => 0.9513, std.dev.: 0.0367) MultiSource/Benchmarks/VersaBench/bmm/bmm: 16.21% (0.0759 => 0.0882, std.dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: 16.07% (9.4845 => 11.0085, std.dev.: 0.2521) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.99% (4.2646 => 4.9464, std.dev.: 0.2037) MultiSource/Benchmarks/Olden/mst/mst: 15.91% (0.1163 => 0.1348, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.74% (0.0648 => 0.0750, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.69% (0.2065 => 0.2389, std.dev.: 0.0102) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.59% (0.0834 => 0.0964, std.dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.53% (0.0953 => 0.1101, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.46% (0.0886 => 0.1023, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/health/health: 15.06% (0.1268 => 0.1459, std.dev.: 0.0067) MultiSource/Applications/viterbi/viterbi: 15.05% (0.1555 => 0.1789, std.dev.: 0.0050) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.03% (0.3121 => 0.3590, std.dev.: 0.0141) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.94% (0.0770 => 0.0885, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.61% (0.2758 => 0.3161, std.dev.: 0.0126) MultiSource/Benchmarks/NPB-serial/is/is: 14.60% (0.0719 => 0.0824, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 14.58% (17.1811 => 19.6860, std.dev.: 0.4790) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.49% (4.9449 => 5.6612, std.dev.: 0.2122) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.48% (0.1029 => 0.1178, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 14.44% (3.8922 => 4.4543, std.dev.: 0.1965) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 14.11% (0.8101 => 0.9244, std.dev.: 0.0291) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.08% (0.5981 => 0.6823, std.dev.: 0.0202) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.95% (0.1032 => 0.1176, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.84% (0.1062 => 0.1209, std.dev.: 0.0042) SingleSource/UnitTests/ObjC++/Hello: 13.67% (0.5925 => 0.6735, std.dev.: 0.0306) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.54% (0.1337 => 0.1518, std.dev.: 0.0057) MultiSource/Applications/oggenc/oggenc: 13.40% (5.7591 => 6.5307, std.dev.: 0.2503) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.95% (0.1143 => 0.1291, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/exceptions-2: 12.44% (0.3497 => 0.3932, std.dev.: 0.0155) SingleSource/UnitTests/ObjC/exceptions-3: 12.26% (0.3516 => 0.3947, std.dev.: 0.0144) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.33% (0.1906 => 0.2122, std.dev.: 0.0076) MultiSource/Benchmarks/PAQ8p/paq8p: 10.23% (10.3673 => 11.4275, std.dev.: 0.2399) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.15% (4.3953 => 10.9949, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/methcall: 147.41% (5.3999 => 13.3597, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 31.94% (0.3256 => 0.4296, std.dev.: 0.0286) SingleSource/Benchmarks/Misc/oourafft: 17.45% (6.6465 => 7.8061, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.36% (1.1145 => 1.3080, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.98% (0.2944 => 0.3326, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.61% (2.8904 => 3.2261, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.18% (8.6802 => 9.6506, std.dev.: 0.1867) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.74% (10.3460 => 11.4569, std.dev.: 0.2929) SingleSource/Benchmarks/Misc/richards_benchmark: 10.00% (1.1396 => 1.2536, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.43% (1.7254 => 1.8881, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.82% (4.2280 => 4.4742, std.dev.: 0.0086) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 4.86% (26.0924 => 27.3597, std.dev.: 0.1639) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.07% (11.6436 => 12.1178, std.dev.: 0.0063) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: 2.24% (2.4116 => 2.4656, std.dev.: 0.0193) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 2.03% (3.1595 => 3.2236, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.97% (2.1424 => 2.1845, std.dev.: 0.0150) MultiSource/Benchmarks/PAQ8p/paq8p: 1.67% (85.0658 => 86.4849, std.dev.: 0.1652) MultiSource/Benchmarks/mafft/pairlocalalign: 1.60% (27.8444 => 28.2889, std.dev.: 0.0117) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.51% (6.5088 => 6.6071, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.29% (1.0313 => 1.0446, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.22% (5.2139 => 5.2777, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/perlin: 1.19% (5.9798 => 6.0508, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.02% (1.9577 => 1.9776, std.dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1672, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.78% (5.2763 => 1.2254, std.dev.: 0.0401) SingleSource/Benchmarks/Misc/salsa20: -75.38% (0.8651 => 0.2130, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/richards_benchmark: -44.76% (0.1622 => 0.0896, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.27% (5.3526 => 4.6960, std.dev.: 0.1524) MultiSource/Applications/JM/ldecod/ldecod: -12.05% (10.4361 => 9.1781, std.dev.: 0.4692) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.97% (5.3855 => 4.7409, std.dev.: 0.1405) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.33% (0.3987 => 0.2379, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.31% (4.5009 => 2.7764, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -33.52% (1.1492 => 0.7640, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.14% (2.6546 => 2.0139, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -19.34% (0.2161 => 0.1743, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.61% (1.6925 => 1.4283, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2841, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.75% (32.5116 => 29.0154, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/mandel-2: -10.65% (1.5373 => 1.3736, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -10.49% (9.5636 => 8.5605, std.dev.: 0.2048) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.69% (1.5660 => 1.4299, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.2416 => 3.0212, std.dev.: 0.0263) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5760, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: -4.25% (6.2999 => 6.0319, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.32% (0.9957 => 0.9626, std.dev.: 0.0112) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.31% (19.9488 => 19.2890, std.dev.: 0.1702) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8915, std.dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.25% (0.4808 => 0.4700, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6774, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.70% (8.1563 => 8.0180, std.dev.: 0.0121) SingleSource/Benchmarks/Misc/salsa20: -1.51% (10.2830 => 10.1277, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0014) Report Time: 2.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 07:44:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 09:44:10 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121125154410.5CC1F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6235?compare_to=6232&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6235, Order: 168562, Start Time: 2012-11-25 14:10:07, End Time: 2012-11-25 15:44:40 To: 6232, Order: 168561, Start Time: 2012-11-25 12:21:40, End Time: 2012-11-25 13:51:25 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 5 (47 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1049 (907 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.10% (0.8476 => 0.8654, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.65% (2.3584 => 2.6095, std.dev.: 0.0639) MultiSource/Benchmarks/nbench/nbench: 3.64% (21.1747 => 21.9465, std.dev.: 0.0265) SingleSource/Benchmarks/Shootout-C++/methcall: 3.60% (8.7177 => 9.0319, std.dev.: 0.0866) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.91% (59.4717 => 60.6095, std.dev.: 0.3551) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.19% (1.0726 => 1.0854, std.dev.: 0.1786) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -16.11% (0.0180 => 0.0151, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0429 => 0.0428, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -23.37% (0.0338 => 0.0259, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 29.29% (0.0239 => 0.0309, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -13.59% (0.0412 => 0.0356, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/casts: -1.92% (0.0208 => 0.0204, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 12.89% (0.0194 => 0.0219, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.01% (0.1478 => 0.1493, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -8.53% (1.1637 => 1.0644, std.dev.: 0.0661) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.79% (0.4200 => 0.4275, std.dev.: 0.0930) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.46% (0.1445 => 0.1495, std.dev.: 0.0303) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.79% (0.0577 => 0.0645, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 9.09% (0.0220 => 0.0240, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.62% (0.0552 => 0.0583, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.36% (1.1908 => 1.1951, std.dev.: 0.0813) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -73.33% (0.0015 => 0.0004, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -88.89% (0.0009 => 0.0001, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.80% (0.0564 => 0.0608, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.24% (0.0182 => 0.0197, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.31% (0.7794 => 0.7818, std.dev.: 0.0013) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 151.28% (0.0039 => 0.0098, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.11% (16.4461 => 17.6158, std.dev.: 1.0402) MultiSource/Applications/sqlite3/sqlite3: 2316.50% (0.6332 => 15.3013, std.dev.: 0.4104) MultiSource/Benchmarks/McCat/08-main/main: 49.81% (0.1831 => 0.2743, std.dev.: 0.0763) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.22% (0.1559 => 0.1462, std.dev.: 0.0391) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7211.08% (0.3123 => 22.8325, std.dev.: 0.9273) SingleSource/Benchmarks/CoyoteBench/fftbench: 52.82% (0.2463 => 0.3764, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1529.64% (0.3344 => 5.4495, std.dev.: 0.0586) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.76% (0.2364 => 0.3233, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/bigfib: 4.46% (0.6010 => 0.6278, std.dev.: 0.0419) SingleSource/Benchmarks/Misc/mandel: 3.96% (0.0429 => 0.0446, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.54% (0.3266 => 0.3447, std.dev.: 0.0529) SingleSource/Benchmarks/Shootout-C++/strcat: 3.66% (0.1969 => 0.2041, std.dev.: 0.0159) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.34% (0.0224 => 0.0227, std.dev.: 0.0008) SingleSource/UnitTests/byval-alignment: -25.65% (0.0230 => 0.0171, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0526, std.dev.: 0.0120) MultiSource/Applications/oggenc/oggenc: 9.71% (0.1462 => 0.1604, std.dev.: 0.0163) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4657, std.dev.: 0.0534) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0694, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4985, std.dev.: 0.0148) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5125, std.dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5135, std.dev.: 0.1337) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3274, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1316, std.dev.: 0.0170) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3619, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4043, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0827, std.dev.: 0.0028) SingleSource/Regression/C/uint64_to_float: -23.94% (2.1832 => 1.6605, std.dev.: 0.0034) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/viterbi/viterbi: 8.88% (0.1577 => 0.1717, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.66% (0.1983 => 0.2115, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 5.29% (1.2568 => 1.3233, std.dev.: 0.0145) MultiSource/Applications/spiff/spiff: 5.01% (0.7950 => 0.8348, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 4.93% (0.9039 => 0.9485, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.75% (0.7966 => 0.8344, std.dev.: 0.0125) MultiSource/Applications/treecc/treecc: 4.69% (1.9948 => 2.0883, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.63% (2.1401 => 2.2391, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.56% (1.1685 => 1.2218, std.dev.: 0.0166) MultiSource/Applications/SPASS/SPASS: 4.39% (14.2605 => 14.8867, std.dev.: 0.0495) MultiSource/Applications/sgefa/sgefa: 4.33% (0.2999 => 0.3129, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.06% (0.8316 => 0.8654, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.79% (0.3717 => 0.3858, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 2.91% (2.2184 => 2.2829, std.dev.: 0.0224) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.61% (0.8340 => 0.8558, std.dev.: 0.0058) MultiSource/Applications/lambda-0_1_3/lambda: 2.46% (0.7557 => 0.7743, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.46% (0.6586 => 0.6748, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 155.28% (0.0199 => 0.0508, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/pi: 58.02% (1.5795 => 2.4959, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 18.43% (0.7597 => 0.8997, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.67% (2.7995 => 3.2941, std.dev.: 0.0867) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.61% (2.9753 => 3.4694, std.dev.: 0.0485) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.92% (5.0261 => 5.6254, std.dev.: 0.1256) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.59% (6.3772 => 6.9248, std.dev.: 0.0396) MultiSource/Applications/SIBsim4/SIBsim4: 8.02% (3.1873 => 3.4430, std.dev.: 0.0354) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.86% (1.1857 => 1.2789, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 7.09% (1.7056 => 1.8265, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.77% (4.7794 => 5.1032, std.dev.: 0.1183) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.32% (4.9686 => 5.2824, std.dev.: 0.0979) SingleSource/Benchmarks/Misc/richards_benchmark: 6.21% (1.3037 => 1.3846, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.87% (4.5327 => 4.7986, std.dev.: 0.0658) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.66% (3.3761 => 3.5333, std.dev.: 0.0235) MultiSource/Applications/lambda-0_1_3/lambda: 4.53% (7.4933 => 7.8329, std.dev.: 0.0388) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.52% (6.2275 => 6.5089, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.05% (4.9453 => 5.1458, std.dev.: 0.0134) MultiSource/Applications/hexxagon/hexxagon: 3.93% (14.0064 => 14.5570, std.dev.: 0.0171) MultiSource/Applications/siod/siod: 3.07% (3.6643 => 3.7767, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.87% (11.5690 => 11.9015, std.dev.: 0.0320) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.77% (4.8660 => 5.0009, std.dev.: 0.0491) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.64% (8.2783 => 8.4969, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout/lists: 2.36% (7.3375 => 7.5105, std.dev.: 0.0331) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.27% (59.2638 => 60.6095, std.dev.: 0.3551) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.73% (1.5941 => 1.6216, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.71% (1.1365 => 1.1559, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/neural/neural: 1.30% (1.0841 => 1.0982, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/ReedSolomon: 1.27% (8.5322 => 8.6406, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.22% (3.5679 => 3.6114, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.13% (5.4641 => 4.3098, std.dev.: 0.0646) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.58% (7.2130 => 6.2336, std.dev.: 0.0659) SingleSource/Benchmarks/McGill/chomp: -10.43% (1.1216 => 1.0046, std.dev.: 0.0424) MultiSource/Benchmarks/mafft/pairlocalalign: -8.44% (63.1822 => 57.8516, std.dev.: 0.0676) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.37% (14.6451 => 13.5661, std.dev.: 0.0906) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.68% (4.7482 => 4.4310, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.18% (0.3269 => 0.3067, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.76% (5.4972 => 5.1805, std.dev.: 0.0744) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.68% (3.7148 => 3.5039, std.dev.: 0.0424) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.91% (5.1557 => 4.9024, std.dev.: 0.0482) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.62% (0.5807 => 0.5597, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.36% (2.8773 => 2.7805, std.dev.: 0.0269) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.10% (6.0224 => 5.8355, std.dev.: 0.0695) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.87% (28.5821 => 27.7631, std.dev.: 0.0054) MultiSource/Applications/aha/aha: -2.48% (3.3398 => 3.2571, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.78% (11.5316 => 11.3266, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.56% (9.9065 => 9.7516, std.dev.: 0.0208) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.3487 => 2.3187, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.18% (5.6343 => 5.5677, std.dev.: 0.0147) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.04% (3.5968 => 3.5594, std.dev.: 0.0088) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 5.77% (1.0262 => 1.0854, std.dev.: 0.1786) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 22.76% (0.0123 => 0.0151, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.97% (0.0254 => 0.0259, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.32% (0.0302 => 0.0309, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.29% (0.0384 => 0.0356, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 3.82% (0.1438 => 0.1493, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -6.05% (1.1329 => 1.0644, std.dev.: 0.0661) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.67% (0.4164 => 0.4275, std.dev.: 0.0930) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.20% (0.1369 => 0.1495, std.dev.: 0.0303) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.62% (0.0641 => 0.0645, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 23.08% (0.0195 => 0.0240, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.87% (0.0578 => 0.0583, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.49% (1.1437 => 1.1951, std.dev.: 0.0813) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 300.00% (0.0001 => 0.0004, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.03% (0.0627 => 0.0608, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.44% (0.0180 => 0.0197, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.48% (0.8017 => 0.7818, std.dev.: 0.0013) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 58.06% (0.0062 => 0.0098, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 08:03:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 10:03:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121125160341.B1BFF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6236?compare_to=6233&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6236, Order: 168562, Start Time: 2012-11-25 14:29:54, End Time: 2012-11-25 16:04:12 To: 6233, Order: 168561, Start Time: 2012-11-25 12:32:48, End Time: 2012-11-25 14:06:29 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (176 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (860 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.71% (77.7903 => 80.6783, std.dev.: 0.3430) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 14.42% (0.3834 => 0.4387, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.83% (7.4937 => 7.7055, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.69% (2.0478 => 2.1028, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash2: 2.04% (3.1932 => 3.2582, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.21% (79.7170 => 80.6783, std.dev.: 0.3430) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.60% (0.1431 => 0.1308, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.93% (0.3821 => 0.3518, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -6.44% (2.4924 => 2.3320, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.39% (0.9542 => 0.8932, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.37% (0.3357 => 0.3143, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/exceptions-2: -6.19% (0.3831 => 0.3594, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.19% (0.3896 => 0.3655, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.16% (0.3880 => 0.3641, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-3: -6.16% (0.3848 => 0.3611, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.14% (0.2428 => 0.2279, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.11% (0.3812 => 0.3579, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.10% (0.4033 => 0.3787, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -6.01% (0.4176 => 0.3925, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.00% (0.7198 => 0.6766, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.99% (0.3891 => 0.3658, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -5.93% (0.2160 => 0.2032, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -5.83% (16.1920 => 15.2474, std.dev.: 0.0097) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.80% (0.9852 => 0.9281, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -5.79% (7.0961 => 6.6854, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.77% (0.3658 => 0.3447, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -5.76% (0.4199 => 0.3957, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.74% (0.6484 => 0.6112, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.71% (1.0544 => 0.9942, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -5.71% (9.2283 => 8.7017, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.69% (1.3722 => 1.2941, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.64% (0.5478 => 0.5169, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.63% (1.2300 => 1.1607, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.61% (0.3884 => 0.3666, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.61% (0.5863 => 0.5534, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.61% (3.5339 => 3.3356, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/football/football: -5.61% (0.9179 => 0.8664, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.58% (4.8161 => 4.5472, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.53% (0.5591 => 0.5282, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -5.52% (4.3330 => 4.0940, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: -5.50% (1.1450 => 1.0820, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.48% (0.5570 => 0.5265, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.47% (0.5705 => 0.5393, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.45% (0.2695 => 0.2548, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.45% (0.6052 => 0.5722, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.45% (0.5925 => 0.5602, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.45% (1.4642 => 1.3844, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.45% (0.5857 => 0.5538, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -5.44% (0.4280 => 0.4047, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.43% (0.6736 => 0.6370, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.41% (0.6667 => 0.6306, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.41% (0.5805 => 0.5491, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.41% (4.0323 => 3.8142, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.40% (0.6446 => 0.6098, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.39% (6.7716 => 6.4066, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.38% (0.6297 => 0.5958, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.38% (0.6230 => 0.5895, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -5.36% (0.2985 => 0.2825, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -5.34% (0.3406 => 0.3224, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -5.34% (1.2515 => 1.1847, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.33% (4.5069 => 4.2666, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.33% (1.6364 => 1.5492, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.33% (0.6194 => 0.5864, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.31% (0.6304 => 0.5969, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.31% (0.5802 => 0.5494, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.31% (0.6293 => 0.5959, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.31% (4.8802 => 4.6213, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.29% (0.5859 => 0.5549, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.29% (0.6260 => 0.5929, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.26% (0.5575 => 0.5282, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.24% (0.5456 => 0.5170, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.24% (0.7919 => 0.7504, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: -5.24% (1.1530 => 1.0926, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.23% (1.2784 => 1.2115, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.23% (0.5581 => 0.5289, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.21% (0.3931 => 0.3726, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.20% (0.5999 => 0.5687, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.20% (0.5849 => 0.5545, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.20% (0.6660 => 0.6314, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.18% (0.5941 => 0.5633, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.18% (0.4151 => 0.3936, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: -5.18% (17.1032 => 16.2180, std.dev.: 0.0168) MultiSource/Applications/SPASS/SPASS: -5.17% (15.5079 => 14.7061, std.dev.: 0.0152) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.15% (0.4916 => 0.4663, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.13% (0.3837 => 0.3640, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.13% (0.4813 => 0.4566, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: -5.11% (0.2659 => 0.2523, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.11% (0.3483 => 0.3305, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -5.09% (0.3025 => 0.2871, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.09% (0.2871 => 0.2725, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -5.08% (1.3864 => 1.3160, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.07% (0.3057 => 0.2902, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: -5.07% (0.3255 => 0.3090, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.07% (0.2999 => 0.2847, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.07% (14.2083 => 13.4882, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.06% (0.5688 => 0.5400, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.06% (0.8521 => 0.8090, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -5.05% (1.3148 => 1.2484, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.05% (0.4321 => 0.4103, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.04% (0.3016 => 0.2864, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.03% (0.6189 => 0.5878, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.01% (2.1713 => 2.0626, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: -5.01% (0.4515 => 0.4289, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.00% (0.2278 => 0.2164, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.98% (0.6440 => 0.6119, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.98% (0.2548 => 0.2421, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.98% (8.0126 => 7.6137, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.96% (0.2903 => 0.2759, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -4.96% (0.3026 => 0.2876, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.95% (1.2210 => 1.1606, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: -4.94% (0.3581 => 0.3404, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.94% (0.3323 => 0.3159, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: -4.91% (0.2849 => 0.2709, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.91% (0.2933 => 0.2789, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.90% (1.2221 => 1.1622, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/random: -4.90% (0.2939 => 0.2795, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.90% (0.6676 => 0.6349, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.89% (0.6033 => 0.5738, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -4.89% (2.4021 => 2.2847, std.dev.: 0.0083) MultiSource/Applications/d/make_dparser: -4.87% (3.5154 => 3.3441, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: -4.85% (0.7447 => 0.7086, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.82% (0.5168 => 0.4919, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.82% (0.2989 => 0.2845, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.81% (22.4056 => 21.3269, std.dev.: 0.0048) MultiSource/Applications/lua/lua: -4.81% (4.0594 => 3.8641, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/wc: -4.80% (0.3205 => 0.3051, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.80% (0.2355 => 0.2242, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.79% (0.6681 => 0.6361, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.78% (0.2385 => 0.2271, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.77% (1.6474 => 1.5688, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: -4.77% (0.3481 => 0.3315, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.76% (0.3319 => 0.3161, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: -4.73% (0.4248 => 0.4047, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: -4.73% (0.4861 => 0.4631, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.73% (0.3849 => 0.3667, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -4.73% (0.3194 => 0.3043, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.70% (0.3252 => 0.3099, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.67% (0.7339 => 0.6996, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -4.66% (15.2527 => 14.5421, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/ary3: -4.64% (0.3446 => 0.3286, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -4.61% (0.3059 => 0.2918, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -4.60% (0.3867 => 0.3689, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -4.60% (0.3394 => 0.3238, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -4.58% (2.1401 => 2.0420, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.56% (0.4083 => 0.3897, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.56% (0.3271 => 0.3122, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -4.55% (0.7982 => 0.7619, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.50% (0.5329 => 0.5089, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -4.47% (0.3621 => 0.3459, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.47% (0.6395 => 0.6109, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.47% (0.5569 => 0.5320, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.43% (0.7021 => 0.6710, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.39% (0.7524 => 0.7194, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.38% (0.4427 => 0.4233, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: -4.35% (5.0226 => 4.8039, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.35% (0.5567 => 0.5325, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.32% (0.6395 => 0.6119, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.30% (0.9557 => 0.9146, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference-object: -4.27% (0.6441 => 0.6166, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -4.22% (18.2933 => 17.5214, std.dev.: 0.0168) SingleSource/UnitTests/ObjC++/property-reference: -4.22% (0.7779 => 0.7451, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: -4.16% (34.0927 => 32.6742, std.dev.: 0.0067) SingleSource/UnitTests/ObjC++/Hello: -4.13% (0.6347 => 0.6085, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: -4.12% (0.3788 => 0.3632, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.10% (0.3491 => 0.3348, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: -4.09% (0.8418 => 0.8074, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.07% (2.2587 => 2.1667, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: -4.06% (0.6750 => 0.6476, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.84% (0.9077 => 0.8728, std.dev.: 0.0027) MultiSource/Applications/hbd/hbd: -3.80% (1.5610 => 1.5017, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/hash: -3.78% (0.4524 => 0.4353, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.53% (5.4682 => 5.2749, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -2.08% (20.7746 => 20.3427, std.dev.: 0.0200) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7535, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/richards_benchmark: -8.70% (1.2842 => 1.1725, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7060, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.88% (2.2633 => 2.1755, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3339, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4708, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 08:50:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 10:50:08 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121125165008.9BF2C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6237?compare_to=6231&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6237, Order: 168561, Start Time: 2012-11-25 13:29:57, End Time: 2012-11-25 16:50:38 To: 6231, Order: 168557, Start Time: 2012-11-25 09:21:06, End Time: 2012-11-25 12:41:54 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (171 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1089 (719 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.54% (124.8714 => 130.5358, std.dev.: 0.1950) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.88% (2.0611 => 2.1204, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.56% (53.9763 => 54.8197, std.dev.: 0.0617) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.56% (0.0625 => 0.0891, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.21% (0.1063 => 0.1416, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.20% (0.2969 => 0.3747, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.86% (0.1106 => 0.1392, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.07% (0.0714 => 0.0893, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 24.72% (1.5932 => 1.9870, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.72% (0.4139 => 0.5162, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.91% (0.4253 => 0.5270, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.79% (0.0475 => 0.0588, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.59% (0.5900 => 0.7292, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.43% (0.4994 => 0.6164, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.29% (0.0584 => 0.0720, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.13% (0.1107 => 0.1363, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.94% (0.5000 => 0.6147, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.43% (0.1021 => 0.1250, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.41% (0.1620 => 0.1983, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.74% (0.0897 => 0.1092, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.17% (0.0633 => 0.0767, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.89% (0.0584 => 0.0706, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.87% (0.0642 => 0.0776, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 20.78% (0.0948 => 0.1145, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.67% (0.1103 => 0.1331, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.52% (0.0541 => 0.0652, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 20.34% (0.0821 => 0.0988, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.32% (0.0822 => 0.0989, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.24% (0.3903 => 0.4693, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.14% (0.1549 => 0.1861, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.14% (0.1003 => 0.1205, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.14% (0.1604 => 0.1927, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 20.07% (0.1619 => 0.1944, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 19.70% (0.0604 => 0.0723, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 18.90% (0.0947 => 0.1126, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.88% (0.1462 => 0.1738, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 18.69% (0.0808 => 0.0959, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.62% (0.2014 => 0.2389, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.43% (0.3890 => 0.4607, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 18.23% (0.1218 => 0.1440, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 18.02% (0.5826 => 0.6876, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.95% (0.2736 => 0.3227, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 17.92% (0.4029 => 0.4751, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 17.85% (0.5889 => 0.6940, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 17.77% (0.0698 => 0.0822, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.74% (0.1088 => 0.1281, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.69% (1.3152 => 1.5478, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.66% (0.0572 => 0.0673) MultiSource/Benchmarks/McCat/09-vor/vor: 17.61% (0.1505 => 0.1770, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.27% (0.2866 => 0.3361, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 17.13% (0.5546 => 0.6496, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.01% (3.5627 => 4.1687, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.77% (0.1968 => 0.2298, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 16.68% (1.8794 => 2.1928, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.62% (0.4658 => 0.5432, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.61% (1.6211 => 1.8904, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.54% (0.3271 => 0.3812, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.47% (0.1160 => 0.1351, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.30% (0.5026 => 0.5845, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 16.19% (0.1421 => 0.1651, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 16.09% (0.9697 => 1.1257, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.06% (0.3930 => 0.4561, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.05% (0.4361 => 0.5061, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 15.95% (1.0781 => 1.2501, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 15.89% (0.2750 => 0.3187, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.83% (0.2875 => 0.3330, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.81% (2.7292 => 3.1607, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 15.73% (0.1284 => 0.1486, std.dev.: 0.0051) SingleSource/UnitTests/ObjC++/property-reference: 15.60% (0.7171 => 0.8290, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/fibo: 15.41% (0.2725 => 0.3145, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 15.36% (0.2813 => 0.3245, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 15.32% (4.2109 => 4.8559, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.24% (4.4195 => 5.0929, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/objinst: 15.23% (0.2823 => 0.3253, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 15.21% (0.3004 => 0.3461, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 15.18% (0.2714 => 0.3126, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.15% (0.3195 => 0.3679, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.12% (0.2738 => 0.3152, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.12% (0.2911 => 0.3351, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 15.11% (0.2780 => 0.3200, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 15.09% (0.2803 => 0.3226, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.08% (0.2792 => 0.3213, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 15.08% (0.9909 => 1.1403, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.02% (0.2729 => 0.3139, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.00% (1.9694 => 2.2649, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/except: 14.94% (0.2811 => 0.3231, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 14.86% (0.3446 => 0.3958, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.86% (1.9966 => 2.2932, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary3: 14.85% (0.3267 => 0.3752, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.81% (2.0673 => 2.3734, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-4: 14.75% (0.3465 => 0.3976, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 14.73% (0.3096 => 0.3552, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.71% (0.3488 => 0.4001, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 14.70% (0.3469 => 0.3979, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.68% (0.3460 => 0.3968, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.67% (0.3496 => 0.4009, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 14.67% (0.3258 => 0.3736, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.61% (0.3442 => 0.3945, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.59% (0.1090 => 0.1249, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.44% (0.3060 => 0.3502, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 14.33% (0.3650 => 0.4173, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 14.29% (0.3317 => 0.3791, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 14.22% (0.3643 => 0.4161, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 14.17% (0.2075 => 0.2369, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 14.11% (0.2566 => 0.2928, std.dev.: 0.0060) MultiSource/Benchmarks/Bullet/bullet: 14.04% (23.5202 => 26.8233, std.dev.: 0.0190) SingleSource/UnitTests/ObjC/parameter-passing: 13.96% (0.3724 => 0.4244, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 13.92% (1.4269 => 1.6255, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.86% (0.3362 => 0.3828, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.83% (0.3124 => 0.3556, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.79% (0.3625 => 0.4125, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 13.78% (0.3678 => 0.4185, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 13.71% (0.3348 => 0.3807, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.62% (0.3282 => 0.3729, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 13.46% (0.3477 => 0.3945, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 13.34% (0.3726 => 0.4223, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 13.27% (0.7875 => 0.8920, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 13.10% (0.4146 => 0.4689, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 13.08% (0.4251 => 0.4807, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 12.99% (2.1653 => 2.4466, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.98% (0.3845 => 0.4344, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.95% (0.3690 => 0.4168, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.86% (0.3981 => 0.4493, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 12.76% (4.6177 => 5.2067, std.dev.: 0.0086) MultiSource/Benchmarks/mafft/pairlocalalign: 12.54% (2.1013 => 2.3649, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 12.37% (0.5012 => 0.5632, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 11.97% (0.2691 => 0.3013, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 11.80% (5.5417 => 6.1956, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.62% (0.2040 => 0.2277, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.42% (0.6435 => 0.7170, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.19% (0.1028 => 0.1143, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.67% (0.2737 => 0.3029, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.64% (0.2068 => 0.2288, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 10.63% (0.3498 => 0.3870, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.63% (0.1383 => 0.1530, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 10.52% (0.6634 => 0.7332, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.41% (0.3084 => 0.3405, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 10.23% (0.4847 => 0.5343, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 9.89% (0.3336 => 0.3666, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.42% (0.2103 => 0.2301, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 9.12% (2.0346 => 2.2201, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 9.03% (0.2391 => 0.2607, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.47% (0.5361 => 0.5815, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.33% (4.6926 => 5.0836, std.dev.: 0.0146) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.14% (11.6398 => 12.5871, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.77% (0.5584 => 0.6018, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.59% (0.7426 => 0.7990, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 6.54% (11.9555 => 12.7375, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.22% (0.3792 => 0.3990, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 8.42% (0.2802 => 0.3038, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6097, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6741, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1677, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-2: 4.64% (1.8057 => 1.8895, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.44% (0.3693 => 0.3857, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: 4.25% (14.0481 => 14.6446, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2022, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.84% (2.0820 => 2.1204, std.dev.: 0.0050) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2235, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3053, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2860, std.dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5831, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.36% (2.4764 => 2.3931, std.dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.78% (25.4195 => 16.5793, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/ary2: -7.91% (0.2402 => 0.2212, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9747, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8009, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/tsp/tsp: -7.31% (2.1113 => 1.9570, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.7997, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0042) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: -2.99% (17.2379 => 16.7217, std.dev.: 0.0553) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.25% (41.7953 => 40.8565, std.dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5770, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4958, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.25% (105.3826 => 104.0690, std.dev.: 0.1080) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.03% (16.2163 => 16.0489, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 09:37:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 11:37:33 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121125173733.152DF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6238?compare_to=6235&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6238, Order: 168566, Start Time: 2012-11-25 16:03:22, End Time: 2012-11-25 17:38:02 To: 6235, Order: 168562, Start Time: 2012-11-25 14:10:07, End Time: 2012-11-25 15:44:40 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 6 (58 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1047 (899 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.40% (0.3114 => 0.3220, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.15% (0.8433 => 0.8699, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.91% (0.9669 => 0.9950, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.78% (8.8474 => 9.0046, std.dev.: 0.0452) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.66% (1.2218 => 1.2421, std.dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lambda-0_1_3/lambda: 2.56% (7.8329 => 8.0332, std.dev.: 0.0644) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.51% (3.2941 => 3.2115, std.dev.: 0.0081) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.01% (1.0854 => 1.0744, std.dev.: 0.2341) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 55.63% (0.0151 => 0.0235, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.93% (0.0428 => 0.0432, std.dev.: 0.0102) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 28.96% (0.0259 => 0.0334, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.94% (0.0309 => 0.0315, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 20.51% (0.0356 => 0.0429, std.dev.: 0.0110) SingleSource/UnitTests/Vector/Altivec/casts: 0.98% (0.0204 => 0.0206, std.dev.: 0.0051) SingleSource/UnitTests/Vector/Altivec/test1: 1.37% (0.0219 => 0.0222, std.dev.: 0.0042) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -1.07% (0.1493 => 0.1477, std.dev.: 0.0211) MultiSource/Applications/lemon/lemon: 8.82% (1.0644 => 1.1583, std.dev.: 0.3734) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.70% (0.4275 => 0.4117, std.dev.: 0.0927) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.14% (0.1495 => 0.1448, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.55% (0.0645 => 0.0635, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 15.42% (0.0240 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.17% (0.0583 => 0.0582, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.11% (1.1951 => 1.1938, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 675.00% (0.0004 => 0.0031, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.92% (0.0608 => 0.0644, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.80% (0.0197 => 0.0236, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.24% (0.7818 => 0.7799, std.dev.: 0.1494) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -22.45% (0.0098 => 0.0076, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 6.87% (16.4461 => 17.5767, std.dev.: 1.6328) MultiSource/Applications/sqlite3/sqlite3: 2315.89% (0.6332 => 15.2974, std.dev.: 0.6520) MultiSource/Benchmarks/McCat/08-main/main: 49.15% (0.1831 => 0.2731, std.dev.: 0.0402) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.94% (0.1559 => 0.1482, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7142.94% (0.3123 => 22.6197, std.dev.: 0.5796) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.87% (0.2463 => 0.3716, std.dev.: 0.0159) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1525.33% (0.3344 => 5.4351, std.dev.: 0.2758) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.79% (0.2364 => 0.3210, std.dev.: 0.1262) SingleSource/Benchmarks/Misc-C++/bigfib: 4.39% (0.6010 => 0.6274, std.dev.: 0.0690) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.28% (0.3266 => 0.3471, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/strcat: 6.40% (0.1969 => 0.2095, std.dev.: 0.0035) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.91% (0.0224 => 0.0235, std.dev.: 0.0021) SingleSource/UnitTests/byval-alignment: -19.57% (0.0230 => 0.0185, std.dev.: 0.0039) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0520, std.dev.: 0.0114) MultiSource/Applications/oggenc/oggenc: 12.31% (0.1462 => 0.1642, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4665, std.dev.: 0.0243) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0722, std.dev.: 0.0147) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4958, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5087, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.6659, std.dev.: 0.3693) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3251, std.dev.: 0.0397) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1672, std.dev.: 0.1835) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3635, std.dev.: 0.0386) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4062, std.dev.: 0.0377) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0009, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0849, std.dev.: 0.0135) SingleSource/Regression/C/uint64_to_float: -23.73% (2.1832 => 1.6651, std.dev.: 0.0153) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.78% (0.0773 => 0.0895, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.26% (0.0848 => 0.0952, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.03% (0.1983 => 0.2162, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.70% (0.3137 => 0.3410, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.65% (0.3295 => 0.3580, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.79% (0.1425 => 0.1536, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.43% (0.8321 => 0.8939, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.40% (0.2998 => 0.3220, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.02% (0.2279 => 0.2439, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.76% (0.8148 => 0.8699, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.39% (0.2519 => 0.2680, std.dev.: 0.0057) MultiSource/Applications/Burg/burg: 6.32% (1.2222 => 1.2995, std.dev.: 0.0228) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.30% (1.1685 => 1.2421, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.63% (0.2133 => 0.2253, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.46% (0.9435 => 0.9950, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.69% (1.6386 => 1.7154, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.34% (1.3279 => 1.3855, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.13% (8.6476 => 9.0046, std.dev.: 0.0452) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.01% (4.1763 => 4.3438, std.dev.: 0.0257) MultiSource/Applications/d/make_dparser: 3.49% (3.2366 => 3.3496, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.40% (4.4873 => 4.6399, std.dev.: 0.0224) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.08% (13.1811 => 13.5872, std.dev.: 0.0336) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.85% (0.3717 => 0.3823, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.34% (1.2602 => 1.2897, std.dev.: 0.0096) MultiSource/Benchmarks/mafft/pairlocalalign: 2.18% (8.6247 => 8.8124, std.dev.: 0.0342) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.78% (1.2423 => 1.2644, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 119.60% (0.0199 => 0.0437, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/pi: 58.43% (1.5795 => 2.5024, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.52% (2.9753 => 3.4668, std.dev.: 0.0319) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.59% (0.7597 => 0.8781, std.dev.: 0.0313) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.72% (2.7995 => 3.2115, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.63% (5.0261 => 5.6104, std.dev.: 0.0341) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.61% (0.3186 => 0.3524, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.00% (1.1857 => 1.2805, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.99% (6.3772 => 6.8866, std.dev.: 0.0758) SingleSource/Benchmarks/McGill/queens: 7.54% (1.7056 => 1.8342, std.dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: 7.21% (7.4933 => 8.0332, std.dev.: 0.0644) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.76% (4.7794 => 5.1026, std.dev.: 0.0487) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.3037 => 1.3902, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.18% (4.9686 => 5.2758, std.dev.: 0.0547) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.90% (4.5327 => 4.8000, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.84% (6.2275 => 6.5290, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.70% (3.3761 => 3.5348, std.dev.: 0.0385) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.22% (4.9469 => 5.1557, std.dev.: 0.0606) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.10% (4.9453 => 5.1481, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.90% (14.0064 => 14.5520, std.dev.: 0.0543) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.68% (0.3587 => 0.3719, std.dev.: 0.0044) MultiSource/Applications/siod/siod: 3.11% (3.6643 => 3.7784, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.78% (11.5690 => 11.8902, std.dev.: 0.0698) SingleSource/Benchmarks/Dhrystone/dry: 2.74% (0.5081 => 0.5220, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.71% (8.2783 => 8.5025, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout/lists: 2.46% (7.3375 => 7.5181, std.dev.: 0.0530) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.31% (4.8660 => 4.9783, std.dev.: 0.0162) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.91% (1.1365 => 1.1582, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.69% (1.5941 => 1.6211, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.50% (4.4340 => 4.5007, std.dev.: 0.0247) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.34% (3.5679 => 3.6158, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/neural/neural: 1.30% (1.0841 => 1.0982, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.13% (5.4641 => 4.3093, std.dev.: 0.0802) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.26% (7.2130 => 6.2562, std.dev.: 0.2444) MultiSource/Benchmarks/mafft/pairlocalalign: -8.43% (63.1822 => 57.8538, std.dev.: 0.1087) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.79% (14.6451 => 13.5041, std.dev.: 0.0915) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.88% (4.7482 => 4.4216, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.36% (0.3269 => 0.3061, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.92% (5.4972 => 5.1717, std.dev.: 0.0241) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.29% (3.7148 => 3.5182, std.dev.: 0.0595) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.04% (5.1557 => 4.8960, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.65% (2.8773 => 2.7434, std.dev.: 0.0244) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.15% (6.0224 => 5.8325, std.dev.: 0.0156) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.14% (28.5821 => 27.6847, std.dev.: 0.1264) MultiSource/Applications/aha/aha: -2.24% (3.3398 => 3.2651, std.dev.: 0.0185) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.05% (2.4490 => 2.3987, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/hash2: -1.92% (3.4237 => 3.3581, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.59% (4.9994 => 4.9199, std.dev.: 0.0203) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.56% (2.3487 => 2.3120, std.dev.: 0.0084) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.70% (1.0262 => 1.0744, std.dev.: 0.2341) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 91.06% (0.0123 => 0.0235, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.88% (0.0408 => 0.0432, std.dev.: 0.0102) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.50% (0.0254 => 0.0334, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.72% (0.0384 => 0.0429, std.dev.: 0.0110) SingleSource/UnitTests/Vector/Altivec/casts: 8.42% (0.0190 => 0.0206, std.dev.: 0.0051) SingleSource/UnitTests/Vector/Altivec/test1: 23.33% (0.0180 => 0.0222, std.dev.: 0.0042) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 2.71% (0.1438 => 0.1477, std.dev.: 0.0211) MultiSource/Applications/lemon/lemon: 2.24% (1.1329 => 1.1583, std.dev.: 0.3734) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.13% (0.4164 => 0.4117, std.dev.: 0.0927) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.77% (0.1369 => 0.1448, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.94% (0.0641 => 0.0635, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.69% (0.0578 => 0.0582, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.38% (1.1437 => 1.1938, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.71% (0.0627 => 0.0644, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.11% (0.0180 => 0.0236, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.72% (0.8017 => 0.7799, std.dev.: 0.1494) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 22.58% (0.0062 => 0.0076, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 10:00:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 12:00:26 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121125180026.186172A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6239?compare_to=6236&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6239, Order: 168566, Start Time: 2012-11-25 16:27:20, End Time: 2012-11-25 18:00:55 To: 6236, Order: 168562, Start Time: 2012-11-25 14:29:54, End Time: 2012-11-25 16:04:12 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 3 (4 on baseline) Performance Improvements: 0 (179 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1089 (859 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/lambda-0_1_3/lambda: 1.33% (0.7619 => 0.7720, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.53% (1.1470 => 1.1645, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.10% (42.5166 => 42.9842, std.dev.: 0.0203) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.66% (2.0478 => 2.1022, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.4937 => 7.6777, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/hash2: 2.09% (3.1932 => 3.2600, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.03% (0.3821 => 0.3514, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -6.77% (2.4924 => 2.3236, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.59% (0.3142 => 0.2935, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.53% (0.9542 => 0.8919, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.37% (0.3357 => 0.3143, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -5.97% (0.2160 => 0.2031, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.97% (0.2428 => 0.2283, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.93% (0.7198 => 0.6771, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.85% (0.1796 => 0.1691, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -5.83% (9.2283 => 8.6906, std.dev.: 0.0134) MultiSource/Applications/JM/lencod/lencod: -5.80% (16.1920 => 15.2525, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/ReedSolomon: -5.80% (0.1879 => 0.1770, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: -5.76% (7.0961 => 6.6875, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.73% (0.5863 => 0.5527, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.71% (0.9852 => 0.9289, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.71% (0.5591 => 0.5272, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.67% (0.5570 => 0.5254, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.66% (0.6484 => 0.6117, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.64% (0.5478 => 0.5169, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.63% (1.3722 => 1.2949, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.61% (0.2355 => 0.2223, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: -5.60% (0.9179 => 0.8665, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.58% (0.6052 => 0.5714, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.56% (0.5805 => 0.5482, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.55% (0.5857 => 0.5532, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.54% (0.5705 => 0.5389, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.54% (0.6230 => 0.5885, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.54% (0.5925 => 0.5597, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.53% (0.6667 => 0.6298, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.53% (0.5802 => 0.5481, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.53% (1.0544 => 0.9961, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.52% (0.3658 => 0.3456, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.48% (0.5581 => 0.5275, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.48% (4.8161 => 4.5521, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.46% (0.6446 => 0.6094, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.46% (0.6194 => 0.5856, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.45% (0.5849 => 0.5530, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.41% (0.5456 => 0.5161, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.40% (3.5339 => 3.3429, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.38% (0.6297 => 0.5958, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.36% (0.5575 => 0.5276, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.36% (1.6364 => 1.5487, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.35% (0.6260 => 0.5925, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -5.35% (0.3831 => 0.3626, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.35% (4.0323 => 3.8167, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.34% (0.2695 => 0.2551, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.34% (0.3880 => 0.3673, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.33% (4.8802 => 4.6203, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: -5.31% (1.1530 => 1.0918, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.30% (1.2300 => 1.1648, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.30% (0.6660 => 0.6307, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.30% (0.6304 => 0.5970, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -5.29% (0.3896 => 0.3690, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: -5.26% (0.4033 => 0.3821, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.25% (0.6189 => 0.5864, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.24% (0.6681 => 0.6331, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: -5.22% (1.1450 => 1.0852, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -5.22% (0.3812 => 0.3613, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.21% (1.4642 => 1.3879, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-3: -5.20% (0.3848 => 0.3648, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.18% (0.5941 => 0.5633, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.18% (0.4515 => 0.4281, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.18% (6.7716 => 6.4208, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.16% (14.2083 => 13.4746, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.15% (0.5859 => 0.5557, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.15% (0.5688 => 0.5395, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.11% (0.6676 => 0.6335, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.10% (0.7919 => 0.7515, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.09% (4.5069 => 4.2773, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: -5.09% (1.3864 => 1.3158, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.08% (1.2784 => 1.2134, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.07% (0.6033 => 0.5727, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.06% (0.6440 => 0.6114, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.05% (17.1032 => 16.2400, std.dev.: 0.0237) SingleSource/UnitTests/ObjC/exceptions: -5.03% (0.4176 => 0.3966, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.02% (0.8521 => 0.8093, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.02% (0.6293 => 0.5977, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.02% (0.3406 => 0.3235, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -5.01% (4.3330 => 4.1161, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.99% (0.6736 => 0.6400, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.99% (0.3891 => 0.3697, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.98% (8.0126 => 7.6134, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.95% (1.2210 => 1.1606, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: -4.95% (0.2871 => 0.2729, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.90% (1.2221 => 1.1622, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: -4.89% (15.5079 => 14.7492, std.dev.: 0.0206) MultiSource/Benchmarks/Olden/bh/bh: -4.86% (0.2985 => 0.2840, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.84% (0.3057 => 0.2909, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.83% (0.5999 => 0.5709, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -4.83% (0.3581 => 0.3408, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.83% (0.2278 => 0.2168, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.82% (0.3483 => 0.3315, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.81% (0.3016 => 0.2871, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.80% (0.3205 => 0.3051, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -4.80% (0.3394 => 0.3231, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -4.80% (0.2939 => 0.2798, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.79% (0.2903 => 0.2764, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: -4.78% (0.2989 => 0.2846, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.78% (0.7339 => 0.6988, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: -4.76% (0.3255 => 0.3100, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.76% (0.4916 => 0.4682, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -4.76% (0.3446 => 0.3282, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.75% (0.3323 => 0.3165, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.75% (0.2548 => 0.2427, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.75% (0.4151 => 0.3954, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -4.74% (0.4199 => 0.4000, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.74% (0.2933 => 0.2794, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -4.71% (3.5154 => 3.3499, std.dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: -4.70% (1.3148 => 1.2530, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: -4.69% (0.3026 => 0.2884, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.69% (0.3884 => 0.3702, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.67% (0.2849 => 0.2716, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.67% (0.3837 => 0.3658, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.65% (0.2385 => 0.2274, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.64% (0.6395 => 0.6098, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.63% (0.2999 => 0.2860, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.62% (0.3849 => 0.3671, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -4.61% (15.2527 => 14.5491, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.61% (0.3252 => 0.3102, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -4.61% (1.2515 => 1.1938, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.61% (2.1713 => 2.0713, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/moments: -4.59% (0.4248 => 0.4053, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.58% (0.3931 => 0.3751, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -4.57% (0.3481 => 0.3322, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -4.53% (0.3025 => 0.2888, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -4.51% (0.3194 => 0.3050, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -4.50% (4.0594 => 3.8766, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: -4.50% (0.7447 => 0.7112, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: -4.48% (0.2659 => 0.2540, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.47% (22.4056 => 21.4030, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.47% (0.5569 => 0.5320, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.45% (0.7524 => 0.7189, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.41% (0.6395 => 0.6113, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.41% (0.4083 => 0.3903, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -4.40% (0.4861 => 0.4647, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.37% (0.3319 => 0.3174, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists: -4.36% (0.3621 => 0.3463, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.35% (0.5168 => 0.4943, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -4.35% (5.0226 => 4.8040, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: -4.34% (0.3867 => 0.3699, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.33% (1.6474 => 1.5761, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: -4.32% (0.4280 => 0.4095, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.31% (0.5567 => 0.5327, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.30% (0.7021 => 0.6719, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.30% (0.5329 => 0.5100, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.26% (0.4813 => 0.4608, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.21% (0.9557 => 0.9155, std.dev.: 0.0017) MultiSource/Applications/treecc/treecc: -4.13% (2.1401 => 2.0518, std.dev.: 0.0028) SingleSource/Regression/C++/ofstream_ctor: -4.12% (0.3059 => 0.2933, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.10% (0.4321 => 0.4144, std.dev.: 0.0040) MultiSource/Applications/siod/siod: -4.04% (2.4021 => 2.3051, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.00% (0.4427 => 0.4250, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -3.96% (0.3788 => 0.3638, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -3.90% (0.6750 => 0.6487, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -3.85% (0.3271 => 0.3145, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.85% (2.2587 => 2.1717, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: -3.84% (0.7779 => 0.7480, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: -3.79% (0.6441 => 0.6197, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: -3.75% (0.6347 => 0.6109, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -3.74% (34.0927 => 32.8177, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/hash: -3.71% (0.4524 => 0.4356, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.70% (0.3491 => 0.3362, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -3.64% (0.8418 => 0.8112, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.61% (0.9077 => 0.8749, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: -3.48% (1.5610 => 1.5067, std.dev.: 0.0057) MultiSource/Applications/kimwitu++/kc: -3.45% (18.2933 => 17.6616, std.dev.: 0.0118) MultiSource/Applications/lambda-0_1_3/lambda: -3.28% (0.7982 => 0.7720, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.98% (5.4682 => 5.3055, std.dev.: 0.0120) SingleSource/UnitTests/Vector/constpool: -2.49% (20.7746 => 20.2573, std.dev.: 0.0287) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.54% (7.5137 => 5.7448, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1729, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7068, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.81% (2.2633 => 2.1770, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.82% (1.3096 => 1.2858, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4715, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 10:41:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 12:41:37 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121125184137.DE6452A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6240?compare_to=6234&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6240, Order: 168565, Start Time: 2012-11-25 16:22:11, End Time: 2012-11-25 18:42:06 To: 6234, Order: 168561, Start Time: 2012-11-25 13:06:08, End Time: 2012-11-25 15:25:45 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 52 (167 on baseline) Performance Improvements: 16 (38 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1018 (680 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 14.45% (1.7930 => 2.0520, std.dev.: 0.0219) SingleSource/Benchmarks/Shootout-C++/matrix: 13.34% (0.3412 => 0.3867, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: 13.03% (0.1880 => 0.2125, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.76% (0.5149 => 0.5806, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/exptree: 12.30% (0.0927 => 0.1041, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 11.94% (0.3173 => 0.3552, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/methcall: 11.82% (0.3164 => 0.3538, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 11.72% (0.7341 => 0.8201, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/moments: 10.79% (0.4504 => 0.4990, std.dev.: 0.0008) SingleSource/Benchmarks/LivermoreLoops/kernel14: 10.68% (0.1086 => 0.1202, std.dev.: 0.0010) SingleSource/Benchmarks/LivermoreLoops/kernel15: 10.41% (0.1182 => 0.1305, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/ReedSolomon: 10.13% (0.2192 => 0.2414, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.07% (0.3158 => 0.3476, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 9.73% (0.5172 => 0.5675, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.61% (0.6565 => 0.7196, std.dev.: 0.0195) SingleSource/UnitTests/ObjC++/property-reference: 9.46% (0.8059 => 0.8821, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.36% (0.5897 => 0.6449, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.35% (0.6613 => 0.7231, std.dev.: 0.0240) SingleSource/Benchmarks/LivermoreLoops/kernel16: 9.28% (0.1131 => 0.1236, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.25% (0.7169 => 0.7832, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.13% (0.5880 => 0.6417, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.94% (0.6301 => 0.6864, std.dev.: 0.0193) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.75% (0.1291 => 0.1404, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.72% (0.5783 => 0.6287, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/flops: 7.51% (0.1972 => 0.2120, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 7.50% (2.2835 => 2.4548, std.dev.: 0.0575) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.43% (0.3067 => 0.3295, std.dev.: 0.0031) SingleSource/Benchmarks/LivermoreLoops/kernel18: 7.10% (0.1479 => 0.1584, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/fibo: 6.71% (0.3084 => 0.3291, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/neural/neural: 6.61% (0.1604 => 0.1710, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.56% (0.3492 => 0.3721, std.dev.: 0.0089) MultiSource/Applications/viterbi/viterbi: 6.26% (0.1789 => 0.1901, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists: 6.21% (0.3815 => 0.4052, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 6.02% (0.4781 => 0.5069, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/random: 6.00% (0.3082 => 0.3267, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 5.99% (0.5427 => 0.5752, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 5.87% (0.3526 => 0.3733, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference-object: 5.70% (0.6667 => 0.7047, std.dev.: 0.0100) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.27% (0.2409 => 0.2536, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 4.95% (0.6528 => 0.6851, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/objinst: 4.43% (0.3367 => 0.3516, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: 4.10% (54.8873 => 57.1397, std.dev.: 0.0398) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: 25.16% (3.7839 => 4.7360, std.dev.: 0.0772) SingleSource/Benchmarks/CoyoteBench/fftbench: 22.84% (2.1010 => 2.5808, std.dev.: 0.0808) SingleSource/Benchmarks/Shootout/ary3: 18.98% (3.9927 => 4.7504, std.dev.: 0.0350) MultiSource/Applications/SPASS/SPASS: 17.18% (13.4432 => 15.7523, std.dev.: 0.3779) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.64% (11.4569 => 12.7904, std.dev.: 0.1624) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.95% (3.9369 => 4.2894, std.dev.: 0.0117) SingleSource/Benchmarks/McGill/chomp: 8.17% (1.2181 => 1.3176, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash2: 8.00% (3.3739 => 3.6437, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 6.08% (0.7763 => 0.8235, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.09% (1.5652 => 1.5822, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/messages-2: -13.77% (0.0893 => 0.0770, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: -9.09% (0.4698 => 0.4271, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -7.87% (0.4470 => 0.4118, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -7.50% (0.3267 => 0.3022, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: -7.30% (0.3357 => 0.3112, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: -7.29% (0.4264 => 0.3953, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.95% (0.3412 => 0.3175, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -6.88% (0.5042 => 0.4695, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.63% (0.4237 => 0.3956, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -5.45% (0.4603 => 0.4352, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: -5.04% (0.3731 => 0.3543, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -4.95% (0.4083 => 0.3881, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/synchronized: -4.95% (0.4186 => 0.3979, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -4.44% (0.4619 => 0.4414, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -2.99% (4.0498 => 3.9289, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: -1.44% (12.7112 => 12.5286, std.dev.: 0.0021) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.25% (69.3977 => 69.5729, std.dev.: 0.1737) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1338 => 0.1338, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.48% (0.0419 => 0.0421, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.46% (0.0651 => 0.0654, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -0.08% (494.0245 => 493.6085, std.dev.: 0.1706) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 10.01% (63.2438 => 69.5729, std.dev.: 0.1737) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0421, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43671.26% (1.1277 => 493.6085, std.dev.: 0.1706) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.57% (0.5229 => 1.5403, std.dev.: 0.1141) MultiSource/Applications/SPASS/SPASS: 20.24% (14.9895 => 18.0227, std.dev.: 0.0966) MultiSource/Applications/kimwitu++/kc: 47.26% (14.1553 => 20.8447, std.dev.: 0.5130) MultiSource/Benchmarks/MallocBench/gs/gs: 21.27% (4.1105 => 4.9850, std.dev.: 0.1872) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.81% (1.1048 => 1.5115, std.dev.: 0.0618) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 426.30% (7.1582 => 37.6739, std.dev.: 0.5560) SingleSource/Benchmarks/Misc-C++-EH/spirit: 75.99% (3.4629 => 6.0944, std.dev.: 0.4193) SingleSource/Benchmarks/Misc-C++/stepanov_container: 78.50% (0.6222 => 1.1106, std.dev.: 0.0256) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10957.08% (0.0720 => 7.9611, std.dev.: 0.1443) MultiSource/Applications/SIBsim4/SIBsim4: 3859400.00% (0.0001 => 3.8595, std.dev.: 0.0357) MultiSource/Applications/SPASS/SPASS: 15752200.00% (0.0001 => 15.7523, std.dev.: 0.3779) MultiSource/Applications/kimwitu++/kc: 52200.00% (0.0001 => 0.0523, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 64100.00% (0.0001 => 0.0642, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576100.00% (0.0001 => 0.5762, std.dev.: 0.0207) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10085300.00% (0.0001 => 10.0854, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5764400.00% (0.0001 => 5.7645, std.dev.: 0.8845) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1710.39% (1.1194 => 20.2655, std.dev.: 0.7317) MultiSource/Applications/ClamAV/clamscan: 67.69% (22.1758 => 37.1860, std.dev.: 0.1307) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.61% (2.9384 => 4.6313, std.dev.: 0.3297) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.18% (7.0540 => 11.0874, std.dev.: 0.2386) SingleSource/Benchmarks/CoyoteBench/almabench: 48.63% (0.0730 => 0.1085, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 48.35% (8.1363 => 12.0705, std.dev.: 0.2516) SingleSource/Benchmarks/Misc/flops: 48.04% (0.1432 => 0.2120, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 47.28% (21.9371 => 32.3081, std.dev.: 0.1020) MultiSource/Benchmarks/FreeBench/distray/distray: 45.74% (0.1056 => 0.1539, std.dev.: 0.0089) SingleSource/UnitTests/vla: 37.75% (0.0355 => 0.0489, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 32.32% (0.4289 => 0.5675, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 31.65% (0.0793 => 0.1044, std.dev.: 0.0020) SingleSource/Benchmarks/Stanford/Treesort: 29.93% (0.0411 => 0.0534, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.39% (1.5859 => 2.0520, std.dev.: 0.0219) SingleSource/Benchmarks/McGill/chomp: 28.40% (0.1655 => 0.2125, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/exptree: 27.89% (0.0814 => 0.1041, std.dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: 27.44% (0.0481 => 0.0613, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 27.03% (0.6456 => 0.8201, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/matrix: 26.77% (0.0818 => 0.1037, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 26.75% (0.0871 => 0.1104, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/15-trie/trie: 26.38% (0.0527 => 0.0666, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 26.04% (0.1175 => 0.1481, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 25.73% (0.1236 => 0.1554, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.38% (0.0457 => 0.0573, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 25.24% (0.4636 => 0.5806, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/17-bintr/bintr: 25.19% (0.0675 => 0.0845, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: 24.82% (0.3098 => 0.3867, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 24.50% (0.4620 => 0.5752, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.11% (0.0842 => 0.1045, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.99% (0.0746 => 0.0925, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/except: 23.72% (0.2871 => 0.3552, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/bisort/bisort: 23.62% (0.0614 => 0.0759, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 23.54% (0.7835 => 0.9679, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/moments: 23.27% (0.4048 => 0.4990, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 22.98% (0.2877 => 0.3538, std.dev.: 0.0012) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.83% (0.1143 => 0.1404, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: 22.57% (0.0536 => 0.0657, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/misr: 22.43% (0.0633 => 0.0775, std.dev.: 0.0029) MultiSource/Applications/viterbi/viterbi: 22.25% (0.1555 => 0.1901, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/hash: 22.06% (0.0485 => 0.0592, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 22.04% (0.2554 => 0.3117, std.dev.: 0.0176) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.98% (0.5105 => 0.6227, std.dev.: 0.0226) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.84% (0.1566 => 0.1908, std.dev.: 0.0100) MultiSource/Benchmarks/Olden/health/health: 21.53% (0.1268 => 0.1541, std.dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/lpbench: 21.42% (0.0929 => 0.1128, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 21.09% (2.0273 => 2.4548, std.dev.: 0.0575) SingleSource/Benchmarks/Shootout-C++/heapsort: 21.03% (0.2872 => 0.3476, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.78% (0.2758 => 0.3331, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/fibo: 20.77% (0.2725 => 0.3291, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 20.41% (0.7326 => 0.8821, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.36% (0.2107 => 0.2536, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: 20.07% (0.3109 => 0.3733, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.07% (0.4615 => 0.5541, std.dev.: 0.0155) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.3180 => 0.3816, std.dev.: 0.0118) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.30% (0.2700 => 0.3221, std.dev.: 0.0157) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 18.59% (0.2603 => 0.3087, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.46% (0.1029 => 0.1219, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/lists: 18.41% (0.3422 => 0.4052, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.40% (0.1125 => 0.1332, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.33% (0.8172 => 0.9670, std.dev.: 0.0355) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 18.16% (0.3650 => 0.4313, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.97% (0.2793 => 0.3295, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/05-eks/eks: 17.91% (0.4299 => 0.5069, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/ReedSolomon: 17.81% (0.2049 => 0.2414, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.70% (14.3668 => 16.9096, std.dev.: 0.3992) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.68% (0.3162 => 0.3721, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/fbench: 17.57% (0.0592 => 0.0696, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 17.27% (0.3423 => 0.4014, std.dev.: 0.0133) MultiSource/Benchmarks/FreeBench/neural/neural: 16.88% (0.1463 => 0.1710, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference-object: 16.87% (0.6030 => 0.7047, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.80% (2.0665 => 2.4137, std.dev.: 0.0661) SingleSource/UnitTests/SignlessTypes/rem: 16.70% (0.1144 => 0.1335, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 16.60% (0.2802 => 0.3267, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 16.52% (0.1695 => 0.1975, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout/lists: 16.45% (0.0626 => 0.0729, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/messages-2: 16.31% (0.0662 => 0.0770, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 15.91% (0.1163 => 0.1348, std.dev.: 0.0064) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.74% (0.0953 => 0.1103, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 15.60% (3.8723 => 4.4765, std.dev.: 0.2191) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.59% (0.0648 => 0.0749, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.58% (0.0770 => 0.0890, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.58% (0.0886 => 0.1024, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 15.42% (0.1906 => 0.2200, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.37% (4.9449 => 5.7047, std.dev.: 0.1941) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.35% (0.2065 => 0.2382, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.06% (0.0770 => 0.0886, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.04% (0.1117 => 0.1285, std.dev.: 0.0058) MultiSource/Benchmarks/NPB-serial/is/is: 14.88% (0.0719 => 0.0826, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.63% (0.0834 => 0.0956, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.58% (4.2646 => 4.8862, std.dev.: 0.2152) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.42% (0.3121 => 0.3571, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.25% (0.5981 => 0.6833, std.dev.: 0.0216) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.14% (0.1337 => 0.1526, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.75% (0.1062 => 0.1208, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.68% (0.5569 => 0.6331, std.dev.: 0.0266) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.67% (0.3307 => 0.3759, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 13.46% (17.1811 => 19.4932, std.dev.: 0.6484) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.37% (5.0018 => 5.6707, std.dev.: 0.1918) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.34% (0.2271 => 0.2574, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/hello: 13.01% (0.2714 => 0.3067, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.83% (0.5020 => 0.5664, std.dev.: 0.0187) SingleSource/UnitTests/ObjC/parameter-passing: 12.40% (0.3927 => 0.4414, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 12.30% (0.3131 => 0.3516, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.01% (0.3865 => 0.4329, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.99% (0.3886 => 0.4352, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 11.75% (0.3473 => 0.3881, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/synchronized: 11.74% (0.3561 => 0.3979, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.72% (0.3516 => 0.3928, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.71% (0.4203 => 0.4695, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.66% (0.3543 => 0.3956, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.61% (0.3497 => 0.3903, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.57% (0.3828 => 0.4271, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.57% (0.3543 => 0.3953, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.48% (0.3694 => 0.4118, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 11.21% (0.3603 => 0.4007, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists1: 10.67% (0.3684 => 0.4077, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 10.21% (10.3673 => 11.4254, std.dev.: 0.1107) SingleSource/Regression/C++/ofstream_ctor: 9.95% (0.2905 => 0.3194, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: 9.93% (0.2831 => 0.3112, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 9.83% (0.3379 => 0.3711, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.82% (0.2891 => 0.3175, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.65% (0.2756 => 0.3022, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 9.62% (0.3232 => 0.3543, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 9.59% (0.3283 => 0.3598, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.24% (0.3052 => 0.3334, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: 5.49% (54.1659 => 57.1397, std.dev.: 0.0398) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.03% (0.3817 => 0.3971, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 151.00% (4.3953 => 11.0320, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: 147.87% (5.3999 => 13.3850, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/17-bintr/bintr: 57.33% (0.1043 => 0.1641, std.dev.: 0.0225) SingleSource/Benchmarks/Shootout/ary3: 28.41% (3.6994 => 4.7504, std.dev.: 0.0350) SingleSource/Benchmarks/Shootout-C++/ary3: 27.24% (3.7221 => 4.7360, std.dev.: 0.0772) SingleSource/Benchmarks/CoyoteBench/fftbench: 26.76% (2.0360 => 2.5808, std.dev.: 0.0808) SingleSource/Benchmarks/CoyoteBench/lpbench: 23.63% (10.3460 => 12.7904, std.dev.: 0.1624) SingleSource/Benchmarks/Misc/oourafft: 17.65% (6.6465 => 7.8193, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.71% (1.1145 => 1.3007, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash2: 15.39% (3.1578 => 3.6437, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.01% (0.2944 => 0.3327, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/moments: 12.08% (0.1159 => 0.1299, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.58% (2.8904 => 3.2252, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/heapsort: 11.32% (3.8532 => 4.2894, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/hash: 10.46% (0.7455 => 0.8235, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/richards_benchmark: 10.26% (1.1396 => 1.2565, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.32% (1.7254 => 1.8862, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: 6.49% (1.2373 => 1.3176, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.65% (4.2280 => 4.4668, std.dev.: 0.0024) MultiSource/Applications/lua/lua: 5.62% (26.0924 => 27.5600, std.dev.: 0.1057) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.6436 => 12.1286, std.dev.: 0.0091) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: 2.62% (2.4116 => 2.4749, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/hash: 2.45% (4.9088 => 5.0292, std.dev.: 0.0285) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.35% (1.7133 => 1.7536, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 2.06% (3.1595 => 3.2246, std.dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: 2.02% (1.9577 => 1.9972, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: 1.98% (3.8526 => 3.9289, std.dev.: 0.0035) MultiSource/Benchmarks/PAQ8p/paq8p: 1.90% (85.0658 => 86.6813, std.dev.: 0.0939) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.87% (2.1424 => 2.1824, std.dev.: 0.0127) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (27.8444 => 28.2409, std.dev.: 0.0678) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.41% (6.5088 => 6.6007, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/sieve: 1.31% (5.2139 => 5.2823, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.29% (1.0313 => 1.0446, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0506, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.42% (6.6874 => 0.1728, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.60% (5.2763 => 1.2348, std.dev.: 0.0451) SingleSource/Benchmarks/Misc/salsa20: -75.75% (0.8651 => 0.2098, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/richards_benchmark: -44.82% (0.1622 => 0.0895, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.97% (5.3855 => 4.6870, std.dev.: 0.1632) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.46% (5.3526 => 4.7390, std.dev.: 0.1486) MultiSource/Applications/JM/ldecod/ldecod: -10.85% (10.4361 => 9.3037, std.dev.: 0.3329) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.26% (0.3987 => 0.2382, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.33% (4.5009 => 2.7759, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.16% (2.6546 => 2.0132, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/mason/mason: -19.34% (0.2161 => 0.1743, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.66% (1.6925 => 1.4275, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2842, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.73% (32.5116 => 29.0223, std.dev.: 0.0195) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -10.23% (9.5636 => 8.5851, std.dev.: 0.1900) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.03% (1.5660 => 1.4246, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.95% (4.8142 => 4.4796, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.05% (3.2416 => 3.0455, std.dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7497, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -5.36% (19.9488 => 18.8788, std.dev.: 0.3240) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -4.58% (1.5835 => 1.5109, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/lists: -4.25% (6.2999 => 6.0322, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.45% (0.9957 => 0.9613, std.dev.: 0.0078) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8917, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.41% (0.4808 => 0.4692, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.78% (8.1563 => 8.0109, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6773, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -1.47% (10.2830 => 10.1318, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.09% (0.2116 => 0.0654, std.dev.: 0.0015) Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 11:24:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 13:24:31 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121125192431.9AFC72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6241?compare_to=6238&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6241, Order: 168570, Start Time: 2012-11-25 17:55:17, End Time: 2012-11-25 19:25:02 To: 6238, Order: 168566, Start Time: 2012-11-25 16:03:22, End Time: 2012-11-25 17:38:02 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 5 (100 on baseline) Performance Improvements: 19 (23 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1030 (851 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.54% (0.9272 => 0.9415, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.88% (1.3043 => 1.3940, std.dev.: 0.0308) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.87% (58.9724 => 60.6671, std.dev.: 0.1741) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.57% (4.3538 => 4.4655, std.dev.: 0.0380) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.17% (1.2459 => 1.2605, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.01% (0.2162 => 0.2032, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.28% (1.2421 => 1.1889, std.dev.: 0.0176) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.13% (0.3220 => 0.3087, std.dev.: 0.0050) MultiSource/Applications/Burg/burg: -2.57% (1.2995 => 1.2661, std.dev.: 0.0108) MultiSource/Applications/d/make_dparser: -1.06% (3.3496 => 3.3140, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -12.89% (3.4771 => 3.0290, std.dev.: 0.0305) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.19% (0.3524 => 0.3341, std.dev.: 0.0069) MultiSource/Applications/SPASS/SPASS: -3.59% (8.7302 => 8.4167, std.dev.: 0.0754) MultiSource/Applications/sgefa/sgefa: -3.21% (0.3617 => 0.3501, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: -2.71% (8.0332 => 7.8154, std.dev.: 0.0554) SingleSource/Benchmarks/Shootout/hash: -2.16% (4.3556 => 4.2617, std.dev.: 0.0092) SingleSource/Benchmarks/Dhrystone/dry: -2.11% (0.5220 => 0.5110, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: -2.01% (0.6328 => 0.6201, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.84% (4.5007 => 4.4178, std.dev.: 0.0231) SingleSource/Benchmarks/Dhrystone/fldry: -1.44% (0.6938 => 0.6838, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.27% (2.9353 => 2.8980, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/ary3: -1.20% (2.0229 => 1.9987, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/mandel-2: -1.17% (2.9274 => 2.8932, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.01% (4.5915 => 4.5450, std.dev.: 0.0144) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.78% (1.0744 => 1.0553, std.dev.: 0.0148) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -6.38% (0.0235 => 0.0220, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.46% (0.0432 => 0.0430, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -17.96% (0.0334 => 0.0274, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0315 => 0.0314, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.43% (0.0429 => 0.0410, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0206 => 0.0206, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -21.17% (0.0222 => 0.0175, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1477 => 0.1476, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 0.72% (1.1583 => 1.1666, std.dev.: 0.0206) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.46% (0.4117 => 0.4177, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.80% (0.1448 => 0.1422, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.72% (0.0635 => 0.0605, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -31.41% (0.0277 => 0.0190, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.44% (0.0582 => 0.0602, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.06% (1.1938 => 1.1931, std.dev.: 0.0329) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.54% (0.0644 => 0.0589, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.69% (0.0236 => 0.0240, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.46% (0.7799 => 0.7763, std.dev.: 0.0052) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -14.47% (0.0076 => 0.0065, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 6.83% (16.4461 => 17.5686, std.dev.: 0.0175) MultiSource/Applications/sqlite3/sqlite3: 2319.25% (0.6332 => 15.3187, std.dev.: 0.0116) MultiSource/Benchmarks/McCat/08-main/main: 41.94% (0.1831 => 0.2599, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -11.10% (0.1559 => 0.1386, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7084.98% (0.3123 => 22.4387, std.dev.: 0.1736) SingleSource/Benchmarks/CoyoteBench/fftbench: 52.70% (0.2463 => 0.3761, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1521.89% (0.3344 => 5.4236, std.dev.: 0.0272) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.65% (0.2364 => 0.3254, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/bigfib: 4.41% (0.6010 => 0.6275, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.3266 => 0.3426, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: 3.96% (0.1969 => 0.2047, std.dev.: 0.0013) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.14% (0.0224 => 0.0240, std.dev.: 0.0008) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0477, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 7.73% (0.1462 => 0.1575, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4645, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0700, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4946, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5146, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.4952, std.dev.: 0.1372) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3154, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1191, std.dev.: 0.0416) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3626, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4049, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0870, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: -23.70% (2.1832 => 1.6657, std.dev.: 0.0093) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 12.84% (0.0810 => 0.0914, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: 9.89% (0.1112 => 0.1222, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.16% (0.3295 => 0.3531, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.16% (0.2180 => 0.2336, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.14% (0.3137 => 0.3361, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.84% (0.8321 => 0.8890, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.58% (0.7473 => 0.7965, std.dev.: 0.0105) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.46% (0.1905 => 0.2009, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.30% (0.9435 => 0.9935, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.97% (0.2133 => 0.2239, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.96% (0.2519 => 0.2644, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.55% (0.8148 => 0.8519, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.51% (1.1606 => 1.2129, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.06% (0.6287 => 0.6542, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.96% (0.9056 => 0.9415, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.93% (0.4127 => 0.4289, std.dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: 3.90% (1.1271 => 1.1711, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 3.59% (1.2222 => 1.2661, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.47% (1.2526 => 1.2961, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.44% (0.4559 => 0.4716, std.dev.: 0.0020) MultiSource/Applications/spiff/spiff: 3.26% (0.7950 => 0.8209, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.24% (0.3115 => 0.3216, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.15% (2.1401 => 2.2075, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.08% (0.9908 => 1.0213, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 2.93% (0.6834 => 0.7034, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.91% (1.4479 => 1.4900, std.dev.: 0.0104) MultiSource/Applications/SPASS/SPASS: 2.91% (14.2605 => 14.6749, std.dev.: 0.0482) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.89% (0.8697 => 0.8948, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.81% (4.1763 => 4.2937, std.dev.: 0.0339) MultiSource/Applications/SIBsim4/SIBsim4: 2.81% (1.2568 => 1.2921, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.79% (1.3279 => 1.3649, std.dev.: 0.0105) MultiSource/Applications/siod/siod: 2.76% (2.2184 => 2.2796, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.66% (0.8340 => 0.8562, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (1.5315 => 1.5720, std.dev.: 0.0044) MultiSource/Benchmarks/PAQ8p/paq8p: 2.63% (2.3764 => 2.4388, std.dev.: 0.0097) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.57% (6.6074 => 6.7775, std.dev.: 0.0423) MultiSource/Applications/lua/lua: 2.57% (3.8189 => 3.9172, std.dev.: 0.0292) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.56% (0.5191 => 0.5324, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.56% (0.9688 => 0.9936, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.51% (0.8457 => 0.8669, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.41% (4.5702 => 4.6805, std.dev.: 0.0403) MultiSource/Applications/ClamAV/clamscan: 2.41% (14.7684 => 15.1241, std.dev.: 0.0761) MultiSource/Applications/d/make_dparser: 2.39% (3.2366 => 3.3140, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.36% (0.8331 => 0.8528, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.36% (13.1811 => 13.4927, std.dev.: 0.0751) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.34% (0.8086 => 0.8275, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.31% (0.8066 => 0.8252, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.31% (0.8805 => 0.9008, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.30% (0.8050 => 0.8235, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.26% (0.9069 => 0.9274, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.22% (0.8712 => 0.8905, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.18% (0.8286 => 0.8467, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.17% (0.6586 => 0.6729, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 2.17% (15.3280 => 15.6607, std.dev.: 0.0319) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.16% (0.8518 => 0.8702, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.16% (0.8716 => 0.8904, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: 2.14% (31.8598 => 32.5415, std.dev.: 0.2558) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.13% (0.7932 => 0.8101, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.08% (0.8048 => 0.8215, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.02% (0.9039 => 0.9222, std.dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 2.01% (6.7320 => 6.8672, std.dev.: 0.0343) MultiSource/Applications/hexxagon/hexxagon: 1.98% (0.9810 => 1.0004, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.92% (0.8316 => 0.8476, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.90% (1.2602 => 1.2842, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.88% (3.1832 => 3.2430, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.83% (0.8927 => 0.9090, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.79% (0.8338 => 0.8487, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 1.76% (1.0945 => 1.1138, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.62% (0.8995 => 0.9141, std.dev.: 0.0050) MultiSource/Applications/oggenc/oggenc: 1.51% (4.9628 => 5.0379, std.dev.: 0.0263) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 111.56% (0.0199 => 0.0421, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/pi: 58.66% (1.5795 => 2.5061, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.34% (2.9753 => 3.4616, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.72% (0.7597 => 0.8791, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.53% (2.7995 => 3.2064, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.45% (5.0261 => 5.6016, std.dev.: 0.1010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.66% (1.1857 => 1.2765, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/queens: 7.23% (1.7056 => 1.8290, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.79% (4.7794 => 5.1041, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.81% (4.5327 => 4.7961, std.dev.: 0.0064) MultiSource/Applications/SIBsim4/SIBsim4: 5.81% (3.1873 => 3.3725, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.86% (6.2275 => 6.5304, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.50% (3.3761 => 3.5281, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: 4.30% (7.4933 => 7.8154, std.dev.: 0.0554) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.05% (4.9453 => 5.1458, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.99% (4.9469 => 5.1444, std.dev.: 0.0063) MultiSource/Applications/hexxagon/hexxagon: 3.83% (14.0064 => 14.5434, std.dev.: 0.0058) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.36% (1.2337 => 1.2751, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.29% (0.3587 => 0.3705, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.79% (8.2783 => 8.5089, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.72% (11.5690 => 11.8832, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.53% (4.3552 => 4.4655, std.dev.: 0.0380) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.37% (59.2638 => 60.6671, std.dev.: 0.1741) SingleSource/Benchmarks/Shootout/lists: 2.36% (7.3375 => 7.5105, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.23% (4.8660 => 4.9743, std.dev.: 0.0275) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.94% (1.1365 => 1.1586, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.91% (4.8362 => 4.9285, std.dev.: 0.0273) MultiSource/Benchmarks/Olden/power/power: 1.32% (1.2061 => 1.2220, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.16% (3.5679 => 3.6093, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.05% (1.2474 => 1.2605, std.dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -36.98% (0.0338 => 0.0213, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/em3d/em3d: -20.98% (5.4641 => 4.3180, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.20% (7.2130 => 6.1887, std.dev.: 0.3599) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.85% (1.0512 => 0.9371, std.dev.: 0.0287) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.72% (0.3269 => 0.2984, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: -8.53% (63.1822 => 57.7936, std.dev.: 0.0697) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.46% (14.6451 => 13.5530, std.dev.: 0.0265) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -7.03% (4.7482 => 4.4144, std.dev.: 0.0244) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.92% (5.4972 => 5.1715, std.dev.: 0.0417) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.09% (5.1557 => 4.8934, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.34% (4.7449 => 4.5389, std.dev.: 0.0098) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.23% (2.8773 => 2.7557, std.dev.: 0.0410) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.73% (6.0224 => 5.7979, std.dev.: 0.0297) MultiSource/Applications/lua/lua: -3.33% (29.8330 => 28.8393, std.dev.: 0.0226) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.14% (28.5821 => 27.6844, std.dev.: 0.1521) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.98% (0.5807 => 0.5634, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.58% (9.9065 => 9.6511, std.dev.: 0.0482) SingleSource/Benchmarks/Shootout-C++/hash2: -2.27% (3.4237 => 3.3460, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.05% (11.5316 => 11.2957, std.dev.: 0.0104) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.84% (2.3487 => 2.3055, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.72% (3.2169 => 3.1616, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.45% (3.5968 => 3.5446, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout/hash: -1.09% (4.3087 => 4.2617, std.dev.: 0.0092) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.84% (1.0262 => 1.0553, std.dev.: 0.0148) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.39% (0.0408 => 0.0430, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 7.87% (0.0254 => 0.0274, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 6.77% (0.0384 => 0.0410, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: 8.42% (0.0190 => 0.0206, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -2.78% (0.0180 => 0.0175, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.64% (0.1438 => 0.1476, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 2.97% (1.1329 => 1.1666, std.dev.: 0.0206) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.31% (0.4164 => 0.4177, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.87% (0.1369 => 0.1422, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.62% (0.0641 => 0.0605, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.56% (0.0195 => 0.0190, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.15% (0.0578 => 0.0602, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.32% (1.1437 => 1.1931, std.dev.: 0.0329) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.06% (0.0627 => 0.0589, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 33.33% (0.0180 => 0.0240, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.17% (0.8017 => 0.7763, std.dev.: 0.0052) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 4.84% (0.0062 => 0.0065, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 11:56:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 13:56:51 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121125195651.3CC802A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6242?compare_to=6239&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6242, Order: 168570, Start Time: 2012-11-25 18:23:50, End Time: 2012-11-25 19:57:21 To: 6239, Order: 168566, Start Time: 2012-11-25 16:27:20, End Time: 2012-11-25 18:00:55 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (6 on baseline) Performance Improvements: 1 (174 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1089 (862 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 6.72% (0.4090 => 0.4365, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.89% (54.8252 => 56.4092, std.dev.: 0.0938) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/sim/sim: -1.19% (4.9404 => 4.8814, std.dev.: 0.0014) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 13.85% (0.3834 => 0.4365, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.36% (54.5751 => 56.4092, std.dev.: 0.0938) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.74% (2.0478 => 2.1040, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/salsa20: 2.66% (7.4937 => 7.6930, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash2: 2.15% (3.1932 => 3.2619, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.17% (0.3821 => 0.3509, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.90% (2.4924 => 2.3203, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.87% (0.3142 => 0.2926, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.56% (0.9542 => 0.8916, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.50% (0.3848 => 0.3598, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.46% (0.3357 => 0.3140, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: -6.44% (0.3896 => 0.3645, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -6.37% (0.4033 => 0.3776, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -6.37% (0.3831 => 0.3587, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.37% (0.3880 => 0.3633, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -6.35% (0.3812 => 0.3570, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.20% (0.4176 => 0.3917, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.14% (0.3891 => 0.3652, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.11% (0.2355 => 0.2211, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.09% (0.7198 => 0.6760, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: -6.02% (7.0961 => 6.6688, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.98% (0.6484 => 0.6096, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: -5.98% (16.1920 => 15.2241, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.97% (0.2428 => 0.2283, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -5.93% (0.2160 => 0.2032, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.92% (1.3722 => 1.2909, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: -5.91% (0.4199 => 0.3951, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -5.89% (9.2283 => 8.6845, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.82% (0.3658 => 0.3445, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.80% (4.8161 => 4.5369, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.79% (1.0544 => 0.9933, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.79% (0.3884 => 0.3659, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.77% (0.5705 => 0.5376, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.76% (0.9852 => 0.9285, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.73% (0.1796 => 0.1693, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.73% (0.5863 => 0.5527, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.68% (0.6230 => 0.5876, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.66% (0.5570 => 0.5255, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.65% (0.6667 => 0.6290, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: -5.65% (0.9179 => 0.8660, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.64% (4.0323 => 3.8048, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.64% (4.8802 => 4.6049, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.64% (1.6364 => 1.5441, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.59% (6.7716 => 6.3928, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.59% (0.5478 => 0.5172, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.59% (1.2300 => 1.1613, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.58% (0.6446 => 0.6086, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.58% (0.5802 => 0.5478, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.58% (0.5591 => 0.5279, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.57% (0.6052 => 0.5715, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.57% (0.5857 => 0.5531, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.56% (0.6297 => 0.5947, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.54% (4.5069 => 4.2571, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/05-eks/eks: -5.51% (0.4515 => 0.4266, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.51% (3.5339 => 3.3392, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.51% (0.5849 => 0.5527, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: -5.50% (0.2871 => 0.2713, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.50% (0.3057 => 0.2889, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.47% (0.5575 => 0.5270, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.47% (0.6293 => 0.5949, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.45% (0.2695 => 0.2548, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.45% (0.5925 => 0.5602, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.45% (1.4642 => 1.3844, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.45% (0.6260 => 0.5919, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: -5.44% (0.2939 => 0.2779, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -5.44% (0.4280 => 0.4047, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -5.44% (1.1530 => 1.0903, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.43% (0.3406 => 0.3221, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.43% (0.5805 => 0.5490, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -5.40% (0.3205 => 0.3032, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.39% (14.2083 => 13.4418, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.39% (0.5859 => 0.5543, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.39% (0.6304 => 0.5964, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.39% (0.2933 => 0.2775, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.37% (0.2903 => 0.2747, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.37% (0.3016 => 0.2854, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -5.37% (0.2849 => 0.2696, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.36% (8.0126 => 7.5831, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.33% (0.5456 => 0.5165, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -5.33% (0.3394 => 0.3213, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -5.32% (0.2989 => 0.2830, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -5.31% (0.3446 => 0.3263, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -5.31% (1.1450 => 1.0842, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.30% (0.6189 => 0.5861, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.30% (1.2210 => 1.1563, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.30% (1.2784 => 1.2107, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.29% (0.5941 => 0.5627, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.27% (0.8521 => 0.8072, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.27% (0.3323 => 0.3148, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -5.25% (0.3255 => 0.3084, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -5.25% (1.3148 => 1.2458, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -5.23% (0.2985 => 0.2829, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.23% (0.6660 => 0.6312, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -5.22% (4.3330 => 4.1068, std.dev.: 0.0114) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.21% (0.6736 => 0.6385, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.20% (1.2221 => 1.1585, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.20% (0.5688 => 0.5392, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.20% (0.4151 => 0.3935, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.20% (0.2999 => 0.2843, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: -5.19% (0.3026 => 0.2869, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.18% (0.2278 => 0.2160, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.17% (2.1713 => 2.0590, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.15% (0.7919 => 0.7511, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.14% (0.3849 => 0.3651, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.14% (0.5581 => 0.5294, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -5.14% (15.5079 => 14.7107, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.14% (0.6440 => 0.6109, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: -5.12% (0.3025 => 0.2870, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -5.12% (17.1032 => 16.2274, std.dev.: 0.0036) MultiSource/Applications/Burg/burg: -5.10% (1.2515 => 1.1877, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary2: -5.08% (0.3481 => 0.3304, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -5.08% (0.3581 => 0.3399, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.07% (0.2385 => 0.2264, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.07% (0.3194 => 0.3032, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.06% (0.2548 => 0.2419, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.04% (0.6681 => 0.6344, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: -5.01% (1.3864 => 1.3169, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.01% (0.3252 => 0.3089, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.01% (0.6033 => 0.5731, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.98% (0.4916 => 0.4671, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.98% (0.3837 => 0.3646, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.96% (0.3931 => 0.3736, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.95% (0.5999 => 0.5702, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.94% (0.6676 => 0.6346, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.94% (0.3483 => 0.3311, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -4.92% (0.4861 => 0.4622, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: -4.90% (0.4248 => 0.4040, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -4.88% (3.5154 => 3.3439, std.dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: -4.84% (0.3059 => 0.2911, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.82% (0.4083 => 0.3886, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -4.82% (15.2527 => 14.5171, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/lists: -4.81% (0.3621 => 0.3447, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.79% (0.3319 => 0.3160, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -4.78% (4.0594 => 3.8654, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.77% (0.6395 => 0.6090, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.77% (0.4321 => 0.4115, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.76% (0.3867 => 0.3683, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.76% (0.4813 => 0.4584, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.71% (0.7447 => 0.7096, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.64% (0.7524 => 0.7175, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.63% (22.4056 => 21.3675, std.dev.: 0.0186) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.63% (0.7021 => 0.6696, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.60% (0.5569 => 0.5313, std.dev.: 0.0051) SingleSource/UnitTests/ObjC++/Hello: -4.57% (0.6347 => 0.6057, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.53% (0.5567 => 0.5315, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.52% (1.6474 => 1.5729, std.dev.: 0.0203) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.49% (0.9557 => 0.9128, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: -4.49% (5.0226 => 4.7972, std.dev.: 0.0042) SingleSource/UnitTests/ObjC++/property-reference-object: -4.49% (0.6441 => 0.6152, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.43% (0.5168 => 0.4939, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: -4.41% (2.1401 => 2.0458, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.39% (0.5329 => 0.5095, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.33% (0.7779 => 0.7442, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.32% (0.6395 => 0.6119, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: -4.31% (0.3271 => 0.3130, std.dev.: 0.0009) MultiSource/Applications/siod/siod: -4.29% (2.4021 => 2.2991, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/sieve: -4.28% (0.3788 => 0.3626, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.27% (0.4427 => 0.4238, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -4.27% (0.6750 => 0.6462, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.10% (0.9077 => 0.8705, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -4.05% (0.8418 => 0.8077, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: -4.03% (0.7982 => 0.7660, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: -4.00% (0.4524 => 0.4343, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -3.98% (34.0927 => 32.7344, std.dev.: 0.0185) MultiSource/Applications/hbd/hbd: -3.96% (1.5610 => 1.4992, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.95% (2.2587 => 2.1694, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.90% (0.3491 => 0.3355, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -3.72% (18.2933 => 17.6129, std.dev.: 0.0154) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.24% (5.4682 => 5.2912, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -2.34% (20.7746 => 20.2892, std.dev.: 0.0382) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.58% (7.5137 => 5.7416, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/richards_benchmark: -8.63% (1.2842 => 1.1734, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.84% (2.2633 => 2.1765, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4725, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 12:59:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 14:59:08 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121125205908.24FE02A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/6243?compare_to=6237&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6243, Order: 168569, Start Time: 2012-11-25 17:38:49, End Time: 2012-11-25 20:59:37 To: 6237, Order: 168561, Start Time: 2012-11-25 13:29:57, End Time: 2012-11-25 16:50:38 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (170 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1092 (720 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.84% (0.0625 => 0.0874, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.23% (0.1063 => 0.1395, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.97% (0.2969 => 0.3740, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.23% (0.1106 => 0.1385, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.64% (0.4253 => 0.5301, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.38% (0.4139 => 0.5148, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 24.15% (1.5932 => 1.9779, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.81% (0.0714 => 0.0884, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.37% (0.0475 => 0.0586, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.31% (0.4994 => 0.6158, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.14% (0.5900 => 0.7265, std.dev.: 0.0034) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.77% (0.0584 => 0.0717, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.49% (0.0547 => 0.0670, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.38% (0.5000 => 0.6119, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.74% (0.1021 => 0.1243, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 21.70% (0.0599 => 0.0729, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.63% (0.0897 => 0.1091, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.54% (0.1620 => 0.1969, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.87% (0.1107 => 0.1338, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.70% (0.0541 => 0.0653, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 20.46% (0.0948 => 0.1142, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.22% (0.0633 => 0.0761, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.21% (0.0584 => 0.0702, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.13% (0.1103 => 0.1325, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.94% (0.0642 => 0.0770, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.81% (0.3903 => 0.4676, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: 19.73% (0.0821 => 0.0983, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.64% (0.1003 => 0.1200, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.63% (0.1549 => 0.1853, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.34% (0.0822 => 0.0981, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.33% (0.1604 => 0.1914, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 19.21% (0.1619 => 0.1930, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 19.21% (0.0604 => 0.0720, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.67% (0.1462 => 0.1735, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.59% (0.0947 => 0.1123, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 18.56% (0.0808 => 0.0958, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.12% (0.3890 => 0.4595, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.87% (0.2014 => 0.2374, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 17.57% (0.1218 => 0.1432, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.43% (0.2736 => 0.3213, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 17.35% (0.4029 => 0.4728, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 17.18% (0.5546 => 0.6499, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.11% (1.3152 => 1.5402, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 17.01% (0.1505 => 0.1761, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.00% (0.1088 => 0.1273, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.92% (0.2866 => 0.3351, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 16.77% (0.5826 => 0.6803, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 16.69% (1.8794 => 2.1930, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 16.49% (0.5889 => 0.6860, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.46% (0.1968 => 0.2292, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.38% (0.4658 => 0.5421, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.25% (3.5627 => 4.1417, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.17% (1.6211 => 1.8833, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.17% (0.3271 => 0.3800, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.00% (0.5026 => 0.5830, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.95% (0.1160 => 0.1345, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 15.78% (0.9697 => 1.1227, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.65% (0.2875 => 0.3325, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 15.62% (0.1421 => 0.1643, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.59% (0.4361 => 0.5041, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 15.45% (1.0781 => 1.2447, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 15.34% (0.1284 => 0.1481, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.26% (4.4195 => 5.0939, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.22% (0.3930 => 0.4528, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: 15.08% (0.2725 => 0.3136, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 15.04% (0.2813 => 0.3236, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hello: 15.03% (0.2714 => 0.3122, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 15.03% (4.2109 => 4.8439, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/strcat: 15.02% (0.2750 => 0.3163, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 14.97% (0.2738 => 0.3148, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.96% (2.7292 => 3.1374, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.80% (0.3195 => 0.3668, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/nestedloop: 14.80% (0.2729 => 0.3133, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 14.74% (0.2823 => 0.3239, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 14.66% (0.2803 => 0.3214, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.63% (0.2911 => 0.3337, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 14.62% (0.9909 => 1.1358, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: 14.60% (0.2780 => 0.3186, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.60% (1.9694 => 2.2570, std.dev.: 0.0035) SingleSource/Regression/C++/ofstream_ctor: 14.58% (0.3004 => 0.3442, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 14.54% (0.7171 => 0.8214, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 14.51% (0.2811 => 0.3219, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.51% (0.2792 => 0.3197, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/wc: 14.50% (0.3096 => 0.3545, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.50% (1.9966 => 2.2861, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.50% (0.1090 => 0.1248, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary3: 14.36% (0.3267 => 0.3736, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 14.35% (23.5202 => 26.8958, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.29% (2.0673 => 2.3628, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 14.27% (0.2075 => 0.2371, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary: 14.24% (0.3258 => 0.3722, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 14.11% (0.3317 => 0.3785, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 13.80% (0.2566 => 0.2920, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 13.64% (1.4269 => 1.6215, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 13.57% (0.3678 => 0.4177, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.56% (0.3362 => 0.3818, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.56% (0.3060 => 0.3475, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 13.53% (0.3348 => 0.3801, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.41% (0.3124 => 0.3543, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.35% (0.3282 => 0.3720, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 13.22% (0.7875 => 0.8916, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sieve: 13.15% (0.3726 => 0.4216, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 13.11% (0.3477 => 0.3933, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.10% (0.3625 => 0.4100, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 12.94% (0.3446 => 0.3892, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.90% (0.3690 => 0.4166, std.dev.: 0.0078) MultiSource/Applications/JM/ldecod/ldecod: 12.82% (2.1653 => 2.4429, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/for-in: 12.81% (0.3496 => 0.3944, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 12.81% (0.4146 => 0.4677, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.78% (0.3465 => 0.3908, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.77% (0.3460 => 0.3902, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.76% (0.3981 => 0.4489, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.73% (0.3488 => 0.3932, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.71% (0.3469 => 0.3910, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 12.70% (0.4251 => 0.4791, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 12.67% (0.3442 => 0.3878, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.49% (0.3650 => 0.4106, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.43% (0.3643 => 0.4096, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.41% (0.3845 => 0.4322, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 12.36% (4.6177 => 5.1883, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/parameter-passing: 12.22% (0.3724 => 0.4179, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 12.15% (0.5012 => 0.5621, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 12.13% (2.1013 => 2.3561, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 11.89% (0.2691 => 0.3011, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.57% (0.2040 => 0.2276, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.53% (0.6435 => 0.7177, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11.34% (5.5417 => 6.1701, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.09% (0.1028 => 0.1142, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.63% (0.6634 => 0.7339, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 10.61% (0.3498 => 0.3869, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.52% (0.2737 => 0.3025, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 10.48% (0.4847 => 0.5355, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.47% (0.3084 => 0.3407, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.34% (0.1383 => 0.1526, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.20% (0.2068 => 0.2279, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 9.89% (0.3336 => 0.3666, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.65% (0.2103 => 0.2306, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 9.42% (2.0346 => 2.2262, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 9.33% (0.2391 => 0.2614, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.97% (4.6926 => 5.1137, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.93% (0.5361 => 0.5840, std.dev.: 0.0160) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.46% (11.6398 => 12.6242, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.19% (0.7426 => 0.8034, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.88% (0.5584 => 0.6024, std.dev.: 0.0063) MultiSource/Applications/kimwitu++/kc: 6.60% (11.9555 => 12.7445, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.48% (0.3792 => 0.3924, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 9.81% (0.2802 => 0.3077, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 6.83% (0.2122 => 0.2267, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6104, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.79% (0.3693 => 0.3907, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6691, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1684, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-2: 4.47% (1.8057 => 1.8864, std.dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/dry: 4.28% (14.0481 => 14.6489, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1958, std.dev.: 0.0076) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.56% (3.1722 => 3.2216, std.dev.: 0.0052) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3060, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2838, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5866, std.dev.: 0.0118) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.86% (2.4764 => 2.4055, std.dev.: 0.0142) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5669, std.dev.: 0.0082) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9748, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7914, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -6.29% (0.2402 => 0.2251, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8030, std.dev.: 0.0073) SingleSource/Benchmarks/Dhrystone/fldry: -3.25% (17.2379 => 16.6776, std.dev.: 0.1028) MultiSource/Applications/siod/siod: -3.04% (6.9842 => 6.7721, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8674, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5787, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.70% (0.6293 => 0.6186, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4953, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1706, std.dev.: 0.0730) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0449, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 13:52:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 15:52:50 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121125215250.1D7F02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6244?compare_to=6240&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6244, Order: 168570, Start Time: 2012-11-25 19:33:05, End Time: 2012-11-25 21:53:19 To: 6240, Order: 168565, Start Time: 2012-11-25 16:22:11, End Time: 2012-11-25 18:42:06 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 40 (142 on baseline) Performance Improvements: 4 (38 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1042 (705 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 14.77% (0.7846 => 0.9005, std.dev.: 0.0240) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.62% (0.6649 => 0.7621, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 14.01% (0.6224 => 0.7096, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 13.96% (0.6425 => 0.7322, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.82% (0.6860 => 0.7808, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 13.57% (0.6199 => 0.7040, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 12.94% (0.6173 => 0.6972, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 12.81% (0.5925 => 0.6684, std.dev.: 0.0251) MultiSource/Applications/hexxagon/hexxagon: 12.53% (1.3923 => 1.5668, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.99% (0.3686 => 0.4128, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 11.43% (1.5638 => 1.7425, std.dev.: 0.0148) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.13% (0.7170 => 0.7968, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.92% (0.3909 => 0.4336, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: 10.71% (0.1457 => 0.1613, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.57% (1.7429 => 1.9271, std.dev.: 0.0188) MultiSource/Benchmarks/Prolangs-C/football/football: 9.77% (0.9862 => 1.0826, std.dev.: 0.0163) MultiSource/Benchmarks/Olden/mst/mst: 9.72% (0.1348 => 0.1479, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.38% (2.4839 => 2.7169, std.dev.: 0.0757) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.36% (0.4582 => 0.5011, std.dev.: 0.0137) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.52% (0.3335 => 0.3619, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.46% (0.1891 => 0.2051, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.39% (0.1526 => 0.1654, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 7.99% (3.7608 => 4.0613, std.dev.: 0.0883) SingleSource/Benchmarks/Shootout-C++/ary: 7.90% (0.3543 => 0.3823, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ary3: 7.62% (0.3598 => 0.3872, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.27% (1.2348 => 1.3246, std.dev.: 0.0228) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.93% (0.5050 => 0.5400, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.54% (0.3759 => 0.4005, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: 6.31% (0.2885 => 0.3067, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.56% (0.7701 => 0.8129, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5.41% (0.8710 => 0.9181, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.21% (0.2208 => 0.2323, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.81% (2.4137 => 2.5299, std.dev.: 0.0346) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 4.65% (0.6669 => 0.6979, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/synchronized: 4.40% (0.3979 => 0.4154, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.10% (0.6287 => 0.6545, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.77% (14.5415 => 17.7075, std.dev.: 0.5845) MultiSource/Applications/JM/ldecod/ldecod: 18.88% (0.1213 => 0.1442, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 17.50% (8.4344 => 9.9106, std.dev.: 0.0685) MultiSource/Benchmarks/Olden/mst/mst: 12.00% (0.1317 => 0.1475, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash: -14.94% (0.5675 => 0.4827, std.dev.: 0.0253) SingleSource/UnitTests/ObjC++/property-reference: -9.47% (0.8821 => 0.7986, std.dev.: 0.0299) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash: -5.68% (0.8235 => 0.7767, std.dev.: 0.0153) SingleSource/Benchmarks/Dhrystone/fldry: -2.81% (1.9972 => 1.9411, std.dev.: 0.0194) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.09% (69.5729 => 69.5076, std.dev.: 0.0394) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.07% (0.1338 => 0.1337, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0421 => 0.0420, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.31% (0.0654 => 0.0652, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: 0.07% (493.6085 => 493.9504, std.dev.: 0.0816) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.90% (63.2438 => 69.5076, std.dev.: 0.0394) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43701.58% (1.1277 => 493.9504, std.dev.: 0.0816) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.89% (0.5229 => 1.5420, std.dev.: 0.0860) MultiSource/Applications/SPASS/SPASS: 18.52% (14.9895 => 17.7659, std.dev.: 0.5120) MultiSource/Applications/kimwitu++/kc: 51.58% (14.1553 => 21.4573, std.dev.: 0.3377) MultiSource/Benchmarks/MallocBench/gs/gs: 21.91% (4.1105 => 5.0113, std.dev.: 0.1729) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.70% (1.1048 => 1.5103, std.dev.: 0.0731) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 428.63% (7.1582 => 37.8401, std.dev.: 0.1365) SingleSource/Benchmarks/Misc-C++-EH/spirit: 75.17% (3.4629 => 6.0660, std.dev.: 0.3942) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.07% (0.6222 => 1.0333, std.dev.: 0.0664) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10983.47% (0.0720 => 7.9801, std.dev.: 0.1593) MultiSource/Applications/SIBsim4/SIBsim4: 3859400.00% (0.0001 => 3.8595, std.dev.: 0.0257) MultiSource/Applications/SPASS/SPASS: 12777500.00% (0.0001 => 12.7776, std.dev.: 2.3207) MultiSource/Applications/kimwitu++/kc: 52000.00% (0.0001 => 0.0521, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 577100.00% (0.0001 => 0.5772, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10084000.00% (0.0001 => 10.0841, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6324400.00% (0.0001 => 6.3245, std.dev.: 0.4912) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1774.27% (1.1194 => 20.9806, std.dev.: 0.5097) MultiSource/Applications/ClamAV/clamscan: 65.87% (22.1758 => 36.7829, std.dev.: 0.5968) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 60.23% (7.0540 => 11.3023, std.dev.: 0.1383) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.73% (2.9384 => 4.6055, std.dev.: 0.2621) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 48.43% (8.1363 => 12.0764, std.dev.: 0.1120) MultiSource/Applications/JM/lencod/lencod: 46.53% (21.9371 => 32.1437, std.dev.: 0.1733) MultiSource/Benchmarks/FreeBench/distray/distray: 44.79% (0.1056 => 0.1529, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops: 38.34% (0.1432 => 0.1981, std.dev.: 0.0099) SingleSource/Benchmarks/CoyoteBench/almabench: 38.22% (0.0730 => 0.1009, std.dev.: 0.0056) SingleSource/Benchmarks/Stanford/Oscar: 32.23% (0.0636 => 0.0841, std.dev.: 0.0026) SingleSource/UnitTests/vla: 29.86% (0.0355 => 0.0461, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/messages-2: 28.85% (0.0662 => 0.0853, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/mst/mst: 27.17% (0.1163 => 0.1479, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: 26.04% (0.0626 => 0.0789, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 26.01% (0.3441 => 0.4336, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 25.60% (0.0672 => 0.0844, std.dev.: 0.0021) MultiSource/Benchmarks/NPB-serial/is/is: 25.59% (0.0719 => 0.0903, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 25.01% (1.5415 => 1.9271, std.dev.: 0.0188) SingleSource/Benchmarks/Stanford/Towers: 24.42% (0.0471 => 0.0586, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 23.86% (0.0528 => 0.0654, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.86% (0.0746 => 0.0924, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.71% (0.1337 => 0.1654, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 23.53% (0.6450 => 0.7968, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 23.36% (2.2024 => 2.7169, std.dev.: 0.0757) SingleSource/Benchmarks/CoyoteBench/huffbench: 23.08% (0.0871 => 0.1072, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.03% (0.1029 => 0.1266, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 22.83% (1.4186 => 1.7425, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C++/city/city: 22.42% (2.0665 => 2.5299, std.dev.: 0.0346) MultiSource/Benchmarks/BitBench/five11/five11: 22.40% (0.0567 => 0.0694, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 22.24% (0.2554 => 0.3122, std.dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 22.13% (0.4103 => 0.5011, std.dev.: 0.0137) MultiSource/Applications/hexxagon/hexxagon: 22.01% (1.2842 => 1.5668, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C++/life/life: 21.86% (0.0933 => 0.1137, std.dev.: 0.0028) MultiSource/Applications/d/make_dparser: 21.76% (3.3354 => 4.0613, std.dev.: 0.0883) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.58% (0.1566 => 0.1904, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/football/football: 21.35% (0.8921 => 1.0826, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/wordfreq: 21.11% (0.3307 => 0.4005, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.00% (0.1695 => 0.2051, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/dot-syntax-1: 20.88% (0.0479 => 0.0579, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.81% (0.2758 => 0.3332, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 20.46% (0.3427 => 0.4128, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/tsp/tsp: 20.43% (0.1175 => 0.1415, std.dev.: 0.0069) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.39% (0.1584 => 0.1907, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/hash2: 19.98% (0.4620 => 0.5543, std.dev.: 0.0151) MultiSource/Benchmarks/MallocBench/espresso/espresso: 19.38% (4.2646 => 5.0909, std.dev.: 0.1594) MultiSource/Benchmarks/mafft/pairlocalalign: 19.26% (9.4845 => 11.3112, std.dev.: 0.2312) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 19.13% (0.3162 => 0.3767, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/lists1: 19.06% (0.3684 => 0.4386, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout-C++/moments: 18.97% (0.4048 => 0.4816, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 18.91% (0.0640 => 0.0761, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.89% (0.2700 => 0.3210, std.dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 18.68% (0.3650 => 0.4332, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ary2: 18.56% (0.3379 => 0.4006, std.dev.: 0.0167) SingleSource/UnitTests/ObjC/parameter-passing: 18.33% (0.3927 => 0.4647, std.dev.: 0.0110) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.31% (0.1125 => 0.1331, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary: 18.29% (0.3232 => 0.3823, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.28% (0.8067 => 0.9542, std.dev.: 0.0392) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 18.11% (0.5981 => 0.7064, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.04% (14.3668 => 16.9584, std.dev.: 0.1996) SingleSource/Benchmarks/Shootout-C++/ary3: 17.94% (0.3283 => 0.3872, std.dev.: 0.0094) SingleSource/UnitTests/2006-12-11-LoadConstants: 17.94% (0.1143 => 0.1348, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists: 17.77% (0.3422 => 0.4030, std.dev.: 0.0133) MultiSource/Applications/sqlite3/sqlite3: 17.47% (17.1811 => 20.1824, std.dev.: 0.3565) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.41% (0.2872 => 0.3372, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/hello: 17.35% (0.2714 => 0.3185, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 17.30% (0.0838 => 0.0983, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.29% (0.2793 => 0.3276, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/fbench: 17.23% (0.0592 => 0.0694, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/instance-method-metadata: 17.22% (0.3543 => 0.4153, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/property: 16.98% (0.3886 => 0.4546, std.dev.: 0.0171) MultiSource/Benchmarks/Olden/bisort/bisort: 16.94% (0.0614 => 0.0718, std.dev.: 0.0035) MultiSource/Applications/Burg/burg: 16.90% (1.1642 => 1.3610, std.dev.: 0.0621) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.81% (0.8172 => 0.9546, std.dev.: 0.0374) SingleSource/Benchmarks/Stanford/Puzzle: 16.80% (0.1268 => 0.1481, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/random: 16.74% (0.2802 => 0.3271, std.dev.: 0.0096) SingleSource/UnitTests/ObjC/trivial-interface: 16.70% (0.3473 => 0.4053, std.dev.: 0.0081) SingleSource/UnitTests/ObjC/synchronized: 16.65% (0.3561 => 0.4154, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.25% (0.0886 => 0.1030, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/matrix: 16.14% (0.0818 => 0.0950, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 16.10% (0.0770 => 0.0894, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 16.00% (0.1906 => 0.2211, std.dev.: 0.0093) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.90% (0.0648 => 0.0751, std.dev.: 0.0034) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.74% (0.0953 => 0.1103, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.59% (0.2065 => 0.2387, std.dev.: 0.0114) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.59% (0.0834 => 0.0964, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 15.55% (0.3131 => 0.3618, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/health/health: 15.30% (0.1268 => 0.1462, std.dev.: 0.0069) MultiSource/Applications/spiff/spiff: 15.19% (0.7835 => 0.9025, std.dev.: 0.0439) SingleSource/Benchmarks/Misc/oourafft: 15.14% (0.3282 => 0.3779, std.dev.: 0.0088) MultiSource/Applications/minisat/minisat: 14.77% (0.7115 => 0.8166, std.dev.: 0.0405) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.74% (0.3121 => 0.3581, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.68% (0.1117 => 0.1281, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.38% (0.0730 => 0.0835, std.dev.: 0.0035) SingleSource/UnitTests/ObjC++/Hello: 14.30% (0.5925 => 0.6772, std.dev.: 0.0180) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.29% (0.2107 => 0.2408, std.dev.: 0.0058) SingleSource/UnitTests/ObjC++/property-reference-object: 14.25% (0.6030 => 0.6889, std.dev.: 0.0165) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.23% (0.3935 => 0.4495, std.dev.: 0.0159) MultiSource/Applications/oggenc/oggenc: 14.18% (5.7591 => 6.5756, std.dev.: 0.2390) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 13.91% (0.3177 => 0.3619, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.70% (0.5860 => 0.6663, std.dev.: 0.0273) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.61% (0.9765 => 1.1094, std.dev.: 0.0446) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.34% (0.2271 => 0.2574, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.11% (5.0018 => 5.6577, std.dev.: 0.1348) SingleSource/UnitTests/ObjC/exceptions-2: 12.07% (0.3497 => 0.3919, std.dev.: 0.0135) SingleSource/UnitTests/ObjC/exceptions-4: 12.02% (0.3543 => 0.3969, std.dev.: 0.0118) SingleSource/UnitTests/ObjC/exceptions: 12.02% (0.3828 => 0.4288, std.dev.: 0.0141) MultiSource/Benchmarks/Olden/power/power: 12.01% (0.1440 => 0.1613, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 11.80% (0.3516 => 0.3931, std.dev.: 0.0139) SingleSource/UnitTests/ObjC/for-in: 11.56% (0.3694 => 0.4121, std.dev.: 0.0151) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.68% (0.4879 => 0.5400, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.40% (0.3826 => 0.4224, std.dev.: 0.0154) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 149.61% (4.3953 => 10.9713, std.dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/methcall: 147.21% (5.3999 => 13.3492, std.dev.: 0.0124) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 31.77% (13.4384 => 17.7075, std.dev.: 0.5845) SingleSource/Benchmarks/Misc/oourafft: 17.39% (6.6465 => 7.8022, std.dev.: 0.0101) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.00% (1.1145 => 1.3040, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/mst/mst: 14.79% (0.1285 => 0.1475, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 14.05% (1.3045 => 1.4878, std.dev.: 0.0660) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.01% (0.2944 => 0.3327, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/hash2: 12.74% (3.1578 => 3.5601, std.dev.: 0.0416) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.64% (2.8904 => 3.2267, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 11.09% (0.1298 => 0.1442, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/richards_benchmark: 10.18% (1.1396 => 1.2556, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Puzzle: 10.06% (0.1421 => 0.1564, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.31% (1.7254 => 1.8861, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/ffbench: 8.53% (0.9505 => 1.0316, std.dev.: 0.0176) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.52% (4.2280 => 4.4615, std.dev.: 0.0045) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: 4.87% (3.8526 => 4.0403, std.dev.: 0.0495) MultiSource/Applications/lua/lua: 4.82% (26.0924 => 27.3509, std.dev.: 0.1777) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.12% (11.6436 => 12.1238, std.dev.: 0.0052) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.32% (0.4162 => 0.4300, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 2.21% (85.0658 => 86.9436, std.dev.: 0.0833) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 2.04% (3.1595 => 3.2241, std.dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: 1.99% (2.4116 => 2.4596, std.dev.: 0.0145) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.47% (6.5088 => 6.6048, std.dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: 1.32% (27.8444 => 28.2117, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0496, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.30% (6.6874 => 0.1805, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -75.09% (0.8651 => 0.2155, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -74.90% (5.2763 => 1.3246, std.dev.: 0.0228) SingleSource/Benchmarks/Misc/richards_benchmark: -40.81% (0.1622 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.12% (5.3855 => 4.6787, std.dev.: 0.1386) MultiSource/Applications/JM/ldecod/ldecod: -11.75% (10.4361 => 9.2102, std.dev.: 0.4321) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.27% (5.3526 => 4.8029, std.dev.: 0.1020) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.20% (0.0628 => 0.0363) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.36% (0.3987 => 0.2378, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.29% (4.5009 => 2.7776, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.16% (2.6546 => 2.0132, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -19.44% (0.2161 => 0.1741, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -16.03% (1.6925 => 1.4212, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2839, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.69% (32.5116 => 29.0359, std.dev.: 0.0188) SingleSource/Benchmarks/Misc/mandel-2: -10.67% (1.5373 => 1.3732, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -9.59% (9.5636 => 8.6461, std.dev.: 0.1944) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4245, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.86% (1.6805 => 1.5484, std.dev.: 0.0284) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.14% (19.9488 => 18.7248, std.dev.: 0.4129) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.90% (3.2416 => 3.0504, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.56% (2.7294 => 2.5776, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5061, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -4.52% (6.2999 => 6.0149, std.dev.: 0.0110) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8919, std.dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.39% (0.4808 => 0.4693, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.78% (8.1563 => 8.0111, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6769, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -1.54% (10.2830 => 10.1244, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.97% (0.1485 => 0.1337, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0021) Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 14:44:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 16:44:57 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121125224457.3BE112A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6245?compare_to=6241&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6245, Order: 168571, Start Time: 2012-11-25 21:15:03, End Time: 2012-11-25 22:45:26 To: 6241, Order: 168570, Start Time: 2012-11-25 17:55:17, End Time: 2012-11-25 19:25:02 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 25 (122 on baseline) Performance Improvements: 3 (25 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1026 (827 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.86% (0.1386 => 0.1495, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 6.31% (0.2599 => 0.2763, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/bh/bh: 4.73% (0.2957 => 0.3097, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/09-vor/vor: 4.67% (0.3167 => 0.3315, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 4.38% (0.3451 => 0.3602, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.22% (0.3055 => 0.3184, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.09% (4.5243 => 4.6643, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.04% (0.6144 => 0.6331, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.50% (1.3649 => 1.3990, std.dev.: 0.0132) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.26% (0.6290 => 0.6432, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.14% (0.4866 => 0.4970, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: 2.08% (1.2661 => 1.2924, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.97% (4.2937 => 4.3782, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.77% (8.7862 => 8.9421, std.dev.: 0.0382) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.46% (0.8890 => 0.9020, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 1.11% (2.2796 => 2.3049, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.08% (0.9230 => 0.9330, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 14.66% (0.7652 => 0.8774, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 6.99% (8.4662 => 9.0576, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 5.58% (20.5904 => 21.7389, std.dev.: 0.1448) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.22% (0.3341 => 0.3482, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.77% (1.0060 => 1.0339, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.82% (2.7015 => 2.7508, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.47% (3.5446 => 3.5967, std.dev.: 0.0126) MultiSource/Benchmarks/FreeBench/neural/neural: 1.08% (1.0870 => 1.0987, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -7.73% (3.9537 => 3.6481, std.dev.: 0.1105) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.25% (1.2605 => 1.2448, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/matrix: -1.02% (1.5744 => 1.5584, std.dev.: 0.0019) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.58% (1.0553 => 1.0492, std.dev.: 0.0144) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -32.73% (0.0220 => 0.0148, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0430 => 0.0430, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.85% (0.0274 => 0.0247, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0314 => 0.0315, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 3.66% (0.0410 => 0.0425, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0206 => 0.0207, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 4.57% (0.0175 => 0.0183, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.41% (0.1476 => 0.1482, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.56% (1.1666 => 1.1848, std.dev.: 0.0083) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.89% (0.4177 => 0.4140, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.41% (0.1422 => 0.1442, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.79% (0.0605 => 0.0640, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.32% (0.0190 => 0.0202, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.33% (0.0602 => 0.0588, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.38% (1.1931 => 1.1976, std.dev.: 0.0110) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 800.00% (0.0001 => 0.0009, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.19% (0.0589 => 0.0582, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -25.42% (0.0240 => 0.0179, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.70% (0.7763 => 0.7817, std.dev.: 0.0011) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 30.77% (0.0065 => 0.0085, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.62% (16.4461 => 17.6990, std.dev.: 0.1347) MultiSource/Applications/sqlite3/sqlite3: 2323.85% (0.6332 => 15.3478, std.dev.: 0.0514) MultiSource/Benchmarks/McCat/08-main/main: 50.90% (0.1831 => 0.2763, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.11% (0.1559 => 0.1495, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7087.51% (0.3123 => 22.4466, std.dev.: 0.2580) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.44% (0.2463 => 0.3730, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1529.67% (0.3344 => 5.4496, std.dev.: 0.0741) SingleSource/Benchmarks/Misc-C++/Large/ray: 34.90% (0.2364 => 0.3189, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/bigfib: 4.73% (0.6010 => 0.6294, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.24% (0.3266 => 0.3437, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/strcat: 4.11% (0.1969 => 0.2050, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.70% (0.0224 => 0.0239, std.dev.: 0.0078) SingleSource/UnitTests/byval-alignment: -33.91% (0.0230 => 0.0152, std.dev.: 0.0010) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0462, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 9.10% (0.1462 => 0.1595, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4732, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0707, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4952, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5152, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.4687, std.dev.: 0.0680) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3134, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1360, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3635, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4004, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0876, std.dev.: 0.0005) SingleSource/Regression/C/uint64_to_float: -23.95% (2.1832 => 1.6603, std.dev.: 0.0055) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.78% (0.0810 => 0.0954, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.45% (0.0773 => 0.0877, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.25% (0.0830 => 0.0940, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.40% (0.8321 => 0.9020, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.72% (0.1425 => 0.1535, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.71% (0.7473 => 0.8049, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.30% (0.4847 => 0.5201, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.21% (0.5961 => 0.6331, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.03% (0.3003 => 0.3184, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.01% (0.8148 => 0.8638, std.dev.: 0.0130) MultiSource/Applications/Burg/burg: 5.74% (1.2222 => 1.2924, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.56% (0.1905 => 0.2011, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.53% (0.2133 => 0.2251, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.50% (0.2180 => 0.2300, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.35% (0.4127 => 0.4348, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.35% (1.3279 => 1.3990, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.16% (0.5817 => 0.6117, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.83% (4.1763 => 4.3782, std.dev.: 0.0145) MultiSource/Applications/spiff/spiff: 4.58% (0.7950 => 0.8314, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.53% (0.2519 => 0.2633, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.14% (2.1401 => 2.2286, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.13% (0.9435 => 0.9825, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.09% (1.1606 => 1.2081, std.dev.: 0.0166) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.09% (0.2741 => 0.2853, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.94% (4.4873 => 4.6643, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.91% (0.4783 => 0.4970, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 3.90% (2.2184 => 2.3049, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 3.88% (4.1305 => 4.2907, std.dev.: 0.0593) MultiSource/Applications/sgefa/sgefa: 3.87% (0.2999 => 0.3115, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.77% (0.8611 => 0.8936, std.dev.: 0.0048) MultiSource/Applications/SPASS/SPASS: 3.73% (14.2605 => 14.7930, std.dev.: 0.0221) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.60% (0.3115 => 0.3227, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.50% (6.6074 => 6.8388, std.dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.42% (0.4559 => 0.4715, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.41% (8.6476 => 8.9421, std.dev.: 0.0382) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.40% (0.8697 => 0.8993, std.dev.: 0.0056) MultiSource/Applications/minisat/minisat: 3.35% (0.6834 => 0.7063, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.35% (1.1685 => 1.2076, std.dev.: 0.0126) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.29% (0.6227 => 0.6432, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 3.29% (1.2568 => 1.2981, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.25% (0.9688 => 1.0003, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.21% (4.5702 => 4.7168, std.dev.: 0.0288) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.18% (1.5315 => 1.5802, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.13% (0.8597 => 0.8866, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.08% (13.1811 => 13.5870, std.dev.: 0.0801) MultiSource/Applications/lua/lua: 3.06% (3.8189 => 3.9359, std.dev.: 0.0255) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.06% (1.2526 => 1.2909, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.03% (0.8518 => 0.8776, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.00% (0.8338 => 0.8588, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.00% (0.8007 => 0.8247, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.92% (0.9039 => 0.9303, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.90% (0.8457 => 0.8702, std.dev.: 0.0037) MultiSource/Applications/treecc/treecc: 2.84% (1.9948 => 2.0514, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.82% (0.7932 => 0.8156, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.82% (0.9074 => 0.9330, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.81% (4.4880 => 4.6139, std.dev.: 0.0233) MultiSource/Applications/ClamAV/clamscan: 2.80% (14.7684 => 15.1821, std.dev.: 0.0768) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.75% (1.2602 => 1.2949, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.74% (0.8927 => 0.9172, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.73% (0.8316 => 0.8543, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 2.68% (31.8598 => 32.7142, std.dev.: 0.1857) MultiSource/Applications/d/make_dparser: 2.60% (3.2366 => 3.3207, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.58% (0.5191 => 0.5325, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: 2.58% (2.3764 => 2.4376, std.dev.: 0.0230) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.57% (0.8716 => 0.8940, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.54% (0.8420 => 0.8634, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.54% (0.8317 => 0.8528, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.53% (0.8885 => 0.9110, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.52% (0.9908 => 1.0158, std.dev.: 0.0046) MultiSource/Applications/lemon/lemon: 2.52% (1.0945 => 1.1221, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.52% (0.8331 => 0.8541, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.50% (0.8359 => 0.8568, std.dev.: 0.0026) MultiSource/Applications/hbd/hbd: 2.48% (1.4269 => 1.4623, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.48% (0.8712 => 0.8928, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.46% (0.8048 => 0.8246, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.42% (1.1170 => 1.1440, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.40% (0.6586 => 0.6744, std.dev.: 0.0055) MultiSource/Applications/JM/lencod/lencod: 2.34% (15.3280 => 15.6868, std.dev.: 0.0292) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.32% (0.8177 => 0.8367, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.31% (0.8066 => 0.8252, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.29% (0.8656 => 0.8854, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.20% (0.8086 => 0.8264, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 2.17% (4.9628 => 5.0704, std.dev.: 0.0294) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (6.7320 => 6.8730, std.dev.: 0.0339) MultiSource/Applications/lambda-0_1_3/lambda: 1.96% (0.7557 => 0.7705, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.94% (0.8805 => 0.8976, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.83% (0.8995 => 0.9160, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 1.81% (0.9810 => 0.9988, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 107.04% (0.0199 => 0.0412, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/pi: 58.66% (1.5795 => 2.5060, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.12% (0.7597 => 0.8822, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.09% (2.9753 => 3.4541, std.dev.: 0.0249) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.69% (2.7995 => 3.2108, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.48% (5.0261 => 5.6031, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.29% (0.3186 => 0.3482, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.07% (1.1857 => 1.2814, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/queens: 7.26% (1.7056 => 1.8295, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: 7.19% (1.3037 => 1.3975, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.68% (4.7794 => 5.0987, std.dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 6.08% (3.1873 => 3.3810, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.80% (4.5327 => 4.7958, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.36% (2.2485 => 2.3691, std.dev.: 0.0250) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.65% (6.2275 => 6.5171, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.49% (3.3761 => 3.5276, std.dev.: 0.0185) MultiSource/Applications/lambda-0_1_3/lambda: 4.47% (7.4933 => 7.8282, std.dev.: 0.0456) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.05% (4.9453 => 5.1455, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.00% (4.9469 => 5.1448, std.dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 3.89% (14.0064 => 14.5512, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.26% (0.3587 => 0.3704, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.04% (1.2337 => 1.2712, std.dev.: 0.0054) MultiSource/Applications/siod/siod: 2.79% (3.6643 => 3.7666, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.77% (11.5690 => 11.8891, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.61% (8.2783 => 8.4942, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout/lists: 2.45% (7.3375 => 7.5174, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.44% (4.8362 => 4.9543, std.dev.: 0.0278) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.31% (1.1365 => 1.1627, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.49% (2.5763 => 2.6147, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/power/power: 1.43% (1.2061 => 1.2234, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: 1.35% (1.0841 => 1.0987, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.33% (1.5941 => 1.6153, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.25% (2.4647 => 2.4956, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.20% (3.5679 => 3.6106, std.dev.: 0.0106) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.07% (5.4641 => 4.3126, std.dev.: 0.0592) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.95% (7.2130 => 6.3511, std.dev.: 0.1769) SingleSource/Benchmarks/McGill/chomp: -10.96% (1.1216 => 0.9987, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.58% (1.0512 => 0.9400, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/heapsort: -9.18% (3.2926 => 2.9903, std.dev.: 0.0211) MultiSource/Benchmarks/mafft/pairlocalalign: -8.55% (63.1822 => 57.7816, std.dev.: 0.1172) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.93% (14.6451 => 13.4836, std.dev.: 0.0652) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.87% (4.7482 => 4.4220, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.27% (0.3269 => 0.3064, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.80% (3.7148 => 3.4993, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.79% (5.4972 => 5.1790, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.08% (5.1557 => 4.8939, std.dev.: 0.0517) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.33% (4.7449 => 4.5396, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.75% (6.0224 => 5.7964, std.dev.: 0.0291) MultiSource/Applications/lua/lua: -3.29% (29.8330 => 28.8529, std.dev.: 0.1275) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (28.5821 => 27.7003, std.dev.: 0.0571) MultiSource/Benchmarks/Prolangs-C++/life/life: -3.04% (2.6356 => 2.5554, std.dev.: 0.0071) MultiSource/Applications/aha/aha: -2.63% (3.3398 => 3.2519, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.59% (2.4490 => 2.3855, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.53% (3.2169 => 3.1354, std.dev.: 0.0246) SingleSource/Benchmarks/Shootout-C++/hash2: -2.39% (3.4237 => 3.3418, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.07% (11.5316 => 11.2925, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.06% (9.9065 => 9.7021, std.dev.: 0.0546) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.93% (1.2822 => 1.2575, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.54% (4.9994 => 4.9222, std.dev.: 0.0092) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.24% (1.0262 => 1.0492, std.dev.: 0.0144) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 20.33% (0.0123 => 0.0148, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.39% (0.0408 => 0.0430, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.76% (0.0254 => 0.0247, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/casts: 8.95% (0.0190 => 0.0207, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 1.67% (0.0180 => 0.0183, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 3.06% (0.1438 => 0.1482, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 4.58% (1.1329 => 1.1848, std.dev.: 0.0083) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.58% (0.4164 => 0.4140, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.33% (0.1369 => 0.1442, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.16% (0.0641 => 0.0640, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.59% (0.0195 => 0.0202, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.73% (0.0578 => 0.0588, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.71% (1.1437 => 1.1976, std.dev.: 0.0110) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 800.00% (0.0001 => 0.0009, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.18% (0.0627 => 0.0582, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.56% (0.0180 => 0.0179, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.49% (0.8017 => 0.7817, std.dev.: 0.0011) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 37.10% (0.0062 => 0.0085, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 3.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 14:51:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 16:51:27 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121125225127.D79382A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6246?compare_to=6242&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6246, Order: 168571, Start Time: 2012-11-25 21:18:21, End Time: 2012-11-25 22:51:57 To: 6242, Order: 168570, Start Time: 2012-11-25 18:23:50, End Time: 2012-11-25 19:57:21 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (177 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (860 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.02% (0.3834 => 0.4410, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.57% (2.0478 => 2.1004, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: 2.49% (7.4937 => 7.6802, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/hash2: 1.85% (3.1932 => 3.2523, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.74% (0.1431 => 0.1306, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.01% (0.3821 => 0.3515, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -6.84% (2.4924 => 2.3219, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.53% (0.3812 => 0.3563, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -6.49% (0.3880 => 0.3628, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-2: -6.47% (0.3831 => 0.3583) SingleSource/UnitTests/ObjC/synchronized: -6.47% (0.3896 => 0.3644, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -6.40% (0.4033 => 0.3775, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.34% (0.3848 => 0.3604, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.25% (0.3891 => 0.3648, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.19% (0.9542 => 0.8951, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -6.13% (0.4176 => 0.3920, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.07% (0.2355 => 0.2212, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.01% (0.2428 => 0.2282, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -6.00% (9.2283 => 8.6743, std.dev.: 0.0087) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.95% (0.3884 => 0.3653, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.89% (0.6484 => 0.6102, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: -5.88% (16.1920 => 15.2399, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.88% (0.7198 => 0.6775, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: -5.83% (0.2160 => 0.2034, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -5.81% (0.4199 => 0.3955, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.79% (0.9852 => 0.9282, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.77% (0.5478 => 0.5162, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.75% (1.3722 => 1.2933, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.72% (0.5591 => 0.5271, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.68% (0.5705 => 0.5381, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.67% (0.5859 => 0.5527, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.66% (0.3658 => 0.3451, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.66% (4.0323 => 3.8042, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/football/football: -5.65% (0.9179 => 0.8660, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: -5.63% (7.0961 => 6.6965, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.63% (4.8161 => 4.5450, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.62% (0.5857 => 0.5528, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.58% (0.5863 => 0.5536, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.58% (1.0544 => 0.9956, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.54% (0.5581 => 0.5272, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.53% (6.7716 => 6.3972, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.52% (1.6364 => 1.5460, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/parameter-passing: -5.51% (0.4280 => 0.4044, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.51% (0.6681 => 0.6313, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.51% (0.5849 => 0.5527, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.50% (0.6304 => 0.5957, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.49% (0.6297 => 0.5951, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.49% (0.6446 => 0.6092, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.49% (0.6230 => 0.5888, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.49% (0.6052 => 0.5720, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.48% (0.5802 => 0.5484, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.48% (0.5805 => 0.5487, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: -5.47% (1.1530 => 1.0899, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.46% (0.6260 => 0.5918, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -5.46% (0.3406 => 0.3220, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.45% (4.8802 => 4.6140, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/05-eks/eks: -5.45% (0.4515 => 0.4269, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.42% (1.2300 => 1.1633, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.42% (0.6660 => 0.6299, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.41% (0.6676 => 0.6315, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.39% (0.6194 => 0.5860, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -5.39% (0.3357 => 0.3176, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.39% (0.5941 => 0.5621, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.39% (0.5570 => 0.5270, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.37% (0.5456 => 0.5163, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.37% (4.5069 => 4.2650, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.37% (3.5339 => 3.3443, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.35% (0.6667 => 0.6310, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.35% (1.4642 => 1.3859, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.34% (0.2695 => 0.2551, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.33% (0.6189 => 0.5859, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.33% (0.3057 => 0.2894, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.33% (0.5575 => 0.5278, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.31% (0.6440 => 0.6098, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: -5.29% (0.2871 => 0.2719, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -5.27% (0.2939 => 0.2784, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.26% (0.6293 => 0.5962, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.26% (0.5688 => 0.5389, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.24% (1.2784 => 1.2114, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.24% (0.3016 => 0.2858, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.24% (0.2903 => 0.2751, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.22% (0.6033 => 0.5718, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -5.21% (1.1450 => 1.0854, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.20% (8.0126 => 7.5962, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.20% (0.6736 => 0.6386, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.19% (14.2083 => 13.4711, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.18% (0.2933 => 0.2781, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.16% (0.3255 => 0.3087, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -5.16% (0.2849 => 0.2702, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -5.16% (0.3026 => 0.2870, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: -5.15% (0.3205 => 0.3040, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.15% (0.3323 => 0.3152, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.14% (0.8521 => 0.8083, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: -5.14% (4.3330 => 4.1103, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.13% (0.5999 => 0.5691, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: -5.11% (0.3446 => 0.3270, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.11% (0.4151 => 0.3939, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.09% (0.7919 => 0.7516, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.08% (1.2210 => 1.1590, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.08% (2.1713 => 2.0611, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: -5.07% (1.2515 => 1.1880, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary: -5.07% (0.3394 => 0.3222, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.07% (1.2221 => 1.1602, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.04% (0.4916 => 0.4668, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.04% (0.3252 => 0.3088, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.04% (0.3849 => 0.3655, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.04% (0.2999 => 0.2848, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.02% (0.3483 => 0.3308, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -5.01% (17.1032 => 16.2457, std.dev.: 0.0129) MultiSource/Benchmarks/McCat/08-main/main: -5.00% (0.2659 => 0.2526, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -5.00% (0.3481 => 0.3307, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -4.97% (0.3581 => 0.3403, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.96% (0.3931 => 0.3736, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -4.96% (0.3025 => 0.2875, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.95% (0.2385 => 0.2267, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: -4.94% (1.3864 => 1.3179, std.dev.: 0.0167) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.92% (0.2278 => 0.2166, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.90% (0.4813 => 0.4577, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: -4.90% (0.4248 => 0.4040, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -4.87% (0.3059 => 0.2910, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -4.85% (0.3194 => 0.3039, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.85% (0.3319 => 0.3158, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: -4.85% (15.5079 => 14.7565, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.83% (0.6395 => 0.6086, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.80% (0.3837 => 0.3653, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.79% (0.2548 => 0.2426, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: -4.78% (0.2989 => 0.2846, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.78% (0.3867 => 0.3682, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -4.78% (3.5154 => 3.3475, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -4.75% (0.3621 => 0.3449, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -4.71% (15.2527 => 14.5336, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/bh/bh: -4.69% (0.2985 => 0.2845, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.65% (0.7339 => 0.6998, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.62% (0.5168 => 0.4929, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.61% (0.5569 => 0.5312, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.61% (0.4321 => 0.4122, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -4.58% (4.0594 => 3.8735, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.56% (0.7524 => 0.7181, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -4.54% (0.7447 => 0.7109, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.53% (0.4083 => 0.3898, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -4.53% (0.4861 => 0.4641) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.50% (0.5329 => 0.5089, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.49% (0.6395 => 0.6108, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.49% (1.6474 => 1.5735, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.44% (0.7021 => 0.6709, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.43% (0.9077 => 0.8675, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.42% (0.5567 => 0.5321, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.40% (22.4056 => 21.4205, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.38% (0.4427 => 0.4233, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -4.38% (5.0226 => 4.8026, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: -4.38% (0.6347 => 0.6069, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: -4.36% (0.3788 => 0.3623, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -4.33% (1.3148 => 1.2579, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -4.32% (0.6441 => 0.6163, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.31% (0.9557 => 0.9145, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -4.29% (0.7779 => 0.7445, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -4.25% (2.4021 => 2.3000, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -4.22% (0.3271 => 0.3133, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -4.18% (0.6750 => 0.6468, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -3.96% (2.1401 => 2.0554, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.95% (0.3491 => 0.3353, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -3.93% (0.8418 => 0.8087, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -3.93% (34.0927 => 32.7530, std.dev.: 0.0148) MultiSource/Applications/lambda-0_1_3/lambda: -3.86% (0.7982 => 0.7674, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.86% (2.2587 => 2.1716, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash: -3.78% (0.4524 => 0.4353, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -3.72% (1.5610 => 1.5030, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: -3.67% (18.2933 => 17.6216, std.dev.: 0.0161) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.10% (5.4682 => 5.2988, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -2.83% (20.7746 => 20.1871, std.dev.: 0.0178) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7559, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1733, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -4.05% (2.2633 => 2.1716, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.91% (1.7753 => 1.7059, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.34% (1.3096 => 1.2790, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4713, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 17:08:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 19:08:03 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121126010803.D95B72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6247?compare_to=6243&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6247, Order: 168571, Start Time: 2012-11-25 21:47:41, End Time: 2012-11-26 01:08:31 To: 6243, Order: 168569, Start Time: 2012-11-25 17:38:49, End Time: 2012-11-25 20:59:37 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (171 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1091 (719 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.12% (0.3907 => 0.3785, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.92% (0.0625 => 0.0887, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.64% (0.1063 => 0.1410, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.20% (0.2969 => 0.3747, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.50% (0.1106 => 0.1388, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 25.26% (1.5932 => 1.9956, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.57% (0.4139 => 0.5156, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.01% (0.4253 => 0.5274, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.95% (0.0714 => 0.0885, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.58% (0.0475 => 0.0587, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.46% (0.0584 => 0.0721, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.43% (0.4994 => 0.6164, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.37% (0.5900 => 0.7279, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.94% (0.5000 => 0.6147, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.16% (0.1620 => 0.1979, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.07% (0.0897 => 0.1095, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.04% (0.1021 => 0.1246, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.77% (0.1107 => 0.1348, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.89% (0.0584 => 0.0706, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.85% (0.0633 => 0.0765) MultiSource/Benchmarks/Olden/em3d/em3d: 20.68% (0.0948 => 0.1144, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.67% (0.1103 => 0.1331, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.52% (0.0541 => 0.0652, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.40% (0.0642 => 0.0773, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.40% (0.0495 => 0.0596, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.32% (0.3903 => 0.4696, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 20.22% (0.0821 => 0.0987, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.21% (0.1549 => 0.1862, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.19% (0.0822 => 0.0988, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.14% (0.1003 => 0.1205, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.01% (0.1604 => 0.1925, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724) MultiSource/Benchmarks/McCat/05-eks/eks: 19.77% (0.1619 => 0.1939) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.08% (0.1462 => 0.1741, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 19.01% (0.0947 => 0.1127, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 18.81% (0.0808 => 0.0960, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.74% (0.3890 => 0.4619, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.42% (0.2014 => 0.2385, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 18.06% (0.1218 => 0.1438, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 17.87% (0.4029 => 0.4749, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 17.77% (0.0698 => 0.0822, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.69% (0.2736 => 0.3220, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.61% (1.3152 => 1.5468, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.56% (0.1088 => 0.1279, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 17.48% (0.1505 => 0.1768, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 17.35% (0.5826 => 0.6837, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.24% (0.2866 => 0.3360, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.18% (0.3271 => 0.3833, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 17.17% (0.5546 => 0.6498, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 17.08% (0.5889 => 0.6895, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.02% (0.0605 => 0.0708, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.97% (0.1968 => 0.2302, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 16.87% (1.8794 => 2.1965, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.74% (3.5627 => 4.1592, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.70% (0.4658 => 0.5436, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.41% (0.5026 => 0.5851, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.38% (0.1160 => 0.1350, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.37% (1.6211 => 1.8864, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 16.19% (0.1421 => 0.1651, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 16.03% (0.9697 => 1.1251, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.98% (0.4361 => 0.5058, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.85% (0.3930 => 0.4553, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 15.82% (1.0781 => 1.2487, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 15.65% (0.1284 => 0.1485, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.50% (2.7292 => 3.1521, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.48% (0.2875 => 0.3320, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 15.34% (4.2109 => 4.8568, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.28% (4.4195 => 5.0950, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.12% (1.9694 => 2.2672, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.96% (0.3195 => 0.3673, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: 14.94% (0.7171 => 0.8242, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.93% (1.9966 => 2.2946, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.86% (0.1090 => 0.1252, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 14.84% (0.2729 => 0.3134, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 14.81% (0.2823 => 0.3241) SingleSource/Benchmarks/Shootout-C++/fibo: 14.79% (0.2725 => 0.3128, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.77% (0.2911 => 0.3341, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ackermann: 14.76% (0.2738 => 0.3142, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 14.75% (0.2813 => 0.3228, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 14.74% (0.9909 => 1.1370, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/hello: 14.74% (0.2714 => 0.3114, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 14.65% (0.2750 => 0.3153, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 14.64% (0.2780 => 0.3187, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 14.60% (0.2075 => 0.2378, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 14.58% (0.3004 => 0.3442, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 14.52% (0.2803 => 0.3210, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 14.51% (0.2811 => 0.3219, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.47% (0.2792 => 0.3196, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 14.34% (0.2566 => 0.2934, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 14.31% (0.3096 => 0.3539, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.28% (2.0673 => 2.3625, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 14.14% (0.3267 => 0.3729, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 14.05% (0.3317 => 0.3783, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 14.00% (0.3258 => 0.3714, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 13.99% (23.5202 => 26.8103, std.dev.: 0.0033) MultiSource/Applications/lua/lua: 13.86% (1.4269 => 1.6246, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.59% (0.3362 => 0.3819, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.57% (0.3124 => 0.3548, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 13.56% (0.3348 => 0.3802, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.50% (0.3060 => 0.3473, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 13.49% (0.3678 => 0.4174, std.dev.: 0.0044) MultiSource/Applications/treecc/treecc: 13.36% (0.7875 => 0.8927, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: 13.32% (0.0758 => 0.0859, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.19% (0.3282 => 0.3715, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.19% (0.3625 => 0.4103, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 13.14% (0.3477 => 0.3934, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/for-in: 13.10% (0.3496 => 0.3954, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 13.10% (0.3726 => 0.4214, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 13.06% (2.1653 => 2.4481, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-4: 13.02% (0.3465 => 0.3916, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.00% (0.3446 => 0.3894, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.98% (0.3460 => 0.3909, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.97% (0.3469 => 0.3919, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 12.90% (0.4146 => 0.4681, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.82% (0.3488 => 0.3935, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 12.81% (0.3442 => 0.3883, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 12.76% (4.6177 => 5.2068, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/property: 12.68% (0.3650 => 0.4113, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.67% (0.3845 => 0.4332, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.66% (0.3981 => 0.4485, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.66% (0.3690 => 0.4157, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 12.63% (0.4251 => 0.4788, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 12.59% (2.1013 => 2.3659, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 12.52% (0.2691 => 0.3028, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions: 12.49% (0.3643 => 0.4098, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.46% (0.3724 => 0.4188, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.16% (0.2040 => 0.2288, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 12.11% (0.5012 => 0.5619, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11.53% (5.5417 => 6.1804, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.48% (0.1028 => 0.1146, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.39% (0.6435 => 0.7168, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 10.89% (0.3498 => 0.3879, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 10.78% (0.6634 => 0.7349, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.77% (0.1383 => 0.1532, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.70% (0.3084 => 0.3414, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.45% (0.2737 => 0.3023, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.44% (0.2068 => 0.2284, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 10.42% (0.4847 => 0.5352, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 9.95% (0.3336 => 0.3668, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.84% (0.2103 => 0.2310) MultiSource/Applications/sqlite3/sqlite3: 9.46% (2.0346 => 2.2271, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 9.33% (0.2391 => 0.2614, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.05% (0.5361 => 0.5846, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.55% (4.6926 => 5.0938, std.dev.: 0.0116) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.44% (11.6398 => 12.6219, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.36% (0.7426 => 0.8047, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.33% (0.5584 => 0.6049, std.dev.: 0.0134) MultiSource/Applications/kimwitu++/kc: 6.63% (11.9555 => 12.7480, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.77% (0.3792 => 0.3935, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 9.24% (0.2802 => 0.3061, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6121, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6764, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-2: 4.83% (1.8057 => 1.8930, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1648, std.dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: 4.27% (14.0481 => 14.6476, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2082, std.dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.72% (3.1722 => 3.2269, std.dev.: 0.0023) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3034, std.dev.: 0.0135) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2881, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5959, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.84% (2.4764 => 2.4061, std.dev.: 0.0087) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.90% (25.4195 => 16.5480, std.dev.: 0.0270) SingleSource/Benchmarks/Shootout-C++/ary2: -8.41% (0.2402 => 0.2200, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9741, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7937, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8014, std.dev.: 0.0124) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7730, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.74% (17.2379 => 16.7648, std.dev.: 0.0704) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8656, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.99% (0.6293 => 0.6168, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5745, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4957, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1466, std.dev.: 0.1023) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0458, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 4.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 17:09:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 19:09:28 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121126010928.881F62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6248?compare_to=6244&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6248, Order: 168571, Start Time: 2012-11-25 22:50:33, End Time: 2012-11-26 01:09:58 To: 6244, Order: 168570, Start Time: 2012-11-25 19:33:05, End Time: 2012-11-25 21:53:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 91 (177 on baseline) Performance Improvements: 15 (41 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 980 (667 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 17.48% (0.1407 => 0.1653, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.54% (0.7178 => 0.8222, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.46% (0.6147 => 0.7036, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 14.40% (0.5772 => 0.6603, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 14.37% (0.6214 => 0.7107, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 14.17% (0.6592 => 0.7526, std.dev.: 0.0256) MultiSource/Applications/lemon/lemon: 13.95% (1.1996 => 1.3670, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 13.89% (0.6307 => 0.7183, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 13.72% (0.8564 => 0.9739, std.dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.70% (0.5788 => 0.6581, std.dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 13.50% (1.5420 => 1.7501, std.dev.: 0.0168) MultiSource/Benchmarks/McCat/17-bintr/bintr: 13.49% (0.0786 => 0.0892, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 13.29% (2.2845 => 2.5880, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.21% (1.0333 => 1.1698, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.01% (0.7547 => 0.8529, std.dev.: 0.0038) MultiSource/Applications/aha/aha: 12.18% (0.1330 => 0.1492, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.82% (0.1904 => 0.2129, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/exptree: 11.76% (0.0927 => 0.1036, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 11.72% (0.3122 => 0.3488, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/except: 11.62% (0.3176 => 0.3545, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/methcall: 11.60% (0.3172 => 0.3540, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/fibo: 11.53% (0.3009 => 0.3356, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 11.49% (0.8166 => 0.9104, std.dev.: 0.0149) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.44% (0.1171 => 0.1305, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.43% (0.1907 => 0.2125, std.dev.: 0.0081) SingleSource/Benchmarks/LivermoreLoops/kernel15: 11.39% (0.1185 => 0.1320, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.38% (0.2901 => 0.3231, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.28% (0.1037 => 0.1154, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash: 11.27% (0.4827 => 0.5371, std.dev.: 0.0034) SingleSource/Benchmarks/LivermoreLoops/kernel17: 10.68% (0.1011 => 0.1119, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 10.59% (0.2201 => 0.2434, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 10.56% (0.0956 => 0.1057, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 10.32% (0.7293 => 0.8046, std.dev.: 0.0167) MultiSource/Applications/oggenc/oggenc: 10.16% (6.5756 => 7.2434, std.dev.: 0.0470) MultiSource/Applications/Burg/burg: 10.07% (1.3610 => 1.4980, std.dev.: 0.0056) SingleSource/Benchmarks/LivermoreLoops/kernel19: 9.77% (0.1044 => 0.1146, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: 9.23% (0.1462 => 0.1597, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.22% (0.2408 => 0.2630, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.16% (0.6879 => 0.7509, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.92% (0.6636 => 0.7228, std.dev.: 0.0169) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 8.90% (0.1495 => 0.1628, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.85% (0.6697 => 0.7290, std.dev.: 0.0172) MultiSource/Benchmarks/PAQ8p/paq8p: 8.75% (10.8281 => 11.7759, std.dev.: 0.0786) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.73% (0.5910 => 0.6426, std.dev.: 0.0163) MultiSource/Benchmarks/McCat/04-bisect/bisect: 8.69% (0.1208 => 0.1313, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.68% (1.5885 => 1.7264, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/tsp/tsp: 8.55% (0.1415 => 0.1536, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.29% (0.6596 => 0.7143, std.dev.: 0.0187) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.29% (0.5635 => 0.6102, std.dev.: 0.0092) SingleSource/Benchmarks/LivermoreLoops/kernel18: 8.21% (0.1486 => 0.1608, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 7.82% (0.1981 => 0.2136, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.19% (0.2574 => 0.2759, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.16% (5.6577 => 6.0626, std.dev.: 0.0491) MultiSource/Benchmarks/McCat/09-vor/vor: 7.13% (0.3562 => 0.3816, std.dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.28% (0.5222 => 0.5550, std.dev.: 0.0113) MultiSource/Applications/sgefa/sgefa: 6.01% (0.3530 => 0.3742, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.89% (1.5103 => 1.5993, std.dev.: 0.0297) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.76% (2.3150 => 2.4483, std.dev.: 0.0422) SingleSource/UnitTests/ObjC++/property-reference: 5.52% (0.7986 => 0.8427, std.dev.: 0.0154) SingleSource/Benchmarks/Linpack/linpack-pc: 4.34% (0.3067 => 0.3200, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest: 36.84% (0.3447 => 0.4717, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 31.60% (9.5710 => 12.5952, std.dev.: 0.1491) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.07% (6.3245 => 7.5303, std.dev.: 0.0813) MultiSource/Benchmarks/Olden/bisort/bisort: 14.98% (0.8687 => 0.9988, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/health/health: 14.80% (0.4614 => 0.5297, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.45% (10.9290 => 12.3985, std.dev.: 0.2313) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 13.40% (2.7536 => 3.1225, std.dev.: 0.0056) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.18% (1.7376 => 1.9667, std.dev.: 0.0359) MultiSource/Benchmarks/Olden/tsp/tsp: 13.14% (1.1035 => 1.2485, std.dev.: 0.0209) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 12.61% (4.1404 => 4.6625, std.dev.: 0.0486) SingleSource/Benchmarks/McGill/chomp: 9.65% (1.2105 => 1.3273, std.dev.: 0.0097) MultiSource/Applications/lemon/lemon: 9.14% (1.4362 => 1.5674, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.74% (9.0261 => 9.8153, std.dev.: 0.1270) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.27% (1.4878 => 1.5811, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.87% (0.1994 => 0.2111, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/puzzle: 5.30% (0.7417 => 0.7810, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.99% (1.5484 => 1.6257, std.dev.: 0.0200) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 4.42% (5.2454 => 5.4773, std.dev.: 0.0416) MultiSource/Applications/sqlite3/sqlite3: 4.27% (4.5902 => 4.7862, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/hash: 4.15% (0.7767 => 0.8089, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.37% (0.3327 => 0.3439, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.87% (1.5565 => 1.6012, std.dev.: 0.0102) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.69% (32.1366 => 33.0025, std.dev.: 0.0301) MultiSource/Applications/SIBsim4/SIBsim4: 1.85% (3.8595 => 3.9310, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.62% (4.8114 => 4.8893, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.52% (2.8212 => 2.8642, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.43% (48.7416 => 49.4379, std.dev.: 0.0899) SingleSource/Benchmarks/Shootout-C++/hash2: 1.41% (3.5601 => 3.6104, std.dev.: 0.0148) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.32% (1.8869 => 1.9118, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.32% (60.9926 => 61.7955, std.dev.: 0.2111) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.09% (5.6764 => 5.7381, std.dev.: 0.0134) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.69% (0.6545 => 0.5780, std.dev.: 0.0181) MultiSource/Applications/hexxagon/hexxagon: -11.00% (1.5668 => 1.3945, std.dev.: 0.0483) MultiSource/Benchmarks/Prolangs-C++/city/city: -10.20% (2.5299 => 2.2718, std.dev.: 0.0795) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.02% (0.7968 => 0.7170, std.dev.: 0.0224) MultiSource/Benchmarks/Olden/power/power: -9.61% (0.1613 => 0.1458, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: -8.78% (1.0826 => 0.9875, std.dev.: 0.0350) MultiSource/Benchmarks/Olden/mst/mst: -8.59% (0.1479 => 0.1352, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -7.74% (0.3619 => 0.3339, std.dev.: 0.0107) MultiSource/Applications/d/make_dparser: -7.26% (4.0613 => 3.7664, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.15% (0.1805 => 0.1676, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.83% (11.3023 => 10.6431, std.dev.: 0.2487) MultiSource/Applications/sqlite3/sqlite3: -4.39% (20.1824 => 19.2963, std.dev.: 0.1483) MultiSource/Applications/kimwitu++/kc: -2.53% (21.4573 => 20.9149, std.dev.: 0.0508) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -15.88% (0.1442 => 0.1213, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/mst/mst: -10.78% (0.1475 => 0.1316, std.dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.73% (69.5076 => 70.0171, std.dev.: 0.1186) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 1.87% (0.1337 => 0.1362, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.05% (0.0420 => 0.0437, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0652 => 0.0652, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -0.00% (493.9504 => 493.9387, std.dev.: 0.2351) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 10.71% (63.2438 => 70.0171, std.dev.: 0.1186) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.00% (4.3882 => 0.0437, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43700.54% (1.1277 => 493.9387, std.dev.: 0.2351) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 234.69% (0.5229 => 1.7501, std.dev.: 0.0168) MultiSource/Applications/SPASS/SPASS: 21.72% (14.9895 => 18.2459, std.dev.: 0.2456) MultiSource/Applications/kimwitu++/kc: 47.75% (14.1553 => 20.9149, std.dev.: 0.0508) MultiSource/Benchmarks/MallocBench/gs/gs: 15.73% (4.1105 => 4.7569, std.dev.: 0.2258) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 44.76% (1.1048 => 1.5993, std.dev.: 0.0297) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 428.60% (7.1582 => 37.8380, std.dev.: 0.4096) SingleSource/Benchmarks/Misc-C++-EH/spirit: 75.71% (3.4629 => 6.0845, std.dev.: 0.0789) SingleSource/Benchmarks/Misc-C++/stepanov_container: 88.01% (0.6222 => 1.1698, std.dev.: 0.0138) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10421.53% (0.0720 => 7.5755, std.dev.: 0.1905) MultiSource/Applications/SIBsim4/SIBsim4: 3930900.00% (0.0001 => 3.9310, std.dev.: 0.0057) MultiSource/Applications/SPASS/SPASS: 13316800.00% (0.0001 => 13.3169, std.dev.: 1.2035) MultiSource/Applications/kimwitu++/kc: 52400.00% (0.0001 => 0.0525, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14400.00% (0.0001 => 0.0145, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575900.00% (0.0001 => 0.5760, std.dev.: 0.0262) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10079300.00% (0.0001 => 10.0794, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7530200.00% (0.0001 => 7.5303, std.dev.: 0.0813) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1712.80% (1.1194 => 20.2925, std.dev.: 0.7839) MultiSource/Applications/ClamAV/clamscan: 69.00% (22.1758 => 37.4763, std.dev.: 0.4268) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.79% (2.9384 => 4.6072, std.dev.: 0.3818) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 52.21% (8.1363 => 12.3845, std.dev.: 0.1754) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 50.88% (7.0540 => 10.6431, std.dev.: 0.2487) SingleSource/Benchmarks/Misc/flops: 49.16% (0.1432 => 0.2136, std.dev.: 0.0053) MultiSource/Applications/JM/lencod/lencod: 47.12% (21.9371 => 32.2736, std.dev.: 0.0954) MultiSource/Benchmarks/FreeBench/distray/distray: 45.08% (0.1056 => 0.1532, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/almabench: 44.93% (0.0730 => 0.1058, std.dev.: 0.0016) SingleSource/UnitTests/vla: 39.44% (0.0355 => 0.0495, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 36.57% (0.2554 => 0.3488, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 35.95% (0.1566 => 0.2129, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/n-body: 34.99% (0.0746 => 0.1007, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 34.15% (0.1584 => 0.2125, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 33.74% (0.1236 => 0.1653, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 33.29% (0.0793 => 0.1057, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/17-bintr/bintr: 32.15% (0.0675 => 0.0892, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 31.02% (0.7433 => 0.9739, std.dev.: 0.0144) MultiSource/Benchmarks/Olden/tsp/tsp: 30.72% (0.1175 => 0.1536, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 29.63% (0.1151 => 0.1492, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 29.15% (0.0614 => 0.0793, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.91% (0.5105 => 0.6581, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 28.86% (0.0842 => 0.1085, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 28.67% (1.1642 => 1.4980, std.dev.: 0.0056) MultiSource/Applications/minisat/minisat: 27.96% (0.7115 => 0.9104, std.dev.: 0.0149) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.94% (0.0408 => 0.0522, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.78% (0.6675 => 0.8529, std.dev.: 0.0038) MultiSource/Applications/treecc/treecc: 27.66% (2.0273 => 2.5880, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/15-trie/trie: 27.51% (0.0527 => 0.0672, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 27.49% (1.0722 => 1.3670, std.dev.: 0.0088) SingleSource/Benchmarks/McGill/exptree: 27.27% (0.0814 => 0.1036, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 27.22% (0.2700 => 0.3435, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 26.59% (0.2065 => 0.2614, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/health/health: 25.95% (0.1268 => 0.1597, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 25.77% (5.7591 => 7.2434, std.dev.: 0.0470) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.73% (0.0886 => 0.1114, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 25.66% (0.1695 => 0.2130, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/matrix: 25.55% (0.0818 => 0.1027, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: 25.23% (0.4289 => 0.5371, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/perimeter/perimeter: 25.06% (0.0770 => 0.0963, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 24.82% (0.2107 => 0.2630, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 24.63% (0.6456 => 0.8046, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/hash2: 24.24% (0.4620 => 0.5740, std.dev.: 0.0217) SingleSource/Benchmarks/CoyoteBench/lpbench: 24.22% (0.0929 => 0.1154, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 24.13% (0.2603 => 0.3231, std.dev.: 0.0054) SingleSource/Benchmarks/Stanford/Oscar: 23.90% (0.0636 => 0.0788, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/perlin: 23.88% (0.0536 => 0.0664, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.63% (0.1062 => 0.1313, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 23.48% (0.2871 => 0.3545, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 23.37% (0.1117 => 0.1378, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/fibo: 23.16% (0.2725 => 0.3356, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 23.04% (0.2877 => 0.3540, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 22.59% (14.3668 => 17.6120, std.dev.: 0.3227) SingleSource/Benchmarks/CoyoteBench/huffbench: 22.27% (0.0871 => 0.1065, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/misr: 21.96% (0.0633 => 0.0772, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: 21.83% (0.0481 => 0.0586, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 21.55% (0.5020 => 0.6102, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.49% (0.2271 => 0.2759, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.21% (5.0018 => 6.0626, std.dev.: 0.0491) SingleSource/Benchmarks/Misc/fbench: 20.78% (0.0592 => 0.0715, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 20.36% (0.3109 => 0.3742, std.dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.26% (0.4615 => 0.5550, std.dev.: 0.0113) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.3180 => 0.3816, std.dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: 19.78% (9.4845 => 11.3606, std.dev.: 0.1954) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.69% (0.8172 => 0.9781, std.dev.: 0.0228) SingleSource/Benchmarks/CoyoteBench/fftbench: 19.65% (0.4636 => 0.5547, std.dev.: 0.0201) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.25% (0.1143 => 0.1363, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/moments: 19.07% (0.4048 => 0.4820, std.dev.: 0.0105) MultiSource/Benchmarks/VersaBench/bmm/bmm: 18.84% (0.0759 => 0.0902, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: 18.79% (0.2049 => 0.2434, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 18.74% (3.8723 => 4.5981, std.dev.: 0.1294) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.49% (0.1125 => 0.1333, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 18.49% (1.5859 => 1.8791, std.dev.: 0.0795) SingleSource/UnitTests/ObjC/messages-2: 17.52% (0.0662 => 0.0778, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 17.41% (0.8101 => 0.9511, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.10% (0.2872 => 0.3363, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/lists: 16.93% (0.0626 => 0.0732, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hello: 16.88% (0.2714 => 0.3172, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/em3d/em3d: 16.28% (0.1695 => 0.1971, std.dev.: 0.0089) MultiSource/Benchmarks/McCat/05-eks/eks: 16.28% (0.4299 => 0.4999, std.dev.: 0.0222) MultiSource/Benchmarks/Olden/mst/mst: 16.25% (0.1163 => 0.1352, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.90% (0.2793 => 0.3237, std.dev.: 0.0072) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.84% (0.0953 => 0.1104, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/neural/neural: 15.45% (0.1463 => 0.1689, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.26% (0.2758 => 0.3179, std.dev.: 0.0146) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.26% (0.1940 => 0.2236, std.dev.: 0.0113) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.25% (0.3121 => 0.3597, std.dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.19% (0.0770 => 0.0887, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference: 15.03% (0.7326 => 0.8427, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.95% (4.9449 => 5.6841, std.dev.: 0.1896) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.83% (0.1032 => 0.1185, std.dev.: 0.0050) MultiSource/Benchmarks/NPB-serial/is/is: 14.74% (0.0719 => 0.0825, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.51% (0.1337 => 0.1531, std.dev.: 0.0057) MultiSource/Applications/spiff/spiff: 14.45% (0.7835 => 0.8967, std.dev.: 0.0419) SingleSource/UnitTests/ObjC++/property-reference-object: 14.39% (0.6030 => 0.6898, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.28% (0.5569 => 0.6364, std.dev.: 0.0271) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.19% (0.5981 => 0.6830, std.dev.: 0.0249) SingleSource/UnitTests/ObjC++/Hello: 14.14% (0.5925 => 0.6763, std.dev.: 0.0180) MultiSource/Applications/siod/siod: 14.06% (2.2969 => 2.6198, std.dev.: 0.1087) SingleSource/Benchmarks/Shootout-C++/lists: 13.79% (0.3422 => 0.3894, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.61% (0.1029 => 0.1169, std.dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: 13.59% (10.3673 => 11.7759, std.dev.: 0.0786) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.17% (1.5415 => 1.7445, std.dev.: 0.0770) MultiSource/Applications/d/make_dparser: 12.92% (3.3354 => 3.7664, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 12.84% (0.3131 => 0.3533, std.dev.: 0.0086) SingleSource/UnitTests/ObjC/parameter-passing: 12.78% (0.3927 => 0.4429, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.48% (3.8922 => 4.3780, std.dev.: 0.0355) SingleSource/UnitTests/ObjC/property: 12.45% (0.3886 => 0.4370, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.34% (0.3865 => 0.4342, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 12.31% (17.1811 => 19.2963, std.dev.: 0.1483) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.02% (0.4203 => 0.4708, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.00% (0.3543 => 0.3968, std.dev.: 0.0082) SingleSource/UnitTests/ObjC/trivial-interface: 11.86% (0.3473 => 0.3885, std.dev.: 0.0133) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.83% (0.3543 => 0.3962, std.dev.: 0.0084) SingleSource/UnitTests/ObjC/exceptions: 11.81% (0.3828 => 0.4280, std.dev.: 0.0106) SingleSource/UnitTests/ObjC/exceptions-3: 11.75% (0.3516 => 0.3929, std.dev.: 0.0085) SingleSource/UnitTests/ObjC/exceptions-2: 11.72% (0.3497 => 0.3907, std.dev.: 0.0079) SingleSource/UnitTests/ObjC/for-in: 11.51% (0.3694 => 0.4119, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/sieve: 11.46% (0.3603 => 0.4016, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 11.39% (1.5603 => 1.7380, std.dev.: 0.0633) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.18% (2.2022 => 2.4483, std.dev.: 0.0422) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.16% (0.6450 => 0.7170, std.dev.: 0.0224) SingleSource/UnitTests/SignlessTypes/rem: 10.93% (0.1144 => 0.1269, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/football/football: 10.69% (0.8921 => 0.9875, std.dev.: 0.0350) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.55% (0.3650 => 0.4035, std.dev.: 0.0140) SingleSource/Regression/C++/ofstream_ctor: 10.26% (0.2905 => 0.3203, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.21% (0.4064 => 0.4479, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 10.21% (0.2831 => 0.3120, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.15% (0.3162 => 0.3483, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.10% (0.2891 => 0.3183, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.93% (2.0665 => 2.2718, std.dev.: 0.0795) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.69% (0.2756 => 0.3023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.30% (0.2266 => 0.2386, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.25% (4.3953 => 10.9991, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/methcall: 147.75% (5.3999 => 13.3783, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 44.87% (0.3256 => 0.4717, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 38.17% (9.1159 => 12.5952, std.dev.: 0.1491) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 21.20% (1.3045 => 1.5811, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/bisort/bisort: 19.86% (0.8333 => 0.9988, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/lpbench: 19.84% (10.3460 => 12.3985, std.dev.: 0.2313) MultiSource/Benchmarks/Olden/health/health: 19.17% (0.4445 => 0.5297, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/oourafft: 17.59% (6.6465 => 7.8154, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.81% (0.2944 => 0.3439, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.74% (1.1145 => 1.3011, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/tsp/tsp: 15.76% (1.0785 => 1.2485, std.dev.: 0.0209) SingleSource/Benchmarks/Shootout-C++/hash2: 14.33% (3.1578 => 3.6104, std.dev.: 0.0148) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.08% (8.6802 => 9.8153, std.dev.: 0.1270) SingleSource/Benchmarks/BenchmarkGame/puzzle: 12.18% (0.6962 => 0.7810, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.66% (2.8904 => 3.2273, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: 10.19% (1.1396 => 1.2557, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.30% (1.7254 => 1.8858, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 8.68% (0.9505 => 1.0330, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/hash: 8.50% (0.7455 => 0.8089, std.dev.: 0.0099) MultiSource/Applications/lemon/lemon: 8.40% (1.4460 => 1.5674, std.dev.: 0.0059) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.30% (1.8329 => 1.9667, std.dev.: 0.0359) SingleSource/Benchmarks/McGill/chomp: 7.27% (1.2373 => 1.3273, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 5.65% (26.0924 => 27.5656, std.dev.: 0.1270) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.57% (4.2280 => 4.4636, std.dev.: 0.0098) SingleSource/Regression/C/uint64_to_float: 5.08% (0.5413 => 0.5688, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.76% (0.3463 => 0.3628, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 3.96% (11.6436 => 12.1046, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.48% (3.6395 => 3.7663, std.dev.: 0.0264) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 3.06% (4.6441 => 4.7862, std.dev.: 0.0149) MultiSource/Applications/sgefa/sgefa: 2.27% (0.6223 => 0.6364, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.23% (2.1424 => 2.1902, std.dev.: 0.0154) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.15% (1.3677 => 1.3971, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 2.06% (3.1595 => 3.2246, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: 1.94% (2.4116 => 2.4585, std.dev.: 0.0126) MultiSource/Benchmarks/PAQ8p/paq8p: 1.61% (85.0658 => 86.4390, std.dev.: 0.1951) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.52% (6.5088 => 6.6078, std.dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8444 => 28.2326, std.dev.: 0.0366) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.23% (5.2139 => 5.2780, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0506, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1676, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.74% (5.2763 => 1.2271, std.dev.: 0.0403) SingleSource/Benchmarks/Misc/salsa20: -74.21% (0.8651 => 0.2231, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -37.85% (0.1622 => 0.1008, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.98% (5.3855 => 4.6862, std.dev.: 0.1794) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.22% (5.3526 => 4.7523, std.dev.: 0.1455) MultiSource/Applications/JM/ldecod/ldecod: -10.15% (10.4361 => 9.3765, std.dev.: 0.2717) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.96% (1.7609 => 1.7264, std.dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.52% (0.0628 => 0.0361, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.33% (0.3987 => 0.2379, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.32% (4.5009 => 2.7762, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.17% (2.6546 => 2.0129, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -19.34% (0.2161 => 0.1743, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4236, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.72% (2.6778 => 2.2837, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.84% (32.5116 => 28.9863, std.dev.: 0.0191) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734) MultiSource/Benchmarks/NPB-serial/is/is: -10.52% (9.5636 => 8.5575, std.dev.: 0.2100) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.57% (1.5660 => 1.4318, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.94% (4.8142 => 4.4803, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.2416 => 3.0211, std.dev.: 0.0252) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.29% (19.9488 => 18.6942, std.dev.: 0.3584) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.55% (2.7294 => 2.5779, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5093, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: -4.30% (6.2999 => 6.0288, std.dev.: 0.0065) MultiSource/Applications/siod/siod: -3.41% (3.2827 => 3.1707, std.dev.: 0.0388) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.39% (0.9957 => 0.9619, std.dev.: 0.0088) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.26% (1.6805 => 1.6257, std.dev.: 0.0200) MultiSource/Benchmarks/sim/sim: -3.08% (5.0483 => 4.8930, std.dev.: 0.0034) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.58% (0.4808 => 0.4684, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.82% (8.1563 => 8.0081, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6776) SingleSource/Benchmarks/Misc/salsa20: -1.55% (10.2830 => 10.1238, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.28% (0.1485 => 0.1362, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0013) Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 18:27:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 20:27:32 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121126022732.AA5942A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6249?compare_to=6245&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6249, Order: 168574, Start Time: 2012-11-26 00:53:16, End Time: 2012-11-26 02:28:02 To: 6245, Order: 168571, Start Time: 2012-11-25 21:15:03, End Time: 2012-11-25 22:45:26 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 5 (57 on baseline) Performance Improvements: 1 (23 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1048 (894 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/lambda-0_1_3/lambda: 2.53% (0.7705 => 0.7900, std.dev.: 0.0055) MultiSource/Applications/hexxagon/hexxagon: 1.49% (0.9988 => 1.0137, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.71% (21.2864 => 22.7147, std.dev.: 0.0292) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.91% (1.3418 => 1.4077, std.dev.: 0.0199) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.21% (0.4024 => 0.4153, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: -6.20% (54.9185 => 51.5149, std.dev.: 0.8135) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.10% (1.0492 => 1.0712, std.dev.: 0.0270) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 48.65% (0.0148 => 0.0220, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0430 => 0.0430, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 36.03% (0.0247 => 0.0336, std.dev.: 0.0059) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0315 => 0.0314, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0425 => 0.0425, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: -0.48% (0.0207 => 0.0206, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/test1: 19.67% (0.0183 => 0.0219, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.74% (0.1482 => 0.1493, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 0.37% (1.1848 => 1.1892, std.dev.: 0.0049) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.14% (0.4140 => 0.4187, std.dev.: 0.0243) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.97% (0.1442 => 0.1456, std.dev.: 0.0273) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 600.00% (0.0001 => 0.0007, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.56% (0.0640 => 0.0650, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 21.29% (0.0202 => 0.0245, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.80% (0.0588 => 0.0548, std.dev.: 0.0169) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.39% (1.1976 => 1.2023, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 244.44% (0.0009 => 0.0031, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.00% (0.0582 => 0.0646, std.dev.: 0.0130) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 41.34% (0.0179 => 0.0253, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.60% (0.7817 => 0.7770, std.dev.: 0.0069) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -9.41% (0.0085 => 0.0077, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.68% (16.4461 => 17.7098, std.dev.: 0.4903) MultiSource/Applications/sqlite3/sqlite3: 2364.43% (0.6332 => 15.6048, std.dev.: 0.3447) MultiSource/Benchmarks/McCat/08-main/main: 51.01% (0.1831 => 0.2765, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.71% (0.1559 => 0.1548, std.dev.: 0.0315) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7200.54% (0.3123 => 22.7996, std.dev.: 0.9689) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.49% (0.2463 => 0.3682, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1533.13% (0.3344 => 5.4612, std.dev.: 0.2628) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.44% (0.2364 => 0.3249, std.dev.: 0.1057) SingleSource/Benchmarks/Misc-C++/bigfib: 4.64% (0.6010 => 0.6289, std.dev.: 0.0255) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.33% (0.3266 => 0.3440, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/strcat: 3.40% (0.1969 => 0.2036, std.dev.: 0.0055) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.80% (0.0224 => 0.0237, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -37.83% (0.0230 => 0.0143, std.dev.: 0.0015) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0530, std.dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: 11.97% (0.1462 => 0.1637, std.dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4802, std.dev.: 0.0383) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0748, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4946, std.dev.: 0.0069) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5142, std.dev.: 0.0177) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.6228, std.dev.: 0.1943) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3151, std.dev.: 0.0302) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1385, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3631, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4010, std.dev.: 0.0499) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0845, std.dev.: 0.0262) SingleSource/Regression/C/uint64_to_float: -23.99% (2.1832 => 1.6595, std.dev.: 0.0034) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.27% (0.0848 => 0.0969, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.86% (0.0830 => 0.0945, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/tsp/tsp: 13.40% (0.1112 => 0.1261, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.61% (0.1905 => 0.2088, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.55% (0.2794 => 0.3005, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.13% (0.2103 => 0.2232, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.67% (1.1170 => 1.1692, std.dev.: 0.0179) MultiSource/Applications/lambda-0_1_3/lambda: 4.54% (0.7557 => 0.7900, std.dev.: 0.0055) MultiSource/Applications/hbd/hbd: 4.24% (1.4269 => 1.4874, std.dev.: 0.0231) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 4.05% (0.8597 => 0.8945, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.98% (0.3115 => 0.3239, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.76% (0.8048 => 0.8351, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.66% (2.1401 => 2.2184, std.dev.: 0.0180) MultiSource/Applications/SIBsim4/SIBsim4: 3.54% (1.2568 => 1.3013, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.44% (0.8716 => 0.9016, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.38% (0.4559 => 0.4713, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.34% (0.8086 => 0.8356, std.dev.: 0.0102) MultiSource/Applications/hexxagon/hexxagon: 3.33% (0.9810 => 1.0137, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 3.32% (0.8885 => 0.9180, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.18% (0.7932 => 0.8184, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.77% (0.5191 => 0.5335, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 111.56% (0.0199 => 0.0421, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/pi: 50.78% (1.5795 => 2.3815, std.dev.: 0.0644) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 20.27% (0.0528 => 0.0635, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.03% (0.7597 => 0.8891, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.36% (2.9753 => 3.4620, std.dev.: 0.0412) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.71% (2.7995 => 3.2113, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6089, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.04% (6.3772 => 7.0172, std.dev.: 0.1494) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.05% (1.1857 => 1.2811, std.dev.: 0.0103) SingleSource/Benchmarks/McGill/queens: 7.44% (1.7056 => 1.8325, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.77% (4.7794 => 5.1029, std.dev.: 0.0081) MultiSource/Applications/SIBsim4/SIBsim4: 6.66% (3.1873 => 3.3997, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/richards_benchmark: 6.57% (1.3037 => 1.3893, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.98% (4.5327 => 4.8037, std.dev.: 0.0605) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.71% (6.2275 => 6.5209, std.dev.: 0.0279) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.69% (3.3761 => 3.5343, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.21% (4.9453 => 5.1537, std.dev.: 0.0172) MultiSource/Benchmarks/Olden/treeadd/treeadd: 4.18% (0.3587 => 0.3737, std.dev.: 0.0034) MultiSource/Applications/lambda-0_1_3/lambda: 4.18% (7.4933 => 7.8064, std.dev.: 0.0404) MultiSource/Applications/hexxagon/hexxagon: 3.99% (14.0064 => 14.5659, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.99% (4.9469 => 5.1444, std.dev.: 0.0279) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.03% (0.4031 => 0.4153, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 2.97% (3.6643 => 3.7730, std.dev.: 0.0271) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.69% (11.5690 => 11.8802, std.dev.: 0.0313) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.51% (8.2783 => 8.4858, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.45% (4.8362 => 4.9545, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.40% (4.8660 => 4.9828, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout/lists: 2.31% (7.3375 => 7.5073, std.dev.: 0.0205) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.18% (59.2638 => 60.5580, std.dev.: 0.2638) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.86% (22.2997 => 22.7147, std.dev.: 0.0292) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.64% (1.1365 => 1.1551, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/power/power: 1.55% (1.2061 => 1.2248, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 1.31% (1.0841 => 1.0983, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/ReedSolomon: 1.27% (8.5322 => 8.6402, std.dev.: 0.0382) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.15% (3.5679 => 3.6089, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/whetstone: 1.05% (2.1224 => 2.1447, std.dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.92% (5.4641 => 4.3212, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.76% (7.2130 => 6.1486, std.dev.: 0.1737) SingleSource/Benchmarks/McGill/chomp: -10.93% (1.1216 => 0.9990, std.dev.: 0.0354) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.76% (1.0512 => 0.9381, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: -8.31% (63.1822 => 57.9329, std.dev.: 0.0719) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.89% (14.6451 => 13.4894, std.dev.: 0.2822) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.89% (4.7482 => 4.4211, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.04% (5.4972 => 5.1654, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.98% (3.7148 => 3.4928, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.04% (5.1557 => 4.8959, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.41% (4.7449 => 4.5358, std.dev.: 0.0290) MultiSource/Benchmarks/nbench/nbench: -4.07% (21.9654 => 21.0719, std.dev.: 0.3458) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.70% (6.0224 => 5.7995, std.dev.: 0.0165) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.36% (0.5807 => 0.5612, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.97% (28.5821 => 27.7330, std.dev.: 0.1295) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.88% (2.8773 => 2.7945, std.dev.: 0.0228) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.51% (2.4490 => 2.3875, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.34% (9.9065 => 9.6746, std.dev.: 0.0881) SingleSource/Benchmarks/Shootout-C++/hash2: -2.26% (3.4237 => 3.3462, std.dev.: 0.0257) MultiSource/Applications/aha/aha: -2.20% (3.3398 => 3.2663, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (11.5316 => 11.2986, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.54% (4.9994 => 4.9224, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.01% (5.6343 => 5.5773, std.dev.: 0.0046) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.39% (1.0262 => 1.0712, std.dev.: 0.0270) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.39% (0.0408 => 0.0430, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 32.28% (0.0254 => 0.0336, std.dev.: 0.0059) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: 8.42% (0.0190 => 0.0206, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 3.82% (0.1438 => 0.1493, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 4.97% (1.1329 => 1.1892, std.dev.: 0.0049) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.55% (0.4164 => 0.4187, std.dev.: 0.0243) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.36% (0.1369 => 0.1456, std.dev.: 0.0273) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.40% (0.0641 => 0.0650, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 25.64% (0.0195 => 0.0245, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.19% (0.0578 => 0.0548, std.dev.: 0.0169) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.12% (1.1437 => 1.2023, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.03% (0.0627 => 0.0646, std.dev.: 0.0130) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 40.56% (0.0180 => 0.0253, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.08% (0.8017 => 0.7770, std.dev.: 0.0069) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 24.19% (0.0062 => 0.0077, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 18:27:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 20:27:53 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121126022753.58A722A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6250?compare_to=6246&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6250, Order: 168574, Start Time: 2012-11-26 00:54:37, End Time: 2012-11-26 02:28:24 To: 6246, Order: 168571, Start Time: 2012-11-25 21:18:21, End Time: 2012-11-25 22:51:57 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (177 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (860 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 17.45% (0.3834 => 0.4503, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.09% (2.0478 => 2.1111, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/salsa20: 2.50% (7.4937 => 7.6812, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/hash2: 2.23% (3.1932 => 3.2645, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.75% (0.3821 => 0.3525, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.59% (0.3142 => 0.2935, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -6.58% (2.4924 => 2.3285, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -6.32% (0.3831 => 0.3589, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.31% (0.3848 => 0.3605, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -6.29% (0.3880 => 0.3636, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -6.26% (0.3896 => 0.3652, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.24% (0.3812 => 0.3574, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.17% (0.4033 => 0.3784, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.17% (0.3357 => 0.3150, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: -6.03% (0.4176 => 0.3924, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.02% (0.9542 => 0.8968, std.dev.: 0.0066) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.99% (0.2355 => 0.2214, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.96% (0.3891 => 0.3659, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.94% (0.6484 => 0.6099, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.93% (0.2428 => 0.2284, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -5.93% (0.2160 => 0.2032, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -5.88% (9.2283 => 8.6856, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.88% (0.7198 => 0.6775, std.dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: -5.77% (16.1920 => 15.2570, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.68% (0.1796 => 0.1694) MultiSource/Applications/JM/ldecod/ldecod: -5.67% (7.0961 => 6.6937, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.66% (0.3884 => 0.3664, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.64% (1.0544 => 0.9949, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/property: -5.62% (0.4199 => 0.3963, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/ReedSolomon: -5.59% (0.1879 => 0.1774, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.58% (4.8161 => 4.5475, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.57% (1.3722 => 1.2957, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.56% (0.9852 => 0.9304, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.52% (4.0323 => 3.8096, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.52% (0.3658 => 0.3456, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.51% (6.7716 => 6.3988, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/football/football: -5.50% (0.9179 => 0.8674, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.49% (1.6364 => 1.5465, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.45% (0.2695 => 0.2548, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.39% (1.2300 => 1.1637, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.37% (0.5863 => 0.5548, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.37% (0.5478 => 0.5184, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.35% (4.8802 => 4.6189, std.dev.: 0.0071) MultiSource/Benchmarks/sim/sim: -5.34% (0.3406 => 0.3224, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.34% (0.6052 => 0.5729, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.33% (0.3057 => 0.2894, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -5.33% (0.2871 => 0.2718, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -5.33% (0.4280 => 0.4052, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -5.33% (1.1530 => 1.0916, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.29% (0.5705 => 0.5403, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.28% (0.5591 => 0.5296, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.25% (0.2933 => 0.2779, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.24% (0.5857 => 0.5550, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.24% (0.3016 => 0.2858, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.24% (0.5575 => 0.5283, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.23% (1.4642 => 1.3876, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.23% (4.5069 => 4.2712, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.22% (0.6297 => 0.5968, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.21% (8.0126 => 7.5951, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.21% (0.5802 => 0.5500, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.20% (0.2903 => 0.2752, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.20% (3.5339 => 3.3502, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: -5.19% (0.3025 => 0.2868, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -5.19% (0.2989 => 0.2834, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.18% (0.4515 => 0.4281, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.18% (0.5925 => 0.5618, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: -5.18% (0.3205 => 0.3039, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.17% (0.2939 => 0.2787, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.17% (0.5805 => 0.5505, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.16% (14.2083 => 13.4745, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.16% (0.5849 => 0.5547, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.16% (0.6260 => 0.5937, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: -5.16% (0.2849 => 0.2702, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.15% (1.2784 => 1.2125, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -5.15% (1.1450 => 1.0860, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.15% (0.6230 => 0.5909, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.15% (0.6293 => 0.5969, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.14% (0.6304 => 0.5980, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.13% (0.3255 => 0.3088, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.13% (0.2985 => 0.2832, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -5.12% (0.3026 => 0.2871, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.12% (0.6189 => 0.5872, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -5.11% (17.1032 => 16.2284, std.dev.: 0.0200) SingleSource/Benchmarks/Shootout-C++/ary3: -5.11% (0.3446 => 0.3270, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.11% (0.6660 => 0.6320, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.10% (0.6194 => 0.5878, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -5.10% (0.3394 => 0.3221, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.09% (0.8521 => 0.8087, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.09% (0.6736 => 0.6393, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.08% (0.6667 => 0.6328, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.07% (0.6446 => 0.6119, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.06% (0.5570 => 0.5288, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.05% (2.1713 => 2.0616, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.04% (0.6681 => 0.6344, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.03% (0.4151 => 0.3942, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.02% (0.5581 => 0.5301, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -5.00% (0.3481 => 0.3307, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.99% (0.6033 => 0.5732, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.98% (0.4916 => 0.4671, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: -4.98% (4.3330 => 4.1171, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.98% (0.3252 => 0.3090, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.97% (0.5999 => 0.5701, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.97% (0.5456 => 0.5185, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.97% (0.3323 => 0.3158, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.96% (0.2278 => 0.2165, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.95% (0.7919 => 0.7527, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.94% (0.6440 => 0.6122, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.92% (1.2221 => 1.1620, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -4.91% (1.3148 => 1.2502, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: -4.90% (1.3864 => 1.3185, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.89% (1.2210 => 1.1613, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: -4.89% (0.2659 => 0.2529, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.88% (0.3849 => 0.3661, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -4.88% (0.3194 => 0.3038, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.87% (0.5688 => 0.5411, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.87% (0.2999 => 0.2853, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.87% (0.6676 => 0.6351, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.86% (0.4813 => 0.4579, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.85% (0.5941 => 0.5653, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.83% (0.2548 => 0.2425, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -4.82% (15.5079 => 14.7598, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.82% (0.2385 => 0.2270, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/moments: -4.80% (0.4248 => 0.4044, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -4.80% (3.5154 => 3.3468, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: -4.79% (1.2515 => 1.1916, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.76% (0.3931 => 0.3744, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -4.75% (0.3581 => 0.3411, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -4.71% (0.3059 => 0.2915, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -4.69% (0.3621 => 0.3451, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -4.69% (15.2527 => 14.5378, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.67% (0.3837 => 0.3658, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -4.59% (0.4861 => 0.4638, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.58% (0.4083 => 0.3896, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.58% (0.3319 => 0.3167, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -4.58% (0.3867 => 0.3690, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -4.50% (4.0594 => 3.8766, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: -4.50% (0.7447 => 0.7112, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.43% (0.6395 => 0.6112, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.42% (0.4321 => 0.4130, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.37% (0.7021 => 0.6714, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.36% (0.7524 => 0.7196, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -4.35% (0.6347 => 0.6071, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.34% (0.4427 => 0.4235, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.32% (0.5168 => 0.4945, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -4.31% (5.0226 => 4.8060, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.30% (1.6474 => 1.5765, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -4.27% (0.6441 => 0.6166, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -4.25% (0.3788 => 0.3627, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.20% (0.5329 => 0.5105, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.20% (0.5569 => 0.5335, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.18% (0.9077 => 0.8698, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.16% (0.7339 => 0.7034, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.15% (22.4056 => 21.4747, std.dev.: 0.0136) SingleSource/UnitTests/ObjC++/property-reference: -4.14% (0.7779 => 0.7457, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.11% (0.8418 => 0.8072, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: -4.09% (2.1401 => 2.0526, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: -4.04% (0.3271 => 0.3139, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.03% (0.6395 => 0.6137, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -4.00% (0.6750 => 0.6480, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -3.98% (2.4021 => 2.3064, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: -3.89% (0.4524 => 0.4348, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.88% (0.5567 => 0.5351, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -3.81% (0.7982 => 0.7678, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -3.79% (34.0927 => 32.8009, std.dev.: 0.0136) MultiSource/Applications/hbd/hbd: -3.73% (1.5610 => 1.5027, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.71% (2.2587 => 2.1749, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.64% (0.3491 => 0.3364, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -3.39% (18.2933 => 17.6734, std.dev.: 0.0231) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.82% (5.4682 => 5.3138, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -2.39% (20.7746 => 20.2787, std.dev.: 0.0155) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7548, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/richards_benchmark: -8.68% (1.2842 => 1.1727, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -4.00% (2.2633 => 2.1728, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7068, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.73% (1.3096 => 1.2869, std.dev.: 0.0075) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4705, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 20:21:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 22:21:06 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121126042106.55AE42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6251?compare_to=6249&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6251, Order: 168577, Start Time: 2012-11-26 02:45:40, End Time: 2012-11-26 04:21:00 To: 6249, Order: 168574, Start Time: 2012-11-26 00:53:16, End Time: 2012-11-26 02:28:02 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 14 (99 on baseline) Performance Improvements: 4 (23 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1036 (852 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.79% (2.2184 => 2.4356, std.dev.: 0.0134) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.42% (0.2363 => 0.2491, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.97% (0.3239 => 0.3400, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash: 3.34% (0.3864 => 0.3993, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.57% (0.6998 => 0.7108, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel24: 46.33% (0.2670 => 0.3907, std.dev.: 0.0182) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 14.62% (45.2646 => 51.8813, std.dev.: 0.7653) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.18% (2.2805 => 2.4214, std.dev.: 0.0405) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.84% (41.5982 => 43.6095, std.dev.: 0.7239) SingleSource/Benchmarks/Misc/pi: 4.40% (2.3815 => 2.4864, std.dev.: 0.0146) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.36% (4.3571 => 4.5471, std.dev.: 0.0431) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.73% (6.1486 => 6.3778, std.dev.: 0.0543) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.68% (1.2479 => 1.2938, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/ffbench: 2.68% (1.4194 => 1.4574, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.12% (0.3005 => 0.2851, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.61% (0.2232 => 0.2129, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -2.55% (0.9505 => 0.9263, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -9.97% (1.4077 => 1.2674, std.dev.: 0.0476) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.49% (1.0712 => 1.0872, std.dev.: 0.0643) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.45% (0.0220 => 0.0219, std.dev.: 0.0068) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0430 => 0.0430, std.dev.: 0.0122) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.89% (0.0336 => 0.0333, std.dev.: 0.0093) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.64% (0.0314 => 0.0316, std.dev.: 0.0091) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0425 => 0.0427, std.dev.: 0.0136) SingleSource/UnitTests/Vector/Altivec/casts: 2.43% (0.0206 => 0.0211, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/test1: 0.46% (0.0219 => 0.0220, std.dev.: 0.0057) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.47% (0.1493 => 0.1500, std.dev.: 0.0036) MultiSource/Applications/lemon/lemon: 1.00% (1.1892 => 1.2011, std.dev.: 0.2347) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.96% (0.4187 => 0.4227, std.dev.: 0.0363) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.46% (0.1456 => 0.1391, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.29% (0.0007 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.15% (0.0650 => 0.0649, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.84% (0.0245 => 0.0274, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.03% (0.0548 => 0.0592, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.43% (1.2023 => 1.1971, std.dev.: 0.0358) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -74.07% (0.0027 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.46% (0.0646 => 0.0643, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.56% (0.0253 => 0.0244, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.51% (0.7770 => 0.7810, std.dev.: 0.0028) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -31.17% (0.0077 => 0.0053, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.92% (16.4461 => 17.9133, std.dev.: 0.7656) MultiSource/Applications/sqlite3/sqlite3: 2362.07% (0.6332 => 15.5898, std.dev.: 0.2054) MultiSource/Benchmarks/McCat/08-main/main: 50.90% (0.1831 => 0.2763, std.dev.: 0.0673) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.07% (0.1559 => 0.1480, std.dev.: 0.0091) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7165.71% (0.3123 => 22.6908, std.dev.: 0.3632) SingleSource/Benchmarks/CoyoteBench/fftbench: 52.62% (0.2463 => 0.3759, std.dev.: 0.0175) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1610.23% (0.3344 => 5.7190, std.dev.: 0.4733) SingleSource/Benchmarks/Misc-C++/Large/ray: 39.17% (0.2364 => 0.3290, std.dev.: 0.0470) SingleSource/Benchmarks/Misc-C++/bigfib: 5.07% (0.6010 => 0.6315, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/mandel: 4.43% (0.0429 => 0.0448, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.93% (0.3266 => 0.3427, std.dev.: 0.0744) SingleSource/Benchmarks/Shootout-C++/strcat: 3.56% (0.1969 => 0.2039, std.dev.: 0.0044) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.14% (0.0224 => 0.0240, std.dev.: 0.0078) SingleSource/UnitTests/byval-alignment: -22.17% (0.0230 => 0.0179, std.dev.: 0.0041) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0524) MultiSource/Applications/oggenc/oggenc: 12.24% (0.1462 => 0.1641, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4762, std.dev.: 0.0808) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0712, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4881, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5141, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.7668, std.dev.: 0.1831) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3269, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1285, std.dev.: 0.0580) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3632, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4017, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0886, std.dev.: 0.0114) SingleSource/Regression/C/uint64_to_float: -24.37% (2.1832 => 1.6512, std.dev.: 0.0790) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 18.50% (0.0627 => 0.0743, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.18% (0.0830 => 0.0956, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 13.81% (2.1401 => 2.4356, std.dev.: 0.0134) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.33% (0.0848 => 0.0961, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 11.21% (0.0937 => 0.1042, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.21% (0.2240 => 0.2491, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.37% (0.1157 => 0.1277, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.88% (0.8321 => 0.9143, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.15% (0.3115 => 0.3400, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.21% (0.1983 => 0.2126, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.74% (0.1885 => 0.2012, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.27% (0.4559 => 0.4845, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.10% (0.2998 => 0.3181, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.48% (0.4783 => 0.5045, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.38% (1.1606 => 1.2230, std.dev.: 0.0228) SingleSource/Benchmarks/Shootout-C++/hash: 5.08% (0.3800 => 0.3993, std.dev.: 0.0021) MultiSource/Applications/treecc/treecc: 4.74% (1.9948 => 2.0894, std.dev.: 0.0310) SingleSource/Benchmarks/Shootout-C++/ary: 4.73% (0.2390 => 0.2503, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 4.68% (14.2605 => 14.9274, std.dev.: 0.1184) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.03% (6.6074 => 6.8738, std.dev.: 0.0499) MultiSource/Applications/JM/ldecod/ldecod: 3.78% (6.7320 => 6.9866, std.dev.: 0.0769) MultiSource/Applications/d/make_dparser: 3.63% (3.2366 => 3.3540, std.dev.: 0.0288) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.45% (0.8316 => 0.8603, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.42% (0.9056 => 0.9366, std.dev.: 0.0062) MultiSource/Applications/JM/lencod/lencod: 3.36% (15.3280 => 15.8434, std.dev.: 0.0744) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.33% (0.9688 => 1.0011, std.dev.: 0.0099) MultiSource/Applications/SIBsim4/SIBsim4: 3.10% (1.2568 => 1.2957, std.dev.: 0.0079) MultiSource/Benchmarks/PAQ8p/paq8p: 3.07% (2.3764 => 2.4493, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.04% (0.8457 => 0.8714, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.02% (0.8805 => 0.9071, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.82% (0.8697 => 0.8942, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.80% (4.5702 => 4.6981, std.dev.: 0.0485) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.76% (0.7932 => 0.8151, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.70% (0.8007 => 0.8223, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.67% (0.8050 => 0.8265, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.59% (0.8331 => 0.8547, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.52% (0.8317 => 0.8527, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.49% (0.9908 => 1.0155, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.44% (0.8712 => 0.8925, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.44% (0.8286 => 0.8488, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.43% (0.8204 => 0.8403, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.40% (0.8086 => 0.8280, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.38% (0.6943 => 0.7108, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.37% (0.8518 => 0.8720, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.35% (0.8069 => 0.8259, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.34% (0.8177 => 0.8368, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.27% (0.8855 => 0.9056, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.24% (0.8261 => 0.8446, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.18% (0.8656 => 0.8845, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.14% (0.9069 => 0.9263, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.14% (0.8885 => 0.9075, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.13% (0.8359 => 0.8537, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.08% (0.7966 => 0.8132, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.97% (0.8927 => 0.9103, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 118.59% (0.0199 => 0.0435, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/pi: 57.42% (1.5795 => 2.4864, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.89% (0.7597 => 0.8880, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.43% (44.5605 => 51.8813, std.dev.: 0.7653) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.15% (2.9753 => 3.4558, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.53% (2.7995 => 3.2064, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.46% (5.0261 => 5.6022, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.80% (0.3186 => 0.3530, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.78% (1.1857 => 1.2780, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 7.69% (2.2485 => 2.4214, std.dev.: 0.0405) SingleSource/Benchmarks/McGill/queens: 7.46% (1.7056 => 1.8328, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.43% (6.3772 => 6.8508, std.dev.: 0.1507) SingleSource/Benchmarks/Misc/richards_benchmark: 7.09% (1.3037 => 1.3961, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.74% (4.7794 => 5.1017, std.dev.: 0.0093) MultiSource/Applications/SIBsim4/SIBsim4: 6.43% (3.1873 => 3.3921, std.dev.: 0.0528) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.87% (4.9686 => 5.2603, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.71% (4.5327 => 4.7913, std.dev.: 0.0184) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.28% (41.4238 => 43.6095, std.dev.: 0.7239) MultiSource/Applications/lambda-0_1_3/lambda: 5.26% (7.4933 => 7.8873, std.dev.: 0.0469) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.77% (6.2275 => 6.5246, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.77% (3.3761 => 3.5370, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.68% (22.2997 => 23.3440, std.dev.: 0.3808) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.41% (4.3552 => 4.5471, std.dev.: 0.0431) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.18% (4.9453 => 5.1518, std.dev.: 0.0307) MultiSource/Applications/hexxagon/hexxagon: 4.05% (14.0064 => 14.5742, std.dev.: 0.0349) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.03% (4.9469 => 5.1461, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/hash: 3.88% (0.6205 => 0.6446, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/except: 3.58% (0.4921 => 0.5097, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.51% (0.3587 => 0.3713, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: 3.09% (7.3375 => 7.5642, std.dev.: 0.0274) MultiSource/Applications/siod/siod: 3.03% (3.6643 => 3.7755, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.81% (11.5690 => 11.8942, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.80% (2.7551 => 2.8323, std.dev.: 0.0294) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.72% (8.2783 => 8.5032, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/bh/bh: 2.67% (2.3560 => 2.4188, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.31% (4.8660 => 4.9784, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.16% (1.1365 => 1.1611, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.94% (1.4296 => 1.4574, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/whetstone: 1.71% (2.1224 => 2.1586, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/power/power: 1.57% (1.2061 => 1.2250, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 1.47% (8.5322 => 8.6575, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/neural/neural: 1.31% (1.0841 => 1.0983, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.25% (5.8421 => 5.9151, std.dev.: 0.0119) MultiSource/Benchmarks/BitBench/five11/five11: 1.24% (5.6030 => 5.6724, std.dev.: 0.0210) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.22% (3.5679 => 3.6116, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.69% (5.4641 => 4.3335, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.58% (7.2130 => 6.3778, std.dev.: 0.0543) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.86% (1.0512 => 0.9370, std.dev.: 0.0076) SingleSource/Benchmarks/McGill/chomp: -9.75% (1.1216 => 1.0123, std.dev.: 0.0149) MultiSource/Benchmarks/mafft/pairlocalalign: -8.22% (63.1822 => 57.9859, std.dev.: 0.1020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.65% (14.6451 => 13.5254, std.dev.: 0.1118) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -7.05% (4.7482 => 4.4134, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.30% (0.3269 => 0.3063, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.01% (3.7148 => 3.4917, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.94% (5.4972 => 5.1706, std.dev.: 0.0532) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.16% (5.1557 => 4.8896, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.35% (4.7449 => 4.5385, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.84% (6.0224 => 5.7911, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (28.5821 => 27.6996, std.dev.: 0.1642) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.73% (2.6356 => 2.5637, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.38% (2.4490 => 2.3906, std.dev.: 0.0163) MultiSource/Applications/aha/aha: -2.11% (3.3398 => 3.2693, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.99% (9.9065 => 9.7092, std.dev.: 0.0656) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.99% (11.5316 => 11.3024, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/hash2: -1.82% (3.4237 => 3.3613, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.61% (4.9994 => 4.9188, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.59% (2.3487 => 2.3113, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.29% (5.6343 => 5.5615, std.dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 5.94% (1.0262 => 1.0872, std.dev.: 0.0643) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0068) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.39% (0.0408 => 0.0430, std.dev.: 0.0122) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0093) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0091) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.20% (0.0384 => 0.0427, std.dev.: 0.0136) SingleSource/UnitTests/Vector/Altivec/casts: 11.05% (0.0190 => 0.0211, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/test1: 22.22% (0.0180 => 0.0220, std.dev.: 0.0057) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 4.31% (0.1438 => 0.1500, std.dev.: 0.0036) MultiSource/Applications/lemon/lemon: 6.02% (1.1329 => 1.2011, std.dev.: 0.2347) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.51% (0.4164 => 0.4227, std.dev.: 0.0363) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.61% (0.1369 => 0.1391, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.25% (0.0641 => 0.0649, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 40.51% (0.0195 => 0.0274, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.42% (0.0578 => 0.0592, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.67% (1.1437 => 1.1971, std.dev.: 0.0358) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0014 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.55% (0.0627 => 0.0643, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 35.56% (0.0180 => 0.0244, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.58% (0.8017 => 0.7810, std.dev.: 0.0028) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -14.52% (0.0062 => 0.0053, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 20:24:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 22:24:18 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121126042418.8CBCC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6252?compare_to=6250&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6252, Order: 168577, Start Time: 2012-11-26 02:51:23, End Time: 2012-11-26 04:24:48 To: 6250, Order: 168574, Start Time: 2012-11-26 00:54:37, End Time: 2012-11-26 02:28:24 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (179 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (859 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1009, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.4937 => 7.6699, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash2: 2.08% (3.1932 => 3.2596, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.60% (0.1431 => 0.1308, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.90% (0.3821 => 0.3519, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -6.58% (2.4924 => 2.3283, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.49% (0.3142 => 0.2938, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.19% (0.3896 => 0.3655, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.19% (0.3848 => 0.3610) SingleSource/UnitTests/ObjC/exceptions-4: -6.16% (0.3880 => 0.3641, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.08% (0.3831 => 0.3598, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.07% (0.4033 => 0.3788, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.06% (0.3812 => 0.3581, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.03% (0.9542 => 0.8967, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.02% (0.3357 => 0.3155, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.99% (0.3891 => 0.3658, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/oourafft: -5.97% (0.2160 => 0.2031, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -5.96% (0.4176 => 0.3927, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -5.93% (9.2283 => 8.6810, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.85% (0.2428 => 0.2286, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.83% (0.7198 => 0.6778, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.82% (0.2355 => 0.2218, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.78% (0.6484 => 0.6109, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.73% (0.1796 => 0.1693, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.71% (0.9852 => 0.9289, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: -5.70% (16.1920 => 15.2691, std.dev.: 0.0113) MultiSource/Applications/JM/ldecod/ldecod: -5.66% (7.0961 => 6.6947, std.dev.: 0.0065) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.64% (0.3884 => 0.3665, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.60% (1.3722 => 1.2953, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.60% (1.0544 => 0.9954, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -5.55% (0.4199 => 0.3966, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.54% (4.0323 => 3.8088, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.54% (4.8161 => 4.5495, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.47% (6.7716 => 6.4014, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.46% (0.5478 => 0.5179, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: -5.46% (0.9179 => 0.8678, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.44% (1.6364 => 1.5473, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.43% (4.8802 => 4.6150, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -5.43% (0.1879 => 0.1777, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.42% (0.2695 => 0.2549, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.39% (0.3658 => 0.3461, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.37% (0.3016 => 0.2854, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.36% (0.2871 => 0.2717, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.34% (1.2300 => 1.1643, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.33% (0.5591 => 0.5293, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.32% (0.5863 => 0.5551, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -5.32% (1.1530 => 1.0917, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.30% (0.3057 => 0.2895, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.27% (0.6052 => 0.5733, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -5.25% (0.3255 => 0.3084, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: -5.24% (1.1450 => 1.0850, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.22% (0.5859 => 0.5553, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.22% (0.6230 => 0.5905, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: -5.21% (0.3205 => 0.3038, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.21% (0.6297 => 0.5969, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.21% (0.5857 => 0.5552, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.20% (1.4642 => 1.3880, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.20% (0.2903 => 0.2752, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.20% (4.5069 => 4.2725, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.20% (8.0126 => 7.5959, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.19% (0.6260 => 0.5935, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.19% (14.2083 => 13.4708, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.18% (0.5925 => 0.5618, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: -5.17% (0.3446 => 0.3268, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.16% (0.5849 => 0.5547, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.16% (0.5581 => 0.5293, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -5.16% (0.3394 => 0.3219, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.14% (3.5339 => 3.3522, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.14% (1.2784 => 1.2127, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.13% (0.5575 => 0.5289, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -5.13% (0.2985 => 0.2832, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -5.13% (17.1032 => 16.2266, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.12% (0.6189 => 0.5872, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -5.12% (0.2989 => 0.2836, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.12% (0.5705 => 0.5413, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.11% (0.2933 => 0.2783, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.11% (0.3406 => 0.3232, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.11% (0.6304 => 0.5982, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.11% (0.4151 => 0.3939, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.11% (0.6736 => 0.6392, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -5.10% (0.2939 => 0.2789, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.10% (0.6194 => 0.5878, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.09% (0.6293 => 0.5973, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.08% (0.5802 => 0.5507, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -5.07% (0.4515 => 0.4286, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: -5.07% (0.4280 => 0.4063, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.06% (0.5805 => 0.5511, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.06% (0.8521 => 0.8090, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -5.03% (1.3148 => 1.2487, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.01% (0.3252 => 0.3089, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.01% (0.6667 => 0.6333, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/objinst: -5.01% (0.3194 => 0.3034, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.01% (2.1713 => 2.0626, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.00% (0.6660 => 0.6327, std.dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: -4.99% (1.3864 => 1.3172, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.98% (0.6446 => 0.6125, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.97% (0.5570 => 0.5293, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.97% (0.5456 => 0.5185, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.95% (0.7919 => 0.7527, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.93% (0.2999 => 0.2851, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.92% (0.4916 => 0.4674, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.92% (0.5999 => 0.5704, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.92% (0.2278 => 0.2166, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.91% (0.2849 => 0.2709, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.91% (0.6681 => 0.6353, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.91% (0.6033 => 0.5737, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.90% (0.3837 => 0.3649, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.89% (1.2221 => 1.1623, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/gs/gs: -4.88% (4.3330 => 4.1217, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.88% (0.3323 => 0.3161, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.86% (1.2210 => 1.1616, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.86% (0.6440 => 0.6127, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: -4.86% (0.3581 => 0.3407, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -4.85% (0.3481 => 0.3312, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -4.85% (15.5079 => 14.7553, std.dev.: 0.0162) MultiSource/Benchmarks/McCat/08-main/main: -4.85% (0.2659 => 0.2530, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.82% (0.6676 => 0.6354, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.81% (0.3931 => 0.3742, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.80% (0.5941 => 0.5656, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.79% (0.3483 => 0.3316, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -4.79% (0.3025 => 0.2880, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -4.79% (0.3026 => 0.2881, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.79% (0.2548 => 0.2426, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: -4.79% (1.2515 => 1.1916, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.78% (0.2385 => 0.2271, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -4.76% (3.5154 => 3.3480, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -4.75% (0.3621 => 0.3449, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.71% (0.5688 => 0.5420, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/moments: -4.71% (0.4248 => 0.4048, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.70% (0.4083 => 0.3891, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.68% (0.3849 => 0.3669, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.67% (0.3319 => 0.3164, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.63% (0.3867 => 0.3688, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -4.63% (15.2527 => 14.5469, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.51% (0.5168 => 0.4935, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -4.51% (0.4861 => 0.4642, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.48% (1.6474 => 1.5736, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.47% (0.4321 => 0.4128, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.45% (0.4813 => 0.4599, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -4.45% (0.3059 => 0.2923, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -4.39% (4.0594 => 3.8813, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.39% (0.7021 => 0.6713, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.36% (0.6347 => 0.6070, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -4.35% (0.7779 => 0.7441, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: -4.29% (5.0226 => 4.8070, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.28% (0.7524 => 0.7202, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.26% (0.7339 => 0.7026, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.24% (0.9077 => 0.8692, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference-object: -4.24% (0.6441 => 0.6168, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.22% (0.4427 => 0.4240, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.20% (22.4056 => 21.4647, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.19% (0.6395 => 0.6127, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: -4.18% (0.7447 => 0.7136, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: -4.17% (0.3788 => 0.3630, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.15% (0.9557 => 0.9160, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -4.13% (0.3271 => 0.3136, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: -4.11% (0.4524 => 0.4338, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -4.10% (0.8418 => 0.8073, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.10% (0.6395 => 0.6133, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.09% (0.5569 => 0.5341, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.03% (0.5329 => 0.5114, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -4.03% (2.4021 => 2.3054, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: -3.97% (0.6750 => 0.6482, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -3.92% (2.1401 => 2.0562, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.91% (2.2587 => 2.1703, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.81% (0.5567 => 0.5355, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -3.76% (34.0927 => 32.8119, std.dev.: 0.0112) MultiSource/Applications/hbd/hbd: -3.70% (1.5610 => 1.5032, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -3.67% (0.7982 => 0.7689, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: -3.39% (18.2933 => 17.6723, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.80% (5.4682 => 5.3152, std.dev.: 0.0172) SingleSource/UnitTests/Vector/constpool: -2.53% (20.7746 => 20.2487, std.dev.: 0.0083) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7529, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/richards_benchmark: -8.74% (1.2842 => 1.1720, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.83% (1.7753 => 1.7073, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.75% (2.2633 => 2.1784, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.68% (1.3096 => 1.2745, std.dev.: 0.0130) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4695, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.01% (1.6086 => 1.5924, std.dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 20:28:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 22:28:44 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121126042844.93C702A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6253?compare_to=6248&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6253, Order: 168576, Start Time: 2012-11-26 02:09:41, End Time: 2012-11-26 04:29:12 To: 6248, Order: 168571, Start Time: 2012-11-25 22:50:33, End Time: 2012-11-26 01:09:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 77 (185 on baseline) Performance Improvements: 26 (40 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 983 (660 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 15.03% (0.6207 => 0.7140, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.56% (0.6921 => 0.7929, std.dev.: 0.0194) MultiSource/Applications/siod/siod: 14.47% (2.6198 => 2.9990, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 14.40% (0.7868 => 0.9001, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.34% (0.5921 => 0.6770, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 14.29% (0.6436 => 0.7356, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.29% (0.5780 => 0.6606, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.97% (0.6237 => 0.7108, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 13.67% (0.6153 => 0.6994, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.63% (0.6676 => 0.7586, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 13.62% (0.6183 => 0.7025, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.59% (0.8089 => 0.9188, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 12.75% (0.3702 => 0.4174, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 11.90% (0.7194 => 0.8050, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/random: 11.86% (0.3061 => 0.3424, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.83% (2.2718 => 2.5405, std.dev.: 0.0179) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.76% (0.2236 => 0.2499, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/18-imp/imp: 11.48% (0.3886 => 0.4332, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: 11.41% (0.3347 => 0.3729, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.40% (0.3913 => 0.4359, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 11.32% (1.5675 => 1.7450, std.dev.: 0.0128) MultiSource/Benchmarks/Olden/em3d/em3d: 10.50% (0.1971 => 0.2178, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/BoolLiteralTest: 10.50% (0.3982 => 0.4400, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.39% (1.7445 => 1.9258, std.dev.: 0.0225) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.87% (0.1713 => 0.1882, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.84% (4.8324 => 5.3078, std.dev.: 0.0524) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.60% (0.6291 => 0.6895, std.dev.: 0.0129) MultiSource/Applications/hbd/hbd: 9.58% (1.7380 => 1.9045, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.33% (0.6364 => 0.6958, std.dev.: 0.0089) MultiSource/Applications/hexxagon/hexxagon: 9.17% (1.3945 => 1.5224, std.dev.: 0.0224) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.02% (0.5930 => 0.6465, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.95% (0.1531 => 0.1668, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.80% (6.0845 => 6.6202, std.dev.: 0.1643) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.73% (0.4607 => 0.5009, std.dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.59% (0.7170 => 0.7786, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/football/football: 8.41% (0.9875 => 1.0705, std.dev.: 0.0135) MultiSource/Applications/JM/ldecod/ldecod: 8.36% (9.3765 => 10.1600, std.dev.: 0.0478) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.18% (0.3339 => 0.3612, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.79% (0.4479 => 0.4828, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.4016 => 0.4325, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.62% (4.3780 => 4.7117, std.dev.: 0.0862) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.32% (0.5038 => 0.5407, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.31% (0.4035 => 0.4330, std.dev.: 0.0097) MultiSource/Applications/lua/lua: 7.23% (4.5981 => 4.9307, std.dev.: 0.0382) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.14% (0.4342 => 0.4652, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/objinst: 6.74% (0.3533 => 0.3771, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 5.17% (0.3907 => 0.4109, std.dev.: 0.0065) SingleSource/UnitTests/ObjC/exceptions: 5.14% (0.4280 => 0.4500, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.11% (0.3973 => 0.4176, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.85% (0.3237 => 0.3394, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.85% (0.3363 => 0.3526, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.60% (1.2271 => 1.2835, std.dev.: 0.0214) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.59% (0.3962 => 0.4144, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.13% (0.6102 => 0.6354, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/for-in: 3.93% (0.4119 => 0.4281, std.dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 3.61% (0.3742 => 0.3877, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/moments: 3.28% (0.4820 => 0.4978, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 28.16% (1.3169 => 1.6877, std.dev.: 0.0276) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 27.86% (14.4328 => 18.4531, std.dev.: 0.2251) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.73% (1.5565 => 1.9414, std.dev.: 0.0254) MultiSource/Applications/JM/ldecod/ldecod: 21.93% (0.1213 => 0.1479, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 13.98% (8.6268 => 9.8324, std.dev.: 0.0917) SingleSource/Benchmarks/Shootout/ary3: 12.49% (4.3433 => 4.8858, std.dev.: 0.1055) MultiSource/Benchmarks/Olden/mst/mst: 7.67% (0.1316 => 0.1417, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: 6.98% (1.9570 => 2.0936, std.dev.: 0.0155) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 6.06% (0.5278 => 0.5598, std.dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/huffbench: 3.87% (18.6942 => 19.4180, std.dev.: 0.1241) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.70% (6.1294 => 6.3563, std.dev.: 0.0778) SingleSource/Benchmarks/Misc/ffbench: 3.50% (1.0330 => 1.0692, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.95% (5.4773 => 5.6390, std.dev.: 0.0295) MultiSource/Benchmarks/Olden/em3d/em3d: 2.41% (3.1096 => 3.1845, std.dev.: 0.0117) SingleSource/Benchmarks/Dhrystone/fldry: 2.21% (1.9372 => 1.9801, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.70% (3.7663 => 3.8305, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.65% (5.3659 => 5.4547, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.31% (4.9598 => 5.0247, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.27% (4.0948 => 4.1470, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/hash2: 1.27% (3.6104 => 3.6563, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/treecc/treecc: -11.32% (2.5880 => 2.2951, std.dev.: 0.0506) SingleSource/Benchmarks/McGill/exptree: -10.33% (0.1036 => 0.0929, std.dev.: 0.0003) SingleSource/Benchmarks/LivermoreLoops/kernel15: -10.23% (0.1320 => 0.1185, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: -10.01% (0.9104 => 0.8193, std.dev.: 0.0237) SingleSource/Benchmarks/LivermoreLoops/kernel17: -9.56% (0.1119 => 0.1012, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -9.15% (0.8046 => 0.7310, std.dev.: 0.0002) SingleSource/Benchmarks/LivermoreLoops/kernel16: -8.34% (0.1235 => 0.1132, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -8.25% (0.2630 => 0.2413, std.dev.: 0.0080) MultiSource/Benchmarks/PAQ8p/paq8p: -8.07% (11.7759 => 10.8253, std.dev.: 0.1963) SingleSource/Benchmarks/LivermoreLoops/kernel18: -7.84% (0.1608 => 0.1482, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: -7.58% (0.2136 => 0.1974, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.45% (0.2759 => 0.2581, std.dev.: 0.0066) SingleSource/UnitTests/ObjC++/property-reference: -4.59% (0.8427 => 0.8040, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.21% (1.8791 => 1.8000, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.74% (0.6693 => 0.6443, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -3.67% (0.6898 => 0.6645, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/Hello: -3.64% (0.6763 => 0.6517, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -3.23% (12.3845 => 11.9844, std.dev.: 0.1505) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -10.34% (4.2441 => 3.8053, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: -8.44% (1.3273 => 1.2153, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -7.19% (5.7929 => 5.3763, std.dev.: 0.1397) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.16% (33.0025 => 31.6300, std.dev.: 0.4183) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -2.95% (1.6012 => 1.5540, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.90% (61.7955 => 60.6206, std.dev.: 0.2445) SingleSource/Benchmarks/LivermoreLoops/kernel14: -1.36% (1.5758 => 1.5543, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -1.34% (49.4379 => 48.7733, std.dev.: 0.2161) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.80% (70.0171 => 69.4544, std.dev.: 0.2164) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -1.76% (0.1362 => 0.1338, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.12% (0.0437 => 0.0419, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0652 => 0.0653, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 0.02% (493.9387 => 494.0193, std.dev.: 0.2149) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.82% (63.2438 => 69.4544, std.dev.: 0.2164) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0419, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43707.69% (1.1277 => 494.0193, std.dev.: 0.2149) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.15% (0.5229 => 1.5381, std.dev.: 0.1140) MultiSource/Applications/SPASS/SPASS: 22.67% (14.9895 => 18.3873, std.dev.: 0.3224) MultiSource/Applications/kimwitu++/kc: 47.33% (14.1553 => 20.8552, std.dev.: 0.6245) MultiSource/Benchmarks/MallocBench/gs/gs: 21.80% (4.1105 => 5.0067, std.dev.: 0.1610) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.87% (1.1048 => 1.5121, std.dev.: 0.0731) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 431.08% (7.1582 => 38.0157, std.dev.: 0.2888) SingleSource/Benchmarks/Misc-C++-EH/spirit: 91.18% (3.4629 => 6.6202, std.dev.: 0.1643) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.57% (0.6222 => 1.0364, std.dev.: 0.0711) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10560.56% (0.0720 => 7.6756, std.dev.: 0.2150) MultiSource/Applications/SIBsim4/SIBsim4: 3860300.00% (0.0001 => 3.8604, std.dev.: 0.0365) MultiSource/Applications/SPASS/SPASS: 12176100.00% (0.0001 => 12.1762, std.dev.: 1.3797) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576700.00% (0.0001 => 0.5768, std.dev.: 0.0194) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10071200.00% (0.0001 => 10.0713, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6736700.00% (0.0001 => 6.7368, std.dev.: 0.4395) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1799.57% (1.1194 => 21.2638, std.dev.: 0.4433) MultiSource/Applications/ClamAV/clamscan: 70.31% (22.1758 => 37.7687, std.dev.: 0.3425) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 58.12% (7.0540 => 11.1536, std.dev.: 0.2144) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.45% (2.9384 => 4.5972, std.dev.: 0.2575) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.30% (8.1363 => 11.9844, std.dev.: 0.1505) MultiSource/Applications/JM/lencod/lencod: 46.84% (21.9371 => 32.2133, std.dev.: 0.0492) MultiSource/Benchmarks/FreeBench/distray/distray: 44.79% (0.1056 => 0.1529, std.dev.: 0.0039) SingleSource/UnitTests/vla: 38.87% (0.0355 => 0.0493, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 38.22% (0.0730 => 0.1009, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 37.85% (0.1432 => 0.1974, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 32.64% (0.0527 => 0.0699, std.dev.: 0.0023) MultiSource/Applications/siod/siod: 30.57% (2.2969 => 2.9990, std.dev.: 0.0084) MultiSource/Applications/aha/aha: 30.15% (0.1151 => 0.1498, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/dot-syntax-1: 29.65% (0.0479 => 0.0621, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 29.05% (0.0871 => 0.1124, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 28.81% (0.1940 => 0.2499, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/em3d/em3d: 28.50% (0.1695 => 0.2178, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/messages-2: 28.40% (0.0662 => 0.0850, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 27.33% (3.8723 => 4.9307, std.dev.: 0.0382) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.21% (0.0408 => 0.0519, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 26.68% (0.3441 => 0.4359, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 26.57% (0.5020 => 0.6354, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/18-imp/imp: 26.56% (0.3423 => 0.4332, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 26.37% (0.1695 => 0.2142, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash: 25.83% (0.4289 => 0.5397, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout/hash: 25.77% (0.0485 => 0.0610, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 25.59% (0.0719 => 0.0903, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 25.45% (0.0672 => 0.0843, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/family/family: 25.19% (0.0397 => 0.0497, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.05% (0.0479 => 0.0599, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 24.94% (0.5569 => 0.6958, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 24.93% (1.5415 => 1.9258, std.dev.: 0.0225) SingleSource/Benchmarks/Shootout-C++/lists: 24.90% (0.3422 => 0.4274, std.dev.: 0.0170) MultiSource/Benchmarks/Olden/mst/mst: 24.76% (0.1163 => 0.1451, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.76% (0.1337 => 0.1668, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 24.70% (0.3109 => 0.3877, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ks/ks: 24.64% (0.1510 => 0.1882, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 24.46% (4.2646 => 5.3078, std.dev.: 0.0524) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 24.24% (0.0528 => 0.0656, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.16% (0.0770 => 0.0956, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 23.64% (0.4620 => 0.5712, std.dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.59% (0.0746 => 0.0922, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/Oscar: 23.58% (0.0636 => 0.0786, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.01% (1.4186 => 1.7450, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/hello: 22.99% (0.2714 => 0.3338, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/moments: 22.97% (0.4048 => 0.4978, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/city/city: 22.94% (2.0665 => 2.5405, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/heapsort: 22.77% (0.2872 => 0.3526, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 22.47% (0.2554 => 0.3128, std.dev.: 0.0220) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 22.46% (0.0953 => 0.1167, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 22.31% (0.1125 => 0.1376, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/random: 22.20% (0.2802 => 0.3424, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 22.08% (0.4103 => 0.5009, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C++/life/life: 22.08% (0.0933 => 0.1139, std.dev.: 0.0028) MultiSource/Applications/hbd/hbd: 22.06% (1.5603 => 1.9045, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 21.80% (0.3427 => 0.4174, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.54% (0.2758 => 0.3352, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/nestedloop: 21.52% (0.2793 => 0.3394, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 21.05% (3.8922 => 4.7117, std.dev.: 0.0862) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.77% (0.1584 => 0.1913, std.dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 20.71% (0.6450 => 0.7786, std.dev.: 0.0105) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.68% (0.0793 => 0.0957, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/tsp/tsp: 20.68% (0.1175 => 0.1418, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/bh/bh: 20.60% (0.3092 => 0.3729, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 20.44% (0.3131 => 0.3771, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 20.36% (0.3865 => 0.4652, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/fbench: 20.10% (0.0592 => 0.0711, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sieve: 20.04% (0.3603 => 0.4325, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/football/football: 20.00% (0.8921 => 1.0705, std.dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 19.81% (0.6675 => 0.7997, std.dev.: 0.0317) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 19.17% (0.0798 => 0.0951, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.07% (0.2700 => 0.3215, std.dev.: 0.0192) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.85% (0.1029 => 0.1223, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 18.80% (0.4064 => 0.4828, std.dev.: 0.0089) MultiSource/Applications/Burg/burg: 18.77% (1.1642 => 1.3827, std.dev.: 0.0599) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 18.75% (0.0640 => 0.0760, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 18.63% (0.3650 => 0.4330, std.dev.: 0.0097) MultiSource/Applications/hexxagon/hexxagon: 18.55% (1.2842 => 1.5224, std.dev.: 0.0224) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.47% (0.0704 => 0.0834, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.09% (14.3668 => 16.9664, std.dev.: 0.3202) SingleSource/Benchmarks/Misc/whetstone: 18.03% (0.0660 => 0.0779, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 18.02% (0.5981 => 0.7059, std.dev.: 0.0134) SingleSource/UnitTests/ObjC/exceptions: 17.55% (0.3828 => 0.4500, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/exceptions-2: 17.50% (0.3497 => 0.4109, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.46% (0.0842 => 0.0989, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.16% (0.8172 => 0.9574, std.dev.: 0.0407) MultiSource/Applications/d/make_dparser: 17.07% (3.3354 => 3.9049, std.dev.: 0.1421) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.96% (0.3543 => 0.4144, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 16.77% (0.0626 => 0.0731, std.dev.: 0.0030) SingleSource/UnitTests/SignlessTypes/rem: 16.70% (0.1144 => 0.1335, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-4: 16.68% (0.3543 => 0.4134, std.dev.: 0.0065) SingleSource/UnitTests/ObjC/exceptions-3: 16.55% (0.3516 => 0.4098, std.dev.: 0.0080) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.90% (0.0648 => 0.0751, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: 15.89% (0.3694 => 0.4281, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.84% (0.0770 => 0.0892, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/matrix: 15.77% (0.0818 => 0.0947, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 15.74% (0.1906 => 0.2206, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.35% (0.0834 => 0.0962, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.31% (0.1117 => 0.1288, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.21% (0.0730 => 0.0841, std.dev.: 0.0032) MultiSource/Applications/viterbi/viterbi: 15.18% (0.1555 => 0.1791, std.dev.: 0.0039) MultiSource/Applications/minisat/minisat: 15.15% (0.7115 => 0.8193, std.dev.: 0.0237) MultiSource/Applications/spiff/spiff: 14.77% (0.7835 => 0.8992, std.dev.: 0.0408) SingleSource/Benchmarks/Misc/ffbench: 14.75% (0.0705 => 0.0809, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.64% (0.8067 => 0.9248, std.dev.: 0.0355) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.52% (0.2107 => 0.2413, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.30% (0.3307 => 0.3780, std.dev.: 0.0132) MultiSource/Applications/sqlite3/sqlite3: 14.15% (17.1811 => 19.6116, std.dev.: 0.5894) SingleSource/Benchmarks/McGill/exptree: 14.13% (0.0814 => 0.0929, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.00% (5.0018 => 5.7022, std.dev.: 0.1563) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.86% (0.5860 => 0.6672, std.dev.: 0.0278) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.84% (0.1062 => 0.1209, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.81% (0.9765 => 1.1114, std.dev.: 0.0482) SingleSource/Benchmarks/McGill/chomp: 13.78% (0.1655 => 0.1883, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 13.69% (0.3177 => 0.3612, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.65% (0.2271 => 0.2581, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 13.50% (1.5859 => 1.8000, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 13.28% (9.4845 => 10.7444, std.dev.: 0.4614) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 13.28% (2.2024 => 2.4948, std.dev.: 0.0987) SingleSource/Benchmarks/Misc-C++/bigfib: 13.23% (0.6456 => 0.7310, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 13.21% (2.0273 => 2.2951, std.dev.: 0.0506) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.37% (0.4203 => 0.4723, std.dev.: 0.0185) SingleSource/UnitTests/ObjC/trivial-interface: 12.21% (0.3473 => 0.3897, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.17% (0.3927 => 0.4405, std.dev.: 0.0115) SingleSource/UnitTests/ObjC/property: 12.09% (0.3886 => 0.4356, std.dev.: 0.0102) SingleSource/UnitTests/ObjC/synchronized: 11.88% (0.3561 => 0.3984, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/lists1: 11.13% (0.3684 => 0.4094, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.82% (0.4879 => 0.5407, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.78% (0.1892 => 0.2096, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ary2: 10.21% (0.3379 => 0.3724, std.dev.: 0.0123) SingleSource/UnitTests/ObjC++/property-reference-object: 10.20% (0.6030 => 0.6645, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.13% (0.2891 => 0.3184, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/ary: 10.02% (0.3232 => 0.3556, std.dev.: 0.0125) SingleSource/UnitTests/ObjC++/Hello: 9.99% (0.5925 => 0.6517, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 9.93% (0.3283 => 0.3609, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wc: 9.90% (0.3052 => 0.3354, std.dev.: 0.0100) SingleSource/Benchmarks/Stanford/Puzzle: 9.86% (0.1268 => 0.1393, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/matrix: 9.75% (0.3098 => 0.3400, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 9.75% (0.7326 => 0.8040, std.dev.: 0.0095) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.41% (0.3817 => 0.4176, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/oourafft: 8.84% (0.3282 => 0.3572, std.dev.: 0.0095) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.81% (4.3953 => 11.0239, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/methcall: 147.67% (5.3999 => 13.3740, std.dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 37.32% (13.4384 => 18.4531, std.dev.: 0.2251) SingleSource/Benchmarks/Shootout/ary3: 32.07% (3.6994 => 4.8858, std.dev.: 0.1055) MultiSource/Benchmarks/Ptrdist/ft/ft: 31.46% (1.2838 => 1.6877, std.dev.: 0.0276) MultiSource/Benchmarks/VersaBench/dbms/dbms: 28.69% (1.5086 => 1.9414, std.dev.: 0.0254) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 23.64% (1.3045 => 1.6129, std.dev.: 0.0264) SingleSource/Benchmarks/Shootout-C++/moments: 18.98% (0.1159 => 0.1379, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/oourafft: 17.44% (6.6465 => 7.8059, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.69% (1.1145 => 1.3005, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/hash2: 15.79% (3.1578 => 3.6563, std.dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 13.94% (0.1298 => 0.1479, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.01% (0.2944 => 0.3327, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/heapsort: 12.98% (3.8532 => 4.3533, std.dev.: 0.1545) SingleSource/Benchmarks/BenchmarkGame/puzzle: 12.96% (0.6962 => 0.7864, std.dev.: 0.0339) SingleSource/Benchmarks/Misc/ffbench: 12.49% (0.9505 => 1.0692, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.65% (2.8904 => 3.2272, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/mst/mst: 10.27% (0.1285 => 0.1417, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: 10.20% (1.1396 => 1.2558, std.dev.: 0.0022) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 9.27% (0.7455 => 0.8146, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.26% (1.7254 => 1.8851, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: 7.89% (1.9405 => 2.0936, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout/hash: 6.17% (4.9088 => 5.2118, std.dev.: 0.1083) MultiSource/Applications/lua/lua: 5.96% (26.0924 => 27.6481, std.dev.: 0.1003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.58% (4.2280 => 4.4639, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.25% (3.6395 => 3.8305, std.dev.: 0.0153) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.13% (11.6436 => 12.1241, std.dev.: 0.0167) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.32% (0.4162 => 0.4300, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.05% (0.6223 => 0.6413, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 2.65% (3.1023 => 3.1845, std.dev.: 0.0117) SingleSource/Benchmarks/Dhrystone/dry: 2.45% (2.4116 => 2.4708, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary3: 2.24% (3.7221 => 3.8053, std.dev.: 0.0051) MultiSource/Benchmarks/PAQ8p/paq8p: 2.18% (85.0658 => 86.9205, std.dev.: 0.0532) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.15% (1.3677 => 1.3971, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 2.10% (3.1595 => 3.2259, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 1.37% (27.8444 => 28.2252, std.dev.: 0.0524) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.27% (6.5088 => 6.5913, std.dev.: 0.0126) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0313 => 1.0441, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0505, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.13% (5.2139 => 5.2727, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.38% (6.6874 => 0.1750, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.67% (5.2763 => 1.2835, std.dev.: 0.0214) SingleSource/Benchmarks/Misc/salsa20: -74.48% (0.8651 => 0.2208, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/richards_benchmark: -38.96% (0.1622 => 0.0990, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.76% (5.3855 => 4.6981, std.dev.: 0.1283) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.95% (5.3526 => 4.7128, std.dev.: 0.1417) MultiSource/Applications/JM/ldecod/ldecod: -2.65% (10.4361 => 10.1600, std.dev.: 0.0478) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.31% (0.3987 => 0.2380, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.29% (4.5009 => 2.7777, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.18% (2.6546 => 2.0126, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: -19.39% (0.2161 => 0.1742, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.68% (1.6925 => 1.4271, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.69% (2.6778 => 2.2845, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.74% (32.5116 => 29.0213, std.dev.: 0.0282) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -10.23% (9.5636 => 8.5849, std.dev.: 0.1819) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4245, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.2416 => 3.0209, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.17% (0.2497 => 0.2368, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5061, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.65% (1.6805 => 1.6023, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout/lists: -4.08% (6.2999 => 6.0426, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.34% (0.9957 => 0.9624, std.dev.: 0.0091) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8916, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.72% (0.4808 => 0.4677, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.66% (19.9488 => 19.4180, std.dev.: 0.1241) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.90% (8.1563 => 8.0014, std.dev.: 0.0165) SingleSource/Benchmarks/McGill/chomp: -1.78% (1.2373 => 1.2153, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6769, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -1.54% (10.2830 => 10.1243, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.14% (0.2116 => 0.0653, std.dev.: 0.0012) Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 21:16:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 25 Nov 2012 23:16:52 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121126051652.109432A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6254?compare_to=6247&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6254, Order: 168576, Start Time: 2012-11-26 01:56:43, End Time: 2012-11-26 05:17:22 To: 6247, Order: 168571, Start Time: 2012-11-25 21:47:41, End Time: 2012-11-26 01:08:31 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (169 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1089 (722 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.81% (127.1737 => 130.7423, std.dev.: 0.3055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.47% (54.1455 => 54.9402, std.dev.: 0.0374) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: -8.42% (72.2084 => 66.1273, std.dev.: 0.0884) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.80% (0.0625 => 0.0880, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.80% (0.1063 => 0.1401, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.10% (0.2969 => 0.3744, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.32% (0.1106 => 0.1386) MultiSource/Applications/oggenc/oggenc: 25.08% (1.5932 => 1.9928, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.50% (0.4139 => 0.5153, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.38% (0.4253 => 0.5290, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.23% (0.0714 => 0.0887, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.41% (0.4994 => 0.6163, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.37% (0.0475 => 0.0586, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.29% (0.0584 => 0.0720, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.90% (0.5900 => 0.7251, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.46% (0.5000 => 0.6123, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.74% (0.1021 => 0.1243, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.67% (0.1620 => 0.1971, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 21.54% (0.0599 => 0.0728, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.52% (0.0897 => 0.1090, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.05% (0.1107 => 0.1340, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.38% (0.0584 => 0.0703, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.22% (0.0633 => 0.0761, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.22% (0.1103 => 0.1326, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 20.15% (0.0948 => 0.1139, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.94% (0.0642 => 0.0770) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.88% (0.3903 => 0.4679, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.75% (0.1549 => 0.1855, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.74% (0.1003 => 0.1201, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 19.73% (0.0821 => 0.0983, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.51% (0.1604 => 0.1917, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.34% (0.0822 => 0.0981, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: 19.21% (0.0604 => 0.0720, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 19.15% (0.1619 => 0.1929, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.97% (0.2014 => 0.2396, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.81% (0.1462 => 0.1737, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 18.59% (0.0947 => 0.1123, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.33% (0.3890 => 0.4603, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 17.65% (0.1218 => 0.1433, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/mst/mst: 17.62% (0.0698 => 0.0821, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.58% (0.2736 => 0.3217, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 17.54% (0.1505 => 0.1769, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 17.40% (0.4029 => 0.4730, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.21% (1.3152 => 1.5415, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.19% (0.1088 => 0.1275, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 17.18% (0.5826 => 0.6827, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.13% (0.2866 => 0.3357, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 16.93% (0.5889 => 0.6886, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 16.77% (0.5546 => 0.6476, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.57% (0.1968 => 0.2294, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 16.54% (1.8794 => 2.1903, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.48% (0.3271 => 0.3810, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.47% (0.4658 => 0.5425, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.35% (3.5627 => 4.1453, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.22% (0.5026 => 0.5841, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.17% (1.6211 => 1.8833, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.03% (0.1160 => 0.1346, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 15.85% (0.9697 => 1.1234, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/18-imp/imp: 15.76% (0.1421 => 0.1645, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.73% (0.4361 => 0.5047, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 15.57% (1.0781 => 1.2460, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.51% (0.2875 => 0.3321, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.37% (4.4195 => 5.0989, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.27% (0.3930 => 0.4530, std.dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.22% (2.7292 => 3.1446, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: 15.19% (0.1284 => 0.1479, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.08% (0.2738 => 0.3151, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 15.08% (4.2109 => 4.8457, std.dev.: 0.0090) SingleSource/Regression/C++/ofstream_ctor: 14.98% (0.3004 => 0.3454, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 14.91% (0.2750 => 0.3160, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 14.85% (0.7171 => 0.8236, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 14.82% (0.2780 => 0.3192, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 14.81% (0.2823 => 0.3241, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 14.75% (0.2725 => 0.3127, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 14.74% (0.2714 => 0.3114, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.68% (0.2792 => 0.3202, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 14.68% (0.2813 => 0.3226, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.68% (0.1090 => 0.1250, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 14.66% (0.2729 => 0.3129, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 14.59% (0.2811 => 0.3221, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 14.54% (0.9909 => 1.1350, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.50% (0.2911 => 0.3333, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.47% (1.9694 => 2.2543, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.46% (0.3195 => 0.3657, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 14.44% (23.5202 => 26.9162, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/random: 14.41% (0.2803 => 0.3207, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.37% (1.9966 => 2.2836, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.36% (2.0673 => 2.3642, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 14.31% (0.3096 => 0.3539, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary3: 14.17% (0.3267 => 0.3730, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 14.17% (0.2075 => 0.2369, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 14.06% (0.3258 => 0.3716, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 13.99% (0.2566 => 0.2925, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 13.87% (0.3317 => 0.3777, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 13.60% (1.4269 => 1.6209, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.59% (0.3060 => 0.3476, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 13.59% (0.3678 => 0.4178, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.56% (0.3362 => 0.3818, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.41% (0.3124 => 0.3543, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 13.41% (0.3348 => 0.3797, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.32% (0.3282 => 0.3719, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 13.31% (0.3726 => 0.4222, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 13.24% (0.7875 => 0.8918, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.10% (0.3488 => 0.3945, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 13.09% (0.3477 => 0.3932, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.08% (0.3625 => 0.4099, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.96% (0.3981 => 0.4497, std.dev.: 0.0126) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.85% (0.3845 => 0.4339, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash2: 12.84% (0.4251 => 0.4797, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 12.81% (0.4146 => 0.4677, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: 12.71% (0.3446 => 0.3884, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.70% (0.3496 => 0.3940, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.70% (0.3465 => 0.3905, std.dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: 12.69% (2.1653 => 2.4401, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.63% (0.3690 => 0.4156, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.57% (0.3469 => 0.3905, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.55% (0.3442 => 0.3874) SingleSource/UnitTests/ObjC/exceptions-3: 12.54% (0.3460 => 0.3894, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 12.41% (0.3650 => 0.4103, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 12.27% (0.5012 => 0.5627, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 12.22% (4.6177 => 5.1818, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions: 12.19% (0.3643 => 0.4087, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 12.15% (0.2691 => 0.3018, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/parameter-passing: 12.11% (0.3724 => 0.4175, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 12.07% (2.1013 => 2.3549, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.62% (0.2040 => 0.2277, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 11.56% (5.5417 => 6.1821, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.48% (0.1028 => 0.1146, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.36% (0.6435 => 0.7166, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.67% (0.2737 => 0.3029, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 10.61% (0.3498 => 0.3869, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 10.60% (0.6634 => 0.7337, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.51% (0.3084 => 0.3408, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 10.32% (0.4847 => 0.5347, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.27% (0.1383 => 0.1525, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.20% (0.2068 => 0.2279, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 9.83% (0.3336 => 0.3664, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.70% (0.2103 => 0.2307, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 9.45% (0.2391 => 0.2617, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 9.37% (2.0346 => 2.2252, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.89% (4.6926 => 5.1100, std.dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.64% (0.5361 => 0.5824, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.53% (11.6398 => 12.6332, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.11% (0.7426 => 0.8028, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.86% (0.5584 => 0.6023, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 6.48% (11.9555 => 12.7305, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.35% (0.3792 => 0.3919, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 9.71% (0.2802 => 0.3074, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6096, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6676, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1681, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-2: 4.66% (1.8057 => 1.8898, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6383, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.22% (0.3693 => 0.3812, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary3: 2.14% (15.8721 => 16.2112, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.75% (3.1722 => 3.2278, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3027, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2871, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5127, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5390, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5909, std.dev.: 0.0147) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.77% (2.4764 => 2.4077, std.dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.94% (25.4195 => 16.5371, std.dev.: 0.0205) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9791, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7843, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -3.57% (11.2080 => 10.8078, std.dev.: 0.0127) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -2.83% (17.2379 => 16.7501, std.dev.: 0.0586) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.49% (0.6293 => 0.6136, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8642, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5738, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4952, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.30% (5.7935 => 5.7180, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.07% (105.3826 => 104.2513, std.dev.: 0.0351) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0458, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 22:08:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 00:08:50 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121126060850.7D5372A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6255?compare_to=6251&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6255, Order: 168580, Start Time: 2012-11-26 04:38:32, End Time: 2012-11-26 06:09:20 To: 6251, Order: 168577, Start Time: 2012-11-26 02:45:40, End Time: 2012-11-26 04:21:00 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 3 (80 on baseline) Performance Improvements: 41 (25 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1010 (869 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.82% (0.9103 => 0.9269, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.40% (2.0072 => 2.0354, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.04% (1.8688 => 1.8883, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -25.56% (0.0900 => 0.0670, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -18.95% (0.0591 => 0.0479, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -16.11% (0.0838 => 0.0703, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -14.60% (0.0767 => 0.0655, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -8.98% (2.4356 => 2.2169, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.20% (3.4687 => 3.2537, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.56% (0.3400 => 0.3211, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.14% (0.2491 => 0.2363, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.65% (5.7190 => 5.4528, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.27% (0.2954 => 0.2828, std.dev.: 0.0042) MultiSource/Benchmarks/sim/sim: -4.11% (0.3383 => 0.3244, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -3.52% (1.4209 => 1.3709, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/hash: -3.26% (0.3993 => 0.3863, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.10% (0.4845 => 0.4695, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: -2.99% (0.7148 => 0.6934, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.00% (0.9333 => 0.9146, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: -1.84% (1.0208 => 1.0020, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.71% (0.6848 => 0.6731, std.dev.: 0.0022) MultiSource/Applications/siod/siod: -1.32% (2.3173 => 2.2867, std.dev.: 0.0082) MultiSource/Applications/lua/lua: -1.10% (3.9907 => 3.9469, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench: -15.32% (1.7668 => 1.4962, std.dev.: 0.0726) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -13.85% (51.8813 => 44.6975, std.dev.: 0.1659) SingleSource/Benchmarks/Shootout-C++/heapsort: -13.00% (3.4920 => 3.0379, std.dev.: 0.1694) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -7.93% (64.2117 => 59.1216, std.dev.: 0.9054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.60% (3.4105 => 3.1514, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -6.83% (43.6095 => 40.6312, std.dev.: 0.7615) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.62% (23.3440 => 22.0321, std.dev.: 0.0527) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -5.53% (4.2256 => 3.9918, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: -4.51% (4.5471 => 4.3422, std.dev.: 0.0515) SingleSource/Benchmarks/Shootout-C++/except: -4.47% (0.5097 => 0.4869, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.15% (3.0648 => 2.9376, std.dev.: 0.0174) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -3.79% (0.6153 => 0.5920, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.34% (0.4136 => 0.3998, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: -3.30% (0.6446 => 0.6233, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.14% (4.6787 => 4.5318, std.dev.: 0.0294) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -2.86% (2.8323 => 2.7513, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/ffbench: -2.40% (1.4574 => 1.4224, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/bh/bh: -2.26% (2.4188 => 2.3642, std.dev.: 0.0169) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.13% (0.5736 => 0.5614, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.44% (5.9151 => 5.8300, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/whetstone: -1.33% (2.1586 => 2.1298, std.dev.: 0.0029) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.12% (1.0872 => 1.0750, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0219 => 0.0219, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -13.02% (0.0430 => 0.0374, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -25.53% (0.0333 => 0.0248, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.95% (0.0316 => 0.0313, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -6.09% (0.0427 => 0.0401, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: -3.32% (0.0211 => 0.0204) SingleSource/UnitTests/Vector/Altivec/test1: -20.91% (0.0220 => 0.0174, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -1.47% (0.1500 => 0.1478, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -7.93% (1.2011 => 1.1059, std.dev.: 0.0506) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.25% (0.4227 => 0.4132, std.dev.: 0.0200) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.65% (0.1391 => 0.1414, std.dev.: 0.0262) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -12.17% (0.0649 => 0.0570, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.46% (0.0274 => 0.0278, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.45% (0.0592 => 0.0642, std.dev.: 0.0115) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.43% (1.1971 => 1.2023, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -85.71% (0.0007 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.40% (0.0643 => 0.0589, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.39% (0.0244 => 0.0204, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.20% (0.7810 => 0.7794, std.dev.: 0.0046) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 22.64% (0.0053 => 0.0065, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.00% (16.4461 => 17.5968, std.dev.: 0.2862) MultiSource/Applications/sqlite3/sqlite3: 2315.57% (0.6332 => 15.2954, std.dev.: 0.1986) MultiSource/Benchmarks/McCat/08-main/main: 49.10% (0.1831 => 0.2730, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.17% (0.1559 => 0.1494, std.dev.: 0.0247) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7073.62% (0.3123 => 22.4032, std.dev.: 0.9552) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.24% (0.2463 => 0.3725, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1530.62% (0.3344 => 5.4528, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.65% (0.2364 => 0.3254, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 4.93% (0.6010 => 0.6306, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel: 2.10% (0.0429 => 0.0438, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.21% (0.3266 => 0.3436, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/strcat: 4.57% (0.1969 => 0.2059, std.dev.: 0.0017) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.70% (0.0224 => 0.0239, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0471, std.dev.: 0.0035) MultiSource/Applications/oggenc/oggenc: 6.91% (0.1462 => 0.1563, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4591, std.dev.: 0.0115) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0693, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4940, std.dev.: 0.0954) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5189, std.dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.4962, std.dev.: 0.0726) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3127, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1284, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3625, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3994, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0874, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: -24.16% (2.1832 => 1.6557, std.dev.: 0.0031) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.27% (0.0810 => 0.0958, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.23% (0.0773 => 0.0883, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.01% (0.0830 => 0.0938, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 11.96% (0.1112 => 0.1245, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/health/health: 8.83% (0.1347 => 0.1466, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.45% (0.1905 => 0.2047, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/em3d/em3d: 6.74% (0.1721 => 0.1837, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.51% (0.2519 => 0.2683, std.dev.: 0.0027) MultiSource/Applications/Burg/burg: 6.38% (1.2222 => 1.3002, std.dev.: 0.0044) MultiSource/Applications/hbd/hbd: 5.66% (1.4269 => 1.5077, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.49% (0.2240 => 0.2363, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.25% (0.5961 => 0.6274, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.11% (1.2526 => 1.3166, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.07% (1.1606 => 1.2195, std.dev.: 0.0086) MultiSource/Applications/spiff/spiff: 4.99% (0.7950 => 0.8347, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 4.73% (4.1305 => 4.3258, std.dev.: 0.0495) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.68% (0.9435 => 0.9877, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.68% (0.6287 => 0.6581, std.dev.: 0.0063) MultiSource/Applications/sgefa/sgefa: 3.87% (0.2999 => 0.3115, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 3.83% (0.8927 => 0.9269, std.dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: 3.66% (14.2605 => 14.7829, std.dev.: 0.0655) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.61% (1.4479 => 1.5001, std.dev.: 0.0188) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.59% (2.1401 => 2.2169, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 3.48% (1.9948 => 2.0643, std.dev.: 0.0134) MultiSource/Applications/lua/lua: 3.35% (3.8189 => 3.9469, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.24% (1.3279 => 1.3709, std.dev.: 0.0148) MultiSource/Applications/siod/siod: 3.08% (2.2184 => 2.2867, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.03% (0.8340 => 0.8593, std.dev.: 0.0079) MultiSource/Applications/ClamAV/clamscan: 3.01% (14.7684 => 15.2124, std.dev.: 0.1082) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.01% (0.8518 => 0.8774, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.98% (0.4559 => 0.4695, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 2.97% (1.2568 => 1.2941, std.dev.: 0.0122) MultiSource/Applications/d/make_dparser: 2.95% (3.2366 => 3.3321, std.dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.92% (0.6227 => 0.6409, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.85% (1.5315 => 1.5751, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.79% (0.3657 => 0.3759, std.dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 2.72% (6.7320 => 6.9151, std.dev.: 0.0307) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.59% (0.8069 => 0.8278, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.58% (0.5191 => 0.5325, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 2.46% (2.3764 => 2.4348, std.dev.: 0.0141) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.45% (4.5702 => 4.6821, std.dev.: 0.0264) MultiSource/Applications/JM/lencod/lencod: 2.44% (15.3280 => 15.7015, std.dev.: 0.1052) MultiSource/Applications/lambda-0_1_3/lambda: 2.37% (0.7557 => 0.7736, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 2.27% (1.0945 => 1.1193, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.21% (3.1832 => 3.2537, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.20% (0.6586 => 0.6731, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 2.14% (0.9810 => 1.0020, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.68% (0.8995 => 0.9146, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 122.11% (0.0199 => 0.0442, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/pi: 57.12% (1.5795 => 2.4817, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.37% (0.7597 => 0.8841, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.35% (2.9753 => 3.4617, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.71% (2.7995 => 3.2114, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6089, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.05% (1.1857 => 1.2811, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 7.21% (1.7056 => 1.8285, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 6.92% (3.1873 => 3.4080, std.dev.: 0.0222) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.67% (4.7794 => 5.0982, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/richards_benchmark: 6.08% (1.3037 => 1.3830, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.89% (4.5327 => 4.7998, std.dev.: 0.0079) MultiSource/Applications/lambda-0_1_3/lambda: 4.80% (7.4933 => 7.8532, std.dev.: 0.0253) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.75% (3.3761 => 3.5364, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.65% (6.2275 => 6.5171, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.13% (4.9453 => 5.1493, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.05% (4.9469 => 5.1472, std.dev.: 0.0232) MultiSource/Applications/hexxagon/hexxagon: 3.87% (14.0064 => 14.5480, std.dev.: 0.0074) MultiSource/Applications/siod/siod: 2.74% (3.6643 => 3.7647, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.70% (11.5690 => 11.8818, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.49% (8.2783 => 8.4841, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.40% (4.8660 => 4.9828, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout/lists: 2.27% (7.3375 => 7.5038, std.dev.: 0.0285) MultiSource/Benchmarks/llubenchmark/llu: 1.94% (1.9967 => 2.0354, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.58% (1.1365 => 1.1545, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.52% (4.8362 => 4.9097, std.dev.: 0.0193) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.44% (2.4647 => 2.5001, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/power/power: 1.39% (1.2061 => 1.2229, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.20% (1.4205 => 1.4376, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/ReedSolomon: 1.20% (8.5322 => 8.6347, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.18% (3.5679 => 3.6100, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: 1.12% (1.0841 => 1.0962, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.16% (5.4641 => 4.3077, std.dev.: 0.0280) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.91% (7.2130 => 6.2099, std.dev.: 0.1348) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.84% (1.0512 => 0.9372, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: -10.49% (1.1216 => 1.0039, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.05% (14.6451 => 13.3202, std.dev.: 0.3429) MultiSource/Benchmarks/mafft/pairlocalalign: -8.53% (63.1822 => 57.7928, std.dev.: 0.1787) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.88% (4.7482 => 4.4217, std.dev.: 0.0898) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.95% (3.7148 => 3.4937, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.84% (5.4972 => 5.1763, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.10% (5.1557 => 4.8929, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.47% (4.7449 => 4.5330, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.74% (6.0224 => 5.7970, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.32% (0.5807 => 0.5614, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.27% (2.4490 => 2.3690, std.dev.: 0.0169) MultiSource/Applications/lua/lua: -3.20% (29.8330 => 28.8785, std.dev.: 0.0515) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (28.5821 => 27.7007, std.dev.: 0.0801) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.55% (9.9065 => 9.6535, std.dev.: 0.0860) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.41% (2.6356 => 2.5722, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash2: -2.39% (3.4237 => 3.3419, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/mason/mason: -2.27% (0.5415 => 0.5292, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.04% (11.5316 => 11.2964, std.dev.: 0.0874) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.04% (3.2169 => 3.1514, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.58% (4.9994 => 4.9203, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.22% (5.6343 => 5.5653, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.20% (22.2997 => 22.0321, std.dev.: 0.0527) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.76% (1.0262 => 1.0750, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -8.33% (0.0408 => 0.0374, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.36% (0.0254 => 0.0248, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 4.43% (0.0384 => 0.0401, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204) SingleSource/UnitTests/Vector/Altivec/test1: -3.33% (0.0180 => 0.0174, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.78% (0.1438 => 0.1478, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -2.38% (1.1329 => 1.1059, std.dev.: 0.0506) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.77% (0.4164 => 0.4132, std.dev.: 0.0200) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.29% (0.1369 => 0.1414, std.dev.: 0.0262) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.08% (0.0641 => 0.0570, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.56% (0.0195 => 0.0278, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 11.07% (0.0578 => 0.0642, std.dev.: 0.0115) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.12% (1.1437 => 1.2023, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.06% (0.0627 => 0.0589, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 13.33% (0.0180 => 0.0204, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.78% (0.8017 => 0.7794, std.dev.: 0.0046) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 4.84% (0.0062 => 0.0065, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 22:21:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 00:21:02 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121126062102.899DC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6256?compare_to=6252&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6256, Order: 168580, Start Time: 2012-11-26 04:48:08, End Time: 2012-11-26 06:21:33 To: 6252, Order: 168577, Start Time: 2012-11-26 02:51:23, End Time: 2012-11-26 04:24:48 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (178 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (859 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 9.05% (0.3834 => 0.4181, std.dev.: 0.0121) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1007, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/salsa20: 2.55% (7.4937 => 7.6849, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/hash2: 2.25% (3.1932 => 3.2651, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.98% (0.3821 => 0.3516, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -6.86% (2.4924 => 2.3214, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.81% (0.3142 => 0.2928, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.40% (0.3357 => 0.3142, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -6.26% (0.3831 => 0.3591, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -6.22% (0.3812 => 0.3575, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.21% (0.3880 => 0.3639, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.20% (0.9542 => 0.8950, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.18% (0.2428 => 0.2278, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -6.16% (0.2160 => 0.2027, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: -6.13% (0.3848 => 0.3612, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -6.11% (9.2283 => 8.6643, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/synchronized: -6.08% (0.3896 => 0.3659, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.03% (0.6484 => 0.6093, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -6.00% (0.4033 => 0.3791, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.90% (0.1796 => 0.1690, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.89% (0.9852 => 0.9272, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.89% (0.3891 => 0.3662, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -5.84% (0.4176 => 0.3932, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -5.83% (7.0961 => 6.6826, std.dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: -5.82% (16.1920 => 15.2489, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.79% (0.7198 => 0.6781, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.76% (1.3722 => 1.2932, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.65% (4.8161 => 4.5439, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.65% (4.0323 => 3.8045, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.64% (0.3884 => 0.3665, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.61% (0.5705 => 0.5385, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -5.58% (0.9179 => 0.8667, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.55% (0.5857 => 0.5532, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.52% (0.6304 => 0.5956, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.51% (1.0544 => 0.9963, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.51% (0.5863 => 0.5540, std.dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: -5.50% (1.1530 => 1.0896, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.49% (0.5478 => 0.5177, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.49% (0.2695 => 0.2547, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.48% (1.6364 => 1.5467, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: -5.48% (0.4199 => 0.3969, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.48% (4.8802 => 4.6129, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.47% (0.5591 => 0.5285, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.47% (0.5575 => 0.5270, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.47% (6.7716 => 6.4012, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.47% (0.3658 => 0.3458, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.43% (0.6297 => 0.5955, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.43% (0.5802 => 0.5487, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.42% (1.2300 => 1.1633, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.42% (3.5339 => 3.3424, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.41% (0.6230 => 0.5893, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.39% (0.6660 => 0.6301, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.39% (0.5941 => 0.5621, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.39% (0.5849 => 0.5534, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.38% (0.5859 => 0.5544, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.36% (0.5805 => 0.5494, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.35% (4.5069 => 4.2658, std.dev.: 0.0121) MultiSource/Benchmarks/sim/sim: -5.34% (0.3406 => 0.3224, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.32% (0.6446 => 0.6103, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.30% (0.6052 => 0.5731, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.29% (0.6667 => 0.6314, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: -5.29% (0.2871 => 0.2719, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: -5.29% (0.4515 => 0.4276, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.29% (0.5581 => 0.5286, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.28% (0.6293 => 0.5961, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -5.28% (1.1450 => 1.0846, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.27% (14.2083 => 13.4591, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.27% (0.5925 => 0.5613, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.25% (1.4642 => 1.3874, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.23% (0.3057 => 0.2897, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.22% (0.5570 => 0.5279, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.22% (8.0126 => 7.5944, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.21% (0.3016 => 0.2859, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.18% (0.6194 => 0.5873, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.17% (0.2939 => 0.2787, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.17% (0.2903 => 0.2753, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.16% (0.8521 => 0.8081, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.16% (1.2784 => 1.2124, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.15% (1.2221 => 1.1592, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -5.14% (0.4280 => 0.4060, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -5.14% (17.1032 => 16.2248, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.13% (1.2210 => 1.1584, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: -5.12% (0.2849 => 0.2703, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.12% (0.6033 => 0.5724, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -5.12% (0.2989 => 0.2836, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -5.12% (0.3205 => 0.3041, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.11% (0.2933 => 0.2783, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.11% (0.4916 => 0.4665, std.dev.: 0.0021) MultiSource/Applications/SIBsim4/SIBsim4: -5.10% (1.3864 => 1.3157, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.10% (0.5456 => 0.5178, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.09% (0.6681 => 0.6341, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.08% (0.6736 => 0.6394, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.07% (0.3255 => 0.3090, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -5.06% (0.3025 => 0.2872, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -5.06% (1.3148 => 1.2483, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/ary3: -5.05% (0.3446 => 0.3272, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.03% (0.5999 => 0.5697, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.01% (0.5688 => 0.5403, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -5.01% (4.3330 => 4.1159, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/except: -4.99% (0.3026 => 0.2875, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -4.98% (0.3394 => 0.3225, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -4.95% (0.3194 => 0.3036, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.94% (0.6676 => 0.6346, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.94% (0.4151 => 0.3946, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.93% (0.6189 => 0.5884, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.92% (0.2278 => 0.2166, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.91% (0.7919 => 0.7530, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.91% (0.3323 => 0.3160, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.90% (0.2999 => 0.2852, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -4.88% (0.3481 => 0.3311, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.88% (2.1713 => 2.0654, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.88% (0.6440 => 0.6126, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.87% (0.2548 => 0.2424, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.86% (0.2385 => 0.2269, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -4.86% (0.3581 => 0.3407, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.86% (0.3252 => 0.3094, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -4.84% (0.3059 => 0.2911, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.83% (0.3849 => 0.3663, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.82% (0.3837 => 0.3652, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -4.82% (3.5154 => 3.3461, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.81% (0.3931 => 0.3742, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -4.80% (0.4248 => 0.4044, std.dev.: 0.0043) MultiSource/Applications/Burg/burg: -4.79% (1.2515 => 1.1916, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -4.77% (15.5079 => 14.7677, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.77% (0.3483 => 0.3317, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.76% (0.2355 => 0.2243, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: -4.75% (0.4861 => 0.4630, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: -4.74% (0.2659 => 0.2533, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.73% (0.3319 => 0.3162, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -4.73% (0.7447 => 0.7095, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.72% (0.4813 => 0.4586, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -4.70% (15.2527 => 14.5359, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.69% (0.7524 => 0.7171, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.64% (0.6395 => 0.6098, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -4.64% (0.3621 => 0.3453) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.61% (0.7339 => 0.7001, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -4.59% (0.2985 => 0.2848, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.53% (0.4083 => 0.3898, std.dev.: 0.0024) MultiSource/Applications/lua/lua: -4.48% (4.0594 => 3.8774, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.47% (0.5569 => 0.5320, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.43% (1.6474 => 1.5745, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: -4.42% (5.0226 => 4.8008, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.42% (0.7021 => 0.6711, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -4.40% (0.3867 => 0.3697, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.32% (0.5329 => 0.5099, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.29% (0.5567 => 0.5328, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.25% (22.4056 => 21.4538, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.24% (0.9557 => 0.9152, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.21% (0.6395 => 0.6126, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.20% (0.4427 => 0.4241, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.20% (0.5168 => 0.4951, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.20% (0.9077 => 0.8696, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: -4.11% (0.8418 => 0.8072, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: -4.10% (0.6347 => 0.6087, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -4.09% (0.3788 => 0.3633, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.06% (0.7779 => 0.7463, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: -4.06% (2.1401 => 2.0532, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: -4.04% (0.3271 => 0.3139, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -4.01% (0.6441 => 0.6183, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -3.99% (2.4021 => 2.3063, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/bigfib: -3.91% (0.6750 => 0.6486, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: -3.87% (0.4524 => 0.4349, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.84% (2.2587 => 2.1719, std.dev.: 0.0081) MultiSource/Applications/lambda-0_1_3/lambda: -3.78% (0.7982 => 0.7680, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: -3.73% (1.5610 => 1.5027, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.66% (0.4321 => 0.4163, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -3.56% (34.0927 => 32.8779, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.55% (0.3491 => 0.3367, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -3.30% (18.2933 => 17.6896, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.71% (5.4682 => 5.3199, std.dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -2.23% (20.7746 => 20.3105, std.dev.: 0.0161) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7534, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -8.69% (1.2842 => 1.1726, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.68% (2.2633 => 2.1800, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.91% (1.3096 => 1.2715, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4699, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 23:40:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 01:40:52 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121126074052.118872A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6257?compare_to=6253&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6257, Order: 168580, Start Time: 2012-11-26 05:21:20, End Time: 2012-11-26 07:41:21 To: 6253, Order: 168576, Start Time: 2012-11-26 02:09:41, End Time: 2012-11-26 04:29:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 41 (189 on baseline) Performance Improvements: 2 (40 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1043 (656 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01: 12.03% (0.1014 => 0.1136, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.93% (0.1171 => 0.1299, std.dev.: 0.0035) SingleSource/Benchmarks/LivermoreLoops/kernel07: 10.92% (0.1044 => 0.1158, std.dev.: 0.0008) SingleSource/Benchmarks/LivermoreLoops/kernel11: 10.79% (0.1010 => 0.1119, std.dev.: 0.0014) SingleSource/Benchmarks/LivermoreLoops/kernel05: 10.54% (0.1006 => 0.1112, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel06: 10.15% (0.1044 => 0.1150, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 10.06% (0.8992 => 0.9897, std.dev.: 0.0048) SingleSource/Benchmarks/LivermoreLoops/kernel09: 10.00% (0.1060 => 0.1166, std.dev.: 0.0010) SingleSource/Benchmarks/LivermoreLoops/kernel04: 9.99% (0.1061 => 0.1167, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 9.97% (0.3279 => 0.3606, std.dev.: 0.0066) SingleSource/Benchmarks/LivermoreLoops/kernel08: 9.94% (0.1238 => 0.1361, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.44% (2.4948 => 2.7303, std.dev.: 0.0598) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.20% (0.6891 => 0.7525, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.06% (0.6712 => 0.7320, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.00% (0.6611 => 0.7206, std.dev.: 0.0186) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.56% (0.1332 => 0.1446, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.55% (0.6223 => 0.6755, std.dev.: 0.0174) MultiSource/Applications/d/make_dparser: 8.32% (3.9049 => 4.2298, std.dev.: 0.0318) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.24% (0.3630 => 0.3929, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/strcat: 7.53% (0.3121 => 0.3356, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.43% (0.3780 => 0.4061, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/ary: 7.40% (0.3556 => 0.3819, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.30% (0.3028 => 0.3249, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.20% (0.4723 => 0.5063, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.10% (0.4213 => 0.4512, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/wc: 6.74% (0.3354 => 0.3580, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.75% (6.6202 => 7.0010, std.dev.: 0.0610) SingleSource/Benchmarks/Misc/oourafft: 5.66% (0.3572 => 0.3774, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.95% (0.5009 => 0.5257, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.4828 => 0.5049, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.57% (0.4330 => 0.4528, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.45% (4.7117 => 4.9216, std.dev.: 0.0316) MultiSource/Benchmarks/mafft/pairlocalalign: 4.42% (10.7444 => 11.2190, std.dev.: 0.0847) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/SPASS/SPASS: 25.02% (12.1762 => 15.2232, std.dev.: 0.4037) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 9.22% (9.4916 => 10.3664, std.dev.: 0.0307) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 8.59% (0.4214 => 0.4576, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 5.69% (0.3515 => 0.3715, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/hash: 3.29% (5.2118 => 5.3834, std.dev.: 0.0515) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.11% (6.3563 => 6.4903, std.dev.: 0.0450) SingleSource/Benchmarks/Shootout-C++/lists: 1.24% (12.5872 => 12.7439, std.dev.: 0.0447) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.06% (2.1361 => 2.1587, std.dev.: 0.0079) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -1.78% (37.7687 => 37.0959, std.dev.: 0.2347) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -1.99% (27.6481 => 27.0990, std.dev.: 0.2080) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.03% (69.4544 => 69.4762, std.dev.: 0.1844) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.07% (0.1338 => 0.1337, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0419 => 0.0420, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.31% (0.0653 => 0.0651, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -0.35% (494.0193 => 492.2669, std.dev.: 0.9528) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.85% (63.2438 => 69.4762, std.dev.: 0.1844) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43552.29% (1.1277 => 492.2669, std.dev.: 0.9528) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.17% (0.5229 => 1.5382, std.dev.: 0.0558) MultiSource/Applications/SPASS/SPASS: 21.11% (14.9895 => 18.1545, std.dev.: 0.1043) MultiSource/Applications/kimwitu++/kc: 51.28% (14.1553 => 21.4140, std.dev.: 0.4850) MultiSource/Benchmarks/MallocBench/gs/gs: 26.22% (4.1105 => 5.1884, std.dev.: 0.1017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.01% (1.1048 => 1.5137, std.dev.: 0.0758) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 432.25% (7.1582 => 38.0994, std.dev.: 0.2941) SingleSource/Benchmarks/Misc-C++-EH/spirit: 102.17% (3.4629 => 7.0010, std.dev.: 0.0610) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.35% (0.6222 => 1.0350, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10979.03% (0.0720 => 7.9769, std.dev.: 0.1337) MultiSource/Applications/SIBsim4/SIBsim4: 3859400.00% (0.0001 => 3.8595, std.dev.: 0.0120) MultiSource/Applications/SPASS/SPASS: 15223100.00% (0.0001 => 15.2232, std.dev.: 0.4037) MultiSource/Applications/kimwitu++/kc: 51700.00% (0.0001 => 0.0518, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 597500.00% (0.0001 => 0.5976, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10074500.00% (0.0001 => 10.0746, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5677100.00% (0.0001 => 5.6772, std.dev.: 0.5396) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1720.01% (1.1194 => 20.3732, std.dev.: 0.6976) MultiSource/Applications/ClamAV/clamscan: 67.28% (22.1758 => 37.0959, std.dev.: 0.2347) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 61.24% (7.0540 => 11.3742, std.dev.: 0.0872) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.21% (2.9384 => 4.6195, std.dev.: 0.2566) MultiSource/Applications/JM/lencod/lencod: 46.55% (21.9371 => 32.1499, std.dev.: 0.0406) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 45.61% (8.1363 => 11.8469, std.dev.: 0.1587) MultiSource/Benchmarks/FreeBench/distray/distray: 44.98% (0.1056 => 0.1531, std.dev.: 0.0060) SingleSource/UnitTests/vla: 43.66% (0.0355 => 0.0510, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 38.62% (0.1432 => 0.1985, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/almabench: 37.95% (0.0730 => 0.1007, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/dot-syntax-1: 31.11% (0.0479 => 0.0628, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/family/family: 30.73% (0.0397 => 0.0519, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: 28.47% (0.0871 => 0.1119, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 28.13% (0.4103 => 0.5257, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 27.98% (0.0672 => 0.0860, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/hash: 27.42% (0.0485 => 0.0618, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 27.38% (0.3441 => 0.4383, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 26.82% (3.3354 => 4.2298, std.dev.: 0.0318) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 26.70% (0.0528 => 0.0669, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 26.60% (0.3865 => 0.4893, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.45% (3.8922 => 4.9216, std.dev.: 0.0316) MultiSource/Applications/spiff/spiff: 26.32% (0.7835 => 0.9897, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/lists: 26.20% (0.0626 => 0.0790, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 25.95% (0.3603 => 0.4538, std.dev.: 0.0172) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 25.79% (0.0442 => 0.0556, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 25.63% (0.3422 => 0.4299, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/functionobjects: 25.58% (0.5020 => 0.6304, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/em3d/em3d: 25.37% (0.1695 => 0.2125, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.05% (0.0479 => 0.0599, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/moments: 24.68% (0.4048 => 0.5047, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 24.26% (0.3162 => 0.3929, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/ray: 24.24% (0.4064 => 0.5049, std.dev.: 0.0019) SingleSource/Regression/C++/ofstream_ctor: 24.13% (0.2905 => 0.3606, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.13% (0.0746 => 0.0926, std.dev.: 0.0043) SingleSource/Benchmarks/Stanford/Oscar: 24.06% (0.0636 => 0.0789, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 24.05% (0.3650 => 0.4528, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 23.97% (2.2024 => 2.7303, std.dev.: 0.0598) SingleSource/Benchmarks/Shootout-C++/nestedloop: 23.95% (0.2793 => 0.3462, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/heapsort: 23.71% (0.2872 => 0.3553, std.dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 23.64% (0.1125 => 0.1391, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/football/football: 23.13% (0.8921 => 1.0984, std.dev.: 0.0266) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.03% (0.1029 => 0.1266, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 23.02% (0.6450 => 0.7935, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/wordfreq: 22.80% (0.3307 => 0.4061, std.dev.: 0.0063) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 22.67% (0.0953 => 0.1169, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/random: 22.66% (0.2802 => 0.3437, std.dev.: 0.0085) MultiSource/Benchmarks/McCat/08-main/main: 22.55% (0.2554 => 0.3130, std.dev.: 0.0113) MultiSource/Benchmarks/Olden/mst/mst: 22.53% (0.1163 => 0.1425, std.dev.: 0.0034) MultiSource/Applications/lua/lua: 22.24% (3.8723 => 4.7335, std.dev.: 0.1346) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 21.97% (0.3427 => 0.4180, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.97% (0.1566 => 0.1910, std.dev.: 0.0055) MultiSource/Benchmarks/BitBench/five11/five11: 21.87% (0.0567 => 0.0691, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hello: 21.37% (0.2714 => 0.3294, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 21.18% (0.5981 => 0.7248, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.17% (0.2758 => 0.3342, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/fbench: 21.11% (0.0592 => 0.0717, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 20.85% (0.1175 => 0.1420, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.81% (0.0793 => 0.0958, std.dev.: 0.0027) SingleSource/UnitTests/SignlessTypes/rem: 20.80% (0.1144 => 0.1382, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 20.77% (0.0491 => 0.0593, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.77% (0.1584 => 0.1913, std.dev.: 0.0058) MultiSource/Applications/viterbi/viterbi: 20.64% (0.1555 => 0.1876, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/life/life: 20.58% (0.0933 => 0.1125, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.48% (0.5860 => 0.7060, std.dev.: 0.0210) SingleSource/Benchmarks/Shootout-C++/spellcheck: 20.46% (0.4203 => 0.5063, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 20.28% (0.8067 => 0.9703, std.dev.: 0.0226) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.42% (0.0834 => 0.0996, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.93% (0.2700 => 0.3211, std.dev.: 0.0182) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.89% (0.0704 => 0.0837, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/whetstone: 18.79% (0.0660 => 0.0784, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 18.54% (0.2831 => 0.3356, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/objinst: 18.43% (0.3131 => 0.3708, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.30% (4.2646 => 5.0449, std.dev.: 0.1809) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.29% (0.0842 => 0.0996, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 18.29% (9.4845 => 11.2190, std.dev.: 0.0847) SingleSource/Benchmarks/Shootout-C++/ary: 18.16% (0.3232 => 0.3819, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/exceptions: 17.97% (0.3828 => 0.4516, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 17.97% (0.0640 => 0.0755, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.89% (0.2756 => 0.3249, std.dev.: 0.0053) SingleSource/UnitTests/SignlessTypes/Large/cast: 17.73% (0.0564 => 0.0664, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.69% (1.4186 => 1.6695, std.dev.: 0.0391) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.63% (0.2065 => 0.2429, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-2: 17.53% (0.3497 => 0.4110, std.dev.: 0.0078) SingleSource/UnitTests/ObjC/instance-method-metadata: 17.50% (0.3543 => 0.4163, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/exceptions-3: 17.49% (0.3516 => 0.4131, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 17.47% (0.1906 => 0.2239, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.46% (14.3668 => 16.8752, std.dev.: 0.2575) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 17.42% (0.0838 => 0.0984, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.39% (0.8172 => 0.9593, std.dev.: 0.0344) SingleSource/UnitTests/ObjC/exceptions-4: 17.39% (0.3543 => 0.4159, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/wc: 17.30% (0.3052 => 0.3580, std.dev.: 0.0067) MultiSource/Applications/hbd/hbd: 17.23% (1.5603 => 1.8291, std.dev.: 0.0419) MultiSource/Benchmarks/McCat/17-bintr/bintr: 17.04% (0.0675 => 0.0790, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 16.70% (1.2842 => 1.4986, std.dev.: 0.0423) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 16.61% (0.1114 => 0.1299, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/for-in: 16.51% (0.3694 => 0.4304, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 16.46% (0.2430 => 0.2830, std.dev.: 0.0133) MultiSource/Applications/sqlite3/sqlite3: 16.40% (17.1811 => 19.9980, std.dev.: 0.5049) MultiSource/Benchmarks/Olden/bisort/bisort: 16.29% (0.0614 => 0.0714, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.20% (0.0648 => 0.0753, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.10% (0.0770 => 0.0894, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.80% (0.0886 => 0.1026, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/matrix: 15.77% (0.0818 => 0.0947, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.58% (0.0770 => 0.0890, std.dev.: 0.0035) MultiSource/Applications/treecc/treecc: 15.58% (2.0273 => 2.3431, std.dev.: 0.0620) MultiSource/Applications/Burg/burg: 15.49% (1.1642 => 1.3445, std.dev.: 0.0214) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.31% (0.1117 => 0.1288, std.dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: 15.30% (0.0719 => 0.0829, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.21% (0.0730 => 0.0841, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/ffbench: 15.18% (0.0705 => 0.0812, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 15.08% (0.7115 => 0.8188, std.dev.: 0.0300) MultiSource/Applications/lambda-0_1_3/lambda: 15.05% (0.7433 => 0.8552, std.dev.: 0.0346) SingleSource/Benchmarks/Misc/oourafft: 14.99% (0.3282 => 0.3774, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/chomp: 14.86% (0.1655 => 0.1901, std.dev.: 0.0068) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.77% (0.3121 => 0.3582, std.dev.: 0.0142) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.76% (0.2107 => 0.2418, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.66% (0.3935 => 0.4512, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.66% (0.1337 => 0.1533, std.dev.: 0.0069) SingleSource/Benchmarks/McGill/exptree: 14.37% (0.0814 => 0.0931, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.16% (0.1236 => 0.1411, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.14% (0.9765 => 1.1146, std.dev.: 0.0455) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.12% (0.1062 => 0.1212, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 14.05% (0.5105 => 0.5822, std.dev.: 0.0214) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.00% (0.2271 => 0.2589, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/18-imp/imp: 13.99% (0.3423 => 0.3902, std.dev.: 0.0176) SingleSource/Benchmarks/Shootout-C++/sumcol: 13.56% (0.2891 => 0.3283, std.dev.: 0.0128) MultiSource/Applications/oggenc/oggenc: 13.50% (5.7591 => 6.5363, std.dev.: 0.2000) SingleSource/UnitTests/ObjC/parameter-passing: 13.14% (0.3927 => 0.4443, std.dev.: 0.0178) SingleSource/Benchmarks/Misc-C++/bigfib: 13.14% (0.6456 => 0.7304, std.dev.: 0.0270) SingleSource/UnitTests/ObjC/property: 12.66% (0.3886 => 0.4378, std.dev.: 0.0171) SingleSource/UnitTests/ObjC/trivial-interface: 12.27% (0.3473 => 0.3899, std.dev.: 0.0124) SingleSource/UnitTests/ObjC/synchronized: 12.22% (0.3561 => 0.3996, std.dev.: 0.0134) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.84% (0.0929 => 0.1039, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/05-eks/eks: 11.77% (0.4299 => 0.4805, std.dev.: 0.0115) SingleSource/UnitTests/ObjC/block-byref-aggr: 11.74% (0.3817 => 0.4265, std.dev.: 0.0167) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.69% (5.0018 => 5.5867, std.dev.: 0.1249) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.25% (0.4879 => 0.5428, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.14% (0.2603 => 0.2893, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.07% (0.4636 => 0.5149, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.89% (0.1892 => 0.2098, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/ary3: 10.39% (0.3283 => 0.3624, std.dev.: 0.0116) SingleSource/Benchmarks/Stanford/Puzzle: 10.33% (0.1268 => 0.1399, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/neural/neural: 10.32% (0.1463 => 0.1614, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/except: 10.28% (0.2871 => 0.3166, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/matrix: 10.01% (0.3098 => 0.3408, std.dev.: 0.0058) SingleSource/UnitTests/ObjC++/property-reference-object: 9.83% (0.6030 => 0.6623, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/fibo: 9.80% (0.2725 => 0.2992, std.dev.: 0.0102) SingleSource/UnitTests/ObjC++/Hello: 9.70% (0.5925 => 0.6500, std.dev.: 0.0116) SingleSource/UnitTests/ObjC++/property-reference: 9.42% (0.7326 => 0.8016, std.dev.: 0.0194) MultiSource/Benchmarks/Olden/power/power: 7.78% (0.1440 => 0.1552, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/ReedSolomon: 7.37% (0.2049 => 0.2200, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.48% (4.3953 => 11.0095, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/methcall: 147.53% (5.3999 => 13.3665, std.dev.: 0.0049) MultiSource/Benchmarks/llubenchmark/llu: 96.24% (3.7781 => 7.4141, std.dev.: 0.7281) SingleSource/Benchmarks/Shootout/ary3: 25.05% (3.6994 => 4.6261, std.dev.: 0.1635) SingleSource/Benchmarks/Shootout-C++/moments: 23.81% (0.1159 => 0.1435, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/oourafft: 17.43% (6.6465 => 7.8051, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.69% (1.1145 => 1.3005, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.12% (3.8532 => 4.3973, std.dev.: 0.0953) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.91% (0.2944 => 0.3324, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.65% (2.8904 => 3.2272, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 11.63% (0.9505 => 1.0610, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/richards_benchmark: 10.15% (1.1396 => 1.2553, std.dev.: 0.0019) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: 9.67% (4.9088 => 5.3834, std.dev.: 0.0515) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.35% (1.7254 => 1.8868, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 9.13% (3.1578 => 3.4460, std.dev.: 0.1005) MultiSource/Benchmarks/Olden/mst/mst: 8.09% (0.1285 => 0.1389, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.96% (0.9540 => 1.0109, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.91% (4.2280 => 4.4780, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.41% (3.6395 => 3.8363, std.dev.: 0.0134) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 4.99% (1.9405 => 2.0373, std.dev.: 0.0264) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.6436 => 12.1295, std.dev.: 0.0146) MultiSource/Applications/lua/lua: 3.86% (26.0924 => 27.0990, std.dev.: 0.2080) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.27% (2.0360 => 2.1026, std.dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/dry: 2.25% (2.4116 => 2.4658, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 2.07% (3.1595 => 3.2248, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.86% (2.1424 => 2.1822, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/lists: 1.67% (12.5348 => 12.7439, std.dev.: 0.0447) MultiSource/Benchmarks/PAQ8p/paq8p: 1.64% (85.0658 => 86.4634, std.dev.: 0.2942) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (27.8444 => 28.2387, std.dev.: 0.0335) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.38% (6.5088 => 6.5983, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0313 => 1.0440, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.22% (5.2139 => 5.2777, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0503, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.29% (6.6874 => 0.1809, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -75.81% (0.8651 => 0.2093, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.10% (5.2763 => 1.3139, std.dev.: 0.0217) SingleSource/Benchmarks/Misc/richards_benchmark: -44.64% (0.1622 => 0.0898, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.20% (5.3855 => 4.6746, std.dev.: 0.1386) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.99% (5.3526 => 4.8179, std.dev.: 0.0972) MultiSource/Applications/JM/ldecod/ldecod: -6.64% (10.4361 => 9.7436, std.dev.: 0.2109) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.20% (0.0628 => 0.0363, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.33% (0.3987 => 0.2379, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.28% (4.5009 => 2.7781, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.52% (1.1492 => 0.7640, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.12% (2.6546 => 2.0143, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: -19.25% (0.2161 => 0.1745, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4240, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.69% (2.6778 => 2.2843, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.66% (32.5116 => 29.0447, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/mandel-2: -10.65% (1.5373 => 1.3736, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -9.17% (9.5636 => 8.6865, std.dev.: 0.1404) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.05% (1.5660 => 1.4243, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.40% (1.6805 => 1.5393, std.dev.: 0.0309) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.64% (3.2416 => 3.0265, std.dev.: 0.0196) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.12% (1.8329 => 1.7390, std.dev.: 0.0309) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5054, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: -4.47% (6.2999 => 6.0182, std.dev.: 0.0145) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.67% (19.9488 => 19.2175, std.dev.: 0.1688) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8917, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.07% (0.9957 => 0.9651, std.dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.41% (0.4808 => 0.4692, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.91% (8.1563 => 8.0008, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -1.48% (10.2830 => 10.1304, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.97% (0.1485 => 0.1337, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0011) Report Time: 2.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Nov 25 23:55:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 01:55:56 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121126075556.ED0162A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6258?compare_to=6255&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6258, Order: 168581, Start Time: 2012-11-26 06:26:45, End Time: 2012-11-26 07:56:28 To: 6255, Order: 168580, Start Time: 2012-11-26 04:38:32, End Time: 2012-11-26 06:09:20 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 6 (109 on baseline) Performance Improvements: 13 (30 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1035 (835 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/minisat/minisat: 1.47% (0.6934 => 0.7036, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/lpbench: 3.28% (3.8918 => 4.0196, std.dev.: 0.0161) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.40% (40.6312 => 41.6060, std.dev.: 0.2257) MultiSource/Applications/SPASS/SPASS: 2.33% (8.4427 => 8.6390, std.dev.: 0.0622) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.78% (13.3202 => 13.5569, std.dev.: 0.0711) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.14% (2.3690 => 2.3960, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: -3.91% (0.3298 => 0.3169, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -2.87% (1.3709 => 1.3315, std.dev.: 0.0124) MultiSource/Applications/hbd/hbd: -2.57% (1.5077 => 1.4690, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -2.51% (1.3166 => 1.2836, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.92% (0.8651 => 0.8485, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.85% (1.5001 => 1.4723, std.dev.: 0.0085) MultiSource/Applications/lambda-0_1_3/lambda: -1.68% (0.7736 => 0.7606, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.48% (4.6281 => 4.5598, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.41% (0.9269 => 0.9138, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.38% (4.3333 => 4.2735, std.dev.: 0.0173) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: -6.37% (0.2118 => 0.1983, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.23% (0.2102 => 0.1992, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.29% (1.4376 => 1.4191, std.dev.: 0.0061) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -2.18% (1.0750 => 1.0516, std.dev.: 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -11.87% (0.0219 => 0.0193, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 13.90% (0.0374 => 0.0426, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 13.31% (0.0248 => 0.0281, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0313 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 5.74% (0.0401 => 0.0424, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0204 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 25.29% (0.0174 => 0.0218, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1478 => 0.1477, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -0.96% (1.1059 => 1.0953, std.dev.: 0.0421) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.50% (0.4132 => 0.4194, std.dev.: 0.0215) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.84% (0.1414 => 0.1440, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.98% (0.0570 => 0.0644, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -23.02% (0.0278 => 0.0214, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.21% (0.0642 => 0.0615, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.07% (1.2023 => 1.2014, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 500.00% (0.0001 => 0.0006, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.21% (0.0589 => 0.0576, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.25% (0.0204 => 0.0179, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.42% (0.7794 => 0.7827, std.dev.: 0.0035) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 9.23% (0.0065 => 0.0071, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.50% (16.4461 => 17.6794, std.dev.: 0.0214) MultiSource/Applications/sqlite3/sqlite3: 2331.38% (0.6332 => 15.3955, std.dev.: 0.0107) MultiSource/Benchmarks/McCat/08-main/main: 48.17% (0.1831 => 0.2713, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.89% (0.1559 => 0.1436, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7108.49% (0.3123 => 22.5121, std.dev.: 0.1069) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.18% (0.2463 => 0.3699, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1534.33% (0.3344 => 5.4652, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.52% (0.2364 => 0.3251, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.91% (0.6010 => 0.6305, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel: -0.70% (0.0429 => 0.0426, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.64% (0.3266 => 0.3385, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/strcat: 3.61% (0.1969 => 0.2040, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.23% (0.0224 => 0.0229, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0486, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 9.10% (0.1462 => 0.1595, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4625, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0696, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4912, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5114, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.4905, std.dev.: 0.0714) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3123, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1326, std.dev.: 0.0174) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3632, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4011, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0846, std.dev.: 0.0029) SingleSource/Regression/C/uint64_to_float: -23.85% (2.1832 => 1.6626, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.81% (0.0810 => 0.0930, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.62% (0.0848 => 0.0955, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 11.24% (0.1112 => 0.1237, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.86% (0.1425 => 0.1537, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.60% (0.2180 => 0.2302, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.49% (0.7473 => 0.7883, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.30% (0.4847 => 0.5104, std.dev.: 0.0087) MultiSource/Applications/Burg/burg: 4.93% (1.2222 => 1.2824, std.dev.: 0.0181) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.81% (0.3137 => 0.3288, std.dev.: 0.0032) MultiSource/Applications/spiff/spiff: 4.74% (0.7950 => 0.8327, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.50% (0.5961 => 0.6229, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.39% (0.2279 => 0.2379, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.11% (0.8148 => 0.8483, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.05% (0.2519 => 0.2621, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.97% (2.1401 => 2.2251, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.79% (0.6287 => 0.6525, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.78% (0.4127 => 0.4283, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 3.56% (1.2568 => 1.3016, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.38% (1.5315 => 1.5832, std.dev.: 0.0050) MultiSource/Applications/sgefa/sgefa: 3.37% (0.2999 => 0.3100, std.dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 3.24% (1.1271 => 1.1636, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.22% (0.4559 => 0.4706, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.20% (14.2605 => 14.7162, std.dev.: 0.0927) MultiSource/Applications/treecc/treecc: 3.18% (1.9948 => 2.0583, std.dev.: 0.0229) MultiSource/Applications/siod/siod: 3.14% (2.2184 => 2.2880, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.09% (0.8340 => 0.8598, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.08% (0.8050 => 0.8298, std.dev.: 0.0039) MultiSource/Applications/lua/lua: 3.05% (3.8189 => 3.9354, std.dev.: 0.0215) MultiSource/Applications/minisat/minisat: 2.96% (0.6834 => 0.7036, std.dev.: 0.0032) MultiSource/Applications/hbd/hbd: 2.95% (1.4269 => 1.4690, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.94% (3.1832 => 3.2768, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.91% (0.8069 => 0.8304, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.91% (0.8697 => 0.8950, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.88% (0.8007 => 0.8238, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.79% (0.9688 => 0.9958, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: 2.76% (2.3764 => 2.4420, std.dev.: 0.0034) MultiSource/Applications/ClamAV/clamscan: 2.71% (14.7684 => 15.1682, std.dev.: 0.1141) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.64% (0.9069 => 0.9308, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.62% (0.9435 => 0.9682, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.57% (0.8518 => 0.8737, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.57% (0.8331 => 0.8545, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.57% (0.8611 => 0.8832, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.55% (13.1811 => 13.5166, std.dev.: 0.0395) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.47% (1.2526 => 1.2836, std.dev.: 0.0100) MultiSource/Applications/JM/ldecod/ldecod: 2.41% (6.7320 => 6.8943, std.dev.: 0.0437) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.40% (0.9908 => 1.0146, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.38% (0.9074 => 0.9290, std.dev.: 0.0077) MultiSource/Applications/hexxagon/hexxagon: 2.36% (0.9810 => 1.0042, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.36% (0.8927 => 0.9138, std.dev.: 0.0043) MultiSource/Applications/oggenc/oggenc: 2.36% (4.9628 => 5.0799, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.35% (0.9056 => 0.9269, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.34% (0.8286 => 0.8480, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.33% (0.8885 => 0.9092, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.33% (4.1763 => 4.2735, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.31% (0.8261 => 0.8452, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.29% (0.8420 => 0.8613, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.29% (0.8656 => 0.8854, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.27% (0.8855 => 0.9056, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.26% (1.6386 => 1.6757, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.24% (0.8712 => 0.8907, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.23% (0.8716 => 0.8910, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.20% (0.8086 => 0.8264, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.19% (0.8066 => 0.8243, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.18% (0.8359 => 0.8541, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.17% (0.8048 => 0.8223, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.17% (0.7932 => 0.8104, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.05% (0.8204 => 0.8372, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.03% (0.8316 => 0.8485, std.dev.: 0.0056) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.96% (6.6074 => 6.7371, std.dev.: 0.0392) MultiSource/Applications/lemon/lemon: 1.93% (1.0945 => 1.1156, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.69% (1.4479 => 1.4723, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.62% (4.4873 => 4.5598, std.dev.: 0.0200) MultiSource/Benchmarks/mafft/pairlocalalign: 1.48% (8.6247 => 8.7520, std.dev.: 0.0282) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.21% (1.2423 => 1.2573, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 113.57% (0.0199 => 0.0425, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/pi: 58.69% (1.5795 => 2.5065, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.38% (2.9753 => 3.4626, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.15% (0.7597 => 0.8824, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.69% (2.7995 => 3.2107, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6085, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.01% (1.1857 => 1.2807, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.88% (0.3186 => 0.3437, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.40% (6.3772 => 6.8489, std.dev.: 0.0702) SingleSource/Benchmarks/McGill/queens: 7.23% (1.7056 => 1.8289, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.72% (4.7794 => 5.1005, std.dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 5.96% (3.1873 => 3.3772, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.90% (4.5327 => 4.8001, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/richards_benchmark: 5.89% (1.3037 => 1.3805, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.85% (4.9686 => 5.2591, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 4.84% (7.4933 => 7.8558, std.dev.: 0.0479) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.56% (3.3761 => 3.5302, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.50% (6.2275 => 6.5077, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.16% (4.9453 => 5.1509, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.05% (4.9469 => 5.1473, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.78% (14.0064 => 14.5358, std.dev.: 0.0261) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.46% (0.3587 => 0.3711, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 3.05% (3.9006 => 4.0196, std.dev.: 0.0161) MultiSource/Applications/siod/siod: 2.97% (3.6643 => 3.7731, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.78% (11.5690 => 11.8903, std.dev.: 0.0442) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.72% (8.2783 => 8.5034, std.dev.: 0.0048) MultiSource/Applications/SPASS/SPASS: 2.45% (8.4326 => 8.6390, std.dev.: 0.0622) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.36% (4.8660 => 4.9808, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: 2.28% (7.3375 => 7.5049, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.07% (4.8362 => 4.9364, std.dev.: 0.0262) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.82% (1.1365 => 1.1572, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: 1.30% (1.0841 => 1.0982, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: 1.24% (8.5322 => 8.6379, std.dev.: 0.0267) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.2061 => 1.2201, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.10% (3.5679 => 3.6072, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.03% (5.4641 => 4.3149, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.91% (7.2130 => 6.2099, std.dev.: 0.0911) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.33% (1.0512 => 0.9321, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: -10.62% (1.1216 => 1.0025, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -8.43% (63.1822 => 57.8562, std.dev.: 0.7651) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.43% (14.6451 => 13.5569, std.dev.: 0.0711) SingleSource/Benchmarks/Shootout/heapsort: -7.16% (3.2926 => 3.0568, std.dev.: 0.0671) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.89% (4.7482 => 4.4211, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.21% (0.3269 => 0.3066, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.18% (3.7148 => 3.4851, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.89% (5.4972 => 5.1733, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.08% (5.1557 => 4.8938, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.40% (4.7449 => 4.5359, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.78% (6.0224 => 5.7948, std.dev.: 0.0113) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.34% (2.8773 => 2.7813, std.dev.: 0.0294) MultiSource/Applications/lua/lua: -3.20% (29.8330 => 28.8787, std.dev.: 0.2679) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.03% (28.5821 => 27.7168, std.dev.: 0.0615) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.98% (0.5807 => 0.5634, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.96% (2.6356 => 2.5575, std.dev.: 0.0154) MultiSource/Benchmarks/FreeBench/mason/mason: -2.75% (0.5415 => 0.5266, std.dev.: 0.0036) MultiSource/Applications/aha/aha: -2.67% (3.3398 => 3.2506, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/hash2: -2.53% (3.4237 => 3.3372, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/bisort/bisort: -2.46% (0.6636 => 0.6473, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.24% (9.9065 => 9.6842, std.dev.: 0.0617) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.16% (2.4490 => 2.3960, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.99% (11.5316 => 11.3019, std.dev.: 0.0225) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.76% (3.2169 => 3.1604, std.dev.: 0.0075) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.64% (2.3487 => 2.3102, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.59% (4.9994 => 4.9197, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.25% (5.6343 => 5.5641, std.dev.: 0.0077) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.48% (1.0262 => 1.0516, std.dev.: 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 56.91% (0.0123 => 0.0193, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 10.63% (0.0254 => 0.0281, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.71% (0.1438 => 0.1477, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -3.32% (1.1329 => 1.0953, std.dev.: 0.0421) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.72% (0.4164 => 0.4194, std.dev.: 0.0215) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.19% (0.1369 => 0.1440, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.47% (0.0641 => 0.0644, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 9.74% (0.0195 => 0.0214, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.40% (0.0578 => 0.0615, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.05% (1.1437 => 1.2014, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 500.00% (0.0001 => 0.0006, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.13% (0.0627 => 0.0576, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.56% (0.0180 => 0.0179, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.37% (0.8017 => 0.7827, std.dev.: 0.0035) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 14.52% (0.0062 => 0.0071, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 00:20:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 02:20:15 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121126082015.B2F082A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6259?compare_to=6256&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6259, Order: 168581, Start Time: 2012-11-26 06:44:38, End Time: 2012-11-26 08:20:45 To: 6256, Order: 168580, Start Time: 2012-11-26 04:48:08, End Time: 2012-11-26 06:21:33 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (149 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (888 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 3.87% (0.4181 => 0.4343, std.dev.: 0.0023) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 13.28% (0.3834 => 0.4343, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1012, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/salsa20: 2.29% (7.4937 => 7.6653, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/hash2: 2.09% (3.1932 => 3.2598, std.dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.01% (0.1431 => 0.1302, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.90% (0.3821 => 0.3519, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -6.78% (2.4924 => 2.3233, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.59% (0.3142 => 0.2935, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.30% (0.9542 => 0.8941, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: -6.16% (0.2160 => 0.2027, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.14% (0.2428 => 0.2279, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.07% (0.2355 => 0.2212, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/trivial-interface: -6.06% (0.3812 => 0.3581, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.06% (0.3880 => 0.3645, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.06% (0.3848 => 0.3615, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.03% (0.3831 => 0.3600, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.98% (0.6484 => 0.6096, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: -5.96% (9.2283 => 8.6784, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/synchronized: -5.93% (0.3896 => 0.3665, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -5.90% (0.4033 => 0.3795, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.85% (0.1796 => 0.1691, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.83% (0.7198 => 0.6778, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.83% (0.9852 => 0.9278, std.dev.: 0.0093) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.81% (0.3891 => 0.3665, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -5.75% (16.1920 => 15.2610, std.dev.: 0.3273) SingleSource/UnitTests/ObjC/exceptions: -5.75% (0.4176 => 0.3936, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.69% (0.5591 => 0.5273, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.61% (4.0323 => 3.8059, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.61% (0.5705 => 0.5385, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.60% (0.5478 => 0.5171, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.60% (1.3722 => 1.2954, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.59% (0.5863 => 0.5535, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.58% (4.8161 => 4.5472, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.56% (0.3884 => 0.3668, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/football/football: -5.55% (0.9179 => 0.8670, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.51% (1.0544 => 0.9963, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.48% (0.5857 => 0.5536, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.48% (4.8802 => 4.6129, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.46% (0.5581 => 0.5276, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.46% (0.6297 => 0.5953, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.44% (6.7716 => 6.4030, std.dev.: 0.0098) SingleSource/UnitTests/ObjC/property: -5.43% (0.4199 => 0.3971, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.42% (0.6660 => 0.6299, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.42% (0.2695 => 0.2549, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.40% (0.5849 => 0.5533, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.40% (0.5575 => 0.5274, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.39% (0.5805 => 0.5492, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: -5.39% (1.1530 => 1.0909, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.38% (1.6364 => 1.5484, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.38% (0.5802 => 0.5490, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.38% (3.5339 => 3.3439, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.35% (0.6230 => 0.5897, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.33% (0.6194 => 0.5864, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.32% (0.6052 => 0.5730, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.32% (0.6260 => 0.5927, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.32% (0.5925 => 0.5610, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.29% (0.5941 => 0.5627, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.27% (0.6304 => 0.5972, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.26% (0.6667 => 0.6316, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.26% (4.5069 => 4.2698, std.dev.: 0.0287) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.26% (0.5570 => 0.5277, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.24% (1.4642 => 1.3875, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.23% (0.6446 => 0.6109, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.22% (14.2083 => 13.4661, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.21% (0.5456 => 0.5172, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -5.20% (0.3406 => 0.3229, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.20% (0.6293 => 0.5966, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.17% (0.6676 => 0.6331, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.15% (0.6033 => 0.5722, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.15% (1.2784 => 1.2125, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.15% (1.2210 => 1.1581, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.15% (8.0126 => 7.6001, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.14% (0.5859 => 0.5558, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.10% (0.6681 => 0.6340, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.07% (0.6189 => 0.5875, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.06% (0.5688 => 0.5400, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.05% (0.2871 => 0.2726, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: -5.05% (4.3330 => 4.1143, std.dev.: 0.0136) SingleSource/UnitTests/ObjC/parameter-passing: -5.05% (0.4280 => 0.4064, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -5.00% (0.2939 => 0.2792, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.00% (0.8521 => 0.8095, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.97% (0.3057 => 0.2905, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.97% (0.6440 => 0.6120, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.93% (0.2903 => 0.2760, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.92% (0.7919 => 0.7529, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.91% (0.2933 => 0.2789, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.91% (0.3016 => 0.2868, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.90% (1.2221 => 1.1622, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/wc: -4.90% (0.3205 => 0.3048, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.87% (0.4151 => 0.3949, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -4.85% (0.3255 => 0.3097, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -4.83% (0.3394 => 0.3230, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -4.83% (0.3025 => 0.2879, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.81% (0.3931 => 0.3742, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -4.79% (0.3194 => 0.3041, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -4.79% (0.3446 => 0.3281, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.78% (0.2989 => 0.2846, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.77% (0.3252 => 0.3097, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.74% (0.3837 => 0.3655, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary2: -4.74% (0.3481 => 0.3316, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: -4.74% (0.2849 => 0.2714, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.74% (0.3483 => 0.3318, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.73% (0.3849 => 0.3667, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.73% (2.1713 => 2.0687, std.dev.: 0.0200) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.70% (0.2278 => 0.2171, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: -4.68% (0.4248 => 0.4049, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: -4.66% (0.3026 => 0.2885, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.61% (0.3319 => 0.3166, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.60% (0.3323 => 0.3170, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.60% (0.4916 => 0.4690, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: -4.58% (0.3059 => 0.2919, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.57% (0.6395 => 0.6103, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.51% (0.5569 => 0.5318, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: -4.51% (0.4861 => 0.4642, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.50% (0.5999 => 0.5729, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.50% (0.7339 => 0.7009, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.49% (0.7524 => 0.7186, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.47% (0.5168 => 0.4937, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -4.42% (0.3867 => 0.3696, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.39% (1.6474 => 1.5750, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.39% (0.6395 => 0.6114, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.37% (0.9077 => 0.8680, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.36% (0.4083 => 0.3905, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.33% (0.7021 => 0.6717, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.24% (0.5329 => 0.5103, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.23% (0.2999 => 0.2872, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: -4.14% (0.6347 => 0.6084, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.13% (0.4813 => 0.4614, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.12% (0.4321 => 0.4143, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.11% (0.5567 => 0.5338, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.05% (0.9557 => 0.9170, std.dev.: 0.0093) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.97% (22.4056 => 21.5154, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference-object: -3.94% (0.6441 => 0.6187, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -3.93% (0.6750 => 0.6485, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -3.91% (0.3788 => 0.3640, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.89% (0.4427 => 0.4255, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -3.83% (34.0927 => 32.7882, std.dev.: 0.0463) SingleSource/UnitTests/ObjC++/property-reference: -3.77% (0.7779 => 0.7486, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.67% (2.2587 => 2.1759, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.61% (0.3491 => 0.3365, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -3.60% (0.4524 => 0.4361, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.74% (5.4682 => 5.3186, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -2.60% (20.7746 => 20.2350, std.dev.: 0.0463) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7573, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1728, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7067, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.73% (2.2633 => 2.1789, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.68% (6.5735 => 6.4629, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 01:28:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 03:28:23 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121126092823.632A12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6260?compare_to=6254&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6260, Order: 168580, Start Time: 2012-11-26 06:05:25, End Time: 2012-11-26 09:28:53 To: 6254, Order: 168576, Start Time: 2012-11-26 01:56:43, End Time: 2012-11-26 05:17:22 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (171 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1090 (720 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 3.54% (0.3527 => 0.3652, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -4.60% (130.7423 => 124.7303, std.dev.: 1.5698) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.12% (0.0625 => 0.0882, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.08% (0.1063 => 0.1404, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.17% (0.0714 => 0.0908, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.73% (0.2969 => 0.3733, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.05% (0.1106 => 0.1383, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.79% (0.4139 => 0.5165, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.55% (0.4253 => 0.5297, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 24.38% (1.5932 => 1.9817, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.86% (0.5900 => 0.7308, std.dev.: 0.0331) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.25% (0.4994 => 0.6155, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.12% (0.0584 => 0.0719, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.02% (0.1620 => 0.1993, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.70% (0.5000 => 0.6135, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.67% (0.0547 => 0.0671, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.74% (0.1021 => 0.1243, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.40% (0.0897 => 0.1089, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 21.20% (0.0599 => 0.0726, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.05% (0.1107 => 0.1340, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.21% (0.0584 => 0.0702, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/em3d/em3d: 20.04% (0.0948 => 0.1138, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.91% (0.3903 => 0.4680, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.91% (0.0633 => 0.0759, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.78% (0.0642 => 0.0769, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.76% (0.1103 => 0.1321, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 19.61% (0.0821 => 0.0982, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.50% (0.1549 => 0.1851, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 19.37% (0.0604 => 0.0721, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.34% (0.1003 => 0.1197, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.26% (0.1604 => 0.1913, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.22% (0.0822 => 0.0980, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 19.21% (0.1619 => 0.1930, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.33% (0.1462 => 0.1730, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 18.32% (0.0808 => 0.0956, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 18.27% (0.0947 => 0.1120, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.97% (0.3890 => 0.4589, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.83% (0.2014 => 0.2373, std.dev.: 0.0122) MultiSource/Applications/spiff/spiff: 17.65% (0.4029 => 0.4740, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.51% (1.3152 => 1.5455, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: 17.41% (0.1218 => 0.1430, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.32% (0.2736 => 0.3210, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 17.19% (0.0698 => 0.0818, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.10% (0.1088 => 0.1274, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 17.01% (0.1505 => 0.1761, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.89% (0.2866 => 0.3350, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.77% (0.1968 => 0.2298, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 16.67% (1.8794 => 2.1927, std.dev.: 0.0060) SingleSource/UnitTests/ObjC++/Hello: 16.62% (0.5826 => 0.6794, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 16.61% (0.5546 => 0.6467, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: 16.59% (0.5889 => 0.6866, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.42% (0.4658 => 0.5423, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.32% (0.5026 => 0.5846, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.26% (0.3930 => 0.4569, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.23% (3.5627 => 4.1411, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.11% (1.6211 => 1.8822, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.93% (0.3271 => 0.3792, std.dev.: 0.0024) MultiSource/Applications/hbd/hbd: 15.61% (0.9697 => 1.1211, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.60% (0.1160 => 0.1341, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/18-imp/imp: 15.41% (0.1421 => 0.1640, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.41% (0.4361 => 0.5033, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 15.35% (1.0781 => 1.2436, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.19% (4.4195 => 5.0910, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/bh/bh: 15.11% (0.1284 => 0.1478, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 14.99% (0.2875 => 0.3306, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 14.93% (4.2109 => 4.8395, std.dev.: 0.0108) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.83% (2.7292 => 3.1339, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.69% (1.9694 => 2.2587, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/strcat: 14.58% (0.2750 => 0.3151, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.41% (1.9966 => 2.2844, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.40% (0.1090 => 0.1247, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 14.39% (0.2780 => 0.3180, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 14.35% (0.2738 => 0.3131, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 14.33% (0.2714 => 0.3103, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 14.29% (0.7171 => 0.8196, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/objinst: 14.24% (0.2823 => 0.3225, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 14.24% (0.2725 => 0.3113, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.22% (0.2792 => 0.3189) SingleSource/Benchmarks/Shootout-C++/nestedloop: 14.22% (0.2729 => 0.3117, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 14.19% (23.5202 => 26.8585, std.dev.: 0.0220) MultiSource/Applications/hexxagon/hexxagon: 14.18% (0.9909 => 1.1314, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.17% (2.0673 => 2.3603, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/methcall: 14.15% (0.2813 => 0.3211, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 14.15% (0.3004 => 0.3429, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 14.13% (0.2803 => 0.3199, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.12% (0.3195 => 0.3646, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 14.11% (0.2566 => 0.2928, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 14.09% (0.2811 => 0.3207, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.08% (0.2911 => 0.3321, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 13.93% (0.2075 => 0.2364, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 13.85% (0.0758 => 0.0863, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 13.84% (0.3267 => 0.3719, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/wc: 13.82% (0.3096 => 0.3524, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 13.69% (0.3258 => 0.3704, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 13.52% (1.4269 => 1.6198, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary2: 13.51% (0.3317 => 0.3765, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.30% (0.3060 => 0.3467, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.30% (0.3362 => 0.3809, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 13.19% (0.3678 => 0.4163, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.07% (0.3488 => 0.3944, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 13.02% (0.3348 => 0.3784, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.00% (0.3124 => 0.3530, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 12.99% (0.3625 => 0.4096, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 12.95% (0.3282 => 0.3707, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 12.94% (0.7875 => 0.8894, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 12.87% (2.1653 => 2.4440, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/lists1: 12.80% (0.3477 => 0.3922, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 12.75% (0.3726 => 0.4201, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 12.61% (0.3465 => 0.3902, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 12.59% (0.4146 => 0.4668, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 12.58% (4.6177 => 5.1985, std.dev.: 0.0368) SingleSource/UnitTests/ObjC/exceptions-2: 12.57% (0.3446 => 0.3879, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.56% (0.3496 => 0.3935, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.54% (0.3469 => 0.3904, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.52% (0.3690 => 0.4152, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-3: 12.49% (0.3460 => 0.3892, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 12.43% (0.3442 => 0.3870, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.33% (0.3650 => 0.4100, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 12.33% (0.4251 => 0.4775, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.29% (0.1383 => 0.1553, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.23% (0.3981 => 0.4468, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.17% (0.3845 => 0.4313, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 12.12% (2.1013 => 2.3560, std.dev.: 0.0095) SingleSource/UnitTests/ObjC/exceptions: 12.11% (0.3643 => 0.4084, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.00% (0.3724 => 0.4171, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 11.97% (0.5012 => 0.5612, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 11.67% (0.2691 => 0.3005, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.67% (0.2040 => 0.2278, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11.16% (5.5417 => 6.1601, std.dev.: 0.0076) MultiSource/Applications/lambda-0_1_3/lambda: 11.09% (0.3498 => 0.3886, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.09% (0.1028 => 0.1142, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.05% (0.6435 => 0.7146, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 10.16% (0.3336 => 0.3675, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 10.13% (0.6634 => 0.7306, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.12% (0.3084 => 0.3396, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 10.11% (0.4847 => 0.5337, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.94% (0.2737 => 0.3009, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 9.87% (0.2391 => 0.2627, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.86% (0.2068 => 0.2272, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.46% (0.2103 => 0.2302, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 9.35% (2.0346 => 2.2248, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.51% (4.6926 => 5.0919, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.41% (11.6398 => 12.6191, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.26% (0.5361 => 0.5804, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.82% (0.7426 => 0.8007, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.63% (0.5584 => 0.6010, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 6.47% (11.9555 => 12.7295, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.22% (0.3792 => 0.3914, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 68.92% (0.2162 => 0.3652, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.80% (0.0734 => 0.0872, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.30% (0.5917 => 0.6704, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 9.85% (0.2802 => 0.3078, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 8.25% (0.2122 => 0.2297, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6098, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.82% (0.3693 => 0.3908, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6716, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-2: 4.77% (1.8057 => 1.8918, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1688, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: 4.26% (14.0481 => 14.6459, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2062, std.dev.: 0.0034) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2245, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.49% (7.1849 => 7.2916, std.dev.: 0.0030) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3086, std.dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0028) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5124, std.dev.: 0.0103) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1051, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.02% (50.0626 => 50.5752, std.dev.: 0.0100) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.11% (2.4764 => 2.3994, std.dev.: 0.0140) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5773, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/ary2: -9.58% (0.2402 => 0.2172, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9781, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8084, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7991, std.dev.: 0.0130) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7730, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: -2.34% (17.2379 => 16.8353, std.dev.: 0.0394) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8611, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.13% (0.6293 => 0.6159, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5798, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -1.43% (5.5810 => 5.5013, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1820, std.dev.: 0.0200) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0474, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 02:28:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 04:28:42 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121126102842.16B2B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6261?compare_to=6258&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6261, Order: 168582, Start Time: 2012-11-26 08:57:49, End Time: 2012-11-26 10:29:14 To: 6258, Order: 168581, Start Time: 2012-11-26 06:26:45, End Time: 2012-11-26 07:56:28 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 9 (98 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1045 (852 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.72% (0.1956 => 0.2107, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.47% (1.1890 => 1.2184, std.dev.: 0.0083) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.26% (6.7371 => 6.8223, std.dev.: 0.0195) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.18% (4.6342 => 4.6888, std.dev.: 0.0192) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.11% (1.2836 => 1.2979, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 24.99% (1.4960 => 1.8699, std.dev.: 0.0097) SingleSource/Benchmarks/Stanford/Puzzle: 7.40% (0.1609 => 0.1728, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.93% (1.3290 => 1.3812, std.dev.: 0.0181) SingleSource/Benchmarks/Linpack/linpack-pc: 3.69% (51.2625 => 53.1537, std.dev.: 0.1423) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.08% (1.0516 => 1.0735, std.dev.: 0.1336) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 13.99% (0.0193 => 0.0220, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.94% (0.0426 => 0.0430, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 19.22% (0.0281 => 0.0335, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.28% (0.0312 => 0.0316, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.71% (0.0424 => 0.0427, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0204 => 0.0205, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0218 => 0.0218, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.27% (0.1477 => 0.1473, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 9.60% (1.0953 => 1.2005, std.dev.: 0.2956) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.31% (0.4194 => 0.4207, std.dev.: 0.0364) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.07% (0.1440 => 0.1439, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.76% (0.0644 => 0.0594, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.88% (0.0214 => 0.0233, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.22% (0.0615 => 0.0546, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.32% (1.2014 => 1.1975, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 416.67% (0.0006 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.33% (0.0576 => 0.0624, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.02% (0.0179 => 0.0222, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.55% (0.7827 => 0.7784, std.dev.: 0.0052) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: 500.00% (0.0001 => 0.0006, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 64.79% (0.0071 => 0.0117, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.04% (16.4461 => 17.6046, std.dev.: 0.4575) MultiSource/Applications/sqlite3/sqlite3: 2312.57% (0.6332 => 15.2764, std.dev.: 0.6761) MultiSource/Benchmarks/McCat/08-main/main: 50.14% (0.1831 => 0.2749, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.45% (0.1559 => 0.1474, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7073.46% (0.3123 => 22.4027, std.dev.: 0.2604) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.91% (0.2463 => 0.3717, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1535.41% (0.3344 => 5.4688, std.dev.: 0.0826) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.10% (0.2364 => 0.3241, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 4.63% (0.6010 => 0.6288, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/mandel: 0.47% (0.0429 => 0.0431, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.44% (0.3266 => 0.3411, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/strcat: 4.52% (0.1969 => 0.2058, std.dev.: 0.0082) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.91% (0.0224 => 0.0235, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0007) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0491, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 8.82% (0.1462 => 0.1591, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4665, std.dev.: 0.1795) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0706, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4949, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5089, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.4890, std.dev.: 0.0964) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3159, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1383, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3629, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4007, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0868, std.dev.: 0.0010) SingleSource/Regression/C/uint64_to_float: -23.94% (2.1832 => 1.6605, std.dev.: 0.0147) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.42% (0.0810 => 0.0943, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: 13.13% (0.1112 => 0.1258, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.98% (0.1425 => 0.1553, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.30% (0.1466 => 0.1573, std.dev.: 0.0027) MultiSource/Applications/viterbi/viterbi: 6.91% (0.1577 => 0.1686, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.25% (0.1983 => 0.2107, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.90% (1.2222 => 1.2943, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.82% (1.1606 => 1.2281, std.dev.: 0.0232) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.70% (0.2998 => 0.3169, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.96% (0.2378 => 0.2496, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 4.93% (0.2999 => 0.3147, std.dev.: 0.0035) MultiSource/Applications/spiff/spiff: 4.47% (0.7950 => 0.8305, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.27% (1.1685 => 1.2184, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.08% (1.6386 => 1.7054, std.dev.: 0.0126) MultiSource/Benchmarks/Olden/bh/bh: 3.92% (0.2985 => 0.3102, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 3.87% (1.1271 => 1.1707, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 3.71% (14.2605 => 14.7896, std.dev.: 0.1469) MultiSource/Applications/treecc/treecc: 3.62% (1.9948 => 2.0670, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.62% (0.4559 => 0.4724, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.62% (1.2526 => 1.2979, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.37% (0.8697 => 0.8990, std.dev.: 0.0094) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.25% (6.6074 => 6.8223, std.dev.: 0.0195) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.24% (0.4783 => 0.4938, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.23% (0.3717 => 0.3837, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.17% (1.5315 => 1.5800, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.06% (0.8340 => 0.8595, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: 3.06% (2.3764 => 2.4490, std.dev.: 0.0128) MultiSource/Applications/siod/siod: 3.04% (2.2184 => 2.2858, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.86% (0.8317 => 0.8555, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.84% (0.8050 => 0.8279, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.80% (0.9074 => 0.9328, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.80% (0.8611 => 0.8852, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.77% (0.8331 => 0.8562, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.77% (0.8518 => 0.8754, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.72% (0.8597 => 0.8831, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.71% (0.8069 => 0.8288, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/05-eks/eks: 2.71% (0.4397 => 0.4516, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.70% (0.8286 => 0.8510, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.70% (0.8086 => 0.8304, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.65% (0.9069 => 0.9309, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.65% (4.4873 => 4.6060, std.dev.: 0.0213) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.60% (4.5702 => 4.6888, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.58% (0.8204 => 0.8416, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.58% (0.9908 => 1.0164, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.56% (1.4479 => 1.4849, std.dev.: 0.0045) MultiSource/Benchmarks/Bullet/bullet: 2.53% (31.8598 => 32.6647, std.dev.: 0.1077) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.51% (0.7966 => 0.8166, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.44% (0.8066 => 0.8263, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.44% (0.8457 => 0.8663, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.41% (0.9688 => 0.9921, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.35% (0.8805 => 0.9012, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.32% (0.7932 => 0.8116, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.31% (0.8656 => 0.8856, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.31% (0.8716 => 0.8917, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.26% (0.8855 => 0.9055, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.25% (0.8359 => 0.8547, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.23% (0.8927 => 0.9126, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.23% (0.8712 => 0.8906, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.14% (0.8261 => 0.8438, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.14% (0.8420 => 0.8600, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.13% (0.8177 => 0.8351, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.06% (0.8048 => 0.8214, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.04% (0.8885 => 0.9066, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.97% (0.8338 => 0.8502, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.96% (0.8316 => 0.8479, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.84% (1.2423 => 1.2651, std.dev.: 0.0074) MultiSource/Benchmarks/mafft/pairlocalalign: 1.78% (8.6247 => 8.7786, std.dev.: 0.0436) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 112.56% (0.0199 => 0.0423, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/pi: 57.18% (1.5795 => 2.4827, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.35% (2.9753 => 3.4619, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.59% (0.7597 => 0.8781, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.54% (2.7995 => 3.2066, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.53% (5.0261 => 5.6054, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 7.42% (1.7056 => 1.8322, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.14% (1.1857 => 1.2704, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/richards_benchmark: 6.87% (1.3037 => 1.3933, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.63% (4.7794 => 5.0961, std.dev.: 0.0037) MultiSource/Applications/SIBsim4/SIBsim4: 6.03% (3.1873 => 3.3796, std.dev.: 0.0574) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.85% (4.5327 => 4.7978, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.84% (4.9686 => 5.2590, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.00% (2.2485 => 2.3609, std.dev.: 0.0374) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.74% (6.2275 => 6.5227, std.dev.: 0.0369) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.64% (3.3761 => 3.5329, std.dev.: 0.0282) MultiSource/Applications/lambda-0_1_3/lambda: 4.24% (7.4933 => 7.8111, std.dev.: 0.0540) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.09% (4.9453 => 5.1474, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.02% (4.9469 => 5.1458, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.97% (14.0064 => 14.5625, std.dev.: 0.0414) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.36% (1.2337 => 1.2751, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 3.03% (3.6643 => 3.7753, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.82% (11.5690 => 11.8949, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.79% (8.2783 => 8.5095, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.60% (4.8362 => 4.9618, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.21% (4.8660 => 4.9733, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/lists: 2.19% (7.3375 => 7.4983, std.dev.: 0.0204) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.18% (1.1365 => 1.1613, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 1.46% (1.2061 => 1.2237, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.18% (3.5679 => 3.6101, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: 1.11% (1.0841 => 1.0961, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -32.25% (0.0338 => 0.0229, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: -21.01% (5.4641 => 4.3162, std.dev.: 0.0426) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.64% (7.2130 => 6.2288, std.dev.: 0.1033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.19% (1.0512 => 0.9336, std.dev.: 0.0288) SingleSource/Benchmarks/McGill/chomp: -11.05% (1.1216 => 0.9977, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: -8.41% (63.1822 => 57.8664, std.dev.: 0.0999) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.47% (14.6451 => 13.5505, std.dev.: 0.1393) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.89% (4.7482 => 4.4212, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.97% (3.7148 => 3.4931, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.89% (5.4972 => 5.1732, std.dev.: 0.0232) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.17% (5.1557 => 4.8892, std.dev.: 0.0278) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.42% (2.8773 => 2.7500, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.36% (4.7449 => 4.5381, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.68% (6.0224 => 5.8005, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.67% (2.4490 => 2.3591, std.dev.: 0.0170) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (28.5821 => 27.6770, std.dev.: 0.0408) MultiSource/Benchmarks/Prolangs-C++/life/life: -3.01% (2.6356 => 2.5563, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.51% (9.9065 => 9.6578, std.dev.: 0.0608) MultiSource/Applications/aha/aha: -2.33% (3.3398 => 3.2620, std.dev.: 0.0230) SingleSource/Benchmarks/Shootout-C++/hash2: -2.17% (3.4237 => 3.3493, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.01% (11.5316 => 11.3002, std.dev.: 0.0353) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.94% (4.9994 => 4.9024, std.dev.: 0.0095) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.68% (2.3487 => 2.3092, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.17% (5.6343 => 5.5683, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.61% (1.0262 => 1.0735, std.dev.: 0.1336) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.39% (0.0408 => 0.0430, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.89% (0.0254 => 0.0335, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.20% (0.0384 => 0.0427, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.43% (0.1438 => 0.1473, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 5.97% (1.1329 => 1.2005, std.dev.: 0.2956) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.03% (0.4164 => 0.4207, std.dev.: 0.0364) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.11% (0.1369 => 0.1439, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.33% (0.0641 => 0.0594, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 19.49% (0.0195 => 0.0233, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.54% (0.0578 => 0.0546, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.70% (1.1437 => 1.1975, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.48% (0.0627 => 0.0624, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.33% (0.0180 => 0.0222, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.91% (0.8017 => 0.7784, std.dev.: 0.0052) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: 500.00% (0.0001 => 0.0006, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 88.71% (0.0062 => 0.0117, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 02:35:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 04:35:33 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121126103533.1E3122A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6262?compare_to=6259&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6262, Order: 168582, Start Time: 2012-11-26 09:02:31, End Time: 2012-11-26 10:36:04 To: 6259, Order: 168581, Start Time: 2012-11-26 06:44:38, End Time: 2012-11-26 08:20:45 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 1 (179 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (859 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.50% (0.7486 => 0.7374, std.dev.: 0.0033) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1016, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.4937 => 7.6860, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hash2: 2.28% (3.1932 => 3.2660, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.08% (0.1431 => 0.1301, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.88% (0.3821 => 0.3520, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: -7.18% (0.3831 => 0.3556, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -7.17% (0.3848 => 0.3572, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -7.16% (0.3880 => 0.3602, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -7.11% (0.3896 => 0.3619, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -7.08% (0.3812 => 0.3542, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.99% (0.3891 => 0.3619, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.97% (0.3142 => 0.2923, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -6.94% (0.4033 => 0.3753, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.94% (2.4924 => 2.3194, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.93% (0.3884 => 0.3615, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: -6.85% (0.4176 => 0.3890, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -6.48% (0.4199 => 0.3927, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.40% (0.3357 => 0.3142, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.35% (0.7198 => 0.6741, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.29% (0.9542 => 0.8942, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.28% (0.2355 => 0.2207, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.22% (0.2428 => 0.2277, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -6.20% (0.2160 => 0.2026, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -6.17% (0.4280 => 0.4016, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.11% (0.6484 => 0.6088, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -5.96% (0.1879 => 0.1767, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -5.95% (9.2283 => 8.6794, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.90% (0.1796 => 0.1690, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.87% (0.9852 => 0.9274, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -5.85% (7.0961 => 6.6809, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.83% (4.8161 => 4.5355, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.82% (1.3722 => 1.2923, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: -5.80% (16.1920 => 15.2529, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.74% (1.0544 => 0.9939, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.74% (4.0323 => 3.8010, std.dev.: 0.0083) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.71% (6.7716 => 6.3848, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/05-eks/eks: -5.67% (0.4515 => 0.4259, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.67% (0.5591 => 0.5274, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -5.64% (0.9179 => 0.8661, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.63% (4.8802 => 4.6055, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/fibo: -5.61% (0.2871 => 0.2710, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.60% (0.5478 => 0.5171, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.56% (0.3057 => 0.2887, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.56% (0.2933 => 0.2770, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.55% (0.2939 => 0.2776, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.54% (0.5863 => 0.5538, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.53% (1.2300 => 1.1620, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.49% (0.2695 => 0.2547, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: -5.49% (1.1530 => 1.0897, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.48% (0.6297 => 0.5952, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.47% (0.6230 => 0.5889, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.47% (0.3658 => 0.3458, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.46% (0.5857 => 0.5537, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -5.46% (0.3205 => 0.3030, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.45% (4.5069 => 4.2613, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.43% (0.5705 => 0.5395, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.41% (0.5805 => 0.5491, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -5.40% (0.3406 => 0.3222, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.39% (0.5581 => 0.5280, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.38% (0.6667 => 0.6308, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.38% (0.3255 => 0.3080, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.38% (0.6660 => 0.6302, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.37% (1.2210 => 1.1554, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hello: -5.37% (0.2849 => 0.2696, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.36% (0.6194 => 0.5862, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.36% (0.6736 => 0.6375, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.35% (0.5849 => 0.5536, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.34% (0.2903 => 0.2748, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.34% (0.6052 => 0.5729, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.34% (0.6260 => 0.5926, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.33% (8.0126 => 7.5852, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.33% (0.5925 => 0.5609, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -5.32% (0.2989 => 0.2830, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.31% (1.4642 => 1.3865, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.29% (3.5339 => 3.3469, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.29% (0.4916 => 0.4656, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -5.29% (0.3026 => 0.2866, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.28% (1.2784 => 1.2109, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.28% (0.6293 => 0.5961, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.27% (0.3016 => 0.2857, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.27% (0.5941 => 0.5628, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -5.26% (0.3025 => 0.2866, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.26% (0.5575 => 0.5282, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.25% (0.8521 => 0.8074, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.25% (1.2221 => 1.1580, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.24% (0.6681 => 0.6331, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.24% (14.2083 => 13.4642, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/bh/bh: -5.23% (0.2985 => 0.2829, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.22% (0.5456 => 0.5171, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -5.22% (0.3446 => 0.3266, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.22% (0.5859 => 0.5553, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -5.21% (0.7779 => 0.7374, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: -5.20% (4.3330 => 4.1075, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.20% (0.6304 => 0.5976, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.20% (0.2999 => 0.2843, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: -5.19% (1.3864 => 1.3144, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: -5.19% (1.1450 => 1.0856, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: -5.19% (0.3394 => 0.3218, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.18% (0.5999 => 0.5688, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.18% (0.6676 => 0.6330, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.18% (0.6446 => 0.6112, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -5.18% (1.3148 => 1.2467, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.17% (0.5802 => 0.5502, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.17% (0.5570 => 0.5282, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.17% (0.6189 => 0.5869, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.17% (0.3849 => 0.3650, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -5.17% (0.3194 => 0.3029, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.16% (0.7919 => 0.7510, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.15% (0.6033 => 0.5722, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.13% (0.4151 => 0.3938, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.11% (0.2659 => 0.2523, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.11% (0.4813 => 0.4567, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.11% (0.3837 => 0.3641, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.10% (0.2001 => 0.1899, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.09% (2.1713 => 2.0607, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -5.08% (0.3481 => 0.3304, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -5.08% (17.1032 => 16.2343, std.dev.: 0.0241) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.04% (0.3931 => 0.3733, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.03% (0.6440 => 0.6116, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.03% (0.5688 => 0.5402, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.01% (0.3252 => 0.3089, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.00% (0.3319 => 0.3153, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/moments: -4.99% (0.4248 => 0.4036, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.99% (0.2385 => 0.2266, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.99% (1.6364 => 1.5548, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.98% (0.2548 => 0.2421, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.95% (0.6347 => 0.6033, std.dev.: 0.0085) MultiSource/Applications/Burg/burg: -4.94% (1.2515 => 1.1897, std.dev.: 0.0031) SingleSource/Regression/C++/ofstream_ctor: -4.94% (0.3059 => 0.2908, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.91% (0.3323 => 0.3160, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: -4.87% (15.5079 => 14.7525, std.dev.: 0.0129) SingleSource/UnitTests/ObjC++/property-reference-object: -4.83% (0.6441 => 0.6130, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -4.81% (3.5154 => 3.3463, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.80% (0.4083 => 0.3887, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -4.78% (15.2527 => 14.5241, std.dev.: 0.0168) MultiSource/Benchmarks/McCat/18-imp/imp: -4.75% (0.3581 => 0.3411, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.71% (0.7021 => 0.6690, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: -4.70% (0.7447 => 0.7097, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.70% (0.2278 => 0.2171, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -4.69% (0.3621 => 0.3451, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: -4.68% (0.3867 => 0.3686, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -4.67% (0.4861 => 0.4634, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.62% (0.5168 => 0.4929, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.62% (0.3483 => 0.3322, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -4.62% (0.4524 => 0.4315, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.62% (0.9077 => 0.8658, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.59% (0.4427 => 0.4224, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.55% (0.7524 => 0.7182, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.49% (0.4321 => 0.4127, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: -4.46% (5.0226 => 4.7985, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sieve: -4.46% (0.3788 => 0.3619, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.46% (0.6395 => 0.6110, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.45% (1.6474 => 1.5741, std.dev.: 0.0068) MultiSource/Applications/lua/lua: -4.43% (4.0594 => 3.8796, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.43% (0.5329 => 0.5093, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.40% (0.7339 => 0.7016, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.39% (0.9557 => 0.9137, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: -4.35% (0.8418 => 0.8052, std.dev.: 0.0020) MultiSource/Applications/treecc/treecc: -4.33% (2.1401 => 2.0474, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.28% (22.4056 => 21.4461, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.22% (0.5567 => 0.5332, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.18% (0.5569 => 0.5336, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/bigfib: -4.16% (0.6750 => 0.6469, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -4.05% (2.4021 => 2.3048, std.dev.: 0.0057) MultiSource/Benchmarks/Bullet/bullet: -4.03% (34.0927 => 32.7191, std.dev.: 0.0352) MultiSource/Applications/lambda-0_1_3/lambda: -4.01% (0.7982 => 0.7662, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.90% (0.3491 => 0.3355, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: -3.88% (1.5610 => 1.5005, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.68% (2.2587 => 2.1755, std.dev.: 0.0182) MultiSource/Applications/kimwitu++/kc: -3.51% (18.2933 => 17.6507, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.88% (5.4682 => 5.3107, std.dev.: 0.0061) SingleSource/UnitTests/Vector/constpool: -2.28% (20.7746 => 20.3019, std.dev.: 0.0673) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7516, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/richards_benchmark: -8.77% (1.2842 => 1.1716, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -4.07% (2.2633 => 2.1711, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.55% (1.3096 => 1.2762, std.dev.: 0.0091) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.61% (6.5735 => 6.4676, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 02:56:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 04:56:26 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121126105626.B3F512A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6263?compare_to=6257&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6263, Order: 168581, Start Time: 2012-11-26 08:36:21, End Time: 2012-11-26 10:55:54 To: 6257, Order: 168580, Start Time: 2012-11-26 05:21:20, End Time: 2012-11-26 07:41:21 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 92 (197 on baseline) Performance Improvements: 17 (37 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 977 (651 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/messages-2: 15.98% (0.0776 => 0.0900, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 14.98% (1.8006 => 2.0704, std.dev.: 0.0269) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 13.96% (0.5795 => 0.6604, std.dev.: 0.0076) MultiSource/Applications/lambda-0_1_3/lambda: 13.84% (0.8552 => 0.9736, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 13.84% (0.6228 => 0.7090, std.dev.: 0.0173) MultiSource/Applications/SIBsim4/SIBsim4: 13.79% (1.5382 => 1.7503, std.dev.: 0.0086) MultiSource/Applications/lemon/lemon: 13.64% (1.2009 => 1.3647, std.dev.: 0.0130) SingleSource/Benchmarks/Stanford/Oscar: 12.67% (0.0789 => 0.0889, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 12.62% (0.1901 => 0.2141, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 12.49% (0.3130 => 0.3521, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/bigfib: 12.28% (0.7304 => 0.8201, std.dev.: 0.0027) MultiSource/Applications/aha/aha: 12.01% (0.1332 => 0.1492, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 11.88% (0.3408 => 0.3813, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.82% (0.5822 => 0.6510, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.81% (1.4769 => 1.6513, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/lists1: 11.70% (0.4093 => 0.4572, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 11.64% (6.5363 => 7.2974, std.dev.: 0.0169) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.55% (1.3167 => 1.4688, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/09-vor/vor: 11.41% (0.3577 => 0.3985, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/exptree: 11.39% (0.0931 => 0.1037, std.dev.: 0.0041) MultiSource/Applications/Burg/burg: 11.28% (1.3445 => 1.4962, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/ary2: 11.13% (0.3730 => 0.4145, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.06% (0.2243 => 0.2491, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: 11.04% (0.3624 => 0.4024, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 10.75% (0.0958 => 0.1061, std.dev.: 0.0008) SingleSource/Benchmarks/LivermoreLoops/kernel24: 10.74% (0.1006 => 0.1114, std.dev.: 0.0038) SingleSource/Benchmarks/LivermoreLoops/kernel22: 10.53% (0.1016 => 0.1123, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.51% (0.1913 => 0.2114, std.dev.: 0.0014) SingleSource/Benchmarks/LivermoreLoops/kernel17: 10.45% (0.1014 => 0.1120, std.dev.: 0.0009) SingleSource/Benchmarks/LivermoreLoops/kernel23: 10.39% (0.1116 => 0.1232, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.35% (0.1411 => 0.1557, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.31% (0.6373 => 0.7030, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.30% (1.7458 => 1.9257, std.dev.: 0.0140) SingleSource/Benchmarks/LivermoreLoops/kernel21: 10.25% (0.1112 => 0.1226, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 10.25% (0.3902 => 0.4302, std.dev.: 0.0023) SingleSource/Benchmarks/LivermoreLoops/kernel20: 10.06% (0.1044 => 0.1149, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: 10.03% (0.2890 => 0.3180, std.dev.: 0.0007) SingleSource/Benchmarks/LivermoreLoops/kernel18: 10.03% (0.1496 => 0.1646, std.dev.: 0.0044) MultiSource/Applications/treecc/treecc: 10.02% (2.3431 => 2.5779, std.dev.: 0.0160) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.64% (0.1722 => 0.1888, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/parameter-passing: 9.36% (0.4443 => 0.4859, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/synchronized: 9.16% (0.3996 => 0.4362, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.89% (2.3311 => 2.5384, std.dev.: 0.0343) MultiSource/Benchmarks/McCat/05-eks/eks: 8.47% (0.4805 => 0.5212, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/property: 8.38% (0.4378 => 0.4745, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: 8.08% (0.3899 => 0.4214, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.96% (1.0350 => 1.1174, std.dev.: 0.0244) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 7.72% (0.1490 => 0.1605, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.19% (0.3283 => 0.3519, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: 7.19% (0.3158 => 0.3385, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.19% (0.5149 => 0.5519, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/fibo: 7.19% (0.2992 => 0.3207, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.04% (5.0449 => 5.4001, std.dev.: 0.0205) SingleSource/Benchmarks/Misc/flops: 7.00% (0.1985 => 0.2124, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 6.68% (0.6500 => 0.6934, std.dev.: 0.0050) MultiSource/Applications/sgefa/sgefa: 6.46% (0.3545 => 0.3774, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.44% (2.7303 => 2.9062, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/ReedSolomon: 6.36% (0.2200 => 0.2340, std.dev.: 0.0044) SingleSource/UnitTests/ObjC++/property-reference: 5.03% (0.8016 => 0.8419, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/wc: 4.97% (0.3580 => 0.3758, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.63% (0.4061 => 0.4249, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.56% (0.3249 => 0.3397, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.48% (0.4512 => 0.4714, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 4.44% (0.4304 => 0.4495, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.41% (1.6695 => 1.7431, std.dev.: 0.0128) SingleSource/UnitTests/ObjC/exceptions-2: 4.01% (0.4110 => 0.4275, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 3.90% (0.3356 => 0.3487, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.39% (0.4163 => 0.4304, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 3.21% (0.3774 => 0.3895, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions: 2.39% (0.4516 => 0.4624, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: 112.33% (0.1046 => 0.2221, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 37.36% (0.3410 => 0.4684, std.dev.: 0.0100) MultiSource/Applications/minisat/minisat: 31.16% (9.5546 => 12.5316, std.dev.: 0.1495) MultiSource/Benchmarks/McCat/09-vor/vor: 29.68% (0.1213 => 0.1573, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 27.63% (1.3216 => 1.6867, std.dev.: 0.0220) SingleSource/Benchmarks/Shootout-C++/ary3: 22.62% (3.7882 => 4.6450, std.dev.: 0.0903) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 20.15% (3.7971 => 4.5621, std.dev.: 0.1162) SingleSource/Benchmarks/Shootout-C++/ary2: 16.54% (0.0762 => 0.0888, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 11.68% (5.6569 => 6.3175, std.dev.: 0.0638) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.25% (1.7390 => 1.9172, std.dev.: 0.0463) MultiSource/Applications/lemon/lemon: 8.86% (1.4365 => 1.5638, std.dev.: 0.0140) SingleSource/Benchmarks/McGill/chomp: 8.20% (1.2160 => 1.3157, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/heapsort: 7.61% (4.0456 => 4.3536, std.dev.: 0.0790) MultiSource/Applications/sqlite3/sqlite3: 3.21% (4.5987 => 4.7465, std.dev.: 0.0278) SingleSource/Benchmarks/Shootout-C++/lists1: 2.72% (0.6171 => 0.6339, std.dev.: 0.0038) MultiSource/Applications/SIBsim4/SIBsim4: 2.34% (3.8595 => 3.9499, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/ackermann: 1.87% (1.7426 => 1.7752, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.67% (3.0265 => 3.0771, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.58% (61.1135 => 62.0796, std.dev.: 0.0928) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.58% (2.3100 => 2.3465, std.dev.: 0.0032) MultiSource/Applications/lua/lua: 1.36% (27.0990 => 27.4673, std.dev.: 0.0574) SingleSource/Benchmarks/Dhrystone/fldry: 1.29% (1.9423 => 1.9673, std.dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -11.40% (0.3553 => 0.3148, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -10.82% (4.2298 => 3.7720, std.dev.: 0.0010) SingleSource/Benchmarks/LivermoreLoops/kernel01: -10.56% (0.1136 => 0.1016, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: -10.49% (0.6304 => 0.5643, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: -9.26% (0.9897 => 0.8981, std.dev.: 0.0353) SingleSource/Benchmarks/LivermoreLoops/kernel05: -9.17% (0.1112 => 0.1010, std.dev.: 0.0004) SingleSource/Benchmarks/LivermoreLoops/kernel04: -8.83% (0.1167 => 0.1064, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -3.51% (19.9980 => 19.2953, std.dev.: 0.1425) MultiSource/Applications/kimwitu++/kc: -2.52% (21.4140 => 20.8735, std.dev.: 0.0959) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -18.74% (4.6261 => 3.7593, std.dev.: 0.1642) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -11.11% (10.3664 => 9.2143, std.dev.: 0.3290) SingleSource/Benchmarks/Shootout-C++/heapsort: -10.17% (4.3973 => 3.9500, std.dev.: 0.1651) SingleSource/Benchmarks/Misc/ffbench: -6.36% (1.0610 => 0.9935, std.dev.: 0.0200) MultiSource/Applications/JM/lencod/lencod: -4.57% (7.9769 => 7.6124, std.dev.: 0.0174) MultiSource/Applications/siod/siod: -3.83% (3.3147 => 3.1876, std.dev.: 0.0415) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -3.63% (0.5535 => 0.5334, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: -3.31% (3.8363 => 3.7095, std.dev.: 0.0044) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.57% (69.4762 => 69.0809, std.dev.: 0.2315) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 2.24% (0.1337 => 0.1367, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.62% (0.0420 => 0.0431, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0651 => 0.0652, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 0.35% (492.2669 => 493.9855, std.dev.: 0.2959) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.23% (63.2438 => 69.0809, std.dev.: 0.2315) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.02% (4.3882 => 0.0431, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43704.69% (1.1277 => 493.9855, std.dev.: 0.2959) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 234.73% (0.5229 => 1.7503, std.dev.: 0.0086) MultiSource/Applications/SPASS/SPASS: 22.67% (14.9895 => 18.3875, std.dev.: 0.1861) MultiSource/Applications/kimwitu++/kc: 47.46% (14.1553 => 20.8735, std.dev.: 0.0959) MultiSource/Benchmarks/MallocBench/gs/gs: 21.27% (4.1105 => 4.9848, std.dev.: 0.1688) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.36% (1.1048 => 1.5176, std.dev.: 0.0715) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 431.41% (7.1582 => 38.0393, std.dev.: 0.3287) SingleSource/Benchmarks/Misc-C++-EH/spirit: 76.17% (3.4629 => 6.1007, std.dev.: 0.4017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 79.59% (0.6222 => 1.1174, std.dev.: 0.0244) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10472.78% (0.0720 => 7.6124, std.dev.: 0.0174) MultiSource/Applications/SIBsim4/SIBsim4: 3949800.00% (0.0001 => 3.9499, std.dev.: 0.0085) MultiSource/Applications/SPASS/SPASS: 12910300.00% (0.0001 => 12.9104, std.dev.: 1.0115) MultiSource/Applications/kimwitu++/kc: 51900.00% (0.0001 => 0.0520, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575900.00% (0.0001 => 0.5760, std.dev.: 0.0221) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10100200.00% (0.0001 => 10.1003, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5768100.00% (0.0001 => 5.7682, std.dev.: 0.6652) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1768.69% (1.1194 => 20.9181, std.dev.: 0.3801) MultiSource/Applications/ClamAV/clamscan: 70.02% (22.1758 => 37.7026, std.dev.: 0.3018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 64.98% (2.9384 => 4.8478, std.dev.: 0.1538) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.96% (7.0540 => 10.9312, std.dev.: 0.3263) SingleSource/Benchmarks/Misc/flops: 48.32% (0.1432 => 0.2124, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 47.04% (21.9371 => 32.2553, std.dev.: 0.0894) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 45.37% (8.1363 => 11.8276, std.dev.: 0.2209) MultiSource/Benchmarks/FreeBench/distray/distray: 44.98% (0.1056 => 0.1531, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Oscar: 39.78% (0.0636 => 0.0889, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/almabench: 38.36% (0.0730 => 0.1010, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/08-main/main: 37.86% (0.2554 => 0.3521, std.dev.: 0.0082) SingleSource/UnitTests/ObjC/messages-2: 35.95% (0.0662 => 0.0900, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/dot-syntax-1: 35.91% (0.0479 => 0.0651, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 33.80% (0.0793 => 0.1061, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 33.46% (0.1584 => 0.2114, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/17-bintr/bintr: 32.00% (0.0675 => 0.0891, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 31.96% (2.2024 => 2.9062, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout/lists: 31.63% (0.0626 => 0.0824, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/dot-syntax: 31.55% (0.0355 => 0.0467, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/15-trie/trie: 31.31% (0.0527 => 0.0692, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 30.98% (0.7433 => 0.9736, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 30.55% (1.5859 => 2.0704, std.dev.: 0.0269) SingleSource/UnitTests/vla: 30.42% (0.0355 => 0.0463, std.dev.: 0.0025) MultiSource/Applications/aha/aha: 29.63% (0.1151 => 0.1492, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Towers: 29.51% (0.0471 => 0.0610, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 29.37% (0.1655 => 0.2141, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Treesort: 29.20% (0.0411 => 0.0531, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 28.98% (0.0842 => 0.1086, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 28.62% (0.1125 => 0.1447, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 28.52% (1.1642 => 1.4962, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/wordfreq: 28.49% (0.3307 => 0.4249, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/ft/ft: 28.40% (0.1940 => 0.2491, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 27.92% (0.0437 => 0.0559, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.52% (0.5105 => 0.6510, std.dev.: 0.0143) SingleSource/Benchmarks/McGill/exptree: 27.40% (0.0814 => 0.1037, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: 27.28% (1.0722 => 1.3647, std.dev.: 0.0130) MultiSource/Applications/treecc/treecc: 27.16% (2.0273 => 2.5779, std.dev.: 0.0160) SingleSource/Benchmarks/Misc-C++/bigfib: 27.03% (0.6456 => 0.8201, std.dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 26.97% (0.0953 => 0.1210, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 26.86% (0.0886 => 0.1124, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 26.71% (5.7591 => 7.2974, std.dev.: 0.0169) MultiSource/Benchmarks/MallocBench/espresso/espresso: 26.63% (4.2646 => 5.4001, std.dev.: 0.0205) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.54% (0.0746 => 0.0944, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 26.54% (1.3050 => 1.6513, std.dev.: 0.0119) SingleSource/UnitTests/Vector/SSE/sse_shift: 26.46% (0.0378 => 0.0478, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/RealMM: 26.26% (0.0396 => 0.0500, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 26.23% (0.5569 => 0.7030, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 25.98% (0.4203 => 0.5295, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 25.97% (0.1236 => 0.1557, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/18-imp/imp: 25.68% (0.3423 => 0.4302, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/family/family: 25.44% (0.0397 => 0.0498, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: 25.31% (0.3180 => 0.3985, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 25.30% (0.0672 => 0.0842, std.dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: 25.16% (0.0481 => 0.0602, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 25.05% (0.3441 => 0.4303, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 25.03% (0.1510 => 0.1888, std.dev.: 0.0057) SingleSource/Benchmarks/Dhrystone/dry: 25.00% (0.0456 => 0.0570, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 24.92% (1.5415 => 1.9257, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 24.43% (0.0528 => 0.0657, std.dev.: 0.0014) SingleSource/Benchmarks/Stanford/Queens: 24.40% (0.0414 => 0.0515, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.16% (0.0770 => 0.0956, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists1: 24.10% (0.3684 => 0.4572, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 23.86% (0.2905 => 0.3598, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 23.83% (1.1861 => 1.4688, std.dev.: 0.0093) SingleSource/UnitTests/ObjC/parameter-passing: 23.73% (0.3927 => 0.4859, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.35% (0.1062 => 0.1310, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 23.27% (0.3232 => 0.3984, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/ackermann: 23.26% (0.2756 => 0.3397, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/misr: 23.22% (0.0633 => 0.0780, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 23.17% (0.2831 => 0.3487, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 23.13% (0.3052 => 0.3758, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: 23.08% (0.3098 => 0.3813, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 22.89% (0.1695 => 0.2083, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 22.87% (1.4186 => 1.7431, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C++/city/city: 22.84% (2.0665 => 2.5384, std.dev.: 0.0343) SingleSource/Benchmarks/Shootout-C++/ary2: 22.67% (0.3379 => 0.4145, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_isamax: 22.59% (0.0704 => 0.0863, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 22.57% (0.3283 => 0.4024, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.54% (0.0457 => 0.0560, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/synchronized: 22.49% (0.3561 => 0.4362, std.dev.: 0.0097) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.41% (0.1566 => 0.1917, std.dev.: 0.0097) MultiSource/Benchmarks/NPB-serial/is/is: 22.39% (0.0719 => 0.0880, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: 22.25% (0.3497 => 0.4275, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/life/life: 22.19% (0.0933 => 0.1140, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/property: 22.10% (0.3886 => 0.4745, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-3: 21.99% (0.3516 => 0.4289, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 21.89% (0.4103 => 0.5001, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout/matrix: 21.76% (0.0818 => 0.0996, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 21.72% (0.2891 => 0.3519, std.dev.: 0.0029) MultiSource/Applications/lua/lua: 21.69% (3.8723 => 4.7123, std.dev.: 0.1166) SingleSource/UnitTests/ObjC/for-in: 21.68% (0.3694 => 0.4495, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 21.66% (0.2871 => 0.3493, std.dev.: 0.0164) SingleSource/UnitTests/ObjC/instance-method-metadata: 21.48% (0.3543 => 0.4304, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 21.39% (0.3109 => 0.3774, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/exceptions-4: 21.37% (0.3543 => 0.4300, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.36% (0.2758 => 0.3347, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/trivial-interface: 21.34% (0.3473 => 0.4214, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 21.24% (0.4299 => 0.5212, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 20.92% (0.3427 => 0.4144, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions: 20.79% (0.3828 => 0.4624, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 20.71% (0.3162 => 0.3817, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.80% (0.3935 => 0.4714, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 19.31% (0.8921 => 1.0644, std.dev.: 0.0198) SingleSource/Benchmarks/CoyoteBench/lpbench: 19.16% (0.0929 => 0.1107, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 19.05% (0.4636 => 0.5519, std.dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.68% (0.6450 => 0.7655, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/oourafft: 18.68% (0.3282 => 0.3895, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 18.40% (0.1337 => 0.1583, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 18.37% (0.5981 => 0.7080, std.dev.: 0.0162) MultiSource/Benchmarks/Olden/bh/bh: 18.11% (0.3092 => 0.3652, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 17.97% (0.3650 => 0.4306, std.dev.: 0.0207) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.89% (14.3668 => 16.9370, std.dev.: 0.4808) SingleSource/Benchmarks/Shootout-C++/fibo: 17.69% (0.2725 => 0.3207, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/methcall: 17.66% (0.2877 => 0.3385, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.54% (0.0798 => 0.0938, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.16% (0.8172 => 0.9574, std.dev.: 0.0386) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.09% (0.2065 => 0.2418, std.dev.: 0.0098) SingleSource/UnitTests/ObjC++/Hello: 17.03% (0.5925 => 0.6934, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/bisort/bisort: 16.61% (0.0614 => 0.0716, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 16.56% (0.0640 => 0.0746, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 16.51% (0.1163 => 0.1355, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.36% (0.0648 => 0.0754, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.13% (0.1029 => 0.1195, std.dev.: 0.0040) MultiSource/Applications/viterbi/viterbi: 15.95% (0.1555 => 0.1803, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 15.90% (0.1906 => 0.2209, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.84% (0.0770 => 0.0892, std.dev.: 0.0037) MultiSource/Applications/siod/siod: 15.61% (2.2969 => 2.6555, std.dev.: 0.1068) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.49% (0.1117 => 0.1290, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 15.38% (0.1268 => 0.1463, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.93% (0.3121 => 0.3587, std.dev.: 0.0096) SingleSource/UnitTests/ObjC++/property-reference: 14.92% (0.7326 => 0.8419, std.dev.: 0.0132) MultiSource/Applications/hbd/hbd: 14.88% (1.5603 => 1.7924, std.dev.: 0.0444) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.76% (0.2107 => 0.2418, std.dev.: 0.0118) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.75% (0.0834 => 0.0957, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: 14.63% (0.7835 => 0.8981, std.dev.: 0.0353) SingleSource/UnitTests/ObjC++/property-reference-object: 14.49% (0.6030 => 0.6904, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.48% (4.9449 => 5.6608, std.dev.: 0.1909) MultiSource/Benchmarks/mafft/pairlocalalign: 14.44% (9.4845 => 10.8540, std.dev.: 0.3154) SingleSource/Benchmarks/Misc/ReedSolomon: 14.20% (0.2049 => 0.2340, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/block-byref-aggr: 14.09% (0.3817 => 0.4355, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.05% (0.9765 => 1.1137, std.dev.: 0.0453) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.04% (0.5860 => 0.6683, std.dev.: 0.0270) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.87% (0.2271 => 0.2586, std.dev.: 0.0094) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.30% (0.1143 => 0.1295, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 13.09% (3.3354 => 3.7720, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.41% (0.5020 => 0.5643, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 12.31% (17.1811 => 19.2953, std.dev.: 0.1425) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.21% (0.1695 => 0.1902, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/hash2: 12.03% (0.4620 => 0.5176, std.dev.: 0.0134) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.84% (5.0018 => 5.5939, std.dev.: 0.1943) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.61% (0.2872 => 0.3148, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.97% (0.4879 => 0.5268, std.dev.: 0.0116) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.10% (4.3953 => 10.9928, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 147.38% (5.3999 => 13.3582, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/17-bintr/bintr: 112.94% (0.1043 => 0.2221, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 43.86% (0.3256 => 0.4684, std.dev.: 0.0100) MultiSource/Applications/minisat/minisat: 37.47% (9.1159 => 12.5316, std.dev.: 0.1495) MultiSource/Benchmarks/McCat/09-vor/vor: 36.31% (0.1154 => 0.1573, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 31.38% (1.2838 => 1.6867, std.dev.: 0.0220) SingleSource/Benchmarks/Shootout-C++/ary3: 24.80% (3.7221 => 4.6450, std.dev.: 0.0903) SingleSource/Benchmarks/Misc/oourafft: 17.56% (6.6465 => 7.8135, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.53% (1.1145 => 1.3099, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary2: 17.31% (0.0757 => 0.0888, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.15% (0.2944 => 0.3331, std.dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.01% (2.0360 => 2.3009, std.dev.: 0.1024) SingleSource/Benchmarks/Shootout/heapsort: 13.00% (3.8526 => 4.3536, std.dev.: 0.0790) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.57% (2.8904 => 3.2248, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 10.10% (1.1396 => 1.2547, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.35% (1.7254 => 1.8868, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 8.15% (1.4460 => 1.5638, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout/strcat: 7.00% (0.1899 => 0.2032, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/chomp: 6.34% (1.2373 => 1.3157, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.93% (4.2280 => 4.4786, std.dev.: 0.0025) MultiSource/Applications/lua/lua: 5.27% (26.0924 => 27.4673, std.dev.: 0.0574) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 5.03% (1.9405 => 2.0381, std.dev.: 0.0254) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.14% (11.6436 => 12.1257, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.61% (1.7133 => 1.7752, std.dev.: 0.0111) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.36% (0.4162 => 0.4302, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 2.72% (0.6171 => 0.6339, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/dry: 2.58% (2.4116 => 2.4739, std.dev.: 0.0151) MultiSource/Applications/sgefa/sgefa: 2.35% (0.6223 => 0.6369, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: 2.20% (4.6441 => 4.7465, std.dev.: 0.0278) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.13% (1.3677 => 1.3968, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 2.04% (3.1595 => 3.2240, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.92% (3.6395 => 3.7095, std.dev.: 0.0044) MultiSource/Benchmarks/PAQ8p/paq8p: 1.82% (85.0658 => 86.6104, std.dev.: 0.1767) SingleSource/Benchmarks/Shootout-C++/sieve: 1.54% (2.4858 => 2.5242, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.48% (6.5088 => 6.6049, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/sieve: 1.47% (5.2139 => 5.2905, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.43% (2.3135 => 2.3465, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 1.37% (27.8444 => 28.2246, std.dev.: 0.0508) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0505, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.37% (6.6874 => 0.1759, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -75.88% (0.8651 => 0.2087, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.87% (5.2763 => 1.2733, std.dev.: 0.0410) SingleSource/Benchmarks/Misc/richards_benchmark: -44.64% (0.1622 => 0.0898, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.34% (5.3855 => 4.6671, std.dev.: 0.1092) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.96% (5.3526 => 4.6587, std.dev.: 0.1663) MultiSource/Applications/JM/ldecod/ldecod: -7.40% (10.4361 => 9.6634, std.dev.: 0.1738) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.31% (0.3987 => 0.2380, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.36% (4.5009 => 2.7743, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.19% (2.6546 => 2.0124, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/mason/mason: -19.30% (0.2161 => 0.1744, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4249, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2840, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.70% (32.5116 => 29.0339, std.dev.: 0.0201) SingleSource/Benchmarks/Misc/mandel-2: -10.63% (1.5373 => 1.3739, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -10.46% (9.5636 => 8.5628, std.dev.: 0.1855) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4245, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.95% (4.8142 => 4.4797, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.07% (3.2416 => 3.0771, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5084, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -4.48% (6.2999 => 6.0179, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.36% (0.9957 => 0.9622, std.dev.: 0.0070) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8913, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.16% (0.4808 => 0.4704, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6771, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.71% (8.1563 => 8.0171, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -1.46% (10.2830 => 10.1327, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -7.95% (0.1485 => 0.1367, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0016) Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 04:17:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 06:17:21 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121126121721.DA3852A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6264?compare_to=6261&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6264, Order: 168583, Start Time: 2012-11-26 10:46:30, End Time: 2012-11-26 12:17:53 To: 6261, Order: 168582, Start Time: 2012-11-26 08:57:49, End Time: 2012-11-26 10:29:14 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 5 (97 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1049 (853 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.83% (0.8438 => 0.8592, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.80% (0.9012 => 0.9174, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.55% (0.9328 => 0.9473, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel12: 18.38% (0.1170 => 0.1385, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.14% (6.5744 => 7.1095, std.dev.: 0.1698) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.01% (1.0735 => 1.0734, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.91% (0.0220 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0430 => 0.0432, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -6.87% (0.0335 => 0.0312, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -18.04% (0.0316 => 0.0259, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.11% (0.0427 => 0.0418, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0205 => 0.0204, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 3.21% (0.0218 => 0.0225, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1473 => 0.1471, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -4.64% (1.2005 => 1.1448, std.dev.: 0.0258) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.59% (0.4207 => 0.4140, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.20% (0.1439 => 0.1485, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.35% (0.0594 => 0.0602, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -21.46% (0.0233 => 0.0183, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.42% (0.0546 => 0.0592, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.32% (1.1975 => 1.1937, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.64% (0.0624 => 0.0620, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.80% (0.0222 => 0.0218, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.7784 => 0.7784, std.dev.: 0.0627) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -39.32% (0.0117 => 0.0071, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.52% (16.4461 => 17.6834, std.dev.: 0.0195) MultiSource/Applications/sqlite3/sqlite3: 2317.40% (0.6332 => 15.3070, std.dev.: 0.1710) MultiSource/Benchmarks/McCat/08-main/main: 49.54% (0.1831 => 0.2738, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.61% (0.1559 => 0.1456, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7126.19% (0.3123 => 22.5674, std.dev.: 0.2786) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.28% (0.2463 => 0.3726, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1549.49% (0.3344 => 5.5159, std.dev.: 0.7278) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.87% (0.2364 => 0.3283, std.dev.: 0.1136) SingleSource/Benchmarks/Misc-C++/bigfib: 4.83% (0.6010 => 0.6300, std.dev.: 0.0856) SingleSource/Benchmarks/Misc/mandel: 2.56% (0.0429 => 0.0440, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.21% (0.3266 => 0.3436, std.dev.: 0.1272) SingleSource/Benchmarks/Shootout-C++/strcat: 5.03% (0.1969 => 0.2068, std.dev.: 0.0657) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0224 => 0.0224, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0465, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 7.32% (0.1462 => 0.1569, std.dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4680, std.dev.: 0.0377) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0680, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4945, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5128, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5669, std.dev.: 0.1764) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3176, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1341, std.dev.: 0.0165) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3629, std.dev.: 0.0197) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4067, std.dev.: 0.0754) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0889, std.dev.: 0.0172) SingleSource/Regression/C/uint64_to_float: -24.25% (2.1832 => 1.6538, std.dev.: 0.0073) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.65% (0.0810 => 0.0953, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.84% (0.0773 => 0.0880, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.44% (0.0848 => 0.0962, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 11.60% (0.1112 => 0.1241, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.82% (0.4847 => 0.5226, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.89% (0.7473 => 0.7988, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.01% (0.2279 => 0.2416, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.76% (0.8148 => 0.8617, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.39% (0.6287 => 0.6626, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.35% (0.1905 => 0.2007, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.31% (0.1885 => 0.1985, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.17% (0.5961 => 0.6269, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.14% (1.1685 => 1.2286, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.11% (1.1606 => 1.2199, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.78% (0.2240 => 0.2347, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.64% (0.2998 => 0.3137, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.40% (0.9074 => 0.9473, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.33% (0.3003 => 0.3133, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 4.19% (0.8805 => 0.9174, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 4.01% (0.8261 => 0.8592, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.93% (0.4127 => 0.4289, std.dev.: 0.0025) MultiSource/Applications/lua/lua: 3.83% (3.8189 => 3.9652, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.76% (0.9435 => 0.9790, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.71% (4.1763 => 4.3312, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.67% (1.3279 => 1.3766, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.61% (1.2526 => 1.2978, std.dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.41% (0.4783 => 0.4946, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 3.40% (31.8598 => 32.9433, std.dev.: 0.0416) MultiSource/Applications/minisat/minisat: 3.25% (0.6834 => 0.7056, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.23% (0.8007 => 0.8266, std.dev.: 0.0057) MultiSource/Benchmarks/nbench/nbench: 3.23% (1.1271 => 1.1635, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.96% (0.8317 => 0.8563, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.94% (13.1811 => 13.5687, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 2.91% (4.1305 => 4.2508, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.88% (0.8086 => 0.8319, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.82% (4.4873 => 4.6138, std.dev.: 0.0117) MultiSource/Applications/SIBsim4/SIBsim4: 2.76% (1.2568 => 1.2915, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.75% (0.8359 => 0.8589, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.74% (0.8457 => 0.8689, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.66% (1.6386 => 1.6822, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.65% (0.7932 => 0.8142, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.64% (0.8716 => 0.8946, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.62% (4.4880 => 4.6058, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.60% (0.9069 => 0.9305, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.60% (0.8656 => 0.8881, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.60% (0.7966 => 0.8173, std.dev.: 0.0055) MultiSource/Benchmarks/PAQ8p/paq8p: 2.58% (2.3764 => 2.4377, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.53% (0.9039 => 0.9268, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.47% (0.8286 => 0.8491, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.44% (0.9908 => 1.0150, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.40% (0.8331 => 0.8531, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.40% (0.8712 => 0.8921, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/football/football: 2.40% (0.8768 => 0.8978, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.39% (6.6074 => 6.7656, std.dev.: 0.0457) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.38% (0.8420 => 0.8620, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.37% (0.8597 => 0.8801, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/05-eks/eks: 2.37% (0.4397 => 0.4501, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.31% (0.6227 => 0.6371, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.27% (8.6476 => 8.8443, std.dev.: 0.0379) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.24% (1.4479 => 1.4803, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.19% (0.8050 => 0.8226, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.18% (0.8338 => 0.8520, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.15% (0.8995 => 0.9188, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.11% (4.5702 => 4.6665, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.07% (0.8927 => 0.9112, std.dev.: 0.0052) MultiSource/Applications/lambda-0_1_3/lambda: 1.81% (0.7557 => 0.7694, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.74% (1.2423 => 1.2639, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.13% (1.2602 => 1.2745, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 105.03% (0.0199 => 0.0408, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/pi: 57.32% (1.5795 => 2.4849, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.62% (0.7597 => 0.8860, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.07% (2.9753 => 3.4533, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.54% (2.7995 => 3.2065, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.58% (5.0261 => 5.6082, std.dev.: 0.0330) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.48% (6.3772 => 7.1095, std.dev.: 0.1698) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.20% (1.1857 => 1.2829, std.dev.: 0.0162) SingleSource/Benchmarks/McGill/queens: 7.58% (1.7056 => 1.8348, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.80% (4.7794 => 5.1046, std.dev.: 0.0149) MultiSource/Applications/SIBsim4/SIBsim4: 5.89% (3.1873 => 3.3751, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.85% (4.9686 => 5.2594, std.dev.: 0.0251) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.81% (0.3186 => 0.3371, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.80% (4.5327 => 4.7954, std.dev.: 0.0204) MultiSource/Applications/lambda-0_1_3/lambda: 5.11% (7.4933 => 7.8759, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.69% (3.3761 => 3.5345, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.67% (6.2275 => 6.5185, std.dev.: 0.0308) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.21% (4.9453 => 5.1536, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.03% (4.9469 => 5.1461, std.dev.: 0.0159) MultiSource/Applications/hexxagon/hexxagon: 3.95% (14.0064 => 14.5592, std.dev.: 0.0240) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.32% (1.2337 => 1.2746, std.dev.: 0.0046) MultiSource/Applications/siod/siod: 2.91% (3.6643 => 3.7709, std.dev.: 0.0315) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.87% (8.2783 => 8.5156, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.83% (11.5690 => 11.8959, std.dev.: 0.0191) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.01% (1.1365 => 1.1594, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.81% (4.8362 => 4.9235, std.dev.: 0.0255) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.44% (2.4647 => 2.5002, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/neural/neural: 1.29% (1.0841 => 1.0981, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 1.02% (1.2061 => 1.2184, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -32.84% (0.0338 => 0.0227, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: -21.19% (5.4641 => 4.3065, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.56% (7.2130 => 6.2346, std.dev.: 0.0738) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.74% (1.0512 => 0.9383, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: -10.14% (1.1216 => 1.0079, std.dev.: 0.0337) MultiSource/Benchmarks/mafft/pairlocalalign: -8.52% (63.1822 => 57.8008, std.dev.: 0.1295) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.24% (14.6451 => 13.4388, std.dev.: 0.0747) MultiSource/Benchmarks/nbench/nbench: -7.75% (21.9654 => 20.2640, std.dev.: 0.5598) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.13% (0.3269 => 0.3036, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.87% (4.7482 => 4.4222, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.98% (3.7148 => 3.4927, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.89% (5.4972 => 5.1733, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.17% (5.1557 => 4.8893, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.39% (4.7449 => 4.5365, std.dev.: 0.0416) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.46% (6.0224 => 5.8143, std.dev.: 0.0251) MultiSource/Applications/lua/lua: -3.40% (29.8330 => 28.8198, std.dev.: 0.2016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.13% (0.5807 => 0.5625, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.00% (28.5821 => 27.7243, std.dev.: 0.0411) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.97% (2.6356 => 2.5573, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: -2.40% (3.4237 => 3.3417, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.99% (11.5316 => 11.3020, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.62% (4.9994 => 4.9184, std.dev.: 0.0305) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.3487 => 2.3186, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.21% (5.6343 => 5.5664, std.dev.: 0.0192) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.60% (1.0262 => 1.0734, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.88% (0.0408 => 0.0432, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 22.83% (0.0254 => 0.0312, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -14.24% (0.0302 => 0.0259, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.85% (0.0384 => 0.0418, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 25.00% (0.0180 => 0.0225, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.29% (0.1438 => 0.1471, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.05% (1.1329 => 1.1448, std.dev.: 0.0258) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.58% (0.4164 => 0.4140, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.47% (0.1369 => 0.1485, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.08% (0.0641 => 0.0602, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.15% (0.0195 => 0.0183, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.42% (0.0578 => 0.0592, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.37% (1.1437 => 1.1937, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.12% (0.0627 => 0.0620, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 21.11% (0.0180 => 0.0218, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.91% (0.8017 => 0.7784, std.dev.: 0.0627) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 14.52% (0.0062 => 0.0071, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 04:32:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 06:32:07 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121126123207.75C5E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6265?compare_to=6262&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6265, Order: 168583, Start Time: 2012-11-26 10:58:54, End Time: 2012-11-26 12:32:38 To: 6262, Order: 168582, Start Time: 2012-11-26 09:02:31, End Time: 2012-11-26 10:36:04 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 3 (4 on baseline) Performance Improvements: 0 (179 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1089 (859 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 13.25% (0.3562 => 0.4034, std.dev.: 0.0170) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.79% (78.9970 => 80.4107, std.dev.: 0.5087) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.56% (1.2762 => 1.2961, std.dev.: 0.0008) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1012, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4937 => 7.6670, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/hash2: 2.26% (3.1932 => 3.2654, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.08% (0.1431 => 0.1301, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.06% (0.3821 => 0.3513, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -7.05% (0.3831 => 0.3561, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -7.02% (0.3848 => 0.3578, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -7.01% (0.3880 => 0.3608, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -6.96% (2.4924 => 2.3190, std.dev.: 0.0075) SingleSource/UnitTests/ObjC/synchronized: -6.93% (0.3896 => 0.3626, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -6.87% (0.4033 => 0.3756, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -6.85% (0.3812 => 0.3551, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.81% (0.3142 => 0.2928, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -6.68% (0.4176 => 0.3897, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.60% (0.3891 => 0.3634, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.46% (0.3357 => 0.3140, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.46% (0.3884 => 0.3633, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.38% (0.9542 => 0.8933, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.37% (0.2355 => 0.2205, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -6.30% (0.2160 => 0.2024, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -6.26% (0.4199 => 0.3936, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.11% (9.2283 => 8.6649, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.10% (0.2428 => 0.2280, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: -5.96% (16.1920 => 15.2268, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.90% (0.1796 => 0.1690, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.90% (0.9852 => 0.9271, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.88% (0.7198 => 0.6775, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.86% (0.6484 => 0.6104, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.86% (1.3722 => 1.2918, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/parameter-passing: -5.84% (0.4280 => 0.4030, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.82% (4.8161 => 4.5357, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.81% (4.0323 => 3.7982, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: -5.71% (7.0961 => 6.6907, std.dev.: 0.0151) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.70% (6.7716 => 6.3858, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.65% (0.5591 => 0.5275, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.63% (4.8802 => 4.6053, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.61% (1.0544 => 0.9953, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: -5.60% (0.4515 => 0.4262, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.57% (0.5705 => 0.5387, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.56% (0.5863 => 0.5537, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.55% (0.5478 => 0.5174, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -5.54% (1.1530 => 1.0891, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.53% (1.6364 => 1.5459, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.53% (0.2695 => 0.2546, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: -5.52% (0.9179 => 0.8672, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.49% (0.6297 => 0.5951, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.47% (1.2300 => 1.1627, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.45% (0.5857 => 0.5538, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.44% (0.5859 => 0.5540, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.44% (0.6304 => 0.5961, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.39% (0.5802 => 0.5489, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.39% (0.6230 => 0.5894, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.39% (4.5069 => 4.2639, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.38% (0.5925 => 0.5606, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.38% (0.5575 => 0.5275, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.37% (0.6667 => 0.6309, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.35% (0.6052 => 0.5728, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.34% (0.3406 => 0.3224, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.34% (0.5581 => 0.5283, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.34% (0.6446 => 0.6102, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.34% (0.5941 => 0.5624, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.33% (1.2221 => 1.1570, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.31% (0.5570 => 0.5274, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.30% (3.5339 => 3.3465, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.30% (0.3057 => 0.2895, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.28% (0.2933 => 0.2778, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -5.28% (0.3255 => 0.3083, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.28% (1.2210 => 1.1565, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.28% (8.0126 => 7.5896, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.28% (0.5456 => 0.5168, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.28% (0.3658 => 0.3465, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: -5.27% (0.2939 => 0.2784, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.27% (1.4642 => 1.3870, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.26% (0.6293 => 0.5962, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.6736 => 0.6382, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -5.25% (1.1450 => 1.0849, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.24% (0.3016 => 0.2858, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.23% (0.5849 => 0.5543, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.23% (0.6660 => 0.6312, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -5.22% (0.2871 => 0.2721, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.22% (0.5805 => 0.5502, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.22% (14.2083 => 13.4673, std.dev.: 0.0210) SingleSource/Benchmarks/Shootout-C++/wc: -5.21% (0.3205 => 0.3038, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.18% (0.6260 => 0.5936, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.17% (0.6189 => 0.5869, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.17% (0.4916 => 0.4662, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: -5.16% (1.3864 => 1.3148, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: -5.16% (0.2985 => 0.2831, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.15% (0.8521 => 0.8082, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.15% (1.2784 => 1.2126, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: -5.14% (0.3446 => 0.3269, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.13% (0.2903 => 0.2754, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: -5.12% (0.2849 => 0.2703, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.12% (0.3025 => 0.2870, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.10% (0.2999 => 0.2846, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.10% (17.1032 => 16.2314, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.09% (0.6033 => 0.5726, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.09% (0.3323 => 0.3154, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.08% (0.5999 => 0.5694, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.08% (0.6676 => 0.6337, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.07% (0.2385 => 0.2264, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -5.06% (0.3026 => 0.2873, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.05% (0.2001 => 0.1900, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.05% (0.6440 => 0.6115, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -5.02% (0.2989 => 0.2839, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.01% (0.4151 => 0.3943, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.00% (0.2278 => 0.2164, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.99% (0.5688 => 0.5404, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -4.99% (4.3330 => 4.1168, std.dev.: 0.0111) MultiSource/Applications/hexxagon/hexxagon: -4.98% (1.3148 => 1.2493, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.98% (0.7919 => 0.7525, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: -4.97% (0.3581 => 0.3403, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.95% (0.3837 => 0.3647, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -4.95% (0.3394 => 0.3226, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.94% (0.6681 => 0.6351, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: -4.92% (3.5154 => 3.3425, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/objinst: -4.92% (0.3194 => 0.3037, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.91% (2.1713 => 2.0647, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.88% (0.3931 => 0.3739, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.86% (0.3849 => 0.3662, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -4.85% (0.2659 => 0.2530, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.83% (0.3252 => 0.3095, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.83% (0.2548 => 0.2425, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -4.80% (0.3481 => 0.3314, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.79% (0.3319 => 0.3160, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -4.75% (15.2527 => 14.5284, std.dev.: 0.0133) MultiSource/Applications/Burg/burg: -4.73% (1.2515 => 1.1923, std.dev.: 0.0064) MultiSource/Applications/SPASS/SPASS: -4.73% (15.5079 => 14.7747, std.dev.: 0.0060) MultiSource/Applications/minisat/minisat: -4.73% (0.7447 => 0.7095, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.71% (0.3483 => 0.3319, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.69% (0.7021 => 0.6692, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: -4.67% (0.4861 => 0.4634, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.61% (0.6395 => 0.6100, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.60% (0.7524 => 0.7178, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -4.59% (0.4248 => 0.4053, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.56% (0.4083 => 0.3897, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: -4.53% (5.0226 => 4.7950, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists: -4.53% (0.3621 => 0.3457, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.49% (0.4321 => 0.4127, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.47% (0.5569 => 0.5320, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.47% (0.7339 => 0.7011, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.43% (0.5329 => 0.5093, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.40% (0.4813 => 0.4601, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.39% (0.6395 => 0.6114, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.38% (0.3059 => 0.2925, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -4.34% (0.3867 => 0.3699, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.34% (22.4056 => 21.4325, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash: -4.31% (0.4524 => 0.4329, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.31% (1.6474 => 1.5764, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -4.30% (4.0594 => 3.8849, std.dev.: 0.0645) SingleSource/UnitTests/ObjC++/Hello: -4.29% (0.6347 => 0.6075, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.28% (0.9557 => 0.9148, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.28% (0.5567 => 0.5329, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -4.24% (0.8418 => 0.8061, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: -4.22% (0.6441 => 0.6169, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -4.22% (0.3271 => 0.3133, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.16% (0.4427 => 0.4243, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.11% (0.9077 => 0.8704, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: -4.07% (0.3788 => 0.3634, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -4.01% (0.6750 => 0.6479, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: -4.00% (2.1401 => 2.0545, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -3.95% (34.0927 => 32.7455, std.dev.: 0.0089) SingleSource/UnitTests/ObjC++/property-reference: -3.93% (0.7779 => 0.7473, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.91% (0.5168 => 0.4966, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -3.88% (2.4021 => 2.3088, std.dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: -3.88% (0.7982 => 0.7672, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.78% (0.3491 => 0.3359, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.68% (2.2587 => 2.1756, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -3.49% (1.5610 => 1.5065, std.dev.: 0.0045) MultiSource/Applications/kimwitu++/kc: -3.47% (18.2933 => 17.6588, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.90% (5.4682 => 5.3095, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -2.41% (20.7746 => 20.2730, std.dev.: 0.0323) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7522, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1728, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -4.03% (2.2633 => 2.1720, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4707, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.03% (1.3096 => 1.2961, std.dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 05:37:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 07:37:16 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121126133716.765FD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6266?compare_to=6260&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6266, Order: 168583, Start Time: 2012-11-26 10:16:58, End Time: 2012-11-26 13:37:47 To: 6260, Order: 168580, Start Time: 2012-11-26 06:05:25, End Time: 2012-11-26 09:28:53 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 23 (173 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1069 (717 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 2.90% (0.3892 => 0.4005, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 2.84% (0.3902 => 0.4013, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 2.84% (0.3870 => 0.3980, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.84% (0.3914 => 0.4025, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 2.84% (0.3879 => 0.3989, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 2.82% (0.3935 => 0.4046, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 2.69% (0.4084 => 0.4194, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 2.61% (0.4171 => 0.4280, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/property: 2.59% (0.4100 => 0.4206, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 1.85% (0.6794 => 0.6920, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.78% (3.1339 => 3.1898, std.dev.: 0.0068) SingleSource/UnitTests/ObjC++/property-reference: 1.74% (0.8196 => 0.8339, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference-object: 1.50% (0.6866 => 0.6969, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 1.38% (1.2436 => 1.2607, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 1.35% (6.1601 => 6.2433, std.dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: 1.28% (2.3560 => 2.3861, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.22% (5.0910 => 5.1532, std.dev.: 0.0072) MultiSource/Applications/hexxagon/hexxagon: 1.18% (1.1314 => 1.1448, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 1.14% (0.8894 => 0.8995, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.13% (2.3603 => 2.3870, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.03% (1.8822 => 1.9016, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.03% (4.1411 => 4.1837, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 1.00% (4.8395 => 4.8880, std.dev.: 0.0065) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.44% (0.0625 => 0.0884, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.83% (0.1063 => 0.1412, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.81% (0.2969 => 0.3765, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.47% (0.0714 => 0.0903, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.31% (0.1106 => 0.1397, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.22% (0.4253 => 0.5368, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.27% (0.4139 => 0.5185, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 24.94% (1.5932 => 1.9906, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.21% (0.0475 => 0.0590) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.01% (0.4994 => 0.6193, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.86% (0.5900 => 0.7308, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.58% (0.0547 => 0.0676, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.46% (0.0584 => 0.0721, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.42% (0.5000 => 0.6171, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.78% (0.1620 => 0.1989, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 22.54% (0.0599 => 0.0734, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.53% (0.1021 => 0.1251, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.41% (0.0897 => 0.1098, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.40% (0.1107 => 0.1355, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.58% (0.0584 => 0.0710, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.33% (0.0633 => 0.0768) MultiSource/Benchmarks/Olden/em3d/em3d: 21.20% (0.0948 => 0.1149, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.07% (0.0541 => 0.0655, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.03% (0.1103 => 0.1335, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.91% (0.3903 => 0.4719, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.87% (0.0642 => 0.0776, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.81% (0.0495 => 0.0598, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 20.71% (0.0821 => 0.0991, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.66% (0.1549 => 0.1869, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.64% (0.1003 => 0.1210, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 20.38% (0.1619 => 0.1949, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.32% (0.0822 => 0.0989, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.26% (0.1604 => 0.1929, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/power/power: 20.03% (0.0604 => 0.0725, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.56% (0.1462 => 0.1748, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 19.54% (0.0947 => 0.1132, std.dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 19.31% (0.0808 => 0.0964) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.02% (0.3890 => 0.4630, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.92% (0.2014 => 0.2395, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 18.88% (0.1218 => 0.1448, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.82% (0.2736 => 0.3251, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 18.78% (0.5826 => 0.6920, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 18.62% (0.0698 => 0.0828, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 18.47% (0.4029 => 0.4773, std.dev.: 0.0045) SingleSource/UnitTests/ObjC++/property-reference-object: 18.34% (0.5889 => 0.6969, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.23% (1.3152 => 1.5550, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.21% (0.2866 => 0.3388, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 18.21% (0.1505 => 0.1779, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.20% (0.1088 => 0.1286, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.83% (0.0572 => 0.0674, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.63% (0.0573 => 0.0674, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 17.58% (0.5546 => 0.6521, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 17.44% (1.8794 => 2.2071, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.43% (3.5627 => 4.1837, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.39% (0.4658 => 0.5468, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.38% (0.1968 => 0.2310, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.36% (0.0605 => 0.0710, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.30% (1.6211 => 1.9016, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.98% (0.1160 => 0.1357, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.97% (0.3271 => 0.3826, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 16.94% (1.0781 => 1.2607, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.88% (2.7292 => 3.1898, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.76% (0.4361 => 0.5092, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/18-imp/imp: 16.75% (0.1421 => 0.1659, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.73% (0.2875 => 0.3356, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 16.62% (0.9697 => 1.1309, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.60% (4.4195 => 5.1532, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.51% (0.5026 => 0.5856, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.34% (0.3930 => 0.4572, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 16.29% (0.7171 => 0.8339, std.dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: 16.08% (4.2109 => 4.8880, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/fibo: 16.07% (0.2725 => 0.3163, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 16.07% (0.2750 => 0.3192, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.07% (0.2738 => 0.3178, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 16.04% (0.1284 => 0.1490, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 15.99% (0.2714 => 0.3148, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 15.91% (0.2823 => 0.3272, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 15.90% (0.2780 => 0.3222, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 15.88% (0.3004 => 0.3481, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 15.88% (0.2803 => 0.3248, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.87% (0.2729 => 0.3162, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 15.82% (0.3465 => 0.4013, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.80% (0.3488 => 0.4039, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.76% (0.2792 => 0.3232, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 15.76% (0.3446 => 0.3989, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 15.75% (0.3460 => 0.4005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.75% (1.9694 => 2.2795, std.dev.: 0.0092) SingleSource/UnitTests/ObjC/for-in: 15.73% (0.3496 => 0.4046, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 15.71% (0.2813 => 0.3255, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 15.69% (0.2811 => 0.3252, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/trivial-interface: 15.63% (0.3442 => 0.3980, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/synchronized: 15.62% (0.3469 => 0.4011, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.56% (0.2911 => 0.3364, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.56% (1.9966 => 2.3072, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wc: 15.54% (0.3096 => 0.3577, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 15.53% (0.9909 => 1.1448, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.50% (0.1090 => 0.1259, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.49% (0.3195 => 0.3690, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.46% (2.0673 => 2.3870, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 15.37% (0.2075 => 0.2394, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 15.27% (0.3267 => 0.3766, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 15.23% (0.3650 => 0.4206, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 15.23% (23.5202 => 27.1019, std.dev.: 0.0257) SingleSource/UnitTests/ObjC/exceptions: 15.12% (0.3643 => 0.4194, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 15.10% (0.3258 => 0.3750, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 15.08% (0.2566 => 0.2953, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 14.98% (0.3317 => 0.3814, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 14.93% (0.3724 => 0.4280, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.67% (0.3060 => 0.3509, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.66% (0.3362 => 0.3855, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 14.60% (1.4269 => 1.6352, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 14.57% (0.3678 => 0.4214, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.47% (0.3124 => 0.3576, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 14.46% (0.3348 => 0.3832, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.38% (0.3282 => 0.3754, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 14.24% (0.3477 => 0.3972, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 14.22% (0.3726 => 0.4256, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 14.22% (0.7875 => 0.8995, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.12% (0.3625 => 0.4137, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 13.84% (0.4146 => 0.4720, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 13.79% (2.1653 => 2.4638, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hash2: 13.78% (0.4251 => 0.4837, std.dev.: 0.0149) MultiSource/Benchmarks/sim/sim: 13.72% (0.0758 => 0.0862, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.69% (0.3981 => 0.4526, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.69% (0.3690 => 0.4195, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 13.55% (2.1013 => 2.3861, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.47% (0.3845 => 0.4363, std.dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 13.40% (4.6177 => 5.2364, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/bigfib: 13.37% (0.5012 => 0.5682, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.09% (0.2040 => 0.2307, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 12.97% (0.2691 => 0.3040, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 12.66% (5.5417 => 6.2433, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.03% (0.6435 => 0.7209, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.58% (0.1028 => 0.1147, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.50% (0.1383 => 0.1542, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 11.46% (0.3498 => 0.3899, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.25% (0.2737 => 0.3045, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 11.20% (0.6634 => 0.7377, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.19% (0.3084 => 0.3429, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.17% (0.2068 => 0.2299, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 10.89% (0.4847 => 0.5375, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 10.43% (2.0346 => 2.2468, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 10.40% (0.3336 => 0.3683, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 10.20% (0.2391 => 0.2635, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.18% (0.2103 => 0.2317, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.33% (0.5361 => 0.5861, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.11% (4.6926 => 5.1200, std.dev.: 0.0114) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.92% (11.6398 => 12.6786, std.dev.: 0.0199) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.59% (0.7426 => 0.8064, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.43% (0.5584 => 0.6055, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 7.14% (11.9555 => 12.8092, std.dev.: 0.0113) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.14% (0.3792 => 0.4025, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 9.46% (0.2802 => 0.3067, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6103, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6678, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-2: 4.91% (1.8057 => 1.8943, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1654, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/dry: 4.12% (14.0481 => 14.6265, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2017, std.dev.: 0.0421) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2236, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.47% (7.1849 => 7.2905, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3004, std.dev.: 0.0142) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5966, std.dev.: 0.0277) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.58% (2.4764 => 2.3878, std.dev.: 0.0168) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.77% (25.4195 => 16.5803, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ary2: -8.12% (0.2402 => 0.2207, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9747, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7964, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9576, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8045, std.dev.: 0.0048) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7733, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.73% (0.6293 => 0.6121, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.25% (41.7953 => 40.8546, std.dev.: 0.0056) SingleSource/Benchmarks/Dhrystone/fldry: -2.22% (17.2379 => 16.8549, std.dev.: 0.0373) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.68% (10.7630 => 10.5827, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4993, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7166, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1705, std.dev.: 0.0626) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0443, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 06:06:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 08:06:11 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121126140611.85F102A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6267?compare_to=6264&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6267, Order: 168586, Start Time: 2012-11-26 12:34:45, End Time: 2012-11-26 14:06:42 To: 6264, Order: 168583, Start Time: 2012-11-26 10:46:30, End Time: 2012-11-26 12:17:53 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 3 (72 on baseline) Performance Improvements: 5 (25 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1046 (877 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/except: 2.44% (0.4872 => 0.4991, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.55% (1.0039 => 1.0195, std.dev.: 0.0053) MultiSource/Benchmarks/BitBench/five11/five11: 1.44% (5.6015 => 5.6824, std.dev.: 0.0145) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.95% (0.9473 => 0.9288, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.80% (0.8592 => 0.8437, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.74% (0.9174 => 0.9014, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.23% (0.8794 => 0.8686, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -7.55% (7.1095 => 6.5726, std.dev.: 0.0687) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.61% (1.0734 => 1.0561, std.dev.: 0.0198) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.46% (0.0218 => 0.0219, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -14.12% (0.0432 => 0.0371, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -16.03% (0.0312 => 0.0262, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 21.24% (0.0259 => 0.0314, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.66% (0.0418 => 0.0386, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0204 => 0.0205, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: -3.11% (0.0225 => 0.0218, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 0.82% (0.1471 => 0.1483, std.dev.: 0.0076) MultiSource/Applications/lemon/lemon: -3.47% (1.1448 => 1.1051, std.dev.: 0.2170) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 12.17% (0.4140 => 0.4644, std.dev.: 0.0220) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.42% (0.1485 => 0.1449, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.15% (0.0602 => 0.0639, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 47.54% (0.0183 => 0.0270, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.69% (0.0592 => 0.0582, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.15% (1.1937 => 1.1955, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.16% (0.0620 => 0.0619, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.18% (0.0218 => 0.0174, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.95% (0.7784 => 0.7710, std.dev.: 0.0045) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -19.72% (0.0071 => 0.0057, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.47% (16.4461 => 17.8391, std.dev.: 0.1816) MultiSource/Applications/sqlite3/sqlite3: 2350.08% (0.6332 => 15.5139, std.dev.: 0.4004) MultiSource/Benchmarks/McCat/08-main/main: 48.12% (0.1831 => 0.2712, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.71% (0.1559 => 0.1470, std.dev.: 0.0215) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7057.16% (0.3123 => 22.3518, std.dev.: 0.2122) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.59% (0.2463 => 0.3709, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1536.33% (0.3344 => 5.4719, std.dev.: 0.0194) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.72% (0.2364 => 0.3232, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/bigfib: 4.81% (0.6010 => 0.6299, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel: 3.50% (0.0429 => 0.0444, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.26% (0.3266 => 0.3405, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 2.89% (0.1969 => 0.2026, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0224 => 0.0224, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -31.74% (0.0230 => 0.0157, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0493, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 8.00% (0.1462 => 0.1579, std.dev.: 0.0184) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4787, std.dev.: 0.0260) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0729, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4916, std.dev.: 0.0075) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5104, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.4994, std.dev.: 0.0801) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3162, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1331, std.dev.: 0.0154) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3630, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4090, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0844, std.dev.: 0.0029) SingleSource/Regression/C/uint64_to_float: -23.79% (2.1832 => 1.6639, std.dev.: 0.0021) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.93% (0.0810 => 0.0939, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.38% (0.0848 => 0.0953, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.76% (0.1905 => 0.2091, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.75% (0.1466 => 0.1609, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.57% (0.4847 => 0.5214, std.dev.: 0.0119) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.10% (1.2526 => 1.3039, std.dev.: 0.0105) MultiSource/Benchmarks/nbench/nbench: 3.98% (1.1271 => 1.1720, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.50% (2.1401 => 2.2151, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.18% (0.5191 => 0.5356, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.83% (0.8697 => 0.8943, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.79% (0.8420 => 0.8655, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.70% (0.8050 => 0.8267, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.66% (0.8007 => 0.8220, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.59% (0.4559 => 0.4677, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.57% (0.6586 => 0.6755, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.47% (0.8611 => 0.8824, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.46% (0.8712 => 0.8926, std.dev.: 0.0061) MultiSource/Benchmarks/PAQ8p/paq8p: 2.45% (2.3764 => 2.4346, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.40% (0.8331 => 0.8531, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.37% (0.8805 => 0.9014, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.37% (0.9908 => 1.0143, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.36% (0.9074 => 0.9288, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.32% (0.9069 => 0.9279, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.30% (0.9039 => 0.9247, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.30% (0.8317 => 0.8508, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.21% (3.1832 => 3.2536, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.21% (0.8286 => 0.8469, std.dev.: 0.0071) MultiSource/Benchmarks/Bullet/bullet: 2.18% (31.8598 => 32.5536, std.dev.: 0.1591) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.17% (0.8359 => 0.8540, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.15% (0.8086 => 0.8260, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.13% (0.8261 => 0.8437, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.13% (0.8457 => 0.8637, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.08% (0.8069 => 0.8237, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.06% (1.4479 => 1.4777, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.03% (0.8656 => 0.8832, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.97% (0.8518 => 0.8686, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.90% (0.8927 => 0.9097, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.86% (0.8048 => 0.8198, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.86% (0.8885 => 0.9050, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (8.6247 => 8.7684, std.dev.: 0.0115) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 99.50% (0.0199 => 0.0397, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/pi: 56.69% (1.5795 => 2.4749, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.62% (0.7597 => 0.8860, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.06% (2.9753 => 3.4532, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.38% (2.7995 => 3.2020, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6089, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.63% (0.3186 => 0.3461, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.02% (1.1857 => 1.2808, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 7.04% (1.7056 => 1.8257, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/richards_benchmark: 6.82% (1.3037 => 1.3926, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.74% (4.7794 => 5.1013, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 6.61% (3.1873 => 3.3979, std.dev.: 0.0497) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.93% (4.9686 => 5.2630, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.91% (4.5327 => 4.8005, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.69% (6.2275 => 6.5195, std.dev.: 0.0068) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.58% (1.2337 => 1.2902, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.43% (3.3761 => 3.5257, std.dev.: 0.0426) MultiSource/Applications/lambda-0_1_3/lambda: 4.43% (7.4933 => 7.8251, std.dev.: 0.0460) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.05% (4.9453 => 5.1455, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 4.03% (14.0064 => 14.5708, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.99% (4.9469 => 5.1445, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.12% (0.3587 => 0.3699, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.06% (6.3772 => 6.5726, std.dev.: 0.0687) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.76% (11.5690 => 11.8880, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.66% (8.2783 => 8.4988, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/lists: 2.52% (7.3375 => 7.5223, std.dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.32% (1.1365 => 1.1629, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.29% (4.8660 => 4.9775, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.44% (1.5941 => 1.6171, std.dev.: 0.0040) MultiSource/Benchmarks/BitBench/five11/five11: 1.42% (5.6030 => 5.6824, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/ReedSolomon: 1.32% (8.5322 => 8.6450, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.12% (3.5679 => 3.6077, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.95% (5.4641 => 4.3195, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.50% (7.2130 => 6.1670, std.dev.: 0.0681) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.84% (1.0512 => 0.9373, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.61% (1.1216 => 1.0026, std.dev.: 0.0181) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.66% (14.6451 => 13.3764, std.dev.: 0.0972) MultiSource/Benchmarks/mafft/pairlocalalign: -8.50% (63.1822 => 57.8103, std.dev.: 0.1151) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.91% (4.7482 => 4.4203, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.55% (0.3269 => 0.3055, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.95% (3.7148 => 3.4936, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.89% (5.4972 => 5.1735, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.02% (5.1557 => 4.8968, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.41% (4.7449 => 4.5358, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.88% (2.8773 => 2.7657, std.dev.: 0.0316) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.79% (6.0224 => 5.7943, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (28.5821 => 27.7020, std.dev.: 0.0534) MultiSource/Applications/lua/lua: -2.98% (29.8330 => 28.9438, std.dev.: 0.2676) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.86% (0.5807 => 0.5641, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.77% (2.6356 => 2.5625, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.50% (9.9065 => 9.6586, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/hash2: -2.26% (3.4237 => 3.3463, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.97% (11.5316 => 11.3045, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.86% (1.0388 => 1.0195, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.76% (4.9994 => 4.9115, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.3487 => 2.3184, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.17% (5.6343 => 5.5684, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.91% (1.0262 => 1.0561, std.dev.: 0.0198) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.07% (0.0408 => 0.0371, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.15% (0.0254 => 0.0262, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.52% (0.0384 => 0.0386, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 3.13% (0.1438 => 0.1483, std.dev.: 0.0076) MultiSource/Applications/lemon/lemon: -2.45% (1.1329 => 1.1051, std.dev.: 0.2170) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 11.53% (0.4164 => 0.4644, std.dev.: 0.0220) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.84% (0.1369 => 0.1449, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.31% (0.0641 => 0.0639, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 38.46% (0.0195 => 0.0270, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.69% (0.0578 => 0.0582, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.53% (1.1437 => 1.1955, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.28% (0.0627 => 0.0619, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.33% (0.0180 => 0.0174, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.83% (0.8017 => 0.7710, std.dev.: 0.0045) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -8.06% (0.0062 => 0.0057, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 06:11:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 08:11:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121126141141.773D72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6268?compare_to=6263&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6268, Order: 168583, Start Time: 2012-11-26 11:52:47, End Time: 2012-11-26 14:12:11 To: 6263, Order: 168581, Start Time: 2012-11-26 08:36:21, End Time: 2012-11-26 10:55:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 30 (152 on baseline) Performance Improvements: 2 (40 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1054 (693 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/objects/objects: 17.37% (0.1169 => 0.1372, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.53% (0.1659 => 0.1900, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 12.50% (0.4487 => 0.5048, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.80% (0.4352 => 0.4822, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/sieve: 10.41% (0.4033 => 0.4453, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.70% (0.1175 => 0.1289, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.80% (0.6894 => 0.7501, std.dev.: 0.0174) SingleSource/UnitTests/SignlessTypes/rem: 8.76% (0.1267 => 0.1378, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 8.71% (0.5934 => 0.6451, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.68% (0.6909 => 0.7509, std.dev.: 0.0213) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.68% (0.5921 => 0.6435, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.64% (0.6184 => 0.6718, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.41% (0.6672 => 0.7233, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 8.35% (0.6171 => 0.6686, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.14% (0.6888 => 0.7449, std.dev.: 0.0198) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.75% (0.6683 => 0.7067, std.dev.: 0.0143) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.46% (0.2673 => 0.2819, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.08% (4.6587 => 4.8955, std.dev.: 0.0698) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.62% (10.9312 => 11.4360, std.dev.: 0.0492) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 4.41% (0.6851 => 0.7153, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.12% (1.2733 => 1.3258, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.99% (0.6463 => 0.6721, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.53% (0.7655 => 0.7925, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.51% (0.5268 => 0.5453, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/football/football: 2.81% (1.0644 => 1.0943, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.65% (5.5939 => 5.7420, std.dev.: 0.0274) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.16% (0.7080 => 0.7233, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.87% (11.8276 => 12.0485, std.dev.: 0.0688) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.91% (0.5760 => 0.6158, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout/hash: 4.01% (5.1917 => 5.4000, std.dev.: 0.0514) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -10.69% (0.4024 => 0.3594, std.dev.: 0.0144) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.25% (0.4355 => 0.4170, std.dev.: 0.0068) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.47% (69.0809 => 69.4065, std.dev.: 0.2896) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.95% (0.1367 => 0.1354, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.55% (0.0431 => 0.0420, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0652 => 0.0652, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 0.07% (493.9855 => 494.3247, std.dev.: 0.0630) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.74% (63.2438 => 69.4065, std.dev.: 0.2896) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43734.77% (1.1277 => 494.3247, std.dev.: 0.0630) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.05% (0.5229 => 1.5376, std.dev.: 0.1199) MultiSource/Applications/SPASS/SPASS: 20.01% (14.9895 => 17.9896, std.dev.: 0.4652) MultiSource/Applications/kimwitu++/kc: 46.89% (14.1553 => 20.7933, std.dev.: 0.3975) MultiSource/Benchmarks/MallocBench/gs/gs: 25.40% (4.1105 => 5.1545, std.dev.: 0.1017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.92% (1.1048 => 1.5127, std.dev.: 0.0745) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 431.94% (7.1582 => 38.0771, std.dev.: 0.2474) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.03% (3.4629 => 6.3729, std.dev.: 0.3298) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.96% (0.6222 => 1.0326, std.dev.: 0.0559) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10797.22% (0.0720 => 7.8460, std.dev.: 0.1148) MultiSource/Applications/SIBsim4/SIBsim4: 3922800.00% (0.0001 => 3.9229, std.dev.: 0.0064) MultiSource/Applications/SPASS/SPASS: 12057400.00% (0.0001 => 12.0575, std.dev.: 2.1999) MultiSource/Applications/kimwitu++/kc: 52000.00% (0.0001 => 0.0521, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 615700.00% (0.0001 => 0.6158, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10090600.00% (0.0001 => 10.0907, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5689700.00% (0.0001 => 5.6898, std.dev.: 0.6259) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1735.46% (1.1194 => 20.5461, std.dev.: 0.7534) MultiSource/Applications/ClamAV/clamscan: 69.43% (22.1758 => 37.5721, std.dev.: 0.4164) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 62.12% (7.0540 => 11.4360, std.dev.: 0.0492) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.49% (2.9384 => 4.6277, std.dev.: 0.2811) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 48.08% (8.1363 => 12.0485, std.dev.: 0.0688) MultiSource/Applications/JM/lencod/lencod: 47.03% (21.9371 => 32.2538, std.dev.: 0.1436) MultiSource/Benchmarks/FreeBench/distray/distray: 44.89% (0.1056 => 0.1530, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 38.62% (0.1432 => 0.1985, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/almabench: 38.22% (0.0730 => 0.1009, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/08-main/main: 37.39% (0.2554 => 0.3509, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/15-trie/trie: 33.59% (0.0527 => 0.0704, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 33.04% (0.0793 => 0.1055, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Oscar: 32.55% (0.0636 => 0.0843, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 31.91% (0.7433 => 0.9805, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/17-bintr/bintr: 31.70% (0.0675 => 0.0889, std.dev.: 0.0003) SingleSource/UnitTests/vla: 29.86% (0.0355 => 0.0461, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 29.78% (2.2024 => 2.8582, std.dev.: 0.0237) SingleSource/UnitTests/ObjC/dot-syntax-1: 29.65% (0.0479 => 0.0621, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 29.22% (0.0842 => 0.1088, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 26.86% (0.1940 => 0.2461, std.dev.: 0.0033) MultiSource/Applications/lemon/lemon: 26.74% (1.0722 => 1.3589, std.dev.: 0.0167) MultiSource/Benchmarks/McCat/18-imp/imp: 26.35% (0.3423 => 0.4325, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 26.27% (0.3441 => 0.4345, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/09-vor/vor: 25.63% (0.3180 => 0.3995, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 25.34% (0.0730 => 0.0915, std.dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 25.11% (5.7591 => 7.2052, std.dev.: 0.0720) SingleSource/Benchmarks/Shootout-C++/reversefile: 24.76% (0.3865 => 0.4822, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/ks/ks: 24.70% (0.1510 => 0.1883, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 24.33% (0.1151 => 0.1431, std.dev.: 0.0011) MultiSource/Benchmarks/llubenchmark/llu: 24.24% (0.0462 => 0.0574, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 24.22% (1.1642 => 1.4462, std.dev.: 0.0303) SingleSource/Benchmarks/Misc-C++/Large/ray: 24.21% (0.4064 => 0.5048, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.00% (0.1029 => 0.1276, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 24.00% (1.5859 => 1.9665, std.dev.: 0.0474) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.99% (0.0746 => 0.0925, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 23.98% (0.0442 => 0.0548, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/em3d/em3d: 23.72% (0.1695 => 0.2097, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sieve: 23.59% (0.3603 => 0.4453, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.47% (0.1044 => 0.1289, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 23.16% (0.1114 => 0.1372, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 23.02% (4.2646 => 5.2463, std.dev.: 0.0794) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 22.87% (0.6450 => 0.7925, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/wordfreq: 22.68% (0.3307 => 0.4057, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/football/football: 22.67% (0.8921 => 1.0943, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 22.30% (1.4186 => 1.7350, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.29% (0.1337 => 0.1635, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/spellcheck: 21.82% (0.4203 => 0.5120, std.dev.: 0.0113) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.71% (0.1566 => 0.1906, std.dev.: 0.0102) MultiSource/Benchmarks/BitBench/five11/five11: 21.69% (0.0567 => 0.0690, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.51% (0.5569 => 0.6767, std.dev.: 0.0271) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 21.48% (0.3427 => 0.4163, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 21.45% (0.1175 => 0.1427, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.28% (0.1062 => 0.1288, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 21.22% (0.0834 => 0.1011, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 20.94% (3.8723 => 4.6832, std.dev.: 0.1329) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 20.93% (0.5981 => 0.7233, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/05-eks/eks: 20.87% (0.4299 => 0.5196, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.71% (0.1584 => 0.1912, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.60% (0.5860 => 0.7067, std.dev.: 0.0143) SingleSource/UnitTests/SignlessTypes/rem: 20.45% (0.1144 => 0.1378, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 20.41% (0.0838 => 0.1009, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 20.37% (0.0491 => 0.0591, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.93% (0.8067 => 0.9675, std.dev.: 0.0316) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 19.78% (0.1906 => 0.2283, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 19.76% (2.0273 => 2.4279, std.dev.: 0.0820) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 19.69% (0.0640 => 0.0766, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.62% (0.2758 => 0.3299, std.dev.: 0.0065) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.20% (0.1125 => 0.1341, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/bh/bh: 19.15% (0.3092 => 0.3684, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.96% (0.2700 => 0.3212, std.dev.: 0.0180) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.70% (0.4615 => 0.5478, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/strcat: 18.47% (0.2831 => 0.3354, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.06% (14.3668 => 16.9619, std.dev.: 0.1765) SingleSource/Regression/C++/ofstream_ctor: 17.80% (0.2905 => 0.3422, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/ary: 17.45% (0.3232 => 0.3796, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 17.28% (0.1892 => 0.2219, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.23% (0.2891 => 0.3389, std.dev.: 0.0078) SingleSource/UnitTests/ObjC/exceptions-2: 17.19% (0.3497 => 0.4098, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/wc: 17.01% (0.3052 => 0.3571, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.99% (0.0871 => 0.1019, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 16.96% (0.0672 => 0.0786, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 16.92% (0.1625 => 0.1900, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.91% (0.2756 => 0.3222, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/exceptions-3: 16.89% (0.3516 => 0.4110, std.dev.: 0.0077) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.62% (0.8172 => 0.9530, std.dev.: 0.0416) MultiSource/Benchmarks/Olden/health/health: 16.17% (0.1268 => 0.1473, std.dev.: 0.0062) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.16% (0.0953 => 0.1107, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 16.01% (0.2430 => 0.2819, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/mst/mst: 15.99% (0.1163 => 0.1349, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.93% (0.2065 => 0.2394, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.90% (0.0648 => 0.0751, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/matrix: 15.89% (0.0818 => 0.0948, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.84% (0.0770 => 0.0892, std.dev.: 0.0038) MultiSource/Applications/d/make_dparser: 15.48% (3.3354 => 3.8518, std.dev.: 0.1026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.13% (0.1117 => 0.1286, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: 15.11% (0.3282 => 0.3778, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.06% (0.0770 => 0.0886, std.dev.: 0.0039) MultiSource/Applications/viterbi/viterbi: 15.05% (0.1555 => 0.1789, std.dev.: 0.0073) SingleSource/Benchmarks/McGill/exptree: 14.99% (0.0814 => 0.0936, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.80% (5.0018 => 5.7420, std.dev.: 0.0274) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.45% (0.3121 => 0.3572, std.dev.: 0.0151) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.38% (0.2107 => 0.2410, std.dev.: 0.0052) SingleSource/Benchmarks/Stanford/Puzzle: 14.20% (0.1268 => 0.1448, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.95% (0.3935 => 0.4484, std.dev.: 0.0096) MultiSource/Applications/sgefa/sgefa: 13.51% (0.3109 => 0.3529, std.dev.: 0.0148) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.47% (0.2271 => 0.2577, std.dev.: 0.0063) MultiSource/Applications/sqlite3/sqlite3: 13.42% (17.1811 => 19.4870, std.dev.: 0.2981) MultiSource/Benchmarks/Prolangs-C++/office/office: 13.07% (0.3136 => 0.3546, std.dev.: 0.0135) MultiSource/Benchmarks/FreeBench/neural/neural: 12.10% (0.1463 => 0.1640, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/trivial-interface: 11.98% (0.3473 => 0.3889, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.76% (0.4879 => 0.5453, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.99% (0.2603 => 0.2889, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.83% (0.6030 => 0.6623, std.dev.: 0.0220) SingleSource/UnitTests/ObjC++/Hello: 9.65% (0.5925 => 0.6497, std.dev.: 0.0217) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.25% (0.3817 => 0.4170, std.dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.08% (4.3953 => 10.9919, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/methcall: 147.40% (5.3999 => 13.3591, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/17-bintr/bintr: 119.85% (0.1043 => 0.2293, std.dev.: 0.0228) MultiSource/Benchmarks/llubenchmark/llu: 77.69% (3.7781 => 6.7132, std.dev.: 0.9624) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 42.60% (0.3256 => 0.4643, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 35.79% (0.1154 => 0.1567, std.dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/ft/ft: 31.28% (1.2838 => 1.6854, std.dev.: 0.0177) MultiSource/Applications/minisat/minisat: 23.91% (9.1159 => 11.2952, std.dev.: 0.6824) SingleSource/Benchmarks/Misc/oourafft: 17.45% (6.6465 => 7.8061, std.dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.74% (1.1145 => 1.3011, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.01% (0.2944 => 0.3327, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.58% (2.8904 => 3.2251, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 10.14% (1.1396 => 1.2551, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/hash: 10.01% (4.9088 => 5.4000, std.dev.: 0.0514) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.50% (1.7254 => 1.8893, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 7.86% (1.4460 => 1.5597, std.dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 6.92% (8.6802 => 9.2813, std.dev.: 0.1516) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.98% (4.2280 => 4.4809, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 5.68% (26.0924 => 27.5755, std.dev.: 0.0874) MultiSource/Benchmarks/Olden/bh/bh: 5.44% (1.9405 => 2.0461, std.dev.: 0.0222) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.76% (0.3463 => 0.3628, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.6436 => 12.1294, std.dev.: 0.0122) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: 2.15% (2.4116 => 2.4635, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 2.02% (3.1595 => 3.2234, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 1.63% (12.5348 => 12.7394, std.dev.: 0.0517) MultiSource/Benchmarks/PAQ8p/paq8p: 1.59% (85.0658 => 86.4156, std.dev.: 0.2846) MultiSource/Benchmarks/mafft/pairlocalalign: 1.52% (27.8444 => 28.2675, std.dev.: 0.0488) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.37% (6.5088 => 6.5981, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/sieve: 1.29% (2.4858 => 2.5179, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.21% (5.2139 => 5.2770, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0501, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.31% (6.6874 => 0.1799, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -75.51% (0.8651 => 0.2119, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -74.87% (5.2763 => 1.3258, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/richards_benchmark: -44.76% (0.1622 => 0.0896, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.41% (5.3855 => 4.7170, std.dev.: 0.1442) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -11.88% (0.1330 => 0.1172, std.dev.: 0.0040) MultiSource/Applications/JM/ldecod/ldecod: -11.25% (10.4361 => 9.2617, std.dev.: 0.4074) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -9.69% (1.7609 => 1.5903, std.dev.: 0.0608) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.54% (5.3526 => 4.8955, std.dev.: 0.0698) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.20% (0.0628 => 0.0363, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.31% (0.3987 => 0.2380, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.28% (4.5009 => 2.7778, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.15% (2.6546 => 2.0135, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: -19.16% (0.2161 => 0.1747, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4258, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.67% (2.6778 => 2.2849, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.77% (32.5116 => 29.0105, std.dev.: 0.0274) SingleSource/Benchmarks/Misc/mandel-2: -10.63% (1.5373 => 1.3739, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.05% (1.5660 => 1.4243, std.dev.: 0.0038) MultiSource/Benchmarks/NPB-serial/is/is: -8.10% (9.5636 => 8.7885, std.dev.: 0.0906) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5758, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.44% (3.2416 => 3.0652, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.01% (0.2497 => 0.2372, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5076, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: -4.43% (6.2999 => 6.0210, std.dev.: 0.0126) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.68% (19.9488 => 19.2144, std.dev.: 0.0654) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8915, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.93% (0.9957 => 0.9665, std.dev.: 0.0068) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.33% (0.4808 => 0.4696, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.78% (8.1563 => 8.0109, std.dev.: 0.0162) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6773, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.47% (10.2830 => 10.1316, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.82% (0.1485 => 0.1354, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0013) Report Time: 2.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 06:28:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 08:28:47 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121126142847.807132A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6269?compare_to=6265&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6269, Order: 168586, Start Time: 2012-11-26 12:55:43, End Time: 2012-11-26 14:29:19 To: 6265, Order: 168583, Start Time: 2012-11-26 10:58:54, End Time: 2012-11-26 12:32:38 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (174 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (864 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.85% (2.0478 => 2.1061, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4937 => 7.6769, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash2: 2.23% (3.1932 => 3.2645, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.08% (0.1431 => 0.1301, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.90% (0.3821 => 0.3519, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -7.06% (0.3812 => 0.3543, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -6.99% (2.4924 => 2.3181, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: -6.98% (0.3880 => 0.3609, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.97% (0.3831 => 0.3564, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.96% (0.3848 => 0.3580, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.88% (0.3896 => 0.3628, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.84% (0.3142 => 0.2927, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.84% (0.3891 => 0.3625, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.77% (0.4033 => 0.3760, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: -6.70% (0.4176 => 0.3896, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.44% (0.3884 => 0.3634, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.43% (0.3357 => 0.3141, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.40% (0.9542 => 0.8931, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: -6.39% (0.2160 => 0.2022, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.37% (0.2355 => 0.2205, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: -6.24% (0.4199 => 0.3937, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.11% (9.2283 => 8.6649, std.dev.: 0.0168) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.10% (0.2428 => 0.2280, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/parameter-passing: -5.98% (0.4280 => 0.4024, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.98% (0.9852 => 0.9263, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -5.94% (16.1920 => 15.2295, std.dev.: 0.0144) MultiSource/Applications/JM/ldecod/ldecod: -5.93% (7.0961 => 6.6755, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.88% (0.7198 => 0.6775, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.85% (0.6484 => 0.6105, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.84% (4.0323 => 3.7967, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.84% (1.3722 => 1.2921, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.75% (6.7716 => 6.3825, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.72% (4.8161 => 4.5408, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.69% (1.0544 => 0.9944, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: -5.63% (0.9179 => 0.8662, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.63% (0.5705 => 0.5384, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.62% (0.5591 => 0.5277, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.61% (4.8802 => 4.6063, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.60% (0.2695 => 0.2544, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.60% (0.5857 => 0.5529, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.59% (0.5863 => 0.5535, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.59% (0.5478 => 0.5172, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.57% (1.2300 => 1.1615, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: -5.56% (0.4515 => 0.4264, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.51% (0.6297 => 0.5950, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.49% (0.6230 => 0.5888, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.49% (0.5925 => 0.5600, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: -5.48% (1.1530 => 1.0898, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.45% (0.5575 => 0.5271, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.45% (0.5581 => 0.5277, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.44% (0.6667 => 0.6304, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.44% (4.5069 => 4.2618, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.42% (0.6052 => 0.5724, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.41% (0.5805 => 0.5491, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.41% (1.2210 => 1.1550, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.40% (0.6260 => 0.5922, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.39% (0.3658 => 0.3461, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.38% (0.5802 => 0.5490, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.38% (0.6194 => 0.5861, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.35% (0.5849 => 0.5536, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.35% (1.4642 => 1.3859, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.35% (0.6660 => 0.6304, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.34% (0.6736 => 0.6376, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.34% (8.0126 => 7.5848, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.34% (0.5941 => 0.5624, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.33% (0.5859 => 0.5547, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.32% (1.6364 => 1.5494, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.31% (0.5570 => 0.5274, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.30% (0.6681 => 0.6327, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.29% (3.5339 => 3.3469, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.29% (14.2083 => 13.4568, std.dev.: 0.0110) MultiSource/Applications/lemon/lemon: -5.28% (1.1450 => 1.0845, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -5.27% (0.2939 => 0.2784, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.26% (0.6293 => 0.5962, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.23% (0.3057 => 0.2897, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.23% (0.4916 => 0.4659, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.22% (0.3255 => 0.3085, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.21% (0.6676 => 0.6328, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.21% (0.3016 => 0.2859, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.20% (0.6189 => 0.5867, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.20% (0.8521 => 0.8078, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: -5.20% (4.3330 => 4.1079, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/fibo: -5.19% (0.2871 => 0.2722, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.19% (0.6033 => 0.5720, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.18% (0.2933 => 0.2781, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.18% (0.6446 => 0.6112, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.17% (0.3406 => 0.3230, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.17% (0.2903 => 0.2753, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.16% (0.2385 => 0.2262, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.15% (1.2221 => 1.1592, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.14% (1.2784 => 1.2127, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.13% (0.5999 => 0.5691, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -5.12% (0.2849 => 0.2703, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -5.12% (0.3205 => 0.3041, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.12% (0.3323 => 0.3153, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: -5.11% (0.2659 => 0.2523, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.09% (0.2278 => 0.2162, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -5.09% (0.2985 => 0.2833, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: -5.09% (0.3026 => 0.2872, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.08% (0.5688 => 0.5399, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.08% (0.6440 => 0.6113, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.07% (0.2999 => 0.2847, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -5.05% (0.3446 => 0.3272, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -5.05% (1.3864 => 1.3164, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: -5.03% (17.1032 => 16.2430, std.dev.: 0.0144) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.02% (0.2548 => 0.2420, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -5.01% (0.3394 => 0.3224, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.00% (0.3837 => 0.3645, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.00% (0.2001 => 0.1901, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.98% (0.7919 => 0.7525, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -4.97% (1.3148 => 1.2494, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.95% (2.1713 => 2.0638, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -4.94% (0.3581 => 0.3404, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: -4.94% (0.3481 => 0.3309, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -4.93% (0.3025 => 0.2876, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -4.90% (0.4248 => 0.4040, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: -4.86% (15.5079 => 14.7537, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.86% (0.3931 => 0.3740, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.86% (0.3252 => 0.3094, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.79% (0.4151 => 0.3952, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: -4.78% (3.5154 => 3.3472, std.dev.: 0.0067) MultiSource/Applications/Burg/burg: -4.75% (1.2515 => 1.1920, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/strcat: -4.75% (0.2989 => 0.2847, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.73% (0.3319 => 0.3162, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.71% (0.3483 => 0.3319, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.70% (0.7339 => 0.6994, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -4.67% (0.3621 => 0.3452, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -4.65% (15.2527 => 14.5427, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.64% (0.6395 => 0.6098, std.dev.: 0.0064) MultiSource/Applications/minisat/minisat: -4.63% (0.7447 => 0.7102, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: -4.63% (0.4861 => 0.4636, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.63% (0.7524 => 0.7176, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.61% (0.3059 => 0.2918, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -4.59% (5.0226 => 4.7919, std.dev.: 0.0024) MultiSource/Applications/lua/lua: -4.59% (4.0594 => 3.8732, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists1: -4.58% (0.3867 => 0.3690, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.56% (0.7021 => 0.6701, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.55% (0.4813 => 0.4594, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -4.54% (0.3194 => 0.3049, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.54% (0.4321 => 0.4125, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.49% (0.5168 => 0.4936, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.49% (0.5569 => 0.5319, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.46% (0.6395 => 0.6110, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.45% (0.5329 => 0.5092, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.42% (0.5567 => 0.5321, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.41% (0.4083 => 0.3903, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.35% (1.6474 => 1.5758, std.dev.: 0.0068) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.32% (22.4056 => 21.4383, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.31% (0.4427 => 0.4236, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.30% (0.9557 => 0.9146, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -4.30% (0.8418 => 0.8056, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: -4.29% (0.6347 => 0.6075, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -4.22% (0.3271 => 0.3133, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: -4.20% (0.3788 => 0.3629, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.20% (0.9077 => 0.8696, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: -4.14% (2.1401 => 2.0515, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference-object: -4.13% (0.6441 => 0.6175, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -4.06% (2.4021 => 2.3045, std.dev.: 0.0064) MultiSource/Benchmarks/Bullet/bullet: -4.04% (34.0927 => 32.7144, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/bigfib: -4.03% (0.6750 => 0.6478, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -3.95% (0.7779 => 0.7472, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: -3.91% (0.4524 => 0.4347, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -3.90% (0.7982 => 0.7671, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.84% (0.3491 => 0.3357, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: -3.71% (1.5610 => 1.5031, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.68% (2.2587 => 2.1756, std.dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: -3.42% (18.2933 => 17.6668, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.89% (5.4682 => 5.3100, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -2.30% (20.7746 => 20.2964, std.dev.: 0.0323) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7545, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -8.76% (1.2842 => 1.1717, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: -3.87% (2.2633 => 2.1757, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7069, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.64% (6.5735 => 6.4656, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 07:57:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 09:57:11 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121126155711.DE6732A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6270?compare_to=6267&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6270, Order: 168587, Start Time: 2012-11-26 14:23:40, End Time: 2012-11-26 15:57:42 To: 6267, Order: 168586, Start Time: 2012-11-26 12:34:45, End Time: 2012-11-26 14:06:42 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 3 (47 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1051 (909 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.15% (0.8469 => 0.8651, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.40% (4.5637 => 4.6278, std.dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: 3.08% (51.5584 => 53.1442, std.dev.: 0.2504) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.08% (1.0561 => 1.0781, std.dev.: 0.1958) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.37% (0.0219 => 0.0216, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 15.36% (0.0371 => 0.0428, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 27.10% (0.0262 => 0.0333, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0314 => 0.0314, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.10% (0.0386 => 0.0425, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: -0.98% (0.0205 => 0.0203, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: 0.46% (0.0218 => 0.0219, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 0.13% (0.1483 => 0.1485, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 5.77% (1.1051 => 1.1689, std.dev.: 0.3606) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -10.01% (0.4644 => 0.4179, std.dev.: 0.0452) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.21% (0.1449 => 0.1417, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.79% (0.0639 => 0.0602, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.22% (0.0270 => 0.0276, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.33% (0.0582 => 0.0551, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.10% (1.1955 => 1.1967, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.48% (0.0619 => 0.0622, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.71% (0.0174 => 0.0217, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.32% (0.7710 => 0.7735, std.dev.: 0.0035) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 40.35% (0.0057 => 0.0080, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.16% (16.4461 => 17.6238, std.dev.: 1.4917) MultiSource/Applications/sqlite3/sqlite3: 2319.74% (0.6332 => 15.3218, std.dev.: 0.6857) MultiSource/Benchmarks/McCat/08-main/main: 50.19% (0.1831 => 0.2750, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.18% (0.1559 => 0.1447, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7080.95% (0.3123 => 22.4261, std.dev.: 0.4555) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.67% (0.2463 => 0.3711, std.dev.: 0.0159) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1541.24% (0.3344 => 5.4883, std.dev.: 0.1134) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.62% (0.2364 => 0.3277, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 4.68% (0.6010 => 0.6291, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/mandel: 3.50% (0.0429 => 0.0444, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.65% (0.3266 => 0.3418, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/strcat: 3.15% (0.1969 => 0.2031, std.dev.: 0.0702) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.14% (0.0224 => 0.0240, std.dev.: 0.0067) SingleSource/UnitTests/byval-alignment: -30.87% (0.0230 => 0.0159, std.dev.: 0.0063) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0523, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 11.97% (0.1462 => 0.1637, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4660, std.dev.: 0.0750) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0710, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4945, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5114, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5787, std.dev.: 0.5399) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3244, std.dev.: 0.0251) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1389, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3675, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4116, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0884, std.dev.: 0.0221) SingleSource/Regression/C/uint64_to_float: -24.13% (2.1832 => 1.6564, std.dev.: 0.0522) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.62% (0.0848 => 0.0955, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.94% (0.2180 => 0.2353, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.71% (1.1606 => 1.2269, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.63% (0.2133 => 0.2253, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.83% (0.3003 => 0.3148, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.41% (0.8286 => 0.8651, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.90% (0.8050 => 0.8364, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.87% (4.1763 => 4.3380, std.dev.: 0.0202) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.82% (1.2526 => 1.3005, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.66% (0.4559 => 0.4726, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.13% (4.4873 => 4.6278, std.dev.: 0.0096) MultiSource/Benchmarks/nbench/nbench: 3.10% (1.1271 => 1.1620, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.08% (0.8340 => 0.8597, std.dev.: 0.0055) MultiSource/Benchmarks/PAQ8p/paq8p: 2.97% (2.3764 => 2.4469, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.83% (0.5191 => 0.5338, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.80% (1.4479 => 1.4884, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: 2.61% (31.8598 => 32.6924, std.dev.: 0.1869) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.42% (4.5702 => 4.6807, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.36% (0.9069 => 0.9283, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.26% (0.8855 => 0.9055, std.dev.: 0.0077) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 112.06% (0.0199 => 0.0422, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/pi: 57.00% (1.5795 => 2.4798, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.23% (2.9753 => 3.4582, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.26% (0.7597 => 0.8756, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.53% (2.7995 => 3.2064, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.58% (5.0261 => 5.6081, std.dev.: 0.0176) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.59% (1.1857 => 1.2757, std.dev.: 0.0074) SingleSource/Benchmarks/McGill/queens: 7.52% (1.7056 => 1.8338, std.dev.: 0.0282) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.80% (4.7794 => 5.1043, std.dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 6.24% (3.1873 => 3.3863, std.dev.: 0.0720) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.92% (4.5327 => 4.8011, std.dev.: 0.0181) MultiSource/Benchmarks/Olden/treeadd/treeadd: 5.19% (0.3587 => 0.3773, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.60% (6.2275 => 6.5140, std.dev.: 0.0533) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.45% (3.3761 => 3.5264, std.dev.: 0.0282) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.20% (4.9469 => 5.1547, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.17% (4.9453 => 5.1517, std.dev.: 0.0100) MultiSource/Applications/hexxagon/hexxagon: 3.89% (14.0064 => 14.5506, std.dev.: 0.0834) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.50% (0.2887 => 0.2988, std.dev.: 0.0022) MultiSource/Applications/siod/siod: 3.23% (3.6643 => 3.7827, std.dev.: 0.0272) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.75% (11.5690 => 11.8869, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.58% (8.2783 => 8.4921, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: 2.48% (7.3375 => 7.5195, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.25% (4.8660 => 4.9754, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.94% (1.2474 => 1.2716, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.72% (1.1365 => 1.1561, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/ReedSolomon: 1.49% (8.5322 => 8.6595, std.dev.: 0.0176) MultiSource/Benchmarks/FreeBench/neural/neural: 1.31% (1.0841 => 1.0983, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.30% (5.4641 => 4.3003, std.dev.: 0.0403) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.57% (7.2130 => 6.1619, std.dev.: 0.2648) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.08% (1.0512 => 0.9347, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.24% (14.6451 => 13.2917, std.dev.: 0.3019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.09% (0.3269 => 0.2972, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: -8.55% (63.1822 => 57.7819, std.dev.: 0.0588) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.87% (4.7482 => 4.4221, std.dev.: 0.0293) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.87% (5.4972 => 5.1743, std.dev.: 0.0263) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.38% (4.7449 => 4.5370, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.77% (6.0224 => 5.7953, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.06% (28.5821 => 27.7084, std.dev.: 0.0244) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.03% (0.5807 => 0.5631, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.56% (2.6356 => 2.5682, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.53% (9.9065 => 9.6560, std.dev.: 0.0814) SingleSource/Benchmarks/Shootout-C++/hash2: -2.27% (3.4237 => 3.3461, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (11.5316 => 11.2991, std.dev.: 0.0739) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.69% (2.3487 => 2.3091, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.58% (4.9994 => 4.9205, std.dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 5.06% (1.0262 => 1.0781, std.dev.: 0.1958) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 75.61% (0.0123 => 0.0216, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 3.27% (0.1438 => 0.1485, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 3.18% (1.1329 => 1.1689, std.dev.: 0.3606) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.36% (0.4164 => 0.4179, std.dev.: 0.0452) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.51% (0.1369 => 0.1417, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.08% (0.0641 => 0.0602, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.54% (0.0195 => 0.0276, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.67% (0.0578 => 0.0551, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.63% (1.1437 => 1.1967, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.80% (0.0627 => 0.0622, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 20.56% (0.0180 => 0.0217, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.52% (0.8017 => 0.7735, std.dev.: 0.0035) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 29.03% (0.0062 => 0.0080, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 08:25:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 10:25:44 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121126162544.726E52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6271?compare_to=6269&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6271, Order: 168588, Start Time: 2012-11-26 14:52:39, End Time: 2012-11-26 16:26:14 To: 6269, Order: 168586, Start Time: 2012-11-26 12:55:43, End Time: 2012-11-26 14:29:19 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (177 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (861 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.99% (2.0478 => 2.1091, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: 2.49% (7.4937 => 7.6806, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/hash2: 2.20% (3.1932 => 3.2633, std.dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.29% (0.1431 => 0.1298, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.45% (0.3821 => 0.3498, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.13% (0.3142 => 0.2918, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -6.93% (2.4924 => 2.3198, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.76% (0.9542 => 0.8897, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.54% (0.2355 => 0.2201, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -6.50% (0.3831 => 0.3582, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.48% (0.3812 => 0.3565, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.47% (0.3848 => 0.3599, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.47% (0.3880 => 0.3629, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -6.40% (0.4033 => 0.3775, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: -6.37% (0.3896 => 0.3648, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.34% (0.2428 => 0.2274, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -6.34% (0.2160 => 0.2023, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.25% (0.3891 => 0.3648, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.23% (0.4176 => 0.3916, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.20% (0.7198 => 0.6752, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: -6.19% (9.2283 => 8.6575, std.dev.: 0.0131) MultiSource/Applications/JM/lencod/lencod: -6.13% (16.1920 => 15.1990, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.07% (0.1796 => 0.1687, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.06% (0.6484 => 0.6091, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.05% (0.9852 => 0.9256, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -6.01% (0.1879 => 0.1766, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.95% (0.3884 => 0.3653, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -5.93% (7.0961 => 6.6755, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.92% (1.3722 => 1.2909, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/property: -5.91% (0.4199 => 0.3951, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.88% (4.8161 => 4.5331, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.87% (4.0323 => 3.7957, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.82% (0.5863 => 0.5522, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.80% (0.5705 => 0.5374, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.74% (0.5857 => 0.5521, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: -5.73% (0.9179 => 0.8653, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.73% (6.7716 => 6.3839, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.71% (0.5478 => 0.5165, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.70% (0.6297 => 0.5938, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.69% (1.0544 => 0.9944, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: -5.69% (0.3357 => 0.3166, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.67% (1.2300 => 1.1602, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.67% (0.5802 => 0.5473, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.66% (4.8802 => 4.6042, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.64% (0.2695 => 0.2543, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.64% (0.5925 => 0.5591, std.dev.: 0.0075) MultiSource/Benchmarks/nbench/nbench: -5.60% (1.1530 => 1.0884, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.60% (0.5575 => 0.5263, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -5.58% (0.4280 => 0.4041, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.58% (0.6304 => 0.5952, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.57% (0.5849 => 0.5523, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.56% (0.5591 => 0.5280, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.56% (0.6660 => 0.6290, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.54% (0.6230 => 0.5885, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.53% (0.5805 => 0.5484, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.52% (0.3658 => 0.3456, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.52% (0.3406 => 0.3218, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.52% (3.5339 => 3.3389, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.51% (0.6446 => 0.6091, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -5.49% (1.1450 => 1.0821, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.47% (1.6364 => 1.5469, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.46% (0.5570 => 0.5266, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.45% (0.5941 => 0.5617, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.45% (14.2083 => 13.4341, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.45% (0.5581 => 0.5277, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.43% (4.5069 => 4.2621, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.42% (1.2210 => 1.1548, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.41% (8.0126 => 7.5789, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/05-eks/eks: -5.40% (0.4515 => 0.4271, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.38% (1.2221 => 1.1563, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.37% (0.6667 => 0.6309, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.36% (1.2784 => 1.2099, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.35% (1.4642 => 1.3858, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.35% (0.6260 => 0.5925, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.34% (0.6052 => 0.5729, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.33% (0.6736 => 0.6377, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.33% (0.6194 => 0.5864, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.31% (0.4916 => 0.4655, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.30% (0.5999 => 0.5681, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.28% (0.5456 => 0.5168, std.dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: -5.28% (17.1032 => 16.2008, std.dev.: 0.0182) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.27% (0.2278 => 0.2158, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.26% (0.6293 => 0.5962, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.24% (0.7919 => 0.7504, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.24% (0.6189 => 0.5865, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.22% (0.6033 => 0.5718, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.21% (0.6681 => 0.6333, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.20% (0.2385 => 0.2261, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -5.19% (0.2985 => 0.2830, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: -5.19% (4.3330 => 4.1081, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.19% (0.5688 => 0.5393, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.19% (0.6440 => 0.6106, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.18% (0.6676 => 0.6330, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -5.12% (1.3864 => 1.3154, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.11% (0.8521 => 0.8086, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.10% (0.2999 => 0.2846, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: -5.09% (1.3148 => 1.2479, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.07% (0.3057 => 0.2902, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -5.05% (1.2515 => 1.1883, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/fibo: -5.02% (0.2871 => 0.2727, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -5.00% (3.5154 => 3.3396, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.00% (0.2001 => 0.1901, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.98% (0.2548 => 0.2421, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -4.97% (0.2939 => 0.2793, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.96% (0.3205 => 0.3046, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.95% (0.3837 => 0.3647, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: -4.94% (0.3581 => 0.3404, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.93% (0.2903 => 0.2760, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.91% (0.3483 => 0.3312, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.91% (0.3323 => 0.3160, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.90% (0.7447 => 0.7082, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: -4.89% (15.5079 => 14.7493, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.88% (0.3931 => 0.3739, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.87% (0.3016 => 0.2869, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -4.86% (0.3025 => 0.2878, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.84% (0.4151 => 0.3950, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.84% (0.2933 => 0.2791, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -4.83% (0.3394 => 0.3230, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -4.82% (0.2989 => 0.2845, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.82% (0.6395 => 0.6087, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -4.79% (0.3446 => 0.3281, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.78% (0.3849 => 0.3665, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -4.77% (4.0594 => 3.8657, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/matrix: -4.76% (0.3255 => 0.3100, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.76% (0.5168 => 0.4922, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: -4.73% (0.4248 => 0.4047, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -4.73% (0.3194 => 0.3043, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.72% (15.2527 => 14.5335, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary2: -4.71% (0.3481 => 0.3317, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.71% (2.1713 => 2.0691, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.70% (0.7524 => 0.7170, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.69% (0.5569 => 0.5308, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.67% (0.3252 => 0.3100, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.67% (0.7339 => 0.6996, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -4.67% (0.2849 => 0.2716, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: -4.65% (5.0226 => 4.7888, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.64% (0.7021 => 0.6695, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -4.58% (0.3867 => 0.3690, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.56% (0.5567 => 0.5313, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.56% (1.6474 => 1.5723, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.55% (0.3319 => 0.3168, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.54% (0.9077 => 0.8665, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.51% (0.4321 => 0.4126, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.47% (0.5329 => 0.5091, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/hash2: -4.46% (0.4861 => 0.4644, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -4.43% (0.3026 => 0.2892, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.43% (0.6395 => 0.6112, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.41% (0.4083 => 0.3903, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.39% (0.9557 => 0.9137, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: -4.38% (0.3059 => 0.2925, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.36% (22.4056 => 21.4294, std.dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.32% (0.4813 => 0.4605, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -4.31% (0.3271 => 0.3130, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -4.21% (0.6347 => 0.6080, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -4.18% (0.8418 => 0.8066, std.dev.: 0.0016) MultiSource/Applications/siod/siod: -4.18% (2.4021 => 2.3017, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: -4.13% (2.1401 => 2.0518, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: -4.02% (0.7982 => 0.7661, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference-object: -4.02% (0.6441 => 0.6182, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -3.99% (0.6750 => 0.6481, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.98% (2.2587 => 2.1687, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.95% (0.4427 => 0.4252, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -3.95% (1.5610 => 1.4993, std.dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: -3.86% (34.0927 => 32.7754, std.dev.: 0.0224) SingleSource/UnitTests/ObjC++/property-reference: -3.83% (0.7779 => 0.7481, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sieve: -3.83% (0.3788 => 0.3643, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: -3.80% (0.4524 => 0.4352, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.75% (0.3491 => 0.3360, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: -3.63% (18.2933 => 17.6301, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.06% (5.4682 => 5.3007, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -2.33% (20.7746 => 20.2900, std.dev.: 0.0469) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.36% (7.5137 => 5.7586, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: -8.65% (1.2842 => 1.1731, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: -3.87% (2.2633 => 2.1758, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.84% (1.7753 => 1.7072, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4719, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.02% (3.2107 => 3.1781, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 09:23:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 11:23:25 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121126172325.577892A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6272?compare_to=6268&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6272, Order: 168587, Start Time: 2012-11-26 15:04:55, End Time: 2012-11-26 17:23:55 To: 6268, Order: 168583, Start Time: 2012-11-26 11:52:47, End Time: 2012-11-26 14:12:11 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 11 (131 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1075 (716 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.74% (4.4049 => 4.7898, std.dev.: 0.0766) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.25% (0.3546 => 0.3803, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.13% (0.3128 => 0.3351, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/objinst: 6.80% (0.3351 => 0.3579, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.69% (0.3048 => 0.3252, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/lists: 6.58% (0.3815 => 0.4066, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/random: 6.31% (0.3058 => 0.3251, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 5.16% (0.6614 => 0.6955, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 4.04% (0.7501 => 0.7804, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 4.21% (6.1409 => 6.3994, std.dev.: 0.0712) SingleSource/Benchmarks/Shootout-C++/hash2: 4.11% (3.4224 => 3.5632, std.dev.: 0.0438) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.53% (69.4065 => 69.7777, std.dev.: 0.2899) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -1.18% (0.1354 => 0.1338, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0420 => 0.0420, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0652 => 0.0652, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -0.01% (494.3247 => 494.2815, std.dev.: 0.0254) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 10.33% (63.2438 => 69.7777, std.dev.: 0.2899) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43730.94% (1.1277 => 494.2815, std.dev.: 0.0254) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 196.29% (0.5229 => 1.5493, std.dev.: 0.0785) MultiSource/Applications/SPASS/SPASS: 21.28% (14.9895 => 18.1788, std.dev.: 0.3385) MultiSource/Applications/kimwitu++/kc: 47.42% (14.1553 => 20.8679, std.dev.: 0.6211) MultiSource/Benchmarks/MallocBench/gs/gs: 16.71% (4.1105 => 4.7973, std.dev.: 0.2564) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.88% (1.1048 => 1.5122, std.dev.: 0.0654) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 429.34% (7.1582 => 37.8909, std.dev.: 0.4518) SingleSource/Benchmarks/Misc-C++-EH/spirit: 95.42% (3.4629 => 6.7671, std.dev.: 0.1631) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.39% (0.6222 => 1.0353, std.dev.: 0.0638) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10661.53% (0.0720 => 7.7483, std.dev.: 0.2217) MultiSource/Applications/SIBsim4/SIBsim4: 3863400.00% (0.0001 => 3.8635, std.dev.: 0.0408) MultiSource/Applications/SPASS/SPASS: 12181600.00% (0.0001 => 12.1817, std.dev.: 1.8341) MultiSource/Applications/kimwitu++/kc: 52000.00% (0.0001 => 0.0521, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576900.00% (0.0001 => 0.5770, std.dev.: 0.0199) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10069800.00% (0.0001 => 10.0699, std.dev.: 0.0161) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5676900.00% (0.0001 => 5.6770, std.dev.: 0.8060) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1722.63% (1.1194 => 20.4025, std.dev.: 0.7691) MultiSource/Applications/ClamAV/clamscan: 68.83% (22.1758 => 37.4389, std.dev.: 0.3789) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 61.11% (7.0540 => 11.3647, std.dev.: 0.1093) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.04% (2.9384 => 4.6146, std.dev.: 0.2675) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.13% (8.1363 => 12.1340, std.dev.: 0.2200) MultiSource/Applications/JM/lencod/lencod: 46.71% (21.9371 => 32.1843, std.dev.: 0.1436) MultiSource/Benchmarks/FreeBench/distray/distray: 44.79% (0.1056 => 0.1529, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/almabench: 39.04% (0.0730 => 0.1015, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 38.20% (0.1432 => 0.1979, std.dev.: 0.0058) SingleSource/UnitTests/vla: 35.21% (0.0355 => 0.0480, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/messages-2: 27.95% (0.0662 => 0.0847, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 25.65% (0.1236 => 0.1553, std.dev.: 0.0057) MultiSource/Applications/aha/aha: 25.46% (0.1151 => 0.1444, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 24.66% (0.0730 => 0.0910, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.53% (0.1125 => 0.1401, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.99% (0.0746 => 0.0925, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 23.98% (0.0442 => 0.0548, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: 23.90% (0.0456 => 0.0565, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Oscar: 23.74% (0.0636 => 0.0787, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.56% (0.1044 => 0.1290, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 23.06% (3.8922 => 4.7898, std.dev.: 0.0766) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 22.98% (0.1114 => 0.1370, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/exptree: 22.97% (0.0814 => 0.1001, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: 22.96% (0.0871 => 0.1071, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.84% (0.1029 => 0.1264, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/hash: 22.47% (0.0485 => 0.0594, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 22.40% (0.2554 => 0.3126, std.dev.: 0.0193) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 22.35% (0.0953 => 0.1166, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.90% (0.1566 => 0.1909, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 21.72% (1.4186 => 1.7267, std.dev.: 0.0262) MultiSource/Benchmarks/BitBench/five11/five11: 21.69% (0.0567 => 0.0690, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.30% (0.3441 => 0.4174, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C++/office/office: 21.27% (0.3136 => 0.3803, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 21.21% (4.2646 => 5.1692, std.dev.: 0.0963) SingleSource/UnitTests/ObjC/dot-syntax-1: 20.88% (0.0479 => 0.0579, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/tsp/tsp: 20.68% (0.1175 => 0.1418, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/ks/ks: 20.60% (0.1510 => 0.1821, std.dev.: 0.0055) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.52% (0.1584 => 0.1909, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 20.38% (0.0834 => 0.1004, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 20.14% (3.8723 => 4.6521, std.dev.: 0.1448) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 19.93% (0.3427 => 0.4110, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.30% (0.2700 => 0.3221, std.dev.: 0.0173) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 19.20% (0.1906 => 0.2272, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/misr: 18.96% (0.0633 => 0.0753, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 18.82% (0.3422 => 0.4066, std.dev.: 0.0089) SingleSource/UnitTests/ObjC/parameter-passing: 18.82% (0.3927 => 0.4666, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/moments: 18.50% (0.4048 => 0.4797, std.dev.: 0.0240) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0704 => 0.0832, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 18.17% (0.8921 => 1.0542, std.dev.: 0.0301) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 18.15% (0.1625 => 0.1920, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.05% (0.0842 => 0.0994, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/ray: 17.94% (0.4064 => 0.4793, std.dev.: 0.0179) SingleSource/Benchmarks/Misc/whetstone: 17.88% (0.0660 => 0.0778, std.dev.: 0.0023) MultiSource/Applications/treecc/treecc: 17.80% (2.0273 => 2.3882, std.dev.: 0.0896) SingleSource/UnitTests/2006-12-11-LoadConstants: 17.67% (0.1143 => 0.1345, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.58% (0.1337 => 0.1572, std.dev.: 0.0048) MultiSource/Applications/hbd/hbd: 17.48% (1.5603 => 1.8330, std.dev.: 0.0421) SingleSource/Benchmarks/Misc/fbench: 17.40% (0.0592 => 0.0695, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.25% (14.3668 => 16.8452, std.dev.: 0.2635) SingleSource/UnitTests/ObjC/instance-method-metadata: 17.10% (0.3543 => 0.4149, std.dev.: 0.0137) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 17.06% (0.0838 => 0.0981, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.90% (0.8172 => 0.9553, std.dev.: 0.0385) SingleSource/UnitTests/ObjC/for-in: 16.87% (0.3694 => 0.4317, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.84% (0.5981 => 0.6988, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout/lists: 16.77% (0.0626 => 0.0731, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.68% (0.2872 => 0.3351, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.43% (0.2793 => 0.3252, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.30% (0.3865 => 0.4495, std.dev.: 0.0144) MultiSource/Benchmarks/Olden/mst/mst: 16.25% (0.1163 => 0.1352, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.07% (0.3826 => 0.4441, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/random: 16.02% (0.2802 => 0.3251, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout/matrix: 16.01% (0.0818 => 0.0949, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.90% (0.0648 => 0.0751, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.88% (0.2065 => 0.2393, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.67% (0.1117 => 0.1292, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hello: 15.66% (0.2714 => 0.3139, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/property: 15.34% (0.3886 => 0.4482, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.32% (0.0770 => 0.0888, std.dev.: 0.0036) MultiSource/Applications/viterbi/viterbi: 15.31% (0.1555 => 0.1793, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.19% (0.0770 => 0.0887, std.dev.: 0.0041) MultiSource/Applications/sgefa/sgefa: 15.15% (0.3109 => 0.3580, std.dev.: 0.0143) SingleSource/Benchmarks/Misc-C++/bigfib: 14.98% (0.6456 => 0.7423, std.dev.: 0.0309) SingleSource/UnitTests/ObjC/exceptions: 14.68% (0.3828 => 0.4390, std.dev.: 0.0049) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.61% (0.3121 => 0.3577, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/objinst: 14.31% (0.3131 => 0.3579, std.dev.: 0.0080) SingleSource/Benchmarks/McGill/chomp: 14.26% (0.1655 => 0.1891, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.86% (0.9765 => 1.1118, std.dev.: 0.0432) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.79% (0.5860 => 0.6668, std.dev.: 0.0261) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.61% (0.2271 => 0.2580, std.dev.: 0.0112) MultiSource/Applications/sqlite3/sqlite3: 12.31% (17.1811 => 19.2954, std.dev.: 0.7828) SingleSource/UnitTests/ObjC/exceptions-3: 12.26% (0.3516 => 0.3947, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/trivial-interface: 12.24% (0.3473 => 0.3898, std.dev.: 0.0155) SingleSource/UnitTests/ObjC/exceptions-4: 12.14% (0.3543 => 0.3973, std.dev.: 0.0084) SingleSource/UnitTests/ObjC/synchronized: 12.08% (0.3561 => 0.3991, std.dev.: 0.0155) SingleSource/UnitTests/ObjC/exceptions-2: 12.01% (0.3497 => 0.3917, std.dev.: 0.0111) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.78% (5.0018 => 5.5908, std.dev.: 0.1930) SingleSource/Benchmarks/Shootout-C++/ary3: 11.57% (0.3283 => 0.3663, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.54% (0.4879 => 0.5442, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/lists1: 10.75% (0.3684 => 0.4080, std.dev.: 0.0128) SingleSource/Benchmarks/Stanford/Puzzle: 10.73% (0.1268 => 0.1404, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary2: 9.44% (0.3379 => 0.3698, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/matrix: 9.23% (0.3098 => 0.3384, std.dev.: 0.0110) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 149.60% (4.3953 => 10.9707, std.dev.: 0.0295) SingleSource/Benchmarks/Shootout-C++/methcall: 147.22% (5.3999 => 13.3494, std.dev.: 0.0149) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.99% (1.2838 => 1.5790, std.dev.: 0.0883) SingleSource/Benchmarks/Misc/oourafft: 17.49% (6.6465 => 7.8089, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.90% (1.1145 => 1.3028, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.01% (0.2944 => 0.3327, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/hash2: 12.84% (3.1578 => 3.5632, std.dev.: 0.0438) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.60% (2.8904 => 3.2258, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: 10.20% (1.1396 => 1.2558, std.dev.: 0.0024) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.23% (1.7254 => 1.8847, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/ffbench: 8.35% (0.9505 => 1.0299, std.dev.: 0.0207) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.91% (4.2280 => 4.4777, std.dev.: 0.0022) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.12% (11.6436 => 12.1237, std.dev.: 0.0072) MultiSource/Applications/lua/lua: 4.09% (26.0924 => 27.1605, std.dev.: 0.2381) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.34% (0.4162 => 0.4301, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.13% (1.3677 => 1.3969, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 2.03% (3.1595 => 3.2236, std.dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/dry: 1.95% (2.4116 => 2.4586, std.dev.: 0.0106) MultiSource/Benchmarks/PAQ8p/paq8p: 1.71% (85.0658 => 86.5190, std.dev.: 0.1759) SingleSource/Benchmarks/Shootout-C++/ackermann: 1.65% (1.7133 => 1.7415, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.45% (6.5088 => 6.6031, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (27.8444 => 28.2395, std.dev.: 0.0683) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.27% (1.0313 => 1.0444, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0503, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.13% (5.2139 => 5.2726, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.28% (6.6874 => 0.1822, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -75.45% (0.8651 => 0.2124, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.00% (5.2763 => 1.3193, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/richards_benchmark: -44.70% (0.1622 => 0.0897, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.32% (5.3855 => 4.7219, std.dev.: 0.1392) MultiSource/Applications/JM/ldecod/ldecod: -9.74% (10.4361 => 9.4195, std.dev.: 0.3583) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.97% (5.3526 => 4.8725, std.dev.: 0.1017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.36% (0.3987 => 0.2378, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.35% (4.5009 => 2.7747, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7636, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.11% (2.6546 => 2.0147, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -19.25% (0.2161 => 0.1745, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.68% (1.6925 => 1.4272, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.68% (2.6778 => 2.2848, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.72% (32.5116 => 29.0277, std.dev.: 0.0179) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4245, std.dev.: 0.0045) MultiSource/Benchmarks/NPB-serial/is/is: -8.27% (9.5636 => 8.7724, std.dev.: 0.1362) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.50% (1.6805 => 1.5545, std.dev.: 0.0287) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4791, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.2416 => 3.0212, std.dev.: 0.0262) SingleSource/Benchmarks/CoyoteBench/huffbench: -5.76% (19.9488 => 18.8002, std.dev.: 0.1730) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5761, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: -4.96% (1.5835 => 1.5049, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: -4.41% (6.2999 => 6.0220, std.dev.: 0.0073) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8920, std.dev.: 0.0025) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.62% (0.4808 => 0.4682, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.85% (8.1563 => 8.0054, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -1.52% (10.2830 => 10.1266, std.dev.: 0.0050) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0020) Report Time: 2.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 09:45:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 11:45:03 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121126174503.C57C42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6273?compare_to=6270&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6273, Order: 168590, Start Time: 2012-11-26 16:14:29, End Time: 2012-11-26 17:45:36 To: 6270, Order: 168587, Start Time: 2012-11-26 14:23:40, End Time: 2012-11-26 15:57:42 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 6 (88 on baseline) Performance Improvements: 4 (29 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1044 (857 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/nbench/nbench: 1.16% (1.1620 => 1.1755, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.01% (1.2718 => 1.2847, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel24: 36.86% (0.2794 => 0.3824, std.dev.: 0.0370) SingleSource/Benchmarks/Shootout-C++/ary3: 2.99% (1.9997 => 2.0594, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.26% (1.8702 => 1.8937, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/ffbench: 1.13% (1.4155 => 1.4315, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -1.47% (1.0110 => 0.9961, std.dev.: 0.0045) MultiSource/Applications/SIBsim4/SIBsim4: -1.28% (1.3123 => 1.2955, std.dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel12: -13.27% (0.1387 => 0.1203, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.45% (1.2716 => 1.2532, std.dev.: 0.0028) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.38% (1.0781 => 1.0740, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -12.96% (0.0216 => 0.0188, std.dev.: 0.0077) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.50% (0.0428 => 0.0413, std.dev.: 0.0130) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -4.20% (0.0333 => 0.0319, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.64% (0.0314 => 0.0316, std.dev.: 0.0096) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.71% (0.0425 => 0.0422, std.dev.: 0.0122) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0203 => 0.0202, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/test1: -21.46% (0.0219 => 0.0172, std.dev.: 0.0072) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.13% (0.1485 => 0.1487, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -1.72% (1.1689 => 1.1488, std.dev.: 0.0416) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.22% (0.4179 => 0.4188, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.83% (0.1417 => 0.1443, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.16% (0.0602 => 0.0615, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -8.33% (0.0276 => 0.0253, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.53% (0.0551 => 0.0598, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.08% (1.1967 => 1.1976, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -93.55% (0.0031 => 0.0002, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -40.74% (0.0027 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.32% (0.0622 => 0.0624, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.23% (0.0217 => 0.0210, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.75% (0.7735 => 0.7870, std.dev.: 0.0028) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 12.50% (0.0080 => 0.0090, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.11% (16.4461 => 17.6158, std.dev.: 0.0322) MultiSource/Applications/sqlite3/sqlite3: 2316.23% (0.6332 => 15.2996, std.dev.: 0.0643) MultiSource/Benchmarks/McCat/08-main/main: 43.53% (0.1831 => 0.2628, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.12% (0.1559 => 0.1448, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7125.36% (0.3123 => 22.5648, std.dev.: 1.1098) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.95% (0.2463 => 0.3718, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1548.53% (0.3344 => 5.5127, std.dev.: 0.0879) SingleSource/Benchmarks/Misc-C++/Large/ray: 34.69% (0.2364 => 0.3184, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 4.06% (0.6010 => 0.6254, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/mandel: 2.56% (0.0429 => 0.0440, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.32% (0.3266 => 0.3407, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/strcat: 3.10% (0.1969 => 0.2030, std.dev.: 0.0036) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.34% (0.0224 => 0.0227, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -28.26% (0.0230 => 0.0165, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0437, std.dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: 10.74% (0.1462 => 0.1619, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4635, std.dev.: 0.0085) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0687, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4933, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5132, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5948, std.dev.: 0.1284) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3300, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1289, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3629, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4095, std.dev.: 0.0288) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0829, std.dev.: 0.0029) SingleSource/Regression/C/uint64_to_float: -24.22% (2.1832 => 1.6545, std.dev.: 0.0085) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.79% (0.0810 => 0.0946, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 13.13% (0.1112 => 0.1258, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.29% (0.0830 => 0.0932, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.07% (0.2180 => 0.2356, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.62% (0.6010 => 0.6468, std.dev.: 0.0069) MultiSource/Applications/viterbi/viterbi: 7.04% (0.1577 => 0.1688, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.79% (0.3137 => 0.3350, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.43% (0.6287 => 0.6691, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.7473 => 0.7930, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.09% (0.5961 => 0.6324, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.92% (0.3295 => 0.3490, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.75% (0.1983 => 0.2097, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.54% (0.2240 => 0.2364, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: 5.48% (1.2222 => 1.2892, std.dev.: 0.0113) MultiSource/Benchmarks/MallocBench/gs/gs: 4.83% (4.1305 => 4.3300, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.76% (0.3003 => 0.3146, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 4.70% (0.7950 => 0.8324, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.70% (0.2998 => 0.3139, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.58% (0.9435 => 0.9867, std.dev.: 0.0152) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.53% (0.2519 => 0.2633, std.dev.: 0.0029) MultiSource/Applications/treecc/treecc: 4.33% (1.9948 => 2.0812, std.dev.: 0.0099) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.1271 => 1.1755, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.27% (1.1606 => 1.2102, std.dev.: 0.0101) MultiSource/Applications/hbd/hbd: 4.12% (1.4269 => 1.4857, std.dev.: 0.0150) MultiSource/Applications/lua/lua: 4.04% (3.8189 => 3.9730, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.88% (0.4127 => 0.4287, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.74% (14.2605 => 14.7938, std.dev.: 0.0897) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.73% (0.6227 => 0.6459, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 3.63% (0.2999 => 0.3108, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.58% (2.1401 => 2.2168, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.56% (0.5817 => 0.6024, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.49% (1.3279 => 1.3742, std.dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: 3.37% (14.7684 => 15.2661, std.dev.: 0.0392) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.35% (1.1685 => 1.2076, std.dev.: 0.0094) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.26% (4.4880 => 4.6345, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 3.25% (2.2184 => 2.2904, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.24% (0.5191 => 0.5359, std.dev.: 0.0058) MultiSource/Applications/d/make_dparser: 3.20% (3.2366 => 3.3403, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 3.08% (1.2568 => 1.2955, std.dev.: 0.0056) MultiSource/Applications/minisat/minisat: 3.04% (0.6834 => 0.7042, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.98% (1.2526 => 1.2899, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.72% (1.1170 => 1.1474, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.64% (8.6476 => 8.8757, std.dev.: 0.0578) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.51% (1.6386 => 1.6797, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.49% (4.1763 => 4.2801, std.dev.: 0.0355) MultiSource/Applications/JM/ldecod/ldecod: 2.45% (6.7320 => 6.8972, std.dev.: 0.0567) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.38% (6.6074 => 6.7644, std.dev.: 0.0297) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.35% (0.6586 => 0.6741, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 2.18% (0.8768 => 0.8959, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 2.12% (15.3280 => 15.6533, std.dev.: 0.1028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.12% (4.4873 => 4.5824, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.10% (13.1811 => 13.4580, std.dev.: 0.0331) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.94% (1.2602 => 1.2847, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 1.91% (0.7557 => 0.7701, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.80% (4.5702 => 4.6523, std.dev.: 0.0049) MultiSource/Applications/lemon/lemon: 1.73% (1.0945 => 1.1134, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 1.54% (0.9810 => 0.9961, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.07% (1.2423 => 1.2556, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 142.71% (0.0199 => 0.0483, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/pi: 57.68% (1.5795 => 2.4905, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.32% (0.7597 => 0.8913, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.19% (2.9753 => 3.4571, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.71% (2.7995 => 3.2112, std.dev.: 0.0690) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6086, std.dev.: 0.0246) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.15% (1.1857 => 1.2823, std.dev.: 0.0102) SingleSource/Benchmarks/McGill/queens: 7.06% (1.7056 => 1.8260, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/richards_benchmark: 6.84% (1.3037 => 1.3929, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.60% (4.7794 => 5.0949, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.90% (4.9686 => 5.2618, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.84% (4.5327 => 4.7975, std.dev.: 0.0348) MultiSource/Applications/SIBsim4/SIBsim4: 5.82% (3.1873 => 3.3729, std.dev.: 0.0217) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.82% (6.2275 => 6.5278, std.dev.: 0.0356) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.68% (3.3761 => 3.5342, std.dev.: 0.0273) MultiSource/Applications/lambda-0_1_3/lambda: 4.33% (7.4933 => 7.8175, std.dev.: 0.0626) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.13% (4.9453 => 5.1495, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.92% (14.0064 => 14.5557, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.84% (4.9469 => 5.1369, std.dev.: 0.0389) MultiSource/Applications/siod/siod: 3.20% (3.6643 => 3.7817, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/ary3: 2.98% (1.9999 => 2.0594, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.93% (8.2783 => 8.5211, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.65% (11.5690 => 11.8757, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout/lists: 2.24% (7.3375 => 7.5017, std.dev.: 0.0223) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.19% (4.8660 => 4.9726, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.72% (4.8362 => 4.9193, std.dev.: 0.0239) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.51% (1.5941 => 1.6182, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.47% (1.1365 => 1.1532, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.33% (2.4647 => 2.4976, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/neural/neural: 1.33% (1.0841 => 1.0985, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.19% (5.4641 => 4.3063, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.75% (7.2130 => 6.1493, std.dev.: 0.1276) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.09% (1.0512 => 0.9346, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: -10.90% (1.1216 => 0.9994, std.dev.: 0.0283) MultiSource/Benchmarks/mafft/pairlocalalign: -8.55% (63.1822 => 57.7828, std.dev.: 0.1539) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.36% (14.6451 => 13.4204, std.dev.: 0.1803) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.08% (0.3269 => 0.3005, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.87% (4.7482 => 4.4219, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.08% (5.4972 => 5.1632, std.dev.: 0.0712) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.95% (3.7148 => 3.4937, std.dev.: 0.0349) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.14% (5.1557 => 4.8909, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.46% (4.7449 => 4.5332, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.77% (6.0224 => 5.7951, std.dev.: 0.0156) MultiSource/Applications/lua/lua: -3.34% (29.8330 => 28.8373, std.dev.: 0.0711) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.12% (0.5807 => 0.5626, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.05% (28.5821 => 27.7100, std.dev.: 0.0150) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.85% (1.2822 => 1.2457, std.dev.: 0.0134) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.52% (2.8773 => 2.8047, std.dev.: 0.0267) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.30% (9.9065 => 9.6785, std.dev.: 0.0854) MultiSource/Benchmarks/Olden/bisort/bisort: -2.25% (0.6636 => 0.6487, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: -2.17% (3.4237 => 3.3493, std.dev.: 0.0262) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (11.5316 => 11.2992, std.dev.: 0.0063) MultiSource/Applications/aha/aha: -2.02% (3.3398 => 3.2725, std.dev.: 0.0164) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.95% (3.2169 => 3.1541, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.59% (4.9994 => 4.9198, std.dev.: 0.0164) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.56% (2.4490 => 2.4109, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.52% (4.2466 => 4.1822, std.dev.: 0.0155) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.30% (2.3487 => 2.3182, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.14% (5.6343 => 5.5700, std.dev.: 0.0099) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.66% (1.0262 => 1.0740, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 52.85% (0.0123 => 0.0188, std.dev.: 0.0077) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.23% (0.0408 => 0.0413, std.dev.: 0.0130) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 25.59% (0.0254 => 0.0319, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0096) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0122) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/test1: -4.44% (0.0180 => 0.0172, std.dev.: 0.0072) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 3.41% (0.1438 => 0.1487, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.40% (1.1329 => 1.1488, std.dev.: 0.0416) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.58% (0.4164 => 0.4188, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.41% (0.1369 => 0.1443, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.06% (0.0641 => 0.0615, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 29.74% (0.0195 => 0.0253, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.46% (0.0578 => 0.0598, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.71% (1.1437 => 1.1976, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0001 => 0.0002, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 14.29% (0.0014 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.48% (0.0627 => 0.0624, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.67% (0.0180 => 0.0210, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.83% (0.8017 => 0.7870, std.dev.: 0.0028) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 45.16% (0.0062 => 0.0090, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 09:46:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 11:46:01 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121126174601.0E1EC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6274?compare_to=6266&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6274, Order: 168586, Start Time: 2012-11-26 14:25:53, End Time: 2012-11-26 17:46:32 To: 6266, Order: 168583, Start Time: 2012-11-26 10:16:58, End Time: 2012-11-26 13:37:47 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (172 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1091 (719 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.82% (2.0471 => 2.1048, std.dev.: 0.0132) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.80% (0.0625 => 0.0880, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.17% (0.1063 => 0.1405, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.27% (0.2969 => 0.3749, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.86% (0.1106 => 0.1392, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.49% (0.0714 => 0.0896) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.25% (0.4253 => 0.5327, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.91% (0.4139 => 0.5170, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 24.36% (1.5932 => 1.9813, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.00% (0.0475 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.97% (0.5900 => 0.7314, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.39% (0.4994 => 0.6162, std.dev.: 0.0043) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.29% (0.0584 => 0.0720, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.14% (0.5000 => 0.6157, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.53% (0.1620 => 0.1985, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.43% (0.1021 => 0.1250, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.13% (0.1107 => 0.1352) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.07% (0.0897 => 0.1095, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.89% (0.0584 => 0.0706, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.85% (0.0633 => 0.0765, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.85% (0.1103 => 0.1333, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.61% (0.0495 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.57% (0.3903 => 0.4706, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 20.57% (0.0948 => 0.1143, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.56% (0.0642 => 0.0774, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.46% (0.1549 => 0.1866, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 20.46% (0.0821 => 0.0989, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.34% (0.1003 => 0.1207, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.32% (0.0822 => 0.0989) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.89% (0.1604 => 0.1923, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 19.77% (0.1619 => 0.1939, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 19.70% (0.0604 => 0.0723, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 19.32% (0.0947 => 0.1130, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.02% (0.1462 => 0.1740, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 18.94% (0.0808 => 0.0961) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.62% (0.2014 => 0.2389, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.56% (0.3890 => 0.4612, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 18.47% (0.5826 => 0.6902, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 18.14% (0.1218 => 0.1439, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 18.02% (0.4029 => 0.4755, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.02% (0.2736 => 0.3229, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 18.02% (0.5889 => 0.6950, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 17.91% (0.0698 => 0.0823, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.90% (1.3152 => 1.5506, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.74% (0.1088 => 0.1281, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.62% (0.2866 => 0.3371, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 17.54% (0.1505 => 0.1769, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 17.20% (0.5546 => 0.6500, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.11% (3.5627 => 4.1723, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.07% (0.1968 => 0.2304, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.98% (1.6211 => 1.8964, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: 16.91% (1.8794 => 2.1972, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 16.86% (0.0605 => 0.0707, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.79% (0.4658 => 0.5440, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.72% (0.3271 => 0.3818, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.70% (0.2875 => 0.3355, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.55% (0.1160 => 0.1352, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 16.37% (0.9697 => 1.1284, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: 16.33% (0.1421 => 0.1653, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.30% (0.4361 => 0.5072, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.28% (2.7292 => 3.1735, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 16.18% (1.0781 => 1.2525, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.16% (4.4195 => 5.1335, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.08% (0.5026 => 0.5834, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.06% (0.3930 => 0.4561, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 15.99% (0.7171 => 0.8318, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: 15.82% (0.2750 => 0.3185, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.74% (0.2738 => 0.3169, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 15.73% (0.2714 => 0.3141, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 15.73% (0.1284 => 0.1486, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 15.72% (4.2109 => 4.8728, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/fibo: 15.71% (0.2725 => 0.3153, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 15.68% (0.3004 => 0.3475, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 15.65% (0.2780 => 0.3215, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.65% (0.2729 => 0.3156, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.58% (0.2792 => 0.3227, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 15.56% (0.3465 => 0.4004, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 15.52% (0.2823 => 0.3261, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 15.50% (0.2813 => 0.3249, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 15.48% (0.2803 => 0.3237, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 15.48% (0.9909 => 1.1443, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 15.44% (0.3446 => 0.3978, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.43% (1.9694 => 2.2733, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 15.40% (0.2811 => 0.3244, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 15.38% (0.3460 => 0.3992, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 15.36% (0.3496 => 0.4033, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 15.34% (0.3469 => 0.4001, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 15.31% (0.3442 => 0.3969, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.30% (2.0673 => 2.3836, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.29% (0.2911 => 0.3356, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.28% (0.3488 => 0.4021, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.26% (1.9966 => 2.3012, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 15.25% (0.3096 => 0.3568, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.24% (0.3195 => 0.3682, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.05% (0.1090 => 0.1254, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 15.00% (0.3267 => 0.3757, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 14.96% (0.3650 => 0.4196, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 14.86% (0.3258 => 0.3742, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 14.85% (0.3643 => 0.4184, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/football/football: 14.84% (0.2075 => 0.2383, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 14.79% (23.5202 => 26.9986, std.dev.: 0.0131) SingleSource/UnitTests/ObjC/parameter-passing: 14.61% (0.3724 => 0.4268, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 14.59% (0.3317 => 0.3801, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 14.54% (0.2566 => 0.2939, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.35% (0.3060 => 0.3499, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 14.33% (0.3678 => 0.4205, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.25% (0.3362 => 0.3841, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.21% (0.3124 => 0.3568, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.17% (0.3282 => 0.3747, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 14.07% (1.4269 => 1.6277, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 14.07% (0.3348 => 0.3819, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.99% (0.3625 => 0.4132, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/sieve: 13.93% (0.3726 => 0.4245, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 13.87% (0.7875 => 0.8967, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/lists1: 13.81% (0.3477 => 0.3957, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.71% (0.3690 => 0.4196, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 13.51% (0.4146 => 0.4706, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 13.45% (2.1653 => 2.4565, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 13.43% (0.4251 => 0.4822, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.41% (0.3981 => 0.4515, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 13.32% (0.0758 => 0.0859, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.32% (0.3845 => 0.4357, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 13.02% (4.6177 => 5.2188, std.dev.: 0.0135) MultiSource/Benchmarks/mafft/pairlocalalign: 12.91% (2.1013 => 2.3726, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: 12.91% (0.5012 => 0.5659, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 12.75% (0.2691 => 0.3034, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.65% (0.2040 => 0.2298, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 12.17% (5.5417 => 6.2163, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.75% (0.6435 => 0.7191, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.28% (0.1383 => 0.1539, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.99% (0.1028 => 0.1141, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 10.86% (0.3498 => 0.3878, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.81% (0.2737 => 0.3033, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.78% (0.2068 => 0.2291, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.57% (0.3084 => 0.3410, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 10.56% (0.4847 => 0.5359, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.52% (0.6634 => 0.7332, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 9.92% (0.3336 => 0.3667, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 9.90% (2.0346 => 2.2360, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 9.66% (0.2391 => 0.2622, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.61% (0.2103 => 0.2305, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.99% (0.5361 => 0.5843, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.52% (4.6926 => 5.0925, std.dev.: 0.0146) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.28% (11.6398 => 12.6035, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.90% (0.5584 => 0.6025, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.80% (0.7426 => 0.8005, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 6.72% (11.9555 => 12.7594, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.88% (0.3792 => 0.4015, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.67% (0.2802 => 0.3073, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6107, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6683, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-2: 4.75% (1.8057 => 1.8915, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1722, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.39% (0.3693 => 0.3855, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: 4.25% (14.0481 => 14.6452, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1953, std.dev.: 0.0083) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2226, std.dev.: 0.0039) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3050, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2871, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5868, std.dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5643, std.dev.: 0.0194) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9767, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary2: -7.70% (0.2402 => 0.2217, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7900, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9587, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8038, std.dev.: 0.0043) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7729, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -2.93% (3.6262 => 3.5200, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.78% (17.2379 => 16.7591, std.dev.: 0.0696) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.54% (0.6293 => 0.6133, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8692, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5750, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4958, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1843, std.dev.: 0.0797) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0452, std.dev.: 0.0054) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 10:22:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 12:22:30 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121126182230.45F722A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6275?compare_to=6271&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6275, Order: 168590, Start Time: 2012-11-26 16:49:17, End Time: 2012-11-26 18:23:01 To: 6271, Order: 168588, Start Time: 2012-11-26 14:52:39, End Time: 2012-11-26 16:26:14 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (178 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (860 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.64% (2.0478 => 2.1018, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/salsa20: 2.36% (7.4937 => 7.6706, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/hash2: 2.19% (3.1932 => 3.2630, std.dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.29% (0.1431 => 0.1298, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.40% (0.3821 => 0.3500, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.13% (0.3142 => 0.2918, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -6.93% (2.4924 => 2.3198, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.79% (0.9542 => 0.8894, std.dev.: 0.0024) MultiSource/Applications/sgefa/sgefa: -6.55% (0.3357 => 0.3137, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -6.50% (0.3848 => 0.3598, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.50% (0.2355 => 0.2202, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.45% (0.3812 => 0.3566, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -6.44% (0.2160 => 0.2021, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -6.42% (0.3831 => 0.3585, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -6.39% (0.3896 => 0.3647, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -6.31% (0.3880 => 0.3635, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.30% (0.2428 => 0.2275, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.30% (0.4033 => 0.3779, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.30% (0.3891 => 0.3646, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.26% (9.2283 => 8.6505, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.25% (0.7198 => 0.6748, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: -6.25% (0.4176 => 0.3915, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.15% (0.9852 => 0.9246, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: -6.08% (16.1920 => 15.2076, std.dev.: 0.0102) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.02% (0.3884 => 0.3650, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.00% (0.6484 => 0.6095, std.dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: -5.97% (7.0961 => 6.6725, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.94% (1.3722 => 1.2907, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.90% (4.0323 => 3.7943, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.88% (4.8161 => 4.5329, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/property: -5.86% (0.4199 => 0.3953, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.85% (0.5591 => 0.5264, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.82% (0.5857 => 0.5516, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.78% (0.5705 => 0.5375, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.76% (1.0544 => 0.9937, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: -5.75% (0.9179 => 0.8651, std.dev.: 0.0114) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.71% (0.2695 => 0.2541, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.70% (1.6364 => 1.5431, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.68% (0.5863 => 0.5530, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.67% (4.8802 => 4.6034, std.dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: -5.66% (1.1530 => 1.0877, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.65% (0.6230 => 0.5878, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.65% (6.7716 => 6.3892, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.64% (0.5478 => 0.5169, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.63% (1.2300 => 1.1608, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.62% (0.6667 => 0.6292, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.62% (0.6304 => 0.5950, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.61% (0.6297 => 0.5944, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.60% (0.6660 => 0.6287, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.60% (0.5575 => 0.5263, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.59% (3.5339 => 3.3365, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.58% (0.5859 => 0.5532, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.56% (0.5849 => 0.5524, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.55% (0.5802 => 0.5480, std.dev.: 0.0033) MultiSource/Benchmarks/sim/sim: -5.55% (0.3406 => 0.3217, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.54% (4.5069 => 4.2572, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.54% (0.6446 => 0.6089, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.54% (0.5941 => 0.5612, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -5.54% (0.4515 => 0.4265, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.54% (0.5925 => 0.5597, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.53% (0.5805 => 0.5484, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.52% (0.6194 => 0.5852, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -5.51% (0.4280 => 0.4044, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.49% (0.5570 => 0.5264, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.48% (1.4642 => 1.3840, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.47% (1.2210 => 1.1542, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.47% (0.3658 => 0.3458, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -5.47% (1.1450 => 1.0824, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.46% (0.5581 => 0.5276, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.46% (0.6260 => 0.5918, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.44% (14.2083 => 13.4353, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.44% (0.6052 => 0.5723, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.42% (8.0126 => 7.5781, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.42% (0.6736 => 0.6371, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.38% (1.2784 => 1.2096, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.37% (0.6293 => 0.5955, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.32% (0.6189 => 0.5860, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.30% (0.8521 => 0.8069, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.30% (0.6676 => 0.6322, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.29% (1.2221 => 1.1574, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: -5.29% (17.1032 => 16.1982, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.28% (0.5456 => 0.5168, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.27% (0.5688 => 0.5388, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.24% (0.6033 => 0.5717, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -5.19% (0.2985 => 0.2830, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.18% (0.2278 => 0.2160, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.18% (1.3864 => 1.3146, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.18% (0.7919 => 0.7509, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.17% (0.5999 => 0.5689, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: -5.14% (0.3581 => 0.3397, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: -5.14% (4.3330 => 4.1104, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.10% (0.2999 => 0.2846, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.09% (0.4916 => 0.4666, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.07% (0.3057 => 0.2902, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.06% (0.2548 => 0.2419, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.06% (0.6681 => 0.6343, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: -5.06% (1.2515 => 1.1882, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -5.06% (1.3148 => 1.2483, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.03% (0.2385 => 0.2265, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: -5.03% (3.5154 => 3.3386, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/fibo: -5.02% (0.2871 => 0.2727, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.02% (0.6440 => 0.6117, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/08-main/main: -5.00% (0.2659 => 0.2526, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -4.99% (15.5079 => 14.7336, std.dev.: 0.0306) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.99% (0.3931 => 0.3735, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -4.93% (0.2939 => 0.2794, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.93% (0.2903 => 0.2760, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.93% (0.3837 => 0.3648, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.91% (0.4151 => 0.3947, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.91% (0.2933 => 0.2789, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.91% (0.3016 => 0.2868, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -4.88% (0.2849 => 0.2710, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -4.88% (0.3446 => 0.3278, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.86% (0.7524 => 0.7158, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.85% (2.1713 => 2.0660, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.85% (0.3323 => 0.3162, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -4.83% (15.2527 => 14.5164, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/methcall: -4.83% (0.3025 => 0.2879, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.82% (0.6395 => 0.6087, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -4.81% (0.7447 => 0.7089, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: -4.80% (0.3394 => 0.3231, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -4.79% (0.3255 => 0.3099, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -4.79% (4.0594 => 3.8651, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/wc: -4.77% (0.3205 => 0.3052, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -4.77% (5.0226 => 4.7829, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary2: -4.77% (0.3481 => 0.3315, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.73% (0.3319 => 0.3162, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.72% (0.5168 => 0.4924, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.71% (0.3483 => 0.3319, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.69% (0.7339 => 0.6995, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.67% (0.3252 => 0.3100, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: -4.66% (0.3194 => 0.3045, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -4.66% (0.4248 => 0.4050, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.65% (0.5569 => 0.5310, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.65% (0.3849 => 0.3670, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -4.65% (0.2989 => 0.2850, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -4.61% (0.3621 => 0.3454, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -4.60% (0.3867 => 0.3689, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.60% (0.7021 => 0.6698, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/except: -4.59% (0.3026 => 0.2887, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -4.58% (0.3059 => 0.2919, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -4.57% (0.4861 => 0.4639, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.55% (1.6474 => 1.5724, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.54% (0.5567 => 0.5314, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (0.5329 => 0.5087, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.50% (0.6395 => 0.6107, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.46% (0.9077 => 0.8672, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.44% (22.4056 => 21.4118, std.dev.: 0.0224) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.38% (0.4813 => 0.4602, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: -4.34% (0.3271 => 0.3129, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.30% (0.9557 => 0.9146, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.28% (0.4321 => 0.4136, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -4.26% (0.8418 => 0.8059, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: -4.19% (2.1401 => 2.0504, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/Hello: -4.19% (0.6347 => 0.6081, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -4.17% (2.4021 => 2.3020, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.16% (0.4083 => 0.3913, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.04% (2.2587 => 2.1674, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: -4.01% (0.6441 => 0.6183, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.93% (0.4427 => 0.4253, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -3.93% (1.5610 => 1.4997, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: -3.90% (0.6750 => 0.6487, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/hash: -3.85% (0.4524 => 0.4350, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -3.84% (0.7779 => 0.7480, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -3.83% (34.0927 => 32.7853, std.dev.: 0.0212) SingleSource/Benchmarks/Shootout-C++/sieve: -3.80% (0.3788 => 0.3644, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.78% (0.3491 => 0.3359, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -3.66% (0.7982 => 0.7690, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: -3.65% (18.2933 => 17.6250, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.03% (5.4682 => 5.3025, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -2.37% (20.7746 => 20.2820, std.dev.: 0.0341) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7560, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: -8.63% (1.2842 => 1.1734, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.76% (2.2633 => 2.1783, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.46% (1.3096 => 1.2774, std.dev.: 0.0124) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4711, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 11:36:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 13:36:01 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121126193601.504352A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6276?compare_to=6273&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6276, Order: 168592, Start Time: 2012-11-26 18:02:22, End Time: 2012-11-26 19:36:32 To: 6273, Order: 168590, Start Time: 2012-11-26 16:14:29, End Time: 2012-11-26 17:45:36 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 4 (43 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1049 (912 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.82% (0.9026 => 0.9732, std.dev.: 0.0191) MultiSource/Benchmarks/mafft/pairlocalalign: 1.31% (8.7478 => 8.8625, std.dev.: 0.0354) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.52% (41.1532 => 42.1919, std.dev.: 0.2244) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.27% (13.4204 => 13.7254, std.dev.: 0.0481) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.81% (2.8047 => 2.7540, std.dev.: 0.0165) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.10% (1.0740 => 1.1073, std.dev.: 0.2241) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 13.83% (0.0188 => 0.0214, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.39% (0.0413 => 0.0427, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -11.29% (0.0319 => 0.0283, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.95% (0.0316 => 0.0313, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.24% (0.0422 => 0.0423, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: 0.99% (0.0202 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 26.16% (0.0172 => 0.0217, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 62.50% (0.0008 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.29% (0.1487 => 0.1521, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 9.83% (1.1488 => 1.2617, std.dev.: 0.0102) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.10% (0.4188 => 0.4100, std.dev.: 0.0691) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.22% (0.1443 => 0.1475, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.07% (0.0615 => 0.0640, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.70% (0.0253 => 0.0275, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.02% (0.0598 => 0.0556, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.02% (1.1976 => 1.1974, std.dev.: 0.0265) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1450.00% (0.0002 => 0.0031, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 68.75% (0.0016 => 0.0027, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.69% (0.0624 => 0.0647, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.81% (0.0210 => 0.0260, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.76% (0.7870 => 0.7810, std.dev.: 0.0151) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -2.22% (0.0090 => 0.0088, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 9.13% (16.4461 => 17.9477, std.dev.: 0.9726) MultiSource/Applications/sqlite3/sqlite3: 2338.14% (0.6332 => 15.4383, std.dev.: 0.4795) MultiSource/Benchmarks/McCat/08-main/main: 48.44% (0.1831 => 0.2718, std.dev.: 0.0784) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.54% (0.1559 => 0.1457, std.dev.: 0.0483) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7236.22% (0.3123 => 22.9110, std.dev.: 0.5515) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.43% (0.2463 => 0.3705, std.dev.: 0.1301) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1533.97% (0.3344 => 5.4640, std.dev.: 0.0520) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.84% (0.2364 => 0.3235, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 4.51% (0.6010 => 0.6281, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.58% (0.3266 => 0.3383, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 3.25% (0.1969 => 0.2033, std.dev.: 0.0072) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -28.57% (0.0224 => 0.0160, std.dev.: 0.0039) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0527, std.dev.: 0.0110) MultiSource/Applications/oggenc/oggenc: 10.53% (0.1462 => 0.1616, std.dev.: 0.0107) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4780, std.dev.: 0.0383) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0727, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4984, std.dev.: 0.0845) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5179, std.dev.: 0.0169) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.4973, std.dev.: 0.3232) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3191, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1397, std.dev.: 0.0147) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3631, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4096, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0822, std.dev.: 0.0183) SingleSource/Regression/C/uint64_to_float: -23.85% (2.1832 => 1.6624, std.dev.: 0.0091) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0005, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.90% (0.8855 => 0.9732, std.dev.: 0.0191) MultiSource/Applications/SPASS/SPASS: 3.85% (14.2605 => 14.8090, std.dev.: 0.1708) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.63% (2.1401 => 2.2177, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.32% (0.8716 => 0.9005, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.20% (0.4559 => 0.4705, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.07% (1.5315 => 1.5785, std.dev.: 0.0121) MultiSource/Applications/lemon/lemon: 2.99% (1.0945 => 1.1272, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.94% (0.8340 => 0.8585, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 2.76% (8.6247 => 8.8625, std.dev.: 0.0354) MultiSource/Applications/d/make_dparser: 2.53% (3.2366 => 3.3185, std.dev.: 0.0317) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.41% (0.5191 => 0.5316, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.25% (0.6586 => 0.6734, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 88.94% (0.0199 => 0.0376, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/pi: 56.83% (1.5795 => 2.4771, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.86% (2.9753 => 3.4768, std.dev.: 0.0663) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.30% (0.7597 => 0.8835, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.71% (2.7995 => 3.2113, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6086, std.dev.: 0.0927) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.07% (1.1857 => 1.2814, std.dev.: 0.0193) SingleSource/Benchmarks/McGill/queens: 7.33% (1.7056 => 1.8307, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/richards_benchmark: 6.90% (1.3037 => 1.3937, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.74% (4.7794 => 5.1015, std.dev.: 0.0061) MultiSource/Applications/SIBsim4/SIBsim4: 6.65% (3.1873 => 3.3994, std.dev.: 0.0440) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.95% (4.5327 => 4.8022, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.91% (4.9686 => 5.2624, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.80% (6.2275 => 6.5265, std.dev.: 0.0146) MultiSource/Applications/lambda-0_1_3/lambda: 4.64% (7.4933 => 7.8413, std.dev.: 0.0606) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.63% (3.3761 => 3.5323, std.dev.: 0.0412) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.13% (4.9453 => 5.1494, std.dev.: 0.0516) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.10% (4.9469 => 5.1498, std.dev.: 0.0372) MultiSource/Applications/hexxagon/hexxagon: 4.09% (14.0064 => 14.5798, std.dev.: 0.1469) MultiSource/Applications/siod/siod: 3.11% (3.6643 => 3.7784, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.75% (11.5690 => 11.8869, std.dev.: 0.0294) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.69% (8.2783 => 8.5010, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.57% (4.8362 => 4.9607, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.42% (4.8660 => 4.9837, std.dev.: 0.0315) SingleSource/Benchmarks/Shootout/lists: 2.37% (7.3375 => 7.5111, std.dev.: 0.0167) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.85% (41.4238 => 42.1919, std.dev.: 0.2244) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.64% (1.1365 => 1.1551, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: 1.27% (1.0841 => 1.0979, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.23% (4.4340 => 4.4886, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.10% (3.5679 => 3.6072, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/ReedSolomon: 1.06% (8.5322 => 8.6223, std.dev.: 0.0158) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.96% (5.4641 => 4.3186, std.dev.: 0.0698) MultiSource/Benchmarks/SciMark2-C/scimark2: -13.77% (28.5821 => 24.6475, std.dev.: 1.4576) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.58% (1.0512 => 0.9295, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.45% (7.2130 => 6.3872, std.dev.: 0.1825) MultiSource/Benchmarks/mafft/pairlocalalign: -8.49% (63.1822 => 57.8153, std.dev.: 0.0740) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -7.06% (4.7482 => 4.4129, std.dev.: 0.0423) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.28% (14.6451 => 13.7254, std.dev.: 0.0481) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.92% (5.4972 => 5.1718, std.dev.: 0.0550) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.47% (3.7148 => 3.5116, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.14% (5.1557 => 4.8909, std.dev.: 0.0697) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.48% (4.7449 => 4.5324, std.dev.: 0.0206) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.29% (2.8773 => 2.7540, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.72% (6.0224 => 5.7986, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.62% (0.5807 => 0.5655, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.60% (2.6356 => 2.5672, std.dev.: 0.0213) MultiSource/Applications/aha/aha: -2.40% (3.3398 => 3.2598, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash2: -2.32% (3.4237 => 3.3442, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.99% (11.5316 => 11.3017, std.dev.: 0.0264) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.52% (4.9994 => 4.9234, std.dev.: 0.0254) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 7.90% (1.0262 => 1.1073, std.dev.: 0.2241) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 73.98% (0.0123 => 0.0214, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 11.42% (0.0254 => 0.0283, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 5.77% (0.1438 => 0.1521, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 11.37% (1.1329 => 1.2617, std.dev.: 0.0102) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.54% (0.4164 => 0.4100, std.dev.: 0.0691) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.74% (0.1369 => 0.1475, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.16% (0.0641 => 0.0640, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.03% (0.0195 => 0.0275, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.81% (0.0578 => 0.0556, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.70% (1.1437 => 1.1974, std.dev.: 0.0265) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.19% (0.0627 => 0.0647, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 44.44% (0.0180 => 0.0260, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.58% (0.8017 => 0.7810, std.dev.: 0.0151) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 41.94% (0.0062 => 0.0088, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 12:19:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 14:19:06 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121126201906.2BC882A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6277?compare_to=6275&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6277, Order: 168597, Start Time: 2012-11-26 18:46:02, End Time: 2012-11-26 20:19:34 To: 6275, Order: 168590, Start Time: 2012-11-26 16:49:17, End Time: 2012-11-26 18:23:01 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (173 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (864 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 7.34% (0.4126 => 0.4429, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.52% (0.3834 => 0.4429, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.29% (1.2783 => 1.3715, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1006, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/salsa20: 2.34% (7.4937 => 7.6689, std.dev.: 0.0277) SingleSource/Benchmarks/Shootout-C++/hash2: 2.25% (3.1932 => 3.2651, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.15% (0.1431 => 0.1300) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.48% (0.3821 => 0.3497, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.07% (0.3142 => 0.2920, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -6.97% (2.4924 => 2.3187, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.78% (0.9542 => 0.8895, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: -6.58% (0.3357 => 0.3136, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-2: -6.53% (0.3831 => 0.3581, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -6.51% (0.3812 => 0.3564, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.44% (0.3848 => 0.3600, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.44% (0.3880 => 0.3630) SingleSource/UnitTests/ObjC/synchronized: -6.42% (0.3896 => 0.3646, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -6.39% (0.2160 => 0.2022, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: -6.35% (0.4033 => 0.3777, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.32% (0.3891 => 0.3645, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.28% (0.2355 => 0.2207, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.28% (0.7198 => 0.6746, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -6.23% (0.4176 => 0.3916, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -6.18% (9.2283 => 8.6579, std.dev.: 0.0067) MultiSource/Applications/JM/lencod/lencod: -6.12% (16.1920 => 15.2018, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.06% (0.6484 => 0.6091, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.05% (0.2428 => 0.2281, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.02% (0.9852 => 0.9259, std.dev.: 0.0149) MultiSource/Applications/JM/ldecod/ldecod: -6.01% (7.0961 => 6.6694, std.dev.: 0.0074) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.97% (0.3884 => 0.3652, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.87% (1.3722 => 1.2916, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.84% (4.0323 => 3.7967, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.84% (0.5857 => 0.5515, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.82% (1.0544 => 0.9930, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.81% (0.5591 => 0.5266, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.78% (4.8161 => 4.5375, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/property: -5.76% (0.4199 => 0.3957, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -5.76% (0.9179 => 0.8650, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.75% (0.5705 => 0.5377, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.71% (0.2695 => 0.2541, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.71% (6.7716 => 6.3850, std.dev.: 0.0050) MultiSource/Benchmarks/nbench/nbench: -5.68% (1.1530 => 1.0875, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.67% (4.8802 => 4.6036, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.63% (0.5859 => 0.5529, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.63% (0.3658 => 0.3452, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.62% (1.6364 => 1.5444, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.60% (0.6052 => 0.5713, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.60% (0.5575 => 0.5263, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.59% (0.5581 => 0.5269, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.58% (0.6304 => 0.5952, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.57% (0.5941 => 0.5610, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.57% (1.2300 => 1.1615, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.57% (0.5478 => 0.5173, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.56% (0.6260 => 0.5912, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.55% (0.6667 => 0.6297, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.55% (0.3406 => 0.3217, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.54% (0.5456 => 0.5154, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.53% (0.6297 => 0.5949, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.53% (1.4642 => 1.3833, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.52% (0.6194 => 0.5852, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -5.51% (0.4280 => 0.4044, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.50% (0.5802 => 0.5483, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -5.49% (0.4515 => 0.4267, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.48% (0.6660 => 0.6295, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.48% (0.5805 => 0.5487, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.48% (0.6446 => 0.6093, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.48% (0.5863 => 0.5542, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.47% (4.5069 => 4.2602, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.47% (0.5925 => 0.5601, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.46% (0.5570 => 0.5266, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.45% (14.2083 => 13.4341, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.44% (0.5849 => 0.5531, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.43% (0.6736 => 0.6370, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.43% (3.5339 => 3.3420, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.43% (0.6189 => 0.5853, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.42% (0.6676 => 0.6314, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.41% (8.0126 => 7.5792, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.39% (1.2784 => 1.2095, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -5.36% (1.1450 => 1.0836, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.36% (0.6293 => 0.5956, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.36% (17.1032 => 16.1873, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.35% (0.4916 => 0.4653, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.33% (0.6681 => 0.6325, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.32% (0.6033 => 0.5712, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.32% (1.2210 => 1.1561, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.30% (0.6440 => 0.6099, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -5.22% (4.3330 => 4.1068, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.22% (0.5999 => 0.5686, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.21% (0.8521 => 0.8077, std.dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: -5.20% (1.3864 => 1.3143, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -5.19% (0.2985 => 0.2830, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.18% (0.7919 => 0.7509, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.16% (0.2385 => 0.2262, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.14% (0.2278 => 0.2161, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.13% (0.5688 => 0.5396, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.12% (1.2221 => 1.1595, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.10% (0.2548 => 0.2418, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: -5.05% (0.3581 => 0.3400, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.04% (0.2999 => 0.2848, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -4.95% (3.5154 => 3.3413, std.dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: -4.94% (15.2527 => 14.4989, std.dev.: 0.0232) MultiSource/Applications/SPASS/SPASS: -4.93% (15.5079 => 14.7430, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/08-main/main: -4.93% (0.2659 => 0.2528, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.92% (0.7524 => 0.7154, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.91% (0.3483 => 0.3312, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.88% (0.3319 => 0.3157, std.dev.: 0.0022) MultiSource/Applications/Burg/burg: -4.87% (1.2515 => 1.1906, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -4.86% (1.3148 => 1.2509, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.83% (0.3931 => 0.3741, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.82% (0.7339 => 0.6985, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.81% (0.3057 => 0.2910, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.77% (0.2933 => 0.2793, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: -4.77% (0.7447 => 0.7092, std.dev.: 0.0014) MultiSource/Applications/lua/lua: -4.76% (4.0594 => 3.8663, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.75% (0.6395 => 0.6091, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -4.73% (0.2939 => 0.2800, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.72% (0.4151 => 0.3955, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.72% (0.3837 => 0.3656, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.72% (0.4813 => 0.4586, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.70% (0.5168 => 0.4925, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.68% (0.2903 => 0.2767, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: -4.66% (0.3194 => 0.3045, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.66% (0.3323 => 0.3168, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.62% (0.3849 => 0.3671, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -4.62% (0.3205 => 0.3057, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: -4.60% (0.2849 => 0.2718, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary2: -4.60% (0.3481 => 0.3321, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -4.60% (0.3025 => 0.2886, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -4.59% (0.3446 => 0.3288, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.58% (0.6395 => 0.6102, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.56% (1.6474 => 1.5722, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.55% (0.3252 => 0.3104, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.55% (2.1713 => 2.0725, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: -4.55% (0.2989 => 0.2853, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.54% (0.5567 => 0.5314, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (0.7021 => 0.6702, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -4.54% (0.3394 => 0.3240, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -4.49% (0.3255 => 0.3109, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.46% (22.4056 => 21.4053, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.45% (0.5569 => 0.5321, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.45% (0.5329 => 0.5092, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.44% (0.3016 => 0.2882, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -4.42% (0.3621 => 0.3461, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/lists1: -4.40% (0.3867 => 0.3697, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -4.33% (0.4248 => 0.4064, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -4.32% (0.3059 => 0.2927, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.31% (0.4083 => 0.3907, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: -4.30% (0.3026 => 0.2896, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.28% (0.4321 => 0.4136, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: -4.28% (0.3271 => 0.3131, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.23% (0.9557 => 0.9153, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -4.21% (2.1401 => 2.0499, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: -4.21% (5.0226 => 4.8112, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: -4.14% (0.6347 => 0.6084, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -4.13% (2.4021 => 2.3030, std.dev.: 0.0078) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.12% (0.9077 => 0.8703, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: -4.07% (0.8418 => 0.8075, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -4.07% (0.6441 => 0.6179, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -4.05% (0.7779 => 0.7464, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -3.96% (0.7982 => 0.7666, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -3.94% (0.6750 => 0.6484, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -3.93% (34.0927 => 32.7527, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.90% (2.2587 => 2.1706, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.70% (0.4427 => 0.4263, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -3.70% (1.5610 => 1.5032, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.58% (0.3491 => 0.3366, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: -3.56% (0.4524 => 0.4363, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -3.45% (18.2933 => 17.6627, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/sieve: -3.43% (0.3788 => 0.3658, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.08% (5.4682 => 5.2997, std.dev.: 0.0079) SingleSource/UnitTests/Vector/constpool: -2.55% (20.7746 => 20.2444, std.dev.: 0.0315) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7571, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -8.61% (1.2842 => 1.1736, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: -3.89% (2.2633 => 2.1753, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4719, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 12:32:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 14:32:42 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121126203242.4A6C42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6278?compare_to=6272&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6278, Order: 168592, Start Time: 2012-11-26 18:14:40, End Time: 2012-11-26 20:33:13 To: 6272, Order: 168587, Start Time: 2012-11-26 15:04:55, End Time: 2012-11-26 17:23:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 71 (190 on baseline) Performance Improvements: 5 (39 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1010 (656 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.89% (0.4566 => 0.5246, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 14.48% (0.8071 => 0.9240, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 14.31% (0.8563 => 0.9788, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 14.30% (0.6202 => 0.7089, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 14.06% (0.7169 => 0.8177, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.00% (0.6128 => 0.6986, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 13.70% (0.5780 => 0.6572, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 13.55% (0.6275 => 0.7125, std.dev.: 0.0211) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.06% (0.1049 => 0.1186, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.74% (0.5628 => 0.6345, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/hash2: 12.27% (0.5168 => 0.5802, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 12.14% (0.3467 => 0.3888, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/bh/bh: 12.06% (0.3334 => 0.3736, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 11.97% (2.4886 => 2.7864, std.dev.: 0.0371) SingleSource/Benchmarks/LivermoreLoops/kernel17: 11.78% (0.1010 => 0.1129, std.dev.: 0.0029) SingleSource/Benchmarks/LivermoreLoops/kernel16: 11.60% (0.1129 => 0.1260, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.51% (0.4022 => 0.4485, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/09-vor/vor: 11.14% (0.3574 => 0.3972, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.98% (1.7419 => 1.9331, std.dev.: 0.0139) SingleSource/Benchmarks/LivermoreLoops/kernel23: 10.71% (0.1111 => 0.1230, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 10.62% (0.3889 => 0.4302, std.dev.: 0.0007) SingleSource/Benchmarks/LivermoreLoops/kernel24: 10.58% (0.1002 => 0.1108, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.46% (1.4735 => 1.6277, std.dev.: 0.0043) SingleSource/Benchmarks/LivermoreLoops/kernel18: 10.37% (0.1485 => 0.1639, std.dev.: 0.0005) SingleSource/Benchmarks/LivermoreLoops/kernel21: 9.92% (0.1109 => 0.1219, std.dev.: 0.0026) MultiSource/Applications/oggenc/oggenc: 9.87% (6.5558 => 7.2028, std.dev.: 0.0744) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.73% (0.6113 => 0.6708, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.44% (1.7953 => 1.9647, std.dev.: 0.0437) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 9.06% (0.1335 => 0.1456, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 8.96% (0.4017 => 0.4377, std.dev.: 0.0051) MultiSource/Applications/Burg/burg: 8.96% (1.3383 => 1.4582, std.dev.: 0.0309) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.69% (0.3221 => 0.3501, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.49% (0.1189 => 0.1290, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/em3d/em3d: 8.20% (0.1976 => 0.2138, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.97% (2.2581 => 2.4381, std.dev.: 0.0665) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.12% (0.3162 => 0.3387, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.07% (0.4495 => 0.4813, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.87% (0.4191 => 0.4479, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.87% (0.4703 => 0.5026, std.dev.: 0.0084) SingleSource/UnitTests/Vector/constpool: 6.80% (53.4779 => 57.1169, std.dev.: 0.0922) SingleSource/Benchmarks/Shootout-C++/hello: 5.45% (0.3139 => 0.3310, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 5.39% (0.3598 => 0.3792, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/random: 4.89% (0.3251 => 0.3410, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists: 4.72% (0.4066 => 0.4258, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/moments: 4.67% (0.4797 => 0.5021, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.43% (6.7671 => 7.0666, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.20% (0.3252 => 0.3356, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.69% (4.7898 => 4.9185, std.dev.: 0.0374) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.85% (37.8909 => 38.5917, std.dev.: 0.0810) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 32.63% (0.1192 => 0.1581, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 15.16% (5.3681 => 6.1818, std.dev.: 0.1861) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 13.96% (6.4066 => 7.3007, std.dev.: 0.0546) SingleSource/Benchmarks/Shootout/ary3: 12.39% (4.2155 => 4.7376, std.dev.: 0.1193) MultiSource/Applications/lemon/lemon: 9.11% (1.4374 => 1.5683, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.97% (0.5770 => 0.6230, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: 7.11% (1.9556 => 2.0947, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.77% (6.0680 => 6.4789, std.dev.: 0.0801) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 6.20% (0.3435 => 0.3648, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash: 4.46% (0.7616 => 0.7956, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/ffbench: 3.78% (1.0299 => 1.0688, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.39% (3.7107 => 3.8364, std.dev.: 0.0156) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.13% (1.5545 => 1.6032, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/hash2: 2.66% (3.5632 => 3.6579, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.18% (6.3994 => 6.5386, std.dev.: 0.0216) SingleSource/Benchmarks/Dhrystone/fldry: 2.16% (1.9378 => 1.9797, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.76% (1.5634 => 1.5909, std.dev.: 0.0069) MultiSource/Applications/lua/lua: 1.65% (27.1605 => 27.6090, std.dev.: 0.0665) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.63% (2.3098 => 2.3474, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (3.8635 => 3.9202, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.15% (2.1365 => 2.1610, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.07% (4.0884 => 4.1320, std.dev.: 0.0079) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/parameter-passing: -5.10% (0.4666 => 0.4428, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.41% (0.4149 => 0.3966, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: -4.29% (0.4317 => 0.4132, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -2.32% (0.4390 => 0.4288, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -7.36% (4.0704 => 3.7709, std.dev.: 0.0837) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.08% (69.7777 => 69.8344, std.dev.: 0.2472) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 1.05% (0.1338 => 0.1352, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0420 => 0.0420, std.dev.: 0.0067) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.14% (0.0652 => 0.0679, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -0.04% (494.2815 => 494.0968, std.dev.: 0.1820) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 10.42% (63.2438 => 69.8344, std.dev.: 0.2472) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0067) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43714.56% (1.1277 => 494.0968, std.dev.: 0.1820) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 193.88% (0.5229 => 1.5367, std.dev.: 0.0943) MultiSource/Applications/SPASS/SPASS: 20.04% (14.9895 => 17.9937, std.dev.: 0.4351) MultiSource/Applications/kimwitu++/kc: 46.29% (14.1553 => 20.7074, std.dev.: 0.5958) MultiSource/Benchmarks/MallocBench/gs/gs: 15.09% (4.1105 => 4.7306, std.dev.: 0.2869) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.86% (1.1048 => 1.5120, std.dev.: 0.0770) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 439.13% (7.1582 => 38.5917, std.dev.: 0.0810) SingleSource/Benchmarks/Misc-C++-EH/spirit: 104.07% (3.4629 => 7.0666, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.88% (0.6222 => 1.0321, std.dev.: 0.0194) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10582.64% (0.0720 => 7.6915, std.dev.: 0.1737) MultiSource/Applications/SIBsim4/SIBsim4: 3920100.00% (0.0001 => 3.9202, std.dev.: 0.0136) MultiSource/Applications/SPASS/SPASS: 12170300.00% (0.0001 => 12.1704, std.dev.: 2.0901) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 63800.00% (0.0001 => 0.0639, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 622900.00% (0.0001 => 0.6230, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10085500.00% (0.0001 => 10.0856, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5677500.00% (0.0001 => 5.6776, std.dev.: 0.2914) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1799.76% (1.1194 => 21.2659, std.dev.: 0.4161) MultiSource/Applications/ClamAV/clamscan: 69.72% (22.1758 => 37.6372, std.dev.: 0.3652) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 58.53% (2.9384 => 4.6583, std.dev.: 0.2237) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.83% (7.0540 => 11.0629, std.dev.: 0.2653) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.81% (8.1363 => 11.9452, std.dev.: 0.3806) MultiSource/Applications/JM/lencod/lencod: 46.52% (21.9371 => 32.1424, std.dev.: 0.1996) MultiSource/Benchmarks/FreeBench/distray/distray: 44.98% (0.1056 => 0.1531, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/almabench: 38.90% (0.0730 => 0.1014, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: 38.20% (0.1432 => 0.1979, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: 31.68% (0.7433 => 0.9788, std.dev.: 0.0131) MultiSource/Benchmarks/McCat/15-trie/trie: 31.31% (0.0527 => 0.0692, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 30.30% (0.0528 => 0.0688, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 30.21% (0.0672 => 0.0875, std.dev.: 0.0013) SingleSource/UnitTests/vla: 29.86% (0.0355 => 0.0461, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: 29.67% (0.2700 => 0.3501, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/family/family: 29.22% (0.0397 => 0.0513, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 27.86% (0.4103 => 0.5246, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/hash: 27.84% (0.0485 => 0.0620, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: 27.12% (0.0933 => 0.1186, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 27.00% (0.0437 => 0.0555, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 26.52% (2.2024 => 2.7864, std.dev.: 0.0371) SingleSource/Benchmarks/Adobe-C++/functionobjects: 26.39% (0.5020 => 0.6345, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.37% (3.8922 => 4.9185, std.dev.: 0.0374) MultiSource/Benchmarks/Olden/em3d/em3d: 26.14% (0.1695 => 0.2138, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: 25.72% (0.0871 => 0.1095, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/18-imp/imp: 25.68% (0.3423 => 0.4302, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 25.58% (0.4620 => 0.5802, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 25.48% (0.0730 => 0.0916, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 25.40% (1.5415 => 1.9331, std.dev.: 0.0139) MultiSource/Applications/Burg/burg: 25.25% (1.1642 => 1.4582, std.dev.: 0.0309) MultiSource/Applications/oggenc/oggenc: 25.07% (5.7591 => 7.2028, std.dev.: 0.0744) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.00% (0.1032 => 0.1290, std.dev.: 0.0029) SingleSource/Benchmarks/Stanford/Oscar: 25.00% (0.0636 => 0.0795, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 24.91% (0.3180 => 0.3972, std.dev.: 0.0028) MultiSource/Benchmarks/NPB-serial/is/is: 24.76% (0.0719 => 0.0897, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 24.73% (1.3050 => 1.6277, std.dev.: 0.0043) MultiSource/Applications/aha/aha: 24.59% (0.1151 => 0.1434, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: 24.53% (0.3865 => 0.4813, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 24.43% (0.3422 => 0.4258, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.13% (0.0746 => 0.0926, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 24.04% (0.4048 => 0.5021, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.03% (0.0770 => 0.0955, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 23.89% (1.5859 => 1.9647, std.dev.: 0.0437) SingleSource/Benchmarks/Misc-C++/Large/ray: 23.57% (0.4064 => 0.5022, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/heapsort: 23.50% (0.2872 => 0.3547, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.34% (0.1337 => 0.1649, std.dev.: 0.0012) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.18% (0.1143 => 0.1408, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.08% (0.1044 => 0.1285, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 22.96% (0.3162 => 0.3888, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 22.88% (0.3650 => 0.4485, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/mst/mst: 22.61% (0.1163 => 0.1426, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/08-main/main: 22.44% (0.2554 => 0.3127, std.dev.: 0.0166) SingleSource/Benchmarks/Misc/whetstone: 22.27% (0.0660 => 0.0807, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 22.09% (3.8723 => 4.7278, std.dev.: 0.1295) SingleSource/Benchmarks/Shootout-C++/hello: 21.96% (0.2714 => 0.3310, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 21.72% (0.1114 => 0.1356, std.dev.: 0.0072) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.71% (0.1566 => 0.1906, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/random: 21.70% (0.2802 => 0.3410, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sieve: 21.48% (0.3603 => 0.4377, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.22% (0.5569 => 0.6751, std.dev.: 0.0193) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 21.06% (0.0793 => 0.0960, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/tsp/tsp: 20.85% (0.1175 => 0.1420, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/bh/bh: 20.83% (0.3092 => 0.3736, std.dev.: 0.0046) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.52% (0.1584 => 0.1909, std.dev.: 0.0113) MultiSource/Benchmarks/MallocBench/espresso/espresso: 20.49% (4.2646 => 5.1386, std.dev.: 0.1170) SingleSource/Benchmarks/Misc/fbench: 20.44% (0.0592 => 0.0713, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 20.20% (2.0273 => 2.4368, std.dev.: 0.0834) SingleSource/Benchmarks/Shootout-C++/nestedloop: 20.16% (0.2793 => 0.3356, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 19.83% (0.3131 => 0.3752, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.63% (0.1029 => 0.1231, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.58% (0.4203 => 0.5026, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 19.17% (0.0798 => 0.0951, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 19.00% (0.3826 => 0.4553, std.dev.: 0.0138) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.51% (1.1861 => 1.4057, std.dev.: 0.0393) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.49% (0.1125 => 0.1333, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.10% (1.4186 => 1.6753, std.dev.: 0.0334) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.98% (2.0665 => 2.4381, std.dev.: 0.0665) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.86% (0.3136 => 0.3696, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.39% (14.3668 => 16.8646, std.dev.: 0.4171) MultiSource/Benchmarks/sim/sim: 17.33% (0.3387 => 0.3974, std.dev.: 0.0134) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 17.30% (0.0838 => 0.0983, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.16% (0.2891 => 0.3387, std.dev.: 0.0084) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.12% (0.8172 => 0.9571, std.dev.: 0.0361) SingleSource/Benchmarks/Shootout/lists: 16.93% (0.0626 => 0.0732, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/messages-2: 16.92% (0.0662 => 0.0774, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 16.82% (1.1840 => 1.3831, std.dev.: 0.0478) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.74% (0.0675 => 0.0788, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/ffbench: 16.45% (0.0705 => 0.0821, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.17% (0.3427 => 0.3981, std.dev.: 0.0108) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 16.05% (0.1906 => 0.2212, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.95% (0.0834 => 0.0967, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.91% (0.0886 => 0.1027, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.90% (0.0648 => 0.0751, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/matrix: 15.89% (0.0818 => 0.0948, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.82% (0.1940 => 0.2247, std.dev.: 0.0114) MultiSource/Benchmarks/Olden/health/health: 15.69% (0.1268 => 0.1467, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/oourafft: 15.54% (0.3282 => 0.3792, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.45% (0.0770 => 0.0889, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.42% (0.0953 => 0.1100, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.41% (4.9449 => 5.7067, std.dev.: 0.2024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.16% (0.2758 => 0.3176, std.dev.: 0.0152) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.05% (0.8101 => 0.9320, std.dev.: 0.0276) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.95% (0.1117 => 0.1284, std.dev.: 0.0047) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.74% (0.3121 => 0.3581, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/strcat: 14.62% (0.2831 => 0.3245, std.dev.: 0.0105) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.57% (0.2107 => 0.2414, std.dev.: 0.0114) MultiSource/Applications/spiff/spiff: 14.35% (0.7835 => 0.8959, std.dev.: 0.0415) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.31% (0.5981 => 0.6837, std.dev.: 0.0214) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.16% (0.1236 => 0.1411, std.dev.: 0.0068) SingleSource/Benchmarks/McGill/exptree: 14.00% (0.0814 => 0.0928, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.97% (0.3307 => 0.3769, std.dev.: 0.0176) MultiSource/Benchmarks/mafft/pairlocalalign: 13.88% (9.4845 => 10.8014, std.dev.: 0.3678) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.88% (0.9765 => 1.1120, std.dev.: 0.0329) MultiSource/Applications/sqlite3/sqlite3: 13.83% (17.1811 => 19.5564, std.dev.: 0.3404) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.82% (0.3935 => 0.4479, std.dev.: 0.0101) MultiSource/Benchmarks/McCat/05-eks/eks: 13.65% (0.4299 => 0.4886, std.dev.: 0.0196) MultiSource/Applications/sgefa/sgefa: 13.64% (0.3109 => 0.3533, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.56% (0.5105 => 0.5797, std.dev.: 0.0213) SingleSource/Benchmarks/McGill/chomp: 13.47% (0.1655 => 0.1878, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.35% (0.6675 => 0.7566, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 13.33% (1.5603 => 1.7683, std.dev.: 0.0760) SingleSource/Benchmarks/Misc-C++/bigfib: 13.21% (0.6456 => 0.7309, std.dev.: 0.0294) MultiSource/Applications/d/make_dparser: 13.00% (3.3354 => 3.7691, std.dev.: 0.1235) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.86% (0.1625 => 0.1834, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/parameter-passing: 12.76% (0.3927 => 0.4428, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 12.47% (0.3497 => 0.3933, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/trivial-interface: 12.15% (0.3473 => 0.3895, std.dev.: 0.0156) SingleSource/UnitTests/ObjC/exceptions-4: 12.02% (0.3543 => 0.3969, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/exceptions: 12.02% (0.3828 => 0.4288, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 12.00% (0.3516 => 0.3938, std.dev.: 0.0081) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.94% (0.3543 => 0.3966, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 11.86% (0.3694 => 0.4132, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.40% (0.4879 => 0.5435, std.dev.: 0.0107) SingleSource/Benchmarks/Stanford/Puzzle: 10.80% (0.1268 => 0.1405, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists1: 10.78% (0.3684 => 0.4081, std.dev.: 0.0129) SingleSource/UnitTests/ObjC++/property-reference-object: 10.51% (0.6030 => 0.6664, std.dev.: 0.0198) SingleSource/UnitTests/SignlessTypes/rem: 10.40% (0.1144 => 0.1263, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 9.84% (0.3283 => 0.3606, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/ary2: 9.71% (0.3379 => 0.3707, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/except: 9.68% (0.2871 => 0.3149, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 9.65% (0.3232 => 0.3544, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/matrix: 9.39% (0.3098 => 0.3389, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/methcall: 9.21% (0.2877 => 0.3142, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 9.14% (0.2725 => 0.2974, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 7.92% (0.1440 => 0.1554, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: 7.08% (0.2049 => 0.2194, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: 5.45% (54.1659 => 57.1169, std.dev.: 0.0922) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.78% (4.3953 => 11.0227, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/methcall: 147.58% (5.3999 => 13.3691, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/09-vor/vor: 37.00% (0.1154 => 0.1581, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout/ary3: 28.06% (3.6994 => 4.7376, std.dev.: 0.1193) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 25.22% (13.4384 => 16.8277, std.dev.: 1.0235) SingleSource/Benchmarks/Shootout-C++/moments: 19.76% (0.1159 => 0.1388, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/oourafft: 17.44% (6.6465 => 7.8059, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.38% (1.1145 => 1.3082, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 15.84% (3.1578 => 3.6579, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.12% (0.0864 => 0.0986, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 13.49% (3.8532 => 4.3729, std.dev.: 0.1452) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.98% (0.2944 => 0.3326, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/ffbench: 12.45% (0.9505 => 1.0688, std.dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.59% (2.8904 => 3.2255, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 10.23% (1.1396 => 1.2562, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.48% (1.7254 => 1.8889, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 8.46% (1.4460 => 1.5683, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/bh/bh: 7.95% (1.9405 => 2.0947, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash: 6.72% (0.7455 => 0.7956, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/hash: 6.65% (4.9088 => 5.2350, std.dev.: 0.1078) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.09% (0.3070 => 0.3257, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.94% (0.9540 => 1.0107, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 5.81% (26.0924 => 27.6090, std.dev.: 0.0665) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.80% (4.2280 => 4.4733, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.41% (3.6395 => 3.8364, std.dev.: 0.0156) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.08% (11.6436 => 12.1186, std.dev.: 0.0158) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.36% (0.4162 => 0.4302, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: 2.81% (3.8526 => 3.9610, std.dev.: 0.0336) SingleSource/Benchmarks/Dhrystone/dry: 2.63% (2.4116 => 2.4750, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 2.06% (3.1595 => 3.2247, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.83% (2.1424 => 2.1816, std.dev.: 0.0126) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2779, std.dev.: 0.0481) MultiSource/Benchmarks/PAQ8p/paq8p: 1.54% (85.0658 => 86.3750, std.dev.: 0.2593) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.47% (2.3135 => 2.3474, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ackermann: 1.44% (1.7133 => 1.7379, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.41% (6.5088 => 6.6006, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0313 => 1.0441, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0499, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: 1.12% (1.9577 => 1.9797, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.37% (6.6874 => 0.1758, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.51% (5.2763 => 1.2921, std.dev.: 0.0154) SingleSource/Benchmarks/Misc/salsa20: -75.44% (0.8651 => 0.2125, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/richards_benchmark: -44.64% (0.1622 => 0.0898, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.29% (5.3855 => 4.7234, std.dev.: 0.0999) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.22% (5.3526 => 4.7523, std.dev.: 0.1395) MultiSource/Applications/JM/ldecod/ldecod: -10.92% (10.4361 => 9.2969, std.dev.: 0.4057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.52% (0.0628 => 0.0361, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.31% (0.3987 => 0.2380, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.30% (4.5009 => 2.7771, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.18% (2.6546 => 2.0128, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: -19.16% (0.2161 => 0.1747, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.69% (1.6925 => 1.4270, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2842, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.77% (32.5116 => 29.0102, std.dev.: 0.0237) SingleSource/Benchmarks/Misc/mandel-2: -10.65% (1.5373 => 1.3736, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -9.89% (9.5636 => 8.6173, std.dev.: 0.1947) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.05% (1.5660 => 1.4243, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.04% (3.2416 => 3.0459, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5758, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.17% (0.2497 => 0.2368, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -4.62% (1.5835 => 1.5104, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.60% (1.6805 => 1.6032, std.dev.: 0.0144) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.29% (19.9488 => 19.0921, std.dev.: 0.2690) SingleSource/Benchmarks/Shootout/lists: -4.25% (6.2999 => 6.0323, std.dev.: 0.0082) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8916, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.86% (0.9957 => 0.9672, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.29% (0.4808 => 0.4698, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.77% (8.1563 => 8.0116, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6770, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -1.49% (10.2830 => 10.1295, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.96% (0.1485 => 0.1352, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.91% (0.2116 => 0.0679, std.dev.: 0.0003) Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 13:32:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 15:32:51 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121126213251.5E37D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6279?compare_to=6276&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6279, Order: 168600, Start Time: 2012-11-26 19:56:16, End Time: 2012-11-26 21:33:23 To: 6276, Order: 168592, Start Time: 2012-11-26 18:02:22, End Time: 2012-11-26 19:36:32 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 19 (58 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1034 (900 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 66.52% (0.0463 => 0.0771, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 55.48% (0.1231 => 0.1914, std.dev.: 0.0105) MultiSource/Benchmarks/FreeBench/distray/distray: 31.20% (0.0955 => 0.1253, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 15.60% (0.2289 => 0.2646, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.13% (0.9061 => 0.9798, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.17% (0.2330 => 0.2497, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.32% (22.9110 => 24.3580, std.dev.: 0.2050) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 4.52% (0.9045 => 0.9454, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 4.22% (0.8535 => 0.8895, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.08% (0.5102 => 0.5310, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.75% (0.2829 => 0.2935, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.15% (0.7907 => 0.8156, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.30% (0.6388 => 0.6535, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.89% (0.6734 => 0.6861, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.43% (0.8648 => 0.8772, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: 14.11% (45.6396 => 52.0795, std.dev.: 1.0679) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.72% (24.6475 => 27.7819, std.dev.: 0.0467) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.50% (1.2368 => 1.2554, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/pi: 1.21% (2.4771 => 2.5071, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: -2.45% (4.4348 => 4.3263, std.dev.: 0.0410) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -3.49% (1.1073 => 1.0686, std.dev.: 0.2017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 6.54% (0.0214 => 0.0228, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.11% (0.0427 => 0.0436, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 18.02% (0.0283 => 0.0334, std.dev.: 0.0086) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.60% (0.0313 => 0.0318, std.dev.: 0.0081) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.13% (0.0423 => 0.0432, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/casts: 6.37% (0.0204 => 0.0217, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/test1: 1.38% (0.0217 => 0.0220, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.39% (0.1521 => 0.1527, std.dev.: 0.0278) MultiSource/Applications/lemon/lemon: -7.34% (1.2617 => 1.1691, std.dev.: 0.3465) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 8.90% (0.4100 => 0.4465, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.54% (0.1475 => 0.1542, std.dev.: 0.0249) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.19% (0.0640 => 0.0718, std.dev.: 0.0190) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.73% (0.0275 => 0.0277, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 55.58% (0.0556 => 0.0865, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.15% (1.1974 => 1.1992, std.dev.: 0.0149) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -44.44% (0.0027 => 0.0015, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.82% (0.0647 => 0.0577, std.dev.: 0.0137) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.08% (0.0260 => 0.0268, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.28% (0.7810 => 0.7910, std.dev.: 0.0155) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -52.27% (0.0088 => 0.0042, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 11.13% (16.4461 => 18.2766, std.dev.: 0.3179) MultiSource/Applications/sqlite3/sqlite3: 2362.24% (0.6332 => 15.5909, std.dev.: 0.6764) MultiSource/Benchmarks/McCat/08-main/main: 52.65% (0.1831 => 0.2795, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.13% (0.1559 => 0.1479, std.dev.: 0.0317) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7699.55% (0.3123 => 24.3580, std.dev.: 0.2050) SingleSource/Benchmarks/CoyoteBench/fftbench: 52.09% (0.2463 => 0.3746, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1552.27% (0.3344 => 5.5252, std.dev.: 0.2576) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.49% (0.2364 => 0.3274, std.dev.: 0.0425) SingleSource/Benchmarks/Misc-C++/bigfib: 5.52% (0.6010 => 0.6342, std.dev.: 0.0222) SingleSource/Benchmarks/Misc/mandel: 4.66% (0.0429 => 0.0449, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.02% (0.3266 => 0.3430, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/strcat: 3.66% (0.1969 => 0.2041, std.dev.: 0.0582) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.48% (0.0224 => 0.0243, std.dev.: 0.0035) SingleSource/UnitTests/byval-alignment: -25.65% (0.0230 => 0.0171, std.dev.: 0.0066) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0537, std.dev.: 0.0062) MultiSource/Applications/oggenc/oggenc: 12.24% (0.1462 => 0.1641, std.dev.: 0.0242) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4766, std.dev.: 0.0654) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0720, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4991, std.dev.: 0.0953) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5238, std.dev.: 0.0140) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5473, std.dev.: 0.5848) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3145, std.dev.: 0.0316) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1251, std.dev.: 0.0186) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3635, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4091, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0881, std.dev.: 0.0125) SingleSource/Regression/C/uint64_to_float: -24.00% (2.1832 => 1.6592, std.dev.: 0.0031) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 69.82% (0.0454 => 0.0771, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 65.43% (0.1157 => 0.1914, std.dev.: 0.0105) MultiSource/Benchmarks/FreeBench/distray/distray: 36.94% (0.0915 => 0.1253, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.98% (0.0810 => 0.0988, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.38% (0.2180 => 0.2646, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/tsp/tsp: 17.90% (0.1112 => 0.1311, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.33% (0.0848 => 0.0978, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.45% (0.2519 => 0.2883, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.03% (0.2249 => 0.2497, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.76% (0.1905 => 0.2110, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 10.28% (0.8885 => 0.9798, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.55% (0.4847 => 0.5310, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.14% (0.7473 => 0.8156, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.74% (0.6010 => 0.6535, std.dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.59% (0.3137 => 0.3375, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.37% (0.8805 => 0.9454, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.16% (0.9069 => 0.9718, std.dev.: 0.0189) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.46% (0.3295 => 0.3508, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.41% (0.8359 => 0.8895, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.80% (0.2774 => 0.2935, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: 5.73% (0.2985 => 0.3156, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 5.05% (0.8177 => 0.8590, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 5.00% (0.9074 => 0.9528, std.dev.: 0.0141) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.78% (0.2741 => 0.2872, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.55% (0.3717 => 0.3886, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.55% (0.5191 => 0.5427, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.35% (0.5817 => 0.6070, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.18% (0.8420 => 0.8772, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.18% (0.6586 => 0.6861, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.99% (0.8317 => 0.8649, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.28% (1.2423 => 1.2830, std.dev.: 0.0145) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 128.64% (0.0199 => 0.0455, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/pi: 58.73% (1.5795 => 2.5071, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.26% (0.7597 => 0.8908, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.25% (2.9753 => 3.4589, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.78% (2.7995 => 3.2133, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.69% (5.0261 => 5.6134, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.93% (1.1857 => 1.2797, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 7.55% (1.7056 => 1.8343, std.dev.: 0.0132) MultiSource/Applications/SIBsim4/SIBsim4: 6.93% (3.1873 => 3.4081, std.dev.: 0.0477) SingleSource/Benchmarks/Misc/richards_benchmark: 6.67% (1.3037 => 1.3907, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.56% (4.7794 => 5.0929, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.93% (4.9686 => 5.2630, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.80% (4.5327 => 4.7955, std.dev.: 0.0290) MultiSource/Applications/lambda-0_1_3/lambda: 4.92% (7.4933 => 7.8620, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.84% (3.3761 => 3.5395, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.65% (6.2275 => 6.5169, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.31% (4.9453 => 5.1585, std.dev.: 0.0669) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.29% (4.9469 => 5.1589, std.dev.: 0.0076) MultiSource/Applications/hexxagon/hexxagon: 4.22% (14.0064 => 14.5981, std.dev.: 0.0299) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.43% (0.3587 => 0.3710, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.52% (11.5690 => 11.8610, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.48% (8.2783 => 8.4840, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.41% (4.8660 => 4.9831, std.dev.: 0.0230) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.11% (1.1365 => 1.1605, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: 1.63% (7.3375 => 7.4574, std.dev.: 0.0383) MultiSource/Benchmarks/FreeBench/neural/neural: 1.44% (1.0841 => 1.0997, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.08% (3.5679 => 3.6064, std.dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.85% (5.4641 => 4.3251, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.44% (7.2130 => 6.3880, std.dev.: 0.0861) SingleSource/Benchmarks/McGill/chomp: -10.89% (1.1216 => 0.9995, std.dev.: 0.0242) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.38% (1.0512 => 0.9421, std.dev.: 0.0149) MultiSource/Benchmarks/mafft/pairlocalalign: -8.13% (63.1822 => 58.0486, std.dev.: 0.0280) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.88% (14.6451 => 13.6369, std.dev.: 0.1159) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.54% (4.7482 => 4.4375, std.dev.: 0.0516) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.69% (3.7148 => 3.5034, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.87% (5.1557 => 4.9046, std.dev.: 0.0345) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.33% (4.7449 => 4.5395, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.58% (6.0224 => 5.8067, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.56% (0.5807 => 0.5600, std.dev.: 0.0065) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.80% (28.5821 => 27.7819, std.dev.: 0.0467) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.00% (11.5316 => 11.3012, std.dev.: 0.0850) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.61% (4.9994 => 4.9189, std.dev.: 0.0094) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.3487 => 2.3208, std.dev.: 0.0077) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.13% (1.0262 => 1.0686, std.dev.: 0.2017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 85.37% (0.0123 => 0.0228, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 6.86% (0.0408 => 0.0436, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.50% (0.0254 => 0.0334, std.dev.: 0.0086) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.30% (0.0302 => 0.0318, std.dev.: 0.0081) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 12.50% (0.0384 => 0.0432, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/casts: 14.21% (0.0190 => 0.0217, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/test1: 22.22% (0.0180 => 0.0220, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 6.19% (0.1438 => 0.1527, std.dev.: 0.0278) MultiSource/Applications/lemon/lemon: 3.20% (1.1329 => 1.1691, std.dev.: 0.3465) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 7.23% (0.4164 => 0.4465, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 12.64% (0.1369 => 0.1542, std.dev.: 0.0249) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.01% (0.0641 => 0.0718, std.dev.: 0.0190) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 49.65% (0.0578 => 0.0865, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.85% (1.1437 => 1.1992, std.dev.: 0.0149) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 7.14% (0.0014 => 0.0015, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.97% (0.0627 => 0.0577, std.dev.: 0.0137) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.89% (0.0180 => 0.0268, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.33% (0.8017 => 0.7910, std.dev.: 0.0155) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -32.26% (0.0062 => 0.0042, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 13:54:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 15:54:24 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121126215424.3A5602A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6280?compare_to=6274&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6280, Order: 168592, Start Time: 2012-11-26 18:34:36, End Time: 2012-11-26 21:54:54 To: 6274, Order: 168586, Start Time: 2012-11-26 14:25:53, End Time: 2012-11-26 17:46:32 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (174 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1092 (716 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.64% (0.0625 => 0.0879, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.17% (0.1063 => 0.1405, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.37% (0.2969 => 0.3752, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.77% (0.1106 => 0.1391, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.51% (0.4253 => 0.5338, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.10% (0.4139 => 0.5178, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 24.82% (1.5932 => 1.9887, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.23% (0.0714 => 0.0887) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.21% (0.0475 => 0.0590, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.19% (0.4994 => 0.6202, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.78% (0.5000 => 0.6189, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.61% (0.5900 => 0.7293, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.58% (0.0547 => 0.0676, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.46% (0.0584 => 0.0721, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.78% (0.1620 => 0.1989, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.43% (0.1021 => 0.1250, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.31% (0.1107 => 0.1354, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 22.04% (0.0599 => 0.0731, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.96% (0.0897 => 0.1094, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.40% (0.0584 => 0.0709, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.17% (0.0633 => 0.0767, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 20.99% (0.0948 => 0.1147, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.94% (0.1103 => 0.1334, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 20.83% (0.0821 => 0.0992, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.72% (0.0642 => 0.0775, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.64% (0.1003 => 0.1210, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.56% (0.0822 => 0.0991, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.47% (0.3903 => 0.4702, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.40% (0.0495 => 0.0596, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.40% (0.1549 => 0.1865, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 20.07% (0.1619 => 0.1944, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.01% (0.1604 => 0.1925, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 19.54% (0.0947 => 0.1132, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.08% (0.1462 => 0.1741, std.dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: 18.94% (0.0808 => 0.0961, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.87% (0.2014 => 0.2394, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.79% (0.3890 => 0.4621, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 18.64% (0.1218 => 0.1445, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.55% (0.1968 => 0.2333, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.42% (0.2736 => 0.3240, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 18.40% (0.5826 => 0.6898, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 18.34% (0.0698 => 0.0826, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.32% (1.3152 => 1.5562, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: 18.19% (0.4029 => 0.4762, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 18.14% (0.5889 => 0.6957, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.11% (0.1088 => 0.1285, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 18.01% (0.1505 => 0.1776, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.00% (0.2866 => 0.3382, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 17.94% (0.5546 => 0.6541, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.83% (0.0572 => 0.0674, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.38% (3.5627 => 4.1820, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.24% (1.6211 => 1.9005, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 17.18% (1.8794 => 2.2023, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: 16.98% (0.9697 => 1.1344, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.98% (0.4658 => 0.5449, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.90% (0.2875 => 0.3361, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 16.86% (0.0605 => 0.0707, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.75% (0.3271 => 0.3819, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.72% (0.1160 => 0.1354, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.71% (2.7292 => 3.1853, std.dev.: 0.0090) MultiSource/Applications/d/make_dparser: 16.57% (1.0781 => 1.2567, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.55% (4.4195 => 5.1508, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/18-imp/imp: 16.47% (0.1421 => 0.1655, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.43% (0.5026 => 0.5852, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.29% (0.2738 => 0.3184, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.28% (0.4361 => 0.5071, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 16.22% (0.2725 => 0.3167, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 16.20% (0.1284 => 0.1492, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.19% (0.2792 => 0.3244, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 16.18% (0.2750 => 0.3195, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/hello: 16.18% (0.2714 => 0.3153, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.16% (0.2729 => 0.3170, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 16.15% (0.2823 => 0.3279, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.15% (0.3195 => 0.3711, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.15% (0.2911 => 0.3381, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 16.14% (0.2813 => 0.3267, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 16.13% (0.9909 => 1.1507, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.11% (0.3930 => 0.4563, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 16.09% (0.3096 => 0.3594, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 16.08% (0.3004 => 0.3487, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 16.04% (0.2780 => 0.3226, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 16.01% (0.7171 => 0.8319, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/random: 15.91% (0.2803 => 0.3249, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 15.87% (0.2811 => 0.3257, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 15.84% (4.2109 => 4.8780, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.76% (1.9694 => 2.2798, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.73% (2.0673 => 2.3924, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 15.49% (0.3267 => 0.3773, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.49% (1.9966 => 2.3058, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.48% (0.3488 => 0.4028, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-4: 15.44% (0.3465 => 0.4000, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 15.41% (0.3446 => 0.3977, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 15.40% (0.3460 => 0.3993, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/synchronized: 15.39% (0.3469 => 0.4003, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 15.38% (0.3317 => 0.3827, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/for-in: 15.36% (0.3496 => 0.4033, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 15.34% (0.3442 => 0.3970, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 15.33% (23.5202 => 27.1261, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/ary: 15.32% (0.3258 => 0.3757, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.14% (0.3124 => 0.3597, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.14% (0.1090 => 0.1255, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 15.07% (0.3650 => 0.4200, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 15.04% (0.2075 => 0.2387, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.00% (0.3060 => 0.3519, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 14.99% (0.3643 => 0.4189, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 14.78% (0.3348 => 0.3843, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.70% (0.3625 => 0.4158, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.69% (0.3362 => 0.3856, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 14.68% (0.3678 => 0.4218, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 14.65% (0.2566 => 0.2942, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/parameter-passing: 14.58% (0.3724 => 0.4267, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.56% (0.3282 => 0.3760, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/sieve: 14.41% (0.3726 => 0.4263, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 14.39% (1.4269 => 1.6322, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: 14.29% (0.3477 => 0.3974, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.09% (0.3981 => 0.4542, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 14.09% (0.4146 => 0.4730, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 13.90% (0.4251 => 0.4842, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 13.89% (0.7875 => 0.8969, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.71% (0.3690 => 0.4196, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.71% (0.3845 => 0.4372, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 13.64% (2.1653 => 2.4607, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 13.33% (0.5012 => 0.5680) MultiSource/Benchmarks/sim/sim: 13.32% (0.0758 => 0.0859, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 13.31% (2.1013 => 2.3809, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 13.23% (4.6177 => 5.2287, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.84% (0.2040 => 0.2302, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 12.75% (0.2691 => 0.3034, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 12.41% (5.5417 => 6.2292, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.17% (0.6435 => 0.7218, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.48% (0.1028 => 0.1146, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.28% (0.1383 => 0.1539, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 11.21% (0.3498 => 0.3890, std.dev.: 0.0022) MultiSource/Applications/siod/siod: 11.20% (0.6634 => 0.7377, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.07% (0.2737 => 0.3040, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.03% (0.2068 => 0.2296, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.67% (0.3084 => 0.3413, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 10.46% (0.4847 => 0.5354, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 10.31% (0.3336 => 0.3680, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 10.19% (2.0346 => 2.2419, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.89% (0.2103 => 0.2311, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 9.79% (0.2391 => 0.2625, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.86% (4.6926 => 5.1082, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.82% (0.5361 => 0.5834, std.dev.: 0.0133) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.60% (11.6398 => 12.6412, std.dev.: 0.0196) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.35% (0.5584 => 0.6050, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.95% (0.7426 => 0.8016, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 6.96% (11.9555 => 12.7874, std.dev.: 0.0120) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.99% (0.3792 => 0.4019, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 9.42% (0.2802 => 0.3066, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.60% (0.2122 => 0.2262, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6102, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6681, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-2: 4.83% (1.8057 => 1.8929, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1708, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6367, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1946, std.dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.69% (2.0820 => 2.1172, std.dev.: 0.0113) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2239, std.dev.: 0.0042) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3002, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2864, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6032, std.dev.: 0.0504) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.67% (2.4764 => 2.4102, std.dev.: 0.0121) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5549, std.dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/ary2: -7.91% (0.2402 => 0.2212, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9784, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7967, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.52% (11.2080 => 10.8132, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0053) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5191, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -2.27% (17.2379 => 16.8464, std.dev.: 0.0295) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8644, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5717, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4955, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1525, std.dev.: 0.0804) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0428, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 14:15:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 16:15:43 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121126221543.10E692A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6281?compare_to=6277&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6281, Order: 168603, Start Time: 2012-11-26 20:42:43, End Time: 2012-11-26 22:16:13 To: 6277, Order: 168597, Start Time: 2012-11-26 18:46:02, End Time: 2012-11-26 20:19:34 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (180 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (857 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.86% (0.3834 => 0.4442, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1010, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/salsa20: 2.55% (7.4937 => 7.6849, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/hash2: 2.23% (3.1932 => 3.2643, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.15% (0.1431 => 0.1300, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.48% (0.3821 => 0.3497, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -7.34% (2.4924 => 2.3094, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.13% (0.3142 => 0.2918, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.84% (0.9542 => 0.8889, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -6.67% (0.3357 => 0.3133, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: -6.48% (0.2160 => 0.2020, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.38% (0.2428 => 0.2273, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.29% (0.1796 => 0.1683, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.26% (0.6484 => 0.6078, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.24% (0.2355 => 0.2208, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.20% (0.3884 => 0.3643, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: -6.20% (16.1920 => 15.1883, std.dev.: 0.0198) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.19% (0.9852 => 0.9242, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.19% (0.3812 => 0.3576, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.19% (0.3880 => 0.3640, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.19% (0.3848 => 0.3610, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.18% (9.2283 => 8.6578, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/synchronized: -6.13% (0.3896 => 0.3657, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-2: -6.13% (0.3831 => 0.3596, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.10% (0.7198 => 0.6759, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: -6.07% (0.4033 => 0.3788, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.04% (0.3891 => 0.3656, std.dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: -6.02% (7.0961 => 6.6688, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ReedSolomon: -6.01% (0.1879 => 0.1766, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: -5.94% (0.4176 => 0.3928, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.92% (1.3722 => 1.2909, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.90% (0.5591 => 0.5261, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.88% (1.0544 => 0.9924, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.87% (4.8161 => 4.5332, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: -5.86% (0.9179 => 0.8641, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.81% (0.5478 => 0.5160, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.80% (4.0323 => 3.7983, std.dev.: 0.0081) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: -5.78% (1.1530 => 1.0864, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.77% (0.3658 => 0.3447, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.76% (0.5863 => 0.5525, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.75% (0.5857 => 0.5520, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.75% (0.2695 => 0.2540, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.75% (0.5705 => 0.5377, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.74% (1.6364 => 1.5425, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.71% (0.6230 => 0.5874, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.71% (4.8802 => 4.6014, std.dev.: 0.0106) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.67% (6.7716 => 6.3875, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.67% (0.5859 => 0.5527, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.66% (0.5581 => 0.5265, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.65% (0.6260 => 0.5906, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.62% (3.5339 => 3.3352, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.62% (0.6297 => 0.5943, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.62% (0.6052 => 0.5712, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.61% (1.2300 => 1.1610, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.61% (0.6667 => 0.6293, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.61% (0.5941 => 0.5608, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.60% (0.5925 => 0.5593, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.59% (0.6194 => 0.5848, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.58% (0.6446 => 0.6086, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.58% (0.5570 => 0.5259, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.58% (0.5805 => 0.5481, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.57% (4.5069 => 4.2557, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.56% (0.5575 => 0.5265, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.55% (1.4642 => 1.3829, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.55% (0.6304 => 0.5954, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.55% (0.4199 => 0.3966, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -5.55% (1.1450 => 1.0815, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.52% (1.2784 => 1.2078, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: -5.52% (17.1032 => 16.1591, std.dev.: 0.0162) MultiSource/Benchmarks/sim/sim: -5.52% (0.3406 => 0.3218, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.52% (0.5456 => 0.5155, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.51% (0.6681 => 0.6313, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.50% (0.5802 => 0.5483, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.49% (0.5849 => 0.5528, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.48% (0.6736 => 0.6367, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.45% (0.6660 => 0.6297) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.43% (0.6189 => 0.5853, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.42% (14.2083 => 13.4383, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.40% (0.6033 => 0.5707, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.40% (0.8521 => 0.8061, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: -5.38% (0.4515 => 0.4272, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.36% (0.6676 => 0.6318, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.36% (0.6293 => 0.5956, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: -5.35% (1.3864 => 1.3122, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.33% (8.0126 => 7.5859, std.dev.: 0.0119) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.31% (1.2210 => 1.1562, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/parameter-passing: -5.28% (0.4280 => 0.4054, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.28% (1.2221 => 1.1576, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.27% (0.7919 => 0.7502, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.26% (0.6440 => 0.6101, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -5.26% (0.2985 => 0.2828, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -5.26% (4.3330 => 4.1052, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.23% (0.5999 => 0.5685, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.22% (0.2278 => 0.2159, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.17% (0.4916 => 0.4662, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.16% (0.2385 => 0.2262, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: -5.14% (1.2515 => 1.1872, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: -5.12% (15.5079 => 14.7132, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.12% (0.5688 => 0.5397, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -5.11% (0.3581 => 0.3398, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.10% (0.2999 => 0.2846, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: -5.08% (3.5154 => 3.3368, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.05% (0.3483 => 0.3307, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.03% (0.3319 => 0.3152, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.02% (0.2548 => 0.2420, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.00% (0.2659 => 0.2526, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -4.99% (0.3446 => 0.3274, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: -4.97% (0.7447 => 0.7077, std.dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: -4.96% (1.3148 => 1.2496, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -4.95% (0.2871 => 0.2729, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.94% (0.3016 => 0.2867, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.94% (0.3323 => 0.3159, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -4.92% (0.2989 => 0.2842, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -4.90% (4.0594 => 3.8605, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/ary: -4.89% (0.3394 => 0.3228, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: -4.88% (0.3255 => 0.3096, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.88% (0.7524 => 0.7157, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.88% (0.2933 => 0.2790, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.85% (0.7339 => 0.6983, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.84% (0.4151 => 0.3950, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: -4.84% (0.3205 => 0.3050, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: -4.83% (0.4861 => 0.4626, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.83% (0.6395 => 0.6086, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -4.83% (0.2939 => 0.2797, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.82% (0.2903 => 0.2763, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: -4.81% (0.2849 => 0.2712, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.81% (0.3057 => 0.2910, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.81% (0.3849 => 0.3664, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.80% (2.1713 => 2.0671, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -4.80% (15.2527 => 14.5211, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.80% (0.3837 => 0.3653, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.78% (0.3931 => 0.3743, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.76% (0.5168 => 0.4922, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: -4.76% (0.3026 => 0.2882) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.74% (0.7021 => 0.6688, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -4.73% (0.3194 => 0.3043, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.70% (1.6474 => 1.5699, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.68% (0.6395 => 0.6096, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.64% (0.3252 => 0.3101, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -4.63% (0.3481 => 0.3320, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -4.61% (0.4248 => 0.4052, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.58% (0.5567 => 0.5312, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.58% (0.5329 => 0.5085, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -4.56% (0.3025 => 0.2887, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.54% (22.4056 => 21.3895, std.dev.: 0.0059) MultiSource/Applications/treecc/treecc: -4.53% (2.1401 => 2.0432, std.dev.: 0.0051) SingleSource/Regression/C++/ofstream_ctor: -4.51% (0.3059 => 0.2921, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.51% (0.5569 => 0.5318, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.44% (0.9077 => 0.8674, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.43% (0.4083 => 0.3902, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: -4.42% (0.3621 => 0.3461, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.40% (0.4321 => 0.4131, std.dev.: 0.0056) MultiSource/Applications/oggenc/oggenc: -4.37% (5.0226 => 4.8033, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/lists1: -4.34% (0.3867 => 0.3699, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.33% (0.9557 => 0.9143, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: -4.32% (0.8418 => 0.8054, std.dev.: 0.0058) MultiSource/Applications/siod/siod: -4.31% (2.4021 => 2.2986, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: -4.27% (0.6347 => 0.6076, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.26% (0.4813 => 0.4608, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -4.25% (0.3271 => 0.3132, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: -4.25% (0.7982 => 0.7643, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: -4.22% (0.6441 => 0.6169, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.18% (0.4427 => 0.4242, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.16% (2.2587 => 2.1648, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -4.07% (34.0927 => 32.7043, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/bigfib: -4.06% (0.6750 => 0.6476, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -4.02% (0.7779 => 0.7466, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.92% (0.3491 => 0.3354, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: -3.91% (0.3788 => 0.3640, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -3.72% (18.2933 => 17.6119, std.dev.: 0.0160) MultiSource/Applications/hbd/hbd: -3.70% (1.5610 => 1.5033, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: -3.67% (0.4524 => 0.4358, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.10% (5.4682 => 5.2987, std.dev.: 0.0064) SingleSource/UnitTests/Vector/constpool: -2.38% (20.7746 => 20.2807, std.dev.: 0.0495) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7538, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: -8.78% (1.2842 => 1.1715, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7061, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.71% (2.2633 => 2.1793, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.04% (1.0557 => 1.0236, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.79% (1.3096 => 1.2731, std.dev.: 0.0091) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.64% (6.5735 => 6.4656, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 15:27:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 17:27:28 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121126232728.CC0A42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6282?compare_to=6279&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6282, Order: 168608, Start Time: 2012-11-26 21:50:36, End Time: 2012-11-26 23:28:00 To: 6279, Order: 168600, Start Time: 2012-11-26 19:56:16, End Time: 2012-11-26 21:33:23 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (30 on baseline) Performance Regressions: 11 (45 on baseline) Performance Improvements: 2 (13 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1041 (916 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel04: 58.59% (0.1077 => 0.1708, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 44.15% (0.1479 => 0.2132, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 40.88% (0.2468 => 0.3477, std.dev.: 0.0268) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.47% (6.9108 => 7.7033, std.dev.: 0.3071) MultiSource/Applications/lemon/lemon: 4.35% (1.1132 => 1.1616, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.52% (0.8725 => 0.9032, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 27.83% (0.1617 => 0.2067, std.dev.: 0.0135) MultiSource/Applications/SPASS/SPASS: 23.57% (8.2879 => 10.2413, std.dev.: 0.0678) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 19.01% (2.4850 => 2.9575, std.dev.: 0.0783) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.22% (3.9986 => 4.2072, std.dev.: 0.0742) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.98% (4.3263 => 4.4551, std.dev.: 0.0498) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -4.48% (3.9565 => 3.7791, std.dev.: 0.0607) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.32% (6.3880 => 6.3038, std.dev.: 0.0165) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.45% (1.0686 => 1.0734, std.dev.: 0.2310) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -41.67% (0.0228 => 0.0133, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.61% (0.0436 => 0.0429, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0334 => 0.0335, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.57% (0.0318 => 0.0313, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0432 => 0.0432, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: -5.53% (0.0217 => 0.0205, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: -0.91% (0.0220 => 0.0218, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.23% (0.1527 => 0.1561, std.dev.: 0.0238) MultiSource/Applications/lemon/lemon: 4.12% (1.1691 => 1.2173, std.dev.: 0.3660) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.61% (0.4465 => 0.4393, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.23% (0.1542 => 0.1523, std.dev.: 0.0252) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.67% (0.0718 => 0.0706, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.61% (0.0277 => 0.0287, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -27.51% (0.0865 => 0.0627, std.dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.03% (1.1992 => 1.1996, std.dev.: 0.0120) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.23% (0.0031 => 0.0032, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 80.00% (0.0015 => 0.0027, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.96% (0.0577 => 0.0646, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0268 => 0.0268, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.29% (0.7910 => 0.7887, std.dev.: 0.1191) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 123.81% (0.0042 => 0.0094, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 9.47% (16.4461 => 18.0039, std.dev.: 0.9485) MultiSource/Applications/sqlite3/sqlite3: 2411.47% (0.6332 => 15.9026, std.dev.: 0.3921) MultiSource/Benchmarks/McCat/08-main/main: 54.34% (0.1831 => 0.2826, std.dev.: 0.0491) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 36.75% (0.1559 => 0.2132, std.dev.: 0.0094) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7059.27% (0.3123 => 22.3584, std.dev.: 1.6330) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.97% (0.2463 => 0.3743, std.dev.: 0.1098) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1583.25% (0.3344 => 5.6288, std.dev.: 0.2044) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.28% (0.2364 => 0.3269, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/bigfib: 5.09% (0.6010 => 0.6316, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/mandel: 3.50% (0.0429 => 0.0444, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.55% (0.3266 => 0.3480, std.dev.: 0.0759) SingleSource/Benchmarks/Shootout-C++/strcat: 4.42% (0.1969 => 0.2056, std.dev.: 0.0589) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.23% (0.0224 => 0.0229, std.dev.: 0.0010) SingleSource/UnitTests/byval-alignment: -31.30% (0.0230 => 0.0158, std.dev.: 0.0008) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0519, std.dev.: 0.0064) MultiSource/Applications/oggenc/oggenc: 13.34% (0.1462 => 0.1657, std.dev.: 0.0246) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.5089, std.dev.: 0.5336) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0719, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4895, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5117, std.dev.: 0.0422) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.7624, std.dev.: 0.3476) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3301, std.dev.: 0.0351) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1507, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3636, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4042, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0839, std.dev.: 0.0046) SingleSource/Regression/C/uint64_to_float: -23.85% (2.1832 => 1.6624, std.dev.: 0.0154) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 52.57% (0.2279 => 0.3477, std.dev.: 0.0268) MultiSource/Benchmarks/BitBench/five11/five11: 41.21% (0.0529 => 0.0747, std.dev.: 0.0080) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.59% (6.6074 => 7.7033, std.dev.: 0.3071) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.03% (0.0848 => 0.0967, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.89% (2.1401 => 2.3304, std.dev.: 0.0453) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.32% (0.8338 => 0.9032, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/football/football: 7.71% (0.8768 => 0.9444, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.34% (0.4127 => 0.4430, std.dev.: 0.0095) MultiSource/Applications/lemon/lemon: 6.13% (1.0945 => 1.1616, std.dev.: 0.0124) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 118.59% (0.0199 => 0.0435, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/mst/mst: 65.95% (0.1386 => 0.2300, std.dev.: 0.0250) SingleSource/Benchmarks/Misc/pi: 58.15% (1.5795 => 2.4980, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 32.93% (0.1555 => 0.2067, std.dev.: 0.0135) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 21.54% (2.4333 => 2.9575, std.dev.: 0.0783) MultiSource/Applications/SPASS/SPASS: 21.45% (8.4326 => 10.2413, std.dev.: 0.0678) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 18.36% (0.7597 => 0.8992, std.dev.: 0.0245) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.37% (2.9753 => 3.4624, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.75% (2.7995 => 3.2124, std.dev.: 0.0426) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.75% (5.0261 => 5.6168, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 8.54% (0.1370 => 0.1487, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 8.34% (3.1873 => 3.4530, std.dev.: 0.0431) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.89% (1.1857 => 1.2793, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/queens: 7.59% (1.7056 => 1.8350, std.dev.: 0.0246) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.54% (6.3772 => 6.8580, std.dev.: 0.0783) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.79% (4.7794 => 5.1040, std.dev.: 0.0812) SingleSource/Benchmarks/Misc/richards_benchmark: 6.67% (1.3037 => 1.3906, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.08% (4.5327 => 4.8082, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.88% (4.9686 => 5.2608, std.dev.: 0.0345) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.40% (3.9917 => 4.2072, std.dev.: 0.0742) MultiSource/Benchmarks/Olden/treeadd/treeadd: 5.32% (0.3587 => 0.3778, std.dev.: 0.0070) MultiSource/Applications/lambda-0_1_3/lambda: 4.73% (7.4933 => 7.8478, std.dev.: 0.1124) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.69% (6.2275 => 6.5195, std.dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 4.05% (14.0064 => 14.5733, std.dev.: 0.1293) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.02% (4.9469 => 5.1456, std.dev.: 0.0363) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.95% (4.9453 => 5.1405, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.52% (4.8362 => 5.0066, std.dev.: 0.0430) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.63% (11.5690 => 11.8728, std.dev.: 0.0419) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.37% (8.2783 => 8.4747, std.dev.: 0.0253) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 2.03% (1.4205 => 1.4493, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/whetstone: 1.61% (2.1224 => 2.1566, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.54% (3.5679 => 3.6227, std.dev.: 0.0208) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.51% (4.0473 => 4.1084, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.40% (4.4340 => 4.4961, std.dev.: 0.0164) MultiSource/Benchmarks/FreeBench/neural/neural: 1.38% (1.0841 => 1.0991, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: 1.06% (1.2061 => 1.2189, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.25% (5.4641 => 4.3578, std.dev.: 0.0250) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.61% (7.2130 => 6.3038, std.dev.: 0.0165) MultiSource/Benchmarks/mafft/pairlocalalign: -8.48% (63.1822 => 57.8247, std.dev.: 0.1289) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.51% (4.7482 => 4.4391, std.dev.: 0.0159) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.49% (14.6451 => 13.6946, std.dev.: 0.0877) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.77% (3.7148 => 3.5006, std.dev.: 0.0218) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.75% (5.4972 => 5.1811, std.dev.: 0.0338) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.00% (5.1557 => 4.8977, std.dev.: 0.0263) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.41% (4.7449 => 4.5357, std.dev.: 0.0153) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.44% (0.5807 => 0.5607, std.dev.: 0.0076) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.90% (28.5821 => 27.7535, std.dev.: 0.1222) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.98% (11.5316 => 11.3035, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.16% (5.6343 => 5.5691, std.dev.: 0.0111) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.60% (1.0262 => 1.0734, std.dev.: 0.2310) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 8.13% (0.0123 => 0.0133, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.15% (0.0408 => 0.0429, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.89% (0.0254 => 0.0335, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 12.50% (0.0384 => 0.0432, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 8.55% (0.1438 => 0.1561, std.dev.: 0.0238) MultiSource/Applications/lemon/lemon: 7.45% (1.1329 => 1.2173, std.dev.: 0.3660) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.50% (0.4164 => 0.4393, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.25% (0.1369 => 0.1523, std.dev.: 0.0252) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.14% (0.0641 => 0.0706, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 47.18% (0.0195 => 0.0287, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.48% (0.0578 => 0.0627, std.dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.89% (1.1437 => 1.1996, std.dev.: 0.0120) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3100.00% (0.0001 => 0.0032, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.03% (0.0627 => 0.0646, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.89% (0.0180 => 0.0268, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.62% (0.8017 => 0.7887, std.dev.: 0.1191) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 51.61% (0.0062 => 0.0094, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 15:43:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 17:43:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121126234320.0A0562A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6283?compare_to=6278&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6283, Order: 168603, Start Time: 2012-11-26 21:24:05, End Time: 2012-11-26 23:43:50 To: 6278, Order: 168592, Start Time: 2012-11-26 18:14:40, End Time: 2012-11-26 20:33:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 12 (105 on baseline) Performance Improvements: 2 (40 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1072 (740 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hexxagon/hexxagon: 11.60% (1.3939 => 1.5556, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.26% (0.6619 => 0.7232, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.17% (0.6414 => 0.7002, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.07% (0.6871 => 0.7494, std.dev.: 0.0228) MultiSource/Applications/hbd/hbd: 7.69% (1.7683 => 1.9042, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.42% (0.9015 => 0.9684, std.dev.: 0.0243) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.24% (0.6837 => 0.7195, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.07% (4.7523 => 4.9931, std.dev.: 0.0423) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 14.18% (0.1213 => 0.1385, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 4.78% (1.5295 => 1.6026, std.dev.: 0.0192) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 4.78% (3.1354 => 3.2852, std.dev.: 0.0269) MultiSource/Applications/sqlite3/sqlite3: 2.55% (4.5876 => 4.7044, std.dev.: 0.0179) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.76% (0.1290 => 0.1177, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.17% (3.6484 => 3.6057, std.dev.: 0.0136) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.02% (69.8344 => 69.8464, std.dev.: 0.1058) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -1.04% (0.1352 => 0.1338, std.dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.48% (0.0420 => 0.0422, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.98% (0.0679 => 0.0652, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -0.06% (494.0968 => 493.8154, std.dev.: 0.2742) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 10.44% (63.2438 => 69.8464, std.dev.: 0.1058) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0422, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43689.61% (1.1277 => 493.8154, std.dev.: 0.2742) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 197.78% (0.5229 => 1.5571, std.dev.: 0.0825) MultiSource/Applications/SPASS/SPASS: 21.67% (14.9895 => 18.2372, std.dev.: 0.2334) MultiSource/Applications/kimwitu++/kc: 46.84% (14.1553 => 20.7862, std.dev.: 0.6035) MultiSource/Benchmarks/MallocBench/gs/gs: 23.26% (4.1105 => 5.0667, std.dev.: 0.1501) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.02% (1.1048 => 1.5138, std.dev.: 0.0602) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 430.86% (7.1582 => 37.9999, std.dev.: 0.4692) SingleSource/Benchmarks/Misc-C++-EH/spirit: 75.97% (3.4629 => 6.0936, std.dev.: 0.4184) SingleSource/Benchmarks/Misc-C++/stepanov_container: 68.02% (0.6222 => 1.0454, std.dev.: 0.0434) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10550.28% (0.0720 => 7.6682, std.dev.: 0.2391) MultiSource/Applications/SIBsim4/SIBsim4: 3860600.00% (0.0001 => 3.8607, std.dev.: 0.0425) MultiSource/Applications/SPASS/SPASS: 12821600.00% (0.0001 => 12.8217, std.dev.: 1.3153) MultiSource/Applications/kimwitu++/kc: 51700.00% (0.0001 => 0.0518, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 64000.00% (0.0001 => 0.0641, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 581200.00% (0.0001 => 0.5813, std.dev.: 0.0168) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10070000.00% (0.0001 => 10.0701, std.dev.: 0.0147) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5669400.00% (0.0001 => 5.6695, std.dev.: 0.9123) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1721.88% (1.1194 => 20.3941, std.dev.: 0.6615) MultiSource/Applications/ClamAV/clamscan: 67.56% (22.1758 => 37.1576, std.dev.: 0.5640) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 61.82% (2.9384 => 4.7549, std.dev.: 0.2592) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.84% (7.0540 => 10.9933, std.dev.: 0.2862) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.21% (8.1363 => 12.1402, std.dev.: 0.1740) MultiSource/Applications/JM/lencod/lencod: 46.76% (21.9371 => 32.1943, std.dev.: 0.0590) MultiSource/Benchmarks/FreeBench/distray/distray: 45.45% (0.1056 => 0.1536, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops: 39.59% (0.1432 => 0.1999, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/almabench: 38.63% (0.0730 => 0.1012, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/08-main/main: 31.99% (0.2554 => 0.3371, std.dev.: 0.0109) SingleSource/Benchmarks/BenchmarkGame/n-body: 30.03% (0.0746 => 0.0970, std.dev.: 0.0021) SingleSource/UnitTests/vla: 29.86% (0.0355 => 0.0461, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/five11/five11: 27.51% (0.0567 => 0.0723, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 26.47% (0.1175 => 0.1486, std.dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.80% (0.1125 => 0.1404, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/dot-syntax-1: 23.59% (0.0479 => 0.0592, std.dev.: 0.0025) SingleSource/Benchmarks/Stanford/Oscar: 23.58% (0.0636 => 0.0786, std.dev.: 0.0044) MultiSource/Applications/Burg/burg: 23.05% (1.1642 => 1.4326, std.dev.: 0.0269) MultiSource/Benchmarks/Olden/mst/mst: 22.36% (0.1163 => 0.1423, std.dev.: 0.0040) MultiSource/Applications/hbd/hbd: 22.04% (1.5603 => 1.9042, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 22.01% (0.0886 => 0.1081, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.65% (0.1566 => 0.1905, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 21.58% (0.0834 => 0.1014, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 21.13% (1.2842 => 1.5556, std.dev.: 0.0143) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 21.09% (0.1584 => 0.1918, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.07% (0.2758 => 0.3339, std.dev.: 0.0112) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 20.77% (0.0491 => 0.0593, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.74% (0.2107 => 0.2544, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.55% (0.0793 => 0.0956, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.43% (0.5860 => 0.7057, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 20.30% (0.5981 => 0.7195, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 20.04% (0.8067 => 0.9684, std.dev.: 0.0243) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.59% (0.1062 => 0.1270, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 19.20% (0.4620 => 0.5507, std.dev.: 0.0147) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.51% (14.3668 => 17.0265, std.dev.: 0.4454) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 18.36% (0.2603 => 0.3081, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 18.23% (2.2024 => 2.6039, std.dev.: 0.1212) SingleSource/Benchmarks/Shootout/lists: 18.05% (0.0626 => 0.0739, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/fbench: 17.91% (0.0592 => 0.0698, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 17.28% (0.1892 => 0.2219, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.25% (0.5020 => 0.5886, std.dev.: 0.0178) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.84% (0.4615 => 0.5392, std.dev.: 0.0219) MultiSource/Benchmarks/FreeBench/neural/neural: 16.81% (0.1463 => 0.1709, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.79% (0.8172 => 0.9544, std.dev.: 0.0345) MultiSource/Benchmarks/Olden/em3d/em3d: 16.76% (0.1695 => 0.1979, std.dev.: 0.0097) MultiSource/Applications/lua/lua: 16.47% (3.8723 => 4.5101, std.dev.: 0.2253) SingleSource/Benchmarks/Shootout/matrix: 16.26% (0.0818 => 0.0951, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 16.13% (0.2430 => 0.2822, std.dev.: 0.0087) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.90% (0.0648 => 0.0751, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.88% (0.2065 => 0.2393, std.dev.: 0.0081) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.74% (0.0953 => 0.1103, std.dev.: 0.0050) MultiSource/Applications/viterbi/viterbi: 15.63% (0.1555 => 0.1798, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.40% (0.1117 => 0.1289, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 15.27% (9.4845 => 10.9330, std.dev.: 0.3743) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.06% (0.0770 => 0.0886, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/health/health: 15.06% (0.1268 => 0.1459, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.02% (5.0018 => 5.7533, std.dev.: 0.1530) MultiSource/Applications/sqlite3/sqlite3: 14.99% (17.1811 => 19.7566, std.dev.: 0.6963) MultiSource/Applications/minisat/minisat: 14.98% (0.7115 => 0.8181, std.dev.: 0.0359) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.38% (0.1029 => 0.1177, std.dev.: 0.0044) MultiSource/Applications/spiff/spiff: 14.27% (0.7835 => 0.8953, std.dev.: 0.0398) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.05% (0.1032 => 0.1177, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.02% (0.5569 => 0.6350, std.dev.: 0.0284) MultiSource/Applications/oggenc/oggenc: 14.00% (5.7591 => 6.5654, std.dev.: 0.3052) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.61% (0.2271 => 0.2580, std.dev.: 0.0090) MultiSource/Benchmarks/McCat/05-eks/eks: 13.47% (0.4299 => 0.4878, std.dev.: 0.0220) SingleSource/UnitTests/ObjC/property: 13.10% (0.3886 => 0.4395, std.dev.: 0.0190) SingleSource/UnitTests/ObjC/exceptions-4: 12.59% (0.3543 => 0.3989, std.dev.: 0.0108) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.48% (0.3543 => 0.3985, std.dev.: 0.0148) SingleSource/UnitTests/ObjC/trivial-interface: 12.44% (0.3473 => 0.3905, std.dev.: 0.0152) SingleSource/UnitTests/ObjC/exceptions-3: 12.40% (0.3516 => 0.3952, std.dev.: 0.0144) SingleSource/UnitTests/ObjC/exceptions-2: 12.38% (0.3497 => 0.3930, std.dev.: 0.0152) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.29% (0.8101 => 0.9097, std.dev.: 0.0358) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.33% (0.1906 => 0.2122, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/power/power: 7.78% (0.1440 => 0.1552, std.dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: 7.42% (10.3673 => 11.1363, std.dev.: 0.2611) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.17% (4.3953 => 10.9957, std.dev.: 0.0188) SingleSource/Benchmarks/Shootout-C++/methcall: 147.41% (5.3999 => 13.3598, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/oourafft: 17.46% (6.6465 => 7.8071, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.62% (1.1145 => 1.2997, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.08% (0.2944 => 0.3329, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.60% (2.8904 => 3.2258, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 11.32% (3.1578 => 3.5152, std.dev.: 0.0658) SingleSource/Benchmarks/Misc/richards_benchmark: 10.18% (1.1396 => 1.2556, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.24% (1.7254 => 1.8849, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.95% (0.9540 => 1.0108, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.70% (4.2280 => 4.4690, std.dev.: 0.0114) SingleSource/Regression/C/uint64_to_float: 5.10% (0.5413 => 0.5689, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 4.84% (3.1334 => 3.2852, std.dev.: 0.0269) MultiSource/Applications/lua/lua: 4.74% (26.0924 => 27.3300, std.dev.: 0.1478) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.6436 => 12.1220, std.dev.: 0.0167) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: 2.62% (2.4116 => 2.4747, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 2.06% (3.1595 => 3.2246, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.87% (2.1424 => 2.1825, std.dev.: 0.0098) MultiSource/Benchmarks/PAQ8p/paq8p: 1.82% (85.0658 => 86.6140, std.dev.: 0.1543) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.53% (6.5088 => 6.6082, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 1.35% (27.8444 => 28.2201, std.dev.: 0.0659) MultiSource/Applications/sqlite3/sqlite3: 1.30% (4.6441 => 4.7044, std.dev.: 0.0179) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.29% (1.0313 => 1.0446, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.26% (5.2139 => 5.2797, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0505, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1677, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.71% (5.2763 => 1.2291, std.dev.: 0.0457) SingleSource/Benchmarks/Misc/salsa20: -75.49% (0.8651 => 0.2120, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/richards_benchmark: -44.82% (0.1622 => 0.0895, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.03% (5.3855 => 4.7377, std.dev.: 0.1561) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -11.88% (0.1330 => 0.1172, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.72% (5.3526 => 4.9931, std.dev.: 0.0423) MultiSource/Applications/JM/ldecod/ldecod: -6.68% (10.4361 => 9.7386, std.dev.: 0.2173) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.16% (0.3987 => 0.2386, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.30% (4.5009 => 2.7772, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.16% (2.6546 => 2.0132, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: -19.53% (0.2161 => 0.1739, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -15.56% (1.6925 => 1.4291, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2841, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.73% (32.5116 => 29.0222, std.dev.: 0.0272) SingleSource/Benchmarks/Misc/mandel-2: -10.67% (1.5373 => 1.3733, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -10.41% (9.5636 => 8.5683, std.dev.: 0.1915) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4244, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.07% (1.6805 => 1.5448, std.dev.: 0.0519) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.94% (4.8142 => 4.4799, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.2416 => 3.0213, std.dev.: 0.0281) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5759, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -5.17% (1.5835 => 1.5016, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.81% (0.2497 => 0.2377, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -4.23% (6.2999 => 6.0333, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.80% (19.9488 => 19.1900, std.dev.: 0.0209) MultiSource/Benchmarks/sim/sim: -3.06% (5.0483 => 4.8937, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.82% (0.9957 => 0.9676, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.35% (0.4808 => 0.4695, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.81% (8.1563 => 8.0085, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6774, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -1.49% (10.2830 => 10.1298, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0014) Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 16:11:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 18:11:18 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121127001118.5B5362A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6284?compare_to=6281&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6284, Order: 168619, Start Time: 2012-11-26 22:39:27, End Time: 2012-11-27 00:11:48 To: 6281, Order: 168603, Start Time: 2012-11-26 20:42:43, End Time: 2012-11-26 22:16:13 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 3 (180 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1088 (856 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.49% (78.2734 => 81.0076, std.dev.: 0.3095) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.48% (31.3542 => 10.1964, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -10.96% (0.3623 => 0.3226, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.21% (0.3834 => 0.4417, std.dev.: 0.0097) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.73% (2.0478 => 2.1037, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/salsa20: 2.43% (7.4937 => 7.6761, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/hash2: 1.96% (3.1932 => 3.2558, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.62% (79.7170 => 81.0076, std.dev.: 0.3095) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.80% (0.3821 => 0.3523, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -7.03% (2.4924 => 2.3172, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.65% (0.3142 => 0.2933, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.63% (0.3831 => 0.3577, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.58% (0.3812 => 0.3561, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.57% (0.3880 => 0.3625, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.55% (0.9542 => 0.8917, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: -6.49% (0.3896 => 0.3643, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.42% (0.4033 => 0.3774, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -6.42% (0.3848 => 0.3601, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.37% (0.3891 => 0.3643, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.20% (0.3357 => 0.3149, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: -6.18% (0.4176 => 0.3918, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -6.16% (0.2160 => 0.2027, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.10% (0.2428 => 0.2280, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -6.02% (9.2283 => 8.6732, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.99% (0.2355 => 0.2214, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.97% (0.3884 => 0.3652, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.90% (0.7198 => 0.6773, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -5.88% (16.1920 => 15.2393, std.dev.: 0.0112) SingleSource/UnitTests/ObjC/property: -5.86% (0.4199 => 0.3953, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.82% (0.9852 => 0.9279, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.74% (0.6484 => 0.6112, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -5.70% (7.0961 => 6.6919, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.67% (4.8161 => 4.5431, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -5.67% (0.9179 => 0.8659, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.62% (0.5857 => 0.5528, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.60% (0.5591 => 0.5278, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.60% (1.3722 => 1.2954, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.59% (4.0323 => 3.8068, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.55% (1.0544 => 0.9959, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -5.51% (0.4280 => 0.4044, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.50% (4.8802 => 4.6120, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.49% (0.6667 => 0.6301, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.48% (6.7716 => 6.4002, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.48% (1.6364 => 1.5468, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.47% (0.6304 => 0.5959, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.45% (0.2695 => 0.2548, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.44% (0.6194 => 0.5857, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.43% (0.5705 => 0.5395, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.42% (0.5478 => 0.5181, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.42% (0.5925 => 0.5604, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: -5.41% (1.1530 => 1.0906, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.40% (0.6052 => 0.5725, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.40% (1.2300 => 1.1636, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.39% (0.5802 => 0.5489, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.38% (0.5581 => 0.5281, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.36% (0.5859 => 0.5545, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.36% (0.3658 => 0.3462, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.36% (0.5863 => 0.5549, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.34% (4.5069 => 4.2661, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.34% (0.6446 => 0.6102, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.33% (0.6230 => 0.5898, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.32% (14.2083 => 13.4524, std.dev.: 0.0242) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.32% (0.6260 => 0.5927, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.32% (0.5849 => 0.5538, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.31% (0.5570 => 0.5274, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.31% (0.6681 => 0.6326, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.30% (0.6189 => 0.5861, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: -5.29% (1.3864 => 1.3130, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.29% (0.5805 => 0.5498, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.28% (3.5339 => 3.3472, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.27% (0.6660 => 0.6309, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.26% (0.5575 => 0.5282, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.22% (1.4642 => 1.3878, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.22% (1.2784 => 1.2117, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.20% (0.6033 => 0.5719, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: -5.19% (1.1450 => 1.0856, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: -5.18% (0.4515 => 0.4281, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -5.17% (0.3406 => 0.3230, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.17% (8.0126 => 7.5987, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.15% (0.6676 => 0.6332, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.15% (0.5688 => 0.5395, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.15% (0.5456 => 0.5175, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.14% (0.6440 => 0.6109, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (0.5941 => 0.5636, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -5.11% (17.1032 => 16.2292, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.11% (0.8521 => 0.8086, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.10% (0.6293 => 0.5972, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.08% (0.6297 => 0.5977, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -5.08% (4.3330 => 4.1131, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.06% (0.6736 => 0.6395, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.05% (1.2210 => 1.1593, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.99% (0.2385 => 0.2266, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.97% (0.5999 => 0.5701, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.92% (0.2278 => 0.2166, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.91% (0.7919 => 0.7530, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.90% (1.2221 => 1.1622, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -4.82% (3.5154 => 3.3458, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: -4.82% (15.5079 => 14.7609, std.dev.: 0.0153) MultiSource/Applications/ClamAV/clamscan: -4.79% (15.2527 => 14.5224, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.78% (0.3057 => 0.2911, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.77% (0.2999 => 0.2856, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -4.73% (0.2939 => 0.2800, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.69% (0.6395 => 0.6095, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.68% (0.3483 => 0.3320, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: -4.67% (0.3446 => 0.3285, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.67% (0.2933 => 0.2796, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.67% (0.2548 => 0.2429, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: -4.67% (0.2871 => 0.2737, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.65% (0.4151 => 0.3958, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.63% (0.7339 => 0.6999, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -4.63% (0.2659 => 0.2536, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -4.62% (0.3205 => 0.3057, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.62% (0.2903 => 0.2769, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -4.61% (1.2515 => 1.1938, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.61% (0.3016 => 0.2877, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -4.61% (0.7447 => 0.7104, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.60% (0.3323 => 0.3170, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -4.60% (0.2849 => 0.2718, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -4.58% (0.3255 => 0.3106, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.57% (0.7524 => 0.7180, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.55% (0.3931 => 0.3752, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.54% (2.1713 => 2.0727, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: -4.54% (0.3394 => 0.3240, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -4.52% (0.4248 => 0.4056, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: -4.52% (1.3148 => 1.2554, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: -4.52% (0.2989 => 0.2854, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -4.50% (0.3025 => 0.2889, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.47% (0.7021 => 0.6707, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.47% (0.4813 => 0.4598, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.46% (0.3837 => 0.3666, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -4.45% (0.3481 => 0.3326, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.45% (0.5168 => 0.4938, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -4.43% (0.3026 => 0.2892, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.42% (0.3849 => 0.3679, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -4.41% (0.3194 => 0.3053, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.39% (0.5329 => 0.5095, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.38% (0.6395 => 0.6115, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -4.35% (4.0594 => 3.8827, std.dev.: 0.0058) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.34% (22.4056 => 21.4334, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.33% (0.5569 => 0.5328, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.32% (0.9557 => 0.9144, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: -4.32% (0.4861 => 0.4651, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.30% (1.6474 => 1.5766, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -4.27% (0.3867 => 0.3702, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -4.25% (0.3621 => 0.3467, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.23% (0.9077 => 0.8693, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -4.22% (0.6347 => 0.6079, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.19% (0.4321 => 0.4140, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -4.18% (0.3059 => 0.2931, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.15% (0.3252 => 0.3117, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.13% (0.3319 => 0.3182, std.dev.: 0.0041) MultiSource/Applications/treecc/treecc: -4.12% (2.1401 => 2.0520, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.11% (0.4083 => 0.3915, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.11% (0.5567 => 0.5338, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.11% (0.4916 => 0.4714, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: -4.09% (0.2985 => 0.2863, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: -4.08% (0.3581 => 0.3435, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: -4.04% (0.6441 => 0.6181, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -3.96% (34.0927 => 32.7411, std.dev.: 0.0325) MultiSource/Applications/siod/siod: -3.95% (2.4021 => 2.3071, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/09-vor/vor: -3.94% (0.3271 => 0.3142, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: -3.85% (5.0226 => 4.8290, std.dev.: 0.0084) SingleSource/UnitTests/ObjC++/property-reference: -3.81% (0.7779 => 0.7483, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: -3.78% (0.6750 => 0.6495, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.77% (0.4427 => 0.4260, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -3.75% (0.3788 => 0.3646, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -3.74% (0.8418 => 0.8103, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.72% (0.3491 => 0.3361, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -3.67% (0.7982 => 0.7689, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: -3.63% (0.4524 => 0.4360, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.54% (2.2587 => 2.1787, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: -3.46% (18.2933 => 17.6611, std.dev.: 0.0240) MultiSource/Applications/hbd/hbd: -3.33% (1.5610 => 1.5090, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.87% (5.4682 => 5.3115, std.dev.: 0.0113) SingleSource/UnitTests/Vector/constpool: -2.47% (20.7746 => 20.2623, std.dev.: 0.0340) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1964, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7509, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -8.77% (1.2842 => 1.1716, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7067, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: -3.76% (2.2633 => 2.1781, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.33% (1.3096 => 1.2660, std.dev.: 0.0130) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.01% (1.0557 => 1.0239, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4681, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 17:25:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 19:25:05 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121127012505.8C8F32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6285?compare_to=6282&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6285, Order: 168630, Start Time: 2012-11-26 23:48:38, End Time: 2012-11-27 01:25:37 To: 6282, Order: 168608, Start Time: 2012-11-26 21:50:36, End Time: 2012-11-26 23:28:00 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 1 (1 on baseline) New Passes: 0 (30 on baseline) Performance Regressions: 16 (64 on baseline) Performance Improvements: 7 (18 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 38 (38 on baseline) Unchanged Tests: 1030 (891 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/SciMark2-C/scimark2: -65.94% (27.7535 => 9.4521, std.dev.: 0.1658) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 70.60% (0.0415 => 0.0708, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-3: 65.36% (0.0280 => 0.0463, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/hash: 63.70% (0.0540 => 0.0884, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/objinst: 46.84% (0.0427 => 0.0627, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/richards_benchmark: 46.03% (0.0756 => 0.1104, std.dev.: 0.0081) SingleSource/UnitTests/Vector/constpool: 21.10% (8.6349 => 10.4565, std.dev.: 0.1617) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.73% (0.1785 => 0.1923, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.57% (0.8647 => 0.9302, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/sieve: 5.08% (0.2832 => 0.2976, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 54.94% (3.0317 => 4.6974, std.dev.: 0.1418) SingleSource/Benchmarks/Shootout-C++/heapsort: 29.12% (3.0621 => 3.9538, std.dev.: 0.3124) SingleSource/Benchmarks/Linpack/linpack-pc: 18.02% (45.1768 => 53.3181, std.dev.: 0.3341) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.70% (3.7791 => 4.2590, std.dev.: 0.0826) SingleSource/Benchmarks/Shootout/hash: 9.61% (4.2829 => 4.6944, std.dev.: 0.0860) SingleSource/Benchmarks/Shootout-C++/lists: 3.39% (16.7684 => 17.3373, std.dev.: 0.1136) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.12% (1.2567 => 1.2708, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel04: -35.83% (0.1708 => 0.1096, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -8.61% (0.9347 => 0.8542, std.dev.: 0.0184) MultiSource/Benchmarks/MallocBench/gs/gs: -4.75% (4.6166 => 4.3971, std.dev.: 0.0624) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: -39.35% (0.2300 => 0.1395, std.dev.: 0.0296) SingleSource/Benchmarks/LivermoreLoops/kernel09: -22.48% (0.1063 => 0.0824, std.dev.: 0.0087) SingleSource/Benchmarks/LivermoreLoops/kernel04: -18.05% (0.1202 => 0.0985, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.35% (2.8907 => 2.7650, std.dev.: 0.0220) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.57% (1.0734 => 1.1010, std.dev.: 0.1263) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 72.18% (0.0133 => 0.0229, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.63% (0.0429 => 0.0436, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.60% (0.0335 => 0.0337, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.88% (0.0313 => 0.0322, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.93% (0.0432 => 0.0436, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: 2.44% (0.0205 => 0.0210, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 2.75% (0.0218 => 0.0224, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -4.93% (0.1561 => 0.1484, std.dev.: 0.0067) MultiSource/Applications/lemon/lemon: 3.12% (1.2173 => 1.2553, std.dev.: 0.2545) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.01% (0.4393 => 0.4569, std.dev.: 0.1827) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -10.11% (0.1523 => 0.1369, std.dev.: 0.0410) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.67% (0.0706 => 0.0666, std.dev.: 0.0270) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.23% (0.0287 => 0.0272, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.61% (0.0627 => 0.0573, std.dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.16% (1.1996 => 1.2135, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.13% (0.0032 => 0.0031, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.15% (0.0646 => 0.0645, std.dev.: 0.0135) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.72% (0.0268 => 0.0250, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.03% (0.7887 => 0.7727, std.dev.: 0.0244) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -34.04% (0.0094 => 0.0062, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/SciMark2-C/scimark2: -66.93% (28.5821 => 9.4521, std.dev.: 0.1658) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 14.95% (16.4461 => 18.9047, std.dev.: 0.4842) MultiSource/Applications/sqlite3/sqlite3: 2347.00% (0.6332 => 15.4944, std.dev.: 0.4126) MultiSource/Benchmarks/McCat/08-main/main: 52.70% (0.1831 => 0.2796, std.dev.: 0.0691) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.93% (0.1559 => 0.1451, std.dev.: 0.0516) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7135.61% (0.3123 => 22.5968, std.dev.: 0.8540) SingleSource/Benchmarks/CoyoteBench/fftbench: 53.27% (0.2463 => 0.3775, std.dev.: 0.0908) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1618.54% (0.3344 => 5.7468, std.dev.: 0.5070) SingleSource/Benchmarks/Misc-C++/Large/ray: 40.65% (0.2364 => 0.3325, std.dev.: 0.0407) SingleSource/Benchmarks/Misc-C++/bigfib: 10.50% (0.6010 => 0.6641, std.dev.: 0.1311) SingleSource/Benchmarks/Misc/mandel: 6.06% (0.0429 => 0.0455, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.49% (0.3266 => 0.3478, std.dev.: 0.0488) SingleSource/Benchmarks/Shootout-C++/strcat: 13.66% (0.1969 => 0.2238, std.dev.: 0.0400) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 9.38% (0.0224 => 0.0245, std.dev.: 0.0076) SingleSource/UnitTests/byval-alignment: -24.35% (0.0230 => 0.0174, std.dev.: 0.0062) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0549, std.dev.: 0.0075) MultiSource/Applications/oggenc/oggenc: 16.42% (0.1462 => 0.1702, std.dev.: 0.0351) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4849, std.dev.: 0.0387) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0730, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4951, std.dev.: 0.1035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5137, std.dev.: 0.0141) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.8493, std.dev.: 0.1842) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3609, std.dev.: 0.0986) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1541, std.dev.: 0.0412) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3856, std.dev.: 0.0256) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4309, std.dev.: 0.0598) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0010, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0857, std.dev.: 0.0085) SingleSource/Regression/C/uint64_to_float: -24.09% (2.1832 => 1.6573, std.dev.: 0.0727) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/flops-3: 79.46% (0.0258 => 0.0463, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/heapsort: 78.34% (0.0397 => 0.0708, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/hash: 75.40% (0.0504 => 0.0884, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/objinst: 62.44% (0.0386 => 0.0627, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/richards_benchmark: 52.91% (0.0722 => 0.1104, std.dev.: 0.0081) SingleSource/UnitTests/Vector/constpool: 24.22% (8.4179 => 10.4565, std.dev.: 0.1617) MultiSource/Benchmarks/Olden/tsp/tsp: 15.29% (0.1112 => 0.1282, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.33% (0.0848 => 0.0961, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.86% (0.8316 => 0.9302, std.dev.: 0.0143) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.91% (0.2180 => 0.2396, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.51% (0.1756 => 0.1923, std.dev.: 0.0039) MultiSource/Applications/oggenc/oggenc: 8.14% (4.9628 => 5.3667, std.dev.: 0.1052) SingleSource/Benchmarks/Shootout-C++/sieve: 8.02% (0.2755 => 0.2976, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.49% (0.8340 => 0.8965, std.dev.: 0.0235) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.37% (0.2240 => 0.2405, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.30% (0.1905 => 0.2044, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/gs/gs: 6.45% (4.1305 => 4.3971, std.dev.: 0.0624) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.45% (0.4127 => 0.4393, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.99% (0.2519 => 0.2670, std.dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 5.30% (0.2999 => 0.3158, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.93% (0.5191 => 0.5447, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.89% (1.1170 => 1.1716, std.dev.: 0.0180) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.52% (4.4880 => 4.6907, std.dev.: 0.0555) MultiSource/Benchmarks/sim/sim: 4.12% (0.3226 => 0.3359, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.96% (0.8331 => 0.8578, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.78% (0.8204 => 0.8432, std.dev.: 0.0079) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 132.16% (0.0199 => 0.0462, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/pi: 57.21% (1.5795 => 2.4831, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout/heapsort: 42.67% (3.2926 => 4.6974, std.dev.: 0.1418) SingleSource/Benchmarks/Shootout-C++/heapsort: 29.57% (3.0515 => 3.9538, std.dev.: 0.3124) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.74% (0.7597 => 0.8869, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.20% (2.9753 => 3.4572, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout/strcat: 15.80% (0.1538 => 0.1781, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.73% (2.7995 => 3.2118, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.27% (2.2485 => 2.5244, std.dev.: 0.0516) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.61% (5.0261 => 5.6097, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/hash: 8.95% (4.3087 => 4.6944, std.dev.: 0.0860) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.81% (6.3772 => 6.9391, std.dev.: 0.1903) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.68% (3.9188 => 4.2590, std.dev.: 0.0826) MultiSource/Applications/SIBsim4/SIBsim4: 8.32% (3.1873 => 3.4525, std.dev.: 0.0524) SingleSource/Benchmarks/Misc/richards_benchmark: 7.76% (1.3037 => 1.4049, std.dev.: 0.0255) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.63% (1.1857 => 1.2762, std.dev.: 0.0099) SingleSource/Benchmarks/McGill/queens: 7.36% (1.7056 => 1.8311, std.dev.: 0.0310) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.40% (4.7794 => 5.0855, std.dev.: 0.0775) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.87% (4.9686 => 5.2603, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.70% (3.3761 => 3.5348, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.64% (6.2275 => 6.5166, std.dev.: 0.0359) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.34% (22.2997 => 23.2685, std.dev.: 0.3253) MultiSource/Applications/siod/siod: 4.32% (3.6643 => 3.8227, std.dev.: 0.0450) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.22% (4.9453 => 5.1540, std.dev.: 0.0522) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.04% (4.9469 => 5.1468, std.dev.: 0.0232) MultiSource/Applications/hexxagon/hexxagon: 3.99% (14.0064 => 14.5655, std.dev.: 0.0182) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.47% (4.8362 => 5.0041, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.29% (0.5889 => 0.6083, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/lists: 3.23% (16.7941 => 17.3373, std.dev.: 0.1136) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.74% (11.5690 => 11.8864, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout/lists: 2.74% (7.3375 => 7.5386, std.dev.: 0.0354) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.36% (4.8660 => 4.9807, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.30% (4.4340 => 4.5359, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.02% (8.2783 => 8.4458, std.dev.: 0.0410) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.88% (1.2474 => 1.2708, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.68% (2.4647 => 2.5061, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.24% (1.5941 => 1.6138, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.22% (3.5679 => 3.6116, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -21.19% (5.4641 => 4.3060, std.dev.: 0.0533) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.91% (7.2130 => 6.2820, std.dev.: 0.1245) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.65% (1.0512 => 0.9392, std.dev.: 0.0115) SingleSource/Benchmarks/McGill/chomp: -8.85% (1.1216 => 1.0223, std.dev.: 0.0365) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.69% (14.6451 => 13.3723, std.dev.: 0.2381) MultiSource/Benchmarks/mafft/pairlocalalign: -8.16% (63.1822 => 58.0241, std.dev.: 0.7093) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.86% (4.7482 => 4.4225, std.dev.: 0.0340) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.96% (3.7148 => 3.4933, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.08% (5.1557 => 4.8939, std.dev.: 0.0441) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.41% (4.7449 => 4.5355, std.dev.: 0.0436) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.90% (2.8773 => 2.7650, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.77% (6.0224 => 5.7955, std.dev.: 0.0355) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.85% (2.6356 => 2.5605, std.dev.: 0.0162) MultiSource/Applications/aha/aha: -2.34% (3.3398 => 3.2618, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.99% (9.9065 => 9.7096, std.dev.: 0.0697) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.93% (11.5316 => 11.3096, std.dev.: 0.0636) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.72% (4.9994 => 4.9132, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.14% (5.6343 => 5.5701, std.dev.: 0.0239) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 7.29% (1.0262 => 1.1010, std.dev.: 0.1263) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 86.18% (0.0123 => 0.0229, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 6.86% (0.0408 => 0.0436, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 32.68% (0.0254 => 0.0337, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 6.62% (0.0302 => 0.0322, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 13.54% (0.0384 => 0.0436, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: 10.53% (0.0190 => 0.0210, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 24.44% (0.0180 => 0.0224, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 100.00% (0.0007 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 3.20% (0.1438 => 0.1484, std.dev.: 0.0067) MultiSource/Applications/lemon/lemon: 10.80% (1.1329 => 1.2553, std.dev.: 0.2545) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 9.73% (0.4164 => 0.4569, std.dev.: 0.1827) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: - (0.1369 => 0.1369, std.dev.: 0.0410) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.90% (0.0641 => 0.0666, std.dev.: 0.0270) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 39.49% (0.0195 => 0.0272, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.87% (0.0578 => 0.0573, std.dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.10% (1.1437 => 1.2135, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.87% (0.0627 => 0.0645, std.dev.: 0.0135) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 38.89% (0.0180 => 0.0250, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.62% (0.8017 => 0.7727, std.dev.: 0.0244) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0062 => 0.0062, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 18:03:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 20:03:38 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121127020338.A5C792A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6286?compare_to=6280&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6286, Order: 168615, Start Time: 2012-11-26 22:43:27, End Time: 2012-11-27 02:04:09 To: 6280, Order: 168592, Start Time: 2012-11-26 18:34:36, End Time: 2012-11-26 21:54:54 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (170 on baseline) Performance Improvements: 4 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1085 (720 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 27.06% (58.9712 => 74.9304, std.dev.: 0.0222) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.04% (29.0334 => 33.3997, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.16% (54.2258 => 54.8534, std.dev.: 0.0705) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.25% (3.1853 => 3.1455, std.dev.: 0.0064) MultiSource/Applications/oggenc/oggenc: -1.17% (1.9887 => 1.9655, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: -1.12% (1.1344 => 1.1217, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.84% (2.1172 => 2.0782, std.dev.: 0.0134) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.00% (0.0625 => 0.0875, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.33% (0.1063 => 0.1396, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.03% (0.1106 => 0.1405, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.97% (0.2969 => 0.3740, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.65% (0.0714 => 0.0890, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.26% (0.4139 => 0.5143, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.10% (0.4253 => 0.5278, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 23.37% (1.5932 => 1.9655, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.19% (0.5900 => 0.7268, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.85% (0.4994 => 0.6135, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.77% (0.0584 => 0.0717, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.67% (0.0547 => 0.0671, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.38% (0.5000 => 0.6119, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.79% (0.1620 => 0.1973, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.74% (0.1021 => 0.1243, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 21.37% (0.0599 => 0.0727, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.29% (0.0897 => 0.1088, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.14% (0.1107 => 0.1341, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0584 => 0.0704, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 20.25% (0.0948 => 0.1140, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.22% (0.0633 => 0.0761, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.13% (0.1103 => 0.1325, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.04% (0.3903 => 0.4685, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.78% (0.0642 => 0.0769, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.75% (0.1549 => 0.1855, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 19.73% (0.0821 => 0.0983, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.54% (0.1003 => 0.1199, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.46% (0.0822 => 0.0982, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.45% (0.1604 => 0.1916, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 19.27% (0.1619 => 0.1931, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 19.21% (0.0604 => 0.0720, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 18.69% (0.0947 => 0.1124, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.60% (0.1462 => 0.1734, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.33% (0.3890 => 0.4603, std.dev.: 0.0024) MultiSource/Applications/sgefa/sgefa: 18.07% (0.0808 => 0.0954, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.02% (0.2014 => 0.2377, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 17.57% (0.1218 => 0.1432, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.54% (0.2736 => 0.3216, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 17.40% (0.4029 => 0.4730, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.33% (1.3152 => 1.5431, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.28% (0.1088 => 0.1276, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/mst/mst: 17.19% (0.0698 => 0.0818, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 17.08% (0.1505 => 0.1762, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 16.91% (0.5826 => 0.6811, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.78% (0.2866 => 0.3347, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 16.77% (0.5546 => 0.6476, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.69% (3.5627 => 4.1574, std.dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference-object: 16.66% (0.5889 => 0.6870, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.60% (0.4658 => 0.5431, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 16.37% (1.8794 => 2.1871, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.36% (0.1968 => 0.2290, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.19% (1.6211 => 1.8835, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.03% (0.1160 => 0.1346, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.02% (0.3271 => 0.3795, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.92% (0.5026 => 0.5826, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.90% (0.2875 => 0.3332, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 15.70% (1.0781 => 1.2474, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 15.69% (0.1421 => 0.1644, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 15.67% (0.9697 => 1.1217, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.59% (0.4361 => 0.5041, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.40% (4.4195 => 5.1001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 15.40% (0.2780 => 0.3208, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.32% (0.3930 => 0.4532, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: 15.27% (0.2750 => 0.3170, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/bh/bh: 15.26% (0.1284 => 0.1480, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.25% (2.7292 => 3.1455, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.19% (0.2738 => 0.3154, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 15.16% (0.2725 => 0.3138, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 15.14% (0.2714 => 0.3125, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 15.13% (4.2109 => 4.8478, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 15.12% (0.9909 => 1.1407, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.10% (0.2729 => 0.3141, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 15.05% (0.2823 => 0.3248, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 15.05% (0.3004 => 0.3456, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.01% (0.2911 => 0.3348, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.97% (0.2792 => 0.3210, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 14.97% (0.2813 => 0.3234, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 14.91% (0.2811 => 0.3230, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 14.88% (0.2803 => 0.3220, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 14.85% (23.5202 => 27.0140, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.82% (0.3488 => 0.4005, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 14.80% (0.7171 => 0.8232, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.76% (1.9694 => 2.2600, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.75% (2.0673 => 2.3723, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.71% (0.3195 => 0.3665, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 14.66% (0.3096 => 0.3550, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.54% (1.9966 => 2.2870, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary3: 14.48% (0.3267 => 0.3740, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 14.36% (0.3258 => 0.3726, std.dev.: 0.0109) SingleSource/UnitTests/ObjC/exceptions-2: 14.34% (0.3446 => 0.3940, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.31% (0.1090 => 0.1246, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 14.27% (0.3496 => 0.3995, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.26% (0.3465 => 0.3959, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.25% (0.3460 => 0.3953, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 14.23% (0.3317 => 0.3789, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.21% (0.3469 => 0.3962, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.12% (0.3060 => 0.3492, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/trivial-interface: 14.09% (0.3442 => 0.3927, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 14.03% (0.2566 => 0.2926, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 14.02% (0.2075 => 0.2366, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.99% (0.3124 => 0.3561, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.83% (0.3362 => 0.3827, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 13.81% (0.3650 => 0.4154, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.78% (0.3643 => 0.4145, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.74% (0.3282 => 0.3733, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 13.65% (0.3348 => 0.3805, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 13.64% (0.3724 => 0.4232, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 13.62% (0.3678 => 0.4179, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 13.57% (1.4269 => 1.6205, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.43% (0.3625 => 0.4112, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 13.34% (0.3726 => 0.4223, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 13.30% (0.2691 => 0.3049, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.29% (0.3845 => 0.4356, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 13.26% (0.3477 => 0.3938, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 13.22% (0.7875 => 0.8916, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 13.02% (0.4146 => 0.4686, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.96% (0.3981 => 0.4497, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 12.93% (2.1013 => 2.3730, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash2: 12.91% (0.4251 => 0.4800, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.87% (0.3690 => 0.4165, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 12.66% (2.1653 => 2.4394, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 12.43% (4.6177 => 5.1919, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/bigfib: 12.29% (0.5012 => 0.5628, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.81% (0.2040 => 0.2281, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 11.31% (5.5417 => 6.1685, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.05% (0.6435 => 0.7146, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 11.03% (0.3498 => 0.3884, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.41% (0.1383 => 0.1527, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.31% (0.1028 => 0.1134, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.19% (0.2737 => 0.3016, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.15% (0.2068 => 0.2278, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 9.96% (0.4847 => 0.5330, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 9.77% (0.6634 => 0.7282, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.66% (0.3084 => 0.3382, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 9.50% (0.3336 => 0.3653, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 9.26% (2.0346 => 2.2230, std.dev.: 0.0185) MultiSource/Applications/lemon/lemon: 9.12% (0.2391 => 0.2609, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.84% (0.2103 => 0.2289, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.21% (4.6926 => 5.0777, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.02% (0.5361 => 0.5791, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.87% (11.6398 => 12.5554, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.56% (0.5584 => 0.6006, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.22% (0.7426 => 0.7962, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 6.22% (11.9555 => 12.6993, std.dev.: 0.0235) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.77% (0.3792 => 0.3973, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.97% (29.0505 => 33.3997, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 9.24% (0.2802 => 0.3061, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 7.30% (0.2122 => 0.2277, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6091, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6739, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1655, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6442, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-2: 4.23% (1.8057 => 1.8821, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2089, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2226, std.dev.: 0.0072) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3013, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2852, std.dev.: 0.0040) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5128, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5838, std.dev.: 0.0171) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.78% (2.4764 => 2.4076, std.dev.: 0.0182) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5626, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/ary2: -9.62% (0.2402 => 0.2171, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9770, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7961, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.50% (11.2080 => 10.8154, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0060) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7723, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.43% (17.2379 => 16.8184, std.dev.: 0.0620) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8624, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5788, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4955, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.27% (105.3826 => 104.0453, std.dev.: 0.1452) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0437, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 18:06:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 20:06:38 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121127020638.818712A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6287?compare_to=6284&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6287, Order: 168636, Start Time: 2012-11-27 00:34:51, End Time: 2012-11-27 02:07:08 To: 6284, Order: 168619, Start Time: 2012-11-26 22:39:27, End Time: 2012-11-27 00:11:48 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 2 (182 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1090 (855 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -63.55% (1.8097 => 0.6597, std.dev.: 0.0194) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3741 => 1.1680) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 17.76% (0.3834 => 0.4515, std.dev.: 0.0109) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.75% (2.0478 => 2.1042, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/salsa20: 2.36% (7.4937 => 7.6705, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/hash2: 2.28% (3.1932 => 3.2661, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.11% (0.3821 => 0.3511, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -7.36% (2.4924 => 2.3090, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.75% (0.3142 => 0.2930, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.64% (0.9542 => 0.8908, std.dev.: 0.0041) MultiSource/Applications/sgefa/sgefa: -6.40% (0.3357 => 0.3142, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.38% (0.2428 => 0.2273, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -6.03% (9.2283 => 8.6719, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/oourafft: -6.02% (0.2160 => 0.2030, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.95% (0.6484 => 0.6098, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -5.90% (16.1920 => 15.2362, std.dev.: 0.0150) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.90% (0.2355 => 0.2216, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.83% (0.5863 => 0.5521, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: -5.82% (7.0961 => 6.6829, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/football/football: -5.78% (0.9179 => 0.8648, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.78% (1.0544 => 0.9935, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.77% (0.3658 => 0.3447, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.76% (0.9852 => 0.9285, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.75% (0.5478 => 0.5163, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.71% (0.7198 => 0.6787, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.68% (1.3722 => 1.2942, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.67% (0.5802 => 0.5473, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.66% (0.5705 => 0.5382, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.66% (4.0323 => 3.8042, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.65% (0.5591 => 0.5275, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.62% (0.5857 => 0.5528, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.62% (0.5805 => 0.5479, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.61% (0.6681 => 0.6306, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.60% (0.5925 => 0.5593, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.60% (0.6304 => 0.5951, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.56% (0.6660 => 0.6290, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.53% (4.8161 => 4.5496, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.53% (1.6364 => 1.5459, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.53% (1.2300 => 1.1620, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.52% (0.6446 => 0.6090, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.51% (0.6297 => 0.5950, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.51% (0.5575 => 0.5268, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.51% (0.6230 => 0.5887, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.49% (1.2784 => 1.2082, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.48% (0.5581 => 0.5275, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.48% (4.8802 => 4.6127, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.48% (0.5859 => 0.5538, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.45% (0.2695 => 0.2548, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.45% (0.6260 => 0.5919, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.44% (0.6667 => 0.6304, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: -5.43% (1.1530 => 1.0904, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -5.42% (1.1450 => 1.0829, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.41% (3.5339 => 3.3426, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.40% (0.7919 => 0.7491, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.40% (0.6052 => 0.5725, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.40% (1.4642 => 1.3852, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.39% (0.6736 => 0.6373, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.39% (0.5849 => 0.5534, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.38% (0.6189 => 0.5856, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.38% (0.5688 => 0.5382, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.36% (0.6194 => 0.5862, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.36% (4.5069 => 4.2655, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.36% (0.6293 => 0.5956, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -5.32% (4.3330 => 4.1024, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.30% (0.6033 => 0.5713, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.30% (0.5456 => 0.5167, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.30% (0.5570 => 0.5275, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.29% (0.5941 => 0.5627, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.28% (0.3406 => 0.3226, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.28% (0.8521 => 0.8071, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: -5.26% (0.2871 => 0.2720, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.24% (0.6676 => 0.6326, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.23% (0.3483 => 0.3301, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.22% (6.7716 => 6.4181, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.22% (0.6440 => 0.6104, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.21% (14.2083 => 13.4686, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.21% (0.3016 => 0.2859, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.20% (0.2903 => 0.2752, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.20% (0.3057 => 0.2898, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -5.19% (0.3831 => 0.3632, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -5.19% (0.3255 => 0.3086, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -5.19% (0.3025 => 0.2868, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -5.18% (0.3880 => 0.3679, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -5.17% (0.3812 => 0.3615, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.17% (0.5999 => 0.5689, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.16% (0.3931 => 0.3728, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.15% (17.1032 => 16.2217, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.15% (0.3323 => 0.3152, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: -5.15% (0.3848 => 0.3650, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.10% (0.3194 => 0.3031, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.10% (1.2221 => 1.1598, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.08% (0.4151 => 0.3940, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -5.08% (0.4033 => 0.3828, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -5.08% (0.3896 => 0.3698, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.08% (1.3148 => 1.2480, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: -5.08% (0.4176 => 0.3964, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -5.05% (0.4515 => 0.4287, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.04% (0.3252 => 0.3088, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -5.03% (0.2985 => 0.2835, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.01% (1.2210 => 1.1598, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.00% (0.3837 => 0.3645, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -5.00% (15.5079 => 14.7328, std.dev.: 0.0184) MultiSource/Applications/Burg/burg: -4.99% (1.2515 => 1.1890, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.99% (0.3891 => 0.3697, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.98% (0.4916 => 0.4671, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.98% (0.2933 => 0.2787, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.97% (8.0126 => 7.6144, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: -4.96% (0.2659 => 0.2527, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.96% (0.2278 => 0.2165, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: -4.95% (0.3394 => 0.3226, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.93% (0.2999 => 0.2851, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -4.92% (3.5154 => 3.3426, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.91% (0.2548 => 0.2423, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -4.90% (1.3864 => 1.3184, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.90% (2.1713 => 2.0650, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -4.89% (0.3026 => 0.2878, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -4.88% (0.2989 => 0.2843, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.86% (0.6395 => 0.6084, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -4.85% (0.3481 => 0.3312, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: -4.83% (0.3581 => 0.3408, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.82% (0.4813 => 0.4581, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: -4.81% (0.2849 => 0.2712, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: -4.80% (0.2939 => 0.2798, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.78% (0.7339 => 0.6988, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -4.76% (15.2527 => 14.5260, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.74% (0.4321 => 0.4116, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.74% (0.3205 => 0.3053) SingleSource/UnitTests/ObjC/property: -4.69% (0.4199 => 0.4002, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -4.68% (0.4248 => 0.4049, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: -4.67% (0.3446 => 0.3285, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: -4.65% (0.3867 => 0.3687, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.65% (0.7524 => 0.7174, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.65% (0.5569 => 0.5310, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.64% (0.3059 => 0.2917, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.63% (0.3884 => 0.3704, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -4.63% (0.7447 => 0.7102, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.62% (0.5168 => 0.4929, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.62% (0.3849 => 0.3671, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.61% (0.2385 => 0.2275, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -4.58% (0.3621 => 0.3455, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -4.55% (4.0594 => 3.8749, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.52% (0.7021 => 0.6704, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.51% (0.4280 => 0.4087, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -4.51% (0.4861 => 0.4642, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.50% (0.6395 => 0.6107, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.49% (0.5567 => 0.5317, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -4.45% (0.7982 => 0.7627, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -4.43% (2.1401 => 2.0452, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.41% (0.4083 => 0.3903, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.39% (1.6474 => 1.5751, std.dev.: 0.0180) MultiSource/Applications/oggenc/oggenc: -4.39% (5.0226 => 4.8022, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.36% (22.4056 => 21.4280, std.dev.: 0.0156) MultiSource/Benchmarks/McCat/09-vor/vor: -4.34% (0.3271 => 0.3129, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.32% (0.5329 => 0.5099, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.30% (0.9557 => 0.9146, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.29% (0.4427 => 0.4237, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: -4.29% (0.6347 => 0.6075, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.25% (0.3319 => 0.3178, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -4.21% (2.4021 => 2.3009, std.dev.: 0.0026) MultiSource/Applications/spiff/spiff: -4.19% (0.8418 => 0.8065, std.dev.: 0.0079) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.19% (0.9077 => 0.8697, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sieve: -4.17% (0.3788 => 0.3630, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -4.15% (0.6441 => 0.6174, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: -4.08% (18.2933 => 17.5463, std.dev.: 0.0123) SingleSource/UnitTests/ObjC++/property-reference: -3.96% (0.7779 => 0.7471, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -3.94% (0.6750 => 0.6484, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -3.87% (34.0927 => 32.7742, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.78% (2.2587 => 2.1734, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/hash: -3.74% (0.4524 => 0.4355, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.68% (1.5610 => 1.5035, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.61% (0.3491 => 0.3365, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.09% (5.4682 => 5.2993, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -2.03% (20.7746 => 20.3536, std.dev.: 0.0833) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1970, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: -63.55% (1.8100 => 0.6597, std.dev.: 0.0194) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7500, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1729, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.92% (2.2633 => 2.1745, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7067, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.24% (1.3096 => 1.2672, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.67% (6.5735 => 6.4634, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 18:55:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 20:55:34 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121127025534.9F3132A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6288?compare_to=6283&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6288, Order: 168633, Start Time: 2012-11-27 00:38:23, End Time: 2012-11-27 02:56:04 To: 6283, Order: 168603, Start Time: 2012-11-26 21:24:05, End Time: 2012-11-26 23:43:50 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 69 (157 on baseline) Performance Improvements: 7 (44 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1010 (684 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 16.10% (0.7204 => 0.8364, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 15.65% (0.6864 => 0.7938, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 15.22% (0.5905 => 0.6804, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.09% (0.5936 => 0.6832, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 15.08% (0.7173 => 0.8255, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 14.97% (0.7194 => 0.8271, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.91% (0.6695 => 0.7693, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.73% (0.6313 => 0.7243, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.72% (0.6595 => 0.7566, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 14.48% (0.6595 => 0.7550, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 14.41% (0.6238 => 0.7137, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.67% (0.5791 => 0.6525, std.dev.: 0.0063) MultiSource/Applications/minisat/minisat: 12.22% (0.8181 => 0.9181, std.dev.: 0.0077) SingleSource/Benchmarks/LivermoreLoops/kernel01: 12.03% (0.1014 => 0.1136, std.dev.: 0.0004) SingleSource/Benchmarks/LivermoreLoops/kernel11: 11.83% (0.1014 => 0.1134, std.dev.: 0.0007) SingleSource/Benchmarks/LivermoreLoops/kernel10: 11.71% (0.1050 => 0.1173, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 11.56% (3.7700 => 4.2060, std.dev.: 0.0480) SingleSource/Benchmarks/LivermoreLoops/kernel13: 11.52% (0.1085 => 0.1210, std.dev.: 0.0008) SingleSource/Benchmarks/LivermoreLoops/kernel04: 11.32% (0.1060 => 0.1180, std.dev.: 0.0003) SingleSource/Benchmarks/LivermoreLoops/kernel09: 11.12% (0.1061 => 0.1179, std.dev.: 0.0009) SingleSource/Benchmarks/LivermoreLoops/kernel07: 11.02% (0.1044 => 0.1159, std.dev.: 0.0043) SingleSource/Benchmarks/LivermoreLoops/kernel03: 10.97% (0.0994 => 0.1103, std.dev.: 0.0006) SingleSource/Benchmarks/LivermoreLoops/kernel14: 10.89% (0.1093 => 0.1212, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 10.86% (0.8953 => 0.9925, std.dev.: 0.0130) SingleSource/Benchmarks/LivermoreLoops/kernel12: 10.73% (0.0997 => 0.1104, std.dev.: 0.0013) SingleSource/Benchmarks/LivermoreLoops/kernel06: 10.73% (0.1044 => 0.1156, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 10.65% (4.7549 => 5.2612, std.dev.: 0.0830) SingleSource/Benchmarks/LivermoreLoops/kernel08: 10.63% (0.1232 => 0.1363, std.dev.: 0.0010) SingleSource/Benchmarks/LivermoreLoops/kernel05: 10.31% (0.1009 => 0.1113, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.26% (0.6874 => 0.7579, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.70% (0.5895 => 0.6467, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.45% (0.5915 => 0.6474, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.90% (0.7563 => 0.8236, std.dev.: 0.0232) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.70% (0.1896 => 0.2061, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: 8.39% (0.3337 => 0.3617, std.dev.: 0.0083) MultiSource/Applications/viterbi/viterbi: 8.23% (0.1798 => 0.1946, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 7.79% (0.3131 => 0.3375, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/methcall: 7.78% (0.3123 => 0.3366, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.76% (0.1469 => 0.1583, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.70% (0.5115 => 0.5509, std.dev.: 0.0114) SingleSource/Regression/C++/ofstream_ctor: 7.41% (0.3172 => 0.3407, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/18-imp/imp: 7.19% (0.3893 => 0.4173, std.dev.: 0.0074) SingleSource/Benchmarks/LivermoreLoops/kernel18: 7.15% (0.1483 => 0.1589, std.dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: 7.09% (11.1363 => 11.9257, std.dev.: 0.0868) MultiSource/Applications/treecc/treecc: 7.01% (2.3114 => 2.4735, std.dev.: 0.0602) SingleSource/Benchmarks/Misc/ReedSolomon: 6.92% (0.2198 => 0.2350, std.dev.: 0.0047) MultiSource/Benchmarks/Fhourstones/fhourstones: 6.88% (0.1905 => 0.2036, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.23% (8.0939 => 8.5984, std.dev.: 0.0770) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.19% (0.7291 => 0.7742, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.85% (0.2204 => 0.2333, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.58% (0.3999 => 0.4182, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.16% (4.7377 => 4.9350, std.dev.: 0.0715) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.21% (0.5392 => 0.5565, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 1.29% (32.1943 => 32.6111, std.dev.: 0.1141) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/SPASS/SPASS: 30.81% (12.8217 => 16.7723, std.dev.: 0.3769) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 7.76% (0.5349 => 0.5764, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.65% (9.1259 => 9.8237, std.dev.: 0.0264) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 7.33% (0.4242 => 0.4553, std.dev.: 0.0048) MultiSource/Benchmarks/NPB-serial/is/is: 3.98% (8.5683 => 8.9090, std.dev.: 0.0502) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.89% (1.5448 => 1.6049, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.16% (4.3224 => 4.4592, std.dev.: 0.0378) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.36% (4.8047 => 4.9182, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.49% (3.2852 => 3.3343, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.29% (7.2812 => 7.3753, std.dev.: 0.0240) MultiSource/Applications/lambda-0_1_3/lambda: 1.21% (5.2511 => 5.3149, std.dev.: 0.0028) MultiSource/Applications/spiff/spiff: 1.20% (2.9535 => 2.9888, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.12% (5.4777 => 5.5388, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.07% (5.6760 => 5.7368, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.05% (5.4236 => 5.4803, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -8.64% (1.9042 => 1.7396, std.dev.: 0.0514) MultiSource/Applications/SPASS/SPASS: -1.73% (18.2372 => 17.9218, std.dev.: 0.0961) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -64.85% (29.0222 => 10.2015, std.dev.: 0.0346) SingleSource/Benchmarks/Dhrystone/fldry: -64.30% (1.9741 => 0.7047, std.dev.: 0.0056) SingleSource/Benchmarks/Dhrystone/dry: -52.79% (2.4747 => 1.1682, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.00% (0.3627 => 0.3228, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.68% (0.8571 => 0.8170, std.dev.: 0.0009) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.72% (69.8464 => 70.3509, std.dev.: 0.0512) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1338 => 0.1338, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.77% (0.0422 => 0.0459, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.46% (0.0652 => 0.0649, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 0.01% (493.8154 => 493.8625, std.dev.: 0.1795) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 11.24% (63.2438 => 70.3509, std.dev.: 0.0512) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.95% (4.3882 => 0.0459, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43693.78% (1.1277 => 493.8625, std.dev.: 0.1795) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 219.39% (0.5229 => 1.6701, std.dev.: 0.0593) MultiSource/Applications/SPASS/SPASS: 19.56% (14.9895 => 17.9218, std.dev.: 0.0961) MultiSource/Applications/kimwitu++/kc: 47.54% (14.1553 => 20.8849, std.dev.: 0.7339) MultiSource/Benchmarks/MallocBench/gs/gs: 15.39% (4.1105 => 4.7432, std.dev.: 0.2738) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.50% (1.1048 => 1.5191, std.dev.: 0.0677) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 433.53% (7.1582 => 38.1909, std.dev.: 0.0437) SingleSource/Benchmarks/Misc-C++-EH/spirit: 77.01% (3.4629 => 6.1297, std.dev.: 0.3393) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.46% (0.6222 => 1.0357, std.dev.: 0.0796) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10999.17% (0.0720 => 7.9914, std.dev.: 0.1719) MultiSource/Applications/SIBsim4/SIBsim4: 3862600.00% (0.0001 => 3.8627, std.dev.: 0.0274) MultiSource/Applications/SPASS/SPASS: 16772200.00% (0.0001 => 16.7723, std.dev.: 0.3769) MultiSource/Applications/kimwitu++/kc: 52400.00% (0.0001 => 0.0525, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576300.00% (0.0001 => 0.5764, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10074600.00% (0.0001 => 10.0747, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6727300.00% (0.0001 => 6.7274, std.dev.: 0.4241) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1720.37% (1.1194 => 20.3772, std.dev.: 0.3749) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 79.05% (2.9384 => 5.2612, std.dev.: 0.0830) MultiSource/Applications/ClamAV/clamscan: 67.34% (22.1758 => 37.1087, std.dev.: 0.3276) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.07% (7.0540 => 10.7979, std.dev.: 0.4431) MultiSource/Applications/JM/lencod/lencod: 48.66% (21.9371 => 32.6111, std.dev.: 0.1141) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 48.47% (8.1363 => 12.0796, std.dev.: 0.2832) MultiSource/Benchmarks/FreeBench/distray/distray: 45.55% (0.1056 => 0.1537, std.dev.: 0.0091) SingleSource/Benchmarks/CoyoteBench/almabench: 45.07% (0.0730 => 0.1059, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 38.76% (0.1432 => 0.1987, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/n-body: 31.37% (0.0746 => 0.0980, std.dev.: 0.0011) SingleSource/UnitTests/vla: 31.27% (0.0355 => 0.0466, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/dot-syntax-1: 31.11% (0.0479 => 0.0628, std.dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 30.01% (0.1566 => 0.2036, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/messages-2: 29.31% (0.0662 => 0.0856, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 29.04% (0.7115 => 0.9181, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/15-trie/trie: 27.89% (0.0527 => 0.0674, std.dev.: 0.0043) MultiSource/Benchmarks/BitBench/five11/five11: 27.16% (0.0567 => 0.0721, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 26.68% (0.7835 => 0.9925, std.dev.: 0.0130) MultiSource/Applications/d/make_dparser: 26.10% (3.3354 => 4.2060, std.dev.: 0.0480) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 25.27% (0.0467 => 0.0585, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.24% (0.1125 => 0.1409, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 25.14% (0.1555 => 0.1946, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 24.83% (0.0447 => 0.0558, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Oscar: 24.37% (0.0636 => 0.0791, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/exptree: 23.96% (0.0814 => 0.1009, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 23.39% (0.6675 => 0.8236, std.dev.: 0.0232) SingleSource/Benchmarks/Shootout/lists: 23.16% (0.0626 => 0.0771, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/08-main/main: 23.14% (0.2554 => 0.3145, std.dev.: 0.0189) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 22.98% (0.0953 => 0.1172, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 22.57% (0.1892 => 0.2319, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/matrix: 22.37% (0.0818 => 0.1001, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 22.19% (1.0722 => 1.3101, std.dev.: 0.0582) MultiSource/Applications/treecc/treecc: 22.01% (2.0273 => 2.4735, std.dev.: 0.0602) MultiSource/Benchmarks/McCat/18-imp/imp: 21.91% (0.3423 => 0.4173, std.dev.: 0.0074) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 21.76% (0.0648 => 0.0789, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 21.75% (0.5020 => 0.6112, std.dev.: 0.0096) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 21.69% (0.0793 => 0.0965, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.69% (0.0770 => 0.0937, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.59% (0.1695 => 0.2061, std.dev.: 0.0048) MultiSource/Benchmarks/BitBench/drop3/drop3: 21.58% (0.0482 => 0.0586, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 21.34% (0.1584 => 0.1922, std.dev.: 0.0110) MultiSource/Benchmarks/Olden/tsp/tsp: 20.94% (0.1175 => 0.1421, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.67% (0.0842 => 0.1016, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.59% (0.4615 => 0.5565, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 20.50% (0.3180 => 0.3832, std.dev.: 0.0162) MultiSource/Benchmarks/mafft/pairlocalalign: 19.79% (9.4845 => 11.3619, std.dev.: 0.2316) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.70% (0.2700 => 0.3232, std.dev.: 0.0195) SingleSource/Benchmarks/CoyoteBench/lpbench: 19.70% (0.0929 => 0.1112, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 19.68% (0.4620 => 0.5529, std.dev.: 0.0119) SingleSource/Benchmarks/McGill/misr: 19.59% (0.0633 => 0.0757, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 19.06% (14.3668 => 17.1045, std.dev.: 0.5454) SingleSource/UnitTests/ObjC/parameter-passing: 18.92% (0.3927 => 0.4670, std.dev.: 0.0090) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.89% (0.0704 => 0.0837, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 18.83% (0.4636 => 0.5509, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/hash: 18.63% (0.4289 => 0.5088, std.dev.: 0.0163) SingleSource/UnitTests/ObjC/property: 18.30% (0.3886 => 0.4597, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/fbench: 18.24% (0.0592 => 0.0700, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 18.21% (0.4299 => 0.5082, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 18.15% (0.2430 => 0.2871, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/except: 17.55% (0.2871 => 0.3375, std.dev.: 0.0085) MultiSource/Benchmarks/McCat/17-bintr/bintr: 17.48% (0.0675 => 0.0793, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 17.41% (0.0672 => 0.0789, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 17.34% (0.8101 => 0.9506, std.dev.: 0.0237) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.34% (0.0871 => 0.1022, std.dev.: 0.0023) SingleSource/Regression/C++/ofstream_ctor: 17.28% (0.2905 => 0.3407, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/exceptions-4: 17.22% (0.3543 => 0.4153, std.dev.: 0.0122) SingleSource/UnitTests/ObjC/synchronized: 17.16% (0.3561 => 0.4172, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/exceptions-2: 17.16% (0.3497 => 0.4097, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/exceptions-3: 17.15% (0.3516 => 0.4119, std.dev.: 0.0156) SingleSource/UnitTests/ObjC/instance-method-metadata: 17.10% (0.3543 => 0.4149, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/matrix: 17.08% (0.3098 => 0.3627, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/methcall: 17.00% (0.2877 => 0.3366, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/bh/bh: 16.98% (0.3092 => 0.3617, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/for-in: 16.97% (0.3694 => 0.4321, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/ary3: 16.91% (0.3283 => 0.3838, std.dev.: 0.0126) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.85% (0.8172 => 0.9549, std.dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/fibo: 16.84% (0.2725 => 0.3184, std.dev.: 0.0123) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.79% (0.0834 => 0.0974, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary2: 16.78% (0.3379 => 0.3946, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/em3d/em3d: 16.76% (0.1695 => 0.1979, std.dev.: 0.0107) MultiSource/Benchmarks/VersaBench/bmm/bmm: 16.60% (0.0759 => 0.0885, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions: 16.48% (0.3828 => 0.4459, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/bisort/bisort: 16.45% (0.0614 => 0.0715, std.dev.: 0.0030) SingleSource/UnitTests/SignlessTypes/rem: 16.43% (0.1144 => 0.1332, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.08% (0.2065 => 0.2397, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/health/health: 16.01% (0.1268 => 0.1471, std.dev.: 0.0059) MultiSource/Applications/aha/aha: 15.90% (0.1151 => 0.1334, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.84% (0.2758 => 0.3195, std.dev.: 0.0147) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.82% (0.1940 => 0.2247, std.dev.: 0.0118) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.67% (0.3121 => 0.3610, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.58% (0.0770 => 0.0890, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.47% (0.2107 => 0.2433, std.dev.: 0.0112) MultiSource/Applications/Burg/burg: 15.46% (1.1642 => 1.3442, std.dev.: 0.0458) MultiSource/Benchmarks/NPB-serial/is/is: 15.44% (0.0719 => 0.0830) MultiSource/Benchmarks/PAQ8p/paq8p: 15.03% (10.3673 => 11.9257, std.dev.: 0.0868) MultiSource/Applications/lua/lua: 14.83% (3.8723 => 4.4467, std.dev.: 0.2155) SingleSource/Benchmarks/Misc/ReedSolomon: 14.69% (0.2049 => 0.2350, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.66% (0.1337 => 0.1533, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.60% (0.5981 => 0.6854, std.dev.: 0.0247) MultiSource/Applications/oggenc/oggenc: 14.58% (5.7591 => 6.5987, std.dev.: 0.2717) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.49% (0.2271 => 0.2600, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.42% (0.5569 => 0.6372, std.dev.: 0.0310) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.38% (0.1029 => 0.1177, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.31% (0.1062 => 0.1214, std.dev.: 0.0056) MultiSource/Applications/sgefa/sgefa: 14.28% (0.3109 => 0.3553, std.dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.25% (0.5860 => 0.6695, std.dev.: 0.0290) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.98% (0.3441 => 0.3922, std.dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 13.85% (2.2024 => 2.5074, std.dev.: 0.1141) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.60% (1.5415 => 1.7512, std.dev.: 0.0559) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.29% (0.0933 => 0.1057, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.00% (4.9449 => 5.5878, std.dev.: 0.2010) MultiSource/Applications/sqlite3/sqlite3: 12.53% (17.1811 => 19.3332, std.dev.: 0.6887) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.13% (0.3865 => 0.4334, std.dev.: 0.0149) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.01% (0.1906 => 0.2135, std.dev.: 0.0078) SingleSource/UnitTests/ObjC/trivial-interface: 12.01% (0.3473 => 0.3890, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.55% (0.4103 => 0.4577, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 11.51% (0.3422 => 0.3816, std.dev.: 0.0125) MultiSource/Applications/hbd/hbd: 11.49% (1.5603 => 1.7396, std.dev.: 0.0514) SingleSource/Benchmarks/Shootout-C++/sieve: 11.13% (0.3603 => 0.4004, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.49% (0.3650 => 0.4033, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.36% (0.4064 => 0.4485, std.dev.: 0.0153) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.08% (0.1438 => 0.1583, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.66% (2.0665 => 2.2662, std.dev.: 0.0703) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.56% (0.3817 => 0.4182, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.55% (0.3162 => 0.3464, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.42% (0.5925 => 0.6483, std.dev.: 0.0202) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.00% (7.9617 => 8.5984, std.dev.: 0.0770) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.38% (0.3177 => 0.3348, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 149.63% (4.3953 => 10.9719, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/methcall: 147.24% (5.3999 => 13.3506, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/oourafft: 17.45% (6.6465 => 7.8063, std.dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.58% (1.1145 => 1.2993, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 14.27% (1.3045 => 1.4906, std.dev.: 0.0634) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.17% (8.6802 => 9.8237, std.dev.: 0.0264) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.11% (0.2944 => 0.3330, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.54% (2.8904 => 3.2240, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: 10.50% (3.1578 => 3.4895, std.dev.: 0.0629) SingleSource/Benchmarks/Misc/richards_benchmark: 10.22% (1.1396 => 1.2561, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.31% (1.7254 => 1.8861, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.41% (3.1334 => 3.3343, std.dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.81% (13.4384 => 14.2193, std.dev.: 0.1674) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.39% (4.2280 => 4.4558, std.dev.: 0.0110) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.97% (11.6436 => 12.1058, std.dev.: 0.0143) MultiSource/Applications/lua/lua: 3.91% (26.0924 => 27.1123, std.dev.: 0.2819) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.12% (1.3677 => 1.3967, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 2.07% (3.1595 => 3.2250, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.01% (2.1424 => 2.1855, std.dev.: 0.0096) MultiSource/Applications/spiff/spiff: 1.85% (2.9346 => 2.9888, std.dev.: 0.0126) MultiSource/Benchmarks/PAQ8p/paq8p: 1.79% (85.0658 => 86.5898, std.dev.: 0.1184) MultiSource/Benchmarks/mafft/pairlocalalign: 1.27% (27.8444 => 28.1978, std.dev.: 0.0268) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.25% (6.5088 => 6.5903, std.dev.: 0.0106) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0313 => 1.0441, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0506, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1694, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.53% (5.2763 => 1.2381, std.dev.: 0.0410) SingleSource/Benchmarks/Misc/salsa20: -74.72% (0.8651 => 0.2187, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: -39.64% (0.1622 => 0.0979, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.12% (5.3526 => 4.7573, std.dev.: 0.1559) MultiSource/Applications/JM/ldecod/ldecod: -10.50% (10.4361 => 9.3398, std.dev.: 0.2954) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -9.32% (1.7609 => 1.5968, std.dev.: 0.0629) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.37% (5.3855 => 4.9350, std.dev.: 0.0715) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -68.62% (32.5116 => 10.2015, std.dev.: 0.0346) SingleSource/Benchmarks/Dhrystone/fldry: -64.00% (1.9577 => 0.7047, std.dev.: 0.0056) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1682, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.13% (0.3987 => 0.2387) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.35% (4.5009 => 2.7748, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7636, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.08% (2.6546 => 2.0155, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -19.34% (0.2161 => 0.1743, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.70% (1.6925 => 1.4267, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2838, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -10.67% (1.5373 => 1.3732, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.71% (1.5660 => 1.4296, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0019) MultiSource/Benchmarks/NPB-serial/is/is: -6.84% (9.5636 => 8.9090, std.dev.: 0.0502) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.2416 => 3.0207, std.dev.: 0.0255) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.40% (19.9488 => 18.6725, std.dev.: 0.3380) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.56% (2.7294 => 2.5776, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.15% (0.8614 => 0.8170, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5079, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.77% (0.2497 => 0.2378, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -4.54% (6.2999 => 6.0139, std.dev.: 0.0121) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.50% (1.6805 => 1.6049, std.dev.: 0.0104) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.31% (0.9957 => 0.9627, std.dev.: 0.0089) MultiSource/Benchmarks/sim/sim: -3.09% (5.0483 => 4.8923, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.48% (0.4808 => 0.4689, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6774, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.61% (8.1563 => 8.0253, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/salsa20: -1.51% (10.2830 => 10.1282, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0009) Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 19:22:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 21:22:08 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121127032208.2FB7D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6289?compare_to=6285&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6289, Order: 168660, Start Time: 2012-11-27 01:46:21, End Time: 2012-11-27 03:22:40 To: 6285, Order: 168630, Start Time: 2012-11-26 23:48:38, End Time: 2012-11-27 01:25:37 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (30 on baseline) Performance Regressions: 17 (88 on baseline) Performance Improvements: 12 (16 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 39 (38 on baseline) Unchanged Tests: 1024 (869 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 68.32% (0.1348 => 0.2269, std.dev.: 0.0067) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.26% (22.5968 => 24.9162, std.dev.: 0.1054) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.30% (0.8626 => 0.9342, std.dev.: 0.0218) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.89% (0.9274 => 1.0006, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 7.15% (0.8939 => 0.9578, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.73% (0.8163 => 0.8631, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 5.43% (0.8578 => 0.9044, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (0.9227 => 0.9605, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.97% (0.8517 => 0.8770, std.dev.: 0.0093) MultiSource/Applications/sqlite3/sqlite3: 2.29% (15.4944 => 15.8498, std.dev.: 0.0757) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.57% (4.9175 => 5.7325, std.dev.: 0.0955) MultiSource/Benchmarks/PAQ8p/paq8p: 4.44% (92.0358 => 96.1238, std.dev.: 0.2903) SingleSource/Benchmarks/Shootout-C++/ary3: 3.67% (2.0581 => 2.1336, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/except: 2.18% (0.4958 => 0.5066, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.85% (3.4572 => 3.5212, std.dev.: 0.0217) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.52% (13.3723 => 13.5761, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.10% (3.5855 => 3.6250, std.dev.: 0.0106) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout/hash: -38.35% (0.0884 => 0.0545, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/whetstone: -16.72% (0.0951 => 0.0792, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -12.61% (0.0809 => 0.0707, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -10.46% (0.1061 => 0.0950, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -7.72% (0.9302 => 0.8584, std.dev.: 0.0233) MultiSource/Applications/SIBsim4/SIBsim4: -7.68% (1.4119 => 1.3035, std.dev.: 0.0106) MultiSource/Benchmarks/McCat/18-imp/imp: -6.79% (0.3842 => 0.3581, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/bh/bh: -5.87% (0.3222 => 0.3033, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/05-eks/eks: -5.03% (0.4748 => 0.4509, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -7.22% (2.5244 => 2.3421, std.dev.: 0.0625) MultiSource/Applications/SIBsim4/SIBsim4: -1.96% (3.4525 => 3.3848, std.dev.: 0.0195) SingleSource/Benchmarks/Misc/ffbench: -1.01% (1.4613 => 1.4465, std.dev.: 0.0044) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -2.34% (1.1010 => 1.0752, std.dev.: 0.0808) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.49% (0.0229 => 0.0221, std.dev.: 0.0051) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.15% (0.0436 => 0.0431, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -16.32% (0.0337 => 0.0282, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.17% (0.0322 => 0.0315, std.dev.: 0.0093) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.29% (0.0436 => 0.0426, std.dev.: 0.0086) SingleSource/UnitTests/Vector/Altivec/casts: -0.48% (0.0210 => 0.0209, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/test1: -3.12% (0.0224 => 0.0217, std.dev.: 0.0062) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.96% (0.1484 => 0.1528, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: -0.21% (1.2553 => 1.2527, std.dev.: 0.0263) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -7.42% (0.4569 => 0.4230, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.09% (0.1369 => 0.1425, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.60% (0.0666 => 0.0662, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.21% (0.0272 => 0.0278, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.09% (0.0573 => 0.0561, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.13% (1.2135 => 1.1998, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: -0.03% (9.4521 => 9.4494, std.dev.: 0.0234) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.31% (0.0645 => 0.0647, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.40% (0.0250 => 0.0261, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.53% (0.7727 => 0.7768, std.dev.: 0.0243) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.81% (0.0062 => 0.0046, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/SciMark2-C/scimark2: -66.94% (28.5821 => 9.4494, std.dev.: 0.0234) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 9.35% (16.4461 => 17.9831, std.dev.: 0.4960) MultiSource/Applications/sqlite3/sqlite3: 2403.13% (0.6332 => 15.8498, std.dev.: 0.0757) MultiSource/Benchmarks/McCat/08-main/main: 52.70% (0.1831 => 0.2796, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.03% (0.1559 => 0.1575, std.dev.: 0.0182) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7878.29% (0.3123 => 24.9162, std.dev.: 0.1054) SingleSource/Benchmarks/CoyoteBench/fftbench: 54.73% (0.2463 => 0.3811, std.dev.: 0.0442) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1600.30% (0.3344 => 5.6858, std.dev.: 0.1534) SingleSource/Benchmarks/Misc-C++/Large/ray: 44.20% (0.2364 => 0.3409, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 8.59% (0.6010 => 0.6526, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/mandel: 5.83% (0.0429 => 0.0454, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.31% (0.3266 => 0.3570, std.dev.: 0.0408) SingleSource/Benchmarks/Shootout-C++/strcat: 11.58% (0.1969 => 0.2197, std.dev.: 0.0515) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 9.38% (0.0224 => 0.0245, std.dev.: 0.0057) SingleSource/UnitTests/byval-alignment: -19.57% (0.0230 => 0.0185, std.dev.: 0.0032) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0511, std.dev.: 0.0042) MultiSource/Applications/oggenc/oggenc: 12.59% (0.1462 => 0.1646, std.dev.: 0.0135) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.5045, std.dev.: 0.0628) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0759, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4952, std.dev.: 0.0231) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5370, std.dev.: 0.0426) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.9552, std.dev.: 0.2025) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3259, std.dev.: 0.0613) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1620, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3644, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4127, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0837, std.dev.: 0.0173) SingleSource/Regression/C/uint64_to_float: -24.10% (2.1832 => 1.6571, std.dev.: 0.0078) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 74.40% (0.1301 => 0.2269, std.dev.: 0.0067) SingleSource/Benchmarks/Stanford/Quicksort: 31.16% (0.0353 => 0.0463, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.00% (0.0773 => 0.0974, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.50% (0.0717 => 0.0821, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.46% (0.0830 => 0.0950, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.95% (0.8420 => 0.9342, std.dev.: 0.0218) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.34% (0.8069 => 0.8903, std.dev.: 0.0254) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 10.33% (0.9069 => 1.0006, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.13% (0.8697 => 0.9578, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/sieve: 9.69% (0.2755 => 0.3022, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.86% (2.1401 => 2.3297, std.dev.: 0.0425) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.60% (0.8340 => 0.9057, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.56% (0.8331 => 0.9044, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.35% (0.7966 => 0.8631, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.03% (1.5315 => 1.6545, std.dev.: 0.0427) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.78% (0.8995 => 0.9605, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.75% (0.8048 => 0.8591, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.72% (0.8317 => 0.8876, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.70% (3.1832 => 3.3966, std.dev.: 0.0698) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.44% (0.8359 => 0.8897, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.16% (0.8261 => 0.8770, std.dev.: 0.0093) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.09% (0.2133 => 0.2263, std.dev.: 0.0044) MultiSource/Applications/oggenc/oggenc: 5.56% (4.9628 => 5.2389, std.dev.: 0.0853) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 5.44% (0.8712 => 0.9186, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 5.07% (0.8805 => 0.9251, std.dev.: 0.0141) MultiSource/Applications/hbd/hbd: 5.04% (1.4269 => 1.4988, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.84% (0.8656 => 0.9075, std.dev.: 0.0107) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.83% (0.4783 => 0.5014, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.71% (0.9074 => 0.9501, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/matrix: 4.58% (0.2227 => 0.2329, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.52% (0.4559 => 0.4765, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.37% (0.8716 => 0.9097, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.32% (0.5191 => 0.5415, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 4.15% (0.8007 => 0.8339, std.dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.98% (0.3717 => 0.3865, std.dev.: 0.0042) MultiSource/Applications/lua/lua: 3.90% (3.8189 => 3.9678, std.dev.: 0.0248) MultiSource/Applications/SIBsim4/SIBsim4: 3.72% (1.2568 => 1.3035, std.dev.: 0.0106) MultiSource/Applications/lemon/lemon: 3.55% (1.0945 => 1.1334, std.dev.: 0.0097) MultiSource/Benchmarks/sim/sim: 3.32% (0.3226 => 0.3333, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.24% (0.8611 => 0.8890, std.dev.: 0.0082) MultiSource/Applications/lambda-0_1_3/lambda: 3.08% (0.7557 => 0.7790, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 2.80% (0.9810 => 1.0085, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.72% (0.8885 => 0.9127, std.dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 122.11% (0.0199 => 0.0442, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/ary2: 86.40% (0.0125 => 0.0233, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/pi: 58.06% (1.5795 => 2.4966, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 25.86% (4.5547 => 5.7325, std.dev.: 0.0955) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 19.96% (0.7597 => 0.9113, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.35% (2.9753 => 3.5212, std.dev.: 0.0217) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 15.75% (2.7995 => 3.2404, std.dev.: 0.1074) SingleSource/Benchmarks/Shootout-C++/hash: 13.09% (0.6205 => 0.7017, std.dev.: 0.0313) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.88% (3.9188 => 4.3844, std.dev.: 0.1562) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.57% (5.0261 => 5.6074, std.dev.: 0.0408) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.55% (6.3772 => 6.9224, std.dev.: 0.1467) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.25% (1.1857 => 1.2835, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 7.70% (1.7056 => 1.8370, std.dev.: 0.0202) SingleSource/Benchmarks/Shootout/ary3: 7.23% (2.0949 => 2.2464, std.dev.: 0.0363) SingleSource/Benchmarks/Misc/richards_benchmark: 6.87% (1.3037 => 1.3933, std.dev.: 0.0246) SingleSource/Benchmarks/Shootout-C++/ary3: 6.69% (1.9999 => 2.1336, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.64% (4.7794 => 5.0968, std.dev.: 0.0565) MultiSource/Applications/SIBsim4/SIBsim4: 6.20% (3.1873 => 3.3848, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.12% (4.9686 => 5.2729, std.dev.: 0.0826) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.94% (4.5327 => 4.8020, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 5.30% (7.4933 => 7.8903, std.dev.: 0.0297) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.96% (3.3761 => 3.5434, std.dev.: 0.0267) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.87% (6.2275 => 6.5306, std.dev.: 0.0286) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.82% (4.9469 => 5.1851, std.dev.: 0.0897) MultiSource/Benchmarks/PAQ8p/paq8p: 4.74% (91.7701 => 96.1238, std.dev.: 0.2903) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.26% (4.9453 => 5.1562, std.dev.: 0.0231) MultiSource/Applications/hexxagon/hexxagon: 4.09% (14.0064 => 14.5799, std.dev.: 0.0044) MultiSource/Applications/siod/siod: 3.91% (3.6643 => 3.8077, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.90% (59.2638 => 61.5780, std.dev.: 0.5326) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.24% (4.8362 => 4.9928, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/except: 2.95% (0.4921 => 0.5066, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: 2.60% (7.3375 => 7.5284, std.dev.: 0.0657) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.53% (8.2783 => 8.4876, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.44% (11.5690 => 11.8513, std.dev.: 0.0186) MultiSource/Applications/spiff/spiff: 2.35% (2.8561 => 2.9232, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.14% (4.0473 => 4.1341, std.dev.: 0.0260) SingleSource/Benchmarks/Stanford/FloatMM: 2.10% (0.8807 => 0.8992, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.71% (1.1365 => 1.1559, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.65% (4.4340 => 4.5073, std.dev.: 0.0260) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.62% (3.7781 => 3.8393, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 1.61% (8.5322 => 8.6697, std.dev.: 0.0245) MultiSource/Benchmarks/FreeBench/neural/neural: 1.49% (1.0841 => 1.1002, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 1.39% (2.3560 => 2.3887, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/ffbench: 1.18% (1.4296 => 1.4465, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.07% (2.7551 => 2.7846, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -20.35% (5.4641 => 4.3521, std.dev.: 0.0295) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.34% (7.2130 => 6.2506, std.dev.: 0.1881) MultiSource/Benchmarks/mafft/pairlocalalign: -7.75% (63.1822 => 58.2860, std.dev.: 0.3828) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.30% (14.6451 => 13.5761, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.85% (4.7482 => 4.4231, std.dev.: 0.0651) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.86% (3.7148 => 3.4972, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.84% (5.4972 => 5.1761, std.dev.: 0.1004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.02% (5.1557 => 4.8969, std.dev.: 0.0631) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.17% (4.7449 => 4.5469, std.dev.: 0.0358) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.64% (2.8773 => 2.7725, std.dev.: 0.0385) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.62% (6.0224 => 5.8042, std.dev.: 0.0145) MultiSource/Applications/lua/lua: -2.29% (29.8330 => 29.1501, std.dev.: 0.2138) MultiSource/Applications/aha/aha: -2.10% (3.3398 => 3.2695, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.87% (11.5316 => 11.3159, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash2: -1.53% (3.4237 => 3.3713, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.27% (4.9994 => 4.9358, std.dev.: 0.0172) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.77% (1.0262 => 1.0752, std.dev.: 0.0808) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 79.67% (0.0123 => 0.0221, std.dev.: 0.0051) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.64% (0.0408 => 0.0431, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 11.02% (0.0254 => 0.0282, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0093) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.94% (0.0384 => 0.0426, std.dev.: 0.0086) SingleSource/UnitTests/Vector/Altivec/casts: 10.00% (0.0190 => 0.0209, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0062) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 6.26% (0.1438 => 0.1528, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 10.57% (1.1329 => 1.2527, std.dev.: 0.0263) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.59% (0.4164 => 0.4230, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.09% (0.1369 => 0.1425, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.28% (0.0641 => 0.0662, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.56% (0.0195 => 0.0278, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.94% (0.0578 => 0.0561, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.91% (1.1437 => 1.1998, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.19% (0.0627 => 0.0647, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 45.00% (0.0180 => 0.0261, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.11% (0.8017 => 0.7768, std.dev.: 0.0243) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.81% (0.0062 => 0.0046, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 20:01:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 22:01:54 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121127040154.AD51F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6290?compare_to=6287&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6290, Order: 168669, Start Time: 2012-11-27 02:30:15, End Time: 2012-11-27 04:02:25 To: 6287, Order: 168636, Start Time: 2012-11-27 00:34:51, End Time: 2012-11-27 02:07:08 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (6 on baseline) Performance Improvements: 0 (184 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1090 (852 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 9.06% (0.6597 => 0.7195, std.dev.: 0.0190) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.90% (54.4357 => 56.0166, std.dev.: 0.3457) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 16.09% (0.3834 => 0.4451, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.64% (54.5751 => 56.0166, std.dev.: 0.3457) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.56% (2.0478 => 2.1003, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/salsa20: 2.56% (7.4937 => 7.6854, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 2.17% (3.1932 => 3.2626, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.01% (0.1431 => 0.1302, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.11% (0.3821 => 0.3511, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.97% (0.3142 => 0.2923, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.90% (2.4924 => 2.3204, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.80% (0.9542 => 0.8893, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.55% (0.3357 => 0.3137, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -6.48% (0.2160 => 0.2020, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -6.43% (0.3812 => 0.3567, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.37% (0.3831 => 0.3587, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.37% (0.3848 => 0.3603, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.37% (0.3880 => 0.3633, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.31% (0.3896 => 0.3650, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.30% (0.2428 => 0.2275, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -6.23% (0.1879 => 0.1762, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.22% (0.3891 => 0.3649, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.20% (0.4033 => 0.3783, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.18% (0.9852 => 0.9243, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.12% (0.1796 => 0.1686, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: -6.08% (0.4176 => 0.3922, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.08% (9.2283 => 8.6676, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.07% (0.2355 => 0.2212, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.00% (0.7198 => 0.6766, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.99% (0.5478 => 0.5150, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.92% (0.5863 => 0.5516, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: -5.91% (16.1920 => 15.2347, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.91% (0.6484 => 0.6101, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.89% (1.3722 => 1.2914, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.88% (0.5802 => 0.5461, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/football/football: -5.87% (0.9179 => 0.8640, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -5.86% (7.0961 => 6.6804, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.86% (0.5805 => 0.5465, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.81% (4.0323 => 3.7981, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.81% (0.5857 => 0.5517, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.80% (0.3658 => 0.3446, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.80% (0.5591 => 0.5267, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -5.79% (0.4199 => 0.3956, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.77% (4.8161 => 4.5381, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.76% (0.6304 => 0.5941, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.74% (0.3884 => 0.3661, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.73% (1.0544 => 0.9940, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.72% (0.6260 => 0.5902, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.71% (0.6230 => 0.5874, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.70% (0.5581 => 0.5263, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.67% (0.5925 => 0.5589, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.65% (0.6660 => 0.6284, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.63% (0.5705 => 0.5384, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.62% (6.7716 => 6.3910, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.61% (0.5575 => 0.5262, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.59% (1.6364 => 1.5449, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.59% (0.5849 => 0.5522, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.59% (0.5941 => 0.5609, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.57% (0.6189 => 0.5844, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.57% (0.6297 => 0.5946, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.54% (0.5688 => 0.5373, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -5.54% (1.1450 => 1.0816, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.53% (0.6667 => 0.6298, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.53% (0.2695 => 0.2546, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.53% (4.8802 => 4.6104, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.52% (0.6446 => 0.6090, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.51% (0.5570 => 0.5263, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.51% (0.6681 => 0.6313, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.51% (0.6194 => 0.5853, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.48% (1.2300 => 1.1626, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.47% (0.6052 => 0.5721, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -5.46% (1.1530 => 1.0901, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.45% (3.5339 => 3.3414, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.44% (0.5456 => 0.5159, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.44% (4.5069 => 4.2617, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.43% (0.7919 => 0.7489, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: -5.42% (0.4280 => 0.4048, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.42% (0.6440 => 0.6091, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.41% (1.2784 => 1.2092, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.36% (0.4515 => 0.4273, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: -5.35% (4.3330 => 4.1012, std.dev.: 0.0074) MultiSource/Benchmarks/sim/sim: -5.34% (0.3406 => 0.3224, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.32% (0.6293 => 0.5958, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.32% (0.6033 => 0.5712, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.30% (14.2083 => 13.4557, std.dev.: 0.0122) MultiSource/Applications/SIBsim4/SIBsim4: -5.29% (1.3864 => 1.3130, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.29% (0.6736 => 0.6380, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.25% (0.8521 => 0.8074, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: -5.23% (17.1032 => 16.2084, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.20% (1.2221 => 1.1586, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.19% (8.0126 => 7.5967, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.18% (0.2278 => 0.2160, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.17% (0.4916 => 0.4662, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.14% (1.2210 => 1.1583, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.13% (0.5999 => 0.5691, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.13% (0.2985 => 0.2832, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: -5.02% (0.3025 => 0.2873, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.02% (1.4642 => 1.3907, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/fibo: -5.02% (0.2871 => 0.2727, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.01% (0.4151 => 0.3943, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.99% (0.3931 => 0.3735, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -4.96% (0.2659 => 0.2527, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.96% (0.6395 => 0.6078, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -4.95% (1.3148 => 1.2497, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.95% (0.2385 => 0.2267, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.94% (0.2933 => 0.2788, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: -4.94% (0.3581 => 0.3404, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: -4.94% (15.5079 => 14.7422, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.93% (0.2999 => 0.2851, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.93% (0.3837 => 0.3648, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -4.92% (0.3255 => 0.3095, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -4.92% (0.3194 => 0.3037, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.91% (0.3483 => 0.3312, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.91% (0.3057 => 0.2907, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -4.90% (0.2939 => 0.2795, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.90% (2.1713 => 2.0650, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.89% (0.2903 => 0.2761, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.87% (0.2548 => 0.2424, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.86% (0.5168 => 0.4917, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -4.83% (0.7447 => 0.7087, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -4.79% (15.2527 => 14.5215, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/except: -4.79% (0.3026 => 0.2881, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -4.77% (0.2849 => 0.2713, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.77% (0.7524 => 0.7165, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: -4.77% (1.2515 => 1.1918, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.76% (0.5569 => 0.5304, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.76% (0.7339 => 0.6990) MultiSource/Applications/lua/lua: -4.75% (4.0594 => 3.8666, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/wc: -4.71% (0.3205 => 0.3054, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.68% (0.3849 => 0.3669, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.64% (0.6395 => 0.6098, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.64% (0.3252 => 0.3101, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -4.61% (0.3059 => 0.2918, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: -4.61% (0.4861 => 0.4637, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.60% (0.3323 => 0.3170, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -4.59% (0.4248 => 0.4053, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.58% (0.5567 => 0.5312, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -4.57% (0.3481 => 0.3322, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.55% (1.6474 => 1.5724, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: -4.55% (2.1401 => 2.0428, std.dev.: 0.0037) MultiSource/Applications/d/make_dparser: -4.54% (3.5154 => 3.3558, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.54% (0.4321 => 0.4125, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.53% (0.4813 => 0.4595, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (0.7021 => 0.6703, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -4.46% (0.7779 => 0.7432, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: -4.44% (0.6347 => 0.6065, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.41% (0.4083 => 0.3903, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: -4.40% (0.3867 => 0.3697, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -4.38% (0.2989 => 0.2858, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -4.37% (0.3271 => 0.3128, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: -4.35% (0.3446 => 0.3296, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.34% (22.4056 => 21.4327, std.dev.: 0.0123) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.34% (0.3319 => 0.3175, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: -4.34% (0.3621 => 0.3464, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -4.33% (0.6441 => 0.6162, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -4.33% (0.3394 => 0.3247, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -4.31% (0.4524 => 0.4329, std.dev.: 0.0020) MultiSource/Applications/siod/siod: -4.27% (2.4021 => 2.2995, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.27% (0.5859 => 0.5609, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.24% (0.9557 => 0.9152, std.dev.: 0.0048) MultiSource/Applications/oggenc/oggenc: -4.24% (5.0226 => 4.8098, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.18% (0.5329 => 0.5106, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -4.18% (0.8418 => 0.8066, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: -4.10% (0.7982 => 0.7655, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.09% (0.4427 => 0.4246, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.08% (0.9077 => 0.8707, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: -3.96% (0.3788 => 0.3638, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -3.86% (34.0927 => 32.7764, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/bigfib: -3.82% (0.6750 => 0.6492, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: -3.81% (18.2933 => 17.5969, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.78% (0.3491 => 0.3359, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.75% (2.2587 => 2.1740, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -3.49% (1.5610 => 1.5065, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.98% (5.4682 => 5.3055, std.dev.: 0.0034) SingleSource/UnitTests/Vector/constpool: -2.83% (20.7746 => 20.1857, std.dev.: 0.0421) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1963, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: -60.25% (1.8100 => 0.7195, std.dev.: 0.0190) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7551, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1729, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.96% (2.2633 => 2.1736, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.28% (1.3096 => 1.2667, std.dev.: 0.0139) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4693, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.11% (1.6086 => 1.5908, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 21:08:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 23:08:45 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121127050845.DDED82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6291?compare_to=6289&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6291, Order: 168675, Start Time: 2012-11-27 03:40:25, End Time: 2012-11-27 05:09:17 To: 6289, Order: 168660, Start Time: 2012-11-27 01:46:21, End Time: 2012-11-27 03:22:40 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (30 on baseline) Performance Regressions: 1 (127 on baseline) Performance Improvements: 135 (30 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 39 (38 on baseline) Unchanged Tests: 917 (816 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.23% (1.8766 => 1.8997, std.dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -41.56% (0.2269 => 0.1326, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/garage/garage: -26.97% (0.0890 => 0.0650, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/life/life: -24.00% (0.1104 => 0.0839, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/Quicksort: -22.46% (0.0463 => 0.0359, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/simul/simul: -17.00% (0.0800 => 0.0664, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: -15.39% (0.4457 => 0.3771, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/city/city: -11.94% (1.6978 => 1.4950, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/office/office: -11.57% (0.2429 => 0.2148, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -10.57% (0.0974 => 0.0871, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -10.37% (24.9162 => 22.3324, std.dev.: 0.0648) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.62% (0.1206 => 0.1090, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -9.37% (0.2221 => 0.2013, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -8.56% (0.1297 => 0.1186, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -7.99% (0.9342 => 0.8596, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -7.84% (0.2539 => 0.2340, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -7.60% (0.8903 => 0.8226, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -7.51% (0.3420 => 0.3163, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -7.41% (0.9578 => 0.8868, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -6.97% (1.0006 => 0.9309, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.92% (0.3063 => 0.2851, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.91% (0.8863 => 0.8251, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -6.74% (0.2197 => 0.2049, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.43% (0.2443 => 0.2286, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.41% (0.2263 => 0.2118, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.38% (0.9070 => 0.8491, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: -6.12% (0.3022 => 0.2837, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.77% (0.9044 => 0.8522, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.74% (0.8631 => 0.8136, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.64% (0.9578 => 0.9038, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: -5.60% (34.6891 => 32.7474, std.dev.: 0.0702) SingleSource/Benchmarks/Shootout-C++/random: -5.48% (0.2134 => 0.2017, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.48% (0.3703 => 0.3500, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.29% (0.9057 => 0.8578, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.27% (0.8831 => 0.8366, std.dev.: 0.0089) SingleSource/UnitTests/Vector/constpool: -5.18% (8.9859 => 8.5202, std.dev.: 0.1135) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.13% (0.2029 => 0.1925, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.12% (0.2128 => 0.2019, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists1: -5.09% (0.3220 => 0.3056, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.03% (0.9605 => 0.9122, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.01% (0.6363 => 0.6044, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.97% (0.9103 => 0.8651, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.87% (1.4373 => 1.3673, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.84% (0.2978 => 0.2834, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.83% (4.8081 => 4.5759, std.dev.: 0.0485) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.61% (0.8591 => 0.8195, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.56% (1.6545 => 1.5790, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.55% (2.3297 => 2.2238, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/08-main/main: -4.47% (0.2796 => 0.2671, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/wc: -4.33% (0.2330 => 0.2229, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -4.26% (0.6526 => 0.6248, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/lists: -4.15% (0.2697 => 0.2585, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -4.14% (1.0251 => 0.9827, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.11% (0.3409 => 0.3269, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.07% (0.8897 => 0.8535, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.04% (0.9186 => 0.8815, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.03% (0.8876 => 0.8518, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.92% (3.3966 => 3.2636, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.89% (5.6858 => 5.4647, std.dev.: 0.0083) MultiSource/Applications/spiff/spiff: -3.85% (0.8673 => 0.8339, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.84% (0.8338 => 0.8018, std.dev.: 0.0047) MultiSource/Applications/oggenc/oggenc: -3.81% (5.2389 => 5.0393, std.dev.: 0.0451) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.77% (0.8770 => 0.8439, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: -3.70% (15.8498 => 15.2640, std.dev.: 0.1054) SingleSource/Benchmarks/Shootout-C++/moments: -3.65% (0.3863 => 0.3722, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.61% (0.8439 => 0.8134, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/football/football: -3.60% (0.9284 => 0.8950, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.52% (0.6667 => 0.6432, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.34% (0.6745 => 0.6520, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.33% (0.3570 => 0.3451, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -3.22% (0.6372 => 0.6167, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.13% (0.8536 => 0.8269, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -2.90% (0.8624 => 0.8374, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -2.85% (9.0777 => 8.8188, std.dev.: 0.0843) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.84% (0.9075 => 0.8817, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/gs/gs: -2.84% (4.3989 => 4.2741, std.dev.: 0.0300) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.78% (0.9368 => 0.9108, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.75% (0.8958 => 0.8712, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -2.72% (0.9251 => 0.8999, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: -2.23% (17.9831 => 17.5821, std.dev.: 0.1202) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -2.22% (1.7351 => 1.6965, std.dev.: 0.0128) MultiSource/Applications/treecc/treecc: -2.22% (2.1209 => 2.0738, std.dev.: 0.0064) MultiSource/Applications/siod/siod: -2.17% (2.3331 => 2.2825, std.dev.: 0.0145) MultiSource/Applications/SPASS/SPASS: -2.15% (15.0631 => 14.7393, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -2.14% (0.8418 => 0.8238, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -2.04% (1.0288 => 1.0078, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.02% (0.9501 => 0.9309, std.dev.: 0.0044) MultiSource/Applications/JM/ldecod/ldecod: -2.02% (7.0372 => 6.8952, std.dev.: 0.0292) MultiSource/Applications/lemon/lemon: -1.99% (1.1334 => 1.1109, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.98% (13.8581 => 13.5844, std.dev.: 0.0692) MultiSource/Applications/JM/lencod/lencod: -1.90% (16.0328 => 15.7281, std.dev.: 0.0739) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.72% (4.7562 => 4.6746, std.dev.: 0.0169) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.59% (1.1743 => 1.1556, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -1.57% (0.6734 => 0.6628, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: -1.40% (8.9114 => 8.7869, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.17% (0.9320 => 0.9211, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.03% (4.6799 => 4.6317, std.dev.: 0.0117) MultiSource/Applications/d/make_dparser: -1.01% (3.3551 => 3.3212, std.dev.: 0.0089) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: -46.78% (0.0233 => 0.0124, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -42.08% (2.8932 => 1.6756, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -30.21% (0.0566 => 0.0395, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: -21.62% (1.9552 => 1.5324, std.dev.: 0.0552) SingleSource/Benchmarks/Misc-C++/stepanov_container: -20.77% (5.7325 => 4.5416, std.dev.: 0.0280) SingleSource/Benchmarks/Shootout-C++/heapsort: -19.43% (3.7979 => 3.0600, std.dev.: 0.1801) SingleSource/Benchmarks/Shootout-C++/ackermann: -15.97% (4.3844 => 3.6842, std.dev.: 0.2703) SingleSource/Benchmarks/Shootout-C++/hash: -11.12% (0.7017 => 0.6237, std.dev.: 0.0087) MultiSource/Benchmarks/Fhourstones/fhourstones: -9.32% (1.3743 => 1.2462, std.dev.: 0.0191) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -9.16% (0.2226 => 0.2022, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -9.00% (3.4417 => 3.1318, std.dev.: 0.0770) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -7.30% (0.1754 => 0.1626, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: -7.08% (0.1469 => 0.1365, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/ary3: -6.73% (2.2464 => 2.0953, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/ary3: -6.35% (2.1336 => 1.9981, std.dev.: 0.0102) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.88% (0.5370 => 0.5108, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: -4.09% (96.1238 => 92.1935, std.dev.: 0.0804) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.98% (42.6027 => 40.9070, std.dev.: 0.6547) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.37% (0.3501 => 0.3383, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/except: -3.16% (0.5066 => 0.4906, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.96% (2.6676 => 2.5887, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C++/primes/primes: -2.94% (0.9113 => 0.8845, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.90% (2.6263 => 2.5502, std.dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.92% (1.0339 => 1.0141, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.90% (3.5212 => 3.4542, std.dev.: 0.0217) SingleSource/Benchmarks/Shootout/hash: -1.83% (4.3427 => 4.2633, std.dev.: 0.0232) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.77% (2.5333 => 2.4884, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.65% (4.1341 => 4.0659, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.35% (5.0890 => 5.0202, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.22% (3.2404 => 3.2010, std.dev.: 0.0043) MultiSource/Applications/lua/lua: -1.19% (29.1501 => 28.8036, std.dev.: 0.0826) SingleSource/Benchmarks/Misc/mandel: -1.17% (1.4127 => 1.3962, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.15% (61.5780 => 60.8691, std.dev.: 0.2541) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.11% (5.4467 => 5.3861, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: -1.09% (4.5045 => 4.4554, std.dev.: 0.0168) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.05% (1.2590 => 1.2458, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-6: -1.03% (2.4711 => 2.4457, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.01% (4.9928 => 4.9422, std.dev.: 0.0114) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.95% (1.0752 => 1.0650, std.dev.: 0.0101) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -35.75% (0.0221 => 0.0142, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -10.90% (0.0431 => 0.0384, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 6.38% (0.0282 => 0.0300, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.63% (0.0315 => 0.0313, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.23% (0.0426 => 0.0408, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: -2.39% (0.0209 => 0.0204, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -9.22% (0.0217 => 0.0197, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -76.92% (0.0013 => 0.0003, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -2.09% (0.1528 => 0.1496, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: -6.61% (1.2527 => 1.1699, std.dev.: 0.0097) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.75% (0.4230 => 0.4156, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.54% (0.1425 => 0.1403, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -16.16% (0.0662 => 0.0555, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -16.91% (0.0278 => 0.0231, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 11.41% (0.0561 => 0.0625, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.17% (1.1998 => 1.1978, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: -0.11% (9.4494 => 9.4394, std.dev.: 0.0922) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -93.55% (0.0031 => 0.0002, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -19.23% (0.0026 => 0.0021, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.66% (0.0647 => 0.0591, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.90% (0.0261 => 0.0243, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.7768 => 0.7768, std.dev.: 0.0043) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 58.70% (0.0046 => 0.0073, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/SciMark2-C/scimark2: -66.97% (28.5821 => 9.4394, std.dev.: 0.0922) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 6.91% (16.4461 => 17.5821, std.dev.: 0.1202) MultiSource/Applications/sqlite3/sqlite3: 2310.61% (0.6332 => 15.2640, std.dev.: 0.1054) MultiSource/Benchmarks/McCat/08-main/main: 45.88% (0.1831 => 0.2671, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.12% (0.1559 => 0.1448, std.dev.: 0.0059) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7050.94% (0.3123 => 22.3324, std.dev.: 0.0648) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.87% (0.2463 => 0.3716, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1534.18% (0.3344 => 5.4647, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.28% (0.2364 => 0.3269, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 3.96% (0.6010 => 0.6248, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel: 1.86% (0.0429 => 0.0437, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.66% (0.3266 => 0.3451, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.06% (0.1969 => 0.2049, std.dev.: 0.0017) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.93% (0.0224 => 0.0244, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -25.65% (0.0230 => 0.0171, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0476, std.dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 6.22% (0.1462 => 0.1553, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4554, std.dev.: 0.0168) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0746, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4951, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5108, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5324, std.dev.: 0.0552) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3134, std.dev.: 0.0242) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1380, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3627, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3962, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0839, std.dev.: 0.0018) SingleSource/Regression/C/uint64_to_float: -23.79% (2.1832 => 1.6638, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.65% (0.0810 => 0.0953, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.10% (0.0830 => 0.0947, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.21% (0.0848 => 0.0960, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/tsp/tsp: 13.13% (0.1112 => 0.1258, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.69% (0.2279 => 0.2477, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.49% (0.6010 => 0.6520, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.14% (0.1425 => 0.1541, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.05% (0.4847 => 0.5237, std.dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.84% (0.3137 => 0.3383, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.71% (0.2180 => 0.2348, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.57% (0.1466 => 0.1577, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.29% (0.7473 => 0.8018, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.22% (0.3295 => 0.3500, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.17% (0.8148 => 0.8651, std.dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.98% (0.1905 => 0.2019, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.92% (0.2519 => 0.2668, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.49% (0.3003 => 0.3168, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.42% (0.6287 => 0.6628, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.29% (1.1606 => 1.2220, std.dev.: 0.0128) MultiSource/Applications/spiff/spiff: 4.89% (0.7950 => 0.8339, std.dev.: 0.0084) MultiSource/Applications/Burg/burg: 4.72% (1.2222 => 1.2799, std.dev.: 0.0077) MultiSource/Applications/hbd/hbd: 4.55% (1.4269 => 1.4918, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.15% (0.9435 => 0.9827, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.12% (4.1763 => 4.3485, std.dev.: 0.0079) MultiSource/Applications/treecc/treecc: 3.96% (1.9948 => 2.0738, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.91% (2.1401 => 2.2238, std.dev.: 0.0044) MultiSource/Applications/lua/lua: 3.91% (3.8189 => 3.9681, std.dev.: 0.0502) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.90% (0.5817 => 0.6044, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.88% (0.4127 => 0.4287, std.dev.: 0.0052) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.68% (6.6074 => 6.8506, std.dev.: 0.0139) MultiSource/Applications/hexxagon/hexxagon: 3.68% (0.9810 => 1.0171, std.dev.: 0.0073) MultiSource/Benchmarks/nbench/nbench: 3.67% (1.1271 => 1.1685, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.63% (0.3717 => 0.3852, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.53% (1.6386 => 1.6965, std.dev.: 0.0128) MultiSource/Applications/minisat/minisat: 3.51% (0.6834 => 0.7074, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 3.48% (4.1305 => 4.2741, std.dev.: 0.0300) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.47% (0.4783 => 0.4949, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.46% (1.2526 => 1.2959, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.46% (0.5961 => 0.6167, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.46% (1.1170 => 1.1556, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.36% (14.2605 => 14.7393, std.dev.: 0.0211) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.29% (0.6227 => 0.6432, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.25% (1.4479 => 1.4950, std.dev.: 0.0039) MultiSource/Applications/ClamAV/clamscan: 3.25% (14.7684 => 15.2484, std.dev.: 0.0387) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.22% (4.4873 => 4.6317, std.dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.10% (1.5315 => 1.5790, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.06% (13.1811 => 13.5844, std.dev.: 0.0692) MultiSource/Applications/siod/siod: 2.89% (2.2184 => 2.2825, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.87% (0.8007 => 0.8237, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.85% (0.8340 => 0.8578, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 2.79% (31.8598 => 32.7474, std.dev.: 0.0702) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.69% (0.8611 => 0.8843, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.65% (0.9069 => 0.9309, std.dev.: 0.0030) MultiSource/Applications/d/make_dparser: 2.61% (3.2366 => 3.3212, std.dev.: 0.0089) MultiSource/Applications/JM/lencod/lencod: 2.61% (15.3280 => 15.7281, std.dev.: 0.0739) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.60% (0.8457 => 0.8677, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.59% (0.9074 => 0.9309, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/05-eks/eks: 2.57% (0.4397 => 0.4510, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.55% (0.7932 => 0.8134, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.53% (3.1832 => 3.2636, std.dev.: 0.0151) MultiSource/Applications/SIBsim4/SIBsim4: 2.51% (1.2568 => 1.2883, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.50% (0.8050 => 0.8251, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.47% (0.8286 => 0.8491, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.46% (0.6586 => 0.6748, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.46% (0.8338 => 0.8543, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.46% (0.4559 => 0.4671, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: 2.45% (2.3764 => 2.4346, std.dev.: 0.0132) MultiSource/Applications/JM/ldecod/ldecod: 2.42% (6.7320 => 6.8952, std.dev.: 0.0292) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.42% (0.8317 => 0.8518, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.41% (0.8177 => 0.8374, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.29% (0.8331 => 0.8522, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.28% (4.5702 => 4.6746, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.28% (0.8518 => 0.8712, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.26% (0.8086 => 0.8269, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.22% (0.8316 => 0.8501, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.20% (0.8805 => 0.8999, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.15% (0.8261 => 0.8439, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.15% (0.8885 => 0.9076, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.13% (0.7966 => 0.8136, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.13% (0.8066 => 0.8238, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.11% (0.8359 => 0.8535, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.07% (0.8855 => 0.9038, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.03% (0.8927 => 0.9108, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.97% (0.8697 => 0.8868, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.95% (0.8069 => 0.8226, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.90% (0.9039 => 0.9211, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 1.88% (8.6247 => 8.7869, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.72% (0.9908 => 1.0078, std.dev.: 0.0038) MultiSource/Applications/lemon/lemon: 1.50% (1.0945 => 1.1109, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 104.02% (0.0199 => 0.0406, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/pi: 57.14% (1.5795 => 2.4821, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.43% (0.7597 => 0.8845, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.10% (2.9753 => 3.4542, std.dev.: 0.0217) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.34% (2.7995 => 3.2010, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.39% (5.0261 => 5.5986, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.01% (1.1857 => 1.2807, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 7.45% (1.7056 => 1.8326, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/strcat: 7.02% (0.1538 => 0.1646, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.70% (4.7794 => 5.0998, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.18% (0.3186 => 0.3383, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/richards_benchmark: 6.07% (1.3037 => 1.3828, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.87% (4.9686 => 5.2604, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.86% (4.5327 => 4.7981, std.dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 5.72% (3.1873 => 3.3695, std.dev.: 0.0264) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.82% (2.2485 => 2.3569, std.dev.: 0.0122) MultiSource/Applications/lambda-0_1_3/lambda: 4.68% (7.4933 => 7.8441, std.dev.: 0.0378) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.55% (3.3761 => 3.5297, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.49% (6.2275 => 6.5074, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.11% (4.9453 => 5.1487, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 4.07% (14.0064 => 14.5768, std.dev.: 0.1099) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.06% (1.2337 => 1.2838, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/treeadd/treeadd: 4.01% (0.3587 => 0.3731, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.97% (4.9469 => 5.1434, std.dev.: 0.0022) MultiSource/Applications/siod/siod: 2.97% (3.6643 => 3.7732, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.83% (11.5690 => 11.8964, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.71% (59.2638 => 60.8691, std.dev.: 0.2541) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.51% (8.2783 => 8.4861, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.25% (4.8660 => 4.9755, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.19% (4.8362 => 4.9422, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout/lists: 2.18% (7.3375 => 7.4971, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 1.99% (0.5889 => 0.6006, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.58% (1.1365 => 1.1545, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.54% (1.5941 => 1.6187, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/power/power: 1.46% (1.2061 => 1.2237, std.dev.: 0.0018) SingleSource/Benchmarks/Stanford/FloatMM: 1.14% (0.8807 => 0.8907, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/ReedSolomon: 1.13% (8.5322 => 8.6283, std.dev.: 0.0341) MultiSource/Benchmarks/FreeBench/neural/neural: 1.01% (1.0841 => 1.0951, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.12% (2.8951 => 1.6756, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -33.14% (0.0338 => 0.0226, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/em3d/em3d: -21.09% (5.4641 => 4.3117, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.47% (7.2130 => 6.1692, std.dev.: 0.2487) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.86% (1.0512 => 0.9370, std.dev.: 0.0299) SingleSource/Benchmarks/McGill/chomp: -10.78% (1.1216 => 1.0007, std.dev.: 0.0129) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -10.58% (14.6451 => 13.0962, std.dev.: 0.2290) MultiSource/Benchmarks/mafft/pairlocalalign: -8.54% (63.1822 => 57.7837, std.dev.: 0.0297) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.62% (0.3269 => 0.3020, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.88% (4.7482 => 4.4214, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.22% (3.7148 => 3.4839, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.88% (5.4972 => 5.1741, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.13% (5.1557 => 4.8910, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.48% (2.8773 => 2.7484, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.38% (4.7449 => 4.5373, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.80% (6.0224 => 5.7936, std.dev.: 0.0104) MultiSource/Applications/lua/lua: -3.45% (29.8330 => 28.8036, std.dev.: 0.0826) MultiSource/Benchmarks/Prolangs-C++/life/life: -3.24% (2.6356 => 2.5502, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.24% (0.5807 => 0.5619, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: -2.71% (0.6636 => 0.6456, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.47% (2.4490 => 2.3884, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.46% (9.9065 => 9.6625, std.dev.: 0.0569) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.38% (1.0388 => 1.0141, std.dev.: 0.0032) MultiSource/Applications/aha/aha: -2.36% (3.3398 => 3.2610, std.dev.: 0.0282) SingleSource/Benchmarks/Shootout-C++/hash2: -2.28% (3.4237 => 3.3456, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.01% (11.5316 => 11.3002, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.65% (4.9994 => 4.9171, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.54% (3.2169 => 3.1675, std.dev.: 0.0089) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.3487 => 2.3183, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.29% (5.6343 => 5.5617, std.dev.: 0.0175) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.78% (1.0262 => 1.0650, std.dev.: 0.0101) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 15.45% (0.0123 => 0.0142, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.88% (0.0408 => 0.0384, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 18.11% (0.0254 => 0.0300, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 6.25% (0.0384 => 0.0408, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 9.44% (0.0180 => 0.0197, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -57.14% (0.0007 => 0.0003, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 4.03% (0.1438 => 0.1496, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 3.27% (1.1329 => 1.1699, std.dev.: 0.0097) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.19% (0.4164 => 0.4156, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.48% (0.1369 => 0.1403, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -13.42% (0.0641 => 0.0555, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 18.46% (0.0195 => 0.0231, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.13% (0.0578 => 0.0625, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.73% (1.1437 => 1.1978, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0001 => 0.0002, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0014 => 0.0021, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.74% (0.0627 => 0.0591, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 35.00% (0.0180 => 0.0243, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.11% (0.8017 => 0.7768, std.dev.: 0.0043) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 17.74% (0.0062 => 0.0073, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 21:57:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 26 Nov 2012 23:57:16 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121127055716.6D2962A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6292?compare_to=6290&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6292, Order: 168675, Start Time: 2012-11-27 04:25:21, End Time: 2012-11-27 05:57:48 To: 6290, Order: 168669, Start Time: 2012-11-27 02:30:15, End Time: 2012-11-27 04:02:25 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (182 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (855 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 18.21% (0.3834 => 0.4532, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.04% (2.0478 => 2.1100, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: 2.55% (7.4937 => 7.6846, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/hash2: 2.22% (3.1932 => 3.2641, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.19% (0.3821 => 0.3508, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.07% (0.3142 => 0.2920, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -6.92% (2.4924 => 2.3200, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.83% (0.9542 => 0.8890, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.55% (0.3357 => 0.3137, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.43% (0.2428 => 0.2272, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.32% (0.7198 => 0.6743, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.28% (0.9852 => 0.9233, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: -6.17% (0.1879 => 0.1763, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.09% (9.2283 => 8.6660, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.07% (0.1796 => 0.1687, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.03% (0.2355 => 0.2213, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -5.93% (0.3812 => 0.3586, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.90% (0.5863 => 0.5517, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -5.90% (0.3848 => 0.3621, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: -5.89% (0.9179 => 0.8638, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: -5.88% (16.1920 => 15.2398, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/exceptions-2: -5.87% (0.3831 => 0.3606, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.86% (0.5478 => 0.5157, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: -5.85% (0.3896 => 0.3668, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.85% (0.3880 => 0.3653, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -5.82% (7.0961 => 6.6829, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.82% (0.3658 => 0.3445, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.81% (0.5591 => 0.5266, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.81% (0.5802 => 0.5465, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.77% (1.3722 => 1.2930, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.77% (0.5805 => 0.5470, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.77% (0.5857 => 0.5519, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.74% (0.6484 => 0.6112, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.71% (4.0323 => 3.8019, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/for-in: -5.70% (0.4033 => 0.3803, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.69% (0.5925 => 0.5588, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.68% (4.8161 => 4.5426, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.68% (0.2695 => 0.2542, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.67% (1.0544 => 0.9946, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.66% (0.6660 => 0.6283, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.65% (0.3891 => 0.3671, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.65% (0.6304 => 0.5948, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.64% (0.5705 => 0.5383, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.64% (0.5581 => 0.5266, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/exceptions: -5.63% (0.4176 => 0.3941, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.58% (0.6052 => 0.5714, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.57% (0.5849 => 0.5523, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.57% (0.6446 => 0.6087, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.56% (0.5859 => 0.5533, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.56% (4.8802 => 4.6089, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: -5.54% (1.1530 => 1.0891, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.53% (0.6260 => 0.5914, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.53% (3.5339 => 3.3386, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.53% (0.6297 => 0.5949, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -5.52% (1.1450 => 1.0818, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.51% (0.6681 => 0.6313, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.51% (0.6230 => 0.5887, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.50% (0.6667 => 0.6300, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.50% (1.2300 => 1.1623, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.49% (0.5570 => 0.5264, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.47% (0.6194 => 0.5855, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.47% (0.5688 => 0.5377, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: -5.46% (0.2160 => 0.2042, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.45% (0.5941 => 0.5617, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.44% (1.6364 => 1.5474, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.43% (1.2784 => 1.2090, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.41% (0.6189 => 0.5854, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.39% (4.5069 => 4.2641, std.dev.: 0.0097) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.38% (6.7716 => 6.4076, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.37% (0.5456 => 0.5163, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.36% (0.5575 => 0.5276, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.33% (0.3884 => 0.3677, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.31% (0.4199 => 0.3976, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.31% (0.6440 => 0.6098, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: -5.31% (4.3330 => 4.1030, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.30% (0.7919 => 0.7499, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -5.30% (17.1032 => 16.1962, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.29% (1.4642 => 1.3867, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.29% (0.6293 => 0.5960, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.29% (0.6676 => 0.6323, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.29% (0.6033 => 0.5714, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.29% (1.2221 => 1.1575, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.28% (0.3406 => 0.3226, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.27% (1.2210 => 1.1566, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.27% (0.8521 => 0.8072, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.27% (14.2083 => 13.4597, std.dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.6736 => 0.6382, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: -5.18% (0.4515 => 0.4281, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.13% (0.5999 => 0.5691, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.13% (0.2985 => 0.2832, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: -5.11% (1.3864 => 1.3156, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.09% (0.2278 => 0.2162, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.02% (8.0126 => 7.6105, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.01% (0.3931 => 0.3734, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.97% (0.5168 => 0.4911, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.97% (0.3483 => 0.3310, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -4.96% (0.2659 => 0.2527, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.96% (0.4916 => 0.4672, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.96% (0.4151 => 0.3945, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -4.95% (0.4280 => 0.4068, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.95% (0.2548 => 0.2422, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -4.92% (15.5079 => 14.7444, std.dev.: 0.0150) MultiSource/Applications/d/make_dparser: -4.91% (3.5154 => 3.3428, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.84% (0.3016 => 0.2870, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.82% (0.7339 => 0.6985, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: -4.82% (0.3255 => 0.3098, std.dev.: 0.0007) MultiSource/Applications/lua/lua: -4.81% (4.0594 => 3.8640, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.81% (0.3057 => 0.2910, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -4.81% (0.2871 => 0.2733, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -4.80% (0.3581 => 0.3409, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.80% (0.2999 => 0.2855, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.78% (0.7447 => 0.7091, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.77% (0.3837 => 0.3654, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/random: -4.76% (0.2939 => 0.2799, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -4.76% (1.2515 => 1.1919, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.76% (0.5569 => 0.5304, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.75% (0.2903 => 0.2765, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.73% (2.1713 => 2.0686, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.71% (0.2933 => 0.2795, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.70% (0.7524 => 0.7170, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -4.70% (0.3194 => 0.3044, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -4.67% (15.2527 => 14.5400, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/except: -4.66% (0.3026 => 0.2885, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.65% (0.3205 => 0.3056, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -4.62% (1.3148 => 1.2541, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.60% (0.3323 => 0.3170, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.59% (0.7021 => 0.6699, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.57% (0.6395 => 0.6103, std.dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference: -4.56% (0.7779 => 0.7424, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.56% (0.5567 => 0.5313, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -4.55% (5.0226 => 4.7940, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/moments: -4.54% (0.4248 => 0.4055, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.53% (1.6474 => 1.5728, std.dev.: 0.0118) SingleSource/UnitTests/ObjC++/Hello: -4.52% (0.6347 => 0.6060, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.52% (0.3252 => 0.3105, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -4.51% (0.3481 => 0.3324, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.49% (0.3849 => 0.3676, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -4.45% (0.3059 => 0.2923, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -4.44% (0.4861 => 0.4645, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.43% (22.4056 => 21.4127, std.dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.42% (0.4321 => 0.4130, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: -4.40% (2.1401 => 2.0460, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -4.39% (2.4021 => 2.2966, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.37% (0.5329 => 0.5096, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -4.36% (0.6441 => 0.6160, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.32% (0.3867 => 0.3700, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -4.28% (0.3621 => 0.3466, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary3: -4.27% (0.3446 => 0.3299, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.26% (0.4813 => 0.4608, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.22% (0.9557 => 0.9154, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -4.21% (0.3394 => 0.3251, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -4.18% (0.4524 => 0.4335, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: -4.17% (0.7982 => 0.7649, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.16% (0.3319 => 0.3181, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.12% (0.8418 => 0.8071, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: -4.12% (0.2989 => 0.2866, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -4.08% (34.0927 => 32.7032, std.dev.: 0.0120) MultiSource/Benchmarks/McCat/09-vor/vor: -4.07% (0.3271 => 0.3138, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.02% (0.4083 => 0.3919, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.00% (0.4427 => 0.4250, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.88% (2.2587 => 2.1710, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: -3.87% (18.2933 => 17.5862, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/sieve: -3.83% (0.3788 => 0.3643, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.81% (0.3491 => 0.3358, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -3.72% (0.6750 => 0.6499, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.67% (0.9077 => 0.8744, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: -3.38% (1.5610 => 1.5083, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.00% (5.4682 => 5.3043, std.dev.: 0.0052) SingleSource/UnitTests/Vector/constpool: -2.89% (20.7746 => 20.1744, std.dev.: 0.0327) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1955, std.dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: -62.43% (1.8100 => 0.6800, std.dev.: 0.0169) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7555, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1723, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7070, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.83% (2.2633 => 2.1766, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.03% (1.0557 => 1.0237, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.86% (1.3096 => 1.2722, std.dev.: 0.0090) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.61% (6.5735 => 6.4678, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 22:04:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 00:04:30 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121127060430.790A62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6293?compare_to=6288&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6293, Order: 168673, Start Time: 2012-11-27 03:46:41, End Time: 2012-11-27 06:05:00 To: 6288, Order: 168633, Start Time: 2012-11-27 00:38:23, End Time: 2012-11-27 02:56:04 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 85 (193 on baseline) Performance Improvements: 3 (44 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 998 (648 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/lambda-0_1_3/lambda: 13.74% (0.8604 => 0.9786, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: 12.27% (0.3145 => 0.3531, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 11.30% (0.0965 => 0.1074, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 10.94% (0.3740 => 0.4149, std.dev.: 0.0034) MultiSource/Applications/lua/lua: 10.33% (4.4467 => 4.9061, std.dev.: 0.0483) SingleSource/Benchmarks/Shootout-C++/moments: 10.27% (0.4500 => 0.4962, std.dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: 10.19% (6.5987 => 7.2711, std.dev.: 0.0362) MultiSource/Benchmarks/Olden/em3d/em3d: 10.11% (0.1979 => 0.2179, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.04% (6.1297 => 6.7452, std.dev.: 0.0855) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.94% (0.3610 => 0.3969, std.dev.: 0.0009) SingleSource/Benchmarks/LivermoreLoops/kernel19: 9.57% (0.1045 => 0.1145, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.56% (0.1214 => 0.1330, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/trivial-interface: 9.28% (0.3890 => 0.4251, std.dev.: 0.0086) SingleSource/Benchmarks/LivermoreLoops/kernel21: 9.21% (0.1118 => 0.1221, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 9.12% (0.6483 => 0.7074, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference-object: 8.99% (0.6609 => 0.7203, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 8.86% (0.7995 => 0.8703, std.dev.: 0.0267) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.83% (4.4063 => 4.7953, std.dev.: 0.0582) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.44% (0.3140 => 0.3405, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.28% (0.6724 => 0.7281, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.92% (0.3032 => 0.3272, std.dev.: 0.0076) MultiSource/Applications/lemon/lemon: 7.79% (1.3101 => 1.4122, std.dev.: 0.0134) MultiSource/Benchmarks/FreeBench/distray/distray: 7.48% (0.1537 => 0.1652, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.46% (0.5080 => 0.5459, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/random: 7.45% (0.3047 => 0.3274, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/objinst: 7.37% (0.3350 => 0.3597, std.dev.: 0.0088) MultiSource/Applications/Burg/burg: 7.05% (1.3442 => 1.4390, std.dev.: 0.0245) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.87% (1.2381 => 1.3232, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/lists: 6.87% (0.3816 => 0.4078, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.69% (0.2600 => 0.2774, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.67% (0.1694 => 0.1807, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.38% (0.4485 => 0.4771, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.33% (0.2908 => 0.3092, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/exceptions: 5.83% (0.4459 => 0.4719, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.56% (10.7979 => 11.3983, std.dev.: 0.1242) MultiSource/Applications/treecc/treecc: 5.39% (2.4735 => 2.6067, std.dev.: 0.0092) MultiSource/Applications/hbd/hbd: 5.33% (1.7396 => 1.8323, std.dev.: 0.0339) MultiSource/Applications/SIBsim4/SIBsim4: 5.25% (1.6701 => 1.7578, std.dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/methcall: 5.14% (0.3366 => 0.3539, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/except: 4.74% (0.3375 => 0.3535, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/09-vor/vor: 4.62% (0.3832 => 0.4009, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.50% (0.5509 => 0.5757, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/fibo: 4.37% (0.3184 => 0.3323, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 4.36% (0.5529 => 0.5770, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: 4.27% (0.4097 => 0.4272, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/property: 4.20% (0.4597 => 0.4790, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.12% (0.8236 => 0.8575, std.dev.: 0.0073) SingleSource/UnitTests/ObjC/for-in: 4.03% (0.4321 => 0.4495, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/18-imp/imp: 3.86% (0.4173 => 0.4334, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 3.84% (0.4172 => 0.4332, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-4: 3.80% (0.4153 => 0.4311, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: 3.79% (0.3617 => 0.3754, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-3: 3.54% (0.4119 => 0.4265, std.dev.: 0.0056) MultiSource/Applications/ClamAV/clamscan: 2.11% (37.1087 => 37.8933, std.dev.: 0.1858) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: 123.38% (0.1048 => 0.2341, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 37.74% (0.3439 => 0.4737, std.dev.: 0.0041) MultiSource/Applications/minisat/minisat: 19.90% (10.2969 => 12.3464, std.dev.: 0.2026) SingleSource/Benchmarks/Shootout/ary3: 16.08% (3.7699 => 4.3761, std.dev.: 0.1610) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 14.09% (5.3748 => 6.1320, std.dev.: 0.0232) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 14.03% (6.3230 => 7.2102, std.dev.: 0.1240) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.71% (6.7274 => 7.6495, std.dev.: 0.0180) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.32% (11.0179 => 12.3757, std.dev.: 0.2290) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.02% (2.2960 => 2.5719, std.dev.: 0.1061) SingleSource/Benchmarks/Shootout-C++/ary3: 9.36% (4.2280 => 4.6237, std.dev.: 0.1461) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.04% (1.4906 => 1.6105, std.dev.: 0.0262) SingleSource/Benchmarks/Misc/ffbench: 7.37% (0.9936 => 1.0668, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 7.19% (1.4580 => 1.5629, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 6.20% (0.3514 => 0.3732, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 5.09% (6.1628 => 6.4767, std.dev.: 0.0311) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 5.04% (5.3851 => 5.6563, std.dev.: 0.0479) SingleSource/Benchmarks/BenchmarkGame/puzzle: 4.75% (0.7411 => 0.7763, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/bh/bh: 4.62% (1.9994 => 2.0918, std.dev.: 0.0154) SingleSource/Benchmarks/CoyoteBench/huffbench: 4.50% (18.6725 => 19.5122, std.dev.: 0.0930) SingleSource/Benchmarks/Shootout-C++/hash2: 4.48% (3.4895 => 3.6459, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.30% (9.9613 => 10.3897, std.dev.: 0.0410) SingleSource/Benchmarks/Shootout-C++/hash: 3.70% (0.7767 => 0.8054, std.dev.: 0.0109) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.15% (1.6049 => 1.6554, std.dev.: 0.0127) MultiSource/Benchmarks/Olden/em3d/em3d: 3.08% (3.1097 => 3.2056, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.75% (1.5539 => 1.5966, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.58% (3.7312 => 3.8275, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.28% (59.7067 => 61.0688, std.dev.: 0.0245) MultiSource/Applications/SIBsim4/SIBsim4: 2.21% (3.8627 => 3.9480, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.72% (1.8868 => 1.9193, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.45% (27.1123 => 27.5056, std.dev.: 0.0284) MultiSource/Applications/sqlite3/sqlite3: 1.41% (4.7251 => 4.7919, std.dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/d/make_dparser: -10.15% (4.2060 => 3.7791, std.dev.: 0.1329) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/JM/lencod/lencod: -5.37% (7.9914 => 7.5620, std.dev.: 0.1468) SingleSource/Benchmarks/Dhrystone/fldry: -5.12% (0.7047 => 0.6686, std.dev.: 0.0096) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.81% (70.3509 => 69.7803, std.dev.: 0.0655) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 1.12% (0.1338 => 0.1353, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -7.19% (0.0459 => 0.0426, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.31% (0.0649 => 0.0651, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: 0.03% (493.8625 => 494.0168, std.dev.: 0.2211) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 10.34% (63.2438 => 69.7803, std.dev.: 0.0655) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.03% (4.3882 => 0.0426, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43707.47% (1.1277 => 494.0168, std.dev.: 0.2211) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 236.16% (0.5229 => 1.7578, std.dev.: 0.0190) MultiSource/Applications/SPASS/SPASS: 20.18% (14.9895 => 18.0138, std.dev.: 0.2407) MultiSource/Applications/kimwitu++/kc: 46.91% (14.1553 => 20.7953, std.dev.: 0.2210) MultiSource/Benchmarks/MallocBench/gs/gs: 15.66% (4.1105 => 4.7543, std.dev.: 0.2772) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.97% (1.1048 => 1.5132, std.dev.: 0.0675) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 432.43% (7.1582 => 38.1124, std.dev.: 0.3512) SingleSource/Benchmarks/Misc-C++-EH/spirit: 94.78% (3.4629 => 6.7452, std.dev.: 0.0855) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.10% (0.6222 => 1.0335, std.dev.: 0.0710) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10402.78% (0.0720 => 7.5620, std.dev.: 0.1468) MultiSource/Applications/SIBsim4/SIBsim4: 3947900.00% (0.0001 => 3.9480, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 14353400.00% (0.0001 => 14.3535, std.dev.: 0.9880) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576400.00% (0.0001 => 0.5765, std.dev.: 0.0197) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10070100.00% (0.0001 => 10.0702, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7649400.00% (0.0001 => 7.6495, std.dev.: 0.0180) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1723.32% (1.1194 => 20.4102, std.dev.: 0.7413) MultiSource/Applications/ClamAV/clamscan: 70.88% (22.1758 => 37.8933, std.dev.: 0.1858) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 61.59% (7.0540 => 11.3983, std.dev.: 0.1242) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.19% (2.9384 => 4.6190, std.dev.: 0.3007) MultiSource/Benchmarks/FreeBench/distray/distray: 56.44% (0.1056 => 0.1652, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 49.59% (0.0730 => 0.1092, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.53% (8.1363 => 12.1666, std.dev.: 0.3063) MultiSource/Applications/JM/lencod/lencod: 48.09% (21.9371 => 32.4858, std.dev.: 0.0934) MultiSource/Benchmarks/McCat/08-main/main: 38.25% (0.2554 => 0.3531, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 37.43% (0.1432 => 0.1968, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 35.44% (0.0793 => 0.1074, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 34.99% (0.0746 => 0.1007, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/messages-2: 34.14% (0.0662 => 0.0888, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/15-trie/trie: 32.26% (0.0527 => 0.0697, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 31.71% (1.0722 => 1.4122, std.dev.: 0.0134) MultiSource/Applications/lambda-0_1_3/lambda: 31.66% (0.7433 => 0.9786, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/puzzle: 31.13% (0.0408 => 0.0535, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 31.12% (0.0842 => 0.1104, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/17-bintr/bintr: 30.52% (0.0675 => 0.0881, std.dev.: 0.0023) SingleSource/UnitTests/vla: 30.14% (0.0355 => 0.0462, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 28.58% (2.0273 => 2.6067, std.dev.: 0.0092) MultiSource/Benchmarks/Olden/em3d/em3d: 28.55% (0.1695 => 0.2179, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.46% (0.6675 => 0.8575, std.dev.: 0.0073) SingleSource/UnitTests/ObjC/dot-syntax: 28.17% (0.0355 => 0.0455, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.17% (0.3121 => 0.3969, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/matrix: 26.89% (0.0818 => 0.1038, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 26.70% (3.8723 => 4.9061, std.dev.: 0.0483) MultiSource/Benchmarks/McCat/18-imp/imp: 26.61% (0.3423 => 0.4334, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 26.38% (0.1175 => 0.1485, std.dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: 26.25% (5.7591 => 7.2711, std.dev.: 0.0362) MultiSource/Benchmarks/McCat/09-vor/vor: 26.07% (0.3180 => 0.4009, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: 25.72% (0.4289 => 0.5392, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 25.66% (0.1695 => 0.2130, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/functionobjects: 25.60% (0.5020 => 0.6305, std.dev.: 0.0237) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.47% (0.0479 => 0.0601, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.40% (0.0886 => 0.1111, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.24% (0.1062 => 0.1330, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: 24.89% (0.4620 => 0.5770, std.dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: 24.74% (0.0481 => 0.0600, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 24.66% (0.0442 => 0.0551, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 24.42% (0.1163 => 0.1447, std.dev.: 0.0022) MultiSource/Applications/aha/aha: 24.33% (0.1151 => 0.1431, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bisort/bisort: 24.27% (0.0614 => 0.0763, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 24.18% (0.4636 => 0.5757, std.dev.: 0.0083) SingleSource/Benchmarks/Stanford/Oscar: 23.74% (0.0636 => 0.0787, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.62% (0.1029 => 0.1272, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 23.60% (1.1642 => 1.4390, std.dev.: 0.0245) SingleSource/UnitTests/ObjC/exceptions: 23.28% (0.3828 => 0.4719, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/property: 23.26% (0.3886 => 0.4790, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 23.20% (3.8922 => 4.7953, std.dev.: 0.0582) SingleSource/Benchmarks/Shootout-C++/except: 23.13% (0.2871 => 0.3535, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: 23.01% (0.2877 => 0.3539, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/lpbench: 22.82% (0.0929 => 0.1141, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 22.58% (0.4048 => 0.4962, std.dev.: 0.0031) MultiSource/Benchmarks/sim/sim: 22.50% (0.3387 => 0.4149, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/parameter-passing: 22.46% (0.3927 => 0.4809, std.dev.: 0.0128) SingleSource/UnitTests/ObjC/trivial-interface: 22.40% (0.3473 => 0.4251, std.dev.: 0.0086) SingleSource/UnitTests/ObjC/exceptions-2: 22.16% (0.3497 => 0.4272, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.15% (0.2271 => 0.2774, std.dev.: 0.0051) MultiSource/Benchmarks/BitBench/five11/five11: 22.05% (0.0567 => 0.0692, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/instance-method-metadata: 22.04% (0.3543 => 0.4324, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/fibo: 21.94% (0.2725 => 0.3323, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: 21.68% (0.3694 => 0.4495, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-4: 21.68% (0.3543 => 0.4311, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/synchronized: 21.65% (0.3561 => 0.4332, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: 21.41% (0.3092 => 0.3754, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-3: 21.30% (0.3516 => 0.4265, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.21% (0.2107 => 0.2554, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/fbench: 21.11% (0.0592 => 0.0717, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 20.94% (0.4299 => 0.5199, std.dev.: 0.0095) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.71% (0.1584 => 0.1912, std.dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 20.29% (0.0838 => 0.1008, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 20.02% (0.0834 => 0.1001, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.56% (0.2700 => 0.3228, std.dev.: 0.0108) SingleSource/UnitTests/ObjC++/property-reference-object: 19.45% (0.6030 => 0.7203, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/whetstone: 19.39% (0.0660 => 0.0788, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 19.39% (0.5925 => 0.7074, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ReedSolomon: 19.23% (0.2049 => 0.2443, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.20% (0.1125 => 0.1341, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/lists: 19.17% (0.3422 => 0.4078, std.dev.: 0.0058) SingleSource/UnitTests/ObjC++/property-reference: 18.80% (0.7326 => 0.8703, std.dev.: 0.0267) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 18.79% (0.2603 => 0.3092, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.56% (0.2872 => 0.3405, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.18% (14.3668 => 16.9786, std.dev.: 0.1893) MultiSource/Benchmarks/mafft/pairlocalalign: 17.44% (9.4845 => 11.1388, std.dev.: 0.2846) MultiSource/Applications/hbd/hbd: 17.43% (1.5603 => 1.8323, std.dev.: 0.0339) SingleSource/Benchmarks/Misc-C++/Large/ray: 17.40% (0.4064 => 0.4771, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.34% (0.9765 => 1.1458, std.dev.: 0.0424) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.22% (0.0871 => 0.1021, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.15% (0.2793 => 0.3272, std.dev.: 0.0076) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.00% (0.8172 => 0.9561, std.dev.: 0.0390) SingleSource/Benchmarks/Shootout-C++/random: 16.85% (0.2802 => 0.3274, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.81% (0.1892 => 0.2210, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/neural/neural: 16.54% (0.1463 => 0.1705, std.dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.37% (0.0953 => 0.1109, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.36% (0.0648 => 0.0754, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/bmm/bmm: 16.34% (0.0759 => 0.0883, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.13% (0.2065 => 0.2398, std.dev.: 0.0113) MultiSource/Benchmarks/Olden/health/health: 16.01% (0.1268 => 0.1471, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.97% (0.0770 => 0.0893, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.40% (0.1117 => 0.1289, std.dev.: 0.0024) MultiSource/Applications/viterbi/viterbi: 15.37% (0.1555 => 0.1794, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.32% (0.0770 => 0.0888, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.31% (0.1940 => 0.2237, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.19% (0.2758 => 0.3177, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/objinst: 14.88% (0.3131 => 0.3597, std.dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.65% (0.4615 => 0.5291, std.dev.: 0.0227) SingleSource/Benchmarks/Misc/ffbench: 14.61% (0.0705 => 0.0808, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.44% (0.1337 => 0.1530, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.41% (0.5981 => 0.6843, std.dev.: 0.0250) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.34% (0.1032 => 0.1180, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.20% (0.5569 => 0.6360, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.15% (0.3307 => 0.3775, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 14.05% (0.5105 => 0.5822, std.dev.: 0.0036) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.00% (0.1143 => 0.1303, std.dev.: 0.0032) MultiSource/Applications/sgefa/sgefa: 13.83% (0.3109 => 0.3539, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 13.62% (1.5859 => 1.8019, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 13.47% (2.2024 => 2.4991, std.dev.: 0.1058) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.38% (0.1906 => 0.2161, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.38% (0.1510 => 0.1712, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 13.30% (3.3354 => 3.7791, std.dev.: 0.1329) MultiSource/Applications/siod/siod: 13.27% (2.2969 => 2.6018, std.dev.: 0.0723) MultiSource/Applications/hexxagon/hexxagon: 13.25% (1.2842 => 1.4544, std.dev.: 0.0404) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.15% (4.2646 => 4.8256, std.dev.: 0.0894) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.14% (1.3050 => 1.4765, std.dev.: 0.0601) SingleSource/Benchmarks/Shootout-C++/hello: 13.08% (0.2714 => 0.3069, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/bigfib: 13.00% (0.6456 => 0.7295, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.63% (0.3865 => 0.4353, std.dev.: 0.0142) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.46% (0.8101 => 0.9110, std.dev.: 0.0306) MultiSource/Applications/sqlite3/sqlite3: 11.97% (17.1811 => 19.2373, std.dev.: 0.1015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.89% (0.4879 => 0.5459, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.75% (0.4203 => 0.4697, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.67% (5.0018 => 5.5857, std.dev.: 0.1872) SingleSource/Benchmarks/Shootout-C++/sieve: 11.21% (0.3603 => 0.4007, std.dev.: 0.0134) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.13% (1.1861 => 1.3181, std.dev.: 0.0280) SingleSource/Benchmarks/Stanford/Puzzle: 10.73% (0.1268 => 0.1404, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 10.08% (10.3673 => 11.4124, std.dev.: 0.2333) SingleSource/Benchmarks/Shootout-C++/strcat: 9.86% (0.2831 => 0.3110, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.75% (0.2891 => 0.3173, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.65% (0.2756 => 0.3022, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 9.51% (0.3282 => 0.3594, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.17% (0.3052 => 0.3332, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.11% (2.2022 => 2.4028, std.dev.: 0.0517) MultiSource/Benchmarks/Olden/power/power: 8.33% (0.1440 => 0.1560, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.63% (0.3935 => 0.4196, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.33% (4.3953 => 11.0028, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/methcall: 147.75% (5.3999 => 13.3782, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/17-bintr/bintr: 124.45% (0.1043 => 0.2341, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 45.49% (0.3256 => 0.4737, std.dev.: 0.0041) MultiSource/Applications/minisat/minisat: 35.44% (9.1159 => 12.3464, std.dev.: 0.2026) MultiSource/Benchmarks/McCat/09-vor/vor: 26.69% (0.1154 => 0.1462, std.dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/fftbench: 26.32% (2.0360 => 2.5719, std.dev.: 0.1061) SingleSource/Benchmarks/Shootout-C++/ary3: 24.22% (3.7221 => 4.6237, std.dev.: 0.1461) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 23.46% (1.3045 => 1.6105, std.dev.: 0.0262) SingleSource/Benchmarks/CoyoteBench/lpbench: 19.62% (10.3460 => 12.3757, std.dev.: 0.2290) SingleSource/Benchmarks/Shootout/ary3: 18.29% (3.6994 => 4.3761, std.dev.: 0.1610) SingleSource/Benchmarks/Misc/oourafft: 17.40% (6.6465 => 7.8033, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.85% (1.1145 => 1.3023, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 15.46% (3.1578 => 3.6459, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.18% (0.2944 => 0.3332, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/ffbench: 12.24% (0.9505 => 1.0668, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.68% (2.8904 => 3.2281, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/puzzle: 11.51% (0.6962 => 0.7763, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/richards_benchmark: 10.28% (1.1396 => 1.2568, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.28% (1.7254 => 1.8855, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 8.51% (1.0785 => 1.1703, std.dev.: 0.0336) MultiSource/Benchmarks/Olden/mst/mst: 8.33% (0.1285 => 0.1392, std.dev.: 0.0032) MultiSource/Applications/lemon/lemon: 8.08% (1.4460 => 1.5629, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash: 8.03% (0.7455 => 0.8054, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/bh/bh: 7.80% (1.9405 => 2.0918, std.dev.: 0.0154) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.44% (8.6802 => 9.3258, std.dev.: 0.2190) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.94% (0.9540 => 1.0107, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.55% (4.2280 => 4.4626, std.dev.: 0.0143) MultiSource/Applications/lua/lua: 5.42% (26.0924 => 27.5056, std.dev.: 0.0284) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.17% (3.6395 => 3.8275, std.dev.: 0.0104) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.6436 => 12.1227, std.dev.: 0.0056) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 3.33% (3.1023 => 3.2056, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 3.18% (4.6441 => 4.7919, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.64% (1.2838 => 1.3177, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.25% (1.7133 => 1.7519, std.dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.17% (1.3677 => 1.3974, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 2.04% (3.1595 => 3.2240, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 1.85% (85.0658 => 86.6382, std.dev.: 0.1245) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.45% (6.5088 => 6.6032, std.dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: 1.37% (27.8444 => 28.2271, std.dev.: 0.0313) SingleSource/Benchmarks/Shootout/sieve: 1.32% (5.2139 => 5.2825, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0313 => 1.0441, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0506, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 1.16% (5.2636 => 5.3245, std.dev.: 0.0023) MultiSource/Applications/spiff/spiff: 1.03% (2.9346 => 2.9648, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.30% (6.6874 => 0.1807, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -74.92% (5.2763 => 1.3232, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/salsa20: -74.22% (0.8651 => 0.2230, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -36.31% (0.1622 => 0.1033, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.76% (5.3855 => 4.6985, std.dev.: 0.1363) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -11.35% (0.1330 => 0.1179, std.dev.: 0.0049) MultiSource/Applications/JM/ldecod/ldecod: -10.24% (10.4361 => 9.3676, std.dev.: 0.2447) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.79% (5.3526 => 4.8823, std.dev.: 0.0961) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -68.59% (32.5116 => 10.2128, std.dev.: 0.0215) SingleSource/Benchmarks/Dhrystone/fldry: -65.85% (1.9577 => 0.6686, std.dev.: 0.0096) SingleSource/Benchmarks/Dhrystone/dry: -51.55% (2.4116 => 1.1683, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.20% (0.0628 => 0.0363, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.33% (0.3987 => 0.2379, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.31% (4.5009 => 2.7766, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: -33.54% (1.1492 => 0.7638, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.14% (2.6546 => 2.0137, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: -19.30% (0.2161 => 0.1744, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4247, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.69% (2.6778 => 2.2844, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.80% (1.5660 => 1.4282, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -7.70% (9.5636 => 8.8273, std.dev.: 0.0856) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.2416 => 3.0211, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.70% (0.3463 => 0.3231, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.55% (2.7294 => 2.5778, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.13% (0.8614 => 0.8172, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.64% (1.5835 => 1.5101, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: -4.28% (6.2999 => 6.0304, std.dev.: 0.0040) MultiSource/Applications/siod/siod: -3.40% (3.2827 => 3.1711, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -3.00% (5.0483 => 4.8966, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.56% (0.9957 => 0.9702, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.29% (0.4808 => 0.4698, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.19% (19.9488 => 19.5122, std.dev.: 0.0930) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.90% (8.1563 => 8.0011, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6774, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.49% (10.2830 => 10.1302, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.89% (0.1485 => 0.1353, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0027) Report Time: 2.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 22:10:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 00:10:38 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121127061038.EB3DD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6294?compare_to=6286&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6294, Order: 168669, Start Time: 2012-11-27 02:52:30, End Time: 2012-11-27 06:11:09 To: 6286, Order: 168615, Start Time: 2012-11-26 22:43:27, End Time: 2012-11-27 02:04:09 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 36 (36 on baseline) Performance Regressions: 1 (161 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1055 (694 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Applications/hbd/hbd MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/ObjC++/Hello SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/ObjC/bitfield-access-2 SingleSource/UnitTests/ObjC/dot-syntax SingleSource/UnitTests/ObjC/dot-syntax-1 SingleSource/UnitTests/ObjC/dot-syntax-2 SingleSource/UnitTests/ObjC/instance-method-metadata SingleSource/UnitTests/ObjC/messages SingleSource/UnitTests/ObjC/messages-2 SingleSource/UnitTests/ObjC/parameter-passing SingleSource/UnitTests/ObjC/predefined-expr-in-method SingleSource/UnitTests/ObjC/property SingleSource/UnitTests/ObjC/protocols SingleSource/UnitTests/ObjC/synchronized MultiSource/Applications/hbd/hbd: 1.40% (1.1217 => 1.1374, std.dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: 0.78% (12.6993 => 12.7985, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.60% (12.5554 => 12.3539, std.dev.: 0.0143) SingleSource/UnitTests/ObjC++/Hello: 18.51% (0.6811 => 0.8072, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 17.25% (0.8232 => 0.9652, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 18.37% (0.6870 => 0.8132, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/bitfield-access-2: 40.56% (0.0286 => 0.0402) SingleSource/UnitTests/ObjC/dot-syntax: 28.75% (0.0320 => 0.0412, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/dot-syntax-1: 22.42% (0.0397 => 0.0486, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/dot-syntax-2: 41.59% (0.0226 => 0.0320) SingleSource/UnitTests/ObjC/instance-method-metadata: 28.74% (0.4005 => 0.5156, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/messages: 34.07% (0.0273 => 0.0366, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/messages-2: 22.22% (0.0477 => 0.0583, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 27.24% (0.4232 => 0.5385, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/predefined-expr-in-method: 46.53% (0.0202 => 0.0296) SingleSource/UnitTests/ObjC/property: 27.95% (0.4154 => 0.5315, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/protocols: 38.64% (0.0264 => 0.0366) SingleSource/UnitTests/ObjC/synchronized: 29.25% (0.3962 => 0.5121, std.dev.: 0.0003) New Failures - Execution Time ----------------------------- MultiSource/Applications/hbd/hbd MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/ObjC++/Hello SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/ObjC/bitfield-access-2 SingleSource/UnitTests/ObjC/dot-syntax SingleSource/UnitTests/ObjC/dot-syntax-1 SingleSource/UnitTests/ObjC/dot-syntax-2 SingleSource/UnitTests/ObjC/instance-method-metadata SingleSource/UnitTests/ObjC/messages SingleSource/UnitTests/ObjC/messages-2 SingleSource/UnitTests/ObjC/parameter-passing SingleSource/UnitTests/ObjC/predefined-expr-in-method SingleSource/UnitTests/ObjC/property SingleSource/UnitTests/ObjC/protocols SingleSource/UnitTests/ObjC/synchronized MultiSource/Applications/hbd/hbd: -96.15% (0.0026 => 0.0001) MultiSource/Applications/kimwitu++/kc: -99.85% (0.0658 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (40.8624 => 0.0001) SingleSource/UnitTests/ObjC++/Hello: -93.75% (0.0016 => 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -93.75% (0.0016 => 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -93.75% (0.0016 => 0.0001) SingleSource/UnitTests/ObjC/bitfield-access-2: -93.75% (0.0016 => 0.0001) SingleSource/UnitTests/ObjC/dot-syntax: -93.75% (0.0016 => 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: -93.75% (0.0016 => 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-2: -93.75% (0.0016 => 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -93.75% (0.0016 => 0.0001) SingleSource/UnitTests/ObjC/messages: -94.12% (0.0017 => 0.0001) SingleSource/UnitTests/ObjC/messages-2: -94.12% (0.0017 => 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -94.12% (0.0017 => 0.0001) SingleSource/UnitTests/ObjC/predefined-expr-in-method: -94.12% (0.0017 => 0.0001) SingleSource/UnitTests/ObjC/property: -94.44% (0.0018 => 0.0001) SingleSource/UnitTests/ObjC/protocols: -94.12% (0.0017 => 0.0001) SingleSource/UnitTests/ObjC/synchronized: -99.91% (0.1053 => 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 20.85% (0.4341 => 0.5246, std.dev.: 0.0241) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/hbd/hbd MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/ObjC++/Hello SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/ObjC/bitfield-access-2 SingleSource/UnitTests/ObjC/dot-syntax SingleSource/UnitTests/ObjC/dot-syntax-1 SingleSource/UnitTests/ObjC/dot-syntax-2 SingleSource/UnitTests/ObjC/instance-method-metadata SingleSource/UnitTests/ObjC/messages SingleSource/UnitTests/ObjC/messages-2 SingleSource/UnitTests/ObjC/parameter-passing SingleSource/UnitTests/ObjC/predefined-expr-in-method SingleSource/UnitTests/ObjC/property SingleSource/UnitTests/ObjC/protocols SingleSource/UnitTests/ObjC/synchronized MultiSource/Applications/hbd/hbd: 17.29% (0.9697 => 1.1374, std.dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: 7.05% (11.9555 => 12.7985, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.13% (11.6398 => 12.3539, std.dev.: 0.0143) SingleSource/UnitTests/ObjC++/Hello: 38.55% (0.5826 => 0.8072, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 34.60% (0.7171 => 0.9652, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 38.09% (0.5889 => 0.8132, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/bitfield-access-2: 52.85% (0.0263 => 0.0402) SingleSource/UnitTests/ObjC/dot-syntax: 50.36% (0.0274 => 0.0412, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/dot-syntax-1: 40.06% (0.0347 => 0.0486, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/dot-syntax-2: 72.97% (0.0185 => 0.0320) SingleSource/UnitTests/ObjC/instance-method-metadata: 47.82% (0.3488 => 0.5156, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/messages: 59.83% (0.0229 => 0.0366, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/messages-2: 39.14% (0.0419 => 0.0583, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 44.60% (0.3724 => 0.5385, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/predefined-expr-in-method: 81.60% (0.0163 => 0.0296) SingleSource/UnitTests/ObjC/property: 45.62% (0.3650 => 0.5315, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/protocols: 66.36% (0.0220 => 0.0366) SingleSource/UnitTests/ObjC/synchronized: 47.62% (0.3469 => 0.5121, std.dev.: 0.0003) New Failures - Execution Time ----------------------------- MultiSource/Applications/hbd/hbd MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/ObjC++/Hello SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/ObjC/bitfield-access-2 SingleSource/UnitTests/ObjC/dot-syntax SingleSource/UnitTests/ObjC/dot-syntax-1 SingleSource/UnitTests/ObjC/dot-syntax-2 SingleSource/UnitTests/ObjC/instance-method-metadata SingleSource/UnitTests/ObjC/messages SingleSource/UnitTests/ObjC/messages-2 SingleSource/UnitTests/ObjC/parameter-passing SingleSource/UnitTests/ObjC/predefined-expr-in-method SingleSource/UnitTests/ObjC/property SingleSource/UnitTests/ObjC/protocols SingleSource/UnitTests/ObjC/synchronized MultiSource/Applications/hbd/hbd: -96.15% (0.0026 => 0.0001) MultiSource/Applications/kimwitu++/kc: -99.85% (0.0648 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (41.7953 => 0.0001) SingleSource/UnitTests/ObjC++/Hello: -93.75% (0.0016 => 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -93.75% (0.0016 => 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -93.75% (0.0016 => 0.0001) SingleSource/UnitTests/ObjC/bitfield-access-2: -93.33% (0.0015 => 0.0001) SingleSource/UnitTests/ObjC/dot-syntax: -93.75% (0.0016 => 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: -93.75% (0.0016 => 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-2: -93.33% (0.0015 => 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -93.75% (0.0016 => 0.0001) SingleSource/UnitTests/ObjC/messages: -94.12% (0.0017 => 0.0001) SingleSource/UnitTests/ObjC/messages-2: -94.12% (0.0017 => 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -94.12% (0.0017 => 0.0001) SingleSource/UnitTests/ObjC/predefined-expr-in-method: -94.12% (0.0017 => 0.0001) SingleSource/UnitTests/ObjC/property: -94.12% (0.0017 => 0.0001) SingleSource/UnitTests/ObjC/protocols: -94.12% (0.0017 => 0.0001) SingleSource/UnitTests/ObjC/synchronized: -99.91% (0.1054 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.96% (0.0625 => 0.0881, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.80% (0.1063 => 0.1401, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.77% (0.2969 => 0.3734, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.41% (0.1106 => 0.1387, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.32% (0.4253 => 0.5330, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.51% (0.0714 => 0.0889, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.35% (0.4139 => 0.5147, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 23.77% (1.5932 => 1.9719, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.04% (0.1107 => 0.1362, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.95% (0.5900 => 0.7254, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.81% (0.4994 => 0.6133, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.60% (0.0584 => 0.0716, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.49% (0.0547 => 0.0670, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.32% (0.5000 => 0.6116, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.74% (0.1021 => 0.1243, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.73% (0.1620 => 0.1972, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.40% (0.0897 => 0.1089, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 21.37% (0.0599 => 0.0727, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.38% (0.0633 => 0.0762) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.38% (0.0584 => 0.0703, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.09% (0.0642 => 0.0771, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 20.04% (0.0948 => 0.1138, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.95% (0.1103 => 0.1323, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.91% (0.3903 => 0.4680, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 19.85% (0.0821 => 0.0984, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.59% (0.0822 => 0.0983, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.50% (0.1549 => 0.1851, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.44% (0.1003 => 0.1198, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.33% (0.1604 => 0.1914, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 19.27% (0.1619 => 0.1931, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 19.21% (0.0604 => 0.0720, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.40% (0.1462 => 0.1731, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.37% (0.0947 => 0.1121, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 18.32% (0.0808 => 0.0956, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.94% (0.3890 => 0.4588, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.87% (0.2014 => 0.2374, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 17.49% (0.1218 => 0.1431, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.32% (0.2736 => 0.3210, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 17.27% (0.4029 => 0.4725, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.10% (0.1088 => 0.1274, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.08% (1.3152 => 1.5399, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.01% (0.2875 => 0.3364, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 16.94% (0.1505 => 0.1760, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.85% (0.2866 => 0.3349, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.62% (0.4658 => 0.5432, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.51% (0.3271 => 0.3811, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.50% (3.5627 => 4.1506, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 16.48% (0.5546 => 0.6460, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 16.42% (1.8794 => 2.1880, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.25% (1.6211 => 1.8845, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 16.25% (0.3004 => 0.3492, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.21% (0.1968 => 0.2287, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 16.18% (0.2725 => 0.3166, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 16.18% (0.2750 => 0.3195, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.14% (0.2738 => 0.3180, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 16.06% (0.2714 => 0.3150, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.01% (0.2729 => 0.3166, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 16.01% (0.2780 => 0.3225, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.95% (0.1160 => 0.1345, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 15.88% (0.2803 => 0.3248, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.87% (0.2792 => 0.3235, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 15.85% (0.2813 => 0.3259, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 15.83% (0.1421 => 0.1646, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 15.80% (0.2823 => 0.3269, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 15.80% (0.2811 => 0.3255, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.63% (0.2911 => 0.3366, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 15.62% (0.9909 => 1.1457, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 15.60% (0.3096 => 0.3579, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.55% (0.4361 => 0.5039, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.54% (2.0673 => 2.3886, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.46% (0.3195 => 0.3689, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 15.36% (1.0781 => 1.2437, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.34% (0.5026 => 0.5797, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.31% (4.4195 => 5.0960, std.dev.: 0.0099) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.27% (2.7292 => 3.1460, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 15.21% (0.3267 => 0.3764, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: 15.19% (0.1284 => 0.1479, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.14% (0.3930 => 0.4525, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: 15.13% (0.3258 => 0.3751, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 15.09% (4.2109 => 4.8462, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary2: 14.80% (0.3317 => 0.3808, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 14.69% (23.5202 => 26.9743, std.dev.: 0.0220) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.67% (0.3060 => 0.3509, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.59% (0.1090 => 0.1249, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.54% (0.3362 => 0.3851, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.52% (1.9694 => 2.2554, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.47% (0.3124 => 0.3576, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.44% (0.3282 => 0.3756, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.35% (1.9966 => 2.2831, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: 14.27% (0.3678 => 0.4203, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 14.25% (0.3348 => 0.3825, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 14.09% (0.4146 => 0.4730, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 14.04% (0.3477 => 0.3965, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.99% (0.3625 => 0.4132, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 13.93% (0.3726 => 0.4245, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 13.73% (0.2075 => 0.2360, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 13.71% (0.4251 => 0.4834, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.60% (0.3845 => 0.4368, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 13.52% (0.2566 => 0.2913, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.49% (0.3981 => 0.4518, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.39% (0.3465 => 0.3929, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.33% (0.3690 => 0.4182, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/trivial-interface: 13.31% (0.3442 => 0.3900, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 13.24% (0.3496 => 0.3959, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.24% (0.3460 => 0.3918, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 13.23% (0.3446 => 0.3902, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 13.14% (1.4269 => 1.6144, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 12.80% (0.7875 => 0.8883, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 12.79% (0.5012 => 0.5653, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.68% (0.3643 => 0.4105, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 12.39% (2.1653 => 2.4335, std.dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 12.27% (4.6177 => 5.1841, std.dev.: 0.0074) MultiSource/Benchmarks/mafft/pairlocalalign: 12.08% (2.1013 => 2.3551, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 11.74% (0.2691 => 0.3007, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.42% (0.2040 => 0.2273, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.34% (0.6435 => 0.7165, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.26% (0.3498 => 0.3892, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11.01% (5.5417 => 6.1516, std.dev.: 0.0164) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.40% (0.2068 => 0.2283, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.34% (0.1383 => 0.1526, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.19% (0.2737 => 0.3016, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 9.92% (0.4847 => 0.5328, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.82% (0.1028 => 0.1129, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.53% (0.3084 => 0.3378, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 9.53% (0.6634 => 0.7266, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 9.38% (0.3336 => 0.3649, std.dev.: 0.0055) MultiSource/Applications/lemon/lemon: 9.08% (0.2391 => 0.2608, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 9.07% (2.0346 => 2.2192, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.56% (0.2103 => 0.2283, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.68% (4.6926 => 5.0528, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.42% (0.5361 => 0.5759, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.82% (0.5584 => 0.5965, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.73% (0.7426 => 0.7926, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.96% (0.3792 => 0.3942, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.98% (29.0505 => 33.4025, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 9.03% (0.2802 => 0.3055, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6093, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 5.23% (0.2122 => 0.2233, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6760, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-2: 4.77% (1.8057 => 1.8918, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1657, std.dev.: 0.0315) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6367, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.11% (0.3693 => 0.3808, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1965, std.dev.: 0.0079) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.56% (3.1722 => 3.2218, std.dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3064, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2855, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5930, std.dev.: 0.0294) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.23% (2.4764 => 2.3963, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5686, std.dev.: 0.0171) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9784, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -7.66% (0.2402 => 0.2218, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8071, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8064, std.dev.: 0.0039) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.94% (0.6293 => 0.6108, std.dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/fldry: -2.67% (17.2379 => 16.7783, std.dev.: 0.0311) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5798, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4948, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1727, std.dev.: 0.0746) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0441, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 3.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 23:25:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 01:25:57 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121127072557.1C5AF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6295?compare_to=6291&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6295, Order: 168676, Start Time: 2012-11-27 05:51:57, End Time: 2012-11-27 07:26:29 To: 6291, Order: 168675, Start Time: 2012-11-27 03:40:25, End Time: 2012-11-27 05:09:17 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (30 on baseline) Performance Regressions: 7 (43 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 39 (38 on baseline) Unchanged Tests: 1046 (912 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.88% (0.8543 => 0.8704, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 1.87% (0.7640 => 0.7783, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.27% (0.9211 => 0.9328, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.11% (0.3383 => 0.3556, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.20% (13.0962 => 13.6466, std.dev.: 0.0789) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.63% (1.3593 => 1.4087, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.06% (0.3954 => 0.4075, std.dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.37% (1.0650 => 1.0796, std.dev.: 0.2274) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 54.23% (0.0142 => 0.0219, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0175) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 10.33% (0.0300 => 0.0331, std.dev.: 0.0077) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.96% (0.0313 => 0.0310, std.dev.: 0.0095) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0204 => 0.0204, std.dev.: 0.0063) SingleSource/UnitTests/Vector/Altivec/test1: 10.66% (0.0197 => 0.0218, std.dev.: 0.0063) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 333.33% (0.0003 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.74% (0.1496 => 0.1485, std.dev.: 0.0052) MultiSource/Applications/lemon/lemon: 6.76% (1.1699 => 1.2490, std.dev.: 0.0167) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.66% (0.4156 => 0.4225, std.dev.: 0.1992) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.14% (0.1403 => 0.1359, std.dev.: 0.0309) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 800.00% (0.0001 => 0.0009, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.39% (0.0555 => 0.0596, std.dev.: 0.0223) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 18.61% (0.0231 => 0.0274, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.84% (0.0625 => 0.0601, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.66% (1.1978 => 1.2057, std.dev.: 0.0176) MultiSource/Benchmarks/SciMark2-C/scimark2: 0.17% (9.4394 => 9.4554, std.dev.: 0.0512) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1450.00% (0.0002 => 0.0031, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 28.57% (0.0021 => 0.0027, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.98% (0.0591 => 0.0650, std.dev.: 0.0146) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.47% (0.0243 => 0.0266, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.42% (0.7768 => 0.7801, std.dev.: 0.0039) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: 200.00% (0.0001 => 0.0003, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 15.07% (0.0073 => 0.0084, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/SciMark2-C/scimark2: -66.92% (28.5821 => 9.4554, std.dev.: 0.0512) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.66% (16.4461 => 17.8703, std.dev.: 1.4290) MultiSource/Applications/sqlite3/sqlite3: 2347.46% (0.6332 => 15.4973, std.dev.: 0.4919) MultiSource/Benchmarks/McCat/08-main/main: 52.27% (0.1831 => 0.2788, std.dev.: 0.0741) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.54% (0.1559 => 0.1535, std.dev.: 0.0355) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7347.01% (0.3123 => 23.2570, std.dev.: 0.6055) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.99% (0.2463 => 0.3719, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1536.21% (0.3344 => 5.4715, std.dev.: 0.4694) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.58% (0.2364 => 0.3276, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 5.12% (0.6010 => 0.6318, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/mandel: 2.10% (0.0429 => 0.0438, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.14% (0.3266 => 0.3434, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/strcat: 5.08% (0.1969 => 0.2069, std.dev.: 0.0411) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.04% (0.0224 => 0.0242, std.dev.: 0.0044) SingleSource/UnitTests/byval-alignment: -24.78% (0.0230 => 0.0173, std.dev.: 0.0048) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0523, std.dev.: 0.0066) MultiSource/Applications/oggenc/oggenc: 12.18% (0.1462 => 0.1640, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4779, std.dev.: 0.0301) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0765, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.5165, std.dev.: 0.0154) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5150, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5555, std.dev.: 0.5634) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3205, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1424, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3630, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3963, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0879, std.dev.: 0.0024) SingleSource/Regression/C/uint64_to_float: -23.79% (2.1832 => 1.6639, std.dev.: 0.1530) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.77% (0.1157 => 0.1351, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.15% (0.1137 => 0.1241, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 5.12% (1.2568 => 1.3211, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.78% (0.9908 => 1.0382, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.39% (0.8338 => 0.8704, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 4.32% (3.8189 => 3.9840, std.dev.: 0.0317) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.95% (2.1401 => 2.2246, std.dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.31% (0.4559 => 0.4710, std.dev.: 0.0025) MultiSource/Applications/lemon/lemon: 3.20% (1.0945 => 1.1295, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.20% (0.9039 => 0.9328, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 2.99% (0.7557 => 0.7783, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.76% (0.9056 => 0.9306, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.68% (0.8597 => 0.8827, std.dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 129.15% (0.0199 => 0.0456, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/pi: 58.13% (1.5795 => 2.4976, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.56% (0.7597 => 0.8855, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.37% (2.9753 => 3.4624, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.72% (2.7995 => 3.2117, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 12.16% (5.0261 => 5.6372, std.dev.: 0.0284) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.61% (0.3186 => 0.3556, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.10% (1.1857 => 1.2818, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.14% (6.3772 => 6.8328, std.dev.: 0.0893) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.03% (4.7794 => 5.1154, std.dev.: 0.0939) MultiSource/Applications/SIBsim4/SIBsim4: 6.36% (3.1873 => 3.3899, std.dev.: 0.0270) SingleSource/Benchmarks/Misc/richards_benchmark: 6.15% (1.3037 => 1.3839, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.10% (4.5327 => 4.8093, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.93% (4.9686 => 5.2631, std.dev.: 0.0047) MultiSource/Applications/lambda-0_1_3/lambda: 4.60% (7.4933 => 7.8380, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.56% (4.9469 => 5.1726, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.55% (6.2275 => 6.5109, std.dev.: 0.0394) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.15% (4.9453 => 5.1506, std.dev.: 0.0193) MultiSource/Applications/hexxagon/hexxagon: 4.03% (14.0064 => 14.5709, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.73% (4.8362 => 4.9684, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.65% (8.2783 => 8.4977, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.65% (11.5690 => 11.8753, std.dev.: 0.0274) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.37% (4.8660 => 4.9815, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout/lists: 2.30% (7.3375 => 7.5066, std.dev.: 0.0627) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.51% (1.5941 => 1.6182, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/ReedSolomon: 1.42% (8.5322 => 8.6537, std.dev.: 0.0238) MultiSource/Benchmarks/FreeBench/neural/neural: 1.29% (1.0841 => 1.0981, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.20% (4.4340 => 4.4872, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.08% (4.0473 => 4.0909, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.05% (3.5679 => 3.6055, std.dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -41.65% (2.8951 => 1.6892, std.dev.: 0.0568) MultiSource/Benchmarks/Olden/em3d/em3d: -21.23% (5.4641 => 4.3039, std.dev.: 0.1046) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.46% (7.2130 => 6.2422, std.dev.: 0.0517) SingleSource/Benchmarks/McGill/chomp: -10.26% (1.1216 => 1.0065, std.dev.: 0.0209) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.09% (1.0512 => 0.9451, std.dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: -8.37% (63.1822 => 57.8936, std.dev.: 0.0220) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.82% (14.6451 => 13.6466, std.dev.: 0.0789) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.77% (4.7482 => 4.4269, std.dev.: 0.0477) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.57% (5.4972 => 5.1910, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.01% (5.1557 => 4.8975, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.18% (2.8773 => 2.7571, std.dev.: 0.0235) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.83% (2.4490 => 2.3551, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.47% (6.0224 => 5.8136, std.dev.: 0.0415) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.21% (4.7449 => 4.5925, std.dev.: 0.0428) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.20% (0.5807 => 0.5621, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.03% (9.9065 => 9.7051, std.dev.: 0.0611) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.92% (11.5316 => 11.3101, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.15% (5.6343 => 5.5697, std.dev.: 0.0174) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 5.20% (1.0262 => 1.0796, std.dev.: 0.2274) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0175) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0077) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.65% (0.0302 => 0.0310, std.dev.: 0.0095) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.94% (0.0384 => 0.0426, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0063) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0063) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 3.27% (0.1438 => 0.1485, std.dev.: 0.0052) MultiSource/Applications/lemon/lemon: 10.25% (1.1329 => 1.2490, std.dev.: 0.0167) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.46% (0.4164 => 0.4225, std.dev.: 0.1992) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.73% (0.1369 => 0.1359, std.dev.: 0.0309) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.50% (0.0008 => 0.0009, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.02% (0.0641 => 0.0596, std.dev.: 0.0223) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 40.51% (0.0195 => 0.0274, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.98% (0.0578 => 0.0601, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.42% (1.1437 => 1.2057, std.dev.: 0.0176) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.67% (0.0627 => 0.0650, std.dev.: 0.0146) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.69% (0.8017 => 0.7801, std.dev.: 0.0039) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: 200.00% (0.0001 => 0.0003, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 35.48% (0.0062 => 0.0084, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Nov 26 23:52:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 01:52:32 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121127075232.418642A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6296?compare_to=6292&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6296, Order: 168676, Start Time: 2012-11-27 06:20:44, End Time: 2012-11-27 07:53:04 To: 6292, Order: 168675, Start Time: 2012-11-27 04:25:21, End Time: 2012-11-27 05:57:48 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (183 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (854 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 17.68% (0.3834 => 0.4512, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.65% (2.0478 => 2.1021, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/salsa20: 2.48% (7.4937 => 7.6799, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/hash2: 2.01% (3.1932 => 3.2573, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.01% (0.1431 => 0.1302, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.17% (0.3821 => 0.3509, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.00% (0.3142 => 0.2922, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -6.93% (2.4924 => 2.3197, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.76% (0.9542 => 0.8897, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.58% (0.3357 => 0.3136, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.38% (0.2428 => 0.2273, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -6.30% (0.2160 => 0.2024, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.29% (0.7198 => 0.6745, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.20% (0.9852 => 0.9241, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.12% (0.1796 => 0.1686, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.07% (0.2355 => 0.2212, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -6.07% (9.2283 => 8.6680, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: -5.95% (0.3831 => 0.3603, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: -5.93% (0.3812 => 0.3586, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/football/football: -5.90% (0.9179 => 0.8637, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.90% (0.3880 => 0.3651, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: -5.88% (16.1920 => 15.2397, std.dev.: 0.0199) SingleSource/UnitTests/ObjC/synchronized: -5.88% (0.3896 => 0.3667, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.82% (0.5857 => 0.5516, std.dev.: 0.0080) MultiSource/Applications/JM/ldecod/ldecod: -5.81% (7.0961 => 6.6839, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/for-in: -5.80% (0.4033 => 0.3799, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.80% (0.3658 => 0.3446, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.78% (0.5863 => 0.5524, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.78% (1.3722 => 1.2929, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.77% (0.5802 => 0.5467, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -5.74% (0.3848 => 0.3627, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: -5.74% (0.1761 => 0.1660, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.73% (4.0323 => 3.8012, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.73% (0.6304 => 0.5943, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.70% (0.5478 => 0.5166, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.69% (0.5925 => 0.5588, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.68% (0.5805 => 0.5475, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.68% (0.5705 => 0.5381, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.67% (0.5591 => 0.5274, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.66% (4.8161 => 4.5436, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.65% (0.6297 => 0.5941, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.65% (0.5575 => 0.5260, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.65% (0.6230 => 0.5878, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.65% (0.6446 => 0.6082, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.64% (0.6484 => 0.6118, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.64% (0.2695 => 0.2543) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.63% (0.5859 => 0.5529, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.62% (1.0544 => 0.9951, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.60% (0.6660 => 0.6287, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.58% (0.3891 => 0.3674, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.56% (0.5849 => 0.5524, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -5.56% (0.4176 => 0.3944, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.54% (0.5688 => 0.5373, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -5.54% (1.1450 => 1.0816, std.dev.: 0.0053) MultiSource/Benchmarks/nbench/nbench: -5.53% (1.1530 => 1.0892, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.52% (1.6364 => 1.5460, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.52% (4.8802 => 4.6107, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.52% (0.5941 => 0.5613, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.52% (0.6667 => 0.6299, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.51% (1.2300 => 1.1622, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.51% (0.6260 => 0.5915, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.51% (3.5339 => 3.3393, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.50% (0.6052 => 0.5719, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.48% (0.5456 => 0.5157, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.46% (0.5581 => 0.5276, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.46% (0.5570 => 0.5266, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.45% (0.6189 => 0.5852, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.42% (1.2784 => 1.2091, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.41% (4.5069 => 4.2630, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.39% (0.6681 => 0.6321, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.38% (6.7716 => 6.4070, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.35% (1.4642 => 1.3858, std.dev.: 0.0088) MultiSource/Applications/sqlite3/sqlite3: -5.35% (17.1032 => 16.1878, std.dev.: 0.0186) MultiSource/Benchmarks/MallocBench/gs/gs: -5.32% (4.3330 => 4.1024, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.31% (0.6194 => 0.5865, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.30% (0.6033 => 0.5713, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.28% (1.2221 => 1.1576, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/property: -5.26% (0.4199 => 0.3978, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.6736 => 0.6382, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.25% (0.3884 => 0.3680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.23% (0.6676 => 0.6327, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.22% (0.8521 => 0.8076, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.22% (14.2083 => 13.4667, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.22% (1.2210 => 1.1573, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: -5.20% (0.3406 => 0.3229, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.20% (0.6293 => 0.5966, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.17% (0.6440 => 0.6107, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: -5.14% (0.4515 => 0.4283, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: -5.10% (1.3864 => 1.3157, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -5.09% (0.2985 => 0.2833, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.04% (0.4916 => 0.4668, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.02% (8.0126 => 7.6107, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.00% (0.2278 => 0.2164, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.97% (0.3057 => 0.2905, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.97% (0.5999 => 0.5701, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.97% (0.3483 => 0.3310, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -4.96% (1.2515 => 1.1894, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -4.95% (0.4280 => 0.4068, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -4.95% (15.5079 => 14.7409, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.94% (0.4151 => 0.3946, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -4.91% (0.7447 => 0.7081, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.91% (0.6395 => 0.6081, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -4.91% (3.5154 => 3.3429, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: -4.89% (0.2659 => 0.2529, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: -4.89% (0.3581 => 0.3406, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (0.2871 => 0.2731, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.87% (0.2548 => 0.2424, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: -4.87% (0.2939 => 0.2796, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -4.86% (0.3025 => 0.2878, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -4.85% (0.3255 => 0.3097, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -4.83% (15.2527 => 14.5162, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.82% (0.7919 => 0.7537, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.82% (0.2385 => 0.2270, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -4.81% (4.0594 => 3.8640, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.81% (0.2933 => 0.2792) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.80% (0.7524 => 0.7163, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/objinst: -4.79% (0.3194 => 0.3041, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.77% (0.3016 => 0.2872, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.76% (0.3931 => 0.3744, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.75% (2.1713 => 2.0682, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.74% (0.5168 => 0.4923, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -4.73% (0.3026 => 0.2883, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.72% (0.5569 => 0.5306, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.72% (0.3837 => 0.3656, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -4.70% (0.2849 => 0.2715, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.70% (0.2999 => 0.2858, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.70% (0.7339 => 0.6994, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.69% (0.3323 => 0.3167, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: -4.69% (1.3148 => 1.2532, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wc: -4.68% (0.3205 => 0.3055) SingleSource/UnitTests/ObjC++/property-reference: -4.67% (0.7779 => 0.7416, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.65% (0.2903 => 0.2768, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -4.64% (0.4248 => 0.4051, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.62% (0.5567 => 0.5310, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.61% (0.4321 => 0.4122, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.58% (1.6474 => 1.5720, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: -4.57% (0.4861 => 0.4639, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -4.55% (5.0226 => 4.7940, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.55% (0.3252 => 0.3104, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.54% (0.3059 => 0.2920, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.52% (0.3849 => 0.3675, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.50% (22.4056 => 21.3980, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.49% (0.6395 => 0.6108, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -4.49% (0.6441 => 0.6152, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -4.48% (2.4021 => 2.2945, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.46% (0.7021 => 0.6708, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: -4.44% (0.6347 => 0.6065, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -4.34% (0.3867 => 0.3699, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.33% (0.5329 => 0.5098, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: -4.33% (2.1401 => 2.0475, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/ary: -4.30% (0.3394 => 0.3248, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/strcat: -4.28% (0.2989 => 0.2861, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -4.28% (0.3621 => 0.3466, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.28% (0.4813 => 0.4607, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary3: -4.27% (0.3446 => 0.3299, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.24% (0.4083 => 0.3910, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.15% (0.9557 => 0.9160, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: -4.15% (0.7982 => 0.7651, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: -4.13% (0.3271 => 0.3136, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.09% (0.4427 => 0.4246, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.07% (0.3319 => 0.3184, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -4.03% (34.0927 => 32.7172, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.94% (0.9077 => 0.8719, std.dev.: 0.0037) MultiSource/Applications/kimwitu++/kc: -3.93% (18.2933 => 17.5751, std.dev.: 0.0112) MultiSource/Applications/spiff/spiff: -3.91% (0.8418 => 0.8089, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/sieve: -3.88% (0.3788 => 0.3641, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.87% (2.2587 => 2.1713, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.81% (0.3491 => 0.3358, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -3.70% (0.6750 => 0.6500, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -3.65% (0.4524 => 0.4359, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: -3.30% (1.5610 => 1.5095, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.04% (5.4682 => 5.3019, std.dev.: 0.0109) SingleSource/UnitTests/Vector/constpool: -2.98% (20.7746 => 20.1557, std.dev.: 0.0200) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1968, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: -62.56% (1.8100 => 0.6777, std.dev.: 0.0089) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7550, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Misc/richards_benchmark: -8.62% (1.2842 => 1.1735, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.91% (2.2633 => 2.1749, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4690, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 01:18:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 03:18:47 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121127091847.0848C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6297?compare_to=6295&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6297, Order: 168680, Start Time: 2012-11-27 07:45:56, End Time: 2012-11-27 09:19:17 To: 6295, Order: 168676, Start Time: 2012-11-27 05:51:57, End Time: 2012-11-27 07:26:29 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (30 on baseline) Performance Regressions: 3 (59 on baseline) Performance Improvements: 4 (21 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 39 (38 on baseline) Unchanged Tests: 1046 (893 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: 31.90% (39.1876 => 51.6889, std.dev.: 0.6883) SingleSource/Benchmarks/Misc/flops-3: 1.40% (2.0687 => 2.0976, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.05% (1.4609 => 1.4762, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/lists1: -3.81% (0.3200 => 0.3078, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: -1.81% (1.3211 => 1.2972, std.dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.05% (0.5165 => 0.4904, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.54% (40.6132 => 39.5803, std.dev.: 0.2672) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.07% (1.0796 => 1.0804, std.dev.: 0.2344) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0219 => 0.0219, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0425 => 0.0425, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.60% (0.0331 => 0.0333, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.97% (0.0310 => 0.0313, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0426 => 0.0426, std.dev.: 0.0120) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0204 => 0.0203, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: -0.46% (0.0218 => 0.0217, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1485 => 0.1486, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -5.24% (1.2490 => 1.1836, std.dev.: 0.0276) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.69% (0.4225 => 0.4254, std.dev.: 0.1347) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.45% (0.1359 => 0.1433, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.56% (0.0596 => 0.0653, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.46% (0.0274 => 0.0278, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.16% (0.0601 => 0.0564, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.82% (1.2057 => 1.1958, std.dev.: 0.0811) MultiSource/Benchmarks/SciMark2-C/scimark2: -0.11% (9.4554 => 9.4448, std.dev.: 0.0823) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -74.07% (0.0027 => 0.0007, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.08% (0.0650 => 0.0643, std.dev.: 0.0149) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -37.59% (0.0266 => 0.0166, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.01% (0.7801 => 0.7880, std.dev.: 0.0043) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -66.67% (0.0003 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -30.95% (0.0084 => 0.0058, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/SciMark2-C/scimark2: -66.96% (28.5821 => 9.4448, std.dev.: 0.0823) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.31% (16.4461 => 17.8132, std.dev.: 1.0937) MultiSource/Applications/sqlite3/sqlite3: 2316.12% (0.6332 => 15.2989, std.dev.: 0.2853) MultiSource/Benchmarks/McCat/08-main/main: 51.50% (0.1831 => 0.2774, std.dev.: 0.0414) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.25% (0.1559 => 0.1446, std.dev.: 0.0059) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7321.01% (0.3123 => 23.1758, std.dev.: 0.7614) SingleSource/Benchmarks/CoyoteBench/fftbench: 52.54% (0.2463 => 0.3757, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1560.23% (0.3344 => 5.5518, std.dev.: 0.2115) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.56% (0.2364 => 0.3252, std.dev.: 0.0144) SingleSource/Benchmarks/Misc-C++/bigfib: 6.69% (0.6010 => 0.6412, std.dev.: 0.0148) SingleSource/Benchmarks/Misc/mandel: - (0.0429 => 0.0429, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.49% (0.3266 => 0.3478, std.dev.: 0.0411) SingleSource/Benchmarks/Shootout-C++/strcat: 4.01% (0.1969 => 0.2048, std.dev.: 0.0034) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 9.82% (0.0224 => 0.0246, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -26.09% (0.0230 => 0.0170, std.dev.: 0.0069) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0517, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 13.13% (0.1462 => 0.1654, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4715, std.dev.: 0.0298) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0736, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4904, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5164, std.dev.: 0.0208) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.6053, std.dev.: 0.0582) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3238, std.dev.: 0.0375) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1710, std.dev.: 0.0240) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3650, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4029, std.dev.: 0.1312) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0827, std.dev.: 0.0062) SingleSource/Regression/C/uint64_to_float: -23.82% (2.1832 => 1.6631, std.dev.: 0.0096) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/viterbi/viterbi: 7.86% (0.1577 => 0.1701, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.83% (0.3295 => 0.3553, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.43% (0.3115 => 0.3284, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/wc: 4.99% (0.2183 => 0.2292, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 4.69% (3.8189 => 3.9979, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.30% (0.8457 => 0.8821, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.28% (0.3717 => 0.3876, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.25% (3.1832 => 3.3186, std.dev.: 0.0374) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.21% (0.4559 => 0.4751, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 4.11% (0.6834 => 0.7115, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.75% (0.8805 => 0.9135, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.75% (0.8597 => 0.8919, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/lists1: 3.67% (0.2969 => 0.3078, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.65% (0.8359 => 0.8664, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.58% (0.9056 => 0.9380, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.43% (0.8656 => 0.8953, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.37% (0.5191 => 0.5366, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.23% (0.8007 => 0.8266, std.dev.: 0.0084) MultiSource/Applications/SIBsim4/SIBsim4: 3.21% (1.2568 => 1.2972, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.10% (0.6586 => 0.6790, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.00% (0.9074 => 0.9346, std.dev.: 0.0059) MultiSource/Applications/lambda-0_1_3/lambda: 2.87% (0.7557 => 0.7774, std.dev.: 0.0072) MultiSource/Applications/JM/lencod/lencod: 2.72% (15.3280 => 15.7453, std.dev.: 0.1384) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.70% (0.8066 => 0.8284, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.66% (0.8338 => 0.8560, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.55% (0.8716 => 0.8938, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 2.05% (8.6247 => 8.8018, std.dev.: 0.0579) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 109.05% (0.0199 => 0.0416, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/pi: 56.07% (1.5795 => 2.4652, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.68% (0.7597 => 0.8940, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.34% (2.9753 => 3.4614, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.72% (2.7995 => 3.2117, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.71% (5.0261 => 5.6148, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.51% (0.3186 => 0.3457, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.41% (6.3772 => 6.9133, std.dev.: 0.1801) SingleSource/Benchmarks/Misc/richards_benchmark: 7.76% (1.3037 => 1.4049, std.dev.: 0.0274) SingleSource/Benchmarks/McGill/queens: 7.51% (1.7056 => 1.8337, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.03% (4.7794 => 5.1152, std.dev.: 0.0362) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 6.69% (1.1857 => 1.2650, std.dev.: 0.0084) MultiSource/Applications/SIBsim4/SIBsim4: 6.32% (3.1873 => 3.3887, std.dev.: 0.0275) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.93% (4.5327 => 4.8014, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.74% (4.9686 => 5.2539, std.dev.: 0.0415) MultiSource/Applications/lambda-0_1_3/lambda: 5.10% (7.4933 => 7.8751, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.71% (6.2275 => 6.5210, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.67% (3.3761 => 3.5336, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.19% (4.9453 => 5.1527, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.02% (4.9469 => 5.1460, std.dev.: 0.0157) MultiSource/Applications/hexxagon/hexxagon: 3.89% (14.0064 => 14.5509, std.dev.: 0.0383) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.94% (11.5690 => 11.9096, std.dev.: 0.0392) MultiSource/Applications/siod/siod: 2.94% (3.6643 => 3.7721, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout/lists: 2.53% (7.3375 => 7.5233, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.23% (8.2783 => 8.4626, std.dev.: 0.0329) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.99% (4.4340 => 4.5221, std.dev.: 0.0235) MultiSource/Benchmarks/BitBench/five11/five11: 1.84% (5.6030 => 5.7060, std.dev.: 0.0273) SingleSource/Benchmarks/Shootout-C++/hash: 1.76% (0.6205 => 0.6314, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.55% (1.4536 => 1.4762, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.50% (2.4647 => 2.5017, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-3: 1.48% (2.0670 => 2.0976, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.14% (3.5679 => 3.6084, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.10% (2.8951 => 1.6763, std.dev.: 0.0092) MultiSource/Benchmarks/Olden/em3d/em3d: -20.65% (5.4641 => 4.3360, std.dev.: 0.0263) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.18% (7.2130 => 6.2622, std.dev.: 0.1353) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.75% (1.0512 => 0.9382, std.dev.: 0.0234) SingleSource/Benchmarks/McGill/chomp: -10.40% (1.1216 => 1.0050, std.dev.: 0.0257) MultiSource/Benchmarks/mafft/pairlocalalign: -8.40% (63.1822 => 57.8729, std.dev.: 0.0468) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.86% (14.6451 => 13.4944, std.dev.: 0.1505) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.85% (4.7482 => 4.4231, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.96% (3.7148 => 3.4934, std.dev.: 0.0501) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.84% (5.4972 => 5.1760, std.dev.: 0.0292) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.07% (5.1557 => 4.8943, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.42% (4.7449 => 4.5354, std.dev.: 0.0373) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.97% (2.8773 => 2.7632, std.dev.: 0.0343) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.60% (6.0224 => 5.8053, std.dev.: 0.0158) MultiSource/Applications/aha/aha: -2.65% (3.3398 => 3.2512, std.dev.: 0.0263) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.28% (2.6356 => 2.5754, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/hash2: -2.10% (3.4237 => 3.3517, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.03% (11.5316 => 11.2978, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.37% (9.9065 => 9.7707, std.dev.: 0.0351) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.3487 => 2.3188, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.16% (5.6343 => 5.5687, std.dev.: 0.0254) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 5.28% (1.0262 => 1.0804, std.dev.: 0.2344) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.94% (0.0384 => 0.0426, std.dev.: 0.0120) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 3.34% (0.1438 => 0.1486, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 4.48% (1.1329 => 1.1836, std.dev.: 0.0276) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.16% (0.4164 => 0.4254, std.dev.: 0.1347) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.67% (0.1369 => 0.1433, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.87% (0.0641 => 0.0653, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.56% (0.0195 => 0.0278, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.42% (0.0578 => 0.0564, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.56% (1.1437 => 1.1958, std.dev.: 0.0811) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0014 => 0.0007, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.55% (0.0627 => 0.0643, std.dev.: 0.0149) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.78% (0.0180 => 0.0166, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.71% (0.8017 => 0.7880, std.dev.: 0.0043) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -6.45% (0.0062 => 0.0058, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 3.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 01:52:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 03:52:37 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121127095237.C027A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6299?compare_to=6296&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6299, Order: 168681, Start Time: 2012-11-27 08:20:29, End Time: 2012-11-27 09:53:08 To: 6296, Order: 168676, Start Time: 2012-11-27 06:20:44, End Time: 2012-11-27 07:53:04 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (182 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (856 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.26% (20.1557 => 20.4104, std.dev.: 0.0123) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.29% (1.2783 => 1.3715, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.02% (2.0478 => 2.1097, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/salsa20: 2.66% (7.4937 => 7.6933, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/hash2: 2.10% (3.1932 => 3.2603, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.74% (0.1431 => 0.1306, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.96% (0.3821 => 0.3517, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.81% (0.3142 => 0.2928, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.61% (0.9542 => 0.8911, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.59% (0.3884 => 0.3628, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: -6.58% (0.3812 => 0.3561, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -6.58% (0.3831 => 0.3579, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-4: -6.57% (0.3880 => 0.3625, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -6.56% (2.4924 => 2.3288, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: -6.55% (0.3848 => 0.3596, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.44% (0.3896 => 0.3645, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.40% (0.3891 => 0.3642, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -6.40% (0.4033 => 0.3775, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -6.30% (0.4176 => 0.3913, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -6.30% (0.2160 => 0.2024, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.26% (0.3357 => 0.3147, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.14% (0.2428 => 0.2279, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -6.04% (9.2283 => 8.6710, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.00% (0.9852 => 0.9261, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.89% (0.6484 => 0.6102, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.86% (0.2355 => 0.2217, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/property: -5.86% (0.4199 => 0.3953, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.85% (0.1796 => 0.1691, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.82% (0.7198 => 0.6779, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -5.80% (0.9179 => 0.8647, std.dev.: 0.0125) MultiSource/Applications/JM/ldecod/ldecod: -5.78% (7.0961 => 6.6856, std.dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: -5.77% (16.1920 => 15.2570, std.dev.: 0.0226) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.74% (0.5591 => 0.5270, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.73% (1.3722 => 1.2936, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.72% (1.0544 => 0.9941, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.70% (0.5805 => 0.5474, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -5.68% (0.1761 => 0.1661, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.68% (0.2695 => 0.2542, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.66% (0.5478 => 0.5168, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.64% (4.8161 => 4.5445, std.dev.: 0.0200) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.64% (4.0323 => 3.8050, std.dev.: 0.0227) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.62% (0.5925 => 0.5592, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.62% (0.5859 => 0.5530, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.60% (0.3658 => 0.3453, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.60% (0.6304 => 0.5951, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.58% (0.6052 => 0.5714, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.58% (0.5802 => 0.5478, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.56% (4.8802 => 4.6087, std.dev.: 0.0183) SingleSource/UnitTests/ObjC/parameter-passing: -5.56% (0.4280 => 0.4042, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.56% (0.6260 => 0.5912, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -5.55% (0.3025 => 0.2857, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.54% (0.5575 => 0.5266, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: -5.51% (1.1530 => 1.0895, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.49% (0.6189 => 0.5849, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.49% (0.5863 => 0.5541, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.49% (1.6364 => 1.5466, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.49% (0.5705 => 0.5392, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.48% (0.5581 => 0.5275, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: -5.48% (0.1879 => 0.1776, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.48% (0.5857 => 0.5536, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.47% (0.3016 => 0.2851, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: -5.47% (0.3255 => 0.3077, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.45% (0.6297 => 0.5954, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.44% (0.6660 => 0.6298, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.43% (6.7716 => 6.4036, std.dev.: 0.0313) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.43% (3.5339 => 3.3419, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.42% (0.5849 => 0.5532, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.41% (1.2300 => 1.1634, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.39% (0.5941 => 0.5621, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.39% (0.5570 => 0.5270, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: -5.38% (1.3864 => 1.3118, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.38% (4.5069 => 4.2645, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.37% (0.5456 => 0.5163, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -5.36% (0.2871 => 0.2717, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -5.36% (0.4515 => 0.4273, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.35% (0.6033 => 0.5710, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.35% (0.6446 => 0.6101, std.dev.: 0.0060) SingleSource/UnitTests/ObjC++/property-reference: -5.35% (0.7779 => 0.7363, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.35% (0.6230 => 0.5897, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.33% (0.5688 => 0.5385, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.32% (0.6667 => 0.6312, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.32% (0.2933 => 0.2777, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.31% (0.6194 => 0.5865, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.30% (0.3057 => 0.2895, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.30% (1.2784 => 1.2107, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/except: -5.29% (0.3026 => 0.2866, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.28% (1.4642 => 1.3869, std.dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: -5.26% (1.3148 => 1.2456, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: -5.26% (0.3194 => 0.3026, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.25% (2.1713 => 2.0573, std.dev.: 0.0035) MultiSource/Applications/lemon/lemon: -5.24% (1.1450 => 1.0850, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.24% (0.2903 => 0.2751, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.23% (0.6676 => 0.6327, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.21% (0.2939 => 0.2786, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.21% (17.1032 => 16.2129, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.20% (0.4151 => 0.3935, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.19% (0.3837 => 0.3638, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.19% (0.6440 => 0.6106, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.18% (0.6293 => 0.5967, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wc: -5.18% (0.3205 => 0.3039, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -5.17% (0.3059 => 0.2901, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.14% (0.8521 => 0.8083, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.13% (0.6681 => 0.6338, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.13% (0.7919 => 0.7513, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.11% (0.6736 => 0.6392, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.09% (8.0126 => 7.6047, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hello: -5.09% (0.2849 => 0.2704, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -5.07% (0.6347 => 0.6025, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.07% (0.3849 => 0.3654, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.07% (0.4916 => 0.4667, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.06% (0.3931 => 0.3732, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: -5.06% (0.4248 => 0.4033, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -5.04% (4.3330 => 4.1145, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.02% (1.2221 => 1.1607, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: -5.02% (0.3406 => 0.3235, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.02% (1.2210 => 1.1597, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.02% (0.5999 => 0.5698, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.01% (0.3252 => 0.3089, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.01% (0.4813 => 0.4572, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.99% (14.2083 => 13.5000, std.dev.: 0.0206) SingleSource/Benchmarks/Shootout-C++/ary2: -4.97% (0.3481 => 0.3308, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -4.97% (0.6441 => 0.6121, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.96% (0.2278 => 0.2165, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: -4.92% (0.4861 => 0.4622, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.86% (0.5168 => 0.4917, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -4.85% (15.5079 => 14.7565, std.dev.: 0.0120) MultiSource/Applications/ClamAV/clamscan: -4.84% (15.2527 => 14.5150, std.dev.: 0.0167) MultiSource/Benchmarks/McCat/18-imp/imp: -4.83% (0.3581 => 0.3408, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: -4.79% (1.2515 => 1.1915, std.dev.: 0.0028) MultiSource/Applications/d/make_dparser: -4.79% (3.5154 => 3.3469, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: -4.78% (0.2659 => 0.2532, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -4.77% (0.3394 => 0.3232, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.77% (0.4321 => 0.4115, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.77% (0.3483 => 0.3317, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.75% (0.2548 => 0.2427, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -4.73% (0.3867 => 0.3684, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -4.72% (4.0594 => 3.8677, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.71% (0.6395 => 0.6094, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.70% (0.4083 => 0.3891, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -4.70% (0.3446 => 0.3284, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.70% (0.2385 => 0.2273, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.67% (0.2999 => 0.2859, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: -4.67% (0.3621 => 0.3452, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.65% (0.7339 => 0.6998, std.dev.: 0.0085) MultiSource/Applications/minisat/minisat: -4.65% (0.7447 => 0.7101, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: -4.64% (0.4524 => 0.4314, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.64% (0.7524 => 0.7175, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.63% (0.6395 => 0.6099, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.50% (1.6474 => 1.5733, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -4.46% (0.2985 => 0.2852, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.45% (0.5567 => 0.5319, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.43% (0.4427 => 0.4231, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.42% (0.5569 => 0.5323, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.42% (0.9557 => 0.9135, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.40% (22.4056 => 21.4197, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.37% (0.5329 => 0.5096, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: -4.30% (0.3788 => 0.3625, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -4.22% (2.1401 => 2.0497, std.dev.: 0.0108) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.19% (0.9077 => 0.8697, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/bigfib: -4.18% (0.6750 => 0.6468, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -4.18% (34.0927 => 32.6688, std.dev.: 0.0378) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.10% (0.3319 => 0.3183, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: -4.07% (5.0226 => 4.8181, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: -4.07% (0.3271 => 0.3138, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -4.03% (2.4021 => 2.3054, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.81% (0.3491 => 0.3358, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.73% (2.2587 => 2.1745, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: -3.68% (18.2933 => 17.6199, std.dev.: 0.0136) MultiSource/Applications/spiff/spiff: -3.62% (0.8418 => 0.8113, std.dev.: 0.0054) MultiSource/Applications/hbd/hbd: -3.58% (1.5610 => 1.5051, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: -3.51% (0.7982 => 0.7702, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.01% (5.4682 => 5.3038, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -1.75% (20.7746 => 20.4104, std.dev.: 0.0123) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.51% (31.3723 => 10.1924, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -62.11% (1.8100 => 0.6858, std.dev.: 0.0144) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7525, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: -8.74% (1.2842 => 1.1719, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1739, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.63% (1.3096 => 1.2752, std.dev.: 0.0070) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4704, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 02:23:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 04:23:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121127102320.74B422A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6300?compare_to=6294&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6300, Order: 168677, Start Time: 2012-11-27 06:59:19, End Time: 2012-11-27 10:23:51 To: 6294, Order: 168669, Start Time: 2012-11-27 02:52:30, End Time: 2012-11-27 06:11:09 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (36 on baseline) Performance Regressions: 1 (161 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 36 (0 on baseline) Unchanged Tests: 1055 (696 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.60% (2.0598 => 2.1339, std.dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/hbd/hbd MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/ObjC++/Hello SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/ObjC/bitfield-access-2 SingleSource/UnitTests/ObjC/dot-syntax SingleSource/UnitTests/ObjC/dot-syntax-1 SingleSource/UnitTests/ObjC/dot-syntax-2 SingleSource/UnitTests/ObjC/instance-method-metadata SingleSource/UnitTests/ObjC/messages SingleSource/UnitTests/ObjC/messages-2 SingleSource/UnitTests/ObjC/parameter-passing SingleSource/UnitTests/ObjC/predefined-expr-in-method SingleSource/UnitTests/ObjC/property SingleSource/UnitTests/ObjC/protocols SingleSource/UnitTests/ObjC/synchronized MultiSource/Applications/hbd/hbd: 0.43% (1.1374 => 1.1423, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 0.33% (12.7985 => 12.8402, std.dev.: 0.0207) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.58% (12.3539 => 12.4254, std.dev.: 0.1924) SingleSource/UnitTests/ObjC++/Hello: 0.71% (0.8072 => 0.8129, std.dev.: 0.0145) SingleSource/UnitTests/ObjC++/property-reference: 1.08% (0.9652 => 0.9756, std.dev.: 0.0144) SingleSource/UnitTests/ObjC++/property-reference-object: 0.77% (0.8132 => 0.8195, std.dev.: 0.0107) SingleSource/UnitTests/ObjC/bitfield-access-2: 0.25% (0.0402 => 0.0403, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/dot-syntax: 0.24% (0.0412 => 0.0413, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/dot-syntax-1: 0.62% (0.0486 => 0.0489, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/dot-syntax-2: 0.31% (0.0320 => 0.0321, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/instance-method-metadata: 0.45% (0.5156 => 0.5179, std.dev.: 0.0098) SingleSource/UnitTests/ObjC/messages: 0.27% (0.0366 => 0.0367, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/messages-2: 0.17% (0.0583 => 0.0584, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/parameter-passing: 0.61% (0.5385 => 0.5418, std.dev.: 0.0104) SingleSource/UnitTests/ObjC/predefined-expr-in-method: 0.34% (0.0296 => 0.0297, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 0.51% (0.5315 => 0.5342, std.dev.: 0.0142) SingleSource/UnitTests/ObjC/protocols: 6.28% (0.0366 => 0.0389, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 0.62% (0.5121 => 0.5153, std.dev.: 0.0117) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/hbd/hbd MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/ObjC++/Hello SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/ObjC/bitfield-access-2 SingleSource/UnitTests/ObjC/dot-syntax SingleSource/UnitTests/ObjC/dot-syntax-1 SingleSource/UnitTests/ObjC/dot-syntax-2 SingleSource/UnitTests/ObjC/instance-method-metadata SingleSource/UnitTests/ObjC/messages SingleSource/UnitTests/ObjC/messages-2 SingleSource/UnitTests/ObjC/parameter-passing SingleSource/UnitTests/ObjC/predefined-expr-in-method SingleSource/UnitTests/ObjC/property SingleSource/UnitTests/ObjC/protocols SingleSource/UnitTests/ObjC/synchronized MultiSource/Applications/hbd/hbd: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/UnitTests/ObjC++/Hello: - (0.0001 => 0.0001) SingleSource/UnitTests/ObjC++/property-reference: - (0.0001 => 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: - (0.0001 => 0.0001) SingleSource/UnitTests/ObjC/bitfield-access-2: - (0.0001 => 0.0001) SingleSource/UnitTests/ObjC/dot-syntax: - (0.0001 => 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: - (0.0001 => 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-2: - (0.0001 => 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: - (0.0001 => 0.0001) SingleSource/UnitTests/ObjC/messages: - (0.0001 => 0.0001) SingleSource/UnitTests/ObjC/messages-2: - (0.0001 => 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: - (0.0001 => 0.0001) SingleSource/UnitTests/ObjC/predefined-expr-in-method: - (0.0001 => 0.0001) SingleSource/UnitTests/ObjC/property: - (0.0001 => 0.0001) SingleSource/UnitTests/ObjC/protocols: - (0.0001 => 0.0001) SingleSource/UnitTests/ObjC/synchronized: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/hbd/hbd MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/ObjC++/Hello SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/ObjC/bitfield-access-2 SingleSource/UnitTests/ObjC/dot-syntax SingleSource/UnitTests/ObjC/dot-syntax-1 SingleSource/UnitTests/ObjC/dot-syntax-2 SingleSource/UnitTests/ObjC/instance-method-metadata SingleSource/UnitTests/ObjC/messages SingleSource/UnitTests/ObjC/messages-2 SingleSource/UnitTests/ObjC/parameter-passing SingleSource/UnitTests/ObjC/predefined-expr-in-method SingleSource/UnitTests/ObjC/property SingleSource/UnitTests/ObjC/protocols SingleSource/UnitTests/ObjC/synchronized MultiSource/Applications/hbd/hbd: 17.80% (0.9697 => 1.1423, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 7.40% (11.9555 => 12.8402, std.dev.: 0.0207) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.75% (11.6398 => 12.4254, std.dev.: 0.1924) SingleSource/UnitTests/ObjC++/Hello: 39.53% (0.5826 => 0.8129, std.dev.: 0.0145) SingleSource/UnitTests/ObjC++/property-reference: 36.05% (0.7171 => 0.9756, std.dev.: 0.0144) SingleSource/UnitTests/ObjC++/property-reference-object: 39.16% (0.5889 => 0.8195, std.dev.: 0.0107) SingleSource/UnitTests/ObjC/bitfield-access-2: 53.23% (0.0263 => 0.0403, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/dot-syntax: 50.73% (0.0274 => 0.0413, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/dot-syntax-1: 40.92% (0.0347 => 0.0489, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/dot-syntax-2: 73.51% (0.0185 => 0.0321, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/instance-method-metadata: 48.48% (0.3488 => 0.5179, std.dev.: 0.0098) SingleSource/UnitTests/ObjC/messages: 60.26% (0.0229 => 0.0367, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/messages-2: 39.38% (0.0419 => 0.0584, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/parameter-passing: 45.49% (0.3724 => 0.5418, std.dev.: 0.0104) SingleSource/UnitTests/ObjC/predefined-expr-in-method: 82.21% (0.0163 => 0.0297, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 46.36% (0.3650 => 0.5342, std.dev.: 0.0142) SingleSource/UnitTests/ObjC/protocols: 76.82% (0.0220 => 0.0389, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 48.54% (0.3469 => 0.5153, std.dev.: 0.0117) New Failures - Execution Time ----------------------------- MultiSource/Applications/hbd/hbd MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/ObjC++/Hello SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/ObjC/bitfield-access-2 SingleSource/UnitTests/ObjC/dot-syntax SingleSource/UnitTests/ObjC/dot-syntax-1 SingleSource/UnitTests/ObjC/dot-syntax-2 SingleSource/UnitTests/ObjC/instance-method-metadata SingleSource/UnitTests/ObjC/messages SingleSource/UnitTests/ObjC/messages-2 SingleSource/UnitTests/ObjC/parameter-passing SingleSource/UnitTests/ObjC/predefined-expr-in-method SingleSource/UnitTests/ObjC/property SingleSource/UnitTests/ObjC/protocols SingleSource/UnitTests/ObjC/synchronized MultiSource/Applications/hbd/hbd: -96.15% (0.0026 => 0.0001) MultiSource/Applications/kimwitu++/kc: -99.85% (0.0648 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (41.7953 => 0.0001) SingleSource/UnitTests/ObjC++/Hello: -93.75% (0.0016 => 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -93.75% (0.0016 => 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -93.75% (0.0016 => 0.0001) SingleSource/UnitTests/ObjC/bitfield-access-2: -93.33% (0.0015 => 0.0001) SingleSource/UnitTests/ObjC/dot-syntax: -93.75% (0.0016 => 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: -93.75% (0.0016 => 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-2: -93.33% (0.0015 => 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -93.75% (0.0016 => 0.0001) SingleSource/UnitTests/ObjC/messages: -94.12% (0.0017 => 0.0001) SingleSource/UnitTests/ObjC/messages-2: -94.12% (0.0017 => 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -94.12% (0.0017 => 0.0001) SingleSource/UnitTests/ObjC/predefined-expr-in-method: -94.12% (0.0017 => 0.0001) SingleSource/UnitTests/ObjC/property: -94.12% (0.0017 => 0.0001) SingleSource/UnitTests/ObjC/protocols: -94.12% (0.0017 => 0.0001) SingleSource/UnitTests/ObjC/synchronized: -99.91% (0.1054 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.80% (0.0625 => 0.0880, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.89% (0.1063 => 0.1402, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.07% (0.2969 => 0.3743, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.50% (0.1106 => 0.1388, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.65% (0.0714 => 0.0890, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.64% (0.4253 => 0.5301, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.38% (0.4139 => 0.5148, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.64% (0.5900 => 0.7295, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 23.32% (1.5932 => 1.9648, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.99% (0.4994 => 0.6142, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.76% (0.5000 => 0.6138, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.60% (0.0584 => 0.0716, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.30% (0.0547 => 0.0669, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 22.04% (0.0599 => 0.0731, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.84% (0.1021 => 0.1244, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.79% (0.1620 => 0.1973, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.63% (0.0897 => 0.1091, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.32% (0.1107 => 0.1343, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.38% (0.0633 => 0.0762, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.26% (0.1604 => 0.1929, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 20.25% (0.0948 => 0.1140, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.09% (0.0642 => 0.0771, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.04% (0.1003 => 0.1204, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.04% (0.3903 => 0.4685, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.03% (0.0584 => 0.0701, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.95% (0.1103 => 0.1323, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.88% (0.1549 => 0.1857, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 19.85% (0.0821 => 0.0984, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.83% (0.0822 => 0.0985, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: 19.37% (0.0604 => 0.0721, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 19.33% (0.1619 => 0.1932, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 18.69% (0.0947 => 0.1124, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.47% (0.1462 => 0.1732, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.07% (0.3890 => 0.4593, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.02% (0.2014 => 0.2377, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.97% (0.2866 => 0.3381, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 17.65% (0.1218 => 0.1433, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 17.62% (0.0698 => 0.0821, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.61% (1.3152 => 1.5468, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: 17.55% (0.4029 => 0.4736, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 17.51% (0.3004 => 0.3530, std.dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.39% (0.2875 => 0.3375, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.32% (0.2736 => 0.3210, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.19% (0.1088 => 0.1275, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 17.01% (0.1505 => 0.1761, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.84% (1.6211 => 1.8941, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.71% (3.5627 => 4.1581, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.71% (0.2729 => 0.3185, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 16.65% (0.2750 => 0.3208, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.65% (0.2738 => 0.3194, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hello: 16.65% (0.2714 => 0.3166, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.59% (0.2911 => 0.3394, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 16.59% (0.2725 => 0.3177, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 16.55% (0.2780 => 0.3240, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 16.52% (1.8794 => 2.1899, std.dev.: 0.0036) MultiSource/Applications/Burg/burg: 16.50% (0.5546 => 0.6461, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 16.40% (0.2823 => 0.3286, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 16.39% (0.2813 => 0.3274, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 16.38% (0.9909 => 1.1532, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/except: 16.36% (0.2811 => 0.3271, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.36% (0.1968 => 0.2290, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.34% (0.4658 => 0.5419, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 16.30% (0.2803 => 0.3260, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.30% (0.2792 => 0.3247, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.29% (0.3271 => 0.3804, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wc: 16.25% (0.3096 => 0.3599, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.22% (0.5026 => 0.5841, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.21% (0.3195 => 0.3713, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.21% (0.1160 => 0.1348, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.04% (2.0673 => 2.3989, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 15.82% (0.3267 => 0.3784, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.82% (0.3362 => 0.3894, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.82% (0.4361 => 0.5051, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 15.72% (0.3258 => 0.3770, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 15.69% (0.1421 => 0.1644, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 15.58% (1.0781 => 1.2461, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 15.57% (23.5202 => 27.1821, std.dev.: 0.6561) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.57% (2.7292 => 3.1540, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.47% (0.3930 => 0.4538, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary2: 15.47% (0.3317 => 0.3830, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.33% (0.3060 => 0.3529, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.29% (4.4195 => 5.0951, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/bh/bh: 15.19% (0.1284 => 0.1479, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 15.12% (0.3678 => 0.4234, std.dev.: 0.0047) MultiSource/Applications/ClamAV/clamscan: 15.04% (4.2109 => 4.8441, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.99% (0.3282 => 0.3774, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.95% (0.3124 => 0.3591, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.80% (1.9694 => 2.2608, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 14.78% (0.3477 => 0.3991, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 14.74% (0.4146 => 0.4757, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 14.67% (0.3348 => 0.3839, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.57% (1.9966 => 2.2876, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 14.47% (0.3726 => 0.4265, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.46% (0.3625 => 0.4149, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.31% (0.1090 => 0.1246, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 14.12% (0.2075 => 0.2368, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 14.02% (0.3496 => 0.3986, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash2: 13.97% (0.4251 => 0.4845, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.97% (0.3981 => 0.4537, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/exceptions-3: 13.93% (0.3460 => 0.3942, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions-2: 13.93% (0.3446 => 0.3926, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.90% (0.3690 => 0.4203, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-4: 13.88% (0.3465 => 0.3946, std.dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 13.87% (0.2566 => 0.2922, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 13.77% (0.3442 => 0.3916, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions: 13.37% (0.3643 => 0.4130, std.dev.: 0.0049) MultiSource/Applications/lua/lua: 13.34% (1.4269 => 1.6172, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/bigfib: 13.29% (0.5012 => 0.5678, std.dev.: 0.0043) MultiSource/Applications/treecc/treecc: 13.07% (0.7875 => 0.8904, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 13.06% (2.1653 => 2.4480, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.65% (0.1383 => 0.1558, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 12.50% (4.6177 => 5.1951, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 12.44% (2.1013 => 2.3627, std.dev.: 0.0600) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.16% (0.2040 => 0.2288, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 11.93% (0.2691 => 0.3012, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.81% (0.6435 => 0.7195, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 11.11% (5.5417 => 6.1574, std.dev.: 0.0134) MultiSource/Applications/lambda-0_1_3/lambda: 10.86% (0.3498 => 0.3878, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.59% (0.2068 => 0.2287, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.56% (0.2737 => 0.3026, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.51% (0.1028 => 0.1136, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 10.21% (0.4847 => 0.5342, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.89% (0.3084 => 0.3389, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 9.75% (0.6634 => 0.7281, std.dev.: 0.0070) MultiSource/Applications/minisat/minisat: 9.74% (0.3336 => 0.3661, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 9.28% (2.0346 => 2.2235, std.dev.: 0.0175) MultiSource/Applications/lemon/lemon: 9.16% (0.2391 => 0.2610, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.94% (0.2103 => 0.2291, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.23% (4.6926 => 5.0787, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.89% (0.5361 => 0.5784, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.00% (0.7426 => 0.7946, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.00% (0.5584 => 0.5975, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.40% (0.3792 => 0.3959, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.12% (0.0734 => 0.0867, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.97% (29.0505 => 33.3986, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.28% (0.5917 => 0.6703, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 10.21% (0.2802 => 0.3088, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6093, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.22% (12.0509 => 12.6801, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.98% (0.3693 => 0.3877, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: 4.85% (0.2122 => 0.2225, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1650, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-2: 4.67% (1.8057 => 1.8900, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.49% (2.0820 => 2.1339, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: 2.41% (14.0481 => 14.3872, std.dev.: 0.1231) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1921, std.dev.: 0.0617) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.53% (3.1722 => 3.2208, std.dev.: 0.0097) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3102, std.dev.: 0.0147) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2851, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5390, std.dev.: 0.0086) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5884, std.dev.: 0.0155) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.81% (25.4195 => 16.5718, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/ary2: -9.20% (0.2402 => 0.2181, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9784, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8000, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9574, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0065) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7748, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -2.93% (17.2379 => 16.7330, std.dev.: 0.1757) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5756, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4960, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1835, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0462, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 03:06:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 05:06:31 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121127110631.DFA872A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6301?compare_to=6297&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6301, Order: 168691, Start Time: 2012-11-27 09:36:26, End Time: 2012-11-27 11:07:03 To: 6297, Order: 168680, Start Time: 2012-11-27 07:45:56, End Time: 2012-11-27 09:19:17 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (30 on baseline) Performance Regressions: 1 (92 on baseline) Performance Improvements: 15 (26 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 39 (38 on baseline) Unchanged Tests: 1037 (855 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 7.31% (20.7761 => 22.2950, std.dev.: 0.4924) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.14% (23.1758 => 22.4473, std.dev.: 0.1921) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.44% (0.9110 => 0.8888, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.73% (0.8682 => 0.8532, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.71% (0.9063 => 0.8908, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.62% (0.9397 => 0.9245, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.56% (0.8664 => 0.8529, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.47% (0.8953 => 0.8821, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.46% (0.8240 => 0.8120, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: -1.45% (2.4693 => 2.4334, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.40% (0.9380 => 0.9249, std.dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: -1.03% (33.0015 => 32.6613, std.dev.: 0.1287) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.01% (1.0232 => 1.0129, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Bullet/bullet: -1.71% (7.2097 => 7.0861, std.dev.: 0.0309) SingleSource/Benchmarks/Misc/flops-3: -1.64% (2.0976 => 2.0631, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.34% (1.4762 => 1.4564, std.dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.35% (1.0804 => 1.0658, std.dev.: 0.0064) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -7.76% (0.0219 => 0.0202, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -17.88% (0.0425 => 0.0349, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.60% (0.0333 => 0.0331, std.dev.: 0.0098) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0313 => 0.0313, std.dev.: 0.0104) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.23% (0.0426 => 0.0425, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -31.53% (0.0203 => 0.0139, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/test1: 0.46% (0.0217 => 0.0218, std.dev.: 0.0073) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 62.50% (0.0008 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.27% (0.1486 => 0.1490, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -5.39% (1.1836 => 1.1198, std.dev.: 0.0137) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.34% (0.4254 => 0.4197, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.16% (0.1433 => 0.1402, std.dev.: 0.0203) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.07% (0.0653 => 0.0660, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.36% (0.0278 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 11.70% (0.0564 => 0.0630, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.07% (1.1958 => 1.1950, std.dev.: 0.0096) MultiSource/Benchmarks/SciMark2-C/scimark2: -0.03% (9.4448 => 9.4419, std.dev.: 0.1325) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 271.43% (0.0007 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0643 => 0.0643, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 60.24% (0.0166 => 0.0266, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.60% (0.7880 => 0.7833, std.dev.: 0.0100) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 112.07% (0.0058 => 0.0123, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/SciMark2-C/scimark2: -66.97% (28.5821 => 9.4419, std.dev.: 0.1325) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.38% (16.4461 => 17.6594, std.dev.: 0.1230) MultiSource/Applications/sqlite3/sqlite3: 2314.67% (0.6332 => 15.2897, std.dev.: 0.2771) MultiSource/Benchmarks/McCat/08-main/main: 48.61% (0.1831 => 0.2721, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.84% (0.1559 => 0.1468, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7087.74% (0.3123 => 22.4473, std.dev.: 0.1921) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.83% (0.2463 => 0.3715, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1533.55% (0.3344 => 5.4626, std.dev.: 0.3050) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.65% (0.2364 => 0.3254, std.dev.: 0.1125) SingleSource/Benchmarks/Misc-C++/bigfib: 4.44% (0.6010 => 0.6277, std.dev.: 0.0207) SingleSource/Benchmarks/Misc/mandel: 2.10% (0.0429 => 0.0438, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.45% (0.3266 => 0.3444, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/strcat: 4.06% (0.1969 => 0.2049, std.dev.: 0.0379) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.89% (0.0224 => 0.0226, std.dev.: 0.0010) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0519, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.05% (0.1462 => 0.1565, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4651, std.dev.: 0.0235) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0700, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4943, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5055, std.dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5487, std.dev.: 0.1754) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3101, std.dev.: 0.0398) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1247, std.dev.: 0.1799) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3631, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3886, std.dev.: 0.0493) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0861, std.dev.: 0.0328) SingleSource/Regression/C/uint64_to_float: -24.11% (2.1832 => 1.6568, std.dev.: 0.0065) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.65% (0.0810 => 0.0953, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.97% (0.0848 => 0.0958, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 12.50% (0.1112 => 0.1251, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.34% (0.2279 => 0.2469, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.03% (0.4847 => 0.5236, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.98% (0.7473 => 0.8069, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.51% (0.2180 => 0.2322, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.44% (0.3137 => 0.3339, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.35% (0.1983 => 0.2109, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.85% (1.1685 => 1.2369, std.dev.: 0.0093) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.77% (0.8321 => 0.8801, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.74% (0.6010 => 0.6355, std.dev.: 0.0133) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.16% (0.2519 => 0.2649, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.2998 => 0.3138, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.39% (1.1606 => 1.2116, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.34% (0.4127 => 0.4306, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.14% (0.4783 => 0.4981, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 4.05% (0.2985 => 0.3106, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 3.83% (1.1271 => 1.1703, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.70% (4.1763 => 4.3309, std.dev.: 0.0251) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.69% (0.9435 => 0.9783, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.63% (1.6386 => 1.6980, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 3.61% (3.8189 => 3.9569, std.dev.: 0.0475) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.54% (1.2526 => 1.2970, std.dev.: 0.0134) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.36% (0.3717 => 0.3842, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.31% (0.4559 => 0.4710, std.dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.30% (6.6074 => 6.8257, std.dev.: 0.0218) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.97% (13.1811 => 13.5723, std.dev.: 0.0430) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.92% (0.8007 => 0.8241, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.89% (0.5817 => 0.5985, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.85% (1.3279 => 1.3657, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.78% (4.4873 => 4.6119, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.53% (0.8611 => 0.8829, std.dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: 2.52% (31.8598 => 32.6613, std.dev.: 0.1287) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.47% (0.8457 => 0.8666, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.43% (0.8697 => 0.8908, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.41% (0.8331 => 0.8532, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: 2.40% (2.3764 => 2.4334, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.25% (0.8261 => 0.8447, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.23% (0.9908 => 1.0129, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.21% (0.8048 => 0.8226, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.21% (0.7932 => 0.8107, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.19% (0.8885 => 0.9080, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.17% (4.4880 => 4.5855, std.dev.: 0.0318) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.16% (0.8286 => 0.8465, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.13% (0.9056 => 0.9249, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.13% (0.9688 => 0.9894, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.11% (0.8204 => 0.8377, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.08% (0.8086 => 0.8254, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.07% (0.8716 => 0.8896, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.03% (0.8359 => 0.8529, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.02% (0.8317 => 0.8485, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.94% (0.8177 => 0.8336, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.94% (0.9069 => 0.9245, std.dev.: 0.0053) MultiSource/Applications/lemon/lemon: 1.94% (1.0945 => 1.1157, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.93% (0.7966 => 0.8120, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.91% (0.8518 => 0.8681, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.91% (0.8069 => 0.8223, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.91% (0.8656 => 0.8821, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.71% (0.8927 => 0.9080, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 1.29% (8.6247 => 8.7357, std.dev.: 0.0348) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 103.52% (0.0199 => 0.0405, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/pi: 57.28% (1.5795 => 2.4842, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 19.13% (0.0528 => 0.0629, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.68% (0.7597 => 0.8940, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.34% (2.9753 => 3.4616, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.65% (2.7995 => 3.2096, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.48% (5.0261 => 5.6029, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.18% (1.1857 => 1.2827, std.dev.: 0.0116) MultiSource/Applications/SIBsim4/SIBsim4: 6.70% (3.1873 => 3.4009, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.68% (4.7794 => 5.0988, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.80% (4.9686 => 5.2568, std.dev.: 0.0430) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.74% (4.5327 => 4.7927, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.30% (0.3186 => 0.3355, std.dev.: 0.0055) MultiSource/Applications/lambda-0_1_3/lambda: 4.93% (7.4933 => 7.8629, std.dev.: 0.0852) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.69% (6.2275 => 6.5197, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.68% (3.3761 => 3.5340, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.07% (4.9453 => 5.1465, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.05% (4.9469 => 5.1473, std.dev.: 0.0336) MultiSource/Applications/hexxagon/hexxagon: 3.95% (14.0064 => 14.5591, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.12% (0.3587 => 0.3699, std.dev.: 0.0040) MultiSource/Applications/siod/siod: 3.03% (3.6643 => 3.7752, std.dev.: 0.0207) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.87% (1.2337 => 1.2691, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.79% (11.5690 => 11.8912, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.74% (8.2783 => 8.5054, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.55% (4.8362 => 4.9595, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.37% (4.8660 => 4.9812, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: 2.34% (7.3375 => 7.5089, std.dev.: 0.0310) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.50% (1.1365 => 1.1536, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.38% (2.4647 => 2.4986, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/neural/neural: 1.28% (1.0841 => 1.0980, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.12% (3.5679 => 3.6078, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -41.97% (2.8951 => 1.6799, std.dev.: 0.2424) MultiSource/Benchmarks/Olden/em3d/em3d: -21.51% (5.4641 => 4.2888, std.dev.: 0.0318) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.27% (7.2130 => 6.3277, std.dev.: 0.0919) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.54% (1.0512 => 0.9299, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/chomp: -11.04% (1.1216 => 0.9978, std.dev.: 0.0277) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.55% (14.6451 => 13.2468, std.dev.: 0.2057) MultiSource/Benchmarks/mafft/pairlocalalign: -8.48% (63.1822 => 57.8266, std.dev.: 0.0817) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.91% (4.7482 => 4.4201, std.dev.: 0.0286) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.33% (0.3269 => 0.3062, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.08% (3.7148 => 3.4888, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.88% (5.4972 => 5.1739, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.14% (5.1557 => 4.8908, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.40% (4.7449 => 4.5361, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.38% (2.4490 => 2.3417, std.dev.: 0.0318) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.79% (6.0224 => 5.7943, std.dev.: 0.0023) MultiSource/Applications/lua/lua: -3.15% (29.8330 => 28.8926, std.dev.: 0.2671) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.03% (0.5807 => 0.5631, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.74% (2.6356 => 2.5634, std.dev.: 0.0163) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.57% (1.2822 => 1.2493, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.48% (9.9065 => 9.6613, std.dev.: 0.0431) MultiSource/Applications/aha/aha: -2.39% (3.3398 => 3.2601, std.dev.: 0.0126) MultiSource/Benchmarks/Olden/bisort/bisort: -2.32% (0.6636 => 0.6482, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.00% (11.5316 => 11.3014, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hash2: -1.67% (3.4237 => 3.3666, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.59% (4.9994 => 4.9198, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.35% (2.3487 => 2.3169, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.86% (1.0262 => 1.0658, std.dev.: 0.0064) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 64.23% (0.0123 => 0.0202, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -14.46% (0.0408 => 0.0349, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0098) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0104) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -26.84% (0.0190 => 0.0139, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0073) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 3.62% (0.1438 => 0.1490, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -1.16% (1.1329 => 1.1198, std.dev.: 0.0137) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.79% (0.4164 => 0.4197, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.41% (0.1369 => 0.1402, std.dev.: 0.0203) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.96% (0.0641 => 0.0660, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.00% (0.0578 => 0.0630, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.49% (1.1437 => 1.1950, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.55% (0.0627 => 0.0643, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.30% (0.8017 => 0.7833, std.dev.: 0.0100) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 98.39% (0.0062 => 0.0123, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 03:48:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 05:48:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121127114820.2B2222A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6302?compare_to=6299&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6302, Order: 168691, Start Time: 2012-11-27 10:16:20, End Time: 2012-11-27 11:48:52 To: 6299, Order: 168681, Start Time: 2012-11-27 08:20:29, End Time: 2012-11-27 09:53:08 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (7 on baseline) Performance Improvements: 0 (182 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1090 (853 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.00% (54.9648 => 56.6124, std.dev.: 0.0919) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.10% (0.9532 => 0.9637, std.dev.: 0.0034) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.73% (54.5751 => 56.6124, std.dev.: 0.0919) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.64% (2.0478 => 2.1019, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: 2.54% (7.4937 => 7.6844, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hash2: 2.03% (3.1932 => 3.2579, std.dev.: 0.0151) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.11% (0.9531 => 0.9637, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.08% (1.5103 => 1.5266, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.46% (0.1431 => 0.1310, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.93% (0.3821 => 0.3518, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.65% (0.3142 => 0.2933, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -6.60% (0.3831 => 0.3578, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.55% (0.3848 => 0.3596, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -6.55% (0.3880 => 0.3626, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.54% (0.3884 => 0.3630, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.54% (0.9542 => 0.8918, std.dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: -6.52% (0.3357 => 0.3138, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -6.52% (2.4924 => 2.3299, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -6.52% (0.3896 => 0.3642, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -6.45% (0.3812 => 0.3566, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -6.37% (0.4033 => 0.3776, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.32% (0.3891 => 0.3645, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.25% (0.4176 => 0.3915, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: -6.20% (0.2160 => 0.2026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.18% (0.2428 => 0.2278, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.96% (0.9852 => 0.9265, std.dev.: 0.0100) MultiSource/Benchmarks/mafft/pairlocalalign: -5.95% (9.2283 => 8.6789, std.dev.: 0.1387) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.89% (0.6484 => 0.6102, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.86% (0.2355 => 0.2217, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -5.83% (0.9179 => 0.8644, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: -5.74% (16.1920 => 15.2621, std.dev.: 0.0059) MultiSource/Applications/JM/ldecod/ldecod: -5.73% (7.0961 => 6.6893, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: -5.72% (0.4199 => 0.3959, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.71% (0.7198 => 0.6787, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.71% (0.5591 => 0.5272, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.70% (1.3722 => 1.2940, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.69% (4.8161 => 4.5421, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.68% (1.0544 => 0.9945, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.68% (0.6304 => 0.5946, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -5.68% (0.1761 => 0.1661, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.68% (0.2695 => 0.2542, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.65% (0.6052 => 0.5710, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.62% (4.0323 => 3.8058, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.58% (0.5805 => 0.5481, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.55% (0.5802 => 0.5480, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.55% (0.5859 => 0.5534, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.54% (0.5925 => 0.5597, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (0.5857 => 0.5533, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -5.52% (1.1530 => 1.0893, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.51% (0.6260 => 0.5915, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.50% (0.5581 => 0.5274, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.50% (4.8802 => 4.6120, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.49% (0.6189 => 0.5849, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.49% (0.5575 => 0.5269, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.48% (0.5478 => 0.5178, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.48% (1.6364 => 1.5468, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.47% (0.3016 => 0.2851, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -5.47% (0.4280 => 0.4046, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.46% (0.5570 => 0.5266, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.45% (3.5339 => 3.3413, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.42% (0.6660 => 0.6299, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.42% (0.5849 => 0.5532, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.41% (0.6446 => 0.6097, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.41% (0.3658 => 0.3460, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.40% (0.5705 => 0.5397, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.39% (0.5863 => 0.5547, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.38% (0.6667 => 0.6308, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.37% (0.5941 => 0.5622, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.37% (0.6297 => 0.5959, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.37% (1.2300 => 1.1640, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.36% (6.7716 => 6.4088, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: -5.36% (0.3025 => 0.2863, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.35% (0.6033 => 0.5710, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.34% (0.5688 => 0.5384, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -5.31% (0.3255 => 0.3082, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.31% (0.6230 => 0.5899, std.dev.: 0.0110) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.31% (4.5069 => 4.2678, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.30% (0.5456 => 0.5167, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: -5.29% (0.2871 => 0.2719, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.29% (0.6676 => 0.6323, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.28% (0.6194 => 0.5867, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.27% (0.2939 => 0.2784, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -5.27% (1.1450 => 1.0847, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.26% (1.2784 => 1.2112, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.25% (0.2933 => 0.2779, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -5.25% (0.4515 => 0.4278, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.25% (0.6440 => 0.6102, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -5.25% (1.3148 => 1.2458, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: -5.24% (1.3864 => 1.3138, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: -5.23% (0.3194 => 0.3027, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.22% (1.4642 => 1.3877, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/except: -5.22% (0.3026 => 0.2868, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.20% (0.4151 => 0.3935, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.20% (0.2903 => 0.2752, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -5.17% (17.1032 => 16.2194, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.14% (0.3057 => 0.2900, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.13% (0.6681 => 0.6338, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.13% (0.6293 => 0.5970, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: -5.12% (0.3205 => 0.3041, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -5.10% (0.3059 => 0.2903, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -5.09% (0.2849 => 0.2704, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.09% (2.1713 => 2.0608, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.06% (0.6736 => 0.6395, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.06% (0.3931 => 0.3732, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -5.06% (0.6347 => 0.6026, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.04% (0.3252 => 0.3088, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.03% (8.0126 => 7.6098, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.03% (0.3323 => 0.3156) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.01% (0.4813 => 0.4572, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -4.99% (0.3406 => 0.3236, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.98% (14.2083 => 13.5003, std.dev.: 0.0139) MultiSource/Benchmarks/MallocBench/gs/gs: -4.97% (4.3330 => 4.1178, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.96% (0.2278 => 0.2165, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: -4.94% (0.4248 => 0.4038, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.92% (0.5999 => 0.5704, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/18-imp/imp: -4.91% (0.3581 => 0.3405, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: -4.91% (0.3481 => 0.3310, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.90% (0.3837 => 0.3649, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.89% (0.8521 => 0.8104, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -4.89% (0.6441 => 0.6126, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -4.88% (0.2989 => 0.2843, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.88% (0.3483 => 0.3313, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.87% (0.7919 => 0.7533, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: -4.85% (0.3446 => 0.3279, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -4.83% (0.4861 => 0.4626, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.81% (0.3849 => 0.3664, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -4.79% (15.5079 => 14.7651, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.79% (0.2548 => 0.2426, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary: -4.77% (0.3394 => 0.3232, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -4.76% (15.2527 => 14.5263, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/bh/bh: -4.76% (0.2985 => 0.2843, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.75% (1.2221 => 1.1640, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: -4.74% (0.2659 => 0.2533, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.74% (0.2385 => 0.2272, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.73% (0.2999 => 0.2857, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.73% (1.2210 => 1.1632, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.72% (0.4321 => 0.4117, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -4.69% (0.3621 => 0.3451, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.69% (0.6395 => 0.6095, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.65% (0.7339 => 0.6998, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -4.65% (0.7447 => 0.7101, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.64% (0.7524 => 0.7175, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: -4.63% (3.5154 => 3.3526, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: -4.61% (0.7779 => 0.7420, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.58% (0.6395 => 0.6102, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -4.58% (4.0594 => 3.8735, std.dev.: 0.0053) MultiSource/Applications/Burg/burg: -4.58% (1.2515 => 1.1942, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: -4.58% (0.3867 => 0.3690, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (0.7021 => 0.6702, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.53% (0.4083 => 0.3898, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.47% (0.5567 => 0.5318, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.45% (0.4916 => 0.4697, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.44% (0.5569 => 0.5322, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.43% (0.4427 => 0.4231, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.38% (1.6474 => 1.5753, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.36% (0.9557 => 0.9140, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.35% (0.5329 => 0.5097, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.32% (22.4056 => 21.4370, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/sieve: -4.30% (0.3788 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -4.22% (34.0927 => 32.6525, std.dev.: 0.0190) MultiSource/Applications/oggenc/oggenc: -4.17% (5.0226 => 4.8131, std.dev.: 0.0025) MultiSource/Applications/treecc/treecc: -4.09% (2.1401 => 2.0525, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: -4.07% (0.4524 => 0.4340, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.04% (0.3319 => 0.3185, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -4.01% (0.6750 => 0.6479, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -4.00% (0.3271 => 0.3140, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -3.96% (2.4021 => 2.3069, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -3.94% (0.8418 => 0.8086, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -3.85% (0.7982 => 0.7675, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.84% (0.9077 => 0.8728, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.78% (0.3491 => 0.3359, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.77% (2.2587 => 2.1735, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: -3.59% (18.2933 => 17.6368, std.dev.: 0.0204) MultiSource/Applications/hbd/hbd: -3.55% (1.5610 => 1.5056, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.96% (5.4682 => 5.3063, std.dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -1.78% (20.7746 => 20.4038, std.dev.: 0.0308) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1961, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -62.59% (1.8100 => 0.6771, std.dev.: 0.0257) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7550, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1728, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.92% (2.2633 => 2.1746, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4736, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 04:34:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 06:34:06 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121127123406.E2A552A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6303?compare_to=6298&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6303, Order: 168691, Start Time: 2012-11-27 10:16:10, End Time: 2012-11-27 12:34:39 To: 6298, Order: 168677, Start Time: 2012-11-27 07:03:53, End Time: 2012-11-27 09:26:24 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 80 (204 on baseline) Performance Improvements: 44 (43 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 962 (638 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 12.78% (0.3137 => 0.3538, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 12.40% (0.8201 => 0.9218, std.dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.86% (0.5818 => 0.6508, std.dev.: 0.0206) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.68% (0.3783 => 0.4225, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.59% (0.3176 => 0.3544, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 11.11% (0.7289 => 0.8099, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.00% (0.1909 => 0.2119, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/wc: 10.87% (0.3338 => 0.3701, std.dev.: 0.0013) SingleSource/Benchmarks/LivermoreLoops/kernel03: 10.73% (0.0997 => 0.1104, std.dev.: 0.0038) MultiSource/Applications/spiff/spiff: 10.68% (0.8974 => 0.9932, std.dev.: 0.0097) SingleSource/Benchmarks/LivermoreLoops/kernel02: 10.44% (0.1054 => 0.1164, std.dev.: 0.0040) SingleSource/Benchmarks/LivermoreLoops/kernel07: 10.34% (0.1044 => 0.1152, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.24% (1.7449 => 1.9236, std.dev.: 0.0137) SingleSource/Benchmarks/LivermoreLoops/kernel08: 10.13% (0.1234 => 0.1359, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.06% (0.3608 => 0.3971, std.dev.: 0.0024) SingleSource/Benchmarks/Stanford/Puzzle: 10.01% (0.1408 => 0.1549, std.dev.: 0.0006) SingleSource/Benchmarks/LivermoreLoops/kernel06: 9.86% (0.1045 => 0.1148, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.56% (1.1171 => 1.2239, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.22% (0.5903 => 0.6447, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.18% (0.3019 => 0.3296, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/04-bisect/bisect: 8.75% (0.1212 => 0.1318, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 8.72% (0.3728 => 0.4053, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/chomp: 8.62% (0.1880 => 0.2042, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.24% (0.1530 => 0.1656, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.23% (0.7597 => 0.8222, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/strcat: 8.19% (0.3149 => 0.3407, std.dev.: 0.0033) MultiSource/Applications/lemon/lemon: 8.04% (1.2032 => 1.2999, std.dev.: 0.0349) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.99% (1.0358 => 1.1186, std.dev.: 0.0209) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.95% (0.5067 => 0.5470, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 7.88% (1.5416 => 1.6631, std.dev.: 0.0399) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.62% (1.2329 => 1.3268, std.dev.: 0.0123) MultiSource/Benchmarks/Olden/bh/bh: 7.49% (0.3349 => 0.3600, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/matrix: 7.16% (0.3381 => 0.3623, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/09-vor/vor: 7.04% (0.3579 => 0.3831, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ary3: 6.99% (0.3593 => 0.3844, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 6.96% (0.3707 => 0.3965, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 6.94% (0.3903 => 0.4174, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ary: 6.92% (0.3540 => 0.3785, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/lists1: 6.87% (0.4074 => 0.4354, std.dev.: 0.0087) MultiSource/Applications/treecc/treecc: 6.74% (2.2927 => 2.4472, std.dev.: 0.0363) SingleSource/Regression/C++/ofstream_ctor: 6.71% (0.3188 => 0.3402, std.dev.: 0.0050) MultiSource/Applications/d/make_dparser: 6.16% (3.9976 => 4.2440, std.dev.: 0.0218) SingleSource/Benchmarks/Misc/flops: 6.07% (0.1960 => 0.2079, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 5.67% (0.4783 => 0.5054, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.38% (0.2417 => 0.2547, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.24% (1.9617 => 2.0645, std.dev.: 0.0391) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.03% (0.9676 => 1.0163, std.dev.: 0.0176) MultiSource/Benchmarks/MallocBench/gs/gs: 4.91% (5.1390 => 5.3913, std.dev.: 0.0131) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.91% (0.4484 => 0.4704, std.dev.: 0.0084) MultiSource/Benchmarks/nbench/nbench: 4.90% (1.4193 => 1.4889, std.dev.: 0.0217) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.80% (0.3357 => 0.3518, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/sieve: 4.12% (0.4291 => 0.4468, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.05% (0.7021 => 0.7305, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/oourafft: 3.82% (0.3797 => 0.3942, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.80% (0.7660 => 0.7951, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.34% (1.6119 => 1.6657, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.02% (2.8489 => 2.9065, std.dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 1.47% (32.0212 => 32.4934, std.dev.: 0.0420) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: 76.56% (0.1045 => 0.1845, std.dev.: 0.0273) MultiSource/Benchmarks/llubenchmark/llu: 53.18% (5.8151 => 8.9075, std.dev.: 0.0296) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 31.50% (0.3410 => 0.4484, std.dev.: 0.0090) MultiSource/Applications/SPASS/SPASS: 30.15% (12.8063 => 16.6669, std.dev.: 0.3629) MultiSource/Benchmarks/McCat/09-vor/vor: 21.48% (0.1192 => 0.1448, std.dev.: 0.0064) MultiSource/Applications/minisat/minisat: 18.76% (9.4963 => 11.2778, std.dev.: 0.4311) MultiSource/Applications/JM/ldecod/ldecod: 13.63% (0.1306 => 0.1484, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.64% (1.7498 => 1.9360, std.dev.: 0.0195) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 9.32% (2.8465 => 3.1119, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout/hash: 6.23% (5.1175 => 5.4362, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 6.16% (0.5327 => 0.5655, std.dev.: 0.0050) SingleSource/Benchmarks/McGill/chomp: 5.35% (1.2093 => 1.2740, std.dev.: 0.0192) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.00% (1.5447 => 1.6220, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout/ary3: 4.05% (4.7919 => 4.9859, std.dev.: 0.0153) MultiSource/Applications/JM/lencod/lencod: 3.05% (8.0805 => 8.3266, std.dev.: 0.0264) MultiSource/Applications/sqlite3/sqlite3: 3.01% (4.5859 => 4.7238, std.dev.: 0.0235) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.26% (4.7038 => 4.8101, std.dev.: 0.0047) MultiSource/Applications/siod/siod: 2.09% (3.3169 => 3.3861, std.dev.: 0.0265) MultiSource/Applications/lua/lua: 1.89% (27.1383 => 27.6509, std.dev.: 0.1180) SingleSource/Benchmarks/Shootout-C++/lists: 1.82% (12.6213 => 12.8513, std.dev.: 0.0135) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.50% (0.9620 => 0.9764, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.15% (3.0415 => 3.0766, std.dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.05% (5.3201 => 4.6257, std.dev.: 0.1564) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -11.93% (0.1341 => 0.1181, std.dev.: 0.0001) MultiSource/Applications/aha/aha: -11.62% (0.1515 => 0.1339, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -11.40% (0.5823 => 0.5159, std.dev.: 0.0192) MultiSource/Benchmarks/MallocBench/espresso/espresso: -10.82% (5.4143 => 4.8285, std.dev.: 0.1774) SingleSource/Benchmarks/Shootout-C++/hash: -10.77% (0.5374 => 0.4795, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -10.66% (1.5006 => 1.3406, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -10.44% (0.1629 => 0.1459, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -10.35% (0.3595 => 0.3223, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -10.00% (0.7062 => 0.6356, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -9.98% (1.4659 => 1.3196, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: -9.94% (0.5705 => 0.5138, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -9.82% (1.6377 => 1.4768, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: -9.40% (1.9170 => 1.7368, std.dev.: 0.0057) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -9.13% (0.1227 => 0.1115, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -9.05% (1.0007 => 0.9101, std.dev.: 0.0129) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.04% (0.2941 => 0.2675, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/health/health: -8.36% (0.1602 => 0.1468, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/mst/mst: -8.18% (0.1479 => 0.1358, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -7.84% (4.7860 => 4.4110, std.dev.: 0.0909) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.78% (5.1479 => 4.7473, std.dev.: 0.0471) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -7.65% (18.2550 => 16.8591, std.dev.: 0.3239) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -7.57% (8.6084 => 7.9565, std.dev.: 0.1807) MultiSource/Applications/kimwitu++/kc: -7.13% (22.5016 => 20.8981, std.dev.: 0.1929) SingleSource/UnitTests/ObjC++/Hello: -6.20% (0.6963 => 0.6531, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -6.13% (7.0053 => 6.5757, std.dev.: 0.0528) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.13% (2.5093 => 2.3555, std.dev.: 0.0529) MultiSource/Applications/SPASS/SPASS: -5.18% (18.9190 => 17.9388, std.dev.: 0.1009) MultiSource/Applications/ClamAV/clamscan: -1.58% (37.6510 => 37.0544, std.dev.: 0.0573) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench: -18.64% (2.5859 => 2.1038, std.dev.: 0.0813) MultiSource/Benchmarks/Olden/bisort/bisort: -14.22% (1.0092 => 0.8657, std.dev.: 0.0322) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -13.27% (7.2996 => 6.3306, std.dev.: 0.0189) MultiSource/Benchmarks/Olden/health/health: -13.06% (0.5315 => 0.4621, std.dev.: 0.0210) SingleSource/Benchmarks/CoyoteBench/lpbench: -12.16% (12.6430 => 11.1061, std.dev.: 0.3609) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -11.72% (6.0865 => 5.3733, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/mst/mst: -11.40% (0.1482 => 0.1313, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: -6.41% (0.8126 => 0.7605, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.37% (0.3357 => 0.3143, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.98% (0.3464 => 0.3326, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: -3.11% (3.8399 => 3.7203, std.dev.: 0.0174) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -2.94% (1.5982 => 1.5512, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/em3d/em3d: -2.31% (3.1831 => 3.1096, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.86% (2.3515 => 2.3078, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.11% (1.3142 => 1.2996, std.dev.: 0.0005) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.20% (69.5524 => 69.4144, std.dev.: 0.2946) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -1.76% (0.1362 => 0.1338) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -12.16% (0.0477 => 0.0419, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.35% (0.0669 => 0.0678, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 0.02% (493.8695 => 493.9540, std.dev.: 0.3541) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.76% (63.2438 => 69.4144, std.dev.: 0.2946) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0419, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43701.90% (1.1277 => 493.9540, std.dev.: 0.3541) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 218.05% (0.5229 => 1.6631, std.dev.: 0.0399) MultiSource/Applications/SPASS/SPASS: 19.68% (14.9895 => 17.9388, std.dev.: 0.1009) MultiSource/Applications/kimwitu++/kc: 47.63% (14.1553 => 20.8981, std.dev.: 0.1929) MultiSource/Benchmarks/MallocBench/gs/gs: 31.16% (4.1105 => 5.3913, std.dev.: 0.0131) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 50.77% (1.1048 => 1.6657, std.dev.: 0.0105) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 433.26% (7.1582 => 38.1720, std.dev.: 0.3097) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.54% (3.4629 => 6.4251, std.dev.: 0.3015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 79.78% (0.6222 => 1.1186, std.dev.: 0.0209) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11464.72% (0.0720 => 8.3266, std.dev.: 0.0264) MultiSource/Applications/SIBsim4/SIBsim4: 3861500.00% (0.0001 => 3.8616, std.dev.: 0.0188) MultiSource/Applications/SPASS/SPASS: 16666800.00% (0.0001 => 16.6669, std.dev.: 0.3629) MultiSource/Applications/kimwitu++/kc: 53500.00% (0.0001 => 0.0536, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 65000.00% (0.0001 => 0.0651, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576000.00% (0.0001 => 0.5761, std.dev.: 0.0267) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10101700.00% (0.0001 => 10.1018, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5947500.00% (0.0001 => 5.9476, std.dev.: 0.4203) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1790.54% (1.1194 => 21.1627, std.dev.: 0.4397) MultiSource/Applications/ClamAV/clamscan: 67.09% (22.1758 => 37.0544, std.dev.: 0.0573) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 66.20% (7.0540 => 11.7240, std.dev.: 0.1836) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.42% (2.9384 => 4.6257, std.dev.: 0.1564) MultiSource/Benchmarks/FreeBench/distray/distray: 52.56% (0.1056 => 0.1611, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 48.47% (8.1363 => 12.0798, std.dev.: 0.2270) MultiSource/Applications/JM/lencod/lencod: 48.12% (21.9371 => 32.4934, std.dev.: 0.0420) SingleSource/Benchmarks/Misc/flops: 45.18% (0.1432 => 0.2079, std.dev.: 0.0019) SingleSource/UnitTests/vla: 44.79% (0.0355 => 0.0514, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 38.53% (0.2554 => 0.3538, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Oscar: 38.36% (0.0636 => 0.0880, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 38.36% (0.0730 => 0.1010, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones/fhourstones: 34.67% (0.1566 => 0.2109, std.dev.: 0.0065) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 33.78% (0.1584 => 0.2119, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 33.17% (0.0793 => 0.1056, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 31.97% (2.2024 => 2.9065, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/n-body: 30.43% (0.0746 => 0.0973, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 30.18% (1.5859 => 2.0645, std.dev.: 0.0391) MultiSource/Applications/minisat/minisat: 29.56% (0.7115 => 0.9218, std.dev.: 0.0166) MultiSource/Benchmarks/McCat/17-bintr/bintr: 29.33% (0.0675 => 0.0873, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: 29.16% (0.0871 => 0.1125, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/15-trie/trie: 28.27% (0.0527 => 0.0676, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 27.76% (0.3307 => 0.4225, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 27.56% (0.2758 => 0.3518, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.48% (0.5105 => 0.6508, std.dev.: 0.0206) MultiSource/Applications/d/make_dparser: 27.24% (3.3354 => 4.2440, std.dev.: 0.0218) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.23% (0.3121 => 0.3971, std.dev.: 0.0024) MultiSource/Applications/spiff/spiff: 26.76% (0.7835 => 0.9932, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout/lists: 26.68% (0.0626 => 0.0793, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: 26.60% (0.0485 => 0.0614, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 26.43% (0.0719 => 0.0909, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 26.30% (0.0886 => 0.1119, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 25.98% (0.8067 => 1.0163, std.dev.: 0.0176) MultiSource/Benchmarks/nbench/nbench: 25.75% (1.1840 => 1.4889, std.dev.: 0.0217) SingleSource/Benchmarks/Misc/whetstone: 25.45% (0.0660 => 0.0828, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 25.45% (0.6456 => 0.8099, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 25.40% (0.0437 => 0.0548, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 25.34% (0.9765 => 1.2239, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.16% (0.0457 => 0.0572, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 25.10% (0.4048 => 0.5064, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 24.79% (1.5415 => 1.9236, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 24.66% (0.5860 => 0.7305, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/spellcheck: 24.65% (0.4203 => 0.5239, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 24.60% (0.1236 => 0.1540, std.dev.: 0.0056) SingleSource/UnitTests/2006-12-11-LoadConstants: 24.58% (0.1143 => 0.1424, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 24.52% (0.3422 => 0.4261, std.dev.: 0.0061) MultiSource/Applications/siod/siod: 24.47% (2.2969 => 2.8590, std.dev.: 0.0856) MultiSource/Applications/viterbi/viterbi: 24.37% (0.1555 => 0.1934, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/Queens: 24.15% (0.0414 => 0.0514, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 24.11% (0.1062 => 0.1318, std.dev.: 0.0010) MultiSource/Benchmarks/llubenchmark/llu: 24.03% (0.0462 => 0.0573, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 24.02% (0.4064 => 0.5040, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/sieve: 24.01% (0.3603 => 0.4468, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.86% (0.1337 => 0.1656, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 23.59% (0.2793 => 0.3452, std.dev.: 0.0067) SingleSource/Benchmarks/McGill/exptree: 23.46% (0.0814 => 0.1005, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 23.38% (0.1655 => 0.2042, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 23.27% (0.6450 => 0.7951, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 23.18% (0.6675 => 0.8222, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 22.97% (0.5981 => 0.7355, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sumcol: 22.59% (0.2891 => 0.3544, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 22.30% (0.3865 => 0.4727, std.dev.: 0.0072) SingleSource/Benchmarks/Stanford/Puzzle: 22.16% (0.1268 => 0.1549, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 22.08% (0.2872 => 0.3506, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 21.94% (0.3423 => 0.4174, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.50% (0.0842 => 0.1023, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/random: 21.48% (0.2802 => 0.3404, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wc: 21.26% (0.3052 => 0.3701, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 21.24% (1.0722 => 1.2999, std.dev.: 0.0349) SingleSource/UnitTests/ObjC/dot-syntax-1: 21.09% (0.0479 => 0.0580, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hello: 21.08% (0.2714 => 0.3286, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.88% (0.2107 => 0.2547, std.dev.: 0.0045) MultiSource/Applications/treecc/treecc: 20.71% (2.0273 => 2.4472, std.dev.: 0.0363) MultiSource/Benchmarks/Olden/tsp/tsp: 20.60% (0.1175 => 0.1417, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/09-vor/vor: 20.47% (0.3180 => 0.3831, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/strcat: 20.35% (0.2831 => 0.3407, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/oourafft: 20.11% (0.3282 => 0.3942, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.99% (4.9449 => 5.9334, std.dev.: 0.1040) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.86% (0.2271 => 0.2722, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/objinst: 19.77% (0.3131 => 0.3750, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 19.66% (0.3387 => 0.4053, std.dev.: 0.0048) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.64% (0.1125 => 0.1346, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 19.59% (0.2756 => 0.3296, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/misr: 19.59% (0.0633 => 0.0757, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.54% (0.3935 => 0.4704, std.dev.: 0.0084) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.42% (0.0834 => 0.0996, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 19.42% (0.0798 => 0.0953, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.37% (0.2700 => 0.3223, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.24% (0.1029 => 0.1227, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists1: 18.19% (0.3684 => 0.4354, std.dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 17.78% (0.0838 => 0.0987, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 17.56% (0.4299 => 0.5054, std.dev.: 0.0076) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.44% (0.0648 => 0.0761, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 17.43% (17.1811 => 20.1751, std.dev.: 0.3631) SingleSource/UnitTests/ObjC/messages-2: 17.37% (0.0662 => 0.0777) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.35% (14.3668 => 16.8591, std.dev.: 0.3239) SingleSource/Benchmarks/Shootout-C++/ary2: 17.34% (0.3379 => 0.3965, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 17.11% (0.0672 => 0.0787, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary: 17.11% (0.3232 => 0.3785, std.dev.: 0.0060) SingleSource/Regression/C++/ofstream_ctor: 17.11% (0.2905 => 0.3402, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary3: 17.09% (0.3283 => 0.3844, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.00% (0.0953 => 0.1115, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 16.95% (0.3098 => 0.3623, std.dev.: 0.0079) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.86% (0.8172 => 0.9550, std.dev.: 0.0412) MultiSource/Benchmarks/Olden/mst/mst: 16.77% (0.1163 => 0.1358, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 16.76% (0.1695 => 0.1979, std.dev.: 0.0062) SingleSource/UnitTests/SignlessTypes/rem: 16.52% (0.1144 => 0.1333, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 16.52% (0.1114 => 0.1298, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 16.47% (0.1906 => 0.2220, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: 16.43% (0.3092 => 0.3600, std.dev.: 0.0042) MultiSource/Applications/aha/aha: 16.33% (0.1151 => 0.1339, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 16.29% (0.0614 => 0.0714, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.23% (0.3826 => 0.4447, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.98% (0.3136 => 0.3637, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/health/health: 15.77% (0.1268 => 0.1468, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.58% (0.0770 => 0.0890, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: 15.53% (0.0818 => 0.0945, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.45% (0.0770 => 0.0889, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.40% (0.1117 => 0.1289, std.dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: 15.24% (9.4845 => 10.9300, std.dev.: 0.3514) MultiSource/Applications/Burg/burg: 15.15% (1.1642 => 1.3406, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 15.01% (0.7433 => 0.8549, std.dev.: 0.0321) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 14.67% (0.3177 => 0.3643, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.44% (0.1032 => 0.1181, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 14.25% (0.3109 => 0.3552, std.dev.: 0.0168) MultiSource/Applications/oggenc/oggenc: 14.18% (5.7591 => 6.5757, std.dev.: 0.0528) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.13% (0.5569 => 0.6356, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 13.91% (3.8723 => 4.4110, std.dev.: 0.0909) SingleSource/UnitTests/ObjC/parameter-passing: 13.45% (0.3927 => 0.4455, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.22% (4.2646 => 4.8285, std.dev.: 0.1774) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.16% (1.3050 => 1.4768, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 13.05% (0.3886 => 0.4393, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.81% (0.3497 => 0.3945, std.dev.: 0.0086) SingleSource/UnitTests/ObjC/trivial-interface: 12.76% (0.3473 => 0.3916, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.74% (0.1625 => 0.1832, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/synchronized: 12.66% (0.3561 => 0.4012, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 12.64% (0.3543 => 0.3991, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.60% (0.3516 => 0.3959, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.59% (0.3543 => 0.3989, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.57% (0.3828 => 0.4309, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.45% (0.1695 => 0.1906, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.39% (0.5020 => 0.5642, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.34% (0.8101 => 0.9101, std.dev.: 0.0129) SingleSource/UnitTests/ObjC/for-in: 12.32% (0.3694 => 0.4149, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.11% (0.4879 => 0.5470, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 11.80% (0.4289 => 0.4795, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.73% (0.0929 => 0.1038) SingleSource/Benchmarks/Shootout-C++/hash2: 11.67% (0.4620 => 0.5159, std.dev.: 0.0192) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.56% (0.2603 => 0.2904, std.dev.: 0.0109) MultiSource/Applications/hbd/hbd: 11.31% (1.5603 => 1.7368, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.26% (1.1861 => 1.3196, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.83% (0.4636 => 0.5138, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.23% (0.5925 => 0.6531, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.08% (0.2430 => 0.2675, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/except: 9.79% (0.2871 => 0.3152, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/fibo: 9.50% (0.2725 => 0.2984, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/ReedSolomon: 8.15% (0.2049 => 0.2216, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.96% (2.2022 => 2.3555, std.dev.: 0.0529) SingleSource/UnitTests/Vector/constpool: 5.33% (54.1659 => 57.0544, std.dev.: 0.2840) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.70% (4.3953 => 11.0189, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 147.46% (5.3999 => 13.3624, std.dev.: 0.0022) MultiSource/Benchmarks/llubenchmark/llu: 135.77% (3.7781 => 8.9075, std.dev.: 0.0296) MultiSource/Benchmarks/McCat/17-bintr/bintr: 76.89% (0.1043 => 0.1845, std.dev.: 0.0273) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 37.71% (0.3256 => 0.4484, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout/ary3: 34.78% (3.6994 => 4.9859, std.dev.: 0.0153) MultiSource/Benchmarks/McCat/09-vor/vor: 25.48% (0.1154 => 0.1448, std.dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 25.04% (13.4384 => 16.8039, std.dev.: 0.9368) MultiSource/Applications/minisat/minisat: 23.72% (9.1159 => 11.2778, std.dev.: 0.4311) SingleSource/Benchmarks/Shootout-C++/moments: 22.69% (0.1159 => 0.1422, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/oourafft: 17.53% (6.6465 => 7.8119, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.61% (1.1145 => 1.2996, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.41% (3.8532 => 4.4469, std.dev.: 0.0453) MultiSource/Applications/JM/ldecod/ldecod: 14.33% (0.1298 => 0.1484, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.98% (0.2944 => 0.3326, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.57% (2.8904 => 3.2247, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/hash: 10.74% (4.9088 => 5.4362, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/richards_benchmark: 10.24% (1.1396 => 1.2563, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.39% (1.7254 => 1.8874, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: 7.81% (3.7221 => 4.0127, std.dev.: 0.1050) MultiSource/Applications/lua/lua: 5.97% (26.0924 => 27.6509, std.dev.: 0.1180) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.78% (4.2280 => 4.4724, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones/fhourstones: 5.62% (1.8329 => 1.9360, std.dev.: 0.0195) SingleSource/Regression/C/uint64_to_float: 5.08% (0.5413 => 0.5688, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: 4.85% (3.8526 => 4.0395, std.dev.: 0.0653) MultiSource/Benchmarks/nbench/nbench: 4.13% (11.6436 => 12.1244, std.dev.: 0.0047) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.36% (0.4162 => 0.4302, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 3.15% (3.2827 => 3.3861, std.dev.: 0.0265) SingleSource/Benchmarks/Shootout-C++/lists: 2.52% (12.5348 => 12.8513, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.35% (1.7133 => 1.7536, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.22% (3.6395 => 3.7203, std.dev.: 0.0174) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.12% (1.3677 => 1.3967, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 2.05% (3.1595 => 3.2244, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 2.01% (0.7455 => 0.7605, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.85% (2.1424 => 2.1820, std.dev.: 0.0139) MultiSource/Applications/sqlite3/sqlite3: 1.72% (4.6441 => 4.7238, std.dev.: 0.0235) MultiSource/Benchmarks/PAQ8p/paq8p: 1.67% (85.0658 => 86.4887, std.dev.: 0.2167) SingleSource/Benchmarks/Shootout-C++/sieve: 1.34% (2.4858 => 2.5191, std.dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.31% (6.5088 => 6.5938, std.dev.: 0.0096) MultiSource/Benchmarks/mafft/pairlocalalign: 1.30% (27.8444 => 28.2050, std.dev.: 0.0697) SingleSource/Benchmarks/Shootout/sieve: 1.22% (5.2139 => 5.2777, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0504, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.31% (6.6874 => 0.1798, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/salsa20: -75.81% (0.8651 => 0.2093, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -74.85% (5.2763 => 1.3268, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/richards_benchmark: -44.33% (0.1622 => 0.0903, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.85% (5.3855 => 4.7473, std.dev.: 0.0471) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.49% (5.3526 => 4.8445, std.dev.: 0.1015) MultiSource/Applications/JM/ldecod/ldecod: -7.96% (10.4361 => 9.6049, std.dev.: 0.1981) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -68.59% (32.5116 => 10.2116, std.dev.: 0.0219) SingleSource/Benchmarks/Dhrystone/fldry: -65.67% (1.9577 => 0.6721, std.dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1681, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.20% (0.0628 => 0.0363, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.36% (0.3987 => 0.2378, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.26% (4.5009 => 2.7788, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.16% (2.6546 => 2.0133, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/mason/mason: -19.34% (0.2161 => 0.1743, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.70% (1.6925 => 1.4268, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2842, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -10.69% (1.5373 => 1.3729, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -9.98% (9.5636 => 8.6089, std.dev.: 0.2020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.05% (1.5660 => 1.4243, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.94% (4.8142 => 4.4802, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.76% (0.3463 => 0.3229, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.57% (2.7294 => 2.5775, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.09% (3.2416 => 3.0766, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.93% (0.8614 => 0.8189, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5077, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -4.32% (6.2999 => 6.0279, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.81% (19.9488 => 19.1892, std.dev.: 0.1798) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.48% (1.6805 => 1.6220, std.dev.: 0.0168) MultiSource/Benchmarks/sim/sim: -3.03% (5.0483 => 4.8952, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.35% (0.4808 => 0.4695, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.94% (0.9957 => 0.9764, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.84% (8.1563 => 8.0065, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -1.50% (10.2830 => 10.1292, std.dev.: 0.0061) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.96% (0.2116 => 0.0678, std.dev.: 0.0010) Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 04:52:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 06:52:11 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121127125211.943D62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6304?compare_to=6301&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6304, Order: 168694, Start Time: 2012-11-27 11:23:50, End Time: 2012-11-27 12:52:42 To: 6301, Order: 168691, Start Time: 2012-11-27 09:36:26, End Time: 2012-11-27 11:07:03 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (30 on baseline) Performance Regressions: 10 (120 on baseline) Performance Improvements: 5 (30 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 39 (38 on baseline) Unchanged Tests: 1038 (823 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.31% (22.4473 => 22.9662, std.dev.: 0.0606) MultiSource/Benchmarks/PAQ8p/paq8p: 1.41% (2.4334 => 2.4676, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 1.14% (2.2848 => 2.3109, std.dev.: 0.0034) MultiSource/Applications/hbd/hbd: 1.06% (1.4730 => 1.4886, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 9.63% (3.6539 => 4.0056, std.dev.: 0.1004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.31% (3.0252 => 3.1557, std.dev.: 0.0354) SingleSource/Benchmarks/Shootout/heapsort: 4.22% (3.0059 => 3.1327, std.dev.: 0.0466) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.15% (2.6754 => 2.7597, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.10% (0.3355 => 0.3459, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: 1.21% (1.3777 => 1.3944, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -4.16% (0.5236 => 0.5018, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/bh/bh: -3.41% (0.3106 => 0.3000, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/except: -3.97% (0.5094 => 0.4892, std.dev.: 0.0063) MultiSource/Applications/SPASS/SPASS: -2.42% (8.5968 => 8.3889, std.dev.: 0.0775) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.15% (2.7916 => 2.7594, std.dev.: 0.0112) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.29% (1.0658 => 1.0627, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -16.34% (0.0202 => 0.0169, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.29% (0.0349 => 0.0350, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -25.98% (0.0331 => 0.0245, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -5.75% (0.0313 => 0.0295, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0425 => 0.0425, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/casts: 23.74% (0.0139 => 0.0172, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: -17.89% (0.0218 => 0.0179, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.67% (0.1490 => 0.1480, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 4.55% (1.1198 => 1.1708, std.dev.: 0.0098) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.48% (0.4197 => 0.4177, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.43% (0.1402 => 0.1436, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -85.71% (0.0007 => 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.03% (0.0660 => 0.0607, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -29.96% (0.0277 => 0.0194, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.05% (0.0630 => 0.0573, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.13% (1.1950 => 1.1966, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 0.03% (9.4419 => 9.4447, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.89% (0.0643 => 0.0573, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.07% (0.0266 => 0.0194, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.82% (0.7833 => 0.7769, std.dev.: 0.0025) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -69.92% (0.0123 => 0.0037, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/SciMark2-C/scimark2: -66.96% (28.5821 => 9.4447, std.dev.: 0.0033) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.74% (16.4461 => 17.7188, std.dev.: 0.0306) MultiSource/Applications/sqlite3/sqlite3: 2325.06% (0.6332 => 15.3555, std.dev.: 0.0517) MultiSource/Benchmarks/McCat/08-main/main: 46.70% (0.1831 => 0.2686, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.12% (0.1559 => 0.1448, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7253.89% (0.3123 => 22.9662, std.dev.: 0.0606) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.29% (0.2463 => 0.3677, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1538.94% (0.3344 => 5.4806, std.dev.: 0.0316) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.03% (0.2364 => 0.3263, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 4.96% (0.6010 => 0.6308, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: 2.80% (0.0429 => 0.0441, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.48% (0.3266 => 0.3445, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 4.72% (0.1969 => 0.2062, std.dev.: 0.0050) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.04% (0.0224 => 0.0242, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -26.09% (0.0230 => 0.0170, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0447, std.dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 6.57% (0.1462 => 0.1558, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4626, std.dev.: 0.0120) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0718, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4952, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5091, std.dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.4932, std.dev.: 0.0638) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3110, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1288, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3627, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3928, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0865, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: -23.97% (2.1832 => 1.6598, std.dev.: 0.0064) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.68% (0.0810 => 0.0937, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/tsp/tsp: 10.97% (0.1112 => 0.1234, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.15% (0.2180 => 0.2314, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.12% (0.8321 => 0.8830, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.97% (0.2279 => 0.2415, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.70% (0.1983 => 0.2096, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 5.24% (1.2222 => 1.2863, std.dev.: 0.0142) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.15% (0.8148 => 0.8568, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.98% (0.3295 => 0.3459, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 4.58% (0.7950 => 0.8314, std.dev.: 0.0123) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.37% (0.2519 => 0.2629, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 4.32% (1.4269 => 1.4886, std.dev.: 0.0053) MultiSource/Applications/siod/siod: 4.17% (2.2184 => 2.3109, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.16% (1.1606 => 1.2089, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.09% (0.4127 => 0.4296, std.dev.: 0.0036) MultiSource/Applications/treecc/treecc: 4.09% (1.9948 => 2.0764, std.dev.: 0.0107) MultiSource/Applications/SPASS/SPASS: 4.07% (14.2605 => 14.8403, std.dev.: 0.0332) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.04% (0.2998 => 0.3119, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.97% (2.1401 => 2.2251, std.dev.: 0.0076) MultiSource/Benchmarks/PAQ8p/paq8p: 3.84% (2.3764 => 2.4676, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 3.72% (0.6834 => 0.7088, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.68% (1.2526 => 1.2987, std.dev.: 0.0063) MultiSource/Applications/lua/lua: 3.56% (3.8189 => 3.9548, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.53% (0.4847 => 0.5018, std.dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: 3.49% (31.8598 => 32.9714, std.dev.: 0.1724) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (1.5315 => 1.5835, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.39% (0.6010 => 0.6214, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.36% (0.6287 => 0.6498, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.34% (0.3717 => 0.3841, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 3.33% (1.2568 => 1.2987, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.33% (1.6386 => 1.6932, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.22% (0.5191 => 0.5358, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.21% (0.8697 => 0.8976, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.20% (13.1811 => 13.6028, std.dev.: 0.0151) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.00% (4.1763 => 4.3015, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.00% (0.8340 => 0.8590, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.99% (0.9074 => 0.9345, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.98% (0.3657 => 0.3766, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.98% (1.4479 => 1.4910, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 2.94% (0.9810 => 1.0098, std.dev.: 0.0095) MultiSource/Benchmarks/nbench/nbench: 2.90% (1.1271 => 1.1598, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.88% (0.9908 => 1.0193, std.dev.: 0.0084) MultiSource/Applications/ClamAV/clamscan: 2.84% (14.7684 => 15.1884, std.dev.: 0.0964) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.81% (1.3279 => 1.3652, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.78% (0.8712 => 0.8954, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.77% (0.8331 => 0.8562, std.dev.: 0.0034) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.77% (6.6074 => 6.7905, std.dev.: 0.0394) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.77% (3.1832 => 3.2714, std.dev.: 0.0206) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.75% (0.8805 => 0.9047, std.dev.: 0.0067) MultiSource/Applications/d/make_dparser: 2.73% (3.2366 => 3.3250, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.71% (0.8656 => 0.8891, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.68% (0.9688 => 0.9948, std.dev.: 0.0054) MultiSource/Applications/lemon/lemon: 2.68% (1.0945 => 1.1238, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.68% (0.4783 => 0.4911, std.dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: 2.66% (4.9628 => 5.0950, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.60% (0.7966 => 0.8173, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.57% (0.8597 => 0.8818, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.52% (0.9039 => 0.9267, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.52% (0.8885 => 0.9109, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.51% (0.8261 => 0.8468, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.51% (0.6586 => 0.6751, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.49% (0.8420 => 0.8630, std.dev.: 0.0053) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (6.7320 => 6.8998, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.42% (0.8177 => 0.8375, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.39% (4.4873 => 4.5946, std.dev.: 0.0138) MultiSource/Applications/JM/lencod/lencod: 2.33% (15.3280 => 15.6852, std.dev.: 0.0269) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.33% (0.8204 => 0.8395, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.30% (0.4559 => 0.4664, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.30% (0.8086 => 0.8272, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.30% (0.8359 => 0.8551, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.26% (0.8069 => 0.8251, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.23% (0.8066 => 0.8246, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.20% (0.8050 => 0.8227, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.19% (0.8855 => 0.9049, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.15% (0.9069 => 0.9264, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.09% (0.8338 => 0.8512, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.02% (4.4880 => 4.5787, std.dev.: 0.0223) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.94% (0.6227 => 0.6348, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.91% (0.8316 => 0.8475, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/football/football: 1.80% (0.8768 => 0.8926, std.dev.: 0.0059) MultiSource/Applications/lambda-0_1_3/lambda: 1.77% (0.7557 => 0.7691, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.74% (0.8518 => 0.8666, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.72% (0.8995 => 0.9150, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.27% (1.2423 => 1.2581, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 97.49% (0.0199 => 0.0393, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/pi: 58.82% (1.5795 => 2.5086, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.45% (2.9753 => 3.4648, std.dev.: 0.0847) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.66% (0.7597 => 0.8787, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.48% (2.7995 => 3.2049, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6085, std.dev.: 0.0229) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.57% (0.3186 => 0.3459, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.10% (1.1857 => 1.2817, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.58% (6.3772 => 6.8603, std.dev.: 0.1129) SingleSource/Benchmarks/Misc/richards_benchmark: 6.96% (1.3037 => 1.3944, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/queens: 6.93% (1.7056 => 1.8238, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.70% (4.7794 => 5.0994, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 6.29% (3.1873 => 3.3877, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.89% (4.5327 => 4.7999, std.dev.: 0.0292) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.82% (4.9686 => 5.2577, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.83% (6.2275 => 6.5283, std.dev.: 0.0099) MultiSource/Applications/lambda-0_1_3/lambda: 4.65% (7.4933 => 7.8419, std.dev.: 0.0636) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.63% (3.3761 => 3.5325, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.11% (4.9453 => 5.1484, std.dev.: 0.0110) MultiSource/Applications/hexxagon/hexxagon: 3.91% (14.0064 => 14.5535, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.41% (3.0515 => 3.1557, std.dev.: 0.0354) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.01% (0.3587 => 0.3695, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.86% (1.2337 => 1.2690, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.86% (11.5690 => 11.8996, std.dev.: 0.0129) MultiSource/Applications/siod/siod: 2.82% (3.6643 => 3.7675, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.66% (8.2783 => 8.4987, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout/lists: 2.55% (7.3375 => 7.5245, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.33% (4.8660 => 4.9793, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.01% (4.8362 => 4.9334, std.dev.: 0.0346) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.96% (1.1365 => 1.1588, std.dev.: 0.0045) MultiSource/Applications/spiff/spiff: 1.92% (2.8561 => 2.9110, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.78% (4.4340 => 4.5128, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/power/power: 1.48% (1.2061 => 1.2239, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.38% (3.5679 => 3.6171, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.35% (2.4647 => 2.4979, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/ReedSolomon: 1.24% (8.5322 => 8.6383, std.dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -41.99% (2.8951 => 1.6794, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: -20.98% (5.4641 => 4.3178, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.56% (7.2130 => 6.3792, std.dev.: 0.1275) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.77% (1.0512 => 0.9380, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.63% (1.1216 => 1.0024, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.75% (0.3269 => 0.2983, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.68% (14.6451 => 13.3736, std.dev.: 0.2022) MultiSource/Benchmarks/mafft/pairlocalalign: -8.35% (63.1822 => 57.9036, std.dev.: 0.0341) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.87% (4.7482 => 4.4221, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.01% (3.7148 => 3.4916, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.65% (5.4972 => 5.1864, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.05% (5.1557 => 4.8951, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -4.86% (3.2926 => 3.1327, std.dev.: 0.0466) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.34% (4.7449 => 4.5388, std.dev.: 0.0403) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.10% (2.8773 => 2.7594, std.dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.04% (2.4490 => 2.3501, std.dev.: 0.0286) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.69% (6.0224 => 5.7999, std.dev.: 0.0061) MultiSource/Applications/lua/lua: -3.36% (29.8330 => 28.8296, std.dev.: 0.0293) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.96% (0.5807 => 0.5635, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.82% (2.6356 => 2.5612, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.46% (9.9065 => 9.6632, std.dev.: 0.0302) MultiSource/Applications/aha/aha: -2.40% (3.3398 => 3.2596, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/hash2: -2.23% (3.4237 => 3.3472, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bisort/bisort: -2.05% (0.6636 => 0.6500, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.98% (11.5316 => 11.3036, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.77% (3.2169 => 3.1601, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.51% (4.9994 => 4.9240, std.dev.: 0.0146) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.36% (2.3487 => 2.3168, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.11% (5.6343 => 5.5720, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/ffbench: -1.03% (1.4296 => 1.4149, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.56% (1.0262 => 1.0627, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 37.40% (0.0123 => 0.0169, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -14.22% (0.0408 => 0.0350, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.54% (0.0254 => 0.0245, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.32% (0.0302 => 0.0295, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/casts: -9.47% (0.0190 => 0.0172, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: -0.56% (0.0180 => 0.0179, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.92% (0.1438 => 0.1480, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 3.35% (1.1329 => 1.1708, std.dev.: 0.0098) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.31% (0.4164 => 0.4177, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.89% (0.1369 => 0.1436, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.30% (0.0641 => 0.0607, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.51% (0.0195 => 0.0194, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.87% (0.0578 => 0.0573, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.63% (1.1437 => 1.1966, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.61% (0.0627 => 0.0573, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.78% (0.0180 => 0.0194, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.09% (0.8017 => 0.7769, std.dev.: 0.0025) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -40.32% (0.0062 => 0.0037, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 05:44:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 07:44:03 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121127134403.14EA22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6305?compare_to=6302&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6305, Order: 168694, Start Time: 2012-11-27 12:12:11, End Time: 2012-11-27 13:44:34 To: 6302, Order: 168691, Start Time: 2012-11-27 10:16:20, End Time: 2012-11-27 11:48:52 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 1 (182 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (856 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.07% (0.9637 => 0.9534, std.dev.: 0.0022) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.86% (2.0478 => 2.1064, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/salsa20: 2.43% (7.4937 => 7.6759, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/hash2: 2.13% (3.1932 => 3.2612, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.74% (0.1431 => 0.1306, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.51% (0.3821 => 0.3534, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.46% (0.3142 => 0.2939, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.30% (0.9542 => 0.8941, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: -6.29% (0.3357 => 0.3146, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -6.28% (2.4924 => 2.3358, std.dev.: 0.0165) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.22% (0.2428 => 0.2277, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -6.11% (0.3812 => 0.3579, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -6.11% (0.3831 => 0.3597, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.08% (0.3880 => 0.3644, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/synchronized: -6.06% (0.3896 => 0.3660, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.06% (0.3848 => 0.3615, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -6.02% (0.2160 => 0.2030, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.00% (0.3884 => 0.3651, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.93% (0.4033 => 0.3794, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -5.90% (9.2283 => 8.6841, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.88% (0.9852 => 0.9273, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.86% (0.6484 => 0.6104, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: -5.84% (0.4176 => 0.3932, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.82% (0.2355 => 0.2218) MultiSource/Applications/JM/lencod/lencod: -5.81% (16.1920 => 15.2511, std.dev.: 0.0096) MultiSource/Applications/JM/ldecod/ldecod: -5.81% (7.0961 => 6.6840, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.79% (0.5857 => 0.5518, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: -5.78% (0.9179 => 0.8648, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.78% (0.3891 => 0.3666, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.77% (1.0544 => 0.9936, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.75% (0.5863 => 0.5526, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.71% (0.5478 => 0.5165, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -5.68% (0.1761 => 0.1661, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.67% (0.5925 => 0.5589, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.67% (0.7198 => 0.6790, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.63% (0.3658 => 0.3452, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.61% (1.3722 => 1.2952, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.61% (0.5849 => 0.5521, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.59% (0.5705 => 0.5386, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.58% (0.6260 => 0.5911, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.57% (0.6230 => 0.5883, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.57% (0.5802 => 0.5479, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.56% (4.8161 => 4.5481, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.56% (0.5805 => 0.5482, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.54% (0.6052 => 0.5717, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.54% (4.0323 => 3.8091, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.52% (0.6304 => 0.5956, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.52% (6.7716 => 6.3980, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.49% (0.6194 => 0.5854, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.48% (1.2300 => 1.1626, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.48% (0.6297 => 0.5952, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.46% (0.5570 => 0.5266, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.45% (0.4199 => 0.3970, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.45% (0.6660 => 0.6297, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.44% (4.8802 => 4.6148, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.44% (0.5591 => 0.5287, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.41% (0.6667 => 0.6306, std.dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: -5.41% (1.1530 => 1.0906, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.41% (0.5581 => 0.5279, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.41% (1.6364 => 1.5479, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.40% (0.5575 => 0.5274, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.38% (0.2695 => 0.2550, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.37% (0.6736 => 0.6374, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.37% (0.7919 => 0.7494, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.36% (0.5859 => 0.5545, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.34% (0.6293 => 0.5957, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.34% (0.5941 => 0.5624, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.33% (0.6676 => 0.6320, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.33% (0.6189 => 0.5859, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.33% (3.5339 => 3.3455, std.dev.: 0.0136) MultiSource/Applications/lemon/lemon: -5.31% (1.1450 => 1.0842, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.31% (0.6446 => 0.6104, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.31% (4.5069 => 4.2678, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/05-eks/eks: -5.29% (0.4515 => 0.4276, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.26% (1.4642 => 1.3872, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.22% (0.6681 => 0.6332, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.22% (0.8521 => 0.8076, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/fibo: -5.19% (0.2871 => 0.2722, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -5.19% (0.4280 => 0.4058, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -5.17% (4.3330 => 4.1092, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.15% (0.6033 => 0.5722, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: -5.15% (0.6347 => 0.6020, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.14% (14.2083 => 13.4783, std.dev.: 0.0188) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.13% (1.2784 => 1.2128, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.12% (0.5688 => 0.5397, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.10% (8.0126 => 7.6038, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.07% (0.3016 => 0.2863, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -5.07% (0.2939 => 0.2790, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.07% (0.5999 => 0.5695, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.06% (0.6440 => 0.6114, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.05% (1.2210 => 1.1593, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -5.05% (0.3406 => 0.3234) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.05% (0.2278 => 0.2163, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.05% (0.2933 => 0.2785, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -5.03% (0.2985 => 0.2835, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -5.00% (0.6441 => 0.6119, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.00% (0.3483 => 0.3309, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.00% (0.3323 => 0.3157, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.97% (0.2999 => 0.2850, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.96% (0.4151 => 0.3945, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -4.96% (0.3205 => 0.3046, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.96% (0.2903 => 0.2759, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: -4.96% (0.3025 => 0.2875, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -4.95% (0.2849 => 0.2708, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -4.94% (1.3148 => 1.2498, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -4.93% (17.1032 => 16.2602, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/except: -4.92% (0.3026 => 0.2877, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.92% (0.4916 => 0.4674, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.91% (0.3057 => 0.2907, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.91% (0.2548 => 0.2423, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.89% (2.1713 => 2.0651, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: -4.89% (0.3581 => 0.3406, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -4.88% (0.3255 => 0.3096, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.88% (0.3931 => 0.3739, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -4.88% (0.3194 => 0.3038, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.86% (0.2385 => 0.2269, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -4.85% (0.2659 => 0.2530, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -4.83% (0.3394 => 0.3230, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.82% (0.3837 => 0.3652, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -4.82% (1.3864 => 1.3196, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: -4.82% (0.2989 => 0.2845, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.82% (0.6395 => 0.6087, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.80% (1.2221 => 1.1634, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: -4.79% (0.3446 => 0.3281, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.77% (0.7779 => 0.7408, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: -4.75% (1.2515 => 1.1920, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.75% (0.5456 => 0.5197, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -4.74% (3.5154 => 3.3489, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: -4.73% (15.5079 => 14.7745, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.72% (0.4321 => 0.4117, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -4.71% (0.3481 => 0.3317, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.70% (0.3849 => 0.3668, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.64% (0.3059 => 0.2917, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.64% (0.7524 => 0.7175, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.63% (0.7339 => 0.6999, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.62% (0.5168 => 0.4929, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -4.59% (0.4248 => 0.4053, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.58% (0.3252 => 0.3103, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -4.58% (4.0594 => 3.8735, std.dev.: 0.0059) MultiSource/Applications/ClamAV/clamscan: -4.57% (15.2527 => 14.5550, std.dev.: 0.0118) MultiSource/Applications/minisat/minisat: -4.55% (0.7447 => 0.7108, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.55% (0.4813 => 0.4594, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: -4.53% (0.4861 => 0.4641, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.53% (0.5569 => 0.5317, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.50% (0.6395 => 0.6107, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -4.50% (0.3621 => 0.3458, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -4.49% (2.1401 => 2.0441, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.45% (1.6474 => 1.5741, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.43% (0.4083 => 0.3902, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: -4.42% (0.3867 => 0.3696, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.37% (0.5567 => 0.5324, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.32% (0.9077 => 0.8685, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.26% (0.7021 => 0.6722, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -4.19% (5.0226 => 4.8120, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.18% (0.4427 => 0.4242, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.17% (0.9557 => 0.9158, std.dev.: 0.0020) MultiSource/Applications/siod/siod: -4.16% (2.4021 => 2.3021, std.dev.: 0.0143) MultiSource/Benchmarks/Bullet/bullet: -4.15% (34.0927 => 32.6790, std.dev.: 0.0112) MultiSource/Benchmarks/McCat/09-vor/vor: -4.10% (0.3271 => 0.3137, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.09% (0.5329 => 0.5111, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: -4.09% (0.4524 => 0.4339, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.09% (22.4056 => 21.4900, std.dev.: 0.0119) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.07% (0.3319 => 0.3184, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: -3.97% (18.2933 => 17.5676, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/sieve: -3.93% (0.3788 => 0.3639, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -3.92% (0.8418 => 0.8088, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: -3.81% (0.7982 => 0.7678, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -3.78% (0.6750 => 0.6495, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.72% (2.2587 => 2.1746, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.61% (0.3491 => 0.3365, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: -3.24% (1.5610 => 1.5105, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -2.63% (20.7746 => 20.2280, std.dev.: 0.0775) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.59% (5.4682 => 5.3267, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1957, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -62.64% (1.8100 => 0.6763, std.dev.: 0.0095) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7499, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1723, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: -4.01% (2.2633 => 2.1726, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.50% (6.5735 => 6.4750, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 06:32:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 08:32:25 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121127143225.451C62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6306?compare_to=6300&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6306, Order: 168694, Start Time: 2012-11-27 11:12:11, End Time: 2012-11-27 14:32:57 To: 6300, Order: 168677, Start Time: 2012-11-27 06:59:19, End Time: 2012-11-27 10:23:51 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Passes: 36 (0 on baseline) Performance Regressions: 5 (173 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1050 (718 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Applications/hbd/hbd MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/ObjC++/Hello SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/ObjC/bitfield-access-2 SingleSource/UnitTests/ObjC/dot-syntax SingleSource/UnitTests/ObjC/dot-syntax-1 SingleSource/UnitTests/ObjC/dot-syntax-2 SingleSource/UnitTests/ObjC/instance-method-metadata SingleSource/UnitTests/ObjC/messages SingleSource/UnitTests/ObjC/messages-2 SingleSource/UnitTests/ObjC/parameter-passing SingleSource/UnitTests/ObjC/predefined-expr-in-method SingleSource/UnitTests/ObjC/property SingleSource/UnitTests/ObjC/protocols SingleSource/UnitTests/ObjC/synchronized MultiSource/Applications/hbd/hbd: -1.54% (1.1423 => 1.1247, std.dev.: 0.0042) MultiSource/Applications/kimwitu++/kc: -0.90% (12.8402 => 12.7240, std.dev.: 0.0223) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.10% (12.4254 => 12.5616, std.dev.: 0.0089) SingleSource/UnitTests/ObjC++/Hello: -15.38% (0.8129 => 0.6879, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: -14.90% (0.9756 => 0.8302, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference-object: -15.07% (0.8195 => 0.6960, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/bitfield-access-2: -29.03% (0.0403 => 0.0286, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/dot-syntax: -22.52% (0.0413 => 0.0320, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: -18.81% (0.0489 => 0.0397, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/dot-syntax-2: -29.28% (0.0321 => 0.0227, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -23.07% (0.5179 => 0.3984, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/messages: -25.61% (0.0367 => 0.0273, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/messages-2: -18.15% (0.0584 => 0.0478, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -21.95% (0.5418 => 0.4229, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/predefined-expr-in-method: -31.99% (0.0297 => 0.0202, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -22.24% (0.5342 => 0.4154, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/protocols: -32.13% (0.0389 => 0.0264, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: -23.15% (0.5153 => 0.3960, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/hbd/hbd MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/ObjC++/Hello SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/ObjC/bitfield-access-2 SingleSource/UnitTests/ObjC/dot-syntax SingleSource/UnitTests/ObjC/dot-syntax-1 SingleSource/UnitTests/ObjC/dot-syntax-2 SingleSource/UnitTests/ObjC/instance-method-metadata SingleSource/UnitTests/ObjC/messages SingleSource/UnitTests/ObjC/messages-2 SingleSource/UnitTests/ObjC/parameter-passing SingleSource/UnitTests/ObjC/predefined-expr-in-method SingleSource/UnitTests/ObjC/property SingleSource/UnitTests/ObjC/protocols SingleSource/UnitTests/ObjC/synchronized MultiSource/Applications/hbd/hbd: 2500.00% (0.0001 => 0.0026) MultiSource/Applications/kimwitu++/kc: 65700.00% (0.0001 => 0.0658, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 40848000.00% (0.0001 => 40.8481, std.dev.: 0.0069) SingleSource/UnitTests/ObjC++/Hello: 1500.00% (0.0001 => 0.0016, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 1500.00% (0.0001 => 0.0016, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 1500.00% (0.0001 => 0.0016) SingleSource/UnitTests/ObjC/bitfield-access-2: 1500.00% (0.0001 => 0.0016) SingleSource/UnitTests/ObjC/dot-syntax: 1500.00% (0.0001 => 0.0016) SingleSource/UnitTests/ObjC/dot-syntax-1: 1500.00% (0.0001 => 0.0016, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/dot-syntax-2: 1500.00% (0.0001 => 0.0016) SingleSource/UnitTests/ObjC/instance-method-metadata: 1500.00% (0.0001 => 0.0016, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/messages: 1600.00% (0.0001 => 0.0017) SingleSource/UnitTests/ObjC/messages-2: 1600.00% (0.0001 => 0.0017, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 1600.00% (0.0001 => 0.0017) SingleSource/UnitTests/ObjC/predefined-expr-in-method: 1600.00% (0.0001 => 0.0017) SingleSource/UnitTests/ObjC/property: 1600.00% (0.0001 => 0.0017, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/protocols: 1600.00% (0.0001 => 0.0017) SingleSource/UnitTests/ObjC/synchronized: 104900.00% (0.0001 => 0.1050, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel05: 2.55% (0.5419 => 0.5557, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.14% (125.6299 => 128.3175, std.dev.: 0.8527) SingleSource/Benchmarks/Dhrystone/dry: 1.80% (14.3872 => 14.6458, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.14% (54.2052 => 54.8238, std.dev.: 0.0814) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.10% (1.3461 => 1.3609, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.61% (2.1339 => 2.0781, std.dev.: 0.0137) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.76% (0.0625 => 0.0886, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.55% (0.1063 => 0.1409, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.47% (0.2969 => 0.3755, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.89% (0.4253 => 0.5354, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.59% (0.1106 => 0.1389, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.86% (0.4139 => 0.5168, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.51% (0.0714 => 0.0889, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 24.11% (1.5932 => 1.9773, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.79% (0.0475 => 0.0588, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.75% (0.4994 => 0.6180, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.47% (0.5900 => 0.7285, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.46% (0.0584 => 0.0721, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.96% (0.5000 => 0.6148, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.22% (0.1620 => 0.1980, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.04% (0.1021 => 0.1246, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.77% (0.1107 => 0.1348, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.74% (0.0897 => 0.1092, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.72% (0.0584 => 0.0705, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.72% (0.0642 => 0.0775, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.70% (0.0633 => 0.0764, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.58% (0.1103 => 0.1330, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 20.57% (0.0948 => 0.1143, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.24% (0.3903 => 0.4693, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 20.22% (0.0821 => 0.0987, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.14% (0.1549 => 0.1861, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.04% (0.1003 => 0.1204, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.95% (0.0822 => 0.0986, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/05-eks/eks: 19.77% (0.1619 => 0.1939, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.76% (0.1604 => 0.1921, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 19.70% (0.0604 => 0.0723, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 19.01% (0.0947 => 0.1127, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.81% (0.1462 => 0.1737, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 18.69% (0.0808 => 0.0959, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.68% (0.2736 => 0.3247, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.43% (0.3890 => 0.4607, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.42% (0.2014 => 0.2385, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 18.19% (0.5889 => 0.6960, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 18.07% (0.5826 => 0.6879, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 17.98% (0.1218 => 0.1437, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 17.92% (0.4029 => 0.4751, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.81% (1.3152 => 1.5495, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.66% (0.0572 => 0.0673, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.65% (0.1088 => 0.1280, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 17.62% (0.0698 => 0.0821, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 17.34% (0.1505 => 0.1766, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.31% (0.2866 => 0.3362, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.13% (3.5627 => 4.1731, std.dev.: 0.0036) MultiSource/Applications/Burg/burg: 16.97% (0.5546 => 0.6487, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 16.79% (1.8794 => 2.1950, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.78% (1.6211 => 1.8931, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.77% (0.1968 => 0.2298, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.77% (0.4658 => 0.5439, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 16.69% (0.0605 => 0.0706, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.66% (0.2875 => 0.3354, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.55% (0.1160 => 0.1352, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.48% (0.3271 => 0.3810, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.39% (0.5026 => 0.5850, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 16.15% (0.2750 => 0.3194, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.06% (0.3930 => 0.4561, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 16.05% (0.1421 => 0.1649, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.00% (0.2738 => 0.3176, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 15.98% (0.9697 => 1.1247, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hello: 15.95% (0.2714 => 0.3147, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.95% (2.7292 => 3.1646, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.91% (0.2911 => 0.3374, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 15.89% (0.2725 => 0.3158, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 15.85% (0.2813 => 0.3259, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.84% (0.4361 => 0.5052, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 15.83% (0.2823 => 0.3270, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 15.83% (0.2780 => 0.3220, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.79% (4.4195 => 5.1175, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.79% (0.2729 => 0.3160, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 15.77% (0.7171 => 0.8302, std.dev.: 0.0034) SingleSource/Regression/C++/ofstream_ctor: 15.75% (0.3004 => 0.3477, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 15.69% (0.2811 => 0.3252, std.dev.: 0.0054) MultiSource/Applications/d/make_dparser: 15.69% (1.0781 => 1.2472, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.65% (0.2792 => 0.3229, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 15.63% (0.2803 => 0.3241, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 15.60% (0.3096 => 0.3579, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 15.58% (0.1284 => 0.1484, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 15.54% (0.9909 => 1.1449, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 15.53% (4.2109 => 4.8649, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.49% (0.3195 => 0.3690, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.36% (2.0673 => 2.3849, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary3: 15.24% (0.3267 => 0.3765, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.18% (1.9694 => 2.2683, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ary: 15.16% (0.3258 => 0.3752, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 15.13% (23.5202 => 27.0782, std.dev.: 0.0226) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.01% (1.9966 => 2.2962, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary2: 14.92% (0.3317 => 0.3812, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.90% (0.3060 => 0.3516, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.77% (0.1090 => 0.1251, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.63% (0.3124 => 0.3581, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 14.41% (0.2075 => 0.2374, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 14.34% (0.3446 => 0.3940, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 14.33% (0.3678 => 0.4205, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 14.31% (0.3465 => 0.3961, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.31% (0.3362 => 0.3843, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.26% (0.3282 => 0.3750, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 14.25% (0.3348 => 0.3825, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 14.24% (0.3496 => 0.3994, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.22% (0.3488 => 0.3984, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 14.22% (0.3460 => 0.3952, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 14.15% (0.3469 => 0.3960, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 14.12% (0.3442 => 0.3928, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 14.11% (0.2566 => 0.2928, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 13.94% (0.3643 => 0.4151, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 13.93% (0.3726 => 0.4245, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 13.92% (0.3477 => 0.3961, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 13.81% (0.3650 => 0.4154, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.79% (0.3625 => 0.4125, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 13.75% (0.4146 => 0.4716, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 13.67% (1.4269 => 1.6219, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/parameter-passing: 13.56% (0.3724 => 0.4229, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/hash2: 13.48% (0.4251 => 0.4824, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.44% (0.3981 => 0.4516, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.41% (0.3690 => 0.4185, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 13.33% (0.7875 => 0.8925, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 13.32% (0.0758 => 0.0859, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.24% (0.3845 => 0.4354, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 13.00% (2.1653 => 2.4467, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 12.91% (2.1013 => 2.3725, std.dev.: 0.0049) MultiSource/Applications/JM/lencod/lencod: 12.86% (4.6177 => 5.2114, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 12.69% (0.5012 => 0.5648, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.58% (0.1383 => 0.1557, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 12.45% (0.2691 => 0.3026, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.25% (0.2040 => 0.2290, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.52% (0.6435 => 0.7176, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11.30% (5.5417 => 6.1677, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: 10.61% (0.3498 => 0.3869, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.51% (0.1028 => 0.1136, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.34% (0.2737 => 0.3020, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.30% (0.2068 => 0.2281, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 10.25% (0.4847 => 0.5344, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.05% (0.3084 => 0.3394, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 9.81% (0.6634 => 0.7285, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 9.50% (0.3336 => 0.3653, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 9.50% (2.0346 => 2.2279, std.dev.: 0.0057) MultiSource/Applications/lemon/lemon: 9.45% (0.2391 => 0.2617, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.03% (0.2103 => 0.2293, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.19% (0.5361 => 0.5800, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.16% (4.6926 => 5.0755, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.92% (11.6398 => 12.5616, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.41% (0.5584 => 0.5998, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.41% (0.7426 => 0.7976, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 6.43% (11.9555 => 12.7240, std.dev.: 0.0223) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.93% (0.3792 => 0.3979, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.98% (29.0505 => 33.4011, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 8.89% (0.2802 => 0.3051, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6120, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6721, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1702, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-2: 4.61% (1.8057 => 1.8889, std.dev.: 0.0049) SingleSource/Benchmarks/Dhrystone/dry: 4.25% (14.0481 => 14.6458, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.03% (0.3693 => 0.3842, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2046, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2220, std.dev.: 0.0036) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3034, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.32% (7.1849 => 7.2800, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5120, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5895, std.dev.: 0.0115) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5664, std.dev.: 0.0224) SingleSource/Benchmarks/Shootout-C++/ary2: -8.03% (0.2402 => 0.2209, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9758, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8003, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8027, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0058) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7725, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5184, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -2.85% (17.2379 => 16.7467, std.dev.: 0.0424) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.27% (41.7953 => 40.8481, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5730, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4951, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.1983, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0421, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 06:50:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 08:50:45 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121127145045.346D82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6307?compare_to=6304&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6307, Order: 168698, Start Time: 2012-11-27 13:21:51, End Time: 2012-11-27 14:51:16 To: 6304, Order: 168694, Start Time: 2012-11-27 11:23:50, End Time: 2012-11-27 12:52:42 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (30 on baseline) Performance Regressions: 19 (130 on baseline) Performance Improvements: 1 (28 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 39 (38 on baseline) Unchanged Tests: 1033 (815 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/viterbi/viterbi: 6.58% (0.1612 => 0.1718, std.dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: 5.76% (0.2967 => 0.3138, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.69% (0.7646 => 0.8081, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.65% (0.6214 => 0.6503, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 2.98% (0.3459 => 0.3562, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.93% (0.6117 => 0.6296, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.91% (0.5018 => 0.5164, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.68% (1.2556 => 1.2893, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.65% (0.8830 => 0.9064, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/05-eks/eks: 2.51% (0.4385 => 0.4495, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.33% (4.5766 => 4.6832, std.dev.: 0.0141) MultiSource/Benchmarks/MallocBench/gs/gs: 2.02% (4.2365 => 4.3220, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.85% (8.7863 => 8.9492, std.dev.: 0.0253) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.78% (0.6348 => 0.6461, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.18% (0.9732 => 0.9847, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: 12.53% (0.0798 => 0.0898, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 9.05% (21.0477 => 22.9523, std.dev.: 0.1554) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.03% (1.3220 => 1.4414, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.39% (0.8635 => 0.8841, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.91% (60.3041 => 58.5513, std.dev.: 0.5487) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.63% (1.0627 => 1.0694, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 28.99% (0.0169 => 0.0218, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 22.29% (0.0350 => 0.0428, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.43% (0.0245 => 0.0322, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.76% (0.0295 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -12.24% (0.0425 => 0.0373, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: 18.60% (0.0172 => 0.0204, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -25.70% (0.0179 => 0.0133, std.dev.: 0.0041) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: - (0.1480 => 0.1480, std.dev.: 0.0095) MultiSource/Applications/lemon/lemon: -0.86% (1.1708 => 1.1607, std.dev.: 0.0165) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.62% (0.4177 => 0.4203, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.72% (0.1436 => 0.1397, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.94% (0.0607 => 0.0577, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.78% (0.0194 => 0.0277, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.05% (0.0573 => 0.0567, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.15% (1.1966 => 1.1948, std.dev.: 0.0112) MultiSource/Benchmarks/SciMark2-C/scimark2: -0.05% (9.4447 => 9.4401, std.dev.: 0.0605) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.09% (0.0573 => 0.0561, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.58% (0.0194 => 0.0199, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.76% (0.7769 => 0.7828, std.dev.: 0.0087) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 59.46% (0.0037 => 0.0059, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/SciMark2-C/scimark2: -66.97% (28.5821 => 9.4401, std.dev.: 0.0605) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.41% (16.4461 => 17.6644, std.dev.: 0.1217) MultiSource/Applications/sqlite3/sqlite3: 2319.52% (0.6332 => 15.3204, std.dev.: 0.0461) MultiSource/Benchmarks/McCat/08-main/main: 47.68% (0.1831 => 0.2704, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.74% (0.1559 => 0.1454, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7071.69% (0.3123 => 22.3972, std.dev.: 0.5126) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.60% (0.2463 => 0.3734, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1532.36% (0.3344 => 5.4586, std.dev.: 0.1174) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.41% (0.2364 => 0.3272, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 5.24% (0.6010 => 0.6325, std.dev.: 0.0186) SingleSource/Benchmarks/Misc/mandel: -0.70% (0.0429 => 0.0426, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.87% (0.3266 => 0.3425, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/strcat: 4.16% (0.1969 => 0.2051, std.dev.: 0.0026) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.25% (0.0224 => 0.0238, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -25.65% (0.0230 => 0.0171) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0510, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 11.83% (0.1462 => 0.1635, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4624, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0747, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4940, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5146, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5106, std.dev.: 0.0497) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3343, std.dev.: 0.0415) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1370, std.dev.: 0.0478) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3625, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3915, std.dev.: 0.0396) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0879, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: -24.09% (2.1832 => 1.6572, std.dev.: 0.0064) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.38% (0.0810 => 0.0967, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.86% (0.0830 => 0.0945, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: 13.40% (0.1112 => 0.1261, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.12% (0.1425 => 0.1555, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 8.94% (0.1577 => 0.1718, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.93% (0.8321 => 0.9064, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/mst/mst: 8.67% (0.1177 => 0.1279, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.20% (0.6010 => 0.6503, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.14% (0.1905 => 0.2060, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.14% (0.7473 => 0.8081, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.10% (0.3295 => 0.3562, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.29% (0.2180 => 0.2339, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.27% (0.2998 => 0.3216, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.20% (0.2279 => 0.2443, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.54% (0.4847 => 0.5164, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/em3d/em3d: 6.45% (0.1721 => 0.1832, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.41% (0.3137 => 0.3338, std.dev.: 0.0052) MultiSource/Applications/Burg/burg: 6.28% (1.2222 => 1.2990, std.dev.: 0.0043) MultiSource/Applications/spiff/spiff: 6.03% (0.7950 => 0.8429, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.95% (0.2519 => 0.2669, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.90% (0.6287 => 0.6658, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.62% (0.5961 => 0.6296, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.54% (0.8148 => 0.8599, std.dev.: 0.0136) MultiSource/Applications/treecc/treecc: 5.00% (1.9948 => 2.0946, std.dev.: 0.0185) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.69% (1.1606 => 1.2150, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/gs/gs: 4.64% (4.1305 => 4.3220, std.dev.: 0.0065) MultiSource/Applications/sgefa/sgefa: 4.63% (0.2999 => 0.3138, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.47% (1.1685 => 1.2207, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.37% (0.9435 => 0.9847, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.34% (0.4127 => 0.4306, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.33% (1.4479 => 1.5106, std.dev.: 0.0181) MultiSource/Applications/hbd/hbd: 4.04% (1.4269 => 1.4846, std.dev.: 0.0185) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.02% (0.8340 => 0.8675, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 3.86% (1.1271 => 1.1706, std.dev.: 0.0056) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.85% (6.6074 => 6.8621, std.dev.: 0.0341) MultiSource/Applications/minisat/minisat: 3.83% (0.6834 => 0.7096, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 3.79% (0.2985 => 0.3098, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.76% (0.6227 => 0.6461, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 3.71% (14.2605 => 14.7899, std.dev.: 0.0789) MultiSource/Applications/siod/siod: 3.70% (2.2184 => 2.3004, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.70% (2.1401 => 2.2192, std.dev.: 0.0106) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.66% (0.4783 => 0.4958, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.60% (1.2526 => 1.2977, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.49% (8.6476 => 8.9492, std.dev.: 0.0253) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.38% (1.6386 => 1.6940, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.33% (13.1811 => 13.6199, std.dev.: 0.1473) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.31% (4.1763 => 4.3147, std.dev.: 0.0155) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.31% (0.3717 => 0.3840, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.30% (1.5315 => 1.5821, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.29% (0.4559 => 0.4709, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.20% (0.5817 => 0.6003, std.dev.: 0.0069) MultiSource/Applications/lua/lua: 3.18% (3.8189 => 3.9405, std.dev.: 0.0301) MultiSource/Applications/SIBsim4/SIBsim4: 3.17% (1.2568 => 1.2966, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: 3.16% (31.8598 => 32.8673, std.dev.: 0.2380) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.15% (4.4873 => 4.6286, std.dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: 3.02% (6.7320 => 6.9351, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.00% (0.8177 => 0.8422, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.99% (0.8597 => 0.8854, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.95% (0.8611 => 0.8865, std.dev.: 0.0050) MultiSource/Applications/ClamAV/clamscan: 2.95% (14.7684 => 15.2039, std.dev.: 0.0779) MultiSource/Applications/d/make_dparser: 2.94% (3.2366 => 3.3319, std.dev.: 0.0312) MultiSource/Applications/hexxagon/hexxagon: 2.92% (0.9810 => 1.0096, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.83% (1.3279 => 1.3655, std.dev.: 0.0103) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.82% (4.4880 => 4.6145, std.dev.: 0.0272) MultiSource/Applications/JM/lencod/lencod: 2.80% (15.3280 => 15.7568, std.dev.: 0.0258) MultiSource/Applications/lambda-0_1_3/lambda: 2.79% (0.7557 => 0.7768, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.78% (3.1832 => 3.2717, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.69% (0.8007 => 0.8222, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.66% (0.8261 => 0.8481, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.66% (0.9688 => 0.9946, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.66% (0.9056 => 0.9297, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.64% (0.5191 => 0.5328, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.63% (0.8716 => 0.8945, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.62% (1.1170 => 1.1463, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.59% (0.8457 => 0.8676, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.59% (0.8885 => 0.9115, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.54% (0.8656 => 0.8876, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.51% (0.8331 => 0.8540, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.50% (0.8712 => 0.8930, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.48% (0.9074 => 0.9299, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.47% (4.5702 => 4.6832, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.43% (0.8338 => 0.8541, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.35% (0.8518 => 0.8718, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.32% (0.9039 => 0.9249, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.32% (0.9908 => 1.0138, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.31% (1.2602 => 1.2893, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.26% (0.7932 => 0.8111, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.25% (0.8805 => 0.9003, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.25% (0.8317 => 0.8504, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.20% (0.8086 => 0.8264, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.14% (0.8697 => 0.8883, std.dev.: 0.0054) MultiSource/Applications/oggenc/oggenc: 2.13% (4.9628 => 5.0683, std.dev.: 0.0262) MultiSource/Benchmarks/Prolangs-C/football/football: 1.98% (0.8768 => 0.8942, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.96% (0.8927 => 0.9102, std.dev.: 0.0060) MultiSource/Applications/lemon/lemon: 1.90% (1.0945 => 1.1153, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.85% (0.8316 => 0.8470, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.59% (0.8048 => 0.8176, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 102.51% (0.0199 => 0.0403, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/pi: 58.94% (1.5795 => 2.5105, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.15% (2.9753 => 3.4559, std.dev.: 0.0605) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.09% (0.7597 => 0.8819, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.47% (2.7995 => 3.2047, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.59% (5.0261 => 5.6085, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.50% (6.3772 => 7.0467, std.dev.: 0.0747) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.24% (1.1857 => 1.2834, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 7.48% (1.7056 => 1.8332, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.63% (4.7794 => 5.0962, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 6.31% (1.3037 => 1.3859, std.dev.: 0.0095) MultiSource/Applications/SIBsim4/SIBsim4: 6.29% (3.1873 => 3.3877, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.84% (4.5327 => 4.7975, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.75% (4.9686 => 5.2541, std.dev.: 0.0773) MultiSource/Applications/lambda-0_1_3/lambda: 5.02% (7.4933 => 7.8693, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.67% (6.2275 => 6.5184, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.62% (3.3761 => 3.5320, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.49% (21.9654 => 22.9523, std.dev.: 0.1554) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.20% (4.9453 => 5.1531, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.96% (4.9469 => 5.1429, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.93% (0.3587 => 0.3728, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.87% (14.0064 => 14.5481, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.83% (1.3882 => 1.4414, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.99% (1.2337 => 1.2706, std.dev.: 0.0081) MultiSource/Applications/siod/siod: 2.84% (3.6643 => 3.7684, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.76% (11.5690 => 11.8887, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.47% (8.2783 => 8.4829, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout/lists: 2.19% (7.3375 => 7.4984, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.97% (4.8362 => 4.9314, std.dev.: 0.0314) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.83% (1.1365 => 1.1573, std.dev.: 0.0056) MultiSource/Applications/spiff/spiff: 1.60% (2.8561 => 2.9019, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.53% (2.4647 => 2.5023, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.06% (3.5679 => 3.6057, std.dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.02% (8.4179 => 8.3321, std.dev.: 0.0312) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.25% (2.8951 => 1.6720, std.dev.: 0.0154) MultiSource/Benchmarks/Olden/em3d/em3d: -21.27% (5.4641 => 4.3020, std.dev.: 0.0259) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.05% (1.0512 => 0.9350, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -10.74% (7.2130 => 6.4380, std.dev.: 0.1373) SingleSource/Benchmarks/McGill/chomp: -9.96% (1.1216 => 1.0099, std.dev.: 0.0271) MultiSource/Benchmarks/mafft/pairlocalalign: -8.56% (63.1822 => 57.7726, std.dev.: 0.1557) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.55% (14.6451 => 13.3932, std.dev.: 0.0325) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.59% (0.3269 => 0.3021, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.88% (4.7482 => 4.4214, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.16% (3.7148 => 3.4859, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.80% (5.4972 => 5.1782, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.21% (5.1557 => 4.8869, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.44% (4.7449 => 4.5340, std.dev.: 0.0250) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.21% (2.8773 => 2.7561, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.88% (6.0224 => 5.7886, std.dev.: 0.0538) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.36% (0.5807 => 0.5612, std.dev.: 0.0017) MultiSource/Applications/lua/lua: -3.28% (29.8330 => 28.8533, std.dev.: 0.0747) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.88% (2.6356 => 2.5597, std.dev.: 0.0236) MultiSource/Benchmarks/FreeBench/mason/mason: -2.51% (0.5415 => 0.5279, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.46% (9.9065 => 9.6625, std.dev.: 0.0402) MultiSource/Benchmarks/Olden/bisort/bisort: -2.46% (0.6636 => 0.6473, std.dev.: 0.0062) MultiSource/Applications/aha/aha: -2.39% (3.3398 => 3.2599, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: -2.28% (3.4237 => 3.3457, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.10% (11.5316 => 11.2892, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.68% (4.9994 => 4.9156, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.61% (2.3487 => 2.3110, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.14% (5.6343 => 5.5700, std.dev.: 0.0206) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.21% (1.0262 => 1.0694, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 26.77% (0.0254 => 0.0322, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.86% (0.0384 => 0.0373, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -26.11% (0.0180 => 0.0133, std.dev.: 0.0041) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.92% (0.1438 => 0.1480, std.dev.: 0.0095) MultiSource/Applications/lemon/lemon: 2.45% (1.1329 => 1.1607, std.dev.: 0.0165) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.94% (0.4164 => 0.4203, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.05% (0.1369 => 0.1397, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.98% (0.0641 => 0.0577, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.90% (0.0578 => 0.0567, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.47% (1.1437 => 1.1948, std.dev.: 0.0112) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.53% (0.0627 => 0.0561, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 10.56% (0.0180 => 0.0199, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.36% (0.8017 => 0.7828, std.dev.: 0.0087) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -4.84% (0.0062 => 0.0059, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 07:39:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 09:39:49 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121127153949.69E2F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6308?compare_to=6305&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6308, Order: 168698, Start Time: 2012-11-27 14:07:57, End Time: 2012-11-27 15:40:18 To: 6305, Order: 168694, Start Time: 2012-11-27 12:12:11, End Time: 2012-11-27 13:44:34 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (180 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (856 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.72% (54.5508 => 56.5805, std.dev.: 0.0993) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.23% (0.3834 => 0.3996, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.67% (54.5751 => 56.5805, std.dev.: 0.0993) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.93% (2.0478 => 2.1078, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/salsa20: 2.49% (7.4937 => 7.6802, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/hash2: 2.08% (3.1932 => 3.2597, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.74% (0.1431 => 0.1306, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.46% (0.3821 => 0.3536, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.33% (0.9542 => 0.8938, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -6.31% (2.4924 => 2.3351, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: -6.26% (0.3357 => 0.3147, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.14% (0.2428 => 0.2279, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.10% (0.3884 => 0.3647, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.08% (0.3831 => 0.3598, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -6.06% (0.2160 => 0.2029, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.06% (0.3880 => 0.3645, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -6.03% (0.3812 => 0.3582, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -6.01% (0.3896 => 0.3662, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.95% (0.3848 => 0.3619, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -5.90% (9.2283 => 8.6836, std.dev.: 0.0086) SingleSource/UnitTests/ObjC/for-in: -5.90% (0.4033 => 0.3795, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.88% (0.6484 => 0.6103, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.86% (0.3891 => 0.3663, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.84% (0.9852 => 0.9277, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -5.83% (0.9179 => 0.8644, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.82% (0.2355 => 0.2218, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.79% (1.0544 => 0.9933, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: -5.79% (7.0961 => 6.6855, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: -5.72% (0.4176 => 0.3937, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.72% (0.5857 => 0.5522, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.71% (0.5591 => 0.5272, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: -5.70% (16.1920 => 15.2693, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.63% (0.7198 => 0.6793, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.62% (0.5478 => 0.5170, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.62% (4.8161 => 4.5456, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.61% (0.6667 => 0.6293, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.60% (0.5925 => 0.5593, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.60% (0.6052 => 0.5713, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.59% (0.6260 => 0.5910, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.59% (0.6230 => 0.5882, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.57% (0.2695 => 0.2545, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.55% (6.7716 => 6.3960, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.53% (0.5863 => 0.5539, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.53% (4.0323 => 3.8095, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.52% (0.3658 => 0.3456, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.51% (0.5805 => 0.5485, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.50% (0.5581 => 0.5274, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.48% (0.5802 => 0.5484, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.48% (1.6364 => 1.5468, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.46% (1.2300 => 1.1628, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.45% (0.5849 => 0.5530, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.45% (0.5941 => 0.5617, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.45% (0.6446 => 0.6095, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.43% (0.5705 => 0.5395, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.41% (0.6304 => 0.5963, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.40% (0.5570 => 0.5269, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.39% (0.5859 => 0.5543, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.38% (0.5575 => 0.5275, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.36% (0.6189 => 0.5857, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.36% (1.3722 => 1.2986, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: -5.35% (1.1530 => 1.0913, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.35% (0.6660 => 0.6304, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -5.34% (1.1450 => 1.0838, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/property: -5.33% (0.4199 => 0.3975, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.33% (0.6676 => 0.6320, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.33% (3.5339 => 3.3456, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.32% (0.6293 => 0.5958, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.32% (0.6297 => 0.5962, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.30% (4.8802 => 4.6217, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.28% (0.5456 => 0.5168, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.27% (4.5069 => 4.2696, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.26% (1.2784 => 1.2111, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.26% (1.4642 => 1.3872, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: -5.25% (0.4515 => 0.4278, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: -5.23% (0.4280 => 0.4056, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.23% (0.6736 => 0.6384, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.19% (0.7919 => 0.7508, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.19% (0.6033 => 0.5720, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -5.18% (0.6347 => 0.6018, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.17% (0.6440 => 0.6107, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.16% (0.6681 => 0.6336, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: -5.16% (4.3330 => 4.1093, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.12% (8.0126 => 7.6025, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.12% (0.5999 => 0.5692, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.11% (0.2933 => 0.2783, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: -5.09% (0.2871 => 0.2725, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.07% (0.3057 => 0.2902, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.05% (1.2210 => 1.1593, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -5.05% (0.3406 => 0.3234, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.05% (14.2083 => 13.4908, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.03% (0.5688 => 0.5402, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.02% (0.2548 => 0.2420, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.01% (0.3016 => 0.2865, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -5.00% (0.2939 => 0.2792, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -4.99% (1.3148 => 1.2492, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.99% (0.3931 => 0.3735, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.98% (0.4916 => 0.4671, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.97% (0.3483 => 0.3310, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.96% (0.4151 => 0.3945, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: -4.95% (0.3255 => 0.3094, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -4.93% (0.3025 => 0.2876, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -4.92% (0.3026 => 0.2877, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -4.92% (17.1032 => 16.2612, std.dev.: 0.0299) SingleSource/UnitTests/ObjC++/property-reference-object: -4.92% (0.6441 => 0.6124, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.92% (0.2278 => 0.2166, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.88% (0.3323 => 0.3161, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.87% (0.8521 => 0.8106, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -4.86% (0.2985 => 0.2840, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: -4.85% (0.2659 => 0.2530, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.84% (0.2849 => 0.2711, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.83% (0.2999 => 0.2854, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.82% (0.3837 => 0.3652, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -4.82% (1.2515 => 1.1912, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: -4.81% (3.5154 => 3.3462, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: -4.80% (0.3205 => 0.3051, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -4.80% (0.3581 => 0.3409, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.80% (0.3252 => 0.3096, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -4.79% (0.3194 => 0.3041, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -4.79% (1.3864 => 1.3200, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: -4.79% (0.3446 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -4.78% (0.2989 => 0.2846, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: -4.76% (15.5079 => 14.7690, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.76% (2.1713 => 2.0680, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.74% (1.2221 => 1.1642, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.73% (0.7339 => 0.6992, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.72% (0.7779 => 0.7412, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -4.71% (0.3394 => 0.3234, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.71% (0.6395 => 0.6094, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.70% (0.4813 => 0.4587, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.68% (0.2903 => 0.2767, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary2: -4.68% (0.3481 => 0.3318, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -4.64% (0.3059 => 0.2917, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -4.63% (15.2527 => 14.5458, std.dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.63% (0.4321 => 0.4121, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -4.58% (4.0594 => 3.8736, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.57% (0.3849 => 0.3673, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.57% (0.5168 => 0.4932, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.57% (0.7447 => 0.7107, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.49% (0.7524 => 0.7186, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.49% (0.6395 => 0.6108, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.49% (0.2385 => 0.2278, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -4.48% (0.4861 => 0.4643, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -4.47% (0.4248 => 0.4058, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.45% (0.3867 => 0.3695, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.44% (0.5569 => 0.5322, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.39% (1.6474 => 1.5750, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.36% (0.4083 => 0.3905, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: -4.35% (2.1401 => 2.0470, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.29% (0.7021 => 0.6720, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: -4.28% (5.0226 => 4.8075, std.dev.: 0.0152) MultiSource/Benchmarks/McCat/09-vor/vor: -4.28% (0.3271 => 0.3131, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.26% (0.5329 => 0.5102, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -4.23% (0.3621 => 0.3468, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -4.20% (2.4021 => 2.3011, std.dev.: 0.0145) MultiSource/Applications/spiff/spiff: -4.19% (0.8418 => 0.8065, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.17% (0.5567 => 0.5335, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.12% (0.9557 => 0.9163, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: -4.10% (0.7982 => 0.7655, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.09% (0.4427 => 0.4246, std.dev.: 0.0070) MultiSource/Benchmarks/Bullet/bullet: -4.08% (34.0927 => 32.7015, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash: -4.07% (0.4524 => 0.4340, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.04% (22.4056 => 21.4999, std.dev.: 0.0138) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.04% (0.3319 => 0.3185, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sieve: -3.96% (0.3788 => 0.3638, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -3.87% (18.2933 => 17.5845, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.80% (0.9077 => 0.8732, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: -3.67% (0.6750 => 0.6502, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.64% (0.3491 => 0.3364, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.55% (2.2587 => 2.1785, std.dev.: 0.0081) MultiSource/Applications/hbd/hbd: -3.36% (1.5610 => 1.5086, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.61% (5.4682 => 5.3255, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -2.42% (20.7746 => 20.2712, std.dev.: 0.0823) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1950, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: -61.32% (1.8100 => 0.7001, std.dev.: 0.0183) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7548, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -8.70% (1.2842 => 1.1725, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.99% (2.2633 => 2.1729, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4681, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 4.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 07:43:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 09:43:06 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121127154306.1A5752A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6309?compare_to=6303&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6309, Order: 168694, Start Time: 2012-11-27 13:24:53, End Time: 2012-11-27 15:43:37 To: 6303, Order: 168691, Start Time: 2012-11-27 10:16:10, End Time: 2012-11-27 12:34:39 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 25 (143 on baseline) Performance Improvements: 3 (44 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1058 (698 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.23% (0.1175 => 0.1354, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.22% (0.6196 => 0.7077, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.72% (0.6165 => 0.7011, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 13.44% (0.0841 => 0.0954, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.99% (0.6886 => 0.7505, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 8.86% (0.5923 => 0.6448, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/fibo: 6.90% (0.2984 => 0.3190, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.57% (0.4447 => 0.4739, std.dev.: 0.0061) SingleSource/Regression/C++/ofstream_ctor: 5.67% (0.3402 => 0.3595, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 5.04% (0.2042 => 0.2145, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 4.99% (0.4309 => 0.4524, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ary: 4.83% (0.3785 => 0.3968, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.71% (0.8222 => 0.8609, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 4.69% (10.9300 => 11.4431, std.dev.: 0.1573) SingleSource/Benchmarks/Shootout-C++/matrix: 4.69% (0.3623 => 0.3793, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 4.59% (0.7845 => 0.8205, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.50% (1.1186 => 1.1689, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-3: 4.42% (0.3959 => 0.4134, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.12% (0.3637 => 0.3787, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/UnitTests/ObjC/synchronized: 74.55% (0.1104 => 0.1927, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.03% (4.2303 => 4.3585, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 2.90% (1.2740 => 1.3110, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/lists1: 2.78% (0.6192 => 0.6364, std.dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: 2.43% (0.6721 => 0.6884, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ackermann: 1.10% (1.7536 => 1.7729, std.dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/nestedloop: -11.94% (0.3452 => 0.3040, std.dev.: 0.0158) MultiSource/Benchmarks/MallocBench/gs/gs: -2.81% (5.3913 => 5.2398, std.dev.: 0.0578) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.54% (1.0163 => 1.0006, std.dev.: 0.0059) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.86% (69.4144 => 70.0108, std.dev.: 0.0592) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1338 => 0.1338, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.73% (0.0419 => 0.0443, std.dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.44% (0.0678 => 0.0675, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 0.05% (493.9540 => 494.2000, std.dev.: 0.0694) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 10.70% (63.2438 => 70.0108, std.dev.: 0.0592) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.99% (4.3882 => 0.0443, std.dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43723.71% (1.1277 => 494.2000, std.dev.: 0.0694) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.49% (0.5229 => 1.5399, std.dev.: 0.0838) MultiSource/Applications/SPASS/SPASS: 19.00% (14.9895 => 17.8374, std.dev.: 0.4096) MultiSource/Applications/kimwitu++/kc: 47.75% (14.1553 => 20.9145, std.dev.: 0.6205) MultiSource/Benchmarks/MallocBench/gs/gs: 27.47% (4.1105 => 5.2398, std.dev.: 0.0578) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 50.36% (1.1048 => 1.6612, std.dev.: 0.0130) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 431.95% (7.1582 => 38.0784, std.dev.: 0.3585) SingleSource/Benchmarks/Misc-C++-EH/spirit: 76.96% (3.4629 => 6.1280, std.dev.: 0.2626) SingleSource/Benchmarks/Misc-C++/stepanov_container: 87.87% (0.6222 => 1.1689, std.dev.: 0.0025) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10717.50% (0.0720 => 7.7886, std.dev.: 0.2708) MultiSource/Applications/SIBsim4/SIBsim4: 3863300.00% (0.0001 => 3.8634, std.dev.: 0.0255) MultiSource/Applications/SPASS/SPASS: 12733200.00% (0.0001 => 12.7333, std.dev.: 2.1595) MultiSource/Applications/kimwitu++/kc: 53700.00% (0.0001 => 0.0538, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 64500.00% (0.0001 => 0.0646, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14500.00% (0.0001 => 0.0146) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576300.00% (0.0001 => 0.5764, std.dev.: 0.0216) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10068100.00% (0.0001 => 10.0682, std.dev.: 0.0183) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6774400.00% (0.0001 => 6.7745, std.dev.: 0.3938) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1807.70% (1.1194 => 21.3548, std.dev.: 0.4308) MultiSource/Applications/ClamAV/clamscan: 67.42% (22.1758 => 37.1271, std.dev.: 0.5123) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.26% (2.9384 => 4.6209, std.dev.: 0.2132) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 52.48% (7.0540 => 10.7559, std.dev.: 0.3770) MultiSource/Applications/JM/lencod/lencod: 47.45% (21.9371 => 32.3469, std.dev.: 0.1350) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.27% (8.1363 => 11.9822, std.dev.: 0.2689) SingleSource/Benchmarks/Misc/flops: 47.00% (0.1432 => 0.2105, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/distray/distray: 44.70% (0.1056 => 0.1528, std.dev.: 0.0056) SingleSource/UnitTests/vla: 44.23% (0.0355 => 0.0512, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 38.49% (0.0730 => 0.1011, std.dev.: 0.0021) SingleSource/Benchmarks/Stanford/Oscar: 36.79% (0.0636 => 0.0870, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 35.28% (0.0326 => 0.0441, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 31.23% (0.1236 => 0.1622, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 30.68% (0.0730 => 0.0954, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 30.43% (0.0746 => 0.0973, std.dev.: 0.0020) SingleSource/Benchmarks/Stanford/Towers: 29.94% (0.0471 => 0.0612, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 29.69% (0.1044 => 0.1354, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 29.61% (0.1655 => 0.2145, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/exptree: 29.48% (0.0814 => 0.1054, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 29.07% (0.0626 => 0.0808, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.97% (0.6675 => 0.8609, std.dev.: 0.0023) SingleSource/Regression/C++/EH/exception_spec_test: 28.86% (0.0350 => 0.0451, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/dot-syntax-1: 28.81% (0.0479 => 0.0617, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 27.76% (0.3307 => 0.4225, std.dev.: 0.0115) MultiSource/Benchmarks/NPB-serial/is/is: 26.56% (0.0719 => 0.0910, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/RealMM: 26.52% (0.0396 => 0.0501, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 26.26% (0.0457 => 0.0577, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 26.14% (0.2758 => 0.3479, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 25.63% (0.0437 => 0.0549, std.dev.: 0.0007) MultiSource/Benchmarks/llubenchmark/llu: 25.32% (0.0462 => 0.0579, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Queens: 24.88% (0.0414 => 0.0517, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 24.05% (0.3684 => 0.4570, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 24.04% (0.8067 => 1.0006, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 23.86% (0.3826 => 0.4739, std.dev.: 0.0061) SingleSource/Regression/C++/ofstream_ctor: 23.75% (0.2905 => 0.3595, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 23.58% (1.1840 => 1.4632, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/ary: 22.77% (0.3232 => 0.3968, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: 22.44% (0.2554 => 0.3127, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/matrix: 22.43% (0.3098 => 0.3793, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.09% (0.1566 => 0.1912, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 22.04% (0.5981 => 0.7299, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/ackermann: 21.95% (0.2756 => 0.3361, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/misr: 21.80% (0.0633 => 0.0771, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.40% (0.3121 => 0.3789, std.dev.: 0.0108) SingleSource/Benchmarks/Stanford/Puzzle: 21.14% (0.1268 => 0.1536, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 21.07% (4.9449 => 5.9866, std.dev.: 0.0549) MultiSource/Applications/treecc/treecc: 20.96% (2.0273 => 2.4522, std.dev.: 0.0646) MultiSource/Benchmarks/Prolangs-C++/office/office: 20.76% (0.3136 => 0.3787, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 20.65% (9.4845 => 11.4431, std.dev.: 0.1573) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 20.65% (1.5415 => 1.8598, std.dev.: 0.0429) SingleSource/Benchmarks/Shootout-C++/wc: 20.58% (0.3052 => 0.3680, std.dev.: 0.0115) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.55% (0.0793 => 0.0956, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/tsp/tsp: 20.51% (0.1175 => 0.1416, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.24% (0.5860 => 0.7046, std.dev.: 0.0215) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.01% (0.9765 => 1.1719, std.dev.: 0.0237) SingleSource/UnitTests/SignlessTypes/rem: 19.93% (0.1144 => 0.1372, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: 19.78% (0.0536 => 0.0642, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary2: 19.44% (0.3379 => 0.4036, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.30% (0.1337 => 0.1595, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.84% (0.1125 => 0.1337, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/exceptions: 18.18% (0.3828 => 0.4524, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/except: 18.11% (0.2871 => 0.3391, std.dev.: 0.0172) SingleSource/UnitTests/ObjC/exceptions-2: 17.70% (0.3497 => 0.4116, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.70% (0.0842 => 0.0991, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/exceptions-4: 17.58% (0.3543 => 0.4166, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/exceptions-3: 17.58% (0.3516 => 0.4134, std.dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: 17.49% (17.1811 => 20.1868, std.dev.: 0.3897) SingleSource/Benchmarks/Shootout-C++/methcall: 17.38% (0.2877 => 0.3377, std.dev.: 0.0158) MultiSource/Benchmarks/McCat/17-bintr/bintr: 17.19% (0.0675 => 0.0791, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.17% (0.8172 => 0.9575, std.dev.: 0.0382) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.11% (0.0871 => 0.1020, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary3: 17.09% (0.3283 => 0.3844, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/fibo: 17.06% (0.2725 => 0.3190, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.97% (14.3668 => 16.8042, std.dev.: 0.6241) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.58% (0.0953 => 0.1111, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/em3d/em3d: 16.34% (0.1695 => 0.1972, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/mst/mst: 16.34% (0.1163 => 0.1353, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout/matrix: 16.14% (0.0818 => 0.0950, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 15.90% (0.1906 => 0.2209, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.90% (0.0648 => 0.0751, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.69% (0.0886 => 0.1025, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 15.66% (0.0798 => 0.0923, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.58% (0.1117 => 0.1291, std.dev.: 0.0051) MultiSource/Applications/viterbi/viterbi: 15.50% (0.1555 => 0.1796, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.45% (0.0770 => 0.0889, std.dev.: 0.0043) MultiSource/Applications/aha/aha: 15.20% (0.1151 => 0.1326, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.94% (0.0770 => 0.0885, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.91% (0.6450 => 0.7412, std.dev.: 0.0270) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.67% (0.2107 => 0.2416, std.dev.: 0.0102) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.63% (0.0834 => 0.0956, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.31% (0.1062 => 0.1214, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/ReedSolomon: 14.01% (0.2049 => 0.2336, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.80% (0.1029 => 0.1171, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.43% (0.2271 => 0.2576, std.dev.: 0.0109) SingleSource/UnitTests/ObjC/property: 12.79% (0.3886 => 0.4383, std.dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.53% (3.8922 => 4.3797, std.dev.: 0.1485) SingleSource/UnitTests/ObjC/synchronized: 12.44% (0.3561 => 0.4004, std.dev.: 0.0135) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.36% (0.3543 => 0.3981, std.dev.: 0.0129) SingleSource/UnitTests/ObjC/trivial-interface: 12.35% (0.3473 => 0.3902, std.dev.: 0.0124) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.27% (0.8101 => 0.9095, std.dev.: 0.0368) SingleSource/UnitTests/ObjC/for-in: 12.02% (0.3694 => 0.4138, std.dev.: 0.0150) MultiSource/Benchmarks/McCat/05-eks/eks: 11.58% (0.4299 => 0.4797, std.dev.: 0.0166) MultiSource/Benchmarks/PAQ8p/paq8p: 10.24% (10.3673 => 11.4289, std.dev.: 0.2614) SingleSource/UnitTests/ObjC++/property-reference-object: 10.00% (0.6030 => 0.6633, std.dev.: 0.0143) SingleSource/UnitTests/ObjC++/Hello: 9.65% (0.5925 => 0.6497, std.dev.: 0.0148) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.61% (0.3817 => 0.4184, std.dev.: 0.0070) SingleSource/UnitTests/ObjC++/property-reference: 9.40% (0.7326 => 0.8015, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.91% (0.4879 => 0.5265, std.dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.24% (4.3953 => 10.9986, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/methcall: 147.40% (5.3999 => 13.3592, std.dev.: 0.0027) MultiSource/Benchmarks/llubenchmark/llu: 104.10% (3.7781 => 7.7111, std.dev.: 0.5587) SingleSource/UnitTests/ObjC/synchronized: 83.35% (0.1051 => 0.1927, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.90% (13.4384 => 16.3808, std.dev.: 1.1252) SingleSource/Benchmarks/Shootout-C++/ary2: 21.66% (0.0757 => 0.0921, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 17.60% (6.6465 => 7.8162, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary: 16.93% (0.0756 => 0.0884, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.67% (1.1145 => 1.3003, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.01% (0.2944 => 0.3327, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.65% (2.8904 => 3.2270, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/heapsort: 11.11% (3.8526 => 4.2805, std.dev.: 0.1115) SingleSource/Benchmarks/Misc/richards_benchmark: 10.07% (1.1396 => 1.2544, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.24% (1.7254 => 1.8849, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/hash: 7.61% (4.9088 => 5.2825, std.dev.: 0.0882) SingleSource/Benchmarks/Shootout/strcat: 6.64% (0.1899 => 0.2025, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 5.96% (1.2373 => 1.3110, std.dev.: 0.0103) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.90% (4.2280 => 4.4776, std.dev.: 0.0015) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 4.95% (26.0924 => 27.3843, std.dev.: 0.2163) MultiSource/Benchmarks/nbench/nbench: 3.96% (11.6436 => 12.1047, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.67% (0.3540 => 0.3670, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.48% (1.7133 => 1.7729, std.dev.: 0.0056) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.36% (0.4162 => 0.4302, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.13% (0.6171 => 0.6364, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.13% (1.3677 => 1.3969, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 2.05% (3.1595 => 3.2242, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 1.59% (85.0658 => 86.4148, std.dev.: 0.1113) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.41% (6.5088 => 6.6005, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 1.34% (27.8444 => 28.2185, std.dev.: 0.0266) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.33% (1.0313 => 1.0450, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.30% (5.2139 => 5.2815, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/perlin: 1.19% (5.9798 => 6.0507, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1672, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.45% (5.2763 => 1.2424, std.dev.: 0.0398) SingleSource/Benchmarks/Misc/salsa20: -75.38% (0.8651 => 0.2130, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: -44.88% (0.1622 => 0.0894, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.18% (5.3526 => 4.7009, std.dev.: 0.1487) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.91% (5.3855 => 4.7439, std.dev.: 0.1473) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -11.58% (0.1330 => 0.1176, std.dev.: 0.0055) MultiSource/Applications/JM/ldecod/ldecod: -10.01% (10.4361 => 9.3912, std.dev.: 0.3350) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -68.62% (32.5116 => 10.2006, std.dev.: 0.0210) SingleSource/Benchmarks/Dhrystone/fldry: -64.84% (1.9577 => 0.6884, std.dev.: 0.0059) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1682, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.36% (0.3987 => 0.2378, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.26% (4.5009 => 2.7789, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.16% (2.6546 => 2.0133, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: -19.16% (0.2161 => 0.1747, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.68% (1.6925 => 1.4272, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2840, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -10.25% (9.5636 => 8.5836, std.dev.: 0.2161) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.03% (1.5660 => 1.4246, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.94% (4.8142 => 4.4802, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.78% (3.2416 => 3.0217, std.dev.: 0.0284) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.57% (2.7294 => 2.5775, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -5.14% (19.9488 => 18.9238, std.dev.: 0.2305) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.96% (0.8614 => 0.8187, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5066, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: -4.52% (6.2999 => 6.0150, std.dev.: 0.0078) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.49% (1.6805 => 1.6050, std.dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.32% (0.9957 => 0.9626, std.dev.: 0.0117) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8920, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.48% (0.4808 => 0.4689, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.83% (8.1563 => 8.0073, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -1.53% (10.2830 => 10.1258, std.dev.: 0.0038) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.10% (0.2116 => 0.0675, std.dev.: 0.0006) Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 09:00:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 11:00:07 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121127170007.4C1002A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6310?compare_to=6307&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6310, Order: 168701, Start Time: 2012-11-27 15:27:20, End Time: 2012-11-27 17:00:39 To: 6307, Order: 168698, Start Time: 2012-11-27 13:21:51, End Time: 2012-11-27 14:51:16 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (30 on baseline) Performance Regressions: 7 (63 on baseline) Performance Improvements: 1 (20 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 39 (38 on baseline) Unchanged Tests: 1045 (890 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 7.38% (0.8264 => 0.8874, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 6.35% (0.8883 => 0.9447, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.34% (0.2443 => 0.2549, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.04% (0.8591 => 0.8766, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.29% (0.8599 => 0.8710, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.64% (2.4150 => 2.4787, std.dev.: 0.0247) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.22% (2.3698 => 2.3987, std.dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -6.88% (1.4414 => 1.3423, std.dev.: 0.0300) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.12% (1.0694 => 1.0814, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.75% (0.0218 => 0.0224, std.dev.: 0.0064) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.64% (0.0428 => 0.0435, std.dev.: 0.0118) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 5.28% (0.0322 => 0.0339, std.dev.: 0.0104) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.24% (0.0312 => 0.0319, std.dev.: 0.0108) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 16.35% (0.0373 => 0.0434, std.dev.: 0.0135) SingleSource/UnitTests/Vector/Altivec/casts: 3.92% (0.0204 => 0.0212, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 67.67% (0.0133 => 0.0223, std.dev.: 0.0076) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 3.24% (0.1480 => 0.1528, std.dev.: 0.0092) MultiSource/Applications/lemon/lemon: 3.29% (1.1607 => 1.1989, std.dev.: 0.4111) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.69% (0.4203 => 0.4132, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.37% (0.1397 => 0.1486, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.60% (0.0577 => 0.0592, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0277 => 0.0278, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.23% (0.0567 => 0.0591, std.dev.: 0.0110) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.18% (1.1948 => 1.1926, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 0.07% (9.4401 => 9.4471, std.dev.: 0.0134) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 700.00% (0.0001 => 0.0008, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.73% (0.0561 => 0.0610, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.53% (0.0199 => 0.0188, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.03% (0.7828 => 0.7747, std.dev.: 0.0056) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: -85.71% (0.0007 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 52.54% (0.0059 => 0.0090, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/SciMark2-C/scimark2: -66.95% (28.5821 => 9.4471, std.dev.: 0.0134) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.02% (16.4461 => 17.7643, std.dev.: 0.2690) MultiSource/Applications/sqlite3/sqlite3: 2370.75% (0.6332 => 15.6448, std.dev.: 0.7183) MultiSource/Benchmarks/McCat/08-main/main: 51.01% (0.1831 => 0.2765, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.62% (0.1559 => 0.1487, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7254.63% (0.3123 => 22.9685, std.dev.: 1.0965) SingleSource/Benchmarks/CoyoteBench/fftbench: 53.07% (0.2463 => 0.3770, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1561.21% (0.3344 => 5.5551, std.dev.: 0.2725) SingleSource/Benchmarks/Misc-C++/Large/ray: 40.82% (0.2364 => 0.3329, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/bigfib: 5.06% (0.6010 => 0.6314, std.dev.: 0.0195) SingleSource/Benchmarks/Misc/mandel: 3.50% (0.0429 => 0.0444, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.34% (0.3266 => 0.3473, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/strcat: 5.13% (0.1969 => 0.2070, std.dev.: 0.0032) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.48% (0.0224 => 0.0243, std.dev.: 0.0019) SingleSource/UnitTests/byval-alignment: -26.09% (0.0230 => 0.0170, std.dev.: 0.0016) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0517, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 11.83% (0.1462 => 0.1635, std.dev.: 0.0281) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4588, std.dev.: 0.0968) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0748, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4949, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5145, std.dev.: 0.0947) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.6558, std.dev.: 0.2190) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3116, std.dev.: 0.0449) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1498, std.dev.: 0.0234) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3631, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3999, std.dev.: 0.0278) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0877, std.dev.: 0.0011) SingleSource/Regression/C/uint64_to_float: -23.94% (2.1832 => 1.6606, std.dev.: 0.0151) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.05% (0.0810 => 0.0940, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.68% (0.0848 => 0.0964, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 12.59% (0.1112 => 0.1252, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.85% (0.2279 => 0.2549, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.20% (0.1137 => 0.1253, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.75% (0.8086 => 0.8874, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.45% (0.2180 => 0.2386, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.62% (0.8697 => 0.9447, std.dev.: 0.0130) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.16% (0.3137 => 0.3393, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.90% (0.8148 => 0.8710, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.51% (0.1905 => 0.2029, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.31% (0.6287 => 0.6684, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 5.90% (0.9074 => 0.9609, std.dev.: 0.0202) SingleSource/Benchmarks/Shootout-C++/ary3: 5.32% (0.2427 => 0.2556, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 5.30% (0.8927 => 0.9400, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 5.26% (0.8805 => 0.9268, std.dev.: 0.0151) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.16% (0.2519 => 0.2649, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.12% (6.6074 => 6.9460, std.dev.: 0.1075) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 5.12% (0.8712 => 0.9158, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.07% (0.3115 => 0.3273, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 5.02% (4.1305 => 4.3378, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.75% (0.5961 => 0.6244, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/lists1: 4.51% (0.2969 => 0.3103, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.36% (0.2774 => 0.2895, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 4.16% (0.8855 => 0.9223, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/18-imp/imp: 4.14% (0.3503 => 0.3648, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.11% (0.8420 => 0.8766, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.80% (0.3657 => 0.3796, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.46% (1.1170 => 1.1556, std.dev.: 0.0074) MultiSource/Benchmarks/nbench/nbench: 3.27% (1.1271 => 1.1639, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.07% (8.6476 => 8.9133, std.dev.: 0.0422) MultiSource/Benchmarks/McCat/05-eks/eks: 2.80% (0.4397 => 0.4520, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.45% (4.4880 => 4.5979, std.dev.: 0.0276) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 100.50% (0.0199 => 0.0399, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/pi: 56.74% (1.5795 => 2.4757, std.dev.: 0.0204) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.40% (0.7597 => 0.8843, std.dev.: 0.0402) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.38% (2.9753 => 3.4627, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.73% (2.7995 => 3.2119, std.dev.: 0.0431) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.61% (5.0261 => 5.6098, std.dev.: 0.0383) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 9.12% (44.5605 => 48.6264, std.dev.: 1.4805) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.24% (1.1857 => 1.2834, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/queens: 7.65% (1.7056 => 1.8360, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.94% (4.7794 => 5.1110, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.30% (4.9686 => 5.2817, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 5.46% (7.4933 => 7.9025, std.dev.: 0.0499) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.77% (6.2275 => 6.5246, std.dev.: 0.0440) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.34% (4.9469 => 5.1618, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.19% (4.9453 => 5.1527, std.dev.: 0.0350) MultiSource/Applications/hexxagon/hexxagon: 3.99% (14.0064 => 14.5656, std.dev.: 0.0232) MultiSource/Applications/siod/siod: 3.16% (3.6643 => 3.7800, std.dev.: 0.0189) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.10% (1.2337 => 1.2719, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.93% (0.3587 => 0.3692, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.77% (11.5690 => 11.8891, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.75% (4.8362 => 4.9693, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.62% (8.2783 => 8.4950, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: 2.32% (7.3375 => 7.5074, std.dev.: 0.0390) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.07% (0.5889 => 0.6011, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.61% (1.5941 => 1.6198, std.dev.: 0.0050) MultiSource/Applications/spiff/spiff: 1.43% (2.8561 => 2.8968, std.dev.: 0.0113) MultiSource/Benchmarks/FreeBench/neural/neural: 1.29% (1.0841 => 1.0981, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 1.25% (1.2061 => 1.2212, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.19% (3.5679 => 3.6104, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.4647 => 2.4903, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.08% (2.8951 => 1.6769, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -37.28% (0.0338 => 0.0212, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/em3d/em3d: -20.91% (5.4641 => 4.3215, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.39% (7.2130 => 6.1751, std.dev.: 0.1093) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.07% (1.0512 => 0.9348, std.dev.: 0.0335) SingleSource/Benchmarks/McGill/chomp: -10.66% (1.1216 => 1.0020, std.dev.: 0.0304) MultiSource/Benchmarks/mafft/pairlocalalign: -8.52% (63.1822 => 57.7967, std.dev.: 0.2002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.92% (4.7482 => 4.4197, std.dev.: 0.0222) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.77% (14.6451 => 13.6536, std.dev.: 0.3591) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.82% (3.7148 => 3.4985, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.82% (5.4972 => 5.1772, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.31% (4.7449 => 4.5406, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.61% (6.0224 => 5.8052, std.dev.: 0.0264) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.25% (2.8773 => 2.7837, std.dev.: 0.0248) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.98% (0.5807 => 0.5634, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: -2.26% (3.4237 => 3.3464, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.05% (2.4490 => 2.3987, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.93% (1.2822 => 1.2574, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.90% (9.9065 => 9.7180, std.dev.: 0.0599) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.05% (5.6343 => 5.5749, std.dev.: 0.0063) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 5.38% (1.0262 => 1.0814, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 82.11% (0.0123 => 0.0224, std.dev.: 0.0064) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 6.62% (0.0408 => 0.0435, std.dev.: 0.0118) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 33.46% (0.0254 => 0.0339, std.dev.: 0.0104) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.63% (0.0302 => 0.0319, std.dev.: 0.0108) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 13.02% (0.0384 => 0.0434, std.dev.: 0.0135) SingleSource/UnitTests/Vector/Altivec/casts: 11.58% (0.0190 => 0.0212, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 23.89% (0.0180 => 0.0223, std.dev.: 0.0076) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 6.26% (0.1438 => 0.1528, std.dev.: 0.0092) MultiSource/Applications/lemon/lemon: 5.83% (1.1329 => 1.1989, std.dev.: 0.4111) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.77% (0.4164 => 0.4132, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.55% (0.1369 => 0.1486, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.64% (0.0641 => 0.0592, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.56% (0.0195 => 0.0278, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.25% (0.0578 => 0.0591, std.dev.: 0.0110) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.28% (1.1437 => 1.1926, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -42.86% (0.0014 => 0.0008, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.71% (0.0627 => 0.0610, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.44% (0.0180 => 0.0188, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.37% (0.8017 => 0.7747, std.dev.: 0.0056) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 45.16% (0.0062 => 0.0090, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 09:35:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 11:35:04 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121127173504.E09E82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6311?compare_to=6308&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6311, Order: 168701, Start Time: 2012-11-27 16:03:22, End Time: 2012-11-27 17:35:36 To: 6308, Order: 168698, Start Time: 2012-11-27 14:07:57, End Time: 2012-11-27 15:40:18 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 1 (183 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (855 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.71% (56.5805 => 54.4815, std.dev.: 0.5163) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1014, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.4937 => 7.6827, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/hash2: 2.34% (3.1932 => 3.2680, std.dev.: 0.0068) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.74% (0.1431 => 0.1306, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.67% (0.3821 => 0.3528, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.91% (0.9542 => 0.8883, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.84% (0.3142 => 0.2927, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -6.79% (2.4924 => 2.3232, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.61% (0.3357 => 0.3135, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -6.53% (0.2160 => 0.2019, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.30% (0.2428 => 0.2275, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.25% (9.2283 => 8.6517, std.dev.: 0.0108) SingleSource/UnitTests/ObjC/trivial-interface: -6.24% (0.3812 => 0.3574, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.24% (0.3880 => 0.3638, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.23% (0.3884 => 0.3642, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.22% (0.9852 => 0.9239, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -6.21% (0.3831 => 0.3593, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.21% (0.3848 => 0.3609, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.13% (0.5857 => 0.5498, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.13% (0.5925 => 0.5562, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -6.11% (0.3896 => 0.3658, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: -6.09% (0.9179 => 0.8620, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: -6.08% (16.1920 => 15.2068, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.08% (0.5478 => 0.5145, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: -6.07% (0.4033 => 0.3788, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.05% (0.5863 => 0.5508, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: -6.05% (7.0961 => 6.6667, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.04% (0.3891 => 0.3656, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.03% (0.5805 => 0.5455, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.01% (1.0544 => 0.9910, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.00% (0.6052 => 0.5689, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -5.99% (0.4176 => 0.3926, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.98% (0.6484 => 0.6096, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.97% (0.5591 => 0.5257, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -5.96% (0.1761 => 0.1656, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.96% (0.6260 => 0.5887, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.94% (0.2355 => 0.2215, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.93% (0.6304 => 0.5930, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.93% (0.5802 => 0.5458, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.92% (0.5705 => 0.5367, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.92% (0.5575 => 0.5245, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.91% (0.6230 => 0.5862, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.86% (0.5941 => 0.5593, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.85% (0.6667 => 0.6277, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.84% (1.3722 => 1.2921, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.83% (0.5570 => 0.5245, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.83% (4.0323 => 3.7974, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.82% (0.5581 => 0.5256, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.82% (4.8161 => 4.5360, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.81% (0.6297 => 0.5931, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.81% (6.7716 => 6.3782, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.79% (0.5859 => 0.5520, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.78% (0.6194 => 0.5836, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: -5.78% (1.1530 => 1.0864, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.75% (0.7198 => 0.6784, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.75% (0.5688 => 0.5361, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.74% (0.6676 => 0.6293, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.71% (0.2695 => 0.2541, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.71% (0.6660 => 0.6280, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.70% (0.6189 => 0.5836, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.69% (0.6446 => 0.6079, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.69% (0.5849 => 0.5516, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.65% (0.3025 => 0.2854, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.65% (0.3255 => 0.3071, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -5.65% (0.4515 => 0.4260, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.64% (0.6736 => 0.6356, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: -5.61% (0.2871 => 0.2710, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.60% (0.3658 => 0.3453, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.59% (0.3057 => 0.2886, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.58% (4.8802 => 4.6077, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.57% (0.6440 => 0.6081, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.57% (0.6033 => 0.5697, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.57% (1.2300 => 1.1615, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.55% (1.6364 => 1.5455, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.55% (0.6293 => 0.5944, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.54% (0.3016 => 0.2849, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.54% (0.5456 => 0.5154, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.53% (3.5339 => 3.3384, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: -5.53% (1.1450 => 1.0817, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.52% (0.2933 => 0.2771, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.50% (2.1713 => 2.0518, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: -5.50% (0.4199 => 0.3968, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.48% (0.2939 => 0.2778, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.47% (0.3837 => 0.3627, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.46% (1.4642 => 1.3843, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: -5.45% (0.3194 => 0.3020, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -5.45% (1.3148 => 1.2432, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.44% (0.4151 => 0.3925, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.44% (0.3931 => 0.3717, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -5.42% (0.3026 => 0.2862, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.42% (14.2083 => 13.4388, std.dev.: 0.0204) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.41% (0.2903 => 0.2746, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.41% (1.2784 => 1.2093, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.38% (8.0126 => 7.5815, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.38% (0.7919 => 0.7493, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: -5.37% (0.2849 => 0.2696, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -5.37% (0.3205 => 0.3033, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: -5.36% (1.3864 => 1.3121, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.34% (0.6681 => 0.6324, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.33% (0.3323 => 0.3146, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -5.30% (0.4280 => 0.4053, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -5.30% (0.3059 => 0.2897, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.29% (1.2210 => 1.1564, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.29% (0.4916 => 0.4656, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: -5.28% (4.3330 => 4.1044, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.27% (0.3849 => 0.3646, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -5.26% (0.6347 => 0.6013, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.23% (0.3252 => 0.3082, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.22% (0.2278 => 0.2159, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -5.22% (0.2989 => 0.2833, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.22% (0.5999 => 0.5686, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.21% (4.5069 => 4.2722, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.20% (0.8521 => 0.8078, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: -5.20% (0.3406 => 0.3229, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -5.19% (0.3446 => 0.3267, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -5.16% (17.1032 => 16.2210, std.dev.: 0.0158) MultiSource/Applications/SPASS/SPASS: -5.13% (15.5079 => 14.7129, std.dev.: 0.0199) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.09% (0.4321 => 0.4101, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -5.08% (0.3481 => 0.3304, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.08% (0.7339 => 0.6966, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -5.08% (0.4861 => 0.4614, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -5.08% (0.2659 => 0.2524, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.07% (0.2385 => 0.2264, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.07% (0.2999 => 0.2847, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -5.07% (0.3394 => 0.3222, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -5.03% (1.2515 => 1.1886, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.02% (0.6395 => 0.6074, std.dev.: 0.0067) SingleSource/UnitTests/ObjC++/property-reference-object: -5.01% (0.6441 => 0.6118, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: -5.01% (0.7447 => 0.7074, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/bh/bh: -4.99% (0.2985 => 0.2836, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -4.99% (0.4248 => 0.4036) MultiSource/Applications/d/make_dparser: -4.99% (3.5154 => 3.3400, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.99% (0.4813 => 0.4573, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.98% (0.2548 => 0.2421, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: -4.97% (0.3581 => 0.3403, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.97% (0.3483 => 0.3310, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.97% (1.2221 => 1.1614, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: -4.89% (0.3867 => 0.3678, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: -4.87% (0.7779 => 0.7400, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.86% (0.7524 => 0.7158, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -4.86% (15.2527 => 14.5121, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.85% (0.5567 => 0.5297, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: -4.83% (0.3621 => 0.3446, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.80% (0.6395 => 0.6088, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.80% (0.5168 => 0.4920, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -4.80% (0.4524 => 0.4307, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.78% (0.4083 => 0.3888, std.dev.: 0.0023) MultiSource/Applications/lua/lua: -4.76% (4.0594 => 3.8662, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.74% (0.5569 => 0.5305, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.68% (0.9557 => 0.9110, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.66% (0.7021 => 0.6694, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -4.64% (5.0226 => 4.7894, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.64% (0.5329 => 0.5082, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.61% (0.4427 => 0.4223, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.61% (1.6474 => 1.5715, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -4.49% (34.0927 => 32.5622, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/sieve: -4.46% (0.3788 => 0.3619, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: -4.40% (2.1401 => 2.0459, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.34% (22.4056 => 21.4328, std.dev.: 0.0138) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.34% (0.3319 => 0.3175, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -4.31% (0.3271 => 0.3130, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -4.27% (2.4021 => 2.2995, std.dev.: 0.0028) MultiSource/Applications/hbd/hbd: -4.23% (1.5610 => 1.4949, std.dev.: 0.0075) MultiSource/Applications/lambda-0_1_3/lambda: -4.22% (0.7982 => 0.7645, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -4.19% (0.6750 => 0.6467, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.15% (0.9077 => 0.8700, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.98% (0.3491 => 0.3352, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -3.97% (0.8418 => 0.8084, std.dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: -3.85% (18.2933 => 17.5899, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.84% (2.2587 => 2.1720, std.dev.: 0.0189) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.94% (5.4682 => 5.3077, std.dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -2.24% (20.7746 => 20.3096, std.dev.: 0.0475) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.52% (31.3723 => 10.1910, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: -61.88% (1.8100 => 0.6900, std.dev.: 0.0093) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.54% (7.5137 => 5.7447, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -8.76% (1.2842 => 1.1717, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.51% (0.8545 => 0.8160, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7067, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.86% (2.2633 => 2.1760, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.17% (1.0557 => 1.0222, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.24% (1.3096 => 1.2803, std.dev.: 0.0101) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4711, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 10:40:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 12:40:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121127184041.866942A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6312?compare_to=6306&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6312, Order: 168698, Start Time: 2012-11-27 15:21:02, End Time: 2012-11-27 18:41:10 To: 6306, Order: 168694, Start Time: 2012-11-27 11:12:11, End Time: 2012-11-27 14:32:57 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (171 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1092 (719 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.12% (0.0625 => 0.0882, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.36% (0.1063 => 0.1407, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.24% (0.2969 => 0.3748, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.86% (0.4253 => 0.5353, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.59% (0.1106 => 0.1389, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.69% (0.4139 => 0.5161, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.51% (0.0714 => 0.0889, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.51% (0.5900 => 0.7346, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.21% (0.0475 => 0.0590, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 24.10% (1.5932 => 1.9772, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.33% (0.4994 => 0.6159, std.dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.29% (0.0584 => 0.0720, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.85% (0.0547 => 0.0672, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.82% (0.5000 => 0.6141, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.22% (0.1620 => 0.1980, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.14% (0.1021 => 0.1247, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.95% (0.1107 => 0.1350, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 21.70% (0.0599 => 0.0729, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.52% (0.0897 => 0.1090, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.85% (0.0633 => 0.0765, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.72% (0.0584 => 0.0705, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.56% (0.0642 => 0.0774, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 20.46% (0.0948 => 0.1142, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 20.34% (0.0821 => 0.0988, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.31% (0.1103 => 0.1327, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.14% (0.3903 => 0.4689, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.04% (0.1003 => 0.1204, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.01% (0.1549 => 0.1859, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.83% (0.0822 => 0.0985, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.76% (0.1604 => 0.1921, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 19.70% (0.0604 => 0.0723, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 19.58% (0.1619 => 0.1936, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 18.90% (0.0947 => 0.1126, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.88% (0.1462 => 0.1738, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 18.56% (0.0808 => 0.0958, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.37% (0.2014 => 0.2384, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 18.25% (0.5889 => 0.6964, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/Hello: 18.21% (0.5826 => 0.6887, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.20% (0.3890 => 0.4598, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 17.98% (0.1218 => 0.1437, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 17.77% (0.0698 => 0.0822, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 17.75% (0.4029 => 0.4744, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.69% (0.2736 => 0.3220, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.62% (1.3152 => 1.5469, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.46% (0.1088 => 0.1278, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.38% (0.2866 => 0.3364, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 17.28% (0.1505 => 0.1765, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.09% (3.5627 => 4.1715, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 16.97% (0.5546 => 0.6487, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 16.86% (0.0605 => 0.0707, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.77% (0.1968 => 0.2298, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.70% (0.2875 => 0.3355, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.67% (1.6211 => 1.8914, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.66% (0.4658 => 0.5434, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 16.64% (1.8794 => 2.1921, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.47% (0.1160 => 0.1351, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.32% (0.5026 => 0.5846, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.29% (0.3271 => 0.3804, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: 16.19% (0.9697 => 1.1267, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.15% (0.2911 => 0.3381) SingleSource/Benchmarks/Shootout-C++/strcat: 16.11% (0.2750 => 0.3193, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.09% (0.2729 => 0.3168, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 16.07% (0.2725 => 0.3163, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 16.05% (0.1421 => 0.1649, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.03% (0.2738 => 0.3177, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 15.99% (0.2714 => 0.3148, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 15.88% (0.3004 => 0.3481, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.87% (0.4361 => 0.5053, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: 15.85% (0.2813 => 0.3259, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 15.85% (0.9909 => 1.1480, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.84% (2.7292 => 3.1614, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.79% (4.4195 => 5.1175, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 15.79% (0.2780 => 0.3219, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 15.77% (0.2803 => 0.3245, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 15.76% (0.2823 => 0.3268, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 15.76% (0.7171 => 0.8301, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 15.71% (1.0781 => 1.2475, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 15.65% (0.2811 => 0.3251, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.65% (0.2792 => 0.3229, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 15.63% (0.3096 => 0.3580, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.59% (0.3195 => 0.3693, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.55% (0.3930 => 0.4541, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 15.47% (4.2109 => 4.8622, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/bh/bh: 15.42% (0.1284 => 0.1482, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 15.40% (0.3267 => 0.3770, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.35% (2.0673 => 2.3847, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary: 15.22% (0.3258 => 0.3754, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.18% (1.9694 => 2.2683, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 15.11% (23.5202 => 27.0736, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ary2: 15.01% (0.3317 => 0.3815, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.92% (1.9966 => 2.2945, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.90% (0.3060 => 0.3516, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.77% (0.1090 => 0.1251, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.66% (0.3124 => 0.3582, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.47% (0.3282 => 0.3757, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 14.41% (0.3678 => 0.4208, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.37% (0.3362 => 0.3845, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 14.36% (0.2075 => 0.2373, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 14.34% (0.3348 => 0.3828, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 14.29% (0.3465 => 0.3960, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 14.28% (0.3446 => 0.3938, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.19% (0.3488 => 0.3983, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.19% (0.3460 => 0.3951, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 14.18% (0.3469 => 0.3961, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.16% (0.3496 => 0.3991, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 14.15% (0.2566 => 0.2929, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.09% (0.3442 => 0.3927, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 13.98% (0.3726 => 0.4247, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.93% (0.3625 => 0.4130, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 13.92% (0.3477 => 0.3961, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 13.86% (0.3643 => 0.4148, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash: 13.82% (0.4146 => 0.4719, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 13.80% (1.4269 => 1.6238, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.78% (0.3650 => 0.4153, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.71% (0.3690 => 0.4196, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 13.59% (0.3724 => 0.4230, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 13.55% (0.4251 => 0.4827, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.39% (0.3981 => 0.4514, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 13.35% (0.7875 => 0.8926, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.34% (0.3845 => 0.4358, std.dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 13.14% (2.1653 => 2.4499, std.dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 12.85% (4.6177 => 5.2109, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 12.75% (0.5012 => 0.5651, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 12.61% (2.1013 => 2.3662, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.16% (0.2040 => 0.2288, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 12.11% (0.2691 => 0.3017, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.55% (0.6435 => 0.7178, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11.25% (5.5417 => 6.1653, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.85% (0.1383 => 0.1533, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 10.52% (0.3498 => 0.3866, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.41% (0.1028 => 0.1135) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.40% (0.2068 => 0.2283, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.38% (0.2737 => 0.3021, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 10.21% (0.4847 => 0.5342, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.11% (0.6634 => 0.7305, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.08% (0.3084 => 0.3395, std.dev.: 0.0040) MultiSource/Applications/minisat/minisat: 9.47% (0.3336 => 0.3652, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 9.44% (2.0346 => 2.2266, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 9.41% (0.2391 => 0.2616, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.89% (0.2103 => 0.2290, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.11% (0.5361 => 0.5796, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.11% (4.6926 => 5.0730, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.03% (11.6398 => 12.5739, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.34% (0.5584 => 0.5994, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.10% (0.7426 => 0.7953, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 6.40% (11.9555 => 12.7202, std.dev.: 0.0181) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.85% (0.3792 => 0.3976, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.98% (29.0505 => 33.4021, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 9.17% (0.2802 => 0.3059, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6113, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6738, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-2: 4.70% (1.8057 => 1.8906, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1685, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: 4.16% (14.0481 => 14.6328, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.14% (0.3693 => 0.3846, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1986, std.dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.64% (3.1722 => 3.2242, std.dev.: 0.0024) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3080, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2874, std.dev.: 0.0055) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5389, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5848, std.dev.: 0.0234) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.01% (2.4764 => 2.3770, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.89% (25.4195 => 16.5500, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/ary2: -8.99% (0.2402 => 0.2186, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9795, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7976, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8065, std.dev.: 0.0027) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.00% (0.6293 => 0.6104, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.95% (17.2379 => 16.7288, std.dev.: 0.0560) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8619, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5724, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4963, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1583, std.dev.: 0.0850) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0411, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 10:52:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 12:52:54 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121127185254.A48972A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6313?compare_to=6310&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6313, Order: 168705, Start Time: 2012-11-27 17:18:52, End Time: 2012-11-27 18:53:27 To: 6310, Order: 168701, Start Time: 2012-11-27 15:27:20, End Time: 2012-11-27 17:00:39 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (30 on baseline) Performance Regressions: 5 (43 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 39 (38 on baseline) Unchanged Tests: 1048 (918 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.37% (0.6439 => 0.6656, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.69% (1.3776 => 1.4009, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.45% (1.2870 => 1.3056, std.dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 60.38% (0.0212 => 0.0340, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.99% (58.0905 => 59.8294, std.dev.: 0.5189) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.01% (1.0814 => 1.1139, std.dev.: 0.0211) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.34% (0.0224 => 0.0221, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.61% (0.0435 => 0.0428, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.47% (0.0339 => 0.0334, std.dev.: 0.0096) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.63% (0.0319 => 0.0317, std.dev.: 0.0095) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.84% (0.0434 => 0.0426, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/casts: -2.83% (0.0212 => 0.0206, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -1.35% (0.0223 => 0.0220, std.dev.: 0.0075) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -2.81% (0.1528 => 0.1485, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: -6.69% (1.1989 => 1.1187, std.dev.: 0.2622) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.32% (0.4132 => 0.4228, std.dev.: 0.0389) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.09% (0.1486 => 0.1455, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 16.72% (0.0592 => 0.0691, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.08% (0.0278 => 0.0275, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.25% (0.0591 => 0.0560, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.63% (1.1926 => 1.2001, std.dev.: 0.0291) MultiSource/Benchmarks/SciMark2-C/scimark2: 0.14% (9.4471 => 9.4603, std.dev.: 0.0660) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 237.50% (0.0008 => 0.0027, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.23% (0.0610 => 0.0648, std.dev.: 0.0141) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 42.02% (0.0188 => 0.0267, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.54% (0.7747 => 0.7789, std.dev.: 0.1328) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -11.11% (0.0090 => 0.0080, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/SciMark2-C/scimark2: -66.90% (28.5821 => 9.4603, std.dev.: 0.0660) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.82% (16.4461 => 17.8961, std.dev.: 0.8320) MultiSource/Applications/sqlite3/sqlite3: 2351.26% (0.6332 => 15.5214, std.dev.: 0.6371) MultiSource/Benchmarks/McCat/08-main/main: 58.00% (0.1831 => 0.2893, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.55% (0.1559 => 0.1488, std.dev.: 0.0194) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7157.09% (0.3123 => 22.6639, std.dev.: 0.7650) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.64% (0.2463 => 0.3735, std.dev.: 0.0370) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1559.45% (0.3344 => 5.5492, std.dev.: 0.3316) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.32% (0.2364 => 0.3270, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/bigfib: 5.42% (0.6010 => 0.6336, std.dev.: 0.1769) SingleSource/Benchmarks/Misc/mandel: 3.03% (0.0429 => 0.0442, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.61% (0.3266 => 0.3482, std.dev.: 0.0566) SingleSource/Benchmarks/Shootout-C++/strcat: 5.99% (0.1969 => 0.2087, std.dev.: 0.0639) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.68% (0.0224 => 0.0230, std.dev.: 0.0077) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0027) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0524, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 12.24% (0.1462 => 0.1641, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4698, std.dev.: 0.1228) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0717, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4861, std.dev.: 0.0063) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5117, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5105, std.dev.: 0.4353) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3129, std.dev.: 0.0976) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1314, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3628, std.dev.: 0.0247) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3908, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0882, std.dev.: 0.0211) SingleSource/Regression/C/uint64_to_float: -23.68% (2.1832 => 1.6663, std.dev.: 0.0097) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.64% (0.0717 => 0.0822, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.44% (0.0848 => 0.0962, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.75% (0.6010 => 0.6656, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.31% (0.7473 => 0.8169, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.86% (0.4847 => 0.5228, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.34% (0.3295 => 0.3537, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.02% (0.5961 => 0.6320, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.68% (1.1170 => 1.1805, std.dev.: 0.0188) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.50% (0.4127 => 0.4354, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.50% (1.3279 => 1.4009, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.28% (0.8204 => 0.8637, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.25% (0.6287 => 0.6617, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.90% (0.3003 => 0.3150, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.85% (0.5817 => 0.6099, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.64% (0.6227 => 0.6516, std.dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.95% (0.3717 => 0.3864, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.60% (1.2602 => 1.3056, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/football/football: 3.30% (0.8768 => 0.9057, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 132.16% (0.0199 => 0.0462, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/pi: 55.82% (1.5795 => 2.4611, std.dev.: 0.0256) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.76% (0.7597 => 0.8946, std.dev.: 0.0312) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.35% (2.9753 => 3.4618, std.dev.: 0.0425) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 15.51% (2.7995 => 3.2337, std.dev.: 0.0385) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.73% (5.0261 => 5.6158, std.dev.: 0.0220) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.70% (0.3186 => 0.3495, std.dev.: 0.0099) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.12% (1.1857 => 1.2820, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 7.87% (3.1873 => 3.4381, std.dev.: 0.0363) SingleSource/Benchmarks/McGill/queens: 7.18% (1.7056 => 1.8281, std.dev.: 0.0436) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.71% (4.7794 => 5.0999, std.dev.: 0.0835) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (1.3037 => 1.3898, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.92% (4.9686 => 5.2628, std.dev.: 0.0211) MultiSource/Applications/lambda-0_1_3/lambda: 5.72% (7.4933 => 7.9222, std.dev.: 0.0886) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.43% (3.3761 => 3.5258, std.dev.: 0.0182) MultiSource/Applications/siod/siod: 3.95% (3.6643 => 3.8091, std.dev.: 0.0351) MultiSource/Applications/hexxagon/hexxagon: 3.93% (14.0064 => 14.5572, std.dev.: 0.0553) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.79% (6.3772 => 6.6188, std.dev.: 0.0922) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.85% (11.5690 => 11.8991, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.37% (8.2783 => 8.4744, std.dev.: 0.0267) SingleSource/Benchmarks/Shootout/lists: 2.33% (7.3375 => 7.5086, std.dev.: 0.0158) MultiSource/Applications/spiff/spiff: 1.99% (2.8561 => 2.9129, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/power/power: 1.77% (1.2061 => 1.2275, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.72% (2.4647 => 2.5072, std.dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.17% (3.5679 => 3.6098, std.dev.: 0.0107) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.19% (2.8951 => 1.6736, std.dev.: 0.0262) MultiSource/Benchmarks/Olden/em3d/em3d: -20.82% (5.4641 => 4.3265, std.dev.: 0.0996) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.47% (7.2130 => 6.1695, std.dev.: 0.0929) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.61% (1.0512 => 0.9397, std.dev.: 0.0146) MultiSource/Benchmarks/mafft/pairlocalalign: -8.49% (63.1822 => 57.8203, std.dev.: 0.0931) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.96% (14.6451 => 13.6251, std.dev.: 0.0802) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.83% (4.7482 => 4.4241, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.96% (3.7148 => 3.4934, std.dev.: 0.0470) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.72% (5.4972 => 5.1825, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.70% (6.0224 => 5.7997, std.dev.: 0.0512) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.49% (2.8773 => 2.7769, std.dev.: 0.0368) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.77% (9.9065 => 9.7314, std.dev.: 0.0656) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 8.55% (1.0262 => 1.1139, std.dev.: 0.0211) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 79.67% (0.0123 => 0.0221, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.50% (0.0254 => 0.0334, std.dev.: 0.0096) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.97% (0.0302 => 0.0317, std.dev.: 0.0095) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.94% (0.0384 => 0.0426, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/casts: 8.42% (0.0190 => 0.0206, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 22.22% (0.0180 => 0.0220, std.dev.: 0.0075) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 3.27% (0.1438 => 0.1485, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: -1.25% (1.1329 => 1.1187, std.dev.: 0.2622) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.54% (0.4164 => 0.4228, std.dev.: 0.0389) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.28% (0.1369 => 0.1455, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.80% (0.0641 => 0.0691, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.03% (0.0195 => 0.0275, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.11% (0.0578 => 0.0560, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.93% (1.1437 => 1.2001, std.dev.: 0.0291) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.35% (0.0627 => 0.0648, std.dev.: 0.0141) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.84% (0.8017 => 0.7789, std.dev.: 0.1328) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 29.03% (0.0062 => 0.0080, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 11:00:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 13:00:52 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121127190052.199A02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6314?compare_to=6309&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6314, Order: 168702, Start Time: 2012-11-27 16:42:14, End Time: 2012-11-27 19:01:21 To: 6309, Order: 168694, Start Time: 2012-11-27 13:24:53, End Time: 2012-11-27 15:43:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 30 (142 on baseline) Performance Improvements: 2 (43 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1054 (700 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.34% (0.4206 => 0.4767, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.51% (1.7997 => 1.9529, std.dev.: 0.0559) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.37% (0.5839 => 0.6328, std.dev.: 0.0128) MultiSource/Applications/Burg/burg: 8.24% (1.3393 => 1.4496, std.dev.: 0.0310) MultiSource/Benchmarks/McCat/08-main/main: 8.22% (0.3127 => 0.3384, std.dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: 7.93% (1.3940 => 1.5045, std.dev.: 0.0348) MultiSource/Applications/aha/aha: 7.69% (0.1326 => 0.1428, std.dev.: 0.0036) MultiSource/Applications/viterbi/viterbi: 7.29% (0.1796 => 0.1927, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.06% (0.1911 => 0.2046, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.03% (0.5134 => 0.5495, std.dev.: 0.0034) MultiSource/Applications/hbd/hbd: 6.93% (1.7328 => 1.8528, std.dev.: 0.0226) MultiSource/Benchmarks/McCat/09-vor/vor: 6.62% (0.3578 => 0.3815, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/oourafft: 6.60% (0.3605 => 0.3843, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/05-eks/eks: 5.34% (0.4797 => 0.5053, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.30% (0.2416 => 0.2544, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/property: 4.43% (0.4383 => 0.4577, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 4.39% (0.6497 => 0.6782, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.82% (0.3981 => 0.4133, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/trivial-interface: 3.51% (0.3902 => 0.4039, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 3.50% (0.4004 => 0.4144, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 3.47% (0.4438 => 0.4592, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 2.97% (0.6633 => 0.6830, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/SPASS/SPASS: 18.94% (12.7333 => 15.1449, std.dev.: 0.4528) MultiSource/Benchmarks/McCat/09-vor/vor: 18.49% (0.1195 => 0.1416, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 10.59% (5.3752 => 5.9446, std.dev.: 0.2178) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.14% (2.1010 => 2.2931, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 8.90% (2.7632 => 3.0090, std.dev.: 0.0405) SingleSource/Benchmarks/CoyoteBench/lpbench: 3.95% (10.4483 => 10.8608, std.dev.: 0.0775) MultiSource/Applications/sqlite3/sqlite3: 3.06% (4.5918 => 4.7321, std.dev.: 0.0382) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.55% (3.0217 => 3.0686, std.dev.: 0.0053) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C++/ofstream_ctor: -4.31% (0.3595 => 0.3440, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.01% (87.6904 => 86.8076, std.dev.: 0.2697) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.11% (70.0108 => 69.9371, std.dev.: 0.0939) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1338 => 0.1338, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.42% (0.0443 => 0.0419, std.dev.: 0.0074) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.04% (0.0675 => 0.0668, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -0.05% (494.2000 => 493.9715, std.dev.: 0.2398) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 10.58% (63.2438 => 69.9371, std.dev.: 0.0939) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0419, std.dev.: 0.0074) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43703.45% (1.1277 => 493.9715, std.dev.: 0.2398) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 207.00% (0.5229 => 1.6053, std.dev.: 0.0650) MultiSource/Applications/SPASS/SPASS: 20.69% (14.9895 => 18.0908, std.dev.: 0.1804) MultiSource/Applications/kimwitu++/kc: 50.20% (14.1553 => 21.2615, std.dev.: 0.1495) MultiSource/Benchmarks/MallocBench/gs/gs: 21.38% (4.1105 => 4.9894, std.dev.: 0.2080) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 46.17% (1.1048 => 1.6149, std.dev.: 0.0319) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 433.95% (7.1582 => 38.2210, std.dev.: 0.3295) SingleSource/Benchmarks/Misc-C++-EH/spirit: 76.35% (3.4629 => 6.1067, std.dev.: 0.4781) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.98% (0.6222 => 1.0327, std.dev.: 0.0729) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10466.94% (0.0720 => 7.6082, std.dev.: 0.3015) MultiSource/Applications/SIBsim4/SIBsim4: 3859400.00% (0.0001 => 3.8595, std.dev.: 0.0453) MultiSource/Applications/SPASS/SPASS: 15144800.00% (0.0001 => 15.1449, std.dev.: 0.4528) MultiSource/Applications/kimwitu++/kc: 51700.00% (0.0001 => 0.0518, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 64000.00% (0.0001 => 0.0641, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14400.00% (0.0001 => 0.0145, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576200.00% (0.0001 => 0.5763, std.dev.: 0.0191) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10090300.00% (0.0001 => 10.0904, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5671200.00% (0.0001 => 5.6713, std.dev.: 0.7416) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1797.11% (1.1194 => 21.2363, std.dev.: 0.2561) MultiSource/Applications/ClamAV/clamscan: 67.79% (22.1758 => 37.2095, std.dev.: 0.4728) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 62.97% (2.9384 => 4.7887, std.dev.: 0.2418) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 51.91% (7.0540 => 10.7160, std.dev.: 0.4412) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.20% (8.1363 => 12.2205, std.dev.: 0.1342) MultiSource/Applications/JM/lencod/lencod: 47.38% (21.9371 => 32.3301, std.dev.: 0.1450) MultiSource/Benchmarks/FreeBench/distray/distray: 44.60% (0.1056 => 0.1527, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops: 43.58% (0.1432 => 0.2056, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/almabench: 42.60% (0.0730 => 0.1041, std.dev.: 0.0005) SingleSource/UnitTests/vla: 39.72% (0.0355 => 0.0496, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Oscar: 32.55% (0.0636 => 0.0843, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 32.50% (0.2554 => 0.3384, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/dot-syntax-1: 29.85% (0.0479 => 0.0622, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 29.17% (0.1584 => 0.2046, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/messages-2: 28.70% (0.0662 => 0.0852, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.87% (0.0793 => 0.1014, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/tsp/tsp: 25.87% (0.1175 => 0.1479, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.51% (0.0886 => 0.1112, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/17-bintr/bintr: 25.33% (0.0675 => 0.0846, std.dev.: 0.0050) SingleSource/Benchmarks/Stanford/Towers: 24.84% (0.0471 => 0.0588, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 24.51% (1.1642 => 1.4496, std.dev.: 0.0310) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.35% (0.0842 => 0.1047, std.dev.: 0.0019) MultiSource/Applications/aha/aha: 24.07% (0.1151 => 0.1428, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 23.96% (0.5105 => 0.6328, std.dev.: 0.0128) MultiSource/Applications/viterbi/viterbi: 23.92% (0.1555 => 0.1927, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.86% (0.0746 => 0.0924, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: 23.44% (0.1655 => 0.2043, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 23.14% (1.5859 => 1.9529, std.dev.: 0.0559) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.88% (0.1062 => 0.1305, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 22.70% (0.0467 => 0.0573, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: 22.04% (0.0626 => 0.0764, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wordfreq: 21.89% (0.3307 => 0.4031, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/bigfib: 21.64% (0.6456 => 0.7853, std.dev.: 0.0286) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.52% (0.1566 => 0.1903, std.dev.: 0.0097) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 21.45% (0.0648 => 0.0787, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/hash: 21.44% (0.0485 => 0.0589, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 21.26% (0.7835 => 0.9501, std.dev.: 0.0222) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 21.14% (0.3935 => 0.4767, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.03% (0.2758 => 0.3338, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/reversefile: 20.96% (0.3865 => 0.4675, std.dev.: 0.0154) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.74% (0.2107 => 0.2544, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 20.49% (1.5415 => 1.8574, std.dev.: 0.0487) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.20% (0.5860 => 0.7044, std.dev.: 0.0192) MultiSource/Benchmarks/nbench/nbench: 20.01% (1.1840 => 1.4209, std.dev.: 0.0307) MultiSource/Benchmarks/McCat/09-vor/vor: 19.97% (0.3180 => 0.3815, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.73% (0.8067 => 0.9659, std.dev.: 0.0242) SingleSource/Benchmarks/Shootout/matrix: 19.68% (0.0818 => 0.0979, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/exptree: 19.66% (0.0814 => 0.0974, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 19.56% (0.5981 => 0.7151, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.30% (0.4203 => 0.5014, std.dev.: 0.0133) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.26% (0.2700 => 0.3220, std.dev.: 0.0186) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.20% (0.2271 => 0.2707, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/sieve: 19.04% (0.3603 => 0.4289, std.dev.: 0.0234) SingleSource/Benchmarks/McGill/misr: 18.96% (0.0633 => 0.0753, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: 18.95% (0.0929 => 0.1105, std.dev.: 0.0017) MultiSource/Applications/hbd/hbd: 18.75% (1.5603 => 1.8528, std.dev.: 0.0226) SingleSource/UnitTests/2006-12-11-LoadConstants: 18.72% (0.1143 => 0.1357, std.dev.: 0.0043) MultiSource/Applications/d/make_dparser: 18.70% (3.3354 => 3.9591, std.dev.: 0.1277) SingleSource/Benchmarks/CoyoteBench/fftbench: 18.53% (0.4636 => 0.5495, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 18.52% (0.2603 => 0.3085, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 18.50% (4.9449 => 5.8596, std.dev.: 0.1097) SingleSource/Regression/C++/ofstream_ctor: 18.42% (0.2905 => 0.3440, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.40% (0.6450 => 0.7637, std.dev.: 0.0198) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.40% (0.1125 => 0.1332, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists1: 18.13% (0.3684 => 0.4352, std.dev.: 0.0210) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.81% (0.2891 => 0.3406, std.dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.80% (0.0871 => 0.1026, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/property: 17.78% (0.3886 => 0.4577, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 17.70% (0.3232 => 0.3804, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/except: 17.55% (0.2871 => 0.3375, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/05-eks/eks: 17.54% (0.4299 => 0.5053, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.27% (0.2756 => 0.3232, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ary3: 17.27% (0.3283 => 0.3850, std.dev.: 0.0092) SingleSource/UnitTests/ObjC/exceptions: 17.16% (0.3828 => 0.4485, std.dev.: 0.0094) MultiSource/Applications/hexxagon/hexxagon: 17.15% (1.2842 => 1.5045, std.dev.: 0.0348) SingleSource/Benchmarks/Stanford/Puzzle: 17.11% (0.1268 => 0.1485, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/oourafft: 17.09% (0.3282 => 0.3843, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary2: 17.08% (0.3379 => 0.3956, std.dev.: 0.0074) SingleSource/UnitTests/ObjC/parameter-passing: 16.93% (0.3927 => 0.4592, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wc: 16.87% (0.3052 => 0.3567, std.dev.: 0.0087) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.85% (0.8172 => 0.9549, std.dev.: 0.0278) SingleSource/Benchmarks/Shootout-C++/fibo: 16.81% (0.2725 => 0.3183, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/matrix: 16.69% (0.3098 => 0.3615, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.65% (0.3543 => 0.4133, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.65% (14.3668 => 16.7587, std.dev.: 0.7045) MultiSource/Benchmarks/FreeBench/neural/neural: 16.54% (0.1463 => 0.1705, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-2: 16.44% (0.3497 => 0.4072, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/synchronized: 16.37% (0.3561 => 0.4144, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 16.30% (0.3473 => 0.4039, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 16.22% (0.3694 => 0.4293, std.dev.: 0.0075) SingleSource/UnitTests/ObjC/exceptions-3: 16.21% (0.3516 => 0.4086, std.dev.: 0.0061) SingleSource/UnitTests/SignlessTypes/rem: 16.17% (0.1144 => 0.1329, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.16% (0.0953 => 0.1107, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-4: 16.14% (0.3543 => 0.4115, std.dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: 16.03% (9.4845 => 11.0053, std.dev.: 0.3475) MultiSource/Benchmarks/Olden/mst/mst: 15.99% (0.1163 => 0.1349, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/em3d/em3d: 15.99% (0.1695 => 0.1966, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/strcat: 15.82% (0.2831 => 0.3279, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.58% (0.0770 => 0.0890, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.40% (0.2065 => 0.2383, std.dev.: 0.0100) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 15.37% (0.1906 => 0.2199, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.04% (0.1117 => 0.1285, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.68% (0.0770 => 0.0883, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.63% (0.0834 => 0.0956, std.dev.: 0.0035) SingleSource/UnitTests/ObjC++/Hello: 14.46% (0.5925 => 0.6782, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: 14.01% (0.2049 => 0.2336, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.91% (0.0798 => 0.0909, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference-object: 13.27% (0.6030 => 0.6830, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.02% (0.8101 => 0.9156, std.dev.: 0.0342) SingleSource/Benchmarks/Shootout-C++/hash: 12.29% (0.4289 => 0.4816, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.27% (0.5020 => 0.5636, std.dev.: 0.0188) SingleSource/Benchmarks/Shootout-C++/hash2: 11.88% (0.4620 => 0.5169, std.dev.: 0.0176) SingleSource/UnitTests/ObjC++/property-reference: 9.92% (0.7326 => 0.8053, std.dev.: 0.0178) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.93% (0.3817 => 0.4158, std.dev.: 0.0074) MultiSource/Benchmarks/PAQ8p/paq8p: 7.34% (10.3673 => 11.1280, std.dev.: 0.2616) Performance Regressions - Execution Time ---------------------------------------- SingleSource/UnitTests/ObjC/synchronized: 218.74% (0.1051 => 0.3350, std.dev.: 0.0678) SingleSource/Benchmarks/Shootout/methcall: 149.59% (4.3953 => 10.9703, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/methcall: 147.20% (5.3999 => 13.3483, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/09-vor/vor: 22.70% (0.1154 => 0.1416, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/oourafft: 17.46% (6.6465 => 7.8072, std.dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.64% (1.1145 => 1.3000, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.04% (0.2944 => 0.3328, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.63% (2.0360 => 2.2931, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.58% (2.8904 => 3.2250, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/richards_benchmark: 10.22% (1.1396 => 1.2561, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.31% (1.7254 => 1.8861, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.87% (4.2280 => 4.4763, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 4.98% (10.3460 => 10.8608, std.dev.: 0.0775) MultiSource/Applications/lua/lua: 4.83% (26.0924 => 27.3530, std.dev.: 0.1269) MultiSource/Benchmarks/nbench/nbench: 4.01% (11.6436 => 12.1105, std.dev.: 0.0118) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.32% (0.4162 => 0.4300, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.22% (3.6395 => 3.7204, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 2.04% (3.1595 => 3.2239, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 1.69% (85.0658 => 86.5045, std.dev.: 0.1787) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.45% (6.5088 => 6.6034, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.28% (1.0313 => 1.0445, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.27% (27.8444 => 28.1982, std.dev.: 0.0517) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0504, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1675, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.61% (5.2763 => 1.2340, std.dev.: 0.0478) SingleSource/Benchmarks/Misc/salsa20: -75.30% (0.8651 => 0.2137, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/richards_benchmark: -44.64% (0.1622 => 0.0898, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.85% (5.3855 => 4.6933, std.dev.: 0.1607) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.31% (5.3526 => 4.6936, std.dev.: 0.1520) MultiSource/Applications/JM/ldecod/ldecod: -8.74% (10.4361 => 9.5240, std.dev.: 0.3442) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -68.57% (32.5116 => 10.2175, std.dev.: 0.0232) SingleSource/Benchmarks/Dhrystone/fldry: -64.57% (1.9577 => 0.6937, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1681, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.23% (0.3987 => 0.2383, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.92% (0.0506 => 0.0304) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.27% (4.5009 => 2.7783, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.17% (2.6546 => 2.0130, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/mason/mason: -19.39% (0.2161 => 0.1742, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -16.06% (1.6925 => 1.4207, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2840, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -10.52% (9.5636 => 8.5576, std.dev.: 0.1916) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.05% (1.5660 => 1.4242, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.93% (4.8142 => 4.4806, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -5.76% (19.9488 => 18.7990, std.dev.: 0.3379) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5758, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.34% (3.2416 => 3.0686, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.10% (0.8614 => 0.8175, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.93% (0.2497 => 0.2374, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5090, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: -4.40% (6.2999 => 6.0227, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.04% (1.6805 => 1.6126, std.dev.: 0.0202) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.33% (0.9957 => 0.9625, std.dev.: 0.0069) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8917, std.dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.72% (0.4808 => 0.4677, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6773, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.74% (8.1563 => 8.0145, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/salsa20: -1.49% (10.2830 => 10.1298, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.43% (0.2116 => 0.0668, std.dev.: 0.0006) Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 11:30:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 13:30:36 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121127193036.CD35C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6315?compare_to=6311&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6315, Order: 168705, Start Time: 2012-11-27 17:58:49, End Time: 2012-11-27 19:31:08 To: 6311, Order: 168701, Start Time: 2012-11-27 16:03:22, End Time: 2012-11-27 17:35:36 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 4 (7 on baseline) Performance Improvements: 0 (182 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1088 (853 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 12.63% (0.3903 => 0.4396, std.dev.: 0.0113) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.70% (54.4815 => 56.4979, std.dev.: 0.0400) MultiSource/Benchmarks/llubenchmark/llu: 1.76% (3.7532 => 3.8191, std.dev.: 0.0153) SingleSource/Benchmarks/Dhrystone/fldry: 1.70% (0.6900 => 0.7017, std.dev.: 0.0042) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 14.66% (0.3834 => 0.4396, std.dev.: 0.0113) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.29% (1.2783 => 1.3715, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.52% (54.5751 => 56.4979, std.dev.: 0.0400) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.40% (2.0478 => 2.1174, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: 2.40% (7.4937 => 7.6735, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/hash2: 2.04% (3.1932 => 3.2582, std.dev.: 0.0022) MultiSource/Benchmarks/llubenchmark/llu: 2.02% (3.7435 => 3.8191, std.dev.: 0.0153) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.74% (0.1431 => 0.1306, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.62% (0.3821 => 0.3530, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.85% (0.9542 => 0.8888, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.84% (0.3142 => 0.2927, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -6.77% (2.4924 => 2.3236, std.dev.: 0.0064) MultiSource/Applications/sgefa/sgefa: -6.67% (0.3357 => 0.3133, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: -6.48% (0.2160 => 0.2020, std.dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: -6.22% (9.2283 => 8.6545, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.12% (0.9852 => 0.9249, std.dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: -6.11% (16.1920 => 15.2019, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.08% (0.5857 => 0.5501, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.07% (0.5863 => 0.5507, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: -6.07% (0.1879 => 0.1765, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: -6.06% (0.9179 => 0.8623, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.05% (0.5591 => 0.5253, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.03% (0.5925 => 0.5568, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.02% (0.5478 => 0.5148, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.01% (0.2428 => 0.2282, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.99% (0.6260 => 0.5885, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.96% (0.5802 => 0.5456, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.95% (0.5849 => 0.5501, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.94% (0.5705 => 0.5366, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: -5.94% (7.0961 => 6.6745, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.92% (0.6230 => 0.5861, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.92% (0.6052 => 0.5694, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.88% (1.0544 => 0.9924, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.88% (0.6667 => 0.6275, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.88% (0.5581 => 0.5253, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.86% (0.6484 => 0.6104, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.86% (0.6297 => 0.5928, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.86% (0.2355 => 0.2217, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.85% (0.1761 => 0.1658, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.84% (0.5805 => 0.5466, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.81% (0.5941 => 0.5596, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.80% (1.3722 => 1.2926, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.80% (0.6660 => 0.6274, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.80% (0.3658 => 0.3446, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.78% (0.6194 => 0.5836, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.76% (0.6304 => 0.5941, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.75% (0.5859 => 0.5522, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.75% (0.5688 => 0.5361, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.74% (4.0323 => 3.8007, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.74% (0.6446 => 0.6076, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.71% (0.5570 => 0.5252, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -5.71% (1.1530 => 1.0872, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.69% (4.8161 => 4.5420, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.69% (0.5575 => 0.5258, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.68% (0.2695 => 0.2542, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.68% (0.6676 => 0.6297, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.66% (0.6681 => 0.6303, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.63% (1.2300 => 1.1607, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -5.63% (0.4515 => 0.4261, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.62% (3.5339 => 3.3353, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.61% (0.6440 => 0.6079, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.60% (1.6364 => 1.5447, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.60% (4.8802 => 4.6071, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.59% (0.5456 => 0.5151, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.59% (0.3884 => 0.3667, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -5.56% (0.3812 => 0.3600, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.54% (0.8521 => 0.8049, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.53% (0.7198 => 0.6800, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.52% (4.5069 => 4.2581, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: -5.52% (1.1450 => 1.0818, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.52% (0.3896 => 0.3681, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -5.52% (0.3880 => 0.3666, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.46% (6.7716 => 6.4022, std.dev.: 0.0074) MultiSource/Applications/SIBsim4/SIBsim4: -5.43% (1.3864 => 1.3111, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: -5.43% (0.4033 => 0.3814, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -5.43% (0.3831 => 0.3623, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.42% (1.4642 => 1.3849, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.40% (0.6736 => 0.6372, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.40% (1.2784 => 1.2094, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.37% (0.3891 => 0.3682, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.37% (0.6293 => 0.5955, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.37% (0.7919 => 0.7494, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions: -5.34% (0.4176 => 0.3953, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.29% (14.2083 => 13.4564, std.dev.: 0.0153) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.27% (0.4916 => 0.4657, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -5.26% (0.3025 => 0.2866, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.26% (0.3406 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.20% (1.2210 => 1.1575, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/fibo: -5.15% (0.2871 => 0.2723, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -5.14% (17.1032 => 16.2247, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.14% (0.3057 => 0.2900, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -5.13% (0.3255 => 0.3088, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -5.12% (4.3330 => 4.1111, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.12% (0.5999 => 0.5692, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.11% (0.3931 => 0.3730, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.11% (0.7339 => 0.6964, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.11% (8.0126 => 7.6033, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.11% (0.3837 => 0.3641, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -5.10% (0.2939 => 0.2789, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.10% (0.3194 => 0.3031, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.09% (0.2278 => 0.2162, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -5.09% (0.3205 => 0.3042, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: -5.08% (1.3148 => 1.2480, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.08% (0.2933 => 0.2784, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.07% (0.3016 => 0.2863, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.06% (2.1713 => 2.0615) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.03% (0.2903 => 0.2757, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -5.01% (15.5079 => 14.7315, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.99% (0.6395 => 0.6076, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -4.98% (0.2849 => 0.2707, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -4.98% (0.4199 => 0.3990, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -4.98% (3.5154 => 3.3405, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.96% (0.4151 => 0.3945, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -4.96% (0.2985 => 0.2837, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -4.96% (0.3026 => 0.2876, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.95% (0.2385 => 0.2267, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.95% (0.2548 => 0.2422, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: -4.93% (1.2515 => 1.1898, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.89% (0.6395 => 0.6082, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.89% (1.2221 => 1.1623, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.89% (0.7524 => 0.7156, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.89% (0.3252 => 0.3093, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.88% (0.5569 => 0.5297, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.87% (0.2999 => 0.2853, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: -4.85% (5.0226 => 4.7789, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: -4.85% (0.2659 => 0.2530, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.83% (0.3849 => 0.3663, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.82% (0.4813 => 0.4581, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -4.81% (15.2527 => 14.5183, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary3: -4.79% (0.3446 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -4.78% (0.2989 => 0.2846, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -4.77% (0.3059 => 0.2913, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.77% (0.3483 => 0.3317, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -4.76% (0.4248 => 0.4046, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.75% (0.3323 => 0.3165, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -4.75% (0.7447 => 0.7093, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.72% (0.4321 => 0.4117, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -4.71% (0.3394 => 0.3234, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -4.71% (0.3481 => 0.3317, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -4.69% (0.3581 => 0.3413, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -4.69% (0.4861 => 0.4633, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.67% (0.5329 => 0.5080, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.67% (0.7021 => 0.6693, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.65% (0.5567 => 0.5308, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.65% (0.4280 => 0.4081, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.61% (0.5168 => 0.4930, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: -4.60% (0.3867 => 0.3689, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.51% (0.9557 => 0.9126, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.49% (1.6474 => 1.5735, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout-C++/lists: -4.47% (0.3621 => 0.3459, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -4.47% (0.4524 => 0.4322, std.dev.: 0.0019) MultiSource/Applications/treecc/treecc: -4.46% (2.1401 => 2.0446, std.dev.: 0.0030) MultiSource/Applications/lua/lua: -4.46% (4.0594 => 3.8784, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.43% (0.4083 => 0.3902, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: -4.35% (0.7779 => 0.7441, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: -4.27% (34.0927 => 32.6368, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/Hello: -4.27% (0.6347 => 0.6076, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -4.25% (0.7982 => 0.7643, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.24% (22.4056 => 21.4563, std.dev.: 0.0054) MultiSource/Applications/siod/siod: -4.19% (2.4021 => 2.3014, std.dev.: 0.0054) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.19% (0.3319 => 0.3180, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.18% (0.4427 => 0.4242, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -4.15% (0.6441 => 0.6174, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -4.13% (0.3271 => 0.3136, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: -4.09% (1.5610 => 1.4972, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sieve: -4.04% (0.3788 => 0.3635, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -3.91% (0.6750 => 0.6486, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.90% (0.9077 => 0.8723, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -3.85% (0.8418 => 0.8094, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.80% (2.2587 => 2.1728, std.dev.: 0.0070) MultiSource/Applications/kimwitu++/kc: -3.73% (18.2933 => 17.6106, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.67% (0.3491 => 0.3363, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.74% (5.4682 => 5.3184, std.dev.: 0.0020) SingleSource/UnitTests/Vector/constpool: -2.33% (20.7746 => 20.2905, std.dev.: 0.0565) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1960, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: -61.23% (1.8100 => 0.7017, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7569, std.dev.: 0.0085) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -8.66% (1.2842 => 1.1730, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.89% (2.2633 => 2.1753, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.25% (1.3096 => 1.2671, std.dev.: 0.0119) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4694, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 12:48:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 14:48:24 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121127204824.C159A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6316?compare_to=6313&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6316, Order: 168712, Start Time: 2012-11-27 19:13:25, End Time: 2012-11-27 20:48:56 To: 6313, Order: 168705, Start Time: 2012-11-27 17:18:52, End Time: 2012-11-27 18:53:27 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (30 on baseline) Performance Regressions: 5 (43 on baseline) Performance Improvements: 2 (17 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 39 (38 on baseline) Unchanged Tests: 1046 (913 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.28% (3.2733 => 3.4787, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.46% (1.0371 => 1.0522, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel24: 36.32% (0.3447 => 0.4699, std.dev.: 0.0413) SingleSource/Benchmarks/Linpack/linpack-pc: 31.08% (39.1904 => 51.3711, std.dev.: 0.8648) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.80% (6.6188 => 6.9362, std.dev.: 0.1090) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -2.55% (0.8642 => 0.8422, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -1.29% (0.8296 => 0.8189, std.dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.93% (1.1139 => 1.0924, std.dev.: 0.2799) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.45% (0.0221 => 0.0222, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.70% (0.0428 => 0.0431, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.60% (0.0334 => 0.0336, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0317 => 0.0317, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0426 => 0.0428, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 1.94% (0.0206 => 0.0210, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0220 => 0.0220, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.41% (0.1485 => 0.1506, std.dev.: 0.0244) MultiSource/Applications/lemon/lemon: 15.50% (1.1187 => 1.2921, std.dev.: 0.1661) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.02% (0.4228 => 0.4229, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.37% (0.1455 => 0.1435, std.dev.: 0.0258) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.97% (0.0691 => 0.0629, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.55% (0.0275 => 0.0268, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.89% (0.0560 => 0.0555, std.dev.: 0.0137) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.32% (1.2001 => 1.1962, std.dev.: 0.0481) MultiSource/Benchmarks/SciMark2-C/scimark2: -0.07% (9.4603 => 9.4535, std.dev.: 0.0826) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -59.26% (0.0027 => 0.0011, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.62% (0.0648 => 0.0644, std.dev.: 0.0186) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0267 => 0.0267, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.93% (0.7789 => 0.7939, std.dev.: 0.0075) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -15.00% (0.0080 => 0.0068, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/SciMark2-C/scimark2: -66.93% (28.5821 => 9.4535, std.dev.: 0.0826) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.89% (16.4461 => 17.9087, std.dev.: 0.6114) MultiSource/Applications/sqlite3/sqlite3: 2352.92% (0.6332 => 15.5319, std.dev.: 0.6970) MultiSource/Benchmarks/McCat/08-main/main: 51.34% (0.1831 => 0.2771, std.dev.: 0.0538) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.13% (0.1559 => 0.1557, std.dev.: 0.0122) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7250.69% (0.3123 => 22.9562, std.dev.: 0.7906) SingleSource/Benchmarks/CoyoteBench/fftbench: 52.42% (0.2463 => 0.3754, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1577.63% (0.3344 => 5.6100, std.dev.: 0.2151) SingleSource/Benchmarks/Misc-C++/Large/ray: 40.99% (0.2364 => 0.3333, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/bigfib: 6.31% (0.6010 => 0.6389, std.dev.: 0.0179) SingleSource/Benchmarks/Misc/mandel: 2.10% (0.0429 => 0.0438, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.52% (0.3266 => 0.3479, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/strcat: 6.55% (0.1969 => 0.2098, std.dev.: 0.0356) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.59% (0.0224 => 0.0241, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0525, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 12.24% (0.1462 => 0.1641, std.dev.: 0.0271) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4744, std.dev.: 0.2330) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0711, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4882, std.dev.: 0.0328) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5136, std.dev.: 0.0170) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.6455, std.dev.: 0.3917) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3610, std.dev.: 0.0394) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1368, std.dev.: 0.0377) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3630, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4009, std.dev.: 0.0463) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0874, std.dev.: 0.0166) SingleSource/Regression/C/uint64_to_float: -23.20% (2.1832 => 1.6767, std.dev.: 0.0039) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.28% (3.1832 => 3.4787, std.dev.: 0.0169) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.64% (0.3717 => 0.4001, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary: 7.11% (0.2390 => 0.2560, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 6.58% (0.1839 => 0.1960, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.20% (0.9908 => 1.0522, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.93% (0.7966 => 0.8438, std.dev.: 0.0154) MultiSource/Applications/lua/lua: 5.76% (3.8189 => 4.0390, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.69% (0.8697 => 0.9105, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.08% (0.5191 => 0.5403, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 4.08% (0.9069 => 0.9439, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 4.01% (0.8007 => 0.8328, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.90% (0.8331 => 0.8656, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.89% (0.8656 => 0.8993, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 3.74% (0.8927 => 0.9261, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.24% (0.7932 => 0.8189, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.00% (0.8177 => 0.8422, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 138.19% (0.0199 => 0.0474, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/pi: 56.62% (1.5795 => 2.4738, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.93% (0.7597 => 0.8883, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.28% (2.9753 => 3.4597, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.70% (2.7995 => 3.2110, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.48% (5.0261 => 5.6031, std.dev.: 0.0319) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.77% (6.3772 => 6.9362, std.dev.: 0.1090) MultiSource/Applications/SIBsim4/SIBsim4: 8.69% (3.1873 => 3.4643, std.dev.: 0.0333) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.69% (1.1857 => 1.2769, std.dev.: 0.0182) SingleSource/Benchmarks/Misc/richards_benchmark: 6.62% (1.3037 => 1.3900, std.dev.: 0.0240) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.29% (4.7794 => 5.0799, std.dev.: 0.0226) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.05% (4.5327 => 4.8070, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.96% (4.9686 => 5.2648, std.dev.: 0.0283) MultiSource/Applications/lambda-0_1_3/lambda: 5.10% (7.4933 => 7.8758, std.dev.: 0.0204) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.79% (3.3761 => 3.5378, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.71% (6.2275 => 6.5208, std.dev.: 0.0092) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.68% (1.2337 => 1.2914, std.dev.: 0.0223) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.14% (4.9453 => 5.1498, std.dev.: 0.0292) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.11% (4.9469 => 5.1500, std.dev.: 0.0080) MultiSource/Applications/hexxagon/hexxagon: 4.01% (14.0064 => 14.5683, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.66% (11.5690 => 11.8764, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.33% (4.8660 => 4.9793, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.09% (0.5889 => 0.6012, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.81% (1.1365 => 1.1571, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: 1.38% (1.0841 => 1.0991, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.21% (3.5679 => 3.6112, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: 1.09% (7.5003 => 7.5820, std.dev.: 0.0187) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -41.90% (2.8951 => 1.6821, std.dev.: 0.0186) MultiSource/Benchmarks/Olden/em3d/em3d: -21.02% (5.4641 => 4.3154, std.dev.: 0.0803) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.90% (7.2130 => 6.3544, std.dev.: 0.0720) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.66% (1.0512 => 0.9391, std.dev.: 0.0128) MultiSource/Benchmarks/mafft/pairlocalalign: -8.42% (63.1822 => 57.8606, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.94% (4.7482 => 4.4189, std.dev.: 0.0240) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.42% (14.6451 => 13.7049, std.dev.: 0.0747) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.87% (5.4972 => 5.1747, std.dev.: 0.0441) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.83% (3.7148 => 3.4983, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.01% (5.1557 => 4.8974, std.dev.: 0.0222) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.18% (4.7449 => 4.5464, std.dev.: 0.0280) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.64% (6.0224 => 5.8032, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.56% (2.6356 => 2.5680, std.dev.: 0.0117) MultiSource/Applications/aha/aha: -2.42% (3.3398 => 3.2590, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (11.5316 => 11.2989, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.18% (5.6343 => 5.5678, std.dev.: 0.0171) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.15% (2.3487 => 2.3217, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 6.45% (1.0262 => 1.0924, std.dev.: 0.2799) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 80.49% (0.0123 => 0.0222, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.64% (0.0408 => 0.0431, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 32.28% (0.0254 => 0.0336, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.97% (0.0302 => 0.0317, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.46% (0.0384 => 0.0428, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 10.53% (0.0190 => 0.0210, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 22.22% (0.0180 => 0.0220, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 4.73% (0.1438 => 0.1506, std.dev.: 0.0244) MultiSource/Applications/lemon/lemon: 14.05% (1.1329 => 1.2921, std.dev.: 0.1661) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.56% (0.4164 => 0.4229, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.82% (0.1369 => 0.1435, std.dev.: 0.0258) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.87% (0.0641 => 0.0629, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 37.44% (0.0195 => 0.0268, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.98% (0.0578 => 0.0555, std.dev.: 0.0137) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.59% (1.1437 => 1.1962, std.dev.: 0.0481) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -21.43% (0.0014 => 0.0011, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.71% (0.0627 => 0.0644, std.dev.: 0.0186) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.97% (0.8017 => 0.7939, std.dev.: 0.0075) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 9.68% (0.0062 => 0.0068, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 13:26:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 15:26:13 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121127212613.945DA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6317?compare_to=6315&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6317, Order: 168719, Start Time: 2012-11-27 19:54:11, End Time: 2012-11-27 21:26:44 To: 6315, Order: 168705, Start Time: 2012-11-27 17:58:49, End Time: 2012-11-27 19:31:08 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (6 on baseline) Performance Improvements: 1 (184 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (852 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/oourafft: -3.05% (5.5700 => 5.4001, std.dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 14.01% (0.3834 => 0.4371, std.dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.24% (2.0478 => 2.1142, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/salsa20: 2.40% (7.4937 => 7.6733, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash2: 1.92% (3.1932 => 3.2546, std.dev.: 0.0078) MultiSource/Benchmarks/llubenchmark/llu: 1.70% (3.7435 => 3.8073, std.dev.: 0.0140) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.56% (0.3821 => 0.3532, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.23% (0.9542 => 0.8852, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.65% (0.3142 => 0.2933, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.55% (0.3357 => 0.3137, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -6.50% (2.4924 => 2.3305, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -6.44% (0.2160 => 0.2021, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.38% (0.2428 => 0.2273, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -6.08% (9.2283 => 8.6675, std.dev.: 0.0157) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.07% (0.1796 => 0.1687, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: -6.06% (0.3812 => 0.3581, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.06% (0.3880 => 0.3645, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.05% (0.6484 => 0.6092, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -6.02% (16.1920 => 15.2167, std.dev.: 0.0074) SingleSource/UnitTests/ObjC/exceptions-2: -6.00% (0.3831 => 0.3601, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -6.00% (0.3848 => 0.3617, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.99% (0.9852 => 0.9262, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.97% (0.3884 => 0.3652, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -5.96% (0.1879 => 0.1767, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.92% (0.5925 => 0.5574, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.91% (0.3891 => 0.3661, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.90% (0.3896 => 0.3666, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.90% (0.2355 => 0.2216, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.90% (0.4033 => 0.3795, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -5.87% (0.9179 => 0.8640, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.85% (0.5863 => 0.5520, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.82% (0.5478 => 0.5159, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -5.82% (0.4176 => 0.3933, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.81% (0.5591 => 0.5266, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: -5.78% (7.0961 => 6.6860, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.72% (0.6260 => 0.5902, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.71% (0.5705 => 0.5379, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.70% (0.5802 => 0.5471, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.70% (0.5857 => 0.5523, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.70% (0.5805 => 0.5474, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.69% (0.6304 => 0.5945, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.69% (1.3722 => 1.2941, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.69% (0.3658 => 0.3450, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.68% (0.5859 => 0.5526, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.67% (1.0544 => 0.9946, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.65% (0.6230 => 0.5878, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.64% (0.5849 => 0.5519, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -5.63% (1.1530 => 1.0881, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.62% (4.0323 => 3.8055, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.62% (0.6052 => 0.5712, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.62% (4.8161 => 4.5456, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.61% (0.5581 => 0.5268, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.61% (0.6297 => 0.5944, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.60% (0.5570 => 0.5258, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.59% (0.6194 => 0.5848, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.58% (0.6667 => 0.6295, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.55% (0.6446 => 0.6088, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.51% (0.6660 => 0.6293, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.50% (0.5941 => 0.5614, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.49% (1.2300 => 1.1625, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.48% (4.8802 => 4.6128, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.47% (0.5575 => 0.5270, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.47% (0.5688 => 0.5377, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.46% (3.5339 => 3.3408, std.dev.: 0.0069) MultiSource/Applications/lemon/lemon: -5.44% (1.1450 => 1.0827, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.43% (0.6681 => 0.6318, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.43% (0.7198 => 0.6807, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.43% (0.4199 => 0.3971, std.dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.42% (6.7716 => 6.4047, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.42% (0.7919 => 0.7490, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.41% (1.6364 => 1.5478, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.41% (1.4642 => 1.3850, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: -5.40% (1.3864 => 1.3115, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.39% (0.5456 => 0.5162, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.38% (0.6189 => 0.5856, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.37% (0.8521 => 0.8063, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.36% (0.6293 => 0.5956, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.35% (4.5069 => 4.2659, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.34% (0.2695 => 0.2551, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: -5.34% (0.4515 => 0.4274, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.30% (0.6033 => 0.5713, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.27% (0.6676 => 0.6324, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.27% (1.2784 => 1.2110, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/gs/gs: -5.27% (4.3330 => 4.1046, std.dev.: 0.0134) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.6736 => 0.6383, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/parameter-passing: -5.21% (0.4280 => 0.4057, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.20% (0.3406 => 0.3229, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.18% (14.2083 => 13.4722, std.dev.: 0.0142) MultiSource/Applications/sqlite3/sqlite3: -5.15% (17.1032 => 16.2223, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.14% (0.6440 => 0.6109, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.11% (1.2210 => 1.1586, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.11% (0.4916 => 0.4665, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.10% (0.2548 => 0.2418, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.05% (0.5999 => 0.5696, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.05% (8.0126 => 7.6080, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/08-main/main: -5.04% (0.2659 => 0.2525, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.03% (0.2385 => 0.2265, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.00% (0.2278 => 0.2164, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.00% (1.2221 => 1.1610, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.99% (0.6395 => 0.6076, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: -4.99% (1.2515 => 1.1891, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: -4.97% (15.5079 => 14.7370, std.dev.: 0.0139) MultiSource/Benchmarks/McCat/18-imp/imp: -4.91% (0.3581 => 0.3405, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.90% (0.2999 => 0.2852, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -4.90% (3.5154 => 3.3432, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -4.82% (0.2985 => 0.2841, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.81% (0.3931 => 0.3742, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.79% (0.3483 => 0.3316, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.77% (0.4151 => 0.3953, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.74% (0.5168 => 0.4923, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -4.70% (0.3255 => 0.3102, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.67% (0.5569 => 0.5309, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.67% (0.3837 => 0.3658, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.65% (15.2527 => 14.5441, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: -4.64% (1.3148 => 1.2538, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/objinst: -4.63% (0.3194 => 0.3046, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.60% (0.7524 => 0.7178, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -4.60% (0.2871 => 0.2739, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -4.60% (0.3025 => 0.2886, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.59% (0.4813 => 0.4592, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.58% (0.5567 => 0.5312, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.58% (0.3016 => 0.2878, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.55% (0.6395 => 0.6104, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.54% (0.3323 => 0.3172, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.52% (0.3252 => 0.3105, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.51% (0.3057 => 0.2919, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.51% (0.2903 => 0.2772, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -4.50% (5.0226 => 4.7965, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: -4.49% (0.7447 => 0.7113, std.dev.: 0.0011) MultiSource/Applications/lua/lua: -4.48% (4.0594 => 3.8774, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.47% (2.1713 => 2.0742, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.47% (0.5329 => 0.5091, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -4.45% (0.4248 => 0.4059, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.43% (22.4056 => 21.4141, std.dev.: 0.0134) SingleSource/Regression/C++/ofstream_ctor: -4.41% (0.3059 => 0.2924, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.40% (0.7021 => 0.6712, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -4.39% (0.2939 => 0.2810, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.39% (1.6474 => 1.5751, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.34% (0.3849 => 0.3682, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.30% (0.2933 => 0.2807, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.29% (0.9557 => 0.9147, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.28% (0.4321 => 0.4136, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: -4.28% (0.4861 => 0.4653, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -4.26% (0.3026 => 0.2897, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.25% (0.6347 => 0.6077, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.25% (0.3271 => 0.3132, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: -4.23% (2.1401 => 2.0495, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: -4.22% (0.3481 => 0.3334, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.22% (0.3319 => 0.3179, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -4.17% (34.0927 => 32.6710, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/lists1: -4.16% (0.3867 => 0.3706, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: -4.14% (0.2849 => 0.2731, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -4.10% (0.6441 => 0.6177, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -4.09% (0.3205 => 0.3074, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -4.08% (2.4021 => 2.3040, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -4.07% (0.3394 => 0.3256, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -4.06% (0.3446 => 0.3306, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.04% (0.4083 => 0.3918, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: -4.02% (0.4524 => 0.4342, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.02% (0.4427 => 0.4249, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: -3.95% (18.2933 => 17.5711, std.dev.: 0.0193) MultiSource/Applications/lambda-0_1_3/lambda: -3.93% (0.7982 => 0.7668, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.92% (0.9077 => 0.8721, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -3.88% (0.2989 => 0.2873, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -3.87% (0.7779 => 0.7478, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.83% (2.2587 => 2.1721, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/sieve: -3.80% (0.3788 => 0.3644, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -3.79% (0.6750 => 0.6494, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -3.79% (0.8418 => 0.8099, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.72% (0.3491 => 0.3361, std.dev.: 0.0041) MultiSource/Applications/hbd/hbd: -3.40% (1.5610 => 1.5079, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.11% (5.4682 => 5.2980, std.dev.: 0.0103) SingleSource/UnitTests/Vector/constpool: -2.69% (20.7746 => 20.2156, std.dev.: 0.0217) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1963, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: -62.44% (1.8100 => 0.6798, std.dev.: 0.0109) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7566, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1733, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.76% (2.2633 => 2.1782, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.41% (1.3096 => 1.2649, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4001, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.18% (1.0557 => 1.0221, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.72% (6.5735 => 6.4606, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 14:12:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 16:12:04 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121127221204.97BF22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6318?compare_to=6314&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6318, Order: 168716, Start Time: 2012-11-27 19:54:20, End Time: 2012-11-27 22:12:34 To: 6314, Order: 168702, Start Time: 2012-11-27 16:42:14, End Time: 2012-11-27 19:01:21 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 89 (204 on baseline) Performance Improvements: 18 (44 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 979 (637 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 15.92% (0.6684 => 0.7748, std.dev.: 0.0060) MultiSource/Applications/siod/siod: 14.79% (2.6006 => 2.9851, std.dev.: 0.0223) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.77% (0.6305 => 0.7236, std.dev.: 0.0228) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 14.60% (0.6218 => 0.7126, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 14.58% (2.4985 => 2.8628, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 14.33% (6.1067 => 6.9815, std.dev.: 0.0530) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.30% (0.7190 => 0.8218, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.28% (0.6721 => 0.7681, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 14.26% (0.7200 => 0.8227, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.11% (0.6596 => 0.7527, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 14.01% (0.5780 => 0.6590, std.dev.: 0.0251) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 13.49% (0.5907 => 0.6704, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 13.13% (0.7198 => 0.8143, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 12.95% (0.6581 => 0.7433, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.50% (4.3881 => 4.9364, std.dev.: 0.0337) SingleSource/Benchmarks/Misc-C++/Large/ray: 12.31% (0.4469 => 0.5019, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.24% (0.5636 => 0.6326, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 12.13% (0.5895 => 0.6610, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 12.03% (0.6869 => 0.7695, std.dev.: 0.0109) MultiSource/Applications/minisat/minisat: 11.79% (0.8187 => 0.9152, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 11.51% (0.5169 => 0.5764, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 11.51% (0.3050 => 0.3401, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/heapsort: 11.36% (0.3134 => 0.3490, std.dev.: 0.0073) MultiSource/Benchmarks/sim/sim: 11.35% (0.3728 => 0.4151, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/moments: 11.02% (0.4501 => 0.4997, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.90% (0.3045 => 0.3377, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: 10.38% (0.2880 => 0.3179, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 10.33% (0.3534 => 0.3899, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 10.33% (0.2963 => 0.3269, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.25% (0.1903 => 0.2098, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/objinst: 10.17% (0.3354 => 0.3695, std.dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.01% (0.3597 => 0.3957, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.71% (0.2090 => 0.2293, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 9.46% (0.1491 => 0.1632, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.29% (0.6611 => 0.7225, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.91% (0.6657 => 0.7250, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/hash: 8.78% (0.4816 => 0.5239, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.77% (0.2681 => 0.2916, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.72% (0.5893 => 0.6407, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.72% (0.6884 => 0.7484, std.dev.: 0.0181) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.68% (4.7887 => 5.2045, std.dev.: 0.0839) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.51% (1.1106 => 1.2051, std.dev.: 0.0149) MultiSource/Applications/lemon/lemon: 8.07% (1.2035 => 1.3006, std.dev.: 0.0216) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.71% (0.2206 => 0.2376, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.45% (4.6936 => 5.0435, std.dev.: 0.0126) MultiSource/Benchmarks/Olden/bh/bh: 7.13% (0.3339 => 0.3577, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.43% (10.7160 => 11.4051, std.dev.: 0.1203) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.33% (0.1675 => 0.1781, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.24% (0.3220 => 0.3421, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 5.67% (19.2222 => 20.3114, std.dev.: 0.2630) MultiSource/Benchmarks/McCat/18-imp/imp: 5.66% (0.3890 => 0.4110, std.dev.: 0.0073) MultiSource/Applications/d/make_dparser: 5.44% (3.9591 => 4.1743, std.dev.: 0.0242) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.84% (2.3471 => 2.4606, std.dev.: 0.0220) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.73% (8.0825 => 8.4651, std.dev.: 0.1105) MultiSource/Benchmarks/McCat/08-main/main: 3.81% (0.3384 => 0.3513, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 3.69% (0.2707 => 0.2807, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.56% (4.6933 => 4.8604, std.dev.: 0.0599) MultiSource/Applications/SIBsim4/SIBsim4: 3.48% (1.6053 => 1.6612, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.23% (12.2205 => 12.6152, std.dev.: 0.0819) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: 29.25% (0.1641 => 0.2121, std.dev.: 0.0113) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.39% (0.3607 => 0.4631, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/ary3: 23.15% (3.7563 => 4.6258, std.dev.: 0.2250) MultiSource/Applications/JM/ldecod/ldecod: 21.76% (0.1213 => 0.1477, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 20.93% (3.8018 => 4.5977, std.dev.: 0.0156) SingleSource/Benchmarks/CoyoteBench/lpbench: 18.06% (10.8608 => 12.8228, std.dev.: 0.1264) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.91% (1.7410 => 1.9310, std.dev.: 0.0524) MultiSource/Benchmarks/Olden/health/health: 9.87% (0.4621 => 0.5077, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.56% (3.9432 => 4.3201, std.dev.: 0.0837) MultiSource/Applications/JM/lencod/lencod: 9.20% (7.6082 => 8.3081, std.dev.: 0.0126) MultiSource/Benchmarks/Olden/tsp/tsp: 8.99% (1.1040 => 1.2032, std.dev.: 0.0278) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.87% (8.4307 => 9.1785, std.dev.: 0.2863) SingleSource/Benchmarks/Shootout-C++/hash2: 8.34% (3.3692 => 3.6503, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/bisort/bisort: 8.21% (0.8652 => 0.9362, std.dev.: 0.0221) SingleSource/Benchmarks/Misc/ffbench: 7.28% (0.9935 => 1.0658, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.26% (8.9296 => 9.5775, std.dev.: 0.1833) MultiSource/Applications/siod/siod: 6.10% (3.1730 => 3.3666, std.dev.: 0.0298) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 4.63% (3.1888 => 3.3366, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 4.24% (6.2837 => 6.5503, std.dev.: 0.0231) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.68% (3.7204 => 3.8572, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.08% (4.3281 => 4.4613, std.dev.: 0.0109) SingleSource/Benchmarks/CoyoteBench/huffbench: 2.67% (18.7990 => 19.3006, std.dev.: 0.0643) MultiSource/Benchmarks/Olden/bh/bh: 2.50% (1.9572 => 2.0061, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.84% (4.8098 => 4.8984, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.68% (2.8224 => 2.8697, std.dev.: 0.0046) MultiSource/Applications/sgefa/sgefa: 1.61% (0.6257 => 0.6358, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.35% (6.0457 => 6.1275, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.34% (48.7337 => 49.3891, std.dev.: 0.2503) MultiSource/Applications/lua/lua: 1.28% (27.3530 => 27.7032, std.dev.: 0.0770) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.13% (5.6757 => 5.7400, std.dev.: 0.0174) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/McGill/chomp: -7.83% (0.2043 => 0.1883, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary: -7.07% (0.3804 => 0.3535, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.96% (0.3232 => 0.3007, std.dev.: 0.0027) MultiSource/Applications/hbd/hbd: -6.65% (1.8528 => 1.7296, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: -6.61% (0.3843 => 0.3589, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/matrix: -6.58% (0.3615 => 0.3377, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.55% (1.6149 => 1.5091, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout-C++/ary2: -6.55% (0.3956 => 0.3697, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -6.53% (0.4352 => 0.4068, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.30% (0.7637 => 0.7156, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.94% (0.4767 => 0.4484, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.82% (5.8596 => 5.5186, std.dev.: 0.0944) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.54% (0.7151 => 0.6826, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.25% (21.2363 => 20.3331, std.dev.: 0.1768) MultiSource/Applications/kimwitu++/kc: -1.86% (21.2615 => 20.8658, std.dev.: 0.1411) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/ObjC/synchronized: -48.51% (0.3350 => 0.1725, std.dev.: 0.0283) SingleSource/Benchmarks/McGill/chomp: -3.79% (1.2649 => 1.2169, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout/heapsort: -2.80% (4.0382 => 3.9252, std.dev.: 0.0168) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.73% (69.9371 => 69.4246, std.dev.: 0.2803) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1338 => 0.1338) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0419 => 0.0420, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.40% (0.0668 => 0.0652, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 0.01% (493.9715 => 494.0110, std.dev.: 0.1821) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.77% (63.2438 => 69.4246, std.dev.: 0.2803) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43706.95% (1.1277 => 494.0110, std.dev.: 0.1821) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 217.69% (0.5229 => 1.6612, std.dev.: 0.0086) MultiSource/Applications/SPASS/SPASS: 20.20% (14.9895 => 18.0170, std.dev.: 0.2364) MultiSource/Applications/kimwitu++/kc: 47.41% (14.1553 => 20.8658, std.dev.: 0.1411) MultiSource/Benchmarks/MallocBench/gs/gs: 16.94% (4.1105 => 4.8068, std.dev.: 0.1817) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.59% (1.1048 => 1.5091, std.dev.: 0.0184) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 431.36% (7.1582 => 38.0357, std.dev.: 0.2550) SingleSource/Benchmarks/Misc-C++-EH/spirit: 101.61% (3.4629 => 6.9815, std.dev.: 0.0530) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.51% (0.6222 => 1.0298, std.dev.: 0.0008) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11439.03% (0.0720 => 8.3081, std.dev.: 0.0126) MultiSource/Applications/SIBsim4/SIBsim4: 3864900.00% (0.0001 => 3.8650, std.dev.: 0.0060) MultiSource/Applications/SPASS/SPASS: 14819200.00% (0.0001 => 14.8193, std.dev.: 1.0061) MultiSource/Applications/kimwitu++/kc: 53700.00% (0.0001 => 0.0538, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 64900.00% (0.0001 => 0.0650, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575800.00% (0.0001 => 0.5759, std.dev.: 0.0196) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10085300.00% (0.0001 => 10.0854, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5676900.00% (0.0001 => 5.6770, std.dev.: 0.3749) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1716.43% (1.1194 => 20.3331, std.dev.: 0.1768) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 77.12% (2.9384 => 5.2045, std.dev.: 0.0839) MultiSource/Applications/ClamAV/clamscan: 66.82% (22.1758 => 36.9931, std.dev.: 0.1150) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 61.68% (7.0540 => 11.4051, std.dev.: 0.1203) MultiSource/Benchmarks/FreeBench/distray/distray: 57.20% (0.1056 => 0.1660, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 55.05% (8.1363 => 12.6152, std.dev.: 0.0819) MultiSource/Applications/JM/lencod/lencod: 46.94% (21.9371 => 32.2342, std.dev.: 0.1141) SingleSource/Benchmarks/CoyoteBench/almabench: 43.97% (0.0730 => 0.1051, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: 37.55% (0.2554 => 0.3513, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 36.66% (0.1432 => 0.1957, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 33.97% (0.1566 => 0.2098, std.dev.: 0.0061) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 33.90% (0.1584 => 0.2121, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 33.67% (0.0793 => 0.1060, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/17-bintr/bintr: 30.67% (0.0675 => 0.0882, std.dev.: 0.0007) SingleSource/UnitTests/vla: 30.14% (0.0355 => 0.0462, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 29.99% (2.2024 => 2.8628, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 29.96% (2.2969 => 2.9851, std.dev.: 0.0223) MultiSource/Benchmarks/BitBench/five11/five11: 29.81% (0.0567 => 0.0736, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 29.02% (0.1175 => 0.1516, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 28.63% (0.7115 => 0.9152, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.83% (3.8922 => 4.9364, std.dev.: 0.0337) MultiSource/Benchmarks/SciMark2-C/scimark2: 26.79% (0.3121 => 0.3957, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/15-trie/trie: 26.76% (0.0527 => 0.0668, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 26.70% (0.2700 => 0.3421, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 26.47% (0.0442 => 0.0559, std.dev.: 0.0018) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 26.12% (0.0467 => 0.0589, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 26.02% (0.5020 => 0.6326, std.dev.: 0.0064) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 25.95% (0.0447 => 0.0563, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 25.77% (0.0842 => 0.1059, std.dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 25.66% (0.1555 => 0.1954, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.62% (0.0648 => 0.0814, std.dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 25.41% (0.3109 => 0.3899, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 25.15% (3.3354 => 4.1743, std.dev.: 0.0242) SingleSource/Benchmarks/Shootout-C++/hash2: 24.76% (0.4620 => 0.5764, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 24.67% (0.1062 => 0.1324, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 24.64% (0.0491 => 0.0612, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.53% (0.1125 => 0.1401, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 24.38% (0.0443 => 0.0551, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 24.33% (0.0929 => 0.1155, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.86% (0.0746 => 0.0924, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.83% (0.2107 => 0.2609, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 23.78% (1.5859 => 1.9630, std.dev.: 0.0451) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 23.70% (0.0886 => 0.1096, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.60% (0.2271 => 0.2807, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/messages-2: 23.56% (0.0662 => 0.0818, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: 23.50% (0.4064 => 0.5019, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bisort/bisort: 23.45% (0.0614 => 0.0758, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: 23.44% (0.4048 => 0.4997, std.dev.: 0.0135) SingleSource/Benchmarks/Stanford/Oscar: 23.43% (0.0636 => 0.0785, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 23.41% (0.9765 => 1.2051, std.dev.: 0.0149) MultiSource/Benchmarks/BitBench/drop3/drop3: 23.24% (0.0482 => 0.0594, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 22.67% (0.0953 => 0.1169, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 22.56% (0.3387 => 0.4151, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash: 22.15% (0.4289 => 0.5239, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/whetstone: 21.97% (0.0660 => 0.0805, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 21.85% (0.1268 => 0.1545, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 21.82% (0.2603 => 0.3171, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.77% (0.1029 => 0.1253, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 21.60% (0.0838 => 0.1019, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/heapsort: 21.52% (0.2872 => 0.3490, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/random: 21.38% (0.2802 => 0.3401, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 21.30% (1.0722 => 1.3006, std.dev.: 0.0216) MultiSource/Applications/spiff/spiff: 21.20% (0.7835 => 0.9496, std.dev.: 0.0167) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 21.19% (0.1892 => 0.2293, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 21.12% (0.1463 => 0.1772, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 21.10% (0.0834 => 0.1010, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: 20.91% (0.2793 => 0.3377, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.52% (0.0770 => 0.0928, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 20.45% (0.2714 => 0.3269, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fbench: 20.10% (0.0592 => 0.0711, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: 20.07% (0.3423 => 0.4110, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/reversefile: 20.05% (0.3865 => 0.4640, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 20.00% (0.2430 => 0.2916, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 19.78% (0.3180 => 0.3809, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/sieve: 18.93% (0.3603 => 0.4285, std.dev.: 0.0090) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.61% (0.0704 => 0.0835, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 18.49% (0.4636 => 0.5493, std.dev.: 0.0128) MultiSource/Applications/sqlite3/sqlite3: 18.22% (17.1811 => 20.3114, std.dev.: 0.2630) SingleSource/Benchmarks/Shootout-C++/objinst: 18.01% (0.3131 => 0.3695, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/parameter-passing: 17.62% (0.3927 => 0.4619, std.dev.: 0.0122) MultiSource/Benchmarks/McCat/05-eks/eks: 17.21% (0.4299 => 0.5039, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.08% (14.3668 => 16.8203, std.dev.: 0.2970) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.97% (0.8101 => 0.9476, std.dev.: 0.0186) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.76% (0.0871 => 0.1017, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.60% (0.3543 => 0.4131, std.dev.: 0.0110) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.57% (0.8172 => 0.9526, std.dev.: 0.0134) SingleSource/UnitTests/ObjC/trivial-interface: 16.56% (0.3473 => 0.4048, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.55% (0.4615 => 0.5379, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 16.52% (0.0672 => 0.0783, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists: 16.34% (0.3422 => 0.3981, std.dev.: 0.0138) SingleSource/UnitTests/ObjC/property: 16.16% (0.3886 => 0.4514, std.dev.: 0.0239) SingleSource/UnitTests/ObjC/synchronized: 16.09% (0.3561 => 0.4134, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/mst/mst: 16.08% (0.1163 => 0.1350, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 15.93% (0.1695 => 0.1965, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/matrix: 15.77% (0.0818 => 0.0947, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/bh/bh: 15.69% (0.3092 => 0.3577, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.64% (0.2065 => 0.2388, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/for-in: 15.59% (0.3694 => 0.4270, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.19% (0.0770 => 0.0887, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.13% (0.1117 => 0.1286, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 14.94% (1.3050 => 1.5000, std.dev.: 0.0321) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.90% (0.1940 => 0.2229, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 14.89% (0.0705 => 0.0810, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 14.78% (0.7326 => 0.8409, std.dev.: 0.0156) SingleSource/UnitTests/ObjC++/property-reference-object: 14.63% (0.6030 => 0.6912, std.dev.: 0.0124) MultiSource/Applications/lambda-0_1_3/lambda: 14.60% (0.7433 => 0.8518, std.dev.: 0.0367) MultiSource/Benchmarks/mafft/pairlocalalign: 14.49% (9.4845 => 10.8592, std.dev.: 0.1218) MultiSource/Benchmarks/NPB-serial/is/is: 14.46% (0.0719 => 0.0823, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 14.25% (0.0814 => 0.0930, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.15% (0.3307 => 0.3775, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.13% (0.5981 => 0.6826, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 14.06% (0.5925 => 0.6758, std.dev.: 0.0221) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.00% (0.1236 => 0.1409, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.95% (0.1032 => 0.1176, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.95% (0.3935 => 0.4484, std.dev.: 0.0085) SingleSource/Benchmarks/McGill/chomp: 13.78% (0.1655 => 0.1883, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.74% (0.5569 => 0.6334, std.dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.71% (0.5105 => 0.5805, std.dev.: 0.0224) MultiSource/Applications/lua/lua: 13.52% (3.8723 => 4.3957, std.dev.: 0.0594) MultiSource/Applications/oggenc/oggenc: 13.47% (5.7591 => 6.5347, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.33% (0.6675 => 0.7565, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.16% (0.3441 => 0.3894, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.11% (0.1510 => 0.1708, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.78% (4.2646 => 4.8096, std.dev.: 0.0647) SingleSource/Benchmarks/Misc-C++/bigfib: 12.64% (0.6456 => 0.7272, std.dev.: 0.0254) MultiSource/Applications/treecc/treecc: 12.50% (2.0273 => 2.2808, std.dev.: 0.0769) SingleSource/UnitTests/ObjC/exceptions: 11.94% (0.3828 => 0.4285, std.dev.: 0.0160) SingleSource/UnitTests/ObjC/exceptions-4: 11.83% (0.3543 => 0.3962, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.82% (0.4203 => 0.4700, std.dev.: 0.0138) SingleSource/UnitTests/ObjC/exceptions-3: 11.75% (0.3516 => 0.3929, std.dev.: 0.0142) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.73% (2.2022 => 2.4606, std.dev.: 0.0220) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.60% (4.9449 => 5.5186, std.dev.: 0.0944) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.36% (5.0018 => 5.5700, std.dev.: 0.0705) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.23% (0.1906 => 0.2120, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.95% (0.6450 => 0.7156, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 10.85% (1.5603 => 1.7296, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 10.73% (0.1268 => 0.1404, std.dev.: 0.0040) MultiSource/Benchmarks/PAQ8p/paq8p: 10.69% (10.3673 => 11.4754, std.dev.: 0.3361) MultiSource/Benchmarks/Ptrdist/bc/bc: 10.55% (1.1861 => 1.3112, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 10.51% (0.8921 => 0.9859, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists1: 10.42% (0.3684 => 0.4068, std.dev.: 0.0007) SingleSource/UnitTests/SignlessTypes/rem: 10.40% (0.1144 => 0.1263, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.96% (1.4186 => 1.5599, std.dev.: 0.0221) SingleSource/Benchmarks/Shootout-C++/strcat: 9.71% (0.2831 => 0.3106, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.51% (0.2891 => 0.3166, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/ary2: 9.41% (0.3379 => 0.3697, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.37% (0.3232 => 0.3535, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 9.35% (0.3282 => 0.3589, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.11% (0.2756 => 0.3007, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: 9.01% (0.3098 => 0.3377, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.55% (0.1438 => 0.1561, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.20% (0.3136 => 0.3393, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.65% (0.3427 => 0.3689, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.32% (7.9617 => 8.4651, std.dev.: 0.1105) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.72% (0.3177 => 0.3327, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.59% (4.3953 => 11.0144, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/methcall: 147.74% (5.3999 => 13.3775, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/17-bintr/bintr: 103.36% (0.1043 => 0.2121, std.dev.: 0.0113) MultiSource/Benchmarks/llubenchmark/llu: 77.03% (3.7781 => 6.6884, std.dev.: 1.0620) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 42.23% (0.3256 => 0.4631, std.dev.: 0.0041) MultiSource/Applications/minisat/minisat: 26.51% (9.1159 => 11.5321, std.dev.: 0.3079) MultiSource/Benchmarks/McCat/09-vor/vor: 25.39% (0.1154 => 0.1447, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout/ary3: 25.04% (3.6994 => 4.6258, std.dev.: 0.2250) SingleSource/Benchmarks/CoyoteBench/lpbench: 23.94% (10.3460 => 12.8228, std.dev.: 0.1264) SingleSource/Benchmarks/Misc/oourafft: 17.45% (6.6465 => 7.8062, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.63% (1.1145 => 1.2998, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: 15.60% (3.1578 => 3.6503, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/health/health: 14.22% (0.4445 => 0.5077, std.dev.: 0.0083) MultiSource/Applications/JM/ldecod/ldecod: 13.79% (0.1298 => 0.1477, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.25% (0.2944 => 0.3334, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bisort/bisort: 12.35% (0.8333 => 0.9362, std.dev.: 0.0221) SingleSource/Benchmarks/Misc/ffbench: 12.13% (0.9505 => 1.0658, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/heapsort: 12.12% (3.8532 => 4.3201, std.dev.: 0.0837) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.63% (2.8904 => 3.2266, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 11.56% (1.0785 => 1.2032, std.dev.: 0.0278) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.34% (8.6802 => 9.5775, std.dev.: 0.1833) SingleSource/Benchmarks/Misc/richards_benchmark: 10.28% (1.1396 => 1.2567, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.45% (1.7254 => 1.8885, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash: 8.60% (0.7455 => 0.8096, std.dev.: 0.0206) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.25% (13.4384 => 14.5465, std.dev.: 0.3829) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.48% (3.1334 => 3.3366, std.dev.: 0.0037) MultiSource/Applications/lua/lua: 6.17% (26.0924 => 27.7032, std.dev.: 0.0770) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.02% (4.2280 => 4.4826, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.99% (0.9540 => 1.0111, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.98% (3.6395 => 3.8572, std.dev.: 0.0122) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.6436 => 12.1317, std.dev.: 0.0105) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 3.38% (1.9405 => 2.0061, std.dev.: 0.0164) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.61% (1.2838 => 1.3173, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 2.56% (3.2827 => 3.3666, std.dev.: 0.0298) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.31% (1.3045 => 1.3346, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.26% (1.7133 => 1.7520, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 2.17% (0.6223 => 0.6358, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970) MultiSource/Applications/aha/aha: 2.08% (3.1595 => 3.2251, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 1.96% (85.0658 => 86.7338, std.dev.: 0.0924) SingleSource/Benchmarks/Shootout/heapsort: 1.88% (3.8526 => 3.9252, std.dev.: 0.0168) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.87% (2.1424 => 2.1824, std.dev.: 0.0063) MultiSource/Benchmarks/mafft/pairlocalalign: 1.62% (27.8444 => 28.2956, std.dev.: 0.0291) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.53% (6.5088 => 6.6086, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0501, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.34% (6.6874 => 0.1781, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.34% (5.2763 => 1.2486, std.dev.: 0.0404) SingleSource/Benchmarks/Misc/salsa20: -74.32% (0.8651 => 0.2222, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: -44.76% (0.1622 => 0.0896, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -9.90% (1.7609 => 1.5866, std.dev.: 0.0444) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -9.75% (5.3855 => 4.8604, std.dev.: 0.0599) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.77% (5.3526 => 5.0435, std.dev.: 0.0126) MultiSource/Applications/JM/ldecod/ldecod: -5.08% (10.4361 => 9.9055, std.dev.: 0.1517) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -68.48% (32.5116 => 10.2491, std.dev.: 0.0110) SingleSource/Benchmarks/Dhrystone/fldry: -65.93% (1.9577 => 0.6669, std.dev.: 0.0172) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1681, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.20% (0.0628 => 0.0363, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.13% (0.3987 => 0.2387, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.34% (4.5009 => 2.7754, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: -33.54% (1.1492 => 0.7638, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.15% (2.6546 => 2.0134, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -19.20% (0.2161 => 0.1746, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.55% (1.6925 => 1.4294, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.69% (2.6778 => 2.2845, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -10.64% (1.5373 => 1.3738, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.76% (1.5660 => 1.4288, std.dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: -8.41% (9.5636 => 8.7596, std.dev.: 0.1166) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.35% (3.2416 => 3.0359, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.14% (0.8614 => 0.8171, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: -4.97% (1.5835 => 1.5048, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.81% (0.2497 => 0.2377, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.33% (1.6805 => 1.6078, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/lists: -4.22% (6.2999 => 6.0342, std.dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.25% (19.9488 => 19.3006, std.dev.: 0.0643) MultiSource/Benchmarks/sim/sim: -2.95% (5.0483 => 4.8992, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.66% (0.4808 => 0.4680, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.24% (0.9957 => 0.9734, std.dev.: 0.0064) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.60% (8.1563 => 8.0261, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/salsa20: -1.48% (10.2830 => 10.1313, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0000) Report Time: 3.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 14:42:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 16:42:11 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121127224212.005612A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6319?compare_to=6316&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6319, Order: 168722, Start Time: 2012-11-27 21:06:29, End Time: 2012-11-27 22:42:44 To: 6316, Order: 168712, Start Time: 2012-11-27 19:13:25, End Time: 2012-11-27 20:48:56 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (30 on baseline) Performance Regressions: 19 (69 on baseline) Performance Improvements: 7 (18 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 39 (38 on baseline) Unchanged Tests: 1027 (886 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2005-11-29-LongSwitch: 151.49% (0.0101 => 0.0254, std.dev.: 0.0011) SingleSource/UnitTests/2002-08-02-CastTest: 89.21% (0.0139 => 0.0263, std.dev.: 0.0003) SingleSource/UnitTests/2008-07-13-InlineSetjmp: 78.00% (0.0150 => 0.0267, std.dev.: 0.0018) SingleSource/UnitTests/2003-05-14-AtExit: 75.26% (0.0190 => 0.0333, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: 71.43% (0.0168 => 0.0288, std.dev.: 0.0022) SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 66.01% (0.0153 => 0.0254, std.dev.: 0.0021) SingleSource/Regression/C++/global_ctor: 50.96% (0.0208 => 0.0314, std.dev.: 0.0030) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 44.81% (0.0241 => 0.0349, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.09% (0.1855 => 0.1968, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 5.90% (0.9307 => 0.9856, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.63% (2.2742 => 2.4023, std.dev.: 0.0167) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 28.35% (3.3561 => 4.3074, std.dev.: 0.3370) SingleSource/Benchmarks/Shootout-C++/heapsort: 27.68% (3.5091 => 4.4804, std.dev.: 0.2384) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.38% (4.0098 => 4.5062, std.dev.: 0.1468) SingleSource/Benchmarks/Linpack/linpack-pc: 3.47% (51.3711 => 53.1527, std.dev.: 0.0365) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.42% (2.4001 => 2.4341, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.37% (8.3892 => 8.5045, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/pi: 1.22% (2.4738 => 2.5039, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.05% (5.8185 => 5.8798, std.dev.: 0.0117) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/football/football: -2.99% (0.9253 => 0.8976, std.dev.: 0.0089) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel24: -51.80% (0.4699 => 0.2265, std.dev.: 0.0855) MultiSource/Benchmarks/nbench/nbench: -6.28% (21.9347 => 20.5572, std.dev.: 0.2797) MultiSource/Applications/SIBsim4/SIBsim4: -5.32% (3.4643 => 3.2799, std.dev.: 0.0430) SingleSource/Benchmarks/Misc/ffbench: -2.68% (1.4577 => 1.4186, std.dev.: 0.0071) MultiSource/Benchmarks/BitBench/five11/five11: -1.52% (5.7356 => 5.6485, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/matrix: -1.33% (2.9194 => 2.8807, std.dev.: 0.0075) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -2.30% (1.0924 => 1.0673, std.dev.: 0.2988) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.45% (0.0222 => 0.0221, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0431 => 0.0430, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.60% (0.0336 => 0.0338, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0317 => 0.0318, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0428 => 0.0430, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: -1.43% (0.0210 => 0.0207, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 0.91% (0.0220 => 0.0222, std.dev.: 0.0074) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -3.85% (0.1506 => 0.1448, std.dev.: 0.0075) MultiSource/Applications/lemon/lemon: -10.37% (1.2921 => 1.1581, std.dev.: 0.4259) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.89% (0.4229 => 0.4149, std.dev.: 0.1390) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.67% (0.1435 => 0.1459, std.dev.: 0.0250) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.50% (0.0629 => 0.0651, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.36% (0.0268 => 0.0277, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.55% (0.0555 => 0.0608, std.dev.: 0.0160) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.16% (1.1962 => 1.1943, std.dev.: 0.0419) MultiSource/Benchmarks/SciMark2-C/scimark2: -0.09% (9.4535 => 9.4452, std.dev.: 0.0182) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 63.64% (0.0011 => 0.0018, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 25.93% (0.0644 => 0.0811, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.37% (0.0267 => 0.0266, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.15% (0.7939 => 0.7848, std.dev.: 0.0054) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0007 => 0.0007, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: 100.00% (0.0001 => 0.0002, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: 800.00% (0.0001 => 0.0009, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 41.18% (0.0068 => 0.0096, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/SciMark2-C/scimark2: -66.95% (28.5821 => 9.4452, std.dev.: 0.0182) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 7.56% (16.4461 => 17.6900, std.dev.: 0.8975) MultiSource/Applications/sqlite3/sqlite3: 2319.41% (0.6332 => 15.3197, std.dev.: 0.6288) MultiSource/Benchmarks/McCat/08-main/main: 59.09% (0.1831 => 0.2913, std.dev.: 0.0238) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.43% (0.1559 => 0.1490, std.dev.: 0.0332) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7387.29% (0.3123 => 23.3828, std.dev.: 0.6308) SingleSource/Benchmarks/CoyoteBench/fftbench: 52.70% (0.2463 => 0.3761, std.dev.: 0.1071) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1573.06% (0.3344 => 5.5947, std.dev.: 0.2570) SingleSource/Benchmarks/Misc-C++/Large/ray: 42.05% (0.2364 => 0.3358, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/bigfib: 5.37% (0.6010 => 0.6333, std.dev.: 0.0154) SingleSource/Benchmarks/Misc/mandel: 3.73% (0.0429 => 0.0445, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.42% (0.3266 => 0.3541, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/strcat: 6.25% (0.1969 => 0.2092, std.dev.: 0.0047) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 55.80% (0.0224 => 0.0349, std.dev.: 0.0036) SingleSource/UnitTests/byval-alignment: 25.22% (0.0230 => 0.0288, std.dev.: 0.0022) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0527, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 12.45% (0.1462 => 0.1644, std.dev.: 0.0320) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3900, std.dev.: 0.0899) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0734, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4965, std.dev.: 0.0763) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5125, std.dev.: 0.0246) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5689, std.dev.: 0.3632) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3229, std.dev.: 0.0412) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1532, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3653, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4009, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0818, std.dev.: 0.0032) SingleSource/Regression/C/uint64_to_float: -23.59% (2.1832 => 1.6681, std.dev.: 0.0537) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-08-02-CastTest: 112.10% (0.0124 => 0.0263, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-14-AtExit: 91.38% (0.0174 => 0.0333, std.dev.: 0.0007) SingleSource/UnitTests/2005-11-29-LongSwitch: 90.98% (0.0133 => 0.0254, std.dev.: 0.0011) SingleSource/UnitTests/2006-12-01-float_varg: 85.83% (0.0127 => 0.0236, std.dev.: 0.0004) SingleSource/UnitTests/2008-07-13-InlineSetjmp: 85.42% (0.0144 => 0.0267, std.dev.: 0.0018) SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 82.73% (0.0139 => 0.0254, std.dev.: 0.0021) SingleSource/UnitTests/2003-09-18-BitFieldTest: 78.63% (0.0131 => 0.0234, std.dev.: 0.0010) SingleSource/Regression/C++/EH/simple_throw: 76.64% (0.0137 => 0.0242, std.dev.: 0.0022) SingleSource/UnitTests/2003-07-10-SignConversions: 73.94% (0.0142 => 0.0247, std.dev.: 0.0015) SingleSource/UnitTests/2007-03-02-VaCopy: 73.72% (0.0137 => 0.0238, std.dev.: 0.0012) SingleSource/Regression/C++/2011-03-28-Bitfield: 71.33% (0.0150 => 0.0257, std.dev.: 0.0022) SingleSource/Regression/C++/global_ctor: 69.73% (0.0185 => 0.0314, std.dev.: 0.0030) SingleSource/UnitTests/2003-05-26-Shorts: 67.78% (0.0180 => 0.0302, std.dev.: 0.0024) SingleSource/UnitTests/2006-02-04-DivRem: 66.67% (0.0153 => 0.0255, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 12.25% (2.1401 => 2.4023, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 11.93% (0.8855 => 0.9911, std.dev.: 0.0295) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.69% (0.1778 => 0.1968, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.95% (0.8697 => 0.9562, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.62% (0.9074 => 0.9856, std.dev.: 0.0143) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.42% (0.3137 => 0.3401, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.70% (0.4559 => 0.4910, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.45% (0.1893 => 0.2034, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.77% (0.3295 => 0.3518, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.76% (0.8359 => 0.8924, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.12% (0.8805 => 0.9344, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/except: 6.01% (0.2045 => 0.2168, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.99% (0.8597 => 0.9112, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.97% (0.1927 => 0.2042, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.72% (0.8457 => 0.8941, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.42% (0.8340 => 0.8792, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.21% (0.4127 => 0.4342, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.16% (0.9039 => 0.9505, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (0.2091 => 0.2198, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.02% (0.8048 => 0.8452, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/hash: 4.84% (0.3800 => 0.3984, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary2: 4.70% (0.2509 => 0.2627, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.68% (0.3657 => 0.3828, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.40% (0.7966 => 0.8237, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 3.28% (0.8069 => 0.8334, std.dev.: 0.0097) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 117.09% (0.0199 => 0.0432, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/pi: 58.52% (1.5795 => 2.5039, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/heapsort: 46.83% (3.0515 => 4.4804, std.dev.: 0.2384) SingleSource/Benchmarks/Shootout/heapsort: 30.82% (3.2926 => 4.3074, std.dev.: 0.3370) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.32% (0.7597 => 0.8913, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.43% (2.9753 => 3.4641, std.dev.: 0.0365) SingleSource/Benchmarks/CoyoteBench/lpbench: 15.53% (3.9006 => 4.5062, std.dev.: 0.1468) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.65% (2.7995 => 3.2096, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.82% (5.0261 => 5.6201, std.dev.: 0.0737) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.78% (6.3772 => 6.9371, std.dev.: 0.1260) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.12% (1.1857 => 1.2820, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 7.53% (1.7056 => 1.8341, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.50% (4.7794 => 5.0900, std.dev.: 0.0505) SingleSource/Benchmarks/Misc/richards_benchmark: 6.47% (1.3037 => 1.3881, std.dev.: 0.0289) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.02% (4.9686 => 5.2675, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.99% (4.5327 => 4.8044, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.90% (6.2275 => 6.5326, std.dev.: 0.0102) MultiSource/Applications/lambda-0_1_3/lambda: 4.49% (7.4933 => 7.8295, std.dev.: 0.0342) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.41% (4.9469 => 5.1650, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.12% (4.9453 => 5.1488, std.dev.: 0.0193) MultiSource/Applications/hexxagon/hexxagon: 3.90% (14.0064 => 14.5521, std.dev.: 0.0669) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.91% (11.5690 => 11.9060, std.dev.: 0.0161) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.90% (0.5889 => 0.6060, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.73% (8.2783 => 8.5045, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout/lists: 2.67% (7.3375 => 7.5337, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.59% (4.8362 => 4.9613, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/ReedSolomon: 1.84% (8.5322 => 8.6892, std.dev.: 0.0154) SingleSource/Benchmarks/Misc/whetstone: 1.43% (2.1224 => 2.1527, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.27% (3.5679 => 3.6131, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/neural/neural: 1.26% (1.0841 => 1.0978, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.14% (2.8951 => 1.6751, std.dev.: 0.0492) MultiSource/Benchmarks/Olden/em3d/em3d: -20.28% (5.4641 => 4.3559, std.dev.: 0.0570) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.96% (7.2130 => 6.2783, std.dev.: 0.1207) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.73% (1.0512 => 0.9384, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: -9.65% (1.1216 => 1.0134, std.dev.: 0.0270) MultiSource/Benchmarks/mafft/pairlocalalign: -8.36% (63.1822 => 57.9005, std.dev.: 0.2069) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.01% (14.6451 => 13.4720, std.dev.: 0.1489) MultiSource/Benchmarks/nbench/nbench: -6.41% (21.9654 => 20.5572, std.dev.: 0.2797) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.95% (5.4972 => 5.1701, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.88% (4.7482 => 4.4691, std.dev.: 0.0422) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.46% (3.7148 => 3.5121, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.01% (5.1557 => 4.8975, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.15% (4.7449 => 4.5482, std.dev.: 0.0734) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.00% (0.5807 => 0.5633, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.99% (2.6356 => 2.5569, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.43% (9.9065 => 9.6661, std.dev.: 0.0732) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.95% (11.5316 => 11.3072, std.dev.: 0.0584) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.3487 => 2.3154, std.dev.: 0.0054) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.01% (1.0262 => 1.0673, std.dev.: 0.2988) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 79.67% (0.0123 => 0.0221, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.39% (0.0408 => 0.0430, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 33.07% (0.0254 => 0.0338, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.30% (0.0302 => 0.0318, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.98% (0.0384 => 0.0430, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: 8.95% (0.0190 => 0.0207, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 23.33% (0.0180 => 0.0222, std.dev.: 0.0074) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.70% (0.1438 => 0.1448, std.dev.: 0.0075) MultiSource/Applications/lemon/lemon: 2.22% (1.1329 => 1.1581, std.dev.: 0.4259) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.36% (0.4164 => 0.4149, std.dev.: 0.1390) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.57% (0.1369 => 0.1459, std.dev.: 0.0250) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.56% (0.0641 => 0.0651, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.19% (0.0578 => 0.0608, std.dev.: 0.0160) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.42% (1.1437 => 1.1943, std.dev.: 0.0419) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 28.57% (0.0014 => 0.0018, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 29.35% (0.0627 => 0.0811, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.11% (0.8017 => 0.7848, std.dev.: 0.0054) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: 100.00% (0.0001 => 0.0002, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: 800.00% (0.0001 => 0.0009, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 54.84% (0.0062 => 0.0096, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 14:49:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 16:49:37 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121127224937.1C63D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6320?compare_to=6312&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6320, Order: 168712, Start Time: 2012-11-27 19:29:20, End Time: 2012-11-27 22:50:08 To: 6312, Order: 168698, Start Time: 2012-11-27 15:21:02, End Time: 2012-11-27 18:41:10 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (170 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1089 (720 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.18% (2.3770 => 2.4051, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 32.59% (56.5205 => 74.9418, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.03% (54.2015 => 54.7577, std.dev.: 0.1143) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.44% (0.0625 => 0.0884, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.36% (0.1063 => 0.1407, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.20% (0.2969 => 0.3747, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.41% (0.1106 => 0.1387, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.07% (0.0714 => 0.0893, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.81% (0.4139 => 0.5166, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.55% (0.4253 => 0.5297, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 24.46% (1.5932 => 1.9829, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.42% (0.5900 => 0.7282, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.13% (0.4994 => 0.6149, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.95% (0.0584 => 0.0718, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.85% (0.0547 => 0.0672, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.46% (0.5000 => 0.6123, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.85% (0.1620 => 0.1974, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.84% (0.1021 => 0.1244, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.74% (0.0897 => 0.1092, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.50% (0.1107 => 0.1345, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.40% (0.1103 => 0.1328, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.38% (0.0584 => 0.0703, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 20.36% (0.0948 => 0.1141, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.98% (0.3903 => 0.4683, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 19.98% (0.0821 => 0.0985, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.94% (0.1003 => 0.1203, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.94% (0.0642 => 0.0770, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.82% (0.1549 => 0.1856, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.71% (0.0822 => 0.0984, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 19.46% (0.1619 => 0.1934, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.45% (0.1604 => 0.1916, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 19.37% (0.0604 => 0.0721, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.95% (0.1462 => 0.1739, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 18.80% (0.0947 => 0.1125, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 18.56% (0.0808 => 0.0958, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.15% (0.3890 => 0.4596, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.07% (0.2014 => 0.2378, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.68% (1.3152 => 1.5477, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 17.65% (0.1218 => 0.1433, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.58% (0.2736 => 0.3217, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.56% (0.1088 => 0.1279, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 17.51% (0.5826 => 0.6846, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 17.47% (0.4029 => 0.4733, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 17.41% (0.1505 => 0.1767, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 17.24% (0.5889 => 0.6904, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.06% (0.2866 => 0.3355, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 17.06% (0.5546 => 0.6492, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.03% (0.3271 => 0.3828, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.02% (0.4658 => 0.5451, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 16.77% (1.8794 => 2.1946, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.72% (0.1968 => 0.2297, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.70% (3.5627 => 4.1578, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.43% (1.6211 => 1.8874, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.28% (0.2875 => 0.3343, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 16.19% (0.9697 => 1.1267, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.12% (0.1160 => 0.1347, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.00% (0.5026 => 0.5830, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/18-imp/imp: 15.97% (0.1421 => 0.1648, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hello: 15.88% (0.2714 => 0.3145, std.dev.: 0.0042) MultiSource/Applications/d/make_dparser: 15.81% (1.0781 => 1.2486, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.75% (0.4361 => 0.5048, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.71% (4.4195 => 5.1139, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.70% (0.2738 => 0.3168, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 15.67% (0.2750 => 0.3181, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.65% (0.3930 => 0.4545, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 15.63% (0.2725 => 0.3151, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 15.61% (0.3004 => 0.3473, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.57% (0.2729 => 0.3154, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/methcall: 15.57% (0.2813 => 0.3251, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 15.48% (0.2823 => 0.3260, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 15.47% (0.2780 => 0.3210, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 15.44% (0.9909 => 1.1439, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.40% (0.2792 => 0.3222, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 15.35% (0.7171 => 0.8272, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: 15.34% (0.1284 => 0.1481, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 15.34% (4.2109 => 4.8568, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/random: 15.31% (0.2803 => 0.3232, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 15.26% (0.2811 => 0.3240, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.25% (0.2911 => 0.3355, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.22% (2.7292 => 3.1445, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/wc: 15.21% (0.3096 => 0.3567, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.12% (2.0673 => 2.3798, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.09% (0.3195 => 0.3677, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 15.06% (23.5202 => 27.0629, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.99% (1.9694 => 2.2646, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 14.97% (0.3267 => 0.3756, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.77% (0.1090 => 0.1251, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 14.76% (0.3258 => 0.3739, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 14.75% (0.2075 => 0.2381, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.69% (1.9966 => 2.2900, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary2: 14.59% (0.3317 => 0.3801, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.28% (0.3060 => 0.3497, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.22% (0.3362 => 0.3840, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.18% (0.3124 => 0.3567, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 14.03% (0.2566 => 0.2926, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.02% (0.3282 => 0.3742, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 13.92% (0.3678 => 0.4190, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 13.86% (0.3348 => 0.3812, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 13.77% (0.3726 => 0.4239, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 13.66% (0.3477 => 0.3952, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.60% (0.3625 => 0.4118, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 13.57% (1.4269 => 1.6205, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.46% (0.3981 => 0.4517, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 13.41% (0.4146 => 0.4702, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 13.38% (0.3446 => 0.3907, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.36% (0.3465 => 0.3928, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 13.36% (0.4251 => 0.4819, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 13.32% (0.0758 => 0.0859, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 13.32% (0.7875 => 0.8924, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 13.30% (0.3496 => 0.3961, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.29% (0.3460 => 0.3920, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.28% (0.3690 => 0.4180, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.25% (0.3488 => 0.3950, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.23% (0.3469 => 0.3928, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.22% (0.3442 => 0.3897, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.08% (0.3845 => 0.4348, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions: 13.01% (0.3643 => 0.4117, std.dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 12.99% (2.1653 => 2.4465, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 12.99% (0.3650 => 0.4124, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.76% (0.3724 => 0.4199, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 12.67% (0.5012 => 0.5647, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 12.62% (4.6177 => 5.2005, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 12.48% (2.1013 => 2.3635, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.35% (0.2040 => 0.2292) MultiSource/Applications/SIBsim4/SIBsim4: 12.34% (0.2691 => 0.3023, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 11.41% (5.5417 => 6.1739, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.41% (0.6435 => 0.7169, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.85% (0.1383 => 0.1533, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.80% (0.1028 => 0.1139, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 10.72% (0.3498 => 0.3873, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.30% (0.2737 => 0.3019, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.25% (0.2068 => 0.2280, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 10.17% (0.6634 => 0.7309, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.02% (0.3084 => 0.3393, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 9.99% (0.4847 => 0.5331, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 9.47% (0.3336 => 0.3652, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 9.47% (2.0346 => 2.2272, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.46% (0.2103 => 0.2302, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 9.45% (0.2391 => 0.2617, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.12% (4.6926 => 5.0737, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.88% (11.6398 => 12.5567, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.83% (0.5361 => 0.5781, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.61% (0.7426 => 0.7991, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.43% (0.5584 => 0.5999, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 6.23% (11.9555 => 12.7000, std.dev.: 0.0177) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.98% (0.3792 => 0.3943, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.97% (29.0505 => 33.4008, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 9.67% (0.2802 => 0.3073, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6104, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6723, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/flops: 4.66% (15.4430 => 16.1628, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-2: 4.30% (1.8057 => 1.8834, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6419, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary3: 2.14% (15.8721 => 16.2116, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.55% (3.1722 => 3.2213, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2898, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3015, std.dev.: 0.0038) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/almabench: 1.12% (12.4025 => 12.5408, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5907, std.dev.: 0.0307) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.88% (2.4764 => 2.4051, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.91% (25.4195 => 16.5456, std.dev.: 0.0162) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9767, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8033, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/tsp/tsp: -7.21% (2.1113 => 1.9591, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary2: -5.50% (0.2402 => 0.2270, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.41% (11.2080 => 10.8262, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.05% (0.6293 => 0.6101, std.dev.: 0.0050) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7728, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -2.89% (17.2379 => 16.7404, std.dev.: 0.0705) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8622, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5772, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4954, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1459, std.dev.: 0.0360) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0453, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 01:25:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 03:25:54 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121127092554.56D8E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6298?compare_to=6293&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6298, Order: 168677, Start Time: 2012-11-27 07:03:53, End Time: 2012-11-27 09:26:24 To: 6293, Order: 168673, Start Time: 2012-11-27 03:46:41, End Time: 2012-11-27 06:05:00 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 113 (217 on baseline) Performance Improvements: 61 (45 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 912 (623 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 15.18% (4.6190 => 5.3201, std.dev.: 0.0226) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.91% (0.5895 => 0.6774, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 14.61% (0.6593 => 0.7556, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 14.57% (0.8062 => 0.9237, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.53% (0.6602 => 0.7561, std.dev.: 0.0069) MultiSource/Applications/siod/siod: 14.44% (2.6018 => 2.9776, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 14.00% (2.4991 => 2.8489, std.dev.: 0.0397) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.64% (0.1180 => 0.1341, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 13.49% (0.5789 => 0.6570, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.47% (0.4594 => 0.5213, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 13.29% (0.7872 => 0.8918, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.28% (0.6222 => 0.7048, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.23% (0.6884 => 0.7795, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 13.23% (0.0786 => 0.0890, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 13.11% (0.5906 => 0.6680, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 12.84% (0.6424 => 0.7249, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.61% (0.2237 => 0.2519, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.55% (0.1052 => 0.1184, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 12.37% (0.6150 => 0.6911, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 12.30% (0.3707 => 0.4163, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.20% (4.8256 => 5.4143, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 12.05% (0.3478 => 0.3897, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.84% (2.2694 => 2.5381, std.dev.: 0.0200) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.79% (0.4039 => 0.4515, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 11.40% (0.1167 => 0.1300, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.37% (0.3228 => 0.3595, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.21% (1.3181 => 1.4659, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.16% (0.3916 => 0.4353, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.04% (0.6360 => 0.7062, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.97% (1.5672 => 1.7391, std.dev.: 0.0206) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.92% (1.4765 => 1.6377, std.dev.: 0.0077) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.86% (0.1179 => 0.1307, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 10.68% (0.9871 => 1.0925, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.64% (0.1109 => 0.1227, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.42% (0.1660 => 0.1833, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.99% (0.1712 => 0.1883, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.99% (0.2674 => 0.2941, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.85% (5.5857 => 6.1361, std.dev.: 0.0298) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.85% (0.9110 => 1.0007, std.dev.: 0.0050) MultiSource/Applications/sgefa/sgefa: 9.75% (0.3539 => 0.3884, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: 9.59% (0.2888 => 0.3165, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.56% (4.6985 => 5.1479, std.dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.45% (0.5291 => 0.5791, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.39% (0.1182 => 0.1293, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.95% (1.5951 => 1.7378, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/health/health: 8.91% (0.1471 => 0.1602, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.90% (0.6867 => 0.7478, std.dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.87% (1.8019 => 1.9617, std.dev.: 0.0501) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (0.7195 => 0.7828, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.71% (0.6212 => 0.6753, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.66% (0.6292 => 0.6837, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.61% (0.1289 => 0.1400, std.dev.: 0.0033) MultiSource/Applications/kimwitu++/kc: 8.21% (20.7953 => 22.5016, std.dev.: 0.0245) MultiSource/Benchmarks/MallocBench/gs/gs: 8.09% (4.7543 => 5.1390, std.dev.: 0.0466) MultiSource/Applications/hexxagon/hexxagon: 8.00% (1.4544 => 1.5708, std.dev.: 0.0131) MultiSource/Applications/sqlite3/sqlite3: 7.90% (19.2373 => 20.7573, std.dev.: 0.1461) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.82% (7.9838 => 8.6084, std.dev.: 0.1010) SingleSource/Benchmarks/Shootout-C++/hello: 7.56% (0.3069 => 0.3301, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.52% (16.9786 => 18.2550, std.dev.: 0.0711) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.51% (0.3394 => 0.3649, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.39% (0.4211 => 0.4522, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.24% (0.4697 => 0.5037, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.13% (0.9032 => 0.9676, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/sieve: 7.09% (0.4007 => 0.4291, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.86% (0.4196 => 0.4484, std.dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.77% (0.7174 => 0.7660, std.dev.: 0.0139) MultiSource/Benchmarks/nbench/nbench: 6.67% (1.3305 => 1.4193, std.dev.: 0.0196) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.62% (0.9561 => 1.0194, std.dev.: 0.0041) MultiSource/Applications/JM/ldecod/ldecod: 6.53% (9.3676 => 9.9792, std.dev.: 0.1414) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.52% (1.5132 => 1.6119, std.dev.: 0.0224) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.40% (0.6843 => 0.7281, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones/fhourstones: 6.18% (0.1910 => 0.2028, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.05% (5.5376 => 5.8726, std.dev.: 0.0688) MultiSource/Applications/d/make_dparser: 5.78% (3.7791 => 3.9976, std.dev.: 0.0590) SingleSource/Benchmarks/Misc/oourafft: 5.65% (0.3594 => 0.3797, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.43% (0.3336 => 0.3517, std.dev.: 0.0060) MultiSource/Applications/SPASS/SPASS: 5.03% (18.0138 => 18.9190, std.dev.: 0.0845) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.01% (0.6686 => 0.7021, std.dev.: 0.0051) SingleSource/UnitTests/Vector/constpool: 4.71% (54.7952 => 57.3749, std.dev.: 0.1179) SingleSource/Benchmarks/Shootout-C++/random: 4.64% (0.3274 => 0.3426, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 4.62% (1.8323 => 1.9170, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.50% (0.7494 => 0.7831, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/objinst: 4.45% (0.3597 => 0.3757, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.43% (2.4028 => 2.5093, std.dev.: 0.0172) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.30% (6.7452 => 7.0353, std.dev.: 0.0406) MultiSource/Applications/Burg/burg: 4.28% (1.4390 => 1.5006, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 4.26% (0.7281 => 0.7591, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.16% (0.3272 => 0.3408, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.78% (4.7953 => 4.9284, std.dev.: 0.0322) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.06% (38.1124 => 38.8987, std.dev.: 0.0771) Performance Regressions - Execution Time ---------------------------------------- SingleSource/UnitTests/ObjC/synchronized: 40.57% (0.1151 => 0.1618, std.dev.: 0.0166) MultiSource/Benchmarks/Ptrdist/ft/ft: 26.38% (1.3177 => 1.6653, std.dev.: 0.0109) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.61% (1.5550 => 1.8755, std.dev.: 0.0521) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.64% (3.7971 => 4.4291, std.dev.: 0.0830) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.79% (14.3267 => 16.5885, std.dev.: 0.6846) MultiSource/Benchmarks/Olden/health/health: 14.99% (0.4622 => 0.5315, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bisort/bisort: 13.02% (0.8929 => 1.0092, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout/ary3: 9.50% (4.3761 => 4.7919, std.dev.: 0.0785) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.08% (9.1383 => 9.9680, std.dev.: 0.1104) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.30% (9.3258 => 10.0998, std.dev.: 0.0434) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.99% (4.0834 => 4.3690, std.dev.: 0.0202) MultiSource/Applications/JM/lencod/lencod: 6.86% (7.5620 => 8.0805, std.dev.: 0.0326) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.77% (0.3144 => 0.3357, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 4.60% (3.1711 => 3.3169, std.dev.: 0.0224) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.96% (0.3332 => 0.3464, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 3.15% (2.7596 => 2.8465, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.66% (5.3975 => 5.5412, std.dev.: 0.0179) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.02% (31.4242 => 32.0585, std.dev.: 0.1114) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.97% (5.3680 => 5.4740, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.89% (2.3079 => 2.3515, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.66% (4.9438 => 5.0258, std.dev.: 0.0223) MultiSource/Applications/sgefa/sgefa: 1.61% (0.6256 => 0.6357, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.11% (1.5379 => 1.5550, std.dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/lemon/lemon: -14.80% (1.4122 => 1.2032, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -12.30% (1.7578 => 1.5416, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: -12.05% (2.6067 => 2.2927, std.dev.: 0.0231) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -11.41% (0.8575 => 0.7597, std.dev.: 0.0303) SingleSource/Benchmarks/Shootout-C++/methcall: -11.30% (0.3539 => 0.3139, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -11.16% (0.3531 => 0.3137, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -11.09% (0.3535 => 0.3143, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -10.79% (0.3754 => 0.3349, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -10.73% (0.4009 => 0.3579, std.dev.: 0.0007) SingleSource/Benchmarks/LivermoreLoops/kernel09: -10.53% (0.1187 => 0.1062, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -10.52% (0.1074 => 0.0961, std.dev.: 0.0006) SingleSource/Benchmarks/LivermoreLoops/kernel12: -10.30% (0.1117 => 0.1002, std.dev.: 0.0028) SingleSource/Benchmarks/LivermoreLoops/kernel07: -10.23% (0.1163 => 0.1044, std.dev.: 0.0032) MultiSource/Benchmarks/sim/sim: -10.15% (0.4149 => 0.3728, std.dev.: 0.0005) SingleSource/Benchmarks/LivermoreLoops/kernel15: -10.09% (0.1318 => 0.1185, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -10.05% (0.1104 => 0.0993, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -9.94% (0.4334 => 0.3903, std.dev.: 0.0007) SingleSource/Benchmarks/LivermoreLoops/kernel11: -9.87% (0.1125 => 0.1014, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/ReedSolomon: -9.86% (0.2443 => 0.2202, std.dev.: 0.0001) SingleSource/Benchmarks/LivermoreLoops/kernel13: -9.50% (0.1200 => 0.1086, std.dev.: 0.0024) SingleSource/Benchmarks/LivermoreLoops/kernel08: -9.46% (0.1363 => 0.1234, std.dev.: 0.0036) SingleSource/Benchmarks/LivermoreLoops/kernel16: -9.27% (0.1252 => 0.1136, std.dev.: 0.0012) SingleSource/Benchmarks/LivermoreLoops/kernel18: -9.23% (0.1636 => 0.1485, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: -9.10% (0.3969 => 0.3608, std.dev.: 0.0082) SingleSource/Benchmarks/LivermoreLoops/kernel14: -9.08% (0.1200 => 0.1091, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/04-bisect/bisect: -8.87% (0.1330 => 0.1212, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -8.15% (0.6439 => 0.5914, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -8.14% (0.6990 => 0.6421, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -8.12% (0.6415 => 0.5894, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -8.11% (0.6674 => 0.6133, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/05-eks/eks: -8.00% (0.5199 => 0.4783, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: -7.94% (0.4272 => 0.3933, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.86% (0.1272 => 0.1172, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -7.45% (0.4311 => 0.3990, std.dev.: 0.0113) SingleSource/UnitTests/ObjC/exceptions-3: -7.29% (0.4265 => 0.3954, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.18% (0.5459 => 0.5067, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/distray/distray: -7.14% (0.1652 => 0.1534, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -7.07% (0.2774 => 0.2578, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.03% (0.1807 => 0.1680, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.82% (1.3232 => 1.2329, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.36% (0.2554 => 0.2417, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.36% (0.7056 => 0.6678, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -4.37% (11.4124 => 10.9133, std.dev.: 0.0830) MultiSource/Applications/JM/lencod/lencod: -1.43% (32.4858 => 32.0212, std.dev.: 0.0613) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: -55.36% (0.2341 => 0.1045, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -28.01% (0.4737 => 0.3410, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: -25.76% (7.6495 => 5.6790, std.dev.: 0.2967) MultiSource/Applications/minisat/minisat: -23.08% (12.3464 => 9.4963, std.dev.: 0.1273) MultiSource/Benchmarks/McCat/09-vor/vor: -18.47% (0.1462 => 0.1192, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -18.28% (4.6237 => 3.7787, std.dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -15.32% (1.6105 => 1.3637, std.dev.: 0.0560) MultiSource/Applications/SPASS/SPASS: -10.78% (14.3535 => 12.8063, std.dev.: 0.3724) MultiSource/Applications/lemon/lemon: -8.09% (1.5629 => 1.4365, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.69% (1.6554 => 1.5447, std.dev.: 0.0279) MultiSource/Applications/sqlite3/sqlite3: -4.30% (4.7919 => 4.5859, std.dev.: 0.0021) MultiSource/Benchmarks/NPB-serial/is/is: -3.06% (8.8273 => 8.5576, std.dev.: 0.0050) MultiSource/Applications/SIBsim4/SIBsim4: -2.24% (3.9480 => 3.8594, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.60% (1.9193 => 1.8886, std.dev.: 0.0015) MultiSource/Applications/lua/lua: -1.34% (27.5056 => 27.1383, std.dev.: 0.0583) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.06% (7.3450 => 7.2673, std.dev.: 0.0088) SingleSource/Benchmarks/LivermoreLoops/kernel14: -1.01% (1.5788 => 1.5629, std.dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.33% (69.7803 => 69.5524, std.dev.: 0.0450) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.67% (0.1353 => 0.1362, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.97% (0.0426 => 0.0477, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.76% (0.0651 => 0.0669, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: -0.03% (494.0168 => 493.8695, std.dev.: 0.2979) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.98% (63.2438 => 69.5524, std.dev.: 0.0450) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.91% (4.3882 => 0.0477, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43694.40% (1.1277 => 493.8695, std.dev.: 0.2979) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.82% (0.5229 => 1.5416, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 26.22% (14.9895 => 18.9190, std.dev.: 0.0845) MultiSource/Applications/kimwitu++/kc: 58.96% (14.1553 => 22.5016, std.dev.: 0.0245) MultiSource/Benchmarks/MallocBench/gs/gs: 25.02% (4.1105 => 5.1390, std.dev.: 0.0466) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 45.90% (1.1048 => 1.6119, std.dev.: 0.0224) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 443.41% (7.1582 => 38.8987, std.dev.: 0.0771) SingleSource/Benchmarks/Misc-C++-EH/spirit: 103.16% (3.4629 => 7.0353, std.dev.: 0.0406) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.47% (0.6222 => 1.0358, std.dev.: 0.0396) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11122.92% (0.0720 => 8.0805, std.dev.: 0.0326) MultiSource/Applications/SIBsim4/SIBsim4: 3859300.00% (0.0001 => 3.8594, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 12806200.00% (0.0001 => 12.8063, std.dev.: 0.3724) MultiSource/Applications/kimwitu++/kc: 52700.00% (0.0001 => 0.0528, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14400.00% (0.0001 => 0.0145, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 620900.00% (0.0001 => 0.6210, std.dev.: 0.0235) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10084900.00% (0.0001 => 10.0850, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5678900.00% (0.0001 => 5.6790, std.dev.: 0.2967) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1757.02% (1.1194 => 20.7875, std.dev.: 0.2564) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 81.05% (2.9384 => 5.3201, std.dev.: 0.0226) MultiSource/Applications/ClamAV/clamscan: 69.78% (22.1758 => 37.6510, std.dev.: 0.1696) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 61.28% (7.0540 => 11.3768, std.dev.: 0.0856) SingleSource/Benchmarks/CoyoteBench/almabench: 49.18% (0.0730 => 0.1089, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 48.47% (8.1363 => 12.0799, std.dev.: 0.0495) MultiSource/Applications/JM/lencod/lencod: 45.97% (21.9371 => 32.0212, std.dev.: 0.0613) MultiSource/Benchmarks/FreeBench/distray/distray: 45.27% (0.1056 => 0.1534, std.dev.: 0.0002) SingleSource/UnitTests/block-byref-cxxobj-test: 37.83% (0.0267 => 0.0368, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 36.87% (0.1432 => 0.1960, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/voronoi/voronoi: 33.15% (0.2700 => 0.3595, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 32.44% (0.0672 => 0.0890, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 31.62% (0.1151 => 0.1515, std.dev.: 0.0015) SingleSource/UnitTests/vla: 30.14% (0.0355 => 0.0462, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 29.94% (0.1032 => 0.1341, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/ft/ft: 29.85% (0.1940 => 0.2519, std.dev.: 0.0101) MultiSource/Applications/siod/siod: 29.64% (2.2969 => 2.9776, std.dev.: 0.0109) MultiSource/Benchmarks/Fhourstones/fhourstones: 29.50% (0.1566 => 0.2028, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 29.35% (2.2024 => 2.8489, std.dev.: 0.0397) MultiSource/Benchmarks/Olden/bisort/bisort: 28.99% (0.0614 => 0.0792, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/family/family: 28.97% (0.0397 => 0.0512, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 28.90% (1.1642 => 1.5006, std.dev.: 0.0172) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 28.75% (0.0953 => 0.1227, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/treeadd/treeadd: 28.61% (0.0416 => 0.0535, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.84% (0.0528 => 0.0675, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 27.32% (0.0871 => 0.1109, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 27.29% (0.0447 => 0.0569, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 27.19% (0.0467 => 0.0594, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/mst/mst: 27.17% (0.1163 => 0.1479, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 27.06% (14.3668 => 18.2550, std.dev.: 0.0711) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 27.05% (0.4103 => 0.5213, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 26.96% (4.2646 => 5.4143, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/life/life: 26.90% (0.0933 => 0.1184, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 26.81% (0.5569 => 0.7062, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.62% (3.8922 => 4.9284, std.dev.: 0.0322) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 26.50% (0.3441 => 0.4353, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 26.49% (0.2065 => 0.2612, std.dev.: 0.0092) MultiSource/Benchmarks/Olden/health/health: 26.34% (0.1268 => 0.1602, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 26.04% (0.4620 => 0.5823, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 25.49% (1.3050 => 1.6377, std.dev.: 0.0077) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 25.48% (0.4615 => 0.5791, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.45% (0.0770 => 0.0966, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 25.34% (0.1117 => 0.1400, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash: 25.30% (0.4289 => 0.5374, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 25.21% (0.0730 => 0.0914, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: 25.19% (0.0770 => 0.0964, std.dev.: 0.0034) MultiSource/Applications/sgefa/sgefa: 24.93% (0.3109 => 0.3884, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.74% (0.8172 => 1.0194, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ks/ks: 24.70% (0.1510 => 0.1883, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Oscar: 24.37% (0.0636 => 0.0791, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/moments: 24.36% (0.4048 => 0.5034, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.26% (0.0746 => 0.0927, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 23.99% (0.0592 => 0.0734) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.85% (0.1044 => 0.1293, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: 23.84% (0.4064 => 0.5033, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 23.70% (0.3650 => 0.4515, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 23.70% (1.5859 => 1.9617, std.dev.: 0.0501) MultiSource/Applications/lua/lua: 23.60% (3.8723 => 4.7860, std.dev.: 0.1025) MultiSource/Benchmarks/Ptrdist/bc/bc: 23.59% (1.1861 => 1.4659, std.dev.: 0.0182) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 23.53% (0.8101 => 1.0007, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/lists: 23.52% (0.3422 => 0.4227, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 23.24% (0.3162 => 0.3897, std.dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/fftbench: 23.06% (0.4636 => 0.5705, std.dev.: 0.0136) SingleSource/Benchmarks/Misc/whetstone: 23.03% (0.0660 => 0.0812, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 22.86% (1.5603 => 1.9170, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/08-main/main: 22.83% (0.2554 => 0.3137, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 22.82% (2.0665 => 2.5381, std.dev.: 0.0200) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 22.68% (5.0018 => 6.1361, std.dev.: 0.0298) MultiSource/Benchmarks/BitBench/drop3/drop3: 22.61% (0.0482 => 0.0591, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 22.59% (1.4186 => 1.7391, std.dev.: 0.0206) MultiSource/Benchmarks/Prolangs-C/football/football: 22.46% (0.8921 => 1.0925, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 22.32% (1.2842 => 1.5708, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/random: 22.27% (0.2802 => 0.3426, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/hash: 22.27% (0.0485 => 0.0593, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 22.02% (0.2793 => 0.3408, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 21.97% (0.0719 => 0.0877, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 21.91% (0.0648 => 0.0790, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 21.74% (0.5981 => 0.7281, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.72% (0.2758 => 0.3357, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/heapsort: 21.69% (0.2872 => 0.3495, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 21.64% (5.7591 => 7.0053, std.dev.: 0.1548) SingleSource/Benchmarks/Shootout-C++/hello: 21.63% (0.2714 => 0.3301, std.dev.: 0.0081) SingleSource/UnitTests/ObjC/dot-syntax-1: 21.50% (0.0479 => 0.0582) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 21.48% (0.3427 => 0.4163, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 21.19% (0.0793 => 0.0961, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.03% (0.2430 => 0.2941, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 20.81% (17.1811 => 20.7573, std.dev.: 0.1461) MultiSource/Benchmarks/Olden/tsp/tsp: 20.77% (0.1175 => 0.1419, std.dev.: 0.0059) MultiSource/Applications/viterbi/viterbi: 20.64% (0.1555 => 0.1876, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.52% (0.1584 => 0.1909, std.dev.: 0.0063) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 20.44% (0.1125 => 0.1355, std.dev.: 0.0081) SingleSource/UnitTests/2006-12-11-LoadConstants: 20.12% (0.1143 => 0.1373, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/objinst: 19.99% (0.3131 => 0.3757, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.95% (0.8067 => 0.9676, std.dev.: 0.0166) MultiSource/Benchmarks/nbench/nbench: 19.87% (1.1840 => 1.4193, std.dev.: 0.0196) MultiSource/Applications/d/make_dparser: 19.85% (3.3354 => 3.9976, std.dev.: 0.0590) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.84% (0.4203 => 0.5037, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.81% (0.5860 => 0.7021, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/bmm/bmm: 19.76% (0.0759 => 0.0909, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference: 19.66% (0.7326 => 0.8766, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 19.53% (0.0640 => 0.0765, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 19.22% (0.6030 => 0.7189, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/sieve: 19.10% (0.3603 => 0.4291, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/reversefile: 18.97% (0.3865 => 0.4598, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 18.76% (4.9449 => 5.8726, std.dev.: 0.0688) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.76% (0.6450 => 0.7660, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 18.19% (0.3826 => 0.4522, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.93% (0.0842 => 0.0993, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 17.52% (0.5925 => 0.6963, std.dev.: 0.0175) MultiSource/Benchmarks/McCat/17-bintr/bintr: 17.48% (0.0675 => 0.0793, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 17.09% (0.0626 => 0.0733, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 16.70% (0.1114 => 0.1300, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/matrix: 16.50% (0.0818 => 0.0953, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.36% (0.3136 => 0.3649, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.91% (0.0886 => 0.1027, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 15.69% (0.3282 => 0.3797, std.dev.: 0.0047) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.60% (0.3121 => 0.3608, std.dev.: 0.0082) MultiSource/Applications/minisat/minisat: 15.26% (0.7115 => 0.8201, std.dev.: 0.0256) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.06% (0.0704 => 0.0810, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.71% (0.2107 => 0.2417, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.64% (0.1236 => 0.1417, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.63% (0.0834 => 0.0956, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 14.54% (0.7835 => 0.8974, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.44% (0.1337 => 0.1530, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.40% (0.9765 => 1.1171, std.dev.: 0.0253) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.39% (0.3307 => 0.3783, std.dev.: 0.0180) SingleSource/Benchmarks/McGill/exptree: 14.37% (0.0814 => 0.0931, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 14.21% (9.4845 => 10.8326, std.dev.: 0.1768) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.12% (0.1062 => 0.1212, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 14.02% (0.3423 => 0.3903, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.95% (0.3935 => 0.4484, std.dev.: 0.0097) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.95% (2.2022 => 2.5093, std.dev.: 0.0172) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.90% (0.1029 => 0.1172, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.81% (0.6675 => 0.7597, std.dev.: 0.0303) SingleSource/Benchmarks/McGill/chomp: 13.60% (0.1655 => 0.1880, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.52% (0.2271 => 0.2578, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.19% (1.5415 => 1.7449, std.dev.: 0.0454) MultiSource/Benchmarks/Olden/power/power: 13.12% (0.1440 => 0.1629, std.dev.: 0.0045) MultiSource/Applications/treecc/treecc: 13.09% (2.0273 => 2.2927, std.dev.: 0.0231) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.80% (0.1625 => 0.1833, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/exceptions-4: 12.62% (0.3543 => 0.3990, std.dev.: 0.0113) SingleSource/UnitTests/ObjC/trivial-interface: 12.55% (0.3473 => 0.3909, std.dev.: 0.0161) MultiSource/Benchmarks/McCat/09-vor/vor: 12.55% (0.3180 => 0.3579, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 12.47% (0.3497 => 0.3933, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.46% (0.3516 => 0.3954, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 12.22% (1.0722 => 1.2032, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.54% (0.1906 => 0.2126, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/05-eks/eks: 11.26% (0.4299 => 0.4783, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 11.04% (0.1268 => 0.1408, std.dev.: 0.0040) SingleSource/UnitTests/SignlessTypes/rem: 10.75% (0.1144 => 0.1267, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.70% (0.3177 => 0.3517, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/lists1: 10.59% (0.3684 => 0.4074, std.dev.: 0.0136) MultiSource/Benchmarks/sim/sim: 10.07% (0.3387 => 0.3728, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 9.74% (0.2905 => 0.3188, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.71% (0.3379 => 0.3707, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.54% (0.2756 => 0.3019, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/ary: 9.53% (0.3232 => 0.3540, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/except: 9.47% (0.2871 => 0.3143, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 9.44% (0.3283 => 0.3593, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 9.13% (0.3098 => 0.3381, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 9.11% (0.2877 => 0.3139, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 8.31% (0.3092 => 0.3349, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.12% (7.9617 => 8.6084, std.dev.: 0.1010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.79% (0.1438 => 0.1550, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: 7.47% (0.2049 => 0.2202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: 5.92% (54.1659 => 57.3749, std.dev.: 0.1179) MultiSource/Benchmarks/PAQ8p/paq8p: 5.27% (10.3673 => 10.9133, std.dev.: 0.0830) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.74% (0.3817 => 0.3998, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 151.16% (4.3953 => 11.0393, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: 147.63% (5.3999 => 13.3718, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/synchronized: 53.95% (0.1051 => 0.1618, std.dev.: 0.0166) MultiSource/Benchmarks/Ptrdist/ft/ft: 29.72% (1.2838 => 1.6653, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout/ary3: 29.53% (3.6994 => 4.7919, std.dev.: 0.0785) SingleSource/Benchmarks/CoyoteBench/fftbench: 27.01% (2.0360 => 2.5859, std.dev.: 0.0692) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.32% (1.5086 => 1.8755, std.dev.: 0.0521) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 23.44% (13.4384 => 16.5885, std.dev.: 0.6846) SingleSource/Benchmarks/CoyoteBench/lpbench: 22.20% (10.3460 => 12.6430, std.dev.: 0.1752) SingleSource/Benchmarks/Shootout-C++/moments: 21.31% (0.1159 => 0.1406, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bisort/bisort: 21.11% (0.8333 => 1.0092, std.dev.: 0.0161) MultiSource/Benchmarks/Olden/health/health: 19.57% (0.4445 => 0.5315, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.92% (1.1145 => 1.3142, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.66% (0.2944 => 0.3464, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 17.43% (6.6465 => 7.8048, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 16.35% (8.6802 => 10.0998, std.dev.: 0.0434) SingleSource/Benchmarks/Shootout-C++/hash2: 15.67% (3.1578 => 3.6527, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/mst/mst: 15.33% (0.1285 => 0.1482, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/heapsort: 13.39% (3.8532 => 4.3690, std.dev.: 0.0202) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.56% (2.8904 => 3.2244, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 10.29% (1.1396 => 1.2569, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 10.06% (0.9505 => 1.0461, std.dev.: 0.0161) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.48% (1.7254 => 1.8889, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.35% (0.3070 => 0.3357, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: 9.00% (0.7455 => 0.8126, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.92% (4.2280 => 4.4785, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.92% (0.9540 => 1.0105, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.51% (3.6395 => 3.8399, std.dev.: 0.0115) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.73% (0.3256 => 0.3410, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 4.17% (9.1159 => 9.4963, std.dev.: 0.1273) MultiSource/Applications/lua/lua: 4.01% (26.0924 => 27.1383, std.dev.: 0.0583) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.6436 => 12.1038, std.dev.: 0.0027) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 2.60% (3.1023 => 3.1831, std.dev.: 0.0135) MultiSource/Applications/aha/aha: 2.19% (3.1595 => 3.2286, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 2.15% (0.6223 => 0.6357, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970) MultiSource/Benchmarks/PAQ8p/paq8p: 1.97% (85.0658 => 86.7455, std.dev.: 0.1108) MultiSource/Benchmarks/mafft/pairlocalalign: 1.75% (27.8444 => 28.3311, std.dev.: 0.0196) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.64% (2.3135 => 2.3515, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 1.52% (3.7221 => 3.7787, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/ackermann: 1.49% (1.7133 => 1.7389, std.dev.: 0.0074) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.45% (6.5088 => 6.6035, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 1.23% (2.2771 => 2.3052, std.dev.: 0.0061) MultiSource/Applications/lambda-0_1_3/lambda: 1.17% (5.2636 => 5.3254, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0499, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1680, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.63% (5.2763 => 1.2329, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -75.79% (0.8651 => 0.2094, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/richards_benchmark: -44.33% (0.1622 => 0.0903, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.72% (5.3526 => 4.7788, std.dev.: 0.0984) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.41% (5.3855 => 5.1479, std.dev.: 0.0085) MultiSource/Applications/JM/ldecod/ldecod: -4.38% (10.4361 => 9.9792, std.dev.: 0.1414) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.31% (1.7609 => 1.7378, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -68.63% (32.5116 => 10.1998, std.dev.: 0.0080) SingleSource/Benchmarks/Dhrystone/fldry: -65.40% (1.9577 => 0.6774, std.dev.: 0.0102) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1681, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.31% (0.3987 => 0.2380, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.92% (0.0506 => 0.0304, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.24% (4.5009 => 2.7798, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -33.53% (1.1492 => 0.7639, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.13% (2.6546 => 2.0140, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: -19.34% (0.2161 => 0.1743, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.60% (1.6925 => 1.4284, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2839, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -10.62% (1.5373 => 1.3740, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -10.52% (9.5636 => 8.5576, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.47% (1.5660 => 1.4333, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.08% (1.6805 => 1.5447, std.dev.: 0.0279) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.76% (0.3463 => 0.3229, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.17% (3.2416 => 3.0415, std.dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5758, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.03% (0.8614 => 0.8181, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -4.90% (1.5835 => 1.5059, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.53% (1.8329 => 1.7498, std.dev.: 0.0282) SingleSource/Benchmarks/Shootout/lists: -4.09% (6.2999 => 6.0420, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.38% (0.9957 => 0.9620, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8914, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.16% (0.4808 => 0.4704, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.92% (8.1563 => 7.9995, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6767, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -1.48% (10.2830 => 10.1304, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: -1.25% (4.6441 => 4.5859, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.28% (0.1485 => 0.1362, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.38% (0.2116 => 0.0669, std.dev.: 0.0000) Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 15:21:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 17:21:45 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121127232145.D03572A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6321?compare_to=6317&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6321, Order: 168723, Start Time: 2012-11-27 21:49:56, End Time: 2012-11-27 23:22:18 To: 6317, Order: 168719, Start Time: 2012-11-27 19:54:11, End Time: 2012-11-27 21:26:44 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (186 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (850 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.71% (55.5377 => 56.4854, std.dev.: 0.0656) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 16.82% (0.3834 => 0.4479, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.50% (54.5751 => 56.4854, std.dev.: 0.0656) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1016, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/salsa20: 2.55% (7.4937 => 7.6846, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash2: 2.22% (3.1932 => 3.2640, std.dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.51% (0.3821 => 0.3534, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.20% (0.9542 => 0.8855, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.68% (0.3142 => 0.2932, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -6.52% (2.4924 => 2.3298, std.dev.: 0.0119) MultiSource/Applications/sgefa/sgefa: -6.49% (0.3357 => 0.3139, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -6.39% (0.2160 => 0.2022, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.38% (0.2428 => 0.2273, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.06% (0.9852 => 0.9255, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.01% (0.3880 => 0.3647, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -5.98% (9.2283 => 8.6760, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.96% (0.1796 => 0.1689, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: -5.95% (0.3831 => 0.3603, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -5.95% (16.1920 => 15.2292, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.94% (0.5857 => 0.5509, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -5.93% (0.3812 => 0.3586, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.90% (0.3896 => 0.3666, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.89% (0.6484 => 0.6102, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: -5.88% (7.0961 => 6.6792, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/exceptions-3: -5.87% (0.3848 => 0.3622, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.86% (0.2355 => 0.2217, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.85% (0.4033 => 0.3797, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: -5.85% (0.9179 => 0.8642, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.84% (0.5478 => 0.5158, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.83% (0.1716 => 0.1616, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.82% (0.5925 => 0.5580, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.80% (0.5863 => 0.5523, std.dev.: 0.0105) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -5.77% (0.4176 => 0.3935, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.74% (0.5591 => 0.5270, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.74% (0.5805 => 0.5472, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.71% (1.0544 => 0.9942, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.70% (0.6052 => 0.5707, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.69% (0.6260 => 0.5904, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.65% (0.6667 => 0.6290, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -5.64% (0.1879 => 0.1773, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.64% (1.3722 => 1.2948, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.64% (0.2695 => 0.2543, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.64% (4.8161 => 4.5445, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.63% (0.6230 => 0.5879, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.63% (0.3891 => 0.3672, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.63% (4.0323 => 3.8054, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.60% (0.5570 => 0.5258, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.59% (0.6297 => 0.5945, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.58% (0.6446 => 0.6086, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.58% (0.3658 => 0.3454, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.57% (0.5705 => 0.5387, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.57% (0.6660 => 0.6289, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.55% (0.5802 => 0.5480, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.55% (0.5859 => 0.5534, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.53% (0.7198 => 0.6800, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.52% (0.5581 => 0.5273, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.51% (0.6189 => 0.5848, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.51% (0.5575 => 0.5268, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.51% (0.6194 => 0.5853, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.50% (0.6304 => 0.5957, std.dev.: 0.0129) MultiSource/Benchmarks/nbench/nbench: -5.49% (1.1530 => 1.0897, std.dev.: 0.0051) MultiSource/Applications/lemon/lemon: -5.45% (1.1450 => 1.0826, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.45% (0.6681 => 0.6317, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.44% (1.2300 => 1.1631, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.44% (3.5339 => 3.3417, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.44% (0.6676 => 0.6313, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.44% (0.5849 => 0.5531, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.44% (0.5941 => 0.5618, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -5.43% (1.3864 => 1.3111, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/property: -5.43% (0.4199 => 0.3971, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.43% (0.5456 => 0.5160, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.42% (6.7716 => 6.4047, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.41% (1.6364 => 1.5478, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.40% (0.5688 => 0.5381, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.35% (1.4642 => 1.3859, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.34% (0.6736 => 0.6376, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.34% (4.8802 => 4.6195, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.33% (1.2784 => 1.2102, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.33% (4.5069 => 4.2665, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.30% (0.6440 => 0.6099, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.25% (0.3884 => 0.3680, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -5.23% (4.3330 => 4.1062, std.dev.: 0.0144) MultiSource/Applications/sqlite3/sqlite3: -5.21% (17.1032 => 16.2128, std.dev.: 0.0238) MultiSource/Benchmarks/McCat/05-eks/eks: -5.20% (0.4515 => 0.4280, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.19% (0.8521 => 0.8079, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.18% (1.2210 => 1.1577, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.18% (0.6293 => 0.5967, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.17% (0.6033 => 0.5721, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.14% (0.3406 => 0.3231, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.14% (14.2083 => 13.4787, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -5.13% (0.2985 => 0.2832, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.09% (0.7919 => 0.7516, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/08-main/main: -5.08% (0.2659 => 0.2524, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.06% (8.0126 => 7.6070, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/parameter-passing: -5.05% (0.4280 => 0.4064, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -4.97% (15.5079 => 14.7365, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.96% (0.4916 => 0.4672, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.95% (0.2548 => 0.2422, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.87% (0.2278 => 0.2167, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: -4.86% (0.3581 => 0.3407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.85% (0.7339 => 0.6983, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -4.83% (0.7447 => 0.7087, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.83% (0.5999 => 0.5709, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.80% (1.2221 => 1.1634, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.80% (0.2999 => 0.2855, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -4.79% (1.2515 => 1.1915, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -4.78% (3.5154 => 3.3472, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.78% (0.3931 => 0.3743, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.78% (0.5168 => 0.4921, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.77% (0.6395 => 0.6090, std.dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: -4.77% (1.3148 => 1.2521, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.75% (0.4151 => 0.3954, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.74% (0.3837 => 0.3655, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -4.73% (15.2527 => 14.5314, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.71% (0.3483 => 0.3319, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -4.70% (0.3255 => 0.3102, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -4.68% (4.0594 => 3.8694, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: -4.66% (0.3025 => 0.2884, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.66% (0.6395 => 0.6097, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.65% (0.4813 => 0.4589, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.65% (0.7524 => 0.7174, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.64% (0.3016 => 0.2876, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -4.60% (0.2871 => 0.2739, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.58% (0.3057 => 0.2917, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -4.57% (0.3194 => 0.3048, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -4.56% (5.0226 => 4.7938, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.51% (2.1713 => 2.0733, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.51% (0.5569 => 0.5318, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.50% (0.2933 => 0.2801, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -4.49% (0.3026 => 0.2890, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.49% (1.6474 => 1.5735, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.47% (0.7021 => 0.6707, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.46% (0.3252 => 0.3107, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -4.46% (0.2939 => 0.2808, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -4.42% (0.4861 => 0.4646, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.41% (0.2903 => 0.2775, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.39% (22.4056 => 21.4215, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.38% (0.5567 => 0.5323, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -4.38% (0.3059 => 0.2925, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -4.34% (0.3205 => 0.3066, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.32% (0.2849 => 0.2726, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.32% (0.5329 => 0.5099, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -4.31% (0.3481 => 0.3331, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -4.31% (0.4248 => 0.4065, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.30% (0.3323 => 0.3180, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -4.28% (2.1401 => 2.0486, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.24% (0.9557 => 0.9152, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.24% (0.4321 => 0.4138, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.23% (0.3849 => 0.3686, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.22% (0.3319 => 0.3179, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -4.19% (0.6441 => 0.6171, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.19% (0.3271 => 0.3134, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -4.16% (0.6347 => 0.6083, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -4.11% (0.3621 => 0.3472, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.11% (0.4083 => 0.3915, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: -4.11% (0.3867 => 0.3708, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -4.10% (34.0927 => 32.6956, std.dev.: 0.0032) MultiSource/Applications/siod/siod: -4.10% (2.4021 => 2.3037, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/ary3: -4.03% (0.3446 => 0.3307, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -4.01% (0.3394 => 0.3258, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -3.98% (0.2989 => 0.2870, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -3.98% (0.8418 => 0.8083, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.98% (0.4427 => 0.4251, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -3.97% (0.7779 => 0.7470, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -3.96% (0.4524 => 0.4345, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -3.92% (0.7982 => 0.7669, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: -3.89% (18.2933 => 17.5823, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.86% (0.9077 => 0.8727, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.78% (2.2587 => 2.1733, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -3.73% (0.6750 => 0.6498, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: -3.64% (0.3788 => 0.3650, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: -3.52% (1.5610 => 1.5061, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.01% (5.4682 => 5.3037, std.dev.: 0.0142) SingleSource/UnitTests/Vector/constpool: -2.67% (20.7746 => 20.2196, std.dev.: 0.0341) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1961, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -62.45% (1.8100 => 0.6796, std.dev.: 0.0150) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -23.35% (7.5137 => 5.7589, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -8.76% (1.2842 => 1.1717, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7069, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.77% (2.2633 => 2.1779, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.27% (5.5807 => 5.3984, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4729, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 16:39:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 18:39:36 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121128003936.990D72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6322?compare_to=6319&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6322, Order: 168735, Start Time: 2012-11-27 23:03:31, End Time: 2012-11-28 00:40:09 To: 6319, Order: 168722, Start Time: 2012-11-27 21:06:29, End Time: 2012-11-27 22:42:44 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (30 on baseline) Performance Regressions: 28 (58 on baseline) Performance Improvements: 6 (18 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 39 (38 on baseline) Unchanged Tests: 1019 (897 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel03: 60.61% (0.1023 => 0.1643, std.dev.: 0.0051) SingleSource/Benchmarks/LivermoreLoops/kernel16: 46.16% (0.1146 => 0.1675, std.dev.: 0.0106) SingleSource/UnitTests/SignlessTypes/shr: 43.23% (0.0303 => 0.0434, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: 36.88% (0.8587 => 1.1754, std.dev.: 0.0867) MultiSource/Benchmarks/McCat/09-vor/vor: 33.37% (0.3308 => 0.4412, std.dev.: 0.0362) MultiSource/Benchmarks/Olden/em3d/em3d: 30.37% (0.1798 => 0.2344, std.dev.: 0.0035) MultiSource/Applications/JM/lencod/lencod: 17.62% (15.7552 => 18.5317, std.dev.: 0.5982) MultiSource/Applications/SPASS/SPASS: 15.07% (14.9147 => 17.1629, std.dev.: 0.8177) MultiSource/Benchmarks/McCat/05-eks/eks: 14.86% (0.4502 => 0.5171, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.63% (13.5581 => 14.8638, std.dev.: 0.3623) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.19% (1.0027 => 1.0547, std.dev.: 0.0133) MultiSource/Benchmarks/MallocBench/gs/gs: 3.69% (4.3814 => 4.5432, std.dev.: 0.0394) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.65% (0.6478 => 0.6585, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 92.05% (0.1383 => 0.2656, std.dev.: 0.0079) SingleSource/Benchmarks/LivermoreLoops/kernel02: 55.45% (0.0330 => 0.0513, std.dev.: 0.0025) SingleSource/Benchmarks/LivermoreLoops/kernel16: 49.40% (0.0496 => 0.0741, std.dev.: 0.0071) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.69% (2.5927 => 2.8699, std.dev.: 0.0967) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.92% (3.1846 => 3.4050, std.dev.: 0.0303) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.16% (0.3363 => 0.3503, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.79% (39.0727 => 40.5530, std.dev.: 0.1408) MultiSource/Applications/aha/aha: 3.13% (3.2639 => 3.3661, std.dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.56% (13.4720 => 13.8166, std.dev.: 0.1210) MultiSource/Benchmarks/Olden/bh/bh: 2.50% (2.3715 => 2.4307, std.dev.: 0.0093) MultiSource/Applications/lua/lua: 2.23% (29.4396 => 30.0960, std.dev.: 0.2097) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.74% (9.6661 => 9.8339, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/flops-5: 1.65% (2.8963 => 2.9442, std.dev.: 0.0129) MultiSource/Benchmarks/BitBench/five11/five11: 1.25% (5.6485 => 5.7192, std.dev.: 0.0266) SingleSource/Benchmarks/Misc/flops-6: 1.23% (2.4660 => 2.4964, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-08-02-CastTest: -49.81% (0.0263 => 0.0132, std.dev.: 0.0017) SingleSource/UnitTests/2003-05-14-AtExit: -42.94% (0.0333 => 0.0190, std.dev.: 0.0051) SingleSource/UnitTests/byval-alignment: -40.28% (0.0288 => 0.0172, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -10.83% (0.0979 => 0.0873, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.45% (0.1968 => 0.1841, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: -10.05% (0.2179 => 0.1960, std.dev.: 0.0047) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.97% (1.0673 => 1.0777, std.dev.: 0.1876) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.45% (0.0221 => 0.0220, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0430 => 0.0429, std.dev.: 0.0138) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -17.16% (0.0338 => 0.0280, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.31% (0.0318 => 0.0317, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.16% (0.0430 => 0.0425, std.dev.: 0.0110) SingleSource/UnitTests/Vector/Altivec/casts: -0.97% (0.0207 => 0.0205, std.dev.: 0.0064) SingleSource/UnitTests/Vector/Altivec/test1: -1.35% (0.0222 => 0.0219, std.dev.: 0.0070) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 38.46% (0.0013 => 0.0018, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.35% (0.1448 => 0.1453, std.dev.: 0.0239) MultiSource/Applications/lemon/lemon: 0.97% (1.1581 => 1.1693, std.dev.: 0.4058) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.69% (0.4149 => 0.4385, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.12% (0.1459 => 0.1428, std.dev.: 0.0207) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.31% (0.0651 => 0.0653, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0277 => 0.0278, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.78% (0.0608 => 0.0585, std.dev.: 0.0172) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.08% (1.1943 => 1.1952, std.dev.: 0.0711) MultiSource/Benchmarks/SciMark2-C/scimark2: 0.29% (9.4452 => 9.4729, std.dev.: 0.0156) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -35.48% (0.0031 => 0.0020, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0018 => 0.0027, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -20.59% (0.0811 => 0.0644, std.dev.: 0.0118) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.88% (0.0266 => 0.0261, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.61% (0.7848 => 0.7800, std.dev.: 0.0414) SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: -50.00% (0.0002 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -23.96% (0.0096 => 0.0073, std.dev.: 0.0051) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/SciMark2-C/scimark2: -66.86% (28.5821 => 9.4729, std.dev.: 0.0156) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 9.81% (16.4461 => 18.0589, std.dev.: 0.8190) MultiSource/Applications/sqlite3/sqlite3: 2409.68% (0.6332 => 15.8913, std.dev.: 0.5190) MultiSource/Benchmarks/McCat/08-main/main: 56.74% (0.1831 => 0.2870, std.dev.: 0.0431) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.75% (0.1559 => 0.1485, std.dev.: 0.0322) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7527.99% (0.3123 => 23.8222, std.dev.: 0.6506) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.85% (0.2463 => 0.3740, std.dev.: 0.0773) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1559.78% (0.3344 => 5.5503, std.dev.: 0.2941) SingleSource/Benchmarks/Misc-C++/Large/ray: 42.64% (0.2364 => 0.3372, std.dev.: 0.0597) SingleSource/Benchmarks/Misc-C++/bigfib: 8.09% (0.6010 => 0.6496, std.dev.: 0.0276) SingleSource/Benchmarks/Misc/mandel: 14.22% (0.0429 => 0.0490, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.09% (0.3266 => 0.3465, std.dev.: 0.0466) SingleSource/Benchmarks/Shootout-C++/strcat: 6.81% (0.1969 => 0.2103, std.dev.: 0.0041) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 9.38% (0.0224 => 0.0245, std.dev.: 0.0068) SingleSource/UnitTests/byval-alignment: -25.22% (0.0230 => 0.0172, std.dev.: 0.0043) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0531, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 13.54% (0.1462 => 0.1660, std.dev.: 0.0283) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4139, std.dev.: 0.0508) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0741, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4909, std.dev.: 0.0196) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5322, std.dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 1.5890, std.dev.: 0.2562) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3210, std.dev.: 0.0209) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1476, std.dev.: 0.0477) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3676, std.dev.: 0.0185) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4016, std.dev.: 0.0363) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0808, std.dev.: 0.0136) SingleSource/Regression/C/uint64_to_float: -23.88% (2.1832 => 1.6618, std.dev.: 0.0359) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/shr: 127.23% (0.0191 => 0.0434, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: 47.85% (0.7950 => 1.1754, std.dev.: 0.0867) MultiSource/Benchmarks/Olden/em3d/em3d: 36.20% (0.1721 => 0.2344, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/09-vor/vor: 35.21% (0.3263 => 0.4412, std.dev.: 0.0362) MultiSource/Applications/JM/lencod/lencod: 20.90% (15.3280 => 18.5317, std.dev.: 0.5982) MultiSource/Applications/SPASS/SPASS: 20.35% (14.2605 => 17.1629, std.dev.: 0.8177) MultiSource/Benchmarks/McCat/05-eks/eks: 17.60% (0.4397 => 0.5171, std.dev.: 0.0180) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.54% (0.1062 => 0.1227, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.77% (13.1811 => 14.8638, std.dev.: 0.3623) MultiSource/Benchmarks/MallocBench/gs/gs: 9.99% (4.1305 => 4.5432, std.dev.: 0.0394) MultiSource/Benchmarks/mafft/pairlocalalign: 9.64% (8.6247 => 9.4558, std.dev.: 0.2790) MultiSource/Benchmarks/McCat/04-bisect/bisect: 8.97% (0.1137 => 0.1239, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.87% (0.9688 => 1.0547, std.dev.: 0.0133) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.19% (0.1905 => 0.2061, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.75% (0.6227 => 0.6585, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.49% (0.8204 => 0.8654, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 4.97% (0.8007 => 0.8405, std.dev.: 0.0148) MultiSource/Benchmarks/PAQ8p/paq8p: 4.92% (2.3764 => 2.4933, std.dev.: 0.0435) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.72% (0.8885 => 0.9304, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.71% (0.2249 => 0.2355, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 107.54% (0.0199 => 0.0413, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 91.63% (0.1386 => 0.2656, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/pi: 57.26% (1.5795 => 2.4840, std.dev.: 0.0156) MultiSource/Applications/SPASS/SPASS: 18.22% (8.4326 => 9.9688, std.dev.: 0.5895) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.62% (2.9753 => 3.4699, std.dev.: 0.0191) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.76% (0.7597 => 0.8794, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.75% (2.7995 => 3.2125, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.60% (5.0261 => 5.6091, std.dev.: 0.0169) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.40% (2.5763 => 2.8699, std.dev.: 0.0967) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.95% (0.3186 => 0.3503, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/18-imp/imp: 7.52% (0.1370 => 0.1473, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.30% (1.1857 => 1.2723, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/richards_benchmark: 6.96% (1.3037 => 1.3944, std.dev.: 0.0330) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.88% (0.1700 => 0.1817, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 6.78% (44.5605 => 47.5825, std.dev.: 1.1545) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.76% (6.3772 => 6.8080, std.dev.: 0.1463) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.43% (4.5327 => 4.8241, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.09% (4.9686 => 5.2711, std.dev.: 0.0421) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 5.85% (3.2169 => 3.4050, std.dev.: 0.0303) MultiSource/Applications/lambda-0_1_3/lambda: 5.47% (7.4933 => 7.9035, std.dev.: 0.0282) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.09% (6.2275 => 6.5444, std.dev.: 0.0115) MultiSource/Applications/siod/siod: 4.99% (3.6643 => 3.8470, std.dev.: 0.0519) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.91% (4.9469 => 5.1900, std.dev.: 0.0365) MultiSource/Applications/hexxagon/hexxagon: 4.18% (14.0064 => 14.5915, std.dev.: 0.1072) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.14% (4.9453 => 5.1502, std.dev.: 0.0139) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.43% (39.2082 => 40.5530, std.dev.: 0.1408) MultiSource/Benchmarks/Olden/bh/bh: 3.17% (2.3560 => 2.4307, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.89% (4.8660 => 5.0067, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.84% (0.3587 => 0.3689, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.75% (11.5690 => 11.8870, std.dev.: 0.0681) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.42% (8.2783 => 8.4784, std.dev.: 0.0171) SingleSource/Benchmarks/Misc/flops-6: 2.24% (2.4416 => 2.4964, std.dev.: 0.0024) MultiSource/Benchmarks/BitBench/five11/five11: 2.07% (5.6030 => 5.7192, std.dev.: 0.0266) SingleSource/Benchmarks/Misc/flops-5: 1.67% (2.8957 => 2.9442, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/flops-4: 1.48% (1.6531 => 1.6775, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/neural/neural: 1.37% (1.0841 => 1.0989, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.12% (3.5679 => 3.6077, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-8: 1.04% (2.5609 => 2.5875, std.dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -41.93% (2.8951 => 1.6811, std.dev.: 0.0223) MultiSource/Benchmarks/Olden/em3d/em3d: -19.75% (5.4641 => 4.3848, std.dev.: 0.1228) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.99% (7.2130 => 6.2761, std.dev.: 0.0903) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.74% (1.0512 => 0.9383, std.dev.: 0.0070) SingleSource/Benchmarks/McGill/chomp: -8.25% (1.1216 => 1.0291, std.dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: -8.20% (63.1822 => 58.0020, std.dev.: 0.1746) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.78% (4.7482 => 4.4265, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.81% (0.3269 => 0.3079, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.66% (14.6451 => 13.8166, std.dev.: 0.1210) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.55% (5.4972 => 5.1919, std.dev.: 0.0732) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.48% (3.7148 => 3.5113, std.dev.: 0.0340) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.94% (5.1557 => 4.9011, std.dev.: 0.0236) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.57% (2.8773 => 2.7458, std.dev.: 0.0300) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.98% (4.7449 => 4.5561, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.41% (6.0224 => 5.8172, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.29% (0.5807 => 0.5616, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.81% (11.5316 => 11.3224, std.dev.: 0.0746) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.50% (4.9994 => 4.9246, std.dev.: 0.0285) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 5.02% (1.0262 => 1.0777, std.dev.: 0.1876) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.15% (0.0408 => 0.0429, std.dev.: 0.0138) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 10.24% (0.0254 => 0.0280, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.97% (0.0302 => 0.0317, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0110) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0064) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0070) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 157.14% (0.0007 => 0.0018, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 1.04% (0.1438 => 0.1453, std.dev.: 0.0239) MultiSource/Applications/lemon/lemon: 3.21% (1.1329 => 1.1693, std.dev.: 0.4058) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.31% (0.4164 => 0.4385, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.31% (0.1369 => 0.1428, std.dev.: 0.0207) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.87% (0.0641 => 0.0653, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.56% (0.0195 => 0.0278, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.21% (0.0578 => 0.0585, std.dev.: 0.0172) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.50% (1.1437 => 1.1952, std.dev.: 0.0711) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1900.00% (0.0001 => 0.0020, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.71% (0.0627 => 0.0644, std.dev.: 0.0118) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 45.00% (0.0180 => 0.0261, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.71% (0.8017 => 0.7800, std.dev.: 0.0414) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 17.74% (0.0062 => 0.0073, std.dev.: 0.0051) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 17:17:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 19:17:04 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121128011704.6FD482A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6323?compare_to=6321&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6323, Order: 168741, Start Time: 2012-11-27 23:45:21, End Time: 2012-11-28 01:17:36 To: 6321, Order: 168723, Start Time: 2012-11-27 21:49:56, End Time: 2012-11-27 23:22:18 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (6 on baseline) Performance Improvements: 0 (185 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (851 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 13.77% (0.3834 => 0.4362, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.31% (1.2783 => 1.3717, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.78% (2.0478 => 2.1047, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.62% (54.5751 => 56.0050, std.dev.: 0.3533) SingleSource/Benchmarks/Misc/salsa20: 2.48% (7.4937 => 7.6797, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/hash2: 2.35% (3.1932 => 3.2683, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.67% (0.3821 => 0.3528, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: -6.94% (0.3831 => 0.3565, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: -6.93% (0.3880 => 0.3611, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.91% (0.9542 => 0.8883, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -6.90% (0.3812 => 0.3549, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: -6.85% (0.3896 => 0.3629, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: -6.78% (0.3848 => 0.3587, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.74% (0.4033 => 0.3761, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -6.63% (0.4176 => 0.3899, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -6.47% (2.4924 => 2.3311, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: -6.41% (0.4199 => 0.3930, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.39% (0.3884 => 0.3636, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.34% (0.2428 => 0.2274, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.32% (0.3357 => 0.3145, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.25% (0.3891 => 0.3648, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.16% (0.2355 => 0.2210, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -6.14% (0.4280 => 0.4017, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.09% (0.6484 => 0.6089, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -6.06% (0.2160 => 0.2029, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.96% (1.0544 => 0.9916, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: -5.93% (16.1920 => 15.2317, std.dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: -5.91% (9.2283 => 8.6826, std.dev.: 0.0128) MultiSource/Applications/JM/ldecod/ldecod: -5.87% (7.0961 => 6.6796, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.82% (0.3658 => 0.3445, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.71% (0.9852 => 0.9289, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.71% (0.2695 => 0.2541, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -5.70% (0.9179 => 0.8656, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/ReedSolomon: -5.69% (0.1879 => 0.1772, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.68% (1.3722 => 1.2942, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.68% (4.8161 => 4.5425, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/chomp: -5.68% (0.1761 => 0.1661, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.67% (0.5857 => 0.5525, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.64% (4.0323 => 3.8047, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.64% (1.2300 => 1.1606, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.64% (0.5478 => 0.5169, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.61% (0.6667 => 0.6293, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.60% (0.5591 => 0.5278, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.60% (6.7716 => 6.3926, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.56% (0.5863 => 0.5537, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.55% (0.5925 => 0.5596, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.55% (0.5859 => 0.5534, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.54% (0.6052 => 0.5717, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.52% (0.5849 => 0.5526, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.50% (0.6304 => 0.5957, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.50% (0.5802 => 0.5483, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.49% (0.7919 => 0.7484, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.49% (0.6230 => 0.5888, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.47% (4.8802 => 4.6131, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.47% (0.8521 => 0.8055, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.45% (0.6260 => 0.5919, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.45% (3.5339 => 3.3414, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.44% (1.6364 => 1.5473, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.44% (0.6660 => 0.6298, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -5.43% (4.3330 => 4.0977, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.43% (0.5805 => 0.5490, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -5.42% (1.1530 => 1.0905, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.42% (0.6293 => 0.5952, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.42% (0.6736 => 0.6371, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.42% (0.5705 => 0.5396, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.41% (0.5581 => 0.5279, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.40% (0.5570 => 0.5269, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.40% (0.5941 => 0.5620, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.40% (0.6297 => 0.5957, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.38% (1.2784 => 1.2096, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.38% (0.5575 => 0.5275, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.37% (0.6446 => 0.6100, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -5.34% (1.1450 => 1.0839, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: -5.32% (0.3025 => 0.2864, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.32% (0.3931 => 0.3722, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.32% (8.0126 => 7.5866, std.dev.: 0.0065) MultiSource/Applications/hexxagon/hexxagon: -5.31% (1.3148 => 1.2450, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: -5.31% (1.3864 => 1.3128, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.31% (0.7198 => 0.6816, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.30% (0.6194 => 0.5866, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.29% (0.4916 => 0.4656, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.28% (4.5069 => 4.2688, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.28% (14.2083 => 13.4581, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.27% (0.2999 => 0.2841, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -5.27% (0.2659 => 0.2519, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.24% (0.3016 => 0.2858, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.22% (0.2278 => 0.2159, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.22% (0.5456 => 0.5171, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -5.22% (0.3255 => 0.3085, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.21% (0.6676 => 0.6328, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.21% (0.3323 => 0.3150, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.20% (0.5688 => 0.5392, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.19% (1.4642 => 1.3882, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.18% (2.1713 => 2.0588, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.18% (0.2548 => 0.2416, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.17% (0.3057 => 0.2899, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.15% (0.6189 => 0.5870, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.14% (0.4321 => 0.4099, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.13% (0.3194 => 0.3030, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/fibo: -5.12% (0.2871 => 0.2724, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.12% (0.4515 => 0.4284, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.12% (0.2385 => 0.2263, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.11% (0.6440 => 0.6111, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.11% (0.3837 => 0.3641, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.10% (1.2210 => 1.1587, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: -5.09% (0.2985 => 0.2833, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -5.09% (17.1032 => 16.2324, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/except: -5.09% (0.3026 => 0.2872, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -5.08% (1.2515 => 1.1879, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference-object: -5.08% (0.6441 => 0.6114, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.07% (1.2221 => 1.1602, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.06% (0.4151 => 0.3941, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: -5.05% (15.5079 => 14.7247, std.dev.: 0.0065) MultiSource/Benchmarks/sim/sim: -5.05% (0.3406 => 0.3234, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.05% (0.4813 => 0.4570, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.05% (0.2933 => 0.2785, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.04% (0.6033 => 0.5729, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -5.04% (0.2939 => 0.2791, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.00% (0.5999 => 0.5699, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.00% (0.3483 => 0.3309, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: -4.99% (0.3446 => 0.3274, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.99% (0.7779 => 0.7391, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: -4.98% (0.2989 => 0.2840, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.96% (0.2903 => 0.2759, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: -4.95% (3.5154 => 3.3413, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.95% (0.3252 => 0.3091, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -4.95% (0.3394 => 0.3226, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.93% (0.6347 => 0.6034) SingleSource/Benchmarks/Shootout-C++/wc: -4.93% (0.3205 => 0.3047, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -4.88% (0.3481 => 0.3311, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.88% (0.5168 => 0.4916, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -4.85% (0.4861 => 0.4625, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -4.84% (0.2849 => 0.2711, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -4.84% (4.0594 => 3.8630, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (0.6681 => 0.6358, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/18-imp/imp: -4.78% (0.3581 => 0.3410, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.75% (0.6395 => 0.6091, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -4.74% (0.3059 => 0.2914, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -4.73% (0.7447 => 0.7095, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -4.72% (15.2527 => 14.5330, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/lists: -4.69% (0.3621 => 0.3451, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -4.66% (0.4248 => 0.4050, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.65% (0.7339 => 0.6998, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.64% (0.7524 => 0.7175, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: -4.60% (0.3867 => 0.3689, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -4.58% (0.4524 => 0.4317, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -4.50% (2.4021 => 2.2939, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.48% (1.6474 => 1.5736, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.47% (0.5569 => 0.5320, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.46% (0.3319 => 0.3171, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.46% (0.4083 => 0.3901, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.46% (0.9557 => 0.9131, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: -4.43% (34.0927 => 32.5815, std.dev.: 0.0238) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.42% (0.3849 => 0.3679, std.dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: -4.40% (5.0226 => 4.8018, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: -4.36% (2.1401 => 2.0467, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.36% (0.4427 => 0.4234, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.36% (0.7021 => 0.6715, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -4.35% (18.2933 => 17.4975, std.dev.: 0.0092) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.34% (22.4056 => 21.4337, std.dev.: 0.0140) MultiSource/Applications/lambda-0_1_3/lambda: -4.33% (0.7982 => 0.7636, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.33% (0.5567 => 0.5326, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.32% (0.6395 => 0.6119, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.26% (0.9077 => 0.8690, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: -4.22% (0.3788 => 0.3628, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (0.5329 => 0.5108, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.07% (0.3271 => 0.3138, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.05% (0.8418 => 0.8077, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -3.99% (0.6750 => 0.6481, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.72% (2.2587 => 2.1747, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.67% (0.3491 => 0.3363, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -3.66% (1.5610 => 1.5039, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.14% (5.4682 => 5.2967, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -2.44% (20.7746 => 20.2677, std.dev.: 0.0278) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.51% (31.3723 => 10.1920, std.dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/fldry: -62.03% (1.8100 => 0.6872, std.dev.: 0.0071) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7533, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -8.63% (1.2842 => 1.1734, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fbench: -3.77% (2.2633 => 2.1780, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3995, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4699, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 17:22:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 19:22:58 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121128012258.C85672A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6324?compare_to=6318&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6324, Order: 168731, Start Time: 2012-11-27 23:05:25, End Time: 2012-11-28 01:23:28 To: 6318, Order: 168716, Start Time: 2012-11-27 19:54:20, End Time: 2012-11-27 22:12:34 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 15 (136 on baseline) Performance Improvements: 3 (42 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1068 (707 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel09: 10.15% (0.1064 => 0.1172, std.dev.: 0.0002) SingleSource/Benchmarks/LivermoreLoops/kernel08: 9.12% (0.1239 => 0.1352, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (0.6880 => 0.7481, std.dev.: 0.0211) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.06% (0.5805 => 0.6273, std.dev.: 0.0130) MultiSource/Applications/treecc/treecc: 7.19% (2.2808 => 2.4447, std.dev.: 0.0574) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.10% (0.8996 => 0.9635, std.dev.: 0.0225) MultiSource/Benchmarks/nbench/nbench: 6.87% (1.3285 => 1.4198, std.dev.: 0.0342) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.6650 => 0.7039, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/oourafft: 5.41% (0.3589 => 0.3783, std.dev.: 0.0053) SingleSource/UnitTests/ObjC++/Hello: 4.08% (0.6758 => 0.7034, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/synchronized: 3.70% (0.4134 => 0.4287, std.dev.: 0.0028) MultiSource/Applications/spiff/spiff: 3.65% (0.9496 => 0.9843, std.dev.: 0.0105) SingleSource/UnitTests/ObjC++/property-reference-object: 3.17% (0.6912 => 0.7131, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.80% (4.7110 => 4.7956, std.dev.: 0.0292) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.79% (3.0441 => 3.0987, std.dev.: 0.0083) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -12.99% (0.7681 => 0.6683, std.dev.: 0.0385) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.63% (12.6152 => 11.9048, std.dev.: 0.2710) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/oourafft: -1.11% (7.8062 => 7.7196, std.dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.15% (69.4246 => 69.3185, std.dev.: 0.2106) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.07% (0.1338 => 0.1337, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0420 => 0.0419, std.dev.: 0.0077) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.83% (0.0652 => 0.0677, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -0.00% (494.0110 => 494.0044, std.dev.: 0.0736) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.61% (63.2438 => 69.3185, std.dev.: 0.2106) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0419, std.dev.: 0.0077) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43706.37% (1.1277 => 494.0044, std.dev.: 0.0736) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 217.98% (0.5229 => 1.6627, std.dev.: 0.0469) MultiSource/Applications/SPASS/SPASS: 19.24% (14.9895 => 17.8742, std.dev.: 0.2050) MultiSource/Applications/kimwitu++/kc: 46.37% (14.1553 => 20.7195, std.dev.: 0.7009) MultiSource/Benchmarks/MallocBench/gs/gs: 20.72% (4.1105 => 4.9624, std.dev.: 0.1682) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 43.58% (1.1048 => 1.5863, std.dev.: 0.0386) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 431.96% (7.1582 => 38.0790, std.dev.: 0.2608) SingleSource/Benchmarks/Misc-C++-EH/spirit: 96.72% (3.4629 => 6.8123, std.dev.: 0.1369) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.73% (0.6222 => 1.0312, std.dev.: 0.0594) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10461.81% (0.0720 => 7.6045, std.dev.: 0.3380) MultiSource/Applications/SIBsim4/SIBsim4: 3857600.00% (0.0001 => 3.8577, std.dev.: 0.0327) MultiSource/Applications/SPASS/SPASS: 14558600.00% (0.0001 => 14.5587, std.dev.: 1.2200) MultiSource/Applications/kimwitu++/kc: 52100.00% (0.0001 => 0.0522, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 64000.00% (0.0001 => 0.0641, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14400.00% (0.0001 => 0.0145, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576700.00% (0.0001 => 0.5768, std.dev.: 0.0283) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10086200.00% (0.0001 => 10.0863, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5676000.00% (0.0001 => 5.6761, std.dev.: 0.3602) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1762.84% (1.1194 => 20.8526, std.dev.: 0.4566) MultiSource/Applications/ClamAV/clamscan: 67.01% (22.1758 => 37.0362, std.dev.: 0.5211) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 59.76% (2.9384 => 4.6943, std.dev.: 0.2656) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 50.86% (7.0540 => 10.6414, std.dev.: 0.4412) MultiSource/Applications/JM/lencod/lencod: 47.22% (21.9371 => 32.2950, std.dev.: 0.0700) SingleSource/Benchmarks/CoyoteBench/almabench: 46.99% (0.0730 => 0.1073, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.32% (8.1363 => 11.9048, std.dev.: 0.2710) MultiSource/Benchmarks/FreeBench/distray/distray: 44.32% (0.1056 => 0.1524, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops: 36.80% (0.1432 => 0.1959, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 29.86% (2.2024 => 2.8601, std.dev.: 0.0290) SingleSource/UnitTests/vla: 29.86% (0.0355 => 0.0461, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.49% (0.1125 => 0.1423, std.dev.: 0.0042) MultiSource/Benchmarks/NPB-serial/is/is: 26.29% (0.0719 => 0.0908, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 26.09% (0.0437 => 0.0551, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 26.04% (1.5859 => 1.9989, std.dev.: 0.0333) MultiSource/Applications/spiff/spiff: 25.63% (0.7835 => 0.9843, std.dev.: 0.0105) SingleSource/Benchmarks/Dhrystone/fldry: 24.95% (0.0481 => 0.0601, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 24.55% (0.0953 => 0.1187, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 24.16% (0.4048 => 0.5026, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 23.98% (0.4620 => 0.5728, std.dev.: 0.0134) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.86% (0.0746 => 0.0924, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/Oscar: 23.43% (0.0636 => 0.0785, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 22.88% (0.5105 => 0.6273, std.dev.: 0.0130) SingleSource/Benchmarks/Misc-C++/Large/ray: 22.32% (0.4064 => 0.4971, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/parameter-passing: 22.31% (0.3927 => 0.4803, std.dev.: 0.0161) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 21.82% (0.0793 => 0.0966, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/fftbench: 21.70% (0.4636 => 0.5642, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/random: 21.70% (0.2802 => 0.3410, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 21.69% (1.0722 => 1.3048, std.dev.: 0.0272) SingleSource/Benchmarks/Shootout-C++/heapsort: 21.66% (0.2872 => 0.3494, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.46% (0.1566 => 0.1902, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/lists: 21.39% (0.3422 => 0.4154, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/whetstone: 21.36% (0.0660 => 0.0801, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.32% (0.2758 => 0.3346, std.dev.: 0.0142) SingleSource/UnitTests/Vector/SSE/sse_isamax: 20.88% (0.0704 => 0.0851, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.83% (0.1584 => 0.1914, std.dev.: 0.0105) SingleSource/UnitTests/ObjC/trivial-interface: 20.76% (0.3473 => 0.4194, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/hello: 20.74% (0.2714 => 0.3277, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/nestedloop: 20.66% (0.2793 => 0.3370, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 20.61% (0.0592 => 0.0714, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 20.59% (2.0273 => 2.4447, std.dev.: 0.0574) MultiSource/Applications/sgefa/sgefa: 20.42% (0.3109 => 0.3744, std.dev.: 0.0084) SingleSource/UnitTests/ObjC/synchronized: 20.39% (0.3561 => 0.4287, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/tsp/tsp: 20.34% (0.1175 => 0.1414, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.12% (0.5860 => 0.7039, std.dev.: 0.0151) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 20.09% (1.5415 => 1.8512, std.dev.: 0.0471) SingleSource/Benchmarks/Shootout-C++/reversefile: 19.97% (0.3865 => 0.4637, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/objinst: 19.96% (0.3131 => 0.3756, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 19.92% (1.1840 => 1.4198, std.dev.: 0.0342) SingleSource/UnitTests/ObjC/property: 19.76% (0.3886 => 0.4654, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.44% (0.8067 => 0.9635, std.dev.: 0.0225) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 18.92% (0.1337 => 0.1590, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference: 18.82% (0.7326 => 0.8705, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.78% (0.2700 => 0.3207, std.dev.: 0.0155) SingleSource/UnitTests/ObjC++/Hello: 18.72% (0.5925 => 0.7034, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/sieve: 18.68% (0.3603 => 0.4276, std.dev.: 0.0090) SingleSource/UnitTests/ObjC++/property-reference-object: 18.26% (0.6030 => 0.7131, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.46% (0.0842 => 0.0989, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/17-bintr/bintr: 17.04% (0.0675 => 0.0790, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/lists: 16.93% (0.0626 => 0.0732, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.78% (4.9449 => 5.7745, std.dev.: 0.1494) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.77% (0.3441 => 0.4018, std.dev.: 0.0188) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.76% (0.0871 => 0.1017, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.67% (14.3668 => 16.7614, std.dev.: 0.7113) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.43% (0.0834 => 0.0971, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.31% (0.8172 => 0.9505, std.dev.: 0.0319) MultiSource/Benchmarks/Olden/mst/mst: 15.99% (0.1163 => 0.1349, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/em3d/em3d: 15.93% (0.1695 => 0.1965, std.dev.: 0.0096) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.91% (0.0886 => 0.1027, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/matrix: 15.89% (0.0818 => 0.0948, std.dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.89% (0.3121 => 0.3617, std.dev.: 0.0162) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.74% (0.0648 => 0.0750, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: 15.49% (0.3092 => 0.3571, std.dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 15.48% (0.1906 => 0.2201, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.40% (0.2065 => 0.2383, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 15.38% (3.8922 => 4.4908, std.dev.: 0.2301) MultiSource/Applications/sqlite3/sqlite3: 15.28% (17.1811 => 19.8070, std.dev.: 0.4490) SingleSource/Benchmarks/Misc/oourafft: 15.27% (0.3282 => 0.3783, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.19% (0.0770 => 0.0887, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/health/health: 15.14% (0.1268 => 0.1460, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.04% (0.1117 => 0.1285, std.dev.: 0.0028) MultiSource/Applications/aha/aha: 15.03% (0.1151 => 0.1324, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.94% (0.0770 => 0.0885, std.dev.: 0.0033) MultiSource/Applications/viterbi/viterbi: 14.73% (0.1555 => 0.1784, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.52% (0.2107 => 0.2413, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.51% (0.5981 => 0.6849, std.dev.: 0.0217) SingleSource/Benchmarks/McGill/exptree: 14.37% (0.0814 => 0.0931, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/ffbench: 14.18% (0.0705 => 0.0805, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.82% (0.3935 => 0.4479, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.78% (0.0798 => 0.0908, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: 13.78% (0.1655 => 0.1883, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/18-imp/imp: 13.76% (0.3423 => 0.3894, std.dev.: 0.0178) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.75% (0.1062 => 0.1208, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.51% (0.1510 => 0.1714, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.51% (0.1029 => 0.1168, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.20% (0.8101 => 0.9089, std.dev.: 0.0343) MultiSource/Benchmarks/McCat/05-eks/eks: 11.44% (0.4299 => 0.4791, std.dev.: 0.0185) SingleSource/UnitTests/ObjC/exceptions-3: 11.29% (0.3516 => 0.3913, std.dev.: 0.0151) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.15% (0.1892 => 0.2103, std.dev.: 0.0081) MultiSource/Benchmarks/PAQ8p/paq8p: 11.15% (10.3673 => 11.5232, std.dev.: 0.2519) SingleSource/Benchmarks/Stanford/Puzzle: 10.41% (0.1268 => 0.1400, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists1: 10.40% (0.3684 => 0.4067, std.dev.: 0.0133) SingleSource/UnitTests/SignlessTypes/rem: 10.14% (0.1144 => 0.1260, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.92% (4.3953 => 11.0289, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/methcall: 147.56% (5.3999 => 13.3682, std.dev.: 0.0101) SingleSource/UnitTests/ObjC/synchronized: 47.57% (0.1051 => 0.1551, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout/ary3: 27.12% (3.6994 => 4.7026, std.dev.: 0.0499) SingleSource/Benchmarks/CoyoteBench/fftbench: 25.06% (2.0360 => 2.5462, std.dev.: 0.1568) SingleSource/Benchmarks/CoyoteBench/lpbench: 23.30% (10.3460 => 12.7562, std.dev.: 0.0545) SingleSource/Benchmarks/Shootout-C++/moments: 22.26% (0.1159 => 0.1417, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.58% (1.1145 => 1.2993, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/oourafft: 16.15% (6.6465 => 7.7196, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: 15.23% (3.1578 => 3.6387, std.dev.: 0.0111) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.94% (0.2944 => 0.3325, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/heapsort: 12.40% (3.8532 => 4.3310, std.dev.: 0.0232) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.64% (2.8904 => 3.2269, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 10.18% (1.1396 => 1.2556, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 9.85% (0.9505 => 1.0441, std.dev.: 0.0094) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.55% (1.7254 => 1.8901, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 6.29% (0.7455 => 0.7924, std.dev.: 0.0108) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 5.89% (26.0924 => 27.6304, std.dev.: 0.0230) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.76% (4.2280 => 4.4717, std.dev.: 0.0067) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 3.99% (11.6436 => 12.1081, std.dev.: 0.0204) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.34% (0.4162 => 0.4301, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970) MultiSource/Applications/aha/aha: 2.06% (3.1595 => 3.2245, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 1.70% (85.0658 => 86.5151, std.dev.: 0.1719) SingleSource/Benchmarks/Shootout-C++/ackermann: 1.62% (1.7133 => 1.7410, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.20% (6.5088 => 6.5870, std.dev.: 0.0148) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0499, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.2139 => 5.2747, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fbench: 1.05% (2.2771 => 2.3009, std.dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1675, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.94% (5.2763 => 1.2169, std.dev.: 0.0469) SingleSource/Benchmarks/Misc/salsa20: -75.70% (0.8651 => 0.2102, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/richards_benchmark: -44.76% (0.1622 => 0.0896, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.24% (5.3855 => 4.6726, std.dev.: 0.1604) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.33% (5.3526 => 4.6927, std.dev.: 0.1454) MultiSource/Applications/JM/ldecod/ldecod: -7.51% (10.4361 => 9.6520, std.dev.: 0.1447) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -68.59% (32.5116 => 10.2129, std.dev.: 0.0235) SingleSource/Benchmarks/Dhrystone/fldry: -65.76% (1.9577 => 0.6703, std.dev.: 0.0112) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1682, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.52% (0.0628 => 0.0361, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.33% (0.3987 => 0.2379, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.33% (4.5009 => 2.7757, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.16% (2.6546 => 2.0132, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: -19.11% (0.2161 => 0.1748, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4240, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2840, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -10.62% (1.5373 => 1.3740, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -10.27% (9.5636 => 8.5812, std.dev.: 0.1830) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.03% (1.5660 => 1.4246, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.69% (3.2416 => 3.0572, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.14% (0.8614 => 0.8171, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.09% (0.2497 => 0.2370, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -4.66% (1.5835 => 1.5097, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.54% (1.6805 => 1.6042, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout/lists: -4.27% (6.2999 => 6.0311, std.dev.: 0.0090) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.68% (19.9488 => 19.2144, std.dev.: 0.0872) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.29% (0.9957 => 0.9629, std.dev.: 0.0085) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8914, std.dev.: 0.0050) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.23% (0.4808 => 0.4701, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.13% (1.3861 => 1.3566, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.73% (8.1563 => 8.0148, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/salsa20: -1.50% (10.2830 => 10.1285, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.97% (0.1485 => 0.1337, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.01% (0.2116 => 0.0677, std.dev.: 0.0006) Report Time: 3.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 18:33:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 20:33:06 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121128023306.F3B4C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6325?compare_to=6322&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6325, Order: 168752, Start Time: 2012-11-28 00:59:33, End Time: 2012-11-28 02:33:39 To: 6322, Order: 168735, Start Time: 2012-11-27 23:03:31, End Time: 2012-11-28 00:40:09 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 2 (1 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 31 (53 on baseline) Performance Improvements: 68 (36 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 39 (40 on baseline) Unchanged Tests: 952 (884 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/fftbench: 0.51% (0.3740 => 0.3759, std.dev.: 0.0104) New Failures - Execution Time ----------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (1.5890 => 0.0000, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.24% (1.2947 => 1.3367, std.dev.: 0.0138) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel12: 31.28% (0.1298 => 0.1704, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 23.65% (3.0041 => 3.7147, std.dev.: 0.0489) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.77% (4.8632 => 5.8732, std.dev.: 0.0780) SingleSource/Benchmarks/LivermoreLoops/kernel13: 16.81% (0.1808 => 0.2112, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/misr: 16.17% (0.4056 => 0.4712, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 15.09% (8.4784 => 9.7581, std.dev.: 0.0102) SingleSource/Benchmarks/Stanford/Puzzle: 9.58% (0.1576 => 0.1727, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/em3d/em3d: 9.04% (4.3848 => 4.7813, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 7.79% (0.3851 => 0.4151, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.36% (23.5876 => 25.3241, std.dev.: 0.1270) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.51% (5.1919 => 5.5301, std.dev.: 0.0248) SingleSource/Benchmarks/Shootout/nestedloop: 6.02% (0.1960 => 0.2078, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.79% (5.4193 => 5.7330, std.dev.: 0.0804) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.25% (5.3236 => 5.6031, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.92% (0.5199 => 0.5455, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 4.43% (7.9035 => 8.2535, std.dev.: 0.0371) MultiSource/Applications/aha/aha: 4.24% (3.3661 => 3.5087, std.dev.: 0.0482) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 3.11% (0.4432 => 0.4570, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.39% (5.8172 => 5.9563, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/hash2: 2.31% (3.3499 => 3.4274, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.26% (3.4059 => 3.4830, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.22% (11.3224 => 11.5738, std.dev.: 0.0442) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.13% (6.8080 => 6.9530, std.dev.: 0.0429) MultiSource/Benchmarks/Olden/power/power: 2.06% (1.2240 => 1.2492, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 1.91% (0.5616 => 0.5723, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.81% (4.9011 => 4.9896, std.dev.: 0.0292) SingleSource/Benchmarks/Shootout/methcall: 1.73% (8.2548 => 8.3979, std.dev.: 0.0213) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.13% (4.4265 => 4.4766, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.07% (1.9309 => 1.9516, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.03% (3.5486 => 3.5850, std.dev.: 0.0086) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/SignlessTypes/shr: -38.48% (0.0434 => 0.0267, std.dev.: 0.0038) SingleSource/Benchmarks/LivermoreLoops/kernel03: -36.82% (0.1643 => 0.1038, std.dev.: 0.0092) SingleSource/Benchmarks/LivermoreLoops/kernel16: -31.04% (0.1675 => 0.1155, std.dev.: 0.0036) MultiSource/Applications/aha/aha: -21.96% (0.1503 => 0.1173, std.dev.: 0.0037) SingleSource/Benchmarks/LivermoreLoops/kernel10: -19.88% (0.1353 => 0.1084, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: -18.16% (1.6065 => 1.3147, std.dev.: 0.0538) MultiSource/Applications/treecc/treecc: -17.08% (2.5692 => 2.1303, std.dev.: 0.1299) SingleSource/Benchmarks/LivermoreLoops/kernel19: -16.36% (0.1296 => 0.1084, std.dev.: 0.0013) SingleSource/Benchmarks/LivermoreLoops/kernel01: -12.86% (0.1221 => 0.1064, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: -12.28% (17.1629 => 15.0548, std.dev.: 0.3576) MultiSource/Applications/d/make_dparser: -11.45% (3.7897 => 3.3559, std.dev.: 0.0607) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -8.25% (0.1321 => 0.1212, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: -5.08% (9.4558 => 8.9752, std.dev.: 0.0691) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.24% (4.5426 => 4.3956, std.dev.: 0.0317) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel16: -34.68% (0.0741 => 0.0484, std.dev.: 0.0020) SingleSource/Benchmarks/LivermoreLoops/kernel02: -32.94% (0.0513 => 0.0344, std.dev.: 0.0060) SingleSource/Benchmarks/LivermoreLoops/kernel08: -23.14% (0.3569 => 0.2743, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.25% (1.4529 => 1.1587, std.dev.: 0.0012) SingleSource/Benchmarks/LivermoreLoops/kernel21: -20.19% (1.2411 => 0.9905, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.21% (9.8339 => 8.2397, std.dev.: 0.0259) SingleSource/Benchmarks/LivermoreLoops/kernel06: -16.07% (0.4494 => 0.3772, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -13.41% (3.4050 => 2.9484, std.dev.: 0.1204) SingleSource/Benchmarks/Misc/pi: -13.24% (2.4840 => 2.1550, std.dev.: 0.0291) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.84% (6.2761 => 5.5333, std.dev.: 0.2618) SingleSource/Benchmarks/LivermoreLoops/kernel01: -11.65% (0.2557 => 0.2259, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: -10.58% (2.5875 => 2.3137, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -10.22% (5.6091 => 5.0361, std.dev.: 0.0473) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.08% (2.8699 => 2.5806, std.dev.: 0.0258) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -9.72% (6.5444 => 5.9086, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -9.31% (3.4699 => 3.1467, std.dev.: 0.0310) SingleSource/Benchmarks/Shootout-C++/ary3: -9.19% (2.0013 => 1.8173, std.dev.: 0.0516) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -8.78% (5.2711 => 4.8085, std.dev.: 0.0279) MultiSource/Applications/siod/siod: -8.27% (3.8470 => 3.5288, std.dev.: 0.0865) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -7.99% (5.1502 => 4.7388, std.dev.: 0.0249) SingleSource/Regression/C/uint64_to_float: -7.67% (1.6618 => 1.5344, std.dev.: 0.0067) SingleSource/Benchmarks/Stanford/FloatMM: -7.57% (0.8984 => 0.8304, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -7.25% (5.0952 => 4.7256, std.dev.: 0.0447) SingleSource/Benchmarks/Shootout/sieve: -6.09% (7.0557 => 6.6257, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.90% (5.1425 => 4.8390, std.dev.: 0.0600) SingleSource/Benchmarks/Misc/ffbench: -5.72% (1.4121 => 1.3313, std.dev.: 0.0275) SingleSource/Benchmarks/Misc/flops: -5.48% (9.3745 => 8.8612, std.dev.: 0.0556) SingleSource/Benchmarks/McGill/queens: -5.21% (1.8348 => 1.7392, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.68% (6.1953 => 5.9056, std.dev.: 0.0520) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.34% (5.6056 => 5.3622, std.dev.: 0.0249) SingleSource/Benchmarks/LivermoreLoops/kernel20: -4.26% (3.2325 => 3.0947, std.dev.: 0.0045) SingleSource/Benchmarks/LivermoreLoops/kernel14: -4.15% (5.3989 => 5.1747, std.dev.: 0.0169) MultiSource/Applications/JM/lencod/lencod: -3.98% (6.8813 => 6.6073, std.dev.: 0.0643) SingleSource/Benchmarks/Misc/perlin: -3.91% (5.1151 => 4.9153, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/flops-6: -3.55% (2.4964 => 2.4078, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.17% (40.5530 => 39.2662, std.dev.: 0.3159) SingleSource/Benchmarks/Misc/flops-5: -2.98% (2.9442 => 2.8565, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.95% (5.1900 => 5.0367, std.dev.: 0.0292) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -2.85% (3.6077 => 3.5050, std.dev.: 0.0269) MultiSource/Benchmarks/FreeBench/neural/neural: -2.79% (1.0989 => 1.0682, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -2.75% (5.4061 => 5.2575, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/fbench: -2.67% (3.3904 => 3.2999, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.3944 => 1.3646, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.97% (1.1651 => 1.1422, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: -1.91% (8.8216 => 8.6531, std.dev.: 0.0468) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.88% (1.2749 => 1.2509, std.dev.: 0.0082) MultiSource/Benchmarks/BitBench/five11/five11: -1.84% (5.7192 => 5.6138, std.dev.: 0.0396) SingleSource/Benchmarks/Shootout/lists: -1.78% (7.5130 => 7.3793, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (15.8922 => 15.6281, std.dev.: 0.0278) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.57% (1.5329 => 1.5088, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.51% (5.1476 => 5.0700, std.dev.: 0.0206) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.46% (4.5478 => 4.4815, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.45% (3.3343 => 3.2859, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.22% (4.0820 => 4.0320, std.dev.: 0.0174) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.93% (1.0777 => 1.0985, std.dev.: 0.2617) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.45% (0.0220 => 0.0221, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0429 => 0.0430, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 18.57% (0.0280 => 0.0332, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.26% (0.0317 => 0.0313, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0425 => 0.0427, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0205 => 0.0206, std.dev.: 0.0064) SingleSource/UnitTests/Vector/Altivec/test1: 1.37% (0.0219 => 0.0222, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -27.78% (0.0018 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 3.37% (0.1453 => 0.1502, std.dev.: 0.0232) MultiSource/Applications/lemon/lemon: 2.32% (1.1693 => 1.1964, std.dev.: 0.3854) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.29% (0.4385 => 0.4109, std.dev.: 0.0413) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.89% (0.1428 => 0.1455, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.44% (0.0653 => 0.0624, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.72% (0.0278 => 0.0276, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.34% (0.0585 => 0.0583, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -2.73% (1.1952 => 1.1626, std.dev.: 0.0247) MultiSource/Benchmarks/SciMark2-C/scimark2: -0.93% (9.4729 => 9.3851, std.dev.: 0.0265) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 45.00% (0.0020 => 0.0029, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.37% (0.0644 => 0.0603, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.38% (0.0261 => 0.0260, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 2.74% (0.7800 => 0.8014, std.dev.: 0.0117) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -9.59% (0.0073 => 0.0066, std.dev.: 0.0051) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/SciMark2-C/scimark2: -67.16% (28.5821 => 9.3851, std.dev.: 0.0265) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.86% (16.4461 => 17.9025, std.dev.: 1.0946) MultiSource/Applications/sqlite3/sqlite3: 2337.10% (0.6332 => 15.4317, std.dev.: 1.0963) MultiSource/Benchmarks/McCat/08-main/main: 51.28% (0.1831 => 0.2770, std.dev.: 0.0909) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.94% (0.1559 => 0.1482, std.dev.: 0.0062) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7426.67% (0.3123 => 23.5058, std.dev.: 0.2624) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1536.81% (0.3344 => 5.4735, std.dev.: 0.2973) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.94% (0.2364 => 0.3261, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/bigfib: 5.69% (0.6010 => 0.6352, std.dev.: 0.0166) SingleSource/Benchmarks/Misc/mandel: 4.43% (0.0429 => 0.0448, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.58% (0.3266 => 0.3481, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/strcat: 6.15% (0.1969 => 0.2090, std.dev.: 0.0667) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.12% (0.0224 => 0.0231, std.dev.: 0.0012) SingleSource/UnitTests/byval-alignment: -29.57% (0.0230 => 0.0162, std.dev.: 0.0024) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0520, std.dev.: 0.0066) MultiSource/Applications/oggenc/oggenc: 14.98% (0.1462 => 0.1681, std.dev.: 0.0232) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4046, std.dev.: 0.1287) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0727, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4893, std.dev.: 0.0079) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5269, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2727, std.dev.: 0.0475) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0700, std.dev.: 0.0206) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3617, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3787, std.dev.: 0.1507) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0830, std.dev.: 0.0047) SingleSource/Regression/C/uint64_to_float: -29.72% (2.1832 => 1.5344, std.dev.: 0.0067) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0008, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.61% (0.8321 => 0.9204, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.47% (0.1425 => 0.1560, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.87% (0.1983 => 0.2139, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.21% (0.1885 => 0.2021, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.00% (1.6386 => 1.7533, std.dev.: 0.0223) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.80% (1.1685 => 1.2479, std.dev.: 0.0144) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.71% (1.2526 => 1.3367, std.dev.: 0.0138) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.80% (0.2378 => 0.2516, std.dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 5.34% (1.1271 => 1.1873, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.25% (4.1763 => 4.3956, std.dev.: 0.0317) SingleSource/Benchmarks/Shootout-C++/ary3: 5.07% (0.2427 => 0.2550, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.16% (4.4873 => 4.6740, std.dev.: 0.0403) MultiSource/Benchmarks/mafft/pairlocalalign: 4.06% (8.6247 => 8.9752, std.dev.: 0.0691) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.98% (0.3717 => 0.3865, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.62% (0.2844 => 0.2947, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: 3.46% (0.3645 => 0.3771, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 36.44% (1.5795 => 2.1550, std.dev.: 0.0291) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 27.67% (2.9096 => 3.7147, std.dev.: 0.0489) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 21.78% (0.0528 => 0.0643, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.26% (4.8436 => 5.8732, std.dev.: 0.0780) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.88% (8.2783 => 9.7581, std.dev.: 0.0102) SingleSource/Benchmarks/McGill/misr: 17.77% (0.4001 => 0.4712, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.97% (0.7597 => 0.8886, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.65% (2.7995 => 3.1256, std.dev.: 0.0582) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.05% (0.3186 => 0.3538, std.dev.: 0.0083) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.36% (0.1129 => 0.1246, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.21% (1.1857 => 1.3068, std.dev.: 0.0183) MultiSource/Applications/lambda-0_1_3/lambda: 10.15% (7.4933 => 8.2535, std.dev.: 0.0371) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.03% (6.3772 => 6.9530, std.dev.: 0.0429) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.41% (23.5781 => 25.3241, std.dev.: 0.1270) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 6.39% (4.8660 => 5.1771, std.dev.: 0.0793) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.19% (3.3761 => 3.5850, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.86% (4.5327 => 4.7983, std.dev.: 0.0326) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.80% (5.4187 => 5.7330, std.dev.: 0.0804) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.76% (2.9753 => 3.1467, std.dev.: 0.0310) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.44% (0.3937 => 0.4151, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.29% (5.3218 => 5.6031, std.dev.: 0.0124) MultiSource/Applications/aha/aha: 5.06% (3.3398 => 3.5087, std.dev.: 0.0482) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 4.99% (0.4353 => 0.4570, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: 4.67% (1.3037 => 1.3646, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.62% (0.5214 => 0.5455, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 3.57% (1.2061 => 1.2492, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.34% (4.8362 => 4.9976, std.dev.: 0.0424) MultiSource/Benchmarks/PAQ8p/paq8p: 2.51% (91.7701 => 94.0777, std.dev.: 0.7514) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.13% (3.4104 => 3.4830, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.99% (11.5690 => 11.7990, std.dev.: 0.0354) SingleSource/Benchmarks/McGill/queens: 1.97% (1.7056 => 1.7392, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.82% (4.9469 => 5.0367, std.dev.: 0.0292) SingleSource/Benchmarks/Shootout/methcall: 1.58% (8.2676 => 8.3979, std.dev.: 0.0213) SingleSource/Benchmarks/Misc/flops-7: 1.20% (1.7156 => 1.7362, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.11% (1.5941 => 1.6118, std.dev.: 0.0067) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.11% (1.9302 => 1.9516, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.07% (4.4340 => 4.4815, std.dev.: 0.0119) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.21% (2.8951 => 1.6730, std.dev.: 0.0348) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -23.29% (7.2130 => 5.5333, std.dev.: 0.2618) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.25% (1.4529 => 1.1587, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.83% (9.9065 => 8.2397, std.dev.: 0.0259) MultiSource/Benchmarks/Olden/em3d/em3d: -12.50% (5.4641 => 4.7813, std.dev.: 0.0133) SingleSource/Benchmarks/McGill/chomp: -9.69% (1.1216 => 1.0129, std.dev.: 0.0230) SingleSource/Benchmarks/Misc/flops-8: -9.65% (2.5609 => 2.3137, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/ary3: -9.13% (1.9999 => 1.8173, std.dev.: 0.0516) MultiSource/Benchmarks/mafft/pairlocalalign: -8.95% (63.1822 => 57.5291, std.dev.: 0.0334) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.29% (0.3269 => 0.2998, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/ffbench: -6.88% (1.4296 => 1.3313, std.dev.: 0.0275) SingleSource/Benchmarks/Shootout/sieve: -6.15% (7.0599 => 6.6257, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.72% (4.7482 => 4.4766, std.dev.: 0.0023) SingleSource/Benchmarks/Stanford/FloatMM: -5.71% (0.8807 => 0.8304, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.68% (5.1305 => 4.8390, std.dev.: 0.0600) SingleSource/Benchmarks/Misc/flops: -5.48% (9.3748 => 8.8612, std.dev.: 0.0556) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.12% (6.2275 => 5.9086, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.83% (5.6343 => 5.3622, std.dev.: 0.0249) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.44% (4.7449 => 4.5343, std.dev.: 0.0324) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.29% (6.1706 => 5.9056, std.dev.: 0.0520) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.18% (4.9453 => 4.7388, std.dev.: 0.0249) SingleSource/Benchmarks/Misc/perlin: -3.78% (5.1084 => 4.9153, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/methcall: -3.60% (8.9760 => 8.6531, std.dev.: 0.0468) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.44% (3.7148 => 3.5871, std.dev.: 0.0447) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.22% (4.9686 => 4.8085, std.dev.: 0.0279) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.22% (5.1557 => 4.9896, std.dev.: 0.0292) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.18% (5.4300 => 5.2575, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/fbench: -2.49% (3.3840 => 3.2999, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.85% (3.3479 => 3.2859, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -1.62% (15.8853 => 15.6281, std.dev.: 0.0278) MultiSource/Benchmarks/FreeBench/neural/neural: -1.47% (1.0841 => 1.0682, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.44% (1.5308 => 1.5088, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.39% (4.2466 => 4.1874, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-6: -1.38% (2.4416 => 2.4078, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-5: -1.35% (2.8957 => 2.8565, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.10% (6.0224 => 5.9563, std.dev.: 0.0183) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 7.05% (1.0262 => 1.0985, std.dev.: 0.2617) SingleSource/Benchmarks/CoyoteBench/fftbench: 52.62% (0.2463 => 0.3759, std.dev.: 0.0104) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 79.67% (0.0123 => 0.0221, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.39% (0.0408 => 0.0430, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.20% (0.0384 => 0.0427, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/casts: 8.42% (0.0190 => 0.0206, std.dev.: 0.0064) SingleSource/UnitTests/Vector/Altivec/test1: 23.33% (0.0180 => 0.0222, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 4.45% (0.1438 => 0.1502, std.dev.: 0.0232) MultiSource/Applications/lemon/lemon: 5.61% (1.1329 => 1.1964, std.dev.: 0.3854) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.32% (0.4164 => 0.4109, std.dev.: 0.0413) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.28% (0.1369 => 0.1455, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.65% (0.0641 => 0.0624, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.54% (0.0195 => 0.0276, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.87% (0.0578 => 0.0583, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.65% (1.1437 => 1.1626, std.dev.: 0.0247) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2800.00% (0.0001 => 0.0029, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.83% (0.0627 => 0.0603, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 44.44% (0.0180 => 0.0260, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.04% (0.8017 => 0.8014, std.dev.: 0.0117) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 6.45% (0.0062 => 0.0066, std.dev.: 0.0051) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 18:59:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 20:59:51 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121128025952.00B122A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6326?compare_to=6320&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6326, Order: 168737, Start Time: 2012-11-27 23:39:24, End Time: 2012-11-28 03:00:23 To: 6320, Order: 168712, Start Time: 2012-11-27 19:29:20, End Time: 2012-11-27 22:50:08 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (172 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1092 (718 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.48% (0.0625 => 0.0878, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.08% (0.1063 => 0.1404, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.73% (0.0714 => 0.0912, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.03% (0.1106 => 0.1405, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.10% (0.2969 => 0.3744, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.23% (0.4253 => 0.5326, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.74% (0.4139 => 0.5163, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.12% (0.5900 => 0.7323, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 23.68% (1.5932 => 1.9704, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.49% (0.4994 => 0.6167, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.40% (0.1620 => 0.1999, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.37% (0.0475 => 0.0586, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.12% (0.0584 => 0.0719, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.68% (0.5000 => 0.6134, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.43% (0.1021 => 0.1250, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.96% (0.0897 => 0.1094, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.77% (0.1107 => 0.1348, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.01% (0.0633 => 0.0766, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.76% (0.1103 => 0.1332, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.70% (0.0541 => 0.0653, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.57% (0.1604 => 0.1934, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0584 => 0.0704, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 20.46% (0.0948 => 0.1142, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.40% (0.0642 => 0.0773, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.39% (0.3903 => 0.4699, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/health/health: 20.22% (0.0821 => 0.0987, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.21% (0.1549 => 0.1862, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.14% (0.1003 => 0.1205, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 19.83% (0.1619 => 0.1940, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.71% (0.0822 => 0.0984, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 19.54% (0.0604 => 0.0722, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 19.50% (0.0605 => 0.0723, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.15% (0.1462 => 0.1742, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 19.01% (0.0947 => 0.1127, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 18.69% (0.0808 => 0.0959, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.66% (1.3152 => 1.5606, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.52% (0.2014 => 0.2387, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 18.44% (0.4029 => 0.4772, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.35% (0.3890 => 0.4604, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.21% (0.2866 => 0.3388, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.19% (0.1968 => 0.2326, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 18.06% (0.1218 => 0.1438, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.98% (0.2736 => 0.3228, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 17.91% (0.0698 => 0.0823, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 17.89% (0.5826 => 0.6868, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.78% (0.4658 => 0.5486, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 17.74% (0.5889 => 0.6934, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.65% (0.1088 => 0.1280, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.53% (0.5026 => 0.5907, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: 17.41% (0.1505 => 0.1767, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 17.35% (1.8794 => 2.2054, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 17.31% (0.5546 => 0.6506, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 17.29% (0.1284 => 0.1506, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.18% (0.3271 => 0.3833, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.11% (3.5627 => 4.1721, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.94% (1.6211 => 1.8957, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.55% (0.1160 => 0.1352, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 16.35% (0.9697 => 1.1282, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 16.26% (0.1421 => 0.1652, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.17% (0.2875 => 0.3340, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 16.11% (1.0781 => 1.2518, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.01% (0.4361 => 0.5059, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 15.91% (0.7171 => 0.8312, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.87% (2.7292 => 3.1624, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.80% (0.3930 => 0.4551, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/strcat: 15.75% (0.2750 => 0.3183, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.74% (4.4195 => 5.1151, std.dev.: 0.0078) MultiSource/Applications/ClamAV/clamscan: 15.60% (4.2109 => 4.8679, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.58% (1.9694 => 2.2763, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 15.54% (0.9909 => 1.1449, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.52% (0.2738 => 0.3163, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 15.49% (0.2725 => 0.3147, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 15.48% (0.2714 => 0.3134, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.39% (0.2729 => 0.3149, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 15.38% (0.2803 => 0.3234, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 15.35% (0.3004 => 0.3465, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.33% (0.2792 => 0.3220, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 15.32% (0.2780 => 0.3206, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 15.32% (0.2813 => 0.3244, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.31% (0.3195 => 0.3684, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 15.27% (0.2823 => 0.3254, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.20% (1.9966 => 2.3001, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/except: 15.19% (0.2811 => 0.3238, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 15.16% (23.5202 => 27.0864, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.13% (2.0673 => 2.3801, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.12% (0.2911 => 0.3351, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 15.05% (0.3096 => 0.3562, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.97% (0.3488 => 0.4010, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 14.84% (0.2075 => 0.2383, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 14.81% (0.3267 => 0.3751, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 14.73% (0.3258 => 0.3738, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 14.57% (0.3465 => 0.3970, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 14.57% (0.3446 => 0.3948, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 14.50% (0.3317 => 0.3798, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.50% (0.1090 => 0.1248, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.48% (0.3060 => 0.3503, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 14.47% (0.3496 => 0.4002, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.47% (0.3469 => 0.3971, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 14.42% (0.3460 => 0.3959, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 14.38% (0.3442 => 0.3937, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 14.30% (0.2566 => 0.2933, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 14.18% (1.4269 => 1.6293, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 14.17% (0.3678 => 0.4199, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.13% (0.3362 => 0.3837, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 14.08% (0.3650 => 0.4164, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 14.05% (0.3643 => 0.4155, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.02% (0.3124 => 0.3562, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.95% (0.3282 => 0.3740, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 13.95% (0.3477 => 0.3962, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 13.95% (0.3348 => 0.3815, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 13.80% (0.3724 => 0.4238, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 13.74% (0.7875 => 0.8957, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.71% (0.3625 => 0.4122, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 13.69% (0.3726 => 0.4236, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 13.53% (0.4146 => 0.4707, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 13.46% (0.0758 => 0.0860, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.44% (0.3690 => 0.4186, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.39% (0.3845 => 0.4360, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 13.34% (0.4251 => 0.4818, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.29% (0.3981 => 0.4510, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 13.19% (2.1653 => 2.4510, std.dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 13.01% (4.6177 => 5.2183, std.dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: 12.89% (2.1013 => 2.3721, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 12.59% (0.5012 => 0.5643, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 12.45% (0.2691 => 0.3026, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.40% (0.2040 => 0.2293, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.29% (0.1383 => 0.1553, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11.90% (5.5417 => 6.2010, std.dev.: 0.0149) MultiSource/Applications/lambda-0_1_3/lambda: 11.64% (0.3498 => 0.3905, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.50% (0.6435 => 0.7175, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.09% (0.1028 => 0.1142, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.85% (0.2737 => 0.3034, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 10.83% (0.4847 => 0.5372, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.49% (0.2068 => 0.2285, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.31% (0.3084 => 0.3402, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 10.28% (0.6634 => 0.7316, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 10.16% (0.2391 => 0.2634, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 9.92% (2.0346 => 2.2365, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 9.86% (0.3336 => 0.3665, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.80% (0.2103 => 0.2309, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.36% (4.6926 => 5.0849, std.dev.: 0.0131) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.15% (11.6398 => 12.5887, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.15% (0.5361 => 0.5798, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.07% (0.7426 => 0.8025, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.86% (0.5584 => 0.6023, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 6.41% (11.9555 => 12.7218, std.dev.: 0.0112) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.01% (0.3792 => 0.3982, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.99% (29.0505 => 33.4045, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 9.56% (0.2802 => 0.3070, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6113, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6777, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.93% (0.3693 => 0.3875, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1650, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-2: 4.35% (1.8057 => 1.8843, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/dry: 4.26% (14.0481 => 14.6464, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1949, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.61% (3.1722 => 3.2232, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3042, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2861, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5127, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.02% (50.0626 => 50.5746, std.dev.: 0.0173) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.59% (2.4764 => 2.3874, std.dev.: 0.0311) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.89% (25.4195 => 16.5508, std.dev.: 0.0118) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9790, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -7.66% (0.2402 => 0.2218, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8015, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8034, std.dev.: 0.0132) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -2.39% (17.2379 => 16.8257, std.dev.: 0.0221) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8687, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.13% (0.6293 => 0.6159, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5792, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: -1.55% (5.5810 => 5.4945, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1482, std.dev.: 0.0935) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0484, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 19:12:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 21:12:24 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121128031224.B95362A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/6327?compare_to=6323&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6327, Order: 168755, Start Time: 2012-11-28 01:40:44, End Time: 2012-11-28 03:12:56 To: 6323, Order: 168741, Start Time: 2012-11-27 23:45:21, End Time: 2012-11-28 01:17:36 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 1 (186 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (851 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.27% (79.3799 => 78.3689, std.dev.: 0.2435) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.49% (0.3834 => 0.4428, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.03% (2.0478 => 2.1099, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/salsa20: 2.36% (7.4937 => 7.6708, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/hash2: 2.25% (3.1932 => 3.2650, std.dev.: 0.0108) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.72% (0.3821 => 0.3526, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.97% (0.9542 => 0.8877, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/trivial-interface: -6.95% (0.3812 => 0.3547, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.94% (0.3831 => 0.3565, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.93% (0.3880 => 0.3611, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.90% (0.3896 => 0.3627, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.89% (0.3848 => 0.3583, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -6.77% (0.4033 => 0.3760, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -6.70% (0.4176 => 0.3896, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.66% (0.3891 => 0.3632, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.65% (0.3142 => 0.2933, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.44% (0.3884 => 0.3634, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -6.43% (2.4924 => 2.3322, std.dev.: 0.0145) SingleSource/UnitTests/ObjC/property: -6.41% (0.4199 => 0.3930, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.38% (0.2428 => 0.2273, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.37% (0.3357 => 0.3143, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.17% (0.6484 => 0.6084, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.11% (0.2355 => 0.2211, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: -6.07% (0.4280 => 0.4020, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -6.01% (16.1920 => 15.2196, std.dev.: 0.0156) MultiSource/Applications/JM/ldecod/ldecod: -5.98% (7.0961 => 6.6720, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: -5.97% (0.2160 => 0.2031, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.97% (1.0544 => 0.9915, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: -5.93% (9.2283 => 8.6812, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/football/football: -5.84% (0.9179 => 0.8643, std.dev.: 0.0042) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.83% (0.1716 => 0.1616, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.83% (0.9852 => 0.9278, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.82% (0.3658 => 0.3445, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.74% (4.8161 => 4.5396, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.72% (1.3722 => 1.2937, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.72% (1.2300 => 1.1597, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.71% (0.2695 => 0.2541, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.70% (6.7716 => 6.3858, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.67% (0.5857 => 0.5525, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -5.65% (4.3330 => 4.0880, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.65% (4.0323 => 3.8045, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.62% (0.7919 => 0.7474, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.62% (0.6052 => 0.5712, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.61% (1.4642 => 1.3821, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.60% (0.5925 => 0.5593, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.60% (0.8521 => 0.8044, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.59% (4.8802 => 4.6075, std.dev.: 0.0136) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.57% (0.6736 => 0.6361, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.56% (0.5591 => 0.5280, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.54% (0.5849 => 0.5525, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.53% (0.6667 => 0.6298, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.53% (0.5802 => 0.5481, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.52% (0.6304 => 0.5956, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.51% (0.6293 => 0.5946, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.51% (0.6260 => 0.5915, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.50% (0.5705 => 0.5391, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.48% (0.5478 => 0.5178, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.47% (0.6230 => 0.5889, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.46% (4.5069 => 4.2607, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.46% (0.5863 => 0.5543, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.46% (0.5570 => 0.5266, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.46% (3.5339 => 3.3411, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: -5.43% (1.1530 => 1.0904, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.43% (1.2784 => 1.2090, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.43% (0.5859 => 0.5541, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.42% (0.6194 => 0.5858, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.41% (0.6446 => 0.6097, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.41% (0.5805 => 0.5491, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.40% (0.5941 => 0.5620, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.39% (0.5581 => 0.5280, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -5.39% (1.1450 => 1.0833, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -5.39% (0.3025 => 0.2862, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -5.38% (1.3148 => 1.2441, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.38% (0.2548 => 0.2411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.36% (0.5575 => 0.5276, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -5.36% (0.4515 => 0.4273, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.35% (0.6660 => 0.6304, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.32% (8.0126 => 7.5864, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.32% (0.5999 => 0.5680, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.31% (0.7198 => 0.6816, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.30% (1.6364 => 1.5496, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: -5.30% (0.2659 => 0.2518, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.30% (14.2083 => 13.4552, std.dev.: 0.0081) MultiSource/Benchmarks/Olden/bh/bh: -5.29% (0.2985 => 0.2827, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -5.29% (0.3194 => 0.3025, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.29% (0.4916 => 0.4656, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.29% (0.6297 => 0.5964, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.29% (0.6676 => 0.6323, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.28% (0.6189 => 0.5862, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.27% (0.3931 => 0.3724, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.26% (2.1713 => 2.0571, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.25% (0.3255 => 0.3084, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.24% (0.5456 => 0.5170, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.23% (1.2210 => 1.1572, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.22% (0.5688 => 0.5391, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.21% (0.3837 => 0.3637, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.21% (0.6681 => 0.6333, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: -5.21% (15.5079 => 14.7002, std.dev.: 0.0126) MultiSource/Applications/Burg/burg: -5.20% (1.2515 => 1.1864, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.19% (0.6440 => 0.6106, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: -5.18% (1.3864 => 1.3146, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.18% (0.3323 => 0.3151, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.17% (0.2999 => 0.2844, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.17% (0.3252 => 0.3084, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.16% (0.4151 => 0.3937, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.15% (0.6033 => 0.5722, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.14% (0.3406 => 0.3231, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.14% (0.4321 => 0.4099, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: -5.12% (0.2989 => 0.2836, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.10% (0.3057 => 0.2901, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: -5.10% (17.1032 => 16.2305, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.10% (0.2903 => 0.2755, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.09% (0.2278 => 0.2162, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: -5.09% (0.3026 => 0.2872, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.08% (0.3483 => 0.3306, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.08% (0.2933 => 0.2784, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -5.08% (0.6441 => 0.6114, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -5.07% (0.2939 => 0.2790, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -5.05% (0.3581 => 0.3400, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: -5.05% (0.7779 => 0.7386, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.04% (0.3016 => 0.2864, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -5.03% (0.3059 => 0.2905, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -5.03% (0.3481 => 0.3306, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.99% (0.2385 => 0.2266, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.97% (0.4813 => 0.4574, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.94% (1.2221 => 1.1617, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -4.92% (0.4861 => 0.4622, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -4.91% (0.2849 => 0.2709, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -4.90% (0.3446 => 0.3277, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: -4.90% (0.7447 => 0.7082, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (0.2871 => 0.2731, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -4.85% (4.0594 => 3.8625, std.dev.: 0.0024) MultiSource/Applications/d/make_dparser: -4.85% (3.5154 => 3.3450, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.84% (0.5168 => 0.4918, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: -4.83% (0.3394 => 0.3230, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.81% (0.6347 => 0.6042, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -4.78% (0.3621 => 0.3448, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: -4.76% (0.4248 => 0.4046, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.75% (15.2527 => 14.5276, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/wc: -4.74% (0.3205 => 0.3053, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.73% (0.7339 => 0.6992, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.71% (0.6395 => 0.6094, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/lists1: -4.65% (0.3867 => 0.3687, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.65% (0.3849 => 0.3670, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.62% (1.6474 => 1.5713, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: -4.62% (2.1401 => 2.0413, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.61% (0.7524 => 0.7177, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -4.58% (2.4021 => 2.2921, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.53% (0.4083 => 0.3898, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -4.52% (0.3271 => 0.3123, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.51% (0.9557 => 0.9126, std.dev.: 0.0123) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.49% (0.3319 => 0.3170, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: -4.46% (34.0927 => 32.5708, std.dev.: 0.0189) MultiSource/Applications/lambda-0_1_3/lambda: -4.45% (0.7982 => 0.7627, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: -4.43% (5.0226 => 4.8001, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.41% (0.6395 => 0.6113, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.38% (0.4427 => 0.4233, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.36% (22.4056 => 21.4278, std.dev.: 0.0079) MultiSource/Applications/kimwitu++/kc: -4.35% (18.2933 => 17.4969, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.33% (0.7021 => 0.6717, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.31% (0.5569 => 0.5329, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: -4.30% (0.8418 => 0.8056, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.29% (0.5567 => 0.5328, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.29% (0.9077 => 0.8688, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.28% (0.5329 => 0.5101, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: -4.17% (0.3788 => 0.3630, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -4.09% (0.6750 => 0.6474, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: -4.07% (0.4524 => 0.4340, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.83% (2.2587 => 2.1723, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.78% (0.3491 => 0.3359, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -3.74% (1.5610 => 1.5026, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.15% (5.4682 => 5.2957, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -2.37% (20.7746 => 20.2826, std.dev.: 0.0177) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1953, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -62.29% (1.8100 => 0.6825, std.dev.: 0.0102) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7556, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -8.61% (1.2842 => 1.1736) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: -3.85% (2.2633 => 2.1762, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4004, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.77% (1.3096 => 1.2733, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.69% (79.7170 => 78.3689, std.dev.: 0.2435) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.50% (6.5735 => 6.4750, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 20:27:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 22:27:40 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121128042740.D3EFC2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6328?compare_to=6325&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6328, Order: 168757, Start Time: 2012-11-28 02:52:00, End Time: 2012-11-28 04:28:14 To: 6325, Order: 168752, Start Time: 2012-11-28 00:59:33, End Time: 2012-11-28 02:33:39 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 25 (70 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1025 (866 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 78.71% (0.0155 => 0.0277, std.dev.: 0.0009) SingleSource/Regression/C/2003-05-23-TransparentUnion: 77.12% (0.0153 => 0.0271, std.dev.: 0.0004) SingleSource/Regression/C/matrixTranspose: 75.30% (0.0247 => 0.0433, std.dev.: 0.0006) SingleSource/UnitTests/2006-12-01-float_varg: 75.00% (0.0144 => 0.0252, std.dev.: 0.0008) SingleSource/Regression/C/2004-02-03-AggregateCopy: 71.83% (0.0142 => 0.0244, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: 67.26% (0.0504 => 0.0843, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/ary3: 58.30% (0.0259 => 0.0410, std.dev.: 0.0011) SingleSource/UnitTests/SignlessTypes/div: 55.32% (0.0282 => 0.0438, std.dev.: 0.0008) SingleSource/Regression/C++/EH/ctor_dtor_count: 55.03% (0.0189 => 0.0293, std.dev.: 0.0019) SingleSource/UnitTests/2003-05-14-AtExit: 53.16% (0.0190 => 0.0291, std.dev.: 0.0022) SingleSource/UnitTests/member-function-pointers: 52.28% (0.0197 => 0.0300, std.dev.: 0.0035) SingleSource/UnitTests/Vector/sumarray-dbl: 51.26% (0.0199 => 0.0301, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/ackermann: 47.27% (0.0220 => 0.0324, std.dev.: 0.0034) SingleSource/UnitTests/Vector/constpool: 28.61% (8.7886 => 11.3033, std.dev.: 0.2778) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.01% (0.6800 => 0.7073, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 10.20% (43.3501 => 47.7712, std.dev.: 0.7983) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 8.05% (2.9484 => 3.1857, std.dev.: 0.0726) SingleSource/Benchmarks/Shootout/ary3: 6.61% (2.1134 => 2.2530, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.81% (15.6008 => 16.5069, std.dev.: 0.2564) SingleSource/Benchmarks/Misc/pi: 2.65% (2.1550 => 2.2122, std.dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 2.31% (3.1980 => 3.2720, std.dev.: 0.0223) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.06% (42.6118 => 43.4886, std.dev.: 0.2615) SingleSource/Benchmarks/Misc/ffbench: 2.04% (1.3313 => 1.3585, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/whetstone: 1.89% (2.1596 => 2.2005, std.dev.: 0.0139) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.02% (1.5710 => 1.5871, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.09% (1.2479 => 1.2343, std.dev.: 0.0032) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.36% (1.0985 => 1.0945, std.dev.: 0.1914) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.12% (0.3759 => 0.3914, std.dev.: 0.0189) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 31.67% (0.0221 => 0.0291, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.35% (0.0430 => 0.0453, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 4.52% (0.0332 => 0.0347, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 63.26% (0.0313 => 0.0511, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 17.33% (0.0427 => 0.0501, std.dev.: 0.0077) SingleSource/UnitTests/Vector/Altivec/casts: 4.85% (0.0206 => 0.0216, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/test1: 3.60% (0.0222 => 0.0230, std.dev.: 0.0075) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -1.40% (0.1502 => 0.1481, std.dev.: 0.0205) MultiSource/Applications/lemon/lemon: 8.15% (1.1964 => 1.2939, std.dev.: 0.2684) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.06% (0.4109 => 0.3942, std.dev.: 0.0412) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.42% (0.1455 => 0.1563, std.dev.: 0.0315) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.56% (0.0624 => 0.0640, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.72% (0.0276 => 0.0274, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.26% (0.0583 => 0.0564, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.71% (1.1626 => 1.1709, std.dev.: 0.0232) MultiSource/Benchmarks/SciMark2-C/scimark2: 0.21% (9.3851 => 9.4045, std.dev.: 0.0150) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.45% (0.0029 => 0.0030, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.50% (0.0603 => 0.0606, std.dev.: 0.0163) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.92% (0.0260 => 0.0265, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.51% (0.8014 => 0.8055, std.dev.: 0.0116) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -28.79% (0.0066 => 0.0047, std.dev.: 0.0064) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/SciMark2-C/scimark2: -67.10% (28.5821 => 9.4045, std.dev.: 0.0150) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.71% (16.4461 => 17.8779, std.dev.: 0.8359) MultiSource/Applications/sqlite3/sqlite3: 2348.31% (0.6332 => 15.5027, std.dev.: 0.6632) MultiSource/Benchmarks/McCat/08-main/main: 50.19% (0.1831 => 0.2750, std.dev.: 0.0798) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.55% (0.1559 => 0.1488, std.dev.: 0.0419) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7205.44% (0.3123 => 22.8149, std.dev.: 0.7560) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1559.75% (0.3344 => 5.5502, std.dev.: 0.2257) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.92% (0.2364 => 0.3284, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/bigfib: 7.37% (0.6010 => 0.6453, std.dev.: 0.1965) SingleSource/Benchmarks/Misc/mandel: 3.96% (0.0429 => 0.0446, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.52% (0.3266 => 0.3577, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/strcat: 4.37% (0.1969 => 0.2055, std.dev.: 0.0054) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 12.05% (0.0224 => 0.0251, std.dev.: 0.0058) SingleSource/UnitTests/byval-alignment: -20.00% (0.0230 => 0.0184, std.dev.: 0.0056) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0516, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 15.25% (0.1462 => 0.1685, std.dev.: 0.0323) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4257, std.dev.: 0.0570) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0679, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4936, std.dev.: 0.0986) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5179, std.dev.: 0.0169) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2691, std.dev.: 0.0277) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0934, std.dev.: 0.0305) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3635, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3755, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0811, std.dev.: 0.0042) SingleSource/Regression/C/uint64_to_float: -30.12% (2.1832 => 1.5256, std.dev.: 0.0394) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-23-TransparentUnion: 113.39% (0.0127 => 0.0271, std.dev.: 0.0004) SingleSource/Regression/C++/EH/simple_throw: 102.19% (0.0137 => 0.0277, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 100.00% (0.0108 => 0.0216, std.dev.: 0.0017) SingleSource/UnitTests/2006-12-01-float_varg: 98.43% (0.0127 => 0.0252, std.dev.: 0.0008) SingleSource/Regression/C/2004-02-03-AggregateCopy: 96.77% (0.0124 => 0.0244, std.dev.: 0.0007) SingleSource/Regression/C/matrixTranspose: 87.45% (0.0231 => 0.0433, std.dev.: 0.0006) SingleSource/UnitTests/member-function-pointers: 80.72% (0.0166 => 0.0300, std.dev.: 0.0035) SingleSource/Regression/C++/EH/dead_try_block: 78.74% (0.0127 => 0.0227, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/ary3: 74.47% (0.0235 => 0.0410, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: 70.99% (0.0493 => 0.0843, std.dev.: 0.0023) SingleSource/Regression/C++/EH/ctor_dtor_count: 70.35% (0.0172 => 0.0293, std.dev.: 0.0019) SingleSource/UnitTests/2003-05-14-AtExit: 67.24% (0.0174 => 0.0291, std.dev.: 0.0022) SingleSource/UnitTests/SignlessTypes/div: 65.28% (0.0265 => 0.0438, std.dev.: 0.0008) SingleSource/UnitTests/Vector/sumarray-dbl: 63.59% (0.0184 => 0.0301, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/ackermann: 62.00% (0.0200 => 0.0324, std.dev.: 0.0034) SingleSource/UnitTests/SignlessTypes/ccc: 53.59% (0.0209 => 0.0321, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: 34.28% (8.4179 => 11.3033, std.dev.: 0.2778) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.42% (0.0830 => 0.0958, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 11.95% (0.0937 => 0.1049, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.28% (0.1425 => 0.1543, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.39% (0.6586 => 0.7073, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.19% (0.8885 => 0.9524, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.03% (13.1811 => 14.1071, std.dev.: 0.1150) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.94% (1.6386 => 1.7523, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.38% (0.5191 => 0.5522, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.07% (0.2998 => 0.3180, std.dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: 5.69% (2.3764 => 2.5117, std.dev.: 0.0175) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.68% (1.2526 => 1.3237, std.dev.: 0.0228) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.63% (1.1685 => 1.2343, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 5.60% (0.8855 => 0.9351, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.82% (0.3115 => 0.3265, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.71% (0.3717 => 0.3855, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.59% (6.6074 => 6.8446, std.dev.: 0.0759) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 52.26% (0.0199 => 0.0303, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/pi: 40.06% (1.5795 => 2.2122, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 28.02% (2.9096 => 3.7249, std.dev.: 0.0587) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.21% (4.8436 => 5.8707, std.dev.: 0.0234) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.87% (8.2783 => 9.7580, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.66% (0.7597 => 0.8863, std.dev.: 0.0161) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.71% (14.6451 => 16.5069, std.dev.: 0.2564) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 12.16% (2.7995 => 3.1399, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.50% (6.3772 => 7.1106, std.dev.: 0.1796) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.05% (0.3186 => 0.3538, std.dev.: 0.0089) MultiSource/Applications/lambda-0_1_3/lambda: 10.25% (7.4933 => 8.2611, std.dev.: 0.0294) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.22% (1.1857 => 1.3069, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.71% (3.9917 => 4.2995, std.dev.: 0.1182) SingleSource/Benchmarks/Shootout/ary3: 7.55% (2.0949 => 2.2530, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.44% (23.5781 => 25.3333, std.dev.: 0.0725) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 7.21% (44.5605 => 47.7712, std.dev.: 0.7983) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.35% (3.3761 => 3.5904, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.20% (2.9753 => 3.1597, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 6.18% (4.8660 => 5.1665, std.dev.: 0.0315) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 6.16% (5.4187 => 5.7526, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.09% (4.5327 => 4.8086, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.28% (5.3218 => 5.6030, std.dev.: 0.0277) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.16% (0.3937 => 0.4140, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 5.10% (0.5214 => 0.5480, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 5.10% (0.4353 => 0.4575, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.98% (41.4238 => 43.4886, std.dev.: 0.2615) SingleSource/Benchmarks/Misc/richards_benchmark: 4.66% (1.3037 => 1.3644, std.dev.: 0.0130) MultiSource/Applications/aha/aha: 4.61% (3.3398 => 3.4936, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.74% (4.8362 => 5.0170, std.dev.: 0.0361) SingleSource/Benchmarks/Misc/whetstone: 3.68% (2.1224 => 2.2005, std.dev.: 0.0139) MultiSource/Benchmarks/PAQ8p/paq8p: 2.96% (91.7701 => 94.4895, std.dev.: 0.4281) MultiSource/Applications/SIBsim4/SIBsim4: 2.66% (3.1873 => 3.2720, std.dev.: 0.0223) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.13% (3.4104 => 3.4831, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.93% (11.5690 => 11.7921, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout/methcall: 1.32% (8.2676 => 8.3765, std.dev.: 0.0260) SingleSource/Benchmarks/Misc/ReedSolomon: 1.22% (8.5322 => 8.6361, std.dev.: 0.0114) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.08% (1.9302 => 1.9511, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.29% (2.8951 => 1.6708, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -23.76% (7.2130 => 5.4990, std.dev.: 0.1463) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.36% (1.4529 => 1.1571, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -17.31% (9.9065 => 8.1915, std.dev.: 0.0336) MultiSource/Benchmarks/Olden/em3d/em3d: -12.58% (5.4641 => 4.7766, std.dev.: 0.0830) SingleSource/Benchmarks/Misc/flops-8: -9.35% (2.5609 => 2.3214, std.dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: -9.09% (63.1822 => 57.4416, std.dev.: 0.1325) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.82% (0.3269 => 0.3046, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.22% (4.7482 => 4.4528, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.07% (5.1305 => 4.8192, std.dev.: 0.0326) SingleSource/Benchmarks/Stanford/FloatMM: -6.03% (0.8807 => 0.8276, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: -5.92% (7.0599 => 6.6421, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.38% (6.2275 => 5.8924, std.dev.: 0.0354) SingleSource/Benchmarks/Misc/flops: -5.33% (9.3748 => 8.8750, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/ffbench: -4.97% (1.4296 => 1.3585, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.78% (5.6343 => 5.3651, std.dev.: 0.0274) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.64% (2.8773 => 2.7439, std.dev.: 0.0311) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.53% (4.7449 => 4.5298, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.24% (6.1706 => 5.9089, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.20% (4.9453 => 4.7378, std.dev.: 0.0258) SingleSource/Benchmarks/Misc/perlin: -3.71% (5.1084 => 4.9190, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.28% (4.9686 => 4.8058, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.25% (5.1557 => 4.9883, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/methcall: -3.15% (8.9760 => 8.6929, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.01% (5.4300 => 5.2663, std.dev.: 0.0257) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.99% (3.7148 => 3.6038, std.dev.: 0.0284) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.58% (2.6356 => 2.5677, std.dev.: 0.0187) MultiSource/Applications/siod/siod: -2.33% (3.6643 => 3.5789, std.dev.: 0.0300) SingleSource/Benchmarks/Misc/fbench: -2.20% (3.3840 => 3.3094, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/flops-5: -1.76% (2.8957 => 2.8448, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.73% (3.3479 => 3.2901, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.50% (3.5679 => 3.5143, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/neural/neural: -1.41% (1.0841 => 1.0688, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -1.40% (15.8853 => 15.6634, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.24% (4.2466 => 4.1939, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/flops-6: -1.16% (2.4416 => 2.4133, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.06% (4.7794 => 4.7285, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 6.66% (1.0262 => 1.0945, std.dev.: 0.1914) SingleSource/Benchmarks/CoyoteBench/fftbench: 58.91% (0.2463 => 0.3914, std.dev.: 0.0189) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 136.59% (0.0123 => 0.0291, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 11.03% (0.0408 => 0.0453, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 36.61% (0.0254 => 0.0347, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 69.21% (0.0302 => 0.0511, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 30.47% (0.0384 => 0.0501, std.dev.: 0.0077) SingleSource/UnitTests/Vector/Altivec/casts: 13.68% (0.0190 => 0.0216, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/test1: 27.78% (0.0180 => 0.0230, std.dev.: 0.0075) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.99% (0.1438 => 0.1481, std.dev.: 0.0205) MultiSource/Applications/lemon/lemon: 14.21% (1.1329 => 1.2939, std.dev.: 0.2684) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.33% (0.4164 => 0.3942, std.dev.: 0.0412) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.17% (0.1369 => 0.1563, std.dev.: 0.0315) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.16% (0.0641 => 0.0640, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 40.51% (0.0195 => 0.0274, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.42% (0.0578 => 0.0564, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 2.38% (1.1437 => 1.1709, std.dev.: 0.0232) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.35% (0.0627 => 0.0606, std.dev.: 0.0163) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.22% (0.0180 => 0.0265, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.47% (0.8017 => 0.8055, std.dev.: 0.0116) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -24.19% (0.0062 => 0.0047, std.dev.: 0.0064) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 20:34:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 22:34:18 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121128043418.407DA2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6329?compare_to=6324&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6329, Order: 168755, Start Time: 2012-11-28 02:15:29, End Time: 2012-11-28 04:34:50 To: 6324, Order: 168731, Start Time: 2012-11-27 23:05:25, End Time: 2012-11-28 01:23:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 65 (143 on baseline) Performance Improvements: 4 (44 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1017 (698 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/objects/objects: 18.41% (0.1168 => 0.1383, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.97% (0.0837 => 0.0979, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.93% (0.1651 => 0.1914, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 15.25% (0.7843 => 0.9039, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 15.06% (0.6137 => 0.7061, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.68% (0.5891 => 0.6756, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 14.67% (0.7171 => 0.8223, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 14.60% (0.8070 => 0.9248, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 14.08% (0.6420 => 0.7324, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 14.05% (0.6283 => 0.7166, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 13.62% (0.6880 => 0.7817, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/17-bintr/bintr: 13.54% (0.0790 => 0.0897, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 12.62% (0.1189 => 0.1339, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 11.98% (0.3371 => 0.3775, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.83% (0.6207 => 0.6941, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ary: 11.58% (0.3533 => 0.3942, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.52% (0.4203 => 0.4687, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C++/office/office: 11.46% (0.3385 => 0.3773, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 11.40% (0.6173 => 0.6877, std.dev.: 0.0102) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.04% (0.1169 => 0.1298, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.87% (0.5216 => 0.5783, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.50% (1.4722 => 1.6268, std.dev.: 0.0140) MultiSource/Benchmarks/Olden/health/health: 10.48% (0.1460 => 0.1613, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.35% (0.6326 => 0.6981, std.dev.: 0.0090) MultiSource/Benchmarks/McCat/09-vor/vor: 9.41% (0.3571 => 0.3907, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary2: 8.99% (0.3691 => 0.4023, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.86% (0.9089 => 0.9894, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.81% (0.2383 => 0.2593, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.58% (0.1177 => 0.1278, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.43% (4.8102 => 5.2159, std.dev.: 0.0994) MultiSource/Benchmarks/McCat/05-eks/eks: 8.37% (0.4791 => 0.5192, std.dev.: 0.0043) MultiSource/Applications/d/make_dparser: 8.13% (3.7629 => 4.0687, std.dev.: 0.1022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.97% (1.5628 => 1.6873, std.dev.: 0.0278) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.94% (5.5673 => 6.0094, std.dev.: 0.0836) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.79% (0.3695 => 0.3983, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.74% (1.5756 => 1.6976, std.dev.: 0.0216) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.70% (0.3207 => 0.3454, std.dev.: 0.0054) SingleSource/Regression/C++/ofstream_ctor: 7.57% (0.3169 => 0.3409, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.28% (1.3125 => 1.4080, std.dev.: 0.0273) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.20% (0.9505 => 1.0189, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/football/football: 7.13% (0.9837 => 1.0538, std.dev.: 0.0199) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.99% (16.7614 => 17.9338, std.dev.: 0.0904) MultiSource/Benchmarks/McCat/18-imp/imp: 6.86% (0.3894 => 0.4161, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/methcall: 6.66% (0.3139 => 0.3348, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/fibo: 6.57% (0.2968 => 0.3163, std.dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: 6.34% (10.5790 => 11.2500, std.dev.: 0.2512) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.02% (4.6726 => 4.9541, std.dev.: 0.0407) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.33% (0.3956 => 0.4167, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: 126.00% (0.1046 => 0.2364, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 35.95% (0.3441 => 0.4678, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/flops: 28.59% (6.7482 => 8.6773, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 21.08% (1.5587 => 1.8873, std.dev.: 0.0992) SingleSource/Benchmarks/Shootout-C++/ary: 18.27% (0.0761 => 0.0900, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.39% (14.7076 => 17.1181, std.dev.: 0.8657) MultiSource/Benchmarks/Olden/bisort/bisort: 15.72% (0.8670 => 1.0033, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 15.20% (0.4631 => 0.5335, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.14% (0.0839 => 0.0966, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 13.83% (0.0759 => 0.0864, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 13.25% (10.1735 => 11.5215, std.dev.: 0.1597) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.44% (6.0272 => 6.4758, std.dev.: 0.0733) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.67% (4.2375 => 4.3507, std.dev.: 0.0098) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.41% (2.3287 => 2.3615, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.33% (4.9462 => 5.0122, std.dev.: 0.0244) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.32% (4.0914 => 4.1455, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/ackermann: 1.17% (1.7410 => 1.7613, std.dev.: 0.0076) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/random: -11.20% (0.3410 => 0.3028, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/heapsort: -10.68% (0.3494 => 0.3121, std.dev.: 0.0141) SingleSource/UnitTests/ObjC++/property-reference: -8.54% (0.8705 => 0.7962, std.dev.: 0.0284) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/lpbench: -14.04% (12.7562 => 10.9648, std.dev.: 0.5272) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.56% (69.3185 => 69.7067, std.dev.: 0.0822) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.07% (0.1337 => 0.1338, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.75% (0.0419 => 0.0485, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.69% (0.0677 => 0.0652, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -0.10% (494.0044 => 493.5046, std.dev.: 0.3831) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 10.22% (63.2438 => 69.7067, std.dev.: 0.0822) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.89% (4.3882 => 0.0485, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43662.05% (1.1277 => 493.5046, std.dev.: 0.3831) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 209.33% (0.5229 => 1.6175, std.dev.: 0.0232) MultiSource/Applications/SPASS/SPASS: 22.10% (14.9895 => 18.3026, std.dev.: 0.2281) MultiSource/Applications/kimwitu++/kc: 47.28% (14.1553 => 20.8485, std.dev.: 0.3608) MultiSource/Benchmarks/MallocBench/gs/gs: 15.13% (4.1105 => 4.7325, std.dev.: 0.2421) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.42% (1.1048 => 1.5182, std.dev.: 0.0670) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 431.87% (7.1582 => 38.0721, std.dev.: 0.3149) SingleSource/Benchmarks/Misc-C++-EH/spirit: 89.55% (3.4629 => 6.5640, std.dev.: 0.1953) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.54% (0.6222 => 1.0300, std.dev.: 0.0646) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10926.94% (0.0720 => 7.9394, std.dev.: 0.1505) MultiSource/Applications/SIBsim4/SIBsim4: 3854500.00% (0.0001 => 3.8546, std.dev.: 0.0116) MultiSource/Applications/SPASS/SPASS: 13815100.00% (0.0001 => 13.8152, std.dev.: 0.9107) MultiSource/Applications/kimwitu++/kc: 52500.00% (0.0001 => 0.0526, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576300.00% (0.0001 => 0.5764, std.dev.: 0.0208) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10072300.00% (0.0001 => 10.0724, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6326500.00% (0.0001 => 6.3266, std.dev.: 0.5784) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1754.86% (1.1194 => 20.7633, std.dev.: 0.6337) MultiSource/Applications/ClamAV/clamscan: 66.90% (22.1758 => 37.0121, std.dev.: 0.1383) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.50% (2.9384 => 4.5986, std.dev.: 0.3301) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.38% (7.0540 => 10.8197, std.dev.: 0.1246) MultiSource/Applications/JM/lencod/lencod: 46.93% (21.9371 => 32.2319, std.dev.: 0.0581) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 45.92% (8.1363 => 11.8725, std.dev.: 0.3107) MultiSource/Benchmarks/FreeBench/distray/distray: 44.51% (0.1056 => 0.1526, std.dev.: 0.0068) SingleSource/UnitTests/vla: 41.41% (0.0355 => 0.0502, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 37.67% (0.0730 => 0.1005, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: 37.57% (0.1432 => 0.1970, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 34.11% (0.0730 => 0.0979, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/17-bintr/bintr: 32.89% (0.0675 => 0.0897, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 32.41% (0.0793 => 0.1050, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/15-trie/trie: 29.79% (0.0527 => 0.0684, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 28.74% (0.0842 => 0.1084, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 28.26% (0.1044 => 0.1339, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: 27.93% (0.2700 => 0.3454, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/treeadd/treeadd: 27.40% (0.0416 => 0.0530, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 27.21% (0.1268 => 0.1613, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/lists: 26.36% (0.0626 => 0.0791, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.57% (0.2065 => 0.2593, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 25.35% (0.5569 => 0.6981, std.dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 25.31% (0.4615 => 0.5783, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 24.83% (14.3668 => 17.9338, std.dev.: 0.0904) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.68% (0.8172 => 1.0189, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 24.66% (1.3050 => 1.6268, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.42% (0.0770 => 0.0958, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 24.15% (0.1114 => 0.1383, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.86% (0.0746 => 0.0924, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.84% (0.1032 => 0.1278, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/dot-syntax-1: 23.80% (0.0479 => 0.0593, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/Oscar: 23.58% (0.0636 => 0.0786, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/perimeter/perimeter: 23.51% (0.0770 => 0.0951, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 22.89% (0.1695 => 0.2083, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/09-vor/vor: 22.86% (0.3180 => 0.3907, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.83% (0.1117 => 0.1372, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 22.70% (1.1642 => 1.4285, std.dev.: 0.0382) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 22.50% (0.3826 => 0.4687, std.dev.: 0.0131) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.35% (0.1566 => 0.1916, std.dev.: 0.0091) MultiSource/Benchmarks/MallocBench/espresso/espresso: 22.31% (4.2646 => 5.2159, std.dev.: 0.0994) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 22.13% (0.8101 => 0.9894, std.dev.: 0.0113) MultiSource/Applications/d/make_dparser: 21.99% (3.3354 => 4.0687, std.dev.: 0.1022) SingleSource/Benchmarks/Shootout-C++/ary: 21.97% (0.3232 => 0.3942, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/matrix: 21.85% (0.3098 => 0.3775, std.dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: 21.84% (0.0719 => 0.0876, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 21.81% (0.2554 => 0.3111, std.dev.: 0.0182) MultiSource/Benchmarks/VersaBench/bmm/bmm: 21.74% (0.0759 => 0.0924, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 21.56% (0.3423 => 0.4161, std.dev.: 0.0089) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 21.21% (0.1584 => 0.1920, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.13% (0.3441 => 0.4168, std.dev.: 0.0197) MultiSource/Applications/viterbi/viterbi: 21.09% (0.1555 => 0.1883, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 20.77% (0.4299 => 0.5192, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/office/office: 20.31% (0.3136 => 0.3773, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 20.14% (5.0018 => 6.0094, std.dev.: 0.0836) MultiSource/Benchmarks/Olden/tsp/tsp: 20.00% (0.1175 => 0.1410, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary2: 19.06% (0.3379 => 0.4023, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.94% (1.4186 => 1.6873, std.dev.: 0.0278) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.71% (1.1861 => 1.4080, std.dev.: 0.0273) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.67% (0.1125 => 0.1335, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 18.61% (9.4845 => 11.2500, std.dev.: 0.2512) MultiSource/Benchmarks/Prolangs-C/football/football: 18.13% (0.8921 => 1.0538, std.dev.: 0.0199) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 17.78% (0.1625 => 0.1914, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 17.69% (17.1811 => 20.2200, std.dev.: 0.3754) SingleSource/Regression/C++/ofstream_ctor: 17.35% (0.2905 => 0.3409, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/except: 16.82% (0.2871 => 0.3354, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 16.76% (0.1695 => 0.1979, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/methcall: 16.37% (0.2877 => 0.3348, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.22% (0.3427 => 0.3983, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/bh/bh: 16.11% (0.3092 => 0.3590, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/fibo: 16.07% (0.2725 => 0.3163, std.dev.: 0.0070) MultiSource/Applications/spiff/spiff: 15.92% (0.7835 => 0.9082, std.dev.: 0.0343) MultiSource/Benchmarks/Olden/mst/mst: 15.91% (0.1163 => 0.1348, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout/matrix: 15.89% (0.0818 => 0.0948, std.dev.: 0.0039) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.74% (0.0953 => 0.1103, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.46% (0.0886 => 0.1023, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.23% (0.0834 => 0.0961, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.00% (0.3121 => 0.3589, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/ReedSolomon: 14.89% (0.2049 => 0.2354, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.88% (4.9449 => 5.6807, std.dev.: 0.1880) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.83% (0.2758 => 0.3167, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.48% (0.1029 => 0.1178, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.16% (0.5981 => 0.6828, std.dev.: 0.0206) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.12% (0.1062 => 0.1212, std.dev.: 0.0054) MultiSource/Applications/oggenc/oggenc: 13.94% (5.7591 => 6.5621, std.dev.: 0.1719) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.91% (0.1337 => 0.1523, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.91% (0.5860 => 0.6675, std.dev.: 0.0290) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.77% (0.9765 => 1.1110, std.dev.: 0.0355) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.65% (0.2271 => 0.2581, std.dev.: 0.0115) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.31% (0.1510 => 0.1711, std.dev.: 0.0076) MultiSource/Applications/treecc/treecc: 12.88% (2.0273 => 2.2885, std.dev.: 0.0802) MultiSource/Applications/hexxagon/hexxagon: 12.58% (1.2842 => 1.4457, std.dev.: 0.0431) SingleSource/UnitTests/ObjC/parameter-passing: 12.55% (0.3927 => 0.4420, std.dev.: 0.0182) MultiSource/Applications/lemon/lemon: 12.52% (1.0722 => 1.2064, std.dev.: 0.0470) SingleSource/UnitTests/ObjC/property: 12.17% (0.3886 => 0.4359, std.dev.: 0.0178) SingleSource/UnitTests/ObjC/synchronized: 11.71% (0.3561 => 0.3978, std.dev.: 0.0153) SingleSource/UnitTests/ObjC/exceptions-2: 11.67% (0.3497 => 0.3905, std.dev.: 0.0152) SingleSource/UnitTests/ObjC/exceptions-3: 11.63% (0.3516 => 0.3925, std.dev.: 0.0154) SingleSource/UnitTests/ObjC/for-in: 11.48% (0.3694 => 0.4118, std.dev.: 0.0158) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.46% (0.3543 => 0.3949, std.dev.: 0.0152) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.11% (0.3177 => 0.3530, std.dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.97% (0.1906 => 0.2115, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.17% (0.3817 => 0.4167, std.dev.: 0.0074) MultiSource/Benchmarks/PAQ8p/paq8p: 8.44% (10.3673 => 11.2425, std.dev.: 0.2809) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.06% (4.3953 => 10.9911, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/methcall: 147.44% (5.3999 => 13.3615, std.dev.: 0.0112) MultiSource/Benchmarks/McCat/17-bintr/bintr: 126.65% (0.1043 => 0.2364, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 43.67% (0.3256 => 0.4678, std.dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 27.38% (13.4384 => 17.1181, std.dev.: 0.8657) MultiSource/Applications/minisat/minisat: 26.39% (9.1159 => 11.5215, std.dev.: 0.1597) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.10% (1.5086 => 1.8873, std.dev.: 0.0992) MultiSource/Benchmarks/Olden/bisort/bisort: 20.40% (0.8333 => 1.0033, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 20.02% (0.4445 => 0.5335, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary: 19.05% (0.0756 => 0.0900, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.47% (1.1145 => 1.3092, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.30% (0.2944 => 0.3424, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/oourafft: 16.17% (6.6465 => 7.7213, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ary2: 14.13% (0.0757 => 0.0864, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.81% (0.0864 => 0.0966, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.65% (2.8904 => 3.2270, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: 10.30% (1.1396 => 1.2570, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.40% (1.7254 => 1.8876, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.88% (8.6802 => 9.4510, std.dev.: 0.2797) MultiSource/Applications/lua/lua: 6.23% (26.0924 => 27.7187, std.dev.: 0.0758) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.50% (0.3070 => 0.3239, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.47% (4.2280 => 4.4594, std.dev.: 0.0114) MultiSource/Benchmarks/Olden/bh/bh: 5.30% (1.9405 => 2.0434, std.dev.: 0.0234) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.96% (11.6436 => 12.1044, std.dev.: 0.0081) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.31% (0.3540 => 0.3657, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.15% (2.1424 => 2.2099, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.80% (1.7133 => 1.7613, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 2.08% (3.1595 => 3.2252, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.07% (2.3135 => 2.3615, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: 1.54% (85.0658 => 86.3797, std.dev.: 0.0776) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.41% (6.5088 => 6.6005, std.dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.26% (1.0313 => 1.0443, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.25% (5.2139 => 5.2789, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/perlin: 1.19% (5.9798 => 6.0509, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 1.02% (5.2636 => 5.3174, std.dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1679, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.80% (5.2763 => 1.2241, std.dev.: 0.0243) SingleSource/Benchmarks/Misc/salsa20: -75.66% (0.8651 => 0.2106, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/richards_benchmark: -44.82% (0.1622 => 0.0895, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.40% (5.3526 => 4.6887, std.dev.: 0.1433) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.01% (5.3855 => 4.9541, std.dev.: 0.0407) MultiSource/Applications/JM/ldecod/ldecod: -6.51% (10.4361 => 9.7570, std.dev.: 0.2273) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.59% (1.7609 => 1.6976, std.dev.: 0.0216) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -68.62% (32.5116 => 10.2014, std.dev.: 0.0246) SingleSource/Benchmarks/Dhrystone/fldry: -65.49% (1.9577 => 0.6756, std.dev.: 0.0184) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1681, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.36% (0.3987 => 0.2378, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.23% (4.5009 => 2.7801, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.49% (1.1492 => 0.7643, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.07% (2.6546 => 2.0157, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -19.30% (0.2161 => 0.1744, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4218, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2840, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -10.65% (1.5373 => 1.3736, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -10.52% (9.5636 => 8.5578, std.dev.: 0.0859) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.52% (1.5660 => 1.4326, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.2416 => 3.0212, std.dev.: 0.0266) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.13% (0.8614 => 0.8172, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -5.09% (19.9488 => 18.9330, std.dev.: 0.1252) SingleSource/Benchmarks/Misc/flops-5: -4.98% (1.5835 => 1.5047, std.dev.: 0.0021) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.67% (1.6805 => 1.6020, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout/lists: -4.46% (6.2999 => 6.0188, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.35% (0.9957 => 0.9623, std.dev.: 0.0068) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8916, std.dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.60% (0.4808 => 0.4683, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.84% (8.1563 => 8.0060, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6773, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -1.47% (10.2830 => 10.1318, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0013) Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 21:07:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 27 Nov 2012 23:07:40 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121128050740.E92482A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6330?compare_to=6327&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6330, Order: 168765, Start Time: 2012-11-28 03:35:55, End Time: 2012-11-28 05:08:12 To: 6327, Order: 168755, Start Time: 2012-11-28 01:40:44, End Time: 2012-11-28 03:12:56 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (6 on baseline) Performance Improvements: 0 (185 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1090 (851 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 2.34% (0.6825 => 0.6985, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.65% (55.5019 => 56.4157, std.dev.: 0.0579) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 13.77% (0.3834 => 0.4362, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.37% (54.5751 => 56.4157, std.dev.: 0.0579) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.01% (2.0478 => 2.1094, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/salsa20: 2.43% (7.4937 => 7.6759, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 2.00% (3.1932 => 3.2571, std.dev.: 0.0091) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.38% (0.3821 => 0.3539, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.04% (0.9542 => 0.8870, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -6.97% (0.3831 => 0.3564, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.93% (0.3880 => 0.3611, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -6.93% (0.3896 => 0.3626, std.dev.: 0.0078) SingleSource/UnitTests/ObjC/trivial-interface: -6.93% (0.3812 => 0.3548, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.81% (0.3142 => 0.2928, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.81% (0.3848 => 0.3586, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -6.77% (0.4033 => 0.3760, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.66% (0.3891 => 0.3632, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.51% (0.4176 => 0.3904, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -6.47% (2.4924 => 2.3311, std.dev.: 0.0159) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.43% (0.2428 => 0.2272, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.39% (0.3884 => 0.3636, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -6.33% (0.4199 => 0.3933, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.29% (0.3357 => 0.3146, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.06% (9.2283 => 8.6690, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -5.98% (0.4280 => 0.4024, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.94% (0.6484 => 0.6099, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: -5.92% (7.0961 => 6.6760, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: -5.91% (16.1920 => 15.2343, std.dev.: 0.0169) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.86% (0.2355 => 0.2217, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.84% (0.5857 => 0.5515, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.81% (0.5925 => 0.5581, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.79% (1.0544 => 0.9934, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.78% (0.5863 => 0.5524, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.77% (0.3658 => 0.3447, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.75% (0.5705 => 0.5377, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.73% (0.9852 => 0.9287, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.72% (0.5805 => 0.5473, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.70% (0.5802 => 0.5471, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.70% (0.5859 => 0.5525, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.70% (0.5478 => 0.5166, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.69% (0.6304 => 0.5945, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.68% (0.1796 => 0.1694, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.67% (0.6052 => 0.5709, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.66% (0.5849 => 0.5518, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: -5.65% (0.9179 => 0.8660, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.64% (0.2695 => 0.2543, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.64% (0.6260 => 0.5907, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.64% (0.5570 => 0.5256, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.63% (0.5591 => 0.5276, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.63% (0.7198 => 0.6793, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.62% (0.6297 => 0.5943, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.61% (0.5941 => 0.5608, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.60% (0.6660 => 0.6287, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.60% (0.6446 => 0.6085, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.59% (1.2300 => 1.1612, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.58% (4.0323 => 3.8073, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.58% (0.6667 => 0.6295, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.58% (0.5575 => 0.5264, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.57% (1.3722 => 1.2957, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.50% (6.7716 => 6.3992, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.49% (0.5688 => 0.5376, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.46% (0.5581 => 0.5276, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -5.45% (0.6347 => 0.6001, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.42% (0.6194 => 0.5858, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.42% (4.8802 => 4.6159, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: -5.40% (1.1530 => 1.0907, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.39% (1.6364 => 1.5482, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.39% (0.5456 => 0.5162, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -5.38% (1.1450 => 1.0834, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.35% (4.8161 => 4.5585, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.33% (0.6676 => 0.6320, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.33% (1.4642 => 1.3862, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.32% (4.5069 => 4.2671, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.32% (0.3931 => 0.3722, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.30% (0.6189 => 0.5861, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -5.28% (0.3406 => 0.3226, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.27% (0.6033 => 0.5715, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.27% (0.6736 => 0.6381, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.26% (0.6440 => 0.6101, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.26% (1.2784 => 1.2112, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.25% (0.6681 => 0.6330, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: -5.25% (0.6441 => 0.6103, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -5.24% (0.7779 => 0.7371, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: -5.24% (4.3330 => 4.1061, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.23% (1.2210 => 1.1571, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: -5.22% (0.3025 => 0.2867, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.21% (0.3016 => 0.2859, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -5.20% (1.3864 => 1.3143, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.18% (14.2083 => 13.4720, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.18% (8.0126 => 7.5977, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.16% (0.7919 => 0.7510, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.13% (0.5999 => 0.5691, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -5.13% (17.1032 => 16.2251, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/matrix: -5.13% (0.3255 => 0.3088, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.12% (3.5339 => 3.3531, std.dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.12% (0.3323 => 0.3153, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -5.11% (0.2659 => 0.2523, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.11% (2.1713 => 2.0603, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.08% (0.8521 => 0.8088, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: -5.07% (0.3194 => 0.3032, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.06% (0.2548 => 0.2419, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -5.06% (0.2985 => 0.2834, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: -5.06% (1.3148 => 1.2483, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.04% (0.3057 => 0.2903, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.03% (0.4515 => 0.4288, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.02% (0.2871 => 0.2727, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.01% (1.2221 => 1.1609, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: -4.99% (0.3026 => 0.2875, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.98% (0.2933 => 0.2787, std.dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: -4.97% (0.3059 => 0.2907, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -4.97% (0.2939 => 0.2793, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: -4.96% (15.5079 => 14.7385, std.dev.: 0.0140) MultiSource/Applications/Burg/burg: -4.95% (1.2515 => 1.1895, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.95% (0.2385 => 0.2267, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.94% (0.6293 => 0.5982, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.93% (0.2999 => 0.2851, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.93% (0.4321 => 0.4108, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.93% (0.2903 => 0.2760, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.93% (0.6395 => 0.6080, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.92% (0.3252 => 0.3092, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.91% (0.4151 => 0.3947, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.90% (0.3837 => 0.3649, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.90% (0.3205 => 0.3048, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -4.89% (3.5154 => 3.3434, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/strcat: -4.88% (0.2989 => 0.2843, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -4.88% (0.3481 => 0.3311, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.88% (0.4916 => 0.4676, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/18-imp/imp: -4.86% (0.3581 => 0.3407, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: -4.83% (0.4861 => 0.4626, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.82% (0.4813 => 0.4581, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: -4.81% (0.2849 => 0.2712, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -4.79% (0.3446 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.76% (0.5168 => 0.4922, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.76% (0.7524 => 0.7166, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -4.74% (0.3394 => 0.3233, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.74% (0.3483 => 0.3318, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -4.72% (0.3621 => 0.3450, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -4.71% (0.3867 => 0.3685, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.69% (0.7339 => 0.6995, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -4.66% (4.0594 => 3.8702, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.65% (0.5569 => 0.5310, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.61% (15.2527 => 14.5489, std.dev.: 0.0110) MultiSource/Applications/minisat/minisat: -4.61% (0.7447 => 0.7104, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.60% (0.3849 => 0.3672, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -4.59% (0.4248 => 0.4053, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.52% (0.2278 => 0.2175, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.52% (0.6395 => 0.6106, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.51% (0.5567 => 0.5316, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.41% (0.4083 => 0.3903, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -4.38% (5.0226 => 4.8027, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.34% (0.9557 => 0.9142, std.dev.: 0.0151) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.34% (0.3319 => 0.3175, std.dev.: 0.0042) MultiSource/Applications/treecc/treecc: -4.34% (2.1401 => 2.0473, std.dev.: 0.0080) MultiSource/Applications/lambda-0_1_3/lambda: -4.30% (0.7982 => 0.7639, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.28% (0.5329 => 0.5101, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.27% (0.7021 => 0.6721, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -4.27% (2.4021 => 2.2995, std.dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.27% (1.6474 => 1.5771, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.27% (22.4056 => 21.4498, std.dev.: 0.0130) MultiSource/Benchmarks/Bullet/bullet: -4.23% (34.0927 => 32.6507, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.22% (0.4427 => 0.4240, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -4.16% (0.8418 => 0.8068, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: -4.16% (0.3271 => 0.3135, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -4.12% (0.3788 => 0.3632, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.11% (0.9077 => 0.8704, std.dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: -4.09% (18.2933 => 17.5444, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/bigfib: -4.00% (0.6750 => 0.6480, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: -3.96% (0.4524 => 0.4345, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: -3.61% (1.5610 => 1.5047, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.58% (0.3491 => 0.3366, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.51% (2.2587 => 2.1794, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.95% (5.4682 => 5.3067, std.dev.: 0.0134) SingleSource/UnitTests/Vector/constpool: -2.47% (20.7746 => 20.2622, std.dev.: 0.0282) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1954, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: -61.41% (1.8100 => 0.6985, std.dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.53% (7.5137 => 5.7455, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225) SingleSource/Benchmarks/Misc/richards_benchmark: -8.62% (1.2842 => 1.1735, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.83% (2.2633 => 2.1766, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4003, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.02% (1.0557 => 1.0238, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.22% (1.3096 => 1.2805, std.dev.: 0.0060) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4673, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 22:16:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 00:16:54 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121128061654.7DA452A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6331?compare_to=6328&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6331, Order: 168771, Start Time: 2012-11-28 04:45:18, End Time: 2012-11-28 06:17:28 To: 6328, Order: 168757, Start Time: 2012-11-28 02:52:00, End Time: 2012-11-28 04:28:14 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 2 (77 on baseline) Performance Improvements: 22 (42 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1027 (854 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel24: 81.64% (0.1890 => 0.3433, std.dev.: 0.0231) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.10% (1.4254 => 1.4411, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C++/EH/simple_throw: -48.74% (0.0277 => 0.0142, std.dev.: 0.0050) SingleSource/Regression/C/2003-05-23-TransparentUnion: -46.86% (0.0271 => 0.0144, std.dev.: 0.0015) SingleSource/Regression/C/matrixTranspose: -41.80% (0.0433 => 0.0252, std.dev.: 0.0062) SingleSource/UnitTests/SignlessTypes/ccc: -39.88% (0.0321 => 0.0193, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/ary3: -39.27% (0.0410 => 0.0249, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/ackermann: -34.26% (0.0324 => 0.0213, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -25.44% (11.3033 => 8.4279, std.dev.: 0.9726) SingleSource/Benchmarks/CoyoteBench/almabench: -23.20% (0.0918 => 0.0705, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout/matrix: -13.41% (0.0880 => 0.0762, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: -3.76% (0.3832 => 0.3688, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.07% (0.9524 => 0.9232, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -2.66% (0.8869 => 0.8633, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -2.05% (0.9645 => 0.9447, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.66% (0.8928 => 0.8780, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.44% (0.8658 => 0.8533, std.dev.: 0.0043) MultiSource/Benchmarks/PAQ8p/paq8p: -1.43% (2.5117 => 2.4758, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.40% (0.9119 => 0.8991, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.09% (0.9351 => 0.9249, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -15.64% (3.7970 => 3.2030, std.dev.: 0.1899) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.64% (5.4990 => 5.3538, std.dev.: 0.0557) SingleSource/Benchmarks/Shootout-C++/hash: -1.81% (0.6285 => 0.6171, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/fibo: -1.11% (4.3448 => 4.2966, std.dev.: 0.0084) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.11% (1.0945 => 1.0824, std.dev.: 0.0137) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.73% (0.3914 => 0.3729, std.dev.: 0.0361) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -24.40% (0.0291 => 0.0220, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -16.78% (0.0453 => 0.0377, std.dev.: 0.0137) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.46% (0.0347 => 0.0335, std.dev.: 0.0103) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -43.84% (0.0511 => 0.0287, std.dev.: 0.0094) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -15.37% (0.0501 => 0.0424, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/casts: -4.17% (0.0216 => 0.0207, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/test1: -3.91% (0.0230 => 0.0221, std.dev.: 0.0065) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.54% (0.1481 => 0.1473, std.dev.: 0.0053) MultiSource/Applications/lemon/lemon: -6.65% (1.2939 => 1.2078, std.dev.: 0.0383) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.37% (0.3942 => 0.4193, std.dev.: 0.0424) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.53% (0.1563 => 0.1461, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -62.50% (0.0008 => 0.0003, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.56% (0.0640 => 0.0630, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -14.96% (0.0274 => 0.0233, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.71% (0.0564 => 0.0560, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.66% (1.1709 => 1.1515, std.dev.: 0.0137) MultiSource/Benchmarks/SciMark2-C/scimark2: -0.20% (9.4045 => 9.3858, std.dev.: 0.0382) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.67% (0.0030 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -80.77% (0.0026 => 0.0005, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.28% (0.0606 => 0.0574, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.91% (0.0265 => 0.0252, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.06% (0.8055 => 0.7970, std.dev.: 0.0251) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 14.89% (0.0047 => 0.0054, std.dev.: 0.0064) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/SciMark2-C/scimark2: -67.16% (28.5821 => 9.3858, std.dev.: 0.0382) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.61% (16.4461 => 17.8628, std.dev.: 0.4330) MultiSource/Applications/sqlite3/sqlite3: 2345.81% (0.6332 => 15.4869, std.dev.: 0.6335) MultiSource/Benchmarks/McCat/08-main/main: 48.72% (0.1831 => 0.2723, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.85% (0.1559 => 0.1499, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7204.03% (0.3123 => 22.8105, std.dev.: 0.3692) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1531.34% (0.3344 => 5.4552, std.dev.: 0.0760) SingleSource/Benchmarks/Misc-C++/Large/ray: 39.42% (0.2364 => 0.3296, std.dev.: 0.0287) SingleSource/Benchmarks/Misc-C++/bigfib: 5.32% (0.6010 => 0.6330, std.dev.: 0.0166) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0429 => 0.0439, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.17% (0.3266 => 0.3435, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/strcat: 3.56% (0.1969 => 0.2039, std.dev.: 0.0022) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.48% (0.0224 => 0.0243, std.dev.: 0.0019) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0061) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0517, std.dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 15.18% (0.1462 => 0.1684, std.dev.: 0.0119) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4058, std.dev.: 0.0410) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0690, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4930, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5196, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2633, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0669, std.dev.: 0.0365) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3620, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3762, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0854, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: -29.79% (2.1832 => 1.5328, std.dev.: 0.0460) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.53% (0.0810 => 0.0952, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.03% (0.0848 => 0.0967, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/tsp/tsp: 13.31% (0.1112 => 0.1260, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 12.94% (0.0773 => 0.0873, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.65% (0.2279 => 0.2499, std.dev.: 0.0053) MultiSource/Applications/viterbi/viterbi: 8.12% (0.1577 => 0.1705, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: 7.68% (1.4269 => 1.5365, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/em3d/em3d: 6.86% (0.1721 => 0.1839, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.53% (0.1885 => 0.2008, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.94% (1.2526 => 1.3270, std.dev.: 0.0059) MultiSource/Applications/ClamAV/clamscan: 5.75% (14.7684 => 15.6171, std.dev.: 0.1801) MultiSource/Benchmarks/nbench/nbench: 5.29% (1.1271 => 1.1867, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 5.13% (0.8317 => 0.8744, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.76% (0.8697 => 0.9111, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.70% (0.9908 => 1.0374, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 4.45% (0.8855 => 0.9249, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.41% (0.8611 => 0.8991, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.39% (0.8050 => 0.8403, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 4.38% (0.9039 => 0.9435, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.37% (0.8086 => 0.8439, std.dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: 4.29% (0.9810 => 1.0231, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 4.28% (0.8597 => 0.8965, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.28% (0.8420 => 0.8780, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.27% (0.9688 => 1.0102, std.dev.: 0.0108) MultiSource/Applications/SIBsim4/SIBsim4: 4.27% (1.2568 => 1.3105, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.26% (0.7966 => 0.8305, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.25% (0.9074 => 0.9460, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.19% (0.8286 => 0.8633, std.dev.: 0.0079) MultiSource/Benchmarks/PAQ8p/paq8p: 4.18% (2.3764 => 2.4758, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 4.17% (0.9069 => 0.9447, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.09% (0.8331 => 0.8672, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.00% (0.8069 => 0.8392, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 4.00% (0.8177 => 0.8504, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.98% (0.8518 => 0.8857, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.95% (0.8457 => 0.8791, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.92% (0.8656 => 0.8995, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 3.91% (0.8927 => 0.9276, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 3.91% (0.8885 => 0.9232, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.85% (0.4783 => 0.4967, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.84% (0.8048 => 0.8357, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.84% (0.8338 => 0.8658, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.82% (0.8359 => 0.8678, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.75% (0.8316 => 0.8628, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.50% (0.3115 => 0.3224, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.30% (1.4479 => 1.4957, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.29% (0.8261 => 0.8533, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 55.78% (0.0199 => 0.0310, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/pi: 40.11% (1.5795 => 2.2131, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 27.75% (2.9096 => 3.7170, std.dev.: 0.1017) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.20% (4.8436 => 5.8703, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 18.03% (0.7597 => 0.8967, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.90% (8.2783 => 9.7601, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/misr: 15.97% (0.4001 => 0.4640, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.69% (2.7995 => 3.1268, std.dev.: 0.0152) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.36% (0.1129 => 0.1246) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.28% (1.1857 => 1.3076, std.dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: 10.18% (7.4933 => 8.2559, std.dev.: 0.0548) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.68% (3.9917 => 4.2983, std.dev.: 0.0883) MultiSource/Benchmarks/McCat/18-imp/imp: 7.37% (0.1370 => 0.1471, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.34% (23.5781 => 25.3078, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.37% (3.3761 => 3.5910, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.17% (2.9753 => 3.1590, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.92% (4.8660 => 5.1542, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.69% (4.5327 => 4.7908, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.38% (0.3937 => 0.4149, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.37% (5.4187 => 5.7095, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.07% (5.3218 => 5.5915, std.dev.: 0.0150) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 4.57% (0.4353 => 0.4552, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: 4.22% (1.3037 => 1.3587, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/power/power: 2.84% (1.2061 => 1.2403, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.38% (3.4104 => 3.4917, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.91% (1.2337 => 1.2573, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/methcall: 1.67% (8.2676 => 8.4060, std.dev.: 0.0250) MultiSource/Applications/spiff/spiff: 1.59% (2.8561 => 2.9015, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.58% (11.5690 => 11.7517, std.dev.: 0.0212) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.45% (1.4205 => 1.4411, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.27% (4.9469 => 5.0096, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.28% (2.8951 => 1.6711, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -25.78% (7.2130 => 5.3538, std.dev.: 0.0557) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.34% (1.4529 => 1.1574, std.dev.: 0.0858) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.71% (9.9065 => 8.2507, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/ary3: -13.49% (1.9999 => 1.7302, std.dev.: 0.0905) MultiSource/Benchmarks/Olden/em3d/em3d: -12.65% (5.4641 => 4.7729, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: -9.93% (1.1216 => 1.0102, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/flops-8: -9.80% (2.5609 => 2.3100, std.dev.: 0.0293) MultiSource/Benchmarks/mafft/pairlocalalign: -9.00% (63.1822 => 57.4962, std.dev.: 0.1249) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.16% (1.0512 => 0.9654, std.dev.: 0.0025) SingleSource/Benchmarks/Stanford/FloatMM: -6.76% (0.8807 => 0.8212, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.25% (5.1305 => 4.8098, std.dev.: 0.0330) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.22% (4.7482 => 4.4527, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout/sieve: -6.07% (7.0599 => 6.6314, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/flops: -5.52% (9.3748 => 8.8576, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.46% (6.2275 => 5.8876, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.87% (5.6343 => 5.3597, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.50% (4.7449 => 4.5316, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.40% (6.1706 => 5.8989, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.19% (4.9453 => 4.7381, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.80% (3.7148 => 3.5735, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/perlin: -3.80% (5.1084 => 4.9145, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: -3.78% (8.9760 => 8.6369, std.dev.: 0.0317) MultiSource/Applications/lua/lua: -3.70% (29.8330 => 28.7283, std.dev.: 0.1141) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.60% (5.1557 => 4.9699, std.dev.: 0.0125) MultiSource/Applications/siod/siod: -3.57% (3.6643 => 3.5336, std.dev.: 0.0426) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.30% (2.8773 => 2.7824, std.dev.: 0.0301) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.28% (4.9686 => 4.8057, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.19% (5.4300 => 5.2567, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.76% (2.6356 => 2.5628, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/fbench: -2.55% (3.3840 => 3.2978, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.50% (1.3882 => 1.3535, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.93% (3.3479 => 3.2832, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-5: -1.88% (2.8957 => 2.8412, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.61% (3.5679 => 3.5105, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/fp-convert: -1.59% (15.8853 => 15.6335, std.dev.: 0.0220) SingleSource/Benchmarks/Misc/flops-6: -1.58% (2.4416 => 2.4031, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/neural/neural: -1.46% (1.0841 => 1.0683, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: -1.43% (6.7064 => 6.6103, std.dev.: 0.0226) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.28% (4.2466 => 4.1921, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.21% (4.7794 => 4.7217, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.10% (6.0224 => 5.9560, std.dev.: 0.0095) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 5.48% (1.0262 => 1.0824, std.dev.: 0.0137) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.40% (0.2463 => 0.3729, std.dev.: 0.0361) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -7.60% (0.0408 => 0.0377, std.dev.: 0.0137) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.89% (0.0254 => 0.0335, std.dev.: 0.0103) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -4.97% (0.0302 => 0.0287, std.dev.: 0.0094) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/casts: 8.95% (0.0190 => 0.0207, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/test1: 22.78% (0.0180 => 0.0221, std.dev.: 0.0065) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.43% (0.1438 => 0.1473, std.dev.: 0.0053) MultiSource/Applications/lemon/lemon: 6.61% (1.1329 => 1.2078, std.dev.: 0.0383) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.70% (0.4164 => 0.4193, std.dev.: 0.0424) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.72% (0.1369 => 0.1461, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -62.50% (0.0008 => 0.0003, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.72% (0.0641 => 0.0630, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 19.49% (0.0195 => 0.0233, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.11% (0.0578 => 0.0560, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.68% (1.1437 => 1.1515, std.dev.: 0.0137) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -64.29% (0.0014 => 0.0005, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.45% (0.0627 => 0.0574, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 40.00% (0.0180 => 0.0252, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.59% (0.8017 => 0.7970, std.dev.: 0.0251) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -12.90% (0.0062 => 0.0054, std.dev.: 0.0064) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 23:03:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 01:03:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121128070320.E90F62A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6332?compare_to=6330&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6332, Order: 168771, Start Time: 2012-11-28 05:31:11, End Time: 2012-11-28 07:03:54 To: 6330, Order: 168765, Start Time: 2012-11-28 03:35:55, End Time: 2012-11-28 05:08:12 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (6 on baseline) Performance Improvements: 0 (184 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1090 (852 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.55% (0.7371 => 0.7485, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.01% (78.4217 => 80.7855, std.dev.: 0.5726) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 12.70% (0.3834 => 0.4321, std.dev.: 0.0107) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.45% (54.5751 => 56.4572, std.dev.: 0.0559) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.71% (2.0478 => 2.1032, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.4937 => 7.6745, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/hash2: 2.15% (3.1932 => 3.2619, std.dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.01% (0.1431 => 0.1302, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.51% (0.3821 => 0.3534, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -7.15% (0.3831 => 0.3557, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -7.11% (0.3880 => 0.3604, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -7.11% (0.3812 => 0.3541, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -7.07% (0.3848 => 0.3576, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -7.06% (0.3896 => 0.3621, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.05% (0.9542 => 0.8869, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -6.99% (0.4033 => 0.3751, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.89% (0.3891 => 0.3623, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.84% (0.3142 => 0.2927, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -6.80% (0.4176 => 0.3892, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -6.66% (2.4924 => 2.3264, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.57% (0.3884 => 0.3629, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -6.48% (0.4199 => 0.3927, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.26% (0.2428 => 0.2276, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -6.25% (0.2160 => 0.2025, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -6.17% (0.3357 => 0.3150, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.14% (9.2283 => 8.6621, std.dev.: 0.0086) MultiSource/Applications/JM/lencod/lencod: -6.10% (16.1920 => 15.2045, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/parameter-passing: -6.10% (0.4280 => 0.4019, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.07% (0.2355 => 0.2212, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -6.05% (7.0961 => 6.6669, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.90% (0.1796 => 0.1690, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.89% (0.6484 => 0.6102, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -5.85% (0.1879 => 0.1769, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.85% (0.9852 => 0.9276, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/football/football: -5.82% (0.9179 => 0.8645, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.77% (0.5857 => 0.5519, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.76% (1.0544 => 0.9937, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.74% (1.3722 => 1.2934, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.70% (0.5925 => 0.5587, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.70% (4.0323 => 3.8025, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.69% (0.5591 => 0.5273, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.68% (4.8161 => 4.5426, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.67% (0.6260 => 0.5905, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.67% (0.7198 => 0.6790, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.65% (0.5805 => 0.5477, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.63% (0.5863 => 0.5533, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.58% (0.6052 => 0.5714, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.58% (4.8802 => 4.6079, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.58% (0.3658 => 0.3454, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.57% (0.6230 => 0.5883, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.56% (1.2300 => 1.1616, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.55% (0.5802 => 0.5480, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.55% (0.5570 => 0.5261, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.55% (0.5859 => 0.5534, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.54% (0.5581 => 0.5272, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.53% (0.6667 => 0.6298, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -5.52% (1.1530 => 1.0893, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.52% (0.5575 => 0.5267, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.49% (0.6304 => 0.5958, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.49% (0.5849 => 0.5528, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.49% (0.5941 => 0.5615, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.48% (1.6364 => 1.5467, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.48% (0.6189 => 0.5850, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.47% (0.6194 => 0.5855, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.46% (0.5478 => 0.5179, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.45% (6.7716 => 6.4027, std.dev.: 0.0041) MultiSource/Benchmarks/sim/sim: -5.43% (0.3406 => 0.3221, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.43% (0.6446 => 0.6096, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.43% (4.5069 => 4.2624, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.42% (0.2695 => 0.2549, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.41% (0.6676 => 0.6315, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.41% (0.6660 => 0.6300, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.40% (1.4642 => 1.3851, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.40% (0.5705 => 0.5397, std.dev.: 0.0055) MultiSource/Applications/lemon/lemon: -5.35% (1.1450 => 1.0837, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.32% (0.5456 => 0.5166, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.30% (8.0126 => 7.5879, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.30% (0.6440 => 0.6099, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.29% (0.6297 => 0.5964, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.28% (14.2083 => 13.4577, std.dev.: 0.0168) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.28% (1.2784 => 1.2109, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/gs/gs: -5.28% (4.3330 => 4.1044, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: -5.27% (17.1032 => 16.2019, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.26% (0.6293 => 0.5962, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.25% (0.6033 => 0.5716, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.24% (0.6681 => 0.6331, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.23% (1.2210 => 1.1572, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.22% (0.5688 => 0.5391, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.20% (0.6736 => 0.6386, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.19% (3.5339 => 3.3506, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/05-eks/eks: -5.18% (0.4515 => 0.4281, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.18% (1.2221 => 1.1588, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.15% (0.8521 => 0.8082, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.13% (0.7919 => 0.7513, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: -5.11% (1.3864 => 1.3156, std.dev.: 0.0115) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.07% (0.2385 => 0.2264, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.06% (0.2548 => 0.2419, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -5.06% (0.2985 => 0.2834, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.05% (0.2278 => 0.2163, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.04% (0.4916 => 0.4668, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.03% (0.5999 => 0.5697, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.02% (0.2871 => 0.2727, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.99% (0.3931 => 0.3735, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -4.96% (3.5154 => 3.3412, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: -4.95% (15.5079 => 14.7399, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/matrix: -4.95% (0.3255 => 0.3094, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.94% (0.3057 => 0.2906) MultiSource/Benchmarks/McCat/08-main/main: -4.93% (0.2659 => 0.2528, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -4.93% (0.3025 => 0.2876, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.92% (2.1713 => 2.0645, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: -4.90% (1.3148 => 1.2504, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.88% (0.3323 => 0.3161, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.87% (0.2999 => 0.2853, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.85% (0.3483 => 0.3314, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.84% (0.3016 => 0.2870, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.84% (0.5168 => 0.4918, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: -4.83% (0.3581 => 0.3408, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.83% (0.3252 => 0.3095, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.82% (0.3837 => 0.3652, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -4.82% (15.2527 => 14.5174, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/ary: -4.80% (0.3394 => 0.3231, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -4.80% (0.2939 => 0.2798, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -4.79% (0.3194 => 0.3041, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -4.79% (0.3446 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -4.78% (0.2989 => 0.2846, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -4.77% (0.3205 => 0.3052) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.77% (0.2933 => 0.2793, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -4.76% (0.3026 => 0.2882, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.75% (0.2903 => 0.2765, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: -4.74% (0.2849 => 0.2714, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.73% (0.7524 => 0.7168, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.70% (0.7339 => 0.6994, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.70% (0.4151 => 0.3956, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.69% (0.6395 => 0.6095, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -4.69% (0.4861 => 0.4633, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -4.69% (1.2515 => 1.1928, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -4.68% (0.4248 => 0.4049, std.dev.: 0.0007) MultiSource/Applications/lua/lua: -4.67% (4.0594 => 3.8700, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: -4.65% (0.3481 => 0.3319, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.65% (0.7447 => 0.7101, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.61% (0.3059 => 0.2918, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.60% (0.3849 => 0.3672, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.58% (0.4321 => 0.4123, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.55% (0.6395 => 0.6104, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -4.54% (0.6347 => 0.6059, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.53% (0.3867 => 0.3692, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.51% (0.4813 => 0.4596, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.50% (0.7021 => 0.6705, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: -4.47% (0.3621 => 0.3459, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.45% (0.5567 => 0.5319, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.42% (0.6441 => 0.6156, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.42% (0.5569 => 0.5323, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.38% (0.9077 => 0.8679, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.35% (0.5329 => 0.5097, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.31% (0.4083 => 0.3907, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: -4.28% (0.3271 => 0.3131, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.28% (0.9557 => 0.9148, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.25% (0.3319 => 0.3178, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -4.24% (2.1401 => 2.0493, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.21% (22.4056 => 21.4615, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.15% (1.6474 => 1.5790, std.dev.: 0.0068) MultiSource/Applications/oggenc/oggenc: -4.13% (5.0226 => 4.8152, std.dev.: 0.0048) MultiSource/Applications/siod/siod: -4.12% (2.4021 => 2.3031, std.dev.: 0.0048) MultiSource/Benchmarks/Bullet/bullet: -4.08% (34.0927 => 32.7029, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.02% (0.4427 => 0.4249, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -3.98% (0.4524 => 0.4344, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: -3.96% (0.3788 => 0.3638, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -3.92% (0.8418 => 0.8088, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.78% (0.3491 => 0.3359, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -3.78% (0.7779 => 0.7485, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: -3.73% (0.6750 => 0.6498, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -3.70% (0.7982 => 0.7687, std.dev.: 0.0058) MultiSource/Applications/kimwitu++/kc: -3.69% (18.2933 => 17.6188, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.54% (2.2587 => 2.1788, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: -3.24% (1.5610 => 1.5104, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.10% (5.4682 => 5.2989, std.dev.: 0.0056) SingleSource/UnitTests/Vector/constpool: -2.31% (20.7746 => 20.2940, std.dev.: 0.0324) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1964, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -61.01% (1.8100 => 0.7057, std.dev.: 0.0081) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7563, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1729, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.89% (2.2633 => 2.1753, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7069, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3994, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.95% (1.0557 => 1.0246, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4686, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 23:09:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 01:09:58 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121128070958.4A72A2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6333?compare_to=6326&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6333, Order: 168764, Start Time: 2012-11-28 03:49:36, End Time: 2012-11-28 07:10:31 To: 6326, Order: 168737, Start Time: 2012-11-27 23:39:24, End Time: 2012-11-28 03:00:23 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (173 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1091 (718 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.10% (54.1646 => 54.7613, std.dev.: 0.1110) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.44% (0.0625 => 0.0884, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.46% (0.1063 => 0.1408, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.27% (0.2969 => 0.3749, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.95% (0.1106 => 0.1393, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.91% (0.0714 => 0.0899, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.86% (0.4253 => 0.5353, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.56% (0.4139 => 0.5197, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 24.59% (1.5932 => 1.9849, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.29% (0.4994 => 0.6207, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 24.21% (0.0541 => 0.0672, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.00% (0.0475 => 0.0589, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.97% (0.5900 => 0.7314, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.64% (0.5000 => 0.6182, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.12% (0.0584 => 0.0719, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.59% (0.1620 => 0.1986, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.43% (0.1021 => 0.1250, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.40% (0.1107 => 0.1355, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 22.20% (0.0599 => 0.0732, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.96% (0.0897 => 0.1094, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 21.16% (0.0605 => 0.0733, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.87% (0.0642 => 0.0776, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.85% (0.0633 => 0.0765, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.76% (0.1103 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 20.68% (0.0948 => 0.1144, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0584 => 0.0704, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.40% (0.0495 => 0.0596, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.34% (0.3903 => 0.4697, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/health/health: 20.22% (0.0821 => 0.0987, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.08% (0.1549 => 0.1860, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.07% (0.0822 => 0.0987) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.04% (0.1003 => 0.1204, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 19.89% (0.1619 => 0.1941, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.89% (0.1604 => 0.1923, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 19.70% (0.0604 => 0.0723, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 19.22% (0.0947 => 0.1129, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.88% (0.1462 => 0.1738, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 18.81% (0.0808 => 0.0960, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.77% (0.2014 => 0.2392, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.46% (1.3152 => 1.5580, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.43% (0.3890 => 0.4607, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 18.06% (0.1218 => 0.1438, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 18.02% (0.4029 => 0.4755, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 17.95% (0.5889 => 0.6946, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 17.92% (0.5826 => 0.6870, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 17.91% (0.0698 => 0.0823, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.87% (0.2736 => 0.3225, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.74% (0.1088 => 0.1281, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.73% (0.5026 => 0.5917, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/09-vor/vor: 17.54% (0.1505 => 0.1769, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.48% (0.2866 => 0.3367, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.35% (3.5627 => 4.1810, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.33% (0.3271 => 0.3838, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 17.15% (0.5546 => 0.6497, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.07% (0.1968 => 0.2304, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.02% (0.4658 => 0.5451, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.02% (1.6211 => 1.8970, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 16.88% (1.8794 => 2.1967, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 16.63% (0.9697 => 1.1310, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.56% (0.2875 => 0.3351, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.47% (0.1160 => 0.1351, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.46% (0.4361 => 0.5079, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.44% (2.7292 => 3.1779, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 16.34% (1.0781 => 1.2543, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 16.33% (0.7171 => 0.8342, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 16.33% (0.1421 => 0.1653, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 16.18% (0.2725 => 0.3166, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.09% (0.2729 => 0.3168, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 16.04% (0.2750 => 0.3191, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 15.99% (0.2714 => 0.3148, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.96% (0.2738 => 0.3175, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 15.86% (0.2780 => 0.3221, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.86% (4.4195 => 5.1205, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.85% (0.3930 => 0.4553, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 15.85% (0.3004 => 0.3480, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.80% (0.2792 => 0.3233, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 15.76% (0.2823 => 0.3268, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 15.75% (0.2813 => 0.3256, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 15.71% (4.2109 => 4.8726, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.70% (0.2911 => 0.3368, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 15.70% (0.2803 => 0.3243, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 15.69% (0.2811 => 0.3252, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 15.59% (0.2566 => 0.2966, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 15.58% (0.1284 => 0.1484, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 15.57% (0.3096 => 0.3578, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 15.54% (0.9909 => 1.1449, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.53% (2.0673 => 2.3883, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.43% (0.3195 => 0.3688, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.36% (0.3060 => 0.3530, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.33% (1.9694 => 2.2714, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.25% (1.9966 => 2.3011, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.23% (0.1090 => 0.1256, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.22% (0.3488 => 0.4019, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 15.18% (0.3267 => 0.3763, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 15.04% (0.3258 => 0.3748, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 15.00% (23.5202 => 27.0480, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ary2: 14.92% (0.3317 => 0.3812, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 14.84% (0.2075 => 0.2383, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.69% (0.3362 => 0.3856, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.66% (0.3282 => 0.3763, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions-4: 14.63% (0.3465 => 0.3972, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 14.60% (0.3446 => 0.3949, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 14.59% (0.3496 => 0.4006, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.53% (0.3124 => 0.3578, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 14.46% (0.3678 => 0.4210, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.45% (0.3460 => 0.3960, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 14.44% (0.3469 => 0.3970, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 14.44% (0.3442 => 0.3939, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 14.38% (0.0758 => 0.0867, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 14.37% (0.3348 => 0.3829, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 14.22% (0.3726 => 0.4256, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 14.11% (0.3650 => 0.4165, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 14.01% (0.3477 => 0.3964, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 14.00% (0.3643 => 0.4153, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 13.90% (1.4269 => 1.6253, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/parameter-passing: 13.83% (0.3724 => 0.4239, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.79% (0.3625 => 0.4125, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.66% (0.3981 => 0.4525, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 13.65% (0.4146 => 0.4712, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 13.64% (0.7875 => 0.8949, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 13.60% (0.4251 => 0.4829, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 13.58% (2.1013 => 2.3867, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.55% (0.3690 => 0.4190, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 13.41% (2.1653 => 2.4557, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.37% (0.3845 => 0.4359, std.dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 13.19% (4.6177 => 5.2267, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.94% (0.2040 => 0.2304, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 12.79% (0.5012 => 0.5653, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 12.67% (0.2691 => 0.3032, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 12.29% (5.5417 => 6.2229, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.58% (0.6435 => 0.7180, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.57% (0.1383 => 0.1543, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.78% (0.2068 => 0.2291, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 10.75% (0.3498 => 0.3874, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.70% (0.1028 => 0.1138, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.67% (0.2737 => 0.3029, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 10.60% (0.4847 => 0.5361, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 10.46% (0.6634 => 0.7328, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.05% (0.3084 => 0.3394, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 9.89% (0.3336 => 0.3666, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 9.86% (2.0346 => 2.2353, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 9.66% (0.2391 => 0.2622, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.32% (0.2103 => 0.2299, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.19% (4.6926 => 5.1237, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.34% (0.5361 => 0.5808, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.28% (11.6398 => 12.6035, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.76% (0.7426 => 0.8002, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.75% (0.5584 => 0.6017, std.dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: 6.60% (11.9555 => 12.7449, std.dev.: 0.0088) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.12% (0.3792 => 0.3986, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.96% (29.0505 => 33.3972, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.42% (0.2802 => 0.3066, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6091, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.50% (0.3693 => 0.3896, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6700, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-2: 4.74% (1.8057 => 1.8913, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1687, std.dev.: 0.0244) SingleSource/Benchmarks/Dhrystone/dry: 4.30% (14.0481 => 14.6515, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1987, std.dev.: 0.0072) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2252, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.50% (7.1849 => 7.2928, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3070, std.dev.: 0.0019) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5874, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5681, std.dev.: 0.0228) SingleSource/Benchmarks/Shootout-C++/ary2: -7.87% (0.2402 => 0.2213, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9772, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7910, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9573, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8066, std.dev.: 0.0036) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7728, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.89% (0.6293 => 0.6111, std.dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/fldry: -2.40% (17.2379 => 16.8244, std.dev.: 0.0587) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8664, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5778, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4959, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1740, std.dev.: 0.0690) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.02% (16.2163 => 16.0516, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Nov 27 23:44:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 01:44:05 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121128074405.265812A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6334?compare_to=6329&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6334, Order: 168771, Start Time: 2012-11-28 05:26:10, End Time: 2012-11-28 07:44:37 To: 6329, Order: 168755, Start Time: 2012-11-28 02:15:29, End Time: 2012-11-28 04:34:50 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 29 (151 on baseline) Performance Improvements: 2 (41 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1055 (693 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash: 11.65% (0.4774 => 0.5330, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.46% (0.6147 => 0.6667, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 8.26% (0.5930 => 0.6420, std.dev.: 0.0167) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.23% (0.3949 => 0.4274, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 7.99% (0.6458 => 0.6974, std.dev.: 0.0169) SingleSource/UnitTests/ObjC/parameter-passing: 6.83% (0.4420 => 0.4722, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.51% (0.2242 => 0.2388, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.50% (0.3121 => 0.3324, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.96% (1.7458 => 1.8499, std.dev.: 0.0384) SingleSource/UnitTests/ObjC++/property-reference-object: 5.54% (0.6587 => 0.6952, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.43% (0.3167 => 0.3339, std.dev.: 0.0059) MultiSource/Benchmarks/PAQ8p/paq8p: 5.39% (11.2425 => 11.8490, std.dev.: 0.1733) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 5.15% (0.6698 => 0.7043, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 4.87% (0.2115 => 0.2218, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/synchronized: 4.60% (0.3978 => 0.4161, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.58% (1.5182 => 1.5877, std.dev.: 0.0254) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.29% (5.6807 => 5.9245, std.dev.: 0.0750) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.27% (0.3983 => 0.4153, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.43% (20.7633 => 21.4762, std.dev.: 0.2624) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.19% (0.4168 => 0.4301, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.60% (1.6873 => 1.7311, std.dev.: 0.0144) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.31% (5.2159 => 5.3364, std.dev.: 0.0286) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.04% (1.6976 => 1.7323, std.dev.: 0.0115) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 32.12% (0.1180 => 0.1559, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.90% (1.3191 => 1.5684, std.dev.: 0.0607) SingleSource/Benchmarks/Shootout-C++/hash2: 5.77% (3.3758 => 3.5707, std.dev.: 0.0371) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.13% (1.8873 => 1.9652, std.dev.: 0.0112) MultiSource/Applications/sqlite3/sqlite3: 3.35% (4.5582 => 4.7109, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.30% (3.5965 => 3.6434, std.dev.: 0.0150) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: -13.75% (0.2364 => 0.2039, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.65% (3.5298 => 3.4716, std.dev.: 0.0194) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.05% (69.7067 => 69.7433, std.dev.: 0.0444) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.07% (0.1338 => 0.1339, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.74% (0.0485 => 0.0462, std.dev.: 0.0051) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.45% (0.0652 => 0.0668, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 0.11% (493.5046 => 494.0517, std.dev.: 0.1269) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 10.28% (63.2438 => 69.7433, std.dev.: 0.0444) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.95% (4.3882 => 0.0462, std.dev.: 0.0051) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43710.56% (1.1277 => 494.0517, std.dev.: 0.1269) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 217.46% (0.5229 => 1.6600, std.dev.: 0.0449) MultiSource/Applications/SPASS/SPASS: 20.42% (14.9895 => 18.0503, std.dev.: 0.2362) MultiSource/Applications/kimwitu++/kc: 45.99% (14.1553 => 20.6658, std.dev.: 0.3925) MultiSource/Benchmarks/MallocBench/gs/gs: 18.15% (4.1105 => 4.8565, std.dev.: 0.2077) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 43.71% (1.1048 => 1.5877, std.dev.: 0.0254) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 430.68% (7.1582 => 37.9874, std.dev.: 0.1231) SingleSource/Benchmarks/Misc-C++-EH/spirit: 94.22% (3.4629 => 6.7258, std.dev.: 0.1252) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.41% (0.6222 => 1.0292, std.dev.: 0.0636) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10367.64% (0.0720 => 7.5367, std.dev.: 0.3467) MultiSource/Applications/SIBsim4/SIBsim4: 3856500.00% (0.0001 => 3.8566, std.dev.: 0.0447) MultiSource/Applications/SPASS/SPASS: 14760600.00% (0.0001 => 14.7607, std.dev.: 0.5785) MultiSource/Applications/kimwitu++/kc: 52000.00% (0.0001 => 0.0521, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14400.00% (0.0001 => 0.0145, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576500.00% (0.0001 => 0.5766, std.dev.: 0.0211) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10069700.00% (0.0001 => 10.0698, std.dev.: 0.0156) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5679500.00% (0.0001 => 5.6796, std.dev.: 0.7973) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1818.55% (1.1194 => 21.4762, std.dev.: 0.2624) MultiSource/Applications/ClamAV/clamscan: 67.54% (22.1758 => 37.1541, std.dev.: 0.4289) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.75% (2.9384 => 4.6354, std.dev.: 0.2953) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 52.04% (7.0540 => 10.7252, std.dev.: 0.2329) MultiSource/Applications/JM/lencod/lencod: 48.28% (21.9371 => 32.5293, std.dev.: 0.1257) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 45.24% (8.1363 => 11.8169, std.dev.: 0.2607) MultiSource/Benchmarks/FreeBench/distray/distray: 44.13% (0.1056 => 0.1522, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/almabench: 43.97% (0.0730 => 0.1051, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 37.50% (0.1432 => 0.1969, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 32.41% (0.0793 => 0.1050, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 31.96% (0.2700 => 0.3563, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/17-bintr/bintr: 30.67% (0.0675 => 0.0882, std.dev.: 0.0012) SingleSource/UnitTests/vla: 29.58% (0.0355 => 0.0460, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 29.45% (0.0842 => 0.1090, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 29.04% (0.0730 => 0.0942, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/messages-2: 28.85% (0.0662 => 0.0853, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/treeadd/treeadd: 28.37% (0.0416 => 0.0534, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 28.00% (0.1032 => 0.1321, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/15-trie/trie: 27.32% (0.0527 => 0.0671, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 27.24% (0.4615 => 0.5872, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 26.15% (0.1044 => 0.1317, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.35% (0.8172 => 1.0244, std.dev.: 0.0112) MultiSource/Benchmarks/MallocBench/espresso/espresso: 25.13% (4.2646 => 5.3364, std.dev.: 0.0286) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.04% (0.2065 => 0.2582, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 24.99% (0.3441 => 0.4301, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 24.69% (0.5569 => 0.6944, std.dev.: 0.0048) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.44% (0.1125 => 0.1400, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/09-vor/vor: 24.31% (0.3180 => 0.3953, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 24.27% (0.4289 => 0.5330, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 23.99% (0.1117 => 0.1385, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.73% (0.0746 => 0.0923, std.dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/dry: 23.68% (0.0456 => 0.0564, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Oscar: 23.43% (0.0636 => 0.0785, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 23.23% (1.3050 => 1.6082, std.dev.: 0.0266) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.09% (0.1940 => 0.2388, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/em3d/em3d: 23.01% (0.1695 => 0.2085, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.90% (2.2024 => 2.7068, std.dev.: 0.0864) MultiSource/Benchmarks/McCat/18-imp/imp: 22.73% (0.3423 => 0.4201, std.dev.: 0.0074) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 22.67% (0.0953 => 0.1169, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 22.58% (0.3826 => 0.4690, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 22.17% (14.3668 => 17.5513, std.dev.: 0.3627) SingleSource/Benchmarks/CoyoteBench/lpbench: 22.07% (0.0929 => 0.1134, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 22.03% (1.4186 => 1.7311, std.dev.: 0.0144) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 22.00% (5.0018 => 6.1020, std.dev.: 0.0408) MultiSource/Benchmarks/NPB-serial/is/is: 21.97% (0.0719 => 0.0877, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 21.95% (0.0770 => 0.0939, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 21.85% (0.2554 => 0.3112, std.dev.: 0.0169) MultiSource/Benchmarks/McCat/05-eks/eks: 21.80% (0.4299 => 0.5236, std.dev.: 0.0030) MultiSource/Applications/spiff/spiff: 21.43% (0.7835 => 0.9514, std.dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 21.18% (0.3427 => 0.4153, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 21.11% (1.0722 => 1.2985, std.dev.: 0.0440) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.07% (0.2758 => 0.3339, std.dev.: 0.0059) MultiSource/Applications/d/make_dparser: 20.85% (3.3354 => 4.0308, std.dev.: 0.1153) MultiSource/Benchmarks/Prolangs-C++/office/office: 20.82% (0.3136 => 0.3789, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/instance-method-metadata: 20.63% (0.3543 => 0.4274, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/fbench: 20.61% (0.0592 => 0.0714, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.52% (0.1584 => 0.1909, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/tsp/tsp: 20.43% (0.1175 => 0.1415, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/ks/ks: 20.33% (0.1510 => 0.1817, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 20.31% (1.1861 => 1.4270, std.dev.: 0.0296) SingleSource/UnitTests/ObjC/parameter-passing: 20.24% (0.3927 => 0.4722, std.dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: 20.15% (9.4845 => 11.3958, std.dev.: 0.1791) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 20.01% (1.5415 => 1.8499, std.dev.: 0.0384) SingleSource/Benchmarks/Shootout-C++/hash2: 19.91% (0.4620 => 0.5540, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/football/football: 19.86% (0.8921 => 1.0693, std.dev.: 0.0174) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.81% (4.9449 => 5.9245, std.dev.: 0.0750) MultiSource/Benchmarks/VersaBench/bmm/bmm: 19.50% (0.0759 => 0.0907, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 19.03% (1.1840 => 1.4093, std.dev.: 0.0301) SingleSource/Benchmarks/Misc/whetstone: 18.79% (0.0660 => 0.0784, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 18.74% (3.8922 => 4.6216, std.dev.: 0.1498) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.40% (0.8067 => 0.9551, std.dev.: 0.0231) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 18.28% (0.0640 => 0.0757, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.04% (0.0704 => 0.0831, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.94% (0.5981 => 0.7054, std.dev.: 0.0162) SingleSource/Benchmarks/CoyoteBench/fftbench: 17.90% (0.4636 => 0.5466, std.dev.: 0.0175) SingleSource/UnitTests/ObjC/property: 17.73% (0.3886 => 0.4575, std.dev.: 0.0204) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 17.54% (0.1625 => 0.1910, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 17.26% (0.0672 => 0.0788, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.88% (0.0871 => 0.1018, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/synchronized: 16.85% (0.3561 => 0.4161, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 16.70% (0.1114 => 0.1300, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/trivial-interface: 16.59% (0.3473 => 0.4049, std.dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 16.37% (0.1906 => 0.2218, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/moments: 16.28% (0.4048 => 0.4707, std.dev.: 0.0144) MultiSource/Benchmarks/Olden/mst/mst: 15.99% (0.1163 => 0.1349, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/bh/bh: 15.78% (0.3092 => 0.3580, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.74% (0.2872 => 0.3324, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.69% (0.0886 => 0.1025, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.59% (0.0648 => 0.0749, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 15.43% (0.1555 => 0.1795, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/health/health: 15.38% (0.1268 => 0.1463, std.dev.: 0.0068) SingleSource/UnitTests/ObjC++/property-reference-object: 15.29% (0.6030 => 0.6952, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout/matrix: 15.28% (0.0818 => 0.0943, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.06% (0.0770 => 0.0886, std.dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.00% (0.3121 => 0.3589, std.dev.: 0.0141) SingleSource/UnitTests/ObjC++/Hello: 14.82% (0.5925 => 0.6803, std.dev.: 0.0221) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.75% (0.0834 => 0.0957, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/exptree: 14.50% (0.0814 => 0.0932, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.44% (0.1337 => 0.1530, std.dev.: 0.0053) MultiSource/Benchmarks/PAQ8p/paq8p: 14.29% (10.3673 => 11.8490, std.dev.: 0.1733) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.16% (0.0798 => 0.0911, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.90% (0.1029 => 0.1172, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.84% (0.1062 => 0.1209, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.71% (0.4064 => 0.4621, std.dev.: 0.0178) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 13.69% (0.3177 => 0.3612, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.69% (0.5860 => 0.6662, std.dev.: 0.0282) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.62% (0.9765 => 1.1095, std.dev.: 0.0495) MultiSource/Applications/sqlite3/sqlite3: 12.76% (17.1811 => 19.3742, std.dev.: 0.6588) SingleSource/UnitTests/ObjC/for-in: 11.83% (0.3694 => 0.4131, std.dev.: 0.0163) SingleSource/UnitTests/ObjC/exceptions-4: 11.77% (0.3543 => 0.3960, std.dev.: 0.0159) SingleSource/UnitTests/ObjC/exceptions-3: 11.72% (0.3516 => 0.3928, std.dev.: 0.0156) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.78% (0.1892 => 0.2096, std.dev.: 0.0062) MultiSource/Benchmarks/sim/sim: 10.13% (0.3387 => 0.3730, std.dev.: 0.0112) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.12% (4.3953 => 10.9934, std.dev.: 0.0254) SingleSource/Benchmarks/Shootout-C++/methcall: 147.47% (5.3999 => 13.3632, std.dev.: 0.0105) MultiSource/Benchmarks/McCat/17-bintr/bintr: 95.49% (0.1043 => 0.2039, std.dev.: 0.0106) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 42.78% (0.3256 => 0.4649, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/09-vor/vor: 35.10% (0.1154 => 0.1559, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 34.69% (13.4384 => 18.1008, std.dev.: 0.4385) MultiSource/Benchmarks/VersaBench/dbms/dbms: 30.27% (1.5086 => 1.9652, std.dev.: 0.0112) MultiSource/Applications/minisat/minisat: 30.08% (9.1159 => 11.8577, std.dev.: 0.1647) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.17% (1.2838 => 1.5684, std.dev.: 0.0607) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.75% (1.1145 => 1.3123, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 16.16% (6.6465 => 7.7205, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash2: 13.08% (3.1578 => 3.5707, std.dev.: 0.0371) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.91% (0.2944 => 0.3324, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.64% (2.8904 => 3.2268, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 10.26% (1.1396 => 1.2565, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.28% (1.7254 => 1.8856, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/ffbench: 8.61% (0.9505 => 1.0323, std.dev.: 0.0158) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.18% (0.3070 => 0.3321, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 6.32% (26.0924 => 27.7403, std.dev.: 0.0498) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.70% (4.2280 => 4.4690, std.dev.: 0.0099) SingleSource/Regression/C/uint64_to_float: 5.10% (0.5413 => 0.5689, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.06% (1.9405 => 2.0387, std.dev.: 0.0228) MultiSource/Benchmarks/nbench/nbench: 3.97% (11.6436 => 12.1063, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.74% (3.6395 => 3.7757, std.dev.: 0.0356) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.64% (0.3540 => 0.3669, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.14% (2.1424 => 2.2096, std.dev.: 0.0208) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.17% (2.3135 => 2.3637, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.13% (1.3677 => 1.3969, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 2.07% (3.1595 => 3.2248, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 1.51% (85.0658 => 86.3496, std.dev.: 0.0638) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.45% (6.5088 => 6.6031, std.dev.: 0.0077) MultiSource/Applications/sqlite3/sqlite3: 1.44% (4.6441 => 4.7109, std.dev.: 0.0177) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.23% (5.2139 => 5.2778, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0501, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.51% (6.6874 => 0.1667, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.77% (5.2763 => 1.2255, std.dev.: 0.0436) SingleSource/Benchmarks/Misc/salsa20: -75.70% (0.8651 => 0.2102, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/richards_benchmark: -44.76% (0.1622 => 0.0896, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.42% (5.3526 => 4.6877, std.dev.: 0.0633) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.03% (5.3855 => 4.7917, std.dev.: 0.1285) MultiSource/Applications/JM/ldecod/ldecod: -8.18% (10.4361 => 9.5823, std.dev.: 0.2801) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -68.62% (32.5116 => 10.2022, std.dev.: 0.0095) SingleSource/Benchmarks/Dhrystone/fldry: -65.14% (1.9577 => 0.6825, std.dev.: 0.0210) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1681, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.36% (0.3987 => 0.2378, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.27% (4.5009 => 2.7785, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: -33.47% (1.1492 => 0.7646, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.10% (2.6546 => 2.0149, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -19.30% (0.2161 => 0.1744, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.93% (1.6925 => 1.4229, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.72% (2.6778 => 2.2836, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -10.29% (9.5636 => 8.5796, std.dev.: 0.1317) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.91% (1.5660 => 1.4265, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.2416 => 3.0211, std.dev.: 0.0241) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.73% (0.3463 => 0.3230, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5759, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.14% (0.8614 => 0.8171, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: -4.75% (1.5835 => 1.5083, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.53% (19.9488 => 19.0457, std.dev.: 0.2200) SingleSource/Benchmarks/Shootout/lists: -4.22% (6.2999 => 6.0339, std.dev.: 0.0090) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8912, std.dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.62% (0.4808 => 0.4682, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.89% (8.1563 => 8.0019, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6770, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -1.47% (10.2830 => 10.1315, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.43% (0.2116 => 0.0668, std.dev.: 0.0008) Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 00:05:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 02:05:34 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121128080534.D55832A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6335?compare_to=6331&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6335, Order: 168774, Start Time: 2012-11-28 06:35:07, End Time: 2012-11-28 08:06:07 To: 6331, Order: 168771, Start Time: 2012-11-28 04:45:18, End Time: 2012-11-28 06:17:28 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 11 (152 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1040 (781 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.85% (0.2051 => 0.2253, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.40% (0.6325 => 0.6540, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.17% (0.6921 => 0.7071, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.15% (0.8283 => 0.8461, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.92% (0.6080 => 0.6197, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.47% (8.8759 => 9.0063, std.dev.: 0.0357) MultiSource/Benchmarks/MallocBench/gs/gs: 1.44% (4.2760 => 4.3374, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.26% (1.3270 => 1.3437, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.57% (0.3286 => 0.3502, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.89% (2.4140 => 2.4596, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.20% (11.5283 => 11.6662, std.dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.55% (1.0824 => 1.0765, std.dev.: 0.0140) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.17% (0.3729 => 0.3810, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.82% (0.0220 => 0.0224, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 9.02% (0.0377 => 0.0411, std.dev.: 0.0152) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -4.48% (0.0335 => 0.0320, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 13.24% (0.0287 => 0.0325, std.dev.: 0.0094) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -9.91% (0.0424 => 0.0382, std.dev.: 0.0133) SingleSource/UnitTests/Vector/Altivec/casts: -21.74% (0.0207 => 0.0162, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/test1: -3.17% (0.0221 => 0.0214, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -7.69% (0.0013 => 0.0012, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.27% (0.1473 => 0.1477, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 0.62% (1.2078 => 1.2153, std.dev.: 0.0228) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.70% (0.4193 => 0.4038, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.94% (0.1461 => 0.1418, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -66.67% (0.0003 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.95% (0.0630 => 0.0636, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -16.74% (0.0233 => 0.0194, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.36% (0.0560 => 0.0558, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.64% (1.1515 => 1.1441, std.dev.: 0.0094) MultiSource/Benchmarks/SciMark2-C/scimark2: 0.08% (9.3858 => 9.3934, std.dev.: 0.0229) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -80.00% (0.0005 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.19% (0.0574 => 0.0527, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.90% (0.0252 => 0.0222, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.27% (0.7970 => 0.8071, std.dev.: 0.0100) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 300.00% (0.0001 => 0.0004, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 31.48% (0.0054 => 0.0071, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/SciMark2-C/scimark2: -67.14% (28.5821 => 9.3934, std.dev.: 0.0229) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.34% (16.4461 => 17.8182, std.dev.: 0.1093) MultiSource/Applications/sqlite3/sqlite3: 2366.88% (0.6332 => 15.6203, std.dev.: 0.3386) MultiSource/Benchmarks/McCat/08-main/main: 47.46% (0.1831 => 0.2700, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.63% (0.1559 => 0.1440, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7142.84% (0.3123 => 22.6194, std.dev.: 0.5759) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1549.64% (0.3344 => 5.5164, std.dev.: 0.2937) SingleSource/Benchmarks/Misc-C++/Large/ray: 40.78% (0.2364 => 0.3328, std.dev.: 0.0953) SingleSource/Benchmarks/Misc-C++/bigfib: 6.14% (0.6010 => 0.6379, std.dev.: 0.0172) SingleSource/Benchmarks/Misc/mandel: 4.20% (0.0429 => 0.0447, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.67% (0.3266 => 0.3484, std.dev.: 0.0335) SingleSource/Benchmarks/Shootout-C++/strcat: 5.94% (0.1969 => 0.2086, std.dev.: 0.0042) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 13.84% (0.0224 => 0.0255, std.dev.: 0.0083) SingleSource/UnitTests/byval-alignment: -25.65% (0.0230 => 0.0171, std.dev.: 0.0063) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0452, std.dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: 13.20% (0.1462 => 0.1655, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4340, std.dev.: 0.0299) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0717, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4898, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5219, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2649, std.dev.: 0.0349) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0706, std.dev.: 0.0346) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3640, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3872, std.dev.: 0.0249) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0866, std.dev.: 0.0023) SingleSource/Regression/C/uint64_to_float: -29.96% (2.1832 => 1.5292, std.dev.: 0.1787) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0006) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.15% (0.0848 => 0.0968, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.10% (0.0773 => 0.0882, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.33% (0.0810 => 0.0918, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.41% (0.0830 => 0.0933, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 11.60% (0.1112 => 0.1241, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.97% (0.1756 => 0.1931, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.16% (0.4127 => 0.4505, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.02% (0.7473 => 0.8147, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.82% (0.6010 => 0.6540, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.72% (0.2180 => 0.2370, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.32% (0.3295 => 0.3569, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 8.16% (0.6287 => 0.6800, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.98% (0.1466 => 0.1583, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 7.97% (0.3226 => 0.3483, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.41% (0.8321 => 0.8938, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.36% (0.3137 => 0.3368, std.dev.: 0.0065) MultiSource/Applications/viterbi/viterbi: 7.36% (0.1577 => 0.1693, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.27% (1.2526 => 1.3437, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 7.18% (1.4269 => 1.5294, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.13% (0.9435 => 1.0108, std.dev.: 0.0092) MultiSource/Applications/spiff/spiff: 7.08% (0.7950 => 0.8513, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.95% (0.2519 => 0.2694, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.94% (0.2998 => 0.3206, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.81% (0.1983 => 0.2118, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.64% (0.4847 => 0.5169, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.53% (0.5817 => 0.6197, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.53% (13.1811 => 14.0417, std.dev.: 0.0644) MultiSource/Applications/Burg/burg: 6.47% (1.2222 => 1.3013, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.38% (0.2240 => 0.2383, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.04% (1.6386 => 1.7376, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.01% (0.2279 => 0.2416, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.96% (1.3279 => 1.4071, std.dev.: 0.0122) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.68% (0.8148 => 0.8611, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 5.67% (0.8007 => 0.8461, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.63% (0.2133 => 0.2253, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.62% (0.1885 => 0.1991, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.59% (0.5961 => 0.6294, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/football/football: 5.33% (0.8768 => 0.9235, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5.21% (0.9908 => 1.0424, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.18% (0.8286 => 0.8715, std.dev.: 0.0037) MultiSource/Applications/siod/siod: 5.08% (2.2184 => 2.3311, std.dev.: 0.0068) MultiSource/Applications/SPASS/SPASS: 5.06% (14.2605 => 14.9824, std.dev.: 0.0703) MultiSource/Benchmarks/nbench/nbench: 5.04% (1.1271 => 1.1839, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: 5.01% (4.1305 => 4.3374, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.00% (0.3003 => 0.3153, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.95% (0.6227 => 0.6535, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.92% (0.8697 => 0.9125, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 4.87% (0.8261 => 0.8663, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.81% (1.1685 => 1.2247, std.dev.: 0.0149) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.81% (1.1606 => 1.2164, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.75% (0.8420 => 0.8820, std.dev.: 0.0057) MultiSource/Applications/treecc/treecc: 4.67% (1.9948 => 2.0879, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.60% (4.1763 => 4.3684, std.dev.: 0.0393) SingleSource/Benchmarks/Shootout-C++/ary2: 4.58% (0.2509 => 0.2624, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.57% (0.9074 => 0.9489, std.dev.: 0.0119) MultiSource/Applications/JM/lencod/lencod: 4.56% (15.3280 => 16.0262, std.dev.: 0.0314) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.55% (0.8457 => 0.8842, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.50% (0.9688 => 1.0124, std.dev.: 0.0100) MultiSource/Applications/ClamAV/clamscan: 4.49% (14.7684 => 15.4322, std.dev.: 0.1201) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 4.49% (0.8597 => 0.8983, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.49% (0.7932 => 0.8288, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.45% (1.1170 => 1.1667, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 4.43% (0.9069 => 0.9471, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.42% (0.8885 => 0.9278, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 4.40% (0.8805 => 0.9192, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 4.39% (0.8927 => 0.9319, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.38% (0.8656 => 0.9035, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.34% (0.8518 => 0.8888, std.dev.: 0.0074) MultiSource/Benchmarks/PAQ8p/paq8p: 4.30% (2.3764 => 2.4785, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.26% (0.8611 => 0.8978, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.20% (0.9056 => 0.9436, std.dev.: 0.0112) MultiSource/Applications/lua/lua: 4.17% (3.8189 => 3.9783, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4.17% (0.8317 => 0.8664, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.15% (0.8716 => 0.9078, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.15% (8.6476 => 9.0063, std.dev.: 0.0357) MultiSource/Benchmarks/mafft/pairlocalalign: 4.14% (8.6247 => 8.9814, std.dev.: 0.0975) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.13% (0.6586 => 0.6858, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.13% (0.8331 => 0.8675, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.11% (0.8069 => 0.8401, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 4.08% (0.8359 => 0.8700, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 4.05% (0.8712 => 0.9065, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 4.04% (0.8177 => 0.8507, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.02% (0.8086 => 0.8411, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.01% (0.2741 => 0.2851, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.00% (6.6074 => 6.8716, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.99% (0.8316 => 0.8648, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.99% (0.8050 => 0.8371, std.dev.: 0.0068) MultiSource/Applications/SIBsim4/SIBsim4: 3.99% (1.2568 => 1.3069, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.96% (0.8338 => 0.8668, std.dev.: 0.0070) MultiSource/Applications/minisat/minisat: 3.94% (0.6834 => 0.7103, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.88% (1.2602 => 1.3091, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.84% (0.8855 => 0.9195, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.80% (0.8204 => 0.8516, std.dev.: 0.0074) MultiSource/Applications/lemon/lemon: 3.73% (1.0945 => 1.1353, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.4479 => 1.5014, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/bh/bh: 3.65% (0.2985 => 0.3094, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.64% (0.4783 => 0.4957, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 3.63% (0.2999 => 0.3108, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.63% (0.8066 => 0.8359, std.dev.: 0.0056) MultiSource/Applications/JM/ldecod/ldecod: 3.62% (6.7320 => 6.9760, std.dev.: 0.0431) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.58% (0.8048 => 0.8336, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.47% (0.3717 => 0.3846, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.38% (0.9810 => 1.0142, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.34% (4.4873 => 4.6372, std.dev.: 0.0558) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.27% (0.3124 => 0.3226, std.dev.: 0.0027) MultiSource/Applications/d/make_dparser: 3.20% (3.2366 => 3.3401, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.98% (4.4880 => 4.6217, std.dev.: 0.0312) MultiSource/Applications/lambda-0_1_3/lambda: 2.96% (0.7557 => 0.7781, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 2.94% (0.3503 => 0.3606, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.52% (4.5702 => 4.6854, std.dev.: 0.0228) MultiSource/Applications/oggenc/oggenc: 2.41% (4.9628 => 5.0826, std.dev.: 0.0199) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.84% (0.6943 => 0.7071, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 60.30% (0.0199 => 0.0319, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/pi: 40.18% (1.5795 => 2.2142, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 27.69% (2.9096 => 3.7154, std.dev.: 0.0403) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.01% (4.8436 => 5.8611, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.88% (8.2783 => 9.7582, std.dev.: 0.0231) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.52% (0.7597 => 0.8928, std.dev.: 0.0075) SingleSource/Benchmarks/McGill/misr: 17.30% (0.4001 => 0.4693, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.46% (2.7995 => 3.1203, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.28% (1.1857 => 1.3076, std.dev.: 0.0077) MultiSource/Applications/lambda-0_1_3/lambda: 10.19% (7.4933 => 8.2570, std.dev.: 0.0718) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.92% (0.3186 => 0.3502, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.36% (23.5781 => 25.3123, std.dev.: 0.0463) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.03% (3.9917 => 4.2722, std.dev.: 0.0821) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.27% (3.3761 => 3.5878, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.96% (2.9753 => 3.1525, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.85% (4.8660 => 5.1505, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.72% (4.5327 => 4.7919, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 5.39% (0.5214 => 0.5495, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.25% (5.3218 => 5.6011, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.24% (5.4187 => 5.7026, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 5.12% (0.4353 => 0.4576, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 4.56% (1.3037 => 1.3631, std.dev.: 0.0153) MultiSource/Applications/aha/aha: 4.51% (3.3398 => 3.4905, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 4.45% (0.3937 => 0.4112, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/power/power: 2.91% (1.2061 => 1.2412, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.54% (1.2337 => 1.2650, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/whetstone: 2.49% (2.1224 => 2.1753, std.dev.: 0.0204) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.31% (3.4104 => 3.4893, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.07% (0.6150 => 0.6277, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/methcall: 1.91% (8.2676 => 8.4254, std.dev.: 0.0201) SingleSource/Benchmarks/McGill/queens: 1.74% (1.7056 => 1.7353, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.64% (11.5690 => 11.7592, std.dev.: 0.0139) MultiSource/Benchmarks/Olden/bh/bh: 1.49% (2.3560 => 2.3911, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/ReedSolomon: 1.32% (8.5322 => 8.6446, std.dev.: 0.0166) MultiSource/Benchmarks/sim/sim: 1.21% (3.8206 => 3.8667, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.17% (11.5316 => 11.6662, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/mandel-text: 1.14% (1.8231 => 1.8438, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.11% (1.9302 => 1.9516, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-7: 1.08% (1.7156 => 1.7342, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: 1.06% (2.0670 => 2.0889, std.dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.17% (2.8951 => 1.6741, std.dev.: 0.0215) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -24.32% (7.2130 => 5.4585, std.dev.: 0.2436) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.52% (1.4529 => 1.1547, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -17.25% (9.9065 => 8.1972, std.dev.: 0.0323) MultiSource/Benchmarks/Olden/em3d/em3d: -12.66% (5.4641 => 4.7722, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -10.43% (0.3269 => 0.2928, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: -9.69% (1.1216 => 1.0129, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-8: -9.67% (2.5609 => 2.3133, std.dev.: 0.0130) MultiSource/Benchmarks/mafft/pairlocalalign: -9.10% (63.1822 => 57.4315, std.dev.: 0.0624) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.18% (1.0512 => 0.9652, std.dev.: 0.0050) SingleSource/Benchmarks/Stanford/FloatMM: -6.81% (0.8807 => 0.8207, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/ffbench: -6.71% (1.4296 => 1.3337, std.dev.: 0.0217) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.12% (5.1305 => 4.8167, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: -6.11% (7.0599 => 6.6284, std.dev.: 0.0377) SingleSource/Benchmarks/Misc/flops: -5.48% (9.3748 => 8.8608, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.34% (6.2275 => 5.8948, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.84% (5.6343 => 5.3615, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.53% (4.7449 => 4.5300, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.51% (6.1706 => 5.8920, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.33% (4.9453 => 4.7313, std.dev.: 0.0066) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.84% (2.8773 => 2.7669, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.83% (3.7148 => 3.5725, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/perlin: -3.76% (5.1084 => 4.9164, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.69% (5.1557 => 4.9652, std.dev.: 0.0066) MultiSource/Applications/lua/lua: -3.66% (29.8330 => 28.7412, std.dev.: 0.1985) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.40% (4.9686 => 4.7997, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/methcall: -3.21% (8.9760 => 8.6883, std.dev.: 0.0257) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.18% (5.4300 => 5.2571, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.61% (2.6356 => 2.5667, std.dev.: 0.0211) SingleSource/Benchmarks/Misc/fbench: -2.59% (3.3840 => 3.2962, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/neural/neural: -2.11% (1.0841 => 1.0612, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.87% (3.3479 => 3.2852, std.dev.: 0.0185) SingleSource/Benchmarks/Misc/flops-5: -1.70% (2.8957 => 2.8466, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: -1.55% (1.4861 => 1.4630, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.53% (1.5866 => 1.5623, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/fp-convert: -1.46% (15.8853 => 15.6531, std.dev.: 0.0263) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.35% (3.5679 => 3.5196, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: -1.33% (6.7064 => 6.6173, std.dev.: 0.0310) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.31% (4.7794 => 4.7168, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.12% (6.0224 => 5.9547, std.dev.: 0.0222) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.90% (1.0262 => 1.0765, std.dev.: 0.0140) SingleSource/Benchmarks/CoyoteBench/fftbench: 54.69% (0.2463 => 0.3810, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 82.11% (0.0123 => 0.0224, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.74% (0.0408 => 0.0411, std.dev.: 0.0152) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 25.98% (0.0254 => 0.0320, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 7.62% (0.0302 => 0.0325, std.dev.: 0.0094) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.52% (0.0384 => 0.0382, std.dev.: 0.0133) SingleSource/UnitTests/Vector/Altivec/casts: -14.74% (0.0190 => 0.0162, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/test1: 18.89% (0.0180 => 0.0214, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 71.43% (0.0007 => 0.0012, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.71% (0.1438 => 0.1477, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 7.27% (1.1329 => 1.2153, std.dev.: 0.0228) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.03% (0.4164 => 0.4038, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.58% (0.1369 => 0.1418, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.78% (0.0641 => 0.0636, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.51% (0.0195 => 0.0194, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.46% (0.0578 => 0.0558, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.03% (1.1437 => 1.1441, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.95% (0.0627 => 0.0527, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.33% (0.0180 => 0.0222, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.67% (0.8017 => 0.8071, std.dev.: 0.0100) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 300.00% (0.0001 => 0.0004, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 14.52% (0.0062 => 0.0071, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 01:00:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 03:00:38 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121128090038.B8EF52A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/6336?compare_to=6332&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6336, Order: 168775, Start Time: 2012-11-28 07:26:47, End Time: 2012-11-28 09:01:10 To: 6332, Order: 168771, Start Time: 2012-11-28 05:31:11, End Time: 2012-11-28 07:03:54 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (158 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (879 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 16.74% (0.3834 => 0.4476, std.dev.: 0.0186) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.09% (2.0478 => 2.1110, std.dev.: 0.0165) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.4937 => 7.6862, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/hash2: 2.31% (3.1932 => 3.2671, std.dev.: 0.0229) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.69% (0.3821 => 0.3527, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.84% (0.9542 => 0.8889, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -6.56% (2.4924 => 2.3290, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -6.20% (0.3357 => 0.3149, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -6.13% (9.2283 => 8.6628, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.10% (0.2428 => 0.2280, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.97% (0.5925 => 0.5571, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -5.96% (16.1920 => 15.2267, std.dev.: 0.0181) MultiSource/Applications/JM/ldecod/ldecod: -5.95% (7.0961 => 6.6741, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.94% (0.5591 => 0.5259, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.92% (0.5857 => 0.5510, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.92% (0.5863 => 0.5516, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.91% (0.9852 => 0.9270, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: -5.90% (0.3831 => 0.3605, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.90% (0.3848 => 0.3621, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.86% (0.5802 => 0.5462, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.84% (0.6230 => 0.5866, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.84% (0.5478 => 0.5158, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.84% (0.5859 => 0.5517, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.84% (0.5705 => 0.5372, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: -5.82% (0.3880 => 0.3654, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.82% (0.6304 => 0.5937, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -5.80% (0.3896 => 0.3670, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: -5.80% (0.3812 => 0.3591, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.79% (0.3057 => 0.2880, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.79% (0.5805 => 0.5469, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -5.78% (0.9179 => 0.8648, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.78% (0.6484 => 0.6109, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.77% (0.3016 => 0.2842, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.75% (0.6297 => 0.5935, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.75% (0.6194 => 0.5838, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.74% (0.6667 => 0.6284, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.73% (0.6260 => 0.5901, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.73% (1.0544 => 0.9940, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.73% (0.5570 => 0.5251, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.71% (0.5849 => 0.5515, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.71% (0.5941 => 0.5602, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: -5.68% (0.4033 => 0.3804, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.68% (0.4176 => 0.3939, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.66% (0.6446 => 0.6081, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.66% (0.5581 => 0.5265, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.65% (0.3891 => 0.3671, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: -5.65% (0.3255 => 0.3071, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.65% (0.5575 => 0.5260, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.63% (0.6681 => 0.6305, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.61% (0.5688 => 0.5369, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.58% (1.2300 => 1.1614, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.57% (1.3722 => 1.2957, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.56% (0.2355 => 0.2224, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.56% (0.6189 => 0.5845, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.56% (0.6660 => 0.6290, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.55% (0.3658 => 0.3455, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.52% (4.0323 => 3.8097, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.52% (0.3931 => 0.3714, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.51% (0.3323 => 0.3140, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: -5.51% (1.3148 => 1.2424, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.50% (0.6676 => 0.6309, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -5.49% (0.3059 => 0.2891, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.49% (0.2695 => 0.2547, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.49% (6.7716 => 6.3998, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/methcall: -5.49% (0.3025 => 0.2859, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.49% (0.6033 => 0.5702, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.48% (0.5456 => 0.5157, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.48% (4.8161 => 4.5522, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.46% (4.8802 => 4.6138, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: -5.45% (0.3194 => 0.3020, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/random: -5.44% (0.2939 => 0.2779, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: -5.43% (1.1450 => 1.0828, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.42% (0.2933 => 0.2774, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.42% (0.3837 => 0.3629, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.41% (2.1713 => 2.0538, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.39% (4.5069 => 4.2641, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/property: -5.38% (0.4199 => 0.3973, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.36% (0.3884 => 0.3676, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.35% (0.3252 => 0.3078, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.33% (1.6364 => 1.5491, std.dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: -5.33% (1.1530 => 1.0916, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.32% (14.2083 => 13.4528, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.31% (1.2784 => 1.2105, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.30% (0.6440 => 0.6099, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.29% (0.6293 => 0.5960, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/except: -5.29% (0.3026 => 0.2866, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.27% (0.6736 => 0.6381, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.27% (0.7919 => 0.7502, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary2: -5.26% (0.3481 => 0.3298, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.25% (0.4321 => 0.4094, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/05-eks/eks: -5.25% (0.4515 => 0.4278, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -5.24% (17.1032 => 16.2070, std.dev.: 0.0200) MultiSource/Benchmarks/sim/sim: -5.23% (0.3406 => 0.3228, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.18% (1.4642 => 1.3883, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.18% (0.7198 => 0.6825, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.18% (0.2278 => 0.2160, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: -5.16% (0.4248 => 0.4029, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.14% (8.0126 => 7.6007, std.dev.: 0.0079) MultiSource/Applications/SIBsim4/SIBsim4: -5.10% (1.3864 => 1.3157, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/parameter-passing: -5.09% (0.4280 => 0.4062, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.07% (0.6395 => 0.6071, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -5.06% (0.2985 => 0.2834, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: -5.04% (0.2659 => 0.2525, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.01% (0.8521 => 0.8094, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/strcat: -4.98% (0.2989 => 0.2840, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.98% (0.2548 => 0.2421, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -4.97% (4.3330 => 4.1175, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -4.96% (0.4861 => 0.4620, std.dev.: 0.0060) MultiSource/Applications/Burg/burg: -4.94% (1.2515 => 1.1897, std.dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: -4.94% (15.5079 => 14.7423, std.dev.: 0.0234) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.92% (0.7339 => 0.6978, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.90% (0.4813 => 0.4577, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: -4.87% (3.5154 => 3.3443, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.86% (0.2385 => 0.2269, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.85% (0.3483 => 0.3314, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.81% (0.7524 => 0.7162, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -4.75% (0.3581 => 0.3411, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -4.74% (0.7447 => 0.7094, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.73% (1.2210 => 1.1632, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.72% (0.5569 => 0.5306, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.68% (0.4916 => 0.4686, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/sieve: -4.67% (0.3788 => 0.3611, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.66% (0.6395 => 0.6097, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -4.65% (15.2527 => 14.5436, std.dev.: 0.0087) MultiSource/Applications/lua/lua: -4.60% (4.0594 => 3.8726, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.60% (0.5567 => 0.5311, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -4.52% (2.4021 => 2.2935, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.51% (0.4083 => 0.3899, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.48% (22.4056 => 21.4016, std.dev.: 0.0114) MultiSource/Applications/lambda-0_1_3/lambda: -4.45% (0.7982 => 0.7627, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: -4.44% (34.0927 => 32.5783, std.dev.: 0.0357) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.43% (0.2999 => 0.2866, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: -4.40% (18.2933 => 17.4877, std.dev.: 0.0233) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.37% (0.3319 => 0.3174, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.37% (0.5999 => 0.5737, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/09-vor/vor: -4.34% (0.3271 => 0.3129, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.32% (1.2221 => 1.1693, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -4.14% (0.6347 => 0.6084, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -4.13% (0.6441 => 0.6175, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -4.06% (2.1401 => 2.0532, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.02% (0.9077 => 0.8712, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference: -3.90% (0.7779 => 0.7476, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: -3.80% (1.5610 => 1.5017, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: -3.75% (0.8418 => 0.8102, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.73% (5.0226 => 4.8354, std.dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -2.62% (20.7746 => 20.2296, std.dev.: 0.0313) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1952, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/fldry: -63.38% (1.8100 => 0.6629, std.dev.: 0.0205) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7556, std.dev.: 0.0101) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: -3.90% (2.2633 => 2.1750, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4004, std.dev.: 0.0086) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4742, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 01:53:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 03:53:58 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121128095358.109DD2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6337?compare_to=6335&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6337, Order: 168776, Start Time: 2012-11-28 08:23:17, End Time: 2012-11-28 09:54:30 To: 6335, Order: 168774, Start Time: 2012-11-28 06:35:07, End Time: 2012-11-28 08:06:07 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 5 (130 on baseline) Performance Improvements: 13 (40 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1033 (803 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel07: 10.64% (0.0959 => 0.1061, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: 12.83% (0.0803 => 0.0906, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 4.40% (4.8190 => 5.0311, std.dev.: 0.0266) SingleSource/Benchmarks/McGill/queens: 1.40% (1.7353 => 1.7596, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.33% (1.5978 => 1.6191, std.dev.: 0.0053) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.08% (0.2253 => 0.2116, std.dev.: 0.0049) MultiSource/Applications/hbd/hbd: -3.27% (1.5294 => 1.4794, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -3.19% (1.3437 => 1.3008, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.33% (0.8147 => 0.7957, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -2.21% (0.8715 => 0.8522, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.17% (1.5014 => 1.4688, std.dev.: 0.0096) MultiSource/Benchmarks/MallocBench/gs/gs: -1.69% (4.3374 => 4.2641, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -1.58% (0.8461 => 0.8327, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.48% (0.7071 => 0.6966, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -1.48% (0.8288 => 0.8165, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.35% (6.8716 => 6.7788, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.27% (1.0424 => 1.0292, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/minisat/minisat: -1.35% (6.3021 => 6.2170, std.dev.: 0.0249) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.53% (1.0765 => 1.0708, std.dev.: 0.0132) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.73% (0.3810 => 0.3706, std.dev.: 0.1212) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0224 => 0.0224, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.87% (0.0411 => 0.0431, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 4.69% (0.0320 => 0.0335, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.77% (0.0325 => 0.0316, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 12.83% (0.0382 => 0.0431, std.dev.: 0.0084) SingleSource/UnitTests/Vector/Altivec/casts: 29.01% (0.0162 => 0.0209, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/test1: 3.74% (0.0214 => 0.0222, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -91.67% (0.0012 => 0.0001, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -1.42% (0.1477 => 0.1456, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -6.79% (1.2153 => 1.1328, std.dev.: 0.3521) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.10% (0.4038 => 0.4034, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.40% (0.1418 => 0.1452, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.32% (0.0636 => 0.0564, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 36.60% (0.0194 => 0.0265, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: - (0.0558 => 0.0558, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.36% (1.1441 => 1.1482, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: -0.07% (9.3934 => 9.3870, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 300.00% (0.0001 => 0.0004, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.11% (0.0527 => 0.0575, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.80% (0.0222 => 0.0226, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.21% (0.8071 => 0.7973, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -75.00% (0.0004 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 52.11% (0.0071 => 0.0108, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/SciMark2-C/scimark2: -67.16% (28.5821 => 9.3870, std.dev.: 0.0065) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.66% (16.4461 => 17.8705, std.dev.: 0.0385) MultiSource/Applications/sqlite3/sqlite3: 2334.82% (0.6332 => 15.4173, std.dev.: 0.3013) MultiSource/Benchmarks/McCat/08-main/main: 41.89% (0.1831 => 0.2598, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.09% (0.1559 => 0.1464, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7165.61% (0.3123 => 22.6905, std.dev.: 0.1982) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1549.31% (0.3344 => 5.5153, std.dev.: 0.2523) SingleSource/Benchmarks/Misc-C++/Large/ray: 40.10% (0.2364 => 0.3312, std.dev.: 0.0173) SingleSource/Benchmarks/Misc-C++/bigfib: 7.07% (0.6010 => 0.6435, std.dev.: 0.0327) SingleSource/Benchmarks/Misc/mandel: 5.59% (0.0429 => 0.0453, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.18% (0.3266 => 0.3533, std.dev.: 0.0955) SingleSource/Benchmarks/Shootout-C++/strcat: 3.30% (0.1969 => 0.2034, std.dev.: 0.0627) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -3.57% (0.0224 => 0.0216, std.dev.: 0.0097) SingleSource/UnitTests/byval-alignment: -26.09% (0.0230 => 0.0170, std.dev.: 0.0063) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0502, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 8.82% (0.1462 => 0.1591, std.dev.: 0.0125) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4013, std.dev.: 0.0434) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0690, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4935, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5201, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2781, std.dev.: 0.0362) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0766, std.dev.: 0.0271) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3643, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3821, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0860, std.dev.: 0.0021) SingleSource/Regression/C/uint64_to_float: -29.71% (2.1832 => 1.5345, std.dev.: 0.0256) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.05% (0.0810 => 0.0940, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.06% (0.0830 => 0.0955, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 14.75% (0.1112 => 0.1276, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.03% (0.0848 => 0.0950, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.13% (0.2180 => 0.2379, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.88% (0.2240 => 0.2439, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.88% (2.1401 => 2.3302, std.dev.: 0.0673) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.75% (0.4127 => 0.4488, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.84% (0.1466 => 0.1581, std.dev.: 0.0036) MultiSource/Benchmarks/sim/sim: 7.41% (0.3226 => 0.3465, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.40% (0.1905 => 0.2046, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.15% (0.2519 => 0.2699, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.54% (0.6287 => 0.6698, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.48% (0.7473 => 0.7957, std.dev.: 0.0073) MultiSource/Applications/SPASS/SPASS: 6.17% (14.2605 => 15.1406, std.dev.: 0.2760) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.70% (0.1983 => 0.2096, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.66% (13.1811 => 13.9270, std.dev.: 0.0354) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.51% (0.6227 => 0.6570, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.41% (0.1885 => 0.1987, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.35% (0.9435 => 0.9940, std.dev.: 0.0189) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.27% (1.6386 => 1.7249, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.26% (0.5191 => 0.5464, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.22% (0.3295 => 0.3467, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.13% (0.2279 => 0.2396, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.05% (0.5961 => 0.6262, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.99% (1.3279 => 1.3941, std.dev.: 0.0053) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.3137 => 0.3291, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/football/football: 4.70% (0.8768 => 0.9180, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.61% (0.8148 => 0.8524, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.61% (0.9688 => 1.0135, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.54% (1.1606 => 1.2133, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.44% (0.8697 => 0.9083, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.39% (0.8611 => 0.8989, std.dev.: 0.0053) MultiSource/Applications/JM/lencod/lencod: 4.32% (15.3280 => 15.9898, std.dev.: 0.0688) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.27% (0.8331 => 0.8687, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.25% (0.3717 => 0.3875, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.22% (0.8457 => 0.8814, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 4.21% (0.9069 => 0.9451, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.17% (0.9074 => 0.9452, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 4.16% (1.2568 => 1.3091, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.10% (0.9056 => 0.9427, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.08% (1.1170 => 1.1626, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.07% (0.6586 => 0.6854, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 4.04% (0.6834 => 0.7110, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4.02% (0.8317 => 0.8651, std.dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: 4.01% (2.3764 => 2.4717, std.dev.: 0.0252) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 4.00% (0.9039 => 0.9401, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 4.00% (0.8007 => 0.8327, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.96% (0.8050 => 0.8369, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.93% (0.8597 => 0.8935, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.90% (0.5817 => 0.6044, std.dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 3.89% (1.1271 => 1.1709, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.88% (0.9908 => 1.0292, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.85% (1.2526 => 1.3008, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.85% (0.8712 => 0.9047, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 3.83% (0.8927 => 0.9269, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 3.83% (0.8885 => 0.9225, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.78% (0.8656 => 0.8983, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.74% (0.8204 => 0.8511, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.70% (0.8261 => 0.8567, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.68% (0.8359 => 0.8667, std.dev.: 0.0025) MultiSource/Applications/hbd/hbd: 3.68% (1.4269 => 1.4794, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.66% (0.8855 => 0.9179, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.66% (0.8420 => 0.8728, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.65% (0.8086 => 0.8381, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.65% (1.1685 => 1.2111, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.63% (0.8177 => 0.8474, std.dev.: 0.0062) MultiSource/Applications/lua/lua: 3.63% (3.8189 => 3.9576, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 3.62% (0.8069 => 0.8361, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.58% (0.8048 => 0.8336, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 3.51% (8.6247 => 8.9276, std.dev.: 0.1079) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.50% (0.8518 => 0.8816, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.45% (0.8316 => 0.8603, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.43% (0.8066 => 0.8343, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.36% (0.8805 => 0.9101, std.dev.: 0.0097) MultiSource/Applications/JM/ldecod/ldecod: 3.30% (6.7320 => 6.9541, std.dev.: 0.0543) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.29% (0.8716 => 0.9003, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/gs/gs: 3.23% (4.1305 => 4.2641, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.19% (0.8338 => 0.8604, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.17% (4.1763 => 4.3088, std.dev.: 0.0333) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.94% (0.7932 => 0.8165, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.85% (0.8286 => 0.8522, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.67% (4.4880 => 4.6079, std.dev.: 0.0321) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.61% (1.2602 => 1.2931, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.60% (8.6476 => 8.8727, std.dev.: 0.0672) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.59% (6.6074 => 6.7788, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.52% (0.7966 => 0.8167, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.53% (0.8995 => 0.9133, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 52.76% (0.0199 => 0.0304, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/pi: 36.22% (1.5795 => 2.1516, std.dev.: 0.0295) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 28.42% (2.9096 => 3.7366, std.dev.: 0.0701) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 21.21% (0.0528 => 0.0640, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.14% (4.8436 => 5.8675, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.95% (0.7597 => 0.8961, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.89% (8.2783 => 9.7592, std.dev.: 0.0182) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.80% (0.3186 => 0.3562, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.67% (2.7995 => 3.1262, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 10.16% (7.4933 => 8.2548, std.dev.: 0.0315) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.14% (1.1857 => 1.3059, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.39% (0.1129 => 0.1235, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.02% (6.3772 => 6.9525, std.dev.: 0.1973) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 8.05% (3.9917 => 4.3132, std.dev.: 0.1217) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.41% (23.5781 => 25.3249, std.dev.: 0.0640) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.34% (3.3761 => 3.5902, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 6.15% (0.2015 => 0.2139, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.97% (2.9753 => 3.1530, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.95% (4.8660 => 5.1553, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.75% (4.5327 => 4.7932, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 5.70% (0.5214 => 0.5511, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.56% (0.3937 => 0.4156, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.32% (5.4187 => 5.7071, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.17% (5.3218 => 5.5972, std.dev.: 0.0036) MultiSource/Applications/aha/aha: 4.75% (3.3398 => 3.4985, std.dev.: 0.0174) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 4.69% (0.4353 => 0.4557, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 4.03% (4.8362 => 5.0311, std.dev.: 0.0266) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.44% (1.0388 => 1.0745, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/power/power: 3.43% (1.2061 => 1.2475, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/queens: 3.17% (1.7056 => 1.7596, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.38% (3.4104 => 3.4916, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.11% (0.6150 => 0.6280, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/methcall: 1.95% (8.2676 => 8.4290, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.93% (1.2337 => 1.2575, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.63% (11.5690 => 11.7570, std.dev.: 0.0173) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.57% (1.5941 => 1.6191, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/ReedSolomon: 1.37% (8.5322 => 8.6489, std.dev.: 0.0357) MultiSource/Benchmarks/Olden/bh/bh: 1.35% (2.3560 => 2.3877, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: 1.16% (91.7701 => 92.8392, std.dev.: 0.2349) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.15% (4.9469 => 5.0039, std.dev.: 0.0130) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.12% (1.9302 => 1.9518, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.05% (6.1525 => 6.2170, std.dev.: 0.0249) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.14% (2.8951 => 1.6752, std.dev.: 0.0231) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -24.29% (7.2130 => 5.4613, std.dev.: 0.2945) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.32% (1.4529 => 1.1576, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.79% (9.9065 => 8.2429, std.dev.: 0.0114) MultiSource/Benchmarks/Olden/em3d/em3d: -13.21% (5.4641 => 4.7424, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/ary3: -13.15% (1.9999 => 1.7369, std.dev.: 0.1007) SingleSource/Benchmarks/Misc/flops-8: -9.37% (2.5609 => 2.3210, std.dev.: 0.0078) MultiSource/Benchmarks/mafft/pairlocalalign: -9.06% (63.1822 => 57.4569, std.dev.: 0.0729) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.38% (0.3269 => 0.2995, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.17% (1.0512 => 0.9653, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.23% (4.7482 => 4.4523, std.dev.: 0.0018) SingleSource/Benchmarks/Stanford/FloatMM: -6.19% (0.8807 => 0.8262, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.10% (5.1305 => 4.8177, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/sieve: -6.08% (7.0599 => 6.6306, std.dev.: 0.0232) SingleSource/Benchmarks/Misc/flops: -5.56% (9.3748 => 8.8535, std.dev.: 0.0394) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.43% (6.2275 => 5.8896, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.84% (5.6343 => 5.3616, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.60% (4.7449 => 4.5268, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.45% (6.1706 => 5.8958, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.31% (4.9453 => 4.7323, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.84% (2.8773 => 2.7668, std.dev.: 0.0270) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.79% (3.7148 => 3.5740, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.65% (5.1557 => 4.9677, std.dev.: 0.0010) MultiSource/Applications/lua/lua: -3.60% (29.8330 => 28.7596, std.dev.: 0.1434) SingleSource/Benchmarks/Misc/perlin: -3.36% (5.1084 => 4.9366, std.dev.: 0.0248) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.28% (4.9686 => 4.8057, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.20% (5.4300 => 5.2560, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: -3.14% (8.9760 => 8.6940, std.dev.: 0.0396) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.06% (2.6356 => 2.5813, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: -1.88% (1.4861 => 1.4581, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.85% (3.5679 => 3.5018, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.81% (3.3479 => 3.2873, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-5: -1.62% (2.8957 => 2.8488, std.dev.: 0.0128) MultiSource/Applications/JM/lencod/lencod: -1.51% (6.7064 => 6.6053, std.dev.: 0.0353) MultiSource/Benchmarks/FreeBench/neural/neural: -1.49% (1.0841 => 1.0679, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.47% (15.8853 => 15.6511, std.dev.: 0.0318) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.41% (4.2466 => 4.1866, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-6: -1.34% (2.4416 => 2.4088, std.dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.21% (1.5308 => 1.5123, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.12% (6.0224 => 5.9548, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.35% (1.0262 => 1.0708, std.dev.: 0.0132) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.47% (0.2463 => 0.3706, std.dev.: 0.1212) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 82.11% (0.0123 => 0.0224, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.64% (0.0408 => 0.0431, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.89% (0.0254 => 0.0335, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 12.24% (0.0384 => 0.0431, std.dev.: 0.0084) SingleSource/UnitTests/Vector/Altivec/casts: 10.00% (0.0190 => 0.0209, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/test1: 23.33% (0.0180 => 0.0222, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 1.25% (0.1438 => 0.1456, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -0.01% (1.1329 => 1.1328, std.dev.: 0.3521) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.12% (0.4164 => 0.4034, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.06% (0.1369 => 0.1452, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -12.01% (0.0641 => 0.0564, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 35.90% (0.0195 => 0.0265, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.46% (0.0578 => 0.0558, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.39% (1.1437 => 1.1482, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -71.43% (0.0014 => 0.0004, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.29% (0.0627 => 0.0575, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.56% (0.0180 => 0.0226, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.55% (0.8017 => 0.7973, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 74.19% (0.0062 => 0.0108, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 02:57:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 04:57:17 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121128105717.865D22A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6338?compare_to=6336&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6338, Order: 168779, Start Time: 2012-11-28 09:24:44, End Time: 2012-11-28 10:57:03 To: 6336, Order: 168775, Start Time: 2012-11-28 07:26:47, End Time: 2012-11-28 09:01:10 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (186 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (852 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.00% (2.0478 => 2.1093, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.4937 => 7.6827, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 2.14% (3.1932 => 3.2616, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.67% (0.3821 => 0.3528, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.04% (0.9542 => 0.8870, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.72% (0.3142 => 0.2931, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.65% (2.4924 => 2.3266, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.34% (0.2428 => 0.2274, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.32% (0.3357 => 0.3145, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -6.22% (9.2283 => 8.6546, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/oourafft: -6.16% (0.2160 => 0.2027, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -5.99% (7.0961 => 6.6712, std.dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: -5.99% (16.1920 => 15.2229, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.98% (0.9852 => 0.9263, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: -5.97% (0.9179 => 0.8631, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -5.96% (0.1879 => 0.1767, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.96% (0.5925 => 0.5572, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.94% (0.6484 => 0.6099, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.90% (0.1796 => 0.1690, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.90% (0.5863 => 0.5517, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: -5.90% (0.3831 => 0.3605, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.84% (0.5478 => 0.5158, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.83% (0.7198 => 0.6778, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.83% (0.5591 => 0.5265, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -5.82% (0.3880 => 0.3654, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.82% (1.0544 => 0.9930, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.82% (0.5705 => 0.5373, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.82% (0.2355 => 0.2218, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.79% (0.5802 => 0.5466, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: -5.78% (0.3896 => 0.3671, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.77% (0.5805 => 0.5470, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.77% (0.3848 => 0.3626, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.77% (0.3884 => 0.3660, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.76% (0.6304 => 0.5941, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.75% (0.5859 => 0.5522, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -5.74% (0.1761 => 0.1660, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.74% (1.3722 => 1.2935, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.72% (0.5857 => 0.5522, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -5.72% (0.3812 => 0.3594, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.71% (0.2695 => 0.2541, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.71% (0.3658 => 0.3449, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.70% (0.6297 => 0.5938, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.68% (0.5581 => 0.5264, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.68% (4.0323 => 3.8034, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/exceptions: -5.68% (0.4176 => 0.3939, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.67% (0.6667 => 0.6289, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.67% (1.2300 => 1.1603, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.66% (0.6660 => 0.6283, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.66% (0.5849 => 0.5518, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.66% (0.5570 => 0.5255, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.63% (0.6194 => 0.5845, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: -5.63% (0.4033 => 0.3806, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.61% (0.5575 => 0.5262, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -5.61% (1.1450 => 1.0808, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.60% (4.8161 => 4.5464, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.58% (0.6052 => 0.5714, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.58% (0.3891 => 0.3674, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.58% (0.6260 => 0.5911, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.56% (4.8802 => 4.6089, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.54% (0.6681 => 0.6311, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.54% (0.5688 => 0.5373, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.54% (0.6230 => 0.5885, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.52% (3.5339 => 3.3388, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.49% (0.6189 => 0.5849, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -5.49% (1.1530 => 1.0897, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.48% (0.7919 => 0.7485, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.48% (0.6736 => 0.6367, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.48% (0.6446 => 0.6093, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.47% (1.4642 => 1.3841, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.46% (1.6364 => 1.5470, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.46% (1.2784 => 1.2086, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.45% (4.5069 => 4.2611, std.dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.44% (6.7716 => 6.4032, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.41% (0.6676 => 0.6315, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.40% (0.5941 => 0.5620) SingleSource/UnitTests/ObjC/property: -5.38% (0.4199 => 0.3973, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -5.38% (4.3330 => 4.0998, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.37% (0.3016 => 0.2854, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.37% (17.1032 => 16.1849, std.dev.: 0.0217) MultiSource/Benchmarks/sim/sim: -5.34% (0.3406 => 0.3224, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.34% (0.3931 => 0.3721, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -5.32% (0.4515 => 0.4275, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.31% (0.3255 => 0.3082, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.30% (0.5456 => 0.5167, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.27% (0.5999 => 0.5683, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: -5.27% (1.2515 => 1.1856, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.24% (0.6293 => 0.5963, std.dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: -5.22% (1.3864 => 1.3140, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.22% (14.2083 => 13.4667, std.dev.: 0.0138) SingleSource/Regression/C++/ofstream_ctor: -5.20% (0.3059 => 0.2900, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.18% (0.4151 => 0.3936, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.18% (0.3323 => 0.3151, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.16% (8.0126 => 7.5992, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/bh/bh: -5.16% (0.2985 => 0.2831, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -5.16% (0.3026 => 0.2870, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -5.14% (0.4280 => 0.4060, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.13% (0.3837 => 0.3640, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.13% (0.4916 => 0.4664, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: -5.12% (15.5079 => 14.7132, std.dev.: 0.0190) MultiSource/Benchmarks/McCat/08-main/main: -5.11% (0.2659 => 0.2523, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -5.11% (1.3148 => 1.2476, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.11% (1.2221 => 1.1597, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.09% (0.8521 => 0.8087, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.09% (0.2278 => 0.2162, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.09% (0.6033 => 0.5726, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.06% (0.2548 => 0.2419) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.04% (1.2210 => 1.1595, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.04% (0.2999 => 0.2848, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: -5.03% (0.3581 => 0.3401, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -5.02% (3.5154 => 3.3390, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.01% (0.3252 => 0.3089, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.99% (2.1713 => 2.0629, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.97% (0.6395 => 0.6077, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -4.97% (0.3481 => 0.3308, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -4.96% (0.3446 => 0.3275, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.95% (0.5168 => 0.4912, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.95% (0.2989 => 0.2841, std.dev.: 0.0030) MultiSource/Applications/lua/lua: -4.95% (4.0594 => 3.8584, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/ary: -4.95% (0.3394 => 0.3226, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -4.95% (0.3194 => 0.3036, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.88% (0.4813 => 0.4578, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -4.82% (0.7982 => 0.7597, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.81% (0.4321 => 0.4113, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.81% (0.7339 => 0.6986, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.81% (0.3057 => 0.2910, std.dev.: 0.0045) MultiSource/Applications/ClamAV/clamscan: -4.81% (15.2527 => 14.5197, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/moments: -4.80% (0.4248 => 0.4044, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.80% (0.6440 => 0.6131, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.79% (0.3483 => 0.3316, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -4.79% (0.4861 => 0.4628, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -4.78% (0.3621 => 0.3448, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: -4.77% (0.7447 => 0.7092, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/fibo: -4.74% (0.2871 => 0.2735, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: -4.71% (0.3867 => 0.3685, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.70% (0.5569 => 0.5307, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: -4.70% (0.2939 => 0.2801, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.68% (0.7524 => 0.7172, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -4.64% (2.4021 => 2.2907, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.64% (0.2933 => 0.2797, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.62% (0.2903 => 0.2769, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -4.60% (0.2849 => 0.2718, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: -4.59% (0.3271 => 0.3121, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.58% (0.6395 => 0.6102, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.55% (0.3849 => 0.3674, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.53% (1.6474 => 1.5727, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.51% (0.5567 => 0.5316, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.49% (0.3205 => 0.3061, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: -4.49% (18.2933 => 17.4716, std.dev.: 0.0077) SingleSource/UnitTests/ObjC++/property-reference: -4.49% (0.7779 => 0.7430, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.48% (22.4056 => 21.4028, std.dev.: 0.0203) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.44% (0.7021 => 0.6709, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.44% (5.0226 => 4.7997, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.43% (0.4427 => 0.4231, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.39% (0.5329 => 0.5095, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.38% (0.9557 => 0.9138, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: -4.37% (2.1401 => 2.0466, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/hash: -4.35% (0.4524 => 0.4327, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: -4.33% (0.3788 => 0.3624, std.dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: -4.29% (34.0927 => 32.6314, std.dev.: 0.0356) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.26% (0.4083 => 0.3909, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.24% (0.6347 => 0.6078, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.22% (0.9077 => 0.8694, std.dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.16% (0.3319 => 0.3181, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: -4.12% (0.8418 => 0.8071, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: -3.99% (0.6441 => 0.6184, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.92% (0.3491 => 0.3354, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: -3.86% (1.5610 => 1.5008, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.83% (2.2587 => 2.1721, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: -3.78% (0.6750 => 0.6495, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.21% (5.4682 => 5.2925, std.dev.: 0.0069) SingleSource/UnitTests/Vector/constpool: -2.62% (20.7746 => 20.2313, std.dev.: 0.0247) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1953, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: -62.66% (1.8100 => 0.6758, std.dev.: 0.0104) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7509, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: -8.66% (1.2842 => 1.1730, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.84% (1.7753 => 1.7071, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.54% (2.2633 => 2.1831, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4000, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4710, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.40% (1.3096 => 1.2913, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 02:58:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 04:58:44 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121128105844.401002A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6339?compare_to=6334&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6339, Order: 168776, Start Time: 2012-11-28 08:40:06, End Time: 2012-11-28 10:58:35 To: 6334, Order: 168771, Start Time: 2012-11-28 05:26:10, End Time: 2012-11-28 07:44:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 48 (154 on baseline) Performance Improvements: 2 (42 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1036 (689 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 22.18% (0.0514 => 0.0628, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 13.56% (0.8515 => 0.9670, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 13.08% (1.7939 => 2.0286, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/nestedloop: 13.00% (0.3023 => 0.3416, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 11.90% (0.3329 => 0.3725, std.dev.: 0.0025) MultiSource/Applications/treecc/treecc: 11.79% (2.2836 => 2.5528, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout-C++/lists: 11.59% (0.3804 => 0.4245, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 11.54% (0.3032 => 0.3382, std.dev.: 0.0024) SingleSource/Benchmarks/LivermoreLoops/kernel16: 10.15% (0.1133 => 0.1248, std.dev.: 0.0002) SingleSource/Benchmarks/LivermoreLoops/kernel14: 9.81% (0.1091 => 0.1198, std.dev.: 0.0016) SingleSource/Benchmarks/LivermoreLoops/kernel13: 9.74% (0.1088 => 0.1194, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 9.50% (0.4283 => 0.4690, std.dev.: 0.0026) MultiSource/Applications/lua/lua: 9.50% (4.3817 => 4.7980, std.dev.: 0.0375) SingleSource/UnitTests/ObjC/for-in: 9.49% (0.4131 => 0.4523, std.dev.: 0.0040) SingleSource/Benchmarks/LivermoreLoops/kernel15: 9.37% (0.1184 => 0.1295, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 8.55% (0.2936 => 0.3187, std.dev.: 0.0053) SingleSource/UnitTests/ObjC++/property-reference: 8.45% (0.8045 => 0.8725, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.89% (0.5794 => 0.6251, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.79% (0.4621 => 0.4981, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 7.38% (0.3983 => 0.4277, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.22% (0.4180 => 0.4482, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.04% (0.4320 => 0.4624, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/moments: 6.69% (0.4707 => 0.5022, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.63% (0.3324 => 0.3511, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.60% (2.7068 => 2.8583, std.dev.: 0.0248) SingleSource/UnitTests/ObjC/trivial-interface: 4.15% (0.4049 => 0.4217, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/synchronized: 3.75% (0.4161 => 0.4317, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference-object: 3.55% (0.6952 => 0.7199, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 3.40% (0.6803 => 0.7034, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/property: 2.78% (0.4575 => 0.4702, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.62% (0.5466 => 0.5609, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 2.08% (0.5540 => 0.5655, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.95% (0.7012 => 0.7149, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 23.67% (3.7995 => 4.6988, std.dev.: 0.2040) SingleSource/Benchmarks/Shootout-C++/moments: 17.57% (0.1212 => 0.1425, std.dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 14.19% (0.1212 => 0.1384, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.82% (11.3457 => 12.8007, std.dev.: 0.0379) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.67% (2.2980 => 2.5661, std.dev.: 0.0843) MultiSource/Benchmarks/Olden/mst/mst: 8.37% (0.1314 => 0.1424, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 8.09% (2.8833 => 3.1167, std.dev.: 0.0748) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 5.54% (0.5327 => 0.5622, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/ffbench: 2.28% (1.0323 => 1.0558, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.05% (4.7164 => 4.8132, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash2: 2.04% (3.5707 => 3.6435, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/em3d/em3d: 1.86% (3.1203 => 3.1783, std.dev.: 0.0113) MultiSource/Applications/SIBsim4/SIBsim4: 1.49% (3.8566 => 3.9140, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.12% (3.0211 => 3.0550, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.09% (61.2058 => 61.8709, std.dev.: 0.0852) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/lencod/lencod: -1.32% (32.5293 => 32.1003, std.dev.: 0.0898) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -2.12% (27.7403 => 27.1509, std.dev.: 0.1940) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.42% (69.7433 => 69.4473, std.dev.: 0.0302) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.15% (0.1339 => 0.1337, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -9.52% (0.0462 => 0.0418, std.dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.40% (0.0668 => 0.0652, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -0.01% (494.0517 => 494.0072, std.dev.: 0.2680) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.81% (63.2438 => 69.4473, std.dev.: 0.0302) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43706.62% (1.1277 => 494.0072, std.dev.: 0.2680) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 193.29% (0.5229 => 1.5336, std.dev.: 0.0961) MultiSource/Applications/SPASS/SPASS: 18.19% (14.9895 => 17.7160, std.dev.: 0.3715) MultiSource/Applications/kimwitu++/kc: 46.12% (14.1553 => 20.6835, std.dev.: 0.7925) MultiSource/Benchmarks/MallocBench/gs/gs: 14.35% (4.1105 => 4.7003, std.dev.: 0.2717) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.41% (1.1048 => 1.5071, std.dev.: 0.0771) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 430.27% (7.1582 => 37.9577, std.dev.: 0.0770) SingleSource/Benchmarks/Misc-C++-EH/spirit: 94.98% (3.4629 => 6.7518, std.dev.: 0.1289) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.41% (0.6222 => 1.0292, std.dev.: 0.0551) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10627.64% (0.0720 => 7.7239, std.dev.: 0.2718) MultiSource/Applications/SIBsim4/SIBsim4: 3913900.00% (0.0001 => 3.9140, std.dev.: 0.0049) MultiSource/Applications/SPASS/SPASS: 13427100.00% (0.0001 => 13.4272, std.dev.: 2.0937) MultiSource/Applications/kimwitu++/kc: 52300.00% (0.0001 => 0.0524, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576500.00% (0.0001 => 0.5766, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10092200.00% (0.0001 => 10.0923, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5684100.00% (0.0001 => 5.6842, std.dev.: 0.3422) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1770.27% (1.1194 => 20.9358, std.dev.: 0.4049) MultiSource/Applications/ClamAV/clamscan: 66.93% (22.1758 => 37.0171, std.dev.: 0.4516) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 59.16% (2.9384 => 4.6769, std.dev.: 0.2820) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 49.44% (7.0540 => 10.5418, std.dev.: 0.3128) SingleSource/Benchmarks/CoyoteBench/almabench: 48.22% (0.0730 => 0.1082, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 46.33% (21.9371 => 32.1003, std.dev.: 0.0898) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 45.55% (8.1363 => 11.8423, std.dev.: 0.3737) MultiSource/Benchmarks/FreeBench/distray/distray: 43.94% (0.1056 => 0.1520, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/messages-2: 41.69% (0.0662 => 0.0938, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/messages: 38.84% (0.0327 => 0.0454, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 36.38% (0.1432 => 0.1953, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/fldry: 30.56% (0.0481 => 0.0628, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 30.10% (0.7433 => 0.9670, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 29.78% (2.2024 => 2.8583, std.dev.: 0.0248) SingleSource/UnitTests/vla: 29.58% (0.0355 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 28.54% (0.1584 => 0.2036, std.dev.: 0.0056) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 28.53% (0.1125 => 0.1446, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.91% (1.5859 => 2.0286, std.dev.: 0.0174) MultiSource/Benchmarks/Olden/voronoi/voronoi: 26.44% (0.2700 => 0.3414, std.dev.: 0.0091) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 26.23% (0.0953 => 0.1203, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 25.92% (2.0273 => 2.5528, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout-C++/hash: 25.76% (0.4289 => 0.5394, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.32% (0.0770 => 0.0965, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/lpbench: 24.76% (0.0929 => 0.1159, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.75% (0.2065 => 0.2576, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/moments: 24.06% (0.4048 => 0.5022, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 24.05% (0.3422 => 0.4245, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 23.91% (3.8723 => 4.7980, std.dev.: 0.0375) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.84% (0.1032 => 0.1278, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.59% (0.0746 => 0.0922, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/dry: 23.46% (0.0456 => 0.0563, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.45% (0.8172 => 1.0088, std.dev.: 0.0146) SingleSource/Benchmarks/Stanford/Oscar: 23.27% (0.0636 => 0.0784, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 22.56% (0.4064 => 0.4981, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions: 22.52% (0.3828 => 0.4690, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 22.45% (0.5105 => 0.6251, std.dev.: 0.0118) SingleSource/UnitTests/ObjC/for-in: 22.44% (0.3694 => 0.4523, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 22.40% (0.4620 => 0.5655, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/nestedloop: 22.31% (0.2793 => 0.3416, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 22.25% (0.2872 => 0.3511, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 21.95% (0.3927 => 0.4789, std.dev.: 0.0109) SingleSource/UnitTests/ObjC/instance-method-metadata: 21.85% (0.3543 => 0.4317, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/whetstone: 21.67% (0.0660 => 0.0803, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/trivial-interface: 21.42% (0.3473 => 0.4217, std.dev.: 0.0024) MultiSource/Benchmarks/NPB-serial/is/is: 21.42% (0.0719 => 0.0873, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.33% (0.0886 => 0.1075, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fbench: 21.28% (0.0592 => 0.0718, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 21.23% (0.3561 => 0.4317, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.07% (0.1566 => 0.1896, std.dev.: 0.0110) SingleSource/UnitTests/Vector/SSE/sse_isamax: 21.02% (0.0704 => 0.0852, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 21.00% (0.3886 => 0.4702, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 20.99% (0.4636 => 0.5609, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.97% (0.5569 => 0.6737, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/random: 20.70% (0.2802 => 0.3382, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.28% (0.3441 => 0.4139, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/tsp/tsp: 20.09% (0.1175 => 0.1411, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/reversefile: 19.64% (0.3865 => 0.4624, std.dev.: 0.0103) SingleSource/UnitTests/ObjC++/property-reference-object: 19.39% (0.6030 => 0.7199, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 19.10% (0.7326 => 0.8725, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 18.97% (0.3131 => 0.3725, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.90% (5.0018 => 5.9472, std.dev.: 0.0968) SingleSource/UnitTests/ObjC++/Hello: 18.72% (0.5925 => 0.7034, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 18.71% (0.3603 => 0.4277, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/mst/mst: 18.40% (0.1163 => 0.1377, std.dev.: 0.0052) MultiSource/Applications/minisat/minisat: 18.24% (0.7115 => 0.8413, std.dev.: 0.0459) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.07% (14.3668 => 16.9632, std.dev.: 0.6030) SingleSource/Benchmarks/Shootout-C++/hello: 17.43% (0.2714 => 0.3187, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.38% (4.2646 => 5.0058, std.dev.: 0.1860) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.28% (1.4186 => 1.6637, std.dev.: 0.0428) SingleSource/UnitTests/ObjC/exceptions-4: 16.79% (0.3543 => 0.4138, std.dev.: 0.0090) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.76% (0.0871 => 0.1017, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.67% (0.0648 => 0.0756, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 16.57% (5.7591 => 6.7132, std.dev.: 0.2922) SingleSource/Benchmarks/Shootout/lists: 16.45% (0.0626 => 0.0729) MultiSource/Applications/siod/siod: 16.10% (2.2969 => 2.6668, std.dev.: 0.0311) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.76% (0.3427 => 0.3967, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout/matrix: 15.65% (0.0818 => 0.0946, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 15.53% (0.1906 => 0.2202, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/health/health: 15.30% (0.1268 => 0.1462, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.20% (1.3050 => 1.5033, std.dev.: 0.0576) MultiSource/Applications/hbd/hbd: 14.80% (1.5603 => 1.7913, std.dev.: 0.0562) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.74% (0.3121 => 0.3581, std.dev.: 0.0162) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.68% (0.0770 => 0.0883, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.63% (0.0834 => 0.0956, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.47% (0.2758 => 0.3157, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.45% (4.9449 => 5.6594, std.dev.: 0.1919) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.29% (0.2107 => 0.2408, std.dev.: 0.0108) SingleSource/Benchmarks/McGill/exptree: 14.25% (0.0814 => 0.0930, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.91% (0.1337 => 0.1523, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.90% (0.3935 => 0.4482, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.84% (0.5981 => 0.6809, std.dev.: 0.0313) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.80% (0.1029 => 0.1171, std.dev.: 0.0035) MultiSource/Benchmarks/PAQ8p/paq8p: 13.78% (10.3673 => 11.7956, std.dev.: 0.1305) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.70% (0.3307 => 0.3760, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.50% (0.5860 => 0.6651, std.dev.: 0.0280) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.36% (0.9765 => 1.1070, std.dev.: 0.0456) MultiSource/Applications/sgefa/sgefa: 13.28% (0.3109 => 0.3522, std.dev.: 0.0094) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 13.28% (0.3177 => 0.3599, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 13.23% (0.1655 => 0.1874, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/oourafft: 13.19% (0.3282 => 0.3715, std.dev.: 0.0071) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.17% (0.2271 => 0.2570, std.dev.: 0.0093) MultiSource/Applications/sqlite3/sqlite3: 13.15% (17.1811 => 19.4400, std.dev.: 0.4847) SingleSource/UnitTests/ObjC/exceptions-2: 12.21% (0.3497 => 0.3924, std.dev.: 0.0158) SingleSource/UnitTests/ObjC/exceptions-3: 12.20% (0.3516 => 0.3945, std.dev.: 0.0163) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.20% (0.1143 => 0.1271, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.20% (0.1892 => 0.2085, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/lists1: 10.15% (0.3684 => 0.4058, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/ary2: 9.62% (0.3379 => 0.3704, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.38% (0.1268 => 0.1387, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary3: 8.99% (0.3283 => 0.3578, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 8.91% (0.3098 => 0.3374, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 8.88% (0.3232 => 0.3519, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 7.01% (0.1440 => 0.1541, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/ReedSolomon: 6.93% (0.2049 => 0.2191, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 151.09% (4.3953 => 11.0361, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/methcall: 147.61% (5.3999 => 13.3709, std.dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 31.58% (13.4384 => 17.6820, std.dev.: 0.5450) MultiSource/Benchmarks/VersaBench/dbms/dbms: 29.39% (1.5086 => 1.9520, std.dev.: 0.0260) SingleSource/Benchmarks/Shootout/ary3: 27.02% (3.6994 => 4.6988, std.dev.: 0.2040) SingleSource/Benchmarks/CoyoteBench/fftbench: 26.04% (2.0360 => 2.5661, std.dev.: 0.0843) SingleSource/Benchmarks/CoyoteBench/lpbench: 23.73% (10.3460 => 12.8007, std.dev.: 0.0379) SingleSource/Benchmarks/Shootout-C++/moments: 22.95% (0.1159 => 0.1425, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.31% (1.1145 => 1.3074, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: 16.18% (6.6465 => 7.7216, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 15.38% (3.1578 => 3.6435, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.55% (0.2944 => 0.3343, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/heapsort: 12.64% (3.8532 => 4.3402, std.dev.: 0.1734) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.64% (2.8904 => 3.2267, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 11.08% (0.9505 => 1.0558, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/mst/mst: 10.82% (0.1285 => 0.1424, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 10.21% (1.1396 => 1.2560, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 9.73% (0.7455 => 0.8180, std.dev.: 0.0113) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.42% (1.7254 => 1.8880, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.96% (4.2280 => 4.4801, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.11% (0.3070 => 0.3227, std.dev.: 0.0053) MultiSource/Applications/lua/lua: 4.06% (26.0924 => 27.1509, std.dev.: 0.1940) MultiSource/Benchmarks/nbench/nbench: 4.01% (11.6436 => 12.1107, std.dev.: 0.0075) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.32% (0.4162 => 0.4300, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 2.45% (3.1023 => 3.1783, std.dev.: 0.0113) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 2.04% (3.1595 => 3.2241, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: 2.00% (3.8526 => 3.9296, std.dev.: 0.0253) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.88% (2.1424 => 2.1827, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/ackermann: 1.75% (1.7133 => 1.7432, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.74% (2.3135 => 2.3538, std.dev.: 0.0068) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.55% (6.5088 => 6.6100, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 1.45% (85.0658 => 86.3031, std.dev.: 0.1738) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0313 => 1.0441, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0499, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.14% (5.2139 => 5.2734, std.dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: 1.13% (5.2636 => 5.3231, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.51% (6.6874 => 0.1664, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.94% (5.2763 => 1.2165, std.dev.: 0.0448) SingleSource/Benchmarks/Misc/salsa20: -75.78% (0.8651 => 0.2095, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/richards_benchmark: -45.25% (0.1622 => 0.0888, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.77% (5.3855 => 4.6441, std.dev.: 0.1669) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.01% (5.3526 => 4.6564, std.dev.: 0.1129) MultiSource/Applications/JM/ldecod/ldecod: -10.57% (10.4361 => 9.3325, std.dev.: 0.3133) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.96% (1.7609 => 1.6735, std.dev.: 0.0270) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -68.62% (32.5116 => 10.2018, std.dev.: 0.0352) SingleSource/Benchmarks/Dhrystone/fldry: -65.83% (1.9577 => 0.6690, std.dev.: 0.0135) SingleSource/Benchmarks/Dhrystone/dry: -51.55% (2.4116 => 1.1685, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.52% (0.0628 => 0.0361, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.31% (0.3987 => 0.2380, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.21% (4.5009 => 2.7811, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -33.39% (1.1492 => 0.7655, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.15% (2.6546 => 2.0135, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -19.34% (0.2161 => 0.1743, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.62% (1.6925 => 1.4281, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2840, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -10.65% (1.5373 => 1.3736, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -10.54% (9.5636 => 8.5554, std.dev.: 0.1512) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.05% (1.5660 => 1.4243, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.76% (3.2416 => 3.0550, std.dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.08% (0.8614 => 0.8176, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: -4.95% (1.5835 => 1.5051, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/lists: -4.19% (6.2999 => 6.0358, std.dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.32% (19.9488 => 19.2865, std.dev.: 0.2044) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8914, std.dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.29% (0.4808 => 0.4698, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.83% (8.1563 => 8.0072, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6771, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -1.52% (10.2830 => 10.1269, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.97% (0.1485 => 0.1337, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0013) Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 03:23:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 05:23:11 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121128112311.44A0D2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6340?compare_to=6333&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6340, Order: 168775, Start Time: 2012-11-28 07:58:43, End Time: 2012-11-28 11:23:45 To: 6333, Order: 168764, Start Time: 2012-11-28 03:49:36, End Time: 2012-11-28 07:10:31 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (165 on baseline) Performance Improvements: 4 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1088 (725 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.61% (3.1779 => 3.1268, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.12% (1.8970 => 1.8758, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.02% (5.1237 => 5.0714, std.dev.: 0.0111) MultiSource/Applications/SPASS/SPASS: -1.00% (6.2229 => 6.1604, std.dev.: 0.0070) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.84% (0.0625 => 0.0874, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.42% (0.1063 => 0.1397, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.73% (0.2969 => 0.3733, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.23% (0.1106 => 0.1385, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.16% (0.4253 => 0.5323, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.63% (0.0475 => 0.0592, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.47% (0.4139 => 0.5152, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.81% (0.0714 => 0.0884, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.58% (0.5900 => 0.7291, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 23.48% (1.5932 => 1.9673, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 23.45% (0.0452 => 0.0558, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.31% (0.4994 => 0.6158, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.60% (0.0584 => 0.0716, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.58% (0.5000 => 0.6129, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.12% (0.0547 => 0.0668, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.42% (0.1620 => 0.1967, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.40% (0.0897 => 0.1089, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.35% (0.1021 => 0.1239, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 21.20% (0.0599 => 0.0726, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.14% (0.1107 => 0.1341, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.07% (0.0541 => 0.0655, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.79% (0.1549 => 0.1871, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.57% (0.1604 => 0.1934, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.13% (0.1103 => 0.1325, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.91% (0.0633 => 0.0759, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 19.83% (0.0948 => 0.1136, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.78% (0.0642 => 0.0769, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.69% (0.0584 => 0.0699, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.63% (0.3903 => 0.4669, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/health/health: 19.49% (0.0821 => 0.0981, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.34% (0.1003 => 0.1197, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.10% (0.0822 => 0.0979, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 19.04% (0.0604 => 0.0719, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 18.78% (0.1619 => 0.1923, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.40% (0.1462 => 0.1731, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 18.16% (0.0947 => 0.1119, std.dev.: 0.0022) MultiSource/Applications/sgefa/sgefa: 18.07% (0.0808 => 0.0954, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 18.06% (0.5826 => 0.6878, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.91% (0.2736 => 0.3226, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.87% (0.3890 => 0.4585, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 17.73% (0.5889 => 0.6933, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.53% (0.2014 => 0.2367, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.48% (0.2866 => 0.3367, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.32% (1.3152 => 1.5430, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/mst/mst: 17.19% (0.0698 => 0.0818, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 17.13% (0.4029 => 0.4719, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: 17.08% (0.1218 => 0.1426, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 16.77% (0.5546 => 0.6476, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 16.74% (0.1505 => 0.1757, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 16.73% (0.1088 => 0.1270, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 16.69% (0.0605 => 0.0706, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.65% (0.5026 => 0.5863, std.dev.: 0.0017) MultiSource/Applications/hbd/hbd: 16.60% (0.9697 => 1.1307, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 16.52% (1.8794 => 2.1899, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 16.48% (0.7171 => 0.8353, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.42% (0.3271 => 0.3808, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.38% (0.2875 => 0.3346, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.34% (0.4658 => 0.5419, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.29% (3.5627 => 4.1431, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/strcat: 16.18% (0.2750 => 0.3195, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.06% (0.1968 => 0.2284, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 16.00% (0.2725 => 0.3161, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 15.96% (0.2813 => 0.3262, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hello: 15.95% (0.2714 => 0.3147, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 15.94% (0.2823 => 0.3273, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/matrix: 15.90% (0.2780 => 0.3222, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.87% (0.2729 => 0.3162, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.84% (0.2911 => 0.3372, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.83% (0.3930 => 0.4552, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.78% (0.1160 => 0.1343, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.71% (1.6211 => 1.8758, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.65% (0.3195 => 0.3695, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 15.62% (0.9909 => 1.1457, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 15.60% (0.3096 => 0.3579, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.59% (2.0673 => 2.3896, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 15.48% (0.1421 => 0.1641, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 15.41% (1.0781 => 1.2442, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.36% (0.4361 => 0.5031, std.dev.: 0.0019) SingleSource/Regression/C++/ofstream_ctor: 15.35% (0.3004 => 0.3465, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/ary3: 15.15% (0.3267 => 0.3762, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.11% (0.3362 => 0.3870, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/bh/bh: 15.11% (0.1284 => 0.1478, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.03% (4.4195 => 5.0838, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/ary: 14.95% (0.3258 => 0.3745, std.dev.: 0.0121) MultiSource/Applications/ClamAV/clamscan: 14.90% (4.2109 => 4.8383, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.80% (0.3060 => 0.3513, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 14.75% (23.5202 => 26.9883, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/ary2: 14.74% (0.3317 => 0.3806, std.dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.57% (2.7292 => 3.1268, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.51% (1.9694 => 2.2551, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.50% (0.1090 => 0.1248, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.40% (0.3124 => 0.3574, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.25% (1.9966 => 2.2812, std.dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 14.22% (0.2566 => 0.2931, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 14.22% (0.3726 => 0.4256, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/lists: 14.16% (0.3348 => 0.3822, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.14% (0.3282 => 0.3746, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 14.07% (0.2075 => 0.2367, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.90% (0.3625 => 0.4129, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/hash: 13.70% (0.4146 => 0.4714, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/hash2: 13.62% (0.4251 => 0.4830, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.59% (0.3981 => 0.4522, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.41% (0.3690 => 0.4185, std.dev.: 0.0117) MultiSource/Applications/lua/lua: 13.41% (1.4269 => 1.6182, std.dev.: 0.0030) MultiSource/Applications/treecc/treecc: 12.98% (0.7875 => 0.8897, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 12.77% (0.5012 => 0.5652, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.67% (0.3488 => 0.3930, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 12.57% (4.6177 => 5.1980, std.dev.: 0.0108) MultiSource/Applications/JM/ldecod/ldecod: 12.48% (2.1653 => 2.4356, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.29% (0.1383 => 0.1553, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.27% (0.3465 => 0.3890, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.22% (0.3446 => 0.3867, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.19% (0.3496 => 0.3922, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.14% (0.3460 => 0.3880, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.11% (0.3469 => 0.3889, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 12.09% (0.3442 => 0.3858, std.dev.: 0.0077) MultiSource/Applications/SIBsim4/SIBsim4: 11.97% (0.2691 => 0.3013, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 11.86% (2.1013 => 2.3506, std.dev.: 0.0144) SingleSource/UnitTests/ObjC/property: 11.86% (0.3650 => 0.4083, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.80% (0.3643 => 0.4073, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.76% (0.2040 => 0.2280, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.71% (0.3724 => 0.4160, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.69% (0.6435 => 0.7187, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 11.16% (5.5417 => 6.1604, std.dev.: 0.0070) MultiSource/Applications/lambda-0_1_3/lambda: 11.12% (0.3498 => 0.3887, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.81% (0.2737 => 0.3033, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.41% (0.1028 => 0.1135, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.40% (0.2068 => 0.2283, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 10.27% (0.4847 => 0.5345, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 10.14% (0.6634 => 0.7307, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.12% (0.3084 => 0.3396, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 9.65% (0.3336 => 0.3658, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 9.18% (2.0346 => 2.2213, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.13% (0.2103 => 0.2295, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 8.95% (0.2391 => 0.2605, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.18% (11.6398 => 12.5921, std.dev.: 0.0158) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.07% (4.6926 => 5.0714, std.dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.55% (0.5361 => 0.5766, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.43% (0.7426 => 0.7978, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.07% (0.5584 => 0.5979, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 6.40% (11.9555 => 12.7209, std.dev.: 0.0078) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.98% (0.3792 => 0.3905, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 67.81% (0.2162 => 0.3628, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0120) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.26% (0.0734 => 0.0868, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.98% (29.0505 => 33.4026, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 9.67% (0.2802 => 0.3073, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6101, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.26% (0.3693 => 0.3924, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 5.05% (12.0509 => 12.6589, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/flops-2: 4.81% (1.8057 => 1.8926, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1677, std.dev.: 0.0149) SingleSource/Benchmarks/Dhrystone/dry: 2.64% (14.0481 => 14.4191, std.dev.: 0.1084) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2057, std.dev.: 0.0092) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.55% (3.1722 => 3.2215, std.dev.: 0.0042) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3057, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2879, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5141, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5825, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.22% (2.4764 => 2.4214, std.dev.: 0.0108) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -36.05% (25.4195 => 16.2562, std.dev.: 0.1627) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9773, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8010, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9576, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -6.54% (0.2402 => 0.2245, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8037, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.16% (0.6293 => 0.6094, std.dev.: 0.0032) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -2.86% (17.2379 => 16.7457, std.dev.: 0.1496) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8615, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5746, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4973, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1591, std.dev.: 0.0535) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0446, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 03:41:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 05:41:39 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121128114139.60EC02A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6341?compare_to=6337&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6341, Order: 168779, Start Time: 2012-11-28 10:11:25, End Time: 2012-11-28 11:42:13 To: 6337, Order: 168776, Start Time: 2012-11-28 08:23:17, End Time: 2012-11-28 09:54:30 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 7 (114 on baseline) Performance Improvements: 3 (40 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1041 (819 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 5.08% (0.2598 => 0.2730, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.80% (0.3024 => 0.3139, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.88% (1.2931 => 1.3303, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.26% (4.6356 => 4.6940, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.25% (0.9427 => 0.9545, std.dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 1.10% (1.1709 => 1.1838, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.04% (6.7788 => 6.8493, std.dev.: 0.0178) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.31% (0.2439 => 0.2334, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.06% (0.3533 => 0.3425, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: -5.59% (0.2181 => 0.2059, std.dev.: 0.0025) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.92% (1.0708 => 1.0806, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.59% (0.3706 => 0.3684, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.89% (0.0224 => 0.0222, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.46% (0.0431 => 0.0429, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.30% (0.0335 => 0.0334, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0316 => 0.0316, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.46% (0.0431 => 0.0429, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -1.44% (0.0209 => 0.0206, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -14.86% (0.0222 => 0.0189, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 500.00% (0.0001 => 0.0006, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.41% (0.1456 => 0.1462, std.dev.: 0.0123) MultiSource/Applications/lemon/lemon: -2.63% (1.1328 => 1.1030, std.dev.: 0.3794) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.90% (0.4034 => 0.3917, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.76% (0.1452 => 0.1441, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.28% (0.0564 => 0.0622, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.43% (0.0265 => 0.0240, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.15% (0.0558 => 0.0570, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.12% (1.1482 => 1.1468, std.dev.: 0.1045) MultiSource/Benchmarks/SciMark2-C/scimark2: 0.05% (9.3870 => 9.3913, std.dev.: 0.0348) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -75.00% (0.0004 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.04% (0.0575 => 0.0523, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -9.73% (0.0226 => 0.0204, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.03% (0.7973 => 0.8055, std.dev.: 0.0611) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: -45.37% (0.0108 => 0.0059, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/SciMark2-C/scimark2: -67.14% (28.5821 => 9.3913, std.dev.: 0.0348) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.99% (16.4461 => 17.9241, std.dev.: 0.4171) MultiSource/Applications/sqlite3/sqlite3: 2369.82% (0.6332 => 15.6389, std.dev.: 0.7618) MultiSource/Benchmarks/McCat/08-main/main: 49.10% (0.1831 => 0.2730, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.91% (0.1559 => 0.1498, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7111.94% (0.3123 => 22.5229, std.dev.: 0.1307) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1536.45% (0.3344 => 5.4723, std.dev.: 0.2677) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.07% (0.2364 => 0.3264, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++/bigfib: 4.96% (0.6010 => 0.6308, std.dev.: 0.0157) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.87% (0.3266 => 0.3425, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: 3.76% (0.1969 => 0.2043, std.dev.: 0.0699) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.68% (0.0224 => 0.0230, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -30.87% (0.0230 => 0.0159, std.dev.: 0.0008) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0505, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 8.55% (0.1462 => 0.1587, std.dev.: 0.0116) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4098, std.dev.: 0.0628) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0694, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4925, std.dev.: 0.0071) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5148, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2820, std.dev.: 0.0382) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0696, std.dev.: 0.1291) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3614, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3864, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0845, std.dev.: 0.0022) SingleSource/Regression/C/uint64_to_float: -29.77% (2.1832 => 1.5332, std.dev.: 0.0301) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.68% (0.0848 => 0.0981, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.31% (0.0810 => 0.0934, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 11.06% (0.1112 => 0.1235, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.40% (0.4127 => 0.4515, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.04% (0.2180 => 0.2377, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.59% (0.8321 => 0.9036, std.dev.: 0.0204) MultiSource/Benchmarks/sim/sim: 8.25% (0.3226 => 0.3492, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.04% (0.6010 => 0.6493, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.30% (0.1466 => 0.1573, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 7.06% (0.6287 => 0.6731, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.95% (0.9435 => 1.0091, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.46% (0.4847 => 0.5160, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.38% (0.7473 => 0.7950, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.27% (13.1811 => 14.0070, std.dev.: 0.1044) MultiSource/Benchmarks/Olden/em3d/em3d: 6.04% (0.1721 => 0.1825, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.96% (1.3279 => 1.4071, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 5.79% (0.8007 => 0.8471, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.56% (1.2602 => 1.3303, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.40% (0.9056 => 0.9545, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.21% (0.9039 => 0.9510, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.16% (0.9688 => 1.0188, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.09% (1.2526 => 1.3164, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.09% (0.5191 => 0.5455, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.05% (0.8611 => 0.9046, std.dev.: 0.0078) MultiSource/Benchmarks/nbench/nbench: 5.03% (1.1271 => 1.1838, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.86% (0.7966 => 0.8353, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.84% (0.8331 => 0.8734, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.73% (0.8050 => 0.8431, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/football/football: 4.71% (0.8768 => 0.9181, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.69% (0.8457 => 0.8854, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.66% (1.6386 => 1.7150, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.66% (0.8716 => 0.9122, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.64% (8.6476 => 9.0492, std.dev.: 0.0877) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 4.62% (0.9069 => 0.9488, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.61% (0.8885 => 0.9295, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.58% (0.9074 => 0.9490, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.57% (0.5817 => 0.6083, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.54% (0.8656 => 0.9049, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.53% (0.3003 => 0.3139, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.50% (0.8286 => 0.8659, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 4.47% (0.8048 => 0.8408, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.46% (0.9908 => 1.0350, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.43% (0.8518 => 0.8895, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 4.42% (0.8597 => 0.8977, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.38% (0.2741 => 0.2861, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 4.33% (0.8177 => 0.8531, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4.32% (0.8317 => 0.8676, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 4.31% (0.8204 => 0.8558, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.24% (0.8069 => 0.8411, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.20% (0.8316 => 0.8665, std.dev.: 0.0115) MultiSource/Benchmarks/PAQ8p/paq8p: 4.19% (2.3764 => 2.4759, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.11% (0.7932 => 0.8258, std.dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.04% (0.3717 => 0.3867, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.03% (4.1763 => 4.3448, std.dev.: 0.0576) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 4.03% (0.8359 => 0.8696, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.02% (0.8338 => 0.8673, std.dev.: 0.0052) MultiSource/Applications/lua/lua: 3.97% (3.8189 => 3.9706, std.dev.: 0.0326) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.97% (0.8712 => 0.9058, std.dev.: 0.0095) MultiSource/Applications/minisat/minisat: 3.85% (0.6834 => 0.7097, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.83% (0.8805 => 0.9142, std.dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: 3.80% (8.6247 => 8.9528, std.dev.: 0.0377) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 3.73% (0.8927 => 0.9260, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.73% (0.8855 => 0.9185, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.72% (0.8066 => 0.8366, std.dev.: 0.0098) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.66% (6.6074 => 6.8493, std.dev.: 0.0178) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.62% (0.4783 => 0.4956, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.61% (0.8261 => 0.8559, std.dev.: 0.0110) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.59% (1.1606 => 1.2023, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.54% (4.4880 => 4.6467, std.dev.: 0.0258) MultiSource/Benchmarks/Bullet/bullet: 2.89% (31.8598 => 32.7796, std.dev.: 0.0898) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.71% (4.5702 => 4.6940, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.63% (4.4873 => 4.6055, std.dev.: 0.0304) MultiSource/Benchmarks/McCat/05-eks/eks: 2.32% (0.4397 => 0.4499, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.11% (1.4479 => 1.4785, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.81% (0.8995 => 0.9158, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.46% (1.2423 => 1.2604, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 27.97% (2.9096 => 3.7235, std.dev.: 0.0234) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.23% (4.8436 => 5.8719, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.89% (8.2783 => 9.7596, std.dev.: 0.0231) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.39% (0.7597 => 0.8918, std.dev.: 0.0144) SingleSource/Benchmarks/McGill/misr: 16.55% (0.4001 => 0.4663, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.77% (2.7995 => 3.1291, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 10.31% (7.4933 => 8.2655, std.dev.: 0.0174) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.23% (1.1857 => 1.3070, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.38% (0.3186 => 0.3485, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.08% (6.3772 => 6.8922, std.dev.: 0.1492) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.38% (23.5781 => 25.3181, std.dev.: 0.0310) MultiSource/Benchmarks/McCat/18-imp/imp: 7.37% (0.1370 => 0.1471, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.07% (3.9917 => 4.2740, std.dev.: 0.0297) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.35% (3.3761 => 3.5905, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.02% (2.9753 => 3.1545, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.95% (4.8660 => 5.1557, std.dev.: 0.0259) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.77% (0.3937 => 0.4164, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.60% (4.5327 => 4.7867, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.36% (5.4187 => 5.7090, std.dev.: 0.0243) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.17% (5.3218 => 5.5968, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 4.99% (0.4353 => 0.4570, std.dev.: 0.0016) MultiSource/Applications/aha/aha: 4.86% (3.3398 => 3.5022, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/richards_benchmark: 4.43% (1.3037 => 1.3615, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.37% (0.5214 => 0.5442, std.dev.: 0.0034) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.78% (0.2887 => 0.2996, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.28% (4.8362 => 4.9950, std.dev.: 0.0203) MultiSource/Benchmarks/Olden/power/power: 2.83% (1.2061 => 1.2402, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.62% (1.2337 => 1.2660, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.37% (3.4104 => 3.4911, std.dev.: 0.0304) SingleSource/Benchmarks/Dhrystone/dry: 2.26% (0.5081 => 0.5196, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/queens: 2.23% (1.7056 => 1.7436, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.15% (0.6150 => 0.6282, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/methcall: 2.11% (8.2676 => 8.4420, std.dev.: 0.0397) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.89% (11.5690 => 11.7877, std.dev.: 0.0111) MultiSource/Benchmarks/Olden/bh/bh: 1.50% (2.3560 => 2.3914, std.dev.: 0.0118) MultiSource/Benchmarks/PAQ8p/paq8p: 1.29% (91.7701 => 92.9565, std.dev.: 0.0365) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.16% (4.9469 => 5.0043, std.dev.: 0.0118) MultiSource/Benchmarks/sim/sim: 1.12% (3.8206 => 3.8635, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.09% (2.8951 => 1.6766, std.dev.: 0.1104) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -25.64% (7.2130 => 5.3635, std.dev.: 0.0659) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -17.00% (9.9065 => 8.2220, std.dev.: 0.0205) SingleSource/Benchmarks/Shootout-C++/ary3: -12.84% (1.9999 => 1.7432, std.dev.: 0.0299) MultiSource/Benchmarks/Olden/em3d/em3d: -12.82% (5.4641 => 4.7638, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -10.71% (0.3269 => 0.2919, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: -9.69% (1.1216 => 1.0129, std.dev.: 0.0380) MultiSource/Benchmarks/mafft/pairlocalalign: -9.13% (63.1822 => 57.4109, std.dev.: 0.0213) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.00% (1.0512 => 0.9566, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.83% (3.2169 => 2.9649, std.dev.: 0.0712) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.23% (4.7482 => 4.4524, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.10% (5.1305 => 4.8173, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout/sieve: -6.01% (7.0599 => 6.6357, std.dev.: 0.0140) SingleSource/Benchmarks/Stanford/FloatMM: -5.94% (0.8807 => 0.8284, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/flops: -5.46% (9.3748 => 8.8626, std.dev.: 0.0215) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.37% (6.2275 => 5.8933, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.85% (5.6343 => 5.3610, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: -4.58% (1.4296 => 1.3641, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.55% (4.7449 => 4.5290, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.43% (6.1706 => 5.8971, std.dev.: 0.0343) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.30% (4.9453 => 4.7328, std.dev.: 0.0011) MultiSource/Applications/lua/lua: -3.81% (29.8330 => 28.6961, std.dev.: 0.0744) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.80% (3.7148 => 3.5736, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/perlin: -3.73% (5.1084 => 4.9179, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.62% (5.1557 => 4.9689, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/methcall: -3.56% (8.9760 => 8.6567, std.dev.: 0.0806) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.36% (4.9686 => 4.8017, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.26% (5.4300 => 5.2530, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.21% (1.3882 => 1.3436, std.dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.81% (2.6356 => 2.5616, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/hash: -2.80% (4.3087 => 4.1882, std.dev.: 0.0348) MultiSource/Applications/siod/siod: -2.61% (3.6643 => 3.5688, std.dev.: 0.0317) SingleSource/Benchmarks/Misc/fbench: -2.47% (3.3840 => 3.3003, std.dev.: 0.0233) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.68% (1.5866 => 1.5599, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/fp-convert: -1.59% (15.8853 => 15.6327, std.dev.: 0.0290) MultiSource/Benchmarks/FreeBench/neural/neural: -1.48% (1.0841 => 1.0681, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: -1.45% (1.4861 => 1.4645, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-6: -1.36% (2.4416 => 2.4083, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.22% (4.2466 => 4.1946, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.14% (4.7794 => 4.7251, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 5.30% (1.0262 => 1.0806, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.57% (0.2463 => 0.3684, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 80.49% (0.0123 => 0.0222, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.15% (0.0408 => 0.0429, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.50% (0.0254 => 0.0334, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.72% (0.0384 => 0.0429, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 8.42% (0.0190 => 0.0206, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 5.00% (0.0180 => 0.0189, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -14.29% (0.0007 => 0.0006, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 1.67% (0.1438 => 0.1462, std.dev.: 0.0123) MultiSource/Applications/lemon/lemon: -2.64% (1.1329 => 1.1030, std.dev.: 0.3794) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.93% (0.4164 => 0.3917, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.26% (0.1369 => 0.1441, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.96% (0.0641 => 0.0622, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 23.08% (0.0195 => 0.0240, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.38% (0.0578 => 0.0570, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.27% (1.1437 => 1.1468, std.dev.: 0.1045) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -16.59% (0.0627 => 0.0523, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 13.33% (0.0180 => 0.0204, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.47% (0.8017 => 0.8055, std.dev.: 0.0611) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: -4.84% (0.0062 => 0.0059, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 04:53:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 06:53:06 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121128125306.596D72A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6342?compare_to=6338&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6342, Order: 168782, Start Time: 2012-11-28 11:21:19, End Time: 2012-11-28 12:53:38 To: 6338, Order: 168779, Start Time: 2012-11-28 09:24:44, End Time: 2012-11-28 10:57:03 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (182 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (855 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.11% (1.1490 => 1.1618, std.dev.: 0.0025) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1013, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/salsa20: 2.54% (7.4937 => 7.6837, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/hash2: 2.20% (3.1932 => 3.2633, std.dev.: 0.0028) MultiSource/Benchmarks/llubenchmark/llu: 2.07% (3.7435 => 3.8209, std.dev.: 0.0227) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.62% (0.3821 => 0.3530, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.38% (0.9542 => 0.8838, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.81% (0.3142 => 0.2928, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.46% (0.3357 => 0.3140, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: -6.44% (0.2160 => 0.2021, std.dev.: 0.0040) MultiSource/Benchmarks/PAQ8p/paq8p: -6.40% (2.4924 => 2.3328, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-2: -6.34% (0.3831 => 0.3588, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.31% (0.3880 => 0.3635, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.29% (0.3848 => 0.3606, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.27% (0.3812 => 0.3573, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -6.26% (9.2283 => 8.6504, std.dev.: 0.0130) SingleSource/UnitTests/ObjC/synchronized: -6.24% (0.3896 => 0.3653, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.20% (0.3884 => 0.3643, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: -6.07% (16.1920 => 15.2090, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.07% (0.1796 => 0.1687, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -6.07% (0.1879 => 0.1765, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: -6.05% (0.4033 => 0.3789, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.04% (0.9852 => 0.9257, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -6.00% (7.0961 => 6.6701, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/football/football: -6.00% (0.9179 => 0.8628, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.96% (0.5857 => 0.5508, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.95% (1.0544 => 0.9917, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.94% (0.3891 => 0.3660, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.94% (0.5863 => 0.5515, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: -5.91% (0.4176 => 0.3929, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.89% (0.6484 => 0.6102, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.88% (0.5478 => 0.5156, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.87% (0.5805 => 0.5464, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.87% (0.5591 => 0.5263, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.83% (0.6260 => 0.5895, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.82% (0.2355 => 0.2218, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.81% (0.2428 => 0.2287, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.80% (0.5705 => 0.5374, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.79% (0.5925 => 0.5582, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.78% (0.6052 => 0.5702, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.77% (0.6304 => 0.5940, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.75% (0.6660 => 0.6277, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.74% (0.3658 => 0.3448, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.73% (0.5849 => 0.5514, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.73% (0.5570 => 0.5251, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.72% (0.7198 => 0.6786, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.71% (0.2695 => 0.2541, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.70% (0.5575 => 0.5257, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.70% (0.5859 => 0.5525, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.68% (4.0323 => 3.8031, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.67% (0.5941 => 0.5604, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: -5.67% (0.4199 => 0.3961, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.67% (0.6194 => 0.5843, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.66% (4.8161 => 4.5434, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.65% (0.6667 => 0.6290, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.64% (0.5581 => 0.5266, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.64% (0.5802 => 0.5475, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.62% (0.6230 => 0.5880, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.62% (0.6446 => 0.6084, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.61% (0.6297 => 0.5944, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.59% (0.6189 => 0.5843, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.59% (0.5456 => 0.5151, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: -5.59% (1.1530 => 1.0886, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.57% (3.5339 => 3.3372, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.56% (0.5688 => 0.5372, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.56% (4.8802 => 4.6091, std.dev.: 0.0113) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.55% (6.7716 => 6.3955, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.54% (0.6676 => 0.6306, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.54% (1.3722 => 1.2962, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.52% (1.2300 => 1.1621, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: -5.52% (1.1450 => 1.0818, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: -5.49% (0.4515 => 0.4267, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.46% (1.4642 => 1.3842, std.dev.: 0.0068) MultiSource/Applications/SIBsim4/SIBsim4: -5.45% (1.3864 => 1.3109, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.43% (0.6440 => 0.6090, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -5.40% (0.3406 => 0.3222, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.40% (4.5069 => 4.2637, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.39% (0.6033 => 0.5708, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.37% (1.2784 => 1.2097, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.37% (0.6681 => 0.6322, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.36% (0.6736 => 0.6375, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: -5.32% (4.3330 => 4.1025, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.31% (0.6293 => 0.5959, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.26% (1.6364 => 1.5503, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -5.26% (0.4280 => 0.4055, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -5.24% (17.1032 => 16.2078, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.22% (8.0126 => 7.5941, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.22% (0.7919 => 0.7506, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.19% (0.8521 => 0.8079, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.17% (0.4916 => 0.4662, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.16% (14.2083 => 13.4751, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.12% (0.5999 => 0.5692, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: -5.07% (15.5079 => 14.7212, std.dev.: 0.0159) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.03% (0.2385 => 0.2265, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.97% (0.7339 => 0.6974, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.97% (0.2999 => 0.2850, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.96% (0.2278 => 0.2165, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.95% (0.2548 => 0.2422, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.91% (0.6395 => 0.6081, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -4.89% (0.2659 => 0.2529, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -4.89% (0.3581 => 0.3406, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.88% (0.7524 => 0.7157, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.86% (0.5168 => 0.4917, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -4.85% (15.2527 => 14.5123, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.85% (0.3483 => 0.3314, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.85% (0.5569 => 0.5299, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -4.83% (1.2515 => 1.1910, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.77% (1.2221 => 1.1638, std.dev.: 0.0015) MultiSource/Applications/lua/lua: -4.74% (4.0594 => 3.8668, std.dev.: 0.0133) MultiSource/Applications/d/make_dparser: -4.74% (3.5154 => 3.3487, std.dev.: 0.0056) MultiSource/Applications/minisat/minisat: -4.73% (0.7447 => 0.7095, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.72% (0.5567 => 0.5304, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.68% (0.6395 => 0.6096, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -4.67% (1.3148 => 1.2534, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -4.62% (0.2985 => 0.2847, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.58% (1.6474 => 1.5719, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.58% (0.3931 => 0.3751, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (0.7021 => 0.6703, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.52% (0.5329 => 0.5088, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.46% (0.4151 => 0.3966, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.44% (1.2210 => 1.1668, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: -4.43% (2.1401 => 2.0454, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.39% (0.3323 => 0.3177, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.38% (0.3057 => 0.2923, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.37% (22.4056 => 21.4260, std.dev.: 0.0060) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.31% (0.3319 => 0.3176, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: -4.26% (0.4861 => 0.4654, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -4.25% (0.8418 => 0.8060, std.dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: -4.25% (0.3059 => 0.2929, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -4.24% (0.3255 => 0.3117, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.19% (0.2933 => 0.2810, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.18% (0.3252 => 0.3116, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -4.18% (0.2871 => 0.2751, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -4.15% (0.2939 => 0.2817, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.14% (0.9557 => 0.9161, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -4.13% (2.4021 => 2.3029, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.11% (0.3016 => 0.2892, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -4.11% (0.3481 => 0.3338, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -4.10% (34.0927 => 32.6935, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.09% (2.1713 => 2.0824, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.09% (0.3837 => 0.3680, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.07% (0.4813 => 0.4617, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.06% (0.2903 => 0.2785, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -4.04% (0.2849 => 0.2734, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: -4.03% (0.3025 => 0.2903, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.03% (0.4321 => 0.4147, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: -4.01% (0.7982 => 0.7662, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -4.01% (0.3194 => 0.3066, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -3.99% (0.3205 => 0.3077, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -3.99% (18.2933 => 17.5632, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/strcat: -3.95% (0.2989 => 0.2871, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.92% (0.9077 => 0.8721, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/except: -3.90% (0.3026 => 0.2908, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -3.90% (0.7779 => 0.7476, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.89% (0.4083 => 0.3924, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: -3.89% (0.3394 => 0.3262, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: -3.89% (0.3446 => 0.3312, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -3.85% (0.3867 => 0.3718, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.80% (2.2587 => 2.1728, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.72% (0.3491 => 0.3361, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -3.72% (0.4248 => 0.4090, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.66% (0.6441 => 0.6205, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -3.62% (0.6347 => 0.6117, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.53% (5.0226 => 4.8455, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: -3.53% (0.6750 => 0.6512, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -3.40% (0.4524 => 0.4370, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.37% (0.4427 => 0.4278, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.26% (5.4682 => 5.2900, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sieve: -3.14% (0.3788 => 0.3669, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -2.99% (1.5610 => 1.5143, std.dev.: 0.0067) SingleSource/UnitTests/Vector/constpool: -2.71% (20.7746 => 20.2123, std.dev.: 0.0394) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1957, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/fldry: -62.24% (1.8100 => 0.6835, std.dev.: 0.0068) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7558, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -8.76% (1.2842 => 1.1717, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7069, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.73% (2.2633 => 2.1788, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4005, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4734, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 05:29:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 07:29:29 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121128132929.338C02A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6343?compare_to=6341&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6343, Order: 168782, Start Time: 2012-11-28 11:58:58, End Time: 2012-11-28 13:30:02 To: 6341, Order: 168779, Start Time: 2012-11-28 10:11:25, End Time: 2012-11-28 11:42:13 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 21 (128 on baseline) Performance Improvements: 1 (41 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1029 (804 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/health/health: 7.79% (0.1373 => 0.1480, std.dev.: 0.0029) MultiSource/Applications/viterbi/viterbi: 7.72% (0.1581 => 0.1703, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.07% (0.2404 => 0.2526, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.02% (0.2053 => 0.2156, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.54% (0.2334 => 0.2440, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.33% (1.2023 => 1.2423, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.09% (1.0091 => 1.0403, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.02% (0.6190 => 0.6377, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.64% (0.5160 => 0.5296, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.56% (0.6493 => 0.6659, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.01% (0.8258 => 0.8424, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/football/football: 1.75% (0.9181 => 0.9342, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.66% (0.9049 => 0.9199, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.48% (1.7150 => 1.7404, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.44% (4.3448 => 4.4073, std.dev.: 0.0153) MultiSource/Applications/lua/lua: 1.43% (3.9706 => 4.0272, std.dev.: 0.0106) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 20.54% (1.8178 => 2.1911, std.dev.: 0.0119) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.97% (15.5423 => 16.9360, std.dev.: 0.3494) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.30% (4.1138 => 4.2906, std.dev.: 0.0221) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.51% (1.0667 => 1.1041, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/whetstone: 2.43% (2.1689 => 2.2217, std.dev.: 0.0107) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: -6.35% (0.9025 => 0.8452, std.dev.: 0.0149) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.05% (1.0806 => 1.1028, std.dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.08% (0.3684 => 0.3687, std.dev.: 0.0209) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0222 => 0.0222, std.dev.: 0.0056) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0429 => 0.0430, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.60% (0.0334 => 0.0336, std.dev.: 0.0070) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0316 => 0.0315, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.23% (0.0429 => 0.0428, std.dev.: 0.0139) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0206 => 0.0206, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/test1: 16.93% (0.0189 => 0.0221, std.dev.: 0.0083) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 33.33% (0.0006 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.68% (0.1462 => 0.1452, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 6.10% (1.1030 => 1.1703, std.dev.: 0.0597) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.81% (0.3917 => 0.3988, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: - (0.1441 => 0.1441, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.50% (0.0622 => 0.0594, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 14.58% (0.0240 => 0.0275, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.39% (0.0570 => 0.0595, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.10% (1.1468 => 1.1456, std.dev.: 0.0088) MultiSource/Benchmarks/SciMark2-C/scimark2: 0.06% (9.3913 => 9.3967, std.dev.: 0.0411) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2800.00% (0.0001 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 600.00% (0.0001 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 15.49% (0.0523 => 0.0604, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 29.41% (0.0204 => 0.0264, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.27% (0.8055 => 0.8033, std.dev.: 0.0859) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.42% (0.0059 => 0.0044, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/SciMark2-C/scimark2: -67.12% (28.5821 => 9.3967, std.dev.: 0.0411) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 9.35% (16.4461 => 17.9837, std.dev.: 0.1663) MultiSource/Applications/sqlite3/sqlite3: 2338.12% (0.6332 => 15.4382, std.dev.: 0.3232) MultiSource/Benchmarks/McCat/08-main/main: 51.50% (0.1831 => 0.2774, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.59% (0.1559 => 0.1503, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7074.83% (0.3123 => 22.4070, std.dev.: 1.2199) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1532.95% (0.3344 => 5.4606, std.dev.: 0.3638) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.54% (0.2364 => 0.3275, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/bigfib: 4.06% (0.6010 => 0.6254, std.dev.: 0.1623) SingleSource/Benchmarks/Misc/mandel: 0.47% (0.0429 => 0.0431, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.02% (0.3266 => 0.3430, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/strcat: 3.25% (0.1969 => 0.2033, std.dev.: 0.0048) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.57% (0.0224 => 0.0232, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -25.22% (0.0230 => 0.0172, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0515, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 11.76% (0.1462 => 0.1634, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3982, std.dev.: 0.0385) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0717, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4947, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5189, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2756, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0686, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3622, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3835, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0836, std.dev.: 0.0054) SingleSource/Regression/C/uint64_to_float: -30.08% (2.1832 => 1.5265, std.dev.: 0.0171) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.68% (0.0810 => 0.0937, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 14.21% (0.1112 => 0.1270, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.20% (0.0773 => 0.0875, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.85% (0.0848 => 0.0957, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.11% (0.2180 => 0.2444, std.dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.09% (0.3137 => 0.3485, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 11.02% (0.1425 => 0.1582, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.84% (0.2279 => 0.2526, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.80% (0.6010 => 0.6659, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.72% (0.1157 => 0.1281, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.26% (0.9435 => 1.0403, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/health/health: 9.87% (0.1347 => 0.1480, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.26% (0.4847 => 0.5296, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.18% (0.7473 => 0.8159, std.dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.97% (0.4127 => 0.4497, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.93% (0.2240 => 0.2440, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.88% (0.8321 => 0.9060, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.72% (0.1983 => 0.2156, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.68% (0.3295 => 0.3581, std.dev.: 0.0060) MultiSource/Applications/Burg/burg: 8.49% (1.2222 => 1.3260, std.dev.: 0.0108) MultiSource/Benchmarks/sim/sim: 8.18% (0.3226 => 0.3490, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.05% (0.1466 => 0.1584, std.dev.: 0.0017) MultiSource/Applications/viterbi/viterbi: 7.99% (0.1577 => 0.1703, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 7.94% (0.6287 => 0.6786, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.24% (0.2998 => 0.3215, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.04% (1.1606 => 1.2423, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.99% (0.3003 => 0.3213, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.98% (0.5961 => 0.6377, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.87% (13.1811 => 14.0873, std.dev.: 0.0850) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.86% (0.8148 => 0.8707, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.86% (0.5817 => 0.6216, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.80% (1.3279 => 1.4182, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.67% (0.1905 => 0.2032, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/football/football: 6.55% (0.8768 => 0.9342, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.47% (0.1885 => 0.2007, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 6.42% (0.7950 => 0.8460, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 6.31% (0.8712 => 0.9262, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.29% (0.8359 => 0.8885, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 6.27% (0.8656 => 0.9199, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.21% (1.6386 => 1.7404, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.20% (0.7932 => 0.8424, std.dev.: 0.0049) MultiSource/Applications/siod/siod: 6.18% (2.2184 => 2.3554, std.dev.: 0.0172) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.14% (0.2133 => 0.2264, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.07% (1.1685 => 1.2394, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.95% (1.2526 => 1.3271, std.dev.: 0.0193) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.80% (0.6227 => 0.6588, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 5.60% (1.9948 => 2.1066, std.dev.: 0.0404) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.56% (1.2602 => 1.3303, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.53% (4.1763 => 4.4073, std.dev.: 0.0153) MultiSource/Applications/SPASS/SPASS: 5.45% (14.2605 => 15.0384, std.dev.: 0.1170) MultiSource/Applications/lua/lua: 5.45% (3.8189 => 4.0272, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.40% (0.2519 => 0.2655, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 5.37% (1.1271 => 1.1876, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 5.24% (0.8697 => 0.9153, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.14% (0.9039 => 0.9504, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 5.11% (0.9074 => 0.9538, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5.08% (0.9908 => 1.0411, std.dev.: 0.0112) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.06% (0.4783 => 0.5025, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.88% (0.2378 => 0.2494, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.87% (0.8457 => 0.8869, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.85% (0.5191 => 0.5443, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.85% (0.9056 => 0.9495, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.83% (0.9688 => 1.0156, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.78% (0.8611 => 0.9023, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.76% (8.6476 => 9.0595, std.dev.: 0.0440) MultiSource/Applications/ClamAV/clamscan: 4.76% (14.7684 => 15.4716, std.dev.: 0.0969) MultiSource/Benchmarks/MallocBench/gs/gs: 4.69% (4.1305 => 4.3242, std.dev.: 0.0356) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.63% (0.2741 => 0.2868, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 4.61% (0.8597 => 0.8993, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.58% (0.8716 => 0.9115, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.46% (0.8885 => 0.9281, std.dev.: 0.0144) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.43% (1.1170 => 1.1665, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.41% (0.8338 => 0.8706, std.dev.: 0.0036) MultiSource/Applications/minisat/minisat: 4.32% (0.6834 => 0.7129, std.dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.30% (0.3717 => 0.3877, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.28% (4.4873 => 4.6792, std.dev.: 0.0444) MultiSource/Applications/JM/lencod/lencod: 4.20% (15.3280 => 15.9721, std.dev.: 0.0314) MultiSource/Applications/SIBsim4/SIBsim4: 4.12% (1.2568 => 1.3086, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/bh/bh: 4.12% (0.2985 => 0.3108, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.05% (0.8066 => 0.8393, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.04% (0.8316 => 0.8652, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.01% (4.4880 => 4.6681, std.dev.: 0.0118) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.94% (6.6074 => 6.8676, std.dev.: 0.0681) MultiSource/Applications/lambda-0_1_3/lambda: 3.88% (0.7557 => 0.7850, std.dev.: 0.0083) MultiSource/Applications/JM/ldecod/ldecod: 3.73% (6.7320 => 6.9830, std.dev.: 0.0216) MultiSource/Applications/d/make_dparser: 3.56% (3.2366 => 3.3517, std.dev.: 0.0389) MultiSource/Applications/hexxagon/hexxagon: 3.55% (0.9810 => 1.0158, std.dev.: 0.0061) MultiSource/Applications/oggenc/oggenc: 3.20% (4.9628 => 5.1215, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.50% (0.6943 => 0.7047, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.03% (1.2423 => 1.2551, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 38.72% (1.5795 => 2.1911, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 28.08% (2.9096 => 3.7267, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.19% (4.8436 => 5.8702, std.dev.: 0.0237) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.90% (8.2783 => 9.7599, std.dev.: 0.0351) SingleSource/Benchmarks/McGill/misr: 16.62% (0.4001 => 0.4666, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.57% (0.7597 => 0.8856, std.dev.: 0.0130) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.64% (14.6451 => 16.9360, std.dev.: 0.3494) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.65% (2.7995 => 3.1256, std.dev.: 0.0227) MultiSource/Applications/lambda-0_1_3/lambda: 10.33% (7.4933 => 8.2673, std.dev.: 0.0437) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.00% (1.1857 => 1.3043, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.29% (0.3186 => 0.3482, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.61% (3.9917 => 4.2956, std.dev.: 0.0139) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.36% (23.5781 => 25.3128, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.35% (3.3761 => 3.5904, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.29% (1.0388 => 1.1041, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.16% (2.9753 => 3.1585, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.66% (4.5327 => 4.7892, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.39% (5.4187 => 5.7109, std.dev.: 0.0198) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.21% (0.3937 => 0.4142, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.18% (5.3218 => 5.5973, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 5.15% (0.4353 => 0.4577, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.97% (0.5214 => 0.5473, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 4.84% (3.3398 => 3.5013, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/richards_benchmark: 4.82% (1.3037 => 1.3666, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/whetstone: 4.68% (2.1224 => 2.2217, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.55% (4.8362 => 5.0080, std.dev.: 0.0278) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.23% (0.3587 => 0.3703, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/power/power: 2.89% (1.2061 => 1.2409, std.dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.18% (3.4104 => 3.4849, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.12% (1.2337 => 1.2599, std.dev.: 0.0084) SingleSource/Benchmarks/Dhrystone/dry: 2.07% (0.5081 => 0.5186, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.81% (11.5690 => 11.7785, std.dev.: 0.0323) SingleSource/Benchmarks/Shootout/methcall: 1.64% (8.2676 => 8.4034, std.dev.: 0.0255) SingleSource/Benchmarks/McGill/queens: 1.63% (1.7056 => 1.7334, std.dev.: 0.0057) MultiSource/Benchmarks/sim/sim: 1.37% (3.8206 => 3.8729, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/ReedSolomon: 1.29% (8.5322 => 8.6422, std.dev.: 0.0239) MultiSource/Applications/spiff/spiff: 1.19% (2.8561 => 2.8902, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-7: 1.06% (1.7156 => 1.7337, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.23% (2.8951 => 1.6724, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -22.09% (7.2130 => 5.6200, std.dev.: 0.3838) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.90% (1.4529 => 1.1493, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.81% (9.9065 => 8.2408, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/ary3: -13.31% (1.9999 => 1.7338, std.dev.: 0.0289) MultiSource/Benchmarks/Olden/em3d/em3d: -12.79% (5.4641 => 4.7652, std.dev.: 0.0310) SingleSource/Benchmarks/Misc/flops-8: -9.55% (2.5609 => 2.3164, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/chomp: -9.31% (1.1216 => 1.0172, std.dev.: 0.0382) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.09% (0.3269 => 0.2972, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: -8.98% (63.1822 => 57.5087, std.dev.: 0.1279) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.27% (1.0512 => 0.9643, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.90% (3.2169 => 2.9628, std.dev.: 0.0338) SingleSource/Benchmarks/Stanford/FloatMM: -6.62% (0.8807 => 0.8224, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.39% (4.7482 => 4.4446, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/sieve: -6.19% (7.0599 => 6.6230, std.dev.: 0.0313) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.17% (5.1305 => 4.8139, std.dev.: 0.0324) SingleSource/Benchmarks/Misc/flops: -5.61% (9.3748 => 8.8485, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.42% (6.2275 => 5.8899, std.dev.: 0.0740) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.90% (5.6343 => 5.3581, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.35% (4.9453 => 4.7303, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/ffbench: -4.18% (1.4296 => 1.3698, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.79% (6.1706 => 5.9366, std.dev.: 0.0426) MultiSource/Applications/siod/siod: -3.77% (3.6643 => 3.5260, std.dev.: 0.0173) SingleSource/Benchmarks/Misc/perlin: -3.73% (5.1084 => 4.9177, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.64% (5.1557 => 4.9680, std.dev.: 0.0028) MultiSource/Applications/lua/lua: -3.61% (29.8330 => 28.7550, std.dev.: 0.1850) SingleSource/Benchmarks/Shootout-C++/methcall: -3.61% (8.9760 => 8.6520, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.25% (5.4300 => 5.2537, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout/hash: -2.72% (4.3087 => 4.1915, std.dev.: 0.0373) SingleSource/Benchmarks/Misc/fbench: -2.59% (3.3840 => 3.2965, std.dev.: 0.0298) MultiSource/Benchmarks/FreeBench/neural/neural: -2.21% (1.0841 => 1.0601, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.15% (0.5807 => 0.5682, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: -2.09% (1.4861 => 1.4550, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.03% (3.3479 => 3.2798, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.69% (1.5866 => 1.5598, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/fp-convert: -1.63% (15.8853 => 15.6270, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.60% (3.5679 => 3.5107, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-5: -1.59% (2.8957 => 2.8498, std.dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: -1.59% (6.7064 => 6.6001, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/himenobmtxpa: -1.48% (4.3552 => 4.2906, std.dev.: 0.0221) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.30% (1.5308 => 1.5109, std.dev.: 0.0049) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 7.46% (1.0262 => 1.1028, std.dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.70% (0.2463 => 0.3687, std.dev.: 0.0209) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 80.49% (0.0123 => 0.0222, std.dev.: 0.0056) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.39% (0.0408 => 0.0430, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 32.28% (0.0254 => 0.0336, std.dev.: 0.0070) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.46% (0.0384 => 0.0428, std.dev.: 0.0139) SingleSource/UnitTests/Vector/Altivec/casts: 8.42% (0.0190 => 0.0206, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/test1: 22.78% (0.0180 => 0.0221, std.dev.: 0.0083) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.97% (0.1438 => 0.1452, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 3.30% (1.1329 => 1.1703, std.dev.: 0.0597) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.23% (0.4164 => 0.3988, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.26% (0.1369 => 0.1441, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.33% (0.0641 => 0.0594, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.03% (0.0195 => 0.0275, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.94% (0.0578 => 0.0595, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.17% (1.1437 => 1.1456, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2800.00% (0.0001 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0014 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.67% (0.0627 => 0.0604, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 46.67% (0.0180 => 0.0264, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.20% (0.8017 => 0.8033, std.dev.: 0.0859) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -29.03% (0.0062 => 0.0044, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 06:13:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 08:13:52 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121128141352.D1BE02A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6344?compare_to=6339&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6344, Order: 168782, Start Time: 2012-11-28 11:55:05, End Time: 2012-11-28 14:14:24 To: 6339, Order: 168776, Start Time: 2012-11-28 08:40:06, End Time: 2012-11-28 10:58:35 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 22 (140 on baseline) Performance Improvements: 10 (43 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1054 (702 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 16.33% (0.4017 => 0.4673, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 16.17% (0.6208 => 0.7212, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.97% (0.6864 => 0.7754, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 12.38% (0.6161 => 0.6924, std.dev.: 0.0204) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.16% (0.1044 => 0.1171, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 12.15% (0.5776 => 0.6478, std.dev.: 0.0221) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.35% (0.4555 => 0.4981, std.dev.: 0.0134) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.03% (0.2570 => 0.2802, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.86% (0.8074 => 0.8789, std.dev.: 0.0242) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 8.79% (0.5895 => 0.6413, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.93% (0.3391 => 0.3660, std.dev.: 0.0075) MultiSource/Applications/hexxagon/hexxagon: 7.88% (1.3852 => 1.4944, std.dev.: 0.0360) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.81% (0.2408 => 0.2596, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.69% (0.5616 => 0.6048, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/ary2: 7.53% (0.3704 => 0.3983, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/ReedSolomon: 6.75% (0.2191 => 0.2339, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.60% (7.9196 => 8.4420, std.dev.: 0.1326) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.00% (0.5234 => 0.5548, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.93% (0.2194 => 0.2324, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.56% (2.3057 => 2.4339, std.dev.: 0.0451) SingleSource/UnitTests/ObjC/exceptions-3: 4.92% (0.3945 => 0.4139, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.79% (8.9091 => 9.6918, std.dev.: 0.1699) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -17.68% (0.0628 => 0.0517, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/messages-2: -17.48% (0.0938 => 0.0774, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/lpbench: -10.61% (0.1159 => 0.1036, std.dev.: 0.0043) SingleSource/UnitTests/ObjC++/property-reference: -7.87% (0.8725 => 0.8038, std.dev.: 0.0236) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/lpbench: -19.87% (12.8007 => 10.2566, std.dev.: 0.7467) SingleSource/Benchmarks/CoyoteBench/fftbench: -17.85% (2.5661 => 2.1081, std.dev.: 0.1639) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -11.70% (3.1167 => 2.7521, std.dev.: 0.1224) SingleSource/Benchmarks/Shootout-C++/hash: -6.89% (0.8180 => 0.7616, std.dev.: 0.0197) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.64% (4.3402 => 4.0520, std.dev.: 0.0302) MultiSource/Benchmarks/Olden/em3d/em3d: -2.16% (3.1783 => 3.1097, std.dev.: 0.0231) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.20% (69.4473 => 69.3111, std.dev.: 0.3567) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 1.65% (0.1337 => 0.1359, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.48% (0.0418 => 0.0420, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0652 => 0.0652, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 0.08% (494.0072 => 494.4020, std.dev.: 0.0518) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.59% (63.2438 => 69.3111, std.dev.: 0.3567) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43741.62% (1.1277 => 494.4020, std.dev.: 0.0518) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.24% (0.5229 => 1.5386, std.dev.: 0.0508) MultiSource/Applications/SPASS/SPASS: 21.61% (14.9895 => 18.2287, std.dev.: 0.2335) MultiSource/Applications/kimwitu++/kc: 48.61% (14.1553 => 21.0361, std.dev.: 0.6025) MultiSource/Benchmarks/MallocBench/gs/gs: 14.93% (4.1105 => 4.7242, std.dev.: 0.2821) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.80% (1.1048 => 1.5114, std.dev.: 0.0606) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 432.84% (7.1582 => 38.1418, std.dev.: 0.1692) SingleSource/Benchmarks/Misc-C++-EH/spirit: 75.49% (3.4629 => 6.0769, std.dev.: 0.3863) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.06% (0.6222 => 1.0332, std.dev.: 0.0825) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10641.67% (0.0720 => 7.7340, std.dev.: 0.1953) MultiSource/Applications/SIBsim4/SIBsim4: 3854300.00% (0.0001 => 3.8544, std.dev.: 0.0309) MultiSource/Applications/SPASS/SPASS: 13450800.00% (0.0001 => 13.4509, std.dev.: 0.9521) MultiSource/Applications/kimwitu++/kc: 52600.00% (0.0001 => 0.0527, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576900.00% (0.0001 => 0.5770, std.dev.: 0.0277) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10080600.00% (0.0001 => 10.0807, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5776700.00% (0.0001 => 5.7768, std.dev.: 0.6977) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1736.49% (1.1194 => 20.5577, std.dev.: 0.6807) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 68.70% (2.9384 => 4.9570, std.dev.: 0.1830) MultiSource/Applications/ClamAV/clamscan: 67.54% (22.1758 => 37.1523, std.dev.: 0.4794) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 51.22% (7.0540 => 10.6670, std.dev.: 0.3866) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.21% (8.1363 => 12.2212, std.dev.: 0.2011) MultiSource/Applications/JM/lencod/lencod: 47.03% (21.9371 => 32.2534, std.dev.: 0.0711) MultiSource/Benchmarks/FreeBench/distray/distray: 44.22% (0.1056 => 0.1523, std.dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/almabench: 38.36% (0.0730 => 0.1010, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 36.87% (0.1432 => 0.1960, std.dev.: 0.0050) SingleSource/UnitTests/vla: 36.06% (0.0355 => 0.0483, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 29.55% (0.0528 => 0.0684, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 29.17% (0.0672 => 0.0868, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 28.85% (0.1584 => 0.2041, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.14% (0.0479 => 0.0609, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: 26.21% (0.1175 => 0.1483, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: 26.20% (0.0626 => 0.0790, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/family/family: 25.94% (0.0397 => 0.0500, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/life/life: 25.51% (0.0933 => 0.1171, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.03% (0.1566 => 0.1958, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.26% (0.0746 => 0.0927, std.dev.: 0.0018) SingleSource/Benchmarks/Stanford/Oscar: 24.21% (0.0636 => 0.0790, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 24.03% (0.0491 => 0.0609, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bisort/bisort: 23.62% (0.0614 => 0.0759, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.38% (0.2271 => 0.2802, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.21% (0.2107 => 0.2596, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: 22.47% (0.2554 => 0.3128, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 22.08% (0.5105 => 0.6232, std.dev.: 0.0210) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.78% (0.0886 => 0.1079, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 21.40% (0.4103 => 0.4981, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout/matrix: 21.27% (0.0818 => 0.0992, std.dev.: 0.0036) MultiSource/Applications/Burg/burg: 21.04% (1.1642 => 1.4092, std.dev.: 0.0468) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.55% (0.0793 => 0.0956, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/functionobjects: 20.48% (0.5020 => 0.6048, std.dev.: 0.0112) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.22% (0.4615 => 0.5548, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/reversefile: 20.08% (0.3865 => 0.4641, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 20.06% (0.1695 => 0.2035, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/lists: 19.40% (0.3422 => 0.4086, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.93% (0.2700 => 0.3211, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/sieve: 18.82% (0.3603 => 0.4281, std.dev.: 0.0104) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.67% (0.1125 => 0.1335, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary2: 17.88% (0.3379 => 0.3983, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.81% (0.0842 => 0.0992, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/exceptions-3: 17.72% (0.3516 => 0.4139, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.45% (0.0871 => 0.1023, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/exceptions-2: 17.39% (0.3497 => 0.4105, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.31% (14.3668 => 16.8542, std.dev.: 0.6151) SingleSource/UnitTests/ObjC/exceptions-4: 17.30% (0.3543 => 0.4156, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/except: 17.24% (0.2871 => 0.3366, std.dev.: 0.0094) MultiSource/Benchmarks/McCat/17-bintr/bintr: 17.19% (0.0675 => 0.0791, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 17.17% (9.4845 => 11.1131, std.dev.: 0.2427) SingleSource/Benchmarks/Shootout-C++/ary3: 17.03% (0.3283 => 0.3842, std.dev.: 0.0148) MultiSource/Applications/minisat/minisat: 16.98% (0.7115 => 0.8323, std.dev.: 0.0372) SingleSource/Benchmarks/Shootout-C++/matrix: 16.95% (0.3098 => 0.3623, std.dev.: 0.0102) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.92% (0.8172 => 0.9555, std.dev.: 0.0395) SingleSource/Benchmarks/Shootout-C++/hello: 16.80% (0.2714 => 0.3170, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.71% (0.3136 => 0.3660, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ary: 16.71% (0.3232 => 0.3772, std.dev.: 0.0144) MultiSource/Benchmarks/FreeBench/neural/neural: 16.68% (0.1463 => 0.1707, std.dev.: 0.0080) MultiSource/Benchmarks/VersaBench/bmm/bmm: 16.60% (0.0759 => 0.0885, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 16.58% (0.1695 => 0.1976, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.51% (0.0648 => 0.0755, std.dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: 16.39% (5.7591 => 6.7032, std.dev.: 0.2767) MultiSource/Applications/hexxagon/hexxagon: 16.37% (1.2842 => 1.4944, std.dev.: 0.0360) SingleSource/UnitTests/SignlessTypes/rem: 16.35% (0.1144 => 0.1331, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 16.34% (0.1114 => 0.1296, std.dev.: 0.0061) SingleSource/Regression/C++/ofstream_ctor: 16.28% (0.2905 => 0.3378, std.dev.: 0.0178) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 16.21% (0.2603 => 0.3025, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.17% (0.2065 => 0.2399, std.dev.: 0.0104) MultiSource/Applications/sqlite3/sqlite3: 16.08% (17.1811 => 19.9432, std.dev.: 0.5001) SingleSource/Benchmarks/Shootout-C++/methcall: 16.02% (0.2877 => 0.3338, std.dev.: 0.0090) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.95% (0.0953 => 0.1105, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/fibo: 15.82% (0.2725 => 0.3156, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 15.81% (3.8922 => 4.5077, std.dev.: 0.2053) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.76% (0.1117 => 0.1293, std.dev.: 0.0067) MultiSource/Applications/viterbi/viterbi: 15.43% (0.1555 => 0.1795, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 15.35% (0.2430 => 0.2803, std.dev.: 0.0134) MultiSource/Benchmarks/Olden/health/health: 15.30% (0.1268 => 0.1462, std.dev.: 0.0073) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3121 => 0.3596, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.19% (0.2758 => 0.3177, std.dev.: 0.0136) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.06% (0.0770 => 0.0886, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/oourafft: 14.96% (0.3282 => 0.3773, std.dev.: 0.0078) MultiSource/Benchmarks/NPB-serial/is/is: 14.88% (0.0719 => 0.0826, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.51% (0.5981 => 0.6849, std.dev.: 0.0226) MultiSource/Applications/spiff/spiff: 14.46% (0.7835 => 0.8968, std.dev.: 0.0393) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.29% (0.1337 => 0.1528, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.19% (0.1029 => 0.1175, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/ReedSolomon: 14.15% (0.2049 => 0.2339, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.08% (4.9449 => 5.6412, std.dev.: 0.1546) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.03% (0.1062 => 0.1211, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.95% (0.3935 => 0.4484, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.80% (0.9765 => 1.1113, std.dev.: 0.0466) MultiSource/Applications/sgefa/sgefa: 13.80% (0.3109 => 0.3538, std.dev.: 0.0141) MultiSource/Benchmarks/McCat/18-imp/imp: 13.73% (0.3423 => 0.3893, std.dev.: 0.0124) MultiSource/Applications/lua/lua: 13.47% (3.8723 => 4.3938, std.dev.: 0.2007) SingleSource/UnitTests/ObjC/parameter-passing: 13.32% (0.3927 => 0.4450, std.dev.: 0.0175) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.31% (0.1510 => 0.1711, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.86% (0.8101 => 0.9143, std.dev.: 0.0362) SingleSource/UnitTests/ObjC/trivial-interface: 12.84% (0.3473 => 0.3919, std.dev.: 0.0128) SingleSource/UnitTests/ObjC/property: 12.84% (0.3886 => 0.4385, std.dev.: 0.0172) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.70% (0.3543 => 0.3993, std.dev.: 0.0138) SingleSource/UnitTests/ObjC/exceptions: 12.59% (0.3828 => 0.4310, std.dev.: 0.0153) SingleSource/UnitTests/ObjC/synchronized: 12.58% (0.3561 => 0.4009, std.dev.: 0.0148) SingleSource/UnitTests/ObjC/for-in: 12.43% (0.3694 => 0.4153, std.dev.: 0.0146) MultiSource/Benchmarks/McCat/09-vor/vor: 12.23% (0.3180 => 0.3569, std.dev.: 0.0142) MultiSource/Applications/lemon/lemon: 12.08% (1.0722 => 1.2017, std.dev.: 0.0473) MultiSource/Benchmarks/McCat/05-eks/eks: 11.89% (0.4299 => 0.4810, std.dev.: 0.0161) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.29% (0.1143 => 0.1272, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.52% (2.2022 => 2.4339, std.dev.: 0.0451) SingleSource/UnitTests/ObjC++/property-reference-object: 10.40% (0.6030 => 0.6657, std.dev.: 0.0219) SingleSource/UnitTests/ObjC++/Hello: 10.28% (0.5925 => 0.6534, std.dev.: 0.0236) SingleSource/UnitTests/ObjC++/property-reference: 9.72% (0.7326 => 0.8038, std.dev.: 0.0236) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.59% (0.3817 => 0.4183, std.dev.: 0.0097) MultiSource/Benchmarks/PAQ8p/paq8p: 8.55% (10.3673 => 11.2532, std.dev.: 0.3331) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.03% (7.9617 => 8.4420, std.dev.: 0.1326) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 149.60% (4.3953 => 10.9705, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/methcall: 147.19% (5.3999 => 13.3482, std.dev.: 0.0154) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.64% (1.1145 => 1.3000, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/oourafft: 16.13% (6.6465 => 7.7185, std.dev.: 0.0126) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.15% (0.2944 => 0.3331, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.65% (8.6802 => 9.6918, std.dev.: 0.1699) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.53% (2.8904 => 3.2238, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: 10.12% (1.1396 => 1.2549, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.23% (1.7254 => 1.8846, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.62% (4.2280 => 4.4655, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.16% (3.8532 => 4.0520, std.dev.: 0.0302) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.6436 => 12.1007, std.dev.: 0.0197) MultiSource/Applications/lua/lua: 3.83% (26.0924 => 27.0910, std.dev.: 0.2751) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.12% (1.3677 => 1.3967, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 2.05% (3.1595 => 3.2244, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.04% (2.1424 => 2.1861, std.dev.: 0.0108) MultiSource/Benchmarks/PAQ8p/paq8p: 1.61% (85.0658 => 86.4362, std.dev.: 0.1721) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.36% (6.5088 => 6.5975, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0503, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 1.08% (2.2771 => 2.3017, std.dev.: 0.0080) MultiSource/Applications/lambda-0_1_3/lambda: 1.04% (5.2636 => 5.3186, std.dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1676, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.89% (5.2763 => 1.2193, std.dev.: 0.0572) SingleSource/Benchmarks/Misc/salsa20: -74.65% (0.8651 => 0.2193, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/richards_benchmark: -40.26% (0.1622 => 0.0969, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.31% (5.3526 => 4.6936, std.dev.: 0.1717) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.72% (5.3855 => 4.8082, std.dev.: 0.1037) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -9.61% (1.7609 => 1.5917, std.dev.: 0.0580) MultiSource/Applications/JM/ldecod/ldecod: -6.74% (10.4361 => 9.7327, std.dev.: 0.2170) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -68.61% (32.5116 => 10.2061, std.dev.: 0.0285) SingleSource/Benchmarks/Dhrystone/fldry: -65.60% (1.9577 => 0.6735, std.dev.: 0.0108) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1681, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.52% (0.0628 => 0.0361, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.36% (0.3987 => 0.2378, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.25% (4.5009 => 2.7791, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: -33.53% (1.1492 => 0.7639, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.17% (2.6546 => 2.0130, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: -19.16% (0.2161 => 0.1747, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.70% (1.6925 => 1.4268, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.72% (2.6778 => 2.2836, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -10.67% (1.5373 => 1.3733, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -10.48% (9.5636 => 8.5610, std.dev.: 0.2018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.71% (1.5660 => 1.4296, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.16% (1.6805 => 1.5433, std.dev.: 0.0360) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.73% (0.3463 => 0.3230, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.55% (3.2416 => 3.0617, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.14% (0.8614 => 0.8171, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.89% (19.9488 => 18.9732, std.dev.: 0.2143) SingleSource/Benchmarks/Misc/flops-5: -4.80% (1.5835 => 1.5075, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -4.56% (6.2999 => 6.0125, std.dev.: 0.0084) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8918, std.dev.: 0.0034) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.54% (0.4808 => 0.4686, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.87% (8.1563 => 8.0039, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6774, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -1.47% (10.2830 => 10.1321, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.48% (0.1485 => 0.1359, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0015) Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 06:48:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 08:48:27 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121128144827.13D672A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6345?compare_to=6342&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6345, Order: 168785, Start Time: 2012-11-28 13:16:34, End Time: 2012-11-28 14:48:53 To: 6342, Order: 168782, Start Time: 2012-11-28 11:21:19, End Time: 2012-11-28 12:53:38 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (5 on baseline) Performance Improvements: 0 (183 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1090 (854 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 14.75% (0.3872 => 0.4443, std.dev.: 0.0114) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 1.32% (3.6811 => 3.7296, std.dev.: 0.0046) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.88% (0.3834 => 0.4443, std.dev.: 0.0114) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.07% (2.0478 => 2.1107, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/salsa20: 2.42% (7.4937 => 7.6750, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash2: 2.08% (3.1932 => 3.2595, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.74% (0.1431 => 0.1306, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.83% (0.3821 => 0.3522, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.87% (0.9542 => 0.8886, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.68% (0.3142 => 0.2932, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -6.58% (2.4924 => 2.3285, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.26% (0.3831 => 0.3591, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.24% (0.3848 => 0.3608, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.21% (0.3896 => 0.3654, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.21% (0.3880 => 0.3639, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.14% (0.2428 => 0.2279, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -6.11% (0.3812 => 0.3579, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.11% (0.3357 => 0.3152, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: -6.10% (0.4033 => 0.3787, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.99% (0.4176 => 0.3926, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -5.97% (0.2160 => 0.2031, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.91% (0.3891 => 0.3661, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.86% (0.7198 => 0.6776, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.86% (0.6484 => 0.6104, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: -5.81% (9.2283 => 8.6919, std.dev.: 0.0091) MultiSource/Applications/JM/lencod/lencod: -5.79% (16.1920 => 15.2541, std.dev.: 0.0148) MultiSource/Applications/JM/ldecod/ldecod: -5.79% (7.0961 => 6.6855, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.79% (1.0544 => 0.9934, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.77% (0.2355 => 0.2219, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: -5.68% (0.9179 => 0.8658, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/property: -5.67% (0.4199 => 0.3961, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.63% (0.9852 => 0.9297, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.54% (0.3884 => 0.3669, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.52% (0.3658 => 0.3456, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.49% (4.0323 => 3.8109, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.48% (4.8161 => 4.5524, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.42% (1.2300 => 1.1633, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.42% (0.5925 => 0.5604, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.41% (0.5863 => 0.5546, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.40% (4.8802 => 4.6169, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.40% (0.5857 => 0.5541, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -5.37% (0.4280 => 0.4050, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.36% (1.6364 => 1.5487, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.36% (1.3722 => 1.2987, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.35% (0.5478 => 0.5185, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.35% (0.6304 => 0.5967, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.34% (0.5805 => 0.5495, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.32% (6.7716 => 6.4111, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.31% (0.5859 => 0.5548, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.31% (0.2695 => 0.2552, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.30% (0.5849 => 0.5539, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: -5.30% (1.1530 => 1.0919, std.dev.: 0.0058) MultiSource/Applications/lemon/lemon: -5.27% (1.1450 => 1.0847, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.26% (0.5705 => 0.5405, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.25% (3.5339 => 3.3483, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.24% (0.5575 => 0.5283, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.23% (0.3406 => 0.3228, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.23% (0.6660 => 0.6312, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.22% (0.5802 => 0.5499, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.22% (1.2784 => 1.2117, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.19% (0.6260 => 0.5935, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.18% (0.7919 => 0.7509, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.17% (0.6667 => 0.6322, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.17% (14.2083 => 13.4741, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.16% (0.6293 => 0.5968, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.15% (0.5570 => 0.5283, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.15% (0.6736 => 0.6389, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.15% (0.5591 => 0.5303, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.15% (0.6297 => 0.5973, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: -5.12% (17.1032 => 16.2283, std.dev.: 0.0135) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.10% (4.5069 => 4.2770, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.09% (0.6052 => 0.5744, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.09% (0.5581 => 0.5297, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.09% (0.6446 => 0.6118, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.08% (0.5688 => 0.5399, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.07% (0.6230 => 0.5914, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -5.06% (4.3330 => 4.1137, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.05% (8.0126 => 7.6077, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/05-eks/eks: -5.05% (0.4515 => 0.4287, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.05% (0.8521 => 0.8091, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -5.02% (1.3864 => 1.3168, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.02% (1.4642 => 1.3907, std.dev.: 0.0089) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.00% (0.2278 => 0.2164, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.99% (0.6189 => 0.5880, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.99% (0.6194 => 0.5885, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -4.96% (0.2985 => 0.2837, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.95% (0.5941 => 0.5647, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.90% (0.5999 => 0.5705, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.88% (0.5456 => 0.5190, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.87% (0.6676 => 0.6351, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.86% (0.4916 => 0.4677, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.84% (0.3016 => 0.2870, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.84% (0.6033 => 0.5741, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: -4.83% (1.2515 => 1.1910, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.83% (1.2210 => 1.1620, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.83% (0.2548 => 0.2425, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: -4.81% (0.2659 => 0.2531, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.80% (0.2999 => 0.2855, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -4.78% (15.5079 => 14.7663, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.77% (0.4151 => 0.3953, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: -4.76% (0.3255 => 0.3100, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.74% (0.3483 => 0.3318, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: -4.71% (3.5154 => 3.3500, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/18-imp/imp: -4.69% (0.3581 => 0.3413, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.69% (0.3837 => 0.3657, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.68% (0.3931 => 0.3747, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.67% (0.7447 => 0.7099, std.dev.: 0.0033) SingleSource/Regression/C++/ofstream_ctor: -4.64% (0.3059 => 0.2917, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.64% (0.6681 => 0.6371, std.dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: -4.64% (1.3148 => 1.2538, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.63% (0.3323 => 0.3169, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.63% (0.4813 => 0.4590, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: -4.63% (0.3026 => 0.2886, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.62% (1.2221 => 1.1657, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.59% (0.5168 => 0.4931, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -4.58% (15.2527 => 14.5535, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.57% (0.6395 => 0.6103, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -4.52% (0.2989 => 0.2854, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.51% (0.4321 => 0.4126, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -4.51% (4.0594 => 3.8764, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: -4.50% (0.3621 => 0.3458, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -4.50% (0.3025 => 0.2889, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.49% (0.6440 => 0.6151, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -4.48% (0.3481 => 0.3325, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.46% (2.1713 => 2.0744, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -4.45% (0.3194 => 0.3052, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.41% (0.7524 => 0.7192, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: -4.39% (0.3394 => 0.3245, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.38% (0.3057 => 0.2923, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -4.38% (0.3446 => 0.3295, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.31% (0.3252 => 0.3112, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.30% (0.7021 => 0.6719, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/fibo: -4.28% (0.2871 => 0.2748, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.28% (0.5329 => 0.5101, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.27% (0.5569 => 0.5331, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.26% (0.2933 => 0.2808, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: -4.26% (0.4248 => 0.4067, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.24% (22.4056 => 21.4549, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.20% (0.2903 => 0.2781, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.20% (1.6474 => 1.5782, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.20% (0.7339 => 0.7031, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -4.20% (2.1401 => 2.0503, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/09-vor/vor: -4.19% (0.3271 => 0.3134, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -4.19% (0.2939 => 0.2816, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.10% (0.3319 => 0.3183, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: -4.10% (0.7982 => 0.7655, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists1: -4.09% (0.3867 => 0.3709, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.08% (0.5567 => 0.5340, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -4.06% (0.3205 => 0.3075, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.05% (0.3849 => 0.3693, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -4.05% (0.4861 => 0.4664, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.03% (0.9077 => 0.8711, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hello: -4.00% (0.2849 => 0.2735, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.98% (2.4021 => 2.3066, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: -3.96% (0.7779 => 0.7471, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.94% (0.9557 => 0.9180, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -3.94% (0.6395 => 0.6143, std.dev.: 0.0084) MultiSource/Benchmarks/Bullet/bullet: -3.86% (34.0927 => 32.7772, std.dev.: 0.0184) MultiSource/Applications/kimwitu++/kc: -3.85% (18.2933 => 17.5882, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.85% (0.4083 => 0.3926, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.84% (0.4427 => 0.4257, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -3.81% (0.6347 => 0.6105, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -3.75% (0.8418 => 0.8102, std.dev.: 0.0042) SingleSource/UnitTests/ObjC++/property-reference-object: -3.74% (0.6441 => 0.6200, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -3.71% (0.4524 => 0.4356, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.65% (5.0226 => 4.8391, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -3.64% (0.3788 => 0.3650, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.51% (2.2587 => 2.1795, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.47% (0.3491 => 0.3370, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -3.44% (0.6750 => 0.6518, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -3.24% (1.5610 => 1.5104, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.11% (5.4682 => 5.2979, std.dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -2.01% (20.7746 => 20.3568, std.dev.: 0.0173) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1955, std.dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: -60.43% (1.8100 => 0.7162, std.dev.: 0.0130) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7574, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -8.68% (1.2842 => 1.1727, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -4.04% (2.2633 => 2.1718, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.41% (1.3096 => 1.2649, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3995, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4685, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 4.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 07:16:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 09:16:56 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121128151656.E1EFC2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6346?compare_to=6343&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6346, Order: 168785, Start Time: 2012-11-28 13:46:52, End Time: 2012-11-28 15:17:27 To: 6343, Order: 168782, Start Time: 2012-11-28 11:58:58, End Time: 2012-11-28 13:30:02 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 3 (139 on baseline) Performance Improvements: 6 (43 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1042 (791 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: 5.71% (0.1752 => 0.1852, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 1.09% (1.4820 => 1.4982, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.04% (2.7553 => 2.8115, std.dev.: 0.0115) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -2.74% (0.5296 => 0.5151, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.89% (0.9262 => 0.9087, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.84% (0.9479 => 0.9305, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -1.72% (0.8424 => 0.8279, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.48% (0.9199 => 0.9063, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.02% (16.9360 => 15.7468, std.dev.: 0.3712) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.22% (1.1028 => 1.0893, std.dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.57% (0.3687 => 0.3745, std.dev.: 0.0093) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.45% (0.0222 => 0.0221, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.47% (0.0430 => 0.0428, std.dev.: 0.0114) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.20% (0.0336 => 0.0295, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.27% (0.0315 => 0.0319, std.dev.: 0.0097) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.40% (0.0428 => 0.0434, std.dev.: 0.0123) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0206 => 0.0205, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/test1: -35.29% (0.0221 => 0.0143, std.dev.: 0.0082) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 62.50% (0.0008 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.55% (0.1452 => 0.1489, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: -1.44% (1.1703 => 1.1535, std.dev.: 0.0564) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.68% (0.3988 => 0.4055, std.dev.: 0.0734) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.75% (0.1441 => 0.1495, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 13.47% (0.0594 => 0.0674, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.27% (0.0275 => 0.0244, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.69% (0.0595 => 0.0579, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.06% (1.1456 => 1.1463, std.dev.: 0.0052) MultiSource/Benchmarks/SciMark2-C/scimark2: -0.04% (9.3967 => 9.3934, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -62.07% (0.0029 => 0.0011, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -85.71% (0.0007 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.58% (0.0604 => 0.0528, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.71% (0.0264 => 0.0175, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.16% (0.8033 => 0.8046, std.dev.: 0.0147) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -15.91% (0.0044 => 0.0037, std.dev.: 0.0063) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/SciMark2-C/scimark2: -67.14% (28.5821 => 9.3934, std.dev.: 0.0050) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.76% (16.4461 => 17.8876, std.dev.: 0.1593) MultiSource/Applications/sqlite3/sqlite3: 2347.69% (0.6332 => 15.4988, std.dev.: 0.2328) MultiSource/Benchmarks/McCat/08-main/main: 48.17% (0.1831 => 0.2713, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.20% (0.1559 => 0.1478, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7163.08% (0.3123 => 22.6826, std.dev.: 0.9750) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1536.54% (0.3344 => 5.4726, std.dev.: 0.2877) SingleSource/Benchmarks/Misc-C++/Large/ray: 39.51% (0.2364 => 0.3298, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/bigfib: 4.99% (0.6010 => 0.6310, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/mandel: 4.20% (0.0429 => 0.0447, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.24% (0.3266 => 0.3437, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/strcat: 4.57% (0.1969 => 0.2059, std.dev.: 0.0051) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.04% (0.0224 => 0.0242, std.dev.: 0.0077) SingleSource/UnitTests/byval-alignment: -31.74% (0.0230 => 0.0157, std.dev.: 0.0013) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0520, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 10.40% (0.1462 => 0.1614, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3977, std.dev.: 0.0115) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0699, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4930, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5222, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2742, std.dev.: 0.0236) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0778, std.dev.: 0.0179) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3613, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3847, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0004, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0846, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: -29.68% (2.1832 => 1.5353, std.dev.: 0.0352) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.86% (0.0810 => 0.0979, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/tsp/tsp: 16.46% (0.1112 => 0.1295, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.20% (0.0773 => 0.0875, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.13% (0.0830 => 0.0939, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.34% (0.1905 => 0.2102, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.91% (0.3137 => 0.3448, std.dev.: 0.0015) MultiSource/Applications/aha/aha: 9.65% (0.1088 => 0.1193, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.54% (0.2180 => 0.2388, std.dev.: 0.0035) MultiSource/Benchmarks/sim/sim: 8.99% (0.3226 => 0.3516, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 8.98% (0.1347 => 0.1468, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.97% (0.4127 => 0.4497, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 8.88% (0.1137 => 0.1238, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.86% (0.7473 => 0.8135, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.53% (0.8321 => 0.9031, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.37% (0.2998 => 0.3249, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.28% (0.9435 => 1.0216, std.dev.: 0.0085) MultiSource/Applications/spiff/spiff: 8.15% (0.7950 => 0.8598, std.dev.: 0.0101) MultiSource/Applications/Burg/burg: 8.05% (1.2222 => 1.3206, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 7.94% (0.6287 => 0.6786, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.91% (0.1466 => 0.1582, std.dev.: 0.0016) MultiSource/Applications/viterbi/viterbi: 7.74% (0.1577 => 0.1699, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 7.61% (0.1721 => 0.1852, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.00% (1.2526 => 1.3403, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.88% (1.1606 => 1.2405, std.dev.: 0.0180) MultiSource/Benchmarks/Fhourstones/fhourstones: 6.80% (0.1588 => 0.1696, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.79% (0.2240 => 0.2392, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.76% (0.8148 => 0.8699, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.67% (0.6010 => 0.6411, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.56% (13.1811 => 14.0459, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.2279 => 0.2428, std.dev.: 0.0032) MultiSource/Applications/sgefa/sgefa: 6.37% (0.2999 => 0.3190, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.27% (0.4847 => 0.5151, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.01% (0.3295 => 0.3493, std.dev.: 0.0041) MultiSource/Applications/treecc/treecc: 5.93% (1.9948 => 2.1131, std.dev.: 0.0257) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.91% (0.5961 => 0.6313, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.72% (0.2519 => 0.2663, std.dev.: 0.0023) MultiSource/Applications/siod/siod: 5.72% (2.2184 => 2.3452, std.dev.: 0.0230) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.71% (1.6386 => 1.7322, std.dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.67% (0.6227 => 0.6580, std.dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 5.61% (1.1271 => 1.1903, std.dev.: 0.0087) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.59% (0.2378 => 0.2511, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.54% (0.8286 => 0.8745, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/football/football: 5.53% (0.8768 => 0.9253, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.52% (1.3279 => 1.4012, std.dev.: 0.0101) MultiSource/Applications/SPASS/SPASS: 5.39% (14.2605 => 15.0290, std.dev.: 0.1135) MultiSource/Benchmarks/MallocBench/gs/gs: 5.21% (4.1305 => 4.3457, std.dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.20% (1.1170 => 1.1751, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.16% (0.8611 => 0.9055, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 5.07% (0.8697 => 0.9138, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 5.05% (0.8007 => 0.8411, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.04% (0.9039 => 0.9495, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 5.04% (0.9069 => 0.9526, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.01% (0.5191 => 0.5451, std.dev.: 0.0088) MultiSource/Applications/hbd/hbd: 5.00% (1.4269 => 1.4982, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.98% (4.1763 => 4.3843, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.97% (0.8457 => 0.8877, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.97% (0.9908 => 1.0400, std.dev.: 0.0115) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.90% (0.3717 => 0.3899, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.89% (0.9688 => 1.0162, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.83% (8.6476 => 9.0651, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.74% (0.9074 => 0.9504, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.73% (0.8518 => 0.8921, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.70% (0.9056 => 0.9482, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.70% (0.8656 => 0.9063, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.69% (0.5817 => 0.6090, std.dev.: 0.0071) MultiSource/Applications/JM/lencod/lencod: 4.67% (15.3280 => 16.0433, std.dev.: 0.1163) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.66% (0.8050 => 0.8425, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 4.66% (0.8805 => 0.9215, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4.64% (0.8317 => 0.8703, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 4.61% (0.8597 => 0.8993, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.59% (0.8885 => 0.9293, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.57% (0.8069 => 0.8438, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 4.57% (0.8359 => 0.8741, std.dev.: 0.0059) MultiSource/Applications/lua/lua: 4.56% (3.8189 => 3.9932, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.55% (0.8716 => 0.9113, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 4.48% (0.8261 => 0.8631, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.42% (0.7966 => 0.8318, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.39% (0.8331 => 0.8697, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.37% (0.7932 => 0.8279, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 4.33% (0.8177 => 0.8531, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.33% (0.8086 => 0.8436, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 4.30% (0.8712 => 0.9087, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.29% (0.8338 => 0.8696, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 4.28% (0.8204 => 0.8555, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 4.23% (0.8927 => 0.9305, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.23% (0.2741 => 0.2857, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 4.19% (14.7684 => 15.3870, std.dev.: 0.1353) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.17% (0.8316 => 0.8663, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 4.16% (0.8048 => 0.8383, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.15% (0.8066 => 0.8401, std.dev.: 0.0103) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.10% (6.6074 => 6.8784, std.dev.: 0.0281) MultiSource/Applications/SIBsim4/SIBsim4: 3.94% (1.2568 => 1.3063, std.dev.: 0.0081) MultiSource/Applications/minisat/minisat: 3.88% (0.6834 => 0.7099, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.86% (1.2602 => 1.3089, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.81% (1.1685 => 1.2130, std.dev.: 0.0128) MultiSource/Applications/JM/ldecod/ldecod: 3.79% (6.7320 => 6.9870, std.dev.: 0.0504) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.69% (4.4880 => 4.6535, std.dev.: 0.0346) MultiSource/Applications/lambda-0_1_3/lambda: 3.67% (0.7557 => 0.7834, std.dev.: 0.0034) MultiSource/Applications/lemon/lemon: 3.59% (1.0945 => 1.1338, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.37% (4.5702 => 4.7243, std.dev.: 0.0487) MultiSource/Applications/hexxagon/hexxagon: 3.32% (0.9810 => 1.0136, std.dev.: 0.0035) MultiSource/Applications/oggenc/oggenc: 3.04% (4.9628 => 5.1139, std.dev.: 0.0560) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.03% (0.4783 => 0.4928, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.39% (4.4873 => 4.5944, std.dev.: 0.0393) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.59% (0.8995 => 0.9138, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 39.88% (1.5795 => 2.2094, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 27.88% (2.9096 => 3.7209, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.02% (4.8436 => 5.8615, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.87% (8.2783 => 9.7575, std.dev.: 0.0121) SingleSource/Benchmarks/McGill/misr: 16.57% (0.4001 => 0.4664, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.02% (0.7597 => 0.8738, std.dev.: 0.0286) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.55% (2.7995 => 3.1229, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.33% (6.3772 => 7.0361, std.dev.: 0.0833) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.16% (1.1857 => 1.3062, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 10.14% (7.4933 => 8.2528, std.dev.: 0.0157) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.52% (14.6451 => 15.7468, std.dev.: 0.3712) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.33% (23.5781 => 25.3074, std.dev.: 0.0474) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.07% (3.9917 => 4.2738, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.36% (3.3761 => 3.5909, std.dev.: 0.0282) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.96% (4.8660 => 5.1562, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.78% (4.5327 => 4.7947, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: 5.75% (0.2887 => 0.3053, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 5.47% (0.4353 => 0.4591, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.38% (0.3937 => 0.4149, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.33% (5.4187 => 5.7073, std.dev.: 0.0484) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.21% (5.3218 => 5.5990, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.78% (0.5214 => 0.5463, std.dev.: 0.0053) MultiSource/Applications/aha/aha: 4.67% (3.3398 => 3.4959, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/treeadd/treeadd: 4.38% (0.3587 => 0.3744, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: 4.07% (1.3037 => 1.3567, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/power/power: 3.47% (1.2061 => 1.2479, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.36% (4.8362 => 4.9987, std.dev.: 0.0353) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.18% (3.4104 => 3.4846, std.dev.: 0.0069) SingleSource/Benchmarks/McGill/queens: 2.07% (1.7056 => 1.7409, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/methcall: 1.98% (8.2676 => 8.4310, std.dev.: 0.0408) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.58% (11.5690 => 11.7520, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: 1.41% (2.3560 => 2.3892, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.23% (4.9469 => 5.0079, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/ReedSolomon: 1.10% (8.5322 => 8.6262, std.dev.: 0.0290) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.15% (2.8951 => 1.6747, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -24.36% (7.2130 => 5.4556, std.dev.: 0.3788) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.68% (1.4529 => 1.1524, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.94% (9.9065 => 8.2282, std.dev.: 0.0237) SingleSource/Benchmarks/Shootout-C++/ary3: -13.00% (1.9999 => 1.7400, std.dev.: 0.0525) MultiSource/Benchmarks/Olden/em3d/em3d: -12.75% (5.4641 => 4.7674, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -11.01% (0.3269 => 0.2909, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-8: -9.50% (2.5609 => 2.3177, std.dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: -9.11% (63.1822 => 57.4271, std.dev.: 0.0856) SingleSource/Benchmarks/McGill/chomp: -8.60% (1.1216 => 1.0251, std.dev.: 0.0126) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.16% (1.0512 => 0.9654, std.dev.: 0.0224) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.01% (3.2169 => 2.9913, std.dev.: 0.0340) SingleSource/Benchmarks/Stanford/FloatMM: -6.77% (0.8807 => 0.8211, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.41% (4.7482 => 4.4438, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout/sieve: -6.29% (7.0599 => 6.6158, std.dev.: 0.0434) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.12% (5.1305 => 4.8165, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/flops: -5.55% (9.3748 => 8.8542, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.42% (6.2275 => 5.8902, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/ffbench: -5.13% (1.4296 => 1.3563, std.dev.: 0.0224) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.94% (5.6343 => 5.3558, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.56% (4.7449 => 4.5287, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.54% (4.9453 => 4.7206, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.44% (6.1706 => 5.8966, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.91% (3.7148 => 3.5695, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/perlin: -3.74% (5.1084 => 4.9172, std.dev.: 0.0036) MultiSource/Applications/lua/lua: -3.70% (29.8330 => 28.7278, std.dev.: 0.2534) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.67% (5.1557 => 4.9663, std.dev.: 0.0295) MultiSource/Applications/siod/siod: -3.62% (3.6643 => 3.5315, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/methcall: -3.35% (8.9760 => 8.6750, std.dev.: 0.0350) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.28% (4.9686 => 4.8057, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.23% (5.4300 => 5.2547, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fbench: -2.32% (3.3840 => 3.3056, std.dev.: 0.0141) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.29% (2.8773 => 2.8115, std.dev.: 0.0115) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.93% (3.3479 => 3.2833, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -1.76% (0.5807 => 0.5705, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-6: -1.65% (2.4416 => 2.4013, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.61% (3.5679 => 3.5104, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-5: -1.60% (2.8957 => 2.8493, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/fp-convert: -1.58% (15.8853 => 15.6347, std.dev.: 0.0274) MultiSource/Benchmarks/FreeBench/neural/neural: -1.46% (1.0841 => 1.0683, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.31% (4.2466 => 4.1908, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.12% (6.0224 => 5.9548, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.12% (4.7794 => 4.7261, std.dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 6.15% (1.0262 => 1.0893, std.dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/fftbench: 52.05% (0.2463 => 0.3745, std.dev.: 0.0093) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 79.67% (0.0123 => 0.0221, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0114) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 16.14% (0.0254 => 0.0295, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.63% (0.0302 => 0.0319, std.dev.: 0.0097) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 13.02% (0.0384 => 0.0434, std.dev.: 0.0123) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/test1: -20.56% (0.0180 => 0.0143, std.dev.: 0.0082) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 3.55% (0.1438 => 0.1489, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: 1.82% (1.1329 => 1.1535, std.dev.: 0.0564) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.62% (0.4164 => 0.4055, std.dev.: 0.0734) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.20% (0.1369 => 0.1495, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.15% (0.0641 => 0.0674, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 25.13% (0.0195 => 0.0244, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.17% (0.0578 => 0.0579, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.23% (1.1437 => 1.1463, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1000.00% (0.0001 => 0.0011, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.79% (0.0627 => 0.0528, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.78% (0.0180 => 0.0175, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.36% (0.8017 => 0.8046, std.dev.: 0.0147) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -40.32% (0.0062 => 0.0037, std.dev.: 0.0063) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 5.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 07:32:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 09:32:38 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121128153238.8224E2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6347?compare_to=6340&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6347, Order: 168782, Start Time: 2012-11-28 12:11:58, End Time: 2012-11-28 15:33:10 To: 6340, Order: 168775, Start Time: 2012-11-28 07:58:43, End Time: 2012-11-28 11:23:45 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 14 (173 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1078 (717 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.51% (3.1268 => 3.1739, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 1.46% (1.2442 => 1.2624, std.dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 1.46% (2.4356 => 2.4711, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 1.40% (2.3506 => 2.3835, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.25% (1.8758 => 1.8992, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.20% (1.5430 => 1.5615, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.17% (2.2812 => 2.3078, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.16% (2.2551 => 2.2812, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.14% (4.1431 => 4.1903, std.dev.: 0.0081) MultiSource/Applications/treecc/treecc: 1.14% (0.8897 => 0.8998, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.13% (5.0838 => 5.1412, std.dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 1.07% (4.8383 => 4.8899, std.dev.: 0.0118) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 2.03% (16.2562 => 16.5868, std.dev.: 0.0068) SingleSource/Benchmarks/Dhrystone/dry: 1.49% (14.4191 => 14.6342, std.dev.: 0.0091) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.60% (0.0625 => 0.0885, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.74% (0.1063 => 0.1411, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.47% (0.2969 => 0.3755, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.04% (0.1106 => 0.1394, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.91% (0.0714 => 0.0899, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.25% (0.4139 => 0.5184, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.99% (0.4253 => 0.5316, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.76% (0.5900 => 0.7361, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.42% (0.0475 => 0.0591, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 24.16% (1.5932 => 1.9781, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.87% (0.4994 => 0.6186, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.72% (0.5000 => 0.6186, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.63% (0.0584 => 0.0722, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.40% (0.0547 => 0.0675, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.21% (0.1021 => 0.1258, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.09% (0.1620 => 0.1994, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.49% (0.1107 => 0.1356, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.30% (0.0897 => 0.1097, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 22.04% (0.0599 => 0.0731, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.58% (0.0584 => 0.0710, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.37% (0.3903 => 0.4737, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.33% (0.0633 => 0.0768, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.26% (0.0541 => 0.0656, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.21% (0.1103 => 0.1337, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 21.20% (0.0948 => 0.1149, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.18% (0.0642 => 0.0778, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.74% (0.1003 => 0.1211, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.68% (0.0822 => 0.0992, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.61% (0.0495 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.59% (0.1549 => 0.1868, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 20.58% (0.0821 => 0.0990, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 20.38% (0.1619 => 0.1949, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.32% (0.1604 => 0.1930, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 20.03% (0.0604 => 0.0725, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 19.64% (0.0947 => 0.1133, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.43% (0.1462 => 0.1746, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 19.18% (0.0808 => 0.0963, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.02% (0.2014 => 0.2397, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.97% (0.2736 => 0.3255, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.87% (0.3890 => 0.4624, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.73% (1.3152 => 1.5615, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: 18.59% (0.4029 => 0.4778, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 18.47% (0.1218 => 0.1443, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 18.34% (0.0698 => 0.0826, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 18.25% (0.5826 => 0.6889, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.18% (0.0572 => 0.0676, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 18.05% (0.5889 => 0.6952, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.04% (0.2866 => 0.3383, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 17.94% (0.1505 => 0.1775, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.74% (0.1088 => 0.1281, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.65% (0.4658 => 0.5480, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.62% (3.5627 => 4.1903, std.dev.: 0.0081) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.59% (0.1160 => 0.1364, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 17.53% (0.5546 => 0.6518, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/gs/gs: 17.44% (1.8794 => 2.2072, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.33% (0.1968 => 0.2309, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 17.20% (0.9697 => 1.1365, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.16% (1.6211 => 1.8992, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 17.09% (1.0781 => 1.2624, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.06% (0.3271 => 0.3829, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 16.86% (0.0605 => 0.0707, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 16.75% (0.1421 => 0.1659, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 16.68% (0.7171 => 0.8367, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.56% (0.2875 => 0.3351, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.56% (0.4361 => 0.5083, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.55% (0.5026 => 0.5858, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.33% (4.4195 => 5.1412, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 16.31% (0.9909 => 1.1525, std.dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.29% (2.7292 => 3.1739, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.28% (0.3930 => 0.4570, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.25% (0.2738 => 0.3183, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 16.25% (0.2714 => 0.3155, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 16.15% (0.2725 => 0.3165, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 16.12% (4.2109 => 4.8899, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/strcat: 16.11% (0.2750 => 0.3193, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.09% (0.2729 => 0.3168, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 16.08% (0.2780 => 0.3227, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.03% (0.3195 => 0.3707, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.01% (0.2792 => 0.3239, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 15.98% (0.2823 => 0.3274, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 15.97% (0.1284 => 0.1489, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 15.96% (0.2813 => 0.3262, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.83% (1.9694 => 2.2812, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/wc: 15.83% (0.3096 => 0.3586, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 15.80% (0.2803 => 0.3246, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 15.80% (0.2811 => 0.3255, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.79% (2.0673 => 2.3937, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.66% (0.2911 => 0.3367, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.59% (1.9966 => 2.3078, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.50% (0.1090 => 0.1259, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 15.48% (0.3004 => 0.3469, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 15.35% (0.2566 => 0.2960, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 15.30% (0.3267 => 0.3767, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 15.22% (0.3258 => 0.3754, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 15.04% (0.2075 => 0.2387, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 14.98% (0.3317 => 0.3814, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.93% (0.3060 => 0.3517, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.84% (0.3362 => 0.3861, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.63% (0.3124 => 0.3581, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 14.51% (1.4269 => 1.6340, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/lists: 14.46% (0.3348 => 0.3832, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.44% (0.3282 => 0.3756, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 14.41% (0.3726 => 0.4263, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 14.35% (0.4146 => 0.4741, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 14.33% (0.3678 => 0.4205, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 14.29% (23.5202 => 26.8811, std.dev.: 0.0164) MultiSource/Applications/treecc/treecc: 14.26% (0.7875 => 0.8998, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.23% (0.3625 => 0.4141, std.dev.: 0.0048) MultiSource/Applications/JM/ldecod/ldecod: 14.12% (2.1653 => 2.4711, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 14.08% (0.2691 => 0.3070, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: 14.07% (0.3446 => 0.3931, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 14.06% (0.3477 => 0.3966, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.02% (0.3981 => 0.4539, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.88% (0.3465 => 0.3946, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 13.87% (0.3496 => 0.3981, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 13.84% (0.3460 => 0.3939, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 13.84% (0.3469 => 0.3949, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.80% (0.3442 => 0.3917, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.79% (0.3488 => 0.3969, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 13.67% (0.4251 => 0.4832, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.66% (0.3690 => 0.4194, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 13.60% (4.6177 => 5.2455, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/property: 13.48% (0.3650 => 0.4142, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 13.46% (0.0758 => 0.0860, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 13.43% (2.1013 => 2.3835, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions: 13.40% (0.3643 => 0.4131, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.39% (0.3845 => 0.4360, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/parameter-passing: 13.27% (0.3724 => 0.4218, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 12.83% (0.5012 => 0.5655, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.75% (0.2040 => 0.2300, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 12.18% (0.3498 => 0.3924, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 12.04% (5.5417 => 6.2090, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.95% (0.6435 => 0.7204, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.42% (0.1383 => 0.1541, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 11.34% (0.6634 => 0.7386, std.dev.: 0.0061) MultiSource/Benchmarks/PAQ8p/paq8p: 10.96% (0.4847 => 0.5378, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.93% (0.2068 => 0.2294, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.89% (0.1028 => 0.1140, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.81% (0.2737 => 0.3033, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.38% (0.3084 => 0.3404, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 10.25% (0.2391 => 0.2636, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 10.22% (0.3336 => 0.3677, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 9.98% (2.0346 => 2.2376, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.61% (0.2103 => 0.2305, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.34% (4.6926 => 5.0841, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.34% (0.5361 => 0.5808, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.18% (11.6398 => 12.5923, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.04% (0.7426 => 0.8023, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.84% (0.5584 => 0.6022, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 6.75% (11.9555 => 12.7619, std.dev.: 0.0159) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.95% (29.0505 => 33.3947, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6111, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.47% (0.3693 => 0.3895, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary: 5.37% (0.2122 => 0.2236, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6793, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-2: 4.83% (1.8057 => 1.8930, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1662, std.dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/dry: 4.17% (14.0481 => 14.6342, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1977, std.dev.: 0.0053) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2227, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.50% (7.1849 => 7.2925, std.dev.: 0.0017) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3050, std.dev.: 0.0041) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5122, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5389, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5821, std.dev.: 0.0102) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.35% (2.4764 => 2.4181, std.dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.75% (25.4195 => 16.5868, std.dev.: 0.0068) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9780, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8116, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -6.87% (0.2402 => 0.2237, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8073, std.dev.: 0.0041) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.51% (0.6293 => 0.6135, std.dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/fldry: -2.22% (17.2379 => 16.8555, std.dev.: 0.0504) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8684, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5774, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4948, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.08% (105.3826 => 104.2461, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0427, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 3.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 08:43:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 10:43:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121128164341.E78D02A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6348?compare_to=6345&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6348, Order: 168792, Start Time: 2012-11-28 15:11:55, End Time: 2012-11-28 16:44:14 To: 6345, Order: 168785, Start Time: 2012-11-28 13:16:34, End Time: 2012-11-28 14:48:53 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (6 on baseline) Performance Improvements: 0 (182 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1090 (854 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.64% (54.6182 => 56.6087, std.dev.: 0.0717) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.38% (1.2649 => 1.2824, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.78% (0.3834 => 0.4439, std.dev.: 0.0111) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.73% (54.5751 => 56.6087, std.dev.: 0.0717) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.35% (2.0478 => 2.1165, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/salsa20: 2.54% (7.4937 => 7.6841, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/hash2: 2.10% (3.1932 => 3.2601, std.dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.83% (0.3821 => 0.3522, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.89% (0.9542 => 0.8885, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.59% (0.3142 => 0.2935, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -6.54% (2.4924 => 2.3294, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -6.37% (0.3831 => 0.3587, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.31% (0.3880 => 0.3635, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.30% (0.3812 => 0.3572, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.24% (0.3848 => 0.3608, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.21% (0.3896 => 0.3654, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.14% (0.3891 => 0.3652, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -6.10% (0.4033 => 0.3787, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.06% (0.4176 => 0.3923, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.05% (0.3357 => 0.3154, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -5.94% (9.2283 => 8.6802, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/oourafft: -5.88% (0.2160 => 0.2033, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.85% (0.2428 => 0.2286, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: -5.84% (7.0961 => 6.6814, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.82% (0.7198 => 0.6779, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.82% (0.2355 => 0.2218, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.81% (0.6484 => 0.6107, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -5.79% (16.1920 => 15.2545, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/ReedSolomon: -5.75% (0.1879 => 0.1771, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: -5.73% (0.9179 => 0.8653, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.70% (1.0544 => 0.9943, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.66% (0.3884 => 0.3664, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.64% (0.9852 => 0.9296, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.58% (0.3658 => 0.3454, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -5.55% (0.4199 => 0.3966, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.52% (4.0323 => 3.8098, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.52% (1.3722 => 1.2965, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.45% (0.2695 => 0.2548, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.39% (0.6304 => 0.5964, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.39% (1.2300 => 1.1637, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/parameter-passing: -5.37% (0.4280 => 0.4050, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.37% (0.5863 => 0.5548, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.36% (4.8161 => 4.5578, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.35% (4.8802 => 4.6189, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.35% (0.5925 => 0.5608, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.35% (1.6364 => 1.5489, std.dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: -5.34% (1.1530 => 1.0914, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.33% (0.5478 => 0.5186, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.32% (6.7716 => 6.4115, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.31% (0.5802 => 0.5494, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.30% (1.4642 => 1.3866, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.29% (0.5857 => 0.5547, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.29% (0.5859 => 0.5549, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.29% (0.5805 => 0.5498, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -5.28% (1.1450 => 1.0845, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.26% (0.6260 => 0.5931, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.25% (0.7919 => 0.7503, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.24% (0.5705 => 0.5406, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.23% (4.5069 => 4.2712, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.20% (0.6052 => 0.5737, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.20% (0.5575 => 0.5285, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -5.20% (0.3406 => 0.3229, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.20% (0.6293 => 0.5966, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.18% (0.5941 => 0.5633, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.18% (3.5339 => 3.3507, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.17% (14.2083 => 13.4732, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.17% (0.6446 => 0.6113, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.16% (0.5849 => 0.5547, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.16% (0.5581 => 0.5293, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -5.16% (1.3864 => 1.3149, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: -5.14% (4.3330 => 4.1105, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.13% (0.5570 => 0.5284, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.13% (0.6297 => 0.5974, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.13% (17.1032 => 16.2264, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.11% (0.6667 => 0.6326, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.10% (0.5591 => 0.5306, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -5.09% (0.4515 => 0.4285, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.09% (0.6189 => 0.5874, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.09% (0.6230 => 0.5913, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.09% (0.6194 => 0.5879, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.08% (0.6736 => 0.6394, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.07% (8.0126 => 7.6067, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.05% (0.8521 => 0.8091, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.03% (0.5999 => 0.5697, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.03% (0.5688 => 0.5402, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.00% (0.4916 => 0.4670, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.00% (0.6681 => 0.6347, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -4.97% (1.2784 => 1.2148, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.96% (0.6033 => 0.5734, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.94% (0.3016 => 0.2867, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.93% (0.5456 => 0.5187, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -4.92% (0.2985 => 0.2838, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.91% (0.6676 => 0.6348, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -4.88% (0.3255 => 0.3096, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.87% (0.2548 => 0.2424, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.86% (0.2385 => 0.2269, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.85% (1.2210 => 1.1618, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -4.84% (15.5079 => 14.7570, std.dev.: 0.0113) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.83% (0.2278 => 0.2168, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: -4.81% (1.3148 => 1.2515, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: -4.79% (1.2515 => 1.1915, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: -4.78% (0.2659 => 0.2532, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: -4.78% (0.3581 => 0.3410, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.77% (0.2999 => 0.2856, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.74% (0.6440 => 0.6135, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: -4.72% (3.5154 => 3.3495, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.71% (0.3483 => 0.3319, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.69% (0.3323 => 0.3167, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -4.69% (0.3026 => 0.2884, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.68% (0.3057 => 0.2914, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.65% (15.2527 => 14.5434, std.dev.: 0.0191) SingleSource/Regression/C++/ofstream_ctor: -4.61% (0.3059 => 0.2918, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.60% (1.2221 => 1.1659, std.dev.: 0.0076) MultiSource/Applications/minisat/minisat: -4.57% (0.7447 => 0.7107, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.56% (2.1713 => 2.0723, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.55% (0.3931 => 0.3752, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -4.55% (4.0594 => 3.8749, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.53% (0.6395 => 0.6105, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.53% (0.4151 => 0.3963, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -4.53% (0.3025 => 0.2888, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.53% (0.5168 => 0.4934, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: -4.52% (0.2989 => 0.2854, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -4.50% (0.3621 => 0.3458, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -4.48% (0.3394 => 0.3242, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.47% (0.4321 => 0.4128, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.46% (0.3837 => 0.3666, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -4.45% (0.3481 => 0.3326, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -4.45% (0.4248 => 0.4059, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -4.45% (0.3194 => 0.3052, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -4.35% (0.2871 => 0.2746, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.35% (0.7524 => 0.7197, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -4.34% (0.3867 => 0.3699, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.28% (0.5329 => 0.5101, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.27% (0.5569 => 0.5331, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.26% (0.4813 => 0.4608, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.25% (0.7339 => 0.7027, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.25% (0.3319 => 0.3178, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.24% (0.3252 => 0.3114, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -4.24% (0.4861 => 0.4655, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.22% (1.6474 => 1.5778, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.22% (0.5567 => 0.5332, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.21% (22.4056 => 21.4623, std.dev.: 0.0042) MultiSource/Applications/treecc/treecc: -4.21% (2.1401 => 2.0501, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.19% (0.7021 => 0.6727, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.17% (0.2903 => 0.2782, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.16% (0.2933 => 0.2811, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -4.09% (2.4021 => 2.3038, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: -4.09% (0.3205 => 0.3074, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.08% (0.6395 => 0.6134, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -4.07% (0.2849 => 0.2733, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -4.07% (0.3271 => 0.3138, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.07% (0.4427 => 0.4247, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -4.05% (0.7982 => 0.7659, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: -4.01% (0.2939 => 0.2821, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.01% (0.9557 => 0.9174, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -3.93% (0.8418 => 0.8087, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.88% (0.9077 => 0.8725, std.dev.: 0.0044) MultiSource/Applications/kimwitu++/kc: -3.88% (18.2933 => 17.5844, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.87% (0.4083 => 0.3925, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/sieve: -3.85% (0.3788 => 0.3642, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -3.84% (34.0927 => 32.7821, std.dev.: 0.0161) SingleSource/UnitTests/ObjC++/Hello: -3.78% (0.6347 => 0.6107, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.72% (0.3491 => 0.3361, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -3.68% (0.6441 => 0.6204, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: -3.67% (0.4524 => 0.4358, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: -3.66% (5.0226 => 4.8390, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.54% (2.2587 => 2.1788, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -3.53% (0.6750 => 0.6512, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -3.47% (0.7779 => 0.7509, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: -3.29% (1.5610 => 1.5096, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.13% (5.4682 => 5.2970, std.dev.: 0.0185) SingleSource/UnitTests/Vector/constpool: -1.97% (20.7746 => 20.3648, std.dev.: 0.0307) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1959, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: -62.39% (1.8100 => 0.6808, std.dev.: 0.0139) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7539, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -4.04% (2.2633 => 2.1718, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3989, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.08% (1.3096 => 1.2824, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4725, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 09:02:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 11:02:44 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121128170244.B41DE2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6349?compare_to=6346&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6349, Order: 168792, Start Time: 2012-11-28 15:34:18, End Time: 2012-11-28 17:03:15 To: 6346, Order: 168785, Start Time: 2012-11-28 13:46:52, End Time: 2012-11-28 15:17:27 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 7 (147 on baseline) Performance Improvements: 8 (47 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1036 (779 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 28.19% (1.4614 => 1.8734, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.18% (15.7468 => 17.1931, std.dev.: 0.4130) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.29% (0.3290 => 0.3530, std.dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/fldry: 2.97% (0.6599 => 0.6795, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.89% (2.3857 => 2.4308, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.45% (1.2403 => 1.2583, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.38% (4.0959 => 4.1524, std.dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -3.42% (0.3448 => 0.3330, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -3.29% (8.7719 => 8.4830, std.dev.: 0.0369) MultiSource/Applications/spiff/spiff: -2.62% (0.8598 => 0.8373, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.48% (4.7574 => 4.5442, std.dev.: 0.0500) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.14% (5.4556 => 5.3391, std.dev.: 0.0359) MultiSource/Applications/minisat/minisat: -1.54% (6.3609 => 6.2632, std.dev.: 0.0309) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.24% (3.6114 => 3.5665, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/mandel: -1.13% (1.3847 => 1.3690, std.dev.: 0.0053) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.21% (1.0893 => 1.0870, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.77% (0.3745 => 0.3716, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -14.93% (0.0221 => 0.0188, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.11% (0.0428 => 0.0389, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 13.22% (0.0295 => 0.0334, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -18.50% (0.0319 => 0.0260, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -16.36% (0.0434 => 0.0363, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0205 => 0.0205, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 44.06% (0.0143 => 0.0206, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -2.01% (0.1489 => 0.1459, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -8.91% (1.1535 => 1.0507, std.dev.: 0.0872) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.35% (0.4055 => 0.3919, std.dev.: 0.0237) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.74% (0.1495 => 0.1521, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -12.91% (0.0674 => 0.0587, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -24.18% (0.0244 => 0.0185, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.59% (0.0579 => 0.0564, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.47% (1.1463 => 1.1409, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 0.01% (9.3934 => 9.3943, std.dev.: 0.0305) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -63.64% (0.0011 => 0.0004, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 1400.00% (0.0001 => 0.0015, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.76% (0.0528 => 0.0524, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.86% (0.0175 => 0.0208, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.06% (0.8046 => 0.8051, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 59.46% (0.0037 => 0.0059, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/SciMark2-C/scimark2: -67.13% (28.5821 => 9.3943, std.dev.: 0.0305) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 9.17% (16.4461 => 17.9548, std.dev.: 0.0717) MultiSource/Applications/sqlite3/sqlite3: 2344.47% (0.6332 => 15.4784, std.dev.: 0.1148) MultiSource/Benchmarks/McCat/08-main/main: 48.72% (0.1831 => 0.2723, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.38% (0.1559 => 0.1444, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7147.04% (0.3123 => 22.6325, std.dev.: 0.1208) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1532.78% (0.3344 => 5.4600, std.dev.: 0.0237) SingleSource/Benchmarks/Misc-C++/Large/ray: 39.00% (0.2364 => 0.3286, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 5.82% (0.6010 => 0.6360, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel: -10.72% (0.0429 => 0.0383, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.3266 => 0.3426, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/strcat: 3.40% (0.1969 => 0.2036, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.12% (0.0224 => 0.0231, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0447, std.dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 10.19% (0.1462 => 0.1611, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3971, std.dev.: 0.0124) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0691, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4949, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5212, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2640, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0726, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3617, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3690, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0835, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: -29.92% (2.1832 => 1.5299, std.dev.: 0.0025) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.28% (0.0810 => 0.0950, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.51% (0.0848 => 0.0988, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 13.49% (0.1112 => 0.1262, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.29% (0.0830 => 0.0932, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.82% (0.4127 => 0.4491, std.dev.: 0.0038) MultiSource/Benchmarks/sim/sim: 8.06% (0.3226 => 0.3486, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.93% (0.1425 => 0.1538, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.82% (2.1401 => 2.3075, std.dev.: 0.0227) MultiSource/Applications/Burg/burg: 7.68% (1.2222 => 1.3161, std.dev.: 0.0074) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.67% (0.8321 => 0.8959, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/em3d/em3d: 7.55% (0.1721 => 0.1851, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 7.46% (0.6287 => 0.6756, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.04% (0.9435 => 1.0099, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.93% (0.1905 => 0.2037, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.82% (0.7473 => 0.7983, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.81% (1.5315 => 1.6358, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.55% (0.5191 => 0.5531, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 6.25% (0.8768 => 0.9316, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.25% (13.1811 => 14.0047, std.dev.: 0.0521) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.16% (0.3295 => 0.3498, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.15% (0.2519 => 0.2674, std.dev.: 0.0056) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.15% (0.3137 => 0.3330, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.02% (1.3279 => 1.4078, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.87% (3.1832 => 3.3702, std.dev.: 0.0150) MultiSource/Applications/siod/siod: 5.67% (2.2184 => 2.3441, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 5.52% (0.8697 => 0.9177, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.51% (1.2526 => 1.3216, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.47% (0.9688 => 1.0218, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.38% (0.8611 => 0.9074, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 5.34% (0.9074 => 0.9559, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 5.32% (0.7950 => 0.8373, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.29% (1.6386 => 1.7253, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 5.28% (0.8069 => 0.8495, std.dev.: 0.0101) MultiSource/Applications/SPASS/SPASS: 5.25% (14.2605 => 15.0091, std.dev.: 0.0758) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.21% (0.9056 => 0.9528, std.dev.: 0.0114) MultiSource/Benchmarks/McCat/18-imp/imp: 5.20% (0.3503 => 0.3685, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 5.17% (0.8712 => 0.9162, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 5.14% (0.9069 => 0.9535, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.12% (0.8597 => 0.9037, std.dev.: 0.0156) MultiSource/Benchmarks/Olden/bh/bh: 5.06% (0.2985 => 0.3136, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.01% (1.1606 => 1.2187, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.99% (0.9908 => 1.0402, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.97% (0.8457 => 0.8877, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 4.93% (0.9039 => 0.9485, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 4.93% (0.8177 => 0.8580, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.92% (0.8885 => 0.9322, std.dev.: 0.0057) MultiSource/Benchmarks/nbench/nbench: 4.89% (1.1271 => 1.1822, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 4.88% (0.8007 => 0.8398, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.88% (0.8656 => 0.9078, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.85% (0.5961 => 0.6250, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 4.81% (0.8261 => 0.8658, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 4.68% (0.8805 => 0.9217, std.dev.: 0.0043) MultiSource/Applications/treecc/treecc: 4.67% (1.9948 => 2.0879, std.dev.: 0.0247) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.65% (0.2279 => 0.2385, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 4.64% (0.8359 => 0.8747, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.60% (0.3717 => 0.3888, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: 4.58% (2.3764 => 2.4853, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.57% (0.8050 => 0.8418, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.52% (0.8716 => 0.9110, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.51% (0.8518 => 0.8902, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.50% (0.3003 => 0.3138, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.46% (0.6010 => 0.6278, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 4.42% (0.8204 => 0.8567, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.40% (0.8316 => 0.8682, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.40% (1.1685 => 1.2199, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.39% (0.8286 => 0.8650, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.38% (0.5817 => 0.6072, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.38% (0.8420 => 0.8789, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 4.37% (0.8927 => 0.9317, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.34% (0.4559 => 0.4757, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.29% (0.7966 => 0.8308, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.29% (1.2602 => 1.3143, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 4.29% (0.8855 => 0.9235, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.29% (0.2378 => 0.2480, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.25% (0.8086 => 0.8430, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.25% (0.7932 => 0.8269, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4.23% (0.8317 => 0.8669, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.23% (0.8331 => 0.8683, std.dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.20% (0.4783 => 0.4984, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.16% (4.4880 => 4.6746, std.dev.: 0.0083) MultiSource/Applications/d/make_dparser: 4.12% (3.2366 => 3.3699, std.dev.: 0.0136) MultiSource/Applications/minisat/minisat: 4.08% (0.6834 => 0.7113, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 4.02% (8.6247 => 8.9710, std.dev.: 0.0577) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.97% (4.1763 => 4.3421, std.dev.: 0.0250) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.96% (0.8338 => 0.8668, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.95% (8.6476 => 8.9896, std.dev.: 0.0600) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.90% (0.2741 => 0.2848, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.90% (0.6227 => 0.6470, std.dev.: 0.0076) MultiSource/Applications/JM/lencod/lencod: 3.90% (15.3280 => 15.9253, std.dev.: 0.0634) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.84% (0.8066 => 0.8376, std.dev.: 0.0068) MultiSource/Applications/SIBsim4/SIBsim4: 3.77% (1.2568 => 1.3042, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.76% (0.2844 => 0.2951, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 3.67% (1.0945 => 1.1347, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/gs/gs: 3.60% (4.1305 => 4.2794, std.dev.: 0.0345) MultiSource/Applications/lua/lua: 3.51% (3.8189 => 3.9529, std.dev.: 0.0347) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.43% (1.1170 => 1.1553, std.dev.: 0.0119) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.36% (6.6074 => 6.8291, std.dev.: 0.0220) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.34% (0.3115 => 0.3219, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 3.29% (6.7320 => 6.9534, std.dev.: 0.0291) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.25% (0.8340 => 0.8611, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.20% (0.6586 => 0.6797, std.dev.: 0.0070) MultiSource/Applications/ClamAV/clamscan: 3.18% (14.7684 => 15.2381, std.dev.: 0.1366) MultiSource/Applications/oggenc/oggenc: 3.07% (4.9628 => 5.1154, std.dev.: 0.0071) MultiSource/Applications/lambda-0_1_3/lambda: 2.75% (0.7557 => 0.7765, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.58% (4.5702 => 4.6879, std.dev.: 0.0198) MultiSource/Benchmarks/Bullet/bullet: 2.47% (31.8598 => 32.6470, std.dev.: 0.2155) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.20% (0.8995 => 0.9193, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 1.98% (0.9810 => 1.0004, std.dev.: 0.0066) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 39.84% (1.5795 => 2.2088, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 27.58% (2.9096 => 3.7121, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.25% (4.8436 => 5.8728, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.92% (8.2783 => 9.7614, std.dev.: 0.0212) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.40% (14.6451 => 17.1931, std.dev.: 0.4130) SingleSource/Benchmarks/McGill/misr: 17.40% (0.4001 => 0.4697, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.66% (0.7597 => 0.8863, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.30% (6.3772 => 7.1613, std.dev.: 0.1593) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.68% (2.7995 => 3.1266, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.80% (0.3186 => 0.3530, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.20% (1.1857 => 1.3066, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 10.10% (7.4933 => 8.2499, std.dev.: 0.0219) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.35% (23.5781 => 25.3116, std.dev.: 0.0265) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.24% (3.9917 => 4.2808, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/lpbench: 6.46% (3.9006 => 4.1524, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.37% (3.3761 => 3.5910, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.10% (2.9753 => 3.1568, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 6.01% (4.8660 => 5.1586, std.dev.: 0.0290) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.69% (4.5327 => 4.7904, std.dev.: 0.0189) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.31% (0.3937 => 0.4146, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.29% (5.3218 => 5.6031, std.dev.: 0.0323) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.17% (5.4187 => 5.6987, std.dev.: 0.0248) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 5.01% (0.5214 => 0.5475, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 4.94% (0.4353 => 0.4568, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 4.84% (1.0388 => 1.0891, std.dev.: 0.0148) MultiSource/Applications/aha/aha: 4.69% (3.3398 => 3.4966, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/richards_benchmark: 4.43% (1.3037 => 1.3615, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.71% (4.8362 => 5.0156, std.dev.: 0.0158) MultiSource/Benchmarks/Olden/power/power: 3.09% (1.2061 => 1.2434, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.21% (3.4104 => 3.4859, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.21% (0.6150 => 0.6286, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/queens: 2.14% (1.7056 => 1.7421, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: 2.01% (0.5081 => 0.5183, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 1.80% (6.1525 => 6.2632, std.dev.: 0.0309) SingleSource/Benchmarks/Shootout/methcall: 1.63% (8.2676 => 8.4021, std.dev.: 0.0218) SingleSource/Benchmarks/Misc/ReedSolomon: 1.58% (8.5322 => 8.6671, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.51% (11.5690 => 11.7442, std.dev.: 0.0168) MultiSource/Benchmarks/Olden/bh/bh: 1.46% (2.3560 => 2.3904, std.dev.: 0.0119) MultiSource/Benchmarks/sim/sim: 1.05% (3.8206 => 3.8606, std.dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.27% (2.8951 => 1.6714, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -25.98% (7.2130 => 5.3391, std.dev.: 0.0359) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.81% (1.4529 => 1.1506, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.89% (9.9065 => 8.2333, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/ary3: -13.47% (1.9999 => 1.7306, std.dev.: 0.0115) MultiSource/Benchmarks/Olden/em3d/em3d: -12.76% (5.4641 => 4.7671, std.dev.: 0.0332) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.54% (0.3269 => 0.2957, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: -9.53% (1.1216 => 1.0147, std.dev.: 0.0261) SingleSource/Benchmarks/Misc/flops-8: -9.45% (2.5609 => 2.3190, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -9.11% (63.1822 => 57.4248, std.dev.: 0.0430) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.21% (1.0512 => 0.9649, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.90% (3.2169 => 2.9629, std.dev.: 0.0238) SingleSource/Benchmarks/Shootout/sieve: -6.20% (7.0599 => 6.6223, std.dev.: 0.0418) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.15% (4.7482 => 4.4563, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.09% (5.1305 => 4.8180, std.dev.: 0.0588) SingleSource/Benchmarks/Stanford/FloatMM: -5.71% (0.8807 => 0.8304, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/flops: -5.61% (9.3748 => 8.8492, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.33% (6.2275 => 5.8954, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/ffbench: -5.23% (1.4296 => 1.3548, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.84% (5.6343 => 5.3615, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.56% (4.7449 => 4.5287, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.34% (6.1706 => 5.9026, std.dev.: 0.0682) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.32% (4.9453 => 4.7316, std.dev.: 0.0118) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.27% (2.8773 => 2.7544, std.dev.: 0.0234) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.07% (1.3882 => 1.3317, std.dev.: 0.0199) MultiSource/Applications/lua/lua: -3.96% (29.8330 => 28.6520, std.dev.: 0.1034) SingleSource/Benchmarks/Shootout-C++/methcall: -3.95% (8.9760 => 8.6217, std.dev.: 0.0609) SingleSource/Benchmarks/Misc/perlin: -3.74% (5.1084 => 4.9173, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.64% (5.1557 => 4.9682, std.dev.: 0.0117) MultiSource/Applications/siod/siod: -3.45% (3.6643 => 3.5378, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.27% (4.9686 => 4.8061, std.dev.: 0.0275) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.15% (5.4300 => 5.2587, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/hash: -2.69% (4.3087 => 4.1930, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.64% (2.6356 => 2.5661, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/fbench: -2.55% (3.3840 => 3.2978, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: -2.08% (1.0841 => 1.0616, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: -2.01% (1.4861 => 1.4562, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/flops-5: -1.73% (2.8957 => 2.8455, std.dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/fldry: -1.66% (0.6910 => 0.6795, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-6: -1.64% (2.4416 => 2.4015, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.59% (3.5679 => 3.5111, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: -1.57% (15.8853 => 15.6356, std.dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: -1.54% (6.7064 => 6.6029, std.dev.: 0.0226) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.44% (4.2466 => 4.1853, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.23% (4.7794 => 4.7207, std.dev.: 0.0080) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.02% (2.4333 => 2.4084, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.01% (1.5308 => 1.5154, std.dev.: 0.0058) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 5.92% (1.0262 => 1.0870, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.87% (0.2463 => 0.3716, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 52.85% (0.0123 => 0.0188, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.66% (0.0408 => 0.0389, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.50% (0.0254 => 0.0334, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -13.91% (0.0302 => 0.0260, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.47% (0.0384 => 0.0363, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 14.44% (0.0180 => 0.0206, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.46% (0.1438 => 0.1459, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -7.26% (1.1329 => 1.0507, std.dev.: 0.0872) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.88% (0.4164 => 0.3919, std.dev.: 0.0237) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.10% (0.1369 => 0.1521, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.42% (0.0641 => 0.0587, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.13% (0.0195 => 0.0185, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.42% (0.0578 => 0.0564, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.24% (1.1437 => 1.1409, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 300.00% (0.0001 => 0.0004, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 7.14% (0.0014 => 0.0015, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -16.43% (0.0627 => 0.0524, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.56% (0.0180 => 0.0208, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.42% (0.8017 => 0.8051, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -4.84% (0.0062 => 0.0059, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 5.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 09:32:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 11:32:21 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121128173221.713172A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6350?compare_to=6344&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6350, Order: 168785, Start Time: 2012-11-28 15:09:41, End Time: 2012-11-28 17:32:50 To: 6344, Order: 168782, Start Time: 2012-11-28 11:55:05, End Time: 2012-11-28 14:14:24 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 55 (155 on baseline) Performance Improvements: 1 (43 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1030 (687 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/messages-2: 14.08% (0.0774 => 0.0883, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 13.95% (0.6229 => 0.7098, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/objinst: 12.73% (0.3371 => 0.3800, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 12.48% (0.3038 => 0.3417, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 11.95% (0.5148 => 0.5763, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.91% (0.5128 => 0.5739, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/random: 11.91% (0.3047 => 0.3410, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/heapsort: 11.74% (0.3126 => 0.3493, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/moments: 11.23% (0.4478 => 0.4981, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.70% (0.6187 => 0.6849, std.dev.: 0.0170) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.62% (0.1036 => 0.1146, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.77% (4.5077 => 4.9481, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/parameter-passing: 9.46% (0.4450 => 0.4871, std.dev.: 0.0155) SingleSource/UnitTests/ObjC/exceptions: 9.10% (0.4310 => 0.4702, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.02% (0.9555 => 1.0417, std.dev.: 0.0050) MultiSource/Applications/lambda-0_1_3/lambda: 8.88% (0.8552 => 0.9311, std.dev.: 0.0229) MultiSource/Benchmarks/PAQ8p/paq8p: 8.84% (11.2532 => 12.2477, std.dev.: 0.1209) SingleSource/UnitTests/ObjC/for-in: 8.74% (0.4153 => 0.4516, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.67% (0.3993 => 0.4339, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/synchronized: 8.56% (0.4009 => 0.4352, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.49% (0.5936 => 0.6440, std.dev.: 0.0166) SingleSource/UnitTests/ObjC/trivial-interface: 8.11% (0.3919 => 0.4237, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 8.05% (1.5386 => 1.6625, std.dev.: 0.0378) SingleSource/Benchmarks/Shootout-C++/hash: 7.94% (0.4801 => 0.5182, std.dev.: 0.0088) SingleSource/UnitTests/ObjC/property: 7.91% (0.4385 => 0.4732, std.dev.: 0.0041) MultiSource/Applications/lua/lua: 7.45% (4.3938 => 4.7210, std.dev.: 0.0992) SingleSource/Benchmarks/Misc-C++/bigfib: 7.12% (0.7278 => 0.7796, std.dev.: 0.0169) MultiSource/Benchmarks/Olden/em3d/em3d: 7.03% (0.1976 => 0.2115, std.dev.: 0.0041) SingleSource/UnitTests/ObjC++/Hello: 6.92% (0.6534 => 0.6986, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.36% (0.7170 => 0.7626, std.dev.: 0.0104) SingleSource/UnitTests/ObjC++/property-reference: 5.36% (0.8038 => 0.8469, std.dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.93% (0.6048 => 0.6346, std.dev.: 0.0067) SingleSource/UnitTests/ObjC++/property-reference-object: 4.79% (0.6657 => 0.6976, std.dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.43% (4.9570 => 5.1765, std.dev.: 0.0831) SingleSource/UnitTests/ObjC/exceptions-4: 4.16% (0.4156 => 0.4329, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.83% (0.4183 => 0.4343, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-3: 3.19% (0.4139 => 0.4271, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/BoolLiteralTest: 2.89% (0.4673 => 0.4808, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.38% (8.4420 => 8.6427, std.dev.: 0.0618) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 23.75% (14.2783 => 17.6698, std.dev.: 0.4974) SingleSource/Benchmarks/CoyoteBench/fftbench: 19.62% (2.1081 => 2.5217, std.dev.: 0.1582) SingleSource/Benchmarks/CoyoteBench/lpbench: 19.27% (10.2566 => 12.2327, std.dev.: 0.3766) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.54% (1.5560 => 1.8445, std.dev.: 0.0601) MultiSource/Applications/minisat/minisat: 17.99% (9.5238 => 11.2367, std.dev.: 0.6508) SingleSource/Benchmarks/Shootout-C++/moments: 14.58% (0.1214 => 0.1391, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 14.32% (13.4509 => 15.3775, std.dev.: 0.5384) SingleSource/Benchmarks/Shootout-C++/hash2: 8.26% (3.3693 => 3.6477, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hash: 5.93% (0.7616 => 0.8068, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.23% (4.0520 => 4.2639, std.dev.: 0.0489) MultiSource/Applications/lemon/lemon: 4.89% (1.4443 => 1.5149, std.dev.: 0.0259) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.73% (59.6329 => 61.8556, std.dev.: 0.0619) MultiSource/Applications/sqlite3/sqlite3: 3.57% (4.5613 => 4.7240, std.dev.: 0.0177) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.26% (6.2822 => 6.4872, std.dev.: 0.0389) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.66% (4.2367 => 4.3069, std.dev.: 0.0269) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.05% (2.1861 => 2.2090, std.dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/ObjC/synchronized: -31.41% (0.1939 => 0.1330, std.dev.: 0.0027) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.50% (69.3111 => 68.9669, std.dev.: 0.6107) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -1.55% (0.1359 => 0.1338, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.10% (0.0420 => 0.0454, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.31% (0.0652 => 0.0654, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -1.12% (494.4020 => 488.8876, std.dev.: 2.3781) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.05% (63.2438 => 68.9669, std.dev.: 0.6107) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.97% (4.3882 => 0.0454, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43252.63% (1.1277 => 488.8876, std.dev.: 2.3781) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 217.94% (0.5229 => 1.6625, std.dev.: 0.0378) MultiSource/Applications/SPASS/SPASS: 21.02% (14.9895 => 18.1409, std.dev.: 0.1400) MultiSource/Applications/kimwitu++/kc: 47.10% (14.1553 => 20.8221, std.dev.: 0.6165) MultiSource/Benchmarks/MallocBench/gs/gs: 21.88% (4.1105 => 5.0098, std.dev.: 0.1547) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.07% (1.1048 => 1.5144, std.dev.: 0.0763) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 427.93% (7.1582 => 37.7905, std.dev.: 0.3608) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.05% (3.4629 => 6.3388, std.dev.: 0.3329) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.80% (0.6222 => 1.0316, std.dev.: 0.0652) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10480.14% (0.0720 => 7.6177, std.dev.: 0.3010) MultiSource/Applications/SIBsim4/SIBsim4: 3857700.00% (0.0001 => 3.8578, std.dev.: 0.0523) MultiSource/Applications/SPASS/SPASS: 15377400.00% (0.0001 => 15.3775, std.dev.: 0.5384) MultiSource/Applications/kimwitu++/kc: 52400.00% (0.0001 => 0.0525, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 64000.00% (0.0001 => 0.0641, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576000.00% (0.0001 => 0.5761, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10074600.00% (0.0001 => 10.0747, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5685000.00% (0.0001 => 5.6851, std.dev.: 0.9060) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1735.80% (1.1194 => 20.5499, std.dev.: 0.7050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 76.17% (2.9384 => 5.1765, std.dev.: 0.0831) MultiSource/Applications/ClamAV/clamscan: 67.45% (22.1758 => 37.1326, std.dev.: 0.3571) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.81% (8.1363 => 12.2707, std.dev.: 0.2697) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 50.67% (7.0540 => 10.6282, std.dev.: 0.4291) SingleSource/Benchmarks/CoyoteBench/almabench: 47.53% (0.0730 => 0.1077, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/distray/distray: 44.89% (0.1056 => 0.1530, std.dev.: 0.0058) MultiSource/Applications/JM/lencod/lencod: 43.58% (21.9371 => 31.4979, std.dev.: 0.4081) SingleSource/Benchmarks/Misc/flops: 37.50% (0.1432 => 0.1969, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/messages-2: 33.38% (0.0662 => 0.0883, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/dot-syntax-1: 32.15% (0.0479 => 0.0633, std.dev.: 0.0016) SingleSource/UnitTests/vla: 30.42% (0.0355 => 0.0463, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.47% (0.8172 => 1.0417, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 27.13% (3.8922 => 4.9481, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/functionobjects: 26.41% (0.5020 => 0.6346, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/family/family: 25.69% (0.0397 => 0.0499, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 25.27% (0.7433 => 0.9311, std.dev.: 0.0229) MultiSource/Benchmarks/Olden/em3d/em3d: 24.78% (0.1695 => 0.2115, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash2: 24.74% (0.4620 => 0.5763, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.66% (0.0746 => 0.0930, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 24.44% (0.0491 => 0.0611, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 24.04% (0.3927 => 0.4871, std.dev.: 0.0155) SingleSource/Benchmarks/Stanford/Oscar: 23.90% (0.0636 => 0.0788, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: 23.79% (0.4636 => 0.5739, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 23.56% (0.1125 => 0.1390, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/lpbench: 23.36% (0.0929 => 0.1146, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 23.05% (0.4048 => 0.4981, std.dev.: 0.0118) SingleSource/UnitTests/ObjC/exceptions: 22.83% (0.3828 => 0.4702, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 22.56% (0.0953 => 0.1168, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: 22.55% (0.2554 => 0.3130, std.dev.: 0.0153) SingleSource/UnitTests/ObjC/instance-method-metadata: 22.47% (0.3543 => 0.4339, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/mst/mst: 22.44% (0.1163 => 0.1424, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/nestedloop: 22.34% (0.2793 => 0.3417, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 22.25% (0.3694 => 0.4516, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/synchronized: 22.21% (0.3561 => 0.4352, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-4: 22.18% (0.3543 => 0.4329, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.16% (0.1566 => 0.1913, std.dev.: 0.0093) SingleSource/UnitTests/ObjC/trivial-interface: 22.00% (0.3473 => 0.4237, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 21.92% (3.8723 => 4.7210, std.dev.: 0.0992) SingleSource/UnitTests/ObjC/property: 21.77% (0.3886 => 0.4732, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/random: 21.70% (0.2802 => 0.3410, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/heapsort: 21.62% (0.2872 => 0.3493, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 21.59% (0.4103 => 0.4989, std.dev.: 0.0212) SingleSource/UnitTests/ObjC/exceptions-2: 21.50% (0.3497 => 0.4249, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/exceptions-3: 21.47% (0.3516 => 0.4271, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 21.37% (0.3131 => 0.3800, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 21.25% (1.0722 => 1.3000, std.dev.: 0.0572) MultiSource/Applications/Burg/burg: 21.24% (1.1642 => 1.4115, std.dev.: 0.0448) MultiSource/Applications/d/make_dparser: 21.23% (3.3354 => 4.0436, std.dev.: 0.1263) SingleSource/Benchmarks/Shootout-C++/hash: 20.82% (0.4289 => 0.5182, std.dev.: 0.0088) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.77% (0.1584 => 0.1913, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/bigfib: 20.76% (0.6456 => 0.7796, std.dev.: 0.0169) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.55% (0.0793 => 0.0956, std.dev.: 0.0050) MultiSource/Applications/spiff/spiff: 20.46% (0.7835 => 0.9438, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 20.36% (14.3668 => 17.2917, std.dev.: 0.5290) SingleSource/Benchmarks/Shootout-C++/reversefile: 19.97% (0.3865 => 0.4637, std.dev.: 0.0125) MultiSource/Applications/viterbi/viterbi: 19.68% (0.1555 => 0.1861, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/bmm/bmm: 19.50% (0.0759 => 0.0907, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 19.37% (0.3422 => 0.4085, std.dev.: 0.0197) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.23% (2.2024 => 2.6260, std.dev.: 0.1118) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.07% (0.2700 => 0.3215, std.dev.: 0.0196) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 19.05% (0.0672 => 0.0800, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sieve: 18.82% (0.3603 => 0.4281, std.dev.: 0.0214) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.47% (0.0704 => 0.0834, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.23% (0.6450 => 0.7626, std.dev.: 0.0104) MultiSource/Benchmarks/PAQ8p/paq8p: 18.14% (10.3673 => 12.2477, std.dev.: 0.1209) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.05% (0.0842 => 0.0994, std.dev.: 0.0045) SingleSource/UnitTests/ObjC++/Hello: 17.91% (0.5925 => 0.6986, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary3: 17.27% (0.3283 => 0.3850, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/methcall: 17.24% (0.2877 => 0.3373, std.dev.: 0.0102) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.22% (0.0871 => 0.1021, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 16.97% (9.4845 => 11.0936, std.dev.: 0.2743) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.53% (0.3121 => 0.3637, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.48% (0.9765 => 1.1374, std.dev.: 0.0474) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.13% (0.2065 => 0.2398, std.dev.: 0.0101) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.80% (0.0886 => 0.1026, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.76% (0.1117 => 0.1293, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hello: 15.73% (0.2714 => 0.3141, std.dev.: 0.0096) SingleSource/UnitTests/ObjC++/property-reference-object: 15.69% (0.6030 => 0.6976, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.67% (4.9449 => 5.7197, std.dev.: 0.1131) SingleSource/Benchmarks/Shootout/matrix: 15.65% (0.0818 => 0.0946, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 15.64% (0.2430 => 0.2810, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.62% (1.5415 => 1.7823, std.dev.: 0.0336) SingleSource/UnitTests/ObjC++/property-reference: 15.60% (0.7326 => 0.8469, std.dev.: 0.0145) MultiSource/Benchmarks/NPB-serial/is/is: 15.58% (0.0719 => 0.0831, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/health/health: 15.54% (0.1268 => 0.1465, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/bh/bh: 15.52% (0.3092 => 0.3572, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/oourafft: 15.14% (0.3282 => 0.3779, std.dev.: 0.0175) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.06% (0.0770 => 0.0886, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.88% (0.1062 => 0.1220, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.76% (0.2107 => 0.2418, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.44% (0.1337 => 0.1530, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/18-imp/imp: 14.43% (0.3423 => 0.3917, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.40% (0.5981 => 0.6842, std.dev.: 0.0235) SingleSource/Benchmarks/Misc/ReedSolomon: 14.35% (0.2049 => 0.2343, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.29% (0.1029 => 0.1176, std.dev.: 0.0049) MultiSource/Applications/sgefa/sgefa: 14.28% (0.3109 => 0.3553, std.dev.: 0.0149) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.27% (0.0834 => 0.0953, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.06% (0.5569 => 0.6352, std.dev.: 0.0273) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.98% (0.5860 => 0.6679, std.dev.: 0.0301) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.97% (0.5105 => 0.5818, std.dev.: 0.0222) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.84% (0.1510 => 0.1719, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.83% (0.2271 => 0.2585, std.dev.: 0.0120) SingleSource/UnitTests/ObjC/block-byref-aggr: 13.78% (0.3817 => 0.4343, std.dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 13.46% (5.7591 => 6.5340, std.dev.: 0.2010) MultiSource/Applications/treecc/treecc: 13.15% (2.0273 => 2.2938, std.dev.: 0.0831) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.07% (0.8101 => 0.9079, std.dev.: 0.0338) MultiSource/Benchmarks/McCat/05-eks/eks: 12.07% (0.4299 => 0.4818, std.dev.: 0.0191) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.90% (0.1143 => 0.1279, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 11.56% (17.1811 => 19.1669, std.dev.: 0.6884) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.76% (0.3177 => 0.3519, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary: 9.90% (0.3232 => 0.3552, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.58% (0.2756 => 0.3020, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/matrix: 9.36% (0.3098 => 0.3388, std.dev.: 0.0111) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.55% (7.9617 => 8.6427, std.dev.: 0.0618) MultiSource/Benchmarks/Olden/power/power: 7.50% (0.1440 => 0.1548, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.38% (4.3953 => 11.0050, std.dev.: 0.0230) SingleSource/Benchmarks/Shootout-C++/methcall: 147.52% (5.3999 => 13.3661, std.dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 31.49% (13.4384 => 17.6698, std.dev.: 0.4974) SingleSource/UnitTests/ObjC/synchronized: 26.55% (0.1051 => 0.1330, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 23.86% (2.0360 => 2.5217, std.dev.: 0.1582) MultiSource/Applications/minisat/minisat: 23.26% (9.1159 => 11.2367, std.dev.: 0.6508) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.27% (1.5086 => 1.8445, std.dev.: 0.0601) SingleSource/Benchmarks/Shootout-C++/moments: 20.02% (0.1159 => 0.1391, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/lpbench: 18.24% (10.3460 => 12.2327, std.dev.: 0.3766) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.66% (1.1145 => 1.3002, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/oourafft: 16.15% (6.6465 => 7.7197, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/hash2: 15.51% (3.1578 => 3.6477, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout/ary3: 14.95% (3.6994 => 4.2526, std.dev.: 0.2002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.15% (0.2944 => 0.3331, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.65% (2.8904 => 3.2270, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.66% (3.8532 => 4.2639, std.dev.: 0.0489) SingleSource/Benchmarks/Misc/richards_benchmark: 10.39% (1.1396 => 1.2580, std.dev.: 0.0042) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.27% (1.7254 => 1.8853, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash: 8.22% (0.7455 => 0.8068, std.dev.: 0.0125) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.68% (4.2280 => 4.4682, std.dev.: 0.0048) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 5.02% (1.9405 => 2.0380, std.dev.: 0.0322) MultiSource/Applications/lua/lua: 4.99% (26.0924 => 27.3949, std.dev.: 0.2095) MultiSource/Applications/lemon/lemon: 4.76% (1.4460 => 1.5149, std.dev.: 0.0259) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.6436 => 12.1024, std.dev.: 0.0143) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.32% (0.4162 => 0.4300, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.11% (2.1424 => 2.2090, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 2.07% (3.1595 => 3.2249, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 1.75% (1.7133 => 1.7432, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: 1.72% (4.6441 => 4.7240, std.dev.: 0.0177) MultiSource/Benchmarks/PAQ8p/paq8p: 1.59% (85.0658 => 86.4185, std.dev.: 0.2094) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.46% (6.5088 => 6.6038, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/sieve: 1.32% (5.2139 => 5.2825, std.dev.: 0.0166) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.29% (1.0313 => 1.0446, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0502, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 1.07% (5.2636 => 5.3197, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1676, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.79% (5.2763 => 1.2248, std.dev.: 0.0564) SingleSource/Benchmarks/Misc/salsa20: -74.29% (0.8651 => 0.2224, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/richards_benchmark: -36.25% (0.1622 => 0.1034, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.45% (5.3526 => 4.6863, std.dev.: 0.1799) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.38% (5.3855 => 4.7727, std.dev.: 0.1304) MultiSource/Applications/JM/ldecod/ldecod: -6.67% (10.4361 => 9.7404, std.dev.: 0.0990) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -68.60% (32.5116 => 10.2074, std.dev.: 0.0256) SingleSource/Benchmarks/Dhrystone/fldry: -65.90% (1.9577 => 0.6676, std.dev.: 0.0136) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1682, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.28% (0.3987 => 0.2381, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.22% (4.5009 => 2.7806, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7652, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.14% (2.6546 => 2.0137, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -19.30% (0.2161 => 0.1744, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -16.01% (1.6925 => 1.4215, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2842, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -10.64% (1.5373 => 1.3738, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -10.51% (9.5636 => 8.5583, std.dev.: 0.1168) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.52% (1.5660 => 1.4326, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.41% (1.6805 => 1.5392, std.dev.: 0.0366) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.95% (4.8142 => 4.4796, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.70% (0.3463 => 0.3231, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.51% (3.2416 => 3.0629, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.17% (0.2497 => 0.2368, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.07% (0.8614 => 0.8177, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5082, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/lists: -4.32% (6.2999 => 6.0280, std.dev.: 0.0113) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.58% (19.9488 => 19.2337, std.dev.: 0.1368) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.56% (0.9957 => 0.9603, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: -3.09% (5.0483 => 4.8921, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.56% (0.4808 => 0.4685, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.86% (8.1563 => 8.0047, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -1.53% (10.2830 => 10.1258, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.09% (0.2116 => 0.0654, std.dev.: 0.0009) Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 11:37:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 13:37:10 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121128193710.A1B3B2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6351?compare_to=6349&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6351, Order: 168794, Start Time: 2012-11-28 18:01:45, End Time: 2012-11-28 19:37:45 To: 6349, Order: 168792, Start Time: 2012-11-28 15:34:18, End Time: 2012-11-28 17:03:15 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 12 (63 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1039 (874 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.91% (0.1277 => 0.1378, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.89% (0.2307 => 0.2466, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 4.63% (0.3174 => 0.3321, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.41% (0.2837 => 0.2962, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 2.87% (3.9529 => 4.0664, std.dev.: 0.0219) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 12.04% (19.6868 => 22.0568, std.dev.: 0.8030) MultiSource/Benchmarks/Olden/health/health: 4.48% (0.3460 => 0.3615, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.60% (59.3563 => 60.8980, std.dev.: 0.5872) MultiSource/Applications/SIBsim4/SIBsim4: 2.20% (3.1934 => 3.2638, std.dev.: 0.0257) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.70% (2.4718 => 2.5138, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.68% (1.5631 => 1.5893, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.49% (4.3973 => 4.4626, std.dev.: 0.0179) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.83% (1.0870 => 1.0960, std.dev.: 0.0375) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.24% (0.3716 => 0.3707, std.dev.: 0.0791) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -17.55% (0.0188 => 0.0155, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 10.80% (0.0389 => 0.0431, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.50% (0.0334 => 0.0339, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 23.08% (0.0260 => 0.0320, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 14.05% (0.0363 => 0.0414, std.dev.: 0.0070) SingleSource/UnitTests/Vector/Altivec/casts: -12.68% (0.0205 => 0.0179, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/test1: 7.28% (0.0206 => 0.0221, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.69% (0.1459 => 0.1469, std.dev.: 0.0194) MultiSource/Applications/lemon/lemon: 12.76% (1.0507 => 1.1848, std.dev.: 0.1299) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.70% (0.3919 => 0.4025, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.57% (0.1521 => 0.1421, std.dev.: 0.0276) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.17% (0.0587 => 0.0588, std.dev.: 0.0176) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 50.27% (0.0185 => 0.0278, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.53% (0.0564 => 0.0567, std.dev.: 0.0151) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.60% (1.1409 => 1.1591, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 0.10% (9.3943 => 9.4037, std.dev.: 0.1365) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 650.00% (0.0004 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 73.33% (0.0015 => 0.0026, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 15.84% (0.0524 => 0.0607, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 12.02% (0.0208 => 0.0233, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.39% (0.8051 => 0.8082, std.dev.: 0.0279) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: 500.00% (0.0001 => 0.0006, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 300.00% (0.0001 => 0.0004, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 76.27% (0.0059 => 0.0104, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/SciMark2-C/scimark2: -67.10% (28.5821 => 9.4037, std.dev.: 0.1365) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 9.64% (16.4461 => 18.0317, std.dev.: 0.2648) MultiSource/Applications/sqlite3/sqlite3: 2375.60% (0.6332 => 15.6755, std.dev.: 0.7511) MultiSource/Benchmarks/McCat/08-main/main: 53.58% (0.1831 => 0.2812, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.89% (0.1559 => 0.1514, std.dev.: 0.0381) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7321.77% (0.3123 => 23.1782, std.dev.: 0.7861) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1533.13% (0.3344 => 5.4612, std.dev.: 0.2755) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.69% (0.2364 => 0.3255, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/bigfib: 5.27% (0.6010 => 0.6327, std.dev.: 0.0903) SingleSource/Benchmarks/Misc/mandel: 3.73% (0.0429 => 0.0445, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.27% (0.3266 => 0.3438, std.dev.: 0.0492) SingleSource/Benchmarks/Shootout-C++/strcat: 4.52% (0.1969 => 0.2058, std.dev.: 0.0072) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 12.95% (0.0224 => 0.0253, std.dev.: 0.0016) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0508, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 15.18% (0.1462 => 0.1684, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4256, std.dev.: 0.0420) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0724, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.5123, std.dev.: 0.0810) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5181, std.dev.: 0.0407) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2670, std.dev.: 0.0286) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0654, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3616, std.dev.: 0.0228) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3861, std.dev.: 0.0338) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0815, std.dev.: 0.0233) SingleSource/Regression/C/uint64_to_float: -29.64% (2.1832 => 1.5362, std.dev.: 0.0269) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 22.22% (0.0810 => 0.0990, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.57% (0.0848 => 0.0997, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.12% (0.2180 => 0.2466, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.22% (0.8148 => 0.9062, std.dev.: 0.0281) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.03% (0.1137 => 0.1251, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 8.80% (0.3226 => 0.3510, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.39% (0.1466 => 0.1589, std.dev.: 0.0047) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.19% (0.1588 => 0.1718, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.48% (0.9074 => 0.9753, std.dev.: 0.0130) MultiSource/Benchmarks/nbench/nbench: 7.46% (1.1271 => 1.2112, std.dev.: 0.0139) MultiSource/Benchmarks/Olden/bh/bh: 7.24% (0.2985 => 0.3201, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.78% (0.2774 => 0.2962, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: 6.71% (2.3764 => 2.5359, std.dev.: 0.0584) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.54% (0.8048 => 0.8574, std.dev.: 0.0191) MultiSource/Applications/lua/lua: 6.48% (3.8189 => 4.0664, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 6.28% (0.8855 => 0.9411, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 6.26% (0.9069 => 0.9637, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.51% (0.8656 => 0.9133, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 5.49% (0.8317 => 0.8774, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 5.33% (0.8712 => 0.9176, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.11% (0.2741 => 0.2881, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5.05% (0.9908 => 1.0408, std.dev.: 0.0183) MultiSource/Benchmarks/McCat/18-imp/imp: 4.97% (0.3503 => 0.3677, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.90% (0.8420 => 0.8833, std.dev.: 0.0143) MultiSource/Benchmarks/McCat/05-eks/eks: 4.50% (0.4397 => 0.4595, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.22% (0.7966 => 0.8302, std.dev.: 0.0127) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 39.61% (1.5795 => 2.2051, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 27.96% (2.9096 => 3.7231, std.dev.: 0.0659) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 24.63% (0.0406 => 0.0506, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.26% (4.8436 => 5.8733, std.dev.: 0.0186) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.95% (14.6451 => 17.4209, std.dev.: 0.2946) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.93% (8.2783 => 9.7628, std.dev.: 0.0237) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.97% (0.7597 => 0.8810, std.dev.: 0.0182) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.51% (0.3186 => 0.3680, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.73% (2.7995 => 3.1278, std.dev.: 0.0356) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.47% (6.3772 => 7.0450, std.dev.: 0.2098) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.36% (0.1129 => 0.1246, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 10.34% (7.4933 => 8.2681, std.dev.: 0.0152) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 9.90% (1.1857 => 1.3031, std.dev.: 0.0155) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.40% (23.5781 => 25.3239, std.dev.: 0.0321) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.04% (3.9917 => 4.2726, std.dev.: 0.0655) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.43% (4.5327 => 4.8243, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.42% (3.3761 => 3.5930, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.06% (2.9753 => 3.1556, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.94% (5.3218 => 5.6379, std.dev.: 0.0268) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.87% (4.8660 => 5.1516, std.dev.: 0.0287) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.33% (5.4187 => 5.7076, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.31% (0.3937 => 0.4146, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 4.51% (1.3037 => 1.3625, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 4.02% (0.4353 => 0.4528, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/dry: 3.66% (0.5081 => 0.5267, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 3.55% (0.5214 => 0.5399, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.82% (0.3587 => 0.3688, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.76% (59.2638 => 60.8980, std.dev.: 0.5872) MultiSource/Benchmarks/Olden/bh/bh: 2.53% (2.3560 => 2.4155, std.dev.: 0.0139) MultiSource/Applications/SIBsim4/SIBsim4: 2.40% (3.1873 => 3.2638, std.dev.: 0.0257) SingleSource/Benchmarks/Misc/whetstone: 2.30% (2.1224 => 2.1712, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.12% (3.4104 => 3.4827, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.99% (2.4647 => 2.5138, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.79% (11.5690 => 11.7756, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout/methcall: 1.59% (8.2676 => 8.3992, std.dev.: 0.0299) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.24% (4.9469 => 5.0082, std.dev.: 0.0100) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.23% (1.9302 => 1.9539, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.31% (2.8951 => 1.6701, std.dev.: 0.0346) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -26.32% (7.2130 => 5.3142, std.dev.: 0.0949) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.30% (1.4529 => 1.1579, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.93% (9.9065 => 8.2293, std.dev.: 0.0114) MultiSource/Benchmarks/Olden/em3d/em3d: -12.04% (5.4641 => 4.8064, std.dev.: 0.0205) SingleSource/Benchmarks/Misc/flops-8: -9.60% (2.5609 => 2.3151, std.dev.: 0.0152) SingleSource/Benchmarks/McGill/chomp: -9.42% (1.1216 => 1.0159, std.dev.: 0.0400) MultiSource/Benchmarks/mafft/pairlocalalign: -9.05% (63.1822 => 57.4663, std.dev.: 0.0691) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.14% (0.3269 => 0.3003, std.dev.: 0.0072) SingleSource/Benchmarks/Stanford/FloatMM: -6.64% (0.8807 => 0.8222, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/sieve: -6.10% (7.0599 => 6.6290, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.09% (5.1305 => 4.8181, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: -5.56% (9.3748 => 8.8535, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.39% (4.7482 => 4.4923, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.29% (6.2275 => 5.8981, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.77% (5.6343 => 5.3655, std.dev.: 0.0242) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.49% (4.7449 => 4.5319, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.45% (6.1706 => 5.8963, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.08% (4.9453 => 4.7433, std.dev.: 0.0233) SingleSource/Benchmarks/Shootout-C++/methcall: -3.98% (8.9760 => 8.6186, std.dev.: 0.1354) SingleSource/Benchmarks/Misc/perlin: -3.81% (5.1084 => 4.9140, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.79% (3.7148 => 3.5739, std.dev.: 0.0327) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.70% (2.8773 => 2.7709, std.dev.: 0.0265) MultiSource/Applications/lua/lua: -3.35% (29.8330 => 28.8341, std.dev.: 0.3671) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.29% (5.1557 => 4.9862, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.27% (5.4300 => 5.2524, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.04% (4.9686 => 4.8177, std.dev.: 0.0093) MultiSource/Applications/siod/siod: -2.75% (3.6643 => 3.5637, std.dev.: 0.0193) SingleSource/Benchmarks/Misc/fbench: -2.44% (3.3840 => 3.3013, std.dev.: 0.0067) SingleSource/Benchmarks/Dhrystone/fldry: -2.07% (0.6910 => 0.6767, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.02% (3.3479 => 3.2802, std.dev.: 0.0172) SingleSource/Benchmarks/Misc/fp-convert: -1.70% (15.8853 => 15.6145, std.dev.: 0.0320) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.70% (3.5679 => 3.5073, std.dev.: 0.0093) MultiSource/Benchmarks/FreeBench/neural/neural: -1.38% (1.0841 => 1.0691, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.18% (4.7794 => 4.7229, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.11% (6.0224 => 5.9557, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 6.80% (1.0262 => 1.0960, std.dev.: 0.0375) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.51% (0.2463 => 0.3707, std.dev.: 0.0791) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 26.02% (0.0123 => 0.0155, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.64% (0.0408 => 0.0431, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 33.46% (0.0254 => 0.0339, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.96% (0.0302 => 0.0320, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 7.81% (0.0384 => 0.0414, std.dev.: 0.0070) SingleSource/UnitTests/Vector/Altivec/casts: -5.79% (0.0190 => 0.0179, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/test1: 22.78% (0.0180 => 0.0221, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.16% (0.1438 => 0.1469, std.dev.: 0.0194) MultiSource/Applications/lemon/lemon: 4.58% (1.1329 => 1.1848, std.dev.: 0.1299) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.34% (0.4164 => 0.4025, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.80% (0.1369 => 0.1421, std.dev.: 0.0276) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.27% (0.0641 => 0.0588, std.dev.: 0.0176) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.56% (0.0195 => 0.0278, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.90% (0.0578 => 0.0567, std.dev.: 0.0151) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.35% (1.1437 => 1.1591, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.19% (0.0627 => 0.0607, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 29.44% (0.0180 => 0.0233, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.81% (0.8017 => 0.8082, std.dev.: 0.0279) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: 500.00% (0.0001 => 0.0006, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 300.00% (0.0001 => 0.0004, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 67.74% (0.0062 => 0.0104, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 11:37:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 13:37:47 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121128193747.770462A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6352?compare_to=6348&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6352, Order: 168794, Start Time: 2012-11-28 18:06:00, End Time: 2012-11-28 19:38:17 To: 6348, Order: 168792, Start Time: 2012-11-28 15:11:55, End Time: 2012-11-28 16:44:14 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (184 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (852 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 3.77% (0.6808 => 0.7065, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 16.51% (0.3834 => 0.4467, std.dev.: 0.0086) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.48% (1.2783 => 1.3739, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1012, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/salsa20: 2.50% (7.4937 => 7.6809, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 2.25% (3.1932 => 3.2652, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.25% (79.7170 => 80.7108, std.dev.: 0.2089) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.74% (0.1431 => 0.1306, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.11% (0.3821 => 0.3511, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.25% (0.9542 => 0.8850, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.94% (0.3142 => 0.2924, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -6.89% (2.4924 => 2.3206, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -6.76% (0.3831 => 0.3572, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.68% (0.3848 => 0.3591, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.68% (0.3880 => 0.3621, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.64% (0.3812 => 0.3559, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.57% (0.3896 => 0.3640, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.50% (0.3891 => 0.3638, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -6.47% (0.4033 => 0.3772, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.44% (0.4176 => 0.3907, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.37% (0.3357 => 0.3143, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: -6.34% (0.2160 => 0.2023, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.30% (0.2428 => 0.2275, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.19% (9.2283 => 8.6575, std.dev.: 0.0200) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.15% (0.3884 => 0.3645, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -6.11% (16.1920 => 15.2025, std.dev.: 0.0087) SingleSource/UnitTests/ObjC/property: -6.07% (0.4199 => 0.3944, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.07% (0.2355 => 0.2212, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.07% (0.7198 => 0.6761, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.05% (0.6484 => 0.6092, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: -6.04% (7.0961 => 6.6674, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.02% (0.9852 => 0.9259, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -5.96% (0.1879 => 0.1767, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.96% (0.1796 => 0.1689, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: -5.95% (0.9179 => 0.8633, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.95% (1.0544 => 0.9917, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.91% (4.8161 => 4.5317, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.87% (4.0323 => 3.7956, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/parameter-passing: -5.86% (0.4280 => 0.4029, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.80% (0.3658 => 0.3446, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.79% (0.5857 => 0.5518, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.75% (1.3722 => 1.2933, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: -5.74% (0.1761 => 0.1660, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.72% (0.5805 => 0.5473, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.71% (0.5863 => 0.5528, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.71% (1.2300 => 1.1598, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.69% (0.5925 => 0.5588, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.68% (0.5849 => 0.5517, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.67% (6.7716 => 6.3876, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.65% (0.6304 => 0.5948, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.64% (0.2695 => 0.2543, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.62% (3.5339 => 3.3352, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.60% (0.5859 => 0.5531, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.59% (0.6667 => 0.6294, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.59% (0.5478 => 0.5172, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.58% (4.5069 => 4.2555, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.57% (0.6660 => 0.6289, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: -5.56% (0.4515 => 0.4264, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.56% (4.8802 => 4.6090, std.dev.: 0.0068) MultiSource/Benchmarks/nbench/nbench: -5.55% (1.1530 => 1.0890, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.53% (0.5802 => 0.5481, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.52% (0.5575 => 0.5267, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.52% (0.5581 => 0.5273, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.51% (1.4642 => 1.3835, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.51% (0.7919 => 0.7483, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.50% (0.6293 => 0.5947, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.49% (0.5705 => 0.5392, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.48% (0.6297 => 0.5952, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.48% (0.6446 => 0.6093, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -5.48% (1.1450 => 1.0823, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -5.47% (4.3330 => 4.0961, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.46% (0.5591 => 0.5286, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.45% (0.6736 => 0.6369, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.44% (0.6230 => 0.5891, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.44% (0.5570 => 0.5267, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.44% (1.2784 => 1.2089, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.43% (1.6364 => 1.5476, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: -5.42% (1.3864 => 1.3112, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.40% (0.6052 => 0.5725, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.40% (0.6260 => 0.5922, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.39% (0.8521 => 0.8062, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.35% (0.6189 => 0.5858, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.34% (0.5688 => 0.5384, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.34% (14.2083 => 13.4490, std.dev.: 0.0040) MultiSource/Benchmarks/sim/sim: -5.34% (0.3406 => 0.3224, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.30% (0.6681 => 0.6327, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.29% (8.0126 => 7.5885, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.29% (0.4916 => 0.4656, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.28% (0.6194 => 0.5867, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.27% (0.6676 => 0.6324, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.26% (0.5456 => 0.5169, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.25% (0.5941 => 0.5629, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.22% (0.2278 => 0.2159, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: -5.20% (17.1032 => 16.2136, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.20% (0.3057 => 0.2898, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.20% (0.2385 => 0.2261, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -5.19% (0.2985 => 0.2830, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.18% (0.5999 => 0.5688, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.18% (0.2548 => 0.2416, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.13% (1.2210 => 1.1584, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.12% (0.6440 => 0.6110, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.11% (0.2659 => 0.2523, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -5.11% (15.5079 => 14.7148, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.11% (0.3483 => 0.3305, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: -5.10% (1.3148 => 1.2478, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.07% (0.2999 => 0.2847, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: -5.05% (0.3581 => 0.3400, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.99% (0.6033 => 0.5732, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -4.96% (3.5154 => 3.3409, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.96% (0.3931 => 0.3736, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.90% (1.2221 => 1.1622, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -4.87% (1.2515 => 1.1905, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.87% (0.3837 => 0.3650, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -4.85% (15.2527 => 14.5123, std.dev.: 0.0199) MultiSource/Applications/minisat/minisat: -4.85% (0.7447 => 0.7086, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -4.84% (4.0594 => 3.8628, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/fibo: -4.84% (0.2871 => 0.2732, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.82% (0.6395 => 0.6087, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.80% (0.7524 => 0.7163, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/methcall: -4.79% (0.3025 => 0.2880, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.78% (0.3323 => 0.3164, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.73% (2.1713 => 2.0685, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.72% (0.2903 => 0.2766, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.70% (0.3252 => 0.3099, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -4.70% (0.2939 => 0.2801, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.66% (0.7339 => 0.6997, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.65% (0.4151 => 0.3958, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.64% (0.7021 => 0.6695, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -4.64% (0.3255 => 0.3104, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.64% (0.2933 => 0.2797, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: -4.63% (0.4861 => 0.4636, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.62% (0.3205 => 0.3057, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.61% (0.3016 => 0.2877, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.61% (0.5168 => 0.4930, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: -4.57% (0.3194 => 0.3048, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: -4.56% (0.3026 => 0.2888, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.54% (22.4056 => 21.3886, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/hello: -4.53% (0.2849 => 0.2720, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.49% (1.6474 => 1.5734, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ary2: -4.48% (0.3481 => 0.3325, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -4.48% (0.3059 => 0.2922, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -4.47% (0.4248 => 0.4058, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -4.47% (0.3446 => 0.3292, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.47% (0.4813 => 0.4598, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.47% (0.5329 => 0.5091, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.45% (0.5567 => 0.5319, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists: -4.45% (0.3621 => 0.3460, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -4.42% (34.0927 => 32.5867, std.dev.: 0.0108) MultiSource/Applications/siod/siod: -4.41% (2.4021 => 2.2962, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.39% (0.6395 => 0.6114, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.37% (0.4321 => 0.4132, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists1: -4.37% (0.3867 => 0.3698, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -4.36% (0.3394 => 0.3246, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: -4.35% (0.2989 => 0.2859, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: -4.34% (0.3271 => 0.3129, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.34% (0.3849 => 0.3682, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.34% (0.4083 => 0.3906, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.31% (0.3319 => 0.3176, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: -4.27% (0.6441 => 0.6166, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -4.27% (0.4524 => 0.4331, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: -4.25% (2.1401 => 2.0491, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.24% (0.9557 => 0.9152, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: -4.23% (0.7982 => 0.7644, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: -4.23% (18.2933 => 17.5189, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.18% (0.9077 => 0.8698, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/Hello: -4.13% (0.6347 => 0.6085, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.11% (5.0226 => 4.8162, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: -4.10% (0.8418 => 0.8073, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.98% (0.4427 => 0.4251, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: -3.93% (0.7779 => 0.7473, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.90% (0.3491 => 0.3355, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: -3.84% (0.6750 => 0.6491, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.81% (2.2587 => 2.1726, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/sieve: -3.67% (0.3788 => 0.3649, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: -3.55% (1.5610 => 1.5056, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.39% (5.4682 => 5.2829, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -1.99% (20.7746 => 20.3610, std.dev.: 0.0153) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.51% (31.3723 => 10.1942, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/fldry: -60.97% (1.8100 => 0.7065, std.dev.: 0.0059) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7565, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -8.78% (1.2842 => 1.1715, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.97% (2.2633 => 2.1734, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7069) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3996, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4718, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 11:41:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 13:41:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121128194141.AA1822A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6353?compare_to=6347&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6353, Order: 168792, Start Time: 2012-11-28 16:21:20, End Time: 2012-11-28 19:42:08 To: 6347, Order: 168782, Start Time: 2012-11-28 12:11:58, End Time: 2012-11-28 15:33:10 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (174 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1090 (717 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 4.36% (0.2934 => 0.3062, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.48% (2.0486 => 2.0994, std.dev.: 0.0158) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.12% (0.0625 => 0.0882, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.46% (0.1063 => 0.1408, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.41% (0.2969 => 0.3753, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.86% (0.1106 => 0.1392, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.77% (0.0714 => 0.0898, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.32% (0.4139 => 0.5187, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.50% (0.4253 => 0.5295, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.15% (0.4994 => 0.6200, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 24.14% (1.5932 => 1.9778, std.dev.: 0.0086) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.12% (0.5900 => 0.7323, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.58% (0.0475 => 0.0587, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.52% (0.5000 => 0.6176, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.29% (0.0584 => 0.0720, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.72% (0.1620 => 0.1988, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.53% (0.1021 => 0.1251, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.40% (0.1107 => 0.1355, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.07% (0.0897 => 0.1095, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.17% (0.0633 => 0.0767, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 21.10% (0.0948 => 0.1148, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.07% (0.0541 => 0.0655, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.06% (0.0584 => 0.0707, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.94% (0.1103 => 0.1334, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.72% (0.0642 => 0.0775, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.54% (0.1003 => 0.1209, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.52% (0.3903 => 0.4704, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.40% (0.0495 => 0.0596, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 20.34% (0.0821 => 0.0988, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.21% (0.1549 => 0.1862, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.19% (0.0822 => 0.0988, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.14% (0.1604 => 0.1927, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 19.83% (0.1619 => 0.1940, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 19.70% (0.0604 => 0.0723, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.36% (0.1462 => 0.1745, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 19.22% (0.0947 => 0.1129, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.97% (0.2736 => 0.3255, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.79% (0.3890 => 0.4621, std.dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 18.69% (0.0808 => 0.0959, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.67% (0.2014 => 0.2390, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 18.31% (0.5826 => 0.6893, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.29% (1.3152 => 1.5558, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 18.19% (0.5889 => 0.6960, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 18.14% (0.1218 => 0.1439, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 18.05% (0.0698 => 0.0824, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 17.92% (0.4029 => 0.4751, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 17.74% (0.1505 => 0.1772, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.66% (0.0572 => 0.0673, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.62% (0.2866 => 0.3371, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.52% (0.0605 => 0.0711, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.48% (3.5627 => 4.1853, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.46% (0.1088 => 0.1278, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 17.37% (1.8794 => 2.2059, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: 17.17% (0.5546 => 0.6498, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.12% (0.1968 => 0.2305, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.02% (0.4658 => 0.5451, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 16.94% (0.7171 => 0.8386, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.90% (1.6211 => 1.8951, std.dev.: 0.0086) MultiSource/Applications/hbd/hbd: 16.85% (0.9697 => 1.1331, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.81% (0.1160 => 0.1355, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.72% (0.3271 => 0.3818, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.47% (0.5026 => 0.5854, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 16.47% (0.1421 => 0.1655, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 16.46% (1.0781 => 1.2556, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.42% (0.4361 => 0.5077, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.42% (0.2875 => 0.3347, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 16.29% (0.2725 => 0.3169, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 16.24% (4.2109 => 4.8947, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.15% (2.7292 => 3.1699, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.14% (0.2738 => 0.3180, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 16.11% (0.2750 => 0.3193, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 16.06% (0.2714 => 0.3150, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.03% (0.3930 => 0.4560, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.98% (0.2729 => 0.3165, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.97% (0.2911 => 0.3376, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.95% (4.4195 => 5.1246, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/matrix: 15.90% (0.2780 => 0.3222, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 15.87% (0.2811 => 0.3257, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 15.80% (0.2803 => 0.3246, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 15.71% (0.9909 => 1.1466, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 15.71% (0.2813 => 0.3255, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.69% (0.2792 => 0.3230, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.68% (0.3195 => 0.3696, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 15.67% (0.3096 => 0.3581, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 15.66% (0.2823 => 0.3265, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 15.65% (0.1284 => 0.1485, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.62% (2.0673 => 2.3902, std.dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 15.55% (0.2566 => 0.2965, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.52% (1.9966 => 2.3065, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 15.48% (0.3004 => 0.3469, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.39% (1.9694 => 2.2724, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary3: 15.24% (0.3267 => 0.3765, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.23% (0.1090 => 0.1256, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 15.13% (0.3258 => 0.3751, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.11% (0.3362 => 0.3870, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 14.98% (0.3317 => 0.3814, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 14.80% (0.2075 => 0.2382, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.67% (0.3060 => 0.3509, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.47% (0.3124 => 0.3576, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.44% (0.3282 => 0.3756, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/moments: 14.22% (0.3678 => 0.4201, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 14.09% (1.4269 => 1.6279, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: 14.07% (23.5202 => 26.8298, std.dev.: 0.0127) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.07% (0.3845 => 0.4386, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 14.06% (0.3726 => 0.4250, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 14.06% (0.4146 => 0.4729, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 14.04% (0.3348 => 0.3818, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 14.01% (0.3477 => 0.3964, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-4: 13.88% (0.3465 => 0.3946, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.79% (0.3625 => 0.4125, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 13.79% (0.7875 => 0.8961, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-2: 13.76% (0.3446 => 0.3920, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.70% (0.3496 => 0.3975, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 13.68% (2.1653 => 2.4615, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.68% (0.3488 => 0.3965, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 13.66% (0.3469 => 0.3943, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.64% (0.3460 => 0.3932, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.63% (0.3442 => 0.3911, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.60% (0.3690 => 0.4192, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 13.59% (0.0758 => 0.0861, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.56% (0.3981 => 0.4521, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/hash2: 13.43% (0.4251 => 0.4822, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 13.36% (2.1013 => 2.3820, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/property: 13.29% (0.3650 => 0.4135, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 13.29% (4.6177 => 5.2312, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/exceptions: 13.26% (0.3643 => 0.4126, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 13.08% (0.3724 => 0.4211, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 12.71% (0.2691 => 0.3033, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 12.61% (0.5012 => 0.5644, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.60% (0.2040 => 0.2297, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 11.66% (0.3498 => 0.3906, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.66% (0.6435 => 0.7185, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.64% (0.1383 => 0.1544, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 11.63% (5.5417 => 6.1864, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.78% (0.2737 => 0.3032, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.69% (0.6634 => 0.7343, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 10.69% (0.4847 => 0.5365, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.60% (0.1028 => 0.1137, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.59% (0.2068 => 0.2287, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.21% (0.3084 => 0.3399, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 10.00% (0.2391 => 0.2630, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 9.95% (2.0346 => 2.2370, std.dev.: 0.0056) MultiSource/Applications/minisat/minisat: 9.92% (0.3336 => 0.3667, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.32% (0.2103 => 0.2299, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.23% (0.5361 => 0.5802, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.91% (4.6926 => 5.0638, std.dev.: 0.0071) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.87% (11.6398 => 12.5559, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.81% (0.7426 => 0.8006, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.68% (0.5584 => 0.6013, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 6.66% (11.9555 => 12.7513, std.dev.: 0.0122) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.27% (0.3792 => 0.3954, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.37% (0.2162 => 0.3532, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.99% (29.0505 => 33.4045, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: 9.28% (0.2802 => 0.3062, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6086, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6781, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.74% (0.3693 => 0.3868, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 4.73% (15.4430 => 16.1735, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-2: 4.67% (1.8057 => 1.8901, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/dry: 4.32% (14.0481 => 14.6550, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1990, std.dev.: 0.0058) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.69% (3.1722 => 3.2257, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3062, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2856, std.dev.: 0.0036) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5836, std.dev.: 0.0115) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.98% (25.4195 => 16.5277, std.dev.: 0.0348) SingleSource/Benchmarks/Shootout-C++/ary2: -10.53% (0.2402 => 0.2149, std.dev.: 0.0060) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9779, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7914, std.dev.: 0.0110) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -3.53% (11.2080 => 10.8126, std.dev.: 0.0067) SingleSource/Benchmarks/Dhrystone/fldry: -3.18% (17.2379 => 16.6889, std.dev.: 0.0628) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7730, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.43% (0.6293 => 0.6140, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8700, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5771, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4954, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1780, std.dev.: 0.0385) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0459, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 12:45:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 14:45:40 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121128204540.C4F422A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6354?compare_to=6350&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6354, Order: 168792, Start Time: 2012-11-28 18:26:28, End Time: 2012-11-28 20:46:12 To: 6350, Order: 168785, Start Time: 2012-11-28 15:09:41, End Time: 2012-11-28 17:32:50 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 51 (147 on baseline) Performance Improvements: 4 (43 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1031 (695 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.09% (0.6167 => 0.7036, std.dev.: 0.0247) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.17% (0.6679 => 0.7492, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.03% (0.6625 => 0.7422, std.dev.: 0.0143) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.88% (0.2585 => 0.2892, std.dev.: 0.0043) MultiSource/Applications/siod/siod: 11.74% (2.5983 => 2.9034, std.dev.: 0.0500) MultiSource/Benchmarks/Prolangs-C++/life/life: 11.57% (0.1072 => 0.1196, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 11.28% (0.1161 => 0.1292, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.10% (0.6709 => 0.7454, std.dev.: 0.0184) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.00% (0.2418 => 0.2684, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.96% (0.5804 => 0.6440, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.82% (0.9029 => 0.9916, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.51% (0.1293 => 0.1416, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.07% (0.6230 => 0.6795, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.86% (0.6245 => 0.6798, std.dev.: 0.0190) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.21% (0.2885 => 0.3122, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.08% (0.4702 => 0.5082, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.89% (0.1900 => 0.2050, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.75% (0.5818 => 0.6269, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.46% (0.3768 => 0.4049, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.42% (0.4462 => 0.4793, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.34% (0.3161 => 0.3393, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/fibo: 7.00% (0.2984 => 0.3193, std.dev.: 0.0061) MultiSource/Applications/SIBsim4/SIBsim4: 6.68% (1.6625 => 1.7735, std.dev.: 0.0416) MultiSource/Benchmarks/FreeBench/neural/neural: 6.53% (0.1607 => 0.1712, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 6.46% (0.3575 => 0.3806, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.22% (0.1719 => 0.1826, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.08% (10.6282 => 11.2742, std.dev.: 0.1285) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.80% (0.2398 => 0.2537, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.16% (4.6863 => 4.9283, std.dev.: 0.0659) MultiSource/Benchmarks/MallocBench/gs/gs: 4.97% (5.0098 => 5.2589, std.dev.: 0.0461) SingleSource/Benchmarks/Shootout-C++/hello: 4.62% (0.3141 => 0.3286, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 4.51% (0.9311 => 0.9731, std.dev.: 0.0131) MultiSource/Applications/kimwitu++/kc: 4.09% (20.8221 => 21.6747, std.dev.: 0.2476) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.08% (0.4637 => 0.4826, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.65% (20.5499 => 21.3008, std.dev.: 0.0863) MultiSource/Applications/JM/lencod/lencod: 2.88% (31.4979 => 32.4042, std.dev.: 0.2265) SingleSource/UnitTests/Vector/constpool: 2.74% (53.6325 => 55.1019, std.dev.: 0.4785) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: 31.36% (5.6851 => 7.4680, std.dev.: 0.1028) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.54% (0.3451 => 0.4298, std.dev.: 0.0217) MultiSource/Benchmarks/McCat/09-vor/vor: 21.28% (0.1189 => 0.1442, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 20.63% (1.3453 => 1.6228, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.49% (1.3187 => 1.4966, std.dev.: 0.0376) SingleSource/Benchmarks/BenchmarkGame/puzzle: 10.71% (0.6950 => 0.7694, std.dev.: 0.0251) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.21% (9.0192 => 9.9402, std.dev.: 0.0855) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 9.37% (9.5354 => 10.4288, std.dev.: 0.0543) MultiSource/Applications/siod/siod: 6.40% (3.2000 => 3.4047, std.dev.: 0.0376) SingleSource/Benchmarks/CoyoteBench/lpbench: 5.06% (12.2327 => 12.8519, std.dev.: 0.0677) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.82% (31.1598 => 32.3488, std.dev.: 0.4149) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.40% (7.2669 => 7.3683, std.dev.: 0.0191) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.30% (1.3349 => 1.3523, std.dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: 1.26% (3.8578 => 3.9066, std.dev.: 0.0179) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -13.44% (0.1034 => 0.0895, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/dbms/dbms: -8.25% (1.0417 => 0.9558, std.dev.: 0.0324) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash: -5.65% (0.8068 => 0.7612, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.19% (3.6473 => 3.6038, std.dev.: 0.0151) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.73% (68.9669 => 69.4724, std.dev.: 0.3563) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 1.12% (0.1338 => 0.1353, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -7.49% (0.0454 => 0.0420, std.dev.: 0.0076) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.31% (0.0654 => 0.0652, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 1.06% (488.8876 => 494.0489, std.dev.: 0.1207) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.85% (63.2438 => 69.4724, std.dev.: 0.3563) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0076) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43710.31% (1.1277 => 494.0489, std.dev.: 0.1207) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 239.17% (0.5229 => 1.7735, std.dev.: 0.0416) MultiSource/Applications/SPASS/SPASS: 18.41% (14.9895 => 17.7485, std.dev.: 0.5779) MultiSource/Applications/kimwitu++/kc: 53.12% (14.1553 => 21.6747, std.dev.: 0.2476) MultiSource/Benchmarks/MallocBench/gs/gs: 27.94% (4.1105 => 5.2589, std.dev.: 0.0461) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.98% (1.1048 => 1.5134, std.dev.: 0.0676) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 431.65% (7.1582 => 38.0567, std.dev.: 0.0319) SingleSource/Benchmarks/Misc-C++-EH/spirit: 75.43% (3.4629 => 6.0748, std.dev.: 0.4628) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.93% (0.6222 => 1.0324, std.dev.: 0.0538) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10364.72% (0.0720 => 7.5346, std.dev.: 0.3602) MultiSource/Applications/SIBsim4/SIBsim4: 3906500.00% (0.0001 => 3.9066, std.dev.: 0.0179) MultiSource/Applications/SPASS/SPASS: 14649300.00% (0.0001 => 14.6494, std.dev.: 1.6049) MultiSource/Applications/kimwitu++/kc: 52800.00% (0.0001 => 0.0529, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 64600.00% (0.0001 => 0.0647, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 585400.00% (0.0001 => 0.5855, std.dev.: 0.0334) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10081100.00% (0.0001 => 10.0812, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7467900.00% (0.0001 => 7.4680, std.dev.: 0.1028) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1802.88% (1.1194 => 21.3008, std.dev.: 0.0863) MultiSource/Applications/ClamAV/clamscan: 70.02% (22.1758 => 37.7034, std.dev.: 0.3264) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 66.38% (2.9384 => 4.8889, std.dev.: 0.1758) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 59.83% (7.0540 => 11.2742, std.dev.: 0.1285) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 48.70% (8.1363 => 12.0989, std.dev.: 0.3031) MultiSource/Applications/JM/lencod/lencod: 47.71% (21.9371 => 32.4042, std.dev.: 0.2265) MultiSource/Benchmarks/FreeBench/distray/distray: 45.08% (0.1056 => 0.1532, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/almabench: 44.38% (0.0730 => 0.1054, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 42.81% (0.1432 => 0.2045, std.dev.: 0.0042) SingleSource/Benchmarks/Stanford/Oscar: 32.70% (0.0636 => 0.0844, std.dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: 30.92% (0.7433 => 0.9731, std.dev.: 0.0131) SingleSource/UnitTests/vla: 30.14% (0.0355 => 0.0462, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/dot-syntax-1: 29.02% (0.0479 => 0.0618, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/messages-2: 29.00% (0.0662 => 0.0854, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/life/life: 28.19% (0.0933 => 0.1196, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 27.85% (0.5860 => 0.7492, std.dev.: 0.0134) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.49% (0.0793 => 0.1011, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 27.38% (0.2107 => 0.2684, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 27.34% (0.2271 => 0.2892, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 26.77% (0.1117 => 0.1416, std.dev.: 0.0034) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.45% (0.1584 => 0.2003, std.dev.: 0.0091) MultiSource/Applications/siod/siod: 26.41% (2.2969 => 2.9034, std.dev.: 0.0500) SingleSource/Benchmarks/Shootout/lists: 26.36% (0.0626 => 0.0791, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: 25.87% (0.1175 => 0.1479, std.dev.: 0.0085) MultiSource/Benchmarks/McCat/17-bintr/bintr: 25.48% (0.0675 => 0.0847, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.31% (0.0648 => 0.0812, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/reversefile: 24.86% (0.3865 => 0.4826, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.66% (0.0746 => 0.0930, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.47% (0.0842 => 0.1048, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.59% (0.0479 => 0.0592, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: 23.28% (0.0481 => 0.0593, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/lpbench: 23.25% (0.0929 => 0.1145, std.dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/dry: 23.03% (0.0456 => 0.0561, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.01% (0.0730 => 0.0898, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 22.92% (0.8067 => 0.9916, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.86% (0.2065 => 0.2537, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 22.80% (0.5105 => 0.6269, std.dev.: 0.0133) MultiSource/Benchmarks/McCat/08-main/main: 22.71% (0.2554 => 0.3134, std.dev.: 0.0117) MultiSource/Applications/lua/lua: 22.59% (3.8723 => 4.7469, std.dev.: 0.1053) SingleSource/Benchmarks/Shootout-C++/wordfreq: 22.44% (0.3307 => 0.4049, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.11% (0.9765 => 1.1924, std.dev.: 0.0236) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.03% (0.1566 => 0.1911, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/lists: 21.80% (0.3422 => 0.4168, std.dev.: 0.0129) MultiSource/Applications/d/make_dparser: 21.64% (3.3354 => 4.0572, std.dev.: 0.1109) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.60% (0.3121 => 0.3795, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/functionobjects: 21.59% (0.5020 => 0.6104, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/hello: 21.08% (0.2714 => 0.3286, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 20.94% (0.1695 => 0.2050, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/ks/ks: 20.93% (0.1510 => 0.1826, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/spellcheck: 20.91% (0.4203 => 0.5082, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/sieve: 20.68% (0.3603 => 0.4348, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/perlin: 20.52% (0.0536 => 0.0646, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/whetstone: 20.00% (0.0660 => 0.0792, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 19.94% (0.2603 => 0.3122, std.dev.: 0.0081) MultiSource/Benchmarks/mafft/pairlocalalign: 19.83% (9.4845 => 11.3653, std.dev.: 0.2193) MultiSource/Benchmarks/McCat/09-vor/vor: 19.69% (0.3180 => 0.3806, std.dev.: 0.0074) SingleSource/UnitTests/ObjC/parameter-passing: 19.68% (0.3927 => 0.4700, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 19.41% (1.3050 => 1.5583, std.dev.: 0.0371) SingleSource/UnitTests/ObjC/exceptions: 19.36% (0.3828 => 0.4569, std.dev.: 0.0087) SingleSource/UnitTests/ObjC/property: 19.07% (0.3886 => 0.4627, std.dev.: 0.0097) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.84% (0.1125 => 0.1337, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.70% (0.2700 => 0.3205, std.dev.: 0.0170) SingleSource/UnitTests/ObjC/instance-method-metadata: 18.63% (0.3543 => 0.4203, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 18.35% (0.3826 => 0.4528, std.dev.: 0.0216) SingleSource/UnitTests/ObjC/synchronized: 18.28% (0.3561 => 0.4212, std.dev.: 0.0169) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.28% (0.6450 => 0.7629, std.dev.: 0.0168) SingleSource/UnitTests/ObjC/trivial-interface: 18.26% (0.3473 => 0.4107, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/fbench: 18.07% (0.0592 => 0.0699, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 17.94% (0.4064 => 0.4793, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.79% (14.3668 => 16.9225, std.dev.: 0.5780) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 17.78% (1.5859 => 1.8678, std.dev.: 0.0737) MultiSource/Benchmarks/McCat/05-eks/eks: 17.77% (0.4299 => 0.5063, std.dev.: 0.0144) SingleSource/UnitTests/2006-12-11-LoadConstants: 17.67% (0.1143 => 0.1345, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/Puzzle: 17.59% (0.1268 => 0.1491, std.dev.: 0.0056) MultiSource/Applications/hbd/hbd: 17.57% (1.5603 => 1.8344, std.dev.: 0.0468) SingleSource/UnitTests/ObjC/exceptions-3: 17.46% (0.3516 => 0.4130, std.dev.: 0.0095) SingleSource/UnitTests/ObjC/exceptions-4: 17.41% (0.3543 => 0.4160, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.36% (0.2891 => 0.3393, std.dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.22% (0.0871 => 0.1021, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/fibo: 17.17% (0.2725 => 0.3193, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.06% (0.3441 => 0.4028, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/wc: 17.04% (0.3052 => 0.3572, std.dev.: 0.0091) MultiSource/Applications/minisat/minisat: 17.02% (0.7115 => 0.8326, std.dev.: 0.0403) MultiSource/Benchmarks/FreeBench/neural/neural: 17.02% (0.1463 => 0.1712, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.96% (0.8172 => 0.9558, std.dev.: 0.0324) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.84% (0.3136 => 0.3664, std.dev.: 0.0107) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.79% (0.0953 => 0.1113, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/em3d/em3d: 16.58% (0.1695 => 0.1976, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/mst/mst: 16.51% (0.1163 => 0.1355, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/exceptions-2: 16.33% (0.3497 => 0.4068, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 15.98% (0.1114 => 0.1292, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.84% (0.0770 => 0.0892, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.77% (0.2758 => 0.3193, std.dev.: 0.0147) MultiSource/Applications/hexxagon/hexxagon: 15.76% (1.2842 => 1.4866, std.dev.: 0.0360) MultiSource/Benchmarks/Olden/health/health: 15.69% (0.1268 => 0.1467, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/except: 15.67% (0.2871 => 0.3321, std.dev.: 0.0091) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.47% (0.8101 => 0.9354, std.dev.: 0.0260) MultiSource/Applications/viterbi/viterbi: 15.43% (0.1555 => 0.1795, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 15.33% (0.5981 => 0.6898, std.dev.: 0.0188) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.32% (0.0770 => 0.0888, std.dev.: 0.0038) MultiSource/Benchmarks/NPB-serial/is/is: 15.02% (0.0719 => 0.0827, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.93% (0.4636 => 0.5328, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/strcat: 14.80% (0.2831 => 0.3250, std.dev.: 0.0110) MultiSource/Applications/spiff/spiff: 14.72% (0.7835 => 0.8988, std.dev.: 0.0441) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.39% (0.0834 => 0.0954, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.39% (5.0018 => 5.7214, std.dev.: 0.2332) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.32% (0.4615 => 0.5276, std.dev.: 0.0201) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.29% (0.1029 => 0.1176, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 13.30% (17.1811 => 19.4668, std.dev.: 0.4644) MultiSource/Benchmarks/PAQ8p/paq8p: 12.91% (10.3673 => 11.7059, std.dev.: 0.3903) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.49% (0.1906 => 0.2144, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.89% (2.2022 => 2.4420, std.dev.: 0.0502) SingleSource/UnitTests/ObjC++/property-reference-object: 10.88% (0.6030 => 0.6686, std.dev.: 0.0240) SingleSource/UnitTests/SignlessTypes/rem: 10.31% (0.1144 => 0.1262, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.64% (4.3953 => 11.0163, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/methcall: 147.40% (5.3999 => 13.3592, std.dev.: 0.0083) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 32.00% (0.3256 => 0.4298, std.dev.: 0.0217) MultiSource/Benchmarks/McCat/09-vor/vor: 24.96% (0.1154 => 0.1442, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 24.40% (1.3045 => 1.6228, std.dev.: 0.0090) SingleSource/Benchmarks/CoyoteBench/lpbench: 24.22% (10.3460 => 12.8519, std.dev.: 0.0677) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.64% (1.1145 => 1.2999, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/ft/ft: 16.58% (1.2838 => 1.4966, std.dev.: 0.0376) SingleSource/Benchmarks/Misc/oourafft: 16.35% (6.6465 => 7.7330, std.dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.52% (8.6802 => 9.9402, std.dev.: 0.0855) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.01% (0.2944 => 0.3327, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.65% (2.8904 => 3.2270, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 11.01% (3.8532 => 4.2774, std.dev.: 0.0824) SingleSource/Benchmarks/BenchmarkGame/puzzle: 10.51% (0.6962 => 0.7694, std.dev.: 0.0251) SingleSource/Benchmarks/Misc/richards_benchmark: 10.29% (1.1396 => 1.2569) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.31% (1.7254 => 1.8860, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 6.00% (1.4460 => 1.5327, std.dev.: 0.0170) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.56% (4.2280 => 4.4630, std.dev.: 0.0124) SingleSource/Regression/C/uint64_to_float: 5.08% (0.5413 => 0.5688, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.70% (26.0924 => 27.3188, std.dev.: 0.1381) MultiSource/Benchmarks/nbench/nbench: 4.08% (11.6436 => 12.1183, std.dev.: 0.0083) MultiSource/Applications/siod/siod: 3.72% (3.2827 => 3.4047, std.dev.: 0.0376) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 2.21% (85.0658 => 86.9489, std.dev.: 0.0378) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.15% (1.3677 => 1.3971, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 2.05% (3.1595 => 3.2244, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.49% (6.5088 => 6.6057, std.dev.: 0.0064) MultiSource/Applications/lambda-0_1_3/lambda: 1.30% (5.2636 => 5.3320, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.23% (5.2139 => 5.2779, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0504, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1676, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.78% (5.2763 => 1.2253, std.dev.: 0.0467) SingleSource/Benchmarks/Misc/salsa20: -75.37% (0.8651 => 0.2131, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/richards_benchmark: -44.82% (0.1622 => 0.0895, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -11.95% (0.1330 => 0.1171, std.dev.: 0.0060) MultiSource/Applications/JM/ldecod/ldecod: -11.14% (10.4361 => 9.2735, std.dev.: 0.4503) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.57% (5.3855 => 4.9239, std.dev.: 0.0607) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.93% (5.3526 => 4.9283, std.dev.: 0.0659) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -68.63% (32.5116 => 10.1983, std.dev.: 0.0365) SingleSource/Benchmarks/Dhrystone/fldry: -64.81% (1.9577 => 0.6889, std.dev.: 0.0083) SingleSource/Benchmarks/Dhrystone/dry: -51.55% (2.4116 => 1.1684, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.23% (0.3987 => 0.2383, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.33% (4.5009 => 2.7756, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.15% (2.6546 => 2.0136, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/mason/mason: -19.20% (0.2161 => 0.1746, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: -15.63% (1.6925 => 1.4279, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2839, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -9.99% (9.5636 => 8.6085, std.dev.: 0.1986) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.05% (1.5660 => 1.4243, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.2416 => 3.0208, std.dev.: 0.0315) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.76% (0.3463 => 0.3229, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7497, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.06% (0.8614 => 0.8178, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.01% (0.2497 => 0.2372, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5076, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -4.32% (6.2999 => 6.0280, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.67% (19.9488 => 19.2165, std.dev.: 0.1536) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.26% (0.9957 => 0.9632, std.dev.: 0.0064) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8915, std.dev.: 0.0031) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.31% (0.4808 => 0.4697, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.95% (8.1563 => 7.9975, std.dev.: 0.0244) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6772, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -1.45% (10.2830 => 10.1339, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.89% (0.1485 => 0.1353, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0015) Report Time: 2.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 13:26:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 15:26:15 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121128212615.722BB2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6355?compare_to=6351&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6355, Order: 168806, Start Time: 2012-11-28 19:56:00, End Time: 2012-11-28 21:26:49 To: 6351, Order: 168794, Start Time: 2012-11-28 18:01:45, End Time: 2012-11-28 19:37:45 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 1 (77 on baseline) Performance Improvements: 18 (46 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1032 (850 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.38% (0.8810 => 0.9108, std.dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest: -38.21% (0.0301 => 0.0186, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.33% (0.1233 => 0.1118, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.63% (1.3797 => 1.3020, std.dev.: 0.0287) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.58% (0.3781 => 0.3570, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.72% (0.6532 => 0.6224, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -4.67% (4.8420 => 4.6157, std.dev.: 0.0334) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -3.92% (1.4781 => 1.4201, std.dev.: 0.0116) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.51% (1.2653 => 1.2209, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/football/football: -3.15% (0.9601 => 0.9299, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.05% (1.2531 => 1.2149, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -2.56% (1.7700 => 1.7247, std.dev.: 0.0130) SingleSource/UnitTests/Vector/constpool: -1.97% (8.7083 => 8.5364, std.dev.: 0.0489) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel24: -30.27% (0.2663 => 0.1857, std.dev.: 0.0295) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.49% (0.5123 => 0.4893, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.99% (3.3095 => 3.1776, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.91% (17.4209 => 16.7394, std.dev.: 0.1555) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.20% (41.8826 => 40.5428, std.dev.: 0.3415) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.48% (22.5663 => 22.0067, std.dev.: 0.0623) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.48% (1.0960 => 1.0798, std.dev.: 0.3122) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.08% (0.3707 => 0.3710, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 11.61% (0.0155 => 0.0173, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.70% (0.0431 => 0.0428, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -21.53% (0.0339 => 0.0266, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -4.38% (0.0320 => 0.0306, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -6.76% (0.0414 => 0.0386, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: -11.73% (0.0179 => 0.0158, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/test1: -4.07% (0.0221 => 0.0212, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.68% (0.1469 => 0.1479, std.dev.: 0.0178) MultiSource/Applications/lemon/lemon: -1.50% (1.1848 => 1.1670, std.dev.: 0.2003) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.96% (0.4025 => 0.3946, std.dev.: 0.1032) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.62% (0.1421 => 0.1444, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -25.00% (0.0008 => 0.0006, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.38% (0.0588 => 0.0602, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0278 => 0.0278, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.53% (0.0567 => 0.0587, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.96% (1.1591 => 1.1480, std.dev.: 0.0075) MultiSource/Benchmarks/SciMark2-C/scimark2: -0.08% (9.4037 => 9.3965, std.dev.: 0.0240) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.67% (0.0030 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -69.23% (0.0026 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.36% (0.0607 => 0.0532, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.44% (0.0233 => 0.0218, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.46% (0.8082 => 0.7964, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -37.50% (0.0104 => 0.0065, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/SciMark2-C/scimark2: -67.12% (28.5821 => 9.3965, std.dev.: 0.0240) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.71% (16.4461 => 17.8791, std.dev.: 1.7812) MultiSource/Applications/sqlite3/sqlite3: 2348.14% (0.6332 => 15.5016, std.dev.: 0.6572) MultiSource/Benchmarks/McCat/08-main/main: 49.15% (0.1831 => 0.2731, std.dev.: 0.0869) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.69% (0.1559 => 0.1408, std.dev.: 0.0079) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7150.75% (0.3123 => 22.6441, std.dev.: 0.3759) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1532.00% (0.3344 => 5.4574, std.dev.: 0.0351) SingleSource/Benchmarks/Misc-C++/Large/ray: 39.09% (0.2364 => 0.3288, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 5.07% (0.6010 => 0.6315, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: 1.63% (0.0429 => 0.0436, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.14% (0.3266 => 0.3434, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 3.56% (0.1969 => 0.2039, std.dev.: 0.0027) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -4.46% (0.0224 => 0.0214, std.dev.: 0.0016) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0517, std.dev.: 0.0152) MultiSource/Applications/oggenc/oggenc: 15.05% (0.1462 => 0.1682, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3960, std.dev.: 0.0337) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0700, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4893, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5184, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2760, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0662, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3622, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3696, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0837, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -29.85% (2.1832 => 1.5316, std.dev.: 0.0013) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.92% (0.0848 => 0.0983, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 13.67% (0.1112 => 0.1264, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.40% (0.4127 => 0.4515, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.35% (0.3295 => 0.3570, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.26% (2.1401 => 2.3168, std.dev.: 0.0142) MultiSource/Benchmarks/sim/sim: 7.66% (0.3226 => 0.3473, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.50% (0.2279 => 0.2450, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 7.18% (1.2222 => 1.3099, std.dev.: 0.0263) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.94% (1.3279 => 1.4201, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.77% (1.5315 => 1.6352, std.dev.: 0.0128) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.61% (0.1983 => 0.2114, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.06% (3.1832 => 3.3761, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/football/football: 6.06% (0.8768 => 0.9299, std.dev.: 0.0104) MultiSource/Benchmarks/MallocBench/gs/gs: 5.31% (4.1305 => 4.3500, std.dev.: 0.0682) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.25% (1.6386 => 1.7247, std.dev.: 0.0130) MultiSource/Applications/sgefa/sgefa: 5.20% (0.2999 => 0.3155, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.20% (1.1606 => 1.2209, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.05% (0.8204 => 0.8618, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.94% (0.8050 => 0.8448, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.89% (0.5191 => 0.5445, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.67% (0.8286 => 0.8673, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.63% (0.8420 => 0.8810, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.60% (0.8069 => 0.8440, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.43% (0.8338 => 0.8707, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 4.10% (8.6247 => 8.9783, std.dev.: 0.0610) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.06% (0.3717 => 0.3868, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.97% (1.1685 => 1.2149, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.50% (0.3115 => 0.3224, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 3.49% (1.0945 => 1.1327, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.47% (0.4559 => 0.4717, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.45% (0.6586 => 0.6813, std.dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: 2.92% (31.8598 => 32.7915, std.dev.: 0.2161) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.87% (0.3657 => 0.3762, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.86% (4.4873 => 4.6157, std.dev.: 0.0334) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.82% (0.8340 => 0.8575, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 40.13% (1.5795 => 2.2134, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 27.57% (2.9096 => 3.7119, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.06% (4.8436 => 5.8636, std.dev.: 0.0197) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 19.89% (0.7597 => 0.9108, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.87% (8.2783 => 9.7575, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/misr: 16.85% (0.4001 => 0.4675, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.30% (14.6451 => 16.7394, std.dev.: 0.1555) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.46% (2.7995 => 3.1203, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.61% (0.3186 => 0.3524, std.dev.: 0.0087) MultiSource/Applications/lambda-0_1_3/lambda: 10.29% (7.4933 => 8.2644, std.dev.: 0.0605) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.27% (0.1129 => 0.1245, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.24% (1.1857 => 1.3071, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.33% (6.3772 => 6.9086, std.dev.: 0.0932) MultiSource/Benchmarks/McCat/18-imp/imp: 7.88% (0.1370 => 0.1478, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.33% (23.5781 => 25.3061, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.03% (3.9917 => 4.2724, std.dev.: 0.0259) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.23% (2.9753 => 3.1606, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.10% (3.3761 => 3.5822, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.89% (4.8660 => 5.1524, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.79% (0.3937 => 0.4165, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.67% (4.5327 => 4.7898, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 5.54% (0.4353 => 0.4594, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.37% (5.4187 => 5.7096, std.dev.: 0.0454) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.18% (5.3218 => 5.5974, std.dev.: 0.0412) SingleSource/Benchmarks/CoyoteBench/lpbench: 5.01% (3.9006 => 4.0959, std.dev.: 0.0255) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.89% (0.5214 => 0.5469, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 4.72% (3.3398 => 3.4973, std.dev.: 0.0328) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.13% (3.0515 => 3.1776, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/richards_benchmark: 4.07% (1.3037 => 1.3567, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.52% (4.8362 => 5.0062, std.dev.: 0.0113) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.23% (1.0388 => 1.0724, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/whetstone: 2.93% (2.1224 => 2.1845, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.23% (0.6150 => 0.6287, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.21% (3.4104 => 3.4858, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/methcall: 2.14% (8.2676 => 8.4447, std.dev.: 0.0159) SingleSource/Benchmarks/McGill/queens: 2.04% (1.7056 => 1.7404, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.51% (11.5690 => 11.7436, std.dev.: 0.0444) SingleSource/Benchmarks/Misc/ReedSolomon: 1.40% (8.5322 => 8.6516, std.dev.: 0.0191) SingleSource/Benchmarks/Misc/flops-7: 1.18% (1.7156 => 1.7358, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.13% (1.9302 => 1.9521, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.08% (11.5316 => 11.6566, std.dev.: 0.0062) MultiSource/Benchmarks/sim/sim: 1.01% (3.8206 => 3.8592, std.dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.48% (2.8951 => 1.6652, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -24.83% (7.2130 => 5.4221, std.dev.: 0.0616) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.35% (1.4529 => 1.1572, std.dev.: 0.0768) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.99% (9.9065 => 8.2230, std.dev.: 0.0216) SingleSource/Benchmarks/Shootout-C++/ary3: -13.50% (1.9999 => 1.7300, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/em3d/em3d: -12.58% (5.4641 => 4.7768, std.dev.: 0.0106) SingleSource/Benchmarks/McGill/chomp: -9.66% (1.1216 => 1.0133, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-8: -9.49% (2.5609 => 2.3178, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -9.08% (63.1822 => 57.4466, std.dev.: 0.0332) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.17% (3.2169 => 2.9542, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/ackermann: -8.04% (3.9188 => 3.6037, std.dev.: 0.0616) SingleSource/Benchmarks/Stanford/FloatMM: -6.77% (0.8807 => 0.8211, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.29% (5.1305 => 4.8080, std.dev.: 0.0340) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.23% (4.7482 => 4.4522, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout/sieve: -6.15% (7.0599 => 6.6256, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: -5.54% (9.3748 => 8.8552, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.32% (6.2275 => 5.8960, std.dev.: 0.0242) MultiSource/Benchmarks/VersaBench/bmm/bmm: -5.09% (2.8773 => 2.7308, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.85% (5.6343 => 5.3609, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.57% (4.7449 => 4.5282, std.dev.: 0.0368) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.42% (4.9453 => 4.7269, std.dev.: 0.0318) MultiSource/Applications/siod/siod: -4.07% (3.6643 => 3.5151, std.dev.: 0.0521) SingleSource/Benchmarks/Misc/ffbench: -4.00% (1.4296 => 1.3724, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout/heapsort: -3.95% (3.2926 => 3.1624, std.dev.: 0.0399) SingleSource/Benchmarks/Misc/perlin: -3.85% (5.1084 => 4.9117, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.70% (3.7148 => 3.5775, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.63% (5.1557 => 4.9685, std.dev.: 0.0343) SingleSource/Benchmarks/Shootout-C++/methcall: -3.54% (8.9760 => 8.6585, std.dev.: 0.0515) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.28% (4.9686 => 4.8057, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.22% (5.4300 => 5.2552, std.dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.20% (1.3882 => 1.3438, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.89% (2.6356 => 2.5593, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/hash: -2.81% (4.3087 => 4.1876, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/fbench: -2.71% (3.3840 => 3.2923, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.13% (41.4238 => 40.5428, std.dev.: 0.3415) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.94% (3.3479 => 3.2829, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.87% (3.5679 => 3.5013, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-5: -1.73% (2.8957 => 2.8457, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/fp-convert: -1.61% (15.8853 => 15.6291, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/neural/neural: -1.49% (1.0841 => 1.0680, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.31% (22.2997 => 22.0067, std.dev.: 0.0623) SingleSource/Benchmarks/Misc/flops-6: -1.27% (2.4416 => 2.4106, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.27% (4.2466 => 4.1928, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.11% (6.0224 => 5.9554, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.11% (4.7794 => 4.7265, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists: -1.01% (16.7941 => 16.6252, std.dev.: 0.0546) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 5.22% (1.0262 => 1.0798, std.dev.: 0.3122) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.63% (0.2463 => 0.3710, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 40.65% (0.0123 => 0.0173, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 4.72% (0.0254 => 0.0266, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.32% (0.0302 => 0.0306, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.52% (0.0384 => 0.0386, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: -16.84% (0.0190 => 0.0158, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/test1: 17.78% (0.0180 => 0.0212, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.85% (0.1438 => 0.1479, std.dev.: 0.0178) MultiSource/Applications/lemon/lemon: 3.01% (1.1329 => 1.1670, std.dev.: 0.2003) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.24% (0.4164 => 0.3946, std.dev.: 0.1032) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.48% (0.1369 => 0.1444, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -25.00% (0.0008 => 0.0006, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.08% (0.0641 => 0.0602, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.56% (0.0195 => 0.0278, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.56% (0.0578 => 0.0587, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.38% (1.1437 => 1.1480, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -42.86% (0.0014 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.15% (0.0627 => 0.0532, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 21.11% (0.0180 => 0.0218, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.66% (0.8017 => 0.7964, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 4.84% (0.0062 => 0.0065, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 13:33:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 15:33:15 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121128213315.D15B12A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6356?compare_to=6352&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6356, Order: 168806, Start Time: 2012-11-28 20:01:25, End Time: 2012-11-28 21:33:45 To: 6352, Order: 168794, Start Time: 2012-11-28 18:06:00, End Time: 2012-11-28 19:38:17 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (183 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1092 (854 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 17.89% (0.3834 => 0.4520, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.75% (2.0478 => 2.1041, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/salsa20: 2.49% (7.4937 => 7.6804, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash2: 2.21% (3.1932 => 3.2637, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.03% (0.3821 => 0.3514, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.48% (0.9542 => 0.8828, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.91% (0.3142 => 0.2925, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -6.74% (2.4924 => 2.3245, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.65% (0.3896 => 0.3637, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -6.63% (0.3831 => 0.3577, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: -6.62% (0.3880 => 0.3623, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -6.61% (0.3357 => 0.3135, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.60% (0.3848 => 0.3594, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.51% (0.3812 => 0.3564, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.45% (0.4033 => 0.3773, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -6.44% (0.2160 => 0.2021, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.37% (0.3891 => 0.3643, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.34% (0.2428 => 0.2274, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.33% (0.2355 => 0.2206, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -6.29% (9.2283 => 8.6474, std.dev.: 0.0157) SingleSource/UnitTests/ObjC/exceptions: -6.27% (0.4176 => 0.3914, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.25% (0.9852 => 0.9236, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: -6.25% (16.1920 => 15.1802, std.dev.: 0.0157) MultiSource/Applications/JM/ldecod/ldecod: -6.25% (7.0961 => 6.6529, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.18% (0.3884 => 0.3644, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -6.17% (0.1879 => 0.1763, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: -6.10% (0.4199 => 0.3943, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.08% (0.6484 => 0.6090, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.01% (0.1796 => 0.1688, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.96% (1.0544 => 0.9916, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.94% (4.8161 => 4.5301, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/football/football: -5.94% (0.9179 => 0.8634, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.91% (4.0323 => 3.7938, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.89% (1.3722 => 1.2914, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.89% (0.1716 => 0.1615, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.86% (0.5925 => 0.5578, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.78% (0.7198 => 0.6782, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.77% (6.7716 => 6.3807, std.dev.: 0.0052) MultiSource/Benchmarks/nbench/nbench: -5.77% (1.1530 => 1.0865, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.76% (0.5863 => 0.5525, std.dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.76% (1.2300 => 1.1592, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.74% (4.8802 => 4.6002, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/parameter-passing: -5.72% (0.4280 => 0.4035, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -5.71% (0.4515 => 0.4257, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.70% (0.5478 => 0.5166, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.69% (0.5591 => 0.5273, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.66% (0.6304 => 0.5947, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.66% (0.5849 => 0.5518, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.66% (0.3658 => 0.3451, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.65% (0.6260 => 0.5906, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.65% (1.6364 => 1.5439, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.65% (0.5859 => 0.5528, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.64% (0.2695 => 0.2543, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.63% (0.5805 => 0.5478, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.63% (0.7919 => 0.7473, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.63% (0.5705 => 0.5384, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.60% (1.2784 => 1.2068, std.dev.: 0.0049) MultiSource/Applications/lemon/lemon: -5.60% (1.1450 => 1.0809, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.60% (4.5069 => 4.2546, std.dev.: 0.0152) MultiSource/Benchmarks/MallocBench/gs/gs: -5.57% (4.3330 => 4.0915, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.57% (0.5581 => 0.5270, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.57% (3.5339 => 3.3371, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.57% (0.5802 => 0.5479, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.57% (0.5857 => 0.5531, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.56% (0.6293 => 0.5943, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.55% (1.4642 => 1.3830, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.54% (0.5575 => 0.5266, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.53% (0.6297 => 0.5949, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.52% (0.6667 => 0.6299, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.52% (14.2083 => 13.4243, std.dev.: 0.0096) MultiSource/Applications/SIBsim4/SIBsim4: -5.50% (1.3864 => 1.3101, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.50% (0.5688 => 0.5375, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.50% (0.6660 => 0.6294, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.49% (0.6052 => 0.5720, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.48% (0.5999 => 0.5670, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.47% (8.0126 => 7.5740, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.46% (0.6736 => 0.6368, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.46% (0.6194 => 0.5856, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.45% (0.8521 => 0.8057, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.44% (0.6230 => 0.5891, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.43% (0.3406 => 0.3221, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.41% (0.6446 => 0.6097, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.40% (0.6681 => 0.6320, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.40% (0.6189 => 0.5855, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.39% (0.5941 => 0.5621, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.38% (0.6676 => 0.6317, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -5.36% (17.1032 => 16.1868, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.36% (0.2278 => 0.2156, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.33% (0.5456 => 0.5165, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.33% (0.4916 => 0.4654, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.30% (0.2548 => 0.2413, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.29% (0.6033 => 0.5714, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: -5.27% (0.2659 => 0.2519, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -5.26% (0.2985 => 0.2828, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -5.25% (15.5079 => 14.6942, std.dev.: 0.0154) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.24% (1.2210 => 1.1570, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.24% (0.2385 => 0.2260, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.20% (0.6440 => 0.6105, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -5.17% (1.2515 => 1.1868, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.17% (0.2999 => 0.2844, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: -5.08% (0.3581 => 0.3399, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.05% (0.3483 => 0.3307, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.98% (1.2221 => 1.1612, std.dev.: 0.0035) MultiSource/Applications/lua/lua: -4.96% (4.0594 => 3.8581, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: -4.95% (3.5154 => 3.3413, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: -4.90% (0.7447 => 0.7082, std.dev.: 0.0067) MultiSource/Applications/ClamAV/clamscan: -4.86% (15.2527 => 14.5112, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.84% (0.5168 => 0.4918, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.78% (0.3931 => 0.3743, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -4.78% (1.3148 => 1.2520, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.68% (0.6395 => 0.6096, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.67% (0.4151 => 0.3957, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.67% (0.3837 => 0.3658, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.65% (0.3057 => 0.2915, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.64% (0.5329 => 0.5082, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.63% (0.7524 => 0.7176, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -4.62% (0.3271 => 0.3120, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.60% (0.3323 => 0.3170, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.59% (0.7339 => 0.7002, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.59% (1.6474 => 1.5718, std.dev.: 0.0188) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.59% (0.7021 => 0.6699, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -4.57% (2.1401 => 2.0422, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: -4.53% (0.4861 => 0.4641, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/objinst: -4.51% (0.3194 => 0.3050, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.50% (2.1713 => 2.0736, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.49% (0.3252 => 0.3106, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.49% (22.4056 => 21.3998, std.dev.: 0.0161) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.46% (0.3319 => 0.3171, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: -4.46% (0.2939 => 0.2808, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.44% (0.6395 => 0.6111, std.dev.: 0.0053) MultiSource/Applications/siod/siod: -4.44% (2.4021 => 2.2955, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.44% (0.5567 => 0.5320, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -4.42% (0.3481 => 0.3327, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -4.42% (0.3255 => 0.3111, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -4.42% (0.2849 => 0.2723, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.40% (0.2933 => 0.2804, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -4.39% (0.3621 => 0.3462, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -4.39% (0.2871 => 0.2745) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.38% (0.5569 => 0.5325, std.dev.: 0.0046) SingleSource/Regression/C++/ofstream_ctor: -4.38% (0.3059 => 0.2925, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: -4.37% (0.3205 => 0.3065, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -4.36% (0.8418 => 0.8051, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.34% (0.3016 => 0.2885, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -4.32% (0.7982 => 0.7637, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -4.32% (0.2989 => 0.2860, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.31% (0.2903 => 0.2778, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -4.30% (34.0927 => 32.6274, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary: -4.27% (0.3394 => 0.3249, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.26% (0.4813 => 0.4608, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -4.24% (0.3867 => 0.3703, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -4.24% (0.3446 => 0.3300, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -4.21% (0.4248 => 0.4069, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.18% (0.3849 => 0.3688, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -4.16% (5.0226 => 4.8135, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: -4.13% (18.2933 => 17.5373, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.09% (0.4083 => 0.3916, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: -4.09% (0.7779 => 0.7461, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.07% (0.4321 => 0.4145, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.07% (0.9557 => 0.9168, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.01% (0.9077 => 0.8713, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference-object: -3.97% (0.6441 => 0.6185, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -3.91% (0.4524 => 0.4347, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: -3.89% (0.6347 => 0.6100, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.84% (0.3491 => 0.3357, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.79% (2.2587 => 2.1732, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.77% (0.4427 => 0.4260, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -3.64% (0.6750 => 0.6504, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: -3.56% (0.3788 => 0.3653, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: -3.41% (1.5610 => 1.5078, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.30% (5.4682 => 5.2876, std.dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -1.93% (20.7746 => 20.3745, std.dev.: 0.0308) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1953, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: -61.59% (1.8100 => 0.6952, std.dev.: 0.0128) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7567, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225) SingleSource/Benchmarks/Misc/richards_benchmark: -8.63% (1.2842 => 1.1734, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -4.03% (2.2633 => 2.1721, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3993, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.16% (1.3096 => 1.2813, std.dev.: 0.0109) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4701, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 15:28:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 17:28:48 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121128232848.77A012A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6357?compare_to=6356&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6357, Order: 168816, Start Time: 2012-11-28 21:56:59, End Time: 2012-11-28 23:29:11 To: 6356, Order: 168806, Start Time: 2012-11-28 20:01:25, End Time: 2012-11-28 21:33:45 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (7 on baseline) Performance Improvements: 0 (186 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1091 (849 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.15% (54.7681 => 56.4938, std.dev.: 0.0925) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 17.76% (0.3834 => 0.4515, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.52% (54.5751 => 56.4938, std.dev.: 0.0925) SingleSource/Benchmarks/Misc/salsa20: 2.59% (7.4937 => 7.6877, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1008, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hash2: 2.27% (3.1932 => 3.2658, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.10% (0.9531 => 0.9636, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.19% (0.3821 => 0.3508, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.49% (0.9542 => 0.8827, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.87% (0.3142 => 0.2926, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -6.68% (2.4924 => 2.3259, std.dev.: 0.0055) MultiSource/Applications/sgefa/sgefa: -6.64% (0.3357 => 0.3134, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.43% (0.2428 => 0.2272, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -6.36% (9.2283 => 8.6411, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: -6.34% (0.2160 => 0.2023, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -6.34% (16.1920 => 15.1655, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.18% (0.1796 => 0.1685, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -6.17% (0.1879 => 0.1763, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.16% (0.2355 => 0.2210, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -6.10% (0.9179 => 0.8619, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.00% (0.9852 => 0.9261, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.98% (0.6484 => 0.6096, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -5.98% (7.0961 => 6.6719, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.95% (1.3722 => 1.2906, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.92% (0.5925 => 0.5574, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.90% (4.0323 => 3.7945, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.89% (1.0544 => 0.9923, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.88% (0.6395 => 0.6019, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -5.88% (0.3812 => 0.3588, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.83% (0.5863 => 0.5521, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.83% (0.2695 => 0.2538, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.82% (0.6304 => 0.5937, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/exceptions-3: -5.82% (0.3848 => 0.3624, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.82% (1.2300 => 1.1584, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-2: -5.82% (0.3831 => 0.3608, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.82% (4.8161 => 4.5359, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-4: -5.80% (0.3880 => 0.3655, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: -5.78% (1.1530 => 1.0863, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.78% (0.5569 => 0.5247, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.78% (0.3896 => 0.3671, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.75% (0.7198 => 0.6784, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.73% (0.6052 => 0.5705, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.72% (0.5802 => 0.5470, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.72% (0.5859 => 0.5524, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.72% (0.6297 => 0.5937, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.71% (0.5705 => 0.5379, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.71% (1.6364 => 1.5430, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -5.68% (0.1761 => 0.1661, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -5.68% (1.1450 => 1.0800, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.68% (0.6660 => 0.6282, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.67% (0.5575 => 0.5259, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.67% (4.8802 => 4.6037, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.66% (0.3658 => 0.3451, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -5.65% (0.4033 => 0.3805, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.65% (0.5805 => 0.5477, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.62% (0.5570 => 0.5257, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.62% (0.6194 => 0.5846, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.61% (0.6681 => 0.6306, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.61% (0.6736 => 0.6358, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.61% (0.5941 => 0.5608, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.60% (0.3891 => 0.3673, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.60% (1.2784 => 1.2068, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.60% (0.7524 => 0.7103, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.59% (0.6293 => 0.5941, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.59% (6.7716 => 6.3930, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.58% (0.5591 => 0.5279, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -5.58% (0.4176 => 0.3943, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.57% (0.6230 => 0.5883, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.55% (1.4642 => 1.3829, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.55% (0.6667 => 0.6297, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.55% (0.3406 => 0.3217, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.54% (0.7919 => 0.7480, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.53% (4.5069 => 4.2575, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.53% (0.7339 => 0.6933, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.53% (0.6676 => 0.6307, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.51% (0.6260 => 0.5915, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -5.47% (0.4515 => 0.4268, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.47% (3.5339 => 3.3407, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.45% (0.5688 => 0.5378, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.45% (14.2083 => 13.4341, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.45% (0.5581 => 0.5277, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.45% (0.6189 => 0.5852, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.42% (0.5567 => 0.5265, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: -5.42% (1.3864 => 1.3112, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: -5.40% (4.3330 => 4.0990, std.dev.: 0.0124) MultiSource/Applications/sqlite3/sqlite3: -5.38% (17.1032 => 16.1839, std.dev.: 0.0141) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.34% (0.8521 => 0.8066, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.33% (1.2221 => 1.1570, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.32% (1.2210 => 1.1560, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.30% (0.6033 => 0.5713, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.30% (8.0126 => 7.5877, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.27% (0.6395 => 0.6058, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.25% (0.3884 => 0.3680, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.24% (0.4199 => 0.3979, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.23% (0.4916 => 0.4659, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.18% (0.2548 => 0.2416, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.18% (0.2278 => 0.2160, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.17% (0.3057 => 0.2899, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -5.16% (0.2985 => 0.2831, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.16% (0.2385 => 0.2262, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.14% (0.3483 => 0.3304, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: -5.11% (0.3581 => 0.3398, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: -5.10% (1.3148 => 1.2477, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.10% (0.5999 => 0.5693, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: -5.10% (3.5154 => 3.3362, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -5.06% (15.5079 => 14.7235, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.06% (0.3323 => 0.3155, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -5.02% (15.2527 => 14.4869, std.dev.: 0.0177) MultiSource/Benchmarks/McCat/08-main/main: -5.00% (0.2659 => 0.2526, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.99% (0.5857 => 0.5565, std.dev.: 0.0048) MultiSource/Applications/Burg/burg: -4.98% (1.2515 => 1.1892, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -4.98% (0.4280 => 0.4067, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.96% (0.4151 => 0.3945, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.88% (0.3931 => 0.3739, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (0.2871 => 0.2731, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: -4.87% (0.7447 => 0.7084, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.87% (0.5478 => 0.5211, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.84% (0.2933 => 0.2791, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.84% (0.6446 => 0.6134, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.84% (0.5849 => 0.5566, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.83% (0.2999 => 0.2854, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -4.83% (0.2939 => 0.2797, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.83% (0.3252 => 0.3095, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -4.82% (0.3255 => 0.3098, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -4.81% (4.0594 => 3.8640, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.79% (0.2903 => 0.2764, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.77% (0.3837 => 0.3654, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.76% (2.1713 => 2.0679, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.76% (0.5168 => 0.4922, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.74% (0.3016 => 0.2873, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -4.73% (5.0226 => 4.7849, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/hash2: -4.69% (0.4861 => 0.4633, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.65% (1.6474 => 1.5708, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: -4.63% (0.2849 => 0.2717, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: -4.63% (0.3026 => 0.2886, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.62% (0.3849 => 0.3671, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.57% (0.4813 => 0.4593, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: -4.56% (0.3205 => 0.3059, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: -4.54% (0.3059 => 0.2920, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -4.54% (0.3194 => 0.3049, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.53% (0.7021 => 0.6703, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -4.53% (0.3025 => 0.2888, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: -4.52% (0.2989 => 0.2854, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -4.51% (0.3481 => 0.3324, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -4.50% (0.4248 => 0.4057, std.dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.49% (22.4056 => 21.3991, std.dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.48% (0.5329 => 0.5090, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -4.48% (2.1401 => 2.0443, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.47% (0.4321 => 0.4128, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: -4.45% (0.3394 => 0.3243, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -4.45% (2.4021 => 2.2953, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: -4.42% (0.3621 => 0.3461, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -4.42% (34.0927 => 32.5870, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.41% (0.6440 => 0.6156, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -4.38% (0.3446 => 0.3295, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists1: -4.34% (0.3867 => 0.3699, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.34% (0.5456 => 0.5219, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: -4.34% (0.3271 => 0.3129, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.33% (0.9557 => 0.9143, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.30% (0.9077 => 0.8687, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: -4.28% (0.8418 => 0.8058, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.25% (0.3319 => 0.3178, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.21% (0.4083 => 0.3911, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: -4.19% (18.2933 => 17.5274, std.dev.: 0.1587) SingleSource/UnitTests/ObjC++/property-reference-object: -3.97% (0.6441 => 0.6185, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.95% (0.4427 => 0.4252, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.86% (2.2587 => 2.1715, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.81% (0.3491 => 0.3358, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -3.76% (0.6750 => 0.6496, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: -3.72% (0.3788 => 0.3647, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.72% (0.6347 => 0.6111, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: -3.65% (0.4524 => 0.4359, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: -3.56% (0.7779 => 0.7502, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: -3.47% (1.5610 => 1.5069, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.21% (5.4682 => 5.2925, std.dev.: 0.0322) SingleSource/UnitTests/Vector/constpool: -2.35% (20.7746 => 20.2855, std.dev.: 0.0176) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1974, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -61.19% (1.8100 => 0.7024, std.dev.: 0.0182) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7554, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1732, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7069, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.82% (2.2633 => 2.1769, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4001, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.31% (1.3096 => 1.2793, std.dev.: 0.0080) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.66% (6.5735 => 6.4642, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 3.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 15:40:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 17:40:38 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121128234038.21CD72A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6358?compare_to=6355&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6358, Order: 168816, Start Time: 2012-11-28 22:06:15, End Time: 2012-11-28 23:41:13 To: 6355, Order: 168806, Start Time: 2012-11-28 19:56:00, End Time: 2012-11-28 21:26:49 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 38 (103 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1013 (839 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/FloatMM: 75.12% (0.0406 => 0.0711, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/queens: 68.75% (0.0416 => 0.0702, std.dev.: 0.0042) SingleSource/Benchmarks/Stanford/Towers: 40.77% (0.0466 => 0.0656, std.dev.: 0.0073) SingleSource/Benchmarks/Stanford/Quicksort: 38.83% (0.0358 => 0.0497, std.dev.: 0.0048) MultiSource/Applications/viterbi/viterbi: 19.23% (0.1695 => 0.2021, std.dev.: 0.0097) MultiSource/Applications/ClamAV/clamscan: 17.76% (15.4240 => 18.1632, std.dev.: 1.0625) MultiSource/Applications/JM/ldecod/ldecod: 11.49% (6.9581 => 7.7574, std.dev.: 0.2695) SingleSource/Benchmarks/Misc-C++-EH/spirit: 11.15% (5.4574 => 6.0660, std.dev.: 0.0800) MultiSource/Applications/SPASS/SPASS: 10.81% (15.0424 => 16.6678, std.dev.: 0.5059) MultiSource/Applications/sqlite3/sqlite3: 10.05% (15.5016 => 17.0589, std.dev.: 0.1125) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.99% (0.2053 => 0.2258, std.dev.: 0.0027) SingleSource/Benchmarks/LivermoreLoops/kernel01: 9.95% (0.1055 => 0.1160, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/random: 9.82% (0.2017 => 0.2215, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/oourafft: 8.97% (0.2141 => 0.2333, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 6.65% (5.0897 => 5.4283, std.dev.: 0.1025) SingleSource/Benchmarks/Shootout-C++/ary: 5.80% (0.2430 => 0.2571, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.67% (0.8343 => 0.8816, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/hash2: 5.40% (0.4145 => 0.4369, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 5.22% (0.9150 => 0.9628, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.22% (1.0180 => 1.0711, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/lists1: 5.07% (0.3056 => 0.3211, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.29% (0.6618 => 0.6836, std.dev.: 0.0052) MultiSource/Applications/kimwitu++/kc: 2.02% (17.8791 => 18.2394, std.dev.: 0.1255) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.26% (0.9192 => 0.9308, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: 44.12% (0.0723 => 0.1042, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/heapsort: 31.60% (3.1776 => 4.1818, std.dev.: 0.2936) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 28.22% (1.4655 => 1.8790, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.30% (3.6037 => 4.1551, std.dev.: 0.1022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 10.46% (2.9542 => 3.2632, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/hash: 9.60% (4.1876 => 4.5895, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout/ary3: 7.16% (2.0930 => 2.2429, std.dev.: 0.0185) SingleSource/Benchmarks/McGill/chomp: 4.58% (1.0133 => 1.0597, std.dev.: 0.0092) MultiSource/Applications/SIBsim4/SIBsim4: 4.02% (3.1983 => 3.3270, std.dev.: 0.0272) SingleSource/Benchmarks/CoyoteBench/lpbench: 2.94% (4.0959 => 4.2164, std.dev.: 0.0349) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.50% (39.0728 => 40.0508, std.dev.: 0.2538) MultiSource/Applications/JM/lencod/lencod: 1.94% (6.6124 => 6.7404, std.dev.: 0.0305) SingleSource/Benchmarks/Misc/mandel-2: 1.66% (1.6652 => 1.6929, std.dev.: 0.0098) MultiSource/Applications/siod/siod: 1.50% (3.5151 => 3.5678, std.dev.: 0.0139) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.07% (1.0798 => 1.0913, std.dev.: 0.0428) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.78% (0.3710 => 0.3739, std.dev.: 0.0084) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 27.75% (0.0173 => 0.0221, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.70% (0.0428 => 0.0431, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.01% (0.0266 => 0.0258, std.dev.: 0.0045) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.27% (0.0306 => 0.0316, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.10% (0.0386 => 0.0425, std.dev.: 0.0134) SingleSource/UnitTests/Vector/Altivec/casts: 30.38% (0.0158 => 0.0206, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/test1: 4.72% (0.0212 => 0.0222, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 16.09% (0.1479 => 0.1717, std.dev.: 0.0155) MultiSource/Applications/lemon/lemon: 6.01% (1.1670 => 1.2371, std.dev.: 0.3801) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.18% (0.3946 => 0.4190, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.87% (0.1444 => 0.1417, std.dev.: 0.0262) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.33% (0.0006 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.15% (0.0602 => 0.0633, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.80% (0.0278 => 0.0273, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.11% (0.0587 => 0.0557, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.11% (1.1480 => 1.1493, std.dev.: 0.0076) MultiSource/Benchmarks/SciMark2-C/scimark2: 0.01% (9.3965 => 9.3971, std.dev.: 0.0489) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1600.00% (0.0001 => 0.0017, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 225.00% (0.0008 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.72% (0.0532 => 0.0605, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 21.56% (0.0218 => 0.0265, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/puzzle: 2.51% (0.7964 => 0.8164, std.dev.: 0.1263) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -26.15% (0.0065 => 0.0048, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/SciMark2-C/scimark2: -67.12% (28.5821 => 9.3971, std.dev.: 0.0489) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 10.90% (16.4461 => 18.2394, std.dev.: 0.1255) MultiSource/Applications/sqlite3/sqlite3: 2594.08% (0.6332 => 17.0589, std.dev.: 0.1125) MultiSource/Benchmarks/McCat/08-main/main: 50.63% (0.1831 => 0.2758, std.dev.: 0.0972) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.20% (0.1559 => 0.1478, std.dev.: 0.0224) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7268.27% (0.3123 => 23.0111, std.dev.: 0.8847) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1714.00% (0.3344 => 6.0660, std.dev.: 0.0800) SingleSource/Benchmarks/Misc-C++/Large/ray: 40.14% (0.2364 => 0.3313, std.dev.: 0.0162) SingleSource/Benchmarks/Misc-C++/bigfib: 7.14% (0.6010 => 0.6439, std.dev.: 0.0396) SingleSource/Benchmarks/Misc/mandel: 8.86% (0.0429 => 0.0467, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.06% (0.3266 => 0.3464, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/strcat: 7.82% (0.1969 => 0.2123, std.dev.: 0.0364) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 15.62% (0.0224 => 0.0259, std.dev.: 0.0039) SingleSource/UnitTests/byval-alignment: -20.87% (0.0230 => 0.0182, std.dev.: 0.0059) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0516, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 15.60% (0.1462 => 0.1690, std.dev.: 0.0245) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4357, std.dev.: 0.0336) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0729, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4870, std.dev.: 0.0057) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5233, std.dev.: 0.0863) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3056, std.dev.: 0.0363) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0825, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3629, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4335, std.dev.: 0.0385) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0839, std.dev.: 0.0161) SingleSource/Regression/C/uint64_to_float: -29.89% (2.1832 => 1.5306, std.dev.: 0.0024) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/FloatMM: 80.46% (0.0394 => 0.0711, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/queens: 60.27% (0.0438 => 0.0702, std.dev.: 0.0042) SingleSource/Benchmarks/Stanford/Towers: 47.09% (0.0446 => 0.0656, std.dev.: 0.0073) SingleSource/Benchmarks/Stanford/Quicksort: 40.79% (0.0353 => 0.0497, std.dev.: 0.0048) MultiSource/Applications/SIBsim4/SIBsim4: 29.18% (1.2568 => 1.6235, std.dev.: 0.1246) MultiSource/Applications/viterbi/viterbi: 28.15% (0.1577 => 0.2021, std.dev.: 0.0097) MultiSource/Applications/ClamAV/clamscan: 22.99% (14.7684 => 18.1632, std.dev.: 1.0625) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.90% (0.0810 => 0.0955, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 16.88% (14.2605 => 16.6678, std.dev.: 0.5059) MultiSource/Applications/JM/lencod/lencod: 16.40% (15.3280 => 17.8420, std.dev.: 0.9201) MultiSource/Applications/JM/ldecod/ldecod: 15.23% (6.7320 => 7.7574, std.dev.: 0.2695) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 12.94% (0.0773 => 0.0873, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/oourafft: 11.73% (0.2088 => 0.2333, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.14% (0.7932 => 0.8816, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/random: 11.08% (0.1994 => 0.2215, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.56% (0.9688 => 1.0711, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 10.51% (0.8712 => 0.9628, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.59% (0.2180 => 0.2389, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.40% (0.4127 => 0.4515, std.dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: 9.38% (4.9628 => 5.4283, std.dev.: 0.1025) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.35% (0.8656 => 0.9465, std.dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.23% (0.3295 => 0.3599, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.21% (0.9056 => 0.9890, std.dev.: 0.0308) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.02% (0.9039 => 0.9854, std.dev.: 0.0185) MultiSource/Applications/siod/siod: 8.89% (2.2184 => 2.4156, std.dev.: 0.0380) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 8.73% (0.6287 => 0.6836, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.19% (0.1466 => 0.1586, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 8.15% (0.2969 => 0.3211, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.78% (0.1927 => 0.2077, std.dev.: 0.0056) MultiSource/Benchmarks/sim/sim: 7.63% (0.3226 => 0.3472, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 7.57% (0.2390 => 0.2571, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.57% (0.2378 => 0.2558, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.49% (0.8048 => 0.8651, std.dev.: 0.0156) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.41% (0.8148 => 0.8752, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.39% (0.8805 => 0.9456, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.34% (0.8316 => 0.8926, std.dev.: 0.0227) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.32% (0.2240 => 0.2404, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hello: 7.29% (0.1797 => 0.1928, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.99% (0.8066 => 0.8630, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 6.98% (0.9074 => 0.9707, std.dev.: 0.0189) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.96% (0.2111 => 0.2258, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.82% (0.1905 => 0.2035, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 6.68% (0.8518 => 0.9087, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.63% (0.8338 => 0.8891, std.dev.: 0.0190) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.48% (1.3279 => 1.4139, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/football/football: 6.16% (0.8768 => 0.9308, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.04% (0.5961 => 0.6321, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.96% (1.1170 => 1.1836, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/hash2: 5.92% (0.4125 => 0.4369, std.dev.: 0.0052) MultiSource/Applications/lua/lua: 5.22% (3.8189 => 4.0184, std.dev.: 0.0185) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.08% (0.3717 => 0.3906, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.57% (1.2602 => 1.3178, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.32% (0.6227 => 0.6496, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/moments: 4.28% (0.3645 => 0.3801, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.09% (0.2741 => 0.2853, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.48% (0.8995 => 0.9308, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: 58.60% (0.0657 => 0.1042, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/pi: 40.11% (1.5795 => 2.2130, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/heapsort: 37.04% (3.0515 => 4.1818, std.dev.: 0.2936) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 29.50% (2.9096 => 3.7680, std.dev.: 0.0378) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.42% (4.8436 => 5.8811, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 18.01% (0.7597 => 0.8965, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.91% (8.2783 => 9.7608, std.dev.: 0.0268) SingleSource/Benchmarks/McGill/misr: 17.57% (0.4001 => 0.4704, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.64% (14.6451 => 16.7896, std.dev.: 0.1189) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.12% (0.3186 => 0.3636, std.dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: 10.62% (7.4933 => 8.2891, std.dev.: 0.0112) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.45% (0.1129 => 0.1247, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.40% (1.1857 => 1.3090, std.dev.: 0.0319) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.47% (6.3772 => 6.9809, std.dev.: 0.0637) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.10% (3.9006 => 4.2164, std.dev.: 0.0349) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.85% (23.5781 => 25.4301, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout/ary3: 7.06% (2.0949 => 2.2429, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.84% (2.9753 => 3.1788, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout/hash: 6.52% (4.3087 => 4.5895, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.34% (3.3761 => 3.5901, std.dev.: 0.0217) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.95% (4.5327 => 4.8026, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.95% (2.2485 => 2.3822, std.dev.: 0.0305) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.64% (5.4187 => 5.7243, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.40% (5.3218 => 5.6093, std.dev.: 0.0187) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.33% (0.3937 => 0.4147, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.22% (4.8660 => 5.1200, std.dev.: 0.0274) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.95% (0.5214 => 0.5472, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 4.92% (1.3037 => 1.3679, std.dev.: 0.0165) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 4.50% (0.4353 => 0.4549, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 4.40% (4.8362 => 5.0490, std.dev.: 0.0163) MultiSource/Applications/SIBsim4/SIBsim4: 4.38% (3.1873 => 3.3270, std.dev.: 0.0272) MultiSource/Benchmarks/Olden/power/power: 3.64% (1.2061 => 1.2500, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/whetstone: 3.19% (2.1224 => 2.1902, std.dev.: 0.0168) SingleSource/Benchmarks/McGill/queens: 3.07% (1.7056 => 1.7579, std.dev.: 0.0072) SingleSource/Benchmarks/Dhrystone/dry: 3.05% (0.5081 => 0.5236, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.55% (1.2337 => 1.2652, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.38% (3.4104 => 3.4915, std.dev.: 0.0081) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.15% (39.2082 => 40.0508, std.dev.: 0.2538) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.13% (11.5690 => 11.8157, std.dev.: 0.0501) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.04% (4.9469 => 5.0476, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout/methcall: 1.61% (8.2676 => 8.4005, std.dev.: 0.0168) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.44% (3.2169 => 3.2632, std.dev.: 0.0079) MultiSource/Applications/spiff/spiff: 1.35% (2.8561 => 2.8948, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/ReedSolomon: 1.35% (8.5322 => 8.6473, std.dev.: 0.0350) SingleSource/Benchmarks/Misc/flops-7: 1.20% (1.7156 => 1.7362, std.dev.: 0.0075) MultiSource/Benchmarks/sim/sim: 1.15% (3.8206 => 3.8645, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout/fib2: 1.02% (4.3025 => 4.3462, std.dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -41.53% (2.8951 => 1.6929, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -24.44% (7.2130 => 5.4502, std.dev.: 0.1965) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.29% (1.4529 => 1.1581, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.76% (9.9065 => 8.2457, std.dev.: 0.0373) MultiSource/Benchmarks/Olden/em3d/em3d: -12.72% (5.4641 => 4.7692, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-8: -9.09% (2.5609 => 2.3280, std.dev.: 0.0323) MultiSource/Benchmarks/mafft/pairlocalalign: -8.97% (63.1822 => 57.5162, std.dev.: 0.0660) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.13% (1.0512 => 0.9657, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/sieve: -6.03% (7.0599 => 6.6340, std.dev.: 0.0248) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.91% (5.1305 => 4.8273, std.dev.: 0.0424) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.57% (4.7482 => 4.4837, std.dev.: 0.0235) SingleSource/Benchmarks/McGill/chomp: -5.52% (1.1216 => 1.0597, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/flops: -5.32% (9.3748 => 8.8764, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.31% (6.2275 => 5.8970, std.dev.: 0.0625) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.69% (5.6343 => 5.3701, std.dev.: 0.0286) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.54% (4.7449 => 4.5295, std.dev.: 0.0270) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.38% (2.8773 => 2.7513, std.dev.: 0.0461) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.26% (6.1706 => 5.9076, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/ffbench: -3.99% (1.4296 => 1.3725, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/methcall: -3.64% (8.9760 => 8.6492, std.dev.: 0.0651) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.57% (5.1557 => 4.9716, std.dev.: 0.0592) SingleSource/Benchmarks/Misc/perlin: -3.40% (5.1084 => 4.9347, std.dev.: 0.0314) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.11% (3.7148 => 3.5992, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.04% (5.4300 => 5.2647, std.dev.: 0.0131) MultiSource/Applications/lua/lua: -2.94% (29.8330 => 28.9546, std.dev.: 0.2127) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.91% (4.9686 => 4.8239, std.dev.: 0.0205) MultiSource/Applications/siod/siod: -2.63% (3.6643 => 3.5678, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.67% (3.3479 => 3.2920, std.dev.: 0.0163) MultiSource/Benchmarks/FreeBench/neural/neural: -1.43% (1.0841 => 1.0686, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.39% (15.8853 => 15.6646, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.30% (3.5679 => 3.5215, std.dev.: 0.0043) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 6.34% (1.0262 => 1.0913, std.dev.: 0.0428) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.81% (0.2463 => 0.3739, std.dev.: 0.0084) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 79.67% (0.0123 => 0.0221, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.64% (0.0408 => 0.0431, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.57% (0.0254 => 0.0258, std.dev.: 0.0045) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0134) SingleSource/UnitTests/Vector/Altivec/casts: 8.42% (0.0190 => 0.0206, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/test1: 23.33% (0.0180 => 0.0222, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 19.40% (0.1438 => 0.1717, std.dev.: 0.0155) MultiSource/Applications/lemon/lemon: 9.20% (1.1329 => 1.2371, std.dev.: 0.3801) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.62% (0.4164 => 0.4190, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.51% (0.1369 => 0.1417, std.dev.: 0.0262) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.25% (0.0641 => 0.0633, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 40.00% (0.0195 => 0.0273, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.63% (0.0578 => 0.0557, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.49% (1.1437 => 1.1493, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1600.00% (0.0001 => 0.0017, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.51% (0.0627 => 0.0605, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.22% (0.0180 => 0.0265, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.83% (0.8017 => 0.8164, std.dev.: 0.1263) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -22.58% (0.0062 => 0.0048, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 15:51:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 17:51:02 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121128235102.101312A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6359?compare_to=6353&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6359, Order: 168806, Start Time: 2012-11-28 20:30:16, End Time: 2012-11-28 23:51:29 To: 6353, Order: 168792, Start Time: 2012-11-28 16:21:20, End Time: 2012-11-28 19:42:08 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (175 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1088 (715 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 1.01% (26.8298 => 27.1020, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 8.91% (0.2099 => 0.2286, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 8.00% (109.7728 => 118.5571, std.dev.: 0.0342) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.30% (126.0163 => 128.9120, std.dev.: 1.0805) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.80% (0.0625 => 0.0880, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.27% (0.1063 => 0.1406, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.68% (0.2969 => 0.3761, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.13% (0.1106 => 0.1395, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.79% (0.4253 => 0.5350, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.34% (0.4139 => 0.5188, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.79% (0.0714 => 0.0891, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.71% (0.5900 => 0.7358, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.05% (0.4994 => 0.6195, std.dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: 24.01% (1.5932 => 1.9757, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.79% (0.0475 => 0.0588, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.46% (0.0584 => 0.0721, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.22% (0.5000 => 0.6161, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.90% (0.1620 => 0.1991, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.62% (0.1021 => 0.1252, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.30% (0.0897 => 0.1097, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.04% (0.1107 => 0.1351, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 22.04% (0.0599 => 0.0731, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 21.35% (0.0698 => 0.0847, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.33% (0.0633 => 0.0768, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 21.10% (0.0948 => 0.1148, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.06% (0.0584 => 0.0707, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.87% (0.0642 => 0.0776, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.85% (0.1103 => 0.1333, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.83% (0.3903 => 0.4716, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.81% (0.0495 => 0.0598, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 20.71% (0.0821 => 0.0991, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.46% (0.1549 => 0.1866, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.44% (0.1003 => 0.1208, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.44% (0.0822 => 0.0990, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.14% (0.1604 => 0.1927, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 20.14% (0.1619 => 0.1945, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 19.43% (0.0947 => 0.1131, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.36% (0.1462 => 0.1745, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 19.06% (0.0808 => 0.0962) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.89% (0.3890 => 0.4625, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.82% (0.2736 => 0.3251, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.72% (0.2014 => 0.2391, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.61% (1.3152 => 1.5600, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/Hello: 18.54% (0.5826 => 0.6906, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.39% (0.1968 => 0.2330, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 18.36% (0.5889 => 0.6970, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 18.27% (0.4029 => 0.4765, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 18.23% (0.1218 => 0.1440, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 17.87% (0.1505 => 0.1774, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: 17.87% (0.9697 => 1.1430, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.83% (0.2866 => 0.3377, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.79% (0.2738 => 0.3225, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.66% (0.0572 => 0.0673, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.65% (0.1088 => 0.1280, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.57% (0.2875 => 0.3380, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 17.54% (0.5546 => 0.6519, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.45% (0.4658 => 0.5471, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.43% (3.5627 => 4.1837, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: 17.33% (1.8794 => 2.2051, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/fibo: 17.17% (0.2725 => 0.3193, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 17.06% (0.2714 => 0.3177, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.04% (0.2729 => 0.3194, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 17.03% (0.1421 => 0.1663, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 17.01% (0.7171 => 0.8391, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 16.96% (0.2813 => 0.3290, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.92% (0.4361 => 0.5099, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.90% (1.6211 => 1.8951, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.90% (0.1160 => 0.1356, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 16.87% (0.2780 => 0.3249, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 16.84% (0.2803 => 0.3275, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.81% (0.3271 => 0.3821, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 16.80% (0.2750 => 0.3212, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.79% (0.5026 => 0.5870, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 16.72% (0.2811 => 0.3281, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 16.70% (0.3096 => 0.3613, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.66% (0.2911 => 0.3396, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 16.65% (0.2823 => 0.3293, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 16.62% (0.9909 => 1.1556, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.62% (0.2792 => 0.3256, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 16.34% (0.3004 => 0.3495, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 16.34% (1.0781 => 1.2543, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.31% (2.0673 => 2.4045, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.28% (0.3195 => 0.3715, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 16.17% (4.2109 => 4.8916, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.16% (4.4195 => 5.1335, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.08% (0.3930 => 0.4562, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 16.04% (0.3267 => 0.3791, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.03% (2.7292 => 3.1666, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/bh/bh: 15.97% (0.1284 => 0.1489, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 15.93% (0.3258 => 0.3777, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 15.77% (0.3317 => 0.3840, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.65% (0.3060 => 0.3539, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.59% (1.9694 => 2.2765, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.41% (0.1090 => 0.1258, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.40% (0.3124 => 0.3605, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.37% (1.9966 => 2.3035, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.32% (0.3362 => 0.3877, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 15.32% (0.2566 => 0.2959, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 15.23% (23.5202 => 27.1020, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/moments: 15.17% (0.3678 => 0.4236, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sieve: 15.16% (0.3726 => 0.4291, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.11% (0.3282 => 0.3778, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/lists: 15.08% (0.3348 => 0.3853, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 14.98% (0.4146 => 0.4767, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 14.84% (0.2075 => 0.2383, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 14.78% (0.3477 => 0.3991, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.66% (0.3690 => 0.4231, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.65% (0.3625 => 0.4156, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 14.40% (0.4251 => 0.4863, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.37% (0.3981 => 0.4553, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 14.27% (1.4269 => 1.6305, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.25% (0.3845 => 0.4393, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 14.16% (0.7875 => 0.8990, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: 13.99% (0.3446 => 0.3928, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 13.98% (0.0758 => 0.0864, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.97% (0.3465 => 0.3949, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 13.89% (0.3442 => 0.3920, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.87% (0.3460 => 0.3940, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 13.86% (0.2691 => 0.3064, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/synchronized: 13.84% (0.3469 => 0.3949, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.82% (0.3496 => 0.3979, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.79% (0.3488 => 0.3969, std.dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 13.74% (2.1653 => 2.4629, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/bigfib: 13.57% (0.5012 => 0.5692, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.48% (0.3650 => 0.4142, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 13.45% (0.3643 => 0.4133, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 13.27% (0.3724 => 0.4218, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 13.25% (4.6177 => 5.2296, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 13.22% (2.1013 => 2.3790, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.35% (0.6435 => 0.7230, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.35% (0.2040 => 0.2292, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 12.35% (0.3498 => 0.3930, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 12.14% (5.5417 => 6.2147, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.29% (0.2737 => 0.3046, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.22% (0.2068 => 0.2300, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.19% (0.1028 => 0.1143, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.14% (0.1383 => 0.1537, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 11.09% (0.6634 => 0.7370, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.93% (0.3084 => 0.3421, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 10.89% (0.4847 => 0.5375, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 10.43% (0.3336 => 0.3684, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.03% (0.2103 => 0.2314, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 10.00% (2.0346 => 2.2380, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 9.95% (0.2391 => 0.2629, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.53% (4.6926 => 5.0929, std.dev.: 0.0216) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.52% (0.5361 => 0.5818, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.46% (11.6398 => 12.6245, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.09% (0.7426 => 0.8027, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.02% (0.5584 => 0.6032, std.dev.: 0.0031) MultiSource/Applications/kimwitu++/kc: 6.93% (11.9555 => 12.7840, std.dev.: 0.0185) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.56% (0.3792 => 0.3965, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.98% (29.0505 => 33.4029, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 9.71% (0.2802 => 0.3074, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: 7.73% (0.2122 => 0.2286, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6085, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.63% (0.3693 => 0.3901, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6691, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-2: 4.71% (1.8057 => 1.8908, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1705, std.dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6413, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2089, std.dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.84% (3.1722 => 3.2307, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.51% (2.0820 => 2.1135, std.dev.: 0.0096) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3004, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2875, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.14% (8.4155 => 8.5111, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.02% (50.0626 => 50.5743, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.08% (2.4764 => 2.4248, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.94% (25.4195 => 16.5389, std.dev.: 0.0359) SingleSource/Benchmarks/Shootout-C++/ary2: -9.24% (0.2402 => 0.2180, std.dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9738, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7959, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -3.55% (11.2080 => 10.8104, std.dev.: 0.0082) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std.dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: -2.99% (17.2379 => 16.7229, std.dev.: 0.0566) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.89% (0.6293 => 0.6111, std.dev.: 0.0054) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8649, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5758, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4958, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.11% (105.3826 => 104.2127, std.dev.: 0.0341) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0478, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 16:01:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 18:01:51 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121129000151.45C762A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6360?compare_to=6354&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6360, Order: 168806, Start Time: 2012-11-28 21:42:41, End Time: 2012-11-29 00:02:16 To: 6354, Order: 168792, Start Time: 2012-11-28 18:26:28, End Time: 2012-11-28 20:46:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 36 (148 on baseline) Performance Improvements: 6 (43 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1044 (694 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 12.27% (0.3700 => 0.4154, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.70% (0.3205 => 0.3580, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.28% (4.8284 => 5.3730, std.dev.: 0.0156) SingleSource/UnitTests/ObjC/BoolLiteralTest: 11.26% (0.4013 => 0.4465, std.dev.: 0.0117) MultiSource/Benchmarks/nbench/nbench: 11.07% (1.3328 => 1.4804, std.dev.: 0.0252) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.59% (0.6863 => 0.7590, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/football/football: 10.43% (0.9882 => 1.0913, std.dev.: 0.0133) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.41% (0.2093 => 0.2290, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.93% (0.3193 => 0.3478, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.65% (0.6905 => 0.7502, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.63% (0.7210 => 0.7832, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.57% (0.6513 => 0.7071, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.33% (1.5134 => 1.6394, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.29% (0.6900 => 0.7472, std.dev.: 0.0188) SingleSource/Regression/C++/ofstream_ctor: 7.93% (0.3178 => 0.3430, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.72% (0.4028 => 0.4339, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.61% (0.6790 => 0.7307, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/random: 7.04% (0.3052 => 0.3267, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.01% (0.2240 => 0.2397, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.95% (1.3151 => 1.4065, std.dev.: 0.0306) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.92% (0.1676 => 0.1792, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 6.85% (0.1474 => 0.1575, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.29% (0.6898 => 0.7332, std.dev.: 0.0041) MultiSource/Benchmarks/Fhourstones/fhourstones: 5.81% (0.1911 => 0.2022, std.dev.: 0.0039) MultiSource/Applications/spiff/spiff: 5.73% (0.8988 => 0.9503, std.dev.: 0.0179) MultiSource/Applications/d/make_dparser: 5.44% (4.0572 => 4.2779, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.43% (0.7176 => 0.7566, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary: 4.60% (0.3541 => 0.3704, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary3: 4.34% (0.3596 => 0.3752, std.dev.: 0.0041) MultiSource/Applications/hbd/hbd: 3.93% (1.8344 => 1.9065, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.54% (0.3022 => 0.3129, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.20% (4.9283 => 5.0367, std.dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.30% (0.3151 => 0.3444, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.29% (3.1768 => 3.3449, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.09% (5.0429 => 5.1485, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.57% (2.8207 => 2.8650, std.dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/life/life: -12.63% (0.1196 => 0.1045, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.83% (0.1416 => 0.1291, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.74% (0.7492 => 0.6987, std.dev.: 0.0194) SingleSource/UnitTests/Vector/constpool: -2.81% (55.1019 => 53.5543, std.dev.: 0.4560) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -11.66% (4.3455 => 3.8389, std.dev.: 0.1461) SingleSource/Benchmarks/Shootout-C++/ackermann: -1.39% (1.7515 => 1.7272, std.dev.: 0.0078) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.46% (69.4724 => 69.1548, std.dev.: 0.4249) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -1.03% (0.1353 => 0.1339, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0420 => 0.0420, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0652 => 0.0651, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -0.00% (494.0489 => 494.0399, std.dev.: 0.1128) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.35% (63.2438 => 69.1548, std.dev.: 0.4249) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43709.51% (1.1277 => 494.0399, std.dev.: 0.1128) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.97% (0.5229 => 1.5424, std.dev.: 0.1005) MultiSource/Applications/SPASS/SPASS: 17.43% (14.9895 => 17.6027, std.dev.: 0.3276) MultiSource/Applications/kimwitu++/kc: 46.63% (14.1553 => 20.7558, std.dev.: 0.7149) MultiSource/Benchmarks/MallocBench/gs/gs: 21.21% (4.1105 => 4.9822, std.dev.: 0.1923) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 48.39% (1.1048 => 1.6394, std.dev.: 0.0087) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 430.03% (7.1582 => 37.9403, std.dev.: 0.2110) SingleSource/Benchmarks/Misc-C++-EH/spirit: 75.07% (3.4629 => 6.0626, std.dev.: 0.3671) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.38% (0.6222 => 1.0290, std.dev.: 0.0650) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10372.92% (0.0720 => 7.5405, std.dev.: 0.3244) MultiSource/Applications/SIBsim4/SIBsim4: 3930500.00% (0.0001 => 3.9306, std.dev.: 0.0085) MultiSource/Applications/SPASS/SPASS: 16219300.00% (0.0001 => 16.2194, std.dev.: 0.7080) MultiSource/Applications/kimwitu++/kc: 53400.00% (0.0001 => 0.0535, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14500.00% (0.0001 => 0.0146, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576300.00% (0.0001 => 0.5764, std.dev.: 0.0234) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10068700.00% (0.0001 => 10.0688, std.dev.: 0.0146) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6819400.00% (0.0001 => 6.8195, std.dev.: 0.4415) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1710.47% (1.1194 => 20.2664, std.dev.: 0.4497) MultiSource/Applications/ClamAV/clamscan: 69.27% (22.1758 => 37.5377, std.dev.: 0.2764) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 66.47% (2.9384 => 4.8917, std.dev.: 0.2119) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 62.24% (7.0540 => 11.4443, std.dev.: 0.1172) MultiSource/Applications/JM/lencod/lencod: 48.32% (21.9371 => 32.5370, std.dev.: 0.1296) SingleSource/Benchmarks/Misc/flops: 47.70% (0.1432 => 0.2115, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/distray/distray: 44.79% (0.1056 => 0.1529, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 44.76% (8.1363 => 11.7781, std.dev.: 0.1982) SingleSource/Benchmarks/CoyoteBench/almabench: 40.68% (0.0730 => 0.1027, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/voronoi/voronoi: 32.59% (0.2700 => 0.3580, std.dev.: 0.0088) SingleSource/Benchmarks/Stanford/Oscar: 32.08% (0.0636 => 0.0840, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 30.19% (0.0467 => 0.0608, std.dev.: 0.0012) SingleSource/UnitTests/vla: 30.14% (0.0355 => 0.0462, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 29.12% (0.1566 => 0.2022, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/dot-syntax-1: 29.02% (0.0479 => 0.0618, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 28.26% (3.3354 => 4.2779, std.dev.: 0.0141) SingleSource/UnitTests/ObjC/messages-2: 27.49% (0.0662 => 0.0844, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 26.47% (0.0442 => 0.0559, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/treeadd/treeadd: 26.44% (0.0416 => 0.0526, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 26.11% (0.2758 => 0.3478, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 26.10% (0.3441 => 0.4339, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/functionobjects: 26.08% (0.5020 => 0.6329, std.dev.: 0.0180) MultiSource/Benchmarks/MallocBench/espresso/espresso: 25.99% (4.2646 => 5.3730, std.dev.: 0.0156) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.31% (0.0648 => 0.0812, std.dev.: 0.0032) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 25.28% (0.0447 => 0.0560, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 25.19% (0.0770 => 0.0964, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 25.03% (1.1840 => 1.4804, std.dev.: 0.0252) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 24.63% (0.8067 => 1.0054, std.dev.: 0.0320) SingleSource/Benchmarks/Stanford/Towers: 24.42% (0.0471 => 0.0586, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.99% (0.0746 => 0.0925, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.56% (0.1940 => 0.2397, std.dev.: 0.0050) SingleSource/Benchmarks/McGill/chomp: 23.14% (0.1655 => 0.2038, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.13% (0.1029 => 0.1267, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 23.03% (0.0482 => 0.0593, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 22.96% (0.0871 => 0.1071, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.65% (0.1695 => 0.2079, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 22.59% (0.5981 => 0.7332, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/football/football: 22.33% (0.8921 => 1.0913, std.dev.: 0.0133) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 22.31% (0.1125 => 0.1376, std.dev.: 0.0034) MultiSource/Applications/hbd/hbd: 22.19% (1.5603 => 1.9065, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/wordfreq: 21.86% (0.3307 => 0.4030, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.50% (0.0479 => 0.0582, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.31% (0.3121 => 0.3786, std.dev.: 0.0065) MultiSource/Applications/spiff/spiff: 21.29% (0.7835 => 0.9503, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 21.21% (0.3427 => 0.4154, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 21.04% (0.1892 => 0.2290, std.dev.: 0.0007) SingleSource/UnitTests/SignlessTypes/Large/cast: 20.74% (0.0564 => 0.0681, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/perlin: 20.71% (0.0536 => 0.0647, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 20.67% (9.4845 => 11.4450, std.dev.: 0.1216) MultiSource/Applications/hexxagon/hexxagon: 20.43% (1.2842 => 1.5466, std.dev.: 0.0495) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.27% (0.1584 => 0.1905, std.dev.: 0.0114) MultiSource/Benchmarks/Olden/tsp/tsp: 20.17% (0.1175 => 0.1412, std.dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.02% (0.4615 => 0.5539, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.80% (0.9765 => 1.1698, std.dev.: 0.0285) SingleSource/Benchmarks/Shootout-C++/reversefile: 19.40% (0.3865 => 0.4615, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.23% (0.5860 => 0.6987, std.dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/lists: 19.08% (0.3422 => 0.4075, std.dev.: 0.0189) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.06% (0.4203 => 0.5004, std.dev.: 0.0243) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.58% (1.1861 => 1.4065, std.dev.: 0.0306) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.47% (0.0834 => 0.0988, std.dev.: 0.0022) SingleSource/Regression/C++/ofstream_ctor: 18.07% (0.2905 => 0.3430, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/moments: 17.84% (0.4048 => 0.4770, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 17.67% (3.8922 => 4.5800, std.dev.: 0.2112) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.58% (0.0842 => 0.0990, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 17.56% (0.0672 => 0.0790, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/parameter-passing: 17.37% (0.3927 => 0.4609, std.dev.: 0.0103) SingleSource/UnitTests/ObjC/property: 17.24% (0.3886 => 0.4556, std.dev.: 0.0094) SingleSource/UnitTests/ObjC/exceptions: 17.22% (0.3828 => 0.4487, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.05% (14.3668 => 16.8157, std.dev.: 0.3172) SingleSource/Benchmarks/Shootout-C++/hash2: 16.84% (0.4620 => 0.5398, std.dev.: 0.0248) SingleSource/Benchmarks/Shootout/lists: 16.77% (0.0626 => 0.0731, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.76% (0.8172 => 0.9542, std.dev.: 0.0274) SingleSource/Benchmarks/Shootout-C++/random: 16.60% (0.2802 => 0.3267, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/exceptions-4: 16.54% (0.3543 => 0.4129, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.46% (0.2891 => 0.3367, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.45% (0.3543 => 0.4126, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/exceptions-2: 16.44% (0.3497 => 0.4072, std.dev.: 0.0108) SingleSource/UnitTests/ObjC/for-in: 16.30% (0.3694 => 0.4296, std.dev.: 0.0079) SingleSource/UnitTests/ObjC/exceptions-3: 16.27% (0.3516 => 0.4088, std.dev.: 0.0194) SingleSource/UnitTests/SignlessTypes/rem: 16.26% (0.1144 => 0.1330, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.03% (0.0886 => 0.1028, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/mst/mst: 15.99% (0.1163 => 0.1349, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 15.98% (0.5105 => 0.5921, std.dev.: 0.0300) SingleSource/UnitTests/ObjC/trivial-interface: 15.87% (0.3473 => 0.4024, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 15.78% (0.0640 => 0.0741, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.75% (0.2793 => 0.3233, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/hello: 15.66% (0.2714 => 0.3139, std.dev.: 0.0104) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.63% (0.0953 => 0.1102, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/Puzzle: 15.62% (0.1268 => 0.1466, std.dev.: 0.0040) MultiSource/Applications/Burg/burg: 15.58% (1.1642 => 1.3456, std.dev.: 0.0699) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.58% (0.1117 => 0.1291, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/matrix: 15.53% (0.0818 => 0.0945, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/health/health: 15.46% (0.1268 => 0.1464, std.dev.: 0.0073) SingleSource/UnitTests/ObjC/synchronized: 15.16% (0.3561 => 0.4101, std.dev.: 0.0102) MultiSource/Applications/minisat/minisat: 14.91% (0.7115 => 0.8176, std.dev.: 0.0411) SingleSource/Benchmarks/Shootout-C++/sieve: 14.90% (0.3603 => 0.4140, std.dev.: 0.0082) MultiSource/Benchmarks/NPB-serial/is/is: 14.74% (0.0719 => 0.0825, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.62% (0.4636 => 0.5314, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/ary: 14.60% (0.3232 => 0.3704, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.55% (0.2872 => 0.3290, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.36% (0.1337 => 0.1529, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ary3: 14.29% (0.3283 => 0.3752, std.dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference-object: 14.25% (0.6030 => 0.6889, std.dev.: 0.0132) SingleSource/UnitTests/ObjC++/Hello: 14.24% (0.5925 => 0.6769, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.03% (0.1062 => 0.1211, std.dev.: 0.0051) SingleSource/UnitTests/ObjC++/property-reference: 14.00% (0.7326 => 0.8352, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/ackermann: 13.53% (0.2756 => 0.3129, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary2: 13.20% (0.3379 => 0.3825, std.dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.59% (0.0929 => 0.1046, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists1: 12.51% (0.3684 => 0.4145, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.00% (0.0933 => 0.1045, std.dev.: 0.0043) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.81% (0.1143 => 0.1278, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 11.63% (0.4299 => 0.4799, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/hash: 11.59% (0.4289 => 0.4786, std.dev.: 0.0146) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.39% (0.1906 => 0.2123, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.53% (0.1438 => 0.1575, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.47% (0.2430 => 0.2660, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/except: 9.20% (0.2871 => 0.3135, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/fibo: 8.99% (0.2725 => 0.2970, std.dev.: 0.0091) MultiSource/Benchmarks/PAQ8p/paq8p: 8.97% (10.3673 => 11.2969, std.dev.: 0.2978) SingleSource/Benchmarks/Shootout-C++/methcall: 8.79% (0.2877 => 0.3130, std.dev.: 0.0094) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.62% (0.3817 => 0.4146, std.dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 148.66% (4.3953 => 10.9295, std.dev.: 0.0520) SingleSource/Benchmarks/Shootout-C++/methcall: 147.20% (5.3999 => 13.3485, std.dev.: 0.0101) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.27% (1.2838 => 1.5569, std.dev.: 0.0639) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.66% (1.1145 => 1.3113, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.51% (0.2944 => 0.3430, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/oourafft: 16.23% (6.6465 => 7.7252, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 15.59% (8.6802 => 10.0335, std.dev.: 0.0638) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.18% (0.3070 => 0.3444, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.65% (2.8904 => 3.2271, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 10.53% (3.1578 => 3.4903, std.dev.: 0.0705) SingleSource/Benchmarks/Misc/richards_benchmark: 10.27% (1.1396 => 1.2566, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.30% (1.7254 => 1.8858, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.75% (3.1334 => 3.3449, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.94% (0.9540 => 1.0107, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.58% (4.2280 => 4.4641, std.dev.: 0.0116) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.96% (26.0924 => 27.3872, std.dev.: 0.2224) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.6436 => 12.1400, std.dev.: 0.0163) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 2.18% (85.0658 => 86.9226, std.dev.: 0.0423) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 2.07% (3.1595 => 3.2249, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.53% (6.5088 => 6.6082, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0503, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.32% (6.6874 => 0.1792, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.16% (5.2763 => 1.2581, std.dev.: 0.0286) SingleSource/Benchmarks/Misc/salsa20: -75.76% (0.8651 => 0.2097, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/richards_benchmark: -40.38% (0.1622 => 0.0967, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.85% (5.3855 => 4.6932, std.dev.: 0.1582) MultiSource/Applications/JM/ldecod/ldecod: -11.49% (10.4361 => 9.2365, std.dev.: 0.2925) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -10.52% (1.7609 => 1.5756, std.dev.: 0.0718) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.90% (5.3526 => 5.0367, std.dev.: 0.0082) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -68.63% (32.5116 => 10.1998, std.dev.: 0.0338) SingleSource/Benchmarks/Dhrystone/fldry: -66.66% (1.9577 => 0.6526, std.dev.: 0.0229) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1681, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.20% (0.0628 => 0.0363) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.23% (0.3987 => 0.2383, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.31% (4.5009 => 2.7764, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.54% (1.1492 => 0.7638, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.15% (2.6546 => 2.0135, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/mason/mason: -19.53% (0.2161 => 0.1739, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4238, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2840, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -10.51% (9.5636 => 8.5580, std.dev.: 0.2151) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.03% (1.5660 => 1.4246, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.07% (19.9488 => 18.3384, std.dev.: 0.5313) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.79% (3.2416 => 3.0215, std.dev.: 0.0291) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7497, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.14% (0.8614 => 0.8171, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5091, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -4.35% (6.2999 => 6.0256, std.dev.: 0.0531) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.35% (0.9957 => 0.9623, std.dev.: 0.0041) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8920, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.66% (0.4808 => 0.4680, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.94% (8.1563 => 7.9981, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6774, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -1.50% (10.2830 => 10.1288, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0015) Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 17:26:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 19:26:23 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121129012623.C6D1A2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6361?compare_to=6357&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6361, Order: 168829, Start Time: 2012-11-28 23:54:39, End Time: 2012-11-29 01:26:57 To: 6357, Order: 168816, Start Time: 2012-11-28 21:56:59, End Time: 2012-11-28 23:29:11 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 1 (188 on baseline) Added Tests: 0 (50 on baseline) Unchanged Tests: 1090 (849 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.69% (78.0616 => 80.1619, std.dev.: 0.3887) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -3.30% (0.7024 => 0.6792, std.dev.: 0.0085) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 18.26% (0.3834 => 0.4534, std.dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.73% (2.0478 => 2.1037, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: 2.39% (7.4937 => 7.6728, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/hash2: 1.89% (3.1932 => 3.2536, std.dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.01% (0.1431 => 0.1302, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.35% (0.3821 => 0.3502, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.81% (0.9542 => 0.8797, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.07% (0.3142 => 0.2920, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.86% (2.4924 => 2.3214, std.dev.: 0.0163) MultiSource/Applications/sgefa/sgefa: -6.73% (0.3357 => 0.3131, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.51% (0.2428 => 0.2270, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -6.44% (0.2160 => 0.2021, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: -6.34% (16.1920 => 15.1652, std.dev.: 0.0179) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.29% (0.1796 => 0.1683, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.24% (0.2355 => 0.2208, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: -6.22% (7.0961 => 6.6544, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.22% (0.7198 => 0.6750, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -6.22% (0.9179 => 0.8608, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -6.22% (9.2283 => 8.6545, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/ReedSolomon: -6.17% (0.1879 => 0.1763, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.14% (0.6484 => 0.6086, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.13% (0.5925 => 0.5562, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.04% (0.3658 => 0.3437, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.02% (0.1761 => 0.1655, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.99% (0.9852 => 0.9262, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.96% (0.6052 => 0.5691, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: -5.95% (0.3831 => 0.3603, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.94% (0.6395 => 0.6015, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.94% (1.0544 => 0.9918, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.92% (0.6297 => 0.5924, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.92% (0.5591 => 0.5260, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.90% (0.3880 => 0.3651, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.90% (0.6681 => 0.6287, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.89% (0.1716 => 0.1615, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.88% (0.5863 => 0.5518, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.88% (0.3812 => 0.3588, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.87% (0.6230 => 0.5864, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.87% (0.3848 => 0.3622, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.87% (0.5570 => 0.5243, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.87% (0.6304 => 0.5934, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.86% (0.2695 => 0.2537, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.85% (0.5705 => 0.5371, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -5.85% (0.3896 => 0.3668, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.85% (4.0323 => 3.7965, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.83% (0.6667 => 0.6278, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.83% (0.5802 => 0.5464, std.dev.: 0.0060) MultiSource/Applications/lemon/lemon: -5.83% (1.1450 => 1.0783, std.dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.81% (3.5339 => 3.3287, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.78% (0.3891 => 0.3666, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.78% (0.5569 => 0.5247, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.78% (0.7339 => 0.6915, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: -5.78% (0.4033 => 0.3800, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.77% (1.2300 => 1.1590, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.77% (0.6260 => 0.5899, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.76% (0.6194 => 0.5837, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.76% (1.3722 => 1.2932, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.76% (4.8161 => 4.5389, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.75% (0.5805 => 0.5471, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: -5.75% (0.4176 => 0.3936, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.72% (0.5941 => 0.5601, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.70% (0.6189 => 0.5836, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.70% (1.6364 => 1.5432, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.68% (0.5859 => 0.5526, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.67% (0.8521 => 0.8038, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.66% (1.2784 => 1.2060, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.66% (0.6676 => 0.6298, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.66% (1.4642 => 1.3813, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -5.65% (1.1530 => 1.0878, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.64% (0.5581 => 0.5266, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.64% (0.6736 => 0.6356, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.64% (4.8802 => 4.6049, std.dev.: 0.0073) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.64% (6.7716 => 6.3897, std.dev.: 0.0116) MultiSource/Benchmarks/sim/sim: -5.64% (0.3406 => 0.3214, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.63% (0.3057 => 0.2885, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.60% (0.4515 => 0.4262, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.59% (0.7919 => 0.7476, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.59% (4.5069 => 4.2548, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: -5.58% (1.3864 => 1.3090, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.57% (0.6660 => 0.6289, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.55% (0.6395 => 0.6040, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.55% (0.6293 => 0.5944, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.54% (0.5575 => 0.5266, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.54% (0.7524 => 0.7107, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.53% (0.5567 => 0.5259, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.52% (0.5688 => 0.5374, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -5.43% (4.3330 => 4.0977, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.41% (0.3252 => 0.3076, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.40% (0.6033 => 0.5707, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.40% (14.2083 => 13.4415, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.39% (0.3931 => 0.3719, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -5.38% (0.4199 => 0.3973, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -5.37% (17.1032 => 16.1842, std.dev.: 0.0181) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.37% (0.4151 => 0.3928, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.35% (1.2221 => 1.1567, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -5.35% (1.3148 => 1.2445, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.33% (0.3884 => 0.3677, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.33% (0.3323 => 0.3146, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.31% (1.2210 => 1.1562, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.30% (0.2548 => 0.2413, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.29% (0.2871 => 0.2719, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.25% (0.3483 => 0.3300, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -5.22% (0.3255 => 0.3085, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.21% (0.3837 => 0.3637, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -5.21% (15.5079 => 14.6998, std.dev.: 0.0149) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.21% (0.4916 => 0.4660, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.21% (0.2939 => 0.2786, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.19% (2.1713 => 2.0586, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.18% (0.2278 => 0.2160, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: -5.17% (3.5154 => 3.3335, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.17% (8.0126 => 7.5980, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hello: -5.16% (0.2849 => 0.2702, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.16% (0.2985 => 0.2831, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -5.15% (1.2515 => 1.1870, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.14% (0.3016 => 0.2861) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.13% (0.2903 => 0.2754, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -5.13% (0.3059 => 0.2902, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.12% (0.5857 => 0.5557, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: -5.11% (0.2659 => 0.2523) SingleSource/Benchmarks/Shootout-C++/objinst: -5.10% (0.3194 => 0.3031) SingleSource/UnitTests/ObjC/parameter-passing: -5.09% (0.4280 => 0.4062, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -5.08% (0.3581 => 0.3399, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.07% (0.5478 => 0.5200, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.07% (0.2385 => 0.2264, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -5.06% (0.3025 => 0.2872, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -5.04% (0.4861 => 0.4616, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/except: -5.02% (0.3026 => 0.2874, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: -4.98% (0.2989 => 0.2840, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.98% (0.7447 => 0.7076, std.dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: -4.97% (15.2527 => 14.4953, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: -4.96% (0.3446 => 0.3275, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.95% (0.5999 => 0.5702, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary: -4.95% (0.3394 => 0.3226, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.95% (0.6446 => 0.6127, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: -4.93% (0.3205 => 0.3047, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -4.92% (0.4248 => 0.4039, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -4.91% (4.0594 => 3.8600, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.91% (0.5849 => 0.5562, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -4.89% (34.0927 => 32.4244, std.dev.: 0.0340) SingleSource/Benchmarks/Shootout-C++/lists: -4.89% (0.3621 => 0.3444, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -4.89% (0.3867 => 0.3678, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.86% (0.5168 => 0.4917, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: -4.85% (0.3481 => 0.3312, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.80% (0.4813 => 0.4582) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.80% (1.6474 => 1.5684, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.79% (0.4321 => 0.4114, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.78% (0.4083 => 0.3888, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.76% (0.7021 => 0.6687, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.73% (0.5329 => 0.5077, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.68% (0.3849 => 0.3669, std.dev.: 0.0040) MultiSource/Applications/oggenc/oggenc: -4.67% (5.0226 => 4.7878, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -4.65% (0.7982 => 0.7611, std.dev.: 0.0024) MultiSource/Applications/treecc/treecc: -4.64% (2.1401 => 2.0409, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.60% (0.9557 => 0.9117, std.dev.: 0.0052) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.60% (22.4056 => 21.3751, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.58% (0.5456 => 0.5206, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.55% (0.6440 => 0.6147, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -4.48% (2.4021 => 2.2944, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.43% (0.2999 => 0.2866, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -4.38% (0.8418 => 0.8049, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: -4.37% (0.3271 => 0.3128, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.36% (0.9077 => 0.8681, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.31% (0.4427 => 0.4236, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.31% (0.3319 => 0.3176, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: -4.28% (18.2933 => 17.5109, std.dev.: 0.0209) SingleSource/Benchmarks/Shootout-C++/hash: -4.24% (0.4524 => 0.4332, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.19% (2.2587 => 2.1640, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: -4.17% (0.3788 => 0.3630, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -4.03% (0.6750 => 0.6478, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.98% (0.3491 => 0.3352, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -3.88% (0.6441 => 0.6191, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -3.72% (1.5610 => 1.5029, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/Hello: -3.70% (0.6347 => 0.6112, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -3.46% (0.7779 => 0.7510, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.07% (5.4682 => 5.3005, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -2.25% (20.7746 => 20.3077, std.dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1960, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -62.48% (1.8100 => 0.6792, std.dev.: 0.0085) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7526, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1723, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.84% (1.7753 => 1.7072, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.67% (2.2633 => 2.1802, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4002, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.08% (1.0557 => 1.0232, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.82% (1.3096 => 1.2858, std.dev.: 0.0090) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.70% (6.5735 => 6.4617, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 17:35:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 19:35:03 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121129013503.EF7CD2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6362?compare_to=6358&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6362, Order: 168829, Start Time: 2012-11-29 00:00:39, End Time: 2012-11-29 01:35:38 To: 6358, Order: 168816, Start Time: 2012-11-28 22:06:15, End Time: 2012-11-28 23:41:13 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 20 (82 on baseline) Performance Improvements: 30 (38 on baseline) Added Tests: 0 (50 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1001 (853 on baseline) Total Tests: 1092 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest: 53.23% (0.0928 => 0.1422, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/15-trie/trie: 49.38% (0.0569 => 0.0850, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/ks/ks: 48.80% (0.1586 => 0.2360, std.dev.: 0.0096) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 29.26% (0.0950 => 0.1228, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.32% (0.8752 => 1.1143, std.dev.: 0.0684) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.36% (0.1238 => 0.1552, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 22.78% (0.6321 => 0.7761, std.dev.: 0.0287) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.94% (9.1154 => 10.6594, std.dev.: 0.4094) MultiSource/Benchmarks/McCat/08-main/main: 12.47% (0.2758 => 0.3102, std.dev.: 0.0081) MultiSource/Applications/hexxagon/hexxagon: 8.15% (1.0146 => 1.0973, std.dev.: 0.0291) MultiSource/Applications/kimwitu++/kc: 5.43% (18.2394 => 19.2304, std.dev.: 0.3045) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.88% (0.4515 => 0.4690, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.01% (1.7370 => 1.7545, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 40.97% (0.8830 => 1.2448, std.dev.: 0.0347) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.70% (1.2908 => 1.5451, std.dev.: 0.0872) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 18.31% (1.2652 => 1.4968, std.dev.: 0.0636) MultiSource/Benchmarks/llubenchmark/llu: 4.10% (2.0130 => 2.0956, std.dev.: 0.0269) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.02% (3.7680 => 3.8440, std.dev.: 0.0270) MultiSource/Applications/sqlite3/sqlite3: 1.97% (4.4357 => 4.5232, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.68% (4.4465 => 4.5212, std.dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Stanford/FloatMM: -40.37% (0.0711 => 0.0424, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: -33.48% (0.0702 => 0.0467, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Towers: -26.37% (0.0656 => 0.0483, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Quicksort: -25.15% (0.0497 => 0.0372, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: -14.34% (0.1276 => 0.1093, std.dev.: 0.0010) SingleSource/Benchmarks/LivermoreLoops/kernel19: -11.07% (0.1228 => 0.1092, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: -10.47% (0.2150 => 0.1925, std.dev.: 0.0017) SingleSource/Benchmarks/LivermoreLoops/kernel01: -9.91% (0.1160 => 0.1045, std.dev.: 0.0015) SingleSource/UnitTests/SignlessTypes/rem: -9.66% (0.1191 => 0.1076, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/random: -9.44% (0.2215 => 0.2006, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++-EH/spirit: -9.01% (6.0660 => 5.5196, std.dev.: 0.1968) SingleSource/Benchmarks/Misc/oourafft: -8.53% (0.2333 => 0.2134, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: -6.63% (0.2277 => 0.2126, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary2: -4.84% (0.2704 => 0.2573, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.55% (0.3388 => 0.3234, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.97% (0.5240 => 0.5032, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash: -3.78% (0.4073 => 0.3919, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: -33.49% (0.1042 => 0.0693, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ackermann: -11.05% (4.1551 => 3.6959, std.dev.: 0.1112) SingleSource/Benchmarks/Shootout/nestedloop: -8.80% (0.2216 => 0.2021, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.00% (3.2632 => 3.0349, std.dev.: 0.0712) SingleSource/Benchmarks/Shootout-C++/hash: -5.65% (0.6550 => 0.6180, std.dev.: 0.0050) SingleSource/Benchmarks/McGill/chomp: -4.14% (1.0597 => 1.0158, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel: -3.60% (1.4335 => 1.3819, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/flops-4: -3.56% (1.7202 => 1.6589, std.dev.: 0.0067) SingleSource/Benchmarks/Stanford/FloatMM: -2.55% (0.8523 => 0.8306, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/primes/primes: -1.61% (0.8965 => 0.8821, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.49% (1.4798 => 1.4578, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: -1.10% (1.7579 => 1.7385, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel-2: -1.10% (1.6929 => 1.6743, std.dev.: 0.0067) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.48% (1.0913 => 1.0965, std.dev.: 0.2438) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.78% (0.3739 => 0.3710, std.dev.: 0.0136) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.26% (0.0221 => 0.0216, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.16% (0.0431 => 0.0426, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 28.68% (0.0258 => 0.0332, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.95% (0.0316 => 0.0313, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.47% (0.0425 => 0.0423, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: -1.46% (0.0206 => 0.0203, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/test1: -2.25% (0.0222 => 0.0217, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -30.77% (0.0013 => 0.0009, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -2.91% (0.1717 => 0.1667, std.dev.: 0.0139) MultiSource/Applications/lemon/lemon: 10.63% (1.2371 => 1.3686, std.dev.: 0.2411) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 8.64% (0.4190 => 0.4552, std.dev.: 0.1572) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.75% (0.1417 => 0.1626, std.dev.: 0.0174) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.05% (0.0633 => 0.0620, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.20% (0.0273 => 0.0267, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.97% (0.0557 => 0.0568, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: - (1.1493 => 1.1493, std.dev.: 0.1724) MultiSource/Benchmarks/SciMark2-C/scimark2: 0.02% (9.3971 => 9.3987, std.dev.: 0.0531) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 76.47% (0.0017 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.17% (0.0605 => 0.0606, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.75% (0.0265 => 0.0263, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.53% (0.8164 => 0.8039, std.dev.: 0.1104) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 25.00% (0.0048 => 0.0060, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/SciMark2-C/scimark2: -67.12% (28.5821 => 9.3987, std.dev.: 0.0531) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 16.93% (16.4461 => 19.2304, std.dev.: 0.3045) MultiSource/Applications/sqlite3/sqlite3: 2554.86% (0.6332 => 16.8106, std.dev.: 0.2129) MultiSource/Benchmarks/McCat/08-main/main: 69.42% (0.1831 => 0.3102, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.69% (0.1559 => 0.1517, std.dev.: 0.0408) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7096.99% (0.3123 => 22.4762, std.dev.: 0.4242) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1550.60% (0.3344 => 5.5196, std.dev.: 0.1968) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.23% (0.2364 => 0.3244, std.dev.: 0.0267) SingleSource/Benchmarks/Misc-C++/bigfib: 5.41% (0.6010 => 0.6335, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/mandel: 3.96% (0.0429 => 0.0446, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.76% (0.3266 => 0.3454, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/strcat: 3.91% (0.1969 => 0.2046, std.dev.: 0.0038) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.91% (0.0224 => 0.0235, std.dev.: 0.0041) SingleSource/UnitTests/byval-alignment: -25.65% (0.0230 => 0.0171, std.dev.: 0.0029) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0530, std.dev.: 0.0125) MultiSource/Applications/oggenc/oggenc: 14.57% (0.1462 => 0.1675, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.5232, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0764, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4965, std.dev.: 0.0827) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5247, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2781, std.dev.: 0.0161) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0713, std.dev.: 0.0190) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3623, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3819, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0810, std.dev.: 0.0022) SingleSource/Regression/C/uint64_to_float: -30.04% (2.1832 => 1.5273, std.dev.: 0.0137) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest: 71.53% (0.0829 => 0.1422, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/ks/ks: 60.98% (0.1466 => 0.2360, std.dev.: 0.0096) MultiSource/Benchmarks/McCat/15-trie/trie: 55.96% (0.0545 => 0.0850, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 47.95% (0.0830 => 0.1228, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 36.76% (0.8148 => 1.1143, std.dev.: 0.0684) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.50% (0.1137 => 0.1552, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 30.20% (0.5961 => 0.7761, std.dev.: 0.0287) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 25.49% (1.2602 => 1.5814, std.dev.: 0.1129) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 23.26% (8.6476 => 10.6594, std.dev.: 0.4094) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 21.88% (0.6010 => 0.7325, std.dev.: 0.0480) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.64% (0.4127 => 0.4690, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 11.99% (1.3279 => 1.4871, std.dev.: 0.0298) MultiSource/Applications/hexxagon/hexxagon: 11.86% (0.9810 => 1.0973, std.dev.: 0.0291) SingleSource/Benchmarks/Misc/flops: 11.63% (0.0937 => 0.1046, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.72% (0.7473 => 0.8274, std.dev.: 0.0214) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 10.61% (0.1150 => 0.1272, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 10.60% (1.2222 => 1.3517, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.43% (0.8331 => 0.9200, std.dev.: 0.0247) MultiSource/Benchmarks/Prolangs-C/football/football: 10.12% (0.8768 => 0.9655, std.dev.: 0.0250) MultiSource/Benchmarks/sim/sim: 9.92% (0.3226 => 0.3546, std.dev.: 0.0046) MultiSource/Applications/minisat/minisat: 9.85% (0.6834 => 0.7507, std.dev.: 0.0187) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.33% (0.1425 => 0.1558, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 8.97% (1.0945 => 1.1927, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.13% (13.1811 => 14.1215, std.dev.: 0.2287) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.07% (1.6386 => 1.7545, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.93% (0.8805 => 0.9415, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.82% (0.8177 => 0.8735, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.68% (0.8716 => 0.9298, std.dev.: 0.0219) MultiSource/Applications/siod/siod: 6.60% (2.2184 => 2.3649, std.dev.: 0.0333) MultiSource/Applications/sgefa/sgefa: 6.57% (0.2999 => 0.3196, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.46% (0.8597 => 0.9152, std.dev.: 0.0159) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.05% (0.3717 => 0.3942, std.dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: 5.78% (4.9628 => 5.2495, std.dev.: 0.0940) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.60% (0.8048 => 0.8499, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.54% (0.2998 => 0.3164, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.21% (0.4783 => 0.5032, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.51% (0.8340 => 0.8716, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.82% (0.3115 => 0.3234, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash: 3.13% (0.3800 => 0.3919, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.50% (0.6943 => 0.7047, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 51.08% (0.0231 => 0.0349, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 41.63% (0.8789 => 1.2448, std.dev.: 0.0347) SingleSource/Benchmarks/Misc/pi: 39.82% (1.5795 => 2.2085, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 32.11% (2.9096 => 3.8440, std.dev.: 0.0270) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 21.33% (1.2337 => 1.4968, std.dev.: 0.0636) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.13% (4.8436 => 5.8669, std.dev.: 0.0174) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.50% (1.2822 => 1.5451, std.dev.: 0.0872) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.60% (8.2783 => 9.7352, std.dev.: 0.0232) SingleSource/Benchmarks/McGill/misr: 16.20% (0.4001 => 0.4649, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.11% (0.7597 => 0.8821, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.46% (14.6451 => 16.6158, std.dev.: 0.4301) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.55% (0.3186 => 0.3586, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.75% (2.7995 => 3.1284, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 11.30% (3.9917 => 4.4429, std.dev.: 0.0637) MultiSource/Benchmarks/McCat/04-bisect/bisect: 11.07% (0.1129 => 0.1254, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 10.29% (7.4933 => 8.2646, std.dev.: 0.0229) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 9.69% (1.1857 => 1.3006, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.07% (6.3772 => 6.9554, std.dev.: 0.1303) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.33% (23.5781 => 25.3064, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.34% (3.3761 => 3.5903, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.99% (4.8660 => 5.1573, std.dev.: 0.0354) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.96% (2.9753 => 3.1527, std.dev.: 0.0574) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 5.73% (0.5214 => 0.5513, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.70% (4.5327 => 4.7912, std.dev.: 0.0312) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.42% (5.4187 => 5.7125, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.27% (5.3218 => 5.6021, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 5.15% (0.4353 => 0.4577, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.11% (0.3937 => 0.4138, std.dev.: 0.0020) MultiSource/Benchmarks/llubenchmark/llu: 4.95% (1.9967 => 2.0956, std.dev.: 0.0269) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 4.71% (4.8362 => 5.0638, std.dev.: 0.0198) SingleSource/Benchmarks/Misc/richards_benchmark: 4.21% (1.3037 => 1.3586, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/dry: 2.99% (0.5081 => 0.5233, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 2.89% (2.1224 => 2.1837, std.dev.: 0.0137) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.14% (3.4104 => 3.4834, std.dev.: 0.0267) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.04% (11.5690 => 11.8047, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.97% (4.4340 => 4.5212, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.94% (39.2082 => 39.9700, std.dev.: 0.0743) SingleSource/Benchmarks/McGill/queens: 1.93% (1.7056 => 1.7385, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/methcall: 1.68% (8.2676 => 8.4066, std.dev.: 0.0288) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.35% (4.9469 => 5.0136, std.dev.: 0.0250) MultiSource/Applications/spiff/spiff: 1.34% (2.8561 => 2.8944, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.22% (1.5941 => 1.6135, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.17% (2.8951 => 1.6743, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -23.91% (7.2130 => 5.4882, std.dev.: 0.2277) MultiSource/Benchmarks/Ptrdist/ks/ks: -17.32% (1.4529 => 1.2013, std.dev.: 0.0810) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -17.00% (9.9065 => 8.2222, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/ary3: -13.27% (1.9999 => 1.7345, std.dev.: 0.0862) MultiSource/Benchmarks/Olden/em3d/em3d: -12.66% (5.4641 => 4.7724, std.dev.: 0.0333) SingleSource/Benchmarks/Misc/flops-8: -9.44% (2.5609 => 2.3192, std.dev.: 0.0264) SingleSource/Benchmarks/McGill/chomp: -9.43% (1.1216 => 1.0158, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: -9.14% (63.1822 => 57.4052, std.dev.: 0.0537) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.12% (5.1305 => 4.8165, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout/sieve: -6.03% (7.0599 => 6.6340, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.90% (4.7482 => 4.4682, std.dev.: 0.0105) SingleSource/Benchmarks/Stanford/FloatMM: -5.69% (0.8807 => 0.8306, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: -5.49% (9.3748 => 8.8599, std.dev.: 0.0271) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.40% (6.2275 => 5.8911, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.88% (5.6343 => 5.3594, std.dev.: 0.0253) SingleSource/Benchmarks/Misc/himenobmtxpa: -4.85% (4.3552 => 4.1439, std.dev.: 0.0810) SingleSource/Benchmarks/Misc/ffbench: -4.58% (1.4296 => 1.3641, std.dev.: 0.0217) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.43% (2.8773 => 2.7498, std.dev.: 0.0481) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.19% (6.1706 => 5.9120, std.dev.: 0.0330) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.05% (4.9453 => 4.7448, std.dev.: 0.0232) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.77% (3.7148 => 3.5747, std.dev.: 0.0250) SingleSource/Benchmarks/Misc/perlin: -3.70% (5.1084 => 4.9192, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.44% (5.1557 => 4.9786, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/methcall: -3.26% (8.9760 => 8.6831, std.dev.: 0.0351) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.21% (5.4300 => 5.2559, std.dev.: 0.0250) MultiSource/Applications/siod/siod: -3.13% (3.6643 => 3.5496, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.87% (4.7449 => 4.6085, std.dev.: 0.0316) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.76% (2.6356 => 2.5628, std.dev.: 0.0274) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.57% (1.3882 => 1.3525, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/fbench: -2.38% (3.3840 => 3.3034, std.dev.: 0.0229) SingleSource/Benchmarks/Dhrystone/fldry: -2.17% (0.6910 => 0.6760, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.77% (3.3479 => 3.2885, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-5: -1.62% (2.8957 => 2.8487, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/fp-convert: -1.47% (15.8853 => 15.6517, std.dev.: 0.0433) SingleSource/Benchmarks/Misc/flops-6: -1.31% (2.4416 => 2.4096, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.27% (4.2466 => 4.1928, std.dev.: 0.0108) MultiSource/Benchmarks/FreeBench/neural/neural: -1.26% (1.0841 => 1.0704, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 6.85% (1.0262 => 1.0965, std.dev.: 0.2438) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.63% (0.2463 => 0.3710, std.dev.: 0.0136) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 75.61% (0.0123 => 0.0216, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 28.57% (0.0007 => 0.0009, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 15.92% (0.1438 => 0.1667, std.dev.: 0.0139) MultiSource/Applications/lemon/lemon: 20.81% (1.1329 => 1.3686, std.dev.: 0.2411) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 9.32% (0.4164 => 0.4552, std.dev.: 0.1572) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.77% (0.1369 => 0.1626, std.dev.: 0.0174) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.28% (0.0641 => 0.0620, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 36.92% (0.0195 => 0.0267, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.73% (0.0578 => 0.0568, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.49% (1.1437 => 1.1493, std.dev.: 0.1724) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.35% (0.0627 => 0.0606, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 46.11% (0.0180 => 0.0263, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.27% (0.8017 => 0.8039, std.dev.: 0.1104) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -3.23% (0.0062 => 0.0060, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 19:22:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 21:22:56 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121129032256.16F0D2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6363?compare_to=6361&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6363, Order: 168846, Start Time: 2012-11-29 01:49:48, End Time: 2012-11-29 03:23:29 To: 6361, Order: 168829, Start Time: 2012-11-28 23:54:39, End Time: 2012-11-29 01:26:57 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (182 on baseline) Added Tests: 2 (52 on baseline) Unchanged Tests: 1091 (854 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.21% (0.9541 => 0.9656, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 18.02% (0.3834 => 0.4525, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1016, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: 2.53% (7.4937 => 7.6835, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 1.99% (3.1932 => 3.2569, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.31% (0.9531 => 0.9656, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.90% (0.3821 => 0.3519, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.17% (0.9542 => 0.8858, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.72% (0.3142 => 0.2931, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.69% (2.4924 => 2.3257, std.dev.: 0.0158) MultiSource/Applications/sgefa/sgefa: -6.34% (0.3357 => 0.3144, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.34% (0.2428 => 0.2274, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.19% (9.2283 => 8.6575, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-3: -6.11% (0.3848 => 0.3613, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: -6.09% (0.3812 => 0.3580, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.08% (0.3896 => 0.3659, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.08% (0.3831 => 0.3598, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.08% (0.6484 => 0.6090, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.01% (0.1796 => 0.1688, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: -6.00% (0.9179 => 0.8628, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.99% (0.3891 => 0.3658, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -5.98% (16.1920 => 15.2230, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/oourafft: -5.97% (0.2160 => 0.2031, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -5.95% (0.4033 => 0.3793, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.94% (0.4176 => 0.3928, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.94% (1.0544 => 0.9918, std.dev.: 0.0074) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.86% (0.2355 => 0.2217, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -5.85% (0.1879 => 0.1769, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -5.84% (7.0961 => 6.6819, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.82% (0.7198 => 0.6779, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.78% (1.3722 => 1.2929, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: -5.77% (0.3880 => 0.3656, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.74% (0.3658 => 0.3448, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.74% (0.5925 => 0.5585, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.70% (0.9852 => 0.9290, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.65% (1.2300 => 1.1605, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.63% (1.6364 => 1.5443, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.61% (0.6395 => 0.6036, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.60% (0.2695 => 0.2544, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.56% (0.3884 => 0.3668) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.56% (0.5863 => 0.5537, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -5.55% (0.4199 => 0.3966, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -5.55% (1.1450 => 1.0815, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.55% (1.4642 => 1.3830, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.53% (0.5591 => 0.5282, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.52% (3.5339 => 3.3388, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: -5.52% (1.1530 => 1.0894, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.48% (0.5802 => 0.5484, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.48% (0.5805 => 0.5487, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.48% (4.8161 => 4.5523, std.dev.: 0.0078) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.47% (6.7716 => 6.4010, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.47% (4.5069 => 4.2603, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.46% (0.6297 => 0.5953, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.46% (0.6667 => 0.6303, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.46% (14.2083 => 13.4329, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.46% (0.7919 => 0.7487, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.45% (0.5575 => 0.5271, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.45% (0.6052 => 0.5722, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.45% (1.2784 => 1.2087, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.45% (0.6660 => 0.6297, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -5.45% (4.3330 => 4.0970, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.43% (0.5859 => 0.5541, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.43% (0.6230 => 0.5892, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.43% (0.6304 => 0.5962, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.42% (0.5569 => 0.5267, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.41% (0.6189 => 0.5854, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.41% (4.8802 => 4.6161, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.40% (0.5570 => 0.5269, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.40% (0.3406 => 0.3222, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.39% (0.5941 => 0.5621, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.38% (0.6260 => 0.5923, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.38% (0.5705 => 0.5398, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.37% (0.6293 => 0.5955, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.37% (0.3931 => 0.3720, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.36% (0.6676 => 0.6318, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.35% (0.8521 => 0.8065, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: -5.35% (0.4280 => 0.4051, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.34% (0.6736 => 0.6376, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.33% (0.6681 => 0.6325, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.31% (0.3255 => 0.3082, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.31% (4.0323 => 3.8183, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.31% (0.3016 => 0.2856, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -5.29% (0.3025 => 0.2865, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.28% (0.5567 => 0.5273, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.28% (1.3148 => 1.2454, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.27% (1.3864 => 1.3133, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.27% (0.3323 => 0.3148, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.25% (0.6395 => 0.6059, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -5.25% (17.1032 => 16.2046, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.25% (0.7524 => 0.7129, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.24% (0.3837 => 0.3636, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -5.22% (0.3026 => 0.2868, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.20% (0.4151 => 0.3935, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.20% (0.3483 => 0.3302, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.19% (0.7339 => 0.6958, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.18% (0.5999 => 0.5688, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.18% (0.2548 => 0.2416, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.18% (0.5581 => 0.5292, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.18% (2.1713 => 2.0589, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.17% (0.3057 => 0.2899, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.16% (8.0126 => 7.5989, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/objinst: -5.13% (0.3194 => 0.3030, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.13% (0.2985 => 0.2832, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.11% (0.2659 => 0.2523, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.11% (0.6033 => 0.5725, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: -5.10% (0.3059 => 0.2903, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -5.09% (15.5079 => 14.7181, std.dev.: 0.0172) MultiSource/Benchmarks/McCat/05-eks/eks: -5.07% (0.4515 => 0.4286, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -5.07% (3.5154 => 3.3372, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.05% (0.2278 => 0.2163, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.05% (0.2933 => 0.2785, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.04% (0.3252 => 0.3088, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.04% (1.2221 => 1.1605, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -5.03% (1.2515 => 1.1885, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.02% (0.2871 => 0.2727, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.00% (0.4916 => 0.4670, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.00% (0.2999 => 0.2849, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -5.00% (0.3481 => 0.3307, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.99% (0.2903 => 0.2758, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.98% (1.2210 => 1.1602, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: -4.97% (0.3581 => 0.3403, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -4.93% (0.2939 => 0.2794, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.91% (0.4321 => 0.4109, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -4.88% (0.2989 => 0.2843, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: -4.87% (0.4248 => 0.4041, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.84% (0.2849 => 0.2711, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -4.83% (0.4861 => 0.4626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.81% (0.3849 => 0.3664, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.78% (15.2527 => 14.5232, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: -4.78% (0.7447 => 0.7091, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: -4.76% (0.3446 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -4.75% (0.3621 => 0.3449, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -4.74% (0.3394 => 0.3233, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.72% (0.4813 => 0.4586, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.70% (22.4056 => 21.3517, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.70% (0.5857 => 0.5582, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -4.68% (4.0594 => 3.8696, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.65% (0.5478 => 0.5223, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: -4.65% (0.3867 => 0.3687, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.63% (1.6474 => 1.5711, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.59% (0.5168 => 0.4931, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.56% (0.6446 => 0.6152, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.55% (0.5849 => 0.5583, std.dev.: 0.0009) MultiSource/Applications/siod/siod: -4.51% (2.4021 => 2.2937, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.50% (0.5329 => 0.5089, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.47% (0.4427 => 0.4229, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.44% (0.7021 => 0.6709, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.44% (0.9557 => 0.9133, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.43% (0.4083 => 0.3902, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: -4.42% (5.0226 => 4.8007, std.dev.: 0.0045) MultiSource/Applications/treecc/treecc: -4.40% (2.1401 => 2.0460, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/sieve: -4.38% (0.3788 => 0.3622, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -4.36% (0.7982 => 0.7634, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.32% (0.8418 => 0.8054, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: -4.27% (18.2933 => 17.5119, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.27% (0.5456 => 0.5223, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: -4.27% (0.4524 => 0.4331, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -4.26% (34.0927 => 32.6405, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.25% (0.6440 => 0.6166, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -4.25% (0.3271 => 0.3132, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: -4.19% (0.6750 => 0.6467, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.16% (0.3319 => 0.3181, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.01% (0.3491 => 0.3351, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.96% (2.2587 => 2.1692, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.87% (0.9077 => 0.8726, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/Hello: -3.78% (0.6347 => 0.6107, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.75% (1.5610 => 1.5024, std.dev.: 0.0084) SingleSource/UnitTests/ObjC++/property-reference-object: -3.70% (0.6441 => 0.6203, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: -3.47% (0.7779 => 0.7509, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.15% (5.4682 => 5.2959, std.dev.: 0.0153) SingleSource/UnitTests/Vector/constpool: -2.49% (20.7746 => 20.2577, std.dev.: 0.0136) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1969, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -62.42% (1.8100 => 0.6802, std.dev.: 0.0077) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -23.35% (7.5137 => 5.7590, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1733, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.98% (2.2633 => 2.1733, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.78% (1.3096 => 1.2601, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.63% (6.5735 => 6.4666, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 19:23:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 21:23:33 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121129032333.3C3102A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6364?compare_to=6360&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6364, Order: 168829, Start Time: 2012-11-29 01:02:22, End Time: 2012-11-29 03:24:06 To: 6360, Order: 168806, Start Time: 2012-11-28 21:42:41, End Time: 2012-11-29 00:02:16 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 38 (134 on baseline) Performance Improvements: 5 (43 on baseline) Added Tests: 0 (184 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1045 (710 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.22% (0.4567 => 0.5262, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 15.05% (0.5902 => 0.6790, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 14.35% (0.7206 => 0.8240, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.31% (0.6710 => 0.7670, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 13.80% (0.5905 => 0.6720, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 13.67% (0.5912 => 0.6720, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: 13.55% (0.1454 => 0.1651, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 12.78% (0.0790 => 0.0891, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 12.32% (0.4010 => 0.4504, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.99% (2.2601 => 2.5311, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.53% (0.1168 => 0.1291, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.99% (0.1652 => 0.1817, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.02% (0.6222 => 0.6783, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.77% (0.5784 => 0.6291, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.67% (0.6712 => 0.7294, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.15% (0.3411 => 0.3689, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.95% (0.3473 => 0.3749, std.dev.: 0.0068) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.83% (0.3332 => 0.3593, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 7.70% (0.1325 => 0.1427, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/wc: 7.45% (0.3341 => 0.3590, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/sieve: 7.32% (0.4140 => 0.4443, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.18% (0.9542 => 1.0227, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.29% (0.4615 => 0.4859, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hello: 4.97% (0.3139 => 0.3295, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.83% (4.6932 => 4.9197, std.dev.: 0.0734) MultiSource/Applications/SPASS/SPASS: 2.90% (17.6027 => 18.1131, std.dev.: 0.1660) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 28.23% (1.5598 => 2.0001, std.dev.: 0.0218) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.43% (14.4248 => 17.3711, std.dev.: 0.7511) SingleSource/Benchmarks/CoyoteBench/lpbench: 19.27% (10.6367 => 12.6864, std.dev.: 0.0627) MultiSource/Applications/JM/ldecod/ldecod: 14.70% (0.1211 => 0.1389, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.34% (8.7078 => 9.6953, std.dev.: 0.1770) MultiSource/Applications/JM/lencod/lencod: 8.52% (7.5405 => 8.1833, std.dev.: 0.0452) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.03% (4.0250 => 4.2274, std.dev.: 0.0670) SingleSource/Benchmarks/Dhrystone/fldry: 4.93% (0.6526 => 0.6848, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 3.59% (4.5641 => 4.7281, std.dev.: 0.0150) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.35% (0.5764 => 0.5957, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.46% (5.6753 => 5.7580, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/sieve: 1.28% (2.4952 => 2.5272, std.dev.: 0.0106) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -16.68% (0.7590 => 0.6324, std.dev.: 0.0442) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -7.90% (0.2290 => 0.2109, std.dev.: 0.0052) SingleSource/UnitTests/ObjC++/property-reference-object: -4.31% (0.6889 => 0.6592, std.dev.: 0.0113) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.81% (7.3987 => 7.2645, std.dev.: 0.0504) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.02% (4.1888 => 4.1460, std.dev.: 0.0154) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -3.31% (69.1548 => 66.8682, std.dev.: 1.4273) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.15% (0.1339 => 0.1337, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0420 => 0.0420, std.dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0651 => 0.0651, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: -0.09% (494.0399 => 493.5793, std.dev.: 0.1787) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 5.73% (63.2438 => 66.8682, std.dev.: 1.4273) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43668.67% (1.1277 => 493.5793, std.dev.: 0.1787) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.00% (0.5229 => 1.5373, std.dev.: 0.0989) MultiSource/Applications/SPASS/SPASS: 20.84% (14.9895 => 18.1131, std.dev.: 0.1660) MultiSource/Applications/kimwitu++/kc: 46.33% (14.1553 => 20.7128, std.dev.: 0.8776) MultiSource/Benchmarks/MallocBench/gs/gs: 16.99% (4.1105 => 4.8090, std.dev.: 0.2480) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.84% (1.1048 => 1.5118, std.dev.: 0.0758) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 432.91% (7.1582 => 38.1469, std.dev.: 0.4270) SingleSource/Benchmarks/Misc-C++-EH/spirit: 75.14% (3.4629 => 6.0648, std.dev.: 0.3669) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.86% (0.6222 => 1.0320, std.dev.: 0.0636) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11265.69% (0.0720 => 8.1833, std.dev.: 0.0452) MultiSource/Applications/SIBsim4/SIBsim4: 3857100.00% (0.0001 => 3.8572, std.dev.: 0.0299) MultiSource/Applications/SPASS/SPASS: 14051500.00% (0.0001 => 14.0516, std.dev.: 1.4863) MultiSource/Applications/kimwitu++/kc: 53200.00% (0.0001 => 0.0533, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 595600.00% (0.0001 => 0.5957, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9976200.00% (0.0001 => 9.9763, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7238100.00% (0.0001 => 7.2382, std.dev.: 0.2285) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1808.01% (1.1194 => 21.3583, std.dev.: 0.4692) MultiSource/Applications/ClamAV/clamscan: 70.03% (22.1758 => 37.7046, std.dev.: 0.0527) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.45% (2.9384 => 4.6266, std.dev.: 0.3696) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.82% (7.0540 => 10.9914, std.dev.: 0.2624) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 48.65% (8.1363 => 12.0946, std.dev.: 0.1891) MultiSource/Applications/JM/lencod/lencod: 46.34% (21.9371 => 32.1021, std.dev.: 0.1706) MultiSource/Benchmarks/FreeBench/distray/distray: 44.89% (0.1056 => 0.1530, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops: 44.83% (0.1432 => 0.2074, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/almabench: 42.74% (0.0730 => 0.1042, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 32.59% (0.0672 => 0.0891, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/family/family: 32.24% (0.0397 => 0.0525, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/Oscar: 31.92% (0.0636 => 0.0839, std.dev.: 0.0024) SingleSource/UnitTests/vla: 29.86% (0.0355 => 0.0461, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones/fhourstones: 29.37% (0.1566 => 0.2026, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 28.25% (0.4103 => 0.5262, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.84% (0.0528 => 0.0675, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/messages-2: 27.49% (0.0662 => 0.0844, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 25.72% (0.3865 => 0.4859, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/functionobjects: 25.56% (0.5020 => 0.6303, std.dev.: 0.0227) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.15% (0.8172 => 1.0227, std.dev.: 0.0048) MultiSource/Benchmarks/NPB-serial/is/is: 25.03% (0.0719 => 0.0899, std.dev.: 0.0030) SingleSource/Benchmarks/Stanford/Towers: 24.20% (0.0471 => 0.0585, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/spellcheck: 24.17% (0.4203 => 0.5219, std.dev.: 0.0207) MultiSource/Applications/aha/aha: 23.98% (0.1151 => 0.1427, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.86% (0.0746 => 0.0924, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/life/life: 23.79% (0.0933 => 0.1155, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.59% (0.0479 => 0.0592, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.51% (0.1940 => 0.2396, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 23.40% (0.3650 => 0.4504, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/sieve: 23.31% (0.3603 => 0.4443, std.dev.: 0.0040) MultiSource/Applications/Burg/burg: 22.99% (1.1642 => 1.4319, std.dev.: 0.0405) SingleSource/Benchmarks/McGill/chomp: 22.96% (0.1655 => 0.2035, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/city/city: 22.48% (2.0665 => 2.5311, std.dev.: 0.0102) MultiSource/Benchmarks/McCat/08-main/main: 22.44% (0.2554 => 0.3127, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/wordfreq: 22.38% (0.3307 => 0.4047, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/lists: 22.00% (0.3422 => 0.4175, std.dev.: 0.0140) MultiSource/Benchmarks/nbench/nbench: 21.87% (1.1840 => 1.4429, std.dev.: 0.0156) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 21.63% (0.0467 => 0.0568, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 21.61% (1.0722 => 1.3039, std.dev.: 0.0441) SingleSource/Benchmarks/Shootout-C++/hello: 21.41% (0.2714 => 0.3295, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.17% (0.2758 => 0.3342, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.16% (0.2065 => 0.2502, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/tsp/tsp: 20.85% (0.1175 => 0.1420, std.dev.: 0.0057) MultiSource/Applications/d/make_dparser: 20.80% (3.3354 => 4.0291, std.dev.: 0.1344) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.55% (0.2107 => 0.2540, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 20.47% (0.1695 => 0.2042, std.dev.: 0.0087) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.45% (0.1584 => 0.1908, std.dev.: 0.0095) MultiSource/Applications/viterbi/viterbi: 20.45% (0.1555 => 0.1873, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/espresso/espresso: 20.29% (4.2646 => 5.1299, std.dev.: 0.1032) MultiSource/Applications/spiff/spiff: 20.24% (0.7835 => 0.9421, std.dev.: 0.0285) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 20.06% (0.5981 => 0.7181, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.05% (0.1117 => 0.1341, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.05% (0.5860 => 0.7035, std.dev.: 0.0331) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.24% (0.8067 => 0.9619, std.dev.: 0.0214) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.15% (0.2271 => 0.2706, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/bisort/bisort: 19.06% (0.0614 => 0.0731, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.92% (14.3668 => 17.0851, std.dev.: 0.3708) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.67% (0.1125 => 0.1335, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 18.56% (0.3162 => 0.3749, std.dev.: 0.0068) MultiSource/Applications/lua/lua: 18.14% (3.8723 => 4.5746, std.dev.: 0.1948) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.85% (1.1861 => 1.3978, std.dev.: 0.0492) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.63% (0.3136 => 0.3689, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/wc: 17.63% (0.3052 => 0.3590, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 17.59% (3.8922 => 4.5769, std.dev.: 0.1713) SingleSource/UnitTests/ObjC/parameter-passing: 17.55% (0.3927 => 0.4616, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.46% (0.0842 => 0.0989, std.dev.: 0.0040) SingleSource/UnitTests/SignlessTypes/rem: 17.40% (0.1144 => 0.1343, std.dev.: 0.0025) SingleSource/Benchmarks/Stanford/Puzzle: 17.27% (0.1268 => 0.1487, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 17.03% (0.2831 => 0.3313, std.dev.: 0.0134) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.88% (0.0871 => 0.1018, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/property: 16.78% (0.3886 => 0.4538, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/lists: 16.77% (0.0626 => 0.0731, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.55% (0.0834 => 0.0972, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 16.52% (0.2603 => 0.3033, std.dev.: 0.0121) SingleSource/UnitTests/ObjC/exceptions-3: 16.30% (0.3516 => 0.4089, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/for-in: 16.08% (0.3694 => 0.4288, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-4: 15.98% (0.3543 => 0.4109, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-2: 15.90% (0.3497 => 0.4053, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 15.89% (0.1114 => 0.1291, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions: 15.88% (0.3828 => 0.4436, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.81% (0.4636 => 0.5369, std.dev.: 0.0218) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.74% (0.0648 => 0.0750, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 15.53% (0.1906 => 0.2202, std.dev.: 0.0089) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.50% (0.3543 => 0.4092, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.35% (0.0886 => 0.1022, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.32% (0.0770 => 0.0888, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/health/health: 15.22% (0.1268 => 0.1461, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/synchronized: 15.05% (0.3561 => 0.4097, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.94% (0.0770 => 0.0885, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.93% (0.3121 => 0.3587, std.dev.: 0.0170) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.70% (0.1143 => 0.1311, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: 14.65% (0.1440 => 0.1651, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.99% (0.1337 => 0.1524, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.75% (0.1062 => 0.1208, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.51% (0.1029 => 0.1168, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.38% (0.9765 => 1.1072, std.dev.: 0.0477) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 13.09% (0.3177 => 0.3593, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.05% (0.1510 => 0.1707, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/trivial-interface: 12.53% (0.3473 => 0.3908, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.82% (0.1625 => 0.1817, std.dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: 11.67% (9.4845 => 10.5914, std.dev.: 0.3369) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.47% (0.1892 => 0.2109, std.dev.: 0.0052) SingleSource/UnitTests/ObjC++/property-reference-object: 9.32% (0.6030 => 0.6592, std.dev.: 0.0113) SingleSource/UnitTests/ObjC++/Hello: 9.32% (0.5925 => 0.6477, std.dev.: 0.0116) SingleSource/UnitTests/ObjC++/property-reference: 8.93% (0.7326 => 0.7980, std.dev.: 0.0216) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 150.70% (4.3953 => 11.0189, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/methcall: 147.55% (5.3999 => 13.3673, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/dbms/dbms: 32.58% (1.5086 => 2.0001, std.dev.: 0.0218) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 29.26% (13.4384 => 17.3711, std.dev.: 0.7511) SingleSource/Benchmarks/CoyoteBench/lpbench: 22.62% (10.3460 => 12.6864, std.dev.: 0.0627) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.45% (1.1145 => 1.3090, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/oourafft: 16.28% (6.6465 => 7.7283, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.98% (0.2944 => 0.3326, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.65% (2.8904 => 3.2272, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: 10.16% (1.1396 => 1.2554, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.71% (3.8532 => 4.2274, std.dev.: 0.0670) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.24% (1.7254 => 1.8848, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.99% (4.2280 => 4.4813, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0009) SingleSource/Regression/C/uint64_to_float: 5.04% (0.5413 => 0.5686, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 4.27% (26.0924 => 27.2070, std.dev.: 0.3649) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.6436 => 12.1000, std.dev.: 0.0163) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.32% (0.4162 => 0.4300, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 2.13% (85.0658 => 86.8752, std.dev.: 0.0159) MultiSource/Applications/aha/aha: 2.10% (3.1595 => 3.2258, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.90% (2.1424 => 2.1830, std.dev.: 0.0126) MultiSource/Applications/sqlite3/sqlite3: 1.81% (4.6441 => 4.7281, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/sieve: 1.67% (2.4858 => 2.5272, std.dev.: 0.0106) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.47% (6.5088 => 6.6042, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.27% (1.0313 => 1.0444, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.24% (5.2139 => 5.2784, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0504, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 1.04% (5.2636 => 5.3183, std.dev.: 0.0081) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1673, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.65% (5.2763 => 1.2319, std.dev.: 0.0506) SingleSource/Benchmarks/Misc/salsa20: -75.39% (0.8651 => 0.2129, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/richards_benchmark: -40.20% (0.1622 => 0.0970, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.00% (5.3526 => 4.8175, std.dev.: 0.1206) MultiSource/Applications/JM/ldecod/ldecod: -9.59% (10.4361 => 9.4356, std.dev.: 0.3053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.65% (5.3855 => 4.9197, std.dev.: 0.0734) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -68.63% (32.5116 => 10.1992, std.dev.: 0.0292) SingleSource/Benchmarks/Dhrystone/fldry: -65.02% (1.9577 => 0.6848, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1682) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.36% (0.3987 => 0.2378, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.92% (0.0506 => 0.0304, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.28% (4.5009 => 2.7781, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: -33.54% (1.1492 => 0.7638, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.11% (2.6546 => 2.0147, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/mason/mason: -19.20% (0.2161 => 0.1746, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4257, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2840, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -10.33% (9.5636 => 8.5753, std.dev.: 0.1517) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4244, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.30% (1.6805 => 1.5410, std.dev.: 0.0371) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.95% (4.8142 => 4.4798, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.93% (19.9488 => 18.5670, std.dev.: 0.3922) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.79% (3.2416 => 3.0215, std.dev.: 0.0280) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.73% (0.3463 => 0.3230, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7497, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.13% (0.8614 => 0.8172, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5054, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: -4.24% (6.2999 => 6.0327, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.43% (0.9957 => 0.9615, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.43% (0.4808 => 0.4643, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8912, std.dev.: 0.0042) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.89% (8.1563 => 8.0018, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -1.54% (10.2830 => 10.1249, std.dev.: 0.0052) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.97% (0.1485 => 0.1337, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0023) Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 19:26:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 21:26:58 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121129032658.10BF12A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6365?compare_to=6362&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6365, Order: 168846, Start Time: 2012-11-29 01:53:41, End Time: 2012-11-29 03:27:33 To: 6362, Order: 168829, Start Time: 2012-11-29 00:00:39, End Time: 2012-11-29 01:35:38 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 1 (2 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 7 (78 on baseline) Performance Improvements: 67 (44 on baseline) Added Tests: 1 (51 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 977 (851 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.86% (40.4108 => 42.7777, std.dev.: 0.7161) SingleSource/Benchmarks/Shootout/random: 3.59% (2.3892 => 2.4749, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.23% (2.4280 => 2.5065, std.dev.: 0.0214) MultiSource/Applications/JM/lencod/lencod: 2.87% (6.7078 => 6.9004, std.dev.: 0.0560) SingleSource/Benchmarks/Shootout/ary3: 1.66% (2.0931 => 2.1278, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout/lists: 1.18% (7.3312 => 7.4177, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/lists: 1.15% (16.6999 => 16.8926, std.dev.: 0.0707) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/15-trie/trie: -32.82% (0.0850 => 0.0571, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/ks/ks: -32.71% (0.2360 => 0.1588, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -24.35% (0.1228 => 0.0929, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/18-imp/imp: -22.69% (0.4721 => 0.3650, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -21.45% (0.7761 => 0.6096, std.dev.: 0.0136) MultiSource/Benchmarks/McCat/05-eks/eks: -19.69% (0.5577 => 0.4479, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/ft/ft: -19.28% (0.2464 => 0.1989, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -18.33% (1.5814 => 1.2916, std.dev.: 0.0158) MultiSource/Benchmarks/MallocBench/gs/gs: -17.09% (5.1896 => 4.3029, std.dev.: 0.0678) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -16.57% (10.6594 => 8.8936, std.dev.: 0.0881) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.68% (0.7555 => 0.6370, std.dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: -15.54% (0.0772 => 0.0652, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: -14.49% (0.3851 => 0.3293, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -13.64% (0.0997 => 0.0861, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: -13.45% (5.3125 => 4.5981, std.dev.: 0.0494) MultiSource/Benchmarks/Olden/bh/bh: -12.68% (0.3556 => 0.3105, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/distray/distray: -10.97% (0.1085 => 0.0966, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -10.57% (0.2639 => 0.2360, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -10.53% (0.3921 => 0.3508, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -9.99% (0.1021 => 0.0919, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -9.10% (0.2539 => 0.2308, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/pifft/pifft: -8.80% (1.0000 => 0.9120, std.dev.: 0.0216) MultiSource/Benchmarks/Fhourstones/fhourstones: -8.40% (0.1761 => 0.1613, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -7.46% (1.4871 => 1.3762, std.dev.: 0.0221) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.23% (0.3071 => 0.2849, std.dev.: 0.0076) MultiSource/Applications/kimwitu++/kc: -6.81% (19.2304 => 17.9209, std.dev.: 0.4244) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -6.39% (0.7091 => 0.6638, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/em3d/em3d: -6.36% (0.1935 => 0.1812, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.77% (0.2532 => 0.2386, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.40% (4.8603 => 4.5979, std.dev.: 0.0728) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.05% (0.4690 => 0.4500, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -3.72% (4.7677 => 4.5903, std.dev.: 0.0589) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.12% (0.3942 => 0.3819, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.91% (0.9041 => 0.8778, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -2.76% (1.3386 => 1.3017, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.65% (0.8895 => 0.8659, std.dev.: 0.0086) MultiSource/Applications/SIBsim4/SIBsim4: -2.58% (1.3348 => 1.3004, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.46% (1.2334 => 1.2030, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -2.46% (1.7545 => 1.7113, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -2.16% (0.9152 => 0.8954, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: -1.96% (1.2032 => 1.1796, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.42% (14.1215 => 13.9208, std.dev.: 0.0756) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.38% (0.8977 => 0.8853, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.25% (0.8881 => 0.8770, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -50.43% (0.0349 => 0.0173, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ft/ft: -29.10% (1.2448 => 0.8826, std.dev.: 0.1130) MultiSource/Benchmarks/MallocBench/gs/gs: -27.45% (0.1053 => 0.0764, std.dev.: 0.0062) MultiSource/Benchmarks/Fhourstones/fhourstones: -19.21% (1.5451 => 1.2483, std.dev.: 0.0476) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -16.96% (1.4968 => 1.2429, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.32% (0.0901 => 0.0772, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: -11.13% (0.1886 => 0.1676, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/18-imp/imp: -6.73% (0.1501 => 0.1400, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -4.23% (5.0638 => 4.8495, std.dev.: 0.0812) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.82% (2.5219 => 2.4255, std.dev.: 0.0290) MultiSource/Benchmarks/llubenchmark/llu: -3.64% (2.0956 => 2.0194, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/ks/ks: -3.61% (1.2013 => 1.1579, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.12% (0.4263 => 0.4130, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -2.96% (3.8440 => 3.7301, std.dev.: 0.0403) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -2.16% (4.5212 => 4.4236, std.dev.: 0.0376) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.05% (6.0006 => 5.8775, std.dev.: 0.0067) MultiSource/Applications/SIBsim4/SIBsim4: -1.99% (3.2638 => 3.1990, std.dev.: 0.0231) MultiSource/Benchmarks/Olden/bh/bh: -1.96% (2.4391 => 2.3914, std.dev.: 0.0146) MultiSource/Benchmarks/FreeBench/mason/mason: -1.91% (0.5509 => 0.5404, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.90% (39.9700 => 39.2122, std.dev.: 0.1711) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.75% (0.9833 => 0.9661, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.73% (4.6085 => 4.5288, std.dev.: 0.0258) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.12% (1.1492 => 1.1363, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.49% (1.0965 => 1.1019, std.dev.: 0.2523) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.02% (0.3710 => 0.3785, std.dev.: 0.1236) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.31% (0.0216 => 0.0221, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0426 => 0.0428, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.90% (0.0332 => 0.0335, std.dev.: 0.0082) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0313 => 0.0314, std.dev.: 0.0070) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0423 => 0.0423, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/casts: 2.96% (0.0203 => 0.0209, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 0.92% (0.0217 => 0.0219, std.dev.: 0.0071) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 55.56% (0.0009 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -12.36% (0.1667 => 0.1461, std.dev.: 0.0061) MultiSource/Applications/lemon/lemon: -14.02% (1.3686 => 1.1767, std.dev.: 0.1153) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -11.84% (0.4552 => 0.4013, std.dev.: 0.0659) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -7.56% (0.1626 => 0.1503, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.55% (0.0620 => 0.0642, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.75% (0.0267 => 0.0269, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.18% (0.0568 => 0.0569, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.03% (1.1493 => 1.1496, std.dev.: 0.0053) MultiSource/Benchmarks/SciMark2-C/scimark2: -0.03% (9.3987 => 9.3961, std.dev.: 0.0207) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.67% (0.0030 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.56% (0.0606 => 0.0542, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -34.98% (0.0263 => 0.0171, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.57% (0.8039 => 0.8165, std.dev.: 0.0388) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 8.33% (0.0060 => 0.0065, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Benchmarks/SciMark2-C/scimark2: -67.13% (28.5821 => 9.3961, std.dev.: 0.0207) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.97% (16.4461 => 17.9209, std.dev.: 0.4244) MultiSource/Applications/sqlite3/sqlite3: 2345.63% (0.6332 => 15.4857, std.dev.: 0.8714) MultiSource/Benchmarks/McCat/08-main/main: 47.68% (0.1831 => 0.2704, std.dev.: 0.0842) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.93% (0.1559 => 0.1451, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7260.61% (0.3123 => 22.9872, std.dev.: 0.6543) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1556.37% (0.3344 => 5.5389, std.dev.: 0.2446) SingleSource/Benchmarks/Misc-C++/Large/ray: 39.21% (0.2364 => 0.3291, std.dev.: 0.0669) SingleSource/Benchmarks/Misc-C++/bigfib: 5.66% (0.6010 => 0.6350, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/mandel: 6.29% (0.0429 => 0.0456, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.12% (0.3266 => 0.3564, std.dev.: 0.0901) SingleSource/Benchmarks/Shootout-C++/strcat: 4.98% (0.1969 => 0.2067, std.dev.: 0.0023) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.14% (0.0224 => 0.0240, std.dev.: 0.0075) SingleSource/UnitTests/byval-alignment: -31.74% (0.0230 => 0.0157, std.dev.: 0.0052) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0468, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 12.11% (0.1462 => 0.1639, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4108, std.dev.: 0.0585) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0743, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4938, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5208, std.dev.: 0.0438) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2779, std.dev.: 0.0207) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1010, std.dev.: 0.0565) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3623, std.dev.: 0.0247) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3773, std.dev.: 0.0206) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0828, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: -29.71% (2.1832 => 1.5345, std.dev.: 0.0337) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0003, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.68% (0.0848 => 0.0964, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.46% (0.0810 => 0.0919, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 13.31% (0.1112 => 0.1260, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.64% (2.1401 => 2.3465, std.dev.: 0.0590) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.04% (0.4127 => 0.4500, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.77% (3.1832 => 3.4625, std.dev.: 0.1033) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.32% (0.1466 => 0.1588, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.26% (0.2180 => 0.2360, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.46% (0.3295 => 0.3508, std.dev.: 0.0055) MultiSource/Benchmarks/sim/sim: 6.32% (0.3226 => 0.3430, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/ReedSolomon: 5.93% (0.1839 => 0.1948, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.61% (13.1811 => 13.9208, std.dev.: 0.0756) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.58% (0.6287 => 0.6638, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.56% (0.2519 => 0.2659, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.49% (0.8321 => 0.8778, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.28% (0.5191 => 0.5465, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.19% (0.9688 => 1.0191, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.70% (0.2998 => 0.3139, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.70% (0.2279 => 0.2386, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.68% (0.8457 => 0.8853, std.dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 4.66% (1.1271 => 1.1796, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.66% (0.8611 => 0.9012, std.dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.61% (1.1170 => 1.1685, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.44% (1.6386 => 1.7113, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/18-imp/imp: 4.20% (0.3503 => 0.3650, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.17% (0.9056 => 0.9434, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.16% (0.8420 => 0.8770, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 4.15% (0.8597 => 0.8954, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.12% (0.8316 => 0.8659, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/bh/bh: 4.02% (0.2985 => 0.3105, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.97% (0.8286 => 0.8615, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.92% (1.2526 => 1.3017, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/hash: 3.84% (0.3800 => 0.3946, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists1: 3.84% (0.2969 => 0.3083, std.dev.: 0.0042) MultiSource/Applications/SIBsim4/SIBsim4: 3.47% (1.2568 => 1.3004, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.32% (0.4783 => 0.4942, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.95% (1.1685 => 1.2030, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.84% (8.6476 => 8.8936, std.dev.: 0.0881) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.74% (0.3717 => 0.3819, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 54.27% (0.0199 => 0.0307, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/pi: 40.35% (1.5795 => 2.2168, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 28.20% (2.9096 => 3.7301, std.dev.: 0.0403) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.03% (4.8436 => 5.8620, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.91% (8.2783 => 9.7612, std.dev.: 0.0240) SingleSource/Benchmarks/McGill/misr: 16.90% (0.4001 => 0.4677, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.77% (0.7597 => 0.8871, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.95% (14.6451 => 16.8348, std.dev.: 0.3333) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.66% (2.7995 => 3.1260, std.dev.: 0.0043) MultiSource/Applications/lambda-0_1_3/lambda: 10.49% (7.4933 => 8.2793, std.dev.: 0.0152) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.26% (1.1857 => 1.3074, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.21% (6.3772 => 7.0281, std.dev.: 0.2132) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.99% (3.9917 => 4.3108, std.dev.: 0.0836) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.49% (23.5781 => 25.3444, std.dev.: 0.0699) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.30% (3.3761 => 3.5887, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.97% (2.9753 => 3.1528, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.96% (4.8660 => 5.1560, std.dev.: 0.0265) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.80% (4.5327 => 4.7958, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.46% (0.3937 => 0.4152, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.33% (5.3218 => 5.6053, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.31% (5.4187 => 5.7064, std.dev.: 0.0401) MultiSource/Applications/aha/aha: 5.04% (3.3398 => 3.5082, std.dev.: 0.0199) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 4.85% (0.4353 => 0.4564, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.45% (0.5214 => 0.5446, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/whetstone: 4.34% (2.1224 => 2.2145, std.dev.: 0.0288) MultiSource/Benchmarks/Olden/power/power: 2.94% (1.2061 => 1.2416, std.dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 2.89% (6.7064 => 6.9004, std.dev.: 0.0560) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.63% (0.6150 => 0.6312, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.36% (3.4104 => 3.4910, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.35% (2.4490 => 2.5065, std.dev.: 0.0214) SingleSource/Benchmarks/McGill/queens: 2.01% (1.7056 => 1.7399, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.71% (11.5690 => 11.7668, std.dev.: 0.0197) SingleSource/Benchmarks/Shootout/methcall: 1.65% (8.2676 => 8.4043, std.dev.: 0.0434) SingleSource/Benchmarks/Shootout/ary3: 1.57% (2.0949 => 2.1278, std.dev.: 0.0105) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.35% (2.5763 => 2.6112, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/ReedSolomon: 1.34% (8.5322 => 8.6467, std.dev.: 0.0019) MultiSource/Benchmarks/llubenchmark/llu: 1.14% (1.9967 => 2.0194, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/lists: 1.09% (7.3375 => 7.4177, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-7: 1.05% (1.7156 => 1.7336, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.17% (2.8951 => 1.6742, std.dev.: 0.0254) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -25.31% (7.2130 => 5.3877, std.dev.: 0.0487) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.30% (1.4529 => 1.1579, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -17.10% (9.9065 => 8.2128, std.dev.: 0.0195) MultiSource/Benchmarks/Olden/em3d/em3d: -12.96% (5.4641 => 4.7557, std.dev.: 0.1072) SingleSource/Benchmarks/Shootout-C++/ary3: -10.12% (1.9999 => 1.7976, std.dev.: 0.0715) SingleSource/Benchmarks/Misc/flops-8: -9.43% (2.5609 => 2.3193, std.dev.: 0.0086) SingleSource/Benchmarks/McGill/chomp: -9.42% (1.1216 => 1.0160, std.dev.: 0.0194) MultiSource/Benchmarks/mafft/pairlocalalign: -8.98% (63.1822 => 57.5070, std.dev.: 0.1314) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.35% (0.3269 => 0.2996, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.10% (1.0512 => 0.9661, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -6.35% (3.2169 => 3.0125, std.dev.: 0.0601) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.24% (4.7482 => 4.4521, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.10% (5.1305 => 4.8174, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/sieve: -5.93% (7.0599 => 6.6415, std.dev.: 0.0449) SingleSource/Benchmarks/Stanford/FloatMM: -5.73% (0.8807 => 0.8302, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.45% (6.2275 => 5.8883, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops: -5.40% (9.3748 => 8.8690, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.81% (5.6343 => 5.3633, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.71% (3.9188 => 3.7341, std.dev.: 0.0437) SingleSource/Benchmarks/Misc/himenobmtxpa: -4.61% (4.3552 => 4.1543, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.55% (4.7449 => 4.5288, std.dev.: 0.0258) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.45% (6.1706 => 5.8960, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.39% (4.9453 => 4.7280, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/ffbench: -4.25% (1.4296 => 1.3689, std.dev.: 0.0139) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.11% (2.8773 => 2.7589, std.dev.: 0.0440) MultiSource/Applications/siod/siod: -3.97% (3.6643 => 3.5187, std.dev.: 0.0296) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.97% (1.3882 => 1.3331, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.81% (3.7148 => 3.5731, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/perlin: -3.74% (5.1084 => 4.9173, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.61% (5.1557 => 4.9698, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/methcall: -3.45% (8.9760 => 8.6665, std.dev.: 0.0613) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.18% (4.9686 => 4.8108, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.17% (5.4300 => 5.2578, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -2.12% (3.3840 => 3.3123, std.dev.: 0.0184) MultiSource/Benchmarks/FreeBench/neural/neural: -1.90% (1.0841 => 1.0635, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-5: -1.83% (2.8957 => 2.8428, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.74% (3.3479 => 3.2897, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/tsp/tsp: -1.74% (1.4861 => 1.4603, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.70% (3.5679 => 3.5071, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/fp-convert: -1.51% (15.8853 => 15.6451, std.dev.: 0.0328) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.19% (4.2466 => 4.1959, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.15% (4.7794 => 4.7244, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.13% (6.0224 => 5.9544, std.dev.: 0.0219) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 7.38% (1.0262 => 1.1019, std.dev.: 0.2523) SingleSource/Benchmarks/CoyoteBench/fftbench: 53.67% (0.2463 => 0.3785, std.dev.: 0.1236) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 79.67% (0.0123 => 0.0221, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.89% (0.0254 => 0.0335, std.dev.: 0.0082) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0070) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/casts: 10.00% (0.0190 => 0.0209, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0071) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 100.00% (0.0007 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.60% (0.1438 => 0.1461, std.dev.: 0.0061) MultiSource/Applications/lemon/lemon: 3.87% (1.1329 => 1.1767, std.dev.: 0.1153) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.63% (0.4164 => 0.4013, std.dev.: 0.0659) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.79% (0.1369 => 0.1503, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.16% (0.0641 => 0.0642, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 37.95% (0.0195 => 0.0269, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.56% (0.0578 => 0.0569, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.52% (1.1437 => 1.1496, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.56% (0.0627 => 0.0542, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.00% (0.0180 => 0.0171, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.85% (0.8017 => 0.8165, std.dev.: 0.0388) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 4.84% (0.0062 => 0.0065, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 20:00:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 22:00:35 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121129040035.30AEC2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6366?compare_to=6359&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6366, Order: 168829, Start Time: 2012-11-29 00:39:48, End Time: 2012-11-29 04:01:09 To: 6359, Order: 168806, Start Time: 2012-11-28 20:30:16, End Time: 2012-11-28 23:51:29 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (179 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (184 on baseline) Unchanged Tests: 1090 (713 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.76% (0.6195 => 0.6304, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.94% (80.4428 => 83.6122, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/health/health: 2.53% (0.6284 => 0.6443, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.92% (128.9120 => 123.8592, std.dev.: 1.4729) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.12% (0.0625 => 0.0882, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.21% (0.1063 => 0.1416, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.20% (0.4253 => 0.5410, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.05% (0.2969 => 0.3772, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.58% (0.1106 => 0.1400, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.23% (0.4994 => 0.6304, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.77% (0.0714 => 0.0898, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.51% (0.4139 => 0.5195, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.24% (0.5900 => 0.7389, std.dev.: 0.0115) MultiSource/Applications/oggenc/oggenc: 24.62% (1.5932 => 1.9854, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.42% (0.0475 => 0.0591, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.34% (0.0415 => 0.0516, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.77% (0.0547 => 0.0677, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.63% (0.0584 => 0.0722, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.42% (0.5000 => 0.6171, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.21% (0.1021 => 0.1258, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.96% (0.1620 => 0.1992, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.67% (0.1107 => 0.1358, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.63% (0.0897 => 0.1100, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 22.54% (0.0599 => 0.0734, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.65% (0.0642 => 0.0781, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 21.52% (0.0948 => 0.1152, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.48% (0.0633 => 0.0769, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.44% (0.0541 => 0.0657, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.40% (0.0584 => 0.0709, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.40% (0.1103 => 0.1339, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.21% (0.0495 => 0.0600, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.14% (0.1003 => 0.1215, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.01% (0.3903 => 0.4723, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.82% (0.1604 => 0.1938, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.80% (0.0822 => 0.0993, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.79% (0.1549 => 0.1871, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 20.71% (0.0821 => 0.0991, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 20.53% (0.0604 => 0.0728, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 20.44% (0.1619 => 0.1950, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 19.96% (0.0947 => 0.1136, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 19.87% (0.1505 => 0.1804, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 19.80% (0.0808 => 0.0968, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.77% (0.1462 => 0.1751, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.41% (0.2014 => 0.2405, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.41% (0.3890 => 0.4645, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.95% (0.1968 => 0.2341, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.93% (0.1088 => 0.1294, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 18.80% (0.1218 => 0.1447, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.74% (1.3152 => 1.5617, std.dev.: 0.0068) MultiSource/Applications/spiff/spiff: 18.64% (0.4029 => 0.4780, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.60% (0.2736 => 0.3245, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 18.48% (0.0698 => 0.0827, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.35% (0.0605 => 0.0716, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.25% (0.2866 => 0.3389, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 18.25% (0.5826 => 0.6889, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 18.22% (0.5889 => 0.6962, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.18% (0.0572 => 0.0676, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.03% (3.5627 => 4.2050, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 17.98% (1.8794 => 2.2174, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.98% (0.0573 => 0.0676) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.69% (0.4658 => 0.5482, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 17.69% (0.5546 => 0.6527, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: 17.56% (0.9697 => 1.1400, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.51% (1.6211 => 1.9050, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.36% (0.3271 => 0.3839, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.31% (0.5026 => 0.5896, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.24% (0.1160 => 0.1360, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.22% (0.2875 => 0.3370, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 17.17% (0.1421 => 0.1665, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.11% (0.4361 => 0.5107, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 17.03% (0.7171 => 0.8392, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.99% (2.7292 => 3.1929, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 16.95% (0.2566 => 0.3001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.95% (0.2738 => 0.3202, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 16.91% (0.2714 => 0.3173, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 16.88% (0.2725 => 0.3185, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 16.83% (1.0781 => 1.2595, std.dev.: 0.0089) MultiSource/Applications/ClamAV/clamscan: 16.78% (4.2109 => 4.9173, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.75% (0.2729 => 0.3186, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 16.74% (0.1284 => 0.1499, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.70% (4.4195 => 5.1574, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/matrix: 16.69% (0.2780 => 0.3244, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.66% (0.2911 => 0.3396, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.59% (0.3930 => 0.4582, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 16.53% (0.2813 => 0.3278, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 16.51% (0.2750 => 0.3204, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 16.51% (0.2811 => 0.3275, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.48% (0.2792 => 0.3252, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 16.45% (0.2803 => 0.3264, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 16.44% (0.3096 => 0.3605, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 16.44% (0.2823 => 0.3287, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.38% (2.0673 => 2.4059, std.dev.: 0.0046) SingleSource/Regression/C++/ofstream_ctor: 16.38% (0.3004 => 0.3496, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.35% (1.9694 => 2.2913, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 16.34% (0.9909 => 1.1528, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.15% (0.3195 => 0.3711, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.92% (1.9966 => 2.3145, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary3: 15.86% (0.3267 => 0.3785, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 15.76% (0.2075 => 0.2402, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 15.72% (0.3258 => 0.3770, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.69% (0.1090 => 0.1261, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.65% (0.3060 => 0.3539, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.59% (0.3362 => 0.3886, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 15.44% (0.3317 => 0.3829, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 15.19% (0.3477 => 0.4005, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 15.12% (0.3678 => 0.4234, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.08% (0.3282 => 0.3777, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.04% (0.3124 => 0.3594, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 15.01% (0.2691 => 0.3095, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 15.01% (0.3465 => 0.3985, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 15.00% (23.5202 => 27.0484, std.dev.: 0.0277) SingleSource/Benchmarks/Shootout-C++/hash: 14.98% (0.4146 => 0.4767, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 14.96% (0.3348 => 0.3849, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 14.90% (0.3726 => 0.4281, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 14.89% (0.3446 => 0.3959, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 14.87% (0.3469 => 0.3985, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-3: 14.86% (0.3460 => 0.3974, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.85% (0.3488 => 0.4006, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 14.85% (0.3496 => 0.4015, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 14.77% (1.4269 => 1.6377, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 14.73% (0.3442 => 0.3949, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 14.64% (0.0758 => 0.0869, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 14.58% (0.7875 => 0.9023, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.51% (0.3625 => 0.4151, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 14.44% (0.3650 => 0.4177, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/exceptions: 14.38% (0.3643 => 0.4167, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 14.35% (0.4251 => 0.4861, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.34% (0.3981 => 0.4552, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 14.31% (2.1013 => 2.4021, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 14.31% (2.1653 => 2.4751, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 14.23% (0.3724 => 0.4254, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.23% (0.3690 => 0.4215, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.22% (0.2040 => 0.2330, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.17% (0.3845 => 0.4390, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 13.76% (4.6177 => 5.2533, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/bigfib: 13.31% (0.5012 => 0.5679, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 12.92% (0.3498 => 0.3950, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.65% (0.1383 => 0.1558, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.49% (0.6435 => 0.7239, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 12.33% (5.5417 => 6.2249, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 11.73% (0.6634 => 0.7412, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.51% (0.2068 => 0.2306, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 11.31% (0.4847 => 0.5395, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.22% (0.2737 => 0.3044, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.19% (0.1028 => 0.1143, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.83% (0.3084 => 0.3418, std.dev.: 0.0090) MultiSource/Applications/sqlite3/sqlite3: 10.77% (2.0346 => 2.2537, std.dev.: 0.0044) MultiSource/Applications/lemon/lemon: 10.66% (0.2391 => 0.2646, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 10.52% (0.3336 => 0.3687, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.08% (0.2103 => 0.2315, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.27% (0.5361 => 0.5858, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.79% (11.6398 => 12.6634, std.dev.: 0.0126) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.59% (4.6926 => 5.0955, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.56% (0.7426 => 0.8062, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.31% (0.5584 => 0.6048, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 7.08% (11.9555 => 12.8023, std.dev.: 0.0114) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.46% (0.3792 => 0.3999, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.99% (29.0505 => 33.4059, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 9.17% (0.2802 => 0.3059, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6120, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 5.47% (0.2122 => 0.2238, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6693, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-2: 4.96% (1.8057 => 1.8952, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1653, std.dev.: 0.0492) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.60% (79.9355 => 83.6122, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/dry: 4.17% (14.0481 => 14.6334, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.25% (0.3693 => 0.3813, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/health/health: 2.66% (0.6276 => 0.6443, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1966, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2224, std.dev.: 0.0035) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3061, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2889, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0015) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5797, std.dev.: 0.0128) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.09% (2.4764 => 2.4247, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.74% (25.4195 => 16.5882, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/ary2: -8.08% (0.2402 => 0.2208, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9767, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8042, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8046, std.dev.: 0.0025) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7729, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -2.97% (17.2379 => 16.7261, std.dev.: 0.1082) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.57% (0.6293 => 0.6131, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8608, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5717, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4949, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.2043, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0440, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 21:19:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 23:19:17 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121129051917.3C4162A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6367?compare_to=6365&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6367, Order: 168851, Start Time: 2012-11-29 03:46:07, End Time: 2012-11-29 05:19:51 To: 6365, Order: 168846, Start Time: 2012-11-29 01:53:41, End Time: 2012-11-29 03:27:33 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 18 (123 on baseline) Performance Improvements: 2 (37 on baseline) Added Tests: 0 (51 on baseline) Existing Failures: 42 (40 on baseline) Unchanged Tests: 1032 (813 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.74% (0.2039 => 0.2156, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.85% (0.2308 => 0.2420, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.64% (1.2030 => 1.2468, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.53% (0.9807 => 1.0153, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 3.18% (0.6918 => 0.7138, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.08% (0.6370 => 0.6566, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.78% (0.8778 => 0.9022, std.dev.: 0.0094) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.10% (6.7317 => 6.8728, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.69% (4.5979 => 4.6758, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.22% (4.3426 => 4.3957, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/football/football: 1.22% (0.9168 => 0.9280, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.20% (4.5903 => 4.6453, std.dev.: 0.0104) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: 49.43% (35.3477 => 52.8215, std.dev.: 0.0990) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.26% (0.3425 => 0.3605, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.69% (4.8495 => 5.0286, std.dev.: 0.0117) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.32% (1.3331 => 1.3640, std.dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.25% (16.8348 => 17.2132, std.dev.: 0.0943) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.01% (1.8594 => 1.8782, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.19% (23.1546 => 22.1848, std.dev.: 0.3325) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.97% (2.5065 => 2.4321, std.dev.: 0.0106) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.97% (1.1019 => 1.0802, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.46% (0.3785 => 0.3692, std.dev.: 0.0678) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0221 => 0.0221, std.dev.: 0.0072) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0428 => 0.0429, std.dev.: 0.0140) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0335 => 0.0335, std.dev.: 0.0102) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0314 => 0.0314, std.dev.: 0.0110) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.65% (0.0423 => 0.0430, std.dev.: 0.0129) SingleSource/UnitTests/Vector/Altivec/casts: -2.39% (0.0209 => 0.0204, std.dev.: 0.0077) SingleSource/UnitTests/Vector/Altivec/test1: 0.46% (0.0219 => 0.0220, std.dev.: 0.0071) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -1.30% (0.1461 => 0.1442, std.dev.: 0.0025) MultiSource/Applications/lemon/lemon: -8.07% (1.1767 => 1.0817, std.dev.: 0.0516) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.17% (0.4013 => 0.3966, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.52% (0.1503 => 0.1420, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.49% (0.0642 => 0.0626, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -28.25% (0.0269 => 0.0193, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.11% (0.0569 => 0.0557, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.25% (1.1496 => 1.1467, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: -0.02% (9.3961 => 9.3940, std.dev.: 0.0146) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.03% (0.0542 => 0.0553, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 21.64% (0.0171 => 0.0208, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.65% (0.8165 => 0.8112, std.dev.: 0.0099) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: 300.00% (0.0002 => 0.0008, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 47.69% (0.0065 => 0.0096, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.00% (34.5134 => 34.5129, std.dev.: 0.0102) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Benchmarks/SciMark2-C/scimark2: -67.13% (28.5821 => 9.3940, std.dev.: 0.0146) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.51% (16.4461 => 17.8464, std.dev.: 0.0691) MultiSource/Applications/sqlite3/sqlite3: 2348.53% (0.6332 => 15.5041, std.dev.: 0.0165) MultiSource/Benchmarks/McCat/08-main/main: 45.60% (0.1831 => 0.2666, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.95% (0.1559 => 0.1435, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7167.28% (0.3123 => 22.6957, std.dev.: 0.9680) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1574.97% (0.3344 => 5.6011, std.dev.: 0.1952) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.79% (0.2364 => 0.3281, std.dev.: 0.0200) SingleSource/Benchmarks/Misc-C++/bigfib: 6.12% (0.6010 => 0.6378, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/mandel: 2.80% (0.0429 => 0.0441, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.59% (0.3266 => 0.3416, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/strcat: 3.10% (0.1969 => 0.2030, std.dev.: 0.0070) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 12.05% (0.0224 => 0.0251, std.dev.: 0.0081) SingleSource/UnitTests/byval-alignment: -26.09% (0.0230 => 0.0170, std.dev.: 0.0056) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0516, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 8.21% (0.1462 => 0.1582, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4039, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0727, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4921, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5196, std.dev.: 0.1103) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2719, std.dev.: 0.0289) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0828, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3640, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3791, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0833, std.dev.: 0.0035) SingleSource/Regression/C/uint64_to_float: -29.93% (2.1832 => 1.5298, std.dev.: 0.0043) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.04% (0.0848 => 0.0984, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.94% (0.0810 => 0.0931, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 12.91% (0.0937 => 0.1058, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/tsp/tsp: 12.23% (0.1112 => 0.1248, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.02% (0.2180 => 0.2442, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.89% (0.1425 => 0.1566, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.59% (0.1157 => 0.1268, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 9.31% (0.7950 => 0.8690, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.10% (0.3295 => 0.3595, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.72% (0.1983 => 0.2156, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.65% (0.4127 => 0.4484, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.63% (0.7473 => 0.8118, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.42% (0.8321 => 0.9022, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.40% (0.6010 => 0.6515, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.04% (0.2240 => 0.2420, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 7.78% (0.3226 => 0.3477, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.64% (0.1466 => 0.1578, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.61% (0.9435 => 1.0153, std.dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.30% (0.3137 => 0.3366, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/em3d/em3d: 6.80% (0.1721 => 0.1838, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.70% (1.1685 => 1.2468, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.37% (0.2998 => 0.3189, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.16% (0.6287 => 0.6674, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.11% (13.1811 => 13.9868, std.dev.: 0.0507) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.10% (0.2279 => 0.2418, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.06% (1.6386 => 1.7379, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/football/football: 5.84% (0.8768 => 0.9280, std.dev.: 0.0030) MultiSource/Applications/treecc/treecc: 5.81% (1.9948 => 2.1106, std.dev.: 0.0152) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.75% (1.2526 => 1.3246, std.dev.: 0.0154) MultiSource/Benchmarks/nbench/nbench: 5.69% (1.1271 => 1.1912, std.dev.: 0.0068) MultiSource/Applications/SPASS/SPASS: 5.65% (14.2605 => 15.0665, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.45% (1.1606 => 1.2239, std.dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.44% (0.6227 => 0.6566, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 5.38% (2.2184 => 2.3378, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.25% (4.1763 => 4.3957, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.24% (0.2519 => 0.2651, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 5.15% (0.9074 => 0.9541, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 5.14% (0.8805 => 0.9258, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.08% (0.7966 => 0.8371, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.08% (0.8597 => 0.9034, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.05% (1.3279 => 1.3950, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.94% (0.8697 => 0.9127, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.90% (0.3003 => 0.3150, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.81% (0.8050 => 0.8437, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 4.78% (0.8007 => 0.8390, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.69% (0.8457 => 0.8854, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.52% (0.5817 => 0.6080, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.52% (0.9688 => 1.0126, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.49% (1.1170 => 1.1671, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.47% (0.9056 => 0.9461, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 4.47% (0.9039 => 0.9443, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 4.45% (0.6834 => 0.7138, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.28% (0.8086 => 0.8432, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/bh/bh: 4.25% (0.2985 => 0.3112, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.16% (0.2741 => 0.2855, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.15% (0.8716 => 0.9078, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 4.12% (0.8927 => 0.9295, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.06% (0.8885 => 0.9246, std.dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.02% (6.6074 => 6.8728, std.dev.: 0.0074) MultiSource/Applications/JM/lencod/lencod: 4.00% (15.3280 => 15.9417, std.dev.: 0.0505) MultiSource/Benchmarks/McCat/05-eks/eks: 4.00% (0.4397 => 0.4573, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.95% (0.8048 => 0.8366, std.dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 3.94% (14.7684 => 15.3509, std.dev.: 0.0244) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.94% (0.8316 => 0.8644, std.dev.: 0.0086) MultiSource/Applications/d/make_dparser: 3.89% (3.2366 => 3.3625, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.82% (0.7932 => 0.8235, std.dev.: 0.0038) MultiSource/Applications/lua/lua: 3.73% (3.8189 => 3.9612, std.dev.: 0.0494) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.69% (0.8338 => 0.8646, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.67% (0.8611 => 0.8927, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.52% (4.4873 => 4.6453, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.50% (0.8066 => 0.8348, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.42% (0.8177 => 0.8457, std.dev.: 0.0064) MultiSource/Applications/SIBsim4/SIBsim4: 3.41% (1.2568 => 1.2997, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.41% (8.6476 => 8.9426, std.dev.: 0.0471) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.36% (0.3717 => 0.3842, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.36% (4.4880 => 4.6388, std.dev.: 0.0194) MultiSource/Applications/lemon/lemon: 3.34% (1.0945 => 1.1311, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 3.27% (6.7320 => 6.9523, std.dev.: 0.0556) MultiSource/Applications/hbd/hbd: 3.21% (1.4269 => 1.4727, std.dev.: 0.0170) MultiSource/Benchmarks/McCat/18-imp/imp: 3.00% (0.3503 => 0.3608, std.dev.: 0.0035) MultiSource/Applications/oggenc/oggenc: 2.91% (4.9628 => 5.1070, std.dev.: 0.0120) MultiSource/Applications/lambda-0_1_3/lambda: 2.61% (0.7557 => 0.7754, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.56% (1.2602 => 1.2924, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.31% (4.5702 => 4.6758, std.dev.: 0.0161) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 39.97% (1.5795 => 2.2109, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 28.57% (2.9096 => 3.7409, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.07% (4.8436 => 5.8640, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.81% (8.2783 => 9.7527, std.dev.: 0.0311) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.54% (14.6451 => 17.2132, std.dev.: 0.0943) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.91% (0.7597 => 0.8806, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.15% (0.3186 => 0.3605, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.89% (2.7995 => 3.1323, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 10.16% (7.4933 => 8.2543, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 9.86% (1.1857 => 1.3026, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.52% (23.5781 => 25.3514, std.dev.: 0.0592) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.24% (3.9917 => 4.2806, std.dev.: 0.1115) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.26% (3.3761 => 3.5873, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.13% (2.9753 => 3.1576, std.dev.: 0.0262) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.97% (4.8660 => 5.1567, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.82% (4.5327 => 4.7963, std.dev.: 0.0429) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.30% (5.3218 => 5.6041, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.27% (5.4187 => 5.7040, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 5.21% (0.4353 => 0.4580, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.13% (0.3937 => 0.4139, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 5.02% (0.5214 => 0.5476, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 4.87% (3.3398 => 3.5024, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/whetstone: 4.62% (2.1224 => 2.2205, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 4.57% (1.3037 => 1.3633, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.98% (4.8362 => 5.0286, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/power/power: 3.13% (1.2061 => 1.2439, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.04% (59.2638 => 61.0675, std.dev.: 0.3179) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.79% (0.3587 => 0.3687, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 2.71% (6.7064 => 6.8879, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.36% (3.4104 => 3.4910, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.21% (0.6150 => 0.6286, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 2.03% (1.7056 => 1.7402, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 1.97% (6.1525 => 6.2739, std.dev.: 0.0203) MultiSource/Benchmarks/Olden/bh/bh: 1.66% (2.3560 => 2.3952, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.61% (11.5690 => 11.7556, std.dev.: 0.0294) SingleSource/Benchmarks/Misc/ReedSolomon: 1.29% (8.5322 => 8.6424, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.21% (4.9469 => 5.0069, std.dev.: 0.0114) MultiSource/Benchmarks/sim/sim: 1.03% (3.8206 => 3.8599, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/flops-7: 1.03% (1.7156 => 1.7332, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.14% (2.8951 => 1.6751, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -25.94% (7.2130 => 5.3422, std.dev.: 0.0517) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.37% (1.4529 => 1.1569, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.95% (9.9065 => 8.2272, std.dev.: 0.0132) MultiSource/Benchmarks/Olden/em3d/em3d: -13.26% (5.4641 => 4.7393, std.dev.: 0.0187) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -10.43% (0.3269 => 0.2928, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: -8.98% (63.1822 => 57.5058, std.dev.: 0.0756) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.29% (1.0512 => 0.9641, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: -6.27% (1.4296 => 1.3399, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.24% (4.7482 => 4.4520, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/FloatMM: -6.11% (0.8807 => 0.8269, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.10% (5.1305 => 4.8177, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/sieve: -5.95% (7.0599 => 6.6399, std.dev.: 0.0766) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.43% (6.2275 => 5.8893, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/flops: -5.34% (9.3748 => 8.8739, std.dev.: 0.1155) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.55% (5.6343 => 5.3782, std.dev.: 0.0596) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.53% (4.7449 => 4.5301, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.39% (4.9453 => 4.7282, std.dev.: 0.0033) MultiSource/Applications/lua/lua: -4.12% (29.8330 => 28.6039, std.dev.: 0.0692) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.08% (6.1706 => 5.9186, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/perlin: -3.75% (5.1084 => 4.9167, std.dev.: 0.0287) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.64% (5.1557 => 4.9681, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.58% (3.7148 => 3.5817, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/methcall: -3.36% (8.9760 => 8.6741, std.dev.: 0.0358) MultiSource/Applications/siod/siod: -3.31% (3.6643 => 3.5429, std.dev.: 0.0235) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.27% (4.9686 => 4.8062, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.19% (5.4300 => 5.2570, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/tsp/tsp: -2.35% (1.4861 => 1.4512, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/fbench: -2.27% (3.3840 => 3.3073, std.dev.: 0.0138) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.74% (1.3882 => 1.3640, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-5: -1.64% (2.8957 => 2.8483, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/fp-convert: -1.52% (15.8853 => 15.6446, std.dev.: 0.0157) MultiSource/Benchmarks/FreeBench/neural/neural: -1.48% (1.0841 => 1.0681, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.47% (3.5679 => 3.5153, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.31% (4.7794 => 4.7169, std.dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.22% (4.2466 => 4.1950, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.00% (6.0224 => 5.9620, std.dev.: 0.0116) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 5.26% (1.0262 => 1.0802, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.90% (0.2463 => 0.3692, std.dev.: 0.0678) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 79.67% (0.0123 => 0.0221, std.dev.: 0.0072) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.15% (0.0408 => 0.0429, std.dev.: 0.0140) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.89% (0.0254 => 0.0335, std.dev.: 0.0102) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0110) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.98% (0.0384 => 0.0430, std.dev.: 0.0129) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0077) SingleSource/UnitTests/Vector/Altivec/test1: 22.22% (0.0180 => 0.0220, std.dev.: 0.0071) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.28% (0.1438 => 0.1442, std.dev.: 0.0025) MultiSource/Applications/lemon/lemon: -4.52% (1.1329 => 1.0817, std.dev.: 0.0516) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.76% (0.4164 => 0.3966, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.73% (0.1369 => 0.1420, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.34% (0.0641 => 0.0626, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.03% (0.0195 => 0.0193, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.63% (0.0578 => 0.0557, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.26% (1.1437 => 1.1467, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.80% (0.0627 => 0.0553, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.56% (0.0180 => 0.0208, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.18% (0.8017 => 0.8112, std.dev.: 0.0099) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 54.84% (0.0062 => 0.0096, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 21:19:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 28 Nov 2012 23:19:42 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121129051942.3E2E22A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6368?compare_to=6363&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6368, Order: 168851, Start Time: 2012-11-29 03:46:35, End Time: 2012-11-29 05:20:17 To: 6363, Order: 168846, Start Time: 2012-11-29 01:49:48, End Time: 2012-11-29 03:23:29 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 1 (184 on baseline) Added Tests: 0 (52 on baseline) Unchanged Tests: 1092 (852 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.41% (20.2577 => 20.5443, std.dev.: 0.0338) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.42% (3.8596 => 3.8047, std.dev.: 0.0145) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.86% (0.3834 => 0.4442, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.29% (1.2783 => 1.3715, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.99% (2.0478 => 2.1091, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.4937 => 7.6657, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/hash2: 1.83% (3.1932 => 3.2517, std.dev.: 0.0065) MultiSource/Benchmarks/llubenchmark/llu: 1.63% (3.7435 => 3.8047, std.dev.: 0.0145) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.74% (0.1431 => 0.1306, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.93% (0.3821 => 0.3518, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.17% (0.9542 => 0.8858, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/trivial-interface: -6.77% (0.3812 => 0.3554, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -6.76% (2.4924 => 2.3238, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.72% (0.3142 => 0.2931, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.70% (0.3848 => 0.3590, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.70% (0.3880 => 0.3620, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -6.68% (0.3831 => 0.3575, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: -6.65% (0.3896 => 0.3637, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.63% (0.3891 => 0.3633, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.57% (0.4033 => 0.3768, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: -6.51% (0.4176 => 0.3904, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.30% (0.2428 => 0.2275, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.28% (0.3884 => 0.3640, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -6.08% (16.1920 => 15.2072, std.dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: -6.08% (0.3357 => 0.3153, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -6.07% (0.4199 => 0.3944, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.07% (0.1796 => 0.1687, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -5.96% (0.1879 => 0.1767, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -5.96% (0.4280 => 0.4025, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -5.96% (9.2283 => 8.6786, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.94% (0.6484 => 0.6099, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -5.93% (0.2160 => 0.2032, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -5.92% (7.0961 => 6.6759, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.90% (0.2355 => 0.2216, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.81% (1.0544 => 0.9931, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: -5.78% (0.9179 => 0.8648, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.77% (0.3658 => 0.3447, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -5.68% (0.1761 => 0.1661, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.66% (1.3722 => 1.2946, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.63% (1.2300 => 1.1607, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.63% (0.5591 => 0.5276, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.63% (0.6395 => 0.6035, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.62% (4.8161 => 4.5452, std.dev.: 0.0071) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.62% (0.9852 => 0.9298, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.54% (0.5863 => 0.5538, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.54% (4.8802 => 4.6099, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.53% (4.5069 => 4.2577, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.53% (0.6297 => 0.5949, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -5.52% (1.1450 => 1.0818, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.52% (1.4642 => 1.3834, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.51% (1.6364 => 1.5462, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.50% (4.0323 => 3.8106, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.49% (0.2695 => 0.2547, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.48% (0.5802 => 0.5484, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: -5.46% (4.3330 => 4.0963, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.45% (0.7339 => 0.6939, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -5.44% (1.1530 => 1.0903, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.43% (0.6293 => 0.5951, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.43% (0.8521 => 0.8058, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.43% (1.2784 => 1.2090, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.42% (6.7716 => 6.4047, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.41% (0.6667 => 0.6306, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: -5.39% (1.3864 => 1.3117, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.38% (3.5339 => 3.3436, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.38% (0.5925 => 0.5606, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.38% (0.6304 => 0.5965, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.38% (0.6230 => 0.5895, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.36% (0.5575 => 0.5276, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.35% (0.6660 => 0.6304, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.34% (0.6194 => 0.5863, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -5.34% (0.3406 => 0.3224, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.33% (14.2083 => 13.4506, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.33% (0.5570 => 0.5273, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.33% (0.5859 => 0.5547, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.32% (0.5805 => 0.5496, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.32% (0.7919 => 0.7498, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.31% (0.6736 => 0.6378, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.29% (0.6260 => 0.5929, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.28% (0.5705 => 0.5404, std.dev.: 0.0062) MultiSource/Applications/Burg/burg: -5.27% (1.2515 => 1.1855, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.27% (0.6052 => 0.5733, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.27% (0.6681 => 0.6329, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.25% (0.5941 => 0.5629, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -5.24% (17.1032 => 16.2070, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.21% (0.7524 => 0.7132, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.21% (0.5567 => 0.5277, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.20% (0.3057 => 0.2898, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.20% (0.6676 => 0.6329, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.19% (0.6395 => 0.6063, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.18% (1.2210 => 1.1577, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/05-eks/eks: -5.16% (0.4515 => 0.4282, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.16% (0.5581 => 0.5293, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.15% (0.6189 => 0.5870, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.15% (0.5999 => 0.5690, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.14% (0.7198 => 0.6828, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.14% (0.3483 => 0.3304, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -5.11% (1.3148 => 1.2476, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/bh/bh: -5.09% (0.2985 => 0.2833, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.09% (1.2221 => 1.1599, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: -5.09% (3.5154 => 3.3365, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: -5.08% (15.5079 => 14.7208, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.07% (8.0126 => 7.6060, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.06% (0.2548 => 0.2419, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.06% (0.3323 => 0.3155, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -5.04% (0.3194 => 0.3033, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.03% (0.5688 => 0.5402, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.99% (0.2385 => 0.2266, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -4.96% (0.3025 => 0.2875, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.95% (0.3252 => 0.3091, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.94% (0.6033 => 0.5735, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.94% (0.4151 => 0.3946, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -4.94% (0.3059 => 0.2908, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.94% (0.3931 => 0.3737, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -4.93% (15.2527 => 14.5003, std.dev.: 0.0241) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.93% (0.4321 => 0.4108, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: -4.93% (0.2659 => 0.2528, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.92% (0.4916 => 0.4674, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.91% (2.1713 => 2.0647, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.87% (0.2278 => 0.2167, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.85% (0.3837 => 0.3651, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.84% (0.2871 => 0.2732, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.83% (0.2999 => 0.2854, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -4.83% (0.3481 => 0.3313, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -4.79% (0.3255 => 0.3099, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -4.79% (0.3446 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.79% (0.2903 => 0.2764, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.78% (0.3849 => 0.3665, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -4.75% (0.2989 => 0.2847, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -4.75% (0.3581 => 0.3411, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.74% (0.3016 => 0.2873, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -4.72% (4.0594 => 3.8678, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: -4.70% (0.7447 => 0.7097, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.69% (0.5478 => 0.5221, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -4.68% (0.3205 => 0.3055, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.67% (0.2849 => 0.2716, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -4.67% (0.3621 => 0.3452, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -4.65% (2.4021 => 2.2905, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.63% (0.4813 => 0.4590, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.63% (0.5857 => 0.5586, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: -4.61% (0.4861 => 0.4637, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.60% (0.2933 => 0.2798, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -4.60% (2.1401 => 2.0417, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: -4.59% (0.4248 => 0.4053, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -4.58% (0.3867 => 0.3690, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/random: -4.56% (0.2939 => 0.2805, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.55% (1.6474 => 1.5725, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -4.54% (0.7982 => 0.7620, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.53% (22.4056 => 21.3898, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.52% (0.7021 => 0.6704, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.50% (0.6446 => 0.6156, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -4.48% (34.0927 => 32.5640, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.47% (0.5329 => 0.5091, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: -4.46% (0.3026 => 0.2891, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.45% (0.5849 => 0.5589, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -4.40% (5.0226 => 4.8018, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.34% (0.9557 => 0.9142, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.29% (0.5456 => 0.5222, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.29% (0.4083 => 0.3908, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: -4.28% (0.3271 => 0.3131, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.16% (0.6440 => 0.6172, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.16% (0.3319 => 0.3181, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -4.16% (0.8418 => 0.8068, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: -4.12% (18.2933 => 17.5397, std.dev.: 0.0188) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.11% (0.4427 => 0.4245, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -4.05% (0.4524 => 0.4341, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.04% (0.9077 => 0.8710, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/bigfib: -3.94% (0.6750 => 0.6484, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: -3.93% (0.3788 => 0.3639, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.81% (0.3491 => 0.3358, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.72% (2.2587 => 2.1747, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/Hello: -3.59% (0.6347 => 0.6119, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: -3.57% (1.5610 => 1.5053, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference-object: -3.43% (0.6441 => 0.6220, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -3.38% (0.7779 => 0.7516, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.87% (5.4682 => 5.3115, std.dev.: 0.0078) SingleSource/UnitTests/Vector/constpool: -1.11% (20.7746 => 20.5443, std.dev.: 0.0338) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1962, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: -61.69% (1.8100 => 0.6935, std.dev.: 0.0086) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -23.35% (7.5137 => 5.7589, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1729, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.88% (2.2633 => 2.1755, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.42% (1.3096 => 1.2648, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4000, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.63% (6.5735 => 6.4666, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 22:47:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 00:47:19 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121129064719.42F672A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6369?compare_to=6364&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6369, Order: 168851, Start Time: 2012-11-29 04:23:57, End Time: 2012-11-29 06:47:50 To: 6364, Order: 168829, Start Time: 2012-11-29 01:02:22, End Time: 2012-11-29 03:24:06 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 30 (132 on baseline) Performance Improvements: 5 (41 on baseline) Added Tests: 2 (186 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1051 (712 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/treecc/treecc: 14.61% (2.2882 => 2.6225, std.dev.: 0.0129) SingleSource/Benchmarks/LivermoreLoops/kernel08: 11.99% (0.1234 => 0.1382, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.36% (0.1707 => 0.1901, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/gs/gs: 11.35% (4.8090 => 5.3550, std.dev.: 0.0386) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.70% (1.1072 => 1.2257, std.dev.: 0.0315) SingleSource/Benchmarks/LivermoreLoops/kernel06: 10.43% (0.1045 => 0.1154, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.25% (0.1171 => 0.1291, std.dev.: 0.0045) SingleSource/Benchmarks/LivermoreLoops/kernel07: 10.04% (0.1046 => 0.1151, std.dev.: 0.0032) SingleSource/Benchmarks/LivermoreLoops/kernel02: 9.96% (0.1054 => 0.1159, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 9.73% (1.4221 => 1.5604, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.19% (0.6670 => 0.7283, std.dev.: 0.0186) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.12% (0.1908 => 0.2082, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.81% (0.5913 => 0.6434, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.78% (0.6240 => 0.6788, std.dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.56% (0.7571 => 0.8219, std.dev.: 0.0182) MultiSource/Applications/oggenc/oggenc: 7.85% (6.5727 => 7.0887, std.dev.: 0.1296) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.49% (0.4181 => 0.4494, std.dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.18% (0.7160 => 0.7674, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.04% (0.4234 => 0.4532, std.dev.: 0.0115) SingleSource/Benchmarks/Linpack/linpack-pc: 6.53% (0.2881 => 0.3069, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.56% (0.9619 => 1.0154, std.dev.: 0.0032) MultiSource/Applications/spiff/spiff: 5.29% (0.9421 => 0.9919, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference-object: 5.14% (0.6592 => 0.6931, std.dev.: 0.0131) SingleSource/UnitTests/ObjC++/Hello: 5.03% (0.6477 => 0.6803, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.91% (0.3342 => 0.3506, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.43% (0.7035 => 0.7347, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.38% (0.2396 => 0.2501, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.82% (10.9914 => 11.4110, std.dev.: 0.0522) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.66% (0.3437 => 0.4147, std.dev.: 0.0228) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.60% (1.4846 => 1.6865, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Olden/power/power: -11.93% (0.1651 => 0.1454, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/lpbench: -13.12% (12.6864 => 11.0214, std.dev.: 0.3411) MultiSource/Benchmarks/Olden/mst/mst: -11.15% (0.1480 => 0.1315, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -3.42% (4.7281 => 4.5663, std.dev.: 0.0515) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.51% (1.3542 => 1.3338, std.dev.: 0.0064) Added Tests - Compile Time -------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 2.11% (66.8682 => 68.2823, std.dev.: 0.6424) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 1.35% (0.1337 => 0.1355, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0420 => 0.0419, std.dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0651 => 0.0652, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: 0.07% (493.5793 => 493.9203, std.dev.: 0.0178) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 7.97% (63.2438 => 68.2823, std.dev.: 0.6424) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0419, std.dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43698.91% (1.1277 => 493.9203, std.dev.: 0.0178) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.84% (0.5229 => 1.5417, std.dev.: 0.1012) MultiSource/Applications/SPASS/SPASS: 18.46% (14.9895 => 17.7560, std.dev.: 0.3742) MultiSource/Applications/kimwitu++/kc: 47.53% (14.1553 => 20.8840, std.dev.: 0.6753) MultiSource/Benchmarks/MallocBench/gs/gs: 30.28% (4.1105 => 5.3550, std.dev.: 0.0386) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.80% (1.1048 => 1.5114, std.dev.: 0.0844) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.88% (7.1582 => 37.5721, std.dev.: 0.3707) SingleSource/Benchmarks/Misc-C++-EH/spirit: 80.32% (3.4629 => 6.2442, std.dev.: 0.3412) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.51% (0.6222 => 1.0360, std.dev.: 0.0657) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10504.72% (0.0720 => 7.6354, std.dev.: 0.2310) MultiSource/Applications/SIBsim4/SIBsim4: 3855800.00% (0.0001 => 3.8559, std.dev.: 0.0410) MultiSource/Applications/SPASS/SPASS: 13925700.00% (0.0001 => 13.9258, std.dev.: 1.8900) MultiSource/Applications/kimwitu++/kc: 53800.00% (0.0001 => 0.0539, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 65000.00% (0.0001 => 0.0651, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 590500.00% (0.0001 => 0.5906, std.dev.: 0.0206) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9986700.00% (0.0001 => 9.9868, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6096500.00% (0.0001 => 6.0966, std.dev.: 0.5729) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1786.99% (1.1194 => 21.1230, std.dev.: 0.5316) MultiSource/Applications/ClamAV/clamscan: 69.88% (22.1758 => 37.6721, std.dev.: 0.2261) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 61.77% (7.0540 => 11.4110, std.dev.: 0.0522) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.11% (2.9384 => 4.5870, std.dev.: 0.3297) MultiSource/Applications/JM/lencod/lencod: 46.41% (21.9371 => 32.1190, std.dev.: 0.3435) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 45.04% (8.1363 => 11.8005, std.dev.: 0.3575) MultiSource/Benchmarks/FreeBench/distray/distray: 44.70% (0.1056 => 0.1528, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/almabench: 43.84% (0.0730 => 0.1050, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 42.95% (0.1432 => 0.2047, std.dev.: 0.0029) MultiSource/Benchmarks/Fhourstones/fhourstones: 35.44% (0.1566 => 0.2121, std.dev.: 0.0034) SingleSource/UnitTests/vla: 34.08% (0.0355 => 0.0476, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Oscar: 32.39% (0.0636 => 0.0842, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 31.75% (0.2554 => 0.3365, std.dev.: 0.0157) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 31.44% (0.1584 => 0.2082, std.dev.: 0.0024) MultiSource/Applications/treecc/treecc: 29.36% (2.0273 => 2.6225, std.dev.: 0.0129) MultiSource/Benchmarks/Ptrdist/ft/ft: 28.92% (0.1940 => 0.2501, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/loader/loader: 27.12% (0.2758 => 0.3506, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: 26.68% (0.0626 => 0.0793, std.dev.: 0.0051) MultiSource/Applications/spiff/spiff: 26.60% (0.7835 => 0.9919, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/messages-2: 26.44% (0.0662 => 0.0837, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ks/ks: 25.89% (0.1510 => 0.1901, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 25.87% (0.8067 => 1.0154, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/17-bintr/bintr: 25.63% (0.0675 => 0.0848, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 25.52% (0.9765 => 1.2257, std.dev.: 0.0315) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 25.38% (0.5860 => 0.7347, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.47% (0.0842 => 0.1048, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.66% (0.1044 => 0.1291, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.59% (0.0746 => 0.0922, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/chomp: 23.50% (0.1655 => 0.2044, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 23.13% (0.6675 => 0.8219, std.dev.: 0.0182) MultiSource/Applications/oggenc/oggenc: 23.09% (5.7591 => 7.0887, std.dev.: 0.1296) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.82% (0.0793 => 0.0974, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wordfreq: 22.65% (0.3307 => 0.4056, std.dev.: 0.0207) SingleSource/Benchmarks/McGill/exptree: 22.48% (0.0814 => 0.0997, std.dev.: 0.0069) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.27% (0.3121 => 0.3816, std.dev.: 0.0144) MultiSource/Applications/minisat/minisat: 22.05% (0.7115 => 0.8684, std.dev.: 0.0229) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.78% (0.0886 => 0.1079, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.70% (0.0871 => 0.1060, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 21.51% (1.2842 => 1.5604, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.30% (0.1695 => 0.2056, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 21.08% (0.5020 => 0.6078, std.dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 20.86% (3.8922 => 4.7040, std.dev.: 0.1107) MultiSource/Applications/viterbi/viterbi: 20.77% (0.1555 => 0.1878, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/tsp/tsp: 20.77% (0.1175 => 0.1419, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/bc/bc: 20.39% (1.1861 => 1.4279, std.dev.: 0.0210) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.94% (0.4203 => 0.5041, std.dev.: 0.0137) MultiSource/Applications/d/make_dparser: 19.51% (3.3354 => 3.9862, std.dev.: 0.1469) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.22% (0.2700 => 0.3219, std.dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.12% (2.2024 => 2.6235, std.dev.: 0.0979) SingleSource/Benchmarks/McGill/misr: 19.12% (0.0633 => 0.0754, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.98% (0.6450 => 0.7674, std.dev.: 0.0133) SingleSource/Benchmarks/CoyoteBench/fftbench: 18.90% (0.4636 => 0.5512, std.dev.: 0.0175) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.67% (0.1125 => 0.1335, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/perlin: 18.66% (0.0536 => 0.0636, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 18.45% (0.3826 => 0.4532, std.dev.: 0.0115) SingleSource/UnitTests/ObjC/parameter-passing: 18.41% (0.3927 => 0.4650, std.dev.: 0.0094) MultiSource/Applications/lua/lua: 18.35% (3.8723 => 4.5827, std.dev.: 0.1055) SingleSource/Benchmarks/Shootout-C++/lists: 18.18% (0.3422 => 0.4044, std.dev.: 0.0129) SingleSource/UnitTests/ObjC/property: 18.01% (0.3886 => 0.4586, std.dev.: 0.0104) MultiSource/Applications/sqlite3/sqlite3: 17.91% (17.1811 => 20.2583, std.dev.: 0.5473) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.76% (14.3668 => 16.9178, std.dev.: 0.4680) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.63% (0.0834 => 0.0981, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: 17.53% (0.3828 => 0.4499, std.dev.: 0.0145) SingleSource/UnitTests/ObjC/trivial-interface: 17.28% (0.3473 => 0.4073, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/strcat: 17.17% (0.2831 => 0.3317, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/exceptions-4: 17.05% (0.3543 => 0.4147, std.dev.: 0.0107) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.91% (0.3543 => 0.4142, std.dev.: 0.0153) SingleSource/UnitTests/ObjC/synchronized: 16.85% (0.3561 => 0.4161, std.dev.: 0.0128) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.69% (4.2646 => 4.9764, std.dev.: 0.2073) SingleSource/UnitTests/ObjC/for-in: 16.65% (0.3694 => 0.4309, std.dev.: 0.0092) MultiSource/Benchmarks/VersaBench/bmm/bmm: 16.60% (0.0759 => 0.0885, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.56% (0.2065 => 0.2407, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/wc: 16.48% (0.3052 => 0.3555, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.47% (0.5981 => 0.6966, std.dev.: 0.0176) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.45% (0.8172 => 0.9516, std.dev.: 0.0392) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.36% (0.2891 => 0.3364, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/em3d/em3d: 16.34% (0.1695 => 0.1972, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/mst/mst: 16.34% (0.1163 => 0.1353, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Puzzle: 16.09% (0.1268 => 0.1472, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.01% (0.1062 => 0.1232, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hello: 15.99% (0.2714 => 0.3148, std.dev.: 0.0072) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.90% (0.0648 => 0.0751, std.dev.: 0.0032) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.74% (0.0953 => 0.1103, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.45% (0.0770 => 0.0889, std.dev.: 0.0042) MultiSource/Applications/Burg/burg: 15.40% (1.1642 => 1.3435, std.dev.: 0.0446) MultiSource/Applications/aha/aha: 15.38% (0.1151 => 0.1328, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.31% (0.1117 => 0.1288, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/matrix: 15.28% (0.0818 => 0.0943, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference-object: 14.94% (0.6030 => 0.6931, std.dev.: 0.0131) SingleSource/UnitTests/ObjC++/Hello: 14.82% (0.5925 => 0.6803, std.dev.: 0.0117) SingleSource/UnitTests/ObjC++/property-reference: 14.56% (0.7326 => 0.8393, std.dev.: 0.0187) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.52% (0.2107 => 0.2413, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.21% (0.3935 => 0.4494, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.14% (0.1337 => 0.1526, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.99% (0.1029 => 0.1173, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.56% (0.4615 => 0.5241, std.dev.: 0.0233) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.56% (0.2271 => 0.2579, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/05-eks/eks: 13.40% (0.4299 => 0.4875, std.dev.: 0.0149) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.16% (5.0018 => 5.6600, std.dev.: 0.2526) MultiSource/Applications/lemon/lemon: 12.56% (1.0722 => 1.2069, std.dev.: 0.0472) SingleSource/UnitTests/ObjC/exceptions-3: 12.23% (0.3516 => 0.3946, std.dev.: 0.0079) SingleSource/UnitTests/ObjC/exceptions-2: 11.90% (0.3497 => 0.3913, std.dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.84% (0.0929 => 0.1039, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/fibo: 11.63% (0.2725 => 0.3042, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.41% (0.2603 => 0.2900, std.dev.: 0.0087) SingleSource/UnitTests/SignlessTypes/rem: 10.84% (0.1144 => 0.1268, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/except: 9.79% (0.2871 => 0.3152, std.dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 149.63% (4.3953 => 10.9719, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/methcall: 147.21% (5.3999 => 13.3489, std.dev.: 0.0135) MultiSource/Benchmarks/Ptrdist/ft/ft: 31.37% (1.2838 => 1.6865, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.36% (0.3256 => 0.4147, std.dev.: 0.0228) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.95% (1.1145 => 1.3034, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/oourafft: 16.14% (6.6465 => 7.7194, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.91% (0.2944 => 0.3324, std.dev.: 0.0138) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.55% (2.8904 => 3.2241, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.99% (1.1396 => 1.2534, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.25% (1.7254 => 1.8850, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/ffbench: 8.39% (0.9505 => 1.0302, std.dev.: 0.0145) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.59% (4.2280 => 4.4645, std.dev.: 0.0128) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 4.71% (26.0924 => 27.3216, std.dev.: 0.2928) MultiSource/Benchmarks/nbench/nbench: 4.16% (11.6436 => 12.1282, std.dev.: 0.0067) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.34% (0.4162 => 0.4301, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.12% (1.3677 => 1.3967, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 2.07% (3.1595 => 3.2249, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.92% (2.1424 => 2.1836, std.dev.: 0.0142) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.40% (6.5088 => 6.6002, std.dev.: 0.0093) MultiSource/Benchmarks/PAQ8p/paq8p: 1.33% (85.0658 => 86.1973, std.dev.: 0.2938) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.28% (1.0313 => 1.0445, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0505, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.51% (6.6874 => 0.1667, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.90% (5.2763 => 1.2187, std.dev.: 0.0479) SingleSource/Benchmarks/Misc/salsa20: -75.07% (0.8651 => 0.2157, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: -45.19% (0.1622 => 0.0889, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.52% (5.3855 => 4.6574, std.dev.: 0.1299) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.37% (5.3526 => 4.6903, std.dev.: 0.1549) MultiSource/Applications/JM/ldecod/ldecod: -12.22% (10.4361 => 9.1608, std.dev.: 0.4839) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -68.62% (32.5116 => 10.2028, std.dev.: 0.0197) SingleSource/Benchmarks/Dhrystone/fldry: -66.20% (1.9577 => 0.6618, std.dev.: 0.0239) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1681, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.52% (0.0628 => 0.0361, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.36% (0.3987 => 0.2378, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.29% (4.5009 => 2.7775, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.16% (2.6546 => 2.0132, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: -19.39% (0.2161 => 0.1742, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4262, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.72% (2.6778 => 2.2837, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -10.11% (9.5636 => 8.5964, std.dev.: 0.1848) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4245, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.95% (4.8142 => 4.4794, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.14% (19.9488 => 18.7242, std.dev.: 0.3816) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.14% (3.2416 => 3.0427, std.dev.: 0.0167) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.59% (2.7294 => 2.5769, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7497, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.13% (0.2497 => 0.2369, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.06% (0.8614 => 0.8178, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -4.91% (1.5835 => 1.5058, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -4.51% (6.2999 => 6.0160, std.dev.: 0.0073) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8916, std.dev.: 0.0061) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.58% (0.4808 => 0.4684, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6773, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.73% (8.1563 => 8.0154, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/salsa20: -1.57% (10.2830 => 10.1212, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.75% (0.1485 => 0.1355, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0025) Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 23:09:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 01:09:47 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121129070947.ACB912A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6370?compare_to=6367&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6370, Order: 168854, Start Time: 2012-11-29 05:36:52, End Time: 2012-11-29 07:10:22 To: 6367, Order: 168851, Start Time: 2012-11-29 03:46:07, End Time: 2012-11-29 05:19:51 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 7 (88 on baseline) Performance Improvements: 2 (37 on baseline) Added Tests: 0 (51 on baseline) Existing Failures: 42 (40 on baseline) Unchanged Tests: 1043 (848 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.65% (0.8471 => 0.8950, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.18% (0.5045 => 0.5256, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.62% (1.2924 => 1.3262, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.66% (0.8457 => 0.8597, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 6.84% (43.9932 => 47.0024, std.dev.: 0.4189) MultiSource/Benchmarks/BitBench/five11/five11: 1.31% (5.6010 => 5.6743, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/tsp/tsp: 1.10% (1.4512 => 1.4671, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/lists: -1.53% (16.9488 => 16.6899, std.dev.: 0.0687) SingleSource/Benchmarks/Shootout/ary3: -1.28% (2.1204 => 2.0933, std.dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.01% (1.0802 => 1.0911, std.dev.: 0.0105) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.08% (0.3692 => 0.3689, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -6.79% (0.0221 => 0.0206, std.dev.: 0.0068) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.93% (0.0429 => 0.0425, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.60% (0.0335 => 0.0337, std.dev.: 0.0082) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -16.88% (0.0314 => 0.0261, std.dev.: 0.0119) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.63% (0.0430 => 0.0423, std.dev.: 0.0064) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0204 => 0.0204, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: -33.64% (0.0220 => 0.0146, std.dev.: 0.0093) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 4.44% (0.1442 => 0.1506, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 11.73% (1.0817 => 1.2086, std.dev.: 0.0433) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.55% (0.3966 => 0.3988, std.dev.: 0.0226) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.77% (0.1420 => 0.1409, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.82% (0.0626 => 0.0552, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.15% (0.0193 => 0.0185, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.87% (0.0557 => 0.0612, std.dev.: 0.0155) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.10% (1.1467 => 1.1478, std.dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: -0.01% (9.3940 => 9.3926, std.dev.: 0.0514) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1800.00% (0.0001 => 0.0019, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 700.00% (0.0001 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.45% (0.0553 => 0.0561, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.75% (0.0208 => 0.0169, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.86% (0.8112 => 0.8042, std.dev.: 0.0450) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -39.58% (0.0096 => 0.0058, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.24% (34.5129 => 34.4304, std.dev.: 0.2125) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Benchmarks/SciMark2-C/scimark2: -67.14% (28.5821 => 9.3926, std.dev.: 0.0514) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 9.13% (16.4461 => 17.9478, std.dev.: 0.2739) MultiSource/Applications/sqlite3/sqlite3: 2350.71% (0.6332 => 15.5179, std.dev.: 0.6854) MultiSource/Benchmarks/McCat/08-main/main: 50.03% (0.1831 => 0.2747, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.13% (0.1559 => 0.1479, std.dev.: 0.0351) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7103.59% (0.3123 => 22.4968, std.dev.: 0.7664) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1540.82% (0.3344 => 5.4869, std.dev.: 0.2015) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.28% (0.2364 => 0.3269, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/bigfib: 5.14% (0.6010 => 0.6319, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: 3.50% (0.0429 => 0.0444, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.32% (0.3266 => 0.3407, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/strcat: 2.79% (0.1969 => 0.2024, std.dev.: 0.0070) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.04% (0.0224 => 0.0242, std.dev.: 0.0022) SingleSource/UnitTests/byval-alignment: -26.09% (0.0230 => 0.0170, std.dev.: 0.0000) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0520, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 6.91% (0.1462 => 0.1563, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3961, std.dev.: 0.0306) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0685, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4953, std.dev.: 0.0174) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5133, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2687, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0715, std.dev.: 0.0336) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3619, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3878, std.dev.: 0.0227) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0841, std.dev.: 0.0008) SingleSource/Regression/C/uint64_to_float: -29.91% (2.1832 => 1.5301, std.dev.: 0.0086) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0007, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.98% (0.0848 => 0.0992, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.52% (0.0773 => 0.0893, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 15.29% (0.1112 => 0.1282, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.23% (0.0717 => 0.0819, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.77% (0.0830 => 0.0936, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.15% (0.2180 => 0.2423, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.84% (0.8148 => 0.8950, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.15% (0.7473 => 0.8157, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.09% (0.4127 => 0.4502, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 8.95% (0.6287 => 0.6850, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.68% (0.3295 => 0.3581, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.44% (0.4847 => 0.5256, std.dev.: 0.0047) MultiSource/Applications/Burg/burg: 8.43% (1.2222 => 1.3252, std.dev.: 0.0115) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.19% (0.1466 => 0.1586, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.09% (0.9435 => 1.0198, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.08% (0.1905 => 0.2059, std.dev.: 0.0023) MultiSource/Benchmarks/sim/sim: 8.03% (0.3226 => 0.3485, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/health/health: 8.02% (0.1347 => 0.1455, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.36% (0.3003 => 0.3224, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.95% (1.2526 => 1.3397, std.dev.: 0.0322) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.94% (0.6010 => 0.6427, std.dev.: 0.0144) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.92% (0.3137 => 0.3354, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.84% (0.5961 => 0.6369, std.dev.: 0.0153) MultiSource/Benchmarks/Fhourstones/fhourstones: 6.80% (0.1588 => 0.1696, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/em3d/em3d: 6.57% (0.1721 => 0.1834, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.54% (1.3279 => 1.4148, std.dev.: 0.0132) MultiSource/Applications/siod/siod: 6.36% (2.2184 => 2.3596, std.dev.: 0.0208) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.27% (0.2519 => 0.2677, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/football/football: 5.98% (0.8768 => 0.9292, std.dev.: 0.0194) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.97% (1.1170 => 1.1837, std.dev.: 0.0165) MultiSource/Benchmarks/nbench/nbench: 5.63% (1.1271 => 1.1906, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 5.33% (0.8317 => 0.8760, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 5.28% (0.8697 => 0.9156, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.26% (0.5191 => 0.5464, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.25% (0.2133 => 0.2245, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.24% (1.2602 => 1.3262, std.dev.: 0.0096) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.22% (0.2741 => 0.2884, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.16% (8.6476 => 9.0937, std.dev.: 0.0780) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 5.14% (0.8177 => 0.8597, std.dev.: 0.0054) MultiSource/Applications/hbd/hbd: 5.09% (1.4269 => 1.4995, std.dev.: 0.0206) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 4.86% (0.9039 => 0.9478, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.80% (0.7966 => 0.8348, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.68% (0.9074 => 0.9499, std.dev.: 0.0128) MultiSource/Applications/lua/lua: 4.46% (3.8189 => 3.9894, std.dev.: 0.0600) MultiSource/Applications/minisat/minisat: 4.43% (0.6834 => 0.7137, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.42% (0.8069 => 0.8426, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 4.41% (0.8805 => 0.9193, std.dev.: 0.0100) MultiSource/Benchmarks/PAQ8p/paq8p: 4.28% (2.3764 => 2.4781, std.dev.: 0.0360) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 4.10% (0.8204 => 0.8540, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.01% (0.8420 => 0.8758, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 4.01% (0.8007 => 0.8328, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.96% (0.8048 => 0.8367, std.dev.: 0.0063) MultiSource/Applications/lambda-0_1_3/lambda: 3.61% (0.7557 => 0.7830, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.60% (1.4479 => 1.4855, std.dev.: 0.0081) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 50.75% (0.0199 => 0.0300, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/pi: 38.59% (1.5795 => 2.1890, std.dev.: 0.0129) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 28.44% (2.9096 => 3.7371, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.03% (4.8436 => 5.8624, std.dev.: 0.0079) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.59% (14.6451 => 17.5148, std.dev.: 0.3562) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.90% (8.2783 => 9.7603, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.56% (0.7597 => 0.8855, std.dev.: 0.0157) SingleSource/Benchmarks/McGill/misr: 16.37% (0.4001 => 0.4656, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.51% (2.7995 => 3.1216, std.dev.: 0.0074) MultiSource/Applications/lambda-0_1_3/lambda: 10.23% (7.4933 => 8.2599, std.dev.: 0.0313) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.15% (1.1857 => 1.3060, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.55% (3.9917 => 4.2930, std.dev.: 0.1072) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.33% (23.5781 => 25.3067, std.dev.: 0.0661) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.36% (3.3761 => 3.5908, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.95% (4.8660 => 5.1553, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.81% (2.9753 => 3.1481, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.67% (4.5327 => 4.7896, std.dev.: 0.0337) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 5.48% (44.5605 => 47.0024, std.dev.: 0.4189) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.33% (0.3937 => 0.4147, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 5.27% (3.9006 => 4.1063, std.dev.: 0.0401) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.17% (5.4187 => 5.6991, std.dev.: 0.0281) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 5.03% (0.4353 => 0.4572, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 4.95% (0.2887 => 0.3030, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 4.93% (3.3398 => 3.5045, std.dev.: 0.0220) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.72% (0.5214 => 0.5460, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 4.26% (4.8362 => 5.0420, std.dev.: 0.0226) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.62% (0.3587 => 0.3717, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/dry: 3.25% (0.5081 => 0.5246, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: 2.97% (1.2061 => 1.2419, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.31% (3.4104 => 3.4891, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/methcall: 1.64% (8.2676 => 8.4034, std.dev.: 0.0293) SingleSource/Benchmarks/Misc/ReedSolomon: 1.28% (8.5322 => 8.6414, std.dev.: 0.0116) MultiSource/Benchmarks/BitBench/five11/five11: 1.27% (5.6030 => 5.6743, std.dev.: 0.0085) MultiSource/Benchmarks/sim/sim: 1.24% (3.8206 => 3.8680, std.dev.: 0.0143) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.43% (2.8951 => 1.6666, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -25.39% (7.2130 => 5.3816, std.dev.: 0.3001) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.19% (1.4529 => 1.1596, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -17.10% (9.9065 => 8.2124, std.dev.: 0.0212) SingleSource/Benchmarks/Shootout-C++/ary3: -13.16% (1.9999 => 1.7367, std.dev.: 0.0942) MultiSource/Benchmarks/Olden/em3d/em3d: -12.86% (5.4641 => 4.7612, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/flops-8: -9.57% (2.5609 => 2.3157, std.dev.: 0.0125) MultiSource/Benchmarks/mafft/pairlocalalign: -9.05% (63.1822 => 57.4623, std.dev.: 0.1579) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.29% (1.0512 => 0.9641, std.dev.: 0.0078) SingleSource/Benchmarks/Stanford/FloatMM: -6.61% (0.8807 => 0.8225, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.26% (4.7482 => 4.4509, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout/sieve: -6.18% (7.0599 => 6.6236, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.17% (5.1305 => 4.8137, std.dev.: 0.0238) SingleSource/Benchmarks/Misc/ffbench: -5.87% (1.4296 => 1.3457, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/flops: -5.59% (9.3748 => 8.8511, std.dev.: 0.0235) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.34% (6.2275 => 5.8947, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.85% (5.6343 => 5.3613, std.dev.: 0.0265) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.70% (2.8773 => 2.7422, std.dev.: 0.0403) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.53% (4.7449 => 4.5298, std.dev.: 0.0422) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.43% (6.1706 => 5.8974, std.dev.: 0.0916) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.37% (4.9453 => 4.7294, std.dev.: 0.0288) SingleSource/Benchmarks/Misc/perlin: -3.85% (5.1084 => 4.9117, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.84% (5.4300 => 5.2216, std.dev.: 0.0271) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.72% (5.1557 => 4.9639, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/methcall: -3.64% (8.9760 => 8.6494, std.dev.: 0.0319) MultiSource/Applications/lua/lua: -3.49% (29.8330 => 28.7914, std.dev.: 0.3412) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.28% (4.9686 => 4.8055, std.dev.: 0.0136) MultiSource/Applications/siod/siod: -3.09% (3.6643 => 3.5511, std.dev.: 0.0160) SingleSource/Benchmarks/Misc/fbench: -2.51% (3.3840 => 3.2992, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.48% (0.5807 => 0.5663, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/neural/neural: -2.11% (1.0841 => 1.0612, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.95% (3.3479 => 3.2827, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/fp-convert: -1.63% (15.8853 => 15.6263, std.dev.: 0.0326) SingleSource/Benchmarks/Misc/flops-5: -1.60% (2.8957 => 2.8495, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.58% (3.5679 => 3.5114, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.36% (4.2466 => 4.1888, std.dev.: 0.0167) MultiSource/Benchmarks/Olden/tsp/tsp: -1.28% (1.4861 => 1.4671, std.dev.: 0.0046) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 6.32% (1.0262 => 1.0911, std.dev.: 0.0105) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.78% (0.2463 => 0.3689, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 67.48% (0.0123 => 0.0206, std.dev.: 0.0068) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 32.68% (0.0254 => 0.0337, std.dev.: 0.0082) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -13.58% (0.0302 => 0.0261, std.dev.: 0.0119) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0064) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: -18.89% (0.0180 => 0.0146, std.dev.: 0.0093) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 4.73% (0.1438 => 0.1506, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 6.68% (1.1329 => 1.2086, std.dev.: 0.0433) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.23% (0.4164 => 0.3988, std.dev.: 0.0226) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.92% (0.1369 => 0.1409, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -13.88% (0.0641 => 0.0552, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.13% (0.0195 => 0.0185, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.88% (0.0578 => 0.0612, std.dev.: 0.0155) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.36% (1.1437 => 1.1478, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1800.00% (0.0001 => 0.0019, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -42.86% (0.0014 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.53% (0.0627 => 0.0561, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.11% (0.0180 => 0.0169, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.31% (0.8017 => 0.8042, std.dev.: 0.0450) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -6.45% (0.0062 => 0.0058, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Nov 28 23:16:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 01:16:18 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121129071618.E1AD62A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6371?compare_to=6368&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6371, Order: 168854, Start Time: 2012-11-29 05:43:18, End Time: 2012-11-29 07:16:53 To: 6368, Order: 168851, Start Time: 2012-11-29 03:46:35, End Time: 2012-11-29 05:20:17 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 2 (184 on baseline) Added Tests: 0 (52 on baseline) Unchanged Tests: 1092 (853 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.02% (20.5443 => 20.3355, std.dev.: 0.0727) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -2.12% (0.6935 => 0.6788, std.dev.: 0.0029) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.60% (0.3834 => 0.4432, std.dev.: 0.0095) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.23% (2.0478 => 2.1140, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/salsa20: 2.53% (7.4937 => 7.6830, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/hash2: 2.28% (3.1932 => 3.2661, std.dev.: 0.0075) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.88% (0.3821 => 0.3520, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.11% (0.9542 => 0.8864, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.75% (0.3142 => 0.2930, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -6.67% (2.4924 => 2.3261, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: -6.66% (0.3831 => 0.3576, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.65% (0.3880 => 0.3622, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -6.64% (0.3812 => 0.3559, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -6.60% (0.3848 => 0.3594, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.55% (0.3896 => 0.3641, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.50% (0.3891 => 0.3638, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -6.47% (0.4033 => 0.3772, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.38% (0.2428 => 0.2273, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.37% (0.4176 => 0.3910, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.26% (0.3357 => 0.3147, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -6.16% (0.2160 => 0.2027, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.13% (0.3884 => 0.3646, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -6.03% (0.4199 => 0.3946, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -5.97% (9.2283 => 8.6771, std.dev.: 0.0052) MultiSource/Applications/JM/ldecod/ldecod: -5.96% (7.0961 => 6.6733, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.96% (0.1796 => 0.1689, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: -5.93% (16.1920 => 15.2317, std.dev.: 0.0149) SingleSource/UnitTests/ObjC/parameter-passing: -5.89% (0.4280 => 0.4028, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.86% (0.2355 => 0.2217, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: -5.85% (0.1879 => 0.1769, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.82% (0.3658 => 0.3445, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.80% (0.6484 => 0.6108, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: -5.76% (0.9179 => 0.8650, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.74% (1.3722 => 1.2935, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.72% (0.9852 => 0.9288, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.68% (0.5863 => 0.5530, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.68% (0.6395 => 0.6032, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.67% (0.6052 => 0.5709, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.65% (1.2300 => 1.1605, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: -5.64% (1.1530 => 1.0880, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.63% (0.5591 => 0.5276, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.63% (0.5805 => 0.5478, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.63% (4.0323 => 3.8054, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.62% (0.5925 => 0.5592, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.60% (1.0544 => 0.9954, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.59% (0.6297 => 0.5945, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.58% (4.8802 => 4.6079, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.57% (0.5569 => 0.5259, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.57% (0.2695 => 0.2545, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.56% (4.8161 => 4.5481, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.56% (0.7339 => 0.6931, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.55% (0.6304 => 0.5954, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.52% (0.6667 => 0.6299, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.52% (6.7716 => 6.3981, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.51% (0.5575 => 0.5268, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.51% (0.6194 => 0.5853, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -5.50% (1.1450 => 1.0820, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -5.49% (4.3330 => 4.0952, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.48% (1.6364 => 1.5467, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.48% (0.7919 => 0.7485, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.48% (0.6660 => 0.6295, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.46% (3.5339 => 3.3408, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.46% (0.5859 => 0.5539, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.46% (4.5069 => 4.2609, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.45% (0.6676 => 0.6312, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.45% (0.5705 => 0.5394, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.44% (0.6230 => 0.5891, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.43% (0.5802 => 0.5487, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.42% (1.4642 => 1.3849, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.42% (0.6260 => 0.5921, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.41% (0.6395 => 0.6049, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.41% (0.5567 => 0.5266, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.40% (0.5941 => 0.5620, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.39% (0.6293 => 0.5954, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.37% (0.8521 => 0.8063, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.37% (0.6681 => 0.6322, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.37% (14.2083 => 13.4458, std.dev.: 0.0148) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.36% (0.6736 => 0.6375, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.36% (1.2784 => 1.2099, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.36% (0.5581 => 0.5282, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.35% (0.6189 => 0.5858, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.33% (0.5570 => 0.5273, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -5.30% (1.2515 => 1.1852, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: -5.29% (1.3864 => 1.3130, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.28% (0.5999 => 0.5682, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -5.24% (1.3148 => 1.2459, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: -5.23% (0.2659 => 0.2520, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.22% (0.7524 => 0.7131, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.22% (0.6033 => 0.5718, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.22% (8.0126 => 7.5943, std.dev.: 0.0123) MultiSource/Benchmarks/sim/sim: -5.20% (0.3406 => 0.3229, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.19% (1.2210 => 1.1576, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -5.17% (17.1032 => 16.2183, std.dev.: 0.0233) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.17% (0.3057 => 0.2899, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.15% (0.5688 => 0.5395, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.14% (0.3931 => 0.3729) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.14% (0.2278 => 0.2161, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.13% (0.3837 => 0.3640, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -5.13% (15.5079 => 14.7129, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/bh/bh: -5.13% (0.2985 => 0.2832, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: -5.12% (0.3025 => 0.2870, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.12% (1.2221 => 1.1595, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.10% (0.3252 => 0.3086, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -5.10% (3.5154 => 3.3360, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/05-eks/eks: -5.09% (0.4515 => 0.4285, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.09% (0.3323 => 0.3154, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.07% (0.2385 => 0.2264, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.07% (0.7198 => 0.6833, std.dev.: 0.0084) SingleSource/Regression/C++/ofstream_ctor: -5.07% (0.3059 => 0.2904, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.06% (0.2548 => 0.2419, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -5.04% (0.3194 => 0.3033, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.02% (2.1713 => 2.0623, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.00% (0.3483 => 0.3309, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.99% (0.4151 => 0.3944, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: -4.98% (0.3255 => 0.3093, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.95% (0.4321 => 0.4107, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.95% (0.2989 => 0.2841, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -4.94% (0.3581 => 0.3404, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.93% (0.2999 => 0.2851, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.87% (0.3016 => 0.2869, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.86% (0.4916 => 0.4677, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: -4.85% (0.3446 => 0.3279, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -4.81% (0.4861 => 0.4627, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -4.81% (0.2871 => 0.2733, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.81% (0.3849 => 0.3664, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -4.80% (0.3394 => 0.3231, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -4.79% (0.3026 => 0.2881, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: -4.78% (0.3867 => 0.3682, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.78% (0.5168 => 0.4921, std.dev.: 0.0022) MultiSource/Applications/lua/lua: -4.77% (4.0594 => 3.8656, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.75% (0.2903 => 0.2765, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: -4.73% (0.2939 => 0.2800, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -4.71% (0.3481 => 0.3317, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.71% (0.5478 => 0.5220, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.71% (0.2933 => 0.2795, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -4.70% (34.0927 => 32.4910, std.dev.: 0.0240) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.70% (0.5857 => 0.5582, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -4.69% (15.2527 => 14.5370, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/wc: -4.68% (0.3205 => 0.3055, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.65% (0.5849 => 0.5577, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.64% (0.7021 => 0.6695, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -4.64% (0.4248 => 0.4051, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.63% (0.4813 => 0.4590, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.63% (0.2849 => 0.2717, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.62% (1.6474 => 1.5713, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: -4.62% (0.7447 => 0.7103, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -4.61% (2.4021 => 2.2914, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.56% (0.5329 => 0.5086, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -4.56% (0.3621 => 0.3456, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -4.56% (2.1401 => 2.0426, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.53% (22.4056 => 21.3909, std.dev.: 0.0163) MultiSource/Applications/lambda-0_1_3/lambda: -4.45% (0.7982 => 0.7627, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.45% (0.9557 => 0.9132, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.44% (0.5456 => 0.5214, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.42% (0.6446 => 0.6161, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -4.41% (5.0226 => 4.8011, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: -4.40% (0.3271 => 0.3127, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.31% (0.3319 => 0.3176, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.29% (0.6440 => 0.6164, std.dev.: 0.0056) MultiSource/Applications/spiff/spiff: -4.25% (0.8418 => 0.8060, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.16% (0.4083 => 0.3913, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.09% (0.4427 => 0.4246, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: -4.07% (0.4524 => 0.4340, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.03% (0.9077 => 0.8711, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -4.02% (18.2933 => 17.5583, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/sieve: -3.99% (0.3788 => 0.3637, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -3.99% (0.6750 => 0.6481, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.91% (2.2587 => 2.1703, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.87% (0.3491 => 0.3356, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -3.61% (1.5610 => 1.5047, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: -3.34% (0.6347 => 0.6135, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: -3.26% (0.6441 => 0.6231, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -3.14% (0.7779 => 0.7535, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.87% (5.4682 => 5.3113, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -2.11% (20.7746 => 20.3355, std.dev.: 0.0727) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1951, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -62.50% (1.8100 => 0.6788, std.dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7558, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -8.72% (1.2842 => 1.1722, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161) SingleSource/Benchmarks/Misc/fbench: -3.89% (2.2633 => 2.1752, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4001, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.46% (6.5735 => 6.4772, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 00:19:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 02:19:04 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121129081904.665492A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6372?compare_to=6366&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6372, Order: 168852, Start Time: 2012-11-29 04:49:13, End Time: 2012-11-29 08:19:05 To: 6366, Order: 168829, Start Time: 2012-11-29 00:39:48, End Time: 2012-11-29 04:01:09 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (180 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 2 (186 on baseline) Unchanged Tests: 1092 (710 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Added Tests - Compile Time -------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.88% (0.0625 => 0.0893, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.87% (0.1063 => 0.1423, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.95% (0.2969 => 0.3769, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.76% (0.4253 => 0.5391, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.67% (0.1106 => 0.1401, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.36% (0.4139 => 0.5230, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 25.88% (0.0452 => 0.0569, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.63% (0.0714 => 0.0897, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.37% (0.4994 => 0.6261, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 25.33% (1.5932 => 1.9967, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.20% (0.5900 => 0.7387, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.05% (0.0475 => 0.0594, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.58% (0.0415 => 0.0517, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.30% (0.5000 => 0.6215, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.77% (0.0547 => 0.0677, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.63% (0.0584 => 0.0722, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.33% (0.1620 => 0.1998, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.31% (0.1021 => 0.1259, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.12% (0.1103 => 0.1358, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.94% (0.1107 => 0.1361, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 22.70% (0.0599 => 0.0735) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.41% (0.0897 => 0.1098, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.01% (0.1604 => 0.1957, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.96% (0.0633 => 0.0772, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.92% (0.0584 => 0.0712, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 21.73% (0.0948 => 0.1154, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.65% (0.0642 => 0.0781, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.63% (0.0541 => 0.0658, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 21.49% (0.0605 => 0.0735, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.21% (0.0495 => 0.0600, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.09% (0.3903 => 0.4726, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.04% (0.1003 => 0.1214, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.98% (0.1549 => 0.1874, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.92% (0.0822 => 0.0994, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/health/health: 20.71% (0.0821 => 0.0991, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 20.69% (0.1619 => 0.1954, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 20.59% (0.0947 => 0.1142, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.90% (0.1462 => 0.1753, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.51% (0.2014 => 0.2407, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.51% (0.3890 => 0.4649, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.48% (0.1160 => 0.1386, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 19.43% (0.5826 => 0.6958, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 19.31% (0.0808 => 0.0964, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.05% (0.2866 => 0.3412, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 18.98% (0.5889 => 0.7007, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 18.97% (0.1218 => 0.1449, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.96% (1.3152 => 1.5645, std.dev.: 0.0046) MultiSource/Applications/spiff/spiff: 18.86% (0.4029 => 0.4789, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.86% (0.2736 => 0.3252, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 18.77% (0.0698 => 0.0829, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 18.54% (0.1505 => 0.1784, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.38% (0.1088 => 0.1288, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.36% (0.0572 => 0.0677, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.29% (0.4658 => 0.5510, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.26% (3.5627 => 4.2131, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.25% (0.5026 => 0.5943, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 18.14% (1.8794 => 2.2203, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.98% (0.0573 => 0.0676, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.92% (0.3271 => 0.3857, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.84% (0.1968 => 0.2319, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 17.83% (0.5546 => 0.6535, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 17.77% (0.7171 => 0.8445, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.74% (1.6211 => 1.9087, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.47% (0.4361 => 0.5123, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.36% (4.4195 => 5.1869, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 17.33% (4.2109 => 4.9406, std.dev.: 0.0031) MultiSource/Applications/d/make_dparser: 17.18% (1.0781 => 1.2633, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 17.17% (0.1421 => 0.1665, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.11% (2.7292 => 3.1963, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/bh/bh: 16.90% (0.1284 => 0.1501, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.79% (0.3930 => 0.4590, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 16.63% (0.2075 => 0.2420, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.52% (0.2875 => 0.3350, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.51% (0.3488 => 0.4064, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 16.51% (0.9697 => 1.1298, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hello: 16.36% (0.2714 => 0.3158, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.31% (1.9966 => 2.3222, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.28% (0.2911 => 0.3385, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.26% (1.9694 => 2.2897, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/fibo: 16.22% (0.2725 => 0.3167, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.18% (0.2738 => 0.3181, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.15% (0.1090 => 0.1266, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.12% (0.2729 => 0.3169, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 16.12% (0.2780 => 0.3228, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 16.11% (0.3446 => 0.4001, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 16.07% (0.2750 => 0.3192, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.05% (0.2792 => 0.3240, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 16.03% (0.3469 => 0.4025, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 16.02% (0.3496 => 0.4056, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 16.02% (0.3465 => 0.4020, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 15.98% (0.3460 => 0.4013, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 15.97% (0.2811 => 0.3260, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 15.92% (0.9909 => 1.1487, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 15.91% (0.2823 => 0.3272, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 15.89% (0.2813 => 0.3260, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 15.88% (0.2803 => 0.3248, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 15.86% (0.2566 => 0.2973, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 15.83% (0.3442 => 0.3987, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.80% (2.0673 => 2.3940, std.dev.: 0.0643) MultiSource/Applications/lua/lua: 15.78% (1.4269 => 1.6521, std.dev.: 0.0211) SingleSource/Benchmarks/Shootout-C++/wc: 15.63% (0.3096 => 0.3580, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 15.59% (0.3650 => 0.4219, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 15.58% (0.3004 => 0.3472, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.52% (0.3195 => 0.3691, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 15.45% (0.3643 => 0.4206, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 15.34% (0.3267 => 0.3768, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 15.20% (0.3724 => 0.4290, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 15.16% (0.3258 => 0.3752, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 14.98% (0.3317 => 0.3814, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.96% (0.3362 => 0.3865, std.dev.: 0.0123) MultiSource/Benchmarks/Bullet/bullet: 14.96% (23.5202 => 27.0381, std.dev.: 0.0244) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.87% (0.3060 => 0.3515, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.66% (0.3124 => 0.3582, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/hash: 14.52% (0.4146 => 0.4748, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 14.51% (0.7875 => 0.9018, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.50% (0.3282 => 0.3758, std.dev.: 0.0078) MultiSource/Applications/JM/ldecod/ldecod: 14.39% (2.1653 => 2.4768, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 14.38% (0.0758 => 0.0867, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 14.37% (0.3348 => 0.3829, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 14.36% (0.3678 => 0.4206, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 14.29% (0.3477 => 0.3974, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 14.22% (0.3726 => 0.4256, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 14.13% (4.6177 => 5.2700, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 14.02% (2.1013 => 2.3958, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.93% (0.3625 => 0.4130, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.89% (0.3981 => 0.4534, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.85% (0.3690 => 0.4201, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 13.83% (0.4251 => 0.4839, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.81% (0.1383 => 0.1574, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.63% (0.2040 => 0.2318, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.45% (0.3845 => 0.4362, std.dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 13.34% (0.2691 => 0.3050, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: 13.19% (0.5012 => 0.5673, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 12.65% (5.5417 => 6.2426, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 12.21% (0.6634 => 0.7444, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.84% (0.6435 => 0.7197, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 11.49% (0.3498 => 0.3900, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.46% (0.2068 => 0.2305, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 11.27% (0.3336 => 0.3712, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.14% (0.2737 => 0.3042, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.89% (0.1028 => 0.1140, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.44% (0.3084 => 0.3406, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 10.42% (2.0346 => 2.2467, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 10.33% (0.2391 => 0.2638, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.56% (0.2103 => 0.2304, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.38% (0.5361 => 0.5810, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.33% (11.6398 => 12.6092, std.dev.: 0.0395) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.18% (4.6926 => 5.0763, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.97% (0.7426 => 0.8018, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.81% (0.5584 => 0.6020, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 7.09% (11.9555 => 12.8028, std.dev.: 0.0164) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.33% (0.3792 => 0.4032, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.12% (0.0734 => 0.0867, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.99% (29.0505 => 33.4054, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 9.49% (0.2802 => 0.3068, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 6.93% (0.2122 => 0.2269, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6104, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.36% (0.3693 => 0.3891, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6793, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-2: 4.86% (1.8057 => 1.8934, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1694, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.60% (79.9355 => 83.6119, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/dry: 4.30% (14.0481 => 14.6527, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/health/health: 2.72% (0.6276 => 0.6447, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2006, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2225, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.58% (2.0820 => 2.1148, std.dev.: 0.0114) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3062, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.43% (1.0927 => 1.1083, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2869, std.dev.: 0.0030) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5787, std.dev.: 0.0304) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.18% (2.4764 => 2.4224, std.dev.: 0.0108) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5761, std.dev.: 0.0220) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9768, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: -7.66% (0.2402 => 0.2218, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7927, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9589, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.43% (11.2080 => 10.8236, std.dev.: 0.0052) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/fldry: -2.45% (17.2379 => 16.8154, std.dev.: 0.0493) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8713, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.21% (0.6293 => 0.6154, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5744, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4961, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.1990, std.dev.: 0.0507) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0470, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 00:57:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 02:57:01 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121129085701.EB13F2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/6373?compare_to=6370&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6373, Order: 168856, Start Time: 2012-11-29 07:27:09, End Time: 2012-11-29 08:57:35 To: 6370, Order: 168854, Start Time: 2012-11-29 05:36:52, End Time: 2012-11-29 07:10:22 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 4 (138 on baseline) Performance Improvements: 9 (45 on baseline) Added Tests: 0 (51 on baseline) Existing Failures: 42 (40 on baseline) Unchanged Tests: 1039 (790 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/spiff/spiff: 2.98% (0.8446 => 0.8698, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 13.47% (0.7711 => 0.8750, std.dev.: 0.0182) SingleSource/Benchmarks/Misc/pi: 1.22% (2.1890 => 2.2157, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.09% (1.5975 => 1.6149, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/viterbi/viterbi: -5.91% (0.1743 => 0.1640, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: -5.39% (0.9145 => 0.8652, std.dev.: 0.0159) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -3.99% (0.8950 => 0.8593, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.58% (0.9228 => 0.8990, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -2.18% (1.7419 => 1.7039, std.dev.: 0.0146) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.50% (1.3397 => 1.3196, std.dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.86% (17.5148 => 15.7872, std.dev.: 0.4455) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.55% (0.3030 => 0.2892, std.dev.: 0.0032) MultiSource/Benchmarks/BitBench/five11/five11: -1.57% (5.6743 => 5.5852, std.dev.: 0.0262) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.14% (1.0911 => 1.0787, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.3689 => 0.3689, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 7.28% (0.0206 => 0.0221, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.71% (0.0425 => 0.0428, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.84% (0.0337 => 0.0287, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 20.69% (0.0261 => 0.0315, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.02% (0.0423 => 0.0406, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/casts: -19.61% (0.0204 => 0.0164, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/test1: 24.66% (0.0146 => 0.0182, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -2.86% (0.1506 => 0.1463, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -9.74% (1.2086 => 1.0909, std.dev.: 0.0580) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.03% (0.3988 => 0.3987, std.dev.: 0.0666) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.42% (0.1409 => 0.1429, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 13.41% (0.0552 => 0.0626, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 10.81% (0.0185 => 0.0205, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.31% (0.0612 => 0.0604, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.72% (1.1478 => 1.1395, std.dev.: 0.0065) MultiSource/Benchmarks/SciMark2-C/scimark2: 0.14% (9.3926 => 9.4059, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -84.21% (0.0019 => 0.0003, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -87.50% (0.0008 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.91% (0.0561 => 0.0511, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 37.28% (0.0169 => 0.0232, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.04% (0.8042 => 0.8039, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -17.24% (0.0058 => 0.0048, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.05% (34.4304 => 34.4487, std.dev.: 0.0411) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Benchmarks/SciMark2-C/scimark2: -67.09% (28.5821 => 9.4059, std.dev.: 0.0122) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.50% (16.4461 => 17.8444, std.dev.: 0.1538) MultiSource/Applications/sqlite3/sqlite3: 2344.61% (0.6332 => 15.4793, std.dev.: 0.2566) MultiSource/Benchmarks/McCat/08-main/main: 48.94% (0.1831 => 0.2727, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.39% (0.1559 => 0.1475, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7125.36% (0.3123 => 22.5648, std.dev.: 0.0479) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1528.17% (0.3344 => 5.4446, std.dev.: 0.0437) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.03% (0.2364 => 0.3263, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 4.79% (0.6010 => 0.6298, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/mandel: 1.40% (0.0429 => 0.0435, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.26% (0.3266 => 0.3405, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 1.47% (0.1969 => 0.1998, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.68% (0.0224 => 0.0230, std.dev.: 0.0010) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0480, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 5.88% (0.1462 => 0.1548, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4069, std.dev.: 0.0187) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0743, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4925, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5194, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2713, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0689, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3610, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3696, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0807, std.dev.: 0.0022) SingleSource/Regression/C/uint64_to_float: -29.68% (2.1832 => 1.5352, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.14% (0.0810 => 0.0965, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.57% (0.0848 => 0.0980, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 12.95% (0.1112 => 0.1256, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.55% (0.2180 => 0.2410, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.26% (0.3295 => 0.3633, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 9.41% (0.7950 => 0.8698, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.09% (0.9435 => 1.0293, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.96% (0.1183 => 0.1289, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.58% (0.4127 => 0.4481, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.41% (2.1401 => 2.3200, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 8.13% (0.6287 => 0.6798, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.12% (0.1466 => 0.1585, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.60% (0.7473 => 0.8041, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.29% (0.6010 => 0.6448, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.16% (0.1425 => 0.1527, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.96% (0.3003 => 0.3212, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.86% (1.5315 => 1.6366, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.36% (0.5817 => 0.6187, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.14% (1.1606 => 1.2319, std.dev.: 0.0241) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.14% (13.1811 => 13.9908, std.dev.: 0.0502) MultiSource/Applications/Burg/burg: 5.92% (1.2222 => 1.2946, std.dev.: 0.0183) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.89% (0.1885 => 0.1996, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.74% (3.1832 => 3.3660, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.62% (0.9056 => 0.9565, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.62% (0.1905 => 0.2012, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 5.51% (14.2605 => 15.0466, std.dev.: 0.0999) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.46% (0.8148 => 0.8593, std.dev.: 0.0087) MultiSource/Applications/siod/siod: 5.41% (2.2184 => 2.3385, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.36% (0.4847 => 0.5107, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.35% (1.2526 => 1.3196, std.dev.: 0.0070) MultiSource/Applications/treecc/treecc: 5.32% (1.9948 => 2.1009, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/gs/gs: 5.22% (4.1305 => 4.3460, std.dev.: 0.0221) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.16% (0.9688 => 1.0188, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/football/football: 5.11% (0.8768 => 0.9216, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.07% (0.8597 => 0.9033, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.98% (1.3279 => 1.3940, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.97% (0.8611 => 0.9039, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.85% (0.5191 => 0.5443, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 4.83% (0.6834 => 0.7164, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 4.76% (3.8189 => 4.0006, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.73% (0.8697 => 0.9108, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.71% (8.6476 => 9.0548, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.70% (4.1763 => 4.3727, std.dev.: 0.0316) MultiSource/Benchmarks/nbench/nbench: 4.68% (1.1271 => 1.1799, std.dev.: 0.0138) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.64% (0.2240 => 0.2344, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.64% (0.9908 => 1.0368, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 4.62% (1.4269 => 1.4928, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 4.55% (0.9069 => 0.9482, std.dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.54% (0.6227 => 0.6510, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 4.51% (0.8007 => 0.8368, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.48% (0.2279 => 0.2381, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 4.41% (0.8048 => 0.8403, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.41% (0.2519 => 0.2630, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.38% (0.8457 => 0.8827, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.31% (0.8885 => 0.9268, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 4.27% (0.8359 => 0.8716, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 4.23% (0.8855 => 0.9230, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.19% (0.8331 => 0.8680, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4.17% (0.8317 => 0.8664, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.17% (0.3717 => 0.3872, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 4.12% (14.7684 => 15.3767, std.dev.: 0.0490) MultiSource/Applications/SIBsim4/SIBsim4: 4.10% (1.2568 => 1.3083, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.08% (0.4559 => 0.4745, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 4.07% (0.8261 => 0.8597, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.05% (0.8518 => 0.8863, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.05% (1.1685 => 1.2158, std.dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.99% (1.1170 => 1.1616, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.99% (1.6386 => 1.7039, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.98% (0.8286 => 0.8616, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.96% (0.8177 => 0.8501, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.92% (0.8086 => 0.8403, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.91% (0.8050 => 0.8365, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.90% (0.9074 => 0.9428, std.dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: 3.90% (2.3764 => 2.4691, std.dev.: 0.0083) MultiSource/Applications/JM/lencod/lencod: 3.89% (15.3280 => 15.9248, std.dev.: 0.0541) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.87% (0.8712 => 0.9049, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.86% (0.8656 => 0.8990, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 3.85% (0.8069 => 0.8380, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.85% (0.8204 => 0.8520, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 3.77% (1.0945 => 1.1358, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.75% (0.8316 => 0.8628, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.74% (0.7932 => 0.8229, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.73% (0.8420 => 0.8734, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.70% (0.2998 => 0.3109, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: 3.65% (3.2366 => 3.3548, std.dev.: 0.0230) MultiSource/Benchmarks/mafft/pairlocalalign: 3.64% (8.6247 => 8.9387, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.64% (0.7966 => 0.8256, std.dev.: 0.0085) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.61% (6.6074 => 6.8458, std.dev.: 0.0223) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.61% (0.8066 => 0.8357, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 3.37% (0.8927 => 0.9228, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.36% (0.6586 => 0.6807, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.17% (1.2602 => 1.3002, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.14% (0.8716 => 0.8990, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.10% (4.4873 => 4.6264, std.dev.: 0.0110) MultiSource/Applications/JM/ldecod/ldecod: 3.06% (6.7320 => 6.9379, std.dev.: 0.0569) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.03% (0.4783 => 0.4928, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/18-imp/imp: 2.94% (0.3503 => 0.3606, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.73% (4.4880 => 4.6106, std.dev.: 0.0294) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.65% (4.5702 => 4.6912, std.dev.: 0.0425) MultiSource/Applications/oggenc/oggenc: 2.43% (4.9628 => 5.0835, std.dev.: 0.0248) MultiSource/Benchmarks/Bullet/bullet: 2.17% (31.8598 => 32.5522, std.dev.: 0.1092) MultiSource/Applications/hexxagon/hexxagon: 2.15% (0.9810 => 1.0021, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 40.28% (1.5795 => 2.2157, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 28.60% (2.9096 => 3.7417, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.21% (4.8436 => 5.8709, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.85% (8.2783 => 9.7563, std.dev.: 0.0059) SingleSource/Benchmarks/McGill/misr: 16.60% (0.4001 => 0.4665, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.23% (0.7597 => 0.8830, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.62% (2.7995 => 3.1248, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.36% (0.3186 => 0.3548, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.25% (1.1857 => 1.3072, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 10.06% (7.4933 => 8.2475, std.dev.: 0.0138) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.33% (23.5781 => 25.3070, std.dev.: 0.0431) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.04% (3.9917 => 4.2727, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.39% (3.3761 => 3.5918, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.19% (2.9753 => 3.1594, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 6.04% (4.8660 => 5.1599, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.84% (4.5327 => 4.7973, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 5.47% (0.4353 => 0.4591, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.46% (0.3937 => 0.4152, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.38% (5.3218 => 5.6082, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.23% (5.4187 => 5.7019, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 5.16% (0.2015 => 0.2119, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 5.14% (0.5214 => 0.5482, std.dev.: 0.0066) MultiSource/Applications/aha/aha: 4.79% (3.3398 => 3.4999, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/lpbench: 4.72% (3.9006 => 4.0848, std.dev.: 0.0292) SingleSource/Benchmarks/Misc/richards_benchmark: 3.87% (1.3037 => 1.3542, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/power/power: 3.57% (1.2061 => 1.2492, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.94% (4.8362 => 4.9784, std.dev.: 0.0301) MultiSource/Applications/JM/lencod/lencod: 2.86% (6.7064 => 6.8985, std.dev.: 0.0283) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.36% (3.4104 => 3.4910, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/methcall: 2.07% (8.2676 => 8.4384, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.71% (11.5690 => 11.7673, std.dev.: 0.0164) SingleSource/Benchmarks/McGill/queens: 1.69% (1.7056 => 1.7344, std.dev.: 0.0067) MultiSource/Applications/spiff/spiff: 1.44% (2.8561 => 2.8971, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.34% (4.9469 => 5.0130, std.dev.: 0.0232) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.30% (1.5941 => 1.6149, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.05% (1.9302 => 1.9505, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.44% (2.8951 => 1.6663, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -26.01% (7.2130 => 5.3366, std.dev.: 0.4165) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.55% (1.4529 => 1.1543, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.95% (9.9065 => 8.2270, std.dev.: 0.0396) SingleSource/Benchmarks/Shootout-C++/ary3: -13.33% (1.9999 => 1.7333, std.dev.: 0.0157) MultiSource/Benchmarks/Olden/em3d/em3d: -13.26% (5.4641 => 4.7394, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/flops-8: -9.85% (2.5609 => 2.3087, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.05% (0.3269 => 0.2973, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -8.97% (63.1822 => 57.5121, std.dev.: 0.0345) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.23% (1.0512 => 0.9647, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.35% (3.2169 => 2.9803, std.dev.: 0.0160) SingleSource/Benchmarks/Stanford/FloatMM: -6.69% (0.8807 => 0.8218, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.16% (4.7482 => 4.4555, std.dev.: 0.0587) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.11% (5.1305 => 4.8172, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout/sieve: -6.07% (7.0599 => 6.6311, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (0.6910 => 0.6523, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/flops: -5.56% (9.3748 => 8.8531, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/ffbench: -5.37% (1.4296 => 1.3528, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.32% (6.2275 => 5.8964, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.85% (5.6343 => 5.3612, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/heapsort: -4.76% (3.2926 => 3.1358, std.dev.: 0.0602) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.65% (22.2997 => 21.2621, std.dev.: 0.3477) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.54% (4.7449 => 4.5295, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.27% (4.9453 => 4.7342, std.dev.: 0.0154) MultiSource/Applications/siod/siod: -4.26% (3.6643 => 3.5081, std.dev.: 0.0302) MultiSource/Applications/lua/lua: -3.89% (29.8330 => 28.6728, std.dev.: 0.3839) SingleSource/Benchmarks/Misc/perlin: -3.89% (5.1084 => 4.9098, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.82% (3.7148 => 3.5729, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -3.76% (8.9760 => 8.6387, std.dev.: 0.0640) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.20% (5.4300 => 5.2562, std.dev.: 0.0200) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.01% (1.3882 => 1.3464, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout/hash: -2.73% (4.3087 => 4.1910, std.dev.: 0.0316) SingleSource/Benchmarks/Misc/fbench: -2.63% (3.3840 => 3.2951, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.54% (2.8773 => 2.8042, std.dev.: 0.0246) MultiSource/Benchmarks/Olden/tsp/tsp: -2.17% (1.4861 => 1.4538, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.97% (3.3479 => 3.2819, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-5: -1.87% (2.8957 => 2.8416, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.77% (3.5679 => 3.5047, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/flops-6: -1.68% (2.4416 => 2.4005, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (15.8853 => 15.6221, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/neural/neural: -1.46% (1.0841 => 1.0683, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.26% (4.2466 => 4.1931, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.16% (1.5308 => 1.5131, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.12% (6.0224 => 5.9548, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.12% (4.7794 => 4.7258, std.dev.: 0.0077) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 5.12% (1.0262 => 1.0787, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.78% (0.2463 => 0.3689, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 79.67% (0.0123 => 0.0221, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 12.99% (0.0254 => 0.0287, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 5.73% (0.0384 => 0.0406, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/casts: -13.68% (0.0190 => 0.0164, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/test1: 1.11% (0.0180 => 0.0182, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.74% (0.1438 => 0.1463, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -3.71% (1.1329 => 1.0909, std.dev.: 0.0580) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.25% (0.4164 => 0.3987, std.dev.: 0.0666) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.38% (0.1369 => 0.1429, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.34% (0.0641 => 0.0626, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.13% (0.0195 => 0.0205, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.50% (0.0578 => 0.0604, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.37% (1.1437 => 1.1395, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 200.00% (0.0001 => 0.0003, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -18.50% (0.0627 => 0.0511, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 28.89% (0.0180 => 0.0232, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.27% (0.8017 => 0.8039, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -22.58% (0.0062 => 0.0048, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 3.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 01:16:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 03:16:42 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121129091642.4CC2D2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6374?compare_to=6371&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6374, Order: 168856, Start Time: 2012-11-29 07:39:52, End Time: 2012-11-29 09:17:16 To: 6371, Order: 168854, Start Time: 2012-11-29 05:43:18, End Time: 2012-11-29 07:16:53 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (130 on baseline) Added Tests: 0 (52 on baseline) Unchanged Tests: 1093 (906 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.82% (78.4167 => 80.6256, std.dev.: 0.0964) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 16.88% (0.3834 => 0.4481, std.dev.: 0.0186) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.29% (1.2783 => 1.3715, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: 2.85% (7.4937 => 7.7073, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1013, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 2.19% (3.1932 => 3.2632, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.14% (79.7170 => 80.6256, std.dev.: 0.0964) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.53% (0.1431 => 0.1309, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.59% (0.3821 => 0.3531, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.81% (0.9542 => 0.8892, std.dev.: 0.0173) MultiSource/Benchmarks/PAQ8p/paq8p: -6.69% (2.4924 => 2.3257, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0064) MultiSource/Applications/sgefa/sgefa: -6.37% (0.3357 => 0.3143, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -6.02% (9.2283 => 8.6724, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/oourafft: -6.02% (0.2160 => 0.2030, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -6.01% (0.1879 => 0.1766, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.90% (0.1796 => 0.1690, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: -5.86% (16.1920 => 15.2428, std.dev.: 0.0081) SingleSource/Benchmarks/McGill/chomp: -5.85% (0.1761 => 0.1658, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -5.80% (7.0961 => 6.6842, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.71% (1.3722 => 1.2938, std.dev.: 0.0261) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.69% (0.5575 => 0.5258, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.64% (0.2695 => 0.2543, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.62% (0.5805 => 0.5479, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.57% (0.6660 => 0.6289, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: -5.57% (0.3896 => 0.3679, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.57% (0.3880 => 0.3664, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -5.56% (0.3812 => 0.3600, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.56% (0.3831 => 0.3618, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.54% (0.3848 => 0.3635, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.53% (3.5339 => 3.3383, std.dev.: 0.0160) MultiSource/Applications/lemon/lemon: -5.52% (1.1450 => 1.0818, std.dev.: 0.0075) SingleSource/UnitTests/ObjC/for-in: -5.50% (0.4033 => 0.3811, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.47% (0.6304 => 0.5959, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.42% (0.3931 => 0.3718, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions: -5.41% (0.4176 => 0.3950, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.38% (4.8802 => 4.6176, std.dev.: 0.0948) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.38% (0.5802 => 0.5490, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.36% (0.6395 => 0.6052, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -5.36% (0.9179 => 0.8687, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.35% (0.5941 => 0.5623, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.34% (6.7716 => 6.4097, std.dev.: 0.1374) MultiSource/Benchmarks/McCat/05-eks/eks: -5.34% (0.4515 => 0.4274, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.33% (0.3884 => 0.3677, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.30% (0.6194 => 0.5866, std.dev.: 0.0088) MultiSource/Applications/SIBsim4/SIBsim4: -5.29% (1.3864 => 1.3130, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.29% (0.3891 => 0.3685, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.27% (0.6033 => 0.5715, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.26% (0.5688 => 0.5389, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.24% (0.6676 => 0.6326, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.23% (0.5567 => 0.5276, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/matrix: -5.22% (0.3255 => 0.3085, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.22% (0.5859 => 0.5553, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.17% (0.3252 => 0.3084, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.15% (0.3323 => 0.3152, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.14% (0.3016 => 0.2861, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.13% (1.3148 => 1.2474, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: -5.12% (17.1032 => 16.2274, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.10% (0.3057 => 0.2901, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -5.07% (0.4199 => 0.3986, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.06% (0.2985 => 0.2834, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: -5.06% (0.3025 => 0.2872, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.05% (0.4321 => 0.4103, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/objinst: -4.98% (0.3194 => 0.3035, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.97% (0.7198 => 0.6840, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.95% (0.3837 => 0.3647, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -4.95% (1.2515 => 1.1896, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.94% (0.3483 => 0.3311, std.dev.: 0.0057) SingleSource/Regression/C++/ofstream_ctor: -4.94% (0.3059 => 0.2908, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.91% (2.1713 => 2.0647, std.dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/hash2: -4.88% (0.4861 => 0.4624, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.87% (0.4151 => 0.3949, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -4.86% (0.4280 => 0.4072, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: -4.86% (0.3581 => 0.3407, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: -4.83% (15.5079 => 14.7592, std.dev.: 0.0050) MultiSource/Applications/d/make_dparser: -4.83% (3.5154 => 3.3457, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: -4.80% (0.3481 => 0.3314, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.77% (0.2871 => 0.2734, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -4.75% (15.2527 => 14.5288, std.dev.: 0.0258) MultiSource/Applications/minisat/minisat: -4.73% (0.7447 => 0.7095, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.72% (1.6474 => 1.5696, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.71% (0.2933 => 0.2795, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.70% (0.4813 => 0.4587, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.68% (0.2903 => 0.2767, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.66% (0.5168 => 0.4927, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: -4.66% (0.2939 => 0.2802, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.65% (0.3849 => 0.3670, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.65% (0.3205 => 0.3056, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -4.61% (34.0927 => 32.5196, std.dev.: 0.0355) SingleSource/Benchmarks/Shootout-C++/lists: -4.61% (0.3621 => 0.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: -4.56% (0.2849 => 0.2719, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.56% (0.5329 => 0.5086, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: -4.56% (0.3446 => 0.3289, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.55% (0.6440 => 0.6147, std.dev.: 0.0086) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.54% (22.4056 => 21.3873, std.dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (0.7021 => 0.6702, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -4.54% (4.0594 => 3.8752, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary: -4.54% (0.3394 => 0.3240, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -4.52% (0.3271 => 0.3123, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: -4.50% (0.3867 => 0.3693, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -4.48% (0.2989 => 0.2855, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -4.46% (2.1401 => 2.0446, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -4.46% (2.4021 => 2.2950, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.45% (0.9557 => 0.9132, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.36% (0.4427 => 0.4234, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: -4.34% (18.2933 => 17.4988, std.dev.: 0.0215) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.33% (0.5456 => 0.5220, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/moments: -4.31% (0.4248 => 0.4065, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -4.24% (0.6750 => 0.6464, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: -4.20% (0.3788 => 0.3629, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: -4.20% (5.0226 => 4.8118, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: -4.20% (0.7982 => 0.7647, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.09% (0.4083 => 0.3916, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: -4.09% (0.4524 => 0.4339, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -4.04% (0.8418 => 0.8078, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.84% (2.2587 => 2.1720, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.84% (0.3491 => 0.3357, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.70% (0.6347 => 0.6112, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: -3.66% (0.6441 => 0.6205, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -3.52% (0.7779 => 0.7505, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -3.33% (1.5610 => 1.5090, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.05% (5.4682 => 5.3015, std.dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -2.32% (20.7746 => 20.2936, std.dev.: 0.0186) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1948, std.dev.: 0.0119) SingleSource/Benchmarks/Dhrystone/fldry: -62.23% (1.8100 => 0.6836, std.dev.: 0.0187) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7504, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: -8.62% (1.2842 => 1.1735, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.70% (2.2633 => 2.1796, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3999, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4742, std.dev.: 0.0103) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 02:30:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 04:30:13 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121129103013.A2DF52A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6375?compare_to=6369&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6375, Order: 168856, Start Time: 2012-11-29 07:53:57, End Time: 2012-11-29 10:30:47 To: 6369, Order: 168851, Start Time: 2012-11-29 04:23:57, End Time: 2012-11-29 06:47:50 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 30 (135 on baseline) Performance Improvements: 2 (42 on baseline) Added Tests: 0 (186 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1056 (708 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 14.37% (0.5924 => 0.6775, std.dev.: 0.0297) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 14.05% (4.5870 => 5.2313, std.dev.: 0.0204) MultiSource/Applications/lambda-0_1_3/lambda: 13.70% (0.8577 => 0.9752, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 13.70% (0.7207 => 0.8194, std.dev.: 0.0302) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 12.92% (0.5942 => 0.6710, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 12.49% (0.6715 => 0.7554, std.dev.: 0.0153) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.01% (0.1174 => 0.1315, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.82% (2.2598 => 2.5268, std.dev.: 0.0194) SingleSource/UnitTests/ObjC/BoolLiteralTest: 11.35% (0.4000 => 0.4454, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/ReedSolomon: 10.03% (0.2194 => 0.2414, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/matrix: 9.89% (0.3378 => 0.3712, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.16% (0.6157 => 0.6721, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.58% (0.2202 => 0.2391, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 7.98% (0.3133 => 0.3383, std.dev.: 0.0054) MultiSource/Benchmarks/sim/sim: 6.76% (0.3728 => 0.3980, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.70% (1.5680 => 1.6731, std.dev.: 0.0370) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.34% (0.3219 => 0.3423, std.dev.: 0.0072) SingleSource/Regression/C++/ofstream_ctor: 6.26% (0.3163 => 0.3361, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.18% (7.9727 => 8.4652, std.dev.: 0.1322) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.02% (0.9516 => 1.0089, std.dev.: 0.0143) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.16% (0.3335 => 0.3507, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/health/health: 9.45% (0.4637 => 0.5075, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 8.95% (2.7547 => 3.0012, std.dev.: 0.0399) SingleSource/Benchmarks/Dhrystone/fldry: 5.44% (0.6618 => 0.6978, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/bh/bh: 4.34% (1.9557 => 2.0406, std.dev.: 0.0319) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.82% (1.5620 => 1.6061, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.78% (59.3688 => 61.0185, std.dev.: 0.5203) SingleSource/Benchmarks/Shootout-C++/lists1: 2.63% (0.6167 => 0.6329, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.93% (6.0347 => 6.1511, std.dev.: 0.0244) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.40% (3.4648 => 3.5134, std.dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -8.28% (0.6788 => 0.6226, std.dev.: 0.0140) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: -1.20% (18.7242 => 18.4986, std.dev.: 0.0864) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -2.33% (68.2823 => 66.6885, std.dev.: 0.7113) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -1.03% (0.1355 => 0.1341, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0419 => 0.0420, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0652 => 0.0652, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: -0.19% (493.9203 => 492.9973, std.dev.: 0.4665) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 5.45% (63.2438 => 66.6885, std.dev.: 0.7113) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43617.06% (1.1277 => 492.9973, std.dev.: 0.4665) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 217.08% (0.5229 => 1.6580, std.dev.: 0.0536) MultiSource/Applications/SPASS/SPASS: 17.98% (14.9895 => 17.6846, std.dev.: 0.6102) MultiSource/Applications/kimwitu++/kc: 50.94% (14.1553 => 21.3659, std.dev.: 0.3842) MultiSource/Benchmarks/MallocBench/gs/gs: 14.98% (4.1105 => 4.7263, std.dev.: 0.2651) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 44.42% (1.1048 => 1.5956, std.dev.: 0.0330) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 434.97% (7.1582 => 38.2940, std.dev.: 0.3289) SingleSource/Benchmarks/Misc-C++-EH/spirit: 89.42% (3.4629 => 6.5593, std.dev.: 0.1861) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.65% (0.6222 => 1.0307, std.dev.: 0.0668) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10357.78% (0.0720 => 7.5296, std.dev.: 0.3488) MultiSource/Applications/SIBsim4/SIBsim4: 3867200.00% (0.0001 => 3.8673, std.dev.: 0.0329) MultiSource/Applications/SPASS/SPASS: 12955900.00% (0.0001 => 12.9560, std.dev.: 2.1313) MultiSource/Applications/kimwitu++/kc: 52500.00% (0.0001 => 0.0526, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 64300.00% (0.0001 => 0.0644, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14400.00% (0.0001 => 0.0145, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 580700.00% (0.0001 => 0.5808, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10013900.00% (0.0001 => 10.0140, std.dev.: 0.0250) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5679600.00% (0.0001 => 5.6797, std.dev.: 0.7213) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1706.87% (1.1194 => 20.2261, std.dev.: 0.8298) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 78.03% (2.9384 => 5.2313, std.dev.: 0.0204) MultiSource/Applications/ClamAV/clamscan: 69.94% (22.1758 => 37.6854, std.dev.: 0.2984) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 51.62% (7.0540 => 10.6954, std.dev.: 0.4704) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.52% (8.1363 => 12.0027, std.dev.: 0.3763) MultiSource/Applications/JM/lencod/lencod: 46.95% (21.9371 => 32.2361, std.dev.: 0.2494) MultiSource/Benchmarks/FreeBench/distray/distray: 44.79% (0.1056 => 0.1529, std.dev.: 0.0064) SingleSource/UnitTests/vla: 38.87% (0.0355 => 0.0493, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 38.13% (0.1432 => 0.1978, std.dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/almabench: 38.08% (0.0730 => 0.1008, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 31.20% (0.7433 => 0.9752, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/tsp/tsp: 29.62% (0.1175 => 0.1523, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/voronoi/voronoi: 26.78% (0.2700 => 0.3423, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/bisort/bisort: 26.38% (0.0614 => 0.0776, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/family/family: 26.20% (0.0397 => 0.0501, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: 25.40% (0.0626 => 0.0785, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 25.15% (0.0672 => 0.0841, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.80% (0.1125 => 0.1404, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: 24.00% (0.0871 => 0.1080, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.99% (0.0746 => 0.0925, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 23.91% (0.6675 => 0.8271, std.dev.: 0.0189) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.46% (0.8172 => 1.0089, std.dev.: 0.0143) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 23.34% (0.0467 => 0.0576, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 23.11% (0.0528 => 0.0650, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 22.98% (0.0953 => 0.1172, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 22.96% (2.2969 => 2.8242, std.dev.: 0.0889) MultiSource/Benchmarks/Prolangs-C++/city/city: 22.27% (2.0665 => 2.5268, std.dev.: 0.0194) MultiSource/Benchmarks/Olden/health/health: 22.00% (0.1268 => 0.1547, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/life/life: 21.97% (0.0933 => 0.1138, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.56% (0.0770 => 0.0936, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.49% (0.5569 => 0.6766, std.dev.: 0.0279) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.46% (0.1566 => 0.1902, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/whetstone: 21.21% (0.0660 => 0.0800, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 20.77% (0.0491 => 0.0593, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.33% (0.1584 => 0.1906, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout/matrix: 19.93% (0.0818 => 0.0981, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: 19.82% (0.3098 => 0.3712, std.dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.50% (0.4615 => 0.5515, std.dev.: 0.0128) MultiSource/Benchmarks/VersaBench/bmm/bmm: 19.50% (0.0759 => 0.0907, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0704 => 0.0832, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 18.16% (1.5859 => 1.8739, std.dev.: 0.0942) SingleSource/Benchmarks/Shootout-C++/lists1: 17.94% (0.3684 => 0.4345, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.94% (1.4186 => 1.6731, std.dev.: 0.0370) SingleSource/Benchmarks/Misc/ReedSolomon: 17.81% (0.2049 => 0.2414, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/bigfib: 17.63% (0.6456 => 0.7594, std.dev.: 0.0294) SingleSource/Benchmarks/Shootout-C++/methcall: 17.59% (0.2877 => 0.3383, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.58% (14.3668 => 16.8930, std.dev.: 0.6463) MultiSource/Benchmarks/sim/sim: 17.51% (0.3387 => 0.3980, std.dev.: 0.0083) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.46% (0.0842 => 0.0989, std.dev.: 0.0042) MultiSource/Applications/lua/lua: 17.33% (3.8723 => 4.5435, std.dev.: 0.1816) MultiSource/Applications/hbd/hbd: 17.30% (1.5603 => 1.8302, std.dev.: 0.0691) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 17.18% (0.3650 => 0.4277, std.dev.: 0.0190) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.04% (0.5105 => 0.5975, std.dev.: 0.0268) SingleSource/UnitTests/ObjC/messages-2: 16.77% (0.0662 => 0.0773, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/mst/mst: 16.77% (0.1163 => 0.1358, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.67% (0.0834 => 0.0973, std.dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 16.55% (1.1840 => 1.3800, std.dev.: 0.0521) SingleSource/Benchmarks/CoyoteBench/lpbench: 16.47% (0.0929 => 0.1082, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.26% (0.8101 => 0.9418, std.dev.: 0.0338) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.09% (4.2646 => 4.9507, std.dev.: 0.2282) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 16.01% (0.2430 => 0.2819, std.dev.: 0.0099) MultiSource/Benchmarks/mafft/pairlocalalign: 15.86% (9.4845 => 10.9885, std.dev.: 0.3911) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.74% (0.0648 => 0.0750, std.dev.: 0.0031) SingleSource/Regression/C++/ofstream_ctor: 15.70% (0.2905 => 0.3361, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 15.53% (0.1906 => 0.2202, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 15.53% (0.1655 => 0.1912, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.46% (0.0886 => 0.1023, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.45% (0.2065 => 0.2384, std.dev.: 0.0108) MultiSource/Benchmarks/Olden/bh/bh: 15.43% (0.3092 => 0.3569, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/fibo: 15.38% (0.2725 => 0.3144, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.31% (0.1117 => 0.1288, std.dev.: 0.0050) SingleSource/UnitTests/SignlessTypes/rem: 15.21% (0.1144 => 0.1318, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.93% (0.3121 => 0.3587, std.dev.: 0.0178) MultiSource/Benchmarks/NPB-serial/is/is: 14.74% (0.0719 => 0.0825, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.62% (0.2107 => 0.2415, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.23% (0.5981 => 0.6832, std.dev.: 0.0231) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.19% (0.1029 => 0.1175, std.dev.: 0.0049) MultiSource/Applications/oggenc/oggenc: 14.16% (5.7591 => 6.5744, std.dev.: 0.2540) SingleSource/UnitTests/ObjC++/property-reference: 14.14% (0.7326 => 0.8362, std.dev.: 0.0110) MultiSource/Applications/spiff/spiff: 14.12% (0.7835 => 0.8941, std.dev.: 0.0384) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.98% (0.4064 => 0.4632, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.91% (0.1337 => 0.1523, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.75% (0.1062 => 0.1208, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/18-imp/imp: 13.56% (0.3423 => 0.3887, std.dev.: 0.0164) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.39% (0.2271 => 0.2575, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.23% (4.9449 => 5.5989, std.dev.: 0.2007) SingleSource/UnitTests/ObjC/parameter-passing: 12.38% (0.3927 => 0.4413, std.dev.: 0.0101) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.17% (0.0838 => 0.0940, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/property: 12.09% (0.3886 => 0.4356, std.dev.: 0.0098) MultiSource/Applications/sqlite3/sqlite3: 11.98% (17.1811 => 19.2397, std.dev.: 0.5872) SingleSource/UnitTests/ObjC/exceptions-4: 11.71% (0.3543 => 0.3958, std.dev.: 0.0085) SingleSource/UnitTests/ObjC/exceptions: 11.70% (0.3828 => 0.4276, std.dev.: 0.0100) SingleSource/UnitTests/ObjC/synchronized: 11.68% (0.3561 => 0.3977, std.dev.: 0.0078) SingleSource/UnitTests/ObjC/exceptions-2: 11.55% (0.3497 => 0.3901, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/trivial-interface: 11.55% (0.3473 => 0.3874, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.54% (0.3543 => 0.3952, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/hello: 11.46% (0.2714 => 0.3025, std.dev.: 0.0106) SingleSource/UnitTests/ObjC/exceptions-3: 11.43% (0.3516 => 0.3918, std.dev.: 0.0083) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.37% (0.1143 => 0.1273, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/for-in: 11.32% (0.3694 => 0.4112, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/05-eks/eks: 11.10% (0.4299 => 0.4776, std.dev.: 0.0185) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.39% (0.3177 => 0.3507, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.35% (0.4636 => 0.5116, std.dev.: 0.0170) SingleSource/UnitTests/ObjC++/property-reference-object: 9.93% (0.6030 => 0.6629, std.dev.: 0.0137) SingleSource/UnitTests/ObjC++/Hello: 9.86% (0.5925 => 0.6509, std.dev.: 0.0131) MultiSource/Benchmarks/PAQ8p/paq8p: 8.55% (10.3673 => 11.2541, std.dev.: 0.2308) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.32% (7.9617 => 8.4652, std.dev.: 0.1322) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.52% (0.2266 => 0.2391, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 149.49% (4.3953 => 10.9660, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/methcall: 147.54% (5.3999 => 13.3668, std.dev.: 0.0073) MultiSource/Benchmarks/llubenchmark/llu: 96.85% (3.7781 => 7.4372, std.dev.: 0.5552) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.97% (1.1145 => 1.3036, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/oourafft: 16.14% (6.6465 => 7.7195, std.dev.: 0.0155) MultiSource/Benchmarks/Olden/health/health: 14.17% (0.4445 => 0.5075, std.dev.: 0.0092) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.28% (0.2944 => 0.3335, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.57% (2.8904 => 3.2248, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/richards_benchmark: 10.20% (1.1396 => 1.2558, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.30% (1.7254 => 1.8859, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.90% (4.2280 => 4.4775, std.dev.: 0.0107) MultiSource/Applications/lua/lua: 5.44% (26.0924 => 27.5130, std.dev.: 0.0398) MultiSource/Benchmarks/Olden/bh/bh: 5.16% (1.9405 => 2.0406, std.dev.: 0.0319) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.08% (0.3070 => 0.3226, std.dev.: 0.0052) MultiSource/Benchmarks/nbench/nbench: 4.12% (11.6436 => 12.1234, std.dev.: 0.0214) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.34% (0.4162 => 0.4301, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 2.56% (0.6171 => 0.6329, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 2.13% (3.1595 => 3.2267, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.60% (6.5088 => 6.6127, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.38% (2.3135 => 2.3454, std.dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.29% (1.0313 => 1.0446, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 1.22% (5.2636 => 5.3279, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0499, std.dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1685, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.35% (5.2763 => 1.2480, std.dev.: 0.0509) SingleSource/Benchmarks/Misc/salsa20: -75.27% (0.8651 => 0.2139, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/richards_benchmark: -44.64% (0.1622 => 0.0898, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.04% (5.3855 => 4.6834, std.dev.: 0.1513) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.39% (5.3526 => 4.6896, std.dev.: 0.1720) MultiSource/Applications/JM/ldecod/ldecod: -10.66% (10.4361 => 9.3232, std.dev.: 0.3844) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -68.47% (32.5116 => 10.2522, std.dev.: 0.0081) SingleSource/Benchmarks/Dhrystone/fldry: -64.36% (1.9577 => 0.6978, std.dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1681, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.21% (0.3987 => 0.2384, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.23% (4.5009 => 2.7804, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.17% (2.6546 => 2.0129, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/mason/mason: -19.44% (0.2161 => 0.1741, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4258, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2841, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -10.54% (9.5636 => 8.5554, std.dev.: 0.1144) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.51% (1.5660 => 1.4327, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.27% (19.9488 => 18.4986, std.dev.: 0.0864) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4813, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.77% (3.2416 => 3.0547, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.54% (2.7294 => 2.5782, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.14% (0.8614 => 0.8171, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5065, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.77% (0.2497 => 0.2378, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -4.47% (6.2999 => 6.0182, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.43% (1.6805 => 1.6061, std.dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.39% (0.9957 => 0.9619, std.dev.: 0.0043) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8916, std.dev.: 0.0049) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.27% (0.4808 => 0.4699, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.84% (8.1563 => 8.0064, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/salsa20: -1.67% (10.2830 => 10.1115, std.dev.: 0.0109) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.70% (0.1485 => 0.1341, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0024) Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 02:59:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 04:59:43 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121129105943.C0C3D2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6376?compare_to=6373&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6376, Order: 168862, Start Time: 2012-11-29 09:25:38, End Time: 2012-11-29 11:00:19 To: 6373, Order: 168856, Start Time: 2012-11-29 07:27:09, End Time: 2012-11-29 08:57:35 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 12 (95 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (51 on baseline) Existing Failures: 42 (40 on baseline) Unchanged Tests: 1040 (840 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.60% (0.0750 => 0.0882, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.23% (0.2074 => 0.2224, std.dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: 2.81% (8.4551 => 8.6930, std.dev.: 0.0750) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.85% (1.3002 => 1.3242, std.dev.: 0.0079) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel24: 59.34% (0.2184 => 0.3480, std.dev.: 0.0415) MultiSource/Benchmarks/Olden/mst/mst: 36.34% (0.1406 => 0.1917, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 11.02% (1.6925 => 1.8790, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 9.47% (21.2621 => 23.2757, std.dev.: 0.7431) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.92% (15.7872 => 17.1962, std.dev.: 0.1591) SingleSource/Benchmarks/Dhrystone/fldry: 3.59% (0.6523 => 0.6757, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.16% (5.3366 => 5.4517, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/except: 2.09% (0.4881 => 0.4983, std.dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.41% (1.0787 => 1.0831, std.dev.: 0.0547) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.46% (0.3689 => 0.3706, std.dev.: 0.0051) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.45% (0.0221 => 0.0222, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -14.95% (0.0428 => 0.0364, std.dev.: 0.0141) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -8.01% (0.0287 => 0.0264, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0315 => 0.0316, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.23% (0.0406 => 0.0411, std.dev.: 0.0119) SingleSource/UnitTests/Vector/Altivec/casts: 7.32% (0.0164 => 0.0176, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/test1: 21.98% (0.0182 => 0.0222, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/Burg/burg: 1300.00% (0.0001 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1463 => 0.1465, std.dev.: 0.0253) MultiSource/Applications/lemon/lemon: 6.96% (1.0909 => 1.1668, std.dev.: 0.3542) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.43% (0.3987 => 0.4004, std.dev.: 0.0193) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.61% (0.1429 => 0.1452, std.dev.: 0.0205) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.92% (0.0626 => 0.0638, std.dev.: 0.0188) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 24.88% (0.0205 => 0.0256, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.45% (0.0604 => 0.0559, std.dev.: 0.0138) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.81% (1.1395 => 1.1487, std.dev.: 0.0402) MultiSource/Benchmarks/SciMark2-C/scimark2: -0.11% (9.4059 => 9.3951, std.dev.: 0.0369) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 866.67% (0.0003 => 0.0029, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 18.00% (0.0511 => 0.0603, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.22% (0.0232 => 0.0265, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.07% (0.8039 => 0.8033, std.dev.: 0.0140) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0007 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.00% (0.0048 => 0.0036, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.04% (34.4487 => 34.4366, std.dev.: 0.0622) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Benchmarks/SciMark2-C/scimark2: -67.13% (28.5821 => 9.3951, std.dev.: 0.0369) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.89% (16.4461 => 17.9081, std.dev.: 0.7024) MultiSource/Applications/sqlite3/sqlite3: 2347.30% (0.6332 => 15.4963, std.dev.: 0.8903) MultiSource/Benchmarks/McCat/08-main/main: 48.83% (0.1831 => 0.2725, std.dev.: 0.0192) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.81% (0.1559 => 0.1484, std.dev.: 0.0059) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7086.01% (0.3123 => 22.4419, std.dev.: 0.1024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1563.04% (0.3344 => 5.5612, std.dev.: 0.2314) SingleSource/Benchmarks/Misc-C++/Large/ray: 39.09% (0.2364 => 0.3288, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/bigfib: 5.92% (0.6010 => 0.6366, std.dev.: 0.0341) SingleSource/Benchmarks/Misc/mandel: 0.47% (0.0429 => 0.0431, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.82% (0.3266 => 0.3456, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/strcat: 4.57% (0.1969 => 0.2059, std.dev.: 0.0011) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -8.48% (0.0224 => 0.0205, std.dev.: 0.0019) SingleSource/UnitTests/byval-alignment: -26.09% (0.0230 => 0.0170, std.dev.: 0.0047) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0519, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 12.38% (0.1462 => 0.1643, std.dev.: 0.0271) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4343, std.dev.: 0.0990) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0700, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4925, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5136, std.dev.: 0.0148) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2778, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0687, std.dev.: 0.0213) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3637, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3687, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0783, std.dev.: 0.0034) SingleSource/Regression/C/uint64_to_float: -29.85% (2.1832 => 1.5315, std.dev.: 0.0070) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.10% (0.0773 => 0.0882, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.74% (0.0848 => 0.0956, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.32% (0.1425 => 0.1572, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.84% (0.4127 => 0.4533, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.65% (0.3295 => 0.3613, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.72% (0.6010 => 0.6534, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 8.65% (0.6287 => 0.6831, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.32% (2.1401 => 2.3182, std.dev.: 0.0172) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.24% (0.1905 => 0.2043, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.17% (1.3279 => 1.4231, std.dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.10% (1.5315 => 1.6402, std.dev.: 0.0288) MultiSource/Benchmarks/sim/sim: 6.76% (0.3226 => 0.3444, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.63% (0.3137 => 0.3345, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/football/football: 6.57% (0.8768 => 0.9344, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.17% (1.2526 => 1.3299, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.16% (0.3003 => 0.3188, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.13% (0.6227 => 0.6609, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.00% (0.2133 => 0.2261, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.93% (0.5191 => 0.5499, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.87% (0.1756 => 0.1859, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.47% (0.5961 => 0.6287, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.35% (0.2111 => 0.2224, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.26% (0.2378 => 0.2503, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.24% (0.8656 => 0.9110, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.08% (1.2602 => 1.3242, std.dev.: 0.0079) MultiSource/Benchmarks/MallocBench/gs/gs: 5.06% (4.1305 => 4.3394, std.dev.: 0.0210) MultiSource/Benchmarks/nbench/nbench: 4.90% (1.1271 => 1.1823, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 4.72% (0.8805 => 0.9221, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 4.71% (0.8712 => 0.9122, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.63% (0.9908 => 1.0367, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.43% (0.4559 => 0.4761, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 4.37% (2.3764 => 2.4802, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.36% (0.8286 => 0.8647, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 4.35% (0.8359 => 0.8723, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 4.34% (0.9069 => 0.9463, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.32% (0.8457 => 0.8822, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 4.31% (0.9039 => 0.9429, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.28% (0.5817 => 0.6066, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.25% (0.6586 => 0.6866, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.07% (0.8050 => 0.8378, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 4.05% (0.8048 => 0.8374, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.04% (0.8069 => 0.8395, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.04% (0.8518 => 0.8862, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 4.04% (0.8177 => 0.8507, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.03% (0.7966 => 0.8287, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.00% (0.8420 => 0.8757, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.99% (0.8855 => 0.9208, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 3.98% (8.6247 => 8.9682, std.dev.: 0.0244) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.97% (0.8317 => 0.8647, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.94% (0.2844 => 0.2956, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 3.91% (0.8927 => 0.9276, std.dev.: 0.0117) MultiSource/Applications/minisat/minisat: 3.88% (0.6834 => 0.7099, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.75% (0.8204 => 0.8512, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.66% (0.3657 => 0.3791, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.37% (8.6476 => 8.9392, std.dev.: 0.0858) SingleSource/UnitTests/Vector/constpool: 3.27% (8.4179 => 8.6930, std.dev.: 0.0750) MultiSource/Benchmarks/Bullet/bullet: 2.94% (31.8598 => 32.7980, std.dev.: 0.2304) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 39.37% (1.5795 => 2.2013, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/mst/mst: 38.31% (0.1386 => 0.1917, std.dev.: 0.0153) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 28.39% (2.9096 => 3.7356, std.dev.: 0.1120) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.27% (4.8436 => 5.8737, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.86% (8.2783 => 9.7569, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.42% (14.6451 => 17.1962, std.dev.: 0.1591) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.55% (0.7597 => 0.8854, std.dev.: 0.0078) SingleSource/Benchmarks/McGill/misr: 16.25% (0.4001 => 0.4651, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.75% (0.3186 => 0.3624, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.07% (6.3772 => 7.1470, std.dev.: 0.1821) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.50% (2.7995 => 3.1214, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.36% (0.1129 => 0.1246, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 10.21% (7.4933 => 8.2581, std.dev.: 0.0406) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.18% (1.1857 => 1.3064, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 8.85% (3.9917 => 4.3450, std.dev.: 0.0927) MultiSource/Benchmarks/McCat/18-imp/imp: 7.74% (0.1370 => 0.1476, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.34% (23.5781 => 25.3094, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.34% (3.3761 => 3.5901, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.01% (2.9753 => 3.1540, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.92% (4.5327 => 4.8011, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.90% (4.8660 => 5.1529, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.43% (5.4187 => 5.7132, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.28% (5.3218 => 5.6027, std.dev.: 0.0281) MultiSource/Applications/aha/aha: 5.26% (3.3398 => 3.5154, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 5.20% (0.5214 => 0.5485, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 4.98% (0.3937 => 0.4133, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 4.61% (1.3037 => 1.3638, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 4.08% (4.8362 => 5.0336, std.dev.: 0.0491) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.26% (0.3587 => 0.3704, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/power/power: 3.00% (1.2061 => 1.2423, std.dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/dry: 2.44% (0.5081 => 0.5205, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.38% (3.4104 => 3.4916, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/methcall: 1.85% (8.2676 => 8.4204, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/ReedSolomon: 1.63% (8.5322 => 8.6709, std.dev.: 0.0342) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.53% (2.7978 => 2.8405, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.41% (11.5690 => 11.7321, std.dev.: 0.0518) MultiSource/Benchmarks/sim/sim: 1.17% (3.8206 => 3.8654, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.09% (1.9302 => 1.9513, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.14% (2.8951 => 1.6750, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -24.42% (7.2130 => 5.4517, std.dev.: 0.0168) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.34% (1.4529 => 1.1574, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.88% (9.9065 => 8.2341, std.dev.: 0.0303) MultiSource/Benchmarks/Olden/em3d/em3d: -13.22% (5.4641 => 4.7420, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/ary3: -11.50% (1.9999 => 1.7699, std.dev.: 0.0794) SingleSource/Benchmarks/Misc/flops-8: -9.52% (2.5609 => 2.3172, std.dev.: 0.0120) MultiSource/Benchmarks/mafft/pairlocalalign: -9.03% (63.1822 => 57.4764, std.dev.: 0.0105) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.57% (1.0512 => 0.9611, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.41% (0.3269 => 0.2994, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.22% (4.7482 => 4.4528, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.19% (5.1305 => 4.8128, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout/sieve: -6.10% (7.0599 => 6.6294, std.dev.: 0.0391) SingleSource/Benchmarks/Stanford/FloatMM: -5.70% (0.8807 => 0.8305, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/flops: -5.45% (9.3748 => 8.8635, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.44% (6.2275 => 5.8889, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.85% (5.6343 => 5.3612, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.63% (4.7449 => 4.5254, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.40% (6.1706 => 5.8993, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.21% (4.9453 => 4.7369, std.dev.: 0.0106) MultiSource/Applications/siod/siod: -3.97% (3.6643 => 3.5189, std.dev.: 0.0336) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.84% (3.7148 => 3.5720, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/perlin: -3.73% (5.1084 => 4.9181, std.dev.: 0.0132) MultiSource/Applications/lua/lua: -3.68% (29.8330 => 28.7352, std.dev.: 0.3140) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.66% (5.1557 => 4.9668, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/methcall: -3.60% (8.9760 => 8.6533, std.dev.: 0.0594) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.27% (4.9686 => 4.8059, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/himenobmtxpa: -3.26% (4.3552 => 4.2133, std.dev.: 0.0364) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.18% (5.4300 => 5.2572, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.76% (2.6356 => 2.5628, std.dev.: 0.0085) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.39% (2.8773 => 2.8084, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/fbench: -2.38% (3.3840 => 3.3036, std.dev.: 0.0130) SingleSource/Benchmarks/Dhrystone/fldry: -2.21% (0.6910 => 0.6757, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.10% (3.3479 => 3.2775, std.dev.: 0.0219) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.84% (3.5679 => 3.5023, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/fp-convert: -1.50% (15.8853 => 15.6463, std.dev.: 0.0282) MultiSource/Benchmarks/FreeBench/neural/neural: -1.46% (1.0841 => 1.0683, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.33% (4.2466 => 4.1902, std.dev.: 0.0098) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 5.54% (1.0262 => 1.0831, std.dev.: 0.0547) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.47% (0.2463 => 0.3706, std.dev.: 0.0051) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 80.49% (0.0123 => 0.0222, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -10.78% (0.0408 => 0.0364, std.dev.: 0.0141) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.94% (0.0254 => 0.0264, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 7.03% (0.0384 => 0.0411, std.dev.: 0.0119) SingleSource/UnitTests/Vector/Altivec/casts: -7.37% (0.0190 => 0.0176, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/test1: 23.33% (0.0180 => 0.0222, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 100.00% (0.0007 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.88% (0.1438 => 0.1465, std.dev.: 0.0253) MultiSource/Applications/lemon/lemon: 2.99% (1.1329 => 1.1668, std.dev.: 0.3542) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.84% (0.4164 => 0.4004, std.dev.: 0.0193) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.06% (0.1369 => 0.1452, std.dev.: 0.0205) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.47% (0.0641 => 0.0638, std.dev.: 0.0188) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 31.28% (0.0195 => 0.0256, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.29% (0.0578 => 0.0559, std.dev.: 0.0138) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.44% (1.1437 => 1.1487, std.dev.: 0.0402) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2800.00% (0.0001 => 0.0029, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.83% (0.0627 => 0.0603, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.22% (0.0180 => 0.0265, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.20% (0.8017 => 0.8033, std.dev.: 0.0140) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -41.94% (0.0062 => 0.0036, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 03:13:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 05:13:44 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121129111344.3A3BC2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/6377?compare_to=6374&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6377, Order: 168862, Start Time: 2012-11-29 09:40:41, End Time: 2012-11-29 11:14:18 To: 6374, Order: 168856, Start Time: 2012-11-29 07:39:52, End Time: 2012-11-29 09:17:16 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (184 on baseline) Added Tests: 0 (52 on baseline) Unchanged Tests: 1093 (853 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.72% (54.5119 => 56.5420, std.dev.: 0.0711) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.60% (54.5751 => 56.5420, std.dev.: 0.0711) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.53% (2.0478 => 2.0997, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: 2.53% (7.4937 => 7.6830, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/hash2: 2.10% (3.1932 => 3.2603, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.46% (0.1431 => 0.1310, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.46% (0.3821 => 0.3536, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.42% (0.9542 => 0.8834, std.dev.: 0.0105) MultiSource/Benchmarks/PAQ8p/paq8p: -6.75% (2.4924 => 2.3241, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.56% (0.3142 => 0.2936, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -6.37% (0.3357 => 0.3143, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -6.25% (0.2160 => 0.2025, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.22% (0.2428 => 0.2277, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -6.07% (0.1879 => 0.1765, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.05% (9.2283 => 8.6703, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.01% (0.1796 => 0.1688, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.85% (0.3880 => 0.3653, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -5.84% (16.1920 => 15.2471, std.dev.: 0.0100) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.81% (0.9852 => 0.9280, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.80% (0.6667 => 0.6280, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.80% (0.6052 => 0.5701, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -5.79% (0.3831 => 0.3609, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.79% (0.5581 => 0.5258, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -5.77% (0.9179 => 0.8649, std.dev.: 0.0109) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.77% (0.3884 => 0.3660, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.76% (0.6194 => 0.5837, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.76% (0.5591 => 0.5269, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -5.75% (7.0961 => 6.6878, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.74% (0.5805 => 0.5472, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.73% (1.3722 => 1.2936, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.72% (0.6681 => 0.6299, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: -5.71% (1.1530 => 1.0872, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.69% (0.6304 => 0.5945, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -5.69% (0.3848 => 0.3629, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.69% (0.6484 => 0.6115, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.68% (1.0544 => 0.9945, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: -5.67% (0.3896 => 0.3675, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.67% (0.6230 => 0.5877, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.65% (0.5925 => 0.5590, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -5.64% (0.3812 => 0.3597, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.64% (0.6260 => 0.5907, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.64% (0.5941 => 0.5606, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.63% (0.6395 => 0.6035, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.63% (0.4033 => 0.3806, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.62% (0.6189 => 0.5841, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.61% (0.5863 => 0.5534, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.61% (4.0323 => 3.8061, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.61% (0.2355 => 0.2223, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.60% (0.3658 => 0.3453, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.60% (0.5575 => 0.5263, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.59% (0.6676 => 0.6303, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.59% (0.7339 => 0.6929, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: -5.58% (0.4176 => 0.3943, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.58% (0.3891 => 0.3674, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.56% (1.2300 => 1.1616, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.55% (4.8161 => 4.5487, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.53% (0.2695 => 0.2546, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.52% (0.6395 => 0.6042, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.51% (3.5339 => 3.3392, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.50% (0.5802 => 0.5483, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.49% (0.5569 => 0.5263, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.49% (0.6297 => 0.5951, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: -5.45% (0.4515 => 0.4269, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.40% (0.3057 => 0.2892, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.40% (0.7524 => 0.7118, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.39% (0.5859 => 0.5543, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.39% (0.6660 => 0.6301, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.36% (1.2784 => 1.2099, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.35% (0.6033 => 0.5710, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.33% (0.7198 => 0.6814, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: -5.33% (1.3864 => 1.3125, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.33% (0.5705 => 0.5401, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.33% (0.5688 => 0.5385, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.32% (4.5069 => 4.2671, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.32% (0.5567 => 0.5271, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.32% (1.6364 => 1.5494, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -5.31% (1.1450 => 1.0842, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.28% (0.5570 => 0.5276, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.27% (4.8802 => 4.6231, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.25% (1.4642 => 1.3874, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.24% (14.2083 => 13.4636, std.dev.: 0.0198) MultiSource/Applications/hexxagon/hexxagon: -5.23% (1.3148 => 1.2460, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/property: -5.22% (0.4199 => 0.3980, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.21% (0.6736 => 0.6385, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: -5.19% (0.3255 => 0.3086, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.19% (0.3837 => 0.3638, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.14% (0.3406 => 0.3231, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.13% (0.3194 => 0.3030, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.13% (2.1713 => 2.0600, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: -5.12% (0.3025 => 0.2870, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.12% (0.2871 => 0.2724, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.12% (0.6293 => 0.5971, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.11% (0.5478 => 0.5198, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -5.11% (17.1032 => 16.2297, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.10% (6.7716 => 6.4264, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: -5.08% (4.3330 => 4.1127, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/random: -5.07% (0.2939 => 0.2790, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.07% (0.4813 => 0.4569, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.06% (0.2903 => 0.2756, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.06% (0.3931 => 0.3732, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.06% (0.4151 => 0.3941, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -5.05% (0.3205 => 0.3043, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.04% (0.3016 => 0.2864, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.01% (0.2933 => 0.2786, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -4.99% (1.2515 => 1.1890, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.98% (1.2221 => 1.1613, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: -4.96% (0.3446 => 0.3275, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.96% (8.0126 => 7.6151, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/except: -4.96% (0.3026 => 0.2876, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -4.95% (15.5079 => 14.7400, std.dev.: 0.0211) SingleSource/UnitTests/ObjC/parameter-passing: -4.93% (0.4280 => 0.4069, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -4.92% (0.2985 => 0.2838, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -4.91% (0.2849 => 0.2709, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.91% (0.8521 => 0.8103, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.91% (0.3323 => 0.3160, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: -4.88% (0.2989 => 0.2843, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.88% (0.3483 => 0.3313, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -4.88% (0.4861 => 0.4624, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -4.86% (0.3394 => 0.3229, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.84% (1.2210 => 1.1619, std.dev.: 0.0089) MultiSource/Applications/d/make_dparser: -4.83% (3.5154 => 3.3455, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.82% (0.4916 => 0.4679, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -4.82% (15.2527 => 14.5181, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.81% (0.5857 => 0.5575, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.80% (0.7919 => 0.7539, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: -4.79% (0.7447 => 0.7090, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.79% (0.6446 => 0.6137, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.79% (0.4321 => 0.4114, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.78% (0.2278 => 0.2169) MultiSource/Benchmarks/McCat/08-main/main: -4.78% (0.2659 => 0.2532, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -4.77% (0.3481 => 0.3315, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.76% (0.5168 => 0.4922, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.73% (0.3849 => 0.3667, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.70% (0.5849 => 0.5574, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -4.68% (0.4248 => 0.4049, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.67% (0.3252 => 0.3100, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.67% (0.2548 => 0.2429, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.66% (1.6474 => 1.5707, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: -4.65% (0.3867 => 0.3687, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -4.64% (0.3581 => 0.3415, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.62% (0.5999 => 0.5722, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.62% (0.5329 => 0.5083, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -4.61% (0.3621 => 0.3454, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.60% (0.7021 => 0.6698, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -4.59% (0.7779 => 0.7422, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.58% (0.5456 => 0.5206, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -4.54% (34.0927 => 32.5458, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.53% (0.6440 => 0.6148, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.53% (0.4083 => 0.3898, std.dev.: 0.0037) MultiSource/Applications/lua/lua: -4.53% (4.0594 => 3.8756, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.53% (22.4056 => 21.3913, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.50% (0.2999 => 0.2864, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.48% (0.9557 => 0.9129, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -4.47% (0.4524 => 0.4322, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: -4.34% (2.1401 => 2.0472, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.34% (0.4427 => 0.4235, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.30% (0.6347 => 0.6074, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -4.28% (0.6750 => 0.6461, std.dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: -4.27% (0.7982 => 0.7641, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -4.27% (2.4021 => 2.2995, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: -4.22% (0.6441 => 0.6169, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -4.13% (0.3271 => 0.3136, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -4.05% (18.2933 => 17.5517, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/sieve: -4.04% (0.3788 => 0.3635, std.dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: -3.98% (5.0226 => 4.8227, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: -3.98% (0.8418 => 0.8083, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.84% (0.3491 => 0.3357, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.80% (0.3319 => 0.3193, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.78% (2.2587 => 2.1733, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.78% (0.9077 => 0.8734, std.dev.: 0.0051) MultiSource/Applications/hbd/hbd: -3.41% (1.5610 => 1.5077, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.03% (5.4682 => 5.3026, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -2.43% (20.7746 => 20.2706, std.dev.: 0.0336) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.53% (31.3723 => 10.1861, std.dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/fldry: -62.26% (1.8100 => 0.6831, std.dev.: 0.0115) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.35% (7.5137 => 5.7592, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -8.61% (1.2842 => 1.1736) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7067, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.73% (2.2633 => 2.1788, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3999, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4729, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.44% (1.3096 => 1.2908, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 04:34:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 06:34:33 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121129123433.286C92A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6378?compare_to=6372&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6378, Order: 168856, Start Time: 2012-11-29 09:07:52, End Time: 2012-11-29 12:35:06 To: 6372, Order: 168852, Start Time: 2012-11-29 04:49:13, End Time: 2012-11-29 08:19:05 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (177 on baseline) Performance Improvements: 3 (17 on baseline) Added Tests: 0 (186 on baseline) Unchanged Tests: 1090 (714 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.34% (1.1298 => 1.1449, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -2.02% (0.8445 => 0.8274, std.dev.: 0.0043) MultiSource/Applications/oggenc/oggenc: -1.17% (1.9967 => 1.9734, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -1.16% (1.6521 => 1.6329, std.dev.: 0.0018) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.44% (0.0625 => 0.0884, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.93% (0.1063 => 0.1413, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.78% (0.2969 => 0.3764, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.04% (0.1106 => 0.1394, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.77% (0.0714 => 0.0898) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.44% (0.4139 => 0.5192, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.83% (0.4253 => 0.5309, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.42% (0.0475 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.99% (0.4994 => 0.6192, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.86% (0.5900 => 0.7308, std.dev.: 0.0043) MultiSource/Applications/oggenc/oggenc: 23.86% (1.5932 => 1.9734, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.80% (0.5000 => 0.6190, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.63% (0.0584 => 0.0722, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.40% (0.0547 => 0.0675, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.27% (0.1620 => 0.1997, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.11% (0.1021 => 0.1257, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.58% (0.1107 => 0.1357, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 22.54% (0.0599 => 0.0734, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.30% (0.0897 => 0.1097, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.96% (0.0633 => 0.0772, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 21.62% (0.0948 => 0.1153, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.58% (0.0584 => 0.0710, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.44% (0.0541 => 0.0657, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.40% (0.1103 => 0.1339, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.34% (0.0642 => 0.0779, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.21% (0.0495 => 0.0600, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.14% (0.1003 => 0.1215, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.07% (0.1604 => 0.1942, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.80% (0.0822 => 0.0993, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.79% (0.1549 => 0.1871, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.75% (0.3903 => 0.4713, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 20.57% (0.1619 => 0.1952, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 20.46% (0.0821 => 0.0989, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 19.75% (0.0947 => 0.1134, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.46% (0.2014 => 0.2406, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.29% (0.1462 => 0.1744, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 19.18% (0.0808 => 0.0963, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.89% (0.3890 => 0.4625, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 18.72% (0.1218 => 0.1446, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 18.62% (0.0698 => 0.0828, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 18.62% (0.4029 => 0.4779, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.53% (1.3152 => 1.5589, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.31% (0.2736 => 0.3237, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 18.27% (0.1505 => 0.1780, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.18% (0.0572 => 0.0676, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.14% (0.2866 => 0.3386, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 18.07% (0.9697 => 1.1449, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.01% (0.1088 => 0.1284, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.98% (0.0573 => 0.0676, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 17.90% (0.5826 => 0.6869, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.86% (3.5627 => 4.1989, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/gs/gs: 17.85% (1.8794 => 2.2149, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.71% (0.4658 => 0.5483, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.67% (0.3271 => 0.3849, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.53% (0.1968 => 0.2313, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 17.51% (0.5889 => 0.6920, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 17.49% (0.5546 => 0.6516, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.41% (0.1160 => 0.1362, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.33% (0.5026 => 0.5897, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.04% (1.6211 => 1.8974, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.94% (0.2875 => 0.3362, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 16.89% (0.1421 => 0.1661, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.87% (0.2738 => 0.3200, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.83% (0.4361 => 0.5095, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 16.76% (0.2780 => 0.3246, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 16.73% (0.2725 => 0.3181, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hello: 16.73% (0.2714 => 0.3168, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 16.69% (0.0605 => 0.0706, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 16.64% (4.2109 => 4.9118, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 16.62% (1.0781 => 1.2573, std.dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.59% (2.7292 => 3.1821, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/strcat: 16.55% (0.2750 => 0.3205, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.53% (0.2729 => 0.3180, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.51% (0.2792 => 0.3253, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 16.51% (0.2811 => 0.3275, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.49% (0.2911 => 0.3391, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.39% (0.3930 => 0.4574, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/random: 16.38% (0.2803 => 0.3262, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 16.33% (0.2823 => 0.3284, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 16.32% (0.2813 => 0.3272, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.30% (4.4195 => 5.1398, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.28% (2.0673 => 2.4038, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wc: 16.25% (0.3096 => 0.3599, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 16.21% (0.3004 => 0.3491, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 16.20% (0.1284 => 0.1492, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 16.14% (0.9909 => 1.1508, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.03% (0.3195 => 0.3707, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.95% (1.9694 => 2.2836, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.75% (1.9966 => 2.3111, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary3: 15.70% (0.3267 => 0.3780, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 15.68% (0.3258 => 0.3769, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.50% (0.1090 => 0.1259, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 15.47% (0.3317 => 0.3830, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.39% (0.3060 => 0.3531, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 15.38% (0.7171 => 0.8274, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.32% (0.3362 => 0.3877, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.20% (0.3124 => 0.3599, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 15.08% (23.5202 => 27.0664, std.dev.: 0.0227) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.96% (0.3282 => 0.3773, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 14.92% (0.3726 => 0.4282, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 14.87% (0.3678 => 0.4225, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 14.84% (0.2075 => 0.2383, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 14.73% (0.3348 => 0.3841, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 14.66% (0.3465 => 0.3973, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 14.65% (0.2566 => 0.2942, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: 14.63% (0.3446 => 0.3950, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.62% (0.3488 => 0.3998, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 14.56% (0.3496 => 0.4005, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 14.54% (0.3460 => 0.3963, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.53% (0.3469 => 0.3973, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 14.52% (0.4146 => 0.4748, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/trivial-interface: 14.47% (0.3442 => 0.3940, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 14.44% (0.3477 => 0.3979, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 14.44% (1.4269 => 1.6329, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.43% (0.3625 => 0.4148, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 14.30% (0.4251 => 0.4859, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.19% (0.3981 => 0.4546, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 14.16% (0.3650 => 0.4167, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 14.14% (0.3643 => 0.4158, std.dev.: 0.0033) MultiSource/Applications/treecc/treecc: 14.06% (0.7875 => 0.8982, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.98% (0.3690 => 0.4206, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 13.88% (0.3724 => 0.4241, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.73% (0.3845 => 0.4373, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 13.72% (0.0758 => 0.0862, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 13.66% (2.1653 => 2.4611, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: 13.65% (0.5012 => 0.5696, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 13.41% (2.1013 => 2.3830, std.dev.: 0.0083) MultiSource/Applications/JM/lencod/lencod: 13.26% (4.6177 => 5.2298, std.dev.: 0.0099) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.94% (0.2040 => 0.2304, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 12.93% (0.2691 => 0.3039, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.20% (0.6435 => 0.7220, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.00% (0.1383 => 0.1549, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11.86% (5.5417 => 6.1991, std.dev.: 0.0076) MultiSource/Applications/lambda-0_1_3/lambda: 11.64% (0.3498 => 0.3905, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.11% (0.2737 => 0.3041, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 11.00% (0.6634 => 0.7364, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.99% (0.1028 => 0.1141) MultiSource/Benchmarks/PAQ8p/paq8p: 10.83% (0.4847 => 0.5372, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.59% (0.2068 => 0.2287, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.57% (0.3084 => 0.3410, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.46% (0.3336 => 0.3685, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 10.04% (0.2391 => 0.2631, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 9.76% (2.0346 => 2.2331, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.51% (0.2103 => 0.2303, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.26% (0.5361 => 0.5804, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.17% (4.6926 => 5.0758, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.13% (11.6398 => 12.5865, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.86% (0.7426 => 0.8010, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.68% (0.5584 => 0.6013, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 6.81% (11.9555 => 12.7697, std.dev.: 0.0121) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.14% (0.3792 => 0.3987, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.12% (0.0734 => 0.0867, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.98% (29.0505 => 33.4013, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 9.81% (0.2802 => 0.3077, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6089, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.25% (0.3693 => 0.3887, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6706, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1691, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/flops-2: 4.69% (1.8057 => 1.8903, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.60% (79.9355 => 83.6093, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6382, std.dev.: 0.0169) MultiSource/Benchmarks/Olden/health/health: 2.77% (0.6276 => 0.6450, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2065, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.73% (3.1722 => 3.2272, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3034, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2872, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5848, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.67% (25.4195 => 16.6059, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/ary2: -7.87% (0.2402 => 0.2213, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9746, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7920, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9576, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8022, std.dev.: 0.0051) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7734, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.87% (17.2379 => 16.7430, std.dev.: 0.0567) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.30% (0.6293 => 0.6148, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8719, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5728, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4955, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1780, std.dev.: 0.0565) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0444, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 04:51:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 06:51:04 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121129125104.811502A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6379?compare_to=6376&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6379, Order: 168867, Start Time: 2012-11-29 11:17:52, End Time: 2012-11-29 12:51:37 To: 6376, Order: 168862, Start Time: 2012-11-29 09:25:38, End Time: 2012-11-29 11:00:19 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 10 (106 on baseline) Performance Improvements: 7 (42 on baseline) Added Tests: 0 (51 on baseline) Existing Failures: 42 (40 on baseline) Unchanged Tests: 1035 (825 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.85% (0.8458 => 0.8784, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.42% (1.0087 => 1.0331, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.56% (0.6534 => 0.6636, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.41% (8.9392 => 9.0655, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel24: 48.65% (0.3480 => 0.5173, std.dev.: 0.0230) SingleSource/Benchmarks/Linpack/linpack-pc: 3.93% (50.8335 => 52.8326, std.dev.: 0.2355) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.65% (7.1470 => 7.4079, std.dev.: 0.0443) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 2.71% (0.4463 => 0.4584, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.50% (4.9623 => 5.0365, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/mandel: 1.48% (1.3687 => 1.3889, std.dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/football/football: -1.66% (0.9344 => 0.9189, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: -26.34% (0.1917 => 0.1412, std.dev.: 0.0118) MultiSource/Applications/SPASS/SPASS: -7.91% (9.1242 => 8.4024, std.dev.: 0.1114) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -7.57% (23.2757 => 21.5140, std.dev.: 0.4142) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -7.19% (47.3544 => 43.9495, std.dev.: 0.4483) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -5.16% (1.3876 => 1.3160, std.dev.: 0.0167) MultiSource/Benchmarks/Ptrdist/ft/ft: -3.23% (0.8772 => 0.8489, std.dev.: 0.0079) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.66% (1.0831 => 1.0902, std.dev.: 0.0311) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.22% (0.3706 => 0.3698, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -25.23% (0.0222 => 0.0166, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 17.58% (0.0364 => 0.0428, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 18.94% (0.0264 => 0.0314, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.63% (0.0316 => 0.0314, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 3.16% (0.0411 => 0.0424, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: 16.48% (0.0176 => 0.0205, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -16.22% (0.0222 => 0.0186, std.dev.: 0.0035) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/Burg/burg: -92.86% (0.0014 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.66% (0.1465 => 0.1504, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -0.51% (1.1668 => 1.1609, std.dev.: 0.0519) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.15% (0.4004 => 0.3998, std.dev.: 0.0282) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.75% (0.1452 => 0.1412, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.63% (0.0638 => 0.0642, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -20.31% (0.0256 => 0.0204, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.62% (0.0559 => 0.0596, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.01% (1.1487 => 1.1486, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: -0.01% (9.3951 => 9.3946, std.dev.: 0.0174) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -82.76% (0.0029 => 0.0005, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.47% (0.0603 => 0.0564, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.13% (0.0265 => 0.0262, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.15% (0.8033 => 0.8045, std.dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 113.89% (0.0036 => 0.0077, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.04% (34.4366 => 34.4494, std.dev.: 0.0285) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Benchmarks/SciMark2-C/scimark2: -67.13% (28.5821 => 9.3946, std.dev.: 0.0174) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.51% (16.4461 => 17.8464, std.dev.: 0.1169) MultiSource/Applications/sqlite3/sqlite3: 2334.67% (0.6332 => 15.4163, std.dev.: 0.3211) MultiSource/Benchmarks/McCat/08-main/main: 50.68% (0.1831 => 0.2759, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.49% (0.1559 => 0.1489, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7169.00% (0.3123 => 22.7011, std.dev.: 1.1183) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1548.89% (0.3344 => 5.5139, std.dev.: 0.2329) SingleSource/Benchmarks/Misc-C++/Large/ray: 40.19% (0.2364 => 0.3314, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/bigfib: 6.44% (0.6010 => 0.6397, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/mandel: 4.66% (0.0429 => 0.0449, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.00% (0.3266 => 0.3462, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/strcat: 4.42% (0.1969 => 0.2056, std.dev.: 0.0193) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.80% (0.0224 => 0.0237, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -25.65% (0.0230 => 0.0171, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0518, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 12.18% (0.1462 => 0.1640, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4352, std.dev.: 0.0121) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0686, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4924, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5148, std.dev.: 0.0251) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2652, std.dev.: 0.0888) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0710, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3627, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3889, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0804, std.dev.: 0.0081) SingleSource/Regression/C/uint64_to_float: -29.78% (2.1832 => 1.5330, std.dev.: 0.0023) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.91% (0.0810 => 0.0947, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.16% (0.0848 => 0.0985, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.82% (0.0830 => 0.0953, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.75% (0.0773 => 0.0887, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 13.94% (0.1112 => 0.1267, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.42% (0.6010 => 0.6636, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.30% (0.8321 => 0.9178, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.05% (0.2180 => 0.2399, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.69% (0.3137 => 0.3441, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.52% (0.2279 => 0.2496, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.50% (0.9435 => 1.0331, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.48% (0.1466 => 0.1605, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.41% (0.3295 => 0.3605, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.08% (0.1157 => 0.1262, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/04-bisect/bisect: 8.97% (0.1137 => 0.1239, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.56% (0.4847 => 0.5262, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 8.42% (1.2222 => 1.3251, std.dev.: 0.0272) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.41% (0.4127 => 0.4474, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.30% (0.2240 => 0.2426, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 7.81% (0.3226 => 0.3478, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.81% (0.8148 => 0.8784, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.77% (0.1905 => 0.2053, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.73% (0.7473 => 0.8051, std.dev.: 0.0094) MultiSource/Applications/spiff/spiff: 7.45% (0.7950 => 0.8542, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 7.43% (0.6287 => 0.6754, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.18% (0.1588 => 0.1702, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.12% (0.8331 => 0.8924, std.dev.: 0.0179) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.06% (0.1983 => 0.2123, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.86% (0.3003 => 0.3209, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.71% (0.8420 => 0.8985, std.dev.: 0.0164) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.71% (0.2519 => 0.2688, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 6.40% (1.9948 => 2.1225, std.dev.: 0.0356) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.18% (1.3279 => 1.4100, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.18% (1.2526 => 1.3300, std.dev.: 0.0089) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.15% (0.4783 => 0.5077, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.06% (13.1811 => 13.9800, std.dev.: 0.1871) MultiSource/Applications/hbd/hbd: 5.93% (1.4269 => 1.5115, std.dev.: 0.0125) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.92% (1.1606 => 1.2293, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.90% (1.6386 => 1.7353, std.dev.: 0.0317) MultiSource/Applications/siod/siod: 5.84% (2.2184 => 2.3480, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.50% (0.5817 => 0.6137, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.47% (0.2998 => 0.3162, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.46% (0.6227 => 0.6567, std.dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 5.43% (1.1271 => 1.1883, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.34% (0.2133 => 0.2247, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.06% (0.9039 => 0.9496, std.dev.: 0.0074) MultiSource/Applications/lua/lua: 5.03% (3.8189 => 4.0111, std.dev.: 0.0266) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.83% (8.6476 => 9.0655, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/gs/gs: 4.81% (4.1305 => 4.3291, std.dev.: 0.0293) MultiSource/Benchmarks/Prolangs-C/football/football: 4.80% (0.8768 => 0.9189, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.80% (0.5961 => 0.6247, std.dev.: 0.0047) MultiSource/Applications/SPASS/SPASS: 4.78% (14.2605 => 14.9420, std.dev.: 0.1561) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.61% (4.1763 => 4.3688, std.dev.: 0.0452) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.52% (0.9688 => 1.0126, std.dev.: 0.0151) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.23% (1.1170 => 1.1643, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/05-eks/eks: 4.09% (0.4397 => 0.4577, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.04% (0.8716 => 0.9068, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.02% (1.2602 => 1.3108, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.94% (4.4873 => 4.6643, std.dev.: 0.0542) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.92% (0.8316 => 0.8642, std.dev.: 0.0102) MultiSource/Applications/JM/lencod/lencod: 3.92% (15.3280 => 15.9281, std.dev.: 0.2119) MultiSource/Applications/SIBsim4/SIBsim4: 3.87% (1.2568 => 1.3055, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/18-imp/imp: 3.80% (0.3503 => 0.3636, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 3.77% (3.2366 => 3.3586, std.dev.: 0.0285) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.75% (0.8338 => 0.8651, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.63% (4.5702 => 4.7360, std.dev.: 0.0407) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.53% (6.6074 => 6.8408, std.dev.: 0.0633) MultiSource/Applications/JM/ldecod/ldecod: 3.52% (6.7320 => 6.9688, std.dev.: 0.0335) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.18% (4.4880 => 4.6305, std.dev.: 0.0351) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.70% (0.8995 => 0.9238, std.dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: 2.15% (4.9628 => 5.0694, std.dev.: 0.0378) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 72.86% (0.0199 => 0.0344, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/pi: 39.42% (1.5795 => 2.2021, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 28.07% (2.9096 => 3.7263, std.dev.: 0.0354) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.23% (4.8436 => 5.8721, std.dev.: 0.0220) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 20.45% (0.0528 => 0.0636, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/misr: 18.02% (0.4001 => 0.4722, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.93% (8.2783 => 9.7624, std.dev.: 0.0220) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.45% (0.7597 => 0.8847, std.dev.: 0.0314) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 16.16% (6.3772 => 7.4079, std.dev.: 0.0443) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.94% (2.7995 => 3.1338, std.dev.: 0.1137) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.39% (0.3186 => 0.3517, std.dev.: 0.0076) MultiSource/Applications/lambda-0_1_3/lambda: 10.16% (7.4933 => 8.2543, std.dev.: 0.0272) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 9.78% (1.1857 => 1.3017, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.63% (3.9917 => 4.2963, std.dev.: 0.0783) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.34% (23.5781 => 25.3083, std.dev.: 0.0557) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.32% (3.3761 => 3.5894, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.82% (4.5327 => 4.7963, std.dev.: 0.0327) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.36% (0.3937 => 0.4148, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.36% (5.4187 => 5.7090, std.dev.: 0.0202) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 5.31% (0.4353 => 0.4584, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.28% (5.3218 => 5.6027, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 5.08% (0.5214 => 0.5479, std.dev.: 0.0016) MultiSource/Applications/aha/aha: 4.81% (3.3398 => 3.5006, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/richards_benchmark: 4.33% (1.3037 => 1.3601, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 3.57% (1.2061 => 1.2491, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.26% (0.3587 => 0.3704, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 2.71% (6.7064 => 6.8881, std.dev.: 0.0258) SingleSource/Benchmarks/Dhrystone/dry: 2.40% (0.5081 => 0.5203, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.36% (3.4104 => 3.4910, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 2.04% (1.7056 => 1.7404, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/methcall: 1.94% (8.2676 => 8.4282, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.82% (11.5690 => 11.7801, std.dev.: 0.0255) SingleSource/Benchmarks/Misc/ReedSolomon: 1.38% (8.5322 => 8.6499, std.dev.: 0.0370) MultiSource/Benchmarks/Olden/bh/bh: 1.25% (2.3560 => 2.3855, std.dev.: 0.0111) MultiSource/Benchmarks/sim/sim: 1.22% (3.8206 => 3.8671, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.17% (2.8951 => 1.6741, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -22.24% (7.2130 => 5.6088, std.dev.: 0.0863) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.75% (1.4529 => 1.1514, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.96% (9.9065 => 8.2261, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/ary3: -12.92% (1.9999 => 1.7416, std.dev.: 0.0477) MultiSource/Benchmarks/Olden/em3d/em3d: -12.88% (5.4641 => 4.7603, std.dev.: 0.0128) SingleSource/Benchmarks/McGill/chomp: -10.24% (1.1216 => 1.0068, std.dev.: 0.0209) SingleSource/Benchmarks/Misc/flops-8: -9.69% (2.5609 => 2.3128, std.dev.: 0.0101) MultiSource/Benchmarks/mafft/pairlocalalign: -9.09% (63.1822 => 57.4379, std.dev.: 0.0818) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.72% (0.3269 => 0.2984, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.36% (1.0512 => 0.9633, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.10% (3.2169 => 2.9886, std.dev.: 0.0395) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.22% (4.7482 => 4.4528, std.dev.: 0.0053) SingleSource/Benchmarks/Stanford/FloatMM: -6.11% (0.8807 => 0.8269, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.09% (5.1305 => 4.8178, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout/sieve: -6.08% (7.0599 => 6.6307, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: -5.54% (9.3748 => 8.8556, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.32% (6.2275 => 5.8959, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -5.20% (1.3882 => 1.3160, std.dev.: 0.0167) SingleSource/Benchmarks/Misc/ffbench: -5.03% (1.4296 => 1.3577, std.dev.: 0.0269) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.79% (2.8773 => 2.7394, std.dev.: 0.0334) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.59% (5.6343 => 5.3758, std.dev.: 0.0372) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.46% (4.7449 => 4.5334, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.35% (4.9453 => 4.7304, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/methcall: -3.72% (8.9760 => 8.6417, std.dev.: 0.0791) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.64% (5.1557 => 4.9678, std.dev.: 0.0157) MultiSource/Applications/siod/siod: -3.61% (3.6643 => 3.5319, std.dev.: 0.0115) MultiSource/Applications/lua/lua: -3.60% (29.8330 => 28.7581, std.dev.: 0.1421) SingleSource/Benchmarks/Misc/perlin: -3.59% (5.1084 => 4.9249, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.57% (3.7148 => 3.5820, std.dev.: 0.0321) MultiSource/Benchmarks/Ptrdist/ft/ft: -3.41% (0.8789 => 0.8489, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.06% (5.4300 => 5.2637, std.dev.: 0.0218) SingleSource/Benchmarks/Misc/fbench: -2.51% (3.3840 => 3.2990, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/tsp/tsp: -2.23% (1.4861 => 1.4529, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.91% (3.3479 => 3.2839, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.83% (3.5679 => 3.5026, std.dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/fldry: -1.79% (0.6910 => 0.6786, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: -1.62% (15.8853 => 15.6278, std.dev.: 0.0258) MultiSource/Benchmarks/FreeBench/neural/neural: -1.49% (1.0841 => 1.0679, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -1.49% (2.4416 => 2.4052, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/flops-5: -1.32% (2.8957 => 2.8576, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.28% (4.2466 => 4.1924, std.dev.: 0.0121) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 6.24% (1.0262 => 1.0902, std.dev.: 0.0311) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.14% (0.2463 => 0.3698, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 34.96% (0.0123 => 0.0166, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 23.62% (0.0254 => 0.0314, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 3.33% (0.0180 => 0.0186, std.dev.: 0.0035) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 4.59% (0.1438 => 0.1504, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 2.47% (1.1329 => 1.1609, std.dev.: 0.0519) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.99% (0.4164 => 0.3998, std.dev.: 0.0282) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.14% (0.1369 => 0.1412, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.16% (0.0641 => 0.0642, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 4.62% (0.0195 => 0.0204, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.11% (0.0578 => 0.0596, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.43% (1.1437 => 1.1486, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 400.00% (0.0001 => 0.0005, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.05% (0.0627 => 0.0564, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 45.56% (0.0180 => 0.0262, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.35% (0.8017 => 0.8045, std.dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 24.19% (0.0062 => 0.0077, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 05:10:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 07:10:30 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121129131031.07BD12A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6380?compare_to=6377&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6380, Order: 168867, Start Time: 2012-11-29 11:37:20, End Time: 2012-11-29 13:11:06 To: 6377, Order: 168862, Start Time: 2012-11-29 09:40:41, End Time: 2012-11-29 11:14:18 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (185 on baseline) Added Tests: 0 (52 on baseline) Unchanged Tests: 1093 (852 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 6.82% (0.3666 => 0.3916, std.dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.56% (2.0478 => 2.1002, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.4937 => 7.6826, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash2: 1.99% (3.1932 => 3.2566, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.20% (0.9531 => 0.9645, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.46% (0.1431 => 0.1310, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.46% (0.9542 => 0.8830, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.38% (0.3821 => 0.3539, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -6.78% (2.4924 => 2.3234, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.72% (0.3142 => 0.2931, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.49% (0.3357 => 0.3139, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: -6.25% (0.2160 => 0.2025, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.22% (0.2428 => 0.2277, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -6.11% (9.2283 => 8.6646, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.90% (0.1796 => 0.1690, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -5.90% (16.1920 => 15.2370, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.88% (0.6052 => 0.5696, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.87% (0.5925 => 0.5577, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -5.85% (0.9179 => 0.8642, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.81% (0.5575 => 0.5251, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -5.79% (0.3831 => 0.3609, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.79% (0.6304 => 0.5939, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.79% (0.5805 => 0.5469, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.79% (0.9852 => 0.9282, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.78% (0.5591 => 0.5268, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.77% (0.5581 => 0.5259, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.77% (0.3658 => 0.3447, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: -5.76% (1.1530 => 1.0866, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/synchronized: -5.75% (0.3896 => 0.3672, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.74% (0.6395 => 0.6028, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.73% (0.5863 => 0.5527, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.73% (0.6667 => 0.6285, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: -5.72% (7.0961 => 6.6899, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.72% (0.6484 => 0.6113, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.72% (0.3884 => 0.3662, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.70% (0.6681 => 0.6300, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-4: -5.70% (0.3880 => 0.3659, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.67% (0.6194 => 0.5843, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -5.67% (0.3848 => 0.3630, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.66% (1.3722 => 1.2945, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: -5.65% (0.4176 => 0.3940, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.65% (0.2355 => 0.2222, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.64% (4.0323 => 3.8048, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.64% (0.5569 => 0.5255, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.62% (0.5941 => 0.5607, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -5.61% (0.3812 => 0.3598, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.60% (0.3891 => 0.3673, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.59% (0.6676 => 0.6303, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: -5.58% (0.4033 => 0.3808, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.57% (0.2695 => 0.2545, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.56% (0.6189 => 0.5845, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.55% (0.6230 => 0.5884, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.55% (0.5802 => 0.5480, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.55% (0.5859 => 0.5534, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.54% (0.6260 => 0.5913, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.54% (0.6395 => 0.6041, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.53% (0.6660 => 0.6292, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.52% (0.5705 => 0.5390, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.52% (1.2300 => 1.1621, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.52% (0.7524 => 0.7109, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.51% (1.0544 => 0.9963, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.51% (4.8161 => 4.5508, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.50% (3.5339 => 3.3395, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -5.49% (0.4515 => 0.4267, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.49% (0.7339 => 0.6936, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.46% (0.3057 => 0.2890, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.46% (0.5567 => 0.5263, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.44% (4.8802 => 4.6147, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.43% (0.5688 => 0.5379, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.41% (1.4642 => 1.3850, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.40% (0.6736 => 0.6372, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.37% (4.5069 => 4.2651, std.dev.: 0.0103) MultiSource/Applications/SIBsim4/SIBsim4: -5.35% (1.3864 => 1.3122, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.35% (0.5570 => 0.5272, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.35% (0.7198 => 0.6813, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.34% (14.2083 => 13.4492, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.32% (0.6033 => 0.5712, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.32% (1.6364 => 1.5494, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.30% (0.7919 => 0.7499, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.30% (1.2784 => 1.2106, std.dev.: 0.0055) MultiSource/Applications/hexxagon/hexxagon: -5.30% (1.3148 => 1.2451, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.24% (0.4199 => 0.3979, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: -5.23% (0.3406 => 0.3228, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -5.22% (1.1450 => 1.0852, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.22% (6.7716 => 6.4182, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/gs/gs: -5.22% (4.3330 => 4.1069, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: -5.19% (17.1032 => 16.2163, std.dev.: 0.0228) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.16% (0.3837 => 0.3639, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -5.16% (0.3025 => 0.2869, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.12% (0.6293 => 0.5971, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.11% (0.3016 => 0.2862, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.09% (0.2871 => 0.2725, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.08% (2.1713 => 2.0609, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/objinst: -5.07% (0.3194 => 0.3032, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.06% (0.3931 => 0.3732, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.06% (0.5478 => 0.5201, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.05% (0.8521 => 0.8091, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.05% (0.2933 => 0.2785, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -5.04% (1.2515 => 1.1884, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/matrix: -5.04% (0.3255 => 0.3091, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.04% (0.2939 => 0.2791, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -5.00% (0.3059 => 0.2906, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.99% (0.3205 => 0.3045, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -4.96% (0.3446 => 0.3275, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.96% (0.2903 => 0.2759, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.95% (0.5999 => 0.5702, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.93% (0.5857 => 0.5568, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -4.92% (0.3394 => 0.3227, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.91% (0.4151 => 0.3947, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.91% (0.3483 => 0.3312, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.91% (0.3323 => 0.3160, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.88% (8.0126 => 7.6212, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/parameter-passing: -4.88% (0.4280 => 0.4071, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.88% (0.4321 => 0.4110, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.88% (0.2849 => 0.2710, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -4.88% (15.5079 => 14.7516, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: -4.88% (0.4861 => 0.4624, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.87% (0.2278 => 0.2167, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -4.86% (0.2985 => 0.2840, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.86% (0.6446 => 0.6133, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.82% (0.2385 => 0.2270, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.82% (0.5849 => 0.5567, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.82% (0.4916 => 0.4679, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -4.82% (0.2989 => 0.2845, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -4.81% (3.5154 => 3.3462, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary2: -4.80% (0.3481 => 0.3314, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.79% (0.2548 => 0.2426, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.77% (1.2221 => 1.1638, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.76% (0.5168 => 0.4922, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/except: -4.76% (0.3026 => 0.2882, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.76% (0.7021 => 0.6687, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.74% (0.4813 => 0.4585, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.70% (0.3849 => 0.3668, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.70% (0.2999 => 0.2858, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -4.70% (15.2527 => 14.5358, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.68% (1.2210 => 1.1638, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: -4.68% (0.4248 => 0.4049, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -4.67% (4.0594 => 3.8697, std.dev.: 0.0048) MultiSource/Applications/minisat/minisat: -4.66% (0.7447 => 0.7100, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.65% (0.5329 => 0.5081, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.64% (0.5456 => 0.5203, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.61% (0.3252 => 0.3102, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -4.61% (0.3581 => 0.3416, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -4.60% (0.3867 => 0.3689, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.60% (1.6474 => 1.5716, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: -4.60% (0.4524 => 0.4316, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.58% (22.4056 => 21.3792, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/lists: -4.56% (0.3621 => 0.3456, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -4.52% (34.0927 => 32.5510, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.52% (0.9557 => 0.9125, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: -4.51% (0.2659 => 0.2539, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -4.51% (0.7779 => 0.7428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.50% (0.6440 => 0.6150, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.46% (0.4083 => 0.3901, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -4.45% (2.4021 => 2.2951, std.dev.: 0.0146) MultiSource/Applications/treecc/treecc: -4.42% (2.1401 => 2.0456, std.dev.: 0.0053) MultiSource/Applications/lambda-0_1_3/lambda: -4.38% (0.7982 => 0.7632, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: -4.32% (0.6347 => 0.6073, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -4.31% (0.6750 => 0.6459, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.29% (0.4427 => 0.4237, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -4.20% (0.3788 => 0.3629, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -4.18% (0.8418 => 0.8066, std.dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: -4.18% (18.2933 => 17.5287, std.dev.: 0.0142) SingleSource/UnitTests/ObjC++/property-reference-object: -4.18% (0.6441 => 0.6172, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.07% (0.3319 => 0.3184, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: -3.91% (5.0226 => 4.8260, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/09-vor/vor: -3.88% (0.3271 => 0.3144, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.87% (0.3491 => 0.3356, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.85% (2.2587 => 2.1717, std.dev.: 0.0121) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.57% (0.9077 => 0.8753, std.dev.: 0.0028) MultiSource/Applications/hbd/hbd: -3.57% (1.5610 => 1.5053, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.07% (5.4682 => 5.3004, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.34% (20.7746 => 20.2889, std.dev.: 0.0187) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1962, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: -62.36% (1.8100 => 0.6812, std.dev.: 0.0089) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.35% (7.5137 => 5.7594, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Misc/richards_benchmark: -8.69% (1.2842 => 1.1726, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.78% (2.2633 => 2.1778, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4004, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.17% (1.3096 => 1.2681, std.dev.: 0.0119) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.61% (6.5735 => 6.4674, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 06:01:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 08:01:43 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121129140143.48EEA2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6381?compare_to=6375&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6381, Order: 168867, Start Time: 2012-11-29 11:41:20, End Time: 2012-11-29 14:02:16 To: 6375, Order: 168856, Start Time: 2012-11-29 07:53:57, End Time: 2012-11-29 10:30:47 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 42 (176 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (186 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1046 (666 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/lemon/lemon: 12.95% (1.2128 => 1.3698, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 11.69% (0.1163 => 0.1299, std.dev.: 0.0036) SingleSource/Benchmarks/LivermoreLoops/kernel22: 11.52% (0.1016 => 0.1133, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: 11.43% (0.5748 => 0.6405, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.83% (0.1644 => 0.1822, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.25% (2.5953 => 2.8612, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.08% (0.3690 => 0.4062, std.dev.: 0.0139) SingleSource/Benchmarks/LivermoreLoops/kernel23: 10.05% (0.1114 => 0.1226, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.65% (4.3755 => 4.7977, std.dev.: 0.0667) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.64% (1.8739 => 2.0545, std.dev.: 0.0352) MultiSource/Applications/lua/lua: 8.69% (4.5435 => 4.9383, std.dev.: 0.0330) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.68% (0.6234 => 0.6775, std.dev.: 0.0191) MultiSource/Applications/Burg/burg: 7.94% (1.3352 => 1.4412, std.dev.: 0.0381) SingleSource/Benchmarks/Shootout-C++/hash: 7.61% (0.4769 => 0.5132, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.44% (0.3899 => 0.4189, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.41% (0.5058 => 0.5433, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/except: 7.39% (0.3113 => 0.3343, std.dev.: 0.0085) MultiSource/Benchmarks/McCat/09-vor/vor: 7.22% (0.3560 => 0.3817, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/hash2: 6.98% (0.5126 => 0.5484, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.89% (1.2480 => 1.3340, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/ary: 6.48% (0.3532 => 0.3761, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.73% (6.5593 => 6.9350, std.dev.: 0.0676) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.35% (0.9418 => 0.9922, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 4.98% (0.6973 => 0.7320, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.06% (0.3128 => 0.3255, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.84% (0.6766 => 0.7026, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/flops: 28.53% (6.7505 => 8.6767, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 21.19% (0.1189 => 0.1441, std.dev.: 0.0072) MultiSource/Applications/JM/ldecod/ldecod: 20.63% (0.1212 => 0.1462, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.51% (0.3609 => 0.4313, std.dev.: 0.0187) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.47% (3.8705 => 4.3920, std.dev.: 0.1220) MultiSource/Applications/lemon/lemon: 9.69% (1.4370 => 1.5763, std.dev.: 0.0130) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.10% (2.1021 => 2.2934, std.dev.: 0.0273) MultiSource/Applications/JM/lencod/lencod: 7.00% (7.5296 => 8.0564, std.dev.: 0.1263) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.81% (82.7345 => 87.5434, std.dev.: 0.5719) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 4.75% (3.1341 => 3.2831, std.dev.: 0.0374) MultiSource/Benchmarks/PAQ8p/paq8p: 2.80% (84.5745 => 86.9414, std.dev.: 0.0421) SingleSource/Benchmarks/CoyoteBench/lpbench: 2.11% (10.6169 => 10.8408, std.dev.: 0.0808) SingleSource/Benchmarks/Shootout-C++/hash: 2.09% (0.7604 => 0.7763, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.97% (61.0185 => 62.2228, std.dev.: 0.0795) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.40% (7.2768 => 7.3790, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/lists: 1.40% (12.4874 => 12.6617, std.dev.: 0.0597) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 3.68% (66.6885 => 69.1455, std.dev.: 0.6722) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.15% (0.1341 => 0.1339, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.48% (0.0420 => 0.0422, std.dev.: 0.0065) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.31% (0.0652 => 0.0650, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: 0.16% (492.9973 => 493.7882, std.dev.: 0.2976) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.33% (63.2438 => 69.1455, std.dev.: 0.6722) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0422, std.dev.: 0.0065) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43687.20% (1.1277 => 493.7882, std.dev.: 0.2976) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 198.09% (0.5229 => 1.5587, std.dev.: 0.0704) MultiSource/Applications/SPASS/SPASS: 20.27% (14.9895 => 18.0280, std.dev.: 0.4357) MultiSource/Applications/kimwitu++/kc: 51.58% (14.1553 => 21.4560, std.dev.: 0.3251) MultiSource/Benchmarks/MallocBench/gs/gs: 14.76% (4.1105 => 4.7173, std.dev.: 0.2829) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 44.18% (1.1048 => 1.5929, std.dev.: 0.0350) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 434.26% (7.1582 => 38.2436, std.dev.: 0.0760) SingleSource/Benchmarks/Misc-C++-EH/spirit: 100.27% (3.4629 => 6.9350, std.dev.: 0.0676) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.45% (0.6222 => 1.0294, std.dev.: 0.0356) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11089.44% (0.0720 => 8.0564, std.dev.: 0.1263) MultiSource/Applications/SIBsim4/SIBsim4: 3854500.00% (0.0001 => 3.8546, std.dev.: 0.0367) MultiSource/Applications/SPASS/SPASS: 12118800.00% (0.0001 => 12.1189, std.dev.: 2.4006) MultiSource/Applications/kimwitu++/kc: 52100.00% (0.0001 => 0.0522, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 64200.00% (0.0001 => 0.0643, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14500.00% (0.0001 => 0.0146) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575900.00% (0.0001 => 0.5760, std.dev.: 0.0205) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10004000.00% (0.0001 => 10.0041, std.dev.: 0.0179) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5670400.00% (0.0001 => 5.6705, std.dev.: 0.8280) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1748.65% (1.1194 => 20.6938, std.dev.: 0.6869) MultiSource/Applications/ClamAV/clamscan: 71.17% (22.1758 => 37.9581, std.dev.: 0.1111) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.09% (2.9384 => 4.6158, std.dev.: 0.2642) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 52.66% (7.0540 => 10.7684, std.dev.: 0.3387) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.83% (8.1363 => 11.9469, std.dev.: 0.3448) MultiSource/Applications/JM/lencod/lencod: 45.50% (21.9371 => 31.9191, std.dev.: 0.2718) MultiSource/Benchmarks/FreeBench/distray/distray: 44.32% (0.1056 => 0.1524, std.dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/almabench: 44.11% (0.0730 => 0.1052, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops: 37.43% (0.1432 => 0.1968, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/Oscar: 31.60% (0.0636 => 0.0837, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/tsp/tsp: 30.72% (0.1175 => 0.1536, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 29.91% (2.2024 => 2.8612, std.dev.: 0.0052) SingleSource/UnitTests/vla: 29.58% (0.0355 => 0.0460, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.55% (1.5859 => 2.0545, std.dev.: 0.0352) SingleSource/UnitTests/ObjC/messages-2: 28.25% (0.0662 => 0.0849, std.dev.: 0.0033) MultiSource/Applications/lemon/lemon: 27.76% (1.0722 => 1.3698, std.dev.: 0.0131) MultiSource/Applications/lua/lua: 27.53% (3.8723 => 4.9383, std.dev.: 0.0330) MultiSource/Benchmarks/McCat/15-trie/trie: 27.13% (0.0527 => 0.0670, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: 26.96% (0.2700 => 0.3428, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.23% (0.0770 => 0.0972, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 26.16% (0.5569 => 0.7026, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/17-bintr/bintr: 25.48% (0.0675 => 0.0847, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.82% (0.0842 => 0.1051, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.44% (0.1125 => 0.1400, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: 23.79% (1.1642 => 1.4412, std.dev.: 0.0381) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.73% (0.0746 => 0.0923, std.dev.: 0.0020) MultiSource/Applications/aha/aha: 23.63% (0.1151 => 0.1423, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.55% (0.1032 => 0.1275, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 23.26% (3.8922 => 4.7977, std.dev.: 0.0667) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 23.15% (0.0838 => 0.1032, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/exptree: 23.10% (0.0814 => 0.1002, std.dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 22.83% (0.1555 => 0.1910, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/health/health: 22.71% (0.1268 => 0.1556, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/lists: 22.68% (0.0626 => 0.0768, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 22.62% (0.5105 => 0.6260, std.dev.: 0.0289) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 22.48% (0.0467 => 0.0572, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 22.48% (0.8101 => 0.9922, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout/hash: 22.47% (0.0485 => 0.0594, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 22.40% (0.7433 => 0.9098, std.dev.: 0.0412) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 22.40% (1.4186 => 1.7363, std.dev.: 0.0258) MultiSource/Benchmarks/McCat/08-main/main: 22.24% (0.2554 => 0.3122, std.dev.: 0.0168) SingleSource/Benchmarks/CoyoteBench/huffbench: 22.16% (0.0871 => 0.1064, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.74% (0.3441 => 0.4189, std.dev.: 0.0062) MultiSource/Benchmarks/NPB-serial/is/is: 21.56% (0.0719 => 0.0874, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 21.34% (0.0834 => 0.1012, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.26% (0.1566 => 0.1899, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 20.80% (14.3668 => 17.3557, std.dev.: 0.2750) SingleSource/Benchmarks/McGill/chomp: 20.48% (0.1655 => 0.1994, std.dev.: 0.0119) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.46% (0.0953 => 0.1148, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 20.37% (0.0491 => 0.0591, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.30% (0.0793 => 0.0954, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 20.06% (0.0648 => 0.0778, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: 20.03% (0.3180 => 0.3817, std.dev.: 0.0084) MultiSource/Benchmarks/nbench/nbench: 19.86% (1.1840 => 1.4191, std.dev.: 0.0459) SingleSource/Benchmarks/Shootout/matrix: 19.80% (0.0818 => 0.0980, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 19.65% (0.4289 => 0.5132, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 19.50% (0.3307 => 0.3952, std.dev.: 0.0194) MultiSource/Applications/treecc/treecc: 19.26% (2.0273 => 2.4177, std.dev.: 0.0824) SingleSource/UnitTests/ObjC/parameter-passing: 19.25% (0.3927 => 0.4683, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.95% (0.1029 => 0.1224, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 18.70% (0.4620 => 0.5484, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/whetstone: 18.64% (0.0660 => 0.0783, std.dev.: 0.0034) MultiSource/Applications/sgefa/sgefa: 18.59% (0.3109 => 0.3687, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 18.53% (0.3427 => 0.4062, std.dev.: 0.0139) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.37% (4.2646 => 5.0482, std.dev.: 0.1685) SingleSource/Benchmarks/Misc-C++/Large/ray: 18.26% (0.4064 => 0.4806, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/lists1: 18.19% (0.3684 => 0.4354, std.dev.: 0.0201) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0704 => 0.0832, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 18.12% (0.3886 => 0.4590, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.97% (0.5981 => 0.7056, std.dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C/football/football: 17.94% (0.8921 => 1.0521, std.dev.: 0.0409) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.83% (0.3826 => 0.4508, std.dev.: 0.0216) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.80% (0.2758 => 0.3249, std.dev.: 0.0112) MultiSource/Applications/oggenc/oggenc: 17.41% (5.7591 => 6.7619, std.dev.: 0.2443) SingleSource/Benchmarks/Misc/fbench: 17.40% (0.0592 => 0.0695, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 17.36% (0.3387 => 0.3975, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/synchronized: 17.35% (0.3561 => 0.4179, std.dev.: 0.0151) SingleSource/UnitTests/ObjC/trivial-interface: 17.25% (0.3473 => 0.4072, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/05-eks/eks: 17.19% (0.4299 => 0.5038, std.dev.: 0.0114) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 17.07% (0.1892 => 0.2215, std.dev.: 0.0050) SingleSource/Benchmarks/McGill/misr: 16.90% (0.0633 => 0.0740, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: 16.79% (0.2877 => 0.3360, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 16.61% (0.1114 => 0.1299, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.56% (0.8172 => 0.9525, std.dev.: 0.0449) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.47% (0.2756 => 0.3210, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/except: 16.44% (0.2871 => 0.3343, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/mst/mst: 16.42% (0.1163 => 0.1354, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary: 16.37% (0.3232 => 0.3761, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.33% (4.9449 => 5.7523, std.dev.: 0.1696) SingleSource/Benchmarks/Shootout-C++/ary3: 16.33% (0.3283 => 0.3819, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/ary2: 16.22% (0.3379 => 0.3927, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.17% (0.3136 => 0.3643, std.dev.: 0.0141) MultiSource/Benchmarks/Olden/em3d/em3d: 16.11% (0.1695 => 0.1968, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.03% (5.0018 => 5.8035, std.dev.: 0.1884) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 15.95% (0.1906 => 0.2210, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.88% (0.2065 => 0.2393, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/fibo: 15.67% (0.2725 => 0.3152, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.58% (0.0770 => 0.0890, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.58% (0.0886 => 0.1024, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/matrix: 15.43% (0.3098 => 0.3576, std.dev.: 0.0085) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.40% (0.1143 => 0.1319, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/Hello: 15.12% (0.5925 => 0.6821, std.dev.: 0.0139) MultiSource/Applications/sqlite3/sqlite3: 15.05% (17.1811 => 19.7664, std.dev.: 0.3661) SingleSource/UnitTests/ObjC++/property-reference: 14.99% (0.7326 => 0.8424, std.dev.: 0.0141) SingleSource/UnitTests/ObjC++/property-reference-object: 14.98% (0.6030 => 0.6933, std.dev.: 0.0298) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.96% (0.3121 => 0.3588, std.dev.: 0.0156) SingleSource/Regression/C++/ofstream_ctor: 14.91% (0.2905 => 0.3338, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.06% (0.1337 => 0.1525, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.03% (0.1062 => 0.1211, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.00% (0.1236 => 0.1409, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.86% (0.5860 => 0.6672, std.dev.: 0.0280) SingleSource/Benchmarks/Stanford/Puzzle: 13.72% (0.1268 => 0.1442, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ReedSolomon: 13.67% (0.2049 => 0.2329, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.65% (0.9765 => 1.1098, std.dev.: 0.0492) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.47% (0.2271 => 0.2577, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/moments: 13.46% (0.4048 => 0.4593, std.dev.: 0.0079) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.46% (0.4615 => 0.5236, std.dev.: 0.0232) MultiSource/Benchmarks/mafft/pairlocalalign: 13.39% (9.4845 => 10.7543, std.dev.: 0.4916) MultiSource/Benchmarks/FreeBench/neural/neural: 13.06% (0.1463 => 0.1654, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/sumcol: 12.59% (0.2891 => 0.3255, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/bigfib: 12.50% (0.6456 => 0.7263, std.dev.: 0.0222) SingleSource/UnitTests/ObjC/exceptions: 12.30% (0.3828 => 0.4299, std.dev.: 0.0096) SingleSource/UnitTests/ObjC/exceptions-3: 12.29% (0.3516 => 0.3948, std.dev.: 0.0079) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.16% (0.3543 => 0.3974, std.dev.: 0.0085) SingleSource/UnitTests/ObjC/exceptions-2: 12.15% (0.3497 => 0.3922, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.12% (0.1625 => 0.1822, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions-4: 12.11% (0.3543 => 0.3972, std.dev.: 0.0085) SingleSource/UnitTests/ObjC/for-in: 11.94% (0.3694 => 0.4135, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.82% (0.3865 => 0.4322, std.dev.: 0.0129) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.52% (0.0929 => 0.1036, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.35% (0.4879 => 0.5433, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.23% (0.4203 => 0.4675, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/sieve: 10.82% (0.3603 => 0.3993, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/lists: 10.75% (0.3422 => 0.3790, std.dev.: 0.0115) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.59% (0.4636 => 0.5127, std.dev.: 0.0165) SingleSource/UnitTests/SignlessTypes/rem: 10.58% (0.1144 => 0.1265, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: 9.54% (0.2831 => 0.3101, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/oourafft: 9.32% (0.3282 => 0.3588, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/hello: 9.14% (0.2714 => 0.2962, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/random: 8.49% (0.2802 => 0.3040, std.dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 149.48% (4.3953 => 10.9653, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/methcall: 147.00% (5.3999 => 13.3380, std.dev.: 0.0213) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 32.46% (0.3256 => 0.4313, std.dev.: 0.0187) MultiSource/Benchmarks/McCat/09-vor/vor: 24.87% (0.1154 => 0.1441, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.71% (1.1145 => 1.3007, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/oourafft: 16.15% (6.6465 => 7.7199, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.55% (0.2944 => 0.3343, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.64% (2.0360 => 2.2934, std.dev.: 0.0273) MultiSource/Applications/JM/ldecod/ldecod: 12.63% (0.1298 => 0.1462, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/tsp/tsp: 11.72% (1.0785 => 1.2049, std.dev.: 0.0452) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.60% (2.8904 => 3.2256, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 10.16% (1.1396 => 1.2554, std.dev.: 0.0019) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.52% (1.7254 => 1.8897, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: 9.01% (1.4460 => 1.5763, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/ffbench: 8.12% (0.9505 => 1.0277, std.dev.: 0.0300) SingleSource/Benchmarks/Shootout-C++/hash2: 6.94% (3.1578 => 3.3769, std.dev.: 0.0847) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.96% (0.9540 => 1.0109, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.66% (4.2280 => 4.4671, std.dev.: 0.0103) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 4.78% (10.3460 => 10.8408, std.dev.: 0.0808) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 4.78% (3.1334 => 3.2831, std.dev.: 0.0374) MultiSource/Applications/lua/lua: 4.71% (26.0924 => 27.3216, std.dev.: 0.1285) SingleSource/Benchmarks/Shootout-C++/hash: 4.13% (0.7455 => 0.7763, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.03% (11.6436 => 12.1127, std.dev.: 0.0238) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.32% (0.4162 => 0.4300, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 2.96% (3.8532 => 3.9674, std.dev.: 0.0388) MultiSource/Benchmarks/PAQ8p/paq8p: 2.20% (85.0658 => 86.9414, std.dev.: 0.0421) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.13% (1.3677 => 1.3968, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 2.03% (3.1595 => 3.2236, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.93% (2.3135 => 2.3581, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.89% (2.1424 => 2.1829, std.dev.: 0.0129) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.50% (6.5088 => 6.6066, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.26% (1.0313 => 1.0443, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0502, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 1.10% (5.2636 => 5.3213, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.38% (6.6874 => 0.1749, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -74.72% (5.2763 => 1.3340, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/salsa20: -74.48% (0.8651 => 0.2208, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/richards_benchmark: -40.26% (0.1622 => 0.0969, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.34% (5.3855 => 4.6671, std.dev.: 0.1753) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -12.33% (0.1330 => 0.1166, std.dev.: 0.0063) MultiSource/Applications/JM/ldecod/ldecod: -10.88% (10.4361 => 9.3008, std.dev.: 0.4118) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.65% (5.3526 => 4.7827, std.dev.: 0.1211) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -68.61% (32.5116 => 10.2060, std.dev.: 0.0207) SingleSource/Benchmarks/Dhrystone/fldry: -65.55% (1.9577 => 0.6745, std.dev.: 0.0125) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1682) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.20% (0.0628 => 0.0363, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.36% (0.3987 => 0.2378, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.30% (4.5009 => 2.7772, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.16% (2.6546 => 2.0132, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: -19.25% (0.2161 => 0.1745, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4221, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2839, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -10.67% (1.5373 => 1.3732, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -10.48% (9.5636 => 8.5614, std.dev.: 0.2005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.05% (1.5660 => 1.4243, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.2416 => 3.0208, std.dev.: 0.0171) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.19% (19.9488 => 18.7138, std.dev.: 0.2091) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5759, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.17% (0.2497 => 0.2368, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.13% (0.8614 => 0.8172, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5080, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -4.49% (6.2999 => 6.0168, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.11% (0.9957 => 0.9647, std.dev.: 0.0054) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8918, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.66% (0.4808 => 0.4680, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6767, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.76% (8.1563 => 8.0127, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/salsa20: -1.60% (10.2830 => 10.1188, std.dev.: 0.0049) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.28% (0.2116 => 0.0650, std.dev.: 0.0023) Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 06:48:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 08:48:54 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121129144854.372002A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6382?compare_to=6379&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6382, Order: 168874, Start Time: 2012-11-29 13:11:45, End Time: 2012-11-29 14:49:06 To: 6379, Order: 168867, Start Time: 2012-11-29 11:17:52, End Time: 2012-11-29 12:51:37 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 17 (74 on baseline) Performance Improvements: 3 (33 on baseline) Added Tests: 0 (51 on baseline) Existing Failures: 42 (40 on baseline) Unchanged Tests: 1032 (866 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/minisat/minisat: 21.40% (0.7060 => 0.8571, std.dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: 12.55% (6.9688 => 7.8437, std.dev.: 0.3226) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 11.66% (0.1098 => 0.1226, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 5.02% (0.9229 => 0.9692, std.dev.: 0.0103) SingleSource/UnitTests/Vector/constpool: 2.35% (8.4304 => 8.6282, std.dev.: 0.0586) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.43% (1.1643 => 1.1809, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 66.40% (0.0250 => 0.0416, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 27.56% (6.3145 => 8.0548, std.dev.: 0.1839) MultiSource/Applications/SPASS/SPASS: 21.43% (8.4024 => 10.2034, std.dev.: 0.2279) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 10.31% (43.9495 => 48.4807, std.dev.: 1.5225) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.28% (15.4980 => 17.0905, std.dev.: 0.0664) SingleSource/Benchmarks/LivermoreLoops/kernel06: 5.49% (0.3735 => 0.3940, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.71% (3.7263 => 3.8645, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/whetstone: 2.76% (2.1528 => 2.2123, std.dev.: 0.0184) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.60% (39.4757 => 40.1084, std.dev.: 0.2297) MultiSource/Applications/sqlite3/sqlite3: 1.51% (4.4352 => 4.5023, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.43% (1.3160 => 1.3348, std.dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.54% (0.8706 => 0.8572, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.96% (5.6088 => 5.2743, std.dev.: 0.1117) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.20% (5.2197 => 5.1569, std.dev.: 0.0046) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.39% (1.0902 => 1.0945, std.dev.: 0.0603) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.46% (0.3698 => 0.3715, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 32.53% (0.0166 => 0.0220, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0428 => 0.0427, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 6.37% (0.0314 => 0.0334, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.64% (0.0314 => 0.0316, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0424 => 0.0426, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0205 => 0.0204, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 19.89% (0.0186 => 0.0223, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/Burg/burg: 1300.00% (0.0001 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -2.93% (0.1504 => 0.1460, std.dev.: 0.0364) MultiSource/Applications/lemon/lemon: 8.56% (1.1609 => 1.2603, std.dev.: 0.3777) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.25% (0.3998 => 0.4128, std.dev.: 0.0195) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.24% (0.1412 => 0.1599, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.17% (0.0642 => 0.0688, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 34.80% (0.0204 => 0.0275, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.54% (0.0596 => 0.0557, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.02% (1.1486 => 1.1488, std.dev.: 0.0222) MultiSource/Benchmarks/SciMark2-C/scimark2: 0.07% (9.3946 => 9.4008, std.dev.: 0.0233) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 260.00% (0.0005 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.01% (0.0564 => 0.0547, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.15% (0.0262 => 0.0265, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.15% (0.8045 => 0.8033, std.dev.: 0.0221) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 1.30% (0.0077 => 0.0078, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.08% (34.4494 => 34.4224, std.dev.: 0.1078) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Benchmarks/SciMark2-C/scimark2: -67.11% (28.5821 => 9.4008, std.dev.: 0.0233) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 14.43% (16.4461 => 18.8193, std.dev.: 0.4519) MultiSource/Applications/sqlite3/sqlite3: 2525.38% (0.6332 => 16.6239, std.dev.: 0.6622) MultiSource/Benchmarks/McCat/08-main/main: 52.76% (0.1831 => 0.2797, std.dev.: 0.0780) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.12% (0.1559 => 0.1592, std.dev.: 0.0372) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7136.63% (0.3123 => 22.6000, std.dev.: 1.0693) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1544.08% (0.3344 => 5.4978, std.dev.: 0.2213) SingleSource/Benchmarks/Misc-C++/Large/ray: 46.02% (0.2364 => 0.3452, std.dev.: 0.1041) SingleSource/Benchmarks/Misc-C++/bigfib: 5.72% (0.6010 => 0.6354, std.dev.: 0.2092) SingleSource/Benchmarks/Misc/mandel: 6.06% (0.0429 => 0.0455, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.72% (0.3266 => 0.3420, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/strcat: 4.27% (0.1969 => 0.2053, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.48% (0.0224 => 0.0243, std.dev.: 0.0042) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0526, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 12.65% (0.1462 => 0.1647, std.dev.: 0.0245) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.5023, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0710, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4944, std.dev.: 0.0292) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5211, std.dev.: 0.0126) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2724, std.dev.: 0.0615) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0717, std.dev.: 0.0667) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3621, std.dev.: 0.0181) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3777, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0791, std.dev.: 0.0023) SingleSource/Regression/C/uint64_to_float: -29.87% (2.1832 => 1.5311, std.dev.: 0.0022) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/spiff/spiff: 33.51% (0.7950 => 1.0614, std.dev.: 0.0826) MultiSource/Applications/minisat/minisat: 25.42% (0.6834 => 0.8571, std.dev.: 0.0054) MultiSource/Applications/lua/lua: 23.72% (3.8189 => 4.7246, std.dev.: 0.3514) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.74% (0.0810 => 0.0978, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 16.88% (14.2605 => 16.6671, std.dev.: 0.9129) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.63% (0.0848 => 0.0989, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 16.51% (6.7320 => 7.8437, std.dev.: 0.3226) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.44% (0.1062 => 0.1226, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.82% (0.0830 => 0.0953, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 14.70% (15.3280 => 17.5809, std.dev.: 0.8656) MultiSource/Benchmarks/Olden/tsp/tsp: 13.67% (0.1112 => 0.1264, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.19% (0.1157 => 0.1298, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.76% (0.4127 => 0.4571, std.dev.: 0.0096) MultiSource/Benchmarks/sim/sim: 10.04% (0.3226 => 0.3550, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.08% (0.8885 => 0.9692, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.93% (0.1778 => 0.1919, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.93% (2.1401 => 2.3098, std.dev.: 0.0593) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.55% (0.8148 => 0.8763, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.50% (0.8457 => 0.9091, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.35% (0.9039 => 0.9703, std.dev.: 0.0153) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.26% (0.3717 => 0.3987, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/football/football: 6.54% (0.8768 => 0.9341, std.dev.: 0.0194) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.72% (1.1170 => 1.1809, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 4.49% (0.8204 => 0.8572, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.47% (0.8050 => 0.8410, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.44% (0.8995 => 0.9394, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.26% (0.8286 => 0.8639, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.01% (0.3115 => 0.3240, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.84% (0.4559 => 0.4734, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 3.81% (8.6247 => 8.9532, std.dev.: 0.1060) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.01% (0.3657 => 0.3767, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash: 2.97% (0.3800 => 0.3913, std.dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: 2.50% (8.4179 => 8.6282, std.dev.: 0.0586) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 39.59% (1.5795 => 2.2048, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 32.82% (2.9096 => 3.8645, std.dev.: 0.0067) MultiSource/Applications/minisat/minisat: 30.92% (6.1525 => 8.0548, std.dev.: 0.1839) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.45% (4.8436 => 5.8827, std.dev.: 0.0398) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 21.02% (0.0528 => 0.0639, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 21.00% (8.4326 => 10.2034, std.dev.: 0.2279) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.00% (8.2783 => 9.7688, std.dev.: 0.0188) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.52% (0.7597 => 0.8928, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.70% (14.6451 => 17.0905, std.dev.: 0.0664) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.72% (2.7995 => 3.1276, std.dev.: 0.0278) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.21% (6.3772 => 7.0923, std.dev.: 0.2458) MultiSource/Applications/lambda-0_1_3/lambda: 10.69% (7.4933 => 8.2942, std.dev.: 0.0231) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.36% (0.1129 => 0.1246, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 8.10% (0.1370 => 0.1481, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.93% (3.9917 => 4.3083, std.dev.: 0.0741) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.41% (23.5781 => 25.3252, std.dev.: 0.0606) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.43% (3.3761 => 3.5931, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.15% (2.9753 => 3.1582, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.98% (4.8660 => 5.1569, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.98% (4.5327 => 4.8036, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.51% (5.4187 => 5.7171, std.dev.: 0.0140) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 5.45% (0.5214 => 0.5498, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.38% (5.3218 => 5.6082, std.dev.: 0.0245) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 5.26% (0.4353 => 0.4582, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 4.98% (0.3937 => 0.4133, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 4.76% (6.7064 => 7.0259, std.dev.: 0.0539) SingleSource/Benchmarks/Misc/whetstone: 4.24% (2.1224 => 2.2123, std.dev.: 0.0184) MultiSource/Benchmarks/Olden/power/power: 3.63% (1.2061 => 1.2499, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: 2.73% (2.3560 => 2.4203, std.dev.: 0.0206) SingleSource/Benchmarks/Dhrystone/dry: 2.40% (0.5081 => 0.5203, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.30% (39.2082 => 40.1084, std.dev.: 0.2297) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6150 => 0.6290, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 2.20% (1.7056 => 1.7432, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.19% (3.4104 => 3.4852, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: 2.06% (3.8206 => 3.8994, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.78% (11.5690 => 11.7752, std.dev.: 0.0458) SingleSource/Benchmarks/Shootout/methcall: 1.69% (8.2676 => 8.4077, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/ReedSolomon: 1.21% (8.5322 => 8.6354, std.dev.: 0.0305) SingleSource/Benchmarks/Misc/flops-7: 1.11% (1.7156 => 1.7346, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.10% (1.9302 => 1.9514, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/mandel-text: 1.05% (1.8231 => 1.8422, std.dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -41.47% (2.8951 => 1.6945, std.dev.: 0.1531) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -26.88% (7.2130 => 5.2743, std.dev.: 0.1117) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.25% (1.4529 => 1.1587, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.84% (9.9065 => 8.2385, std.dev.: 0.0145) MultiSource/Benchmarks/Olden/em3d/em3d: -12.23% (5.4641 => 4.7959, std.dev.: 0.0278) SingleSource/Benchmarks/Shootout-C++/ary3: -11.90% (1.9999 => 1.7620, std.dev.: 0.0702) SingleSource/Benchmarks/Misc/flops-8: -9.13% (2.5609 => 2.3270, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: -9.09% (63.1822 => 57.4382, std.dev.: 0.0325) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.17% (0.3269 => 0.3002, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.88% (1.0512 => 0.9684, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.23% (5.1305 => 4.8109, std.dev.: 0.0440) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.02% (4.7482 => 4.4624, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/sieve: -6.01% (7.0599 => 6.6354, std.dev.: 0.0151) SingleSource/Benchmarks/Stanford/FloatMM: -5.65% (0.8807 => 0.8309, std.dev.: 0.0172) SingleSource/Benchmarks/Misc/flops: -5.41% (9.3748 => 8.8677, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.27% (6.2275 => 5.8990, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.63% (5.6343 => 5.3734, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.53% (4.7449 => 4.5299, std.dev.: 0.0349) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.40% (6.1706 => 5.8992, std.dev.: 0.0298) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.05% (4.9453 => 4.7448, std.dev.: 0.0131) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.85% (1.3882 => 1.3348, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/perlin: -3.67% (5.1084 => 4.9208, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.53% (5.1557 => 4.9736, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.20% (5.4300 => 5.2563, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/methcall: -3.19% (8.9760 => 8.6900, std.dev.: 0.0235) SingleSource/Benchmarks/Misc/fbench: -1.98% (3.3840 => 3.3169, std.dev.: 0.0062) SingleSource/Benchmarks/Dhrystone/fldry: -1.87% (0.6910 => 0.6781, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-5: -1.70% (2.8957 => 2.8464, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/fp-convert: -1.55% (15.8853 => 15.6394, std.dev.: 0.0309) MultiSource/Benchmarks/FreeBench/neural/neural: -1.41% (1.0841 => 1.0688, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.31% (3.5679 => 3.5212, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.20% (4.2466 => 4.1955, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.09% (4.7794 => 4.7274, std.dev.: 0.0161) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 6.66% (1.0262 => 1.0945, std.dev.: 0.0603) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.83% (0.2463 => 0.3715, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.50% (0.0254 => 0.0334, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.94% (0.0384 => 0.0426, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 23.89% (0.0180 => 0.0223, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 100.00% (0.0007 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.53% (0.1438 => 0.1460, std.dev.: 0.0364) MultiSource/Applications/lemon/lemon: 11.25% (1.1329 => 1.2603, std.dev.: 0.3777) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.86% (0.4164 => 0.4128, std.dev.: 0.0195) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.80% (0.1369 => 0.1599, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.33% (0.0641 => 0.0688, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.03% (0.0195 => 0.0275, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.63% (0.0578 => 0.0557, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.45% (1.1437 => 1.1488, std.dev.: 0.0222) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1700.00% (0.0001 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.76% (0.0627 => 0.0547, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.22% (0.0180 => 0.0265, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.20% (0.8017 => 0.8033, std.dev.: 0.0221) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 25.81% (0.0062 => 0.0078, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 07:07:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 09:07:18 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121129150718.D53992A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6383?compare_to=6380&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6383, Order: 168876, Start Time: 2012-11-29 13:34:01, End Time: 2012-11-29 15:07:31 To: 6380, Order: 168867, Start Time: 2012-11-29 11:37:20, End Time: 2012-11-29 13:11:06 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (183 on baseline) Added Tests: 0 (52 on baseline) Unchanged Tests: 1093 (854 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 2.13% (0.6812 => 0.6957, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1011, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/salsa20: 2.45% (7.4937 => 7.6771, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 2.22% (3.1932 => 3.2641, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.10% (1.5103 => 1.5269, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.53% (0.1431 => 0.1309, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.41% (0.9542 => 0.8835, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.41% (0.3821 => 0.3538, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -6.78% (2.4924 => 2.3235, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.72% (0.3142 => 0.2931, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.34% (0.3357 => 0.3144, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.14% (0.2428 => 0.2279, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -6.09% (9.2283 => 8.6662, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/ReedSolomon: -6.01% (0.1879 => 0.1766, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.96% (0.1796 => 0.1689, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -5.84% (16.1920 => 15.2462, std.dev.: 0.0151) SingleSource/UnitTests/ObjC/exceptions-2: -5.82% (0.3831 => 0.3608, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -5.82% (0.9179 => 0.8645, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.81% (0.5575 => 0.5251, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.80% (0.5863 => 0.5523, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.79% (0.5925 => 0.5582, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.78% (0.6484 => 0.6109, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.78% (0.5591 => 0.5268, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.78% (0.9852 => 0.9283, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.75% (0.6194 => 0.5838, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: -5.75% (0.3880 => 0.3657, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.73% (0.6681 => 0.6298, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.73% (0.6304 => 0.5943, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -5.72% (0.3896 => 0.3673) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.72% (0.5805 => 0.5473, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: -5.71% (7.0961 => 6.6909, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.70% (1.0544 => 0.9943, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.70% (0.6667 => 0.6287, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -5.70% (1.1530 => 1.0873, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.69% (0.3884 => 0.3663, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -5.68% (0.4033 => 0.3804, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.68% (0.6395 => 0.6032, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.67% (1.3722 => 1.2944, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.67% (0.6297 => 0.5940, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.66% (0.5581 => 0.5265, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.64% (0.5569 => 0.5255, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -5.61% (0.3848 => 0.3632, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.60% (0.3658 => 0.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.59% (4.0323 => 3.8069, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -5.59% (0.3812 => 0.3599, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.55% (0.6230 => 0.5884, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.55% (0.5567 => 0.5258, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.55% (0.5859 => 0.5534, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.54% (0.6189 => 0.5846, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.53% (0.2695 => 0.2546, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.53% (0.3891 => 0.3676, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.52% (0.5941 => 0.5613, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.52% (0.5802 => 0.5482, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.51% (0.6676 => 0.6308, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.51% (0.6660 => 0.6293, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.51% (1.6364 => 1.5463, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.50% (0.6052 => 0.5719, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.48% (3.5339 => 3.3401, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions: -5.48% (0.4176 => 0.3947, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.46% (0.6395 => 0.6046, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.45% (0.5705 => 0.5394, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.44% (0.7339 => 0.6940, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.43% (1.2300 => 1.1632, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -5.43% (0.4515 => 0.4270, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.42% (0.6260 => 0.5921, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.41% (1.2784 => 1.2092, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.40% (14.2083 => 13.4410, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.40% (0.5688 => 0.5381, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.39% (0.5570 => 0.5270, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.39% (4.8802 => 4.6174, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.38% (4.8161 => 4.5570, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.33% (0.7198 => 0.6814, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.33% (0.6736 => 0.6377, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.32% (4.5069 => 4.2670, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.32% (0.6033 => 0.5712, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.30% (0.3057 => 0.2895, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -5.29% (1.3148 => 1.2453, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.28% (1.4642 => 1.3869, std.dev.: 0.0096) MultiSource/Applications/lemon/lemon: -5.27% (1.1450 => 1.0847, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.26% (0.6293 => 0.5962, std.dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: -5.26% (1.3864 => 1.3135, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.19% (0.3931 => 0.3727, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -5.17% (0.4199 => 0.3982, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.16% (0.3025 => 0.2869, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/gs/gs: -5.14% (4.3330 => 4.1105, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.13% (0.8521 => 0.8084, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.11% (0.5478 => 0.5198, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.11% (0.3406 => 0.3232, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.08% (0.3837 => 0.3642) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.08% (2.1713 => 2.0610, std.dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.07% (6.7716 => 6.4282, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: -5.07% (0.3255 => 0.3090, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.06% (0.7919 => 0.7518, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -5.06% (17.1032 => 16.2375, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/objinst: -5.04% (0.3194 => 0.3033, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: -4.99% (0.3446 => 0.3274, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.99% (0.4151 => 0.3944, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.98% (0.5999 => 0.5700, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -4.95% (15.5079 => 14.7401, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.94% (0.3016 => 0.2867, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -4.94% (0.3059 => 0.2908, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.94% (0.3323 => 0.3159, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.93% (8.0126 => 7.6175, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.93% (1.2210 => 1.1608, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.93% (1.2221 => 1.1619, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: -4.92% (0.2985 => 0.2838, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -4.92% (0.3026 => 0.2877, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -4.92% (0.2989 => 0.2842, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -4.89% (0.3394 => 0.3228, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -4.89% (1.2515 => 1.1903, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.88% (0.2933 => 0.2790, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.87% (0.2278 => 0.2167, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.87% (0.5857 => 0.5572, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.86% (0.2385 => 0.2269, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.86% (0.2903 => 0.2762, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.84% (0.4280 => 0.4073, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.83% (0.3849 => 0.3663, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: -4.80% (0.3205 => 0.3051, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -4.80% (0.2939 => 0.2798, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.80% (0.3252 => 0.3096, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.79% (0.3483 => 0.3316, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.79% (0.6446 => 0.6137, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -4.79% (0.4861 => 0.4628, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.79% (0.5849 => 0.5569, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.78% (0.4916 => 0.4681, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -4.76% (15.2527 => 14.5272, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/moments: -4.76% (0.4248 => 0.4046, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.75% (0.2548 => 0.2427, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -4.75% (3.5154 => 3.3485, std.dev.: 0.0106) MultiSource/Benchmarks/McCat/18-imp/imp: -4.75% (0.3581 => 0.3411, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.74% (0.2849 => 0.2714, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -4.71% (0.3867 => 0.3685, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.70% (0.5168 => 0.4925, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -4.70% (0.7447 => 0.7097, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.67% (0.4321 => 0.4119, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.67% (0.4813 => 0.4588, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: -4.67% (0.2871 => 0.2737, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -4.61% (0.3621 => 0.3454, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.60% (0.5456 => 0.5205, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.60% (0.5329 => 0.5084, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (0.7021 => 0.6702, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference: -4.54% (0.7779 => 0.7426, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.53% (0.2999 => 0.2863, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: -4.51% (0.2659 => 0.2539, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -4.49% (34.0927 => 32.5605, std.dev.: 0.0114) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.49% (22.4056 => 21.3992, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.48% (0.9557 => 0.9129, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -4.46% (4.0594 => 3.8782, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.40% (1.6474 => 1.5749, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.36% (0.6440 => 0.6159, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -4.33% (2.4021 => 2.2981, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.29% (0.4427 => 0.4237, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.29% (0.4083 => 0.3908, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -4.29% (0.6347 => 0.6075, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -4.24% (0.6750 => 0.6464, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -4.23% (2.1401 => 2.0495, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/sieve: -4.22% (0.3788 => 0.3628, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -4.15% (0.6441 => 0.6174, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -4.12% (0.7982 => 0.7653, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -4.08% (18.2933 => 17.5471, std.dev.: 0.0102) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.05% (0.9077 => 0.8709, std.dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.04% (0.3319 => 0.3185, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -3.97% (0.3271 => 0.3141, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.90% (5.0226 => 4.8269, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: -3.87% (0.4524 => 0.4349, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.82% (2.2587 => 2.1725, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.78% (0.3491 => 0.3359, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -3.66% (0.8418 => 0.8110, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.61% (1.5610 => 1.5046, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.86% (5.4682 => 5.3117, std.dev.: 0.0069) SingleSource/UnitTests/Vector/constpool: -2.39% (20.7746 => 20.2771, std.dev.: 0.0360) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1960, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -61.56% (1.8100 => 0.6957, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7528, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Misc/richards_benchmark: -8.66% (1.2842 => 1.1730, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.68% (2.2633 => 2.1800, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.27% (1.3096 => 1.2668, std.dev.: 0.0121) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3985, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4721, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 08:49:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 10:49:35 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121129164935.102BE2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6384?compare_to=6378&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6384, Order: 168871, Start Time: 2012-11-29 13:23:16, End Time: 2012-11-29 16:50:08 To: 6378, Order: 168856, Start Time: 2012-11-29 09:07:52, End Time: 2012-11-29 12:35:06 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (180 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (186 on baseline) Unchanged Tests: 1091 (710 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 3.56% (0.4208 => 0.4358, std.dev.: 0.0042) SingleSource/UnitTests/ObjC++/property-reference: 1.34% (0.8274 => 0.8385, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.15% (2.1037 => 2.1279, std.dev.: 0.0029) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.88% (0.0625 => 0.0893, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.05% (0.1063 => 0.1425, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.68% (0.2969 => 0.3761, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.58% (0.1106 => 0.1400, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.66% (0.4139 => 0.5201, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.65% (0.4253 => 0.5344, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.49% (0.0714 => 0.0896, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.07% (0.5900 => 0.7379, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 24.90% (1.5932 => 1.9899, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.63% (0.0475 => 0.0592, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.58% (0.0415 => 0.0517, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.12% (0.5000 => 0.6206, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.11% (0.4994 => 0.6198, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.77% (0.0547 => 0.0677, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.52% (0.1620 => 0.2001, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.46% (0.0584 => 0.0721, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.31% (0.1021 => 0.1259, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.04% (0.1107 => 0.1362, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 22.37% (0.0599 => 0.0733, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.19% (0.0897 => 0.1096, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.12% (0.0633 => 0.0773, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.92% (0.0584 => 0.0712, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.63% (0.0541 => 0.0658, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 21.62% (0.0948 => 0.1153, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.50% (0.0642 => 0.0780, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.49% (0.1103 => 0.1340, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.21% (0.0495 => 0.0600, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.94% (0.1003 => 0.1213, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.93% (0.3903 => 0.4720, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.92% (0.0822 => 0.0994, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.89% (0.1604 => 0.1939, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.85% (0.1549 => 0.1872, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 20.75% (0.1619 => 0.1955, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/health/health: 20.71% (0.0821 => 0.0991, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 20.03% (0.0604 => 0.0725, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 19.96% (0.0947 => 0.1136, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 19.73% (0.1505 => 0.1802, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.56% (0.1462 => 0.1748, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 19.46% (0.5826 => 0.6960, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.22% (0.2014 => 0.2401, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.13% (0.3890 => 0.4634, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 19.07% (0.5889 => 0.7012, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 19.06% (0.0808 => 0.0962, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 18.97% (0.1218 => 0.1449) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.90% (0.1968 => 0.2340, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 18.89% (0.4029 => 0.4790, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 18.77% (0.0698 => 0.0829, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.60% (0.2736 => 0.3245, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.58% (1.3152 => 1.5596, std.dev.: 0.0039) MultiSource/Applications/hbd/hbd: 18.43% (0.9697 => 1.1484, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.36% (0.0572 => 0.0677, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.32% (0.2866 => 0.3391, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.20% (0.1088 => 0.1286, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.00% (3.5627 => 4.2039, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.95% (0.2875 => 0.3391, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.93% (0.1160 => 0.1368, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.80% (0.0573 => 0.0675, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 17.76% (1.8794 => 2.2132, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.61% (0.3271 => 0.3847, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 17.56% (0.5546 => 0.6520, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.43% (1.6211 => 1.9037, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.43% (0.4658 => 0.5470, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.38% (0.2738 => 0.3214, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 17.32% (0.2725 => 0.3197, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 17.30% (0.2780 => 0.3261, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 17.24% (0.2714 => 0.3182, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 17.24% (0.2750 => 0.3224, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.23% (0.5026 => 0.5892, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.23% (0.2792 => 0.3273, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.22% (0.2729 => 0.3199, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 17.21% (0.2813 => 0.3297, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.19% (0.0605 => 0.0709, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 17.11% (0.2811 => 0.3292, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 17.11% (0.2823 => 0.3306, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.11% (0.2911 => 0.3409, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 17.10% (0.1421 => 0.1664, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.96% (2.7292 => 3.1920, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/random: 16.95% (0.2803 => 0.3278, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 16.93% (0.7171 => 0.8385, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 16.93% (0.3096 => 0.3620, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 16.88% (1.0781 => 1.2601, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 16.84% (0.9909 => 1.1578, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.76% (0.4361 => 0.5092, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 16.74% (0.3004 => 0.3507, std.dev.: 0.0072) MultiSource/Applications/ClamAV/clamscan: 16.72% (4.2109 => 4.9149, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.72% (2.0673 => 2.4129, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.64% (0.3930 => 0.4584, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.59% (0.3195 => 0.3725, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.44% (4.4195 => 5.1459, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/bh/bh: 16.36% (0.1284 => 0.1494, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 16.35% (0.3267 => 0.3801, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.34% (0.3060 => 0.3560, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.16% (1.9966 => 2.3192, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.10% (1.9694 => 2.2865, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.08% (0.3488 => 0.4049, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 16.08% (0.3258 => 0.3782, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.01% (0.3124 => 0.3624, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 15.98% (0.3317 => 0.3847, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.91% (0.3362 => 0.3897, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.78% (0.1090 => 0.1262, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 15.70% (0.3465 => 0.4009, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 15.63% (23.5202 => 27.1974, std.dev.: 0.0108) SingleSource/UnitTests/ObjC/exceptions-2: 15.50% (0.3446 => 0.3980, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.45% (0.3282 => 0.3789, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 15.45% (0.3496 => 0.4036, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 15.43% (0.3726 => 0.4301, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 15.42% (0.3469 => 0.4004, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 15.38% (0.3460 => 0.3992, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 15.37% (0.3442 => 0.3971, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 15.33% (0.3678 => 0.4242, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 15.29% (0.3348 => 0.3860, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash: 15.27% (0.4146 => 0.4779, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 15.07% (0.3650 => 0.4200, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 15.02% (0.3643 => 0.4190, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 14.99% (0.2075 => 0.2386, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 14.96% (0.3477 => 0.3997, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.90% (0.3625 => 0.4165, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 14.85% (0.2566 => 0.2947, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.82% (0.3981 => 0.4571, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 14.69% (0.3724 => 0.4271, std.dev.: 0.0031) MultiSource/Applications/lua/lua: 14.65% (1.4269 => 1.6359, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.58% (0.3690 => 0.4228, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 14.53% (0.7875 => 0.9019, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 14.51% (0.4251 => 0.4868, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.38% (0.3845 => 0.4398, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 14.29% (0.5012 => 0.5728, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 14.07% (2.1653 => 2.4700, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 13.83% (2.1013 => 2.3920, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 13.82% (4.6177 => 5.2557, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 13.72% (0.0758 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.67% (0.1383 => 0.1572, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.19% (0.2040 => 0.2309, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 13.01% (0.2691 => 0.3041, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.53% (0.6435 => 0.7241, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 12.29% (0.3498 => 0.3928, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 12.24% (5.5417 => 6.2202, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 11.28% (0.6634 => 0.7382, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.25% (0.2737 => 0.3045, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.22% (0.2068 => 0.2300, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.19% (0.1028 => 0.1143, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 10.85% (0.4847 => 0.5373, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.77% (0.3084 => 0.3416, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 10.55% (0.3336 => 0.3688, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 9.95% (2.0346 => 2.2371, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 9.91% (0.2391 => 0.2628, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.70% (0.2103 => 0.2307, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.52% (0.5361 => 0.5818, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.44% (4.6926 => 5.0886, std.dev.: 0.0076) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.43% (11.6398 => 12.6215, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.07% (0.7426 => 0.8025, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.66% (0.5584 => 0.6012, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 6.98% (11.9555 => 12.7894, std.dev.: 0.0149) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.96% (0.3792 => 0.4018, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.99% (29.0505 => 33.4066, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 9.06% (0.2802 => 0.3056, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 7.02% (0.2122 => 0.2271, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6096, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.28% (0.3693 => 0.3925, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6685, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-2: 5.07% (1.8057 => 1.8973, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1696, std.dev.: 0.0277) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.59% (79.9355 => 83.6056, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/dry: 4.21% (14.0481 => 14.6389, std.dev.: 0.0125) MultiSource/Benchmarks/Olden/health/health: 2.69% (0.6276 => 0.6445, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.20% (2.0820 => 2.1279, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1940, std.dev.: 0.0399) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2253, std.dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3054, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.37% (7.1849 => 7.2833, std.dev.: 0.0027) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5407, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5801, std.dev.: 0.0219) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.65% (2.4764 => 2.3859, std.dev.: 0.0112) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.98% (25.4195 => 16.5279, std.dev.: 0.0209) SingleSource/Benchmarks/Shootout-C++/ary2: -8.41% (0.2402 => 0.2200, std.dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9769, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7982, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std.dev.: 0.0069) SingleSource/UnitTests/Vector/build2: -3.71% (11.2080 => 10.7917, std.dev.: 0.0143) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std.dev.: 0.0047) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7744, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -2.68% (17.2379 => 16.7764, std.dev.: 0.0786) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8589, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.69% (10.7630 => 10.5815, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4972, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1708, std.dev.: 0.0995) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0453, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 08:52:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 10:52:21 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121129165221.93E402A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6385?compare_to=6382&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6385, Order: 168887, Start Time: 2012-11-29 15:14:58, End Time: 2012-11-29 16:52:55 To: 6382, Order: 168874, Start Time: 2012-11-29 13:11:45, End Time: 2012-11-29 14:49:06 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 11 (65 on baseline) Performance Improvements: 16 (37 on baseline) Added Tests: 0 (51 on baseline) Existing Failures: 42 (40 on baseline) Unchanged Tests: 1025 (871 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 24.50% (0.2424 => 0.3018, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 21.83% (4.4404 => 5.4098, std.dev.: 0.2459) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.26% (1.0486 => 1.1142, std.dev.: 0.0111) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.55% (2.7432 => 3.0600, std.dev.: 0.0597) SingleSource/Benchmarks/Linpack/linpack-pc: 7.12% (47.5470 => 50.9336, std.dev.: 0.9139) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.51% (5.2743 => 5.5123, std.dev.: 0.0772) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.20% (41.8123 => 43.1488, std.dev.: 0.3397) SingleSource/Benchmarks/Shootout/ary3: 2.20% (2.0938 => 2.1398, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 2.17% (1.8474 => 1.8874, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.85% (1.5910 => 1.6205, std.dev.: 0.0075) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (5.6180 => 5.6844, std.dev.: 0.0090) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel08: -25.36% (0.1660 => 0.1239, std.dev.: 0.0099) SingleSource/Benchmarks/LivermoreLoops/kernel16: -22.59% (0.1483 => 0.1148, std.dev.: 0.0050) MultiSource/Applications/viterbi/viterbi: -15.45% (0.1922 => 0.1625, std.dev.: 0.0090) SingleSource/Benchmarks/LivermoreLoops/kernel02: -14.30% (0.1238 => 0.1061, std.dev.: 0.0009) SingleSource/Benchmarks/LivermoreLoops/kernel06: -10.78% (0.1206 => 0.1076, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.45% (0.3452 => 0.3264, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.64% (0.8833 => 0.8600, std.dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel24: -36.47% (0.3455 => 0.2195, std.dev.: 0.0123) SingleSource/Benchmarks/LivermoreLoops/kernel08: -13.79% (0.3147 => 0.2713, std.dev.: 0.0036) SingleSource/Benchmarks/LivermoreLoops/kernel06: -5.13% (0.3940 => 0.3738, std.dev.: 0.0033) SingleSource/Benchmarks/LivermoreLoops/kernel01: -4.38% (0.2353 => 0.2250, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.03% (3.8645 => 3.7087, std.dev.: 0.0560) SingleSource/Benchmarks/Shootout-C++/hash: -2.47% (0.6363 => 0.6206, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -2.30% (1.2840 => 1.2545, std.dev.: 0.0087) MultiSource/Applications/sqlite3/sqlite3: -2.13% (4.5023 => 4.4063, std.dev.: 0.0318) SingleSource/Benchmarks/Misc/mandel-2: -1.25% (1.6945 => 1.6733, std.dev.: 0.0082) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.66% (1.0945 => 1.1346, std.dev.: 0.2048) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.40% (0.3715 => 0.3700, std.dev.: 0.0110) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0220 => 0.0220, std.dev.: 0.0059) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0427 => 0.0428, std.dev.: 0.0143) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0334 => 0.0334, std.dev.: 0.0080) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0316 => 0.0315, std.dev.: 0.0080) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 4.93% (0.0426 => 0.0447, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/casts: 1.96% (0.0204 => 0.0208, std.dev.: 0.0065) SingleSource/UnitTests/Vector/Altivec/test1: -1.79% (0.0223 => 0.0219, std.dev.: 0.0067) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: - (0.1460 => 0.1460, std.dev.: 0.0033) MultiSource/Applications/lemon/lemon: -2.90% (1.2603 => 1.2237, std.dev.: 0.3858) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.90% (0.4128 => 0.4165, std.dev.: 0.1291) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -9.38% (0.1599 => 0.1449, std.dev.: 0.0292) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.69% (0.0688 => 0.0642, std.dev.: 0.0174) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 9.82% (0.0275 => 0.0302, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.82% (0.0557 => 0.0595, std.dev.: 0.0153) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.30% (1.1488 => 1.1523, std.dev.: 0.1254) MultiSource/Benchmarks/SciMark2-C/scimark2: 0.04% (9.4008 => 9.4045, std.dev.: 0.0397) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 66.67% (0.0018 => 0.0030, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.60% (0.0547 => 0.0605, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.02% (0.0265 => 0.0273, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.29% (0.8033 => 0.8056, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 1.28% (0.0078 => 0.0079, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.21% (34.4224 => 34.4951, std.dev.: 0.1098) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Benchmarks/SciMark2-C/scimark2: -67.10% (28.5821 => 9.4045, std.dev.: 0.0397) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 12.47% (16.4461 => 18.4968, std.dev.: 1.3720) MultiSource/Applications/sqlite3/sqlite3: 2355.99% (0.6332 => 15.5513, std.dev.: 0.8912) MultiSource/Benchmarks/McCat/08-main/main: 50.79% (0.1831 => 0.2761, std.dev.: 0.0168) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.03% (0.1559 => 0.1465, std.dev.: 0.0426) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7107.17% (0.3123 => 22.5080, std.dev.: 1.1511) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1555.50% (0.3344 => 5.5360, std.dev.: 0.1952) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.07% (0.2364 => 0.3264, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 6.21% (0.6010 => 0.6383, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: 0.47% (0.0429 => 0.0431, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.17% (0.3266 => 0.3435, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 3.86% (0.1969 => 0.2045, std.dev.: 0.0032) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.80% (0.0224 => 0.0237, std.dev.: 0.0033) SingleSource/UnitTests/byval-alignment: -25.65% (0.0230 => 0.0171, std.dev.: 0.0059) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0597, std.dev.: 0.0067) MultiSource/Applications/oggenc/oggenc: 12.31% (0.1462 => 0.1642, std.dev.: 0.0104) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4063, std.dev.: 0.0318) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0680, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4942, std.dev.: 0.0230) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5201, std.dev.: 0.0172) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2829, std.dev.: 0.0385) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0674, std.dev.: 0.0195) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3631, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3708, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0763, std.dev.: 0.0023) SingleSource/Regression/C/uint64_to_float: -29.85% (2.1832 => 1.5315, std.dev.: 0.0109) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 38.44% (0.2180 => 0.3018, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 29.54% (4.1763 => 5.4098, std.dev.: 0.2459) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 22.54% (0.2240 => 0.2745, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.23% (4.4873 => 5.4847, std.dev.: 0.3465) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.45% (0.9908 => 1.1142, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/flops: 11.21% (0.0937 => 0.1042, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.31% (0.8656 => 0.9462, std.dev.: 0.0255) MultiSource/Benchmarks/sim/sim: 9.14% (0.3226 => 0.3521, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.69% (0.8611 => 0.9273, std.dev.: 0.0205) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.57% (2.1401 => 2.3020, std.dev.: 0.0356) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.49% (0.8927 => 0.9596, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.02% (0.8359 => 0.8946, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.78% (0.8177 => 0.8731, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.76% (0.8048 => 0.8592, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.25% (0.8261 => 0.8777, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 6.22% (0.8697 => 0.9238, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 6.18% (0.8518 => 0.9044, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.08% (3.1832 => 3.3768, std.dev.: 0.0689) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 5.53% (0.8805 => 0.9292, std.dev.: 0.0179) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (0.5191 => 0.5439, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.82% (0.4559 => 0.4733, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.24% (0.3115 => 0.3216, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.12% (0.8340 => 0.8600, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.12% (0.3657 => 0.3771, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 56.28% (0.0199 => 0.0311, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/pi: 36.36% (1.5795 => 2.1538, std.dev.: 0.0246) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 27.46% (2.9096 => 3.7087, std.dev.: 0.0560) MultiSource/Benchmarks/Ptrdist/ft/ft: 25.91% (0.8789 => 1.1066, std.dev.: 0.0844) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.44% (4.8436 => 5.8819, std.dev.: 0.0229) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.77% (2.5763 => 3.0600, std.dev.: 0.0597) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.68% (8.2783 => 9.7418, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.56% (0.7597 => 0.8931, std.dev.: 0.0134) SingleSource/Benchmarks/McGill/misr: 16.15% (0.4001 => 0.4647, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.93% (0.3186 => 0.3598, std.dev.: 0.0089) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.13% (14.6451 => 16.4218, std.dev.: 0.4244) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.78% (2.7995 => 3.1292, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.74% (6.3772 => 7.0623, std.dev.: 0.1978) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.54% (0.1129 => 0.1248, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 10.33% (7.4933 => 8.2672, std.dev.: 0.2084) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.29% (1.1857 => 1.3077, std.dev.: 0.0211) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.36% (23.5781 => 25.3125, std.dev.: 0.1165) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 6.08% (4.8660 => 5.1620, std.dev.: 0.0329) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.04% (3.3761 => 3.5801, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.56% (0.3937 => 0.4156, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 5.56% (0.2015 => 0.2127, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.54% (5.4187 => 5.7191, std.dev.: 0.0124) SingleSource/Benchmarks/CoyoteBench/lpbench: 5.32% (3.9006 => 4.1082, std.dev.: 0.0711) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.30% (5.3218 => 5.6040, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 5.17% (0.4353 => 0.4578, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 5.10% (0.5214 => 0.5480, std.dev.: 0.0044) MultiSource/Applications/aha/aha: 4.78% (3.3398 => 3.4994, std.dev.: 0.0236) SingleSource/Benchmarks/Misc/richards_benchmark: 4.63% (1.3037 => 1.3640, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.16% (41.4238 => 43.1488, std.dev.: 0.3397) MultiSource/Benchmarks/Olden/power/power: 3.38% (1.2061 => 1.2469, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.40% (3.4104 => 3.4924, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.39% (0.6150 => 0.6297, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/queens: 2.20% (1.7056 => 1.7432, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/ary3: 2.14% (2.0949 => 2.1398, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.08% (4.9469 => 5.0500, std.dev.: 0.0224) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.08% (11.5690 => 11.8093, std.dev.: 0.0369) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.66% (1.5941 => 1.6205, std.dev.: 0.0075) MultiSource/Benchmarks/BitBench/five11/five11: 1.45% (5.6030 => 5.6844, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/ReedSolomon: 1.23% (8.5322 => 8.6370, std.dev.: 0.0392) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.16% (6.7533 => 6.8318, std.dev.: 0.0151) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.12% (1.9302 => 1.9518, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.20% (2.8951 => 1.6733, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -23.58% (7.2130 => 5.5123, std.dev.: 0.0772) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.24% (1.4529 => 1.1588, std.dev.: 0.0328) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.77% (9.9065 => 8.2451, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/em3d/em3d: -12.66% (5.4641 => 4.7724, std.dev.: 0.0658) SingleSource/Benchmarks/Shootout-C++/ary3: -11.62% (1.9999 => 1.7675, std.dev.: 0.0142) SingleSource/Benchmarks/McGill/chomp: -9.98% (1.1216 => 1.0097, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-8: -9.79% (2.5609 => 2.3101, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: -8.90% (63.1822 => 57.5568, std.dev.: 0.2262) SingleSource/Benchmarks/Stanford/FloatMM: -6.70% (0.8807 => 0.8217, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ffbench: -6.44% (1.4296 => 1.3375, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.18% (4.7482 => 4.4547, std.dev.: 0.1010) SingleSource/Benchmarks/Shootout/sieve: -6.08% (7.0599 => 6.6310, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.97% (5.1305 => 4.8242, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/flops: -5.37% (9.3748 => 8.8716, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.03% (6.2275 => 5.9144, std.dev.: 0.0287) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.79% (5.6343 => 5.3646, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.39% (4.7449 => 4.5366, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: -4.31% (4.3552 => 4.1676, std.dev.: 0.0643) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.20% (6.1706 => 5.9115, std.dev.: 0.0314) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.70% (3.7148 => 3.5772, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/perlin: -3.61% (5.1084 => 4.9242, std.dev.: 0.0337) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.59% (4.9453 => 4.7679, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.57% (5.1557 => 4.9717, std.dev.: 0.0514) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.22% (4.9686 => 4.8085, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/methcall: -3.22% (8.9760 => 8.6870, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.08% (5.4300 => 5.2630, std.dev.: 0.0423) MultiSource/Applications/siod/siod: -2.68% (3.6643 => 3.5661, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/fbench: -2.24% (3.3840 => 3.3082, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.04% (3.3479 => 3.2796, std.dev.: 0.0130) SingleSource/Benchmarks/Dhrystone/fldry: -1.97% (0.6910 => 0.6774, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-5: -1.88% (2.8957 => 2.8413, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.60% (3.5679 => 3.5109, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/flops-6: -1.54% (2.4416 => 2.4039, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/fp-convert: -1.53% (15.8853 => 15.6416, std.dev.: 0.0240) MultiSource/Benchmarks/FreeBench/neural/neural: -1.33% (1.0841 => 1.0697, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.11% (4.7794 => 4.7262, std.dev.: 0.0152) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 10.56% (1.0262 => 1.1346, std.dev.: 0.2048) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.22% (0.2463 => 0.3700, std.dev.: 0.0110) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0059) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0143) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.50% (0.0254 => 0.0334, std.dev.: 0.0080) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0080) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 16.41% (0.0384 => 0.0447, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/casts: 9.47% (0.0190 => 0.0208, std.dev.: 0.0065) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0067) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.53% (0.1438 => 0.1460, std.dev.: 0.0033) MultiSource/Applications/lemon/lemon: 8.01% (1.1329 => 1.2237, std.dev.: 0.3858) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.02% (0.4164 => 0.4165, std.dev.: 0.1291) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.84% (0.1369 => 0.1449, std.dev.: 0.0292) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.16% (0.0641 => 0.0642, std.dev.: 0.0174) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 54.87% (0.0195 => 0.0302, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.94% (0.0578 => 0.0595, std.dev.: 0.0153) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.75% (1.1437 => 1.1523, std.dev.: 0.1254) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.51% (0.0627 => 0.0605, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 51.67% (0.0180 => 0.0273, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.49% (0.8017 => 0.8056, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 27.42% (0.0062 => 0.0079, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 09:04:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 11:04:01 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121129170401.DD6242A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6386?compare_to=6383&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6386, Order: 168887, Start Time: 2012-11-29 15:30:51, End Time: 2012-11-29 17:04:36 To: 6383, Order: 168876, Start Time: 2012-11-29 13:34:01, End Time: 2012-11-29 15:07:31 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (183 on baseline) Added Tests: 0 (52 on baseline) Unchanged Tests: 1094 (854 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.15% (0.3834 => 0.3993, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1016, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: 2.43% (7.4937 => 7.6759, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash2: 1.81% (3.1932 => 3.2510, std.dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.04% (0.1431 => 0.1316, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.51% (0.3821 => 0.3534, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.85% (0.9542 => 0.8888, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.33% (0.3142 => 0.2943, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -6.32% (2.4924 => 2.3350, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.93% (0.2428 => 0.2284, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -5.90% (0.3357 => 0.3159, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: -5.65% (0.2160 => 0.2038, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -5.64% (0.1879 => 0.1773, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -5.59% (9.2283 => 8.7122, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.53% (0.7198 => 0.6800, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.49% (0.3658 => 0.3457, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.46% (1.0544 => 0.9968, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: -5.43% (0.9179 => 0.8681, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -5.42% (16.1920 => 15.3147, std.dev.: 0.0090) MultiSource/Applications/JM/ldecod/ldecod: -5.40% (7.0961 => 6.7126, std.dev.: 0.0105) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.37% (0.9852 => 0.9323, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.35% (0.6484 => 0.6137, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.28% (1.3722 => 1.2998, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.25% (0.6052 => 0.5734, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.25% (0.6667 => 0.6317, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.23% (0.3057 => 0.2897, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.23% (3.5339 => 3.3492, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.22% (0.5575 => 0.5284, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.20% (1.2300 => 1.1660, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.19% (0.2695 => 0.2555, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.19% (0.6304 => 0.5977, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.18% (4.0323 => 3.8233, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.18% (0.6194 => 0.5873, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.17% (0.6189 => 0.5869, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: -5.15% (1.1530 => 1.0936, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.15% (0.5805 => 0.5506, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.14% (0.2355 => 0.2234, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.13% (0.6681 => 0.6338, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.13% (0.6395 => 0.6067, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.12% (0.5581 => 0.5295, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (0.5941 => 0.5637, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.12% (0.5863 => 0.5563, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.12% (0.5591 => 0.5305, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.11% (0.5925 => 0.5622, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.10% (0.6260 => 0.5941, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.09% (0.3931 => 0.3731, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.08% (1.6364 => 1.5532, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.06% (0.7919 => 0.7518, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.06% (0.6660 => 0.6323, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.05% (0.5859 => 0.5563, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.05% (0.6395 => 0.6072, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.05% (0.7524 => 0.7144, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.05% (0.6297 => 0.5979, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.05% (1.4642 => 1.3903, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.04% (0.6230 => 0.5916, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.03% (0.7339 => 0.6970, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.03% (0.5569 => 0.5289, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.02% (0.6676 => 0.6341, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -5.01% (4.3330 => 4.1158, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.01% (0.5567 => 0.5288, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -5.00% (1.1450 => 1.0877, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -4.99% (1.2784 => 1.2146, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: -4.98% (0.2871 => 0.2728, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -4.98% (17.1032 => 16.2517, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.97% (0.3016 => 0.2866, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.97% (0.6736 => 0.6401, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -4.97% (4.8161 => 4.5767, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.97% (0.3323 => 0.3158, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -4.92% (1.3148 => 1.2501, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -4.92% (0.3255 => 0.3095, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.91% (0.4151 => 0.3947, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.90% (0.3837 => 0.3649, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.90% (2.1713 => 2.0650, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.89% (0.5705 => 0.5426, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.89% (4.5069 => 4.2866, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.88% (0.6293 => 0.5986, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.87% (14.2083 => 13.5157, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -4.87% (1.3864 => 1.3189, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wc: -4.87% (0.3205 => 0.3049, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -4.87% (0.2939 => 0.2796, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.86% (0.3252 => 0.3094, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.84% (0.5802 => 0.5521, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.84% (0.6033 => 0.5741, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.82% (0.3406 => 0.3242, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -4.81% (4.8802 => 4.6454, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.81% (0.2933 => 0.2792, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -4.79% (0.3026 => 0.2881, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.76% (0.5570 => 0.5305, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.75% (0.2903 => 0.2765, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.75% (0.2989 => 0.2847, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: -4.74% (0.3059 => 0.2914, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -4.72% (0.2985 => 0.2844, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: -4.72% (0.4515 => 0.4302, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -4.71% (0.3394 => 0.3234, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -4.71% (0.3481 => 0.3317, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.71% (0.3483 => 0.3319, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -4.70% (0.3446 => 0.3284, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -4.69% (0.3025 => 0.2883, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.67% (6.7716 => 6.4552, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hello: -4.67% (0.2849 => 0.2716, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.66% (0.8521 => 0.8124, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: -4.63% (0.4861 => 0.4636, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -4.63% (0.2659 => 0.2536, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.61% (0.5688 => 0.5426, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -4.60% (0.3194 => 0.3047, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.59% (0.2548 => 0.2431, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.58% (0.4321 => 0.4123, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -4.58% (15.5079 => 14.7974, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.55% (0.5999 => 0.5726, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.55% (0.3849 => 0.3674, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/moments: -4.54% (0.4248 => 0.4055, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.53% (0.5168 => 0.4934, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -4.52% (1.2515 => 1.1949, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.51% (0.3884 => 0.3709, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.50% (1.2210 => 1.1660, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.50% (8.0126 => 7.6519, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/lists: -4.50% (0.3621 => 0.3458, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.48% (1.2221 => 1.1674, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.46% (0.3831 => 0.3660, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.45% (0.4916 => 0.4697, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -4.44% (0.3848 => 0.3677, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.44% (0.4033 => 0.3854, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.43% (0.3880 => 0.3708, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.42% (0.5478 => 0.5236, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: -4.41% (0.3896 => 0.3724, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -4.41% (15.2527 => 14.5797, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/18-imp/imp: -4.41% (0.3581 => 0.3423, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: -4.39% (3.5154 => 3.3610, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.39% (0.7021 => 0.6713, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: -4.37% (0.3867 => 0.3698, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions: -4.36% (0.4176 => 0.3994, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -4.35% (4.0594 => 3.8830, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.34% (0.4083 => 0.3906, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.33% (0.2999 => 0.2869, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.33% (0.3812 => 0.3647, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.32% (0.5857 => 0.5604, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.32% (0.3891 => 0.3723, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.31% (0.5849 => 0.5597, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.28% (22.4056 => 21.4459, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.28% (0.4813 => 0.4607, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.25% (0.6446 => 0.6172, std.dev.: 0.0073) MultiSource/Applications/minisat/minisat: -4.24% (0.7447 => 0.7131, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.24% (0.5329 => 0.5103, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.23% (0.2385 => 0.2284, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.23% (1.6474 => 1.5777, std.dev.: 0.0065) SingleSource/UnitTests/ObjC++/property-reference: -4.19% (0.7779 => 0.7453, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.19% (0.9557 => 0.9157, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.18% (0.6440 => 0.6171, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -4.12% (34.0927 => 32.6877, std.dev.: 0.0067) MultiSource/Applications/siod/siod: -4.11% (2.4021 => 2.3033, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/property: -4.07% (0.4199 => 0.4028, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.07% (0.5456 => 0.5234, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: -4.04% (0.3788 => 0.3635, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -4.03% (0.7982 => 0.7660, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: -3.99% (5.0226 => 4.8222, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: -3.98% (18.2933 => 17.5650, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.93% (0.4427 => 0.4253, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -3.92% (2.1401 => 2.0563, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: -3.88% (0.6347 => 0.6101, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -3.84% (0.6750 => 0.6491, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -3.79% (0.3271 => 0.3147, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: -3.79% (0.4280 => 0.4118, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -3.78% (0.4524 => 0.4353, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: -3.63% (0.6441 => 0.6207, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.53% (0.3319 => 0.3202, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.50% (2.2587 => 2.1797, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.49% (0.3491 => 0.3369, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: -3.27% (1.5610 => 1.5100, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: -3.22% (0.8418 => 0.8147, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.21% (0.9077 => 0.8786, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.73% (5.4682 => 5.3188, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -2.02% (20.7746 => 20.3556, std.dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1949, std.dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: -61.59% (1.8100 => 0.6953, std.dev.: 0.0168) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -23.35% (7.5137 => 5.7592, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Misc/richards_benchmark: -8.68% (1.2842 => 1.1727, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7069, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.74% (2.2633 => 2.1786, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3996, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4713, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 09:28:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 11:28:52 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121129172852.3D6D02A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6387?compare_to=6381&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6387, Order: 168879, Start Time: 2012-11-29 15:02:16, End Time: 2012-11-29 17:29:23 To: 6381, Order: 168867, Start Time: 2012-11-29 11:41:20, End Time: 2012-11-29 14:02:16 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 36 (118 on baseline) Performance Improvements: 1 (43 on baseline) Added Tests: 0 (186 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1051 (724 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/siod/siod: 16.79% (2.5965 => 3.0324, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 15.04% (0.7189 => 0.8270, std.dev.: 0.0283) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.55% (0.6682 => 0.7654, std.dev.: 0.0223) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 13.86% (0.5887 => 0.6703, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/city/city: 13.17% (2.2518 => 2.5484, std.dev.: 0.0326) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.74% (0.7575 => 0.8540, std.dev.: 0.0313) MultiSource/Benchmarks/MallocBench/gs/gs: 12.36% (4.7173 => 5.3002, std.dev.: 0.0441) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 11.88% (4.6158 => 5.1642, std.dev.: 0.0616) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.84% (0.1166 => 0.1304, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.82% (1.3144 => 1.4698, std.dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.76% (0.8996 => 1.0054, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.65% (0.2241 => 0.2502, std.dev.: 0.0080) MultiSource/Applications/SIBsim4/SIBsim4: 11.26% (1.5587 => 1.7342, std.dev.: 0.0098) MultiSource/Applications/hexxagon/hexxagon: 10.80% (1.3860 => 1.5357, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.66% (0.5880 => 0.6507, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.39% (0.6672 => 0.7365, std.dev.: 0.0101) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.98% (0.3588 => 0.3946, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.92% (1.1098 => 1.2199, std.dev.: 0.0131) MultiSource/Applications/hbd/hbd: 9.45% (1.7308 => 1.8943, std.dev.: 0.0178) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.46% (0.1714 => 0.1859, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.83% (0.3449 => 0.3719, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.51% (0.3249 => 0.3493, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 7.38% (0.7263 => 0.7799, std.dev.: 0.0198) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.99% (0.4192 => 0.4485, std.dev.: 0.0101) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.07% (0.5236 => 0.5554, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.52% (10.7684 => 11.3633, std.dev.: 0.1022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.91% (0.3339 => 0.3503, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.33% (4.7827 => 4.9422, std.dev.: 0.0403) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.04% (1.5558 => 1.8364, std.dev.: 0.0697) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 14.32% (2.7505 => 3.1445, std.dev.: 0.0732) MultiSource/Applications/ClamAV/clamscan: 6.54% (0.1544 => 0.1645, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 6.05% (3.1716 => 3.3634, std.dev.: 0.0126) MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.02% (2.1829 => 2.2488, std.dev.: 0.0254) MultiSource/Applications/SIBsim4/SIBsim4: 1.88% (3.8546 => 3.9270, std.dev.: 0.0110) MultiSource/Applications/sgefa/sgefa: 1.68% (0.6256 => 0.6361, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.41% (3.0208 => 3.0635, std.dev.: 0.0082) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -7.77% (0.7250 => 0.6687, std.dev.: 0.0213) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -2.24% (69.1455 => 67.5989, std.dev.: 0.6217) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1339 => 0.1339, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0422 => 0.0421, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.31% (0.0650 => 0.0652, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -0.11% (493.7882 => 493.2514, std.dev.: 0.2614) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 6.89% (63.2438 => 67.5989, std.dev.: 0.6217) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0421, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43639.59% (1.1277 => 493.2514, std.dev.: 0.2614) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 231.65% (0.5229 => 1.7342, std.dev.: 0.0098) MultiSource/Applications/SPASS/SPASS: 17.54% (14.9895 => 17.6192, std.dev.: 0.5702) MultiSource/Applications/kimwitu++/kc: 48.36% (14.1553 => 21.0008, std.dev.: 0.6143) MultiSource/Benchmarks/MallocBench/gs/gs: 28.94% (4.1105 => 5.3002, std.dev.: 0.0441) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.52% (1.1048 => 1.5083, std.dev.: 0.0834) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 411.02% (7.1582 => 36.5796, std.dev.: 1.0830) SingleSource/Benchmarks/Misc-C++-EH/spirit: 75.90% (3.4629 => 6.0913, std.dev.: 0.4191) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.04% (0.6222 => 1.0331, std.dev.: 0.0526) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10353.33% (0.0720 => 7.5264, std.dev.: 0.3407) MultiSource/Applications/SIBsim4/SIBsim4: 3926900.00% (0.0001 => 3.9270, std.dev.: 0.0110) MultiSource/Applications/SPASS/SPASS: 14671400.00% (0.0001 => 14.6715, std.dev.: 1.4752) MultiSource/Applications/kimwitu++/kc: 52800.00% (0.0001 => 0.0529, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 65500.00% (0.0001 => 0.0656, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 579400.00% (0.0001 => 0.5795, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10018100.00% (0.0001 => 10.0182, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5678900.00% (0.0001 => 5.6790, std.dev.: 0.7700) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1707.42% (1.1194 => 20.2323, std.dev.: 0.6624) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 75.75% (2.9384 => 5.1642, std.dev.: 0.0616) MultiSource/Applications/ClamAV/clamscan: 68.89% (22.1758 => 37.4527, std.dev.: 0.3407) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 61.09% (7.0540 => 11.3633, std.dev.: 0.1022) MultiSource/Applications/JM/lencod/lencod: 47.23% (21.9371 => 32.2990, std.dev.: 0.2033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 45.92% (8.1363 => 11.8726, std.dev.: 0.3011) MultiSource/Benchmarks/FreeBench/distray/distray: 44.22% (0.1056 => 0.1523, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/almabench: 43.84% (0.0730 => 0.1050, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 37.43% (0.1432 => 0.1968, std.dev.: 0.0113) SingleSource/UnitTests/vla: 33.24% (0.0355 => 0.0473, std.dev.: 0.0034) MultiSource/Applications/siod/siod: 32.02% (2.2969 => 3.0324, std.dev.: 0.0151) SingleSource/Benchmarks/BenchmarkGame/n-body: 29.76% (0.0746 => 0.0968, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ft/ft: 28.97% (0.1940 => 0.2502, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.94% (0.6675 => 0.8540, std.dev.: 0.0313) MultiSource/Benchmarks/Prolangs-C/loader/loader: 26.65% (0.2758 => 0.3493, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 26.43% (0.3121 => 0.3946, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C++/family/family: 25.69% (0.0397 => 0.0499, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 25.68% (0.5860 => 0.7365, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 24.93% (0.9765 => 1.2199, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 24.85% (0.0672 => 0.0839, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 24.63% (0.8067 => 1.0054, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 24.24% (0.0528 => 0.0656, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 23.92% (1.1861 => 1.4698, std.dev.: 0.0180) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.50% (0.1566 => 0.1934, std.dev.: 0.0103) SingleSource/Benchmarks/Stanford/Oscar: 23.43% (0.0636 => 0.0785, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/city/city: 23.32% (2.0665 => 2.5484, std.dev.: 0.0326) SingleSource/Benchmarks/Shootout/lists: 23.16% (0.0626 => 0.0771, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/ks/ks: 23.11% (0.1510 => 0.1859, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 21.93% (0.2554 => 0.3114, std.dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C++/life/life: 21.76% (0.0933 => 0.1136, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fbench: 21.62% (0.0592 => 0.0720, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 21.56% (0.0793 => 0.0964, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 21.45% (0.5981 => 0.7264, std.dev.: 0.0099) MultiSource/Applications/hbd/hbd: 21.41% (1.5603 => 1.8943, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout/matrix: 21.27% (0.0818 => 0.0992, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: 21.16% (0.8172 => 0.9901, std.dev.: 0.0160) SingleSource/Benchmarks/Misc-C++/bigfib: 20.80% (0.6456 => 0.7799, std.dev.: 0.0198) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 20.50% (0.4103 => 0.4944, std.dev.: 0.0162) MultiSource/Applications/d/make_dparser: 20.42% (3.3354 => 4.0165, std.dev.: 0.1195) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.39% (0.1584 => 0.1907, std.dev.: 0.0096) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.35% (0.4615 => 0.5554, std.dev.: 0.0112) SingleSource/UnitTests/ObjC/messages-2: 20.24% (0.0662 => 0.0796, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 20.20% (4.2646 => 5.1260, std.dev.: 0.1414) MultiSource/Applications/hexxagon/hexxagon: 19.58% (1.2842 => 1.5357, std.dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.85% (0.6450 => 0.7666, std.dev.: 0.0304) MultiSource/Benchmarks/VersaBench/bmm/bmm: 18.71% (0.0759 => 0.0901, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.63% (0.2700 => 0.3203, std.dev.: 0.0178) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.31% (0.1125 => 0.1331, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 17.64% (0.3650 => 0.4294, std.dev.: 0.0167) MultiSource/Benchmarks/McCat/17-bintr/bintr: 17.63% (0.0675 => 0.0794, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.62% (0.3162 => 0.3719, std.dev.: 0.0084) MultiSource/Applications/sgefa/sgefa: 17.56% (0.3109 => 0.3655, std.dev.: 0.0108) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.11% (0.0871 => 0.1020, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/mst/mst: 16.51% (0.1163 => 0.1355, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.13% (0.2065 => 0.2398, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.05% (0.0648 => 0.0752, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.03% (14.3668 => 16.6695, std.dev.: 0.5864) MultiSource/Benchmarks/Olden/health/health: 16.01% (0.1268 => 0.1471, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.80% (0.0886 => 0.1026, std.dev.: 0.0042) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.75% (0.1143 => 0.1323, std.dev.: 0.0034) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.74% (0.0953 => 0.1103, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.64% (0.4636 => 0.5361, std.dev.: 0.0227) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.59% (0.0834 => 0.0964, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.32% (0.0770 => 0.0888, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.31% (0.1117 => 0.1288, std.dev.: 0.0032) MultiSource/Applications/viterbi/viterbi: 15.31% (0.1555 => 0.1793, std.dev.: 0.0074) SingleSource/UnitTests/ObjC/exceptions: 15.13% (0.3828 => 0.4407, std.dev.: 0.0173) MultiSource/Benchmarks/mafft/pairlocalalign: 15.04% (9.4845 => 10.9114, std.dev.: 0.4047) SingleSource/UnitTests/ObjC/for-in: 14.86% (0.3694 => 0.4243, std.dev.: 0.0092) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.78% (0.1062 => 0.1219, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/exceptions-4: 14.76% (0.3543 => 0.4066, std.dev.: 0.0138) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.57% (0.2107 => 0.2414, std.dev.: 0.0096) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.48% (0.3543 => 0.4056, std.dev.: 0.0162) SingleSource/UnitTests/ObjC/exceptions-3: 14.39% (0.3516 => 0.4022, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.98% (0.3935 => 0.4485, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.90% (0.1029 => 0.1172, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.84% (0.1337 => 0.1522, std.dev.: 0.0068) MultiSource/Benchmarks/nbench/nbench: 13.61% (1.1840 => 1.3452, std.dev.: 0.0599) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.61% (0.2271 => 0.2580, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/parameter-passing: 12.58% (0.3927 => 0.4421, std.dev.: 0.0167) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.38% (0.1906 => 0.2142, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.34% (5.0018 => 5.6188, std.dev.: 0.2289) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.29% (0.8101 => 0.9097, std.dev.: 0.0369) SingleSource/UnitTests/ObjC/property: 12.25% (0.3886 => 0.4362, std.dev.: 0.0181) SingleSource/UnitTests/ObjC/trivial-interface: 12.21% (0.3473 => 0.3897, std.dev.: 0.0136) SingleSource/UnitTests/ObjC/exceptions-2: 12.01% (0.3497 => 0.3917, std.dev.: 0.0075) SingleSource/UnitTests/ObjC/synchronized: 11.91% (0.3561 => 0.3985, std.dev.: 0.0164) MultiSource/Applications/sqlite3/sqlite3: 11.20% (17.1811 => 19.1050, std.dev.: 0.7193) SingleSource/UnitTests/ObjC++/property-reference-object: 10.28% (0.6030 => 0.6650, std.dev.: 0.0233) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.26% (0.3177 => 0.3503, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.93% (0.1438 => 0.1552, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: 6.61% (10.3673 => 11.0529, std.dev.: 0.2146) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 149.08% (4.3953 => 10.9476, std.dev.: 0.0413) SingleSource/Benchmarks/Shootout-C++/methcall: 147.48% (5.3999 => 13.3637, std.dev.: 0.0087) MultiSource/Benchmarks/VersaBench/dbms/dbms: 21.73% (1.5086 => 1.8364, std.dev.: 0.0697) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.75% (1.1145 => 1.3123, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 16.18% (6.6465 => 7.7220, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.87% (0.2944 => 0.3323, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.55% (2.8904 => 3.2241, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: 10.07% (1.1396 => 1.2544, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.30% (1.7254 => 1.8859, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/ffbench: 7.64% (0.9505 => 1.0231, std.dev.: 0.0265) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.81% (4.2280 => 4.4738, std.dev.: 0.0089) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: 4.97% (2.1424 => 2.2488, std.dev.: 0.0254) MultiSource/Benchmarks/nbench/nbench: 4.16% (11.6436 => 12.1276, std.dev.: 0.0079) MultiSource/Applications/lua/lua: 3.86% (26.0924 => 27.0986, std.dev.: 0.3288) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 2.46% (3.2827 => 3.3634, std.dev.: 0.0126) MultiSource/Applications/sgefa/sgefa: 2.22% (0.6223 => 0.6361, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 2.06% (3.1595 => 3.2245, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.54% (6.5088 => 6.6091, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.29% (1.0313 => 1.0446, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 1.19% (5.9798 => 6.0507, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 1.15% (5.2636 => 5.3242, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1673, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.71% (5.2763 => 1.2291, std.dev.: 0.0585) SingleSource/Benchmarks/Misc/salsa20: -75.22% (0.8651 => 0.2144, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/richards_benchmark: -44.94% (0.1622 => 0.0893, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.32% (5.3855 => 4.6683, std.dev.: 0.1168) MultiSource/Applications/JM/ldecod/ldecod: -11.23% (10.4361 => 9.2637, std.dev.: 0.4202) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -9.69% (1.7609 => 1.5903, std.dev.: 0.0390) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.67% (5.3526 => 4.9422, std.dev.: 0.0403) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -68.60% (32.5116 => 10.2097, std.dev.: 0.0204) SingleSource/Benchmarks/Dhrystone/fldry: -65.94% (1.9577 => 0.6667, std.dev.: 0.0144) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1681, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.13% (0.3987 => 0.2387, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.26% (4.5009 => 2.7788, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.14% (2.6546 => 2.0139, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/mason/mason: -19.39% (0.2161 => 0.1742, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4241, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2841, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -10.63% (1.5373 => 1.3739, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -10.51% (9.5636 => 8.5584, std.dev.: 0.1049) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.51% (1.5660 => 1.4327, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.95% (4.8142 => 4.4798, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.70% (0.3463 => 0.3231, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.77% (1.6805 => 1.5835, std.dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.57% (2.7294 => 2.5773, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7497, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.49% (3.2416 => 3.0635, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-5: -5.08% (1.5835 => 1.5031, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.05% (0.8614 => 0.8179, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.73% (0.2497 => 0.2379, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -4.41% (6.2999 => 6.0222, std.dev.: 0.0247) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8916, std.dev.: 0.0029) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.93% (0.4808 => 0.4667, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.82% (0.9957 => 0.9676, std.dev.: 0.0065) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.94% (8.1563 => 7.9981, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6769, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -1.47% (10.2830 => 10.1323, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0011) Report Time: 3.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 10:49:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 12:49:15 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121129184915.2C4702A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6388?compare_to=6385&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6388, Order: 168900, Start Time: 2012-11-29 17:10:58, End Time: 2012-11-29 18:49:49 To: 6385, Order: 168887, Start Time: 2012-11-29 15:14:58, End Time: 2012-11-29 16:52:55 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 25 (67 on baseline) Performance Improvements: 2 (30 on baseline) Added Tests: 0 (51 on baseline) Existing Failures: 42 (40 on baseline) Unchanged Tests: 1025 (876 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 77.47% (0.0586 => 0.1040, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 63.50% (0.0748 => 0.1223, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 56.62% (0.3264 => 0.5112, std.dev.: 0.0217) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 51.21% (0.0865 => 0.1308, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 45.26% (0.0380 => 0.0552, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 44.58% (0.0895 => 0.1294, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.65% (0.1170 => 0.1669, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 27.04% (0.0673 => 0.0855, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/football/football: 20.81% (0.9363 => 1.1311, std.dev.: 0.0050) MultiSource/Benchmarks/nbench/nbench: 20.20% (1.2095 => 1.4538, std.dev.: 0.0928) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.22% (4.9348 => 5.7350, std.dev.: 0.2529) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.41% (1.2041 => 1.3897, std.dev.: 0.0468) MultiSource/Applications/sqlite3/sqlite3: 7.77% (15.5513 => 16.7593, std.dev.: 0.3520) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.83% (0.3515 => 0.3755, std.dev.: 0.0081) MultiSource/Applications/lambda-0_1_3/lambda: 6.01% (0.7715 => 0.8179, std.dev.: 0.0114) MultiSource/Applications/siod/siod: 5.72% (2.3268 => 2.4598, std.dev.: 0.0504) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.57% (0.5439 => 0.5579, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 51.70% (0.0294 => 0.0446, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.56% (2.9746 => 3.1697, std.dev.: 0.0734) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.08% (21.6802 => 22.9986, std.dev.: 0.2595) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.40% (4.2816 => 4.4698, std.dev.: 0.0628) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.02% (5.5123 => 5.6785, std.dev.: 0.0320) SingleSource/Benchmarks/Misc/pi: 2.45% (2.1538 => 2.2066, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.33% (5.0354 => 5.1527, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/methcall: 1.79% (8.2645 => 8.4121, std.dev.: 0.0172) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.71% (1.0072 => 0.9598, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -11.41% (3.0600 => 2.7110, std.dev.: 0.1092) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 18.69% (1.1346 => 1.3467, std.dev.: 0.1475) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.22% (0.3700 => 0.3708, std.dev.: 0.0089) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 16.82% (0.0220 => 0.0257, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.70% (0.0428 => 0.0425, std.dev.: 0.0137) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.90% (0.0334 => 0.0331, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.90% (0.0315 => 0.0309, std.dev.: 0.0097) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.37% (0.0447 => 0.0423, std.dev.: 0.0108) SingleSource/UnitTests/Vector/Altivec/casts: -2.40% (0.0208 => 0.0203, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0219 => 0.0219, std.dev.: 0.0057) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 13.70% (0.1460 => 0.1660, std.dev.: 0.0200) MultiSource/Applications/lemon/lemon: 0.04% (1.2237 => 1.2242, std.dev.: 0.2257) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.35% (0.4165 => 0.4067, std.dev.: 0.0250) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.18% (0.1449 => 0.1582, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.29% (0.0007 => 0.0008, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.62% (0.0642 => 0.0646, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.25% (0.0302 => 0.0339, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.23% (0.0595 => 0.0552, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.03% (1.1523 => 1.1520, std.dev.: 0.0385) MultiSource/Benchmarks/SciMark2-C/scimark2: 0.01% (9.4045 => 9.4057, std.dev.: 0.0391) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.50% (0.0605 => 0.0602, std.dev.: 0.0116) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.56% (0.0273 => 0.0266, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.01% (0.8056 => 0.8057, std.dev.: 0.0233) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -8.86% (0.0079 => 0.0072, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.37% (34.4951 => 34.3660, std.dev.: 0.2222) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Benchmarks/SciMark2-C/scimark2: -67.09% (28.5821 => 9.4057, std.dev.: 0.0391) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 17.22% (16.4461 => 19.2786, std.dev.: 0.4387) MultiSource/Applications/sqlite3/sqlite3: 2546.76% (0.6332 => 16.7593, std.dev.: 0.3520) MultiSource/Benchmarks/McCat/08-main/main: 55.43% (0.1831 => 0.2846, std.dev.: 0.0674) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.96% (0.1559 => 0.1574, std.dev.: 0.0201) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7194.97% (0.3123 => 22.7822, std.dev.: 1.1524) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1573.12% (0.3344 => 5.5949, std.dev.: 0.0712) SingleSource/Benchmarks/Misc-C++/Large/ray: 40.27% (0.2364 => 0.3316, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/bigfib: 6.66% (0.6010 => 0.6410, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/mandel: 4.20% (0.0429 => 0.0447, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.75% (0.3266 => 0.3421, std.dev.: 0.0832) SingleSource/Benchmarks/Shootout-C++/strcat: 4.11% (0.1969 => 0.2050, std.dev.: 0.0648) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.14% (0.0224 => 0.0240, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0059) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0523, std.dev.: 0.0050) MultiSource/Applications/oggenc/oggenc: 12.59% (0.1462 => 0.1646, std.dev.: 0.0237) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4891, std.dev.: 0.0446) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0689, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4864, std.dev.: 0.0085) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5216, std.dev.: 0.0243) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2766, std.dev.: 0.0426) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0946, std.dev.: 0.1503) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3638, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3783, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0807, std.dev.: 0.0031) SingleSource/Regression/C/uint64_to_float: -29.66% (2.1832 => 1.5356, std.dev.: 0.0037) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 80.56% (0.0576 => 0.1040, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 74.47% (0.0701 => 0.1223, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 70.51% (0.2998 => 0.5112, std.dev.: 0.0217) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 62.35% (0.0340 => 0.0552, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 59.12% (0.0822 => 0.1308, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 54.68% (0.1079 => 0.1669, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 52.24% (0.0850 => 0.1294, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 44.53% (0.6010 => 0.8686, std.dev.: 0.0746) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 31.54% (0.0650 => 0.0855, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/football/football: 29.00% (0.8768 => 1.1311, std.dev.: 0.0050) MultiSource/Benchmarks/nbench/nbench: 28.99% (1.1271 => 1.4538, std.dev.: 0.0928) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 25.49% (4.5702 => 5.7350, std.dev.: 0.2529) MultiSource/Benchmarks/Ptrdist/bc/bc: 24.41% (1.1170 => 1.3897, std.dev.: 0.0468) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.70% (0.3137 => 0.3755, std.dev.: 0.0081) MultiSource/Benchmarks/Olden/tsp/tsp: 15.65% (0.1112 => 0.1286, std.dev.: 0.0063) MultiSource/Applications/siod/siod: 10.88% (2.2184 => 2.4598, std.dev.: 0.0504) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.36% (0.8656 => 0.9553, std.dev.: 0.0169) MultiSource/Applications/lambda-0_1_3/lambda: 8.23% (0.7557 => 0.8179, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.47% (0.5191 => 0.5579, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.70% (0.8359 => 0.8919, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 6.59% (0.8007 => 0.8535, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.46% (0.8805 => 0.9374, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.46% (0.8611 => 0.9167, std.dev.: 0.0208) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.26% (0.1756 => 0.1866, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.06% (0.2378 => 0.2522, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 5.77% (0.9074 => 0.9598, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.17% (0.9039 => 0.9506, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.56% (0.6586 => 0.6886, std.dev.: 0.0101) MultiSource/Benchmarks/mafft/pairlocalalign: 4.54% (8.6247 => 9.0161, std.dev.: 0.1046) SingleSource/Benchmarks/Shootout-C++/lists1: 3.74% (0.2969 => 0.3080, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 97.35% (0.0226 => 0.0446, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/pi: 39.70% (1.5795 => 2.2066, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 33.32% (2.9096 => 3.8792, std.dev.: 0.1546) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.24% (4.8436 => 5.8726, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.61% (8.2783 => 9.7357, std.dev.: 0.0350) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.72% (14.6451 => 17.0944, std.dev.: 0.2909) SingleSource/Benchmarks/McGill/misr: 16.62% (0.4001 => 0.4666, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 11.98% (3.9917 => 4.4698, std.dev.: 0.0628) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.85% (2.7995 => 3.1313, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.51% (6.3772 => 7.0473, std.dev.: 0.1020) MultiSource/Applications/lambda-0_1_3/lambda: 10.37% (7.4933 => 8.2706, std.dev.: 0.0397) MultiSource/Benchmarks/llubenchmark/llu: 10.05% (1.9967 => 2.1973, std.dev.: 0.0695) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.02% (1.1857 => 1.3045, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.37% (23.5781 => 25.3156, std.dev.: 0.0209) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 6.54% (4.8362 => 5.1527, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.43% (2.9753 => 3.1667, std.dev.: 0.0619) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.36% (3.3761 => 3.5909, std.dev.: 0.0645) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.87% (4.8660 => 5.1515, std.dev.: 0.0584) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.83% (4.5327 => 4.7971, std.dev.: 0.0244) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.82% (5.4187 => 5.7343, std.dev.: 0.0381) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.27% (5.3218 => 5.6024, std.dev.: 0.0372) MultiSource/Applications/aha/aha: 5.27% (3.3398 => 3.5157, std.dev.: 0.0186) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.26% (0.3937 => 0.4144, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 5.24% (0.4353 => 0.4581, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 4.23% (1.3037 => 1.3589, std.dev.: 0.0209) MultiSource/Benchmarks/Olden/power/power: 3.61% (1.2061 => 1.2497, std.dev.: 0.0102) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.13% (22.2997 => 22.9986, std.dev.: 0.2595) SingleSource/Benchmarks/Misc/whetstone: 2.88% (2.1224 => 2.1835, std.dev.: 0.0156) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.33% (3.4104 => 3.4897, std.dev.: 0.0110) MultiSource/Benchmarks/Olden/bh/bh: 2.23% (2.3560 => 2.4086, std.dev.: 0.0198) SingleSource/Benchmarks/McGill/queens: 2.20% (1.7056 => 1.7431, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.11% (11.5690 => 11.8126, std.dev.: 0.0492) MultiSource/Applications/spiff/spiff: 1.88% (2.8561 => 2.9097, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout/methcall: 1.75% (8.2676 => 8.4121, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.68% (4.9469 => 5.0301, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/ReedSolomon: 1.36% (8.5322 => 8.6485, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/flops-7: 1.19% (1.7156 => 1.7360, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.19% (2.8951 => 1.6736, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -21.27% (7.2130 => 5.6785, std.dev.: 0.0320) MultiSource/Benchmarks/Ptrdist/ks/ks: -19.88% (1.4529 => 1.1641, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.80% (9.9065 => 8.2420, std.dev.: 0.0111) MultiSource/Benchmarks/Olden/em3d/em3d: -12.67% (5.4641 => 4.7719, std.dev.: 0.1152) SingleSource/Benchmarks/Misc/flops-8: -9.76% (2.5609 => 2.3109, std.dev.: 0.0050) SingleSource/Benchmarks/McGill/chomp: -9.47% (1.1216 => 1.0154, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: -8.83% (63.1822 => 57.6011, std.dev.: 0.1044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.71% (1.0512 => 0.9701, std.dev.: 0.0228) SingleSource/Benchmarks/Stanford/FloatMM: -6.63% (0.8807 => 0.8223, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ffbench: -6.25% (1.4296 => 1.3403, std.dev.: 0.0218) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.19% (4.7482 => 4.4545, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/sieve: -6.02% (7.0599 => 6.6348, std.dev.: 0.0355) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.93% (5.1305 => 4.8264, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/flops: -5.51% (9.3748 => 8.8585, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.29% (6.2275 => 5.8979, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.84% (5.6343 => 5.3615, std.dev.: 0.0197) SingleSource/Benchmarks/Misc/himenobmtxpa: -4.57% (4.3552 => 4.1561, std.dev.: 0.0528) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.32% (6.1706 => 5.9043, std.dev.: 0.0287) SingleSource/Benchmarks/Shootout-C++/methcall: -3.81% (8.9760 => 8.6340, std.dev.: 0.0218) SingleSource/Benchmarks/Misc/perlin: -3.73% (5.1084 => 4.9181, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.63% (5.1557 => 4.9687, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.55% (4.7449 => 4.5763, std.dev.: 0.0334) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.28% (4.9686 => 4.8054, std.dev.: 0.0231) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.15% (5.4300 => 5.2587, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/fbench: -2.54% (3.3840 => 3.2982, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/flops-5: -1.80% (2.8957 => 2.8435, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.69% (3.5679 => 3.5075, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/fp-convert: -1.61% (15.8853 => 15.6302, std.dev.: 0.0373) MultiSource/Benchmarks/FreeBench/neural/neural: -1.48% (1.0841 => 1.0681, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 31.23% (1.0262 => 1.3467, std.dev.: 0.1475) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.55% (0.2463 => 0.3708, std.dev.: 0.0089) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 108.94% (0.0123 => 0.0257, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0137) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.32% (0.0302 => 0.0309, std.dev.: 0.0097) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0108) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0057) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 100.00% (0.0007 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 15.44% (0.1438 => 0.1660, std.dev.: 0.0200) MultiSource/Applications/lemon/lemon: 8.06% (1.1329 => 1.2242, std.dev.: 0.2257) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.33% (0.4164 => 0.4067, std.dev.: 0.0250) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.56% (0.1369 => 0.1582, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.78% (0.0641 => 0.0646, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 73.85% (0.0195 => 0.0339, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.50% (0.0578 => 0.0552, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.73% (1.1437 => 1.1520, std.dev.: 0.0385) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.99% (0.0627 => 0.0602, std.dev.: 0.0116) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.50% (0.8017 => 0.8057, std.dev.: 0.0233) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 16.13% (0.0062 => 0.0072, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 11:00:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 13:00:39 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121129190039.F22642A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6389?compare_to=6386&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6389, Order: 168900, Start Time: 2012-11-29 17:27:39, End Time: 2012-11-29 19:01:14 To: 6386, Order: 168887, Start Time: 2012-11-29 15:30:51, End Time: 2012-11-29 17:04:36 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (5 on baseline) Performance Improvements: 0 (184 on baseline) Added Tests: 0 (52 on baseline) Unchanged Tests: 1092 (853 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 12.62% (0.3993 => 0.4497, std.dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.07% (1.2732 => 1.2995, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 17.29% (0.3834 => 0.4497, std.dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.70% (2.0478 => 2.1030, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.4937 => 7.6700, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/hash2: 2.19% (3.1932 => 3.2631, std.dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.60% (0.1431 => 0.1308, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.46% (0.3821 => 0.3536, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.24% (0.9542 => 0.8851, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: -6.79% (2.4924 => 2.3231, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.34% (0.2428 => 0.2274, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -6.24% (0.3831 => 0.3592, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.23% (0.3357 => 0.3148, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -6.21% (0.3848 => 0.3609, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.18% (0.3884 => 0.3644, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.16% (0.3896 => 0.3656, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.16% (0.3880 => 0.3641, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/for-in: -6.12% (0.4033 => 0.3786, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.11% (0.3812 => 0.3579, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.01% (0.4176 => 0.3925, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/oourafft: -5.97% (0.2160 => 0.2031, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.96% (0.1796 => 0.1689, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.94% (0.3891 => 0.3660, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.89% (0.6484 => 0.6102, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: -5.84% (16.1920 => 15.2458, std.dev.: 0.0088) MultiSource/Benchmarks/mafft/pairlocalalign: -5.82% (9.2283 => 8.6911, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.77% (0.3658 => 0.3447, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -5.75% (7.0961 => 6.6882, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.68% (0.9852 => 0.9292, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.66% (1.3722 => 1.2945, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -5.64% (0.4199 => 0.3962, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.60% (0.5805 => 0.5480, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.49% (0.5863 => 0.5541, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.49% (0.2695 => 0.2547, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.47% (4.0323 => 3.8117, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: -5.47% (0.9179 => 0.8677, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.47% (0.5925 => 0.5601, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.45% (0.6052 => 0.5722, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.45% (1.6364 => 1.5472, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.44% (0.5591 => 0.5287, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.43% (1.0544 => 0.9971, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.41% (0.5859 => 0.5542, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.41% (1.2300 => 1.1635, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: -5.40% (1.3864 => 1.3115, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.40% (3.5339 => 3.3430, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.39% (0.6230 => 0.5894, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.39% (0.2355 => 0.2228, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.38% (0.6297 => 0.5958, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -5.37% (1.1530 => 1.0911, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.36% (0.7198 => 0.6812, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.36% (0.6660 => 0.6303, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.34% (1.2784 => 1.2101, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.33% (0.6676 => 0.6320, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.32% (0.6395 => 0.6055, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.32% (4.8802 => 4.6208, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.32% (14.2083 => 13.4531, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.31% (0.6681 => 0.6326, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.31% (0.6667 => 0.6313, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.31% (4.5069 => 4.2678, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.30% (1.4642 => 1.3866, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: -5.29% (17.1032 => 16.1982, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.29% (0.7339 => 0.6951, std.dev.: 0.0110) SingleSource/UnitTests/ObjC/parameter-passing: -5.28% (0.4280 => 0.4054, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.27% (0.5941 => 0.5628, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.26% (0.8521 => 0.8073, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.26% (0.5575 => 0.5282, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.26% (4.8161 => 4.5630, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.25% (0.6395 => 0.6059, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.23% (0.5581 => 0.5289, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.23% (0.6736 => 0.6384, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.22% (0.7524 => 0.7131, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.22% (0.6189 => 0.5866, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.21% (0.6293 => 0.5965, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.21% (0.5569 => 0.5279, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.21% (0.5570 => 0.5280, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.20% (0.6194 => 0.5872, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -5.20% (4.3330 => 4.1079, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.19% (0.6304 => 0.5977, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.18% (0.6260 => 0.5936, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.17% (0.5802 => 0.5502, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.17% (0.3406 => 0.3230, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.15% (0.6033 => 0.5722, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.14% (0.7919 => 0.7512, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.14% (0.5567 => 0.5281, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.13% (6.7716 => 6.4244, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.12% (0.5688 => 0.5397, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -5.07% (1.1450 => 1.0870, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.02% (0.3483 => 0.3308, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.00% (0.3057 => 0.2904, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.00% (0.5705 => 0.5420, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -4.99% (15.5079 => 14.7340, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.98% (8.0126 => 7.6133, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: -4.96% (0.4515 => 0.4291, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.93% (0.5999 => 0.5703, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.93% (1.2221 => 1.1618, std.dev.: 0.0031) MultiSource/Applications/Burg/burg: -4.88% (1.2515 => 1.1904, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: -4.86% (0.2985 => 0.2840, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.84% (1.2210 => 1.1619, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.81% (0.3931 => 0.3742, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: -4.80% (0.3581 => 0.3409, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.80% (0.4916 => 0.4680, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.80% (0.3837 => 0.3653, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -4.79% (1.3148 => 1.2518, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.78% (0.3323 => 0.3164, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -4.78% (3.5154 => 3.3474, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.74% (0.2278 => 0.2170, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: -4.74% (0.2659 => 0.2533, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.74% (0.2385 => 0.2272, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.74% (0.3252 => 0.3098, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -4.72% (15.2527 => 14.5329, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.71% (0.2548 => 0.2428, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.70% (2.1713 => 2.0692, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/fibo: -4.70% (0.2871 => 0.2736, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -4.70% (0.3255 => 0.3102, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.67% (0.5478 => 0.5222, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.67% (0.2933 => 0.2796, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -4.66% (0.3025 => 0.2884, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.65% (0.4151 => 0.3958) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.64% (0.3016 => 0.2876, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -4.63% (0.3194 => 0.3046, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.63% (0.5857 => 0.5586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -4.62% (0.3205 => 0.3057, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -4.59% (4.0594 => 3.8729, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.59% (0.5168 => 0.4931, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/except: -4.56% (0.3026 => 0.2888, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -4.56% (0.2939 => 0.2805, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.55% (0.2903 => 0.2771, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -4.51% (0.3059 => 0.2921, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -4.51% (0.3481 => 0.3324, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -4.48% (0.4861 => 0.4643, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -4.46% (0.2849 => 0.2722, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.43% (0.7021 => 0.6710, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.43% (0.5849 => 0.5590, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: -4.40% (0.7447 => 0.7119, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.40% (0.2999 => 0.2867, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.39% (0.3849 => 0.3680, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.39% (0.6446 => 0.6163, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.37% (0.4321 => 0.4132, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.34% (22.4056 => 21.4331, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.33% (0.6440 => 0.6161, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: -4.33% (0.4248 => 0.4064, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -4.33% (2.1401 => 2.0475, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/strcat: -4.28% (0.2989 => 0.2861, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -4.27% (0.3394 => 0.3249, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.27% (1.6474 => 1.5771, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: -4.27% (0.3446 => 0.3299, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.25% (0.5456 => 0.5224, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/lists: -4.23% (0.3621 => 0.3468, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -4.21% (2.4021 => 2.3010, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.18% (0.4813 => 0.4612, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: -4.16% (0.3271 => 0.3135, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -4.14% (34.0927 => 32.6814, std.dev.: 0.0125) MultiSource/Applications/lambda-0_1_3/lambda: -4.13% (0.7982 => 0.7652, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.12% (0.9557 => 0.9163, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.11% (0.5329 => 0.5110, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.07% (0.4083 => 0.3917, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -4.06% (0.3867 => 0.3710, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -4.05% (5.0226 => 4.8193, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: -3.98% (0.4524 => 0.4344, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: -3.91% (0.7779 => 0.7475, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.91% (0.4427 => 0.4254, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -3.88% (18.2933 => 17.5833, std.dev.: 0.0322) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.86% (0.3319 => 0.3191, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -3.80% (0.8418 => 0.8098, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: -3.75% (0.6750 => 0.6497, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -3.72% (0.3788 => 0.3647, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.70% (0.9077 => 0.8741, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.58% (0.3491 => 0.3366, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -3.48% (0.6347 => 0.6126, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.46% (2.2587 => 2.1805, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: -3.38% (0.6441 => 0.6223, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -3.34% (1.5610 => 1.5088, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -2.77% (20.7746 => 20.1998, std.dev.: 0.0284) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.58% (5.4682 => 5.3270, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1957, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -62.48% (1.8100 => 0.6791, std.dev.: 0.0089) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7540, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Misc/richards_benchmark: -8.61% (1.2842 => 1.1736, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.70% (2.2633 => 2.1796, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3987, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4693, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 12:48:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 14:48:37 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121129204837.DBE052A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6390?compare_to=6388&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6390, Order: 168914, Start Time: 2012-11-29 19:09:55, End Time: 2012-11-29 20:49:13 To: 6388, Order: 168900, Start Time: 2012-11-29 17:10:58, End Time: 2012-11-29 18:49:49 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 23 (87 on baseline) Performance Improvements: 12 (27 on baseline) Added Tests: 0 (51 on baseline) Existing Failures: 42 (40 on baseline) Unchanged Tests: 1017 (859 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 75.74% (0.0305 => 0.0536, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Perm: 66.56% (0.0311 => 0.0518, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/family/family: 63.51% (0.0444 => 0.0726, std.dev.: 0.0021) SingleSource/Benchmarks/Stanford/Quicksort: 58.60% (0.0372 => 0.0590, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/dt: 54.39% (0.0342 => 0.0528, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fbench: 53.25% (0.0693 => 0.1062, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-1: 51.41% (0.0284 => 0.0430, std.dev.: 0.0034) SingleSource/Benchmarks/Stanford/Towers: 51.13% (0.0485 => 0.0733, std.dev.: 0.0024) MultiSource/Applications/spiff/spiff: 37.56% (0.9170 => 1.2614, std.dev.: 0.0401) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 37.55% (0.0703 => 0.0967, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 34.41% (1.3553 => 1.8216, std.dev.: 0.0846) MultiSource/Applications/SPASS/SPASS: 17.94% (15.2888 => 18.0320, std.dev.: 0.7348) MultiSource/Applications/JM/lencod/lencod: 14.37% (16.0910 => 18.4029, std.dev.: 0.3101) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.56% (0.8816 => 0.9747, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 4.94% (0.9506 => 0.9976, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.70% (0.9259 => 0.9602, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Towers: 60.29% (0.0209 => 0.0335, std.dev.: 0.0043) MultiSource/Applications/JM/ldecod/ldecod: 25.29% (0.0779 => 0.0976, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/matrix: 12.92% (1.5655 => 1.7678, std.dev.: 0.0522) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.25% (60.0906 => 62.6435, std.dev.: 0.2751) SingleSource/Benchmarks/Misc/ffbench: 3.76% (1.3403 => 1.3907, std.dev.: 0.0099) MultiSource/Applications/SIBsim4/SIBsim4: 2.61% (3.2529 => 3.3379, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/lists: 1.86% (16.6581 => 16.9687, std.dev.: 0.0581) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -34.60% (0.5112 => 0.3343, std.dev.: 0.0491) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -22.43% (0.8686 => 0.6738, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/football/football: -17.11% (1.1311 => 0.9376, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: -15.46% (0.2465 => 0.2084, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: -14.00% (1.3897 => 1.1952, std.dev.: 0.0158) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -44.62% (0.0446 => 0.0247, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: -16.18% (1.1796 => 0.9887, std.dev.: 0.0412) MultiSource/Benchmarks/llubenchmark/llu: -7.40% (2.1973 => 2.0348, std.dev.: 0.0220) MultiSource/Benchmarks/Prolangs-C++/life/life: -4.77% (2.7072 => 2.5780, std.dev.: 0.0227) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -2.29% (5.1527 => 5.0345, std.dev.: 0.0360) MultiSource/Benchmarks/BitBench/five11/five11: -2.17% (5.6837 => 5.5601, std.dev.: 0.0458) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.42% (1.1152 => 1.0994, std.dev.: 0.0025) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -14.56% (1.3467 => 1.1506, std.dev.: 0.1683) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.11% (0.3708 => 0.3712, std.dev.: 0.1136) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -14.01% (0.0257 => 0.0221, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.71% (0.0425 => 0.0428, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.60% (0.0331 => 0.0333, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.62% (0.0309 => 0.0314, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.95% (0.0423 => 0.0427, std.dev.: 0.0120) SingleSource/UnitTests/Vector/Altivec/casts: 1.48% (0.0203 => 0.0206, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/test1: 0.46% (0.0219 => 0.0220, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/Burg/burg: - (0.0014 => 0.0014, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -3.86% (0.1660 => 0.1596, std.dev.: 0.0136) MultiSource/Applications/lemon/lemon: 10.71% (1.2242 => 1.3553, std.dev.: 0.3323) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.11% (0.4067 => 0.4022, std.dev.: 0.1337) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.83% (0.1582 => 0.1474, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.46% (0.0646 => 0.0643, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.34% (0.0339 => 0.0287, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.43% (0.0552 => 0.0582, std.dev.: 0.0130) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.16% (1.1520 => 1.1502, std.dev.: 0.0347) MultiSource/Benchmarks/SciMark2-C/scimark2: -0.04% (9.4057 => 9.4018, std.dev.: 0.1028) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0602 => 0.0602, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.75% (0.0266 => 0.0264, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.52% (0.8057 => 0.8099, std.dev.: 0.0140) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 73.61% (0.0072 => 0.0125, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.32% (34.3660 => 34.4755, std.dev.: 0.3956) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Benchmarks/SciMark2-C/scimark2: -67.11% (28.5821 => 9.4018, std.dev.: 0.1028) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 13.04% (16.4461 => 18.5907, std.dev.: 0.5743) MultiSource/Applications/sqlite3/sqlite3: 2477.53% (0.6332 => 16.3209, std.dev.: 0.3924) MultiSource/Benchmarks/McCat/08-main/main: 51.67% (0.1831 => 0.2777, std.dev.: 0.0708) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.28% (0.1559 => 0.1539, std.dev.: 0.0298) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7131.83% (0.3123 => 22.5850, std.dev.: 0.9936) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1659.84% (0.3344 => 5.8849, std.dev.: 0.1174) SingleSource/Benchmarks/Misc-C++/Large/ray: 43.49% (0.2364 => 0.3392, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: 10.67% (0.6010 => 0.6651, std.dev.: 0.0167) SingleSource/Benchmarks/Misc/mandel: 29.84% (0.0429 => 0.0557, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.34% (0.3266 => 0.3571, std.dev.: 0.0902) SingleSource/Benchmarks/Shootout-C++/strcat: 4.77% (0.1969 => 0.2063, std.dev.: 0.0579) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.48% (0.0224 => 0.0243, std.dev.: 0.0088) SingleSource/UnitTests/byval-alignment: -30.43% (0.0230 => 0.0160, std.dev.: 0.0063) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0522, std.dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: 12.79% (0.1462 => 0.1649, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.5243, std.dev.: 0.0523) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0733, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4946, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5214, std.dev.: 0.0312) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3080, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0897, std.dev.: 0.0273) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3680, std.dev.: 0.0200) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3882, std.dev.: 0.0660) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0907, std.dev.: 0.0195) SingleSource/Regression/C/uint64_to_float: -29.99% (2.1832 => 1.5284, std.dev.: 0.0463) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0005) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 78.67% (0.0300 => 0.0536, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/family/family: 76.64% (0.0411 => 0.0726, std.dev.: 0.0021) SingleSource/Benchmarks/Stanford/Perm: 76.19% (0.0294 => 0.0518, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/dt: 69.23% (0.0312 => 0.0528, std.dev.: 0.0019) SingleSource/Benchmarks/Stanford/Quicksort: 67.14% (0.0353 => 0.0590, std.dev.: 0.0014) SingleSource/Benchmarks/Stanford/Towers: 64.35% (0.0446 => 0.0733, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fbench: 63.64% (0.0649 => 0.1062, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-1: 59.26% (0.0270 => 0.0430, std.dev.: 0.0034) MultiSource/Applications/spiff/spiff: 58.67% (0.7950 => 1.2614, std.dev.: 0.0401) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 44.76% (0.0668 => 0.0967, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 44.55% (1.2602 => 1.8216, std.dev.: 0.0846) MultiSource/Applications/SPASS/SPASS: 26.45% (14.2605 => 18.0320, std.dev.: 0.7348) MultiSource/Benchmarks/Olden/treeadd/treeadd: 23.82% (0.0424 => 0.0525, std.dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 20.06% (15.3280 => 18.4029, std.dev.: 0.3101) MultiSource/Applications/ClamAV/clamscan: 18.89% (14.7684 => 17.5576, std.dev.: 0.9177) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.87% (0.8340 => 0.9747, std.dev.: 0.0116) MultiSource/Applications/siod/siod: 15.08% (2.2184 => 2.5530, std.dev.: 0.1195) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.27% (0.1983 => 0.2266, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.11% (0.6010 => 0.6738, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.07% (0.1756 => 0.1968, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.62% (1.5315 => 1.7094, std.dev.: 0.0468) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.53% (0.3295 => 0.3675, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.37% (0.9039 => 0.9976, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.25% (0.8148 => 0.8983, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 10.22% (0.8712 => 0.9602, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.15% (0.4847 => 0.5339, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.12% (0.9074 => 0.9992, std.dev.: 0.0222) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.40% (0.1905 => 0.2084, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 9.26% (1.0945 => 1.1958, std.dev.: 0.0310) MultiSource/Benchmarks/sim/sim: 8.99% (0.3226 => 0.3516, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.59% (0.3003 => 0.3261, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.09% (0.8927 => 0.9649, std.dev.: 0.0152) MultiSource/Applications/oggenc/oggenc: 7.57% (4.9628 => 5.3383, std.dev.: 0.1189) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.06% (0.8286 => 0.8871, std.dev.: 0.0138) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.00% (1.1170 => 1.1952, std.dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C/football/football: 6.93% (0.8768 => 0.9376, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.83% (0.9908 => 1.0585, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 6.81% (0.8050 => 0.8598, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 6.80% (0.8086 => 0.8636, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 6.75% (0.8697 => 0.9284, std.dev.: 0.0075) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.22% (0.2378 => 0.2526, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/lists1: 5.69% (0.2969 => 0.3138, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.57% (0.8420 => 0.8889, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.87% (0.2794 => 0.2930, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.82% (4.4880 => 4.7042, std.dev.: 0.0557) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.47% (0.8995 => 0.9397, std.dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Towers: 55.81% (0.0215 => 0.0335, std.dev.: 0.0043) MultiSource/Applications/JM/ldecod/ldecod: 46.99% (0.0664 => 0.0976, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/pi: 34.78% (1.5795 => 2.1288, std.dev.: 0.0415) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 28.98% (2.9096 => 3.7527, std.dev.: 0.0594) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.37% (4.8436 => 5.8787, std.dev.: 0.0299) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.92% (4.5547 => 5.4621, std.dev.: 0.3446) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.45% (8.2783 => 9.7227, std.dev.: 0.0341) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.66% (14.6451 => 17.0846, std.dev.: 0.1796) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.24% (0.7597 => 0.8831, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.35% (0.3186 => 0.3675, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout/matrix: 12.81% (1.5671 => 1.7678, std.dev.: 0.0522) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.49% (0.8789 => 0.9887, std.dev.: 0.0412) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.76% (2.7995 => 3.1288, std.dev.: 0.0515) MultiSource/Applications/lambda-0_1_3/lambda: 10.62% (7.4933 => 8.2891, std.dev.: 0.0301) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.36% (0.1129 => 0.1246, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.24% (6.3772 => 7.0303, std.dev.: 0.0590) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 9.74% (1.1857 => 1.3012, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout/strcat: 8.78% (0.1538 => 0.1673, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 8.29% (3.9917 => 4.3226, std.dev.: 0.1071) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.36% (23.5781 => 25.3127, std.dev.: 0.2241) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.67% (3.3761 => 3.6014, std.dev.: 0.0693) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 6.08% (4.8660 => 5.1619, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.87% (4.5327 => 4.7988, std.dev.: 0.0129) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.70% (59.2638 => 62.6435, std.dev.: 0.2751) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.57% (5.4187 => 5.7207, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.57% (2.9753 => 3.1410, std.dev.: 0.0512) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 5.26% (0.5214 => 0.5488, std.dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 5.12% (6.7064 => 7.0495, std.dev.: 0.0415) MultiSource/Applications/aha/aha: 5.08% (3.3398 => 3.5096, std.dev.: 0.0337) SingleSource/Benchmarks/Misc/richards_benchmark: 4.83% (1.3037 => 1.3667, std.dev.: 0.0225) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 4.82% (0.4353 => 0.4563, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 4.73% (3.1873 => 3.3379, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 4.10% (4.8362 => 5.0345, std.dev.: 0.0360) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 4.01% (0.3937 => 0.4095, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: 3.65% (1.2061 => 1.2501, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.47% (3.4104 => 3.4946, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/methcall: 2.01% (8.2676 => 8.4338, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.98% (11.5690 => 11.7979, std.dev.: 0.0543) MultiSource/Benchmarks/Bullet/bullet: 1.84% (7.1181 => 7.2493, std.dev.: 0.0258) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.16% (1.9302 => 1.9525, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (16.7941 => 16.9687, std.dev.: 0.0581) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -40.76% (2.8951 => 1.7150, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -24.17% (7.2130 => 5.4693, std.dev.: 0.1317) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.12% (1.4529 => 1.1606, std.dev.: 0.0241) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.78% (9.9065 => 8.2437, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/em3d/em3d: -12.59% (5.4641 => 4.7761, std.dev.: 0.0420) SingleSource/Benchmarks/Misc/flops-8: -9.15% (2.5609 => 2.3266, std.dev.: 0.0466) MultiSource/Benchmarks/mafft/pairlocalalign: -9.04% (63.1822 => 57.4691, std.dev.: 0.2513) SingleSource/Benchmarks/Stanford/FloatMM: -6.36% (0.8807 => 0.8247, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.68% (4.7482 => 4.4785, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/flops: -5.28% (9.3748 => 8.8801, std.dev.: 0.0197) MultiSource/Benchmarks/VersaBench/bmm/bmm: -5.06% (2.8773 => 2.7318, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.93% (6.2275 => 5.9202, std.dev.: 0.0231) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.46% (5.6343 => 5.3830, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.17% (6.1706 => 5.9134, std.dev.: 0.0410) SingleSource/Benchmarks/Shootout-C++/methcall: -4.07% (8.9760 => 8.6109, std.dev.: 0.0503) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.64% (3.7148 => 3.5794, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.51% (4.9453 => 4.7719, std.dev.: 0.0351) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.50% (1.3882 => 1.3396, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.34% (5.1557 => 4.9837, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.13% (4.9686 => 4.8132, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.02% (5.4300 => 5.2661, std.dev.: 0.0624) SingleSource/Benchmarks/Misc/ffbench: -2.72% (1.4296 => 1.3907, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.80% (3.3479 => 3.2876, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.59% (3.5679 => 3.5113, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/neural/neural: -1.41% (1.0841 => 1.0688, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: -1.29% (15.8853 => 15.6807, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.15% (4.7794 => 4.7242, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 12.12% (1.0262 => 1.1506, std.dev.: 0.1683) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.71% (0.2463 => 0.3712, std.dev.: 0.1136) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 79.67% (0.0123 => 0.0221, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.20% (0.0384 => 0.0427, std.dev.: 0.0120) SingleSource/UnitTests/Vector/Altivec/casts: 8.42% (0.0190 => 0.0206, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/test1: 22.22% (0.0180 => 0.0220, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 100.00% (0.0007 => 0.0014, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 10.99% (0.1438 => 0.1596, std.dev.: 0.0136) MultiSource/Applications/lemon/lemon: 19.63% (1.1329 => 1.3553, std.dev.: 0.3323) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.41% (0.4164 => 0.4022, std.dev.: 0.1337) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.67% (0.1369 => 0.1474, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.31% (0.0641 => 0.0643, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 47.18% (0.0195 => 0.0287, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.69% (0.0578 => 0.0582, std.dev.: 0.0130) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.57% (1.1437 => 1.1502, std.dev.: 0.0347) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.99% (0.0627 => 0.0602, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 46.67% (0.0180 => 0.0264, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.02% (0.8017 => 0.8099, std.dev.: 0.0140) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 101.61% (0.0062 => 0.0125, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 12:52:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 14:52:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121129205241.BF6A72A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6391?compare_to=6387&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6391, Order: 168902, Start Time: 2012-11-29 18:31:21, End Time: 2012-11-29 20:53:14 To: 6387, Order: 168879, Start Time: 2012-11-29 15:02:16, End Time: 2012-11-29 17:29:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 17 (119 on baseline) Performance Improvements: 1 (43 on baseline) Added Tests: 0 (186 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1070 (723 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.75% (0.7172 => 0.7871, std.dev.: 0.0219) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.34% (0.1907 => 0.2047, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.18% (0.6632 => 0.7108, std.dev.: 0.0175) MultiSource/Benchmarks/FreeBench/neural/neural: 6.80% (0.1602 => 0.1711, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/moments: 6.56% (0.4469 => 0.4762, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/lists1: 6.50% (0.4059 => 0.4323, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/ReedSolomon: 6.48% (0.2192 => 0.2334, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 6.38% (0.5139 => 0.5467, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/oourafft: 5.35% (0.3588 => 0.3780, std.dev.: 0.0065) SingleSource/UnitTests/Vector/constpool: 5.06% (51.2801 => 53.8724, std.dev.: 0.2467) MultiSource/Benchmarks/PAQ8p/paq8p: 3.68% (11.0529 => 11.4599, std.dev.: 0.1111) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.41% (36.5796 => 37.8281, std.dev.: 0.2784) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 7.28% (9.4438 => 10.1317, std.dev.: 0.1381) SingleSource/Benchmarks/Shootout-C++/hash2: 5.34% (3.3691 => 3.5491, std.dev.: 0.0511) SingleSource/Benchmarks/CoyoteBench/huffbench: 3.34% (18.3285 => 18.9406, std.dev.: 0.2326) MultiSource/Benchmarks/NPB-serial/is/is: 2.96% (8.5584 => 8.8121, std.dev.: 0.0774) MultiSource/Benchmarks/PAQ8p/paq8p: 1.16% (85.9157 => 86.9160, std.dev.: 0.0221) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.47% (2.2488 => 2.1932, std.dev.: 0.0138) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 2.38% (67.5989 => 69.2066, std.dev.: 0.5994) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.07% (0.1339 => 0.1338, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.48% (0.0421 => 0.0419, std.dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.61% (0.0652 => 0.0669, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 0.15% (493.2514 => 494.0075, std.dev.: 0.1422) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.43% (63.2438 => 69.2066, std.dev.: 0.5994) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0419, std.dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43706.64% (1.1277 => 494.0075, std.dev.: 0.1422) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.53% (0.5229 => 1.5401, std.dev.: 0.0979) MultiSource/Applications/SPASS/SPASS: 17.62% (14.9895 => 17.6309, std.dev.: 0.3348) MultiSource/Applications/kimwitu++/kc: 46.02% (14.1553 => 20.6701, std.dev.: 0.8824) MultiSource/Benchmarks/MallocBench/gs/gs: 16.32% (4.1105 => 4.7814, std.dev.: 0.2875) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.02% (1.1048 => 1.5138, std.dev.: 0.0754) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 428.46% (7.1582 => 37.8281, std.dev.: 0.2784) SingleSource/Benchmarks/Misc-C++-EH/spirit: 74.97% (3.4629 => 6.0590, std.dev.: 0.4133) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.16% (0.6222 => 1.0836, std.dev.: 0.0341) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10363.75% (0.0720 => 7.5339, std.dev.: 0.3377) MultiSource/Applications/SIBsim4/SIBsim4: 3856400.00% (0.0001 => 3.8565, std.dev.: 0.0364) MultiSource/Applications/SPASS/SPASS: 14354600.00% (0.0001 => 14.3547, std.dev.: 1.5708) MultiSource/Applications/kimwitu++/kc: 51900.00% (0.0001 => 0.0520, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 65000.00% (0.0001 => 0.0651, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 580500.00% (0.0001 => 0.5806, std.dev.: 0.0282) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9981400.00% (0.0001 => 9.9815, std.dev.: 0.0237) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5834500.00% (0.0001 => 5.8346, std.dev.: 0.7579) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1743.43% (1.1194 => 20.6353, std.dev.: 0.8519) MultiSource/Applications/ClamAV/clamscan: 70.32% (22.1758 => 37.7700, std.dev.: 0.2737) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.65% (2.9384 => 4.6031, std.dev.: 0.4185) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 50.28% (7.0540 => 10.6008, std.dev.: 0.4144) MultiSource/Applications/JM/lencod/lencod: 46.21% (21.9371 => 32.0741, std.dev.: 0.2847) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 45.74% (8.1363 => 11.8578, std.dev.: 0.4296) MultiSource/Benchmarks/FreeBench/distray/distray: 44.70% (0.1056 => 0.1528, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/almabench: 38.77% (0.0730 => 0.1013, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 36.52% (0.1432 => 0.1955, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/n-body: 32.17% (0.0746 => 0.0986, std.dev.: 0.0009) SingleSource/UnitTests/vla: 30.14% (0.0355 => 0.0462, std.dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 29.25% (0.1566 => 0.2024, std.dev.: 0.0091) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 29.23% (0.1584 => 0.2047, std.dev.: 0.0046) MultiSource/Benchmarks/BitBench/five11/five11: 26.98% (0.0567 => 0.0720, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/family/family: 25.44% (0.0397 => 0.0498, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 25.30% (0.0672 => 0.0842, std.dev.: 0.0023) SingleSource/Benchmarks/Stanford/Towers: 24.63% (0.0471 => 0.0587, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/exptree: 24.08% (0.0814 => 0.1010, std.dev.: 0.0059) MultiSource/Applications/d/make_dparser: 23.94% (3.3354 => 4.1338, std.dev.: 0.0925) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 23.48% (0.0528 => 0.0652, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 23.44% (0.1655 => 0.2043, std.dev.: 0.0086) SingleSource/Benchmarks/Stanford/Oscar: 23.43% (0.0636 => 0.0785, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/hash: 22.27% (0.0485 => 0.0593, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 22.18% (0.1163 => 0.1421, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 22.12% (0.0886 => 0.1082, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 22.08% (0.2554 => 0.3118, std.dev.: 0.0182) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.84% (0.1236 => 0.1506, std.dev.: 0.0091) MultiSource/Applications/spiff/spiff: 21.63% (0.7835 => 0.9530, std.dev.: 0.0243) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 21.56% (0.0793 => 0.0964, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/life/life: 21.54% (0.0933 => 0.1134, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/matrix: 21.52% (0.0818 => 0.0994, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.84% (0.8172 => 0.9875, std.dev.: 0.0302) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 20.64% (0.4103 => 0.4950, std.dev.: 0.0119) MultiSource/Benchmarks/Olden/tsp/tsp: 20.43% (0.1175 => 0.1415, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 19.94% (1.5415 => 1.8489, std.dev.: 0.0496) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.82% (0.1125 => 0.1348, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/misr: 19.27% (0.0633 => 0.0755, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 18.93% (1.3050 => 1.5521, std.dev.: 0.0474) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.85% (0.2700 => 0.3209, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/hash2: 18.33% (0.4620 => 0.5467, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C++/city/city: 18.11% (2.0665 => 2.4408, std.dev.: 0.0491) SingleSource/Benchmarks/Shootout-C++/moments: 17.64% (0.4048 => 0.4762, std.dev.: 0.0113) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.63% (0.0953 => 0.1121, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.58% (0.0842 => 0.0990, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/ft/ft: 17.47% (0.1940 => 0.2279, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/lists1: 17.35% (0.3684 => 0.4323, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 17.26% (0.3650 => 0.4280, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout/lists: 17.09% (0.0626 => 0.0733, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.99% (0.0871 => 0.1019, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: 16.95% (0.1463 => 0.1711, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.85% (0.2065 => 0.2413, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.67% (0.3162 => 0.3689, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.55% (14.3668 => 16.7439, std.dev.: 0.8056) SingleSource/UnitTests/SignlessTypes/rem: 16.52% (0.1144 => 0.1333, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/em3d/em3d: 16.52% (0.1695 => 0.1975, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/hash: 15.92% (0.4289 => 0.4972, std.dev.: 0.0158) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.90% (0.0648 => 0.0751, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.86% (0.2756 => 0.3193, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.58% (0.0770 => 0.0890, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.41% (0.2758 => 0.3183, std.dev.: 0.0143) SingleSource/Regression/C++/ofstream_ctor: 15.22% (0.2905 => 0.3347, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/oourafft: 15.17% (0.3282 => 0.3780, std.dev.: 0.0065) MultiSource/Applications/viterbi/viterbi: 15.11% (0.1555 => 0.1790, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/matrix: 15.11% (0.3098 => 0.3566, std.dev.: 0.0089) MultiSource/Applications/oggenc/oggenc: 15.05% (5.7591 => 6.6256, std.dev.: 0.3235) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.02% (4.9449 => 5.6874, std.dev.: 0.1932) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.97% (5.0018 => 5.7506, std.dev.: 0.2029) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.96% (0.1337 => 0.1537, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/nestedloop: 14.86% (0.2793 => 0.3208, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.71% (0.2107 => 0.2417, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/random: 14.67% (0.2802 => 0.3213, std.dev.: 0.0102) SingleSource/UnitTests/ObjC++/property-reference: 14.54% (0.7326 => 0.8391, std.dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.50% (0.5981 => 0.6848, std.dev.: 0.0226) SingleSource/UnitTests/ObjC++/Hello: 14.48% (0.5925 => 0.6783, std.dev.: 0.0248) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.41% (0.0798 => 0.0913, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference-object: 14.38% (0.6030 => 0.6897, std.dev.: 0.0233) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.94% (0.1062 => 0.1210, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/ReedSolomon: 13.91% (0.2049 => 0.2334, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.70% (0.1029 => 0.1170, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.69% (0.2271 => 0.2582, std.dev.: 0.0107) SingleSource/UnitTests/ObjC/parameter-passing: 12.99% (0.3927 => 0.4437, std.dev.: 0.0161) MultiSource/Benchmarks/nbench/nbench: 12.86% (1.1840 => 1.3363, std.dev.: 0.0555) SingleSource/UnitTests/ObjC/property: 12.64% (0.3886 => 0.4377, std.dev.: 0.0174) SingleSource/UnitTests/ObjC/exceptions: 12.49% (0.3828 => 0.4306, std.dev.: 0.0156) MultiSource/Benchmarks/mafft/pairlocalalign: 12.36% (9.4845 => 10.6569, std.dev.: 0.4192) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.33% (0.3543 => 0.3980, std.dev.: 0.0154) SingleSource/UnitTests/ObjC/synchronized: 12.33% (0.3561 => 0.4000, std.dev.: 0.0129) SingleSource/UnitTests/ObjC/exceptions-2: 12.24% (0.3497 => 0.3925, std.dev.: 0.0129) SingleSource/UnitTests/ObjC/exceptions-4: 12.14% (0.3543 => 0.3973, std.dev.: 0.0138) SingleSource/UnitTests/ObjC/exceptions-3: 12.12% (0.3516 => 0.3942, std.dev.: 0.0141) SingleSource/UnitTests/ObjC/for-in: 12.02% (0.3694 => 0.4138, std.dev.: 0.0153) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.28% (0.1906 => 0.2121, std.dev.: 0.0080) MultiSource/Benchmarks/PAQ8p/paq8p: 10.54% (10.3673 => 11.4599, std.dev.: 0.1111) MultiSource/Benchmarks/Olden/power/power: 7.50% (0.1440 => 0.1548, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 149.58% (4.3953 => 10.9698, std.dev.: 0.0279) SingleSource/Benchmarks/Shootout-C++/methcall: 147.20% (5.3999 => 13.3484, std.dev.: 0.0167) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 25.48% (13.4384 => 16.8625, std.dev.: 0.9873) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.65% (1.1145 => 1.3001, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/oourafft: 16.02% (6.6465 => 7.7116, std.dev.: 0.0144) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.98% (0.2944 => 0.3326, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash2: 12.39% (3.1578 => 3.5491, std.dev.: 0.0511) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.67% (2.8904 => 3.2278, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/richards_benchmark: 9.89% (1.1396 => 1.2523, std.dev.: 0.0030) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.42% (1.7254 => 1.8880, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.66% (4.2280 => 4.4674, std.dev.: 0.0036) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 5.09% (26.0924 => 27.4206, std.dev.: 0.1919) MultiSource/Benchmarks/nbench/nbench: 4.07% (11.6436 => 12.1174, std.dev.: 0.0053) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.34% (0.4162 => 0.4301, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.37% (2.1424 => 2.1932, std.dev.: 0.0138) MultiSource/Benchmarks/PAQ8p/paq8p: 2.18% (85.0658 => 86.9160, std.dev.: 0.0221) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 2.06% (3.1595 => 3.2247, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.35% (6.5088 => 6.5968, std.dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0500, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 1.01% (5.2636 => 5.3169, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.51% (6.6874 => 0.1666, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.82% (5.2763 => 1.2233, std.dev.: 0.0430) SingleSource/Benchmarks/Misc/salsa20: -74.87% (0.8651 => 0.2174, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/richards_benchmark: -45.07% (0.1622 => 0.0891, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.98% (5.3855 => 4.6862, std.dev.: 0.1723) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.60% (5.3526 => 4.6780, std.dev.: 0.1601) MultiSource/Applications/JM/ldecod/ldecod: -10.76% (10.4361 => 9.3133, std.dev.: 0.3657) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.71% (1.7609 => 1.6252, std.dev.: 0.0419) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -68.62% (32.5116 => 10.2027, std.dev.: 0.0236) SingleSource/Benchmarks/Dhrystone/fldry: -65.50% (1.9577 => 0.6755, std.dev.: 0.0073) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1681, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.33% (0.3987 => 0.2379, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.32% (4.5009 => 2.7762, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.16% (2.6546 => 2.0133, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: -19.34% (0.2161 => 0.1743, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -16.14% (1.6925 => 1.4193, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.69% (2.6778 => 2.2843, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -10.67% (1.5373 => 1.3732, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.69% (1.5660 => 1.4299, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.02% (1.6805 => 1.5457, std.dev.: 0.0475) MultiSource/Benchmarks/NPB-serial/is/is: -7.86% (9.5636 => 8.8121, std.dev.: 0.0774) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4781, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.76% (0.3463 => 0.3229, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.39% (3.2416 => 3.0344, std.dev.: 0.0257) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.14% (0.8614 => 0.8171, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -5.05% (19.9488 => 18.9406, std.dev.: 0.2326) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.97% (0.2497 => 0.2373, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/lists: -4.50% (6.2999 => 6.0166, std.dev.: 0.0156) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.24% (0.4808 => 0.4604, std.dev.: 0.0047) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8916, std.dev.: 0.0054) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.84% (8.1563 => 8.0066, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6771, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -1.52% (10.2830 => 10.1267, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.38% (0.2116 => 0.0669, std.dev.: 0.0012) Report Time: 2.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 12:57:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 14:57:05 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121129205705.352A92A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6392?compare_to=6389&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6392, Order: 168918, Start Time: 2012-11-29 19:24:10, End Time: 2012-11-29 20:57:39 To: 6389, Order: 168900, Start Time: 2012-11-29 17:27:39, End Time: 2012-11-29 19:01:14 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (184 on baseline) Added Tests: 0 (52 on baseline) Unchanged Tests: 1093 (853 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.00% (1.1495 => 1.1610, std.dev.: 0.0016) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.62% (0.3834 => 0.4433, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.67% (2.0478 => 2.1025, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 2.37% (7.4937 => 7.6710, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hash2: 2.25% (3.1932 => 3.2651, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.74% (0.1431 => 0.1306, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.59% (0.3821 => 0.3531, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.14% (0.9542 => 0.8861, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.72% (0.3142 => 0.2931, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: -6.55% (2.4924 => 2.3292, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -6.46% (0.3357 => 0.3140, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.38% (0.2428 => 0.2273, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.23% (0.3884 => 0.3642, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.21% (0.3880 => 0.3639, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.16% (0.3812 => 0.3577, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.16% (0.3848 => 0.3611, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.13% (0.3896 => 0.3657, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.12% (0.4033 => 0.3786, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -6.08% (0.3831 => 0.3598, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.07% (0.1796 => 0.1687, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.02% (9.2283 => 8.6723, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.01% (0.3891 => 0.3657, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.01% (0.4176 => 0.3925, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -5.94% (16.1920 => 15.2295, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.93% (0.3658 => 0.3441, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: -5.86% (7.0961 => 6.6806, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/ReedSolomon: -5.85% (0.1879 => 0.1769, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.85% (1.3722 => 1.2919, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.83% (0.6484 => 0.6106, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.77% (1.0544 => 0.9936, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -5.74% (0.1761 => 0.1660, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.73% (0.2355 => 0.2220, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -5.69% (0.4199 => 0.3960, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: -5.69% (0.9179 => 0.8657, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.69% (4.8161 => 4.5423, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.68% (1.6364 => 1.5434, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.67% (0.6736 => 0.6354, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.66% (0.5863 => 0.5531, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.65% (4.8802 => 4.6043, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.65% (1.2300 => 1.1605, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.64% (0.5478 => 0.5169, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.62% (0.6052 => 0.5712, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.61% (0.9852 => 0.9299, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.60% (0.2695 => 0.2544, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.60% (4.0323 => 3.8064, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.60% (0.6304 => 0.5951, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.60% (0.5591 => 0.5278, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.59% (0.5705 => 0.5386, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.58% (0.5805 => 0.5481, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.57% (0.6297 => 0.5946, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.57% (0.6395 => 0.6039, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.55% (0.5925 => 0.5596, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.55% (1.4642 => 1.3830, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.54% (0.5581 => 0.5272, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.53% (0.5802 => 0.5481, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.53% (0.5859 => 0.5535, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.50% (1.2784 => 1.2081, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.47% (0.5849 => 0.5529, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.46% (14.2083 => 13.4320, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.46% (0.5857 => 0.5537, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -5.46% (4.3330 => 4.0965, std.dev.: 0.0124) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.46% (6.7716 => 6.4022, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.45% (0.6681 => 0.6317, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.45% (4.5069 => 4.2614, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: -5.45% (17.1032 => 16.1719, std.dev.: 0.0356) MultiSource/Applications/SIBsim4/SIBsim4: -5.42% (1.3864 => 1.3112, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.42% (0.5569 => 0.5267, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.42% (0.7524 => 0.7116, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.42% (0.8521 => 0.8059, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.41% (0.6395 => 0.6049, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -5.41% (1.1450 => 1.0831, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.40% (0.6293 => 0.5953, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: -5.40% (0.4280 => 0.4049, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.38% (3.5339 => 3.3436, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.38% (0.5575 => 0.5275, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.38% (0.6230 => 0.5895, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.37% (0.3406 => 0.3223, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.37% (0.5567 => 0.5268, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: -5.37% (0.2160 => 0.2044, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.35% (0.6260 => 0.5925, std.dev.: 0.0088) MultiSource/Benchmarks/nbench/nbench: -5.34% (1.1530 => 1.0914, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.34% (0.6440 => 0.6096, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.33% (0.7919 => 0.7497, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.30% (0.7339 => 0.6950, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.28% (8.0126 => 7.5893, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.28% (0.5456 => 0.5168, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.27% (0.6446 => 0.6106, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.27% (0.6189 => 0.5863, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.27% (0.3057 => 0.2896, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -5.27% (0.2659 => 0.2519, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.26% (0.5570 => 0.5277, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.25% (0.5941 => 0.5629, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.25% (0.6194 => 0.5869, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.22% (0.7198 => 0.6822, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.22% (0.5688 => 0.5391, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: -5.21% (15.5079 => 14.7000, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: -5.20% (0.4515 => 0.4280, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.19% (0.2985 => 0.2830, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.18% (0.5999 => 0.5688, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.17% (0.6676 => 0.6331, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.14% (0.2548 => 0.2417, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.13% (0.4916 => 0.4664, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -5.12% (0.3025 => 0.2870, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: -5.10% (1.3148 => 1.2478, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.09% (0.3931 => 0.3731, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -5.08% (3.5154 => 3.3369, std.dev.: 0.0071) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.07% (0.2385 => 0.2264, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -5.06% (1.2515 => 1.1882, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/18-imp/imp: -5.05% (0.3581 => 0.3400, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.04% (0.6033 => 0.5729, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -5.04% (0.3255 => 0.3091, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.04% (1.2210 => 1.1595, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.03% (0.3323 => 0.3156, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.01% (0.4151 => 0.3943, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.01% (1.2221 => 1.1609, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.01% (0.3016 => 0.2865, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.00% (0.3483 => 0.3309, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: -4.98% (0.2871 => 0.2728, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -4.95% (0.3194 => 0.3036, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.92% (0.2278 => 0.2166, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.90% (0.3837 => 0.3649, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -4.90% (0.2939 => 0.2795, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -4.89% (0.3026 => 0.2878, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.87% (0.2999 => 0.2853, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.86% (2.1713 => 2.0657, std.dev.: 0.0079) MultiSource/Applications/ClamAV/clamscan: -4.85% (15.2527 => 14.5122, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.84% (0.2933 => 0.2791, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.80% (0.3252 => 0.3096, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.79% (0.2903 => 0.2764) MultiSource/Applications/lua/lua: -4.79% (4.0594 => 3.8651, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.77% (0.4321 => 0.4115, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: -4.74% (0.3059 => 0.2914, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -4.71% (0.3205 => 0.3054, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -4.71% (0.3481 => 0.3317, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -4.71% (0.4248 => 0.4048, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.68% (0.5168 => 0.4926, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.68% (0.3849 => 0.3669, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -4.67% (0.7447 => 0.7099, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.67% (0.2849 => 0.2716, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.65% (0.4813 => 0.4589, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.65% (0.6667 => 0.6357, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.61% (1.6474 => 1.5715, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary3: -4.59% (0.3446 => 0.3288, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -4.58% (0.3621 => 0.3455, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -4.58% (0.2989 => 0.2852, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -4.57% (0.3394 => 0.3239, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -4.56% (0.7982 => 0.7618, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.55% (22.4056 => 21.3856, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: -4.55% (0.4861 => 0.4640, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -4.51% (2.1401 => 2.0436, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -4.47% (2.4021 => 2.2947, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -4.47% (34.0927 => 32.5693, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.47% (0.5329 => 0.5091, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/hash: -4.47% (0.4524 => 0.4322, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -4.45% (0.3867 => 0.3695, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.44% (0.7021 => 0.6709, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/09-vor/vor: -4.40% (0.3271 => 0.3127, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -4.38% (0.8418 => 0.8049, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.37% (0.9077 => 0.8680, std.dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.31% (0.3319 => 0.3176, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.29% (0.4083 => 0.3908, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.25% (0.9557 => 0.9151, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: -4.21% (18.2933 => 17.5228, std.dev.: 0.0074) MultiSource/Applications/oggenc/oggenc: -4.21% (5.0226 => 4.8112, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.20% (0.4427 => 0.4241, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: -4.07% (0.3788 => 0.3634, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -4.00% (0.6750 => 0.6480, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.78% (2.2587 => 2.1734, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: -3.62% (1.5610 => 1.5045, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.61% (0.3491 => 0.3365, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -3.51% (0.7779 => 0.7506, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -3.11% (20.7746 => 20.1290, std.dev.: 0.0224) SingleSource/UnitTests/ObjC++/Hello: -3.01% (0.6347 => 0.6156, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -2.90% (0.6441 => 0.6254, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.86% (5.4682 => 5.3118, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1949, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: -62.42% (1.8100 => 0.6802, std.dev.: 0.0167) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7506, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -8.68% (1.2842 => 1.1727, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7060, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.70% (2.2633 => 2.1796, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3985, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4717, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 13:04:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 15:04:48 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121129210448.094232A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6393?compare_to=6384&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6393, Order: 168900, Start Time: 2012-11-29 17:38:21, End Time: 2012-11-29 21:05:22 To: 6384, Order: 168871, Start Time: 2012-11-29 13:23:16, End Time: 2012-11-29 16:50:08 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (176 on baseline) Performance Improvements: 2 (18 on baseline) Added Tests: 0 (186 on baseline) Unchanged Tests: 1089 (714 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.04% (1.9899 => 2.0106, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 13.91% (104.0128 => 118.4809, std.dev.: 0.0683) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.35% (54.1695 => 54.9017, std.dev.: 0.0250) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.95% (2.1279 => 2.0438, std.dev.: 0.0296) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.44% (0.3925 => 0.3790, std.dev.: 0.0019) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 44.64% (0.0625 => 0.0904) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.52% (0.1063 => 0.1430, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 29.64% (0.0415 => 0.0538, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 29.05% (0.0475 => 0.0613, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.94% (0.1106 => 0.1415, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.32% (0.2969 => 0.3780, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.89% (0.0714 => 0.0906, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.87% (0.4139 => 0.5251, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 26.20% (1.5932 => 2.0106, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.01% (0.4994 => 0.6293, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.53% (0.4253 => 0.5339, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.36% (0.5900 => 0.7396, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.26% (0.5000 => 0.6213, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.14% (0.0584 => 0.0725, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.95% (0.1620 => 0.2008, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.95% (0.0547 => 0.0678, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.80% (0.1021 => 0.1264, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.76% (0.1107 => 0.1370, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.30% (0.1103 => 0.1360, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 23.04% (0.0599 => 0.0737, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 23.00% (0.0948 => 0.1166, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.79% (0.1549 => 0.1902, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.75% (0.0633 => 0.0777, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.74% (0.0897 => 0.1101, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.63% (0.1604 => 0.1967, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.27% (0.0642 => 0.0785, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.26% (0.0584 => 0.0714, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.82% (0.0495 => 0.0603, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.81% (0.0541 => 0.0659, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.78% (0.0822 => 0.1001, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.75% (0.3903 => 0.4752, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.34% (0.1003 => 0.1217, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/health/health: 21.32% (0.0821 => 0.0996, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 21.25% (0.1619 => 0.1963, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 21.03% (0.0604 => 0.0731, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 20.38% (0.0947 => 0.1140, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.11% (0.1462 => 0.1756, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.91% (0.2014 => 0.2415, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 19.88% (0.5826 => 0.6984, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 19.73% (0.4029 => 0.4824, std.dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 19.68% (0.0808 => 0.0967, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.59% (0.3890 => 0.4652, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 19.46% (0.5889 => 0.7035, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 19.38% (0.1218 => 0.1454, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.33% (0.2866 => 0.3420, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.22% (0.1160 => 0.1383, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.21% (0.1968 => 0.2346, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.18% (1.3152 => 1.5675, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.04% (0.2736 => 0.3257, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 18.91% (0.0698 => 0.0830, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.88% (0.0572 => 0.0680, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.80% (3.5627 => 4.2324, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 18.79% (0.9697 => 1.1519, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.75% (0.1088 => 0.1292, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 18.67% (0.1505 => 0.1786, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.34% (0.3271 => 0.3871, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.32% (0.0573 => 0.0678, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.12% (1.6211 => 1.9149, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.03% (0.4658 => 0.5498, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 18.02% (1.8794 => 2.2180, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.91% (0.2875 => 0.3390, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 17.90% (0.5546 => 0.6539, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.79% (0.2738 => 0.3225, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.75% (2.7292 => 3.2135, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.71% (0.5026 => 0.5916, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 17.68% (0.7171 => 0.8439, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 17.65% (0.2725 => 0.3206, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 17.63% (0.2780 => 0.3270, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 17.61% (0.2714 => 0.3192, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 17.59% (0.1421 => 0.1671, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.59% (0.2911 => 0.3423, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 17.55% (1.0781 => 1.2673, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 17.53% (0.2823 => 0.3318, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.52% (0.2729 => 0.3207, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 17.49% (0.2750 => 0.3231, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 17.47% (0.2811 => 0.3302, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.43% (0.3930 => 0.4615, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.40% (0.3195 => 0.3751, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 17.38% (0.2813 => 0.3302, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.36% (0.0605 => 0.0710, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.34% (0.4361 => 0.5117, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.34% (0.2792 => 0.3276, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 17.30% (0.2803 => 0.3288, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.19% (2.0673 => 2.4226, std.dev.: 0.0041) SingleSource/Regression/C++/ofstream_ctor: 17.11% (0.3004 => 0.3518, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 17.11% (4.2109 => 4.9314, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 17.06% (0.9909 => 1.1599, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 17.05% (0.3096 => 0.3624, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.99% (4.4195 => 5.1705, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.89% (0.3488 => 0.4077, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 16.67% (0.1284 => 0.1498, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 16.59% (0.3267 => 0.3809, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.48% (1.9694 => 2.2939, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary2: 16.43% (0.3317 => 0.3862, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 16.42% (0.3258 => 0.3793, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.41% (0.3060 => 0.3562, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.33% (0.1090 => 0.1268, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 16.19% (0.3446 => 0.4004, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 16.19% (0.3465 => 0.4026, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.18% (0.3362 => 0.3906, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.17% (0.3124 => 0.3629, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.16% (1.9966 => 2.3192, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/moments: 16.15% (0.3678 => 0.4272, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 16.12% (0.3442 => 0.3997, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 16.11% (0.3469 => 0.4028, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 16.10% (0.3460 => 0.4017, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 16.08% (0.3496 => 0.4058, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.03% (0.3282 => 0.3808, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 15.99% (23.5202 => 27.2807, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/lists: 15.86% (0.3348 => 0.3879, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 15.76% (0.2075 => 0.2402, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 15.70% (0.3650 => 0.4223, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 15.65% (0.3726 => 0.4309, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 15.65% (0.3643 => 0.4213, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.50% (0.3625 => 0.4187, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 15.44% (0.3477 => 0.4014, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 15.36% (0.3724 => 0.4296, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 15.28% (0.2566 => 0.2958, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 15.20% (0.4146 => 0.4776, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 15.17% (0.4251 => 0.4896, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.17% (0.3981 => 0.4585, std.dev.: 0.0038) MultiSource/Applications/treecc/treecc: 15.09% (0.7875 => 0.9063, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 14.95% (1.4269 => 1.6402, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.91% (0.3690 => 0.4240, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.77% (0.3845 => 0.4413, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 14.60% (2.1653 => 2.4815, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 14.37% (2.1013 => 2.4033, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: 14.25% (0.0758 => 0.0866, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 14.24% (4.6177 => 5.2752, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 14.11% (0.5012 => 0.5719, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.02% (0.2040 => 0.2326, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 13.45% (0.2691 => 0.3053, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.74% (0.6435 => 0.7255, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 12.71% (5.5417 => 6.2458, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.22% (0.1383 => 0.1552, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 12.04% (0.3498 => 0.3919, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.70% (0.2068 => 0.2310, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.66% (0.2737 => 0.3056, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.58% (0.1028 => 0.1147, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 11.38% (0.6634 => 0.7389, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 11.22% (0.4847 => 0.5391, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.12% (0.3084 => 0.3427, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.67% (0.3336 => 0.3692, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 10.38% (2.0346 => 2.2458, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 10.33% (0.2391 => 0.2638, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.03% (0.2103 => 0.2314, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.14% (0.5361 => 0.5851, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.79% (11.6398 => 12.6631, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.76% (4.6926 => 5.1035, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.34% (0.7426 => 0.8045, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.97% (0.5584 => 0.6029, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 7.48% (11.9555 => 12.8492, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.57% (0.3792 => 0.4041, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.98% (29.0505 => 33.4018, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 9.10% (0.2802 => 0.3057, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6103, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.09% (12.0509 => 12.6640, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8939, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1641, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.60% (79.9355 => 83.6095, std.dev.: 0.0076) SingleSource/Benchmarks/Dhrystone/dry: 4.26% (14.0481 => 14.6471, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2087, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.61% (3.1722 => 3.2234, std.dev.: 0.0023) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3022, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.45% (1.0927 => 1.1085, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2850, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5146, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.12% (12.4025 => 12.5408, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5950, std.dev.: 0.0115) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.79% (2.4764 => 2.3825, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5584, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/ary2: -9.24% (0.2402 => 0.2180, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9785, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7987, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8030, std.dev.: 0.0143) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0022) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7729, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/fldry: -2.40% (17.2379 => 16.8249, std.dev.: 0.0316) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8630, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.69% (10.7630 => 10.5808, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4953, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.25% (105.3826 => 104.0678, std.dev.: 0.0975) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0423, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 14:43:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 16:43:17 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121129224317.18F9A2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6394?compare_to=6390&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6394, Order: 168935, Start Time: 2012-11-29 21:06:33, End Time: 2012-11-29 22:43:51 To: 6390, Order: 168914, Start Time: 2012-11-29 19:09:55, End Time: 2012-11-29 20:49:13 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 8 (64 on baseline) Performance Improvements: 21 (34 on baseline) Added Tests: 0 (51 on baseline) Existing Failures: 42 (40 on baseline) Unchanged Tests: 1023 (875 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-BitfieldHandling: 72.03% (0.0143 => 0.0246, std.dev.: 0.0014) SingleSource/UnitTests/Vector/simple: 63.59% (0.0217 => 0.0355, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.94% (1.7094 => 1.8451, std.dev.: 0.0239) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.25% (0.4800 => 0.5004, std.dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: 29.47% (39.2511 => 50.8182, std.dev.: 0.8935) SingleSource/Benchmarks/Misc/richards_benchmark: 2.45% (1.3667 => 1.4002, std.dev.: 0.0102) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.89% (2.7686 => 2.8210, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.70% (2.4376 => 2.4791, std.dev.: 0.0118) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -39.74% (0.0536 => 0.0323, std.dev.: 0.0072) SingleSource/Benchmarks/Stanford/RealMM: -35.34% (0.0648 => 0.0419, std.dev.: 0.0054) MultiSource/Applications/spiff/spiff: -30.51% (1.2614 => 0.8766, std.dev.: 0.0378) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -28.06% (1.8216 => 1.3104, std.dev.: 0.0947) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -26.68% (0.0967 => 0.0709, std.dev.: 0.0089) MultiSource/Applications/SIBsim4/SIBsim4: -18.29% (1.6024 => 1.3093, std.dev.: 0.0328) MultiSource/Applications/JM/lencod/lencod: -12.95% (18.4029 => 16.0200, std.dev.: 0.2278) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -10.69% (0.3593 => 0.3209, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -7.58% (0.9082 => 0.8394, std.dev.: 0.0236) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.25% (0.1968 => 0.1845, std.dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: -4.49% (5.3383 => 5.0986, std.dev.: 0.0850) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Stanford/Towers: -42.39% (0.0335 => 0.0193, std.dev.: 0.0051) MultiSource/Applications/JM/ldecod/ldecod: -34.43% (0.0976 => 0.0640, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -30.47% (0.1418 => 0.0986, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/strcat: -13.23% (0.0907 => 0.0787, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/matrix: -5.84% (3.0648 => 2.8857, std.dev.: 0.0353) MultiSource/Applications/spiff/spiff: -3.70% (2.9970 => 2.8860, std.dev.: 0.0063) MultiSource/Applications/lua/lua: -3.57% (29.7878 => 28.7252, std.dev.: 0.2139) SingleSource/Benchmarks/Misc/mandel-2: -2.48% (1.7150 => 1.6724, std.dev.: 0.0126) MultiSource/Applications/JM/lencod/lencod: -2.11% (7.0495 => 6.9010, std.dev.: 0.0501) SingleSource/Benchmarks/Misc/ffbench: -1.57% (1.3907 => 1.3689, std.dev.: 0.0045) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.48% (1.1506 => 1.0645, std.dev.: 0.1074) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.90% (0.3712 => 0.3894, std.dev.: 0.0404) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.81% (0.0221 => 0.0225, std.dev.: 0.0082) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.64% (0.0428 => 0.0435, std.dev.: 0.0135) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 14.71% (0.0333 => 0.0382, std.dev.: 0.0056) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.82% (0.0314 => 0.0326, std.dev.: 0.0091) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.87% (0.0427 => 0.0435, std.dev.: 0.0145) SingleSource/UnitTests/Vector/Altivec/casts: 2.91% (0.0206 => 0.0212, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/test1: 6.82% (0.0220 => 0.0235, std.dev.: 0.0060) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -7.39% (0.1596 => 0.1478, std.dev.: 0.0102) MultiSource/Applications/lemon/lemon: -12.74% (1.3553 => 1.1826, std.dev.: 0.2756) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.77% (0.4022 => 0.3991, std.dev.: 0.0807) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.47% (0.1474 => 0.1467, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.24% (0.0643 => 0.0635, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.14% (0.0287 => 0.0278, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.26% (0.0582 => 0.0601, std.dev.: 0.0135) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.10% (1.1502 => 1.1491, std.dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: -0.10% (9.4018 => 9.3923, std.dev.: 0.0411) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -53.33% (0.0030 => 0.0014, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.50% (0.0602 => 0.0605, std.dev.: 0.0135) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0264 => 0.0264, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.04% (0.8099 => 0.8183, std.dev.: 0.0363) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -47.20% (0.0125 => 0.0066, std.dev.: 0.0056) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.07% (34.4755 => 34.5003, std.dev.: 0.0422) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Benchmarks/SciMark2-C/scimark2: -67.14% (28.5821 => 9.3923, std.dev.: 0.0411) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.73% (16.4461 => 17.8823, std.dev.: 0.7029) MultiSource/Applications/sqlite3/sqlite3: 2347.66% (0.6332 => 15.4986, std.dev.: 0.6301) MultiSource/Benchmarks/McCat/08-main/main: 48.61% (0.1831 => 0.2721, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.35% (0.1559 => 0.1580, std.dev.: 0.0103) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7332.34% (0.3123 => 23.2112, std.dev.: 0.7888) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1656.40% (0.3344 => 5.8734, std.dev.: 0.0910) SingleSource/Benchmarks/Misc-C++/Large/ray: 41.12% (0.2364 => 0.3336, std.dev.: 0.0367) SingleSource/Benchmarks/Misc-C++/bigfib: 5.94% (0.6010 => 0.6367, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/mandel: 10.26% (0.0429 => 0.0473, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.06% (0.3266 => 0.3464, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/strcat: 5.89% (0.1969 => 0.2085, std.dev.: 0.0366) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 9.82% (0.0224 => 0.0246, std.dev.: 0.0084) SingleSource/UnitTests/byval-alignment: -21.30% (0.0230 => 0.0181, std.dev.: 0.0041) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0511, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 12.45% (0.1462 => 0.1644, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4379, std.dev.: 0.0505) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0692, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4919, std.dev.: 0.0396) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5215, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2746, std.dev.: 0.0864) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0731, std.dev.: 0.0340) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3640, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3831, std.dev.: 0.0206) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0787, std.dev.: 0.0033) SingleSource/Regression/C/uint64_to_float: -29.88% (2.1832 => 1.5308, std.dev.: 0.0377) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-BitfieldHandling: 93.70% (0.0127 => 0.0246, std.dev.: 0.0014) SingleSource/UnitTests/Vector/simple: 79.29% (0.0198 => 0.0355, std.dev.: 0.0024) SingleSource/UnitTests/Vector/build2: 44.44% (0.0315 => 0.0455, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 20.48% (1.5315 => 1.8451, std.dev.: 0.0239) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.42% (0.0810 => 0.0943, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.76% (0.4559 => 0.5004, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.18% (0.4127 => 0.4506, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.82% (0.6586 => 0.7101, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: 7.75% (0.3226 => 0.3476, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.32% (0.3115 => 0.3343, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.94% (1.2526 => 1.3395, std.dev.: 0.0123) MultiSource/Benchmarks/nbench/nbench: 6.22% (1.1271 => 1.1972, std.dev.: 0.0115) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.05% (0.1885 => 0.1999, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 6.00% (0.8069 => 0.8553, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 5.24% (0.9069 => 0.9544, std.dev.: 0.0145) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.23% (6.6074 => 6.9528, std.dev.: 0.0368) SingleSource/Benchmarks/Shootout-C++/moments: 5.02% (0.3645 => 0.3828, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.00% (4.1763 => 4.3852, std.dev.: 0.0540) MultiSource/Applications/JM/lencod/lencod: 4.51% (15.3280 => 16.0200, std.dev.: 0.2278) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.41% (0.9056 => 0.9455, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.41% (0.8286 => 0.8651, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/hash2: 2.47% (0.4125 => 0.4227, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 34.15% (1.5795 => 2.1189, std.dev.: 0.0402) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 28.24% (2.9096 => 3.7313, std.dev.: 0.1095) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.17% (4.8436 => 5.8689, std.dev.: 0.0272) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 18.15% (0.7597 => 0.8976, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.93% (8.2783 => 9.7626, std.dev.: 0.0233) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.91% (14.6451 => 17.1220, std.dev.: 0.5188) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.79% (2.7995 => 3.1297, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.39% (1.1857 => 1.3089, std.dev.: 0.0184) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.36% (0.1129 => 0.1246, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 10.29% (7.4933 => 8.2644, std.dev.: 0.0337) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.94% (6.3772 => 7.0108, std.dev.: 0.1361) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.59% (23.5781 => 25.3688, std.dev.: 0.0802) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.59% (3.9917 => 4.2945, std.dev.: 0.1003) MultiSource/Benchmarks/McCat/18-imp/imp: 7.52% (0.1370 => 0.1473, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 7.40% (1.3037 => 1.4002, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.52% (3.3761 => 3.5961, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 6.33% (4.8660 => 5.1741, std.dev.: 0.0386) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.97% (2.9753 => 3.1529, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.79% (4.5327 => 4.7951, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.53% (5.4187 => 5.7181, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.33% (5.3218 => 5.6057, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.95% (0.5214 => 0.5472, std.dev.: 0.0022) MultiSource/Applications/aha/aha: 4.86% (3.3398 => 3.5020, std.dev.: 0.0306) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 4.82% (0.4353 => 0.4563, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/whetstone: 4.67% (2.1224 => 2.2215, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 4.60% (0.3937 => 0.4118, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 4.54% (4.8362 => 5.0556, std.dev.: 0.0246) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.58% (41.4238 => 42.9078, std.dev.: 0.4612) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.57% (59.2638 => 61.3799, std.dev.: 0.7821) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.18% (0.4031 => 0.4159, std.dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: 2.90% (6.7064 => 6.9010, std.dev.: 0.0501) MultiSource/Benchmarks/Olden/power/power: 2.84% (1.2061 => 1.2403, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.39% (2.7551 => 2.8210, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.33% (3.4104 => 3.4897, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.20% (0.6150 => 0.6285, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.72% (11.5690 => 11.7675, std.dev.: 0.0679) SingleSource/Benchmarks/Shootout/methcall: 1.70% (8.2676 => 8.4082, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/flops-7: 1.46% (1.7156 => 1.7406, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.24% (4.9469 => 5.0084, std.dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.09% (3.7781 => 3.8193, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/mandel-text: 1.05% (1.8231 => 1.8422, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 1.05% (2.8561 => 2.8860, std.dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.23% (2.8951 => 1.6724, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -26.54% (7.2130 => 5.2990, std.dev.: 0.1260) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.32% (1.4529 => 1.1577, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: -19.31% (9.3748 => 7.5645, std.dev.: 0.6340) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.76% (9.9065 => 8.2460, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/ary3: -13.12% (1.9999 => 1.7375, std.dev.: 0.0911) MultiSource/Benchmarks/Olden/em3d/em3d: -12.76% (5.4641 => 4.7671, std.dev.: 0.0161) SingleSource/Benchmarks/Misc/flops-8: -9.18% (2.5609 => 2.3258, std.dev.: 0.0105) MultiSource/Benchmarks/mafft/pairlocalalign: -8.97% (63.1822 => 57.5139, std.dev.: 0.1498) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.38% (0.3269 => 0.2995, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.24% (1.0512 => 0.9646, std.dev.: 0.0113) SingleSource/Benchmarks/Stanford/FloatMM: -6.57% (0.8807 => 0.8228, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.21% (4.7482 => 4.4532, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.13% (5.1305 => 4.8161, std.dev.: 0.0278) SingleSource/Benchmarks/Shootout/sieve: -5.94% (7.0599 => 6.6405, std.dev.: 0.0326) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.40% (6.2275 => 5.8914, std.dev.: 0.0267) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.82% (5.6343 => 5.3627, std.dev.: 0.0268) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.39% (4.7449 => 4.5368, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.35% (4.9453 => 4.7304, std.dev.: 0.0258) SingleSource/Benchmarks/Misc/ffbench: -4.25% (1.4296 => 1.3689, std.dev.: 0.0045) MultiSource/Applications/siod/siod: -4.23% (3.6643 => 3.5093, std.dev.: 0.0482) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.16% (6.1706 => 5.9136, std.dev.: 0.0414) MultiSource/Applications/lua/lua: -3.71% (29.8330 => 28.7252, std.dev.: 0.2139) SingleSource/Benchmarks/Misc/perlin: -3.64% (5.1084 => 4.9224, std.dev.: 0.0321) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.63% (5.1557 => 4.9684, std.dev.: 0.0544) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.25% (4.9686 => 4.8072, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/methcall: -3.11% (8.9760 => 8.6972, std.dev.: 0.0541) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.62% (1.3882 => 1.3518, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.20% (0.5807 => 0.5679, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/fbench: -1.90% (3.3840 => 3.3196, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/flops-5: -1.76% (2.8957 => 2.8448, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fp-convert: -1.31% (15.8853 => 15.6767, std.dev.: 0.0227) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.30% (4.2466 => 4.1916, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.06% (6.0224 => 5.9585, std.dev.: 0.0112) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.73% (1.0262 => 1.0645, std.dev.: 0.1074) SingleSource/Benchmarks/CoyoteBench/fftbench: 58.10% (0.2463 => 0.3894, std.dev.: 0.0404) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 82.93% (0.0123 => 0.0225, std.dev.: 0.0082) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 6.62% (0.0408 => 0.0435, std.dev.: 0.0135) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 50.39% (0.0254 => 0.0382, std.dev.: 0.0056) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 7.95% (0.0302 => 0.0326, std.dev.: 0.0091) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 13.28% (0.0384 => 0.0435, std.dev.: 0.0145) SingleSource/UnitTests/Vector/Altivec/casts: 11.58% (0.0190 => 0.0212, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/test1: 30.56% (0.0180 => 0.0235, std.dev.: 0.0060) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.78% (0.1438 => 0.1478, std.dev.: 0.0102) MultiSource/Applications/lemon/lemon: 4.39% (1.1329 => 1.1826, std.dev.: 0.2756) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.15% (0.4164 => 0.3991, std.dev.: 0.0807) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.16% (0.1369 => 0.1467, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.94% (0.0641 => 0.0635, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.56% (0.0195 => 0.0278, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.98% (0.0578 => 0.0601, std.dev.: 0.0135) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.47% (1.1437 => 1.1491, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1300.00% (0.0001 => 0.0014, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.51% (0.0627 => 0.0605, std.dev.: 0.0135) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 46.67% (0.0180 => 0.0264, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/puzzle: 2.07% (0.8017 => 0.8183, std.dev.: 0.0363) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 6.45% (0.0062 => 0.0066, std.dev.: 0.0056) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 14:54:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 16:54:03 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121129225403.160E42A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6395?compare_to=6392&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6395, Order: 168935, Start Time: 2012-11-29 21:20:54, End Time: 2012-11-29 22:54:27 To: 6392, Order: 168918, Start Time: 2012-11-29 19:24:10, End Time: 2012-11-29 20:57:39 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (6 on baseline) Performance Improvements: 0 (185 on baseline) Added Tests: 0 (52 on baseline) Unchanged Tests: 1092 (851 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.08% (54.4391 => 56.6627, std.dev.: 0.0676) SingleSource/Benchmarks/Dhrystone/fldry: 2.00% (0.6802 => 0.6938, std.dev.: 0.0048) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.78% (0.3834 => 0.4439, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.83% (54.5751 => 56.6627, std.dev.: 0.0676) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1013, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.47% (7.4937 => 7.6791, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/hash2: 2.36% (3.1932 => 3.2686, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.74% (0.1431 => 0.1306, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.64% (0.3821 => 0.3529, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.07% (0.9542 => 0.8867, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.68% (0.3142 => 0.2932, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.34% (0.2428 => 0.2274, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -6.26% (2.4924 => 2.3365, std.dev.: 0.0151) MultiSource/Applications/sgefa/sgefa: -6.23% (0.3357 => 0.3148, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.20% (0.3884 => 0.3643, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.16% (0.3831 => 0.3595, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: -6.16% (0.3880 => 0.3641, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.14% (0.3812 => 0.3578, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -6.08% (0.3896 => 0.3659, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.06% (0.3848 => 0.3615, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: -6.01% (0.4176 => 0.3925, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.99% (0.3891 => 0.3658, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/oourafft: -5.97% (0.2160 => 0.2031, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: -5.97% (9.2283 => 8.6776, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/for-in: -5.95% (0.4033 => 0.3793, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.93% (0.7198 => 0.6771, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: -5.83% (7.0961 => 6.6824, std.dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: -5.83% (16.1920 => 15.2484, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.82% (0.3658 => 0.3445, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.79% (0.1796 => 0.1692, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.79% (0.5805 => 0.5469, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.79% (1.3722 => 1.2928, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.79% (0.9852 => 0.9282, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.78% (0.6052 => 0.5702, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.76% (0.5591 => 0.5269, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.75% (0.5478 => 0.5163, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: -5.74% (0.9179 => 0.8652, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.74% (0.6484 => 0.6112, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.72% (0.5859 => 0.5524, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.69% (0.6304 => 0.5945, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.68% (0.5863 => 0.5530, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.67% (0.5925 => 0.5589, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.67% (0.5857 => 0.5525, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.66% (0.5705 => 0.5382, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.65% (0.5802 => 0.5474, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.64% (0.6260 => 0.5907, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.63% (0.6194 => 0.5845, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.61% (0.5575 => 0.5262, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.60% (0.6395 => 0.6037, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.59% (1.2300 => 1.1612, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.59% (0.5581 => 0.5269, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.59% (0.5567 => 0.5256, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.56% (4.8161 => 4.5481, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.56% (0.7524 => 0.7106, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.55% (0.5941 => 0.5611, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.55% (0.5570 => 0.5261, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.54% (4.8802 => 4.6096, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.54% (0.6230 => 0.5885, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.53% (0.5569 => 0.5261, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -5.50% (0.4199 => 0.3968, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.50% (0.6676 => 0.6309, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.48% (0.2355 => 0.2226, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.48% (0.6189 => 0.5850, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: -5.47% (0.4515 => 0.4268, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.46% (3.5339 => 3.3409, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.45% (0.5849 => 0.5530, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.45% (4.0323 => 3.8125, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.44% (0.6033 => 0.5705, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.43% (1.0544 => 0.9971, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.43% (0.5688 => 0.5379, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.43% (0.6297 => 0.5955, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.42% (1.6364 => 1.5477, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.42% (0.2695 => 0.2549, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.42% (0.3323 => 0.3143, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.41% (0.7339 => 0.6942, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.41% (0.5456 => 0.5161, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.40% (0.6446 => 0.6098, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.40% (1.4642 => 1.3852, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.39% (0.3931 => 0.3719, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.38% (1.2784 => 1.2096, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.36% (0.3057 => 0.2893, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.36% (0.6440 => 0.6095, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -5.35% (0.4280 => 0.4051, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.34% (0.6681 => 0.6324, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.34% (14.2083 => 13.4494, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.34% (0.6293 => 0.5957) MultiSource/Benchmarks/MallocBench/gs/gs: -5.33% (4.3330 => 4.1019, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: -5.32% (0.3025 => 0.2864, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -5.31% (1.3148 => 1.2450, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.31% (4.5069 => 4.2678, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.29% (0.3252 => 0.3080, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: -5.28% (1.1530 => 1.0921, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.28% (0.4151 => 0.3932, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.27% (6.7716 => 6.4147, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.27% (0.6395 => 0.6058, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.24% (2.1713 => 2.0576, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.23% (0.3194 => 0.3027, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.23% (0.6736 => 0.6384, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.21% (0.3837 => 0.3637, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -5.20% (0.3406 => 0.3229, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -5.19% (1.3864 => 1.3145, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.18% (0.2548 => 0.2416, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -5.16% (1.1450 => 1.0859, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.13% (0.8521 => 0.8084, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: -5.12% (0.2871 => 0.2724) MultiSource/Benchmarks/McCat/08-main/main: -5.11% (0.2659 => 0.2523, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.11% (0.2933 => 0.2783, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -5.09% (0.2985 => 0.2833, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.09% (0.4321 => 0.4101, std.dev.: 0.0037) SingleSource/Regression/C++/ofstream_ctor: -5.07% (0.3059 => 0.2904, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.06% (0.2903 => 0.2756, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.06% (8.0126 => 7.6070, std.dev.: 0.0097) MultiSource/Applications/sqlite3/sqlite3: -5.04% (17.1032 => 16.2405, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.04% (0.3016 => 0.2864, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.02% (1.2221 => 1.1608, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -5.00% (0.2939 => 0.2792, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -5.00% (0.3481 => 0.3307, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: -4.99% (0.3205 => 0.3045, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: -4.98% (0.2849 => 0.2707, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.98% (0.5999 => 0.5700, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.98% (0.4916 => 0.4671, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -4.98% (0.3255 => 0.3093, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.95% (0.7919 => 0.7527, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.93% (1.2210 => 1.1608, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -4.92% (0.4861 => 0.4622, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.91% (0.3483 => 0.3312, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -4.90% (15.5079 => 14.7479, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/ary: -4.86% (0.3394 => 0.3229, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.85% (0.2989 => 0.2844, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -4.84% (3.5154 => 3.3453, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -4.83% (0.3621 => 0.3446, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: -4.83% (0.3581 => 0.3408, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.83% (0.2278 => 0.2168, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.82% (0.4813 => 0.4581, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -4.79% (1.2515 => 1.1916, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: -4.78% (0.4248 => 0.4045, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -4.76% (0.3446 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -4.76% (0.3026 => 0.2882, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.74% (0.6667 => 0.6351, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.73% (0.2999 => 0.2857, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -4.73% (0.3867 => 0.3684, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -4.72% (15.2527 => 14.5325, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.71% (0.6660 => 0.6346, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -4.59% (0.7447 => 0.7105, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.57% (0.3849 => 0.3673, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -4.56% (4.0594 => 3.8742, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.53% (0.5168 => 0.4934, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -4.48% (2.1401 => 2.0442, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash: -4.44% (0.4524 => 0.4323, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.42% (0.7021 => 0.6711, std.dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: -4.40% (0.7982 => 0.7631, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.39% (0.5329 => 0.5095, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -4.37% (0.3271 => 0.3128, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.37% (1.6474 => 1.5754, std.dev.: 0.0120) MultiSource/Benchmarks/Bullet/bullet: -4.37% (34.0927 => 32.6031, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.34% (0.9557 => 0.9142, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.31% (22.4056 => 21.4403, std.dev.: 0.0072) MultiSource/Applications/siod/siod: -4.28% (2.4021 => 2.2993, std.dev.: 0.0167) MultiSource/Applications/kimwitu++/kc: -4.14% (18.2933 => 17.5363, std.dev.: 0.0122) MultiSource/Applications/oggenc/oggenc: -4.11% (5.0226 => 4.8163, std.dev.: 0.0050) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.04% (0.3319 => 0.3185, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.00% (0.4427 => 0.4250, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -3.96% (0.6750 => 0.6483, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.91% (0.9077 => 0.8722, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: -3.91% (0.3788 => 0.3640, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: -3.88% (0.8418 => 0.8091, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: -3.73% (0.7779 => 0.7489, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.72% (0.3491 => 0.3361, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.67% (2.2587 => 2.1757, std.dev.: 0.0025) MultiSource/Applications/hbd/hbd: -3.47% (1.5610 => 1.5068, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: -3.32% (0.6441 => 0.6227, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -3.25% (0.6347 => 0.6141, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -2.91% (20.7746 => 20.1702, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.52% (5.4682 => 5.3302, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.50% (31.3723 => 10.1974, std.dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: -61.67% (1.8100 => 0.6938, std.dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7534, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -8.73% (1.2842 => 1.1721, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: -4.04% (2.2633 => 2.1718, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7067, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.80% (1.3096 => 1.2599, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3994, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4699, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 2.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 16:12:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 18:12:37 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121130001237.22E3C2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6396?compare_to=6391&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6396, Order: 168935, Start Time: 2012-11-29 21:49:35, End Time: 2012-11-30 00:13:11 To: 6391, Order: 168902, Start Time: 2012-11-29 18:31:21, End Time: 2012-11-29 20:53:14 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 80 (180 on baseline) Performance Improvements: 4 (43 on baseline) Added Tests: 0 (186 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1004 (662 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/objects/objects: 14.94% (0.1165 => 0.1339, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.85% (0.5805 => 0.6667, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 13.29% (0.6732 => 0.7627, std.dev.: 0.0319) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.71% (0.5894 => 0.6643, std.dev.: 0.0169) MultiSource/Applications/hexxagon/hexxagon: 12.25% (1.3813 => 1.5505, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.25% (0.6621 => 0.7432, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.91% (0.7585 => 0.8488, std.dev.: 0.0166) SingleSource/UnitTests/Vectorizer/gcc-loops: 11.46% (0.5681 => 0.6332, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 11.34% (0.6245 => 0.6953, std.dev.: 0.0246) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.29% (0.1648 => 0.1834, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 10.71% (0.0990 => 0.1096, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.55% (0.7176 => 0.7933, std.dev.: 0.0075) MultiSource/Applications/treecc/treecc: 10.32% (2.3416 => 2.5833, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.08% (0.1210 => 0.1332, std.dev.: 0.0047) SingleSource/Benchmarks/LivermoreLoops/kernel12: 9.99% (0.1001 => 0.1101, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 9.91% (0.3118 => 0.3427, std.dev.: 0.0046) SingleSource/Benchmarks/LivermoreLoops/kernel10: 9.62% (0.1050 => 0.1151, std.dev.: 0.0013) SingleSource/Benchmarks/LivermoreLoops/kernel08: 9.55% (0.1236 => 0.1354, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/BoolLiteralTest: 9.52% (0.4234 => 0.4637, std.dev.: 0.0152) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.48% (8.0267 => 8.7878, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.13% (0.5928 => 0.6469, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.97% (0.6687 => 0.7287, std.dev.: 0.0161) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.82% (0.5625 => 0.6121, std.dev.: 0.0148) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.52% (0.3335 => 0.3619, std.dev.: 0.0100) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.39% (0.2121 => 0.2299, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 8.32% (0.8184 => 0.8865, std.dev.: 0.0158) MultiSource/Benchmarks/Olden/bh/bh: 8.28% (0.3333 => 0.3609, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.02% (16.7439 => 18.0869, std.dev.: 0.2160) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.00% (0.2676 => 0.2890, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.94% (0.3361 => 0.3628, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.76% (0.1906 => 0.2054, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/05-eks/eks: 7.63% (0.4784 => 0.5149, std.dev.: 0.0055) MultiSource/Applications/oggenc/oggenc: 7.61% (6.6256 => 7.1301, std.dev.: 0.0888) MultiSource/Benchmarks/McCat/18-imp/imp: 7.48% (0.3891 => 0.4182, std.dev.: 0.0089) MultiSource/Applications/hbd/hbd: 7.17% (1.7313 => 1.8555, std.dev.: 0.0414) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.39% (0.5099 => 0.5425, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 6.38% (19.2572 => 20.4856, std.dev.: 0.4724) MultiSource/Benchmarks/Olden/em3d/em3d: 6.33% (0.1975 => 0.2100, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.74% (0.4950 => 0.5234, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.69% (0.2582 => 0.2729, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.41% (4.6862 => 4.9396, std.dev.: 0.0670) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.38% (11.8578 => 12.4955, std.dev.: 0.1761) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.20% (0.6465 => 0.6801, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/property: 5.14% (0.4377 => 0.4602, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.89% (0.2047 => 0.2147, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 4.70% (0.9530 => 0.9978, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 4.58% (0.4437 => 0.4640, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 4.56% (0.6444 => 0.6738, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.42% (0.3689 => 0.3852, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-3: 4.39% (0.3942 => 0.4115, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 4.33% (0.3973 => 0.4145, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 4.15% (0.3980 => 0.4145, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 4.12% (0.3906 => 0.4067, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.05% (0.3774 => 0.3927, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.05% (0.4002 => 0.4164, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.84% (0.9875 => 1.0254, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/synchronized: 3.70% (0.4000 => 0.4148, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: 3.50% (0.4138 => 0.4283, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.33% (2.4408 => 2.5222, std.dev.: 0.0291) MultiSource/Applications/d/make_dparser: 3.32% (4.1338 => 4.2709, std.dev.: 0.0198) SingleSource/UnitTests/ObjC/exceptions: 3.27% (0.4306 => 0.4447, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-2: 3.13% (0.3925 => 0.4048, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 3.03% (32.0741 => 33.0471, std.dev.: 0.1619) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.08% (37.8281 => 38.6165, std.dev.: 0.1485) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 46.63% (6.0594 => 8.8848, std.dev.: 0.0389) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 37.38% (0.3424 => 0.4704, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/09-vor/vor: 28.30% (0.1191 => 0.1528, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 28.12% (1.5542 => 1.9913, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 13.17% (8.7069 => 9.8539, std.dev.: 0.1099) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.01% (16.8625 => 18.7189, std.dev.: 0.1453) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.35% (2.1028 => 2.2783, std.dev.: 0.0066) MultiSource/Benchmarks/Fhourstones/fhourstones: 6.64% (1.8147 => 1.9352, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.90% (1.5457 => 1.6214, std.dev.: 0.0136) MultiSource/Benchmarks/Olden/bh/bh: 4.24% (1.9567 => 2.0397, std.dev.: 0.0277) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.18% (6.1469 => 6.3423, std.dev.: 0.0681) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.58% (10.1317 => 10.3926, std.dev.: 0.0384) MultiSource/Applications/JM/lencod/lencod: 2.50% (7.5339 => 7.7222, std.dev.: 0.0340) MultiSource/Applications/SIBsim4/SIBsim4: 1.49% (3.8565 => 3.9140, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.15% (5.6749 => 5.7399, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.07% (3.6242 => 3.6631, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -7.80% (0.6742 => 0.6216, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/lists1: -6.11% (0.4323 => 0.4059, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/ReedSolomon: -4.80% (0.2334 => 0.2222, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/lists: -1.13% (12.6596 => 12.5164, std.dev.: 0.0349) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.43% (69.2066 => 69.5048, std.dev.: 0.6548) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 1.27% (0.1338 => 0.1355, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.97% (0.0419 => 0.0444, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.09% (0.0669 => 0.0655, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: -0.02% (494.0075 => 493.9269, std.dev.: 0.1473) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.90% (63.2438 => 69.5048, std.dev.: 0.6548) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.99% (4.3882 => 0.0444, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43699.49% (1.1277 => 493.9269, std.dev.: 0.1473) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 195.74% (0.5229 => 1.5464, std.dev.: 0.1006) MultiSource/Applications/SPASS/SPASS: 19.23% (14.9895 => 17.8719, std.dev.: 0.1839) MultiSource/Applications/kimwitu++/kc: 46.22% (14.1553 => 20.6978, std.dev.: 0.3775) MultiSource/Benchmarks/MallocBench/gs/gs: 22.06% (4.1105 => 5.0172, std.dev.: 0.1691) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.69% (1.1048 => 1.5212, std.dev.: 0.0394) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 439.47% (7.1582 => 38.6165, std.dev.: 0.1485) SingleSource/Benchmarks/Misc-C++-EH/spirit: 76.17% (3.4629 => 6.1007, std.dev.: 0.1941) SingleSource/Benchmarks/Misc-C++/stepanov_container: 78.72% (0.6222 => 1.1120, std.dev.: 0.0293) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10625.28% (0.0720 => 7.7222, std.dev.: 0.0340) MultiSource/Applications/SIBsim4/SIBsim4: 3913900.00% (0.0001 => 3.9140, std.dev.: 0.0095) MultiSource/Applications/SPASS/SPASS: 15655200.00% (0.0001 => 15.6553, std.dev.: 1.0020) MultiSource/Applications/kimwitu++/kc: 53500.00% (0.0001 => 0.0536, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 65500.00% (0.0001 => 0.0656, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575900.00% (0.0001 => 0.5760, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9990000.00% (0.0001 => 9.9901, std.dev.: 0.0254) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6577900.00% (0.0001 => 6.5780, std.dev.: 0.3815) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1801.67% (1.1194 => 21.2873, std.dev.: 0.5719) MultiSource/Applications/ClamAV/clamscan: 70.91% (22.1758 => 37.8997, std.dev.: 0.1319) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 58.55% (2.9384 => 4.6587, std.dev.: 0.3353) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.89% (7.0540 => 10.8554, std.dev.: 0.4385) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 53.58% (8.1363 => 12.4955, std.dev.: 0.1761) MultiSource/Benchmarks/FreeBench/distray/distray: 53.03% (0.1056 => 0.1616, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 50.64% (21.9371 => 33.0471, std.dev.: 0.1619) SingleSource/Benchmarks/CoyoteBench/almabench: 43.42% (0.0730 => 0.1047, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 40.36% (0.1432 => 0.2010, std.dev.: 0.0093) SingleSource/UnitTests/vla: 40.00% (0.0355 => 0.0497, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 35.54% (0.1584 => 0.2147, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 34.99% (0.0746 => 0.1007, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 34.18% (0.2554 => 0.3427, std.dev.: 0.0046) MultiSource/Benchmarks/Fhourstones/fhourstones: 32.82% (0.1566 => 0.2080, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 32.53% (0.0793 => 0.1051, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/17-bintr/bintr: 31.41% (0.0675 => 0.0887, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 30.36% (0.0672 => 0.0876, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 30.17% (0.0842 => 0.1096, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/dot-syntax-1: 29.85% (0.0479 => 0.0622, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 29.55% (0.0528 => 0.0684, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/messages-2: 29.00% (0.0662 => 0.0854, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 28.19% (0.0933 => 0.1196, std.dev.: 0.0035) MultiSource/Applications/d/make_dparser: 28.05% (3.3354 => 4.2709, std.dev.: 0.0198) MultiSource/Benchmarks/NPB-serial/is/is: 27.96% (0.0719 => 0.0920, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 27.77% (0.0886 => 0.1132, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/family/family: 27.71% (0.0397 => 0.0507, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/15-trie/trie: 27.70% (0.0527 => 0.0673, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 27.57% (0.4103 => 0.5234, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 27.43% (2.0273 => 2.5833, std.dev.: 0.0058) MultiSource/Applications/spiff/spiff: 27.35% (0.7835 => 0.9978, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.16% (0.6675 => 0.8488, std.dev.: 0.0166) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 26.07% (0.0491 => 0.0619, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 25.89% (14.3668 => 18.0869, std.dev.: 0.2160) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 25.51% (0.0443 => 0.0556, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.48% (0.8172 => 1.0254, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.42% (0.1062 => 0.1332, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 24.93% (0.0730 => 0.0912, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 24.92% (0.1236 => 0.1544, std.dev.: 0.0085) MultiSource/Applications/minisat/minisat: 24.60% (0.7115 => 0.8865, std.dev.: 0.0158) SingleSource/Benchmarks/Stanford/Oscar: 24.21% (0.0636 => 0.0790, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: 24.00% (0.0871 => 0.1080, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 23.89% (0.1695 => 0.2100, std.dev.: 0.0043) MultiSource/Applications/oggenc/oggenc: 23.81% (5.7591 => 7.1301, std.dev.: 0.0888) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 23.50% (0.0953 => 0.1177, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.37% (0.1044 => 0.1288, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout/hash: 23.30% (0.0485 => 0.0598, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 23.23% (0.3650 => 0.4498, std.dev.: 0.0092) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 23.20% (0.1125 => 0.1386, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 22.99% (0.6450 => 0.7933, std.dev.: 0.0075) MultiSource/Benchmarks/llubenchmark/llu: 22.94% (0.0462 => 0.0568, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 22.17% (0.3423 => 0.4182, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/city/city: 22.05% (2.0665 => 2.5222, std.dev.: 0.0291) SingleSource/Benchmarks/Adobe-C++/functionobjects: 21.93% (0.5020 => 0.6121, std.dev.: 0.0148) MultiSource/Benchmarks/VersaBench/bmm/bmm: 21.87% (0.0759 => 0.0925, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 21.82% (0.3162 => 0.3852, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.18% (0.1695 => 0.2054, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.16% (0.2065 => 0.2502, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/tsp/tsp: 20.94% (0.1175 => 0.1421, std.dev.: 0.0031) MultiSource/Benchmarks/sim/sim: 20.93% (0.3387 => 0.4096, std.dev.: 0.0150) MultiSource/Applications/hexxagon/hexxagon: 20.74% (1.2842 => 1.5505, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.68% (0.1117 => 0.1348, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 20.62% (0.1906 => 0.2299, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 20.20% (0.1114 => 0.1339, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.17% (0.2271 => 0.2729, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/lists: 20.13% (0.0626 => 0.0752, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 19.77% (0.4299 => 0.5149, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/bigfib: 19.69% (0.6456 => 0.7727, std.dev.: 0.0222) MultiSource/Applications/sqlite3/sqlite3: 19.23% (17.1811 => 20.4856, std.dev.: 0.4724) SingleSource/UnitTests/Vector/SSE/sse_isamax: 19.18% (0.0704 => 0.0839, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 18.93% (0.2430 => 0.2890, std.dev.: 0.0032) MultiSource/Applications/hbd/hbd: 18.92% (1.5603 => 1.8555, std.dev.: 0.0414) SingleSource/Benchmarks/Shootout/matrix: 18.58% (0.0818 => 0.0970, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/property: 18.43% (0.3886 => 0.4602, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 18.16% (0.3927 => 0.4640, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.80% (0.3826 => 0.4507, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.14% (0.0770 => 0.0902, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: 17.10% (0.3473 => 0.4067, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 17.06% (0.0592 => 0.0693, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-3: 17.04% (0.3516 => 0.4115, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 17.02% (0.4636 => 0.5425, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-4: 16.99% (0.3543 => 0.4145, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.99% (0.3543 => 0.4145, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 16.72% (0.3092 => 0.3609, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.69% (0.3865 => 0.4510, std.dev.: 0.0137) MultiSource/Benchmarks/Olden/mst/mst: 16.60% (0.1163 => 0.1356, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/synchronized: 16.48% (0.3561 => 0.4148, std.dev.: 0.0027) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.36% (0.1143 => 0.1330, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions: 16.17% (0.3828 => 0.4447, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.05% (0.0648 => 0.0752, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/for-in: 15.94% (0.3694 => 0.4283, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/09-vor/vor: 15.94% (0.3180 => 0.3687, std.dev.: 0.0156) MultiSource/Applications/aha/aha: 15.90% (0.1151 => 0.1334, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 15.82% (1.1642 => 1.3484, std.dev.: 0.0222) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.81% (0.2758 => 0.3194, std.dev.: 0.0153) SingleSource/UnitTests/ObjC/exceptions-2: 15.76% (0.3497 => 0.4048, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/health/health: 15.69% (0.1268 => 0.1467, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.69% (0.3136 => 0.3628, std.dev.: 0.0084) MultiSource/Applications/viterbi/viterbi: 15.56% (0.1555 => 0.1797, std.dev.: 0.0090) SingleSource/UnitTests/SignlessTypes/rem: 15.47% (0.1144 => 0.1321, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.45% (0.0770 => 0.0889, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 15.30% (0.3282 => 0.3784, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/sieve: 15.18% (0.3603 => 0.4150, std.dev.: 0.0114) SingleSource/Benchmarks/CoyoteBench/lpbench: 15.18% (0.0929 => 0.1070, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/exptree: 14.99% (0.0814 => 0.0936, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.85% (0.5569 => 0.6396, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/lists: 14.76% (0.3422 => 0.3927, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.73% (0.1337 => 0.1534, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.71% (0.5981 => 0.6861, std.dev.: 0.0287) MultiSource/Benchmarks/mafft/pairlocalalign: 14.69% (9.4845 => 10.8774, std.dev.: 0.3024) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.63% (0.0834 => 0.0956, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.58% (0.3307 => 0.3789, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/hash: 14.48% (0.4289 => 0.4910, std.dev.: 0.0197) SingleSource/UnitTests/ObjC++/property-reference-object: 14.44% (0.6030 => 0.6901, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: 14.44% (0.1655 => 0.1894, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.44% (0.5860 => 0.6706, std.dev.: 0.0328) SingleSource/UnitTests/ObjC++/property-reference: 14.35% (0.7326 => 0.8377, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.19% (0.1029 => 0.1175, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 14.15% (0.3441 => 0.3928, std.dev.: 0.0120) MultiSource/Applications/lua/lua: 14.11% (3.8723 => 4.4188, std.dev.: 0.1427) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 14.09% (2.2024 => 2.5127, std.dev.: 0.0756) SingleSource/UnitTests/ObjC++/Hello: 13.97% (0.5925 => 0.6753, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 13.91% (0.3177 => 0.3619, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.89% (1.5415 => 1.7556, std.dev.: 0.0589) SingleSource/Regression/C++/ofstream_ctor: 13.73% (0.2905 => 0.3304, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.61% (4.2646 => 4.8449, std.dev.: 0.1757) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.60% (0.3935 => 0.4470, std.dev.: 0.0155) MultiSource/Benchmarks/nbench/nbench: 13.33% (1.1840 => 1.3418, std.dev.: 0.0350) SingleSource/Benchmarks/Shootout-C++/moments: 13.04% (0.4048 => 0.4576, std.dev.: 0.0204) MultiSource/Applications/lemon/lemon: 12.94% (1.0722 => 1.2109, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 12.88% (0.4620 => 0.5215, std.dev.: 0.0228) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.86% (0.1625 => 0.1834, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.68% (0.8101 => 0.9128, std.dev.: 0.0179) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.57% (4.9449 => 5.5667, std.dev.: 0.2216) SingleSource/Benchmarks/Shootout-C++/nestedloop: 12.42% (0.2793 => 0.3140, std.dev.: 0.0111) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.29% (0.0838 => 0.0941, std.dev.: 0.0025) SingleSource/Benchmarks/Stanford/Puzzle: 11.99% (0.1268 => 0.1420, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: 11.43% (0.8921 => 0.9941, std.dev.: 0.0243) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.21% (0.1892 => 0.2104, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 11.11% (1.4186 => 1.5762, std.dev.: 0.0497) SingleSource/Benchmarks/Shootout-C++/hello: 10.50% (0.2714 => 0.2999, std.dev.: 0.0065) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.38% (7.9617 => 8.7878, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/lists1: 10.18% (0.3684 => 0.4059, std.dev.: 0.0046) MultiSource/Benchmarks/PAQ8p/paq8p: 9.48% (10.3673 => 11.3501, std.dev.: 0.3345) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.09% (0.3817 => 0.4164, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 8.44% (0.2049 => 0.2222, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.24% (0.2756 => 0.2983, std.dev.: 0.0085) Performance Regressions - Execution Time ---------------------------------------- SingleSource/UnitTests/ObjC/synchronized: 186.11% (0.1051 => 0.3007, std.dev.: 0.0518) SingleSource/Benchmarks/Shootout/methcall: 148.34% (4.3953 => 10.9154, std.dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/methcall: 146.84% (5.3999 => 13.3292, std.dev.: 0.0240) MultiSource/Benchmarks/llubenchmark/llu: 135.17% (3.7781 => 8.8848, std.dev.: 0.0389) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 44.47% (0.3256 => 0.4704, std.dev.: 0.0108) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 39.29% (13.4384 => 18.7189, std.dev.: 0.1453) MultiSource/Benchmarks/McCat/09-vor/vor: 32.41% (0.1154 => 0.1528, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 32.00% (1.5086 => 1.9913, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 24.94% (1.3045 => 1.6299, std.dev.: 0.0589) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.64% (1.1145 => 1.2999, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/oourafft: 16.12% (6.6465 => 7.7180, std.dev.: 0.0127) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.94% (0.2944 => 0.3325, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.90% (2.0360 => 2.2783, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.64% (2.8904 => 3.2269, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: 10.17% (1.1396 => 1.2555, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.27% (1.7254 => 1.8853, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.34% (3.1578 => 3.4213, std.dev.: 0.0948) SingleSource/Benchmarks/Misc/ffbench: 7.51% (0.9505 => 1.0219, std.dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.77% (4.2280 => 4.4718, std.dev.: 0.0062) MultiSource/Benchmarks/Fhourstones/fhourstones: 5.58% (1.8329 => 1.9352, std.dev.: 0.0026) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 5.11% (1.9405 => 2.0397, std.dev.: 0.0277) MultiSource/Applications/lua/lua: 4.65% (26.0924 => 27.3056, std.dev.: 0.4343) MultiSource/Benchmarks/nbench/nbench: 4.10% (11.6436 => 12.1215, std.dev.: 0.0071) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.32% (0.4162 => 0.4300, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.90% (2.1424 => 2.2046, std.dev.: 0.0105) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.16% (1.3677 => 1.3972, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 2.13% (85.0658 => 86.8746, std.dev.: 0.0164) MultiSource/Applications/aha/aha: 2.05% (3.1595 => 3.2243, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.36% (6.5088 => 6.5970, std.dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0502, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1682, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.58% (5.2763 => 1.2357, std.dev.: 0.0226) SingleSource/Benchmarks/Misc/salsa20: -75.22% (0.8651 => 0.2144, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: -44.45% (0.1622 => 0.0901, std.dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: -11.85% (10.4361 => 9.1997, std.dev.: 0.3889) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.59% (5.3526 => 4.7320, std.dev.: 0.1830) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.28% (5.3855 => 4.9396, std.dev.: 0.0670) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -68.44% (32.5116 => 10.2606, std.dev.: 0.0075) SingleSource/Benchmarks/Dhrystone/fldry: -64.94% (1.9577 => 0.6863, std.dev.: 0.0084) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1681, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.33% (0.3987 => 0.2379, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.30% (4.5009 => 2.7772, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.12% (2.6546 => 2.0142, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -19.25% (0.2161 => 0.1745, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4228, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2838, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -10.71% (1.5373 => 1.3727, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -10.05% (9.5636 => 8.6020, std.dev.: 0.1803) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.85% (1.5660 => 1.4274, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.18% (19.9488 => 18.3177, std.dev.: 0.3097) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4793, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.61% (0.3463 => 0.3234, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.60% (3.2416 => 3.0601, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.57% (2.7294 => 2.5775, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.95% (0.8614 => 0.8188, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.93% (0.2497 => 0.2374, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -4.73% (1.5835 => 1.5086, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -4.30% (6.2999 => 6.0288, std.dev.: 0.0631) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.52% (1.6805 => 1.6214, std.dev.: 0.0136) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.30% (0.9957 => 0.9628, std.dev.: 0.0100) MultiSource/Benchmarks/sim/sim: -3.05% (5.0483 => 4.8945, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.72% (0.4808 => 0.4677, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6771, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.64% (8.1563 => 8.0227, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/salsa20: -1.47% (10.2830 => 10.1318, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.75% (0.1485 => 0.1355, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.05% (0.2116 => 0.0655, std.dev.: 0.0025) Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 16:38:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 18:38:28 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121130003828.05C3E2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6397?compare_to=6394&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6397, Order: 168950, Start Time: 2012-11-29 23:03:18, End Time: 2012-11-30 00:39:04 To: 6394, Order: 168935, Start Time: 2012-11-29 21:06:33, End Time: 2012-11-29 22:43:51 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 30 (78 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (51 on baseline) Existing Failures: 42 (40 on baseline) Unchanged Tests: 1021 (859 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 44.42% (0.0914 => 0.1320, std.dev.: 0.0101) MultiSource/Benchmarks/McCat/18-imp/imp: 24.53% (0.3600 => 0.4483, std.dev.: 0.0257) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.72% (0.2035 => 0.2477, std.dev.: 0.0130) MultiSource/Benchmarks/McCat/05-eks/eks: 20.21% (0.4464 => 0.5366, std.dev.: 0.0302) MultiSource/Applications/ClamAV/clamscan: 10.16% (15.3737 => 16.9354, std.dev.: 0.3322) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 9.51% (0.1335 => 0.1462, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 9.30% (17.8823 => 19.5462, std.dev.: 0.1209) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.90% (1.0473 => 1.0986, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 4.04% (0.7122 => 0.7410, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary2: 3.96% (0.2576 => 0.2678, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel24: 43.02% (0.1869 => 0.2673, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/ft/ft: 39.57% (0.8795 => 1.2275, std.dev.: 0.0825) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 38.17% (0.0262 => 0.0362, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 32.52% (0.6455 => 0.8554, std.dev.: 0.0777) MultiSource/Benchmarks/Fhourstones/fhourstones: 27.48% (1.2569 => 1.6023, std.dev.: 0.0672) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 17.49% (1.2398 => 1.4566, std.dev.: 0.0275) SingleSource/Benchmarks/Misc/flops: 17.23% (7.5645 => 8.8681, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.19% (3.6547 => 4.0636, std.dev.: 0.1439) MultiSource/Benchmarks/llubenchmark/llu: 8.66% (1.9997 => 2.1728, std.dev.: 0.0213) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 6.65% (45.6340 => 48.6691, std.dev.: 0.5910) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.56% (2.5935 => 2.7377, std.dev.: 0.0460) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 5.06% (3.0742 => 3.2297, std.dev.: 0.0419) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.83% (22.0175 => 23.0808, std.dev.: 0.2023) SingleSource/Benchmarks/Misc/pi: 4.34% (2.1189 => 2.2108, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/health/health: 4.11% (0.3457 => 0.3599, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.56% (4.0313 => 4.1343, std.dev.: 0.0219) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.54% (0.5679 => 0.5823, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.30% (39.1561 => 40.0577, std.dev.: 0.1379) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.91% (1.0974 => 1.1184, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.21% (5.8694 => 5.9406, std.dev.: 0.0172) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -17.49% (0.0589 => 0.0486, std.dev.: 0.0014) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 19.91% (1.0645 => 1.2764, std.dev.: 0.1228) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.37% (0.3894 => 0.3724, std.dev.: 0.0145) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.78% (0.0225 => 0.0221, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.07% (0.0435 => 0.0426, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.83% (0.0382 => 0.0333, std.dev.: 0.0094) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.68% (0.0326 => 0.0314, std.dev.: 0.0064) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.30% (0.0435 => 0.0425, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: -4.72% (0.0212 => 0.0202, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/test1: -7.66% (0.0235 => 0.0217, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 5.68% (0.1478 => 0.1562, std.dev.: 0.0063) MultiSource/Applications/lemon/lemon: 5.04% (1.1826 => 1.2422, std.dev.: 0.1647) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.83% (0.3991 => 0.4104, std.dev.: 0.1322) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.54% (0.1467 => 0.1519, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.46% (0.0635 => 0.0657, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0278 => 0.0279, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.66% (0.0601 => 0.0561, std.dev.: 0.0158) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.17% (1.1491 => 1.1855, std.dev.: 0.0300) MultiSource/Benchmarks/SciMark2-C/scimark2: 0.12% (9.3923 => 9.4033, std.dev.: 0.0193) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 114.29% (0.0014 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.17% (0.0605 => 0.0606, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.44% (0.0264 => 0.0247, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.21% (0.8183 => 0.8084, std.dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 65.15% (0.0066 => 0.0109, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -75.03% (34.5003 => 8.6149, std.dev.: 0.0246) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Benchmarks/SciMark2-C/scimark2: -67.10% (28.5821 => 9.4033, std.dev.: 0.0193) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 18.85% (16.4461 => 19.5462, std.dev.: 0.1209) MultiSource/Applications/sqlite3/sqlite3: 2474.84% (0.6332 => 16.3039, std.dev.: 0.4333) MultiSource/Benchmarks/McCat/08-main/main: 57.35% (0.1831 => 0.2881, std.dev.: 0.0308) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.26% (0.1559 => 0.1563, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7209.00% (0.3123 => 22.8260, std.dev.: 0.5406) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1610.50% (0.3344 => 5.7199, std.dev.: 0.4801) SingleSource/Benchmarks/Misc-C++/Large/ray: 40.74% (0.2364 => 0.3327, std.dev.: 0.0301) SingleSource/Benchmarks/Misc-C++/bigfib: 7.49% (0.6010 => 0.6460, std.dev.: 0.0467) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.70% (0.3266 => 0.3452, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/strcat: 5.79% (0.1969 => 0.2083, std.dev.: 0.0026) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.04% (0.0224 => 0.0242, std.dev.: 0.0048) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0569, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 9.64% (0.1462 => 0.1603, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4636, std.dev.: 0.0299) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0783, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4959, std.dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5216, std.dev.: 0.0147) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3194, std.dev.: 0.0168) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0754, std.dev.: 0.0348) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3625, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3904, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0792, std.dev.: 0.0031) SingleSource/Regression/C/uint64_to_float: -29.90% (2.1832 => 1.5304, std.dev.: 0.0026) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 59.04% (0.0830 => 0.1320, std.dev.: 0.0101) MultiSource/Benchmarks/Ptrdist/ft/ft: 30.03% (0.1905 => 0.2477, std.dev.: 0.0130) SingleSource/Regression/C/casts: 29.33% (0.0341 => 0.0441, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/18-imp/imp: 27.98% (0.3503 => 0.4483, std.dev.: 0.0257) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.06% (0.2180 => 0.2661, std.dev.: 0.0122) MultiSource/Benchmarks/McCat/05-eks/eks: 22.04% (0.4397 => 0.5366, std.dev.: 0.0302) MultiSource/Applications/ClamAV/clamscan: 14.67% (14.7684 => 16.9354, std.dev.: 0.3322) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 13.60% (0.1287 => 0.1462, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.28% (0.1137 => 0.1288, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.17% (3.1832 => 3.6023, std.dev.: 0.0322) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 12.30% (2.1401 => 2.4034, std.dev.: 0.0549) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 10.88% (0.9908 => 1.0986, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.37% (0.8331 => 0.9195, std.dev.: 0.0240) MultiSource/Benchmarks/sim/sim: 10.20% (0.3226 => 0.3555, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/neural/neural: 9.44% (0.1440 => 0.1576, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 9.02% (1.2222 => 1.3325, std.dev.: 0.0351) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.48% (0.4127 => 0.4477, std.dev.: 0.0093) MultiSource/Applications/minisat/minisat: 8.43% (0.6834 => 0.7410, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.30% (0.8518 => 0.9225, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.85% (0.8177 => 0.8819, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.48% (0.8317 => 0.8939, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.39% (0.8712 => 0.9356, std.dev.: 0.0129) MultiSource/Applications/SPASS/SPASS: 7.27% (14.2605 => 15.2972, std.dev.: 0.3717) MultiSource/Applications/oggenc/oggenc: 6.96% (4.9628 => 5.3083, std.dev.: 0.1258) SingleSource/Benchmarks/Shootout-C++/ary2: 6.74% (0.2509 => 0.2678, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.17% (0.3717 => 0.3909, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 56.71% (0.0231 => 0.0362, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 42.60% (3.0515 => 4.3515, std.dev.: 0.2401) SingleSource/Benchmarks/Misc/pi: 39.97% (1.5795 => 2.2108, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ft/ft: 39.66% (0.8789 => 1.2275, std.dev.: 0.0825) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 30.24% (2.9096 => 3.7895, std.dev.: 0.0575) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.96% (1.2822 => 1.6023, std.dev.: 0.0672) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.25% (4.8436 => 5.8729, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.65% (8.2783 => 9.8218, std.dev.: 0.0103) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 18.07% (1.2337 => 1.4566, std.dev.: 0.0275) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.82% (0.7597 => 0.8951, std.dev.: 0.0483) SingleSource/Benchmarks/McGill/misr: 16.92% (0.4001 => 0.4678, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.34% (14.6451 => 17.0382, std.dev.: 0.3142) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.63% (0.1129 => 0.1249, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 10.57% (7.4933 => 8.2854, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.31% (6.3772 => 7.0344, std.dev.: 0.0781) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.17% (1.1857 => 1.3063, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 9.22% (44.5605 => 48.6691, std.dev.: 0.5910) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 9.13% (3.9917 => 4.3560, std.dev.: 0.0630) MultiSource/Benchmarks/llubenchmark/llu: 8.82% (1.9967 => 2.1728, std.dev.: 0.0213) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.34% (23.5781 => 25.3095, std.dev.: 0.0718) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 6.29% (4.8660 => 5.1720, std.dev.: 0.0399) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.26% (2.5763 => 2.7377, std.dev.: 0.0460) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.19% (2.9753 => 3.1596, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.10% (3.3761 => 3.5820, std.dev.: 0.0336) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.87% (59.2638 => 62.7410, std.dev.: 1.0205) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.83% (4.5327 => 4.7970, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.69% (5.4187 => 5.7272, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 5.47% (0.5214 => 0.5499, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.33% (0.3937 => 0.4147, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 4.85% (0.4353 => 0.4564, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 4.75% (3.3398 => 3.4984, std.dev.: 0.0225) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 4.55% (4.8362 => 5.0563, std.dev.: 0.0402) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 4.43% (5.3218 => 5.5575, std.dev.: 0.0444) SingleSource/Benchmarks/Misc/whetstone: 4.11% (2.1224 => 2.2096, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/bh/bh: 3.67% (2.3560 => 2.4425, std.dev.: 0.0287) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.50% (22.2997 => 23.0808, std.dev.: 0.2023) MultiSource/Benchmarks/Olden/power/power: 3.40% (1.2061 => 1.2471, std.dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.36% (3.4104 => 3.4908, std.dev.: 0.0281) SingleSource/Benchmarks/Dhrystone/dry: 2.24% (0.5081 => 0.5195, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.17% (39.2082 => 40.0577, std.dev.: 0.1379) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.15% (4.0473 => 4.1343, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.13% (11.5690 => 11.8154, std.dev.: 0.0032) MultiSource/Applications/spiff/spiff: 1.76% (2.8561 => 2.9065, std.dev.: 0.0091) SingleSource/Benchmarks/McGill/queens: 1.73% (1.7056 => 1.7351, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.71% (1.5941 => 1.6214, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.69% (1.0998 => 1.1184, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.69% (5.8421 => 5.9406, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.67% (3.7781 => 3.8411, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout/methcall: 1.61% (8.2676 => 8.4009, std.dev.: 0.0212) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.23% (1.9302 => 1.9539, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.17% (6.7533 => 6.8324, std.dev.: 0.0184) SingleSource/Benchmarks/Misc-C++/mandel-text: 1.06% (1.8231 => 1.8425, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.22% (2.8951 => 1.6728, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -24.95% (7.2130 => 5.4135, std.dev.: 0.0892) MultiSource/Benchmarks/Ptrdist/ks/ks: -18.68% (1.4529 => 1.1815, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.83% (9.9065 => 8.2394, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/ary3: -13.34% (1.9999 => 1.7332, std.dev.: 0.0978) MultiSource/Benchmarks/Olden/em3d/em3d: -12.61% (5.4641 => 4.7750, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/flops-8: -9.14% (2.5609 => 2.3268, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: -9.09% (63.1822 => 57.4371, std.dev.: 0.1423) SingleSource/Benchmarks/McGill/chomp: -8.82% (1.1216 => 1.0227, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.29% (0.3269 => 0.2998, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.87% (1.0512 => 0.9685, std.dev.: 0.0255) SingleSource/Benchmarks/Shootout/sieve: -6.27% (7.0599 => 6.6174, std.dev.: 0.0404) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.20% (4.7482 => 4.4538, std.dev.: 0.0412) SingleSource/Benchmarks/Stanford/FloatMM: -6.12% (0.8807 => 0.8268, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.95% (5.1305 => 4.8252, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops: -5.40% (9.3748 => 8.8681, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.32% (6.2275 => 5.8959, std.dev.: 0.0624) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.90% (2.8773 => 2.7363, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.81% (5.6343 => 5.3633, std.dev.: 0.0416) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.35% (4.9453 => 4.7301, std.dev.: 0.0224) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.16% (4.7449 => 4.5477, std.dev.: 0.0577) SingleSource/Benchmarks/Misc/perlin: -3.62% (5.1084 => 4.9233, std.dev.: 0.0222) SingleSource/Benchmarks/Shootout-C++/methcall: -3.60% (8.9760 => 8.6533, std.dev.: 0.0226) MultiSource/Applications/siod/siod: -3.56% (3.6643 => 3.5340, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.55% (5.1557 => 4.9728, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.49% (3.7148 => 3.5852, std.dev.: 0.0426) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.25% (4.9686 => 4.8071, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -2.92% (5.4300 => 5.2713, std.dev.: 0.0289) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.67% (1.3882 => 1.3512, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.54% (2.6356 => 2.5686, std.dev.: 0.0212) SingleSource/Benchmarks/Misc/himenobmtxpa: -2.30% (4.3552 => 4.2551, std.dev.: 0.0224) SingleSource/Benchmarks/Misc/fbench: -2.15% (3.3840 => 3.3111, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/flops-5: -1.96% (2.8957 => 2.8388, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: -1.81% (0.6910 => 0.6785, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/fp-convert: -1.67% (15.8853 => 15.6207, std.dev.: 0.0360) MultiSource/Benchmarks/FreeBench/neural/neural: -1.35% (1.0841 => 1.0695, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 24.38% (1.0262 => 1.2764, std.dev.: 0.1228) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.20% (0.2463 => 0.3724, std.dev.: 0.0145) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 79.67% (0.0123 => 0.0221, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0094) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0064) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 8.62% (0.1438 => 0.1562, std.dev.: 0.0063) MultiSource/Applications/lemon/lemon: 9.65% (1.1329 => 1.2422, std.dev.: 0.1647) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.44% (0.4164 => 0.4104, std.dev.: 0.1322) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.96% (0.1369 => 0.1519, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.50% (0.0641 => 0.0657, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 43.08% (0.0195 => 0.0279, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.94% (0.0578 => 0.0561, std.dev.: 0.0158) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.65% (1.1437 => 1.1855, std.dev.: 0.0300) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.35% (0.0627 => 0.0606, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 37.22% (0.0180 => 0.0247, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.84% (0.8017 => 0.8084, std.dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 75.81% (0.0062 => 0.0109, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 16:49:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 18:49:32 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121130004932.259312A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/6398?compare_to=6395&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6398, Order: 168950, Start Time: 2012-11-29 23:17:35, End Time: 2012-11-30 00:50:07 To: 6395, Order: 168935, Start Time: 2012-11-29 21:20:54, End Time: 2012-11-29 22:54:27 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (6 on baseline) Performance Improvements: 1 (187 on baseline) Added Tests: 0 (52 on baseline) Unchanged Tests: 1093 (849 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops: -75.00% (26.5112 => 6.6289, std.dev.: 0.0084) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 12.02% (0.3834 => 0.4295, std.dev.: 0.0090) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.72% (54.5751 => 56.6041, std.dev.: 0.1548) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.89% (2.0478 => 2.1070, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/salsa20: 2.48% (7.4937 => 7.6798, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash2: 2.16% (3.1932 => 3.2622, std.dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.53% (0.1431 => 0.1309, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.67% (0.3821 => 0.3528, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.33% (0.9542 => 0.8843, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -6.90% (2.4924 => 2.3205, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.78% (0.3142 => 0.2929, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.47% (0.2428 => 0.2271, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.39% (0.3884 => 0.3636, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -6.34% (0.3831 => 0.3588, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -6.34% (0.3880 => 0.3634, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -6.29% (0.3848 => 0.3606, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.27% (0.3812 => 0.3573, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -6.26% (0.3896 => 0.3652, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.17% (0.4033 => 0.3784, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.17% (0.6484 => 0.6084, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions: -6.15% (0.4176 => 0.3919, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.12% (0.3891 => 0.3653, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.03% (0.7198 => 0.6764, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.02% (0.3057 => 0.2873, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: -6.01% (0.1879 => 0.1766, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -5.99% (16.1920 => 15.2221, std.dev.: 0.0111) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.99% (0.2355 => 0.2214, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.96% (0.1796 => 0.1689, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.89% (0.1716 => 0.1615, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.86% (1.3722 => 1.2918, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: -5.86% (9.2283 => 8.6877, std.dev.: 0.0079) SingleSource/Benchmarks/McGill/chomp: -5.85% (0.1761 => 0.1658, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: -5.84% (7.0961 => 6.6816, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.83% (0.9852 => 0.9278, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.82% (1.0544 => 0.9930, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.78% (0.6052 => 0.5702, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.78% (0.5591 => 0.5268, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -5.77% (0.9179 => 0.8649, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.77% (0.5805 => 0.5470, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -5.76% (0.4199 => 0.3957, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.70% (0.5802 => 0.5471, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.70% (4.8161 => 4.5415, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.70% (0.5478 => 0.5166, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.69% (1.2300 => 1.1600, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.69% (0.3658 => 0.3450, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -5.68% (1.3148 => 1.2401, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: -5.68% (0.2871 => 0.2708, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.68% (0.6395 => 0.6032, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.67% (0.5925 => 0.5589, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.67% (0.3016 => 0.2845, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.67% (0.6194 => 0.5843, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.66% (4.0323 => 3.8039, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/matrix: -5.65% (0.3255 => 0.3071, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.65% (2.1713 => 2.0486, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.65% (0.6676 => 0.6299, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -5.63% (0.3357 => 0.3168, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.63% (0.5863 => 0.5533, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.62% (0.5859 => 0.5530, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.61% (0.5581 => 0.5268, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.60% (4.8802 => 4.6067, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.60% (0.3837 => 0.3622, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.60% (0.6304 => 0.5951, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.59% (0.5705 => 0.5386, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.59% (0.6260 => 0.5910, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.59% (0.5941 => 0.5609, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.58% (0.2903 => 0.2741, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.58% (1.2784 => 1.2071, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.57% (0.6297 => 0.5946, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.57% (0.3931 => 0.3712, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.57% (0.2695 => 0.2545, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.57% (0.3252 => 0.3071, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.56% (0.6189 => 0.5845, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: -5.54% (0.3194 => 0.3017, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.54% (0.4151 => 0.3921, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.54% (0.5849 => 0.5525, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.54% (0.6230 => 0.5885, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.54% (0.6033 => 0.5699, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.54% (0.5456 => 0.5154, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (0.5857 => 0.5533, std.dev.: 0.0065) SingleSource/Regression/C++/ofstream_ctor: -5.52% (0.3059 => 0.2890, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wc: -5.52% (0.3205 => 0.3028, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -5.52% (0.3025 => 0.2858, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -5.51% (0.4280 => 0.4044, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -5.51% (4.3330 => 4.0941, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.51% (0.6681 => 0.6313, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.51% (0.5575 => 0.5268, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.51% (0.7919 => 0.7483, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.50% (0.8521 => 0.8052, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.50% (0.7524 => 0.7110, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.50% (1.6364 => 1.5464, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.49% (0.5570 => 0.5264, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.49% (0.7339 => 0.6936, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: -5.49% (0.3026 => 0.2860, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.48% (4.5069 => 4.2599, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.48% (0.3323 => 0.3141, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.47% (1.4642 => 1.3841, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.47% (0.6440 => 0.6088, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.45% (3.5339 => 3.3412, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.45% (0.6736 => 0.6369, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.43% (0.6293 => 0.5951, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.43% (14.2083 => 13.4369, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.42% (0.2933 => 0.2774, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: -5.41% (1.1530 => 1.0906, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.40% (0.6446 => 0.6098, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: -5.40% (0.3446 => 0.3260, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.39% (0.6395 => 0.6050, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -5.39% (0.2989 => 0.2828, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -5.38% (0.2939 => 0.2781, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -5.37% (0.3481 => 0.3294, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -5.37% (0.2160 => 0.2044, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.37% (0.4321 => 0.4089, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.37% (0.5569 => 0.5270, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/ary: -5.36% (0.3394 => 0.3212, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.36% (6.7716 => 6.4088, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/08-main/main: -5.34% (0.2659 => 0.2517, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.34% (0.5567 => 0.5270, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -5.32% (0.4515 => 0.4275, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: -5.30% (0.2849 => 0.2698, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.30% (0.2548 => 0.2413, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: -5.29% (1.1450 => 1.0844, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.27% (0.3849 => 0.3646, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.26% (0.5688 => 0.5389, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.21% (1.2210 => 1.1574, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: -5.21% (1.3864 => 1.3142, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.20% (0.3483 => 0.3302, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.16% (8.0126 => 7.5993, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: -5.14% (0.4861 => 0.4611, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -5.14% (0.3406 => 0.3231, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.13% (0.4916 => 0.4664, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.12% (0.5999 => 0.5692, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.11% (1.2221 => 1.1596, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: -5.11% (0.4248 => 0.4031, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -5.10% (17.1032 => 16.2309, std.dev.: 0.0121) MultiSource/Applications/SPASS/SPASS: -5.09% (15.5079 => 14.7192, std.dev.: 0.0244) SingleSource/Benchmarks/Shootout-C++/lists: -5.08% (0.3621 => 0.3437, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.07% (0.2999 => 0.2847, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -5.00% (3.5154 => 3.3397, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: -5.00% (0.4524 => 0.4298, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -4.99% (0.3867 => 0.3674, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.99% (0.4813 => 0.4573, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: -4.97% (0.3581 => 0.3403, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -4.97% (1.2515 => 1.1893, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.96% (0.2278 => 0.2165, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.87% (0.6667 => 0.6342, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: -4.86% (0.2985 => 0.2840, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.85% (0.4083 => 0.3885, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -4.84% (15.2527 => 14.5144, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.82% (0.2385 => 0.2270, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -4.72% (34.0927 => 32.4839, std.dev.: 0.0098) MultiSource/Applications/lua/lua: -4.71% (4.0594 => 3.8681, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.70% (0.4427 => 0.4219, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -4.67% (0.7447 => 0.7099, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.65% (0.6660 => 0.6350, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sieve: -4.65% (0.3788 => 0.3612, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.64% (0.5168 => 0.4928, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.64% (0.9557 => 0.9114, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.56% (0.7779 => 0.7424, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.56% (0.3271 => 0.3122, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (0.7021 => 0.6702, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: -4.52% (5.0226 => 4.7954, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.52% (0.5329 => 0.5088, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.52% (22.4056 => 21.3926, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.43% (1.6474 => 1.5745, std.dev.: 0.0047) MultiSource/Applications/treecc/treecc: -4.43% (2.1401 => 2.0454, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -4.40% (0.7982 => 0.7631, std.dev.: 0.0014) MultiSource/Applications/siod/siod: -4.37% (2.4021 => 2.2972, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.34% (0.3319 => 0.3175, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: -4.28% (18.2933 => 17.5095, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/bigfib: -4.28% (0.6750 => 0.6461, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: -4.18% (0.6347 => 0.6082, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.05% (0.8418 => 0.8077, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.03% (0.9077 => 0.8711, std.dev.: 0.0017) MultiSource/Applications/hbd/hbd: -3.94% (1.5610 => 1.4995, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.92% (0.3491 => 0.3354, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.74% (2.2587 => 2.1743, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: -3.56% (0.6441 => 0.6212, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.83% (20.7746 => 20.1871, std.dev.: 0.1778) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.78% (5.4682 => 5.3163, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -67.52% (31.3723 => 10.1883, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/fldry: -61.07% (1.8100 => 0.7046, std.dev.: 0.0178) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7518, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -8.68% (1.2842 => 1.1727, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.49% (2.2633 => 2.1842, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3991, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4707, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 17:20:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 19:20:19 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121130012019.A87EE2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/6399?compare_to=6393&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6399, Order: 168937, Start Time: 2012-11-29 21:54:04, End Time: 2012-11-30 01:20:52 To: 6393, Order: 168900, Start Time: 2012-11-29 17:38:21, End Time: 2012-11-29 21:05:22 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (178 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (186 on baseline) Unchanged Tests: 1094 (713 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.88% (0.0625 => 0.0893, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.77% (0.1063 => 0.1422, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 28.63% (0.0475 => 0.0611, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.25% (0.2969 => 0.3778, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.85% (0.1106 => 0.1403, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.61% (0.0714 => 0.0904, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.60% (0.4139 => 0.5240, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 26.10% (1.5932 => 2.0090, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.83% (0.5900 => 0.7424, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.69% (0.4994 => 0.6277, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 25.32% (0.0541 => 0.0678, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.00% (0.0584 => 0.0730, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.90% (0.4253 => 0.5312, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.82% (0.0415 => 0.0518, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.28% (0.5000 => 0.6214, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.14% (0.1620 => 0.2011, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.77% (0.0547 => 0.0677, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.58% (0.1107 => 0.1368, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.51% (0.1021 => 0.1261, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 22.87% (0.0599 => 0.0736, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.74% (0.0897 => 0.1101, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.53% (0.1549 => 0.1898, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.43% (0.0633 => 0.0775, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.26% (0.0584 => 0.0714, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.12% (0.0642 => 0.0784, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 22.05% (0.0948 => 0.1157, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.85% (0.1103 => 0.1344, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.65% (0.0822 => 0.1000, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.62% (0.0495 => 0.0602, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.50% (0.3903 => 0.4742, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.34% (0.1003 => 0.1217, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/health/health: 21.32% (0.0821 => 0.0996, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 21.31% (0.1619 => 0.1964, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 21.12% (0.0947 => 0.1147, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 21.03% (0.0604 => 0.0731, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.89% (0.1604 => 0.1939, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.97% (0.1462 => 0.1754, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 19.93% (0.0808 => 0.0969, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.91% (0.2014 => 0.2415, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.67% (0.3890 => 0.4655, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 19.64% (0.5826 => 0.6970, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.36% (0.1968 => 0.2349, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.33% (0.2866 => 0.3420, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 19.29% (0.1218 => 0.1453, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 19.27% (0.5889 => 0.7024, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.18% (1.3152 => 1.5675, std.dev.: 0.0077) MultiSource/Applications/spiff/spiff: 19.14% (0.4029 => 0.4800, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 19.05% (0.0698 => 0.0831, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.01% (0.2736 => 0.3256, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.85% (3.5627 => 4.2344, std.dev.: 0.0095) MultiSource/Benchmarks/McCat/09-vor/vor: 18.67% (0.1505 => 0.1786, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.66% (0.1088 => 0.1291, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.53% (0.0572 => 0.0678, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.50% (0.3271 => 0.3876, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 18.40% (0.9697 => 1.1481, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.36% (0.4658 => 0.5513, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 18.35% (1.8794 => 2.2243, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.32% (0.0573 => 0.0678, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 18.16% (0.5546 => 0.6553, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.05% (1.6211 => 1.9137, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 17.95% (0.2780 => 0.3279, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.83% (0.5026 => 0.5922, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.80% (2.7292 => 3.2150, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.76% (0.1160 => 0.1366, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.74% (0.2875 => 0.3385, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.69% (0.0605 => 0.0712, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 17.50% (0.2811 => 0.3303, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 17.50% (0.2714 => 0.3189, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.49% (0.2738 => 0.3217, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 17.47% (1.0781 => 1.2664, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 17.45% (0.2750 => 0.3230, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 17.45% (0.1421 => 0.1669, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 17.43% (0.2725 => 0.3200, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.43% (0.4361 => 0.5121, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.41% (0.2792 => 0.3278, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.37% (0.2729 => 0.3203, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.30% (4.4195 => 5.1840, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 17.21% (0.7171 => 0.8405, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.18% (0.3930 => 0.4605, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wc: 17.15% (0.3096 => 0.3627, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 17.09% (0.2803 => 0.3282, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.04% (0.2911 => 0.3407, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 17.00% (0.9909 => 1.1594, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 16.96% (0.2813 => 0.3290, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 16.95% (4.2109 => 4.9248, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.90% (0.3195 => 0.3735, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 16.90% (0.1284 => 0.1501, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 16.90% (0.2823 => 0.3300, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.86% (0.3488 => 0.4076, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.82% (2.0673 => 2.4151, std.dev.: 0.0083) SingleSource/Regression/C++/ofstream_ctor: 16.68% (0.3004 => 0.3505, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 16.65% (0.3267 => 0.3811, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.54% (1.9694 => 2.2952, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary: 16.48% (0.3258 => 0.3795, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.41% (1.9966 => 2.3243, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.33% (0.1090 => 0.1268, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 16.22% (0.3446 => 0.4005, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 16.19% (0.3465 => 0.4026, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 16.13% (0.3496 => 0.4060, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 16.13% (0.3317 => 0.3852, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 16.13% (0.3460 => 0.4018, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 16.12% (0.3442 => 0.3997, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.11% (0.3060 => 0.3553, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 16.06% (0.3469 => 0.4026, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.85% (0.3362 => 0.3895, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 15.81% (0.2075 => 0.2403, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.75% (0.3124 => 0.3616, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 15.67% (0.3643 => 0.4214, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 15.64% (0.3650 => 0.4221, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 15.62% (0.3726 => 0.4308, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 15.55% (0.3678 => 0.4250, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 15.53% (0.3348 => 0.3868, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.48% (0.3282 => 0.3790, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 15.40% (23.5202 => 27.1430, std.dev.: 0.0095) SingleSource/UnitTests/ObjC/parameter-passing: 15.33% (0.3724 => 0.4295, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 15.32% (0.2566 => 0.2959, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 15.27% (0.3477 => 0.4008, std.dev.: 0.0057) MultiSource/Applications/lua/lua: 15.24% (1.4269 => 1.6443, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.09% (0.3625 => 0.4172, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.00% (0.3981 => 0.4578, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 14.85% (2.1653 => 2.4868, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 14.76% (0.4146 => 0.4758, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.74% (0.3690 => 0.4234, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 14.73% (0.4251 => 0.4877, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 14.64% (0.0758 => 0.0869, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 14.59% (0.7875 => 0.9024, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.46% (0.3845 => 0.4401, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 14.44% (2.1013 => 2.4048, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 14.27% (4.6177 => 5.2766, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.12% (0.2040 => 0.2328, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 13.85% (0.5012 => 0.5706, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 13.60% (0.2691 => 0.3057, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.73% (0.1383 => 0.1559, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.71% (0.6435 => 0.7253, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 12.38% (5.5417 => 6.2278, std.dev.: 0.0055) MultiSource/Applications/lambda-0_1_3/lambda: 12.35% (0.3498 => 0.3930, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.90% (0.2068 => 0.2314, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.58% (0.2737 => 0.3054, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.58% (0.1028 => 0.1147, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 11.55% (0.6634 => 0.7400, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: 11.43% (0.4847 => 0.5401, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.25% (0.3084 => 0.3431, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 10.76% (2.0346 => 2.2535, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 10.73% (0.3336 => 0.3694, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 10.58% (0.2391 => 0.2644, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.22% (0.2103 => 0.2318, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.01% (0.5361 => 0.5844, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.81% (11.6398 => 12.6647, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.49% (4.6926 => 5.0911, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.20% (0.5584 => 0.6042, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.05% (0.7426 => 0.8024, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 7.47% (11.9555 => 12.8480, std.dev.: 0.0147) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.57% (0.3792 => 0.4041, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.96% (29.0505 => 33.3977, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 9.42% (0.2802 => 0.3066, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.59% (3.3903 => 3.6136, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary: 6.31% (0.2122 => 0.2256, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6688, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1680, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.61% (79.9355 => 83.6172, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-2: 4.55% (1.8057 => 1.8879, std.dev.: 0.0061) SingleSource/Benchmarks/Dhrystone/dry: 4.17% (14.0481 => 14.6335, std.dev.: 0.0124) MultiSource/Benchmarks/Olden/health/health: 2.77% (0.6276 => 0.6450, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1980, std.dev.: 0.0047) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2231, std.dev.: 0.0046) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3086, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2887, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.19% (8.4155 => 8.5158, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5926, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.74% (25.4195 => 16.5890, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/ary2: -9.08% (0.2402 => 0.2184, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9767, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8011, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8060, std.dev.: 0.0056) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7733, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.74% (17.2379 => 16.7651, std.dev.: 0.0974) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.70% (0.6293 => 0.6123, std.dev.: 0.0047) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8575, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5747, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4952, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (105.3826 => 104.1954, std.dev.: 0.0678) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0452, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 18:36:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 20:36:06 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121130023606.2B2CE2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/6400?compare_to=6397&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6400, Order: 168962, Start Time: 2012-11-30 00:57:43, End Time: 2012-11-30 02:36:40 To: 6397, Order: 168950, Start Time: 2012-11-29 23:03:18, End Time: 2012-11-30 00:39:04 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 1 (28 on baseline) Performance Regressions: 6 (57 on baseline) Performance Improvements: 13 (33 on baseline) Added Tests: 0 (51 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1033 (884 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/SciMark2-C/scimark2: 808.19% (9.4033 => 85.3998, std.dev.: 0.0210) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 24.07% (0.1184 => 0.1469, std.dev.: 0.0033) MultiSource/Applications/hbd/hbd: 18.72% (1.5470 => 1.8366, std.dev.: 0.0753) MultiSource/Applications/lemon/lemon: 2.95% (1.1699 => 1.2044, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 24.72% (1.4993 => 1.8699, std.dev.: 0.0149) MultiSource/Applications/SIBsim4/SIBsim4: 2.46% (3.2398 => 3.3195, std.dev.: 0.0196) MultiSource/Applications/siod/siod: 1.32% (3.5340 => 3.5808, std.dev.: 0.0144) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -18.28% (0.0859 => 0.0702, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -17.81% (0.0932 => 0.0766, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -15.71% (0.3367 => 0.2838, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/bisort/bisort: -15.31% (0.0823 => 0.0697, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/em3d/em3d: -12.66% (0.2117 => 0.1849, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -3.70% (1.7155 => 1.6521, std.dev.: 0.0236) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.29% (0.9841 => 0.9517, std.dev.: 0.0113) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.96% (0.0973 => 0.0808, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.67% (0.3633 => 0.3427, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -3.99% (2.8360 => 2.7229, std.dev.: 0.0277) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.45% (1.1170 => 1.0785, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -2.47% (4.1343 => 4.0323, std.dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.85% (2.4648 => 2.4192, std.dev.: 0.0127) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -14.18% (1.2764 => 1.0954, std.dev.: 0.2729) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.89% (0.3724 => 0.3691, std.dev.: 0.0512) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.45% (0.0221 => 0.0220, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.47% (0.0426 => 0.0424, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.30% (0.0333 => 0.0332, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0314 => 0.0314, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.24% (0.0425 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 1.49% (0.0202 => 0.0205, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 1.38% (0.0217 => 0.0220, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/Burg/burg: 75.00% (0.0008 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -6.08% (0.1562 => 0.1467, std.dev.: 0.0208) MultiSource/Applications/lemon/lemon: 3.80% (1.2422 => 1.2894, std.dev.: 0.4125) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 12.11% (0.4104 => 0.4601, std.dev.: 0.0778) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.63% (0.1519 => 0.1479, std.dev.: 0.0200) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.15% (0.0657 => 0.0656, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.08% (0.0279 => 0.0276, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.70% (0.0561 => 0.0593, std.dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -2.73% (1.1855 => 1.1531, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.33% (0.0606 => 0.0608, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.86% (0.0247 => 0.0259, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.99% (0.8084 => 0.8004, std.dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -50.00% (0.0002 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0001 => 0.0004, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 7.34% (0.0109 => 0.0117, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.24% (8.6149 => 8.6357, std.dev.: 0.0146) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 13.21% (16.4461 => 18.6185, std.dev.: 0.4719) MultiSource/Applications/sqlite3/sqlite3: 2392.07% (0.6332 => 15.7798, std.dev.: 0.5634) MultiSource/Benchmarks/McCat/08-main/main: 60.95% (0.1831 => 0.2947, std.dev.: 0.0545) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.17% (0.1559 => 0.1494, std.dev.: 0.0444) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7148.45% (0.3123 => 22.6369, std.dev.: 1.1526) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1532.48% (0.3344 => 5.4590, std.dev.: 0.3476) SingleSource/Benchmarks/Misc-C++/Large/ray: 39.30% (0.2364 => 0.3293, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/bigfib: 5.14% (0.6010 => 0.6319, std.dev.: 0.0229) SingleSource/Benchmarks/Misc/mandel: 8.62% (0.0429 => 0.0466, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.32% (0.3266 => 0.3407, std.dev.: 0.0250) SingleSource/Benchmarks/Shootout-C++/strcat: 3.45% (0.1969 => 0.2037, std.dev.: 0.0342) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 9.38% (0.0224 => 0.0245, std.dev.: 0.0063) SingleSource/UnitTests/byval-alignment: -29.57% (0.0230 => 0.0162, std.dev.: 0.0067) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0521, std.dev.: 0.0108) MultiSource/Applications/oggenc/oggenc: 12.24% (0.1462 => 0.1641, std.dev.: 0.0263) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4141, std.dev.: 0.0645) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0723, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4941, std.dev.: 0.0926) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5176, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2832, std.dev.: 0.0179) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0736, std.dev.: 0.0660) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3617, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3886, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0816, std.dev.: 0.0363) SingleSource/Regression/C/uint64_to_float: -30.05% (2.1832 => 1.5272, std.dev.: 0.0924) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 33.67% (0.1099 => 0.1469, std.dev.: 0.0033) MultiSource/Applications/hbd/hbd: 28.71% (1.4269 => 1.8366, std.dev.: 0.0753) MultiSource/Benchmarks/McCat/05-eks/eks: 25.54% (0.4397 => 0.5520, std.dev.: 0.0267) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.98% (0.0848 => 0.0992, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.82% (4.4880 => 5.2430, std.dev.: 0.2260) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 12.94% (0.0773 => 0.0873, std.dev.: 0.0034) MultiSource/Applications/lemon/lemon: 10.04% (1.0945 => 1.2044, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.87% (1.5315 => 1.6521, std.dev.: 0.0236) MultiSource/Benchmarks/Olden/em3d/em3d: 7.44% (0.1721 => 0.1849, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.4783 => 0.5076, std.dev.: 0.0083) MultiSource/Applications/minisat/minisat: 5.91% (0.6834 => 0.7238, std.dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.97% (0.5191 => 0.5449, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.88% (0.9074 => 0.9517, std.dev.: 0.0113) MultiSource/Benchmarks/mafft/pairlocalalign: 4.55% (8.6247 => 9.0170, std.dev.: 0.0331) MultiSource/Benchmarks/PAQ8p/paq8p: 4.06% (2.3764 => 2.4728, std.dev.: 0.0297) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.87% (0.6586 => 0.6841, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 198.79% (28.5821 => 85.3998, std.dev.: 0.0210) MultiSource/Benchmarks/Prolangs-C++/city/city: 58.79% (0.0199 => 0.0316, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/pi: 38.42% (1.5795 => 2.1863, std.dev.: 0.0142) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 27.63% (2.9096 => 3.7135, std.dev.: 0.0752) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.20% (4.8436 => 5.8706, std.dev.: 0.0490) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 19.54% (1.2337 => 1.4748, std.dev.: 0.0387) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 19.40% (0.7597 => 0.9071, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.91% (8.2783 => 9.7609, std.dev.: 0.0335) SingleSource/Benchmarks/McGill/misr: 16.97% (0.4001 => 0.4680, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.51% (0.3186 => 0.3712, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.81% (0.1129 => 0.1251, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 10.61% (7.4933 => 8.2885, std.dev.: 0.0246) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.32% (14.6451 => 16.1569, std.dev.: 0.4266) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.06% (1.1857 => 1.3050, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.51% (3.9917 => 4.2916, std.dev.: 0.0833) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.36% (23.5781 => 25.3125, std.dev.: 0.0300) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.34% (3.3761 => 3.5903, std.dev.: 0.0294) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 6.02% (4.8660 => 5.1588, std.dev.: 0.0346) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.76% (4.5327 => 4.7936, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.46% (5.4187 => 5.7148, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 5.35% (0.5214 => 0.5493, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.28% (0.3937 => 0.4145, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.25% (5.3218 => 5.6011, std.dev.: 0.0300) MultiSource/Applications/aha/aha: 5.19% (3.3398 => 3.5131, std.dev.: 0.0531) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 5.01% (0.2015 => 0.2116, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: 4.37% (1.3037 => 1.3607, std.dev.: 0.0106) MultiSource/Applications/SIBsim4/SIBsim4: 4.15% (3.1873 => 3.3195, std.dev.: 0.0196) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.82% (1.0388 => 1.0785, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/power/power: 3.70% (1.2061 => 1.2507, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 3.63% (0.4353 => 0.4511, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.37% (4.8362 => 4.9991, std.dev.: 0.0494) SingleSource/Benchmarks/Dhrystone/dry: 2.83% (0.5081 => 0.5225, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.23% (3.4104 => 3.4866, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout/methcall: 2.15% (8.2676 => 8.4452, std.dev.: 0.0317) SingleSource/Benchmarks/McGill/queens: 1.84% (1.7056 => 1.7369, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.66% (11.5690 => 11.7614, std.dev.: 0.0237) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.49% (41.4238 => 42.0415, std.dev.: 0.1320) SingleSource/Benchmarks/Misc/ReedSolomon: 1.23% (8.5322 => 8.6373, std.dev.: 0.0165) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.20% (1.9302 => 1.9533, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.03% (3.7781 => 3.8171, std.dev.: 0.0068) MultiSource/Benchmarks/sim/sim: 1.03% (3.8206 => 3.8598, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.12% (2.8951 => 1.6758, std.dev.: 0.0962) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -26.68% (7.2130 => 5.2887, std.dev.: 0.0912) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.21% (1.4529 => 1.1593, std.dev.: 0.0574) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.97% (9.9065 => 8.2257, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/em3d/em3d: -12.70% (5.4641 => 4.7703, std.dev.: 0.0218) SingleSource/Benchmarks/Misc/flops-8: -9.83% (2.5609 => 2.3092, std.dev.: 0.0104) SingleSource/Benchmarks/McGill/chomp: -9.63% (1.1216 => 1.0136, std.dev.: 0.0185) MultiSource/Benchmarks/mafft/pairlocalalign: -9.10% (63.1822 => 57.4315, std.dev.: 0.0832) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.17% (4.7482 => 4.4552, std.dev.: 0.0440) SingleSource/Benchmarks/Shootout/sieve: -6.11% (7.0599 => 6.6283, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/flops: -5.56% (9.3748 => 8.8534, std.dev.: 0.0406) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.31% (6.2275 => 5.8967, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.84% (5.6343 => 5.3615, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/ffbench: -4.64% (1.4296 => 1.3633, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.56% (4.7449 => 4.5283, std.dev.: 0.0377) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.44% (4.9453 => 4.7259, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.38% (6.1706 => 5.9005, std.dev.: 0.0287) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.86% (2.8773 => 2.7661, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/perlin: -3.79% (5.1084 => 4.9146, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.63% (5.1557 => 4.9684, std.dev.: 0.0323) SingleSource/Benchmarks/Shootout-C++/methcall: -3.40% (8.9760 => 8.6707, std.dev.: 0.0359) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.39% (1.3882 => 1.3412, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.20% (5.4300 => 5.2564, std.dev.: 0.0268) MultiSource/Benchmarks/Prolangs-C++/life/life: -3.01% (2.6356 => 2.5564, std.dev.: 0.0115) MultiSource/Applications/siod/siod: -2.28% (3.6643 => 3.5808, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/fbench: -2.15% (3.3840 => 3.3111, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.94% (3.3479 => 3.2830, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/fp-convert: -1.62% (15.8853 => 15.6278, std.dev.: 0.0268) SingleSource/Benchmarks/Misc/flops-6: -1.47% (2.4416 => 2.4057, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/flops-5: -1.43% (2.8957 => 2.8544, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: -1.37% (1.0841 => 1.0692, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.25% (4.2466 => 4.1937, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.12% (4.7794 => 4.7259, std.dev.: 0.0158) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 6.74% (1.0262 => 1.0954, std.dev.: 0.2729) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.86% (0.2463 => 0.3691, std.dev.: 0.0512) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 22.22% (0.0180 => 0.0220, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 100.00% (0.0007 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.02% (0.1438 => 0.1467, std.dev.: 0.0208) MultiSource/Applications/lemon/lemon: 13.81% (1.1329 => 1.2894, std.dev.: 0.4125) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 10.49% (0.4164 => 0.4601, std.dev.: 0.0778) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.04% (0.1369 => 0.1479, std.dev.: 0.0200) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.34% (0.0641 => 0.0656, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.54% (0.0195 => 0.0276, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.60% (0.0578 => 0.0593, std.dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.82% (1.1437 => 1.1531, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.03% (0.0627 => 0.0608, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 43.89% (0.0180 => 0.0259, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.16% (0.8017 => 0.8004, std.dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0001 => 0.0004, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 88.71% (0.0062 => 0.0117, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 18:47:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 20:47:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121130024720.85DB32A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/6401?compare_to=6398&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6401, Order: 168963, Start Time: 2012-11-30 01:13:09, End Time: 2012-11-30 02:47:53 To: 6398, Order: 168950, Start Time: 2012-11-29 23:17:35, End Time: 2012-11-30 00:50:07 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (184 on baseline) Added Tests: 0 (52 on baseline) Unchanged Tests: 1093 (852 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 438.71% (10.1883 => 54.8856, std.dev.: 0.0093) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 74.95% (31.3723 => 54.8856, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.51% (54.5751 => 56.4911, std.dev.: 0.0970) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1011, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/salsa20: 2.39% (7.4937 => 7.6731, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/hash2: 2.18% (3.1932 => 3.2629, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.46% (0.1431 => 0.1310, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.48% (0.3821 => 0.3535, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.21% (0.9542 => 0.8854, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.78% (2.4924 => 2.3234, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.59% (0.3142 => 0.2935, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.38% (0.2428 => 0.2273, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.29% (0.3831 => 0.3590, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.26% (0.3880 => 0.3637, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.26% (0.3357 => 0.3147, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -6.21% (0.3896 => 0.3654, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/oourafft: -6.16% (0.2160 => 0.2027, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.14% (0.6484 => 0.6086, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -6.11% (0.3848 => 0.3613, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.08% (0.3884 => 0.3648, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -6.05% (0.4033 => 0.3789, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -5.98% (0.3812 => 0.3584, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -5.97% (16.1920 => 15.2252, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.94% (0.3891 => 0.3660, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.91% (0.1761 => 0.1657, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.90% (0.2355 => 0.2216, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.90% (0.1796 => 0.1690, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -5.87% (0.4176 => 0.3931, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: -5.83% (7.0961 => 6.6822, std.dev.: 0.0067) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.83% (0.1716 => 0.1616, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -5.83% (9.2283 => 8.6907, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.81% (1.3722 => 1.2925, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.81% (0.5478 => 0.5160, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.77% (0.3658 => 0.3447, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.76% (0.9852 => 0.9285, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.75% (0.5805 => 0.5471, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.72% (0.5591 => 0.5271, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.72% (0.5859 => 0.5524, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.71% (1.0544 => 0.9942, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.70% (4.8161 => 4.5417, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.68% (0.5849 => 0.5517, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.67% (0.4199 => 0.3961, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.66% (0.5863 => 0.5531, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.64% (0.5705 => 0.5383, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.64% (0.5802 => 0.5475, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.63% (0.5575 => 0.5261, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: -5.62% (0.9179 => 0.8663, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.61% (0.6395 => 0.6036, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.61% (0.5456 => 0.5150, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.61% (0.5941 => 0.5608, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.60% (0.2695 => 0.2544, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.60% (4.8802 => 4.6068, std.dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.60% (1.2300 => 1.1611, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.60% (0.6052 => 0.5713, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.60% (0.7198 => 0.6795, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.58% (0.5569 => 0.5258, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.58% (0.6304 => 0.5952, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.58% (0.5857 => 0.5530, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: -5.57% (4.3330 => 4.0917, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.56% (6.7716 => 6.3953, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.55% (0.5925 => 0.5596, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.54% (0.5581 => 0.5272, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.53% (1.6364 => 1.5459, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.53% (0.6440 => 0.6084, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.53% (0.6260 => 0.5914, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.53% (0.6189 => 0.5847, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.53% (4.0323 => 3.8095, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.52% (0.7524 => 0.7109, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.51% (0.6230 => 0.5887, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.50% (0.6676 => 0.6309, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.50% (0.5567 => 0.5261, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.49% (0.6297 => 0.5951, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.49% (0.6446 => 0.6092, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.46% (0.6395 => 0.6046, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.44% (0.6194 => 0.5857, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.44% (0.6033 => 0.5705, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.44% (1.4642 => 1.3846, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.43% (4.5069 => 4.2620, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.41% (1.2784 => 1.2093, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.40% (0.5570 => 0.5269, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.40% (0.8521 => 0.8061, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.40% (0.5688 => 0.5381, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.39% (0.6736 => 0.6373, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.37% (0.6293 => 0.5955, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.36% (0.3057 => 0.2893, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.36% (3.5339 => 3.3444, std.dev.: 0.0097) MultiSource/Benchmarks/McCat/05-eks/eks: -5.36% (0.4515 => 0.4273, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.35% (0.7339 => 0.6946, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -5.33% (1.1530 => 1.0915, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.33% (0.7919 => 0.7497, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: -5.29% (1.3864 => 1.3131, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: -5.29% (1.3148 => 1.2453, std.dev.: 0.0103) SingleSource/UnitTests/ObjC/parameter-passing: -5.28% (0.4280 => 0.4054, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.27% (14.2083 => 13.4596, std.dev.: 0.0095) MultiSource/Benchmarks/sim/sim: -5.23% (0.3406 => 0.3228, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.22% (0.2548 => 0.2415, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.21% (0.3323 => 0.3150, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.21% (0.3016 => 0.2859, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -5.19% (0.2985 => 0.2830, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: -5.19% (1.1450 => 1.0856, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.17% (0.3252 => 0.3084, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.16% (0.3931 => 0.3728, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.16% (0.3255 => 0.3087, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -5.16% (0.3025 => 0.2869, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.16% (0.4151 => 0.3937, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.14% (17.1032 => 16.2245, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.13% (0.5999 => 0.5691, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.12% (8.0126 => 7.6024, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.11% (0.3837 => 0.3641, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.09% (2.1713 => 2.0607, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/except: -5.09% (0.3026 => 0.2872, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -5.06% (15.5079 => 14.7234, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/fibo: -5.05% (0.2871 => 0.2726, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.05% (0.4321 => 0.4103, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.03% (1.2210 => 1.1596, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.01% (0.2933 => 0.2786, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -5.00% (0.2939 => 0.2792, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.99% (1.2221 => 1.1611, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.98% (0.4916 => 0.4671, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: -4.98% (0.3194 => 0.3035, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -4.98% (1.2515 => 1.1892, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/18-imp/imp: -4.97% (0.3581 => 0.3403, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/08-main/main: -4.96% (0.2659 => 0.2527, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.95% (0.2385 => 0.2267, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.94% (0.3483 => 0.3311, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: -4.93% (0.3205 => 0.3047, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -4.93% (3.5154 => 3.3421, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.92% (0.2278 => 0.2166, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: -4.90% (0.3059 => 0.2909, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.87% (0.2999 => 0.2853, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.86% (0.2903 => 0.2762, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -4.85% (0.3481 => 0.3312, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.85% (0.2989 => 0.2844, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -4.85% (0.3446 => 0.3279, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.84% (0.2849 => 0.2711, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.84% (0.5168 => 0.4918, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -4.81% (0.4861 => 0.4627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.81% (0.3849 => 0.3664, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -4.80% (0.3394 => 0.3231, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.78% (0.4813 => 0.4583, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -4.75% (15.2527 => 14.5275, std.dev.: 0.0036) MultiSource/Applications/minisat/minisat: -4.75% (0.7447 => 0.7093, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -4.75% (4.0594 => 3.8665, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/moments: -4.71% (0.4248 => 0.4048, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -4.67% (34.0927 => 32.5008, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.64% (0.6660 => 0.6351, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.62% (0.6667 => 0.6359, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -4.58% (0.3621 => 0.3455, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.52% (0.3271 => 0.3123, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.50% (22.4056 => 21.3969, std.dev.: 0.0150) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.49% (0.7021 => 0.6706, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.48% (0.4083 => 0.3900, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: -4.47% (18.2933 => 17.4756, std.dev.: 0.0149) MultiSource/Applications/treecc/treecc: -4.46% (2.1401 => 2.0447, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists1: -4.42% (0.3867 => 0.3696, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -4.42% (2.4021 => 2.2960, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.41% (0.9557 => 0.9136, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -4.40% (0.4524 => 0.4325, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.39% (1.6474 => 1.5750, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.36% (0.9077 => 0.8681, std.dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: -4.36% (5.0226 => 4.8035, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.35% (0.5329 => 0.5097, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.29% (0.4427 => 0.4237, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -4.25% (0.8418 => 0.8060, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.19% (0.3319 => 0.3180, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: -4.13% (0.7779 => 0.7458, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: -4.12% (0.3788 => 0.3632, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.98% (0.3491 => 0.3352, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: -3.85% (0.6750 => 0.6490, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: -3.81% (0.6347 => 0.6105, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.77% (2.2587 => 2.1736, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: -3.34% (0.6441 => 0.6226, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.32% (1.5610 => 1.5092, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.74% (5.4682 => 5.3186, std.dev.: 0.0116) SingleSource/UnitTests/Vector/constpool: -2.70% (20.7746 => 20.2127, std.dev.: 0.0386) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.27% (1.8100 => 0.7010, std.dev.: 0.0063) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7510, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -8.65% (1.2842 => 1.1731, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -4.10% (2.2633 => 2.1706, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7060, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4741, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.02% (3.2107 => 3.1781, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 2.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 19:37:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 21:37:38 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121130033738.DE87C2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/6402?compare_to=6396&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6402, Order: 168962, Start Time: 2012-11-30 01:12:17, End Time: 2012-11-30 03:38:13 To: 6396, Order: 168935, Start Time: 2012-11-29 21:49:35, End Time: 2012-11-30 00:13:11 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 23 (156 on baseline) Performance Improvements: 3 (42 on baseline) Added Tests: 0 (186 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1062 (687 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 12.30% (4.6587 => 5.2319, std.dev.: 0.0635) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.94% (0.6228 => 0.6785, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.91% (0.6159 => 0.6708, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.71% (0.6454 => 0.7016, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.68% (0.6351 => 0.6902, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.61% (0.6455 => 0.7011, std.dev.: 0.0210) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.50% (0.1177 => 0.1277, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 8.22% (0.3687 => 0.3990, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 7.44% (9.1997 => 9.8843, std.dev.: 0.1272) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.44% (0.2425 => 0.2557, std.dev.: 0.0051) MultiSource/Applications/sqlite3/sqlite3: 4.33% (20.4856 => 21.3735, std.dev.: 0.0287) MultiSource/Applications/minisat/minisat: 3.65% (0.8865 => 0.9189, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/18-imp/imp: 3.16% (0.4182 => 0.4314, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: 3.05% (0.3609 => 0.3719, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 1.98% (7.1301 => 7.2710, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.87% (5.5667 => 5.6710, std.dev.: 0.0238) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 471.39% (10.2606 => 58.6282, std.dev.: 0.0134) MultiSource/Applications/minisat/minisat: 21.08% (9.6831 => 11.7239, std.dev.: 0.3739) SingleSource/Benchmarks/Misc/ffbench: 3.98% (1.0219 => 1.0626, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 2.27% (4.5646 => 4.6680, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.96% (2.7990 => 2.8540, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/lists: 1.69% (12.5164 => 12.7282, std.dev.: 0.0236) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.60% (7.2709 => 7.3871, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.47% (0.4498 => 0.4342, std.dev.: 0.0055) MultiSource/Applications/JM/lencod/lencod: -2.20% (33.0471 => 32.3203, std.dev.: 0.1984) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops: -74.98% (26.2472 => 6.5661, std.dev.: 0.0152) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.23% (69.5048 => 69.3451, std.dev.: 0.7207) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 1.11% (0.1355 => 0.1370, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.18% (0.0444 => 0.0421, std.dev.: 0.0078) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.46% (0.0655 => 0.0652, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -0.01% (493.9269 => 493.8813, std.dev.: 0.3561) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.65% (63.2438 => 69.3451, std.dev.: 0.7207) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0421, std.dev.: 0.0078) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43695.45% (1.1277 => 493.8813, std.dev.: 0.3561) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.45% (0.5229 => 1.5397, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 17.49% (14.9895 => 17.6113, std.dev.: 0.3020) MultiSource/Applications/kimwitu++/kc: 45.54% (14.1553 => 20.6013, std.dev.: 0.0881) MultiSource/Benchmarks/MallocBench/gs/gs: 16.98% (4.1105 => 4.8086, std.dev.: 0.2508) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.23% (1.1048 => 1.5161, std.dev.: 0.0774) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 441.49% (7.1582 => 38.7610, std.dev.: 0.3103) SingleSource/Benchmarks/Misc-C++-EH/spirit: 86.31% (3.4629 => 6.4516, std.dev.: 0.3075) SingleSource/Benchmarks/Misc-C++/stepanov_container: 68.23% (0.6222 => 1.0467, std.dev.: 0.0530) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10627.50% (0.0720 => 7.7238, std.dev.: 0.1586) MultiSource/Applications/SIBsim4/SIBsim4: 3856700.00% (0.0001 => 3.8568, std.dev.: 0.0328) MultiSource/Applications/SPASS/SPASS: 14970700.00% (0.0001 => 14.9708, std.dev.: 0.7197) MultiSource/Applications/kimwitu++/kc: 54000.00% (0.0001 => 0.0541, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 65500.00% (0.0001 => 0.0656, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576500.00% (0.0001 => 0.5766, std.dev.: 0.0355) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9987400.00% (0.0001 => 9.9875, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5790000.00% (0.0001 => 5.7901, std.dev.: 0.8692) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1752.77% (1.1194 => 20.7399, std.dev.: 0.6438) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 78.05% (2.9384 => 5.2319, std.dev.: 0.0635) MultiSource/Applications/ClamAV/clamscan: 70.74% (22.1758 => 37.8623, std.dev.: 0.0629) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.35% (7.0540 => 10.8879, std.dev.: 0.3111) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 54.30% (8.1363 => 12.5543, std.dev.: 0.1378) MultiSource/Applications/JM/lencod/lencod: 47.33% (21.9371 => 32.3203, std.dev.: 0.1984) MultiSource/Benchmarks/FreeBench/distray/distray: 45.08% (0.1056 => 0.1532, std.dev.: 0.0058) SingleSource/UnitTests/vla: 38.87% (0.0355 => 0.0493, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/almabench: 38.77% (0.0730 => 0.1013, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 37.71% (0.1432 => 0.1972, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/08-main/main: 36.65% (0.2554 => 0.3490, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 35.23% (0.1584 => 0.2142, std.dev.: 0.0057) MultiSource/Benchmarks/Fhourstones/fhourstones: 34.67% (0.1566 => 0.2109, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 32.16% (0.0793 => 0.1048, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 31.70% (0.0672 => 0.0885, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/15-trie/trie: 31.31% (0.0527 => 0.0692, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/17-bintr/bintr: 31.11% (0.0675 => 0.0885, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/family/family: 29.22% (0.0397 => 0.0513, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 29.15% (0.7115 => 0.9189, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 28.47% (0.4103 => 0.5271, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/messages-2: 28.25% (0.0662 => 0.0849, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.84% (0.0528 => 0.0675, std.dev.: 0.0028) MultiSource/Applications/d/make_dparser: 27.26% (3.3354 => 4.2445, std.dev.: 0.0182) MultiSource/Applications/spiff/spiff: 26.87% (0.7835 => 0.9940, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 26.37% (0.0842 => 0.1064, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 26.25% (5.7591 => 7.2710, std.dev.: 0.0183) MultiSource/Benchmarks/McCat/18-imp/imp: 26.03% (0.3423 => 0.4314, std.dev.: 0.0015) MultiSource/Benchmarks/llubenchmark/llu: 25.97% (0.0462 => 0.0582, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.73% (0.0886 => 0.1114, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.61% (0.8172 => 1.0265, std.dev.: 0.0123) MultiSource/Benchmarks/McCat/09-vor/vor: 25.47% (0.3180 => 0.3990, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 25.40% (0.0933 => 0.1170, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/lists: 24.44% (0.0626 => 0.0779, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: 24.40% (17.1811 => 21.3735, std.dev.: 0.0287) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 24.26% (2.2024 => 2.7368, std.dev.: 0.1105) SingleSource/UnitTests/ObjC/dot-syntax-1: 24.22% (0.0479 => 0.0595, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 24.11% (0.0730 => 0.0906, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/Oscar: 23.58% (0.0636 => 0.0786, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.46% (0.0746 => 0.0921, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 23.30% (0.1695 => 0.2090, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.89% (0.1044 => 0.1283, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/mst/mst: 22.61% (0.1163 => 0.1426, std.dev.: 0.0067) MultiSource/Benchmarks/NPB-serial/is/is: 22.53% (0.0719 => 0.0881, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.50% (0.1062 => 0.1301, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 22.14% (0.3387 => 0.4137, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 22.13% (14.3668 => 17.5468, std.dev.: 0.3818) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.36% (0.2107 => 0.2557, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 20.98% (0.0491 => 0.0594, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 20.85% (0.1175 => 0.1420, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: 20.28% (0.3092 => 0.3719, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 19.75% (0.4299 => 0.5148, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.68% (0.2271 => 0.2718, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/bmm/bmm: 19.63% (0.0759 => 0.0908, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 19.24% (0.4289 => 0.5114, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 18.96% (0.3650 => 0.4342, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hash2: 18.87% (0.4620 => 0.5492, std.dev.: 0.0154) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.76% (0.1125 => 0.1336, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/matrix: 18.70% (0.0818 => 0.0971, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 18.67% (0.2603 => 0.3089, std.dev.: 0.0113) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.67% (0.2700 => 0.3204, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 18.62% (0.0929 => 0.1102, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 18.58% (0.4048 => 0.4800, std.dev.: 0.0240) SingleSource/Benchmarks/CoyoteBench/fftbench: 17.84% (0.4636 => 0.5463, std.dev.: 0.0320) MultiSource/Applications/treecc/treecc: 17.46% (2.0273 => 2.3813, std.dev.: 0.0893) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.35% (0.3826 => 0.4490, std.dev.: 0.0111) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.99% (0.0871 => 0.1019, std.dev.: 0.0026) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.89% (0.1143 => 0.1336, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/parameter-passing: 16.81% (0.3927 => 0.4587, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 16.53% (1.2842 => 1.4965, std.dev.: 0.0387) SingleSource/Benchmarks/Misc/ffbench: 16.45% (0.0705 => 0.0821, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 16.38% (0.2430 => 0.2828, std.dev.: 0.0095) SingleSource/UnitTests/ObjC/property: 16.26% (0.3886 => 0.4518, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 16.25% (0.1114 => 0.1295, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-4: 15.72% (0.3543 => 0.4100, std.dev.: 0.0201) MultiSource/Applications/Burg/burg: 15.62% (1.1642 => 1.3461, std.dev.: 0.0414) SingleSource/UnitTests/ObjC/exceptions: 15.57% (0.3828 => 0.4424, std.dev.: 0.0226) SingleSource/UnitTests/SignlessTypes/rem: 15.56% (0.1144 => 0.1322, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.55% (0.3543 => 0.4094, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/trivial-interface: 15.55% (0.3473 => 0.4013, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.43% (0.0648 => 0.0748, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.40% (0.2793 => 0.3223, std.dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 15.37% (0.1906 => 0.2199, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/random: 15.35% (0.2802 => 0.3232, std.dev.: 0.0164) MultiSource/Applications/viterbi/viterbi: 15.31% (0.1555 => 0.1793, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/health/health: 15.30% (0.1268 => 0.1462, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/exceptions-2: 15.30% (0.3497 => 0.4032, std.dev.: 0.0125) MultiSource/Applications/aha/aha: 15.20% (0.1151 => 0.1326, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.19% (0.0770 => 0.0887, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/for-in: 15.16% (0.3694 => 0.4254, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/synchronized: 15.14% (0.3561 => 0.4100, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.11% (0.3136 => 0.3610, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.04% (0.1117 => 0.1285, std.dev.: 0.0052) MultiSource/Applications/lambda-0_1_3/lambda: 14.99% (0.7433 => 0.8547, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 14.93% (0.3516 => 0.4041, std.dev.: 0.0191) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.87% (0.0834 => 0.0958, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/fibo: 14.79% (0.2725 => 0.3128, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.68% (4.9449 => 5.6710, std.dev.: 0.0238) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.44% (0.1032 => 0.1181, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.40% (0.9765 => 1.1171, std.dev.: 0.0498) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.23% (0.5981 => 0.6832, std.dev.: 0.0243) SingleSource/UnitTests/ObjC++/Hello: 14.06% (0.5925 => 0.6758, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.91% (0.1337 => 0.1523, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/objinst: 13.89% (0.3131 => 0.3566, std.dev.: 0.0111) SingleSource/UnitTests/ObjC++/property-reference-object: 13.88% (0.6030 => 0.6867, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 13.83% (9.4845 => 10.7960, std.dev.: 0.3913) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.69% (0.3441 => 0.3912, std.dev.: 0.0123) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.60% (4.2646 => 4.8446, std.dev.: 0.0995) MultiSource/Applications/lua/lua: 13.49% (3.8723 => 4.3947, std.dev.: 0.0751) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.45% (1.5415 => 1.7489, std.dev.: 0.0457) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.41% (0.1029 => 0.1167, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.40% (5.0018 => 5.6720, std.dev.: 0.0613) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.39% (0.4615 => 0.5233, std.dev.: 0.0188) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.62% (0.3177 => 0.3578, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 12.56% (1.0722 => 1.2069, std.dev.: 0.0481) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.63% (0.1625 => 0.1814, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/football/football: 10.97% (0.8921 => 0.9900, std.dev.: 0.0315) MultiSource/Benchmarks/Ptrdist/bc/bc: 10.94% (1.1861 => 1.3159, std.dev.: 0.0458) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.56% (1.4186 => 1.5684, std.dev.: 0.0512) SingleSource/UnitTests/ObjC++/property-reference: 8.97% (0.7326 => 0.7983, std.dev.: 0.0183) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.10% (0.3817 => 0.4088, std.dev.: 0.0091) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.02% (7.9617 => 8.5209, std.dev.: 0.1105) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.69% (0.4879 => 0.5059, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- SingleSource/UnitTests/ObjC/synchronized: 224.93% (0.1051 => 0.3415, std.dev.: 0.0731) SingleSource/Benchmarks/Shootout/methcall: 149.60% (4.3953 => 10.9707, std.dev.: 0.0294) SingleSource/Benchmarks/Shootout-C++/methcall: 147.45% (5.3999 => 13.3619, std.dev.: 0.0119) MultiSource/Benchmarks/llubenchmark/llu: 132.97% (3.7781 => 8.8019, std.dev.: 0.0732) MultiSource/Benchmarks/SciMark2-C/scimark2: 80.33% (32.5116 => 58.6282, std.dev.: 0.0134) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 44.75% (0.3256 => 0.4713, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/09-vor/vor: 35.10% (0.1154 => 0.1559, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 29.68% (1.5086 => 1.9564, std.dev.: 0.1050) MultiSource/Applications/minisat/minisat: 28.61% (9.1159 => 11.7239, std.dev.: 0.3739) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 16.70% (1.3045 => 1.5224, std.dev.: 0.0629) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.63% (1.1145 => 1.2998, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 16.17% (6.6465 => 7.7214, std.dev.: 0.0092) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.91% (0.2944 => 0.3324, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 11.79% (0.9505 => 1.0626, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.66% (2.8904 => 3.2273, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/richards_benchmark: 10.21% (1.1396 => 1.2560, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.38% (1.7254 => 1.8872, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 7.97% (1.9405 => 2.0952, std.dev.: 0.0294) MultiSource/Applications/lua/lua: 6.34% (26.0924 => 27.7464, std.dev.: 0.1861) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.92% (0.9540 => 1.0105, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 5.88% (1.8329 => 1.9406, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.42% (4.2280 => 4.4573, std.dev.: 0.0130) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691) MultiSource/Benchmarks/nbench/nbench: 4.15% (11.6436 => 12.1272, std.dev.: 0.0237) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.34% (0.4162 => 0.4301, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.16% (2.1424 => 2.2102, std.dev.: 0.0136) MultiSource/Benchmarks/PAQ8p/paq8p: 2.14% (85.0658 => 86.8892, std.dev.: 0.0955) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 2.06% (3.1595 => 3.2245, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 1.54% (12.5348 => 12.7282, std.dev.: 0.0236) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.32% (6.5088 => 6.5944, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0313 => 1.0441, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: 1.17% (5.9798 => 6.0499, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1674, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.73% (5.2763 => 1.2276, std.dev.: 0.0589) SingleSource/Benchmarks/Misc/salsa20: -74.70% (0.8651 => 0.2189, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/richards_benchmark: -44.76% (0.1622 => 0.0896, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.65% (5.3855 => 4.7042, std.dev.: 0.1709) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.27% (5.3526 => 4.6957, std.dev.: 0.1654) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -9.96% (1.7609 => 1.5855, std.dev.: 0.0558) MultiSource/Applications/JM/ldecod/ldecod: -5.29% (10.4361 => 9.8843, std.dev.: 0.1272) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -64.18% (1.9577 => 0.7012, std.dev.: 0.0109) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1681, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.23% (0.3987 => 0.2383, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.31% (4.5009 => 2.7768, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.13% (2.6546 => 2.0140, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/mason/mason: -19.34% (0.2161 => 0.1743, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.63% (1.6925 => 1.4280, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2838, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -10.51% (9.5636 => 8.5583, std.dev.: 0.1782) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.50% (1.5660 => 1.4329, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.03% (19.9488 => 18.3479, std.dev.: 0.4063) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.2416 => 3.0209, std.dev.: 0.0350) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5760, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.06% (0.8614 => 0.8178, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5081, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.65% (0.2497 => 0.2381, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -4.26% (6.2999 => 6.0317, std.dev.: 0.0331) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.37% (0.9957 => 0.9621, std.dev.: 0.0033) MultiSource/Benchmarks/sim/sim: -3.01% (5.0483 => 4.8965, std.dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.25% (0.4808 => 0.4700, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.79% (8.1563 => 8.0102, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6776, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.52% (10.2830 => 10.1267, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -7.74% (0.1485 => 0.1370, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0008) Report Time: 2.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 20:29:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 22:29:19 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121130042919.74F542A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/6403?compare_to=6400&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6403, Order: 168970, Start Time: 2012-11-30 02:53:39, End Time: 2012-11-30 04:29:53 To: 6400, Order: 168962, Start Time: 2012-11-30 00:57:43, End Time: 2012-11-30 02:36:40 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 5 (86 on baseline) Performance Improvements: 43 (37 on baseline) Added Tests: 0 (51 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1005 (851 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 18.71% (19.4944 => 23.1419, std.dev.: 0.6518) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.89% (16.1569 => 17.1085, std.dev.: 0.1974) SingleSource/Benchmarks/Misc/ffbench: 1.61% (1.3633 => 1.3852, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.54% (2.7229 => 2.7648, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.22% (1.2433 => 1.2585, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/04-bisect/bisect: -26.60% (0.1628 => 0.1195, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/05-eks/eks: -19.66% (0.5520 => 0.4435, std.dev.: 0.0059) MultiSource/Applications/hbd/hbd: -18.82% (1.8366 => 1.4909, std.dev.: 0.0134) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -18.48% (0.1082 => 0.0882, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: -12.24% (5.2430 => 4.6011, std.dev.: 0.0594) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -10.57% (0.1012 => 0.0905, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: -10.53% (0.1832 => 0.1639, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -10.10% (0.1030 => 0.0926, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: -9.49% (0.9196 => 0.8323, std.dev.: 0.0139) MultiSource/Applications/viterbi/viterbi: -7.60% (0.1762 => 0.1628, std.dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: -7.10% (1.4053 => 1.3055, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: -7.01% (0.8269 => 0.7689, std.dev.: 0.0089) MultiSource/Applications/d/make_dparser: -6.55% (3.5862 => 3.3513, std.dev.: 0.0343) MultiSource/Applications/lemon/lemon: -6.14% (1.2044 => 1.1304, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.10% (0.6586 => 0.6184, std.dev.: 0.0114) MultiSource/Benchmarks/McCat/08-main/main: -6.04% (0.2947 => 0.2769, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.81% (1.4665 => 1.3813, std.dev.: 0.0242) MultiSource/Applications/Burg/burg: -4.96% (1.3537 => 1.2865, std.dev.: 0.0120) MultiSource/Benchmarks/McCat/18-imp/imp: -4.65% (0.3740 => 0.3566, std.dev.: 0.0032) MultiSource/Applications/siod/siod: -4.23% (2.4365 => 2.3334, std.dev.: 0.0066) MultiSource/Applications/kimwitu++/kc: -4.03% (18.6185 => 17.8687, std.dev.: 0.0893) MultiSource/Applications/sgefa/sgefa: -3.23% (0.3215 => 0.3111, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: -2.56% (2.1461 => 2.0911, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/football/football: -2.33% (0.9443 => 0.9223, std.dev.: 0.0066) MultiSource/Applications/sqlite3/sqlite3: -2.28% (15.7798 => 15.4207, std.dev.: 0.0744) MultiSource/Applications/SPASS/SPASS: -2.01% (15.2926 => 14.9849, std.dev.: 0.0522) MultiSource/Applications/ClamAV/clamscan: -1.84% (15.5922 => 15.3054, std.dev.: 0.0250) MultiSource/Applications/JM/ldecod/ldecod: -1.78% (7.0966 => 6.9701, std.dev.: 0.0233) MultiSource/Applications/JM/lencod/lencod: -1.66% (16.1521 => 15.8843, std.dev.: 0.0279) MultiSource/Applications/hexxagon/hexxagon: -1.48% (1.0231 => 1.0080, std.dev.: 0.0033) MultiSource/Applications/lua/lua: -1.36% (4.0365 => 3.9815, std.dev.: 0.0206) MultiSource/Applications/oggenc/oggenc: -1.20% (5.1325 => 5.0710, std.dev.: 0.0210) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/d/make_dparser: -24.21% (0.0508 => 0.0385, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -23.30% (1.6393 => 1.2574, std.dev.: 0.0130) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -15.87% (1.4748 => 1.2408, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/ft/ft: -12.23% (0.9939 => 0.8723, std.dev.: 0.0203) MultiSource/Applications/minisat/minisat: -7.17% (6.7603 => 6.2759, std.dev.: 0.0050) MultiSource/Applications/SIBsim4/SIBsim4: -3.89% (3.3195 => 3.1905, std.dev.: 0.0027) MultiSource/Applications/lua/lua: -3.00% (29.5465 => 28.6596, std.dev.: 0.1071) MultiSource/Benchmarks/llubenchmark/llu: -1.70% (2.0404 => 2.0057, std.dev.: 0.0118) MultiSource/Applications/JM/lencod/lencod: -1.25% (6.9738 => 6.8867, std.dev.: 0.0073) SingleSource/Benchmarks/LivermoreLoops/kernel21: -1.07% (0.9983 => 0.9876, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -1.03% (3.5808 => 3.5440, std.dev.: 0.0077) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -2.24% (1.0954 => 1.0709, std.dev.: 0.0212) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.49% (0.3691 => 0.3709, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.45% (0.0220 => 0.0219, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0424 => 0.0426, std.dev.: 0.0128) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.60% (0.0332 => 0.0330, std.dev.: 0.0116) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.64% (0.0314 => 0.0312, std.dev.: 0.0103) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0424 => 0.0424, std.dev.: 0.0141) SingleSource/UnitTests/Vector/Altivec/casts: -0.98% (0.0205 => 0.0203, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/test1: -1.36% (0.0220 => 0.0217, std.dev.: 0.0071) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/Burg/burg: -28.57% (0.0014 => 0.0010, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -0.75% (0.1467 => 0.1456, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -10.35% (1.2894 => 1.1560, std.dev.: 0.0249) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -13.02% (0.4601 => 0.4002, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.96% (0.1479 => 0.1450, std.dev.: 0.0333) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.76% (0.0656 => 0.0651, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.42% (0.0593 => 0.0549, std.dev.: 0.0148) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.41% (1.1531 => 1.1484, std.dev.: 0.0987) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.33% (0.0030 => 0.0029, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -69.23% (0.0026 => 0.0008, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.66% (0.0608 => 0.0604, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.93% (0.0259 => 0.0264, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.90% (0.8004 => 0.8076, std.dev.: 0.0206) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -50.00% (0.0002 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -40.17% (0.0117 => 0.0070, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.27% (8.6357 => 8.6126, std.dev.: 0.0211) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.65% (16.4461 => 17.8687, std.dev.: 0.0893) MultiSource/Applications/sqlite3/sqlite3: 2335.36% (0.6332 => 15.4207, std.dev.: 0.0744) MultiSource/Benchmarks/McCat/08-main/main: 51.23% (0.1831 => 0.2769, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.16% (0.1559 => 0.1463, std.dev.: 0.0213) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7114.02% (0.3123 => 22.5294, std.dev.: 1.2144) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1555.92% (0.3344 => 5.5374, std.dev.: 0.0576) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.65% (0.2364 => 0.3254, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/bigfib: 4.91% (0.6010 => 0.6305, std.dev.: 0.0697) SingleSource/Benchmarks/Misc/mandel: 3.73% (0.0429 => 0.0445, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.65% (0.3266 => 0.3418, std.dev.: 0.0214) SingleSource/Benchmarks/Shootout-C++/strcat: 3.86% (0.1969 => 0.2045, std.dev.: 0.0086) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.80% (0.0224 => 0.0237, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0015) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0450, std.dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 12.31% (0.1462 => 0.1642, std.dev.: 0.0046) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4032, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0689, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4951, std.dev.: 0.0367) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5188, std.dev.: 0.0777) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2667, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0752, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3620, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3892, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0844, std.dev.: 0.0059) SingleSource/Regression/C/uint64_to_float: -29.64% (2.1832 => 1.5360, std.dev.: 0.0338) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.32% (0.0810 => 0.0926, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: 13.67% (0.1112 => 0.1264, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.62% (0.0848 => 0.0955, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.35% (0.4127 => 0.4513, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.04% (0.3295 => 0.3560, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.78% (0.1466 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 7.53% (0.3226 => 0.3469, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.48% (0.7473 => 0.8032, std.dev.: 0.0111) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.03% (0.1905 => 0.2039, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.02% (0.6010 => 0.6432, std.dev.: 0.0119) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.02% (0.2180 => 0.2333, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.91% (0.9435 => 1.0087, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.79% (1.5315 => 1.6355, std.dev.: 0.0148) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.73% (0.3137 => 0.3348, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.12% (0.9908 => 1.0514, std.dev.: 0.0205) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.07% (0.4847 => 0.5141, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.64% (0.2519 => 0.2661, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.56% (3.1832 => 3.3602, std.dev.: 0.0267) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.33% (0.2794 => 0.2943, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.26% (1.1606 => 1.2217, std.dev.: 0.0182) MultiSource/Applications/Burg/burg: 5.26% (1.2222 => 1.2865, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/football/football: 5.19% (0.8768 => 0.9223, std.dev.: 0.0066) MultiSource/Applications/siod/siod: 5.18% (2.2184 => 2.3334, std.dev.: 0.0066) MultiSource/Applications/SPASS/SPASS: 5.08% (14.2605 => 14.9849, std.dev.: 0.0522) MultiSource/Benchmarks/nbench/nbench: 5.03% (1.1271 => 1.1838, std.dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.03% (0.5191 => 0.5452, std.dev.: 0.0073) MultiSource/Applications/treecc/treecc: 4.83% (1.9948 => 2.0911, std.dev.: 0.0125) MultiSource/Applications/spiff/spiff: 4.69% (0.7950 => 0.8323, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.63% (0.7966 => 0.8335, std.dev.: 0.0108) MultiSource/Applications/hbd/hbd: 4.49% (1.4269 => 1.4909, std.dev.: 0.0134) MultiSource/Applications/lua/lua: 4.26% (3.8189 => 3.9815, std.dev.: 0.0206) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.95% (0.4559 => 0.4739, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.92% (0.6586 => 0.6844, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.92% (0.3115 => 0.3237, std.dev.: 0.0044) MultiSource/Applications/SIBsim4/SIBsim4: 3.87% (1.2568 => 1.3055, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.76% (0.2741 => 0.2844, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 3.73% (0.2999 => 0.3111, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 3.64% (14.7684 => 15.3054, std.dev.: 0.0250) MultiSource/Applications/JM/lencod/lencod: 3.63% (15.3280 => 15.8843, std.dev.: 0.0279) MultiSource/Applications/d/make_dparser: 3.54% (3.2366 => 3.3513, std.dev.: 0.0343) MultiSource/Applications/JM/ldecod/ldecod: 3.54% (6.7320 => 6.9701, std.dev.: 0.0233) MultiSource/Applications/lemon/lemon: 3.28% (1.0945 => 1.1304, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.94% (6.6074 => 6.8016, std.dev.: 0.0619) MultiSource/Applications/hexxagon/hexxagon: 2.75% (0.9810 => 1.0080, std.dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 2.18% (4.9628 => 5.0710, std.dev.: 0.0210) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 198.25% (28.5821 => 85.2462, std.dev.: 0.1106) SingleSource/Benchmarks/Misc/pi: 39.06% (1.5795 => 2.1965, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 27.74% (2.9096 => 3.7168, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.21% (4.8436 => 5.8710, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 19.74% (0.7597 => 0.9097, std.dev.: 0.0321) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.90% (8.2783 => 9.7604, std.dev.: 0.0272) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.82% (14.6451 => 17.1085, std.dev.: 0.1974) SingleSource/Benchmarks/McGill/misr: 15.17% (0.4001 => 0.4608, std.dev.: 0.0207) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.40% (0.3186 => 0.3613, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.67% (2.7995 => 3.1263, std.dev.: 0.1058) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.51% (6.3772 => 7.1110, std.dev.: 0.0956) MultiSource/Applications/lambda-0_1_3/lambda: 10.12% (7.4933 => 8.2515, std.dev.: 0.0119) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.08% (1.1857 => 1.3052, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.92% (23.5781 => 25.4448, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.27% (3.9917 => 4.2818, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.32% (3.3761 => 3.5895, std.dev.: 0.0747) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.12% (2.9753 => 3.1574, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.99% (4.8660 => 5.1573, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.83% (4.5327 => 4.7968, std.dev.: 0.0139) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 5.37% (1.0388 => 1.0946, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.36% (5.4187 => 5.7089, std.dev.: 0.0363) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.28% (0.3937 => 0.4145, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.28% (5.3218 => 5.6029, std.dev.: 0.0364) SingleSource/Benchmarks/Misc/richards_benchmark: 5.04% (1.3037 => 1.3694, std.dev.: 0.0177) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 5.01% (0.5214 => 0.5475, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 4.78% (0.4353 => 0.4561, std.dev.: 0.0020) MultiSource/Applications/aha/aha: 4.70% (3.3398 => 3.4967, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/power/power: 3.57% (1.2061 => 1.2492, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.19% (4.8362 => 4.9904, std.dev.: 0.0121) SingleSource/Benchmarks/Misc/whetstone: 3.13% (2.1224 => 2.1888, std.dev.: 0.0166) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.88% (0.4031 => 0.4147, std.dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 2.69% (6.7064 => 6.8867, std.dev.: 0.0073) MultiSource/Applications/minisat/minisat: 2.01% (6.1525 => 6.2759, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 1.99% (3.4104 => 3.4784, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/methcall: 1.93% (8.2676 => 8.4268, std.dev.: 0.0234) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.91% (41.4238 => 42.2138, std.dev.: 0.0790) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.69% (11.5690 => 11.7644, std.dev.: 0.0392) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.26% (59.2638 => 60.0113, std.dev.: 0.2205) MultiSource/Benchmarks/sim/sim: 1.25% (3.8206 => 3.8683, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: 1.22% (2.3560 => 2.3848, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.22% (2.7978 => 2.8318, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.33% (2.8951 => 1.6697, std.dev.: 0.0290) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -24.96% (7.2130 => 5.4125, std.dev.: 0.1787) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.32% (1.4529 => 1.1576, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.68% (9.9065 => 8.2545, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/ary3: -13.14% (1.9999 => 1.7371, std.dev.: 0.0746) MultiSource/Benchmarks/Olden/em3d/em3d: -12.55% (5.4641 => 4.7783, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: -9.74% (1.1216 => 1.0124, std.dev.: 0.0315) SingleSource/Benchmarks/Misc/flops-8: -9.40% (2.5609 => 2.3202, std.dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: -9.04% (63.1822 => 57.4733, std.dev.: 0.1184) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.44% (0.3269 => 0.2993, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.18% (1.0512 => 0.9652, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.43% (3.2169 => 2.9779, std.dev.: 0.0097) SingleSource/Benchmarks/Stanford/FloatMM: -6.43% (0.8807 => 0.8241, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.24% (4.7482 => 4.4521, std.dev.: 0.0221) SingleSource/Benchmarks/Shootout/sieve: -6.09% (7.0599 => 6.6301, std.dev.: 0.0309) SingleSource/Benchmarks/Misc/flops: -5.47% (9.3748 => 8.8621, std.dev.: 0.0540) MultiSource/Benchmarks/VersaBench/bmm/bmm: -5.26% (2.8773 => 2.7260, std.dev.: 0.0514) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.86% (5.6343 => 5.3607, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.53% (4.7449 => 4.5300, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.38% (6.1706 => 5.9002, std.dev.: 0.0855) MultiSource/Applications/lua/lua: -3.93% (29.8330 => 28.6596, std.dev.: 0.1071) SingleSource/Benchmarks/Misc/perlin: -3.89% (5.1084 => 4.9098, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.78% (3.7148 => 3.5745, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.60% (5.1557 => 4.9702, std.dev.: 0.0546) MultiSource/Applications/siod/siod: -3.28% (3.6643 => 3.5440, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.28% (4.9686 => 4.8055, std.dev.: 0.0202) SingleSource/Benchmarks/Misc/ffbench: -3.11% (1.4296 => 1.3852, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: -3.05% (8.9760 => 8.7023, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.91% (3.3479 => 3.2841, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-5: -1.70% (2.8957 => 2.8464, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/tsp/tsp: -1.70% (1.4861 => 1.4608, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.56% (3.5679 => 3.5124, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/fp-convert: -1.51% (15.8853 => 15.6449, std.dev.: 0.0266) MultiSource/Benchmarks/FreeBench/neural/neural: -1.50% (1.0841 => 1.0678, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -1.46% (2.4416 => 2.4060, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.34% (1.5866 => 1.5653, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.14% (6.0224 => 5.9540, std.dev.: 0.0079) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.36% (1.0262 => 1.0709, std.dev.: 0.0212) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.59% (0.2463 => 0.3709, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0128) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0116) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0103) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0141) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0071) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 42.86% (0.0007 => 0.0010, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 1.25% (0.1438 => 0.1456, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 2.04% (1.1329 => 1.1560, std.dev.: 0.0249) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.89% (0.4164 => 0.4002, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.92% (0.1369 => 0.1450, std.dev.: 0.0333) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.56% (0.0641 => 0.0651, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.02% (0.0578 => 0.0549, std.dev.: 0.0148) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.41% (1.1437 => 1.1484, std.dev.: 0.0987) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2800.00% (0.0001 => 0.0029, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -42.86% (0.0014 => 0.0008, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.67% (0.0627 => 0.0604, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 46.67% (0.0180 => 0.0264, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.74% (0.8017 => 0.8076, std.dev.: 0.0206) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 12.90% (0.0062 => 0.0070, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 20:45:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 22:45:45 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121130044545.9F1322A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/6404?compare_to=6401&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6404, Order: 168970, Start Time: 2012-11-30 03:11:12, End Time: 2012-11-30 04:46:20 To: 6401, Order: 168963, Start Time: 2012-11-30 01:13:09, End Time: 2012-11-30 02:47:53 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (7 on baseline) Performance Improvements: 0 (186 on baseline) Added Tests: 0 (52 on baseline) Unchanged Tests: 1093 (849 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.71% (3.7454 => 3.8469, std.dev.: 0.0249) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 2.95% (0.3834 => 0.3947, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 74.82% (31.3723 => 54.8449, std.dev.: 0.0225) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.00% (2.0478 => 2.1093, std.dev.: 0.0037) MultiSource/Benchmarks/llubenchmark/llu: 2.76% (3.7435 => 3.8469, std.dev.: 0.0249) SingleSource/Benchmarks/Misc/salsa20: 2.43% (7.4937 => 7.6757, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/hash2: 2.12% (3.1932 => 3.2608, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.32% (0.1431 => 0.1312, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.67% (0.3821 => 0.3528, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.26% (0.9542 => 0.8849, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -6.70% (2.4924 => 2.3253, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.59% (0.3142 => 0.2935, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -6.39% (0.2160 => 0.2022, std.dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: -6.34% (0.3357 => 0.3144, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.34% (0.2428 => 0.2274, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.10% (0.3884 => 0.3647, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.07% (0.1796 => 0.1687, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.06% (0.3880 => 0.3645, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.06% (0.3831 => 0.3599, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.01% (0.6484 => 0.6094, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -6.01% (0.1879 => 0.1766, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -6.01% (16.1920 => 15.2186, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.99% (0.5478 => 0.5150, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -5.98% (0.3812 => 0.3584, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.95% (0.3896 => 0.3664, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.95% (0.3848 => 0.3619, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.95% (0.9852 => 0.9266, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -5.95% (9.2283 => 8.6795, std.dev.: 0.0131) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.94% (0.2355 => 0.2215, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: -5.92% (7.0961 => 6.6762, std.dev.: 0.0153) SingleSource/UnitTests/ObjC/exceptions: -5.89% (0.4176 => 0.3930, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.88% (0.4033 => 0.3796, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.87% (0.5805 => 0.5464, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.85% (0.5705 => 0.5371, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.83% (0.5591 => 0.5265, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.83% (0.1716 => 0.1616, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.83% (0.5802 => 0.5464, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.81% (0.3891 => 0.3665, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.81% (0.5925 => 0.5581, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.77% (0.3658 => 0.3447, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.77% (0.7198 => 0.6783, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.75% (0.6395 => 0.6027, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.75% (0.5859 => 0.5522, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.75% (0.5863 => 0.5526, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.73% (0.6297 => 0.5936, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.72% (0.5857 => 0.5522, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.71% (0.5569 => 0.5251, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.70% (4.0323 => 3.8023, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.70% (1.3722 => 1.2940, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.68% (1.0544 => 0.9945, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.68% (0.5849 => 0.5517, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.67% (4.8161 => 4.5430, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.67% (0.6194 => 0.5843, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/football/football: -5.67% (0.9179 => 0.8659, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.65% (0.6052 => 0.5710, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.65% (0.5575 => 0.5260, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.63% (0.5581 => 0.5267, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.61% (4.8802 => 4.6066, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.61% (0.5941 => 0.5608, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.60% (0.5567 => 0.5255, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.60% (1.2300 => 1.1611, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.60% (0.6446 => 0.6085, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.58% (0.6304 => 0.5952, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.57% (0.6230 => 0.5883, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.57% (0.6681 => 0.6309, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.56% (0.6440 => 0.6082, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -5.55% (0.4199 => 0.3966, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.52% (6.7716 => 6.3981, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.50% (0.6395 => 0.6043, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.50% (0.5688 => 0.5375, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.50% (0.3057 => 0.2889, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.49% (0.6189 => 0.5849, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.49% (1.4642 => 1.3838, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.49% (0.7524 => 0.7111, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.48% (0.5456 => 0.5157, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.45% (0.6033 => 0.5704, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.45% (1.2784 => 1.2087, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.45% (1.6364 => 1.5472, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.45% (0.6260 => 0.5919, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.44% (4.5069 => 4.2616, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.44% (0.5570 => 0.5267, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.42% (0.7339 => 0.6941, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.42% (0.6676 => 0.6314, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.42% (0.8521 => 0.8059, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.42% (0.6736 => 0.6371, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.41% (3.5339 => 3.3427, std.dev.: 0.0223) MultiSource/Benchmarks/MallocBench/gs/gs: -5.40% (4.3330 => 4.0990, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/05-eks/eks: -5.38% (0.4515 => 0.4272, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: -5.37% (1.3864 => 1.3119, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.32% (0.3931 => 0.3722, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.31% (0.6293 => 0.5959, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.31% (0.2695 => 0.2552, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -5.30% (1.1530 => 1.0919, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bh/bh: -5.26% (0.2985 => 0.2828, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.26% (0.2548 => 0.2414, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -5.26% (0.4280 => 0.4055, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.25% (0.7919 => 0.7503, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: -5.25% (1.1450 => 1.0849, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -5.24% (1.3148 => 1.2459, std.dev.: 0.0109) MultiSource/Applications/sqlite3/sqlite3: -5.23% (17.1032 => 16.2092, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.22% (14.2083 => 13.4672, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.21% (0.3837 => 0.3637, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.20% (0.3406 => 0.3229, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -5.16% (0.3025 => 0.2869, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.15% (0.2871 => 0.2723, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.15% (0.3323 => 0.3152, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.14% (0.3016 => 0.2861, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -5.13% (0.3059 => 0.2902, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.13% (0.4916 => 0.4664, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.12% (2.1713 => 2.0601, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -5.11% (0.2659 => 0.2523, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.11% (0.4151 => 0.3939, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.10% (0.3194 => 0.3031, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: -5.10% (0.3255 => 0.3089, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.07% (1.2210 => 1.1591, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.05% (0.5999 => 0.5696, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.05% (0.2278 => 0.2163, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.04% (8.0126 => 7.6085, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.04% (0.3252 => 0.3088, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.04% (1.2221 => 1.1605, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/random: -5.04% (0.2939 => 0.2791, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -4.98% (15.5079 => 14.7351, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.98% (0.2933 => 0.2787, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -4.97% (3.5154 => 3.3406, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wc: -4.96% (0.3205 => 0.3046, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.96% (0.2903 => 0.2759, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.94% (0.3483 => 0.3311, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -4.92% (0.3026 => 0.2877, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/18-imp/imp: -4.91% (0.3581 => 0.3405, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: -4.91% (0.3481 => 0.3310, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: -4.88% (0.2989 => 0.2843, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -4.88% (0.2849 => 0.2710, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.87% (0.2999 => 0.2853, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.86% (0.4321 => 0.4111, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -4.85% (0.3446 => 0.3279, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.79% (0.6660 => 0.6341, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -4.77% (0.4861 => 0.4629, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -4.75% (1.2515 => 1.1920, std.dev.: 0.0073) MultiSource/Applications/ClamAV/clamscan: -4.75% (15.2527 => 14.5278, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.74% (0.5168 => 0.4923, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: -4.73% (0.7447 => 0.7095, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: -4.71% (0.3394 => 0.3234, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -4.70% (4.0594 => 3.8687, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists: -4.69% (0.3621 => 0.3451, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -4.68% (0.4248 => 0.4049) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.63% (0.6667 => 0.6358, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -4.61% (34.0927 => 32.5219, std.dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/hash: -4.53% (0.4524 => 0.4319, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: -4.53% (5.0226 => 4.7951, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/lists1: -4.53% (0.3867 => 0.3692, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.49% (1.6474 => 1.5734, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: -4.47% (0.7982 => 0.7625, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.45% (22.4056 => 21.4091, std.dev.: 0.0161) MultiSource/Applications/treecc/treecc: -4.44% (2.1401 => 2.0451, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.43% (0.7021 => 0.6710, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.43% (0.4813 => 0.4600, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: -4.40% (0.3271 => 0.3127, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: -4.38% (18.2933 => 17.4912, std.dev.: 0.0139) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.37% (0.3319 => 0.3174, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.36% (0.9557 => 0.9140, std.dev.: 0.0014) MultiSource/Applications/siod/siod: -4.35% (2.4021 => 2.2977, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.31% (0.3849 => 0.3683, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.28% (0.5329 => 0.5101, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.26% (0.4083 => 0.3909, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: -4.24% (0.8418 => 0.8061, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.22% (0.4427 => 0.4240, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.14% (0.9077 => 0.8701, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sieve: -4.04% (0.3788 => 0.3635, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -3.96% (0.6750 => 0.6483, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -3.95% (0.7779 => 0.7472, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.69% (2.2587 => 2.1753, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: -3.67% (0.6347 => 0.6114, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.48% (0.6441 => 0.6217, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.20% (1.5610 => 1.5111, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.60% (5.4682 => 5.3261, std.dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -1.78% (20.7746 => 20.4040, std.dev.: 0.0380) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.43% (1.8100 => 0.6800, std.dev.: 0.0195) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7536, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: -8.62% (1.2842 => 1.1735, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.93% (1.7753 => 1.7056, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.80% (2.2633 => 2.1774, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3987, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.67% (6.5735 => 6.4635, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.13% (1.3096 => 1.2948, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 21:38:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 29 Nov 2012 23:38:21 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121130053821.E6D002A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/6405?compare_to=6399&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6405, Order: 168965, Start Time: 2012-11-30 02:09:08, End Time: 2012-11-30 05:38:55 To: 6399, Order: 168937, Start Time: 2012-11-29 21:54:04, End Time: 2012-11-30 01:20:52 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (179 on baseline) Performance Improvements: 4 (18 on baseline) Added Tests: 0 (186 on baseline) Unchanged Tests: 1088 (711 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 443.52% (33.3977 => 181.5241, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.41% (54.1668 => 54.9305, std.dev.: 0.0502) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -2.10% (2.4151 => 2.3644, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: -1.79% (1.1594 => 1.1386, std.dev.: 0.0042) MultiSource/Applications/hbd/hbd: -1.14% (1.1481 => 1.1350, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops: -75.01% (116.8884 => 29.2141, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.28% (0.0625 => 0.0883, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.11% (0.1063 => 0.1415, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 27.16% (0.0475 => 0.0604, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.88% (0.2969 => 0.3767, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.61% (0.0714 => 0.0904, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.58% (0.1106 => 0.1400, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.19% (0.4253 => 0.5367, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.88% (0.4139 => 0.5210, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 25.36% (1.5932 => 1.9972, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.25% (0.5900 => 0.7390, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 25.14% (0.0541 => 0.0677, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.91% (0.4994 => 0.6238, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.58% (0.0415 => 0.0517, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.10% (0.5000 => 0.6205, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.80% (0.0584 => 0.0723, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.77% (0.0547 => 0.0677, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.27% (0.1620 => 0.1997, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.08% (0.0897 => 0.1104, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.04% (0.1107 => 0.1362, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.02% (0.1021 => 0.1256, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 22.70% (0.0599 => 0.0735, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.12% (0.0633 => 0.0773, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.76% (0.1103 => 0.1343, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.65% (0.0642 => 0.0781, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.58% (0.0584 => 0.0710, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 21.31% (0.0948 => 0.1150, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.21% (0.3903 => 0.4731, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: 21.19% (0.0604 => 0.0732, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.05% (0.0822 => 0.0995, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.04% (0.1003 => 0.1214, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.01% (0.0495 => 0.0599, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 20.88% (0.1619 => 0.1957, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.85% (0.1549 => 0.1872, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/health/health: 20.83% (0.0821 => 0.0992, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.82% (0.1604 => 0.1938, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.18% (0.1462 => 0.1757, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.08% (0.3890 => 0.4671, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 20.06% (0.0947 => 0.1137, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 19.93% (0.0808 => 0.0969, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.88% (0.2736 => 0.3280, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.76% (1.3152 => 1.5751, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.71% (0.2014 => 0.2411, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 19.41% (0.4029 => 0.4811, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 19.34% (0.1505 => 0.1796, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 19.29% (0.1218 => 0.1453, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.86% (0.3271 => 0.3888, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.75% (0.1088 => 0.1292, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.70% (0.2866 => 0.3402, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 18.66% (0.5546 => 0.6581, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/mst/mst: 18.62% (0.0698 => 0.0828, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.51% (0.0605 => 0.0717, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.50% (3.5627 => 4.2217, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.42% (0.4658 => 0.5516, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.36% (0.0572 => 0.0677, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 18.28% (0.5826 => 0.6891, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 18.25% (1.8794 => 2.2223, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.19% (1.6211 => 1.9160, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.19% (0.1968 => 0.2326, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.98% (0.0573 => 0.0676, std.dev.: 0.0025) MultiSource/Applications/d/make_dparser: 17.97% (1.0781 => 1.2718, std.dev.: 0.0065) SingleSource/UnitTests/ObjC++/property-reference-object: 17.88% (0.5889 => 0.6942, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.79% (0.5026 => 0.5920, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.65% (2.7292 => 3.2108, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.62% (4.4195 => 5.1981, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 17.59% (0.1421 => 0.1671, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.59% (0.1160 => 0.1364, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.38% (0.4361 => 0.5119, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.07% (0.3930 => 0.4601, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 17.05% (0.9697 => 1.1350, std.dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: 16.89% (4.2109 => 4.9221, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/bh/bh: 16.82% (0.1284 => 0.1500, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.53% (1.9694 => 2.2950, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 16.53% (0.2075 => 0.2418, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.42% (0.1090 => 0.1269, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 16.16% (0.7171 => 0.8330, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.15% (1.9966 => 2.3190, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.69% (0.2875 => 0.3326, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 15.55% (0.2566 => 0.2965, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 15.34% (0.2725 => 0.3143, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 15.33% (0.2714 => 0.3130, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.30% (0.2738 => 0.3157, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.17% (0.2729 => 0.3143, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 15.07% (1.4269 => 1.6419, std.dev.: 0.0019) MultiSource/Applications/treecc/treecc: 15.01% (0.7875 => 0.9057, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/random: 14.98% (0.2803 => 0.3223, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 14.94% (2.1653 => 2.4889, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 14.93% (0.2813 => 0.3233, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 14.91% (0.2823 => 0.3244, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 14.91% (0.9909 => 1.1386, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/matrix: 14.89% (0.2780 => 0.3194, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.83% (0.2792 => 0.3206, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 14.79% (0.3096 => 0.3554, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 14.78% (0.0758 => 0.0870, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 14.76% (0.2750 => 0.3156, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 14.70% (0.3469 => 0.3979, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 14.69% (0.2811 => 0.3224, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 14.68% (0.3446 => 0.3952, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.63% (0.3465 => 0.3972, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.62% (0.3488 => 0.3998, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 14.60% (0.3460 => 0.3965, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.57% (0.2911 => 0.3335, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 14.56% (0.3496 => 0.4005, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.55% (0.3195 => 0.3660, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 14.53% (0.3442 => 0.3942, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 14.48% (2.1013 => 2.4055, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 14.48% (23.5202 => 26.9248, std.dev.: 0.0217) MultiSource/Applications/JM/lencod/lencod: 14.47% (4.6177 => 5.2860, std.dev.: 0.0131) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.46% (0.2040 => 0.2335, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 14.45% (0.3004 => 0.3438, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.37% (2.0673 => 2.3644, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/property: 14.33% (0.3650 => 0.4173, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 14.23% (0.2691 => 0.3074, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 14.20% (0.3267 => 0.3731, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 14.15% (0.3724 => 0.4251, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 14.14% (0.3643 => 0.4158, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 14.03% (0.3258 => 0.3715, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.95% (0.3362 => 0.3831, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 13.84% (0.3317 => 0.3776, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.83% (0.3124 => 0.3556, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.79% (0.3060 => 0.3482, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.52% (0.1383 => 0.1570, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 13.47% (0.3348 => 0.3799, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.41% (0.3282 => 0.3722, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 13.40% (0.3678 => 0.4171, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 13.39% (0.3726 => 0.4225, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 13.36% (0.4146 => 0.4700, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.36% (0.3690 => 0.4183, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.19% (0.3625 => 0.4103, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 13.17% (0.3477 => 0.3935, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 13.04% (5.5417 => 6.2646, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.96% (0.3981 => 0.4497, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 12.87% (0.4251 => 0.4798, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.51% (0.3845 => 0.4326, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 12.49% (0.5012 => 0.5638, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 12.19% (0.6634 => 0.7443, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 11.97% (0.4847 => 0.5427, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 11.69% (0.3498 => 0.3907, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.48% (0.1028 => 0.1146, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 11.44% (2.0346 => 2.2674, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.42% (0.6435 => 0.7170, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 11.25% (0.2391 => 0.2660, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.12% (0.2068 => 0.2298, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.70% (0.3084 => 0.3414, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.67% (0.2737 => 0.3029, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 10.61% (0.3336 => 0.3690, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.99% (0.2103 => 0.2313, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.10% (0.5361 => 0.5849, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.58% (0.5584 => 0.6063, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.41% (11.6398 => 12.6185, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.20% (0.7426 => 0.8035, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.13% (4.6926 => 5.0743, std.dev.: 0.0036) MultiSource/Applications/kimwitu++/kc: 7.01% (11.9555 => 12.7940, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.41% (0.3792 => 0.3997, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.86% (29.0505 => 181.5241, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/flops-1: 22.68% (6.2401 => 7.6553) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 9.89% (0.2802 => 0.3079, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6103, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.66% (0.3693 => 0.3902, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 5.61% (0.2122 => 0.2241, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6743, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1720, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/flops-2: 4.67% (1.8057 => 1.8900, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.60% (79.9355 => 83.6147, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6374, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/health/health: 2.72% (0.6276 => 0.6447, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2000, std.dev.: 0.0399) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2221, std.dev.: 0.0046) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3107, std.dev.: 0.0140) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2858, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5388, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 1.09% (50.0626 => 50.6075, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.48% (2.4764 => 2.4150, std.dev.: 0.0140) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.80% (25.4195 => 16.5726, std.dev.: 0.0115) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9755, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8071, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: -7.15% (2.1113 => 1.9603, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary2: -6.37% (0.2402 => 0.2249, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.43% (11.2080 => 10.8238, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.13% (0.6293 => 0.6096, std.dev.: 0.0058) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -2.83% (17.2379 => 16.7505, std.dev.: 0.0506) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.20% (41.7953 => 40.8744, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5745, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/bh/bh: -1.55% (5.5810 => 5.4946, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.25% (105.3826 => 104.0677, std.dev.: 0.0645) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.03% (16.2163 => 16.0498, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 2.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 22:24:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 00:24:45 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121130062445.A1D2A2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/6406?compare_to=6403&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6406, Order: 168976, Start Time: 2012-11-30 04:49:25, End Time: 2012-11-30 06:25:20 To: 6403, Order: 168970, Start Time: 2012-11-30 02:53:39, End Time: 2012-11-30 04:29:53 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 26 (157 on baseline) Performance Improvements: 5 (42 on baseline) Added Tests: 0 (51 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1022 (775 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/bh/bh: 5.60% (0.3002 => 0.3170, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.35% (0.2299 => 0.2399, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 4.11% (4.1959 => 4.3684, std.dev.: 0.0115) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.01% (0.8773 => 0.9125, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/09-vor/vor: 4.01% (0.3217 => 0.3346, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.71% (0.8492 => 0.8807, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.53% (0.3254 => 0.3369, std.dev.: 0.0042) MultiSource/Applications/spiff/spiff: 3.48% (0.8323 => 0.8613, std.dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.26% (0.3348 => 0.3457, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.05% (0.5141 => 0.5298, std.dev.: 0.0033) MultiSource/Applications/Burg/burg: 3.02% (1.2865 => 1.3254, std.dev.: 0.0115) MultiSource/Applications/treecc/treecc: 2.43% (2.0911 => 2.1419, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.41% (8.8620 => 9.0757, std.dev.: 0.0410) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.29% (0.6844 => 0.7001, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.24% (0.8743 => 0.8939, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.19% (4.6200 => 4.7212, std.dev.: 0.0344) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.14% (1.3053 => 1.3332, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.95% (0.8032 => 0.8189, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/bigfib: 1.93% (0.6305 => 0.6427, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.91% (4.5725 => 4.6598, std.dev.: 0.0307) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.85% (0.5452 => 0.5553, std.dev.: 0.0037) MultiSource/Applications/SIBsim4/SIBsim4: 1.16% (1.3055 => 1.3206, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 1.10% (15.8843 => 16.0593, std.dev.: 0.0310) MultiSource/Applications/JM/ldecod/ldecod: 1.01% (6.9701 => 7.0407, std.dev.: 0.0130) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.15% (2.0057 => 2.0287, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.14% (1.5653 => 1.5831, std.dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.84% (0.2943 => 0.2830, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.40% (1.0442 => 1.0191, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.50% (0.9158 => 0.9021, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.08% (17.1085 => 15.7255, std.dev.: 0.5046) SingleSource/Benchmarks/Misc/ffbench: -4.36% (1.3852 => 1.3248, std.dev.: 0.0130) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.60% (1.0709 => 1.0880, std.dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.59% (0.3709 => 0.3731, std.dev.: 0.0126) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.91% (0.0219 => 0.0221, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.70% (0.0426 => 0.0429, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.12% (0.0330 => 0.0323, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.96% (0.0312 => 0.0315, std.dev.: 0.0102) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0424 => 0.0426, std.dev.: 0.0119) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0203 => 0.0204, std.dev.: 0.0059) SingleSource/UnitTests/Vector/Altivec/test1: 0.92% (0.0217 => 0.0219, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/Burg/burg: 30.00% (0.0010 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.30% (0.1456 => 0.1475, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 2.52% (1.1560 => 1.1851, std.dev.: 0.0422) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.55% (0.4002 => 0.3940, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.03% (0.1450 => 0.1435, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.31% (0.0651 => 0.0649, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -28.16% (0.0277 => 0.0199, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.93% (0.0549 => 0.0598, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.18% (1.1484 => 1.1505, std.dev.: 0.0128) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -87.50% (0.0008 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.92% (0.0604 => 0.0532, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.39% (0.0264 => 0.0226, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.27% (0.8076 => 0.8098, std.dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 21.43% (0.0070 => 0.0085, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.03% (8.6126 => 8.6104, std.dev.: 0.0131) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.90% (16.4461 => 17.9095, std.dev.: 0.2336) MultiSource/Applications/sqlite3/sqlite3: 2344.68% (0.6332 => 15.4797, std.dev.: 0.3954) MultiSource/Benchmarks/McCat/08-main/main: 50.68% (0.1831 => 0.2759, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.78% (0.1559 => 0.1500, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7269.39% (0.3123 => 23.0146, std.dev.: 0.3237) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1557.83% (0.3344 => 5.5438, std.dev.: 0.0987) SingleSource/Benchmarks/Misc-C++/Large/ray: 42.51% (0.2364 => 0.3369, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/bigfib: 6.94% (0.6010 => 0.6427, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/mandel: 3.96% (0.0429 => 0.0446, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.64% (0.3266 => 0.3483, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: 4.67% (0.1969 => 0.2061, std.dev.: 0.0519) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.04% (0.0224 => 0.0242, std.dev.: 0.0077) SingleSource/UnitTests/byval-alignment: -31.74% (0.0230 => 0.0157, std.dev.: 0.0061) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0484, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 6.70% (0.1462 => 0.1560, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4054, std.dev.: 0.0433) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0708, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4893, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5230, std.dev.: 0.0668) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2656, std.dev.: 0.1294) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0767, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3624, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3843, std.dev.: 0.0387) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0860, std.dev.: 0.0022) SingleSource/Regression/C/uint64_to_float: -29.61% (2.1832 => 1.5367, std.dev.: 0.0178) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.40% (0.0810 => 0.0959, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 18.26% (0.1112 => 0.1315, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.57% (0.0848 => 0.0980, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.01% (0.0830 => 0.0938, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.47% (0.2180 => 0.2430, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.69% (0.4127 => 0.4568, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.67% (0.6010 => 0.6651, std.dev.: 0.0118) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.20% (0.3137 => 0.3457, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.03% (2.1401 => 2.3548, std.dev.: 0.0643) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.66% (0.8321 => 0.9125, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.58% (0.7473 => 0.8189, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.50% (0.3295 => 0.3608, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.30% (0.4847 => 0.5298, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.16% (0.9435 => 1.0299, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.05% (0.1425 => 0.1554, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.90% (0.1157 => 0.1260, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.60% (0.2279 => 0.2475, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 8.44% (1.2222 => 1.3254, std.dev.: 0.0115) MultiSource/Applications/spiff/spiff: 8.34% (0.7950 => 0.8613, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.32% (0.1466 => 0.1588, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 8.10% (0.6287 => 0.6796, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/health/health: 8.09% (0.1347 => 0.1456, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.09% (0.8148 => 0.8807, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: 8.06% (0.3226 => 0.3486, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.82% (0.1983 => 0.2138, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.73% (3.1832 => 3.4292, std.dev.: 0.0927) MultiSource/Applications/treecc/treecc: 7.37% (1.9948 => 2.1419, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.10% (0.2240 => 0.2399, std.dev.: 0.0020) MultiSource/Applications/viterbi/viterbi: 6.98% (0.1577 => 0.1687, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.97% (0.5191 => 0.5553, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.76% (0.3003 => 0.3206, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.59% (1.3279 => 1.4154, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.52% (13.1811 => 14.0408, std.dev.: 0.1884) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.43% (1.2526 => 1.3332, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/football/football: 6.43% (0.8768 => 0.9332, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.38% (0.1756 => 0.1868, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.35% (0.2519 => 0.2679, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.30% (0.6586 => 0.7001, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/bh/bh: 6.20% (0.2985 => 0.3170, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 6.17% (2.2184 => 2.3552, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.16% (0.8420 => 0.8939, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.16% (1.1685 => 1.2405, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.07% (1.6386 => 1.7380, std.dev.: 0.0275) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.05% (0.2133 => 0.2262, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.00% (1.1606 => 1.2302, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.98% (0.5817 => 0.6165, std.dev.: 0.0064) MultiSource/Applications/SPASS/SPASS: 5.80% (14.2605 => 15.0878, std.dev.: 0.0405) MultiSource/Benchmarks/MallocBench/gs/gs: 5.76% (4.1305 => 4.3684, std.dev.: 0.0115) MultiSource/Applications/sgefa/sgefa: 5.74% (0.2999 => 0.3171, std.dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 5.67% (1.1271 => 1.1910, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 5.61% (0.9074 => 0.9583, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/lists1: 5.59% (0.2969 => 0.3135, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.57% (0.5961 => 0.6293, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.45% (0.2844 => 0.2999, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.41% (0.1885 => 0.1987, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.31% (1.1170 => 1.1763, std.dev.: 0.0118) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.29% (0.4783 => 0.5036, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 5.19% (1.4269 => 1.5010, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.19% (0.9688 => 1.0191, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.18% (0.8457 => 0.8895, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.15% (4.1763 => 4.3913, std.dev.: 0.0499) MultiSource/Applications/lemon/lemon: 5.13% (1.0945 => 1.1506, std.dev.: 0.0105) MultiSource/Applications/lua/lua: 5.11% (3.8189 => 4.0142, std.dev.: 0.0334) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.11% (0.3657 => 0.3844, std.dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: 5.08% (1.2568 => 1.3206, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.02% (0.8611 => 0.9043, std.dev.: 0.0068) MultiSource/Applications/ClamAV/clamscan: 5.01% (14.7684 => 15.5090, std.dev.: 0.1009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 4.97% (0.9039 => 0.9488, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.95% (8.6476 => 9.0757, std.dev.: 0.0410) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.94% (0.9908 => 1.0397, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 4.93% (0.8597 => 0.9021, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.83% (0.8697 => 0.9117, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 4.83% (0.8204 => 0.8600, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 4.80% (0.8007 => 0.8391, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 4.77% (15.3280 => 16.0593, std.dev.: 0.0310) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 4.76% (0.9069 => 0.9501, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 4.75% (0.8855 => 0.9276, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 4.72% (0.8261 => 0.8651, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.71% (0.8069 => 0.8449, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.63% (0.8050 => 0.8423, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.59% (0.7932 => 0.8296, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 4.59% (6.7320 => 7.0407, std.dev.: 0.0130) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.57% (0.8340 => 0.8721, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 4.56% (0.8359 => 0.8740, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.55% (0.8331 => 0.8710, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 4.44% (0.8712 => 0.9099, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4.44% (0.8317 => 0.8686, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.43% (0.9056 => 0.9457, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.38% (0.8066 => 0.8419, std.dev.: 0.0063) MultiSource/Benchmarks/PAQ8p/paq8p: 4.37% (2.3764 => 2.4803, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.37% (0.8518 => 0.8890, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.35% (0.8316 => 0.8678, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 4.32% (0.8927 => 0.9313, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.32% (0.8338 => 0.8698, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.30% (0.8286 => 0.8642, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 4.29% (0.8048 => 0.8393, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 4.26% (0.8805 => 0.9180, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.23% (0.8086 => 0.8428, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.22% (0.8885 => 0.9260, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.18% (0.7966 => 0.8299, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.16% (0.2741 => 0.2855, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.14% (1.2602 => 1.3124, std.dev.: 0.0115) MultiSource/Applications/d/make_dparser: 4.07% (3.2366 => 3.3682, std.dev.: 0.0220) MultiSource/Benchmarks/McCat/18-imp/imp: 4.00% (0.3503 => 0.3643, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.98% (0.3717 => 0.3865, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.95% (0.8716 => 0.9060, std.dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: 3.87% (0.9810 => 1.0190, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.84% (4.4873 => 4.6598, std.dev.: 0.0307) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.30% (4.5702 => 4.7212, std.dev.: 0.0344) MultiSource/Applications/lambda-0_1_3/lambda: 3.11% (0.7557 => 0.7792, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash2: 3.10% (0.4125 => 0.4253, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.75% (1.4479 => 1.4877, std.dev.: 0.0068) MultiSource/Applications/oggenc/oggenc: 2.66% (4.9628 => 5.0950, std.dev.: 0.0127) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.39% (0.8995 => 0.9210, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 198.48% (28.5821 => 85.3118, std.dev.: 0.0767) MultiSource/Benchmarks/Prolangs-C++/city/city: 53.27% (0.0199 => 0.0305, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/pi: 39.97% (1.5795 => 2.2108, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 29.26% (2.9096 => 3.7609, std.dev.: 0.0214) SingleSource/Benchmarks/Shootout-C++/heapsort: 21.94% (3.0515 => 3.7210, std.dev.: 0.2241) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.20% (4.8436 => 5.8705, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.97% (0.7597 => 0.8962, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.89% (8.2783 => 9.7589, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/misr: 15.75% (0.4001 => 0.4631, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.68% (0.3186 => 0.3590, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.60% (2.7995 => 3.1242, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.26% (1.1857 => 1.3073, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 10.21% (7.4933 => 8.2584, std.dev.: 0.0564) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.74% (23.5781 => 25.4031, std.dev.: 0.0800) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.23% (3.9917 => 4.2804, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.07% (2.9753 => 3.1558, std.dev.: 0.0553) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 6.02% (4.8660 => 5.1591, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.85% (3.3761 => 3.5735, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.82% (4.5327 => 4.7964, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.26% (5.3218 => 5.6016, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.22% (5.4187 => 5.7017, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 5.01% (0.4353 => 0.4571, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.87% (0.5214 => 0.5468, std.dev.: 0.0034) MultiSource/Applications/aha/aha: 4.75% (3.3398 => 3.4984, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: 4.61% (1.3037 => 1.3638, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 4.19% (4.8362 => 5.0387, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.57% (0.3587 => 0.3715, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: 3.56% (1.2061 => 1.2490, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.29% (1.0388 => 1.0730, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 3.18% (0.3937 => 0.4062, std.dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 2.99% (6.7064 => 6.9072, std.dev.: 0.0233) SingleSource/Benchmarks/McGill/queens: 2.23% (1.7056 => 1.7437, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.11% (0.6150 => 0.6280, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.08% (3.4104 => 3.4815, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/methcall: 1.67% (8.2676 => 8.4060, std.dev.: 0.0087) MultiSource/Benchmarks/llubenchmark/llu: 1.60% (1.9967 => 2.0287, std.dev.: 0.0037) MultiSource/Benchmarks/sim/sim: 1.28% (3.8206 => 3.8694, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/ReedSolomon: 1.24% (8.5322 => 8.6380, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.23% (4.9469 => 5.0078, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/flops-7: 1.18% (1.7156 => 1.7358, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.09% (1.9302 => 1.9512, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.03% (11.5316 => 11.6509, std.dev.: 0.0430) SingleSource/Benchmarks/Misc/flops-3: 1.01% (2.0670 => 2.0878, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.16% (2.8951 => 1.6746, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -25.14% (7.2130 => 5.3995, std.dev.: 0.0913) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.33% (1.4529 => 1.1575, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.94% (9.9065 => 8.2286, std.dev.: 0.0151) MultiSource/Benchmarks/Olden/em3d/em3d: -12.75% (5.4641 => 4.7675, std.dev.: 0.0232) SingleSource/Benchmarks/Shootout-C++/ary3: -10.13% (1.9999 => 1.7973, std.dev.: 0.0611) SingleSource/Benchmarks/Misc/flops-8: -9.43% (2.5609 => 2.3195, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: -9.06% (1.1216 => 1.0200, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: -8.99% (63.1822 => 57.4992, std.dev.: 0.1268) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.47% (0.3269 => 0.2992, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.26% (1.0512 => 0.9644, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.86% (3.2169 => 2.9642, std.dev.: 0.0355) SingleSource/Benchmarks/Misc/ffbench: -7.33% (1.4296 => 1.3248, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.24% (4.7482 => 4.4521, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/FloatMM: -5.71% (0.8807 => 0.8304, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops: -5.49% (9.3748 => 8.8599, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.38% (6.2275 => 5.8924, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.83% (5.6343 => 5.3620, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/himenobmtxpa: -4.78% (4.3552 => 4.1469, std.dev.: 0.0736) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.55% (4.7449 => 4.5289, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.44% (6.1706 => 5.8964, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.37% (4.9453 => 4.7291, std.dev.: 0.0026) MultiSource/Applications/siod/siod: -4.18% (3.6643 => 3.5111, std.dev.: 0.0326) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.83% (3.7148 => 3.5726, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.73% (5.1557 => 4.9633, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/perlin: -3.72% (5.1084 => 4.9186, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/methcall: -3.61% (8.9760 => 8.6523, std.dev.: 0.0210) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.48% (3.9188 => 3.7826, std.dev.: 0.0527) MultiSource/Applications/lua/lua: -3.37% (29.8330 => 28.8280, std.dev.: 0.1103) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.25% (2.8773 => 2.7839, std.dev.: 0.0303) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.18% (5.4300 => 5.2573, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.77% (2.6356 => 2.5626, std.dev.: 0.0154) MultiSource/Benchmarks/Olden/tsp/tsp: -2.59% (1.4861 => 1.4476, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/fbench: -2.48% (3.3840 => 3.3000, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.79% (3.3479 => 3.2881, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/flops-5: -1.67% (2.8957 => 2.8472, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.64% (15.8853 => 15.6243, std.dev.: 0.0182) MultiSource/Benchmarks/FreeBench/neural/neural: -1.60% (1.0841 => 1.0668, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.27% (4.2466 => 4.1925, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-6: -1.21% (2.4416 => 2.4120, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.13% (4.7794 => 4.7252, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.11% (6.0224 => 5.9553, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 6.02% (1.0262 => 1.0880, std.dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.48% (0.2463 => 0.3731, std.dev.: 0.0126) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 79.67% (0.0123 => 0.0221, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.15% (0.0408 => 0.0429, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 27.17% (0.0254 => 0.0323, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0102) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.94% (0.0384 => 0.0426, std.dev.: 0.0119) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0059) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.57% (0.1438 => 0.1475, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 4.61% (1.1329 => 1.1851, std.dev.: 0.0422) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.38% (0.4164 => 0.3940, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.82% (0.1369 => 0.1435, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.25% (0.0641 => 0.0649, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.05% (0.0195 => 0.0199, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.46% (0.0578 => 0.0598, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.59% (1.1437 => 1.1505, std.dev.: 0.0128) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2800.00% (0.0001 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.15% (0.0627 => 0.0532, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.56% (0.0180 => 0.0226, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.01% (0.8017 => 0.8098, std.dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 37.10% (0.0062 => 0.0085, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 22:43:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 00:43:26 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121130064326.E6FE42A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/6407?compare_to=6404&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6407, Order: 168976, Start Time: 2012-11-30 05:09:22, End Time: 2012-11-30 06:44:02 To: 6404, Order: 168970, Start Time: 2012-11-30 03:11:12, End Time: 2012-11-30 04:46:20 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 2 (183 on baseline) Added Tests: 0 (52 on baseline) Unchanged Tests: 1092 (854 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -3.17% (0.3947 => 0.3822, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.01% (1.2948 => 1.2817, std.dev.: 0.0031) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 74.76% (31.3723 => 54.8257, std.dev.: 0.0380) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.85% (2.0478 => 2.1061, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/salsa20: 2.60% (7.4937 => 7.6889, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 2.15% (3.1932 => 3.2617, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.46% (0.1431 => 0.1310, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.72% (0.3821 => 0.3526, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.14% (0.9542 => 0.8861, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -6.73% (2.4924 => 2.3247, std.dev.: 0.0150) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.47% (0.2428 => 0.2271, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.46% (0.3142 => 0.2939, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.40% (0.3357 => 0.3142, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-4: -6.29% (0.3880 => 0.3636, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.26% (0.3884 => 0.3641, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.22% (0.3812 => 0.3575, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.21% (0.3848 => 0.3609, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -6.20% (0.2160 => 0.2026, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -6.16% (0.3831 => 0.3595, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/synchronized: -6.16% (0.3896 => 0.3656, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/for-in: -6.12% (0.4033 => 0.3786, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.09% (0.3891 => 0.3654, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/exceptions: -6.08% (0.4176 => 0.3922, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.06% (0.6484 => 0.6091, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.02% (0.5478 => 0.5148, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.00% (0.1716 => 0.1613, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/ReedSolomon: -5.96% (0.1879 => 0.1767, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.96% (0.3658 => 0.3440, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.96% (0.1796 => 0.1689, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -5.94% (16.1920 => 15.2297, std.dev.: 0.0139) MultiSource/Benchmarks/mafft/pairlocalalign: -5.92% (9.2283 => 8.6818, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: -5.91% (0.1761 => 0.1657, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.88% (0.5863 => 0.5518, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.87% (0.5925 => 0.5577, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.86% (0.2355 => 0.2217, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: -5.85% (7.0961 => 6.6813, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.84% (0.5805 => 0.5466, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.83% (0.5591 => 0.5265, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.83% (0.5802 => 0.5464, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.80% (0.6395 => 0.6024, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -5.79% (0.4199 => 0.3956, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.78% (1.3722 => 1.2929, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.77% (0.5705 => 0.5376, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.75% (0.6194 => 0.5838, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.75% (0.5569 => 0.5249, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.75% (0.9852 => 0.9286, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.73% (0.5849 => 0.5514, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.69% (0.6395 => 0.6031, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.68% (0.5581 => 0.5264, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: -5.68% (0.9179 => 0.8658, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.67% (0.7198 => 0.6790, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.67% (0.5575 => 0.5259, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.67% (0.5859 => 0.5527, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.66% (0.3057 => 0.2884, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.66% (1.2300 => 1.1604, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.65% (1.0544 => 0.9948, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.64% (4.0323 => 3.8047, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.64% (0.6297 => 0.5942, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.63% (0.5857 => 0.5527, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.63% (4.8161 => 4.5449, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.63% (0.6681 => 0.6305, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.62% (0.6260 => 0.5908, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.62% (0.6189 => 0.5841, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.62% (0.6304 => 0.5950, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.60% (0.7524 => 0.7103, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.59% (4.8802 => 4.6075, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.59% (0.6676 => 0.6303, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.59% (0.5567 => 0.5256, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.55% (0.6230 => 0.5884, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -5.54% (0.4280 => 0.4043, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.53% (6.7716 => 6.3970, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/methcall: -5.52% (0.3025 => 0.2858, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -5.52% (4.3330 => 4.0938, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.52% (0.6052 => 0.5718, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.51% (0.6446 => 0.6091, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.50% (1.4642 => 1.3836, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.50% (0.5941 => 0.5614, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.50% (0.5456 => 0.5156, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.49% (0.3931 => 0.3715, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.49% (0.2695 => 0.2547, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.46% (0.6736 => 0.6368, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.46% (0.8521 => 0.8056, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: -5.45% (1.3148 => 1.2431, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.45% (0.6440 => 0.6089) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.45% (4.5069 => 4.2613, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.45% (0.3323 => 0.3142, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.44% (1.6364 => 1.5473, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.44% (2.1713 => 2.0532, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: -5.43% (0.2871 => 0.2715, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -5.43% (0.3059 => 0.2893, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.42% (0.7339 => 0.6941, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.42% (0.5570 => 0.5268, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.42% (0.3194 => 0.3021, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.41% (1.2784 => 1.2092, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.40% (0.3016 => 0.2853, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.39% (0.3837 => 0.3630, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.39% (0.7919 => 0.7492, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.39% (0.6293 => 0.5954, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.35% (0.3252 => 0.3078, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.34% (0.2548 => 0.2412, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.32% (14.2083 => 13.4519, std.dev.: 0.0149) MultiSource/Benchmarks/nbench/nbench: -5.32% (1.1530 => 1.0917, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/matrix: -5.31% (0.3255 => 0.3082, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -5.31% (0.3406 => 0.3225, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.31% (0.2939 => 0.2783, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.31% (3.5339 => 3.3464, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.30% (0.2903 => 0.2749, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.30% (0.6033 => 0.5713, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -5.30% (1.1450 => 1.0843, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.30% (0.4151 => 0.3931, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.26% (0.2985 => 0.2828, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.25% (0.2933 => 0.2779, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -5.22% (0.3026 => 0.2868, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.21% (17.1032 => 16.2113, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hello: -5.19% (0.2849 => 0.2701, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -5.19% (0.3394 => 0.3218, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.18% (1.2210 => 1.1577, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/05-eks/eks: -5.18% (0.4515 => 0.4281, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: -5.17% (0.3481 => 0.3301, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -5.17% (0.3446 => 0.3268, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.14% (0.4321 => 0.4099, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -5.12% (15.5079 => 14.7133, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/strcat: -5.12% (0.2989 => 0.2836, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.11% (1.2221 => 1.1596, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -5.10% (1.3864 => 1.3157, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.07% (0.4916 => 0.4667, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -5.05% (1.2515 => 1.1883, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: -5.04% (0.2659 => 0.2525, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.02% (8.0126 => 7.6106, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.00% (0.5999 => 0.5699, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: -5.00% (0.4861 => 0.4618, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.97% (0.2999 => 0.2850, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.95% (0.2385 => 0.2267, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.94% (0.3483 => 0.3311, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -4.92% (0.4248 => 0.4039, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.92% (0.2278 => 0.2166, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -4.92% (0.3621 => 0.3443, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -4.91% (0.3581 => 0.3405, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: -4.91% (3.5154 => 3.3429, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.88% (0.3849 => 0.3661, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -4.84% (0.3867 => 0.3680, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -4.83% (15.2527 => 14.5162, std.dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.80% (0.4813 => 0.4582, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -4.79% (4.0594 => 3.8650, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.77% (0.6660 => 0.6342, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.72% (0.6667 => 0.6352, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -4.62% (0.7447 => 0.7103, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: -4.58% (0.4524 => 0.4317, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -4.57% (0.7982 => 0.7617, std.dev.: 0.0060) MultiSource/Applications/oggenc/oggenc: -4.57% (5.0226 => 4.7931, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: -4.53% (2.1401 => 2.0432, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.50% (0.4427 => 0.4228, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.47% (0.9557 => 0.9130, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.47% (1.6474 => 1.5738, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: -4.46% (0.3271 => 0.3125, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.42% (0.7021 => 0.6711, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.41% (0.5329 => 0.5094, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.41% (22.4056 => 21.4176, std.dev.: 0.0181) MultiSource/Applications/siod/siod: -4.40% (2.4021 => 2.2965, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: -4.38% (34.0927 => 32.6010, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/sieve: -4.36% (0.3788 => 0.3623, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -4.35% (18.2933 => 17.4980, std.dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.34% (0.3319 => 0.3175, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.23% (0.9077 => 0.8693, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -4.13% (0.6750 => 0.6471, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: -4.10% (0.7779 => 0.7460, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: -3.94% (0.8418 => 0.8086, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.94% (0.6347 => 0.6097, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.84% (0.3491 => 0.3357, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: -3.82% (0.6441 => 0.6195, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.66% (2.2587 => 2.1760, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: -3.61% (1.5610 => 1.5046, std.dev.: 0.0030) SingleSource/UnitTests/Vector/constpool: -2.74% (20.7746 => 20.2055, std.dev.: 0.0459) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.62% (5.4682 => 5.3248, std.dev.: 0.0136) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.48% (1.8100 => 0.6972, std.dev.: 0.0071) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7512, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Misc/richards_benchmark: -8.66% (1.2842 => 1.1730, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.79% (2.2633 => 2.1776, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3989, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0245, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.13% (1.3096 => 1.2817, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4684, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Nov 29 22:59:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 00:59:44 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121130065944.A59F92A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/6408?compare_to=6402&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6408, Order: 168972, Start Time: 2012-11-30 04:37:18, End Time: 2012-11-30 07:00:18 To: 6402, Order: 168962, Start Time: 2012-11-30 01:12:17, End Time: 2012-11-30 03:38:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 83 (174 on baseline) Performance Improvements: 22 (42 on baseline) Added Tests: 0 (186 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 983 (669 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.79% (0.3204 => 0.3774, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 14.45% (0.6894 => 0.7890, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.68% (0.6148 => 0.6989, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.91% (0.1906 => 0.2152, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.32% (0.4668 => 0.5243, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 12.17% (0.3705 => 0.4156, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 12.02% (0.3079 => 0.3449, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/sieve: 11.88% (0.3972 => 0.4444, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.87% (4.4155 => 4.9394, std.dev.: 0.0561) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.69% (0.4303 => 0.4806, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.53% (4.8446 => 5.4032, std.dev.: 0.0288) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.45% (0.9022 => 1.0055, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 11.43% (1.5684 => 1.7477, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.30% (0.3912 => 0.4354, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 10.87% (0.7206 => 0.7989, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/football/football: 10.86% (0.9900 => 1.0975, std.dev.: 0.0284) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.85% (1.5855 => 1.7576, std.dev.: 0.0107) SingleSource/Benchmarks/LivermoreLoops/kernel18: 10.77% (0.1485 => 0.1645, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.76% (0.6916 => 0.7660, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.69% (0.5942 => 0.6577, std.dev.: 0.0104) SingleSource/Benchmarks/Linpack/linpack-pc: 10.68% (0.2892 => 0.3201, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.58% (1.7489 => 1.9339, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.55% (0.3119 => 0.3448, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/health/health: 10.26% (0.1462 => 0.1612, std.dev.: 0.0009) SingleSource/Benchmarks/LivermoreLoops/kernel17: 10.17% (0.1013 => 0.1116, std.dev.: 0.0013) SingleSource/Benchmarks/LivermoreLoops/kernel16: 10.06% (0.1133 => 0.1247, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.90% (0.6849 => 0.7527, std.dev.: 0.0107) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.83% (0.2105 => 0.2312, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.76% (0.6371 => 0.6993, std.dev.: 0.0047) SingleSource/Benchmarks/LivermoreLoops/kernel21: 9.37% (0.1110 => 0.1214, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 9.15% (0.8547 => 0.9329, std.dev.: 0.0231) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.08% (0.1167 => 0.1273, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.08% (0.7876 => 0.8591, std.dev.: 0.0224) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.73% (1.5161 => 1.6484, std.dev.: 0.0431) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.66% (0.6191 => 0.6727, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.65% (0.7222 => 0.7847, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.59% (0.6903 => 0.7496, std.dev.: 0.0198) MultiSource/Benchmarks/nbench/nbench: 8.17% (1.3347 => 1.4438, std.dev.: 0.0157) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.15% (5.6720 => 6.1343, std.dev.: 0.0431) SingleSource/Benchmarks/Misc/flops: 7.81% (0.1972 => 0.2126, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.77% (0.9099 => 0.9806, std.dev.: 0.0122) MultiSource/Applications/lua/lua: 7.71% (4.3947 => 4.7337, std.dev.: 0.0910) MultiSource/Applications/lemon/lemon: 7.67% (1.2069 => 1.2995, std.dev.: 0.0251) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.56% (1.2276 => 1.3204, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hello: 7.56% (0.2924 => 0.3145, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 7.47% (0.1674 => 0.1799, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.18% (2.3146 => 2.4809, std.dev.: 0.0467) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.16% (0.5059 => 0.5421, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.05% (5.6710 => 6.0708, std.dev.: 0.0383) MultiSource/Applications/treecc/treecc: 6.87% (2.3813 => 2.5448, std.dev.: 0.0307) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.65% (0.6832 => 0.7286, std.dev.: 0.0134) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.31% (0.5233 => 0.5563, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.93% (4.6957 => 4.9742, std.dev.: 0.0454) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.51% (1.1171 => 1.1787, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.79% (0.7011 => 0.7347, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.77% (0.7236 => 0.7581, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4.13% (0.6785 => 0.7065, std.dev.: 0.0093) MultiSource/Benchmarks/mafft/pairlocalalign: 3.84% (10.7960 => 11.2110, std.dev.: 0.0665) MultiSource/Applications/JM/ldecod/ldecod: 3.42% (9.8843 => 10.2227, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.65% (0.7016 => 0.7202, std.dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/health/health: 16.61% (0.4623 => 0.5391, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 15.16% (0.8660 => 0.9973, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: 12.31% (1.1052 => 1.2413, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 9.78% (0.2281 => 0.2504, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 8.52% (11.7239 => 12.7230, std.dev.: 0.0378) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.39% (6.0600 => 6.5076, std.dev.: 0.0204) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.14% (9.1857 => 9.8417, std.dev.: 0.1224) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 7.04% (1.5276 => 1.6351, std.dev.: 0.0144) MultiSource/Applications/JM/lencod/lencod: 6.67% (7.7238 => 8.2386, std.dev.: 0.0229) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.10% (3.1346 => 3.3259, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.87% (30.2547 => 32.0293, std.dev.: 0.2157) MultiSource/Applications/lemon/lemon: 5.30% (1.4364 => 1.5126, std.dev.: 0.0235) SingleSource/Benchmarks/McGill/chomp: 4.09% (1.2218 => 1.2718, std.dev.: 0.0123) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.43% (0.3324 => 0.3438, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 2.67% (4.6680 => 4.7925, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.83% (4.8017 => 4.8897, std.dev.: 0.0250) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.64% (2.3243 => 2.3625, std.dev.: 0.0022) SingleSource/Benchmarks/LivermoreLoops/kernel14: 1.37% (1.5542 => 1.5755, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 1.31% (3.1627 => 3.2041, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.19% (2.1259 => 2.1513, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.15% (0.9621 => 0.9732, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.10% (5.4151 => 5.4747, std.dev.: 0.0114) MultiSource/Benchmarks/mafft/pairlocalalign: 1.05% (27.8513 => 28.1425, std.dev.: 0.0133) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -13.13% (0.6816 => 0.5921, std.dev.: 0.0213) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -12.65% (0.6768 => 0.5912, std.dev.: 0.0227) MultiSource/Applications/d/make_dparser: -11.00% (4.2445 => 3.7775, std.dev.: 0.1693) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -10.69% (0.2142 => 0.1913, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -10.19% (0.6439 => 0.5783, std.dev.: 0.0242) MultiSource/Benchmarks/Prolangs-C++/life/life: -10.00% (0.1170 => 0.1053, std.dev.: 0.0042) MultiSource/Benchmarks/sim/sim: -9.91% (0.4137 => 0.3727, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -9.58% (0.2109 => 0.1907, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: -8.91% (21.3735 => 19.4692, std.dev.: 0.7304) MultiSource/Benchmarks/Prolangs-C++/trees/trees: -8.50% (0.1283 => 0.1174, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -8.42% (0.6297 => 0.5767, std.dev.: 0.0184) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -7.44% (0.4490 => 0.4156, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: -7.25% (1.0265 => 0.9521, std.dev.: 0.0153) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.54% (0.3578 => 0.3344, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -6.04% (12.5543 => 11.7961, std.dev.: 0.2167) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -51.16% (8.8019 => 4.2986, std.dev.: 1.1282) MultiSource/Benchmarks/VersaBench/dbms/dbms: -20.54% (1.9564 => 1.5545, std.dev.: 0.0856) MultiSource/Applications/SPASS/SPASS: -13.73% (14.9708 => 12.9154, std.dev.: 0.5321) MultiSource/Benchmarks/Fhourstones/fhourstones: -10.36% (1.9406 => 1.7396, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -10.31% (9.4371 => 8.4639, std.dev.: 0.2277) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.93% (5.7729 => 5.6616, std.dev.: 0.0125) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.25% (2.2102 => 2.1825, std.dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 2.03% (69.3451 => 70.7514, std.dev.: 0.0326) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.15% (0.1370 => 0.1368, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0421 => 0.0421, std.dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.45% (0.0652 => 0.0668, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 0.06% (493.8813 => 494.1635, std.dev.: 0.2219) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 11.87% (63.2438 => 70.7514, std.dev.: 0.0326) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0421, std.dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43720.48% (1.1277 => 494.1635, std.dev.: 0.2219) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.30% (0.5229 => 1.5389, std.dev.: 0.1142) MultiSource/Applications/SPASS/SPASS: 23.23% (14.9895 => 18.4719, std.dev.: 0.3439) MultiSource/Applications/kimwitu++/kc: 49.12% (14.1553 => 21.1078, std.dev.: 0.5937) MultiSource/Benchmarks/MallocBench/gs/gs: 20.45% (4.1105 => 4.9510, std.dev.: 0.2164) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 49.20% (1.1048 => 1.6484, std.dev.: 0.0431) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 430.25% (7.1582 => 37.9564, std.dev.: 0.3549) SingleSource/Benchmarks/Misc-C++-EH/spirit: 81.41% (3.4629 => 6.2822, std.dev.: 0.3318) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.77% (0.6222 => 1.0314, std.dev.: 0.0671) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11342.50% (0.0720 => 8.2386, std.dev.: 0.0229) MultiSource/Applications/SIBsim4/SIBsim4: 3854700.00% (0.0001 => 3.8548, std.dev.: 0.0158) MultiSource/Applications/SPASS/SPASS: 12915300.00% (0.0001 => 12.9154, std.dev.: 0.5321) MultiSource/Applications/kimwitu++/kc: 52300.00% (0.0001 => 0.0524, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 64300.00% (0.0001 => 0.0644, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14500.00% (0.0001 => 0.0146, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576200.00% (0.0001 => 0.5763, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9980900.00% (0.0001 => 9.9810, std.dev.: 0.0188) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5855400.00% (0.0001 => 5.8555, std.dev.: 0.7850) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1726.91% (1.1194 => 20.4504, std.dev.: 0.5842) MultiSource/Applications/ClamAV/clamscan: 70.18% (22.1758 => 37.7381, std.dev.: 0.0149) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 60.88% (2.9384 => 4.7274, std.dev.: 0.3483) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.77% (7.0540 => 11.1292, std.dev.: 0.2175) SingleSource/Benchmarks/Misc/flops: 48.46% (0.1432 => 0.2126, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 46.59% (21.9371 => 32.1577, std.dev.: 0.0691) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 44.98% (8.1363 => 11.7961, std.dev.: 0.2167) MultiSource/Benchmarks/FreeBench/distray/distray: 44.98% (0.1056 => 0.1531, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/almabench: 44.66% (0.0730 => 0.1056, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 39.78% (0.2700 => 0.3774, std.dev.: 0.0017) SingleSource/Benchmarks/Stanford/Oscar: 32.39% (0.0636 => 0.0842, std.dev.: 0.0025) SingleSource/UnitTests/vla: 30.99% (0.0355 => 0.0465, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: 30.30% (0.1175 => 0.1531, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/bisort/bisort: 29.32% (0.0614 => 0.0794, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/messages-2: 28.55% (0.0662 => 0.0851, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.14% (0.0479 => 0.0609, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 27.13% (0.1268 => 0.1612, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 27.00% (0.1163 => 0.1477, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 26.96% (0.1695 => 0.2152, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/treeadd/treeadd: 26.92% (0.0416 => 0.0528, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.91% (3.8922 => 4.9394, std.dev.: 0.0561) MultiSource/Benchmarks/MallocBench/espresso/espresso: 26.70% (4.2646 => 5.4032, std.dev.: 0.0288) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 26.62% (0.0447 => 0.0566, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 26.53% (0.3441 => 0.4354, std.dev.: 0.0019) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 25.91% (0.0467 => 0.0588, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 25.57% (0.5569 => 0.6993, std.dev.: 0.0047) MultiSource/Applications/treecc/treecc: 25.53% (2.0273 => 2.5448, std.dev.: 0.0307) MultiSource/Applications/lambda-0_1_3/lambda: 25.51% (0.7433 => 0.9329, std.dev.: 0.0231) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 25.46% (1.5415 => 1.9339, std.dev.: 0.0112) SingleSource/Benchmarks/Stanford/FloatMM: 25.44% (0.0401 => 0.0503, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/em3d/em3d: 25.37% (0.1695 => 0.2125, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 25.11% (0.0442 => 0.0553, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 25.02% (0.2758 => 0.3448, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 24.94% (0.0437 => 0.0546, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.94% (0.0770 => 0.0962, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/spellcheck: 24.74% (0.4203 => 0.5243, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 24.64% (0.8067 => 1.0055, std.dev.: 0.0021) SingleSource/Benchmarks/Stanford/Towers: 24.63% (0.0471 => 0.0587, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/perimeter/perimeter: 24.55% (0.0770 => 0.0959, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.53% (0.1337 => 0.1665, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/reversefile: 24.35% (0.3865 => 0.4806, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.34% (0.0834 => 0.1037, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 24.25% (0.3307 => 0.4109, std.dev.: 0.0169) MultiSource/Applications/aha/aha: 23.89% (0.1151 => 0.1426, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.71% (0.1029 => 0.1273, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.59% (0.0746 => 0.0922, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: 23.56% (0.1655 => 0.2045, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/sieve: 23.34% (0.3603 => 0.4444, std.dev.: 0.0078) SingleSource/Benchmarks/McGill/exptree: 23.34% (0.0814 => 0.1004, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.30% (0.0648 => 0.0799, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.20% (1.4186 => 1.7477, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/football/football: 23.02% (0.8921 => 1.0975, std.dev.: 0.0284) MultiSource/Applications/Burg/burg: 22.89% (1.1642 => 1.4307, std.dev.: 0.0330) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 22.79% (0.0838 => 0.1029, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.77% (4.9449 => 6.0708, std.dev.: 0.0383) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.68% (2.2024 => 2.7018, std.dev.: 0.1072) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 22.64% (5.0018 => 6.1343, std.dev.: 0.0431) MultiSource/Benchmarks/BitBench/drop3/drop3: 22.61% (0.0482 => 0.0591, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: 22.57% (0.0536 => 0.0657, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 22.40% (0.2554 => 0.3126, std.dev.: 0.0180) MultiSource/Applications/lua/lua: 22.25% (3.8723 => 4.7337, std.dev.: 0.0910) MultiSource/Benchmarks/BitBench/five11/five11: 22.22% (0.0567 => 0.0693, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 22.20% (0.1892 => 0.2312, std.dev.: 0.0069) MultiSource/Benchmarks/nbench/nbench: 21.94% (1.1840 => 1.4438, std.dev.: 0.0157) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.92% (0.3121 => 0.3805, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/strcat: 21.83% (0.2831 => 0.3449, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 21.82% (0.5981 => 0.7286, std.dev.: 0.0134) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.78% (0.1566 => 0.1907, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 21.27% (0.3427 => 0.4156, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 21.20% (1.0722 => 1.2995, std.dev.: 0.0251) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 21.05% (0.8101 => 0.9806, std.dev.: 0.0122) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.77% (0.1584 => 0.1913, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.71% (0.9765 => 1.1787, std.dev.: 0.0229) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.68% (0.0793 => 0.0957, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.54% (0.4615 => 0.5563, std.dev.: 0.0106) MultiSource/Applications/viterbi/viterbi: 20.39% (0.1555 => 0.1872, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.34% (0.5860 => 0.7052, std.dev.: 0.0155) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.31% (0.1940 => 0.2334, std.dev.: 0.0084) MultiSource/Applications/oggenc/oggenc: 19.31% (5.7591 => 6.8714, std.dev.: 0.2279) SingleSource/Benchmarks/Shootout-C++/sumcol: 19.27% (0.2891 => 0.3448, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/misr: 18.96% (0.0633 => 0.0753, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 18.91% (0.0640 => 0.0761, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.67% (0.1125 => 0.1335, std.dev.: 0.0063) MultiSource/Benchmarks/mafft/pairlocalalign: 18.20% (9.4845 => 11.2110, std.dev.: 0.0665) SingleSource/Benchmarks/CoyoteBench/lpbench: 18.19% (0.0929 => 0.1098, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 18.05% (0.0798 => 0.0942, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 17.45% (0.3422 => 0.4019, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout/lists: 17.25% (0.0626 => 0.0734, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/parameter-passing: 17.24% (0.3927 => 0.4604, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.22% (0.0871 => 0.1021, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.21% (1.3050 => 1.5296, std.dev.: 0.0629) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 16.82% (0.0672 => 0.0785, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/matrix: 16.75% (0.0818 => 0.0955, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/wc: 16.71% (0.3052 => 0.3562, std.dev.: 0.0133) SingleSource/Benchmarks/Stanford/Puzzle: 16.64% (0.1268 => 0.1479, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions: 16.54% (0.3828 => 0.4461, std.dev.: 0.0006) SingleSource/UnitTests/SignlessTypes/rem: 16.52% (0.1144 => 0.1333, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.51% (0.8172 => 0.9521, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.26% (14.3668 => 16.7026, std.dev.: 0.3556) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.16% (0.1510 => 0.1754, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/except: 15.88% (0.2871 => 0.3327, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/hello: 15.88% (0.2714 => 0.3145, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/property: 15.88% (0.3886 => 0.4503, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-4: 15.75% (0.3543 => 0.4101, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.35% (0.2065 => 0.2382, std.dev.: 0.0107) SingleSource/UnitTests/ObjC/for-in: 15.30% (0.3694 => 0.4259, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 15.27% (0.2725 => 0.3141, std.dev.: 0.0149) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.21% (0.3543 => 0.4082, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 15.07% (0.3516 => 0.4046, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.86% (0.1117 => 0.1283, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.66% (0.0730 => 0.0837, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 13.80% (0.3109 => 0.3538, std.dev.: 0.0157) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.57% (0.4636 => 0.5265, std.dev.: 0.0210) MultiSource/Applications/sqlite3/sqlite3: 13.32% (17.1811 => 19.4692, std.dev.: 0.7304) MultiSource/Applications/siod/siod: 13.29% (2.2969 => 2.6022, std.dev.: 0.1128) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.27% (0.3935 => 0.4457, std.dev.: 0.0144) MultiSource/Applications/d/make_dparser: 13.25% (3.3354 => 3.7775, std.dev.: 0.1693) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.87% (1.1861 => 1.3387, std.dev.: 0.0518) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.86% (0.0933 => 0.1053, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.66% (2.2022 => 2.4809, std.dev.: 0.0467) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 12.45% (0.1044 => 0.1174, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 11.61% (0.3497 => 0.3903, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/power/power: 11.39% (0.1440 => 0.1604, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.11% (0.4879 => 0.5421, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/synchronized: 10.56% (0.3561 => 0.3937, std.dev.: 0.0087) SingleSource/UnitTests/ObjC/trivial-interface: 10.51% (0.3473 => 0.3838, std.dev.: 0.0082) MultiSource/Benchmarks/sim/sim: 10.04% (0.3387 => 0.3727, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.87% (0.1438 => 0.1580, std.dev.: 0.0049) SingleSource/UnitTests/ObjC++/Hello: 9.52% (0.5925 => 0.6489, std.dev.: 0.0128) SingleSource/UnitTests/ObjC++/property-reference-object: 9.49% (0.6030 => 0.6602, std.dev.: 0.0142) SingleSource/UnitTests/ObjC++/property-reference: 9.01% (0.7326 => 0.7986, std.dev.: 0.0184) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.63% (0.3826 => 0.4156, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary: 8.60% (0.3232 => 0.3510, std.dev.: 0.0105) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.70% (0.3817 => 0.4111, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.26% (0.3177 => 0.3344, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 149.60% (4.3953 => 10.9707, std.dev.: 0.0318) SingleSource/Benchmarks/Shootout-C++/methcall: 147.58% (5.3999 => 13.3689, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 79.94% (32.5116 => 58.5026, std.dev.: 0.0295) MultiSource/Applications/minisat/minisat: 39.57% (9.1159 => 12.7230, std.dev.: 0.0378) MultiSource/Benchmarks/Olden/health/health: 21.28% (0.4445 => 0.5391, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 19.68% (0.8333 => 0.9973, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.90% (1.1145 => 1.3028, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.78% (0.2944 => 0.3438, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 16.19% (6.6465 => 7.7229, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/tsp/tsp: 15.10% (1.0785 => 1.2413, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/mst/mst: 14.32% (0.1285 => 0.1469, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.38% (8.6802 => 9.8417, std.dev.: 0.1224) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.60% (2.8904 => 3.2256, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/richards_benchmark: 10.05% (1.1396 => 1.2541, std.dev.: 0.0014) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.27% (1.7254 => 1.8854, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/ffbench: 8.57% (0.9505 => 1.0320, std.dev.: 0.0175) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.14% (3.1334 => 3.3259, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.96% (0.9540 => 1.0109, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 5.71% (26.0924 => 27.5828, std.dev.: 0.0611) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.34% (4.2280 => 4.4537, std.dev.: 0.0165) SingleSource/Regression/C/uint64_to_float: 4.97% (0.5413 => 0.5682, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 4.61% (1.4460 => 1.5126, std.dev.: 0.0235) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.6436 => 12.1018, std.dev.: 0.0312) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 3.28% (3.1023 => 3.2041, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: 3.20% (4.6441 => 4.7925, std.dev.: 0.0124) SingleSource/Benchmarks/McGill/chomp: 2.79% (1.2373 => 1.2718, std.dev.: 0.0123) MultiSource/Benchmarks/PAQ8p/paq8p: 2.19% (85.0658 => 86.9272, std.dev.: 0.0183) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.15% (1.3677 => 1.3971, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.12% (2.3135 => 2.3625, std.dev.: 0.0022) MultiSource/Applications/aha/aha: 2.04% (3.1595 => 3.2240, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.87% (2.1424 => 2.1825, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.46% (6.5088 => 6.6036, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/sieve: 1.30% (2.4858 => 2.5181, std.dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.30% (1.0313 => 1.0447, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0503, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 1.07% (27.8444 => 28.1425, std.dev.: 0.0133) MultiSource/Applications/lambda-0_1_3/lambda: 1.04% (5.2636 => 5.3185, std.dev.: 0.0093) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.31% (6.6874 => 0.1799, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -74.97% (5.2763 => 1.3204, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/salsa20: -74.73% (0.8651 => 0.2186, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/richards_benchmark: -40.26% (0.1622 => 0.0969, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -9.97% (5.3855 => 4.8485, std.dev.: 0.1043) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.07% (5.3526 => 4.9742, std.dev.: 0.0454) MultiSource/Applications/JM/ldecod/ldecod: -2.04% (10.4361 => 10.2227, std.dev.: 0.0126) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.05% (1.9577 => 0.6842, std.dev.: 0.0096) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1681, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.08% (0.3987 => 0.2389, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.30% (4.5009 => 2.7769, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: -33.53% (1.1492 => 0.7639, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.19% (2.6546 => 2.0125, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: -19.44% (0.2161 => 0.1741, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.69% (2.6778 => 2.2844, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -9.26% (9.5636 => 8.6780, std.dev.: 0.1921) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4244, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.86% (3.2416 => 3.0515, std.dev.: 0.0150) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.60% (2.7294 => 2.5766, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7497, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.2497 => 0.2366, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.12% (0.8614 => 0.8173, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.09% (1.8329 => 1.7396, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/flops-5: -4.87% (1.5835 => 1.5064, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.46% (1.6805 => 1.6056, std.dev.: 0.0254) SingleSource/Benchmarks/Shootout/lists: -4.32% (6.2999 => 6.0276, std.dev.: 0.0082) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8911, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.31% (0.4808 => 0.4697, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.26% (0.9957 => 0.9732, std.dev.: 0.0039) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.92% (8.1563 => 7.9998, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6772, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -1.49% (10.2830 => 10.1295, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -7.88% (0.1485 => 0.1368, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.43% (0.2116 => 0.0668, std.dev.: 0.0006) Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 00:19:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 02:19:30 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121130081930.8D37F2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/6409?compare_to=6406&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6409, Order: 168983, Start Time: 2012-11-30 06:44:24, End Time: 2012-11-30 08:20:06 To: 6406, Order: 168976, Start Time: 2012-11-30 04:49:25, End Time: 2012-11-30 06:25:20 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 5 (62 on baseline) Performance Improvements: 7 (41 on baseline) Added Tests: 0 (51 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1041 (871 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.54% (0.8890 => 0.9027, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 28.11% (1.4595 => 1.8697, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.96% (4.1469 => 4.3112, std.dev.: 0.0531) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.37% (3.7826 => 3.8721, std.dev.: 0.0133) MultiSource/Applications/siod/siod: 1.54% (3.5111 => 3.5652, std.dev.: 0.0099) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -5.03% (9.3878 => 8.9153, std.dev.: 0.1104) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.56% (0.3369 => 0.3249, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -2.23% (4.7212 => 4.6157, std.dev.: 0.0322) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.01% (0.8939 => 0.8759, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -14.52% (3.6668 => 3.1342, std.dev.: 0.2018) SingleSource/Benchmarks/Shootout-C++/heapsort: -10.91% (3.7210 => 3.3151, std.dev.: 0.1441) MultiSource/Benchmarks/Prolangs-C++/primes/primes: -1.34% (0.8962 => 0.8842, std.dev.: 0.0041) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.17% (1.0880 => 1.0753, std.dev.: 0.0725) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.88% (0.3731 => 0.3698, std.dev.: 0.0179) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.90% (0.0221 => 0.0219, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.70% (0.0429 => 0.0426, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.10% (0.0323 => 0.0333, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.95% (0.0315 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -20.89% (0.0426 => 0.0337, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0204 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -0.91% (0.0219 => 0.0217, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.68% (0.1475 => 0.1465, std.dev.: 0.0078) MultiSource/Applications/lemon/lemon: -11.76% (1.1851 => 1.0457, std.dev.: 0.5155) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.08% (0.3940 => 0.4022, std.dev.: 0.0581) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.58% (0.1435 => 0.1472, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.40% (0.0649 => 0.0601, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.51% (0.0199 => 0.0202, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.19% (0.0598 => 0.0555, std.dev.: 0.0159) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.29% (1.1505 => 1.1472, std.dev.: 0.0241) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -41.38% (0.0029 => 0.0017, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.44% (0.0532 => 0.0545, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.41% (0.0226 => 0.0207, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.67% (0.8098 => 0.7963, std.dev.: 0.0125) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0008 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -35.29% (0.0085 => 0.0055, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.30% (8.6104 => 8.6359, std.dev.: 0.0306) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 9.40% (16.4461 => 17.9914, std.dev.: 1.6016) MultiSource/Applications/sqlite3/sqlite3: 2344.54% (0.6332 => 15.4788, std.dev.: 0.9008) MultiSource/Benchmarks/McCat/08-main/main: 49.43% (0.1831 => 0.2736, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.32% (0.1559 => 0.1476, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7176.53% (0.3123 => 22.7246, std.dev.: 0.2283) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1544.41% (0.3344 => 5.4989, std.dev.: 0.2918) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.44% (0.2364 => 0.3249, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 6.04% (0.6010 => 0.6373, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.62% (0.3266 => 0.3417, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/strcat: 3.40% (0.1969 => 0.2036, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.46% (0.0224 => 0.0234, std.dev.: 0.0065) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0061) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0460, std.dev.: 0.0081) MultiSource/Applications/oggenc/oggenc: 6.84% (0.1462 => 0.1562, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4021, std.dev.: 0.0493) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0709, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4908, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5192, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2674, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0621, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3617, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3722, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0009, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0840, std.dev.: 0.0009) SingleSource/Regression/C/uint64_to_float: -29.81% (2.1832 => 1.5324, std.dev.: 0.0475) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.22% (0.1983 => 0.2146, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 8.12% (0.3226 => 0.3488, std.dev.: 0.0067) MultiSource/Applications/spiff/spiff: 7.99% (0.7950 => 0.8585, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.46% (0.2279 => 0.2449, std.dev.: 0.0048) MultiSource/Applications/siod/siod: 6.73% (2.2184 => 2.3676, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.98% (0.8518 => 0.9027, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: 5.91% (8.4179 => 8.9153, std.dev.: 0.1104) MultiSource/Applications/SPASS/SPASS: 5.32% (14.2605 => 15.0198, std.dev.: 0.1504) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.03% (1.6386 => 1.7210, std.dev.: 0.0211) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.85% (1.2526 => 1.3133, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.82% (0.8611 => 0.9026, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.77% (0.8697 => 0.9112, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.77% (0.7966 => 0.8346, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.59% (0.8286 => 0.8666, std.dev.: 0.0108) MultiSource/Benchmarks/nbench/nbench: 4.54% (1.1271 => 1.1783, std.dev.: 0.0105) MultiSource/Benchmarks/PAQ8p/paq8p: 4.50% (2.3764 => 2.4834, std.dev.: 0.0231) MultiSource/Benchmarks/mafft/pairlocalalign: 4.50% (8.6247 => 9.0128, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 4.30% (0.8855 => 0.9236, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.08% (0.8331 => 0.8671, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.03% (0.8420 => 0.8759, std.dev.: 0.0046) MultiSource/Applications/sgefa/sgefa: 3.40% (0.2999 => 0.3101, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.34% (0.3115 => 0.3219, std.dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: 2.88% (31.8598 => 32.7785, std.dev.: 0.1353) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.87% (0.3657 => 0.3762, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 198.44% (28.5821 => 85.2992, std.dev.: 0.0482) MultiSource/Benchmarks/Prolangs-C++/city/city: 58.29% (0.0199 => 0.0315, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/pi: 38.24% (1.5795 => 2.1835, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 28.41% (2.9096 => 3.7363, std.dev.: 0.0802) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.22% (4.8436 => 5.8715, std.dev.: 0.0282) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.90% (8.2783 => 9.7605, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.39% (0.7597 => 0.8842, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/misr: 15.67% (0.4001 => 0.4628, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.51% (2.7995 => 3.1216, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.13% (6.3772 => 7.0871, std.dev.: 0.1649) MultiSource/Applications/lambda-0_1_3/lambda: 10.31% (7.4933 => 8.2655, std.dev.: 0.0622) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.08% (1.1857 => 1.3052, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.91% (0.3186 => 0.3438, std.dev.: 0.0087) MultiSource/Benchmarks/McCat/18-imp/imp: 7.81% (0.1370 => 0.1477, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.36% (23.5781 => 25.3123, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.22% (3.3761 => 3.5860, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.19% (2.9753 => 3.1594, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.97% (4.8660 => 5.1564, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.78% (4.5327 => 4.7946, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 5.49% (0.4353 => 0.4592, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.35% (5.4187 => 5.7086, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.33% (5.3218 => 5.6052, std.dev.: 0.0210) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 5.16% (0.5214 => 0.5483, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 4.88% (0.3937 => 0.4129, std.dev.: 0.0016) MultiSource/Applications/aha/aha: 4.75% (3.3398 => 3.4983, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/richards_benchmark: 4.56% (1.3037 => 1.3631, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.93% (0.3587 => 0.3692, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: 2.68% (0.5081 => 0.5217, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.63% (4.8362 => 4.9633, std.dev.: 0.0322) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.26% (3.4104 => 3.4875, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 2.21% (1.7056 => 1.7433, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.67% (11.5690 => 11.7622, std.dev.: 0.0425) SingleSource/Benchmarks/Shootout/methcall: 1.63% (8.2676 => 8.4022, std.dev.: 0.0348) MultiSource/Applications/spiff/spiff: 1.37% (2.8561 => 2.8952, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/ReedSolomon: 1.18% (8.5322 => 8.6327, std.dev.: 0.0248) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.17% (2.7978 => 2.8304, std.dev.: 0.0078) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.08% (1.9302 => 1.9511, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-3: 1.01% (2.0670 => 2.0878, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.29% (2.8951 => 1.6707, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -25.03% (7.2130 => 5.4075, std.dev.: 0.2770) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.92% (1.4529 => 1.1489, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.98% (9.9065 => 8.2240, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/em3d/em3d: -12.66% (5.4641 => 4.7726, std.dev.: 0.1143) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -11.29% (0.3269 => 0.2900, std.dev.: 0.0046) SingleSource/Benchmarks/McGill/chomp: -10.16% (1.1216 => 1.0077, std.dev.: 0.0172) SingleSource/Benchmarks/Misc/flops-8: -9.59% (2.5609 => 2.3154, std.dev.: 0.0149) MultiSource/Benchmarks/mafft/pairlocalalign: -8.99% (63.1822 => 57.5013, std.dev.: 0.0402) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.61% (1.0512 => 0.9607, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.68% (3.2169 => 2.9697, std.dev.: 0.0177) SingleSource/Benchmarks/Stanford/FloatMM: -6.80% (0.8807 => 0.8208, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.21% (4.7482 => 4.4532, std.dev.: 0.0363) SingleSource/Benchmarks/Shootout/sieve: -6.12% (7.0599 => 6.6281, std.dev.: 0.0277) SingleSource/Benchmarks/Misc/ffbench: -6.11% (1.4296 => 1.3422, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.11% (5.1305 => 4.8169, std.dev.: 0.0226) SingleSource/Benchmarks/Misc/flops: -5.52% (9.3748 => 8.8569, std.dev.: 0.0265) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.32% (6.2275 => 5.8962, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.84% (5.6343 => 5.3616, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.54% (4.7449 => 4.5296, std.dev.: 0.0576) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.47% (6.1706 => 5.8950, std.dev.: 0.0406) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.37% (4.9453 => 4.7294, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/methcall: -3.91% (8.9760 => 8.6246, std.dev.: 0.0746) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.79% (3.7148 => 3.5741, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/perlin: -3.73% (5.1084 => 4.9178, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.72% (5.1557 => 4.9640, std.dev.: 0.0409) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.33% (2.8773 => 2.7816, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.18% (5.4300 => 5.2574, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/life/life: -3.06% (2.6356 => 2.5549, std.dev.: 0.0254) MultiSource/Applications/siod/siod: -2.70% (3.6643 => 3.5652, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/fbench: -2.45% (3.3840 => 3.3010, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.95% (3.3479 => 3.2826, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/neural/neural: -1.86% (1.0841 => 1.0639, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/fp-convert: -1.61% (15.8853 => 15.6295, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/flops-5: -1.55% (2.8957 => 2.8508, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.51% (3.5679 => 3.5142, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: -1.38% (2.4416 => 2.4079, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.25% (4.2466 => 4.1934, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/ackermann: -1.19% (3.9188 => 3.8721, std.dev.: 0.0133) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.18% (1.5308 => 1.5127, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.13% (4.7794 => 4.7255, std.dev.: 0.0062) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.78% (1.0262 => 1.0753, std.dev.: 0.0725) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.14% (0.2463 => 0.3698, std.dev.: 0.0179) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -12.24% (0.0384 => 0.0337, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.88% (0.1438 => 0.1465, std.dev.: 0.0078) MultiSource/Applications/lemon/lemon: -7.70% (1.1329 => 1.0457, std.dev.: 0.5155) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.41% (0.4164 => 0.4022, std.dev.: 0.0581) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.52% (0.1369 => 0.1472, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.24% (0.0641 => 0.0601, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.59% (0.0195 => 0.0202, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.98% (0.0578 => 0.0555, std.dev.: 0.0159) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.31% (1.1437 => 1.1472, std.dev.: 0.0241) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1600.00% (0.0001 => 0.0017, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.08% (0.0627 => 0.0545, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.00% (0.0180 => 0.0207, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.67% (0.8017 => 0.7963, std.dev.: 0.0125) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -11.29% (0.0062 => 0.0055, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 00:44:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 02:44:18 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121130084418.B483E2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/6410?compare_to=6407&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6410, Order: 168984, Start Time: 2012-11-30 07:07:01, End Time: 2012-11-30 08:44:53 To: 6407, Order: 168976, Start Time: 2012-11-30 05:09:22, End Time: 2012-11-30 06:44:02 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 1 (145 on baseline) Added Tests: 0 (52 on baseline) Unchanged Tests: 1093 (892 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.06% (3.8285 => 3.7496, std.dev.: 0.0097) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 74.85% (31.3723 => 54.8545, std.dev.: 0.0667) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1011, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/salsa20: 2.53% (7.4937 => 7.6833, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/hash2: 2.27% (3.1932 => 3.2656, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.60% (0.1431 => 0.1308, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.43% (0.3821 => 0.3537, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.12% (0.9542 => 0.8863, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.52% (0.3142 => 0.2937, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions-4: -6.47% (0.3880 => 0.3629, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -6.45% (0.3831 => 0.3584, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.44% (0.3884 => 0.3634, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -6.44% (2.4924 => 2.3320, std.dev.: 0.0387) SingleSource/UnitTests/ObjC/exceptions-3: -6.39% (0.3848 => 0.3602, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.37% (0.3896 => 0.3648, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -6.32% (0.3812 => 0.3571, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.30% (0.2428 => 0.2275, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/for-in: -6.30% (0.4033 => 0.3779, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -6.23% (0.3357 => 0.3148, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions: -6.20% (0.4176 => 0.3917, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.07% (0.3891 => 0.3655, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -5.95% (0.4199 => 0.3949, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.91% (0.6484 => 0.6101, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.83% (0.1716 => 0.1616, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -5.79% (9.2283 => 8.6941, std.dev.: 0.0066) SingleSource/Benchmarks/McGill/chomp: -5.74% (0.1761 => 0.1660, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: -5.71% (16.1920 => 15.2672, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.71% (0.7198 => 0.6787, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.70% (0.5478 => 0.5166, std.dev.: 0.0114) SingleSource/UnitTests/ObjC/parameter-passing: -5.68% (0.4280 => 0.4037, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.67% (0.9852 => 0.9293, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.65% (1.3722 => 1.2947, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.64% (1.0544 => 0.9949, std.dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: -5.59% (7.0961 => 6.6993, std.dev.: 0.0055) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.52% (6.7716 => 6.3976, std.dev.: 0.1242) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.50% (4.8161 => 4.5514, std.dev.: 0.0856) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.50% (0.3057 => 0.2889, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.46% (0.6395 => 0.6046, std.dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.46% (1.2300 => 1.1629, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.45% (0.2695 => 0.2548, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.45% (0.7524 => 0.7114, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.44% (0.3658 => 0.3459, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/football/football: -5.43% (0.9179 => 0.8681, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.40% (1.4642 => 1.3852, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: -5.39% (0.3025 => 0.2862, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.37% (0.7339 => 0.6945, std.dev.: 0.0096) MultiSource/Benchmarks/MallocBench/gs/gs: -5.36% (4.3330 => 4.1008, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.30% (0.2548 => 0.2413, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.29% (0.6736 => 0.6380, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.23% (0.4151 => 0.3934, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.22% (0.5570 => 0.5279, std.dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: -5.22% (1.3148 => 1.2462, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.21% (0.3931 => 0.3726, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.21% (0.6446 => 0.6110, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.21% (0.8521 => 0.8077, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.21% (0.5567 => 0.5277, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.20% (3.5339 => 3.3501, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.20% (4.5069 => 4.2725, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: -5.20% (0.3194 => 0.3028, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.20% (0.6293 => 0.5966, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: -5.19% (0.2985 => 0.2830, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: -5.19% (0.3255 => 0.3086, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.18% (1.6364 => 1.5517, std.dev.: 0.0311) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.17% (0.3016 => 0.2860, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.16% (0.7919 => 0.7510, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/fibo: -5.15% (0.2871 => 0.2723, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.14% (0.3252 => 0.3085, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wc: -5.12% (0.3205 => 0.3041, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -5.11% (0.3481 => 0.3303, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -5.10% (0.2939 => 0.2789, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -5.10% (17.1032 => 16.2314, std.dev.: 0.0133) MultiSource/Applications/lemon/lemon: -5.08% (1.1450 => 1.0868, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.08% (0.3406 => 0.3233, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: -5.07% (0.4515 => 0.4286, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: -5.07% (0.3059 => 0.2904, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.06% (2.1713 => 2.0615, std.dev.: 0.0229) SingleSource/Benchmarks/Shootout-C++/except: -5.06% (0.3026 => 0.2873, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.05% (0.2933 => 0.2785, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: -5.01% (1.3864 => 1.3169, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.00% (0.3837 => 0.3645, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.97% (0.5999 => 0.5701, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary3: -4.96% (0.3446 => 0.3275, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: -4.96% (15.5079 => 14.7385, std.dev.: 0.0264) SingleSource/Benchmarks/Shootout-C++/strcat: -4.95% (0.2989 => 0.2841, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: -4.95% (0.3394 => 0.3226, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: -4.95% (0.2849 => 0.2708, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -4.94% (0.3581 => 0.3404, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.93% (0.2903 => 0.2760, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.92% (0.2278 => 0.2166, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.91% (0.4321 => 0.4109, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.88% (8.0126 => 7.6214, std.dev.: 0.0060) MultiSource/Applications/Burg/burg: -4.83% (1.2515 => 1.1911, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.82% (0.3483 => 0.3315, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -4.82% (3.5154 => 3.3459, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: -4.81% (0.2659 => 0.2531, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: -4.78% (0.4248 => 0.4045, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.77% (0.2999 => 0.2856, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: -4.69% (0.4861 => 0.4633, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -4.66% (15.2527 => 14.5425, std.dev.: 0.0217) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.64% (0.5168 => 0.4928, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -4.64% (0.3621 => 0.3453, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -4.63% (34.0927 => 32.5151, std.dev.: 0.0374) SingleSource/Benchmarks/Shootout-C++/lists1: -4.60% (0.3867 => 0.3689, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.55% (0.3849 => 0.3674, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.46% (0.3271 => 0.3125, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -4.40% (4.0594 => 3.8808, std.dev.: 0.0065) MultiSource/Applications/minisat/minisat: -4.39% (0.7447 => 0.7120, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: -4.39% (5.0226 => 4.8022, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.39% (0.7021 => 0.6713, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.34% (1.6474 => 1.5759, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.32% (0.4813 => 0.4605, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.31% (22.4056 => 21.4398, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.29% (0.4427 => 0.4237, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.28% (0.9557 => 0.9148, std.dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: -4.25% (0.7982 => 0.7643, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.24% (0.4083 => 0.3910, std.dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: -4.22% (18.2933 => 17.5205, std.dev.: 0.0267) MultiSource/Applications/treecc/treecc: -4.22% (2.1401 => 2.0497, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.22% (0.3319 => 0.3179, std.dev.: 0.0027) MultiSource/Applications/siod/siod: -4.21% (2.4021 => 2.3009, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -4.20% (0.3788 => 0.3629, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.15% (0.3323 => 0.3185, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (0.5329 => 0.5108, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -3.97% (0.8418 => 0.8084, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: -3.93% (0.4524 => 0.4346, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -3.73% (0.7779 => 0.7489, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: -3.67% (0.6347 => 0.6114, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.67% (0.3491 => 0.3363, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -3.64% (0.6750 => 0.6504, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.63% (2.2587 => 2.1766, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: -3.59% (1.5610 => 1.5050, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference-object: -3.51% (0.6441 => 0.6215, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -3.20% (20.7746 => 20.1095, std.dev.: 0.0515) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.71% (5.4682 => 5.3198, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -60.93% (1.8100 => 0.7072, std.dev.: 0.0060) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7535, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -8.72% (1.2842 => 1.1722, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: -3.76% (2.2633 => 2.1782, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3991, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4722, std.dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.41% (1.3096 => 1.2911, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0043) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 02:00:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 04:00:32 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121130100032.41D8C2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/6411?compare_to=6405&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6411, Order: 168977, Start Time: 2012-11-30 06:27:15, End Time: 2012-11-30 10:01:05 To: 6405, Order: 168965, Start Time: 2012-11-30 02:09:08, End Time: 2012-11-30 05:38:55 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (177 on baseline) Performance Improvements: 8 (16 on baseline) Added Tests: 0 (186 on baseline) Unchanged Tests: 1085 (715 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 4.08% (0.3527 => 0.3671, std.dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sqlite3/sqlite3: -1.65% (2.2674 => 2.2299, std.dev.: 0.0071) MultiSource/Applications/SPASS/SPASS: -1.25% (6.2646 => 6.1861, std.dev.: 0.0147) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.18% (1.5751 => 1.5565, std.dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: -1.18% (2.4055 => 2.3771, std.dev.: 0.0031) MultiSource/Applications/d/make_dparser: -1.16% (1.2718 => 1.2570, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.16% (5.1981 => 5.1377, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: -1.15% (2.4889 => 2.4604, std.dev.: 0.0052) MultiSource/Applications/JM/lencod/lencod: -1.02% (5.2860 => 5.2320, std.dev.: 0.0062) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.76% (0.0625 => 0.0886, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.64% (0.1063 => 0.1410, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.31% (0.2969 => 0.3750, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.04% (0.1106 => 0.1394, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.15% (0.4139 => 0.5180, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.93% (0.0714 => 0.0892, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.58% (0.0415 => 0.0517, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.34% (0.4253 => 0.5288, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.21% (0.0475 => 0.0590, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 24.05% (1.5932 => 1.9763, std.dev.: 0.0125) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.03% (0.5900 => 0.7318, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.93% (0.4994 => 0.6189, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.63% (0.0584 => 0.0722, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.58% (0.5000 => 0.6179, std.dev.: 0.0032) MultiSource/Applications/viterbi/viterbi: 23.55% (0.0947 => 0.1170, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.96% (0.1620 => 0.1992, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.82% (0.1021 => 0.1254, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.49% (0.1107 => 0.1356, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/tsp/tsp: 22.04% (0.0599 => 0.0731, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.85% (0.0897 => 0.1093, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.48% (0.0633 => 0.0769, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.31% (0.1103 => 0.1338, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.23% (0.0584 => 0.0708, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.18% (0.0642 => 0.0778, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 21.10% (0.0948 => 0.1148, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.95% (0.1604 => 0.1940, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.81% (0.0495 => 0.0598, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.80% (0.0822 => 0.0993, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.68% (0.3903 => 0.4710, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/health/health: 20.46% (0.0821 => 0.0989, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 20.44% (0.1619 => 0.1950, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.44% (0.1003 => 0.1208, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.27% (0.1549 => 0.1863, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 20.03% (0.0604 => 0.0725, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.15% (0.1462 => 0.1742, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.12% (0.2736 => 0.3259, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 18.94% (0.0808 => 0.0961, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.92% (0.3890 => 0.4626, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.87% (0.2014 => 0.2394, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 18.39% (0.1218 => 0.1442, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.35% (1.3152 => 1.5565, std.dev.: 0.0060) MultiSource/Applications/spiff/spiff: 18.34% (0.4029 => 0.4768, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/mst/mst: 18.19% (0.0698 => 0.0825, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 18.04% (0.5826 => 0.6877, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 17.94% (0.5546 => 0.6541, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.92% (0.1088 => 0.1283, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 17.87% (0.1505 => 0.1774, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.79% (0.2866 => 0.3376, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.66% (0.0572 => 0.0673, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.66% (3.5627 => 4.1917, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference-object: 17.56% (0.5889 => 0.6923, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.47% (0.5026 => 0.5904, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.45% (0.0573 => 0.0673, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 17.40% (1.8794 => 2.2064, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.34% (1.6211 => 1.9022, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 17.20% (0.9697 => 1.1365, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.16% (0.1160 => 0.1359, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.07% (0.1968 => 0.2304, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.02% (0.0605 => 0.0708, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.02% (0.4658 => 0.5451, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.00% (0.3271 => 0.3827, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.62% (0.4361 => 0.5086, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.61% (2.7292 => 3.1826, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/18-imp/imp: 16.61% (0.1421 => 0.1657, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 16.59% (1.0781 => 1.2570, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 16.51% (0.7171 => 0.8355, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.25% (4.4195 => 5.1377, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.17% (0.2875 => 0.3340, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 16.07% (4.2109 => 4.8876, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.01% (0.3930 => 0.4559, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: 15.89% (0.1284 => 0.1488, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 15.88% (0.2714 => 0.3145, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 15.85% (0.2725 => 0.3157, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.85% (0.2738 => 0.3172, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.76% (0.2729 => 0.3159, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.70% (1.9694 => 2.2786, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.69% (0.2792 => 0.3230, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 15.68% (0.2780 => 0.3216, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 15.68% (0.2813 => 0.3254, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 15.67% (0.9909 => 1.1462, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/except: 15.65% (0.2811 => 0.3251, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.60% (0.2911 => 0.3365, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.52% (0.3195 => 0.3691, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 15.48% (0.2803 => 0.3237, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 15.48% (0.2823 => 0.3260, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/wc: 15.44% (0.3096 => 0.3574, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 15.42% (0.2750 => 0.3174, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.33% (1.9966 => 2.3027, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.32% (2.0673 => 2.3841, std.dev.: 0.0020) SingleSource/Regression/C++/ofstream_ctor: 15.18% (0.3004 => 0.3460, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.05% (0.1090 => 0.1254, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 14.81% (0.3267 => 0.3751, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.80% (0.3060 => 0.3513, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 14.76% (0.3258 => 0.3739, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 14.75% (0.3465 => 0.3976, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 14.70% (0.2075 => 0.2380, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 14.62% (23.5202 => 26.9590, std.dev.: 0.0130) SingleSource/UnitTests/ObjC/exceptions-2: 14.57% (0.3446 => 0.3948, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 14.56% (0.3317 => 0.3800, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 14.53% (0.2691 => 0.3082, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.51% (0.3460 => 0.3962, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.51% (0.3488 => 0.3994, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 14.47% (0.3496 => 0.4002, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.47% (0.3469 => 0.3971, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 14.44% (0.3442 => 0.3939, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 14.34% (0.2566 => 0.2934, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.34% (0.3362 => 0.3844, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 14.30% (0.3678 => 0.4204, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 14.25% (1.4269 => 1.6302, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.21% (0.3124 => 0.3568, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.14% (0.3282 => 0.3746, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.12% (0.3845 => 0.4388, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 14.01% (0.3348 => 0.3817, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 14.00% (0.3650 => 0.4161, std.dev.: 0.0088) SingleSource/UnitTests/ObjC/exceptions: 14.00% (0.3643 => 0.4153, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 13.96% (0.3726 => 0.4246, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 13.86% (0.3477 => 0.3959, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.82% (0.3625 => 0.4126, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 13.82% (0.7875 => 0.8963, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 13.80% (0.3724 => 0.4238, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 13.63% (2.1653 => 2.4604, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash: 13.41% (0.4146 => 0.4702, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.39% (0.3981 => 0.4514, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.33% (0.3690 => 0.4182, std.dev.: 0.0023) MultiSource/Benchmarks/sim/sim: 13.32% (0.0758 => 0.0859, std.dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 13.30% (4.6177 => 5.2320, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash2: 13.15% (0.4251 => 0.4810, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 13.13% (2.1013 => 2.3771, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.70% (0.2040 => 0.2299, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 12.61% (0.5012 => 0.5644, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.93% (0.1383 => 0.1548, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11.63% (5.5417 => 6.1861, std.dev.: 0.0147) MultiSource/Applications/siod/siod: 11.56% (0.6634 => 0.7401, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.53% (0.6435 => 0.7177, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.48% (0.1028 => 0.1146, std.dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: 11.29% (0.3498 => 0.3893, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.59% (0.2068 => 0.2287, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.38% (0.2737 => 0.3021, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: 10.30% (0.4847 => 0.5346, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: 9.86% (0.3336 => 0.3665, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 9.60% (2.0346 => 2.2299, std.dev.: 0.0071) MultiSource/Applications/lemon/lemon: 9.54% (0.2391 => 0.2619, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.37% (0.2103 => 0.2300, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.13% (0.5584 => 0.6038, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.05% (11.6398 => 12.5766, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.96% (4.6926 => 5.0661, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.85% (0.5361 => 0.5782, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.29% (0.7426 => 0.7967, std.dev.: 0.0034) MultiSource/Applications/kimwitu++/kc: 6.43% (11.9555 => 12.7238, std.dev.: 0.0075) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.04% (0.3792 => 0.3983, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.83% (29.0505 => 181.5151, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 69.80% (0.2162 => 0.3671, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 9.96% (0.2802 => 0.3081, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6095, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.71% (0.3693 => 0.3904, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6786, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-2: 4.83% (1.8057 => 1.8930, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1678, std.dev.: 0.0797) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.59% (79.9355 => 83.6010, std.dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/dry: 4.16% (14.0481 => 14.6320, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/health/health: 2.76% (0.6276 => 0.6449, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2001, std.dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2228, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3048, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2888, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.27% (1.0142 => 1.0271, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5144, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5897, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.80% (25.4195 => 16.5738, std.dev.: 0.0196) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9768, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7995, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/ary2: -7.37% (0.2402 => 0.2225, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.56% (11.2080 => 10.8089, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0061) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7744, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std.dev.: 0.0085) SingleSource/Benchmarks/Dhrystone/fldry: -2.95% (17.2379 => 16.7290, std.dev.: 0.0695) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8688, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5796, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4959, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0454, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 02:12:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 04:12:18 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121130101218.BCA4F2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/6412?compare_to=6409&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6412, Order: 168986, Start Time: 2012-11-30 08:37:00, End Time: 2012-11-30 10:12:55 To: 6409, Order: 168983, Start Time: 2012-11-30 06:44:24, End Time: 2012-11-30 08:20:06 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 2 (60 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (51 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1051 (873 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.71% (0.3438 => 0.3600, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/pi: 1.14% (2.1835 => 2.2085, std.dev.: 0.0056) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.03% (1.0753 => 1.0756, std.dev.: 0.2044) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.95% (0.3698 => 0.3733, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -12.79% (0.0219 => 0.0191, std.dev.: 0.0081) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0426 => 0.0427, std.dev.: 0.0117) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.31% (0.0333 => 0.0302, std.dev.: 0.0115) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.60% (0.0312 => 0.0317, std.dev.: 0.0094) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 14.54% (0.0337 => 0.0386, std.dev.: 0.0129) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0203 => 0.0204, std.dev.: 0.0063) SingleSource/UnitTests/Vector/Altivec/test1: -22.12% (0.0217 => 0.0169, std.dev.: 0.0080) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.57% (0.1465 => 0.1488, std.dev.: 0.0024) MultiSource/Applications/lemon/lemon: 12.17% (1.0457 => 1.1730, std.dev.: 0.3098) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.60% (0.4022 => 0.3998, std.dev.: 0.0478) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.75% (0.1472 => 0.1461, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.66% (0.0601 => 0.0629, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 37.62% (0.0202 => 0.0278, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.44% (0.0555 => 0.0563, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.25% (1.1472 => 1.1443, std.dev.: 0.0221) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -94.12% (0.0017 => 0.0001, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 100.00% (0.0001 => 0.0002, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.57% (0.0545 => 0.0531, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.73% (0.0207 => 0.0191, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.12% (0.7963 => 0.8052, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -7.27% (0.0055 => 0.0051, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.18% (8.6359 => 8.6205, std.dev.: 0.0094) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 9.08% (16.4461 => 17.9395, std.dev.: 1.0945) MultiSource/Applications/sqlite3/sqlite3: 2363.44% (0.6332 => 15.5985, std.dev.: 0.4082) MultiSource/Benchmarks/McCat/08-main/main: 43.47% (0.1831 => 0.2627, std.dev.: 0.0540) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.20% (0.1559 => 0.1478, std.dev.: 0.0269) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7303.36% (0.3123 => 23.1207, std.dev.: 0.3254) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1538.79% (0.3344 => 5.4801, std.dev.: 0.1457) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.52% (0.2364 => 0.3251, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/bigfib: 5.14% (0.6010 => 0.6319, std.dev.: 0.0219) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.78% (0.3266 => 0.3422, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/strcat: 3.86% (0.1969 => 0.2045, std.dev.: 0.0014) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -25.89% (0.0224 => 0.0166, std.dev.: 0.0039) SingleSource/UnitTests/byval-alignment: -35.22% (0.0230 => 0.0149, std.dev.: 0.0009) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0507, std.dev.: 0.0092) MultiSource/Applications/oggenc/oggenc: 7.87% (0.1462 => 0.1577, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3942, std.dev.: 0.0287) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0702, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4941, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5276, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2671, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0819, std.dev.: 0.0594) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3619, std.dev.: 0.0230) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3778, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0807, std.dev.: 0.0029) SingleSource/Regression/C/uint64_to_float: -29.68% (2.1832 => 1.5353, std.dev.: 0.0373) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/aha/aha: 9.56% (0.1088 => 0.1192, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.90% (0.1157 => 0.1260, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.18% (1.2222 => 1.3222, std.dev.: 0.0269) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.09% (0.8321 => 0.8994, std.dev.: 0.0174) MultiSource/Applications/siod/siod: 6.52% (2.2184 => 2.3630, std.dev.: 0.0415) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.22% (0.6287 => 0.6678, std.dev.: 0.0134) MultiSource/Applications/spiff/spiff: 6.10% (0.7950 => 0.8435, std.dev.: 0.0166) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.04% (13.1811 => 13.9769, std.dev.: 0.2813) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.77% (0.8261 => 0.8738, std.dev.: 0.0156) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.50% (0.1983 => 0.2092, std.dev.: 0.0036) MultiSource/Applications/treecc/treecc: 5.40% (1.9948 => 2.1025, std.dev.: 0.0326) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.39% (0.8597 => 0.9060, std.dev.: 0.0099) MultiSource/Applications/sgefa/sgefa: 5.20% (0.2999 => 0.3155, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 5.07% (1.0945 => 1.1500, std.dev.: 0.0215) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.93% (0.4783 => 0.5019, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 4.84% (0.8712 => 0.9134, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.78% (0.9908 => 1.0382, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.65% (0.3115 => 0.3260, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.50% (0.2378 => 0.2485, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 4.26% (0.6834 => 0.7125, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.23% (4.1763 => 4.3529, std.dev.: 0.0355) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.77% (0.4559 => 0.4731, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.71% (0.3717 => 0.3855, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 198.11% (28.5821 => 85.2067, std.dev.: 0.2309) SingleSource/Benchmarks/Misc/pi: 39.82% (1.5795 => 2.2085, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 27.72% (2.9096 => 3.7161, std.dev.: 0.0788) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.22% (4.8436 => 5.8715, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.81% (8.2783 => 9.7527, std.dev.: 0.0136) SingleSource/Benchmarks/McGill/misr: 17.10% (0.4001 => 0.4685, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.19% (0.7597 => 0.8827, std.dev.: 0.0193) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.99% (0.3186 => 0.3600, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.80% (2.7995 => 3.1299, std.dev.: 0.0151) MultiSource/Applications/lambda-0_1_3/lambda: 10.31% (7.4933 => 8.2661, std.dev.: 0.0155) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.25% (1.1857 => 1.3072, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.82% (6.3772 => 6.8757, std.dev.: 0.0849) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.54% (23.5781 => 25.3556, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.09% (3.9917 => 4.2747, std.dev.: 0.0925) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.38% (3.3761 => 3.5915, std.dev.: 0.0460) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 6.01% (4.8660 => 5.1583, std.dev.: 0.0455) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.93% (2.9753 => 3.1517, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.84% (4.5327 => 4.7975, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 5.42% (0.4353 => 0.4589, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.29% (5.4187 => 5.7054, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.25% (5.3218 => 5.6013, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 4.77% (1.0388 => 1.0883, std.dev.: 0.0055) MultiSource/Applications/aha/aha: 4.44% (3.3398 => 3.4882, std.dev.: 0.0313) SingleSource/Benchmarks/Misc/richards_benchmark: 3.96% (1.3037 => 1.3553, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 3.66% (0.3937 => 0.4081, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/power/power: 3.58% (1.2061 => 1.2493, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.45% (4.8362 => 5.0032, std.dev.: 0.0411) MultiSource/Applications/JM/lencod/lencod: 2.74% (6.7064 => 6.8899, std.dev.: 0.0345) SingleSource/Benchmarks/McGill/queens: 2.47% (1.7056 => 1.7477, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.18% (3.4104 => 3.4849, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: 2.15% (91.7701 => 93.7399, std.dev.: 0.6011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.72% (11.5690 => 11.7678, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout/methcall: 1.57% (8.2676 => 8.3973, std.dev.: 0.0409) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.55% (1.2474 => 1.2667, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: 1.47% (2.8561 => 2.8981, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.31% (4.9469 => 5.0119, std.dev.: 0.0166) SingleSource/Benchmarks/Misc/flops-7: 1.21% (1.7156 => 1.7363, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.13% (2.8951 => 1.6753, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -25.37% (7.2130 => 5.3834, std.dev.: 0.0815) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.28% (1.4529 => 1.1582, std.dev.: 0.0362) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -17.18% (9.9065 => 8.2049, std.dev.: 0.0205) MultiSource/Benchmarks/Olden/em3d/em3d: -12.69% (5.4641 => 4.7706, std.dev.: 0.0513) SingleSource/Benchmarks/Shootout-C++/ary3: -12.30% (1.9999 => 1.7539, std.dev.: 0.0926) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -10.71% (0.3269 => 0.2919, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-8: -9.46% (2.5609 => 2.3186, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: -9.11% (63.1822 => 57.4243, std.dev.: 0.2237) SingleSource/Benchmarks/McGill/chomp: -8.76% (1.1216 => 1.0234, std.dev.: 0.0365) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.31% (1.0512 => 0.9638, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.28% (4.7482 => 4.4498, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.11% (5.1305 => 4.8169, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/sieve: -6.09% (7.0599 => 6.6296, std.dev.: 0.0154) SingleSource/Benchmarks/Stanford/FloatMM: -5.63% (0.8807 => 0.8311, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/flops: -5.43% (9.3748 => 8.8653, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.33% (6.2275 => 5.8957, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/ffbench: -5.11% (1.4296 => 1.3566, std.dev.: 0.0088) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.96% (2.8773 => 2.7347, std.dev.: 0.0335) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.83% (5.6343 => 5.3620, std.dev.: 0.0276) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.56% (4.7449 => 4.5286, std.dev.: 0.0332) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.39% (6.1706 => 5.8997, std.dev.: 0.0313) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.35% (4.9453 => 4.7304, std.dev.: 0.0100) MultiSource/Applications/lua/lua: -3.76% (29.8330 => 28.7118, std.dev.: 0.3935) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.75% (3.7148 => 3.5756, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/perlin: -3.71% (5.1084 => 4.9187, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.63% (5.1557 => 4.9683, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/methcall: -3.39% (8.9760 => 8.6718, std.dev.: 0.0370) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.28% (4.9686 => 4.8058, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.25% (5.4300 => 5.2537, std.dev.: 0.0148) MultiSource/Applications/siod/siod: -3.09% (3.6643 => 3.5511, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/fbench: -2.33% (3.3840 => 3.3050, std.dev.: 0.0110) MultiSource/Benchmarks/FreeBench/neural/neural: -2.20% (1.0841 => 1.0602, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.94% (3.3479 => 3.2830, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-5: -1.78% (2.8957 => 2.8442, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/fp-convert: -1.62% (15.8853 => 15.6275, std.dev.: 0.0523) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.57% (3.5679 => 3.5118, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-6: -1.46% (2.4416 => 2.4060, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.27% (4.7794 => 4.7186, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.22% (4.2466 => 4.1950, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.13% (1.8829 => 1.8616, std.dev.: 0.0070) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.81% (1.0262 => 1.0756, std.dev.: 0.2044) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.56% (0.2463 => 0.3733, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 55.28% (0.0123 => 0.0191, std.dev.: 0.0081) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0117) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 18.90% (0.0254 => 0.0302, std.dev.: 0.0115) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.97% (0.0302 => 0.0317, std.dev.: 0.0094) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.52% (0.0384 => 0.0386, std.dev.: 0.0129) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0063) SingleSource/UnitTests/Vector/Altivec/test1: -6.11% (0.0180 => 0.0169, std.dev.: 0.0080) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 3.48% (0.1438 => 0.1488, std.dev.: 0.0024) MultiSource/Applications/lemon/lemon: 3.54% (1.1329 => 1.1730, std.dev.: 0.3098) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.99% (0.4164 => 0.3998, std.dev.: 0.0478) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.72% (0.1369 => 0.1461, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.87% (0.0641 => 0.0629, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.56% (0.0195 => 0.0278, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.60% (0.0578 => 0.0563, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.05% (1.1437 => 1.1443, std.dev.: 0.0221) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -85.71% (0.0014 => 0.0002, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.31% (0.0627 => 0.0531, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.11% (0.0180 => 0.0191, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.44% (0.8017 => 0.8052, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -17.74% (0.0062 => 0.0051, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 02:24:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 04:24:09 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121130102409.B7AE22A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/6413?compare_to=6408&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6413, Order: 168986, Start Time: 2012-11-30 07:55:18, End Time: 2012-11-30 10:24:42 To: 6408, Order: 168972, Start Time: 2012-11-30 04:37:18, End Time: 2012-11-30 07:00:18 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 33 (153 on baseline) Performance Improvements: 12 (42 on baseline) Added Tests: 0 (186 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1043 (690 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel02: 15.78% (0.1052 => 0.1218, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 15.64% (1.8034 => 2.0855, std.dev.: 0.0346) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 13.76% (0.5915 => 0.6729, std.dev.: 0.0212) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.24% (0.7584 => 0.8588, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 12.85% (2.2423 => 2.5304, std.dev.: 0.0400) SingleSource/Benchmarks/Misc-C++/Large/ray: 12.24% (0.4428 => 0.4970, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.94% (0.6199 => 0.6939, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.30% (0.5825 => 0.6483, std.dev.: 0.0104) SingleSource/Benchmarks/LivermoreLoops/kernel01: 11.25% (0.1013 => 0.1127, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.35% (0.4540 => 0.5010, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.68% (0.3452 => 0.3786, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.32% (0.7209 => 0.7881, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.14% (0.5921 => 0.6462, std.dev.: 0.0159) MultiSource/Applications/SIBsim4/SIBsim4: 8.99% (1.5389 => 1.6772, std.dev.: 0.0398) SingleSource/Benchmarks/LivermoreLoops/kernel08: 8.59% (0.1234 => 0.1340, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.44% (0.5912 => 0.6411, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/matrix: 8.24% (0.3360 => 0.3637, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/methcall: 7.37% (0.3107 => 0.3336, std.dev.: 0.0081) SingleSource/Regression/C++/ofstream_ctor: 6.78% (0.3142 => 0.3355, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.14% (2.7018 => 2.8676, std.dev.: 0.0287) MultiSource/Applications/hbd/hbd: 6.02% (1.7300 => 1.8342, std.dev.: 0.0353) SingleSource/UnitTests/ObjC/trivial-interface: 5.60% (0.3838 => 0.4053, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 5.48% (0.7986 => 0.8424, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/synchronized: 4.98% (0.3937 => 0.4133, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference-object: 4.86% (0.6602 => 0.6923, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: 4.53% (0.6489 => 0.6783, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.74% (0.5265 => 0.5462, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 3.61% (0.3903 => 0.4044, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.09% (37.9564 => 38.7478, std.dev.: 0.1701) Performance Regressions - Execution Time ---------------------------------------- SingleSource/UnitTests/ObjC/synchronized: 104.44% (0.1487 => 0.3040, std.dev.: 0.0509) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 19.58% (3.8018 => 4.5462, std.dev.: 0.0891) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 10.94% (2.7669 => 3.0696, std.dev.: 0.0949) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 7.60% (0.5381 => 0.5790, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: -14.60% (0.3774 => 0.3223, std.dev.: 0.0192) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -11.11% (0.2152 => 0.1913, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/sieve: -10.06% (0.4444 => 0.3997, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/reversefile: -10.01% (0.4806 => 0.4325, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -9.82% (4.9394 => 4.4543, std.dev.: 0.1275) SingleSource/Benchmarks/Linpack/linpack-pc: -9.59% (0.3201 => 0.2894, std.dev.: 0.0081) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -10.33% (7.0662 => 6.3362, std.dev.: 0.0451) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -10.05% (0.4566 => 0.4107, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -8.83% (0.2504 => 0.2283, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.42% (6.2172 => 6.1291, std.dev.: 0.0276) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.37% (62.4069 => 61.5543, std.dev.: 0.1685) SingleSource/Benchmarks/Misc/lowercase: -1.16% (8.0997 => 8.0057, std.dev.: 0.0329) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -1.71% (70.7514 => 69.5396, std.dev.: 0.5667) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.95% (0.1368 => 0.1355, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.48% (0.0421 => 0.0419, std.dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.40% (0.0668 => 0.0652, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -0.09% (494.1635 => 493.7307, std.dev.: 0.2640) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.95% (63.2438 => 69.5396, std.dev.: 0.5667) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0419, std.dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43682.10% (1.1277 => 493.7307, std.dev.: 0.2640) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 220.75% (0.5229 => 1.6772, std.dev.: 0.0398) MultiSource/Applications/SPASS/SPASS: 18.81% (14.9895 => 17.8096, std.dev.: 0.5470) MultiSource/Applications/kimwitu++/kc: 47.31% (14.1553 => 20.8519, std.dev.: 0.7840) MultiSource/Benchmarks/MallocBench/gs/gs: 21.47% (4.1105 => 4.9930, std.dev.: 0.1758) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.44% (1.1048 => 1.5184, std.dev.: 0.0729) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 441.31% (7.1582 => 38.7478, std.dev.: 0.1701) SingleSource/Benchmarks/Misc-C++-EH/spirit: 86.22% (3.4629 => 6.4486, std.dev.: 0.3171) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.25% (0.6222 => 1.0344, std.dev.: 0.0701) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10365.69% (0.0720 => 7.5353, std.dev.: 0.3538) MultiSource/Applications/SIBsim4/SIBsim4: 3864600.00% (0.0001 => 3.8647, std.dev.: 0.0486) MultiSource/Applications/SPASS/SPASS: 12058100.00% (0.0001 => 12.0582, std.dev.: 2.4352) MultiSource/Applications/kimwitu++/kc: 52300.00% (0.0001 => 0.0524, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 64900.00% (0.0001 => 0.0650, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576400.00% (0.0001 => 0.5765, std.dev.: 0.0277) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10019400.00% (0.0001 => 10.0195, std.dev.: 0.0448) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5676400.00% (0.0001 => 5.6765, std.dev.: 0.6305) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1719.39% (1.1194 => 20.3662, std.dev.: 0.8449) MultiSource/Applications/ClamAV/clamscan: 69.97% (22.1758 => 37.6930, std.dev.: 0.3108) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 68.98% (2.9384 => 4.9653, std.dev.: 0.1352) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.17% (7.0540 => 10.8754, std.dev.: 0.3715) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 45.71% (8.1363 => 11.8556, std.dev.: 0.4130) MultiSource/Benchmarks/FreeBench/distray/distray: 45.45% (0.1056 => 0.1536, std.dev.: 0.0060) MultiSource/Applications/JM/lencod/lencod: 44.43% (21.9371 => 31.6842, std.dev.: 0.5856) SingleSource/Benchmarks/CoyoteBench/almabench: 43.70% (0.0730 => 0.1049, std.dev.: 0.0011) SingleSource/UnitTests/vla: 39.15% (0.0355 => 0.0494, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 38.41% (0.1432 => 0.1982, std.dev.: 0.0076) SingleSource/Benchmarks/Stanford/Oscar: 31.92% (0.0636 => 0.0839, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 31.50% (1.5859 => 2.0855, std.dev.: 0.0346) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.20% (2.2024 => 2.8676, std.dev.: 0.0287) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.66% (0.6675 => 0.8588, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/dot-syntax-1: 28.39% (0.0479 => 0.0615, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Towers: 28.24% (0.0471 => 0.0604, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.99% (0.5105 => 0.6483, std.dev.: 0.0104) SingleSource/UnitTests/ObjC/messages-2: 26.59% (0.0662 => 0.0838, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: 26.52% (0.0626 => 0.0792, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/family/family: 26.45% (0.0397 => 0.0502, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.69% (0.1125 => 0.1414, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 25.60% (0.0672 => 0.0844, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.16% (0.0457 => 0.0572, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 25.00% (0.0528 => 0.0660, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.26% (0.0746 => 0.0927, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bisort/bisort: 23.78% (0.0614 => 0.0760, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/huffbench: 23.31% (0.0871 => 0.1074, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: 23.09% (0.0485 => 0.0597, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 23.02% (0.1655 => 0.2036, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/08-main/main: 22.51% (0.2554 => 0.3129, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C++/city/city: 22.45% (2.0665 => 2.5304, std.dev.: 0.0400) MultiSource/Applications/treecc/treecc: 22.34% (2.0273 => 2.4801, std.dev.: 0.0520) SingleSource/Benchmarks/Misc-C++/Large/ray: 22.29% (0.4064 => 0.4970, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 22.11% (0.4103 => 0.5010, std.dev.: 0.0130) MultiSource/Benchmarks/llubenchmark/llu: 22.08% (0.0462 => 0.0564, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 21.98% (0.3307 => 0.4034, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C++/life/life: 21.97% (0.0933 => 0.1138, std.dev.: 0.0029) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.71% (0.1566 => 0.1906, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.53% (0.3441 => 0.4182, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/tsp/tsp: 21.11% (0.1175 => 0.1423, std.dev.: 0.0051) MultiSource/Applications/sgefa/sgefa: 21.00% (0.3109 => 0.3762, std.dev.: 0.0108) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.88% (0.0953 => 0.1152, std.dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 20.83% (5.7591 => 6.9585, std.dev.: 0.1479) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.77% (0.1584 => 0.1913, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 20.71% (1.5415 => 1.8607, std.dev.: 0.0595) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.43% (0.0793 => 0.0955, std.dev.: 0.0042) MultiSource/Applications/siod/siod: 20.09% (2.2969 => 2.7583, std.dev.: 0.1359) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.90% (0.1337 => 0.1603, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 19.73% (0.3162 => 0.3786, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.37% (0.2700 => 0.3223, std.dev.: 0.0192) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.91% (0.6450 => 0.7670, std.dev.: 0.0191) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.89% (0.0704 => 0.0837, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 18.71% (0.6456 => 0.7664, std.dev.: 0.0217) SingleSource/Benchmarks/Misc/fbench: 18.24% (0.0592 => 0.0700, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.96% (14.3668 => 16.9470, std.dev.: 0.7235) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 17.90% (0.0838 => 0.0988, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 17.82% (0.4636 => 0.5462, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.81% (0.0842 => 0.0992, std.dev.: 0.0054) MultiSource/Benchmarks/NPB-serial/is/is: 17.80% (0.0719 => 0.0847, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/property: 17.65% (0.3886 => 0.4572, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 17.55% (1.5603 => 1.8342, std.dev.: 0.0353) SingleSource/Benchmarks/Shootout-C++/matrix: 17.40% (0.3098 => 0.3637, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.29% (4.9449 => 5.7999, std.dev.: 0.1414) SingleSource/Benchmarks/Shootout-C++/lists1: 17.26% (0.3684 => 0.4320, std.dev.: 0.0246) SingleSource/Benchmarks/McGill/exptree: 16.95% (0.0814 => 0.0952, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/matrix: 16.87% (0.0818 => 0.0956, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.79% (0.0834 => 0.0974, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.76% (5.0018 => 5.8400, std.dev.: 0.1634) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.70% (0.8172 => 0.9537, std.dev.: 0.0476) SingleSource/UnitTests/ObjC/trivial-interface: 16.70% (0.3473 => 0.4053, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/bmm/bmm: 16.60% (0.0759 => 0.0885, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/mst/mst: 16.42% (0.1163 => 0.1354, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/em3d/em3d: 16.40% (0.1695 => 0.1973, std.dev.: 0.0104) SingleSource/UnitTests/ObjC/exceptions: 16.38% (0.3828 => 0.4455, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/parameter-passing: 16.37% (0.3927 => 0.4570, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions-4: 16.29% (0.3543 => 0.4120, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-3: 16.27% (0.3516 => 0.4088, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/misr: 16.11% (0.0633 => 0.0735, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/synchronized: 16.06% (0.3561 => 0.4133, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.06% (0.3543 => 0.4112, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 15.95% (0.2877 => 0.3336, std.dev.: 0.0081) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.91% (0.0886 => 0.1027, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/wc: 15.89% (0.3052 => 0.3537, std.dev.: 0.0100) SingleSource/UnitTests/ObjC/for-in: 15.84% (0.3694 => 0.4279, std.dev.: 0.0023) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.84% (0.1143 => 0.1324, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.74% (0.0648 => 0.0750, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.71% (0.0770 => 0.0891, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-2: 15.64% (0.3497 => 0.4044, std.dev.: 0.0021) SingleSource/UnitTests/SignlessTypes/rem: 15.56% (0.1144 => 0.1322, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 15.55% (0.1151 => 0.1330, std.dev.: 0.0017) SingleSource/Benchmarks/Stanford/Puzzle: 15.54% (0.1268 => 0.1465, std.dev.: 0.0056) MultiSource/Applications/viterbi/viterbi: 15.50% (0.1555 => 0.1796, std.dev.: 0.0075) SingleSource/Regression/C++/ofstream_ctor: 15.49% (0.2905 => 0.3355, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.37% (0.2758 => 0.3182, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.22% (0.1117 => 0.1287, std.dev.: 0.0056) SingleSource/UnitTests/ObjC++/property-reference: 14.99% (0.7326 => 0.8424, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.90% (0.2107 => 0.2421, std.dev.: 0.0113) SingleSource/UnitTests/ObjC++/property-reference-object: 14.81% (0.6030 => 0.6923, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.69% (0.3935 => 0.4513, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.60% (0.5981 => 0.6854, std.dev.: 0.0226) SingleSource/UnitTests/ObjC++/Hello: 14.48% (0.5925 => 0.6783, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 14.44% (3.8922 => 4.4543, std.dev.: 0.1275) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.38% (0.1029 => 0.1177, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.37% (0.1510 => 0.1727, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.12% (0.1062 => 0.1212, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.78% (0.2271 => 0.2584, std.dev.: 0.0117) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.54% (0.4615 => 0.5240, std.dev.: 0.0227) SingleSource/Benchmarks/Misc/ReedSolomon: 13.13% (0.2049 => 0.2318, std.dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: 12.86% (9.4845 => 10.7045, std.dev.: 0.4171) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.86% (0.1695 => 0.1913, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/lists: 12.80% (0.3422 => 0.3860, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.77% (0.5020 => 0.5661, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.52% (0.8101 => 0.9115, std.dev.: 0.0383) SingleSource/Benchmarks/Shootout-C++/hash: 11.91% (0.4289 => 0.4800, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.90% (0.3865 => 0.4325, std.dev.: 0.0134) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.80% (0.1906 => 0.2131, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.73% (0.0929 => 0.1038, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary2: 11.66% (0.3379 => 0.3773, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/ary: 11.57% (0.3232 => 0.3606, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/hash2: 11.32% (0.4620 => 0.5143, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/fibo: 11.23% (0.2725 => 0.3031, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/except: 11.15% (0.2871 => 0.3191, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/sieve: 10.94% (0.3603 => 0.3997, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/moments: 10.42% (0.4048 => 0.4470, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/oourafft: 9.87% (0.3282 => 0.3606, std.dev.: 0.0081) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.70% (0.3817 => 0.4149, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.26% (0.4879 => 0.5282, std.dev.: 0.0106) Performance Regressions - Execution Time ---------------------------------------- SingleSource/UnitTests/ObjC/synchronized: 189.25% (0.1051 => 0.3040, std.dev.: 0.0509) SingleSource/Benchmarks/Shootout/methcall: 149.56% (4.3953 => 10.9691, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/methcall: 147.33% (5.3999 => 13.3554, std.dev.: 0.0143) MultiSource/Benchmarks/SciMark2-C/scimark2: 79.99% (32.5116 => 58.5189, std.dev.: 0.0430) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.62% (1.1145 => 1.2997, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/oourafft: 16.03% (6.6465 => 7.7122, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.04% (0.2944 => 0.3328, std.dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.02% (2.0360 => 2.2808, std.dev.: 0.0264) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.59% (2.8904 => 3.2254, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: 10.32% (1.1396 => 1.2572, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.53% (1.7254 => 1.8899, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.01% (4.2280 => 4.4822, std.dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.94% (0.9540 => 1.0107, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691) MultiSource/Applications/lua/lua: 4.36% (26.0924 => 27.2307, std.dev.: 0.2642) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.6436 => 12.1312, std.dev.: 0.0184) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.34% (0.4162 => 0.4301, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 2.20% (85.0658 => 86.9348, std.dev.: 0.0137) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.12% (1.3677 => 1.3967, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 2.05% (3.1595 => 3.2242, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.55% (6.5088 => 6.6097, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 1.20% (5.2636 => 5.3267, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0501, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fbench: 1.00% (2.2771 => 2.2999, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1676, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.13% (5.2763 => 1.2595, std.dev.: 0.0342) SingleSource/Benchmarks/Misc/salsa20: -74.82% (0.8651 => 0.2178, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: -40.20% (0.1622 => 0.0970, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.38% (5.3855 => 4.7190, std.dev.: 0.1706) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.95% (5.3526 => 4.7127, std.dev.: 0.1838) MultiSource/Applications/JM/ldecod/ldecod: -11.31% (10.4361 => 9.2561, std.dev.: 0.3968) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -64.78% (1.9577 => 0.6895, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1682) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.38% (0.3987 => 0.2377, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.24% (4.5009 => 2.7796, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7652, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.09% (2.6546 => 2.0150, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/mason/mason: -19.07% (0.2161 => 0.1749, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4263, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.70% (2.6778 => 2.2841, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -10.88% (1.5373 => 1.3701, std.dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: -10.43% (9.5636 => 8.5659, std.dev.: 0.2150) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.68% (1.5660 => 1.4300, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.05% (1.6805 => 1.5453, std.dev.: 0.0301) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4816, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.76% (0.3463 => 0.3229, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.41% (19.9488 => 18.6694, std.dev.: 0.2022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.81% (3.2416 => 3.0532, std.dev.: 0.0169) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7497, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.54% (2.7294 => 2.5782, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.01% (0.2497 => 0.2372, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.00% (0.8614 => 0.8183, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5092, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -4.47% (6.2999 => 6.0183, std.dev.: 0.0038) MultiSource/Benchmarks/sim/sim: -3.12% (5.0483 => 4.8909, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.69% (0.9957 => 0.9689, std.dev.: 0.0046) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.68% (0.4808 => 0.4679, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.97% (8.1563 => 7.9955, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6777, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -1.52% (10.2830 => 10.1265, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.75% (0.1485 => 0.1355, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0015) Report Time: 2.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 02:42:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 04:42:47 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121130104247.754F12A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/6414?compare_to=6410&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6414, Order: 168986, Start Time: 2012-11-30 09:08:29, End Time: 2012-11-30 10:43:23 To: 6410, Order: 168984, Start Time: 2012-11-30 07:07:01, End Time: 2012-11-30 08:44:53 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (184 on baseline) Added Tests: 0 (52 on baseline) Unchanged Tests: 1093 (852 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.30% (54.5543 => 56.3562, std.dev.: 0.1904) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 74.90% (31.3723 => 54.8695, std.dev.: 0.0162) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.26% (54.5751 => 56.3562, std.dev.: 0.1904) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.22% (2.0478 => 2.1138, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.4937 => 7.6825, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/hash2: 2.16% (3.1932 => 3.2623, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.46% (0.1431 => 0.1310) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.62% (0.3821 => 0.3530, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.27% (0.9542 => 0.8848, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.65% (0.3142 => 0.2933, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.46% (0.3357 => 0.3140, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.34% (2.4924 => 2.3344, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.30% (0.2428 => 0.2275, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -6.20% (0.2160 => 0.2026, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.11% (0.3812 => 0.3579, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.11% (0.3880 => 0.3643, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.11% (0.3831 => 0.3597, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.08% (0.3884 => 0.3648, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: -6.01% (0.3896 => 0.3662, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions-3: -6.00% (0.3848 => 0.3617, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -5.98% (0.4033 => 0.3792, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.96% (0.1796 => 0.1689, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.94% (0.3891 => 0.3660, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -5.91% (0.1761 => 0.1657, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -5.90% (9.2283 => 8.6836, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions: -5.89% (0.4176 => 0.3930, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -5.86% (16.1920 => 15.2437, std.dev.: 0.0267) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.82% (0.7198 => 0.6779, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.77% (0.2355 => 0.2219, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.76% (0.9852 => 0.9285, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.75% (0.5863 => 0.5526, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.73% (0.5859 => 0.5523, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: -5.73% (7.0961 => 6.6895, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.72% (0.5805 => 0.5473, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.69% (0.5857 => 0.5524, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.67% (0.5802 => 0.5473, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.64% (0.6484 => 0.6118, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.63% (0.6395 => 0.6035, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.62% (0.5567 => 0.5254, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.60% (1.3722 => 1.2953, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.59% (0.5478 => 0.5172, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.58% (0.5591 => 0.5279, std.dev.: 0.0112) SingleSource/UnitTests/ObjC/property: -5.57% (0.4199 => 0.3965, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.56% (0.6297 => 0.5947, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.56% (0.5705 => 0.5388, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.56% (4.8161 => 4.5485, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.55% (0.6052 => 0.5716, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.54% (0.6194 => 0.5851, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.54% (0.6395 => 0.6041, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.52% (0.6681 => 0.6312, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.52% (0.3658 => 0.3456, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.51% (0.6676 => 0.6308, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.50% (0.6304 => 0.5957, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.50% (4.8802 => 4.6116, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/football/football: -5.50% (0.9179 => 0.8674, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.50% (0.5581 => 0.5274, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.50% (0.5456 => 0.5156, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.50% (0.6260 => 0.5916, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.48% (1.2300 => 1.1626, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.47% (0.6230 => 0.5889, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.47% (0.5849 => 0.5529, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.46% (6.7716 => 6.4016, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.46% (4.0323 => 3.8120, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.44% (3.5339 => 3.3417, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.43% (0.5575 => 0.5272, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: -5.42% (1.3864 => 1.3113, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.40% (0.5570 => 0.5269, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.40% (0.5925 => 0.5605, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -5.40% (0.4280 => 0.4049, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.38% (0.6189 => 0.5856, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.38% (0.5688 => 0.5382, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.37% (1.0544 => 0.9978, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.36% (0.6440 => 0.6095, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.35% (0.7339 => 0.6946, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.34% (0.6446 => 0.6102, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.34% (0.5941 => 0.5624, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.33% (1.6364 => 1.5491, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.33% (1.4642 => 1.3862, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.32% (0.5569 => 0.5273, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.31% (1.2784 => 1.2105, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.31% (0.2695 => 0.2552, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.29% (0.6736 => 0.6380, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: -5.27% (0.4515 => 0.4277, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.24% (0.6293 => 0.5963, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.24% (0.7919 => 0.7504, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.23% (0.3057 => 0.2897, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -5.23% (4.3330 => 4.1064, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.23% (4.5069 => 4.2713, std.dev.: 0.0040) MultiSource/Benchmarks/sim/sim: -5.20% (0.3406 => 0.3229, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -5.20% (1.1450 => 1.0855, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: -5.20% (1.1530 => 1.0931, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.19% (0.3931 => 0.3727, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.18% (0.2548 => 0.2416, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.18% (0.8521 => 0.8080, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.17% (0.6033 => 0.5721, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -5.15% (17.1032 => 16.2226, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.13% (14.2083 => 13.4792, std.dev.: 0.0216) MultiSource/Benchmarks/Olden/bh/bh: -5.09% (0.2985 => 0.2833, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -5.07% (1.3148 => 1.2482, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.97% (0.4813 => 0.4574, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: -4.96% (0.2659 => 0.2527, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.96% (0.4916 => 0.4672, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: -4.95% (0.3255 => 0.3094, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.94% (0.3483 => 0.3311, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.93% (1.2210 => 1.1608, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.93% (0.3837 => 0.3648, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.91% (0.3016 => 0.2868, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: -4.90% (0.3059 => 0.2909, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -4.89% (0.3025 => 0.2877, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.89% (0.4151 => 0.3948, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.89% (0.3252 => 0.3093, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.88% (8.0126 => 7.6217, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (0.2871 => 0.2731, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -4.87% (1.2515 => 1.1905, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: -4.86% (0.3581 => 0.3407, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.85% (0.3323 => 0.3162, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.82% (0.2385 => 0.2270, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: -4.82% (0.3194 => 0.3040, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.81% (0.4321 => 0.4113, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.81% (0.2933 => 0.2792, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.80% (0.5999 => 0.5711, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: -4.79% (15.5079 => 14.7653, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/ary3: -4.79% (0.3446 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -4.77% (0.3205 => 0.3052, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.77% (2.1713 => 2.0678, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/random: -4.76% (0.2939 => 0.2799, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -4.75% (3.5154 => 3.3483, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.75% (1.2221 => 1.1641, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/except: -4.73% (0.3026 => 0.2883, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.72% (0.2903 => 0.2766, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -4.71% (0.3394 => 0.3234, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -4.70% (0.2849 => 0.2715, std.dev.: 0.0032) MultiSource/Applications/ClamAV/clamscan: -4.69% (15.2527 => 14.5368, std.dev.: 0.0206) SingleSource/Benchmarks/Shootout-C++/strcat: -4.68% (0.2989 => 0.2849, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.67% (0.6660 => 0.6349, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.65% (0.2278 => 0.2172, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: -4.63% (0.4861 => 0.4636, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.60% (0.2999 => 0.2861, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.59% (0.6667 => 0.6361, std.dev.: 0.0051) MultiSource/Applications/lua/lua: -4.57% (4.0594 => 3.8739, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout-C++/moments: -4.57% (0.4248 => 0.4054, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -4.55% (34.0927 => 32.5425, std.dev.: 0.0475) SingleSource/Benchmarks/Shootout-C++/ary2: -4.51% (0.3481 => 0.3324, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -4.46% (0.7982 => 0.7626, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.46% (0.7021 => 0.6708, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.42% (0.3849 => 0.3679, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.41% (0.5168 => 0.4940, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.41% (1.6474 => 1.5748, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.40% (0.7447 => 0.7119, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/lists1: -4.37% (0.3867 => 0.3698, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -4.36% (0.3621 => 0.3463, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: -4.35% (2.1401 => 2.0470, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.33% (0.5329 => 0.5098, std.dev.: 0.0070) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.32% (22.4056 => 21.4378, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/hash: -4.29% (0.4524 => 0.4330, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: -4.28% (0.3271 => 0.3131, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.28% (0.9557 => 0.9148, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.28% (5.0226 => 4.8077, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.26% (0.4083 => 0.3909, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -4.26% (2.4021 => 2.2998, std.dev.: 0.0177) MultiSource/Applications/kimwitu++/kc: -4.19% (18.2933 => 17.5276, std.dev.: 0.0131) MultiSource/Applications/spiff/spiff: -4.16% (0.8418 => 0.8068, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.07% (0.3319 => 0.3184, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.04% (0.4427 => 0.4248, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -3.88% (0.3788 => 0.3641, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.81% (0.9077 => 0.8731, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/bigfib: -3.78% (0.6750 => 0.6495, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.56% (2.2587 => 2.1782, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.55% (0.3491 => 0.3367, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -3.51% (0.7779 => 0.7506, std.dev.: 0.0043) MultiSource/Applications/hbd/hbd: -3.39% (1.5610 => 1.5081, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: -3.07% (0.6347 => 0.6152, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -3.06% (20.7746 => 20.1392, std.dev.: 0.0381) SingleSource/UnitTests/ObjC++/property-reference-object: -3.04% (0.6441 => 0.6245, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.71% (5.4682 => 5.3201, std.dev.: 0.0094) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -60.34% (1.8100 => 0.7179, std.dev.: 0.0121) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7566, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -8.70% (1.2842 => 1.1725, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: -3.99% (2.2633 => 2.1731, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.94% (1.7753 => 1.7054, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3998, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0245, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4740, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 04:14:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 06:14:10 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121130121410.E26EB2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/6415?compare_to=6412&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6415, Order: 168991, Start Time: 2012-11-30 10:35:38, End Time: 2012-11-30 12:14:47 To: 6412, Order: 168986, Start Time: 2012-11-30 08:37:00, End Time: 2012-11-30 10:12:55 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 11 (67 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (51 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1042 (867 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.30% (0.2947 => 0.3339, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.32% (0.9529 => 1.0131, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.85% (0.2935 => 0.3048, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.79% (4.3529 => 4.4308, std.dev.: 0.0284) MultiSource/Applications/d/make_dparser: 1.12% (3.3555 => 3.3932, std.dev.: 0.0109) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: 27.95% (39.7249 => 50.8286, std.dev.: 0.2885) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 8.74% (2.2462 => 2.4425, std.dev.: 0.0326) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.93% (1.5638 => 1.5940, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/bh/bh: 1.35% (2.3818 => 2.4139, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.32% (3.1299 => 3.1713, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.29% (6.8757 => 6.9643, std.dev.: 0.0221) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.78% (1.0756 => 1.1055, std.dev.: 0.2147) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.19% (0.3733 => 0.3726, std.dev.: 0.0090) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -31.41% (0.0191 => 0.0131, std.dev.: 0.0066) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0427 => 0.0428, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 9.60% (0.0302 => 0.0331, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.95% (0.0317 => 0.0314, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.88% (0.0386 => 0.0428, std.dev.: 0.0120) SingleSource/UnitTests/Vector/Altivec/casts: -4.90% (0.0204 => 0.0194, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/test1: 29.59% (0.0169 => 0.0219, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -1.55% (0.1488 => 0.1465, std.dev.: 0.0102) MultiSource/Applications/lemon/lemon: 3.94% (1.1730 => 1.2192, std.dev.: 0.3721) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.25% (0.3998 => 0.3988, std.dev.: 0.0849) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.81% (0.1461 => 0.1502, std.dev.: 0.0280) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.34% (0.0629 => 0.0650, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0278 => 0.0279, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.97% (0.0563 => 0.0636, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.62% (1.1443 => 1.1514, std.dev.: 0.0828) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 1200.00% (0.0002 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 14.69% (0.0531 => 0.0609, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.41% (0.0191 => 0.0251, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.06% (0.8052 => 0.8057, std.dev.: 0.0125) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 31.37% (0.0051 => 0.0067, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.21% (8.6205 => 8.6025, std.dev.: 0.0295) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 12.60% (16.4461 => 18.5188, std.dev.: 0.8203) MultiSource/Applications/sqlite3/sqlite3: 2362.43% (0.6332 => 15.5921, std.dev.: 0.6648) MultiSource/Benchmarks/McCat/08-main/main: 51.39% (0.1831 => 0.2772, std.dev.: 0.0854) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.38% (0.1559 => 0.1565, std.dev.: 0.0472) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7235.03% (0.3123 => 22.9073, std.dev.: 0.4143) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1547.91% (0.3344 => 5.5106, std.dev.: 0.1143) SingleSource/Benchmarks/Misc-C++/Large/ray: 40.14% (0.2364 => 0.3313, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/bigfib: 6.19% (0.6010 => 0.6382, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/mandel: 3.96% (0.0429 => 0.0446, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.56% (0.3266 => 0.3513, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/strcat: 5.79% (0.1969 => 0.2083, std.dev.: 0.0049) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 9.82% (0.0224 => 0.0246, std.dev.: 0.0075) SingleSource/UnitTests/byval-alignment: -30.43% (0.0230 => 0.0160, std.dev.: 0.0025) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0518, std.dev.: 0.0077) MultiSource/Applications/oggenc/oggenc: 12.38% (0.1462 => 0.1643, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3999, std.dev.: 0.1434) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0712, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4899, std.dev.: 0.0353) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5211, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2659, std.dev.: 0.0266) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0788, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3607, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3795, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0008, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0824, std.dev.: 0.0101) SingleSource/Regression/C/uint64_to_float: -29.80% (2.1832 => 1.5325, std.dev.: 0.0123) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.34% (0.0773 => 0.0907, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 12.08% (0.9039 => 1.0131, std.dev.: 0.0080) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.42% (0.8321 => 0.9105, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.33% (0.1157 => 0.1265, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: 8.04% (0.7950 => 0.8589, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.17% (0.2844 => 0.3048, std.dev.: 0.0043) MultiSource/Applications/Burg/burg: 7.12% (1.2222 => 1.3092, std.dev.: 0.0317) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 6.93% (0.8518 => 0.9108, std.dev.: 0.0150) MultiSource/Applications/siod/siod: 6.75% (2.2184 => 2.3681, std.dev.: 0.0234) MultiSource/Applications/treecc/treecc: 6.60% (1.9948 => 2.1265, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.60% (0.8286 => 0.8833, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 6.37% (0.8697 => 0.9251, std.dev.: 0.0215) MultiSource/Applications/SPASS/SPASS: 6.32% (14.2605 => 15.1619, std.dev.: 0.2824) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.27% (0.8204 => 0.8718, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.20% (0.8177 => 0.8684, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.09% (4.1763 => 4.4308, std.dev.: 0.0284) MultiSource/Applications/sgefa/sgefa: 5.40% (0.2999 => 0.3161, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.18% (0.8340 => 0.8772, std.dev.: 0.0150) MultiSource/Applications/d/make_dparser: 4.84% (3.2366 => 3.3932, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.48% (0.6586 => 0.6881, std.dev.: 0.0059) MultiSource/Applications/JM/lencod/lencod: 4.23% (15.3280 => 15.9762, std.dev.: 0.1422) MultiSource/Applications/oggenc/oggenc: 4.00% (4.9628 => 5.1612, std.dev.: 0.0298) MultiSource/Benchmarks/mafft/pairlocalalign: 3.96% (8.6247 => 8.9663, std.dev.: 0.0978) MultiSource/Applications/JM/ldecod/ldecod: 3.65% (6.7320 => 6.9779, std.dev.: 0.0561) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 198.79% (28.5821 => 85.3999, std.dev.: 0.0398) SingleSource/Benchmarks/Misc/pi: 40.14% (1.5795 => 2.2135, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 27.78% (2.9096 => 3.7179, std.dev.: 0.1770) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.69% (4.8436 => 5.8942, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.89% (8.2783 => 9.7595, std.dev.: 0.0122) SingleSource/Benchmarks/McGill/misr: 17.20% (0.4001 => 0.4689, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.31% (0.7597 => 0.8836, std.dev.: 0.0351) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.11% (14.6451 => 16.8582, std.dev.: 0.5379) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 13.28% (2.7995 => 3.1713, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.90% (0.3186 => 0.3597, std.dev.: 0.0058) MultiSource/Applications/lambda-0_1_3/lambda: 10.50% (7.4933 => 8.2799, std.dev.: 0.0812) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.36% (0.1129 => 0.1246, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.27% (1.1857 => 1.3075, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.21% (6.3772 => 6.9643, std.dev.: 0.0221) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 8.63% (2.2485 => 2.4425, std.dev.: 0.0326) MultiSource/Benchmarks/McCat/18-imp/imp: 7.66% (0.1370 => 0.1475, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.54% (3.9917 => 4.2927, std.dev.: 0.0937) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.34% (23.5781 => 25.3087, std.dev.: 0.0237) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 6.31% (4.8660 => 5.1732, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.31% (3.3761 => 3.5891, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.10% (2.9753 => 3.1568, std.dev.: 0.0380) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.87% (5.4187 => 5.7366, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.72% (4.5327 => 4.7921, std.dev.: 0.0170) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.49% (0.3937 => 0.4153, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.39% (5.3218 => 5.6088, std.dev.: 0.0202) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 5.38% (0.4353 => 0.4587, std.dev.: 0.0021) MultiSource/Applications/aha/aha: 5.16% (3.3398 => 3.5122, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.81% (0.5214 => 0.5465, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/power/power: 4.60% (1.2061 => 1.2616, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/richards_benchmark: 4.59% (1.3037 => 1.3635, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.72% (4.8362 => 5.0159, std.dev.: 0.0435) MultiSource/Applications/JM/lencod/lencod: 3.07% (6.7064 => 6.9125, std.dev.: 0.0190) MultiSource/Benchmarks/Olden/bh/bh: 2.46% (2.3560 => 2.4139, std.dev.: 0.0116) SingleSource/Benchmarks/Dhrystone/dry: 2.38% (0.5081 => 0.5202, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.36% (3.4104 => 3.4910, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/ReedSolomon: 1.84% (8.5322 => 8.6893, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/queens: 1.79% (1.7056 => 1.7362, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/methcall: 1.72% (8.2676 => 8.4100, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.72% (11.5690 => 11.7678, std.dev.: 0.0366) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.69% (2.4647 => 2.5063, std.dev.: 0.0090) MultiSource/Applications/spiff/spiff: 1.15% (2.8561 => 2.8889, std.dev.: 0.0104) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.13% (1.9302 => 1.9521, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-3: 1.09% (2.0670 => 2.0896, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.10% (2.8951 => 1.6762, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -24.54% (7.2130 => 5.4428, std.dev.: 0.0817) MultiSource/Benchmarks/Ptrdist/ks/ks: -18.78% (1.4529 => 1.1800, std.dev.: 0.0323) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.77% (9.9065 => 8.2456, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/ary3: -13.53% (1.9999 => 1.7293, std.dev.: 0.0941) MultiSource/Benchmarks/Olden/em3d/em3d: -12.45% (5.4641 => 4.7837, std.dev.: 0.0505) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.61% (0.3269 => 0.2955, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-8: -9.49% (2.5609 => 2.3178, std.dev.: 0.0226) MultiSource/Benchmarks/mafft/pairlocalalign: -9.04% (63.1822 => 57.4717, std.dev.: 0.1087) SingleSource/Benchmarks/McGill/chomp: -7.96% (1.1216 => 1.0323, std.dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.75% (1.0512 => 0.9697, std.dev.: 0.0238) SingleSource/Benchmarks/Stanford/FloatMM: -6.61% (0.8807 => 0.8225, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/sieve: -6.12% (7.0599 => 6.6280, std.dev.: 0.0259) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.05% (4.7482 => 4.4610, std.dev.: 0.0275) SingleSource/Benchmarks/Misc/flops: -5.48% (9.3748 => 8.8608, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.16% (5.1305 => 4.8657, std.dev.: 0.0955) SingleSource/Benchmarks/Misc/ffbench: -4.92% (1.4296 => 1.3593, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.89% (6.2275 => 5.9227, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.85% (5.6343 => 5.3613, std.dev.: 0.0320) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.43% (6.1706 => 5.8970, std.dev.: 0.0166) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.41% (2.8773 => 2.7504, std.dev.: 0.0360) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.27% (4.7449 => 4.5424, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/himenobmtxpa: -4.12% (4.3552 => 4.1758, std.dev.: 0.0636) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.98% (4.9453 => 4.7484, std.dev.: 0.0179) SingleSource/Benchmarks/Misc/perlin: -3.93% (5.1084 => 4.9074, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.78% (3.7148 => 3.5742, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.63% (5.1557 => 4.9687, std.dev.: 0.0227) SingleSource/Benchmarks/Shootout-C++/methcall: -3.55% (8.9760 => 8.6577, std.dev.: 0.0381) MultiSource/Applications/siod/siod: -3.30% (3.6643 => 3.5432, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.28% (4.9686 => 4.8058, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.01% (5.4300 => 5.2664, std.dev.: 0.0162) SingleSource/Benchmarks/Misc/fbench: -2.92% (3.3840 => 3.2853, std.dev.: 0.0190) SingleSource/Benchmarks/Dhrystone/fldry: -2.69% (0.6910 => 0.6724, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.53% (2.6356 => 2.5689, std.dev.: 0.0238) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.83% (3.3479 => 3.2865, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/flops-5: -1.70% (2.8957 => 2.8466, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.59% (3.5679 => 3.5110, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/fp-convert: -1.58% (15.8853 => 15.6344, std.dev.: 0.0359) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.27% (4.2466 => 4.1928, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.03% (4.7794 => 4.7304, std.dev.: 0.0177) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 7.73% (1.0262 => 1.1055, std.dev.: 0.2147) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.28% (0.2463 => 0.3726, std.dev.: 0.0090) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 6.50% (0.0123 => 0.0131, std.dev.: 0.0066) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.46% (0.0384 => 0.0428, std.dev.: 0.0120) SingleSource/UnitTests/Vector/Altivec/casts: 2.11% (0.0190 => 0.0194, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.88% (0.1438 => 0.1465, std.dev.: 0.0102) MultiSource/Applications/lemon/lemon: 7.62% (1.1329 => 1.2192, std.dev.: 0.3721) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.23% (0.4164 => 0.3988, std.dev.: 0.0849) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.72% (0.1369 => 0.1502, std.dev.: 0.0280) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.40% (0.0641 => 0.0650, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 43.08% (0.0195 => 0.0279, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.03% (0.0578 => 0.0636, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.67% (1.1437 => 1.1514, std.dev.: 0.0828) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.87% (0.0627 => 0.0609, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.44% (0.0180 => 0.0251, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.50% (0.8017 => 0.8057, std.dev.: 0.0125) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 8.06% (0.0062 => 0.0067, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 04:40:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 06:40:47 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121130124047.B08742A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/6416?compare_to=6414&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6416, Order: 168991, Start Time: 2012-11-30 11:06:34, End Time: 2012-11-30 12:41:23 To: 6414, Order: 168986, Start Time: 2012-11-30 09:08:29, End Time: 2012-11-30 10:43:23 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (6 on baseline) Performance Improvements: 1 (184 on baseline) Added Tests: 0 (52 on baseline) Unchanged Tests: 1091 (852 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 6.11% (0.3600 => 0.3820, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.83% (77.9923 => 79.4188, std.dev.: 0.2134) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -4.11% (0.7179 => 0.6884, std.dev.: 0.0054) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 74.93% (31.3723 => 54.8783, std.dev.: 0.0175) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.47% (54.5751 => 56.4698, std.dev.: 0.0929) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1015, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: 2.27% (7.4937 => 7.6637, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/hash2: 2.20% (3.1932 => 3.2633, std.dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.46% (0.1431 => 0.1310, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.72% (0.3821 => 0.3526, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.03% (0.9542 => 0.8871, std.dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: -6.81% (2.4924 => 2.3227, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.78% (0.3142 => 0.2929, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: -6.63% (0.3831 => 0.3577, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -6.58% (0.3812 => 0.3561, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.57% (0.3880 => 0.3625, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.57% (0.3884 => 0.3629, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.47% (0.3896 => 0.3644, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -6.44% (0.3848 => 0.3600, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -6.42% (0.4033 => 0.3774, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.37% (0.3357 => 0.3143, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.37% (0.4176 => 0.3910, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.34% (0.2428 => 0.2274, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.27% (0.3891 => 0.3647, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.21% (0.7198 => 0.6751, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.07% (0.1796 => 0.1687, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.05% (0.6484 => 0.6092, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -5.97% (0.2160 => 0.2031, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -5.96% (0.1879 => 0.1767, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.96% (0.3658 => 0.3440, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.92% (0.5863 => 0.5516, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -5.91% (0.1761 => 0.1657, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -5.90% (9.2283 => 8.6837, std.dev.: 0.0160) MultiSource/Applications/JM/lencod/lencod: -5.89% (16.1920 => 15.2381, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.84% (0.5802 => 0.5463, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -5.83% (0.4199 => 0.3954, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.82% (0.5478 => 0.5159, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.82% (0.5857 => 0.5516, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -5.81% (7.0961 => 6.6839, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.77% (0.2355 => 0.2219, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.77% (0.6395 => 0.6026, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.77% (0.5859 => 0.5521, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.76% (1.3722 => 1.2932, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.75% (0.6260 => 0.5900, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.72% (0.9852 => 0.9288) SingleSource/UnitTests/ObjC/parameter-passing: -5.72% (0.4280 => 0.4035, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.72% (0.5591 => 0.5271, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.70% (1.0544 => 0.9943, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.69% (0.5567 => 0.5250, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.69% (0.3057 => 0.2883, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.68% (0.5805 => 0.5475, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.68% (0.6052 => 0.5708, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.68% (0.5849 => 0.5517, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.67% (0.6194 => 0.5843, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.66% (0.5581 => 0.5265, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.66% (0.5705 => 0.5382, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.65% (0.5575 => 0.5260, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.65% (0.6304 => 0.5948, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.65% (0.6395 => 0.6034, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.63% (0.6230 => 0.5879, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.62% (0.6297 => 0.5943, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/football/football: -5.62% (0.9179 => 0.8663, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.62% (0.6676 => 0.6301, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.60% (0.7524 => 0.7103, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.59% (1.2300 => 1.1612, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.59% (0.5456 => 0.5151, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.59% (4.8161 => 4.5470, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.56% (0.6189 => 0.5845, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.55% (1.4642 => 1.3829, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.55% (1.6364 => 1.5456, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.55% (0.7339 => 0.6932, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.55% (0.3931 => 0.3713, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.54% (0.6440 => 0.6083, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.53% (0.5570 => 0.5262, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.50% (4.8802 => 4.6119, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.49% (0.6446 => 0.6092, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.49% (0.2695 => 0.2547, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.49% (0.5925 => 0.5600, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.47% (0.6293 => 0.5949, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.45% (0.5941 => 0.5617, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.45% (6.7716 => 6.4027, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.44% (4.5069 => 4.2615, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.44% (0.7919 => 0.7488, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.44% (3.5339 => 3.3416, std.dev.: 0.0194) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.43% (0.8521 => 0.8058, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.43% (0.5688 => 0.5379, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -5.43% (1.3148 => 1.2434, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.43% (4.0323 => 3.8134, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.43% (2.1713 => 2.0535, std.dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: -5.42% (1.3864 => 1.3112, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -5.42% (0.3025 => 0.2861, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.42% (0.6736 => 0.6371, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.39% (0.6681 => 0.6321, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.38% (14.2083 => 13.4443, std.dev.: 0.0162) MultiSource/Benchmarks/nbench/nbench: -5.35% (1.1530 => 1.0913, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.35% (0.4321 => 0.4090, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.34% (0.6033 => 0.5711, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -5.32% (0.3194 => 0.3024, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.30% (0.2903 => 0.2749, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -5.30% (4.3330 => 4.1032, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.30% (0.3323 => 0.3147, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: -5.29% (0.2871 => 0.2719, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -5.29% (0.4515 => 0.4276, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -5.29% (1.1450 => 1.0844, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.29% (0.3837 => 0.3634, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.28% (0.2933 => 0.2778, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -5.28% (0.3255 => 0.3083, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -5.27% (0.3205 => 0.3036, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.26% (1.2784 => 1.2112, std.dev.: 0.0039) MultiSource/Benchmarks/sim/sim: -5.26% (0.3406 => 0.3227, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.25% (0.4151 => 0.3933, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.23% (0.3483 => 0.3301, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: -5.22% (0.3446 => 0.3266, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -5.21% (0.2939 => 0.2786, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.21% (0.3016 => 0.2859, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -5.20% (0.3481 => 0.3300, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -5.20% (17.1032 => 16.2146, std.dev.: 0.0208) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.18% (0.2278 => 0.2160, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -5.15% (0.2989 => 0.2835, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.15% (0.4916 => 0.4663, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.14% (0.2548 => 0.2417) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.13% (0.5999 => 0.5691, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -5.13% (0.2985 => 0.2832, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -5.12% (0.2849 => 0.2703, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.11% (0.2659 => 0.2523, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.11% (1.2221 => 1.1597, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.10% (0.3252 => 0.3086, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -5.04% (1.2515 => 1.1884, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: -5.04% (0.3394 => 0.3223, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -5.03% (0.3059 => 0.2905, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: -5.03% (0.3581 => 0.3401, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.02% (8.0126 => 7.6106, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.99% (0.2385 => 0.2266, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -4.98% (15.5079 => 14.7355, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hash2: -4.92% (0.4861 => 0.4622, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.91% (1.2210 => 1.1611, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: -4.90% (3.5154 => 3.3432, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.87% (0.2999 => 0.2853, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: -4.85% (0.4248 => 0.4042, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -4.83% (0.3621 => 0.3446, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -4.80% (15.2527 => 14.5203, std.dev.: 0.0051) MultiSource/Applications/lua/lua: -4.77% (4.0594 => 3.8657, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/lists1: -4.76% (0.3867 => 0.3683, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.75% (0.3849 => 0.3666, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.74% (0.7447 => 0.7094, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.74% (0.6667 => 0.6351, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: -4.73% (0.4524 => 0.4310, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.73% (0.6660 => 0.6345, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.67% (0.4813 => 0.4588, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -4.66% (34.0927 => 32.5053, std.dev.: 0.0175) MultiSource/Benchmarks/McCat/09-vor/vor: -4.62% (0.3271 => 0.3120, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.60% (0.4083 => 0.3895, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -4.60% (2.1401 => 2.0416, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -4.60% (0.7982 => 0.7615, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.50% (0.4427 => 0.4228, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.49% (0.5168 => 0.4936, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -4.45% (2.4021 => 2.2952, std.dev.: 0.0191) MultiSource/Applications/kimwitu++/kc: -4.45% (18.2933 => 17.4799, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.43% (0.7021 => 0.6710, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.41% (0.5329 => 0.5094, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.40% (22.4056 => 21.4197, std.dev.: 0.0155) MultiSource/Applications/oggenc/oggenc: -4.40% (5.0226 => 4.8016, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/sieve: -4.36% (0.3788 => 0.3623, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.35% (0.9557 => 0.9141, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.33% (1.6474 => 1.5761, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.27% (0.9077 => 0.8689, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: -4.26% (0.8418 => 0.8059, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.25% (0.3319 => 0.3178, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -4.13% (0.6750 => 0.6471, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -3.78% (0.7779 => 0.7485, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: -3.73% (0.6441 => 0.6201, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.70% (0.3491 => 0.3362, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.64% (2.2587 => 2.1765, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: -3.63% (1.5610 => 1.5044, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: -3.59% (0.6347 => 0.6119, std.dev.: 0.0000) SingleSource/UnitTests/Vector/constpool: -3.20% (20.7746 => 20.1108, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.84% (5.4682 => 5.3128, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.97% (1.8100 => 0.6884, std.dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7529, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -8.66% (1.2842 => 1.1730, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7061, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: -3.81% (2.2633 => 2.1771, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3991, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.82% (1.3096 => 1.2858, std.dev.: 0.0078) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.47% (6.5735 => 6.4766, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 05:53:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 07:53:30 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121130135330.DBFB32A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/6417?compare_to=6413&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6417, Order: 168991, Start Time: 2012-11-30 11:28:00, End Time: 2012-11-30 13:54:05 To: 6413, Order: 168986, Start Time: 2012-11-30 07:55:18, End Time: 2012-11-30 10:24:42 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 20 (143 on baseline) Performance Improvements: 1 (42 on baseline) Added Tests: 0 (186 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1067 (700 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 12.50% (0.3129 => 0.3520, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.05% (0.5799 => 0.6382, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.89% (0.5924 => 0.6510, std.dev.: 0.0157) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.32% (0.1212 => 0.1325, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.99% (0.6684 => 0.7285, std.dev.: 0.0203) MultiSource/Applications/d/make_dparser: 8.91% (3.7851 => 4.1224, std.dev.: 0.1033) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.88% (0.6725 => 0.7322, std.dev.: 0.0187) MultiSource/Benchmarks/Olden/bh/bh: 7.72% (0.3340 => 0.3598, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 7.54% (0.6462 => 0.6949, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/strcat: 7.47% (0.3094 => 0.3325, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/18-imp/imp: 6.71% (0.3904 => 0.4166, std.dev.: 0.0081) MultiSource/Applications/spiff/spiff: 6.28% (0.8980 => 0.9544, std.dev.: 0.0198) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.14% (1.4791 => 1.5699, std.dev.: 0.0326) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.21% (2.3274 => 2.4487, std.dev.: 0.0390) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 4.41% (20.3662 => 21.2649, std.dev.: 0.2995) MultiSource/Applications/JM/lencod/lencod: 2.93% (31.6842 => 32.6121, std.dev.: 0.3332) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: 80.88% (0.1046 => 0.1892, std.dev.: 0.0277) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 31.69% (0.3446 => 0.4538, std.dev.: 0.0090) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.39% (1.5453 => 1.6286, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.28% (4.1083 => 4.1608, std.dev.: 0.0134) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -11.81% (0.6729 => 0.5934, std.dev.: 0.0284) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.03% (69.5396 => 69.5199, std.dev.: 0.6765) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -1.18% (0.1355 => 0.1339, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.21% (0.0419 => 0.0445, std.dev.: 0.0056) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0652 => 0.0651, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -0.04% (493.7307 => 493.5374, std.dev.: 0.1671) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.92% (63.2438 => 69.5199, std.dev.: 0.6765) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.99% (4.3882 => 0.0445, std.dev.: 0.0056) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43664.96% (1.1277 => 493.5374, std.dev.: 0.1671) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 195.22% (0.5229 => 1.5437, std.dev.: 0.1025) MultiSource/Applications/SPASS/SPASS: 18.88% (14.9895 => 17.8196, std.dev.: 0.3359) MultiSource/Applications/kimwitu++/kc: 49.73% (14.1553 => 21.1948, std.dev.: 0.2371) MultiSource/Benchmarks/MallocBench/gs/gs: 24.08% (4.1105 => 5.1003, std.dev.: 0.1238) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.53% (1.1048 => 1.5194, std.dev.: 0.0655) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 443.43% (7.1582 => 38.8999, std.dev.: 0.1576) SingleSource/Benchmarks/Misc-C++-EH/spirit: 77.61% (3.4629 => 6.1505, std.dev.: 0.4035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.80% (0.6222 => 1.0378, std.dev.: 0.0535) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10363.19% (0.0720 => 7.5335, std.dev.: 0.3396) MultiSource/Applications/SIBsim4/SIBsim4: 3853800.00% (0.0001 => 3.8539, std.dev.: 0.0404) MultiSource/Applications/SPASS/SPASS: 13557300.00% (0.0001 => 13.5574, std.dev.: 1.9476) MultiSource/Applications/kimwitu++/kc: 52400.00% (0.0001 => 0.0525, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 65000.00% (0.0001 => 0.0651, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 596900.00% (0.0001 => 0.5970, std.dev.: 0.0330) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9985500.00% (0.0001 => 9.9856, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5674300.00% (0.0001 => 5.6744, std.dev.: 0.8008) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1799.67% (1.1194 => 21.2649, std.dev.: 0.2995) MultiSource/Applications/ClamAV/clamscan: 70.65% (22.1758 => 37.8420, std.dev.: 0.2308) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 58.61% (2.9384 => 4.6606, std.dev.: 0.3543) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 58.01% (7.0540 => 11.1460, std.dev.: 0.2179) MultiSource/Benchmarks/FreeBench/distray/distray: 55.21% (0.1056 => 0.1639, std.dev.: 0.0063) MultiSource/Applications/JM/lencod/lencod: 48.66% (21.9371 => 32.6121, std.dev.: 0.3332) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 48.41% (8.1363 => 12.0751, std.dev.: 0.3597) SingleSource/Benchmarks/Misc/flops: 43.37% (0.1432 => 0.2053, std.dev.: 0.0042) SingleSource/UnitTests/vla: 39.44% (0.0355 => 0.0495, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 38.77% (0.0730 => 0.1013, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: 37.82% (0.2554 => 0.3520, std.dev.: 0.0143) SingleSource/Benchmarks/Stanford/Oscar: 32.70% (0.0636 => 0.0844, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 30.90% (0.0793 => 0.1038, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/dot-syntax-1: 29.65% (0.0479 => 0.0621, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/15-trie/trie: 27.51% (0.0527 => 0.0672, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/17-bintr/bintr: 26.96% (0.0675 => 0.0857, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.94% (0.0746 => 0.0947, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/messages-2: 26.89% (0.0662 => 0.0840, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: 26.52% (0.0626 => 0.0792, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 26.25% (0.0842 => 0.1063, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 26.19% (0.0886 => 0.1118, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 25.98% (0.7433 => 0.9364, std.dev.: 0.0345) MultiSource/Benchmarks/McCat/04-bisect/bisect: 24.76% (0.1062 => 0.1325, std.dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.18% (0.1125 => 0.1397, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/huffbench: 24.11% (0.0871 => 0.1081, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 23.93% (0.0443 => 0.0549, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 23.60% (3.3354 => 4.1224, std.dev.: 0.1033) MultiSource/Benchmarks/NPB-serial/is/is: 23.09% (0.0719 => 0.0885, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 23.08% (0.0953 => 0.1173, std.dev.: 0.0043) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 22.70% (0.0467 => 0.0573, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wordfreq: 22.56% (0.3307 => 0.4053, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 22.45% (14.3668 => 17.5917, std.dev.: 0.3144) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 22.00% (0.0491 => 0.0599, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 21.81% (0.7835 => 0.9544, std.dev.: 0.0198) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.78% (0.1566 => 0.1907, std.dev.: 0.0090) MultiSource/Benchmarks/McCat/18-imp/imp: 21.71% (0.3423 => 0.4166, std.dev.: 0.0081) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 21.46% (0.1584 => 0.1924, std.dev.: 0.0099) MultiSource/Applications/minisat/minisat: 21.42% (0.7115 => 0.8639, std.dev.: 0.0300) MultiSource/Benchmarks/Olden/tsp/tsp: 21.36% (0.1175 => 0.1426, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.11% (0.2065 => 0.2501, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/bigfib: 21.10% (0.6456 => 0.7818, std.dev.: 0.0205) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.93% (0.2107 => 0.2548, std.dev.: 0.0110) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.41% (0.3121 => 0.3758, std.dev.: 0.0173) MultiSource/Benchmarks/McCat/09-vor/vor: 20.35% (0.3180 => 0.3827, std.dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.30% (1.3050 => 1.5699, std.dev.: 0.0326) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.14% (0.1117 => 0.1342, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.52% (0.2700 => 0.3227, std.dev.: 0.0169) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.50% (0.4615 => 0.5515, std.dev.: 0.0206) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 18.86% (0.2603 => 0.3094, std.dev.: 0.0113) SingleSource/UnitTests/ObjC/parameter-passing: 18.41% (0.3927 => 0.4650, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 18.38% (0.3422 => 0.4051, std.dev.: 0.0140) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.32% (0.0704 => 0.0833, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fbench: 18.07% (0.0592 => 0.0699, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 17.70% (0.2271 => 0.2673, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/ary2: 17.61% (0.3379 => 0.3974, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/except: 17.49% (0.2871 => 0.3373, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/strcat: 17.45% (0.2831 => 0.3325, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/exceptions: 17.37% (0.3828 => 0.4493, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-4: 17.27% (0.3543 => 0.4155, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.27% (0.0834 => 0.0978, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/matrix: 17.24% (0.0818 => 0.0959, std.dev.: 0.0033) MultiSource/Applications/lua/lua: 17.18% (3.8723 => 4.5375, std.dev.: 0.1687) SingleSource/UnitTests/2006-12-11-LoadConstants: 17.15% (0.1143 => 0.1339, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 17.11% (0.3694 => 0.4326, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 17.05% (0.1906 => 0.2231, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/neural/neural: 17.02% (0.1463 => 0.1712, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/property: 17.01% (0.3886 => 0.4547, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-3: 16.92% (0.3516 => 0.4111, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 16.87% (0.3052 => 0.3567, std.dev.: 0.0075) SingleSource/UnitTests/ObjC/exceptions-2: 16.84% (0.3497 => 0.4086, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.74% (0.8172 => 0.9540, std.dev.: 0.0445) SingleSource/Benchmarks/Shootout-C++/ary: 16.68% (0.3232 => 0.3771, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.60% (0.2891 => 0.3371, std.dev.: 0.0142) SingleSource/UnitTests/ObjC/synchronized: 16.60% (0.3561 => 0.4152, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 16.57% (0.3283 => 0.3827, std.dev.: 0.0096) MultiSource/Applications/oggenc/oggenc: 16.54% (5.7591 => 6.7118, std.dev.: 0.2934) MultiSource/Benchmarks/Olden/em3d/em3d: 16.52% (0.1695 => 0.1975, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/trivial-interface: 16.47% (0.3473 => 0.4045, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 16.42% (0.1163 => 0.1354, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/bh/bh: 16.36% (0.3092 => 0.3598, std.dev.: 0.0081) SingleSource/Regression/C++/ofstream_ctor: 16.21% (0.2905 => 0.3376, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 16.17% (0.1268 => 0.1473, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.05% (0.0648 => 0.0752, std.dev.: 0.0027) SingleSource/UnitTests/SignlessTypes/rem: 16.00% (0.1144 => 0.1327, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 15.88% (0.1555 => 0.1802, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 15.88% (17.1811 => 19.9093, std.dev.: 0.4682) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.84% (0.0770 => 0.0892, std.dev.: 0.0035) MultiSource/Applications/aha/aha: 15.73% (0.1151 => 0.1332, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/health/health: 15.62% (0.1268 => 0.1466, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.57% (0.4636 => 0.5358, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.52% (0.1940 => 0.2241, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.37% (0.2758 => 0.3182, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.33% (0.1337 => 0.1542, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/05-eks/eks: 15.28% (0.4299 => 0.4956, std.dev.: 0.0169) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.19% (0.0770 => 0.0887, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.10% (0.1510 => 0.1738, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.04% (0.3543 => 0.4076, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/Hello: 14.77% (0.5925 => 0.6800, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 14.73% (0.6030 => 0.6918, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.51% (0.5569 => 0.6377, std.dev.: 0.0288) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.50% (0.9765 => 1.1181, std.dev.: 0.0509) SingleSource/UnitTests/ObjC++/property-reference: 14.43% (0.7326 => 0.8383, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.35% (0.5981 => 0.6839, std.dev.: 0.0230) SingleSource/Benchmarks/Shootout-C++/hash: 14.34% (0.4289 => 0.4904, std.dev.: 0.0199) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 14.11% (3.8922 => 4.4412, std.dev.: 0.1495) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.95% (0.3935 => 0.4484, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.64% (1.5415 => 1.7517, std.dev.: 0.0788) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.00% (0.2430 => 0.2746, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.50% (4.9449 => 5.5629, std.dev.: 0.2314) MultiSource/Benchmarks/mafft/pairlocalalign: 12.37% (9.4845 => 10.6582, std.dev.: 0.4357) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.05% (0.0838 => 0.0939, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.40% (1.1861 => 1.3213, std.dev.: 0.0461) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.19% (2.2022 => 2.4487, std.dev.: 0.0390) SingleSource/Benchmarks/Misc/oourafft: 10.09% (0.3282 => 0.3613, std.dev.: 0.0113) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.04% (0.3817 => 0.4162, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/UnitTests/ObjC/synchronized: 258.90% (0.1051 => 0.3772, std.dev.: 0.0709) SingleSource/Benchmarks/Shootout/methcall: 149.58% (4.3953 => 10.9700, std.dev.: 0.0317) SingleSource/Benchmarks/Shootout-C++/methcall: 147.19% (5.3999 => 13.3481, std.dev.: 0.0179) MultiSource/Benchmarks/McCat/17-bintr/bintr: 81.40% (0.1043 => 0.1892, std.dev.: 0.0277) MultiSource/Benchmarks/SciMark2-C/scimark2: 80.06% (32.5116 => 58.5414, std.dev.: 0.0618) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 39.37% (0.3256 => 0.4538, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.61% (1.1145 => 1.2996, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/oourafft: 16.14% (6.6465 => 7.7191, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.98% (0.2944 => 0.3326, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.36% (2.8904 => 3.2187, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/richards_benchmark: 10.12% (1.1396 => 1.2549, std.dev.: 0.0024) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.95% (1.7254 => 1.8799, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/ffbench: 8.26% (0.9505 => 1.0290, std.dev.: 0.0151) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.93% (0.9540 => 1.0106, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.81% (4.2280 => 4.4735, std.dev.: 0.0128) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.99% (26.0924 => 27.3946, std.dev.: 0.2271) MultiSource/Benchmarks/nbench/nbench: 4.12% (11.6436 => 12.1235, std.dev.: 0.0106) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 2.09% (85.0658 => 86.8449, std.dev.: 0.0514) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.08% (1.3677 => 1.3962, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 2.08% (3.1595 => 3.2253, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.85% (2.1424 => 2.1821, std.dev.: 0.0127) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.47% (6.5088 => 6.6046, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.34% (1.0313 => 1.0451, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0503, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 1.08% (5.2636 => 5.3204, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1678, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.68% (5.2763 => 1.2303, std.dev.: 0.0448) SingleSource/Benchmarks/Misc/salsa20: -74.74% (0.8651 => 0.2185, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: -40.38% (0.1622 => 0.0967, std.dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: -11.00% (10.4361 => 9.2882, std.dev.: 0.4226) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.86% (5.3526 => 4.8249, std.dev.: 0.1146) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -9.51% (5.3855 => 4.8732, std.dev.: 0.0909) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -64.93% (1.9577 => 0.6866, std.dev.: 0.0063) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1681) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.13% (0.3987 => 0.2387, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.26% (4.5009 => 2.7787, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.10% (2.6546 => 2.0149, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -19.16% (0.2161 => 0.1747, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.65% (1.6925 => 1.4277, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.72% (2.6778 => 2.2835, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -10.69% (1.5373 => 1.3729, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -10.51% (9.5636 => 8.5587, std.dev.: 0.2328) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4244, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.64% (0.3463 => 0.3233, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.61% (2.7294 => 2.5764, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.56% (3.2416 => 3.0614, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.13% (0.8614 => 0.8172, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.85% (0.2497 => 0.2376, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.79% (19.9488 => 18.9928, std.dev.: 0.3526) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5085, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: -4.55% (6.2999 => 6.0133, std.dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.43% (0.9957 => 0.9615, std.dev.: 0.0065) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.09% (1.6805 => 1.6286, std.dev.: 0.0024) MultiSource/Benchmarks/sim/sim: -3.07% (5.0483 => 4.8932, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.72% (0.4808 => 0.4677, std.dev.: 0.0022) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.90% (8.1563 => 8.0015, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6771, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.52% (10.2830 => 10.1270, std.dev.: 0.0039) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0012) Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 06:11:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 08:11:37 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121130141137.03CC02A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/6418?compare_to=6415&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6418, Order: 168996, Start Time: 2012-11-30 12:33:19, End Time: 2012-11-30 14:12:11 To: 6415, Order: 168991, Start Time: 2012-11-30 10:35:38, End Time: 2012-11-30 12:14:47 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 3 (48 on baseline) Performance Improvements: 4 (28 on baseline) Added Tests: 0 (51 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1046 (898 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.34% (3.5891 => 3.6732, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.48% (16.8582 => 17.1083, std.dev.: 0.0742) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.22% (3.5577 => 3.6012, std.dev.: 0.0105) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -10.09% (0.1784 => 0.1604, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: -1.86% (1.1800 => 1.1580, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.31% (3.1713 => 3.1298, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.00% (1.6186 => 1.6024, std.dev.: 0.0063) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -2.39% (1.1055 => 1.0791, std.dev.: 0.2965) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.38% (0.3726 => 0.3852, std.dev.: 0.1040) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 54.20% (0.0131 => 0.0202, std.dev.: 0.0082) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -19.86% (0.0428 => 0.0343, std.dev.: 0.0146) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 6.95% (0.0331 => 0.0354, std.dev.: 0.0087) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0314 => 0.0313, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.01% (0.0428 => 0.0398, std.dev.: 0.0145) SingleSource/UnitTests/Vector/Altivec/casts: -15.98% (0.0194 => 0.0163, std.dev.: 0.0072) SingleSource/UnitTests/Vector/Altivec/test1: -0.46% (0.0219 => 0.0218, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/Burg/burg: -23.08% (0.0013 => 0.0010, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.68% (0.1465 => 0.1455, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: -9.07% (1.2192 => 1.1086, std.dev.: 0.3809) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.94% (0.3988 => 0.4225, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.73% (0.1502 => 0.1491, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.85% (0.0650 => 0.0625, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.15% (0.0279 => 0.0273, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.16% (0.0636 => 0.0565, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.32% (1.1514 => 1.1551, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.03% (0.0609 => 0.0554, std.dev.: 0.0155) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.58% (0.0251 => 0.0265, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.38% (0.8057 => 0.8088, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 16.42% (0.0067 => 0.0078, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.43% (8.6025 => 8.6397, std.dev.: 0.1045) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 10.22% (16.4461 => 18.1270, std.dev.: 0.8947) MultiSource/Applications/sqlite3/sqlite3: 2346.65% (0.6332 => 15.4922, std.dev.: 0.6272) MultiSource/Benchmarks/McCat/08-main/main: 50.96% (0.1831 => 0.2764, std.dev.: 0.0502) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.45% (0.1559 => 0.1474, std.dev.: 0.0077) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7202.91% (0.3123 => 22.8070, std.dev.: 0.6000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1544.35% (0.3344 => 5.4987, std.dev.: 0.3007) SingleSource/Benchmarks/Misc-C++/Large/ray: 43.19% (0.2364 => 0.3385, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/bigfib: 5.89% (0.6010 => 0.6364, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: 4.66% (0.0429 => 0.0449, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.02% (0.3266 => 0.3430, std.dev.: 0.0486) SingleSource/Benchmarks/Shootout-C++/strcat: 3.81% (0.1969 => 0.2044, std.dev.: 0.0662) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 9.82% (0.0224 => 0.0246, std.dev.: 0.0089) SingleSource/UnitTests/byval-alignment: -29.57% (0.0230 => 0.0162, std.dev.: 0.0017) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0517, std.dev.: 0.0046) MultiSource/Applications/oggenc/oggenc: 12.45% (0.1462 => 0.1644, std.dev.: 0.0088) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3988, std.dev.: 0.0569) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0706, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4883, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5198, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2687, std.dev.: 0.0187) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0704, std.dev.: 0.0144) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3625, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3801, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0844, std.dev.: 0.0146) SingleSource/Regression/C/uint64_to_float: -29.59% (2.1832 => 1.5373, std.dev.: 0.0510) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.83% (0.2519 => 0.2817, std.dev.: 0.0114) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.53% (0.1091 => 0.1195, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.35% (0.2279 => 0.2492, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.88% (2.1401 => 2.3301, std.dev.: 0.0682) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.24% (1.5315 => 1.6577, std.dev.: 0.0341) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.21% (0.2844 => 0.3049, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.20% (3.1832 => 3.3807, std.dev.: 0.0511) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.10% (0.8261 => 0.8765, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.77% (0.8204 => 0.8677, std.dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.49% (0.5191 => 0.5476, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.8340 => 0.8719, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 4.36% (8.6247 => 9.0011, std.dev.: 0.1092) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.84% (0.6586 => 0.6839, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 198.87% (28.5821 => 85.4232, std.dev.: 0.1231) SingleSource/Benchmarks/Misc/pi: 38.64% (1.5795 => 2.1898, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 27.69% (2.9096 => 3.7154, std.dev.: 0.0459) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.57% (4.8436 => 5.8883, std.dev.: 0.0211) SingleSource/Benchmarks/McGill/misr: 18.87% (0.4001 => 0.4756, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.95% (8.2783 => 9.7639, std.dev.: 0.0136) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.82% (14.6451 => 17.1083, std.dev.: 0.0742) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.57% (0.7597 => 0.8856, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.94% (0.3186 => 0.3662, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.80% (2.7995 => 3.1298, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.36% (0.1129 => 0.1246, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.29% (6.3772 => 7.0337, std.dev.: 0.2352) MultiSource/Applications/lambda-0_1_3/lambda: 10.24% (7.4933 => 8.2606, std.dev.: 0.1170) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.18% (1.1857 => 1.3064, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.80% (3.3761 => 3.6732, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.49% (23.5781 => 25.3448, std.dev.: 0.1697) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.01% (3.9917 => 4.2714, std.dev.: 0.0663) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 6.05% (4.8660 => 5.1605, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.85% (4.5327 => 4.7977, std.dev.: 0.0458) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.64% (0.3937 => 0.4159, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.61% (5.3218 => 5.6206, std.dev.: 0.0260) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 5.24% (0.5214 => 0.5487, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 5.01% (0.4353 => 0.4571, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: 4.76% (1.3037 => 1.3657, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 4.14% (4.8362 => 5.0364, std.dev.: 0.0280) MultiSource/Benchmarks/Olden/power/power: 3.65% (1.2061 => 1.2501, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.42% (1.0388 => 1.0743, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.12% (0.3587 => 0.3699, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/queens: 2.37% (1.7056 => 1.7460, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.13% (3.4104 => 3.4829, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.71% (11.5690 => 11.7672, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout/methcall: 1.62% (8.2676 => 8.4018, std.dev.: 0.0273) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.35% (1.9302 => 1.9562, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/ReedSolomon: 1.23% (8.5322 => 8.6371, std.dev.: 0.0369) MultiSource/Benchmarks/sim/sim: 1.10% (3.8206 => 3.8627, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.21% (2.8951 => 1.6730, std.dev.: 0.0422) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -25.00% (7.2130 => 5.4096, std.dev.: 0.1117) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.30% (1.4529 => 1.1580, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.73% (9.9065 => 8.2495, std.dev.: 0.0230) MultiSource/Benchmarks/Olden/em3d/em3d: -12.61% (5.4641 => 4.7751, std.dev.: 0.0451) SingleSource/Benchmarks/Misc/flops-8: -9.26% (2.5609 => 2.3237, std.dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: -8.99% (63.1822 => 57.5019, std.dev.: 0.1344) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.53% (0.3269 => 0.2990, std.dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.15% (1.0512 => 0.9655, std.dev.: 0.0318) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.02% (5.1305 => 4.8216, std.dev.: 0.0565) SingleSource/Benchmarks/Misc/flops: -5.48% (9.3748 => 8.8606, std.dev.: 0.0271) SingleSource/Benchmarks/Misc/ffbench: -5.36% (1.4296 => 1.3530, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout/sieve: -5.31% (7.0599 => 6.6853, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.16% (4.7482 => 4.5034, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.09% (6.2275 => 5.9103, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.50% (4.7449 => 4.5314, std.dev.: 0.0261) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.34% (1.3882 => 1.3280, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.75% (5.1557 => 4.9626, std.dev.: 0.0460) SingleSource/Benchmarks/Shootout-C++/methcall: -3.43% (8.9760 => 8.6678, std.dev.: 0.0452) SingleSource/Benchmarks/Misc/perlin: -3.42% (5.1084 => 4.9336, std.dev.: 0.0284) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.18% (5.4300 => 5.2573, std.dev.: 0.0264) SingleSource/Benchmarks/Misc/fbench: -2.44% (3.3840 => 3.3014, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.88% (3.3479 => 3.2849, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/flops-5: -1.81% (2.8957 => 2.8432, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.75% (3.5679 => 3.5054, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: -1.54% (15.8853 => 15.6410, std.dev.: 0.0229) SingleSource/Benchmarks/Misc/flops-6: -1.27% (2.4416 => 2.4106, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.13% (4.7794 => 4.7256, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 5.15% (1.0262 => 1.0791, std.dev.: 0.2965) SingleSource/Benchmarks/CoyoteBench/fftbench: 56.39% (0.2463 => 0.3852, std.dev.: 0.1040) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 64.23% (0.0123 => 0.0202, std.dev.: 0.0082) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -15.93% (0.0408 => 0.0343, std.dev.: 0.0146) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 39.37% (0.0254 => 0.0354, std.dev.: 0.0087) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 3.65% (0.0384 => 0.0398, std.dev.: 0.0145) SingleSource/UnitTests/Vector/Altivec/casts: -14.21% (0.0190 => 0.0163, std.dev.: 0.0072) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 42.86% (0.0007 => 0.0010, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.18% (0.1438 => 0.1455, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: -2.14% (1.1329 => 1.1086, std.dev.: 0.3809) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.46% (0.4164 => 0.4225, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.91% (0.1369 => 0.1491, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.50% (0.0641 => 0.0625, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 40.00% (0.0195 => 0.0273, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.25% (0.0578 => 0.0565, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.00% (1.1437 => 1.1551, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.64% (0.0627 => 0.0554, std.dev.: 0.0155) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.22% (0.0180 => 0.0265, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.89% (0.8017 => 0.8088, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 25.81% (0.0062 => 0.0078, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 06:19:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 08:19:07 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121130141907.B5AE52A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/6419?compare_to=6411&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6419, Order: 168989, Start Time: 2012-11-30 10:49:36, End Time: 2012-11-30 14:19:42 To: 6411, Order: 168977, Start Time: 2012-11-30 06:27:15, End Time: 2012-11-30 10:01:05 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (177 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (186 on baseline) Unchanged Tests: 1091 (713 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.57% (2.3841 => 2.4215, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: 1.31% (2.3847 => 2.4160, std.dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -3.95% (0.3671 => 0.3526, std.dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.88% (0.0625 => 0.0893, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.58% (0.1063 => 0.1420, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.74% (0.0475 => 0.0602, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.58% (0.1106 => 0.1400, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.51% (0.2969 => 0.3756, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.78% (0.0547 => 0.0688, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.63% (0.4253 => 0.5343, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.56% (0.4139 => 0.5197, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.21% (0.0714 => 0.0894, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 25.01% (1.5932 => 1.9917, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.00% (0.5900 => 0.7375, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.44% (0.1620 => 0.2016, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.98% (0.5000 => 0.6199, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.89% (0.4994 => 0.6187, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.80% (0.0584 => 0.0723) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.82% (0.1021 => 0.1254, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.52% (0.0897 => 0.1099, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.49% (0.1107 => 0.1356, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 22.37% (0.0599 => 0.0733, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 21.41% (0.0948 => 0.1151, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.40% (0.0584 => 0.0709, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.33% (0.0633 => 0.0768, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.26% (0.0541 => 0.0656, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.18% (0.0642 => 0.0778, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.03% (0.1103 => 0.1335, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.01% (0.0495 => 0.0599, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.01% (0.1604 => 0.1941, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 20.70% (0.0604 => 0.0729, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.59% (0.1549 => 0.1868, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.57% (0.3903 => 0.4706, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: 20.46% (0.0821 => 0.0989, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.44% (0.1003 => 0.1208, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.44% (0.0822 => 0.0990, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 20.26% (0.1619 => 0.1947, std.dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: 19.64% (0.0947 => 0.1133, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.43% (0.1462 => 0.1746, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 19.31% (0.0808 => 0.0964, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.97% (0.3890 => 0.4628, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 18.91% (0.4029 => 0.4791, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.87% (0.2014 => 0.2394, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.73% (1.3152 => 1.5616, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.67% (0.2866 => 0.3401, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 18.57% (0.5826 => 0.6908, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 18.48% (0.0698 => 0.0827, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 18.47% (0.1218 => 0.1443, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.35% (0.2736 => 0.3238, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 18.17% (0.5889 => 0.6959, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 18.14% (0.1505 => 0.1778, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 18.10% (0.5546 => 0.6550, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.01% (0.1088 => 0.1284, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 17.86% (0.9697 => 1.1429, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: 17.83% (0.1284 => 0.1513, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.83% (0.0572 => 0.0674, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.80% (0.0573 => 0.0675) MultiSource/Benchmarks/MallocBench/gs/gs: 17.77% (1.8794 => 2.2133, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.71% (3.5627 => 4.1935, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.61% (0.3271 => 0.3847, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.53% (0.5026 => 0.5907, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.52% (0.0605 => 0.0711, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.43% (0.1968 => 0.2311, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.38% (1.6211 => 1.9029, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.13% (2.0673 => 2.4215, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 17.11% (0.7171 => 0.8398, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/matrix: 17.09% (0.2780 => 0.3255, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.07% (0.4658 => 0.5453, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.98% (0.1160 => 0.1357, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 16.96% (0.1421 => 0.1662, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 16.93% (1.0781 => 1.2606, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.90% (0.2875 => 0.3361, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 16.90% (0.2811 => 0.3286, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.78% (4.4195 => 5.1610, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.73% (0.2792 => 0.3259, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 16.70% (0.2725 => 0.3180, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 16.69% (0.2714 => 0.3167, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.69% (0.2738 => 0.3195, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.58% (0.4361 => 0.5084, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.49% (0.2911 => 0.3391, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 16.48% (0.2803 => 0.3265, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.45% (0.2729 => 0.3178, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 16.40% (0.9909 => 1.1534, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: 16.33% (0.2750 => 0.3199, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 16.28% (4.2109 => 4.8966, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.24% (0.3195 => 0.3714, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 16.22% (0.2823 => 0.3281, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 16.21% (0.3004 => 0.3491, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.16% (0.3930 => 0.4565, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wc: 16.15% (0.3096 => 0.3596, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 16.14% (0.2813 => 0.3267, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.08% (2.7292 => 3.1680, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.87% (0.1090 => 0.1263, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.67% (1.9694 => 2.2781, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.56% (1.9966 => 2.3073, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 15.52% (0.3267 => 0.3774, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 15.47% (0.3317 => 0.3830, std.dev.: 0.0091) MultiSource/Benchmarks/Bullet/bullet: 15.46% (23.5202 => 27.1571, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/ary: 15.44% (0.3258 => 0.3761, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 15.43% (0.2566 => 0.2962, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.36% (0.3060 => 0.3530, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.14% (0.3362 => 0.3871, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 15.08% (0.2075 => 0.2388, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/sieve: 15.03% (0.3726 => 0.4286, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.01% (0.3124 => 0.3593, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 14.95% (0.3678 => 0.4228, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/exceptions-2: 14.89% (0.3446 => 0.3959, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.79% (0.3469 => 0.3982, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.78% (0.3282 => 0.3767, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 14.78% (0.3465 => 0.3977, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 14.76% (0.3348 => 0.3842, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 14.73% (0.3496 => 0.4011, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.71% (0.3488 => 0.4001, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 14.65% (0.3460 => 0.3967, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.64% (0.3845 => 0.4408, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.57% (0.3981 => 0.4561, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/trivial-interface: 14.56% (0.3442 => 0.3943, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 14.54% (1.4269 => 1.6343, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.46% (0.3625 => 0.4149, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 14.41% (0.3650 => 0.4176, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 14.41% (0.3477 => 0.3978, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.34% (0.3690 => 0.4219, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 14.30% (0.3643 => 0.4164, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 14.23% (0.4146 => 0.4736, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 14.18% (0.3724 => 0.4252, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash2: 14.00% (0.4251 => 0.4846, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 13.88% (0.7875 => 0.8968, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 13.85% (2.1653 => 2.4653, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 13.72% (0.0758 => 0.0862, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 13.54% (4.6177 => 5.2428, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 13.43% (0.5012 => 0.5685, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 13.25% (2.1013 => 2.3797, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 13.04% (0.2691 => 0.3042, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 12.46% (0.3498 => 0.3934, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.45% (0.2040 => 0.2294, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.20% (0.6435 => 0.7220, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 12.01% (5.5417 => 6.2072, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.96% (0.1028 => 0.1151, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.79% (0.1383 => 0.1546, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 11.15% (0.6634 => 0.7374, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 11.08% (0.4847 => 0.5384, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.07% (0.2068 => 0.2297, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.07% (0.2737 => 0.3040, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.70% (0.3084 => 0.3414, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 10.52% (0.3336 => 0.3687, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 10.10% (2.0346 => 2.2400, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 9.91% (0.2391 => 0.2628, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.89% (0.2103 => 0.2311, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.88% (11.6398 => 12.6731, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.77% (0.5361 => 0.5831, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.59% (4.6926 => 5.0955, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.29% (0.5584 => 0.6047, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.89% (0.7426 => 0.8012, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 6.96% (11.9555 => 12.7871, std.dev.: 0.0139) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.25% (0.3792 => 0.3991, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.81% (29.0505 => 181.5095, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.12% (0.0734 => 0.0867, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6100, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 5.71% (0.2802 => 0.2962, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6690, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1701, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-2: 4.69% (1.8057 => 1.8903, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.60% (79.9355 => 83.6145, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/dry: 4.29% (14.0481 => 14.6506, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.66% (0.3693 => 0.3828, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/health/health: 2.90% (0.6276 => 0.6458, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1997, std.dev.: 0.0066) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.74% (3.1722 => 3.2273, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3075, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2884, std.dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5400, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5831, std.dev.: 0.0159) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.44% (2.4764 => 2.4160, std.dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.89% (25.4195 => 16.5519, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary2: -8.53% (0.2402 => 0.2197, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9769, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8028, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/tsp/tsp: -7.13% (2.1113 => 1.9608, std.dev.: 0.0060) SingleSource/UnitTests/Vector/build2: -3.73% (11.2080 => 10.7904, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: -3.17% (17.2379 => 16.6910, std.dev.: 0.0692) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0053) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7733, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8595, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.69% (10.7630 => 10.5816, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4956, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (105.3826 => 104.1900, std.dev.: 0.0628) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0469, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 06:39:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 08:39:06 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121130143906.4EF7A2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/6420?compare_to=6416&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6420, Order: 168997, Start Time: 2012-11-30 13:04:25, End Time: 2012-11-30 14:39:41 To: 6416, Order: 168991, Start Time: 2012-11-30 11:06:34, End Time: 2012-11-30 12:41:23 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (8 on baseline) Performance Improvements: 0 (179 on baseline) Added Tests: 0 (52 on baseline) Unchanged Tests: 1093 (855 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 14.76% (0.3820 => 0.4384, std.dev.: 0.0065) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 14.35% (0.3834 => 0.4384, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 75.05% (31.3723 => 54.9158, std.dev.: 0.0194) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.37% (54.5751 => 56.4146, std.dev.: 0.1022) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.76% (2.0478 => 2.1043, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: 2.39% (7.4937 => 7.6725, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash2: 2.18% (3.1932 => 3.2629, std.dev.: 0.0024) MultiSource/Benchmarks/llubenchmark/llu: 1.32% (3.7435 => 3.7931, std.dev.: 0.0127) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.39% (0.1431 => 0.1311) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.59% (0.3821 => 0.3531, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.08% (0.9542 => 0.8866, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -6.76% (2.4924 => 2.3238, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.72% (0.3142 => 0.2931, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.68% (0.3831 => 0.3575, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.62% (0.3880 => 0.3623, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/exceptions-3: -6.55% (0.3848 => 0.3596, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.55% (0.3896 => 0.3641, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.45% (0.3812 => 0.3566, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.45% (0.3891 => 0.3640, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.40% (0.4033 => 0.3775, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -6.39% (0.4176 => 0.3909, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.30% (0.2428 => 0.2275, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.20% (0.7198 => 0.6752, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.10% (0.3884 => 0.3647, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -6.10% (0.4199 => 0.3943, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.95% (0.6484 => 0.6098, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.93% (0.3658 => 0.3441, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -5.91% (9.2283 => 8.6827, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.89% (0.5859 => 0.5514, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.82% (0.5805 => 0.5467, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -5.81% (16.1920 => 15.2520, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.81% (0.5857 => 0.5517, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.80% (0.5863 => 0.5523, std.dev.: 0.0112) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.79% (1.3722 => 1.2928, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.77% (0.5802 => 0.5467, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: -5.77% (7.0961 => 6.6864, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.77% (0.5705 => 0.5376, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.75% (0.6395 => 0.6027, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.75% (0.6260 => 0.5900, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -5.75% (0.4280 => 0.4034, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.73% (0.2355 => 0.2220, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.72% (0.3057 => 0.2882, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.72% (0.5591 => 0.5271, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.71% (0.6676 => 0.6295, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.70% (0.6052 => 0.5707, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: -5.69% (0.3357 => 0.3166, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -5.69% (0.9179 => 0.8657, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.68% (0.9852 => 0.9292, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.68% (0.6194 => 0.5842, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.68% (0.5456 => 0.5146, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.68% (0.5849 => 0.5517, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.68% (0.7524 => 0.7097, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.66% (0.6395 => 0.6033, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.66% (0.6189 => 0.5839, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.65% (0.5575 => 0.5260, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.63% (4.0323 => 3.8051, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.63% (0.6304 => 0.5949, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.62% (1.0544 => 0.9951, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.62% (0.5478 => 0.5170, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.62% (0.6230 => 0.5880, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.60% (4.8161 => 4.5463, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.58% (1.6364 => 1.5451, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.57% (0.5688 => 0.5371, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.57% (0.7339 => 0.6930, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.55% (0.3931 => 0.3713, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -5.54% (1.3148 => 1.2419, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.54% (0.5581 => 0.5272, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.53% (6.7716 => 6.3974, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: -5.52% (0.3025 => 0.2858, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -5.52% (4.3330 => 4.0938, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.51% (1.2300 => 1.1622, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.51% (0.6297 => 0.5950, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.51% (0.6681 => 0.6313, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.51% (0.6446 => 0.6091, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.49% (0.5570 => 0.5264, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.49% (4.8802 => 4.6125, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.49% (0.5925 => 0.5600, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.47% (0.3837 => 0.3627, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.47% (0.3016 => 0.2851, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.47% (0.5941 => 0.5616, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.46% (0.5569 => 0.5265, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.46% (2.1713 => 2.0528, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/objinst: -5.45% (0.3194 => 0.3020, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -5.44% (0.3255 => 0.3078, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.43% (0.6440 => 0.6090, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.43% (4.5069 => 4.2620, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.42% (3.5339 => 3.3424, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.42% (0.2695 => 0.2549, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.42% (0.7919 => 0.7490, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: -5.40% (0.2871 => 0.2716, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.40% (1.4642 => 1.3852, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.37% (0.6736 => 0.6374, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.37% (0.6033 => 0.5709, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.35% (0.4151 => 0.3929, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -5.34% (0.2939 => 0.2782, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.34% (0.2903 => 0.2748, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.33% (14.2083 => 13.4510, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.31% (1.2784 => 1.2105, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: -5.30% (1.1530 => 1.0919, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.29% (0.6293 => 0.5960, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.28% (0.2933 => 0.2778, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: -5.27% (0.3205 => 0.3036, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.26% (0.2548 => 0.2414, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.25% (0.4515 => 0.4278, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: -5.23% (0.2849 => 0.2700, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -5.22% (1.1450 => 1.0852, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: -5.21% (1.3864 => 1.3141, std.dev.: 0.0040) MultiSource/Benchmarks/sim/sim: -5.20% (0.3406 => 0.3229, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: -5.19% (0.3446 => 0.3267, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -5.19% (0.3026 => 0.2869, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.17% (0.3483 => 0.3303, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.17% (0.3252 => 0.3084, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -5.15% (0.2989 => 0.2835, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: -5.14% (0.3481 => 0.3302, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.12% (0.5999 => 0.5692, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: -5.11% (0.2659 => 0.2523, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.09% (0.2278 => 0.2162, std.dev.: 0.0022) SingleSource/Regression/C++/ofstream_ctor: -5.07% (0.3059 => 0.2904, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -5.06% (17.1032 => 16.2380, std.dev.: 0.0132) MultiSource/Applications/Burg/burg: -5.05% (1.2515 => 1.1883, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.03% (0.8521 => 0.8092, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.03% (8.0126 => 7.6095, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.99% (0.2385 => 0.2266, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.98% (0.4916 => 0.4671, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.98% (1.2210 => 1.1602, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: -4.98% (15.5079 => 14.7362, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/lists: -4.97% (0.3621 => 0.3441, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: -4.91% (0.3581 => 0.3405, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: -4.88% (3.5154 => 3.3438, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: -4.87% (0.4248 => 0.4041, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -4.86% (0.3867 => 0.3679, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -4.83% (15.2527 => 14.5159, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.83% (1.2221 => 1.1631, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.78% (0.3849 => 0.3665, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -4.75% (4.0594 => 3.8666, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/hash: -4.73% (0.4524 => 0.4310, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.72% (0.6667 => 0.6352, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.72% (0.3323 => 0.3166, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.70% (0.6660 => 0.6347, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.67% (0.4813 => 0.4588, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -4.65% (34.0927 => 32.5080, std.dev.: 0.0144) MultiSource/Benchmarks/McCat/09-vor/vor: -4.59% (0.3271 => 0.3121, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: -4.55% (0.7447 => 0.7108, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.55% (1.6474 => 1.5725, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.52% (0.7021 => 0.6704, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.47% (0.4427 => 0.4229, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.47% (0.2999 => 0.2865, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.46% (0.4083 => 0.3901, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.45% (0.5329 => 0.5092, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.45% (0.9557 => 0.9132, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: -4.44% (0.3788 => 0.3620, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: -4.42% (5.0226 => 4.8005, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: -4.38% (18.2933 => 17.4924, std.dev.: 0.0205) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.33% (22.4056 => 21.4344, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.33% (0.4321 => 0.4134, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.32% (0.9077 => 0.8685, std.dev.: 0.0031) MultiSource/Applications/treecc/treecc: -4.31% (2.1401 => 2.0478, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: -4.30% (0.7982 => 0.7639, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.25% (0.3319 => 0.3178, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.18% (0.5168 => 0.4952, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -4.17% (2.4021 => 2.3019, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -4.10% (0.6750 => 0.6473, std.dev.: 0.0035) MultiSource/Applications/spiff/spiff: -3.86% (0.8418 => 0.8093, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: -3.79% (0.7779 => 0.7484, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.78% (0.3491 => 0.3359, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: -3.73% (0.6441 => 0.6201, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.71% (1.5610 => 1.5031, std.dev.: 0.0035) SingleSource/UnitTests/ObjC++/Hello: -3.67% (0.6347 => 0.6114, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.56% (2.2587 => 2.1782, std.dev.: 0.0171) SingleSource/UnitTests/Vector/constpool: -3.13% (20.7746 => 20.1246, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.89% (5.4682 => 5.3102, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.29% (1.8100 => 0.6826, std.dev.: 0.0161) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.48% (7.5137 => 5.7497, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Misc/richards_benchmark: -8.70% (1.2842 => 1.1725, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7061, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.69% (2.2633 => 2.1798, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3991, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.04% (1.0557 => 1.0236, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.82% (1.3096 => 1.2727, std.dev.: 0.0128) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4709, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 08:05:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 10:05:19 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121130160519.C56922A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/6421?compare_to=6418&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6421, Order: 169001, Start Time: 2012-11-30 14:31:05, End Time: 2012-11-30 16:05:55 To: 6418, Order: 168996, Start Time: 2012-11-30 12:33:19, End Time: 2012-11-30 14:12:11 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 4 (108 on baseline) Performance Improvements: 29 (42 on baseline) Added Tests: 0 (51 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1020 (824 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.19% (0.9210 => 0.9504, std.dev.: 0.0092) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 12.49% (19.3983 => 21.8219, std.dev.: 0.3824) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.89% (59.6727 => 61.3954, std.dev.: 0.5621) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 2.86% (1.8257 => 1.8779, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: -7.55% (0.1774 => 0.1640, std.dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: -6.58% (0.3525 => 0.3293, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -6.29% (0.2496 => 0.2339, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.25% (1.0550 => 0.9891, std.dev.: 0.0251) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.83% (0.9015 => 0.8489, std.dev.: 0.0185) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.70% (0.2122 => 0.2001, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -5.65% (0.5360 => 0.5057, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.61% (0.3260 => 0.3077, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/sieve: -5.57% (0.2997 => 0.2830, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/09-vor/vor: -5.32% (0.3475 => 0.3290, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.89% (1.4489 => 1.3780, std.dev.: 0.0159) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.43% (0.2552 => 0.2439, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.27% (0.8906 => 0.8526, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -3.87% (1.3575 => 1.3050, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -3.64% (0.6942 => 0.6689, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -3.19% (0.8647 => 0.8371, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.15% (4.7341 => 4.5851, std.dev.: 0.0496) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -2.98% (1.3482 => 1.3080, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.57% (0.9099 => 0.8865, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: -2.51% (4.4045 => 4.2941, std.dev.: 0.0348) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -2.45% (0.8598 => 0.8387, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.77% (0.9818 => 0.9644, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/football/football: -1.73% (0.9377 => 0.9215, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.62% (0.8765 => 0.8623, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.54% (0.8830 => 0.8694, std.dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.38% (6.9058 => 6.8104, std.dev.: 0.0361) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -2.27% (3.6732 => 3.5900, std.dev.: 0.0110) MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.07% (2.6371 => 2.5824, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.14% (4.5034 => 4.4522, std.dev.: 0.0083) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.43% (1.0791 => 1.0945, std.dev.: 0.0098) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.05% (0.3852 => 0.3696, std.dev.: 0.0159) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.49% (0.0202 => 0.0205, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 24.20% (0.0343 => 0.0426, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -5.93% (0.0354 => 0.0333, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -13.42% (0.0313 => 0.0271, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 6.28% (0.0398 => 0.0423, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 25.15% (0.0163 => 0.0204, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -14.68% (0.0218 => 0.0186, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/Burg/burg: -90.00% (0.0010 => 0.0001, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 1.51% (0.1455 => 0.1477, std.dev.: 0.0104) MultiSource/Applications/lemon/lemon: 8.16% (1.1086 => 1.1991, std.dev.: 0.4201) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.40% (0.4225 => 0.4039, std.dev.: 0.1678) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.69% (0.1491 => 0.1436, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.28% (0.0625 => 0.0633, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -31.87% (0.0273 => 0.0186, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.42% (0.0565 => 0.0573, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.99% (1.1551 => 1.1437, std.dev.: 0.0697) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.67% (0.0030 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -19.23% (0.0026 => 0.0021, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.22% (0.0554 => 0.0514, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -23.40% (0.0265 => 0.0203, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.06% (0.8088 => 0.8002, std.dev.: 0.1609) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -34.62% (0.0078 => 0.0051, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.38% (8.6397 => 8.6072, std.dev.: 0.0184) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 9.37% (16.4461 => 17.9873, std.dev.: 0.6580) MultiSource/Applications/sqlite3/sqlite3: 2346.42% (0.6332 => 15.4907, std.dev.: 0.8968) MultiSource/Benchmarks/McCat/08-main/main: 48.12% (0.1831 => 0.2712, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.45% (0.1559 => 0.1474, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7264.17% (0.3123 => 22.9983, std.dev.: 0.0581) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1539.68% (0.3344 => 5.4831, std.dev.: 0.2674) SingleSource/Benchmarks/Misc-C++/Large/ray: 39.97% (0.2364 => 0.3309, std.dev.: 0.1058) SingleSource/Benchmarks/Misc-C++/bigfib: 4.79% (0.6010 => 0.6298, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/mandel: 2.80% (0.0429 => 0.0441, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.87% (0.3266 => 0.3425, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/strcat: 2.08% (0.1969 => 0.2010, std.dev.: 0.0099) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.02% (0.0224 => 0.0233, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -61.30% (0.0230 => 0.0089, std.dev.: 0.0039) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0493, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 7.73% (0.1462 => 0.1575, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4332, std.dev.: 0.0677) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0703, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4939, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5231, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2705, std.dev.: 0.0216) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0769, std.dev.: 0.0455) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3620, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3859, std.dev.: 0.0269) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0797, std.dev.: 0.0170) SingleSource/Regression/C/uint64_to_float: -29.67% (2.1832 => 1.5354, std.dev.: 0.0016) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.28% (0.0810 => 0.0950, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.82% (0.0830 => 0.0953, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 14.66% (0.1112 => 0.1275, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.62% (0.1466 => 0.1607, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: 8.90% (0.3226 => 0.3513, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.82% (0.4127 => 0.4491, std.dev.: 0.0118) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.07% (0.2180 => 0.2356, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/health/health: 7.57% (0.1347 => 0.1449, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.33% (0.8855 => 0.9504, std.dev.: 0.0092) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.67% (0.8321 => 0.8876, std.dev.: 0.0202) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.67% (0.2279 => 0.2431, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.66% (0.1983 => 0.2115, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.39% (0.6287 => 0.6689, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.32% (13.1811 => 14.0146, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 6.28% (0.9074 => 0.9644, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.25% (0.3295 => 0.3501, std.dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.15% (0.1885 => 0.2001, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.14% (1.6386 => 1.7392, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.10% (0.2998 => 0.3181, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 5.36% (0.8885 => 0.9361, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 5.33% (1.1271 => 1.1872, std.dev.: 0.0058) MultiSource/Applications/lua/lua: 5.31% (3.8189 => 4.0215, std.dev.: 0.0293) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.26% (0.8286 => 0.8722, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 5.26% (0.8805 => 0.9268, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 5.19% (0.8697 => 0.9148, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.12% (0.4783 => 0.5028, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.12% (0.8518 => 0.8954, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/football/football: 5.10% (0.8768 => 0.9215, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.09% (0.8716 => 0.9160, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 5.08% (0.9069 => 0.9530, std.dev.: 0.0093) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.03% (1.1606 => 1.2190, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 4.98% (0.8007 => 0.8406, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.93% (14.2605 => 14.9633, std.dev.: 0.2530) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.91% (4.1763 => 4.3814, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 4.87% (0.8927 => 0.9362, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.82% (0.8457 => 0.8865, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.82% (0.8086 => 0.8476, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.76% (0.8050 => 0.8433, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 4.76% (0.9039 => 0.9469, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.68% (0.8420 => 0.8814, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.60% (0.8331 => 0.8714, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.59% (0.8611 => 0.9006, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.59% (0.8656 => 0.9053, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.58% (0.9688 => 1.0132, std.dev.: 0.0036) MultiSource/Applications/minisat/minisat: 4.58% (0.6834 => 0.7147, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.54% (1.1685 => 1.2215, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4.52% (0.8317 => 0.8693, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 4.50% (0.8204 => 0.8573, std.dev.: 0.0120) MultiSource/Benchmarks/PAQ8p/paq8p: 4.49% (2.3764 => 2.4830, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.46% (0.9908 => 1.0350, std.dev.: 0.0154) MultiSource/Benchmarks/Olden/bh/bh: 4.46% (0.2985 => 0.3118, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.44% (0.7966 => 0.8320, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.42% (1.2526 => 1.3080, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 4.38% (0.8261 => 0.8623, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.36% (0.7932 => 0.8278, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.35% (0.9056 => 0.9450, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.33% (0.4847 => 0.5057, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.30% (0.8069 => 0.8416, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 4.27% (0.8177 => 0.8526, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 4.27% (8.6247 => 8.9926, std.dev.: 0.0378) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 4.21% (0.8048 => 0.8387, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 4.11% (0.8597 => 0.8950, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.10% (0.8338 => 0.8680, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 4.01% (0.8359 => 0.8694, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.97% (8.6476 => 8.9911, std.dev.: 0.0489) MultiSource/Benchmarks/MallocBench/gs/gs: 3.96% (4.1305 => 4.2941, std.dev.: 0.0348) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.78% (0.8066 => 0.8371, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.77% (1.3279 => 1.3780, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.61% (0.5961 => 0.6176, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.55% (1.2602 => 1.3050, std.dev.: 0.0114) MultiSource/Benchmarks/Bullet/bullet: 3.27% (31.8598 => 32.9007, std.dev.: 0.0534) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.07% (6.6074 => 6.8104, std.dev.: 0.0361) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.12% (1.2423 => 1.2562, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 198.54% (28.5821 => 85.3277, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/pi: 39.92% (1.5795 => 2.2101, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 27.85% (2.9096 => 3.7199, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.26% (4.8436 => 5.8732, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.72% (8.2783 => 9.7451, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.48% (0.7597 => 0.8849, std.dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.06% (14.6451 => 16.8506, std.dev.: 0.6633) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.66% (2.7995 => 3.1260, std.dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: 10.14% (7.4933 => 8.2532, std.dev.: 0.0222) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.10% (1.1857 => 1.3054, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.59% (6.3772 => 6.9247, std.dev.: 0.2064) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.40% (23.5781 => 25.3223, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 7.15% (2.2485 => 2.4092, std.dev.: 0.0294) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 6.63% (3.9917 => 4.2565, std.dev.: 0.0552) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.34% (3.3761 => 3.5900, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.98% (2.9753 => 3.1533, std.dev.: 0.0237) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.85% (4.8660 => 5.1505, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.69% (4.5327 => 4.7904, std.dev.: 0.0161) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.51% (0.3937 => 0.4154, std.dev.: 0.0016) MultiSource/Applications/aha/aha: 5.37% (3.3398 => 3.5193, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.30% (5.4187 => 5.7061, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.30% (5.3218 => 5.6036, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 5.19% (0.4353 => 0.4579, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.74% (0.5214 => 0.5461, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: 3.61% (1.2061 => 1.2496, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.60% (59.2638 => 61.3954, std.dev.: 0.5621) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.17% (4.8362 => 4.9895, std.dev.: 0.0263) MultiSource/Applications/JM/lencod/lencod: 2.98% (6.7064 => 6.9062, std.dev.: 0.0762) SingleSource/Benchmarks/Dhrystone/dry: 2.81% (0.5081 => 0.5224, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/methcall: 1.70% (8.2676 => 8.4081, std.dev.: 0.0223) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.69% (0.6150 => 0.6254, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.49% (11.5690 => 11.7417, std.dev.: 0.0273) MultiSource/Benchmarks/Olden/bh/bh: 1.49% (2.3560 => 2.3911, std.dev.: 0.0073) MultiSource/Benchmarks/sim/sim: 1.42% (3.8206 => 3.8749, std.dev.: 0.0127) MultiSource/Benchmarks/PAQ8p/paq8p: 1.37% (91.7701 => 93.0316, std.dev.: 0.1781) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.29% (2.8951 => 1.6707, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -25.60% (7.2130 => 5.3666, std.dev.: 0.2890) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.35% (1.4529 => 1.1572, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.78% (9.9065 => 8.2445, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/ary3: -12.87% (1.9999 => 1.7426, std.dev.: 0.0344) MultiSource/Benchmarks/Olden/em3d/em3d: -12.55% (5.4641 => 4.7781, std.dev.: 0.1398) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -10.25% (0.3269 => 0.2934, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: -9.05% (63.1822 => 57.4631, std.dev.: 0.0202) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.08% (1.0512 => 0.9663, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.32% (3.2169 => 2.9815, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.23% (4.7482 => 4.4522, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout/sieve: -6.22% (7.0599 => 6.6205, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.14% (5.1305 => 4.8156, std.dev.: 0.0142) SingleSource/Benchmarks/Stanford/FloatMM: -5.76% (0.8807 => 0.8300, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -5.57% (9.3748 => 8.8523, std.dev.: 0.1265) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.40% (6.2275 => 5.8910, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.89% (5.6343 => 5.3586, std.dev.: 0.0387) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.53% (4.7449 => 4.5300, std.dev.: 0.0252) MultiSource/Applications/siod/siod: -4.44% (3.6643 => 3.5016, std.dev.: 0.0372) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.40% (4.9453 => 4.7275, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.37% (6.1706 => 5.9009, std.dev.: 0.0143) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.99% (2.8773 => 2.7626, std.dev.: 0.0319) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.84% (3.7148 => 3.5723, std.dev.: 0.0146) SingleSource/Benchmarks/Misc/perlin: -3.71% (5.1084 => 4.9191, std.dev.: 0.0452) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.64% (5.1557 => 4.9681, std.dev.: 0.0045) MultiSource/Applications/lua/lua: -3.55% (29.8330 => 28.7730, std.dev.: 0.1399) SingleSource/Benchmarks/Shootout-C++/methcall: -3.51% (8.9760 => 8.6606, std.dev.: 0.0372) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -2.97% (5.4300 => 5.2686, std.dev.: 0.0192) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.86% (2.6356 => 2.5603, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.84% (4.9686 => 4.8277, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.83% (1.3882 => 1.3489, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout/hash: -2.56% (4.3087 => 4.1983, std.dev.: 0.0352) SingleSource/Benchmarks/Misc/fbench: -2.56% (3.3840 => 3.2973, std.dev.: 0.0146) MultiSource/Benchmarks/FreeBench/neural/neural: -2.09% (1.0841 => 1.0614, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -1.77% (0.6910 => 0.6788, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -1.76% (0.5807 => 0.5705, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (15.8853 => 15.6233, std.dev.: 0.0269) MultiSource/Benchmarks/Olden/bisort/bisort: -1.54% (0.6636 => 0.6534, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/tsp/tsp: -1.39% (1.4861 => 1.4655, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.35% (1.5866 => 1.5652, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.17% (4.2466 => 4.1969, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.17% (4.7794 => 4.7236, std.dev.: 0.0203) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 6.66% (1.0262 => 1.0945, std.dev.: 0.0098) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.06% (0.2463 => 0.3696, std.dev.: 0.0159) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 66.67% (0.0123 => 0.0205, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -10.26% (0.0302 => 0.0271, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 3.33% (0.0180 => 0.0186, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 2.71% (0.1438 => 0.1477, std.dev.: 0.0104) MultiSource/Applications/lemon/lemon: 5.84% (1.1329 => 1.1991, std.dev.: 0.4201) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.00% (0.4164 => 0.4039, std.dev.: 0.1678) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.89% (0.1369 => 0.1436, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.25% (0.0641 => 0.0633, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.62% (0.0195 => 0.0186, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.87% (0.0578 => 0.0573, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: - (1.1437 => 1.1437, std.dev.: 0.0697) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0014 => 0.0021, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -18.02% (0.0627 => 0.0514, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 12.78% (0.0180 => 0.0203, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.19% (0.8017 => 0.8002, std.dev.: 0.1609) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -17.74% (0.0062 => 0.0051, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 08:38:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 10:38:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121130163820.3C5642A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/6422?compare_to=6420&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6422, Order: 169002, Start Time: 2012-11-30 15:02:59, End Time: 2012-11-30 16:38:54 To: 6420, Order: 168997, Start Time: 2012-11-30 13:04:25, End Time: 2012-11-30 14:39:41 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (181 on baseline) Added Tests: 0 (52 on baseline) Unchanged Tests: 1093 (855 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 2.67% (0.6826 => 0.7008, std.dev.: 0.0046) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.49% (0.3834 => 0.4428, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 74.93% (31.3723 => 54.8795, std.dev.: 0.0207) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.32% (1.2783 => 1.3719, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.66% (2.0478 => 2.1022, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 2.47% (7.4937 => 7.6785, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hash2: 2.07% (3.1932 => 3.2592, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.25% (0.1431 => 0.1313, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.56% (0.3821 => 0.3532, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.08% (0.9542 => 0.8866, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -6.60% (2.4924 => 2.3279, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.56% (0.3812 => 0.3562, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -6.55% (0.3831 => 0.3580, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -6.55% (0.3848 => 0.3596, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: -6.52% (0.3880 => 0.3627, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: -6.49% (0.3896 => 0.3643, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.49% (0.3142 => 0.2938, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -6.42% (0.4033 => 0.3774, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.37% (0.3891 => 0.3643, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -6.23% (0.3357 => 0.3148, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.14% (0.2428 => 0.2279, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -6.13% (0.4176 => 0.3920, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.10% (0.7198 => 0.6759, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.05% (0.3884 => 0.3649, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: -5.88% (0.2160 => 0.2033, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.79% (0.4199 => 0.3956, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -5.77% (9.2283 => 8.6960, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.75% (0.5805 => 0.5471, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.74% (0.6484 => 0.6112, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.72% (0.3057 => 0.2882, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -5.71% (16.1920 => 15.2681, std.dev.: 0.0204) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.70% (0.5857 => 0.5523, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.66% (0.5478 => 0.5168, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.65% (0.5802 => 0.5474, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.65% (0.5859 => 0.5528, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.63% (0.5591 => 0.5276, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.63% (0.5705 => 0.5384, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.59% (0.5567 => 0.5256, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.58% (0.5863 => 0.5536, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.56% (0.6260 => 0.5912, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.55% (0.3658 => 0.3455, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.54% (0.6052 => 0.5717, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.53% (0.6676 => 0.6307, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.53% (0.6189 => 0.5847, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.52% (0.6395 => 0.6042, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.52% (0.5456 => 0.5155, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -5.51% (0.4280 => 0.4044, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.50% (0.9852 => 0.9310, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.49% (0.6230 => 0.5888, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.48% (4.0323 => 3.8113, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.47% (1.3722 => 1.2971, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.47% (0.5849 => 0.5529, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.47% (0.5575 => 0.5270, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -5.46% (0.9179 => 0.8678, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.46% (0.6194 => 0.5856, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -5.45% (0.3025 => 0.2860, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.45% (0.5581 => 0.5277, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.44% (0.6395 => 0.6047, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.44% (0.6304 => 0.5961, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -5.44% (7.0961 => 6.7101, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.42% (4.8161 => 4.5550, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.41% (0.7524 => 0.7117, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.39% (0.5570 => 0.5270, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.38% (0.6446 => 0.6099, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.38% (1.0544 => 0.9977, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.37% (0.6440 => 0.6094, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.37% (0.3016 => 0.2854, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.37% (0.5941 => 0.5622, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.37% (6.7716 => 6.4083, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.35% (0.6297 => 0.5960, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.35% (0.5925 => 0.5608, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.33% (1.2300 => 1.1644, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/fibo: -5.33% (0.2871 => 0.2718, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.33% (1.6364 => 1.5492, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.33% (0.7339 => 0.6948, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.32% (4.8802 => 4.6204, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.31% (0.6681 => 0.6326, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.29% (0.5688 => 0.5387, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.29% (0.3931 => 0.3723, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -5.29% (0.3194 => 0.3025, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -5.28% (0.3255 => 0.3083, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: -5.27% (0.2939 => 0.2784, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.27% (3.5339 => 3.3476, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.27% (0.2695 => 0.2553, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.27% (2.1713 => 2.0569, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.27% (0.3323 => 0.3148, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.26% (0.3837 => 0.3635, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: -5.26% (1.1530 => 1.0923, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.25% (0.2933 => 0.2779, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.23% (0.5569 => 0.5278, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.22% (4.5069 => 4.2717, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.22% (14.2083 => 13.4669, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/wc: -5.21% (0.3205 => 0.3038, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.20% (0.2903 => 0.2752, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.20% (0.6293 => 0.5966, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.17% (0.3252 => 0.3084, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: -5.17% (0.3446 => 0.3268, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.16% (1.2784 => 1.2124, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.14% (0.6033 => 0.5723, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.13% (1.3148 => 1.2473, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.13% (0.4151 => 0.3938, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.13% (1.4642 => 1.3891, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.12% (0.8521 => 0.8085, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: -5.10% (0.3394 => 0.3221, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -5.09% (0.2849 => 0.2704, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -5.09% (0.2989 => 0.2837, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.08% (0.3406 => 0.3233, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: -5.08% (1.3864 => 1.3160, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -5.06% (0.3026 => 0.2873, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -5.02% (17.1032 => 16.2454, std.dev.: 0.0132) MultiSource/Benchmarks/McCat/05-eks/eks: -5.01% (0.4515 => 0.4289, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.00% (0.6736 => 0.6399, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: -5.00% (0.3059 => 0.2906, std.dev.: 0.0036) MultiSource/Applications/lemon/lemon: -5.00% (1.1450 => 1.0878, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.98% (0.7919 => 0.7525, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary2: -4.94% (0.3481 => 0.3309, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.93% (0.4321 => 0.4108, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.93% (1.2221 => 1.1619, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -4.90% (4.3330 => 4.1205, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists: -4.89% (0.3621 => 0.3444, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.89% (8.0126 => 7.6210, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.88% (1.2210 => 1.1614, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.85% (0.3483 => 0.3314, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -4.83% (0.4861 => 0.4626, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.82% (0.4916 => 0.4679, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.80% (0.2355 => 0.2242, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.78% (0.2278 => 0.2169, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: -4.78% (0.4248 => 0.4045, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.77% (0.5999 => 0.5713, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.76% (0.4813 => 0.4584, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.74% (0.2385 => 0.2272, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -4.72% (0.2985 => 0.2844, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: -4.70% (3.5154 => 3.3501, std.dev.: 0.0047) MultiSource/Applications/SPASS/SPASS: -4.68% (15.5079 => 14.7824, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.68% (0.3849 => 0.3669, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -4.68% (15.2527 => 14.5396, std.dev.: 0.0097) MultiSource/Applications/Burg/burg: -4.66% (1.2515 => 1.1932, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.63% (0.2548 => 0.2430, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.60% (0.6667 => 0.6360, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.57% (0.2999 => 0.2862, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: -4.55% (0.3581 => 0.3418, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: -4.55% (0.2659 => 0.2538, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.50% (0.6660 => 0.6360, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -4.47% (4.0594 => 3.8781, std.dev.: 0.0056) MultiSource/Applications/minisat/minisat: -4.42% (0.7447 => 0.7118, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -4.39% (34.0927 => 32.5957, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.36% (0.4083 => 0.3905, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.34% (0.4427 => 0.4235, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.30% (0.7021 => 0.6719, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -4.25% (0.3788 => 0.3627, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.25% (0.9557 => 0.9151, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.24% (0.5168 => 0.4949, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -4.22% (0.3867 => 0.3704, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.18% (0.5329 => 0.5106, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -4.17% (2.1401 => 2.0508, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash: -4.16% (0.4524 => 0.4336, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.15% (22.4056 => 21.4767, std.dev.: 0.0196) MultiSource/Applications/oggenc/oggenc: -4.13% (5.0226 => 4.8153, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.12% (1.6474 => 1.5796, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: -4.10% (0.3271 => 0.3137, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -4.07% (0.7982 => 0.7657, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: -3.99% (0.6750 => 0.6481, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.95% (0.3319 => 0.3188, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: -3.86% (18.2933 => 17.5866, std.dev.: 0.0076) MultiSource/Applications/siod/siod: -3.79% (2.4021 => 2.3111, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.72% (0.9077 => 0.8739, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: -3.60% (0.6441 => 0.6209, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -3.58% (0.8418 => 0.8117, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: -3.47% (0.7779 => 0.7509, std.dev.: 0.0038) MultiSource/Applications/hbd/hbd: -3.47% (1.5610 => 1.5069, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.36% (2.2587 => 2.1828, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.31% (0.6347 => 0.6137, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -3.30% (20.7746 => 20.0894, std.dev.: 0.0375) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.48% (5.4682 => 5.3325, std.dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.28% (1.8100 => 0.7008, std.dev.: 0.0046) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7537, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -8.63% (1.2842 => 1.1734, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.91% (1.7753 => 1.7058, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: -3.86% (2.2633 => 2.1759, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3996, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.05% (1.0557 => 1.0235, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4697, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 09:18:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 11:18:23 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121130171823.3B8B32A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/6423?compare_to=6417&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6423, Order: 169000, Start Time: 2012-11-30 14:55:31, End Time: 2012-11-30 17:18:57 To: 6417, Order: 168991, Start Time: 2012-11-30 11:28:00, End Time: 2012-11-30 13:54:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 43 (188 on baseline) Performance Improvements: 5 (43 on baseline) Added Tests: 0 (186 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1040 (654 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 14.54% (0.7237 => 0.8289, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 14.36% (0.8114 => 0.9279, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 13.80% (0.6208 => 0.7065, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 13.77% (0.6915 => 0.7867, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 13.17% (0.6259 => 0.7083, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.51% (0.5866 => 0.6600, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.27% (0.1907 => 0.2122, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.78% (0.6169 => 0.6834, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.77% (0.6130 => 0.6790, std.dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: 10.08% (1.3939 => 1.5344, std.dev.: 0.0152) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.03% (0.1924 => 0.2117, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.84% (1.5882 => 1.7444, std.dev.: 0.0374) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.14% (0.6377 => 0.6960, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.60% (0.3722 => 0.4005, std.dev.: 0.0095) SingleSource/Benchmarks/McGill/chomp: 7.57% (0.1888 => 0.2031, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.03% (0.2746 => 0.2939, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.76% (1.5692 => 1.6753, std.dev.: 0.0325) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.62% (0.3914 => 0.4173, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.51% (0.4518 => 0.4812, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/em3d/em3d: 6.43% (0.1975 => 0.2102, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.21% (0.2673 => 0.2839, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.12% (0.9105 => 0.9662, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/methcall: 5.46% (0.3148 => 0.3320, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.08% (0.3012 => 0.3165, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.96% (4.8732 => 5.0664, std.dev.: 0.0258) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.94% (0.5074 => 0.5274, std.dev.: 0.0074) MultiSource/Applications/d/make_dparser: 3.18% (4.1224 => 4.2534, std.dev.: 0.0211) MultiSource/Applications/JM/lencod/lencod: 1.50% (32.6121 => 33.1005, std.dev.: 0.1118) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/SPASS/SPASS: 20.62% (13.5574 => 16.3526, std.dev.: 0.7842) MultiSource/Benchmarks/McCat/17-bintr/bintr: 17.44% (0.1892 => 0.2222, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 12.59% (2.7752 => 3.1247, std.dev.: 0.0576) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.29% (1.7378 => 1.9340, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.49% (5.6744 => 6.0995, std.dev.: 0.1292) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.34% (58.1652 => 61.8501, std.dev.: 0.1787) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5.40% (6.0329 => 6.3585, std.dev.: 0.0907) MultiSource/Applications/siod/siod: 4.92% (3.1734 => 3.3294, std.dev.: 0.0242) MultiSource/Benchmarks/NPB-serial/is/is: 3.95% (8.5587 => 8.8970, std.dev.: 0.0612) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.88% (84.5153 => 87.7949, std.dev.: 1.0038) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.80% (0.4538 => 0.4665, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 1.72% (3.8539 => 3.9203, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.41% (4.9606 => 5.0303, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.24% (7.2847 => 7.3753, std.dev.: 0.0209) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.3224 => 2.3475, std.dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/gs/gs: -6.59% (5.1003 => 4.7644, std.dev.: 0.0928) MultiSource/Applications/lua/lua: -1.78% (4.5375 => 4.4567, std.dev.: 0.0243) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/ObjC/synchronized: -60.07% (0.3772 => 0.1506, std.dev.: 0.0710) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.44% (4.1608 => 4.1007, std.dev.: 0.0209) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (4.0395 => 3.9833, std.dev.: 0.0159) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -1.51% (69.5199 => 68.4688, std.dev.: 0.4510) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1339 => 0.1339, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.79% (0.0445 => 0.0493, std.dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.69% (0.0651 => 0.0675, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 0.06% (493.5374 => 493.8529, std.dev.: 0.1041) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 8.26% (63.2438 => 68.4688, std.dev.: 0.4510) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -98.88% (4.3882 => 0.0493, std.dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43692.93% (1.1277 => 493.8529, std.dev.: 0.1041) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.95% (0.5229 => 1.5423, std.dev.: 0.1051) MultiSource/Applications/SPASS/SPASS: 17.46% (14.9895 => 17.6074, std.dev.: 0.2148) MultiSource/Applications/kimwitu++/kc: 45.43% (14.1553 => 20.5858, std.dev.: 0.2469) MultiSource/Benchmarks/MallocBench/gs/gs: 15.91% (4.1105 => 4.7644, std.dev.: 0.0928) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.17% (1.1048 => 1.5155, std.dev.: 0.0804) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 442.36% (7.1582 => 38.8231, std.dev.: 0.4207) SingleSource/Benchmarks/Misc-C++-EH/spirit: 76.42% (3.4629 => 6.1091, std.dev.: 0.4506) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.04% (0.6222 => 1.0331, std.dev.: 0.0355) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10435.83% (0.0720 => 7.5858, std.dev.: 0.0995) MultiSource/Applications/SIBsim4/SIBsim4: 3920200.00% (0.0001 => 3.9203, std.dev.: 0.0115) MultiSource/Applications/SPASS/SPASS: 16352500.00% (0.0001 => 16.3526, std.dev.: 0.7842) MultiSource/Applications/kimwitu++/kc: 54000.00% (0.0001 => 0.0541, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 64300.00% (0.0001 => 0.0644, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 595400.00% (0.0001 => 0.5955, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9995300.00% (0.0001 => 9.9954, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6099400.00% (0.0001 => 6.0995, std.dev.: 0.1292) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1803.77% (1.1194 => 21.3108, std.dev.: 0.4844) MultiSource/Applications/ClamAV/clamscan: 70.82% (22.1758 => 37.8796, std.dev.: 0.1104) MultiSource/Benchmarks/FreeBench/distray/distray: 58.52% (0.1056 => 0.1674, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.23% (2.9384 => 4.6200, std.dev.: 0.0981) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.40% (7.0540 => 10.8206, std.dev.: 0.2253) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 51.12% (8.1363 => 12.2953, std.dev.: 0.2185) MultiSource/Applications/JM/lencod/lencod: 50.89% (21.9371 => 33.1005, std.dev.: 0.1118) SingleSource/Benchmarks/Misc/flops: 43.44% (0.1432 => 0.2054, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/almabench: 42.19% (0.0730 => 0.1038, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: 36.81% (0.2554 => 0.3494, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 35.50% (0.1566 => 0.2122, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 33.65% (0.1584 => 0.2117, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/17-bintr/bintr: 32.59% (0.0675 => 0.0895, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 31.27% (0.0793 => 0.1041, std.dev.: 0.0016) SingleSource/UnitTests/vla: 30.14% (0.0355 => 0.0462, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 29.29% (0.5105 => 0.6600, std.dev.: 0.0020) SingleSource/Benchmarks/Stanford/Oscar: 28.93% (0.0636 => 0.0820, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 28.86% (0.0842 => 0.1085, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 27.91% (0.1175 => 0.1503, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 27.52% (3.3354 => 4.2534, std.dev.: 0.0211) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 27.23% (0.0437 => 0.0556, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.14% (0.0479 => 0.0609, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/five11/five11: 26.63% (0.0567 => 0.0718, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.36% (0.0770 => 0.0973, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.89% (0.1062 => 0.1337, std.dev.: 0.0034) MultiSource/Applications/spiff/spiff: 25.85% (0.7835 => 0.9860, std.dev.: 0.0312) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.73% (0.0886 => 0.1114, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.52% (0.2065 => 0.2592, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 25.47% (0.3180 => 0.3990, std.dev.: 0.0147) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 25.01% (0.2271 => 0.2839, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 24.98% (0.5569 => 0.6960, std.dev.: 0.0105) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 24.77% (0.2107 => 0.2629, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 24.60% (0.0443 => 0.0552, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 24.48% (0.3423 => 0.4261, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.18% (0.1125 => 0.1397, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 24.17% (0.7115 => 0.8835, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 24.15% (1.3050 => 1.6201, std.dev.: 0.0204) MultiSource/Benchmarks/Olden/em3d/em3d: 24.01% (0.1695 => 0.2102, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.86% (0.0746 => 0.0924, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 23.83% (0.0491 => 0.0608, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bisort/bisort: 23.78% (0.0614 => 0.0760, std.dev.: 0.0049) SingleSource/Benchmarks/Stanford/Towers: 23.35% (0.0471 => 0.0581, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/hash: 23.09% (0.0485 => 0.0597, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.83% (0.1117 => 0.1372, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 22.72% (0.1655 => 0.2031, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/messages-2: 22.66% (0.0662 => 0.0812, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/health/health: 22.63% (0.1268 => 0.1555, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: 22.62% (0.0871 => 0.1068, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 22.48% (0.0814 => 0.0997, std.dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 22.04% (0.0953 => 0.1163, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 21.97% (0.2603 => 0.3175, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/05-eks/eks: 21.77% (0.4299 => 0.5235, std.dev.: 0.0142) MultiSource/Applications/treecc/treecc: 21.77% (2.0273 => 2.4686, std.dev.: 0.0741) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.68% (14.3668 => 17.4817, std.dev.: 0.4544) MultiSource/Benchmarks/FreeBench/neural/neural: 21.60% (0.1463 => 0.1779, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/wordfreq: 21.53% (0.3307 => 0.4019, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.27% (0.3441 => 0.4173, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 20.95% (0.2430 => 0.2939, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.65% (0.0770 => 0.0929, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 20.10% (1.5415 => 1.8513, std.dev.: 0.0548) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 19.96% (0.6675 => 0.8007, std.dev.: 0.0267) MultiSource/Applications/sqlite3/sqlite3: 19.85% (17.1811 => 20.5918, std.dev.: 0.3627) MultiSource/Applications/oggenc/oggenc: 19.63% (5.7591 => 6.8898, std.dev.: 0.2236) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.54% (0.0834 => 0.0997, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 19.48% (1.2842 => 1.5344, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.37% (0.1337 => 0.1596, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 19.27% (0.8101 => 0.9662, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.04% (0.2700 => 0.3214, std.dev.: 0.0096) SingleSource/Benchmarks/McGill/misr: 18.80% (0.0633 => 0.0752, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/lpbench: 18.62% (0.0929 => 0.1102, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 18.53% (0.3865 => 0.4581, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/Large/ray: 18.41% (0.4064 => 0.4812, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: 18.37% (0.3092 => 0.3660, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/football/football: 18.35% (0.8921 => 1.0558, std.dev.: 0.0447) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.10% (1.4186 => 1.6753, std.dev.: 0.0325) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 17.90% (0.0838 => 0.0988, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/fbench: 17.74% (0.0592 => 0.0697, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.44% (5.0018 => 5.8740, std.dev.: 0.1379) SingleSource/UnitTests/SignlessTypes/rem: 17.40% (0.1144 => 0.1343, std.dev.: 0.0042) SingleSource/UnitTests/Vector/SSE/sse_isamax: 17.33% (0.0704 => 0.0826, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.32% (4.9449 => 5.8016, std.dev.: 0.1362) SingleSource/Benchmarks/Misc/whetstone: 17.27% (0.0660 => 0.0774, std.dev.: 0.0043) SingleSource/Benchmarks/Stanford/Puzzle: 17.11% (0.1268 => 0.1485, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/lists: 17.09% (0.0626 => 0.0733, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sieve: 17.04% (0.3603 => 0.4217, std.dev.: 0.0106) SingleSource/UnitTests/ObjC/parameter-passing: 16.98% (0.3927 => 0.4594, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.87% (0.3427 => 0.4005, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/spellcheck: 16.80% (0.4203 => 0.4909, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout/matrix: 16.75% (0.0818 => 0.0955, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.74% (0.4636 => 0.5412, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 16.67% (0.0672 => 0.0784, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists: 16.66% (0.3422 => 0.3992, std.dev.: 0.0173) MultiSource/Benchmarks/Olden/mst/mst: 16.60% (0.1163 => 0.1356, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.52% (0.1029 => 0.1199, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.47% (0.8172 => 0.9518, std.dev.: 0.0342) SingleSource/UnitTests/ObjC/property: 16.42% (0.3886 => 0.4524, std.dev.: 0.0118) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.40% (4.2646 => 4.9639, std.dev.: 0.2221) SingleSource/Benchmarks/Shootout-C++/lists1: 16.34% (0.3684 => 0.4286, std.dev.: 0.0127) SingleSource/UnitTests/ObjC/synchronized: 16.32% (0.3561 => 0.4142, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.29% (0.0798 => 0.0928, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 16.28% (0.2831 => 0.3292, std.dev.: 0.0088) SingleSource/UnitTests/ObjC/exceptions-3: 16.18% (0.3516 => 0.4085, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ary3: 16.14% (0.3283 => 0.3813, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 15.91% (0.3828 => 0.4437, std.dev.: 0.0110) MultiSource/Benchmarks/mafft/pairlocalalign: 15.79% (9.4845 => 10.9821, std.dev.: 0.4365) SingleSource/Benchmarks/Shootout-C++/matrix: 15.66% (0.3098 => 0.3583, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.63% (0.2891 => 0.3343, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ary: 15.50% (0.3232 => 0.3733, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 15.40% (0.2877 => 0.3320, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.36% (0.1940 => 0.2238, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.32% (0.2872 => 0.3312, std.dev.: 0.0133) MultiSource/Applications/viterbi/viterbi: 15.31% (0.1555 => 0.1793, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/exceptions-4: 15.24% (0.3543 => 0.4083, std.dev.: 0.0094) SingleSource/UnitTests/ObjC/trivial-interface: 15.23% (0.3473 => 0.4002, std.dev.: 0.0111) MultiSource/Applications/lua/lua: 15.09% (3.8723 => 4.4567, std.dev.: 0.0243) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.09% (0.3121 => 0.3592, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/wc: 15.07% (0.3052 => 0.3512, std.dev.: 0.0105) MultiSource/Applications/hbd/hbd: 15.06% (1.5603 => 1.7953, std.dev.: 0.0644) SingleSource/UnitTests/ObjC/for-in: 15.05% (0.3694 => 0.4250, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/ary2: 15.03% (0.3379 => 0.3887, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.90% (0.3543 => 0.4071, std.dev.: 0.0102) SingleSource/UnitTests/ObjC/exceptions-2: 14.90% (0.3497 => 0.4018, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/ackermann: 14.84% (0.2756 => 0.3165, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hello: 14.81% (0.2714 => 0.3116, std.dev.: 0.0132) SingleSource/Regression/C++/ofstream_ctor: 14.77% (0.2905 => 0.3334, std.dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.34% (0.1032 => 0.1180, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.33% (0.5981 => 0.6838, std.dev.: 0.0219) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.25% (0.9765 => 1.1157, std.dev.: 0.0253) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.25% (2.2022 => 2.5161, std.dev.: 0.0415) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.24% (0.1236 => 0.1412, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.98% (0.5860 => 0.6679, std.dev.: 0.0204) SingleSource/UnitTests/ObjC++/property-reference: 13.96% (0.7326 => 0.8349, std.dev.: 0.0268) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.91% (0.1510 => 0.1720, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 13.83% (0.3109 => 0.3539, std.dev.: 0.0156) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.57% (0.3935 => 0.4469, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 13.55% (0.5925 => 0.6728, std.dev.: 0.0309) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.35% (0.4615 => 0.5231, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/ReedSolomon: 13.32% (0.2049 => 0.2322, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/bigfib: 13.09% (0.6456 => 0.7301, std.dev.: 0.0239) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.71% (0.5020 => 0.5658, std.dev.: 0.0191) MultiSource/Applications/lemon/lemon: 12.66% (1.0722 => 1.2079, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.86% (0.1906 => 0.2132, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash: 11.82% (0.4289 => 0.4796, std.dev.: 0.0144) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.55% (0.1143 => 0.1275, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.38% (0.6450 => 0.7184, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 11.34% (0.4620 => 0.5144, std.dev.: 0.0161) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.31% (0.1892 => 0.2106, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.12% (1.1861 => 1.3180, std.dev.: 0.0380) SingleSource/Benchmarks/Shootout-C++/moments: 10.35% (0.4048 => 0.4467, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/oourafft: 9.78% (0.3282 => 0.3603, std.dev.: 0.0085) MultiSource/Benchmarks/PAQ8p/paq8p: 9.41% (10.3673 => 11.3431, std.dev.: 0.2529) SingleSource/Benchmarks/Shootout-C++/fibo: 8.40% (0.2725 => 0.2954, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.10% (0.4879 => 0.5274, std.dev.: 0.0074) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.39% (0.3817 => 0.4099, std.dev.: 0.0090) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 149.36% (4.3953 => 10.9600, std.dev.: 0.0426) SingleSource/Benchmarks/Shootout-C++/methcall: 147.17% (5.3999 => 13.3470, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/17-bintr/bintr: 113.04% (0.1043 => 0.2222, std.dev.: 0.0094) MultiSource/Benchmarks/SciMark2-C/scimark2: 79.91% (32.5116 => 58.4926, std.dev.: 0.0502) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 43.27% (0.3256 => 0.4665, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: 38.30% (0.1154 => 0.1596, std.dev.: 0.0133) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.64% (1.1145 => 1.2999, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: 16.13% (6.6465 => 7.7183, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.32% (0.2944 => 0.3336, std.dev.: 0.0122) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.62% (2.8904 => 3.2262, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary3: 11.54% (3.7221 => 4.1518, std.dev.: 0.0253) SingleSource/Benchmarks/Misc/richards_benchmark: 10.09% (1.1396 => 1.2546, std.dev.: 0.0032) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.42% (1.7254 => 1.8879, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 8.76% (3.1578 => 3.4343, std.dev.: 0.0420) MultiSource/Applications/lua/lua: 6.14% (26.0924 => 27.6947, std.dev.: 0.2635) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.95% (0.9540 => 1.0108, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.94% (4.2280 => 4.4790, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 5.52% (1.8329 => 1.9340, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/hash: 5.11% (4.9088 => 5.1598, std.dev.: 0.0157) SingleSource/Regression/C/uint64_to_float: 5.08% (0.5413 => 0.5688, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 4.84% (1.9405 => 2.0344, std.dev.: 0.0273) SingleSource/Benchmarks/Misc/ffbench: 4.52% (0.9505 => 0.9935, std.dev.: 0.0155) MultiSource/Benchmarks/nbench/nbench: 4.00% (11.6436 => 12.1094, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/heapsort: 3.39% (3.8526 => 3.9833, std.dev.: 0.0159) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.34% (0.4162 => 0.4301, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.14% (1.3677 => 1.3970) MultiSource/Applications/aha/aha: 2.06% (3.1595 => 3.2247, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 1.95% (85.0658 => 86.7222, std.dev.: 0.0806) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.47% (2.3135 => 2.3475, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/ackermann: 1.44% (1.7133 => 1.7379, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.30% (1.0313 => 1.0447, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.26% (6.5088 => 6.5907, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0501, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1682, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.80% (5.2763 => 1.2771, std.dev.: 0.0236) SingleSource/Benchmarks/Misc/salsa20: -74.89% (0.8651 => 0.2172, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/richards_benchmark: -40.20% (0.1622 => 0.0970, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.05% (5.3526 => 4.7076, std.dev.: 0.1426) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -11.43% (0.1330 => 0.1178, std.dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: -11.41% (10.4361 => 9.2455, std.dev.: 0.2892) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.93% (5.3855 => 5.0664, std.dev.: 0.0258) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.49% (1.9577 => 0.6560, std.dev.: 0.0154) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1681, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.36% (0.3987 => 0.2378, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.26% (4.5009 => 2.7789, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.17% (2.6546 => 2.0131, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/mason/mason: -19.25% (0.2161 => 0.1745, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.72% (1.6925 => 1.4265, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.71% (2.6778 => 2.2840, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -10.69% (1.5373 => 1.3729, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4244, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/distray/distray: -7.66% (0.1592 => 0.1470) MultiSource/Benchmarks/NPB-serial/is/is: -6.97% (9.5636 => 8.8970, std.dev.: 0.0612) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.95% (4.8142 => 4.4794, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.56% (3.2416 => 3.0291, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.60% (2.7294 => 2.5765, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -5.23% (19.9488 => 18.9056, std.dev.: 0.4014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.14% (0.8614 => 0.8171, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: -4.97% (1.5835 => 1.5048, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: -3.98% (6.2999 => 6.0494, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.51% (1.6805 => 1.6215, std.dev.: 0.0060) MultiSource/Benchmarks/sim/sim: -2.98% (5.0483 => 4.8979, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.81% (0.4808 => 0.4673, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.67% (0.9957 => 0.9691, std.dev.: 0.0032) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.91% (8.1563 => 8.0002, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6770, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -1.52% (10.2830 => 10.1269, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.10% (0.2116 => 0.0675, std.dev.: 0.0012) Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 09:58:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 11:58:12 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121130175812.0C1072A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/6424?compare_to=6421&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6424, Order: 169002, Start Time: 2012-11-30 16:22:56, End Time: 2012-11-30 17:58:48 To: 6421, Order: 169001, Start Time: 2012-11-30 14:31:05, End Time: 2012-11-30 16:05:55 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 3 (76 on baseline) Performance Improvements: 2 (42 on baseline) Added Tests: 0 (51 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1048 (856 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.17% (0.3077 => 0.3236, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.47% (0.2772 => 0.2896, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 1.21% (0.8849 => 0.8956, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.62% (0.9504 => 0.9255, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: -6.31% (4.3834 => 4.1070, std.dev.: 0.0665) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.03% (1.0945 => 1.0832, std.dev.: 0.3205) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.27% (0.3696 => 0.3706, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -17.07% (0.0205 => 0.0170, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -13.38% (0.0426 => 0.0369, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.01% (0.0333 => 0.0293, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -14.39% (0.0271 => 0.0232, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -18.68% (0.0423 => 0.0344, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/casts: -10.78% (0.0204 => 0.0182, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/test1: -5.91% (0.0186 => 0.0175, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -1.08% (0.1477 => 0.1461, std.dev.: 0.0265) MultiSource/Applications/lemon/lemon: 1.25% (1.1991 => 1.2141, std.dev.: 0.3520) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.07% (0.4039 => 0.4036, std.dev.: 0.0772) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.69% (0.1436 => 0.1532, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.37% (0.0633 => 0.0599, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 15.59% (0.0186 => 0.0215, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.09% (0.0573 => 0.0561, std.dev.: 0.0143) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.02% (1.1437 => 1.1435, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -95.24% (0.0021 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 15.37% (0.0514 => 0.0593, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.42% (0.0203 => 0.0192, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.04% (0.8002 => 0.8005, std.dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 5.88% (0.0051 => 0.0054, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.19% (8.6072 => 8.6237, std.dev.: 0.0625) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.46% (16.4461 => 17.8370, std.dev.: 1.1567) MultiSource/Applications/sqlite3/sqlite3: 2356.33% (0.6332 => 15.5535, std.dev.: 0.9930) MultiSource/Benchmarks/McCat/08-main/main: 51.94% (0.1831 => 0.2782, std.dev.: 0.0830) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.62% (0.1559 => 0.1487, std.dev.: 0.0443) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7127.60% (0.3123 => 22.5718, std.dev.: 0.8505) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1531.52% (0.3344 => 5.4558, std.dev.: 0.1062) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.49% (0.2364 => 0.3274, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 4.81% (0.6010 => 0.6299, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel: 4.20% (0.0429 => 0.0447, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.59% (0.3266 => 0.3416, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: 3.76% (0.1969 => 0.2043, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.48% (0.0224 => 0.0243, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: -27.83% (0.0230 => 0.0166, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0468, std.dev.: 0.0071) MultiSource/Applications/oggenc/oggenc: 7.18% (0.1462 => 0.1567, std.dev.: 0.0287) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4194, std.dev.: 0.0842) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0729, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4946, std.dev.: 0.0253) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5216, std.dev.: 0.0197) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2869, std.dev.: 0.0318) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0628, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3624, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3850, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0853, std.dev.: 0.0020) SingleSource/Regression/C/uint64_to_float: -30.09% (2.1832 => 1.5263, std.dev.: 0.0039) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.75% (0.0848 => 0.0990, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.94% (0.0830 => 0.0954, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/tsp/tsp: 14.93% (0.1112 => 0.1278, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.92% (0.2180 => 0.2418, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.89% (0.3295 => 0.3621, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.67% (0.6010 => 0.6591, std.dev.: 0.0222) MultiSource/Benchmarks/Olden/health/health: 9.50% (0.1347 => 0.1475, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.07% (0.1466 => 0.1599, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.40% (0.7473 => 0.8101, std.dev.: 0.0221) MultiSource/Benchmarks/sim/sim: 8.00% (0.3226 => 0.3484, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.76% (0.3003 => 0.3236, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.63% (0.8148 => 0.8770, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.45% (2.1401 => 2.2995, std.dev.: 0.0561) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.24% (1.5315 => 1.6424, std.dev.: 0.0319) SingleSource/UnitTests/Vector/constpool: 7.15% (8.4179 => 9.0194, std.dev.: 0.2283) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.08% (0.8420 => 0.8932, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.00% (0.8286 => 0.8783, std.dev.: 0.0177) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.85% (0.2240 => 0.2371, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.84% (0.2519 => 0.2666, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 5.83% (0.8927 => 0.9447, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.64% (3.1832 => 3.3628, std.dev.: 0.0459) MultiSource/Benchmarks/PAQ8p/paq8p: 5.19% (2.3764 => 2.4998, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.01% (0.5191 => 0.5451, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.85% (0.9908 => 1.0389, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.67% (0.9074 => 0.9498, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.55% (0.8697 => 0.9093, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4.53% (0.8317 => 0.8694, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.52% (0.8050 => 0.8414, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 4.52% (0.8855 => 0.9255, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.49% (0.8069 => 0.8431, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 4.48% (0.9069 => 0.9475, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 4.40% (0.8712 => 0.9095, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.38% (0.7966 => 0.8315, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.33% (0.8331 => 0.8692, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.09% (0.8656 => 0.9010, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.83% (8.6476 => 8.9784, std.dev.: 0.1006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.78% (1.1170 => 1.1592, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.69% (1.4479 => 1.5013, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.65% (0.2794 => 0.2896, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.37% (0.6586 => 0.6808, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.34% (0.3115 => 0.3219, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.12% (0.3657 => 0.3771, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.65% (0.8340 => 0.8561, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 198.28% (28.5821 => 85.2558, std.dev.: 0.1825) SingleSource/Benchmarks/Misc/pi: 40.33% (1.5795 => 2.2165, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 27.44% (2.9096 => 3.7079, std.dev.: 0.1189) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.22% (4.8436 => 5.8712, std.dev.: 0.0313) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.90% (8.2783 => 9.7598, std.dev.: 0.0188) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.89% (0.7597 => 0.8956, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.79% (14.6451 => 17.1039, std.dev.: 0.6872) SingleSource/Benchmarks/McGill/misr: 15.60% (0.4001 => 0.4625, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.66% (2.7995 => 3.1260, std.dev.: 0.0169) MultiSource/Applications/lambda-0_1_3/lambda: 10.22% (7.4933 => 8.2594, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.19% (6.3772 => 6.9631, std.dev.: 0.0925) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.35% (3.9917 => 4.2851, std.dev.: 0.0219) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.34% (23.5781 => 25.3079, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.32% (3.3761 => 3.5894, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.05% (2.9753 => 3.1553, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.94% (4.8660 => 5.1550, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.80% (4.5327 => 4.7957, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.34% (5.4187 => 5.7078, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.22% (5.3218 => 5.5997, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.03% (0.3937 => 0.4135, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.91% (0.5214 => 0.5470, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 4.32% (0.4353 => 0.4541, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: 4.03% (1.3037 => 1.3563, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.23% (4.8362 => 4.9924, std.dev.: 0.0357) MultiSource/Benchmarks/Olden/power/power: 3.14% (1.2061 => 1.2440, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.36% (3.4104 => 3.4908, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.26% (59.2638 => 60.6031, std.dev.: 0.3505) SingleSource/Benchmarks/Shootout/methcall: 2.20% (8.2676 => 8.4493, std.dev.: 0.0053) SingleSource/Benchmarks/McGill/queens: 2.05% (1.7056 => 1.7405, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.68% (11.5690 => 11.7631, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.33% (4.9469 => 5.0127, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/ReedSolomon: 1.28% (8.5322 => 8.6410, std.dev.: 0.0209) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.11% (1.9302 => 1.9516, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.27% (2.8951 => 1.6713, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -23.91% (7.2130 => 5.4887, std.dev.: 0.1826) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.32% (1.4529 => 1.1577, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.83% (9.9065 => 8.2388, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary3: -13.05% (1.9999 => 1.7389, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/em3d/em3d: -12.63% (5.4641 => 4.7740, std.dev.: 0.0135) SingleSource/Benchmarks/McGill/chomp: -9.87% (1.1216 => 1.0109, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-8: -9.74% (2.5609 => 2.3115, std.dev.: 0.0096) MultiSource/Benchmarks/mafft/pairlocalalign: -9.13% (63.1822 => 57.4134, std.dev.: 0.1070) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.12% (1.0512 => 0.9658, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.31% (3.2169 => 2.9817, std.dev.: 0.0421) SingleSource/Benchmarks/Misc/ffbench: -6.75% (1.4296 => 1.3331, std.dev.: 0.0127) SingleSource/Benchmarks/Stanford/FloatMM: -6.40% (0.8807 => 0.8243, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.24% (5.1305 => 4.8105, std.dev.: 0.0403) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.22% (4.7482 => 4.4529, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/sieve: -6.08% (7.0599 => 6.6309, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.70% (4.3552 => 4.1070, std.dev.: 0.0665) SingleSource/Benchmarks/Misc/flops: -5.52% (9.3748 => 8.8571, std.dev.: 0.0249) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.34% (6.2275 => 5.8948, std.dev.: 0.0952) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.62% (5.6343 => 5.3738, std.dev.: 0.0301) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.57% (4.7449 => 4.5282, std.dev.: 0.0346) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.43% (6.1706 => 5.8973, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.39% (4.9453 => 4.7284, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.82% (3.7148 => 3.5730, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/perlin: -3.78% (5.1084 => 4.9154, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/methcall: -3.49% (8.9760 => 8.6631, std.dev.: 0.0413) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.26% (4.9686 => 4.8066, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.18% (5.4300 => 5.2574, std.dev.: 0.0077) MultiSource/Applications/siod/siod: -2.91% (3.6643 => 3.5576, std.dev.: 0.0372) SingleSource/Benchmarks/Misc/fbench: -2.68% (3.3840 => 3.2932, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.66% (2.6356 => 2.5656, std.dev.: 0.0209) SingleSource/Benchmarks/Dhrystone/fldry: -2.33% (0.6910 => 0.6749, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -2.32% (1.0841 => 1.0590, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -1.93% (0.5807 => 0.5695, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.93% (3.3479 => 3.2834, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: -1.79% (1.4861 => 1.4595, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/flops-5: -1.74% (2.8957 => 2.8454, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/fp-convert: -1.58% (15.8853 => 15.6344, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-6: -1.43% (2.4416 => 2.4066, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.32% (4.2466 => 4.1905, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.11% (4.7794 => 4.7264, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.09% (6.0224 => 5.9567, std.dev.: 0.0143) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 5.55% (1.0262 => 1.0832, std.dev.: 0.3205) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.47% (0.2463 => 0.3706, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 38.21% (0.0123 => 0.0170, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.56% (0.0408 => 0.0369, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 15.35% (0.0254 => 0.0293, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -23.18% (0.0302 => 0.0232, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -10.42% (0.0384 => 0.0344, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/casts: -4.21% (0.0190 => 0.0182, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/test1: -2.78% (0.0180 => 0.0175, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 1.60% (0.1438 => 0.1461, std.dev.: 0.0265) MultiSource/Applications/lemon/lemon: 7.17% (1.1329 => 1.2141, std.dev.: 0.3520) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.07% (0.4164 => 0.4036, std.dev.: 0.0772) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.91% (0.1369 => 0.1532, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.55% (0.0641 => 0.0599, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 10.26% (0.0195 => 0.0215, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.94% (0.0578 => 0.0561, std.dev.: 0.0143) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.02% (1.1437 => 1.1435, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.42% (0.0627 => 0.0593, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.67% (0.0180 => 0.0192, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.15% (0.8017 => 0.8005, std.dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -12.90% (0.0062 => 0.0054, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 10:37:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 12:37:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121130183741.C171F2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/6425?compare_to=6419&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6425, Order: 169001, Start Time: 2012-11-30 15:08:05, End Time: 2012-11-30 18:38:17 To: 6419, Order: 168989, Start Time: 2012-11-30 10:49:36, End Time: 2012-11-30 14:19:42 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (179 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (186 on baseline) Unchanged Tests: 1091 (711 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 12.92% (66.3788 => 74.9534, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.56% (124.7610 => 131.6977, std.dev.: 0.2287) MultiSource/Applications/ClamAV/clamscan: 3.81% (0.2962 => 0.3075, std.dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.60% (0.0625 => 0.0885, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.21% (0.1063 => 0.1416, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 29.68% (0.0475 => 0.0616, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.61% (0.2969 => 0.3759, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.40% (0.1106 => 0.1398, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.59% (0.4139 => 0.5198, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.49% (0.0714 => 0.0896, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.07% (0.5900 => 0.7379, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.88% (0.1620 => 0.2023, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 24.73% (1.5932 => 1.9872, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.73% (0.4994 => 0.6229, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.62% (0.4253 => 0.5300, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.58% (0.0415 => 0.0517, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.12% (0.5000 => 0.6206, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.97% (0.0584 => 0.0724, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.41% (0.1021 => 0.1260, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.40% (0.0547 => 0.0675, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.13% (0.1107 => 0.1363, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 22.20% (0.0599 => 0.0732, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.07% (0.0897 => 0.1095, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.80% (0.0633 => 0.0771, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.75% (0.0584 => 0.0711, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.65% (0.0642 => 0.0781, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.63% (0.0541 => 0.0658, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 21.62% (0.0948 => 0.1153, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.58% (0.1103 => 0.1341, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.01% (0.0495 => 0.0599, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.98% (0.3903 => 0.4722, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.92% (0.0822 => 0.0994, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.85% (0.1549 => 0.1872, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.84% (0.1003 => 0.1212, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 20.69% (0.1619 => 0.1954, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.64% (0.1604 => 0.1935, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 20.58% (0.0821 => 0.0990, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 20.53% (0.0604 => 0.0728) MultiSource/Applications/viterbi/viterbi: 19.96% (0.0947 => 0.1136, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.49% (0.1462 => 0.1747, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.31% (0.2014 => 0.2403, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 19.18% (0.0808 => 0.0963, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.15% (0.3890 => 0.4635, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 19.04% (0.5826 => 0.6935, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.92% (1.3152 => 1.5641, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 18.91% (0.4029 => 0.4791, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: 18.80% (0.1218 => 0.1447, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.80% (0.1968 => 0.2338, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 18.71% (0.5889 => 0.6991, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.60% (0.2736 => 0.3245, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 18.48% (0.0698 => 0.0827, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 18.34% (0.5546 => 0.6563, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.29% (0.1088 => 0.1287, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.29% (3.5627 => 4.2142, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/09-vor/vor: 18.27% (0.1505 => 0.1780, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.25% (0.2866 => 0.3389, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.18% (0.0572 => 0.0676, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.85% (0.0605 => 0.0713, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.80% (0.0573 => 0.0675, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 17.63% (0.9697 => 1.1407, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 17.63% (0.7171 => 0.8435, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 17.62% (1.8794 => 2.2106, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.54% (1.6211 => 1.9055, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.45% (0.4658 => 0.5471, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.33% (0.1160 => 0.1361, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 17.16% (1.0781 => 1.2631, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 17.10% (0.1421 => 0.1664) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.06% (0.3271 => 0.3829, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.97% (0.2875 => 0.3363, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.97% (0.5026 => 0.5879, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.96% (2.7292 => 3.1920, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.91% (4.4195 => 5.1667, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.90% (0.4361 => 0.5098, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.79% (0.3930 => 0.4590, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 16.72% (4.2109 => 4.9150, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hello: 16.69% (0.2714 => 0.3167, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 16.66% (0.2725 => 0.3179, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.65% (0.2738 => 0.3194, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.56% (0.2729 => 0.3181, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 16.55% (0.2780 => 0.3240, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.33% (0.2792 => 0.3248, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 16.31% (0.9909 => 1.1525, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/except: 16.29% (0.2811 => 0.3269, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 16.29% (0.2750 => 0.3198, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.28% (0.3195 => 0.3715, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 16.27% (0.2803 => 0.3259, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.25% (0.2911 => 0.3384, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 16.21% (0.3004 => 0.3491, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.20% (2.0673 => 2.4022, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 16.20% (0.1284 => 0.1492, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 16.19% (0.2823 => 0.3280, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 16.17% (0.2813 => 0.3268, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 16.12% (0.3096 => 0.3595, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.09% (1.9694 => 2.2863, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.06% (0.1090 => 0.1265, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.00% (1.9966 => 2.3160, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-3: 15.52% (0.3460 => 0.3997, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-2: 15.44% (0.3446 => 0.3978, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 15.43% (0.3267 => 0.3771, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 15.41% (0.3465 => 0.3999, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 15.36% (0.3496 => 0.4033, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.36% (0.3060 => 0.3530, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 15.35% (0.3258 => 0.3758, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.34% (0.3488 => 0.4023, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 15.33% (0.2075 => 0.2393, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 15.31% (0.3469 => 0.4000, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 15.28% (0.3317 => 0.3824, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 15.28% (0.3442 => 0.3968, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 15.21% (23.5202 => 27.0979, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.11% (0.3362 => 0.3870, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 14.99% (0.3650 => 0.4197, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.95% (0.3124 => 0.3591, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: 14.91% (0.3643 => 0.4186, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 14.85% (0.2566 => 0.2947, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.84% (0.3282 => 0.3769, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 14.81% (0.3348 => 0.3844, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.77% (0.3845 => 0.4413, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 14.76% (0.3726 => 0.4276, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 14.72% (0.3724 => 0.4272, std.dev.: 0.0075) MultiSource/Applications/lua/lua: 14.68% (1.4269 => 1.6363, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 14.65% (0.3678 => 0.4217, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 14.52% (0.3477 => 0.3982, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.43% (0.3625 => 0.4148, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 14.40% (0.7875 => 0.9009, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 14.34% (2.1653 => 2.4757, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 14.26% (0.4251 => 0.4857, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.24% (0.3981 => 0.4548, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 14.13% (0.4146 => 0.4732, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.12% (0.3690 => 0.4211, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 14.12% (0.0758 => 0.0865, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 13.91% (4.6177 => 5.2601, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 13.79% (2.1013 => 2.3911, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 13.57% (0.5012 => 0.5692, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.38% (0.2040 => 0.2313, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 13.27% (0.2691 => 0.3048, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.29% (0.6435 => 0.7226, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 12.28% (5.5417 => 6.2224, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.08% (0.1383 => 0.1550, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 11.61% (0.3498 => 0.3904, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.38% (0.1028 => 0.1145, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 11.12% (0.6634 => 0.7372, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.12% (0.2068 => 0.2298, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.96% (0.2737 => 0.3037, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 10.87% (0.4847 => 0.5374, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 10.58% (0.3336 => 0.3689, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.54% (0.3084 => 0.3409, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 10.25% (2.0346 => 2.2432, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 10.25% (0.2391 => 0.2636, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.65% (0.2103 => 0.2306, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.46% (11.6398 => 12.6250, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.41% (0.5361 => 0.5812, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.37% (4.6926 => 5.0854, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.02% (0.5584 => 0.6032, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.82% (0.7426 => 0.8007, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 6.89% (11.9555 => 12.7790, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.85% (0.3792 => 0.4014, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.88% (29.0505 => 181.5309, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 9.74% (0.2802 => 0.3075, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6100, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.66% (0.3693 => 0.3902, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 5.47% (0.2122 => 0.2238, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6703, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-2: 4.79% (1.8057 => 1.8922, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1710, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.60% (79.9355 => 83.6097, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: 4.15% (14.0481 => 14.6307, std.dev.: 0.0150) MultiSource/Benchmarks/Olden/health/health: 2.74% (0.6276 => 0.6448, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 2.14% (15.8721 => 16.2114, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.66% (3.1722 => 3.2250, std.dev.: 0.0019) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3096, std.dev.: 0.0114) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2837, std.dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.6000, std.dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.81% (2.4764 => 2.4068, std.dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5755, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary2: -9.16% (0.2402 => 0.2182, std.dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9744, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8056, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8030, std.dev.: 0.0095) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7727, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.79% (17.2379 => 16.7572, std.dev.: 0.0408) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8632, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.91% (0.6293 => 0.6173, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5750, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4956, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.11% (105.3826 => 104.2110, std.dev.: 0.0355) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0426, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 11:33:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 13:33:02 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121130193302.096652A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/6426?compare_to=6422&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6426, Order: 169016, Start Time: 2012-11-30 17:58:40, End Time: 2012-11-30 19:33:35 To: 6422, Order: 169002, Start Time: 2012-11-30 15:02:59, End Time: 2012-11-30 16:38:54 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (7 on baseline) Performance Improvements: 0 (180 on baseline) Added Tests: 0 (52 on baseline) Unchanged Tests: 1093 (855 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.18% (78.7065 => 80.4246, std.dev.: 0.4000) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 14.66% (0.3834 => 0.4396, std.dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 74.81% (31.3723 => 54.8433, std.dev.: 0.0346) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.64% (2.0478 => 2.1018, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.4937 => 7.6863, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash2: 2.30% (3.1932 => 3.2668, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.24% (0.9531 => 0.9649, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.25% (0.1431 => 0.1313, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.59% (0.3821 => 0.3531, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.12% (0.9542 => 0.8863, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: -6.61% (2.4924 => 2.3276, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.55% (0.3831 => 0.3580, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -6.53% (0.3812 => 0.3563, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.52% (0.3142 => 0.2937, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: -6.47% (0.3896 => 0.3644, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.39% (0.3848 => 0.3602, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.39% (0.3880 => 0.3632, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.32% (0.3891 => 0.3645, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.26% (0.3357 => 0.3147, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -6.23% (0.4176 => 0.3916, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.20% (0.4033 => 0.3783, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.14% (0.2428 => 0.2279, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.09% (0.7198 => 0.6760, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.00% (0.3884 => 0.3651, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -5.88% (0.2160 => 0.2033, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -5.84% (9.2283 => 8.6895, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/property: -5.83% (0.4199 => 0.3954, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -5.80% (0.1879 => 0.1770, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.75% (0.6484 => 0.6111, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.75% (0.5863 => 0.5526, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.70% (0.5478 => 0.5166, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.68% (0.5805 => 0.5475, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.67% (0.5802 => 0.5473, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -5.65% (16.1920 => 15.2779, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.63% (0.5859 => 0.5529, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.63% (0.5705 => 0.5384, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.63% (0.3057 => 0.2885, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -5.62% (7.0961 => 6.6972, std.dev.: 0.0235) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.61% (0.6395 => 0.6036, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.60% (0.5857 => 0.5529, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.59% (0.5567 => 0.5256, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.57% (0.6297 => 0.5946, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.57% (0.5581 => 0.5270, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.57% (0.6194 => 0.5849, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.56% (0.6260 => 0.5912, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -5.54% (0.4280 => 0.4043, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.54% (0.6304 => 0.5955, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.54% (0.6052 => 0.5717, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.53% (0.5591 => 0.5282, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.51% (0.5575 => 0.5268, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.49% (0.9852 => 0.9311, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.49% (0.6230 => 0.5888, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.48% (0.2355 => 0.2226, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.48% (0.6189 => 0.5850, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.47% (0.3658 => 0.3458, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.46% (0.5456 => 0.5158, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.45% (0.6676 => 0.6312, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.44% (0.5849 => 0.5531, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.43% (0.6681 => 0.6318, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.42% (1.0544 => 0.9972, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.41% (0.6395 => 0.6049, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.40% (0.5925 => 0.5605, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.40% (1.2300 => 1.1636, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/methcall: -5.39% (0.3025 => 0.2862, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.36% (0.6440 => 0.6095, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.35% (6.7716 => 6.4090, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.34% (0.5688 => 0.5384, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.34% (0.2695 => 0.2551, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.34% (4.8161 => 4.5588, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.34% (0.7339 => 0.6947, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.33% (1.6364 => 1.5491, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.32% (0.5569 => 0.5273, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.31% (2.1713 => 2.0561, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.31% (0.3016 => 0.2856, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.30% (4.0323 => 3.8184, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.30% (4.8802 => 4.6214, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.30% (0.5941 => 0.5626, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.30% (1.3722 => 1.2995, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.30% (0.3323 => 0.3147, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.29% (0.3931 => 0.3723, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -5.29% (1.1530 => 1.0920, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: -5.29% (1.3148 => 1.2453, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.26% (0.3837 => 0.3635, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -5.26% (0.2871 => 0.2720, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -5.25% (0.3255 => 0.3084, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.24% (0.2939 => 0.2785, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.24% (0.7524 => 0.7130, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.23% (3.5339 => 3.3492, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.22% (0.5570 => 0.5279, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.22% (0.2933 => 0.2780, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.21% (0.6293 => 0.5965, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: -5.19% (1.3864 => 1.3144, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.19% (1.2784 => 1.2121, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: -5.19% (0.9179 => 0.8703, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.18% (0.6446 => 0.6112, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.18% (1.4642 => 1.3884, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.17% (0.6033 => 0.5721, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -5.17% (0.3194 => 0.3029, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.15% (14.2083 => 13.4769, std.dev.: 0.0199) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.14% (0.3252 => 0.3085, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.13% (0.2903 => 0.2754, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.13% (0.4151 => 0.3938, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.12% (4.5069 => 4.2763, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/hello: -5.09% (0.2849 => 0.2704, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -5.07% (17.1032 => 16.2355, std.dev.: 0.0138) MultiSource/Benchmarks/McCat/05-eks/eks: -5.07% (0.4515 => 0.4286, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: -5.06% (0.3026 => 0.2873, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.03% (0.8521 => 0.8092, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.03% (0.4813 => 0.4571, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: -5.03% (0.3481 => 0.3306, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.02% (0.3406 => 0.3235, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -5.02% (0.3446 => 0.3273, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.02% (0.6736 => 0.6398, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: -5.01% (0.3394 => 0.3224, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -5.00% (4.3330 => 4.1162, std.dev.: 0.0041) SingleSource/Regression/C++/ofstream_ctor: -4.97% (0.3059 => 0.2907, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -4.92% (0.2985 => 0.2838, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.91% (8.0126 => 7.6189, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.89% (0.7919 => 0.7532, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: -4.88% (0.2989 => 0.2843, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -4.88% (1.1450 => 1.0891, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.88% (0.3483 => 0.3313, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.86% (0.2385 => 0.2269, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -4.86% (0.3621 => 0.3445, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.85% (1.2221 => 1.1628, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.85% (0.5999 => 0.5708, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.84% (1.2210 => 1.1619, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hash2: -4.83% (0.4861 => 0.4626, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: -4.83% (0.4248 => 0.4043, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -4.78% (0.3867 => 0.3682, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -4.78% (15.5079 => 14.7673, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.77% (0.4321 => 0.4115, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.74% (0.2278 => 0.2170, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.70% (0.4916 => 0.4685, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: -4.68% (3.5154 => 3.3508, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.67% (0.2548 => 0.2429, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -4.67% (15.2527 => 14.5407, std.dev.: 0.0133) MultiSource/Benchmarks/McCat/08-main/main: -4.66% (0.2659 => 0.2535, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: -4.60% (0.4524 => 0.4316, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.56% (0.6667 => 0.6363, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.55% (0.6660 => 0.6357, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.52% (0.3849 => 0.3675, std.dev.: 0.0033) MultiSource/Applications/Burg/burg: -4.46% (1.2515 => 1.1957, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.43% (0.4083 => 0.3902, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -4.42% (34.0927 => 32.5861, std.dev.: 0.0206) MultiSource/Applications/minisat/minisat: -4.40% (0.7447 => 0.7119, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.40% (0.7021 => 0.6712, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.34% (0.4427 => 0.4235, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -4.32% (4.0594 => 3.8840, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.32% (0.5168 => 0.4945, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -4.25% (0.3788 => 0.3627, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.23% (0.2999 => 0.2872, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: -4.20% (5.0226 => 4.8115, std.dev.: 0.0036) MultiSource/Applications/treecc/treecc: -4.19% (2.1401 => 2.0504, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.15% (0.9557 => 0.9160, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (0.5329 => 0.5108, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -4.15% (0.7982 => 0.7651, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.11% (22.4056 => 21.4840, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.08% (1.6474 => 1.5802, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -4.07% (0.3271 => 0.3138, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.98% (0.3319 => 0.3187, std.dev.: 0.0020) MultiSource/Applications/siod/siod: -3.88% (2.4021 => 2.3089, std.dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: -3.86% (18.2933 => 17.5873, std.dev.: 0.0128) MultiSource/Applications/spiff/spiff: -3.81% (0.8418 => 0.8097, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: -3.79% (0.6750 => 0.6494, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.76% (0.9077 => 0.8736, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: -3.65% (0.6441 => 0.6206, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.61% (0.3491 => 0.3365, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -3.58% (0.6347 => 0.6120, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: -3.38% (1.5610 => 1.5082, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.37% (2.2587 => 2.1826, std.dev.: 0.0202) SingleSource/UnitTests/Vector/constpool: -3.06% (20.7746 => 20.1389, std.dev.: 0.0089) SingleSource/UnitTests/ObjC++/property-reference: -3.02% (0.7779 => 0.7544, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.59% (5.4682 => 5.3265, std.dev.: 0.0144) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.61% (1.8100 => 0.6949, std.dev.: 0.0065) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7531, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -8.68% (1.2842 => 1.1727, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: -4.04% (2.2633 => 2.1719, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7061, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4000, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4711, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 11:56:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 13:56:55 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121130195655.2B1F62A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/6427?compare_to=6424&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6427, Order: 169018, Start Time: 2012-11-30 18:17:03, End Time: 2012-11-30 19:57:31 To: 6424, Order: 169002, Start Time: 2012-11-30 16:22:56, End Time: 2012-11-30 17:58:48 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 16 (63 on baseline) Performance Improvements: 1 (23 on baseline) Added Tests: 0 (51 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1036 (888 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 5.29% (0.9190 => 0.9676, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.58% (0.8692 => 0.9090, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 4.32% (0.8550 => 0.8919, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/hash2: 3.44% (0.4132 => 0.4274, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 1.97% (15.0114 => 15.3064, std.dev.: 0.0623) MultiSource/Applications/treecc/treecc: 1.66% (2.1073 => 2.1422, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/football/football: 1.07% (0.9335 => 0.9435, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel24: 31.43% (0.3703 => 0.4867, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.43% (3.2001 => 3.6938, std.dev.: 0.1545) MultiSource/Benchmarks/nbench/nbench: 13.47% (18.7071 => 21.2271, std.dev.: 0.9261) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.17% (0.1592 => 0.1722, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.88% (4.1070 => 4.3486, std.dev.: 0.0260) SingleSource/Benchmarks/Misc/whetstone: 1.77% (2.1637 => 2.2020, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout/fib2: 1.29% (4.3079 => 4.3636, std.dev.: 0.0097) MultiSource/Benchmarks/sim/sim: 1.13% (3.8679 => 3.9116, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.07% (4.1905 => 4.2353, std.dev.: 0.0087) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/pi: -2.59% (2.2165 => 2.1591, std.dev.: 0.0154) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.14% (1.0832 => 1.0847, std.dev.: 0.2237) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.54% (0.3706 => 0.3726, std.dev.: 0.0373) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 30.59% (0.0170 => 0.0222, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 15.72% (0.0369 => 0.0427, std.dev.: 0.0162) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 15.02% (0.0293 => 0.0337, std.dev.: 0.0132) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 35.78% (0.0232 => 0.0315, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 24.71% (0.0344 => 0.0429, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/casts: 13.74% (0.0182 => 0.0207, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 25.14% (0.0175 => 0.0219, std.dev.: 0.0067) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.78% (0.1461 => 0.1487, std.dev.: 0.0104) MultiSource/Applications/lemon/lemon: 2.98% (1.2141 => 1.2503, std.dev.: 0.3735) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.67% (0.4036 => 0.4063, std.dev.: 0.0182) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.70% (0.1532 => 0.1506, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.35% (0.0599 => 0.0673, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 36.28% (0.0215 => 0.0293, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.15% (0.0561 => 0.0646, std.dev.: 0.0152) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.12% (1.1435 => 1.1563, std.dev.: 0.0837) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.18% (0.0593 => 0.0586, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.06% (0.0192 => 0.0267, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.36% (0.8005 => 0.8114, std.dev.: 0.0091) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 94.44% (0.0054 => 0.0105, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.09% (8.6237 => 8.6156, std.dev.: 0.0330) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 10.22% (16.4461 => 18.1269, std.dev.: 1.5510) MultiSource/Applications/sqlite3/sqlite3: 2429.26% (0.6332 => 16.0153, std.dev.: 0.5309) MultiSource/Benchmarks/McCat/08-main/main: 50.30% (0.1831 => 0.2752, std.dev.: 0.0281) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.86% (0.1559 => 0.1452, std.dev.: 0.0047) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7272.65% (0.3123 => 23.0248, std.dev.: 0.6218) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1584.45% (0.3344 => 5.6328, std.dev.: 0.2715) SingleSource/Benchmarks/Misc-C++/Large/ray: 41.41% (0.2364 => 0.3343, std.dev.: 0.0956) SingleSource/Benchmarks/Misc-C++/bigfib: 8.02% (0.6010 => 0.6492, std.dev.: 0.1161) SingleSource/Benchmarks/Misc/mandel: 6.53% (0.0429 => 0.0457, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.75% (0.3266 => 0.3421, std.dev.: 0.0253) SingleSource/Benchmarks/Shootout-C++/strcat: 4.01% (0.1969 => 0.2048, std.dev.: 0.0302) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.04% (0.0224 => 0.0242, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0041) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0501, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 12.65% (0.1462 => 0.1647, std.dev.: 0.0146) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4552, std.dev.: 0.0350) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0738, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4909, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5230, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2859, std.dev.: 0.0450) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0814, std.dev.: 0.0869) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3636, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3748, std.dev.: 0.0400) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0832, std.dev.: 0.0089) SingleSource/Regression/C/uint64_to_float: -29.64% (2.1832 => 1.5361, std.dev.: 0.0218) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 13.45% (2.1401 => 2.4279, std.dev.: 0.0880) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 10.24% (0.9908 => 1.0923, std.dev.: 0.0343) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.00% (0.8050 => 0.8855, std.dev.: 0.0272) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.94% (0.7473 => 0.8216, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.89% (0.8805 => 0.9676, std.dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.81% (1.5315 => 1.6818, std.dev.: 0.0470) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.44% (0.8712 => 0.9534, std.dev.: 0.0295) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.11% (0.8331 => 0.9090, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.42% (0.4847 => 0.5255, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.32% (0.8007 => 0.8673, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.26% (0.1756 => 0.1901, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.97% (0.8261 => 0.8919, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/football/football: 7.61% (0.8768 => 0.9435, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.48% (0.9069 => 0.9747, std.dev.: 0.0238) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 7.47% (0.8697 => 0.9347, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.44% (0.8317 => 0.8936, std.dev.: 0.0185) MultiSource/Applications/treecc/treecc: 7.39% (1.9948 => 2.1422, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.37% (0.9435 => 1.0130, std.dev.: 0.0179) MultiSource/Applications/SPASS/SPASS: 7.33% (14.2605 => 15.3064, std.dev.: 0.0623) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.97% (0.8611 => 0.9211, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.78% (0.9056 => 0.9670, std.dev.: 0.0176) MultiSource/Applications/minisat/minisat: 6.60% (0.6834 => 0.7285, std.dev.: 0.0147) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.15% (0.1885 => 0.2001, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/oourafft: 6.03% (0.2088 => 0.2214, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 6.00% (0.7950 => 0.8427, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.29% (0.5817 => 0.6125, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.70% (0.8340 => 0.8732, std.dev.: 0.0130) MultiSource/Applications/d/make_dparser: 4.65% (3.2366 => 3.3871, std.dev.: 0.0292) SingleSource/Benchmarks/Shootout-C++/hash2: 3.61% (0.4125 => 0.4274, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 198.90% (28.5821 => 85.4306, std.dev.: 0.3645) SingleSource/Benchmarks/Misc/pi: 36.70% (1.5795 => 2.1591, std.dev.: 0.0154) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 27.62% (2.9096 => 3.7133, std.dev.: 0.0412) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.94% (4.8436 => 5.9064, std.dev.: 0.1356) SingleSource/Benchmarks/Shootout-C++/heapsort: 21.05% (3.0515 => 3.6938, std.dev.: 0.1545) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 21.02% (0.0528 => 0.0639, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.23% (8.2783 => 9.7871, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.49% (0.7597 => 0.8926, std.dev.: 0.0323) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.49% (14.6451 => 16.9140, std.dev.: 0.2277) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 12.52% (2.7995 => 3.1501, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.35% (6.3772 => 7.1013, std.dev.: 0.1625) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.38% (1.1857 => 1.3088, std.dev.: 0.0249) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.36% (0.1129 => 0.1246, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 10.30% (7.4933 => 8.2651, std.dev.: 0.0532) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.39% (23.5781 => 25.3214, std.dev.: 0.0377) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.38% (3.3761 => 3.6252, std.dev.: 0.0436) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 6.31% (4.8660 => 5.1732, std.dev.: 0.0286) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 6.10% (5.4187 => 5.7495, std.dev.: 0.0313) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.83% (2.9753 => 3.1487, std.dev.: 0.0339) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 5.60% (0.5214 => 0.5506, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.44% (5.3218 => 5.6112, std.dev.: 0.0991) MultiSource/Benchmarks/Olden/treeadd/treeadd: 5.10% (0.3587 => 0.3770, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 5.05% (0.4353 => 0.4573, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 4.46% (6.7064 => 7.0057, std.dev.: 0.1057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 4.22% (0.3937 => 0.4103, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/whetstone: 3.75% (2.1224 => 2.2020, std.dev.: 0.0114) MultiSource/Benchmarks/Olden/power/power: 3.25% (1.2061 => 1.2453, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.94% (4.8362 => 4.9783, std.dev.: 0.0246) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.54% (3.4104 => 3.4970, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 2.38% (3.8206 => 3.9116, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout/methcall: 1.69% (8.2676 => 8.4076, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout/fib2: 1.42% (4.3025 => 4.3636, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.11% (6.7533 => 6.8284, std.dev.: 0.0217) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.05% (3.7781 => 3.8177, std.dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.19% (2.8951 => 1.6738, std.dev.: 0.0236) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -24.19% (7.2130 => 5.4685, std.dev.: 0.1838) MultiSource/Benchmarks/Ptrdist/ks/ks: -18.48% (1.4529 => 1.1844, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.71% (9.9065 => 8.2508, std.dev.: 0.0173) MultiSource/Benchmarks/Olden/em3d/em3d: -12.66% (5.4641 => 4.7724, std.dev.: 0.0360) SingleSource/Benchmarks/Misc/flops-8: -9.20% (2.5609 => 2.3252, std.dev.: 0.0128) MultiSource/Benchmarks/mafft/pairlocalalign: -9.01% (63.1822 => 57.4896, std.dev.: 0.4166) SingleSource/Benchmarks/McGill/chomp: -8.87% (1.1216 => 1.0221, std.dev.: 0.0271) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.01% (4.7482 => 4.4626, std.dev.: 0.0475) SingleSource/Benchmarks/Shootout/sieve: -5.95% (7.0599 => 6.6399, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.58% (5.1305 => 4.8441, std.dev.: 0.0336) SingleSource/Benchmarks/Misc/flops: -5.14% (9.3748 => 8.8931, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.06% (6.2275 => 5.9125, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.17% (4.7449 => 4.5471, std.dev.: 0.0260) SingleSource/Benchmarks/Misc/perlin: -3.64% (5.1084 => 4.9223, std.dev.: 0.0357) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -2.88% (5.4300 => 5.2738, std.dev.: 0.0438) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.70% (4.9686 => 4.8344, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/methcall: -2.61% (8.9760 => 8.7421, std.dev.: 0.0444) MultiSource/Applications/siod/siod: -2.31% (3.6643 => 3.5795, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout/hash: -1.83% (4.3087 => 4.2298, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.54% (3.5679 => 3.5130, std.dev.: 0.0165) SingleSource/Benchmarks/Misc/fp-convert: -1.31% (15.8853 => 15.6779, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.11% (4.7794 => 4.7265, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 5.70% (1.0262 => 1.0847, std.dev.: 0.2237) SingleSource/Benchmarks/CoyoteBench/fftbench: 51.28% (0.2463 => 0.3726, std.dev.: 0.0373) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 80.49% (0.0123 => 0.0222, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0162) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 32.68% (0.0254 => 0.0337, std.dev.: 0.0132) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.72% (0.0384 => 0.0429, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/casts: 8.95% (0.0190 => 0.0207, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0067) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 3.41% (0.1438 => 0.1487, std.dev.: 0.0104) MultiSource/Applications/lemon/lemon: 10.36% (1.1329 => 1.2503, std.dev.: 0.3735) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.43% (0.4164 => 0.4063, std.dev.: 0.0182) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.01% (0.1369 => 0.1506, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.99% (0.0641 => 0.0673, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 50.26% (0.0195 => 0.0293, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 11.76% (0.0578 => 0.0646, std.dev.: 0.0152) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.10% (1.1437 => 1.1563, std.dev.: 0.0837) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.54% (0.0627 => 0.0586, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.21% (0.8017 => 0.8114, std.dev.: 0.0091) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 69.35% (0.0062 => 0.0105, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 12:43:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 14:43:02 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121130204302.1C50F2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/6428?compare_to=6423&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6428, Order: 169002, Start Time: 2012-11-30 18:18:47, End Time: 2012-11-30 20:43:36 To: 6423, Order: 169000, Start Time: 2012-11-30 14:55:31, End Time: 2012-11-30 17:18:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 21 (171 on baseline) Performance Improvements: 4 (41 on baseline) Added Tests: 0 (186 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1063 (673 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 9.83% (0.1180 => 0.1296, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.02% (0.4578 => 0.4991, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.96% (0.6293 => 0.6857, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 8.86% (0.5913 => 0.6437, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.86% (0.6651 => 0.7240, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.85% (0.7210 => 0.7848, std.dev.: 0.0228) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.80% (0.7884 => 0.8578, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.45% (0.6224 => 0.6750, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.76% (0.7110 => 0.7662, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.48% (0.3448 => 0.3706, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.38% (0.9010 => 0.9675, std.dev.: 0.0206) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.28% (2.2482 => 2.4118, std.dev.: 0.0552) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.96% (1.3180 => 1.4097, std.dev.: 0.0261) MultiSource/Benchmarks/nbench/nbench: 6.87% (1.3354 => 1.4271, std.dev.: 0.0204) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.89% (0.2106 => 0.2230, std.dev.: 0.0048) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.60% (0.3592 => 0.3793, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.41% (4.7076 => 4.9150, std.dev.: 0.0628) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 5.79% (0.6560 => 0.6940, std.dev.: 0.0110) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 4.69% (3.1361 => 3.2833, std.dev.: 0.0326) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.79% (5.3710 => 5.4672, std.dev.: 0.0156) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.06% (3.0291 => 3.0613, std.dev.: 0.0090) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/04-bisect/bisect: -9.50% (0.1337 => 0.1210, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -9.19% (0.2839 => 0.2578, std.dev.: 0.0089) MultiSource/Benchmarks/mafft/pairlocalalign: -2.08% (10.9821 => 10.7534, std.dev.: 0.0574) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.12% (0.5955 => 0.5769, std.dev.: 0.0069) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 1.39% (68.4688 => 69.4174, std.dev.: 0.6690) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 1.12% (0.1339 => 0.1354, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -14.81% (0.0493 => 0.0420, std.dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.96% (0.0675 => 0.0655, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 0.04% (493.8529 => 494.0494, std.dev.: 0.2562) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.76% (63.2438 => 69.4174, std.dev.: 0.6690) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43710.36% (1.1277 => 494.0494, std.dev.: 0.2562) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 199.64% (0.5229 => 1.5668, std.dev.: 0.0825) MultiSource/Applications/SPASS/SPASS: 17.91% (14.9895 => 17.6735, std.dev.: 0.4381) MultiSource/Applications/kimwitu++/kc: 47.06% (14.1553 => 20.8169, std.dev.: 0.3726) MultiSource/Benchmarks/MallocBench/gs/gs: 20.44% (4.1105 => 4.9507, std.dev.: 0.1949) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 44.84% (1.1048 => 1.6002, std.dev.: 0.0538) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 445.56% (7.1582 => 39.0526, std.dev.: 0.3026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 77.52% (3.4629 => 6.1472, std.dev.: 0.3852) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.41% (0.6222 => 1.0354, std.dev.: 0.0543) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10398.89% (0.0720 => 7.5592, std.dev.: 0.3271) MultiSource/Applications/SIBsim4/SIBsim4: 3855900.00% (0.0001 => 3.8560, std.dev.: 0.0367) MultiSource/Applications/SPASS/SPASS: 12717700.00% (0.0001 => 12.7178, std.dev.: 2.1926) MultiSource/Applications/kimwitu++/kc: 52100.00% (0.0001 => 0.0522, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 64400.00% (0.0001 => 0.0645, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14400.00% (0.0001 => 0.0145, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576800.00% (0.0001 => 0.5769, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9992000.00% (0.0001 => 9.9921, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5682200.00% (0.0001 => 5.6823, std.dev.: 0.7871) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1693.68% (1.1194 => 20.0785, std.dev.: 0.7157) MultiSource/Applications/ClamAV/clamscan: 67.80% (22.1758 => 37.2121, std.dev.: 0.4258) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 61.18% (2.9384 => 4.7360, std.dev.: 0.2696) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 58.70% (7.0540 => 11.1949, std.dev.: 0.2399) MultiSource/Applications/JM/lencod/lencod: 48.11% (21.9371 => 32.4921, std.dev.: 0.3493) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.35% (8.1363 => 11.9076, std.dev.: 0.1915) MultiSource/Benchmarks/FreeBench/distray/distray: 45.08% (0.1056 => 0.1532, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops: 43.72% (0.1432 => 0.2058, std.dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/almabench: 38.77% (0.0730 => 0.1013, std.dev.: 0.0013) SingleSource/UnitTests/vla: 35.21% (0.0355 => 0.0480, std.dev.: 0.0014) SingleSource/Benchmarks/Stanford/Oscar: 32.86% (0.0636 => 0.0845, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 30.03% (0.0746 => 0.0970, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/15-trie/trie: 27.70% (0.0527 => 0.0673, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 27.67% (0.2700 => 0.3447, std.dev.: 0.0180) MultiSource/Benchmarks/Olden/tsp/tsp: 26.55% (0.1175 => 0.1487, std.dev.: 0.0040) MultiSource/Applications/spiff/spiff: 26.29% (0.7835 => 0.9895, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/17-bintr/bintr: 25.78% (0.0675 => 0.0849, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.58% (0.1032 => 0.1296, std.dev.: 0.0019) SingleSource/Benchmarks/Stanford/Towers: 24.63% (0.0471 => 0.0587, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.58% (0.0842 => 0.1049, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 24.03% (0.7115 => 0.8825, std.dev.: 0.0333) MultiSource/Benchmarks/Olden/em3d/em3d: 24.01% (0.1695 => 0.2102, std.dev.: 0.0118) MultiSource/Benchmarks/Olden/bisort/bisort: 23.94% (0.0614 => 0.0761, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.66% (0.1940 => 0.2399, std.dev.: 0.0063) SingleSource/Benchmarks/McGill/chomp: 23.63% (0.1655 => 0.2046, std.dev.: 0.0107) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.46% (0.0793 => 0.0979, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 23.07% (0.6675 => 0.8215, std.dev.: 0.0441) MultiSource/Benchmarks/Olden/health/health: 23.03% (0.1268 => 0.1560, std.dev.: 0.0067) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 22.91% (0.0467 => 0.0574, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 22.89% (0.3307 => 0.4064, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/dot-syntax-1: 22.76% (0.0479 => 0.0588, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: 22.50% (0.0871 => 0.1067, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 22.44% (0.2554 => 0.3127, std.dev.: 0.0151) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 22.35% (0.0953 => 0.1166, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/mst/mst: 22.18% (0.1163 => 0.1421, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 22.07% (2.0273 => 2.4747, std.dev.: 0.0700) MultiSource/Benchmarks/McCat/18-imp/imp: 21.79% (0.3423 => 0.4169, std.dev.: 0.0087) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 21.76% (0.0648 => 0.0789, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.68% (0.2758 => 0.3356, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 21.64% (0.4103 => 0.4991, std.dev.: 0.0136) MultiSource/Applications/oggenc/oggenc: 21.56% (5.7591 => 7.0007, std.dev.: 0.1770) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.53% (0.3121 => 0.3793, std.dev.: 0.0067) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.52% (0.1566 => 0.1903, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.30% (0.3441 => 0.4174, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.22% (0.5569 => 0.6751, std.dev.: 0.0207) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 21.10% (0.0834 => 0.1010, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 21.07% (0.1125 => 0.1362, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 21.04% (3.8922 => 4.7113, std.dev.: 0.1336) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.91% (0.0770 => 0.0931, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/bigfib: 20.85% (0.6456 => 0.7802, std.dev.: 0.0210) MultiSource/Benchmarks/MallocBench/espresso/espresso: 20.76% (4.2646 => 5.1500, std.dev.: 0.1441) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 20.70% (1.5415 => 1.8606, std.dev.: 0.0401) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.64% (0.1584 => 0.1911, std.dev.: 0.0089) MultiSource/Benchmarks/nbench/nbench: 20.53% (1.1840 => 1.4271, std.dev.: 0.0204) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.39% (0.9765 => 1.1756, std.dev.: 0.0247) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.00% (0.4615 => 0.5538, std.dev.: 0.0123) MultiSource/Benchmarks/McCat/09-vor/vor: 19.94% (0.3180 => 0.3814, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.93% (0.8067 => 0.9675, std.dev.: 0.0206) SingleSource/Benchmarks/Shootout-C++/reversefile: 19.79% (0.3865 => 0.4630, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.67% (0.1337 => 0.1600, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.51% (0.5860 => 0.7003, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/spellcheck: 18.94% (0.4203 => 0.4999, std.dev.: 0.0219) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.85% (1.1861 => 1.4097, std.dev.: 0.0261) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.56% (0.1029 => 0.1220, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 18.56% (4.9449 => 5.8627, std.dev.: 0.1156) MultiSource/Benchmarks/Prolangs-C/football/football: 18.45% (0.8921 => 1.0567, std.dev.: 0.0207) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.40% (5.0018 => 5.9223, std.dev.: 0.1250) SingleSource/Benchmarks/Shootout-C++/lists: 18.38% (0.3422 => 0.4051, std.dev.: 0.0102) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.32% (0.0704 => 0.0833, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sieve: 18.07% (0.3603 => 0.4254, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 18.04% (0.5981 => 0.7060, std.dev.: 0.0176) MultiSource/Applications/d/make_dparser: 18.00% (3.3354 => 3.9359, std.dev.: 0.1697) SingleSource/Benchmarks/Misc/fbench: 17.91% (0.0592 => 0.0698, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.88% (1.4186 => 1.6723, std.dev.: 0.0374) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 17.86% (0.1892 => 0.2230, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 17.66% (0.0838 => 0.0986, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 17.54% (2.2024 => 2.5888, std.dev.: 0.1335) SingleSource/Benchmarks/CoyoteBench/fftbench: 17.49% (0.4636 => 0.5447, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 17.47% (0.4299 => 0.5050, std.dev.: 0.0100) SingleSource/UnitTests/2006-12-11-LoadConstants: 17.41% (0.1143 => 0.1342, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 17.41% (0.8101 => 0.9511, std.dev.: 0.0257) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.20% (0.3162 => 0.3706, std.dev.: 0.0095) SingleSource/UnitTests/ObjC/messages-2: 16.92% (0.0662 => 0.0774, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.75% (0.3427 => 0.4001, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout/matrix: 16.75% (0.0818 => 0.0955, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.71% (2.0665 => 2.4118, std.dev.: 0.0552) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.63% (0.8172 => 0.9531, std.dev.: 0.0182) MultiSource/Applications/sqlite3/sqlite3: 16.57% (17.1811 => 20.0274, std.dev.: 0.4782) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.56% (0.2065 => 0.2407, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.55% (14.3668 => 16.7439, std.dev.: 0.3882) SingleSource/UnitTests/ObjC/exceptions-4: 16.45% (0.3543 => 0.4126, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 16.40% (0.1268 => 0.1476, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bh/bh: 16.36% (0.3092 => 0.3598, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.19% (0.3650 => 0.4241, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/fibo: 15.93% (0.2725 => 0.3159, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/wc: 15.92% (0.3052 => 0.3538, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.80% (0.0886 => 0.1026, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: 15.80% (1.1642 => 1.3481, std.dev.: 0.0340) MultiSource/Applications/viterbi/viterbi: 15.76% (0.1555 => 0.1800, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.48% (0.5020 => 0.5797, std.dev.: 0.0226) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.40% (0.1117 => 0.1289, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/except: 15.33% (0.2871 => 0.3311, std.dev.: 0.0075) SingleSource/UnitTests/ObjC/exceptions-3: 15.24% (0.3516 => 0.4052, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 15.24% (0.7433 => 0.8566, std.dev.: 0.0434) SingleSource/Regression/C++/ofstream_ctor: 14.97% (0.2905 => 0.3340, std.dev.: 0.0068) MultiSource/Benchmarks/NPB-serial/is/is: 14.88% (0.0719 => 0.0826, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.79% (0.0798 => 0.0916, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.62% (0.2107 => 0.2415, std.dev.: 0.0097) SingleSource/UnitTests/ObjC/exceptions-2: 14.53% (0.3497 => 0.4005, std.dev.: 0.0038) SingleSource/UnitTests/SignlessTypes/rem: 14.16% (0.1144 => 0.1306, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 14.11% (0.2891 => 0.3299, std.dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.97% (0.1510 => 0.1721, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.94% (0.1062 => 0.1210, std.dev.: 0.0047) MultiSource/Applications/sgefa/sgefa: 13.93% (0.3109 => 0.3542, std.dev.: 0.0143) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.82% (0.3935 => 0.4479, std.dev.: 0.0121) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.52% (0.2271 => 0.2578, std.dev.: 0.0089) MultiSource/Benchmarks/mafft/pairlocalalign: 13.38% (9.4845 => 10.7534, std.dev.: 0.0574) MultiSource/Applications/hbd/hbd: 13.07% (1.5603 => 1.7642, std.dev.: 0.0639) SingleSource/UnitTests/ObjC/parameter-passing: 12.43% (0.3927 => 0.4415, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/random: 12.38% (0.2802 => 0.3149, std.dev.: 0.0099) SingleSource/UnitTests/ObjC/synchronized: 12.27% (0.3561 => 0.3998, std.dev.: 0.0065) SingleSource/UnitTests/ObjC/property: 12.04% (0.3886 => 0.4354, std.dev.: 0.0099) SingleSource/UnitTests/ObjC/exceptions: 11.91% (0.3828 => 0.4284, std.dev.: 0.0090) SingleSource/UnitTests/ObjC/trivial-interface: 11.81% (0.3473 => 0.3883, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/oourafft: 11.76% (0.3282 => 0.3668, std.dev.: 0.0101) SingleSource/UnitTests/ObjC/for-in: 11.64% (0.3694 => 0.4124, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.63% (0.3543 => 0.3955, std.dev.: 0.0079) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.44% (0.1906 => 0.2124, std.dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference-object: 10.38% (0.6030 => 0.6656, std.dev.: 0.0143) MultiSource/Benchmarks/sim/sim: 10.30% (0.3387 => 0.3736, std.dev.: 0.0112) SingleSource/UnitTests/ObjC++/Hello: 10.26% (0.5925 => 0.6533, std.dev.: 0.0110) SingleSource/UnitTests/ObjC++/property-reference: 9.75% (0.7326 => 0.8040, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/ary2: 9.59% (0.3379 => 0.3703, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/power/power: 8.06% (0.1440 => 0.1556, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.99% (0.4879 => 0.5269, std.dev.: 0.0104) MultiSource/Benchmarks/PAQ8p/paq8p: 7.30% (10.3673 => 11.1237, std.dev.: 0.2058) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.09% (0.1438 => 0.1540, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.34% (0.3817 => 0.4059, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 149.50% (4.3953 => 10.9664, std.dev.: 0.0360) SingleSource/Benchmarks/Shootout-C++/methcall: 147.17% (5.3999 => 13.3471, std.dev.: 0.0130) MultiSource/Benchmarks/SciMark2-C/scimark2: 79.56% (32.5116 => 58.3791, std.dev.: 0.0744) MultiSource/Benchmarks/McCat/09-vor/vor: 32.58% (0.1154 => 0.1530, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 31.97% (0.3256 => 0.4297, std.dev.: 0.0213) MultiSource/Applications/minisat/minisat: 23.33% (9.1159 => 11.2423, std.dev.: 0.6694) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.38% (1.1145 => 1.3082, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 16.12% (6.6465 => 7.7177, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.76% (0.2944 => 0.3349, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.54% (2.8904 => 3.2240, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: 10.00% (1.1396 => 1.2536, std.dev.: 0.0016) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.24% (1.7254 => 1.8849, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ffbench: 8.35% (0.9505 => 1.0299, std.dev.: 0.0204) MultiSource/Benchmarks/Olden/mst/mst: 8.09% (0.1285 => 0.1389, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.95% (0.9540 => 1.0108, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.65% (4.2280 => 4.4668, std.dev.: 0.0078) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 5.02% (1.9405 => 2.0380, std.dev.: 0.0377) MultiSource/Applications/lua/lua: 4.94% (26.0924 => 27.3826, std.dev.: 0.1680) SingleSource/Benchmarks/Shootout/hash: 4.89% (4.9088 => 5.1489, std.dev.: 0.0244) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 4.78% (3.1334 => 3.2833, std.dev.: 0.0326) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.6436 => 12.1022, std.dev.: 0.0136) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.32% (0.4162 => 0.4300, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.12% (1.3677 => 1.3967, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 2.03% (3.1595 => 3.2236, std.dev.: 0.0023) MultiSource/Benchmarks/PAQ8p/paq8p: 1.97% (85.0658 => 86.7455, std.dev.: 0.0731) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.41% (2.3135 => 2.3461, std.dev.: 0.0094) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.40% (6.5088 => 6.6000, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.28% (1.0313 => 1.0445, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0501, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 1.04% (5.2636 => 5.3184, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fbench: 1.01% (2.2771 => 2.3000, std.dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.38% (6.6874 => 0.1749, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.66% (5.2763 => 1.2844, std.dev.: 0.0209) SingleSource/Benchmarks/Misc/salsa20: -74.84% (0.8651 => 0.2177, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: -41.18% (0.1622 => 0.0954, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.54% (5.3855 => 4.7104, std.dev.: 0.1590) MultiSource/Applications/JM/ldecod/ldecod: -9.49% (10.4361 => 9.4457, std.dev.: 0.3477) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.18% (5.3526 => 4.9150, std.dev.: 0.0628) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -64.55% (1.9577 => 0.6940, std.dev.: 0.0110) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1681, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.04% (0.0628 => 0.0364, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.23% (0.3987 => 0.2383, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.28% (4.5009 => 2.7778, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7636, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.15% (2.6546 => 2.0134, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: -19.11% (0.2161 => 0.1748, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: -15.68% (1.6925 => 1.4272, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.68% (2.6778 => 2.2847, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -10.70% (1.5373 => 1.3728, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -10.53% (9.5636 => 8.5566, std.dev.: 0.1916) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.05% (1.5660 => 1.4243, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.95% (4.8142 => 4.4798, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.59% (2.7294 => 2.5768, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.56% (3.2416 => 3.0613, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -5.44% (19.9488 => 18.8633, std.dev.: 0.3950) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.14% (0.8614 => 0.8171, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5074, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/lists: -4.19% (6.2999 => 6.0359, std.dev.: 0.0077) MultiSource/Benchmarks/sim/sim: -3.12% (5.0483 => 4.8906, std.dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4808 => 0.4659, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.92% (0.9957 => 0.9666, std.dev.: 0.0077) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.06% (8.1563 => 7.9886, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6773, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -1.53% (10.2830 => 10.1259, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.82% (0.1485 => 0.1354, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.05% (0.2116 => 0.0655, std.dev.: 0.0010) Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 13:31:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 15:31:08 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121130213108.4941B2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/6429?compare_to=6426&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6429, Order: 169027, Start Time: 2012-11-30 19:56:45, End Time: 2012-11-30 21:31:43 To: 6426, Order: 169016, Start Time: 2012-11-30 17:58:40, End Time: 2012-11-30 19:33:35 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (7 on baseline) Performance Improvements: 1 (183 on baseline) Added Tests: 0 (52 on baseline) Unchanged Tests: 1091 (852 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.18% (20.1389 => 20.3765, std.dev.: 0.0236) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.00% (54.8573 => 56.5029, std.dev.: 0.0444) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -2.48% (0.6949 => 0.6777, std.dev.: 0.0054) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 11.16% (0.3834 => 0.4262, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 74.95% (31.3723 => 54.8848, std.dev.: 0.0340) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.53% (54.5751 => 56.5029, std.dev.: 0.0444) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.85% (2.0478 => 2.1062, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/salsa20: 2.70% (7.4937 => 7.6962, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/hash2: 2.04% (3.1932 => 3.2585, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.17% (0.3821 => 0.3509, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.28% (0.9542 => 0.8847, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.89% (2.4924 => 2.3207, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: -6.61% (0.3357 => 0.3135, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.34% (0.2428 => 0.2274, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.24% (0.1796 => 0.1684, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -6.01% (16.1920 => 15.2188, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.97% (0.5478 => 0.5151, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -5.96% (0.1761 => 0.1656, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -5.96% (0.1879 => 0.1767, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -5.95% (7.0961 => 6.6737, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/exceptions-2: -5.95% (0.3831 => 0.3603, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.94% (0.2355 => 0.2215, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -5.90% (0.3812 => 0.3587, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.90% (0.3880 => 0.3651, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.90% (0.5863 => 0.5517, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.89% (0.7198 => 0.6774, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.87% (0.5805 => 0.5464, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -5.87% (0.3848 => 0.3622, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.86% (0.5802 => 0.5462, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.84% (0.5859 => 0.5517, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.83% (0.6484 => 0.6106, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.80% (0.7339 => 0.6913, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: -5.80% (0.3896 => 0.3670, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.80% (0.3658 => 0.3446, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.80% (0.5591 => 0.5267, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/exceptions: -5.80% (0.4176 => 0.3934, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.79% (1.3722 => 1.2927, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.79% (0.3057 => 0.2880, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.79% (0.5857 => 0.5518, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.78% (0.3891 => 0.3666, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.78% (0.6230 => 0.5870, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.76% (0.5925 => 0.5584, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -5.75% (9.2283 => 8.6975, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.74% (0.7524 => 0.7092, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.74% (0.6395 => 0.6028, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.73% (0.6052 => 0.5705, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.73% (0.5705 => 0.5378, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.73% (0.6304 => 0.5943, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: -5.71% (0.9179 => 0.8655, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.69% (0.9852 => 0.9291, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.69% (4.8161 => 4.5420, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/for-in: -5.68% (0.4033 => 0.3804, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.66% (1.2300 => 1.1604, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.66% (0.3837 => 0.3620, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.64% (0.2695 => 0.2543, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.64% (0.3016 => 0.2846, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.63% (0.5581 => 0.5267, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.62% (0.3255 => 0.3072, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.61% (0.5849 => 0.5521, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.60% (0.6395 => 0.6037, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -5.59% (1.3148 => 1.2413, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.59% (4.8802 => 4.6075, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.59% (1.0544 => 0.9955, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.59% (0.6194 => 0.5848, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.57% (0.5567 => 0.5257, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.57% (0.5569 => 0.5259, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.55% (0.6446 => 0.6088, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -5.55% (0.4199 => 0.3966, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.55% (0.3931 => 0.3713, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.54% (0.6736 => 0.6363, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/gs/gs: -5.53% (4.3330 => 4.0934, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.53% (4.0323 => 3.8095, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.52% (0.5688 => 0.5374, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.52% (6.7716 => 6.3979, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.51% (0.6297 => 0.5950, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.51% (4.5069 => 4.2586, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.50% (1.4642 => 1.3836, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.50% (0.2871 => 0.2713, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.49% (0.5941 => 0.5615, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.48% (0.5456 => 0.5157, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: -5.48% (0.3194 => 0.3019, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.48% (0.5570 => 0.5265, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -5.46% (0.3059 => 0.2892, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.46% (0.2933 => 0.2773, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -5.45% (0.3026 => 0.2861, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.45% (1.6364 => 1.5472, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: -5.45% (0.4515 => 0.4269, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -5.44% (0.2939 => 0.2779, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.43% (0.3884 => 0.3673, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -5.43% (0.3446 => 0.3259, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.42% (0.6676 => 0.6314, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.42% (2.1713 => 2.0536, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.40% (0.6033 => 0.5707, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.40% (3.5339 => 3.3431, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.39% (0.6681 => 0.6321, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/strcat: -5.39% (0.2989 => 0.2828, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.38% (0.3252 => 0.3077, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -5.38% (1.3864 => 1.3118, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.37% (0.2903 => 0.2747, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: -5.37% (1.1530 => 1.0911, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: -5.37% (0.3205 => 0.3033, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.36% (0.6440 => 0.6095, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.35% (0.8521 => 0.8065, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.35% (0.6260 => 0.5925, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: -5.33% (0.3394 => 0.3213, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.32% (0.4151 => 0.3930, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.32% (1.2784 => 1.2104, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.30% (0.6189 => 0.5861, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.28% (14.2083 => 13.4581, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.28% (0.7919 => 0.7501, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.28% (0.4813 => 0.4559, std.dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: -5.26% (17.1032 => 16.2040, std.dev.: 0.0248) SingleSource/Benchmarks/Shootout-C++/methcall: -5.26% (0.3025 => 0.2866, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -5.25% (1.1450 => 1.0849, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -5.23% (0.4280 => 0.4056, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -5.23% (0.2849 => 0.2700, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.21% (0.6293 => 0.5965, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -5.20% (0.4861 => 0.4608, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.17% (0.3406 => 0.3230, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -5.14% (0.3581 => 0.3397, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -5.13% (0.2985 => 0.2832, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.10% (0.2548 => 0.2418, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.09% (0.2278 => 0.2162, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.09% (8.0126 => 7.6046, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.09% (0.4916 => 0.4666, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: -5.00% (1.2515 => 1.1889, std.dev.: 0.0030) MultiSource/Applications/d/make_dparser: -5.00% (3.5154 => 3.3396, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary2: -5.00% (0.3481 => 0.3307, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.99% (0.3849 => 0.3657, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -4.97% (0.3621 => 0.3441, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.95% (0.5999 => 0.5702, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.95% (0.2385 => 0.2267, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: -4.95% (15.5079 => 14.7407, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/moments: -4.94% (0.4248 => 0.4038, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.94% (1.2210 => 1.1607, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.94% (0.3323 => 0.3159, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -4.89% (0.3867 => 0.3678, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -4.88% (34.0927 => 32.4298, std.dev.: 0.0092) MultiSource/Applications/ClamAV/clamscan: -4.88% (15.2527 => 14.5090, std.dev.: 0.0206) MultiSource/Benchmarks/McCat/08-main/main: -4.81% (0.2659 => 0.2531, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.80% (1.2221 => 1.1634, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: -4.80% (0.4524 => 0.4307, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -4.79% (0.7447 => 0.7090, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.78% (0.4083 => 0.3888, std.dev.: 0.0007) MultiSource/Applications/lua/lua: -4.76% (4.0594 => 3.8660, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.67% (0.6660 => 0.6349, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.67% (0.2999 => 0.2859, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.66% (0.5168 => 0.4927, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.66% (1.6474 => 1.5707, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: -4.56% (0.3271 => 0.3122, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -4.55% (2.1401 => 2.0427, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: -4.55% (0.7982 => 0.7619, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.54% (0.4427 => 0.4226, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.48% (0.5329 => 0.5090, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.48% (0.6667 => 0.6368, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sieve: -4.46% (0.3788 => 0.3619, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.45% (22.4056 => 21.4089, std.dev.: 0.0210) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.44% (0.9557 => 0.9133, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.42% (0.4321 => 0.4130, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -4.39% (2.4021 => 2.2967, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: -4.38% (18.2933 => 17.4915, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.37% (0.7021 => 0.6714, std.dev.: 0.0085) MultiSource/Applications/oggenc/oggenc: -4.27% (5.0226 => 4.8080, std.dev.: 0.0127) MultiSource/Applications/spiff/spiff: -4.26% (0.8418 => 0.8059, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.22% (0.3319 => 0.3179, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -4.18% (0.6750 => 0.6468, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -3.87% (0.7779 => 0.7478, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.84% (0.3491 => 0.3357, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.83% (1.5610 => 1.5012, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: -3.83% (0.6347 => 0.6104, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.67% (2.2587 => 2.1757, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -3.60% (0.6441 => 0.6209, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.37% (0.9077 => 0.8771, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.98% (5.4682 => 5.3051, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -1.92% (20.7746 => 20.3765, std.dev.: 0.0236) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.56% (1.8100 => 0.6777, std.dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7537, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Misc/richards_benchmark: -8.61% (1.2842 => 1.1736) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.96% (2.2633 => 2.1737, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4002, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.77% (1.3096 => 1.2864, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.66% (6.5735 => 6.4646, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 13:53:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 15:53:16 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121130215316.6CDE72A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/6430?compare_to=6427&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6430, Order: 169027, Start Time: 2012-11-30 20:17:03, End Time: 2012-11-30 21:53:52 To: 6427, Order: 169018, Start Time: 2012-11-30 18:17:03, End Time: 2012-11-30 19:57:31 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 4 (75 on baseline) Performance Improvements: 17 (32 on baseline) Added Tests: 0 (51 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1032 (867 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.23% (0.8898 => 0.9096, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: 15.80% (44.3319 => 51.3354, std.dev.: 0.6666) SingleSource/Benchmarks/Misc/whetstone: 1.48% (2.2020 => 2.2346, std.dev.: 0.0104) MultiSource/Benchmarks/BitBench/five11/five11: 1.29% (5.6385 => 5.7111, std.dev.: 0.0153) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -8.50% (0.9938 => 0.9093, std.dev.: 0.0232) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.23% (0.2321 => 0.2130, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.01% (0.9269 => 0.8712, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.42% (0.2564 => 0.2425, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.41% (0.8977 => 0.8581, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.85% (0.3664 => 0.3523, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -3.54% (4.8297 => 4.6586, std.dev.: 0.0435) MultiSource/Benchmarks/McCat/09-vor/vor: -3.24% (0.3396 => 0.3286, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.82% (0.4638 => 0.4507, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.23% (0.8919 => 0.8720, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel24: -62.61% (0.4867 => 0.1820, std.dev.: 0.0553) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -16.59% (0.0639 => 0.0533, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.97% (0.1722 => 0.1602, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.26% (1.3893 => 1.3440, std.dev.: 0.0151) MultiSource/Benchmarks/Ptrdist/ks/ks: -2.79% (1.1844 => 1.1514, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.80% (0.6329 => 0.6215, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/fib2: -1.16% (4.3636 => 4.3132, std.dev.: 0.0061) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.18% (1.0847 => 1.0866, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.64% (0.3726 => 0.3702, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.90% (0.0222 => 0.0220, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0427 => 0.0428, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.48% (0.0337 => 0.0332, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0315 => 0.0314, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.17% (0.0429 => 0.0424, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: -0.97% (0.0207 => 0.0205, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/test1: 0.46% (0.0219 => 0.0220, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -0.61% (0.1487 => 0.1478, std.dev.: 0.0186) MultiSource/Applications/lemon/lemon: -11.13% (1.2503 => 1.1111, std.dev.: 0.2582) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.23% (0.4063 => 0.4013, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.58% (0.1506 => 0.1422, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.00% (0.0673 => 0.0599, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.51% (0.0293 => 0.0271, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.84% (0.0646 => 0.0576, std.dev.: 0.0151) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.01% (1.1563 => 1.1564, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -76.67% (0.0030 => 0.0007, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.53% (0.0586 => 0.0536, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -24.34% (0.0267 => 0.0202, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.80% (0.8114 => 0.8049, std.dev.: 0.0164) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -56.19% (0.0105 => 0.0046, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.10% (8.6156 => 8.6070, std.dev.: 0.0106) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 9.00% (16.4461 => 17.9264, std.dev.: 0.4450) MultiSource/Applications/sqlite3/sqlite3: 2351.44% (0.6332 => 15.5225, std.dev.: 0.5758) MultiSource/Benchmarks/McCat/08-main/main: 50.41% (0.1831 => 0.2754, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.32% (0.1559 => 0.1476, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7167.53% (0.3123 => 22.6965, std.dev.: 0.4740) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1543.18% (0.3344 => 5.4948, std.dev.: 0.2833) SingleSource/Benchmarks/Misc-C++/Large/ray: 42.60% (0.2364 => 0.3371, std.dev.: 0.0399) SingleSource/Benchmarks/Misc-C++/bigfib: 5.86% (0.6010 => 0.6362, std.dev.: 0.0547) SingleSource/Benchmarks/Misc/mandel: 3.73% (0.0429 => 0.0445, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.96% (0.3266 => 0.3428, std.dev.: 0.0803) SingleSource/Benchmarks/Shootout-C++/strcat: 4.16% (0.1969 => 0.2051, std.dev.: 0.0039) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.23% (0.0224 => 0.0229, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0515, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 7.11% (0.1462 => 0.1566, std.dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4105, std.dev.: 0.0458) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0689, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4889, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5175, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2726, std.dev.: 0.0625) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0804, std.dev.: 0.1355) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3625, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3840, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0809, std.dev.: 0.0038) SingleSource/Regression/C/uint64_to_float: -29.91% (2.1832 => 1.5301, std.dev.: 0.0038) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.63% (0.0810 => 0.0969, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: 18.53% (0.1112 => 0.1318, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.44% (0.0848 => 0.0962, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.77% (0.0830 => 0.0936, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.69% (0.1466 => 0.1608, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.31% (0.8321 => 0.9096, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.21% (0.4127 => 0.4507, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/04-bisect/bisect: 8.97% (0.1137 => 0.1239, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: 8.68% (0.3226 => 0.3506, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.26% (0.2240 => 0.2425, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.07% (0.2279 => 0.2463, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.98% (0.1905 => 0.2057, std.dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: 7.67% (8.4179 => 9.0634, std.dev.: 0.1184) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.61% (0.7473 => 0.8042, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.01% (0.9435 => 1.0096, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.92% (0.3295 => 0.3523, std.dev.: 0.0052) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.73% (0.3137 => 0.3348, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.66% (0.6010 => 0.6410, std.dev.: 0.0102) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.20% (0.1983 => 0.2106, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.88% (0.8148 => 0.8627, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/football/football: 5.86% (0.8768 => 0.9282, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.66% (0.3003 => 0.3173, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.56% (0.8261 => 0.8720, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.50% (0.8066 => 0.8510, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 5.40% (0.8316 => 0.8765, std.dev.: 0.0169) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.36% (1.2526 => 1.3197, std.dev.: 0.0147) MultiSource/Benchmarks/nbench/nbench: 5.29% (1.1271 => 1.1867, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.96% (1.1606 => 1.2182, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 4.94% (0.8177 => 0.8581, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.77% (0.6227 => 0.6524, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.52% (0.5817 => 0.6080, std.dev.: 0.0083) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.38% (0.2741 => 0.2861, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.30% (0.3717 => 0.3877, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 4.22% (0.8359 => 0.8712, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/18-imp/imp: 3.11% (0.3503 => 0.3612, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 3.07% (0.4397 => 0.4532, std.dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.69% (6.6074 => 6.7852, std.dev.: 0.0596) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 198.27% (28.5821 => 85.2514, std.dev.: 0.1115) SingleSource/Benchmarks/Misc/pi: 39.38% (1.5795 => 2.2015, std.dev.: 0.0439) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 28.09% (2.9096 => 3.7269, std.dev.: 0.0774) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.44% (4.8436 => 5.8820, std.dev.: 0.1808) SingleSource/Benchmarks/McGill/misr: 18.37% (0.4001 => 0.4736, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.84% (0.7597 => 0.8952, std.dev.: 0.0285) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 16.98% (8.2783 => 9.6843, std.dev.: 0.0409) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 12.76% (2.7995 => 3.1568, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.01% (6.3772 => 7.0794, std.dev.: 0.0550) MultiSource/Applications/lambda-0_1_3/lambda: 10.25% (7.4933 => 8.2615, std.dev.: 0.0791) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 9.56% (1.1857 => 1.2990, std.dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.36% (23.5781 => 25.3126, std.dev.: 0.0306) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.22% (3.9917 => 4.2798, std.dev.: 0.0784) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.85% (3.3761 => 3.6075, std.dev.: 0.0531) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.01% (2.9753 => 3.1541, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.95% (4.8660 => 5.1553, std.dev.: 0.0403) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.91% (4.5327 => 4.8006, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.57% (5.4187 => 5.7203, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.34% (5.3218 => 5.6060, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/whetstone: 5.29% (2.1224 => 2.2346, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.08% (0.3937 => 0.4137, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 5.01% (0.4353 => 0.4571, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.49% (0.5214 => 0.5448, std.dev.: 0.0015) MultiSource/Applications/aha/aha: 4.47% (3.3398 => 3.4892, std.dev.: 0.0131) SingleSource/Benchmarks/Dhrystone/dry: 3.60% (0.5081 => 0.5264, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.53% (4.8362 => 5.0069, std.dev.: 0.0289) MultiSource/Applications/JM/lencod/lencod: 2.99% (6.7064 => 6.9068, std.dev.: 0.0706) MultiSource/Benchmarks/Olden/power/power: 2.94% (1.2061 => 1.2415, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.39% (3.4104 => 3.4919, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: 2.09% (3.8206 => 3.9003, std.dev.: 0.0055) MultiSource/Benchmarks/BitBench/five11/five11: 1.93% (5.6030 => 5.7111, std.dev.: 0.0153) MultiSource/Benchmarks/Olden/bh/bh: 1.82% (2.3560 => 2.3988, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.75% (11.5690 => 11.7714, std.dev.: 0.0200) MultiSource/Applications/spiff/spiff: 1.55% (2.8561 => 2.9003, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/ReedSolomon: 1.38% (8.5322 => 8.6500, std.dev.: 0.0390) SingleSource/Benchmarks/Misc/flops-7: 1.18% (1.7156 => 1.7359, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/mandel-text: 1.14% (1.8231 => 1.8439, std.dev.: 0.0068) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.08% (1.9302 => 1.9511, std.dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.16% (2.8951 => 1.6746, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -25.52% (7.2130 => 5.3725, std.dev.: 0.1044) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.75% (1.4529 => 1.1514, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.69% (9.9065 => 8.2535, std.dev.: 0.0196) MultiSource/Benchmarks/Olden/em3d/em3d: -12.71% (5.4641 => 4.7695, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-8: -9.35% (2.5609 => 2.3214, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: -9.07% (63.1822 => 57.4532, std.dev.: 0.0972) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.38% (0.3269 => 0.2995, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.13% (1.0512 => 0.9657, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/FloatMM: -6.35% (0.8807 => 0.8248, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.21% (4.7482 => 4.4532, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout/sieve: -6.13% (7.0599 => 6.6274, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/flops: -5.36% (9.3748 => 8.8722, std.dev.: 0.0408) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.28% (6.2275 => 5.8985, std.dev.: 0.0072) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.90% (2.8773 => 2.7362, std.dev.: 0.0396) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.53% (4.7449 => 4.5300, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.52% (6.1706 => 5.8916, std.dev.: 0.0617) SingleSource/Benchmarks/Misc/ffbench: -4.05% (1.4296 => 1.3717, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.99% (4.9453 => 4.7479, std.dev.: 0.0199) MultiSource/Applications/lua/lua: -3.92% (29.8330 => 28.6628, std.dev.: 0.3343) SingleSource/Benchmarks/Misc/perlin: -3.67% (5.1084 => 4.9208, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/methcall: -3.67% (8.9760 => 8.6470, std.dev.: 0.0498) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.35% (4.9686 => 4.8020, std.dev.: 0.0613) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.18% (1.3882 => 1.3440, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.11% (5.4300 => 5.2611, std.dev.: 0.0339) SingleSource/Benchmarks/Dhrystone/fldry: -2.19% (0.6910 => 0.6759, std.dev.: 0.0038) MultiSource/Applications/siod/siod: -2.17% (3.6643 => 3.5848, std.dev.: 0.0182) SingleSource/Benchmarks/Misc/flops-5: -2.05% (2.8957 => 2.8362, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -1.84% (0.5807 => 0.5700, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -1.51% (15.8853 => 15.6456, std.dev.: 0.0347) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.19% (4.2466 => 4.1959, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.14% (4.7794 => 4.7249, std.dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 5.89% (1.0262 => 1.0866, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.30% (0.2463 => 0.3702, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/test1: 22.22% (0.0180 => 0.0220, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 2.78% (0.1438 => 0.1478, std.dev.: 0.0186) MultiSource/Applications/lemon/lemon: -1.92% (1.1329 => 1.1111, std.dev.: 0.2582) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.63% (0.4164 => 0.4013, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.87% (0.1369 => 0.1422, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.55% (0.0641 => 0.0599, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 38.97% (0.0195 => 0.0271, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.35% (0.0578 => 0.0576, std.dev.: 0.0151) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.11% (1.1437 => 1.1564, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 600.00% (0.0001 => 0.0007, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.51% (0.0627 => 0.0536, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 12.22% (0.0180 => 0.0202, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.40% (0.8017 => 0.8049, std.dev.: 0.0164) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.81% (0.0062 => 0.0046, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 14:56:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 16:56:57 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121130225657.6B4FC2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/6431?compare_to=6425&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6431, Order: 169020, Start Time: 2012-11-30 19:26:43, End Time: 2012-11-30 22:56:40 To: 6425, Order: 169001, Start Time: 2012-11-30 15:08:05, End Time: 2012-11-30 18:38:17 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (180 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (186 on baseline) Unchanged Tests: 1089 (710 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.85% (0.5879 => 0.5988, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 1.35% (1.9872 => 2.0141, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.23% (1.5641 => 1.5833, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 4.19% (2.0312 => 2.1164, std.dev.: 0.0075) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -4.22% (131.6977 => 126.1351, std.dev.: 1.3480) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 44.00% (0.0625 => 0.0900, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.34% (0.1063 => 0.1428, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.12% (0.1106 => 0.1406, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.98% (0.2969 => 0.3770, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.50% (0.4139 => 0.5236, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.47% (0.0714 => 0.0903, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 26.42% (1.5932 => 2.0141, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.61% (0.4994 => 0.6273, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 25.44% (0.0452 => 0.0567, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 25.20% (0.1107 => 0.1386, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.12% (0.5900 => 0.7382, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.86% (0.5000 => 0.6243, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.76% (0.4253 => 0.5306, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.63% (0.0475 => 0.0592, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.58% (0.0415 => 0.0517, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.14% (0.0584 => 0.0725, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.95% (0.0547 => 0.0678, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.70% (0.1021 => 0.1263) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.58% (0.1620 => 0.2002, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.39% (0.1103 => 0.1361, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 22.87% (0.0599 => 0.0736, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.85% (0.0897 => 0.1102, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.44% (0.1604 => 0.1964, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.27% (0.0633 => 0.0774, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.12% (0.0642 => 0.0784, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.09% (0.0584 => 0.0713, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.00% (0.0541 => 0.0660, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 21.84% (0.0948 => 0.1155, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.41% (0.0495 => 0.0601, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.34% (0.3903 => 0.4736, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 21.31% (0.1619 => 0.1964, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.24% (0.1549 => 0.1878, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.14% (0.1003 => 0.1215, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 21.07% (0.0821 => 0.0994, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.05% (0.0822 => 0.0995, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 20.86% (0.0604 => 0.0730, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.38% (1.3152 => 1.5833, std.dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 20.38% (0.0947 => 0.1140, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 20.17% (0.0808 => 0.0971, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.04% (0.1462 => 0.1755, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.86% (0.2014 => 0.2414, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.77% (0.3890 => 0.4659, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 19.38% (0.1218 => 0.1454, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 19.28% (0.5826 => 0.6949, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.21% (0.1968 => 0.2346, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 19.14% (0.5026 => 0.5988, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.01% (0.2736 => 0.3256, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 18.99% (0.4029 => 0.4794, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 18.87% (0.5889 => 0.7000, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.84% (0.0605 => 0.0719, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 18.77% (0.0698 => 0.0829, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.75% (0.1088 => 0.1292, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 18.74% (0.1505 => 0.1787, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.63% (3.5627 => 4.2263, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.56% (0.2866 => 0.3398, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.53% (0.0572 => 0.0678) MultiSource/Applications/hbd/hbd: 18.43% (0.9697 => 1.1484, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 18.42% (1.8794 => 2.2255, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 18.36% (0.5546 => 0.6564, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.32% (0.0573 => 0.0678, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.31% (1.6211 => 1.9180, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 18.06% (1.0781 => 1.2728, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.78% (0.4658 => 0.5486, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.74% (0.3930 => 0.4627, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 17.61% (0.7171 => 0.8434, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.59% (0.1160 => 0.1364, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.59% (4.4195 => 5.1967, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.55% (0.3271 => 0.3845, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 17.52% (0.1421 => 0.1670, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.48% (2.7292 => 3.2063, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.38% (0.4361 => 0.5119, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.29% (0.2875 => 0.3372, std.dev.: 0.0044) MultiSource/Applications/ClamAV/clamscan: 17.08% (4.2109 => 4.9302, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hello: 17.06% (0.2714 => 0.3177, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.04% (0.2729 => 0.3194, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 17.03% (0.2725 => 0.3189, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.02% (0.2738 => 0.3204, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 16.98% (0.2780 => 0.3252, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.88% (2.0673 => 2.4163, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.83% (0.2792 => 0.3262, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 16.72% (0.2811 => 0.3281, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 16.67% (0.1284 => 0.1498, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.66% (0.2911 => 0.3396, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 16.66% (0.2803 => 0.3270, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.65% (0.3195 => 0.3727, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.65% (1.9694 => 2.2973, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/strcat: 16.62% (0.2750 => 0.3207, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.61% (0.1090 => 0.1271, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 16.53% (0.9909 => 1.1547, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 16.53% (0.2813 => 0.3278, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 16.51% (0.2823 => 0.3289, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 16.51% (0.3096 => 0.3607, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 16.44% (0.3004 => 0.3498, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.44% (1.9966 => 2.3249, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.41% (0.3060 => 0.3562, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 16.19% (0.2075 => 0.2411, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 15.89% (0.3267 => 0.3786, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 15.82% (0.3446 => 0.3991, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 15.75% (0.3460 => 0.4005, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 15.75% (0.3258 => 0.3771, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.74% (0.3488 => 0.4037, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 15.70% (0.3465 => 0.4009, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 15.65% (0.3317 => 0.3836, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 15.64% (23.5202 => 27.1986, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/for-in: 15.62% (0.3496 => 0.4042, std.dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 15.59% (0.2566 => 0.2966, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 15.57% (0.3442 => 0.3978, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 15.57% (0.3469 => 0.4009, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.47% (0.3362 => 0.3882, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.36% (0.3124 => 0.3604, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.36% (0.3282 => 0.3786, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 15.29% (0.3650 => 0.4208, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 15.21% (0.3643 => 0.4197, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 15.12% (1.4269 => 1.6426, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/moments: 15.09% (0.3678 => 0.4233, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 15.05% (0.3348 => 0.3852, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 15.04% (0.0758 => 0.0872, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 15.04% (0.3724 => 0.4284, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 15.03% (0.3726 => 0.4286, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 14.98% (2.1653 => 2.4896, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 14.81% (0.3477 => 0.3992, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 14.81% (0.7875 => 0.9041, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.76% (0.3625 => 0.4160, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.71% (0.2040 => 0.2340, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 14.66% (0.4146 => 0.4754, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 14.63% (0.4251 => 0.4873, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 14.58% (4.6177 => 5.2910, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.53% (0.3690 => 0.4226, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 14.52% (2.1013 => 2.4065, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.49% (0.3981 => 0.4558, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.36% (0.3845 => 0.4397, std.dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 14.05% (0.2691 => 0.3069, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 13.67% (0.5012 => 0.5697, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.16% (0.1383 => 0.1565, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 12.58% (5.5417 => 6.2390, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.57% (0.6435 => 0.7244, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.33% (0.2068 => 0.2323, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 11.92% (0.3498 => 0.3915, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.77% (0.1028 => 0.1149, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 11.74% (0.6634 => 0.7413, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.33% (0.2737 => 0.3047, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 11.25% (2.0346 => 2.2634, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 11.24% (0.3336 => 0.3711, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 11.17% (0.2391 => 0.2658, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 11.16% (0.4847 => 0.5388, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.93% (0.3084 => 0.3421, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.08% (0.2103 => 0.2315, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.21% (0.5361 => 0.5855, std.dev.: 0.0069) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.10% (11.6398 => 12.6995, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.62% (4.6926 => 5.0969, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.40% (0.5584 => 0.6053, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.17% (0.7426 => 0.8033, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 7.33% (11.9555 => 12.8323, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.14% (0.3792 => 0.4025, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.93% (29.0505 => 181.5446, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.49% (0.2802 => 0.3068, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6108, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6744, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.87% (0.3693 => 0.3873, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1659, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-2: 4.62% (1.8057 => 1.8891, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.60% (79.9355 => 83.6114, std.dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/dry: 4.21% (14.0481 => 14.6390, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/health/health: 2.79% (0.6276 => 0.6451, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1962, std.dev.: 0.0070) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2251, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.65% (2.0820 => 2.1164, std.dev.: 0.0075) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3041, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2895, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.37% (1.0927 => 1.1077, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5128, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5792, std.dev.: 0.0206) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.30% (2.4764 => 2.4194, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.91% (25.4195 => 16.5465, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary2: -9.28% (0.2402 => 0.2179, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9790, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7951, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8030, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.13% (0.6293 => 0.6096, std.dev.: 0.0054) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7729, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.58% (17.2379 => 16.7928, std.dev.: 0.0504) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.26% (41.7953 => 40.8526, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5797, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4957, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.08% (105.3826 => 104.2471, std.dev.: 0.0347) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0455, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 3.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 15:29:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 17:29:06 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121130232906.084AE2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/6432?compare_to=6429&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6432, Order: 169037, Start Time: 2012-11-30 21:54:40, End Time: 2012-11-30 23:29:41 To: 6429, Order: 169027, Start Time: 2012-11-30 19:56:45, End Time: 2012-11-30 21:31:43 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (182 on baseline) Added Tests: 0 (52 on baseline) Unchanged Tests: 1093 (854 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 6.29% (0.4262 => 0.4530, std.dev.: 0.0024) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 18.15% (0.3834 => 0.4530, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 74.91% (31.3723 => 54.8736, std.dev.: 0.0257) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.16% (2.0478 => 2.1125, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: 2.56% (7.4937 => 7.6858, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/hash2: 2.29% (3.1932 => 3.2663, std.dev.: 0.0099) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.26% (0.9542 => 0.8849, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.17% (0.3821 => 0.3547, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.62% (2.4924 => 2.3274, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: -6.52% (0.3357 => 0.3138, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.43% (0.3142 => 0.2940, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.22% (0.2428 => 0.2277, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.97% (0.5591 => 0.5257, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.97% (0.5478 => 0.5151, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.88% (0.5802 => 0.5461, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.86% (0.6484 => 0.6104, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.86% (0.5805 => 0.5465, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.85% (0.3658 => 0.3444, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -5.83% (0.2160 => 0.2034, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -5.82% (0.3831 => 0.3608, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.82% (0.3884 => 0.3658, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.82% (0.5863 => 0.5522, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.81% (0.5857 => 0.5517, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -5.79% (0.1761 => 0.1659, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -5.78% (7.0961 => 6.6857, std.dev.: 0.0114) SingleSource/UnitTests/ObjC/trivial-interface: -5.77% (0.3812 => 0.3592, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -5.76% (16.1920 => 15.2587, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/football/football: -5.75% (0.9179 => 0.8651, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/synchronized: -5.75% (0.3896 => 0.3672, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -5.75% (0.3880 => 0.3657, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.75% (0.6230 => 0.5872, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.72% (0.5859 => 0.5524, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: -5.72% (0.3848 => 0.3628, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.71% (0.6395 => 0.6030, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.70% (0.5925 => 0.5587, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.70% (0.5575 => 0.5257, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.68% (0.6304 => 0.5946, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -5.68% (9.2283 => 8.7043, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.68% (0.5849 => 0.5517, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.66% (1.3722 => 1.2945, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.66% (0.5705 => 0.5382, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -5.65% (0.4176 => 0.3940, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.62% (0.7524 => 0.7101, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.61% (0.5581 => 0.5268, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: -5.60% (0.4033 => 0.3807, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.60% (0.3891 => 0.3673, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.60% (0.6052 => 0.5713, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.59% (0.6194 => 0.5848, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.57% (0.5570 => 0.5260, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.56% (0.9852 => 0.9304, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.55% (1.0544 => 0.9959, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.53% (0.2695 => 0.2546, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.52% (0.2355 => 0.2225, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.52% (0.6395 => 0.6042, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.50% (0.3057 => 0.2889, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.49% (0.3931 => 0.3715, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.48% (1.2300 => 1.1626, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.48% (0.5569 => 0.5264, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.47% (0.3837 => 0.3627, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.47% (0.3255 => 0.3077, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.45% (0.6297 => 0.5954, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.44% (0.5456 => 0.5159, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.42% (0.6676 => 0.6314, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.42% (0.5941 => 0.5619, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.41% (0.7339 => 0.6942, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.40% (0.6736 => 0.6372, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.40% (1.4642 => 1.3851, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.40% (0.6446 => 0.6098, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.40% (0.5688 => 0.5381, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.39% (4.8161 => 4.5564, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: -5.39% (0.3025 => 0.2862, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.39% (3.5339 => 3.3435, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/gs/gs: -5.38% (4.3330 => 4.0997, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: -5.37% (1.3148 => 1.2442, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.37% (4.0323 => 3.8159, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.34% (0.7919 => 0.7496, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: -5.33% (0.4199 => 0.3975, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.32% (0.6033 => 0.5712, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.31% (0.6440 => 0.6098, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.31% (1.6364 => 1.5495, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.30% (0.6260 => 0.5928, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.30% (0.6189 => 0.5861, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.30% (0.5567 => 0.5272, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.29% (2.1713 => 2.0564, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.28% (0.2933 => 0.2778, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.28% (4.8802 => 4.6223, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.28% (4.5069 => 4.2689, std.dev.: 0.0582) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.28% (0.6293 => 0.5961, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.27% (0.6681 => 0.6329, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.26% (0.3252 => 0.3081, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -5.25% (0.4515 => 0.4278, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.25% (1.2784 => 1.2113, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.24% (6.7716 => 6.4166, std.dev.: 0.0545) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.24% (0.3323 => 0.3149, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: -5.23% (0.3059 => 0.2899, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/objinst: -5.23% (0.3194 => 0.3027, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.23% (0.4151 => 0.3934, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.22% (0.2871 => 0.2721, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: -5.22% (0.3026 => 0.2868, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.19% (14.2083 => 13.4707, std.dev.: 0.0147) MultiSource/Applications/lemon/lemon: -5.19% (1.1450 => 1.0856, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: -5.19% (0.2989 => 0.2834, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.18% (0.7198 => 0.6825, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: -5.16% (1.1530 => 1.0935, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -5.15% (0.3205 => 0.3040, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.14% (0.3016 => 0.2861, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: -5.14% (0.2939 => 0.2788, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -5.14% (17.1032 => 16.2245, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.13% (0.2903 => 0.2754, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -5.13% (0.3394 => 0.3220, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -5.12% (0.4280 => 0.4061, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.11% (0.8521 => 0.8086, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.10% (0.2548 => 0.2418, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -5.08% (0.3481 => 0.3304, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.08% (0.3406 => 0.3233, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -5.07% (1.3864 => 1.3161, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.07% (0.4813 => 0.4569, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.07% (0.4321 => 0.4102, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.07% (0.4916 => 0.4667, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/bh/bh: -5.06% (0.2985 => 0.2834, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: -5.05% (0.2849 => 0.2705, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.00% (0.3483 => 0.3309, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.97% (0.5999 => 0.5701, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -4.94% (1.2515 => 1.1897, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/ary3: -4.90% (0.3446 => 0.3277, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/moments: -4.85% (0.4248 => 0.4042, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: -4.83% (0.3581 => 0.3408, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.83% (0.2278 => 0.2168, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.83% (1.2221 => 1.1631, std.dev.: 0.0024) MultiSource/Applications/d/make_dparser: -4.82% (3.5154 => 3.3461, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.80% (8.0126 => 7.6279, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.79% (1.2210 => 1.1625, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -4.75% (15.2527 => 14.5283, std.dev.: 0.0181) MultiSource/Applications/minisat/minisat: -4.74% (0.7447 => 0.7094, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.74% (0.2385 => 0.2272, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -4.73% (15.5079 => 14.7741, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/lists: -4.72% (0.3621 => 0.3450, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -4.69% (0.7982 => 0.7608, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists1: -4.68% (0.3867 => 0.3686, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -4.67% (34.0927 => 32.4999, std.dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/hash2: -4.67% (0.4861 => 0.4634, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.67% (0.2999 => 0.2859, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.62% (0.6660 => 0.6352, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.61% (1.6474 => 1.5715, std.dev.: 0.0015) MultiSource/Applications/lua/lua: -4.59% (4.0594 => 3.8732, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.56% (0.6667 => 0.6363, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.51% (0.4083 => 0.3899, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -4.40% (5.0226 => 4.8016, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.38% (0.4427 => 0.4233, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -4.34% (2.1401 => 2.0473, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: -4.32% (0.2659 => 0.2544, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: -4.30% (0.3788 => 0.3625, std.dev.: 0.0047) MultiSource/Applications/kimwitu++/kc: -4.26% (18.2933 => 17.5148, std.dev.: 0.0360) MultiSource/Applications/siod/siod: -4.25% (2.4021 => 2.3001, std.dev.: 0.0048) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.22% (0.3319 => 0.3179, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -4.16% (0.4524 => 0.4336, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -4.10% (0.6750 => 0.6473, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.10% (22.4056 => 21.4875, std.dev.: 0.0168) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.09% (0.9557 => 0.9166, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -4.07% (0.3271 => 0.3138, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.05% (0.7021 => 0.6737, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.03% (0.5329 => 0.5114, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.01% (0.5168 => 0.4961, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -3.94% (0.8418 => 0.8086, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.81% (0.9077 => 0.8731, std.dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference: -3.73% (0.7779 => 0.7489, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: -3.70% (0.6347 => 0.6112, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.66% (2.2587 => 2.1761, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -3.57% (1.5610 => 1.5052, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference-object: -3.56% (0.6441 => 0.6212, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.47% (0.3491 => 0.3370, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.72% (5.4682 => 5.3197, std.dev.: 0.0055) SingleSource/UnitTests/Vector/constpool: -1.87% (20.7746 => 20.3858, std.dev.: 0.0196) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.09% (1.8100 => 0.6861, std.dev.: 0.0255) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7546, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1729, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.84% (1.7753 => 1.7071, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: -3.84% (2.2633 => 2.1765, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3999, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4737, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 15:56:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 17:56:16 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121130235616.2982E2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/6433?compare_to=6430&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6433, Order: 169041, Start Time: 2012-11-30 22:13:31, End Time: 2012-11-30 23:56:52 To: 6430, Order: 169027, Start Time: 2012-11-30 20:17:03, End Time: 2012-11-30 21:53:52 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 34 (78 on baseline) Performance Improvements: 1 (31 on baseline) Added Tests: 0 (51 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1018 (865 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/PR491: 85.50% (0.0131 => 0.0243, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/almabench: 65.38% (0.0702 => 0.1161, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 63.79% (0.0486 => 0.0796, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-7: 58.16% (0.0282 => 0.0446, std.dev.: 0.0007) SingleSource/Benchmarks/LivermoreLoops/kernel22: 56.74% (0.1038 => 0.1627, std.dev.: 0.0084) SingleSource/Benchmarks/LivermoreLoops/kernel23: 52.74% (0.1130 => 0.1726, std.dev.: 0.0105) SingleSource/Benchmarks/LivermoreLoops/kernel17: 44.78% (0.1025 => 0.1484, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/dt: 38.35% (0.0339 => 0.0469, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.84% (8.9072 => 10.6747, std.dev.: 0.2337) MultiSource/Applications/hbd/hbd: 17.02% (1.4681 => 1.7180, std.dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.87% (3.3773 => 3.7106, std.dev.: 0.0323) MultiSource/Applications/kimwitu++/kc: 9.32% (17.9264 => 19.5975, std.dev.: 0.1426) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 8.28% (0.8492 => 0.9195, std.dev.: 0.0253) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.88% (0.1993 => 0.2150, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.72% (5.4948 => 5.9192, std.dev.: 0.0448) MultiSource/Applications/sqlite3/sqlite3: 6.86% (15.5225 => 16.5869, std.dev.: 0.3932) SingleSource/Benchmarks/Shootout-C++/except: 6.18% (0.2089 => 0.2218, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.89% (1.0150 => 1.0748, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 5.54% (0.8765 => 0.9251, std.dev.: 0.0138) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.29% (1.1481 => 1.2088, std.dev.: 0.0129) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel24: 101.65% (0.1820 => 0.3670, std.dev.: 0.0387) SingleSource/Benchmarks/LivermoreLoops/kernel10: 38.31% (0.0744 => 0.1029, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/lpbench: 21.01% (4.1207 => 4.9865, std.dev.: 0.2606) MultiSource/Applications/minisat/minisat: 20.61% (6.2783 => 7.5721, std.dev.: 0.4145) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.77% (2.5961 => 3.0055, std.dev.: 0.0848) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 9.39% (43.8904 => 48.0128, std.dev.: 1.3628) MultiSource/Benchmarks/Bullet/bullet: 6.69% (7.1536 => 7.6321, std.dev.: 0.0315) MultiSource/Applications/lua/lua: 5.54% (28.6628 => 30.2508, std.dev.: 0.1665) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.68% (16.1797 => 16.9370, std.dev.: 0.1700) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.36% (39.3759 => 40.3053, std.dev.: 0.1707) MultiSource/Applications/SIBsim4/SIBsim4: 2.20% (3.1892 => 3.2594, std.dev.: 0.0246) MultiSource/Benchmarks/FreeBench/mason/mason: 2.00% (0.5353 => 0.5460, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.66% (4.4105 => 4.4838, std.dev.: 0.0223) SingleSource/Benchmarks/Shootout/lists: 1.04% (7.3481 => 7.4246, std.dev.: 0.0202) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.12% (5.4214 => 5.3609, std.dev.: 0.0095) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 24.74% (1.0866 => 1.3554, std.dev.: 0.1175) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.78% (0.3702 => 0.3990, std.dev.: 0.0585) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.45% (0.0220 => 0.0219, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -10.75% (0.0428 => 0.0382, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0332 => 0.0333, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.27% (0.0314 => 0.0318, std.dev.: 0.0083) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -8.25% (0.0424 => 0.0389, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0205 => 0.0204, std.dev.: 0.0075) SingleSource/UnitTests/Vector/Altivec/test1: -0.45% (0.0220 => 0.0219, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/Burg/burg: 1300.00% (0.0001 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.17% (0.1478 => 0.1510, std.dev.: 0.0106) MultiSource/Applications/lemon/lemon: 9.27% (1.1111 => 1.2141, std.dev.: 0.3697) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 11.34% (0.4013 => 0.4468, std.dev.: 0.0539) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.63% (0.1422 => 0.1630, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.19% (0.0599 => 0.0666, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.58% (0.0271 => 0.0278, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.74% (0.0576 => 0.0586, std.dev.: 0.0151) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.53% (1.1564 => 1.1503, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 328.57% (0.0007 => 0.0030, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.06% (0.0536 => 0.0606, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 28.22% (0.0202 => 0.0259, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.14% (0.8049 => 0.8038, std.dev.: 0.0480) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 54.35% (0.0046 => 0.0071, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.15% (8.6070 => 8.6195, std.dev.: 0.0418) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 19.16% (16.4461 => 19.5975, std.dev.: 0.1426) MultiSource/Applications/sqlite3/sqlite3: 2519.54% (0.6332 => 16.5869, std.dev.: 0.3932) MultiSource/Benchmarks/McCat/08-main/main: 53.19% (0.1831 => 0.2805, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.49% (0.1559 => 0.1489, std.dev.: 0.0337) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7602.59% (0.3123 => 24.0552, std.dev.: 0.7287) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1670.10% (0.3344 => 5.9192, std.dev.: 0.0448) SingleSource/Benchmarks/Misc-C++/Large/ray: 41.37% (0.2364 => 0.3342, std.dev.: 0.0654) SingleSource/Benchmarks/Misc-C++/bigfib: 7.05% (0.6010 => 0.6434, std.dev.: 0.0248) SingleSource/Benchmarks/Misc/mandel: 11.42% (0.0429 => 0.0478, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.49% (0.3266 => 0.3478, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/strcat: 9.80% (0.1969 => 0.2162, std.dev.: 0.0409) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.59% (0.0224 => 0.0241, std.dev.: 0.0054) SingleSource/UnitTests/byval-alignment: -24.78% (0.0230 => 0.0173, std.dev.: 0.0059) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0520, std.dev.: 0.0038) MultiSource/Applications/oggenc/oggenc: 15.39% (0.1462 => 0.1687, std.dev.: 0.0221) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4838, std.dev.: 0.0223) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0686, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4968, std.dev.: 0.0537) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5287, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3214, std.dev.: 0.0215) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0810, std.dev.: 0.0425) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3631, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3929, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0798, std.dev.: 0.0417) SingleSource/Regression/C/uint64_to_float: -29.09% (2.1832 => 1.5480, std.dev.: 0.0176) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 98.15% (0.0108 => 0.0214, std.dev.: 0.0003) SingleSource/UnitTests/conditional-gnu-ext-cxx: 95.24% (0.0126 => 0.0246, std.dev.: 0.0016) SingleSource/Regression/C/PR491: 94.40% (0.0125 => 0.0243, std.dev.: 0.0041) SingleSource/Regression/C/2003-05-22-VarSizeArray: 88.89% (0.0117 => 0.0221, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 74.18% (0.0457 => 0.0796, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-7: 68.94% (0.0264 => 0.0446, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 68.26% (0.0690 => 0.1161, std.dev.: 0.0012) SingleSource/UnitTests/2007-01-04-KNR-Args: 65.43% (0.0162 => 0.0268, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/dt: 50.32% (0.0312 => 0.0469, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 23.44% (8.6476 => 10.6747, std.dev.: 0.2337) MultiSource/Applications/hbd/hbd: 20.40% (1.4269 => 1.7180, std.dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 17.98% (2.1401 => 2.5248, std.dev.: 0.0887) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 16.57% (3.1832 => 3.7106, std.dev.: 0.0323) MultiSource/Benchmarks/mafft/pairlocalalign: 15.05% (8.6247 => 9.9226, std.dev.: 0.4212) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.06% (0.1885 => 0.2150, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 13.95% (0.8069 => 0.9195, std.dev.: 0.0253) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.34% (0.4127 => 0.4595, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.24% (0.8316 => 0.9251, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.94% (0.9688 => 1.0748, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.48% (0.8261 => 0.9127, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.71% (0.8712 => 0.9558, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.92% (0.9074 => 0.9883, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.84% (0.9908 => 1.0784, std.dev.: 0.0246) SingleSource/Benchmarks/Shootout-C++/except: 8.46% (0.2045 => 0.2218, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.22% (1.1170 => 1.2088, std.dev.: 0.0129) SingleSource/Benchmarks/McGill/chomp: 8.12% (0.1565 => 0.1692, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.02% (0.8420 => 0.9095, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.78% (0.8611 => 0.9281, std.dev.: 0.0238) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.36% (0.8331 => 0.8944, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 6.91% (0.8656 => 0.9254, std.dev.: 0.0183) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.15% (0.1756 => 0.1864, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.60% (0.2741 => 0.2867, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 199.05% (28.5821 => 85.4745, std.dev.: 0.5476) MultiSource/Benchmarks/Prolangs-C++/city/city: 56.78% (0.0199 => 0.0312, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/pi: 39.53% (1.5795 => 2.2038, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/heapsort: 32.94% (3.0515 => 4.0567, std.dev.: 0.3443) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 29.60% (2.9096 => 3.7709, std.dev.: 0.0400) SingleSource/Benchmarks/CoyoteBench/lpbench: 27.84% (3.9006 => 4.9865, std.dev.: 0.2606) MultiSource/Applications/minisat/minisat: 23.07% (6.1525 => 7.5721, std.dev.: 0.4145) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.44% (4.8436 => 5.8821, std.dev.: 0.0405) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.94% (8.2783 => 9.7638, std.dev.: 0.0236) SingleSource/Benchmarks/McGill/misr: 17.42% (0.4001 => 0.4698, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.66% (2.5763 => 3.0055, std.dev.: 0.0848) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.05% (0.7597 => 0.8816, std.dev.: 0.0274) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.65% (14.6451 => 16.9370, std.dev.: 0.1700) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.86% (2.7995 => 3.1316, std.dev.: 0.0289) MultiSource/Applications/lambda-0_1_3/lambda: 10.47% (7.4933 => 8.2780, std.dev.: 0.0403) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.28% (6.3772 => 7.0325, std.dev.: 0.1180) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.20% (1.1857 => 1.3067, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.10% (0.1129 => 0.1243, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.86% (3.9917 => 4.3055, std.dev.: 0.1045) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.42% (23.5781 => 25.3270, std.dev.: 0.0459) MultiSource/Benchmarks/Bullet/bullet: 7.22% (7.1181 => 7.6321, std.dev.: 0.0315) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.81% (3.3761 => 3.6061, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.69% (4.5327 => 4.8358, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.26% (2.9753 => 3.1615, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 6.09% (4.8660 => 5.1622, std.dev.: 0.0516) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.67% (5.3218 => 5.6234, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.63% (5.4187 => 5.7238, std.dev.: 0.0248) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.18% (0.3937 => 0.4141, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.74% (0.5214 => 0.5461, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/richards_benchmark: 4.70% (1.3037 => 1.3650, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.36% (59.2638 => 61.8476, std.dev.: 0.6595) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 4.02% (0.4353 => 0.4528, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/whetstone: 3.70% (2.1224 => 2.2010, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.68% (4.8362 => 5.0143, std.dev.: 0.0307) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.30% (0.4031 => 0.4164, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.80% (39.2082 => 40.3053, std.dev.: 0.1707) MultiSource/Applications/SIBsim4/SIBsim4: 2.26% (3.1873 => 3.2594, std.dev.: 0.0246) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.24% (3.4104 => 3.4869, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/ReedSolomon: 1.98% (8.5322 => 8.7008, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.82% (11.5690 => 11.7801, std.dev.: 0.0189) MultiSource/Benchmarks/Olden/bh/bh: 1.78% (2.3560 => 2.3980, std.dev.: 0.0127) MultiSource/Benchmarks/BitBench/five11/five11: 1.77% (5.6030 => 5.7021, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/methcall: 1.54% (8.2676 => 8.3950, std.dev.: 0.0273) MultiSource/Applications/spiff/spiff: 1.24% (2.8561 => 2.8914, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/lists: 1.19% (7.3375 => 7.4246, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.15% (11.5316 => 11.6643, std.dev.: 0.0342) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -39.95% (2.8951 => 1.7385, std.dev.: 0.0373) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -25.38% (7.2130 => 5.3823, std.dev.: 0.0776) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.26% (1.4529 => 1.1586, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.49% (9.9065 => 8.2725, std.dev.: 0.0250) MultiSource/Benchmarks/Olden/em3d/em3d: -12.66% (5.4641 => 4.7725, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: -9.56% (2.5609 => 2.3160, std.dev.: 0.0109) MultiSource/Benchmarks/mafft/pairlocalalign: -8.75% (63.1822 => 57.6565, std.dev.: 0.0561) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.13% (1.0512 => 0.9657, std.dev.: 0.0315) SingleSource/Benchmarks/Stanford/FloatMM: -6.49% (0.8807 => 0.8235, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.12% (4.7482 => 4.4574, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.10% (5.1305 => 4.8176, std.dev.: 0.0518) SingleSource/Benchmarks/Shootout/sieve: -5.52% (7.0599 => 6.6704, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/flops: -5.19% (9.3748 => 8.8887, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.85% (5.6343 => 5.3609, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.43% (4.7449 => 4.5345, std.dev.: 0.0320) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.86% (6.1706 => 5.9327, std.dev.: 0.0348) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.85% (4.9453 => 4.7550, std.dev.: 0.0291) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.68% (3.7148 => 3.5782, std.dev.: 0.0310) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.61% (5.1557 => 4.9697, std.dev.: 0.0378) SingleSource/Benchmarks/Misc/perlin: -3.58% (5.1084 => 4.9253, std.dev.: 0.0572) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.33% (4.9686 => 4.8031, std.dev.: 0.0617) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.18% (5.4300 => 5.2575, std.dev.: 0.0243) SingleSource/Benchmarks/Misc/ffbench: -2.78% (1.4296 => 1.3898, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/fbench: -2.25% (3.3840 => 3.3079, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-5: -1.75% (2.8957 => 2.8451, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.70% (3.3479 => 3.2911, std.dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.41% (1.5308 => 1.5092, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/neural/neural: -1.34% (1.0841 => 1.0696, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -1.19% (15.8853 => 15.6958, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.11% (6.0224 => 5.9555, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.08% (4.7794 => 4.7279, std.dev.: 0.0175) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 32.08% (1.0262 => 1.3554, std.dev.: 0.1175) SingleSource/Benchmarks/CoyoteBench/fftbench: 62.00% (0.2463 => 0.3990, std.dev.: 0.0585) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -6.37% (0.0408 => 0.0382, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.30% (0.0302 => 0.0318, std.dev.: 0.0083) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.30% (0.0384 => 0.0389, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0075) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 100.00% (0.0007 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.01% (0.1438 => 0.1510, std.dev.: 0.0106) MultiSource/Applications/lemon/lemon: 7.17% (1.1329 => 1.2141, std.dev.: 0.3697) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 7.30% (0.4164 => 0.4468, std.dev.: 0.0539) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 19.07% (0.1369 => 0.1630, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.90% (0.0641 => 0.0666, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.56% (0.0195 => 0.0278, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.38% (0.0578 => 0.0586, std.dev.: 0.0151) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.58% (1.1437 => 1.1503, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.35% (0.0627 => 0.0606, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 43.89% (0.0180 => 0.0259, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.26% (0.8017 => 0.8038, std.dev.: 0.0480) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 14.52% (0.0062 => 0.0071, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 16:04:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 18:04:59 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121201000459.F1A3B2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/6434?compare_to=6428&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6434, Order: 169030, Start Time: 2012-11-30 21:39:42, End Time: 2012-12-01 00:05:31 To: 6428, Order: 169002, Start Time: 2012-11-30 18:18:47, End Time: 2012-11-30 20:43:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 82 (220 on baseline) Performance Improvements: 5 (41 on baseline) Added Tests: 0 (186 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1001 (624 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 13.73% (0.6323 => 0.7191, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: 12.31% (0.3127 => 0.3512, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.09% (0.1911 => 0.2142, std.dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: 11.66% (1.3890 => 1.5509, std.dev.: 0.0073) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.61% (0.1903 => 0.2105, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.40% (0.2895 => 0.3196, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.35% (1.4772 => 1.6301, std.dev.: 0.0249) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.93% (0.2407 => 0.2646, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/neural/neural: 9.62% (0.1612 => 0.1767, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.46% (0.2578 => 0.2822, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.44% (0.2415 => 0.2643, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.17% (0.1210 => 0.1321, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 8.82% (3.9359 => 4.2830, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.60% (1.5928 => 1.7298, std.dev.: 0.0234) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.24% (1.8050 => 1.9537, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.01% (4.7104 => 5.0877, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.97% (0.7240 => 0.7817, std.dev.: 0.0209) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.76% (0.1289 => 0.1389, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.23% (2.3628 => 2.5336, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.82% (1.0354 => 1.1060, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.51% (0.5850 => 0.6231, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.03% (6.1472 => 6.5176, std.dev.: 0.0280) SingleSource/Benchmarks/Shootout-C++/moments: 5.88% (0.4473 => 0.4736, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 5.61% (0.6857 => 0.7242, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.57% (0.3107 => 0.3280, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.51% (0.1923 => 0.2029, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.44% (0.3348 => 0.3530, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 5.43% (0.7477 => 0.7883, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 5.19% (0.4063 => 0.4274, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.08% (0.7187 => 0.7552, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: 4.95% (20.0274 => 21.0185, std.dev.: 0.2197) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.94% (0.4456 => 0.4676, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.91% (0.3033 => 0.3182, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 4.70% (0.3129 => 0.3276, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.64% (2.5888 => 2.7090, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4.63% (0.6775 => 0.7089, std.dev.: 0.0111) MultiSource/Benchmarks/McCat/09-vor/vor: 4.59% (0.3814 => 0.3989, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 4.55% (0.6696 => 0.7001, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/ary2: 4.37% (0.3703 => 0.3865, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash: 4.33% (0.4803 => 0.5011, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/bh/bh: 4.20% (0.3598 => 0.3749, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 4.19% (0.3532 => 0.3680, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.19% (0.3007 => 0.3133, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/matrix: 4.18% (0.3375 => 0.3516, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.14% (0.4174 => 0.4347, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.09% (0.5797 => 0.6034, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.08% (0.9511 => 0.9899, std.dev.: 0.0113) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.91% (5.1500 => 5.3516, std.dev.: 0.0511) SingleSource/Benchmarks/Shootout-C++/ary3: 3.91% (0.3585 => 0.3725, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/18-imp/imp: 3.86% (0.4169 => 0.4330, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.77% (1.6002 => 1.6605, std.dev.: 0.0220) SingleSource/Benchmarks/Shootout-C++/hash2: 3.77% (0.5150 => 0.5344, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.72% (1.8606 => 1.9299, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 3.71% (7.0007 => 7.2607, std.dev.: 0.0584) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.60% (5.9223 => 6.1354, std.dev.: 0.0224) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.54% (5.8627 => 6.0705, std.dev.: 0.0389) MultiSource/Benchmarks/Prolangs-C/football/football: 3.17% (1.0567 => 1.0902, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.95% (1.6723 => 1.7216, std.dev.: 0.0112) SingleSource/UnitTests/ObjC++/property-reference: 2.67% (0.8040 => 0.8255, std.dev.: 0.0046) MultiSource/Applications/ClamAV/clamscan: 1.72% (37.2121 => 37.8519, std.dev.: 0.0825) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/SPASS/SPASS: 30.96% (12.7178 => 16.6554, std.dev.: 0.6127) SingleSource/Benchmarks/Misc-C++/stepanov_container: 15.92% (5.6823 => 6.5868, std.dev.: 0.0537) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.45% (1.7417 => 1.9411, std.dev.: 0.0162) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 10.14% (1.3164 => 1.4499, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 9.49% (0.4297 => 0.4705, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.76% (6.0486 => 6.5180, std.dev.: 0.0303) MultiSource/Benchmarks/Olden/tsp/tsp: 6.74% (1.1692 => 1.2480, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 6.62% (3.1715 => 3.3815, std.dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/puzzle: 6.40% (0.6942 => 0.7386, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.60% (1.5422 => 1.6286, std.dev.: 0.0301) MultiSource/Benchmarks/FreeBench/neural/neural: 4.93% (0.2233 => 0.2343, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.89% (2.1150 => 2.2184, std.dev.: 0.0371) SingleSource/Benchmarks/Shootout-C++/hash2: 3.49% (3.3686 => 3.4863, std.dev.: 0.0354) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.71% (4.7899 => 4.9199, std.dev.: 0.0283) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.19% (5.0432 => 5.1536, std.dev.: 0.0272) MultiSource/Applications/lua/lua: 1.89% (27.3826 => 27.9004, std.dev.: 0.1996) MultiSource/Applications/SIBsim4/SIBsim4: 1.75% (3.8560 => 3.9235, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.69% (2.1250 => 2.1610, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.37% (7.2721 => 7.3715, std.dev.: 0.0276) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.25% (4.1437 => 4.1954, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.21% (2.8215 => 2.8555, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.07% (5.4241 => 5.4824, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/wordfreq: -2.58% (0.4064 => 0.3959, std.dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: -1.42% (20.8169 => 20.5204, std.dev.: 0.0916) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.29% (0.8215 => 0.8109, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.07% (39.0526 => 38.6330, std.dev.: 0.0767) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: -2.39% (18.8633 => 18.4118, std.dev.: 0.0746) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.88% (69.4174 => 68.8096, std.dev.: 0.7907) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.07% (0.1354 => 0.1355, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0420 => 0.0420, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.82% (0.0655 => 0.0680, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -0.00% (494.0494 => 494.0440, std.dev.: 0.1621) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 8.80% (63.2438 => 68.8096, std.dev.: 0.7907) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.04% (4.3882 => 0.0420, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43709.88% (1.1277 => 494.0440, std.dev.: 0.1621) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.95% (0.5229 => 1.5423, std.dev.: 0.0985) MultiSource/Applications/SPASS/SPASS: 17.04% (14.9895 => 17.5435, std.dev.: 0.2081) MultiSource/Applications/kimwitu++/kc: 44.97% (14.1553 => 20.5204, std.dev.: 0.0916) MultiSource/Benchmarks/MallocBench/gs/gs: 19.86% (4.1105 => 4.9269, std.dev.: 0.1475) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 50.30% (1.1048 => 1.6605, std.dev.: 0.0220) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 439.70% (7.1582 => 38.6330, std.dev.: 0.0767) SingleSource/Benchmarks/Misc-C++-EH/spirit: 88.21% (3.4629 => 6.5176, std.dev.: 0.0280) SingleSource/Benchmarks/Misc-C++/stepanov_container: 77.76% (0.6222 => 1.1060, std.dev.: 0.0018) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10368.61% (0.0720 => 7.5374, std.dev.: 0.1154) MultiSource/Applications/SIBsim4/SIBsim4: 3923400.00% (0.0001 => 3.9235, std.dev.: 0.0101) MultiSource/Applications/SPASS/SPASS: 16655300.00% (0.0001 => 16.6554, std.dev.: 0.6127) MultiSource/Applications/kimwitu++/kc: 54100.00% (0.0001 => 0.0542, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 64300.00% (0.0001 => 0.0644, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14500.00% (0.0001 => 0.0146, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576600.00% (0.0001 => 0.5767, std.dev.: 0.0270) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9990100.00% (0.0001 => 9.9902, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6586700.00% (0.0001 => 6.5868, std.dev.: 0.0537) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1745.65% (1.1194 => 20.6602, std.dev.: 0.6915) MultiSource/Applications/ClamAV/clamscan: 70.69% (22.1758 => 37.8519, std.dev.: 0.0825) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.92% (2.9384 => 4.6109, std.dev.: 0.3006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.69% (7.0540 => 10.9117, std.dev.: 0.3018) MultiSource/Applications/JM/lencod/lencod: 48.79% (21.9371 => 32.6399, std.dev.: 0.0892) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.96% (8.1363 => 11.9570, std.dev.: 0.1507) MultiSource/Benchmarks/FreeBench/distray/distray: 44.70% (0.1056 => 0.1528, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/flops: 42.67% (0.1432 => 0.2043, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 41.78% (0.0730 => 0.1035, std.dev.: 0.0010) SingleSource/UnitTests/vla: 39.44% (0.0355 => 0.0495, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 37.51% (0.2554 => 0.3512, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 35.23% (0.1584 => 0.2142, std.dev.: 0.0057) MultiSource/Benchmarks/Fhourstones/fhourstones: 34.42% (0.1566 => 0.2105, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 33.29% (0.0793 => 0.1057, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/15-trie/trie: 31.12% (0.0527 => 0.0691, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/17-bintr/bintr: 30.67% (0.0675 => 0.0882, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/tsp/tsp: 30.55% (0.1175 => 0.1534, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bisort/bisort: 30.29% (0.0614 => 0.0800, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 29.76% (0.0746 => 0.0968, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 29.28% (0.0567 => 0.0733, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 28.70% (0.7115 => 0.9157, std.dev.: 0.0252) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 28.62% (0.0842 => 0.1083, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: 28.41% (3.3354 => 4.2830, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 28.14% (0.2065 => 0.2646, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 27.46% (0.0437 => 0.0557, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/health/health: 26.97% (0.1268 => 0.1610, std.dev.: 0.0062) SingleSource/Benchmarks/Stanford/Oscar: 26.73% (0.0636 => 0.0806, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: 26.68% (2.0273 => 2.5681, std.dev.: 0.0396) MultiSource/Benchmarks/Prolangs-C/loader/loader: 26.58% (0.2758 => 0.3491, std.dev.: 0.0109) MultiSource/Benchmarks/McCat/18-imp/imp: 26.50% (0.3423 => 0.4330, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 26.33% (0.3441 => 0.4347, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 26.27% (0.7835 => 0.9893, std.dev.: 0.0179) MultiSource/Applications/oggenc/oggenc: 26.07% (5.7591 => 7.2607, std.dev.: 0.0584) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.84% (0.0770 => 0.0969, std.dev.: 0.0034) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 25.73% (0.0447 => 0.0562, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 25.49% (4.2646 => 5.3516, std.dev.: 0.0511) MultiSource/Benchmarks/McCat/09-vor/vor: 25.44% (0.3180 => 0.3989, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 25.44% (0.2107 => 0.2643, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 25.20% (1.5415 => 1.9299, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: 25.10% (0.0482 => 0.0603, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 24.91% (1.3050 => 1.6301, std.dev.: 0.0249) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 24.84% (0.0467 => 0.0583, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 24.72% (0.0886 => 0.1105, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 24.55% (0.5569 => 0.6936, std.dev.: 0.0178) MultiSource/Benchmarks/McCat/04-bisect/bisect: 24.39% (0.1062 => 0.1321, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 24.35% (0.1117 => 0.1389, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 24.31% (0.1695 => 0.2107, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 24.26% (0.2271 => 0.2822, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/treeadd/treeadd: 24.04% (0.0416 => 0.0516, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/perimeter/perimeter: 24.03% (0.0770 => 0.0955, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.64% (0.1337 => 0.1653, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 23.56% (0.1125 => 0.1390, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.55% (0.1032 => 0.1275, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: 23.32% (0.0626 => 0.0772, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 23.19% (1.5859 => 1.9537, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 23.00% (2.2024 => 2.7090, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/voronoi/voronoi: 23.00% (0.2700 => 0.3321, std.dev.: 0.0234) SingleSource/UnitTests/ObjC/dot-syntax-1: 22.96% (0.0479 => 0.0589, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 22.78% (0.2603 => 0.3196, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.76% (4.9449 => 6.0705, std.dev.: 0.0389) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 22.66% (5.0018 => 6.1354, std.dev.: 0.0224) MultiSource/Benchmarks/Olden/mst/mst: 22.36% (0.1163 => 0.1423, std.dev.: 0.0075) MultiSource/Applications/sqlite3/sqlite3: 22.34% (17.1811 => 21.0185, std.dev.: 0.2197) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 22.30% (0.5981 => 0.7315, std.dev.: 0.0113) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 22.25% (0.0953 => 0.1165, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 22.21% (0.8921 => 1.0902, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 22.19% (0.8101 => 0.9899, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 22.06% (0.5105 => 0.6231, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 21.96% (0.0838 => 0.1022, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.93% (0.0871 => 0.1062, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/messages-2: 21.90% (0.0662 => 0.0807, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 21.80% (0.8067 => 0.9826, std.dev.: 0.0351) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.68% (0.1236 => 0.1504, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 21.48% (0.6675 => 0.8109, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 21.42% (0.3427 => 0.4161, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 21.42% (0.5860 => 0.7115, std.dev.: 0.0117) SingleSource/Benchmarks/McGill/chomp: 21.39% (0.1655 => 0.2009, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 21.36% (1.4186 => 1.7216, std.dev.: 0.0112) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.34% (0.3121 => 0.3787, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/bh/bh: 21.25% (0.3092 => 0.3749, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 21.04% (0.1892 => 0.2290, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/neural/neural: 20.78% (0.1463 => 0.1767, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 20.77% (1.2842 => 1.5509, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 20.68% (0.0648 => 0.0782, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/hash: 20.62% (0.0485 => 0.0585, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 20.32% (3.8922 => 4.6832, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.24% (0.9765 => 1.1741, std.dev.: 0.0527) SingleSource/Benchmarks/Adobe-C++/functionobjects: 20.20% (0.5020 => 0.6034, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/exptree: 20.15% (0.0814 => 0.0978, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 19.95% (1.1840 => 1.4202, std.dev.: 0.0236) SingleSource/Benchmarks/Misc-C++/bigfib: 19.80% (0.6456 => 0.7734, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 19.72% (0.3307 => 0.3959, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 19.71% (0.1695 => 0.2029, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/matrix: 19.68% (0.0818 => 0.0979, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 19.42% (0.4299 => 0.5134, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 19.37% (0.0640 => 0.0764, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.30% (0.0834 => 0.0995, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/reversefile: 18.71% (0.3865 => 0.4588, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.57% (0.4615 => 0.5472, std.dev.: 0.0158) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.47% (0.0704 => 0.0834, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/misr: 18.33% (0.0633 => 0.0749, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.21% (1.1861 => 1.4021, std.dev.: 0.0386) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 18.05% (0.0798 => 0.0942, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.48% (14.3668 => 16.8779, std.dev.: 0.4117) SingleSource/Benchmarks/Shootout-C++/spellcheck: 17.30% (0.4203 => 0.4930, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/whetstone: 17.27% (0.0660 => 0.0774, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 17.18% (0.3603 => 0.4222, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 17.00% (0.4048 => 0.4736, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 16.83% (0.4289 => 0.5011, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.70% (0.8172 => 0.9537, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/lists: 16.10% (0.3422 => 0.3973, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists1: 16.02% (0.3684 => 0.4274, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.94% (0.4636 => 0.5375, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash2: 15.67% (0.4620 => 0.5344, std.dev.: 0.0065) SingleSource/UnitTests/SignlessTypes/rem: 15.30% (0.1144 => 0.1319, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 15.13% (1.1642 => 1.3403, std.dev.: 0.0016) MultiSource/Applications/viterbi/viterbi: 15.11% (0.1555 => 0.1790, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.06% (0.4064 => 0.4676, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.05% (2.2022 => 2.5336, std.dev.: 0.0151) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.00% (0.1940 => 0.2231, std.dev.: 0.0076) MultiSource/Applications/aha/aha: 14.86% (0.1151 => 0.1322, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 14.76% (0.7433 => 0.8530, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.69% (2.0665 => 2.3700, std.dev.: 0.0692) SingleSource/Benchmarks/CoyoteBench/lpbench: 14.64% (0.0929 => 0.1065, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 14.59% (0.3282 => 0.3761, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 14.59% (0.2831 => 0.3244, std.dev.: 0.0023) SingleSource/Benchmarks/Stanford/Puzzle: 14.43% (0.1268 => 0.1451, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 14.38% (0.3379 => 0.3865, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/except: 14.25% (0.2871 => 0.3280, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.21% (0.2872 => 0.3280, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/fibo: 14.17% (0.2725 => 0.3111, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hello: 14.04% (0.2714 => 0.3095, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wc: 13.99% (0.3052 => 0.3479, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/nestedloop: 13.93% (0.2793 => 0.3182, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 13.87% (0.2877 => 0.3276, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary: 13.86% (0.3232 => 0.3680, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sumcol: 13.80% (0.2891 => 0.3290, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/random: 13.78% (0.2802 => 0.3188, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ackermann: 13.68% (0.2756 => 0.3133, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.64% (0.1510 => 0.1716, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/matrix: 13.49% (0.3098 => 0.3516, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary3: 13.46% (0.3283 => 0.3725, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/parameter-passing: 13.42% (0.3927 => 0.4454, std.dev.: 0.0100) SingleSource/UnitTests/ObjC/exceptions-4: 13.38% (0.3543 => 0.4017, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/property: 13.33% (0.3886 => 0.4404, std.dev.: 0.0090) MultiSource/Applications/lua/lua: 13.30% (3.8723 => 4.3874, std.dev.: 0.0541) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.81% (0.3935 => 0.4439, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 12.74% (0.3131 => 0.3530, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 12.68% (0.7326 => 0.8255, std.dev.: 0.0046) MultiSource/Applications/hbd/hbd: 12.66% (1.5603 => 1.7579, std.dev.: 0.0688) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.56% (0.3543 => 0.3988, std.dev.: 0.0082) SingleSource/UnitTests/ObjC/trivial-interface: 12.18% (0.3473 => 0.3896, std.dev.: 0.0089) SingleSource/UnitTests/ObjC/exceptions-3: 12.17% (0.3516 => 0.3944, std.dev.: 0.0087) MultiSource/Applications/lemon/lemon: 12.05% (1.0722 => 1.2014, std.dev.: 0.0266) SingleSource/UnitTests/ObjC/exceptions: 12.04% (0.3828 => 0.4289, std.dev.: 0.0099) SingleSource/UnitTests/ObjC/exceptions-2: 12.04% (0.3497 => 0.3918, std.dev.: 0.0088) SingleSource/Regression/C++/ofstream_ctor: 11.88% (0.2905 => 0.3250, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/for-in: 11.72% (0.3694 => 0.4127, std.dev.: 0.0097) SingleSource/UnitTests/ObjC/synchronized: 11.51% (0.3561 => 0.3971, std.dev.: 0.0109) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.46% (0.1143 => 0.1274, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.39% (0.1906 => 0.2123, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.24% (0.6450 => 0.7175, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.23% (0.4879 => 0.5427, std.dev.: 0.0117) SingleSource/UnitTests/ObjC++/property-reference-object: 11.14% (0.6030 => 0.6702, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/ReedSolomon: 10.64% (0.2049 => 0.2267, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: 10.01% (0.3387 => 0.3726, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.62% (0.5925 => 0.6495, std.dev.: 0.0136) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.92% (0.3817 => 0.4043, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 149.01% (4.3953 => 10.9446, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/methcall: 147.04% (5.3999 => 13.3400, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 79.99% (32.5116 => 58.5169, std.dev.: 0.0267) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 44.50% (0.3256 => 0.4705, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/09-vor/vor: 35.96% (0.1154 => 0.1569, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 21.34% (9.1159 => 11.0612, std.dev.: 0.5341) MultiSource/Benchmarks/Olden/bisort/bisort: 20.26% (0.8333 => 1.0021, std.dev.: 0.0414) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.31% (1.1145 => 1.3074, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/oourafft: 16.11% (6.6465 => 7.7171, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 15.72% (1.0785 => 1.2480, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.66% (0.2944 => 0.3405, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/moments: 12.25% (0.1159 => 0.1301, std.dev.: 0.0004) MultiSource/Benchmarks/llubenchmark/llu: 11.55% (3.7781 => 4.2144, std.dev.: 0.0263) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.52% (2.8904 => 3.2233, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 11.15% (1.3045 => 1.4499, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/hash2: 10.40% (3.1578 => 3.4863, std.dev.: 0.0354) SingleSource/Benchmarks/Shootout/ary3: 10.22% (3.6994 => 4.0774, std.dev.: 0.0615) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.18% (8.6802 => 9.5636, std.dev.: 0.1598) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.99% (1.1396 => 1.2534, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 9.69% (3.7221 => 4.0826, std.dev.: 0.0589) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.22% (1.7254 => 1.8844, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.96% (2.0360 => 2.2184, std.dev.: 0.0371) MultiSource/Benchmarks/Olden/bh/bh: 7.92% (1.9405 => 2.0941, std.dev.: 0.0290) SingleSource/Benchmarks/Misc/ffbench: 7.15% (0.9505 => 1.0185, std.dev.: 0.0054) MultiSource/Applications/lua/lua: 6.93% (26.0924 => 27.9004, std.dev.: 0.1996) SingleSource/Benchmarks/BenchmarkGame/puzzle: 6.09% (0.6962 => 0.7386, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.06% (0.3070 => 0.3256, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.96% (0.9540 => 1.0109, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 5.90% (1.8329 => 1.9411, std.dev.: 0.0162) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.71% (4.2280 => 4.4695, std.dev.: 0.0056) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 4.93% (0.2233 => 0.2343, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 4.78% (3.1334 => 3.2833, std.dev.: 0.0234) SingleSource/Benchmarks/CoyoteBench/lpbench: 4.64% (10.3460 => 10.8261, std.dev.: 0.0847) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.37% (3.8532 => 4.0214, std.dev.: 0.0133) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.6436 => 12.1040, std.dev.: 0.0240) SingleSource/Benchmarks/Shootout/heapsort: 3.62% (3.8526 => 3.9922, std.dev.: 0.0213) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.53% (0.4162 => 0.4309, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.22% (0.7455 => 0.7695, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.04% (1.5086 => 1.5544, std.dev.: 0.0087) MultiSource/Applications/siod/siod: 3.01% (3.2827 => 3.3815, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.26% (3.6395 => 3.7218, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.13% (2.3135 => 2.3627, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.12% (1.3677 => 1.3967) MultiSource/Benchmarks/PAQ8p/paq8p: 2.09% (85.0658 => 86.8456, std.dev.: 0.0371) MultiSource/Applications/aha/aha: 2.06% (3.1595 => 3.2247, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.86% (2.1424 => 2.1823, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.52% (6.5088 => 6.6079, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.28% (1.0313 => 1.0445, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0502, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 1.06% (1.7133 => 1.7314, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.29% (6.6874 => 0.1809, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -74.96% (5.2763 => 1.3210, std.dev.: 0.0287) SingleSource/Benchmarks/Misc/salsa20: -74.96% (0.8651 => 0.2166, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -41.43% (0.1622 => 0.0950, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -12.18% (0.1330 => 0.1168, std.dev.: 0.0052) MultiSource/Applications/JM/ldecod/ldecod: -10.47% (10.4361 => 9.3436, std.dev.: 0.2335) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.43% (5.3526 => 4.9016, std.dev.: 0.0719) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.53% (5.3855 => 5.0877, std.dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.23% (1.9577 => 0.6611, std.dev.: 0.0236) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1681, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.20% (0.0628 => 0.0363, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.38% (0.3987 => 0.2377, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.30% (4.5009 => 2.7770, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: -33.28% (1.1492 => 0.7667, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.19% (2.6546 => 2.0125, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/mason/mason: -19.48% (0.2161 => 0.1740, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.67% (2.6778 => 2.2851, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -10.72% (1.5373 => 1.3725, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4245, std.dev.: 0.0024) MultiSource/Benchmarks/NPB-serial/is/is: -7.89% (9.5636 => 8.8094, std.dev.: 0.1258) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.70% (19.9488 => 18.4118, std.dev.: 0.0746) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.95% (4.8142 => 4.4797, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.76% (0.3463 => 0.3229, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.66% (3.2416 => 3.0580, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.58% (2.7294 => 2.5772, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.14% (0.8614 => 0.8171, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.75% (1.5835 => 1.5083, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: -4.45% (6.2999 => 6.0194, std.dev.: 0.0405) MultiSource/Benchmarks/sim/sim: -3.11% (5.0483 => 4.8914, std.dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.64% (0.4808 => 0.4681, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3565, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.00% (8.1563 => 7.9935, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6767, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -1.59% (10.2830 => 10.1198, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.75% (0.1485 => 0.1355, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.86% (0.2116 => 0.0680, std.dev.: 0.0011) Report Time: 2.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 17:29:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 19:29:24 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121201012924.1FCC22A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/6435?compare_to=6432&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6435, Order: 169056, Start Time: 2012-11-30 23:55:03, End Time: 2012-12-01 01:29:59 To: 6432, Order: 169037, Start Time: 2012-11-30 21:54:40, End Time: 2012-11-30 23:29:41 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (183 on baseline) Added Tests: 0 (52 on baseline) Unchanged Tests: 1093 (853 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/matrix: 13.84% (0.0744 => 0.0847, std.dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 16.61% (0.3834 => 0.4471, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 74.93% (31.3723 => 54.8805, std.dev.: 0.0176) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1008, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.4937 => 7.6659, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/hash2: 2.22% (3.1932 => 3.2642, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.53% (0.1431 => 0.1309, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.56% (0.3821 => 0.3532) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.91% (0.9542 => 0.8883, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -6.32% (2.4924 => 2.3350, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.27% (0.3142 => 0.2945, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -6.06% (0.3831 => 0.3599, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/exceptions-4: -6.03% (0.3880 => 0.3646, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.03% (0.3848 => 0.3616, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.01% (0.3812 => 0.3583, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.00% (0.3884 => 0.3651, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -5.90% (0.3896 => 0.3666, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.85% (0.4033 => 0.3797, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.83% (0.3891 => 0.3664, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: -5.81% (0.3357 => 0.3162, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: -5.75% (0.4176 => 0.3936, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.72% (0.2428 => 0.2289, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.61% (0.2355 => 0.2223, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -5.60% (0.2160 => 0.2039, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.57% (0.1796 => 0.1696, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.57% (0.6484 => 0.6123, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: -5.45% (9.2283 => 8.7256, std.dev.: 0.0132) SingleSource/UnitTests/ObjC/property: -5.43% (0.4199 => 0.3971, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.36% (0.7198 => 0.6812, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -5.34% (16.1920 => 15.3271, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.34% (0.5805 => 0.5495, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.33% (0.5591 => 0.5293, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.32% (0.9852 => 0.9328, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.30% (0.3658 => 0.3464, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.30% (0.3057 => 0.2895, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.29% (0.5863 => 0.5553, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.28% (0.5478 => 0.5189, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.24% (0.5802 => 0.5498, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.23% (1.0544 => 0.9993, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.22% (0.5859 => 0.5553, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.18% (0.5925 => 0.5618, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.16% (0.5581 => 0.5293, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.16% (0.5857 => 0.5555, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.15% (0.5849 => 0.5548, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.15% (4.8161 => 4.5683, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: -5.14% (0.9179 => 0.8707, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -5.14% (0.4280 => 0.4060, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.11% (0.6395 => 0.6068, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.10% (0.6395 => 0.6069, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.08% (0.7524 => 0.7142, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.08% (0.6304 => 0.5984, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.07% (0.6230 => 0.5914, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -5.06% (7.0961 => 6.7371, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.06% (0.5575 => 0.5293, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -5.06% (0.3025 => 0.2872, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.06% (0.3837 => 0.3643, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.05% (4.8802 => 4.6337, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.05% (1.3722 => 1.3029, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.03% (1.2300 => 1.1681, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.03% (4.0323 => 3.8294, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.03% (0.5705 => 0.5418, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.03% (0.5688 => 0.5402, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.01% (2.1713 => 2.0625, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.01% (0.6052 => 0.5749, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: -5.00% (0.3059 => 0.2906, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.00% (0.7339 => 0.6972, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -5.00% (1.3148 => 1.2491, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.99% (0.3931 => 0.3735, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -4.98% (0.2871 => 0.2728, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.97% (0.3016 => 0.2866, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.97% (0.6194 => 0.5886, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.96% (0.5569 => 0.5293, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.95% (0.5456 => 0.5186, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: -4.95% (0.3194 => 0.3036, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.94% (0.8521 => 0.8100, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: -4.93% (0.2939 => 0.2794, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.93% (0.6676 => 0.6347, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -4.93% (1.2784 => 1.2154, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (0.6681 => 0.6352, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.92% (0.3252 => 0.3092, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.92% (14.2083 => 13.5097, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/matrix: -4.92% (0.3255 => 0.3095, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.89% (1.6364 => 1.5563, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.89% (0.2903 => 0.2761, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -4.89% (0.3026 => 0.2878, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.89% (0.6446 => 0.6131, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.88% (0.5941 => 0.5651, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.88% (0.6297 => 0.5990, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -4.87% (17.1032 => 16.2698, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.86% (0.6293 => 0.5987, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.85% (0.5567 => 0.5297, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.85% (0.3323 => 0.3162, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.84% (1.4642 => 1.3933, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.84% (0.2933 => 0.2791, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.84% (0.6260 => 0.5957, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -4.83% (0.3481 => 0.3313, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.82% (0.2695 => 0.2565, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.81% (4.5069 => 4.2902, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/wc: -4.80% (0.3205 => 0.3051, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -4.80% (4.3330 => 4.1251, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.78% (3.5339 => 3.3650, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.76% (0.5570 => 0.5305, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.76% (0.6033 => 0.5746, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.75% (0.6440 => 0.6134, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.72% (0.6189 => 0.5897, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -4.72% (1.3864 => 1.3210, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.71% (6.7716 => 6.4527, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hello: -4.70% (0.2849 => 0.2715, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.67% (0.4813 => 0.4588, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.66% (0.6736 => 0.6422, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.66% (0.7919 => 0.7550, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.64% (0.3406 => 0.3248, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -4.63% (0.4515 => 0.4306, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -4.61% (0.3446 => 0.3287, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.60% (0.5999 => 0.5723, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.58% (1.2221 => 1.1661, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.55% (0.4151 => 0.3962, std.dev.: 0.0044) MultiSource/Applications/lemon/lemon: -4.55% (1.1450 => 1.0929, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.55% (0.3849 => 0.3674, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -4.54% (0.3394 => 0.3240, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -4.54% (1.1530 => 1.1007, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.52% (1.2210 => 1.1658, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.52% (0.2989 => 0.2854, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -4.47% (0.3621 => 0.3459, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.43% (0.2548 => 0.2435, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.43% (0.2278 => 0.2177, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: -4.40% (0.4248 => 0.4061, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.40% (0.2999 => 0.2867, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -4.39% (1.2515 => 1.1966, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.37% (0.4916 => 0.4701, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.36% (0.3483 => 0.3331, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.36% (0.2385 => 0.2281, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: -4.34% (0.3867 => 0.3699, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -4.34% (0.4861 => 0.4650, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -4.31% (15.5079 => 14.8390, std.dev.: 0.0143) MultiSource/Benchmarks/McCat/18-imp/imp: -4.30% (0.3581 => 0.3427, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.24% (0.4321 => 0.4138, std.dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: -4.23% (15.2527 => 14.6080, std.dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: -4.19% (34.0927 => 32.6640, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.16% (0.4083 => 0.3913, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -4.10% (0.2659 => 0.2550, std.dev.: 0.0010) MultiSource/Applications/lua/lua: -4.10% (4.0594 => 3.8930, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.10% (0.6660 => 0.6387, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.10% (8.0126 => 7.6842, std.dev.: 0.0053) MultiSource/Applications/minisat/minisat: -4.06% (0.7447 => 0.7145, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.04% (0.4427 => 0.4248, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.99% (0.9077 => 0.8715, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -3.96% (1.6474 => 1.5821, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: -3.93% (0.3788 => 0.3639, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -3.93% (3.5154 => 3.3772, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -3.93% (0.6667 => 0.6405, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -3.92% (0.2985 => 0.2868, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -3.91% (0.3271 => 0.3143, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.77% (0.7021 => 0.6756, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.77% (0.3319 => 0.3194, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: -3.77% (0.6347 => 0.6108, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -3.76% (0.7982 => 0.7682, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.75% (0.5168 => 0.4974, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: -3.71% (18.2933 => 17.6149, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.70% (0.9557 => 0.9203, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -3.69% (0.8418 => 0.8107, std.dev.: 0.0020) MultiSource/Applications/treecc/treecc: -3.69% (2.1401 => 2.0612, std.dev.: 0.0040) MultiSource/Applications/oggenc/oggenc: -3.64% (5.0226 => 4.8400, std.dev.: 0.0141) SingleSource/Benchmarks/Misc-C++/bigfib: -3.57% (0.6750 => 0.6509, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -3.53% (2.4021 => 2.3174, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: -3.52% (0.6441 => 0.6214, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.47% (0.5329 => 0.5144, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -3.42% (0.7779 => 0.7513, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.25% (22.4056 => 21.6766, std.dev.: 0.0111) MultiSource/Applications/hbd/hbd: -3.20% (1.5610 => 1.5111, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.15% (0.3491 => 0.3381, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.06% (2.2587 => 2.1895, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.35% (5.4682 => 5.3396, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -1.14% (20.7746 => 20.5384, std.dev.: 0.0341) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.28% (1.8100 => 0.6827, std.dev.: 0.0135) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7500, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -8.62% (1.2842 => 1.1735, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7060, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.65% (2.2633 => 2.1807, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3989, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.96% (1.3096 => 1.2708, std.dev.: 0.0107) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4723, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 17:57:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 19:57:09 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121201015709.1D6272A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/6436?compare_to=6433&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6436, Order: 169059, Start Time: 2012-12-01 00:17:18, End Time: 2012-12-01 01:57:44 To: 6433, Order: 169041, Start Time: 2012-11-30 22:13:31, End Time: 2012-11-30 23:56:52 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 5 (69 on baseline) Performance Improvements: 15 (25 on baseline) Added Tests: 0 (51 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1033 (880 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 55.41% (0.0823 => 0.1279, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 27.35% (0.0691 => 0.0880, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/SPASS/SPASS: 8.84% (9.7435 => 10.6045, std.dev.: 0.2578) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.96% (2.7510 => 2.8323, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.18% (1.3617 => 1.3778, std.dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/CoyoteBench/almabench: -38.42% (0.1161 => 0.0715, std.dev.: 0.0113) SingleSource/Benchmarks/LivermoreLoops/kernel23: -32.79% (0.1726 => 0.1160, std.dev.: 0.0026) SingleSource/Benchmarks/LivermoreLoops/kernel17: -28.77% (0.1484 => 0.1057, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/dt: -26.65% (0.0469 => 0.0344, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -15.06% (10.6747 => 9.0669, std.dev.: 0.1130) SingleSource/Benchmarks/LivermoreLoops/kernel01: -11.10% (0.1180 => 0.1049, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/strcat: -8.65% (0.2162 => 0.1975, std.dev.: 0.0054) MultiSource/Benchmarks/SciMark2-C/scimark2: -6.63% (0.3592 => 0.3354, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.19% (0.9538 => 0.9043, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.84% (0.3907 => 0.3796, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.61% (0.9725 => 0.9471, std.dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel10: -35.18% (0.1029 => 0.0667, std.dev.: 0.0114) MultiSource/Benchmarks/Bullet/bullet: -6.68% (7.6321 => 7.1219, std.dev.: 0.1355) SingleSource/Benchmarks/Misc/mandel-2: -3.59% (1.7385 => 1.6761, std.dev.: 0.0117) MultiSource/Benchmarks/BitBench/five11/five11: -1.61% (5.7021 => 5.6101, std.dev.: 0.0212) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -20.55% (1.3554 => 1.0769, std.dev.: 0.1452) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.89% (0.3990 => 0.3715, std.dev.: 0.0138) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 5.94% (0.0219 => 0.0232, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 16.49% (0.0382 => 0.0445, std.dev.: 0.0122) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 6.91% (0.0333 => 0.0356, std.dev.: 0.0073) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.09% (0.0318 => 0.0331, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.77% (0.0389 => 0.0427, std.dev.: 0.0136) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0204 => 0.0205, std.dev.: 0.0066) SingleSource/UnitTests/Vector/Altivec/test1: 13.70% (0.0219 => 0.0249, std.dev.: 0.0043) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1510 => 0.1511, std.dev.: 0.0220) MultiSource/Applications/lemon/lemon: -0.39% (1.2141 => 1.2094, std.dev.: 0.2619) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -10.59% (0.4468 => 0.3995, std.dev.: 0.0187) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -7.30% (0.1630 => 0.1511, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.05% (0.0666 => 0.0639, std.dev.: 0.0172) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -22.30% (0.0278 => 0.0216, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.48% (0.0586 => 0.0624, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.04% (1.1503 => 1.1498, std.dev.: 0.0980) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.17% (0.0606 => 0.0605, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.04% (0.0259 => 0.0233, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.29% (0.8038 => 0.8061, std.dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 73.24% (0.0071 => 0.0123, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.00% (8.6195 => 8.6199, std.dev.: 0.0237) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 11.06% (16.4461 => 18.2645, std.dev.: 0.8020) MultiSource/Applications/sqlite3/sqlite3: 2403.55% (0.6332 => 15.8525, std.dev.: 0.5597) MultiSource/Benchmarks/McCat/08-main/main: 50.85% (0.1831 => 0.2762, std.dev.: 0.0199) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.43% (0.1559 => 0.1490, std.dev.: 0.0257) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7228.82% (0.3123 => 22.8879, std.dev.: 0.8904) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1729.61% (0.3344 => 6.1182, std.dev.: 0.1859) SingleSource/Benchmarks/Misc-C++/Large/ray: 39.59% (0.2364 => 0.3300, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/bigfib: 9.18% (0.6010 => 0.6562, std.dev.: 0.0482) SingleSource/Benchmarks/Misc/mandel: 3.73% (0.0429 => 0.0445, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.99% (0.3266 => 0.3429, std.dev.: 0.0429) SingleSource/Benchmarks/Shootout-C++/strcat: 0.30% (0.1969 => 0.1975, std.dev.: 0.0054) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.48% (0.0224 => 0.0243, std.dev.: 0.0013) SingleSource/UnitTests/byval-alignment: -24.35% (0.0230 => 0.0174, std.dev.: 0.0051) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0529, std.dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: 12.38% (0.1462 => 0.1643, std.dev.: 0.0175) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4285, std.dev.: 0.0279) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0688, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4933, std.dev.: 0.0285) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5189, std.dev.: 0.0375) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3199, std.dev.: 0.0324) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.1233, std.dev.: 0.0221) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3668, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3860, std.dev.: 0.0260) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0009, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0848, std.dev.: 0.0199) SingleSource/Regression/C/uint64_to_float: -29.65% (2.1832 => 1.5358, std.dev.: 0.0254) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0008, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 64.61% (0.0777 => 0.1279, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 40.35% (0.0627 => 0.0880, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.28% (0.0848 => 0.1020, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 17.68% (2.1401 => 2.5184, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 17.26% (1.5315 => 1.7959, std.dev.: 0.0593) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.12% (0.0668 => 0.0769, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 14.60% (3.1832 => 3.6479, std.dev.: 0.0932) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.32% (0.0773 => 0.0876, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.00% (0.4127 => 0.4581, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.98% (0.8148 => 0.9043, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.85% (0.7473 => 0.8284, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.80% (0.1157 => 0.1282, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.71% (0.3295 => 0.3648, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.88% (0.5191 => 0.5652, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.42% (0.9435 => 1.0229, std.dev.: 0.0175) MultiSource/Benchmarks/sim/sim: 8.15% (0.3226 => 0.3489, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.91% (0.1466 => 0.1582, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.28% (1.2526 => 1.3438, std.dev.: 0.0310) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.08% (0.5817 => 0.6229, std.dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.92% (0.3137 => 0.3354, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.61% (1.1606 => 1.2257, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.36% (0.8656 => 0.9120, std.dev.: 0.0133) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.29% (0.8995 => 0.9471, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.05% (1.2602 => 1.3238, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.85% (8.6476 => 9.0669, std.dev.: 0.1130) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.66% (0.8286 => 0.8672, std.dev.: 0.0147) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.49% (0.3717 => 0.3884, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists1: 4.14% (0.2969 => 0.3092, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.82% (0.3115 => 0.3234, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.80% (0.3657 => 0.3796, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.76% (4.4880 => 4.6568, std.dev.: 0.0510) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 198.62% (28.5821 => 85.3521, std.dev.: 0.0229) SingleSource/Benchmarks/Misc/pi: 33.25% (1.5795 => 2.1047, std.dev.: 0.0513) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 29.21% (2.9096 => 3.7594, std.dev.: 0.1176) MultiSource/Applications/SPASS/SPASS: 25.76% (8.4326 => 10.6045, std.dev.: 0.2578) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.25% (4.8436 => 5.8729, std.dev.: 0.0261) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.78% (8.2783 => 9.7503, std.dev.: 0.0347) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.19% (0.7597 => 0.8903, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/misr: 16.10% (0.4001 => 0.4645, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.97% (0.3186 => 0.3663, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 12.13% (2.7995 => 3.1391, std.dev.: 0.1040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.66% (14.6451 => 16.3523, std.dev.: 0.5398) MultiSource/Applications/lambda-0_1_3/lambda: 10.64% (7.4933 => 8.2909, std.dev.: 0.0351) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.36% (0.1129 => 0.1246, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 9.74% (1.1857 => 1.3012, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.90% (3.9917 => 4.3071, std.dev.: 0.0509) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.46% (23.5781 => 25.3380, std.dev.: 0.0310) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.74% (3.3761 => 3.6036, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.36% (59.2638 => 63.0336, std.dev.: 0.7331) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 6.29% (4.8660 => 5.1719, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.07% (2.9753 => 3.1560, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.91% (4.5327 => 4.8004, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.87% (0.3937 => 0.4168, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.44% (5.4187 => 5.7135, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.34% (5.3218 => 5.6059, std.dev.: 0.0506) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 5.31% (0.4353 => 0.4584, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 4.91% (3.3398 => 3.5037, std.dev.: 0.0274) SingleSource/Benchmarks/Misc/richards_benchmark: 4.87% (1.3037 => 1.3672, std.dev.: 0.0198) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.60% (0.5214 => 0.5454, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.72% (4.8362 => 5.0160, std.dev.: 0.0213) MultiSource/Benchmarks/Olden/power/power: 3.06% (1.2061 => 1.2430, std.dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.82% (3.4104 => 3.5065, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/queens: 2.29% (1.7056 => 1.7446, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.24% (0.6150 => 0.6288, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.54% (11.5690 => 11.7469, std.dev.: 0.0397) SingleSource/Benchmarks/Shootout/methcall: 1.50% (8.2676 => 8.3914, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout/fib2: 1.42% (4.3025 => 4.3636, std.dev.: 0.0179) MultiSource/Benchmarks/sim/sim: 1.07% (3.8206 => 3.8615, std.dev.: 0.0055) MultiSource/Applications/spiff/spiff: 1.06% (2.8561 => 2.8864, std.dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.11% (2.8951 => 1.6761, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -24.31% (7.2130 => 5.4597, std.dev.: 0.1767) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.32% (1.4529 => 1.1577, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.73% (9.9065 => 8.2491, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/em3d/em3d: -12.51% (5.4641 => 4.7803, std.dev.: 0.1018) SingleSource/Benchmarks/Misc/flops-8: -9.34% (2.5609 => 2.3218, std.dev.: 0.0232) MultiSource/Benchmarks/mafft/pairlocalalign: -9.08% (63.1822 => 57.4438, std.dev.: 0.1158) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.09% (1.0512 => 0.9662, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -6.87% (3.2169 => 2.9959, std.dev.: 0.0418) SingleSource/Benchmarks/Stanford/FloatMM: -6.48% (0.8807 => 0.8236, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.22% (4.7482 => 4.4527, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.10% (5.1305 => 4.8173, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout/sieve: -5.97% (7.0599 => 6.6386, std.dev.: 0.1545) SingleSource/Benchmarks/Misc/flops: -5.36% (9.3748 => 8.8723, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.74% (5.6343 => 5.3671, std.dev.: 0.0392) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.50% (4.7449 => 4.5315, std.dev.: 0.0695) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.40% (6.1706 => 5.8991, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.22% (4.9453 => 4.7366, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/perlin: -3.62% (5.1084 => 4.9234, std.dev.: 0.0368) SingleSource/Benchmarks/Shootout-C++/methcall: -3.38% (8.9760 => 8.6722, std.dev.: 0.0407) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.73% (3.3479 => 3.2901, std.dev.: 0.0104) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.56% (2.8773 => 2.8323, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/fp-convert: -1.45% (15.8853 => 15.6555, std.dev.: 0.0483) MultiSource/Benchmarks/FreeBench/neural/neural: -1.42% (1.0841 => 1.0687, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.02% (1.5308 => 1.5152, std.dev.: 0.0060) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.94% (1.0262 => 1.0769, std.dev.: 0.1452) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.83% (0.2463 => 0.3715, std.dev.: 0.0138) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 88.62% (0.0123 => 0.0232, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 9.07% (0.0408 => 0.0445, std.dev.: 0.0122) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 40.16% (0.0254 => 0.0356, std.dev.: 0.0073) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 9.60% (0.0302 => 0.0331, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.20% (0.0384 => 0.0427, std.dev.: 0.0136) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0066) SingleSource/UnitTests/Vector/Altivec/test1: 38.33% (0.0180 => 0.0249, std.dev.: 0.0043) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.08% (0.1438 => 0.1511, std.dev.: 0.0220) MultiSource/Applications/lemon/lemon: 6.75% (1.1329 => 1.2094, std.dev.: 0.2619) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.06% (0.4164 => 0.3995, std.dev.: 0.0187) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.37% (0.1369 => 0.1511, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.31% (0.0641 => 0.0639, std.dev.: 0.0172) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 10.77% (0.0195 => 0.0216, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.96% (0.0578 => 0.0624, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.53% (1.1437 => 1.1498, std.dev.: 0.0980) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.51% (0.0627 => 0.0605, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 29.44% (0.0180 => 0.0233, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.55% (0.8017 => 0.8061, std.dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 98.39% (0.0062 => 0.0123, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 19:24:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 21:24:59 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121201032459.9FB722A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/6437?compare_to=6431&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6437, Order: 169049, Start Time: 2012-11-30 23:55:29, End Time: 2012-12-01 03:25:34 To: 6431, Order: 169020, Start Time: 2012-11-30 19:26:43, End Time: 2012-11-30 22:56:40 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (179 on baseline) Performance Improvements: 2 (18 on baseline) Added Tests: 0 (186 on baseline) Unchanged Tests: 1092 (711 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -6.81% (0.4535 => 0.4226, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.12% (2.4163 => 2.3892, std.dev.: 0.0047) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.12% (0.0625 => 0.0882, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.83% (0.1063 => 0.1412, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.32% (0.2969 => 0.3780, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.03% (0.1106 => 0.1405, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.17% (0.4139 => 0.5222, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.58% (0.4253 => 0.5341, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 25.36% (1.5932 => 1.9972, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.26% (0.0475 => 0.0595, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 25.22% (0.0452 => 0.0566, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.21% (0.0714 => 0.0894) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.20% (0.5900 => 0.7387, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.15% (0.4994 => 0.6250, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 25.14% (0.0541 => 0.0677, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.82% (0.0415 => 0.0518, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.32% (0.0584 => 0.0726, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.26% (0.5000 => 0.6213, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.77% (0.0547 => 0.0677, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.51% (0.1021 => 0.1261) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.33% (0.1620 => 0.1998, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.30% (0.1103 => 0.1360, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.13% (0.1107 => 0.1363, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.08% (0.0897 => 0.1104) MultiSource/Benchmarks/Olden/tsp/tsp: 22.87% (0.0599 => 0.0736, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.96% (0.0642 => 0.0783, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.96% (0.0633 => 0.0772, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 21.84% (0.0948 => 0.1155, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.82% (0.0495 => 0.0603, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.75% (0.0584 => 0.0711, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.57% (0.3903 => 0.4745, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.24% (0.1549 => 0.1878, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.24% (0.1003 => 0.1216, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.05% (0.0822 => 0.0995, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: 21.03% (0.0604 => 0.0731, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 21.00% (0.1619 => 0.1959, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 20.83% (0.0821 => 0.0992, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.82% (0.1604 => 0.1938, std.dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 20.30% (0.0808 => 0.0972, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.11% (0.1462 => 0.1756, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 19.96% (0.0947 => 0.1136, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.92% (0.3890 => 0.4665, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.91% (0.1160 => 0.1391, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 19.73% (0.4029 => 0.4824, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.71% (0.2014 => 0.2411, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.44% (1.3152 => 1.5709, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: 19.38% (0.1218 => 0.1454) MultiSource/Benchmarks/McCat/09-vor/vor: 18.94% (0.1505 => 0.1790, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 18.91% (0.0698 => 0.0830, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.79% (0.2736 => 0.3250, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.74% (0.2866 => 0.3403, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.68% (0.0605 => 0.0718, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.66% (0.1088 => 0.1291, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.53% (0.0572 => 0.0678, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 18.52% (0.5546 => 0.6573, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.51% (3.5627 => 4.2220, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.48% (0.5026 => 0.5955, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 18.46% (1.8794 => 2.2263, std.dev.: 0.0078) SingleSource/UnitTests/ObjC++/Hello: 18.38% (0.5826 => 0.6897, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.32% (0.0573 => 0.0678, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 18.22% (0.5889 => 0.6962, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.19% (0.1968 => 0.2326, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.19% (1.6211 => 1.9159, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.12% (0.4658 => 0.5502, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.85% (0.3271 => 0.3855, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 17.79% (0.9697 => 1.1422, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.70% (4.4195 => 5.2018, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/18-imp/imp: 17.59% (0.1421 => 0.1671, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 17.52% (4.2109 => 4.9487, std.dev.: 0.0071) MultiSource/Applications/d/make_dparser: 17.37% (1.0781 => 1.2654, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.37% (2.7292 => 3.2033, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.36% (0.4361 => 0.5118, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.18% (0.3930 => 0.4605, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 17.04% (0.7171 => 0.8393, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 16.67% (0.1284 => 0.1498, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.61% (0.1090 => 0.1271, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.59% (1.9694 => 2.2961, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: 16.53% (0.2075 => 0.2418, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 16.52% (0.2566 => 0.2990, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.52% (0.2875 => 0.3350, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 16.44% (0.2725 => 0.3173, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 16.33% (0.2811 => 0.3270, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.32% (1.9966 => 2.3224, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.27% (0.2729 => 0.3173, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 16.26% (0.2780 => 0.3232, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.22% (0.2738 => 0.3182, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 16.14% (0.2714 => 0.3152, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.01% (0.2911 => 0.3377, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 15.98% (0.9909 => 1.1492, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.97% (0.2792 => 0.3238, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 15.85% (0.2750 => 0.3186, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 15.84% (0.2803 => 0.3247, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.81% (0.3195 => 0.3700, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 15.73% (0.2823 => 0.3267, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 15.71% (0.2813 => 0.3255, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 15.70% (0.3096 => 0.3582, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.69% (0.3060 => 0.3540, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 15.66% (1.4269 => 1.6503, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.57% (2.0673 => 2.3892, std.dev.: 0.0047) SingleSource/Regression/C++/ofstream_ctor: 15.48% (0.3004 => 0.3469, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 15.30% (2.1013 => 2.4228, std.dev.: 0.0065) MultiSource/Benchmarks/Bullet/bullet: 15.20% (23.5202 => 27.0956, std.dev.: 0.0131) MultiSource/Benchmarks/sim/sim: 15.17% (0.0758 => 0.0873, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 15.15% (0.3267 => 0.3762, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.14% (0.3124 => 0.3597, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.14% (0.3362 => 0.3871, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 15.14% (0.7875 => 0.9067, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 15.13% (0.3317 => 0.3819, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 15.04% (0.3258 => 0.3748, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 14.86% (0.3465 => 0.3980, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 14.81% (2.1653 => 2.4859, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions-2: 14.77% (0.3446 => 0.3955, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.74% (0.3488 => 0.4002, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.66% (0.3282 => 0.3763, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 14.65% (0.3496 => 0.4008, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 14.61% (0.3442 => 0.3945, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 14.57% (0.3460 => 0.3964, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.56% (0.3469 => 0.3974, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 14.55% (0.3678 => 0.4213, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 14.49% (0.3348 => 0.3833, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.41% (0.2040 => 0.2334, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.41% (0.3845 => 0.4399, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 14.36% (0.3726 => 0.4261, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.34% (0.3625 => 0.4145, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 14.33% (0.3650 => 0.4173, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 14.30% (0.3643 => 0.4164, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 14.19% (4.6177 => 5.2728, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists1: 14.18% (0.3477 => 0.3970, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 14.11% (0.4146 => 0.4731, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 14.02% (0.3724 => 0.4246, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.02% (0.3981 => 0.4539, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 13.95% (0.4251 => 0.4844, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.90% (0.3690 => 0.4203, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 13.90% (0.2691 => 0.3065, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 13.29% (0.5012 => 0.5678, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.23% (0.1383 => 0.1566, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 13.11% (5.5417 => 6.2682, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 12.95% (0.3498 => 0.3951, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.39% (0.6435 => 0.7232, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 12.19% (0.4847 => 0.5438, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.16% (0.1028 => 0.1153, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 12.09% (0.6634 => 0.7436, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.80% (0.2068 => 0.2312, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.51% (0.3084 => 0.3439, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.29% (0.2737 => 0.3046, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 11.09% (0.3336 => 0.3706, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 11.05% (2.0346 => 2.2594, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 11.00% (0.2391 => 0.2654, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.46% (0.2103 => 0.2323, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.64% (0.5361 => 0.5878, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.24% (0.5584 => 0.6100, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.98% (11.6398 => 12.6845, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.83% (0.7426 => 0.8082, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.57% (4.6926 => 5.0948, std.dev.: 0.0040) MultiSource/Applications/kimwitu++/kc: 7.70% (11.9555 => 12.8760, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.30% (0.3792 => 0.3993, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.88% (29.0505 => 181.5294, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700) MultiSource/Applications/ClamAV/clamscan: 10.21% (0.2802 => 0.3088, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6097, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.75% (0.2122 => 0.2244, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 5.23% (12.0509 => 12.6812, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1711, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-2: 4.69% (1.8057 => 1.8903, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.60% (79.9355 => 83.6155, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.39% (0.3693 => 0.3855, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6421, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2014, std.dev.: 0.0114) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2220, std.dev.: 0.0023) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3042, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.30% (7.1849 => 7.2785, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5140, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5763, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.33% (2.4764 => 2.4187, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5676, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/ary2: -8.58% (0.2402 => 0.2196, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9784, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8065, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9574, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7979, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0066) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/fldry: -2.64% (17.2379 => 16.7821, std.dev.: 0.0593) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8592, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5722, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4956, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7163, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1693, std.dev.: 0.0838) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0458, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 19:29:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 21:29:08 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121201032908.3D6332A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/6438?compare_to=6435&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6438, Order: 169072, Start Time: 2012-12-01 01:54:58, End Time: 2012-12-01 03:29:43 To: 6435, Order: 169056, Start Time: 2012-11-30 23:55:03, End Time: 2012-12-01 01:29:59 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (7 on baseline) Performance Improvements: 5 (186 on baseline) Added Tests: 0 (52 on baseline) Unchanged Tests: 1088 (849 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.14% (3.7464 => 3.7892, std.dev.: 0.0115) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout/matrix: -12.40% (0.0847 => 0.0742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/constpool: -1.53% (20.5384 => 20.2243, std.dev.: 0.0570) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.33% (21.6766 => 21.3874, std.dev.: 0.0270) MultiSource/Applications/oggenc/oggenc: -1.13% (4.8400 => 4.7853, std.dev.: 0.0019) MultiSource/Applications/siod/siod: -1.09% (2.3174 => 2.2921, std.dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 12.36% (0.3834 => 0.4308, std.dev.: 0.0136) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 74.86% (31.3723 => 54.8590, std.dev.: 0.0218) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.39% (2.0478 => 2.1173, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: 2.48% (7.4937 => 7.6793, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/hash2: 2.06% (3.1932 => 3.2589, std.dev.: 0.0074) MultiSource/Benchmarks/llubenchmark/llu: 1.22% (3.7435 => 3.7892, std.dev.: 0.0115) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.01% (0.1431 => 0.1302, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.77% (0.3821 => 0.3524, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.50% (0.9542 => 0.8826, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.90% (2.4924 => 2.3205, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.78% (0.3142 => 0.2929, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.61% (0.3357 => 0.3135, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.47% (0.2428 => 0.2271, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.24% (0.1796 => 0.1684, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: -6.16% (0.2160 => 0.2027, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/chomp: -6.13% (0.1761 => 0.1653, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.10% (0.5857 => 0.5500, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.08% (0.5478 => 0.5145, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.07% (0.5863 => 0.5507, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.05% (0.5802 => 0.5451, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.01% (0.3658 => 0.3438, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.00% (0.1716 => 0.1613, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.00% (0.6484 => 0.6095, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.98% (0.5805 => 0.5458, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.96% (0.6395 => 0.6014, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.96% (0.5859 => 0.5510, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.94% (0.9852 => 0.9267, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.93% (0.7339 => 0.6904, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -5.93% (7.0961 => 6.6755, std.dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: -5.92% (9.2283 => 8.6821, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.91% (0.5567 => 0.5238, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.89% (0.6230 => 0.5863, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.88% (0.6052 => 0.5696, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.88% (0.5849 => 0.5505, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -5.87% (16.1920 => 15.2423, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.86% (0.3057 => 0.2878, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.84% (0.5925 => 0.5579, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.84% (0.5688 => 0.5356, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.83% (0.6260 => 0.5895, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.83% (0.5575 => 0.5250, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.83% (0.3931 => 0.3702, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.81% (1.3722 => 1.2925, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/football/football: -5.81% (0.9179 => 0.8646, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.80% (0.5705 => 0.5374, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.79% (0.6304 => 0.5939, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.78% (0.7524 => 0.7089, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.77% (0.2355 => 0.2219, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.76% (0.5570 => 0.5249, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.76% (0.5941 => 0.5599, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.75% (0.6033 => 0.5686, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.75% (0.6297 => 0.5935, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.75% (0.5569 => 0.5249, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.74% (0.6446 => 0.6076, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.74% (4.8161 => 4.5397, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.74% (0.7198 => 0.6785, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.72% (0.5591 => 0.5271, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.72% (1.2300 => 1.1597, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.71% (0.7919 => 0.7467, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.70% (0.5456 => 0.5145, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.70% (1.0544 => 0.9943, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.68% (0.6194 => 0.5842, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.68% (0.2695 => 0.2542, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.64% (0.5581 => 0.5266, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.64% (1.3148 => 1.2406, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.64% (4.0323 => 3.8049, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.64% (0.6189 => 0.5840, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.62% (0.6440 => 0.6078, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/methcall: -5.62% (0.3025 => 0.2855, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.61% (3.5339 => 3.3358, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.60% (0.6676 => 0.6302, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.60% (4.8802 => 4.6070, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.60% (0.3252 => 0.3070, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -5.59% (0.1879 => 0.1774, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -5.59% (4.3330 => 4.0909, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.57% (1.6364 => 1.5452, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.57% (1.4642 => 1.3826, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.57% (0.3323 => 0.3138, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.55% (0.6681 => 0.6310, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: -5.54% (0.3194 => 0.3017, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -5.54% (0.2871 => 0.2712, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.54% (0.6736 => 0.6363, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.54% (0.6395 => 0.6041, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.50% (1.2784 => 1.2081, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.49% (2.1713 => 2.0520, std.dev.: 0.0035) MultiSource/Applications/SIBsim4/SIBsim4: -5.47% (1.3864 => 1.3105, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: -5.42% (1.1530 => 1.0905, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.42% (0.4151 => 0.3926, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.42% (0.6293 => 0.5952, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.42% (0.2548 => 0.2410, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -5.40% (0.3205 => 0.3032, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.40% (6.7716 => 6.4061, std.dev.: 0.0035) MultiSource/Applications/lemon/lemon: -5.39% (1.1450 => 1.0833, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.39% (0.2933 => 0.2775, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions-2: -5.38% (0.3831 => 0.3625, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.37% (0.8521 => 0.8063, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.37% (4.5069 => 4.2647, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.37% (0.2903 => 0.2747, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -5.36% (0.3059 => 0.2895, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -5.36% (0.3880 => 0.3672, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.36% (0.3884 => 0.3676, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.35% (0.3848 => 0.3642, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -5.35% (0.3812 => 0.3608, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -5.33% (0.2985 => 0.2826, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: -5.31% (0.3896 => 0.3689, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.30% (0.4321 => 0.4092, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -5.29% (0.3481 => 0.3297, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.28% (14.2083 => 13.4585, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/random: -5.27% (0.2939 => 0.2784, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -5.27% (0.4515 => 0.4277, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.24% (0.3837 => 0.3636, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.23% (17.1032 => 16.2087, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/hello: -5.23% (0.2849 => 0.2700, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -5.22% (0.4176 => 0.3958, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -5.22% (0.2989 => 0.2833, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -5.21% (0.4033 => 0.3823, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -5.19% (0.3446 => 0.3267, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.17% (0.3016 => 0.2860, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.17% (0.5999 => 0.5689, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.17% (0.3891 => 0.3690, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -5.16% (0.3255 => 0.3087, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.15% (0.4916 => 0.4663, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.14% (0.3483 => 0.3304, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.14% (1.2221 => 1.1593, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.13% (0.4813 => 0.4566, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: -5.13% (0.3394 => 0.3220, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -5.12% (15.5079 => 14.7146, std.dev.: 0.0135) MultiSource/Benchmarks/McCat/08-main/main: -5.11% (0.2659 => 0.2523, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -5.10% (0.4861 => 0.4613, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.09% (1.2210 => 1.1589, std.dev.: 0.0034) MultiSource/Benchmarks/sim/sim: -5.08% (0.3406 => 0.3233, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -5.06% (0.4248 => 0.4033, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: -5.05% (0.3581 => 0.3400, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -5.04% (3.5154 => 3.3383, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.03% (0.6660 => 0.6325, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -5.02% (34.0927 => 32.3798, std.dev.: 0.0143) MultiSource/Applications/Burg/burg: -5.02% (1.2515 => 1.1887, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/property: -5.00% (0.4199 => 0.3989, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -5.00% (0.3621 => 0.3440, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.97% (8.0126 => 7.6143, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/except: -4.96% (0.3026 => 0.2876, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -4.93% (4.0594 => 3.8594, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.92% (0.2278 => 0.2166, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.87% (0.2999 => 0.2853, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.86% (0.6667 => 0.6343, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.86% (0.3849 => 0.3662, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: -4.83% (0.7447 => 0.7087, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.81% (0.4280 => 0.4074, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -4.79% (15.2527 => 14.5219, std.dev.: 0.0074) MultiSource/Applications/lambda-0_1_3/lambda: -4.76% (0.7982 => 0.7602, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: -4.72% (5.0226 => 4.7853, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.72% (1.6474 => 1.5697, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: -4.71% (0.3867 => 0.3685, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.70% (0.5168 => 0.4925, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.63% (0.4083 => 0.3894, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -4.59% (2.1401 => 2.0418, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -4.59% (18.2933 => 17.4532, std.dev.: 0.0136) MultiSource/Applications/siod/siod: -4.58% (2.4021 => 2.2921, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.54% (22.4056 => 21.3874, std.dev.: 0.0270) MultiSource/Benchmarks/McCat/09-vor/vor: -4.49% (0.3271 => 0.3124, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.48% (0.9557 => 0.9129, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.43% (0.3319 => 0.3172, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.39% (0.5329 => 0.5095, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.37% (0.7021 => 0.6714, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: -4.35% (0.4524 => 0.4327, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.34% (0.4427 => 0.4235, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -4.30% (0.8418 => 0.8056, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -4.21% (0.6750 => 0.6466, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -4.17% (0.3788 => 0.3630, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.09% (0.9077 => 0.8706, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.90% (0.3491 => 0.3355, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.86% (0.6347 => 0.6102, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.76% (2.2587 => 2.1738, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference-object: -3.74% (0.6441 => 0.6200, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -3.71% (1.5610 => 1.5031, std.dev.: 0.0070) SingleSource/UnitTests/ObjC++/property-reference: -3.51% (0.7779 => 0.7506, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.97% (5.4682 => 5.3056, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -2.65% (20.7746 => 20.2243, std.dev.: 0.0570) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.80% (1.8100 => 0.6914, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7526, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1723, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.87% (2.2633 => 2.1758, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4707, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 19:33:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 21:33:09 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121201033309.66DD32A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/6439?compare_to=6434&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6439, Order: 169061, Start Time: 2012-12-01 01:06:51, End Time: 2012-12-01 03:33:42 To: 6434, Order: 169030, Start Time: 2012-11-30 21:39:42, End Time: 2012-12-01 00:05:31 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 15 (138 on baseline) Performance Improvements: 3 (43 on baseline) Added Tests: 0 (186 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1070 (704 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/objects/objects: 13.66% (0.1149 => 0.1306, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.03% (0.1646 => 0.1844, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.01% (0.5893 => 0.6424, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.01% (0.6218 => 0.6778, std.dev.: 0.0150) MultiSource/Applications/lambda-0_1_3/lambda: 8.53% (0.8530 => 0.9258, std.dev.: 0.0256) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.37% (0.3371 => 0.3653, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/synchronized: 4.36% (0.3971 => 0.4144, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 4.17% (0.4127 => 0.4299, std.dev.: 0.0053) SingleSource/UnitTests/ObjC++/Hello: 3.90% (0.6495 => 0.6748, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 3.72% (0.4404 => 0.4568, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 3.21% (0.3896 => 0.4021, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 3.13% (0.3988 => 0.4113, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference-object: 2.86% (0.6702 => 0.6894, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/UnitTests/ObjC/synchronized: 339.13% (0.1053 => 0.4624, std.dev.: 0.0854) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.03% (1.5310 => 1.5468, std.dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.74% (2.5336 => 2.4389, std.dev.: 0.0339) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.41% (38.6330 => 37.3142, std.dev.: 0.4364) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/neural/neural: -4.65% (0.2343 => 0.2234, std.dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.48% (68.8096 => 69.1402, std.dev.: 0.7416) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -1.11% (0.1355 => 0.1340, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.48% (0.0420 => 0.0418, std.dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.97% (0.0680 => 0.0653, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -0.03% (494.0440 => 493.8871, std.dev.: 0.2294) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 9.32% (63.2438 => 69.1402, std.dev.: 0.7416) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43695.97% (1.1277 => 493.8871, std.dev.: 0.2294) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 194.61% (0.5229 => 1.5405, std.dev.: 0.1009) MultiSource/Applications/SPASS/SPASS: 17.81% (14.9895 => 17.6586, std.dev.: 0.5203) MultiSource/Applications/kimwitu++/kc: 48.61% (14.1553 => 21.0358, std.dev.: 0.5198) MultiSource/Benchmarks/MallocBench/gs/gs: 17.13% (4.1105 => 4.8147, std.dev.: 0.2506) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 37.26% (1.1048 => 1.5164, std.dev.: 0.0803) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 421.28% (7.1582 => 37.3142, std.dev.: 0.4364) SingleSource/Benchmarks/Misc-C++-EH/spirit: 90.83% (3.4629 => 6.6083, std.dev.: 0.1915) SingleSource/Benchmarks/Misc-C++/stepanov_container: 65.85% (0.6222 => 1.0319, std.dev.: 0.0604) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10354.58% (0.0720 => 7.5273, std.dev.: 0.3725) MultiSource/Applications/SIBsim4/SIBsim4: 3854900.00% (0.0001 => 3.8550, std.dev.: 0.0515) MultiSource/Applications/SPASS/SPASS: 14086300.00% (0.0001 => 14.0864, std.dev.: 1.6003) MultiSource/Applications/kimwitu++/kc: 51900.00% (0.0001 => 0.0520, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 64900.00% (0.0001 => 0.0650, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576200.00% (0.0001 => 0.5763, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10011800.00% (0.0001 => 10.0119, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5678700.00% (0.0001 => 5.6788, std.dev.: 0.8476) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1714.47% (1.1194 => 20.3112, std.dev.: 0.8904) MultiSource/Applications/ClamAV/clamscan: 69.24% (22.1758 => 37.5294, std.dev.: 0.2595) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 67.01% (2.9384 => 4.9075, std.dev.: 0.1401) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.02% (7.0540 => 10.7940, std.dev.: 0.3871) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.29% (8.1363 => 11.9024, std.dev.: 0.3884) MultiSource/Applications/JM/lencod/lencod: 46.28% (21.9371 => 32.0898, std.dev.: 0.3503) MultiSource/Benchmarks/FreeBench/distray/distray: 44.89% (0.1056 => 0.1530, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/flops: 43.65% (0.1432 => 0.2057, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/almabench: 41.92% (0.0730 => 0.1036, std.dev.: 0.0019) SingleSource/UnitTests/vla: 39.44% (0.0355 => 0.0495, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Oscar: 32.55% (0.0636 => 0.0843, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/messages-2: 25.98% (0.0662 => 0.0834, std.dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 24.55% (0.7433 => 0.9258, std.dev.: 0.0256) SingleSource/Benchmarks/Stanford/Towers: 24.42% (0.0471 => 0.0586, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 24.14% (1.5859 => 1.9688, std.dev.: 0.0349) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 24.11% (2.2024 => 2.7333, std.dev.: 0.1074) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.99% (0.0746 => 0.0925, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/exptree: 23.71% (0.0814 => 0.1007, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/dot-syntax-1: 23.59% (0.0479 => 0.0592, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 23.32% (0.1655 => 0.2041, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 23.11% (0.5105 => 0.6285, std.dev.: 0.0136) MultiSource/Benchmarks/McCat/08-main/main: 22.12% (0.2554 => 0.3119, std.dev.: 0.0161) MultiSource/Applications/d/make_dparser: 22.01% (3.3354 => 4.0696, std.dev.: 0.0888) SingleSource/Benchmarks/Shootout-C++/wordfreq: 21.92% (0.3307 => 0.4032, std.dev.: 0.0103) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 21.63% (0.0467 => 0.0568, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.52% (0.1566 => 0.1903, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout/matrix: 21.52% (0.0818 => 0.0994, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 21.21% (3.8922 => 4.7179, std.dev.: 0.1160) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.90% (0.5569 => 0.6733, std.dev.: 0.0214) MultiSource/Benchmarks/Olden/tsp/tsp: 20.68% (0.1175 => 0.1418, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 20.54% (1.5415 => 1.8582, std.dev.: 0.0458) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.05% (0.0793 => 0.0952, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.65% (0.4203 => 0.5029, std.dev.: 0.0220) MultiSource/Applications/lemon/lemon: 19.63% (1.0722 => 1.2827, std.dev.: 0.0596) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.45% (0.1337 => 0.1597, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/reversefile: 19.20% (0.3865 => 0.4607, std.dev.: 0.0159) SingleSource/Benchmarks/McGill/misr: 18.96% (0.0633 => 0.0753, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/whetstone: 18.94% (0.0660 => 0.0785, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/perlin: 18.66% (0.0536 => 0.0636, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.49% (0.1125 => 0.1333, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/lists: 18.37% (0.0626 => 0.0741, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 18.26% (0.0838 => 0.0991, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sieve: 18.07% (0.3603 => 0.4254, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/lists: 17.91% (0.3422 => 0.4035, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.77% (0.3826 => 0.4506, std.dev.: 0.0208) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.76% (1.4186 => 1.6705, std.dev.: 0.0356) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.58% (0.0842 => 0.0990, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/property: 17.55% (0.3886 => 0.4568, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 17.44% (0.8101 => 0.9514, std.dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/lists1: 17.35% (0.3684 => 0.4323, std.dev.: 0.0090) MultiSource/Benchmarks/McCat/05-eks/eks: 17.26% (0.4299 => 0.5041, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 17.24% (0.1114 => 0.1306, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.22% (0.0871 => 0.1021, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.92% (0.8172 => 0.9555, std.dev.: 0.0418) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.80% (14.3668 => 16.7811, std.dev.: 0.7107) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.74% (0.0675 => 0.0788, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/strcat: 16.71% (0.2831 => 0.3304, std.dev.: 0.0076) MultiSource/Applications/Burg/burg: 16.61% (1.1642 => 1.3576, std.dev.: 0.0578) SingleSource/UnitTests/SignlessTypes/rem: 16.52% (0.1144 => 0.1333, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-4: 16.51% (0.3543 => 0.4128, std.dev.: 0.0193) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.49% (0.3136 => 0.3653, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/exceptions: 16.46% (0.3828 => 0.4458, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.42% (4.9449 => 5.7569, std.dev.: 0.1773) SingleSource/UnitTests/ObjC/for-in: 16.38% (0.3694 => 0.4299, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/synchronized: 16.37% (0.3561 => 0.4144, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.33% (0.2891 => 0.3363, std.dev.: 0.0079) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.31% (0.0834 => 0.0970, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.26% (0.2872 => 0.3339, std.dev.: 0.0107) SingleSource/UnitTests/ObjC/exceptions-2: 16.13% (0.3497 => 0.4061, std.dev.: 0.0096) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.09% (0.3543 => 0.4113, std.dev.: 0.0030) SingleSource/Regression/C++/ofstream_ctor: 16.04% (0.2905 => 0.3371, std.dev.: 0.0097) SingleSource/UnitTests/ObjC/exceptions-3: 16.04% (0.3516 => 0.4080, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/hello: 16.03% (0.2714 => 0.3149, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.94% (0.0759 => 0.0880, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/lpbench: 15.93% (0.0929 => 0.1077, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wc: 15.86% (0.3052 => 0.3536, std.dev.: 0.0090) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.84% (0.0953 => 0.1104, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/trivial-interface: 15.78% (0.3473 => 0.4021, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 15.75% (0.1695 => 0.1962, std.dev.: 0.0091) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.74% (0.0648 => 0.0750, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.69% (0.0886 => 0.1025, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/matrix: 15.66% (0.3098 => 0.3583, std.dev.: 0.0111) SingleSource/Benchmarks/Stanford/Puzzle: 15.54% (0.1268 => 0.1465, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.51% (5.0018 => 5.7776, std.dev.: 0.1956) MultiSource/Applications/viterbi/viterbi: 15.31% (0.1555 => 0.1793, std.dev.: 0.0065) MultiSource/Applications/minisat/minisat: 15.28% (0.7115 => 0.8202, std.dev.: 0.0413) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.25% (0.3121 => 0.3597, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.19% (0.0770 => 0.0887, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.13% (0.1117 => 0.1286, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.94% (0.0770 => 0.0885, std.dev.: 0.0044) MultiSource/Benchmarks/NPB-serial/is/is: 14.74% (0.0719 => 0.0825, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.43% (0.9765 => 1.1174, std.dev.: 0.0439) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.41% (0.4636 => 0.5304, std.dev.: 0.0256) SingleSource/UnitTests/ObjC++/property-reference-object: 14.33% (0.6030 => 0.6894, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.13% (0.5981 => 0.6826, std.dev.: 0.0233) SingleSource/UnitTests/ObjC/parameter-passing: 14.11% (0.3927 => 0.4481, std.dev.: 0.0072) SingleSource/UnitTests/ObjC++/Hello: 13.89% (0.5925 => 0.6748, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 13.77% (0.3109 => 0.3537, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.72% (0.5860 => 0.6664, std.dev.: 0.0284) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.65% (0.1062 => 0.1207, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.53% (0.0798 => 0.0906, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.48% (0.1625 => 0.1844, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/ReedSolomon: 13.18% (0.2049 => 0.2319, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.12% (1.3050 => 1.4762, std.dev.: 0.0612) SingleSource/Benchmarks/Misc-C++/bigfib: 12.92% (0.6456 => 0.7290, std.dev.: 0.0217) MultiSource/Applications/sqlite3/sqlite3: 12.12% (17.1811 => 19.2640, std.dev.: 0.7448) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.94% (0.1143 => 0.1268, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: 10.80% (0.7326 => 0.8117, std.dev.: 0.0111) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.75% (2.2022 => 2.4389, std.dev.: 0.0339) SingleSource/Benchmarks/Misc/oourafft: 9.63% (0.3282 => 0.3598, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/fibo: 8.95% (0.2725 => 0.2969, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.74% (0.2756 => 0.2997, std.dev.: 0.0093) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.81% (0.3817 => 0.4115, std.dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- SingleSource/UnitTests/ObjC/synchronized: 339.96% (0.1051 => 0.4624, std.dev.: 0.0854) SingleSource/Benchmarks/Shootout/methcall: 149.28% (4.3953 => 10.9568, std.dev.: 0.0369) SingleSource/Benchmarks/Shootout-C++/methcall: 147.18% (5.3999 => 13.3477, std.dev.: 0.0079) MultiSource/Benchmarks/SciMark2-C/scimark2: 80.04% (32.5116 => 58.5337, std.dev.: 0.0388) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.75% (13.4384 => 16.3612, std.dev.: 0.9465) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.01% (1.1145 => 1.3041, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/oourafft: 16.12% (6.6465 => 7.7182, std.dev.: 0.0130) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.25% (0.2944 => 0.3334, std.dev.: 0.0140) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.55% (2.8904 => 3.2241, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 10.18% (1.1396 => 1.2556, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.23% (1.7254 => 1.8846, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.94% (0.9540 => 1.0107, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.69% (4.2280 => 4.4684, std.dev.: 0.0085) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.07% (26.0924 => 27.1551, std.dev.: 0.3080) MultiSource/Benchmarks/nbench/nbench: 4.03% (11.6436 => 12.1124, std.dev.: 0.0072) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.34% (0.4162 => 0.4301, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.12% (1.3677 => 1.3967, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 2.07% (3.1595 => 3.2248, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 1.59% (1.7133 => 1.7406, std.dev.: 0.0066) MultiSource/Benchmarks/PAQ8p/paq8p: 1.37% (85.0658 => 86.2318, std.dev.: 0.3161) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.31% (6.5088 => 6.5938, std.dev.: 0.0105) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0313 => 1.0441, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 1.19% (5.9798 => 6.0509, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.50% (6.6874 => 0.1669, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.56% (5.2763 => 1.2368, std.dev.: 0.0719) SingleSource/Benchmarks/Misc/salsa20: -74.73% (0.8651 => 0.2186, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: -40.07% (0.1622 => 0.0972, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.84% (5.3855 => 4.6940, std.dev.: 0.1735) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.24% (5.3526 => 4.6972, std.dev.: 0.1564) MultiSource/Applications/JM/ldecod/ldecod: -10.95% (10.4361 => 9.2931, std.dev.: 0.4128) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -9.86% (1.7609 => 1.5872, std.dev.: 0.0628) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -65.00% (1.9577 => 0.6851, std.dev.: 0.0127) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1681, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.36% (0.0628 => 0.0362, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.32% (0.0506 => 0.0302, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.31% (0.3987 => 0.2380, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.29% (4.5009 => 2.7775, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.13% (2.6546 => 2.0141, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/mason/mason: -19.07% (0.2161 => 0.1749, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4225, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.67% (2.6778 => 2.2849, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -10.67% (1.5373 => 1.3733, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -10.53% (9.5636 => 8.5564, std.dev.: 0.2033) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.71% (1.5660 => 1.4296, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.20% (19.9488 => 18.3125, std.dev.: 0.5736) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.81% (3.2416 => 3.0207, std.dev.: 0.0198) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.61% (2.7294 => 2.5762, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7497, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.21% (0.2497 => 0.2367, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.15% (0.8614 => 0.8170, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5054, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.50% (1.6805 => 1.6048, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout/lists: -4.34% (6.2999 => 6.0262, std.dev.: 0.0212) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.43% (0.9957 => 0.9615, std.dev.: 0.0078) MultiSource/Benchmarks/sim/sim: -3.10% (5.0483 => 4.8919, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.43% (0.4808 => 0.4691, std.dev.: 0.0014) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6769, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.75% (8.1563 => 8.0134, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/salsa20: -1.49% (10.2830 => 10.1293, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.76% (0.1485 => 0.1340, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.14% (0.2116 => 0.0653, std.dev.: 0.0012) Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 19:52:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 21:52:09 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121201035209.BCBCF2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/6440?compare_to=6436&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6440, Order: 169073, Start Time: 2012-12-01 02:15:48, End Time: 2012-12-01 03:52:47 To: 6436, Order: 169059, Start Time: 2012-12-01 00:17:18, End Time: 2012-12-01 01:57:44 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 4 (64 on baseline) Performance Improvements: 10 (39 on baseline) Added Tests: 0 (51 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1039 (871 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/18-imp/imp: 13.83% (0.3665 => 0.4172, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.64% (0.8672 => 0.8814, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.54% (0.9086 => 0.9226, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 4.28% (2.1047 => 2.1947, std.dev.: 0.0096) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Threads/tls: -48.60% (0.0286 => 0.0147, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -24.66% (0.0880 => 0.0663, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.58% (0.5014 => 0.4734, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.05% (0.9592 => 0.9299, std.dev.: 0.0102) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/lpbench: -5.79% (4.3664 => 4.1137, std.dev.: 0.0741) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -3.42% (22.8247 => 22.0443, std.dev.: 0.1900) SingleSource/Benchmarks/Shootout-C++/ary3: -3.13% (1.7937 => 1.7376, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout/ary3: -1.88% (2.1344 => 2.0943, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.58% (2.8323 => 2.7876, std.dev.: 0.0091) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.28% (9.3225 => 9.2031, std.dev.: 0.0369) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.65% (1.0769 => 1.0839, std.dev.: 0.0299) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.24% (0.3715 => 0.3706, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.31% (0.0232 => 0.0222, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.25% (0.0445 => 0.0435, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -5.90% (0.0356 => 0.0335, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -4.53% (0.0331 => 0.0316, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.47% (0.0427 => 0.0425, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 0.98% (0.0205 => 0.0207, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -11.24% (0.0249 => 0.0221, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.93% (0.1511 => 0.1497, std.dev.: 0.0110) MultiSource/Applications/lemon/lemon: 3.25% (1.2094 => 1.2487, std.dev.: 0.1958) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.48% (0.3995 => 0.4054, std.dev.: 0.0277) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.38% (0.1511 => 0.1460, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.47% (0.0639 => 0.0642, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 23.15% (0.0216 => 0.0266, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.46% (0.0624 => 0.0565, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.17% (1.1498 => 1.1478, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -23.08% (0.0026 => 0.0020, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.33% (0.0605 => 0.0603, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 13.73% (0.0233 => 0.0265, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.29% (0.8061 => 0.8038, std.dev.: 0.0289) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -27.64% (0.0123 => 0.0089, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.08% (8.6199 => 8.6271, std.dev.: 0.0071) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 11.12% (16.4461 => 18.2746, std.dev.: 0.3311) MultiSource/Applications/sqlite3/sqlite3: 2402.48% (0.6332 => 15.8457, std.dev.: 0.6107) MultiSource/Benchmarks/McCat/08-main/main: 51.45% (0.1831 => 0.2773, std.dev.: 0.0531) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.43% (0.1559 => 0.1490, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7085.17% (0.3123 => 22.4393, std.dev.: 1.1824) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1529.58% (0.3344 => 5.4493, std.dev.: 0.2608) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.73% (0.2364 => 0.3256, std.dev.: 0.0346) SingleSource/Benchmarks/Misc-C++/bigfib: 5.24% (0.6010 => 0.6325, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/mandel: 4.66% (0.0429 => 0.0449, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.48% (0.3266 => 0.3445, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/strcat: 3.61% (0.1969 => 0.2040, std.dev.: 0.0587) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.93% (0.0224 => 0.0244, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -24.78% (0.0230 => 0.0173, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0514, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 12.72% (0.1462 => 0.1648, std.dev.: 0.0103) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4349, std.dev.: 0.0380) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0680, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4897, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5177, std.dev.: 0.0895) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2641, std.dev.: 0.0251) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0738, std.dev.: 0.0283) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3616, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3620, std.dev.: 0.0850) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0840, std.dev.: 0.0172) SingleSource/Regression/C/uint64_to_float: -29.93% (2.1832 => 1.5298, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.00% (0.0810 => 0.0972, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/18-imp/imp: 19.10% (0.3503 => 0.4172, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 15.38% (0.1112 => 0.1283, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.55% (0.2180 => 0.2410, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.99% (0.4127 => 0.4498, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 8.53% (0.6287 => 0.6823, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.98% (0.2279 => 0.2438, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.91% (0.2519 => 0.2693, std.dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: 6.76% (0.9810 => 1.0473, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 6.11% (0.8697 => 0.9228, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 5.98% (0.8317 => 0.8814, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 5.93% (0.8316 => 0.8809, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.85% (0.8716 => 0.9226, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.80% (0.9688 => 1.0250, std.dev.: 0.0153) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.68% (0.6227 => 0.6581, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 5.48% (0.9074 => 0.9571, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 4.69% (0.9039 => 0.9463, std.dev.: 0.0083) MultiSource/Applications/minisat/minisat: 4.59% (0.6834 => 0.7148, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.58% (0.7966 => 0.8331, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.40% (0.8656 => 0.9037, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 4.31% (0.8261 => 0.8617, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.26% (0.8050 => 0.8393, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 4.24% (0.8805 => 0.9178, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.18% (0.8066 => 0.8403, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 4.17% (0.8927 => 0.9299, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.07% (1.2602 => 1.3115, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.06% (0.8331 => 0.8669, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.96% (0.8086 => 0.8406, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.37% (0.8359 => 0.8641, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/moments: 2.91% (0.3645 => 0.3751, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 198.78% (28.5821 => 85.3979, std.dev.: 0.3070) SingleSource/Benchmarks/Misc/pi: 38.95% (1.5795 => 2.1947, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 27.68% (2.9096 => 3.7150, std.dev.: 0.0438) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.28% (4.8436 => 5.8744, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 19.51% (0.0528 => 0.0631, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 18.01% (0.7597 => 0.8965, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.78% (8.2783 => 9.7500, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.69% (2.7995 => 3.1269, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.39% (6.3772 => 7.1036, std.dev.: 0.0699) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.36% (0.1129 => 0.1246, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 10.36% (7.4933 => 8.2694, std.dev.: 0.0320) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 9.78% (1.1857 => 1.3017, std.dev.: 0.0150) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.78% (3.9917 => 4.3023, std.dev.: 0.0584) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.35% (23.5781 => 25.3113, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.50% (2.2485 => 2.3947, std.dev.: 0.0472) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.31% (3.3761 => 3.5890, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.95% (4.8660 => 5.1555, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.87% (4.5327 => 4.7988, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.86% (2.9753 => 3.1497, std.dev.: 0.0506) SingleSource/Benchmarks/CoyoteBench/lpbench: 5.46% (3.9006 => 4.1137, std.dev.: 0.0741) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.41% (0.3937 => 0.4150, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.33% (5.3218 => 5.6053, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 5.21% (0.2015 => 0.2120, std.dev.: 0.0037) MultiSource/Applications/aha/aha: 4.95% (3.3398 => 3.5050, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.90% (5.4187 => 5.6844, std.dev.: 0.0282) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.87% (0.5214 => 0.5468, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 4.03% (4.8362 => 5.0310, std.dev.: 0.0376) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 3.49% (0.4353 => 0.4505, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/power/power: 3.08% (1.2061 => 1.2432, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/methcall: 1.97% (8.2676 => 8.4305, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.78% (11.5690 => 11.7753, std.dev.: 0.0187) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.30% (5.8421 => 5.9183, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.25% (4.9469 => 5.0087, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-3: 1.07% (2.0670 => 2.0891, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.16% (2.8951 => 1.6746, std.dev.: 0.0594) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -24.57% (7.2130 => 5.4407, std.dev.: 0.0798) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.26% (1.4529 => 1.1585, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -17.08% (9.9065 => 8.2149, std.dev.: 0.0188) SingleSource/Benchmarks/Shootout-C++/ary3: -13.12% (1.9999 => 1.7376, std.dev.: 0.0199) MultiSource/Benchmarks/Olden/em3d/em3d: -12.71% (5.4641 => 4.7694, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/flops-8: -9.37% (2.5609 => 2.3209, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: -9.03% (63.1822 => 57.4768, std.dev.: 0.0385) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.02% (1.0512 => 0.9669, std.dev.: 0.0113) SingleSource/Benchmarks/Stanford/FloatMM: -6.43% (0.8807 => 0.8241, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.20% (4.7482 => 4.4537, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.03% (5.1305 => 4.8210, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/sieve: -6.01% (7.0599 => 6.6353, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.37% (6.2275 => 5.8928, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/flops: -5.33% (9.3748 => 8.8751, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.83% (5.6343 => 5.3624, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.49% (4.7449 => 4.5319, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.45% (6.1706 => 5.8958, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.29% (4.9453 => 4.7331, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/methcall: -3.84% (8.9760 => 8.6316, std.dev.: 0.0767) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.80% (3.7148 => 3.5737, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/perlin: -3.74% (5.1084 => 4.9173, std.dev.: 0.0227) MultiSource/Applications/siod/siod: -3.44% (3.6643 => 3.5381, std.dev.: 0.0282) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.26% (4.9686 => 4.8065, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.26% (5.4300 => 5.2531, std.dev.: 0.0197) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.12% (2.8773 => 2.7876, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout/hash: -2.45% (4.3087 => 4.2033, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/fbench: -2.38% (3.3840 => 3.3036, std.dev.: 0.0108) SingleSource/Benchmarks/Dhrystone/fldry: -2.20% (0.6910 => 0.6758, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.93% (3.3479 => 3.2834, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-5: -1.91% (2.8957 => 2.8403, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -1.91% (0.5807 => 0.5696, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -1.67% (2.4416 => 2.4009, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/fp-convert: -1.59% (15.8853 => 15.6329, std.dev.: 0.0347) MultiSource/Benchmarks/FreeBench/neural/neural: -1.41% (1.0841 => 1.0688, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.36% (3.5679 => 3.5193, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.22% (4.2466 => 4.1948, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.21% (4.7794 => 4.7215, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.03% (9.2989 => 9.2031, std.dev.: 0.0369) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 5.62% (1.0262 => 1.0839, std.dev.: 0.0299) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.47% (0.2463 => 0.3706, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 80.49% (0.0123 => 0.0222, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 6.62% (0.0408 => 0.0435, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.89% (0.0254 => 0.0335, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 8.95% (0.0190 => 0.0207, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 22.78% (0.0180 => 0.0221, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.10% (0.1438 => 0.1497, std.dev.: 0.0110) MultiSource/Applications/lemon/lemon: 10.22% (1.1329 => 1.2487, std.dev.: 0.1958) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.64% (0.4164 => 0.4054, std.dev.: 0.0277) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.65% (0.1369 => 0.1460, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.16% (0.0641 => 0.0642, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 36.41% (0.0195 => 0.0266, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.25% (0.0578 => 0.0565, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.36% (1.1437 => 1.1478, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 42.86% (0.0014 => 0.0020, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.83% (0.0627 => 0.0603, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.22% (0.0180 => 0.0265, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.26% (0.8017 => 0.8038, std.dev.: 0.0289) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 43.55% (0.0062 => 0.0089, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 21:27:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 23:27:03 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121201052703.D36BD2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/6441?compare_to=6438&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6441, Order: 169077, Start Time: 2012-12-01 03:52:39, End Time: 2012-12-01 05:27:38 To: 6438, Order: 169072, Start Time: 2012-12-01 01:54:58, End Time: 2012-12-01 03:29:43 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (6 on baseline) Performance Improvements: 1 (186 on baseline) Added Tests: 0 (52 on baseline) Unchanged Tests: 1093 (850 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -6.66% (0.4308 => 0.4021, std.dev.: 0.0058) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.88% (0.3834 => 0.4021, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 75.02% (31.3723 => 54.9090, std.dev.: 0.0149) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1015, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.4937 => 7.6822, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/hash2: 2.38% (3.1932 => 3.2693, std.dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.01% (0.1431 => 0.1302, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.93% (0.3821 => 0.3518, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.63% (0.9542 => 0.8814, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.02% (2.4924 => 2.3174, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.75% (0.3142 => 0.2930, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.55% (0.3357 => 0.3137, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.43% (0.2428 => 0.2272, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -6.34% (0.2160 => 0.2023, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.31% (0.3884 => 0.3639, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -6.26% (0.3831 => 0.3591, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-4: -6.26% (0.3880 => 0.3637, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.24% (0.1796 => 0.1684, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -6.21% (0.3848 => 0.3609, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.19% (0.3812 => 0.3576, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.19% (0.3896 => 0.3655, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -6.12% (0.4033 => 0.3786, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -6.08% (0.4176 => 0.3922, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.08% (0.5478 => 0.5145, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.07% (0.3891 => 0.3655, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -6.02% (16.1920 => 15.2177, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/ReedSolomon: -6.01% (0.1879 => 0.1766, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: -6.00% (7.0961 => 6.6700, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -5.99% (9.2283 => 8.6757, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.97% (0.6484 => 0.6097, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: -5.96% (0.1761 => 0.1656, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.96% (0.5857 => 0.5508, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.94% (0.2355 => 0.2215, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.93% (0.3658 => 0.3441, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.93% (0.9852 => 0.9268, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.92% (0.7198 => 0.6772, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.91% (0.5859 => 0.5513, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.87% (0.5805 => 0.5464, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.86% (0.3057 => 0.2878, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.84% (1.3722 => 1.2920, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.84% (0.5567 => 0.5242, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.83% (0.5863 => 0.5521, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.81% (0.5591 => 0.5266, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.81% (0.5575 => 0.5251, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -5.81% (0.4199 => 0.3955, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.80% (4.8161 => 4.5367, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.80% (0.5849 => 0.5510, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.79% (0.5581 => 0.5258, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.78% (0.7339 => 0.6915, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.77% (0.3931 => 0.3704, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.77% (6.7716 => 6.3808, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.77% (0.7524 => 0.7090, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.77% (1.0544 => 0.9936, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: -5.76% (0.9179 => 0.8650, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.76% (4.0323 => 3.8001, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.72% (0.6395 => 0.6029, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.72% (4.8802 => 4.6009, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.72% (0.6052 => 0.5706, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.71% (0.5688 => 0.5363, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.70% (0.5802 => 0.5471, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.70% (0.5925 => 0.5587, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.70% (0.5456 => 0.5145, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.69% (0.6033 => 0.5690, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.68% (0.6230 => 0.5876, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.68% (1.3148 => 1.2401, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.66% (1.2300 => 1.1604, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.66% (0.5941 => 0.5605, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.65% (0.6260 => 0.5906, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.65% (0.6304 => 0.5948, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.63% (0.6676 => 0.6300, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -5.63% (0.4280 => 0.4039, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.61% (0.6395 => 0.6036, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.61% (0.6297 => 0.5944, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.60% (1.6364 => 1.5448, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.58% (0.5569 => 0.5258, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.58% (0.6736 => 0.6360, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.58% (4.5069 => 4.2555, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.57% (0.6189 => 0.5844, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.57% (0.2871 => 0.2711, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.57% (0.3323 => 0.3138, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.57% (0.3252 => 0.3071, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.57% (0.5570 => 0.5260, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -5.56% (0.3059 => 0.2889, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.56% (0.7919 => 0.7479, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.55% (0.6194 => 0.5850, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -5.55% (0.3025 => 0.2857, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.55% (1.4642 => 1.3830, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.54% (0.6440 => 0.6083, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.54% (2.1713 => 2.0511, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.53% (3.5339 => 3.3385, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.53% (0.2695 => 0.2546, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.52% (0.6681 => 0.6312, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -5.51% (0.2939 => 0.2777, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.51% (0.6446 => 0.6091, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.49% (0.2933 => 0.2772, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.49% (0.5705 => 0.5392, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -5.48% (1.3864 => 1.3104, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: -5.48% (4.3330 => 4.0955, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: -5.46% (1.1530 => 1.0901, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.45% (0.6293 => 0.5950, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -5.45% (0.4515 => 0.4269, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.45% (0.3837 => 0.3628, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.45% (0.8521 => 0.8057, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.44% (0.4151 => 0.3925, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.44% (1.2784 => 1.2088, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.42% (0.3194 => 0.3021, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.42% (0.2548 => 0.2410, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -5.42% (0.2659 => 0.2515, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.41% (0.2903 => 0.2746, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -5.40% (0.3205 => 0.3032, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -5.37% (0.2849 => 0.2696, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -5.34% (0.3446 => 0.3262, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -5.33% (0.2985 => 0.2826, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.32% (0.4321 => 0.4091, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -5.31% (0.3481 => 0.3296, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -5.31% (1.1450 => 1.0842, std.dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.28% (0.4813 => 0.4559, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -5.27% (0.3394 => 0.3215, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.27% (0.5999 => 0.5683, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.25% (0.4916 => 0.4658, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.23% (14.2083 => 13.4654, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/strcat: -5.22% (0.2989 => 0.2833, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: -5.19% (0.3581 => 0.3395, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.19% (8.0126 => 7.5965, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/matrix: -5.19% (0.3255 => 0.3086, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -5.18% (0.4861 => 0.4609, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -5.18% (17.1032 => 16.2178, std.dev.: 0.0189) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.14% (0.3483 => 0.3304, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -5.14% (0.3406 => 0.3231, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -5.14% (15.5079 => 14.7115, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.11% (0.3016 => 0.2862, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.09% (0.2278 => 0.2162, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -5.08% (0.3621 => 0.3437, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.08% (1.2210 => 1.1590, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.07% (0.2385 => 0.2264, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.07% (1.2221 => 1.1601, std.dev.: 0.0064) MultiSource/Applications/d/make_dparser: -5.06% (3.5154 => 3.3376, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: -5.06% (0.3026 => 0.2873, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -5.04% (34.0927 => 32.3731, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/moments: -5.04% (0.4248 => 0.4034, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -5.03% (1.2515 => 1.1886, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.99% (0.3849 => 0.3657, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.90% (0.2999 => 0.2852, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -4.89% (15.2527 => 14.5064, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/lists1: -4.86% (0.3867 => 0.3679, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.85% (0.6660 => 0.6337, std.dev.: 0.0057) MultiSource/Applications/lua/lua: -4.85% (4.0594 => 3.8626, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.78% (0.6667 => 0.6348, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.78% (0.7447 => 0.7091, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.65% (0.4083 => 0.3893, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: -4.65% (0.3271 => 0.3119, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.64% (1.6474 => 1.5710, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -4.64% (0.7982 => 0.7612, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -4.62% (2.1401 => 2.0412, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.59% (0.5168 => 0.4931, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.46% (0.3319 => 0.3171, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.45% (22.4056 => 21.4095, std.dev.: 0.0171) MultiSource/Applications/spiff/spiff: -4.44% (0.8418 => 0.8044, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.44% (0.9077 => 0.8674, std.dev.: 0.0043) MultiSource/Applications/kimwitu++/kc: -4.42% (18.2933 => 17.4840, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.42% (0.9557 => 0.9135, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -4.38% (0.4524 => 0.4326, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.29% (5.0226 => 4.8073, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.27% (0.7021 => 0.6721, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -4.27% (2.4021 => 2.2996, std.dev.: 0.0152) SingleSource/Benchmarks/Misc-C++/bigfib: -4.25% (0.6750 => 0.6463, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.22% (0.4427 => 0.4240, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -4.14% (0.3788 => 0.3631, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.10% (0.6347 => 0.6087, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.07% (0.5329 => 0.5112, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.99% (0.6441 => 0.6184, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.84% (2.2587 => 2.1720, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.81% (0.3491 => 0.3358, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -3.80% (1.5610 => 1.5017, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: -3.72% (0.7779 => 0.7490, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.93% (5.4682 => 5.3082, std.dev.: 0.0128) SingleSource/UnitTests/Vector/constpool: -2.55% (20.7746 => 20.2442, std.dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.23% (1.8100 => 0.6836, std.dev.: 0.0059) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7515, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -8.73% (1.2842 => 1.1721, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.93% (1.7753 => 1.7055, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.68% (2.2633 => 2.1800, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.64% (6.5735 => 6.4654, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0217 => 1.0105) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 2.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 21:44:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 30 Nov 2012 23:44:28 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121201054428.96F9A2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/6442?compare_to=6440&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6442, Order: 169077, Start Time: 2012-12-01 04:09:49, End Time: 2012-12-01 05:45:05 To: 6440, Order: 169073, Start Time: 2012-12-01 02:15:48, End Time: 2012-12-01 03:52:47 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 4 (98 on baseline) Performance Improvements: 8 (39 on baseline) Added Tests: 0 (51 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1041 (837 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.40% (0.8601 => 0.8721, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.37% (0.9178 => 0.9304, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.32% (0.8641 => 0.8755, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.09% (0.2035 => 0.2159, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/18-imp/imp: -15.51% (0.4172 => 0.3525, std.dev.: 0.0214) MultiSource/Benchmarks/McCat/05-eks/eks: -2.44% (0.4670 => 0.4556, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.85% (0.8809 => 0.8646, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.64% (0.9226 => 0.9075, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: -3.52% (4.2942 => 4.1432, std.dev.: 0.0265) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.36% (0.3635 => 0.3513, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/lists1: -3.14% (0.6281 => 0.6084, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/primes/primes: -2.60% (0.8965 => 0.8732, std.dev.: 0.0086) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.18% (1.0839 => 1.0859, std.dev.: 0.0545) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.03% (0.3706 => 0.3705, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.90% (0.0222 => 0.0220, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.15% (0.0435 => 0.0430, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.30% (0.0335 => 0.0334, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0316 => 0.0317, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0425 => 0.0427, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -1.45% (0.0207 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -16.74% (0.0221 => 0.0184, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: - (0.1497 => 0.1497, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -14.34% (1.2487 => 1.0696, std.dev.: 0.1911) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.75% (0.4054 => 0.3983, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.81% (0.1460 => 0.1419, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.79% (0.0642 => 0.0592, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.38% (0.0266 => 0.0265, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.30% (0.0565 => 0.0578, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.17% (1.1478 => 1.1498, std.dev.: 0.0162) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -95.00% (0.0020 => 0.0001, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.50% (0.0603 => 0.0600, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.08% (0.0265 => 0.0233, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.8038 => 0.8038, std.dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -30.34% (0.0089 => 0.0062, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.21% (8.6271 => 8.6089, std.dev.: 0.0175) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.59% (16.4461 => 17.8593, std.dev.: 0.5739) MultiSource/Applications/sqlite3/sqlite3: 2341.96% (0.6332 => 15.4625, std.dev.: 0.5866) MultiSource/Benchmarks/McCat/08-main/main: 49.86% (0.1831 => 0.2744, std.dev.: 0.0310) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.91% (0.1559 => 0.1498, std.dev.: 0.0280) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7122.03% (0.3123 => 22.5544, std.dev.: 0.3314) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1545.16% (0.3344 => 5.5014, std.dev.: 0.0921) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.11% (0.2364 => 0.3265, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/bigfib: 4.59% (0.6010 => 0.6286, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/mandel: 3.50% (0.0429 => 0.0444, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.29% (0.3266 => 0.3406, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/strcat: 2.79% (0.1969 => 0.2024, std.dev.: 0.0046) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.68% (0.0224 => 0.0230, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: -51.74% (0.0230 => 0.0111, std.dev.: 0.0031) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0514, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 12.38% (0.1462 => 0.1643, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4125, std.dev.: 0.0558) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0682, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4949, std.dev.: 0.0439) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5212, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2550, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0635, std.dev.: 0.0496) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3630, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3821, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0853, std.dev.: 0.0005) SingleSource/Regression/C/uint64_to_float: -29.93% (2.1832 => 1.5297, std.dev.: 0.0091) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.63% (0.0810 => 0.0969, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.61% (0.0830 => 0.0943, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.15% (0.0848 => 0.0951, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.13% (0.8321 => 0.9081, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.09% (0.4127 => 0.4502, std.dev.: 0.0107) MultiSource/Applications/spiff/spiff: 8.58% (0.7950 => 0.8632, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.86% (0.1425 => 0.1537, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 7.53% (0.3226 => 0.3469, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.31% (0.1983 => 0.2128, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.23% (13.1811 => 14.0029, std.dev.: 0.2623) MultiSource/Applications/treecc/treecc: 6.19% (1.9948 => 2.1182, std.dev.: 0.0220) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.78% (1.2526 => 1.3250, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 5.67% (0.8805 => 0.9304, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.58% (1.6386 => 1.7300, std.dev.: 0.0239) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 5.28% (0.8697 => 0.9156, std.dev.: 0.0126) MultiSource/Applications/siod/siod: 5.24% (2.2184 => 2.3347, std.dev.: 0.0254) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.18% (0.5191 => 0.5460, std.dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 5.16% (14.2605 => 14.9968, std.dev.: 0.2460) MultiSource/Benchmarks/nbench/nbench: 5.02% (1.1271 => 1.1837, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.95% (0.8611 => 0.9037, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.94% (0.9688 => 1.0167, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.91% (0.4783 => 0.5018, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.75% (0.9074 => 0.9505, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 4.74% (0.8359 => 0.8755, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.65% (4.1763 => 4.3705, std.dev.: 0.0612) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.61% (0.8656 => 0.9055, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 4.59% (0.8597 => 0.8992, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 4.58% (0.9069 => 0.9484, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 4.57% (0.8007 => 0.8373, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4.57% (0.8317 => 0.8697, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.57% (0.8340 => 0.8721, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.56% (0.8518 => 0.8906, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.53% (0.8457 => 0.8840, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 4.52% (0.8177 => 0.8547, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.47% (0.8420 => 0.8796, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 4.38% (0.8855 => 0.9243, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 4.36% (0.9039 => 0.9433, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 4.30% (0.8261 => 0.8616, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.27% (0.9056 => 0.9443, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 4.25% (0.8204 => 0.8553, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.19% (0.8050 => 0.8387, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.18% (0.8069 => 0.8406, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.12% (0.8716 => 0.9075, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 4.08% (0.8927 => 0.9291, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.07% (0.8066 => 0.8394, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.06% (0.8885 => 0.9246, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.02% (0.7932 => 0.8251, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 4.00% (0.8048 => 0.8370, std.dev.: 0.0056) MultiSource/Benchmarks/PAQ8p/paq8p: 4.00% (2.3764 => 2.4714, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.97% (0.8316 => 0.8646, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.86% (0.8286 => 0.8606, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.80% (0.8338 => 0.8655, std.dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: 3.78% (15.3280 => 15.9078, std.dev.: 0.1523) MultiSource/Benchmarks/McCat/05-eks/eks: 3.62% (0.4397 => 0.4556, std.dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: 3.52% (8.6247 => 8.9285, std.dev.: 0.0532) MultiSource/Applications/d/make_dparser: 3.28% (3.2366 => 3.3426, std.dev.: 0.0320) MultiSource/Applications/JM/ldecod/ldecod: 3.14% (6.7320 => 6.9433, std.dev.: 0.0794) MultiSource/Benchmarks/Bullet/bullet: 2.56% (31.8598 => 32.6739, std.dev.: 0.2395) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 198.53% (28.5821 => 85.3258, std.dev.: 0.1068) SingleSource/Benchmarks/Misc/pi: 38.98% (1.5795 => 2.1952, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 28.36% (2.9096 => 3.7349, std.dev.: 0.1043) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.20% (4.8436 => 5.8704, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.88% (8.2783 => 9.7586, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/misr: 15.67% (0.4001 => 0.4628, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 14.94% (0.7597 => 0.8732, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.44% (2.7995 => 3.1197, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.29% (1.1857 => 1.3077, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.26% (0.3186 => 0.3513, std.dev.: 0.0044) MultiSource/Applications/lambda-0_1_3/lambda: 10.25% (7.4933 => 8.2615, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.96% (6.3772 => 7.0125, std.dev.: 0.0954) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.96% (3.0515 => 3.3249, std.dev.: 0.1046) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 7.94% (0.2015 => 0.2175, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.35% (23.5781 => 25.3109, std.dev.: 0.0966) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.24% (3.9917 => 4.2808, std.dev.: 0.0756) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.51% (0.2027 => 0.2159, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.51% (1.0388 => 1.1064, std.dev.: 0.0217) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.33% (3.3761 => 3.5897, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 6.01% (4.8660 => 5.1586, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.92% (2.9753 => 3.1515, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.78% (4.5327 => 4.7945, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.41% (0.3937 => 0.4150, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 5.24% (0.4353 => 0.4581, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.17% (5.3218 => 5.5970, std.dev.: 0.0041) MultiSource/Applications/aha/aha: 4.88% (3.3398 => 3.5029, std.dev.: 0.0251) SingleSource/Benchmarks/Misc/richards_benchmark: 4.27% (1.3037 => 1.3594, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 3.97% (0.5214 => 0.5421, std.dev.: 0.0034) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.88% (0.2887 => 0.2999, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: 3.17% (1.2061 => 1.2443, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.26% (3.4104 => 3.4874, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/queens: 2.18% (1.7056 => 1.7428, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/dry: 2.16% (0.5081 => 0.5191, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/methcall: 1.98% (8.2676 => 8.4317, std.dev.: 0.0361) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.52% (11.5690 => 11.7452, std.dev.: 0.0121) MultiSource/Applications/spiff/spiff: 1.45% (2.8561 => 2.8976, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/ReedSolomon: 1.33% (8.5322 => 8.6459, std.dev.: 0.0221) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.26% (4.9469 => 5.0092, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.12% (11.5316 => 11.6609, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.11% (1.9302 => 1.9517, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.29% (2.8951 => 1.6707, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -23.59% (7.2130 => 5.5111, std.dev.: 0.2430) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.95% (1.4529 => 1.1485, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.92% (9.9065 => 8.2308, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/ary3: -13.36% (1.9999 => 1.7327, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/em3d/em3d: -12.80% (5.4641 => 4.7645, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/flops-8: -9.76% (2.5609 => 2.3110, std.dev.: 0.0139) SingleSource/Benchmarks/McGill/chomp: -9.36% (1.1216 => 1.0166, std.dev.: 0.0382) MultiSource/Benchmarks/mafft/pairlocalalign: -9.15% (63.1822 => 57.4036, std.dev.: 0.0420) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.69% (0.3269 => 0.2985, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.28% (1.0512 => 0.9642, std.dev.: 0.0026) SingleSource/Benchmarks/Stanford/FloatMM: -6.65% (0.8807 => 0.8221, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.44% (4.7482 => 4.4423, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.14% (5.1305 => 4.8155, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: -6.13% (7.0599 => 6.6273, std.dev.: 0.0261) SingleSource/Benchmarks/Misc/flops: -5.55% (9.3748 => 8.8547, std.dev.: 0.0585) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.35% (6.2275 => 5.8945, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.99% (2.8773 => 2.7337, std.dev.: 0.0356) SingleSource/Benchmarks/Misc/ffbench: -4.99% (1.4296 => 1.3583, std.dev.: 0.0146) SingleSource/Benchmarks/Misc/himenobmtxpa: -4.87% (4.3552 => 4.1432, std.dev.: 0.0265) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.84% (5.6343 => 5.3616, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.53% (4.7449 => 4.5298, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.45% (6.1706 => 5.8960, std.dev.: 0.0381) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.34% (4.9453 => 4.7307, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -3.76% (3.6643 => 3.5266, std.dev.: 0.0302) SingleSource/Benchmarks/Misc/perlin: -3.74% (5.1084 => 4.9171, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.64% (5.1557 => 4.9679, std.dev.: 0.0505) SingleSource/Benchmarks/Shootout-C++/methcall: -3.37% (8.9760 => 8.6733, std.dev.: 0.0322) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.28% (4.9686 => 4.8058, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.21% (5.4300 => 5.2557, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/hash: -2.75% (4.3087 => 4.1903, std.dev.: 0.0455) SingleSource/Benchmarks/Misc/fbench: -2.65% (3.3840 => 3.2943, std.dev.: 0.0292) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.64% (2.6356 => 2.5661, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/flops-5: -1.75% (2.8957 => 2.8451, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: -1.63% (15.8853 => 15.6262, std.dev.: 0.0268) MultiSource/Benchmarks/FreeBench/neural/neural: -1.46% (1.0841 => 1.0683, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.34% (4.2466 => 4.1898, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-6: -1.31% (2.4416 => 2.4096, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.13% (4.7794 => 4.7254, std.dev.: 0.0088) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 5.82% (1.0262 => 1.0859, std.dev.: 0.0545) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.43% (0.2463 => 0.3705, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.39% (0.0408 => 0.0430, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.50% (0.0254 => 0.0334, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.97% (0.0302 => 0.0317, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.20% (0.0384 => 0.0427, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 2.22% (0.0180 => 0.0184, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 4.10% (0.1438 => 0.1497, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -5.59% (1.1329 => 1.0696, std.dev.: 0.1911) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.35% (0.4164 => 0.3983, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.65% (0.1369 => 0.1419, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.64% (0.0641 => 0.0592, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 35.90% (0.0195 => 0.0265, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: - (0.0578 => 0.0578, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.53% (1.1437 => 1.1498, std.dev.: 0.0162) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.31% (0.0627 => 0.0600, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 29.44% (0.0180 => 0.0233, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.26% (0.8017 => 0.8038, std.dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0062 => 0.0062, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 23:04:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 1 Dec 2012 01:04:58 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121201070458.208112A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/6443?compare_to=6439&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 6443, Order: 169077, Start Time: 2012-12-01 04:32:13, End Time: 2012-12-01 07:05:31 To: 6439, Order: 169061, Start Time: 2012-12-01 01:06:51, End Time: 2012-12-01 03:33:42 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 32 (162 on baseline) Performance Improvements: 1 (41 on baseline) Added Tests: 0 (186 on baseline) Existing Failures: 6 (2 on baseline) Unchanged Tests: 1055 (682 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 15.05% (0.7190 => 0.8272, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.29% (0.6708 => 0.7331, std.dev.: 0.0137) MultiSource/Benchmarks/Olden/health/health: 9.25% (0.1460 => 0.1595, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.51% (0.2104 => 0.2283, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/tsp/tsp: 8.46% (0.1418 => 0.1538, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.34% (0.7600 => 0.8234, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.17% (0.4000 => 0.4327, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.16% (0.5647 => 0.6108, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/ary: 8.15% (0.3520 => 0.3807, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.14% (0.4461 => 0.4824, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/methcall: 8.03% (0.3127 => 0.3378, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/objinst: 7.92% (0.3334 => 0.3598, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/moments: 7.91% (0.4488 => 0.4843, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.67% (0.2997 => 0.3227, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.51% (0.3036 => 0.3264, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ary2: 7.43% (0.3689 => 0.3963, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/hash: 7.11% (0.4798 => 0.5139, std.dev.: 0.0131) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.88% (1.3292 => 1.4073, std.dev.: 0.0252) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.60% (0.6826 => 0.7208, std.dev.: 0.0139) MultiSource/Applications/sqlite3/sqlite3: 5.21% (19.2640 => 20.2686, std.dev.: 0.3891) MultiSource/Benchmarks/PAQ8p/paq8p: 4.51% (10.8640 => 11.3539, std.dev.: 0.1399) MultiSource/Applications/SPASS/SPASS: 3.61% (17.6586 => 18.2967, std.dev.: 0.1130) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.26% (8.0907 => 8.2737, std.dev.: 0.0683) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.66% (7.9431 => 9.3456, std.dev.: 0.4036) MultiSource/Benchmarks/Olden/bisort/bisort: 14.65% (0.8675 => 0.9946, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/tsp/tsp: 13.64% (1.1031 => 1.2536, std.dev.: 0.0212) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.34% (9.0115 => 9.9435, std.dev.: 0.0825) SingleSource/Benchmarks/Shootout-C++/hash2: 5.21% (3.3780 => 3.5540, std.dev.: 0.0434) MultiSource/Benchmarks/Olden/bh/bh: 4.27% (1.9563 => 2.0398, std.dev.: 0.0240) SingleSource/Benchmarks/CoyoteBench/huffbench: 2.95% (18.3125 => 18.8520, std.dev.: 0.1996) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.41% (59.5131 => 60.9459, std.dev.: 0.4883) MultiSource/Applications/lua/lua: 1.38% (27.1551 => 27.5293, std.dev.: 0.0739) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/ObjC/synchronized: -71.78% (0.4624 => 0.1305, std.dev.: 0.1245) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -2.13% (69.1402 => 67.6675, std.dev.: 0.9279) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1340 => 0.1340, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0418 => 0.0419, std.dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0653 => 0.0653, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/power/power: -0.12% (493.8871 => 493.3110, std.dev.: 0.9316) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 6.99% (63.2438 => 67.6675, std.dev.: 0.9279) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0419, std.dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 43644.88% (1.1277 => 493.3110, std.dev.: 0.9316) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 195.89% (0.5229 => 1.5472, std.dev.: 0.0944) MultiSource/Applications/SPASS/SPASS: 22.06% (14.9895 => 18.2967, std.dev.: 0.1130) MultiSource/Applications/kimwitu++/kc: 47.25% (14.1553 => 20.8442, std.dev.: 0.2364) MultiSource/Benchmarks/MallocBench/gs/gs: 19.42% (4.1105 => 4.9086, std.dev.: 0.2055) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 42.12% (1.1048 => 1.5701, std.dev.: 0.0625) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 413.27% (7.1582 => 36.7410, std.dev.: 0.6050) SingleSource/Benchmarks/Misc-C++-EH/spirit: 77.36% (3.4629 => 6.1418, std.dev.: 0.3658) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.70% (0.6222 => 1.0372, std.dev.: 0.0521) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10632.08% (0.0720 => 7.7271, std.dev.: 0.1914) MultiSource/Applications/SIBsim4/SIBsim4: 3853900.00% (0.0001 => 3.8540, std.dev.: 0.0306) MultiSource/Applications/SPASS/SPASS: 14779700.00% (0.0001 => 14.7798, std.dev.: 1.0811) MultiSource/Applications/kimwitu++/kc: 51600.00% (0.0001 => 0.0517, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 64300.00% (0.0001 => 0.0644, std.dev.: 0.0132) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14400.00% (0.0001 => 0.0145, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 586200.00% (0.0001 => 0.5863, std.dev.: 0.0182) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10001300.00% (0.0001 => 10.0014, std.dev.: 0.0206) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6513900.00% (0.0001 => 6.5140, std.dev.: 0.4698) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1695.90% (1.1194 => 20.1033, std.dev.: 0.6738) MultiSource/Applications/ClamAV/clamscan: 65.63% (22.1758 => 36.7295, std.dev.: 0.5376) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 59.17% (2.9384 => 4.6771, std.dev.: 0.2523) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 58.44% (7.0540 => 11.1765, std.dev.: 0.1878) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.84% (8.1363 => 12.0289, std.dev.: 0.1483) MultiSource/Applications/JM/lencod/lencod: 47.06% (21.9371 => 32.2611, std.dev.: 0.3227) MultiSource/Benchmarks/FreeBench/distray/distray: 45.36% (0.1056 => 0.1535, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/flops: 44.06% (0.1432 => 0.2063, std.dev.: 0.0078) SingleSource/UnitTests/vla: 40.28% (0.0355 => 0.0498, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 38.90% (0.0730 => 0.1014, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/bisort/bisort: 30.94% (0.0614 => 0.0804, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: 30.89% (0.1175 => 0.1538, std.dev.: 0.0021) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 27.29% (0.0447 => 0.0569, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/voronoi/voronoi: 27.19% (0.2700 => 0.3434, std.dev.: 0.0184) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.03% (0.5105 => 0.6434, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/health/health: 25.79% (0.1268 => 0.1595, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.60% (0.1125 => 0.1413, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/family/family: 25.44% (0.0397 => 0.0498, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 25.30% (0.0834 => 0.1045, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.61% (0.1032 => 0.1286, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/perimeter/perimeter: 24.55% (0.0770 => 0.0959, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.53% (0.0746 => 0.0929, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Oscar: 23.90% (0.0636 => 0.0788, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 23.48% (0.0528 => 0.0652, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.42% (0.2758 => 0.3404, std.dev.: 0.0152) MultiSource/Benchmarks/Olden/em3d/em3d: 23.36% (0.1695 => 0.2091, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 23.36% (0.6675 => 0.8234, std.dev.: 0.0164) MultiSource/Benchmarks/BitBench/drop3/drop3: 23.03% (0.0482 => 0.0593, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.84% (0.1029 => 0.1264, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 22.70% (0.7433 => 0.9120, std.dev.: 0.0379) SingleSource/Benchmarks/Shootout/hash: 22.68% (0.0485 => 0.0595, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 22.44% (0.2554 => 0.3127, std.dev.: 0.0202) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.22% (0.1566 => 0.1914, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout/matrix: 22.00% (0.0818 => 0.0998, std.dev.: 0.0022) MultiSource/Applications/viterbi/viterbi: 21.99% (0.1555 => 0.1897, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/functionobjects: 21.67% (0.5020 => 0.6108, std.dev.: 0.0104) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 21.45% (0.0648 => 0.0787, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.05% (0.3121 => 0.3778, std.dev.: 0.0090) MultiSource/Applications/d/make_dparser: 20.94% (3.3354 => 4.0339, std.dev.: 0.1471) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.90% (0.1584 => 0.1915, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 20.67% (0.1892 => 0.2283, std.dev.: 0.0054) MultiSource/Applications/spiff/spiff: 20.63% (0.7835 => 0.9451, std.dev.: 0.0228) SingleSource/Benchmarks/Shootout-C++/spellcheck: 20.58% (0.4203 => 0.5068, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/reversefile: 20.54% (0.3865 => 0.4659, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 20.51% (0.5981 => 0.7208, std.dev.: 0.0139) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.41% (0.4615 => 0.5557, std.dev.: 0.0135) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.30% (0.0793 => 0.0954, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/whetstone: 20.15% (0.0660 => 0.0793, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 20.15% (1.1642 => 1.3988, std.dev.: 0.0560) SingleSource/Benchmarks/Shootout-C++/hash: 19.82% (0.4289 => 0.5139, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/sieve: 19.82% (0.3603 => 0.4317, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/hash2: 19.78% (0.4620 => 0.5534, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/moments: 19.64% (0.4048 => 0.4843, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.53% (4.9449 => 5.9108, std.dev.: 0.0843) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.24% (0.3441 => 0.4103, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.23% (0.5860 => 0.6987, std.dev.: 0.0288) MultiSource/Benchmarks/nbench/nbench: 19.10% (1.1840 => 1.4102, std.dev.: 0.0472) MultiSource/Applications/lua/lua: 19.07% (3.8723 => 4.6109, std.dev.: 0.1621) SingleSource/Benchmarks/Misc/perlin: 19.03% (0.0536 => 0.0638, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: 18.70% (0.4064 => 0.4824, std.dev.: 0.0116) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.65% (1.1861 => 1.4073, std.dev.: 0.0252) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 18.62% (0.1337 => 0.1586, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.56% (0.9765 => 1.1577, std.dev.: 0.0269) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 18.55% (0.3650 => 0.4327, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/lists: 18.38% (0.3422 => 0.4051, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 18.28% (0.0640 => 0.0757, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 18.28% (0.4103 => 0.4853, std.dev.: 0.0129) MultiSource/Benchmarks/sim/sim: 18.04% (0.3387 => 0.3998, std.dev.: 0.0099) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 18.01% (0.8101 => 0.9560, std.dev.: 0.0148) MultiSource/Applications/sqlite3/sqlite3: 17.97% (17.1811 => 20.2686, std.dev.: 0.3891) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.80% (0.0871 => 0.1026, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary: 17.79% (0.3232 => 0.3807, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.61% (2.0665 => 2.4305, std.dev.: 0.0742) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.52% (0.0953 => 0.1120, std.dev.: 0.0042) SingleSource/Regression/C++/ofstream_ctor: 17.49% (0.2905 => 0.3413, std.dev.: 0.0176) SingleSource/Benchmarks/Shootout-C++/matrix: 17.43% (0.3098 => 0.3638, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/methcall: 17.41% (0.2877 => 0.3378, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ary2: 17.28% (0.3379 => 0.3963, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout/lists: 17.25% (0.0626 => 0.0734, std.dev.: 0.0040) SingleSource/UnitTests/SignlessTypes/rem: 17.13% (0.1144 => 0.1340, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 17.11% (0.0672 => 0.0787, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.09% (0.2756 => 0.3227, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.08% (0.8067 => 0.9445, std.dev.: 0.0331) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.91% (0.8172 => 0.9554, std.dev.: 0.0382) SingleSource/Benchmarks/Shootout-C++/random: 16.88% (0.2802 => 0.3275, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.86% (0.2793 => 0.3264, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.81% (0.2891 => 0.3377, std.dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/lpbench: 16.79% (0.0929 => 0.1085, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.68% (0.2872 => 0.3351, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.64% (5.0018 => 5.8340, std.dev.: 0.1336) SingleSource/Benchmarks/Shootout-C++/hello: 16.62% (0.2714 => 0.3165, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/strcat: 16.53% (0.2831 => 0.3299, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.48% (4.2646 => 4.9675, std.dev.: 0.2324) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.25% (0.0886 => 0.1030, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.13% (0.2065 => 0.2398, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 16.10% (0.0770 => 0.0894, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: 16.07% (0.8921 => 1.0355, std.dev.: 0.0330) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.03% (0.1117 => 0.1296, std.dev.: 0.0049) MultiSource/Applications/oggenc/oggenc: 16.01% (5.7591 => 6.6809, std.dev.: 0.2561) MultiSource/Benchmarks/NPB-serial/is/is: 15.86% (0.0719 => 0.0833, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 15.71% (1.4186 => 1.6414, std.dev.: 0.0458) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.61% (0.3427 => 0.3962, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.37% (14.3668 => 16.5754, std.dev.: 0.4415) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.19% (0.2107 => 0.2427, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/objinst: 14.92% (0.3131 => 0.3598, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.82% (0.3307 => 0.3797, std.dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.63% (0.5569 => 0.6384, std.dev.: 0.0234) MultiSource/Applications/sgefa/sgefa: 14.51% (0.3109 => 0.3560, std.dev.: 0.0141) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.50% (0.1062 => 0.1216, std.dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: 14.16% (9.4845 => 10.8271, std.dev.: 0.4475) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.00% (0.2271 => 0.2589, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.80% (1.5415 => 1.7542, std.dev.: 0.0762) SingleSource/UnitTests/ObjC/parameter-passing: 13.32% (0.3927 => 0.4450, std.dev.: 0.0124) SingleSource/UnitTests/ObjC/property: 13.12% (0.3886 => 0.4396, std.dev.: 0.0120) SingleSource/UnitTests/ObjC/exceptions-4: 12.84% (0.3543 => 0.3998, std.dev.: 0.0139) SingleSource/UnitTests/ObjC/trivial-interface: 12.78% (0.3473 => 0.3917, std.dev.: 0.0095) SingleSource/UnitTests/ObjC/exceptions: 12.72% (0.3828 => 0.4315, std.dev.: 0.0187) SingleSource/UnitTests/ObjC/synchronized: 12.72% (0.3561 => 0.4014, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/exceptions-3: 12.71% (0.3516 => 0.3963, std.dev.: 0.0148) SingleSource/UnitTests/ObjC/exceptions-2: 12.64% (0.3497 => 0.3939, std.dev.: 0.0126) MultiSource/Applications/lemon/lemon: 12.57% (1.0722 => 1.2070, std.dev.: 0.0409) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.53% (0.0838 => 0.0943, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference-object: 11.11% (0.6030 => 0.6700, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/lists1: 11.07% (0.3684 => 0.4092, std.dev.: 0.0139) SingleSource/UnitTests/ObjC++/Hello: 10.95% (0.5925 => 0.6574, std.dev.: 0.0137) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.85% (0.1143 => 0.1267, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference: 10.59% (0.7326 => 0.8102, std.dev.: 0.0180) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.50% (0.1438 => 0.1589, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 10.49% (0.1268 => 0.1401, std.dev.: 0.0052) MultiSource/Benchmarks/PAQ8p/paq8p: 9.52% (10.3673 => 11.3539, std.dev.: 0.1399) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.03% (0.4879 => 0.5271, std.dev.: 0.0111) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.92% (7.9617 => 8.2737, std.dev.: 0.0683) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 149.52% (4.3953 => 10.9672, std.dev.: 0.0326) SingleSource/Benchmarks/Shootout-C++/methcall: 147.20% (5.3999 => 13.3485, std.dev.: 0.0150) MultiSource/Benchmarks/SciMark2-C/scimark2: 80.02% (32.5116 => 58.5284, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/bisort/bisort: 19.36% (0.8333 => 0.9946, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.32% (1.1145 => 1.3075, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/tsp/tsp: 16.24% (1.0785 => 1.2536, std.dev.: 0.0212) SingleSource/Benchmarks/Misc/oourafft: 16.12% (6.6465 => 7.7178, std.dev.: 0.0112) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.55% (8.6802 => 9.9435, std.dev.: 0.0825) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.06% (0.2944 => 0.3358, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash2: 12.55% (3.1578 => 3.5540, std.dev.: 0.0434) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.65% (2.8904 => 3.2270, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 10.26% (1.1396 => 1.2565, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.28% (1.7254 => 1.8856, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.94% (4.2280 => 4.4792, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.92% (0.9540 => 1.0105, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 5.51% (26.0924 => 27.5293, std.dev.: 0.0739) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 5.12% (1.9405 => 2.0398, std.dev.: 0.0240) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.6436 => 12.1024, std.dev.: 0.0267) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.32% (3.6395 => 3.7604, std.dev.: 0.0275) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.15% (1.3677 => 1.3971, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 1.96% (3.1595 => 3.2214, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.92% (2.1424 => 2.1836, std.dev.: 0.0114) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.45% (6.5088 => 6.6034, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.35% (2.3135 => 2.3447, std.dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0313 => 1.0441, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: 1.18% (5.9798 => 6.0502, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 1.12% (85.0658 => 86.0152, std.dev.: 0.2351) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.39% (6.6874 => 0.1744, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.13% (5.2763 => 1.2594, std.dev.: 0.0373) SingleSource/Benchmarks/Misc/salsa20: -75.77% (0.8651 => 0.2096, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/richards_benchmark: -45.07% (0.1622 => 0.0891, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.34% (5.3855 => 4.6669, std.dev.: 0.1675) MultiSource/Applications/JM/ldecod/ldecod: -11.90% (10.4361 => 9.1938, std.dev.: 0.4456) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.91% (5.3526 => 4.8224, std.dev.: 0.1050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -64.91% (1.9577 => 0.6869, std.dev.: 0.0093) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -47.75% (0.0400 => 0.0209, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.20% (0.0628 => 0.0363, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.16% (0.3987 => 0.2386, std.dev.: 0.0217) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.12% (0.0506 => 0.0303, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -38.29% (4.5009 => 2.7773, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.49% (1.1492 => 0.7643, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.15% (2.6546 => 2.0135, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -19.25% (0.2161 => 0.1745, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -15.77% (1.6925 => 1.4256, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.73% (2.6778 => 2.2833, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -10.68% (1.5373 => 1.3731, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -10.52% (9.5636 => 8.5575, std.dev.: 0.1589) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4244, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4793, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.79% (3.2416 => 3.0214, std.dev.: 0.0282) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.70% (0.3463 => 0.3231, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5761, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -5.50% (19.9488 => 18.8520, std.dev.: 0.1996) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.14% (0.8614 => 0.8171, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-5: -4.98% (1.5835 => 1.5047, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/lists: -4.51% (6.2999 => 6.0156, std.dev.: 0.0141) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.47% (1.6805 => 1.6054, std.dev.: 0.0077) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.43% (0.4808 => 0.4643, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.20% (0.9957 => 0.9638, std.dev.: 0.0076) MultiSource/Benchmarks/sim/sim: -3.13% (5.0483 => 4.8903, std.dev.: 0.0050) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.80% (8.1563 => 8.0095, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -1.48% (10.2830 => 10.1305, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.76% (0.1485 => 0.1340, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.14% (0.2116 => 0.0653, std.dev.: 0.0077) Report Time: 2.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 23:24:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 1 Dec 2012 01:24:57 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121201072457.102FD2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/6444?compare_to=6441&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 6444, Order: 169079, Start Time: 2012-12-01 05:50:39, End Time: 2012-12-01 07:25:33 To: 6441, Order: 169077, Start Time: 2012-12-01 03:52:39, End Time: 2012-12-01 05:27:38 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (6 on baseline) Performance Improvements: 0 (185 on baseline) Added Tests: 0 (52 on baseline) Unchanged Tests: 1094 (851 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 6.91% (0.3834 => 0.4099, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 74.93% (31.3723 => 54.8784, std.dev.: 0.0138) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.81% (2.0478 => 2.1054, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/salsa20: 2.33% (7.4937 => 7.6680, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/hash2: 2.25% (3.1932 => 3.2652, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.01% (0.1431 => 0.1302, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.98% (0.3821 => 0.3516, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.57% (0.9542 => 0.8820, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -6.88% (2.4924 => 2.3209, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.78% (0.3142 => 0.2929, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -6.66% (0.3812 => 0.3558, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.63% (0.3831 => 0.3577, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: -6.57% (0.3896 => 0.3640, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -6.55% (0.3848 => 0.3596, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.54% (0.3884 => 0.3630, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -6.52% (0.3357 => 0.3138, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/exceptions-4: -6.49% (0.3880 => 0.3628, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.43% (0.3891 => 0.3641, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -6.42% (0.4176 => 0.3908, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.40% (0.4033 => 0.3775, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.34% (0.2428 => 0.2274, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -6.30% (0.2160 => 0.2024, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.18% (0.1796 => 0.1685, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: -6.12% (0.4199 => 0.3942, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.11% (0.7198 => 0.6758, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/ReedSolomon: -6.07% (0.1879 => 0.1765, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.03% (0.2355 => 0.2213, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -6.03% (7.0961 => 6.6685, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.00% (0.6484 => 0.6095, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.99% (0.3658 => 0.3439, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.97% (0.5478 => 0.5151, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -5.97% (16.1920 => 15.2257, std.dev.: 0.0258) SingleSource/Benchmarks/McGill/chomp: -5.96% (0.1761 => 0.1656, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.94% (0.5805 => 0.5460, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -5.94% (9.2283 => 8.6799, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.94% (0.5863 => 0.5515, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -5.91% (0.4280 => 0.4027, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.89% (0.9852 => 0.9272, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.82% (6.7716 => 6.3773, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.82% (0.5567 => 0.5243, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.82% (1.3722 => 1.2924, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.78% (4.8161 => 4.5378, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.78% (0.5575 => 0.5253, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.77% (0.5802 => 0.5467, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.77% (0.5859 => 0.5521, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.74% (4.0323 => 3.8007, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: -5.73% (0.9179 => 0.8653, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.72% (0.5581 => 0.5262, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.71% (0.5688 => 0.5363, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.71% (1.0544 => 0.9942, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.69% (0.5849 => 0.5516, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.69% (1.2300 => 1.1600, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.69% (0.5857 => 0.5524, std.dev.: 0.0079) MultiSource/Benchmarks/MallocBench/gs/gs: -5.68% (4.3330 => 4.0870, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.68% (0.6395 => 0.6032, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.67% (0.5925 => 0.5589, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.67% (4.8802 => 4.6035, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.67% (0.5591 => 0.5274, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.66% (0.5456 => 0.5147, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.63% (0.6230 => 0.5879, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.62% (0.3931 => 0.3710, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.60% (0.7524 => 0.7103, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.59% (0.6260 => 0.5910, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.59% (0.6676 => 0.6303, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.58% (0.5569 => 0.5258, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.58% (0.6304 => 0.5952, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.58% (0.6395 => 0.6038, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.57% (0.2695 => 0.2545, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.56% (0.3057 => 0.2887, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.56% (4.5069 => 4.2565, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.55% (0.6194 => 0.5850, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.55% (0.6033 => 0.5698, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -5.54% (1.3148 => 1.2419, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.54% (0.6297 => 0.5948, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.52% (1.6364 => 1.5461, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.51% (0.7919 => 0.7483, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.50% (0.6052 => 0.5719, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.49% (0.7339 => 0.6936, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.47% (1.2784 => 1.2085, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.47% (0.6293 => 0.5949, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.46% (0.6189 => 0.5851, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.43% (0.8521 => 0.8058, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.43% (0.6681 => 0.6318, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.42% (0.5941 => 0.5619, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.42% (0.5705 => 0.5396, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.42% (0.2548 => 0.2410, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.41% (3.5339 => 3.3426, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.41% (0.3252 => 0.3076, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -5.40% (1.1450 => 1.0832, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: -5.40% (1.3864 => 1.3116, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.39% (1.4642 => 1.3853, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.39% (0.6440 => 0.6093, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -5.39% (1.1530 => 1.0909, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.37% (0.6736 => 0.6374, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.36% (2.1713 => 2.0549, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.35% (0.2933 => 0.2776, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.35% (0.5570 => 0.5272, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.34% (0.3837 => 0.3632, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.34% (0.6446 => 0.6102, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.33% (0.3323 => 0.3146, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -5.29% (0.2985 => 0.2827, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.28% (14.2083 => 13.4575, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.27% (0.2903 => 0.2750, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.27% (0.4916 => 0.4657, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.27% (0.2659 => 0.2519, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: -5.26% (0.3059 => 0.2898, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -5.26% (0.3025 => 0.2866, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.23% (0.3194 => 0.3027, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -5.23% (0.4515 => 0.4279, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.22% (1.2221 => 1.1583, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: -5.21% (0.2939 => 0.2786, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.20% (0.5999 => 0.5687, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.18% (1.2210 => 1.1577, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.18% (0.4151 => 0.3936, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -5.18% (0.3205 => 0.3039, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.17% (0.3406 => 0.3230, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: -5.16% (0.2849 => 0.2702, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.15% (17.1032 => 16.2226, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/ary2: -5.14% (0.3481 => 0.3302, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -5.14% (0.3446 => 0.3269, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -5.13% (0.3394 => 0.3220, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.09% (0.2278 => 0.2162, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: -5.08% (15.5079 => 14.7204, std.dev.: 0.0122) MultiSource/Applications/Burg/burg: -5.06% (1.2515 => 1.1882, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.05% (8.0126 => 7.6077, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.05% (0.3483 => 0.3307, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -5.05% (0.2989 => 0.2838, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.05% (0.4813 => 0.4570, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.04% (0.3255 => 0.3091, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -5.04% (3.5154 => 3.3383, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/18-imp/imp: -5.03% (0.3581 => 0.3401, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -5.02% (0.4861 => 0.4617, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.97% (0.3016 => 0.2866, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.97% (0.2999 => 0.2850, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -4.94% (34.0927 => 32.4093, std.dev.: 0.0260) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.94% (0.3849 => 0.3659, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -4.93% (4.0594 => 3.8592, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.92% (0.6660 => 0.6332, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.91% (0.4321 => 0.4109, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.91% (0.2385 => 0.2268, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: -4.89% (0.3621 => 0.3444, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.84% (15.2527 => 14.5145, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/moments: -4.80% (0.4248 => 0.4044, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/except: -4.79% (0.3026 => 0.2881, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -4.75% (0.7447 => 0.7093, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists1: -4.68% (0.3867 => 0.3686, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -4.62% (2.1401 => 2.0413, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.60% (0.6667 => 0.6360, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.60% (1.6474 => 1.5717, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.58% (0.4083 => 0.3896, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -4.56% (0.7982 => 0.7618, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: -4.53% (18.2933 => 17.4640, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.51% (0.5168 => 0.4935, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -4.49% (0.3271 => 0.3124, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.42% (22.4056 => 21.4151, std.dev.: 0.0267) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.40% (0.3319 => 0.3173, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.39% (0.9557 => 0.9137, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.39% (0.7021 => 0.6713, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.38% (5.0226 => 4.8025, std.dev.: 0.0052) MultiSource/Applications/spiff/spiff: -4.36% (0.8418 => 0.8051, std.dev.: 0.0020) MultiSource/Applications/siod/siod: -4.34% (2.4021 => 2.2979, std.dev.: 0.0181) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.30% (0.9077 => 0.8687, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.28% (0.5329 => 0.5101, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -4.18% (0.4524 => 0.4335, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -4.10% (0.6750 => 0.6473, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.95% (0.4427 => 0.4252, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -3.94% (0.6347 => 0.6097, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -3.88% (0.3788 => 0.3641, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.81% (0.3491 => 0.3358, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -3.80% (0.6441 => 0.6196, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.75% (2.2587 => 2.1739, std.dev.: 0.0060) MultiSource/Applications/hbd/hbd: -3.74% (1.5610 => 1.5026, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference: -3.70% (0.7779 => 0.7491, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.94% (5.4682 => 5.3076, std.dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -2.61% (20.7746 => 20.2326, std.dev.: 0.0622) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.53% (1.8100 => 0.6782, std.dev.: 0.0129) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7533, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1729, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: -3.90% (2.2633 => 2.1750, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7068, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3992, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4671, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.11% (1.0217 => 1.0104, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 23:34:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 1 Dec 2012 01:34:39 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121201073439.AD1D42A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/6445?compare_to=6442&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 6445, Order: 169079, Start Time: 2012-12-01 06:01:54, End Time: 2012-12-01 07:35:17 To: 6442, Order: 169077, Start Time: 2012-12-01 04:09:49, End Time: 2012-12-01 05:45:05 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 4 (135 on baseline) Performance Improvements: 9 (48 on baseline) Added Tests: 0 (51 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1040 (791 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 2.98% (8.5313 => 8.7854, std.dev.: 0.0454) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 17.86% (20.8640 => 24.5894, std.dev.: 1.1566) MultiSource/Benchmarks/llubenchmark/llu: 2.00% (1.9931 => 2.0329, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.14% (1.5621 => 1.5799, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -5.85% (0.1845 => 0.1737, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -3.16% (1.0358 => 1.0031, std.dev.: 0.0081) MultiSource/Applications/Burg/burg: -2.55% (1.3200 => 1.2863, std.dev.: 0.0088) MultiSource/Applications/minisat/minisat: -1.61% (0.7164 => 0.7049, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.49% (0.8721 => 0.8591, std.dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/nestedloop: -6.07% (0.2159 => 0.2028, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: -3.78% (8.6263 => 8.3003, std.dev.: 0.0615) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.48% (4.6030 => 4.5351, std.dev.: 0.0243) SingleSource/Benchmarks/Misc/whetstone: -1.14% (2.1886 => 2.1636, std.dev.: 0.0074) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -2.25% (1.0859 => 1.0615, std.dev.: 0.0143) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.22% (0.3705 => 0.3697, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.45% (0.0220 => 0.0219, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.70% (0.0430 => 0.0427, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0334 => 0.0335, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -13.88% (0.0317 => 0.0273, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.47% (0.0427 => 0.0425, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/casts: -29.41% (0.0204 => 0.0144, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/test1: 17.93% (0.0184 => 0.0217, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -2.40% (0.1497 => 0.1461, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 5.67% (1.0696 => 1.1302, std.dev.: 0.0355) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.70% (0.3983 => 0.4011, std.dev.: 0.0203) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.47% (0.1419 => 0.1525, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.87% (0.0592 => 0.0575, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -19.25% (0.0265 => 0.0214, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.33% (0.0578 => 0.0553, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.71% (1.1498 => 1.1416, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -36.67% (0.0030 => 0.0019, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.00% (0.0600 => 0.0510, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.74% (0.0233 => 0.0194, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.05% (0.8038 => 0.8042, std.dev.: 0.0193) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.81% (0.0062 => 0.0046, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.13% (8.6089 => 8.6201, std.dev.: 0.0203) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 8.93% (16.4461 => 17.9154, std.dev.: 0.0526) MultiSource/Applications/sqlite3/sqlite3: 2343.57% (0.6332 => 15.4727, std.dev.: 0.1312) MultiSource/Benchmarks/McCat/08-main/main: 50.03% (0.1831 => 0.2747, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.58% (0.1559 => 0.1472, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7175.60% (0.3123 => 22.7217, std.dev.: 0.1870) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1531.79% (0.3344 => 5.4567, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.24% (0.2364 => 0.3268, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 4.98% (0.6010 => 0.6309, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/mandel: 2.80% (0.0429 => 0.0441, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.80% (0.3266 => 0.3390, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: 3.20% (0.1969 => 0.2032, std.dev.: 0.0008) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.80% (0.0224 => 0.0237, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -30.87% (0.0230 => 0.0159, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0442, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 10.60% (0.1462 => 0.1617, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4051, std.dev.: 0.0459) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0732, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4938, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5209, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2564, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0705, std.dev.: 0.0525) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3617, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3789, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0836, std.dev.: 0.0059) SingleSource/Regression/C/uint64_to_float: -29.56% (2.1832 => 1.5378, std.dev.: 0.0145) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.19% (0.0810 => 0.0933, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 13.94% (0.1112 => 0.1267, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.20% (0.0773 => 0.0875, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.74% (0.0848 => 0.0956, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.05% (0.2180 => 0.2399, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.28% (0.4127 => 0.4510, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.15% (0.1137 => 0.1241, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.73% (0.1157 => 0.1258, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.19% (0.1466 => 0.1586, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 8.09% (0.1347 => 0.1456, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.86% (0.1425 => 0.1537, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.55% (2.1401 => 2.3017, std.dev.: 0.0048) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.24% (0.3137 => 0.3364, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.03% (0.7473 => 0.7998, std.dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.86% (1.5315 => 1.6366, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.66% (0.8321 => 0.8875, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.32% (0.9435 => 1.0031, std.dev.: 0.0081) MultiSource/Benchmarks/sim/sim: 6.26% (0.3226 => 0.3428, std.dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 6.11% (1.1271 => 1.1960, std.dev.: 0.0159) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.09% (0.1905 => 0.2021, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.04% (13.1811 => 13.9770, std.dev.: 0.1973) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.91% (3.1832 => 3.3714, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.89% (0.2240 => 0.2372, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.36% (0.1885 => 0.1986, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.35% (0.8148 => 0.8584, std.dev.: 0.0160) MultiSource/Applications/Burg/burg: 5.24% (1.2222 => 1.2863, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5.24% (0.9908 => 1.0427, std.dev.: 0.0061) MultiSource/Applications/siod/siod: 5.23% (2.2184 => 2.3344, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 5.20% (0.8697 => 0.9149, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.11% (1.6386 => 1.7223, std.dev.: 0.0200) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.05% (0.2378 => 0.2498, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.91% (0.5191 => 0.5446, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.88% (0.2133 => 0.2237, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.83% (14.2605 => 14.9493, std.dev.: 0.0552) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.78% (1.1170 => 1.1704, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.74% (0.8611 => 0.9019, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 4.71% (0.8855 => 0.9272, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.70% (0.3003 => 0.3144, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.69% (0.9688 => 1.0142, std.dev.: 0.0092) MultiSource/Applications/treecc/treecc: 4.66% (1.9948 => 2.0878, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.65% (0.8518 => 0.8914, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 4.62% (0.9069 => 0.9488, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.62% (0.8420 => 0.8809, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.61% (0.8069 => 0.8441, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.61% (0.8331 => 0.8715, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/football/football: 4.60% (0.8768 => 0.9171, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.54% (0.8286 => 0.8662, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.52% (1.2526 => 1.3092, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 4.51% (0.9039 => 0.9447, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.51% (0.9074 => 0.9483, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 4.46% (0.8204 => 0.8570, std.dev.: 0.0050) SingleSource/UnitTests/Vector/constpool: 4.37% (8.4179 => 8.7854, std.dev.: 0.0454) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4.30% (0.8317 => 0.8675, std.dev.: 0.0065) MultiSource/Benchmarks/PAQ8p/paq8p: 4.23% (2.3764 => 2.4770, std.dev.: 0.0163) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.20% (1.1606 => 1.2093, std.dev.: 0.0109) MultiSource/Applications/lemon/lemon: 4.17% (1.0945 => 1.1401, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 4.16% (0.8597 => 0.8955, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.11% (0.8050 => 0.8381, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.10% (0.8656 => 0.9011, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.07% (0.7966 => 0.8290, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 4.07% (0.8927 => 0.9290, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.01% (8.6476 => 8.9944, std.dev.: 0.0613) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.97% (0.7932 => 0.8247, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.96% (0.8712 => 0.9057, std.dev.: 0.0082) MultiSource/Benchmarks/mafft/pairlocalalign: 3.93% (8.6247 => 8.9633, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.92% (0.8007 => 0.8321, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.91% (0.8086 => 0.8402, std.dev.: 0.0079) MultiSource/Applications/sgefa/sgefa: 3.90% (0.2999 => 0.3116, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.90% (0.8805 => 0.9148, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.88% (0.8177 => 0.8494, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.87% (0.8261 => 0.8581, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.86% (0.8048 => 0.8359, std.dev.: 0.0102) MultiSource/Applications/JM/lencod/lencod: 3.85% (15.3280 => 15.9177, std.dev.: 0.0593) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.81% (0.8716 => 0.9048, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.79% (0.4559 => 0.4732, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.79% (0.8316 => 0.8631, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.74% (0.8338 => 0.8650, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.67% (0.8359 => 0.8666, std.dev.: 0.0080) MultiSource/Applications/ClamAV/clamscan: 3.64% (14.7684 => 15.3056, std.dev.: 0.0881) MultiSource/Benchmarks/Olden/bh/bh: 3.58% (0.2985 => 0.3092, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 3.56% (4.1305 => 4.2775, std.dev.: 0.0436) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.44% (1.2602 => 1.3035, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.43% (0.3115 => 0.3222, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.40% (0.6227 => 0.6439, std.dev.: 0.0040) MultiSource/Applications/SIBsim4/SIBsim4: 3.37% (1.2568 => 1.2991, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.31% (0.6586 => 0.6804, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.26% (0.8066 => 0.8329, std.dev.: 0.0087) MultiSource/Applications/JM/ldecod/ldecod: 3.25% (6.7320 => 6.9511, std.dev.: 0.0233) MultiSource/Applications/minisat/minisat: 3.15% (0.6834 => 0.7049, std.dev.: 0.0026) MultiSource/Applications/lua/lua: 3.06% (3.8189 => 3.9357, std.dev.: 0.0313) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.01% (0.8340 => 0.8591, std.dev.: 0.0020) MultiSource/Applications/d/make_dparser: 2.87% (3.2366 => 3.3294, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.75% (1.4479 => 1.4877, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.66% (4.4873 => 4.6068, std.dev.: 0.0454) MultiSource/Benchmarks/Bullet/bullet: 2.64% (31.8598 => 32.7023, std.dev.: 0.0583) MultiSource/Applications/oggenc/oggenc: 2.33% (4.9628 => 5.0786, std.dev.: 0.0127) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 198.44% (28.5821 => 85.2990, std.dev.: 0.1102) SingleSource/Benchmarks/Misc/pi: 40.06% (1.5795 => 2.2122, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 27.52% (2.9096 => 3.7102, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.17% (4.8436 => 5.8692, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.84% (8.2783 => 9.7548, std.dev.: 0.0330) SingleSource/Benchmarks/McGill/misr: 16.97% (0.4001 => 0.4680, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.30% (0.7597 => 0.8835, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.44% (2.7995 => 3.1199, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.42% (0.3186 => 0.3550, std.dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.10% (14.6451 => 16.1249, std.dev.: 0.5123) MultiSource/Applications/lambda-0_1_3/lambda: 10.04% (7.4933 => 8.2456, std.dev.: 0.0213) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.03% (1.1857 => 1.3046, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.35% (23.5781 => 25.3110, std.dev.: 0.0100) MultiSource/Benchmarks/Olden/mst/mst: 7.22% (0.1386 => 0.1486, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.14% (3.9917 => 4.2768, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.11% (3.3761 => 3.5825, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.02% (2.9753 => 3.1543, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.99% (4.8660 => 5.1575, std.dev.: 0.0936) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.76% (4.5327 => 4.7940, std.dev.: 0.0720) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.54% (0.3937 => 0.4155, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 5.38% (0.4353 => 0.4587, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.31% (5.3218 => 5.6045, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.23% (5.4187 => 5.7020, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.81% (0.5214 => 0.5465, std.dev.: 0.0020) MultiSource/Applications/aha/aha: 4.65% (3.3398 => 3.4952, std.dev.: 0.0161) SingleSource/Benchmarks/Misc/richards_benchmark: 4.44% (1.3037 => 1.3616, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: 3.47% (1.2061 => 1.2479, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.46% (4.8362 => 5.0036, std.dev.: 0.0178) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.46% (0.3587 => 0.3711, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 2.83% (6.7064 => 6.8965, std.dev.: 0.0676) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.27% (3.4104 => 3.4878, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/whetstone: 1.94% (2.1224 => 2.1636, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/methcall: 1.91% (8.2676 => 8.4253, std.dev.: 0.0155) MultiSource/Benchmarks/llubenchmark/llu: 1.81% (1.9967 => 2.0329, std.dev.: 0.0050) SingleSource/Benchmarks/McGill/queens: 1.74% (1.7056 => 1.7352, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.55% (11.5690 => 11.7486, std.dev.: 0.0184) MultiSource/Benchmarks/Olden/bh/bh: 1.47% (2.3560 => 2.3907, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 1.30% (91.7701 => 92.9644, std.dev.: 0.4412) MultiSource/Applications/spiff/spiff: 1.16% (2.8561 => 2.8892, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -42.43% (2.8951 => 1.6667, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -25.35% (7.2130 => 5.3843, std.dev.: 0.1488) MultiSource/Benchmarks/Ptrdist/ks/ks: -20.30% (1.4529 => 1.1580, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.62% (9.9065 => 8.2601, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/ary3: -13.37% (1.9999 => 1.7326, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/em3d/em3d: -12.70% (5.4641 => 4.7704, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -10.58% (0.3269 => 0.2923, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-8: -9.48% (2.5609 => 2.3180, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: -9.05% (63.1822 => 57.4635, std.dev.: 0.0380) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.60% (1.0512 => 0.9608, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.54% (3.2169 => 2.9742, std.dev.: 0.0076) SingleSource/Benchmarks/Stanford/FloatMM: -6.64% (0.8807 => 0.8222, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.33% (4.7482 => 4.4476, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/sieve: -6.25% (7.0599 => 6.6188, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.23% (5.1305 => 4.8108, std.dev.: 0.0236) SingleSource/Benchmarks/Misc/flops: -5.51% (9.3748 => 8.8586, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.32% (6.2275 => 5.8962, std.dev.: 0.0199) SingleSource/Benchmarks/Misc/ffbench: -4.86% (1.4296 => 1.3601, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.81% (5.6343 => 5.3631, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.53% (4.7449 => 4.5299, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.36% (4.9453 => 4.7298, std.dev.: 0.0086) MultiSource/Applications/lua/lua: -4.06% (29.8330 => 28.6229, std.dev.: 0.1666) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.80% (3.7148 => 3.5737, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.75% (5.1557 => 4.9624, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: -3.74% (8.9760 => 8.6400, std.dev.: 0.0199) SingleSource/Benchmarks/Misc/perlin: -3.73% (5.1084 => 4.9181, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.64% (2.8773 => 2.7725, std.dev.: 0.0242) MultiSource/Applications/siod/siod: -3.51% (3.6643 => 3.5358, std.dev.: 0.0163) SingleSource/Benchmarks/Misc/himenobmtxpa: -3.48% (4.3552 => 4.2037, std.dev.: 0.0324) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.39% (4.9686 => 4.8003, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.32% (5.4300 => 5.2498, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.06% (44.5605 => 43.1961, std.dev.: 0.3177) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.83% (2.6356 => 2.5610, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout/hash: -2.72% (4.3087 => 4.1916, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/fbench: -2.63% (3.3840 => 3.2951, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bisort/bisort: -2.40% (0.6636 => 0.6477, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.88% (3.3479 => 3.2848, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -1.79% (0.5807 => 0.5703, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.78% (3.5679 => 3.5043, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: -1.65% (2.8957 => 2.8478, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: -1.63% (15.8853 => 15.6256, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: -1.49% (1.0841 => 1.0680, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-6: -1.35% (2.4416 => 2.4087, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.30% (4.2466 => 4.1914, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: -1.29% (1.4861 => 1.4669, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.12% (1.5308 => 1.5137, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.10% (4.7794 => 4.7268, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.09% (6.0224 => 5.9570, std.dev.: 0.0128) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.44% (1.0262 => 1.0615, std.dev.: 0.0143) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.10% (0.2463 => 0.3697, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.89% (0.0254 => 0.0335, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -9.60% (0.0302 => 0.0273, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/casts: -24.21% (0.0190 => 0.0144, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.60% (0.1438 => 0.1461, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -0.24% (1.1329 => 1.1302, std.dev.: 0.0355) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.67% (0.4164 => 0.4011, std.dev.: 0.0203) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.40% (0.1369 => 0.1525, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.30% (0.0641 => 0.0575, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 9.74% (0.0195 => 0.0214, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.33% (0.0578 => 0.0553, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.18% (1.1437 => 1.1416, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1800.00% (0.0001 => 0.0019, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -18.66% (0.0627 => 0.0510, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.78% (0.0180 => 0.0194, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.31% (0.8017 => 0.8042, std.dev.: 0.0193) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.81% (0.0062 => 0.0046, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Nov 30 23:43:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 1 Dec 2012 01:43:24 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121201074324.E01512A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/6446?compare_to=6437&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 6446, Order: 169077, Start Time: 2012-12-01 04:13:54, End Time: 2012-12-01 07:44:00 To: 6437, Order: 169049, Start Time: 2012-11-30 23:55:29, End Time: 2012-12-01 03:25:34 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 5 (178 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (186 on baseline) Unchanged Tests: 1089 (713 on baseline) Total Tests: 1094 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/Hello: 2.00% (0.6897 => 0.7035, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 1.78% (0.8393 => 0.8542, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 1.77% (0.6962 => 0.7085, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.65% (2.3892 => 2.4286, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 1.56% (1.1492 => 1.1671, std.dev.: 0.0026) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.76% (0.0625 => 0.0886, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.30% (0.1063 => 0.1417, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.21% (0.2969 => 0.3777, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.76% (0.1106 => 0.1402, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.26% (0.4253 => 0.5370, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.88% (0.4139 => 0.5210, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.63% (0.0714 => 0.0897, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.34% (0.5900 => 0.7395, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.19% (0.4994 => 0.6252, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 24.96% (1.5932 => 1.9908, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.84% (0.0475 => 0.0593, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.82% (0.0415 => 0.0518, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.66% (0.5000 => 0.6233, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.53% (0.0897 => 0.1117, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.09% (0.1021 => 0.1267, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.01% (0.1620 => 0.2009, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.97% (0.0584 => 0.0724, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.95% (0.0547 => 0.0678, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.67% (0.1107 => 0.1369, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 22.87% (0.0599 => 0.0736, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.59% (0.0633 => 0.0776, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.27% (0.0642 => 0.0785) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.26% (0.0584 => 0.0714, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.18% (0.0541 => 0.0661, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 22.15% (0.0948 => 0.1158, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.12% (0.1103 => 0.1347, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.78% (0.0822 => 0.1001, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.62% (0.0495 => 0.0602, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.45% (0.3903 => 0.4740, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 21.43% (0.1619 => 0.1966, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.34% (0.1003 => 0.1217, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 21.32% (0.0821 => 0.0996, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.13% (0.1604 => 0.1943, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.11% (0.1549 => 0.1876, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 21.03% (0.0604 => 0.0731, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 20.75% (0.5826 => 0.7035, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 20.59% (0.0947 => 0.1142, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 20.31% (0.5889 => 0.7085, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 19.93% (0.4029 => 0.4832, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.87% (0.3890 => 0.4663, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.86% (0.2014 => 0.2414, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.84% (0.1462 => 0.1752, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 19.80% (0.0808 => 0.0968, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 19.62% (0.1218 => 0.1457, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.49% (1.3152 => 1.5715, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.26% (0.1968 => 0.2347, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 19.12% (0.7171 => 0.8542, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.08% (0.2736 => 0.3258, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/mst/mst: 19.05% (0.0698 => 0.0831, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.88% (0.0572 => 0.0680, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 18.87% (0.1505 => 0.1789, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.84% (0.1088 => 0.1293, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 18.81% (0.9697 => 1.1521, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.81% (3.5627 => 4.2328, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.68% (0.2875 => 0.3412) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.63% (0.2866 => 0.3400, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.52% (0.2738 => 0.3245, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.50% (0.0573 => 0.0679) SingleSource/Benchmarks/Shootout-C++/hello: 18.42% (0.2714 => 0.3214, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 18.42% (0.2725 => 0.3227, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.41% (1.6211 => 1.9196, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 18.36% (0.5546 => 0.6564, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 18.32% (0.2729 => 0.3229, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 18.17% (1.8794 => 2.2209, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.10% (0.3271 => 0.3863, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 18.05% (0.2803 => 0.3309, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 18.02% (0.2780 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.02% (0.2792 => 0.3295, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 18.01% (2.7292 => 3.2208, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/wc: 17.93% (0.3096 => 0.3651, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.90% (0.2911 => 0.3432, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.89% (0.5026 => 0.5925, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.86% (0.4658 => 0.5490, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.85% (0.0605 => 0.0713, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 17.79% (0.2811 => 0.3311, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 17.78% (0.2750 => 0.3239, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 17.78% (0.9909 => 1.1671, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.76% (0.1160 => 0.1366, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: 17.74% (0.2813 => 0.3312, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 17.66% (0.1421 => 0.1672, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 17.64% (0.2823 => 0.3321, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 17.52% (1.0781 => 1.2670, std.dev.: 0.0039) SingleSource/Regression/C++/ofstream_ctor: 17.51% (0.3004 => 0.3530, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.48% (2.0673 => 2.4286, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-2: 17.44% (0.3446 => 0.4047, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 17.43% (0.3465 => 0.4069, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.43% (0.3930 => 0.4615, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.43% (0.4361 => 0.5121, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 17.37% (0.3488 => 0.4094, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 17.32% (0.3442 => 0.4038, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.31% (0.3195 => 0.3748, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 17.28% (0.3460 => 0.4058, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.27% (4.4195 => 5.1827, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.25% (0.3060 => 0.3588, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/for-in: 17.25% (0.3496 => 0.4099, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 17.23% (4.2109 => 4.9364, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/synchronized: 17.21% (0.3469 => 0.4066, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 16.98% (0.1284 => 0.1502, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 16.93% (0.3267 => 0.3820, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 16.88% (0.3258 => 0.3808, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 16.77% (0.3650 => 0.4262, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 16.72% (0.3643 => 0.4252, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 16.67% (0.3317 => 0.3870, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.60% (0.3362 => 0.3920, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.55% (1.9694 => 2.2953, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.52% (0.3124 => 0.3640, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 16.49% (0.3724 => 0.4338, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 16.42% (0.3678 => 0.4282, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.37% (1.9966 => 2.3234, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.18% (0.3282 => 0.3813, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.02% (0.3845 => 0.4461, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 15.90% (0.2075 => 0.2405, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 15.89% (0.3348 => 0.3880, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 15.89% (0.3726 => 0.4318, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.87% (0.1090 => 0.1263, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 15.87% (0.4146 => 0.4804, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/lists1: 15.67% (0.3477 => 0.4022, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.64% (0.3625 => 0.4192, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.56% (0.3690 => 0.4264, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 15.36% (23.5202 => 27.1329, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.30% (0.3981 => 0.4590, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 15.28% (0.2566 => 0.2958, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 15.24% (0.4251 => 0.4899, std.dev.: 0.0083) MultiSource/Applications/lua/lua: 15.15% (1.4269 => 1.6431, std.dev.: 0.0022) MultiSource/Applications/treecc/treecc: 14.96% (0.7875 => 0.9053, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 14.66% (2.1653 => 2.4827, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 14.66% (2.1013 => 2.4093, std.dev.: 0.0080) MultiSource/Applications/JM/lencod/lencod: 14.59% (4.6177 => 5.2916, std.dev.: 0.0067) MultiSource/Benchmarks/sim/sim: 14.38% (0.0758 => 0.0867, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.32% (0.1383 => 0.1581, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 14.21% (0.5012 => 0.5724, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.73% (0.2040 => 0.2320, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 13.60% (0.2691 => 0.3057, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.84% (0.6435 => 0.7261, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 12.68% (5.5417 => 6.2442, std.dev.: 0.0074) MultiSource/Applications/lambda-0_1_3/lambda: 12.04% (0.3498 => 0.3919, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.75% (0.2068 => 0.2311, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.73% (0.2737 => 0.3058, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.67% (0.1028 => 0.1148, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 11.58% (0.6634 => 0.7402, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.25% (0.3084 => 0.3431, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 11.16% (0.4847 => 0.5388, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 10.58% (0.3336 => 0.3689, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 10.54% (0.2391 => 0.2643, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 10.33% (2.0346 => 2.2447, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.13% (0.2103 => 0.2316, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.95% (0.5361 => 0.5841, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.75% (11.6398 => 12.6587, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.39% (4.6926 => 5.0863, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.06% (0.5584 => 0.6034, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.99% (0.7426 => 0.8019, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.81% (0.3792 => 0.4088, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 7.45% (11.9555 => 12.8464, std.dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.67% (29.0505 => 181.4693, std.dev.: 0.0316) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 9.81% (0.2802 => 0.3077, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6093, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.25% (0.3693 => 0.3887, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6719, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1652, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.58% (79.9355 => 83.5933, std.dev.: 0.0109) SingleSource/Benchmarks/Dhrystone/dry: 4.32% (14.0481 => 14.6550, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-2: 4.31% (1.8057 => 1.8836, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/health/health: 3.03% (0.6276 => 0.6466, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1976, std.dev.: 0.0063) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2230, std.dev.: 0.0039) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3050, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2871, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5872, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.74% (25.4195 => 16.5888, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary2: -7.74% (0.2402 => 0.2216, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9771, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7883, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8028, std.dev.: 0.0085) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.78% (0.6293 => 0.6118, std.dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/fldry: -2.75% (17.2379 => 16.7644, std.dev.: 0.0736) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8603, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5759, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4960, std.dev.: 0.0079) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.03% (16.2163 => 16.0487, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.02% (105.3826 => 104.3089, std.dev.: 0.0159) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 2.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: